-- Logs begin at Sun 2022-10-30 00:10:40 UTC, end at Sun 2022-10-30 03:08:26 UTC. -- Oct 30 01:02:36.485150 n-d-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Oct 30 01:02:36.494827 n-d-master-1 devstack@n-api.service[105230]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 30 01:02:36.497675 n-d-master-1 devstack@n-api.service[105230]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Oct 30 01:02:36 2022] *** Oct 30 01:02:36.497675 n-d-master-1 devstack@n-api.service[105230]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 30 01:02:36.497675 n-d-master-1 devstack@n-api.service[105230]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 30 01:02:36.497675 n-d-master-1 devstack@n-api.service[105230]: nodename: n-d-master-1 Oct 30 01:02:36.497675 n-d-master-1 devstack@n-api.service[105230]: machine: x86_64 Oct 30 01:02:36.497675 n-d-master-1 devstack@n-api.service[105230]: clock source: unix Oct 30 01:02:36.497675 n-d-master-1 devstack@n-api.service[105230]: pcre jit disabled Oct 30 01:02:36.497675 n-d-master-1 devstack@n-api.service[105230]: detected number of CPU cores: 4 Oct 30 01:02:36.497675 n-d-master-1 devstack@n-api.service[105230]: current working directory: / Oct 30 01:02:36.497675 n-d-master-1 devstack@n-api.service[105230]: detected binary path: /usr/bin/uwsgi-core Oct 30 01:02:36.497675 n-d-master-1 devstack@n-api.service[105230]: your processes number limit is 47680 Oct 30 01:02:36.499433 n-d-master-1 devstack@n-api.service[105230]: your memory page size is 4096 bytes Oct 30 01:02:36.499433 n-d-master-1 devstack@n-api.service[105230]: detected max file descriptor number: 2048 Oct 30 01:02:36.499433 n-d-master-1 devstack@n-api.service[105230]: lock engine: pthread robust mutexes Oct 30 01:02:36.499433 n-d-master-1 devstack@n-api.service[105230]: thunder lock: enabled Oct 30 01:02:36.499433 n-d-master-1 devstack@n-api.service[105230]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 30 01:02:36.499433 n-d-master-1 devstack@n-api.service[105230]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 30 01:02:36.537315 n-d-master-1 devstack@n-api.service[105230]: Python main interpreter initialized at 0x56219687e9c0 Oct 30 01:02:36.537315 n-d-master-1 devstack@n-api.service[105230]: python threads support enabled Oct 30 01:02:36.537315 n-d-master-1 devstack@n-api.service[105230]: your server socket listen backlog is limited to 100 connections Oct 30 01:02:36.537315 n-d-master-1 devstack@n-api.service[105230]: your mercy for graceful operations on workers is 90 seconds Oct 30 01:02:36.537771 n-d-master-1 devstack@n-api.service[105230]: mapped 403077 bytes (393 KB) for 2 cores Oct 30 01:02:36.537771 n-d-master-1 devstack@n-api.service[105230]: *** Operational MODE: preforking *** Oct 30 01:02:36.538058 n-d-master-1 devstack@n-api.service[105230]: *** uWSGI is running in multiple interpreter mode *** Oct 30 01:02:36.538058 n-d-master-1 devstack@n-api.service[105230]: spawned uWSGI master process (pid: 105230) Oct 30 01:02:36.538853 n-d-master-1 devstack@n-api.service[105230]: spawned uWSGI worker 1 (pid: 105231, cores: 1) Oct 30 01:02:36.538881 n-d-master-1 systemd[1]: Started Devstack devstack@n-api.service. Oct 30 01:02:36.542758 n-d-master-1 devstack@n-api.service[105230]: spawned uWSGI worker 2 (pid: 105232, cores: 1) Oct 30 01:02:36.542758 n-d-master-1 devstack@n-api.service[105230]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 30 01:02:37.216355 n-d-master-1 devstack@n-api.service[105232]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 30 01:02:37.241297 n-d-master-1 devstack@n-api.service[105231]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 30 01:02:38.307157 n-d-master-1 devstack@n-api.service[105231]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 30 01:02:38.307157 n-d-master-1 devstack@n-api.service[105231]: from cryptography.utils import int_from_bytes Oct 30 01:02:38.307882 n-d-master-1 devstack@n-api.service[105231]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 30 01:02:38.307882 n-d-master-1 devstack@n-api.service[105231]: from cryptography.utils import int_from_bytes Oct 30 01:02:38.308241 n-d-master-1 devstack@n-api.service[105232]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 30 01:02:38.308241 n-d-master-1 devstack@n-api.service[105232]: from cryptography.utils import int_from_bytes Oct 30 01:02:38.308670 n-d-master-1 devstack@n-api.service[105232]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 30 01:02:38.308670 n-d-master-1 devstack@n-api.service[105232]: from cryptography.utils import int_from_bytes Oct 30 01:02:40.863860 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 30 01:02:40.864673 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 30 01:02:40.864782 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 30 01:02:40.865121 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 30 01:02:40.865402 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 30 01:02:40.865792 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.866118 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.866436 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.866752 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.867081 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.867396 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.867714 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.868030 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.868356 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.868489 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 30 01:02:40.868886 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.868976 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 30 01:02:40.869072 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.869311 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-master-1 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.869605 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 30 01:02:40.869716 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.869975 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.870069 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 30 01:02:40.870241 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 30 01:02:40.870327 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.870593 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.870697 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.870892 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.871072 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.871210 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.871298 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.871504 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.871609 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.871881 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.871989 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.872194 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.872437 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.872571 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.872770 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.872879 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.873121 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.873278 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.873488 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.873661 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.873824 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.873955 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.874126 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.874213 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-master-1 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.874451 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.874582 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.874803 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.874902 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.875259 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.875396 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.875531 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.875653 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.875790 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.875903 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-master-1 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.876024 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.876137 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.876253 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.876360 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.876658 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.876773 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.877033 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.877160 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.877353 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.877482 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.877748 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.877861 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.878079 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.878204 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.878391 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.878503 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.878697 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.878808 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.879017 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.879158 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.879330 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.879476 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.879646 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.879779 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.879954 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.880078 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.880253 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.880393 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-master-1 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.880562 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.880688 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.880870 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.881003 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.881193 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.881399 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.881620 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.881746 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.881932 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.882057 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.882193 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.882316 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.882478 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.882606 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.882798 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.882924 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.883119 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.883246 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.883442 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.883595 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.883680 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.883825 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.883913 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.884154 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.884239 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.884474 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.884560 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.884783 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.884906 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.885084 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.885170 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.885421 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.885525 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.885743 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.885840 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.886051 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.886141 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.886357 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.886451 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.886606 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.886698 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.886914 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.887008 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.887233 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.887331 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.887554 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.887645 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.887876 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.887970 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.888127 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.888709 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.888895 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.889003 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.889215 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.889424 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.889572 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.889682 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.889881 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.889990 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.890193 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.890346 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.890500 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.890724 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.890807 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.891036 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.891117 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.891394 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.891486 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.891700 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.891836 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.892005 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.892150 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.892325 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.892461 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.892641 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.892772 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.892961 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.893093 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.893267 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.893451 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.893614 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.893759 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.894008 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.894095 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.894259 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.894346 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.894572 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.894659 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.894899 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.894985 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.895206 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.895306 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.895508 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.895594 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.896339 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.896424 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.896503 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.896587 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.896665 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.896741 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.896830 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.896908 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.897017 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.897103 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.897362 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.897451 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.897659 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.897749 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.897970 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.898055 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.898218 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.898302 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.898519 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.898606 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.898824 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.898908 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.899141 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.899232 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.899444 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.899529 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.899750 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.899842 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.900054 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.900156 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.900354 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.900447 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.900659 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.900745 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.900964 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.901048 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.901269 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.901455 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.901645 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.901735 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.901894 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.901996 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.902198 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.902293 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.902500 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.902591 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.902802 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.902895 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.903108 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.903192 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.903412 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.903497 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.903724 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.903832 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.904603 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.904691 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.904913 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.904998 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.905218 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.905402 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.905552 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.905639 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.905856 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.905947 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.906163 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.906264 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.906465 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.906549 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.906766 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.906857 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.907069 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.907162 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.907372 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.907456 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.907673 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.907757 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.907978 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.908074 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.908274 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.908358 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.908575 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.908667 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.908892 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.908986 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.909191 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.909276 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.909531 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.909630 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.909851 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.909939 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.910158 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.910243 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.910465 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.910549 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.910769 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.910855 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.911074 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.911159 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.911440 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.911598 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.911774 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.911860 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.912105 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.912190 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.912466 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.912559 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.912844 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.912929 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.913160 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.913292 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.913511 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.913647 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.913826 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.913960 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.914139 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.914271 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.914451 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.914585 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.914768 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.914906 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:02:40.915086 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.915245 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.915416 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.915582 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.915732 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.915926 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.916047 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.916265 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.916374 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.916615 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.916708 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.916952 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.917082 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.917275 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.917435 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.917617 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.917755 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.917936 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.918072 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.918267 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.918413 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.918757 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.918841 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.919071 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.919343 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.919437 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.919754 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.919843 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.920067 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.920227 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.920378 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.920561 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.920690 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.920904 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.921029 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.921230 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.921375 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.921582 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.921671 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.921909 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.922004 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.922228 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.922324 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.922553 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.922653 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.922886 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.922972 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.923197 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.923290 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.923509 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.923597 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.923820 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.923906 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.924131 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.924216 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.924543 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.924631 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.924857 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.924951 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.925181 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.925276 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.925522 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.925621 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.925834 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.925919 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.926148 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.926280 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.926483 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.926568 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.926756 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.926855 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.927054 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.927152 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.927356 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.927451 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.927688 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.927786 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.927968 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.928063 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.928278 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.928859 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.928928 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.929002 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.929078 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.929297 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.929297 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.929509 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.929588 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.929666 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.929914 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.930004 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.930217 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.930302 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.930531 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.930808 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.930903 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.931138 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.931269 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.931444 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.931705 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.931790 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.932040 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.932134 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.932342 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.932426 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.932664 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.932766 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.932972 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.933059 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.933276 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.933394 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.933614 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.933708 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.933916 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.934001 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.934222 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.934307 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.934535 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.934627 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.934843 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.934924 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.935180 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.935271 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.935491 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.935585 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.935825 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.935910 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.936135 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.936227 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.936448 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.936601 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.936762 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.936848 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.937076 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.937169 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.937411 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.937501 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.937727 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.937828 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.938043 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.938129 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.938352 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.938446 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.938672 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.939010 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.939229 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.939315 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.939535 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.939620 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.939833 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.939916 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.940137 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.940383 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.940479 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.940558 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.940752 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.940837 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.941065 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.941160 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.941403 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.941527 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.941722 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.941833 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.942037 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.942133 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.942364 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.942451 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.942680 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.942766 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.943009 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.943124 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.943311 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.943398 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.943613 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.943700 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.943915 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.944010 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.944252 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.944337 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.944553 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.944636 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.944889 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.945015 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.945217 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.945311 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.945519 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.945612 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.945827 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.945923 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.946133 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.946226 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.946438 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.946543 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.946749 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.946843 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.947054 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.947139 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.947358 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.947443 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.947662 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.947756 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.947965 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.948052 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.948268 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.948363 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.948625 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.948711 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.948959 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.949044 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.949284 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.949508 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.949620 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.949711 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.949942 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.950112 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.950246 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.950508 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.950602 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.951549 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.951643 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.951904 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.952044 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.952263 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.952550 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.952638 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.952863 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.953158 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.953253 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.953501 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.953603 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.953813 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.953903 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.954123 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.954218 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.954431 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.954524 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.954750 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.954843 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.955059 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.955159 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.955373 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.955464 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.955679 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.955764 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.956047 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.956140 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.956375 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.956468 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.956692 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.956825 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.956996 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.957094 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.957316 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.957481 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.957662 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.957749 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.957968 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.958055 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.958290 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.958376 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.958600 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.958685 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.958921 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.959007 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.959232 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.959329 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.959593 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.959694 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.959854 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.959941 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.960159 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.960255 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.960466 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.960552 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.960774 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.960862 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.961086 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.961171 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.961414 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.961515 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.961725 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.961811 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.962029 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.962113 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.962341 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.962437 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.962649 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.962734 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.962951 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.963043 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.963256 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.963367 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.963560 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.963647 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.963861 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.963947 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.964174 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.964267 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.964493 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.964579 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.964813 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.964906 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.965115 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.965243 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.965451 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.965538 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.965777 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.965863 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.966086 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.966172 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.966488 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.966573 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.966846 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.966930 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.967238 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.967369 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.967551 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.967871 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.967966 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.968314 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.968413 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.968633 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.968718 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.968949 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.969041 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.969261 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.969395 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.969601 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.969802 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.969911 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.969996 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.970217 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.970305 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.970523 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.970702 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.970837 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.970924 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.971147 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.971233 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.971458 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.971552 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.971771 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.971857 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.972083 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.972169 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.972387 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.972471 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.972695 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.972780 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.973014 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.973099 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.973322 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.973446 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.973655 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.973757 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.973968 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.974053 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.974307 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.974390 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.974651 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.974743 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.974965 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.975049 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.975273 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.975542 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.975631 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.975877 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.976082 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.976176 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.976497 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.976617 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.976850 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.976983 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.977170 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.977382 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.977528 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.977705 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.977855 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.978037 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.978209 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.978358 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.978465 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.978675 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.978760 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.978991 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.979122 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.979396 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.979481 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.979822 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.979914 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.980141 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.980465 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.980551 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.980778 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.980871 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.981094 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.981189 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.981435 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.981524 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.981745 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.981833 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.982587 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.982776 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.982893 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.983034 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.983222 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.983503 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.983790 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.983890 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.984139 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.984244 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.984450 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.984537 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.984774 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.984862 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.985093 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.985181 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.985426 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.985571 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.985735 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.985834 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.986037 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.986123 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.986381 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.986479 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.986687 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.986783 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.987003 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.987123 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.987312 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.987400 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.987621 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.987716 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.987936 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.988023 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.988245 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.988330 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.988552 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.988639 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.988858 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.988943 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.989158 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.989246 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.989487 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.989577 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.989793 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.989878 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.990101 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.990185 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.990406 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.990493 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.990717 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.990803 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.991022 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.991106 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.991329 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.991415 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.991631 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.991716 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.991930 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.992027 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.992239 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.992326 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.992541 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.992626 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.992842 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.992936 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.993148 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.993233 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.993476 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.993580 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.993779 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.993878 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.994088 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.994198 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.994475 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.994562 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.994783 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.994884 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.995172 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.995295 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.995606 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.995716 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.995934 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.996217 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.996366 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.996544 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.996685 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.996855 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.996996 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.997163 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.997312 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.997525 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.998222 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.998376 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.998520 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.998688 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.998860 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.999015 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.999157 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.999329 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.999475 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.999634 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.999791 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:40.999939 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.000098 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.000249 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.000412 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.000554 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.000716 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.000857 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.001031 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.001168 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.001353 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.001514 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.001675 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.001831 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.001980 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.002135 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.002295 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.002445 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.002639 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.002773 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.002943 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.003101 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.003256 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.003407 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.003561 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.003715 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.003880 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.004018 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.004320 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.004405 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.004621 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.004863 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.004958 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.005207 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.005298 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.005543 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.005650 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.005881 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.005996 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.006154 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.006272 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.006457 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.006601 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.006757 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.006917 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.007096 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.007231 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.007412 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.007667 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.007946 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.008103 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.008184 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.008388 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.008485 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.008709 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.008996 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.009083 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.009316 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.009503 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.009650 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.009837 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.009956 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.010159 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.010272 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.010470 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.010584 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.010785 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.010884 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.011094 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.011188 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.011403 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.011488 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.011709 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.011804 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.012021 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.012138 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.012325 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.012472 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.012631 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.012796 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.012935 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.013118 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.013778 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.013984 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.014120 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.014291 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.014603 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.014696 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.014918 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.015115 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.015231 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.015545 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.015630 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.015857 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.015942 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.016167 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.016263 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.016477 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.016607 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.016790 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.016877 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.017101 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.017189 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.017436 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.017578 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.017746 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.017842 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.018058 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.018145 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.018370 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.018455 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.018680 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.018765 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.019001 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.019086 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.019308 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.019400 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.019611 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.019694 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.019921 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.020008 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.020227 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.020312 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.020530 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.020622 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.020832 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.020915 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.021152 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.021266 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.021492 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.021593 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.021811 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.021897 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.022136 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.022221 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.022459 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.022554 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.022782 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.022866 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.023086 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.023170 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.023396 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.023490 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.023697 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.023788 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.024010 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.024184 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.024324 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.024506 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.024637 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.024817 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.025129 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.025220 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.025459 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.025674 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.025760 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.026064 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.026149 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.026391 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.026486 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.026697 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.026783 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.027002 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.027088 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.027307 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.027446 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.027629 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.027715 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.027932 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.028017 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.028252 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.028339 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.028565 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.028674 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.028930 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.029631 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.029768 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.029939 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.030079 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.030356 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.030443 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.030669 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.030764 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.030980 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.031116 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.031302 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.031434 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.031625 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.031749 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.032018 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.032113 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.032339 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.032425 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.032656 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.032743 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.032970 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.033295 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.033445 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.033650 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.033747 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.033964 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.034117 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.034280 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.034550 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.034652 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.034868 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.034956 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.035187 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.035311 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.035505 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.035601 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.035814 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.035920 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.036124 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.036253 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.036440 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.036527 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.036770 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.036857 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.037080 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.037168 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.037413 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.037503 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.037728 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.037833 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.038053 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.038141 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.038359 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.038445 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.038668 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.038761 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.038972 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.039085 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.039373 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.039459 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.039681 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.039776 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.039993 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.040307 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.040404 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.040613 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.040790 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.040917 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.041223 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.041316 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.041579 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.041667 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.041885 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.041975 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.042213 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.042300 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.042522 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.042606 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.042840 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.042927 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.043157 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.043243 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.043459 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.043543 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.043781 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.043868 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.044120 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.044316 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.044638 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.044740 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.045048 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.045135 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.045413 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.045598 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.045745 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.045951 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.046065 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.046264 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.046393 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.046589 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.046818 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.046916 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.047151 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.047238 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.047471 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.047558 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.047799 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.047895 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.048131 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.048218 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.048441 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.048565 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.048749 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.048919 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.049090 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.049225 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.049425 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.049584 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.049740 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.049891 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.050067 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.050195 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.050376 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.050505 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.050690 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.050810 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.051003 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.051097 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.051317 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.051410 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.051625 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.051714 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.051931 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.052017 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.052267 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.052409 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.052562 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.052658 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.052884 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.052971 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.053189 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.053284 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.053532 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.053629 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.053842 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.053929 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.054145 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.054240 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.054479 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.054581 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.054771 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.054862 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.055057 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.055153 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.055370 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.055463 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.055673 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.055760 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.056007 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.056198 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.056300 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.056376 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.056624 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.056712 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.056955 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.057044 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.057278 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.057393 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.057617 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.057705 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.057932 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.058027 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.058244 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.058330 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.058562 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.058656 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.058870 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.058957 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.059183 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.059276 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.059494 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.059584 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.059797 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.059884 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.060127 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.060440 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.060535 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.060744 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.060831 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.061049 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.061135 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.061392 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.061486 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.061710 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.061803 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.062033 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.062195 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.062345 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.062506 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.062655 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.062967 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.063053 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.063278 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.063589 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.063934 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.064168 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.064253 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.064487 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.064586 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.064809 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.064967 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.065118 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.065203 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.065459 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.065549 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.065773 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.065875 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.066084 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.066171 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.066397 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.066483 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.066729 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.066822 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.067043 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.067129 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.067369 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.067455 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.067688 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.067783 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.068007 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.068130 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.068493 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.068579 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.068848 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.069069 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.069163 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.069458 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.069546 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.069776 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.069864 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.070093 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.070179 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.071448 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.071563 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.071657 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.071739 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.071818 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.071897 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.071984 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.071984 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.072137 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.072218 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.072296 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.072376 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.072454 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.072590 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.072690 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.072902 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.073013 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.073215 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.073368 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.073675 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.073763 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.073995 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.074083 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.074311 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.074459 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.074626 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.074787 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.074942 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.075111 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.075281 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.075431 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.076261 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.076356 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.076591 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.076871 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.076958 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.077195 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.077281 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.077533 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.077700 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.077845 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.078031 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.078171 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.078357 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.078445 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.078682 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.078770 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.079086 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.079200 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.079369 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.079506 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.079681 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.079819 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.079997 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.080212 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.080300 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.080561 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.080656 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.080919 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.081031 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.081207 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.081309 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.081551 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.081651 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.081866 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.081963 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.082172 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.082273 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.082484 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.082569 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.082786 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.082873 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.083088 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.083176 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.083402 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.083497 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.083714 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.083802 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.084014 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.084101 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.084329 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.084428 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.084632 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.084733 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.084937 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.085025 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.085238 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.085496 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.085600 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.085827 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.085917 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.086167 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.086260 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.086469 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.086557 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.086775 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.086885 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.087073 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.087207 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.087381 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.087472 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.087683 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.087770 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.087985 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.088073 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.088288 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.088375 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.088588 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.088674 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.088903 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.088990 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.089209 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.089316 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.089536 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.089624 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.089837 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.089942 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.090147 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.090234 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.090493 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.090579 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.090802 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.090898 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.091103 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.091383 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.091474 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.091744 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.091844 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.092060 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.092147 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.092377 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.092462 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.092686 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.092772 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.093005 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.093100 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.093313 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.093454 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.093645 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.093747 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.093957 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.094043 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.094266 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.094353 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.094583 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.094810 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.094898 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.095147 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.095248 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.095471 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.095560 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.095802 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.095891 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.096112 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.096205 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.096421 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.096565 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.096723 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.096809 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.097033 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.097173 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.097369 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.097509 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.097680 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.097807 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.097985 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.098071 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.098292 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.098440 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.098597 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.098683 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.098901 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.098995 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.099209 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.099303 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.099512 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.099606 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.099819 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.099912 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.100124 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.100210 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.100430 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.100515 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.100735 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.100821 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.101046 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.101132 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.101370 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.101477 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.101684 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.101773 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.101996 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.102084 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.102335 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.102421 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.102653 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.102738 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.102958 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.103044 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.103264 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.103356 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.103580 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.103713 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.103889 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.103983 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.104193 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.104278 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.104503 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.104598 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.104816 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.104916 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.105126 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.105221 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.105628 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.106468 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.106582 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.106665 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.106737 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.106805 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.106805 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.107509 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.107844 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.108152 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.108465 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.108773 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.109005 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.109099 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.109426 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.109520 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.109746 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.109839 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.110063 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.110177 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.110397 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.110505 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.110711 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.110838 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.111026 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.111185 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.111339 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.111507 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.111650 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.111835 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.111964 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.112155 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.112276 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.112491 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.112578 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.112835 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.112923 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.113170 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.113257 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.113504 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.113604 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.113822 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.113962 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.114129 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.114223 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.114437 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.114532 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.114749 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.114835 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.115071 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.115165 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.115384 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.115481 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.115692 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.115778 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.115997 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.116083 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.116308 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.116403 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.116614 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.116700 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.116920 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.117006 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.117224 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.117311 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.117552 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.117651 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.117865 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.117961 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.118169 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.118473 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.118599 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.118776 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.118863 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.119078 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.119174 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.119380 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.119505 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.119681 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.119824 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.119992 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.120152 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.120297 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.120503 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.120592 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.120822 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.120921 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.121148 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.121235 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.121490 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.121579 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.121818 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.121916 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.122152 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.122239 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.122470 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.122600 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.123330 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.123432 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.123639 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.123724 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.123948 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.124036 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.124255 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.124341 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.124565 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.124649 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.124883 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.124968 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.125278 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.125643 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.125643 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.126084 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.126084 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.126470 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.126470 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.126992 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.127165 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.127248 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.127327 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.127405 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.127405 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.127629 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.127708 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.127831 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.127939 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.128040 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.128122 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.128200 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.128278 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.128355 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.128479 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.128575 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.128782 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.128879 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.129084 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.129171 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.129411 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.129514 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.129724 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.129811 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.130033 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.130120 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.130340 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.130428 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.130644 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.130731 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.130950 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.131035 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.131254 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.131341 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.131566 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.131653 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.131875 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.131961 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.132190 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.132278 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.132498 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.132585 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.132808 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.132902 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.133124 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.133211 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.133469 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.133558 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.133795 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.133894 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.134117 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.134203 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.134433 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.134526 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.134744 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.134843 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.135158 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.135259 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.135445 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.135537 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.135689 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.135787 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.136006 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.136101 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.136320 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.136407 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.136632 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.136720 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.136944 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.137030 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.137246 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.137351 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.137515 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 30 01:02:41.137639 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.137949 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.140588 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.140588 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.140588 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.140588 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.140588 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.140588 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.140588 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.140588 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.141975 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.141975 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.141975 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.141975 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.142222 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.142474 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.142739 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.143059 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.144266 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.144266 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.144266 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.144517 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.144683 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.145023 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.145477 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.145987 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.146396 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.146962 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.147107 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.147414 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:02:41.147662 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 30 01:02:41.296944 n-d-master-1 devstack@n-api.service[105232]: INFO dbcounter [None req-1f4c5bd6-3b4e-4584-8b1f-d581362f252b None None] Registered counter for database nova_api Oct 30 01:02:41.309087 n-d-master-1 devstack@n-api.service[105231]: INFO dbcounter [None req-552c249c-f311-479f-9711-f72dcb852b31 None None] Registered counter for database nova_api Oct 30 01:02:41.318368 n-d-master-1 devstack@n-api.service[105232]: DEBUG oslo_db.sqlalchemy.engines [None req-1f4c5bd6-3b4e-4584-8b1f-d581362f252b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105232) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 30 01:02:41.327494 n-d-master-1 devstack@n-api.service[105232]: DEBUG dbcounter [-] [105232] Writer thread running {{(pid=105232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 30 01:02:41.330217 n-d-master-1 devstack@n-api.service[105231]: DEBUG oslo_db.sqlalchemy.engines [None req-552c249c-f311-479f-9711-f72dcb852b31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105231) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 30 01:02:41.338304 n-d-master-1 devstack@n-api.service[105231]: DEBUG dbcounter [-] [105231] Writer thread running {{(pid=105231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 30 01:02:41.390399 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.context [None req-1f4c5bd6-3b4e-4584-8b1f-d581362f252b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7a264aef-b8bb-4843-8958-43bc38c25cb0(cell1) {{(pid=105232) load_cells /opt/stack/nova/nova/context.py:464}} Oct 30 01:02:41.394323 n-d-master-1 devstack@n-api.service[105232]: DEBUG oslo_concurrency.lockutils [None req-1f4c5bd6-3b4e-4584-8b1f-d581362f252b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:41.394794 n-d-master-1 devstack@n-api.service[105232]: DEBUG oslo_concurrency.lockutils [None req-1f4c5bd6-3b4e-4584-8b1f-d581362f252b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:41.396373 n-d-master-1 devstack@n-api.service[105232]: DEBUG oslo_concurrency.lockutils [None req-1f4c5bd6-3b4e-4584-8b1f-d581362f252b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:41.397097 n-d-master-1 devstack@n-api.service[105232]: DEBUG oslo_concurrency.lockutils [None req-1f4c5bd6-3b4e-4584-8b1f-d581362f252b None None] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:41.397561 n-d-master-1 devstack@n-api.service[105232]: DEBUG oslo_concurrency.lockutils [None req-1f4c5bd6-3b4e-4584-8b1f-d581362f252b None None] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:41.399566 n-d-master-1 devstack@n-api.service[105232]: DEBUG oslo_concurrency.lockutils [None req-1f4c5bd6-3b4e-4584-8b1f-d581362f252b None None] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:41.401605 n-d-master-1 devstack@n-api.service[105232]: INFO dbcounter [None req-1f4c5bd6-3b4e-4584-8b1f-d581362f252b None None] Registered counter for database nova_cell0 Oct 30 01:02:41.405180 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.context [None req-552c249c-f311-479f-9711-f72dcb852b31 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7a264aef-b8bb-4843-8958-43bc38c25cb0(cell1) {{(pid=105231) load_cells /opt/stack/nova/nova/context.py:464}} Oct 30 01:02:41.406250 n-d-master-1 devstack@n-api.service[105232]: INFO dbcounter [None req-1f4c5bd6-3b4e-4584-8b1f-d581362f252b None None] Registered counter for database nova_cell1 Oct 30 01:02:41.409160 n-d-master-1 devstack@n-api.service[105231]: DEBUG oslo_concurrency.lockutils [None req-552c249c-f311-479f-9711-f72dcb852b31 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:41.409675 n-d-master-1 devstack@n-api.service[105231]: DEBUG oslo_concurrency.lockutils [None req-552c249c-f311-479f-9711-f72dcb852b31 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:41.411331 n-d-master-1 devstack@n-api.service[105231]: DEBUG oslo_concurrency.lockutils [None req-552c249c-f311-479f-9711-f72dcb852b31 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:41.412063 n-d-master-1 devstack@n-api.service[105231]: DEBUG oslo_concurrency.lockutils [None req-552c249c-f311-479f-9711-f72dcb852b31 None None] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:41.412506 n-d-master-1 devstack@n-api.service[105231]: DEBUG oslo_concurrency.lockutils [None req-552c249c-f311-479f-9711-f72dcb852b31 None None] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:41.414392 n-d-master-1 devstack@n-api.service[105232]: DEBUG oslo_db.sqlalchemy.engines [None req-1f4c5bd6-3b4e-4584-8b1f-d581362f252b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105232) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 30 01:02:41.414623 n-d-master-1 devstack@n-api.service[105231]: DEBUG oslo_concurrency.lockutils [None req-552c249c-f311-479f-9711-f72dcb852b31 None None] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:41.416240 n-d-master-1 devstack@n-api.service[105232]: DEBUG oslo_db.sqlalchemy.engines [None req-1f4c5bd6-3b4e-4584-8b1f-d581362f252b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105232) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 30 01:02:41.416716 n-d-master-1 devstack@n-api.service[105231]: INFO dbcounter [None req-552c249c-f311-479f-9711-f72dcb852b31 None None] Registered counter for database nova_cell0 Oct 30 01:02:41.421489 n-d-master-1 devstack@n-api.service[105231]: INFO dbcounter [None req-552c249c-f311-479f-9711-f72dcb852b31 None None] Registered counter for database nova_cell1 Oct 30 01:02:41.422085 n-d-master-1 devstack@n-api.service[105232]: DEBUG dbcounter [-] [105232] Writer thread running {{(pid=105232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 30 01:02:41.428154 n-d-master-1 devstack@n-api.service[105232]: DEBUG dbcounter [-] [105232] Writer thread running {{(pid=105232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 30 01:02:41.428886 n-d-master-1 devstack@n-api.service[105231]: DEBUG oslo_db.sqlalchemy.engines [None req-552c249c-f311-479f-9711-f72dcb852b31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105231) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 30 01:02:41.430184 n-d-master-1 devstack@n-api.service[105231]: DEBUG oslo_db.sqlalchemy.engines [None req-552c249c-f311-479f-9711-f72dcb852b31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105231) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 30 01:02:41.436903 n-d-master-1 devstack@n-api.service[105231]: DEBUG dbcounter [-] [105231] Writer thread running {{(pid=105231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 30 01:02:41.439499 n-d-master-1 devstack@n-api.service[105231]: DEBUG dbcounter [-] [105231] Writer thread running {{(pid=105231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 30 01:02:41.570410 n-d-master-1 devstack@n-api.service[105232]: INFO dbcounter [None req-1f4c5bd6-3b4e-4584-8b1f-d581362f252b None None] Registered counter for database nova_cell0 Oct 30 01:02:41.579844 n-d-master-1 devstack@n-api.service[105232]: DEBUG oslo_db.sqlalchemy.engines [None req-1f4c5bd6-3b4e-4584-8b1f-d581362f252b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105232) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 30 01:02:41.586596 n-d-master-1 devstack@n-api.service[105231]: INFO dbcounter [None req-552c249c-f311-479f-9711-f72dcb852b31 None None] Registered counter for database nova_cell0 Oct 30 01:02:41.586771 n-d-master-1 devstack@n-api.service[105232]: DEBUG dbcounter [-] [105232] Writer thread running {{(pid=105232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 30 01:02:41.596364 n-d-master-1 devstack@n-api.service[105231]: DEBUG oslo_db.sqlalchemy.engines [None req-552c249c-f311-479f-9711-f72dcb852b31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105231) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 30 01:02:41.602792 n-d-master-1 devstack@n-api.service[105231]: DEBUG dbcounter [-] [105231] Writer thread running {{(pid=105231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 30 01:02:42.035716 n-d-master-1 devstack@n-api.service[105232]: WARNING keystonemiddleware.auth_token [None req-1f4c5bd6-3b4e-4584-8b1f-d581362f252b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 30 01:02:42.043018 n-d-master-1 devstack@n-api.service[105232]: WARNING keystonemiddleware.auth_token [None req-1f4c5bd6-3b4e-4584-8b1f-d581362f252b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 30 01:02:42.050804 n-d-master-1 devstack@n-api.service[105231]: WARNING keystonemiddleware.auth_token [None req-552c249c-f311-479f-9711-f72dcb852b31 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 30 01:02:42.058001 n-d-master-1 devstack@n-api.service[105231]: WARNING keystonemiddleware.auth_token [None req-552c249c-f311-479f-9711-f72dcb852b31 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 30 01:02:42.386756 n-d-master-1 devstack@n-api.service[105232]: WARNING keystonemiddleware.auth_token [None req-1f4c5bd6-3b4e-4584-8b1f-d581362f252b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 30 01:02:42.393248 n-d-master-1 devstack@n-api.service[105232]: WARNING keystonemiddleware.auth_token [None req-1f4c5bd6-3b4e-4584-8b1f-d581362f252b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 30 01:02:42.398512 n-d-master-1 devstack@n-api.service[105232]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56219687e9c0 pid: 105232 (default app) Oct 30 01:02:42.400569 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi [None req-1f4c5bd6-3b4e-4584-8b1f-d581362f252b None None] Calling method '>' {{(pid=105232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:02:42.401791 n-d-master-1 devstack@n-api.service[105232]: INFO nova.api.openstack.requestlog [None req-1f4c5bd6-3b4e-4584-8b1f-d581362f252b None None] 10.222.0.13 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001736 Oct 30 01:02:42.402193 n-d-master-1 devstack@n-api.service[105232]: [pid: 105232|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 788 bytes} [Sun Oct 30 01:02:42 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:02:42.415249 n-d-master-1 devstack@n-api.service[105231]: WARNING keystonemiddleware.auth_token [None req-552c249c-f311-479f-9711-f72dcb852b31 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 30 01:02:42.421190 n-d-master-1 devstack@n-api.service[105231]: WARNING keystonemiddleware.auth_token [None req-552c249c-f311-479f-9711-f72dcb852b31 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 30 01:02:42.426458 n-d-master-1 devstack@n-api.service[105231]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56219687e9c0 pid: 105231 (default app) Oct 30 01:04:06.984398 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi [None req-1f4c5bd6-3b4e-4584-8b1f-d581362f252b None None] Calling method '>' {{(pid=105232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:04:06.985446 n-d-master-1 devstack@n-api.service[105232]: INFO nova.api.openstack.requestlog [None req-1f4c5bd6-3b4e-4584-8b1f-d581362f252b None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Oct 30 01:04:06.985845 n-d-master-1 devstack@n-api.service[105232]: [pid: 105232|app: 0|req: 2/2] 10.222.0.13 () {54 vars in 931 bytes} [Sun Oct 30 01:04:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:04:07.002304 n-d-master-1 devstack@n-api.service[105231]: DEBUG dbcounter [-] [105231] Writing DB stats nova_api:SELECT=3 {{(pid=105231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:04:07.004031 n-d-master-1 devstack@n-api.service[105231]: DEBUG dbcounter [-] [105231] Writing DB stats nova_cell0:SELECT=3 {{(pid=105231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:04:07.005048 n-d-master-1 devstack@n-api.service[105231]: DEBUG dbcounter [-] [105231] Writing DB stats nova_cell1:SELECT=3 {{(pid=105231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:04:07.006593 n-d-master-1 devstack@n-api.service[105231]: DEBUG dbcounter [-] [105231] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:04:07.916997 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi [None req-14c4c5f9-ab5c-4e4c-9045-93f90f43f356 admin admin] Calling method '>' {{(pid=105231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:04:07.952837 n-d-master-1 devstack@n-api.service[105231]: INFO nova.api.openstack.requestlog [None req-14c4c5f9-ab5c-4e4c-9045-93f90f43f356 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.959476 Oct 30 01:04:07.953779 n-d-master-1 devstack@n-api.service[105231]: [pid: 105231|app: 0|req: 1/3] 10.222.0.13 () {60 vars in 1292 bytes} [Sun Oct 30 01:04:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:04:10.604740 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi [None req-1f4c5bd6-3b4e-4584-8b1f-d581362f252b None None] Calling method '>' {{(pid=105232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:04:10.605825 n-d-master-1 devstack@n-api.service[105232]: INFO nova.api.openstack.requestlog [None req-1f4c5bd6-3b4e-4584-8b1f-d581362f252b None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Oct 30 01:04:10.606377 n-d-master-1 devstack@n-api.service[105232]: [pid: 105232|app: 0|req: 3/4] 10.222.0.13 () {54 vars in 931 bytes} [Sun Oct 30 01:04:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:04:11.081576 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi [None req-f60cb785-eeea-4f81-a8e7-a7b69603d014 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 1, "os-flavor-access:is_public": true, "id": "c1", "vcpus": 1, "name": "cirros256", "swap": 0, "ram": 256}} {{(pid=105231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:04:11.192125 n-d-master-1 devstack@n-api.service[105231]: INFO nova.api.openstack.requestlog [None req-f60cb785-eeea-4f81-a8e7-a7b69603d014 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.579602 Oct 30 01:04:11.192695 n-d-master-1 devstack@n-api.service[105231]: [pid: 105231|app: 0|req: 2/5] 10.222.0.13 () {64 vars in 1283 bytes} [Sun Oct 30 01:04:10 2022] POST /compute/v2.1/flavors => generated 407 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:04:11.206376 n-d-master-1 devstack@n-api.service[105232]: DEBUG dbcounter [-] [105232] Writing DB stats nova_api:SELECT=3 {{(pid=105232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:04:11.207896 n-d-master-1 devstack@n-api.service[105232]: DEBUG dbcounter [-] [105232] Writing DB stats nova_cell1:SELECT=3 {{(pid=105232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:04:11.209958 n-d-master-1 devstack@n-api.service[105232]: DEBUG dbcounter [-] [105232] Writing DB stats nova_cell0:SELECT=3 {{(pid=105232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:04:11.211035 n-d-master-1 devstack@n-api.service[105232]: DEBUG dbcounter [-] [105232] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:04:11.419795 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi [None req-a963cd07-47f3-49f1-aea0-21900181a1f0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:04:11.562337 n-d-master-1 devstack@n-api.service[105232]: INFO nova.api.openstack.requestlog [None req-a963cd07-47f3-49f1-aea0-21900181a1f0 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.361183 Oct 30 01:04:11.565085 n-d-master-1 devstack@n-api.service[105232]: [pid: 105232|app: 0|req: 4/6] 10.222.0.13 () {64 vars in 1336 bytes} [Sun Oct 30 01:04:11 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:04:14.231377 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi [None req-f60cb785-eeea-4f81-a8e7-a7b69603d014 admin admin] Calling method '>' {{(pid=105231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:04:14.232990 n-d-master-1 devstack@n-api.service[105231]: INFO nova.api.openstack.requestlog [None req-f60cb785-eeea-4f81-a8e7-a7b69603d014 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002016 Oct 30 01:04:14.233701 n-d-master-1 devstack@n-api.service[105231]: [pid: 105231|app: 0|req: 3/7] 10.222.0.13 () {54 vars in 931 bytes} [Sun Oct 30 01:04:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:04:15.069822 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi [None req-691e5718-0b49-4179-8fa8-61bf8fb54c05 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "ram": 512, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds512M", "swap": 0, "disk": 5, "vcpus": 1}} {{(pid=105232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:04:15.195050 n-d-master-1 devstack@n-api.service[105232]: INFO nova.api.openstack.requestlog [None req-691e5718-0b49-4179-8fa8-61bf8fb54c05 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.953262 Oct 30 01:04:15.215484 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi [None req-6953329e-c1aa-42be-b567-177cc108b2a9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:04:15.221704 n-d-master-1 devstack@n-api.service[105232]: [pid: 105232|app: 0|req: 5/8] 10.222.0.13 () {64 vars in 1283 bytes} [Sun Oct 30 01:04:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 30 01:04:15.342733 n-d-master-1 devstack@n-api.service[105231]: INFO nova.api.openstack.requestlog [None req-6953329e-c1aa-42be-b567-177cc108b2a9 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.134902 Oct 30 01:04:15.344182 n-d-master-1 devstack@n-api.service[105231]: [pid: 105231|app: 0|req: 4/9] 10.222.0.13 () {64 vars in 1336 bytes} [Sun Oct 30 01:04:15 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:04:18.336350 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi [None req-691e5718-0b49-4179-8fa8-61bf8fb54c05 admin admin] Calling method '>' {{(pid=105232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:04:18.337693 n-d-master-1 devstack@n-api.service[105232]: INFO nova.api.openstack.requestlog [None req-691e5718-0b49-4179-8fa8-61bf8fb54c05 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001662 Oct 30 01:04:18.338787 n-d-master-1 devstack@n-api.service[105232]: [pid: 105232|app: 0|req: 6/10] 10.222.0.13 () {54 vars in 931 bytes} [Sun Oct 30 01:04:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:04:18.874138 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi [None req-eea1d927-80d4-48b9-9ed3-bf223c1090b1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "id": "d2", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds1G", "swap": 0, "rxtx_factor": 1.0, "disk": 10}} {{(pid=105231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:04:18.942348 n-d-master-1 devstack@n-api.service[105231]: INFO nova.api.openstack.requestlog [None req-eea1d927-80d4-48b9-9ed3-bf223c1090b1 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.594602 Oct 30 01:04:18.943605 n-d-master-1 devstack@n-api.service[105231]: [pid: 105231|app: 0|req: 5/11] 10.222.0.13 () {64 vars in 1283 bytes} [Sun Oct 30 01:04:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:04:18.956320 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi [None req-534c57eb-c193-4d00-a7e5-2a9531c982d0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:04:19.055984 n-d-master-1 devstack@n-api.service[105232]: INFO nova.api.openstack.requestlog [None req-534c57eb-c193-4d00-a7e5-2a9531c982d0 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103836 Oct 30 01:04:19.056567 n-d-master-1 devstack@n-api.service[105232]: [pid: 105232|app: 0|req: 7/12] 10.222.0.13 () {64 vars in 1336 bytes} [Sun Oct 30 01:04:18 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:04:21.682437 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi [None req-eea1d927-80d4-48b9-9ed3-bf223c1090b1 admin admin] Calling method '>' {{(pid=105231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:04:21.683443 n-d-master-1 devstack@n-api.service[105231]: INFO nova.api.openstack.requestlog [None req-eea1d927-80d4-48b9-9ed3-bf223c1090b1 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001750 Oct 30 01:04:21.683841 n-d-master-1 devstack@n-api.service[105231]: [pid: 105231|app: 0|req: 6/13] 10.222.0.13 () {54 vars in 931 bytes} [Sun Oct 30 01:04:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:04:22.167140 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi [None req-6675e70c-f2db-47aa-a5ee-4966644c8974 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "os-flavor-access:is_public": true, "disk": 10, "vcpus": 2, "name": "ds2G", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d3"}} {{(pid=105232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:04:22.279640 n-d-master-1 devstack@n-api.service[105232]: INFO nova.api.openstack.requestlog [None req-6675e70c-f2db-47aa-a5ee-4966644c8974 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.589074 Oct 30 01:04:22.280187 n-d-master-1 devstack@n-api.service[105232]: [pid: 105232|app: 0|req: 8/14] 10.222.0.13 () {64 vars in 1283 bytes} [Sun Oct 30 01:04:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:04:22.300526 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi [None req-d713ae76-bfef-470a-9201-cfa915d1ca31 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:04:22.379594 n-d-master-1 devstack@n-api.service[105231]: INFO nova.api.openstack.requestlog [None req-d713ae76-bfef-470a-9201-cfa915d1ca31 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.083417 Oct 30 01:04:22.380711 n-d-master-1 devstack@n-api.service[105231]: [pid: 105231|app: 0|req: 7/15] 10.222.0.13 () {64 vars in 1336 bytes} [Sun Oct 30 01:04:22 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:04:25.077274 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi [None req-6675e70c-f2db-47aa-a5ee-4966644c8974 admin admin] Calling method '>' {{(pid=105232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:04:25.078921 n-d-master-1 devstack@n-api.service[105232]: INFO nova.api.openstack.requestlog [None req-6675e70c-f2db-47aa-a5ee-4966644c8974 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002087 Oct 30 01:04:25.081013 n-d-master-1 devstack@n-api.service[105232]: [pid: 105232|app: 0|req: 9/16] 10.222.0.13 () {54 vars in 931 bytes} [Sun Oct 30 01:04:25 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:04:25.568531 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi [None req-29f56d50-1f72-4e8d-afb8-94b65ec9474b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "id": "d4", "rxtx_factor": 1.0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "os-flavor-access:is_public": true, "swap": 0, "name": "ds4G"}} {{(pid=105231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:04:25.669103 n-d-master-1 devstack@n-api.service[105231]: INFO nova.api.openstack.requestlog [None req-29f56d50-1f72-4e8d-afb8-94b65ec9474b admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.583521 Oct 30 01:04:25.679097 n-d-master-1 devstack@n-api.service[105231]: [pid: 105231|app: 0|req: 8/17] 10.222.0.13 () {64 vars in 1283 bytes} [Sun Oct 30 01:04:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:04:25.682622 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi [None req-b8ad936c-4909-40b0-85ac-25b4bcbd1654 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:04:25.781987 n-d-master-1 devstack@n-api.service[105232]: INFO nova.api.openstack.requestlog [None req-b8ad936c-4909-40b0-85ac-25b4bcbd1654 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103130 Oct 30 01:04:25.783064 n-d-master-1 devstack@n-api.service[105232]: [pid: 105232|app: 0|req: 10/18] 10.222.0.13 () {64 vars in 1336 bytes} [Sun Oct 30 01:04:25 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:04:28.532638 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi [None req-29f56d50-1f72-4e8d-afb8-94b65ec9474b admin admin] Calling method '>' {{(pid=105231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:04:28.533998 n-d-master-1 devstack@n-api.service[105231]: INFO nova.api.openstack.requestlog [None req-29f56d50-1f72-4e8d-afb8-94b65ec9474b admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001971 Oct 30 01:04:28.534488 n-d-master-1 devstack@n-api.service[105231]: [pid: 105231|app: 0|req: 9/19] 10.222.0.13 () {54 vars in 931 bytes} [Sun Oct 30 01:04:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:04:28.973314 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi [None req-5b95b336-bcdf-4586-a52a-1114cde75c8f admin admin] Calling method '>' {{(pid=105232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:04:29.002971 n-d-master-1 devstack@n-api.service[105232]: INFO nova.api.openstack.requestlog [None req-5b95b336-bcdf-4586-a52a-1114cde75c8f admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.461525 Oct 30 01:04:29.003861 n-d-master-1 devstack@n-api.service[105232]: [pid: 105232|app: 0|req: 11/20] 10.222.0.13 () {60 vars in 1292 bytes} [Sun Oct 30 01:04:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:04:31.606604 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi [None req-29f56d50-1f72-4e8d-afb8-94b65ec9474b admin admin] Calling method '>' {{(pid=105231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:04:31.607758 n-d-master-1 devstack@n-api.service[105231]: INFO nova.api.openstack.requestlog [None req-29f56d50-1f72-4e8d-afb8-94b65ec9474b admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001629 Oct 30 01:04:31.608337 n-d-master-1 devstack@n-api.service[105231]: [pid: 105231|app: 0|req: 10/21] 10.222.0.13 () {54 vars in 931 bytes} [Sun Oct 30 01:04:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:04:32.037516 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi [None req-1335f6fb-bd4e-4281-949b-c830d6ef35d5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "1", "disk": 1, "name": "m1.tiny", "ram": 512, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=105232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:04:32.148382 n-d-master-1 devstack@n-api.service[105232]: INFO nova.api.openstack.requestlog [None req-1335f6fb-bd4e-4281-949b-c830d6ef35d5 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.533717 Oct 30 01:04:32.148787 n-d-master-1 devstack@n-api.service[105232]: [pid: 105232|app: 0|req: 12/22] 10.222.0.13 () {64 vars in 1283 bytes} [Sun Oct 30 01:04:31 2022] POST /compute/v2.1/flavors => generated 402 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:04:32.162519 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi [None req-d834fdd0-52db-48be-be49-7747cd22bdcf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:04:32.261046 n-d-master-1 devstack@n-api.service[105231]: INFO nova.api.openstack.requestlog [None req-d834fdd0-52db-48be-be49-7747cd22bdcf admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102364 Oct 30 01:04:32.261811 n-d-master-1 devstack@n-api.service[105231]: [pid: 105231|app: 0|req: 11/23] 10.222.0.13 () {64 vars in 1333 bytes} [Sun Oct 30 01:04:32 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:04:35.005684 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi [None req-1335f6fb-bd4e-4281-949b-c830d6ef35d5 admin admin] Calling method '>' {{(pid=105232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:04:35.006676 n-d-master-1 devstack@n-api.service[105232]: INFO nova.api.openstack.requestlog [None req-1335f6fb-bd4e-4281-949b-c830d6ef35d5 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002019 Oct 30 01:04:35.007070 n-d-master-1 devstack@n-api.service[105232]: [pid: 105232|app: 0|req: 13/24] 10.222.0.13 () {54 vars in 931 bytes} [Sun Oct 30 01:04:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:04:35.406720 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi [None req-b911b1df-0bc2-4177-beee-7a30281112bd admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 20, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "vcpus": 1, "id": "2", "ram": 2048, "rxtx_factor": 1.0}} {{(pid=105231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:04:35.461319 n-d-master-1 devstack@n-api.service[105231]: INFO nova.api.openstack.requestlog [None req-b911b1df-0bc2-4177-beee-7a30281112bd admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.447986 Oct 30 01:04:35.461852 n-d-master-1 devstack@n-api.service[105231]: [pid: 105231|app: 0|req: 12/25] 10.222.0.13 () {64 vars in 1283 bytes} [Sun Oct 30 01:04:35 2022] POST /compute/v2.1/flavors => generated 405 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:04:35.473874 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi [None req-3bc1af2d-d225-4031-ad5b-e1ea940af212 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:04:35.607911 n-d-master-1 devstack@n-api.service[105232]: INFO nova.api.openstack.requestlog [None req-3bc1af2d-d225-4031-ad5b-e1ea940af212 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.137545 Oct 30 01:04:35.608514 n-d-master-1 devstack@n-api.service[105232]: [pid: 105232|app: 0|req: 14/26] 10.222.0.13 () {64 vars in 1333 bytes} [Sun Oct 30 01:04:35 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:04:38.295871 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi [None req-b911b1df-0bc2-4177-beee-7a30281112bd admin admin] Calling method '>' {{(pid=105231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:04:38.296788 n-d-master-1 devstack@n-api.service[105231]: INFO nova.api.openstack.requestlog [None req-b911b1df-0bc2-4177-beee-7a30281112bd admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Oct 30 01:04:38.297191 n-d-master-1 devstack@n-api.service[105231]: [pid: 105231|app: 0|req: 13/27] 10.222.0.13 () {54 vars in 931 bytes} [Sun Oct 30 01:04:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:04:38.677560 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi [None req-24bca5da-9892-4957-a72e-e910f81e9dfc admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "os-flavor-access:is_public": true, "name": "m1.medium", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "id": "3", "disk": 40}} {{(pid=105232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:04:38.792510 n-d-master-1 devstack@n-api.service[105232]: INFO nova.api.openstack.requestlog [None req-24bca5da-9892-4957-a72e-e910f81e9dfc admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.488128 Oct 30 01:04:38.793069 n-d-master-1 devstack@n-api.service[105232]: [pid: 105232|app: 0|req: 15/28] 10.222.0.13 () {64 vars in 1283 bytes} [Sun Oct 30 01:04:38 2022] POST /compute/v2.1/flavors => generated 406 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 30 01:04:38.805767 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi [None req-66d72944-86c3-44a1-befc-4d067b648e5a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:04:38.811271 n-d-master-1 devstack@n-api.service[105231]: DEBUG dbcounter [-] [105231] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:04:39.621394 n-d-master-1 devstack@n-api.service[105231]: INFO nova.api.openstack.requestlog [None req-66d72944-86c3-44a1-befc-4d067b648e5a admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.819400 Oct 30 01:04:39.630397 n-d-master-1 devstack@n-api.service[105231]: [pid: 105231|app: 0|req: 14/29] 10.222.0.13 () {64 vars in 1333 bytes} [Sun Oct 30 01:04:38 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:04:42.385673 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi [None req-24bca5da-9892-4957-a72e-e910f81e9dfc admin admin] Calling method '>' {{(pid=105232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:04:42.387366 n-d-master-1 devstack@n-api.service[105232]: INFO nova.api.openstack.requestlog [None req-24bca5da-9892-4957-a72e-e910f81e9dfc admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002293 Oct 30 01:04:42.387775 n-d-master-1 devstack@n-api.service[105232]: [pid: 105232|app: 0|req: 16/30] 10.222.0.13 () {54 vars in 931 bytes} [Sun Oct 30 01:04:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:04:42.853185 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi [None req-2f04c4c6-e533-4221-8f8b-7ac9773574ea admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "4", "rxtx_factor": 1.0, "ram": 8192, "disk": 80, "name": "m1.large", "vcpus": 4}} {{(pid=105231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:04:42.930183 n-d-master-1 devstack@n-api.service[105231]: INFO nova.api.openstack.requestlog [None req-2f04c4c6-e533-4221-8f8b-7ac9773574ea admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.535864 Oct 30 01:04:42.931869 n-d-master-1 devstack@n-api.service[105231]: [pid: 105231|app: 0|req: 15/31] 10.222.0.13 () {64 vars in 1283 bytes} [Sun Oct 30 01:04:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 30 01:04:42.945216 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi [None req-073645a6-1dd7-4f32-804f-b330b224f462 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:04:43.072367 n-d-master-1 devstack@n-api.service[105232]: INFO nova.api.openstack.requestlog [None req-073645a6-1dd7-4f32-804f-b330b224f462 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.130758 Oct 30 01:04:43.073607 n-d-master-1 devstack@n-api.service[105232]: [pid: 105232|app: 0|req: 17/32] 10.222.0.13 () {64 vars in 1333 bytes} [Sun Oct 30 01:04:42 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:04:45.875796 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi [None req-2f04c4c6-e533-4221-8f8b-7ac9773574ea admin admin] Calling method '>' {{(pid=105231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:04:45.879448 n-d-master-1 devstack@n-api.service[105231]: INFO nova.api.openstack.requestlog [None req-2f04c4c6-e533-4221-8f8b-7ac9773574ea admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004301 Oct 30 01:04:45.881106 n-d-master-1 devstack@n-api.service[105231]: [pid: 105231|app: 0|req: 16/33] 10.222.0.13 () {54 vars in 931 bytes} [Sun Oct 30 01:04:45 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:04:46.408982 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi [None req-f8a182ee-4c59-4d9b-b8e3-1ef61eb15857 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "id": "5", "rxtx_factor": 1.0, "vcpus": 8, "os-flavor-access:is_public": true, "ram": 16384, "swap": 0, "name": "m1.xlarge"}} {{(pid=105232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:04:46.422728 n-d-master-1 devstack@n-api.service[105232]: DEBUG dbcounter [-] [105232] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:04:46.563647 n-d-master-1 devstack@n-api.service[105232]: INFO nova.api.openstack.requestlog [None req-f8a182ee-4c59-4d9b-b8e3-1ef61eb15857 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.674863 Oct 30 01:04:46.564577 n-d-master-1 devstack@n-api.service[105232]: [pid: 105232|app: 0|req: 18/34] 10.222.0.13 () {64 vars in 1283 bytes} [Sun Oct 30 01:04:45 2022] POST /compute/v2.1/flavors => generated 408 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:04:46.577317 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi [None req-4f78dbfa-8d54-4818-b37d-af44196581ec admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:04:46.670537 n-d-master-1 devstack@n-api.service[105231]: INFO nova.api.openstack.requestlog [None req-4f78dbfa-8d54-4818-b37d-af44196581ec admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096913 Oct 30 01:04:46.671130 n-d-master-1 devstack@n-api.service[105231]: [pid: 105231|app: 0|req: 17/35] 10.222.0.13 () {64 vars in 1333 bytes} [Sun Oct 30 01:04:46 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:05:07.458966 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi [None req-f8a182ee-4c59-4d9b-b8e3-1ef61eb15857 admin admin] Calling method '>' {{(pid=105232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:05:07.460017 n-d-master-1 devstack@n-api.service[105232]: INFO nova.api.openstack.requestlog [None req-f8a182ee-4c59-4d9b-b8e3-1ef61eb15857 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Oct 30 01:05:07.460428 n-d-master-1 devstack@n-api.service[105232]: [pid: 105232|app: 0|req: 19/36] 10.222.0.13 () {54 vars in 931 bytes} [Sun Oct 30 01:05:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:05:07.471285 n-d-master-1 devstack@n-api.service[105231]: DEBUG dbcounter [-] [105231] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=105231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:05:07.858410 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi [None req-579b399b-acfd-43cb-b788-143e4e74ecde admin admin] Calling method '>' {{(pid=105231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:05:07.877845 n-d-master-1 devstack@n-api.service[105231]: INFO nova.api.openstack.requestlog [None req-579b399b-acfd-43cb-b788-143e4e74ecde admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.410912 Oct 30 01:05:07.878392 n-d-master-1 devstack@n-api.service[105231]: [pid: 105231|app: 0|req: 18/37] 10.222.0.13 () {60 vars in 1292 bytes} [Sun Oct 30 01:05:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:05:09.185842 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi [None req-f8a182ee-4c59-4d9b-b8e3-1ef61eb15857 admin admin] Calling method '>' {{(pid=105232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:05:09.186998 n-d-master-1 devstack@n-api.service[105232]: INFO nova.api.openstack.requestlog [None req-f8a182ee-4c59-4d9b-b8e3-1ef61eb15857 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001594 Oct 30 01:05:09.190342 n-d-master-1 devstack@n-api.service[105232]: [pid: 105232|app: 0|req: 20/38] 10.222.0.13 () {56 vars in 1074 bytes} [Sun Oct 30 01:05:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:05:09.728726 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi [None req-ddd019fb-ea76-4f11-9527-ca450873e337 admin admin] Calling method '>' {{(pid=105231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:05:09.734015 n-d-master-1 devstack@n-api.service[105231]: INFO nova.api.openstack.wsgi [None req-ddd019fb-ea76-4f11-9527-ca450873e337 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 30 01:05:09.737241 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi [None req-ddd019fb-ea76-4f11-9527-ca450873e337 admin admin] Request method failure captured: Oct 30 01:05:09.737241 n-d-master-1 devstack@n-api.service[105231]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 30 01:05:09.737241 n-d-master-1 devstack@n-api.service[105231]: Accept: application/json Oct 30 01:05:09.737241 n-d-master-1 devstack@n-api.service[105231]: Accept-Encoding: gzip, deflate Oct 30 01:05:09.737241 n-d-master-1 devstack@n-api.service[105231]: Connection: keep-alive Oct 30 01:05:09.737241 n-d-master-1 devstack@n-api.service[105231]: Content-Length: 0 Oct 30 01:05:09.737241 n-d-master-1 devstack@n-api.service[105231]: Host: 10.222.0.13 Oct 30 01:05:09.737241 n-d-master-1 devstack@n-api.service[105231]: Openstack-Api-Version: compute 2.92 Oct 30 01:05:09.737241 n-d-master-1 devstack@n-api.service[105231]: Openstack-System-Scope: None Oct 30 01:05:09.737241 n-d-master-1 devstack@n-api.service[105231]: User-Agent: python-novaclient Oct 30 01:05:09.737241 n-d-master-1 devstack@n-api.service[105231]: X-Auth-Token: gAAAAABjXc3Fe4xcF0RaNEU7vgKohFCNxsG4OLbP5IkrtVidTS5OpjKI5yNJIQUYytecALB6qY40vwmr8JCrb72Wd5GBgY-sfhDepM2I_3RzdV2AIFa_scH2gklyLF3BQeHNBywrIYtBQmn0S5EkXtSD71n8WVDG0PZYvRcOfGiRtWouwXlqlqA Oct 30 01:05:09.737241 n-d-master-1 devstack@n-api.service[105231]: X-Domain-Id: None Oct 30 01:05:09.737241 n-d-master-1 devstack@n-api.service[105231]: X-Domain-Name: None Oct 30 01:05:09.737241 n-d-master-1 devstack@n-api.service[105231]: X-Identity-Status: Confirmed Oct 30 01:05:09.737241 n-d-master-1 devstack@n-api.service[105231]: X-Is-Admin-Project: True Oct 30 01:05:09.737241 n-d-master-1 devstack@n-api.service[105231]: X-Openstack-Nova-Api-Version: 2.92 Oct 30 01:05:09.737241 n-d-master-1 devstack@n-api.service[105231]: X-Project-Domain-Id: default Oct 30 01:05:09.737241 n-d-master-1 devstack@n-api.service[105231]: X-Project-Domain-Name: Default Oct 30 01:05:09.737241 n-d-master-1 devstack@n-api.service[105231]: X-Project-Id: e4f4b3ee17464dd9b78ef48e253d6687 Oct 30 01:05:09.737241 n-d-master-1 devstack@n-api.service[105231]: X-Project-Name: admin Oct 30 01:05:09.737241 n-d-master-1 devstack@n-api.service[105231]: X-Role: member,admin,reader Oct 30 01:05:09.737241 n-d-master-1 devstack@n-api.service[105231]: X-Roles: member,admin,reader Oct 30 01:05:09.739471 n-d-master-1 devstack@n-api.service[105231]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e4f4b3ee17464dd9b78ef48e253d6687"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e4f4b3ee17464dd9b78ef48e253d6687"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e4f4b3ee17464dd9b78ef48e253d6687"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e4f4b3ee17464dd9b78ef48e253d6687"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:05:09.739471 n-d-master-1 devstack@n-api.service[105231]: X-Tenant: admin Oct 30 01:05:09.739471 n-d-master-1 devstack@n-api.service[105231]: X-Tenant-Id: e4f4b3ee17464dd9b78ef48e253d6687 Oct 30 01:05:09.739471 n-d-master-1 devstack@n-api.service[105231]: X-Tenant-Name: admin Oct 30 01:05:09.739471 n-d-master-1 devstack@n-api.service[105231]: X-User: admin Oct 30 01:05:09.739471 n-d-master-1 devstack@n-api.service[105231]: X-User-Domain-Id: default Oct 30 01:05:09.739471 n-d-master-1 devstack@n-api.service[105231]: X-User-Domain-Name: Default Oct 30 01:05:09.739471 n-d-master-1 devstack@n-api.service[105231]: X-User-Id: 4a27d1c574be440baaae707174fd41c2 Oct 30 01:05:09.739471 n-d-master-1 devstack@n-api.service[105231]: X-User-Name: admin Oct 30 01:05:09.739471 n-d-master-1 devstack@n-api.service[105231]: method: > Oct 30 01:05:09.739471 n-d-master-1 devstack@n-api.service[105231]: exception: Flavor 42 could not be found. Oct 30 01:05:09.739471 n-d-master-1 devstack@n-api.service[105231]: action_args: {'id': '42'} Oct 30 01:05:09.739471 n-d-master-1 devstack@n-api.service[105231]: {{(pid=105231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:05:09.739471 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:05:09.740426 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 30 01:05:09.740426 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 30 01:05:09.740426 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 30 01:05:09.740426 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 30 01:05:09.740426 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 01:05:09.740426 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 01:05:09.740426 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 30 01:05:09.740426 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 30 01:05:09.740426 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 30 01:05:09.740426 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:05:09.740426 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 30 01:05:09.740426 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 30 01:05:09.740426 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 30 01:05:09.740426 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi Oct 30 01:05:09.740426 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:05:09.740426 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi Oct 30 01:05:09.740426 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:05:09.740426 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:05:09.740426 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:05:09.741578 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:05:09.741578 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:05:09.741578 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:05:09.741578 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:05:09.741578 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 30 01:05:09.741578 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:05:09.741578 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 30 01:05:09.741578 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi Oct 30 01:05:09.741578 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:05:09.741578 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi Oct 30 01:05:09.741578 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:05:09.741578 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:05:09.741578 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:05:09.741578 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:05:09.741578 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:05:09.741578 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 30 01:05:09.741578 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi Oct 30 01:05:09.741578 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi [None req-ddd019fb-ea76-4f11-9527-ca450873e337 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:05:09.742705 n-d-master-1 devstack@n-api.service[105231]: INFO nova.api.openstack.requestlog [None req-ddd019fb-ea76-4f11-9527-ca450873e337 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.400122 Oct 30 01:05:09.742705 n-d-master-1 devstack@n-api.service[105231]: [pid: 105231|app: 0|req: 19/39] 10.222.0.13 () {60 vars in 1190 bytes} [Sun Oct 30 01:05:09 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 401 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 30 01:05:09.749261 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi [None req-a4029865-c291-40e6-bbc1-b474bef2398a admin admin] Calling method '>' {{(pid=105232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:05:09.772687 n-d-master-1 devstack@n-api.service[105232]: INFO nova.api.openstack.requestlog [None req-a4029865-c291-40e6-bbc1-b474bef2398a admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027217 Oct 30 01:05:09.773940 n-d-master-1 devstack@n-api.service[105232]: [pid: 105232|app: 0|req: 21/40] 10.222.0.13 () {60 vars in 1210 bytes} [Sun Oct 30 01:05:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:05:09.784341 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi [None req-0e8bdf9d-64de-43ea-b6d3-1c76d8fe3434 admin admin] Calling method '>' {{(pid=105231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:05:09.806996 n-d-master-1 devstack@n-api.service[105231]: INFO nova.api.openstack.requestlog [None req-0e8bdf9d-64de-43ea-b6d3-1c76d8fe3434 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027161 Oct 30 01:05:09.807542 n-d-master-1 devstack@n-api.service[105231]: [pid: 105231|app: 0|req: 20/41] 10.222.0.13 () {60 vars in 1210 bytes} [Sun Oct 30 01:05:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:05:09.817977 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi [None req-bde7bdf0-da02-43f4-9f89-dc4aae389c40 admin admin] Calling method '>' {{(pid=105232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:05:09.823370 n-d-master-1 devstack@n-api.service[105232]: INFO nova.api.openstack.wsgi [None req-bde7bdf0-da02-43f4-9f89-dc4aae389c40 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 30 01:05:09.826782 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi [None req-bde7bdf0-da02-43f4-9f89-dc4aae389c40 admin admin] Request method failure captured: Oct 30 01:05:09.826782 n-d-master-1 devstack@n-api.service[105232]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 30 01:05:09.826782 n-d-master-1 devstack@n-api.service[105232]: Accept: application/json Oct 30 01:05:09.826782 n-d-master-1 devstack@n-api.service[105232]: Accept-Encoding: gzip, deflate Oct 30 01:05:09.826782 n-d-master-1 devstack@n-api.service[105232]: Connection: keep-alive Oct 30 01:05:09.826782 n-d-master-1 devstack@n-api.service[105232]: Content-Length: 0 Oct 30 01:05:09.826782 n-d-master-1 devstack@n-api.service[105232]: Host: 10.222.0.13 Oct 30 01:05:09.826782 n-d-master-1 devstack@n-api.service[105232]: Openstack-Api-Version: compute 2.92 Oct 30 01:05:09.826782 n-d-master-1 devstack@n-api.service[105232]: Openstack-System-Scope: None Oct 30 01:05:09.826782 n-d-master-1 devstack@n-api.service[105232]: User-Agent: python-novaclient Oct 30 01:05:09.826782 n-d-master-1 devstack@n-api.service[105232]: X-Auth-Token: gAAAAABjXc3Fe4xcF0RaNEU7vgKohFCNxsG4OLbP5IkrtVidTS5OpjKI5yNJIQUYytecALB6qY40vwmr8JCrb72Wd5GBgY-sfhDepM2I_3RzdV2AIFa_scH2gklyLF3BQeHNBywrIYtBQmn0S5EkXtSD71n8WVDG0PZYvRcOfGiRtWouwXlqlqA Oct 30 01:05:09.826782 n-d-master-1 devstack@n-api.service[105232]: X-Domain-Id: None Oct 30 01:05:09.826782 n-d-master-1 devstack@n-api.service[105232]: X-Domain-Name: None Oct 30 01:05:09.826782 n-d-master-1 devstack@n-api.service[105232]: X-Identity-Status: Confirmed Oct 30 01:05:09.826782 n-d-master-1 devstack@n-api.service[105232]: X-Is-Admin-Project: True Oct 30 01:05:09.826782 n-d-master-1 devstack@n-api.service[105232]: X-Openstack-Nova-Api-Version: 2.92 Oct 30 01:05:09.826782 n-d-master-1 devstack@n-api.service[105232]: X-Project-Domain-Id: default Oct 30 01:05:09.826782 n-d-master-1 devstack@n-api.service[105232]: X-Project-Domain-Name: Default Oct 30 01:05:09.826782 n-d-master-1 devstack@n-api.service[105232]: X-Project-Id: e4f4b3ee17464dd9b78ef48e253d6687 Oct 30 01:05:09.826782 n-d-master-1 devstack@n-api.service[105232]: X-Project-Name: admin Oct 30 01:05:09.826782 n-d-master-1 devstack@n-api.service[105232]: X-Role: member,admin,reader Oct 30 01:05:09.826782 n-d-master-1 devstack@n-api.service[105232]: X-Roles: member,admin,reader Oct 30 01:05:09.832567 n-d-master-1 devstack@n-api.service[105232]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e4f4b3ee17464dd9b78ef48e253d6687"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e4f4b3ee17464dd9b78ef48e253d6687"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e4f4b3ee17464dd9b78ef48e253d6687"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e4f4b3ee17464dd9b78ef48e253d6687"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:05:09.832567 n-d-master-1 devstack@n-api.service[105232]: X-Tenant: admin Oct 30 01:05:09.832567 n-d-master-1 devstack@n-api.service[105232]: X-Tenant-Id: e4f4b3ee17464dd9b78ef48e253d6687 Oct 30 01:05:09.832567 n-d-master-1 devstack@n-api.service[105232]: X-Tenant-Name: admin Oct 30 01:05:09.832567 n-d-master-1 devstack@n-api.service[105232]: X-User: admin Oct 30 01:05:09.832567 n-d-master-1 devstack@n-api.service[105232]: X-User-Domain-Id: default Oct 30 01:05:09.832567 n-d-master-1 devstack@n-api.service[105232]: X-User-Domain-Name: Default Oct 30 01:05:09.832567 n-d-master-1 devstack@n-api.service[105232]: X-User-Id: 4a27d1c574be440baaae707174fd41c2 Oct 30 01:05:09.832567 n-d-master-1 devstack@n-api.service[105232]: X-User-Name: admin Oct 30 01:05:09.832567 n-d-master-1 devstack@n-api.service[105232]: method: > Oct 30 01:05:09.832567 n-d-master-1 devstack@n-api.service[105232]: exception: Flavor 42 could not be found. Oct 30 01:05:09.832567 n-d-master-1 devstack@n-api.service[105232]: action_args: {'id': '42'} Oct 30 01:05:09.832567 n-d-master-1 devstack@n-api.service[105232]: {{(pid=105232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:05:09.832567 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:05:09.833593 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 30 01:05:09.833593 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 30 01:05:09.833593 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 30 01:05:09.833593 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 30 01:05:09.833593 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 01:05:09.833593 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 01:05:09.833593 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 30 01:05:09.833593 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 30 01:05:09.833593 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 30 01:05:09.833593 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:05:09.833593 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 30 01:05:09.833593 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 30 01:05:09.833593 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 30 01:05:09.833593 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi Oct 30 01:05:09.833593 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:05:09.833593 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi Oct 30 01:05:09.833593 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:05:09.833593 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:05:09.833593 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:05:09.834882 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:05:09.834882 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:05:09.834882 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:05:09.834882 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:05:09.834882 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 30 01:05:09.834882 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:05:09.834882 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 30 01:05:09.834882 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi Oct 30 01:05:09.834882 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:05:09.834882 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi Oct 30 01:05:09.834882 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:05:09.834882 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:05:09.834882 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:05:09.834882 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:05:09.834882 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:05:09.834882 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 30 01:05:09.834882 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi Oct 30 01:05:09.834882 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi [None req-bde7bdf0-da02-43f4-9f89-dc4aae389c40 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:05:09.836100 n-d-master-1 devstack@n-api.service[105232]: INFO nova.api.openstack.requestlog [None req-bde7bdf0-da02-43f4-9f89-dc4aae389c40 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014684 Oct 30 01:05:09.836100 n-d-master-1 devstack@n-api.service[105232]: [pid: 105232|app: 0|req: 22/42] 10.222.0.13 () {60 vars in 1190 bytes} [Sun Oct 30 01:05:09 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 30 01:05:11.044049 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi [None req-0e8bdf9d-64de-43ea-b6d3-1c76d8fe3434 admin admin] Calling method '>' {{(pid=105231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:05:11.045046 n-d-master-1 devstack@n-api.service[105231]: INFO nova.api.openstack.requestlog [None req-0e8bdf9d-64de-43ea-b6d3-1c76d8fe3434 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Oct 30 01:05:11.045473 n-d-master-1 devstack@n-api.service[105231]: [pid: 105231|app: 0|req: 21/43] 10.222.0.13 () {56 vars in 1074 bytes} [Sun Oct 30 01:05:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:05:11.581807 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi [None req-a9071070-c8f0-42d1-a567-fd9a67c9e097 admin admin] Calling method '>' {{(pid=105232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:05:11.586851 n-d-master-1 devstack@n-api.service[105232]: INFO nova.api.openstack.wsgi [None req-a9071070-c8f0-42d1-a567-fd9a67c9e097 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 30 01:05:11.588397 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi [None req-a9071070-c8f0-42d1-a567-fd9a67c9e097 admin admin] Request method failure captured: Oct 30 01:05:11.588397 n-d-master-1 devstack@n-api.service[105232]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 30 01:05:11.588397 n-d-master-1 devstack@n-api.service[105232]: Accept: application/json Oct 30 01:05:11.588397 n-d-master-1 devstack@n-api.service[105232]: Accept-Encoding: gzip, deflate Oct 30 01:05:11.588397 n-d-master-1 devstack@n-api.service[105232]: Connection: keep-alive Oct 30 01:05:11.588397 n-d-master-1 devstack@n-api.service[105232]: Content-Length: 0 Oct 30 01:05:11.588397 n-d-master-1 devstack@n-api.service[105232]: Host: 10.222.0.13 Oct 30 01:05:11.588397 n-d-master-1 devstack@n-api.service[105232]: Openstack-Api-Version: compute 2.92 Oct 30 01:05:11.588397 n-d-master-1 devstack@n-api.service[105232]: Openstack-System-Scope: None Oct 30 01:05:11.588397 n-d-master-1 devstack@n-api.service[105232]: User-Agent: python-novaclient Oct 30 01:05:11.588397 n-d-master-1 devstack@n-api.service[105232]: X-Auth-Token: gAAAAABjXc3GBI8h_TIQc7FqrBTezoVBvZhqypg92u7W6Dqn1ioPT4cfpv6CkBsw5npOX3AxW72e2ftkWragPkCIVFYd42sAa2cROgHrAFME6ZCyer33WgAOPukgPfmAQpZn6j_Suz8s-GVGKpcZfJeVmJknYs6NCQT3Cy9qTBPYwhMhO5F9rbk Oct 30 01:05:11.588397 n-d-master-1 devstack@n-api.service[105232]: X-Domain-Id: None Oct 30 01:05:11.588397 n-d-master-1 devstack@n-api.service[105232]: X-Domain-Name: None Oct 30 01:05:11.588397 n-d-master-1 devstack@n-api.service[105232]: X-Identity-Status: Confirmed Oct 30 01:05:11.588397 n-d-master-1 devstack@n-api.service[105232]: X-Is-Admin-Project: True Oct 30 01:05:11.588397 n-d-master-1 devstack@n-api.service[105232]: X-Openstack-Nova-Api-Version: 2.92 Oct 30 01:05:11.588397 n-d-master-1 devstack@n-api.service[105232]: X-Project-Domain-Id: default Oct 30 01:05:11.588397 n-d-master-1 devstack@n-api.service[105232]: X-Project-Domain-Name: Default Oct 30 01:05:11.588397 n-d-master-1 devstack@n-api.service[105232]: X-Project-Id: e4f4b3ee17464dd9b78ef48e253d6687 Oct 30 01:05:11.588397 n-d-master-1 devstack@n-api.service[105232]: X-Project-Name: admin Oct 30 01:05:11.588397 n-d-master-1 devstack@n-api.service[105232]: X-Role: member,admin,reader Oct 30 01:05:11.588397 n-d-master-1 devstack@n-api.service[105232]: X-Roles: member,admin,reader Oct 30 01:05:11.589751 n-d-master-1 devstack@n-api.service[105232]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e4f4b3ee17464dd9b78ef48e253d6687"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e4f4b3ee17464dd9b78ef48e253d6687"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e4f4b3ee17464dd9b78ef48e253d6687"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e4f4b3ee17464dd9b78ef48e253d6687"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:05:11.589751 n-d-master-1 devstack@n-api.service[105232]: X-Tenant: admin Oct 30 01:05:11.589751 n-d-master-1 devstack@n-api.service[105232]: X-Tenant-Id: e4f4b3ee17464dd9b78ef48e253d6687 Oct 30 01:05:11.589751 n-d-master-1 devstack@n-api.service[105232]: X-Tenant-Name: admin Oct 30 01:05:11.589751 n-d-master-1 devstack@n-api.service[105232]: X-User: admin Oct 30 01:05:11.589751 n-d-master-1 devstack@n-api.service[105232]: X-User-Domain-Id: default Oct 30 01:05:11.589751 n-d-master-1 devstack@n-api.service[105232]: X-User-Domain-Name: Default Oct 30 01:05:11.589751 n-d-master-1 devstack@n-api.service[105232]: X-User-Id: 4a27d1c574be440baaae707174fd41c2 Oct 30 01:05:11.589751 n-d-master-1 devstack@n-api.service[105232]: X-User-Name: admin Oct 30 01:05:11.589751 n-d-master-1 devstack@n-api.service[105232]: method: > Oct 30 01:05:11.589751 n-d-master-1 devstack@n-api.service[105232]: exception: Flavor 84 could not be found. Oct 30 01:05:11.589751 n-d-master-1 devstack@n-api.service[105232]: action_args: {'id': '84'} Oct 30 01:05:11.589751 n-d-master-1 devstack@n-api.service[105232]: {{(pid=105232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:05:11.589751 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:05:11.590689 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 30 01:05:11.590689 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 30 01:05:11.590689 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 30 01:05:11.590689 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 30 01:05:11.590689 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 01:05:11.590689 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 01:05:11.590689 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 30 01:05:11.590689 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 30 01:05:11.590689 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 30 01:05:11.590689 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:05:11.590689 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 30 01:05:11.590689 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 30 01:05:11.590689 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 30 01:05:11.590689 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi Oct 30 01:05:11.590689 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:05:11.590689 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi Oct 30 01:05:11.590689 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:05:11.590689 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:05:11.590689 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:05:11.591882 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:05:11.591882 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:05:11.591882 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:05:11.591882 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:05:11.591882 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 30 01:05:11.591882 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:05:11.591882 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 30 01:05:11.591882 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi Oct 30 01:05:11.591882 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:05:11.591882 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi Oct 30 01:05:11.591882 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:05:11.591882 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:05:11.591882 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:05:11.591882 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:05:11.591882 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:05:11.591882 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 30 01:05:11.591882 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi Oct 30 01:05:11.591882 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi [None req-a9071070-c8f0-42d1-a567-fd9a67c9e097 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:05:11.592943 n-d-master-1 devstack@n-api.service[105232]: INFO nova.api.openstack.requestlog [None req-a9071070-c8f0-42d1-a567-fd9a67c9e097 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.405195 Oct 30 01:05:11.592943 n-d-master-1 devstack@n-api.service[105232]: [pid: 105232|app: 0|req: 23/44] 10.222.0.13 () {60 vars in 1190 bytes} [Sun Oct 30 01:05:11 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 406 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 30 01:05:11.600162 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi [None req-3fe63472-e733-4cbe-a0dd-471313c645a8 admin admin] Calling method '>' {{(pid=105231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:05:11.615545 n-d-master-1 devstack@n-api.service[105231]: INFO nova.api.openstack.requestlog [None req-3fe63472-e733-4cbe-a0dd-471313c645a8 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019634 Oct 30 01:05:11.616132 n-d-master-1 devstack@n-api.service[105231]: [pid: 105231|app: 0|req: 22/45] 10.222.0.13 () {60 vars in 1210 bytes} [Sun Oct 30 01:05:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:05:11.625942 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi [None req-2dc4fa94-0ae5-4bfd-9b37-4a163ed75804 admin admin] Calling method '>' {{(pid=105232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:05:11.642262 n-d-master-1 devstack@n-api.service[105232]: INFO nova.api.openstack.requestlog [None req-2dc4fa94-0ae5-4bfd-9b37-4a163ed75804 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020021 Oct 30 01:05:11.642822 n-d-master-1 devstack@n-api.service[105232]: [pid: 105232|app: 0|req: 24/46] 10.222.0.13 () {60 vars in 1210 bytes} [Sun Oct 30 01:05:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:05:11.652887 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi [None req-fb5d3bca-d59e-4aee-8fa0-653240f35627 admin admin] Calling method '>' {{(pid=105231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:05:11.657924 n-d-master-1 devstack@n-api.service[105231]: INFO nova.api.openstack.wsgi [None req-fb5d3bca-d59e-4aee-8fa0-653240f35627 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 30 01:05:11.659411 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi [None req-fb5d3bca-d59e-4aee-8fa0-653240f35627 admin admin] Request method failure captured: Oct 30 01:05:11.659411 n-d-master-1 devstack@n-api.service[105231]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 30 01:05:11.659411 n-d-master-1 devstack@n-api.service[105231]: Accept: application/json Oct 30 01:05:11.659411 n-d-master-1 devstack@n-api.service[105231]: Accept-Encoding: gzip, deflate Oct 30 01:05:11.659411 n-d-master-1 devstack@n-api.service[105231]: Connection: keep-alive Oct 30 01:05:11.659411 n-d-master-1 devstack@n-api.service[105231]: Content-Length: 0 Oct 30 01:05:11.659411 n-d-master-1 devstack@n-api.service[105231]: Host: 10.222.0.13 Oct 30 01:05:11.659411 n-d-master-1 devstack@n-api.service[105231]: Openstack-Api-Version: compute 2.92 Oct 30 01:05:11.659411 n-d-master-1 devstack@n-api.service[105231]: Openstack-System-Scope: None Oct 30 01:05:11.659411 n-d-master-1 devstack@n-api.service[105231]: User-Agent: python-novaclient Oct 30 01:05:11.659411 n-d-master-1 devstack@n-api.service[105231]: X-Auth-Token: gAAAAABjXc3GBI8h_TIQc7FqrBTezoVBvZhqypg92u7W6Dqn1ioPT4cfpv6CkBsw5npOX3AxW72e2ftkWragPkCIVFYd42sAa2cROgHrAFME6ZCyer33WgAOPukgPfmAQpZn6j_Suz8s-GVGKpcZfJeVmJknYs6NCQT3Cy9qTBPYwhMhO5F9rbk Oct 30 01:05:11.659411 n-d-master-1 devstack@n-api.service[105231]: X-Domain-Id: None Oct 30 01:05:11.659411 n-d-master-1 devstack@n-api.service[105231]: X-Domain-Name: None Oct 30 01:05:11.659411 n-d-master-1 devstack@n-api.service[105231]: X-Identity-Status: Confirmed Oct 30 01:05:11.659411 n-d-master-1 devstack@n-api.service[105231]: X-Is-Admin-Project: True Oct 30 01:05:11.659411 n-d-master-1 devstack@n-api.service[105231]: X-Openstack-Nova-Api-Version: 2.92 Oct 30 01:05:11.659411 n-d-master-1 devstack@n-api.service[105231]: X-Project-Domain-Id: default Oct 30 01:05:11.659411 n-d-master-1 devstack@n-api.service[105231]: X-Project-Domain-Name: Default Oct 30 01:05:11.659411 n-d-master-1 devstack@n-api.service[105231]: X-Project-Id: e4f4b3ee17464dd9b78ef48e253d6687 Oct 30 01:05:11.659411 n-d-master-1 devstack@n-api.service[105231]: X-Project-Name: admin Oct 30 01:05:11.659411 n-d-master-1 devstack@n-api.service[105231]: X-Role: member,admin,reader Oct 30 01:05:11.659411 n-d-master-1 devstack@n-api.service[105231]: X-Roles: member,admin,reader Oct 30 01:05:11.660732 n-d-master-1 devstack@n-api.service[105231]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e4f4b3ee17464dd9b78ef48e253d6687"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e4f4b3ee17464dd9b78ef48e253d6687"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e4f4b3ee17464dd9b78ef48e253d6687"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e4f4b3ee17464dd9b78ef48e253d6687"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:05:11.660732 n-d-master-1 devstack@n-api.service[105231]: X-Tenant: admin Oct 30 01:05:11.660732 n-d-master-1 devstack@n-api.service[105231]: X-Tenant-Id: e4f4b3ee17464dd9b78ef48e253d6687 Oct 30 01:05:11.660732 n-d-master-1 devstack@n-api.service[105231]: X-Tenant-Name: admin Oct 30 01:05:11.660732 n-d-master-1 devstack@n-api.service[105231]: X-User: admin Oct 30 01:05:11.660732 n-d-master-1 devstack@n-api.service[105231]: X-User-Domain-Id: default Oct 30 01:05:11.660732 n-d-master-1 devstack@n-api.service[105231]: X-User-Domain-Name: Default Oct 30 01:05:11.660732 n-d-master-1 devstack@n-api.service[105231]: X-User-Id: 4a27d1c574be440baaae707174fd41c2 Oct 30 01:05:11.660732 n-d-master-1 devstack@n-api.service[105231]: X-User-Name: admin Oct 30 01:05:11.660732 n-d-master-1 devstack@n-api.service[105231]: method: > Oct 30 01:05:11.660732 n-d-master-1 devstack@n-api.service[105231]: exception: Flavor 84 could not be found. Oct 30 01:05:11.660732 n-d-master-1 devstack@n-api.service[105231]: action_args: {'id': '84'} Oct 30 01:05:11.660732 n-d-master-1 devstack@n-api.service[105231]: {{(pid=105231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:05:11.660732 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:05:11.661775 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 30 01:05:11.661775 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 30 01:05:11.661775 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 30 01:05:11.661775 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 30 01:05:11.661775 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 01:05:11.661775 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 01:05:11.661775 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 30 01:05:11.661775 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 30 01:05:11.661775 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 30 01:05:11.661775 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:05:11.661775 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 30 01:05:11.661775 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 30 01:05:11.661775 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 30 01:05:11.661775 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi Oct 30 01:05:11.661775 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:05:11.661775 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi Oct 30 01:05:11.661775 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:05:11.661775 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:05:11.661775 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:05:11.663239 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:05:11.663239 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:05:11.663239 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:05:11.663239 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:05:11.663239 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 30 01:05:11.663239 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:05:11.663239 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 30 01:05:11.663239 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi Oct 30 01:05:11.663239 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:05:11.663239 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi Oct 30 01:05:11.663239 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:05:11.663239 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:05:11.663239 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:05:11.663239 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:05:11.663239 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:05:11.663239 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 30 01:05:11.663239 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi Oct 30 01:05:11.663239 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi [None req-fb5d3bca-d59e-4aee-8fa0-653240f35627 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:05:11.664445 n-d-master-1 devstack@n-api.service[105231]: INFO nova.api.openstack.requestlog [None req-fb5d3bca-d59e-4aee-8fa0-653240f35627 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011463 Oct 30 01:05:11.664445 n-d-master-1 devstack@n-api.service[105231]: [pid: 105231|app: 0|req: 23/47] 10.222.0.13 () {60 vars in 1190 bytes} [Sun Oct 30 01:05:11 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 30 01:05:12.887950 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi [None req-2dc4fa94-0ae5-4bfd-9b37-4a163ed75804 admin admin] Calling method '>' {{(pid=105232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:05:12.888954 n-d-master-1 devstack@n-api.service[105232]: INFO nova.api.openstack.requestlog [None req-2dc4fa94-0ae5-4bfd-9b37-4a163ed75804 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Oct 30 01:05:12.889378 n-d-master-1 devstack@n-api.service[105232]: [pid: 105232|app: 0|req: 25/48] 10.222.0.13 () {56 vars in 1074 bytes} [Sun Oct 30 01:05:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:05:13.419577 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi [None req-37291d15-928c-4c56-92dc-cce63f0edb4c admin admin] Calling method '>' {{(pid=105231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:05:13.426385 n-d-master-1 devstack@n-api.service[105231]: INFO nova.api.openstack.wsgi [None req-37291d15-928c-4c56-92dc-cce63f0edb4c admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 30 01:05:13.427916 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi [None req-37291d15-928c-4c56-92dc-cce63f0edb4c admin admin] Request method failure captured: Oct 30 01:05:13.427916 n-d-master-1 devstack@n-api.service[105231]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 30 01:05:13.427916 n-d-master-1 devstack@n-api.service[105231]: Accept: application/json Oct 30 01:05:13.427916 n-d-master-1 devstack@n-api.service[105231]: Accept-Encoding: gzip, deflate Oct 30 01:05:13.427916 n-d-master-1 devstack@n-api.service[105231]: Connection: keep-alive Oct 30 01:05:13.427916 n-d-master-1 devstack@n-api.service[105231]: Content-Length: 0 Oct 30 01:05:13.427916 n-d-master-1 devstack@n-api.service[105231]: Host: 10.222.0.13 Oct 30 01:05:13.427916 n-d-master-1 devstack@n-api.service[105231]: Openstack-Api-Version: compute 2.92 Oct 30 01:05:13.427916 n-d-master-1 devstack@n-api.service[105231]: Openstack-System-Scope: None Oct 30 01:05:13.427916 n-d-master-1 devstack@n-api.service[105231]: User-Agent: python-novaclient Oct 30 01:05:13.427916 n-d-master-1 devstack@n-api.service[105231]: X-Auth-Token: gAAAAABjXc3IUQCd1i6gXBjIzkCF93N6Zdi4buc4n_AgW95GV01uQAAphrKluiLT5Ftr-xpu_dCZX5PMDrtzpiNKmnawuNBgUyQ0Nw_Qyn7LHdz7tjnuZ7uPGPUb2s3lOoKgH8lPp7N472RFcaAXXhSEgBXPPcvEYIKH_qsjd1KLydMO_h2aBr4 Oct 30 01:05:13.427916 n-d-master-1 devstack@n-api.service[105231]: X-Domain-Id: None Oct 30 01:05:13.427916 n-d-master-1 devstack@n-api.service[105231]: X-Domain-Name: None Oct 30 01:05:13.427916 n-d-master-1 devstack@n-api.service[105231]: X-Identity-Status: Confirmed Oct 30 01:05:13.427916 n-d-master-1 devstack@n-api.service[105231]: X-Is-Admin-Project: True Oct 30 01:05:13.427916 n-d-master-1 devstack@n-api.service[105231]: X-Openstack-Nova-Api-Version: 2.92 Oct 30 01:05:13.427916 n-d-master-1 devstack@n-api.service[105231]: X-Project-Domain-Id: default Oct 30 01:05:13.427916 n-d-master-1 devstack@n-api.service[105231]: X-Project-Domain-Name: Default Oct 30 01:05:13.427916 n-d-master-1 devstack@n-api.service[105231]: X-Project-Id: e4f4b3ee17464dd9b78ef48e253d6687 Oct 30 01:05:13.427916 n-d-master-1 devstack@n-api.service[105231]: X-Project-Name: admin Oct 30 01:05:13.427916 n-d-master-1 devstack@n-api.service[105231]: X-Role: member,admin,reader Oct 30 01:05:13.427916 n-d-master-1 devstack@n-api.service[105231]: X-Roles: member,admin,reader Oct 30 01:05:13.429491 n-d-master-1 devstack@n-api.service[105231]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e4f4b3ee17464dd9b78ef48e253d6687"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e4f4b3ee17464dd9b78ef48e253d6687"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e4f4b3ee17464dd9b78ef48e253d6687"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e4f4b3ee17464dd9b78ef48e253d6687"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:05:13.429491 n-d-master-1 devstack@n-api.service[105231]: X-Tenant: admin Oct 30 01:05:13.429491 n-d-master-1 devstack@n-api.service[105231]: X-Tenant-Id: e4f4b3ee17464dd9b78ef48e253d6687 Oct 30 01:05:13.429491 n-d-master-1 devstack@n-api.service[105231]: X-Tenant-Name: admin Oct 30 01:05:13.429491 n-d-master-1 devstack@n-api.service[105231]: X-User: admin Oct 30 01:05:13.429491 n-d-master-1 devstack@n-api.service[105231]: X-User-Domain-Id: default Oct 30 01:05:13.429491 n-d-master-1 devstack@n-api.service[105231]: X-User-Domain-Name: Default Oct 30 01:05:13.429491 n-d-master-1 devstack@n-api.service[105231]: X-User-Id: 4a27d1c574be440baaae707174fd41c2 Oct 30 01:05:13.429491 n-d-master-1 devstack@n-api.service[105231]: X-User-Name: admin Oct 30 01:05:13.429491 n-d-master-1 devstack@n-api.service[105231]: method: > Oct 30 01:05:13.429491 n-d-master-1 devstack@n-api.service[105231]: exception: Flavor 451 could not be found. Oct 30 01:05:13.429491 n-d-master-1 devstack@n-api.service[105231]: action_args: {'id': '451'} Oct 30 01:05:13.429491 n-d-master-1 devstack@n-api.service[105231]: {{(pid=105231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:05:13.429491 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:05:13.430621 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 30 01:05:13.430621 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 30 01:05:13.430621 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 30 01:05:13.430621 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 30 01:05:13.430621 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 01:05:13.430621 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 01:05:13.430621 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 30 01:05:13.430621 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 30 01:05:13.430621 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 30 01:05:13.430621 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:05:13.430621 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 30 01:05:13.430621 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 30 01:05:13.430621 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 30 01:05:13.430621 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi Oct 30 01:05:13.430621 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:05:13.430621 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi Oct 30 01:05:13.430621 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:05:13.430621 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:05:13.430621 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:05:13.431687 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:05:13.431687 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:05:13.431687 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:05:13.431687 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:05:13.431687 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 30 01:05:13.431687 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:05:13.431687 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 30 01:05:13.431687 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi Oct 30 01:05:13.431687 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:05:13.431687 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi Oct 30 01:05:13.431687 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:05:13.431687 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:05:13.431687 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:05:13.431687 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:05:13.431687 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:05:13.431687 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 30 01:05:13.431687 n-d-master-1 devstack@n-api.service[105231]: ERROR nova.api.openstack.wsgi Oct 30 01:05:13.431687 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi [None req-37291d15-928c-4c56-92dc-cce63f0edb4c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:05:13.432759 n-d-master-1 devstack@n-api.service[105231]: INFO nova.api.openstack.requestlog [None req-37291d15-928c-4c56-92dc-cce63f0edb4c admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.401730 Oct 30 01:05:13.432759 n-d-master-1 devstack@n-api.service[105231]: [pid: 105231|app: 0|req: 24/49] 10.222.0.13 () {60 vars in 1193 bytes} [Sun Oct 30 01:05:13 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 403 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 30 01:05:13.439498 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi [None req-7e14f15c-9418-47bd-9093-f25594cd4efa admin admin] Calling method '>' {{(pid=105232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:05:13.454730 n-d-master-1 devstack@n-api.service[105232]: INFO nova.api.openstack.requestlog [None req-7e14f15c-9418-47bd-9093-f25594cd4efa admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018848 Oct 30 01:05:13.455279 n-d-master-1 devstack@n-api.service[105232]: [pid: 105232|app: 0|req: 26/50] 10.222.0.13 () {60 vars in 1210 bytes} [Sun Oct 30 01:05:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:05:13.465583 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi [None req-7d7d5941-1adc-4bfa-b889-a0e46b803dc2 admin admin] Calling method '>' {{(pid=105231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:05:13.481910 n-d-master-1 devstack@n-api.service[105231]: INFO nova.api.openstack.requestlog [None req-7d7d5941-1adc-4bfa-b889-a0e46b803dc2 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019747 Oct 30 01:05:13.482501 n-d-master-1 devstack@n-api.service[105231]: [pid: 105231|app: 0|req: 25/51] 10.222.0.13 () {60 vars in 1210 bytes} [Sun Oct 30 01:05:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:05:13.492005 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi [None req-7c37da68-6847-4eb1-af63-6f1cde66751d admin admin] Calling method '>' {{(pid=105232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:05:13.497126 n-d-master-1 devstack@n-api.service[105232]: INFO nova.api.openstack.wsgi [None req-7c37da68-6847-4eb1-af63-6f1cde66751d admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 30 01:05:13.498684 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi [None req-7c37da68-6847-4eb1-af63-6f1cde66751d admin admin] Request method failure captured: Oct 30 01:05:13.498684 n-d-master-1 devstack@n-api.service[105232]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 30 01:05:13.498684 n-d-master-1 devstack@n-api.service[105232]: Accept: application/json Oct 30 01:05:13.498684 n-d-master-1 devstack@n-api.service[105232]: Accept-Encoding: gzip, deflate Oct 30 01:05:13.498684 n-d-master-1 devstack@n-api.service[105232]: Connection: keep-alive Oct 30 01:05:13.498684 n-d-master-1 devstack@n-api.service[105232]: Content-Length: 0 Oct 30 01:05:13.498684 n-d-master-1 devstack@n-api.service[105232]: Host: 10.222.0.13 Oct 30 01:05:13.498684 n-d-master-1 devstack@n-api.service[105232]: Openstack-Api-Version: compute 2.92 Oct 30 01:05:13.498684 n-d-master-1 devstack@n-api.service[105232]: Openstack-System-Scope: None Oct 30 01:05:13.498684 n-d-master-1 devstack@n-api.service[105232]: User-Agent: python-novaclient Oct 30 01:05:13.498684 n-d-master-1 devstack@n-api.service[105232]: X-Auth-Token: gAAAAABjXc3IUQCd1i6gXBjIzkCF93N6Zdi4buc4n_AgW95GV01uQAAphrKluiLT5Ftr-xpu_dCZX5PMDrtzpiNKmnawuNBgUyQ0Nw_Qyn7LHdz7tjnuZ7uPGPUb2s3lOoKgH8lPp7N472RFcaAXXhSEgBXPPcvEYIKH_qsjd1KLydMO_h2aBr4 Oct 30 01:05:13.498684 n-d-master-1 devstack@n-api.service[105232]: X-Domain-Id: None Oct 30 01:05:13.498684 n-d-master-1 devstack@n-api.service[105232]: X-Domain-Name: None Oct 30 01:05:13.498684 n-d-master-1 devstack@n-api.service[105232]: X-Identity-Status: Confirmed Oct 30 01:05:13.498684 n-d-master-1 devstack@n-api.service[105232]: X-Is-Admin-Project: True Oct 30 01:05:13.498684 n-d-master-1 devstack@n-api.service[105232]: X-Openstack-Nova-Api-Version: 2.92 Oct 30 01:05:13.498684 n-d-master-1 devstack@n-api.service[105232]: X-Project-Domain-Id: default Oct 30 01:05:13.498684 n-d-master-1 devstack@n-api.service[105232]: X-Project-Domain-Name: Default Oct 30 01:05:13.498684 n-d-master-1 devstack@n-api.service[105232]: X-Project-Id: e4f4b3ee17464dd9b78ef48e253d6687 Oct 30 01:05:13.498684 n-d-master-1 devstack@n-api.service[105232]: X-Project-Name: admin Oct 30 01:05:13.498684 n-d-master-1 devstack@n-api.service[105232]: X-Role: member,admin,reader Oct 30 01:05:13.498684 n-d-master-1 devstack@n-api.service[105232]: X-Roles: member,admin,reader Oct 30 01:05:13.500248 n-d-master-1 devstack@n-api.service[105232]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e4f4b3ee17464dd9b78ef48e253d6687"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e4f4b3ee17464dd9b78ef48e253d6687"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e4f4b3ee17464dd9b78ef48e253d6687"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e4f4b3ee17464dd9b78ef48e253d6687"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:05:13.500248 n-d-master-1 devstack@n-api.service[105232]: X-Tenant: admin Oct 30 01:05:13.500248 n-d-master-1 devstack@n-api.service[105232]: X-Tenant-Id: e4f4b3ee17464dd9b78ef48e253d6687 Oct 30 01:05:13.500248 n-d-master-1 devstack@n-api.service[105232]: X-Tenant-Name: admin Oct 30 01:05:13.500248 n-d-master-1 devstack@n-api.service[105232]: X-User: admin Oct 30 01:05:13.500248 n-d-master-1 devstack@n-api.service[105232]: X-User-Domain-Id: default Oct 30 01:05:13.500248 n-d-master-1 devstack@n-api.service[105232]: X-User-Domain-Name: Default Oct 30 01:05:13.500248 n-d-master-1 devstack@n-api.service[105232]: X-User-Id: 4a27d1c574be440baaae707174fd41c2 Oct 30 01:05:13.500248 n-d-master-1 devstack@n-api.service[105232]: X-User-Name: admin Oct 30 01:05:13.500248 n-d-master-1 devstack@n-api.service[105232]: method: > Oct 30 01:05:13.500248 n-d-master-1 devstack@n-api.service[105232]: exception: Flavor 451 could not be found. Oct 30 01:05:13.500248 n-d-master-1 devstack@n-api.service[105232]: action_args: {'id': '451'} Oct 30 01:05:13.500248 n-d-master-1 devstack@n-api.service[105232]: {{(pid=105232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:05:13.500248 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:05:13.501327 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 30 01:05:13.501327 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 30 01:05:13.501327 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 30 01:05:13.501327 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 30 01:05:13.501327 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 01:05:13.501327 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 01:05:13.501327 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 30 01:05:13.501327 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 30 01:05:13.501327 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 30 01:05:13.501327 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:05:13.501327 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 30 01:05:13.501327 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 30 01:05:13.501327 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 30 01:05:13.501327 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi Oct 30 01:05:13.501327 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:05:13.501327 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi Oct 30 01:05:13.501327 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:05:13.501327 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:05:13.501327 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:05:13.502693 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:05:13.502693 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:05:13.502693 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:05:13.502693 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:05:13.502693 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 30 01:05:13.502693 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:05:13.502693 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 30 01:05:13.502693 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi Oct 30 01:05:13.502693 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:05:13.502693 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi Oct 30 01:05:13.502693 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:05:13.502693 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:05:13.502693 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:05:13.502693 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:05:13.502693 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:05:13.502693 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 30 01:05:13.502693 n-d-master-1 devstack@n-api.service[105232]: ERROR nova.api.openstack.wsgi Oct 30 01:05:13.502693 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi [None req-7c37da68-6847-4eb1-af63-6f1cde66751d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:05:13.503919 n-d-master-1 devstack@n-api.service[105232]: INFO nova.api.openstack.requestlog [None req-7c37da68-6847-4eb1-af63-6f1cde66751d admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011649 Oct 30 01:05:13.503919 n-d-master-1 devstack@n-api.service[105232]: [pid: 105232|app: 0|req: 27/52] 10.222.0.13 () {60 vars in 1193 bytes} [Sun Oct 30 01:05:13 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 30 01:05:14.720435 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi [None req-7d7d5941-1adc-4bfa-b889-a0e46b803dc2 admin admin] Calling method '>' {{(pid=105231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:05:14.721455 n-d-master-1 devstack@n-api.service[105231]: INFO nova.api.openstack.requestlog [None req-7d7d5941-1adc-4bfa-b889-a0e46b803dc2 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Oct 30 01:05:14.721838 n-d-master-1 devstack@n-api.service[105231]: [pid: 105231|app: 0|req: 26/53] 10.222.0.13 () {56 vars in 1074 bytes} [Sun Oct 30 01:05:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:05:15.255716 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi [None req-0c81f762-0e4c-4133-b290-9afbcd062c99 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:05:15.322817 n-d-master-1 devstack@n-api.service[105232]: INFO nova.api.openstack.requestlog [None req-0c81f762-0e4c-4133-b290-9afbcd062c99 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.462970 Oct 30 01:05:15.323384 n-d-master-1 devstack@n-api.service[105232]: [pid: 105232|app: 0|req: 28/54] 10.222.0.13 () {64 vars in 1235 bytes} [Sun Oct 30 01:05:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:05:16.554079 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi [None req-7d7d5941-1adc-4bfa-b889-a0e46b803dc2 admin admin] Calling method '>' {{(pid=105231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:05:16.555330 n-d-master-1 devstack@n-api.service[105231]: INFO nova.api.openstack.requestlog [None req-7d7d5941-1adc-4bfa-b889-a0e46b803dc2 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Oct 30 01:05:16.562412 n-d-master-1 devstack@n-api.service[105231]: [pid: 105231|app: 0|req: 27/55] 10.222.0.13 () {56 vars in 1074 bytes} [Sun Oct 30 01:05:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:05:17.094593 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi [None req-0aae8157-cbb0-402f-9fcb-cd0b9efd1e79 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:05:17.202874 n-d-master-1 devstack@n-api.service[105232]: INFO nova.api.openstack.requestlog [None req-0aae8157-cbb0-402f-9fcb-cd0b9efd1e79 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.512496 Oct 30 01:05:17.203454 n-d-master-1 devstack@n-api.service[105232]: [pid: 105232|app: 0|req: 29/56] 10.222.0.13 () {64 vars in 1235 bytes} [Sun Oct 30 01:05:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:05:18.439400 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi [None req-7d7d5941-1adc-4bfa-b889-a0e46b803dc2 admin admin] Calling method '>' {{(pid=105231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:05:18.440935 n-d-master-1 devstack@n-api.service[105231]: INFO nova.api.openstack.requestlog [None req-7d7d5941-1adc-4bfa-b889-a0e46b803dc2 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Oct 30 01:05:18.441325 n-d-master-1 devstack@n-api.service[105231]: [pid: 105231|app: 0|req: 28/57] 10.222.0.13 () {56 vars in 1074 bytes} [Sun Oct 30 01:05:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:05:18.981777 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi [None req-d928bb27-907c-401e-997e-be2ddae4a521 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:05:19.066148 n-d-master-1 devstack@n-api.service[105232]: INFO nova.api.openstack.requestlog [None req-d928bb27-907c-401e-997e-be2ddae4a521 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.482792 Oct 30 01:05:19.066708 n-d-master-1 devstack@n-api.service[105232]: [pid: 105232|app: 0|req: 30/58] 10.222.0.13 () {64 vars in 1235 bytes} [Sun Oct 30 01:05:18 2022] POST /compute/v2.1/flavors => generated 407 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:05:20.302905 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi [None req-7d7d5941-1adc-4bfa-b889-a0e46b803dc2 admin admin] Calling method '>' {{(pid=105231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:05:20.303904 n-d-master-1 devstack@n-api.service[105231]: INFO nova.api.openstack.requestlog [None req-7d7d5941-1adc-4bfa-b889-a0e46b803dc2 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Oct 30 01:05:20.304294 n-d-master-1 devstack@n-api.service[105231]: [pid: 105231|app: 0|req: 29/59] 10.222.0.13 () {56 vars in 1074 bytes} [Sun Oct 30 01:05:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:05:20.844207 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi [None req-8a741190-8b09-4d6f-828a-58c9746bee5b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:05:20.916758 n-d-master-1 devstack@n-api.service[105232]: INFO nova.api.openstack.requestlog [None req-8a741190-8b09-4d6f-828a-58c9746bee5b admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.473102 Oct 30 01:05:20.923792 n-d-master-1 devstack@n-api.service[105232]: [pid: 105232|app: 0|req: 31/60] 10.222.0.13 () {64 vars in 1235 bytes} [Sun Oct 30 01:05:20 2022] POST /compute/v2.1/flavors => generated 409 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:05:22.141667 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi [None req-7d7d5941-1adc-4bfa-b889-a0e46b803dc2 admin admin] Calling method '>' {{(pid=105231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:05:22.143451 n-d-master-1 devstack@n-api.service[105231]: INFO nova.api.openstack.requestlog [None req-7d7d5941-1adc-4bfa-b889-a0e46b803dc2 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002233 Oct 30 01:05:22.144148 n-d-master-1 devstack@n-api.service[105231]: [pid: 105231|app: 0|req: 30/61] 10.222.0.13 () {56 vars in 1074 bytes} [Sun Oct 30 01:05:22 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:05:22.707579 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi [None req-b0e37960-85fa-4993-b201-dced5812f92a admin admin] Calling method '>' {{(pid=105232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:05:22.729835 n-d-master-1 devstack@n-api.service[105232]: INFO nova.api.openstack.requestlog [None req-b0e37960-85fa-4993-b201-dced5812f92a admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.442706 Oct 30 01:05:22.730499 n-d-master-1 devstack@n-api.service[105232]: [pid: 105232|app: 0|req: 32/62] 10.222.0.13 () {60 vars in 1202 bytes} [Sun Oct 30 01:05:22 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:06:23.123835 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi [None req-7d7d5941-1adc-4bfa-b889-a0e46b803dc2 admin admin] Calling method '>' {{(pid=105231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:06:23.124865 n-d-master-1 devstack@n-api.service[105231]: INFO nova.api.openstack.requestlog [None req-7d7d5941-1adc-4bfa-b889-a0e46b803dc2 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Oct 30 01:06:23.125256 n-d-master-1 devstack@n-api.service[105231]: [pid: 105231|app: 0|req: 31/63] 10.222.0.13 () {54 vars in 931 bytes} [Sun Oct 30 01:06:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:06:23.132732 n-d-master-1 devstack@n-api.service[105232]: DEBUG dbcounter [-] [105232] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:06:23.513141 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi [None req-d5db85a8-e073-4e76-84df-e69b95b2d72a admin admin] Calling method '>' {{(pid=105232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:06:23.534759 n-d-master-1 devstack@n-api.service[105232]: INFO nova.api.openstack.requestlog [None req-d5db85a8-e073-4e76-84df-e69b95b2d72a admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.403558 Oct 30 01:06:23.535300 n-d-master-1 devstack@n-api.service[105232]: [pid: 105232|app: 0|req: 33/64] 10.222.0.13 () {60 vars in 1292 bytes} [Sun Oct 30 01:06:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:06:23.556789 n-d-master-1 devstack@n-api.service[105231]: DEBUG dbcounter [-] [105231] Writing DB stats nova_api:SELECT=14 {{(pid=105231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:06:23.560475 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi [None req-e12e5731-e20e-4fc2-86be-0bfb0465aaf2 admin admin] Calling method '>' {{(pid=105231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:06:23.567905 n-d-master-1 devstack@n-api.service[105231]: INFO nova.api.openstack.requestlog [None req-e12e5731-e20e-4fc2-86be-0bfb0465aaf2 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012558 Oct 30 01:06:23.568511 n-d-master-1 devstack@n-api.service[105231]: [pid: 105231|app: 0|req: 32/65] 10.222.0.13 () {60 vars in 1283 bytes} [Sun Oct 30 01:06:23 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:06:23.580946 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi [None req-4b166c4d-0a7c-47ff-bc8e-53d9e1ad6e09 admin admin] Calling method '>' {{(pid=105232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:06:23.588281 n-d-master-1 devstack@n-api.service[105232]: INFO nova.api.openstack.requestlog [None req-4b166c4d-0a7c-47ff-bc8e-53d9e1ad6e09 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011459 Oct 30 01:06:23.588806 n-d-master-1 devstack@n-api.service[105232]: [pid: 105232|app: 0|req: 34/66] 10.222.0.13 () {60 vars in 1286 bytes} [Sun Oct 30 01:06:23 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:06:23.601206 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi [None req-93209ddb-c47b-4035-a3a4-612843922c09 admin admin] Calling method '>' {{(pid=105231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:06:23.608760 n-d-master-1 devstack@n-api.service[105231]: INFO nova.api.openstack.requestlog [None req-93209ddb-c47b-4035-a3a4-612843922c09 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011225 Oct 30 01:06:23.609282 n-d-master-1 devstack@n-api.service[105231]: [pid: 105231|app: 0|req: 33/67] 10.222.0.13 () {60 vars in 1286 bytes} [Sun Oct 30 01:06:23 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:06:23.621160 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi [None req-e3bb3111-217d-4a5b-87c6-027c7c1872ae admin admin] Calling method '>' {{(pid=105232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:06:23.628830 n-d-master-1 devstack@n-api.service[105232]: INFO nova.api.openstack.requestlog [None req-e3bb3111-217d-4a5b-87c6-027c7c1872ae admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011334 Oct 30 01:06:23.629432 n-d-master-1 devstack@n-api.service[105232]: [pid: 105232|app: 0|req: 35/68] 10.222.0.13 () {60 vars in 1283 bytes} [Sun Oct 30 01:06:23 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:45.864018 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi [None req-93209ddb-c47b-4035-a3a4-612843922c09 admin admin] Calling method '>' {{(pid=105231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:45.865035 n-d-master-1 devstack@n-api.service[105231]: INFO nova.api.openstack.requestlog [None req-93209ddb-c47b-4035-a3a4-612843922c09 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Oct 30 01:11:45.865480 n-d-master-1 devstack@n-api.service[105231]: [pid: 105231|app: 0|req: 34/69] 10.222.0.13 () {56 vars in 1074 bytes} [Sun Oct 30 01:11:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:11:46.018822 n-d-master-1 devstack@n-api.service[105232]: DEBUG dbcounter [-] [105232] Writing DB stats nova_api:SELECT=6 {{(pid=105232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:11:46.167448 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi [None req-f8a256a6-18df-4d62-9379-a6549caf0893 admin admin] Calling method '>' {{(pid=105232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:46.172881 n-d-master-1 devstack@n-api.service[105232]: DEBUG oslo_concurrency.lockutils [None req-f8a256a6-18df-4d62-9379-a6549caf0893 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:46.173382 n-d-master-1 devstack@n-api.service[105232]: DEBUG oslo_concurrency.lockutils [None req-f8a256a6-18df-4d62-9379-a6549caf0893 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:46.173817 n-d-master-1 devstack@n-api.service[105232]: DEBUG oslo_concurrency.lockutils [None req-f8a256a6-18df-4d62-9379-a6549caf0893 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:46.174522 n-d-master-1 devstack@n-api.service[105232]: DEBUG oslo_concurrency.lockutils [None req-f8a256a6-18df-4d62-9379-a6549caf0893 admin admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:46.174958 n-d-master-1 devstack@n-api.service[105232]: DEBUG oslo_concurrency.lockutils [None req-f8a256a6-18df-4d62-9379-a6549caf0893 admin admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:46.175367 n-d-master-1 devstack@n-api.service[105232]: DEBUG oslo_concurrency.lockutils [None req-f8a256a6-18df-4d62-9379-a6549caf0893 admin admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:46.215410 n-d-master-1 devstack@n-api.service[105232]: INFO nova.api.openstack.requestlog [None req-f8a256a6-18df-4d62-9379-a6549caf0893 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.197768 Oct 30 01:11:46.216467 n-d-master-1 devstack@n-api.service[105232]: [pid: 105232|app: 0|req: 36/70] 10.222.0.13 () {60 vars in 1193 bytes} [Sun Oct 30 01:11:46 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:11:47.362315 n-d-master-1 devstack@n-api.service[105231]: DEBUG nova.api.openstack.wsgi [None req-93209ddb-c47b-4035-a3a4-612843922c09 admin admin] Calling method '>' {{(pid=105231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:47.363359 n-d-master-1 devstack@n-api.service[105231]: INFO nova.api.openstack.requestlog [None req-93209ddb-c47b-4035-a3a4-612843922c09 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Oct 30 01:11:47.363801 n-d-master-1 devstack@n-api.service[105231]: [pid: 105231|app: 0|req: 35/71] 10.222.0.13 () {56 vars in 1074 bytes} [Sun Oct 30 01:11:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:11:47.561756 n-d-master-1 devstack@n-api.service[105232]: DEBUG nova.api.openstack.wsgi [None req-a77e3676-2e45-45a7-a08c-5cbfc6cd04c4 admin admin] Calling method '>' {{(pid=105232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:47.565295 n-d-master-1 devstack@n-api.service[105232]: DEBUG oslo_concurrency.lockutils [None req-a77e3676-2e45-45a7-a08c-5cbfc6cd04c4 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:47.565798 n-d-master-1 devstack@n-api.service[105232]: DEBUG oslo_concurrency.lockutils [None req-a77e3676-2e45-45a7-a08c-5cbfc6cd04c4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:47.566223 n-d-master-1 devstack@n-api.service[105232]: DEBUG oslo_concurrency.lockutils [None req-a77e3676-2e45-45a7-a08c-5cbfc6cd04c4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:47.566948 n-d-master-1 devstack@n-api.service[105232]: DEBUG oslo_concurrency.lockutils [None req-a77e3676-2e45-45a7-a08c-5cbfc6cd04c4 admin admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:47.567380 n-d-master-1 devstack@n-api.service[105232]: DEBUG oslo_concurrency.lockutils [None req-a77e3676-2e45-45a7-a08c-5cbfc6cd04c4 admin admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:47.567790 n-d-master-1 devstack@n-api.service[105232]: DEBUG oslo_concurrency.lockutils [None req-a77e3676-2e45-45a7-a08c-5cbfc6cd04c4 admin admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:47.592693 n-d-master-1 devstack@n-api.service[105232]: INFO nova.api.openstack.requestlog [None req-a77e3676-2e45-45a7-a08c-5cbfc6cd04c4 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.088172 Oct 30 01:11:47.593283 n-d-master-1 devstack@n-api.service[105232]: [pid: 105232|app: 0|req: 37/72] 10.222.0.13 () {60 vars in 1193 bytes} [Sun Oct 30 01:11:47 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:12:34.777201 n-d-master-1 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 30 01:12:34.777796 n-d-master-1 devstack@n-api.service[105230]: Sun Oct 30 01:12:34 2022 - graceful shutdown triggered... Oct 30 01:12:34.778259 n-d-master-1 devstack@n-api.service[105231]: Gracefully killing worker 1 (pid: 105231)... Oct 30 01:12:34.779523 n-d-master-1 devstack@n-api.service[105232]: Gracefully killing worker 2 (pid: 105232)... Oct 30 01:12:34.904911 n-d-master-1 devstack@n-api.service[105231]: DEBUG dbcounter [-] [105231] Writing DB stats nova_api:SELECT=4 {{(pid=105231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:12:35.778768 n-d-master-1 devstack@n-api.service[105230]: worker 1 buried after 1 seconds Oct 30 01:12:35.778768 n-d-master-1 devstack@n-api.service[105230]: worker 2 buried after 1 seconds Oct 30 01:12:35.778768 n-d-master-1 devstack@n-api.service[105230]: goodbye to uWSGI. Oct 30 01:12:35.780271 n-d-master-1 systemd[1]: devstack@n-api.service: Succeeded. Oct 30 01:12:35.780846 n-d-master-1 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 30 01:12:35.783646 n-d-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Oct 30 01:12:35.800290 n-d-master-1 devstack@n-api.service[121092]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 30 01:12:35.838666 n-d-master-1 devstack@n-api.service[121092]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Oct 30 01:12:35 2022] *** Oct 30 01:12:35.838666 n-d-master-1 devstack@n-api.service[121092]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 30 01:12:35.838666 n-d-master-1 devstack@n-api.service[121092]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 30 01:12:35.838666 n-d-master-1 devstack@n-api.service[121092]: nodename: n-d-master-1 Oct 30 01:12:35.838666 n-d-master-1 devstack@n-api.service[121092]: machine: x86_64 Oct 30 01:12:35.838666 n-d-master-1 devstack@n-api.service[121092]: clock source: unix Oct 30 01:12:35.838666 n-d-master-1 devstack@n-api.service[121092]: pcre jit disabled Oct 30 01:12:35.838666 n-d-master-1 devstack@n-api.service[121092]: detected number of CPU cores: 4 Oct 30 01:12:35.838666 n-d-master-1 devstack@n-api.service[121092]: current working directory: / Oct 30 01:12:35.838666 n-d-master-1 devstack@n-api.service[121092]: detected binary path: /usr/bin/uwsgi-core Oct 30 01:12:35.838666 n-d-master-1 devstack@n-api.service[121092]: your processes number limit is 47680 Oct 30 01:12:35.838666 n-d-master-1 devstack@n-api.service[121092]: your memory page size is 4096 bytes Oct 30 01:12:35.838666 n-d-master-1 devstack@n-api.service[121092]: detected max file descriptor number: 2048 Oct 30 01:12:35.838666 n-d-master-1 devstack@n-api.service[121092]: lock engine: pthread robust mutexes Oct 30 01:12:35.839935 n-d-master-1 devstack@n-api.service[121092]: thunder lock: enabled Oct 30 01:12:35.839935 n-d-master-1 devstack@n-api.service[121092]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 30 01:12:35.839935 n-d-master-1 devstack@n-api.service[121092]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 30 01:12:35.880434 n-d-master-1 devstack@n-api.service[121092]: Python main interpreter initialized at 0x55ee678f79c0 Oct 30 01:12:35.880434 n-d-master-1 devstack@n-api.service[121092]: python threads support enabled Oct 30 01:12:35.880434 n-d-master-1 devstack@n-api.service[121092]: your server socket listen backlog is limited to 100 connections Oct 30 01:12:35.880434 n-d-master-1 devstack@n-api.service[121092]: your mercy for graceful operations on workers is 90 seconds Oct 30 01:12:35.880902 n-d-master-1 devstack@n-api.service[121092]: mapped 403077 bytes (393 KB) for 2 cores Oct 30 01:12:35.881020 n-d-master-1 devstack@n-api.service[121092]: *** Operational MODE: preforking *** Oct 30 01:12:35.881313 n-d-master-1 devstack@n-api.service[121092]: *** uWSGI is running in multiple interpreter mode *** Oct 30 01:12:35.881313 n-d-master-1 devstack@n-api.service[121092]: spawned uWSGI master process (pid: 121092) Oct 30 01:12:35.881535 n-d-master-1 systemd[1]: Started Devstack devstack@n-api.service. Oct 30 01:12:35.887210 n-d-master-1 devstack@n-api.service[121092]: spawned uWSGI worker 1 (pid: 121102, cores: 1) Oct 30 01:12:35.887210 n-d-master-1 devstack@n-api.service[121092]: spawned uWSGI worker 2 (pid: 121103, cores: 1) Oct 30 01:12:35.887210 n-d-master-1 devstack@n-api.service[121092]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 30 01:12:36.550926 n-d-master-1 devstack@n-api.service[121102]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 30 01:12:36.562742 n-d-master-1 devstack@n-api.service[121103]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 30 01:12:37.802630 n-d-master-1 devstack@n-api.service[121102]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 30 01:12:37.802630 n-d-master-1 devstack@n-api.service[121102]: from cryptography.utils import int_from_bytes Oct 30 01:12:37.803696 n-d-master-1 devstack@n-api.service[121102]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 30 01:12:37.803696 n-d-master-1 devstack@n-api.service[121102]: from cryptography.utils import int_from_bytes Oct 30 01:12:37.818245 n-d-master-1 devstack@n-api.service[121103]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 30 01:12:37.818245 n-d-master-1 devstack@n-api.service[121103]: from cryptography.utils import int_from_bytes Oct 30 01:12:37.818809 n-d-master-1 devstack@n-api.service[121103]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 30 01:12:37.818809 n-d-master-1 devstack@n-api.service[121103]: from cryptography.utils import int_from_bytes Oct 30 01:12:40.240059 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 30 01:12:40.240828 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 30 01:12:40.240828 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 30 01:12:40.241198 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 30 01:12:40.241481 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 30 01:12:40.241871 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.242201 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.242523 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.242841 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.243173 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.243485 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.243805 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.244126 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.244452 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.244714 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.245026 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.245377 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-master-1 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.245705 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.246014 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.246324 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.246644 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.246737 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 30 01:12:40.247160 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 30 01:12:40.247258 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.247258 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.247442 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 30 01:12:40.247538 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.247796 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 30 01:12:40.248034 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.248170 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 30 01:12:40.248438 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.248565 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.248770 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.248879 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.249091 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.249205 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.249431 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.249542 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.249746 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.249883 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.250058 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.250178 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.250386 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.250507 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.250684 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.250798 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.251009 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.251122 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.251286 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.251427 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.251587 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.251699 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-master-1 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.251946 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-master-1 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.252046 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.252270 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.252369 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.252585 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.252707 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.252898 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.253027 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.253215 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.253324 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.253546 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.253648 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.253869 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.254037 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.254184 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.254282 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.254570 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.254696 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.254897 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.254993 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.255217 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.255327 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.255534 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.255638 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.255852 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.255952 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.256154 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.256262 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.256462 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.256563 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.256769 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.256873 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.257088 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.257195 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.257412 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.257521 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.257730 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.257909 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.258009 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.258176 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-master-1 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.258276 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.258433 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.258558 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.258748 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.258882 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.259061 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.259203 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.259454 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.259593 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.259701 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.259800 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.260006 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.260108 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.260323 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.260416 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.260629 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.260753 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.260935 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.261040 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.261240 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.261372 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.261572 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.261679 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.261878 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.261978 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.262182 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.262286 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.262486 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.262578 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.262788 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.262947 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.263109 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.263240 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.263423 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.263534 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.263730 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.263826 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.264038 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.264149 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.264291 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.264414 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.264601 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.264733 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.264923 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.265032 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.265247 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.265392 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.265598 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.265705 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.265852 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.265947 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.266105 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.266230 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.266425 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.266548 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.266744 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.266909 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.267055 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.267157 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.267385 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.267489 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.267696 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.267798 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.268004 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.268153 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.268459 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.268588 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.268730 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.268832 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.268927 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.269021 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.269210 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.269314 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.269554 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.269709 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.269872 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.269974 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.270179 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.270285 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.270485 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.270578 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.270791 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.270884 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.271090 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.271196 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.271394 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.271495 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.271700 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.271797 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.272006 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.272107 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.272312 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.272413 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.272617 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.272710 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.272922 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.273017 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.273224 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.273326 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.273552 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.273647 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.273856 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.273952 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.274158 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.274252 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.274475 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.274582 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.274793 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.274902 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.275099 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.275270 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.275374 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.275476 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.275643 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.275736 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.275948 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.276043 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.276270 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.276372 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.276579 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.276717 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.276883 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.276987 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.277190 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.277289 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.277515 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.277611 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.277818 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.277917 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.278148 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.278262 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.278429 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.278530 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.278737 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.278834 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.279046 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.279139 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.279344 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.279484 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.279648 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.279747 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.279954 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.280094 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.280259 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.280408 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.280563 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.280705 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.280865 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.280965 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.281169 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.281274 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.281496 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.281599 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.281800 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.281893 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.282102 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.282205 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.282404 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.282505 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.282704 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.282796 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.283573 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.283679 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.283836 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.283937 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.284156 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.284303 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.284462 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.284562 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.284763 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.284869 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.285080 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.285175 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.285408 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.285526 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.285720 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.285828 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.286042 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.286143 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.286347 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.286447 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.286656 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.286758 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.286976 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.287076 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.287287 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.287380 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.287597 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.287700 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.287903 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.287995 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.288215 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.288364 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.288576 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.288676 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.288819 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.288917 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.289098 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.289200 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.289424 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.289521 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.289729 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.289823 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.290048 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.290153 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.290373 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.290467 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.290682 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.290787 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.290991 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.291091 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.291299 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.291403 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.291618 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 01:12:40.291711 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.291959 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.292081 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.292278 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.292378 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.292586 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.292689 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.292925 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.293038 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.293256 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.293414 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.293592 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.293710 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.293920 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.294027 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.294236 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.294384 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.294545 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.294638 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.294856 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.294960 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.295165 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.295266 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.295476 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.295575 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.295791 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.295899 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.296101 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.296200 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.296418 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.296517 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.296730 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.296837 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.297051 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.297144 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.297381 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.297479 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.297693 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.297806 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.298004 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.298097 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.298316 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.298409 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.298654 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.299295 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.299522 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.299652 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.299840 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.299989 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.300161 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.300273 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.300474 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.300568 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.300786 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.300879 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.301102 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.301204 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.301454 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.301630 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.301766 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.301948 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.302077 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.302264 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.302381 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.302579 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.302788 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.302917 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.303102 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.303224 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.303413 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.303533 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.303714 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.303860 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.304038 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.304157 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.304370 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.304524 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.304675 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.304788 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.305007 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.305112 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.305606 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.305723 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.305920 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.306027 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.306229 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.306324 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.306540 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.306641 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.306843 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.306951 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.307156 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.307261 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.307467 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.307568 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.307772 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.307884 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.308095 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.308188 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.308406 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.308508 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.308716 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.308866 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.309030 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.309194 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.309369 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.309477 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.309709 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.309853 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.309972 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.310119 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.310282 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.310385 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.310586 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.310679 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.310897 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.310997 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.311206 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.311307 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.311519 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.311622 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.311829 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.311930 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.312140 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.312242 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.312451 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.312548 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.312766 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.312868 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.313079 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.313200 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.313440 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.313569 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.313723 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.313859 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.314041 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.314265 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.314361 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.314454 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.314669 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.314774 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.314974 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.315076 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.315276 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.315370 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.315576 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.315669 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.315884 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.316061 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.316206 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.316305 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.316477 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.316580 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.316781 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.316876 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.317083 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.317175 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.317411 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.317541 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.317727 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.317830 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.318030 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.318130 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.318332 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.318434 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.318641 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.318736 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.318942 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.319089 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.319283 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.319387 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.319587 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.319690 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.319911 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.320003 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.320240 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.320348 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.320556 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.320649 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.320862 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.320961 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.321174 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.321282 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.321524 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.321630 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.321814 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.321908 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.322119 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.322279 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.322429 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.322522 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.322735 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.322836 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.323043 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.323189 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.323352 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.323463 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.323659 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.323759 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.323966 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.324067 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.324291 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.324411 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.324603 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.324708 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.324909 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.325025 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.325212 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.325307 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.325544 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.325665 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.325879 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.325983 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.326188 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.326290 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.326516 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.326617 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.326838 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.326939 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.327149 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.327241 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.327463 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.327565 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.327772 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.327866 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.328084 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.328184 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.328393 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.328502 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.328703 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.328795 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.329018 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.329157 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.329328 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.329481 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.329673 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.329816 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.330006 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.330106 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.330328 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.330430 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.330637 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.330729 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.330955 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.331055 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.331258 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.331361 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.331570 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.331665 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.331878 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.331978 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.332197 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.332329 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.332509 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.332602 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.332820 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.332912 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.333139 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.333241 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.333484 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.333585 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.333795 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.333889 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.334105 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.334206 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.334411 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.334526 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.334724 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.334821 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.335028 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.335137 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.335338 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.335438 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.335644 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.335747 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.335952 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.336046 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.336255 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.336356 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.336564 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.336672 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.336871 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.336966 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.337174 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.337275 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.337501 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.337606 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.337809 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.337901 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.338123 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.338214 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.338436 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.338538 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.338756 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.338851 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.339073 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.339172 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.339374 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.339474 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.339676 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.339817 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.339993 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.340102 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.340300 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.340439 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.340604 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.340706 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.340905 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.341006 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.341206 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.341300 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.341552 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.341655 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.341866 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.341962 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.342170 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.342265 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.342479 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.342577 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.342785 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.342892 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.343089 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.343182 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.343398 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.343496 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.343703 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.343806 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.344010 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.344113 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.344320 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.344423 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.344630 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.344822 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.344958 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.345056 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.345236 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.345387 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.346079 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.346200 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.346389 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.346571 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.346731 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.346833 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.347048 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.347143 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.347358 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.347459 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.347665 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.347910 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.348023 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.348119 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.348264 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.348358 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.348579 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.348671 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.348895 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.348990 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.349201 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.349513 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.349623 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.349856 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.349997 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.350168 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.350271 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.350483 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.350577 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.350793 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.350931 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.351103 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.351234 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.351425 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.351529 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.351740 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.351882 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.352052 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.352153 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.352364 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.352467 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.352677 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.352800 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.352985 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.353132 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.353294 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.353428 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.353634 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.353733 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.353944 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.354047 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.354321 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.354426 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.354560 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.354701 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.354865 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.354964 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.355170 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.355271 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.355479 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.355626 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.355785 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.356051 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.356147 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.356393 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.356495 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.356696 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.356803 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.357009 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.357114 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.357313 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.357479 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.357659 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.357764 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.357970 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.358071 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.358279 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.358387 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.358590 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.358683 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.358896 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.358997 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.359241 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.359336 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.359547 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.359654 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.359857 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.359949 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.360174 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.360271 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.360485 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.360624 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.360796 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.360900 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.361125 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.361772 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.361994 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.362089 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.362300 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.362393 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.362610 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.362727 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.362919 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.363036 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.363223 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.363331 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.363528 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.363662 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.363832 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.363934 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.364143 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.364252 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.364450 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.364564 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.364755 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.364857 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.365065 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.365183 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.365387 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.365498 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.365699 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.365792 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.366001 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.366108 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.366317 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.366456 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.366627 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.366764 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.366930 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.367034 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.367233 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.367339 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.367546 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.367639 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.367854 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.367960 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.368156 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.368251 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.368472 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.368566 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.368776 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.368878 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.369090 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.369192 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.369418 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.369534 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.369725 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.369819 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.370027 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.370128 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.370331 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.370476 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.370637 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.370738 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.370938 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.371036 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.371245 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.371352 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.371557 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.371695 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.371859 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.371979 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.372162 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.372273 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.372466 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.372567 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.372765 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.372859 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.373068 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.373171 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.373390 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.373500 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.373699 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.373794 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.374013 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.374107 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.374317 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.374412 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.374624 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.374729 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.374921 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.375025 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.375222 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.375323 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.375522 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.375616 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.375828 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.375930 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.376130 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.376225 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.376434 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.376533 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.376746 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.376844 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.377055 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.377147 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.377374 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.377484 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.377697 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.377781 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.378003 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.378112 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.378310 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.378412 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.378612 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.378713 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.378912 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.379007 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.379216 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.379318 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.379522 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.379624 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.379833 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.379935 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.380158 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.380267 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.380475 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.380570 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.380779 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.380872 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.381090 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.381184 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.381417 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.381528 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.381723 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.381826 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.382027 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.382122 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.382335 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.382430 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.382641 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.382736 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.382947 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.383043 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.383247 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.383349 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.383549 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.383644 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.383859 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.383962 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.384169 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.384261 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.384478 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.384579 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.384786 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.384895 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.385089 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.385197 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.385413 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.385530 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.385731 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.385832 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.386041 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.386145 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.386351 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.386459 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.386658 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.386826 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.386967 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.387063 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.387276 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.387370 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.387585 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.387679 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.387897 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.388038 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.388206 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.388312 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.388510 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.388610 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.388817 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.388920 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.389121 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.389215 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.389454 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.389553 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.389761 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.389877 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.390060 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.390161 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.390382 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.390514 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.390689 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.390794 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.390988 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.391094 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.391295 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.391396 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.391599 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.391708 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.391908 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.392010 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.392210 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.392369 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.393038 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.393374 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.393498 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.393684 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.393781 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.394002 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.394186 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.394315 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.394411 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.394630 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.394724 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.394946 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.395062 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.395254 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.395350 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.395565 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.395661 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.395871 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.395974 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.396176 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.396290 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.396488 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.396605 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.396799 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.396902 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.397104 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.397207 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.397456 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.397556 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.397768 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.397872 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.398074 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.398167 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.398383 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.398485 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.398690 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.398786 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.399003 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.399097 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.399304 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.399396 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.399626 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.399930 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.400022 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.400250 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.400352 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.400595 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.400699 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.400909 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.401049 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.401227 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.401321 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.401569 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.401666 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.401890 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.401985 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.402209 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.402310 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.402521 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.402619 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.402884 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.402985 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.403208 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.403310 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.403513 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.403616 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.403825 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.403923 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.404132 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.404236 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.404439 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.404532 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.404752 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.404848 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.405059 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.405162 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.405391 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.405490 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.405698 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.405808 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.406002 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.406095 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.406326 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.406429 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.406632 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.406739 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.406953 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.407047 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.407367 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.407460 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.407679 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.407780 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.408006 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.408136 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.408849 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.408944 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.409181 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.409293 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.409506 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.409601 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.409812 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.409905 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.410123 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.410234 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.410430 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.410524 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.410736 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.410829 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.411058 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.411164 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.411364 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.411475 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.411674 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.411768 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.411985 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.412079 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.412292 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.412394 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.412596 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.412693 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.412900 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.413003 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.413220 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.413323 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.413554 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.413661 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.413882 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.413976 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.414193 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.414294 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.414520 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.414628 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.414844 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.414938 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.415149 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.415242 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.415469 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.415572 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.415781 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.415877 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.416086 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.416218 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.416391 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.416497 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.416696 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.416791 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.417039 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.417132 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.417391 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.417509 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.417689 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.417782 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.417997 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.418090 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.418312 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.418415 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.418626 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.418727 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.418937 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.419038 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.419244 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.419339 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.419551 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.419653 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.419874 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.419975 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.420182 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.420278 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.420506 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.420608 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.420811 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.420961 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.421117 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.421254 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.421453 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.421555 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.421759 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.421877 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.422065 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.422159 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.422369 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.422471 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.422676 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.422782 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.422977 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.423070 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.423289 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.423411 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.423585 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.423788 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.423953 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.424278 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.424380 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.424607 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.424715 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.424934 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.425036 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.425260 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.425399 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.425576 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.425726 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.425876 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.425977 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.426174 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.426276 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.426516 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.426623 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.426822 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.426920 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.427152 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.427253 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.427463 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.427590 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.427770 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.427874 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.428082 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.428176 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.428388 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.428491 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.428696 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.428792 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.429002 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.429104 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.429314 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.429443 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.429640 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.429743 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.429947 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.430051 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.430513 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.430623 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.430840 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.430940 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.431146 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.431245 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.431465 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.431570 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.431775 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.432009 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.432104 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.432340 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.432443 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.432662 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.432783 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.432980 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.433088 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.433291 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.433433 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.433634 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.433728 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.433949 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.434091 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.434262 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.434357 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.434574 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.434681 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.434886 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.434980 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.435197 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.435293 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.435511 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.435646 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.435828 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.435977 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.436146 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.436241 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.436467 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.436561 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.436786 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.436889 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.437098 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.437190 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.437435 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.437535 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.437752 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.437864 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.438110 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.438285 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.438428 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.438618 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.438726 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.438937 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.439040 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.439531 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.439653 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.439743 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.439846 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.439949 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.440045 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.440200 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.440304 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.440515 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.440625 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.440828 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.440932 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.441141 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.441236 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.441477 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.441620 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.441789 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.441889 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.442099 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.442194 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.442420 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.442523 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.442756 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.442881 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.443079 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.443194 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.443387 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.443481 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.443701 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.443797 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.444015 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.444157 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.444378 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.444533 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.444699 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.444850 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.445009 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.445184 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.445329 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.445546 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.445669 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.445874 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.446015 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.446191 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.446301 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.446509 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.446610 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.446838 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.446943 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.447146 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.447249 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.447452 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.447545 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.447761 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.447870 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.448072 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.448173 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.448376 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.448471 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.448698 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.448807 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.449013 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.449108 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.449318 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.449447 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.449660 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.449757 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.449969 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.450062 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.450284 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.450502 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.450811 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.450906 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.451131 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.451226 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.451467 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.451614 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.451795 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.451890 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.452109 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.452203 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.452420 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.452555 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.452737 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.452844 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.453045 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.453151 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.453362 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.453564 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.453726 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.453833 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.453985 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.454081 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.454291 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.454396 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.454595 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.454745 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.455424 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.455528 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.455738 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.455882 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.456045 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.456139 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.456353 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.456447 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.456657 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.456759 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.456984 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.457194 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.457287 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.457570 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.457683 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.457891 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.457989 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.458201 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.458294 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.458507 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.458614 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.458810 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.458908 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.459117 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.459211 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.459421 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.459526 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.459730 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.459823 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.460031 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.460133 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.460339 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.460436 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.460643 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.460738 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.460948 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.461041 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.461257 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.461381 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.461620 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.461752 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.461924 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.462039 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.462246 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.462358 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.462551 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.462662 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.462856 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.462964 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.463171 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.463285 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.463477 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.463579 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.463795 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.463926 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.464097 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.464193 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.464403 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.464496 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.464709 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.464860 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.465016 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.465119 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.465322 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.465728 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.465843 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.465957 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.466041 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.466259 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.466368 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.466572 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.466668 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.466879 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.466983 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.467193 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.467288 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.467531 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.467638 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.467839 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.467943 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.468142 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.468235 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.468461 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.468568 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.468764 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.468901 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.469070 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.469174 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.469401 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.469517 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.469715 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.469816 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.470022 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.470114 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.470331 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.470440 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.471184 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.471295 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.471537 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.471632 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.471864 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.471972 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.472169 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.472403 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.472497 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.472743 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.472853 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.473068 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.473163 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.473401 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.473507 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.473744 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.473855 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.474058 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.474160 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.474369 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.474513 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.474680 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.474776 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.474996 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.475094 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.475307 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.475403 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.475616 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.475711 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.475924 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.476048 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.476292 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.476408 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.476552 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.476657 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.476865 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.476960 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.477176 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.477279 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.477505 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.477615 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.477816 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.477910 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.478129 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.478234 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.478441 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.478536 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.478754 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.478837 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.479066 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.479175 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.479377 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.479471 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.479693 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.479791 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.480037 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.480132 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.480361 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.480464 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.480672 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.480775 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.480988 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.481082 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.481308 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.481457 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.481643 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.481786 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.481980 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.482095 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.482266 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.482371 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.482567 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.482669 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.482873 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.482976 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.483181 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.483275 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.483498 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.483675 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.483810 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.483913 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.484112 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.484229 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.484414 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.484547 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.484722 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.484871 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.485026 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.485194 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.485328 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.485541 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.485639 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.485867 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.485971 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.486215 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.486482 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.486579 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.486666 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.486843 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.486939 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.487151 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.487254 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.487454 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.487548 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.487755 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.487850 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.488057 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.488162 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.488365 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.488458 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.488666 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.488759 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.488968 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.489076 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.489275 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.489404 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.489602 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.489706 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.489904 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.489999 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.490235 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.490344 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.490538 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.490638 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.490845 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.490940 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.491156 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.491258 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.491462 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.491556 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.491768 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.491915 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.492071 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.492205 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.492378 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.492481 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.492687 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.492783 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.492990 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.493093 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.493297 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.493426 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.493624 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.493716 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.493933 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.494029 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.494239 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.494343 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.494542 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.494645 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.494852 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.494956 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.495152 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.495256 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.495458 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.495553 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.495763 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.495857 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.496066 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.496168 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.496371 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.496481 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.496700 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.496807 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.497015 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.497111 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.497349 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.497464 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.497672 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.497766 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.497984 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.498079 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.498308 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.498411 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.498618 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.498711 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.498929 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.499032 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.499243 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.499349 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.499554 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.499659 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.499863 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.499957 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.500176 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.500273 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.500486 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.500596 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.500797 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.500890 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.501110 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.501202 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.501442 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.501553 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.501776 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.501875 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.502091 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.502190 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.502416 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.502518 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.502742 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.502834 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.503052 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.503146 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.503382 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.503477 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.503701 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.503793 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.504021 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.504112 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.504339 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.504434 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.504654 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.504748 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.504966 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.505072 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.505274 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.505395 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.505544 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 30 01:12:40.505637 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.505926 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.506241 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.506557 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.506876 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.507191 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.507504 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.507822 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.508139 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.508467 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.508796 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.509110 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.509465 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.509797 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.510149 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.510464 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.510811 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.511145 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.511463 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.511780 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.512090 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 01:12:40.512338 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 30 01:12:40.568499 n-d-master-1 devstack@n-api.service[121103]: INFO dbcounter [None req-51e23d24-a69e-44c5-bb5a-176a109266ee None None] Registered counter for database nova_api Oct 30 01:12:40.575439 n-d-master-1 devstack@n-api.service[121102]: INFO dbcounter [None req-051aaf07-bdec-47b1-b771-52b215954c34 None None] Registered counter for database nova_api Oct 30 01:12:40.591397 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_db.sqlalchemy.engines [None req-51e23d24-a69e-44c5-bb5a-176a109266ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121103) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 30 01:12:40.596723 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_db.sqlalchemy.engines [None req-051aaf07-bdec-47b1-b771-52b215954c34 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121102) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 30 01:12:40.599321 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writer thread running {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 30 01:12:40.603563 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writer thread running {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 30 01:12:40.656226 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.context [None req-51e23d24-a69e-44c5-bb5a-176a109266ee None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7a264aef-b8bb-4843-8958-43bc38c25cb0(cell1) {{(pid=121103) load_cells /opt/stack/nova/nova/context.py:464}} Oct 30 01:12:40.661017 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-51e23d24-a69e-44c5-bb5a-176a109266ee None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:40.661352 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.context [None req-051aaf07-bdec-47b1-b771-52b215954c34 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7a264aef-b8bb-4843-8958-43bc38c25cb0(cell1) {{(pid=121102) load_cells /opt/stack/nova/nova/context.py:464}} Oct 30 01:12:40.661529 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-51e23d24-a69e-44c5-bb5a-176a109266ee None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:40.663144 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-51e23d24-a69e-44c5-bb5a-176a109266ee None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:40.663903 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-51e23d24-a69e-44c5-bb5a-176a109266ee None None] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:40.664338 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-51e23d24-a69e-44c5-bb5a-176a109266ee None None] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:40.665477 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-051aaf07-bdec-47b1-b771-52b215954c34 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:40.665958 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-051aaf07-bdec-47b1-b771-52b215954c34 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:40.666412 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-51e23d24-a69e-44c5-bb5a-176a109266ee None None] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:40.667549 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-051aaf07-bdec-47b1-b771-52b215954c34 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:40.668300 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-051aaf07-bdec-47b1-b771-52b215954c34 None None] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:12:40.668641 n-d-master-1 devstack@n-api.service[121103]: INFO dbcounter [None req-51e23d24-a69e-44c5-bb5a-176a109266ee None None] Registered counter for database nova_cell0 Oct 30 01:12:40.668740 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-051aaf07-bdec-47b1-b771-52b215954c34 None None] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:12:40.670906 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-051aaf07-bdec-47b1-b771-52b215954c34 None None] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:12:40.672965 n-d-master-1 devstack@n-api.service[121102]: INFO dbcounter [None req-051aaf07-bdec-47b1-b771-52b215954c34 None None] Registered counter for database nova_cell0 Oct 30 01:12:40.673088 n-d-master-1 devstack@n-api.service[121103]: INFO dbcounter [None req-51e23d24-a69e-44c5-bb5a-176a109266ee None None] Registered counter for database nova_cell1 Oct 30 01:12:40.677797 n-d-master-1 devstack@n-api.service[121102]: INFO dbcounter [None req-051aaf07-bdec-47b1-b771-52b215954c34 None None] Registered counter for database nova_cell1 Oct 30 01:12:40.684857 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_db.sqlalchemy.engines [None req-51e23d24-a69e-44c5-bb5a-176a109266ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121103) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 30 01:12:40.685687 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_db.sqlalchemy.engines [None req-51e23d24-a69e-44c5-bb5a-176a109266ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121103) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 30 01:12:40.687887 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_db.sqlalchemy.engines [None req-051aaf07-bdec-47b1-b771-52b215954c34 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121102) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 30 01:12:40.691213 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_db.sqlalchemy.engines [None req-051aaf07-bdec-47b1-b771-52b215954c34 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121102) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 30 01:12:40.698156 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writer thread running {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 30 01:12:40.698500 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writer thread running {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 30 01:12:40.699970 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writer thread running {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 30 01:12:40.838283 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writer thread running {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 30 01:12:40.849169 n-d-master-1 devstack@n-api.service[121103]: INFO dbcounter [None req-51e23d24-a69e-44c5-bb5a-176a109266ee None None] Registered counter for database nova_cell0 Oct 30 01:12:40.855276 n-d-master-1 devstack@n-api.service[121102]: INFO dbcounter [None req-051aaf07-bdec-47b1-b771-52b215954c34 None None] Registered counter for database nova_cell0 Oct 30 01:12:40.857036 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_db.sqlalchemy.engines [None req-51e23d24-a69e-44c5-bb5a-176a109266ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121103) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 30 01:12:40.862248 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_db.sqlalchemy.engines [None req-051aaf07-bdec-47b1-b771-52b215954c34 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121102) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 30 01:12:40.865675 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writer thread running {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 30 01:12:40.867009 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writer thread running {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 30 01:12:41.183490 n-d-master-1 devstack@n-api.service[121103]: WARNING keystonemiddleware.auth_token [None req-51e23d24-a69e-44c5-bb5a-176a109266ee None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 30 01:12:41.187299 n-d-master-1 devstack@n-api.service[121102]: WARNING keystonemiddleware.auth_token [None req-051aaf07-bdec-47b1-b771-52b215954c34 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 30 01:12:41.191022 n-d-master-1 devstack@n-api.service[121103]: WARNING keystonemiddleware.auth_token [None req-51e23d24-a69e-44c5-bb5a-176a109266ee None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 30 01:12:41.195388 n-d-master-1 devstack@n-api.service[121102]: WARNING keystonemiddleware.auth_token [None req-051aaf07-bdec-47b1-b771-52b215954c34 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 30 01:12:41.536181 n-d-master-1 devstack@n-api.service[121103]: WARNING keystonemiddleware.auth_token [None req-51e23d24-a69e-44c5-bb5a-176a109266ee None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 30 01:12:41.540647 n-d-master-1 devstack@n-api.service[121102]: WARNING keystonemiddleware.auth_token [None req-051aaf07-bdec-47b1-b771-52b215954c34 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 30 01:12:41.542181 n-d-master-1 devstack@n-api.service[121103]: WARNING keystonemiddleware.auth_token [None req-51e23d24-a69e-44c5-bb5a-176a109266ee None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 30 01:12:41.546681 n-d-master-1 devstack@n-api.service[121102]: WARNING keystonemiddleware.auth_token [None req-051aaf07-bdec-47b1-b771-52b215954c34 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 30 01:12:41.547517 n-d-master-1 devstack@n-api.service[121103]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ee678f79c0 pid: 121103 (default app) Oct 30 01:12:41.551981 n-d-master-1 devstack@n-api.service[121102]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ee678f79c0 pid: 121102 (default app) Oct 30 01:13:25.446404 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:25.447858 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:25.449075 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:25.449927 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:26.849534 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:26.851109 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:26.852460 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:26.853754 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:26.982722 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b4faedf9-aff1-4785-87a8-4a607289d6e0 tempest-AZAdminNegativeTestJSON-1234952359 tempest-AZAdminNegativeTestJSON-1234952359-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:26.984992 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b4faedf9-aff1-4785-87a8-4a607289d6e0 tempest-AZAdminNegativeTestJSON-1234952359 tempest-AZAdminNegativeTestJSON-1234952359-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '4c87a460c2c147e9953a07fc69b458b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76c392d55c145faa0ffe95da38e1db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:26.988622 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b4faedf9-aff1-4785-87a8-4a607289d6e0 tempest-AZAdminNegativeTestJSON-1234952359 tempest-AZAdminNegativeTestJSON-1234952359-project] Request method failure captured: Oct 30 01:13:26.988622 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 30 01:13:26.988622 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:13:26.988622 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:13:26.988622 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:13:26.988622 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:13:26.988622 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:13:26.988622 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:13:26.988622 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:13:26.988622 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:13:26.988622 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXc-yMlk521zSuk2jr_yEheTms4psRGIHijrxKfj9cxYittI_sO4o1jpEx-gYP1m1sD_BTWEFNsuPJbUCobi_KPx1riJKdZ1RaIuNnZxrd_bO4basulWCU6NAvakYlQ-kInk5X0GLUJzZC9vuWwF8FLMlIV5yA-CKYFA2M4LhRIYJozw Oct 30 01:13:26.988622 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:13:26.988622 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:13:26.988622 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:13:26.988622 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:13:26.988622 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:13:26.988622 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:13:26.988622 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: e76c392d55c145faa0ffe95da38e1db0 Oct 30 01:13:26.988622 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1234952359 Oct 30 01:13:26.988622 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:13:26.988622 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:13:26.989793 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e76c392d55c145faa0ffe95da38e1db0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e76c392d55c145faa0ffe95da38e1db0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e76c392d55c145faa0ffe95da38e1db0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e76c392d55c145faa0ffe95da38e1db0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:13:26.989793 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-AZAdminNegativeTestJSON-1234952359 Oct 30 01:13:26.989793 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: e76c392d55c145faa0ffe95da38e1db0 Oct 30 01:13:26.989793 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1234952359 Oct 30 01:13:26.989793 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-AZAdminNegativeTestJSON-1234952359-project Oct 30 01:13:26.989793 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:13:26.989793 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:13:26.989793 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 4c87a460c2c147e9953a07fc69b458b2 Oct 30 01:13:26.989793 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-AZAdminNegativeTestJSON-1234952359-project Oct 30 01:13:26.989793 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:13:26.989793 n-d-master-1 devstack@n-api.service[121103]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 30 01:13:26.989793 n-d-master-1 devstack@n-api.service[121103]: action_args: {} Oct 30 01:13:26.990489 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:13:26.990489 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:13:26.990489 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:13:26.990489 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:13:26.990489 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:13:26.990489 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:13:26.990489 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:13:26.990489 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:13:26.990489 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 30 01:13:26.990489 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 30 01:13:26.990489 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 30 01:13:26.990489 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 30 01:13:26.990489 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 30 01:13:26.990489 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 30 01:13:26.990489 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 01:13:26.990489 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 30 01:13:26.990489 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 01:13:26.990489 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise self.value Oct 30 01:13:26.990489 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 30 01:13:26.991421 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 30 01:13:26.991421 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 30 01:13:26.991421 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 30 01:13:26.991421 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 30 01:13:26.991421 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 30 01:13:26.991421 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 30 01:13:26.991421 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:13:26.991421 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:13:26.991421 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:13:26.991421 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:13:26.991421 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:13:26.991421 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:13:26.991421 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 30 01:13:26.991421 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 30 01:13:26.991421 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 30 01:13:26.991421 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:13:26.993034 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b4faedf9-aff1-4785-87a8-4a607289d6e0 tempest-AZAdminNegativeTestJSON-1234952359 tempest-AZAdminNegativeTestJSON-1234952359-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:13:26.994049 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b4faedf9-aff1-4785-87a8-4a607289d6e0 tempest-AZAdminNegativeTestJSON-1234952359 tempest-AZAdminNegativeTestJSON-1234952359-project] 10.222.0.13 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 1.558338 Oct 30 01:13:26.994591 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1/1] 10.222.0.13 () {58 vars in 1185 bytes} [Sun Oct 30 01:13:25 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 1560 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:13:27.397491 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-05a98a74-d44d-4f84-a2a5-7c0ed52f87a7 tempest-FlavorsAccessTestJSON-1892644905 tempest-FlavorsAccessTestJSON-1892644905-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1424065068", "id": 1363919250, "os-flavor-access:is_public": "False"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:13:27.508288 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-05a98a74-d44d-4f84-a2a5-7c0ed52f87a7 tempest-FlavorsAccessTestJSON-1892644905 tempest-FlavorsAccessTestJSON-1892644905-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.512451 Oct 30 01:13:27.508866 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2/2] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:13:26 2022] POST /compute/v2.1/flavors => generated 431 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:13:27.742269 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b20993b5-b399-49d6-a887-545bce9e528d tempest-FlavorMetadataValidation-905008174 tempest-FlavorMetadataValidation-905008174-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-2095294249", "id": 309146492, "os-flavor-access:is_public": "True"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:13:27.829103 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b20993b5-b399-49d6-a887-545bce9e528d tempest-FlavorMetadataValidation-905008174 tempest-FlavorMetadataValidation-905008174-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.86 time: 0.318951 Oct 30 01:13:27.829744 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3/3] 10.222.0.13 () {62 vars in 1188 bytes} [Sun Oct 30 01:13:27 2022] POST /compute/v2.1/flavors => generated 468 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:13:28.014764 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6c74fe5d-b077-4c4c-b147-155568ca1493 tempest-AggregatesAdminTestV241-273214829 tempest-AggregatesAdminTestV241-273214829-project-admin] Calling method '.version_select at 0x7f44cdbc4f70>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:28.024709 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6c74fe5d-b077-4c4c-b147-155568ca1493 tempest-AggregatesAdminTestV241-273214829 tempest-AggregatesAdminTestV241-273214829-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7a264aef-b8bb-4843-8958-43bc38c25cb0(cell1) {{(pid=121102) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 30 01:13:28.025694 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c74fe5d-b077-4c4c-b147-155568ca1493 tempest-AggregatesAdminTestV241-273214829 tempest-AggregatesAdminTestV241-273214829-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:28.026313 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c74fe5d-b077-4c4c-b147-155568ca1493 tempest-AggregatesAdminTestV241-273214829 tempest-AggregatesAdminTestV241-273214829-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:28.026914 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c74fe5d-b077-4c4c-b147-155568ca1493 tempest-AggregatesAdminTestV241-273214829 tempest-AggregatesAdminTestV241-273214829-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:28.054853 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c74fe5d-b077-4c4c-b147-155568ca1493 tempest-AggregatesAdminTestV241-273214829 tempest-AggregatesAdminTestV241-273214829-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:28.055347 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c74fe5d-b077-4c4c-b147-155568ca1493 tempest-AggregatesAdminTestV241-273214829 tempest-AggregatesAdminTestV241-273214829-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:28.055776 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c74fe5d-b077-4c4c-b147-155568ca1493 tempest-AggregatesAdminTestV241-273214829 tempest-AggregatesAdminTestV241-273214829-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:28.068193 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2ea25f0c-a660-47e6-becc-e0bd72b9181f tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:28.072875 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2ea25f0c-a660-47e6-becc-e0bd72b9181f tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:28.073576 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2ea25f0c-a660-47e6-becc-e0bd72b9181f tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:28.074165 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2ea25f0c-a660-47e6-becc-e0bd72b9181f tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:28.074686 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c74fe5d-b077-4c4c-b147-155568ca1493 tempest-AggregatesAdminTestV241-273214829 tempest-AggregatesAdminTestV241-273214829-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:28.075212 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2ea25f0c-a660-47e6-becc-e0bd72b9181f tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:28.075345 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c74fe5d-b077-4c4c-b147-155568ca1493 tempest-AggregatesAdminTestV241-273214829 tempest-AggregatesAdminTestV241-273214829-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:28.075698 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c74fe5d-b077-4c4c-b147-155568ca1493 tempest-AggregatesAdminTestV241-273214829 tempest-AggregatesAdminTestV241-273214829-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:28.076067 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2ea25f0c-a660-47e6-becc-e0bd72b9181f tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:28.076626 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2ea25f0c-a660-47e6-becc-e0bd72b9181f tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:28.086489 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6c74fe5d-b077-4c4c-b147-155568ca1493 tempest-AggregatesAdminTestV241-273214829 tempest-AggregatesAdminTestV241-273214829-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 1.250687 Oct 30 01:13:28.087182 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1/4] 10.222.0.13 () {60 vars in 1208 bytes} [Sun Oct 30 01:13:26 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:13:28.124779 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2ea25f0c-a660-47e6-becc-e0bd72b9181f tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.293947 Oct 30 01:13:28.126930 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 4/5] 10.222.0.13 () {58 vars in 1176 bytes} [Sun Oct 30 01:13:27 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:13:28.220338 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-058bc1d2-3ac2-4e63-aff1-443927d527ec tempest-HypervisorAdminUnderV252Test-966485558 tempest-HypervisorAdminUnderV252Test-966485558-project-admin] Calling method '.version_select at 0x7f44cdbed040>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:28.222907 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-058bc1d2-3ac2-4e63-aff1-443927d527ec tempest-HypervisorAdminUnderV252Test-966485558 tempest-HypervisorAdminUnderV252Test-966485558-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:28.223389 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-058bc1d2-3ac2-4e63-aff1-443927d527ec tempest-HypervisorAdminUnderV252Test-966485558 tempest-HypervisorAdminUnderV252Test-966485558-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:28.223815 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-058bc1d2-3ac2-4e63-aff1-443927d527ec tempest-HypervisorAdminUnderV252Test-966485558 tempest-HypervisorAdminUnderV252Test-966485558-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:28.241506 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-058bc1d2-3ac2-4e63-aff1-443927d527ec tempest-HypervisorAdminUnderV252Test-966485558 tempest-HypervisorAdminUnderV252Test-966485558-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:28.242143 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-058bc1d2-3ac2-4e63-aff1-443927d527ec tempest-HypervisorAdminUnderV252Test-966485558 tempest-HypervisorAdminUnderV252Test-966485558-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:28.242567 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-058bc1d2-3ac2-4e63-aff1-443927d527ec tempest-HypervisorAdminUnderV252Test-966485558 tempest-HypervisorAdminUnderV252Test-966485558-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:28.253912 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-058bc1d2-3ac2-4e63-aff1-443927d527ec tempest-HypervisorAdminUnderV252Test-966485558 tempest-HypervisorAdminUnderV252Test-966485558-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:28.254401 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-058bc1d2-3ac2-4e63-aff1-443927d527ec tempest-HypervisorAdminUnderV252Test-966485558 tempest-HypervisorAdminUnderV252Test-966485558-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:28.255007 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-058bc1d2-3ac2-4e63-aff1-443927d527ec tempest-HypervisorAdminUnderV252Test-966485558 tempest-HypervisorAdminUnderV252Test-966485558-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:28.257440 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9cd83bbe-4e2c-438b-8ae1-34412c4378c6 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Calling method '.version_select at 0x7f44cda32310>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:28.261437 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-058bc1d2-3ac2-4e63-aff1-443927d527ec tempest-HypervisorAdminUnderV252Test-966485558 tempest-HypervisorAdminUnderV252Test-966485558-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.172998 Oct 30 01:13:28.266674 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9cd83bbe-4e2c-438b-8ae1-34412c4378c6 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7a264aef-b8bb-4843-8958-43bc38c25cb0(cell1) {{(pid=121103) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 30 01:13:28.268067 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9cd83bbe-4e2c-438b-8ae1-34412c4378c6 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:28.268915 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2/6] 10.222.0.13 () {58 vars in 1146 bytes} [Sun Oct 30 01:13:28 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:13:28.269234 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9cd83bbe-4e2c-438b-8ae1-34412c4378c6 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:28.270559 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9cd83bbe-4e2c-438b-8ae1-34412c4378c6 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:28.273766 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b3894004-42bd-4267-9105-94e6f62ee8b0 tempest-FlavorsAccessTestJSON-1892644905 tempest-FlavorsAccessTestJSON-1892644905-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "3441b0a2de064974ba07e5e0cdda427f"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:13:28.309628 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9cd83bbe-4e2c-438b-8ae1-34412c4378c6 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:28.321599 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9cd83bbe-4e2c-438b-8ae1-34412c4378c6 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:28.321599 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9cd83bbe-4e2c-438b-8ae1-34412c4378c6 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:28.323715 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9cd83bbe-4e2c-438b-8ae1-34412c4378c6 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:28.324202 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9cd83bbe-4e2c-438b-8ae1-34412c4378c6 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:28.324635 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9cd83bbe-4e2c-438b-8ae1-34412c4378c6 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:28.331523 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9cd83bbe-4e2c-438b-8ae1-34412c4378c6 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.205122 Oct 30 01:13:28.344131 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 5/7] 10.222.0.13 () {58 vars in 1167 bytes} [Sun Oct 30 01:13:28 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:28.344131 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2df7d4c3-f38f-4432-9860-34e3e6bce4f2 tempest-FlavorMetadataValidation-905008174 tempest-FlavorMetadataValidation-905008174-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:13:28.538850 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b3894004-42bd-4267-9105-94e6f62ee8b0 tempest-FlavorsAccessTestJSON-1892644905 tempest-FlavorsAccessTestJSON-1892644905-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/1363919250/action" status: 200 len: 97 microversion: 2.1 time: 0.267955 Oct 30 01:13:28.539787 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3/8] 10.222.0.13 () {60 vars in 1200 bytes} [Sun Oct 30 01:13:28 2022] POST /compute/v2.1/flavors/1363919250/action => generated 97 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:13:28.544446 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bdfc3133-9f76-4625-a05d-63b969cfa781 tempest-AggregatesAdminTestV241-273214829 tempest-AggregatesAdminTestV241-273214829-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1787010814"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:13:28.564488 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.aggregate [None req-bdfc3133-9f76-4625-a05d-63b969cfa781 tempest-AggregatesAdminTestV241-273214829 tempest-AggregatesAdminTestV241-273214829-project-admin] Generated uuid 40520a11-3116-41a7-a1b4-e6c7b3adb36c for aggregate {{(pid=121102) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 30 01:13:28.635259 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2df7d4c3-f38f-4432-9860-34e3e6bce4f2 tempest-FlavorMetadataValidation-905008174 tempest-FlavorMetadataValidation-905008174-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/309146492/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.301136 Oct 30 01:13:28.635860 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 6/9] 10.222.0.13 () {62 vars in 1262 bytes} [Sun Oct 30 01:13:28 2022] POST /compute/v2.1/flavors/309146492/os-extra_specs => generated 62 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:28.730640 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bdfc3133-9f76-4625-a05d-63b969cfa781 tempest-AggregatesAdminTestV241-273214829 tempest-AggregatesAdminTestV241-273214829-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.189584 Oct 30 01:13:28.731249 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4/10] 10.222.0.13 () {62 vars in 1205 bytes} [Sun Oct 30 01:13:28 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:13:28.737039 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-538e6eaa-dec4-4093-9f10-ba5aee8dcccd tempest-HypervisorAdminUnderV252Test-966485558 tempest-HypervisorAdminUnderV252Test-966485558-project-admin] Calling method '.version_select at 0x7f44cda28dc0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:28.739142 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-538e6eaa-dec4-4093-9f10-ba5aee8dcccd tempest-HypervisorAdminUnderV252Test-966485558 tempest-HypervisorAdminUnderV252Test-966485558-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:28.739720 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-538e6eaa-dec4-4093-9f10-ba5aee8dcccd tempest-HypervisorAdminUnderV252Test-966485558 tempest-HypervisorAdminUnderV252Test-966485558-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:28.740155 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-538e6eaa-dec4-4093-9f10-ba5aee8dcccd tempest-HypervisorAdminUnderV252Test-966485558 tempest-HypervisorAdminUnderV252Test-966485558-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:28.758560 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a7d922b6-d71f-4678-9e2f-49a2c3e65c75 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-933661818", "id": 802268132, "os-flavor-access:is_public": "False"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:13:28.759985 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-538e6eaa-dec4-4093-9f10-ba5aee8dcccd tempest-HypervisorAdminUnderV252Test-966485558 tempest-HypervisorAdminUnderV252Test-966485558-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:28.760560 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-538e6eaa-dec4-4093-9f10-ba5aee8dcccd tempest-HypervisorAdminUnderV252Test-966485558 tempest-HypervisorAdminUnderV252Test-966485558-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:28.761068 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-538e6eaa-dec4-4093-9f10-ba5aee8dcccd tempest-HypervisorAdminUnderV252Test-966485558 tempest-HypervisorAdminUnderV252Test-966485558-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:28.798112 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-538e6eaa-dec4-4093-9f10-ba5aee8dcccd tempest-HypervisorAdminUnderV252Test-966485558 tempest-HypervisorAdminUnderV252Test-966485558-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:28.798596 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-538e6eaa-dec4-4093-9f10-ba5aee8dcccd tempest-HypervisorAdminUnderV252Test-966485558 tempest-HypervisorAdminUnderV252Test-966485558-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:28.799031 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-538e6eaa-dec4-4093-9f10-ba5aee8dcccd tempest-HypervisorAdminUnderV252Test-966485558 tempest-HypervisorAdminUnderV252Test-966485558-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:28.804914 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-538e6eaa-dec4-4093-9f10-ba5aee8dcccd tempest-HypervisorAdminUnderV252Test-966485558 tempest-HypervisorAdminUnderV252Test-966485558-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/n-h1-master-1/servers" status: 200 len: 104 microversion: 2.1 time: 0.071429 Oct 30 01:13:28.805664 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 5/11] 10.222.0.13 () {58 vars in 1212 bytes} [Sun Oct 30 01:13:28 2022] GET /compute/v2.1/os-hypervisors/n-h1-master-1/servers => generated 104 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:13:28.840219 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a7d922b6-d71f-4678-9e2f-49a2c3e65c75 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.202741 Oct 30 01:13:28.840942 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 7/12] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:13:28 2022] POST /compute/v2.1/flavors => generated 435 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:13:28.845922 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d20a3a34-c4bb-41e1-9a42-8b3c507dcae4 tempest-FlavorMetadataValidation-905008174 tempest-FlavorMetadataValidation-905008174-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:28.976204 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d20a3a34-c4bb-41e1-9a42-8b3c507dcae4 tempest-FlavorMetadataValidation-905008174 tempest-FlavorMetadataValidation-905008174-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/309146492" status: 202 len: 0 microversion: 2.86 time: 0.134303 Oct 30 01:13:28.977065 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 8/13] 10.222.0.13 () {60 vars in 1199 bytes} [Sun Oct 30 01:13:28 2022] DELETE /compute/v2.1/flavors/309146492 => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:13:28.980967 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1e64584e-e840-4472-ba01-94bcfe32ca13 tempest-FlavorsAccessTestJSON-451931757 tempest-FlavorsAccessTestJSON-451931757-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:28.981631 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9ebf0d84-5746-45fc-8fcb-3b6fbadafd83 tempest-AggregatesAdminTestV241-273214829 tempest-AggregatesAdminTestV241-273214829-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-42794502"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:13:29.013147 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1e64584e-e840-4472-ba01-94bcfe32ca13 tempest-FlavorsAccessTestJSON-451931757 tempest-FlavorsAccessTestJSON-451931757-project] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5412 microversion: 2.1 time: 0.205981 Oct 30 01:13:29.013695 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 6/14] 10.222.0.13 () {58 vars in 1146 bytes} [Sun Oct 30 01:13:28 2022] GET /compute/v2.1/flavors/detail => generated 5412 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:29.017955 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0e63c8df-3c10-40c9-8804-100377f0c763 tempest-HypervisorAdminUnderV252Test-966485558 tempest-HypervisorAdminUnderV252Test-966485558-project-admin] Calling method '.version_select at 0x7f44cd1419d0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:29.021036 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e63c8df-3c10-40c9-8804-100377f0c763 tempest-HypervisorAdminUnderV252Test-966485558 tempest-HypervisorAdminUnderV252Test-966485558-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:29.021539 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e63c8df-3c10-40c9-8804-100377f0c763 tempest-HypervisorAdminUnderV252Test-966485558 tempest-HypervisorAdminUnderV252Test-966485558-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:29.025851 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e63c8df-3c10-40c9-8804-100377f0c763 tempest-HypervisorAdminUnderV252Test-966485558 tempest-HypervisorAdminUnderV252Test-966485558-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:29.035742 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e63c8df-3c10-40c9-8804-100377f0c763 tempest-HypervisorAdminUnderV252Test-966485558 tempest-HypervisorAdminUnderV252Test-966485558-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:29.036217 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e63c8df-3c10-40c9-8804-100377f0c763 tempest-HypervisorAdminUnderV252Test-966485558 tempest-HypervisorAdminUnderV252Test-966485558-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:29.036645 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e63c8df-3c10-40c9-8804-100377f0c763 tempest-HypervisorAdminUnderV252Test-966485558 tempest-HypervisorAdminUnderV252Test-966485558-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:29.046898 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e63c8df-3c10-40c9-8804-100377f0c763 tempest-HypervisorAdminUnderV252Test-966485558 tempest-HypervisorAdminUnderV252Test-966485558-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:29.047373 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e63c8df-3c10-40c9-8804-100377f0c763 tempest-HypervisorAdminUnderV252Test-966485558 tempest-HypervisorAdminUnderV252Test-966485558-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:29.047798 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e63c8df-3c10-40c9-8804-100377f0c763 tempest-HypervisorAdminUnderV252Test-966485558 tempest-HypervisorAdminUnderV252Test-966485558-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:29.053805 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0e63c8df-3c10-40c9-8804-100377f0c763 tempest-HypervisorAdminUnderV252Test-966485558 tempest-HypervisorAdminUnderV252Test-966485558-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.039026 Oct 30 01:13:29.054372 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 7/15] 10.222.0.13 () {58 vars in 1146 bytes} [Sun Oct 30 01:13:29 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:13:29.058941 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-71b15ce1-c064-49cf-84f1-eb1b5bdfe711 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "a171f2755be64d048fc4b422798ebc49"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:13:29.208348 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9ebf0d84-5746-45fc-8fcb-3b6fbadafd83 tempest-AggregatesAdminTestV241-273214829 tempest-AggregatesAdminTestV241-273214829-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 297 microversion: 2.41 time: 0.230172 Oct 30 01:13:29.208958 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 9/16] 10.222.0.13 () {62 vars in 1210 bytes} [Sun Oct 30 01:13:28 2022] PUT /compute/v2.1/os-aggregates/1 => generated 297 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:13:29.214960 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8539dea1-0c24-47f8-8c13-46dd37234a0b tempest-FlavorMetadataValidation-905008174 tempest-FlavorMetadataValidation-905008174-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:29.245143 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8539dea1-0c24-47f8-8c13-46dd37234a0b tempest-FlavorMetadataValidation-905008174 tempest-FlavorMetadataValidation-905008174-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.035072 Oct 30 01:13:29.245735 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 10/17] 10.222.0.13 () {60 vars in 1187 bytes} [Sun Oct 30 01:13:29 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:13:29.250114 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4606512a-9d51-4604-b36f-28655e65845f tempest-FlavorsAccessTestJSON-1892644905 tempest-FlavorsAccessTestJSON-1892644905-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "3441b0a2de064974ba07e5e0cdda427f"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:13:29.285319 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-71b15ce1-c064-49cf-84f1-eb1b5bdfe711 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/802268132/action" status: 200 len: 96 microversion: 2.1 time: 0.229561 Oct 30 01:13:29.286171 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 8/18] 10.222.0.13 () {60 vars in 1197 bytes} [Sun Oct 30 01:13:29 2022] POST /compute/v2.1/flavors/802268132/action => generated 96 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:13:29.293119 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ef88a5d9-d0c4-4589-b114-0142bc33fa54 tempest-HypervisorAdminUnderV252Test-966485558 tempest-HypervisorAdminUnderV252Test-966485558-project-admin] Calling method '.version_select at 0x7f44cd149160>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:29.296831 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ef88a5d9-d0c4-4589-b114-0142bc33fa54 tempest-HypervisorAdminUnderV252Test-966485558 tempest-HypervisorAdminUnderV252Test-966485558-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:29.298614 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ef88a5d9-d0c4-4589-b114-0142bc33fa54 tempest-HypervisorAdminUnderV252Test-966485558 tempest-HypervisorAdminUnderV252Test-966485558-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:29.299133 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ef88a5d9-d0c4-4589-b114-0142bc33fa54 tempest-HypervisorAdminUnderV252Test-966485558 tempest-HypervisorAdminUnderV252Test-966485558-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:29.315191 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ef88a5d9-d0c4-4589-b114-0142bc33fa54 tempest-HypervisorAdminUnderV252Test-966485558 tempest-HypervisorAdminUnderV252Test-966485558-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:29.316765 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ef88a5d9-d0c4-4589-b114-0142bc33fa54 tempest-HypervisorAdminUnderV252Test-966485558 tempest-HypervisorAdminUnderV252Test-966485558-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:29.317704 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ef88a5d9-d0c4-4589-b114-0142bc33fa54 tempest-HypervisorAdminUnderV252Test-966485558 tempest-HypervisorAdminUnderV252Test-966485558-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:29.326660 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ef88a5d9-d0c4-4589-b114-0142bc33fa54 tempest-HypervisorAdminUnderV252Test-966485558 tempest-HypervisorAdminUnderV252Test-966485558-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/n-h1-master-1/search" status: 200 len: 104 microversion: 2.1 time: 0.038902 Oct 30 01:13:29.327476 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 9/19] 10.222.0.13 () {58 vars in 1209 bytes} [Sun Oct 30 01:13:29 2022] GET /compute/v2.1/os-hypervisors/n-h1-master-1/search => generated 104 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:13:29.334478 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-063b4d95-c365-4de4-b587-660c47dcb191 tempest-AggregatesAdminTestV241-273214829 tempest-AggregatesAdminTestV241-273214829-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:29.357071 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-063b4d95-c365-4de4-b587-660c47dcb191 tempest-AggregatesAdminTestV241-273214829 tempest-AggregatesAdminTestV241-273214829-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 297 microversion: 2.41 time: 0.028350 Oct 30 01:13:29.359360 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 10/20] 10.222.0.13 () {60 vars in 1190 bytes} [Sun Oct 30 01:13:29 2022] GET /compute/v2.1/os-aggregates/1 => generated 297 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:13:29.372780 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-27bccbb2-5838-4b0e-81ac-ca27e06f64ef tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "a171f2755be64d048fc4b422798ebc49"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:13:29.536579 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4606512a-9d51-4604-b36f-28655e65845f tempest-FlavorsAccessTestJSON-1892644905 tempest-FlavorsAccessTestJSON-1892644905-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/1363919250/action" status: 200 len: 21 microversion: 2.1 time: 0.289772 Oct 30 01:13:29.537461 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 11/21] 10.222.0.13 () {60 vars in 1200 bytes} [Sun Oct 30 01:13:29 2022] POST /compute/v2.1/flavors/1363919250/action => generated 21 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:13:29.541784 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0a46b860-c102-4e67-b8c3-92316f5b9854 tempest-AggregatesAdminTestV241-273214829 tempest-AggregatesAdminTestV241-273214829-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:13:29.553379 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0a46b860-c102-4e67-b8c3-92316f5b9854 tempest-AggregatesAdminTestV241-273214829 tempest-AggregatesAdminTestV241-273214829-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:29.553873 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0a46b860-c102-4e67-b8c3-92316f5b9854 tempest-AggregatesAdminTestV241-273214829 tempest-AggregatesAdminTestV241-273214829-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:29.554305 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0a46b860-c102-4e67-b8c3-92316f5b9854 tempest-AggregatesAdminTestV241-273214829 tempest-AggregatesAdminTestV241-273214829-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:30.007990 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-27bccbb2-5838-4b0e-81ac-ca27e06f64ef tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] HTTP exception thrown: Flavor access already exists for flavor 17 and project a171f2755be64d048fc4b422798ebc49 combination. Oct 30 01:13:30.023066 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-27bccbb2-5838-4b0e-81ac-ca27e06f64ef tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] Request method failure captured: Oct 30 01:13:30.023066 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/flavors/802268132/action HTTP/1.1 Oct 30 01:13:30.023066 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:13:30.023066 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:13:30.023066 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:13:30.023066 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 67 Oct 30 01:13:30.023066 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:13:30.023066 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:13:30.023066 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:13:30.023066 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:13:30.023066 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXc-237812xnpQzNXfLPti9cfhh8tI9jb4fmJd9lc1Wm3BjRXqbPrNWDkK1VZWyHLrS7Y6gRHKYLOQ-Xymz7xqdR80Hk50FI6WSEPyjbeHOMqOS9b2G4Swd2SVlgSwb5afiWw6caQozeFBd4tNj30VB8LQ1kqOQsHWZtXWoD0arJnOr4 Oct 30 01:13:30.023066 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:13:30.023066 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:13:30.023066 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:13:30.023066 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:13:30.023066 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:13:30.023066 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:13:30.023066 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 7cc6b17bab9147488735967e838892ca Oct 30 01:13:30.023066 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1733783349 Oct 30 01:13:30.023066 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,admin,reader Oct 30 01:13:30.023066 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,admin,reader Oct 30 01:13:30.024830 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7cc6b17bab9147488735967e838892ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7cc6b17bab9147488735967e838892ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7cc6b17bab9147488735967e838892ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7cc6b17bab9147488735967e838892ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:13:30.024830 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1733783349 Oct 30 01:13:30.024830 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 7cc6b17bab9147488735967e838892ca Oct 30 01:13:30.024830 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1733783349 Oct 30 01:13:30.024830 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin Oct 30 01:13:30.024830 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:13:30.024830 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:13:30.024830 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 24efaa8ae2f04bb5a447d610f7743fdc Oct 30 01:13:30.024830 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin Oct 30 01:13:30.024830 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:13:30.024830 n-d-master-1 devstack@n-api.service[121102]: {"addTenantAccess": {"tenant": "a171f2755be64d048fc4b422798ebc49"}} Oct 30 01:13:30.024830 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:13:30.025599 n-d-master-1 devstack@n-api.service[121102]: exception: Flavor access already exists for flavor 17 and project a171f2755be64d048fc4b422798ebc49 combination. Oct 30 01:13:30.025599 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '802268132', 'body': {'addTenantAccess': {'tenant': 'a171f2755be64d048fc4b422798ebc49'}}} Oct 30 01:13:30.025599 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:13:30.025599 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:13:30.025599 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 30 01:13:30.025599 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 30 01:13:30.025599 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 30 01:13:30.025599 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 30 01:13:30.025599 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 30 01:13:30.025599 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 30 01:13:30.025599 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 30 01:13:30.025599 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 30 01:13:30.025599 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 30 01:13:30.025599 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 30 01:13:30.025599 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 30 01:13:30.025599 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result.read() Oct 30 01:13:30.025599 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 30 01:13:30.025599 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 30 01:13:30.026458 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 30 01:13:30.026458 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 30 01:13:30.026458 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 30 01:13:30.026458 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 30 01:13:30.026458 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 30 01:13:30.026458 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 30 01:13:30.026458 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '17-a171f2755be64d048fc4b422798ebc49' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 30 01:13:30.026458 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:13:30.026458 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 30 01:13:30.026458 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:13:30.026458 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:13:30.026458 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 30 01:13:30.026458 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 30 01:13:30.026458 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 30 01:13:30.026458 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi session.flush() Oct 30 01:13:30.026458 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 30 01:13:30.026458 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 30 01:13:30.026458 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 30 01:13:30.026458 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 30 01:13:30.027553 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 30 01:13:30.027553 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 30 01:13:30.027553 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 30 01:13:30.027553 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception Oct 30 01:13:30.027553 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 30 01:13:30.027553 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 30 01:13:30.027553 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 30 01:13:30.027553 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 30 01:13:30.027553 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 30 01:13:30.027553 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 30 01:13:30.027553 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 30 01:13:30.027553 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 30 01:13:30.027553 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 30 01:13:30.027553 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 30 01:13:30.027553 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 30 01:13:30.027553 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 30 01:13:30.027553 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 30 01:13:30.027553 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 30 01:13:30.028558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 30 01:13:30.028558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 30 01:13:30.028558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 30 01:13:30.028558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 30 01:13:30.028558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 30 01:13:30.028558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 30 01:13:30.028558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 30 01:13:30.028558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception Oct 30 01:13:30.028558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 30 01:13:30.028558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 30 01:13:30.028558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 30 01:13:30.028558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 30 01:13:30.028558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 30 01:13:30.028558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 30 01:13:30.028558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 30 01:13:30.028558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 30 01:13:30.028558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 30 01:13:30.028558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 30 01:13:30.029761 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 30 01:13:30.029761 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result.read() Oct 30 01:13:30.029761 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 30 01:13:30.029761 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 30 01:13:30.029761 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 30 01:13:30.029761 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 30 01:13:30.029761 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 30 01:13:30.029761 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 30 01:13:30.029761 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 30 01:13:30.029761 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 30 01:13:30.029761 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '17-a171f2755be64d048fc4b422798ebc49' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 30 01:13:30.029761 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 30 01:13:30.029761 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 30, 1, 13, 29, 963226), 'updated_at': None, 'flavor_id': 17, 'project_id': 'a171f2755be64d048fc4b422798ebc49'}] Oct 30 01:13:30.029761 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 30 01:13:30.029761 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:13:30.029761 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:13:30.029761 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:13:30.030907 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:13:30.030907 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 30 01:13:30.030907 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 30 01:13:30.030907 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 30 01:13:30.030907 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 30 01:13:30.030907 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 30 01:13:30.030907 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 30 01:13:30.030907 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 30 01:13:30.030907 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 30 01:13:30.030907 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 30 01:13:30.030907 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 30 01:13:30.030907 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 30 01:13:30.030907 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 30 01:13:30.030907 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 30 01:13:30.030907 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 30 01:13:30.030907 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 17 and project a171f2755be64d048fc4b422798ebc49 combination. Oct 30 01:13:30.030907 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:13:30.030907 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:13:30.030907 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:13:30.032013 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:13:30.032013 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:13:30.032013 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:13:30.032013 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:13:30.032013 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:13:30.032013 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:13:30.032013 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:13:30.032013 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:13:30.032013 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:13:30.032013 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 30 01:13:30.032013 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 30 01:13:30.032013 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 17 and project a171f2755be64d048fc4b422798ebc49 combination. Oct 30 01:13:30.032013 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:13:30.032013 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:13:30.032013 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:13:30.032013 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:13:30.032013 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:13:30.032013 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:13:30.032013 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:13:30.032013 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:13:30.033209 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 17 and project a171f2755be64d048fc4b422798ebc49 combination. Oct 30 01:13:30.033209 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:13:30.034826 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-27bccbb2-5838-4b0e-81ac-ca27e06f64ef tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] Returning 409 to user: Flavor access already exists for flavor 17 and project a171f2755be64d048fc4b422798ebc49 combination. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:13:30.035832 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-27bccbb2-5838-4b0e-81ac-ca27e06f64ef tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/802268132/action" status: 409 len: 152 microversion: 2.1 time: 0.675262 Oct 30 01:13:30.036298 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 11/22] 10.222.0.13 () {60 vars in 1197 bytes} [Sun Oct 30 01:13:29 2022] POST /compute/v2.1/flavors/802268132/action => generated 152 bytes in 676 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:13:30.041008 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5af34e14-88b3-4358-929d-937c78b22697 tempest-FlavorsAccessTestJSON-451931757 tempest-FlavorsAccessTestJSON-451931757-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:30.062932 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5af34e14-88b3-4358-929d-937c78b22697 tempest-FlavorsAccessTestJSON-451931757 tempest-FlavorsAccessTestJSON-451931757-project] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025574 Oct 30 01:13:30.063527 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 12/23] 10.222.0.13 () {58 vars in 1146 bytes} [Sun Oct 30 01:13:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:30.068268 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-580cbb25-dfc6-448b-8a7e-38d06215fe76 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "a171f2755be64d048fc4b422798ebc49"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:13:30.325371 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0a46b860-c102-4e67-b8c3-92316f5b9854 tempest-AggregatesAdminTestV241-273214829 tempest-AggregatesAdminTestV241-273214829-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 312 microversion: 2.41 time: 0.786820 Oct 30 01:13:30.326009 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 12/24] 10.222.0.13 () {62 vars in 1232 bytes} [Sun Oct 30 01:13:29 2022] POST /compute/v2.1/os-aggregates/1/action => generated 312 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:13:30.331948 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0bbbdd8b-406d-4c3d-af44-343c05fce0ca tempest-FlavorsAccessTestJSON-1892644905 tempest-FlavorsAccessTestJSON-1892644905-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:30.437997 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0bbbdd8b-406d-4c3d-af44-343c05fce0ca tempest-FlavorsAccessTestJSON-1892644905 tempest-FlavorsAccessTestJSON-1892644905-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1363919250" status: 202 len: 0 microversion: 2.1 time: 0.110460 Oct 30 01:13:30.439003 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 13/25] 10.222.0.13 () {58 vars in 1161 bytes} [Sun Oct 30 01:13:30 2022] DELETE /compute/v2.1/flavors/1363919250 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:13:30.445258 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-04a9f103-1622-4d77-9f0e-96f9de6b14fd tempest-AggregatesAdminTestV241-273214829 tempest-AggregatesAdminTestV241-273214829-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:13:30.470192 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-04a9f103-1622-4d77-9f0e-96f9de6b14fd tempest-AggregatesAdminTestV241-273214829 tempest-AggregatesAdminTestV241-273214829-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:30.471109 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-04a9f103-1622-4d77-9f0e-96f9de6b14fd tempest-AggregatesAdminTestV241-273214829 tempest-AggregatesAdminTestV241-273214829-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:30.476486 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-04a9f103-1622-4d77-9f0e-96f9de6b14fd tempest-AggregatesAdminTestV241-273214829 tempest-AggregatesAdminTestV241-273214829-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:30.575486 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-580cbb25-dfc6-448b-8a7e-38d06215fe76 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/802268132/action" status: 200 len: 21 microversion: 2.1 time: 0.510886 Oct 30 01:13:30.576501 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 13/26] 10.222.0.13 () {60 vars in 1197 bytes} [Sun Oct 30 01:13:30 2022] POST /compute/v2.1/flavors/802268132/action => generated 21 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:13:30.587672 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ee818352-2976-4f25-ad2a-d07dc0d693a0 tempest-FlavorsAccessTestJSON-1892644905 tempest-FlavorsAccessTestJSON-1892644905-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:30.660995 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ee818352-2976-4f25-ad2a-d07dc0d693a0 tempest-FlavorsAccessTestJSON-1892644905 tempest-FlavorsAccessTestJSON-1892644905-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.081166 Oct 30 01:13:30.666774 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 14/27] 10.222.0.13 () {58 vars in 1146 bytes} [Sun Oct 30 01:13:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:30.671635 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5d37102f-4edc-4a9a-9eca-1028279297d7 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:30.716573 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-04a9f103-1622-4d77-9f0e-96f9de6b14fd tempest-AggregatesAdminTestV241-273214829 tempest-AggregatesAdminTestV241-273214829-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 297 microversion: 2.41 time: 0.275351 Oct 30 01:13:30.717444 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 14/28] 10.222.0.13 () {62 vars in 1232 bytes} [Sun Oct 30 01:13:30 2022] POST /compute/v2.1/os-aggregates/1/action => generated 297 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:13:30.734057 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e3c17e1c-bb80-43e2-98f5-fd482017d1e8 tempest-FlavorsAccessTestJSON-1892644905 tempest-FlavorsAccessTestJSON-1892644905-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1207967036", "id": 2076312964, "os-flavor-access:is_public": "False"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:13:30.787552 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5d37102f-4edc-4a9a-9eca-1028279297d7 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/802268132" status: 202 len: 0 microversion: 2.1 time: 0.119572 Oct 30 01:13:30.799027 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 15/29] 10.222.0.13 () {58 vars in 1158 bytes} [Sun Oct 30 01:13:30 2022] DELETE /compute/v2.1/flavors/802268132 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:13:30.799027 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2a3d8cf4-b85a-416f-9280-5bf9e77884f8 tempest-AggregatesAdminTestV241-273214829 tempest-AggregatesAdminTestV241-273214829-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:30.845312 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e3c17e1c-bb80-43e2-98f5-fd482017d1e8 tempest-FlavorsAccessTestJSON-1892644905 tempest-FlavorsAccessTestJSON-1892644905-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.119306 Oct 30 01:13:30.853003 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 15/30] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:13:30 2022] POST /compute/v2.1/flavors => generated 431 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:13:30.853003 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ec6f0bbb-34ce-44cb-bfe3-f847108e5495 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:30.870280 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ec6f0bbb-34ce-44cb-bfe3-f847108e5495 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023304 Oct 30 01:13:30.885789 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 16/31] 10.222.0.13 () {58 vars in 1146 bytes} [Sun Oct 30 01:13:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:30.891231 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-892bb8d8-2f64-4186-b34e-1ec1e2414a02 tempest-FlavorsAccessTestJSON-1892644905 tempest-FlavorsAccessTestJSON-1892644905-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:30.896124 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2a3d8cf4-b85a-416f-9280-5bf9e77884f8 tempest-AggregatesAdminTestV241-273214829 tempest-AggregatesAdminTestV241-273214829-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.106364 Oct 30 01:13:30.897167 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 16/32] 10.222.0.13 () {60 vars in 1193 bytes} [Sun Oct 30 01:13:30 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:13:30.908808 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-892bb8d8-2f64-4186-b34e-1ec1e2414a02 tempest-FlavorsAccessTestJSON-1892644905 tempest-FlavorsAccessTestJSON-1892644905-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/2076312964/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.021795 Oct 30 01:13:30.909826 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 17/33] 10.222.0.13 () {58 vars in 1209 bytes} [Sun Oct 30 01:13:30 2022] GET /compute/v2.1/flavors/2076312964/os-flavor-access => generated 21 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:13:30.914726 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-74db0fcd-b88a-46f2-ba23-067ec90f5c61 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-541501887", "name": "tempest-test_aggregate-424148767"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:13:30.915511 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a42629f0-e9d6-4f21-9352-108bbf594420 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2136956622", "id": 1563775653, "os-flavor-access:is_public": "True"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:13:30.937030 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.aggregate [None req-74db0fcd-b88a-46f2-ba23-067ec90f5c61 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Generated uuid 35a56dea-331d-4e23-80cb-49fb415a3967 for aggregate {{(pid=121103) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 30 01:13:31.043578 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a42629f0-e9d6-4f21-9352-108bbf594420 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.140147 Oct 30 01:13:31.044505 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 17/34] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:13:30 2022] POST /compute/v2.1/flavors => generated 438 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:13:31.050294 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b6b3d47e-4ea1-4782-b5fd-7fe1b39800a0 tempest-FlavorsAccessTestJSON-1892644905 tempest-FlavorsAccessTestJSON-1892644905-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:31.062246 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-74db0fcd-b88a-46f2-ba23-067ec90f5c61 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.151001 Oct 30 01:13:31.063574 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 18/35] 10.222.0.13 () {60 vars in 1165 bytes} [Sun Oct 30 01:13:30 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:13:31.068013 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2be5b13a-5e63-49ed-8d45-beb404199361 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:31.078994 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-2be5b13a-5e63-49ed-8d45-beb404199361 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 30 01:13:31.080838 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2be5b13a-5e63-49ed-8d45-beb404199361 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] Request method failure captured: Oct 30 01:13:31.080838 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/flavors/1563775653/os-flavor-access HTTP/1.1 Oct 30 01:13:31.080838 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:13:31.080838 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:13:31.080838 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:13:31.080838 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:13:31.080838 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:13:31.080838 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:13:31.080838 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:13:31.080838 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:13:31.080838 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXc-237812xnpQzNXfLPti9cfhh8tI9jb4fmJd9lc1Wm3BjRXqbPrNWDkK1VZWyHLrS7Y6gRHKYLOQ-Xymz7xqdR80Hk50FI6WSEPyjbeHOMqOS9b2G4Swd2SVlgSwb5afiWw6caQozeFBd4tNj30VB8LQ1kqOQsHWZtXWoD0arJnOr4 Oct 30 01:13:31.080838 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:13:31.080838 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:13:31.080838 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:13:31.080838 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:13:31.080838 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:13:31.080838 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:13:31.080838 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 7cc6b17bab9147488735967e838892ca Oct 30 01:13:31.080838 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1733783349 Oct 30 01:13:31.080838 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,admin,reader Oct 30 01:13:31.080838 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,admin,reader Oct 30 01:13:31.081986 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7cc6b17bab9147488735967e838892ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7cc6b17bab9147488735967e838892ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7cc6b17bab9147488735967e838892ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7cc6b17bab9147488735967e838892ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:13:31.081986 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1733783349 Oct 30 01:13:31.081986 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 7cc6b17bab9147488735967e838892ca Oct 30 01:13:31.081986 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1733783349 Oct 30 01:13:31.081986 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin Oct 30 01:13:31.081986 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:13:31.081986 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:13:31.081986 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 24efaa8ae2f04bb5a447d610f7743fdc Oct 30 01:13:31.081986 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin Oct 30 01:13:31.081986 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:13:31.081986 n-d-master-1 devstack@n-api.service[121103]: exception: Access list not available for public flavors. Oct 30 01:13:31.081986 n-d-master-1 devstack@n-api.service[121103]: action_args: {'flavor_id': '1563775653'} Oct 30 01:13:31.082601 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:13:31.082601 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:13:31.082601 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:13:31.082601 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:13:31.082601 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:13:31.082601 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:13:31.082601 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:13:31.082601 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:13:31.082601 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 30 01:13:31.082601 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 30 01:13:31.082601 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 30 01:13:31.082601 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:13:31.082601 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:13:31.082601 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:13:31.082601 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:13:31.082601 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:13:31.082601 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:13:31.082601 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:13:31.082601 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:13:31.082601 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 30 01:13:31.082601 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:13:31.084060 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2be5b13a-5e63-49ed-8d45-beb404199361 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:13:31.084060 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2be5b13a-5e63-49ed-8d45-beb404199361 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/1563775653/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.017710 Oct 30 01:13:31.085948 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 19/36] 10.222.0.13 () {58 vars in 1209 bytes} [Sun Oct 30 01:13:31 2022] GET /compute/v2.1/flavors/1563775653/os-flavor-access => generated 91 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:13:31.091770 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-97bb1a98-b162-49b6-a4be-ad092da8a9a0 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:31.104072 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-97bb1a98-b162-49b6-a4be-ad092da8a9a0 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates" status: 200 len: 300 microversion: 2.1 time: 0.016829 Oct 30 01:13:31.104627 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 20/37] 10.222.0.13 () {58 vars in 1143 bytes} [Sun Oct 30 01:13:31 2022] GET /compute/v2.1/os-aggregates => generated 300 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:13:31.112129 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5bdaff5b-80f6-4dd7-abf9-c320b744f971 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:31.116598 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=9,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=8,nova_api:UPDATE=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:31.139204 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b6b3d47e-4ea1-4782-b5fd-7fe1b39800a0 tempest-FlavorsAccessTestJSON-1892644905 tempest-FlavorsAccessTestJSON-1892644905-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/2076312964" status: 202 len: 0 microversion: 2.1 time: 0.093212 Oct 30 01:13:31.143979 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 18/38] 10.222.0.13 () {58 vars in 1161 bytes} [Sun Oct 30 01:13:31 2022] DELETE /compute/v2.1/flavors/2076312964 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:13:31.148906 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d2772fc4-26b7-44a5-8d5e-3e508334cd41 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:13:31.161112 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2772fc4-26b7-44a5-8d5e-3e508334cd41 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:31.161974 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2772fc4-26b7-44a5-8d5e-3e508334cd41 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:31.162414 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2772fc4-26b7-44a5-8d5e-3e508334cd41 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:31.227683 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5bdaff5b-80f6-4dd7-abf9-c320b744f971 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1563775653" status: 202 len: 0 microversion: 2.1 time: 0.119406 Oct 30 01:13:31.228346 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 21/39] 10.222.0.13 () {58 vars in 1161 bytes} [Sun Oct 30 01:13:31 2022] DELETE /compute/v2.1/flavors/1563775653 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:13:31.233143 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f223a1e3-2a27-4146-8a14-c9219bc83ede tempest-FlavorsAccessTestJSON-1892644905 tempest-FlavorsAccessTestJSON-1892644905-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:31.253558 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f223a1e3-2a27-4146-8a14-c9219bc83ede tempest-FlavorsAccessTestJSON-1892644905 tempest-FlavorsAccessTestJSON-1892644905-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023921 Oct 30 01:13:31.254114 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 22/40] 10.222.0.13 () {58 vars in 1146 bytes} [Sun Oct 30 01:13:31 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:31.258182 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2966b1ac-a68e-4752-aac2-ce78cfd440c2 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:31.277188 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2966b1ac-a68e-4752-aac2-ce78cfd440c2 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.022068 Oct 30 01:13:31.277754 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 23/41] 10.222.0.13 () {58 vars in 1146 bytes} [Sun Oct 30 01:13:31 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:31.297173 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8e286836-6e4f-495a-b9ae-d84844337b70 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-494532761", "id": 1536259940, "os-flavor-access:is_public": "False"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:13:31.413356 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8e286836-6e4f-495a-b9ae-d84844337b70 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.119742 Oct 30 01:13:31.414039 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 24/42] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:13:31 2022] POST /compute/v2.1/flavors => generated 438 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:13:32.025522 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0ad765e4-ce3f-40ec-bdea-2fe33da868ae tempest-FlavorsAccessNegativeTestJSON-477851835 tempest-FlavorsAccessNegativeTestJSON-477851835-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "a171f2755be64d048fc4b422798ebc49"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:13:32.029647 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0ad765e4-ce3f-40ec-bdea-2fe33da868ae tempest-FlavorsAccessNegativeTestJSON-477851835 tempest-FlavorsAccessNegativeTestJSON-477851835-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'd69604c3494f489b8d86c6dfa932b108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a171f2755be64d048fc4b422798ebc49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:32.031642 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0ad765e4-ce3f-40ec-bdea-2fe33da868ae tempest-FlavorsAccessNegativeTestJSON-477851835 tempest-FlavorsAccessNegativeTestJSON-477851835-project] Request method failure captured: Oct 30 01:13:32.031642 n-d-master-1 devstack@n-api.service[121103]: request: POST /compute/v2.1/flavors/1536259940/action HTTP/1.1 Oct 30 01:13:32.031642 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:13:32.031642 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:13:32.031642 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:13:32.031642 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 67 Oct 30 01:13:32.031642 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:13:32.031642 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:13:32.031642 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:13:32.031642 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:13:32.031642 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXc-y4dZsMpMUHPxma646n1K6bP58ZbRYdYlaoJoXDZeUerM9RL7QfRPGT-dTxzUgYqBBpuDgxpPeNBbTd_mJhKFcV1JtDxm57yU5OwZjiRxyP2LBRcmk3zhjmuUkTYiXKer8dtwJ_E1eD-GYBMkMx4tOWvdjUIO_LkQr-hfpTwfftp8 Oct 30 01:13:32.031642 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:13:32.031642 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:13:32.031642 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:13:32.031642 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:13:32.031642 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:13:32.031642 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:13:32.031642 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: a171f2755be64d048fc4b422798ebc49 Oct 30 01:13:32.031642 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-477851835 Oct 30 01:13:32.031642 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:13:32.031642 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:13:32.034010 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a171f2755be64d048fc4b422798ebc49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a171f2755be64d048fc4b422798ebc49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a171f2755be64d048fc4b422798ebc49"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a171f2755be64d048fc4b422798ebc49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:13:32.034010 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-477851835 Oct 30 01:13:32.034010 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: a171f2755be64d048fc4b422798ebc49 Oct 30 01:13:32.034010 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-477851835 Oct 30 01:13:32.034010 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-FlavorsAccessNegativeTestJSON-477851835-project Oct 30 01:13:32.034010 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:13:32.034010 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:13:32.034010 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: d69604c3494f489b8d86c6dfa932b108 Oct 30 01:13:32.034010 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-477851835-project Oct 30 01:13:32.034010 n-d-master-1 devstack@n-api.service[121103]: Oct 30 01:13:32.034010 n-d-master-1 devstack@n-api.service[121103]: {"addTenantAccess": {"tenant": "a171f2755be64d048fc4b422798ebc49"}} Oct 30 01:13:32.034010 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:13:32.034682 n-d-master-1 devstack@n-api.service[121103]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 30 01:13:32.034682 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '1536259940', 'body': {'addTenantAccess': {'tenant': 'a171f2755be64d048fc4b422798ebc49'}}} Oct 30 01:13:32.034682 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:13:32.034682 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:13:32.034682 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:13:32.034682 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:13:32.034682 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:13:32.034682 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:13:32.034682 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:13:32.034682 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:13:32.034682 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:13:32.034682 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:13:32.034682 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 30 01:13:32.034682 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 30 01:13:32.034682 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 30 01:13:32.034682 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 30 01:13:32.034682 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 30 01:13:32.034682 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 30 01:13:32.034682 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 01:13:32.035683 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 30 01:13:32.035683 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 01:13:32.035683 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise self.value Oct 30 01:13:32.035683 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 30 01:13:32.035683 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 30 01:13:32.035683 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 30 01:13:32.035683 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 30 01:13:32.035683 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 30 01:13:32.035683 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 30 01:13:32.035683 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 30 01:13:32.035683 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:13:32.035683 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:13:32.035683 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:13:32.035683 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:13:32.035683 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:13:32.035683 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:13:32.035683 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 30 01:13:32.035683 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 30 01:13:32.035683 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 30 01:13:32.035683 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:13:32.036659 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0ad765e4-ce3f-40ec-bdea-2fe33da868ae tempest-FlavorsAccessNegativeTestJSON-477851835 tempest-FlavorsAccessNegativeTestJSON-477851835-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:13:32.036659 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0ad765e4-ce3f-40ec-bdea-2fe33da868ae tempest-FlavorsAccessNegativeTestJSON-477851835 tempest-FlavorsAccessNegativeTestJSON-477851835-project] 10.222.0.13 "POST /compute/v2.1/flavors/1536259940/action" status: 403 len: 130 microversion: 2.1 time: 0.610709 Oct 30 01:13:32.036659 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 25/43] 10.222.0.13 () {60 vars in 1200 bytes} [Sun Oct 30 01:13:31 2022] POST /compute/v2.1/flavors/1536259940/action => generated 130 bytes in 612 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 30 01:13:32.043429 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9490f5de-4004-440a-b9f2-1bc1fe7b917f tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:32.147987 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9490f5de-4004-440a-b9f2-1bc1fe7b917f tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1536259940" status: 202 len: 0 microversion: 2.1 time: 0.108201 Oct 30 01:13:32.149025 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 26/44] 10.222.0.13 () {58 vars in 1161 bytes} [Sun Oct 30 01:13:32 2022] DELETE /compute/v2.1/flavors/1536259940 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:13:32.157633 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-27ce4419-535e-4449-b60e-ad8eac3c9be5 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:32.182849 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-27ce4419-535e-4449-b60e-ad8eac3c9be5 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029252 Oct 30 01:13:32.183561 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 27/45] 10.222.0.13 () {58 vars in 1146 bytes} [Sun Oct 30 01:13:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:13:32.207025 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-36e1381b-7033-49de-a9ec-4d1e71d49fe3 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-267621523", "id": 741011666, "os-flavor-access:is_public": "False"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:13:32.354377 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-36e1381b-7033-49de-a9ec-4d1e71d49fe3 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.151337 Oct 30 01:13:32.355146 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 28/46] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:13:32 2022] POST /compute/v2.1/flavors => generated 435 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:13:32.380439 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c8faf43f-0789-4dd0-bc98-3a6c75c631f7 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "a171f2755be64d048fc4b422798ebc49"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:13:33.107787 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d2772fc4-26b7-44a5-8d5e-3e508334cd41 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 312 microversion: 2.1 time: 1.959962 Oct 30 01:13:33.122427 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 19/47] 10.222.0.13 () {60 vars in 1191 bytes} [Sun Oct 30 01:13:31 2022] POST /compute/v2.1/os-aggregates/2/action => generated 312 bytes in 1978 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:13:33.204091 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c8faf43f-0789-4dd0-bc98-3a6c75c631f7 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/741011666/action" status: 200 len: 96 microversion: 2.1 time: 0.836829 Oct 30 01:13:33.204993 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 29/48] 10.222.0.13 () {60 vars in 1197 bytes} [Sun Oct 30 01:13:32 2022] POST /compute/v2.1/flavors/741011666/action => generated 96 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 30 01:13:33.215948 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-09517b66-116a-460f-89e4-c7de898ea203 tempest-FlavorsAccessNegativeTestJSON-477851835 tempest-FlavorsAccessNegativeTestJSON-477851835-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "a171f2755be64d048fc4b422798ebc49"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:13:33.219553 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-09517b66-116a-460f-89e4-c7de898ea203 tempest-FlavorsAccessNegativeTestJSON-477851835 tempest-FlavorsAccessNegativeTestJSON-477851835-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'd69604c3494f489b8d86c6dfa932b108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a171f2755be64d048fc4b422798ebc49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:33.223159 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-09517b66-116a-460f-89e4-c7de898ea203 tempest-FlavorsAccessNegativeTestJSON-477851835 tempest-FlavorsAccessNegativeTestJSON-477851835-project] Request method failure captured: Oct 30 01:13:33.223159 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/flavors/741011666/action HTTP/1.1 Oct 30 01:13:33.223159 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:13:33.223159 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:13:33.223159 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:13:33.223159 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 70 Oct 30 01:13:33.223159 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:13:33.223159 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:13:33.223159 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:13:33.223159 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:13:33.223159 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXc-y4dZsMpMUHPxma646n1K6bP58ZbRYdYlaoJoXDZeUerM9RL7QfRPGT-dTxzUgYqBBpuDgxpPeNBbTd_mJhKFcV1JtDxm57yU5OwZjiRxyP2LBRcmk3zhjmuUkTYiXKer8dtwJ_E1eD-GYBMkMx4tOWvdjUIO_LkQr-hfpTwfftp8 Oct 30 01:13:33.223159 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:13:33.223159 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:13:33.223159 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:13:33.223159 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:13:33.223159 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:13:33.223159 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:13:33.223159 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: a171f2755be64d048fc4b422798ebc49 Oct 30 01:13:33.223159 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-477851835 Oct 30 01:13:33.223159 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:13:33.223159 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:13:33.224491 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a171f2755be64d048fc4b422798ebc49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a171f2755be64d048fc4b422798ebc49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a171f2755be64d048fc4b422798ebc49"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a171f2755be64d048fc4b422798ebc49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:13:33.224491 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-477851835 Oct 30 01:13:33.224491 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: a171f2755be64d048fc4b422798ebc49 Oct 30 01:13:33.224491 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-477851835 Oct 30 01:13:33.224491 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-FlavorsAccessNegativeTestJSON-477851835-project Oct 30 01:13:33.224491 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:13:33.224491 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:13:33.224491 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: d69604c3494f489b8d86c6dfa932b108 Oct 30 01:13:33.224491 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-477851835-project Oct 30 01:13:33.224491 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:13:33.224491 n-d-master-1 devstack@n-api.service[121102]: {"removeTenantAccess": {"tenant": "a171f2755be64d048fc4b422798ebc49"}} Oct 30 01:13:33.224491 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:13:33.225179 n-d-master-1 devstack@n-api.service[121102]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 30 01:13:33.225179 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '741011666', 'body': {'removeTenantAccess': {'tenant': 'a171f2755be64d048fc4b422798ebc49'}}} Oct 30 01:13:33.225179 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:13:33.225179 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:13:33.225179 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:13:33.225179 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:13:33.225179 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:13:33.225179 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:13:33.225179 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:13:33.225179 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:13:33.225179 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:13:33.225179 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:13:33.225179 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 30 01:13:33.225179 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi context.can( Oct 30 01:13:33.225179 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 30 01:13:33.225179 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 30 01:13:33.225179 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 30 01:13:33.225179 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 30 01:13:33.225179 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 01:13:33.225179 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 30 01:13:33.226212 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 01:13:33.226212 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise self.value Oct 30 01:13:33.226212 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 30 01:13:33.226212 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 30 01:13:33.226212 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 30 01:13:33.226212 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 30 01:13:33.226212 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 30 01:13:33.226212 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 30 01:13:33.226212 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 30 01:13:33.226212 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:13:33.226212 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:13:33.226212 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:13:33.226212 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:13:33.226212 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:13:33.226212 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:13:33.226212 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 30 01:13:33.226212 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 30 01:13:33.226212 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 30 01:13:33.226212 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:13:33.227116 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-09517b66-116a-460f-89e4-c7de898ea203 tempest-FlavorsAccessNegativeTestJSON-477851835 tempest-FlavorsAccessNegativeTestJSON-477851835-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:13:33.227116 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-09517b66-116a-460f-89e4-c7de898ea203 tempest-FlavorsAccessNegativeTestJSON-477851835 tempest-FlavorsAccessNegativeTestJSON-477851835-project] 10.222.0.13 "POST /compute/v2.1/flavors/741011666/action" status: 403 len: 133 microversion: 2.1 time: 0.012996 Oct 30 01:13:33.227116 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 20/49] 10.222.0.13 () {60 vars in 1197 bytes} [Sun Oct 30 01:13:33 2022] POST /compute/v2.1/flavors/741011666/action => generated 133 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 30 01:13:33.244443 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-51518138-a831-4f4b-a4c7-d8fe2bd06e20 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "a171f2755be64d048fc4b422798ebc49"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:13:33.937005 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bdb3b390-1c38-4def-8896-cc8b89813ffa tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1290683790", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "availability_zone": "tempest-test_az-541501887"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:13:33.967797 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bdb3b390-1c38-4def-8896-cc8b89813ffa tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:33.968898 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bdb3b390-1c38-4def-8896-cc8b89813ffa tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:33.973903 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bdb3b390-1c38-4def-8896-cc8b89813ffa tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:33.973903 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bdb3b390-1c38-4def-8896-cc8b89813ffa tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:33.973903 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bdb3b390-1c38-4def-8896-cc8b89813ffa tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:33.973903 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bdb3b390-1c38-4def-8896-cc8b89813ffa tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:34.780043 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-51518138-a831-4f4b-a4c7-d8fe2bd06e20 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/741011666/action" status: 200 len: 21 microversion: 2.1 time: 1.550201 Oct 30 01:13:34.780784 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 30/50] 10.222.0.13 () {60 vars in 1197 bytes} [Sun Oct 30 01:13:33 2022] POST /compute/v2.1/flavors/741011666/action => generated 21 bytes in 1552 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:13:34.790569 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e8d496f4-edfb-443e-ba1a-d04c20cfa41e tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:34.910960 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e8d496f4-edfb-443e-ba1a-d04c20cfa41e tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/741011666" status: 202 len: 0 microversion: 2.1 time: 0.123952 Oct 30 01:13:34.914949 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 31/51] 10.222.0.13 () {58 vars in 1158 bytes} [Sun Oct 30 01:13:34 2022] DELETE /compute/v2.1/flavors/741011666 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:13:34.925595 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-10c98b27-b228-481b-98b9-c18313b2547e tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:35.004014 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-10c98b27-b228-481b-98b9-c18313b2547e tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.081704 Oct 30 01:13:35.005202 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 32/52] 10.222.0.13 () {58 vars in 1146 bytes} [Sun Oct 30 01:13:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:13:35.027533 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7ae68c2d-ed65-44b3-ab04-23e80bf25af5 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1844460083", "id": 2120658329, "os-flavor-access:is_public": "False"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:13:35.123053 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7ae68c2d-ed65-44b3-ab04-23e80bf25af5 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.091241 Oct 30 01:13:35.123053 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 33/53] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:13:35 2022] POST /compute/v2.1/flavors => generated 439 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:13:35.140283 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c2993482-c102-4614-b873-f74413f6516a tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "895de57f9934430d82536a9252f6b39e"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:13:35.416322 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-bdb3b390-1c38-4def-8896-cc8b89813ffa tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] validate_networks() for None {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:13:35.761699 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-bdb3b390-1c38-4def-8896-cc8b89813ffa tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:13:35.762133 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-bdb3b390-1c38-4def-8896-cc8b89813ffa tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:13:35.762611 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-bdb3b390-1c38-4def-8896-cc8b89813ffa tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:13:35.763362 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-bdb3b390-1c38-4def-8896-cc8b89813ffa tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:13:35.763787 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-bdb3b390-1c38-4def-8896-cc8b89813ffa tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:13:35.781439 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bdb3b390-1c38-4def-8896-cc8b89813ffa tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:35.782103 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bdb3b390-1c38-4def-8896-cc8b89813ffa tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:35.782804 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bdb3b390-1c38-4def-8896-cc8b89813ffa tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:35.784544 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bdb3b390-1c38-4def-8896-cc8b89813ffa tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:35.785174 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bdb3b390-1c38-4def-8896-cc8b89813ffa tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:35.788950 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bdb3b390-1c38-4def-8896-cc8b89813ffa tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:35.842712 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-bdb3b390-1c38-4def-8896-cc8b89813ffa tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Getting quotas for project ce6543b666064cd78c02ec5a471d003f. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:13:35.850869 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6,nova_api:DELETE=9 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:35.857519 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-bdb3b390-1c38-4def-8896-cc8b89813ffa tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Getting quotas for user ae9211a459e946c1a114983c531a8897 and project ce6543b666064cd78c02ec5a471d003f. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:13:35.873901 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bdb3b390-1c38-4def-8896-cc8b89813ffa tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:13:35.881364 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bdb3b390-1c38-4def-8896-cc8b89813ffa tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] [instance: ba2968b1-c8ef-4ec2-9d98-66da2c62919b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:13:36.030804 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bdb3b390-1c38-4def-8896-cc8b89813ffa tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.775247 Oct 30 01:13:36.031468 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 21/54] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:13:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:13:36.050934 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-94256c75-f569-41a3-8415-eae97fa604fa tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:36.052864 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-94256c75-f569-41a3-8415-eae97fa604fa tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] [instance: ba2968b1-c8ef-4ec2-9d98-66da2c62919b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:36.233743 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-94256c75-f569-41a3-8415-eae97fa604fa tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9211a459e946c1a114983c531a8897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6543b666064cd78c02ec5a471d003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:36.283654 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-c2993482-c102-4614-b873-f74413f6516a tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] HTTP exception thrown: Flavor access not found for 22 / 895de57f9934430d82536a9252f6b39e combination. Oct 30 01:13:36.284494 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-94256c75-f569-41a3-8415-eae97fa604fa tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] 10.222.0.13 "GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b" status: 200 len: 1242 microversion: 2.1 time: 0.238402 Oct 30 01:13:36.284494 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 22/55] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:36 2022] GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b => generated 1242 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:36.288327 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c2993482-c102-4614-b873-f74413f6516a tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] Request method failure captured: Oct 30 01:13:36.288327 n-d-master-1 devstack@n-api.service[121103]: request: POST /compute/v2.1/flavors/2120658329/action HTTP/1.1 Oct 30 01:13:36.288327 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:13:36.288327 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:13:36.288327 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:13:36.288327 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 70 Oct 30 01:13:36.288327 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:13:36.288327 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:13:36.288327 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:13:36.288327 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:13:36.288327 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXc-237812xnpQzNXfLPti9cfhh8tI9jb4fmJd9lc1Wm3BjRXqbPrNWDkK1VZWyHLrS7Y6gRHKYLOQ-Xymz7xqdR80Hk50FI6WSEPyjbeHOMqOS9b2G4Swd2SVlgSwb5afiWw6caQozeFBd4tNj30VB8LQ1kqOQsHWZtXWoD0arJnOr4 Oct 30 01:13:36.288327 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:13:36.288327 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:13:36.288327 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:13:36.288327 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:13:36.288327 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:13:36.288327 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:13:36.288327 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 7cc6b17bab9147488735967e838892ca Oct 30 01:13:36.288327 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1733783349 Oct 30 01:13:36.288327 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,admin,reader Oct 30 01:13:36.288327 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,admin,reader Oct 30 01:13:36.289702 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7cc6b17bab9147488735967e838892ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7cc6b17bab9147488735967e838892ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7cc6b17bab9147488735967e838892ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7cc6b17bab9147488735967e838892ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:13:36.289702 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1733783349 Oct 30 01:13:36.289702 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 7cc6b17bab9147488735967e838892ca Oct 30 01:13:36.289702 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1733783349 Oct 30 01:13:36.289702 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin Oct 30 01:13:36.289702 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:13:36.289702 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:13:36.289702 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 24efaa8ae2f04bb5a447d610f7743fdc Oct 30 01:13:36.289702 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin Oct 30 01:13:36.289702 n-d-master-1 devstack@n-api.service[121103]: Oct 30 01:13:36.289702 n-d-master-1 devstack@n-api.service[121103]: {"removeTenantAccess": {"tenant": "895de57f9934430d82536a9252f6b39e"}} Oct 30 01:13:36.289702 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:13:36.290411 n-d-master-1 devstack@n-api.service[121103]: exception: Flavor access not found for 22 / 895de57f9934430d82536a9252f6b39e combination. Oct 30 01:13:36.290411 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '2120658329', 'body': {'removeTenantAccess': {'tenant': '895de57f9934430d82536a9252f6b39e'}}} Oct 30 01:13:36.290411 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:13:36.290411 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:13:36.290411 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 30 01:13:36.290411 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 30 01:13:36.290411 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 30 01:13:36.290411 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 30 01:13:36.290411 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 30 01:13:36.290411 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 30 01:13:36.290411 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 30 01:13:36.290411 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 30 01:13:36.290411 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 30 01:13:36.290411 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 30 01:13:36.290411 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 30 01:13:36.290411 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 30 01:13:36.290411 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 30 01:13:36.290411 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 30 01:13:36.291328 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 22 / 895de57f9934430d82536a9252f6b39e combination. Oct 30 01:13:36.291328 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:13:36.291328 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:13:36.291328 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:13:36.291328 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:13:36.291328 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:13:36.291328 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:13:36.291328 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:13:36.291328 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:13:36.291328 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:13:36.291328 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:13:36.291328 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:13:36.291328 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:13:36.291328 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 30 01:13:36.291328 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:13:36.291328 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 22 / 895de57f9934430d82536a9252f6b39e combination. Oct 30 01:13:36.291328 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:13:36.291328 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:13:36.291328 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:13:36.291328 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:13:36.292258 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:13:36.292258 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:13:36.292258 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:13:36.292258 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:13:36.292258 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 22 / 895de57f9934430d82536a9252f6b39e combination. Oct 30 01:13:36.292258 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:13:36.292258 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c2993482-c102-4614-b873-f74413f6516a tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] Returning 404 to user: Flavor access not found for 22 / 895de57f9934430d82536a9252f6b39e combination. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:13:36.296773 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c2993482-c102-4614-b873-f74413f6516a tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/2120658329/action" status: 404 len: 124 microversion: 2.1 time: 1.164624 Oct 30 01:13:36.297963 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 34/56] 10.222.0.13 () {60 vars in 1200 bytes} [Sun Oct 30 01:13:35 2022] POST /compute/v2.1/flavors/2120658329/action => generated 124 bytes in 1173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 01:13:36.306842 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5ae21c12-324c-4a4f-b229-2d6d0b9236d1 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:36.423270 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5ae21c12-324c-4a4f-b229-2d6d0b9236d1 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/2120658329" status: 202 len: 0 microversion: 2.1 time: 0.120701 Oct 30 01:13:36.424741 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 23/57] 10.222.0.13 () {58 vars in 1161 bytes} [Sun Oct 30 01:13:36 2022] DELETE /compute/v2.1/flavors/2120658329 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 30 01:13:36.438111 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ddb4b83f-02bc-4d58-bb5d-25f1a857eb3d tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:36.494293 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ddb4b83f-02bc-4d58-bb5d-25f1a857eb3d tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.064964 Oct 30 01:13:36.499522 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 35/58] 10.222.0.13 () {58 vars in 1146 bytes} [Sun Oct 30 01:13:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:37.312147 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-36826bba-177a-4da3-bd78-8b6b08ab8111 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:37.313064 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-36826bba-177a-4da3-bd78-8b6b08ab8111 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] [instance: ba2968b1-c8ef-4ec2-9d98-66da2c62919b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:37.415995 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-36826bba-177a-4da3-bd78-8b6b08ab8111 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9211a459e946c1a114983c531a8897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6543b666064cd78c02ec5a471d003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:37.445395 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-36826bba-177a-4da3-bd78-8b6b08ab8111 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] 10.222.0.13 "GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b" status: 200 len: 1242 microversion: 2.1 time: 0.142758 Oct 30 01:13:37.448141 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 24/59] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:37 2022] GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b => generated 1242 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:38.469426 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7b290841-5eca-450e-924d-8143df9582e7 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:38.470273 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7b290841-5eca-450e-924d-8143df9582e7 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] [instance: ba2968b1-c8ef-4ec2-9d98-66da2c62919b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:38.473789 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:40.263178 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7b290841-5eca-450e-924d-8143df9582e7 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9211a459e946c1a114983c531a8897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6543b666064cd78c02ec5a471d003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:40.289381 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7b290841-5eca-450e-924d-8143df9582e7 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] 10.222.0.13 "GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b" status: 200 len: 1242 microversion: 2.1 time: 1.823749 Oct 30 01:13:40.290594 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 36/60] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:38 2022] GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b => generated 1242 bytes in 1826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:41.323476 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-241d797f-b7b9-4769-9ab9-6d3afef6b937 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:41.325156 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-241d797f-b7b9-4769-9ab9-6d3afef6b937 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] [instance: ba2968b1-c8ef-4ec2-9d98-66da2c62919b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:41.347046 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=16 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:41.361074 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-241d797f-b7b9-4769-9ab9-6d3afef6b937 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:41.364029 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-241d797f-b7b9-4769-9ab9-6d3afef6b937 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:41.365254 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-241d797f-b7b9-4769-9ab9-6d3afef6b937 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:41.366518 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-241d797f-b7b9-4769-9ab9-6d3afef6b937 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:41.368409 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-241d797f-b7b9-4769-9ab9-6d3afef6b937 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:41.377452 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-241d797f-b7b9-4769-9ab9-6d3afef6b937 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:41.511245 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fd409354-ff4b-4fec-bb35-65992546ffe4 tempest-InstanceUsageAuditLogNegativeTestJSON-636790134 tempest-InstanceUsageAuditLogNegativeTestJSON-636790134-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:41.514882 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-fd409354-ff4b-4fec-bb35-65992546ffe4 tempest-InstanceUsageAuditLogNegativeTestJSON-636790134 tempest-InstanceUsageAuditLogNegativeTestJSON-636790134-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 30 01:13:41.546594 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fd409354-ff4b-4fec-bb35-65992546ffe4 tempest-InstanceUsageAuditLogNegativeTestJSON-636790134 tempest-InstanceUsageAuditLogNegativeTestJSON-636790134-project-admin] Request method failure captured: Oct 30 01:13:41.546594 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 30 01:13:41.546594 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:13:41.546594 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:13:41.546594 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:13:41.546594 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:13:41.546594 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:13:41.546594 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:13:41.546594 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:13:41.546594 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:13:41.546594 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXc_Edwrqr99DI-axfl36XUXhU0N6dFw3bOqHxrB-TKnFRQPIkOkRs_nOExYbvELo50vQLGAqeVN4p6SGAxDuWLVBSxhf7ZVSdoYIOCsgBnA7ihIR5haapZC18bH29UEsrzWEMcZUBpPIiRo3R6vZlfKSSbAm8hwVZ-N9Aj7UsuCpPWo Oct 30 01:13:41.546594 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:13:41.546594 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:13:41.546594 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:13:41.546594 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:13:41.546594 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:13:41.546594 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:13:41.546594 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 429868cfe90f4e1384c1644727499906 Oct 30 01:13:41.546594 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-636790134 Oct 30 01:13:41.546594 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,admin,reader Oct 30 01:13:41.546594 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,admin,reader Oct 30 01:13:41.547656 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/429868cfe90f4e1384c1644727499906"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_429868cfe90f4e1384c1644727499906"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/429868cfe90f4e1384c1644727499906"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/429868cfe90f4e1384c1644727499906"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:13:41.547656 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-636790134 Oct 30 01:13:41.547656 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 429868cfe90f4e1384c1644727499906 Oct 30 01:13:41.547656 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-636790134 Oct 30 01:13:41.547656 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-636790134-project-admin Oct 30 01:13:41.547656 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:13:41.547656 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:13:41.547656 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 9f8fcdf35ab541979c17671b12f5f5f1 Oct 30 01:13:41.547656 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-636790134-project-admin Oct 30 01:13:41.547656 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:13:41.547656 n-d-master-1 devstack@n-api.service[121102]: exception: Invalid timestamp for date invalid_time Oct 30 01:13:41.548265 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'invalid_time'} Oct 30 01:13:41.548265 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:13:41.548265 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:13:41.548265 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 30 01:13:41.548265 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 30 01:13:41.548265 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 30 01:13:41.548265 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 30 01:13:41.548265 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 30 01:13:41.548265 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 30 01:13:41.548265 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 30 01:13:41.548265 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:13:41.548265 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:13:41.548265 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:13:41.548265 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:13:41.548265 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:13:41.548265 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:13:41.548265 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:13:41.548265 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:13:41.548265 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:13:41.548265 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:13:41.549251 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 30 01:13:41.549251 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 30 01:13:41.549251 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 30 01:13:41.549251 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:13:41.549251 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:13:41.549251 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:13:41.549251 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:13:41.549251 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:13:41.549251 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:13:41.549251 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:13:41.549251 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:13:41.549251 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 30 01:13:41.549251 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:13:41.551838 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fd409354-ff4b-4fec-bb35-65992546ffe4 tempest-InstanceUsageAuditLogNegativeTestJSON-636790134 tempest-InstanceUsageAuditLogNegativeTestJSON-636790134-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:13:41.552624 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fd409354-ff4b-4fec-bb35-65992546ffe4 tempest-InstanceUsageAuditLogNegativeTestJSON-636790134 tempest-InstanceUsageAuditLogNegativeTestJSON-636790134-project-admin] 10.222.0.13 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.738376 Oct 30 01:13:41.554343 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 25/61] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:13:40 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 741 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 30 01:13:41.825896 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-241d797f-b7b9-4769-9ab9-6d3afef6b937 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9211a459e946c1a114983c531a8897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6543b666064cd78c02ec5a471d003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:41.848162 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-241d797f-b7b9-4769-9ab9-6d3afef6b937 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] 10.222.0.13 "GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b" status: 200 len: 1296 microversion: 2.1 time: 0.534366 Oct 30 01:13:41.849582 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 37/62] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:41 2022] GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b => generated 1296 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:42.198808 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cb7dd53e-e0d8-42af-a66a-9ab6283184f1 tempest-InstanceUsageAuditLogNegativeTestJSON-822322800 tempest-InstanceUsageAuditLogNegativeTestJSON-822322800-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:42.200722 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-cb7dd53e-e0d8-42af-a66a-9ab6283184f1 tempest-InstanceUsageAuditLogNegativeTestJSON-822322800 tempest-InstanceUsageAuditLogNegativeTestJSON-822322800-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'aef20737964b4057bdba12a91ef1c9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fddc54619245cb8359e4648cb25990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:42.202423 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cb7dd53e-e0d8-42af-a66a-9ab6283184f1 tempest-InstanceUsageAuditLogNegativeTestJSON-822322800 tempest-InstanceUsageAuditLogNegativeTestJSON-822322800-project] Request method failure captured: Oct 30 01:13:42.202423 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 30 01:13:42.202423 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:13:42.202423 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:13:42.202423 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:13:42.202423 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:13:42.202423 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:13:42.202423 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:13:42.202423 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:13:42.202423 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:13:42.202423 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXc_BN96DuBestkKa_xPN_Aym4Wc6BX75uzCQ0Dla561JmGGX5F8kbBLgLs8WjH3Sy35VVeDmdjqpOneOXtwRGv9VqY8e8evAVIBLh57ImN14KieQ1GWY7S9hOoOfwM6DohRZLFMAS_UKoCQL-HQEXnDJe1Yq-d_IZL1mopKQYVtZbS8 Oct 30 01:13:42.202423 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:13:42.202423 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:13:42.202423 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:13:42.202423 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:13:42.202423 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:13:42.202423 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:13:42.202423 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 40fddc54619245cb8359e4648cb25990 Oct 30 01:13:42.202423 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-822322800 Oct 30 01:13:42.202423 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:13:42.202423 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:13:42.203514 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/40fddc54619245cb8359e4648cb25990"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_40fddc54619245cb8359e4648cb25990"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/40fddc54619245cb8359e4648cb25990"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/40fddc54619245cb8359e4648cb25990"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:13:42.203514 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-822322800 Oct 30 01:13:42.203514 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 40fddc54619245cb8359e4648cb25990 Oct 30 01:13:42.203514 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-822322800 Oct 30 01:13:42.203514 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-822322800-project Oct 30 01:13:42.203514 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:13:42.203514 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:13:42.203514 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: aef20737964b4057bdba12a91ef1c9b7 Oct 30 01:13:42.203514 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-822322800-project Oct 30 01:13:42.203514 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:13:42.204022 n-d-master-1 devstack@n-api.service[121102]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 30 01:13:42.204022 n-d-master-1 devstack@n-api.service[121102]: action_args: {} Oct 30 01:13:42.204022 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:13:42.204022 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:13:42.204022 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:13:42.204022 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:13:42.204022 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:13:42.204022 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:13:42.204022 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:13:42.204022 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:13:42.204022 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 30 01:13:42.204022 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 30 01:13:42.204022 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 30 01:13:42.204022 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 30 01:13:42.204022 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 30 01:13:42.204022 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 30 01:13:42.204022 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 01:13:42.204022 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 30 01:13:42.204022 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 01:13:42.204022 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise self.value Oct 30 01:13:42.205034 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 30 01:13:42.205034 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 30 01:13:42.205034 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 30 01:13:42.205034 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 30 01:13:42.205034 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 30 01:13:42.205034 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 30 01:13:42.205034 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 30 01:13:42.205034 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:13:42.205034 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:13:42.205034 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:13:42.205034 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:13:42.205034 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:13:42.205034 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:13:42.205034 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 30 01:13:42.205034 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 30 01:13:42.205034 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 30 01:13:42.205034 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:13:42.206417 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cb7dd53e-e0d8-42af-a66a-9ab6283184f1 tempest-InstanceUsageAuditLogNegativeTestJSON-822322800 tempest-InstanceUsageAuditLogNegativeTestJSON-822322800-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:13:42.206417 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cb7dd53e-e0d8-42af-a66a-9ab6283184f1 tempest-InstanceUsageAuditLogNegativeTestJSON-822322800 tempest-InstanceUsageAuditLogNegativeTestJSON-822322800-project] 10.222.0.13 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.635967 Oct 30 01:13:42.216095 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-602f1da6-c427-4179-b584-1bff12a5c4ce tempest-InstanceUsageAuditLogNegativeTestJSON-822322800 tempest-InstanceUsageAuditLogNegativeTestJSON-822322800-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:42.216095 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-602f1da6-c427-4179-b584-1bff12a5c4ce tempest-InstanceUsageAuditLogNegativeTestJSON-822322800 tempest-InstanceUsageAuditLogNegativeTestJSON-822322800-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'aef20737964b4057bdba12a91ef1c9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fddc54619245cb8359e4648cb25990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:42.216263 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 26/63] 10.222.0.13 () {58 vars in 1185 bytes} [Sun Oct 30 01:13:41 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 648 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:13:42.217452 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-602f1da6-c427-4179-b584-1bff12a5c4ce tempest-InstanceUsageAuditLogNegativeTestJSON-822322800 tempest-InstanceUsageAuditLogNegativeTestJSON-822322800-project] Request method failure captured: Oct 30 01:13:42.217452 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-30%2001:13:42 HTTP/1.1 Oct 30 01:13:42.217452 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:13:42.217452 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:13:42.217452 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:13:42.217452 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:13:42.217452 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:13:42.217452 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:13:42.217452 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:13:42.217452 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:13:42.217452 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXc_BN96DuBestkKa_xPN_Aym4Wc6BX75uzCQ0Dla561JmGGX5F8kbBLgLs8WjH3Sy35VVeDmdjqpOneOXtwRGv9VqY8e8evAVIBLh57ImN14KieQ1GWY7S9hOoOfwM6DohRZLFMAS_UKoCQL-HQEXnDJe1Yq-d_IZL1mopKQYVtZbS8 Oct 30 01:13:42.217452 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:13:42.217452 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:13:42.217452 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:13:42.217452 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:13:42.217452 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:13:42.217452 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:13:42.217452 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 40fddc54619245cb8359e4648cb25990 Oct 30 01:13:42.217452 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-822322800 Oct 30 01:13:42.217452 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:13:42.217452 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:13:42.218692 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/40fddc54619245cb8359e4648cb25990"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_40fddc54619245cb8359e4648cb25990"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/40fddc54619245cb8359e4648cb25990"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/40fddc54619245cb8359e4648cb25990"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:13:42.218692 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-822322800 Oct 30 01:13:42.218692 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 40fddc54619245cb8359e4648cb25990 Oct 30 01:13:42.218692 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-822322800 Oct 30 01:13:42.218692 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-822322800-project Oct 30 01:13:42.218692 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:13:42.218692 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:13:42.218692 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: aef20737964b4057bdba12a91ef1c9b7 Oct 30 01:13:42.218692 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-822322800-project Oct 30 01:13:42.218692 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:13:42.219293 n-d-master-1 devstack@n-api.service[121103]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 30 01:13:42.219293 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '2022-10-30 01:13:42'} Oct 30 01:13:42.219293 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:13:42.219293 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:13:42.219293 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:13:42.219293 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:13:42.219293 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:13:42.219293 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:13:42.219293 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:13:42.219293 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:13:42.219293 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 30 01:13:42.219293 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 30 01:13:42.219293 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 30 01:13:42.219293 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 30 01:13:42.219293 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 30 01:13:42.219293 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 30 01:13:42.219293 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 01:13:42.219293 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 30 01:13:42.219293 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 01:13:42.219293 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise self.value Oct 30 01:13:42.220254 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 30 01:13:42.220254 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 30 01:13:42.220254 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 30 01:13:42.220254 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 30 01:13:42.220254 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 30 01:13:42.220254 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 30 01:13:42.220254 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 30 01:13:42.220254 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:13:42.220254 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:13:42.220254 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:13:42.220254 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:13:42.220254 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:13:42.220254 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:13:42.220254 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 30 01:13:42.220254 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 30 01:13:42.220254 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 30 01:13:42.220254 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:13:42.222685 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-602f1da6-c427-4179-b584-1bff12a5c4ce tempest-InstanceUsageAuditLogNegativeTestJSON-822322800 tempest-InstanceUsageAuditLogNegativeTestJSON-822322800-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:13:42.223530 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-602f1da6-c427-4179-b584-1bff12a5c4ce tempest-InstanceUsageAuditLogNegativeTestJSON-822322800 tempest-InstanceUsageAuditLogNegativeTestJSON-822322800-project] 10.222.0.13 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-30 01:13:42" status: 403 len: 128 microversion: 2.1 time: 0.014349 Oct 30 01:13:42.224304 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 38/64] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 30 01:13:42 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-30%2001%3A13%3A42 => generated 128 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 30 01:13:42.881026 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f1896306-615c-4496-b927-b3999003199e tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:42.881026 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f1896306-615c-4496-b927-b3999003199e tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] [instance: ba2968b1-c8ef-4ec2-9d98-66da2c62919b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:42.893646 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f1896306-615c-4496-b927-b3999003199e tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:42.901563 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f1896306-615c-4496-b927-b3999003199e tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:42.906030 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f1896306-615c-4496-b927-b3999003199e tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:42.908088 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f1896306-615c-4496-b927-b3999003199e tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:42.914290 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f1896306-615c-4496-b927-b3999003199e tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:42.915253 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f1896306-615c-4496-b927-b3999003199e tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:43.128492 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f1896306-615c-4496-b927-b3999003199e tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9211a459e946c1a114983c531a8897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6543b666064cd78c02ec5a471d003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:43.143123 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f1896306-615c-4496-b927-b3999003199e tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] 10.222.0.13 "GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b" status: 200 len: 1296 microversion: 2.1 time: 0.268042 Oct 30 01:13:43.153418 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 39/65] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:42 2022] GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b => generated 1296 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:13:43.755999 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4ed896b3-3884-4903-a7a7-1e4baf6aae85 tempest-AZAdminV2TestJSON-1568198410 tempest-AZAdminV2TestJSON-1568198410-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:43.760611 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4ed896b3-3884-4903-a7a7-1e4baf6aae85 tempest-AZAdminV2TestJSON-1568198410 tempest-AZAdminV2TestJSON-1568198410-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:43.761404 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4ed896b3-3884-4903-a7a7-1e4baf6aae85 tempest-AZAdminV2TestJSON-1568198410 tempest-AZAdminV2TestJSON-1568198410-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:43.762172 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4ed896b3-3884-4903-a7a7-1e4baf6aae85 tempest-AZAdminV2TestJSON-1568198410 tempest-AZAdminV2TestJSON-1568198410-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:43.763675 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4ed896b3-3884-4903-a7a7-1e4baf6aae85 tempest-AZAdminV2TestJSON-1568198410 tempest-AZAdminV2TestJSON-1568198410-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:43.768089 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4ed896b3-3884-4903-a7a7-1e4baf6aae85 tempest-AZAdminV2TestJSON-1568198410 tempest-AZAdminV2TestJSON-1568198410-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:43.771101 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4ed896b3-3884-4903-a7a7-1e4baf6aae85 tempest-AZAdminV2TestJSON-1568198410 tempest-AZAdminV2TestJSON-1568198410-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:43.904801 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4ed896b3-3884-4903-a7a7-1e4baf6aae85 tempest-AZAdminV2TestJSON-1568198410 tempest-AZAdminV2TestJSON-1568198410-project-admin] 10.222.0.13 "GET /compute/v2.1/os-availability-zone" status: 200 len: 189 microversion: 2.1 time: 1.411087 Oct 30 01:13:43.912030 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 27/66] 10.222.0.13 () {58 vars in 1164 bytes} [Sun Oct 30 01:13:42 2022] GET /compute/v2.1/os-availability-zone => generated 189 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:13:43.924430 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-12001cf8-b5b1-4f3d-a053-e0da3c9136e8 tempest-AZAdminV2TestJSON-1568198410 tempest-AZAdminV2TestJSON-1568198410-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:43.926494 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-12001cf8-b5b1-4f3d-a053-e0da3c9136e8 tempest-AZAdminV2TestJSON-1568198410 tempest-AZAdminV2TestJSON-1568198410-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:43.930082 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-12001cf8-b5b1-4f3d-a053-e0da3c9136e8 tempest-AZAdminV2TestJSON-1568198410 tempest-AZAdminV2TestJSON-1568198410-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:43.930082 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-12001cf8-b5b1-4f3d-a053-e0da3c9136e8 tempest-AZAdminV2TestJSON-1568198410 tempest-AZAdminV2TestJSON-1568198410-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:43.930082 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-12001cf8-b5b1-4f3d-a053-e0da3c9136e8 tempest-AZAdminV2TestJSON-1568198410 tempest-AZAdminV2TestJSON-1568198410-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:43.930082 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-12001cf8-b5b1-4f3d-a053-e0da3c9136e8 tempest-AZAdminV2TestJSON-1568198410 tempest-AZAdminV2TestJSON-1568198410-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:43.930460 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-12001cf8-b5b1-4f3d-a053-e0da3c9136e8 tempest-AZAdminV2TestJSON-1568198410 tempest-AZAdminV2TestJSON-1568198410-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:43.989804 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-12001cf8-b5b1-4f3d-a053-e0da3c9136e8 tempest-AZAdminV2TestJSON-1568198410 tempest-AZAdminV2TestJSON-1568198410-project-admin] 10.222.0.13 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 700 microversion: 2.1 time: 0.069238 Oct 30 01:13:43.991972 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 28/67] 10.222.0.13 () {58 vars in 1185 bytes} [Sun Oct 30 01:13:43 2022] GET /compute/v2.1/os-availability-zone/detail => generated 700 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:13:44.168729 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-273f94b2-49f0-4844-9aa6-a04839c3bbbc tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:44.169454 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-273f94b2-49f0-4844-9aa6-a04839c3bbbc tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] [instance: ba2968b1-c8ef-4ec2-9d98-66da2c62919b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:44.190228 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-273f94b2-49f0-4844-9aa6-a04839c3bbbc tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:44.199686 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4921aed6-4f96-4aba-a602-a87754a94ee6 tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Calling method '.version_select at 0x7f44ccf545e0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:44.201700 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4921aed6-4f96-4aba-a602-a87754a94ee6 tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:44.202321 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4921aed6-4f96-4aba-a602-a87754a94ee6 tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:44.203013 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4921aed6-4f96-4aba-a602-a87754a94ee6 tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:44.208218 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-273f94b2-49f0-4844-9aa6-a04839c3bbbc tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:44.211448 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-273f94b2-49f0-4844-9aa6-a04839c3bbbc tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:44.211993 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-273f94b2-49f0-4844-9aa6-a04839c3bbbc tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:44.212635 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-273f94b2-49f0-4844-9aa6-a04839c3bbbc tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:44.213161 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-273f94b2-49f0-4844-9aa6-a04839c3bbbc tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:44.247960 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4921aed6-4f96-4aba-a602-a87754a94ee6 tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:44.249139 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4921aed6-4f96-4aba-a602-a87754a94ee6 tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:44.252188 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4921aed6-4f96-4aba-a602-a87754a94ee6 tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:44.291030 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4921aed6-4f96-4aba-a602-a87754a94ee6 tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:44.297081 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4921aed6-4f96-4aba-a602-a87754a94ee6 tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:44.301468 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4921aed6-4f96-4aba-a602-a87754a94ee6 tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:44.318435 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4921aed6-4f96-4aba-a602-a87754a94ee6 tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 1.137096 Oct 30 01:13:44.325724 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 40/68] 10.222.0.13 () {58 vars in 1146 bytes} [Sun Oct 30 01:13:43 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:13:44.354012 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-909cc035-b129-4418-8895-0df347917777 tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Calling method '.version_select at 0x7f44ccf54160>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:44.357308 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-909cc035-b129-4418-8895-0df347917777 tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:44.374812 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-909cc035-b129-4418-8895-0df347917777 tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:44.376888 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-909cc035-b129-4418-8895-0df347917777 tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:44.444229 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-909cc035-b129-4418-8895-0df347917777 tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:44.444823 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-909cc035-b129-4418-8895-0df347917777 tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:44.451761 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-909cc035-b129-4418-8895-0df347917777 tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:44.508492 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-909cc035-b129-4418-8895-0df347917777 tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:44.510587 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-909cc035-b129-4418-8895-0df347917777 tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:44.512119 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-909cc035-b129-4418-8895-0df347917777 tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:44.533102 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-909cc035-b129-4418-8895-0df347917777 tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1504 microversion: 2.1 time: 0.189907 Oct 30 01:13:44.547047 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 41/69] 10.222.0.13 () {58 vars in 1167 bytes} [Sun Oct 30 01:13:44 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1504 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:44.553712 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7a439578-6e4e-4df8-925e-42b61bca636b tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Calling method '.version_select at 0x7f44ccfbc550>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:44.555679 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7a439578-6e4e-4df8-925e-42b61bca636b tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:44.556237 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7a439578-6e4e-4df8-925e-42b61bca636b tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:44.557370 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7a439578-6e4e-4df8-925e-42b61bca636b tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:44.635084 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7a439578-6e4e-4df8-925e-42b61bca636b tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:44.638921 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7a439578-6e4e-4df8-925e-42b61bca636b tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:44.639769 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7a439578-6e4e-4df8-925e-42b61bca636b tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:44.682801 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7a439578-6e4e-4df8-925e-42b61bca636b tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:44.685141 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7a439578-6e4e-4df8-925e-42b61bca636b tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:44.685641 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7a439578-6e4e-4df8-925e-42b61bca636b tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:44.717042 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7a439578-6e4e-4df8-925e-42b61bca636b tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.165088 Oct 30 01:13:44.722636 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 42/70] 10.222.0.13 () {58 vars in 1146 bytes} [Sun Oct 30 01:13:44 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:13:44.750122 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-96389a88-8155-422d-a8f5-8ef38387aa36 tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Calling method '.version_select at 0x7f44ccf54280>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:44.764580 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-96389a88-8155-422d-a8f5-8ef38387aa36 tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:44.766690 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-96389a88-8155-422d-a8f5-8ef38387aa36 tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:44.775498 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-96389a88-8155-422d-a8f5-8ef38387aa36 tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:44.813870 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-96389a88-8155-422d-a8f5-8ef38387aa36 tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:44.815176 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-96389a88-8155-422d-a8f5-8ef38387aa36 tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:44.816845 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-96389a88-8155-422d-a8f5-8ef38387aa36 tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:44.826471 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-96389a88-8155-422d-a8f5-8ef38387aa36 tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.098732 Oct 30 01:13:44.840006 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 43/71] 10.222.0.13 () {58 vars in 1152 bytes} [Sun Oct 30 01:13:44 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:13:44.852547 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2c934f16-f266-4127-825c-85ff64743d00 tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Calling method '.version_select at 0x7f44ccf540d0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:45.013348 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2c934f16-f266-4127-825c-85ff64743d00 tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:45.013348 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2c934f16-f266-4127-825c-85ff64743d00 tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:45.013348 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2c934f16-f266-4127-825c-85ff64743d00 tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:45.013348 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2c934f16-f266-4127-825c-85ff64743d00 tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.058252 Oct 30 01:13:45.015291 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 44/72] 10.222.0.13 () {58 vars in 1179 bytes} [Sun Oct 30 01:13:44 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:13:45.015960 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-273f94b2-49f0-4844-9aa6-a04839c3bbbc tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9211a459e946c1a114983c531a8897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6543b666064cd78c02ec5a471d003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:45.015960 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-273f94b2-49f0-4844-9aa6-a04839c3bbbc tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] 10.222.0.13 "GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b" status: 200 len: 1338 microversion: 2.1 time: 0.829300 Oct 30 01:13:45.015960 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 29/73] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:44 2022] GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b => generated 1338 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:13:45.018362 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bd19f182-6fa8-4024-aae0-3113776c384d tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Calling method '.version_select at 0x7f44ccf541f0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:45.019495 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd19f182-6fa8-4024-aae0-3113776c384d tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:45.019495 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd19f182-6fa8-4024-aae0-3113776c384d tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:45.019669 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd19f182-6fa8-4024-aae0-3113776c384d tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:45.053789 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd19f182-6fa8-4024-aae0-3113776c384d tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:45.054291 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd19f182-6fa8-4024-aae0-3113776c384d tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:45.054727 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd19f182-6fa8-4024-aae0-3113776c384d tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:45.067207 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd19f182-6fa8-4024-aae0-3113776c384d tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:45.067699 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd19f182-6fa8-4024-aae0-3113776c384d tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:45.223878 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd19f182-6fa8-4024-aae0-3113776c384d tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:45.223878 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bd19f182-6fa8-4024-aae0-3113776c384d tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.065223 Oct 30 01:13:45.223878 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 45/74] 10.222.0.13 () {58 vars in 1146 bytes} [Sun Oct 30 01:13:45 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:13:45.226712 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bd8afafd-e22b-46c1-ba97-6389e1cbde2f tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Calling method '.version_select at 0x7f44ccd3eca0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:45.244496 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bd8afafd-e22b-46c1-ba97-6389e1cbde2f tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:45.245041 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bd8afafd-e22b-46c1-ba97-6389e1cbde2f tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:45.248652 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bd8afafd-e22b-46c1-ba97-6389e1cbde2f tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:45.290527 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bd8afafd-e22b-46c1-ba97-6389e1cbde2f tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:45.292930 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bd8afafd-e22b-46c1-ba97-6389e1cbde2f tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:45.302110 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bd8afafd-e22b-46c1-ba97-6389e1cbde2f tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:45.317039 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bd8afafd-e22b-46c1-ba97-6389e1cbde2f tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.093968 Oct 30 01:13:45.335516 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 30/75] 10.222.0.13 () {58 vars in 1152 bytes} [Sun Oct 30 01:13:45 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:13:45.336031 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0cf07f2e-6c78-4dd7-8d10-934e960ab8ea tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Calling method '.version_select at 0x7f44ccf1d8b0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:45.338143 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0cf07f2e-6c78-4dd7-8d10-934e960ab8ea tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:45.338712 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0cf07f2e-6c78-4dd7-8d10-934e960ab8ea tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:45.339761 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0cf07f2e-6c78-4dd7-8d10-934e960ab8ea tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:45.398250 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0cf07f2e-6c78-4dd7-8d10-934e960ab8ea tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:45.403110 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0cf07f2e-6c78-4dd7-8d10-934e960ab8ea tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:45.404331 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0cf07f2e-6c78-4dd7-8d10-934e960ab8ea tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:45.421430 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0cf07f2e-6c78-4dd7-8d10-934e960ab8ea tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 757 microversion: 2.1 time: 0.089516 Oct 30 01:13:45.429049 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 46/76] 10.222.0.13 () {58 vars in 1152 bytes} [Sun Oct 30 01:13:45 2022] GET /compute/v2.1/os-hypervisors/2 => generated 757 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:13:45.448105 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-46369d14-98e5-4727-8f37-bdf44709e341 tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Calling method '.version_select at 0x7f44ccd60dc0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:45.450666 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-46369d14-98e5-4727-8f37-bdf44709e341 tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:45.451480 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-46369d14-98e5-4727-8f37-bdf44709e341 tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:45.452816 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-46369d14-98e5-4727-8f37-bdf44709e341 tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:45.486948 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-46369d14-98e5-4727-8f37-bdf44709e341 tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:45.488120 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-46369d14-98e5-4727-8f37-bdf44709e341 tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:45.489416 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-46369d14-98e5-4727-8f37-bdf44709e341 tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:45.570735 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-46369d14-98e5-4727-8f37-bdf44709e341 tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:45.571523 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-46369d14-98e5-4727-8f37-bdf44709e341 tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:45.572311 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-46369d14-98e5-4727-8f37-bdf44709e341 tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:45.611235 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-46369d14-98e5-4727-8f37-bdf44709e341 tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Acquiring lock "compute-rpcapi-router" {{(pid=121102) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 30 01:13:45.612440 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-46369d14-98e5-4727-8f37-bdf44709e341 tempest-HypervisorAdminTestJSON-90761535 tempest-HypervisorAdminTestJSON-90761535-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=121102) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 30 01:13:45.613855 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1477c0cd-e1e2-48de-bfe5-a1042b012ba6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:45.620196 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1477c0cd-e1e2-48de-bfe5-a1042b012ba6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:45.627517 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1477c0cd-e1e2-48de-bfe5-a1042b012ba6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:45.627517 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1477c0cd-e1e2-48de-bfe5-a1042b012ba6 None None] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:45.627517 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1477c0cd-e1e2-48de-bfe5-a1042b012ba6 None None] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:45.636495 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1477c0cd-e1e2-48de-bfe5-a1042b012ba6 None None] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:45.665274 n-d-master-1 devstack@n-api.service[121102]: INFO nova.compute.rpcapi [None req-1477c0cd-e1e2-48de-bfe5-a1042b012ba6 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 30 01:13:45.667993 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1477c0cd-e1e2-48de-bfe5-a1042b012ba6 None None] Releasing lock "compute-rpcapi-router" {{(pid=121102) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 30 01:13:45.714849 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1477c0cd-e1e2-48de-bfe5-a1042b012ba6 None None] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.272683 Oct 30 01:13:45.716261 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 31/77] 10.222.0.13 () {58 vars in 1173 bytes} [Sun Oct 30 01:13:45 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:13:46.023700 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8a7608e5-bd3e-4b13-9c24-37fcd7427e25 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:46.024379 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8a7608e5-bd3e-4b13-9c24-37fcd7427e25 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] [instance: ba2968b1-c8ef-4ec2-9d98-66da2c62919b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:46.080379 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8a7608e5-bd3e-4b13-9c24-37fcd7427e25 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:46.082010 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8a7608e5-bd3e-4b13-9c24-37fcd7427e25 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:46.111558 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8a7608e5-bd3e-4b13-9c24-37fcd7427e25 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:46.116275 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8a7608e5-bd3e-4b13-9c24-37fcd7427e25 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:46.117825 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8a7608e5-bd3e-4b13-9c24-37fcd7427e25 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:46.119779 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8a7608e5-bd3e-4b13-9c24-37fcd7427e25 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:47.400289 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8a7608e5-bd3e-4b13-9c24-37fcd7427e25 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9211a459e946c1a114983c531a8897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6543b666064cd78c02ec5a471d003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:47.411455 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8a7608e5-bd3e-4b13-9c24-37fcd7427e25 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] 10.222.0.13 "GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b" status: 200 len: 1338 microversion: 2.1 time: 1.394552 Oct 30 01:13:47.426567 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 47/78] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:46 2022] GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b => generated 1338 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:48.449963 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4df9c653-0197-424b-8ad4-fec6e970efea tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:48.451406 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4df9c653-0197-424b-8ad4-fec6e970efea tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] [instance: ba2968b1-c8ef-4ec2-9d98-66da2c62919b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:48.456608 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=10 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:48.485914 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4df9c653-0197-424b-8ad4-fec6e970efea tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:48.486392 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4df9c653-0197-424b-8ad4-fec6e970efea tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:48.489299 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4df9c653-0197-424b-8ad4-fec6e970efea tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:48.492177 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4df9c653-0197-424b-8ad4-fec6e970efea tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:48.507060 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4df9c653-0197-424b-8ad4-fec6e970efea tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:48.507060 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4df9c653-0197-424b-8ad4-fec6e970efea tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:49.146444 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4df9c653-0197-424b-8ad4-fec6e970efea tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9211a459e946c1a114983c531a8897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6543b666064cd78c02ec5a471d003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:49.155633 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4df9c653-0197-424b-8ad4-fec6e970efea tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] 10.222.0.13 "GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b" status: 200 len: 1338 microversion: 2.1 time: 0.711022 Oct 30 01:13:49.173780 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 32/79] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:48 2022] GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b => generated 1338 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:50.190439 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2a2e2b4a-276a-4027-9143-3ece155bfe94 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:50.191617 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2a2e2b4a-276a-4027-9143-3ece155bfe94 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] [instance: ba2968b1-c8ef-4ec2-9d98-66da2c62919b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:50.207458 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a2e2b4a-276a-4027-9143-3ece155bfe94 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:50.208621 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a2e2b4a-276a-4027-9143-3ece155bfe94 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:50.209071 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a2e2b4a-276a-4027-9143-3ece155bfe94 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:50.212776 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a2e2b4a-276a-4027-9143-3ece155bfe94 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:50.213916 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a2e2b4a-276a-4027-9143-3ece155bfe94 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:50.216254 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a2e2b4a-276a-4027-9143-3ece155bfe94 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:50.281618 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:50.513221 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2a2e2b4a-276a-4027-9143-3ece155bfe94 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9211a459e946c1a114983c531a8897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6543b666064cd78c02ec5a471d003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:50.523921 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2a2e2b4a-276a-4027-9143-3ece155bfe94 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] 10.222.0.13 "GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b" status: 200 len: 1338 microversion: 2.1 time: 0.338858 Oct 30 01:13:50.527440 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 33/80] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:50 2022] GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b => generated 1338 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:50.730158 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-82f93a5e-90f2-4125-a45f-687f728550a8 req-9c33f409-e990-4843-8c67-f28bcea767cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba2968b1-c8ef-4ec2-9d98-66da2c62919b", "tag": "7c42110b-29c3-4585-a867-a3e633a2c945"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:13:50.787102 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-82f93a5e-90f2-4125-a45f-687f728550a8 req-9c33f409-e990-4843-8c67-f28bcea767cf service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:50.791218 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-82f93a5e-90f2-4125-a45f-687f728550a8 req-9c33f409-e990-4843-8c67-f28bcea767cf service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:50.791937 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-82f93a5e-90f2-4125-a45f-687f728550a8 req-9c33f409-e990-4843-8c67-f28bcea767cf service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:50.848225 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-82f93a5e-90f2-4125-a45f-687f728550a8 req-9c33f409-e990-4843-8c67-f28bcea767cf service nova] Creating event network-changed:7c42110b-29c3-4585-a867-a3e633a2c945 for instance ba2968b1-c8ef-4ec2-9d98-66da2c62919b on n-h1-master-1 Oct 30 01:13:50.851384 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-82f93a5e-90f2-4125-a45f-687f728550a8 req-9c33f409-e990-4843-8c67-f28bcea767cf service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121103) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 30 01:13:50.853238 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-82f93a5e-90f2-4125-a45f-687f728550a8 req-9c33f409-e990-4843-8c67-f28bcea767cf service nova] Acquired lock "compute-rpcapi-router" {{(pid=121103) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 30 01:13:50.854640 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5c335969-be61-4f5c-8967-892bcf9a3612 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:50.857018 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5c335969-be61-4f5c-8967-892bcf9a3612 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:50.861161 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5c335969-be61-4f5c-8967-892bcf9a3612 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:50.864529 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5c335969-be61-4f5c-8967-892bcf9a3612 None None] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:50.864993 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5c335969-be61-4f5c-8967-892bcf9a3612 None None] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:50.869571 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5c335969-be61-4f5c-8967-892bcf9a3612 None None] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:50.897578 n-d-master-1 devstack@n-api.service[121103]: INFO nova.compute.rpcapi [None req-5c335969-be61-4f5c-8967-892bcf9a3612 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 30 01:13:50.898724 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5c335969-be61-4f5c-8967-892bcf9a3612 None None] Releasing lock "compute-rpcapi-router" {{(pid=121103) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 30 01:13:50.935017 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5c335969-be61-4f5c-8967-892bcf9a3612 None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.000467 Oct 30 01:13:50.936093 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 48/81] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:13:51.552710 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9c60ea66-b2ec-4ab1-b04d-f7c93dda088e tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:51.553430 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9c60ea66-b2ec-4ab1-b04d-f7c93dda088e tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] [instance: ba2968b1-c8ef-4ec2-9d98-66da2c62919b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:51.567654 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9c60ea66-b2ec-4ab1-b04d-f7c93dda088e tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:51.568156 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9c60ea66-b2ec-4ab1-b04d-f7c93dda088e tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:51.568601 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9c60ea66-b2ec-4ab1-b04d-f7c93dda088e tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:51.569322 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9c60ea66-b2ec-4ab1-b04d-f7c93dda088e tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:51.569809 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9c60ea66-b2ec-4ab1-b04d-f7c93dda088e tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:51.570245 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9c60ea66-b2ec-4ab1-b04d-f7c93dda088e tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:51.850660 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9c60ea66-b2ec-4ab1-b04d-f7c93dda088e tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9211a459e946c1a114983c531a8897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6543b666064cd78c02ec5a471d003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:51.865114 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9c60ea66-b2ec-4ab1-b04d-f7c93dda088e tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] 10.222.0.13 "GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b" status: 200 len: 1338 microversion: 2.1 time: 0.316760 Oct 30 01:13:51.866087 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 34/82] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:51 2022] GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b => generated 1338 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:52.892266 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-332f2594-0405-4a9e-8e01-5916f432e2e5 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:52.894181 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-332f2594-0405-4a9e-8e01-5916f432e2e5 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] [instance: ba2968b1-c8ef-4ec2-9d98-66da2c62919b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:52.916839 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-332f2594-0405-4a9e-8e01-5916f432e2e5 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:52.922187 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-332f2594-0405-4a9e-8e01-5916f432e2e5 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:52.923051 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-332f2594-0405-4a9e-8e01-5916f432e2e5 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:52.925520 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-332f2594-0405-4a9e-8e01-5916f432e2e5 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:52.927308 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-332f2594-0405-4a9e-8e01-5916f432e2e5 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:52.928687 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-332f2594-0405-4a9e-8e01-5916f432e2e5 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:53.131447 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-332f2594-0405-4a9e-8e01-5916f432e2e5 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9211a459e946c1a114983c531a8897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6543b666064cd78c02ec5a471d003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:53.147837 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-332f2594-0405-4a9e-8e01-5916f432e2e5 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] 10.222.0.13 "GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b" status: 200 len: 1338 microversion: 2.1 time: 0.263100 Oct 30 01:13:53.163236 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 49/83] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:52 2022] GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b => generated 1338 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:54.172860 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7bc3f53e-df6d-427c-995b-1f7e30a1075d tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:54.173814 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7bc3f53e-df6d-427c-995b-1f7e30a1075d tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] [instance: ba2968b1-c8ef-4ec2-9d98-66da2c62919b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:54.193090 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7bc3f53e-df6d-427c-995b-1f7e30a1075d tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:54.198040 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7bc3f53e-df6d-427c-995b-1f7e30a1075d tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:54.199583 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7bc3f53e-df6d-427c-995b-1f7e30a1075d tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:54.200618 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7bc3f53e-df6d-427c-995b-1f7e30a1075d tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:54.206204 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7bc3f53e-df6d-427c-995b-1f7e30a1075d tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:54.207515 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7bc3f53e-df6d-427c-995b-1f7e30a1075d tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:54.939223 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7bc3f53e-df6d-427c-995b-1f7e30a1075d tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9211a459e946c1a114983c531a8897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6543b666064cd78c02ec5a471d003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:54.955095 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7bc3f53e-df6d-427c-995b-1f7e30a1075d tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] 10.222.0.13 "GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b" status: 200 len: 1338 microversion: 2.1 time: 0.783969 Oct 30 01:13:54.968906 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 35/84] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:54 2022] GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b => generated 1338 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:55.762093 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-332f2594-0405-4a9e-8e01-5916f432e2e5 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:55.763954 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-332f2594-0405-4a9e-8e01-5916f432e2e5 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] 10.222.0.13 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002214 Oct 30 01:13:55.764797 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 50/85] 10.222.0.13 () {56 vars in 886 bytes} [Sun Oct 30 01:13:55 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 30 01:13:55.977268 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-64299c3c-2804-4648-bae6-a290b7403ef9 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:55.978619 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-64299c3c-2804-4648-bae6-a290b7403ef9 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] [instance: ba2968b1-c8ef-4ec2-9d98-66da2c62919b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:55.996926 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=10 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:56.009399 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-64299c3c-2804-4648-bae6-a290b7403ef9 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:56.010327 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-64299c3c-2804-4648-bae6-a290b7403ef9 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:56.018229 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-64299c3c-2804-4648-bae6-a290b7403ef9 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:56.019382 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-64299c3c-2804-4648-bae6-a290b7403ef9 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:56.020023 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-64299c3c-2804-4648-bae6-a290b7403ef9 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:56.021385 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-64299c3c-2804-4648-bae6-a290b7403ef9 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:56.387008 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-64299c3c-2804-4648-bae6-a290b7403ef9 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9211a459e946c1a114983c531a8897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6543b666064cd78c02ec5a471d003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:56.416943 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-64299c3c-2804-4648-bae6-a290b7403ef9 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] 10.222.0.13 "GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b" status: 200 len: 1338 microversion: 2.1 time: 0.441192 Oct 30 01:13:56.424113 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 36/86] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:55 2022] GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b => generated 1338 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:57.455069 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f174fca5-63ed-4087-b81b-5047fde4a345 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:57.455770 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f174fca5-63ed-4087-b81b-5047fde4a345 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] [instance: ba2968b1-c8ef-4ec2-9d98-66da2c62919b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:57.470709 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f174fca5-63ed-4087-b81b-5047fde4a345 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:57.471212 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f174fca5-63ed-4087-b81b-5047fde4a345 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:57.472169 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f174fca5-63ed-4087-b81b-5047fde4a345 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:57.484659 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f174fca5-63ed-4087-b81b-5047fde4a345 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:57.488775 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f174fca5-63ed-4087-b81b-5047fde4a345 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:57.490311 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f174fca5-63ed-4087-b81b-5047fde4a345 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:58.391850 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f174fca5-63ed-4087-b81b-5047fde4a345 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9211a459e946c1a114983c531a8897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6543b666064cd78c02ec5a471d003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:58.411179 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f174fca5-63ed-4087-b81b-5047fde4a345 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] 10.222.0.13 "GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b" status: 200 len: 1338 microversion: 2.1 time: 0.966921 Oct 30 01:13:58.412454 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 51/87] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:57 2022] GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b => generated 1338 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:58.890423 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8b88bb3a-d538-4756-a028-bdcc514204af tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540 tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1001675410", "ram": 512, "vcpus": 1, "disk": 10, "id": 1087526992, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:13:59.014523 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8b88bb3a-d538-4756-a028-bdcc514204af tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540 tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.990711 Oct 30 01:13:59.015140 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 37/88] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:13:58 2022] POST /compute/v2.1/flavors => generated 416 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:13:59.438968 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-60741b61-be25-4709-8e02-dc1017b205ea tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:59.439591 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-60741b61-be25-4709-8e02-dc1017b205ea tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] [instance: ba2968b1-c8ef-4ec2-9d98-66da2c62919b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:59.458350 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-60741b61-be25-4709-8e02-dc1017b205ea tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:59.467046 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-60741b61-be25-4709-8e02-dc1017b205ea tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:59.467046 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-60741b61-be25-4709-8e02-dc1017b205ea tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:59.467696 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-60741b61-be25-4709-8e02-dc1017b205ea tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:59.470274 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-60741b61-be25-4709-8e02-dc1017b205ea tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:59.470758 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-60741b61-be25-4709-8e02-dc1017b205ea tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:59.484694 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=89 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:59.554728 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7228b53e-4957-46f6-82ae-d22a03b7245e tempest-FlavorsExtraSpecsNegativeTestJSON-556271446 tempest-FlavorsExtraSpecsNegativeTestJSON-556271446-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:59.621852 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-7228b53e-4957-46f6-82ae-d22a03b7245e tempest-FlavorsExtraSpecsNegativeTestJSON-556271446 tempest-FlavorsExtraSpecsNegativeTestJSON-556271446-project] HTTP exception thrown: Flavor 1087526992 has no extra specs with key hw:cpu_thread_policy. Oct 30 01:13:59.624262 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7228b53e-4957-46f6-82ae-d22a03b7245e tempest-FlavorsExtraSpecsNegativeTestJSON-556271446 tempest-FlavorsExtraSpecsNegativeTestJSON-556271446-project] Request method failure captured: Oct 30 01:13:59.624262 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/flavors/1087526992/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 30 01:13:59.624262 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:13:59.624262 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:13:59.624262 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:13:59.624262 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:13:59.624262 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:13:59.624262 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:13:59.624262 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:13:59.624262 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:13:59.624262 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXc_S4gR6d5yh7hOQ5nmAoI9xxw_CzC7sPEKlZ9bfYLEpsL20bKyg5GqevrY8eV7csYrFy5i-NttDaJyT-hTshEOSDvwzR5oS-TvjAJdjHmjG_sJTog0cMce0PKGpvQJl_Z3FubWeou2GG1tl_tU3btu6cz5OQjEmB_xDwDEg6v3ekaw Oct 30 01:13:59.624262 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:13:59.624262 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:13:59.624262 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:13:59.624262 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:13:59.624262 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:13:59.624262 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:13:59.624262 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 2aad025de45d418183825f27941e622a Oct 30 01:13:59.624262 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-556271446 Oct 30 01:13:59.624262 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:13:59.624262 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:13:59.625489 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2aad025de45d418183825f27941e622a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2aad025de45d418183825f27941e622a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2aad025de45d418183825f27941e622a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2aad025de45d418183825f27941e622a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:13:59.625489 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-556271446 Oct 30 01:13:59.625489 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 2aad025de45d418183825f27941e622a Oct 30 01:13:59.625489 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-556271446 Oct 30 01:13:59.625489 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-556271446-project Oct 30 01:13:59.625489 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:13:59.625489 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:13:59.625489 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 550f5106963b4d97a9effec784ee155d Oct 30 01:13:59.625489 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-556271446-project Oct 30 01:13:59.625489 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:13:59.625489 n-d-master-1 devstack@n-api.service[121103]: exception: Flavor 1087526992 has no extra specs with key hw:cpu_thread_policy. Oct 30 01:13:59.626096 n-d-master-1 devstack@n-api.service[121103]: action_args: {'flavor_id': '1087526992', 'id': 'hw:cpu_thread_policy'} Oct 30 01:13:59.626096 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:13:59.626096 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:13:59.626096 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 30 01:13:59.626096 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 30 01:13:59.626096 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 30 01:13:59.626096 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:13:59.626096 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:13:59.626096 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:13:59.626096 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:13:59.626096 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:13:59.626096 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:13:59.626096 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:13:59.626096 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:13:59.626096 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:13:59.626096 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:13:59.626096 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 30 01:13:59.626096 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 30 01:13:59.626096 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1087526992 has no extra specs with key hw:cpu_thread_policy. Oct 30 01:13:59.626096 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:13:59.626096 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:13:59.626096 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:13:59.627321 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:13:59.627321 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:13:59.627321 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:13:59.627321 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:13:59.627321 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:13:59.627321 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1087526992 has no extra specs with key hw:cpu_thread_policy. Oct 30 01:13:59.627321 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:13:59.629235 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7228b53e-4957-46f6-82ae-d22a03b7245e tempest-FlavorsExtraSpecsNegativeTestJSON-556271446 tempest-FlavorsExtraSpecsNegativeTestJSON-556271446-project] Returning 404 to user: Flavor 1087526992 has no extra specs with key hw:cpu_thread_policy. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:13:59.631286 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7228b53e-4957-46f6-82ae-d22a03b7245e tempest-FlavorsExtraSpecsNegativeTestJSON-556271446 tempest-FlavorsExtraSpecsNegativeTestJSON-556271446-project] 10.222.0.13 "GET /compute/v2.1/flavors/1087526992/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.606454 Oct 30 01:13:59.638094 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 52/89] 10.222.0.13 () {58 vars in 1266 bytes} [Sun Oct 30 01:13:59 2022] GET /compute/v2.1/flavors/1087526992/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 614 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:13:59.645621 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7e25bf3c-dcd4-4eed-b956-47ac7d627461 tempest-FlavorsExtraSpecsNegativeTestJSON-556271446 tempest-FlavorsExtraSpecsNegativeTestJSON-556271446-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:13:59.660454 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7e25bf3c-dcd4-4eed-b956-47ac7d627461 tempest-FlavorsExtraSpecsNegativeTestJSON-556271446 tempest-FlavorsExtraSpecsNegativeTestJSON-556271446-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '550f5106963b4d97a9effec784ee155d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aad025de45d418183825f27941e622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:59.664479 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7e25bf3c-dcd4-4eed-b956-47ac7d627461 tempest-FlavorsExtraSpecsNegativeTestJSON-556271446 tempest-FlavorsExtraSpecsNegativeTestJSON-556271446-project] Request method failure captured: Oct 30 01:13:59.664479 n-d-master-1 devstack@n-api.service[121103]: request: POST /compute/v2.1/flavors/1087526992/os-extra_specs HTTP/1.1 Oct 30 01:13:59.664479 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:13:59.664479 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:13:59.664479 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:13:59.664479 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 66 Oct 30 01:13:59.664479 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:13:59.664479 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:13:59.664479 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:13:59.664479 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:13:59.664479 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXc_S4gR6d5yh7hOQ5nmAoI9xxw_CzC7sPEKlZ9bfYLEpsL20bKyg5GqevrY8eV7csYrFy5i-NttDaJyT-hTshEOSDvwzR5oS-TvjAJdjHmjG_sJTog0cMce0PKGpvQJl_Z3FubWeou2GG1tl_tU3btu6cz5OQjEmB_xDwDEg6v3ekaw Oct 30 01:13:59.664479 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:13:59.664479 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:13:59.664479 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:13:59.664479 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:13:59.664479 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:13:59.664479 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:13:59.664479 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 2aad025de45d418183825f27941e622a Oct 30 01:13:59.664479 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-556271446 Oct 30 01:13:59.664479 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:13:59.664479 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:13:59.665748 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2aad025de45d418183825f27941e622a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2aad025de45d418183825f27941e622a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2aad025de45d418183825f27941e622a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2aad025de45d418183825f27941e622a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:13:59.665748 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-556271446 Oct 30 01:13:59.665748 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 2aad025de45d418183825f27941e622a Oct 30 01:13:59.665748 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-556271446 Oct 30 01:13:59.665748 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-556271446-project Oct 30 01:13:59.665748 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:13:59.665748 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:13:59.665748 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 550f5106963b4d97a9effec784ee155d Oct 30 01:13:59.665748 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-556271446-project Oct 30 01:13:59.665748 n-d-master-1 devstack@n-api.service[121103]: Oct 30 01:13:59.665748 n-d-master-1 devstack@n-api.service[121103]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 30 01:13:59.665748 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:13:59.666482 n-d-master-1 devstack@n-api.service[121103]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 30 01:13:59.666482 n-d-master-1 devstack@n-api.service[121103]: action_args: {'flavor_id': '1087526992', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 30 01:13:59.666482 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:13:59.666482 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:13:59.666482 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:13:59.666482 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:13:59.666482 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:13:59.666482 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:13:59.666482 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:13:59.666482 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:13:59.666482 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:13:59.666482 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:13:59.666482 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 30 01:13:59.666482 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 30 01:13:59.666482 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 30 01:13:59.666482 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 30 01:13:59.666482 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 30 01:13:59.666482 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 30 01:13:59.666482 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 01:13:59.667448 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 30 01:13:59.667448 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 01:13:59.667448 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise self.value Oct 30 01:13:59.667448 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 30 01:13:59.667448 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 30 01:13:59.667448 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 30 01:13:59.667448 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 30 01:13:59.667448 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 30 01:13:59.667448 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 30 01:13:59.667448 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 30 01:13:59.667448 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:13:59.667448 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:13:59.667448 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:13:59.667448 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:13:59.667448 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:13:59.667448 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:13:59.667448 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 30 01:13:59.667448 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 30 01:13:59.667448 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 30 01:13:59.667448 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:13:59.672026 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7e25bf3c-dcd4-4eed-b956-47ac7d627461 tempest-FlavorsExtraSpecsNegativeTestJSON-556271446 tempest-FlavorsExtraSpecsNegativeTestJSON-556271446-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:13:59.673293 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7e25bf3c-dcd4-4eed-b956-47ac7d627461 tempest-FlavorsExtraSpecsNegativeTestJSON-556271446 tempest-FlavorsExtraSpecsNegativeTestJSON-556271446-project] 10.222.0.13 "POST /compute/v2.1/flavors/1087526992/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.033732 Oct 30 01:13:59.679155 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 53/90] 10.222.0.13 () {60 vars in 1224 bytes} [Sun Oct 30 01:13:59 2022] POST /compute/v2.1/flavors/1087526992/os-extra_specs => generated 124 bytes in 40 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:13:59.685915 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7c20adf5-d5c8-4993-afdc-61f281acc65d tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540 tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:13:59.733929 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:DELETE=11,nova_api:SELECT=84,nova_api:INSERT=4,nova_api:SAVEPOINT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:59.807294 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7c20adf5-d5c8-4993-afdc-61f281acc65d tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540 tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/1087526992/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.126322 Oct 30 01:13:59.814062 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 54/91] 10.222.0.13 () {60 vars in 1224 bytes} [Sun Oct 30 01:13:59 2022] POST /compute/v2.1/flavors/1087526992/os-extra_specs => generated 66 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:13:59.831710 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-41112d0a-9562-438b-9e20-95d99c685a8d tempest-FlavorsExtraSpecsNegativeTestJSON-556271446 tempest-FlavorsExtraSpecsNegativeTestJSON-556271446-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:59.832543 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-41112d0a-9562-438b-9e20-95d99c685a8d tempest-FlavorsExtraSpecsNegativeTestJSON-556271446 tempest-FlavorsExtraSpecsNegativeTestJSON-556271446-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '550f5106963b4d97a9effec784ee155d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aad025de45d418183825f27941e622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:59.835911 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-41112d0a-9562-438b-9e20-95d99c685a8d tempest-FlavorsExtraSpecsNegativeTestJSON-556271446 tempest-FlavorsExtraSpecsNegativeTestJSON-556271446-project] Request method failure captured: Oct 30 01:13:59.835911 n-d-master-1 devstack@n-api.service[121103]: request: DELETE /compute/v2.1/flavors/1087526992/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 30 01:13:59.835911 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:13:59.835911 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:13:59.835911 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:13:59.835911 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:13:59.835911 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:13:59.835911 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:13:59.835911 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:13:59.835911 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:13:59.835911 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXc_S4gR6d5yh7hOQ5nmAoI9xxw_CzC7sPEKlZ9bfYLEpsL20bKyg5GqevrY8eV7csYrFy5i-NttDaJyT-hTshEOSDvwzR5oS-TvjAJdjHmjG_sJTog0cMce0PKGpvQJl_Z3FubWeou2GG1tl_tU3btu6cz5OQjEmB_xDwDEg6v3ekaw Oct 30 01:13:59.835911 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:13:59.835911 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:13:59.835911 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:13:59.835911 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:13:59.835911 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:13:59.835911 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:13:59.835911 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 2aad025de45d418183825f27941e622a Oct 30 01:13:59.835911 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-556271446 Oct 30 01:13:59.835911 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:13:59.835911 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:13:59.837119 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2aad025de45d418183825f27941e622a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2aad025de45d418183825f27941e622a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2aad025de45d418183825f27941e622a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2aad025de45d418183825f27941e622a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:13:59.837119 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-556271446 Oct 30 01:13:59.837119 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 2aad025de45d418183825f27941e622a Oct 30 01:13:59.837119 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-556271446 Oct 30 01:13:59.837119 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-556271446-project Oct 30 01:13:59.837119 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:13:59.837119 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:13:59.837119 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 550f5106963b4d97a9effec784ee155d Oct 30 01:13:59.837119 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-556271446-project Oct 30 01:13:59.837119 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:13:59.837119 n-d-master-1 devstack@n-api.service[121103]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 30 01:13:59.837813 n-d-master-1 devstack@n-api.service[121103]: action_args: {'flavor_id': '1087526992', 'id': 'hw:numa_nodes'} Oct 30 01:13:59.837813 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:13:59.837813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:13:59.837813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:13:59.837813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:13:59.837813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:13:59.837813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:13:59.837813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:13:59.837813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:13:59.837813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 30 01:13:59.837813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 30 01:13:59.837813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 30 01:13:59.837813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 30 01:13:59.837813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 30 01:13:59.837813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 30 01:13:59.837813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 01:13:59.837813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 30 01:13:59.837813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 01:13:59.837813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise self.value Oct 30 01:13:59.837813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 30 01:13:59.838843 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 30 01:13:59.838843 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 30 01:13:59.838843 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 30 01:13:59.838843 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 30 01:13:59.838843 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 30 01:13:59.838843 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 30 01:13:59.838843 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:13:59.838843 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:13:59.838843 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:13:59.838843 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:13:59.838843 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:13:59.838843 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:13:59.838843 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 30 01:13:59.838843 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 30 01:13:59.838843 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 30 01:13:59.838843 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:13:59.841681 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-41112d0a-9562-438b-9e20-95d99c685a8d tempest-FlavorsExtraSpecsNegativeTestJSON-556271446 tempest-FlavorsExtraSpecsNegativeTestJSON-556271446-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:13:59.843057 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-41112d0a-9562-438b-9e20-95d99c685a8d tempest-FlavorsExtraSpecsNegativeTestJSON-556271446 tempest-FlavorsExtraSpecsNegativeTestJSON-556271446-project] 10.222.0.13 "DELETE /compute/v2.1/flavors/1087526992/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.027220 Oct 30 01:13:59.850609 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 55/92] 10.222.0.13 () {58 vars in 1248 bytes} [Sun Oct 30 01:13:59 2022] DELETE /compute/v2.1/flavors/1087526992/os-extra_specs/hw:numa_nodes => generated 124 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:13:59.865407 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-81c16066-655f-4b50-b050-a46d9b48b52c tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540 tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:13:59.901084 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-81c16066-655f-4b50-b050-a46d9b48b52c tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540 tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/1087526992/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.048588 Oct 30 01:13:59.907406 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 56/93] 10.222.0.13 () {60 vars in 1224 bytes} [Sun Oct 30 01:13:59 2022] POST /compute/v2.1/flavors/1087526992/os-extra_specs => generated 66 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:14:00.232047 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-60741b61-be25-4709-8e02-dc1017b205ea tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9211a459e946c1a114983c531a8897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6543b666064cd78c02ec5a471d003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:00.245510 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-60741b61-be25-4709-8e02-dc1017b205ea tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] 10.222.0.13 "GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b" status: 200 len: 1338 microversion: 2.1 time: 0.813041 Oct 30 01:14:00.250975 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 38/94] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:59 2022] GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b => generated 1338 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:00.265830 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8d24a86d-3229-4e28-98c6-1f7b7b553d4c tempest-FlavorsExtraSpecsNegativeTestJSON-556271446 tempest-FlavorsExtraSpecsNegativeTestJSON-556271446-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:00.273598 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8d24a86d-3229-4e28-98c6-1f7b7b553d4c tempest-FlavorsExtraSpecsNegativeTestJSON-556271446 tempest-FlavorsExtraSpecsNegativeTestJSON-556271446-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '550f5106963b4d97a9effec784ee155d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aad025de45d418183825f27941e622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:00.285058 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8d24a86d-3229-4e28-98c6-1f7b7b553d4c tempest-FlavorsExtraSpecsNegativeTestJSON-556271446 tempest-FlavorsExtraSpecsNegativeTestJSON-556271446-project] Request method failure captured: Oct 30 01:14:00.285058 n-d-master-1 devstack@n-api.service[121102]: request: PUT /compute/v2.1/flavors/1087526992/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 30 01:14:00.285058 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:14:00.285058 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:14:00.285058 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:14:00.285058 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 22 Oct 30 01:14:00.285058 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:14:00.285058 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:14:00.285058 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:14:00.285058 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:14:00.285058 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXc_S4gR6d5yh7hOQ5nmAoI9xxw_CzC7sPEKlZ9bfYLEpsL20bKyg5GqevrY8eV7csYrFy5i-NttDaJyT-hTshEOSDvwzR5oS-TvjAJdjHmjG_sJTog0cMce0PKGpvQJl_Z3FubWeou2GG1tl_tU3btu6cz5OQjEmB_xDwDEg6v3ekaw Oct 30 01:14:00.285058 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:14:00.285058 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:14:00.285058 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:14:00.285058 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:14:00.285058 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:14:00.285058 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:14:00.285058 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 2aad025de45d418183825f27941e622a Oct 30 01:14:00.285058 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-556271446 Oct 30 01:14:00.285058 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:14:00.285058 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:14:00.286517 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2aad025de45d418183825f27941e622a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2aad025de45d418183825f27941e622a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2aad025de45d418183825f27941e622a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2aad025de45d418183825f27941e622a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:14:00.286517 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-556271446 Oct 30 01:14:00.286517 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 2aad025de45d418183825f27941e622a Oct 30 01:14:00.286517 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-556271446 Oct 30 01:14:00.286517 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-556271446-project Oct 30 01:14:00.286517 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:14:00.286517 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:14:00.286517 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 550f5106963b4d97a9effec784ee155d Oct 30 01:14:00.286517 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-556271446-project Oct 30 01:14:00.286517 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:14:00.286517 n-d-master-1 devstack@n-api.service[121102]: {"hw:numa_nodes": "1"} Oct 30 01:14:00.286517 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:14:00.286517 n-d-master-1 devstack@n-api.service[121102]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 30 01:14:00.287366 n-d-master-1 devstack@n-api.service[121102]: action_args: {'flavor_id': '1087526992', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 30 01:14:00.287366 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:14:00.287366 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:00.287366 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:00.287366 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:00.287366 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:14:00.287366 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:14:00.287366 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:14:00.287366 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:14:00.287366 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:14:00.287366 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:14:00.287366 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 30 01:14:00.287366 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 30 01:14:00.287366 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 30 01:14:00.287366 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 30 01:14:00.287366 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 30 01:14:00.287366 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 30 01:14:00.287366 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 01:14:00.287366 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 30 01:14:00.288603 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 01:14:00.288603 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise self.value Oct 30 01:14:00.288603 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 30 01:14:00.288603 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 30 01:14:00.288603 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 30 01:14:00.288603 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 30 01:14:00.288603 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 30 01:14:00.288603 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 30 01:14:00.288603 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 30 01:14:00.288603 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:00.288603 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:00.288603 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:00.288603 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:00.288603 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:00.288603 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:00.288603 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 30 01:14:00.288603 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 30 01:14:00.288603 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 30 01:14:00.288603 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:00.289819 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8d24a86d-3229-4e28-98c6-1f7b7b553d4c tempest-FlavorsExtraSpecsNegativeTestJSON-556271446 tempest-FlavorsExtraSpecsNegativeTestJSON-556271446-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:14:00.289819 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8d24a86d-3229-4e28-98c6-1f7b7b553d4c tempest-FlavorsExtraSpecsNegativeTestJSON-556271446 tempest-FlavorsExtraSpecsNegativeTestJSON-556271446-project] 10.222.0.13 "PUT /compute/v2.1/flavors/1087526992/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.035684 Oct 30 01:14:00.293857 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 39/95] 10.222.0.13 () {60 vars in 1265 bytes} [Sun Oct 30 01:14:00 2022] PUT /compute/v2.1/flavors/1087526992/os-extra_specs/hw:numa_nodes => generated 124 bytes in 44 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:14:00.305206 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e4b6807b-be23-4b80-8276-a23e6cb5d39b tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540 tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:00.328456 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-e4b6807b-be23-4b80-8276-a23e6cb5d39b tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540 tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540-project-admin] HTTP exception thrown: Flavor 1087526992 has no extra specs with key hw:cpu_thread_policy. Oct 30 01:14:00.330520 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e4b6807b-be23-4b80-8276-a23e6cb5d39b tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540 tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540-project-admin] Request method failure captured: Oct 30 01:14:00.330520 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/flavors/1087526992/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 30 01:14:00.330520 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:14:00.330520 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:14:00.330520 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:14:00.330520 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:14:00.330520 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:14:00.330520 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:14:00.330520 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:14:00.330520 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:14:00.330520 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXc_VA26za-qrdQodpnRi5SCtu9j2mGoKXZHasCpZOTM4cdrPy9rj0mZpJP4CUulpZoZgoK69JxJeWjEJ83wFVFTBcUhVgH6p6W44ay6Dl3aCfl40cisNHHp9Z8YuHq2CTQw0G53WHCF0LSVorH5DhXKVCyZIdPEjpSb8M4kZi0pP_0I Oct 30 01:14:00.330520 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:14:00.330520 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:14:00.330520 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:14:00.330520 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:14:00.330520 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:14:00.330520 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:14:00.330520 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: ed039927d56a4fd282f80303e1b05002 Oct 30 01:14:00.330520 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540 Oct 30 01:14:00.330520 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,admin,reader Oct 30 01:14:00.330520 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,admin,reader Oct 30 01:14:00.342537 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ed039927d56a4fd282f80303e1b05002"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ed039927d56a4fd282f80303e1b05002"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ed039927d56a4fd282f80303e1b05002"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ed039927d56a4fd282f80303e1b05002"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:14:00.342537 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540 Oct 30 01:14:00.342537 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: ed039927d56a4fd282f80303e1b05002 Oct 30 01:14:00.342537 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540 Oct 30 01:14:00.342537 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540-project-admin Oct 30 01:14:00.342537 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:14:00.342537 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:14:00.342537 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: f1347abbbbbb4038ad3cf84c40e73a55 Oct 30 01:14:00.342537 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540-project-admin Oct 30 01:14:00.342537 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:14:00.342537 n-d-master-1 devstack@n-api.service[121102]: exception: Flavor 1087526992 has no extra specs with key hw:cpu_thread_policy. Oct 30 01:14:00.343705 n-d-master-1 devstack@n-api.service[121102]: action_args: {'flavor_id': '1087526992', 'id': 'hw:cpu_thread_policy'} Oct 30 01:14:00.343705 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:14:00.343705 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:00.343705 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 30 01:14:00.343705 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 30 01:14:00.343705 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 30 01:14:00.343705 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:00.343705 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:00.343705 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:00.343705 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:00.343705 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:00.343705 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:00.343705 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:14:00.343705 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:14:00.343705 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:14:00.343705 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:14:00.343705 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 30 01:14:00.343705 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 30 01:14:00.343705 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1087526992 has no extra specs with key hw:cpu_thread_policy. Oct 30 01:14:00.343705 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:00.343705 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:00.343705 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:00.344874 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:00.344874 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:00.344874 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:00.344874 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:14:00.344874 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:14:00.344874 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1087526992 has no extra specs with key hw:cpu_thread_policy. Oct 30 01:14:00.344874 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:00.344874 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e4b6807b-be23-4b80-8276-a23e6cb5d39b tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540 tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540-project-admin] Returning 404 to user: Flavor 1087526992 has no extra specs with key hw:cpu_thread_policy. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:14:00.344874 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e4b6807b-be23-4b80-8276-a23e6cb5d39b tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540 tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1087526992/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.035396 Oct 30 01:14:00.344874 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 40/96] 10.222.0.13 () {58 vars in 1269 bytes} [Sun Oct 30 01:14:00 2022] DELETE /compute/v2.1/flavors/1087526992/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:14:00.345433 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8a50f66b-8368-4a89-b1b7-7beeb7bea5d8 tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540 tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:00.352601 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-8a50f66b-8368-4a89-b1b7-7beeb7bea5d8 tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540 tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 30 01:14:00.354214 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8a50f66b-8368-4a89-b1b7-7beeb7bea5d8 tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540 tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540-project-admin] Request method failure captured: Oct 30 01:14:00.354214 n-d-master-1 devstack@n-api.service[121102]: request: PUT /compute/v2.1/flavors/1087526992/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 30 01:14:00.354214 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:14:00.354214 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:14:00.354214 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:14:00.354214 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 27 Oct 30 01:14:00.354214 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:14:00.354214 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:14:00.354214 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:14:00.354214 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:14:00.354214 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXc_VA26za-qrdQodpnRi5SCtu9j2mGoKXZHasCpZOTM4cdrPy9rj0mZpJP4CUulpZoZgoK69JxJeWjEJ83wFVFTBcUhVgH6p6W44ay6Dl3aCfl40cisNHHp9Z8YuHq2CTQw0G53WHCF0LSVorH5DhXKVCyZIdPEjpSb8M4kZi0pP_0I Oct 30 01:14:00.354214 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:14:00.354214 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:14:00.354214 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:14:00.354214 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:14:00.354214 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:14:00.354214 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:14:00.354214 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: ed039927d56a4fd282f80303e1b05002 Oct 30 01:14:00.354214 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540 Oct 30 01:14:00.354214 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,admin,reader Oct 30 01:14:00.354214 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,admin,reader Oct 30 01:14:00.355303 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ed039927d56a4fd282f80303e1b05002"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ed039927d56a4fd282f80303e1b05002"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ed039927d56a4fd282f80303e1b05002"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ed039927d56a4fd282f80303e1b05002"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:14:00.355303 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540 Oct 30 01:14:00.355303 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: ed039927d56a4fd282f80303e1b05002 Oct 30 01:14:00.355303 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540 Oct 30 01:14:00.355303 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540-project-admin Oct 30 01:14:00.355303 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:14:00.355303 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:14:00.355303 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: f1347abbbbbb4038ad3cf84c40e73a55 Oct 30 01:14:00.355303 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540-project-admin Oct 30 01:14:00.355303 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:14:00.355303 n-d-master-1 devstack@n-api.service[121102]: {"hw:cpu_policy": "shared"} Oct 30 01:14:00.355303 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:14:00.355303 n-d-master-1 devstack@n-api.service[121102]: exception: Request body and URI mismatch Oct 30 01:14:00.355962 n-d-master-1 devstack@n-api.service[121102]: action_args: {'flavor_id': '1087526992', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 30 01:14:00.355962 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:14:00.355962 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:00.355962 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:00.355962 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:00.355962 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:14:00.355962 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:14:00.355962 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:14:00.355962 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:14:00.355962 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:14:00.355962 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:14:00.355962 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 30 01:14:00.355962 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 30 01:14:00.355962 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 30 01:14:00.355962 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:00.355962 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:00.355962 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:00.355962 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:00.355962 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:00.355962 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:00.358877 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:14:00.358877 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:14:00.358877 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 30 01:14:00.358877 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:00.358877 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8a50f66b-8368-4a89-b1b7-7beeb7bea5d8 tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540 tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:14:00.358877 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8a50f66b-8368-4a89-b1b7-7beeb7bea5d8 tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540 tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540-project-admin] 10.222.0.13 "PUT /compute/v2.1/flavors/1087526992/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.016554 Oct 30 01:14:00.358877 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 41/97] 10.222.0.13 () {60 vars in 1265 bytes} [Sun Oct 30 01:14:00 2022] PUT /compute/v2.1/flavors/1087526992/os-extra_specs/hw:numa_nodes => generated 73 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 30 01:14:00.368439 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6b99a1c8-d312-404e-8a25-657ce1792595 tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540 tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:00.383782 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6b99a1c8-d312-404e-8a25-657ce1792595 tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540 tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540-project-admin] Request method failure captured: Oct 30 01:14:00.383782 n-d-master-1 devstack@n-api.service[121102]: request: PUT /compute/v2.1/flavors/1087526992/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 30 01:14:00.383782 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:14:00.383782 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:14:00.383782 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:14:00.383782 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 49 Oct 30 01:14:00.383782 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:14:00.383782 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:14:00.383782 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:14:00.383782 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:14:00.383782 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXc_VA26za-qrdQodpnRi5SCtu9j2mGoKXZHasCpZOTM4cdrPy9rj0mZpJP4CUulpZoZgoK69JxJeWjEJ83wFVFTBcUhVgH6p6W44ay6Dl3aCfl40cisNHHp9Z8YuHq2CTQw0G53WHCF0LSVorH5DhXKVCyZIdPEjpSb8M4kZi0pP_0I Oct 30 01:14:00.383782 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:14:00.383782 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:14:00.383782 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:14:00.383782 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:14:00.383782 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:14:00.383782 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:14:00.383782 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: ed039927d56a4fd282f80303e1b05002 Oct 30 01:14:00.383782 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540 Oct 30 01:14:00.383782 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,admin,reader Oct 30 01:14:00.383782 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,admin,reader Oct 30 01:14:00.385259 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ed039927d56a4fd282f80303e1b05002"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ed039927d56a4fd282f80303e1b05002"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ed039927d56a4fd282f80303e1b05002"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ed039927d56a4fd282f80303e1b05002"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:14:00.385259 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540 Oct 30 01:14:00.385259 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: ed039927d56a4fd282f80303e1b05002 Oct 30 01:14:00.385259 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540 Oct 30 01:14:00.385259 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540-project-admin Oct 30 01:14:00.385259 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:14:00.385259 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:14:00.385259 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: f1347abbbbbb4038ad3cf84c40e73a55 Oct 30 01:14:00.385259 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540-project-admin Oct 30 01:14:00.385259 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:14:00.385259 n-d-master-1 devstack@n-api.service[121102]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 30 01:14:00.385259 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:14:00.386307 n-d-master-1 devstack@n-api.service[121102]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 30 01:14:00.386307 n-d-master-1 devstack@n-api.service[121102]: action_args: {'flavor_id': '1087526992', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 30 01:14:00.386307 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:14:00.386307 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:00.386307 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 30 01:14:00.386307 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 30 01:14:00.386307 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 30 01:14:00.386307 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise error Oct 30 01:14:00.386307 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 30 01:14:00.386307 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:00.386307 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 30 01:14:00.386307 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 30 01:14:00.386307 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 30 01:14:00.386307 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 30 01:14:00.386307 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 30 01:14:00.386307 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 30 01:14:00.386307 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 30 01:14:00.386307 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 30 01:14:00.386307 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:00.386307 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi On instance: Oct 30 01:14:00.386307 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 30 01:14:00.386307 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:00.387478 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:00.387478 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:00.387478 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:00.387478 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:00.387478 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:00.387478 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:14:00.387478 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:14:00.387478 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:14:00.387478 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:14:00.387478 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 30 01:14:00.387478 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 30 01:14:00.387478 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 30 01:14:00.387478 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 30 01:14:00.387478 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 30 01:14:00.387478 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 30 01:14:00.387478 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 30 01:14:00.387478 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:00.387478 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:00.387478 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:00.387478 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:00.390009 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:00.390009 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:00.390009 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 30 01:14:00.390009 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 30 01:14:00.390009 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 30 01:14:00.390009 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:00.390009 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6b99a1c8-d312-404e-8a25-657ce1792595 tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540 tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:14:00.390009 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6b99a1c8-d312-404e-8a25-657ce1792595 tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540 tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540-project-admin] 10.222.0.13 "PUT /compute/v2.1/flavors/1087526992/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.022017 Oct 30 01:14:00.390009 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 42/98] 10.222.0.13 () {60 vars in 1265 bytes} [Sun Oct 30 01:14:00 2022] PUT /compute/v2.1/flavors/1087526992/os-extra_specs/hw:numa_nodes => generated 117 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:14:00.396520 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1c42efda-1422-497c-81a0-28a8eae945ba tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540 tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:00.540144 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1c42efda-1422-497c-81a0-28a8eae945ba tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540 tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1087526992" status: 202 len: 0 microversion: 2.1 time: 0.147799 Oct 30 01:14:00.541087 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 43/99] 10.222.0.13 () {58 vars in 1161 bytes} [Sun Oct 30 01:14:00 2022] DELETE /compute/v2.1/flavors/1087526992 => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 30 01:14:00.549444 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bc087ed2-1332-4167-819e-0a8d56e41d85 tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540 tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:00.589145 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a15873f7-b28a-451e-8900-e059e479c9b0 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-624311138", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:00.591859 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bc087ed2-1332-4167-819e-0a8d56e41d85 tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540 tempest-FlavorsExtraSpecsNegativeTestJSON-1022181540-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.045929 Oct 30 01:14:00.594031 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 44/100] 10.222.0.13 () {58 vars in 1146 bytes} [Sun Oct 30 01:14:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:14:00.728361 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-a15873f7-b28a-451e-8900-e059e479c9b0 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] validate_networks() for None {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:14:00.879368 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:01.048314 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-a15873f7-b28a-451e-8900-e059e479c9b0 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:14:01.049105 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-a15873f7-b28a-451e-8900-e059e479c9b0 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:14:01.050461 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-a15873f7-b28a-451e-8900-e059e479c9b0 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:14:01.051085 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-a15873f7-b28a-451e-8900-e059e479c9b0 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:14:01.051703 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-a15873f7-b28a-451e-8900-e059e479c9b0 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:14:01.089991 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a15873f7-b28a-451e-8900-e059e479c9b0 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:01.092332 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a15873f7-b28a-451e-8900-e059e479c9b0 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:01.095224 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a15873f7-b28a-451e-8900-e059e479c9b0 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:01.099422 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a15873f7-b28a-451e-8900-e059e479c9b0 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:01.100617 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a15873f7-b28a-451e-8900-e059e479c9b0 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:01.101070 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a15873f7-b28a-451e-8900-e059e479c9b0 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:01.190761 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-a15873f7-b28a-451e-8900-e059e479c9b0 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Getting quotas for project 72a83b0b15194aa69fc4d82876a1e6fd. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:14:01.198422 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-a15873f7-b28a-451e-8900-e059e479c9b0 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Getting quotas for user 464f9e9314154e3f9c779b9ae10b2a73 and project 72a83b0b15194aa69fc4d82876a1e6fd. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:14:01.219669 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a15873f7-b28a-451e-8900-e059e479c9b0 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:14:01.224794 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a15873f7-b28a-451e-8900-e059e479c9b0 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] [instance: ac13f3c4-a93f-4664-b102-aa57f9c63308] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:14:01.297425 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-90d3f5e4-170e-49d1-9b3a-6bd8b504d665 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:01.308980 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-90d3f5e4-170e-49d1-9b3a-6bd8b504d665 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.528232 Oct 30 01:14:01.312761 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 45/101] 10.222.0.13 () {58 vars in 1137 bytes} [Sun Oct 30 01:14:00 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:14:01.318812 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-32d88b47-0a55-4219-9aa7-bd6e45e385bb tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:01.319471 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-32d88b47-0a55-4219-9aa7-bd6e45e385bb tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] [instance: ba2968b1-c8ef-4ec2-9d98-66da2c62919b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:01.336060 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-32d88b47-0a55-4219-9aa7-bd6e45e385bb tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:01.336806 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-32d88b47-0a55-4219-9aa7-bd6e45e385bb tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:01.338022 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-32d88b47-0a55-4219-9aa7-bd6e45e385bb tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:01.338998 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-32d88b47-0a55-4219-9aa7-bd6e45e385bb tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:01.339719 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-32d88b47-0a55-4219-9aa7-bd6e45e385bb tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:01.340377 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-32d88b47-0a55-4219-9aa7-bd6e45e385bb tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:01.425486 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a15873f7-b28a-451e-8900-e059e479c9b0 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.516521 Oct 30 01:14:01.426499 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 57/102] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:13:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:14:01.832758 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-32d88b47-0a55-4219-9aa7-bd6e45e385bb tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9211a459e946c1a114983c531a8897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6543b666064cd78c02ec5a471d003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:01.847058 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-32d88b47-0a55-4219-9aa7-bd6e45e385bb tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] 10.222.0.13 "GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b" status: 200 len: 1338 microversion: 2.1 time: 0.528801 Oct 30 01:14:01.849580 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 46/103] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:01 2022] GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b => generated 1338 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:01.871054 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7c20afed-a476-4a07-acf3-6fddda6caa81 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:01.871988 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7c20afed-a476-4a07-acf3-6fddda6caa81 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] [instance: ac13f3c4-a93f-4664-b102-aa57f9c63308] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:02.153363 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7d24508c-3dcd-4622-8a1a-f23cf8e9075e tempest-ServersWithSpecificFlavorTestJSON-2035413001 tempest-ServersWithSpecificFlavorTestJSON-2035413001-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1902007554", "id": 1196629979, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:02.210209 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7c20afed-a476-4a07-acf3-6fddda6caa81 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464f9e9314154e3f9c779b9ae10b2a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a83b0b15194aa69fc4d82876a1e6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:02.220208 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7c20afed-a476-4a07-acf3-6fddda6caa81 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] 10.222.0.13 "GET /compute/v2.1/servers/ac13f3c4-a93f-4664-b102-aa57f9c63308" status: 200 len: 1218 microversion: 2.1 time: 0.367434 Oct 30 01:14:02.223781 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 47/104] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:01 2022] GET /compute/v2.1/servers/ac13f3c4-a93f-4664-b102-aa57f9c63308 => generated 1218 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:02.312306 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7d24508c-3dcd-4622-8a1a-f23cf8e9075e tempest-ServersWithSpecificFlavorTestJSON-2035413001 tempest-ServersWithSpecificFlavorTestJSON-2035413001-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.884643 Oct 30 01:14:02.313128 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 58/105] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:14:01 2022] POST /compute/v2.1/flavors => generated 425 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:02.325634 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4bd9f4de-ea55-4297-a239-3954de542bfd tempest-ServersWithSpecificFlavorTestJSON-2035413001 tempest-ServersWithSpecificFlavorTestJSON-2035413001-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:02.336951 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4bd9f4de-ea55-4297-a239-3954de542bfd tempest-ServersWithSpecificFlavorTestJSON-2035413001 tempest-ServersWithSpecificFlavorTestJSON-2035413001-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.014897 Oct 30 01:14:02.346407 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 59/106] 10.222.0.13 () {58 vars in 1182 bytes} [Sun Oct 30 01:14:02 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 30 01:14:02.355825 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5265b3b8-8a06-4ca3-acf8-ab1a73fe6f72 tempest-ServersWithSpecificFlavorTestJSON-2035413001 tempest-ServersWithSpecificFlavorTestJSON-2035413001-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1791763631", "id": 2127731727, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:02.429106 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c39f57cb-b01b-4b76-928f-69b0b8111fb1 tempest-HypervisorAdminV253TestBase-1465034784 tempest-HypervisorAdminV253TestBase-1465034784-project-admin] Calling method '.version_select at 0x7f44ccc40160>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:02.434251 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c39f57cb-b01b-4b76-928f-69b0b8111fb1 tempest-HypervisorAdminV253TestBase-1465034784 tempest-HypervisorAdminV253TestBase-1465034784-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:02.438408 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c39f57cb-b01b-4b76-928f-69b0b8111fb1 tempest-HypervisorAdminV253TestBase-1465034784 tempest-HypervisorAdminV253TestBase-1465034784-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:02.438408 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c39f57cb-b01b-4b76-928f-69b0b8111fb1 tempest-HypervisorAdminV253TestBase-1465034784 tempest-HypervisorAdminV253TestBase-1465034784-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:02.461549 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c39f57cb-b01b-4b76-928f-69b0b8111fb1 tempest-HypervisorAdminV253TestBase-1465034784 tempest-HypervisorAdminV253TestBase-1465034784-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:02.462284 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c39f57cb-b01b-4b76-928f-69b0b8111fb1 tempest-HypervisorAdminV253TestBase-1465034784 tempest-HypervisorAdminV253TestBase-1465034784-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:02.464304 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c39f57cb-b01b-4b76-928f-69b0b8111fb1 tempest-HypervisorAdminV253TestBase-1465034784 tempest-HypervisorAdminV253TestBase-1465034784-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:02.514642 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5265b3b8-8a06-4ca3-acf8-ab1a73fe6f72 tempest-ServersWithSpecificFlavorTestJSON-2035413001 tempest-ServersWithSpecificFlavorTestJSON-2035413001-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.165643 Oct 30 01:14:02.514884 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c39f57cb-b01b-4b76-928f-69b0b8111fb1 tempest-HypervisorAdminV253TestBase-1465034784 tempest-HypervisorAdminV253TestBase-1465034784-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:02.515416 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c39f57cb-b01b-4b76-928f-69b0b8111fb1 tempest-HypervisorAdminV253TestBase-1465034784 tempest-HypervisorAdminV253TestBase-1465034784-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:02.515523 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 60/107] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:14:02 2022] POST /compute/v2.1/flavors => generated 425 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:02.515687 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c39f57cb-b01b-4b76-928f-69b0b8111fb1 tempest-HypervisorAdminV253TestBase-1465034784 tempest-HypervisorAdminV253TestBase-1465034784-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:02.528586 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a63afe5b-6297-4577-92af-87539abf7dda tempest-ServersWithSpecificFlavorTestJSON-2035413001 tempest-ServersWithSpecificFlavorTestJSON-2035413001-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:02.544059 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c39f57cb-b01b-4b76-928f-69b0b8111fb1 tempest-HypervisorAdminV253TestBase-1465034784 tempest-HypervisorAdminV253TestBase-1465034784-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:02.544577 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c39f57cb-b01b-4b76-928f-69b0b8111fb1 tempest-HypervisorAdminV253TestBase-1465034784 tempest-HypervisorAdminV253TestBase-1465034784-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:02.545016 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c39f57cb-b01b-4b76-928f-69b0b8111fb1 tempest-HypervisorAdminV253TestBase-1465034784 tempest-HypervisorAdminV253TestBase-1465034784-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:02.550703 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a63afe5b-6297-4577-92af-87539abf7dda tempest-ServersWithSpecificFlavorTestJSON-2035413001 tempest-ServersWithSpecificFlavorTestJSON-2035413001-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.023985 Oct 30 01:14:02.554799 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 61/108] 10.222.0.13 () {58 vars in 1182 bytes} [Sun Oct 30 01:14:02 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:14:02.573194 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8eacc05f-c4d0-4ff2-8a46-1383f20acfbd tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Action: 'create', calling method: .version_select at 0x7f44cce54160>, body: {"keypair": {"name": "tempest-keypair-548259820", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGghmtBfhcaMl7Yei+Yu4njWjPgIUOZC14w9/ldZngo5VXbyVSfzIpV0vVpNg4bM2Pm0nSYowlWnQOKj4tVUirE8fONW+OIc0KzFczZWlwWQ02IAB9D5U/vYbGY0JIs+Q=="}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:02.576621 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c39f57cb-b01b-4b76-928f-69b0b8111fb1 tempest-HypervisorAdminV253TestBase-1465034784 tempest-HypervisorAdminV253TestBase-1465034784-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:02.577131 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c39f57cb-b01b-4b76-928f-69b0b8111fb1 tempest-HypervisorAdminV253TestBase-1465034784 tempest-HypervisorAdminV253TestBase-1465034784-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:02.580075 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c39f57cb-b01b-4b76-928f-69b0b8111fb1 tempest-HypervisorAdminV253TestBase-1465034784 tempest-HypervisorAdminV253TestBase-1465034784-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:02.597647 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c39f57cb-b01b-4b76-928f-69b0b8111fb1 tempest-HypervisorAdminV253TestBase-1465034784 tempest-HypervisorAdminV253TestBase-1465034784-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1664 microversion: 2.53 time: 0.369165 Oct 30 01:14:02.600224 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 48/109] 10.222.0.13 () {60 vars in 1243 bytes} [Sun Oct 30 01:14:02 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1664 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:14:02.618725 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3c4a0eb4-6cb6-4853-b0d4-384b642468d1 tempest-HypervisorAdminV253TestBase-1465034784 tempest-HypervisorAdminV253TestBase-1465034784-project-admin] Calling method '.version_select at 0x7f44cccae790>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:02.624478 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3c4a0eb4-6cb6-4853-b0d4-384b642468d1 tempest-HypervisorAdminV253TestBase-1465034784 tempest-HypervisorAdminV253TestBase-1465034784-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:02.629727 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3c4a0eb4-6cb6-4853-b0d4-384b642468d1 tempest-HypervisorAdminV253TestBase-1465034784 tempest-HypervisorAdminV253TestBase-1465034784-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:02.629727 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3c4a0eb4-6cb6-4853-b0d4-384b642468d1 tempest-HypervisorAdminV253TestBase-1465034784 tempest-HypervisorAdminV253TestBase-1465034784-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:02.649856 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-8eacc05f-c4d0-4ff2-8a46-1383f20acfbd tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Getting quotas for project 8e6f42c16eeb4e97b65cebf891105008. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:14:02.661121 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-8eacc05f-c4d0-4ff2-8a46-1383f20acfbd tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Getting quotas for user 056e59c7d4c2475eb66b64e0e24367be and project 8e6f42c16eeb4e97b65cebf891105008. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:14:02.662980 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3c4a0eb4-6cb6-4853-b0d4-384b642468d1 tempest-HypervisorAdminV253TestBase-1465034784 tempest-HypervisorAdminV253TestBase-1465034784-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:02.663803 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3c4a0eb4-6cb6-4853-b0d4-384b642468d1 tempest-HypervisorAdminV253TestBase-1465034784 tempest-HypervisorAdminV253TestBase-1465034784-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:02.664394 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3c4a0eb4-6cb6-4853-b0d4-384b642468d1 tempest-HypervisorAdminV253TestBase-1465034784 tempest-HypervisorAdminV253TestBase-1465034784-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:02.688208 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3c4a0eb4-6cb6-4853-b0d4-384b642468d1 tempest-HypervisorAdminV253TestBase-1465034784 tempest-HypervisorAdminV253TestBase-1465034784-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:02.690674 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3c4a0eb4-6cb6-4853-b0d4-384b642468d1 tempest-HypervisorAdminV253TestBase-1465034784 tempest-HypervisorAdminV253TestBase-1465034784-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:02.693749 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3c4a0eb4-6cb6-4853-b0d4-384b642468d1 tempest-HypervisorAdminV253TestBase-1465034784 tempest-HypervisorAdminV253TestBase-1465034784-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:02.713881 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3c4a0eb4-6cb6-4853-b0d4-384b642468d1 tempest-HypervisorAdminV253TestBase-1465034784 tempest-HypervisorAdminV253TestBase-1465034784-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:02.714820 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3c4a0eb4-6cb6-4853-b0d4-384b642468d1 tempest-HypervisorAdminV253TestBase-1465034784 tempest-HypervisorAdminV253TestBase-1465034784-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:02.715523 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3c4a0eb4-6cb6-4853-b0d4-384b642468d1 tempest-HypervisorAdminV253TestBase-1465034784 tempest-HypervisorAdminV253TestBase-1465034784-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:02.740356 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3c4a0eb4-6cb6-4853-b0d4-384b642468d1 tempest-HypervisorAdminV253TestBase-1465034784 tempest-HypervisorAdminV253TestBase-1465034784-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:02.741180 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3c4a0eb4-6cb6-4853-b0d4-384b642468d1 tempest-HypervisorAdminV253TestBase-1465034784 tempest-HypervisorAdminV253TestBase-1465034784-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:02.741861 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3c4a0eb4-6cb6-4853-b0d4-384b642468d1 tempest-HypervisorAdminV253TestBase-1465034784 tempest-HypervisorAdminV253TestBase-1465034784-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:02.754187 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3c4a0eb4-6cb6-4853-b0d4-384b642468d1 tempest-HypervisorAdminV253TestBase-1465034784 tempest-HypervisorAdminV253TestBase-1465034784-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 357 microversion: 2.53 time: 0.139556 Oct 30 01:14:02.755707 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 49/110] 10.222.0.13 () {60 vars in 1222 bytes} [Sun Oct 30 01:14:02 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 357 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 30 01:14:02.769417 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-12a324b7-e5d7-42f9-9261-126063c06848 tempest-HypervisorAdminV253TestBase-1465034784 tempest-HypervisorAdminV253TestBase-1465034784-project-admin] Calling method '.version_select at 0x7f44cccae670>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:02.774249 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-12a324b7-e5d7-42f9-9261-126063c06848 tempest-HypervisorAdminV253TestBase-1465034784 tempest-HypervisorAdminV253TestBase-1465034784-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:02.775128 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-12a324b7-e5d7-42f9-9261-126063c06848 tempest-HypervisorAdminV253TestBase-1465034784 tempest-HypervisorAdminV253TestBase-1465034784-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:02.775740 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-12a324b7-e5d7-42f9-9261-126063c06848 tempest-HypervisorAdminV253TestBase-1465034784 tempest-HypervisorAdminV253TestBase-1465034784-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:02.781525 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8eacc05f-c4d0-4ff2-8a46-1383f20acfbd tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.212979 Oct 30 01:14:02.789394 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 62/111] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 30 01:14:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:02.808879 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-12a324b7-e5d7-42f9-9261-126063c06848 tempest-HypervisorAdminV253TestBase-1465034784 tempest-HypervisorAdminV253TestBase-1465034784-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:02.810214 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-12a324b7-e5d7-42f9-9261-126063c06848 tempest-HypervisorAdminV253TestBase-1465034784 tempest-HypervisorAdminV253TestBase-1465034784-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:02.810955 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-12a324b7-e5d7-42f9-9261-126063c06848 tempest-HypervisorAdminV253TestBase-1465034784 tempest-HypervisorAdminV253TestBase-1465034784-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:02.829605 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-12a324b7-e5d7-42f9-9261-126063c06848 tempest-HypervisorAdminV253TestBase-1465034784 tempest-HypervisorAdminV253TestBase-1465034784-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/18db4346-f719-47e0-9fa3-2ff8ca274990" status: 200 len: 792 microversion: 2.53 time: 0.063043 Oct 30 01:14:02.833552 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 50/112] 10.222.0.13 () {60 vars in 1298 bytes} [Sun Oct 30 01:14:02 2022] GET /compute/v2.1/os-hypervisors/18db4346-f719-47e0-9fa3-2ff8ca274990 => generated 792 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:14:02.895912 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0968f3e0-a793-412e-85ee-10c708f14a04 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:02.896808 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0968f3e0-a793-412e-85ee-10c708f14a04 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] [instance: ba2968b1-c8ef-4ec2-9d98-66da2c62919b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:02.912394 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0968f3e0-a793-412e-85ee-10c708f14a04 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:02.912394 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0968f3e0-a793-412e-85ee-10c708f14a04 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:02.912394 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0968f3e0-a793-412e-85ee-10c708f14a04 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:02.912394 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0968f3e0-a793-412e-85ee-10c708f14a04 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:02.912714 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0968f3e0-a793-412e-85ee-10c708f14a04 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:02.912714 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0968f3e0-a793-412e-85ee-10c708f14a04 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:03.284522 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fd499698-680f-4d4a-9a47-9f513529f494 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:03.284522 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fd499698-680f-4d4a-9a47-9f513529f494 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] [instance: ac13f3c4-a93f-4664-b102-aa57f9c63308] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:03.317572 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-fd499698-680f-4d4a-9a47-9f513529f494 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464f9e9314154e3f9c779b9ae10b2a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a83b0b15194aa69fc4d82876a1e6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:03.321158 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0968f3e0-a793-412e-85ee-10c708f14a04 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9211a459e946c1a114983c531a8897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6543b666064cd78c02ec5a471d003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:03.328252 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fd499698-680f-4d4a-9a47-9f513529f494 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] 10.222.0.13 "GET /compute/v2.1/servers/ac13f3c4-a93f-4664-b102-aa57f9c63308" status: 200 len: 1218 microversion: 2.1 time: 0.084834 Oct 30 01:14:03.329087 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 51/113] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:03 2022] GET /compute/v2.1/servers/ac13f3c4-a93f-4664-b102-aa57f9c63308 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:03.329605 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0968f3e0-a793-412e-85ee-10c708f14a04 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] 10.222.0.13 "GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b" status: 200 len: 1338 microversion: 2.1 time: 0.455133 Oct 30 01:14:03.330173 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 63/114] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:02 2022] GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b => generated 1338 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:04.352867 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-402b007f-de77-481f-890d-36dc43f70c44 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:04.353485 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-402b007f-de77-481f-890d-36dc43f70c44 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] [instance: ba2968b1-c8ef-4ec2-9d98-66da2c62919b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:04.357887 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-46785f08-de5d-4c53-9e69-a627cf50a789 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:04.358268 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-46785f08-de5d-4c53-9e69-a627cf50a789 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] [instance: ac13f3c4-a93f-4664-b102-aa57f9c63308] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:04.366275 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-402b007f-de77-481f-890d-36dc43f70c44 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:04.366942 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-402b007f-de77-481f-890d-36dc43f70c44 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:04.367399 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-402b007f-de77-481f-890d-36dc43f70c44 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:04.371586 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-402b007f-de77-481f-890d-36dc43f70c44 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:04.372196 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-402b007f-de77-481f-890d-36dc43f70c44 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:04.372650 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-402b007f-de77-481f-890d-36dc43f70c44 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:04.386349 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4,nova_api:DELETE=6 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:04.493549 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-46785f08-de5d-4c53-9e69-a627cf50a789 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464f9e9314154e3f9c779b9ae10b2a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a83b0b15194aa69fc4d82876a1e6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:04.505220 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-46785f08-de5d-4c53-9e69-a627cf50a789 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] 10.222.0.13 "GET /compute/v2.1/servers/ac13f3c4-a93f-4664-b102-aa57f9c63308" status: 200 len: 1218 microversion: 2.1 time: 0.156307 Oct 30 01:14:04.508398 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 52/115] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:04 2022] GET /compute/v2.1/servers/ac13f3c4-a93f-4664-b102-aa57f9c63308 => generated 1218 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:05.077357 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-402b007f-de77-481f-890d-36dc43f70c44 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9211a459e946c1a114983c531a8897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6543b666064cd78c02ec5a471d003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:05.093838 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-402b007f-de77-481f-890d-36dc43f70c44 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] 10.222.0.13 "GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b" status: 200 len: 1338 microversion: 2.1 time: 0.744884 Oct 30 01:14:05.107370 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 64/116] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:04 2022] GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b => generated 1338 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:05.535426 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7e0dd921-5510-4b80-b0c2-5a553b75b73b tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:05.537081 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7e0dd921-5510-4b80-b0c2-5a553b75b73b tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] [instance: ac13f3c4-a93f-4664-b102-aa57f9c63308] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:05.544924 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e0dd921-5510-4b80-b0c2-5a553b75b73b tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:05.546961 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e0dd921-5510-4b80-b0c2-5a553b75b73b tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:05.546961 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e0dd921-5510-4b80-b0c2-5a553b75b73b tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:05.548645 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e0dd921-5510-4b80-b0c2-5a553b75b73b tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:05.549275 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e0dd921-5510-4b80-b0c2-5a553b75b73b tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:05.550456 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e0dd921-5510-4b80-b0c2-5a553b75b73b tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:05.683131 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7e0dd921-5510-4b80-b0c2-5a553b75b73b tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464f9e9314154e3f9c779b9ae10b2a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a83b0b15194aa69fc4d82876a1e6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:05.705895 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7e0dd921-5510-4b80-b0c2-5a553b75b73b tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] 10.222.0.13 "GET /compute/v2.1/servers/ac13f3c4-a93f-4664-b102-aa57f9c63308" status: 200 len: 1222 microversion: 2.1 time: 0.170502 Oct 30 01:14:05.706081 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 53/117] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:05 2022] GET /compute/v2.1/servers/ac13f3c4-a93f-4664-b102-aa57f9c63308 => generated 1222 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:14:06.057057 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7861260c-1ddf-4cfd-a6b5-be84e42e3473 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1568627277", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "b4253cc9-9396-4e97-b0c0-e8b6bb730934"}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:06.116434 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-573c5b71-b804-4fbc-8d3f-389076f08d1b tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:06.117302 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-573c5b71-b804-4fbc-8d3f-389076f08d1b tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] [instance: ba2968b1-c8ef-4ec2-9d98-66da2c62919b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:06.130490 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-573c5b71-b804-4fbc-8d3f-389076f08d1b tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:06.131730 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-573c5b71-b804-4fbc-8d3f-389076f08d1b tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:06.133928 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-573c5b71-b804-4fbc-8d3f-389076f08d1b tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:06.136362 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-573c5b71-b804-4fbc-8d3f-389076f08d1b tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:06.140566 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-573c5b71-b804-4fbc-8d3f-389076f08d1b tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:06.141192 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-573c5b71-b804-4fbc-8d3f-389076f08d1b tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:06.231425 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-7861260c-1ddf-4cfd-a6b5-be84e42e3473 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] validate_networks() for [('b4253cc9-9396-4e97-b0c0-e8b6bb730934', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:14:06.529253 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-573c5b71-b804-4fbc-8d3f-389076f08d1b tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9211a459e946c1a114983c531a8897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6543b666064cd78c02ec5a471d003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:06.542734 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-573c5b71-b804-4fbc-8d3f-389076f08d1b tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] 10.222.0.13 "GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b" status: 200 len: 1338 microversion: 2.1 time: 0.430383 Oct 30 01:14:06.561809 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 54/118] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:06 2022] GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b => generated 1338 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:06.730272 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e8ed2b79-f6b1-4bb6-a623-d2335190b266 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:06.730894 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e8ed2b79-f6b1-4bb6-a623-d2335190b266 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] [instance: ac13f3c4-a93f-4664-b102-aa57f9c63308] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:06.740117 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e8ed2b79-f6b1-4bb6-a623-d2335190b266 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:06.740885 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e8ed2b79-f6b1-4bb6-a623-d2335190b266 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:06.742683 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e8ed2b79-f6b1-4bb6-a623-d2335190b266 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:06.743427 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e8ed2b79-f6b1-4bb6-a623-d2335190b266 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:06.743891 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e8ed2b79-f6b1-4bb6-a623-d2335190b266 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:06.745829 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e8ed2b79-f6b1-4bb6-a623-d2335190b266 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:06.843600 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e8ed2b79-f6b1-4bb6-a623-d2335190b266 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464f9e9314154e3f9c779b9ae10b2a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a83b0b15194aa69fc4d82876a1e6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:06.854918 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e8ed2b79-f6b1-4bb6-a623-d2335190b266 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] 10.222.0.13 "GET /compute/v2.1/servers/ac13f3c4-a93f-4664-b102-aa57f9c63308" status: 200 len: 1270 microversion: 2.1 time: 0.131624 Oct 30 01:14:06.855855 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 55/119] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:06 2022] GET /compute/v2.1/servers/ac13f3c4-a93f-4664-b102-aa57f9c63308 => generated 1270 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:07.565494 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-7861260c-1ddf-4cfd-a6b5-be84e42e3473 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:14:07.566922 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-7861260c-1ddf-4cfd-a6b5-be84e42e3473 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:14:07.567401 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-7861260c-1ddf-4cfd-a6b5-be84e42e3473 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:14:07.567815 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-7861260c-1ddf-4cfd-a6b5-be84e42e3473 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:14:07.568262 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-7861260c-1ddf-4cfd-a6b5-be84e42e3473 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:14:07.569363 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b927f993-0f37-4283-a262-0cdad2fcef59 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:07.569988 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b927f993-0f37-4283-a262-0cdad2fcef59 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] [instance: ba2968b1-c8ef-4ec2-9d98-66da2c62919b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:07.577557 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b927f993-0f37-4283-a262-0cdad2fcef59 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:07.578804 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b927f993-0f37-4283-a262-0cdad2fcef59 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:07.580171 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b927f993-0f37-4283-a262-0cdad2fcef59 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:07.581168 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b927f993-0f37-4283-a262-0cdad2fcef59 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:07.581798 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b927f993-0f37-4283-a262-0cdad2fcef59 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:07.582367 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b927f993-0f37-4283-a262-0cdad2fcef59 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:07.592108 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7861260c-1ddf-4cfd-a6b5-be84e42e3473 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:07.595178 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7861260c-1ddf-4cfd-a6b5-be84e42e3473 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:07.596647 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7861260c-1ddf-4cfd-a6b5-be84e42e3473 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:07.599331 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7861260c-1ddf-4cfd-a6b5-be84e42e3473 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:07.601406 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7861260c-1ddf-4cfd-a6b5-be84e42e3473 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:07.603652 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7861260c-1ddf-4cfd-a6b5-be84e42e3473 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:07.701496 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-7861260c-1ddf-4cfd-a6b5-be84e42e3473 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Getting quotas for project 283e7fd477334b879db6b49ee5cc509f. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:14:07.719941 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-7861260c-1ddf-4cfd-a6b5-be84e42e3473 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Getting quotas for user c7334417689847d18bc4c1b27d173a23 and project 283e7fd477334b879db6b49ee5cc509f. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:14:07.749480 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7861260c-1ddf-4cfd-a6b5-be84e42e3473 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:14:07.752248 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7861260c-1ddf-4cfd-a6b5-be84e42e3473 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 7e81dcfb-dcbe-4e05-91a4-541ff2c404ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:14:07.972748 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b927f993-0f37-4283-a262-0cdad2fcef59 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9211a459e946c1a114983c531a8897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6543b666064cd78c02ec5a471d003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:07.981864 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b927f993-0f37-4283-a262-0cdad2fcef59 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] 10.222.0.13 "GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b" status: 200 len: 1338 microversion: 2.1 time: 0.417058 Oct 30 01:14:07.983213 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 56/120] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:07 2022] GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b => generated 1338 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:14:07.988550 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-aefeed4b-9111-4116-af4b-cea352475769 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:07.989385 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-aefeed4b-9111-4116-af4b-cea352475769 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] [instance: ac13f3c4-a93f-4664-b102-aa57f9c63308] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:07.996558 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aefeed4b-9111-4116-af4b-cea352475769 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:07.997303 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aefeed4b-9111-4116-af4b-cea352475769 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:07.998350 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aefeed4b-9111-4116-af4b-cea352475769 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:07.999413 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aefeed4b-9111-4116-af4b-cea352475769 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:08.000489 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aefeed4b-9111-4116-af4b-cea352475769 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:08.001112 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aefeed4b-9111-4116-af4b-cea352475769 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:08.030952 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7861260c-1ddf-4cfd-a6b5-be84e42e3473 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.469205 Oct 30 01:14:08.038109 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 65/121] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:14:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2477 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:14:08.056528 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-22e898d9-0d9e-414a-b9c6-fe88f03424a3 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:08.069929 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-22e898d9-0d9e-414a-b9c6-fe88f03424a3 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 7e81dcfb-dcbe-4e05-91a4-541ff2c404ae] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:08.110379 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-aefeed4b-9111-4116-af4b-cea352475769 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464f9e9314154e3f9c779b9ae10b2a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a83b0b15194aa69fc4d82876a1e6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:08.121328 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-aefeed4b-9111-4116-af4b-cea352475769 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] 10.222.0.13 "GET /compute/v2.1/servers/ac13f3c4-a93f-4664-b102-aa57f9c63308" status: 200 len: 1276 microversion: 2.1 time: 0.135822 Oct 30 01:14:08.122451 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 57/122] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:07 2022] GET /compute/v2.1/servers/ac13f3c4-a93f-4664-b102-aa57f9c63308 => generated 1276 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:08.258986 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-22e898d9-0d9e-414a-b9c6-fe88f03424a3 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:08.271525 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-22e898d9-0d9e-414a-b9c6-fe88f03424a3 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae" status: 200 len: 1211 microversion: 2.1 time: 0.219861 Oct 30 01:14:08.286466 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 66/123] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:08 2022] GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae => generated 1211 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:08.589632 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cfa28ea7-df9a-4bed-a055-68dc3e1bcc3b tempest-HostsAdminNegativeTestJSON-1800607175 tempest-HostsAdminNegativeTestJSON-1800607175-project-admin] Calling method '.version_select at 0x7f44ccc49ee0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:08.595890 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cfa28ea7-df9a-4bed-a055-68dc3e1bcc3b tempest-HostsAdminNegativeTestJSON-1800607175 tempest-HostsAdminNegativeTestJSON-1800607175-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:08.596965 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cfa28ea7-df9a-4bed-a055-68dc3e1bcc3b tempest-HostsAdminNegativeTestJSON-1800607175 tempest-HostsAdminNegativeTestJSON-1800607175-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:08.598621 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cfa28ea7-df9a-4bed-a055-68dc3e1bcc3b tempest-HostsAdminNegativeTestJSON-1800607175 tempest-HostsAdminNegativeTestJSON-1800607175-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:08.600256 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cfa28ea7-df9a-4bed-a055-68dc3e1bcc3b tempest-HostsAdminNegativeTestJSON-1800607175 tempest-HostsAdminNegativeTestJSON-1800607175-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:08.601733 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cfa28ea7-df9a-4bed-a055-68dc3e1bcc3b tempest-HostsAdminNegativeTestJSON-1800607175 tempest-HostsAdminNegativeTestJSON-1800607175-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:08.602879 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cfa28ea7-df9a-4bed-a055-68dc3e1bcc3b tempest-HostsAdminNegativeTestJSON-1800607175 tempest-HostsAdminNegativeTestJSON-1800607175-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:08.668365 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cfa28ea7-df9a-4bed-a055-68dc3e1bcc3b tempest-HostsAdminNegativeTestJSON-1800607175 tempest-HostsAdminNegativeTestJSON-1800607175-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts" status: 200 len: 397 microversion: 2.1 time: 0.544417 Oct 30 01:14:08.677274 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 58/124] 10.222.0.13 () {58 vars in 1128 bytes} [Sun Oct 30 01:14:08 2022] GET /compute/v2.1/os-hosts => generated 397 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:08.822241 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-24d44df6-ed37-4f16-a178-0272f3e1ca20 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1683470029", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "2127731727", "adminPass": "***", "networks": [{"uuid": "08eb4cd4-abe6-4c41-b376-9a666b7ba9c0"}], "security_groups": [{"name": "tempest-securitygroup--819150286"}], "key_name": "tempest-keypair-548259820", "user_data": "}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:09.153419 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-24d44df6-ed37-4f16-a178-0272f3e1ca20 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] validate_networks() for [('08eb4cd4-abe6-4c41-b376-9a666b7ba9c0', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:14:09.233044 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-89302a0d-dc6f-4fc7-941b-41d3c0abcd17 tempest-HostsAdminNegativeTestJSON-1296901282 tempest-HostsAdminNegativeTestJSON-1296901282-project] Calling method '.version_select at 0x7f44ccdebe50>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:09.240663 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-89302a0d-dc6f-4fc7-941b-41d3c0abcd17 tempest-HostsAdminNegativeTestJSON-1296901282 tempest-HostsAdminNegativeTestJSON-1296901282-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'fc425a8158474f1fae8733437a74eb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c467cf21efd4aadbf05ded4ff3d2f40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:09.247574 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-89302a0d-dc6f-4fc7-941b-41d3c0abcd17 tempest-HostsAdminNegativeTestJSON-1296901282 tempest-HostsAdminNegativeTestJSON-1296901282-project] Request method failure captured: Oct 30 01:14:09.247574 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 30 01:14:09.247574 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:14:09.247574 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:14:09.247574 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:14:09.247574 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:14:09.247574 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:14:09.247574 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:14:09.247574 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:14:09.247574 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:14:09.247574 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXc_dUuQo3hUsYjEntXSMlTYYnB09L-6bFBPe91LZ5N3xGBI90w_Mxemksn6FxdpeXQNRb-iO92HcEUzCfH390yCo0fLHiFCh3uxzwQtMffFAYYAoYiZ7U9ShMm9MBH4yZvJZt0B6pVscvCPXA0avZ_Ghuldnh62p570NExJDztwmRd4 Oct 30 01:14:09.247574 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:14:09.247574 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:14:09.247574 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:14:09.247574 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:14:09.247574 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:14:09.247574 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:14:09.247574 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 1c467cf21efd4aadbf05ded4ff3d2f40 Oct 30 01:14:09.247574 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1296901282 Oct 30 01:14:09.247574 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:14:09.247574 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:14:09.249315 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1c467cf21efd4aadbf05ded4ff3d2f40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1c467cf21efd4aadbf05ded4ff3d2f40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1c467cf21efd4aadbf05ded4ff3d2f40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1c467cf21efd4aadbf05ded4ff3d2f40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:14:09.249315 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1296901282 Oct 30 01:14:09.249315 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 1c467cf21efd4aadbf05ded4ff3d2f40 Oct 30 01:14:09.249315 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1296901282 Oct 30 01:14:09.249315 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-HostsAdminNegativeTestJSON-1296901282-project Oct 30 01:14:09.249315 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:14:09.249315 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:14:09.249315 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: fc425a8158474f1fae8733437a74eb9f Oct 30 01:14:09.249315 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1296901282-project Oct 30 01:14:09.249315 n-d-master-1 devstack@n-api.service[121103]: method: Oct 30 01:14:09.249315 n-d-master-1 devstack@n-api.service[121103]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 30 01:14:09.249315 n-d-master-1 devstack@n-api.service[121103]: action_args: {} Oct 30 01:14:09.249315 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:14:09.250487 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:09.250487 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:09.250487 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:09.250487 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:14:09.250487 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:14:09.250487 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:14:09.250487 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:14:09.250487 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 30 01:14:09.250487 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:14:09.250487 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:14:09.250487 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:14:09.250487 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 30 01:14:09.250487 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 30 01:14:09.250487 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 30 01:14:09.250487 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 30 01:14:09.250487 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 30 01:14:09.250487 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 30 01:14:09.250487 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 01:14:09.250487 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 30 01:14:09.252666 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 01:14:09.252666 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise self.value Oct 30 01:14:09.252666 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 30 01:14:09.252666 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 30 01:14:09.252666 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 30 01:14:09.252666 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 30 01:14:09.252666 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 30 01:14:09.252666 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 30 01:14:09.252666 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 30 01:14:09.252666 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:09.252666 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:09.252666 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:09.252666 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:09.252666 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:09.252666 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:09.252666 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 30 01:14:09.252666 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 30 01:14:09.252666 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 30 01:14:09.252666 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:09.264030 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-89302a0d-dc6f-4fc7-941b-41d3c0abcd17 tempest-HostsAdminNegativeTestJSON-1296901282 tempest-HostsAdminNegativeTestJSON-1296901282-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:14:09.266492 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-89302a0d-dc6f-4fc7-941b-41d3c0abcd17 tempest-HostsAdminNegativeTestJSON-1296901282 tempest-HostsAdminNegativeTestJSON-1296901282-project] 10.222.0.13 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.587685 Oct 30 01:14:09.278002 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 67/125] 10.222.0.13 () {58 vars in 1128 bytes} [Sun Oct 30 01:14:08 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 596 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 30 01:14:09.289638 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5142c05e-4f71-4e03-87a2-4c79002d3d4c tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:09.295577 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5142c05e-4f71-4e03-87a2-4c79002d3d4c tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] [instance: ba2968b1-c8ef-4ec2-9d98-66da2c62919b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:09.316891 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5142c05e-4f71-4e03-87a2-4c79002d3d4c tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:09.316891 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5142c05e-4f71-4e03-87a2-4c79002d3d4c tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:09.319745 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5142c05e-4f71-4e03-87a2-4c79002d3d4c tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:09.321603 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5142c05e-4f71-4e03-87a2-4c79002d3d4c tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:09.324923 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5142c05e-4f71-4e03-87a2-4c79002d3d4c tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:09.326288 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5142c05e-4f71-4e03-87a2-4c79002d3d4c tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:09.757853 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5142c05e-4f71-4e03-87a2-4c79002d3d4c tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9211a459e946c1a114983c531a8897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6543b666064cd78c02ec5a471d003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:09.768608 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5142c05e-4f71-4e03-87a2-4c79002d3d4c tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] 10.222.0.13 "GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b" status: 200 len: 1338 microversion: 2.1 time: 0.489226 Oct 30 01:14:09.769885 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 68/126] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:09 2022] GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b => generated 1338 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:09.775124 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9af69d49-0430-4a2f-8fba-ff36b1db1d56 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:09.775984 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9af69d49-0430-4a2f-8fba-ff36b1db1d56 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] [instance: ac13f3c4-a93f-4664-b102-aa57f9c63308] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:09.782780 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9af69d49-0430-4a2f-8fba-ff36b1db1d56 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:09.783657 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9af69d49-0430-4a2f-8fba-ff36b1db1d56 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:09.784289 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9af69d49-0430-4a2f-8fba-ff36b1db1d56 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:09.785282 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9af69d49-0430-4a2f-8fba-ff36b1db1d56 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:09.785908 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9af69d49-0430-4a2f-8fba-ff36b1db1d56 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:09.798599 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9af69d49-0430-4a2f-8fba-ff36b1db1d56 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:10.180100 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9af69d49-0430-4a2f-8fba-ff36b1db1d56 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464f9e9314154e3f9c779b9ae10b2a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a83b0b15194aa69fc4d82876a1e6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:10.207963 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9af69d49-0430-4a2f-8fba-ff36b1db1d56 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] 10.222.0.13 "GET /compute/v2.1/servers/ac13f3c4-a93f-4664-b102-aa57f9c63308" status: 200 len: 1318 microversion: 2.1 time: 0.436534 Oct 30 01:14:10.235761 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 69/127] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:09 2022] GET /compute/v2.1/servers/ac13f3c4-a93f-4664-b102-aa57f9c63308 => generated 1318 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:10.241249 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f3938491-b20f-4616-a645-8a70a30596fa tempest-HostsAdminNegativeTestJSON-1296901282 tempest-HostsAdminNegativeTestJSON-1296901282-project] Calling method '.version_select at 0x7f44ccd89a60>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:10.246106 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f3938491-b20f-4616-a645-8a70a30596fa tempest-HostsAdminNegativeTestJSON-1296901282 tempest-HostsAdminNegativeTestJSON-1296901282-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'fc425a8158474f1fae8733437a74eb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c467cf21efd4aadbf05ded4ff3d2f40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:10.250556 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f3938491-b20f-4616-a645-8a70a30596fa tempest-HostsAdminNegativeTestJSON-1296901282 tempest-HostsAdminNegativeTestJSON-1296901282-project] Request method failure captured: Oct 30 01:14:10.250556 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/os-hosts/n-d-master-1/reboot HTTP/1.1 Oct 30 01:14:10.250556 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:14:10.250556 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:14:10.250556 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:14:10.250556 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:14:10.250556 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:14:10.250556 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:14:10.250556 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:14:10.250556 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:14:10.250556 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXc_dUuQo3hUsYjEntXSMlTYYnB09L-6bFBPe91LZ5N3xGBI90w_Mxemksn6FxdpeXQNRb-iO92HcEUzCfH390yCo0fLHiFCh3uxzwQtMffFAYYAoYiZ7U9ShMm9MBH4yZvJZt0B6pVscvCPXA0avZ_Ghuldnh62p570NExJDztwmRd4 Oct 30 01:14:10.250556 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:14:10.250556 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:14:10.250556 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:14:10.250556 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:14:10.250556 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:14:10.250556 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:14:10.250556 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 1c467cf21efd4aadbf05ded4ff3d2f40 Oct 30 01:14:10.250556 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1296901282 Oct 30 01:14:10.250556 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:14:10.250556 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:14:10.252041 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1c467cf21efd4aadbf05ded4ff3d2f40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1c467cf21efd4aadbf05ded4ff3d2f40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1c467cf21efd4aadbf05ded4ff3d2f40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1c467cf21efd4aadbf05ded4ff3d2f40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:14:10.252041 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1296901282 Oct 30 01:14:10.252041 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 1c467cf21efd4aadbf05ded4ff3d2f40 Oct 30 01:14:10.252041 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1296901282 Oct 30 01:14:10.252041 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-HostsAdminNegativeTestJSON-1296901282-project Oct 30 01:14:10.252041 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:14:10.252041 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:14:10.252041 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: fc425a8158474f1fae8733437a74eb9f Oct 30 01:14:10.252041 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1296901282-project Oct 30 01:14:10.252041 n-d-master-1 devstack@n-api.service[121103]: method: Oct 30 01:14:10.252041 n-d-master-1 devstack@n-api.service[121103]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 30 01:14:10.252041 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'n-d-master-1'} Oct 30 01:14:10.252041 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:14:10.252888 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:10.252888 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:10.252888 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:10.252888 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:14:10.252888 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:14:10.252888 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:14:10.252888 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:14:10.252888 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:14:10.252888 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:14:10.252888 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 30 01:14:10.252888 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 30 01:14:10.252888 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 30 01:14:10.252888 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 30 01:14:10.252888 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 30 01:14:10.252888 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 30 01:14:10.252888 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 01:14:10.252888 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 30 01:14:10.252888 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 01:14:10.252888 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise self.value Oct 30 01:14:10.254244 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 30 01:14:10.254244 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 30 01:14:10.254244 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 30 01:14:10.254244 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 30 01:14:10.254244 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 30 01:14:10.254244 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 30 01:14:10.254244 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 30 01:14:10.254244 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:10.254244 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:10.254244 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:10.254244 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:10.254244 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:10.254244 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:10.254244 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 30 01:14:10.254244 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 30 01:14:10.254244 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 30 01:14:10.254244 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:10.259623 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f3938491-b20f-4616-a645-8a70a30596fa tempest-HostsAdminNegativeTestJSON-1296901282 tempest-HostsAdminNegativeTestJSON-1296901282-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:14:10.260889 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f3938491-b20f-4616-a645-8a70a30596fa tempest-HostsAdminNegativeTestJSON-1296901282 tempest-HostsAdminNegativeTestJSON-1296901282-project] 10.222.0.13 "GET /compute/v2.1/os-hosts/n-d-master-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.029588 Oct 30 01:14:10.265891 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 70/128] 10.222.0.13 () {58 vars in 1188 bytes} [Sun Oct 30 01:14:10 2022] GET /compute/v2.1/os-hosts/n-d-master-1/reboot => generated 111 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:14:10.279614 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ce965888-3b1e-41d7-971c-9293697466df tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:10.280992 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ce965888-3b1e-41d7-971c-9293697466df tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 7e81dcfb-dcbe-4e05-91a4-541ff2c404ae] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:10.306989 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ce965888-3b1e-41d7-971c-9293697466df tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:10.307976 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ce965888-3b1e-41d7-971c-9293697466df tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:10.308749 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ce965888-3b1e-41d7-971c-9293697466df tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:10.311082 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ce965888-3b1e-41d7-971c-9293697466df tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:10.312314 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ce965888-3b1e-41d7-971c-9293697466df tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:10.313646 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ce965888-3b1e-41d7-971c-9293697466df tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:10.361539 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=100 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:10.471227 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ce965888-3b1e-41d7-971c-9293697466df tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:10.489529 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ce965888-3b1e-41d7-971c-9293697466df tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae" status: 200 len: 1236 microversion: 2.1 time: 0.217695 Oct 30 01:14:10.489529 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 71/129] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:10 2022] GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae => generated 1236 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:10.725798 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-e26cb857-060b-4e90-8537-8cc98f36bbb3 req-db9d4825-6ef7-44f1-baba-13a0da11c411 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba2968b1-c8ef-4ec2-9d98-66da2c62919b", "name": "network-vif-plugged", "status": "completed", "tag": "7c42110b-29c3-4585-a867-a3e633a2c945"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:10.746054 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e26cb857-060b-4e90-8537-8cc98f36bbb3 req-db9d4825-6ef7-44f1-baba-13a0da11c411 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:10.747301 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e26cb857-060b-4e90-8537-8cc98f36bbb3 req-db9d4825-6ef7-44f1-baba-13a0da11c411 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:10.749561 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e26cb857-060b-4e90-8537-8cc98f36bbb3 req-db9d4825-6ef7-44f1-baba-13a0da11c411 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:10.811961 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-e26cb857-060b-4e90-8537-8cc98f36bbb3 req-db9d4825-6ef7-44f1-baba-13a0da11c411 service nova] Creating event network-vif-plugged:7c42110b-29c3-4585-a867-a3e633a2c945 for instance ba2968b1-c8ef-4ec2-9d98-66da2c62919b on n-h1-master-1 Oct 30 01:14:10.822374 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-e26cb857-060b-4e90-8537-8cc98f36bbb3 req-db9d4825-6ef7-44f1-baba-13a0da11c411 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.330115 Oct 30 01:14:10.823007 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 72/130] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:10.829581 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bf28fb39-8a3c-4405-86dc-0dc431ac3f85 tempest-HostsAdminNegativeTestJSON-1800607175 tempest-HostsAdminNegativeTestJSON-1800607175-project-admin] Calling method '.version_select at 0x7f44ccdeb940>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:10.851199 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-bf28fb39-8a3c-4405-86dc-0dc431ac3f85 tempest-HostsAdminNegativeTestJSON-1800607175 tempest-HostsAdminNegativeTestJSON-1800607175-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 30 01:14:10.859143 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bf28fb39-8a3c-4405-86dc-0dc431ac3f85 tempest-HostsAdminNegativeTestJSON-1800607175 tempest-HostsAdminNegativeTestJSON-1800607175-project-admin] Request method failure captured: Oct 30 01:14:10.859143 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 30 01:14:10.859143 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:14:10.859143 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:14:10.859143 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:14:10.859143 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:14:10.859143 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:14:10.859143 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:14:10.859143 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:14:10.859143 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:14:10.859143 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXc_f6NR4mFsvOGicDgyz8gZdPPjmHLHa7Wh2nLAfqnHhCLDT2mEW2I3bwIhQA43kbaSP3YA-FZIMa5ENrd66b2X8MG1v6WKnlmyp2vJJLPjLKA4-HR5OXnTTSYkH0HuhApYcn9_7l5NYKNXgEGRfagkeY-IDT-Afeh3j2khLvfXipoU Oct 30 01:14:10.859143 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:14:10.859143 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:14:10.859143 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:14:10.859143 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:14:10.859143 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:14:10.859143 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:14:10.859143 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 9e08e00f6d124462bc36d474ac3d1e59 Oct 30 01:14:10.859143 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1800607175 Oct 30 01:14:10.859143 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,admin,reader Oct 30 01:14:10.859143 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,admin,reader Oct 30 01:14:10.860643 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9e08e00f6d124462bc36d474ac3d1e59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9e08e00f6d124462bc36d474ac3d1e59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9e08e00f6d124462bc36d474ac3d1e59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9e08e00f6d124462bc36d474ac3d1e59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:14:10.860643 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1800607175 Oct 30 01:14:10.860643 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 9e08e00f6d124462bc36d474ac3d1e59 Oct 30 01:14:10.860643 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1800607175 Oct 30 01:14:10.860643 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-HostsAdminNegativeTestJSON-1800607175-project-admin Oct 30 01:14:10.860643 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:14:10.860643 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:14:10.860643 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: e590aac4a07f4867a249f723fa6a3d37 Oct 30 01:14:10.860643 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1800607175-project-admin Oct 30 01:14:10.860643 n-d-master-1 devstack@n-api.service[121103]: method: Oct 30 01:14:10.860643 n-d-master-1 devstack@n-api.service[121103]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 30 01:14:10.860643 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'nonexistent_hostname'} Oct 30 01:14:10.860643 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:14:10.861532 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:10.861532 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 30 01:14:10.861532 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 30 01:14:10.861532 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 30 01:14:10.861532 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 30 01:14:10.861532 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 01:14:10.861532 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 30 01:14:10.861532 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 01:14:10.861532 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise self.value Oct 30 01:14:10.861532 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 30 01:14:10.861532 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 30 01:14:10.861532 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 30 01:14:10.861532 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 30 01:14:10.861532 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 01:14:10.861532 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 01:14:10.861532 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 30 01:14:10.861532 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 30 01:14:10.861532 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 30 01:14:10.861532 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 30 01:14:10.863055 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 30 01:14:10.863055 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 30 01:14:10.863055 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 30 01:14:10.863055 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:10.863055 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:10.863055 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:10.863055 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:10.863055 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:10.863055 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:10.863055 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:14:10.863055 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:14:10.863055 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:14:10.863055 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:14:10.863055 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:14:10.863055 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:14:10.863055 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 30 01:14:10.863055 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 30 01:14:10.863055 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 30 01:14:10.863055 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:14:10.864296 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 30 01:14:10.864296 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:10.864296 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:10.864296 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:10.864296 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:10.864296 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:10.864296 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:10.864296 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:14:10.864296 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:14:10.864296 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 30 01:14:10.864296 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:10.879624 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bf28fb39-8a3c-4405-86dc-0dc431ac3f85 tempest-HostsAdminNegativeTestJSON-1800607175 tempest-HostsAdminNegativeTestJSON-1800607175-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:14:10.881039 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bf28fb39-8a3c-4405-86dc-0dc431ac3f85 tempest-HostsAdminNegativeTestJSON-1800607175 tempest-HostsAdminNegativeTestJSON-1800607175-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.056719 Oct 30 01:14:10.886281 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 73/131] 10.222.0.13 () {58 vars in 1212 bytes} [Sun Oct 30 01:14:10 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:14:10.893038 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a31ed9a7-0e3e-40c1-b65a-c210fd7d33fb tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:10.908814 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a31ed9a7-0e3e-40c1-b65a-c210fd7d33fb tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] [instance: ba2968b1-c8ef-4ec2-9d98-66da2c62919b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:10.926284 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a31ed9a7-0e3e-40c1-b65a-c210fd7d33fb tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:10.927768 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a31ed9a7-0e3e-40c1-b65a-c210fd7d33fb tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:10.929238 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a31ed9a7-0e3e-40c1-b65a-c210fd7d33fb tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:10.931764 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a31ed9a7-0e3e-40c1-b65a-c210fd7d33fb tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:10.935954 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a31ed9a7-0e3e-40c1-b65a-c210fd7d33fb tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:10.936674 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a31ed9a7-0e3e-40c1-b65a-c210fd7d33fb tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:10.946542 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-24d44df6-ed37-4f16-a178-0272f3e1ca20 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:14:10.949405 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-24d44df6-ed37-4f16-a178-0272f3e1ca20 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:14:10.949405 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-24d44df6-ed37-4f16-a178-0272f3e1ca20 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:14:10.949405 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-24d44df6-ed37-4f16-a178-0272f3e1ca20 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:14:10.949405 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-24d44df6-ed37-4f16-a178-0272f3e1ca20 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:14:10.993563 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24d44df6-ed37-4f16-a178-0272f3e1ca20 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:10.994377 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24d44df6-ed37-4f16-a178-0272f3e1ca20 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:10.994876 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24d44df6-ed37-4f16-a178-0272f3e1ca20 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:10.995602 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24d44df6-ed37-4f16-a178-0272f3e1ca20 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:10.996287 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24d44df6-ed37-4f16-a178-0272f3e1ca20 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:10.996718 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24d44df6-ed37-4f16-a178-0272f3e1ca20 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:11.017149 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-24d44df6-ed37-4f16-a178-0272f3e1ca20 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Getting quotas for project 8e6f42c16eeb4e97b65cebf891105008. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:14:11.022884 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-24d44df6-ed37-4f16-a178-0272f3e1ca20 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Getting quotas for user 056e59c7d4c2475eb66b64e0e24367be and project 8e6f42c16eeb4e97b65cebf891105008. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:14:11.042550 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-24d44df6-ed37-4f16-a178-0272f3e1ca20 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:14:11.046519 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-24d44df6-ed37-4f16-a178-0272f3e1ca20 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] [instance: 7571f255-6ff3-4fc7-bcaa-4837bc05dbf5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:14:11.216102 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a31ed9a7-0e3e-40c1-b65a-c210fd7d33fb tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9211a459e946c1a114983c531a8897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6543b666064cd78c02ec5a471d003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:11.228252 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a31ed9a7-0e3e-40c1-b65a-c210fd7d33fb tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] 10.222.0.13 "GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b" status: 200 len: 1338 microversion: 2.1 time: 0.342695 Oct 30 01:14:11.228990 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 74/132] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:10 2022] GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b => generated 1338 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:11.233996 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-24d44df6-ed37-4f16-a178-0272f3e1ca20 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.422523 Oct 30 01:14:11.235276 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 59/133] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:14:08 2022] POST /compute/v2.1/servers => generated 401 bytes in 2425 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:14:11.247368 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6b23839b-35a9-42ef-8fd3-707ad7f719ef tempest-HostsAdminNegativeTestJSON-1296901282 tempest-HostsAdminNegativeTestJSON-1296901282-project] Calling method '.version_select at 0x7f44ccdeb550>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:11.257095 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6b23839b-35a9-42ef-8fd3-707ad7f719ef tempest-HostsAdminNegativeTestJSON-1296901282 tempest-HostsAdminNegativeTestJSON-1296901282-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'fc425a8158474f1fae8733437a74eb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c467cf21efd4aadbf05ded4ff3d2f40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:11.258084 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6b23839b-35a9-42ef-8fd3-707ad7f719ef tempest-HostsAdminNegativeTestJSON-1296901282 tempest-HostsAdminNegativeTestJSON-1296901282-project] Request method failure captured: Oct 30 01:14:11.258084 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Oct 30 01:14:11.258084 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:14:11.258084 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:14:11.258084 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:14:11.258084 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:14:11.258084 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:14:11.258084 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:14:11.258084 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:14:11.258084 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:14:11.258084 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXc_dUuQo3hUsYjEntXSMlTYYnB09L-6bFBPe91LZ5N3xGBI90w_Mxemksn6FxdpeXQNRb-iO92HcEUzCfH390yCo0fLHiFCh3uxzwQtMffFAYYAoYiZ7U9ShMm9MBH4yZvJZt0B6pVscvCPXA0avZ_Ghuldnh62p570NExJDztwmRd4 Oct 30 01:14:11.258084 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:14:11.258084 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:14:11.258084 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:14:11.258084 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:14:11.258084 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:14:11.258084 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:14:11.258084 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 1c467cf21efd4aadbf05ded4ff3d2f40 Oct 30 01:14:11.258084 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1296901282 Oct 30 01:14:11.258084 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:14:11.258084 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:14:11.259244 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1c467cf21efd4aadbf05ded4ff3d2f40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1c467cf21efd4aadbf05ded4ff3d2f40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1c467cf21efd4aadbf05ded4ff3d2f40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1c467cf21efd4aadbf05ded4ff3d2f40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:14:11.259244 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1296901282 Oct 30 01:14:11.259244 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 1c467cf21efd4aadbf05ded4ff3d2f40 Oct 30 01:14:11.259244 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1296901282 Oct 30 01:14:11.259244 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-HostsAdminNegativeTestJSON-1296901282-project Oct 30 01:14:11.259244 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:14:11.259244 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:14:11.259244 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: fc425a8158474f1fae8733437a74eb9f Oct 30 01:14:11.259244 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1296901282-project Oct 30 01:14:11.259244 n-d-master-1 devstack@n-api.service[121103]: method: Oct 30 01:14:11.259244 n-d-master-1 devstack@n-api.service[121103]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 30 01:14:11.259244 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'n-d-master-1'} Oct 30 01:14:11.259244 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:14:11.260186 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:11.260186 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:11.260186 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:11.260186 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:14:11.260186 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:14:11.260186 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:14:11.260186 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:14:11.260186 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:14:11.260186 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:14:11.260186 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 30 01:14:11.260186 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 30 01:14:11.260186 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 30 01:14:11.260186 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 30 01:14:11.260186 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 30 01:14:11.260186 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 30 01:14:11.260186 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 01:14:11.260186 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 30 01:14:11.260186 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 01:14:11.260186 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise self.value Oct 30 01:14:11.261579 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 30 01:14:11.261579 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 30 01:14:11.261579 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 30 01:14:11.261579 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 30 01:14:11.261579 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 30 01:14:11.261579 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 30 01:14:11.261579 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 30 01:14:11.261579 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:11.261579 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:11.261579 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:11.261579 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:11.261579 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:11.261579 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:11.261579 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 30 01:14:11.261579 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 30 01:14:11.261579 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 30 01:14:11.261579 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:11.262505 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6b23839b-35a9-42ef-8fd3-707ad7f719ef tempest-HostsAdminNegativeTestJSON-1296901282 tempest-HostsAdminNegativeTestJSON-1296901282-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:14:11.262505 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6b23839b-35a9-42ef-8fd3-707ad7f719ef tempest-HostsAdminNegativeTestJSON-1296901282 tempest-HostsAdminNegativeTestJSON-1296901282-project] 10.222.0.13 "GET /compute/v2.1/os-hosts/n-d-master-1" status: 403 len: 109 microversion: 2.1 time: 0.029316 Oct 30 01:14:11.262505 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 75/134] 10.222.0.13 () {58 vars in 1167 bytes} [Sun Oct 30 01:14:11 2022] GET /compute/v2.1/os-hosts/n-d-master-1 => generated 109 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:14:11.266190 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3fe0e8f0-0885-4bcb-9286-d03cde723458 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:11.267384 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3fe0e8f0-0885-4bcb-9286-d03cde723458 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] [instance: ac13f3c4-a93f-4664-b102-aa57f9c63308] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:11.325140 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3fe0e8f0-0885-4bcb-9286-d03cde723458 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:11.325140 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3fe0e8f0-0885-4bcb-9286-d03cde723458 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:11.325140 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3fe0e8f0-0885-4bcb-9286-d03cde723458 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:11.329288 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3fe0e8f0-0885-4bcb-9286-d03cde723458 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:11.332174 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3fe0e8f0-0885-4bcb-9286-d03cde723458 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:11.333888 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3fe0e8f0-0885-4bcb-9286-d03cde723458 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:11.576343 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c74d6958-a317-4eba-9e59-ce53d79aede9 tempest-FlavorsV261TestJSON-863372724 tempest-FlavorsV261TestJSON-863372724-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1065650224", "id": 1529992650, "os-flavor-access:is_public": "True"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:11.629515 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3fe0e8f0-0885-4bcb-9286-d03cde723458 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464f9e9314154e3f9c779b9ae10b2a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a83b0b15194aa69fc4d82876a1e6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:11.638927 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3fe0e8f0-0885-4bcb-9286-d03cde723458 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] 10.222.0.13 "GET /compute/v2.1/servers/ac13f3c4-a93f-4664-b102-aa57f9c63308" status: 200 len: 1318 microversion: 2.1 time: 0.376738 Oct 30 01:14:11.660904 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 76/135] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:11 2022] GET /compute/v2.1/servers/ac13f3c4-a93f-4664-b102-aa57f9c63308 => generated 1318 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:11.660904 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-071e4b5e-362f-4bc6-9547-339615104811 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:11.660904 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-071e4b5e-362f-4bc6-9547-339615104811 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] [instance: 7571f255-6ff3-4fc7-bcaa-4837bc05dbf5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:11.777767 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-071e4b5e-362f-4bc6-9547-339615104811 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056e59c7d4c2475eb66b64e0e24367be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6f42c16eeb4e97b65cebf891105008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:11.804841 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-071e4b5e-362f-4bc6-9547-339615104811 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] 10.222.0.13 "GET /compute/v2.1/servers/7571f255-6ff3-4fc7-bcaa-4837bc05dbf5" status: 200 len: 1264 microversion: 2.1 time: 0.157366 Oct 30 01:14:11.809912 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 77/136] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:11 2022] GET /compute/v2.1/servers/7571f255-6ff3-4fc7-bcaa-4837bc05dbf5 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:11.822808 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-db74af19-0c31-4545-a351-cf736d6a7e3b tempest-HostsAdminNegativeTestJSON-1800607175 tempest-HostsAdminNegativeTestJSON-1800607175-project-admin] Calling method '.version_select at 0x7f44ccf448b0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:11.826812 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:INSERT=11,nova_api:RELEASE=4,nova_api:SAVEPOINT=3,nova_api:SELECT=82 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:11.839366 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-db74af19-0c31-4545-a351-cf736d6a7e3b tempest-HostsAdminNegativeTestJSON-1800607175 tempest-HostsAdminNegativeTestJSON-1800607175-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 30 01:14:11.843076 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-db74af19-0c31-4545-a351-cf736d6a7e3b tempest-HostsAdminNegativeTestJSON-1800607175 tempest-HostsAdminNegativeTestJSON-1800607175-project-admin] Request method failure captured: Oct 30 01:14:11.843076 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 30 01:14:11.843076 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:14:11.843076 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:14:11.843076 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:14:11.843076 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:14:11.843076 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:14:11.843076 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:14:11.843076 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:14:11.843076 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:14:11.843076 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXc_f6NR4mFsvOGicDgyz8gZdPPjmHLHa7Wh2nLAfqnHhCLDT2mEW2I3bwIhQA43kbaSP3YA-FZIMa5ENrd66b2X8MG1v6WKnlmyp2vJJLPjLKA4-HR5OXnTTSYkH0HuhApYcn9_7l5NYKNXgEGRfagkeY-IDT-Afeh3j2khLvfXipoU Oct 30 01:14:11.843076 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:14:11.843076 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:14:11.843076 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:14:11.843076 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:14:11.843076 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:14:11.843076 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:14:11.843076 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 9e08e00f6d124462bc36d474ac3d1e59 Oct 30 01:14:11.843076 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1800607175 Oct 30 01:14:11.843076 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,admin,reader Oct 30 01:14:11.843076 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,admin,reader Oct 30 01:14:11.844567 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9e08e00f6d124462bc36d474ac3d1e59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9e08e00f6d124462bc36d474ac3d1e59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9e08e00f6d124462bc36d474ac3d1e59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9e08e00f6d124462bc36d474ac3d1e59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:14:11.844567 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1800607175 Oct 30 01:14:11.844567 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 9e08e00f6d124462bc36d474ac3d1e59 Oct 30 01:14:11.844567 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1800607175 Oct 30 01:14:11.844567 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-HostsAdminNegativeTestJSON-1800607175-project-admin Oct 30 01:14:11.844567 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:14:11.844567 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:14:11.844567 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: e590aac4a07f4867a249f723fa6a3d37 Oct 30 01:14:11.844567 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1800607175-project-admin Oct 30 01:14:11.844567 n-d-master-1 devstack@n-api.service[121103]: method: Oct 30 01:14:11.844567 n-d-master-1 devstack@n-api.service[121103]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 30 01:14:11.844567 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'nonexistent_hostname'} Oct 30 01:14:11.844567 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:14:11.845458 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:11.845458 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 30 01:14:11.845458 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 30 01:14:11.845458 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 01:14:11.845458 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 01:14:11.845458 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 30 01:14:11.845458 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 30 01:14:11.845458 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 30 01:14:11.845458 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 30 01:14:11.845458 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 30 01:14:11.845458 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 30 01:14:11.845458 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 30 01:14:11.845458 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:11.845458 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:11.845458 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:11.845458 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:11.845458 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:11.845458 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:11.845458 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:14:11.846784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:14:11.846784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:14:11.846784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:14:11.846784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:14:11.846784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:14:11.846784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 30 01:14:11.846784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:14:11.846784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 30 01:14:11.846784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:11.846784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:11.846784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:11.846784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:11.846784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:11.846784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:11.846784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:14:11.846784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:14:11.846784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 30 01:14:11.846784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:11.848157 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-db74af19-0c31-4545-a351-cf736d6a7e3b tempest-HostsAdminNegativeTestJSON-1800607175 tempest-HostsAdminNegativeTestJSON-1800607175-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:14:11.850881 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-db74af19-0c31-4545-a351-cf736d6a7e3b tempest-HostsAdminNegativeTestJSON-1800607175 tempest-HostsAdminNegativeTestJSON-1800607175-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.039930 Oct 30 01:14:11.852328 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 78/137] 10.222.0.13 () {58 vars in 1191 bytes} [Sun Oct 30 01:14:11 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:14:11.867524 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7cfe81ff-d0b7-478e-997b-914847c6fcbd tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:11.870929 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7cfe81ff-d0b7-478e-997b-914847c6fcbd tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 7e81dcfb-dcbe-4e05-91a4-541ff2c404ae] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:11.888266 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7cfe81ff-d0b7-478e-997b-914847c6fcbd tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:11.888914 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7cfe81ff-d0b7-478e-997b-914847c6fcbd tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:11.889531 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7cfe81ff-d0b7-478e-997b-914847c6fcbd tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:11.890347 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7cfe81ff-d0b7-478e-997b-914847c6fcbd tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:11.891711 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c74d6958-a317-4eba-9e59-ce53d79aede9 tempest-FlavorsV261TestJSON-863372724 tempest-FlavorsV261TestJSON-863372724-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 0.654891 Oct 30 01:14:11.892379 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7cfe81ff-d0b7-478e-997b-914847c6fcbd tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:11.892993 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7cfe81ff-d0b7-478e-997b-914847c6fcbd tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:11.897894 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 60/138] 10.222.0.13 () {62 vars in 1188 bytes} [Sun Oct 30 01:14:11 2022] POST /compute/v2.1/flavors => generated 468 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:14:11.906675 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d5cfc8d9-86a8-43db-9dbe-e22cdd9cce1c tempest-HostsAdminNegativeTestJSON-1296901282 tempest-HostsAdminNegativeTestJSON-1296901282-project] Calling method '.version_select at 0x7f44ccc85790>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:11.915742 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d5cfc8d9-86a8-43db-9dbe-e22cdd9cce1c tempest-HostsAdminNegativeTestJSON-1296901282 tempest-HostsAdminNegativeTestJSON-1296901282-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'fc425a8158474f1fae8733437a74eb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c467cf21efd4aadbf05ded4ff3d2f40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:11.919405 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d5cfc8d9-86a8-43db-9dbe-e22cdd9cce1c tempest-HostsAdminNegativeTestJSON-1296901282 tempest-HostsAdminNegativeTestJSON-1296901282-project] Request method failure captured: Oct 30 01:14:11.919405 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/os-hosts/n-d-master-1/shutdown HTTP/1.1 Oct 30 01:14:11.919405 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:14:11.919405 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:14:11.919405 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:14:11.919405 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:14:11.919405 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:14:11.919405 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:14:11.919405 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:14:11.919405 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:14:11.919405 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXc_dUuQo3hUsYjEntXSMlTYYnB09L-6bFBPe91LZ5N3xGBI90w_Mxemksn6FxdpeXQNRb-iO92HcEUzCfH390yCo0fLHiFCh3uxzwQtMffFAYYAoYiZ7U9ShMm9MBH4yZvJZt0B6pVscvCPXA0avZ_Ghuldnh62p570NExJDztwmRd4 Oct 30 01:14:11.919405 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:14:11.919405 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:14:11.919405 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:14:11.919405 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:14:11.919405 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:14:11.919405 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:14:11.919405 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 1c467cf21efd4aadbf05ded4ff3d2f40 Oct 30 01:14:11.919405 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1296901282 Oct 30 01:14:11.919405 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:14:11.919405 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:14:11.920902 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1c467cf21efd4aadbf05ded4ff3d2f40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1c467cf21efd4aadbf05ded4ff3d2f40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1c467cf21efd4aadbf05ded4ff3d2f40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1c467cf21efd4aadbf05ded4ff3d2f40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:14:11.920902 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1296901282 Oct 30 01:14:11.920902 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 1c467cf21efd4aadbf05ded4ff3d2f40 Oct 30 01:14:11.920902 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1296901282 Oct 30 01:14:11.920902 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-HostsAdminNegativeTestJSON-1296901282-project Oct 30 01:14:11.920902 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:14:11.920902 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:14:11.920902 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: fc425a8158474f1fae8733437a74eb9f Oct 30 01:14:11.920902 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1296901282-project Oct 30 01:14:11.920902 n-d-master-1 devstack@n-api.service[121102]: method: Oct 30 01:14:11.920902 n-d-master-1 devstack@n-api.service[121102]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 30 01:14:11.920902 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'n-d-master-1'} Oct 30 01:14:11.920902 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:14:11.921676 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:11.921676 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:11.921676 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:11.921676 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:14:11.921676 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:14:11.921676 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:14:11.921676 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:14:11.921676 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:14:11.921676 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:14:11.921676 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 30 01:14:11.921676 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 30 01:14:11.921676 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 30 01:14:11.921676 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 30 01:14:11.921676 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 30 01:14:11.921676 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 30 01:14:11.921676 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 01:14:11.921676 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 30 01:14:11.921676 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 01:14:11.921676 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise self.value Oct 30 01:14:11.923028 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 30 01:14:11.923028 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 30 01:14:11.923028 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 30 01:14:11.923028 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 30 01:14:11.923028 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 30 01:14:11.923028 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 30 01:14:11.923028 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 30 01:14:11.923028 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:11.923028 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:11.923028 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:11.923028 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:11.923028 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:11.923028 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:11.923028 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 30 01:14:11.923028 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 30 01:14:11.923028 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 30 01:14:11.923028 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:11.928029 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d5cfc8d9-86a8-43db-9dbe-e22cdd9cce1c tempest-HostsAdminNegativeTestJSON-1296901282 tempest-HostsAdminNegativeTestJSON-1296901282-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:14:11.932901 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d5cfc8d9-86a8-43db-9dbe-e22cdd9cce1c tempest-HostsAdminNegativeTestJSON-1296901282 tempest-HostsAdminNegativeTestJSON-1296901282-project] 10.222.0.13 "GET /compute/v2.1/os-hosts/n-d-master-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.033290 Oct 30 01:14:11.943427 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 61/139] 10.222.0.13 () {58 vars in 1194 bytes} [Sun Oct 30 01:14:11 2022] GET /compute/v2.1/os-hosts/n-d-master-1/shutdown => generated 113 bytes in 45 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:14:12.267785 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-57b6affa-5f20-4947-aa40-93c9d73fa1b2 tempest-FlavorsV261TestJSON-637812996 tempest-FlavorsV261TestJSON-637812996-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:12.287215 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-57b6affa-5f20-4947-aa40-93c9d73fa1b2 tempest-FlavorsV261TestJSON-637812996 tempest-FlavorsV261TestJSON-637812996-project] 10.222.0.13 "GET /compute/v2.1/flavors/1529992650" status: 200 len: 468 microversion: 2.61 time: 0.342372 Oct 30 01:14:12.293013 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 62/140] 10.222.0.13 () {60 vars in 1199 bytes} [Sun Oct 30 01:14:11 2022] GET /compute/v2.1/flavors/1529992650 => generated 468 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:14:12.311610 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3c481402-5f15-461d-a881-eeba01b21d12 tempest-HostsAdminNegativeTestJSON-1800607175 tempest-HostsAdminNegativeTestJSON-1800607175-project-admin] Calling method '.version_select at 0x7f44ccd60310>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:12.343727 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-3c481402-5f15-461d-a881-eeba01b21d12 tempest-HostsAdminNegativeTestJSON-1800607175 tempest-HostsAdminNegativeTestJSON-1800607175-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 30 01:14:12.350824 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3c481402-5f15-461d-a881-eeba01b21d12 tempest-HostsAdminNegativeTestJSON-1800607175 tempest-HostsAdminNegativeTestJSON-1800607175-project-admin] Request method failure captured: Oct 30 01:14:12.350824 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 30 01:14:12.350824 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:14:12.350824 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:14:12.350824 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:14:12.350824 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:14:12.350824 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:14:12.350824 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:14:12.350824 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:14:12.350824 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:14:12.350824 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXc_f6NR4mFsvOGicDgyz8gZdPPjmHLHa7Wh2nLAfqnHhCLDT2mEW2I3bwIhQA43kbaSP3YA-FZIMa5ENrd66b2X8MG1v6WKnlmyp2vJJLPjLKA4-HR5OXnTTSYkH0HuhApYcn9_7l5NYKNXgEGRfagkeY-IDT-Afeh3j2khLvfXipoU Oct 30 01:14:12.350824 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:14:12.350824 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:14:12.350824 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:14:12.350824 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:14:12.350824 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:14:12.350824 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:14:12.350824 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 9e08e00f6d124462bc36d474ac3d1e59 Oct 30 01:14:12.350824 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1800607175 Oct 30 01:14:12.350824 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,admin,reader Oct 30 01:14:12.350824 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,admin,reader Oct 30 01:14:12.352252 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9e08e00f6d124462bc36d474ac3d1e59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9e08e00f6d124462bc36d474ac3d1e59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9e08e00f6d124462bc36d474ac3d1e59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9e08e00f6d124462bc36d474ac3d1e59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:14:12.352252 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1800607175 Oct 30 01:14:12.352252 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 9e08e00f6d124462bc36d474ac3d1e59 Oct 30 01:14:12.352252 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1800607175 Oct 30 01:14:12.352252 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-HostsAdminNegativeTestJSON-1800607175-project-admin Oct 30 01:14:12.352252 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:14:12.352252 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:14:12.352252 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: e590aac4a07f4867a249f723fa6a3d37 Oct 30 01:14:12.352252 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1800607175-project-admin Oct 30 01:14:12.352252 n-d-master-1 devstack@n-api.service[121102]: method: Oct 30 01:14:12.352252 n-d-master-1 devstack@n-api.service[121102]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 30 01:14:12.352252 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'nonexistent_hostname'} Oct 30 01:14:12.352252 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:14:12.353132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:12.353132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 30 01:14:12.353132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 30 01:14:12.353132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 30 01:14:12.353132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 30 01:14:12.353132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 01:14:12.353132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 30 01:14:12.353132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 01:14:12.353132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise self.value Oct 30 01:14:12.353132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 30 01:14:12.353132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 30 01:14:12.353132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 30 01:14:12.353132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 30 01:14:12.353132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 01:14:12.353132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 01:14:12.353132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 30 01:14:12.353132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 30 01:14:12.353132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 30 01:14:12.353132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 30 01:14:12.354431 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 30 01:14:12.354431 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 30 01:14:12.354431 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 30 01:14:12.354431 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:12.354431 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:12.354431 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:12.354431 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:12.354431 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:12.354431 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:12.354431 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:14:12.354431 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:14:12.354431 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:14:12.354431 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:14:12.354431 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:14:12.354431 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:14:12.354431 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 30 01:14:12.354431 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 30 01:14:12.354431 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 30 01:14:12.354431 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:14:12.355735 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 30 01:14:12.355735 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:12.355735 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:12.355735 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:12.355735 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:12.355735 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:12.355735 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:12.355735 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:14:12.355735 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:14:12.355735 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 30 01:14:12.355735 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:12.356447 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7cfe81ff-d0b7-478e-997b-914847c6fcbd tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:12.357394 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3c481402-5f15-461d-a881-eeba01b21d12 tempest-HostsAdminNegativeTestJSON-1800607175 tempest-HostsAdminNegativeTestJSON-1800607175-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:14:12.358364 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3c481402-5f15-461d-a881-eeba01b21d12 tempest-HostsAdminNegativeTestJSON-1800607175 tempest-HostsAdminNegativeTestJSON-1800607175-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.054269 Oct 30 01:14:12.360206 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 63/141] 10.222.0.13 () {58 vars in 1218 bytes} [Sun Oct 30 01:14:12 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:14:12.372149 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7cfe81ff-d0b7-478e-997b-914847c6fcbd tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae" status: 200 len: 1302 microversion: 2.1 time: 0.509402 Oct 30 01:14:12.372149 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 79/142] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:11 2022] GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae => generated 1302 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:12.372552 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8618ec0e-b6b7-4583-94de-efe673bce8b6 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:12.372552 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8618ec0e-b6b7-4583-94de-efe673bce8b6 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] [instance: ba2968b1-c8ef-4ec2-9d98-66da2c62919b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:12.372720 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ab546fbc-7786-4f04-9907-77fb8d777200 tempest-FlavorsV261TestJSON-863372724 tempest-FlavorsV261TestJSON-863372724-project-admin] Action: 'update', calling method: .version_select at 0x7f44cdf99d30>, body: {"flavor": {"description": "new"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:12.380677 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8618ec0e-b6b7-4583-94de-efe673bce8b6 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:12.381285 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8618ec0e-b6b7-4583-94de-efe673bce8b6 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:12.384006 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8618ec0e-b6b7-4583-94de-efe673bce8b6 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:12.384989 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8618ec0e-b6b7-4583-94de-efe673bce8b6 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:12.385584 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8618ec0e-b6b7-4583-94de-efe673bce8b6 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:12.386236 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8618ec0e-b6b7-4583-94de-efe673bce8b6 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:12.483247 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ab546fbc-7786-4f04-9907-77fb8d777200 tempest-FlavorsV261TestJSON-863372724 tempest-FlavorsV261TestJSON-863372724-project-admin] 10.222.0.13 "PUT /compute/v2.1/flavors/1529992650" status: 200 len: 469 microversion: 2.61 time: 0.114350 Oct 30 01:14:12.484467 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 80/143] 10.222.0.13 () {62 vars in 1219 bytes} [Sun Oct 30 01:14:12 2022] PUT /compute/v2.1/flavors/1529992650 => generated 469 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:14:12.490924 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-aef45623-536e-40ab-92b6-b5c4fa29a74f tempest-HostsAdminNegativeTestJSON-1296901282 tempest-HostsAdminNegativeTestJSON-1296901282-project] Calling method '.version_select at 0x7f44cccf3820>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:12.493145 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-aef45623-536e-40ab-92b6-b5c4fa29a74f tempest-HostsAdminNegativeTestJSON-1296901282 tempest-HostsAdminNegativeTestJSON-1296901282-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'fc425a8158474f1fae8733437a74eb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c467cf21efd4aadbf05ded4ff3d2f40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:12.495433 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-aef45623-536e-40ab-92b6-b5c4fa29a74f tempest-HostsAdminNegativeTestJSON-1296901282 tempest-HostsAdminNegativeTestJSON-1296901282-project] Request method failure captured: Oct 30 01:14:12.495433 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/os-hosts/n-d-master-1/startup HTTP/1.1 Oct 30 01:14:12.495433 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:14:12.495433 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:14:12.495433 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:14:12.495433 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:14:12.495433 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:14:12.495433 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:14:12.495433 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:14:12.495433 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:14:12.495433 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXc_dUuQo3hUsYjEntXSMlTYYnB09L-6bFBPe91LZ5N3xGBI90w_Mxemksn6FxdpeXQNRb-iO92HcEUzCfH390yCo0fLHiFCh3uxzwQtMffFAYYAoYiZ7U9ShMm9MBH4yZvJZt0B6pVscvCPXA0avZ_Ghuldnh62p570NExJDztwmRd4 Oct 30 01:14:12.495433 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:14:12.495433 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:14:12.495433 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:14:12.495433 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:14:12.495433 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:14:12.495433 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:14:12.495433 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 1c467cf21efd4aadbf05ded4ff3d2f40 Oct 30 01:14:12.495433 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1296901282 Oct 30 01:14:12.495433 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:14:12.495433 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:14:12.496861 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1c467cf21efd4aadbf05ded4ff3d2f40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1c467cf21efd4aadbf05ded4ff3d2f40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1c467cf21efd4aadbf05ded4ff3d2f40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1c467cf21efd4aadbf05ded4ff3d2f40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:14:12.496861 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1296901282 Oct 30 01:14:12.496861 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 1c467cf21efd4aadbf05ded4ff3d2f40 Oct 30 01:14:12.496861 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1296901282 Oct 30 01:14:12.496861 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-HostsAdminNegativeTestJSON-1296901282-project Oct 30 01:14:12.496861 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:14:12.496861 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:14:12.496861 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: fc425a8158474f1fae8733437a74eb9f Oct 30 01:14:12.496861 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1296901282-project Oct 30 01:14:12.496861 n-d-master-1 devstack@n-api.service[121103]: method: Oct 30 01:14:12.496861 n-d-master-1 devstack@n-api.service[121103]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 30 01:14:12.496861 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'n-d-master-1'} Oct 30 01:14:12.496861 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:14:12.497873 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:12.497873 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:12.497873 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:12.497873 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:14:12.497873 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:14:12.497873 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:14:12.497873 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:14:12.497873 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:14:12.497873 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:14:12.497873 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 30 01:14:12.497873 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 30 01:14:12.497873 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 30 01:14:12.497873 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 30 01:14:12.497873 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 30 01:14:12.497873 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 30 01:14:12.497873 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 01:14:12.497873 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 30 01:14:12.497873 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 01:14:12.497873 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise self.value Oct 30 01:14:12.499168 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 30 01:14:12.499168 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 30 01:14:12.499168 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 30 01:14:12.499168 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 30 01:14:12.499168 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 30 01:14:12.499168 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 30 01:14:12.499168 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 30 01:14:12.499168 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:12.499168 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:12.499168 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:12.499168 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:12.499168 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:12.499168 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:12.499168 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 30 01:14:12.499168 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 30 01:14:12.499168 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 30 01:14:12.499168 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:12.502354 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-aef45623-536e-40ab-92b6-b5c4fa29a74f tempest-HostsAdminNegativeTestJSON-1296901282 tempest-HostsAdminNegativeTestJSON-1296901282-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:14:12.503296 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-aef45623-536e-40ab-92b6-b5c4fa29a74f tempest-HostsAdminNegativeTestJSON-1296901282 tempest-HostsAdminNegativeTestJSON-1296901282-project] 10.222.0.13 "GET /compute/v2.1/os-hosts/n-d-master-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.017684 Oct 30 01:14:12.507740 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 81/144] 10.222.0.13 () {58 vars in 1191 bytes} [Sun Oct 30 01:14:12 2022] GET /compute/v2.1/os-hosts/n-d-master-1/startup => generated 110 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:14:12.510783 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e35cef35-6662-470a-8f8d-4fe3f1915f21 tempest-FlavorsV261TestJSON-637812996 tempest-FlavorsV261TestJSON-637812996-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:12.546911 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e35cef35-6662-470a-8f8d-4fe3f1915f21 tempest-FlavorsV261TestJSON-637812996 tempest-FlavorsV261TestJSON-637812996-project] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 7160 microversion: 2.61 time: 0.041782 Oct 30 01:14:12.548144 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 82/145] 10.222.0.13 () {60 vars in 1187 bytes} [Sun Oct 30 01:14:12 2022] GET /compute/v2.1/flavors/detail => generated 7160 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:14:12.553957 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f33d207d-40f7-45df-bc19-63e794fd15d5 tempest-HostsAdminNegativeTestJSON-1800607175 tempest-HostsAdminNegativeTestJSON-1800607175-project-admin] Calling method '.version_select at 0x7f44ccf44790>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:12.556088 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8618ec0e-b6b7-4583-94de-efe673bce8b6 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9211a459e946c1a114983c531a8897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6543b666064cd78c02ec5a471d003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:12.563994 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-f33d207d-40f7-45df-bc19-63e794fd15d5 tempest-HostsAdminNegativeTestJSON-1800607175 tempest-HostsAdminNegativeTestJSON-1800607175-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 30 01:14:12.566409 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8618ec0e-b6b7-4583-94de-efe673bce8b6 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] 10.222.0.13 "GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b" status: 200 len: 1338 microversion: 2.1 time: 0.204897 Oct 30 01:14:12.566550 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f33d207d-40f7-45df-bc19-63e794fd15d5 tempest-HostsAdminNegativeTestJSON-1800607175 tempest-HostsAdminNegativeTestJSON-1800607175-project-admin] Request method failure captured: Oct 30 01:14:12.566550 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 30 01:14:12.566550 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:14:12.566550 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:14:12.566550 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:14:12.566550 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:14:12.566550 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:14:12.566550 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:14:12.566550 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:14:12.566550 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:14:12.566550 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXc_f6NR4mFsvOGicDgyz8gZdPPjmHLHa7Wh2nLAfqnHhCLDT2mEW2I3bwIhQA43kbaSP3YA-FZIMa5ENrd66b2X8MG1v6WKnlmyp2vJJLPjLKA4-HR5OXnTTSYkH0HuhApYcn9_7l5NYKNXgEGRfagkeY-IDT-Afeh3j2khLvfXipoU Oct 30 01:14:12.566550 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:14:12.566550 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:14:12.566550 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:14:12.566550 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:14:12.566550 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:14:12.566550 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:14:12.566550 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 9e08e00f6d124462bc36d474ac3d1e59 Oct 30 01:14:12.566550 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1800607175 Oct 30 01:14:12.566550 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,admin,reader Oct 30 01:14:12.566550 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,admin,reader Oct 30 01:14:12.572949 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9e08e00f6d124462bc36d474ac3d1e59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9e08e00f6d124462bc36d474ac3d1e59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9e08e00f6d124462bc36d474ac3d1e59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9e08e00f6d124462bc36d474ac3d1e59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:14:12.572949 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1800607175 Oct 30 01:14:12.572949 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 9e08e00f6d124462bc36d474ac3d1e59 Oct 30 01:14:12.572949 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1800607175 Oct 30 01:14:12.572949 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-HostsAdminNegativeTestJSON-1800607175-project-admin Oct 30 01:14:12.572949 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:14:12.572949 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:14:12.572949 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: e590aac4a07f4867a249f723fa6a3d37 Oct 30 01:14:12.572949 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1800607175-project-admin Oct 30 01:14:12.572949 n-d-master-1 devstack@n-api.service[121103]: method: Oct 30 01:14:12.572949 n-d-master-1 devstack@n-api.service[121103]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 30 01:14:12.572949 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'nonexistent_hostname'} Oct 30 01:14:12.572949 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:14:12.573788 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:12.573788 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 30 01:14:12.573788 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 30 01:14:12.573788 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 30 01:14:12.573788 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 30 01:14:12.573788 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 01:14:12.573788 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 30 01:14:12.573788 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 01:14:12.573788 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise self.value Oct 30 01:14:12.573788 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 30 01:14:12.573788 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 30 01:14:12.573788 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 30 01:14:12.573788 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 30 01:14:12.573788 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 01:14:12.573788 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 01:14:12.573788 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 30 01:14:12.573788 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 30 01:14:12.573788 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 30 01:14:12.573788 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 30 01:14:12.574987 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 30 01:14:12.574987 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 30 01:14:12.574987 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 30 01:14:12.574987 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:12.574987 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:12.574987 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:12.574987 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:12.574987 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:12.574987 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:12.574987 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:14:12.574987 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:14:12.574987 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:14:12.574987 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:14:12.574987 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:14:12.574987 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:14:12.574987 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 30 01:14:12.574987 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 30 01:14:12.574987 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 30 01:14:12.574987 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:14:12.576137 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 30 01:14:12.576137 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:12.576137 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:12.576137 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:12.576137 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:12.576137 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:12.576137 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:12.576137 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:14:12.576137 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:14:12.576137 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 30 01:14:12.576137 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:12.576735 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 64/146] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:12 2022] GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b => generated 1338 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:12.576821 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f33d207d-40f7-45df-bc19-63e794fd15d5 tempest-HostsAdminNegativeTestJSON-1800607175 tempest-HostsAdminNegativeTestJSON-1800607175-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:14:12.576821 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f33d207d-40f7-45df-bc19-63e794fd15d5 tempest-HostsAdminNegativeTestJSON-1800607175 tempest-HostsAdminNegativeTestJSON-1800607175-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.018501 Oct 30 01:14:12.576821 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 83/147] 10.222.0.13 () {58 vars in 1215 bytes} [Sun Oct 30 01:14:12 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:14:12.579115 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d7f7d54b-acf4-4699-9c46-91fb87e7609d tempest-FlavorsV261TestJSON-637812996 tempest-FlavorsV261TestJSON-637812996-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:12.588429 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6e8c6654-9bce-4bef-89a0-a11f76afb5de tempest-HostsAdminNegativeTestJSON-1800607175 tempest-HostsAdminNegativeTestJSON-1800607175-project-admin] Action: 'update', calling method: .version_select at 0x7f44ccec4790>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:12.594315 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6e8c6654-9bce-4bef-89a0-a11f76afb5de tempest-HostsAdminNegativeTestJSON-1800607175 tempest-HostsAdminNegativeTestJSON-1800607175-project-admin] Request method failure captured: Oct 30 01:14:12.594315 n-d-master-1 devstack@n-api.service[121103]: request: PUT /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Oct 30 01:14:12.594315 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:14:12.594315 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:14:12.594315 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:14:12.594315 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 51 Oct 30 01:14:12.594315 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:14:12.594315 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:14:12.594315 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:14:12.594315 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:14:12.594315 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXc_f6NR4mFsvOGicDgyz8gZdPPjmHLHa7Wh2nLAfqnHhCLDT2mEW2I3bwIhQA43kbaSP3YA-FZIMa5ENrd66b2X8MG1v6WKnlmyp2vJJLPjLKA4-HR5OXnTTSYkH0HuhApYcn9_7l5NYKNXgEGRfagkeY-IDT-Afeh3j2khLvfXipoU Oct 30 01:14:12.594315 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:14:12.594315 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:14:12.594315 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:14:12.594315 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:14:12.594315 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:14:12.594315 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:14:12.594315 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 9e08e00f6d124462bc36d474ac3d1e59 Oct 30 01:14:12.594315 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1800607175 Oct 30 01:14:12.594315 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,admin,reader Oct 30 01:14:12.594315 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,admin,reader Oct 30 01:14:12.597254 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9e08e00f6d124462bc36d474ac3d1e59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9e08e00f6d124462bc36d474ac3d1e59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9e08e00f6d124462bc36d474ac3d1e59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9e08e00f6d124462bc36d474ac3d1e59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:14:12.597254 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1800607175 Oct 30 01:14:12.597254 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 9e08e00f6d124462bc36d474ac3d1e59 Oct 30 01:14:12.597254 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1800607175 Oct 30 01:14:12.597254 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-HostsAdminNegativeTestJSON-1800607175-project-admin Oct 30 01:14:12.597254 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:14:12.597254 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:14:12.597254 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: e590aac4a07f4867a249f723fa6a3d37 Oct 30 01:14:12.597254 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1800607175-project-admin Oct 30 01:14:12.597254 n-d-master-1 devstack@n-api.service[121103]: Oct 30 01:14:12.597254 n-d-master-1 devstack@n-api.service[121103]: {"status": "enable", "maintenance_mode": "invalid"} Oct 30 01:14:12.597254 n-d-master-1 devstack@n-api.service[121103]: method: Oct 30 01:14:12.597254 n-d-master-1 devstack@n-api.service[121103]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 30 01:14:12.598146 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'n-d-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 30 01:14:12.598146 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:14:12.598146 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:12.598146 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 30 01:14:12.598146 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 30 01:14:12.598146 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 30 01:14:12.598146 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise error Oct 30 01:14:12.598146 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 30 01:14:12.598146 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:12.598146 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 30 01:14:12.598146 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 30 01:14:12.598146 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi 'disable', Oct 30 01:14:12.598146 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi 'Enable', Oct 30 01:14:12.598146 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi 'Disable', Oct 30 01:14:12.598146 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 30 01:14:12.598146 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 30 01:14:12.598146 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 30 01:14:12.598146 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:12.598146 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi On instance: Oct 30 01:14:12.598146 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi 'invalid' Oct 30 01:14:12.598146 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:12.598146 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:12.598146 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:12.598146 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:12.598146 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:12.599661 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:12.599661 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:14:12.599661 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:14:12.599661 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:14:12.599661 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:14:12.599661 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:14:12.599661 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:14:12.599661 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 30 01:14:12.599661 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 30 01:14:12.599661 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 30 01:14:12.599661 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 30 01:14:12.599661 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 30 01:14:12.599661 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 30 01:14:12.599661 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 30 01:14:12.599661 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:12.599661 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:12.599661 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:12.599661 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:12.599661 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:12.600855 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:12.600855 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 30 01:14:12.600855 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 30 01:14:12.600855 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 30 01:14:12.600855 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:12.600855 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6e8c6654-9bce-4bef-89a0-a11f76afb5de tempest-HostsAdminNegativeTestJSON-1800607175 tempest-HostsAdminNegativeTestJSON-1800607175-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:14:12.600855 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6e8c6654-9bce-4bef-89a0-a11f76afb5de tempest-HostsAdminNegativeTestJSON-1800607175 tempest-HostsAdminNegativeTestJSON-1800607175-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-hosts/n-d-master-1" status: 400 len: 199 microversion: 2.1 time: 0.013149 Oct 30 01:14:12.600855 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 84/148] 10.222.0.13 () {60 vars in 1187 bytes} [Sun Oct 30 01:14:12 2022] PUT /compute/v2.1/os-hosts/n-d-master-1 => generated 199 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:14:12.616017 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d7f7d54b-acf4-4699-9c46-91fb87e7609d tempest-FlavorsV261TestJSON-637812996 tempest-FlavorsV261TestJSON-637812996-project] 10.222.0.13 "GET /compute/v2.1/flavors" status: 200 len: 3687 microversion: 2.61 time: 0.045763 Oct 30 01:14:12.616768 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 65/149] 10.222.0.13 () {60 vars in 1166 bytes} [Sun Oct 30 01:14:12 2022] GET /compute/v2.1/flavors => generated 3687 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:14:12.641937 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bfb085bb-0e2e-4c47-9763-be07903bc829 tempest-FlavorsV261TestJSON-863372724 tempest-FlavorsV261TestJSON-863372724-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:12.761818 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5b674e8e-8038-43a7-97be-07109bb43b23 tempest-HostsAdminNegativeTestJSON-1800607175 tempest-HostsAdminNegativeTestJSON-1800607175-project-admin] Action: 'update', calling method: .version_select at 0x7f44cd045ca0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:12.765464 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5b674e8e-8038-43a7-97be-07109bb43b23 tempest-HostsAdminNegativeTestJSON-1800607175 tempest-HostsAdminNegativeTestJSON-1800607175-project-admin] Request method failure captured: Oct 30 01:14:12.765464 n-d-master-1 devstack@n-api.service[121103]: request: PUT /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Oct 30 01:14:12.765464 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:14:12.765464 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:14:12.765464 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:14:12.765464 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 51 Oct 30 01:14:12.765464 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:14:12.765464 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:14:12.765464 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:14:12.765464 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:14:12.765464 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXc_f6NR4mFsvOGicDgyz8gZdPPjmHLHa7Wh2nLAfqnHhCLDT2mEW2I3bwIhQA43kbaSP3YA-FZIMa5ENrd66b2X8MG1v6WKnlmyp2vJJLPjLKA4-HR5OXnTTSYkH0HuhApYcn9_7l5NYKNXgEGRfagkeY-IDT-Afeh3j2khLvfXipoU Oct 30 01:14:12.765464 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:14:12.765464 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:14:12.765464 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:14:12.765464 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:14:12.765464 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:14:12.765464 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:14:12.765464 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 9e08e00f6d124462bc36d474ac3d1e59 Oct 30 01:14:12.765464 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1800607175 Oct 30 01:14:12.765464 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,admin,reader Oct 30 01:14:12.765464 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,admin,reader Oct 30 01:14:12.774358 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9e08e00f6d124462bc36d474ac3d1e59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9e08e00f6d124462bc36d474ac3d1e59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9e08e00f6d124462bc36d474ac3d1e59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9e08e00f6d124462bc36d474ac3d1e59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:14:12.774358 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1800607175 Oct 30 01:14:12.774358 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 9e08e00f6d124462bc36d474ac3d1e59 Oct 30 01:14:12.774358 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1800607175 Oct 30 01:14:12.774358 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-HostsAdminNegativeTestJSON-1800607175-project-admin Oct 30 01:14:12.774358 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:14:12.774358 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:14:12.774358 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: e590aac4a07f4867a249f723fa6a3d37 Oct 30 01:14:12.774358 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1800607175-project-admin Oct 30 01:14:12.774358 n-d-master-1 devstack@n-api.service[121103]: Oct 30 01:14:12.774358 n-d-master-1 devstack@n-api.service[121103]: {"status": "invalid", "maintenance_mode": "enable"} Oct 30 01:14:12.774358 n-d-master-1 devstack@n-api.service[121103]: method: Oct 30 01:14:12.774358 n-d-master-1 devstack@n-api.service[121103]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 30 01:14:12.775241 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'n-d-master-1', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 30 01:14:12.775241 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:14:12.775241 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:12.775241 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 30 01:14:12.775241 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 30 01:14:12.775241 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 30 01:14:12.775241 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise error Oct 30 01:14:12.775241 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 30 01:14:12.775241 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:12.775241 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 30 01:14:12.775241 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 30 01:14:12.775241 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi 'disable', Oct 30 01:14:12.775241 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi 'Enable', Oct 30 01:14:12.775241 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi 'Disable', Oct 30 01:14:12.775241 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 30 01:14:12.775241 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 30 01:14:12.775241 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 30 01:14:12.775241 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:12.775241 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi On instance: Oct 30 01:14:12.775241 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi 'invalid' Oct 30 01:14:12.775241 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:12.775241 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:12.775241 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:12.775241 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:12.775241 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:12.776842 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:12.776842 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:14:12.776842 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:14:12.776842 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:14:12.776842 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:14:12.776842 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:14:12.776842 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:14:12.776842 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 30 01:14:12.776842 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 30 01:14:12.776842 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 30 01:14:12.776842 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 30 01:14:12.776842 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 30 01:14:12.776842 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 30 01:14:12.776842 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 30 01:14:12.776842 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:12.776842 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:12.776842 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:12.776842 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:12.776842 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:12.778084 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:12.778084 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 30 01:14:12.778084 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 30 01:14:12.778084 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 30 01:14:12.778084 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:12.778433 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bfb085bb-0e2e-4c47-9763-be07903bc829 tempest-FlavorsV261TestJSON-863372724 tempest-FlavorsV261TestJSON-863372724-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1529992650" status: 202 len: 0 microversion: 2.61 time: 0.135537 Oct 30 01:14:12.778521 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5b674e8e-8038-43a7-97be-07109bb43b23 tempest-HostsAdminNegativeTestJSON-1800607175 tempest-HostsAdminNegativeTestJSON-1800607175-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:14:12.778615 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 66/150] 10.222.0.13 () {60 vars in 1202 bytes} [Sun Oct 30 01:14:12 2022] DELETE /compute/v2.1/flavors/1529992650 => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:14:12.778708 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5b674e8e-8038-43a7-97be-07109bb43b23 tempest-HostsAdminNegativeTestJSON-1800607175 tempest-HostsAdminNegativeTestJSON-1800607175-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-hosts/n-d-master-1" status: 400 len: 189 microversion: 2.1 time: 0.164790 Oct 30 01:14:12.778708 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 85/151] 10.222.0.13 () {60 vars in 1187 bytes} [Sun Oct 30 01:14:12 2022] PUT /compute/v2.1/os-hosts/n-d-master-1 => generated 189 bytes in 166 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:14:12.778896 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1584dcd2-8ba7-4a2b-96dc-ebfe3f002dd7 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:12.778896 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1584dcd2-8ba7-4a2b-96dc-ebfe3f002dd7 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] [instance: ac13f3c4-a93f-4664-b102-aa57f9c63308] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:12.779038 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8076aef4-5b3a-4bd9-948e-a5ff71d2c420 tempest-FlavorsV261TestJSON-863372724 tempest-FlavorsV261TestJSON-863372724-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:12.786989 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1584dcd2-8ba7-4a2b-96dc-ebfe3f002dd7 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:12.787579 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1584dcd2-8ba7-4a2b-96dc-ebfe3f002dd7 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:12.788017 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1584dcd2-8ba7-4a2b-96dc-ebfe3f002dd7 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:12.788731 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1584dcd2-8ba7-4a2b-96dc-ebfe3f002dd7 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:12.789433 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1584dcd2-8ba7-4a2b-96dc-ebfe3f002dd7 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:12.790221 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1584dcd2-8ba7-4a2b-96dc-ebfe3f002dd7 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:12.825906 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8076aef4-5b3a-4bd9-948e-a5ff71d2c420 tempest-FlavorsV261TestJSON-863372724 tempest-FlavorsV261TestJSON-863372724-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 6701 microversion: 2.61 time: 0.051597 Oct 30 01:14:12.826725 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 86/152] 10.222.0.13 () {60 vars in 1187 bytes} [Sun Oct 30 01:14:12 2022] GET /compute/v2.1/flavors/detail => generated 6701 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:14:12.833049 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6c48348c-a90b-499e-8f09-d58949ca09d6 tempest-HostsAdminNegativeTestJSON-1296901282 tempest-HostsAdminNegativeTestJSON-1296901282-project] Action: 'update', calling method: .version_select at 0x7f44ccea6700>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:12.836710 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6c48348c-a90b-499e-8f09-d58949ca09d6 tempest-HostsAdminNegativeTestJSON-1296901282 tempest-HostsAdminNegativeTestJSON-1296901282-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'fc425a8158474f1fae8733437a74eb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c467cf21efd4aadbf05ded4ff3d2f40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:12.838410 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6c48348c-a90b-499e-8f09-d58949ca09d6 tempest-HostsAdminNegativeTestJSON-1296901282 tempest-HostsAdminNegativeTestJSON-1296901282-project] Request method failure captured: Oct 30 01:14:12.838410 n-d-master-1 devstack@n-api.service[121103]: request: PUT /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Oct 30 01:14:12.838410 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:14:12.838410 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:14:12.838410 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:14:12.838410 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 50 Oct 30 01:14:12.838410 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:14:12.838410 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:14:12.838410 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:14:12.838410 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:14:12.838410 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXc_dUuQo3hUsYjEntXSMlTYYnB09L-6bFBPe91LZ5N3xGBI90w_Mxemksn6FxdpeXQNRb-iO92HcEUzCfH390yCo0fLHiFCh3uxzwQtMffFAYYAoYiZ7U9ShMm9MBH4yZvJZt0B6pVscvCPXA0avZ_Ghuldnh62p570NExJDztwmRd4 Oct 30 01:14:12.838410 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:14:12.838410 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:14:12.838410 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:14:12.838410 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:14:12.838410 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:14:12.838410 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:14:12.838410 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 1c467cf21efd4aadbf05ded4ff3d2f40 Oct 30 01:14:12.838410 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1296901282 Oct 30 01:14:12.838410 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:14:12.838410 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:14:12.839835 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1c467cf21efd4aadbf05ded4ff3d2f40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1c467cf21efd4aadbf05ded4ff3d2f40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1c467cf21efd4aadbf05ded4ff3d2f40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1c467cf21efd4aadbf05ded4ff3d2f40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:14:12.839835 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1296901282 Oct 30 01:14:12.839835 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 1c467cf21efd4aadbf05ded4ff3d2f40 Oct 30 01:14:12.839835 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1296901282 Oct 30 01:14:12.839835 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-HostsAdminNegativeTestJSON-1296901282-project Oct 30 01:14:12.839835 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:14:12.839835 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:14:12.839835 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: fc425a8158474f1fae8733437a74eb9f Oct 30 01:14:12.839835 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1296901282-project Oct 30 01:14:12.839835 n-d-master-1 devstack@n-api.service[121103]: Oct 30 01:14:12.839835 n-d-master-1 devstack@n-api.service[121103]: {"status": "enable", "maintenance_mode": "enable"} Oct 30 01:14:12.839835 n-d-master-1 devstack@n-api.service[121103]: method: Oct 30 01:14:12.839835 n-d-master-1 devstack@n-api.service[121103]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 30 01:14:12.839835 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'n-d-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 30 01:14:12.840829 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:14:12.840829 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:12.840829 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:12.840829 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:12.840829 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:14:12.840829 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:14:12.840829 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:14:12.840829 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:14:12.840829 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:14:12.840829 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:14:12.840829 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:14:12.840829 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:14:12.840829 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 30 01:14:12.840829 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 30 01:14:12.840829 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 30 01:14:12.840829 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 30 01:14:12.840829 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 30 01:14:12.840829 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 30 01:14:12.840829 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 01:14:12.840829 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 30 01:14:12.842104 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 01:14:12.842104 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise self.value Oct 30 01:14:12.842104 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 30 01:14:12.842104 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 30 01:14:12.842104 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 30 01:14:12.842104 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 30 01:14:12.842104 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 30 01:14:12.842104 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 30 01:14:12.842104 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 30 01:14:12.842104 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:12.842104 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:12.842104 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:12.842104 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:12.842104 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:12.842104 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:12.842104 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 30 01:14:12.842104 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 30 01:14:12.842104 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 30 01:14:12.842104 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:12.844570 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6c48348c-a90b-499e-8f09-d58949ca09d6 tempest-HostsAdminNegativeTestJSON-1296901282 tempest-HostsAdminNegativeTestJSON-1296901282-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:14:12.845642 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6c48348c-a90b-499e-8f09-d58949ca09d6 tempest-HostsAdminNegativeTestJSON-1296901282 tempest-HostsAdminNegativeTestJSON-1296901282-project] 10.222.0.13 "PUT /compute/v2.1/os-hosts/n-d-master-1" status: 403 len: 111 microversion: 2.1 time: 0.017920 Oct 30 01:14:12.846626 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 87/153] 10.222.0.13 () {60 vars in 1187 bytes} [Sun Oct 30 01:14:12 2022] PUT /compute/v2.1/os-hosts/n-d-master-1 => generated 111 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:14:12.852244 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-39a272a2-923b-4f4a-a64b-dda016b17bca tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:12.852855 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-39a272a2-923b-4f4a-a64b-dda016b17bca tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] [instance: 7571f255-6ff3-4fc7-bcaa-4837bc05dbf5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:12.992042 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1584dcd2-8ba7-4a2b-96dc-ebfe3f002dd7 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464f9e9314154e3f9c779b9ae10b2a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a83b0b15194aa69fc4d82876a1e6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:13.007540 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1584dcd2-8ba7-4a2b-96dc-ebfe3f002dd7 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] 10.222.0.13 "GET /compute/v2.1/servers/ac13f3c4-a93f-4664-b102-aa57f9c63308" status: 200 len: 1318 microversion: 2.1 time: 0.237652 Oct 30 01:14:13.007540 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 67/154] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:12 2022] GET /compute/v2.1/servers/ac13f3c4-a93f-4664-b102-aa57f9c63308 => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:13.017356 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f3b81342-da2c-47ee-a5dc-edb52b13f5a2 tempest-HostsAdminNegativeTestJSON-1800607175 tempest-HostsAdminNegativeTestJSON-1800607175-project-admin] Action: 'update', calling method: .version_select at 0x7f44ccc26700>, body: {"status": null, "maintenance_mode": null} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:13.029900 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f3b81342-da2c-47ee-a5dc-edb52b13f5a2 tempest-HostsAdminNegativeTestJSON-1800607175 tempest-HostsAdminNegativeTestJSON-1800607175-project-admin] Request method failure captured: Oct 30 01:14:13.029900 n-d-master-1 devstack@n-api.service[121102]: request: PUT /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Oct 30 01:14:13.029900 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:14:13.029900 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:14:13.029900 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:14:13.029900 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 42 Oct 30 01:14:13.029900 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:14:13.029900 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:14:13.029900 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:14:13.029900 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:14:13.029900 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXc_f6NR4mFsvOGicDgyz8gZdPPjmHLHa7Wh2nLAfqnHhCLDT2mEW2I3bwIhQA43kbaSP3YA-FZIMa5ENrd66b2X8MG1v6WKnlmyp2vJJLPjLKA4-HR5OXnTTSYkH0HuhApYcn9_7l5NYKNXgEGRfagkeY-IDT-Afeh3j2khLvfXipoU Oct 30 01:14:13.029900 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:14:13.029900 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:14:13.029900 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:14:13.029900 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:14:13.029900 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:14:13.029900 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:14:13.029900 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 9e08e00f6d124462bc36d474ac3d1e59 Oct 30 01:14:13.029900 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1800607175 Oct 30 01:14:13.029900 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,admin,reader Oct 30 01:14:13.029900 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,admin,reader Oct 30 01:14:13.031483 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9e08e00f6d124462bc36d474ac3d1e59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9e08e00f6d124462bc36d474ac3d1e59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9e08e00f6d124462bc36d474ac3d1e59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9e08e00f6d124462bc36d474ac3d1e59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:14:13.031483 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1800607175 Oct 30 01:14:13.031483 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 9e08e00f6d124462bc36d474ac3d1e59 Oct 30 01:14:13.031483 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1800607175 Oct 30 01:14:13.031483 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-HostsAdminNegativeTestJSON-1800607175-project-admin Oct 30 01:14:13.031483 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:14:13.031483 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:14:13.031483 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: e590aac4a07f4867a249f723fa6a3d37 Oct 30 01:14:13.031483 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1800607175-project-admin Oct 30 01:14:13.031483 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:14:13.031483 n-d-master-1 devstack@n-api.service[121102]: {"status": null, "maintenance_mode": null} Oct 30 01:14:13.031483 n-d-master-1 devstack@n-api.service[121102]: method: Oct 30 01:14:13.031483 n-d-master-1 devstack@n-api.service[121102]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 30 01:14:13.031483 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'n-d-master-1', 'body': {'status': None, 'maintenance_mode': None}} Oct 30 01:14:13.032481 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:14:13.032481 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:13.032481 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 30 01:14:13.032481 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 30 01:14:13.032481 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 30 01:14:13.032481 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise error Oct 30 01:14:13.032481 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 30 01:14:13.032481 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:13.032481 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 30 01:14:13.032481 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 30 01:14:13.032481 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi 'disable', Oct 30 01:14:13.032481 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi 'Enable', Oct 30 01:14:13.032481 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi 'Disable', Oct 30 01:14:13.032481 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 30 01:14:13.032481 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 30 01:14:13.032481 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 30 01:14:13.032481 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:13.032481 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi On instance: Oct 30 01:14:13.032481 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi None Oct 30 01:14:13.032481 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:13.032481 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:13.032481 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:13.032481 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:13.032481 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:13.032481 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:13.034129 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:14:13.034129 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:14:13.034129 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:14:13.034129 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:14:13.034129 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:14:13.034129 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:14:13.034129 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 30 01:14:13.034129 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 30 01:14:13.034129 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 30 01:14:13.034129 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 30 01:14:13.034129 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 30 01:14:13.034129 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 30 01:14:13.034129 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 30 01:14:13.034129 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:13.034129 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:13.034129 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:13.034129 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:13.034129 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:13.034129 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:13.035246 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 30 01:14:13.035246 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 30 01:14:13.035246 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 30 01:14:13.035246 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:13.035525 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-39a272a2-923b-4f4a-a64b-dda016b17bca tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056e59c7d4c2475eb66b64e0e24367be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6f42c16eeb4e97b65cebf891105008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:13.037212 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f3b81342-da2c-47ee-a5dc-edb52b13f5a2 tempest-HostsAdminNegativeTestJSON-1800607175 tempest-HostsAdminNegativeTestJSON-1800607175-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:14:13.038367 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f3b81342-da2c-47ee-a5dc-edb52b13f5a2 tempest-HostsAdminNegativeTestJSON-1800607175 tempest-HostsAdminNegativeTestJSON-1800607175-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-hosts/n-d-master-1" status: 400 len: 127 microversion: 2.1 time: 0.030789 Oct 30 01:14:13.042484 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 68/155] 10.222.0.13 () {60 vars in 1187 bytes} [Sun Oct 30 01:14:13 2022] PUT /compute/v2.1/os-hosts/n-d-master-1 => generated 127 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:14:13.042902 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-39a272a2-923b-4f4a-a64b-dda016b17bca tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] 10.222.0.13 "GET /compute/v2.1/servers/7571f255-6ff3-4fc7-bcaa-4837bc05dbf5" status: 200 len: 1264 microversion: 2.1 time: 0.194345 Oct 30 01:14:13.053506 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8102d998-234f-46aa-8f86-2e01fe82db6c tempest-HostsAdminNegativeTestJSON-1800607175 tempest-HostsAdminNegativeTestJSON-1800607175-project-admin] Action: 'update', calling method: .version_select at 0x7f44ccb24a60>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:13.053698 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 88/156] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:12 2022] GET /compute/v2.1/servers/7571f255-6ff3-4fc7-bcaa-4837bc05dbf5 => generated 1264 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:13.058767 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.hosts [None req-8102d998-234f-46aa-8f86-2e01fe82db6c tempest-HostsAdminNegativeTestJSON-1800607175 tempest-HostsAdminNegativeTestJSON-1800607175-project-admin] Enabling host nonexistent_hostname. Oct 30 01:14:13.079942 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-8102d998-234f-46aa-8f86-2e01fe82db6c tempest-HostsAdminNegativeTestJSON-1800607175 tempest-HostsAdminNegativeTestJSON-1800607175-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 30 01:14:13.084445 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8102d998-234f-46aa-8f86-2e01fe82db6c tempest-HostsAdminNegativeTestJSON-1800607175 tempest-HostsAdminNegativeTestJSON-1800607175-project-admin] Request method failure captured: Oct 30 01:14:13.084445 n-d-master-1 devstack@n-api.service[121102]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 30 01:14:13.084445 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:14:13.084445 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:14:13.084445 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:14:13.084445 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 50 Oct 30 01:14:13.084445 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:14:13.084445 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:14:13.084445 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:14:13.084445 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:14:13.084445 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXc_f6NR4mFsvOGicDgyz8gZdPPjmHLHa7Wh2nLAfqnHhCLDT2mEW2I3bwIhQA43kbaSP3YA-FZIMa5ENrd66b2X8MG1v6WKnlmyp2vJJLPjLKA4-HR5OXnTTSYkH0HuhApYcn9_7l5NYKNXgEGRfagkeY-IDT-Afeh3j2khLvfXipoU Oct 30 01:14:13.084445 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:14:13.084445 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:14:13.084445 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:14:13.084445 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:14:13.084445 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:14:13.084445 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:14:13.084445 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 9e08e00f6d124462bc36d474ac3d1e59 Oct 30 01:14:13.084445 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1800607175 Oct 30 01:14:13.084445 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,admin,reader Oct 30 01:14:13.084445 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,admin,reader Oct 30 01:14:13.085728 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9e08e00f6d124462bc36d474ac3d1e59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9e08e00f6d124462bc36d474ac3d1e59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9e08e00f6d124462bc36d474ac3d1e59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9e08e00f6d124462bc36d474ac3d1e59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:14:13.085728 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1800607175 Oct 30 01:14:13.085728 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 9e08e00f6d124462bc36d474ac3d1e59 Oct 30 01:14:13.085728 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1800607175 Oct 30 01:14:13.085728 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-HostsAdminNegativeTestJSON-1800607175-project-admin Oct 30 01:14:13.085728 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:14:13.085728 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:14:13.085728 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: e590aac4a07f4867a249f723fa6a3d37 Oct 30 01:14:13.085728 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1800607175-project-admin Oct 30 01:14:13.085728 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:14:13.085728 n-d-master-1 devstack@n-api.service[121102]: {"status": "enable", "maintenance_mode": "enable"} Oct 30 01:14:13.085728 n-d-master-1 devstack@n-api.service[121102]: method: Oct 30 01:14:13.085728 n-d-master-1 devstack@n-api.service[121102]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 30 01:14:13.085728 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 30 01:14:13.086696 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:14:13.086696 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:13.086696 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 30 01:14:13.086696 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 30 01:14:13.086696 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 30 01:14:13.086696 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 30 01:14:13.086696 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 01:14:13.086696 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 30 01:14:13.086696 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 01:14:13.086696 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise self.value Oct 30 01:14:13.086696 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 30 01:14:13.086696 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 30 01:14:13.086696 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 30 01:14:13.086696 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 30 01:14:13.086696 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 01:14:13.086696 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 01:14:13.086696 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 30 01:14:13.086696 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 30 01:14:13.087821 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 30 01:14:13.087821 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 30 01:14:13.087821 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 30 01:14:13.087821 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 30 01:14:13.087821 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 30 01:14:13.087821 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:13.087821 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:13.087821 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:13.087821 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:13.087821 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:13.087821 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:13.087821 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:14:13.087821 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:14:13.087821 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:14:13.087821 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:14:13.087821 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:14:13.087821 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:14:13.087821 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:14:13.087821 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:14:13.087821 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 30 01:14:13.090210 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 30 01:14:13.090210 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 30 01:14:13.090210 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:14:13.090210 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 30 01:14:13.090210 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:13.090210 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:13.090210 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:13.090210 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:13.090210 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:13.090210 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:13.090210 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:14:13.090210 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:14:13.090210 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 30 01:14:13.090210 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:13.090210 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8102d998-234f-46aa-8f86-2e01fe82db6c tempest-HostsAdminNegativeTestJSON-1800607175 tempest-HostsAdminNegativeTestJSON-1800607175-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:14:13.091033 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8102d998-234f-46aa-8f86-2e01fe82db6c tempest-HostsAdminNegativeTestJSON-1800607175 tempest-HostsAdminNegativeTestJSON-1800607175-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.039441 Oct 30 01:14:13.091033 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 69/157] 10.222.0.13 () {60 vars in 1211 bytes} [Sun Oct 30 01:14:13 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 30 01:14:13.401883 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e4cce6f1-40d5-47f3-ae28-1099129067fe tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:13.402914 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e4cce6f1-40d5-47f3-ae28-1099129067fe tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 7e81dcfb-dcbe-4e05-91a4-541ff2c404ae] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:13.414524 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e4cce6f1-40d5-47f3-ae28-1099129067fe tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:13.415504 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e4cce6f1-40d5-47f3-ae28-1099129067fe tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:13.416158 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e4cce6f1-40d5-47f3-ae28-1099129067fe tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:13.417245 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e4cce6f1-40d5-47f3-ae28-1099129067fe tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:13.418022 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e4cce6f1-40d5-47f3-ae28-1099129067fe tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:13.419163 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e4cce6f1-40d5-47f3-ae28-1099129067fe tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:13.446446 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7e4383a2-571e-4e59-8da9-1ac4598b8652 tempest-KeyPairsV210TestJSON-125768253 tempest-KeyPairsV210TestJSON-125768253-project-admin] Action: 'create', calling method: .version_select at 0x7f44ccc8a280>, body: {"keypair": {"name": "tempest-keypair-665131860", "type": "ssh", "user_id": "ea6009a59ffa459fb74626d5ab2f7eee", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGeqbBBStQk8AwkKHDSBEjpg5gHdoYfiXM/Iyi/LtNdD6+k12rWv2gyC16hC/CZ3z03iUwF0RMJUehrWgdqqjEybEfRmToibohh6MDX7K6pzPRbcIGgb8RVd3nd+blR9FQ=="}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:13.465221 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-7e4383a2-571e-4e59-8da9-1ac4598b8652 tempest-KeyPairsV210TestJSON-125768253 tempest-KeyPairsV210TestJSON-125768253-project-admin] Getting quotas for project 57bcfb211dea4e9cb344446f3f6c4eb3. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:14:13.470902 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-7e4383a2-571e-4e59-8da9-1ac4598b8652 tempest-KeyPairsV210TestJSON-125768253 tempest-KeyPairsV210TestJSON-125768253-project-admin] Getting quotas for user 6827489b1573480fa171e7f3d9500ca8 and project 57bcfb211dea4e9cb344446f3f6c4eb3. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:14:13.593979 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e4cce6f1-40d5-47f3-ae28-1099129067fe tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:13.603678 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e4cce6f1-40d5-47f3-ae28-1099129067fe tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae" status: 200 len: 1332 microversion: 2.1 time: 0.211347 Oct 30 01:14:13.604494 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 70/158] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:13 2022] GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae => generated 1332 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:13.609524 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4514e3c3-532d-4f35-b4dd-ad5e67168b52 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:13.610464 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4514e3c3-532d-4f35-b4dd-ad5e67168b52 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] [instance: ba2968b1-c8ef-4ec2-9d98-66da2c62919b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:13.616816 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4514e3c3-532d-4f35-b4dd-ad5e67168b52 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:13.617842 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4514e3c3-532d-4f35-b4dd-ad5e67168b52 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:13.618339 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4514e3c3-532d-4f35-b4dd-ad5e67168b52 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:13.619109 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4514e3c3-532d-4f35-b4dd-ad5e67168b52 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:13.619662 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4514e3c3-532d-4f35-b4dd-ad5e67168b52 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:13.620181 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4514e3c3-532d-4f35-b4dd-ad5e67168b52 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:13.634365 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7e4383a2-571e-4e59-8da9-1ac4598b8652 tempest-KeyPairsV210TestJSON-125768253 tempest-KeyPairsV210TestJSON-125768253-project-admin] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.470533 Oct 30 01:14:13.634365 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 89/159] 10.222.0.13 () {62 vars in 1200 bytes} [Sun Oct 30 01:14:13 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 473 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 30 01:14:13.646600 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2cd2d82c-8951-4158-9a12-a2640bfe4fdd tempest-KeyPairsV210TestJSON-125768253 tempest-KeyPairsV210TestJSON-125768253-project-admin] Action: 'create', calling method: .version_select at 0x7f44ccf1dee0>, body: {"keypair": {"name": "tempest-keypair-678722790", "type": "ssh", "user_id": "ea6009a59ffa459fb74626d5ab2f7eee", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMFqm5qlUppBUVM7hfXU0STxkTydOEjghin5bgmMCbkGXS44zftjjUxln1V3paUjKp8QrMW6S4OmoSx+x52TkvZSnObAemkfFWMYaKfDUP06UWn48V9Txgh2MGcfU07zg=="}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:13.676402 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-2cd2d82c-8951-4158-9a12-a2640bfe4fdd tempest-KeyPairsV210TestJSON-125768253 tempest-KeyPairsV210TestJSON-125768253-project-admin] Getting quotas for project 57bcfb211dea4e9cb344446f3f6c4eb3. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:14:13.684569 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-2cd2d82c-8951-4158-9a12-a2640bfe4fdd tempest-KeyPairsV210TestJSON-125768253 tempest-KeyPairsV210TestJSON-125768253-project-admin] Getting quotas for user 6827489b1573480fa171e7f3d9500ca8 and project 57bcfb211dea4e9cb344446f3f6c4eb3. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:14:13.799112 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2cd2d82c-8951-4158-9a12-a2640bfe4fdd tempest-KeyPairsV210TestJSON-125768253 tempest-KeyPairsV210TestJSON-125768253-project-admin] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.156046 Oct 30 01:14:13.800861 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 90/160] 10.222.0.13 () {62 vars in 1200 bytes} [Sun Oct 30 01:14:13 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 159 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 30 01:14:13.817581 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bde31420-1183-4a4b-93ea-5626adb70a30 tempest-KeyPairsV210TestJSON-125768253 tempest-KeyPairsV210TestJSON-125768253-project-admin] Calling method '.version_select at 0x7f44cce543a0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:13.850123 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bde31420-1183-4a4b-93ea-5626adb70a30 tempest-KeyPairsV210TestJSON-125768253 tempest-KeyPairsV210TestJSON-125768253-project-admin] 10.222.0.13 "GET /compute/v2.1/os-keypairs/tempest-keypair-665131860?user_id=ea6009a59ffa459fb74626d5ab2f7eee" status: 200 len: 511 microversion: 2.10 time: 0.037894 Oct 30 01:14:13.852743 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 91/161] 10.222.0.13 () {60 vars in 1337 bytes} [Sun Oct 30 01:14:13 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-665131860?user_id=ea6009a59ffa459fb74626d5ab2f7eee => generated 511 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:14:13.871296 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9674006c-b33a-485d-8004-2992f1e06d2d tempest-KeyPairsV210TestJSON-125768253 tempest-KeyPairsV210TestJSON-125768253-project-admin] Action: 'create', calling method: .version_select at 0x7f44ccea63a0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-232067130", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIcZejWsJ9zxEsB8NwGwrmOfUlgY7VgA+8CGFH9K8CNzHXB6ntHqishHf3qV0qh/OnFG1ITn7ogOK1fRRQm7V1PhRJ+igBvZuO20Gy5dYTHGVmjeXJdubaYml+B6jyS8Pw=="}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:13.877212 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4514e3c3-532d-4f35-b4dd-ad5e67168b52 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9211a459e946c1a114983c531a8897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6543b666064cd78c02ec5a471d003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:13.891353 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4514e3c3-532d-4f35-b4dd-ad5e67168b52 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] 10.222.0.13 "GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b" status: 200 len: 1338 microversion: 2.1 time: 0.285338 Oct 30 01:14:13.906090 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-9674006c-b33a-485d-8004-2992f1e06d2d tempest-KeyPairsV210TestJSON-125768253 tempest-KeyPairsV210TestJSON-125768253-project-admin] Getting quotas for project 57bcfb211dea4e9cb344446f3f6c4eb3. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:14:13.907316 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 71/162] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:13 2022] GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b => generated 1338 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:13.914945 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-9674006c-b33a-485d-8004-2992f1e06d2d tempest-KeyPairsV210TestJSON-125768253 tempest-KeyPairsV210TestJSON-125768253-project-admin] Getting quotas for user 6827489b1573480fa171e7f3d9500ca8 and project 57bcfb211dea4e9cb344446f3f6c4eb3. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:14:14.030053 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-efd66816-7ee3-48c3-9a65-466a5b74cb41 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:14.030979 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-efd66816-7ee3-48c3-9a65-466a5b74cb41 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] [instance: ac13f3c4-a93f-4664-b102-aa57f9c63308] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:14.040645 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-efd66816-7ee3-48c3-9a65-466a5b74cb41 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:14.042057 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-efd66816-7ee3-48c3-9a65-466a5b74cb41 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:14.044654 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-efd66816-7ee3-48c3-9a65-466a5b74cb41 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:14.044654 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-efd66816-7ee3-48c3-9a65-466a5b74cb41 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:14.044654 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-efd66816-7ee3-48c3-9a65-466a5b74cb41 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:14.044654 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-efd66816-7ee3-48c3-9a65-466a5b74cb41 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:14.062772 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:14.068008 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9674006c-b33a-485d-8004-2992f1e06d2d tempest-KeyPairsV210TestJSON-125768253 tempest-KeyPairsV210TestJSON-125768253-project-admin] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.201803 Oct 30 01:14:14.068611 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 92/163] 10.222.0.13 () {62 vars in 1200 bytes} [Sun Oct 30 01:14:13 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 203 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 30 01:14:14.079744 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a7310a83-e737-48ee-a92d-47e28dffc0e9 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:14.091807 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a7310a83-e737-48ee-a92d-47e28dffc0e9 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] [instance: 7571f255-6ff3-4fc7-bcaa-4837bc05dbf5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:14.114190 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a7310a83-e737-48ee-a92d-47e28dffc0e9 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:14.114978 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a7310a83-e737-48ee-a92d-47e28dffc0e9 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:14.115586 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a7310a83-e737-48ee-a92d-47e28dffc0e9 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:14.116501 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a7310a83-e737-48ee-a92d-47e28dffc0e9 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:14.117188 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a7310a83-e737-48ee-a92d-47e28dffc0e9 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:14.117931 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a7310a83-e737-48ee-a92d-47e28dffc0e9 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:14.211118 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a7310a83-e737-48ee-a92d-47e28dffc0e9 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056e59c7d4c2475eb66b64e0e24367be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6f42c16eeb4e97b65cebf891105008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:14.223935 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a7310a83-e737-48ee-a92d-47e28dffc0e9 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] 10.222.0.13 "GET /compute/v2.1/servers/7571f255-6ff3-4fc7-bcaa-4837bc05dbf5" status: 200 len: 1316 microversion: 2.1 time: 0.148309 Oct 30 01:14:14.228252 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 93/164] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:14 2022] GET /compute/v2.1/servers/7571f255-6ff3-4fc7-bcaa-4837bc05dbf5 => generated 1316 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:14.239640 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4f721005-bdc4-4869-8946-7ac0f488d625 tempest-KeyPairsV210TestJSON-125768253 tempest-KeyPairsV210TestJSON-125768253-project-admin] Calling method '.version_select at 0x7f44ccdeb9d0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:14.244172 n-d-master-1 devstack@n-api.service[121103]: WARNING oslo_db.sqlalchemy.utils [None req-4f721005-bdc4-4869-8946-7ac0f488d625 tempest-KeyPairsV210TestJSON-125768253 tempest-KeyPairsV210TestJSON-125768253-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 30 01:14:14.252353 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4f721005-bdc4-4869-8946-7ac0f488d625 tempest-KeyPairsV210TestJSON-125768253 tempest-KeyPairsV210TestJSON-125768253-project-admin] 10.222.0.13 "GET /compute/v2.1/os-keypairs?user_id=ea6009a59ffa459fb74626d5ab2f7eee" status: 200 len: 724 microversion: 2.10 time: 0.026725 Oct 30 01:14:14.253722 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 94/165] 10.222.0.13 () {60 vars in 1259 bytes} [Sun Oct 30 01:14:14 2022] GET /compute/v2.1/os-keypairs?user_id=ea6009a59ffa459fb74626d5ab2f7eee => generated 724 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:14:14.273458 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4633ff56-931d-478a-b6cb-bd5e9b80516b tempest-KeyPairsV210TestJSON-125768253 tempest-KeyPairsV210TestJSON-125768253-project-admin] Calling method '.version_select at 0x7f44ccec4820>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:14.276371 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-efd66816-7ee3-48c3-9a65-466a5b74cb41 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464f9e9314154e3f9c779b9ae10b2a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a83b0b15194aa69fc4d82876a1e6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:14.285477 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-efd66816-7ee3-48c3-9a65-466a5b74cb41 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] 10.222.0.13 "GET /compute/v2.1/servers/ac13f3c4-a93f-4664-b102-aa57f9c63308" status: 200 len: 1318 microversion: 2.1 time: 0.259869 Oct 30 01:14:14.286659 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 72/166] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:14 2022] GET /compute/v2.1/servers/ac13f3c4-a93f-4664-b102-aa57f9c63308 => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:14.366078 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4633ff56-931d-478a-b6cb-bd5e9b80516b tempest-KeyPairsV210TestJSON-125768253 tempest-KeyPairsV210TestJSON-125768253-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-232067130" status: 204 len: 0 microversion: 2.10 time: 0.096979 Oct 30 01:14:14.366690 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 95/167] 10.222.0.13 () {60 vars in 1322 bytes} [Sun Oct 30 01:14:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-232067130 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 30 01:14:14.375196 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-913333df-2c94-40ca-9e69-22d3aa6119c1 tempest-KeyPairsV210TestJSON-125768253 tempest-KeyPairsV210TestJSON-125768253-project-admin] Calling method '.version_select at 0x7f44ccb24820>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:14.490614 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-913333df-2c94-40ca-9e69-22d3aa6119c1 tempest-KeyPairsV210TestJSON-125768253 tempest-KeyPairsV210TestJSON-125768253-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-678722790?user_id=ea6009a59ffa459fb74626d5ab2f7eee" status: 204 len: 0 microversion: 2.10 time: 0.119024 Oct 30 01:14:14.491968 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 73/168] 10.222.0.13 () {60 vars in 1340 bytes} [Sun Oct 30 01:14:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-678722790?user_id=ea6009a59ffa459fb74626d5ab2f7eee => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 30 01:14:14.500065 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bf3d55ed-6da3-436c-b0b4-c6f4c04d9d2f tempest-KeyPairsV210TestJSON-125768253 tempest-KeyPairsV210TestJSON-125768253-project-admin] Calling method '.version_select at 0x7f44ccea63a0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:14.599289 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bf3d55ed-6da3-436c-b0b4-c6f4c04d9d2f tempest-KeyPairsV210TestJSON-125768253 tempest-KeyPairsV210TestJSON-125768253-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-665131860?user_id=ea6009a59ffa459fb74626d5ab2f7eee" status: 204 len: 0 microversion: 2.10 time: 0.103110 Oct 30 01:14:14.600348 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 96/169] 10.222.0.13 () {60 vars in 1340 bytes} [Sun Oct 30 01:14:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-665131860?user_id=ea6009a59ffa459fb74626d5ab2f7eee => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 30 01:14:14.630975 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-84732583-e43d-4ad3-9343-db6541774996 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:14.631663 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-84732583-e43d-4ad3-9343-db6541774996 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 7e81dcfb-dcbe-4e05-91a4-541ff2c404ae] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:14.643569 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-84732583-e43d-4ad3-9343-db6541774996 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:14.644163 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-84732583-e43d-4ad3-9343-db6541774996 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:14.644762 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-84732583-e43d-4ad3-9343-db6541774996 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:14.645748 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-84732583-e43d-4ad3-9343-db6541774996 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:14.646292 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-84732583-e43d-4ad3-9343-db6541774996 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:14.646924 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-84732583-e43d-4ad3-9343-db6541774996 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:14.796739 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-84732583-e43d-4ad3-9343-db6541774996 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:14.805863 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-84732583-e43d-4ad3-9343-db6541774996 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae" status: 200 len: 1332 microversion: 2.1 time: 0.180592 Oct 30 01:14:14.806445 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 74/170] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:14 2022] GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae => generated 1332 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:14.917851 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4edb3f1c-d4a2-43df-9eba-6737b5527900 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:14.919222 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4edb3f1c-d4a2-43df-9eba-6737b5527900 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] [instance: ba2968b1-c8ef-4ec2-9d98-66da2c62919b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:14.927768 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4edb3f1c-d4a2-43df-9eba-6737b5527900 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:14.930033 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4edb3f1c-d4a2-43df-9eba-6737b5527900 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:14.933157 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4edb3f1c-d4a2-43df-9eba-6737b5527900 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:14.936172 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4edb3f1c-d4a2-43df-9eba-6737b5527900 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:14.938790 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4edb3f1c-d4a2-43df-9eba-6737b5527900 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:14.939436 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4edb3f1c-d4a2-43df-9eba-6737b5527900 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:15.247906 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4edb3f1c-d4a2-43df-9eba-6737b5527900 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9211a459e946c1a114983c531a8897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6543b666064cd78c02ec5a471d003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:15.264522 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4edb3f1c-d4a2-43df-9eba-6737b5527900 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] 10.222.0.13 "GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b" status: 200 len: 1487 microversion: 2.1 time: 0.346283 Oct 30 01:14:15.279352 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 97/171] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:14 2022] GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b => generated 1487 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:15.290621 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-27176279-64f6-4b02-808b-3b811a98ff9f tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:15.291253 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-27176279-64f6-4b02-808b-3b811a98ff9f tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] [instance: 7571f255-6ff3-4fc7-bcaa-4837bc05dbf5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:15.297905 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-27176279-64f6-4b02-808b-3b811a98ff9f tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:15.299045 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-27176279-64f6-4b02-808b-3b811a98ff9f tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:15.299484 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-27176279-64f6-4b02-808b-3b811a98ff9f tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:15.300287 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-27176279-64f6-4b02-808b-3b811a98ff9f tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:15.300705 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-27176279-64f6-4b02-808b-3b811a98ff9f tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:15.301137 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-27176279-64f6-4b02-808b-3b811a98ff9f tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:15.423786 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-27176279-64f6-4b02-808b-3b811a98ff9f tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056e59c7d4c2475eb66b64e0e24367be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6f42c16eeb4e97b65cebf891105008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:15.439118 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-27176279-64f6-4b02-808b-3b811a98ff9f tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] 10.222.0.13 "GET /compute/v2.1/servers/7571f255-6ff3-4fc7-bcaa-4837bc05dbf5" status: 200 len: 1322 microversion: 2.1 time: 0.158339 Oct 30 01:14:15.440101 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 98/172] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:15 2022] GET /compute/v2.1/servers/7571f255-6ff3-4fc7-bcaa-4837bc05dbf5 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:15.458637 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6cebfd2a-ff92-40e4-a4b0-746d0d7d680c tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:15.459593 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6cebfd2a-ff92-40e4-a4b0-746d0d7d680c tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] [instance: ba2968b1-c8ef-4ec2-9d98-66da2c62919b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:15.469544 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6cebfd2a-ff92-40e4-a4b0-746d0d7d680c tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:15.470486 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6cebfd2a-ff92-40e4-a4b0-746d0d7d680c tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:15.471027 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6cebfd2a-ff92-40e4-a4b0-746d0d7d680c tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:15.471898 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6cebfd2a-ff92-40e4-a4b0-746d0d7d680c tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:15.472973 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6cebfd2a-ff92-40e4-a4b0-746d0d7d680c tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:15.473433 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6cebfd2a-ff92-40e4-a4b0-746d0d7d680c tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:15.548766 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-7b5bb741-d385-41be-b87d-c63fa384e6e4 req-80e5286c-7211-4377-b814-d8283247b6ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac13f3c4-a93f-4664-b102-aa57f9c63308", "tag": "ebea2aaf-9820-474d-9632-b91882e101fe"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:15.572693 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-7b5bb741-d385-41be-b87d-c63fa384e6e4 req-80e5286c-7211-4377-b814-d8283247b6ac service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:15.573827 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-7b5bb741-d385-41be-b87d-c63fa384e6e4 req-80e5286c-7211-4377-b814-d8283247b6ac service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:15.574450 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-7b5bb741-d385-41be-b87d-c63fa384e6e4 req-80e5286c-7211-4377-b814-d8283247b6ac service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:15.615059 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-7b5bb741-d385-41be-b87d-c63fa384e6e4 req-80e5286c-7211-4377-b814-d8283247b6ac service nova] Creating event network-changed:ebea2aaf-9820-474d-9632-b91882e101fe for instance ac13f3c4-a93f-4664-b102-aa57f9c63308 on n-h2-master-1 Oct 30 01:14:15.626315 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-7b5bb741-d385-41be-b87d-c63fa384e6e4 req-80e5286c-7211-4377-b814-d8283247b6ac service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.550353 Oct 30 01:14:15.626931 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 75/173] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:15.646341 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c359fc28-4892-47b9-8193-44dcc3636e63 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:15.646341 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c359fc28-4892-47b9-8193-44dcc3636e63 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] [instance: ac13f3c4-a93f-4664-b102-aa57f9c63308] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:15.653135 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c359fc28-4892-47b9-8193-44dcc3636e63 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:15.653679 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c359fc28-4892-47b9-8193-44dcc3636e63 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:15.654112 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c359fc28-4892-47b9-8193-44dcc3636e63 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:15.654824 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c359fc28-4892-47b9-8193-44dcc3636e63 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:15.655274 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c359fc28-4892-47b9-8193-44dcc3636e63 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:15.655702 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c359fc28-4892-47b9-8193-44dcc3636e63 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:15.968052 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c359fc28-4892-47b9-8193-44dcc3636e63 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464f9e9314154e3f9c779b9ae10b2a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a83b0b15194aa69fc4d82876a1e6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:15.979015 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c359fc28-4892-47b9-8193-44dcc3636e63 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] 10.222.0.13 "GET /compute/v2.1/servers/ac13f3c4-a93f-4664-b102-aa57f9c63308" status: 200 len: 1318 microversion: 2.1 time: 0.349415 Oct 30 01:14:15.979793 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 76/174] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:15 2022] GET /compute/v2.1/servers/ac13f3c4-a93f-4664-b102-aa57f9c63308 => generated 1318 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:16.012191 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2cce74ce-57f3-4a44-b6c8-5dae6709aa46 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:16.012828 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2cce74ce-57f3-4a44-b6c8-5dae6709aa46 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 7e81dcfb-dcbe-4e05-91a4-541ff2c404ae] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:16.019361 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2cce74ce-57f3-4a44-b6c8-5dae6709aa46 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:16.019768 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2cce74ce-57f3-4a44-b6c8-5dae6709aa46 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:16.020195 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2cce74ce-57f3-4a44-b6c8-5dae6709aa46 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:16.021004 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2cce74ce-57f3-4a44-b6c8-5dae6709aa46 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:16.021479 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2cce74ce-57f3-4a44-b6c8-5dae6709aa46 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:16.021893 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2cce74ce-57f3-4a44-b6c8-5dae6709aa46 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:16.164380 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6cebfd2a-ff92-40e4-a4b0-746d0d7d680c tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b" status: 200 len: 1638 microversion: 2.1 time: 0.722634 Oct 30 01:14:16.169983 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 99/175] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:15 2022] GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b => generated 1638 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:16.191823 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c7094597-a8c2-460d-9bdb-dee468002aa4 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:16.192556 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c7094597-a8c2-460d-9bdb-dee468002aa4 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] [instance: ba2968b1-c8ef-4ec2-9d98-66da2c62919b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:16.199218 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c7094597-a8c2-460d-9bdb-dee468002aa4 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:16.199713 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c7094597-a8c2-460d-9bdb-dee468002aa4 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:16.200144 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c7094597-a8c2-460d-9bdb-dee468002aa4 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:16.201015 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c7094597-a8c2-460d-9bdb-dee468002aa4 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:16.201541 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c7094597-a8c2-460d-9bdb-dee468002aa4 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:16.201966 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c7094597-a8c2-460d-9bdb-dee468002aa4 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:16.229567 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c7094597-a8c2-460d-9bdb-dee468002aa4 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] [instance: ba2968b1-c8ef-4ec2-9d98-66da2c62919b] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:14:16.351687 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2cce74ce-57f3-4a44-b6c8-5dae6709aa46 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:16.360673 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2cce74ce-57f3-4a44-b6c8-5dae6709aa46 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae" status: 200 len: 1332 microversion: 2.1 time: 0.355242 Oct 30 01:14:16.378971 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 77/176] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:15 2022] GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae => generated 1332 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:16.466056 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6169af01-beae-4691-93d2-10af6ae4787b tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:16.466701 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6169af01-beae-4691-93d2-10af6ae4787b tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] [instance: 7571f255-6ff3-4fc7-bcaa-4837bc05dbf5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:16.473844 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6169af01-beae-4691-93d2-10af6ae4787b tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:16.474338 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6169af01-beae-4691-93d2-10af6ae4787b tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:16.474772 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6169af01-beae-4691-93d2-10af6ae4787b tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:16.475470 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6169af01-beae-4691-93d2-10af6ae4787b tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:16.475922 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6169af01-beae-4691-93d2-10af6ae4787b tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:16.476340 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6169af01-beae-4691-93d2-10af6ae4787b tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:16.544333 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6169af01-beae-4691-93d2-10af6ae4787b tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056e59c7d4c2475eb66b64e0e24367be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6f42c16eeb4e97b65cebf891105008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:16.574667 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6169af01-beae-4691-93d2-10af6ae4787b tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] 10.222.0.13 "GET /compute/v2.1/servers/7571f255-6ff3-4fc7-bcaa-4837bc05dbf5" status: 200 len: 1322 microversion: 2.1 time: 0.112351 Oct 30 01:14:16.575921 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 78/177] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:16 2022] GET /compute/v2.1/servers/7571f255-6ff3-4fc7-bcaa-4837bc05dbf5 => generated 1322 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:14:16.694142 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c7094597-a8c2-460d-9bdb-dee468002aa4 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b" status: 204 len: 0 microversion: 2.1 time: 0.505955 Oct 30 01:14:16.694834 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 100/178] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:14:16 2022] DELETE /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b => generated 0 bytes in 508 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:14:16.704118 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f55741e2-65d0-4460-bfed-ff85cd7c7838 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:16.704899 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f55741e2-65d0-4460-bfed-ff85cd7c7838 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] [instance: ba2968b1-c8ef-4ec2-9d98-66da2c62919b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:16.712897 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f55741e2-65d0-4460-bfed-ff85cd7c7838 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:16.713712 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f55741e2-65d0-4460-bfed-ff85cd7c7838 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:16.718163 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f55741e2-65d0-4460-bfed-ff85cd7c7838 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:16.718163 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f55741e2-65d0-4460-bfed-ff85cd7c7838 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:16.718163 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f55741e2-65d0-4460-bfed-ff85cd7c7838 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:16.718163 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f55741e2-65d0-4460-bfed-ff85cd7c7838 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:16.928715 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f55741e2-65d0-4460-bfed-ff85cd7c7838 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9211a459e946c1a114983c531a8897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6543b666064cd78c02ec5a471d003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:16.937547 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f55741e2-65d0-4460-bfed-ff85cd7c7838 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] 10.222.0.13 "GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b" status: 200 len: 1493 microversion: 2.1 time: 0.237470 Oct 30 01:14:16.938132 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 79/179] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:16 2022] GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b => generated 1493 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:14:17.004601 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fae1c994-1695-4a9b-b9ba-acf698f07ff4 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:17.005967 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-fae1c994-1695-4a9b-b9ba-acf698f07ff4 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] [instance: ac13f3c4-a93f-4664-b102-aa57f9c63308] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:17.014702 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fae1c994-1695-4a9b-b9ba-acf698f07ff4 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:17.015200 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fae1c994-1695-4a9b-b9ba-acf698f07ff4 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:17.019776 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fae1c994-1695-4a9b-b9ba-acf698f07ff4 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:17.020658 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fae1c994-1695-4a9b-b9ba-acf698f07ff4 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:17.021159 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fae1c994-1695-4a9b-b9ba-acf698f07ff4 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:17.021614 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fae1c994-1695-4a9b-b9ba-acf698f07ff4 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:17.278124 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-fae1c994-1695-4a9b-b9ba-acf698f07ff4 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464f9e9314154e3f9c779b9ae10b2a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a83b0b15194aa69fc4d82876a1e6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:17.287334 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fae1c994-1695-4a9b-b9ba-acf698f07ff4 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] 10.222.0.13 "GET /compute/v2.1/servers/ac13f3c4-a93f-4664-b102-aa57f9c63308" status: 200 len: 1318 microversion: 2.1 time: 0.287949 Oct 30 01:14:17.288735 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 101/180] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:16 2022] GET /compute/v2.1/servers/ac13f3c4-a93f-4664-b102-aa57f9c63308 => generated 1318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:17.386985 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-af10d1bf-0928-4f87-bc03-7e29e356a940 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:17.387611 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-af10d1bf-0928-4f87-bc03-7e29e356a940 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 7e81dcfb-dcbe-4e05-91a4-541ff2c404ae] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:17.394809 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af10d1bf-0928-4f87-bc03-7e29e356a940 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:17.394809 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af10d1bf-0928-4f87-bc03-7e29e356a940 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:17.395170 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af10d1bf-0928-4f87-bc03-7e29e356a940 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:17.395861 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af10d1bf-0928-4f87-bc03-7e29e356a940 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:17.396344 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af10d1bf-0928-4f87-bc03-7e29e356a940 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:17.396761 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af10d1bf-0928-4f87-bc03-7e29e356a940 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:17.599947 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8c88cd02-f1e6-4123-83bc-a935245fd260 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:17.600469 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8c88cd02-f1e6-4123-83bc-a935245fd260 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] [instance: 7571f255-6ff3-4fc7-bcaa-4837bc05dbf5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:17.606462 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8c88cd02-f1e6-4123-83bc-a935245fd260 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:17.606945 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8c88cd02-f1e6-4123-83bc-a935245fd260 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:17.607374 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8c88cd02-f1e6-4123-83bc-a935245fd260 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:17.608065 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8c88cd02-f1e6-4123-83bc-a935245fd260 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:17.608514 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8c88cd02-f1e6-4123-83bc-a935245fd260 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:17.608993 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8c88cd02-f1e6-4123-83bc-a935245fd260 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:17.640279 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=4 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:17.668035 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-af10d1bf-0928-4f87-bc03-7e29e356a940 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:17.678005 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-af10d1bf-0928-4f87-bc03-7e29e356a940 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae" status: 200 len: 1332 microversion: 2.1 time: 0.294884 Oct 30 01:14:17.694185 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 80/181] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:17 2022] GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae => generated 1332 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:17.700131 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-ece923f2-4ac3-4595-bb39-82482d56a59a req-7eedc37f-9612-4749-bc98-3aec904b9dd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e81dcfb-dcbe-4e05-91a4-541ff2c404ae", "tag": "8c9bf831-4693-4fde-804b-2216247d9310"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:17.712028 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ece923f2-4ac3-4595-bb39-82482d56a59a req-7eedc37f-9612-4749-bc98-3aec904b9dd0 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:17.712515 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ece923f2-4ac3-4595-bb39-82482d56a59a req-7eedc37f-9612-4749-bc98-3aec904b9dd0 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:17.718190 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ece923f2-4ac3-4595-bb39-82482d56a59a req-7eedc37f-9612-4749-bc98-3aec904b9dd0 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:17.725185 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-ece923f2-4ac3-4595-bb39-82482d56a59a req-7eedc37f-9612-4749-bc98-3aec904b9dd0 service nova] Creating event network-changed:8c9bf831-4693-4fde-804b-2216247d9310 for instance 7e81dcfb-dcbe-4e05-91a4-541ff2c404ae on n-h1-master-1 Oct 30 01:14:17.730335 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-ece923f2-4ac3-4595-bb39-82482d56a59a req-7eedc37f-9612-4749-bc98-3aec904b9dd0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034584 Oct 30 01:14:17.731536 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 81/182] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:17.866833 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8c88cd02-f1e6-4123-83bc-a935245fd260 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056e59c7d4c2475eb66b64e0e24367be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6f42c16eeb4e97b65cebf891105008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:17.884603 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8c88cd02-f1e6-4123-83bc-a935245fd260 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] 10.222.0.13 "GET /compute/v2.1/servers/7571f255-6ff3-4fc7-bcaa-4837bc05dbf5" status: 200 len: 1389 microversion: 2.1 time: 0.289226 Oct 30 01:14:17.902424 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 102/183] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:17 2022] GET /compute/v2.1/servers/7571f255-6ff3-4fc7-bcaa-4837bc05dbf5 => generated 1389 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:14:17.964594 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9b3050f6-2aa6-4ef5-8370-1bb68c9e4d5c tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:17.965949 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9b3050f6-2aa6-4ef5-8370-1bb68c9e4d5c tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] [instance: ba2968b1-c8ef-4ec2-9d98-66da2c62919b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:17.979397 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b3050f6-2aa6-4ef5-8370-1bb68c9e4d5c tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:17.981008 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b3050f6-2aa6-4ef5-8370-1bb68c9e4d5c tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:17.983437 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b3050f6-2aa6-4ef5-8370-1bb68c9e4d5c tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:17.985211 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b3050f6-2aa6-4ef5-8370-1bb68c9e4d5c tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:17.986408 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b3050f6-2aa6-4ef5-8370-1bb68c9e4d5c tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:17.988796 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b3050f6-2aa6-4ef5-8370-1bb68c9e4d5c tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:18.224265 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9b3050f6-2aa6-4ef5-8370-1bb68c9e4d5c tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9211a459e946c1a114983c531a8897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6543b666064cd78c02ec5a471d003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:18.233065 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9b3050f6-2aa6-4ef5-8370-1bb68c9e4d5c tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] 10.222.0.13 "GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b" status: 200 len: 1493 microversion: 2.1 time: 0.273520 Oct 30 01:14:18.233872 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 82/184] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:17 2022] GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b => generated 1493 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:18.311847 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1a06d08e-13ae-4d06-a4db-0da356d259d2 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:18.312572 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1a06d08e-13ae-4d06-a4db-0da356d259d2 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] [instance: ac13f3c4-a93f-4664-b102-aa57f9c63308] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:18.320377 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a06d08e-13ae-4d06-a4db-0da356d259d2 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:18.325440 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a06d08e-13ae-4d06-a4db-0da356d259d2 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:18.325440 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a06d08e-13ae-4d06-a4db-0da356d259d2 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:18.325440 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a06d08e-13ae-4d06-a4db-0da356d259d2 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:18.325440 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a06d08e-13ae-4d06-a4db-0da356d259d2 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:18.325732 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a06d08e-13ae-4d06-a4db-0da356d259d2 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:18.498084 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1a06d08e-13ae-4d06-a4db-0da356d259d2 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464f9e9314154e3f9c779b9ae10b2a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a83b0b15194aa69fc4d82876a1e6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:18.506470 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1a06d08e-13ae-4d06-a4db-0da356d259d2 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] 10.222.0.13 "GET /compute/v2.1/servers/ac13f3c4-a93f-4664-b102-aa57f9c63308" status: 200 len: 1318 microversion: 2.1 time: 0.198680 Oct 30 01:14:18.507056 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 103/185] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:18 2022] GET /compute/v2.1/servers/ac13f3c4-a93f-4664-b102-aa57f9c63308 => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:18.707456 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-af6a5fe0-217a-4935-96a8-6585d321b14c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:18.708063 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-af6a5fe0-217a-4935-96a8-6585d321b14c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 7e81dcfb-dcbe-4e05-91a4-541ff2c404ae] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:18.714526 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af6a5fe0-217a-4935-96a8-6585d321b14c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:18.715007 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af6a5fe0-217a-4935-96a8-6585d321b14c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:18.717643 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af6a5fe0-217a-4935-96a8-6585d321b14c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:18.718380 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af6a5fe0-217a-4935-96a8-6585d321b14c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:18.718839 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af6a5fe0-217a-4935-96a8-6585d321b14c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:18.719260 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af6a5fe0-217a-4935-96a8-6585d321b14c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:18.899836 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-af6a5fe0-217a-4935-96a8-6585d321b14c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:18.912447 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-af6a5fe0-217a-4935-96a8-6585d321b14c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae" status: 200 len: 1332 microversion: 2.1 time: 0.206043 Oct 30 01:14:18.915042 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ca28eccf-5c99-4b21-8c6d-a6a2a1fe373c tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:18.915478 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 83/186] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:18 2022] GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae => generated 1332 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:18.916294 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ca28eccf-5c99-4b21-8c6d-a6a2a1fe373c tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] [instance: 7571f255-6ff3-4fc7-bcaa-4837bc05dbf5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:18.937571 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ca28eccf-5c99-4b21-8c6d-a6a2a1fe373c tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:18.938081 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ca28eccf-5c99-4b21-8c6d-a6a2a1fe373c tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:18.941763 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ca28eccf-5c99-4b21-8c6d-a6a2a1fe373c tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:18.942566 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ca28eccf-5c99-4b21-8c6d-a6a2a1fe373c tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:18.943044 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ca28eccf-5c99-4b21-8c6d-a6a2a1fe373c tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:18.943480 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ca28eccf-5c99-4b21-8c6d-a6a2a1fe373c tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:19.259563 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8a06ed32-3526-47fa-9497-393173390cca tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:19.260527 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8a06ed32-3526-47fa-9497-393173390cca tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] [instance: ba2968b1-c8ef-4ec2-9d98-66da2c62919b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:19.269507 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8a06ed32-3526-47fa-9497-393173390cca tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:19.270278 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8a06ed32-3526-47fa-9497-393173390cca tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:19.270866 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8a06ed32-3526-47fa-9497-393173390cca tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:19.272418 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8a06ed32-3526-47fa-9497-393173390cca tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:19.273121 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8a06ed32-3526-47fa-9497-393173390cca tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:19.273734 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8a06ed32-3526-47fa-9497-393173390cca tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:19.535456 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ca28eccf-5c99-4b21-8c6d-a6a2a1fe373c tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056e59c7d4c2475eb66b64e0e24367be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6f42c16eeb4e97b65cebf891105008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:19.548612 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ca28eccf-5c99-4b21-8c6d-a6a2a1fe373c tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] 10.222.0.13 "GET /compute/v2.1/servers/7571f255-6ff3-4fc7-bcaa-4837bc05dbf5" status: 200 len: 1389 microversion: 2.1 time: 0.641186 Oct 30 01:14:19.552500 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 104/187] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:18 2022] GET /compute/v2.1/servers/7571f255-6ff3-4fc7-bcaa-4837bc05dbf5 => generated 1389 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:14:19.564984 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2a9335dc-c257-494f-9e00-746f24c3f14a tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:19.572385 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2a9335dc-c257-494f-9e00-746f24c3f14a tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] [instance: ac13f3c4-a93f-4664-b102-aa57f9c63308] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:19.602501 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a9335dc-c257-494f-9e00-746f24c3f14a tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:19.603280 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a9335dc-c257-494f-9e00-746f24c3f14a tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:19.603904 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a9335dc-c257-494f-9e00-746f24c3f14a tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:19.607026 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a9335dc-c257-494f-9e00-746f24c3f14a tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:19.613300 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a9335dc-c257-494f-9e00-746f24c3f14a tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:19.615443 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a9335dc-c257-494f-9e00-746f24c3f14a tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:19.671052 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8a06ed32-3526-47fa-9497-393173390cca tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9211a459e946c1a114983c531a8897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6543b666064cd78c02ec5a471d003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:19.685231 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8a06ed32-3526-47fa-9497-393173390cca tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] 10.222.0.13 "GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b" status: 200 len: 1493 microversion: 2.1 time: 0.430612 Oct 30 01:14:19.692349 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 84/188] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:19 2022] GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b => generated 1493 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:19.756027 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-e0c7fe46-350d-4c18-91b2-311f93ecc825 req-9849f9be-a775-4cda-a544-1f448ba6470f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7571f255-6ff3-4fc7-bcaa-4837bc05dbf5", "tag": "f6b29ab4-dbe4-4f1d-8b86-4f2415442840"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:19.768924 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-e0c7fe46-350d-4c18-91b2-311f93ecc825 req-9849f9be-a775-4cda-a544-1f448ba6470f service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:19.769431 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-e0c7fe46-350d-4c18-91b2-311f93ecc825 req-9849f9be-a775-4cda-a544-1f448ba6470f service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:19.769864 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-e0c7fe46-350d-4c18-91b2-311f93ecc825 req-9849f9be-a775-4cda-a544-1f448ba6470f service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:19.792885 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-e0c7fe46-350d-4c18-91b2-311f93ecc825 req-9849f9be-a775-4cda-a544-1f448ba6470f service nova] Creating event network-changed:f6b29ab4-dbe4-4f1d-8b86-4f2415442840 for instance 7571f255-6ff3-4fc7-bcaa-4837bc05dbf5 on n-h2-master-1 Oct 30 01:14:19.809213 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-e0c7fe46-350d-4c18-91b2-311f93ecc825 req-9849f9be-a775-4cda-a544-1f448ba6470f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058399 Oct 30 01:14:19.813589 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 85/189] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:14:19.937665 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8352a8e7-f64f-4841-9c2e-7ac10af3f88a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:19.938601 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8352a8e7-f64f-4841-9c2e-7ac10af3f88a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 7e81dcfb-dcbe-4e05-91a4-541ff2c404ae] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:19.945241 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8352a8e7-f64f-4841-9c2e-7ac10af3f88a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:19.946002 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8352a8e7-f64f-4841-9c2e-7ac10af3f88a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:19.946568 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8352a8e7-f64f-4841-9c2e-7ac10af3f88a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:19.947410 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8352a8e7-f64f-4841-9c2e-7ac10af3f88a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:19.947994 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8352a8e7-f64f-4841-9c2e-7ac10af3f88a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:19.948578 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8352a8e7-f64f-4841-9c2e-7ac10af3f88a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:20.003685 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2a9335dc-c257-494f-9e00-746f24c3f14a tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464f9e9314154e3f9c779b9ae10b2a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a83b0b15194aa69fc4d82876a1e6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:20.021468 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2a9335dc-c257-494f-9e00-746f24c3f14a tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] 10.222.0.13 "GET /compute/v2.1/servers/ac13f3c4-a93f-4664-b102-aa57f9c63308" status: 200 len: 1318 microversion: 2.1 time: 0.467427 Oct 30 01:14:20.023774 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 105/190] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:19 2022] GET /compute/v2.1/servers/ac13f3c4-a93f-4664-b102-aa57f9c63308 => generated 1318 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:20.349151 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8352a8e7-f64f-4841-9c2e-7ac10af3f88a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:20.358922 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8352a8e7-f64f-4841-9c2e-7ac10af3f88a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae" status: 200 len: 1332 microversion: 2.1 time: 0.426059 Oct 30 01:14:20.366864 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 86/191] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:19 2022] GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae => generated 1332 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:20.572766 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8bb7e1b0-b3df-4014-b498-b7150484b125 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:20.573594 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8bb7e1b0-b3df-4014-b498-b7150484b125 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] [instance: 7571f255-6ff3-4fc7-bcaa-4837bc05dbf5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:20.601405 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8bb7e1b0-b3df-4014-b498-b7150484b125 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:20.605405 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8bb7e1b0-b3df-4014-b498-b7150484b125 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:20.610293 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8bb7e1b0-b3df-4014-b498-b7150484b125 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:20.615839 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8bb7e1b0-b3df-4014-b498-b7150484b125 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:20.615839 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8bb7e1b0-b3df-4014-b498-b7150484b125 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:20.615839 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8bb7e1b0-b3df-4014-b498-b7150484b125 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:20.731398 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7be43edc-eb2c-4db2-8314-ca84f1ab7f89 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:20.734908 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7be43edc-eb2c-4db2-8314-ca84f1ab7f89 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] [instance: ba2968b1-c8ef-4ec2-9d98-66da2c62919b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:20.755978 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7be43edc-eb2c-4db2-8314-ca84f1ab7f89 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:20.756772 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7be43edc-eb2c-4db2-8314-ca84f1ab7f89 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:20.757924 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7be43edc-eb2c-4db2-8314-ca84f1ab7f89 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:20.758852 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7be43edc-eb2c-4db2-8314-ca84f1ab7f89 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:20.759598 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7be43edc-eb2c-4db2-8314-ca84f1ab7f89 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:20.763136 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7be43edc-eb2c-4db2-8314-ca84f1ab7f89 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:20.961936 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7be43edc-eb2c-4db2-8314-ca84f1ab7f89 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9211a459e946c1a114983c531a8897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6543b666064cd78c02ec5a471d003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:20.975470 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8bb7e1b0-b3df-4014-b498-b7150484b125 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056e59c7d4c2475eb66b64e0e24367be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6f42c16eeb4e97b65cebf891105008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:20.984314 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7be43edc-eb2c-4db2-8314-ca84f1ab7f89 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] 10.222.0.13 "GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b" status: 200 len: 1451 microversion: 2.1 time: 0.273482 Oct 30 01:14:21.002630 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8bb7e1b0-b3df-4014-b498-b7150484b125 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] 10.222.0.13 "GET /compute/v2.1/servers/7571f255-6ff3-4fc7-bcaa-4837bc05dbf5" status: 200 len: 1389 microversion: 2.1 time: 0.415375 Oct 30 01:14:21.006173 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 87/193] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:20 2022] GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b => generated 1451 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:21.007172 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 106/193] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:20 2022] GET /compute/v2.1/servers/7571f255-6ff3-4fc7-bcaa-4837bc05dbf5 => generated 1389 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:21.008659 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=4 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:21.044116 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-e14dcf57-3fa4-4867-a17e-45999ef540eb req-ddce2d39-e76b-4462-9d0c-76b9ded1b5a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba2968b1-c8ef-4ec2-9d98-66da2c62919b", "name": "network-vif-deleted", "tag": "7c42110b-29c3-4585-a867-a3e633a2c945"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:21.047017 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2235cfcf-f74a-4d65-baa2-c028de6a40b0 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:21.051979 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2235cfcf-f74a-4d65-baa2-c028de6a40b0 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] [instance: ac13f3c4-a93f-4664-b102-aa57f9c63308] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:21.072127 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2235cfcf-f74a-4d65-baa2-c028de6a40b0 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:21.079020 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2235cfcf-f74a-4d65-baa2-c028de6a40b0 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:21.083742 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2235cfcf-f74a-4d65-baa2-c028de6a40b0 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:21.084590 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2235cfcf-f74a-4d65-baa2-c028de6a40b0 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:21.087180 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2235cfcf-f74a-4d65-baa2-c028de6a40b0 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:21.087839 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2235cfcf-f74a-4d65-baa2-c028de6a40b0 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:21.088143 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=12 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:21.094086 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-e14dcf57-3fa4-4867-a17e-45999ef540eb req-ddce2d39-e76b-4462-9d0c-76b9ded1b5a7 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:21.094578 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-e14dcf57-3fa4-4867-a17e-45999ef540eb req-ddce2d39-e76b-4462-9d0c-76b9ded1b5a7 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:21.095008 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-e14dcf57-3fa4-4867-a17e-45999ef540eb req-ddce2d39-e76b-4462-9d0c-76b9ded1b5a7 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:21.100766 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:21.131054 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-e14dcf57-3fa4-4867-a17e-45999ef540eb req-ddce2d39-e76b-4462-9d0c-76b9ded1b5a7 service nova] Creating event network-vif-deleted:7c42110b-29c3-4585-a867-a3e633a2c945 for instance ba2968b1-c8ef-4ec2-9d98-66da2c62919b on n-h1-master-1 Oct 30 01:14:21.145799 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-e14dcf57-3fa4-4867-a17e-45999ef540eb req-ddce2d39-e76b-4462-9d0c-76b9ded1b5a7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138096 Oct 30 01:14:21.146657 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 88/194] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:21.399547 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-35619828-d11c-4a2a-a361-93b198c834e7 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] Action: 'update', calling method: .version_select at 0x7f44cccd1040>, body: {"quota_set": {"ram": "5120"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:21.541635 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2235cfcf-f74a-4d65-baa2-c028de6a40b0 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464f9e9314154e3f9c779b9ae10b2a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a83b0b15194aa69fc4d82876a1e6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:21.550537 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2235cfcf-f74a-4d65-baa2-c028de6a40b0 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] 10.222.0.13 "GET /compute/v2.1/servers/ac13f3c4-a93f-4664-b102-aa57f9c63308" status: 200 len: 1318 microversion: 2.1 time: 0.506669 Oct 30 01:14:21.551619 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 107/195] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:21 2022] GET /compute/v2.1/servers/ac13f3c4-a93f-4664-b102-aa57f9c63308 => generated 1318 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:14:21.560665 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a070020e-dc72-445c-8537-2088df8ca147 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:21.563134 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a070020e-dc72-445c-8537-2088df8ca147 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 7e81dcfb-dcbe-4e05-91a4-541ff2c404ae] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:21.570766 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:21.589570 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a070020e-dc72-445c-8537-2088df8ca147 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:21.594158 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a070020e-dc72-445c-8537-2088df8ca147 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:21.594650 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a070020e-dc72-445c-8537-2088df8ca147 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:21.595526 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a070020e-dc72-445c-8537-2088df8ca147 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:21.595988 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a070020e-dc72-445c-8537-2088df8ca147 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:21.596422 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a070020e-dc72-445c-8537-2088df8ca147 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:21.606707 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-35619828-d11c-4a2a-a361-93b198c834e7 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:21.607178 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-35619828-d11c-4a2a-a361-93b198c834e7 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:21.608448 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-35619828-d11c-4a2a-a361-93b198c834e7 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:21.609187 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-35619828-d11c-4a2a-a361-93b198c834e7 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:21.609671 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-35619828-d11c-4a2a-a361-93b198c834e7 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:21.610236 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-35619828-d11c-4a2a-a361-93b198c834e7 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:21.628143 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:DELETE=4 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:21.758761 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-35619828-d11c-4a2a-a361-93b198c834e7 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/2cdc637333db40698091d929231a22b3" status: 200 len: 240 microversion: 2.36 time: 0.585397 Oct 30 01:14:21.759687 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 89/196] 10.222.0.13 () {62 vars in 1303 bytes} [Sun Oct 30 01:14:21 2022] PUT /compute/v2.1/os-quota-sets/2cdc637333db40698091d929231a22b3 => generated 240 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:14:21.771544 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-59ef47cd-735b-414f-9963-843e206b881f tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] Calling method '.version_select at 0x7f44ccb28280>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:21.809535 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a070020e-dc72-445c-8537-2088df8ca147 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:21.818586 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a070020e-dc72-445c-8537-2088df8ca147 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae" status: 200 len: 1332 microversion: 2.1 time: 0.265728 Oct 30 01:14:21.819841 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 108/197] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:21 2022] GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae => generated 1332 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:21.989998 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-59ef47cd-735b-414f-9963-843e206b881f tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:21.990653 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-59ef47cd-735b-414f-9963-843e206b881f tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:21.991262 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-59ef47cd-735b-414f-9963-843e206b881f tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:21.992198 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-59ef47cd-735b-414f-9963-843e206b881f tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:21.992898 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-59ef47cd-735b-414f-9963-843e206b881f tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:21.993524 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-59ef47cd-735b-414f-9963-843e206b881f tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:22.012597 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-43e5e51b-2b2d-4aaa-a5cb-564010253162 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:22.013217 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-43e5e51b-2b2d-4aaa-a5cb-564010253162 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] [instance: ba2968b1-c8ef-4ec2-9d98-66da2c62919b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:22.023822 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-43e5e51b-2b2d-4aaa-a5cb-564010253162 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:22.024323 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-43e5e51b-2b2d-4aaa-a5cb-564010253162 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:22.024802 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-43e5e51b-2b2d-4aaa-a5cb-564010253162 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:22.026568 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-43e5e51b-2b2d-4aaa-a5cb-564010253162 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:22.027291 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-43e5e51b-2b2d-4aaa-a5cb-564010253162 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:22.027919 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-43e5e51b-2b2d-4aaa-a5cb-564010253162 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:22.040602 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-59ef47cd-735b-414f-9963-843e206b881f tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/2cdc637333db40698091d929231a22b3/detail" status: 200 len: 672 microversion: 2.36 time: 0.264957 Oct 30 01:14:22.043542 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 90/198] 10.222.0.13 () {60 vars in 1304 bytes} [Sun Oct 30 01:14:21 2022] GET /compute/v2.1/os-quota-sets/2cdc637333db40698091d929231a22b3/detail => generated 672 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 30 01:14:22.049785 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4a9825ca-f5dd-42e1-a1c4-eedd361b0588 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:22.052454 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4a9825ca-f5dd-42e1-a1c4-eedd361b0588 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] [instance: 7571f255-6ff3-4fc7-bcaa-4837bc05dbf5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:22.060518 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a9825ca-f5dd-42e1-a1c4-eedd361b0588 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:22.061233 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a9825ca-f5dd-42e1-a1c4-eedd361b0588 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:22.066564 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a9825ca-f5dd-42e1-a1c4-eedd361b0588 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:22.066564 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a9825ca-f5dd-42e1-a1c4-eedd361b0588 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:22.066564 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a9825ca-f5dd-42e1-a1c4-eedd361b0588 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:22.066564 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a9825ca-f5dd-42e1-a1c4-eedd361b0588 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:22.126917 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-43e5e51b-2b2d-4aaa-a5cb-564010253162 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:22.133546 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-43e5e51b-2b2d-4aaa-a5cb-564010253162 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:22.134116 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-43e5e51b-2b2d-4aaa-a5cb-564010253162 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:22.134607 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-43e5e51b-2b2d-4aaa-a5cb-564010253162 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lazy-loading 'fault' on Instance uuid ba2968b1-c8ef-4ec2-9d98-66da2c62919b {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:14:22.278003 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-43e5e51b-2b2d-4aaa-a5cb-564010253162 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9211a459e946c1a114983c531a8897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6543b666064cd78c02ec5a471d003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:22.289204 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-43e5e51b-2b2d-4aaa-a5cb-564010253162 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] 10.222.0.13 "GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b" status: 200 len: 1328 microversion: 2.1 time: 0.281273 Oct 30 01:14:22.292173 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 109/199] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:22 2022] GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b => generated 1328 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:14:22.339371 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4a9825ca-f5dd-42e1-a1c4-eedd361b0588 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056e59c7d4c2475eb66b64e0e24367be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6f42c16eeb4e97b65cebf891105008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:22.348625 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4a9825ca-f5dd-42e1-a1c4-eedd361b0588 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] 10.222.0.13 "GET /compute/v2.1/servers/7571f255-6ff3-4fc7-bcaa-4837bc05dbf5" status: 200 len: 1389 microversion: 2.1 time: 0.303664 Oct 30 01:14:22.362216 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 91/200] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:22 2022] GET /compute/v2.1/servers/7571f255-6ff3-4fc7-bcaa-4837bc05dbf5 => generated 1389 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:22.575872 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3a9d0777-09f7-4dc6-8d3b-ea35bbbf8560 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:22.576482 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3a9d0777-09f7-4dc6-8d3b-ea35bbbf8560 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] [instance: ac13f3c4-a93f-4664-b102-aa57f9c63308] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:22.582914 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a9d0777-09f7-4dc6-8d3b-ea35bbbf8560 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:22.583522 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a9d0777-09f7-4dc6-8d3b-ea35bbbf8560 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:22.584127 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a9d0777-09f7-4dc6-8d3b-ea35bbbf8560 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:22.585596 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a9d0777-09f7-4dc6-8d3b-ea35bbbf8560 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:22.586080 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a9d0777-09f7-4dc6-8d3b-ea35bbbf8560 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:22.586535 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a9d0777-09f7-4dc6-8d3b-ea35bbbf8560 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:22.593186 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a9b50efa-ea54-42b2-a1fc-c98e860eba95 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-319615879", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": "none"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:22.707585 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-a9b50efa-ea54-42b2-a1fc-c98e860eba95 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:14:22.707585 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-a9b50efa-ea54-42b2-a1fc-c98e860eba95 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:14:22.707585 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-a9b50efa-ea54-42b2-a1fc-c98e860eba95 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:14:22.707585 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-a9b50efa-ea54-42b2-a1fc-c98e860eba95 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:14:22.707921 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-a9b50efa-ea54-42b2-a1fc-c98e860eba95 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:14:22.720579 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a9b50efa-ea54-42b2-a1fc-c98e860eba95 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:22.721249 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a9b50efa-ea54-42b2-a1fc-c98e860eba95 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:22.722567 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a9b50efa-ea54-42b2-a1fc-c98e860eba95 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:22.724493 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a9b50efa-ea54-42b2-a1fc-c98e860eba95 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:22.725106 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a9b50efa-ea54-42b2-a1fc-c98e860eba95 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:22.725758 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a9b50efa-ea54-42b2-a1fc-c98e860eba95 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:22.748734 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-a9b50efa-ea54-42b2-a1fc-c98e860eba95 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Getting quotas for project c345b7715cca426599dce98b8906ef8e. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:14:22.754755 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-a9b50efa-ea54-42b2-a1fc-c98e860eba95 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Getting quotas for user c9e2d5caf6c64b5eb508c47bbbc13892 and project c345b7715cca426599dce98b8906ef8e. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:14:22.769276 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a9b50efa-ea54-42b2-a1fc-c98e860eba95 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:14:22.772479 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a9b50efa-ea54-42b2-a1fc-c98e860eba95 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:14:22.872637 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3a9d0777-09f7-4dc6-8d3b-ea35bbbf8560 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464f9e9314154e3f9c779b9ae10b2a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a83b0b15194aa69fc4d82876a1e6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:22.881164 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3a9d0777-09f7-4dc6-8d3b-ea35bbbf8560 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] 10.222.0.13 "GET /compute/v2.1/servers/ac13f3c4-a93f-4664-b102-aa57f9c63308" status: 200 len: 1318 microversion: 2.1 time: 0.309330 Oct 30 01:14:22.882310 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 92/201] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:22 2022] GET /compute/v2.1/servers/ac13f3c4-a93f-4664-b102-aa57f9c63308 => generated 1318 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:22.887111 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e11ee56b-2241-49c6-a006-421a02859865 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] Action: 'update', calling method: .version_select at 0x7f44ccb13a60>, body: {"quota_set": {"ram": "2048"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:22.964743 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a9b50efa-ea54-42b2-a1fc-c98e860eba95 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.518235 Oct 30 01:14:22.965710 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 110/202] 10.222.0.13 () {62 vars in 1188 bytes} [Sun Oct 30 01:14:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 520 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 30 01:14:22.968075 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e11ee56b-2241-49c6-a006-421a02859865 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:22.968591 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e11ee56b-2241-49c6-a006-421a02859865 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:22.969162 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e11ee56b-2241-49c6-a006-421a02859865 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:22.969980 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e11ee56b-2241-49c6-a006-421a02859865 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:22.970733 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e11ee56b-2241-49c6-a006-421a02859865 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:22.971565 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e11ee56b-2241-49c6-a006-421a02859865 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:22.976244 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e3ba0a90-97b7-4ff4-b822-5b51bb3af562 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:22.980489 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e3ba0a90-97b7-4ff4-b822-5b51bb3af562 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 7e81dcfb-dcbe-4e05-91a4-541ff2c404ae] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:22.996615 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e3ba0a90-97b7-4ff4-b822-5b51bb3af562 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:22.996824 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e3ba0a90-97b7-4ff4-b822-5b51bb3af562 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:23.007239 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e3ba0a90-97b7-4ff4-b822-5b51bb3af562 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:23.007239 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e3ba0a90-97b7-4ff4-b822-5b51bb3af562 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:23.007239 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e3ba0a90-97b7-4ff4-b822-5b51bb3af562 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:23.007596 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e3ba0a90-97b7-4ff4-b822-5b51bb3af562 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:23.020921 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e11ee56b-2241-49c6-a006-421a02859865 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:23.021552 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e11ee56b-2241-49c6-a006-421a02859865 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:23.022184 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e11ee56b-2241-49c6-a006-421a02859865 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:23.023129 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e11ee56b-2241-49c6-a006-421a02859865 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:23.023891 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e11ee56b-2241-49c6-a006-421a02859865 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:23.024477 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e11ee56b-2241-49c6-a006-421a02859865 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:23.192399 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e11ee56b-2241-49c6-a006-421a02859865 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/2cdc637333db40698091d929231a22b3?user_id=d8e32fa36bb44c7abbf5ffd35fdac21b" status: 200 len: 240 microversion: 2.36 time: 0.308762 Oct 30 01:14:23.194295 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 93/203] 10.222.0.13 () {62 vars in 1384 bytes} [Sun Oct 30 01:14:22 2022] PUT /compute/v2.1/os-quota-sets/2cdc637333db40698091d929231a22b3?user_id=d8e32fa36bb44c7abbf5ffd35fdac21b => generated 240 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:14:23.210554 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-977c18ec-2576-4ad1-aaeb-6432c574b0b7 req-9f1b479a-94b0-4e62-a967-511c12baf258 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac13f3c4-a93f-4664-b102-aa57f9c63308", "name": "network-vif-plugged", "status": "completed", "tag": "ebea2aaf-9820-474d-9632-b91882e101fe"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:23.213886 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e3ba0a90-97b7-4ff4-b822-5b51bb3af562 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:23.222488 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e3ba0a90-97b7-4ff4-b822-5b51bb3af562 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae" status: 200 len: 1332 microversion: 2.1 time: 0.255605 Oct 30 01:14:23.223578 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 111/204] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:22 2022] GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae => generated 1332 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:23.232398 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2f3829c1-329d-4000-8666-fc0f0096273b tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:23.236227 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2f3829c1-329d-4000-8666-fc0f0096273b tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:23.246459 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-977c18ec-2576-4ad1-aaeb-6432c574b0b7 req-9f1b479a-94b0-4e62-a967-511c12baf258 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:23.247402 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-977c18ec-2576-4ad1-aaeb-6432c574b0b7 req-9f1b479a-94b0-4e62-a967-511c12baf258 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:23.248045 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-977c18ec-2576-4ad1-aaeb-6432c574b0b7 req-9f1b479a-94b0-4e62-a967-511c12baf258 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:23.253998 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:23.264654 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-977c18ec-2576-4ad1-aaeb-6432c574b0b7 req-9f1b479a-94b0-4e62-a967-511c12baf258 service nova] Creating event network-vif-plugged:ebea2aaf-9820-474d-9632-b91882e101fe for instance ac13f3c4-a93f-4664-b102-aa57f9c63308 on n-h2-master-1 Oct 30 01:14:23.271798 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-977c18ec-2576-4ad1-aaeb-6432c574b0b7 req-9f1b479a-94b0-4e62-a967-511c12baf258 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074472 Oct 30 01:14:23.272906 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 94/205] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:14:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:23.278923 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9a6a63ec-10b1-4272-9cc6-bfd5b4ca5d86 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] Calling method '.version_select at 0x7f44ccb341f0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:23.343216 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2f3829c1-329d-4000-8666-fc0f0096273b tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:23.346365 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=41 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:23.353683 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2f3829c1-329d-4000-8666-fc0f0096273b tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:23.356626 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2f3829c1-329d-4000-8666-fc0f0096273b tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:23.365786 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2f3829c1-329d-4000-8666-fc0f0096273b tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] 10.222.0.13 "PUT /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 200 len: 1358 microversion: 2.75 time: 0.140952 Oct 30 01:14:23.367013 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 112/206] 10.222.0.13 () {62 vars in 1297 bytes} [Sun Oct 30 01:14:23 2022] PUT /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 1358 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:14:23.372400 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-958fff45-aa70-410d-b623-532e9bbfcdf4 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:23.373314 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-958fff45-aa70-410d-b623-532e9bbfcdf4 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] [instance: ba2968b1-c8ef-4ec2-9d98-66da2c62919b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:23.376941 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9a6a63ec-10b1-4272-9cc6-bfd5b4ca5d86 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/2cdc637333db40698091d929231a22b3?user_id=d8e32fa36bb44c7abbf5ffd35fdac21b" status: 200 len: 282 microversion: 2.36 time: 0.102199 Oct 30 01:14:23.384356 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 95/207] 10.222.0.13 () {60 vars in 1364 bytes} [Sun Oct 30 01:14:23 2022] GET /compute/v2.1/os-quota-sets/2cdc637333db40698091d929231a22b3?user_id=d8e32fa36bb44c7abbf5ffd35fdac21b => generated 282 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:14:23.395660 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-958fff45-aa70-410d-b623-532e9bbfcdf4 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:23.395660 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-958fff45-aa70-410d-b623-532e9bbfcdf4 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:23.395932 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d3cbf3da-b9fb-4be3-a219-cbed05f12f19 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:23.396025 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-958fff45-aa70-410d-b623-532e9bbfcdf4 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:23.396110 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d3cbf3da-b9fb-4be3-a219-cbed05f12f19 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] [instance: 7571f255-6ff3-4fc7-bcaa-4837bc05dbf5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:23.396210 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-958fff45-aa70-410d-b623-532e9bbfcdf4 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:23.396210 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-958fff45-aa70-410d-b623-532e9bbfcdf4 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:23.396210 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-958fff45-aa70-410d-b623-532e9bbfcdf4 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:23.412105 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-958fff45-aa70-410d-b623-532e9bbfcdf4 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] HTTP exception thrown: Instance ba2968b1-c8ef-4ec2-9d98-66da2c62919b could not be found. Oct 30 01:14:23.415147 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-958fff45-aa70-410d-b623-532e9bbfcdf4 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Request method failure captured: Oct 30 01:14:23.415147 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b HTTP/1.1 Oct 30 01:14:23.415147 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:14:23.415147 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:14:23.415147 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:14:23.415147 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:14:23.415147 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:14:23.415147 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:14:23.415147 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:14:23.415147 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:14:23.415147 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXc-z1rQpRJG_1Qx2ldZYzLzeIVZ4BawuAkv2SSf85ILkyxYcb2WZDbR2BAGG1kJiKiXi44Gh6yGjtlIIycroy83nDE82dxfGDs7QbsfvCmLYYe4n7BicucQYxUuT0DofnIDiDCOnROcOvMZgBVhFeg5Lbl7hOIqp80RHDAxUA6WlmWI Oct 30 01:14:23.415147 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:14:23.415147 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:14:23.415147 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:14:23.415147 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:14:23.415147 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:14:23.415147 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:14:23.415147 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: ce6543b666064cd78c02ec5a471d003f Oct 30 01:14:23.415147 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-AggregatesAdminTestJSON-252681350 Oct 30 01:14:23.415147 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:14:23.415147 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:14:23.416554 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ce6543b666064cd78c02ec5a471d003f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ce6543b666064cd78c02ec5a471d003f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ce6543b666064cd78c02ec5a471d003f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ce6543b666064cd78c02ec5a471d003f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:14:23.416554 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-AggregatesAdminTestJSON-252681350 Oct 30 01:14:23.416554 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: ce6543b666064cd78c02ec5a471d003f Oct 30 01:14:23.416554 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-252681350 Oct 30 01:14:23.416554 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-AggregatesAdminTestJSON-252681350-project Oct 30 01:14:23.416554 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:14:23.416554 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:14:23.416554 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: ae9211a459e946c1a114983c531a8897 Oct 30 01:14:23.416554 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-AggregatesAdminTestJSON-252681350-project Oct 30 01:14:23.416554 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:14:23.416554 n-d-master-1 devstack@n-api.service[121103]: exception: Instance ba2968b1-c8ef-4ec2-9d98-66da2c62919b could not be found. Oct 30 01:14:23.416554 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'ba2968b1-c8ef-4ec2-9d98-66da2c62919b'} Oct 30 01:14:23.417386 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:14:23.417386 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:23.417386 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:14:23.417386 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:14:23.417386 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:14:23.417386 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:14:23.417386 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:14:23.417386 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:14:23.417386 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:14:23.417386 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:14:23.417386 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba2968b1-c8ef-4ec2-9d98-66da2c62919b could not be found. Oct 30 01:14:23.417386 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:23.417386 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:23.417386 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:23.417386 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:23.417386 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:23.417386 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:23.417386 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:14:23.417386 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:14:23.417386 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:14:23.420001 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:14:23.420001 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:14:23.420001 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:14:23.420001 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:14:23.420001 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:14:23.420001 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:14:23.420001 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:14:23.420001 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba2968b1-c8ef-4ec2-9d98-66da2c62919b could not be found. Oct 30 01:14:23.420001 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:23.420001 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:23.420001 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:23.420001 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:23.420001 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:23.420001 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:23.420001 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:14:23.420001 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:14:23.420001 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba2968b1-c8ef-4ec2-9d98-66da2c62919b could not be found. Oct 30 01:14:23.420001 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:23.421154 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-958fff45-aa70-410d-b623-532e9bbfcdf4 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Returning 404 to user: Instance ba2968b1-c8ef-4ec2-9d98-66da2c62919b could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:14:23.422833 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3cbf3da-b9fb-4be3-a219-cbed05f12f19 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:23.423908 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3cbf3da-b9fb-4be3-a219-cbed05f12f19 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:23.424359 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-958fff45-aa70-410d-b623-532e9bbfcdf4 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] 10.222.0.13 "GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b" status: 404 len: 111 microversion: 2.1 time: 0.055757 Oct 30 01:14:23.425713 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 113/208] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:23 2022] GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:14:23.429751 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3cbf3da-b9fb-4be3-a219-cbed05f12f19 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:23.430620 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3cbf3da-b9fb-4be3-a219-cbed05f12f19 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:23.431236 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3cbf3da-b9fb-4be3-a219-cbed05f12f19 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:23.432291 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-651ed7db-ed1d-43b8-9342-db49e887fe66 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:23.432736 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3cbf3da-b9fb-4be3-a219-cbed05f12f19 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:23.433658 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-651ed7db-ed1d-43b8-9342-db49e887fe66 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:23.518477 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-651ed7db-ed1d-43b8-9342-db49e887fe66 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:23.527153 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-651ed7db-ed1d-43b8-9342-db49e887fe66 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:23.529159 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-651ed7db-ed1d-43b8-9342-db49e887fe66 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:23.538603 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-651ed7db-ed1d-43b8-9342-db49e887fe66 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] 10.222.0.13 "GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 200 len: 1358 microversion: 2.75 time: 0.111551 Oct 30 01:14:23.545531 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 114/209] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:14:23 2022] GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 1358 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:14:23.550031 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6048854d-0b77-499e-b825-29dc910a4cc0 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:23.574298 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6048854d-0b77-499e-b825-29dc910a4cc0 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:23.575049 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6048854d-0b77-499e-b825-29dc910a4cc0 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:23.575638 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6048854d-0b77-499e-b825-29dc910a4cc0 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:23.665096 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d3cbf3da-b9fb-4be3-a219-cbed05f12f19 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056e59c7d4c2475eb66b64e0e24367be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6f42c16eeb4e97b65cebf891105008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:23.674527 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d3cbf3da-b9fb-4be3-a219-cbed05f12f19 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] 10.222.0.13 "GET /compute/v2.1/servers/7571f255-6ff3-4fc7-bcaa-4837bc05dbf5" status: 200 len: 1389 microversion: 2.1 time: 0.292294 Oct 30 01:14:23.676328 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 96/210] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:23 2022] GET /compute/v2.1/servers/7571f255-6ff3-4fc7-bcaa-4837bc05dbf5 => generated 1389 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:23.815807 n-d-master-1 devstack@n-api.service[121103]: WARNING nova.scheduler.client.report [None req-6048854d-0b77-499e-b825-29dc910a4cc0 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] [req-603e011c-836b-4e0d-ae0b-5eae37dadae1] Failed to update aggregates to [] for resource provider with UUID 18db4346-f719-47e0-9fa3-2ff8ca274990. Got 409: {"errors": [{"status": 409, "title": "Conflict", "detail": "There was a conflict when trying to complete your request.\n\n Update conflict: Another thread concurrently updated the resource provider data. Please retry your update ", "request_id": "req-603e011c-836b-4e0d-ae0b-5eae37dadae1"}]} Oct 30 01:14:23.912267 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-729bf52b-f336-4234-9d03-84b43f48adf5 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:23.912882 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-729bf52b-f336-4234-9d03-84b43f48adf5 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] [instance: ac13f3c4-a93f-4664-b102-aa57f9c63308] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:23.922957 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-729bf52b-f336-4234-9d03-84b43f48adf5 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:23.930599 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-729bf52b-f336-4234-9d03-84b43f48adf5 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:23.930599 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-729bf52b-f336-4234-9d03-84b43f48adf5 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:23.930599 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-729bf52b-f336-4234-9d03-84b43f48adf5 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:23.930599 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-729bf52b-f336-4234-9d03-84b43f48adf5 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:23.931083 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-729bf52b-f336-4234-9d03-84b43f48adf5 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:24.145150 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-729bf52b-f336-4234-9d03-84b43f48adf5 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464f9e9314154e3f9c779b9ae10b2a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a83b0b15194aa69fc4d82876a1e6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:24.156845 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-729bf52b-f336-4234-9d03-84b43f48adf5 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] 10.222.0.13 "GET /compute/v2.1/servers/ac13f3c4-a93f-4664-b102-aa57f9c63308" status: 200 len: 1318 microversion: 2.1 time: 0.249705 Oct 30 01:14:24.160754 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 97/211] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:23 2022] GET /compute/v2.1/servers/ac13f3c4-a93f-4664-b102-aa57f9c63308 => generated 1318 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:24.199263 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6048854d-0b77-499e-b825-29dc910a4cc0 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 297 microversion: 2.1 time: 0.658524 Oct 30 01:14:24.199869 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 115/212] 10.222.0.13 () {60 vars in 1191 bytes} [Sun Oct 30 01:14:23 2022] POST /compute/v2.1/os-aggregates/2/action => generated 297 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:24.212522 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5319466e-ddb2-4190-ba75-d7a2bba60c53 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:24.250928 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9a8577e5-49d5-419c-b4bf-92896d27087b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:24.251522 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9a8577e5-49d5-419c-b4bf-92896d27087b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 7e81dcfb-dcbe-4e05-91a4-541ff2c404ae] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:24.258921 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9a8577e5-49d5-419c-b4bf-92896d27087b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:24.259408 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9a8577e5-49d5-419c-b4bf-92896d27087b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:24.259835 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9a8577e5-49d5-419c-b4bf-92896d27087b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:24.260545 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9a8577e5-49d5-419c-b4bf-92896d27087b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:24.261380 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9a8577e5-49d5-419c-b4bf-92896d27087b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:24.261990 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9a8577e5-49d5-419c-b4bf-92896d27087b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:24.334717 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5319466e-ddb2-4190-ba75-d7a2bba60c53 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.124703 Oct 30 01:14:24.335405 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 98/213] 10.222.0.13 () {58 vars in 1152 bytes} [Sun Oct 30 01:14:24 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 30 01:14:24.351385 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ad0d2f7f-bdbe-430e-b938-d23973998b13 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-639493408"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:24.355610 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.aggregate [None req-ad0d2f7f-bdbe-430e-b938-d23973998b13 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Generated uuid ab2bbdfc-cff2-455d-a1f5-190cffce6fe6 for aggregate {{(pid=121102) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 30 01:14:24.416378 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9a8577e5-49d5-419c-b4bf-92896d27087b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:24.424104 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9a8577e5-49d5-419c-b4bf-92896d27087b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae" status: 200 len: 1311 microversion: 2.1 time: 0.177459 Oct 30 01:14:24.424669 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 116/214] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:24 2022] GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae => generated 1311 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:14:24.504458 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ad0d2f7f-bdbe-430e-b938-d23973998b13 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.156054 Oct 30 01:14:24.505682 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 99/215] 10.222.0.13 () {60 vars in 1164 bytes} [Sun Oct 30 01:14:24 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:24.528034 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-15f31572-b8ac-4d0c-a5b9-0d00064cbaa8 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:24.553397 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-15f31572-b8ac-4d0c-a5b9-0d00064cbaa8 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:24.553893 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-15f31572-b8ac-4d0c-a5b9-0d00064cbaa8 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:24.554326 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-15f31572-b8ac-4d0c-a5b9-0d00064cbaa8 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:24.571005 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6055d86a-a983-4631-8248-2b5e6f512144 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:24.572687 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6055d86a-a983-4631-8248-2b5e6f512144 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:24.685214 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6055d86a-a983-4631-8248-2b5e6f512144 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:24.699565 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6055d86a-a983-4631-8248-2b5e6f512144 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:24.701319 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6055d86a-a983-4631-8248-2b5e6f512144 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:24.716713 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6055d86a-a983-4631-8248-2b5e6f512144 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] 10.222.0.13 "GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 200 len: 1358 microversion: 2.75 time: 0.149651 Oct 30 01:14:24.718884 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 100/216] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:14:24 2022] GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:14:24.756274 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1f070cd1-56d9-45dd-872e-e6e5a65b6e09 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:24.756890 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1f070cd1-56d9-45dd-872e-e6e5a65b6e09 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] [instance: 7571f255-6ff3-4fc7-bcaa-4837bc05dbf5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:24.786040 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1f070cd1-56d9-45dd-872e-e6e5a65b6e09 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:24.793680 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1f070cd1-56d9-45dd-872e-e6e5a65b6e09 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:24.793809 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1f070cd1-56d9-45dd-872e-e6e5a65b6e09 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:24.794493 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1f070cd1-56d9-45dd-872e-e6e5a65b6e09 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:24.796071 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1f070cd1-56d9-45dd-872e-e6e5a65b6e09 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:24.796535 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1f070cd1-56d9-45dd-872e-e6e5a65b6e09 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:24.954886 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-15f31572-b8ac-4d0c-a5b9-0d00064cbaa8 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 241 microversion: 2.1 time: 0.435933 Oct 30 01:14:24.954886 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 117/217] 10.222.0.13 () {60 vars in 1191 bytes} [Sun Oct 30 01:14:24 2022] POST /compute/v2.1/os-aggregates/3/action => generated 241 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:14:24.965154 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-87111b28-cfc1-493d-9cb9-04c71d9b4db0 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:24.991310 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-87111b28-cfc1-493d-9cb9-04c71d9b4db0 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 241 microversion: 2.1 time: 0.029032 Oct 30 01:14:24.995327 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 118/218] 10.222.0.13 () {58 vars in 1149 bytes} [Sun Oct 30 01:14:24 2022] GET /compute/v2.1/os-aggregates/3 => generated 241 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:14:25.017498 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cd0f4796-c962-4417-af69-9e70d986575e tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:25.032388 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd0f4796-c962-4417-af69-9e70d986575e tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:25.033495 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd0f4796-c962-4417-af69-9e70d986575e tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:25.034235 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd0f4796-c962-4417-af69-9e70d986575e tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:25.068998 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1f070cd1-56d9-45dd-872e-e6e5a65b6e09 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056e59c7d4c2475eb66b64e0e24367be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6f42c16eeb4e97b65cebf891105008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:25.082252 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1f070cd1-56d9-45dd-872e-e6e5a65b6e09 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] 10.222.0.13 "GET /compute/v2.1/servers/7571f255-6ff3-4fc7-bcaa-4837bc05dbf5" status: 200 len: 1389 microversion: 2.1 time: 0.360584 Oct 30 01:14:25.084307 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 101/219] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:24 2022] GET /compute/v2.1/servers/7571f255-6ff3-4fc7-bcaa-4837bc05dbf5 => generated 1389 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:25.182407 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0f6a9cb8-f6d0-4aad-93d6-878b3f03bc99 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:25.183283 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0f6a9cb8-f6d0-4aad-93d6-878b3f03bc99 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] [instance: ac13f3c4-a93f-4664-b102-aa57f9c63308] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:25.192877 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0f6a9cb8-f6d0-4aad-93d6-878b3f03bc99 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:25.193460 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0f6a9cb8-f6d0-4aad-93d6-878b3f03bc99 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:25.193901 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0f6a9cb8-f6d0-4aad-93d6-878b3f03bc99 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:25.195257 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0f6a9cb8-f6d0-4aad-93d6-878b3f03bc99 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:25.195771 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0f6a9cb8-f6d0-4aad-93d6-878b3f03bc99 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:25.196210 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0f6a9cb8-f6d0-4aad-93d6-878b3f03bc99 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:25.330227 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cd0f4796-c962-4417-af69-9e70d986575e tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 226 microversion: 2.1 time: 0.328832 Oct 30 01:14:25.335091 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 119/220] 10.222.0.13 () {60 vars in 1191 bytes} [Sun Oct 30 01:14:24 2022] POST /compute/v2.1/os-aggregates/3/action => generated 226 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:25.341941 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-67fbf38c-fb4d-41fa-b4c5-071c622da2af req-692a67de-ac42-4968-a1f4-c2e95d88494e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7571f255-6ff3-4fc7-bcaa-4837bc05dbf5", "name": "network-vif-plugged", "status": "completed", "tag": "f6b29ab4-dbe4-4f1d-8b86-4f2415442840"}, {"server_uuid": "7e81dcfb-dcbe-4e05-91a4-541ff2c404ae", "name": "network-vif-plugged", "status": "completed", "tag": "8c9bf831-4693-4fde-804b-2216247d9310"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:25.363209 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-67fbf38c-fb4d-41fa-b4c5-071c622da2af req-692a67de-ac42-4968-a1f4-c2e95d88494e service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:25.364024 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-67fbf38c-fb4d-41fa-b4c5-071c622da2af req-692a67de-ac42-4968-a1f4-c2e95d88494e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:25.364668 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-67fbf38c-fb4d-41fa-b4c5-071c622da2af req-692a67de-ac42-4968-a1f4-c2e95d88494e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:25.378486 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-67fbf38c-fb4d-41fa-b4c5-071c622da2af req-692a67de-ac42-4968-a1f4-c2e95d88494e service nova] Creating event network-vif-plugged:f6b29ab4-dbe4-4f1d-8b86-4f2415442840 for instance 7571f255-6ff3-4fc7-bcaa-4837bc05dbf5 on n-h2-master-1 Oct 30 01:14:25.379232 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-67fbf38c-fb4d-41fa-b4c5-071c622da2af req-692a67de-ac42-4968-a1f4-c2e95d88494e service nova] Creating event network-vif-plugged:8c9bf831-4693-4fde-804b-2216247d9310 for instance 7e81dcfb-dcbe-4e05-91a4-541ff2c404ae on n-h1-master-1 Oct 30 01:14:25.382519 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0f6a9cb8-f6d0-4aad-93d6-878b3f03bc99 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464f9e9314154e3f9c779b9ae10b2a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a83b0b15194aa69fc4d82876a1e6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:25.392082 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0f6a9cb8-f6d0-4aad-93d6-878b3f03bc99 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] 10.222.0.13 "GET /compute/v2.1/servers/ac13f3c4-a93f-4664-b102-aa57f9c63308" status: 200 len: 1318 microversion: 2.1 time: 0.213600 Oct 30 01:14:25.397371 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 102/221] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:25 2022] GET /compute/v2.1/servers/ac13f3c4-a93f-4664-b102-aa57f9c63308 => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:14:25.397772 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-67fbf38c-fb4d-41fa-b4c5-071c622da2af req-692a67de-ac42-4968-a1f4-c2e95d88494e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.055936 Oct 30 01:14:25.397772 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 120/222] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:25.398802 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-28ff9ab0-b0ba-43cd-8704-17296cbc86bc tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:25.448264 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-14a163c8-d175-422d-8073-2f215652e14c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:25.448969 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-14a163c8-d175-422d-8073-2f215652e14c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 7e81dcfb-dcbe-4e05-91a4-541ff2c404ae] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:25.470120 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14a163c8-d175-422d-8073-2f215652e14c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:25.470616 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14a163c8-d175-422d-8073-2f215652e14c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:25.473299 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14a163c8-d175-422d-8073-2f215652e14c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:25.474287 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14a163c8-d175-422d-8073-2f215652e14c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:25.474875 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14a163c8-d175-422d-8073-2f215652e14c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:25.475337 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14a163c8-d175-422d-8073-2f215652e14c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:25.494998 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-28ff9ab0-b0ba-43cd-8704-17296cbc86bc tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.100612 Oct 30 01:14:25.496314 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 103/223] 10.222.0.13 () {58 vars in 1152 bytes} [Sun Oct 30 01:14:25 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 30 01:14:25.507565 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-060dbeca-153a-439f-85ff-07d58adc5548 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-381618199"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:25.516540 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.aggregate [None req-060dbeca-153a-439f-85ff-07d58adc5548 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Generated uuid 8e1f9503-f676-4c02-ac5b-117820d94114 for aggregate {{(pid=121102) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 30 01:14:25.678892 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-060dbeca-153a-439f-85ff-07d58adc5548 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.175905 Oct 30 01:14:25.680982 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 104/224] 10.222.0.13 () {60 vars in 1164 bytes} [Sun Oct 30 01:14:25 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:25.691123 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d984682a-4f95-462b-af07-7507459a8d0e tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:25.714223 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d984682a-4f95-462b-af07-7507459a8d0e tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:25.714761 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d984682a-4f95-462b-af07-7507459a8d0e tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:25.715200 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d984682a-4f95-462b-af07-7507459a8d0e tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:25.959169 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-14a163c8-d175-422d-8073-2f215652e14c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:25.973781 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-14a163c8-d175-422d-8073-2f215652e14c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae" status: 200 len: 1311 microversion: 2.1 time: 0.527477 Oct 30 01:14:25.974662 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 121/225] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:25 2022] GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae => generated 1311 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:25.992080 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c31063af-4747-41ec-a684-a61073be3441 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:25.995868 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c31063af-4747-41ec-a684-a61073be3441 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:26.010960 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c31063af-4747-41ec-a684-a61073be3441 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:26.013125 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c31063af-4747-41ec-a684-a61073be3441 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:26.013606 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c31063af-4747-41ec-a684-a61073be3441 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:26.015516 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c31063af-4747-41ec-a684-a61073be3441 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:26.016002 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c31063af-4747-41ec-a684-a61073be3441 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:26.020194 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c31063af-4747-41ec-a684-a61073be3441 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:26.136609 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d984682a-4f95-462b-af07-7507459a8d0e tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 241 microversion: 2.1 time: 0.449312 Oct 30 01:14:26.143424 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 105/226] 10.222.0.13 () {60 vars in 1191 bytes} [Sun Oct 30 01:14:25 2022] POST /compute/v2.1/os-aggregates/4/action => generated 241 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:14:26.143424 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-95171618-3ef5-4903-a661-97b16bbef27a tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:26.145821 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-95171618-3ef5-4903-a661-97b16bbef27a tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] [instance: 7571f255-6ff3-4fc7-bcaa-4837bc05dbf5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:26.160503 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-95171618-3ef5-4903-a661-97b16bbef27a tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:26.161375 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-95171618-3ef5-4903-a661-97b16bbef27a tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:26.162035 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-95171618-3ef5-4903-a661-97b16bbef27a tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:26.162997 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-95171618-3ef5-4903-a661-97b16bbef27a tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:26.163993 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-95171618-3ef5-4903-a661-97b16bbef27a tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:26.164916 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-95171618-3ef5-4903-a661-97b16bbef27a tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:26.241654 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c31063af-4747-41ec-a684-a61073be3441 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:26.260245 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c31063af-4747-41ec-a684-a61073be3441 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:26.265456 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c31063af-4747-41ec-a684-a61073be3441 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:26.281929 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c31063af-4747-41ec-a684-a61073be3441 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] 10.222.0.13 "GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 200 len: 1410 microversion: 2.75 time: 0.305496 Oct 30 01:14:26.285377 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 122/227] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:14:25 2022] GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 1410 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:14:26.304473 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4ab0e418-244b-488d-a023-bb9939f93b77 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:26.314330 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4ab0e418-244b-488d-a023-bb9939f93b77 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates" status: 200 len: 244 microversion: 2.1 time: 0.027853 Oct 30 01:14:26.323590 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 123/228] 10.222.0.13 () {58 vars in 1143 bytes} [Sun Oct 30 01:14:26 2022] GET /compute/v2.1/os-aggregates => generated 244 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:26.329432 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-279767a8-f58a-44d8-b7c6-996e06d625c1 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:26.341307 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-279767a8-f58a-44d8-b7c6-996e06d625c1 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:26.342001 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-279767a8-f58a-44d8-b7c6-996e06d625c1 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:26.342583 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-279767a8-f58a-44d8-b7c6-996e06d625c1 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:26.484682 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-95171618-3ef5-4903-a661-97b16bbef27a tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056e59c7d4c2475eb66b64e0e24367be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6f42c16eeb4e97b65cebf891105008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:26.495868 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-95171618-3ef5-4903-a661-97b16bbef27a tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] 10.222.0.13 "GET /compute/v2.1/servers/7571f255-6ff3-4fc7-bcaa-4837bc05dbf5" status: 200 len: 1389 microversion: 2.1 time: 0.357314 Oct 30 01:14:26.498221 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 106/229] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:26 2022] GET /compute/v2.1/servers/7571f255-6ff3-4fc7-bcaa-4837bc05dbf5 => generated 1389 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:26.502530 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d1d91ceb-3693-45be-a313-320e2465b7f6 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:26.503525 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d1d91ceb-3693-45be-a313-320e2465b7f6 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] [instance: ac13f3c4-a93f-4664-b102-aa57f9c63308] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:26.510922 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1d91ceb-3693-45be-a313-320e2465b7f6 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:26.511649 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1d91ceb-3693-45be-a313-320e2465b7f6 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:26.512957 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1d91ceb-3693-45be-a313-320e2465b7f6 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:26.515205 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1d91ceb-3693-45be-a313-320e2465b7f6 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:26.517773 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1d91ceb-3693-45be-a313-320e2465b7f6 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:26.518700 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1d91ceb-3693-45be-a313-320e2465b7f6 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:26.712113 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d1d91ceb-3693-45be-a313-320e2465b7f6 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464f9e9314154e3f9c779b9ae10b2a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a83b0b15194aa69fc4d82876a1e6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:26.720544 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d1d91ceb-3693-45be-a313-320e2465b7f6 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] 10.222.0.13 "GET /compute/v2.1/servers/ac13f3c4-a93f-4664-b102-aa57f9c63308" status: 200 len: 1318 microversion: 2.1 time: 0.222513 Oct 30 01:14:26.721135 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 107/230] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:26 2022] GET /compute/v2.1/servers/ac13f3c4-a93f-4664-b102-aa57f9c63308 => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:26.817211 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-279767a8-f58a-44d8-b7c6-996e06d625c1 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 226 microversion: 2.1 time: 0.490141 Oct 30 01:14:26.818232 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 124/231] 10.222.0.13 () {60 vars in 1191 bytes} [Sun Oct 30 01:14:26 2022] POST /compute/v2.1/os-aggregates/4/action => generated 226 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:26.841166 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d38b316d-80db-4b69-a0f7-2e38ee8baefa tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:26.885141 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=5,nova_api:DELETE=5 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:26.998819 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d38b316d-80db-4b69-a0f7-2e38ee8baefa tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.169279 Oct 30 01:14:26.998819 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 108/232] 10.222.0.13 () {58 vars in 1152 bytes} [Sun Oct 30 01:14:26 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 30 01:14:27.006227 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bfceb8a2-7964-4392-8f3e-7c5bb18636a7 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:27.007030 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0cc7ace7-bd90-4044-9741-b90383a7b525 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-210402082"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:27.010432 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.aggregate [None req-0cc7ace7-bd90-4044-9741-b90383a7b525 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Generated uuid 62ea4b5f-2947-4bc1-92b3-3f3b975e0245 for aggregate {{(pid=121102) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 30 01:14:27.011877 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-bfceb8a2-7964-4392-8f3e-7c5bb18636a7 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 7e81dcfb-dcbe-4e05-91a4-541ff2c404ae] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:27.036282 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bfceb8a2-7964-4392-8f3e-7c5bb18636a7 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:27.038995 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bfceb8a2-7964-4392-8f3e-7c5bb18636a7 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:27.038995 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bfceb8a2-7964-4392-8f3e-7c5bb18636a7 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:27.039213 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bfceb8a2-7964-4392-8f3e-7c5bb18636a7 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:27.039985 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bfceb8a2-7964-4392-8f3e-7c5bb18636a7 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:27.041006 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bfceb8a2-7964-4392-8f3e-7c5bb18636a7 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:27.150730 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0cc7ace7-bd90-4044-9741-b90383a7b525 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.147388 Oct 30 01:14:27.154266 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 109/233] 10.222.0.13 () {60 vars in 1164 bytes} [Sun Oct 30 01:14:27 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:14:27.171413 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a8dae025-f06f-49d3-b715-0b499d29bcf5 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:27.204071 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a8dae025-f06f-49d3-b715-0b499d29bcf5 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:27.204442 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a8dae025-f06f-49d3-b715-0b499d29bcf5 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:27.205037 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a8dae025-f06f-49d3-b715-0b499d29bcf5 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:27.318781 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-bfceb8a2-7964-4392-8f3e-7c5bb18636a7 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:27.338670 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bfceb8a2-7964-4392-8f3e-7c5bb18636a7 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae" status: 200 len: 1311 microversion: 2.1 time: 0.345438 Oct 30 01:14:27.351500 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 125/234] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:26 2022] GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae => generated 1311 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:27.358779 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-86a06f9a-42cd-448a-8246-bb69a7415105 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:27.360568 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-86a06f9a-42cd-448a-8246-bb69a7415105 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:27.407720 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-86a06f9a-42cd-448a-8246-bb69a7415105 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:27.408340 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-86a06f9a-42cd-448a-8246-bb69a7415105 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:27.408861 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-86a06f9a-42cd-448a-8246-bb69a7415105 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:27.411824 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-86a06f9a-42cd-448a-8246-bb69a7415105 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:27.412376 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-86a06f9a-42cd-448a-8246-bb69a7415105 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:27.412893 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-86a06f9a-42cd-448a-8246-bb69a7415105 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:27.572597 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-86a06f9a-42cd-448a-8246-bb69a7415105 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:27.582882 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-86a06f9a-42cd-448a-8246-bb69a7415105 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:27.584472 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-86a06f9a-42cd-448a-8246-bb69a7415105 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:27.596253 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a8dae025-f06f-49d3-b715-0b499d29bcf5 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 241 microversion: 2.1 time: 0.428564 Oct 30 01:14:27.596892 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 110/235] 10.222.0.13 () {60 vars in 1191 bytes} [Sun Oct 30 01:14:27 2022] POST /compute/v2.1/os-aggregates/5/action => generated 241 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:27.604072 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5a9ea629-2623-48e3-a65f-e449a53b9e29 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:27.604674 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:27.604792 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5a9ea629-2623-48e3-a65f-e449a53b9e29 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] [instance: 7571f255-6ff3-4fc7-bcaa-4837bc05dbf5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:27.608670 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-86a06f9a-42cd-448a-8246-bb69a7415105 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] 10.222.0.13 "GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 200 len: 1416 microversion: 2.75 time: 0.257374 Oct 30 01:14:27.609264 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 126/236] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:14:27 2022] GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 1416 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:14:27.617629 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3be0f98a-6b41-48ad-8659-ed442d20bf62 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:27.633863 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a9ea629-2623-48e3-a65f-e449a53b9e29 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:27.634994 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a9ea629-2623-48e3-a65f-e449a53b9e29 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:27.635610 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a9ea629-2623-48e3-a65f-e449a53b9e29 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:27.636769 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a9ea629-2623-48e3-a65f-e449a53b9e29 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:27.637719 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a9ea629-2623-48e3-a65f-e449a53b9e29 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:27.638394 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a9ea629-2623-48e3-a65f-e449a53b9e29 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:27.648417 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3be0f98a-6b41-48ad-8659-ed442d20bf62 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:27.648930 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3be0f98a-6b41-48ad-8659-ed442d20bf62 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:27.649399 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3be0f98a-6b41-48ad-8659-ed442d20bf62 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:27.849644 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5a9ea629-2623-48e3-a65f-e449a53b9e29 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056e59c7d4c2475eb66b64e0e24367be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6f42c16eeb4e97b65cebf891105008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:27.849644 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5a9ea629-2623-48e3-a65f-e449a53b9e29 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] 10.222.0.13 "GET /compute/v2.1/servers/7571f255-6ff3-4fc7-bcaa-4837bc05dbf5" status: 200 len: 1587 microversion: 2.1 time: 0.251451 Oct 30 01:14:27.850412 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 111/237] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:27 2022] GET /compute/v2.1/servers/7571f255-6ff3-4fc7-bcaa-4837bc05dbf5 => generated 1587 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:27.861202 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-08c0334f-572d-4a1d-a2f7-1d36f9587f28 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:27.862298 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-08c0334f-572d-4a1d-a2f7-1d36f9587f28 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] [instance: ac13f3c4-a93f-4664-b102-aa57f9c63308] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:27.870292 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08c0334f-572d-4a1d-a2f7-1d36f9587f28 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:27.871638 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08c0334f-572d-4a1d-a2f7-1d36f9587f28 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:27.872527 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08c0334f-572d-4a1d-a2f7-1d36f9587f28 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:27.889918 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08c0334f-572d-4a1d-a2f7-1d36f9587f28 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:27.890583 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08c0334f-572d-4a1d-a2f7-1d36f9587f28 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:27.891184 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08c0334f-572d-4a1d-a2f7-1d36f9587f28 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:27.996464 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3be0f98a-6b41-48ad-8659-ed442d20bf62 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 226 microversion: 2.1 time: 0.384962 Oct 30 01:14:27.997200 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 127/238] 10.222.0.13 () {60 vars in 1191 bytes} [Sun Oct 30 01:14:27 2022] POST /compute/v2.1/os-aggregates/5/action => generated 226 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:28.005046 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-de6a067f-5137-4d7b-aeda-efa7b494bf54 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:28.005608 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-de6a067f-5137-4d7b-aeda-efa7b494bf54 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] [instance: 7571f255-6ff3-4fc7-bcaa-4837bc05dbf5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:28.021467 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de6a067f-5137-4d7b-aeda-efa7b494bf54 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:28.023301 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de6a067f-5137-4d7b-aeda-efa7b494bf54 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:28.023772 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de6a067f-5137-4d7b-aeda-efa7b494bf54 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:28.026211 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de6a067f-5137-4d7b-aeda-efa7b494bf54 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:28.026803 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de6a067f-5137-4d7b-aeda-efa7b494bf54 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:28.027241 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de6a067f-5137-4d7b-aeda-efa7b494bf54 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:28.079983 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-08c0334f-572d-4a1d-a2f7-1d36f9587f28 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464f9e9314154e3f9c779b9ae10b2a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a83b0b15194aa69fc4d82876a1e6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:28.090416 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-08c0334f-572d-4a1d-a2f7-1d36f9587f28 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] 10.222.0.13 "GET /compute/v2.1/servers/ac13f3c4-a93f-4664-b102-aa57f9c63308" status: 200 len: 1468 microversion: 2.1 time: 0.233646 Oct 30 01:14:28.107570 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 112/239] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:27 2022] GET /compute/v2.1/servers/ac13f3c4-a93f-4664-b102-aa57f9c63308 => generated 1468 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:28.117790 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-32b2d59d-a946-4de5-a63f-68a713e2f7b3 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:28.144620 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-de6a067f-5137-4d7b-aeda-efa7b494bf54 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] 10.222.0.13 "GET /compute/v2.1/servers/7571f255-6ff3-4fc7-bcaa-4837bc05dbf5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.143282 Oct 30 01:14:28.145818 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 128/240] 10.222.0.13 () {58 vars in 1275 bytes} [Sun Oct 30 01:14:27 2022] GET /compute/v2.1/servers/7571f255-6ff3-4fc7-bcaa-4837bc05dbf5/os-interface => generated 284 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:28.292207 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-32b2d59d-a946-4de5-a63f-68a713e2f7b3 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.183682 Oct 30 01:14:28.293752 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 113/241] 10.222.0.13 () {58 vars in 1152 bytes} [Sun Oct 30 01:14:28 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 30 01:14:28.304839 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ebcf4f06-4004-43fb-b805-c6600202454e tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1813659106"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:28.310256 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.aggregate [None req-ebcf4f06-4004-43fb-b805-c6600202454e tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Generated uuid e618b4f7-ab6d-4e15-8215-39f88841970a for aggregate {{(pid=121102) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 30 01:14:28.428656 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ebcf4f06-4004-43fb-b805-c6600202454e tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.128659 Oct 30 01:14:28.433704 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 114/242] 10.222.0.13 () {60 vars in 1164 bytes} [Sun Oct 30 01:14:28 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:28.437872 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-542d1bc5-05f0-44f4-80c3-30ccd437cfce tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-859016709"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:28.441565 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.aggregate [None req-542d1bc5-05f0-44f4-80c3-30ccd437cfce tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Generated uuid d2ef7b9c-3049-4b6c-ab7c-a865a1454b96 for aggregate {{(pid=121102) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 30 01:14:28.572778 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-542d1bc5-05f0-44f4-80c3-30ccd437cfce tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.142159 Oct 30 01:14:28.573762 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 115/243] 10.222.0.13 () {60 vars in 1164 bytes} [Sun Oct 30 01:14:28 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:28.585721 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-93fc9e9e-9168-4da8-88c2-669ad15a33ac tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:28.586495 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-93fc9e9e-9168-4da8-88c2-669ad15a33ac tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 7e81dcfb-dcbe-4e05-91a4-541ff2c404ae] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:28.621802 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-93fc9e9e-9168-4da8-88c2-669ad15a33ac tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:28.625014 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-93fc9e9e-9168-4da8-88c2-669ad15a33ac tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:28.626672 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-93fc9e9e-9168-4da8-88c2-669ad15a33ac tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:28.629896 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-93fc9e9e-9168-4da8-88c2-669ad15a33ac tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:28.630568 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-93fc9e9e-9168-4da8-88c2-669ad15a33ac tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:28.635202 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-93fc9e9e-9168-4da8-88c2-669ad15a33ac tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:28.641111 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5c0baa80-1b26-4b13-9e08-bb5d6fda7465 tempest-LiveMigrationNegativeTest-108718090 tempest-LiveMigrationNegativeTest-108718090-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-256046140", "block_migration": true, "disk_over_commit": false}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:28.644425 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5c0baa80-1b26-4b13-9e08-bb5d6fda7465 tempest-LiveMigrationNegativeTest-108718090 tempest-LiveMigrationNegativeTest-108718090-project-admin] [instance: ac13f3c4-a93f-4664-b102-aa57f9c63308] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:28.661827 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5c0baa80-1b26-4b13-9e08-bb5d6fda7465 tempest-LiveMigrationNegativeTest-108718090 tempest-LiveMigrationNegativeTest-108718090-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:28.662770 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5c0baa80-1b26-4b13-9e08-bb5d6fda7465 tempest-LiveMigrationNegativeTest-108718090 tempest-LiveMigrationNegativeTest-108718090-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:28.664675 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5c0baa80-1b26-4b13-9e08-bb5d6fda7465 tempest-LiveMigrationNegativeTest-108718090 tempest-LiveMigrationNegativeTest-108718090-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:28.665941 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5c0baa80-1b26-4b13-9e08-bb5d6fda7465 tempest-LiveMigrationNegativeTest-108718090 tempest-LiveMigrationNegativeTest-108718090-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:28.667266 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5c0baa80-1b26-4b13-9e08-bb5d6fda7465 tempest-LiveMigrationNegativeTest-108718090 tempest-LiveMigrationNegativeTest-108718090-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:28.669046 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5c0baa80-1b26-4b13-9e08-bb5d6fda7465 tempest-LiveMigrationNegativeTest-108718090 tempest-LiveMigrationNegativeTest-108718090-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:28.860573 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-5c0baa80-1b26-4b13-9e08-bb5d6fda7465 tempest-LiveMigrationNegativeTest-108718090 tempest-LiveMigrationNegativeTest-108718090-project-admin] Lazy-loading 'flavor' on Instance uuid ac13f3c4-a93f-4664-b102-aa57f9c63308 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:14:28.952527 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5c0baa80-1b26-4b13-9e08-bb5d6fda7465 tempest-LiveMigrationNegativeTest-108718090 tempest-LiveMigrationNegativeTest-108718090-project-admin] [instance: ac13f3c4-a93f-4664-b102-aa57f9c63308] Going to try to live migrate instance to tempest-host-256046140 {{(pid=121103) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 30 01:14:28.961567 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-5c0baa80-1b26-4b13-9e08-bb5d6fda7465 tempest-LiveMigrationNegativeTest-108718090 tempest-LiveMigrationNegativeTest-108718090-project-admin] HTTP exception thrown: Compute host tempest-host-256046140 could not be found. Oct 30 01:14:28.965930 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5c0baa80-1b26-4b13-9e08-bb5d6fda7465 tempest-LiveMigrationNegativeTest-108718090 tempest-LiveMigrationNegativeTest-108718090-project-admin] Request method failure captured: Oct 30 01:14:28.965930 n-d-master-1 devstack@n-api.service[121103]: request: POST /compute/v2.1/servers/ac13f3c4-a93f-4664-b102-aa57f9c63308/action HTTP/1.1 Oct 30 01:14:28.965930 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:14:28.965930 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:14:28.965930 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:14:28.965930 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 106 Oct 30 01:14:28.965930 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:14:28.965930 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:14:28.965930 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:14:28.965930 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:14:28.965930 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXc_XGj-dWS_YIFQ4y8CKdKs992loAea_uJ5LgWYZYwRP1J3KkdRADUG2MeZYQVgeso9p2oRCXPux9rwFLrG-4s_8R8XCnANPJe5k0rOkemnI1J-uhy8Iad0Tb3IB4iaMrNVuyUjDhbAeWb1-8whoZ1u0gQR5s5A-0BIbOZRFOXbgOYQ Oct 30 01:14:28.965930 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:14:28.965930 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:14:28.965930 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:14:28.965930 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:14:28.965930 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:14:28.965930 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:14:28.965930 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: b3dd7611342d442aa6828ec2659988d7 Oct 30 01:14:28.965930 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-LiveMigrationNegativeTest-108718090 Oct 30 01:14:28.965930 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,admin,reader Oct 30 01:14:28.965930 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,admin,reader Oct 30 01:14:28.967187 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b3dd7611342d442aa6828ec2659988d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b3dd7611342d442aa6828ec2659988d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b3dd7611342d442aa6828ec2659988d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b3dd7611342d442aa6828ec2659988d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:14:28.967187 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-LiveMigrationNegativeTest-108718090 Oct 30 01:14:28.967187 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: b3dd7611342d442aa6828ec2659988d7 Oct 30 01:14:28.967187 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-108718090 Oct 30 01:14:28.967187 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-LiveMigrationNegativeTest-108718090-project-admin Oct 30 01:14:28.967187 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:14:28.967187 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:14:28.967187 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: a1274b7f71f04b05ba1753727d2367d1 Oct 30 01:14:28.967187 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-LiveMigrationNegativeTest-108718090-project-admin Oct 30 01:14:28.967187 n-d-master-1 devstack@n-api.service[121103]: Oct 30 01:14:28.967187 n-d-master-1 devstack@n-api.service[121103]: {"os-migrateLive": {"host": "tempest-host-256046140", "block_migration": true, "disk_over_commit": false}} Oct 30 01:14:28.967187 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:14:28.967888 n-d-master-1 devstack@n-api.service[121103]: exception: Compute host tempest-host-256046140 could not be found. Oct 30 01:14:28.967888 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'ac13f3c4-a93f-4664-b102-aa57f9c63308', 'body': {'os-migrateLive': {'host': 'tempest-host-256046140', 'block_migration': True, 'disk_over_commit': False}}} Oct 30 01:14:28.967888 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:14:28.967888 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:28.967888 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 30 01:14:28.967888 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 30 01:14:28.967888 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 30 01:14:28.967888 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 30 01:14:28.967888 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 30 01:14:28.967888 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 30 01:14:28.967888 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 30 01:14:28.967888 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 30 01:14:28.967888 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 30 01:14:28.967888 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 30 01:14:28.967888 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 30 01:14:28.967888 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 30 01:14:28.967888 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 30 01:14:28.967888 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 30 01:14:28.967888 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 30 01:14:28.968928 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 30 01:14:28.968928 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 30 01:14:28.968928 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 30 01:14:28.968928 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Oct 30 01:14:28.968928 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 30 01:14:28.968928 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 01:14:28.968928 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 01:14:28.968928 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 30 01:14:28.968928 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 30 01:14:28.968928 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 30 01:14:28.968928 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:14:28.968928 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 30 01:14:28.968928 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 30 01:14:28.968928 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 30 01:14:28.968928 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 30 01:14:28.968928 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 30 01:14:28.968928 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 30 01:14:28.968928 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-256046140 could not be found. Oct 30 01:14:28.968928 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:28.971303 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:28.971303 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:28.971303 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:28.971303 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:28.971303 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:28.971303 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:14:28.971303 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:14:28.971303 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:14:28.971303 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:14:28.971303 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:14:28.971303 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:14:28.971303 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:14:28.971303 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:14:28.971303 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:14:28.971303 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:14:28.971303 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 30 01:14:28.971303 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 30 01:14:28.971303 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 30 01:14:28.971303 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-256046140 could not be found. Oct 30 01:14:28.971303 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:28.973665 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:28.973665 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:28.973665 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:28.973665 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:28.973665 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:28.973665 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:14:28.973665 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:14:28.973665 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-256046140 could not be found. Oct 30 01:14:28.973665 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:28.975600 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5c0baa80-1b26-4b13-9e08-bb5d6fda7465 tempest-LiveMigrationNegativeTest-108718090 tempest-LiveMigrationNegativeTest-108718090-project-admin] Returning 400 to user: Compute host tempest-host-256046140 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:14:28.976717 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5c0baa80-1b26-4b13-9e08-bb5d6fda7465 tempest-LiveMigrationNegativeTest-108718090 tempest-LiveMigrationNegativeTest-108718090-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/ac13f3c4-a93f-4664-b102-aa57f9c63308/action" status: 400 len: 99 microversion: 2.1 time: 0.829816 Oct 30 01:14:28.977912 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 129/244] 10.222.0.13 () {60 vars in 1279 bytes} [Sun Oct 30 01:14:28 2022] POST /compute/v2.1/servers/ac13f3c4-a93f-4664-b102-aa57f9c63308/action => generated 99 bytes in 831 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 30 01:14:28.987590 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-71d9649f-0e4f-4afc-8f12-8f5ddbadb30c tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:29.030292 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-93fc9e9e-9168-4da8-88c2-669ad15a33ac tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:29.044027 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-93fc9e9e-9168-4da8-88c2-669ad15a33ac tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae" status: 200 len: 1493 microversion: 2.1 time: 0.469171 Oct 30 01:14:29.044727 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 116/245] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:28 2022] GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae => generated 1493 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:29.050597 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a1d63d70-f56a-42c4-858a-5109bffabe0d tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:29.064815 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a1d63d70-f56a-42c4-858a-5109bffabe0d tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:29.070887 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a1d63d70-f56a-42c4-858a-5109bffabe0d tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:29.071610 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a1d63d70-f56a-42c4-858a-5109bffabe0d tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:29.108095 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-71d9649f-0e4f-4afc-8f12-8f5ddbadb30c tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.128863 Oct 30 01:14:29.109361 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 130/246] 10.222.0.13 () {58 vars in 1152 bytes} [Sun Oct 30 01:14:28 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 30 01:14:29.117751 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4754ebea-11bd-454f-a2f9-1e5b21e4996f tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:29.118909 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4754ebea-11bd-454f-a2f9-1e5b21e4996f tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:29.136680 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4754ebea-11bd-454f-a2f9-1e5b21e4996f tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:29.137167 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4754ebea-11bd-454f-a2f9-1e5b21e4996f tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:29.138304 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4754ebea-11bd-454f-a2f9-1e5b21e4996f tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:29.139043 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4754ebea-11bd-454f-a2f9-1e5b21e4996f tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:29.142452 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4754ebea-11bd-454f-a2f9-1e5b21e4996f tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:29.144460 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4754ebea-11bd-454f-a2f9-1e5b21e4996f tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:29.440129 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4754ebea-11bd-454f-a2f9-1e5b21e4996f tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:29.440129 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4754ebea-11bd-454f-a2f9-1e5b21e4996f tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:29.442344 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4754ebea-11bd-454f-a2f9-1e5b21e4996f tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:29.442344 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4754ebea-11bd-454f-a2f9-1e5b21e4996f tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] 10.222.0.13 "GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 200 len: 1416 microversion: 2.75 time: 0.177862 Oct 30 01:14:29.442344 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 131/247] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:14:29 2022] GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 1416 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:14:29.442344 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3e763a71-e3ab-428b-abbe-7dc717704a80 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:29.442673 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3e763a71-e3ab-428b-abbe-7dc717704a80 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] [instance: ac13f3c4-a93f-4664-b102-aa57f9c63308] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:29.442673 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3e763a71-e3ab-428b-abbe-7dc717704a80 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:29.442673 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3e763a71-e3ab-428b-abbe-7dc717704a80 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:29.442673 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3e763a71-e3ab-428b-abbe-7dc717704a80 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:29.442991 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3e763a71-e3ab-428b-abbe-7dc717704a80 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:29.442991 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3e763a71-e3ab-428b-abbe-7dc717704a80 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:29.442991 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3e763a71-e3ab-428b-abbe-7dc717704a80 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:29.442991 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=100 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:29.599104 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3e763a71-e3ab-428b-abbe-7dc717704a80 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464f9e9314154e3f9c779b9ae10b2a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a83b0b15194aa69fc4d82876a1e6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:29.608210 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3e763a71-e3ab-428b-abbe-7dc717704a80 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] 10.222.0.13 "GET /compute/v2.1/servers/ac13f3c4-a93f-4664-b102-aa57f9c63308" status: 200 len: 1468 microversion: 2.1 time: 0.317696 Oct 30 01:14:29.608900 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 132/248] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:29 2022] GET /compute/v2.1/servers/ac13f3c4-a93f-4664-b102-aa57f9c63308 => generated 1468 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:29.733597 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a1d63d70-f56a-42c4-858a-5109bffabe0d tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 241 microversion: 2.1 time: 0.687541 Oct 30 01:14:29.734328 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 117/249] 10.222.0.13 () {60 vars in 1191 bytes} [Sun Oct 30 01:14:29 2022] POST /compute/v2.1/os-aggregates/7/action => generated 241 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:29.739670 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9f6eba9a-586b-49a3-b05f-61f263cea512 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:29.747248 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-9f6eba9a-586b-49a3-b05f-61f263cea512 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Oct 30 01:14:29.749680 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9f6eba9a-586b-49a3-b05f-61f263cea512 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Request method failure captured: Oct 30 01:14:29.749680 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/os-aggregates/6 HTTP/1.1 Oct 30 01:14:29.749680 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:14:29.749680 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:14:29.749680 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:14:29.749680 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:14:29.749680 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:14:29.749680 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:14:29.749680 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:14:29.749680 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:14:29.749680 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXc-3F3F1Y6Y1_TQt8mZdeRszXXo2epXE6tX464kkX8gvuUdnoiADGpvKY2gHTN6Xg5ObogY4_xFaRfyNWUtTClwJoZu7XRGZ5qJSTBZoqQT-S1vXxDMHr-RKx3xHzdCObfk2t9OurcDjfJPbTvJ7TWuTL4Uczg-DyquLqHOTI9MfDm0 Oct 30 01:14:29.749680 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:14:29.749680 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:14:29.749680 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:14:29.749680 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:14:29.749680 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:14:29.749680 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:14:29.749680 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: dcd04564aa9a44f7bff9ed4d1d322176 Oct 30 01:14:29.749680 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-AggregatesAdminTestJSON-1475706727 Oct 30 01:14:29.749680 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,admin,reader Oct 30 01:14:29.749680 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,admin,reader Oct 30 01:14:29.751241 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dcd04564aa9a44f7bff9ed4d1d322176"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_dcd04564aa9a44f7bff9ed4d1d322176"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/dcd04564aa9a44f7bff9ed4d1d322176"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dcd04564aa9a44f7bff9ed4d1d322176"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:14:29.751241 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-AggregatesAdminTestJSON-1475706727 Oct 30 01:14:29.751241 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: dcd04564aa9a44f7bff9ed4d1d322176 Oct 30 01:14:29.751241 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1475706727 Oct 30 01:14:29.751241 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-AggregatesAdminTestJSON-1475706727-project-admin Oct 30 01:14:29.751241 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:14:29.751241 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:14:29.751241 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: b96f9e0241064bb69711a89f1f0bc2ae Oct 30 01:14:29.751241 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-AggregatesAdminTestJSON-1475706727-project-admin Oct 30 01:14:29.751241 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:14:29.751241 n-d-master-1 devstack@n-api.service[121102]: exception: Aggregate 6 could not be found. Oct 30 01:14:29.751241 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '6'} Oct 30 01:14:29.751241 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:14:29.752110 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:29.752110 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 30 01:14:29.752110 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 30 01:14:29.752110 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 30 01:14:29.752110 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 30 01:14:29.752110 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 01:14:29.752110 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 01:14:29.752110 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 30 01:14:29.752110 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 30 01:14:29.752110 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 30 01:14:29.752110 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 30 01:14:29.752110 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 30 01:14:29.752110 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 30 01:14:29.752110 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Oct 30 01:14:29.752110 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:29.752110 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:29.752110 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:29.752110 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:29.752110 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:29.753299 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:29.753299 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:14:29.753299 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:14:29.753299 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:14:29.753299 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:14:29.753299 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 30 01:14:29.753299 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:14:29.753299 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Oct 30 01:14:29.753299 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:29.753299 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:29.753299 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:29.753299 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:29.753299 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:29.753299 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:29.753299 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:14:29.753299 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:14:29.753299 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Oct 30 01:14:29.753299 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:29.754637 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9f6eba9a-586b-49a3-b05f-61f263cea512 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:14:29.754637 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9f6eba9a-586b-49a3-b05f-61f263cea512 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.015755 Oct 30 01:14:29.754637 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 118/250] 10.222.0.13 () {58 vars in 1149 bytes} [Sun Oct 30 01:14:29 2022] GET /compute/v2.1/os-aggregates/6 => generated 77 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:14:29.759643 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1f5fcbce-ca83-40c2-98ef-48d29bacfdc6 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:29.771453 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1f5fcbce-ca83-40c2-98ef-48d29bacfdc6 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:29.771969 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1f5fcbce-ca83-40c2-98ef-48d29bacfdc6 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:29.772457 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1f5fcbce-ca83-40c2-98ef-48d29bacfdc6 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:29.885644 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-1f5fcbce-ca83-40c2-98ef-48d29bacfdc6 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] HTTP exception thrown: Aggregate 7 already has host n-h1-master-1. Oct 30 01:14:29.896975 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1f5fcbce-ca83-40c2-98ef-48d29bacfdc6 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Request method failure captured: Oct 30 01:14:29.896975 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/os-aggregates/7/action HTTP/1.1 Oct 30 01:14:29.896975 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:14:29.896975 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:14:29.896975 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:14:29.896975 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 39 Oct 30 01:14:29.896975 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:14:29.896975 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:14:29.896975 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:14:29.896975 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:14:29.896975 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXc-3gN2AwBYwbdvZGmSvdpdZvZwjFntCD4wstkgGcLi3wTCXZysV4KoMBsD0aD4hAu5hNeKEvgUUO20F4SRa4sY9OuAdO3gP-QlWXV6RdLo-ocB73CaT33LhTEJFJa5Trr2_XU0o08k5NzgdUTdUTgTgWLEA7ifipfA_JZVsSsUejVI Oct 30 01:14:29.896975 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:14:29.896975 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:14:29.896975 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:14:29.896975 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:14:29.896975 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:14:29.896975 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:14:29.896975 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: c63e7b7a4aef41adaa41001c0129434c Oct 30 01:14:29.896975 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1075675897 Oct 30 01:14:29.896975 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,admin,reader Oct 30 01:14:29.896975 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,admin,reader Oct 30 01:14:29.898557 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c63e7b7a4aef41adaa41001c0129434c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c63e7b7a4aef41adaa41001c0129434c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c63e7b7a4aef41adaa41001c0129434c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c63e7b7a4aef41adaa41001c0129434c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:14:29.898557 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1075675897 Oct 30 01:14:29.898557 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: c63e7b7a4aef41adaa41001c0129434c Oct 30 01:14:29.898557 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1075675897 Oct 30 01:14:29.898557 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin Oct 30 01:14:29.898557 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:14:29.898557 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:14:29.898557 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: aa3da3ec33c7409a8c0463bf64d50400 Oct 30 01:14:29.898557 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin Oct 30 01:14:29.898557 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:14:29.898557 n-d-master-1 devstack@n-api.service[121102]: {"add_host": {"host": "n-h1-master-1"}} Oct 30 01:14:29.898557 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:14:29.898557 n-d-master-1 devstack@n-api.service[121102]: exception: Aggregate 7 already has host n-h1-master-1. Oct 30 01:14:29.899494 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '7', 'body': {'add_host': {'host': 'n-h1-master-1'}}} Oct 30 01:14:29.899494 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:14:29.899494 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:29.899494 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 30 01:14:29.899494 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 30 01:14:29.899494 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 30 01:14:29.899494 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 30 01:14:29.899494 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 30 01:14:29.899494 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 30 01:14:29.899494 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 30 01:14:29.899494 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 30 01:14:29.899494 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 30 01:14:29.899494 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 30 01:14:29.899494 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 30 01:14:29.899494 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result.read() Oct 30 01:14:29.899494 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 30 01:14:29.899494 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 30 01:14:29.899494 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 30 01:14:29.899494 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 30 01:14:29.900743 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 30 01:14:29.900743 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 30 01:14:29.900743 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 30 01:14:29.900743 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 30 01:14:29.900743 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-master-1-7' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 30 01:14:29.900743 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:29.900743 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 30 01:14:29.900743 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:29.900743 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:29.900743 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 30 01:14:29.900743 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 30 01:14:29.900743 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 30 01:14:29.900743 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi session.flush() Oct 30 01:14:29.900743 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 30 01:14:29.900743 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 30 01:14:29.900743 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 30 01:14:29.900743 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 30 01:14:29.900743 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 30 01:14:29.900743 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 30 01:14:29.903534 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 30 01:14:29.903534 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception Oct 30 01:14:29.903534 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 30 01:14:29.903534 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 30 01:14:29.903534 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 30 01:14:29.903534 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 30 01:14:29.903534 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 30 01:14:29.903534 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 30 01:14:29.903534 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 30 01:14:29.903534 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 30 01:14:29.903534 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 30 01:14:29.903534 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 30 01:14:29.903534 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 30 01:14:29.903534 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 30 01:14:29.903534 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 30 01:14:29.903534 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 30 01:14:29.903534 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 30 01:14:29.903534 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 30 01:14:29.904874 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 30 01:14:29.904874 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 30 01:14:29.904874 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 30 01:14:29.904874 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 30 01:14:29.904874 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 30 01:14:29.904874 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception Oct 30 01:14:29.904874 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 30 01:14:29.904874 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 30 01:14:29.904874 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 30 01:14:29.904874 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 30 01:14:29.904874 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 30 01:14:29.904874 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 30 01:14:29.904874 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 30 01:14:29.904874 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 30 01:14:29.904874 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 30 01:14:29.904874 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 30 01:14:29.904874 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 30 01:14:29.904874 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result.read() Oct 30 01:14:29.906061 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 30 01:14:29.906061 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 30 01:14:29.906061 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 30 01:14:29.906061 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 30 01:14:29.906061 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 30 01:14:29.906061 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 30 01:14:29.906061 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 30 01:14:29.906061 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 30 01:14:29.906061 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-master-1-7' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 30 01:14:29.906061 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 30 01:14:29.906061 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 30, 1, 14, 29, 789834), 'updated_at': None, 'host': 'n-h1-master-1', 'aggregate_id': 7}] Oct 30 01:14:29.906061 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 30 01:14:29.906061 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:29.906061 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:29.906061 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:29.906061 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:29.906061 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 30 01:14:29.907184 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 30 01:14:29.907184 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 30 01:14:29.907184 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 30 01:14:29.907184 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 01:14:29.907184 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 30 01:14:29.907184 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 01:14:29.907184 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise self.value Oct 30 01:14:29.907184 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 30 01:14:29.907184 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 30 01:14:29.907184 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Oct 30 01:14:29.907184 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 30 01:14:29.907184 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 30 01:14:29.907184 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 30 01:14:29.907184 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 30 01:14:29.907184 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 30 01:14:29.907184 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 30 01:14:29.907184 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 30 01:14:29.907184 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 7 already has host n-h1-master-1. Oct 30 01:14:29.907184 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:29.907184 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:29.911209 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:29.911209 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:29.911209 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:29.911209 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:29.911209 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:14:29.911209 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:14:29.911209 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:14:29.911209 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:14:29.911209 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:14:29.911209 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:14:29.911209 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 30 01:14:29.911209 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 30 01:14:29.911209 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 7 already has host n-h1-master-1. Oct 30 01:14:29.911209 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:29.911209 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:29.911209 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:29.911209 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:29.911209 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:29.911209 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:29.911209 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:14:29.911209 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:14:29.913349 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 already has host n-h1-master-1. Oct 30 01:14:29.913349 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:29.913349 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1f5fcbce-ca83-40c2-98ef-48d29bacfdc6 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Returning 409 to user: Aggregate 7 already has host n-h1-master-1. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:14:29.913349 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1f5fcbce-ca83-40c2-98ef-48d29bacfdc6 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/7/action" status: 409 len: 95 microversion: 2.1 time: 0.137011 Oct 30 01:14:29.913349 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 119/251] 10.222.0.13 () {60 vars in 1191 bytes} [Sun Oct 30 01:14:29 2022] POST /compute/v2.1/os-aggregates/7/action => generated 95 bytes in 142 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 30 01:14:29.913349 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-177929fe-0c25-4798-85e6-8665cd7d74e7 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:29.933903 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-177929fe-0c25-4798-85e6-8665cd7d74e7 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Oct 30 01:14:29.939190 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-177929fe-0c25-4798-85e6-8665cd7d74e7 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Request method failure captured: Oct 30 01:14:29.939190 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Oct 30 01:14:29.939190 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:14:29.939190 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:14:29.939190 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:14:29.939190 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:14:29.939190 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:14:29.939190 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:14:29.939190 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:14:29.939190 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:14:29.939190 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXc-3F3F1Y6Y1_TQt8mZdeRszXXo2epXE6tX464kkX8gvuUdnoiADGpvKY2gHTN6Xg5ObogY4_xFaRfyNWUtTClwJoZu7XRGZ5qJSTBZoqQT-S1vXxDMHr-RKx3xHzdCObfk2t9OurcDjfJPbTvJ7TWuTL4Uczg-DyquLqHOTI9MfDm0 Oct 30 01:14:29.939190 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:14:29.939190 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:14:29.939190 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:14:29.939190 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:14:29.939190 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:14:29.939190 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:14:29.939190 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: dcd04564aa9a44f7bff9ed4d1d322176 Oct 30 01:14:29.939190 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-AggregatesAdminTestJSON-1475706727 Oct 30 01:14:29.939190 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,admin,reader Oct 30 01:14:29.939190 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,admin,reader Oct 30 01:14:29.940762 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dcd04564aa9a44f7bff9ed4d1d322176"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_dcd04564aa9a44f7bff9ed4d1d322176"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/dcd04564aa9a44f7bff9ed4d1d322176"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dcd04564aa9a44f7bff9ed4d1d322176"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:14:29.940762 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-AggregatesAdminTestJSON-1475706727 Oct 30 01:14:29.940762 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: dcd04564aa9a44f7bff9ed4d1d322176 Oct 30 01:14:29.940762 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1475706727 Oct 30 01:14:29.940762 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-AggregatesAdminTestJSON-1475706727-project-admin Oct 30 01:14:29.940762 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:14:29.940762 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:14:29.940762 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: b96f9e0241064bb69711a89f1f0bc2ae Oct 30 01:14:29.940762 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-AggregatesAdminTestJSON-1475706727-project-admin Oct 30 01:14:29.940762 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:14:29.940762 n-d-master-1 devstack@n-api.service[121102]: exception: Aggregate 6 could not be found. Oct 30 01:14:29.940762 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '6'} Oct 30 01:14:29.940762 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:14:29.941647 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:29.941647 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 30 01:14:29.941647 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 30 01:14:29.941647 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 30 01:14:29.941647 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 30 01:14:29.941647 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 01:14:29.941647 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 30 01:14:29.941647 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 01:14:29.941647 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise self.value Oct 30 01:14:29.941647 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 30 01:14:29.941647 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 30 01:14:29.941647 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 30 01:14:29.941647 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 30 01:14:29.941647 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 01:14:29.941647 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 01:14:29.941647 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 30 01:14:29.941647 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 30 01:14:29.941647 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 30 01:14:29.941647 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 30 01:14:29.942837 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 30 01:14:29.942837 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 30 01:14:29.942837 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Oct 30 01:14:29.942837 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:29.942837 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:29.942837 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:29.942837 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:29.942837 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:29.942837 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:29.942837 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:14:29.942837 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:14:29.942837 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:14:29.942837 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:14:29.942837 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 30 01:14:29.942837 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:14:29.942837 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Oct 30 01:14:29.942837 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:29.942837 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:29.942837 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:29.942837 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:29.942837 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:29.944213 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:29.944213 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:14:29.944213 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:14:29.944213 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Oct 30 01:14:29.944213 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:29.955150 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-177929fe-0c25-4798-85e6-8665cd7d74e7 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:14:29.955562 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-177929fe-0c25-4798-85e6-8665cd7d74e7 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.059715 Oct 30 01:14:29.957404 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 120/252] 10.222.0.13 () {58 vars in 1152 bytes} [Sun Oct 30 01:14:29 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 77 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:14:29.964089 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b90361a0-48dc-4269-a53b-b5af19ed97ad tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:29.980357 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b90361a0-48dc-4269-a53b-b5af19ed97ad tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:29.981115 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b90361a0-48dc-4269-a53b-b5af19ed97ad tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:29.982231 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b90361a0-48dc-4269-a53b-b5af19ed97ad tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:30.240554 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fee99527-e90d-48d0-be67-bca8cbaaa8db tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:30.241188 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-fee99527-e90d-48d0-be67-bca8cbaaa8db tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] [instance: 7e81dcfb-dcbe-4e05-91a4-541ff2c404ae] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:30.251694 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fee99527-e90d-48d0-be67-bca8cbaaa8db tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:30.256769 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fee99527-e90d-48d0-be67-bca8cbaaa8db tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:30.256769 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fee99527-e90d-48d0-be67-bca8cbaaa8db tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:30.256769 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fee99527-e90d-48d0-be67-bca8cbaaa8db tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:30.256769 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fee99527-e90d-48d0-be67-bca8cbaaa8db tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:30.257578 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fee99527-e90d-48d0-be67-bca8cbaaa8db tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:30.341080 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b90361a0-48dc-4269-a53b-b5af19ed97ad tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 226 microversion: 2.1 time: 0.382316 Oct 30 01:14:30.342044 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 121/253] 10.222.0.13 () {60 vars in 1191 bytes} [Sun Oct 30 01:14:29 2022] POST /compute/v2.1/os-aggregates/7/action => generated 226 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:30.356405 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bdaace65-59bc-4720-b5c6-3e36dcdfc543 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-620474307", "name": "tempest-test_aggregate-1440489973"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:30.401249 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.aggregate [None req-bdaace65-59bc-4720-b5c6-3e36dcdfc543 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Generated uuid 0eef2694-c987-4fce-8371-6d9eecf5af4c for aggregate {{(pid=121102) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 30 01:14:30.512336 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bdaace65-59bc-4720-b5c6-3e36dcdfc543 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.161028 Oct 30 01:14:30.515748 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 122/254] 10.222.0.13 () {60 vars in 1165 bytes} [Sun Oct 30 01:14:30 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:30.522151 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-61f0613e-47f0-402e-acf7-6e7a2fd15b2d tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-594213320", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:30.598870 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-61f0613e-47f0-402e-acf7-6e7a2fd15b2d tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] validate_networks() for None {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:14:30.827277 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fee99527-e90d-48d0-be67-bca8cbaaa8db tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae" status: 200 len: 1644 microversion: 2.1 time: 1.215168 Oct 30 01:14:30.847533 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 133/255] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:29 2022] GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae => generated 1644 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:30.854386 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1af7a915-deb1-49a5-b298-4b8fc0ecd5bf tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:30.965678 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1af7a915-deb1-49a5-b298-4b8fc0ecd5bf tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.115110 Oct 30 01:14:30.970009 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 134/256] 10.222.0.13 () {58 vars in 1152 bytes} [Sun Oct 30 01:14:30 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 30 01:14:30.975594 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-96ca05e7-bfd0-4f01-bdd1-815b1a501f51 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:30.976474 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-96ca05e7-bfd0-4f01-bdd1-815b1a501f51 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:30.984035 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-96ca05e7-bfd0-4f01-bdd1-815b1a501f51 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:30.984875 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-96ca05e7-bfd0-4f01-bdd1-815b1a501f51 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:30.985578 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-96ca05e7-bfd0-4f01-bdd1-815b1a501f51 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:30.986493 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-96ca05e7-bfd0-4f01-bdd1-815b1a501f51 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:30.989275 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-96ca05e7-bfd0-4f01-bdd1-815b1a501f51 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:30.990109 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-96ca05e7-bfd0-4f01-bdd1-815b1a501f51 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:31.017211 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-61f0613e-47f0-402e-acf7-6e7a2fd15b2d tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:14:31.017895 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-61f0613e-47f0-402e-acf7-6e7a2fd15b2d tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:14:31.018058 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-61f0613e-47f0-402e-acf7-6e7a2fd15b2d tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:14:31.018656 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-61f0613e-47f0-402e-acf7-6e7a2fd15b2d tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:14:31.019272 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-61f0613e-47f0-402e-acf7-6e7a2fd15b2d tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:14:31.039134 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-61f0613e-47f0-402e-acf7-6e7a2fd15b2d tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:31.039908 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-61f0613e-47f0-402e-acf7-6e7a2fd15b2d tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:31.040509 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-61f0613e-47f0-402e-acf7-6e7a2fd15b2d tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:31.041471 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-61f0613e-47f0-402e-acf7-6e7a2fd15b2d tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:31.042089 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-61f0613e-47f0-402e-acf7-6e7a2fd15b2d tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:31.042676 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-61f0613e-47f0-402e-acf7-6e7a2fd15b2d tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:31.086805 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-61f0613e-47f0-402e-acf7-6e7a2fd15b2d tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Getting quotas for project 72a83b0b15194aa69fc4d82876a1e6fd. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:14:31.089005 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-96ca05e7-bfd0-4f01-bdd1-815b1a501f51 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:31.095113 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-61f0613e-47f0-402e-acf7-6e7a2fd15b2d tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Getting quotas for user 464f9e9314154e3f9c779b9ae10b2a73 and project 72a83b0b15194aa69fc4d82876a1e6fd. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:14:31.100265 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-96ca05e7-bfd0-4f01-bdd1-815b1a501f51 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:31.102693 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-96ca05e7-bfd0-4f01-bdd1-815b1a501f51 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:31.109000 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-96ca05e7-bfd0-4f01-bdd1-815b1a501f51 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] 10.222.0.13 "GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 200 len: 1437 microversion: 2.75 time: 0.141158 Oct 30 01:14:31.109877 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 135/257] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:14:30 2022] GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 1437 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:14:31.116303 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-11974eae-743d-43cd-848f-199013fa2aa5 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:31.129986 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-61f0613e-47f0-402e-acf7-6e7a2fd15b2d tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:14:31.132390 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-61f0613e-47f0-402e-acf7-6e7a2fd15b2d tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] [instance: 27cf9c57-37a3-4ccb-ba37-bc66ff5423cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:14:31.230015 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-11974eae-743d-43cd-848f-199013fa2aa5 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.118865 Oct 30 01:14:31.233483 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 136/258] 10.222.0.13 () {58 vars in 1152 bytes} [Sun Oct 30 01:14:31 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 30 01:14:31.238591 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-39cb01bc-a165-44b0-a300-17c4f2c02801 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:31.239975 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-39cb01bc-a165-44b0-a300-17c4f2c02801 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] [instance: 7571f255-6ff3-4fc7-bcaa-4837bc05dbf5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:31.255332 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-39cb01bc-a165-44b0-a300-17c4f2c02801 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:31.265782 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-39cb01bc-a165-44b0-a300-17c4f2c02801 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:31.265782 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-39cb01bc-a165-44b0-a300-17c4f2c02801 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:31.265782 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-39cb01bc-a165-44b0-a300-17c4f2c02801 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:31.265782 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-39cb01bc-a165-44b0-a300-17c4f2c02801 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:31.266671 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-39cb01bc-a165-44b0-a300-17c4f2c02801 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:31.279772 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-61f0613e-47f0-402e-acf7-6e7a2fd15b2d tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.764109 Oct 30 01:14:31.281674 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 123/259] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:14:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:14:31.293063 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-672349e7-0781-46c9-ae98-38702cb2491f req-df9ed1a8-d34f-4708-86bc-e14db92786ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7571f255-6ff3-4fc7-bcaa-4837bc05dbf5", "tag": "f6b29ab4-dbe4-4f1d-8b86-4f2415442840"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:31.319818 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-672349e7-0781-46c9-ae98-38702cb2491f req-df9ed1a8-d34f-4708-86bc-e14db92786ad service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:31.320322 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-672349e7-0781-46c9-ae98-38702cb2491f req-df9ed1a8-d34f-4708-86bc-e14db92786ad service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:31.320759 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-672349e7-0781-46c9-ae98-38702cb2491f req-df9ed1a8-d34f-4708-86bc-e14db92786ad service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:31.345363 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-672349e7-0781-46c9-ae98-38702cb2491f req-df9ed1a8-d34f-4708-86bc-e14db92786ad service nova] Creating event network-changed:f6b29ab4-dbe4-4f1d-8b86-4f2415442840 for instance 7571f255-6ff3-4fc7-bcaa-4837bc05dbf5 on n-h2-master-1 Oct 30 01:14:31.360185 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-672349e7-0781-46c9-ae98-38702cb2491f req-df9ed1a8-d34f-4708-86bc-e14db92786ad service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073977 Oct 30 01:14:31.361152 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 124/260] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:31.371704 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a2f35a4e-c9c6-4d3a-9034-4a9a407fabd0 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:31.375742 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a2f35a4e-c9c6-4d3a-9034-4a9a407fabd0 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] [instance: 7e81dcfb-dcbe-4e05-91a4-541ff2c404ae] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:31.391459 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a2f35a4e-c9c6-4d3a-9034-4a9a407fabd0 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:31.391962 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a2f35a4e-c9c6-4d3a-9034-4a9a407fabd0 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:31.392399 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a2f35a4e-c9c6-4d3a-9034-4a9a407fabd0 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:31.395457 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a2f35a4e-c9c6-4d3a-9034-4a9a407fabd0 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:31.395613 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a2f35a4e-c9c6-4d3a-9034-4a9a407fabd0 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:31.396030 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a2f35a4e-c9c6-4d3a-9034-4a9a407fabd0 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:31.442493 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-39cb01bc-a165-44b0-a300-17c4f2c02801 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056e59c7d4c2475eb66b64e0e24367be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6f42c16eeb4e97b65cebf891105008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:31.473548 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-39cb01bc-a165-44b0-a300-17c4f2c02801 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] 10.222.0.13 "GET /compute/v2.1/servers/7571f255-6ff3-4fc7-bcaa-4837bc05dbf5" status: 200 len: 1587 microversion: 2.1 time: 0.241449 Oct 30 01:14:31.479516 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 137/261] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:31 2022] GET /compute/v2.1/servers/7571f255-6ff3-4fc7-bcaa-4837bc05dbf5 => generated 1587 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:31.494094 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fa79ea85-2c30-4102-8b35-09d3938917ae tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-337742057"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:31.503182 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.aggregate [None req-fa79ea85-2c30-4102-8b35-09d3938917ae tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Generated uuid f3778533-f354-4c2e-a002-3c3aa4eab0c1 for aggregate {{(pid=121103) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 30 01:14:31.618111 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fa79ea85-2c30-4102-8b35-09d3938917ae tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.132969 Oct 30 01:14:31.625301 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 138/262] 10.222.0.13 () {60 vars in 1164 bytes} [Sun Oct 30 01:14:31 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:31.625301 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1bf6d7b5-8a11-452b-bfe6-71e9670be83e tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "deb14158-45d8-4539-889d-ff9726d046d7"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:31.638282 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1bf6d7b5-8a11-452b-bfe6-71e9670be83e tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:31.665574 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1bf6d7b5-8a11-452b-bfe6-71e9670be83e tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:31.667857 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1bf6d7b5-8a11-452b-bfe6-71e9670be83e tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:31.669526 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1bf6d7b5-8a11-452b-bfe6-71e9670be83e tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:31.671838 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1bf6d7b5-8a11-452b-bfe6-71e9670be83e tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:31.674850 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1bf6d7b5-8a11-452b-bfe6-71e9670be83e tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:31.675481 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1bf6d7b5-8a11-452b-bfe6-71e9670be83e tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:31.867035 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a2f35a4e-c9c6-4d3a-9034-4a9a407fabd0 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae" status: 200 len: 1644 microversion: 2.1 time: 0.493061 Oct 30 01:14:31.867778 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 125/263] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:31 2022] GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae => generated 1644 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:31.874131 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5c27b3e1-faa8-4ff3-902e-80673cf3ceba tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:31.913673 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-5c27b3e1-faa8-4ff3-902e-80673cf3ceba tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] HTTP exception thrown: Aggregate 8 could not be found. Oct 30 01:14:31.918516 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5c27b3e1-faa8-4ff3-902e-80673cf3ceba tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Request method failure captured: Oct 30 01:14:31.918516 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Oct 30 01:14:31.918516 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:14:31.918516 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:14:31.918516 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:14:31.918516 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:14:31.918516 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:14:31.918516 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:14:31.918516 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:14:31.918516 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:14:31.918516 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXc-3F3F1Y6Y1_TQt8mZdeRszXXo2epXE6tX464kkX8gvuUdnoiADGpvKY2gHTN6Xg5ObogY4_xFaRfyNWUtTClwJoZu7XRGZ5qJSTBZoqQT-S1vXxDMHr-RKx3xHzdCObfk2t9OurcDjfJPbTvJ7TWuTL4Uczg-DyquLqHOTI9MfDm0 Oct 30 01:14:31.918516 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:14:31.918516 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:14:31.918516 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:14:31.918516 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:14:31.918516 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:14:31.918516 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:14:31.918516 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: dcd04564aa9a44f7bff9ed4d1d322176 Oct 30 01:14:31.918516 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-AggregatesAdminTestJSON-1475706727 Oct 30 01:14:31.918516 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,admin,reader Oct 30 01:14:31.918516 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,admin,reader Oct 30 01:14:31.920723 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dcd04564aa9a44f7bff9ed4d1d322176"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_dcd04564aa9a44f7bff9ed4d1d322176"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/dcd04564aa9a44f7bff9ed4d1d322176"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dcd04564aa9a44f7bff9ed4d1d322176"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:14:31.920723 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-AggregatesAdminTestJSON-1475706727 Oct 30 01:14:31.920723 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: dcd04564aa9a44f7bff9ed4d1d322176 Oct 30 01:14:31.920723 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1475706727 Oct 30 01:14:31.920723 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-AggregatesAdminTestJSON-1475706727-project-admin Oct 30 01:14:31.920723 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:14:31.920723 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:14:31.920723 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: b96f9e0241064bb69711a89f1f0bc2ae Oct 30 01:14:31.920723 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-AggregatesAdminTestJSON-1475706727-project-admin Oct 30 01:14:31.920723 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:14:31.920723 n-d-master-1 devstack@n-api.service[121102]: exception: Aggregate 8 could not be found. Oct 30 01:14:31.920723 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '8'} Oct 30 01:14:31.920723 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:14:31.921627 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:31.921627 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 30 01:14:31.921627 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 30 01:14:31.921627 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 30 01:14:31.921627 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 30 01:14:31.921627 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 01:14:31.921627 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 01:14:31.921627 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 30 01:14:31.921627 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 30 01:14:31.921627 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 30 01:14:31.921627 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 30 01:14:31.921627 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 30 01:14:31.921627 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 30 01:14:31.921627 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 8 could not be found. Oct 30 01:14:31.921627 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:31.921627 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:31.921627 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:31.921627 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:31.921627 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:31.922899 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:31.922899 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:14:31.922899 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:14:31.922899 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:14:31.922899 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:14:31.922899 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 30 01:14:31.922899 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:14:31.922899 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 8 could not be found. Oct 30 01:14:31.922899 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:31.922899 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:31.922899 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:31.922899 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:31.922899 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:31.922899 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:31.922899 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:14:31.922899 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:14:31.922899 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 8 could not be found. Oct 30 01:14:31.922899 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:31.924980 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5c27b3e1-faa8-4ff3-902e-80673cf3ceba tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Returning 404 to user: Aggregate 8 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:14:31.927204 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-1bf6d7b5-8a11-452b-bfe6-71e9670be83e tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:14:31.929617 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-1bf6d7b5-8a11-452b-bfe6-71e9670be83e tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:14:31.930275 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5c27b3e1-faa8-4ff3-902e-80673cf3ceba tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates/8" status: 404 len: 77 microversion: 2.1 time: 0.060494 Oct 30 01:14:31.931717 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-1bf6d7b5-8a11-452b-bfe6-71e9670be83e tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:14:31.932373 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-1bf6d7b5-8a11-452b-bfe6-71e9670be83e tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:14:31.934009 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-1bf6d7b5-8a11-452b-bfe6-71e9670be83e tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:14:31.935561 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 126/264] 10.222.0.13 () {58 vars in 1149 bytes} [Sun Oct 30 01:14:31 2022] GET /compute/v2.1/os-aggregates/8 => generated 77 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:14:31.944609 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-370427b9-af06-4fdc-95ed-8bbb337a32e1 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:31.957697 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-370427b9-af06-4fdc-95ed-8bbb337a32e1 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] [instance: 27cf9c57-37a3-4ccb-ba37-bc66ff5423cd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:32.084990 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-370427b9-af06-4fdc-95ed-8bbb337a32e1 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464f9e9314154e3f9c779b9ae10b2a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a83b0b15194aa69fc4d82876a1e6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:32.093551 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-370427b9-af06-4fdc-95ed-8bbb337a32e1 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] 10.222.0.13 "GET /compute/v2.1/servers/27cf9c57-37a3-4ccb-ba37-bc66ff5423cd" status: 200 len: 1218 microversion: 2.1 time: 0.156066 Oct 30 01:14:32.096375 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 127/265] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:31 2022] GET /compute/v2.1/servers/27cf9c57-37a3-4ccb-ba37-bc66ff5423cd => generated 1218 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:32.167823 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1bf6d7b5-8a11-452b-bfe6-71e9670be83e tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:32.181677 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1bf6d7b5-8a11-452b-bfe6-71e9670be83e tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:32.182265 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1bf6d7b5-8a11-452b-bfe6-71e9670be83e tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:32.183112 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1bf6d7b5-8a11-452b-bfe6-71e9670be83e tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:32.185950 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1bf6d7b5-8a11-452b-bfe6-71e9670be83e tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:32.185950 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1bf6d7b5-8a11-452b-bfe6-71e9670be83e tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:32.185950 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1bf6d7b5-8a11-452b-bfe6-71e9670be83e tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:32.417659 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1bf6d7b5-8a11-452b-bfe6-71e9670be83e tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:32.429607 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1bf6d7b5-8a11-452b-bfe6-71e9670be83e tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:32.433553 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1bf6d7b5-8a11-452b-bfe6-71e9670be83e tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:32.450956 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1bf6d7b5-8a11-452b-bfe6-71e9670be83e tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] 10.222.0.13 "POST /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c/action" status: 202 len: 1494 microversion: 2.75 time: 0.830711 Oct 30 01:14:32.452116 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 139/266] 10.222.0.13 () {62 vars in 1319 bytes} [Sun Oct 30 01:14:31 2022] POST /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c/action => generated 1494 bytes in 832 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 30 01:14:32.456754 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d043e91c-9b08-419e-9efc-5da4a93a3c4f tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:32.478000 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d043e91c-9b08-419e-9efc-5da4a93a3c4f tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:32.481294 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d043e91c-9b08-419e-9efc-5da4a93a3c4f tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:32.484274 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d043e91c-9b08-419e-9efc-5da4a93a3c4f tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:32.486406 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d043e91c-9b08-419e-9efc-5da4a93a3c4f tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:32.490518 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d043e91c-9b08-419e-9efc-5da4a93a3c4f tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:32.492544 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d043e91c-9b08-419e-9efc-5da4a93a3c4f tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:32.576670 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d043e91c-9b08-419e-9efc-5da4a93a3c4f tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.123246 Oct 30 01:14:32.584541 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 140/267] 10.222.0.13 () {58 vars in 1176 bytes} [Sun Oct 30 01:14:32 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:32.619697 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-955dfefb-c5e3-4dca-af28-5ba3bd863db5 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:32.627785 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-642fea57-8232-41de-ae88-f3bd7d09fcee tempest-AggregatesAdminNegativeTestJSON-1541830664 tempest-AggregatesAdminNegativeTestJSON-1541830664-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:32.631336 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-642fea57-8232-41de-ae88-f3bd7d09fcee tempest-AggregatesAdminNegativeTestJSON-1541830664 tempest-AggregatesAdminNegativeTestJSON-1541830664-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '3d46ad002b4d4e7b82c455ee8d2cd2ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7125ddd978584c4b8f1b196e6cc62e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:32.634759 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-642fea57-8232-41de-ae88-f3bd7d09fcee tempest-AggregatesAdminNegativeTestJSON-1541830664 tempest-AggregatesAdminNegativeTestJSON-1541830664-project] Request method failure captured: Oct 30 01:14:32.634759 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/os-aggregates/9/action HTTP/1.1 Oct 30 01:14:32.634759 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:14:32.634759 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:14:32.634759 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:14:32.634759 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 39 Oct 30 01:14:32.634759 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:14:32.634759 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:14:32.634759 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:14:32.634759 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:14:32.634759 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXc-0QrQiztamIwHFFvUqoa069ENcmlzmusmY9jPTcVZOQVrT1319Dw_UMMM4lDV_kMpAjIoQKPhdI31i16Tvjy-FaUnZDsALhBcTRcywK7mVXXE7nFPMU_muszKdk029GOI_MV2k3x0zTWGS8XhrpT3Cy-9OHEPtqCrneDxreS22tZU Oct 30 01:14:32.634759 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:14:32.634759 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:14:32.634759 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:14:32.634759 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:14:32.634759 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:14:32.634759 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:14:32.634759 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 7125ddd978584c4b8f1b196e6cc62e94 Oct 30 01:14:32.634759 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1541830664 Oct 30 01:14:32.634759 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:14:32.634759 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:14:32.636211 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7125ddd978584c4b8f1b196e6cc62e94"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7125ddd978584c4b8f1b196e6cc62e94"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7125ddd978584c4b8f1b196e6cc62e94"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7125ddd978584c4b8f1b196e6cc62e94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:14:32.636211 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1541830664 Oct 30 01:14:32.636211 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 7125ddd978584c4b8f1b196e6cc62e94 Oct 30 01:14:32.636211 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1541830664 Oct 30 01:14:32.636211 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-AggregatesAdminNegativeTestJSON-1541830664-project Oct 30 01:14:32.636211 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:14:32.636211 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:14:32.636211 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 3d46ad002b4d4e7b82c455ee8d2cd2ab Oct 30 01:14:32.636211 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1541830664-project Oct 30 01:14:32.636211 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:14:32.636211 n-d-master-1 devstack@n-api.service[121102]: {"add_host": {"host": "n-h1-master-1"}} Oct 30 01:14:32.636211 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:14:32.636211 n-d-master-1 devstack@n-api.service[121102]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 30 01:14:32.637117 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '9', 'body': {'add_host': {'host': 'n-h1-master-1'}}} Oct 30 01:14:32.637117 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:14:32.637117 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:32.637117 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:32.637117 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:32.637117 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:14:32.637117 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:14:32.637117 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:14:32.637117 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:14:32.637117 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:14:32.637117 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:14:32.637117 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 30 01:14:32.637117 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 30 01:14:32.637117 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 30 01:14:32.637117 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 30 01:14:32.637117 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 30 01:14:32.637117 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 30 01:14:32.637117 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 01:14:32.637117 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 30 01:14:32.639062 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 01:14:32.639062 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise self.value Oct 30 01:14:32.639062 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 30 01:14:32.639062 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 30 01:14:32.639062 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 30 01:14:32.639062 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 30 01:14:32.639062 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 30 01:14:32.639062 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 30 01:14:32.639062 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 30 01:14:32.639062 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:32.639062 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:32.639062 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:32.639062 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:32.639062 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:32.639062 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:32.639062 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 30 01:14:32.639062 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 30 01:14:32.639062 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 30 01:14:32.639062 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:32.640413 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-642fea57-8232-41de-ae88-f3bd7d09fcee tempest-AggregatesAdminNegativeTestJSON-1541830664 tempest-AggregatesAdminNegativeTestJSON-1541830664-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:14:32.640413 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-642fea57-8232-41de-ae88-f3bd7d09fcee tempest-AggregatesAdminNegativeTestJSON-1541830664 tempest-AggregatesAdminNegativeTestJSON-1541830664-project] 10.222.0.13 "POST /compute/v2.1/os-aggregates/9/action" status: 403 len: 118 microversion: 2.1 time: 0.538129 Oct 30 01:14:32.641455 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 128/268] 10.222.0.13 () {60 vars in 1191 bytes} [Sun Oct 30 01:14:32 2022] POST /compute/v2.1/os-aggregates/9/action => generated 118 bytes in 545 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:14:32.660094 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-955dfefb-c5e3-4dca-af28-5ba3bd863db5 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] HTTP exception thrown: Aggregate 8 could not be found. Oct 30 01:14:32.660383 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-449e1f52-210f-41e9-8143-3ce379e10146 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:32.660383 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-449e1f52-210f-41e9-8143-3ce379e10146 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:32.665930 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-955dfefb-c5e3-4dca-af28-5ba3bd863db5 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Request method failure captured: Oct 30 01:14:32.665930 n-d-master-1 devstack@n-api.service[121103]: request: DELETE /compute/v2.1/os-aggregates/8 HTTP/1.1 Oct 30 01:14:32.665930 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:14:32.665930 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:14:32.665930 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:14:32.665930 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:14:32.665930 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:14:32.665930 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:14:32.665930 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:14:32.665930 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:14:32.665930 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXc-3F3F1Y6Y1_TQt8mZdeRszXXo2epXE6tX464kkX8gvuUdnoiADGpvKY2gHTN6Xg5ObogY4_xFaRfyNWUtTClwJoZu7XRGZ5qJSTBZoqQT-S1vXxDMHr-RKx3xHzdCObfk2t9OurcDjfJPbTvJ7TWuTL4Uczg-DyquLqHOTI9MfDm0 Oct 30 01:14:32.665930 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:14:32.665930 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:14:32.665930 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:14:32.665930 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:14:32.665930 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:14:32.665930 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:14:32.665930 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: dcd04564aa9a44f7bff9ed4d1d322176 Oct 30 01:14:32.665930 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-AggregatesAdminTestJSON-1475706727 Oct 30 01:14:32.665930 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,admin,reader Oct 30 01:14:32.665930 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,admin,reader Oct 30 01:14:32.667519 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dcd04564aa9a44f7bff9ed4d1d322176"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_dcd04564aa9a44f7bff9ed4d1d322176"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/dcd04564aa9a44f7bff9ed4d1d322176"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dcd04564aa9a44f7bff9ed4d1d322176"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:14:32.667519 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-AggregatesAdminTestJSON-1475706727 Oct 30 01:14:32.667519 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: dcd04564aa9a44f7bff9ed4d1d322176 Oct 30 01:14:32.667519 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1475706727 Oct 30 01:14:32.667519 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-AggregatesAdminTestJSON-1475706727-project-admin Oct 30 01:14:32.667519 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:14:32.667519 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:14:32.667519 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: b96f9e0241064bb69711a89f1f0bc2ae Oct 30 01:14:32.667519 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-AggregatesAdminTestJSON-1475706727-project-admin Oct 30 01:14:32.667519 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:14:32.667519 n-d-master-1 devstack@n-api.service[121103]: exception: Aggregate 8 could not be found. Oct 30 01:14:32.667519 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '8'} Oct 30 01:14:32.667519 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:14:32.668451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:32.668451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 30 01:14:32.668451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 30 01:14:32.668451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 30 01:14:32.668451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 30 01:14:32.668451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 01:14:32.668451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 30 01:14:32.668451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 01:14:32.668451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise self.value Oct 30 01:14:32.668451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 30 01:14:32.668451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 30 01:14:32.668451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 30 01:14:32.668451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 30 01:14:32.668451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 01:14:32.668451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 01:14:32.668451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 30 01:14:32.668451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 30 01:14:32.668451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 30 01:14:32.668451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 30 01:14:32.669782 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 30 01:14:32.669782 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 30 01:14:32.669782 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 8 could not be found. Oct 30 01:14:32.669782 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:32.669782 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:32.669782 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:32.669782 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:32.669782 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:32.669782 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:32.669782 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:14:32.669782 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:14:32.669782 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:14:32.669782 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:14:32.669782 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 30 01:14:32.669782 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:14:32.669782 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 8 could not be found. Oct 30 01:14:32.669782 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:32.669782 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:32.669782 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:32.669782 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:32.669782 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:32.671888 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:32.671888 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:14:32.671888 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:14:32.671888 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 8 could not be found. Oct 30 01:14:32.671888 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:32.671888 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-955dfefb-c5e3-4dca-af28-5ba3bd863db5 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Returning 404 to user: Aggregate 8 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:14:32.671888 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-955dfefb-c5e3-4dca-af28-5ba3bd863db5 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/8" status: 404 len: 77 microversion: 2.1 time: 0.067775 Oct 30 01:14:32.671888 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 141/269] 10.222.0.13 () {58 vars in 1152 bytes} [Sun Oct 30 01:14:32 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 77 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:14:32.673280 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3cb45501-5994-46e8-95ae-3884827db736 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:32.676974 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3cb45501-5994-46e8-95ae-3884827db736 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] [instance: 7e81dcfb-dcbe-4e05-91a4-541ff2c404ae] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:32.678100 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-449e1f52-210f-41e9-8143-3ce379e10146 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:32.678607 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-449e1f52-210f-41e9-8143-3ce379e10146 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:32.679041 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-449e1f52-210f-41e9-8143-3ce379e10146 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:32.679753 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-449e1f52-210f-41e9-8143-3ce379e10146 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:32.686369 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-449e1f52-210f-41e9-8143-3ce379e10146 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:32.687053 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-449e1f52-210f-41e9-8143-3ce379e10146 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:32.698437 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3cb45501-5994-46e8-95ae-3884827db736 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:32.698949 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3cb45501-5994-46e8-95ae-3884827db736 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:32.699385 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3cb45501-5994-46e8-95ae-3884827db736 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:32.700103 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3cb45501-5994-46e8-95ae-3884827db736 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:32.700559 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3cb45501-5994-46e8-95ae-3884827db736 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:32.700985 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3cb45501-5994-46e8-95ae-3884827db736 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:32.735421 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-3cb45501-5994-46e8-95ae-3884827db736 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lazy-loading 'flavor' on Instance uuid 7e81dcfb-dcbe-4e05-91a4-541ff2c404ae {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:14:32.751624 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3cb45501-5994-46e8-95ae-3884827db736 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] [instance: 7e81dcfb-dcbe-4e05-91a4-541ff2c404ae] Going to try to live migrate instance to n-h2-master-1 {{(pid=121103) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 30 01:14:32.798263 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:DELETE=4,nova_api:SELECT=85,nova_api:INSERT=11 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:32.841941 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-449e1f52-210f-41e9-8143-3ce379e10146 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:32.852088 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-449e1f52-210f-41e9-8143-3ce379e10146 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:32.853611 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-449e1f52-210f-41e9-8143-3ce379e10146 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:32.859364 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-449e1f52-210f-41e9-8143-3ce379e10146 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] 10.222.0.13 "GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 200 len: 1446 microversion: 2.75 time: 0.216509 Oct 30 01:14:32.859954 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 129/270] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:14:32 2022] GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 1446 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:14:32.880355 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f30705f3-ba29-4350-973b-17b661c76528 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:32.997623 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f30705f3-ba29-4350-973b-17b661c76528 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.136346 Oct 30 01:14:33.005735 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 130/271] 10.222.0.13 () {58 vars in 1152 bytes} [Sun Oct 30 01:14:32 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 30 01:14:33.017672 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d39384b7-014e-49ae-bbf5-c883b8cbae28 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-449445217"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:33.030542 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.aggregate [None req-d39384b7-014e-49ae-bbf5-c883b8cbae28 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Generated uuid 776e590d-c542-46d1-810b-a654fff3670b for aggregate {{(pid=121102) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 30 01:14:33.197088 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d39384b7-014e-49ae-bbf5-c883b8cbae28 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.186471 Oct 30 01:14:33.199808 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 131/272] 10.222.0.13 () {60 vars in 1164 bytes} [Sun Oct 30 01:14:33 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:33.208683 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5219c83d-5018-445b-b6a6-fc55dd83e50a tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1340859726"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:33.214562 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.aggregate [None req-5219c83d-5018-445b-b6a6-fc55dd83e50a tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Generated uuid d8583c37-cc94-4e4e-bd16-c07b015ffe9c for aggregate {{(pid=121102) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 30 01:14:33.316798 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5219c83d-5018-445b-b6a6-fc55dd83e50a tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.113731 Oct 30 01:14:33.318075 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 132/273] 10.222.0.13 () {60 vars in 1164 bytes} [Sun Oct 30 01:14:33 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:33.332314 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-80289bca-f1c6-457e-b5d5-ce9a482aa9d5 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:33.341012 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-80289bca-f1c6-457e-b5d5-ce9a482aa9d5 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] [instance: 27cf9c57-37a3-4ccb-ba37-bc66ff5423cd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:33.355133 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-80289bca-f1c6-457e-b5d5-ce9a482aa9d5 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:33.359273 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-80289bca-f1c6-457e-b5d5-ce9a482aa9d5 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:33.359273 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-80289bca-f1c6-457e-b5d5-ce9a482aa9d5 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:33.359273 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-80289bca-f1c6-457e-b5d5-ce9a482aa9d5 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:33.359273 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-80289bca-f1c6-457e-b5d5-ce9a482aa9d5 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:33.359622 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-80289bca-f1c6-457e-b5d5-ce9a482aa9d5 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:33.455273 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-80289bca-f1c6-457e-b5d5-ce9a482aa9d5 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464f9e9314154e3f9c779b9ae10b2a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a83b0b15194aa69fc4d82876a1e6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:33.469642 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-80289bca-f1c6-457e-b5d5-ce9a482aa9d5 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] 10.222.0.13 "GET /compute/v2.1/servers/27cf9c57-37a3-4ccb-ba37-bc66ff5423cd" status: 200 len: 1222 microversion: 2.1 time: 0.149548 Oct 30 01:14:33.486932 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 133/274] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:33 2022] GET /compute/v2.1/servers/27cf9c57-37a3-4ccb-ba37-bc66ff5423cd => generated 1222 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:33.508574 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-958389be-3d27-46f3-a4e5-adadb8842268 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:33.545463 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-958389be-3d27-46f3-a4e5-adadb8842268 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates/10" status: 200 len: 227 microversion: 2.1 time: 0.056892 Oct 30 01:14:33.546351 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 134/275] 10.222.0.13 () {58 vars in 1152 bytes} [Sun Oct 30 01:14:33 2022] GET /compute/v2.1/os-aggregates/10 => generated 227 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:33.552289 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c83745aa-8df9-42de-8e63-bbac81597baf tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-429292913"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:33.567429 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c83745aa-8df9-42de-8e63-bbac81597baf tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:33.568597 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c83745aa-8df9-42de-8e63-bbac81597baf tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:33.569309 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c83745aa-8df9-42de-8e63-bbac81597baf tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:33.580013 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c83745aa-8df9-42de-8e63-bbac81597baf tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:33.580941 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c83745aa-8df9-42de-8e63-bbac81597baf tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:33.582283 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c83745aa-8df9-42de-8e63-bbac81597baf tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:33.591657 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-c83745aa-8df9-42de-8e63-bbac81597baf tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-429292913 could not be found. Oct 30 01:14:33.594258 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c83745aa-8df9-42de-8e63-bbac81597baf tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Request method failure captured: Oct 30 01:14:33.594258 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Oct 30 01:14:33.594258 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:14:33.594258 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:14:33.594258 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:14:33.594258 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 57 Oct 30 01:14:33.594258 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:14:33.594258 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:14:33.594258 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:14:33.594258 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:14:33.594258 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXc-3gN2AwBYwbdvZGmSvdpdZvZwjFntCD4wstkgGcLi3wTCXZysV4KoMBsD0aD4hAu5hNeKEvgUUO20F4SRa4sY9OuAdO3gP-QlWXV6RdLo-ocB73CaT33LhTEJFJa5Trr2_XU0o08k5NzgdUTdUTgTgWLEA7ifipfA_JZVsSsUejVI Oct 30 01:14:33.594258 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:14:33.594258 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:14:33.594258 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:14:33.594258 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:14:33.594258 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:14:33.594258 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:14:33.594258 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: c63e7b7a4aef41adaa41001c0129434c Oct 30 01:14:33.594258 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1075675897 Oct 30 01:14:33.594258 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,admin,reader Oct 30 01:14:33.594258 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,admin,reader Oct 30 01:14:33.595518 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c63e7b7a4aef41adaa41001c0129434c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c63e7b7a4aef41adaa41001c0129434c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c63e7b7a4aef41adaa41001c0129434c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c63e7b7a4aef41adaa41001c0129434c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:14:33.595518 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1075675897 Oct 30 01:14:33.595518 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: c63e7b7a4aef41adaa41001c0129434c Oct 30 01:14:33.595518 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1075675897 Oct 30 01:14:33.595518 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin Oct 30 01:14:33.595518 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:14:33.595518 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:14:33.595518 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: aa3da3ec33c7409a8c0463bf64d50400 Oct 30 01:14:33.595518 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin Oct 30 01:14:33.595518 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:14:33.595518 n-d-master-1 devstack@n-api.service[121102]: {"add_host": {"host": "tempest-nonexist_host-429292913"}} Oct 30 01:14:33.595518 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:14:33.596225 n-d-master-1 devstack@n-api.service[121102]: exception: Compute host tempest-nonexist_host-429292913 could not be found. Oct 30 01:14:33.596225 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '11', 'body': {'add_host': {'host': 'tempest-nonexist_host-429292913'}}} Oct 30 01:14:33.596225 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:14:33.596225 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:33.596225 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 30 01:14:33.596225 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 30 01:14:33.596225 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 01:14:33.596225 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 01:14:33.596225 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 30 01:14:33.596225 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 30 01:14:33.596225 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 30 01:14:33.596225 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 30 01:14:33.596225 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 30 01:14:33.596225 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 30 01:14:33.596225 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-429292913' is not mapped to any cell Oct 30 01:14:33.596225 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:33.596225 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:33.596225 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:33.596225 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:33.596225 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 30 01:14:33.597391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 30 01:14:33.597391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 30 01:14:33.597391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 30 01:14:33.597391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 30 01:14:33.597391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:33.597391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:33.597391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:33.597391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:33.597391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 30 01:14:33.597391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 30 01:14:33.597391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 30 01:14:33.597391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 30 01:14:33.597391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 01:14:33.597391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 30 01:14:33.597391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 01:14:33.597391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise self.value Oct 30 01:14:33.597391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 30 01:14:33.597391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 30 01:14:33.597391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Oct 30 01:14:33.597391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 30 01:14:33.598605 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 30 01:14:33.598605 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 30 01:14:33.598605 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-429292913 could not be found. Oct 30 01:14:33.598605 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:33.598605 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:33.598605 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:33.598605 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:33.598605 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:33.598605 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:33.598605 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:14:33.598605 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:14:33.598605 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:14:33.598605 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:14:33.598605 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:14:33.598605 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:14:33.598605 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 30 01:14:33.598605 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:14:33.598605 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-429292913 could not be found. Oct 30 01:14:33.598605 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:33.598605 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:33.598605 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:33.599779 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:33.599779 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:33.599779 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:33.599779 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:14:33.599779 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:14:33.599779 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-429292913 could not be found. Oct 30 01:14:33.599779 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:33.602215 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c83745aa-8df9-42de-8e63-bbac81597baf tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-429292913 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:14:33.603375 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c83745aa-8df9-42de-8e63-bbac81597baf tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/11/action" status: 404 len: 110 microversion: 2.1 time: 0.055672 Oct 30 01:14:33.604309 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 135/276] 10.222.0.13 () {60 vars in 1194 bytes} [Sun Oct 30 01:14:33 2022] POST /compute/v2.1/os-aggregates/11/action => generated 110 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:14:33.616297 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f4b3211a-615d-4d69-8652-256242bff657 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:33.702229 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f4b3211a-615d-4d69-8652-256242bff657 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 265 microversion: 2.1 time: 0.093181 Oct 30 01:14:33.706320 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 136/277] 10.222.0.13 () {60 vars in 1194 bytes} [Sun Oct 30 01:14:33 2022] POST /compute/v2.1/os-aggregates/10/action => generated 265 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:33.713839 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4aa2e464-f54f-4418-8b50-961c1b8befdc tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:33.863656 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4aa2e464-f54f-4418-8b50-961c1b8befdc tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.154581 Oct 30 01:14:33.863656 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 137/278] 10.222.0.13 () {58 vars in 1155 bytes} [Sun Oct 30 01:14:33 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 30 01:14:33.867735 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7f008d7d-1e01-4038-90e5-3311faca6c9f tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:33.879047 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7f008d7d-1e01-4038-90e5-3311faca6c9f tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates/10" status: 200 len: 241 microversion: 2.1 time: 0.014875 Oct 30 01:14:33.879047 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 138/279] 10.222.0.13 () {58 vars in 1152 bytes} [Sun Oct 30 01:14:33 2022] GET /compute/v2.1/os-aggregates/10 => generated 241 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:34.055713 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f3ac7127-577e-43d8-8425-04cc7f1dc4f9 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Action: 'update', calling method: .version_select at 0x7f44cca04820>, body: {"quota_set": {"ram": "5120"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:34.144405 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3ac7127-577e-43d8-8425-04cc7f1dc4f9 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:34.145187 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3ac7127-577e-43d8-8425-04cc7f1dc4f9 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:34.146311 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3ac7127-577e-43d8-8425-04cc7f1dc4f9 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:34.148581 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3ac7127-577e-43d8-8425-04cc7f1dc4f9 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:34.149258 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3ac7127-577e-43d8-8425-04cc7f1dc4f9 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:34.149885 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3ac7127-577e-43d8-8425-04cc7f1dc4f9 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:34.316438 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f3ac7127-577e-43d8-8425-04cc7f1dc4f9 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/418a796af9844d45b2e4fe65ad1f9f61" status: 200 len: 148 microversion: 2.57 time: 0.438129 Oct 30 01:14:34.318284 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 139/280] 10.222.0.13 () {62 vars in 1303 bytes} [Sun Oct 30 01:14:33 2022] PUT /compute/v2.1/os-quota-sets/418a796af9844d45b2e4fe65ad1f9f61 => generated 148 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:14:34.328663 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7b0572d7-518b-4ce8-95cb-7d5371febeba tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:34.337484 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7b0572d7-518b-4ce8-95cb-7d5371febeba tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Request method failure captured: Oct 30 01:14:34.337484 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 30 01:14:34.337484 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:14:34.337484 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:14:34.337484 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:14:34.337484 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 283 Oct 30 01:14:34.337484 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:14:34.337484 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:14:34.337484 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:14:34.337484 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:14:34.337484 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXc-3gN2AwBYwbdvZGmSvdpdZvZwjFntCD4wstkgGcLi3wTCXZysV4KoMBsD0aD4hAu5hNeKEvgUUO20F4SRa4sY9OuAdO3gP-QlWXV6RdLo-ocB73CaT33LhTEJFJa5Trr2_XU0o08k5NzgdUTdUTgTgWLEA7ifipfA_JZVsSsUejVI Oct 30 01:14:34.337484 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:14:34.337484 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:14:34.337484 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:14:34.337484 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:14:34.337484 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:14:34.337484 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:14:34.337484 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: c63e7b7a4aef41adaa41001c0129434c Oct 30 01:14:34.337484 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1075675897 Oct 30 01:14:34.337484 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,admin,reader Oct 30 01:14:34.337484 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,admin,reader Oct 30 01:14:34.344768 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c63e7b7a4aef41adaa41001c0129434c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c63e7b7a4aef41adaa41001c0129434c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c63e7b7a4aef41adaa41001c0129434c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c63e7b7a4aef41adaa41001c0129434c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:14:34.344768 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1075675897 Oct 30 01:14:34.344768 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: c63e7b7a4aef41adaa41001c0129434c Oct 30 01:14:34.344768 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1075675897 Oct 30 01:14:34.344768 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin Oct 30 01:14:34.344768 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:14:34.344768 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:14:34.344768 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: aa3da3ec33c7409a8c0463bf64d50400 Oct 30 01:14:34.344768 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin Oct 30 01:14:34.344768 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:14:34.345328 n-d-master-1 devstack@n-api.service[121102]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 30 01:14:34.345328 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:14:34.345328 n-d-master-1 devstack@n-api.service[121102]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 30 01:14:34.345328 n-d-master-1 devstack@n-api.service[121102]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 30 01:14:34.345328 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:14:34.345328 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:34.345328 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 30 01:14:34.345328 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 30 01:14:34.345328 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 30 01:14:34.345328 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise error Oct 30 01:14:34.346255 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 30 01:14:34.346255 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:34.346255 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 30 01:14:34.346255 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 30 01:14:34.346255 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:34.346255 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 30 01:14:34.346255 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 30 01:14:34.346255 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:34.346255 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:34.346255 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:34.346255 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:34.346255 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:34.346255 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:34.346255 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:14:34.346255 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:14:34.346255 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:14:34.346255 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:14:34.347744 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:14:34.347744 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:14:34.347744 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 30 01:14:34.347744 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 30 01:14:34.347744 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 30 01:14:34.347744 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 30 01:14:34.347744 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 30 01:14:34.347744 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 30 01:14:34.347744 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 30 01:14:34.347744 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:34.347744 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:34.347744 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:34.347744 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:34.347744 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:34.347744 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:34.349136 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 30 01:14:34.349136 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 30 01:14:34.349136 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 30 01:14:34.349136 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:34.349136 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7b0572d7-518b-4ce8-95cb-7d5371febeba tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:14:34.349514 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7b0572d7-518b-4ce8-95cb-7d5371febeba tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.019567 Oct 30 01:14:34.349514 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 140/281] 10.222.0.13 () {60 vars in 1165 bytes} [Sun Oct 30 01:14:34 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:14:34.349514 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0064ba2d-a3c4-4a98-b26e-25dca55da324 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:34.350118 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0064ba2d-a3c4-4a98-b26e-25dca55da324 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:34.361696 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0064ba2d-a3c4-4a98-b26e-25dca55da324 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:34.362245 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0064ba2d-a3c4-4a98-b26e-25dca55da324 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:34.363287 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0064ba2d-a3c4-4a98-b26e-25dca55da324 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:34.363998 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0064ba2d-a3c4-4a98-b26e-25dca55da324 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:34.364690 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0064ba2d-a3c4-4a98-b26e-25dca55da324 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:34.365149 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0064ba2d-a3c4-4a98-b26e-25dca55da324 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:34.393382 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:34.463518 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0064ba2d-a3c4-4a98-b26e-25dca55da324 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:34.472905 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0064ba2d-a3c4-4a98-b26e-25dca55da324 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:34.475678 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0064ba2d-a3c4-4a98-b26e-25dca55da324 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:34.480561 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0064ba2d-a3c4-4a98-b26e-25dca55da324 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] 10.222.0.13 "GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 200 len: 1446 microversion: 2.75 time: 0.138960 Oct 30 01:14:34.481149 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 141/282] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:14:34 2022] GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 1446 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:14:34.492991 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9dbd8d17-3144-47bd-83fb-020c8efb9de0 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:34.823206 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9dbd8d17-3144-47bd-83fb-020c8efb9de0 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.335939 Oct 30 01:14:34.828965 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 142/283] 10.222.0.13 () {58 vars in 1155 bytes} [Sun Oct 30 01:14:34 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 30 01:14:34.843409 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f5e556dc-51b8-4392-9589-cdb631851351 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Calling method '.version_select at 0x7f44ccaaf550>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:34.953220 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5e556dc-51b8-4392-9589-cdb631851351 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:34.953220 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5e556dc-51b8-4392-9589-cdb631851351 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:34.953220 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5e556dc-51b8-4392-9589-cdb631851351 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:34.956166 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5e556dc-51b8-4392-9589-cdb631851351 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:34.957274 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5e556dc-51b8-4392-9589-cdb631851351 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:34.957743 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5e556dc-51b8-4392-9589-cdb631851351 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:34.992059 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f5e556dc-51b8-4392-9589-cdb631851351 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/418a796af9844d45b2e4fe65ad1f9f61/detail" status: 200 len: 463 microversion: 2.57 time: 0.167051 Oct 30 01:14:35.001938 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 143/284] 10.222.0.13 () {60 vars in 1304 bytes} [Sun Oct 30 01:14:34 2022] GET /compute/v2.1/os-quota-sets/418a796af9844d45b2e4fe65ad1f9f61/detail => generated 463 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:14:35.001938 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-60fbabc2-7491-457f-88d9-4a397a7e779a tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:35.002375 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-60fbabc2-7491-457f-88d9-4a397a7e779a tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Request method failure captured: Oct 30 01:14:35.002375 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 30 01:14:35.002375 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:14:35.002375 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:14:35.002375 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:14:35.002375 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 27 Oct 30 01:14:35.002375 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:14:35.002375 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:14:35.002375 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:14:35.002375 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:14:35.002375 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXc-3gN2AwBYwbdvZGmSvdpdZvZwjFntCD4wstkgGcLi3wTCXZysV4KoMBsD0aD4hAu5hNeKEvgUUO20F4SRa4sY9OuAdO3gP-QlWXV6RdLo-ocB73CaT33LhTEJFJa5Trr2_XU0o08k5NzgdUTdUTgTgWLEA7ifipfA_JZVsSsUejVI Oct 30 01:14:35.002375 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:14:35.002375 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:14:35.002375 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:14:35.002375 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:14:35.002375 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:14:35.002375 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:14:35.002375 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: c63e7b7a4aef41adaa41001c0129434c Oct 30 01:14:35.002375 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1075675897 Oct 30 01:14:35.002375 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,admin,reader Oct 30 01:14:35.002375 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,admin,reader Oct 30 01:14:35.004368 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c63e7b7a4aef41adaa41001c0129434c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c63e7b7a4aef41adaa41001c0129434c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c63e7b7a4aef41adaa41001c0129434c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c63e7b7a4aef41adaa41001c0129434c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:14:35.004368 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1075675897 Oct 30 01:14:35.004368 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: c63e7b7a4aef41adaa41001c0129434c Oct 30 01:14:35.004368 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1075675897 Oct 30 01:14:35.004368 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin Oct 30 01:14:35.004368 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:14:35.004368 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:14:35.004368 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: aa3da3ec33c7409a8c0463bf64d50400 Oct 30 01:14:35.004368 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin Oct 30 01:14:35.004368 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:14:35.004368 n-d-master-1 devstack@n-api.service[121102]: {"aggregate": {"name": ""}} Oct 30 01:14:35.004368 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:14:35.004368 n-d-master-1 devstack@n-api.service[121102]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 30 01:14:35.005400 n-d-master-1 devstack@n-api.service[121102]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 30 01:14:35.005400 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:14:35.005400 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:35.005400 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 30 01:14:35.005400 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 30 01:14:35.005400 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 30 01:14:35.005400 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise error Oct 30 01:14:35.005400 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 30 01:14:35.005400 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:35.005400 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 30 01:14:35.005400 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 30 01:14:35.005400 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:35.005400 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 30 01:14:35.005400 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi '' Oct 30 01:14:35.005400 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:35.005400 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:35.005400 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:35.005400 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:35.005400 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:35.005400 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:35.005400 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:14:35.005400 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:14:35.005400 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:14:35.007379 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:14:35.007379 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:14:35.007379 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:14:35.007379 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 30 01:14:35.007379 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 30 01:14:35.007379 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 30 01:14:35.007379 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 30 01:14:35.007379 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 30 01:14:35.007379 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 30 01:14:35.007379 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 30 01:14:35.007379 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:35.007379 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:35.007379 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:35.007379 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:35.007379 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:35.007379 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:35.007379 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 30 01:14:35.007379 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 30 01:14:35.007379 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 30 01:14:35.007379 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:35.009037 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-60fbabc2-7491-457f-88d9-4a397a7e779a tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:14:35.010210 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-60fbabc2-7491-457f-88d9-4a397a7e779a tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.015726 Oct 30 01:14:35.015472 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 144/285] 10.222.0.13 () {60 vars in 1164 bytes} [Sun Oct 30 01:14:34 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:14:35.022362 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6e299af6-bf5c-46f9-bf5a-0093290d7922 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:35.023861 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6e299af6-bf5c-46f9-bf5a-0093290d7922 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] [instance: 27cf9c57-37a3-4ccb-ba37-bc66ff5423cd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:35.043807 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e299af6-bf5c-46f9-bf5a-0093290d7922 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:35.044598 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e299af6-bf5c-46f9-bf5a-0093290d7922 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:35.045275 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e299af6-bf5c-46f9-bf5a-0093290d7922 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:35.046380 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e299af6-bf5c-46f9-bf5a-0093290d7922 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:35.047065 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e299af6-bf5c-46f9-bf5a-0093290d7922 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:35.048361 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e299af6-bf5c-46f9-bf5a-0093290d7922 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:35.067292 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:35.160852 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6e299af6-bf5c-46f9-bf5a-0093290d7922 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464f9e9314154e3f9c779b9ae10b2a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a83b0b15194aa69fc4d82876a1e6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:35.179470 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6e299af6-bf5c-46f9-bf5a-0093290d7922 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] 10.222.0.13 "GET /compute/v2.1/servers/27cf9c57-37a3-4ccb-ba37-bc66ff5423cd" status: 200 len: 1278 microversion: 2.1 time: 0.161389 Oct 30 01:14:35.179470 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 145/286] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:35 2022] GET /compute/v2.1/servers/27cf9c57-37a3-4ccb-ba37-bc66ff5423cd => generated 1278 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:35.193970 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3f3fd8ce-edfc-4f69-9eb1-96e82667f9c7 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-64546591", "availability_zone": "tempest-test_az-845238386"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:35.197712 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.aggregate [None req-3f3fd8ce-edfc-4f69-9eb1-96e82667f9c7 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Generated uuid db3c7048-d168-495d-ad04-a7bd07cb38e3 for aggregate {{(pid=121102) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 30 01:14:35.329427 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3f3fd8ce-edfc-4f69-9eb1-96e82667f9c7 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.149614 Oct 30 01:14:35.333993 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 146/287] 10.222.0.13 () {60 vars in 1165 bytes} [Sun Oct 30 01:14:35 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:35.374843 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-78575b3f-28ff-4206-bf4f-eee6221ccb4e tempest-AggregatesAdminNegativeTestJSON-1541830664 tempest-AggregatesAdminNegativeTestJSON-1541830664-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-416021255"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:35.380458 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-78575b3f-28ff-4206-bf4f-eee6221ccb4e tempest-AggregatesAdminNegativeTestJSON-1541830664 tempest-AggregatesAdminNegativeTestJSON-1541830664-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '3d46ad002b4d4e7b82c455ee8d2cd2ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7125ddd978584c4b8f1b196e6cc62e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:35.401840 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-78575b3f-28ff-4206-bf4f-eee6221ccb4e tempest-AggregatesAdminNegativeTestJSON-1541830664 tempest-AggregatesAdminNegativeTestJSON-1541830664-project] Request method failure captured: Oct 30 01:14:35.401840 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 30 01:14:35.401840 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:14:35.401840 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:14:35.401840 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:14:35.401840 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 59 Oct 30 01:14:35.401840 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:14:35.401840 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:14:35.401840 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:14:35.401840 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:14:35.401840 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXc-0QrQiztamIwHFFvUqoa069ENcmlzmusmY9jPTcVZOQVrT1319Dw_UMMM4lDV_kMpAjIoQKPhdI31i16Tvjy-FaUnZDsALhBcTRcywK7mVXXE7nFPMU_muszKdk029GOI_MV2k3x0zTWGS8XhrpT3Cy-9OHEPtqCrneDxreS22tZU Oct 30 01:14:35.401840 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:14:35.401840 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:14:35.401840 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:14:35.401840 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:14:35.401840 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:14:35.401840 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:14:35.401840 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 7125ddd978584c4b8f1b196e6cc62e94 Oct 30 01:14:35.401840 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1541830664 Oct 30 01:14:35.401840 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:14:35.401840 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:14:35.403143 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7125ddd978584c4b8f1b196e6cc62e94"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7125ddd978584c4b8f1b196e6cc62e94"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7125ddd978584c4b8f1b196e6cc62e94"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7125ddd978584c4b8f1b196e6cc62e94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:14:35.403143 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1541830664 Oct 30 01:14:35.403143 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 7125ddd978584c4b8f1b196e6cc62e94 Oct 30 01:14:35.403143 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1541830664 Oct 30 01:14:35.403143 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-AggregatesAdminNegativeTestJSON-1541830664-project Oct 30 01:14:35.403143 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:14:35.403143 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:14:35.403143 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 3d46ad002b4d4e7b82c455ee8d2cd2ab Oct 30 01:14:35.403143 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1541830664-project Oct 30 01:14:35.403143 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:14:35.403143 n-d-master-1 devstack@n-api.service[121102]: {"aggregate": {"name": "tempest-test_aggregate-416021255"}} Oct 30 01:14:35.403143 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:14:35.403143 n-d-master-1 devstack@n-api.service[121102]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 30 01:14:35.403980 n-d-master-1 devstack@n-api.service[121102]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-416021255'}}} Oct 30 01:14:35.403980 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:14:35.403980 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:35.403980 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:35.403980 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:35.403980 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:14:35.403980 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:14:35.403980 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:14:35.403980 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:14:35.403980 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:14:35.403980 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:14:35.403980 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:14:35.403980 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:14:35.403980 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 30 01:14:35.403980 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 30 01:14:35.403980 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 30 01:14:35.403980 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 30 01:14:35.403980 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 30 01:14:35.403980 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 30 01:14:35.405006 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 01:14:35.405006 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 30 01:14:35.405006 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 01:14:35.405006 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise self.value Oct 30 01:14:35.405006 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 30 01:14:35.405006 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 30 01:14:35.405006 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 30 01:14:35.405006 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 30 01:14:35.405006 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 30 01:14:35.405006 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 30 01:14:35.405006 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 30 01:14:35.405006 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:35.405006 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:35.405006 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:35.405006 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:35.405006 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:35.405006 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:35.405006 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 30 01:14:35.405006 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 30 01:14:35.405006 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 30 01:14:35.406155 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:35.408036 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-78575b3f-28ff-4206-bf4f-eee6221ccb4e tempest-AggregatesAdminNegativeTestJSON-1541830664 tempest-AggregatesAdminNegativeTestJSON-1541830664-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:14:35.409167 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-78575b3f-28ff-4206-bf4f-eee6221ccb4e tempest-AggregatesAdminNegativeTestJSON-1541830664 tempest-AggregatesAdminNegativeTestJSON-1541830664-project] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.073579 Oct 30 01:14:35.410896 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 147/288] 10.222.0.13 () {60 vars in 1164 bytes} [Sun Oct 30 01:14:35 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 76 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:14:35.418618 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d8b0b961-7923-481b-8930-e64ad71a4df1 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-64546591_new", "availability_zone": "tempest-test_az-845238386_new"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:35.731320 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8b0b961-7923-481b-8930-e64ad71a4df1 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:35.731810 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8b0b961-7923-481b-8930-e64ad71a4df1 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:35.732241 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8b0b961-7923-481b-8930-e64ad71a4df1 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:35.848151 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d8b0b961-7923-481b-8930-e64ad71a4df1 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-aggregates/12" status: 200 len: 333 microversion: 2.1 time: 0.435977 Oct 30 01:14:35.848867 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 148/289] 10.222.0.13 () {60 vars in 1173 bytes} [Sun Oct 30 01:14:35 2022] PUT /compute/v2.1/os-aggregates/12 => generated 333 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:35.859379 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c3b00108-5763-404d-9637-ba89bf6c2418 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Action: 'update', calling method: .version_select at 0x7f44cc945430>, body: {"quota_set": {"ram": "2048"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:36.030746 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c3b00108-5763-404d-9637-ba89bf6c2418 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:36.031243 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c3b00108-5763-404d-9637-ba89bf6c2418 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:36.031674 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c3b00108-5763-404d-9637-ba89bf6c2418 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:36.032406 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c3b00108-5763-404d-9637-ba89bf6c2418 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:36.032854 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c3b00108-5763-404d-9637-ba89bf6c2418 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:36.036813 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c3b00108-5763-404d-9637-ba89bf6c2418 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:36.120169 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c3b00108-5763-404d-9637-ba89bf6c2418 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:36.120636 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c3b00108-5763-404d-9637-ba89bf6c2418 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:36.121154 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c3b00108-5763-404d-9637-ba89bf6c2418 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:36.127021 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c3b00108-5763-404d-9637-ba89bf6c2418 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:36.127599 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c3b00108-5763-404d-9637-ba89bf6c2418 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:36.128046 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c3b00108-5763-404d-9637-ba89bf6c2418 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:36.299790 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c3b00108-5763-404d-9637-ba89bf6c2418 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/418a796af9844d45b2e4fe65ad1f9f61?user_id=09a48d36a0b546cd8c86e0c745b47d27" status: 200 len: 148 microversion: 2.57 time: 0.449015 Oct 30 01:14:36.301166 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 149/290] 10.222.0.13 () {62 vars in 1384 bytes} [Sun Oct 30 01:14:35 2022] PUT /compute/v2.1/os-quota-sets/418a796af9844d45b2e4fe65ad1f9f61?user_id=09a48d36a0b546cd8c86e0c745b47d27 => generated 148 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:14:36.305933 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cbd652d3-e7b3-47b0-a601-d92d35da0aa2 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1038329050"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:36.316434 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.aggregate [None req-cbd652d3-e7b3-47b0-a601-d92d35da0aa2 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Generated uuid b189aa8d-0fe4-4bc3-9012-d32dc8034c20 for aggregate {{(pid=121102) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 30 01:14:36.494512 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cbd652d3-e7b3-47b0-a601-d92d35da0aa2 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.191856 Oct 30 01:14:36.496287 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 150/291] 10.222.0.13 () {60 vars in 1164 bytes} [Sun Oct 30 01:14:36 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:36.506104 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cf175576-e528-4638-b2b8-ac1803b02fae tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:36.507082 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cf175576-e528-4638-b2b8-ac1803b02fae tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:36.520182 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cf175576-e528-4638-b2b8-ac1803b02fae tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:36.521008 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cf175576-e528-4638-b2b8-ac1803b02fae tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:36.521536 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cf175576-e528-4638-b2b8-ac1803b02fae tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:36.522424 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cf175576-e528-4638-b2b8-ac1803b02fae tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:36.523810 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cf175576-e528-4638-b2b8-ac1803b02fae tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:36.524392 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cf175576-e528-4638-b2b8-ac1803b02fae tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:36.689173 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=6,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:36.740041 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-cf175576-e528-4638-b2b8-ac1803b02fae tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:36.753046 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-cf175576-e528-4638-b2b8-ac1803b02fae tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:36.758222 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-cf175576-e528-4638-b2b8-ac1803b02fae tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:36.772985 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cf175576-e528-4638-b2b8-ac1803b02fae tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] 10.222.0.13 "GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 200 len: 1446 microversion: 2.75 time: 0.275342 Oct 30 01:14:36.773609 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 151/292] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:14:36 2022] GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 1446 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:14:36.779090 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fab4a756-4ab9-4cb5-92d4-652ea38fffb5 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:36.796871 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fab4a756-4ab9-4cb5-92d4-652ea38fffb5 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates" status: 200 len: 551 microversion: 2.1 time: 0.020317 Oct 30 01:14:36.800609 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 152/293] 10.222.0.13 () {58 vars in 1143 bytes} [Sun Oct 30 01:14:36 2022] GET /compute/v2.1/os-aggregates => generated 551 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:36.814234 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-75f779a6-20da-46a5-a094-0c6039c4c4c3 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:36.814871 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-75f779a6-20da-46a5-a094-0c6039c4c4c3 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] [instance: 27cf9c57-37a3-4ccb-ba37-bc66ff5423cd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:36.830167 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-75f779a6-20da-46a5-a094-0c6039c4c4c3 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:36.837765 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-75f779a6-20da-46a5-a094-0c6039c4c4c3 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:36.838383 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-75f779a6-20da-46a5-a094-0c6039c4c4c3 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:36.839642 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-75f779a6-20da-46a5-a094-0c6039c4c4c3 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:36.841278 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-75f779a6-20da-46a5-a094-0c6039c4c4c3 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:36.841278 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-75f779a6-20da-46a5-a094-0c6039c4c4c3 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:37.235603 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-75f779a6-20da-46a5-a094-0c6039c4c4c3 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464f9e9314154e3f9c779b9ae10b2a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a83b0b15194aa69fc4d82876a1e6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:37.246845 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-75f779a6-20da-46a5-a094-0c6039c4c4c3 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] 10.222.0.13 "GET /compute/v2.1/servers/27cf9c57-37a3-4ccb-ba37-bc66ff5423cd" status: 200 len: 1318 microversion: 2.1 time: 0.447431 Oct 30 01:14:37.248957 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 153/294] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:36 2022] GET /compute/v2.1/servers/27cf9c57-37a3-4ccb-ba37-bc66ff5423cd => generated 1318 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:37.256492 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-214a8168-ebf2-495e-a084-0da337a5e6d8 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Calling method '.version_select at 0x7f44ccb24d30>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:37.393374 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-214a8168-ebf2-495e-a084-0da337a5e6d8 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/418a796af9844d45b2e4fe65ad1f9f61?user_id=09a48d36a0b546cd8c86e0c745b47d27" status: 200 len: 190 microversion: 2.57 time: 0.142819 Oct 30 01:14:37.394373 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 154/295] 10.222.0.13 () {60 vars in 1364 bytes} [Sun Oct 30 01:14:37 2022] GET /compute/v2.1/os-quota-sets/418a796af9844d45b2e4fe65ad1f9f61?user_id=09a48d36a0b546cd8c86e0c745b47d27 => generated 190 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:14:37.415763 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bda79017-70eb-4717-89e7-056e1e476390 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1038329050"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:37.419398 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.aggregate [None req-bda79017-70eb-4717-89e7-056e1e476390 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Generated uuid 1515b018-64fa-4883-8544-04984b166274 for aggregate {{(pid=121102) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 30 01:14:37.466436 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-bda79017-70eb-4717-89e7-056e1e476390 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1038329050 already exists. Oct 30 01:14:37.468280 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bda79017-70eb-4717-89e7-056e1e476390 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Request method failure captured: Oct 30 01:14:37.468280 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 30 01:14:37.468280 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:14:37.468280 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:14:37.468280 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:14:37.468280 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 60 Oct 30 01:14:37.468280 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:14:37.468280 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:14:37.468280 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:14:37.468280 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:14:37.468280 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXc-3gN2AwBYwbdvZGmSvdpdZvZwjFntCD4wstkgGcLi3wTCXZysV4KoMBsD0aD4hAu5hNeKEvgUUO20F4SRa4sY9OuAdO3gP-QlWXV6RdLo-ocB73CaT33LhTEJFJa5Trr2_XU0o08k5NzgdUTdUTgTgWLEA7ifipfA_JZVsSsUejVI Oct 30 01:14:37.468280 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:14:37.468280 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:14:37.468280 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:14:37.468280 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:14:37.468280 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:14:37.468280 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:14:37.468280 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: c63e7b7a4aef41adaa41001c0129434c Oct 30 01:14:37.468280 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1075675897 Oct 30 01:14:37.468280 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,admin,reader Oct 30 01:14:37.468280 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,admin,reader Oct 30 01:14:37.469643 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c63e7b7a4aef41adaa41001c0129434c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c63e7b7a4aef41adaa41001c0129434c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c63e7b7a4aef41adaa41001c0129434c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c63e7b7a4aef41adaa41001c0129434c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:14:37.469643 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1075675897 Oct 30 01:14:37.469643 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: c63e7b7a4aef41adaa41001c0129434c Oct 30 01:14:37.469643 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1075675897 Oct 30 01:14:37.469643 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin Oct 30 01:14:37.469643 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:14:37.469643 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:14:37.469643 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: aa3da3ec33c7409a8c0463bf64d50400 Oct 30 01:14:37.469643 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin Oct 30 01:14:37.469643 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:14:37.469643 n-d-master-1 devstack@n-api.service[121102]: {"aggregate": {"name": "tempest-test_aggregate-1038329050"}} Oct 30 01:14:37.469643 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:14:37.469643 n-d-master-1 devstack@n-api.service[121102]: exception: Aggregate tempest-test_aggregate-1038329050 already exists. Oct 30 01:14:37.470366 n-d-master-1 devstack@n-api.service[121102]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1038329050'}}} Oct 30 01:14:37.470366 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:14:37.470366 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:37.470366 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 30 01:14:37.470366 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 30 01:14:37.470366 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 30 01:14:37.470366 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 30 01:14:37.470366 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 01:14:37.470366 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 30 01:14:37.470366 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 01:14:37.470366 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise self.value Oct 30 01:14:37.470366 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 30 01:14:37.470366 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 30 01:14:37.470366 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Oct 30 01:14:37.470366 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 30 01:14:37.470366 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 30 01:14:37.470366 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 30 01:14:37.470366 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 30 01:14:37.470366 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 30 01:14:37.471458 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 30 01:14:37.471458 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 30 01:14:37.471458 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 30 01:14:37.471458 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 30 01:14:37.471458 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1038329050 already exists. Oct 30 01:14:37.471458 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:37.471458 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:37.471458 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:37.471458 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:37.471458 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:37.471458 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:37.471458 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:14:37.471458 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:14:37.471458 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:14:37.471458 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:14:37.471458 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:14:37.471458 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:14:37.471458 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:14:37.471458 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:14:37.471458 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 30 01:14:37.472645 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 30 01:14:37.472645 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1038329050 already exists. Oct 30 01:14:37.472645 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:37.472645 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:37.472645 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:37.472645 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:37.472645 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:37.472645 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:37.472645 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:14:37.472645 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:14:37.472645 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1038329050 already exists. Oct 30 01:14:37.472645 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:37.472645 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bda79017-70eb-4717-89e7-056e1e476390 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1038329050 already exists. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:14:37.472645 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bda79017-70eb-4717-89e7-056e1e476390 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.074205 Oct 30 01:14:37.486578 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 155/296] 10.222.0.13 () {60 vars in 1164 bytes} [Sun Oct 30 01:14:37 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 91 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:14:37.492862 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fb29f9c1-eb9d-461e-8904-232f34e4f5ce tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:37.701666 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fb29f9c1-eb9d-461e-8904-232f34e4f5ce tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.213117 Oct 30 01:14:37.708826 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 156/297] 10.222.0.13 () {58 vars in 1155 bytes} [Sun Oct 30 01:14:37 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 30 01:14:37.714158 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1484ff9a-907b-4771-9661-1885fb34a59c tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:37.771818 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3cb45501-5994-46e8-95ae-3884827db736 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae/action" status: 202 len: 0 microversion: 2.1 time: 5.102194 Oct 30 01:14:37.773477 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 142/298] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:14:32 2022] POST /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae/action => generated 0 bytes in 5104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:14:37.778684 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a2211d9b-b54d-4872-8e6b-4f8b14f85980 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1640756372"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:37.805204 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1484ff9a-907b-4771-9661-1885fb34a59c tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.094857 Oct 30 01:14:37.805886 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.aggregate [None req-a2211d9b-b54d-4872-8e6b-4f8b14f85980 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Generated uuid a912166b-2b08-490b-bc7e-06cfd03c32fe for aggregate {{(pid=121103) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 30 01:14:37.810908 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 157/299] 10.222.0.13 () {58 vars in 1155 bytes} [Sun Oct 30 01:14:37 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 30 01:14:37.811278 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-efbde4b6-9089-42b6-a2c7-fa46424479aa tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:37.811896 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-efbde4b6-9089-42b6-a2c7-fa46424479aa tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 7e81dcfb-dcbe-4e05-91a4-541ff2c404ae] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:37.820740 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-efbde4b6-9089-42b6-a2c7-fa46424479aa tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:37.821245 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-efbde4b6-9089-42b6-a2c7-fa46424479aa tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:37.821710 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-efbde4b6-9089-42b6-a2c7-fa46424479aa tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:37.823096 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-efbde4b6-9089-42b6-a2c7-fa46424479aa tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:37.824133 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-efbde4b6-9089-42b6-a2c7-fa46424479aa tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:37.825040 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-efbde4b6-9089-42b6-a2c7-fa46424479aa tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:37.960988 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a2211d9b-b54d-4872-8e6b-4f8b14f85980 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.186249 Oct 30 01:14:37.970551 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 143/300] 10.222.0.13 () {60 vars in 1164 bytes} [Sun Oct 30 01:14:37 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:37.982983 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7acaaa27-1934-4d0d-8f18-425bf1200210 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:37.987115 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7acaaa27-1934-4d0d-8f18-425bf1200210 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:38.003040 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7acaaa27-1934-4d0d-8f18-425bf1200210 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:38.007459 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7acaaa27-1934-4d0d-8f18-425bf1200210 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:38.008263 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7acaaa27-1934-4d0d-8f18-425bf1200210 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:38.009248 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7acaaa27-1934-4d0d-8f18-425bf1200210 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:38.010981 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7acaaa27-1934-4d0d-8f18-425bf1200210 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:38.011693 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7acaaa27-1934-4d0d-8f18-425bf1200210 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:38.213768 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7acaaa27-1934-4d0d-8f18-425bf1200210 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:38.224527 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7acaaa27-1934-4d0d-8f18-425bf1200210 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:38.238285 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7acaaa27-1934-4d0d-8f18-425bf1200210 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:38.250030 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7acaaa27-1934-4d0d-8f18-425bf1200210 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] 10.222.0.13 "GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 200 len: 1446 microversion: 2.75 time: 0.277570 Oct 30 01:14:38.250748 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 144/301] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:14:37 2022] GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 1446 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:14:38.258996 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c81aa9d3-d5da-465c-a684-acb47ad652b7 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1744594872"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:38.268546 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.aggregate [None req-c81aa9d3-d5da-465c-a684-acb47ad652b7 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Generated uuid cecec5e6-05b0-4bba-a180-23a32f922eea for aggregate {{(pid=121103) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 30 01:14:38.321600 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-efbde4b6-9089-42b6-a2c7-fa46424479aa tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:38.331432 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-efbde4b6-9089-42b6-a2c7-fa46424479aa tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae" status: 200 len: 1503 microversion: 2.1 time: 0.524400 Oct 30 01:14:38.335189 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 158/302] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:37 2022] GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae => generated 1503 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:38.350048 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bba06d54-dd5e-4ae3-85cf-d80665607794 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:38.361634 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c81aa9d3-d5da-465c-a684-acb47ad652b7 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.109590 Oct 30 01:14:38.363887 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 145/303] 10.222.0.13 () {60 vars in 1164 bytes} [Sun Oct 30 01:14:38 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:38.375932 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-35bd36cb-deb5-42c1-a07e-84745a99b317 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:38.376159 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bba06d54-dd5e-4ae3-85cf-d80665607794 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates" status: 200 len: 446 microversion: 2.1 time: 0.042334 Oct 30 01:14:38.376765 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 159/304] 10.222.0.13 () {58 vars in 1143 bytes} [Sun Oct 30 01:14:38 2022] GET /compute/v2.1/os-aggregates => generated 446 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:38.377873 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-35bd36cb-deb5-42c1-a07e-84745a99b317 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] [instance: 27cf9c57-37a3-4ccb-ba37-bc66ff5423cd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:38.393700 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-35bd36cb-deb5-42c1-a07e-84745a99b317 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:38.394479 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-35bd36cb-deb5-42c1-a07e-84745a99b317 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:38.395664 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-35bd36cb-deb5-42c1-a07e-84745a99b317 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:38.396849 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-35bd36cb-deb5-42c1-a07e-84745a99b317 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:38.397495 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-35bd36cb-deb5-42c1-a07e-84745a99b317 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:38.398061 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-35bd36cb-deb5-42c1-a07e-84745a99b317 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:38.423512 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fc7a6618-95eb-4a86-b2dd-14f68de7738d tempest-AggregatesAdminNegativeTestJSON-1541830664 tempest-AggregatesAdminNegativeTestJSON-1541830664-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:38.430275 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-fc7a6618-95eb-4a86-b2dd-14f68de7738d tempest-AggregatesAdminNegativeTestJSON-1541830664 tempest-AggregatesAdminNegativeTestJSON-1541830664-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '3d46ad002b4d4e7b82c455ee8d2cd2ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7125ddd978584c4b8f1b196e6cc62e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:38.438611 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fc7a6618-95eb-4a86-b2dd-14f68de7738d tempest-AggregatesAdminNegativeTestJSON-1541830664 tempest-AggregatesAdminNegativeTestJSON-1541830664-project] Request method failure captured: Oct 30 01:14:38.438611 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Oct 30 01:14:38.438611 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:14:38.438611 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:14:38.438611 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:14:38.438611 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:14:38.438611 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:14:38.438611 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:14:38.438611 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:14:38.438611 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:14:38.438611 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXc-0QrQiztamIwHFFvUqoa069ENcmlzmusmY9jPTcVZOQVrT1319Dw_UMMM4lDV_kMpAjIoQKPhdI31i16Tvjy-FaUnZDsALhBcTRcywK7mVXXE7nFPMU_muszKdk029GOI_MV2k3x0zTWGS8XhrpT3Cy-9OHEPtqCrneDxreS22tZU Oct 30 01:14:38.438611 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:14:38.438611 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:14:38.438611 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:14:38.438611 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:14:38.438611 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:14:38.438611 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:14:38.438611 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 7125ddd978584c4b8f1b196e6cc62e94 Oct 30 01:14:38.438611 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1541830664 Oct 30 01:14:38.438611 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:14:38.438611 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:14:38.440095 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7125ddd978584c4b8f1b196e6cc62e94"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7125ddd978584c4b8f1b196e6cc62e94"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7125ddd978584c4b8f1b196e6cc62e94"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7125ddd978584c4b8f1b196e6cc62e94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:14:38.440095 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1541830664 Oct 30 01:14:38.440095 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 7125ddd978584c4b8f1b196e6cc62e94 Oct 30 01:14:38.440095 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1541830664 Oct 30 01:14:38.440095 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-AggregatesAdminNegativeTestJSON-1541830664-project Oct 30 01:14:38.440095 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:14:38.440095 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:14:38.440095 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 3d46ad002b4d4e7b82c455ee8d2cd2ab Oct 30 01:14:38.440095 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1541830664-project Oct 30 01:14:38.440095 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:14:38.440095 n-d-master-1 devstack@n-api.service[121102]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 30 01:14:38.440095 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '15'} Oct 30 01:14:38.441535 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:14:38.441535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:38.441535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:38.441535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:38.441535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:14:38.441535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:14:38.441535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:14:38.441535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:14:38.441535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 30 01:14:38.441535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 30 01:14:38.441535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 30 01:14:38.441535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 30 01:14:38.441535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 30 01:14:38.441535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 30 01:14:38.441535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 01:14:38.441535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 30 01:14:38.441535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 01:14:38.441535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise self.value Oct 30 01:14:38.441535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 30 01:14:38.442923 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 30 01:14:38.442923 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 30 01:14:38.442923 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 30 01:14:38.442923 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 30 01:14:38.442923 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 30 01:14:38.442923 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 30 01:14:38.442923 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:38.442923 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:38.442923 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:38.442923 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:38.442923 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:38.442923 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:38.442923 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 30 01:14:38.442923 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 30 01:14:38.442923 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 30 01:14:38.442923 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:38.442923 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fc7a6618-95eb-4a86-b2dd-14f68de7738d tempest-AggregatesAdminNegativeTestJSON-1541830664 tempest-AggregatesAdminNegativeTestJSON-1541830664-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:14:38.444449 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fc7a6618-95eb-4a86-b2dd-14f68de7738d tempest-AggregatesAdminNegativeTestJSON-1541830664 tempest-AggregatesAdminNegativeTestJSON-1541830664-project] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.062406 Oct 30 01:14:38.446320 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 160/305] 10.222.0.13 () {58 vars in 1155 bytes} [Sun Oct 30 01:14:38 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 69 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:14:38.454750 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-68acd222-4aa2-43ec-8dcd-d78659a6ead3 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:38.556522 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-68acd222-4aa2-43ec-8dcd-d78659a6ead3 tempest-AggregatesAdminTestJSON-1475706727 tempest-AggregatesAdminTestJSON-1475706727-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.108372 Oct 30 01:14:38.557495 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 161/306] 10.222.0.13 () {58 vars in 1155 bytes} [Sun Oct 30 01:14:38 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 30 01:14:38.573734 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8000a525-208f-4d35-90dc-16358c382ac8 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:38.681238 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8000a525-208f-4d35-90dc-16358c382ac8 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.122191 Oct 30 01:14:38.683176 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 162/307] 10.222.0.13 () {58 vars in 1155 bytes} [Sun Oct 30 01:14:38 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 30 01:14:38.696950 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fa3bfad9-40b2-47df-92ff-c821c54cc326 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:38.699149 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fa3bfad9-40b2-47df-92ff-c821c54cc326 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] [instance: ba2968b1-c8ef-4ec2-9d98-66da2c62919b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:38.714511 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fa3bfad9-40b2-47df-92ff-c821c54cc326 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:38.715211 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fa3bfad9-40b2-47df-92ff-c821c54cc326 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:38.715454 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fa3bfad9-40b2-47df-92ff-c821c54cc326 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:38.716174 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fa3bfad9-40b2-47df-92ff-c821c54cc326 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:38.716632 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fa3bfad9-40b2-47df-92ff-c821c54cc326 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:38.717057 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fa3bfad9-40b2-47df-92ff-c821c54cc326 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:38.745806 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-fa3bfad9-40b2-47df-92ff-c821c54cc326 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] HTTP exception thrown: Instance ba2968b1-c8ef-4ec2-9d98-66da2c62919b could not be found. Oct 30 01:14:38.748299 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fa3bfad9-40b2-47df-92ff-c821c54cc326 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Request method failure captured: Oct 30 01:14:38.748299 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b HTTP/1.1 Oct 30 01:14:38.748299 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:14:38.748299 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:14:38.748299 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:14:38.748299 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:14:38.748299 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:14:38.748299 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:14:38.748299 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:14:38.748299 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:14:38.748299 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXc-z1rQpRJG_1Qx2ldZYzLzeIVZ4BawuAkv2SSf85ILkyxYcb2WZDbR2BAGG1kJiKiXi44Gh6yGjtlIIycroy83nDE82dxfGDs7QbsfvCmLYYe4n7BicucQYxUuT0DofnIDiDCOnROcOvMZgBVhFeg5Lbl7hOIqp80RHDAxUA6WlmWI Oct 30 01:14:38.748299 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:14:38.748299 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:14:38.748299 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:14:38.748299 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:14:38.748299 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:14:38.748299 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:14:38.748299 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: ce6543b666064cd78c02ec5a471d003f Oct 30 01:14:38.748299 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-AggregatesAdminTestJSON-252681350 Oct 30 01:14:38.748299 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:14:38.748299 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:14:38.749696 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ce6543b666064cd78c02ec5a471d003f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ce6543b666064cd78c02ec5a471d003f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ce6543b666064cd78c02ec5a471d003f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ce6543b666064cd78c02ec5a471d003f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:14:38.749696 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-AggregatesAdminTestJSON-252681350 Oct 30 01:14:38.749696 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: ce6543b666064cd78c02ec5a471d003f Oct 30 01:14:38.749696 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-252681350 Oct 30 01:14:38.749696 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-AggregatesAdminTestJSON-252681350-project Oct 30 01:14:38.749696 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:14:38.749696 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:14:38.749696 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: ae9211a459e946c1a114983c531a8897 Oct 30 01:14:38.749696 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-AggregatesAdminTestJSON-252681350-project Oct 30 01:14:38.749696 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:14:38.749696 n-d-master-1 devstack@n-api.service[121102]: exception: Instance ba2968b1-c8ef-4ec2-9d98-66da2c62919b could not be found. Oct 30 01:14:38.749696 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'ba2968b1-c8ef-4ec2-9d98-66da2c62919b'} Oct 30 01:14:38.750400 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:14:38.750400 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:38.750400 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:14:38.750400 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:14:38.750400 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:14:38.750400 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:14:38.750400 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:14:38.750400 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:14:38.750400 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:14:38.750400 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:14:38.750400 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba2968b1-c8ef-4ec2-9d98-66da2c62919b could not be found. Oct 30 01:14:38.750400 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:38.750400 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:38.750400 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:38.750400 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:38.750400 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:38.750400 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:38.750400 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:14:38.750400 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:14:38.750400 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:14:38.752313 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:14:38.752313 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:14:38.752313 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:14:38.752313 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:14:38.752313 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:14:38.752313 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:14:38.752313 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:14:38.752313 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:14:38.752313 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:14:38.752313 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba2968b1-c8ef-4ec2-9d98-66da2c62919b could not be found. Oct 30 01:14:38.752313 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:38.752313 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:38.752313 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:38.752313 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:38.752313 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:38.752313 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:38.752313 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:14:38.752313 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:14:38.752313 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba2968b1-c8ef-4ec2-9d98-66da2c62919b could not be found. Oct 30 01:14:38.752313 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:38.756800 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fa3bfad9-40b2-47df-92ff-c821c54cc326 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Returning 404 to user: Instance ba2968b1-c8ef-4ec2-9d98-66da2c62919b could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:14:38.756800 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fa3bfad9-40b2-47df-92ff-c821c54cc326 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b" status: 404 len: 111 microversion: 2.1 time: 0.065150 Oct 30 01:14:38.756800 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 163/308] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:14:38 2022] DELETE /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:14:38.758399 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6835ae25-105e-4544-ad1f-f9d06af15a91 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:38.769752 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-6835ae25-105e-4544-ad1f-f9d06af15a91 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 30 01:14:38.771566 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6835ae25-105e-4544-ad1f-f9d06af15a91 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Request method failure captured: Oct 30 01:14:38.771566 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 30 01:14:38.771566 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:14:38.771566 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:14:38.771566 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:14:38.771566 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:14:38.771566 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:14:38.771566 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:14:38.771566 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:14:38.771566 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:14:38.771566 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXc-3gN2AwBYwbdvZGmSvdpdZvZwjFntCD4wstkgGcLi3wTCXZysV4KoMBsD0aD4hAu5hNeKEvgUUO20F4SRa4sY9OuAdO3gP-QlWXV6RdLo-ocB73CaT33LhTEJFJa5Trr2_XU0o08k5NzgdUTdUTgTgWLEA7ifipfA_JZVsSsUejVI Oct 30 01:14:38.771566 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:14:38.771566 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:14:38.771566 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:14:38.771566 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:14:38.771566 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:14:38.771566 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:14:38.771566 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: c63e7b7a4aef41adaa41001c0129434c Oct 30 01:14:38.771566 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1075675897 Oct 30 01:14:38.771566 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,admin,reader Oct 30 01:14:38.771566 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,admin,reader Oct 30 01:14:38.772914 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c63e7b7a4aef41adaa41001c0129434c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c63e7b7a4aef41adaa41001c0129434c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c63e7b7a4aef41adaa41001c0129434c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c63e7b7a4aef41adaa41001c0129434c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:14:38.772914 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1075675897 Oct 30 01:14:38.772914 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: c63e7b7a4aef41adaa41001c0129434c Oct 30 01:14:38.772914 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1075675897 Oct 30 01:14:38.772914 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin Oct 30 01:14:38.772914 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:14:38.772914 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:14:38.772914 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: aa3da3ec33c7409a8c0463bf64d50400 Oct 30 01:14:38.772914 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin Oct 30 01:14:38.772914 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:14:38.772914 n-d-master-1 devstack@n-api.service[121102]: exception: Aggregate -1 could not be found. Oct 30 01:14:38.772914 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '-1'} Oct 30 01:14:38.773826 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:14:38.773826 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:38.773826 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 30 01:14:38.773826 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 30 01:14:38.773826 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 30 01:14:38.773826 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 30 01:14:38.773826 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 01:14:38.773826 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 30 01:14:38.773826 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 01:14:38.773826 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise self.value Oct 30 01:14:38.773826 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 30 01:14:38.773826 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 30 01:14:38.773826 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 30 01:14:38.773826 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 30 01:14:38.773826 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 01:14:38.773826 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 01:14:38.773826 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 30 01:14:38.773826 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 30 01:14:38.773826 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 30 01:14:38.775080 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 30 01:14:38.775080 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 30 01:14:38.775080 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 30 01:14:38.775080 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 30 01:14:38.775080 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:38.775080 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:38.775080 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:38.775080 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:38.775080 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:38.775080 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:38.775080 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:14:38.775080 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:14:38.775080 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:14:38.775080 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:14:38.775080 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 30 01:14:38.775080 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:14:38.775080 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 30 01:14:38.775080 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:38.775080 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:38.775080 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:38.775080 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:38.776437 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:38.776437 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:38.776437 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:14:38.776437 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:14:38.776437 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 30 01:14:38.776437 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:38.778328 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6835ae25-105e-4544-ad1f-f9d06af15a91 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:14:38.779390 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6835ae25-105e-4544-ad1f-f9d06af15a91 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.025098 Oct 30 01:14:38.780584 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 164/309] 10.222.0.13 () {58 vars in 1155 bytes} [Sun Oct 30 01:14:38 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:14:38.788973 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-35bd36cb-deb5-42c1-a07e-84745a99b317 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464f9e9314154e3f9c779b9ae10b2a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a83b0b15194aa69fc4d82876a1e6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:38.789974 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5020ab72-6e00-4aa1-8166-11f5621159c2 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:38.789974 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5020ab72-6e00-4aa1-8166-11f5621159c2 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] [instance: ba2968b1-c8ef-4ec2-9d98-66da2c62919b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:38.797885 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5020ab72-6e00-4aa1-8166-11f5621159c2 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:38.798360 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5020ab72-6e00-4aa1-8166-11f5621159c2 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:38.798995 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5020ab72-6e00-4aa1-8166-11f5621159c2 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:38.799869 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5020ab72-6e00-4aa1-8166-11f5621159c2 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:38.801022 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5020ab72-6e00-4aa1-8166-11f5621159c2 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:38.801650 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5020ab72-6e00-4aa1-8166-11f5621159c2 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:38.806886 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-35bd36cb-deb5-42c1-a07e-84745a99b317 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] 10.222.0.13 "GET /compute/v2.1/servers/27cf9c57-37a3-4ccb-ba37-bc66ff5423cd" status: 200 len: 1318 microversion: 2.1 time: 0.441722 Oct 30 01:14:38.812102 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 146/310] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:38 2022] GET /compute/v2.1/servers/27cf9c57-37a3-4ccb-ba37-bc66ff5423cd => generated 1318 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:38.819104 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-870242b2-9630-4ada-8a19-1ca091ebba94 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-650314088"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:38.821817 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-5020ab72-6e00-4aa1-8166-11f5621159c2 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] HTTP exception thrown: Instance ba2968b1-c8ef-4ec2-9d98-66da2c62919b could not be found. Oct 30 01:14:38.823580 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.aggregate [None req-870242b2-9630-4ada-8a19-1ca091ebba94 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Generated uuid 89a86598-873c-4fb4-8eb1-88dbb2a38bc4 for aggregate {{(pid=121103) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 30 01:14:38.823945 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5020ab72-6e00-4aa1-8166-11f5621159c2 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Request method failure captured: Oct 30 01:14:38.823945 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b HTTP/1.1 Oct 30 01:14:38.823945 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:14:38.823945 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:14:38.823945 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:14:38.823945 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:14:38.823945 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:14:38.823945 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:14:38.823945 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:14:38.823945 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:14:38.823945 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXc-z1rQpRJG_1Qx2ldZYzLzeIVZ4BawuAkv2SSf85ILkyxYcb2WZDbR2BAGG1kJiKiXi44Gh6yGjtlIIycroy83nDE82dxfGDs7QbsfvCmLYYe4n7BicucQYxUuT0DofnIDiDCOnROcOvMZgBVhFeg5Lbl7hOIqp80RHDAxUA6WlmWI Oct 30 01:14:38.823945 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:14:38.823945 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:14:38.823945 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:14:38.823945 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:14:38.823945 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:14:38.823945 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:14:38.823945 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: ce6543b666064cd78c02ec5a471d003f Oct 30 01:14:38.823945 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-AggregatesAdminTestJSON-252681350 Oct 30 01:14:38.823945 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:14:38.823945 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:14:38.825161 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ce6543b666064cd78c02ec5a471d003f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ce6543b666064cd78c02ec5a471d003f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ce6543b666064cd78c02ec5a471d003f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ce6543b666064cd78c02ec5a471d003f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:14:38.825161 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-AggregatesAdminTestJSON-252681350 Oct 30 01:14:38.825161 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: ce6543b666064cd78c02ec5a471d003f Oct 30 01:14:38.825161 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-252681350 Oct 30 01:14:38.825161 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-AggregatesAdminTestJSON-252681350-project Oct 30 01:14:38.825161 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:14:38.825161 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:14:38.825161 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: ae9211a459e946c1a114983c531a8897 Oct 30 01:14:38.825161 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-AggregatesAdminTestJSON-252681350-project Oct 30 01:14:38.825161 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:14:38.825161 n-d-master-1 devstack@n-api.service[121102]: exception: Instance ba2968b1-c8ef-4ec2-9d98-66da2c62919b could not be found. Oct 30 01:14:38.825161 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'ba2968b1-c8ef-4ec2-9d98-66da2c62919b'} Oct 30 01:14:38.825903 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:14:38.825903 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:38.825903 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:14:38.825903 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:14:38.825903 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:14:38.825903 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:14:38.825903 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:14:38.825903 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:14:38.825903 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:14:38.825903 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:14:38.825903 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba2968b1-c8ef-4ec2-9d98-66da2c62919b could not be found. Oct 30 01:14:38.825903 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:38.825903 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:38.825903 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:38.825903 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:38.825903 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:38.825903 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:38.825903 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:14:38.825903 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:14:38.825903 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:14:38.827302 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:14:38.827302 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:14:38.827302 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:14:38.827302 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:14:38.827302 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:14:38.827302 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:14:38.827302 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:14:38.827302 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba2968b1-c8ef-4ec2-9d98-66da2c62919b could not be found. Oct 30 01:14:38.827302 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:38.827302 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:38.827302 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:38.827302 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:38.827302 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:38.827302 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:38.827302 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:14:38.827302 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:14:38.827302 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba2968b1-c8ef-4ec2-9d98-66da2c62919b could not be found. Oct 30 01:14:38.827302 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:38.829803 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5020ab72-6e00-4aa1-8166-11f5621159c2 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] Returning 404 to user: Instance ba2968b1-c8ef-4ec2-9d98-66da2c62919b could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:14:38.832025 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5020ab72-6e00-4aa1-8166-11f5621159c2 tempest-AggregatesAdminTestJSON-252681350 tempest-AggregatesAdminTestJSON-252681350-project] 10.222.0.13 "GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b" status: 404 len: 111 microversion: 2.1 time: 0.050187 Oct 30 01:14:38.833934 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 165/311] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:38 2022] GET /compute/v2.1/servers/ba2968b1-c8ef-4ec2-9d98-66da2c62919b => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:14:38.968183 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-870242b2-9630-4ada-8a19-1ca091ebba94 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.154746 Oct 30 01:14:38.968896 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 147/312] 10.222.0.13 () {60 vars in 1164 bytes} [Sun Oct 30 01:14:38 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:38.995884 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fbb71c90-6dc9-4993-ad88-469cd753e9fd tempest-AggregatesAdminNegativeTestJSON-1541830664 tempest-AggregatesAdminNegativeTestJSON-1541830664-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:38.998679 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-fbb71c90-6dc9-4993-ad88-469cd753e9fd tempest-AggregatesAdminNegativeTestJSON-1541830664 tempest-AggregatesAdminNegativeTestJSON-1541830664-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '3d46ad002b4d4e7b82c455ee8d2cd2ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7125ddd978584c4b8f1b196e6cc62e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:38.999743 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-d14afd73-31bf-49a0-8a21-5c88dbed149f req-2ea09c6a-175b-49be-95fc-ea8517902275 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27cf9c57-37a3-4ccb-ba37-bc66ff5423cd", "tag": "adfffed5-4e4a-44f0-bcb3-49442b742c2a"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:39.005889 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fbb71c90-6dc9-4993-ad88-469cd753e9fd tempest-AggregatesAdminNegativeTestJSON-1541830664 tempest-AggregatesAdminNegativeTestJSON-1541830664-project] Request method failure captured: Oct 30 01:14:39.005889 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Oct 30 01:14:39.005889 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:14:39.005889 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:14:39.005889 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:14:39.005889 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:14:39.005889 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:14:39.005889 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:14:39.005889 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:14:39.005889 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:14:39.005889 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXc-0QrQiztamIwHFFvUqoa069ENcmlzmusmY9jPTcVZOQVrT1319Dw_UMMM4lDV_kMpAjIoQKPhdI31i16Tvjy-FaUnZDsALhBcTRcywK7mVXXE7nFPMU_muszKdk029GOI_MV2k3x0zTWGS8XhrpT3Cy-9OHEPtqCrneDxreS22tZU Oct 30 01:14:39.005889 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:14:39.005889 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:14:39.005889 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:14:39.005889 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:14:39.005889 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:14:39.005889 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:14:39.005889 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 7125ddd978584c4b8f1b196e6cc62e94 Oct 30 01:14:39.005889 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1541830664 Oct 30 01:14:39.005889 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:14:39.005889 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:14:39.007235 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7125ddd978584c4b8f1b196e6cc62e94"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7125ddd978584c4b8f1b196e6cc62e94"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7125ddd978584c4b8f1b196e6cc62e94"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7125ddd978584c4b8f1b196e6cc62e94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:14:39.007235 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1541830664 Oct 30 01:14:39.007235 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 7125ddd978584c4b8f1b196e6cc62e94 Oct 30 01:14:39.007235 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1541830664 Oct 30 01:14:39.007235 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-AggregatesAdminNegativeTestJSON-1541830664-project Oct 30 01:14:39.007235 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:14:39.007235 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:14:39.007235 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 3d46ad002b4d4e7b82c455ee8d2cd2ab Oct 30 01:14:39.007235 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1541830664-project Oct 30 01:14:39.007235 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:14:39.007235 n-d-master-1 devstack@n-api.service[121102]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 30 01:14:39.007235 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '16'} Oct 30 01:14:39.007948 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:14:39.007948 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:39.007948 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:39.007948 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:39.007948 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:14:39.007948 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:14:39.007948 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:14:39.007948 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:14:39.007948 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 30 01:14:39.007948 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 30 01:14:39.007948 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 30 01:14:39.007948 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 30 01:14:39.007948 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 30 01:14:39.007948 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 30 01:14:39.007948 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 01:14:39.007948 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 30 01:14:39.007948 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 01:14:39.007948 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise self.value Oct 30 01:14:39.007948 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 30 01:14:39.008987 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 30 01:14:39.008987 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 30 01:14:39.008987 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 30 01:14:39.008987 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 30 01:14:39.008987 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 30 01:14:39.008987 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 30 01:14:39.008987 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:39.008987 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:39.008987 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:39.008987 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:39.008987 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:39.008987 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:39.008987 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 30 01:14:39.008987 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 30 01:14:39.008987 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 30 01:14:39.008987 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:39.008987 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fbb71c90-6dc9-4993-ad88-469cd753e9fd tempest-AggregatesAdminNegativeTestJSON-1541830664 tempest-AggregatesAdminNegativeTestJSON-1541830664-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:14:39.012084 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fbb71c90-6dc9-4993-ad88-469cd753e9fd tempest-AggregatesAdminNegativeTestJSON-1541830664 tempest-AggregatesAdminNegativeTestJSON-1541830664-project] 10.222.0.13 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.029163 Oct 30 01:14:39.012269 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 166/313] 10.222.0.13 () {58 vars in 1152 bytes} [Sun Oct 30 01:14:38 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:14:39.023520 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d8e1bd40-1b1d-4970-a919-15c5d8e079d9 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:39.028466 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d14afd73-31bf-49a0-8a21-5c88dbed149f req-2ea09c6a-175b-49be-95fc-ea8517902275 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:39.028976 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d14afd73-31bf-49a0-8a21-5c88dbed149f req-2ea09c6a-175b-49be-95fc-ea8517902275 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:39.029438 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d14afd73-31bf-49a0-8a21-5c88dbed149f req-2ea09c6a-175b-49be-95fc-ea8517902275 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:39.043953 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-d14afd73-31bf-49a0-8a21-5c88dbed149f req-2ea09c6a-175b-49be-95fc-ea8517902275 service nova] Creating event network-changed:adfffed5-4e4a-44f0-bcb3-49442b742c2a for instance 27cf9c57-37a3-4ccb-ba37-bc66ff5423cd on n-h1-master-1 Oct 30 01:14:39.050186 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-d14afd73-31bf-49a0-8a21-5c88dbed149f req-2ea09c6a-175b-49be-95fc-ea8517902275 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068259 Oct 30 01:14:39.051019 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 148/314] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:39.180167 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d8e1bd40-1b1d-4970-a919-15c5d8e079d9 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.166488 Oct 30 01:14:39.181649 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 167/315] 10.222.0.13 () {58 vars in 1155 bytes} [Sun Oct 30 01:14:39 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 30 01:14:39.195310 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-225221ba-5e0b-4c06-b62e-ddece1d0ccf3 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:39.211510 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-225221ba-5e0b-4c06-b62e-ddece1d0ccf3 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 30 01:14:39.213214 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-225221ba-5e0b-4c06-b62e-ddece1d0ccf3 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Request method failure captured: Oct 30 01:14:39.213214 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 30 01:14:39.213214 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:14:39.213214 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:14:39.213214 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:14:39.213214 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:14:39.213214 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:14:39.213214 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:14:39.213214 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:14:39.213214 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:14:39.213214 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXc-3gN2AwBYwbdvZGmSvdpdZvZwjFntCD4wstkgGcLi3wTCXZysV4KoMBsD0aD4hAu5hNeKEvgUUO20F4SRa4sY9OuAdO3gP-QlWXV6RdLo-ocB73CaT33LhTEJFJa5Trr2_XU0o08k5NzgdUTdUTgTgWLEA7ifipfA_JZVsSsUejVI Oct 30 01:14:39.213214 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:14:39.213214 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:14:39.213214 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:14:39.213214 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:14:39.213214 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:14:39.213214 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:14:39.213214 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: c63e7b7a4aef41adaa41001c0129434c Oct 30 01:14:39.213214 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1075675897 Oct 30 01:14:39.213214 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,admin,reader Oct 30 01:14:39.213214 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,admin,reader Oct 30 01:14:39.214708 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c63e7b7a4aef41adaa41001c0129434c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c63e7b7a4aef41adaa41001c0129434c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c63e7b7a4aef41adaa41001c0129434c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c63e7b7a4aef41adaa41001c0129434c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:14:39.214708 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1075675897 Oct 30 01:14:39.214708 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: c63e7b7a4aef41adaa41001c0129434c Oct 30 01:14:39.214708 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1075675897 Oct 30 01:14:39.214708 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin Oct 30 01:14:39.214708 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:14:39.214708 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:14:39.214708 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: aa3da3ec33c7409a8c0463bf64d50400 Oct 30 01:14:39.214708 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin Oct 30 01:14:39.214708 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:14:39.214708 n-d-master-1 devstack@n-api.service[121103]: exception: Aggregate -1 could not be found. Oct 30 01:14:39.214708 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '-1'} Oct 30 01:14:39.215494 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:14:39.215494 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:39.215494 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 30 01:14:39.215494 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 30 01:14:39.215494 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 30 01:14:39.215494 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 30 01:14:39.215494 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 01:14:39.215494 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 01:14:39.215494 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 30 01:14:39.215494 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 30 01:14:39.215494 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 30 01:14:39.215494 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 30 01:14:39.215494 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 30 01:14:39.215494 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 30 01:14:39.215494 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 30 01:14:39.215494 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:39.215494 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:39.215494 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:39.215494 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:39.215494 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:39.216808 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:39.216808 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:14:39.216808 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:14:39.216808 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:14:39.216808 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:14:39.216808 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 30 01:14:39.216808 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:14:39.216808 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 30 01:14:39.216808 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:39.216808 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:39.216808 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:39.216808 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:39.216808 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:39.216808 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:39.216808 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:14:39.216808 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:14:39.216808 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 30 01:14:39.216808 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:39.219557 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-225221ba-5e0b-4c06-b62e-ddece1d0ccf3 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:14:39.220706 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-225221ba-5e0b-4c06-b62e-ddece1d0ccf3 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.031350 Oct 30 01:14:39.221475 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 149/316] 10.222.0.13 () {58 vars in 1152 bytes} [Sun Oct 30 01:14:39 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:14:39.235377 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7f221fdb-80d7-4143-a4a1-7b1cdd4e7c4e tempest-AggregatesAdminNegativeTestJSON-1541830664 tempest-AggregatesAdminNegativeTestJSON-1541830664-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:39.237231 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7f221fdb-80d7-4143-a4a1-7b1cdd4e7c4e tempest-AggregatesAdminNegativeTestJSON-1541830664 tempest-AggregatesAdminNegativeTestJSON-1541830664-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '3d46ad002b4d4e7b82c455ee8d2cd2ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7125ddd978584c4b8f1b196e6cc62e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:39.239442 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7f221fdb-80d7-4143-a4a1-7b1cdd4e7c4e tempest-AggregatesAdminNegativeTestJSON-1541830664 tempest-AggregatesAdminNegativeTestJSON-1541830664-project] Request method failure captured: Oct 30 01:14:39.239442 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 30 01:14:39.239442 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:14:39.239442 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:14:39.239442 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:14:39.239442 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:14:39.239442 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:14:39.239442 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:14:39.239442 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:14:39.239442 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:14:39.239442 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXc-0QrQiztamIwHFFvUqoa069ENcmlzmusmY9jPTcVZOQVrT1319Dw_UMMM4lDV_kMpAjIoQKPhdI31i16Tvjy-FaUnZDsALhBcTRcywK7mVXXE7nFPMU_muszKdk029GOI_MV2k3x0zTWGS8XhrpT3Cy-9OHEPtqCrneDxreS22tZU Oct 30 01:14:39.239442 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:14:39.239442 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:14:39.239442 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:14:39.239442 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:14:39.239442 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:14:39.239442 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:14:39.239442 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 7125ddd978584c4b8f1b196e6cc62e94 Oct 30 01:14:39.239442 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1541830664 Oct 30 01:14:39.239442 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:14:39.239442 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:14:39.240891 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7125ddd978584c4b8f1b196e6cc62e94"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7125ddd978584c4b8f1b196e6cc62e94"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7125ddd978584c4b8f1b196e6cc62e94"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7125ddd978584c4b8f1b196e6cc62e94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:14:39.240891 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1541830664 Oct 30 01:14:39.240891 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 7125ddd978584c4b8f1b196e6cc62e94 Oct 30 01:14:39.240891 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1541830664 Oct 30 01:14:39.240891 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-AggregatesAdminNegativeTestJSON-1541830664-project Oct 30 01:14:39.240891 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:14:39.240891 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:14:39.240891 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 3d46ad002b4d4e7b82c455ee8d2cd2ab Oct 30 01:14:39.240891 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1541830664-project Oct 30 01:14:39.240891 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:14:39.240891 n-d-master-1 devstack@n-api.service[121102]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 30 01:14:39.240891 n-d-master-1 devstack@n-api.service[121102]: action_args: {} Oct 30 01:14:39.241753 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:14:39.241753 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:39.241753 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:39.241753 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:39.241753 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:14:39.241753 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:14:39.241753 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:14:39.241753 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:14:39.241753 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 30 01:14:39.241753 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 30 01:14:39.241753 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 30 01:14:39.241753 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 30 01:14:39.241753 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 30 01:14:39.241753 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 30 01:14:39.241753 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 01:14:39.241753 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 30 01:14:39.241753 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 01:14:39.241753 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise self.value Oct 30 01:14:39.241753 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 30 01:14:39.243189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 30 01:14:39.243189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 30 01:14:39.243189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 30 01:14:39.243189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 30 01:14:39.243189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 30 01:14:39.243189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 30 01:14:39.243189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:39.243189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:39.243189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:39.243189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:39.243189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:39.243189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:39.243189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 30 01:14:39.243189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 30 01:14:39.243189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 30 01:14:39.243189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:39.245274 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7f221fdb-80d7-4143-a4a1-7b1cdd4e7c4e tempest-AggregatesAdminNegativeTestJSON-1541830664 tempest-AggregatesAdminNegativeTestJSON-1541830664-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:14:39.246676 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7f221fdb-80d7-4143-a4a1-7b1cdd4e7c4e tempest-AggregatesAdminNegativeTestJSON-1541830664 tempest-AggregatesAdminNegativeTestJSON-1541830664-project] 10.222.0.13 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.017232 Oct 30 01:14:39.254148 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 168/317] 10.222.0.13 () {58 vars in 1143 bytes} [Sun Oct 30 01:14:39 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:14:39.260740 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e6e26377-35f4-4233-bc3e-36a1bd3c292c tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-965927626"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:39.264927 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.aggregate [None req-e6e26377-35f4-4233-bc3e-36a1bd3c292c tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Generated uuid 33e4f623-48d6-477e-9092-9dc5379a3ba9 for aggregate {{(pid=121103) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 30 01:14:39.283472 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=7,nova_api:INSERT=5 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:39.287344 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-79a8124a-9a98-4a6f-98bd-9801ed0fcfaa tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:39.288186 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-79a8124a-9a98-4a6f-98bd-9801ed0fcfaa tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:39.306720 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-79a8124a-9a98-4a6f-98bd-9801ed0fcfaa tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:39.307613 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-79a8124a-9a98-4a6f-98bd-9801ed0fcfaa tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:39.308503 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-79a8124a-9a98-4a6f-98bd-9801ed0fcfaa tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:39.309613 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-79a8124a-9a98-4a6f-98bd-9801ed0fcfaa tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:39.310208 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-79a8124a-9a98-4a6f-98bd-9801ed0fcfaa tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:39.310865 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-79a8124a-9a98-4a6f-98bd-9801ed0fcfaa tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:39.389104 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e6e26377-35f4-4233-bc3e-36a1bd3c292c tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.133958 Oct 30 01:14:39.390052 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 150/318] 10.222.0.13 () {60 vars in 1164 bytes} [Sun Oct 30 01:14:39 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:39.395178 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a3bc1f99-980b-44d0-bea1-73fd35b0f7c6 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:39.403040 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a3bc1f99-980b-44d0-bea1-73fd35b0f7c6 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 7e81dcfb-dcbe-4e05-91a4-541ff2c404ae] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:39.414595 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a3bc1f99-980b-44d0-bea1-73fd35b0f7c6 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:39.422319 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a3bc1f99-980b-44d0-bea1-73fd35b0f7c6 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:39.426832 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a3bc1f99-980b-44d0-bea1-73fd35b0f7c6 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:39.431783 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a3bc1f99-980b-44d0-bea1-73fd35b0f7c6 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:39.433362 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a3bc1f99-980b-44d0-bea1-73fd35b0f7c6 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:39.436916 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a3bc1f99-980b-44d0-bea1-73fd35b0f7c6 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:39.486841 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-79a8124a-9a98-4a6f-98bd-9801ed0fcfaa tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:39.514903 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-79a8124a-9a98-4a6f-98bd-9801ed0fcfaa tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:39.516888 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-79a8124a-9a98-4a6f-98bd-9801ed0fcfaa tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:39.531451 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-79a8124a-9a98-4a6f-98bd-9801ed0fcfaa tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] 10.222.0.13 "GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 200 len: 1446 microversion: 2.75 time: 0.249282 Oct 30 01:14:39.540790 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 169/319] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:14:39 2022] GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 1446 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:14:39.553499 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8b17c9da-6f8d-44eb-b869-58db81b0742b tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:39.582323 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b17c9da-6f8d-44eb-b869-58db81b0742b tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:39.585775 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b17c9da-6f8d-44eb-b869-58db81b0742b tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:39.588463 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b17c9da-6f8d-44eb-b869-58db81b0742b tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:39.820685 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a3bc1f99-980b-44d0-bea1-73fd35b0f7c6 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:39.838809 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a3bc1f99-980b-44d0-bea1-73fd35b0f7c6 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae" status: 200 len: 1503 microversion: 2.1 time: 0.444274 Oct 30 01:14:39.838809 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 151/320] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:39 2022] GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae => generated 1503 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:39.879216 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b3b19974-8e99-4e3c-86be-6e9926337ace tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:39.879845 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b3b19974-8e99-4e3c-86be-6e9926337ace tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] [instance: 27cf9c57-37a3-4ccb-ba37-bc66ff5423cd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:39.930386 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3b19974-8e99-4e3c-86be-6e9926337ace tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:39.934475 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3b19974-8e99-4e3c-86be-6e9926337ace tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:39.942331 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3b19974-8e99-4e3c-86be-6e9926337ace tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:39.943177 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3b19974-8e99-4e3c-86be-6e9926337ace tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:39.943663 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3b19974-8e99-4e3c-86be-6e9926337ace tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:39.944101 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3b19974-8e99-4e3c-86be-6e9926337ace tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:40.070475 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8b17c9da-6f8d-44eb-b869-58db81b0742b tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 242 microversion: 2.1 time: 0.528199 Oct 30 01:14:40.072743 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 170/321] 10.222.0.13 () {60 vars in 1194 bytes} [Sun Oct 30 01:14:39 2022] POST /compute/v2.1/os-aggregates/17/action => generated 242 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:40.088618 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d96f0465-5d3f-4f78-a466-e6630d7ba83d tempest-AggregatesAdminNegativeTestJSON-1541830664 tempest-AggregatesAdminNegativeTestJSON-1541830664-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:40.107806 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d96f0465-5d3f-4f78-a466-e6630d7ba83d tempest-AggregatesAdminNegativeTestJSON-1541830664 tempest-AggregatesAdminNegativeTestJSON-1541830664-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '3d46ad002b4d4e7b82c455ee8d2cd2ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7125ddd978584c4b8f1b196e6cc62e94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:40.112928 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d96f0465-5d3f-4f78-a466-e6630d7ba83d tempest-AggregatesAdminNegativeTestJSON-1541830664 tempest-AggregatesAdminNegativeTestJSON-1541830664-project] Request method failure captured: Oct 30 01:14:40.112928 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Oct 30 01:14:40.112928 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:14:40.112928 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:14:40.112928 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:14:40.112928 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 42 Oct 30 01:14:40.112928 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:14:40.112928 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:14:40.112928 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:14:40.112928 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:14:40.112928 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXc-0QrQiztamIwHFFvUqoa069ENcmlzmusmY9jPTcVZOQVrT1319Dw_UMMM4lDV_kMpAjIoQKPhdI31i16Tvjy-FaUnZDsALhBcTRcywK7mVXXE7nFPMU_muszKdk029GOI_MV2k3x0zTWGS8XhrpT3Cy-9OHEPtqCrneDxreS22tZU Oct 30 01:14:40.112928 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:14:40.112928 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:14:40.112928 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:14:40.112928 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:14:40.112928 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:14:40.112928 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:14:40.112928 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 7125ddd978584c4b8f1b196e6cc62e94 Oct 30 01:14:40.112928 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1541830664 Oct 30 01:14:40.112928 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:14:40.112928 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:14:40.114262 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7125ddd978584c4b8f1b196e6cc62e94"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7125ddd978584c4b8f1b196e6cc62e94"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7125ddd978584c4b8f1b196e6cc62e94"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7125ddd978584c4b8f1b196e6cc62e94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:14:40.114262 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1541830664 Oct 30 01:14:40.114262 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 7125ddd978584c4b8f1b196e6cc62e94 Oct 30 01:14:40.114262 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1541830664 Oct 30 01:14:40.114262 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-AggregatesAdminNegativeTestJSON-1541830664-project Oct 30 01:14:40.114262 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:14:40.114262 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:14:40.114262 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 3d46ad002b4d4e7b82c455ee8d2cd2ab Oct 30 01:14:40.114262 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1541830664-project Oct 30 01:14:40.114262 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:14:40.114262 n-d-master-1 devstack@n-api.service[121102]: {"remove_host": {"host": "n-h1-master-1"}} Oct 30 01:14:40.114262 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:14:40.114262 n-d-master-1 devstack@n-api.service[121102]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 30 01:14:40.115001 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h1-master-1'}}} Oct 30 01:14:40.115001 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:14:40.115001 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:40.115001 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:40.115001 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:40.115001 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:14:40.115001 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:14:40.115001 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:14:40.115001 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:14:40.115001 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:14:40.115001 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:14:40.115001 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 30 01:14:40.115001 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 30 01:14:40.115001 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 30 01:14:40.115001 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 30 01:14:40.115001 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 30 01:14:40.115001 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 30 01:14:40.115001 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 01:14:40.115001 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 30 01:14:40.116017 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 01:14:40.116017 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise self.value Oct 30 01:14:40.116017 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 30 01:14:40.116017 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 30 01:14:40.116017 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 30 01:14:40.116017 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 30 01:14:40.116017 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 30 01:14:40.116017 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 30 01:14:40.116017 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 30 01:14:40.116017 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:40.116017 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:40.116017 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:40.116017 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:40.116017 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:40.116017 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:40.116017 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 30 01:14:40.116017 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 30 01:14:40.116017 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 30 01:14:40.116017 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:14:40.122335 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d96f0465-5d3f-4f78-a466-e6630d7ba83d tempest-AggregatesAdminNegativeTestJSON-1541830664 tempest-AggregatesAdminNegativeTestJSON-1541830664-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:14:40.125165 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d96f0465-5d3f-4f78-a466-e6630d7ba83d tempest-AggregatesAdminNegativeTestJSON-1541830664 tempest-AggregatesAdminNegativeTestJSON-1541830664-project] 10.222.0.13 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.044246 Oct 30 01:14:40.128987 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 171/322] 10.222.0.13 () {60 vars in 1194 bytes} [Sun Oct 30 01:14:40 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 49 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:14:40.143061 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-598a6cd3-da9f-4476-ab9f-1fb4065716b2 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:40.170894 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-598a6cd3-da9f-4476-ab9f-1fb4065716b2 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:40.173599 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-598a6cd3-da9f-4476-ab9f-1fb4065716b2 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:40.175081 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-598a6cd3-da9f-4476-ab9f-1fb4065716b2 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:40.282510 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b3b19974-8e99-4e3c-86be-6e9926337ace tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464f9e9314154e3f9c779b9ae10b2a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a83b0b15194aa69fc4d82876a1e6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:40.299608 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b3b19974-8e99-4e3c-86be-6e9926337ace tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] 10.222.0.13 "GET /compute/v2.1/servers/27cf9c57-37a3-4ccb-ba37-bc66ff5423cd" status: 200 len: 1318 microversion: 2.1 time: 0.456966 Oct 30 01:14:40.313092 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 152/323] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:39 2022] GET /compute/v2.1/servers/27cf9c57-37a3-4ccb-ba37-bc66ff5423cd => generated 1318 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:40.313092 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-e9975225-e660-405d-b0d5-6e25e72df3ee req-058040e4-0d84-411c-94b4-431eae00e483 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e81dcfb-dcbe-4e05-91a4-541ff2c404ae", "name": "network-vif-unplugged", "status": "completed", "tag": "8c9bf831-4693-4fde-804b-2216247d9310"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:40.323043 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e9975225-e660-405d-b0d5-6e25e72df3ee req-058040e4-0d84-411c-94b4-431eae00e483 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:40.324039 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e9975225-e660-405d-b0d5-6e25e72df3ee req-058040e4-0d84-411c-94b4-431eae00e483 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:40.324661 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e9975225-e660-405d-b0d5-6e25e72df3ee req-058040e4-0d84-411c-94b4-431eae00e483 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:40.340314 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-e9975225-e660-405d-b0d5-6e25e72df3ee req-058040e4-0d84-411c-94b4-431eae00e483 service nova] Creating event network-vif-unplugged:8c9bf831-4693-4fde-804b-2216247d9310 for instance 7e81dcfb-dcbe-4e05-91a4-541ff2c404ae on n-h1-master-1 Oct 30 01:14:40.347353 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-e9975225-e660-405d-b0d5-6e25e72df3ee req-058040e4-0d84-411c-94b4-431eae00e483 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043784 Oct 30 01:14:40.354003 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 153/324] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:14:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:40.606395 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-598a6cd3-da9f-4476-ab9f-1fb4065716b2 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 227 microversion: 2.1 time: 0.472828 Oct 30 01:14:40.607223 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 172/325] 10.222.0.13 () {60 vars in 1194 bytes} [Sun Oct 30 01:14:40 2022] POST /compute/v2.1/os-aggregates/17/action => generated 227 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:40.616903 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a93cc913-dac9-4ea3-830d-720aa94053b3 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:40.617859 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a93cc913-dac9-4ea3-830d-720aa94053b3 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:40.647249 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a93cc913-dac9-4ea3-830d-720aa94053b3 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:40.650427 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a93cc913-dac9-4ea3-830d-720aa94053b3 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:40.650427 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a93cc913-dac9-4ea3-830d-720aa94053b3 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:40.650427 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a93cc913-dac9-4ea3-830d-720aa94053b3 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:40.654913 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a93cc913-dac9-4ea3-830d-720aa94053b3 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:40.655677 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a93cc913-dac9-4ea3-830d-720aa94053b3 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:40.691538 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9b3e4284-d531-44ee-b2a9-b8f418d69ed3 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-312389965", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "a3d745df-bc10-475b-bfb1-2cc9b94a14da"}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:40.772241 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-9b3e4284-d531-44ee-b2a9-b8f418d69ed3 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] validate_networks() for [('a3d745df-bc10-475b-bfb1-2cc9b94a14da', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:14:41.015516 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a93cc913-dac9-4ea3-830d-720aa94053b3 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:41.025755 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a93cc913-dac9-4ea3-830d-720aa94053b3 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:41.027508 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a93cc913-dac9-4ea3-830d-720aa94053b3 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:41.041849 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a93cc913-dac9-4ea3-830d-720aa94053b3 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] 10.222.0.13 "GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 200 len: 1446 microversion: 2.75 time: 0.433317 Oct 30 01:14:41.058667 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 173/326] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:14:40 2022] GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 1446 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:14:41.069287 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-579bf455-aa2f-4eaa-a57e-747a48af7ce6 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:41.190462 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-579bf455-aa2f-4eaa-a57e-747a48af7ce6 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.130430 Oct 30 01:14:41.191721 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 174/327] 10.222.0.13 () {58 vars in 1155 bytes} [Sun Oct 30 01:14:41 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 30 01:14:41.196630 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4d0fba42-ee1a-4783-8f94-0170ac41193a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:41.197361 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4d0fba42-ee1a-4783-8f94-0170ac41193a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 7e81dcfb-dcbe-4e05-91a4-541ff2c404ae] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:41.204375 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d0fba42-ee1a-4783-8f94-0170ac41193a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:41.205123 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d0fba42-ee1a-4783-8f94-0170ac41193a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:41.205664 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d0fba42-ee1a-4783-8f94-0170ac41193a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:41.207198 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d0fba42-ee1a-4783-8f94-0170ac41193a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:41.207904 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d0fba42-ee1a-4783-8f94-0170ac41193a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:41.208579 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d0fba42-ee1a-4783-8f94-0170ac41193a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:41.489493 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4d0fba42-ee1a-4783-8f94-0170ac41193a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:41.499684 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4d0fba42-ee1a-4783-8f94-0170ac41193a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae" status: 200 len: 1503 microversion: 2.1 time: 0.306644 Oct 30 01:14:41.500260 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 175/328] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:41 2022] GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae => generated 1503 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:41.527627 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-75cb8ee2-6fb4-4ff5-88da-da341f5b2829 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-692690836"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:41.531449 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.aggregate [None req-75cb8ee2-6fb4-4ff5-88da-da341f5b2829 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Generated uuid 2343b783-824e-4627-a678-33828d8ba925 for aggregate {{(pid=121102) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 30 01:14:41.537325 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3,nova_api:DELETE=13 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:41.560012 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-9b3e4284-d531-44ee-b2a9-b8f418d69ed3 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:14:41.560649 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-9b3e4284-d531-44ee-b2a9-b8f418d69ed3 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:14:41.561458 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-9b3e4284-d531-44ee-b2a9-b8f418d69ed3 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:14:41.561864 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-9b3e4284-d531-44ee-b2a9-b8f418d69ed3 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:14:41.562311 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-9b3e4284-d531-44ee-b2a9-b8f418d69ed3 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:14:41.573109 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9b3e4284-d531-44ee-b2a9-b8f418d69ed3 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:41.573623 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9b3e4284-d531-44ee-b2a9-b8f418d69ed3 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:41.574050 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9b3e4284-d531-44ee-b2a9-b8f418d69ed3 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:41.575056 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9b3e4284-d531-44ee-b2a9-b8f418d69ed3 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:41.575505 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9b3e4284-d531-44ee-b2a9-b8f418d69ed3 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:41.575918 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9b3e4284-d531-44ee-b2a9-b8f418d69ed3 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:41.595130 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-9b3e4284-d531-44ee-b2a9-b8f418d69ed3 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Getting quotas for project 301cee87901844ed94e635eca054960d. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:14:41.599676 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-9b3e4284-d531-44ee-b2a9-b8f418d69ed3 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Getting quotas for user 2096bbb8aff742b1837931e52ac1c9ae and project 301cee87901844ed94e635eca054960d. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:14:41.611739 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9b3e4284-d531-44ee-b2a9-b8f418d69ed3 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:14:41.614225 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9b3e4284-d531-44ee-b2a9-b8f418d69ed3 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:14:41.642891 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-75cb8ee2-6fb4-4ff5-88da-da341f5b2829 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.124445 Oct 30 01:14:41.643684 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 176/329] 10.222.0.13 () {60 vars in 1164 bytes} [Sun Oct 30 01:14:41 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:41.652612 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-401462b0-8ef3-4c7c-895e-a7af4b352127 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:41.652612 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-401462b0-8ef3-4c7c-895e-a7af4b352127 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] [instance: 27cf9c57-37a3-4ccb-ba37-bc66ff5423cd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:41.685727 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-401462b0-8ef3-4c7c-895e-a7af4b352127 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:41.686988 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-401462b0-8ef3-4c7c-895e-a7af4b352127 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:41.687862 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-401462b0-8ef3-4c7c-895e-a7af4b352127 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:41.689829 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-401462b0-8ef3-4c7c-895e-a7af4b352127 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:41.691338 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-401462b0-8ef3-4c7c-895e-a7af4b352127 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:41.692142 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-401462b0-8ef3-4c7c-895e-a7af4b352127 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:41.804413 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9b3e4284-d531-44ee-b2a9-b8f418d69ed3 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.334854 Oct 30 01:14:41.813417 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 154/330] 10.222.0.13 () {62 vars in 1188 bytes} [Sun Oct 30 01:14:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1345 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 30 01:14:41.820312 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-69e65f80-1843-4c0f-88be-02c9a78fae52 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:41.835131 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-69e65f80-1843-4c0f-88be-02c9a78fae52 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:41.835532 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-69e65f80-1843-4c0f-88be-02c9a78fae52 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:41.836148 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-69e65f80-1843-4c0f-88be-02c9a78fae52 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:41.846170 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-69e65f80-1843-4c0f-88be-02c9a78fae52 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:41.847870 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-69e65f80-1843-4c0f-88be-02c9a78fae52 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:41.848556 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-69e65f80-1843-4c0f-88be-02c9a78fae52 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:41.858042 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.compute.aggregates [None req-69e65f80-1843-4c0f-88be-02c9a78fae52 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 30 01:14:41.858908 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-69e65f80-1843-4c0f-88be-02c9a78fae52 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Oct 30 01:14:41.861422 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-69e65f80-1843-4c0f-88be-02c9a78fae52 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Request method failure captured: Oct 30 01:14:41.861422 n-d-master-1 devstack@n-api.service[121103]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Oct 30 01:14:41.861422 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:14:41.861422 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:14:41.861422 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:14:41.861422 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 42 Oct 30 01:14:41.861422 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:14:41.861422 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:14:41.861422 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:14:41.861422 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:14:41.861422 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXc-3gN2AwBYwbdvZGmSvdpdZvZwjFntCD4wstkgGcLi3wTCXZysV4KoMBsD0aD4hAu5hNeKEvgUUO20F4SRa4sY9OuAdO3gP-QlWXV6RdLo-ocB73CaT33LhTEJFJa5Trr2_XU0o08k5NzgdUTdUTgTgWLEA7ifipfA_JZVsSsUejVI Oct 30 01:14:41.861422 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:14:41.861422 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:14:41.861422 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:14:41.861422 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:14:41.861422 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:14:41.861422 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:14:41.861422 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: c63e7b7a4aef41adaa41001c0129434c Oct 30 01:14:41.861422 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1075675897 Oct 30 01:14:41.861422 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,admin,reader Oct 30 01:14:41.861422 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,admin,reader Oct 30 01:14:41.863238 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c63e7b7a4aef41adaa41001c0129434c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c63e7b7a4aef41adaa41001c0129434c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c63e7b7a4aef41adaa41001c0129434c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c63e7b7a4aef41adaa41001c0129434c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:14:41.863238 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1075675897 Oct 30 01:14:41.863238 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: c63e7b7a4aef41adaa41001c0129434c Oct 30 01:14:41.863238 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1075675897 Oct 30 01:14:41.863238 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin Oct 30 01:14:41.863238 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:14:41.863238 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:14:41.863238 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: aa3da3ec33c7409a8c0463bf64d50400 Oct 30 01:14:41.863238 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin Oct 30 01:14:41.863238 n-d-master-1 devstack@n-api.service[121103]: Oct 30 01:14:41.863238 n-d-master-1 devstack@n-api.service[121103]: {"remove_host": {"host": "nonexist_host"}} Oct 30 01:14:41.863238 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:14:41.863238 n-d-master-1 devstack@n-api.service[121103]: exception: Cannot remove host nonexist_host in aggregate 18 Oct 30 01:14:41.863979 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 30 01:14:41.863979 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:14:41.863979 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:41.863979 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 30 01:14:41.863979 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 30 01:14:41.863979 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 01:14:41.863979 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 01:14:41.863979 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 30 01:14:41.863979 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 30 01:14:41.863979 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 30 01:14:41.863979 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 30 01:14:41.863979 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 30 01:14:41.863979 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 30 01:14:41.863979 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 30 01:14:41.863979 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:41.863979 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:41.863979 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:41.863979 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:41.863979 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 30 01:14:41.863979 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 30 01:14:41.867436 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 30 01:14:41.867436 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 30 01:14:41.867436 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 30 01:14:41.867436 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:41.867436 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:41.867436 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:41.867436 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:41.867436 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 30 01:14:41.867436 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 30 01:14:41.867436 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 30 01:14:41.867436 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 30 01:14:41.867436 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 01:14:41.867436 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 30 01:14:41.867436 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 01:14:41.867436 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise self.value Oct 30 01:14:41.867436 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 30 01:14:41.867436 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 30 01:14:41.867436 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Oct 30 01:14:41.867436 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 30 01:14:41.867436 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 30 01:14:41.874813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 30 01:14:41.874813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 30 01:14:41.874813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:41.874813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:41.874813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:41.874813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:41.874813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:41.874813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:41.874813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:14:41.874813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:14:41.874813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:14:41.874813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:14:41.874813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:14:41.874813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:14:41.874813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 30 01:14:41.874813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 30 01:14:41.874813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Oct 30 01:14:41.874813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:41.874813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:41.874813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:41.874813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:41.875970 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:41.875970 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:41.875970 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:14:41.875970 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:14:41.875970 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Oct 30 01:14:41.875970 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:41.879837 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-69e65f80-1843-4c0f-88be-02c9a78fae52 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:14:41.882046 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-69e65f80-1843-4c0f-88be-02c9a78fae52 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.067202 Oct 30 01:14:41.886455 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 155/331] 10.222.0.13 () {60 vars in 1194 bytes} [Sun Oct 30 01:14:41 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:14:41.892683 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ad739435-21db-495d-adbb-299b7480e196 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:41.893546 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ad739435-21db-495d-adbb-299b7480e196 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:41.906103 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-401462b0-8ef3-4c7c-895e-a7af4b352127 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464f9e9314154e3f9c779b9ae10b2a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a83b0b15194aa69fc4d82876a1e6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:41.917089 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-401462b0-8ef3-4c7c-895e-a7af4b352127 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] 10.222.0.13 "GET /compute/v2.1/servers/27cf9c57-37a3-4ccb-ba37-bc66ff5423cd" status: 200 len: 1318 microversion: 2.1 time: 0.271472 Oct 30 01:14:41.923141 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 177/332] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:41 2022] GET /compute/v2.1/servers/27cf9c57-37a3-4ccb-ba37-bc66ff5423cd => generated 1318 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:41.937740 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-985681f1-b64d-41cb-a623-ebc61ae6e595 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:42.012942 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ad739435-21db-495d-adbb-299b7480e196 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:42.026898 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ad739435-21db-495d-adbb-299b7480e196 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:42.028136 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ad739435-21db-495d-adbb-299b7480e196 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:42.029878 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ad739435-21db-495d-adbb-299b7480e196 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3" status: 200 len: 1261 microversion: 2.25 time: 0.141998 Oct 30 01:14:42.031742 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 156/333] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:14:41 2022] GET /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3 => generated 1261 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:14:42.072540 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-985681f1-b64d-41cb-a623-ebc61ae6e595 tempest-AggregatesAdminNegativeTestJSON-1075675897 tempest-AggregatesAdminNegativeTestJSON-1075675897-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.146318 Oct 30 01:14:42.076813 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 178/334] 10.222.0.13 () {58 vars in 1155 bytes} [Sun Oct 30 01:14:41 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 30 01:14:42.078695 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b1538598-b8f8-4a4f-b1fb-01a7fb86c789 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:42.079421 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b1538598-b8f8-4a4f-b1fb-01a7fb86c789 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:42.099370 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1538598-b8f8-4a4f-b1fb-01a7fb86c789 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:42.100035 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1538598-b8f8-4a4f-b1fb-01a7fb86c789 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:42.100600 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1538598-b8f8-4a4f-b1fb-01a7fb86c789 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:42.101454 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1538598-b8f8-4a4f-b1fb-01a7fb86c789 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:42.102196 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1538598-b8f8-4a4f-b1fb-01a7fb86c789 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:42.102839 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1538598-b8f8-4a4f-b1fb-01a7fb86c789 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:42.237101 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b1538598-b8f8-4a4f-b1fb-01a7fb86c789 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:42.242486 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:42.260400 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b1538598-b8f8-4a4f-b1fb-01a7fb86c789 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:42.262262 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b1538598-b8f8-4a4f-b1fb-01a7fb86c789 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:42.277725 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b1538598-b8f8-4a4f-b1fb-01a7fb86c789 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] 10.222.0.13 "GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 200 len: 1446 microversion: 2.75 time: 0.205134 Oct 30 01:14:42.289385 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 157/335] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:14:42 2022] GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 1446 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:14:42.368500 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-50458802-9516-481c-a9b3-c4ee02d7cfb7 req-d8666c11-e544-4c2a-8c5a-b8fd2272cd83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e81dcfb-dcbe-4e05-91a4-541ff2c404ae", "tag": "8c9bf831-4693-4fde-804b-2216247d9310"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:42.380366 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-50458802-9516-481c-a9b3-c4ee02d7cfb7 req-d8666c11-e544-4c2a-8c5a-b8fd2272cd83 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:42.381071 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-50458802-9516-481c-a9b3-c4ee02d7cfb7 req-d8666c11-e544-4c2a-8c5a-b8fd2272cd83 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:42.381766 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-50458802-9516-481c-a9b3-c4ee02d7cfb7 req-d8666c11-e544-4c2a-8c5a-b8fd2272cd83 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:42.393264 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-50458802-9516-481c-a9b3-c4ee02d7cfb7 req-d8666c11-e544-4c2a-8c5a-b8fd2272cd83 service nova] Creating event network-changed:8c9bf831-4693-4fde-804b-2216247d9310 for instance 7e81dcfb-dcbe-4e05-91a4-541ff2c404ae on n-h1-master-1 Oct 30 01:14:42.398865 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-50458802-9516-481c-a9b3-c4ee02d7cfb7 req-d8666c11-e544-4c2a-8c5a-b8fd2272cd83 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033945 Oct 30 01:14:42.403984 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 179/336] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:42.523106 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e87f8ca9-5916-4864-abe5-c828303562ab tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:42.523831 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e87f8ca9-5916-4864-abe5-c828303562ab tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 7e81dcfb-dcbe-4e05-91a4-541ff2c404ae] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:42.529865 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e87f8ca9-5916-4864-abe5-c828303562ab tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:42.530647 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e87f8ca9-5916-4864-abe5-c828303562ab tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:42.531083 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e87f8ca9-5916-4864-abe5-c828303562ab tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:42.531784 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e87f8ca9-5916-4864-abe5-c828303562ab tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:42.532245 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e87f8ca9-5916-4864-abe5-c828303562ab tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:42.532662 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e87f8ca9-5916-4864-abe5-c828303562ab tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:42.770497 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e87f8ca9-5916-4864-abe5-c828303562ab tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:42.785105 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e87f8ca9-5916-4864-abe5-c828303562ab tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae" status: 200 len: 1503 microversion: 2.1 time: 0.264484 Oct 30 01:14:42.786906 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 158/337] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:42 2022] GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae => generated 1503 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:42.949224 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d03db163-6b7f-442d-ae30-c44c7459271f tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:42.965132 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d03db163-6b7f-442d-ae30-c44c7459271f tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] [instance: 27cf9c57-37a3-4ccb-ba37-bc66ff5423cd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:42.965132 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d03db163-6b7f-442d-ae30-c44c7459271f tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:42.965132 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d03db163-6b7f-442d-ae30-c44c7459271f tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:42.965132 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d03db163-6b7f-442d-ae30-c44c7459271f tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:42.965785 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d03db163-6b7f-442d-ae30-c44c7459271f tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:42.965785 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d03db163-6b7f-442d-ae30-c44c7459271f tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:42.965785 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d03db163-6b7f-442d-ae30-c44c7459271f tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:43.062891 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ac248bad-a708-40e7-9a60-f4e86897d1a5 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:43.062891 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ac248bad-a708-40e7-9a60-f4e86897d1a5 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:43.278619 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ac248bad-a708-40e7-9a60-f4e86897d1a5 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:43.292540 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ac248bad-a708-40e7-9a60-f4e86897d1a5 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:43.297041 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ac248bad-a708-40e7-9a60-f4e86897d1a5 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:43.298312 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ac248bad-a708-40e7-9a60-f4e86897d1a5 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3" status: 200 len: 1261 microversion: 2.25 time: 0.241724 Oct 30 01:14:43.301642 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 159/338] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:14:43 2022] GET /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3 => generated 1261 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:14:43.314359 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-662ace0e-15c5-436a-8ca2-5de05f6f4f68 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:43.314972 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-662ace0e-15c5-436a-8ca2-5de05f6f4f68 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:43.327083 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-662ace0e-15c5-436a-8ca2-5de05f6f4f68 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:43.332085 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-662ace0e-15c5-436a-8ca2-5de05f6f4f68 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:43.332085 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-662ace0e-15c5-436a-8ca2-5de05f6f4f68 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:43.332085 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-662ace0e-15c5-436a-8ca2-5de05f6f4f68 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:43.332085 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-662ace0e-15c5-436a-8ca2-5de05f6f4f68 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:43.332471 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-662ace0e-15c5-436a-8ca2-5de05f6f4f68 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:43.573609 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-662ace0e-15c5-436a-8ca2-5de05f6f4f68 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:43.588245 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-662ace0e-15c5-436a-8ca2-5de05f6f4f68 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:43.590084 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-662ace0e-15c5-436a-8ca2-5de05f6f4f68 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:43.591421 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d03db163-6b7f-442d-ae30-c44c7459271f tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464f9e9314154e3f9c779b9ae10b2a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a83b0b15194aa69fc4d82876a1e6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:43.602129 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-662ace0e-15c5-436a-8ca2-5de05f6f4f68 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] 10.222.0.13 "GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 200 len: 1446 microversion: 2.75 time: 0.291732 Oct 30 01:14:43.602728 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 160/339] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:14:43 2022] GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 1446 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:14:43.610492 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d03db163-6b7f-442d-ae30-c44c7459271f tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] 10.222.0.13 "GET /compute/v2.1/servers/27cf9c57-37a3-4ccb-ba37-bc66ff5423cd" status: 200 len: 1318 microversion: 2.1 time: 0.666838 Oct 30 01:14:43.612809 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 180/340] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:42 2022] GET /compute/v2.1/servers/27cf9c57-37a3-4ccb-ba37-bc66ff5423cd => generated 1318 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:43.810966 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1dc84176-ad58-454f-a411-351447a6d49e tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:43.811671 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1dc84176-ad58-454f-a411-351447a6d49e tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 7e81dcfb-dcbe-4e05-91a4-541ff2c404ae] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:43.830239 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1dc84176-ad58-454f-a411-351447a6d49e tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:43.831109 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1dc84176-ad58-454f-a411-351447a6d49e tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:43.831697 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1dc84176-ad58-454f-a411-351447a6d49e tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:43.832485 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1dc84176-ad58-454f-a411-351447a6d49e tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:43.833033 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1dc84176-ad58-454f-a411-351447a6d49e tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:43.833565 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1dc84176-ad58-454f-a411-351447a6d49e tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:44.199680 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1dc84176-ad58-454f-a411-351447a6d49e tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:44.210594 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1dc84176-ad58-454f-a411-351447a6d49e tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae" status: 200 len: 1503 microversion: 2.1 time: 0.403986 Oct 30 01:14:44.211464 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 161/341] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:43 2022] GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae => generated 1503 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:14:44.326455 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-091ea447-0f05-404e-ad82-b357f4347ebb tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:44.327274 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-091ea447-0f05-404e-ad82-b357f4347ebb tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:44.336013 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-091ea447-0f05-404e-ad82-b357f4347ebb tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:44.338533 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-091ea447-0f05-404e-ad82-b357f4347ebb tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:44.338986 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-091ea447-0f05-404e-ad82-b357f4347ebb tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:44.339746 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-091ea447-0f05-404e-ad82-b357f4347ebb tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:44.340212 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-091ea447-0f05-404e-ad82-b357f4347ebb tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:44.340642 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-091ea447-0f05-404e-ad82-b357f4347ebb tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:44.427138 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-091ea447-0f05-404e-ad82-b357f4347ebb tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:44.446105 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-091ea447-0f05-404e-ad82-b357f4347ebb tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:44.448677 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-091ea447-0f05-404e-ad82-b357f4347ebb tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:44.449989 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-091ea447-0f05-404e-ad82-b357f4347ebb tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3" status: 200 len: 1257 microversion: 2.25 time: 0.129776 Oct 30 01:14:44.450941 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 181/342] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:14:44 2022] GET /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3 => generated 1257 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:14:44.635000 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-71ffc00d-46b0-4470-afc7-6c70ea5f119e tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:44.635000 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-71ffc00d-46b0-4470-afc7-6c70ea5f119e tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:44.650550 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-69f90fd3-9a31-4a02-a950-c46759322e99 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:44.651309 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-69f90fd3-9a31-4a02-a950-c46759322e99 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] [instance: 27cf9c57-37a3-4ccb-ba37-bc66ff5423cd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:44.664417 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-71ffc00d-46b0-4470-afc7-6c70ea5f119e tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:44.664761 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-71ffc00d-46b0-4470-afc7-6c70ea5f119e tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:44.665163 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-71ffc00d-46b0-4470-afc7-6c70ea5f119e tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:44.665948 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-71ffc00d-46b0-4470-afc7-6c70ea5f119e tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:44.666395 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-71ffc00d-46b0-4470-afc7-6c70ea5f119e tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:44.666840 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-71ffc00d-46b0-4470-afc7-6c70ea5f119e tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:44.670642 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-69f90fd3-9a31-4a02-a950-c46759322e99 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:44.671247 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-69f90fd3-9a31-4a02-a950-c46759322e99 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:44.671679 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-69f90fd3-9a31-4a02-a950-c46759322e99 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:44.672413 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-69f90fd3-9a31-4a02-a950-c46759322e99 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:44.673712 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-69f90fd3-9a31-4a02-a950-c46759322e99 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:44.673712 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-69f90fd3-9a31-4a02-a950-c46759322e99 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:44.781793 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-71ffc00d-46b0-4470-afc7-6c70ea5f119e tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:44.796242 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-71ffc00d-46b0-4470-afc7-6c70ea5f119e tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:44.797765 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-71ffc00d-46b0-4470-afc7-6c70ea5f119e tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:44.803552 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-71ffc00d-46b0-4470-afc7-6c70ea5f119e tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] 10.222.0.13 "GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 200 len: 1446 microversion: 2.75 time: 0.173985 Oct 30 01:14:44.804139 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 162/343] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:14:44 2022] GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 1446 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:14:44.853624 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-69f90fd3-9a31-4a02-a950-c46759322e99 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464f9e9314154e3f9c779b9ae10b2a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a83b0b15194aa69fc4d82876a1e6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:44.861392 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-69f90fd3-9a31-4a02-a950-c46759322e99 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] 10.222.0.13 "GET /compute/v2.1/servers/27cf9c57-37a3-4ccb-ba37-bc66ff5423cd" status: 200 len: 1318 microversion: 2.1 time: 0.225075 Oct 30 01:14:44.862226 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 182/344] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:44 2022] GET /compute/v2.1/servers/27cf9c57-37a3-4ccb-ba37-bc66ff5423cd => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:14:45.149097 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-6315dcf3-9bae-4b14-8835-3bd1ef1b6724 req-33ce1873-843b-48c3-89ee-a736784de7dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27cf9c57-37a3-4ccb-ba37-bc66ff5423cd", "name": "network-vif-plugged", "status": "completed", "tag": "adfffed5-4e4a-44f0-bcb3-49442b742c2a"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:45.158716 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-6315dcf3-9bae-4b14-8835-3bd1ef1b6724 req-33ce1873-843b-48c3-89ee-a736784de7dc service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:45.159550 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-6315dcf3-9bae-4b14-8835-3bd1ef1b6724 req-33ce1873-843b-48c3-89ee-a736784de7dc service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:45.159667 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-6315dcf3-9bae-4b14-8835-3bd1ef1b6724 req-33ce1873-843b-48c3-89ee-a736784de7dc service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:45.172457 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-6315dcf3-9bae-4b14-8835-3bd1ef1b6724 req-33ce1873-843b-48c3-89ee-a736784de7dc service nova] Creating event network-vif-plugged:adfffed5-4e4a-44f0-bcb3-49442b742c2a for instance 27cf9c57-37a3-4ccb-ba37-bc66ff5423cd on n-h1-master-1 Oct 30 01:14:45.180814 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-6315dcf3-9bae-4b14-8835-3bd1ef1b6724 req-33ce1873-843b-48c3-89ee-a736784de7dc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034942 Oct 30 01:14:45.181584 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 183/345] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:14:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:14:45.248370 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3d6c872c-0c3b-46bf-892c-55c0318b5c8a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:45.250466 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3d6c872c-0c3b-46bf-892c-55c0318b5c8a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 7e81dcfb-dcbe-4e05-91a4-541ff2c404ae] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:45.260593 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d6c872c-0c3b-46bf-892c-55c0318b5c8a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:45.263087 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d6c872c-0c3b-46bf-892c-55c0318b5c8a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:45.265205 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d6c872c-0c3b-46bf-892c-55c0318b5c8a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:45.266367 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d6c872c-0c3b-46bf-892c-55c0318b5c8a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:45.267218 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d6c872c-0c3b-46bf-892c-55c0318b5c8a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:45.270518 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d6c872c-0c3b-46bf-892c-55c0318b5c8a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:45.445015 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5eebf554-9c80-48cd-b39e-c28ef65b2a8f tempest-FlavorsExtraSpecsTestJSON-161298033 tempest-FlavorsExtraSpecsTestJSON-161298033-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1077119562", "ram": 512, "vcpus": 1, "disk": 10, "id": 7454971, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:45.550509 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5eebf554-9c80-48cd-b39e-c28ef65b2a8f tempest-FlavorsExtraSpecsTestJSON-161298033 tempest-FlavorsExtraSpecsTestJSON-161298033-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.1 time: 0.571984 Oct 30 01:14:45.551631 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 163/346] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:14:44 2022] POST /compute/v2.1/flavors => generated 407 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:45.558282 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3f8ca98d-cd61-4885-a897-506c7064b2a4 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:45.566109 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3f8ca98d-cd61-4885-a897-506c7064b2a4 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:45.578129 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f8ca98d-cd61-4885-a897-506c7064b2a4 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:45.580021 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f8ca98d-cd61-4885-a897-506c7064b2a4 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:45.583220 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3d6c872c-0c3b-46bf-892c-55c0318b5c8a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:45.589581 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f8ca98d-cd61-4885-a897-506c7064b2a4 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:45.589581 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f8ca98d-cd61-4885-a897-506c7064b2a4 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:45.589581 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f8ca98d-cd61-4885-a897-506c7064b2a4 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:45.589581 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f8ca98d-cd61-4885-a897-506c7064b2a4 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:45.594418 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:45.599329 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3d6c872c-0c3b-46bf-892c-55c0318b5c8a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae" status: 200 len: 1503 microversion: 2.1 time: 0.367077 Oct 30 01:14:45.613712 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 184/347] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:45 2022] GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae => generated 1503 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:45.627506 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a04902b9-6523-48ab-843b-d81544352778 tempest-FlavorsExtraSpecsTestJSON-161298033 tempest-FlavorsExtraSpecsTestJSON-161298033-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:45.745842 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3f8ca98d-cd61-4885-a897-506c7064b2a4 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:45.747603 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a04902b9-6523-48ab-843b-d81544352778 tempest-FlavorsExtraSpecsTestJSON-161298033 tempest-FlavorsExtraSpecsTestJSON-161298033-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/7454971/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.130731 Oct 30 01:14:45.752557 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 185/348] 10.222.0.13 () {60 vars in 1215 bytes} [Sun Oct 30 01:14:45 2022] POST /compute/v2.1/flavors/7454971/os-extra_specs => generated 66 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:14:45.761549 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3f8ca98d-cd61-4885-a897-506c7064b2a4 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:45.764328 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3f8ca98d-cd61-4885-a897-506c7064b2a4 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:45.767291 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3f8ca98d-cd61-4885-a897-506c7064b2a4 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3" status: 200 len: 1321 microversion: 2.25 time: 0.213218 Oct 30 01:14:45.767871 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 164/349] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:14:45 2022] GET /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3 => generated 1321 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:14:45.834167 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-50c69f62-7058-40cc-bb47-3b22373b106d tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:45.834167 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-50c69f62-7058-40cc-bb47-3b22373b106d tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:45.846469 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-50c69f62-7058-40cc-bb47-3b22373b106d tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:45.848846 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-50c69f62-7058-40cc-bb47-3b22373b106d tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:45.848846 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-50c69f62-7058-40cc-bb47-3b22373b106d tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:45.851131 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-50c69f62-7058-40cc-bb47-3b22373b106d tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:45.851925 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-50c69f62-7058-40cc-bb47-3b22373b106d tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:45.852668 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-50c69f62-7058-40cc-bb47-3b22373b106d tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:46.016536 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-50c69f62-7058-40cc-bb47-3b22373b106d tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:46.034970 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-50c69f62-7058-40cc-bb47-3b22373b106d tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:46.042438 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-50c69f62-7058-40cc-bb47-3b22373b106d tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:46.055114 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-50c69f62-7058-40cc-bb47-3b22373b106d tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] 10.222.0.13 "GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 200 len: 1446 microversion: 2.75 time: 0.226814 Oct 30 01:14:46.059731 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 165/350] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:14:45 2022] GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 1446 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:14:46.072970 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-acceb9e0-77da-41d4-ae44-6c63583d8079 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:46.073628 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-acceb9e0-77da-41d4-ae44-6c63583d8079 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] [instance: 27cf9c57-37a3-4ccb-ba37-bc66ff5423cd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:46.095623 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-acceb9e0-77da-41d4-ae44-6c63583d8079 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:46.101561 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-acceb9e0-77da-41d4-ae44-6c63583d8079 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:46.102442 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-acceb9e0-77da-41d4-ae44-6c63583d8079 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:46.103810 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-acceb9e0-77da-41d4-ae44-6c63583d8079 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:46.105439 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-acceb9e0-77da-41d4-ae44-6c63583d8079 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:46.106630 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-acceb9e0-77da-41d4-ae44-6c63583d8079 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:46.142958 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2aa44823-cb3c-440d-a661-ac379cea8a47 tempest-FlavorsExtraSpecsTestJSON-881355738 tempest-FlavorsExtraSpecsTestJSON-881355738-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:46.147942 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=22 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:46.164252 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2aa44823-cb3c-440d-a661-ac379cea8a47 tempest-FlavorsExtraSpecsTestJSON-881355738 tempest-FlavorsExtraSpecsTestJSON-881355738-project] 10.222.0.13 "GET /compute/v2.1/flavors/7454971/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.410306 Oct 30 01:14:46.170786 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 186/351] 10.222.0.13 () {58 vars in 1194 bytes} [Sun Oct 30 01:14:45 2022] GET /compute/v2.1/flavors/7454971/os-extra_specs => generated 66 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:14:46.177131 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-48a34880-7a18-48b3-820f-5491e415b76c tempest-FlavorsExtraSpecsTestJSON-161298033 tempest-FlavorsExtraSpecsTestJSON-161298033-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:46.215271 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-48a34880-7a18-48b3-820f-5491e415b76c tempest-FlavorsExtraSpecsTestJSON-161298033 tempest-FlavorsExtraSpecsTestJSON-161298033-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/7454971/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.043264 Oct 30 01:14:46.221101 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 187/352] 10.222.0.13 () {60 vars in 1215 bytes} [Sun Oct 30 01:14:46 2022] POST /compute/v2.1/flavors/7454971/os-extra_specs => generated 66 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:14:46.227344 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-388f9a09-7c7b-4663-983b-8ea4bc485c43 tempest-FlavorsExtraSpecsTestJSON-881355738 tempest-FlavorsExtraSpecsTestJSON-881355738-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:46.239438 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-388f9a09-7c7b-4663-983b-8ea4bc485c43 tempest-FlavorsExtraSpecsTestJSON-881355738 tempest-FlavorsExtraSpecsTestJSON-881355738-project] 10.222.0.13 "GET /compute/v2.1/flavors/7454971/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.016580 Oct 30 01:14:46.245940 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 188/353] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:46 2022] GET /compute/v2.1/flavors/7454971/os-extra_specs/hw:numa_nodes => generated 22 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:14:46.251291 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ef919168-4057-410b-9730-386c47cafac2 tempest-FlavorsExtraSpecsTestJSON-161298033 tempest-FlavorsExtraSpecsTestJSON-161298033-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:46.287899 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ef919168-4057-410b-9730-386c47cafac2 tempest-FlavorsExtraSpecsTestJSON-161298033 tempest-FlavorsExtraSpecsTestJSON-161298033-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/7454971/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.040534 Oct 30 01:14:46.293620 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 189/354] 10.222.0.13 () {60 vars in 1215 bytes} [Sun Oct 30 01:14:46 2022] POST /compute/v2.1/flavors/7454971/os-extra_specs => generated 66 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:14:46.298722 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9b3531ec-1ee5-4bad-b106-5661438aa196 tempest-FlavorsExtraSpecsTestJSON-161298033 tempest-FlavorsExtraSpecsTestJSON-161298033-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:46.308462 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9b3531ec-1ee5-4bad-b106-5661438aa196 tempest-FlavorsExtraSpecsTestJSON-161298033 tempest-FlavorsExtraSpecsTestJSON-161298033-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/7454971/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.013297 Oct 30 01:14:46.309382 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 190/355] 10.222.0.13 () {58 vars in 1194 bytes} [Sun Oct 30 01:14:46 2022] GET /compute/v2.1/flavors/7454971/os-extra_specs => generated 66 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:14:46.321308 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5f43edec-77f7-4ece-a492-09c9c537b42d tempest-FlavorsExtraSpecsTestJSON-161298033 tempest-FlavorsExtraSpecsTestJSON-161298033-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:46.342417 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-acceb9e0-77da-41d4-ae44-6c63583d8079 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464f9e9314154e3f9c779b9ae10b2a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a83b0b15194aa69fc4d82876a1e6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:46.351825 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-acceb9e0-77da-41d4-ae44-6c63583d8079 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] 10.222.0.13 "GET /compute/v2.1/servers/27cf9c57-37a3-4ccb-ba37-bc66ff5423cd" status: 200 len: 1318 microversion: 2.1 time: 0.290584 Oct 30 01:14:46.353095 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 166/356] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:46 2022] GET /compute/v2.1/servers/27cf9c57-37a3-4ccb-ba37-bc66ff5423cd => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:46.497142 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5f43edec-77f7-4ece-a492-09c9c537b42d tempest-FlavorsExtraSpecsTestJSON-161298033 tempest-FlavorsExtraSpecsTestJSON-161298033-project-admin] 10.222.0.13 "PUT /compute/v2.1/flavors/7454971/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.178955 Oct 30 01:14:46.497142 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 191/357] 10.222.0.13 () {60 vars in 1256 bytes} [Sun Oct 30 01:14:46 2022] PUT /compute/v2.1/flavors/7454971/os-extra_specs/hw:numa_nodes => generated 22 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:14:46.508341 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-41f6b014-40dd-49e6-8c63-1cf5b85764ee tempest-FlavorsExtraSpecsTestJSON-161298033 tempest-FlavorsExtraSpecsTestJSON-161298033-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:46.521605 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-41f6b014-40dd-49e6-8c63-1cf5b85764ee tempest-FlavorsExtraSpecsTestJSON-161298033 tempest-FlavorsExtraSpecsTestJSON-161298033-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/7454971/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.018668 Oct 30 01:14:46.522277 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 167/358] 10.222.0.13 () {58 vars in 1194 bytes} [Sun Oct 30 01:14:46 2022] GET /compute/v2.1/flavors/7454971/os-extra_specs => generated 66 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 30 01:14:46.533260 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5a9e3788-5638-40ce-83b6-e1e82b59698d tempest-FlavorsExtraSpecsTestJSON-161298033 tempest-FlavorsExtraSpecsTestJSON-161298033-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:46.651587 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5a9e3788-5638-40ce-83b6-e1e82b59698d tempest-FlavorsExtraSpecsTestJSON-161298033 tempest-FlavorsExtraSpecsTestJSON-161298033-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/7454971/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.121973 Oct 30 01:14:46.652344 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 168/359] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:14:46 2022] DELETE /compute/v2.1/flavors/7454971/os-extra_specs/hw:numa_nodes => generated 0 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 30 01:14:46.657570 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-36cc805f-696e-47d3-a3b1-6057b9b7eca1 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:46.658237 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-36cc805f-696e-47d3-a3b1-6057b9b7eca1 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 7e81dcfb-dcbe-4e05-91a4-541ff2c404ae] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:46.663588 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d8fcd52b-4e86-43f1-ac8e-e2c6744aa326 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-64250098", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:46.664217 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-36cc805f-696e-47d3-a3b1-6057b9b7eca1 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:46.664698 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-36cc805f-696e-47d3-a3b1-6057b9b7eca1 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:46.665124 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-36cc805f-696e-47d3-a3b1-6057b9b7eca1 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:46.665988 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-36cc805f-696e-47d3-a3b1-6057b9b7eca1 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:46.666435 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-36cc805f-696e-47d3-a3b1-6057b9b7eca1 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:46.666848 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-36cc805f-696e-47d3-a3b1-6057b9b7eca1 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:46.742009 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-d8fcd52b-4e86-43f1-ac8e-e2c6744aa326 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] validate_networks() for None {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:14:46.975312 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-36cc805f-696e-47d3-a3b1-6057b9b7eca1 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:46.985176 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-36cc805f-696e-47d3-a3b1-6057b9b7eca1 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae" status: 200 len: 1503 microversion: 2.1 time: 0.331425 Oct 30 01:14:46.986648 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 169/360] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:46 2022] GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae => generated 1503 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:47.009111 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ed3cab1c-3869-4453-ace5-8e87c6ce9eef tempest-FlavorsExtraSpecsTestJSON-161298033 tempest-FlavorsExtraSpecsTestJSON-161298033-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:47.090965 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-d8fcd52b-4e86-43f1-ac8e-e2c6744aa326 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:14:47.091584 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-d8fcd52b-4e86-43f1-ac8e-e2c6744aa326 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:14:47.091989 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-d8fcd52b-4e86-43f1-ac8e-e2c6744aa326 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:14:47.092466 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-d8fcd52b-4e86-43f1-ac8e-e2c6744aa326 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:14:47.092787 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-d8fcd52b-4e86-43f1-ac8e-e2c6744aa326 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:14:47.103138 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8fcd52b-4e86-43f1-ac8e-e2c6744aa326 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:47.103614 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8fcd52b-4e86-43f1-ac8e-e2c6744aa326 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:47.104060 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8fcd52b-4e86-43f1-ac8e-e2c6744aa326 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:47.105763 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8fcd52b-4e86-43f1-ac8e-e2c6744aa326 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:47.106328 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8fcd52b-4e86-43f1-ac8e-e2c6744aa326 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:47.106699 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8fcd52b-4e86-43f1-ac8e-e2c6744aa326 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:47.106971 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ed3cab1c-3869-4453-ace5-8e87c6ce9eef tempest-FlavorsExtraSpecsTestJSON-161298033 tempest-FlavorsExtraSpecsTestJSON-161298033-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/7454971/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.117873 Oct 30 01:14:47.107967 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 170/361] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:14:46 2022] DELETE /compute/v2.1/flavors/7454971/os-extra_specs/hw:cpu_policy => generated 0 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 30 01:14:47.115761 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3a6cabdc-2bf1-4bec-9e95-385d1f2dbf35 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:47.120862 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3a6cabdc-2bf1-4bec-9e95-385d1f2dbf35 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:47.128757 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3a6cabdc-2bf1-4bec-9e95-385d1f2dbf35 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:47.129267 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3a6cabdc-2bf1-4bec-9e95-385d1f2dbf35 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:47.129724 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3a6cabdc-2bf1-4bec-9e95-385d1f2dbf35 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:47.130825 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3a6cabdc-2bf1-4bec-9e95-385d1f2dbf35 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:47.131443 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3a6cabdc-2bf1-4bec-9e95-385d1f2dbf35 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:47.132024 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3a6cabdc-2bf1-4bec-9e95-385d1f2dbf35 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:47.136648 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-d8fcd52b-4e86-43f1-ac8e-e2c6744aa326 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Getting quotas for project 3ee1e04c04bc40568e43eb98df39e7e6. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:14:47.144584 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-d8fcd52b-4e86-43f1-ac8e-e2c6744aa326 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Getting quotas for user 51ccc0bfdee94961aa198e3abf0d85cc and project 3ee1e04c04bc40568e43eb98df39e7e6. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:14:47.162191 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d8fcd52b-4e86-43f1-ac8e-e2c6744aa326 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:14:47.165765 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d8fcd52b-4e86-43f1-ac8e-e2c6744aa326 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] [instance: 4f47f49f-e5a9-46d5-9622-c9c887891646] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:14:47.280121 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3a6cabdc-2bf1-4bec-9e95-385d1f2dbf35 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:47.289316 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3a6cabdc-2bf1-4bec-9e95-385d1f2dbf35 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:47.291101 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3a6cabdc-2bf1-4bec-9e95-385d1f2dbf35 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:47.292366 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3a6cabdc-2bf1-4bec-9e95-385d1f2dbf35 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3" status: 200 len: 1361 microversion: 2.25 time: 0.183361 Oct 30 01:14:47.296287 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 171/362] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:14:47 2022] GET /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3 => generated 1361 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:14:47.300962 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b95de68c-819c-4b4b-af76-c1ac34a837fd tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:47.301625 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b95de68c-819c-4b4b-af76-c1ac34a837fd tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:47.309085 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b95de68c-819c-4b4b-af76-c1ac34a837fd tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:47.309852 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b95de68c-819c-4b4b-af76-c1ac34a837fd tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:47.310468 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b95de68c-819c-4b4b-af76-c1ac34a837fd tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:47.311332 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b95de68c-819c-4b4b-af76-c1ac34a837fd tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:47.311943 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b95de68c-819c-4b4b-af76-c1ac34a837fd tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:47.312536 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b95de68c-819c-4b4b-af76-c1ac34a837fd tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:47.344491 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d8fcd52b-4e86-43f1-ac8e-e2c6744aa326 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.820407 Oct 30 01:14:47.345143 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 192/363] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:14:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 822 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:14:47.354414 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a41671ef-b7a5-4cf5-bbd1-07174bbd1756 tempest-FlavorsExtraSpecsTestJSON-161298033 tempest-FlavorsExtraSpecsTestJSON-161298033-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:47.367796 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a41671ef-b7a5-4cf5-bbd1-07174bbd1756 tempest-FlavorsExtraSpecsTestJSON-161298033 tempest-FlavorsExtraSpecsTestJSON-161298033-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/7454971/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.016855 Oct 30 01:14:47.369192 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 193/364] 10.222.0.13 () {58 vars in 1194 bytes} [Sun Oct 30 01:14:47 2022] GET /compute/v2.1/flavors/7454971/os-extra_specs => generated 19 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:14:47.376575 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b0c346b1-73c7-4d3e-aa4f-75f01f5386cb tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:47.377514 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b0c346b1-73c7-4d3e-aa4f-75f01f5386cb tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] [instance: 4f47f49f-e5a9-46d5-9622-c9c887891646] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:47.393494 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b95de68c-819c-4b4b-af76-c1ac34a837fd tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:47.403572 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b95de68c-819c-4b4b-af76-c1ac34a837fd tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:47.405480 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b95de68c-819c-4b4b-af76-c1ac34a837fd tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:47.413235 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b95de68c-819c-4b4b-af76-c1ac34a837fd tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] 10.222.0.13 "GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 200 len: 1446 microversion: 2.75 time: 0.118247 Oct 30 01:14:47.413950 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 172/365] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:14:47 2022] GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 1446 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:14:47.418949 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4560b30f-e496-4fdf-acbc-862cd9f73883 tempest-FlavorsExtraSpecsTestJSON-161298033 tempest-FlavorsExtraSpecsTestJSON-161298033-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:47.432546 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4,nova_api:SAVEPOINT=1,nova_api:RELEASE=1,nova_api:DELETE=4 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:47.457741 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b0c346b1-73c7-4d3e-aa4f-75f01f5386cb tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ccc0bfdee94961aa198e3abf0d85cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee1e04c04bc40568e43eb98df39e7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:47.464830 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b0c346b1-73c7-4d3e-aa4f-75f01f5386cb tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] 10.222.0.13 "GET /compute/v2.1/servers/4f47f49f-e5a9-46d5-9622-c9c887891646" status: 200 len: 1220 microversion: 2.1 time: 0.094061 Oct 30 01:14:47.466039 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 194/366] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:47 2022] GET /compute/v2.1/servers/4f47f49f-e5a9-46d5-9622-c9c887891646 => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:47.473225 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-16d561ea-809e-4740-83da-d03cdad94911 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:47.474444 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-16d561ea-809e-4740-83da-d03cdad94911 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] [instance: 27cf9c57-37a3-4ccb-ba37-bc66ff5423cd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:47.486775 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-16d561ea-809e-4740-83da-d03cdad94911 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:47.486775 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-16d561ea-809e-4740-83da-d03cdad94911 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:47.486775 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-16d561ea-809e-4740-83da-d03cdad94911 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:47.486775 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-16d561ea-809e-4740-83da-d03cdad94911 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:47.487240 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-16d561ea-809e-4740-83da-d03cdad94911 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:47.487708 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-16d561ea-809e-4740-83da-d03cdad94911 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:47.536373 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4560b30f-e496-4fdf-acbc-862cd9f73883 tempest-FlavorsExtraSpecsTestJSON-161298033 tempest-FlavorsExtraSpecsTestJSON-161298033-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/7454971" status: 202 len: 0 microversion: 2.1 time: 0.109121 Oct 30 01:14:47.536373 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 173/367] 10.222.0.13 () {58 vars in 1152 bytes} [Sun Oct 30 01:14:47 2022] DELETE /compute/v2.1/flavors/7454971 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:14:47.536373 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fa8f4d9f-8318-4836-9d6e-3d88be53b967 tempest-FlavorsExtraSpecsTestJSON-161298033 tempest-FlavorsExtraSpecsTestJSON-161298033-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:47.574546 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fa8f4d9f-8318-4836-9d6e-3d88be53b967 tempest-FlavorsExtraSpecsTestJSON-161298033 tempest-FlavorsExtraSpecsTestJSON-161298033-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.043741 Oct 30 01:14:47.575871 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 174/368] 10.222.0.13 () {58 vars in 1146 bytes} [Sun Oct 30 01:14:47 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:47.662965 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-16d561ea-809e-4740-83da-d03cdad94911 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464f9e9314154e3f9c779b9ae10b2a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a83b0b15194aa69fc4d82876a1e6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:47.674941 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-16d561ea-809e-4740-83da-d03cdad94911 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] 10.222.0.13 "GET /compute/v2.1/servers/27cf9c57-37a3-4ccb-ba37-bc66ff5423cd" status: 200 len: 1467 microversion: 2.1 time: 0.207647 Oct 30 01:14:47.675624 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 195/369] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:47 2022] GET /compute/v2.1/servers/27cf9c57-37a3-4ccb-ba37-bc66ff5423cd => generated 1467 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:47.701546 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-dd7521e3-8238-4653-85b9-66f6c87f6f39 tempest-LiveMigrationNegativeTest-108718090 tempest-LiveMigrationNegativeTest-108718090-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:47.702671 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-dd7521e3-8238-4653-85b9-66f6c87f6f39 tempest-LiveMigrationNegativeTest-108718090 tempest-LiveMigrationNegativeTest-108718090-project-admin] [instance: 27cf9c57-37a3-4ccb-ba37-bc66ff5423cd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:47.710902 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dd7521e3-8238-4653-85b9-66f6c87f6f39 tempest-LiveMigrationNegativeTest-108718090 tempest-LiveMigrationNegativeTest-108718090-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:47.711643 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dd7521e3-8238-4653-85b9-66f6c87f6f39 tempest-LiveMigrationNegativeTest-108718090 tempest-LiveMigrationNegativeTest-108718090-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:47.712270 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dd7521e3-8238-4653-85b9-66f6c87f6f39 tempest-LiveMigrationNegativeTest-108718090 tempest-LiveMigrationNegativeTest-108718090-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:47.713410 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dd7521e3-8238-4653-85b9-66f6c87f6f39 tempest-LiveMigrationNegativeTest-108718090 tempest-LiveMigrationNegativeTest-108718090-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:47.714021 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dd7521e3-8238-4653-85b9-66f6c87f6f39 tempest-LiveMigrationNegativeTest-108718090 tempest-LiveMigrationNegativeTest-108718090-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:47.715261 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dd7521e3-8238-4653-85b9-66f6c87f6f39 tempest-LiveMigrationNegativeTest-108718090 tempest-LiveMigrationNegativeTest-108718090-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:47.763793 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-dd7521e3-8238-4653-85b9-66f6c87f6f39 tempest-LiveMigrationNegativeTest-108718090 tempest-LiveMigrationNegativeTest-108718090-project-admin] Lazy-loading 'flavor' on Instance uuid 27cf9c57-37a3-4ccb-ba37-bc66ff5423cd {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:14:48.009883 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b8914a3f-268e-4bad-b539-3bc336e9f861 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:48.010490 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b8914a3f-268e-4bad-b539-3bc336e9f861 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 7e81dcfb-dcbe-4e05-91a4-541ff2c404ae] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:48.025608 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b8914a3f-268e-4bad-b539-3bc336e9f861 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:48.026440 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b8914a3f-268e-4bad-b539-3bc336e9f861 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:48.028591 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b8914a3f-268e-4bad-b539-3bc336e9f861 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:48.030260 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b8914a3f-268e-4bad-b539-3bc336e9f861 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:48.032251 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b8914a3f-268e-4bad-b539-3bc336e9f861 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:48.032869 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b8914a3f-268e-4bad-b539-3bc336e9f861 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:48.103146 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=75,nova_api:DELETE=2,nova_api:SAVEPOINT=8,nova_api:RELEASE=8,nova_api:UPDATE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:48.163135 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-dd7521e3-8238-4653-85b9-66f6c87f6f39 tempest-LiveMigrationNegativeTest-108718090 tempest-LiveMigrationNegativeTest-108718090-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/27cf9c57-37a3-4ccb-ba37-bc66ff5423cd/action" status: 202 len: 0 microversion: 2.1 time: 0.466974 Oct 30 01:14:48.164220 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 175/370] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:14:47 2022] POST /compute/v2.1/servers/27cf9c57-37a3-4ccb-ba37-bc66ff5423cd/action => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:14:48.169795 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-93360156-0f92-403d-b9eb-cc43dd4de0a4 req-44f9347d-e28b-4309-affb-f8412dfeb98e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3", "tag": "158902f2-0cf8-4485-a0b9-8ba513a59715"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:48.228116 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-93360156-0f92-403d-b9eb-cc43dd4de0a4 req-44f9347d-e28b-4309-affb-f8412dfeb98e service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:48.229182 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-93360156-0f92-403d-b9eb-cc43dd4de0a4 req-44f9347d-e28b-4309-affb-f8412dfeb98e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:48.230353 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-93360156-0f92-403d-b9eb-cc43dd4de0a4 req-44f9347d-e28b-4309-affb-f8412dfeb98e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:48.252231 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-93360156-0f92-403d-b9eb-cc43dd4de0a4 req-44f9347d-e28b-4309-affb-f8412dfeb98e service nova] Creating event network-changed:158902f2-0cf8-4485-a0b9-8ba513a59715 for instance 6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3 on n-h2-master-1 Oct 30 01:14:48.262485 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-93360156-0f92-403d-b9eb-cc43dd4de0a4 req-44f9347d-e28b-4309-affb-f8412dfeb98e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096558 Oct 30 01:14:48.263700 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 176/371] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:48.269952 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f3fa19ad-fcd7-4d9a-8a6a-0e9577aa216d tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:48.270910 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f3fa19ad-fcd7-4d9a-8a6a-0e9577aa216d tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] [instance: 27cf9c57-37a3-4ccb-ba37-bc66ff5423cd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:48.277672 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f3fa19ad-fcd7-4d9a-8a6a-0e9577aa216d tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:48.286412 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f3fa19ad-fcd7-4d9a-8a6a-0e9577aa216d tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:48.286412 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f3fa19ad-fcd7-4d9a-8a6a-0e9577aa216d tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:48.286412 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f3fa19ad-fcd7-4d9a-8a6a-0e9577aa216d tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:48.286412 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f3fa19ad-fcd7-4d9a-8a6a-0e9577aa216d tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:48.286732 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f3fa19ad-fcd7-4d9a-8a6a-0e9577aa216d tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:48.369736 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b8914a3f-268e-4bad-b539-3bc336e9f861 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:48.383066 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b8914a3f-268e-4bad-b539-3bc336e9f861 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae" status: 200 len: 1503 microversion: 2.1 time: 0.377028 Oct 30 01:14:48.383715 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 196/372] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:48 2022] GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae => generated 1503 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:14:48.390913 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6d75544e-879e-4a13-aad0-018e5379766b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:48.391739 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6d75544e-879e-4a13-aad0-018e5379766b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:48.401993 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d75544e-879e-4a13-aad0-018e5379766b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:48.404584 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d75544e-879e-4a13-aad0-018e5379766b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:48.404584 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d75544e-879e-4a13-aad0-018e5379766b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:48.404584 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d75544e-879e-4a13-aad0-018e5379766b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:48.404584 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d75544e-879e-4a13-aad0-018e5379766b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:48.407001 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d75544e-879e-4a13-aad0-018e5379766b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:48.898094 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f3fa19ad-fcd7-4d9a-8a6a-0e9577aa216d tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464f9e9314154e3f9c779b9ae10b2a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a83b0b15194aa69fc4d82876a1e6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:48.906118 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f3fa19ad-fcd7-4d9a-8a6a-0e9577aa216d tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] 10.222.0.13 "GET /compute/v2.1/servers/27cf9c57-37a3-4ccb-ba37-bc66ff5423cd" status: 200 len: 1475 microversion: 2.1 time: 0.641053 Oct 30 01:14:48.906983 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 177/373] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:48 2022] GET /compute/v2.1/servers/27cf9c57-37a3-4ccb-ba37-bc66ff5423cd => generated 1475 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:48.922837 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5f70a731-ff43-4854-89af-6e4d78bebae1 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:48.923460 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5f70a731-ff43-4854-89af-6e4d78bebae1 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:48.929638 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f70a731-ff43-4854-89af-6e4d78bebae1 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:48.930122 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f70a731-ff43-4854-89af-6e4d78bebae1 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:48.930548 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f70a731-ff43-4854-89af-6e4d78bebae1 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:48.931244 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f70a731-ff43-4854-89af-6e4d78bebae1 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:48.931691 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f70a731-ff43-4854-89af-6e4d78bebae1 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:48.932108 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f70a731-ff43-4854-89af-6e4d78bebae1 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:49.075097 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5f70a731-ff43-4854-89af-6e4d78bebae1 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:49.084582 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5f70a731-ff43-4854-89af-6e4d78bebae1 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:49.086148 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5f70a731-ff43-4854-89af-6e4d78bebae1 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:49.092172 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5f70a731-ff43-4854-89af-6e4d78bebae1 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] 10.222.0.13 "GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 200 len: 1446 microversion: 2.75 time: 0.173415 Oct 30 01:14:49.092760 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 178/374] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:14:48 2022] GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 1446 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:14:49.097480 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5698b7bb-95b7-462f-be77-1e3e4b123a84 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:49.098423 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5698b7bb-95b7-462f-be77-1e3e4b123a84 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] [instance: 4f47f49f-e5a9-46d5-9622-c9c887891646] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:49.104506 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5698b7bb-95b7-462f-be77-1e3e4b123a84 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:49.105213 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5698b7bb-95b7-462f-be77-1e3e4b123a84 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:49.105678 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5698b7bb-95b7-462f-be77-1e3e4b123a84 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:49.106379 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5698b7bb-95b7-462f-be77-1e3e4b123a84 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:49.106837 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5698b7bb-95b7-462f-be77-1e3e4b123a84 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:49.107260 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5698b7bb-95b7-462f-be77-1e3e4b123a84 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:49.115746 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6d75544e-879e-4a13-aad0-018e5379766b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:49.132324 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6d75544e-879e-4a13-aad0-018e5379766b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:49.134435 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6d75544e-879e-4a13-aad0-018e5379766b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:49.137724 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6d75544e-879e-4a13-aad0-018e5379766b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3" status: 200 len: 1361 microversion: 2.25 time: 0.751944 Oct 30 01:14:49.147705 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 197/375] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:14:48 2022] GET /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3 => generated 1361 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:14:49.186689 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5698b7bb-95b7-462f-be77-1e3e4b123a84 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ccc0bfdee94961aa198e3abf0d85cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee1e04c04bc40568e43eb98df39e7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:49.195713 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5698b7bb-95b7-462f-be77-1e3e4b123a84 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] 10.222.0.13 "GET /compute/v2.1/servers/4f47f49f-e5a9-46d5-9622-c9c887891646" status: 200 len: 1224 microversion: 2.1 time: 0.101660 Oct 30 01:14:49.197470 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 179/376] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:49 2022] GET /compute/v2.1/servers/4f47f49f-e5a9-46d5-9622-c9c887891646 => generated 1224 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:49.410488 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7584c160-28af-4c9d-b97d-2547417af5d2 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:49.413016 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7584c160-28af-4c9d-b97d-2547417af5d2 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 7e81dcfb-dcbe-4e05-91a4-541ff2c404ae] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:49.418240 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7584c160-28af-4c9d-b97d-2547417af5d2 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:49.418720 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7584c160-28af-4c9d-b97d-2547417af5d2 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:49.419158 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7584c160-28af-4c9d-b97d-2547417af5d2 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:49.419835 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7584c160-28af-4c9d-b97d-2547417af5d2 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:49.420282 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7584c160-28af-4c9d-b97d-2547417af5d2 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:49.420697 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7584c160-28af-4c9d-b97d-2547417af5d2 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:49.569627 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7584c160-28af-4c9d-b97d-2547417af5d2 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:49.580667 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7584c160-28af-4c9d-b97d-2547417af5d2 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae" status: 200 len: 1503 microversion: 2.1 time: 0.174010 Oct 30 01:14:49.581273 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 198/377] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:49 2022] GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae => generated 1503 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:49.931715 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3e3f5903-b344-49f8-a276-dd62d671f9f9 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:49.932355 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3e3f5903-b344-49f8-a276-dd62d671f9f9 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] [instance: 27cf9c57-37a3-4ccb-ba37-bc66ff5423cd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:49.938793 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3e3f5903-b344-49f8-a276-dd62d671f9f9 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:49.939283 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3e3f5903-b344-49f8-a276-dd62d671f9f9 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:49.939710 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3e3f5903-b344-49f8-a276-dd62d671f9f9 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:49.940429 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3e3f5903-b344-49f8-a276-dd62d671f9f9 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:49.940877 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3e3f5903-b344-49f8-a276-dd62d671f9f9 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:49.941297 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3e3f5903-b344-49f8-a276-dd62d671f9f9 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:49.961875 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:50.088774 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3e3f5903-b344-49f8-a276-dd62d671f9f9 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464f9e9314154e3f9c779b9ae10b2a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a83b0b15194aa69fc4d82876a1e6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:50.098350 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3e3f5903-b344-49f8-a276-dd62d671f9f9 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] 10.222.0.13 "GET /compute/v2.1/servers/27cf9c57-37a3-4ccb-ba37-bc66ff5423cd" status: 200 len: 1458 microversion: 2.1 time: 0.170605 Oct 30 01:14:50.099220 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 180/378] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:49 2022] GET /compute/v2.1/servers/27cf9c57-37a3-4ccb-ba37-bc66ff5423cd => generated 1458 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:50.124741 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4cd2bc18-0748-472f-a27c-7d345f368ecd tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:50.126765 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4cd2bc18-0748-472f-a27c-7d345f368ecd tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:50.129214 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-116ba6f4-087e-4a16-81ba-c3d5a3344edc tempest-LiveMigrationNegativeTest-108718090 tempest-LiveMigrationNegativeTest-108718090-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:50.130263 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-116ba6f4-087e-4a16-81ba-c3d5a3344edc tempest-LiveMigrationNegativeTest-108718090 tempest-LiveMigrationNegativeTest-108718090-project-admin] [instance: 27cf9c57-37a3-4ccb-ba37-bc66ff5423cd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:50.136448 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4cd2bc18-0748-472f-a27c-7d345f368ecd tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:50.137870 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4cd2bc18-0748-472f-a27c-7d345f368ecd tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:50.138928 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4cd2bc18-0748-472f-a27c-7d345f368ecd tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:50.139905 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4cd2bc18-0748-472f-a27c-7d345f368ecd tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:50.140651 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4cd2bc18-0748-472f-a27c-7d345f368ecd tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:50.141898 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4cd2bc18-0748-472f-a27c-7d345f368ecd tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:50.156999 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-116ba6f4-087e-4a16-81ba-c3d5a3344edc tempest-LiveMigrationNegativeTest-108718090 tempest-LiveMigrationNegativeTest-108718090-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:50.159276 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-116ba6f4-087e-4a16-81ba-c3d5a3344edc tempest-LiveMigrationNegativeTest-108718090 tempest-LiveMigrationNegativeTest-108718090-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:50.160510 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-116ba6f4-087e-4a16-81ba-c3d5a3344edc tempest-LiveMigrationNegativeTest-108718090 tempest-LiveMigrationNegativeTest-108718090-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:50.161656 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-116ba6f4-087e-4a16-81ba-c3d5a3344edc tempest-LiveMigrationNegativeTest-108718090 tempest-LiveMigrationNegativeTest-108718090-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:50.162734 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-116ba6f4-087e-4a16-81ba-c3d5a3344edc tempest-LiveMigrationNegativeTest-108718090 tempest-LiveMigrationNegativeTest-108718090-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:50.163878 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-116ba6f4-087e-4a16-81ba-c3d5a3344edc tempest-LiveMigrationNegativeTest-108718090 tempest-LiveMigrationNegativeTest-108718090-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:50.233031 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4cd2bc18-0748-472f-a27c-7d345f368ecd tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:50.243727 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4cd2bc18-0748-472f-a27c-7d345f368ecd tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:50.245178 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4cd2bc18-0748-472f-a27c-7d345f368ecd tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:50.252381 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4cd2bc18-0748-472f-a27c-7d345f368ecd tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] 10.222.0.13 "GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 200 len: 1446 microversion: 2.75 time: 0.133265 Oct 30 01:14:50.252381 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 199/379] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:14:50 2022] GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 1446 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:14:50.258032 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5224150e-6556-4534-ad10-bfe24965409a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:50.258930 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5224150e-6556-4534-ad10-bfe24965409a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:50.274332 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5224150e-6556-4534-ad10-bfe24965409a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:50.281504 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5224150e-6556-4534-ad10-bfe24965409a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:50.281504 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5224150e-6556-4534-ad10-bfe24965409a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:50.281504 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5224150e-6556-4534-ad10-bfe24965409a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:50.281504 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5224150e-6556-4534-ad10-bfe24965409a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:50.282023 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5224150e-6556-4534-ad10-bfe24965409a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:50.806595 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5224150e-6556-4534-ad10-bfe24965409a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:50.816752 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5224150e-6556-4534-ad10-bfe24965409a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:50.818538 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5224150e-6556-4534-ad10-bfe24965409a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:50.819920 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5224150e-6556-4534-ad10-bfe24965409a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3" status: 200 len: 1361 microversion: 2.25 time: 0.566490 Oct 30 01:14:50.821375 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 200/380] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:14:50 2022] GET /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3 => generated 1361 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:14:50.835775 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b54a35b1-941a-4042-86d5-039bab152b43 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:50.835775 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b54a35b1-941a-4042-86d5-039bab152b43 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] [instance: 4f47f49f-e5a9-46d5-9622-c9c887891646] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:50.844383 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b54a35b1-941a-4042-86d5-039bab152b43 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:50.844877 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b54a35b1-941a-4042-86d5-039bab152b43 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:50.845556 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b54a35b1-941a-4042-86d5-039bab152b43 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:50.846900 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b54a35b1-941a-4042-86d5-039bab152b43 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:50.848274 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b54a35b1-941a-4042-86d5-039bab152b43 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:50.849025 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b54a35b1-941a-4042-86d5-039bab152b43 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:51.026363 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b54a35b1-941a-4042-86d5-039bab152b43 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ccc0bfdee94961aa198e3abf0d85cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee1e04c04bc40568e43eb98df39e7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:51.034726 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b54a35b1-941a-4042-86d5-039bab152b43 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] 10.222.0.13 "GET /compute/v2.1/servers/4f47f49f-e5a9-46d5-9622-c9c887891646" status: 200 len: 1290 microversion: 2.1 time: 0.211997 Oct 30 01:14:51.035499 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 201/381] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:50 2022] GET /compute/v2.1/servers/4f47f49f-e5a9-46d5-9622-c9c887891646 => generated 1290 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:51.048657 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-116ba6f4-087e-4a16-81ba-c3d5a3344edc tempest-LiveMigrationNegativeTest-108718090 tempest-LiveMigrationNegativeTest-108718090-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/27cf9c57-37a3-4ccb-ba37-bc66ff5423cd" status: 200 len: 1609 microversion: 2.1 time: 0.923158 Oct 30 01:14:51.049544 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 181/382] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:50 2022] GET /compute/v2.1/servers/27cf9c57-37a3-4ccb-ba37-bc66ff5423cd => generated 1609 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:51.068320 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1fb1a86a-0737-451f-80a7-19a7328bebe0 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:51.068989 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1fb1a86a-0737-451f-80a7-19a7328bebe0 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 7e81dcfb-dcbe-4e05-91a4-541ff2c404ae] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:51.078989 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e4418a3b-f603-4432-8c1b-04b776722c40 tempest-LiveMigrationNegativeTest-108718090 tempest-LiveMigrationNegativeTest-108718090-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:51.089128 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e4418a3b-f603-4432-8c1b-04b776722c40 tempest-LiveMigrationNegativeTest-108718090 tempest-LiveMigrationNegativeTest-108718090-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:51.090687 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e4418a3b-f603-4432-8c1b-04b776722c40 tempest-LiveMigrationNegativeTest-108718090 tempest-LiveMigrationNegativeTest-108718090-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:51.091505 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e4418a3b-f603-4432-8c1b-04b776722c40 tempest-LiveMigrationNegativeTest-108718090 tempest-LiveMigrationNegativeTest-108718090-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:51.093597 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e4418a3b-f603-4432-8c1b-04b776722c40 tempest-LiveMigrationNegativeTest-108718090 tempest-LiveMigrationNegativeTest-108718090-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:51.094344 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e4418a3b-f603-4432-8c1b-04b776722c40 tempest-LiveMigrationNegativeTest-108718090 tempest-LiveMigrationNegativeTest-108718090-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:51.095040 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e4418a3b-f603-4432-8c1b-04b776722c40 tempest-LiveMigrationNegativeTest-108718090 tempest-LiveMigrationNegativeTest-108718090-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:51.107115 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=9 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:51.113533 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1fb1a86a-0737-451f-80a7-19a7328bebe0 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:51.114650 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1fb1a86a-0737-451f-80a7-19a7328bebe0 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:51.117087 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1fb1a86a-0737-451f-80a7-19a7328bebe0 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:51.118036 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1fb1a86a-0737-451f-80a7-19a7328bebe0 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:51.118506 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1fb1a86a-0737-451f-80a7-19a7328bebe0 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:51.118930 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1fb1a86a-0737-451f-80a7-19a7328bebe0 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:51.151171 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e4418a3b-f603-4432-8c1b-04b776722c40 tempest-LiveMigrationNegativeTest-108718090 tempest-LiveMigrationNegativeTest-108718090-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.079390 Oct 30 01:14:51.154131 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 182/383] 10.222.0.13 () {58 vars in 1176 bytes} [Sun Oct 30 01:14:51 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:51.177013 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f79ef9ae-4f7c-4668-91dc-5c4f7b095944 tempest-LiveMigrationNegativeTest-108718090 tempest-LiveMigrationNegativeTest-108718090-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:51.181303 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f79ef9ae-4f7c-4668-91dc-5c4f7b095944 tempest-LiveMigrationNegativeTest-108718090 tempest-LiveMigrationNegativeTest-108718090-project-admin] [instance: 27cf9c57-37a3-4ccb-ba37-bc66ff5423cd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:51.198705 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f79ef9ae-4f7c-4668-91dc-5c4f7b095944 tempest-LiveMigrationNegativeTest-108718090 tempest-LiveMigrationNegativeTest-108718090-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:51.199442 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f79ef9ae-4f7c-4668-91dc-5c4f7b095944 tempest-LiveMigrationNegativeTest-108718090 tempest-LiveMigrationNegativeTest-108718090-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:51.200260 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f79ef9ae-4f7c-4668-91dc-5c4f7b095944 tempest-LiveMigrationNegativeTest-108718090 tempest-LiveMigrationNegativeTest-108718090-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:51.202828 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f79ef9ae-4f7c-4668-91dc-5c4f7b095944 tempest-LiveMigrationNegativeTest-108718090 tempest-LiveMigrationNegativeTest-108718090-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:51.203372 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f79ef9ae-4f7c-4668-91dc-5c4f7b095944 tempest-LiveMigrationNegativeTest-108718090 tempest-LiveMigrationNegativeTest-108718090-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:51.204158 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f79ef9ae-4f7c-4668-91dc-5c4f7b095944 tempest-LiveMigrationNegativeTest-108718090 tempest-LiveMigrationNegativeTest-108718090-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:51.235256 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-f79ef9ae-4f7c-4668-91dc-5c4f7b095944 tempest-LiveMigrationNegativeTest-108718090 tempest-LiveMigrationNegativeTest-108718090-project-admin] Lazy-loading 'flavor' on Instance uuid 27cf9c57-37a3-4ccb-ba37-bc66ff5423cd {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:14:51.251155 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-f79ef9ae-4f7c-4668-91dc-5c4f7b095944 tempest-LiveMigrationNegativeTest-108718090 tempest-LiveMigrationNegativeTest-108718090-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 27cf9c57-37a3-4ccb-ba37-bc66ff5423cd while it is in vm_state suspended Oct 30 01:14:51.253444 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f79ef9ae-4f7c-4668-91dc-5c4f7b095944 tempest-LiveMigrationNegativeTest-108718090 tempest-LiveMigrationNegativeTest-108718090-project-admin] Request method failure captured: Oct 30 01:14:51.253444 n-d-master-1 devstack@n-api.service[121103]: request: POST /compute/v2.1/servers/27cf9c57-37a3-4ccb-ba37-bc66ff5423cd/action HTTP/1.1 Oct 30 01:14:51.253444 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:14:51.253444 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:14:51.253444 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:14:51.253444 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 97 Oct 30 01:14:51.253444 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:14:51.253444 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:14:51.253444 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:14:51.253444 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:14:51.253444 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXc_XGj-dWS_YIFQ4y8CKdKs992loAea_uJ5LgWYZYwRP1J3KkdRADUG2MeZYQVgeso9p2oRCXPux9rwFLrG-4s_8R8XCnANPJe5k0rOkemnI1J-uhy8Iad0Tb3IB4iaMrNVuyUjDhbAeWb1-8whoZ1u0gQR5s5A-0BIbOZRFOXbgOYQ Oct 30 01:14:51.253444 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:14:51.253444 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:14:51.253444 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:14:51.253444 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:14:51.253444 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:14:51.253444 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:14:51.253444 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: b3dd7611342d442aa6828ec2659988d7 Oct 30 01:14:51.253444 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-LiveMigrationNegativeTest-108718090 Oct 30 01:14:51.253444 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,admin,reader Oct 30 01:14:51.253444 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,admin,reader Oct 30 01:14:51.254819 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b3dd7611342d442aa6828ec2659988d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b3dd7611342d442aa6828ec2659988d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b3dd7611342d442aa6828ec2659988d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b3dd7611342d442aa6828ec2659988d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:14:51.254819 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-LiveMigrationNegativeTest-108718090 Oct 30 01:14:51.254819 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: b3dd7611342d442aa6828ec2659988d7 Oct 30 01:14:51.254819 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-108718090 Oct 30 01:14:51.254819 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-LiveMigrationNegativeTest-108718090-project-admin Oct 30 01:14:51.254819 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:14:51.254819 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:14:51.254819 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: a1274b7f71f04b05ba1753727d2367d1 Oct 30 01:14:51.254819 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-LiveMigrationNegativeTest-108718090-project-admin Oct 30 01:14:51.254819 n-d-master-1 devstack@n-api.service[121103]: Oct 30 01:14:51.254819 n-d-master-1 devstack@n-api.service[121103]: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": true, "disk_over_commit": false}} Oct 30 01:14:51.254819 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:14:51.255570 n-d-master-1 devstack@n-api.service[121103]: exception: Cannot 'os-migrateLive' instance 27cf9c57-37a3-4ccb-ba37-bc66ff5423cd while it is in vm_state suspended Oct 30 01:14:51.255570 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '27cf9c57-37a3-4ccb-ba37-bc66ff5423cd', 'body': {'os-migrateLive': {'host': 'n-h2-master-1', 'block_migration': True, 'disk_over_commit': False}}} Oct 30 01:14:51.255570 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:14:51.255570 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:51.255570 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 30 01:14:51.255570 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 30 01:14:51.255570 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 30 01:14:51.255570 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 30 01:14:51.255570 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 30 01:14:51.255570 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 30 01:14:51.255570 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 30 01:14:51.255570 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 30 01:14:51.255570 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 30 01:14:51.255570 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 30 01:14:51.255570 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 30 01:14:51.255570 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 30 01:14:51.255570 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 30 01:14:51.255570 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 30 01:14:51.258269 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 30 01:14:51.258269 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 30 01:14:51.258269 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 30 01:14:51.258269 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 30 01:14:51.258269 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 27cf9c57-37a3-4ccb-ba37-bc66ff5423cd in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 30 01:14:51.258269 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:51.258269 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:51.258269 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:51.258269 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:51.258269 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:51.258269 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:51.258269 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:14:51.258269 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:14:51.258269 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:14:51.258269 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:14:51.258269 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:14:51.258269 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:14:51.258269 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:14:51.258269 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:14:51.258269 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:14:51.259467 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:14:51.259467 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 30 01:14:51.259467 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 30 01:14:51.259467 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 30 01:14:51.259467 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 30 01:14:51.259467 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 30 01:14:51.259467 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 27cf9c57-37a3-4ccb-ba37-bc66ff5423cd while it is in vm_state suspended Oct 30 01:14:51.259467 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:51.259467 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:51.259467 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:51.259467 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:51.259467 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:51.259467 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:51.259467 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:14:51.259467 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:14:51.259467 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 27cf9c57-37a3-4ccb-ba37-bc66ff5423cd while it is in vm_state suspended Oct 30 01:14:51.259467 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:51.261261 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f79ef9ae-4f7c-4668-91dc-5c4f7b095944 tempest-LiveMigrationNegativeTest-108718090 tempest-LiveMigrationNegativeTest-108718090-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 27cf9c57-37a3-4ccb-ba37-bc66ff5423cd while it is in vm_state suspended {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:14:51.261261 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f79ef9ae-4f7c-4668-91dc-5c4f7b095944 tempest-LiveMigrationNegativeTest-108718090 tempest-LiveMigrationNegativeTest-108718090-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/27cf9c57-37a3-4ccb-ba37-bc66ff5423cd/action" status: 409 len: 155 microversion: 2.1 time: 0.092047 Oct 30 01:14:51.261261 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 183/384] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:14:51 2022] POST /compute/v2.1/servers/27cf9c57-37a3-4ccb-ba37-bc66ff5423cd/action => generated 155 bytes in 94 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:14:51.267205 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-84326b2f-1ef9-48e3-8dd7-750193b99065 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:51.267539 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-84326b2f-1ef9-48e3-8dd7-750193b99065 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] [instance: 27cf9c57-37a3-4ccb-ba37-bc66ff5423cd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:51.274110 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-84326b2f-1ef9-48e3-8dd7-750193b99065 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:51.274405 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-84326b2f-1ef9-48e3-8dd7-750193b99065 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:51.274878 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-84326b2f-1ef9-48e3-8dd7-750193b99065 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:51.276286 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-84326b2f-1ef9-48e3-8dd7-750193b99065 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:51.276286 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-84326b2f-1ef9-48e3-8dd7-750193b99065 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:51.276603 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-84326b2f-1ef9-48e3-8dd7-750193b99065 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:51.303896 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-84326b2f-1ef9-48e3-8dd7-750193b99065 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] [instance: 27cf9c57-37a3-4ccb-ba37-bc66ff5423cd] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:14:51.427074 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1fb1a86a-0737-451f-80a7-19a7328bebe0 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:51.436241 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1fb1a86a-0737-451f-80a7-19a7328bebe0 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae" status: 200 len: 1503 microversion: 2.1 time: 0.384935 Oct 30 01:14:51.449654 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 202/385] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:51 2022] GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae => generated 1503 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:51.457240 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c1bee36b-c19f-413a-bebe-e0e20340565d tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:51.457909 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c1bee36b-c19f-413a-bebe-e0e20340565d tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:51.468260 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c1bee36b-c19f-413a-bebe-e0e20340565d tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:51.468260 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c1bee36b-c19f-413a-bebe-e0e20340565d tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:51.468260 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c1bee36b-c19f-413a-bebe-e0e20340565d tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:51.468260 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c1bee36b-c19f-413a-bebe-e0e20340565d tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:51.468809 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c1bee36b-c19f-413a-bebe-e0e20340565d tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:51.468809 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c1bee36b-c19f-413a-bebe-e0e20340565d tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:51.557935 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c1bee36b-c19f-413a-bebe-e0e20340565d tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:51.567861 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c1bee36b-c19f-413a-bebe-e0e20340565d tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:51.569452 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c1bee36b-c19f-413a-bebe-e0e20340565d tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:51.576067 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c1bee36b-c19f-413a-bebe-e0e20340565d tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] 10.222.0.13 "GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 200 len: 1446 microversion: 2.75 time: 0.125367 Oct 30 01:14:51.576648 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 203/386] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:14:51 2022] GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 1446 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:14:51.690291 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-84326b2f-1ef9-48e3-8dd7-750193b99065 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] 10.222.0.13 "DELETE /compute/v2.1/servers/27cf9c57-37a3-4ccb-ba37-bc66ff5423cd" status: 204 len: 0 microversion: 2.1 time: 0.426074 Oct 30 01:14:51.691042 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 184/387] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:14:51 2022] DELETE /compute/v2.1/servers/27cf9c57-37a3-4ccb-ba37-bc66ff5423cd => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:14:51.700553 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e5f648e9-ee49-4741-af0d-df5738613abc tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:51.701402 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e5f648e9-ee49-4741-af0d-df5738613abc tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] [instance: 27cf9c57-37a3-4ccb-ba37-bc66ff5423cd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:51.708547 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e5f648e9-ee49-4741-af0d-df5738613abc tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:51.709187 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e5f648e9-ee49-4741-af0d-df5738613abc tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:51.709678 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e5f648e9-ee49-4741-af0d-df5738613abc tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:51.710599 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e5f648e9-ee49-4741-af0d-df5738613abc tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:51.711298 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e5f648e9-ee49-4741-af0d-df5738613abc tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:51.711721 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e5f648e9-ee49-4741-af0d-df5738613abc tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:51.851893 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1de884e1-e922-4e2a-90cc-e786182f254b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:51.852823 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1de884e1-e922-4e2a-90cc-e786182f254b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:51.861378 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1de884e1-e922-4e2a-90cc-e786182f254b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:51.865552 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1de884e1-e922-4e2a-90cc-e786182f254b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:51.866268 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1de884e1-e922-4e2a-90cc-e786182f254b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:51.867020 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1de884e1-e922-4e2a-90cc-e786182f254b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:51.869772 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1de884e1-e922-4e2a-90cc-e786182f254b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:51.870393 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1de884e1-e922-4e2a-90cc-e786182f254b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:51.936810 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e5f648e9-ee49-4741-af0d-df5738613abc tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464f9e9314154e3f9c779b9ae10b2a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a83b0b15194aa69fc4d82876a1e6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:51.945862 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e5f648e9-ee49-4741-af0d-df5738613abc tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] 10.222.0.13 "GET /compute/v2.1/servers/27cf9c57-37a3-4ccb-ba37-bc66ff5423cd" status: 200 len: 1464 microversion: 2.1 time: 0.250144 Oct 30 01:14:51.947073 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 204/388] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:51 2022] GET /compute/v2.1/servers/27cf9c57-37a3-4ccb-ba37-bc66ff5423cd => generated 1464 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:52.075181 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cc0bf5cb-961b-414f-88e0-444891b79ee5 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:52.076169 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cc0bf5cb-961b-414f-88e0-444891b79ee5 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] [instance: 4f47f49f-e5a9-46d5-9622-c9c887891646] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:52.088637 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cc0bf5cb-961b-414f-88e0-444891b79ee5 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:52.089517 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cc0bf5cb-961b-414f-88e0-444891b79ee5 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:52.090177 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cc0bf5cb-961b-414f-88e0-444891b79ee5 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:52.092194 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cc0bf5cb-961b-414f-88e0-444891b79ee5 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:52.092974 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cc0bf5cb-961b-414f-88e0-444891b79ee5 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:52.093654 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cc0bf5cb-961b-414f-88e0-444891b79ee5 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:52.117759 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1de884e1-e922-4e2a-90cc-e786182f254b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:52.133680 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1de884e1-e922-4e2a-90cc-e786182f254b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:52.135818 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1de884e1-e922-4e2a-90cc-e786182f254b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:52.140512 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1de884e1-e922-4e2a-90cc-e786182f254b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3" status: 200 len: 1361 microversion: 2.25 time: 0.290818 Oct 30 01:14:52.140512 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 185/389] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:14:51 2022] GET /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3 => generated 1361 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:14:52.186505 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-cc0bf5cb-961b-414f-88e0-444891b79ee5 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ccc0bfdee94961aa198e3abf0d85cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee1e04c04bc40568e43eb98df39e7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:52.206143 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cc0bf5cb-961b-414f-88e0-444891b79ee5 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] 10.222.0.13 "GET /compute/v2.1/servers/4f47f49f-e5a9-46d5-9622-c9c887891646" status: 200 len: 1278 microversion: 2.1 time: 0.126305 Oct 30 01:14:52.206143 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 205/390] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:52 2022] GET /compute/v2.1/servers/4f47f49f-e5a9-46d5-9622-c9c887891646 => generated 1278 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:52.469740 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a4660784-f7fa-4d3c-8ef8-3461eb55073d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:52.470345 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a4660784-f7fa-4d3c-8ef8-3461eb55073d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 7e81dcfb-dcbe-4e05-91a4-541ff2c404ae] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:52.509956 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a4660784-f7fa-4d3c-8ef8-3461eb55073d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:52.509956 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a4660784-f7fa-4d3c-8ef8-3461eb55073d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:52.509956 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a4660784-f7fa-4d3c-8ef8-3461eb55073d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:52.509956 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a4660784-f7fa-4d3c-8ef8-3461eb55073d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:52.510962 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a4660784-f7fa-4d3c-8ef8-3461eb55073d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:52.510962 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a4660784-f7fa-4d3c-8ef8-3461eb55073d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:52.605875 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8027ef4a-a81d-48c1-8944-41db3788a302 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:52.607136 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8027ef4a-a81d-48c1-8944-41db3788a302 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:52.613956 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8027ef4a-a81d-48c1-8944-41db3788a302 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:52.614718 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8027ef4a-a81d-48c1-8944-41db3788a302 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:52.615468 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8027ef4a-a81d-48c1-8944-41db3788a302 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:52.616352 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8027ef4a-a81d-48c1-8944-41db3788a302 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:52.616974 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8027ef4a-a81d-48c1-8944-41db3788a302 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:52.619491 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8027ef4a-a81d-48c1-8944-41db3788a302 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:52.660590 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a4660784-f7fa-4d3c-8ef8-3461eb55073d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:52.669049 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a4660784-f7fa-4d3c-8ef8-3461eb55073d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae" status: 200 len: 1493 microversion: 2.1 time: 0.206091 Oct 30 01:14:52.669664 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 186/391] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:52 2022] GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae => generated 1493 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:52.694681 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-922227de-f03b-43f8-b0aa-3938fc8a9488 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Calling method '.version_select at 0x7f44cc98dc10>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:52.699211 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-922227de-f03b-43f8-b0aa-3938fc8a9488 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:52.700476 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-922227de-f03b-43f8-b0aa-3938fc8a9488 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:52.701105 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-922227de-f03b-43f8-b0aa-3938fc8a9488 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:52.719004 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-922227de-f03b-43f8-b0aa-3938fc8a9488 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] 10.222.0.13 "GET /compute/v2.1/os-migrations" status: 200 len: 398 microversion: 2.1 time: 0.028822 Oct 30 01:14:52.728642 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 187/392] 10.222.0.13 () {58 vars in 1143 bytes} [Sun Oct 30 01:14:52 2022] GET /compute/v2.1/os-migrations => generated 398 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:52.729448 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8027ef4a-a81d-48c1-8944-41db3788a302 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:52.739514 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d6cc138a-6387-4e7f-ab28-4b1eb90fe3c0 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:52.739514 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d6cc138a-6387-4e7f-ab28-4b1eb90fe3c0 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] [instance: 7e81dcfb-dcbe-4e05-91a4-541ff2c404ae] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:52.743158 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d6cc138a-6387-4e7f-ab28-4b1eb90fe3c0 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:52.743833 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d6cc138a-6387-4e7f-ab28-4b1eb90fe3c0 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:52.744475 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d6cc138a-6387-4e7f-ab28-4b1eb90fe3c0 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:52.745208 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d6cc138a-6387-4e7f-ab28-4b1eb90fe3c0 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:52.745735 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d6cc138a-6387-4e7f-ab28-4b1eb90fe3c0 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:52.746737 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d6cc138a-6387-4e7f-ab28-4b1eb90fe3c0 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:52.752140 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8027ef4a-a81d-48c1-8944-41db3788a302 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:52.755600 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8027ef4a-a81d-48c1-8944-41db3788a302 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:52.767602 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8027ef4a-a81d-48c1-8944-41db3788a302 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] 10.222.0.13 "GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 200 len: 1446 microversion: 2.75 time: 0.164352 Oct 30 01:14:52.770234 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 206/393] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:14:52 2022] GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 1446 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:14:52.958885 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d6cc138a-6387-4e7f-ab28-4b1eb90fe3c0 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae" status: 200 len: 1644 microversion: 2.1 time: 0.228517 Oct 30 01:14:52.959774 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 188/394] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:52 2022] GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae => generated 1644 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:52.979011 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-52ff03aa-b10e-41b8-9e24-2ebf74aca0e8 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:52.979864 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-52ff03aa-b10e-41b8-9e24-2ebf74aca0e8 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] [instance: 27cf9c57-37a3-4ccb-ba37-bc66ff5423cd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:52.986966 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-52ff03aa-b10e-41b8-9e24-2ebf74aca0e8 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:52.988594 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-52ff03aa-b10e-41b8-9e24-2ebf74aca0e8 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:52.989236 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-52ff03aa-b10e-41b8-9e24-2ebf74aca0e8 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:52.990615 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-52ff03aa-b10e-41b8-9e24-2ebf74aca0e8 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:52.992057 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-52ff03aa-b10e-41b8-9e24-2ebf74aca0e8 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:52.992738 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-52ff03aa-b10e-41b8-9e24-2ebf74aca0e8 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:53.123264 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-789b55ae-d456-4db1-8de7-3fa30908febc tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1280740590", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "b4253cc9-9396-4e97-b0c0-e8b6bb730934"}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:53.196050 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-789b55ae-d456-4db1-8de7-3fa30908febc tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] validate_networks() for [('b4253cc9-9396-4e97-b0c0-e8b6bb730934', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:14:53.258740 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-52ff03aa-b10e-41b8-9e24-2ebf74aca0e8 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464f9e9314154e3f9c779b9ae10b2a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a83b0b15194aa69fc4d82876a1e6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:53.271136 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-52ff03aa-b10e-41b8-9e24-2ebf74aca0e8 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] 10.222.0.13 "GET /compute/v2.1/servers/27cf9c57-37a3-4ccb-ba37-bc66ff5423cd" status: 200 len: 1464 microversion: 2.1 time: 0.296270 Oct 30 01:14:53.273296 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 207/395] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:52 2022] GET /compute/v2.1/servers/27cf9c57-37a3-4ccb-ba37-bc66ff5423cd => generated 1464 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:53.287877 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=10 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:53.292061 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-103de014-eaea-4454-ab11-a66178c20a53 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:53.292717 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-103de014-eaea-4454-ab11-a66178c20a53 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:53.309477 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-103de014-eaea-4454-ab11-a66178c20a53 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:53.309979 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-103de014-eaea-4454-ab11-a66178c20a53 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:53.312148 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-103de014-eaea-4454-ab11-a66178c20a53 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:53.312927 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-103de014-eaea-4454-ab11-a66178c20a53 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:53.314276 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-103de014-eaea-4454-ab11-a66178c20a53 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:53.315076 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-103de014-eaea-4454-ab11-a66178c20a53 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:53.877980 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-103de014-eaea-4454-ab11-a66178c20a53 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:53.891122 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-103de014-eaea-4454-ab11-a66178c20a53 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:53.895200 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-103de014-eaea-4454-ab11-a66178c20a53 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:53.902334 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-103de014-eaea-4454-ab11-a66178c20a53 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3" status: 200 len: 1361 microversion: 2.25 time: 0.622166 Oct 30 01:14:53.904371 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 208/396] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:14:53 2022] GET /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3 => generated 1361 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:14:53.923489 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-92c77042-90a0-48eb-8e07-3929ecd9dab6 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:53.926018 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-92c77042-90a0-48eb-8e07-3929ecd9dab6 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] [instance: 4f47f49f-e5a9-46d5-9622-c9c887891646] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:53.942338 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92c77042-90a0-48eb-8e07-3929ecd9dab6 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:53.942830 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92c77042-90a0-48eb-8e07-3929ecd9dab6 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:53.943352 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92c77042-90a0-48eb-8e07-3929ecd9dab6 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:53.944489 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92c77042-90a0-48eb-8e07-3929ecd9dab6 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:53.944962 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92c77042-90a0-48eb-8e07-3929ecd9dab6 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:53.945452 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92c77042-90a0-48eb-8e07-3929ecd9dab6 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:54.245248 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-92c77042-90a0-48eb-8e07-3929ecd9dab6 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ccc0bfdee94961aa198e3abf0d85cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee1e04c04bc40568e43eb98df39e7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:54.254346 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-92c77042-90a0-48eb-8e07-3929ecd9dab6 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] 10.222.0.13 "GET /compute/v2.1/servers/4f47f49f-e5a9-46d5-9622-c9c887891646" status: 200 len: 1320 microversion: 2.1 time: 0.338193 Oct 30 01:14:54.255835 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 209/397] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:53 2022] GET /compute/v2.1/servers/4f47f49f-e5a9-46d5-9622-c9c887891646 => generated 1320 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:54.320366 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-789b55ae-d456-4db1-8de7-3fa30908febc tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:14:54.321626 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-789b55ae-d456-4db1-8de7-3fa30908febc tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:14:54.322273 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-789b55ae-d456-4db1-8de7-3fa30908febc tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:14:54.322841 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-789b55ae-d456-4db1-8de7-3fa30908febc tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:14:54.324441 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-789b55ae-d456-4db1-8de7-3fa30908febc tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:14:54.343077 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-789b55ae-d456-4db1-8de7-3fa30908febc tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:54.343077 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-789b55ae-d456-4db1-8de7-3fa30908febc tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:54.343077 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-789b55ae-d456-4db1-8de7-3fa30908febc tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:54.343077 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-789b55ae-d456-4db1-8de7-3fa30908febc tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:54.343584 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-789b55ae-d456-4db1-8de7-3fa30908febc tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:54.343584 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-789b55ae-d456-4db1-8de7-3fa30908febc tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:54.377305 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-789b55ae-d456-4db1-8de7-3fa30908febc tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Getting quotas for project 283e7fd477334b879db6b49ee5cc509f. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:14:54.383560 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-789b55ae-d456-4db1-8de7-3fa30908febc tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Getting quotas for user c7334417689847d18bc4c1b27d173a23 and project 283e7fd477334b879db6b49ee5cc509f. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:14:54.413193 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-789b55ae-d456-4db1-8de7-3fa30908febc tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:14:54.416301 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-789b55ae-d456-4db1-8de7-3fa30908febc tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0dd3f0e2-2c15-4915-88b0-2df9e312cc4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:14:54.485728 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6fa012bd-b3d7-42b8-82be-8dd0134f6c0c tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-775082119", "id": 1946485000, "os-flavor-access:is_public": "True"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:54.582443 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-789b55ae-d456-4db1-8de7-3fa30908febc tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.462936 Oct 30 01:14:54.583436 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 189/398] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:14:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1465 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 30 01:14:54.594006 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-65eccb4d-be05-446f-b427-72fd56dde6e6 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:54.594951 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-65eccb4d-be05-446f-b427-72fd56dde6e6 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:54.614344 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-65eccb4d-be05-446f-b427-72fd56dde6e6 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:54.615189 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-65eccb4d-be05-446f-b427-72fd56dde6e6 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:54.616520 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-65eccb4d-be05-446f-b427-72fd56dde6e6 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:54.617535 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-65eccb4d-be05-446f-b427-72fd56dde6e6 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:54.618201 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-65eccb4d-be05-446f-b427-72fd56dde6e6 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:54.618826 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-65eccb4d-be05-446f-b427-72fd56dde6e6 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:54.642612 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6fa012bd-b3d7-42b8-82be-8dd0134f6c0c tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.385370 Oct 30 01:14:54.644688 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 210/399] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:14:54 2022] POST /compute/v2.1/flavors => generated 429 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:54.786523 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-768a160c-e9d6-46ea-ae76-632275b221b7 tempest-HypervisorAdminV228Test-379555563 tempest-HypervisorAdminV228Test-379555563-project-admin] Calling method '.version_select at 0x7f44cc8e05e0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:54.788874 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-768a160c-e9d6-46ea-ae76-632275b221b7 tempest-HypervisorAdminV228Test-379555563 tempest-HypervisorAdminV228Test-379555563-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:54.790584 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-768a160c-e9d6-46ea-ae76-632275b221b7 tempest-HypervisorAdminV228Test-379555563 tempest-HypervisorAdminV228Test-379555563-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:54.792745 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-768a160c-e9d6-46ea-ae76-632275b221b7 tempest-HypervisorAdminV228Test-379555563 tempest-HypervisorAdminV228Test-379555563-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:54.801101 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-65eccb4d-be05-446f-b427-72fd56dde6e6 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:54.814256 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-768a160c-e9d6-46ea-ae76-632275b221b7 tempest-HypervisorAdminV228Test-379555563 tempest-HypervisorAdminV228Test-379555563-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:54.814476 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-65eccb4d-be05-446f-b427-72fd56dde6e6 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:54.815341 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-768a160c-e9d6-46ea-ae76-632275b221b7 tempest-HypervisorAdminV228Test-379555563 tempest-HypervisorAdminV228Test-379555563-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:54.816609 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-65eccb4d-be05-446f-b427-72fd56dde6e6 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:54.816742 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-768a160c-e9d6-46ea-ae76-632275b221b7 tempest-HypervisorAdminV228Test-379555563 tempest-HypervisorAdminV228Test-379555563-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:54.826541 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-65eccb4d-be05-446f-b427-72fd56dde6e6 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] 10.222.0.13 "GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 200 len: 1446 microversion: 2.75 time: 0.240937 Oct 30 01:14:54.826541 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 190/400] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:14:54 2022] GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 1446 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:14:54.834512 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-da161dcf-d1eb-49c0-891d-aeac8054f0ff tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:54.835381 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-da161dcf-d1eb-49c0-891d-aeac8054f0ff tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] [instance: 27cf9c57-37a3-4ccb-ba37-bc66ff5423cd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:54.839920 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-768a160c-e9d6-46ea-ae76-632275b221b7 tempest-HypervisorAdminV228Test-379555563 tempest-HypervisorAdminV228Test-379555563-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:54.840569 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-768a160c-e9d6-46ea-ae76-632275b221b7 tempest-HypervisorAdminV228Test-379555563 tempest-HypervisorAdminV228Test-379555563-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:54.841248 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-768a160c-e9d6-46ea-ae76-632275b221b7 tempest-HypervisorAdminV228Test-379555563 tempest-HypervisorAdminV228Test-379555563-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:54.842032 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da161dcf-d1eb-49c0-891d-aeac8054f0ff tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:54.842692 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da161dcf-d1eb-49c0-891d-aeac8054f0ff tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:54.843298 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da161dcf-d1eb-49c0-891d-aeac8054f0ff tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:54.844157 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da161dcf-d1eb-49c0-891d-aeac8054f0ff tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:54.844782 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da161dcf-d1eb-49c0-891d-aeac8054f0ff tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:54.845379 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da161dcf-d1eb-49c0-891d-aeac8054f0ff tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:54.885583 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-768a160c-e9d6-46ea-ae76-632275b221b7 tempest-HypervisorAdminV228Test-379555563 tempest-HypervisorAdminV228Test-379555563-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.230214 Oct 30 01:14:54.894898 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 211/401] 10.222.0.13 () {60 vars in 1187 bytes} [Sun Oct 30 01:14:54 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:14:54.901511 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a45679d8-6b13-44de-9905-da63108361ab tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:54.902131 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a45679d8-6b13-44de-9905-da63108361ab tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0dd3f0e2-2c15-4915-88b0-2df9e312cc4c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:54.990803 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-da161dcf-d1eb-49c0-891d-aeac8054f0ff tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464f9e9314154e3f9c779b9ae10b2a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a83b0b15194aa69fc4d82876a1e6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:54.999106 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-da161dcf-d1eb-49c0-891d-aeac8054f0ff tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] 10.222.0.13 "GET /compute/v2.1/servers/27cf9c57-37a3-4ccb-ba37-bc66ff5423cd" status: 200 len: 1294 microversion: 2.1 time: 0.171037 Oct 30 01:14:54.999968 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 191/402] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:54 2022] GET /compute/v2.1/servers/27cf9c57-37a3-4ccb-ba37-bc66ff5423cd => generated 1294 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:55.007294 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-c463213b-48c4-497a-a40d-cc6efadf405d req-8ffabac2-7114-47e5-a2d3-6025eaf8b41d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27cf9c57-37a3-4ccb-ba37-bc66ff5423cd", "name": "network-vif-deleted", "tag": "adfffed5-4e4a-44f0-bcb3-49442b742c2a"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:55.017237 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-c463213b-48c4-497a-a40d-cc6efadf405d req-8ffabac2-7114-47e5-a2d3-6025eaf8b41d service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:55.017752 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-c463213b-48c4-497a-a40d-cc6efadf405d req-8ffabac2-7114-47e5-a2d3-6025eaf8b41d service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:55.018187 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-c463213b-48c4-497a-a40d-cc6efadf405d req-8ffabac2-7114-47e5-a2d3-6025eaf8b41d service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:55.032896 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-c463213b-48c4-497a-a40d-cc6efadf405d req-8ffabac2-7114-47e5-a2d3-6025eaf8b41d service nova] Creating event network-vif-deleted:adfffed5-4e4a-44f0-bcb3-49442b742c2a for instance 27cf9c57-37a3-4ccb-ba37-bc66ff5423cd on n-h1-master-1 Oct 30 01:14:55.033135 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a45679d8-6b13-44de-9905-da63108361ab tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:55.041877 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=71 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:55.044090 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a45679d8-6b13-44de-9905-da63108361ab tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c" status: 200 len: 1211 microversion: 2.1 time: 0.146976 Oct 30 01:14:55.044216 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-c463213b-48c4-497a-a40d-cc6efadf405d req-8ffabac2-7114-47e5-a2d3-6025eaf8b41d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042169 Oct 30 01:14:55.044964 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 212/403] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:54 2022] GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c => generated 1211 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:55.045296 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 192/404] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:55.056381 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-22a29aa9-35f1-4c11-89ce-62ceb860054e tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:55.056484 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-a171637a-5c7d-465f-b9cf-99bdde33942a req-85424209-44dc-4a15-bcb2-fc8c068673ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3", "name": "network-vif-plugged", "status": "completed", "tag": "158902f2-0cf8-4485-a0b9-8ba513a59715"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:55.063921 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-a171637a-5c7d-465f-b9cf-99bdde33942a req-85424209-44dc-4a15-bcb2-fc8c068673ec service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:55.064854 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-a171637a-5c7d-465f-b9cf-99bdde33942a req-85424209-44dc-4a15-bcb2-fc8c068673ec service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:55.066607 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-a171637a-5c7d-465f-b9cf-99bdde33942a req-85424209-44dc-4a15-bcb2-fc8c068673ec service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:55.078212 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-a171637a-5c7d-465f-b9cf-99bdde33942a req-85424209-44dc-4a15-bcb2-fc8c068673ec service nova] Creating event network-vif-plugged:158902f2-0cf8-4485-a0b9-8ba513a59715 for instance 6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3 on n-h2-master-1 Oct 30 01:14:55.083753 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-a171637a-5c7d-465f-b9cf-99bdde33942a req-85424209-44dc-4a15-bcb2-fc8c068673ec service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037183 Oct 30 01:14:55.084418 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 193/405] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:55.089852 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-60052fa7-a932-406f-a4ea-5944ff272084 req-1e5b5da4-92ce-4467-a4e3-139fbbe1826a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f47f49f-e5a9-46d5-9622-c9c887891646", "tag": "cd794d5d-fb9d-4c11-a17d-bf11f86e2a54"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:55.100892 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-60052fa7-a932-406f-a4ea-5944ff272084 req-1e5b5da4-92ce-4467-a4e3-139fbbe1826a service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:55.101392 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-60052fa7-a932-406f-a4ea-5944ff272084 req-1e5b5da4-92ce-4467-a4e3-139fbbe1826a service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:55.101820 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-60052fa7-a932-406f-a4ea-5944ff272084 req-1e5b5da4-92ce-4467-a4e3-139fbbe1826a service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:55.112974 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-60052fa7-a932-406f-a4ea-5944ff272084 req-1e5b5da4-92ce-4467-a4e3-139fbbe1826a service nova] Creating event network-changed:cd794d5d-fb9d-4c11-a17d-bf11f86e2a54 for instance 4f47f49f-e5a9-46d5-9622-c9c887891646 on n-h1-master-1 Oct 30 01:14:55.117712 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-60052fa7-a932-406f-a4ea-5944ff272084 req-1e5b5da4-92ce-4467-a4e3-139fbbe1826a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031840 Oct 30 01:14:55.118588 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 194/406] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:55.123365 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ceabb3d4-18a6-452e-a396-939795ab60c6 tempest-HypervisorAdminV228Test-379555563 tempest-HypervisorAdminV228Test-379555563-project-admin] Calling method '.version_select at 0x7f44cc982430>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:55.125204 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ceabb3d4-18a6-452e-a396-939795ab60c6 tempest-HypervisorAdminV228Test-379555563 tempest-HypervisorAdminV228Test-379555563-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:55.125594 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ceabb3d4-18a6-452e-a396-939795ab60c6 tempest-HypervisorAdminV228Test-379555563 tempest-HypervisorAdminV228Test-379555563-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:55.126095 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ceabb3d4-18a6-452e-a396-939795ab60c6 tempest-HypervisorAdminV228Test-379555563 tempest-HypervisorAdminV228Test-379555563-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:55.139841 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ceabb3d4-18a6-452e-a396-939795ab60c6 tempest-HypervisorAdminV228Test-379555563 tempest-HypervisorAdminV228Test-379555563-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:55.140309 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ceabb3d4-18a6-452e-a396-939795ab60c6 tempest-HypervisorAdminV228Test-379555563 tempest-HypervisorAdminV228Test-379555563-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:55.140735 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ceabb3d4-18a6-452e-a396-939795ab60c6 tempest-HypervisorAdminV228Test-379555563 tempest-HypervisorAdminV228Test-379555563-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:55.147388 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ceabb3d4-18a6-452e-a396-939795ab60c6 tempest-HypervisorAdminV228Test-379555563 tempest-HypervisorAdminV228Test-379555563-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.027702 Oct 30 01:14:55.148136 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 195/407] 10.222.0.13 () {60 vars in 1193 bytes} [Sun Oct 30 01:14:55 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:14:55.158475 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-001296ba-5b1c-4ab0-b17f-7f4579da4bb9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:55.159795 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-001296ba-5b1c-4ab0-b17f-7f4579da4bb9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:55.167578 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-001296ba-5b1c-4ab0-b17f-7f4579da4bb9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:55.168217 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-001296ba-5b1c-4ab0-b17f-7f4579da4bb9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:55.168749 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-001296ba-5b1c-4ab0-b17f-7f4579da4bb9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:55.169587 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-001296ba-5b1c-4ab0-b17f-7f4579da4bb9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:55.170142 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-001296ba-5b1c-4ab0-b17f-7f4579da4bb9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:55.170664 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-001296ba-5b1c-4ab0-b17f-7f4579da4bb9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:55.175826 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-22a29aa9-35f1-4c11-89ce-62ceb860054e tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1946485000" status: 202 len: 0 microversion: 2.1 time: 0.129232 Oct 30 01:14:55.176894 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 213/408] 10.222.0.13 () {58 vars in 1161 bytes} [Sun Oct 30 01:14:55 2022] DELETE /compute/v2.1/flavors/1946485000 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:14:55.187395 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6bcac8e5-f586-45a5-a853-0408aba7aecc tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:55.212422 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6bcac8e5-f586-45a5-a853-0408aba7aecc tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.029012 Oct 30 01:14:55.213663 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 214/409] 10.222.0.13 () {58 vars in 1146 bytes} [Sun Oct 30 01:14:55 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:14:55.246801 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8bdf8417-fecc-4433-b0c1-7c1579554425 tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1510914622", "id": 688584263, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:55.349837 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8bdf8417-fecc-4433-b0c1-7c1579554425 tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.112893 Oct 30 01:14:55.349837 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 215/410] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:14:55 2022] POST /compute/v2.1/flavors => generated 414 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:55.352235 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e07fa402-7a42-482e-9199-33a465eeeddd tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:55.353367 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e07fa402-7a42-482e-9199-33a465eeeddd tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] [instance: 4f47f49f-e5a9-46d5-9622-c9c887891646] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:55.360267 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e07fa402-7a42-482e-9199-33a465eeeddd tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:55.361122 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e07fa402-7a42-482e-9199-33a465eeeddd tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:55.362237 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e07fa402-7a42-482e-9199-33a465eeeddd tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:55.364294 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e07fa402-7a42-482e-9199-33a465eeeddd tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:55.365032 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e07fa402-7a42-482e-9199-33a465eeeddd tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:55.365394 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e07fa402-7a42-482e-9199-33a465eeeddd tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:55.370317 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:55.566577 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-001296ba-5b1c-4ab0-b17f-7f4579da4bb9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:55.575176 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-001296ba-5b1c-4ab0-b17f-7f4579da4bb9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:55.576666 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-001296ba-5b1c-4ab0-b17f-7f4579da4bb9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:55.577984 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-001296ba-5b1c-4ab0-b17f-7f4579da4bb9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3" status: 200 len: 1361 microversion: 2.25 time: 0.428989 Oct 30 01:14:55.585658 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 196/411] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:14:55 2022] GET /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3 => generated 1361 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:14:55.585658 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-79c73b56-4c14-4c5c-b716-100e94953758 tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:55.605253 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-79c73b56-4c14-4c5c-b716-100e94953758 tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 6225 microversion: 2.1 time: 0.025600 Oct 30 01:14:55.606381 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 197/412] 10.222.0.13 () {58 vars in 1146 bytes} [Sun Oct 30 01:14:55 2022] GET /compute/v2.1/flavors/detail => generated 6225 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:55.625533 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1f8a0b79-5a87-4e31-a4dd-b962357081f1 tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:55.676677 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e07fa402-7a42-482e-9199-33a465eeeddd tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ccc0bfdee94961aa198e3abf0d85cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee1e04c04bc40568e43eb98df39e7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:55.685347 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e07fa402-7a42-482e-9199-33a465eeeddd tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] 10.222.0.13 "GET /compute/v2.1/servers/4f47f49f-e5a9-46d5-9622-c9c887891646" status: 200 len: 1320 microversion: 2.1 time: 0.337724 Oct 30 01:14:55.686163 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 216/413] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:55 2022] GET /compute/v2.1/servers/4f47f49f-e5a9-46d5-9622-c9c887891646 => generated 1320 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:55.758806 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1f8a0b79-5a87-4e31-a4dd-b962357081f1 tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/688584263" status: 202 len: 0 microversion: 2.1 time: 0.137050 Oct 30 01:14:55.759727 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 198/414] 10.222.0.13 () {58 vars in 1158 bytes} [Sun Oct 30 01:14:55 2022] DELETE /compute/v2.1/flavors/688584263 => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 30 01:14:55.768224 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-22dd190e-4653-4d68-82e6-3711efb7f5b6 tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:55.791841 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-22dd190e-4653-4d68-82e6-3711efb7f5b6 tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.026725 Oct 30 01:14:55.792945 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 217/415] 10.222.0.13 () {58 vars in 1146 bytes} [Sun Oct 30 01:14:55 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:55.816066 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6cd1e7bc-48c0-4850-bc4d-a599f63e57a6 tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1502318744", "id": 1981270934, "os-flavor-access:is_public": "True"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:55.856506 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ba8a6545-6be0-4b5d-a518-a523cf3783d4 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:55.857098 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ba8a6545-6be0-4b5d-a518-a523cf3783d4 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:55.863804 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ba8a6545-6be0-4b5d-a518-a523cf3783d4 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:55.864441 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ba8a6545-6be0-4b5d-a518-a523cf3783d4 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:55.864764 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ba8a6545-6be0-4b5d-a518-a523cf3783d4 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:55.865540 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ba8a6545-6be0-4b5d-a518-a523cf3783d4 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:55.865990 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ba8a6545-6be0-4b5d-a518-a523cf3783d4 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:55.866458 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ba8a6545-6be0-4b5d-a518-a523cf3783d4 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:55.897125 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6cd1e7bc-48c0-4850-bc4d-a599f63e57a6 tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.084964 Oct 30 01:14:55.900502 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 199/416] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:14:55 2022] POST /compute/v2.1/flavors => generated 429 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:55.910835 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ce05761e-196d-43c5-86ae-831484448ca2 tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:55.940007 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ba8a6545-6be0-4b5d-a518-a523cf3783d4 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:55.948332 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ba8a6545-6be0-4b5d-a518-a523cf3783d4 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:55.949946 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ba8a6545-6be0-4b5d-a518-a523cf3783d4 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:55.954993 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ba8a6545-6be0-4b5d-a518-a523cf3783d4 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] 10.222.0.13 "GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 200 len: 1446 microversion: 2.75 time: 0.102394 Oct 30 01:14:55.960538 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 218/417] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:14:55 2022] GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 1446 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:14:56.009405 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ce05761e-196d-43c5-86ae-831484448ca2 tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1981270934" status: 202 len: 0 microversion: 2.1 time: 0.102743 Oct 30 01:14:56.009991 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 200/418] 10.222.0.13 () {58 vars in 1161 bytes} [Sun Oct 30 01:14:55 2022] DELETE /compute/v2.1/flavors/1981270934 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 30 01:14:56.018004 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4f6b3b86-4a80-45ae-8b32-ef3321543eba tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:56.023090 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7478f5ab-ea42-4306-b64b-b44902a9ad23 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:56.023711 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7478f5ab-ea42-4306-b64b-b44902a9ad23 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] [instance: 27cf9c57-37a3-4ccb-ba37-bc66ff5423cd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:56.029667 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7478f5ab-ea42-4306-b64b-b44902a9ad23 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:56.030163 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7478f5ab-ea42-4306-b64b-b44902a9ad23 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:56.030599 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7478f5ab-ea42-4306-b64b-b44902a9ad23 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:56.031304 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7478f5ab-ea42-4306-b64b-b44902a9ad23 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:56.031760 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7478f5ab-ea42-4306-b64b-b44902a9ad23 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:56.032189 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7478f5ab-ea42-4306-b64b-b44902a9ad23 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:56.041134 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4f6b3b86-4a80-45ae-8b32-ef3321543eba tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.026520 Oct 30 01:14:56.041763 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 219/419] 10.222.0.13 () {58 vars in 1146 bytes} [Sun Oct 30 01:14:56 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:56.062628 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0769950c-c874-4f7d-9a43-b204b222b8e1 tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-49978048", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:56.067814 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7478f5ab-ea42-4306-b64b-b44902a9ad23 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:56.068323 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7478f5ab-ea42-4306-b64b-b44902a9ad23 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:56.070140 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7478f5ab-ea42-4306-b64b-b44902a9ad23 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:56.070140 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-7478f5ab-ea42-4306-b64b-b44902a9ad23 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lazy-loading 'fault' on Instance uuid 27cf9c57-37a3-4ccb-ba37-bc66ff5423cd {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:14:56.121582 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7478f5ab-ea42-4306-b64b-b44902a9ad23 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464f9e9314154e3f9c779b9ae10b2a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a83b0b15194aa69fc4d82876a1e6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:56.126530 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7478f5ab-ea42-4306-b64b-b44902a9ad23 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] 10.222.0.13 "GET /compute/v2.1/servers/27cf9c57-37a3-4ccb-ba37-bc66ff5423cd" status: 200 len: 1308 microversion: 2.1 time: 0.107229 Oct 30 01:14:56.127323 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 201/420] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:56 2022] GET /compute/v2.1/servers/27cf9c57-37a3-4ccb-ba37-bc66ff5423cd => generated 1308 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:56.136465 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-656dbb49-6bc1-47fe-a2d9-2f0969d60528 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:56.137706 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-656dbb49-6bc1-47fe-a2d9-2f0969d60528 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0dd3f0e2-2c15-4915-88b0-2df9e312cc4c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:56.150554 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0769950c-c874-4f7d-9a43-b204b222b8e1 tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 505 microversion: 2.1 time: 0.091327 Oct 30 01:14:56.151993 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 220/421] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:14:56 2022] POST /compute/v2.1/flavors => generated 505 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:14:56.153621 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-656dbb49-6bc1-47fe-a2d9-2f0969d60528 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:56.156781 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-656dbb49-6bc1-47fe-a2d9-2f0969d60528 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:56.156781 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-656dbb49-6bc1-47fe-a2d9-2f0969d60528 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:56.156781 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-656dbb49-6bc1-47fe-a2d9-2f0969d60528 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:56.156781 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-656dbb49-6bc1-47fe-a2d9-2f0969d60528 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:56.157227 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-656dbb49-6bc1-47fe-a2d9-2f0969d60528 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:56.167898 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-39182222-98ba-4875-89f6-28d9517ed32c tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:56.232190 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-656dbb49-6bc1-47fe-a2d9-2f0969d60528 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:56.239980 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-656dbb49-6bc1-47fe-a2d9-2f0969d60528 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c" status: 200 len: 1215 microversion: 2.1 time: 0.107818 Oct 30 01:14:56.240554 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 202/422] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:56 2022] GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c => generated 1215 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:56.264312 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-39182222-98ba-4875-89f6-28d9517ed32c tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/9629a5dd-2be9-4691-b7a6-01e03ebad9a1" status: 202 len: 0 microversion: 2.1 time: 0.102612 Oct 30 01:14:56.264946 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 221/423] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:14:56 2022] DELETE /compute/v2.1/flavors/9629a5dd-2be9-4691-b7a6-01e03ebad9a1 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:14:56.277592 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-46a84307-0fc5-4fec-b5cf-b2742ac71b41 tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:56.283917 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=7,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:56.299103 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-46a84307-0fc5-4fec-b5cf-b2742ac71b41 tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.025421 Oct 30 01:14:56.299741 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 203/424] 10.222.0.13 () {58 vars in 1146 bytes} [Sun Oct 30 01:14:56 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:56.320513 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-438fe1f6-3f0a-4cd3-8eed-5f2545e38d20 tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1482616235", "id": "72cc4f33-bef7-4a52-91b2-4981d548db50", "os-flavor-access:is_public": "True"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:56.412180 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-438fe1f6-3f0a-4cd3-8eed-5f2545e38d20 tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.087773 Oct 30 01:14:56.412180 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 222/425] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:14:56 2022] POST /compute/v2.1/flavors => generated 507 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:56.422587 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8fd4cc6d-e066-4dae-9023-1376a9e44ad0 tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:56.529827 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8fd4cc6d-e066-4dae-9023-1376a9e44ad0 tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/72cc4f33-bef7-4a52-91b2-4981d548db50" status: 202 len: 0 microversion: 2.1 time: 0.111180 Oct 30 01:14:56.530402 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 204/426] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:14:56 2022] DELETE /compute/v2.1/flavors/72cc4f33-bef7-4a52-91b2-4981d548db50 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:14:56.541367 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9b87e982-8681-4a5f-ba41-efb973d77eac tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:56.578056 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9b87e982-8681-4a5f-ba41-efb973d77eac tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.043029 Oct 30 01:14:56.578715 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 223/427] 10.222.0.13 () {58 vars in 1146 bytes} [Sun Oct 30 01:14:56 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:14:56.602401 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-dd3ce266-5809-4967-8b14-75fe774ca07d tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1522344981", "id": 1838867865, "os-flavor-access:is_public": "True"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:56.604920 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f983b09f-3896-4de0-b366-2431cadd45d2 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:56.605579 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f983b09f-3896-4de0-b366-2431cadd45d2 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:56.612158 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f983b09f-3896-4de0-b366-2431cadd45d2 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:56.612648 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f983b09f-3896-4de0-b366-2431cadd45d2 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:56.613082 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f983b09f-3896-4de0-b366-2431cadd45d2 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:56.613878 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f983b09f-3896-4de0-b366-2431cadd45d2 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:56.614403 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f983b09f-3896-4de0-b366-2431cadd45d2 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:56.614820 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f983b09f-3896-4de0-b366-2431cadd45d2 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:56.688733 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-dd3ce266-5809-4967-8b14-75fe774ca07d tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.091691 Oct 30 01:14:56.689365 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 205/428] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:14:56 2022] POST /compute/v2.1/flavors => generated 414 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:14:56.703725 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9777f3b6-13fd-408e-b14d-fae382f44625 tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:56.717613 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9777f3b6-13fd-408e-b14d-fae382f44625 tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/1838867865" status: 200 len: 414 microversion: 2.1 time: 0.017825 Oct 30 01:14:56.718890 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 206/429] 10.222.0.13 () {58 vars in 1158 bytes} [Sun Oct 30 01:14:56 2022] GET /compute/v2.1/flavors/1838867865 => generated 414 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:56.723867 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9d24a0c9-0735-4462-9814-36d533fca223 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:56.728533 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9d24a0c9-0735-4462-9814-36d533fca223 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] [instance: 4f47f49f-e5a9-46d5-9622-c9c887891646] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:56.732470 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9d24a0c9-0735-4462-9814-36d533fca223 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:56.733296 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9d24a0c9-0735-4462-9814-36d533fca223 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:56.733859 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9d24a0c9-0735-4462-9814-36d533fca223 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:56.734679 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9d24a0c9-0735-4462-9814-36d533fca223 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:56.735338 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9d24a0c9-0735-4462-9814-36d533fca223 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:56.735923 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9d24a0c9-0735-4462-9814-36d533fca223 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:56.756728 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:56.864255 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f983b09f-3896-4de0-b366-2431cadd45d2 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:56.875401 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f983b09f-3896-4de0-b366-2431cadd45d2 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:56.879258 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f983b09f-3896-4de0-b366-2431cadd45d2 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:56.880080 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f983b09f-3896-4de0-b366-2431cadd45d2 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3" status: 200 len: 1361 microversion: 2.25 time: 0.278392 Oct 30 01:14:56.902651 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 224/430] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:14:56 2022] GET /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3 => generated 1361 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:14:56.996153 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9d24a0c9-0735-4462-9814-36d533fca223 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ccc0bfdee94961aa198e3abf0d85cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee1e04c04bc40568e43eb98df39e7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:57.004861 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9d24a0c9-0735-4462-9814-36d533fca223 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] 10.222.0.13 "GET /compute/v2.1/servers/4f47f49f-e5a9-46d5-9622-c9c887891646" status: 200 len: 1320 microversion: 2.1 time: 0.284801 Oct 30 01:14:57.017884 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 207/431] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:56 2022] GET /compute/v2.1/servers/4f47f49f-e5a9-46d5-9622-c9c887891646 => generated 1320 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:57.026832 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4a2c27e5-ce3e-4456-b15b-d08194ff7e01 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:57.028018 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4a2c27e5-ce3e-4456-b15b-d08194ff7e01 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:57.037070 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4a2c27e5-ce3e-4456-b15b-d08194ff7e01 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:57.037805 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4a2c27e5-ce3e-4456-b15b-d08194ff7e01 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:57.038672 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4a2c27e5-ce3e-4456-b15b-d08194ff7e01 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:57.039483 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4a2c27e5-ce3e-4456-b15b-d08194ff7e01 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:57.040210 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4a2c27e5-ce3e-4456-b15b-d08194ff7e01 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:57.040635 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4a2c27e5-ce3e-4456-b15b-d08194ff7e01 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:57.134700 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:57.185271 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bfa2b1d6-82f1-4412-a749-d3b1aa325ce0 tempest-FlavorsAdminTestJSON-413077360 tempest-FlavorsAdminTestJSON-413077360-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:57.191758 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4a2c27e5-ce3e-4456-b15b-d08194ff7e01 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:57.206733 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4a2c27e5-ce3e-4456-b15b-d08194ff7e01 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:57.216686 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4a2c27e5-ce3e-4456-b15b-d08194ff7e01 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:57.223746 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4a2c27e5-ce3e-4456-b15b-d08194ff7e01 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] 10.222.0.13 "GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 200 len: 1446 microversion: 2.75 time: 0.203716 Oct 30 01:14:57.224913 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 208/432] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:14:57 2022] GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 1446 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:14:57.231306 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-abb5b2a5-5372-4a28-8c6f-e90414ba7673 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:57.231927 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-abb5b2a5-5372-4a28-8c6f-e90414ba7673 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] [instance: 27cf9c57-37a3-4ccb-ba37-bc66ff5423cd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:57.259256 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bfa2b1d6-82f1-4412-a749-d3b1aa325ce0 tempest-FlavorsAdminTestJSON-413077360 tempest-FlavorsAdminTestJSON-413077360-project] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 6225 microversion: 2.1 time: 0.355465 Oct 30 01:14:57.260151 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 225/433] 10.222.0.13 () {58 vars in 1146 bytes} [Sun Oct 30 01:14:56 2022] GET /compute/v2.1/flavors/detail => generated 6225 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:57.266382 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7309e2e7-6d19-4d86-9fb5-a8310adfbd88 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:57.266993 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7309e2e7-6d19-4d86-9fb5-a8310adfbd88 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0dd3f0e2-2c15-4915-88b0-2df9e312cc4c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:57.268031 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-abb5b2a5-5372-4a28-8c6f-e90414ba7673 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:57.268923 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-abb5b2a5-5372-4a28-8c6f-e90414ba7673 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:57.269680 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-abb5b2a5-5372-4a28-8c6f-e90414ba7673 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:57.270709 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-abb5b2a5-5372-4a28-8c6f-e90414ba7673 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:57.271355 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-abb5b2a5-5372-4a28-8c6f-e90414ba7673 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:57.271928 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-abb5b2a5-5372-4a28-8c6f-e90414ba7673 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:57.274434 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7309e2e7-6d19-4d86-9fb5-a8310adfbd88 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:57.274996 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7309e2e7-6d19-4d86-9fb5-a8310adfbd88 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:57.275714 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7309e2e7-6d19-4d86-9fb5-a8310adfbd88 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:57.276333 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7309e2e7-6d19-4d86-9fb5-a8310adfbd88 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:57.276957 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7309e2e7-6d19-4d86-9fb5-a8310adfbd88 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:57.277755 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7309e2e7-6d19-4d86-9fb5-a8310adfbd88 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:57.309386 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-abb5b2a5-5372-4a28-8c6f-e90414ba7673 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] HTTP exception thrown: Instance 27cf9c57-37a3-4ccb-ba37-bc66ff5423cd could not be found. Oct 30 01:14:57.311293 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-abb5b2a5-5372-4a28-8c6f-e90414ba7673 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Request method failure captured: Oct 30 01:14:57.311293 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/27cf9c57-37a3-4ccb-ba37-bc66ff5423cd HTTP/1.1 Oct 30 01:14:57.311293 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:14:57.311293 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:14:57.311293 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:14:57.311293 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:14:57.311293 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:14:57.311293 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:14:57.311293 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:14:57.311293 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:14:57.311293 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXc_TU6zPqqxhnrPHFa-fHQyi7BXJ4dCXLKZ9qWrFgiPNXiGSEkkV4NkgWvgdm8NmzzsIcUKp7e1WNqG8Q_X_wUTk0vWbmJCpeDztteaGRjLvr6C-Ju6KAFBK4qv84W-lVGiSNpCvp8KCKoCpmAbn-tItWDK44MJLUXytZhz3zrAAsmc Oct 30 01:14:57.311293 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:14:57.311293 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:14:57.311293 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:14:57.311293 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:14:57.311293 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:14:57.311293 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:14:57.311293 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 72a83b0b15194aa69fc4d82876a1e6fd Oct 30 01:14:57.311293 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-LiveMigrationNegativeTest-1985219618 Oct 30 01:14:57.311293 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:14:57.311293 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:14:57.318939 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/72a83b0b15194aa69fc4d82876a1e6fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_72a83b0b15194aa69fc4d82876a1e6fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/72a83b0b15194aa69fc4d82876a1e6fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/72a83b0b15194aa69fc4d82876a1e6fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:14:57.318939 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-LiveMigrationNegativeTest-1985219618 Oct 30 01:14:57.318939 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 72a83b0b15194aa69fc4d82876a1e6fd Oct 30 01:14:57.318939 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1985219618 Oct 30 01:14:57.318939 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-LiveMigrationNegativeTest-1985219618-project Oct 30 01:14:57.318939 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:14:57.318939 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:14:57.318939 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 464f9e9314154e3f9c779b9ae10b2a73 Oct 30 01:14:57.318939 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-LiveMigrationNegativeTest-1985219618-project Oct 30 01:14:57.318939 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:14:57.318939 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 27cf9c57-37a3-4ccb-ba37-bc66ff5423cd could not be found. Oct 30 01:14:57.318939 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '27cf9c57-37a3-4ccb-ba37-bc66ff5423cd'} Oct 30 01:14:57.319788 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:14:57.319788 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:57.319788 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:14:57.319788 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:14:57.319788 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:14:57.319788 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:14:57.319788 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:14:57.319788 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:14:57.319788 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:14:57.319788 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:14:57.319788 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27cf9c57-37a3-4ccb-ba37-bc66ff5423cd could not be found. Oct 30 01:14:57.319788 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:57.319788 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:57.319788 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:57.319788 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:57.319788 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:57.319788 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:57.319788 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:14:57.319788 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:14:57.319788 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:14:57.321162 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:14:57.321162 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:14:57.321162 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:14:57.321162 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:14:57.321162 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:14:57.321162 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:14:57.321162 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:14:57.321162 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27cf9c57-37a3-4ccb-ba37-bc66ff5423cd could not be found. Oct 30 01:14:57.321162 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:57.321162 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:57.321162 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:57.321162 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:57.321162 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:57.321162 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:57.321162 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:14:57.321162 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:14:57.321162 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27cf9c57-37a3-4ccb-ba37-bc66ff5423cd could not be found. Oct 30 01:14:57.321162 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:57.322416 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-abb5b2a5-5372-4a28-8c6f-e90414ba7673 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Returning 404 to user: Instance 27cf9c57-37a3-4ccb-ba37-bc66ff5423cd could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:14:57.322416 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-abb5b2a5-5372-4a28-8c6f-e90414ba7673 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] 10.222.0.13 "GET /compute/v2.1/servers/27cf9c57-37a3-4ccb-ba37-bc66ff5423cd" status: 404 len: 111 microversion: 2.1 time: 0.087301 Oct 30 01:14:57.322416 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 209/434] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:57 2022] GET /compute/v2.1/servers/27cf9c57-37a3-4ccb-ba37-bc66ff5423cd => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:14:57.322416 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c37f7a30-51ca-4457-9210-a2c7c8adf050 tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:57.383816 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7309e2e7-6d19-4d86-9fb5-a8310adfbd88 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:57.393397 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7309e2e7-6d19-4d86-9fb5-a8310adfbd88 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c" status: 200 len: 1207 microversion: 2.1 time: 0.131055 Oct 30 01:14:57.394013 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 226/435] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:57 2022] GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c => generated 1207 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:57.398846 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b208667a-a477-4c9e-86d0-c9631ffce25c tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:57.400311 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b208667a-a477-4c9e-86d0-c9631ffce25c tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] [instance: ac13f3c4-a93f-4664-b102-aa57f9c63308] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:57.405867 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b208667a-a477-4c9e-86d0-c9631ffce25c tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:57.406357 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b208667a-a477-4c9e-86d0-c9631ffce25c tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:57.406787 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b208667a-a477-4c9e-86d0-c9631ffce25c tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:57.407488 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b208667a-a477-4c9e-86d0-c9631ffce25c tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:57.408113 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b208667a-a477-4c9e-86d0-c9631ffce25c tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:57.408534 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b208667a-a477-4c9e-86d0-c9631ffce25c tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:57.439385 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b208667a-a477-4c9e-86d0-c9631ffce25c tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] [instance: ac13f3c4-a93f-4664-b102-aa57f9c63308] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:14:57.491018 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c37f7a30-51ca-4457-9210-a2c7c8adf050 tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1838867865" status: 202 len: 0 microversion: 2.1 time: 0.174740 Oct 30 01:14:57.491915 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 210/436] 10.222.0.13 () {58 vars in 1161 bytes} [Sun Oct 30 01:14:57 2022] DELETE /compute/v2.1/flavors/1838867865 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:14:57.500093 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-35ca4db6-9d74-4ec5-a6f0-58abdc7fac9f tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:57.532903 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-35ca4db6-9d74-4ec5-a6f0-58abdc7fac9f tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.036751 Oct 30 01:14:57.533819 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 211/437] 10.222.0.13 () {58 vars in 1146 bytes} [Sun Oct 30 01:14:57 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:57.557673 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-29a6826c-378c-4534-84ac-11aef2061e34 tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-629075776", "id": 94610849, "os-flavor-access:is_public": "False"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:57.699037 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-29a6826c-378c-4534-84ac-11aef2061e34 tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 423 microversion: 2.1 time: 0.147461 Oct 30 01:14:57.699674 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 212/438] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:14:57 2022] POST /compute/v2.1/flavors => generated 423 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:14:57.712768 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4df7807a-ccb5-4c3b-970e-51d26995ca09 tempest-FlavorsAdminTestJSON-413077360 tempest-FlavorsAdminTestJSON-413077360-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "94610849"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:57.724082 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-4df7807a-ccb5-4c3b-970e-51d26995ca09 tempest-FlavorsAdminTestJSON-413077360 tempest-FlavorsAdminTestJSON-413077360-project] HTTP exception thrown: Flavor 94610849 could not be found. Oct 30 01:14:57.726264 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4df7807a-ccb5-4c3b-970e-51d26995ca09 tempest-FlavorsAdminTestJSON-413077360 tempest-FlavorsAdminTestJSON-413077360-project] Request method failure captured: Oct 30 01:14:57.726264 n-d-master-1 devstack@n-api.service[121103]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 30 01:14:57.726264 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:14:57.726264 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:14:57.726264 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:14:57.726264 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 105 Oct 30 01:14:57.726264 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:14:57.726264 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:14:57.726264 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:14:57.726264 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:14:57.726264 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdAMWjoYSZ3nnQZx7actHGNUUIPv-8PZwK6YqW-gm8CzhvHRAcfrOQr5LmuMDYM4o4c514C0RX3M6IBd1m6QlUAhnIkVRn9W1NZxr8FLnbJwQPpCTZC_EITAAwmfB3aZmlezXVAlWTYOp-Rgs4blb7jLRx_2sP5lFfGX2cj1xJZMOWM Oct 30 01:14:57.726264 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:14:57.726264 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:14:57.726264 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:14:57.726264 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:14:57.726264 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:14:57.726264 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:14:57.726264 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 655e0c44b17841e9983d8d6aa2ae123e Oct 30 01:14:57.726264 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-FlavorsAdminTestJSON-413077360 Oct 30 01:14:57.726264 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:14:57.726264 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:14:57.727878 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/655e0c44b17841e9983d8d6aa2ae123e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_655e0c44b17841e9983d8d6aa2ae123e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/655e0c44b17841e9983d8d6aa2ae123e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/655e0c44b17841e9983d8d6aa2ae123e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:14:57.727878 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-FlavorsAdminTestJSON-413077360 Oct 30 01:14:57.727878 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 655e0c44b17841e9983d8d6aa2ae123e Oct 30 01:14:57.727878 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-413077360 Oct 30 01:14:57.727878 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-FlavorsAdminTestJSON-413077360-project Oct 30 01:14:57.727878 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:14:57.727878 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:14:57.727878 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: a86c7309cd844c8eb980e555b668c6bf Oct 30 01:14:57.727878 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-FlavorsAdminTestJSON-413077360-project Oct 30 01:14:57.727878 n-d-master-1 devstack@n-api.service[121103]: Oct 30 01:14:57.727878 n-d-master-1 devstack@n-api.service[121103]: {"server": {"name": "test", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "94610849"}} Oct 30 01:14:57.727878 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:14:57.727878 n-d-master-1 devstack@n-api.service[121103]: exception: Flavor 94610849 could not be found. Oct 30 01:14:57.728782 n-d-master-1 devstack@n-api.service[121103]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'deb14158-45d8-4539-889d-ff9726d046d7', 'flavorRef': '94610849'}}} Oct 30 01:14:57.728782 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:14:57.728782 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:57.728782 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 30 01:14:57.728782 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 30 01:14:57.728782 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 30 01:14:57.728782 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 30 01:14:57.728782 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 01:14:57.728782 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 01:14:57.728782 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 30 01:14:57.728782 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 30 01:14:57.728782 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 30 01:14:57.728782 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:14:57.728782 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 30 01:14:57.728782 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 30 01:14:57.728782 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 94610849 could not be found. Oct 30 01:14:57.728782 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:57.728782 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:57.728782 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:57.728782 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:57.730251 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:57.730251 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:57.730251 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:14:57.730251 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:14:57.730251 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:14:57.730251 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:14:57.730251 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:14:57.730251 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:14:57.730251 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:14:57.730251 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:14:57.730251 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:14:57.730251 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:14:57.730251 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 30 01:14:57.730251 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 30 01:14:57.730251 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 30 01:14:57.730251 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 94610849 could not be found. Oct 30 01:14:57.730251 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:57.730251 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:14:57.730251 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:57.730251 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:14:57.730251 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:14:57.731691 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:14:57.731691 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:14:57.731691 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:14:57.731691 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 94610849 could not be found. Oct 30 01:14:57.731691 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:14:57.731691 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4df7807a-ccb5-4c3b-970e-51d26995ca09 tempest-FlavorsAdminTestJSON-413077360 tempest-FlavorsAdminTestJSON-413077360-project] Returning 400 to user: Flavor 94610849 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:14:57.731691 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4df7807a-ccb5-4c3b-970e-51d26995ca09 tempest-FlavorsAdminTestJSON-413077360 tempest-FlavorsAdminTestJSON-413077360-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 79 microversion: 2.1 time: 0.019283 Oct 30 01:14:57.731691 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 213/439] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:14:57 2022] POST /compute/v2.1/servers => generated 79 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 30 01:14:57.737773 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bed5871f-f4e1-4f11-ae87-1b49926a1aba tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:57.821416 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4,nova_api:DELETE=6 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:57.854617 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bed5871f-f4e1-4f11-ae87-1b49926a1aba tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/94610849" status: 202 len: 0 microversion: 2.1 time: 0.121821 Oct 30 01:14:57.855208 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 214/440] 10.222.0.13 () {58 vars in 1155 bytes} [Sun Oct 30 01:14:57 2022] DELETE /compute/v2.1/flavors/94610849 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 30 01:14:57.866914 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7268e3c2-41d6-4b6d-95a0-63478ea0f966 tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:57.906272 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7268e3c2-41d6-4b6d-95a0-63478ea0f966 tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.043664 Oct 30 01:14:57.907329 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 215/441] 10.222.0.13 () {58 vars in 1146 bytes} [Sun Oct 30 01:14:57 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:14:57.912889 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2341d27a-441d-4314-83f8-24d01ad56882 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:57.913563 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2341d27a-441d-4314-83f8-24d01ad56882 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:57.918151 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b208667a-a477-4c9e-86d0-c9631ffce25c tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ac13f3c4-a93f-4664-b102-aa57f9c63308" status: 204 len: 0 microversion: 2.1 time: 0.522456 Oct 30 01:14:57.918829 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 227/442] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:14:57 2022] DELETE /compute/v2.1/servers/ac13f3c4-a93f-4664-b102-aa57f9c63308 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:14:57.925500 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2341d27a-441d-4314-83f8-24d01ad56882 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:57.925500 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2341d27a-441d-4314-83f8-24d01ad56882 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:57.925734 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2341d27a-441d-4314-83f8-24d01ad56882 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:57.928359 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-aa1afa74-0c61-4623-a2da-8e5dd4fe540b tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:57.929294 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-aa1afa74-0c61-4623-a2da-8e5dd4fe540b tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] [instance: ac13f3c4-a93f-4664-b102-aa57f9c63308] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:57.938618 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aa1afa74-0c61-4623-a2da-8e5dd4fe540b tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:57.939384 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aa1afa74-0c61-4623-a2da-8e5dd4fe540b tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:57.939842 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aa1afa74-0c61-4623-a2da-8e5dd4fe540b tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:57.940721 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aa1afa74-0c61-4623-a2da-8e5dd4fe540b tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:57.941224 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aa1afa74-0c61-4623-a2da-8e5dd4fe540b tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:57.942214 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aa1afa74-0c61-4623-a2da-8e5dd4fe540b tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:57.943300 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2341d27a-441d-4314-83f8-24d01ad56882 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:57.943928 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2341d27a-441d-4314-83f8-24d01ad56882 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:57.944371 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2341d27a-441d-4314-83f8-24d01ad56882 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:58.149487 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-aa1afa74-0c61-4623-a2da-8e5dd4fe540b tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464f9e9314154e3f9c779b9ae10b2a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a83b0b15194aa69fc4d82876a1e6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:58.155867 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2341d27a-441d-4314-83f8-24d01ad56882 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:58.158592 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-aa1afa74-0c61-4623-a2da-8e5dd4fe540b tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] 10.222.0.13 "GET /compute/v2.1/servers/ac13f3c4-a93f-4664-b102-aa57f9c63308" status: 200 len: 1474 microversion: 2.1 time: 0.235274 Oct 30 01:14:58.159187 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 228/443] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:57 2022] GET /compute/v2.1/servers/ac13f3c4-a93f-4664-b102-aa57f9c63308 => generated 1474 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:58.163915 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-24cb1579-0507-4ddf-aabd-c7821e2656ac tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1787212139", "id": 320011716, "os-flavor-access:is_public": "False"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:58.168873 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2341d27a-441d-4314-83f8-24d01ad56882 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:58.172534 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2341d27a-441d-4314-83f8-24d01ad56882 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:58.172534 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2341d27a-441d-4314-83f8-24d01ad56882 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3" status: 200 len: 1555 microversion: 2.25 time: 0.263636 Oct 30 01:14:58.176355 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 216/444] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:14:57 2022] GET /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3 => generated 1555 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:14:58.180204 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9a0f6d42-0903-4b6b-b165-e9b840b27048 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:58.180940 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9a0f6d42-0903-4b6b-b165-e9b840b27048 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] [instance: 4f47f49f-e5a9-46d5-9622-c9c887891646] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:58.187322 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9a0f6d42-0903-4b6b-b165-e9b840b27048 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:58.187848 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9a0f6d42-0903-4b6b-b165-e9b840b27048 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:58.188272 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9a0f6d42-0903-4b6b-b165-e9b840b27048 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:58.188986 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9a0f6d42-0903-4b6b-b165-e9b840b27048 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:58.189484 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9a0f6d42-0903-4b6b-b165-e9b840b27048 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:58.189875 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9a0f6d42-0903-4b6b-b165-e9b840b27048 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:58.287937 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-24cb1579-0507-4ddf-aabd-c7821e2656ac tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.127202 Oct 30 01:14:58.288238 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 229/445] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:14:58 2022] POST /compute/v2.1/flavors => generated 412 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:58.438353 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9a0f6d42-0903-4b6b-b165-e9b840b27048 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ccc0bfdee94961aa198e3abf0d85cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee1e04c04bc40568e43eb98df39e7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:58.452431 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9a0f6d42-0903-4b6b-b165-e9b840b27048 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] 10.222.0.13 "GET /compute/v2.1/servers/4f47f49f-e5a9-46d5-9622-c9c887891646" status: 200 len: 1320 microversion: 2.1 time: 0.278162 Oct 30 01:14:58.453411 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 217/446] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:58 2022] GET /compute/v2.1/servers/4f47f49f-e5a9-46d5-9622-c9c887891646 => generated 1320 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:58.462461 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-28f5f351-67e5-4685-ab59-4510c8474639 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:58.464058 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-28f5f351-67e5-4685-ab59-4510c8474639 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:58.476381 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-28f5f351-67e5-4685-ab59-4510c8474639 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:58.477839 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-28f5f351-67e5-4685-ab59-4510c8474639 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:58.478924 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-28f5f351-67e5-4685-ab59-4510c8474639 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:58.480756 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-28f5f351-67e5-4685-ab59-4510c8474639 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:58.481934 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-28f5f351-67e5-4685-ab59-4510c8474639 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:58.483042 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-28f5f351-67e5-4685-ab59-4510c8474639 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:58.568116 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9ec9aabb-4d26-4864-b2c4-70a208de0dff tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:58.569000 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9ec9aabb-4d26-4864-b2c4-70a208de0dff tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] [instance: 6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:58.581025 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9ec9aabb-4d26-4864-b2c4-70a208de0dff tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:58.585731 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9ec9aabb-4d26-4864-b2c4-70a208de0dff tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:58.585731 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9ec9aabb-4d26-4864-b2c4-70a208de0dff tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:58.585731 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9ec9aabb-4d26-4864-b2c4-70a208de0dff tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:58.586065 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9ec9aabb-4d26-4864-b2c4-70a208de0dff tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:58.586065 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9ec9aabb-4d26-4864-b2c4-70a208de0dff tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:58.597177 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-28f5f351-67e5-4685-ab59-4510c8474639 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:58.606517 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-28f5f351-67e5-4685-ab59-4510c8474639 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:58.607964 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-28f5f351-67e5-4685-ab59-4510c8474639 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:58.623411 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-28f5f351-67e5-4685-ab59-4510c8474639 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] 10.222.0.13 "GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 200 len: 1446 microversion: 2.75 time: 0.167891 Oct 30 01:14:58.624639 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 218/447] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:14:58 2022] GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 1446 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:14:58.636777 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-81dde6e9-628d-4c8c-8ad1-83c26a7aad1e tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1124584924", "id": 1422321669, "os-flavor-access:is_public": "True"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:58.740024 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-81dde6e9-628d-4c8c-8ad1-83c26a7aad1e tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.112770 Oct 30 01:14:58.740741 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 219/448] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:14:58 2022] POST /compute/v2.1/flavors => generated 414 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:58.745456 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-66218383-41b5-4bba-befb-007841897304 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:58.746068 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-66218383-41b5-4bba-befb-007841897304 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0dd3f0e2-2c15-4915-88b0-2df9e312cc4c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:58.753201 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-66218383-41b5-4bba-befb-007841897304 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:58.753201 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-66218383-41b5-4bba-befb-007841897304 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:58.753201 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-66218383-41b5-4bba-befb-007841897304 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:58.754261 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-66218383-41b5-4bba-befb-007841897304 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:58.754774 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-66218383-41b5-4bba-befb-007841897304 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:58.755260 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-66218383-41b5-4bba-befb-007841897304 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:58.791456 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-9ec9aabb-4d26-4864-b2c4-70a208de0dff tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lazy-loading 'services' on Instance uuid 6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:14:58.834148 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-66218383-41b5-4bba-befb-007841897304 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:58.842929 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-66218383-41b5-4bba-befb-007841897304 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c" status: 200 len: 1281 microversion: 2.1 time: 0.101271 Oct 30 01:14:58.843519 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 220/449] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:58 2022] GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c => generated 1281 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:58.849222 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9876b8ce-7e1c-4a2e-889e-f5a056bd8074 tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:58.859639 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9ec9aabb-4d26-4864-b2c4-70a208de0dff tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3" status: 200 len: 2047 microversion: 2.25 time: 0.570025 Oct 30 01:14:58.860395 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 230/450] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:14:58 2022] GET /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3 => generated 2047 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:14:58.878116 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9876b8ce-7e1c-4a2e-889e-f5a056bd8074 tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 415 microversion: 2.1 time: 0.033536 Oct 30 01:14:58.878993 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 221/451] 10.222.0.13 () {58 vars in 1169 bytes} [Sun Oct 30 01:14:58 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 415 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:58.886651 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-684a1bca-817d-4147-a216-85b3a784d3fd tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:58.887543 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-684a1bca-817d-4147-a216-85b3a784d3fd tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] [instance: 6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:58.898969 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-684a1bca-817d-4147-a216-85b3a784d3fd tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:58.899781 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-684a1bca-817d-4147-a216-85b3a784d3fd tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:58.900016 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-684a1bca-817d-4147-a216-85b3a784d3fd tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:58.900798 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-684a1bca-817d-4147-a216-85b3a784d3fd tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:58.901309 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-684a1bca-817d-4147-a216-85b3a784d3fd tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:58.901931 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-65106c7a-448b-4066-98fc-a01220d7d02f tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:58.902211 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-684a1bca-817d-4147-a216-85b3a784d3fd tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:58.915525 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-65106c7a-448b-4066-98fc-a01220d7d02f tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 415 microversion: 2.1 time: 0.022084 Oct 30 01:14:58.916284 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 222/452] 10.222.0.13 () {58 vars in 1177 bytes} [Sun Oct 30 01:14:58 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 415 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:14:58.939404 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8da31285-ae34-45d4-824f-83014807a354 tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:58.953177 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8da31285-ae34-45d4-824f-83014807a354 tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 415 microversion: 2.1 time: 0.021330 Oct 30 01:14:58.956631 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 223/453] 10.222.0.13 () {58 vars in 1171 bytes} [Sun Oct 30 01:14:58 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 415 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:14:58.969355 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3d209d3f-f937-431a-8fd7-19508dca87dd tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:58.981783 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3d209d3f-f937-431a-8fd7-19508dca87dd tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 415 microversion: 2.1 time: 0.016108 Oct 30 01:14:58.983524 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 224/454] 10.222.0.13 () {58 vars in 1169 bytes} [Sun Oct 30 01:14:58 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 415 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:14:59.008633 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cd1472b3-ac28-499e-a04b-2651e39fc678 tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:59.033478 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cd1472b3-ac28-499e-a04b-2651e39fc678 tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 6225 microversion: 2.1 time: 0.029840 Oct 30 01:14:59.034277 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 225/455] 10.222.0.13 () {58 vars in 1169 bytes} [Sun Oct 30 01:14:59 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 6225 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:14:59.078102 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-07e442a0-f25b-454e-9ef8-dbc204f27137 tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:59.116304 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-684a1bca-817d-4147-a216-85b3a784d3fd tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lazy-loading 'services' on Instance uuid 6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:14:59.128791 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-07e442a0-f25b-454e-9ef8-dbc204f27137 tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 6225 microversion: 2.1 time: 0.058899 Oct 30 01:14:59.145800 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 226/456] 10.222.0.13 () {58 vars in 1175 bytes} [Sun Oct 30 01:14:59 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 6225 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:59.148956 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-684a1bca-817d-4147-a216-85b3a784d3fd tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3" status: 200 len: 2047 microversion: 2.25 time: 0.266964 Oct 30 01:14:59.159384 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 231/457] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:14:58 2022] GET /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3 => generated 2047 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:14:59.175620 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-85d45af6-3cda-4615-aedb-c81af6b1830c tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:59.185678 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-37806c15-577d-45cf-ac5f-73022d921d1d tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:59.190383 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-37806c15-577d-45cf-ac5f-73022d921d1d tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:59.191181 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-37806c15-577d-45cf-ac5f-73022d921d1d tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:59.191619 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-37806c15-577d-45cf-ac5f-73022d921d1d tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:59.192410 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-37806c15-577d-45cf-ac5f-73022d921d1d tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:59.193060 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-37806c15-577d-45cf-ac5f-73022d921d1d tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:59.193952 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-37806c15-577d-45cf-ac5f-73022d921d1d tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:59.218141 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-85d45af6-3cda-4615-aedb-c81af6b1830c tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 6225 microversion: 2.1 time: 0.048926 Oct 30 01:14:59.225532 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 227/458] 10.222.0.13 () {58 vars in 1173 bytes} [Sun Oct 30 01:14:59 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 6225 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:59.239013 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fed06ab2-e528-41ee-800e-60f4e01f1588 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:59.239941 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-fed06ab2-e528-41ee-800e-60f4e01f1588 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] [instance: ac13f3c4-a93f-4664-b102-aa57f9c63308] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:59.253449 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fed06ab2-e528-41ee-800e-60f4e01f1588 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:59.253979 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fed06ab2-e528-41ee-800e-60f4e01f1588 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:59.254417 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fed06ab2-e528-41ee-800e-60f4e01f1588 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:59.255192 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fed06ab2-e528-41ee-800e-60f4e01f1588 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:59.255722 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fed06ab2-e528-41ee-800e-60f4e01f1588 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:59.256090 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fed06ab2-e528-41ee-800e-60f4e01f1588 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:59.271264 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-37806c15-577d-45cf-ac5f-73022d921d1d tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.080281 Oct 30 01:14:59.271264 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 232/459] 10.222.0.13 () {60 vars in 1217 bytes} [Sun Oct 30 01:14:59 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:14:59.271264 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-e22ff595-9510-4e1c-9173-5bb0641a4816 req-39ff79ec-88c1-484a-acca-f240e392ec04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f47f49f-e5a9-46d5-9622-c9c887891646", "name": "network-vif-plugged", "status": "completed", "tag": "cd794d5d-fb9d-4c11-a17d-bf11f86e2a54"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:59.283748 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-e22ff595-9510-4e1c-9173-5bb0641a4816 req-39ff79ec-88c1-484a-acca-f240e392ec04 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:59.284355 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-e22ff595-9510-4e1c-9173-5bb0641a4816 req-39ff79ec-88c1-484a-acca-f240e392ec04 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:59.285507 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-e22ff595-9510-4e1c-9173-5bb0641a4816 req-39ff79ec-88c1-484a-acca-f240e392ec04 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:59.300341 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-e22ff595-9510-4e1c-9173-5bb0641a4816 req-39ff79ec-88c1-484a-acca-f240e392ec04 service nova] Creating event network-vif-plugged:cd794d5d-fb9d-4c11-a17d-bf11f86e2a54 for instance 4f47f49f-e5a9-46d5-9622-c9c887891646 on n-h1-master-1 Oct 30 01:14:59.306908 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-e22ff595-9510-4e1c-9173-5bb0641a4816 req-39ff79ec-88c1-484a-acca-f240e392ec04 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042517 Oct 30 01:14:59.310122 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 233/460] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:14:59.320637 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-502defb9-bd02-4d76-8937-d291e09774ad tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:59.351261 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-502defb9-bd02-4d76-8937-d291e09774ad tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 6225 microversion: 2.1 time: 0.038358 Oct 30 01:14:59.366369 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 234/461] 10.222.0.13 () {58 vars in 1169 bytes} [Sun Oct 30 01:14:59 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 6225 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:59.371331 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a18fe2a4-d47e-41a7-83f7-aebbbc2a9aa0 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": "auto"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:14:59.374270 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a18fe2a4-d47e-41a7-83f7-aebbbc2a9aa0 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] [instance: 6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:59.380858 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a18fe2a4-d47e-41a7-83f7-aebbbc2a9aa0 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:59.382353 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a18fe2a4-d47e-41a7-83f7-aebbbc2a9aa0 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:59.382353 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a18fe2a4-d47e-41a7-83f7-aebbbc2a9aa0 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:59.383337 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a18fe2a4-d47e-41a7-83f7-aebbbc2a9aa0 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:59.384015 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a18fe2a4-d47e-41a7-83f7-aebbbc2a9aa0 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:59.384927 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a18fe2a4-d47e-41a7-83f7-aebbbc2a9aa0 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:59.493400 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-a18fe2a4-d47e-41a7-83f7-aebbbc2a9aa0 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lazy-loading 'flavor' on Instance uuid 6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:14:59.529992 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-fed06ab2-e528-41ee-800e-60f4e01f1588 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464f9e9314154e3f9c779b9ae10b2a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a83b0b15194aa69fc4d82876a1e6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:59.540317 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fed06ab2-e528-41ee-800e-60f4e01f1588 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] 10.222.0.13 "GET /compute/v2.1/servers/ac13f3c4-a93f-4664-b102-aa57f9c63308" status: 200 len: 1474 microversion: 2.1 time: 0.317865 Oct 30 01:14:59.540317 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 228/462] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:59 2022] GET /compute/v2.1/servers/ac13f3c4-a93f-4664-b102-aa57f9c63308 => generated 1474 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:59.551451 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2368c872-43bb-4cd7-af2d-dc07c59dc5ae tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:59.578105 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a18fe2a4-d47e-41a7-83f7-aebbbc2a9aa0 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] [instance: 6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3] Going to try to live migrate instance to n-h1-master-1 {{(pid=121102) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 30 01:14:59.664513 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2368c872-43bb-4cd7-af2d-dc07c59dc5ae tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1422321669" status: 202 len: 0 microversion: 2.1 time: 0.124726 Oct 30 01:14:59.665109 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 229/463] 10.222.0.13 () {58 vars in 1161 bytes} [Sun Oct 30 01:14:59 2022] DELETE /compute/v2.1/flavors/1422321669 => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:14:59.670578 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a4ac7e2b-c6e6-452e-bf27-03987f42e42d tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:59.671199 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a4ac7e2b-c6e6-452e-bf27-03987f42e42d tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] [instance: 4f47f49f-e5a9-46d5-9622-c9c887891646] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:59.677550 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a4ac7e2b-c6e6-452e-bf27-03987f42e42d tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:59.678054 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a4ac7e2b-c6e6-452e-bf27-03987f42e42d tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:59.678495 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a4ac7e2b-c6e6-452e-bf27-03987f42e42d tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:59.679216 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a4ac7e2b-c6e6-452e-bf27-03987f42e42d tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:59.679677 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a4ac7e2b-c6e6-452e-bf27-03987f42e42d tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:59.680105 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a4ac7e2b-c6e6-452e-bf27-03987f42e42d tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:59.894828 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a4ac7e2b-c6e6-452e-bf27-03987f42e42d tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ccc0bfdee94961aa198e3abf0d85cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee1e04c04bc40568e43eb98df39e7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:14:59.903968 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a4ac7e2b-c6e6-452e-bf27-03987f42e42d tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] 10.222.0.13 "GET /compute/v2.1/servers/4f47f49f-e5a9-46d5-9622-c9c887891646" status: 200 len: 1320 microversion: 2.1 time: 0.237516 Oct 30 01:14:59.904556 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 230/464] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:14:59 2022] GET /compute/v2.1/servers/4f47f49f-e5a9-46d5-9622-c9c887891646 => generated 1320 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:14:59.909593 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0694725d-9f51-43fa-a652-62a7813cca9a tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:14:59.910430 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0694725d-9f51-43fa-a652-62a7813cca9a tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:14:59.917374 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0694725d-9f51-43fa-a652-62a7813cca9a tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:59.920463 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0694725d-9f51-43fa-a652-62a7813cca9a tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:59.920963 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0694725d-9f51-43fa-a652-62a7813cca9a tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:14:59.923744 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0694725d-9f51-43fa-a652-62a7813cca9a tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:14:59.924208 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0694725d-9f51-43fa-a652-62a7813cca9a tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:14:59.926966 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0694725d-9f51-43fa-a652-62a7813cca9a tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:00.255961 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0694725d-9f51-43fa-a652-62a7813cca9a tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:00.274108 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0694725d-9f51-43fa-a652-62a7813cca9a tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:00.275949 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0694725d-9f51-43fa-a652-62a7813cca9a tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:00.282001 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0694725d-9f51-43fa-a652-62a7813cca9a tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] 10.222.0.13 "GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 200 len: 1446 microversion: 2.75 time: 0.376239 Oct 30 01:15:00.302644 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 231/465] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:14:59 2022] GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 1446 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:00.307267 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-10472470-ef6f-4af7-b802-b812e84de52a tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:00.333615 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-10472470-ef6f-4af7-b802-b812e84de52a tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.028838 Oct 30 01:15:00.338642 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 232/466] 10.222.0.13 () {58 vars in 1146 bytes} [Sun Oct 30 01:15:00 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:00.354264 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f337501f-55da-4086-9084-c06bdf1ca11b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:00.354888 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f337501f-55da-4086-9084-c06bdf1ca11b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0dd3f0e2-2c15-4915-88b0-2df9e312cc4c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:00.372102 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f337501f-55da-4086-9084-c06bdf1ca11b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:00.376157 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f337501f-55da-4086-9084-c06bdf1ca11b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:00.378904 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f337501f-55da-4086-9084-c06bdf1ca11b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:00.379296 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f337501f-55da-4086-9084-c06bdf1ca11b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:00.379816 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f337501f-55da-4086-9084-c06bdf1ca11b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:00.380341 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f337501f-55da-4086-9084-c06bdf1ca11b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:00.704324 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f337501f-55da-4086-9084-c06bdf1ca11b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:00.718430 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f337501f-55da-4086-9084-c06bdf1ca11b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c" status: 200 len: 1311 microversion: 2.1 time: 0.375246 Oct 30 01:15:00.719497 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 233/467] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:00 2022] GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c => generated 1311 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:00.728394 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c884680f-557e-4ecc-aac5-f8b47f0dcaeb tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:00.843962 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c884680f-557e-4ecc-aac5-f8b47f0dcaeb tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/320011716" status: 202 len: 0 microversion: 2.1 time: 0.122929 Oct 30 01:15:00.844547 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 234/468] 10.222.0.13 () {58 vars in 1158 bytes} [Sun Oct 30 01:15:00 2022] DELETE /compute/v2.1/flavors/320011716 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:15:00.850908 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7b6a94e5-7d61-4a0f-a3e0-3084dcaf0be8 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:00.851903 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7b6a94e5-7d61-4a0f-a3e0-3084dcaf0be8 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] [instance: ac13f3c4-a93f-4664-b102-aa57f9c63308] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:00.854314 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=15,nova_api:INSERT=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:00.859503 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b6a94e5-7d61-4a0f-a3e0-3084dcaf0be8 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:00.860305 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b6a94e5-7d61-4a0f-a3e0-3084dcaf0be8 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:00.860736 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b6a94e5-7d61-4a0f-a3e0-3084dcaf0be8 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:00.861511 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b6a94e5-7d61-4a0f-a3e0-3084dcaf0be8 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:00.861961 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b6a94e5-7d61-4a0f-a3e0-3084dcaf0be8 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:00.862381 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b6a94e5-7d61-4a0f-a3e0-3084dcaf0be8 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:01.179678 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7b6a94e5-7d61-4a0f-a3e0-3084dcaf0be8 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464f9e9314154e3f9c779b9ae10b2a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a83b0b15194aa69fc4d82876a1e6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:01.190449 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7b6a94e5-7d61-4a0f-a3e0-3084dcaf0be8 tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] 10.222.0.13 "GET /compute/v2.1/servers/ac13f3c4-a93f-4664-b102-aa57f9c63308" status: 200 len: 1474 microversion: 2.1 time: 0.344510 Oct 30 01:15:01.191535 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 235/469] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:00 2022] GET /compute/v2.1/servers/ac13f3c4-a93f-4664-b102-aa57f9c63308 => generated 1474 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:01.364770 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d2608d8e-039b-4f46-aece-4787bdfb2de3 tempest-QuotaClassesAdmin257Test-1988852780 tempest-QuotaClassesAdmin257Test-1988852780-project-admin] Calling method '.version_select at 0x7f44cc81f4c0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:01.391644 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d2608d8e-039b-4f46-aece-4787bdfb2de3 tempest-QuotaClassesAdmin257Test-1988852780 tempest-QuotaClassesAdmin257Test-1988852780-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.198541 Oct 30 01:15:01.392725 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 236/470] 10.222.0.13 () {60 vars in 1226 bytes} [Sun Oct 30 01:15:01 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:15:01.403602 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4e108c51-663f-4bc9-95dd-bf2ce8be0f19 tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:01.447466 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4e108c51-663f-4bc9-95dd-bf2ce8be0f19 tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.052697 Oct 30 01:15:01.448495 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 237/471] 10.222.0.13 () {58 vars in 1146 bytes} [Sun Oct 30 01:15:01 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:01.457550 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2652accf-91d2-401d-a6b7-fc8676ca8d52 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:01.458463 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2652accf-91d2-401d-a6b7-fc8676ca8d52 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] [instance: 4f47f49f-e5a9-46d5-9622-c9c887891646] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:01.470170 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2652accf-91d2-401d-a6b7-fc8676ca8d52 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:01.470669 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2652accf-91d2-401d-a6b7-fc8676ca8d52 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:01.471114 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2652accf-91d2-401d-a6b7-fc8676ca8d52 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:01.471853 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2652accf-91d2-401d-a6b7-fc8676ca8d52 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:01.472497 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2652accf-91d2-401d-a6b7-fc8676ca8d52 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:01.472928 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2652accf-91d2-401d-a6b7-fc8676ca8d52 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:01.659041 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2652accf-91d2-401d-a6b7-fc8676ca8d52 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ccc0bfdee94961aa198e3abf0d85cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee1e04c04bc40568e43eb98df39e7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:01.668802 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2652accf-91d2-401d-a6b7-fc8676ca8d52 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] 10.222.0.13 "GET /compute/v2.1/servers/4f47f49f-e5a9-46d5-9622-c9c887891646" status: 200 len: 1320 microversion: 2.1 time: 0.218694 Oct 30 01:15:01.669548 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 238/472] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:01 2022] GET /compute/v2.1/servers/4f47f49f-e5a9-46d5-9622-c9c887891646 => generated 1320 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:01.674694 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-dee96c55-260f-4930-9249-3a4855890690 req-2c46d5c3-1596-48db-8554-8d7015da2b8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac13f3c4-a93f-4664-b102-aa57f9c63308", "name": "network-vif-deleted", "tag": "ebea2aaf-9820-474d-9632-b91882e101fe"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:01.687481 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-dee96c55-260f-4930-9249-3a4855890690 req-2c46d5c3-1596-48db-8554-8d7015da2b8b service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:01.687977 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-dee96c55-260f-4930-9249-3a4855890690 req-2c46d5c3-1596-48db-8554-8d7015da2b8b service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:01.688411 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-dee96c55-260f-4930-9249-3a4855890690 req-2c46d5c3-1596-48db-8554-8d7015da2b8b service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:01.703502 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-dee96c55-260f-4930-9249-3a4855890690 req-2c46d5c3-1596-48db-8554-8d7015da2b8b service nova] Creating event network-vif-deleted:ebea2aaf-9820-474d-9632-b91882e101fe for instance ac13f3c4-a93f-4664-b102-aa57f9c63308 on n-h2-master-1 Oct 30 01:15:01.708833 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-dee96c55-260f-4930-9249-3a4855890690 req-2c46d5c3-1596-48db-8554-8d7015da2b8b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038072 Oct 30 01:15:01.710008 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 239/473] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:15:01.719299 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-093ca443-d6de-4e45-80d0-2b2a8edff92b tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:01.720524 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-093ca443-d6de-4e45-80d0-2b2a8edff92b tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:01.728386 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-093ca443-d6de-4e45-80d0-2b2a8edff92b tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:01.729211 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-093ca443-d6de-4e45-80d0-2b2a8edff92b tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:01.729687 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-093ca443-d6de-4e45-80d0-2b2a8edff92b tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:01.730575 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-093ca443-d6de-4e45-80d0-2b2a8edff92b tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:01.731226 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-093ca443-d6de-4e45-80d0-2b2a8edff92b tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:01.731815 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-093ca443-d6de-4e45-80d0-2b2a8edff92b tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:01.813287 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-093ca443-d6de-4e45-80d0-2b2a8edff92b tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:01.822170 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-093ca443-d6de-4e45-80d0-2b2a8edff92b tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:01.823828 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-093ca443-d6de-4e45-80d0-2b2a8edff92b tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:01.830140 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-093ca443-d6de-4e45-80d0-2b2a8edff92b tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] 10.222.0.13 "GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 200 len: 1452 microversion: 2.75 time: 0.118623 Oct 30 01:15:01.845922 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 240/474] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:01 2022] GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 1452 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:01.857411 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-87ae9960-7cd1-4637-b6db-9f2ce9b6707d tempest-QuotaClassesAdmin257Test-1988852780 tempest-QuotaClassesAdmin257Test-1988852780-project-admin] Action: 'update', calling method: .version_select at 0x7f44cc81f4c0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:02.862383 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-87ae9960-7cd1-4637-b6db-9f2ce9b6707d tempest-QuotaClassesAdmin257Test-1988852780 tempest-QuotaClassesAdmin257Test-1988852780-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 1.015040 Oct 30 01:15:02.877028 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 241/475] 10.222.0.13 () {62 vars in 1247 bytes} [Sun Oct 30 01:15:01 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:15:02.882974 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-559bb7bb-1924-45fc-a8ce-ac8650ac4123 tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2058667928", "id": 2016238181, "os-flavor-access:is_public": "False"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:03.038862 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-559bb7bb-1924-45fc-a8ce-ac8650ac4123 tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.160237 Oct 30 01:15:03.039503 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 242/476] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:15:02 2022] POST /compute/v2.1/flavors => generated 415 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:15:03.044356 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4e4a1f18-9dbb-44a4-8f90-513ade0388f6 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:03.045010 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4e4a1f18-9dbb-44a4-8f90-513ade0388f6 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0dd3f0e2-2c15-4915-88b0-2df9e312cc4c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:03.052056 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4e4a1f18-9dbb-44a4-8f90-513ade0388f6 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:03.052553 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4e4a1f18-9dbb-44a4-8f90-513ade0388f6 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:03.052986 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4e4a1f18-9dbb-44a4-8f90-513ade0388f6 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:03.053729 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4e4a1f18-9dbb-44a4-8f90-513ade0388f6 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:03.054186 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4e4a1f18-9dbb-44a4-8f90-513ade0388f6 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:03.054607 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4e4a1f18-9dbb-44a4-8f90-513ade0388f6 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:03.187353 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4e4a1f18-9dbb-44a4-8f90-513ade0388f6 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:03.195970 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4e4a1f18-9dbb-44a4-8f90-513ade0388f6 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c" status: 200 len: 1311 microversion: 2.1 time: 0.155223 Oct 30 01:15:03.196943 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 243/477] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:03 2022] GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c => generated 1311 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:03.201674 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ce92efe4-74db-4816-b74a-ede5b7cef6fe tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:03.202287 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ce92efe4-74db-4816-b74a-ede5b7cef6fe tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] [instance: ac13f3c4-a93f-4664-b102-aa57f9c63308] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:03.208416 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ce92efe4-74db-4816-b74a-ede5b7cef6fe tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:03.208903 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ce92efe4-74db-4816-b74a-ede5b7cef6fe tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:03.210069 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ce92efe4-74db-4816-b74a-ede5b7cef6fe tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:03.210795 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ce92efe4-74db-4816-b74a-ede5b7cef6fe tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:03.211245 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ce92efe4-74db-4816-b74a-ede5b7cef6fe tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:03.211688 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ce92efe4-74db-4816-b74a-ede5b7cef6fe tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:03.227295 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-ce92efe4-74db-4816-b74a-ede5b7cef6fe tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] HTTP exception thrown: Instance ac13f3c4-a93f-4664-b102-aa57f9c63308 could not be found. Oct 30 01:15:03.229003 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ce92efe4-74db-4816-b74a-ede5b7cef6fe tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Request method failure captured: Oct 30 01:15:03.229003 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/ac13f3c4-a93f-4664-b102-aa57f9c63308 HTTP/1.1 Oct 30 01:15:03.229003 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:15:03.229003 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:15:03.229003 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:15:03.229003 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:15:03.229003 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:15:03.229003 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:15:03.229003 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:15:03.229003 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:15:03.229003 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXc_TU6zPqqxhnrPHFa-fHQyi7BXJ4dCXLKZ9qWrFgiPNXiGSEkkV4NkgWvgdm8NmzzsIcUKp7e1WNqG8Q_X_wUTk0vWbmJCpeDztteaGRjLvr6C-Ju6KAFBK4qv84W-lVGiSNpCvp8KCKoCpmAbn-tItWDK44MJLUXytZhz3zrAAsmc Oct 30 01:15:03.229003 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:15:03.229003 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:15:03.229003 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:15:03.229003 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:15:03.229003 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:15:03.229003 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:15:03.229003 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 72a83b0b15194aa69fc4d82876a1e6fd Oct 30 01:15:03.229003 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-LiveMigrationNegativeTest-1985219618 Oct 30 01:15:03.229003 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:15:03.229003 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:15:03.230400 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/72a83b0b15194aa69fc4d82876a1e6fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_72a83b0b15194aa69fc4d82876a1e6fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/72a83b0b15194aa69fc4d82876a1e6fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/72a83b0b15194aa69fc4d82876a1e6fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:15:03.230400 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-LiveMigrationNegativeTest-1985219618 Oct 30 01:15:03.230400 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 72a83b0b15194aa69fc4d82876a1e6fd Oct 30 01:15:03.230400 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1985219618 Oct 30 01:15:03.230400 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-LiveMigrationNegativeTest-1985219618-project Oct 30 01:15:03.230400 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:15:03.230400 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:15:03.230400 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 464f9e9314154e3f9c779b9ae10b2a73 Oct 30 01:15:03.230400 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-LiveMigrationNegativeTest-1985219618-project Oct 30 01:15:03.230400 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:15:03.230400 n-d-master-1 devstack@n-api.service[121103]: exception: Instance ac13f3c4-a93f-4664-b102-aa57f9c63308 could not be found. Oct 30 01:15:03.230400 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'ac13f3c4-a93f-4664-b102-aa57f9c63308'} Oct 30 01:15:03.231147 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:15:03.231147 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:15:03.231147 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:15:03.231147 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:15:03.231147 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:15:03.231147 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:15:03.231147 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:15:03.231147 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:15:03.231147 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:15:03.231147 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:15:03.231147 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac13f3c4-a93f-4664-b102-aa57f9c63308 could not be found. Oct 30 01:15:03.231147 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:03.231147 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:15:03.231147 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:03.231147 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:15:03.231147 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:15:03.231147 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:15:03.231147 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:15:03.231147 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:15:03.231147 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:15:03.232609 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:15:03.232609 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:15:03.232609 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:15:03.232609 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:15:03.232609 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:15:03.232609 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:15:03.232609 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:15:03.232609 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac13f3c4-a93f-4664-b102-aa57f9c63308 could not be found. Oct 30 01:15:03.232609 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:03.232609 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:15:03.232609 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:03.232609 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:15:03.232609 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:15:03.232609 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:15:03.232609 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:15:03.232609 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:15:03.232609 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac13f3c4-a93f-4664-b102-aa57f9c63308 could not be found. Oct 30 01:15:03.232609 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:03.234244 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ce92efe4-74db-4816-b74a-ede5b7cef6fe tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] Returning 404 to user: Instance ac13f3c4-a93f-4664-b102-aa57f9c63308 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:15:03.234244 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ce92efe4-74db-4816-b74a-ede5b7cef6fe tempest-LiveMigrationNegativeTest-1985219618 tempest-LiveMigrationNegativeTest-1985219618-project] 10.222.0.13 "GET /compute/v2.1/servers/ac13f3c4-a93f-4664-b102-aa57f9c63308" status: 404 len: 111 microversion: 2.1 time: 0.032528 Oct 30 01:15:03.234244 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 244/478] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:03 2022] GET /compute/v2.1/servers/ac13f3c4-a93f-4664-b102-aa57f9c63308 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:15:03.235819 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b7382a2f-86f6-4d7e-bb07-dc12d67c22d9 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:03.236509 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b7382a2f-86f6-4d7e-bb07-dc12d67c22d9 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] [instance: 4f47f49f-e5a9-46d5-9622-c9c887891646] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:03.243929 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b7382a2f-86f6-4d7e-bb07-dc12d67c22d9 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:03.253589 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b7382a2f-86f6-4d7e-bb07-dc12d67c22d9 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:03.253589 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b7382a2f-86f6-4d7e-bb07-dc12d67c22d9 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:03.253589 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b7382a2f-86f6-4d7e-bb07-dc12d67c22d9 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:03.253589 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b7382a2f-86f6-4d7e-bb07-dc12d67c22d9 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:03.253929 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b7382a2f-86f6-4d7e-bb07-dc12d67c22d9 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:03.455125 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b7382a2f-86f6-4d7e-bb07-dc12d67c22d9 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ccc0bfdee94961aa198e3abf0d85cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee1e04c04bc40568e43eb98df39e7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:03.463856 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b7382a2f-86f6-4d7e-bb07-dc12d67c22d9 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] 10.222.0.13 "GET /compute/v2.1/servers/4f47f49f-e5a9-46d5-9622-c9c887891646" status: 200 len: 1469 microversion: 2.1 time: 0.231720 Oct 30 01:15:03.464625 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 245/479] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:03 2022] GET /compute/v2.1/servers/4f47f49f-e5a9-46d5-9622-c9c887891646 => generated 1469 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:03.469268 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9a437fa0-bf66-447d-a827-6d3770fdb88f tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:03.470079 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9a437fa0-bf66-447d-a827-6d3770fdb88f tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:03.476563 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9a437fa0-bf66-447d-a827-6d3770fdb88f tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:03.477072 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9a437fa0-bf66-447d-a827-6d3770fdb88f tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:03.477595 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9a437fa0-bf66-447d-a827-6d3770fdb88f tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:03.478228 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9a437fa0-bf66-447d-a827-6d3770fdb88f tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:03.478687 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9a437fa0-bf66-447d-a827-6d3770fdb88f tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:03.479113 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9a437fa0-bf66-447d-a827-6d3770fdb88f tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:03.549456 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9a437fa0-bf66-447d-a827-6d3770fdb88f tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:03.566927 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9a437fa0-bf66-447d-a827-6d3770fdb88f tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:03.566927 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9a437fa0-bf66-447d-a827-6d3770fdb88f tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:03.566927 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9a437fa0-bf66-447d-a827-6d3770fdb88f tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] 10.222.0.13 "GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 200 len: 1437 microversion: 2.75 time: 0.100651 Oct 30 01:15:03.567284 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 246/480] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:03 2022] GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 1437 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:03.571450 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-150b041a-9a56-402f-897d-c4e17728e05b tempest-QuotaClassesAdmin257Test-1988852780 tempest-QuotaClassesAdmin257Test-1988852780-project-admin] Calling method '.version_select at 0x7f44cc7bcc10>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:03.582586 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-150b041a-9a56-402f-897d-c4e17728e05b tempest-QuotaClassesAdmin257Test-1988852780 tempest-QuotaClassesAdmin257Test-1988852780-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.014543 Oct 30 01:15:03.590205 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 247/481] 10.222.0.13 () {60 vars in 1226 bytes} [Sun Oct 30 01:15:03 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:15:03.590205 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-07c5ccef-12aa-4fde-96b7-5d384346daa6 tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:03.611954 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-07c5ccef-12aa-4fde-96b7-5d384346daa6 tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.027656 Oct 30 01:15:03.612790 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 248/482] 10.222.0.13 () {58 vars in 1146 bytes} [Sun Oct 30 01:15:03 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:03.726901 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fd0a8062-2eed-42af-be43-791f27283c6f tempest-ServersAdminNegativeTestJSON-331223024 tempest-ServersAdminNegativeTestJSON-331223024-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:03.727810 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-fd0a8062-2eed-42af-be43-791f27283c6f tempest-ServersAdminNegativeTestJSON-331223024 tempest-ServersAdminNegativeTestJSON-331223024-project-admin] [instance: db2f258c-a11b-40a4-a12f-f8df7506c36c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:03.734441 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-fd0a8062-2eed-42af-be43-791f27283c6f tempest-ServersAdminNegativeTestJSON-331223024 tempest-ServersAdminNegativeTestJSON-331223024-project-admin] HTTP exception thrown: Instance db2f258c-a11b-40a4-a12f-f8df7506c36c could not be found. Oct 30 01:15:03.736790 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fd0a8062-2eed-42af-be43-791f27283c6f tempest-ServersAdminNegativeTestJSON-331223024 tempest-ServersAdminNegativeTestJSON-331223024-project-admin] Request method failure captured: Oct 30 01:15:03.736790 n-d-master-1 devstack@n-api.service[121103]: request: POST /compute/v2.1/servers/db2f258c-a11b-40a4-a12f-f8df7506c36c/action HTTP/1.1 Oct 30 01:15:03.736790 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:15:03.736790 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:15:03.736790 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:15:03.736790 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 15 Oct 30 01:15:03.736790 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:15:03.736790 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:15:03.736790 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:15:03.736790 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:15:03.736790 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdAGrOT16w3BcD0EzKYL4VRYA03FHs0jlOkTl6pEa5s5gpPiGMr9Hb0clI65uA2eEZ27q8ok892nUQG7QgbY529jqvOZV8TSemJFVeoHiWX6ZvAuy9J61sZtDCqw1GQfcnkvi1evbXIrJ5dQb9oFzC0LapsFNuzR9hiIipvgEvgAVM8 Oct 30 01:15:03.736790 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:15:03.736790 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:15:03.736790 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:15:03.736790 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:15:03.736790 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:15:03.736790 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:15:03.736790 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 7bc4e7dc475b4830af3bbc7a7ba767ed Oct 30 01:15:03.736790 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-331223024 Oct 30 01:15:03.736790 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,admin,reader Oct 30 01:15:03.736790 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,admin,reader Oct 30 01:15:03.738248 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7bc4e7dc475b4830af3bbc7a7ba767ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7bc4e7dc475b4830af3bbc7a7ba767ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7bc4e7dc475b4830af3bbc7a7ba767ed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7bc4e7dc475b4830af3bbc7a7ba767ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:15:03.738248 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersAdminNegativeTestJSON-331223024 Oct 30 01:15:03.738248 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 7bc4e7dc475b4830af3bbc7a7ba767ed Oct 30 01:15:03.738248 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-331223024 Oct 30 01:15:03.738248 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersAdminNegativeTestJSON-331223024-project-admin Oct 30 01:15:03.738248 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:15:03.738248 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:15:03.738248 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: e5cba98608e84304913424e7704c7227 Oct 30 01:15:03.738248 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersAdminNegativeTestJSON-331223024-project-admin Oct 30 01:15:03.738248 n-d-master-1 devstack@n-api.service[121103]: Oct 30 01:15:03.738248 n-d-master-1 devstack@n-api.service[121103]: {"migrate": {}} Oct 30 01:15:03.738248 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:15:03.738248 n-d-master-1 devstack@n-api.service[121103]: exception: Instance db2f258c-a11b-40a4-a12f-f8df7506c36c could not be found. Oct 30 01:15:03.739124 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'db2f258c-a11b-40a4-a12f-f8df7506c36c', 'body': {'migrate': {}}} Oct 30 01:15:03.739124 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:15:03.739124 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:15:03.739124 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:15:03.739124 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:15:03.739124 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:15:03.739124 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:15:03.739124 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 30 01:15:03.739124 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 30 01:15:03.739124 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db2f258c-a11b-40a4-a12f-f8df7506c36c could not be found. Oct 30 01:15:03.739124 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:03.739124 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:15:03.739124 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:03.739124 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:15:03.739124 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:15:03.739124 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:15:03.739124 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:15:03.739124 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:15:03.739124 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:15:03.739124 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:15:03.740500 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:15:03.740500 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:15:03.740500 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 30 01:15:03.740500 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 30 01:15:03.740500 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:15:03.740500 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:15:03.740500 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db2f258c-a11b-40a4-a12f-f8df7506c36c could not be found. Oct 30 01:15:03.740500 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:03.740500 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:15:03.740500 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:03.740500 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:15:03.740500 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:15:03.740500 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:15:03.740500 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:15:03.740500 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:15:03.740500 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db2f258c-a11b-40a4-a12f-f8df7506c36c could not be found. Oct 30 01:15:03.740500 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:03.741890 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fd0a8062-2eed-42af-be43-791f27283c6f tempest-ServersAdminNegativeTestJSON-331223024 tempest-ServersAdminNegativeTestJSON-331223024-project-admin] Returning 404 to user: Instance db2f258c-a11b-40a4-a12f-f8df7506c36c could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:15:03.742862 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fd0a8062-2eed-42af-be43-791f27283c6f tempest-ServersAdminNegativeTestJSON-331223024 tempest-ServersAdminNegativeTestJSON-331223024-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/db2f258c-a11b-40a4-a12f-f8df7506c36c/action" status: 404 len: 111 microversion: 2.1 time: 0.128718 Oct 30 01:15:03.743599 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 249/483] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:15:03 2022] POST /compute/v2.1/servers/db2f258c-a11b-40a4-a12f-f8df7506c36c/action => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:15:03.934857 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b9132bc5-9966-4013-b782-76b714b41b78 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "deb14158-45d8-4539-889d-ff9726d046d7"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:03.937699 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b9132bc5-9966-4013-b782-76b714b41b78 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:03.947937 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b9132bc5-9966-4013-b782-76b714b41b78 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:03.947937 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b9132bc5-9966-4013-b782-76b714b41b78 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:03.947937 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b9132bc5-9966-4013-b782-76b714b41b78 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:03.947937 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b9132bc5-9966-4013-b782-76b714b41b78 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:03.948273 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b9132bc5-9966-4013-b782-76b714b41b78 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:03.948273 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b9132bc5-9966-4013-b782-76b714b41b78 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:03.951624 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=100 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:04.030619 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-b9132bc5-9966-4013-b782-76b714b41b78 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:15:04.031041 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-b9132bc5-9966-4013-b782-76b714b41b78 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:15:04.031513 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-b9132bc5-9966-4013-b782-76b714b41b78 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:15:04.031920 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-b9132bc5-9966-4013-b782-76b714b41b78 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:15:04.032371 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-b9132bc5-9966-4013-b782-76b714b41b78 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:15:04.279303 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b9132bc5-9966-4013-b782-76b714b41b78 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:04.293369 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b9132bc5-9966-4013-b782-76b714b41b78 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:04.293894 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b9132bc5-9966-4013-b782-76b714b41b78 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:04.294435 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b9132bc5-9966-4013-b782-76b714b41b78 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:04.295032 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b9132bc5-9966-4013-b782-76b714b41b78 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:04.295592 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b9132bc5-9966-4013-b782-76b714b41b78 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:04.295920 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b9132bc5-9966-4013-b782-76b714b41b78 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:04.377040 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:04.454530 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-b9132bc5-9966-4013-b782-76b714b41b78 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lazy-loading 'services' on Instance uuid 2c5b301d-f84c-4395-add9-b84311fa785c {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:15:04.519583 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b9132bc5-9966-4013-b782-76b714b41b78 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c/action" status: 202 len: 1940 microversion: 2.75 time: 0.770160 Oct 30 01:15:04.519583 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 250/484] 10.222.0.13 () {62 vars in 1319 bytes} [Sun Oct 30 01:15:03 2022] POST /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c/action => generated 1940 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 30 01:15:04.520653 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2709fb6b-13c3-4746-8d19-e1ee5f0401d9 tempest-QuotaClassesAdmin257Test-1988852780 tempest-QuotaClassesAdmin257Test-1988852780-project-admin] Action: 'update', calling method: .version_select at 0x7f44cc7f6b80>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:04.870131 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a18fe2a4-d47e-41a7-83f7-aebbbc2a9aa0 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3/action" status: 202 len: 0 microversion: 2.25 time: 5.502376 Oct 30 01:15:04.870730 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 235/485] 10.222.0.13 () {62 vars in 1319 bytes} [Sun Oct 30 01:14:59 2022] POST /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3/action => generated 0 bytes in 5504 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:15:04.877876 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-dedb6e4a-d671-419a-8580-a53c5ca5d5e8 tempest-FlavorsAdminTestJSON-413077360 tempest-FlavorsAdminTestJSON-413077360-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:04.901788 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-dedb6e4a-d671-419a-8580-a53c5ca5d5e8 tempest-FlavorsAdminTestJSON-413077360 tempest-FlavorsAdminTestJSON-413077360-project] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.029517 Oct 30 01:15:04.902385 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 236/486] 10.222.0.13 () {58 vars in 1146 bytes} [Sun Oct 30 01:15:04 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:04.907325 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-b32abbd7-bb68-4586-9a89-b52d176900a3 req-f3691c11-fa16-401d-8ed0-8a83d022ae41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dd3f0e2-2c15-4915-88b0-2df9e312cc4c", "tag": "57a305e2-e962-4bb1-a776-09d4a458a514"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:04.918492 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-b32abbd7-bb68-4586-9a89-b52d176900a3 req-f3691c11-fa16-401d-8ed0-8a83d022ae41 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:04.919235 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-b32abbd7-bb68-4586-9a89-b52d176900a3 req-f3691c11-fa16-401d-8ed0-8a83d022ae41 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:04.919665 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-b32abbd7-bb68-4586-9a89-b52d176900a3 req-f3691c11-fa16-401d-8ed0-8a83d022ae41 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:04.932689 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-b32abbd7-bb68-4586-9a89-b52d176900a3 req-f3691c11-fa16-401d-8ed0-8a83d022ae41 service nova] Creating event network-changed:57a305e2-e962-4bb1-a776-09d4a458a514 for instance 0dd3f0e2-2c15-4915-88b0-2df9e312cc4c on n-h1-master-1 Oct 30 01:15:04.939905 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-b32abbd7-bb68-4586-9a89-b52d176900a3 req-f3691c11-fa16-401d-8ed0-8a83d022ae41 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036228 Oct 30 01:15:04.941689 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 237/487] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:15:04.949713 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2b8affc5-3996-41e4-b6c1-ea549668e286 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1709369458", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:05.012999 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-2b8affc5-3996-41e4-b6c1-ea549668e286 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] validate_networks() for None {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:15:05.239957 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2709fb6b-13c3-4746-8d19-e1ee5f0401d9 tempest-QuotaClassesAdmin257Test-1988852780 tempest-QuotaClassesAdmin257Test-1988852780-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.722867 Oct 30 01:15:05.246587 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 251/488] 10.222.0.13 () {62 vars in 1247 bytes} [Sun Oct 30 01:15:04 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:15:05.255770 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c27b2bc1-1242-4fc4-8ae2-aae79b168281 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:05.260151 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c27b2bc1-1242-4fc4-8ae2-aae79b168281 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0dd3f0e2-2c15-4915-88b0-2df9e312cc4c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:05.270051 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c27b2bc1-1242-4fc4-8ae2-aae79b168281 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:05.270556 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c27b2bc1-1242-4fc4-8ae2-aae79b168281 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:05.270991 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c27b2bc1-1242-4fc4-8ae2-aae79b168281 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:05.271717 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c27b2bc1-1242-4fc4-8ae2-aae79b168281 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:05.272631 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c27b2bc1-1242-4fc4-8ae2-aae79b168281 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:05.272970 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c27b2bc1-1242-4fc4-8ae2-aae79b168281 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:05.553425 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-2b8affc5-3996-41e4-b6c1-ea549668e286 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:15:05.554057 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-2b8affc5-3996-41e4-b6c1-ea549668e286 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:15:05.554745 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-2b8affc5-3996-41e4-b6c1-ea549668e286 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:15:05.555160 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-2b8affc5-3996-41e4-b6c1-ea549668e286 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:15:05.555577 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-2b8affc5-3996-41e4-b6c1-ea549668e286 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:15:05.567066 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2b8affc5-3996-41e4-b6c1-ea549668e286 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:05.567927 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2b8affc5-3996-41e4-b6c1-ea549668e286 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:05.568606 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2b8affc5-3996-41e4-b6c1-ea549668e286 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:05.569594 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2b8affc5-3996-41e4-b6c1-ea549668e286 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:05.570235 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2b8affc5-3996-41e4-b6c1-ea549668e286 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:05.570878 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2b8affc5-3996-41e4-b6c1-ea549668e286 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:05.582859 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c27b2bc1-1242-4fc4-8ae2-aae79b168281 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:05.590952 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c27b2bc1-1242-4fc4-8ae2-aae79b168281 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c" status: 200 len: 1311 microversion: 2.1 time: 0.343143 Oct 30 01:15:05.591547 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 252/489] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:05 2022] GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c => generated 1311 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:05.605461 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e1a05fe1-9f1d-4eba-b20a-af73c5770343 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:05.610063 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-2b8affc5-3996-41e4-b6c1-ea549668e286 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Getting quotas for project 3ee1e04c04bc40568e43eb98df39e7e6. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:15:05.610253 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e1a05fe1-9f1d-4eba-b20a-af73c5770343 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:05.616392 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-2b8affc5-3996-41e4-b6c1-ea549668e286 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Getting quotas for user 51ccc0bfdee94961aa198e3abf0d85cc and project 3ee1e04c04bc40568e43eb98df39e7e6. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:15:05.625808 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e1a05fe1-9f1d-4eba-b20a-af73c5770343 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:05.626305 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e1a05fe1-9f1d-4eba-b20a-af73c5770343 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:05.626738 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e1a05fe1-9f1d-4eba-b20a-af73c5770343 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:05.629306 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e1a05fe1-9f1d-4eba-b20a-af73c5770343 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:05.629799 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e1a05fe1-9f1d-4eba-b20a-af73c5770343 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:05.630229 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e1a05fe1-9f1d-4eba-b20a-af73c5770343 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:05.633301 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2b8affc5-3996-41e4-b6c1-ea549668e286 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:15:05.635646 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2b8affc5-3996-41e4-b6c1-ea549668e286 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] [instance: 19d392d4-2f19-4065-a580-b2fd72303153] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:15:05.738250 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-e1a05fe1-9f1d-4eba-b20a-af73c5770343 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lazy-loading 'services' on Instance uuid 2c5b301d-f84c-4395-add9-b84311fa785c {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:15:05.754947 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=14,nova_api:INSERT=8 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:05.758220 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e1a05fe1-9f1d-4eba-b20a-af73c5770343 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 200 len: 1927 microversion: 2.75 time: 0.156672 Oct 30 01:15:05.761486 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 253/490] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:05 2022] GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 1927 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:05.772665 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-729e30e2-a57a-42dc-afa0-cf689e07d439 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:05.773390 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-729e30e2-a57a-42dc-afa0-cf689e07d439 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:05.779426 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-729e30e2-a57a-42dc-afa0-cf689e07d439 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:05.780036 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-729e30e2-a57a-42dc-afa0-cf689e07d439 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:05.780582 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-729e30e2-a57a-42dc-afa0-cf689e07d439 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:05.781437 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-729e30e2-a57a-42dc-afa0-cf689e07d439 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:05.782110 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-729e30e2-a57a-42dc-afa0-cf689e07d439 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:05.782785 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-729e30e2-a57a-42dc-afa0-cf689e07d439 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:05.785847 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2b8affc5-3996-41e4-b6c1-ea549668e286 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.840293 Oct 30 01:15:05.786990 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 238/491] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:15:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 844 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:15:05.791816 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b9a45920-1bed-4563-a410-b2d380790c94 tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:05.891703 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b9a45920-1bed-4563-a410-b2d380790c94 tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/2016238181" status: 202 len: 0 microversion: 2.1 time: 0.096106 Oct 30 01:15:05.891703 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 239/492] 10.222.0.13 () {58 vars in 1161 bytes} [Sun Oct 30 01:15:05 2022] DELETE /compute/v2.1/flavors/2016238181 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:15:05.892432 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a8b0b95a-34dc-4fba-8e60-feab497c53c1 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:05.892813 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a8b0b95a-34dc-4fba-8e60-feab497c53c1 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] [instance: 19d392d4-2f19-4065-a580-b2fd72303153] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:05.996336 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a8b0b95a-34dc-4fba-8e60-feab497c53c1 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ccc0bfdee94961aa198e3abf0d85cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee1e04c04bc40568e43eb98df39e7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:06.006457 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a8b0b95a-34dc-4fba-8e60-feab497c53c1 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] 10.222.0.13 "GET /compute/v2.1/servers/19d392d4-2f19-4065-a580-b2fd72303153" status: 200 len: 1222 microversion: 2.1 time: 0.118352 Oct 30 01:15:06.009198 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 240/493] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:05 2022] GET /compute/v2.1/servers/19d392d4-2f19-4065-a580-b2fd72303153 => generated 1222 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:06.014460 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8494a609-ea84-4024-b248-1b773ee2e868 tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:06.040040 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8494a609-ea84-4024-b248-1b773ee2e868 tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.031397 Oct 30 01:15:06.040994 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 241/494] 10.222.0.13 () {58 vars in 1146 bytes} [Sun Oct 30 01:15:06 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:06.066401 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-28927f83-03e7-49a3-bc17-115aa4c82dc4 tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-704439664", "id": 2000626227, "os-flavor-access:is_public": "True"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:06.152450 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-28927f83-03e7-49a3-bc17-115aa4c82dc4 tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.091312 Oct 30 01:15:06.153944 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-729e30e2-a57a-42dc-afa0-cf689e07d439 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:06.154923 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 242/495] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:15:06 2022] POST /compute/v2.1/flavors => generated 413 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:15:06.170800 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-729e30e2-a57a-42dc-afa0-cf689e07d439 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:06.174548 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-729e30e2-a57a-42dc-afa0-cf689e07d439 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:06.176158 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-dc2df776-2d84-4b1b-8d59-9a1d737be808 tempest-FlavorsAdminTestJSON-413077360 tempest-FlavorsAdminTestJSON-413077360-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:06.179795 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-729e30e2-a57a-42dc-afa0-cf689e07d439 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3" status: 200 len: 1565 microversion: 2.25 time: 0.419498 Oct 30 01:15:06.180369 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 254/496] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:05 2022] GET /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3 => generated 1565 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:06.202360 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-dc2df776-2d84-4b1b-8d59-9a1d737be808 tempest-FlavorsAdminTestJSON-413077360 tempest-FlavorsAdminTestJSON-413077360-project] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 6224 microversion: 2.1 time: 0.031594 Oct 30 01:15:06.203428 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 243/497] 10.222.0.13 () {58 vars in 1146 bytes} [Sun Oct 30 01:15:06 2022] GET /compute/v2.1/flavors/detail => generated 6224 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:06.228046 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f4f40423-4f52-42e5-a8bd-d6bf14323724 tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:06.344604 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f4f40423-4f52-42e5-a8bd-d6bf14323724 tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/2000626227" status: 202 len: 0 microversion: 2.1 time: 0.120203 Oct 30 01:15:06.345377 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 255/498] 10.222.0.13 () {58 vars in 1161 bytes} [Sun Oct 30 01:15:06 2022] DELETE /compute/v2.1/flavors/2000626227 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:15:06.353468 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b1e8c72c-8683-484a-a581-7d8106aaf78a tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:06.373713 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b1e8c72c-8683-484a-a581-7d8106aaf78a tempest-FlavorsAdminTestJSON-2093945931 tempest-FlavorsAdminTestJSON-2093945931-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.023968 Oct 30 01:15:06.384224 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 244/499] 10.222.0.13 () {58 vars in 1146 bytes} [Sun Oct 30 01:15:06 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:06.617223 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2440d988-620a-471e-825a-2289cc43985b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:06.618264 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2440d988-620a-471e-825a-2289cc43985b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0dd3f0e2-2c15-4915-88b0-2df9e312cc4c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:06.625114 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2440d988-620a-471e-825a-2289cc43985b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:06.625822 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2440d988-620a-471e-825a-2289cc43985b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:06.626443 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2440d988-620a-471e-825a-2289cc43985b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:06.627152 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2440d988-620a-471e-825a-2289cc43985b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:06.627911 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2440d988-620a-471e-825a-2289cc43985b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:06.628388 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2440d988-620a-471e-825a-2289cc43985b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:06.774338 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2440d988-620a-471e-825a-2289cc43985b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:06.789390 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8abf2c6b-3021-44df-97a3-9762eba749f9 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:06.790242 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8abf2c6b-3021-44df-97a3-9762eba749f9 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:06.799158 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2440d988-620a-471e-825a-2289cc43985b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c" status: 200 len: 1311 microversion: 2.1 time: 0.186492 Oct 30 01:15:06.819041 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 256/500] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:06 2022] GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c => generated 1311 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:06.820224 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8abf2c6b-3021-44df-97a3-9762eba749f9 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:06.825804 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8abf2c6b-3021-44df-97a3-9762eba749f9 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:06.825804 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8abf2c6b-3021-44df-97a3-9762eba749f9 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:06.825804 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8abf2c6b-3021-44df-97a3-9762eba749f9 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:06.825804 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8abf2c6b-3021-44df-97a3-9762eba749f9 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:06.826378 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8abf2c6b-3021-44df-97a3-9762eba749f9 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:06.967649 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-4ef85f16-6d0f-4ae2-8040-b0e554c68f9b req-cb408714-93e2-4499-9f31-1c9be0dae93a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3", "name": "network-vif-unplugged", "status": "completed", "tag": "158902f2-0cf8-4485-a0b9-8ba513a59715"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:06.979167 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-4ef85f16-6d0f-4ae2-8040-b0e554c68f9b req-cb408714-93e2-4499-9f31-1c9be0dae93a service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:06.979865 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-4ef85f16-6d0f-4ae2-8040-b0e554c68f9b req-cb408714-93e2-4499-9f31-1c9be0dae93a service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:06.980458 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-4ef85f16-6d0f-4ae2-8040-b0e554c68f9b req-cb408714-93e2-4499-9f31-1c9be0dae93a service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:07.001264 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-4ef85f16-6d0f-4ae2-8040-b0e554c68f9b req-cb408714-93e2-4499-9f31-1c9be0dae93a service nova] Creating event network-vif-unplugged:158902f2-0cf8-4485-a0b9-8ba513a59715 for instance 6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3 on n-h2-master-1 Oct 30 01:15:07.008625 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-4ef85f16-6d0f-4ae2-8040-b0e554c68f9b req-cb408714-93e2-4499-9f31-1c9be0dae93a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044623 Oct 30 01:15:07.009853 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 257/501] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:15:07.034393 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-dca24d79-f960-4a9c-b87f-910d93894a76 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:07.035391 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-8abf2c6b-3021-44df-97a3-9762eba749f9 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lazy-loading 'services' on Instance uuid 2c5b301d-f84c-4395-add9-b84311fa785c {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:15:07.036077 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-dca24d79-f960-4a9c-b87f-910d93894a76 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] [instance: 19d392d4-2f19-4065-a580-b2fd72303153] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:07.055080 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8abf2c6b-3021-44df-97a3-9762eba749f9 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 200 len: 1927 microversion: 2.75 time: 0.270408 Oct 30 01:15:07.065989 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 245/502] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:06 2022] GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 1927 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:07.208259 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5c6fc90e-dc0d-42f6-b345-f1a1e9a810c4 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:07.208872 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5c6fc90e-dc0d-42f6-b345-f1a1e9a810c4 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:07.227520 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c6fc90e-dc0d-42f6-b345-f1a1e9a810c4 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:07.229705 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c6fc90e-dc0d-42f6-b345-f1a1e9a810c4 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:07.230867 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c6fc90e-dc0d-42f6-b345-f1a1e9a810c4 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:07.232003 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c6fc90e-dc0d-42f6-b345-f1a1e9a810c4 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:07.232852 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c6fc90e-dc0d-42f6-b345-f1a1e9a810c4 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:07.233606 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c6fc90e-dc0d-42f6-b345-f1a1e9a810c4 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:07.340942 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-dca24d79-f960-4a9c-b87f-910d93894a76 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ccc0bfdee94961aa198e3abf0d85cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee1e04c04bc40568e43eb98df39e7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:07.350345 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-dca24d79-f960-4a9c-b87f-910d93894a76 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] 10.222.0.13 "GET /compute/v2.1/servers/19d392d4-2f19-4065-a580-b2fd72303153" status: 200 len: 1222 microversion: 2.1 time: 0.320485 Oct 30 01:15:07.353166 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 258/503] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:07 2022] GET /compute/v2.1/servers/19d392d4-2f19-4065-a580-b2fd72303153 => generated 1222 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:07.360579 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-747cf359-228f-455d-9291-56db53c1242c req-7547ce9f-d16e-4e09-bf59-83eeaef6ff18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dd3f0e2-2c15-4915-88b0-2df9e312cc4c", "name": "network-vif-plugged", "status": "completed", "tag": "57a305e2-e962-4bb1-a776-09d4a458a514"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:07.420651 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-747cf359-228f-455d-9291-56db53c1242c req-7547ce9f-d16e-4e09-bf59-83eeaef6ff18 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:07.420651 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-747cf359-228f-455d-9291-56db53c1242c req-7547ce9f-d16e-4e09-bf59-83eeaef6ff18 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:07.420651 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-747cf359-228f-455d-9291-56db53c1242c req-7547ce9f-d16e-4e09-bf59-83eeaef6ff18 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:07.440358 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-747cf359-228f-455d-9291-56db53c1242c req-7547ce9f-d16e-4e09-bf59-83eeaef6ff18 service nova] Creating event network-vif-plugged:57a305e2-e962-4bb1-a776-09d4a458a514 for instance 0dd3f0e2-2c15-4915-88b0-2df9e312cc4c on n-h1-master-1 Oct 30 01:15:07.453960 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-747cf359-228f-455d-9291-56db53c1242c req-7547ce9f-d16e-4e09-bf59-83eeaef6ff18 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092591 Oct 30 01:15:07.457145 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 259/504] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:15:07.529997 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5c6fc90e-dc0d-42f6-b345-f1a1e9a810c4 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:07.537482 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:07.541678 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5c6fc90e-dc0d-42f6-b345-f1a1e9a810c4 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:07.547467 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5c6fc90e-dc0d-42f6-b345-f1a1e9a810c4 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:07.548710 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5c6fc90e-dc0d-42f6-b345-f1a1e9a810c4 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3" status: 200 len: 1565 microversion: 2.25 time: 0.344538 Oct 30 01:15:07.557070 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 246/505] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:07 2022] GET /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3 => generated 1565 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:07.826793 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e2775299-8df2-42d9-9512-5e8933ab13c9 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:07.828481 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e2775299-8df2-42d9-9512-5e8933ab13c9 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0dd3f0e2-2c15-4915-88b0-2df9e312cc4c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:07.840635 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2775299-8df2-42d9-9512-5e8933ab13c9 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:07.841620 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2775299-8df2-42d9-9512-5e8933ab13c9 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:07.842209 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2775299-8df2-42d9-9512-5e8933ab13c9 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:07.843437 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2775299-8df2-42d9-9512-5e8933ab13c9 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:07.848596 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2775299-8df2-42d9-9512-5e8933ab13c9 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:07.848596 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2775299-8df2-42d9-9512-5e8933ab13c9 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:08.043076 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e2775299-8df2-42d9-9512-5e8933ab13c9 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:08.054498 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e2775299-8df2-42d9-9512-5e8933ab13c9 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c" status: 200 len: 1311 microversion: 2.1 time: 0.232684 Oct 30 01:15:08.055527 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 260/506] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:07 2022] GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c => generated 1311 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:08.085431 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-46b4b099-0040-4b2f-be15-9e14907c0ef5 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:08.086639 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-46b4b099-0040-4b2f-be15-9e14907c0ef5 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:08.098970 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-46b4b099-0040-4b2f-be15-9e14907c0ef5 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:08.099219 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-46b4b099-0040-4b2f-be15-9e14907c0ef5 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:08.106135 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-46b4b099-0040-4b2f-be15-9e14907c0ef5 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:08.107129 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-46b4b099-0040-4b2f-be15-9e14907c0ef5 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:08.107607 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-46b4b099-0040-4b2f-be15-9e14907c0ef5 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:08.108026 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-46b4b099-0040-4b2f-be15-9e14907c0ef5 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:08.215524 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-46b4b099-0040-4b2f-be15-9e14907c0ef5 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lazy-loading 'services' on Instance uuid 2c5b301d-f84c-4395-add9-b84311fa785c {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:15:08.239371 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-46b4b099-0040-4b2f-be15-9e14907c0ef5 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 200 len: 1927 microversion: 2.75 time: 0.158969 Oct 30 01:15:08.240025 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 247/507] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:08 2022] GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 1927 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:08.377870 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-38620c33-6490-4ced-9c2a-1abc417e80be tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:08.379686 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-38620c33-6490-4ced-9c2a-1abc417e80be tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] [instance: 19d392d4-2f19-4065-a580-b2fd72303153] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:08.386519 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38620c33-6490-4ced-9c2a-1abc417e80be tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:08.387282 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38620c33-6490-4ced-9c2a-1abc417e80be tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:08.388158 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38620c33-6490-4ced-9c2a-1abc417e80be tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:08.389462 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38620c33-6490-4ced-9c2a-1abc417e80be tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:08.390148 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38620c33-6490-4ced-9c2a-1abc417e80be tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:08.391213 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38620c33-6490-4ced-9c2a-1abc417e80be tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:08.473362 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-38620c33-6490-4ced-9c2a-1abc417e80be tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ccc0bfdee94961aa198e3abf0d85cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee1e04c04bc40568e43eb98df39e7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:08.482119 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-38620c33-6490-4ced-9c2a-1abc417e80be tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] 10.222.0.13 "GET /compute/v2.1/servers/19d392d4-2f19-4065-a580-b2fd72303153" status: 200 len: 1274 microversion: 2.1 time: 0.107098 Oct 30 01:15:08.482982 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 261/508] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:08 2022] GET /compute/v2.1/servers/19d392d4-2f19-4065-a580-b2fd72303153 => generated 1274 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:08.577766 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8b1bda98-c1fc-4478-940c-6eb6c527e3e9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:08.578376 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8b1bda98-c1fc-4478-940c-6eb6c527e3e9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:08.591585 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b1bda98-c1fc-4478-940c-6eb6c527e3e9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:08.592074 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b1bda98-c1fc-4478-940c-6eb6c527e3e9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:08.592515 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b1bda98-c1fc-4478-940c-6eb6c527e3e9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:08.593205 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b1bda98-c1fc-4478-940c-6eb6c527e3e9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:08.594633 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b1bda98-c1fc-4478-940c-6eb6c527e3e9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:08.595230 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b1bda98-c1fc-4478-940c-6eb6c527e3e9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:08.770112 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8b1bda98-c1fc-4478-940c-6eb6c527e3e9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:08.778641 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8b1bda98-c1fc-4478-940c-6eb6c527e3e9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:08.780083 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8b1bda98-c1fc-4478-940c-6eb6c527e3e9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:08.781287 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8b1bda98-c1fc-4478-940c-6eb6c527e3e9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3" status: 200 len: 1565 microversion: 2.25 time: 0.207975 Oct 30 01:15:08.782096 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 248/509] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:08 2022] GET /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3 => generated 1565 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:08.979143 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1023cf69-44bf-4bb0-bb9a-1984db53c2ad tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:08.979836 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1023cf69-44bf-4bb0-bb9a-1984db53c2ad tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] [instance: 7571f255-6ff3-4fc7-bcaa-4837bc05dbf5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:08.988320 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1023cf69-44bf-4bb0-bb9a-1984db53c2ad tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:08.989083 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1023cf69-44bf-4bb0-bb9a-1984db53c2ad tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:08.989567 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1023cf69-44bf-4bb0-bb9a-1984db53c2ad tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:09.002896 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1023cf69-44bf-4bb0-bb9a-1984db53c2ad tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:09.002896 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1023cf69-44bf-4bb0-bb9a-1984db53c2ad tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:09.002896 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1023cf69-44bf-4bb0-bb9a-1984db53c2ad tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:09.021169 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1023cf69-44bf-4bb0-bb9a-1984db53c2ad tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] [instance: 7571f255-6ff3-4fc7-bcaa-4837bc05dbf5] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:15:09.191733 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7a906e1b-701b-472e-ad3d-59318aeaf1b2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1052557757", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:09.257281 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-7a906e1b-701b-472e-ad3d-59318aeaf1b2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] validate_networks() for None {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:15:09.455928 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1023cf69-44bf-4bb0-bb9a-1984db53c2ad tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7571f255-6ff3-4fc7-bcaa-4837bc05dbf5" status: 204 len: 0 microversion: 2.1 time: 0.480824 Oct 30 01:15:09.468780 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 249/510] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:15:08 2022] DELETE /compute/v2.1/servers/7571f255-6ff3-4fc7-bcaa-4837bc05dbf5 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 30 01:15:09.477500 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-731f4e10-dcef-4fb3-982f-90595aecfc14 req-60b8fc83-c2b7-4cb3-b280-53026734a34d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3", "tag": "158902f2-0cf8-4485-a0b9-8ba513a59715"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:09.490721 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-731f4e10-dcef-4fb3-982f-90595aecfc14 req-60b8fc83-c2b7-4cb3-b280-53026734a34d service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:09.491363 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-731f4e10-dcef-4fb3-982f-90595aecfc14 req-60b8fc83-c2b7-4cb3-b280-53026734a34d service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:09.491886 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-731f4e10-dcef-4fb3-982f-90595aecfc14 req-60b8fc83-c2b7-4cb3-b280-53026734a34d service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:09.510230 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-731f4e10-dcef-4fb3-982f-90595aecfc14 req-60b8fc83-c2b7-4cb3-b280-53026734a34d service nova] Creating event network-changed:158902f2-0cf8-4485-a0b9-8ba513a59715 for instance 6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3 on n-h2-master-1 Oct 30 01:15:09.518566 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-731f4e10-dcef-4fb3-982f-90595aecfc14 req-60b8fc83-c2b7-4cb3-b280-53026734a34d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047500 Oct 30 01:15:09.521132 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 250/511] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:15:09.529098 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5ae6d17b-b0de-448a-8760-8a9efe9f0903 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:09.531856 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5ae6d17b-b0de-448a-8760-8a9efe9f0903 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0dd3f0e2-2c15-4915-88b0-2df9e312cc4c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:09.541136 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5ae6d17b-b0de-448a-8760-8a9efe9f0903 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:09.542172 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5ae6d17b-b0de-448a-8760-8a9efe9f0903 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:09.542891 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5ae6d17b-b0de-448a-8760-8a9efe9f0903 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:09.543884 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5ae6d17b-b0de-448a-8760-8a9efe9f0903 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:09.544552 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5ae6d17b-b0de-448a-8760-8a9efe9f0903 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:09.545199 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5ae6d17b-b0de-448a-8760-8a9efe9f0903 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:09.665259 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-7a906e1b-701b-472e-ad3d-59318aeaf1b2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:15:09.665847 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-7a906e1b-701b-472e-ad3d-59318aeaf1b2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:15:09.666793 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-7a906e1b-701b-472e-ad3d-59318aeaf1b2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:15:09.667205 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-7a906e1b-701b-472e-ad3d-59318aeaf1b2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:15:09.667706 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-7a906e1b-701b-472e-ad3d-59318aeaf1b2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:15:09.688338 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7a906e1b-701b-472e-ad3d-59318aeaf1b2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:09.689363 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7a906e1b-701b-472e-ad3d-59318aeaf1b2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:09.690698 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7a906e1b-701b-472e-ad3d-59318aeaf1b2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:09.692601 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7a906e1b-701b-472e-ad3d-59318aeaf1b2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:09.693206 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7a906e1b-701b-472e-ad3d-59318aeaf1b2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:09.693935 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7a906e1b-701b-472e-ad3d-59318aeaf1b2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:09.714876 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-7a906e1b-701b-472e-ad3d-59318aeaf1b2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Getting quotas for project ad621909b99143dd9885006238de72a6. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:15:09.720451 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-7a906e1b-701b-472e-ad3d-59318aeaf1b2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Getting quotas for user 4f1fe6e04e064dfba969b07d4188ab38 and project ad621909b99143dd9885006238de72a6. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:15:09.729934 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5ae6d17b-b0de-448a-8760-8a9efe9f0903 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:09.734890 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7a906e1b-701b-472e-ad3d-59318aeaf1b2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:15:09.737316 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7a906e1b-701b-472e-ad3d-59318aeaf1b2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:15:09.744509 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5ae6d17b-b0de-448a-8760-8a9efe9f0903 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c" status: 200 len: 1493 microversion: 2.1 time: 0.221345 Oct 30 01:15:09.745100 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 251/512] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:09 2022] GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c => generated 1493 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:09.749684 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2254b24f-1759-4fa7-92d0-3885a9c153b2 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:09.750351 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2254b24f-1759-4fa7-92d0-3885a9c153b2 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:09.757759 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2254b24f-1759-4fa7-92d0-3885a9c153b2 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:09.758241 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2254b24f-1759-4fa7-92d0-3885a9c153b2 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:09.758759 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2254b24f-1759-4fa7-92d0-3885a9c153b2 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:09.759430 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2254b24f-1759-4fa7-92d0-3885a9c153b2 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:09.759869 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2254b24f-1759-4fa7-92d0-3885a9c153b2 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:09.760288 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2254b24f-1759-4fa7-92d0-3885a9c153b2 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:09.836396 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-2254b24f-1759-4fa7-92d0-3885a9c153b2 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lazy-loading 'services' on Instance uuid 2c5b301d-f84c-4395-add9-b84311fa785c {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:15:09.858796 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2254b24f-1759-4fa7-92d0-3885a9c153b2 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 200 len: 1927 microversion: 2.75 time: 0.112498 Oct 30 01:15:09.861471 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 252/513] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:09 2022] GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 1927 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:09.868393 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bc3f3560-3ef4-45ab-b4b6-f0fc5a050bbd tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:09.869233 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bc3f3560-3ef4-45ab-b4b6-f0fc5a050bbd tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] [instance: 19d392d4-2f19-4065-a580-b2fd72303153] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:09.885430 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bc3f3560-3ef4-45ab-b4b6-f0fc5a050bbd tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:09.885430 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bc3f3560-3ef4-45ab-b4b6-f0fc5a050bbd tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:09.885430 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bc3f3560-3ef4-45ab-b4b6-f0fc5a050bbd tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:09.885430 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bc3f3560-3ef4-45ab-b4b6-f0fc5a050bbd tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:09.886091 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bc3f3560-3ef4-45ab-b4b6-f0fc5a050bbd tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:09.886091 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bc3f3560-3ef4-45ab-b4b6-f0fc5a050bbd tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:09.920343 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7a906e1b-701b-472e-ad3d-59318aeaf1b2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.176095 Oct 30 01:15:09.921108 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 262/514] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:15:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1178 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 30 01:15:09.929223 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b293f3be-109b-4fcb-8fbf-5c8847543d05 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1919524054", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "1196629979", "adminPass": "***", "networks": [{"uuid": "08eb4cd4-abe6-4c41-b376-9a666b7ba9c0"}], "security_groups": [{"name": "tempest-securitygroup--819150286"}], "key_name": "tempest-keypair-548259820", "user_data": "}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:09.990082 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bc3f3560-3ef4-45ab-b4b6-f0fc5a050bbd tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ccc0bfdee94961aa198e3abf0d85cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee1e04c04bc40568e43eb98df39e7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:09.999825 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bc3f3560-3ef4-45ab-b4b6-f0fc5a050bbd tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] 10.222.0.13 "GET /compute/v2.1/servers/19d392d4-2f19-4065-a580-b2fd72303153" status: 200 len: 1292 microversion: 2.1 time: 0.136957 Oct 30 01:15:10.000932 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 253/515] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:09 2022] GET /compute/v2.1/servers/19d392d4-2f19-4065-a580-b2fd72303153 => generated 1292 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:10.005493 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c4f59688-57b9-4ca8-bce4-b4f653c93312 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:10.006096 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c4f59688-57b9-4ca8-bce4-b4f653c93312 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] [instance: 0dd3f0e2-2c15-4915-88b0-2df9e312cc4c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:10.012274 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4f59688-57b9-4ca8-bce4-b4f653c93312 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:10.012763 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4f59688-57b9-4ca8-bce4-b4f653c93312 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:10.013196 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4f59688-57b9-4ca8-bce4-b4f653c93312 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:10.013952 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4f59688-57b9-4ca8-bce4-b4f653c93312 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:10.014391 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4f59688-57b9-4ca8-bce4-b4f653c93312 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:10.014815 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4f59688-57b9-4ca8-bce4-b4f653c93312 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:10.091645 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-b293f3be-109b-4fcb-8fbf-5c8847543d05 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] validate_networks() for [('08eb4cd4-abe6-4c41-b376-9a666b7ba9c0', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:15:10.281413 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c4f59688-57b9-4ca8-bce4-b4f653c93312 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c" status: 200 len: 1644 microversion: 2.1 time: 0.279274 Oct 30 01:15:10.293243 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 254/516] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:10 2022] GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c => generated 1644 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:10.303301 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5a9637d4-d74b-44e9-bb2c-a2543c8c9908 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:10.303921 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5a9637d4-d74b-44e9-bb2c-a2543c8c9908 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:10.309798 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:10.313877 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a9637d4-d74b-44e9-bb2c-a2543c8c9908 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:10.314668 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a9637d4-d74b-44e9-bb2c-a2543c8c9908 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:10.314813 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a9637d4-d74b-44e9-bb2c-a2543c8c9908 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:10.315767 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a9637d4-d74b-44e9-bb2c-a2543c8c9908 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:10.316190 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a9637d4-d74b-44e9-bb2c-a2543c8c9908 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:10.316614 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a9637d4-d74b-44e9-bb2c-a2543c8c9908 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:10.547301 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5a9637d4-d74b-44e9-bb2c-a2543c8c9908 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:10.557597 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5a9637d4-d74b-44e9-bb2c-a2543c8c9908 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:10.559753 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5a9637d4-d74b-44e9-bb2c-a2543c8c9908 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:10.561038 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5a9637d4-d74b-44e9-bb2c-a2543c8c9908 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3" status: 200 len: 1565 microversion: 2.25 time: 0.266490 Oct 30 01:15:10.573455 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 255/517] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:10 2022] GET /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3 => generated 1565 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:10.573455 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a75ad30a-a356-4077-bcec-b0ac73c6e73b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:10.573455 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a75ad30a-a356-4077-bcec-b0ac73c6e73b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:10.656092 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a75ad30a-a356-4077-bcec-b0ac73c6e73b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:10.665648 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a75ad30a-a356-4077-bcec-b0ac73c6e73b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f" status: 200 len: 1213 microversion: 2.1 time: 0.102847 Oct 30 01:15:10.667523 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 256/518] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:10 2022] GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f => generated 1213 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:10.682233 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-96a29f87-b149-462c-a229-5d6e02c90a3d tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:10.682233 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-96a29f87-b149-462c-a229-5d6e02c90a3d tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] [instance: 0dd3f0e2-2c15-4915-88b0-2df9e312cc4c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:10.682233 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96a29f87-b149-462c-a229-5d6e02c90a3d tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:10.682233 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96a29f87-b149-462c-a229-5d6e02c90a3d tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:10.682664 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96a29f87-b149-462c-a229-5d6e02c90a3d tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:10.682664 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96a29f87-b149-462c-a229-5d6e02c90a3d tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:10.684837 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96a29f87-b149-462c-a229-5d6e02c90a3d tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:10.685680 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96a29f87-b149-462c-a229-5d6e02c90a3d tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:10.717135 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-b293f3be-109b-4fcb-8fbf-5c8847543d05 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:15:10.717909 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-b293f3be-109b-4fcb-8fbf-5c8847543d05 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:15:10.718509 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-b293f3be-109b-4fcb-8fbf-5c8847543d05 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:15:10.719044 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-b293f3be-109b-4fcb-8fbf-5c8847543d05 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:15:10.719569 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-b293f3be-109b-4fcb-8fbf-5c8847543d05 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:15:10.731304 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b293f3be-109b-4fcb-8fbf-5c8847543d05 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:10.731846 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b293f3be-109b-4fcb-8fbf-5c8847543d05 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:10.732288 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b293f3be-109b-4fcb-8fbf-5c8847543d05 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:10.733028 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b293f3be-109b-4fcb-8fbf-5c8847543d05 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:10.734046 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b293f3be-109b-4fcb-8fbf-5c8847543d05 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:10.734477 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b293f3be-109b-4fcb-8fbf-5c8847543d05 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:10.751813 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-b293f3be-109b-4fcb-8fbf-5c8847543d05 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Getting quotas for project 8e6f42c16eeb4e97b65cebf891105008. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:15:10.757062 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-b293f3be-109b-4fcb-8fbf-5c8847543d05 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Getting quotas for user 056e59c7d4c2475eb66b64e0e24367be and project 8e6f42c16eeb4e97b65cebf891105008. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:15:10.770195 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b293f3be-109b-4fcb-8fbf-5c8847543d05 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:15:10.772768 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b293f3be-109b-4fcb-8fbf-5c8847543d05 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] [instance: f9c8bf32-6f0e-4183-88be-031de936bb81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:15:10.844312 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-96a29f87-b149-462c-a229-5d6e02c90a3d tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c" status: 200 len: 1644 microversion: 2.1 time: 0.176656 Oct 30 01:15:10.844894 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 257/519] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:10 2022] GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c => generated 1644 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:10.870214 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-688c52e6-b71f-4373-a534-c4cd6bd4766b tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:10.875050 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-688c52e6-b71f-4373-a534-c4cd6bd4766b tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:10.875050 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-688c52e6-b71f-4373-a534-c4cd6bd4766b tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:10.875393 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-688c52e6-b71f-4373-a534-c4cd6bd4766b tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:10.876430 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-688c52e6-b71f-4373-a534-c4cd6bd4766b tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:10.876878 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-688c52e6-b71f-4373-a534-c4cd6bd4766b tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:10.877369 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-688c52e6-b71f-4373-a534-c4cd6bd4766b tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:10.910003 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-688c52e6-b71f-4373-a534-c4cd6bd4766b tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.047163 Oct 30 01:15:10.910803 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 258/520] 10.222.0.13 () {58 vars in 1176 bytes} [Sun Oct 30 01:15:10 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:15:10.916577 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-185b5928-3479-4f39-aa36-c6a70f726005 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:10.917560 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-185b5928-3479-4f39-aa36-c6a70f726005 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:10.917741 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b293f3be-109b-4fcb-8fbf-5c8847543d05 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.995074 Oct 30 01:15:10.921833 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 263/521] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:15:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 1000 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:15:10.927163 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-185b5928-3479-4f39-aa36-c6a70f726005 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:10.927868 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-185b5928-3479-4f39-aa36-c6a70f726005 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:10.928517 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-185b5928-3479-4f39-aa36-c6a70f726005 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:10.929467 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-185b5928-3479-4f39-aa36-c6a70f726005 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:10.930308 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-185b5928-3479-4f39-aa36-c6a70f726005 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:10.931094 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-185b5928-3479-4f39-aa36-c6a70f726005 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:10.934340 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-53ec0fce-7f61-4aec-93d5-0d28daa19a0d tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:10.934882 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-53ec0fce-7f61-4aec-93d5-0d28daa19a0d tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] [instance: 0dd3f0e2-2c15-4915-88b0-2df9e312cc4c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:10.950075 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-53ec0fce-7f61-4aec-93d5-0d28daa19a0d tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:10.952436 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-53ec0fce-7f61-4aec-93d5-0d28daa19a0d tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:10.954518 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-53ec0fce-7f61-4aec-93d5-0d28daa19a0d tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:10.958301 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-53ec0fce-7f61-4aec-93d5-0d28daa19a0d tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:10.958965 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-53ec0fce-7f61-4aec-93d5-0d28daa19a0d tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:10.959678 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-53ec0fce-7f61-4aec-93d5-0d28daa19a0d tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:11.179294 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-185b5928-3479-4f39-aa36-c6a70f726005 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lazy-loading 'services' on Instance uuid 2c5b301d-f84c-4395-add9-b84311fa785c {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:15:11.207487 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-185b5928-3479-4f39-aa36-c6a70f726005 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 200 len: 1927 microversion: 2.75 time: 0.294597 Oct 30 01:15:11.208510 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 259/522] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:10 2022] GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 1927 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:11.225184 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-45177e3c-ce9c-445c-8473-38734c54c862 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:11.226128 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-45177e3c-ce9c-445c-8473-38734c54c862 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] [instance: f9c8bf32-6f0e-4183-88be-031de936bb81] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:11.314214 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-53ec0fce-7f61-4aec-93d5-0d28daa19a0d tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c/action" status: 202 len: 0 microversion: 2.1 time: 0.386869 Oct 30 01:15:11.315270 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 264/523] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:15:10 2022] POST /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c/action => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:15:11.317673 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-45177e3c-ce9c-445c-8473-38734c54c862 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056e59c7d4c2475eb66b64e0e24367be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6f42c16eeb4e97b65cebf891105008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:11.325831 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-21ab05db-7358-4287-a0c5-5879b3eca5cd tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:11.326731 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-21ab05db-7358-4287-a0c5-5879b3eca5cd tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] [instance: 19d392d4-2f19-4065-a580-b2fd72303153] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:11.339311 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21ab05db-7358-4287-a0c5-5879b3eca5cd tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:11.340006 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21ab05db-7358-4287-a0c5-5879b3eca5cd tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:11.340793 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21ab05db-7358-4287-a0c5-5879b3eca5cd tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:11.341498 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-45177e3c-ce9c-445c-8473-38734c54c862 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] 10.222.0.13 "GET /compute/v2.1/servers/f9c8bf32-6f0e-4183-88be-031de936bb81" status: 200 len: 1264 microversion: 2.1 time: 0.131692 Oct 30 01:15:11.342328 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 260/524] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:11 2022] GET /compute/v2.1/servers/f9c8bf32-6f0e-4183-88be-031de936bb81 => generated 1264 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:11.354516 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-43684a81-dfff-4fec-8e97-f6aa01ce400d tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:11.354516 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-43684a81-dfff-4fec-8e97-f6aa01ce400d tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] [instance: 0dd3f0e2-2c15-4915-88b0-2df9e312cc4c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:11.356334 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-43684a81-dfff-4fec-8e97-f6aa01ce400d tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:11.358153 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-43684a81-dfff-4fec-8e97-f6aa01ce400d tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:11.358153 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-43684a81-dfff-4fec-8e97-f6aa01ce400d tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:11.360427 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-43684a81-dfff-4fec-8e97-f6aa01ce400d tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:11.360427 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-43684a81-dfff-4fec-8e97-f6aa01ce400d tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:11.360834 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-43684a81-dfff-4fec-8e97-f6aa01ce400d tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:11.372760 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21ab05db-7358-4287-a0c5-5879b3eca5cd tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:11.376280 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21ab05db-7358-4287-a0c5-5879b3eca5cd tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:11.376771 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21ab05db-7358-4287-a0c5-5879b3eca5cd tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:11.555052 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-21ab05db-7358-4287-a0c5-5879b3eca5cd tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ccc0bfdee94961aa198e3abf0d85cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee1e04c04bc40568e43eb98df39e7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:11.564406 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-21ab05db-7358-4287-a0c5-5879b3eca5cd tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] 10.222.0.13 "GET /compute/v2.1/servers/19d392d4-2f19-4065-a580-b2fd72303153" status: 200 len: 1280 microversion: 2.1 time: 0.246473 Oct 30 01:15:11.566197 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 265/525] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:11 2022] GET /compute/v2.1/servers/19d392d4-2f19-4065-a580-b2fd72303153 => generated 1280 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:11.672367 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-43684a81-dfff-4fec-8e97-f6aa01ce400d tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c" status: 200 len: 1649 microversion: 2.1 time: 0.327404 Oct 30 01:15:11.674113 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 261/526] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:11 2022] GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c => generated 1649 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:11.681473 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-046a9abe-b83f-4510-95af-836aee5d4182 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:11.682434 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-046a9abe-b83f-4510-95af-836aee5d4182 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:11.693815 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-046a9abe-b83f-4510-95af-836aee5d4182 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:11.694559 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-046a9abe-b83f-4510-95af-836aee5d4182 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:11.695159 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-046a9abe-b83f-4510-95af-836aee5d4182 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:11.696039 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-046a9abe-b83f-4510-95af-836aee5d4182 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:11.697110 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-046a9abe-b83f-4510-95af-836aee5d4182 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:11.697721 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-046a9abe-b83f-4510-95af-836aee5d4182 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:11.942130 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0ec81fcb-2527-49c1-a771-d7e81cfa6e73 tempest-SecurityGroupsTestAdminJSON-1608564342 tempest-SecurityGroupsTestAdminJSON-1608564342-project] Action: 'create', calling method: .version_select at 0x7f44cc7dff70>, body: {"security_group": {"name": "tempest-securitygroup-1386843822", "description": "tempest-description-1374619237"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:12.069576 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-046a9abe-b83f-4510-95af-836aee5d4182 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:12.081452 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-046a9abe-b83f-4510-95af-836aee5d4182 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:12.084240 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-046a9abe-b83f-4510-95af-836aee5d4182 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:12.086316 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-046a9abe-b83f-4510-95af-836aee5d4182 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3" status: 200 len: 1565 microversion: 2.25 time: 0.410944 Oct 30 01:15:12.087474 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 262/527] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:11 2022] GET /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3 => generated 1565 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:12.093599 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-279caa48-4520-4e7b-bbc3-4e4510af0840 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:12.094527 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-279caa48-4520-4e7b-bbc3-4e4510af0840 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:12.104829 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-279caa48-4520-4e7b-bbc3-4e4510af0840 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:12.105622 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-279caa48-4520-4e7b-bbc3-4e4510af0840 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:12.107315 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-279caa48-4520-4e7b-bbc3-4e4510af0840 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:12.108094 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-279caa48-4520-4e7b-bbc3-4e4510af0840 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:12.108548 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-279caa48-4520-4e7b-bbc3-4e4510af0840 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:12.108969 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-279caa48-4520-4e7b-bbc3-4e4510af0840 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:12.264549 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-279caa48-4520-4e7b-bbc3-4e4510af0840 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:12.282078 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-279caa48-4520-4e7b-bbc3-4e4510af0840 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f" status: 200 len: 1209 microversion: 2.1 time: 0.192181 Oct 30 01:15:12.283553 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 263/528] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:12 2022] GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f => generated 1209 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:12.308594 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cdc38fda-058c-43c8-9432-40a5bc64552e tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:12.310731 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cdc38fda-058c-43c8-9432-40a5bc64552e tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:12.325858 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cdc38fda-058c-43c8-9432-40a5bc64552e tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:12.328551 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cdc38fda-058c-43c8-9432-40a5bc64552e tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:12.329057 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cdc38fda-058c-43c8-9432-40a5bc64552e tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:12.331222 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cdc38fda-058c-43c8-9432-40a5bc64552e tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:12.334614 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cdc38fda-058c-43c8-9432-40a5bc64552e tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:12.337857 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cdc38fda-058c-43c8-9432-40a5bc64552e tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:12.348162 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:12.495136 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-cdc38fda-058c-43c8-9432-40a5bc64552e tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lazy-loading 'services' on Instance uuid 2c5b301d-f84c-4395-add9-b84311fa785c {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:15:12.525980 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cdc38fda-058c-43c8-9432-40a5bc64552e tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 200 len: 1927 microversion: 2.75 time: 0.229992 Oct 30 01:15:12.539309 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 264/529] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:12 2022] GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 1927 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:12.547669 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2a4ea2f8-17da-49b5-967c-3d4f60f8acfd tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:12.551920 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2a4ea2f8-17da-49b5-967c-3d4f60f8acfd tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] [instance: f9c8bf32-6f0e-4183-88be-031de936bb81] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:12.565390 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a4ea2f8-17da-49b5-967c-3d4f60f8acfd tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:12.567692 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a4ea2f8-17da-49b5-967c-3d4f60f8acfd tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:12.568410 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a4ea2f8-17da-49b5-967c-3d4f60f8acfd tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:12.571529 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a4ea2f8-17da-49b5-967c-3d4f60f8acfd tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:12.571529 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a4ea2f8-17da-49b5-967c-3d4f60f8acfd tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:12.571529 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a4ea2f8-17da-49b5-967c-3d4f60f8acfd tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:12.713702 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2a4ea2f8-17da-49b5-967c-3d4f60f8acfd tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056e59c7d4c2475eb66b64e0e24367be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6f42c16eeb4e97b65cebf891105008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:12.724622 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2a4ea2f8-17da-49b5-967c-3d4f60f8acfd tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] 10.222.0.13 "GET /compute/v2.1/servers/f9c8bf32-6f0e-4183-88be-031de936bb81" status: 200 len: 1268 microversion: 2.1 time: 0.184093 Oct 30 01:15:12.725780 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 265/530] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:12 2022] GET /compute/v2.1/servers/f9c8bf32-6f0e-4183-88be-031de936bb81 => generated 1268 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:12.741509 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-79241022-6a35-47a8-ad4b-f61005751977 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:12.741509 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-79241022-6a35-47a8-ad4b-f61005751977 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] [instance: 19d392d4-2f19-4065-a580-b2fd72303153] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:12.752994 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-79241022-6a35-47a8-ad4b-f61005751977 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:12.754444 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-79241022-6a35-47a8-ad4b-f61005751977 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:12.756152 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-79241022-6a35-47a8-ad4b-f61005751977 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:12.757691 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-79241022-6a35-47a8-ad4b-f61005751977 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:12.758360 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-79241022-6a35-47a8-ad4b-f61005751977 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:12.758946 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-79241022-6a35-47a8-ad4b-f61005751977 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:13.141250 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0ec81fcb-2527-49c1-a771-d7e81cfa6e73 tempest-SecurityGroupsTestAdminJSON-1608564342 tempest-SecurityGroupsTestAdminJSON-1608564342-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.572526 Oct 30 01:15:13.141250 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 266/531] 10.222.0.13 () {60 vars in 1180 bytes} [Sun Oct 30 01:15:11 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:15:13.145781 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-79241022-6a35-47a8-ad4b-f61005751977 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ccc0bfdee94961aa198e3abf0d85cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee1e04c04bc40568e43eb98df39e7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:13.146678 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-90f39043-e98d-4324-b809-83caf3596312 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:13.147588 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-90f39043-e98d-4324-b809-83caf3596312 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] [instance: 0dd3f0e2-2c15-4915-88b0-2df9e312cc4c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:13.154101 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-79241022-6a35-47a8-ad4b-f61005751977 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] 10.222.0.13 "GET /compute/v2.1/servers/19d392d4-2f19-4065-a580-b2fd72303153" status: 200 len: 1322 microversion: 2.1 time: 0.426878 Oct 30 01:15:13.159197 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-90f39043-e98d-4324-b809-83caf3596312 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:13.161477 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-90f39043-e98d-4324-b809-83caf3596312 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:13.162301 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-90f39043-e98d-4324-b809-83caf3596312 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:13.163219 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-90f39043-e98d-4324-b809-83caf3596312 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:13.163798 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-90f39043-e98d-4324-b809-83caf3596312 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:13.164387 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-90f39043-e98d-4324-b809-83caf3596312 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:13.173942 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 266/532] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:12 2022] GET /compute/v2.1/servers/19d392d4-2f19-4065-a580-b2fd72303153 => generated 1322 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:13.476111 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4a74be80-a6f0-4bf9-83e4-e59eb7b57e5b tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] Calling method '.version_select at 0x7f44cc609ca0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:13.480023 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a74be80-a6f0-4bf9-83e4-e59eb7b57e5b tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:13.480514 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a74be80-a6f0-4bf9-83e4-e59eb7b57e5b tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:13.480968 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a74be80-a6f0-4bf9-83e4-e59eb7b57e5b tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:13.484290 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a74be80-a6f0-4bf9-83e4-e59eb7b57e5b tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:13.484822 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a74be80-a6f0-4bf9-83e4-e59eb7b57e5b tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:13.485505 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a74be80-a6f0-4bf9-83e4-e59eb7b57e5b tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:13.512239 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4a74be80-a6f0-4bf9-83e4-e59eb7b57e5b tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.337040 Oct 30 01:15:13.520955 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 267/533] 10.222.0.13 () {58 vars in 1128 bytes} [Sun Oct 30 01:15:13 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:15:13.520955 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9b7e9eaf-a775-4530-b7fc-6af38e8684c5 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:13.520955 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9b7e9eaf-a775-4530-b7fc-6af38e8684c5 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:13.526891 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b7e9eaf-a775-4530-b7fc-6af38e8684c5 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:13.527379 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b7e9eaf-a775-4530-b7fc-6af38e8684c5 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:13.528050 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b7e9eaf-a775-4530-b7fc-6af38e8684c5 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:13.528647 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b7e9eaf-a775-4530-b7fc-6af38e8684c5 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:13.529086 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b7e9eaf-a775-4530-b7fc-6af38e8684c5 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:13.530866 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b7e9eaf-a775-4530-b7fc-6af38e8684c5 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:13.531001 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-90f39043-e98d-4324-b809-83caf3596312 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c" status: 200 len: 1629 microversion: 2.1 time: 0.387401 Oct 30 01:15:13.531001 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 267/534] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:13 2022] GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c => generated 1629 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:13.539628 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8fbc22fc-655b-42fd-a6a3-46d4f3935f2b tempest-SecurityGroupsTestAdminJSON-1608564342 tempest-SecurityGroupsTestAdminJSON-1608564342-project] Action: 'create', calling method: .version_select at 0x7f44cc78fca0>, body: {"security_group": {"name": "tempest-securitygroup-1825162965", "description": "tempest-description-427828014"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:13.850886 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9b7e9eaf-a775-4530-b7fc-6af38e8684c5 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:13.860288 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9b7e9eaf-a775-4530-b7fc-6af38e8684c5 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:13.882126 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9b7e9eaf-a775-4530-b7fc-6af38e8684c5 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:13.885122 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9b7e9eaf-a775-4530-b7fc-6af38e8684c5 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3" status: 200 len: 1565 microversion: 2.25 time: 0.370353 Oct 30 01:15:13.886903 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 268/535] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:13 2022] GET /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3 => generated 1565 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:13.895257 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-1d2b1f7c-2c8a-47a1-973b-8a961e3cedf7 req-251cbbfe-a1a4-4509-9dd4-bbeb918418bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7571f255-6ff3-4fc7-bcaa-4837bc05dbf5", "name": "network-vif-deleted", "tag": "f6b29ab4-dbe4-4f1d-8b86-4f2415442840"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:13.908795 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-1d2b1f7c-2c8a-47a1-973b-8a961e3cedf7 req-251cbbfe-a1a4-4509-9dd4-bbeb918418bb service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:13.911145 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-1d2b1f7c-2c8a-47a1-973b-8a961e3cedf7 req-251cbbfe-a1a4-4509-9dd4-bbeb918418bb service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:13.912103 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-1d2b1f7c-2c8a-47a1-973b-8a961e3cedf7 req-251cbbfe-a1a4-4509-9dd4-bbeb918418bb service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:13.953260 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-1d2b1f7c-2c8a-47a1-973b-8a961e3cedf7 req-251cbbfe-a1a4-4509-9dd4-bbeb918418bb service nova] Creating event network-vif-deleted:f6b29ab4-dbe4-4f1d-8b86-4f2415442840 for instance 7571f255-6ff3-4fc7-bcaa-4837bc05dbf5 on n-h2-master-1 Oct 30 01:15:13.965908 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-1d2b1f7c-2c8a-47a1-973b-8a961e3cedf7 req-251cbbfe-a1a4-4509-9dd4-bbeb918418bb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077285 Oct 30 01:15:13.967867 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 269/536] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:15:13.975156 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a47562bc-2f16-4b36-bd4c-85228f898ceb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:13.975991 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a47562bc-2f16-4b36-bd4c-85228f898ceb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:13.983286 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a47562bc-2f16-4b36-bd4c-85228f898ceb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:13.983794 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a47562bc-2f16-4b36-bd4c-85228f898ceb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:13.984219 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a47562bc-2f16-4b36-bd4c-85228f898ceb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:13.985265 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a47562bc-2f16-4b36-bd4c-85228f898ceb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:13.986429 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a47562bc-2f16-4b36-bd4c-85228f898ceb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:13.986429 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a47562bc-2f16-4b36-bd4c-85228f898ceb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:14.063580 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a47562bc-2f16-4b36-bd4c-85228f898ceb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:14.072981 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a47562bc-2f16-4b36-bd4c-85228f898ceb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f" status: 200 len: 1283 microversion: 2.1 time: 0.102200 Oct 30 01:15:14.073674 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 270/537] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:13 2022] GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f => generated 1283 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:14.078562 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2b07332d-6488-4272-b903-f09655b72f3c tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] Calling method '.version_select at 0x7f44cc609280>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:14.083989 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2b07332d-6488-4272-b903-f09655b72f3c tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:14.084847 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2b07332d-6488-4272-b903-f09655b72f3c tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:14.085540 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2b07332d-6488-4272-b903-f09655b72f3c tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:14.087219 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2b07332d-6488-4272-b903-f09655b72f3c tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:14.087869 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2b07332d-6488-4272-b903-f09655b72f3c tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:14.088506 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2b07332d-6488-4272-b903-f09655b72f3c tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:14.118463 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2b07332d-6488-4272-b903-f09655b72f3c tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.043504 Oct 30 01:15:14.120444 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 271/538] 10.222.0.13 () {58 vars in 1139 bytes} [Sun Oct 30 01:15:14 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:15:14.125947 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b0fe587c-c082-4aed-814c-5b2f5fbe1f01 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:14.130439 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b0fe587c-c082-4aed-814c-5b2f5fbe1f01 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:14.134062 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0fe587c-c082-4aed-814c-5b2f5fbe1f01 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:14.134480 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0fe587c-c082-4aed-814c-5b2f5fbe1f01 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:14.135631 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0fe587c-c082-4aed-814c-5b2f5fbe1f01 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:14.136642 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0fe587c-c082-4aed-814c-5b2f5fbe1f01 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:14.137674 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0fe587c-c082-4aed-814c-5b2f5fbe1f01 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:14.138665 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0fe587c-c082-4aed-814c-5b2f5fbe1f01 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:14.242183 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8fbc22fc-655b-42fd-a6a3-46d4f3935f2b tempest-SecurityGroupsTestAdminJSON-1608564342 tempest-SecurityGroupsTestAdminJSON-1608564342-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.710450 Oct 30 01:15:14.242776 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 268/539] 10.222.0.13 () {60 vars in 1180 bytes} [Sun Oct 30 01:15:13 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:15:14.248342 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-b0fe587c-c082-4aed-814c-5b2f5fbe1f01 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lazy-loading 'services' on Instance uuid 2c5b301d-f84c-4395-add9-b84311fa785c {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:15:14.255544 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-55788416-5e61-4bf7-9533-35778e50ab8e tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:14.259585 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-55788416-5e61-4bf7-9533-35778e50ab8e tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] [instance: 0dd3f0e2-2c15-4915-88b0-2df9e312cc4c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:14.274013 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b0fe587c-c082-4aed-814c-5b2f5fbe1f01 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 200 len: 1927 microversion: 2.75 time: 0.151831 Oct 30 01:15:14.274894 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 272/540] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:14 2022] GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 1927 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:14.278801 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-55788416-5e61-4bf7-9533-35778e50ab8e tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:14.279304 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-55788416-5e61-4bf7-9533-35778e50ab8e tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:14.279747 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-55788416-5e61-4bf7-9533-35778e50ab8e tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:14.280454 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-55788416-5e61-4bf7-9533-35778e50ab8e tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:14.281079 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-55788416-5e61-4bf7-9533-35778e50ab8e tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:14.281198 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0756623d-09e6-442a-b84e-3228ea0c3c87 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:14.281812 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-55788416-5e61-4bf7-9533-35778e50ab8e tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:14.281931 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0756623d-09e6-442a-b84e-3228ea0c3c87 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] [instance: f9c8bf32-6f0e-4183-88be-031de936bb81] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:14.289073 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0756623d-09e6-442a-b84e-3228ea0c3c87 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:14.289479 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0756623d-09e6-442a-b84e-3228ea0c3c87 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:14.290540 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0756623d-09e6-442a-b84e-3228ea0c3c87 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:14.291545 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0756623d-09e6-442a-b84e-3228ea0c3c87 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:14.292027 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0756623d-09e6-442a-b84e-3228ea0c3c87 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:14.292501 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0756623d-09e6-442a-b84e-3228ea0c3c87 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:14.327076 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-55788416-5e61-4bf7-9533-35778e50ab8e tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lazy-loading 'flavor' on Instance uuid 0dd3f0e2-2c15-4915-88b0-2df9e312cc4c {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:15:14.341840 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-55788416-5e61-4bf7-9533-35778e50ab8e tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] [instance: 0dd3f0e2-2c15-4915-88b0-2df9e312cc4c] Going to try to live migrate instance to n-h2-master-1 {{(pid=121103) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 30 01:15:14.374476 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:14.384234 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0756623d-09e6-442a-b84e-3228ea0c3c87 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056e59c7d4c2475eb66b64e0e24367be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6f42c16eeb4e97b65cebf891105008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:14.394587 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0756623d-09e6-442a-b84e-3228ea0c3c87 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] 10.222.0.13 "GET /compute/v2.1/servers/f9c8bf32-6f0e-4183-88be-031de936bb81" status: 200 len: 1316 microversion: 2.1 time: 0.118671 Oct 30 01:15:14.395188 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 273/541] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:14 2022] GET /compute/v2.1/servers/f9c8bf32-6f0e-4183-88be-031de936bb81 => generated 1316 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:14.399680 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2a982989-0354-44d6-b6be-410203a5a01a tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] Calling method '.version_select at 0x7f44cc622160>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:14.403517 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a982989-0354-44d6-b6be-410203a5a01a tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:14.404010 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a982989-0354-44d6-b6be-410203a5a01a tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:14.404443 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a982989-0354-44d6-b6be-410203a5a01a tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:14.405253 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a982989-0354-44d6-b6be-410203a5a01a tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:14.405651 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a982989-0354-44d6-b6be-410203a5a01a tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:14.406076 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a982989-0354-44d6-b6be-410203a5a01a tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:14.436674 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2a982989-0354-44d6-b6be-410203a5a01a tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.040379 Oct 30 01:15:14.442672 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 274/542] 10.222.0.13 () {58 vars in 1145 bytes} [Sun Oct 30 01:15:14 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:15:14.447178 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-33316cac-3402-4a9b-8c69-78105f2e2e6a tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:14.447778 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-33316cac-3402-4a9b-8c69-78105f2e2e6a tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] [instance: 19d392d4-2f19-4065-a580-b2fd72303153] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:14.456438 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-33316cac-3402-4a9b-8c69-78105f2e2e6a tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:14.456967 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-33316cac-3402-4a9b-8c69-78105f2e2e6a tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:14.458910 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-33316cac-3402-4a9b-8c69-78105f2e2e6a tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:14.458910 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-33316cac-3402-4a9b-8c69-78105f2e2e6a tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:14.458910 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-33316cac-3402-4a9b-8c69-78105f2e2e6a tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:14.459303 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-33316cac-3402-4a9b-8c69-78105f2e2e6a tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:14.735591 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-33316cac-3402-4a9b-8c69-78105f2e2e6a tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ccc0bfdee94961aa198e3abf0d85cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee1e04c04bc40568e43eb98df39e7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:14.749404 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-33316cac-3402-4a9b-8c69-78105f2e2e6a tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] 10.222.0.13 "GET /compute/v2.1/servers/19d392d4-2f19-4065-a580-b2fd72303153" status: 200 len: 1322 microversion: 2.1 time: 0.310930 Oct 30 01:15:14.765121 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 275/543] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:14 2022] GET /compute/v2.1/servers/19d392d4-2f19-4065-a580-b2fd72303153 => generated 1322 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:14.969648 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1562a48f-4221-43a1-8992-cf0671d4e97a tempest-SecurityGroupsTestAdminJSON-916476217 tempest-SecurityGroupsTestAdminJSON-916476217-project-admin] Action: 'create', calling method: .version_select at 0x7f44cc6f30d0>, body: {"security_group": {"name": "tempest-securitygroup-476948599", "description": "tempest-description-1760077157"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:16.181814 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1562a48f-4221-43a1-8992-cf0671d4e97a tempest-SecurityGroupsTestAdminJSON-916476217 tempest-SecurityGroupsTestAdminJSON-916476217-project-admin] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.429418 Oct 30 01:15:16.184232 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 276/544] 10.222.0.13 () {60 vars in 1180 bytes} [Sun Oct 30 01:15:14 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:15:16.187713 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-565d02a7-56da-41a1-aaf4-36ebc0c074ea req-4103fb97-b52b-460a-9ec4-e4084624e6e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19d392d4-2f19-4065-a580-b2fd72303153", "tag": "9b44d98c-e673-45c3-9a12-a02bb9d5af45"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:16.209475 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-565d02a7-56da-41a1-aaf4-36ebc0c074ea req-4103fb97-b52b-460a-9ec4-e4084624e6e2 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:16.210625 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-565d02a7-56da-41a1-aaf4-36ebc0c074ea req-4103fb97-b52b-460a-9ec4-e4084624e6e2 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:16.211197 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-565d02a7-56da-41a1-aaf4-36ebc0c074ea req-4103fb97-b52b-460a-9ec4-e4084624e6e2 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:16.232469 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-565d02a7-56da-41a1-aaf4-36ebc0c074ea req-4103fb97-b52b-460a-9ec4-e4084624e6e2 service nova] Creating event network-changed:9b44d98c-e673-45c3-9a12-a02bb9d5af45 for instance 19d392d4-2f19-4065-a580-b2fd72303153 on n-h2-master-1 Oct 30 01:15:16.241802 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-565d02a7-56da-41a1-aaf4-36ebc0c074ea req-4103fb97-b52b-460a-9ec4-e4084624e6e2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057446 Oct 30 01:15:16.242647 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 277/545] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:15:16.249676 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c294013c-9828-4e2a-bc3a-08c501f72f26 tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] Calling method '.version_select at 0x7f44ccb28a60>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:16.253523 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c294013c-9828-4e2a-bc3a-08c501f72f26 tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:16.254022 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c294013c-9828-4e2a-bc3a-08c501f72f26 tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:16.254462 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c294013c-9828-4e2a-bc3a-08c501f72f26 tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:16.255214 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c294013c-9828-4e2a-bc3a-08c501f72f26 tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:16.255671 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c294013c-9828-4e2a-bc3a-08c501f72f26 tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:16.256104 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c294013c-9828-4e2a-bc3a-08c501f72f26 tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:16.280962 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c294013c-9828-4e2a-bc3a-08c501f72f26 tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.035454 Oct 30 01:15:16.281623 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 278/546] 10.222.0.13 () {58 vars in 1128 bytes} [Sun Oct 30 01:15:16 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:15:16.286830 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4873610a-9400-4970-8a8d-fcf47b7e8b9d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:16.287565 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4873610a-9400-4970-8a8d-fcf47b7e8b9d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:16.294191 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4873610a-9400-4970-8a8d-fcf47b7e8b9d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:16.294687 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4873610a-9400-4970-8a8d-fcf47b7e8b9d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:16.299096 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4873610a-9400-4970-8a8d-fcf47b7e8b9d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:16.299096 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4873610a-9400-4970-8a8d-fcf47b7e8b9d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:16.299096 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4873610a-9400-4970-8a8d-fcf47b7e8b9d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:16.299096 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4873610a-9400-4970-8a8d-fcf47b7e8b9d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:16.436071 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4873610a-9400-4970-8a8d-fcf47b7e8b9d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:16.444632 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4873610a-9400-4970-8a8d-fcf47b7e8b9d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:16.446190 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4873610a-9400-4970-8a8d-fcf47b7e8b9d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:16.447962 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4873610a-9400-4970-8a8d-fcf47b7e8b9d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3" status: 200 len: 1565 microversion: 2.25 time: 0.164828 Oct 30 01:15:16.448098 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 279/547] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:16 2022] GET /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3 => generated 1565 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:16.467826 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9952f8f2-9237-400e-81a2-446d4e42db03 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:16.468446 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9952f8f2-9237-400e-81a2-446d4e42db03 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:16.476815 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9952f8f2-9237-400e-81a2-446d4e42db03 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:16.476815 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9952f8f2-9237-400e-81a2-446d4e42db03 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:16.476815 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9952f8f2-9237-400e-81a2-446d4e42db03 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:16.477134 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9952f8f2-9237-400e-81a2-446d4e42db03 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:16.477623 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9952f8f2-9237-400e-81a2-446d4e42db03 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:16.478049 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9952f8f2-9237-400e-81a2-446d4e42db03 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:16.630176 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9952f8f2-9237-400e-81a2-446d4e42db03 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:16.638561 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9952f8f2-9237-400e-81a2-446d4e42db03 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f" status: 200 len: 1313 microversion: 2.1 time: 0.175059 Oct 30 01:15:16.639260 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 280/548] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:16 2022] GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:16.644950 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-519aa7d8-d7da-4bc0-91ba-1ce2285ac021 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:16.645870 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-519aa7d8-d7da-4bc0-91ba-1ce2285ac021 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:16.652381 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-519aa7d8-d7da-4bc0-91ba-1ce2285ac021 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:16.652871 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-519aa7d8-d7da-4bc0-91ba-1ce2285ac021 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:16.653499 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-519aa7d8-d7da-4bc0-91ba-1ce2285ac021 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:16.654225 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-519aa7d8-d7da-4bc0-91ba-1ce2285ac021 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:16.654672 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-519aa7d8-d7da-4bc0-91ba-1ce2285ac021 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:16.655100 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-519aa7d8-d7da-4bc0-91ba-1ce2285ac021 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:16.732897 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-519aa7d8-d7da-4bc0-91ba-1ce2285ac021 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lazy-loading 'services' on Instance uuid 2c5b301d-f84c-4395-add9-b84311fa785c {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:15:16.751108 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-519aa7d8-d7da-4bc0-91ba-1ce2285ac021 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 200 len: 1927 microversion: 2.75 time: 0.110508 Oct 30 01:15:16.751622 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 281/549] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:16 2022] GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 1927 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:16.756991 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8a5fd184-36c9-4619-bcd6-2cd3c934260d tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:16.757921 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8a5fd184-36c9-4619-bcd6-2cd3c934260d tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] [instance: f9c8bf32-6f0e-4183-88be-031de936bb81] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:16.764443 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8a5fd184-36c9-4619-bcd6-2cd3c934260d tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:16.765063 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8a5fd184-36c9-4619-bcd6-2cd3c934260d tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:16.765455 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8a5fd184-36c9-4619-bcd6-2cd3c934260d tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:16.766169 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8a5fd184-36c9-4619-bcd6-2cd3c934260d tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:16.766612 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8a5fd184-36c9-4619-bcd6-2cd3c934260d tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:16.767246 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8a5fd184-36c9-4619-bcd6-2cd3c934260d tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:16.906850 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8a5fd184-36c9-4619-bcd6-2cd3c934260d tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056e59c7d4c2475eb66b64e0e24367be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6f42c16eeb4e97b65cebf891105008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:16.915612 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8a5fd184-36c9-4619-bcd6-2cd3c934260d tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] 10.222.0.13 "GET /compute/v2.1/servers/f9c8bf32-6f0e-4183-88be-031de936bb81" status: 200 len: 1389 microversion: 2.1 time: 0.162948 Oct 30 01:15:16.916253 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 282/550] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:16 2022] GET /compute/v2.1/servers/f9c8bf32-6f0e-4183-88be-031de936bb81 => generated 1389 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:16.921543 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-064dc7b9-a9bb-49e5-b183-b4af04ad3c17 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:16.922153 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-064dc7b9-a9bb-49e5-b183-b4af04ad3c17 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] [instance: 19d392d4-2f19-4065-a580-b2fd72303153] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:16.931699 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-064dc7b9-a9bb-49e5-b183-b4af04ad3c17 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:16.932454 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-064dc7b9-a9bb-49e5-b183-b4af04ad3c17 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:16.933219 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-064dc7b9-a9bb-49e5-b183-b4af04ad3c17 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:16.934222 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-064dc7b9-a9bb-49e5-b183-b4af04ad3c17 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:16.934669 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-064dc7b9-a9bb-49e5-b183-b4af04ad3c17 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:16.935946 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-064dc7b9-a9bb-49e5-b183-b4af04ad3c17 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:17.167253 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-064dc7b9-a9bb-49e5-b183-b4af04ad3c17 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ccc0bfdee94961aa198e3abf0d85cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee1e04c04bc40568e43eb98df39e7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:17.176258 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-064dc7b9-a9bb-49e5-b183-b4af04ad3c17 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] 10.222.0.13 "GET /compute/v2.1/servers/19d392d4-2f19-4065-a580-b2fd72303153" status: 200 len: 1322 microversion: 2.1 time: 0.258914 Oct 30 01:15:17.192526 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 283/551] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:16 2022] GET /compute/v2.1/servers/19d392d4-2f19-4065-a580-b2fd72303153 => generated 1322 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:17.197949 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d8ae636b-cb42-4ce2-bd6b-05e6f006003b tempest-SecurityGroupsTestAdminJSON-916476217 tempest-SecurityGroupsTestAdminJSON-916476217-project-admin] Action: 'create', calling method: .version_select at 0x7f44cc609820>, body: {"security_group": {"name": "tempest-securitygroup-58519946", "description": "tempest-description-1990526655"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:17.782399 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d8ae636b-cb42-4ce2-bd6b-05e6f006003b tempest-SecurityGroupsTestAdminJSON-916476217 tempest-SecurityGroupsTestAdminJSON-916476217-project-admin] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.583886 Oct 30 01:15:17.782399 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 284/552] 10.222.0.13 () {60 vars in 1180 bytes} [Sun Oct 30 01:15:17 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:15:17.787807 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9be2df32-41c2-4e6a-989c-1f5c7bed0e93 tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] Calling method '.version_select at 0x7f44cc5d5040>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:17.793028 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9be2df32-41c2-4e6a-989c-1f5c7bed0e93 tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:17.793564 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9be2df32-41c2-4e6a-989c-1f5c7bed0e93 tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:17.794248 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9be2df32-41c2-4e6a-989c-1f5c7bed0e93 tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:17.794998 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9be2df32-41c2-4e6a-989c-1f5c7bed0e93 tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:17.795453 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9be2df32-41c2-4e6a-989c-1f5c7bed0e93 tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:17.795873 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9be2df32-41c2-4e6a-989c-1f5c7bed0e93 tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:17.822387 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9be2df32-41c2-4e6a-989c-1f5c7bed0e93 tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.043005 Oct 30 01:15:17.823006 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 285/553] 10.222.0.13 () {58 vars in 1155 bytes} [Sun Oct 30 01:15:17 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:15:17.837933 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b62d1de0-ea3f-41a7-8086-ba08c4a527da tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:17.839796 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b62d1de0-ea3f-41a7-8086-ba08c4a527da tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:17.856086 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b62d1de0-ea3f-41a7-8086-ba08c4a527da tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:17.856589 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b62d1de0-ea3f-41a7-8086-ba08c4a527da tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:17.857036 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b62d1de0-ea3f-41a7-8086-ba08c4a527da tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:17.857853 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b62d1de0-ea3f-41a7-8086-ba08c4a527da tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:17.858313 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b62d1de0-ea3f-41a7-8086-ba08c4a527da tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:17.858767 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b62d1de0-ea3f-41a7-8086-ba08c4a527da tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:17.876223 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:18.108197 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b62d1de0-ea3f-41a7-8086-ba08c4a527da tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:18.120443 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b62d1de0-ea3f-41a7-8086-ba08c4a527da tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:18.122050 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b62d1de0-ea3f-41a7-8086-ba08c4a527da tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:18.124011 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b62d1de0-ea3f-41a7-8086-ba08c4a527da tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3" status: 200 len: 1565 microversion: 2.25 time: 0.290005 Oct 30 01:15:18.124978 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 286/554] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:17 2022] GET /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3 => generated 1565 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:18.131981 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-11800b59-2f5a-4f03-9c7f-4a72dbf479a4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:18.132600 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-11800b59-2f5a-4f03-9c7f-4a72dbf479a4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:18.141849 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-11800b59-2f5a-4f03-9c7f-4a72dbf479a4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:18.143063 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-11800b59-2f5a-4f03-9c7f-4a72dbf479a4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:18.144937 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-11800b59-2f5a-4f03-9c7f-4a72dbf479a4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:18.146532 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-11800b59-2f5a-4f03-9c7f-4a72dbf479a4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:18.147349 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-11800b59-2f5a-4f03-9c7f-4a72dbf479a4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:18.148551 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-11800b59-2f5a-4f03-9c7f-4a72dbf479a4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:18.358164 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-11800b59-2f5a-4f03-9c7f-4a72dbf479a4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:18.373367 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-11800b59-2f5a-4f03-9c7f-4a72dbf479a4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f" status: 200 len: 1313 microversion: 2.1 time: 0.246503 Oct 30 01:15:18.373983 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 287/555] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:18 2022] GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:18.379685 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e930346c-7d02-4b5e-beac-e9ebea408ca4 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:18.384286 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e930346c-7d02-4b5e-beac-e9ebea408ca4 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:18.387970 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e930346c-7d02-4b5e-beac-e9ebea408ca4 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:18.388745 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e930346c-7d02-4b5e-beac-e9ebea408ca4 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:18.389220 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e930346c-7d02-4b5e-beac-e9ebea408ca4 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:18.390167 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e930346c-7d02-4b5e-beac-e9ebea408ca4 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:18.390672 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e930346c-7d02-4b5e-beac-e9ebea408ca4 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:18.391096 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e930346c-7d02-4b5e-beac-e9ebea408ca4 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:18.470404 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-e930346c-7d02-4b5e-beac-e9ebea408ca4 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lazy-loading 'services' on Instance uuid 2c5b301d-f84c-4395-add9-b84311fa785c {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:15:18.489643 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e930346c-7d02-4b5e-beac-e9ebea408ca4 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 200 len: 1927 microversion: 2.75 time: 0.114061 Oct 30 01:15:18.490483 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 288/556] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:18 2022] GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 1927 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:18.495917 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8446497d-dd8a-4f80-82e2-a4b58513bbce tempest-SecurityGroupsTestAdminJSON-916476217 tempest-SecurityGroupsTestAdminJSON-916476217-project-admin] Calling method '.version_select at 0x7f44cc6221f0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:18.739122 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-55788416-5e61-4bf7-9533-35778e50ab8e tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c/action" status: 202 len: 0 microversion: 2.1 time: 4.494583 Oct 30 01:15:18.742272 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 269/557] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:15:14 2022] POST /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c/action => generated 0 bytes in 4499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:15:18.747944 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7f08561f-a0e4-451f-8902-0a4e674c1a65 tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] Calling method '.version_select at 0x7f44cc6b9940>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:18.757817 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7f08561f-a0e4-451f-8902-0a4e674c1a65 tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:18.758684 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7f08561f-a0e4-451f-8902-0a4e674c1a65 tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:18.759360 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7f08561f-a0e4-451f-8902-0a4e674c1a65 tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:18.760486 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7f08561f-a0e4-451f-8902-0a4e674c1a65 tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:18.761198 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7f08561f-a0e4-451f-8902-0a4e674c1a65 tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:18.762203 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7f08561f-a0e4-451f-8902-0a4e674c1a65 tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:18.803354 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7f08561f-a0e4-451f-8902-0a4e674c1a65 tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.058658 Oct 30 01:15:18.804380 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 270/558] 10.222.0.13 () {58 vars in 1128 bytes} [Sun Oct 30 01:15:18 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:15:18.810179 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-dae485a3-f9c2-4b13-ac58-eefd2f2fb00b tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:18.811154 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-dae485a3-f9c2-4b13-ac58-eefd2f2fb00b tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] [instance: f9c8bf32-6f0e-4183-88be-031de936bb81] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:18.821828 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dae485a3-f9c2-4b13-ac58-eefd2f2fb00b tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:18.824912 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dae485a3-f9c2-4b13-ac58-eefd2f2fb00b tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:18.824912 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dae485a3-f9c2-4b13-ac58-eefd2f2fb00b tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:18.824912 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dae485a3-f9c2-4b13-ac58-eefd2f2fb00b tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:18.824912 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dae485a3-f9c2-4b13-ac58-eefd2f2fb00b tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:18.825273 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dae485a3-f9c2-4b13-ac58-eefd2f2fb00b tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:19.045326 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-dae485a3-f9c2-4b13-ac58-eefd2f2fb00b tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056e59c7d4c2475eb66b64e0e24367be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6f42c16eeb4e97b65cebf891105008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:19.066770 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-dae485a3-f9c2-4b13-ac58-eefd2f2fb00b tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] 10.222.0.13 "GET /compute/v2.1/servers/f9c8bf32-6f0e-4183-88be-031de936bb81" status: 200 len: 1389 microversion: 2.1 time: 0.259946 Oct 30 01:15:19.068969 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 271/559] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:18 2022] GET /compute/v2.1/servers/f9c8bf32-6f0e-4183-88be-031de936bb81 => generated 1389 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:19.075674 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-158f7f7a-a8d2-416a-ac73-624f411c5d67 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:19.077009 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-158f7f7a-a8d2-416a-ac73-624f411c5d67 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] [instance: 19d392d4-2f19-4065-a580-b2fd72303153] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:19.085830 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-158f7f7a-a8d2-416a-ac73-624f411c5d67 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:19.087044 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-158f7f7a-a8d2-416a-ac73-624f411c5d67 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:19.087548 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-158f7f7a-a8d2-416a-ac73-624f411c5d67 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:19.089227 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-158f7f7a-a8d2-416a-ac73-624f411c5d67 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:19.090790 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-158f7f7a-a8d2-416a-ac73-624f411c5d67 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:19.091659 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-158f7f7a-a8d2-416a-ac73-624f411c5d67 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:19.301452 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-158f7f7a-a8d2-416a-ac73-624f411c5d67 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ccc0bfdee94961aa198e3abf0d85cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee1e04c04bc40568e43eb98df39e7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:19.325506 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-158f7f7a-a8d2-416a-ac73-624f411c5d67 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] 10.222.0.13 "GET /compute/v2.1/servers/19d392d4-2f19-4065-a580-b2fd72303153" status: 200 len: 1322 microversion: 2.1 time: 0.254774 Oct 30 01:15:19.326816 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 272/560] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:19 2022] GET /compute/v2.1/servers/19d392d4-2f19-4065-a580-b2fd72303153 => generated 1322 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:19.333140 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-50a7cbed-b4e2-4140-b890-cee06bd9ae18 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:19.334026 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-50a7cbed-b4e2-4140-b890-cee06bd9ae18 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0dd3f0e2-2c15-4915-88b0-2df9e312cc4c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:19.351911 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-50a7cbed-b4e2-4140-b890-cee06bd9ae18 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:19.352474 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-50a7cbed-b4e2-4140-b890-cee06bd9ae18 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:19.353032 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-50a7cbed-b4e2-4140-b890-cee06bd9ae18 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:19.353805 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-50a7cbed-b4e2-4140-b890-cee06bd9ae18 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:19.354385 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-50a7cbed-b4e2-4140-b890-cee06bd9ae18 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:19.355020 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-50a7cbed-b4e2-4140-b890-cee06bd9ae18 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:19.719620 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-50a7cbed-b4e2-4140-b890-cee06bd9ae18 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:19.737645 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-50a7cbed-b4e2-4140-b890-cee06bd9ae18 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c" status: 200 len: 1503 microversion: 2.1 time: 0.409606 Oct 30 01:15:19.754800 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 273/561] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:19 2022] GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c => generated 1503 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:19.759346 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c4650a6c-e5fb-4bf9-b1ff-264e165aa2f7 tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] Calling method '.version_select at 0x7f44cc7dfc10>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:19.766172 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c4650a6c-e5fb-4bf9-b1ff-264e165aa2f7 tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:19.766676 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c4650a6c-e5fb-4bf9-b1ff-264e165aa2f7 tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:19.767118 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c4650a6c-e5fb-4bf9-b1ff-264e165aa2f7 tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:19.782777 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c4650a6c-e5fb-4bf9-b1ff-264e165aa2f7 tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:19.783275 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c4650a6c-e5fb-4bf9-b1ff-264e165aa2f7 tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:19.783710 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c4650a6c-e5fb-4bf9-b1ff-264e165aa2f7 tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:19.826198 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c4650a6c-e5fb-4bf9-b1ff-264e165aa2f7 tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts/n-h1-master-1" status: 200 len: 860 microversion: 2.1 time: 0.070976 Oct 30 01:15:19.834479 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 274/562] 10.222.0.13 () {58 vars in 1170 bytes} [Sun Oct 30 01:15:19 2022] GET /compute/v2.1/os-hosts/n-h1-master-1 => generated 860 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:15:19.834479 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-6db53fbf-c34e-448f-9081-c9139c7a1ab5 req-cce82216-8dd8-4e9b-ae3f-e9530efde693 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9c8bf32-6f0e-4183-88be-031de936bb81", "tag": "04c8c04f-f3e1-4927-a35a-2de5c05a0259"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:19.852927 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-6db53fbf-c34e-448f-9081-c9139c7a1ab5 req-cce82216-8dd8-4e9b-ae3f-e9530efde693 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:19.855803 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-6db53fbf-c34e-448f-9081-c9139c7a1ab5 req-cce82216-8dd8-4e9b-ae3f-e9530efde693 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:19.856353 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-6db53fbf-c34e-448f-9081-c9139c7a1ab5 req-cce82216-8dd8-4e9b-ae3f-e9530efde693 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:19.880729 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-6db53fbf-c34e-448f-9081-c9139c7a1ab5 req-cce82216-8dd8-4e9b-ae3f-e9530efde693 service nova] Creating event network-changed:04c8c04f-f3e1-4927-a35a-2de5c05a0259 for instance f9c8bf32-6f0e-4183-88be-031de936bb81 on n-h2-master-1 Oct 30 01:15:19.887464 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-6db53fbf-c34e-448f-9081-c9139c7a1ab5 req-cce82216-8dd8-4e9b-ae3f-e9530efde693 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058190 Oct 30 01:15:19.888815 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 275/563] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:15:19.901989 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e7cdb135-3bb4-4199-8437-fa011589d44b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:19.903954 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e7cdb135-3bb4-4199-8437-fa011589d44b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:19.919483 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7cdb135-3bb4-4199-8437-fa011589d44b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:19.920540 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7cdb135-3bb4-4199-8437-fa011589d44b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:19.921282 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7cdb135-3bb4-4199-8437-fa011589d44b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:19.922314 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7cdb135-3bb4-4199-8437-fa011589d44b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:19.923025 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7cdb135-3bb4-4199-8437-fa011589d44b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:19.923702 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7cdb135-3bb4-4199-8437-fa011589d44b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:20.359110 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e7cdb135-3bb4-4199-8437-fa011589d44b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:20.382482 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e7cdb135-3bb4-4199-8437-fa011589d44b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:20.386017 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e7cdb135-3bb4-4199-8437-fa011589d44b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:20.391492 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e7cdb135-3bb4-4199-8437-fa011589d44b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3" status: 200 len: 1555 microversion: 2.25 time: 0.500698 Oct 30 01:15:20.397814 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 276/564] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:19 2022] GET /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3 => generated 1555 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:20.420003 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-426a879c-ca03-47f1-8863-151f7401f9d0 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:20.421161 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-426a879c-ca03-47f1-8863-151f7401f9d0 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:20.436280 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-426a879c-ca03-47f1-8863-151f7401f9d0 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:20.438606 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-426a879c-ca03-47f1-8863-151f7401f9d0 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:20.442565 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-426a879c-ca03-47f1-8863-151f7401f9d0 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:20.445494 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-426a879c-ca03-47f1-8863-151f7401f9d0 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:20.446579 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-426a879c-ca03-47f1-8863-151f7401f9d0 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:20.447026 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-426a879c-ca03-47f1-8863-151f7401f9d0 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:20.664648 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-426a879c-ca03-47f1-8863-151f7401f9d0 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:20.672759 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-426a879c-ca03-47f1-8863-151f7401f9d0 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f" status: 200 len: 1313 microversion: 2.1 time: 0.272109 Oct 30 01:15:20.673365 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 277/565] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:20 2022] GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f => generated 1313 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:20.693014 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1d0aede9-ba06-42cd-90a3-ac71deb8ee8a tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:20.697591 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1d0aede9-ba06-42cd-90a3-ac71deb8ee8a tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:20.699874 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1d0aede9-ba06-42cd-90a3-ac71deb8ee8a tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:20.700373 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1d0aede9-ba06-42cd-90a3-ac71deb8ee8a tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:20.700819 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1d0aede9-ba06-42cd-90a3-ac71deb8ee8a tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:20.701560 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1d0aede9-ba06-42cd-90a3-ac71deb8ee8a tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:20.702021 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1d0aede9-ba06-42cd-90a3-ac71deb8ee8a tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:20.702451 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1d0aede9-ba06-42cd-90a3-ac71deb8ee8a tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:20.764870 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=49,nova_cell0:UPDATE=7 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:20.788025 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-1d0aede9-ba06-42cd-90a3-ac71deb8ee8a tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lazy-loading 'services' on Instance uuid 2c5b301d-f84c-4395-add9-b84311fa785c {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:15:20.810995 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1d0aede9-ba06-42cd-90a3-ac71deb8ee8a tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 200 len: 1927 microversion: 2.75 time: 0.125038 Oct 30 01:15:20.812322 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 278/566] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:20 2022] GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 1927 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:20.822426 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bf99b8f1-72e1-41fc-b3cc-8a5d0545f9bb tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] Calling method '.version_select at 0x7f44cc6b9550>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:20.830433 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bf99b8f1-72e1-41fc-b3cc-8a5d0545f9bb tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:20.830944 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bf99b8f1-72e1-41fc-b3cc-8a5d0545f9bb tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:20.831437 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bf99b8f1-72e1-41fc-b3cc-8a5d0545f9bb tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:20.847885 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bf99b8f1-72e1-41fc-b3cc-8a5d0545f9bb tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:20.848383 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bf99b8f1-72e1-41fc-b3cc-8a5d0545f9bb tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:20.848817 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bf99b8f1-72e1-41fc-b3cc-8a5d0545f9bb tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:20.872740 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bf99b8f1-72e1-41fc-b3cc-8a5d0545f9bb tempest-HostsAdminTestJSON-1391322185 tempest-HostsAdminTestJSON-1391322185-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts/n-h2-master-1" status: 200 len: 860 microversion: 2.1 time: 0.054246 Oct 30 01:15:20.873352 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 279/567] 10.222.0.13 () {58 vars in 1170 bytes} [Sun Oct 30 01:15:20 2022] GET /compute/v2.1/os-hosts/n-h2-master-1 => generated 860 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:15:20.884224 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e100c7c9-f852-418c-9c78-cb8bb2c87b41 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:20.885095 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e100c7c9-f852-418c-9c78-cb8bb2c87b41 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] [instance: f9c8bf32-6f0e-4183-88be-031de936bb81] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:20.892069 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e100c7c9-f852-418c-9c78-cb8bb2c87b41 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:20.892568 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e100c7c9-f852-418c-9c78-cb8bb2c87b41 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:20.893043 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e100c7c9-f852-418c-9c78-cb8bb2c87b41 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:20.893790 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e100c7c9-f852-418c-9c78-cb8bb2c87b41 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:20.894661 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e100c7c9-f852-418c-9c78-cb8bb2c87b41 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:20.894794 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e100c7c9-f852-418c-9c78-cb8bb2c87b41 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:21.101083 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e100c7c9-f852-418c-9c78-cb8bb2c87b41 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056e59c7d4c2475eb66b64e0e24367be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6f42c16eeb4e97b65cebf891105008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:21.111090 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e100c7c9-f852-418c-9c78-cb8bb2c87b41 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] 10.222.0.13 "GET /compute/v2.1/servers/f9c8bf32-6f0e-4183-88be-031de936bb81" status: 200 len: 1389 microversion: 2.1 time: 0.236624 Oct 30 01:15:21.111687 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 280/568] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:20 2022] GET /compute/v2.1/servers/f9c8bf32-6f0e-4183-88be-031de936bb81 => generated 1389 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:21.123032 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5b601423-898e-4c79-bfa3-214360f302bb tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:21.124033 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5b601423-898e-4c79-bfa3-214360f302bb tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] [instance: 19d392d4-2f19-4065-a580-b2fd72303153] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:21.132978 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5b601423-898e-4c79-bfa3-214360f302bb tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:21.133887 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5b601423-898e-4c79-bfa3-214360f302bb tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:21.136793 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5b601423-898e-4c79-bfa3-214360f302bb tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:21.136793 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5b601423-898e-4c79-bfa3-214360f302bb tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:21.136793 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5b601423-898e-4c79-bfa3-214360f302bb tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:21.136793 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5b601423-898e-4c79-bfa3-214360f302bb tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:21.335008 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=13 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:21.432795 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5b601423-898e-4c79-bfa3-214360f302bb tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ccc0bfdee94961aa198e3abf0d85cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee1e04c04bc40568e43eb98df39e7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:21.444883 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5b601423-898e-4c79-bfa3-214360f302bb tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] 10.222.0.13 "GET /compute/v2.1/servers/19d392d4-2f19-4065-a580-b2fd72303153" status: 200 len: 1322 microversion: 2.1 time: 0.331787 Oct 30 01:15:21.447229 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 281/569] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:21 2022] GET /compute/v2.1/servers/19d392d4-2f19-4065-a580-b2fd72303153 => generated 1322 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:21.450662 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9586a533-8c99-4f3b-b8cb-bc8851cbad9f tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Calling method '.version_select at 0x7f44cc78fee0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:21.454602 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9586a533-8c99-4f3b-b8cb-bc8851cbad9f tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:21.462962 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9586a533-8c99-4f3b-b8cb-bc8851cbad9f tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:21.462962 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9586a533-8c99-4f3b-b8cb-bc8851cbad9f tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:21.465979 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9586a533-8c99-4f3b-b8cb-bc8851cbad9f tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] 10.222.0.13 "GET /compute/v2.1/os-migrations" status: 200 len: 1766 microversion: 2.25 time: 0.018782 Oct 30 01:15:21.476214 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8446497d-dd8a-4f80-82e2-a4b58513bbce tempest-SecurityGroupsTestAdminJSON-916476217 tempest-SecurityGroupsTestAdminJSON-916476217-project-admin] 10.222.0.13 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 10368 microversion: 2.1 time: 2.983670 Oct 30 01:15:21.479468 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 282/570] 10.222.0.13 () {60 vars in 1184 bytes} [Sun Oct 30 01:15:21 2022] GET /compute/v2.1/os-migrations => generated 1766 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:21.489634 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 289/571] 10.222.0.13 () {58 vars in 1191 bytes} [Sun Oct 30 01:15:18 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 10368 bytes in 2998 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:15:21.497662 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d95b3ffa-5464-40ca-9a9f-fb531c4d175c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:21.497662 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d95b3ffa-5464-40ca-9a9f-fb531c4d175c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0dd3f0e2-2c15-4915-88b0-2df9e312cc4c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:21.499956 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c9db2caf-738f-41e5-ac87-a79c987dafd9 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:21.501164 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c9db2caf-738f-41e5-ac87-a79c987dafd9 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] [instance: 6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:21.516578 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c9db2caf-738f-41e5-ac87-a79c987dafd9 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:21.517906 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c9db2caf-738f-41e5-ac87-a79c987dafd9 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:21.518857 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c9db2caf-738f-41e5-ac87-a79c987dafd9 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:21.520393 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c9db2caf-738f-41e5-ac87-a79c987dafd9 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:21.521291 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c9db2caf-738f-41e5-ac87-a79c987dafd9 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:21.522065 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c9db2caf-738f-41e5-ac87-a79c987dafd9 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:21.525268 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=3,nova_api:INSERT=6 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:21.527591 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d95b3ffa-5464-40ca-9a9f-fb531c4d175c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:21.528087 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d95b3ffa-5464-40ca-9a9f-fb531c4d175c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:21.528514 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d95b3ffa-5464-40ca-9a9f-fb531c4d175c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:21.529888 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d95b3ffa-5464-40ca-9a9f-fb531c4d175c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:21.530351 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d95b3ffa-5464-40ca-9a9f-fb531c4d175c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:21.530921 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d95b3ffa-5464-40ca-9a9f-fb531c4d175c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:21.807381 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-c9db2caf-738f-41e5-ac87-a79c987dafd9 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lazy-loading 'services' on Instance uuid 6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:15:21.817093 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d95b3ffa-5464-40ca-9a9f-fb531c4d175c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:21.821762 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c9db2caf-738f-41e5-ac87-a79c987dafd9 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3" status: 200 len: 2047 microversion: 2.25 time: 0.330509 Oct 30 01:15:21.822436 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 290/572] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:21 2022] GET /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3 => generated 2047 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:21.827188 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-27b69d2d-3098-4e10-87d4-93629807c8e7 tempest-SecurityGroupsTestAdminJSON-1608564342 tempest-SecurityGroupsTestAdminJSON-1608564342-project] Calling method '.version_select at 0x7f44cc616790>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:21.839745 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d95b3ffa-5464-40ca-9a9f-fb531c4d175c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c" status: 200 len: 1503 microversion: 2.1 time: 0.357129 Oct 30 01:15:21.855991 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 283/573] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:21 2022] GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c => generated 1503 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:21.867884 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2f38ac2f-f57f-4b77-ba81-afab756fadc0 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:21.869587 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2f38ac2f-f57f-4b77-ba81-afab756fadc0 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:21.884419 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f38ac2f-f57f-4b77-ba81-afab756fadc0 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:21.885378 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f38ac2f-f57f-4b77-ba81-afab756fadc0 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:21.886036 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f38ac2f-f57f-4b77-ba81-afab756fadc0 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:21.886945 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f38ac2f-f57f-4b77-ba81-afab756fadc0 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:21.887692 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f38ac2f-f57f-4b77-ba81-afab756fadc0 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:21.888431 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f38ac2f-f57f-4b77-ba81-afab756fadc0 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:22.143471 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2f38ac2f-f57f-4b77-ba81-afab756fadc0 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:22.153276 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2f38ac2f-f57f-4b77-ba81-afab756fadc0 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f" status: 200 len: 1313 microversion: 2.1 time: 0.294320 Oct 30 01:15:22.153934 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 284/574] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:21 2022] GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f => generated 1313 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:22.158787 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bb265b99-cb2b-4518-91b8-1b9efffe4095 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:22.159397 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-bb265b99-cb2b-4518-91b8-1b9efffe4095 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:22.166681 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb265b99-cb2b-4518-91b8-1b9efffe4095 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:22.167177 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb265b99-cb2b-4518-91b8-1b9efffe4095 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:22.167606 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb265b99-cb2b-4518-91b8-1b9efffe4095 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:22.168512 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb265b99-cb2b-4518-91b8-1b9efffe4095 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:22.174144 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb265b99-cb2b-4518-91b8-1b9efffe4095 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:22.174144 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb265b99-cb2b-4518-91b8-1b9efffe4095 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:22.189151 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-27b69d2d-3098-4e10-87d4-93629807c8e7 tempest-SecurityGroupsTestAdminJSON-1608564342 tempest-SecurityGroupsTestAdminJSON-1608564342-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1112 microversion: 2.1 time: 0.365633 Oct 30 01:15:22.189786 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 291/575] 10.222.0.13 () {58 vars in 1191 bytes} [Sun Oct 30 01:15:21 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1112 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:22.195888 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-a1a23580-0347-4e01-b45c-89b2e4aa3816 req-d60a67e0-74b5-4c65-b583-42e60bd2e8d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12ca60c1-7c35-420c-b177-c7f3915a989f", "tag": "0230e7b6-4d30-48c3-b9ab-066d496072ad"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:22.230096 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-a1a23580-0347-4e01-b45c-89b2e4aa3816 req-d60a67e0-74b5-4c65-b583-42e60bd2e8d3 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:22.230584 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-a1a23580-0347-4e01-b45c-89b2e4aa3816 req-d60a67e0-74b5-4c65-b583-42e60bd2e8d3 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:22.233553 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-a1a23580-0347-4e01-b45c-89b2e4aa3816 req-d60a67e0-74b5-4c65-b583-42e60bd2e8d3 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:22.247463 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-a1a23580-0347-4e01-b45c-89b2e4aa3816 req-d60a67e0-74b5-4c65-b583-42e60bd2e8d3 service nova] Creating event network-changed:0230e7b6-4d30-48c3-b9ab-066d496072ad for instance 12ca60c1-7c35-420c-b177-c7f3915a989f on n-h2-master-1 Oct 30 01:15:22.255178 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-a1a23580-0347-4e01-b45c-89b2e4aa3816 req-d60a67e0-74b5-4c65-b583-42e60bd2e8d3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062895 Oct 30 01:15:22.256166 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 292/576] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:15:22.263670 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d69f1492-92db-4d62-8938-9f3c72ee4b39 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-280527272", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "a3d745df-bc10-475b-bfb1-2cc9b94a14da"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:22.265028 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-bb265b99-cb2b-4518-91b8-1b9efffe4095 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lazy-loading 'services' on Instance uuid 2c5b301d-f84c-4395-add9-b84311fa785c {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:15:22.288023 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bb265b99-cb2b-4518-91b8-1b9efffe4095 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 200 len: 1927 microversion: 2.75 time: 0.132772 Oct 30 01:15:22.289139 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 285/577] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:22 2022] GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 1927 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:22.295870 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-40e74713-a605-464b-848f-9ab3ca12ec91 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:22.296589 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-40e74713-a605-464b-848f-9ab3ca12ec91 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] [instance: f9c8bf32-6f0e-4183-88be-031de936bb81] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:22.304732 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-40e74713-a605-464b-848f-9ab3ca12ec91 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:22.309700 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-40e74713-a605-464b-848f-9ab3ca12ec91 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:22.309700 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-40e74713-a605-464b-848f-9ab3ca12ec91 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:22.309700 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-40e74713-a605-464b-848f-9ab3ca12ec91 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:22.309700 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-40e74713-a605-464b-848f-9ab3ca12ec91 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:22.310198 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-40e74713-a605-464b-848f-9ab3ca12ec91 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:22.327687 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-d69f1492-92db-4d62-8938-9f3c72ee4b39 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] validate_networks() for [('a3d745df-bc10-475b-bfb1-2cc9b94a14da', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:15:22.332746 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:22.549733 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-40e74713-a605-464b-848f-9ab3ca12ec91 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056e59c7d4c2475eb66b64e0e24367be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6f42c16eeb4e97b65cebf891105008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:22.560169 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-40e74713-a605-464b-848f-9ab3ca12ec91 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] 10.222.0.13 "GET /compute/v2.1/servers/f9c8bf32-6f0e-4183-88be-031de936bb81" status: 200 len: 1389 microversion: 2.1 time: 0.269763 Oct 30 01:15:22.566874 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 286/578] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:22 2022] GET /compute/v2.1/servers/f9c8bf32-6f0e-4183-88be-031de936bb81 => generated 1389 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:22.572277 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9496ebe3-ef4a-4a86-94f4-b3aa3ccd0d8f tempest-SecurityGroupsTestAdminJSON-916476217 tempest-SecurityGroupsTestAdminJSON-916476217-project-admin] Calling method '.version_select at 0x7f44cc7df550>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:23.393977 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-d69f1492-92db-4d62-8938-9f3c72ee4b39 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:15:23.393977 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-d69f1492-92db-4d62-8938-9f3c72ee4b39 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:15:23.393977 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-d69f1492-92db-4d62-8938-9f3c72ee4b39 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:15:23.393977 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-d69f1492-92db-4d62-8938-9f3c72ee4b39 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:15:23.393977 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-d69f1492-92db-4d62-8938-9f3c72ee4b39 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:15:23.396539 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d69f1492-92db-4d62-8938-9f3c72ee4b39 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:23.396539 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d69f1492-92db-4d62-8938-9f3c72ee4b39 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:23.397207 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d69f1492-92db-4d62-8938-9f3c72ee4b39 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:23.398871 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d69f1492-92db-4d62-8938-9f3c72ee4b39 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:23.399120 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d69f1492-92db-4d62-8938-9f3c72ee4b39 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:23.399989 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d69f1492-92db-4d62-8938-9f3c72ee4b39 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:23.424472 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-d69f1492-92db-4d62-8938-9f3c72ee4b39 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Getting quotas for project 301cee87901844ed94e635eca054960d. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:15:23.429603 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:23.431078 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-d69f1492-92db-4d62-8938-9f3c72ee4b39 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Getting quotas for user 2096bbb8aff742b1837931e52ac1c9ae and project 301cee87901844ed94e635eca054960d. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:15:23.451188 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d69f1492-92db-4d62-8938-9f3c72ee4b39 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:15:23.742930 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d69f1492-92db-4d62-8938-9f3c72ee4b39 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 3f60e45a-0e20-4280-be86-275d598fd552] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:15:23.886692 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9496ebe3-ef4a-4a86-94f4-b3aa3ccd0d8f tempest-SecurityGroupsTestAdminJSON-916476217 tempest-SecurityGroupsTestAdminJSON-916476217-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/19708b1d-d290-4fa3-8219-76804cb47ea5" status: 202 len: 0 microversion: 2.1 time: 1.324661 Oct 30 01:15:23.888220 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 287/579] 10.222.0.13 () {58 vars in 1272 bytes} [Sun Oct 30 01:15:22 2022] DELETE /compute/v2.1/os-security-groups/19708b1d-d290-4fa3-8219-76804cb47ea5 => generated 0 bytes in 1327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:15:23.898160 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ff251c92-0b70-4b72-b51e-c1318091a328 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:23.900580 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ff251c92-0b70-4b72-b51e-c1318091a328 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] [instance: 19d392d4-2f19-4065-a580-b2fd72303153] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:23.911198 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d69f1492-92db-4d62-8938-9f3c72ee4b39 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.653472 Oct 30 01:15:23.921493 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ff251c92-0b70-4b72-b51e-c1318091a328 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:23.922027 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ff251c92-0b70-4b72-b51e-c1318091a328 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:23.922844 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 293/580] 10.222.0.13 () {62 vars in 1188 bytes} [Sun Oct 30 01:15:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1666 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 30 01:15:23.923910 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ff251c92-0b70-4b72-b51e-c1318091a328 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:23.924851 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ff251c92-0b70-4b72-b51e-c1318091a328 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:23.925866 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ff251c92-0b70-4b72-b51e-c1318091a328 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:23.926483 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ff251c92-0b70-4b72-b51e-c1318091a328 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:23.928442 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-7d34d1c0-6b8f-4ea0-a7bb-816262ec6ee1 req-0bbb836c-ca82-4872-b074-de5307ff5644 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19d392d4-2f19-4065-a580-b2fd72303153", "name": "network-vif-plugged", "status": "completed", "tag": "9b44d98c-e673-45c3-9a12-a02bb9d5af45"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:23.939954 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-7d34d1c0-6b8f-4ea0-a7bb-816262ec6ee1 req-0bbb836c-ca82-4872-b074-de5307ff5644 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:23.940882 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-7d34d1c0-6b8f-4ea0-a7bb-816262ec6ee1 req-0bbb836c-ca82-4872-b074-de5307ff5644 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:23.942064 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-7d34d1c0-6b8f-4ea0-a7bb-816262ec6ee1 req-0bbb836c-ca82-4872-b074-de5307ff5644 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:23.958166 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-7d34d1c0-6b8f-4ea0-a7bb-816262ec6ee1 req-0bbb836c-ca82-4872-b074-de5307ff5644 service nova] Creating event network-vif-plugged:9b44d98c-e673-45c3-9a12-a02bb9d5af45 for instance 19d392d4-2f19-4065-a580-b2fd72303153 on n-h2-master-1 Oct 30 01:15:23.964771 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-7d34d1c0-6b8f-4ea0-a7bb-816262ec6ee1 req-0bbb836c-ca82-4872-b074-de5307ff5644 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040620 Oct 30 01:15:23.965709 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 294/581] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:15:23.982204 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ac433d22-ac57-44ae-a4cb-595b26ad4962 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:23.982925 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ac433d22-ac57-44ae-a4cb-595b26ad4962 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0dd3f0e2-2c15-4915-88b0-2df9e312cc4c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:24.000777 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ac433d22-ac57-44ae-a4cb-595b26ad4962 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:24.004659 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ac433d22-ac57-44ae-a4cb-595b26ad4962 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:24.008150 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ac433d22-ac57-44ae-a4cb-595b26ad4962 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:24.009384 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ac433d22-ac57-44ae-a4cb-595b26ad4962 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:24.010158 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ac433d22-ac57-44ae-a4cb-595b26ad4962 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:24.011199 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ac433d22-ac57-44ae-a4cb-595b26ad4962 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:24.328056 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ff251c92-0b70-4b72-b51e-c1318091a328 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ccc0bfdee94961aa198e3abf0d85cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee1e04c04bc40568e43eb98df39e7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:24.340580 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ff251c92-0b70-4b72-b51e-c1318091a328 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] 10.222.0.13 "GET /compute/v2.1/servers/19d392d4-2f19-4065-a580-b2fd72303153" status: 200 len: 1322 microversion: 2.1 time: 0.451056 Oct 30 01:15:24.360669 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 288/582] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:23 2022] GET /compute/v2.1/servers/19d392d4-2f19-4065-a580-b2fd72303153 => generated 1322 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:24.368361 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-21278060-8860-482d-be6b-a6c43e50b1dd tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:24.369082 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-21278060-8860-482d-be6b-a6c43e50b1dd tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:24.376284 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21278060-8860-482d-be6b-a6c43e50b1dd tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:24.376906 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21278060-8860-482d-be6b-a6c43e50b1dd tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:24.377492 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21278060-8860-482d-be6b-a6c43e50b1dd tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:24.378300 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21278060-8860-482d-be6b-a6c43e50b1dd tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:24.379140 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21278060-8860-482d-be6b-a6c43e50b1dd tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:24.379782 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21278060-8860-482d-be6b-a6c43e50b1dd tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:24.442880 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ac433d22-ac57-44ae-a4cb-595b26ad4962 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:24.460078 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ac433d22-ac57-44ae-a4cb-595b26ad4962 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c" status: 200 len: 1503 microversion: 2.1 time: 0.481984 Oct 30 01:15:24.473375 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 295/583] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:23 2022] GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c => generated 1503 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:24.473375 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f61c3860-ca04-4726-a57b-0f219c3a8ff0 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:24.473375 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f61c3860-ca04-4726-a57b-0f219c3a8ff0 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:24.516888 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f61c3860-ca04-4726-a57b-0f219c3a8ff0 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:24.517433 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f61c3860-ca04-4726-a57b-0f219c3a8ff0 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:24.518883 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f61c3860-ca04-4726-a57b-0f219c3a8ff0 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:24.519953 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f61c3860-ca04-4726-a57b-0f219c3a8ff0 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:24.520424 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f61c3860-ca04-4726-a57b-0f219c3a8ff0 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:24.522294 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f61c3860-ca04-4726-a57b-0f219c3a8ff0 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:24.662977 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-f61c3860-ca04-4726-a57b-0f219c3a8ff0 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lazy-loading 'services' on Instance uuid 2c5b301d-f84c-4395-add9-b84311fa785c {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:15:24.671071 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-21278060-8860-482d-be6b-a6c43e50b1dd tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:24.677298 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-21278060-8860-482d-be6b-a6c43e50b1dd tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f" status: 200 len: 1313 microversion: 2.1 time: 0.315087 Oct 30 01:15:24.678857 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 289/584] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:24 2022] GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f => generated 1313 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:24.685081 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f61c3860-ca04-4726-a57b-0f219c3a8ff0 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 200 len: 1927 microversion: 2.75 time: 0.222707 Oct 30 01:15:24.685982 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 296/585] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:24 2022] GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 1927 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:24.705439 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2ef0fb2f-6586-4745-b903-ce5c13081e92 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:24.705439 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2ef0fb2f-6586-4745-b903-ce5c13081e92 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] [instance: f9c8bf32-6f0e-4183-88be-031de936bb81] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:24.705439 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2ef0fb2f-6586-4745-b903-ce5c13081e92 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:24.705439 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2ef0fb2f-6586-4745-b903-ce5c13081e92 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:24.705966 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2ef0fb2f-6586-4745-b903-ce5c13081e92 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:24.705966 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2ef0fb2f-6586-4745-b903-ce5c13081e92 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:24.705966 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2ef0fb2f-6586-4745-b903-ce5c13081e92 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:24.705966 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2ef0fb2f-6586-4745-b903-ce5c13081e92 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:24.712722 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a5e05ca2-eb8e-4c0a-a749-085b2f5235dc tempest-SecurityGroupsTestAdminJSON-916476217 tempest-SecurityGroupsTestAdminJSON-916476217-project-admin] Calling method '.version_select at 0x7f44cc616310>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:24.960465 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2ef0fb2f-6586-4745-b903-ce5c13081e92 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056e59c7d4c2475eb66b64e0e24367be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6f42c16eeb4e97b65cebf891105008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:24.970727 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2ef0fb2f-6586-4745-b903-ce5c13081e92 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] 10.222.0.13 "GET /compute/v2.1/servers/f9c8bf32-6f0e-4183-88be-031de936bb81" status: 200 len: 1389 microversion: 2.1 time: 0.290122 Oct 30 01:15:24.973933 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 290/586] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:24 2022] GET /compute/v2.1/servers/f9c8bf32-6f0e-4183-88be-031de936bb81 => generated 1389 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:24.991112 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cb296939-c22f-4359-a930-cc5b5b476cd6 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:24.991817 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-cb296939-c22f-4359-a930-cc5b5b476cd6 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 3f60e45a-0e20-4280-be86-275d598fd552] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:25.091340 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-cb296939-c22f-4359-a930-cc5b5b476cd6 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:25.101277 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-cb296939-c22f-4359-a930-cc5b5b476cd6 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:25.103579 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-cb296939-c22f-4359-a930-cc5b5b476cd6 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:25.105887 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cb296939-c22f-4359-a930-cc5b5b476cd6 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552" status: 200 len: 1261 microversion: 2.25 time: 0.130686 Oct 30 01:15:25.126704 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 291/587] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:24 2022] GET /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552 => generated 1261 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:25.132572 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-00b94022-6f95-45cf-ba6a-a7d15edd841e req-c343112b-52f2-4b1d-b125-9da99b0cd3d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dd3f0e2-2c15-4915-88b0-2df9e312cc4c", "name": "network-vif-unplugged", "status": "completed", "tag": "57a305e2-e962-4bb1-a776-09d4a458a514"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:25.147092 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-00b94022-6f95-45cf-ba6a-a7d15edd841e req-c343112b-52f2-4b1d-b125-9da99b0cd3d9 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:25.147528 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-00b94022-6f95-45cf-ba6a-a7d15edd841e req-c343112b-52f2-4b1d-b125-9da99b0cd3d9 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:25.147962 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-00b94022-6f95-45cf-ba6a-a7d15edd841e req-c343112b-52f2-4b1d-b125-9da99b0cd3d9 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:25.161036 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-00b94022-6f95-45cf-ba6a-a7d15edd841e req-c343112b-52f2-4b1d-b125-9da99b0cd3d9 service nova] Creating event network-vif-unplugged:57a305e2-e962-4bb1-a776-09d4a458a514 for instance 0dd3f0e2-2c15-4915-88b0-2df9e312cc4c on n-h1-master-1 Oct 30 01:15:25.167883 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-00b94022-6f95-45cf-ba6a-a7d15edd841e req-c343112b-52f2-4b1d-b125-9da99b0cd3d9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046285 Oct 30 01:15:25.169165 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 292/588] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:15:25.266114 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a5e05ca2-eb8e-4c0a-a749-085b2f5235dc tempest-SecurityGroupsTestAdminJSON-916476217 tempest-SecurityGroupsTestAdminJSON-916476217-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/e9e6feaa-1005-47dc-8686-1bf77bea5750" status: 202 len: 0 microversion: 2.1 time: 0.549958 Oct 30 01:15:25.266114 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 297/589] 10.222.0.13 () {58 vars in 1272 bytes} [Sun Oct 30 01:15:24 2022] DELETE /compute/v2.1/os-security-groups/e9e6feaa-1005-47dc-8686-1bf77bea5750 => generated 0 bytes in 552 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:15:25.267968 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1cea1d2f-d672-4640-8a3d-7229caf03654 tempest-SecurityGroupsTestAdminJSON-1608564342 tempest-SecurityGroupsTestAdminJSON-1608564342-project] Calling method '.version_select at 0x7f44cc7df550>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:25.366544 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-065c1eb8-a52f-484f-a022-3f5537951e11 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:25.367160 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-065c1eb8-a52f-484f-a022-3f5537951e11 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] [instance: 19d392d4-2f19-4065-a580-b2fd72303153] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:25.373167 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-065c1eb8-a52f-484f-a022-3f5537951e11 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:25.373692 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-065c1eb8-a52f-484f-a022-3f5537951e11 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:25.374124 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-065c1eb8-a52f-484f-a022-3f5537951e11 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:25.375034 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-065c1eb8-a52f-484f-a022-3f5537951e11 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:25.375476 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-065c1eb8-a52f-484f-a022-3f5537951e11 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:25.375894 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-065c1eb8-a52f-484f-a022-3f5537951e11 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:25.573681 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-065c1eb8-a52f-484f-a022-3f5537951e11 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ccc0bfdee94961aa198e3abf0d85cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee1e04c04bc40568e43eb98df39e7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:25.582223 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-065c1eb8-a52f-484f-a022-3f5537951e11 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] 10.222.0.13 "GET /compute/v2.1/servers/19d392d4-2f19-4065-a580-b2fd72303153" status: 200 len: 1322 microversion: 2.1 time: 0.220194 Oct 30 01:15:25.582933 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 298/590] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:25 2022] GET /compute/v2.1/servers/19d392d4-2f19-4065-a580-b2fd72303153 => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:15:25.589443 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-92962cef-ca33-42e4-ac32-da3370053a03 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:25.590066 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-92962cef-ca33-42e4-ac32-da3370053a03 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0dd3f0e2-2c15-4915-88b0-2df9e312cc4c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:25.596655 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92962cef-ca33-42e4-ac32-da3370053a03 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:25.597152 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92962cef-ca33-42e4-ac32-da3370053a03 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:25.597627 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92962cef-ca33-42e4-ac32-da3370053a03 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:25.598334 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92962cef-ca33-42e4-ac32-da3370053a03 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:25.598787 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92962cef-ca33-42e4-ac32-da3370053a03 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:25.599211 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92962cef-ca33-42e4-ac32-da3370053a03 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:25.671151 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1cea1d2f-d672-4640-8a3d-7229caf03654 tempest-SecurityGroupsTestAdminJSON-1608564342 tempest-SecurityGroupsTestAdminJSON-1608564342-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/ac609a5a-5d4f-4dca-8888-9e6015968761" status: 202 len: 0 microversion: 2.1 time: 0.407362 Oct 30 01:15:25.671735 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 293/591] 10.222.0.13 () {58 vars in 1272 bytes} [Sun Oct 30 01:15:25 2022] DELETE /compute/v2.1/os-security-groups/ac609a5a-5d4f-4dca-8888-9e6015968761 => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:15:25.680889 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-41e7e26d-b1a5-4ae2-a16b-4c152cec22ef tempest-SecurityGroupsTestAdminJSON-1608564342 tempest-SecurityGroupsTestAdminJSON-1608564342-project] Calling method '.version_select at 0x7f44cc71f940>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:25.849209 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-92962cef-ca33-42e4-ac32-da3370053a03 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:25.862410 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-92962cef-ca33-42e4-ac32-da3370053a03 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c" status: 200 len: 1503 microversion: 2.1 time: 0.277673 Oct 30 01:15:25.868301 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 299/592] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:25 2022] GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c => generated 1503 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:25.887870 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b3430311-e040-4bdc-ba5e-117dfb419371 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:25.889771 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b3430311-e040-4bdc-ba5e-117dfb419371 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:25.908545 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b3430311-e040-4bdc-ba5e-117dfb419371 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:25.908941 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b3430311-e040-4bdc-ba5e-117dfb419371 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:25.909410 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b3430311-e040-4bdc-ba5e-117dfb419371 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:25.910236 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b3430311-e040-4bdc-ba5e-117dfb419371 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:25.910856 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b3430311-e040-4bdc-ba5e-117dfb419371 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:25.911432 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b3430311-e040-4bdc-ba5e-117dfb419371 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:26.067465 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b3430311-e040-4bdc-ba5e-117dfb419371 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:26.075320 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b3430311-e040-4bdc-ba5e-117dfb419371 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f" status: 200 len: 1313 microversion: 2.1 time: 0.205790 Oct 30 01:15:26.075905 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 300/593] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:25 2022] GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f => generated 1313 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:26.080649 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-828bb771-80f8-47f6-ab6d-7fe6a455bdc8 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:26.081258 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-828bb771-80f8-47f6-ab6d-7fe6a455bdc8 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:26.097258 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-41e7e26d-b1a5-4ae2-a16b-4c152cec22ef tempest-SecurityGroupsTestAdminJSON-1608564342 tempest-SecurityGroupsTestAdminJSON-1608564342-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/bb2aa0d9-ae68-406d-9bea-45760de42a6b" status: 202 len: 0 microversion: 2.1 time: 0.420473 Oct 30 01:15:26.099518 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-828bb771-80f8-47f6-ab6d-7fe6a455bdc8 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:26.100012 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-828bb771-80f8-47f6-ab6d-7fe6a455bdc8 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:26.101723 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 294/594] 10.222.0.13 () {58 vars in 1272 bytes} [Sun Oct 30 01:15:25 2022] DELETE /compute/v2.1/os-security-groups/bb2aa0d9-ae68-406d-9bea-45760de42a6b => generated 0 bytes in 426 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:15:26.117859 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-828bb771-80f8-47f6-ab6d-7fe6a455bdc8 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:26.117859 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-828bb771-80f8-47f6-ab6d-7fe6a455bdc8 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:26.117859 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-828bb771-80f8-47f6-ab6d-7fe6a455bdc8 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:26.117859 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-828bb771-80f8-47f6-ab6d-7fe6a455bdc8 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:26.122817 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-dd60456e-974b-4e83-b8c1-ded720d1d8e4 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:26.124430 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-dd60456e-974b-4e83-b8c1-ded720d1d8e4 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] [instance: f9c8bf32-6f0e-4183-88be-031de936bb81] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:26.138029 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dd60456e-974b-4e83-b8c1-ded720d1d8e4 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:26.139862 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dd60456e-974b-4e83-b8c1-ded720d1d8e4 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:26.140784 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dd60456e-974b-4e83-b8c1-ded720d1d8e4 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:26.142021 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dd60456e-974b-4e83-b8c1-ded720d1d8e4 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:26.142817 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dd60456e-974b-4e83-b8c1-ded720d1d8e4 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:26.161518 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dd60456e-974b-4e83-b8c1-ded720d1d8e4 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:26.205253 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-828bb771-80f8-47f6-ab6d-7fe6a455bdc8 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lazy-loading 'services' on Instance uuid 2c5b301d-f84c-4395-add9-b84311fa785c {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:15:26.229049 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-828bb771-80f8-47f6-ab6d-7fe6a455bdc8 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 200 len: 1927 microversion: 2.75 time: 0.151858 Oct 30 01:15:26.230070 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 301/595] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:26 2022] GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 1927 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:26.235435 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fdba9c49-882a-4afa-a626-28f069e492d8 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:26.236526 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fdba9c49-882a-4afa-a626-28f069e492d8 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 3f60e45a-0e20-4280-be86-275d598fd552] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:26.247055 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fdba9c49-882a-4afa-a626-28f069e492d8 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:26.247570 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fdba9c49-882a-4afa-a626-28f069e492d8 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:26.249687 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fdba9c49-882a-4afa-a626-28f069e492d8 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:26.251797 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fdba9c49-882a-4afa-a626-28f069e492d8 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:26.252269 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fdba9c49-882a-4afa-a626-28f069e492d8 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:26.253096 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fdba9c49-882a-4afa-a626-28f069e492d8 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:26.330670 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-fdba9c49-882a-4afa-a626-28f069e492d8 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:26.342853 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-fdba9c49-882a-4afa-a626-28f069e492d8 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:26.365646 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-fdba9c49-882a-4afa-a626-28f069e492d8 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:26.365646 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fdba9c49-882a-4afa-a626-28f069e492d8 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552" status: 200 len: 1313 microversion: 2.25 time: 0.114214 Oct 30 01:15:26.365646 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 302/596] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:26 2022] GET /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552 => generated 1313 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:26.406133 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-dd60456e-974b-4e83-b8c1-ded720d1d8e4 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056e59c7d4c2475eb66b64e0e24367be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6f42c16eeb4e97b65cebf891105008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:26.414714 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-dd60456e-974b-4e83-b8c1-ded720d1d8e4 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] 10.222.0.13 "GET /compute/v2.1/servers/f9c8bf32-6f0e-4183-88be-031de936bb81" status: 200 len: 1389 microversion: 2.1 time: 0.311563 Oct 30 01:15:26.415385 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 295/597] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:26 2022] GET /compute/v2.1/servers/f9c8bf32-6f0e-4183-88be-031de936bb81 => generated 1389 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:26.605248 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5b366a5b-c449-4284-96fc-d547e56b1982 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:26.607656 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5b366a5b-c449-4284-96fc-d547e56b1982 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] [instance: 19d392d4-2f19-4065-a580-b2fd72303153] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:26.615646 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5b366a5b-c449-4284-96fc-d547e56b1982 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:26.616137 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5b366a5b-c449-4284-96fc-d547e56b1982 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:26.616687 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5b366a5b-c449-4284-96fc-d547e56b1982 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:26.617421 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5b366a5b-c449-4284-96fc-d547e56b1982 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:26.618147 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5b366a5b-c449-4284-96fc-d547e56b1982 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:26.618458 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5b366a5b-c449-4284-96fc-d547e56b1982 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:26.769525 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5b366a5b-c449-4284-96fc-d547e56b1982 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ccc0bfdee94961aa198e3abf0d85cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee1e04c04bc40568e43eb98df39e7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:26.777744 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5b366a5b-c449-4284-96fc-d547e56b1982 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] 10.222.0.13 "GET /compute/v2.1/servers/19d392d4-2f19-4065-a580-b2fd72303153" status: 200 len: 1471 microversion: 2.1 time: 0.176274 Oct 30 01:15:26.778370 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 303/598] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:26 2022] GET /compute/v2.1/servers/19d392d4-2f19-4065-a580-b2fd72303153 => generated 1471 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:26.801463 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f0931a00-a90d-491a-88dd-83e448ff7aba tempest-ServersAdminNegativeTestJSON-331223024 tempest-ServersAdminNegativeTestJSON-331223024-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:26.802116 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f0931a00-a90d-491a-88dd-83e448ff7aba tempest-ServersAdminNegativeTestJSON-331223024 tempest-ServersAdminNegativeTestJSON-331223024-project-admin] [instance: 19d392d4-2f19-4065-a580-b2fd72303153] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:26.808816 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f0931a00-a90d-491a-88dd-83e448ff7aba tempest-ServersAdminNegativeTestJSON-331223024 tempest-ServersAdminNegativeTestJSON-331223024-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:26.809581 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f0931a00-a90d-491a-88dd-83e448ff7aba tempest-ServersAdminNegativeTestJSON-331223024 tempest-ServersAdminNegativeTestJSON-331223024-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:26.810072 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f0931a00-a90d-491a-88dd-83e448ff7aba tempest-ServersAdminNegativeTestJSON-331223024 tempest-ServersAdminNegativeTestJSON-331223024-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:26.810875 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f0931a00-a90d-491a-88dd-83e448ff7aba tempest-ServersAdminNegativeTestJSON-331223024 tempest-ServersAdminNegativeTestJSON-331223024-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:26.811328 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f0931a00-a90d-491a-88dd-83e448ff7aba tempest-ServersAdminNegativeTestJSON-331223024 tempest-ServersAdminNegativeTestJSON-331223024-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:26.811746 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f0931a00-a90d-491a-88dd-83e448ff7aba tempest-ServersAdminNegativeTestJSON-331223024 tempest-ServersAdminNegativeTestJSON-331223024-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:26.836265 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-f0931a00-a90d-491a-88dd-83e448ff7aba tempest-ServersAdminNegativeTestJSON-331223024 tempest-ServersAdminNegativeTestJSON-331223024-project-admin] Lazy-loading 'flavor' on Instance uuid 19d392d4-2f19-4065-a580-b2fd72303153 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:15:26.896138 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1b1014e3-e5f9-45fa-b011-268900e4f184 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:26.897063 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1b1014e3-e5f9-45fa-b011-268900e4f184 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0dd3f0e2-2c15-4915-88b0-2df9e312cc4c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:26.903809 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1b1014e3-e5f9-45fa-b011-268900e4f184 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:26.904304 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1b1014e3-e5f9-45fa-b011-268900e4f184 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:26.904941 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1b1014e3-e5f9-45fa-b011-268900e4f184 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:26.905906 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1b1014e3-e5f9-45fa-b011-268900e4f184 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:26.906515 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1b1014e3-e5f9-45fa-b011-268900e4f184 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:26.907097 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1b1014e3-e5f9-45fa-b011-268900e4f184 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:27.044372 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1b1014e3-e5f9-45fa-b011-268900e4f184 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:27.052257 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1b1014e3-e5f9-45fa-b011-268900e4f184 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c" status: 200 len: 1503 microversion: 2.1 time: 0.163466 Oct 30 01:15:27.052942 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 304/599] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:26 2022] GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:15:27.110297 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cae8f503-37bc-4742-9504-259428d5a5eb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:27.110297 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cae8f503-37bc-4742-9504-259428d5a5eb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:27.118941 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cae8f503-37bc-4742-9504-259428d5a5eb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:27.119669 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cae8f503-37bc-4742-9504-259428d5a5eb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:27.120267 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cae8f503-37bc-4742-9504-259428d5a5eb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:27.122352 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cae8f503-37bc-4742-9504-259428d5a5eb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:27.122968 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cae8f503-37bc-4742-9504-259428d5a5eb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:27.123706 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cae8f503-37bc-4742-9504-259428d5a5eb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:27.141150 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f0931a00-a90d-491a-88dd-83e448ff7aba tempest-ServersAdminNegativeTestJSON-331223024 tempest-ServersAdminNegativeTestJSON-331223024-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/19d392d4-2f19-4065-a580-b2fd72303153/action" status: 202 len: 0 microversion: 2.1 time: 0.336963 Oct 30 01:15:27.141150 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 296/600] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:15:26 2022] POST /compute/v2.1/servers/19d392d4-2f19-4065-a580-b2fd72303153/action => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:15:27.153169 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f931a6be-7527-432f-ba91-df649532266d tempest-ServersAdminNegativeTestJSON-331223024 tempest-ServersAdminNegativeTestJSON-331223024-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:27.154023 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f931a6be-7527-432f-ba91-df649532266d tempest-ServersAdminNegativeTestJSON-331223024 tempest-ServersAdminNegativeTestJSON-331223024-project-admin] [instance: 19d392d4-2f19-4065-a580-b2fd72303153] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:27.172507 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f931a6be-7527-432f-ba91-df649532266d tempest-ServersAdminNegativeTestJSON-331223024 tempest-ServersAdminNegativeTestJSON-331223024-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:27.173006 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f931a6be-7527-432f-ba91-df649532266d tempest-ServersAdminNegativeTestJSON-331223024 tempest-ServersAdminNegativeTestJSON-331223024-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:27.174435 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f931a6be-7527-432f-ba91-df649532266d tempest-ServersAdminNegativeTestJSON-331223024 tempest-ServersAdminNegativeTestJSON-331223024-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:27.175463 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f931a6be-7527-432f-ba91-df649532266d tempest-ServersAdminNegativeTestJSON-331223024 tempest-ServersAdminNegativeTestJSON-331223024-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:27.176092 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f931a6be-7527-432f-ba91-df649532266d tempest-ServersAdminNegativeTestJSON-331223024 tempest-ServersAdminNegativeTestJSON-331223024-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:27.176753 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f931a6be-7527-432f-ba91-df649532266d tempest-ServersAdminNegativeTestJSON-331223024 tempest-ServersAdminNegativeTestJSON-331223024-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:27.367527 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-cae8f503-37bc-4742-9504-259428d5a5eb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:27.376056 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cae8f503-37bc-4742-9504-259428d5a5eb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f" status: 200 len: 1313 microversion: 2.1 time: 0.279426 Oct 30 01:15:27.389359 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 305/601] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:27 2022] GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f => generated 1313 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:27.389359 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-605eae62-6309-4eb1-a861-1c130dd84fcb req-c57a1a8a-948f-4dad-8db9-174b7ad35b70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dd3f0e2-2c15-4915-88b0-2df9e312cc4c", "tag": "57a305e2-e962-4bb1-a776-09d4a458a514"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:27.392750 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-605eae62-6309-4eb1-a861-1c130dd84fcb req-c57a1a8a-948f-4dad-8db9-174b7ad35b70 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:27.393229 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-605eae62-6309-4eb1-a861-1c130dd84fcb req-c57a1a8a-948f-4dad-8db9-174b7ad35b70 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:27.393724 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-605eae62-6309-4eb1-a861-1c130dd84fcb req-c57a1a8a-948f-4dad-8db9-174b7ad35b70 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:27.427413 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-605eae62-6309-4eb1-a861-1c130dd84fcb req-c57a1a8a-948f-4dad-8db9-174b7ad35b70 service nova] Creating event network-changed:57a305e2-e962-4bb1-a776-09d4a458a514 for instance 0dd3f0e2-2c15-4915-88b0-2df9e312cc4c on n-h1-master-1 Oct 30 01:15:27.437648 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-605eae62-6309-4eb1-a861-1c130dd84fcb req-c57a1a8a-948f-4dad-8db9-174b7ad35b70 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059267 Oct 30 01:15:27.438593 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 306/602] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:15:27.444789 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2f065de0-6102-468b-a8f1-21228fb1cb7c tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:27.445613 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2f065de0-6102-468b-a8f1-21228fb1cb7c tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:27.451789 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2f065de0-6102-468b-a8f1-21228fb1cb7c tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:27.452276 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2f065de0-6102-468b-a8f1-21228fb1cb7c tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:27.452704 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2f065de0-6102-468b-a8f1-21228fb1cb7c tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:27.453426 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2f065de0-6102-468b-a8f1-21228fb1cb7c tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:27.453877 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2f065de0-6102-468b-a8f1-21228fb1cb7c tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:27.454294 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2f065de0-6102-468b-a8f1-21228fb1cb7c tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:27.471418 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:27.546554 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-2f065de0-6102-468b-a8f1-21228fb1cb7c tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lazy-loading 'services' on Instance uuid 2c5b301d-f84c-4395-add9-b84311fa785c {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:15:27.567049 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2f065de0-6102-468b-a8f1-21228fb1cb7c tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 200 len: 1927 microversion: 2.75 time: 0.126513 Oct 30 01:15:27.577378 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 307/603] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:27 2022] GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 1927 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:27.726794 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f931a6be-7527-432f-ba91-df649532266d tempest-ServersAdminNegativeTestJSON-331223024 tempest-ServersAdminNegativeTestJSON-331223024-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/19d392d4-2f19-4065-a580-b2fd72303153" status: 200 len: 1630 microversion: 2.1 time: 0.581716 Oct 30 01:15:27.726794 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 297/604] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:27 2022] GET /compute/v2.1/servers/19d392d4-2f19-4065-a580-b2fd72303153 => generated 1630 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:15:27.732566 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b1b6d747-dc76-4e81-93c3-d38adffe8dae tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:27.733389 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b1b6d747-dc76-4e81-93c3-d38adffe8dae tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 3f60e45a-0e20-4280-be86-275d598fd552] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:27.742100 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1b6d747-dc76-4e81-93c3-d38adffe8dae tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:27.742590 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1b6d747-dc76-4e81-93c3-d38adffe8dae tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:27.743024 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1b6d747-dc76-4e81-93c3-d38adffe8dae tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:27.743913 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1b6d747-dc76-4e81-93c3-d38adffe8dae tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:27.744566 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1b6d747-dc76-4e81-93c3-d38adffe8dae tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:27.744956 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1b6d747-dc76-4e81-93c3-d38adffe8dae tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:27.836546 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b1b6d747-dc76-4e81-93c3-d38adffe8dae tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:27.849593 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b1b6d747-dc76-4e81-93c3-d38adffe8dae tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:27.854112 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b1b6d747-dc76-4e81-93c3-d38adffe8dae tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:27.855430 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b1b6d747-dc76-4e81-93c3-d38adffe8dae tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552" status: 200 len: 1319 microversion: 2.25 time: 0.127175 Oct 30 01:15:27.859600 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 298/605] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:27 2022] GET /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552 => generated 1319 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:27.869146 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ed9af37d-ff5c-4a55-bedb-e6f9cc600b06 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:27.877591 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ed9af37d-ff5c-4a55-bedb-e6f9cc600b06 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] [instance: f9c8bf32-6f0e-4183-88be-031de936bb81] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:27.891458 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ed9af37d-ff5c-4a55-bedb-e6f9cc600b06 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:27.899358 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ed9af37d-ff5c-4a55-bedb-e6f9cc600b06 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:27.900054 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ed9af37d-ff5c-4a55-bedb-e6f9cc600b06 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:27.900979 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ed9af37d-ff5c-4a55-bedb-e6f9cc600b06 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:27.901638 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ed9af37d-ff5c-4a55-bedb-e6f9cc600b06 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:27.902384 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ed9af37d-ff5c-4a55-bedb-e6f9cc600b06 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:27.923409 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cd453a09-cf3c-4adf-ba59-d512f6c1d698 tempest-HypervisorAdminNegativeUnderV252Test-2146036052 tempest-HypervisorAdminNegativeUnderV252Test-2146036052-project-admin] Calling method '.version_select at 0x7f44cc57f940>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:27.925262 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cd453a09-cf3c-4adf-ba59-d512f6c1d698 tempest-HypervisorAdminNegativeUnderV252Test-2146036052 tempest-HypervisorAdminNegativeUnderV252Test-2146036052-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:27.927524 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cd453a09-cf3c-4adf-ba59-d512f6c1d698 tempest-HypervisorAdminNegativeUnderV252Test-2146036052 tempest-HypervisorAdminNegativeUnderV252Test-2146036052-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:27.928166 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cd453a09-cf3c-4adf-ba59-d512f6c1d698 tempest-HypervisorAdminNegativeUnderV252Test-2146036052 tempest-HypervisorAdminNegativeUnderV252Test-2146036052-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:27.966398 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cd453a09-cf3c-4adf-ba59-d512f6c1d698 tempest-HypervisorAdminNegativeUnderV252Test-2146036052 tempest-HypervisorAdminNegativeUnderV252Test-2146036052-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:27.968752 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cd453a09-cf3c-4adf-ba59-d512f6c1d698 tempest-HypervisorAdminNegativeUnderV252Test-2146036052 tempest-HypervisorAdminNegativeUnderV252Test-2146036052-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:27.971296 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cd453a09-cf3c-4adf-ba59-d512f6c1d698 tempest-HypervisorAdminNegativeUnderV252Test-2146036052 tempest-HypervisorAdminNegativeUnderV252Test-2146036052-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:27.999701 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cd453a09-cf3c-4adf-ba59-d512f6c1d698 tempest-HypervisorAdminNegativeUnderV252Test-2146036052 tempest-HypervisorAdminNegativeUnderV252Test-2146036052-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:28.001199 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cd453a09-cf3c-4adf-ba59-d512f6c1d698 tempest-HypervisorAdminNegativeUnderV252Test-2146036052 tempest-HypervisorAdminNegativeUnderV252Test-2146036052-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:28.002473 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cd453a09-cf3c-4adf-ba59-d512f6c1d698 tempest-HypervisorAdminNegativeUnderV252Test-2146036052 tempest-HypervisorAdminNegativeUnderV252Test-2146036052-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:28.015647 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cd453a09-cf3c-4adf-ba59-d512f6c1d698 tempest-HypervisorAdminNegativeUnderV252Test-2146036052 tempest-HypervisorAdminNegativeUnderV252Test-2146036052-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.446758 Oct 30 01:15:28.017467 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 308/606] 10.222.0.13 () {58 vars in 1146 bytes} [Sun Oct 30 01:15:27 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:15:28.022734 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-e7975595-ae35-498f-8607-5e87980f8693 req-48d77dfa-82fe-4213-87a8-405eb3bb016f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9c8bf32-6f0e-4183-88be-031de936bb81", "name": "network-vif-plugged", "status": "completed", "tag": "04c8c04f-f3e1-4927-a35a-2de5c05a0259"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:28.032987 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-e7975595-ae35-498f-8607-5e87980f8693 req-48d77dfa-82fe-4213-87a8-405eb3bb016f service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:28.033666 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-e7975595-ae35-498f-8607-5e87980f8693 req-48d77dfa-82fe-4213-87a8-405eb3bb016f service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:28.034216 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-e7975595-ae35-498f-8607-5e87980f8693 req-48d77dfa-82fe-4213-87a8-405eb3bb016f service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:28.049805 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-e7975595-ae35-498f-8607-5e87980f8693 req-48d77dfa-82fe-4213-87a8-405eb3bb016f service nova] Creating event network-vif-plugged:04c8c04f-f3e1-4927-a35a-2de5c05a0259 for instance f9c8bf32-6f0e-4183-88be-031de936bb81 on n-h2-master-1 Oct 30 01:15:28.056443 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-e7975595-ae35-498f-8607-5e87980f8693 req-48d77dfa-82fe-4213-87a8-405eb3bb016f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037428 Oct 30 01:15:28.057052 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 309/607] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:15:28.255901 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-57d2bd3f-404d-4c09-b119-08503563d2c7 tempest-HypervisorAdminNegativeUnderV252Test-2144790569 tempest-HypervisorAdminNegativeUnderV252Test-2144790569-project] Calling method '.version_select at 0x7f44cc5784c0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:28.258158 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-57d2bd3f-404d-4c09-b119-08503563d2c7 tempest-HypervisorAdminNegativeUnderV252Test-2144790569 tempest-HypervisorAdminNegativeUnderV252Test-2144790569-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '4bb418a5d05f47fdaded51ae34243867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862c6709e951451ea9e0ac3ef98346ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:28.259567 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ed9af37d-ff5c-4a55-bedb-e6f9cc600b06 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056e59c7d4c2475eb66b64e0e24367be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6f42c16eeb4e97b65cebf891105008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:28.261060 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-57d2bd3f-404d-4c09-b119-08503563d2c7 tempest-HypervisorAdminNegativeUnderV252Test-2144790569 tempest-HypervisorAdminNegativeUnderV252Test-2144790569-project] Request method failure captured: Oct 30 01:15:28.261060 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/os-hypervisors/n-h1-master-1/search HTTP/1.1 Oct 30 01:15:28.261060 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:15:28.261060 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:15:28.261060 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:15:28.261060 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:15:28.261060 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:15:28.261060 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:15:28.261060 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:15:28.261060 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:15:28.261060 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdAuHPvPSyRvkZnXBovXI2YNukctorHexeAol7nV84ZIRouNdM1ayRWy98xrJ3s5-rQ8u1YQNgqUmMS0oGEMOpLUutFc_EHD4Bi4sK6mXxQumHWK9ACkh6MTlp0GS6wascZnCa4IRii8PRv35h88yJtl8NFefaIQIV1-yrAo6Iccz9Y Oct 30 01:15:28.261060 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:15:28.261060 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:15:28.261060 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:15:28.261060 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:15:28.261060 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:15:28.261060 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:15:28.261060 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 862c6709e951451ea9e0ac3ef98346ae Oct 30 01:15:28.261060 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-2144790569 Oct 30 01:15:28.261060 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:15:28.261060 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:15:28.262658 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/862c6709e951451ea9e0ac3ef98346ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_862c6709e951451ea9e0ac3ef98346ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/862c6709e951451ea9e0ac3ef98346ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/862c6709e951451ea9e0ac3ef98346ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:15:28.262658 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-2144790569 Oct 30 01:15:28.262658 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 862c6709e951451ea9e0ac3ef98346ae Oct 30 01:15:28.262658 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-2144790569 Oct 30 01:15:28.262658 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-2144790569-project Oct 30 01:15:28.262658 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:15:28.262658 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:15:28.262658 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 4bb418a5d05f47fdaded51ae34243867 Oct 30 01:15:28.262658 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-2144790569-project Oct 30 01:15:28.262658 n-d-master-1 devstack@n-api.service[121102]: method: Oct 30 01:15:28.262658 n-d-master-1 devstack@n-api.service[121102]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 30 01:15:28.262658 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'n-h1-master-1'} Oct 30 01:15:28.263602 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:15:28.263602 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:15:28.263602 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:15:28.263602 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:15:28.263602 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:15:28.263602 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:15:28.263602 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:15:28.263602 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:15:28.263602 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:15:28.263602 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:15:28.263602 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 30 01:15:28.263602 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 30 01:15:28.263602 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 30 01:15:28.263602 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 30 01:15:28.263602 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 30 01:15:28.263602 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 30 01:15:28.263602 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 01:15:28.263602 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 30 01:15:28.263602 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 01:15:28.265123 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise self.value Oct 30 01:15:28.265123 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 30 01:15:28.265123 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 30 01:15:28.265123 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 30 01:15:28.265123 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 30 01:15:28.265123 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 30 01:15:28.265123 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 30 01:15:28.265123 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 30 01:15:28.265123 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:15:28.265123 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:15:28.265123 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:15:28.265123 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:15:28.265123 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:15:28.265123 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:15:28.265123 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 30 01:15:28.265123 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 30 01:15:28.265123 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 30 01:15:28.265123 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:15:28.266479 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-57d2bd3f-404d-4c09-b119-08503563d2c7 tempest-HypervisorAdminNegativeUnderV252Test-2144790569 tempest-HypervisorAdminNegativeUnderV252Test-2144790569-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:15:28.266479 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-57d2bd3f-404d-4c09-b119-08503563d2c7 tempest-HypervisorAdminNegativeUnderV252Test-2144790569 tempest-HypervisorAdminNegativeUnderV252Test-2144790569-project] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/n-h1-master-1/search" status: 403 len: 117 microversion: 2.1 time: 0.204365 Oct 30 01:15:28.269071 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 310/608] 10.222.0.13 () {58 vars in 1209 bytes} [Sun Oct 30 01:15:28 2022] GET /compute/v2.1/os-hypervisors/n-h1-master-1/search => generated 117 bytes in 211 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:15:28.274096 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ed9af37d-ff5c-4a55-bedb-e6f9cc600b06 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] 10.222.0.13 "GET /compute/v2.1/servers/f9c8bf32-6f0e-4183-88be-031de936bb81" status: 200 len: 1389 microversion: 2.1 time: 0.412886 Oct 30 01:15:28.274871 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-87ef92c6-8fd5-4cc3-a5f8-027f0761d13a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:28.275174 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 299/609] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:27 2022] GET /compute/v2.1/servers/f9c8bf32-6f0e-4183-88be-031de936bb81 => generated 1389 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:28.275945 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-87ef92c6-8fd5-4cc3-a5f8-027f0761d13a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0dd3f0e2-2c15-4915-88b0-2df9e312cc4c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:28.280542 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6cce790e-26a3-4a13-80b1-b732ad666c42 tempest-HypervisorAdminNegativeUnderV252Test-2146036052 tempest-HypervisorAdminNegativeUnderV252Test-2146036052-project-admin] Calling method '.version_select at 0x7f44cc8e2dc0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:28.282420 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6cce790e-26a3-4a13-80b1-b732ad666c42 tempest-HypervisorAdminNegativeUnderV252Test-2146036052 tempest-HypervisorAdminNegativeUnderV252Test-2146036052-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:28.283145 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6cce790e-26a3-4a13-80b1-b732ad666c42 tempest-HypervisorAdminNegativeUnderV252Test-2146036052 tempest-HypervisorAdminNegativeUnderV252Test-2146036052-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:28.283794 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6cce790e-26a3-4a13-80b1-b732ad666c42 tempest-HypervisorAdminNegativeUnderV252Test-2146036052 tempest-HypervisorAdminNegativeUnderV252Test-2146036052-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:28.284324 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-87ef92c6-8fd5-4cc3-a5f8-027f0761d13a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:28.285557 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-87ef92c6-8fd5-4cc3-a5f8-027f0761d13a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:28.286003 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-87ef92c6-8fd5-4cc3-a5f8-027f0761d13a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:28.286710 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-87ef92c6-8fd5-4cc3-a5f8-027f0761d13a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:28.287209 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-87ef92c6-8fd5-4cc3-a5f8-027f0761d13a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:28.287603 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-87ef92c6-8fd5-4cc3-a5f8-027f0761d13a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:28.298295 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-6cce790e-26a3-4a13-80b1-b732ad666c42 tempest-HypervisorAdminNegativeUnderV252Test-2146036052 tempest-HypervisorAdminNegativeUnderV252Test-2146036052-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 30 01:15:28.301011 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6cce790e-26a3-4a13-80b1-b732ad666c42 tempest-HypervisorAdminNegativeUnderV252Test-2146036052 tempest-HypervisorAdminNegativeUnderV252Test-2146036052-project-admin] Request method failure captured: Oct 30 01:15:28.301011 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 30 01:15:28.301011 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:15:28.301011 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:15:28.301011 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:15:28.301011 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:15:28.301011 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:15:28.301011 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:15:28.301011 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:15:28.301011 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:15:28.301011 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdAveN4acq_lFYrHLuWgla0s01XCIhEPm8R8OZaFatXw_SUKvkyFBIdtiDwySCUXIuJ0Bl1WaCST68rn-iPLAh8DUpASF_Z5owXlsEZIWpWmrOnXXaI66LOO9vwUFLVDxtRmJeGAh9o4Ph0oXx_JElz84lAGsV-wgxUaSizDFxTiJGE Oct 30 01:15:28.301011 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:15:28.301011 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:15:28.301011 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:15:28.301011 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:15:28.301011 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:15:28.301011 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:15:28.301011 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: fdf1dd7b072f486490733ca67bac8c7a Oct 30 01:15:28.301011 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-2146036052 Oct 30 01:15:28.301011 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,admin,reader Oct 30 01:15:28.301011 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,admin,reader Oct 30 01:15:28.302785 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fdf1dd7b072f486490733ca67bac8c7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_fdf1dd7b072f486490733ca67bac8c7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/fdf1dd7b072f486490733ca67bac8c7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fdf1dd7b072f486490733ca67bac8c7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:15:28.302785 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-2146036052 Oct 30 01:15:28.302785 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: fdf1dd7b072f486490733ca67bac8c7a Oct 30 01:15:28.302785 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-2146036052 Oct 30 01:15:28.302785 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-2146036052-project-admin Oct 30 01:15:28.302785 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:15:28.302785 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:15:28.302785 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: a217c20de3454be09caed2634dcfe1dd Oct 30 01:15:28.302785 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-2146036052-project-admin Oct 30 01:15:28.302785 n-d-master-1 devstack@n-api.service[121103]: method: Oct 30 01:15:28.302785 n-d-master-1 devstack@n-api.service[121103]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 30 01:15:28.302785 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 30 01:15:28.303500 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:15:28.303500 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:15:28.303500 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:15:28.303500 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:15:28.303500 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:15:28.303500 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:15:28.303500 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:15:28.303500 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:15:28.303500 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:15:28.303500 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:15:28.303500 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 30 01:15:28.303500 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 30 01:15:28.303500 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 30 01:15:28.303500 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 30 01:15:28.303500 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 30 01:15:28.303500 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:28.303500 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:15:28.303500 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:28.303500 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:15:28.303500 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:15:28.304676 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:15:28.304676 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:15:28.304676 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:15:28.304676 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 30 01:15:28.304676 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:28.306265 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6cce790e-26a3-4a13-80b1-b732ad666c42 tempest-HypervisorAdminNegativeUnderV252Test-2146036052 tempest-HypervisorAdminNegativeUnderV252Test-2146036052-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:15:28.307353 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6cce790e-26a3-4a13-80b1-b732ad666c42 tempest-HypervisorAdminNegativeUnderV252Test-2146036052 tempest-HypervisorAdminNegativeUnderV252Test-2146036052-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.031122 Oct 30 01:15:28.308156 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 300/610] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 30 01:15:28 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:15:28.318512 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-650bab4c-5114-42c1-b3d7-d278377e8075 tempest-HypervisorAdminNegativeUnderV252Test-2146036052 tempest-HypervisorAdminNegativeUnderV252Test-2146036052-project-admin] Calling method '.version_select at 0x7f44cc78fb80>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:28.324475 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-650bab4c-5114-42c1-b3d7-d278377e8075 tempest-HypervisorAdminNegativeUnderV252Test-2146036052 tempest-HypervisorAdminNegativeUnderV252Test-2146036052-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:28.324475 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-650bab4c-5114-42c1-b3d7-d278377e8075 tempest-HypervisorAdminNegativeUnderV252Test-2146036052 tempest-HypervisorAdminNegativeUnderV252Test-2146036052-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:28.324475 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-650bab4c-5114-42c1-b3d7-d278377e8075 tempest-HypervisorAdminNegativeUnderV252Test-2146036052 tempest-HypervisorAdminNegativeUnderV252Test-2146036052-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:28.341399 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-650bab4c-5114-42c1-b3d7-d278377e8075 tempest-HypervisorAdminNegativeUnderV252Test-2146036052 tempest-HypervisorAdminNegativeUnderV252Test-2146036052-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:28.342137 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-650bab4c-5114-42c1-b3d7-d278377e8075 tempest-HypervisorAdminNegativeUnderV252Test-2146036052 tempest-HypervisorAdminNegativeUnderV252Test-2146036052-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:28.342683 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-650bab4c-5114-42c1-b3d7-d278377e8075 tempest-HypervisorAdminNegativeUnderV252Test-2146036052 tempest-HypervisorAdminNegativeUnderV252Test-2146036052-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:28.355051 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-650bab4c-5114-42c1-b3d7-d278377e8075 tempest-HypervisorAdminNegativeUnderV252Test-2146036052 tempest-HypervisorAdminNegativeUnderV252Test-2146036052-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:28.355625 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-650bab4c-5114-42c1-b3d7-d278377e8075 tempest-HypervisorAdminNegativeUnderV252Test-2146036052 tempest-HypervisorAdminNegativeUnderV252Test-2146036052-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:28.356136 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-650bab4c-5114-42c1-b3d7-d278377e8075 tempest-HypervisorAdminNegativeUnderV252Test-2146036052 tempest-HypervisorAdminNegativeUnderV252Test-2146036052-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:28.363742 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-650bab4c-5114-42c1-b3d7-d278377e8075 tempest-HypervisorAdminNegativeUnderV252Test-2146036052 tempest-HypervisorAdminNegativeUnderV252Test-2146036052-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.049064 Oct 30 01:15:28.365097 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 301/611] 10.222.0.13 () {58 vars in 1146 bytes} [Sun Oct 30 01:15:28 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:15:28.376782 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-38714002-d760-4122-a91d-e9559f128559 tempest-HypervisorAdminNegativeUnderV252Test-2144790569 tempest-HypervisorAdminNegativeUnderV252Test-2144790569-project] Calling method '.version_select at 0x7f44cc71fd30>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:28.379275 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-38714002-d760-4122-a91d-e9559f128559 tempest-HypervisorAdminNegativeUnderV252Test-2144790569 tempest-HypervisorAdminNegativeUnderV252Test-2144790569-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '4bb418a5d05f47fdaded51ae34243867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862c6709e951451ea9e0ac3ef98346ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:28.381888 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-38714002-d760-4122-a91d-e9559f128559 tempest-HypervisorAdminNegativeUnderV252Test-2144790569 tempest-HypervisorAdminNegativeUnderV252Test-2144790569-project] Request method failure captured: Oct 30 01:15:28.381888 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 30 01:15:28.381888 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:15:28.381888 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:15:28.381888 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:15:28.381888 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:15:28.381888 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:15:28.381888 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:15:28.381888 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:15:28.381888 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:15:28.381888 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdAuHPvPSyRvkZnXBovXI2YNukctorHexeAol7nV84ZIRouNdM1ayRWy98xrJ3s5-rQ8u1YQNgqUmMS0oGEMOpLUutFc_EHD4Bi4sK6mXxQumHWK9ACkh6MTlp0GS6wascZnCa4IRii8PRv35h88yJtl8NFefaIQIV1-yrAo6Iccz9Y Oct 30 01:15:28.381888 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:15:28.381888 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:15:28.381888 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:15:28.381888 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:15:28.381888 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:15:28.381888 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:15:28.381888 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 862c6709e951451ea9e0ac3ef98346ae Oct 30 01:15:28.381888 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-2144790569 Oct 30 01:15:28.381888 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:15:28.381888 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:15:28.383176 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/862c6709e951451ea9e0ac3ef98346ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_862c6709e951451ea9e0ac3ef98346ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/862c6709e951451ea9e0ac3ef98346ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/862c6709e951451ea9e0ac3ef98346ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:15:28.383176 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-2144790569 Oct 30 01:15:28.383176 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 862c6709e951451ea9e0ac3ef98346ae Oct 30 01:15:28.383176 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-2144790569 Oct 30 01:15:28.383176 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-2144790569-project Oct 30 01:15:28.383176 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:15:28.383176 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:15:28.383176 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 4bb418a5d05f47fdaded51ae34243867 Oct 30 01:15:28.383176 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-2144790569-project Oct 30 01:15:28.383176 n-d-master-1 devstack@n-api.service[121103]: method: Oct 30 01:15:28.383176 n-d-master-1 devstack@n-api.service[121103]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 30 01:15:28.383176 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '1'} Oct 30 01:15:28.383863 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:15:28.383863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:15:28.383863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:15:28.383863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:15:28.383863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:15:28.383863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:15:28.383863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:15:28.383863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:15:28.383863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:15:28.383863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:15:28.383863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 30 01:15:28.383863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 30 01:15:28.383863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 30 01:15:28.383863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 30 01:15:28.383863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 30 01:15:28.383863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 30 01:15:28.383863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 01:15:28.383863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 30 01:15:28.383863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 01:15:28.384914 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise self.value Oct 30 01:15:28.384914 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 30 01:15:28.384914 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 30 01:15:28.384914 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 30 01:15:28.384914 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 30 01:15:28.384914 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 30 01:15:28.384914 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 30 01:15:28.384914 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 30 01:15:28.384914 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:28.384914 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:15:28.384914 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:28.384914 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:15:28.384914 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:15:28.384914 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:15:28.384914 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 30 01:15:28.384914 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 30 01:15:28.384914 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 30 01:15:28.384914 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:28.391374 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-38714002-d760-4122-a91d-e9559f128559 tempest-HypervisorAdminNegativeUnderV252Test-2144790569 tempest-HypervisorAdminNegativeUnderV252Test-2144790569-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:15:28.392585 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-38714002-d760-4122-a91d-e9559f128559 tempest-HypervisorAdminNegativeUnderV252Test-2144790569 tempest-HypervisorAdminNegativeUnderV252Test-2144790569-project] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.020543 Oct 30 01:15:28.393825 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 302/612] 10.222.0.13 () {58 vars in 1176 bytes} [Sun Oct 30 01:15:28 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:15:28.404430 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6916ca06-bdc1-4e03-9d03-7e3da762be1e tempest-HypervisorAdminNegativeUnderV252Test-2146036052 tempest-HypervisorAdminNegativeUnderV252Test-2146036052-project-admin] Calling method '.version_select at 0x7f44cc7bcf70>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:28.406498 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6916ca06-bdc1-4e03-9d03-7e3da762be1e tempest-HypervisorAdminNegativeUnderV252Test-2146036052 tempest-HypervisorAdminNegativeUnderV252Test-2146036052-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:28.407093 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6916ca06-bdc1-4e03-9d03-7e3da762be1e tempest-HypervisorAdminNegativeUnderV252Test-2146036052 tempest-HypervisorAdminNegativeUnderV252Test-2146036052-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:28.407791 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6916ca06-bdc1-4e03-9d03-7e3da762be1e tempest-HypervisorAdminNegativeUnderV252Test-2146036052 tempest-HypervisorAdminNegativeUnderV252Test-2146036052-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:28.417421 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-6916ca06-bdc1-4e03-9d03-7e3da762be1e tempest-HypervisorAdminNegativeUnderV252Test-2146036052 tempest-HypervisorAdminNegativeUnderV252Test-2146036052-project-admin] HTTP exception thrown: No hypervisor matching '7750ae08-c285-453b-8e60-a98e4555d798' could be found. Oct 30 01:15:28.419097 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6916ca06-bdc1-4e03-9d03-7e3da762be1e tempest-HypervisorAdminNegativeUnderV252Test-2146036052 tempest-HypervisorAdminNegativeUnderV252Test-2146036052-project-admin] Request method failure captured: Oct 30 01:15:28.419097 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/os-hypervisors/7750ae08-c285-453b-8e60-a98e4555d798/servers HTTP/1.1 Oct 30 01:15:28.419097 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:15:28.419097 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:15:28.419097 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:15:28.419097 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:15:28.419097 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:15:28.419097 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:15:28.419097 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:15:28.419097 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:15:28.419097 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdAveN4acq_lFYrHLuWgla0s01XCIhEPm8R8OZaFatXw_SUKvkyFBIdtiDwySCUXIuJ0Bl1WaCST68rn-iPLAh8DUpASF_Z5owXlsEZIWpWmrOnXXaI66LOO9vwUFLVDxtRmJeGAh9o4Ph0oXx_JElz84lAGsV-wgxUaSizDFxTiJGE Oct 30 01:15:28.419097 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:15:28.419097 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:15:28.419097 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:15:28.419097 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:15:28.419097 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:15:28.419097 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:15:28.419097 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: fdf1dd7b072f486490733ca67bac8c7a Oct 30 01:15:28.419097 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-2146036052 Oct 30 01:15:28.419097 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,admin,reader Oct 30 01:15:28.419097 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,admin,reader Oct 30 01:15:28.420390 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fdf1dd7b072f486490733ca67bac8c7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_fdf1dd7b072f486490733ca67bac8c7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/fdf1dd7b072f486490733ca67bac8c7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fdf1dd7b072f486490733ca67bac8c7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:15:28.420390 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-2146036052 Oct 30 01:15:28.420390 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: fdf1dd7b072f486490733ca67bac8c7a Oct 30 01:15:28.420390 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-2146036052 Oct 30 01:15:28.420390 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-2146036052-project-admin Oct 30 01:15:28.420390 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:15:28.420390 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:15:28.420390 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: a217c20de3454be09caed2634dcfe1dd Oct 30 01:15:28.420390 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-2146036052-project-admin Oct 30 01:15:28.420390 n-d-master-1 devstack@n-api.service[121103]: method: Oct 30 01:15:28.420390 n-d-master-1 devstack@n-api.service[121103]: exception: No hypervisor matching '7750ae08-c285-453b-8e60-a98e4555d798' could be found. Oct 30 01:15:28.420390 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '7750ae08-c285-453b-8e60-a98e4555d798'} Oct 30 01:15:28.421150 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:15:28.421150 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:15:28.421150 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:15:28.421150 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:15:28.421150 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:15:28.421150 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:15:28.421150 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:15:28.421150 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:15:28.421150 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:15:28.421150 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:15:28.421150 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 30 01:15:28.421150 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 30 01:15:28.421150 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 30 01:15:28.421150 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 30 01:15:28.421150 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '7750ae08-c285-453b-8e60-a98e4555d798' could be found. Oct 30 01:15:28.421150 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:28.421150 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:15:28.421150 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:28.421150 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:15:28.422250 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:15:28.422250 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:15:28.422250 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:15:28.422250 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:15:28.422250 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '7750ae08-c285-453b-8e60-a98e4555d798' could be found. Oct 30 01:15:28.422250 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:28.425965 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6916ca06-bdc1-4e03-9d03-7e3da762be1e tempest-HypervisorAdminNegativeUnderV252Test-2146036052 tempest-HypervisorAdminNegativeUnderV252Test-2146036052-project-admin] Returning 404 to user: No hypervisor matching '7750ae08-c285-453b-8e60-a98e4555d798' could be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:15:28.427084 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6916ca06-bdc1-4e03-9d03-7e3da762be1e tempest-HypervisorAdminNegativeUnderV252Test-2146036052 tempest-HypervisorAdminNegativeUnderV252Test-2146036052-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/7750ae08-c285-453b-8e60-a98e4555d798/servers" status: 404 len: 123 microversion: 2.1 time: 0.026881 Oct 30 01:15:28.431898 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 303/613] 10.222.0.13 () {58 vars in 1281 bytes} [Sun Oct 30 01:15:28 2022] GET /compute/v2.1/os-hypervisors/7750ae08-c285-453b-8e60-a98e4555d798/servers => generated 123 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:15:28.437476 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8b526c88-4caa-46b9-a44b-18268f984dff tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:28.438325 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8b526c88-4caa-46b9-a44b-18268f984dff tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:28.445047 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8b526c88-4caa-46b9-a44b-18268f984dff tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:28.446029 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8b526c88-4caa-46b9-a44b-18268f984dff tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:28.446863 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8b526c88-4caa-46b9-a44b-18268f984dff tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:28.447863 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8b526c88-4caa-46b9-a44b-18268f984dff tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:28.449069 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8b526c88-4caa-46b9-a44b-18268f984dff tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:28.449732 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8b526c88-4caa-46b9-a44b-18268f984dff tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:28.672968 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-87ef92c6-8fd5-4cc3-a5f8-027f0761d13a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:28.688358 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-87ef92c6-8fd5-4cc3-a5f8-027f0761d13a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c" status: 200 len: 1503 microversion: 2.1 time: 0.417855 Oct 30 01:15:28.690758 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 311/614] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:28 2022] GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c => generated 1503 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:28.697568 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e40316c3-4bde-483b-98ea-2bb89feefa17 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:28.698384 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e40316c3-4bde-483b-98ea-2bb89feefa17 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:28.707400 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e40316c3-4bde-483b-98ea-2bb89feefa17 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:28.708166 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e40316c3-4bde-483b-98ea-2bb89feefa17 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:28.708897 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e40316c3-4bde-483b-98ea-2bb89feefa17 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:28.710936 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e40316c3-4bde-483b-98ea-2bb89feefa17 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:28.711623 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e40316c3-4bde-483b-98ea-2bb89feefa17 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:28.719956 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e40316c3-4bde-483b-98ea-2bb89feefa17 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:28.782474 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=6 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:28.837575 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8b526c88-4caa-46b9-a44b-18268f984dff tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:28.845955 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-e40316c3-4bde-483b-98ea-2bb89feefa17 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lazy-loading 'services' on Instance uuid 2c5b301d-f84c-4395-add9-b84311fa785c {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:15:28.850811 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8b526c88-4caa-46b9-a44b-18268f984dff tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f" status: 200 len: 1313 microversion: 2.1 time: 0.421417 Oct 30 01:15:28.851401 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 304/615] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:28 2022] GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f => generated 1313 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:28.871096 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5ef1f591-35e2-4f31-bdc3-f3954635ea85 tempest-ServersAdminNegativeTestJSON-331223024 tempest-ServersAdminNegativeTestJSON-331223024-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:28.871746 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5ef1f591-35e2-4f31-bdc3-f3954635ea85 tempest-ServersAdminNegativeTestJSON-331223024 tempest-ServersAdminNegativeTestJSON-331223024-project-admin] [instance: 19d392d4-2f19-4065-a580-b2fd72303153] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:28.905235 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e40316c3-4bde-483b-98ea-2bb89feefa17 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 200 len: 1927 microversion: 2.75 time: 0.211771 Oct 30 01:15:28.908518 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 312/616] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:28 2022] GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 1927 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:28.915868 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ef1f591-35e2-4f31-bdc3-f3954635ea85 tempest-ServersAdminNegativeTestJSON-331223024 tempest-ServersAdminNegativeTestJSON-331223024-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:28.917752 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ef1f591-35e2-4f31-bdc3-f3954635ea85 tempest-ServersAdminNegativeTestJSON-331223024 tempest-ServersAdminNegativeTestJSON-331223024-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:28.918194 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ef1f591-35e2-4f31-bdc3-f3954635ea85 tempest-ServersAdminNegativeTestJSON-331223024 tempest-ServersAdminNegativeTestJSON-331223024-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:28.921326 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ef1f591-35e2-4f31-bdc3-f3954635ea85 tempest-ServersAdminNegativeTestJSON-331223024 tempest-ServersAdminNegativeTestJSON-331223024-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:28.922580 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ef1f591-35e2-4f31-bdc3-f3954635ea85 tempest-ServersAdminNegativeTestJSON-331223024 tempest-ServersAdminNegativeTestJSON-331223024-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:28.923661 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ef1f591-35e2-4f31-bdc3-f3954635ea85 tempest-ServersAdminNegativeTestJSON-331223024 tempest-ServersAdminNegativeTestJSON-331223024-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:28.925818 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f3868928-36f8-4b41-8b6b-e8e7a7d1a414 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:28.929170 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f3868928-36f8-4b41-8b6b-e8e7a7d1a414 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 3f60e45a-0e20-4280-be86-275d598fd552] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:28.935656 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3868928-36f8-4b41-8b6b-e8e7a7d1a414 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:28.936150 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3868928-36f8-4b41-8b6b-e8e7a7d1a414 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:28.936609 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3868928-36f8-4b41-8b6b-e8e7a7d1a414 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:28.937314 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3868928-36f8-4b41-8b6b-e8e7a7d1a414 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:28.937789 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3868928-36f8-4b41-8b6b-e8e7a7d1a414 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:28.938206 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3868928-36f8-4b41-8b6b-e8e7a7d1a414 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:29.223885 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5ef1f591-35e2-4f31-bdc3-f3954635ea85 tempest-ServersAdminNegativeTestJSON-331223024 tempest-ServersAdminNegativeTestJSON-331223024-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/19d392d4-2f19-4065-a580-b2fd72303153" status: 200 len: 1613 microversion: 2.1 time: 0.365832 Oct 30 01:15:29.229507 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 305/617] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:28 2022] GET /compute/v2.1/servers/19d392d4-2f19-4065-a580-b2fd72303153 => generated 1613 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:29.254888 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-eb0cc361-8453-4628-b8fb-21a29dd4d2c9 tempest-ServersAdminNegativeTestJSON-331223024 tempest-ServersAdminNegativeTestJSON-331223024-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:29.255812 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-eb0cc361-8453-4628-b8fb-21a29dd4d2c9 tempest-ServersAdminNegativeTestJSON-331223024 tempest-ServersAdminNegativeTestJSON-331223024-project-admin] [instance: 19d392d4-2f19-4065-a580-b2fd72303153] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:29.263011 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f3868928-36f8-4b41-8b6b-e8e7a7d1a414 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:29.272460 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f3868928-36f8-4b41-8b6b-e8e7a7d1a414 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:29.277964 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f3868928-36f8-4b41-8b6b-e8e7a7d1a414 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:29.278314 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eb0cc361-8453-4628-b8fb-21a29dd4d2c9 tempest-ServersAdminNegativeTestJSON-331223024 tempest-ServersAdminNegativeTestJSON-331223024-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:29.279011 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eb0cc361-8453-4628-b8fb-21a29dd4d2c9 tempest-ServersAdminNegativeTestJSON-331223024 tempest-ServersAdminNegativeTestJSON-331223024-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:29.279455 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eb0cc361-8453-4628-b8fb-21a29dd4d2c9 tempest-ServersAdminNegativeTestJSON-331223024 tempest-ServersAdminNegativeTestJSON-331223024-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:29.280529 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f3868928-36f8-4b41-8b6b-e8e7a7d1a414 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552" status: 200 len: 1361 microversion: 2.25 time: 0.369825 Oct 30 01:15:29.281434 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eb0cc361-8453-4628-b8fb-21a29dd4d2c9 tempest-ServersAdminNegativeTestJSON-331223024 tempest-ServersAdminNegativeTestJSON-331223024-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:29.283057 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 313/618] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:28 2022] GET /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552 => generated 1361 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:29.290276 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eb0cc361-8453-4628-b8fb-21a29dd4d2c9 tempest-ServersAdminNegativeTestJSON-331223024 tempest-ServersAdminNegativeTestJSON-331223024-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:29.290889 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eb0cc361-8453-4628-b8fb-21a29dd4d2c9 tempest-ServersAdminNegativeTestJSON-331223024 tempest-ServersAdminNegativeTestJSON-331223024-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:29.307892 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3b9ebbc4-1b0c-44d0-a2f0-a6298236db5f tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:29.308752 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3b9ebbc4-1b0c-44d0-a2f0-a6298236db5f tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] [instance: f9c8bf32-6f0e-4183-88be-031de936bb81] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:29.315571 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3b9ebbc4-1b0c-44d0-a2f0-a6298236db5f tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:29.317046 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3b9ebbc4-1b0c-44d0-a2f0-a6298236db5f tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:29.317670 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3b9ebbc4-1b0c-44d0-a2f0-a6298236db5f tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:29.318542 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3b9ebbc4-1b0c-44d0-a2f0-a6298236db5f tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:29.319144 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3b9ebbc4-1b0c-44d0-a2f0-a6298236db5f tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:29.319708 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3b9ebbc4-1b0c-44d0-a2f0-a6298236db5f tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:29.400601 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-eb0cc361-8453-4628-b8fb-21a29dd4d2c9 tempest-ServersAdminNegativeTestJSON-331223024 tempest-ServersAdminNegativeTestJSON-331223024-project-admin] HTTP exception thrown: Cannot 'migrate' instance 19d392d4-2f19-4065-a580-b2fd72303153 while it is in vm_state suspended Oct 30 01:15:29.403067 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-eb0cc361-8453-4628-b8fb-21a29dd4d2c9 tempest-ServersAdminNegativeTestJSON-331223024 tempest-ServersAdminNegativeTestJSON-331223024-project-admin] Request method failure captured: Oct 30 01:15:29.403067 n-d-master-1 devstack@n-api.service[121103]: request: POST /compute/v2.1/servers/19d392d4-2f19-4065-a580-b2fd72303153/action HTTP/1.1 Oct 30 01:15:29.403067 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:15:29.403067 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:15:29.403067 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:15:29.403067 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 15 Oct 30 01:15:29.403067 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:15:29.403067 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:15:29.403067 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:15:29.403067 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:15:29.403067 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdAGrOT16w3BcD0EzKYL4VRYA03FHs0jlOkTl6pEa5s5gpPiGMr9Hb0clI65uA2eEZ27q8ok892nUQG7QgbY529jqvOZV8TSemJFVeoHiWX6ZvAuy9J61sZtDCqw1GQfcnkvi1evbXIrJ5dQb9oFzC0LapsFNuzR9hiIipvgEvgAVM8 Oct 30 01:15:29.403067 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:15:29.403067 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:15:29.403067 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:15:29.403067 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:15:29.403067 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:15:29.403067 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:15:29.403067 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 7bc4e7dc475b4830af3bbc7a7ba767ed Oct 30 01:15:29.403067 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-331223024 Oct 30 01:15:29.403067 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,admin,reader Oct 30 01:15:29.403067 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,admin,reader Oct 30 01:15:29.412789 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7bc4e7dc475b4830af3bbc7a7ba767ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7bc4e7dc475b4830af3bbc7a7ba767ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7bc4e7dc475b4830af3bbc7a7ba767ed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7bc4e7dc475b4830af3bbc7a7ba767ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:15:29.412789 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersAdminNegativeTestJSON-331223024 Oct 30 01:15:29.412789 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 7bc4e7dc475b4830af3bbc7a7ba767ed Oct 30 01:15:29.412789 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-331223024 Oct 30 01:15:29.412789 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersAdminNegativeTestJSON-331223024-project-admin Oct 30 01:15:29.412789 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:15:29.412789 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:15:29.412789 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: e5cba98608e84304913424e7704c7227 Oct 30 01:15:29.412789 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersAdminNegativeTestJSON-331223024-project-admin Oct 30 01:15:29.412789 n-d-master-1 devstack@n-api.service[121103]: Oct 30 01:15:29.412789 n-d-master-1 devstack@n-api.service[121103]: {"migrate": {}} Oct 30 01:15:29.412789 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:15:29.412789 n-d-master-1 devstack@n-api.service[121103]: exception: Cannot 'migrate' instance 19d392d4-2f19-4065-a580-b2fd72303153 while it is in vm_state suspended Oct 30 01:15:29.413608 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '19d392d4-2f19-4065-a580-b2fd72303153', 'body': {'migrate': {}}} Oct 30 01:15:29.413608 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:15:29.413608 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:15:29.413608 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 30 01:15:29.413608 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 30 01:15:29.413608 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 30 01:15:29.413608 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 30 01:15:29.413608 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 30 01:15:29.413608 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 30 01:15:29.413608 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 30 01:15:29.413608 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 30 01:15:29.413608 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 30 01:15:29.413608 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 30 01:15:29.413608 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 30 01:15:29.413608 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 30 01:15:29.413608 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 19d392d4-2f19-4065-a580-b2fd72303153 in vm_state suspended. Cannot resize while the instance is in this state. Oct 30 01:15:29.413608 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:29.413608 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:15:29.413608 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:29.413608 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:15:29.414998 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:15:29.414998 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:15:29.414998 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:15:29.414998 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:15:29.414998 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:15:29.414998 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:15:29.414998 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:15:29.414998 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:15:29.414998 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 30 01:15:29.414998 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 30 01:15:29.414998 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 30 01:15:29.414998 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 30 01:15:29.414998 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 19d392d4-2f19-4065-a580-b2fd72303153 while it is in vm_state suspended Oct 30 01:15:29.414998 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:29.414998 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:15:29.414998 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:29.414998 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:15:29.414998 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:15:29.414998 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:15:29.416316 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:15:29.416316 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:15:29.416316 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 19d392d4-2f19-4065-a580-b2fd72303153 while it is in vm_state suspended Oct 30 01:15:29.416316 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:29.416316 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-eb0cc361-8453-4628-b8fb-21a29dd4d2c9 tempest-ServersAdminNegativeTestJSON-331223024 tempest-ServersAdminNegativeTestJSON-331223024-project-admin] Returning 409 to user: Cannot 'migrate' instance 19d392d4-2f19-4065-a580-b2fd72303153 while it is in vm_state suspended {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:15:29.416316 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-eb0cc361-8453-4628-b8fb-21a29dd4d2c9 tempest-ServersAdminNegativeTestJSON-331223024 tempest-ServersAdminNegativeTestJSON-331223024-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/19d392d4-2f19-4065-a580-b2fd72303153/action" status: 409 len: 148 microversion: 2.1 time: 0.154613 Oct 30 01:15:29.416316 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 306/619] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:15:29 2022] POST /compute/v2.1/servers/19d392d4-2f19-4065-a580-b2fd72303153/action => generated 148 bytes in 160 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 30 01:15:29.419978 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fbe54db7-ccb1-442b-bb43-d9b0bcef7883 tempest-ServersAdminNegativeTestJSON-331223024 tempest-ServersAdminNegativeTestJSON-331223024-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:29.424074 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fbe54db7-ccb1-442b-bb43-d9b0bcef7883 tempest-ServersAdminNegativeTestJSON-331223024 tempest-ServersAdminNegativeTestJSON-331223024-project-admin] Request method failure captured: Oct 30 01:15:29.424074 n-d-master-1 devstack@n-api.service[121103]: request: POST /compute/v2.1/servers/4f47f49f-e5a9-46d5-9622-c9c887891646/action HTTP/1.1 Oct 30 01:15:29.424074 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:15:29.424074 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:15:29.424074 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:15:29.424074 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 39 Oct 30 01:15:29.424074 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:15:29.424074 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:15:29.424074 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:15:29.424074 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:15:29.424074 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdAGrOT16w3BcD0EzKYL4VRYA03FHs0jlOkTl6pEa5s5gpPiGMr9Hb0clI65uA2eEZ27q8ok892nUQG7QgbY529jqvOZV8TSemJFVeoHiWX6ZvAuy9J61sZtDCqw1GQfcnkvi1evbXIrJ5dQb9oFzC0LapsFNuzR9hiIipvgEvgAVM8 Oct 30 01:15:29.424074 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:15:29.424074 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:15:29.424074 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:15:29.424074 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:15:29.424074 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:15:29.424074 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:15:29.424074 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 7bc4e7dc475b4830af3bbc7a7ba767ed Oct 30 01:15:29.424074 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-331223024 Oct 30 01:15:29.424074 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,admin,reader Oct 30 01:15:29.424074 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,admin,reader Oct 30 01:15:29.425497 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7bc4e7dc475b4830af3bbc7a7ba767ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7bc4e7dc475b4830af3bbc7a7ba767ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7bc4e7dc475b4830af3bbc7a7ba767ed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7bc4e7dc475b4830af3bbc7a7ba767ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:15:29.425497 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersAdminNegativeTestJSON-331223024 Oct 30 01:15:29.425497 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 7bc4e7dc475b4830af3bbc7a7ba767ed Oct 30 01:15:29.425497 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-331223024 Oct 30 01:15:29.425497 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersAdminNegativeTestJSON-331223024-project-admin Oct 30 01:15:29.425497 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:15:29.425497 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:15:29.425497 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: e5cba98608e84304913424e7704c7227 Oct 30 01:15:29.425497 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersAdminNegativeTestJSON-331223024-project-admin Oct 30 01:15:29.425497 n-d-master-1 devstack@n-api.service[121103]: Oct 30 01:15:29.425497 n-d-master-1 devstack@n-api.service[121103]: {"os-resetState": {"state": "invalid"}} Oct 30 01:15:29.425497 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:15:29.426358 n-d-master-1 devstack@n-api.service[121103]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 30 01:15:29.426358 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '4f47f49f-e5a9-46d5-9622-c9c887891646', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 30 01:15:29.426358 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:15:29.426358 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:15:29.426358 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 30 01:15:29.426358 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 30 01:15:29.426358 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 30 01:15:29.426358 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise error Oct 30 01:15:29.426358 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 30 01:15:29.426358 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:29.426358 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 30 01:15:29.426358 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 30 01:15:29.426358 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:29.426358 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 30 01:15:29.426358 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi 'invalid' Oct 30 01:15:29.426358 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:29.426358 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:15:29.426358 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:29.426358 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:15:29.426358 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:15:29.426358 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:15:29.426358 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:15:29.428041 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:15:29.428041 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:15:29.428041 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:15:29.428041 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 30 01:15:29.428041 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 30 01:15:29.428041 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 30 01:15:29.428041 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 30 01:15:29.428041 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 30 01:15:29.428041 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 30 01:15:29.428041 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 30 01:15:29.428041 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:29.428041 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:15:29.428041 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:29.428041 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:15:29.428041 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:15:29.428041 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:15:29.428041 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 30 01:15:29.428041 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 30 01:15:29.428041 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 30 01:15:29.429311 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:29.429311 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fbe54db7-ccb1-442b-bb43-d9b0bcef7883 tempest-ServersAdminNegativeTestJSON-331223024 tempest-ServersAdminNegativeTestJSON-331223024-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:15:29.429311 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fbe54db7-ccb1-442b-bb43-d9b0bcef7883 tempest-ServersAdminNegativeTestJSON-331223024 tempest-ServersAdminNegativeTestJSON-331223024-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/4f47f49f-e5a9-46d5-9622-c9c887891646/action" status: 400 len: 144 microversion: 2.1 time: 0.012378 Oct 30 01:15:29.429559 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 307/620] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:15:29 2022] POST /compute/v2.1/servers/4f47f49f-e5a9-46d5-9622-c9c887891646/action => generated 144 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:15:29.437476 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c51cc27a-a5ff-4d0f-9034-4ae91775226b tempest-ServersAdminNegativeTestJSON-331223024 tempest-ServersAdminNegativeTestJSON-331223024-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:29.442126 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c51cc27a-a5ff-4d0f-9034-4ae91775226b tempest-ServersAdminNegativeTestJSON-331223024 tempest-ServersAdminNegativeTestJSON-331223024-project-admin] Request method failure captured: Oct 30 01:15:29.442126 n-d-master-1 devstack@n-api.service[121103]: request: POST /compute/v2.1/servers/4f47f49f-e5a9-46d5-9622-c9c887891646/action HTTP/1.1 Oct 30 01:15:29.442126 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:15:29.442126 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:15:29.442126 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:15:29.442126 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 31 Oct 30 01:15:29.442126 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:15:29.442126 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:15:29.442126 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:15:29.442126 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:15:29.442126 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdAGrOT16w3BcD0EzKYL4VRYA03FHs0jlOkTl6pEa5s5gpPiGMr9Hb0clI65uA2eEZ27q8ok892nUQG7QgbY529jqvOZV8TSemJFVeoHiWX6ZvAuy9J61sZtDCqw1GQfcnkvi1evbXIrJ5dQb9oFzC0LapsFNuzR9hiIipvgEvgAVM8 Oct 30 01:15:29.442126 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:15:29.442126 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:15:29.442126 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:15:29.442126 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:15:29.442126 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:15:29.442126 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:15:29.442126 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 7bc4e7dc475b4830af3bbc7a7ba767ed Oct 30 01:15:29.442126 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-331223024 Oct 30 01:15:29.442126 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,admin,reader Oct 30 01:15:29.442126 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,admin,reader Oct 30 01:15:29.444558 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7bc4e7dc475b4830af3bbc7a7ba767ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7bc4e7dc475b4830af3bbc7a7ba767ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7bc4e7dc475b4830af3bbc7a7ba767ed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7bc4e7dc475b4830af3bbc7a7ba767ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:15:29.444558 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersAdminNegativeTestJSON-331223024 Oct 30 01:15:29.444558 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 7bc4e7dc475b4830af3bbc7a7ba767ed Oct 30 01:15:29.444558 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-331223024 Oct 30 01:15:29.444558 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersAdminNegativeTestJSON-331223024-project-admin Oct 30 01:15:29.444558 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:15:29.444558 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:15:29.444558 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: e5cba98608e84304913424e7704c7227 Oct 30 01:15:29.444558 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersAdminNegativeTestJSON-331223024-project-admin Oct 30 01:15:29.444558 n-d-master-1 devstack@n-api.service[121103]: Oct 30 01:15:29.444558 n-d-master-1 devstack@n-api.service[121103]: {"os-resetState": {"state": 1}} Oct 30 01:15:29.444558 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:15:29.444558 n-d-master-1 devstack@n-api.service[121103]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 30 01:15:29.445719 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '4f47f49f-e5a9-46d5-9622-c9c887891646', 'body': {'os-resetState': {'state': 1}}} Oct 30 01:15:29.445719 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:15:29.445719 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:15:29.445719 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 30 01:15:29.445719 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 30 01:15:29.445719 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 30 01:15:29.445719 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise error Oct 30 01:15:29.445719 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 30 01:15:29.445719 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:29.445719 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 30 01:15:29.445719 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 30 01:15:29.445719 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:29.445719 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 30 01:15:29.445719 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi 1 Oct 30 01:15:29.445719 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:29.445719 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:15:29.445719 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:29.445719 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:15:29.445719 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:15:29.445719 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:15:29.445719 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:15:29.445719 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:15:29.447153 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:15:29.447153 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:15:29.447153 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 30 01:15:29.447153 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 30 01:15:29.447153 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 30 01:15:29.447153 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 30 01:15:29.447153 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 30 01:15:29.447153 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 30 01:15:29.447153 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 30 01:15:29.447153 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:29.447153 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:15:29.447153 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:29.447153 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:15:29.447153 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:15:29.447153 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:15:29.447153 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 30 01:15:29.447153 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 30 01:15:29.447153 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 30 01:15:29.447153 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:29.448570 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c51cc27a-a5ff-4d0f-9034-4ae91775226b tempest-ServersAdminNegativeTestJSON-331223024 tempest-ServersAdminNegativeTestJSON-331223024-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:15:29.448570 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c51cc27a-a5ff-4d0f-9034-4ae91775226b tempest-ServersAdminNegativeTestJSON-331223024 tempest-ServersAdminNegativeTestJSON-331223024-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/4f47f49f-e5a9-46d5-9622-c9c887891646/action" status: 400 len: 120 microversion: 2.1 time: 0.012314 Oct 30 01:15:29.448570 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 308/621] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:15:29 2022] POST /compute/v2.1/servers/4f47f49f-e5a9-46d5-9622-c9c887891646/action => generated 120 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:15:29.454754 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-33d98367-9a40-4a42-bc09-cd4f1471bb4d tempest-ServersAdminNegativeTestJSON-331223024 tempest-ServersAdminNegativeTestJSON-331223024-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:29.457563 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-33d98367-9a40-4a42-bc09-cd4f1471bb4d tempest-ServersAdminNegativeTestJSON-331223024 tempest-ServersAdminNegativeTestJSON-331223024-project-admin] Failed to fetch instance by id 999 {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 30 01:15:29.458224 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-33d98367-9a40-4a42-bc09-cd4f1471bb4d tempest-ServersAdminNegativeTestJSON-331223024 tempest-ServersAdminNegativeTestJSON-331223024-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 30 01:15:29.460178 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-33d98367-9a40-4a42-bc09-cd4f1471bb4d tempest-ServersAdminNegativeTestJSON-331223024 tempest-ServersAdminNegativeTestJSON-331223024-project-admin] Request method failure captured: Oct 30 01:15:29.460178 n-d-master-1 devstack@n-api.service[121103]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 30 01:15:29.460178 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:15:29.460178 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:15:29.460178 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:15:29.460178 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 37 Oct 30 01:15:29.460178 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:15:29.460178 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:15:29.460178 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:15:29.460178 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:15:29.460178 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdAGrOT16w3BcD0EzKYL4VRYA03FHs0jlOkTl6pEa5s5gpPiGMr9Hb0clI65uA2eEZ27q8ok892nUQG7QgbY529jqvOZV8TSemJFVeoHiWX6ZvAuy9J61sZtDCqw1GQfcnkvi1evbXIrJ5dQb9oFzC0LapsFNuzR9hiIipvgEvgAVM8 Oct 30 01:15:29.460178 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:15:29.460178 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:15:29.460178 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:15:29.460178 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:15:29.460178 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:15:29.460178 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:15:29.460178 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 7bc4e7dc475b4830af3bbc7a7ba767ed Oct 30 01:15:29.460178 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-331223024 Oct 30 01:15:29.460178 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,admin,reader Oct 30 01:15:29.460178 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,admin,reader Oct 30 01:15:29.461504 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7bc4e7dc475b4830af3bbc7a7ba767ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7bc4e7dc475b4830af3bbc7a7ba767ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7bc4e7dc475b4830af3bbc7a7ba767ed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7bc4e7dc475b4830af3bbc7a7ba767ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:15:29.461504 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersAdminNegativeTestJSON-331223024 Oct 30 01:15:29.461504 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 7bc4e7dc475b4830af3bbc7a7ba767ed Oct 30 01:15:29.461504 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-331223024 Oct 30 01:15:29.461504 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersAdminNegativeTestJSON-331223024-project-admin Oct 30 01:15:29.461504 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:15:29.461504 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:15:29.461504 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: e5cba98608e84304913424e7704c7227 Oct 30 01:15:29.461504 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersAdminNegativeTestJSON-331223024-project-admin Oct 30 01:15:29.461504 n-d-master-1 devstack@n-api.service[121103]: Oct 30 01:15:29.461504 n-d-master-1 devstack@n-api.service[121103]: {"os-resetState": {"state": "error"}} Oct 30 01:15:29.461504 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:15:29.461504 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 999 could not be found. Oct 30 01:15:29.465704 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 30 01:15:29.465704 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:15:29.465704 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:15:29.465704 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:15:29.465704 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:15:29.465704 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 30 01:15:29.465704 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 30 01:15:29.465704 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 30 01:15:29.465704 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:29.465704 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:15:29.465704 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:29.465704 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:15:29.465704 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:15:29.465704 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:15:29.465704 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:15:29.465704 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:15:29.465704 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:15:29.465704 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:15:29.465704 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:15:29.465704 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:15:29.465704 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 30 01:15:29.467070 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 30 01:15:29.467070 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:15:29.467070 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:15:29.467070 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 30 01:15:29.467070 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:29.467070 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:15:29.467070 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:29.467070 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:15:29.467070 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:15:29.467070 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:15:29.467070 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:15:29.467070 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:15:29.467070 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 30 01:15:29.467070 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:29.467070 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-33d98367-9a40-4a42-bc09-cd4f1471bb4d tempest-ServersAdminNegativeTestJSON-331223024 tempest-ServersAdminNegativeTestJSON-331223024-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:15:29.467070 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-33d98367-9a40-4a42-bc09-cd4f1471bb4d tempest-ServersAdminNegativeTestJSON-331223024 tempest-ServersAdminNegativeTestJSON-331223024-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.011106 Oct 30 01:15:29.468008 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 309/622] 10.222.0.13 () {60 vars in 1179 bytes} [Sun Oct 30 01:15:29 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:15:29.471311 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3d2c7ae6-f885-4dc8-a599-ac8d957af21c tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:29.471815 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3d2c7ae6-f885-4dc8-a599-ac8d957af21c tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] [instance: 19d392d4-2f19-4065-a580-b2fd72303153] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:29.481116 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3d2c7ae6-f885-4dc8-a599-ac8d957af21c tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:29.482303 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3d2c7ae6-f885-4dc8-a599-ac8d957af21c tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:29.483078 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3d2c7ae6-f885-4dc8-a599-ac8d957af21c tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:29.484175 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3d2c7ae6-f885-4dc8-a599-ac8d957af21c tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:29.485429 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3d2c7ae6-f885-4dc8-a599-ac8d957af21c tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:29.485803 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3d2c7ae6-f885-4dc8-a599-ac8d957af21c tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:29.509263 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3b9ebbc4-1b0c-44d0-a2f0-a6298236db5f tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056e59c7d4c2475eb66b64e0e24367be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6f42c16eeb4e97b65cebf891105008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:29.520212 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3b9ebbc4-1b0c-44d0-a2f0-a6298236db5f tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] 10.222.0.13 "GET /compute/v2.1/servers/f9c8bf32-6f0e-4183-88be-031de936bb81" status: 200 len: 1389 microversion: 2.1 time: 0.220186 Oct 30 01:15:29.521741 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 314/623] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:29 2022] GET /compute/v2.1/servers/f9c8bf32-6f0e-4183-88be-031de936bb81 => generated 1389 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:29.522163 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3d2c7ae6-f885-4dc8-a599-ac8d957af21c tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] [instance: 19d392d4-2f19-4065-a580-b2fd72303153] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:15:29.569377 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:29.718361 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4b8babe5-30c4-46d1-84f8-d2f5c4190f0b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:29.718975 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4b8babe5-30c4-46d1-84f8-d2f5c4190f0b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0dd3f0e2-2c15-4915-88b0-2df9e312cc4c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:29.724783 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b8babe5-30c4-46d1-84f8-d2f5c4190f0b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:29.725244 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b8babe5-30c4-46d1-84f8-d2f5c4190f0b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:29.725705 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b8babe5-30c4-46d1-84f8-d2f5c4190f0b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:29.726394 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b8babe5-30c4-46d1-84f8-d2f5c4190f0b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:29.726841 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b8babe5-30c4-46d1-84f8-d2f5c4190f0b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:29.727257 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b8babe5-30c4-46d1-84f8-d2f5c4190f0b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:29.889214 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3d2c7ae6-f885-4dc8-a599-ac8d957af21c tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] 10.222.0.13 "DELETE /compute/v2.1/servers/19d392d4-2f19-4065-a580-b2fd72303153" status: 204 len: 0 microversion: 2.1 time: 0.418710 Oct 30 01:15:29.889214 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 310/624] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:15:29 2022] DELETE /compute/v2.1/servers/19d392d4-2f19-4065-a580-b2fd72303153 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:15:29.899652 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f463f5b2-e6ae-4715-a4d2-5a50be3cf3b9 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:29.899652 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f463f5b2-e6ae-4715-a4d2-5a50be3cf3b9 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:29.904654 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f463f5b2-e6ae-4715-a4d2-5a50be3cf3b9 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:29.906784 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f463f5b2-e6ae-4715-a4d2-5a50be3cf3b9 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:29.907245 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f463f5b2-e6ae-4715-a4d2-5a50be3cf3b9 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:29.908022 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f463f5b2-e6ae-4715-a4d2-5a50be3cf3b9 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:29.908599 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f463f5b2-e6ae-4715-a4d2-5a50be3cf3b9 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:29.909084 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f463f5b2-e6ae-4715-a4d2-5a50be3cf3b9 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:29.962090 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4b8babe5-30c4-46d1-84f8-d2f5c4190f0b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:29.974715 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4b8babe5-30c4-46d1-84f8-d2f5c4190f0b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c" status: 200 len: 1503 microversion: 2.1 time: 0.258853 Oct 30 01:15:29.977836 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 315/625] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:29 2022] GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c => generated 1503 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:15:29.985613 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-00178c05-a27e-4d00-b398-74d97651aa7b tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:29.990026 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-00178c05-a27e-4d00-b398-74d97651aa7b tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] [instance: 19d392d4-2f19-4065-a580-b2fd72303153] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:30.003236 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00178c05-a27e-4d00-b398-74d97651aa7b tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:30.004791 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00178c05-a27e-4d00-b398-74d97651aa7b tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:30.005483 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00178c05-a27e-4d00-b398-74d97651aa7b tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:30.007483 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00178c05-a27e-4d00-b398-74d97651aa7b tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:30.008188 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00178c05-a27e-4d00-b398-74d97651aa7b tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:30.008700 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00178c05-a27e-4d00-b398-74d97651aa7b tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:30.427386 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f463f5b2-e6ae-4715-a4d2-5a50be3cf3b9 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:30.436930 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f463f5b2-e6ae-4715-a4d2-5a50be3cf3b9 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f" status: 200 len: 1313 microversion: 2.1 time: 0.547007 Oct 30 01:15:30.438092 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 311/626] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:29 2022] GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f => generated 1313 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:30.443471 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fa7e1b37-61fd-4278-89f3-928c855ce0fb tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:30.444297 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-fa7e1b37-61fd-4278-89f3-928c855ce0fb tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:30.450864 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fa7e1b37-61fd-4278-89f3-928c855ce0fb tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:30.452908 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fa7e1b37-61fd-4278-89f3-928c855ce0fb tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:30.452908 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fa7e1b37-61fd-4278-89f3-928c855ce0fb tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:30.453467 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fa7e1b37-61fd-4278-89f3-928c855ce0fb tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:30.454146 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fa7e1b37-61fd-4278-89f3-928c855ce0fb tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:30.454813 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fa7e1b37-61fd-4278-89f3-928c855ce0fb tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:30.522970 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-00178c05-a27e-4d00-b398-74d97651aa7b tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ccc0bfdee94961aa198e3abf0d85cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee1e04c04bc40568e43eb98df39e7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:30.538083 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-00178c05-a27e-4d00-b398-74d97651aa7b tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] 10.222.0.13 "GET /compute/v2.1/servers/19d392d4-2f19-4065-a580-b2fd72303153" status: 200 len: 1468 microversion: 2.1 time: 0.558889 Oct 30 01:15:30.551292 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-fa7e1b37-61fd-4278-89f3-928c855ce0fb tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lazy-loading 'services' on Instance uuid 2c5b301d-f84c-4395-add9-b84311fa785c {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:15:30.560140 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 316/627] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:29 2022] GET /compute/v2.1/servers/19d392d4-2f19-4065-a580-b2fd72303153 => generated 1468 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:30.570275 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-e7511d34-1033-49e1-97ef-363da7d0277e req-47cfe9a8-6b45-4582-919d-c6689fd76cd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f60e45a-0e20-4280-be86-275d598fd552", "tag": "c8a94bc2-b259-4ae7-9a0e-3c02ee3a39c3"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:30.570911 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fa7e1b37-61fd-4278-89f3-928c855ce0fb tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 200 len: 1927 microversion: 2.75 time: 0.131071 Oct 30 01:15:30.572041 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 312/628] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:30 2022] GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 1927 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:30.578617 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-fc90f57a-c04f-4755-bea7-c825f4941aaa req-f916ac1f-3b18-4302-836b-fc2db1905962 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12ca60c1-7c35-420c-b177-c7f3915a989f", "name": "network-vif-plugged", "status": "completed", "tag": "0230e7b6-4d30-48c3-b9ab-066d496072ad"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:30.589955 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-fc90f57a-c04f-4755-bea7-c825f4941aaa req-f916ac1f-3b18-4302-836b-fc2db1905962 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:30.590822 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-fc90f57a-c04f-4755-bea7-c825f4941aaa req-f916ac1f-3b18-4302-836b-fc2db1905962 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:30.591457 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-fc90f57a-c04f-4755-bea7-c825f4941aaa req-f916ac1f-3b18-4302-836b-fc2db1905962 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:30.604209 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-e7511d34-1033-49e1-97ef-363da7d0277e req-47cfe9a8-6b45-4582-919d-c6689fd76cd4 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:30.608116 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-e7511d34-1033-49e1-97ef-363da7d0277e req-47cfe9a8-6b45-4582-919d-c6689fd76cd4 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:30.608761 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-e7511d34-1033-49e1-97ef-363da7d0277e req-47cfe9a8-6b45-4582-919d-c6689fd76cd4 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:30.614278 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-fc90f57a-c04f-4755-bea7-c825f4941aaa req-f916ac1f-3b18-4302-836b-fc2db1905962 service nova] Creating event network-vif-plugged:0230e7b6-4d30-48c3-b9ab-066d496072ad for instance 12ca60c1-7c35-420c-b177-c7f3915a989f on n-h2-master-1 Oct 30 01:15:30.626687 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-fc90f57a-c04f-4755-bea7-c825f4941aaa req-f916ac1f-3b18-4302-836b-fc2db1905962 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052303 Oct 30 01:15:30.629153 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 313/629] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:15:30.635510 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-e7511d34-1033-49e1-97ef-363da7d0277e req-47cfe9a8-6b45-4582-919d-c6689fd76cd4 service nova] Creating event network-changed:c8a94bc2-b259-4ae7-9a0e-3c02ee3a39c3 for instance 3f60e45a-0e20-4280-be86-275d598fd552 on n-h1-master-1 Oct 30 01:15:30.642073 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-e7511d34-1033-49e1-97ef-363da7d0277e req-47cfe9a8-6b45-4582-919d-c6689fd76cd4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080525 Oct 30 01:15:30.643279 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 317/630] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:15:30.646283 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-57ab6569-07a1-405a-81e9-6ec9d1e2f57a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:30.648345 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-57ab6569-07a1-405a-81e9-6ec9d1e2f57a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 3f60e45a-0e20-4280-be86-275d598fd552] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:30.654804 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-67b4a919-0b78-4cd9-8cb0-88e32a9e6247 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:30.655729 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-67b4a919-0b78-4cd9-8cb0-88e32a9e6247 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] [instance: f9c8bf32-6f0e-4183-88be-031de936bb81] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:30.663494 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-57ab6569-07a1-405a-81e9-6ec9d1e2f57a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:30.663994 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-57ab6569-07a1-405a-81e9-6ec9d1e2f57a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:30.664465 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67b4a919-0b78-4cd9-8cb0-88e32a9e6247 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:30.665242 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67b4a919-0b78-4cd9-8cb0-88e32a9e6247 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:30.665765 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-57ab6569-07a1-405a-81e9-6ec9d1e2f57a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:30.675847 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67b4a919-0b78-4cd9-8cb0-88e32a9e6247 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:30.676111 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-57ab6569-07a1-405a-81e9-6ec9d1e2f57a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:30.676194 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67b4a919-0b78-4cd9-8cb0-88e32a9e6247 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:30.676194 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67b4a919-0b78-4cd9-8cb0-88e32a9e6247 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:30.676194 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67b4a919-0b78-4cd9-8cb0-88e32a9e6247 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:30.676421 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-57ab6569-07a1-405a-81e9-6ec9d1e2f57a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:30.676421 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-57ab6569-07a1-405a-81e9-6ec9d1e2f57a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:30.946494 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-57ab6569-07a1-405a-81e9-6ec9d1e2f57a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:30.954736 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-57ab6569-07a1-405a-81e9-6ec9d1e2f57a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:30.956188 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-57ab6569-07a1-405a-81e9-6ec9d1e2f57a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:30.957854 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-57ab6569-07a1-405a-81e9-6ec9d1e2f57a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552" status: 200 len: 1361 microversion: 2.25 time: 0.324430 Oct 30 01:15:30.958414 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 314/631] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:30 2022] GET /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552 => generated 1361 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:30.959488 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-67b4a919-0b78-4cd9-8cb0-88e32a9e6247 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056e59c7d4c2475eb66b64e0e24367be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6f42c16eeb4e97b65cebf891105008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:30.968384 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-67b4a919-0b78-4cd9-8cb0-88e32a9e6247 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] 10.222.0.13 "GET /compute/v2.1/servers/f9c8bf32-6f0e-4183-88be-031de936bb81" status: 200 len: 1588 microversion: 2.1 time: 0.323096 Oct 30 01:15:30.969026 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 318/632] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:30 2022] GET /compute/v2.1/servers/f9c8bf32-6f0e-4183-88be-031de936bb81 => generated 1588 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:30.994973 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e55b7ab0-b932-462f-8edd-7548cd9a43c7 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:30.995515 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e55b7ab0-b932-462f-8edd-7548cd9a43c7 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] [instance: f9c8bf32-6f0e-4183-88be-031de936bb81] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:31.001976 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e55b7ab0-b932-462f-8edd-7548cd9a43c7 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:31.002466 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e55b7ab0-b932-462f-8edd-7548cd9a43c7 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:31.002925 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e55b7ab0-b932-462f-8edd-7548cd9a43c7 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:31.004132 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e55b7ab0-b932-462f-8edd-7548cd9a43c7 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:31.004379 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8d387187-ae4d-40ed-83b2-ba3222276258 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:31.004584 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e55b7ab0-b932-462f-8edd-7548cd9a43c7 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:31.004990 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8d387187-ae4d-40ed-83b2-ba3222276258 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0dd3f0e2-2c15-4915-88b0-2df9e312cc4c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:31.005084 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e55b7ab0-b932-462f-8edd-7548cd9a43c7 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:31.010952 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d387187-ae4d-40ed-83b2-ba3222276258 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:31.011440 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d387187-ae4d-40ed-83b2-ba3222276258 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:31.011874 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d387187-ae4d-40ed-83b2-ba3222276258 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:31.012572 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d387187-ae4d-40ed-83b2-ba3222276258 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:31.013030 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d387187-ae4d-40ed-83b2-ba3222276258 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:31.013489 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d387187-ae4d-40ed-83b2-ba3222276258 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:31.153089 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e55b7ab0-b932-462f-8edd-7548cd9a43c7 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] 10.222.0.13 "GET /compute/v2.1/servers/f9c8bf32-6f0e-4183-88be-031de936bb81/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.161895 Oct 30 01:15:31.153744 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 315/633] 10.222.0.13 () {58 vars in 1275 bytes} [Sun Oct 30 01:15:30 2022] GET /compute/v2.1/servers/f9c8bf32-6f0e-4183-88be-031de936bb81/os-interface => generated 285 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:15:31.303134 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8d387187-ae4d-40ed-83b2-ba3222276258 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:31.334035 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8d387187-ae4d-40ed-83b2-ba3222276258 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c" status: 200 len: 1503 microversion: 2.1 time: 0.333779 Oct 30 01:15:31.336719 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 319/634] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:30 2022] GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c => generated 1503 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:15:31.465043 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-10314dbe-3ac9-4706-9cbd-2cdd5ef57525 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:31.465694 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-10314dbe-3ac9-4706-9cbd-2cdd5ef57525 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:31.472059 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-10314dbe-3ac9-4706-9cbd-2cdd5ef57525 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:31.472650 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-10314dbe-3ac9-4706-9cbd-2cdd5ef57525 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:31.473088 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-10314dbe-3ac9-4706-9cbd-2cdd5ef57525 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:31.473819 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-10314dbe-3ac9-4706-9cbd-2cdd5ef57525 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:31.474654 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-10314dbe-3ac9-4706-9cbd-2cdd5ef57525 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:31.475111 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-10314dbe-3ac9-4706-9cbd-2cdd5ef57525 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:31.568008 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8967d31d-316b-43b7-b939-da72fa82e7ce tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:31.571105 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8967d31d-316b-43b7-b939-da72fa82e7ce tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] [instance: 19d392d4-2f19-4065-a580-b2fd72303153] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:31.581142 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8967d31d-316b-43b7-b939-da72fa82e7ce tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:31.581994 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8967d31d-316b-43b7-b939-da72fa82e7ce tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:31.583340 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8967d31d-316b-43b7-b939-da72fa82e7ce tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:31.586529 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8967d31d-316b-43b7-b939-da72fa82e7ce tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:31.586529 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8967d31d-316b-43b7-b939-da72fa82e7ce tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:31.586529 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8967d31d-316b-43b7-b939-da72fa82e7ce tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:31.818413 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-10314dbe-3ac9-4706-9cbd-2cdd5ef57525 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:31.827107 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-10314dbe-3ac9-4706-9cbd-2cdd5ef57525 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f" status: 200 len: 1313 microversion: 2.1 time: 0.367217 Oct 30 01:15:31.827987 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 316/635] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:31 2022] GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f => generated 1313 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:31.833700 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-adf623ed-757e-465f-a7ce-ac30f0ad28ea tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:31.834595 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-adf623ed-757e-465f-a7ce-ac30f0ad28ea tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:31.840680 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-adf623ed-757e-465f-a7ce-ac30f0ad28ea tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:31.841481 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-adf623ed-757e-465f-a7ce-ac30f0ad28ea tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:31.842483 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-adf623ed-757e-465f-a7ce-ac30f0ad28ea tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:31.843589 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-adf623ed-757e-465f-a7ce-ac30f0ad28ea tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:31.844713 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-adf623ed-757e-465f-a7ce-ac30f0ad28ea tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:31.844713 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-adf623ed-757e-465f-a7ce-ac30f0ad28ea tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:32.022051 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-adf623ed-757e-465f-a7ce-ac30f0ad28ea tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lazy-loading 'services' on Instance uuid 2c5b301d-f84c-4395-add9-b84311fa785c {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:15:32.043065 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8967d31d-316b-43b7-b939-da72fa82e7ce tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ccc0bfdee94961aa198e3abf0d85cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee1e04c04bc40568e43eb98df39e7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:32.048740 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8967d31d-316b-43b7-b939-da72fa82e7ce tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] 10.222.0.13 "GET /compute/v2.1/servers/19d392d4-2f19-4065-a580-b2fd72303153" status: 200 len: 1468 microversion: 2.1 time: 0.488282 Oct 30 01:15:32.054952 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 320/636] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:31 2022] GET /compute/v2.1/servers/19d392d4-2f19-4065-a580-b2fd72303153 => generated 1468 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:15:32.078652 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-adf623ed-757e-465f-a7ce-ac30f0ad28ea tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 200 len: 1927 microversion: 2.75 time: 0.249398 Oct 30 01:15:32.080371 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 317/637] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:31 2022] GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 1927 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:32.086139 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d70a87bc-0de1-4ff6-bbd9-765d0e8eac91 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:32.093228 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d70a87bc-0de1-4ff6-bbd9-765d0e8eac91 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 3f60e45a-0e20-4280-be86-275d598fd552] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:32.106015 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d70a87bc-0de1-4ff6-bbd9-765d0e8eac91 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:32.106506 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d70a87bc-0de1-4ff6-bbd9-765d0e8eac91 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:32.106939 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d70a87bc-0de1-4ff6-bbd9-765d0e8eac91 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:32.107706 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d70a87bc-0de1-4ff6-bbd9-765d0e8eac91 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:32.108162 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d70a87bc-0de1-4ff6-bbd9-765d0e8eac91 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:32.108613 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d70a87bc-0de1-4ff6-bbd9-765d0e8eac91 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:32.210762 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-20ff5c8a-9b35-403e-9a73-4dacef8f1f0b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-369325353", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:32.303056 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-20ff5c8a-9b35-403e-9a73-4dacef8f1f0b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] validate_networks() for None {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:15:32.516596 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d70a87bc-0de1-4ff6-bbd9-765d0e8eac91 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:32.535224 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d70a87bc-0de1-4ff6-bbd9-765d0e8eac91 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:32.537803 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d70a87bc-0de1-4ff6-bbd9-765d0e8eac91 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:32.539520 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d70a87bc-0de1-4ff6-bbd9-765d0e8eac91 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552" status: 200 len: 1361 microversion: 2.25 time: 0.457074 Oct 30 01:15:32.540648 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 318/638] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:32 2022] GET /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552 => generated 1361 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:32.546303 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9e2a848e-df7b-457f-9fd4-462247752fec tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:32.547500 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9e2a848e-df7b-457f-9fd4-462247752fec tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0dd3f0e2-2c15-4915-88b0-2df9e312cc4c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:32.555477 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e2a848e-df7b-457f-9fd4-462247752fec tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:32.556308 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e2a848e-df7b-457f-9fd4-462247752fec tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:32.556806 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e2a848e-df7b-457f-9fd4-462247752fec tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:32.557835 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e2a848e-df7b-457f-9fd4-462247752fec tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:32.562585 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e2a848e-df7b-457f-9fd4-462247752fec tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:32.562585 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e2a848e-df7b-457f-9fd4-462247752fec tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:33.006285 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9e2a848e-df7b-457f-9fd4-462247752fec tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:33.018898 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9e2a848e-df7b-457f-9fd4-462247752fec tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c" status: 200 len: 1503 microversion: 2.1 time: 0.476504 Oct 30 01:15:33.024752 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 319/639] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:32 2022] GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c => generated 1503 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:33.038069 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-06be99c0-be04-4419-939c-8601c41a9237 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:33.038754 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-06be99c0-be04-4419-939c-8601c41a9237 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:33.051097 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-06be99c0-be04-4419-939c-8601c41a9237 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:33.051601 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-06be99c0-be04-4419-939c-8601c41a9237 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:33.052037 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-06be99c0-be04-4419-939c-8601c41a9237 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:33.056014 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-06be99c0-be04-4419-939c-8601c41a9237 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:33.056604 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-06be99c0-be04-4419-939c-8601c41a9237 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:33.057056 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-06be99c0-be04-4419-939c-8601c41a9237 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:33.063895 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-20ff5c8a-9b35-403e-9a73-4dacef8f1f0b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:15:33.064911 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-20ff5c8a-9b35-403e-9a73-4dacef8f1f0b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:15:33.065618 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-20ff5c8a-9b35-403e-9a73-4dacef8f1f0b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:15:33.066757 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-20ff5c8a-9b35-403e-9a73-4dacef8f1f0b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:15:33.067390 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-20ff5c8a-9b35-403e-9a73-4dacef8f1f0b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:15:33.084434 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-20ff5c8a-9b35-403e-9a73-4dacef8f1f0b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:33.087748 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-20ff5c8a-9b35-403e-9a73-4dacef8f1f0b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:33.098827 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-20ff5c8a-9b35-403e-9a73-4dacef8f1f0b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:33.098827 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-20ff5c8a-9b35-403e-9a73-4dacef8f1f0b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:33.098827 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-20ff5c8a-9b35-403e-9a73-4dacef8f1f0b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:33.098827 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-20ff5c8a-9b35-403e-9a73-4dacef8f1f0b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:33.115787 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=19 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:33.149254 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-20ff5c8a-9b35-403e-9a73-4dacef8f1f0b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Getting quotas for project 76b6f7b705f5428b9a3a3a8c4f86ff48. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:15:33.159013 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-20ff5c8a-9b35-403e-9a73-4dacef8f1f0b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Getting quotas for user c536d41a93ad4337909fe2e2cb949e03 and project 76b6f7b705f5428b9a3a3a8c4f86ff48. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:15:33.195310 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-20ff5c8a-9b35-403e-9a73-4dacef8f1f0b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:15:33.200007 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-20ff5c8a-9b35-403e-9a73-4dacef8f1f0b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: d19d848f-99bc-4f10-b837-d66aaa5258a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:15:33.352724 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-06be99c0-be04-4419-939c-8601c41a9237 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:33.362742 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-06be99c0-be04-4419-939c-8601c41a9237 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f" status: 200 len: 1313 microversion: 2.1 time: 0.336527 Oct 30 01:15:33.364319 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 320/640] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:33 2022] GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f => generated 1313 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:33.387090 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2d886727-cb3a-48f1-b834-c3157aad860c tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:33.388337 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2d886727-cb3a-48f1-b834-c3157aad860c tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] [instance: f9c8bf32-6f0e-4183-88be-031de936bb81] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:33.396853 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2d886727-cb3a-48f1-b834-c3157aad860c tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:33.398316 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2d886727-cb3a-48f1-b834-c3157aad860c tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:33.398834 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2d886727-cb3a-48f1-b834-c3157aad860c tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:33.401169 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2d886727-cb3a-48f1-b834-c3157aad860c tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:33.401891 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2d886727-cb3a-48f1-b834-c3157aad860c tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:33.402550 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2d886727-cb3a-48f1-b834-c3157aad860c tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:33.449437 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-20ff5c8a-9b35-403e-9a73-4dacef8f1f0b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.393017 Oct 30 01:15:33.450110 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 321/641] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:15:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1394 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:15:33.470317 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-075d8441-68fa-4591-ad3a-c2e82028e0ae req-d5c0471b-d71f-4b06-81c3-207a5e736009 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9c8bf32-6f0e-4183-88be-031de936bb81", "tag": "04c8c04f-f3e1-4927-a35a-2de5c05a0259"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:33.522006 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-075d8441-68fa-4591-ad3a-c2e82028e0ae req-d5c0471b-d71f-4b06-81c3-207a5e736009 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:33.522511 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-075d8441-68fa-4591-ad3a-c2e82028e0ae req-d5c0471b-d71f-4b06-81c3-207a5e736009 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:33.522955 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-075d8441-68fa-4591-ad3a-c2e82028e0ae req-d5c0471b-d71f-4b06-81c3-207a5e736009 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:33.567322 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-075d8441-68fa-4591-ad3a-c2e82028e0ae req-d5c0471b-d71f-4b06-81c3-207a5e736009 service nova] Creating event network-changed:04c8c04f-f3e1-4927-a35a-2de5c05a0259 for instance f9c8bf32-6f0e-4183-88be-031de936bb81 on n-h2-master-1 Oct 30 01:15:33.594185 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-075d8441-68fa-4591-ad3a-c2e82028e0ae req-d5c0471b-d71f-4b06-81c3-207a5e736009 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142683 Oct 30 01:15:33.604730 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 322/642] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:15:33.621110 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9c60862e-85b8-4236-a4d5-216f20563118 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:33.632903 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9c60862e-85b8-4236-a4d5-216f20563118 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] [instance: 19d392d4-2f19-4065-a580-b2fd72303153] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:33.653896 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9c60862e-85b8-4236-a4d5-216f20563118 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:33.657910 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9c60862e-85b8-4236-a4d5-216f20563118 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:33.667690 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9c60862e-85b8-4236-a4d5-216f20563118 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:33.667690 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9c60862e-85b8-4236-a4d5-216f20563118 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:33.670293 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9c60862e-85b8-4236-a4d5-216f20563118 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:33.670834 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9c60862e-85b8-4236-a4d5-216f20563118 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:33.775708 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2d886727-cb3a-48f1-b834-c3157aad860c tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056e59c7d4c2475eb66b64e0e24367be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6f42c16eeb4e97b65cebf891105008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:33.791587 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2d886727-cb3a-48f1-b834-c3157aad860c tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] 10.222.0.13 "GET /compute/v2.1/servers/f9c8bf32-6f0e-4183-88be-031de936bb81" status: 200 len: 1588 microversion: 2.1 time: 0.411283 Oct 30 01:15:33.792877 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 321/643] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:33 2022] GET /compute/v2.1/servers/f9c8bf32-6f0e-4183-88be-031de936bb81 => generated 1588 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:33.805994 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5b605a69-58ab-43b5-8431-02faed3c553d tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:33.807070 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5b605a69-58ab-43b5-8431-02faed3c553d tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:33.837049 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5b605a69-58ab-43b5-8431-02faed3c553d tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:33.837979 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5b605a69-58ab-43b5-8431-02faed3c553d tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:33.840966 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5b605a69-58ab-43b5-8431-02faed3c553d tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:33.843587 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5b605a69-58ab-43b5-8431-02faed3c553d tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:33.844465 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5b605a69-58ab-43b5-8431-02faed3c553d tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:33.845138 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5b605a69-58ab-43b5-8431-02faed3c553d tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:33.862892 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9c60862e-85b8-4236-a4d5-216f20563118 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ccc0bfdee94961aa198e3abf0d85cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee1e04c04bc40568e43eb98df39e7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:33.917129 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9c60862e-85b8-4236-a4d5-216f20563118 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] 10.222.0.13 "GET /compute/v2.1/servers/19d392d4-2f19-4065-a580-b2fd72303153" status: 200 len: 1298 microversion: 2.1 time: 0.310940 Oct 30 01:15:33.940532 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 323/644] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:33 2022] GET /compute/v2.1/servers/19d392d4-2f19-4065-a580-b2fd72303153 => generated 1298 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:33.967938 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-26810470-89f3-4c56-bcfb-dd82488e9b0c req-3272d81d-5613-4501-bb2f-112d6c77bace service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19d392d4-2f19-4065-a580-b2fd72303153", "name": "network-vif-deleted", "tag": "9b44d98c-e673-45c3-9a12-a02bb9d5af45"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:33.997913 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-26810470-89f3-4c56-bcfb-dd82488e9b0c req-3272d81d-5613-4501-bb2f-112d6c77bace service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:33.998421 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-26810470-89f3-4c56-bcfb-dd82488e9b0c req-3272d81d-5613-4501-bb2f-112d6c77bace service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:33.998912 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-26810470-89f3-4c56-bcfb-dd82488e9b0c req-3272d81d-5613-4501-bb2f-112d6c77bace service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:34.028091 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-26810470-89f3-4c56-bcfb-dd82488e9b0c req-3272d81d-5613-4501-bb2f-112d6c77bace service nova] Creating event network-vif-deleted:9b44d98c-e673-45c3-9a12-a02bb9d5af45 for instance 19d392d4-2f19-4065-a580-b2fd72303153 on n-h2-master-1 Oct 30 01:15:34.040546 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-26810470-89f3-4c56-bcfb-dd82488e9b0c req-3272d81d-5613-4501-bb2f-112d6c77bace service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092912 Oct 30 01:15:34.041164 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 324/645] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:15:34.048194 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cae077ef-9feb-41b0-80d1-1197203a2af9 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:34.049063 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cae077ef-9feb-41b0-80d1-1197203a2af9 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: d19d848f-99bc-4f10-b837-d66aaa5258a6] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:34.493151 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-cae077ef-9feb-41b0-80d1-1197203a2af9 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:34.515910 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cae077ef-9feb-41b0-80d1-1197203a2af9 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/d19d848f-99bc-4f10-b837-d66aaa5258a6" status: 200 len: 1216 microversion: 2.1 time: 0.470769 Oct 30 01:15:34.517784 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 325/646] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:34 2022] GET /compute/v2.1/servers/d19d848f-99bc-4f10-b837-d66aaa5258a6 => generated 1216 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:34.523595 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-76680904-c050-44f0-b876-0604896972a4 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:34.524334 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-76680904-c050-44f0-b876-0604896972a4 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 3f60e45a-0e20-4280-be86-275d598fd552] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:34.544207 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-76680904-c050-44f0-b876-0604896972a4 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:34.545277 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-76680904-c050-44f0-b876-0604896972a4 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:34.545979 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-76680904-c050-44f0-b876-0604896972a4 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:34.547107 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-76680904-c050-44f0-b876-0604896972a4 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:34.547726 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-76680904-c050-44f0-b876-0604896972a4 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:34.548303 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-76680904-c050-44f0-b876-0604896972a4 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:34.560833 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-5b605a69-58ab-43b5-8431-02faed3c553d tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lazy-loading 'services' on Instance uuid 2c5b301d-f84c-4395-add9-b84311fa785c {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:15:34.630201 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5b605a69-58ab-43b5-8431-02faed3c553d tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 200 len: 1927 microversion: 2.75 time: 0.835414 Oct 30 01:15:34.631870 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 322/647] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:33 2022] GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 1927 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:34.638307 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cd6ec5b5-2ee1-4bc0-ac40-323a8b8a430c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:34.639637 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-cd6ec5b5-2ee1-4bc0-ac40-323a8b8a430c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0dd3f0e2-2c15-4915-88b0-2df9e312cc4c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:34.647588 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd6ec5b5-2ee1-4bc0-ac40-323a8b8a430c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:34.648430 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd6ec5b5-2ee1-4bc0-ac40-323a8b8a430c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:34.649037 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd6ec5b5-2ee1-4bc0-ac40-323a8b8a430c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:34.649972 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd6ec5b5-2ee1-4bc0-ac40-323a8b8a430c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:34.650609 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd6ec5b5-2ee1-4bc0-ac40-323a8b8a430c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:34.651614 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd6ec5b5-2ee1-4bc0-ac40-323a8b8a430c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:34.886753 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-76680904-c050-44f0-b876-0604896972a4 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:34.901869 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-76680904-c050-44f0-b876-0604896972a4 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:34.903528 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-76680904-c050-44f0-b876-0604896972a4 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:34.907686 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-76680904-c050-44f0-b876-0604896972a4 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552" status: 200 len: 1361 microversion: 2.25 time: 0.388690 Oct 30 01:15:34.908839 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 326/648] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:34 2022] GET /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552 => generated 1361 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:34.922369 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-de669d83-663b-4f0a-80b9-1d1d6809c5f8 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:34.923206 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-de669d83-663b-4f0a-80b9-1d1d6809c5f8 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:34.929758 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-de669d83-663b-4f0a-80b9-1d1d6809c5f8 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:34.932424 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-de669d83-663b-4f0a-80b9-1d1d6809c5f8 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:34.932868 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-de669d83-663b-4f0a-80b9-1d1d6809c5f8 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:34.933620 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-de669d83-663b-4f0a-80b9-1d1d6809c5f8 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:34.934485 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-de669d83-663b-4f0a-80b9-1d1d6809c5f8 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:34.934912 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-de669d83-663b-4f0a-80b9-1d1d6809c5f8 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:34.946461 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-cd6ec5b5-2ee1-4bc0-ac40-323a8b8a430c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:34.955345 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cd6ec5b5-2ee1-4bc0-ac40-323a8b8a430c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c" status: 200 len: 1503 microversion: 2.1 time: 0.322252 Oct 30 01:15:34.955921 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 323/649] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:34 2022] GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c => generated 1503 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:34.968537 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5a1df709-e22c-4677-9ee1-be3b4a0c5eb3 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:34.970987 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5a1df709-e22c-4677-9ee1-be3b4a0c5eb3 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] [instance: 19d392d4-2f19-4065-a580-b2fd72303153] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:34.977606 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5a1df709-e22c-4677-9ee1-be3b4a0c5eb3 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:34.978412 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5a1df709-e22c-4677-9ee1-be3b4a0c5eb3 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:34.978941 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5a1df709-e22c-4677-9ee1-be3b4a0c5eb3 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:34.980059 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5a1df709-e22c-4677-9ee1-be3b4a0c5eb3 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:34.980868 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5a1df709-e22c-4677-9ee1-be3b4a0c5eb3 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:34.981370 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5a1df709-e22c-4677-9ee1-be3b4a0c5eb3 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:35.033656 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5a1df709-e22c-4677-9ee1-be3b4a0c5eb3 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:35.034567 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5a1df709-e22c-4677-9ee1-be3b4a0c5eb3 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:35.035624 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5a1df709-e22c-4677-9ee1-be3b4a0c5eb3 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:35.036102 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-5a1df709-e22c-4677-9ee1-be3b4a0c5eb3 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lazy-loading 'fault' on Instance uuid 19d392d4-2f19-4065-a580-b2fd72303153 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:15:35.100636 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:35.120221 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5a1df709-e22c-4677-9ee1-be3b4a0c5eb3 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ccc0bfdee94961aa198e3abf0d85cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee1e04c04bc40568e43eb98df39e7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:35.127179 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5a1df709-e22c-4677-9ee1-be3b4a0c5eb3 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] 10.222.0.13 "GET /compute/v2.1/servers/19d392d4-2f19-4065-a580-b2fd72303153" status: 200 len: 1312 microversion: 2.1 time: 0.162914 Oct 30 01:15:35.127967 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 324/650] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:34 2022] GET /compute/v2.1/servers/19d392d4-2f19-4065-a580-b2fd72303153 => generated 1312 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:35.267619 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-de669d83-663b-4f0a-80b9-1d1d6809c5f8 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:35.276766 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-de669d83-663b-4f0a-80b9-1d1d6809c5f8 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f" status: 200 len: 1463 microversion: 2.1 time: 0.366603 Oct 30 01:15:35.277709 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 327/651] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:34 2022] GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f => generated 1463 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:35.328175 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-c1b72f31-36fe-408d-b8c7-594743dd73a1 req-990612b4-72c3-4623-99ef-ad26bf2a2e64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f60e45a-0e20-4280-be86-275d598fd552", "name": "network-vif-plugged", "status": "completed", "tag": "c8a94bc2-b259-4ae7-9a0e-3c02ee3a39c3"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:35.342844 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:35.345235 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-c1b72f31-36fe-408d-b8c7-594743dd73a1 req-990612b4-72c3-4623-99ef-ad26bf2a2e64 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:35.345948 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-c1b72f31-36fe-408d-b8c7-594743dd73a1 req-990612b4-72c3-4623-99ef-ad26bf2a2e64 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:35.346581 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-c1b72f31-36fe-408d-b8c7-594743dd73a1 req-990612b4-72c3-4623-99ef-ad26bf2a2e64 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:35.359835 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-c1b72f31-36fe-408d-b8c7-594743dd73a1 req-990612b4-72c3-4623-99ef-ad26bf2a2e64 service nova] Creating event network-vif-plugged:c8a94bc2-b259-4ae7-9a0e-3c02ee3a39c3 for instance 3f60e45a-0e20-4280-be86-275d598fd552 on n-h1-master-1 Oct 30 01:15:35.365556 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-c1b72f31-36fe-408d-b8c7-594743dd73a1 req-990612b4-72c3-4623-99ef-ad26bf2a2e64 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041117 Oct 30 01:15:35.366493 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 328/652] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:15:35.516402 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0838bbf8-8007-4daf-956c-d42092a46b3b tempest-InstanceUsageAuditLogTestJSON-841893970 tempest-InstanceUsageAuditLogTestJSON-841893970-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:35.536713 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0838bbf8-8007-4daf-956c-d42092a46b3b tempest-InstanceUsageAuditLogTestJSON-841893970 tempest-InstanceUsageAuditLogTestJSON-841893970-project-admin] 10.222.0.13 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-30 01:15:35" status: 200 len: 318 microversion: 2.1 time: 0.159797 Oct 30 01:15:35.537300 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 329/653] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 30 01:15:35 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-30%2001%3A15%3A35 => generated 318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:15:35.545883 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b1789dfa-3fbf-42e1-a929-ab921f50bfc1 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:35.546779 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b1789dfa-3fbf-42e1-a929-ab921f50bfc1 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: d19d848f-99bc-4f10-b837-d66aaa5258a6] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:35.553962 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b1789dfa-3fbf-42e1-a929-ab921f50bfc1 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:35.554485 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b1789dfa-3fbf-42e1-a929-ab921f50bfc1 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:35.554927 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b1789dfa-3fbf-42e1-a929-ab921f50bfc1 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:35.555656 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b1789dfa-3fbf-42e1-a929-ab921f50bfc1 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:35.556396 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b1789dfa-3fbf-42e1-a929-ab921f50bfc1 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:35.556891 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b1789dfa-3fbf-42e1-a929-ab921f50bfc1 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:35.573702 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:35.586837 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d7e85d11-ea3e-4b9d-99cc-360c80b122b5 tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:35.587538 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d7e85d11-ea3e-4b9d-99cc-360c80b122b5 tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:35.595851 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d7e85d11-ea3e-4b9d-99cc-360c80b122b5 tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:35.596747 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d7e85d11-ea3e-4b9d-99cc-360c80b122b5 tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:35.596747 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d7e85d11-ea3e-4b9d-99cc-360c80b122b5 tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:35.598109 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d7e85d11-ea3e-4b9d-99cc-360c80b122b5 tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:35.598602 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d7e85d11-ea3e-4b9d-99cc-360c80b122b5 tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:35.599102 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d7e85d11-ea3e-4b9d-99cc-360c80b122b5 tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:35.628671 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b1789dfa-3fbf-42e1-a929-ab921f50bfc1 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:35.637940 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b1789dfa-3fbf-42e1-a929-ab921f50bfc1 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/d19d848f-99bc-4f10-b837-d66aaa5258a6" status: 200 len: 1220 microversion: 2.1 time: 0.097670 Oct 30 01:15:35.638919 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 330/654] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:35 2022] GET /compute/v2.1/servers/d19d848f-99bc-4f10-b837-d66aaa5258a6 => generated 1220 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:15:35.658880 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c2106e1d-5bd6-4c4b-a210-616261c9b06f tempest-InstanceUsageAuditLogTestJSON-841893970 tempest-InstanceUsageAuditLogTestJSON-841893970-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:35.671402 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c2106e1d-5bd6-4c4b-a210-616261c9b06f tempest-InstanceUsageAuditLogTestJSON-841893970 tempest-InstanceUsageAuditLogTestJSON-841893970-project-admin] 10.222.0.13 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.031157 Oct 30 01:15:35.671976 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 331/655] 10.222.0.13 () {58 vars in 1185 bytes} [Sun Oct 30 01:15:35 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:15:35.676940 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-64416e44-0123-4e7a-a663-83086988af5d tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:35.677584 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-64416e44-0123-4e7a-a663-83086988af5d tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:35.683631 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-64416e44-0123-4e7a-a663-83086988af5d tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:35.684132 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-64416e44-0123-4e7a-a663-83086988af5d tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:35.684826 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-64416e44-0123-4e7a-a663-83086988af5d tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:35.685558 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-64416e44-0123-4e7a-a663-83086988af5d tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:35.686014 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-64416e44-0123-4e7a-a663-83086988af5d tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:35.686633 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-64416e44-0123-4e7a-a663-83086988af5d tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:35.765609 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-64416e44-0123-4e7a-a663-83086988af5d tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lazy-loading 'services' on Instance uuid 2c5b301d-f84c-4395-add9-b84311fa785c {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:15:35.786558 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-64416e44-0123-4e7a-a663-83086988af5d tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 200 len: 1927 microversion: 2.75 time: 0.113540 Oct 30 01:15:35.787305 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 332/656] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:35 2022] GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 1927 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:35.934766 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a46a54bb-8b41-462a-8d7d-e5e8f9b23a80 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:35.935377 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a46a54bb-8b41-462a-8d7d-e5e8f9b23a80 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 3f60e45a-0e20-4280-be86-275d598fd552] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:35.941529 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a46a54bb-8b41-462a-8d7d-e5e8f9b23a80 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:35.942019 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a46a54bb-8b41-462a-8d7d-e5e8f9b23a80 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:35.942449 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a46a54bb-8b41-462a-8d7d-e5e8f9b23a80 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:35.943145 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a46a54bb-8b41-462a-8d7d-e5e8f9b23a80 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:35.943594 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a46a54bb-8b41-462a-8d7d-e5e8f9b23a80 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:35.944014 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a46a54bb-8b41-462a-8d7d-e5e8f9b23a80 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:35.996143 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d7e85d11-ea3e-4b9d-99cc-360c80b122b5 tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f" status: 200 len: 1614 microversion: 2.1 time: 0.694836 Oct 30 01:15:35.996143 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 325/657] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:35 2022] GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f => generated 1614 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:36.000332 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c6199771-4ae0-4fcc-9e5f-c0eb60f5dc9c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:36.000942 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c6199771-4ae0-4fcc-9e5f-c0eb60f5dc9c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0dd3f0e2-2c15-4915-88b0-2df9e312cc4c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:36.006990 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6199771-4ae0-4fcc-9e5f-c0eb60f5dc9c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:36.007548 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6199771-4ae0-4fcc-9e5f-c0eb60f5dc9c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:36.008049 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6199771-4ae0-4fcc-9e5f-c0eb60f5dc9c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:36.008819 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6199771-4ae0-4fcc-9e5f-c0eb60f5dc9c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:36.009361 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6199771-4ae0-4fcc-9e5f-c0eb60f5dc9c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:36.009865 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6199771-4ae0-4fcc-9e5f-c0eb60f5dc9c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:36.030392 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:36.148688 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a46a54bb-8b41-462a-8d7d-e5e8f9b23a80 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:36.161005 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a46a54bb-8b41-462a-8d7d-e5e8f9b23a80 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:36.162166 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a46a54bb-8b41-462a-8d7d-e5e8f9b23a80 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:36.163643 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a46a54bb-8b41-462a-8d7d-e5e8f9b23a80 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552" status: 200 len: 1361 microversion: 2.25 time: 0.233210 Oct 30 01:15:36.173422 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 333/658] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:35 2022] GET /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552 => generated 1361 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:15:36.181940 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c6199771-4ae0-4fcc-9e5f-c0eb60f5dc9c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:36.182064 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a71d90eb-c044-4840-90ce-d55c532d8faa tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:36.182064 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a71d90eb-c044-4840-90ce-d55c532d8faa tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:36.184121 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a71d90eb-c044-4840-90ce-d55c532d8faa tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:36.184920 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a71d90eb-c044-4840-90ce-d55c532d8faa tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:36.185124 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c6199771-4ae0-4fcc-9e5f-c0eb60f5dc9c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c" status: 200 len: 1478 microversion: 2.1 time: 0.188609 Oct 30 01:15:36.185528 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a71d90eb-c044-4840-90ce-d55c532d8faa tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:36.186392 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a71d90eb-c044-4840-90ce-d55c532d8faa tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:36.187761 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a71d90eb-c044-4840-90ce-d55c532d8faa tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:36.187761 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a71d90eb-c044-4840-90ce-d55c532d8faa tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:36.188967 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 326/659] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:35 2022] GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c => generated 1478 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:36.194975 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d98c7901-f909-48e5-96c2-ac2f9d861994 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:36.195806 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d98c7901-f909-48e5-96c2-ac2f9d861994 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] [instance: 19d392d4-2f19-4065-a580-b2fd72303153] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:36.202064 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d98c7901-f909-48e5-96c2-ac2f9d861994 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:36.203004 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d98c7901-f909-48e5-96c2-ac2f9d861994 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:36.204285 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d98c7901-f909-48e5-96c2-ac2f9d861994 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:36.205579 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d98c7901-f909-48e5-96c2-ac2f9d861994 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:36.206226 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d98c7901-f909-48e5-96c2-ac2f9d861994 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:36.207316 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d98c7901-f909-48e5-96c2-ac2f9d861994 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:36.223965 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-d98c7901-f909-48e5-96c2-ac2f9d861994 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] HTTP exception thrown: Instance 19d392d4-2f19-4065-a580-b2fd72303153 could not be found. Oct 30 01:15:36.226121 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d98c7901-f909-48e5-96c2-ac2f9d861994 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Request method failure captured: Oct 30 01:15:36.226121 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/19d392d4-2f19-4065-a580-b2fd72303153 HTTP/1.1 Oct 30 01:15:36.226121 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:15:36.226121 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:15:36.226121 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:15:36.226121 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:15:36.226121 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:15:36.226121 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:15:36.226121 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:15:36.226121 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:15:36.226121 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdAEQIsI5zTiUPdhbte40Alwapm0ZYUhAbkZ95pXiYWxCfsqPTH7z49blJiiblFtNo7Itk_wdHlUaz3fd15G3kPM9Hxx2LIA_4QQvRnz0AcgtbCrJQi67Dq9ZSD1MICXpuYCqBs2oALiVTVbw8u3jYcw2nTy3n9uZUYMg6ciMh7yu7I Oct 30 01:15:36.226121 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:15:36.226121 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:15:36.226121 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:15:36.226121 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:15:36.226121 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:15:36.226121 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:15:36.226121 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 3ee1e04c04bc40568e43eb98df39e7e6 Oct 30 01:15:36.226121 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-703885089 Oct 30 01:15:36.226121 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:15:36.226121 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:15:36.231188 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3ee1e04c04bc40568e43eb98df39e7e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3ee1e04c04bc40568e43eb98df39e7e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3ee1e04c04bc40568e43eb98df39e7e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3ee1e04c04bc40568e43eb98df39e7e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:15:36.231188 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersAdminNegativeTestJSON-703885089 Oct 30 01:15:36.231188 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 3ee1e04c04bc40568e43eb98df39e7e6 Oct 30 01:15:36.231188 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-703885089 Oct 30 01:15:36.231188 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersAdminNegativeTestJSON-703885089-project Oct 30 01:15:36.231188 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:15:36.231188 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:15:36.231188 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 51ccc0bfdee94961aa198e3abf0d85cc Oct 30 01:15:36.231188 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersAdminNegativeTestJSON-703885089-project Oct 30 01:15:36.231188 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:15:36.231188 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 19d392d4-2f19-4065-a580-b2fd72303153 could not be found. Oct 30 01:15:36.231188 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '19d392d4-2f19-4065-a580-b2fd72303153'} Oct 30 01:15:36.231933 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:15:36.231933 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:15:36.231933 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:15:36.231933 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:15:36.231933 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:15:36.231933 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:15:36.231933 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:15:36.231933 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:15:36.231933 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:15:36.231933 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:15:36.231933 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19d392d4-2f19-4065-a580-b2fd72303153 could not be found. Oct 30 01:15:36.231933 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:36.231933 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:15:36.231933 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:36.231933 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:15:36.231933 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:15:36.231933 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:15:36.231933 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:15:36.231933 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:15:36.231933 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:15:36.233189 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:15:36.233189 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:15:36.233189 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:15:36.233189 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:15:36.233189 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:15:36.233189 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:15:36.233189 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:15:36.233189 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19d392d4-2f19-4065-a580-b2fd72303153 could not be found. Oct 30 01:15:36.233189 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:36.233189 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:15:36.233189 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:36.233189 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:15:36.233189 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:15:36.233189 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:15:36.233189 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:15:36.233189 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:15:36.233189 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19d392d4-2f19-4065-a580-b2fd72303153 could not be found. Oct 30 01:15:36.233189 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:36.234412 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d98c7901-f909-48e5-96c2-ac2f9d861994 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Returning 404 to user: Instance 19d392d4-2f19-4065-a580-b2fd72303153 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:15:36.234412 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d98c7901-f909-48e5-96c2-ac2f9d861994 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] 10.222.0.13 "GET /compute/v2.1/servers/19d392d4-2f19-4065-a580-b2fd72303153" status: 404 len: 111 microversion: 2.1 time: 0.037561 Oct 30 01:15:36.234412 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 327/660] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:36 2022] GET /compute/v2.1/servers/19d392d4-2f19-4065-a580-b2fd72303153 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:15:36.239794 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-67066076-0440-4296-9cc6-516144c8284a tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Calling method '.version_select at 0x7f44cc6bcaf0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:36.243594 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-67066076-0440-4296-9cc6-516144c8284a tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:36.244186 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-67066076-0440-4296-9cc6-516144c8284a tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:36.244532 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-67066076-0440-4296-9cc6-516144c8284a tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:36.255256 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-67066076-0440-4296-9cc6-516144c8284a tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] 10.222.0.13 "GET /compute/v2.1/os-migrations" status: 200 len: 1166 microversion: 2.1 time: 0.018871 Oct 30 01:15:36.255890 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 328/661] 10.222.0.13 () {58 vars in 1143 bytes} [Sun Oct 30 01:15:36 2022] GET /compute/v2.1/os-migrations => generated 1166 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:36.261073 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ce4c0626-1e4f-4606-bd81-e992a9785b6c tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:36.261614 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ce4c0626-1e4f-4606-bd81-e992a9785b6c tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] [instance: 4f47f49f-e5a9-46d5-9622-c9c887891646] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:36.268134 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ce4c0626-1e4f-4606-bd81-e992a9785b6c tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:36.268642 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ce4c0626-1e4f-4606-bd81-e992a9785b6c tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:36.269083 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ce4c0626-1e4f-4606-bd81-e992a9785b6c tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:36.270410 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ce4c0626-1e4f-4606-bd81-e992a9785b6c tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:36.270869 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ce4c0626-1e4f-4606-bd81-e992a9785b6c tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:36.271324 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ce4c0626-1e4f-4606-bd81-e992a9785b6c tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:36.302466 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ce4c0626-1e4f-4606-bd81-e992a9785b6c tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] [instance: 4f47f49f-e5a9-46d5-9622-c9c887891646] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:15:36.429205 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a71d90eb-c044-4840-90ce-d55c532d8faa tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '1d811dc93ede4dbebc25f91027b6dfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8212ea2596df443dbc6cf5494d994b7b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:36.429820 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a71d90eb-c044-4840-90ce-d55c532d8faa tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] flavor_id is None. Assuming migration. {{(pid=121102) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 30 01:15:36.430279 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a71d90eb-c044-4840-90ce-d55c532d8faa tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=121102) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 30 01:15:36.574626 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ce4c0626-1e4f-4606-bd81-e992a9785b6c tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] 10.222.0.13 "DELETE /compute/v2.1/servers/4f47f49f-e5a9-46d5-9622-c9c887891646" status: 204 len: 0 microversion: 2.1 time: 0.317386 Oct 30 01:15:36.576023 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 329/662] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:15:36 2022] DELETE /compute/v2.1/servers/4f47f49f-e5a9-46d5-9622-c9c887891646 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:15:36.582545 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-71983ac8-3f82-49ac-90a3-75cd52fc6a80 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:36.583391 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-71983ac8-3f82-49ac-90a3-75cd52fc6a80 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] [instance: 0dd3f0e2-2c15-4915-88b0-2df9e312cc4c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:36.585586 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:36.590752 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-71983ac8-3f82-49ac-90a3-75cd52fc6a80 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:36.595760 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-71983ac8-3f82-49ac-90a3-75cd52fc6a80 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:36.596535 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-71983ac8-3f82-49ac-90a3-75cd52fc6a80 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:36.597630 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-71983ac8-3f82-49ac-90a3-75cd52fc6a80 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:36.598353 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-71983ac8-3f82-49ac-90a3-75cd52fc6a80 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:36.598775 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-71983ac8-3f82-49ac-90a3-75cd52fc6a80 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:36.745320 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-71983ac8-3f82-49ac-90a3-75cd52fc6a80 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c" status: 200 len: 1629 microversion: 2.1 time: 0.167626 Oct 30 01:15:36.745901 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 330/663] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:36 2022] GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c => generated 1629 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:36.756292 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-188e9a41-607a-4f41-a538-ac6f8af76564 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:36.756292 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-188e9a41-607a-4f41-a538-ac6f8af76564 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] [instance: 4f47f49f-e5a9-46d5-9622-c9c887891646] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:36.757168 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-188e9a41-607a-4f41-a538-ac6f8af76564 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:36.757697 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-188e9a41-607a-4f41-a538-ac6f8af76564 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:36.758131 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-188e9a41-607a-4f41-a538-ac6f8af76564 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:36.758822 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-188e9a41-607a-4f41-a538-ac6f8af76564 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:36.759271 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-188e9a41-607a-4f41-a538-ac6f8af76564 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:36.759693 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-188e9a41-607a-4f41-a538-ac6f8af76564 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:36.786324 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a71d90eb-c044-4840-90ce-d55c532d8faa tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f/action" status: 202 len: 0 microversion: 2.1 time: 0.620639 Oct 30 01:15:36.787285 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 334/664] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:15:36 2022] POST /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f/action => generated 0 bytes in 622 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:15:36.792304 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-996b5826-876e-4ea1-8820-cc7eac154ed0 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:36.792931 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-996b5826-876e-4ea1-8820-cc7eac154ed0 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: d19d848f-99bc-4f10-b837-d66aaa5258a6] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:36.801041 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-996b5826-876e-4ea1-8820-cc7eac154ed0 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:36.802030 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-996b5826-876e-4ea1-8820-cc7eac154ed0 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:36.802830 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-996b5826-876e-4ea1-8820-cc7eac154ed0 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:36.803869 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-996b5826-876e-4ea1-8820-cc7eac154ed0 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:36.804645 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-996b5826-876e-4ea1-8820-cc7eac154ed0 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:36.805267 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-996b5826-876e-4ea1-8820-cc7eac154ed0 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:36.912471 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-996b5826-876e-4ea1-8820-cc7eac154ed0 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:36.919032 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-996b5826-876e-4ea1-8820-cc7eac154ed0 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/d19d848f-99bc-4f10-b837-d66aaa5258a6" status: 200 len: 1220 microversion: 2.1 time: 0.130656 Oct 30 01:15:36.919645 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 335/665] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:36 2022] GET /compute/v2.1/servers/d19d848f-99bc-4f10-b837-d66aaa5258a6 => generated 1220 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:36.930103 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d429a925-6a4d-4e59-9fa3-93b16390f985 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Action: 'create', calling method: .version_select at 0x7f44cc5af1f0>, body: {"keypair": {"name": "tempest-keypair-207035062", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOgJfYeVv18SIYvBI2P3bjYuStHTZHmy5TsAOLIr5yInyLsiVHDTZQIflGBArC/g+LsiBIoRWQEHc9UgIXLZ1MvDcCQPiHf9N8H88thY4fZxj+i21Co6sW0JJ3BLcOU/xQ=="}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:36.954500 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-d429a925-6a4d-4e59-9fa3-93b16390f985 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Getting quotas for project 283e7fd477334b879db6b49ee5cc509f. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:15:36.960323 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-d429a925-6a4d-4e59-9fa3-93b16390f985 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Getting quotas for user c7334417689847d18bc4c1b27d173a23 and project 283e7fd477334b879db6b49ee5cc509f. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:15:36.964082 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-188e9a41-607a-4f41-a538-ac6f8af76564 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ccc0bfdee94961aa198e3abf0d85cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee1e04c04bc40568e43eb98df39e7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:36.973149 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-188e9a41-607a-4f41-a538-ac6f8af76564 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] 10.222.0.13 "GET /compute/v2.1/servers/4f47f49f-e5a9-46d5-9622-c9c887891646" status: 200 len: 1475 microversion: 2.1 time: 0.225713 Oct 30 01:15:36.973765 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 331/666] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:36 2022] GET /compute/v2.1/servers/4f47f49f-e5a9-46d5-9622-c9c887891646 => generated 1475 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:36.979236 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fea0cdf3-ff11-4d58-bb21-119c47c8e9ef tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:36.979843 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-fea0cdf3-ff11-4d58-bb21-119c47c8e9ef tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:36.986068 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fea0cdf3-ff11-4d58-bb21-119c47c8e9ef tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:36.986561 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fea0cdf3-ff11-4d58-bb21-119c47c8e9ef tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:36.986994 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fea0cdf3-ff11-4d58-bb21-119c47c8e9ef tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:36.987704 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fea0cdf3-ff11-4d58-bb21-119c47c8e9ef tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:36.988189 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fea0cdf3-ff11-4d58-bb21-119c47c8e9ef tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:36.988620 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fea0cdf3-ff11-4d58-bb21-119c47c8e9ef tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:37.062428 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d429a925-6a4d-4e59-9fa3-93b16390f985 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.141687 Oct 30 01:15:37.063078 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 336/667] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 30 01:15:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:15:37.068558 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-96a93a21-430c-4feb-9d94-cb92cf5d6626 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:37.069177 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-96a93a21-430c-4feb-9d94-cb92cf5d6626 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:37.078035 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96a93a21-430c-4feb-9d94-cb92cf5d6626 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:37.078535 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96a93a21-430c-4feb-9d94-cb92cf5d6626 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:37.079173 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96a93a21-430c-4feb-9d94-cb92cf5d6626 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:37.080049 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96a93a21-430c-4feb-9d94-cb92cf5d6626 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:37.080658 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96a93a21-430c-4feb-9d94-cb92cf5d6626 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:37.081230 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96a93a21-430c-4feb-9d94-cb92cf5d6626 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:37.175957 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-96a93a21-430c-4feb-9d94-cb92cf5d6626 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lazy-loading 'services' on Instance uuid 2c5b301d-f84c-4395-add9-b84311fa785c {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:15:37.193862 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-fea0cdf3-ff11-4d58-bb21-119c47c8e9ef tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:37.196073 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-96a93a21-430c-4feb-9d94-cb92cf5d6626 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 200 len: 1945 microversion: 2.75 time: 0.131838 Oct 30 01:15:37.197087 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 337/668] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:37 2022] GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 1945 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:37.202053 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-dedd4ba7-4616-4646-bb48-d1f8a22ca832 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:37.205818 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-dedd4ba7-4616-4646-bb48-d1f8a22ca832 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 3f60e45a-0e20-4280-be86-275d598fd552] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:37.210020 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dedd4ba7-4616-4646-bb48-d1f8a22ca832 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:37.210545 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dedd4ba7-4616-4646-bb48-d1f8a22ca832 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:37.210993 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dedd4ba7-4616-4646-bb48-d1f8a22ca832 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:37.211705 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dedd4ba7-4616-4646-bb48-d1f8a22ca832 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:37.212158 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dedd4ba7-4616-4646-bb48-d1f8a22ca832 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:37.212588 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dedd4ba7-4616-4646-bb48-d1f8a22ca832 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:37.224677 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fea0cdf3-ff11-4d58-bb21-119c47c8e9ef tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f" status: 200 len: 1472 microversion: 2.1 time: 0.248946 Oct 30 01:15:37.226432 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 332/669] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:36 2022] GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f => generated 1472 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:37.375115 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-dedd4ba7-4616-4646-bb48-d1f8a22ca832 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:37.384523 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-dedd4ba7-4616-4646-bb48-d1f8a22ca832 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:37.386059 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-dedd4ba7-4616-4646-bb48-d1f8a22ca832 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:37.387229 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-dedd4ba7-4616-4646-bb48-d1f8a22ca832 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552" status: 200 len: 1361 microversion: 2.25 time: 0.189152 Oct 30 01:15:37.387790 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 338/670] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:37 2022] GET /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552 => generated 1361 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:37.944956 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-26ee53e2-4755-45ed-8bdc-48eb3b455cc6 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:37.945967 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-26ee53e2-4755-45ed-8bdc-48eb3b455cc6 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: d19d848f-99bc-4f10-b837-d66aaa5258a6] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:37.954352 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-26ee53e2-4755-45ed-8bdc-48eb3b455cc6 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:37.954774 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-26ee53e2-4755-45ed-8bdc-48eb3b455cc6 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:37.955210 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-26ee53e2-4755-45ed-8bdc-48eb3b455cc6 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:37.956028 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-26ee53e2-4755-45ed-8bdc-48eb3b455cc6 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:37.956479 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-26ee53e2-4755-45ed-8bdc-48eb3b455cc6 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:37.956928 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-26ee53e2-4755-45ed-8bdc-48eb3b455cc6 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:37.996580 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-54de2fec-8a7e-4652-b67a-f05854055801 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:37.997196 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-54de2fec-8a7e-4652-b67a-f05854055801 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] [instance: 4f47f49f-e5a9-46d5-9622-c9c887891646] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:38.012121 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-54de2fec-8a7e-4652-b67a-f05854055801 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:38.012613 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-54de2fec-8a7e-4652-b67a-f05854055801 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:38.013046 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-54de2fec-8a7e-4652-b67a-f05854055801 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:38.013783 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-54de2fec-8a7e-4652-b67a-f05854055801 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:38.014239 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-54de2fec-8a7e-4652-b67a-f05854055801 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:38.014664 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-54de2fec-8a7e-4652-b67a-f05854055801 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:38.024499 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-26ee53e2-4755-45ed-8bdc-48eb3b455cc6 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:38.032870 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-26ee53e2-4755-45ed-8bdc-48eb3b455cc6 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/d19d848f-99bc-4f10-b837-d66aaa5258a6" status: 200 len: 1212 microversion: 2.1 time: 0.093096 Oct 30 01:15:38.033712 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 333/671] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:37 2022] GET /compute/v2.1/servers/d19d848f-99bc-4f10-b837-d66aaa5258a6 => generated 1212 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:38.212379 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-54de2fec-8a7e-4652-b67a-f05854055801 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ccc0bfdee94961aa198e3abf0d85cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee1e04c04bc40568e43eb98df39e7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:38.220477 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-54de2fec-8a7e-4652-b67a-f05854055801 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] 10.222.0.13 "GET /compute/v2.1/servers/4f47f49f-e5a9-46d5-9622-c9c887891646" status: 200 len: 1475 microversion: 2.1 time: 0.228193 Oct 30 01:15:38.221122 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 339/672] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:37 2022] GET /compute/v2.1/servers/4f47f49f-e5a9-46d5-9622-c9c887891646 => generated 1475 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:38.238616 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c92ae288-a283-498a-9cec-6276221530eb tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:38.239387 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c92ae288-a283-498a-9cec-6276221530eb tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:38.246969 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c92ae288-a283-498a-9cec-6276221530eb tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:38.247713 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c92ae288-a283-498a-9cec-6276221530eb tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:38.251669 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c92ae288-a283-498a-9cec-6276221530eb tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:38.252945 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c92ae288-a283-498a-9cec-6276221530eb tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:38.254194 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c92ae288-a283-498a-9cec-6276221530eb tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:38.255190 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b14f2433-776e-4bc7-b3ae-b64b0c7e2405 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:38.255851 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c92ae288-a283-498a-9cec-6276221530eb tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:38.256257 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b14f2433-776e-4bc7-b3ae-b64b0c7e2405 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:38.265789 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b14f2433-776e-4bc7-b3ae-b64b0c7e2405 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:38.266186 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b14f2433-776e-4bc7-b3ae-b64b0c7e2405 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:38.267424 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b14f2433-776e-4bc7-b3ae-b64b0c7e2405 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:38.268354 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b14f2433-776e-4bc7-b3ae-b64b0c7e2405 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:38.268937 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b14f2433-776e-4bc7-b3ae-b64b0c7e2405 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:38.270004 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b14f2433-776e-4bc7-b3ae-b64b0c7e2405 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:38.422560 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-c92ae288-a283-498a-9cec-6276221530eb tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lazy-loading 'services' on Instance uuid 2c5b301d-f84c-4395-add9-b84311fa785c {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:15:38.452441 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c92ae288-a283-498a-9cec-6276221530eb tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 200 len: 1945 microversion: 2.75 time: 0.217550 Oct 30 01:15:38.453634 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 334/673] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:38 2022] GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 1945 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:15:38.470107 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7884e03e-c5fd-46ee-b196-50d2e483df6d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:38.470779 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7884e03e-c5fd-46ee-b196-50d2e483df6d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 3f60e45a-0e20-4280-be86-275d598fd552] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:38.484126 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7884e03e-c5fd-46ee-b196-50d2e483df6d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:38.484621 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7884e03e-c5fd-46ee-b196-50d2e483df6d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:38.485081 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7884e03e-c5fd-46ee-b196-50d2e483df6d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:38.486034 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7884e03e-c5fd-46ee-b196-50d2e483df6d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:38.498006 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7884e03e-c5fd-46ee-b196-50d2e483df6d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:38.498468 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7884e03e-c5fd-46ee-b196-50d2e483df6d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:38.520952 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b14f2433-776e-4bc7-b3ae-b64b0c7e2405 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:38.529794 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b14f2433-776e-4bc7-b3ae-b64b0c7e2405 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f" status: 200 len: 1472 microversion: 2.1 time: 0.283174 Oct 30 01:15:38.533471 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 340/674] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:38 2022] GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f => generated 1472 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:38.668346 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7884e03e-c5fd-46ee-b196-50d2e483df6d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:38.680712 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7884e03e-c5fd-46ee-b196-50d2e483df6d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:38.682482 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7884e03e-c5fd-46ee-b196-50d2e483df6d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:38.683661 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7884e03e-c5fd-46ee-b196-50d2e483df6d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552" status: 200 len: 1361 microversion: 2.25 time: 0.228523 Oct 30 01:15:38.684226 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 335/675] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:38 2022] GET /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552 => generated 1361 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:39.056946 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-379ca2cd-53cc-46fc-be78-4a004ad7a5ad tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:39.057942 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-379ca2cd-53cc-46fc-be78-4a004ad7a5ad tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: d19d848f-99bc-4f10-b837-d66aaa5258a6] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:39.067954 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-379ca2cd-53cc-46fc-be78-4a004ad7a5ad tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:39.068547 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-379ca2cd-53cc-46fc-be78-4a004ad7a5ad tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:39.068966 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-379ca2cd-53cc-46fc-be78-4a004ad7a5ad tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:39.069702 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-379ca2cd-53cc-46fc-be78-4a004ad7a5ad tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:39.070152 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-379ca2cd-53cc-46fc-be78-4a004ad7a5ad tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:39.070572 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-379ca2cd-53cc-46fc-be78-4a004ad7a5ad tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:39.136584 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-379ca2cd-53cc-46fc-be78-4a004ad7a5ad tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:39.144681 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-379ca2cd-53cc-46fc-be78-4a004ad7a5ad tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/d19d848f-99bc-4f10-b837-d66aaa5258a6" status: 200 len: 1212 microversion: 2.1 time: 0.091710 Oct 30 01:15:39.145497 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 341/676] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:39 2022] GET /compute/v2.1/servers/d19d848f-99bc-4f10-b837-d66aaa5258a6 => generated 1212 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:39.247064 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-28a80868-ae71-4df2-a10a-04a71ed91393 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:39.248083 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-28a80868-ae71-4df2-a10a-04a71ed91393 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] [instance: 4f47f49f-e5a9-46d5-9622-c9c887891646] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:39.255643 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-28a80868-ae71-4df2-a10a-04a71ed91393 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:39.256296 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-28a80868-ae71-4df2-a10a-04a71ed91393 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:39.256809 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-28a80868-ae71-4df2-a10a-04a71ed91393 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:39.258045 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-28a80868-ae71-4df2-a10a-04a71ed91393 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:39.258687 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-28a80868-ae71-4df2-a10a-04a71ed91393 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:39.259288 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-28a80868-ae71-4df2-a10a-04a71ed91393 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:39.412806 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-28a80868-ae71-4df2-a10a-04a71ed91393 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ccc0bfdee94961aa198e3abf0d85cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee1e04c04bc40568e43eb98df39e7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:39.418717 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-28a80868-ae71-4df2-a10a-04a71ed91393 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] 10.222.0.13 "GET /compute/v2.1/servers/4f47f49f-e5a9-46d5-9622-c9c887891646" status: 200 len: 1475 microversion: 2.1 time: 0.176884 Oct 30 01:15:39.419282 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 336/677] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:39 2022] GET /compute/v2.1/servers/4f47f49f-e5a9-46d5-9622-c9c887891646 => generated 1475 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:39.485370 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c30dd0a8-b80d-4786-9e01-91b31cfa49e2 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:39.486348 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c30dd0a8-b80d-4786-9e01-91b31cfa49e2 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:39.493272 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c30dd0a8-b80d-4786-9e01-91b31cfa49e2 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:39.494293 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c30dd0a8-b80d-4786-9e01-91b31cfa49e2 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:39.494637 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c30dd0a8-b80d-4786-9e01-91b31cfa49e2 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:39.495341 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c30dd0a8-b80d-4786-9e01-91b31cfa49e2 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:39.495818 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c30dd0a8-b80d-4786-9e01-91b31cfa49e2 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:39.496389 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c30dd0a8-b80d-4786-9e01-91b31cfa49e2 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:39.558028 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cfa38d26-9009-4aa6-83f5-4ddc591d1d34 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:39.558654 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-cfa38d26-9009-4aa6-83f5-4ddc591d1d34 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:39.573553 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cfa38d26-9009-4aa6-83f5-4ddc591d1d34 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:39.574014 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cfa38d26-9009-4aa6-83f5-4ddc591d1d34 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:39.574504 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cfa38d26-9009-4aa6-83f5-4ddc591d1d34 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:39.576324 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cfa38d26-9009-4aa6-83f5-4ddc591d1d34 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:39.576797 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cfa38d26-9009-4aa6-83f5-4ddc591d1d34 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:39.577486 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cfa38d26-9009-4aa6-83f5-4ddc591d1d34 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:39.598537 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-c30dd0a8-b80d-4786-9e01-91b31cfa49e2 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lazy-loading 'services' on Instance uuid 2c5b301d-f84c-4395-add9-b84311fa785c {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:15:39.618558 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c30dd0a8-b80d-4786-9e01-91b31cfa49e2 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 200 len: 1933 microversion: 2.75 time: 0.136952 Oct 30 01:15:39.619662 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 342/678] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:39 2022] GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 1933 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:39.624343 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-fb8fa7cb-9626-4100-9a09-98d464bd0488 req-cfb5d995-5f16-4a20-ac3c-6bd6e617babf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f47f49f-e5a9-46d5-9622-c9c887891646", "name": "network-vif-deleted", "tag": "cd794d5d-fb9d-4c11-a17d-bf11f86e2a54"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:39.634158 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-fb8fa7cb-9626-4100-9a09-98d464bd0488 req-cfb5d995-5f16-4a20-ac3c-6bd6e617babf service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:39.634674 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-fb8fa7cb-9626-4100-9a09-98d464bd0488 req-cfb5d995-5f16-4a20-ac3c-6bd6e617babf service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:39.635072 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-fb8fa7cb-9626-4100-9a09-98d464bd0488 req-cfb5d995-5f16-4a20-ac3c-6bd6e617babf service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:39.647717 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-fb8fa7cb-9626-4100-9a09-98d464bd0488 req-cfb5d995-5f16-4a20-ac3c-6bd6e617babf service nova] Creating event network-vif-deleted:cd794d5d-fb9d-4c11-a17d-bf11f86e2a54 for instance 4f47f49f-e5a9-46d5-9622-c9c887891646 on n-h1-master-1 Oct 30 01:15:39.653520 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-fb8fa7cb-9626-4100-9a09-98d464bd0488 req-cfb5d995-5f16-4a20-ac3c-6bd6e617babf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032480 Oct 30 01:15:39.654554 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 343/679] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:15:39.716444 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9f2fc64d-8a77-492a-b4d1-b28ab357c781 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:39.717541 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9f2fc64d-8a77-492a-b4d1-b28ab357c781 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 3f60e45a-0e20-4280-be86-275d598fd552] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:39.728237 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9f2fc64d-8a77-492a-b4d1-b28ab357c781 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:39.728886 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9f2fc64d-8a77-492a-b4d1-b28ab357c781 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:39.729546 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9f2fc64d-8a77-492a-b4d1-b28ab357c781 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:39.730390 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9f2fc64d-8a77-492a-b4d1-b28ab357c781 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:39.730954 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9f2fc64d-8a77-492a-b4d1-b28ab357c781 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:39.731482 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9f2fc64d-8a77-492a-b4d1-b28ab357c781 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:39.756692 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-cfa38d26-9009-4aa6-83f5-4ddc591d1d34 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:39.765317 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cfa38d26-9009-4aa6-83f5-4ddc591d1d34 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f" status: 200 len: 1472 microversion: 2.1 time: 0.212535 Oct 30 01:15:39.766153 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 337/680] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:39 2022] GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f => generated 1472 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:15:39.872095 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9f2fc64d-8a77-492a-b4d1-b28ab357c781 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:39.885150 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9f2fc64d-8a77-492a-b4d1-b28ab357c781 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:39.886870 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9f2fc64d-8a77-492a-b4d1-b28ab357c781 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:39.888020 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9f2fc64d-8a77-492a-b4d1-b28ab357c781 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552" status: 200 len: 1361 microversion: 2.25 time: 0.176161 Oct 30 01:15:39.888576 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 344/681] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:39 2022] GET /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552 => generated 1361 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:40.103043 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6815ae88-0a2a-457e-9bf8-eafffbc5d431 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1390328380", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "b4253cc9-9396-4e97-b0c0-e8b6bb730934"}], "security_groups": [{"name": "tempest-securitygroup--1024624516"}], "key_name": "tempest-keypair-207035062", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:40.167418 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8669a6e7-a5e6-4020-999e-8946f91fb719 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:40.168322 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8669a6e7-a5e6-4020-999e-8946f91fb719 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: d19d848f-99bc-4f10-b837-d66aaa5258a6] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:40.186570 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8669a6e7-a5e6-4020-999e-8946f91fb719 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:40.187219 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8669a6e7-a5e6-4020-999e-8946f91fb719 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:40.187722 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8669a6e7-a5e6-4020-999e-8946f91fb719 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:40.188649 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8669a6e7-a5e6-4020-999e-8946f91fb719 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:40.189179 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8669a6e7-a5e6-4020-999e-8946f91fb719 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:40.189698 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8669a6e7-a5e6-4020-999e-8946f91fb719 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:40.214673 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-6815ae88-0a2a-457e-9bf8-eafffbc5d431 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] validate_networks() for [('b4253cc9-9396-4e97-b0c0-e8b6bb730934', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:15:40.279007 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8669a6e7-a5e6-4020-999e-8946f91fb719 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:40.287233 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8669a6e7-a5e6-4020-999e-8946f91fb719 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/d19d848f-99bc-4f10-b837-d66aaa5258a6" status: 200 len: 1212 microversion: 2.1 time: 0.124002 Oct 30 01:15:40.288088 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 345/682] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:40 2022] GET /compute/v2.1/servers/d19d848f-99bc-4f10-b837-d66aaa5258a6 => generated 1212 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:40.443461 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-973a4dfd-c6eb-4134-a3c6-0844ed01f3f2 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:40.444354 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-973a4dfd-c6eb-4134-a3c6-0844ed01f3f2 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] [instance: 4f47f49f-e5a9-46d5-9622-c9c887891646] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:40.462640 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-973a4dfd-c6eb-4134-a3c6-0844ed01f3f2 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:40.463044 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-973a4dfd-c6eb-4134-a3c6-0844ed01f3f2 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:40.463484 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-973a4dfd-c6eb-4134-a3c6-0844ed01f3f2 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:40.464187 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-973a4dfd-c6eb-4134-a3c6-0844ed01f3f2 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:40.464640 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-973a4dfd-c6eb-4134-a3c6-0844ed01f3f2 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:40.470835 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-973a4dfd-c6eb-4134-a3c6-0844ed01f3f2 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:40.571352 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-973a4dfd-c6eb-4134-a3c6-0844ed01f3f2 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ccc0bfdee94961aa198e3abf0d85cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee1e04c04bc40568e43eb98df39e7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:40.579537 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-973a4dfd-c6eb-4134-a3c6-0844ed01f3f2 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] 10.222.0.13 "GET /compute/v2.1/servers/4f47f49f-e5a9-46d5-9622-c9c887891646" status: 200 len: 1305 microversion: 2.1 time: 0.140697 Oct 30 01:15:40.580134 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 346/683] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:40 2022] GET /compute/v2.1/servers/4f47f49f-e5a9-46d5-9622-c9c887891646 => generated 1305 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:15:40.734867 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-6815ae88-0a2a-457e-9bf8-eafffbc5d431 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:15:40.735437 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-6815ae88-0a2a-457e-9bf8-eafffbc5d431 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:15:40.735778 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-6815ae88-0a2a-457e-9bf8-eafffbc5d431 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:15:40.736525 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-6815ae88-0a2a-457e-9bf8-eafffbc5d431 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:15:40.737004 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-6815ae88-0a2a-457e-9bf8-eafffbc5d431 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:15:40.742010 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b678b327-b367-46de-aab1-b0ca1cee0ed0 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-2087785523", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:40.746917 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6815ae88-0a2a-457e-9bf8-eafffbc5d431 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:40.747395 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6815ae88-0a2a-457e-9bf8-eafffbc5d431 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:40.747833 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6815ae88-0a2a-457e-9bf8-eafffbc5d431 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:40.748565 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6815ae88-0a2a-457e-9bf8-eafffbc5d431 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:40.749797 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6815ae88-0a2a-457e-9bf8-eafffbc5d431 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:40.750237 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6815ae88-0a2a-457e-9bf8-eafffbc5d431 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:40.768572 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-6815ae88-0a2a-457e-9bf8-eafffbc5d431 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Getting quotas for project 283e7fd477334b879db6b49ee5cc509f. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:15:40.774176 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-6815ae88-0a2a-457e-9bf8-eafffbc5d431 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Getting quotas for user c7334417689847d18bc4c1b27d173a23 and project 283e7fd477334b879db6b49ee5cc509f. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:15:40.787571 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6815ae88-0a2a-457e-9bf8-eafffbc5d431 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:15:40.790062 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6815ae88-0a2a-457e-9bf8-eafffbc5d431 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:15:40.797000 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-b678b327-b367-46de-aab1-b0ca1cee0ed0 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] validate_networks() for None {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:15:40.929026 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6815ae88-0a2a-457e-9bf8-eafffbc5d431 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.829753 Oct 30 01:15:40.930003 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 338/684] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:15:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:15:40.934883 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0a68aacb-bf56-4025-af85-a2c3ba4c3213 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:40.935489 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0a68aacb-bf56-4025-af85-a2c3ba4c3213 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:40.942575 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0a68aacb-bf56-4025-af85-a2c3ba4c3213 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:40.943299 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0a68aacb-bf56-4025-af85-a2c3ba4c3213 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:40.944867 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0a68aacb-bf56-4025-af85-a2c3ba4c3213 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:40.945443 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0a68aacb-bf56-4025-af85-a2c3ba4c3213 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:40.946123 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0a68aacb-bf56-4025-af85-a2c3ba4c3213 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:40.946573 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0a68aacb-bf56-4025-af85-a2c3ba4c3213 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:41.021316 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-b678b327-b367-46de-aab1-b0ca1cee0ed0 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:15:41.022093 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-b678b327-b367-46de-aab1-b0ca1cee0ed0 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:15:41.022688 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-b678b327-b367-46de-aab1-b0ca1cee0ed0 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:15:41.023166 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-b678b327-b367-46de-aab1-b0ca1cee0ed0 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:15:41.023706 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-b678b327-b367-46de-aab1-b0ca1cee0ed0 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:15:41.034153 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b678b327-b367-46de-aab1-b0ca1cee0ed0 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:41.034729 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b678b327-b367-46de-aab1-b0ca1cee0ed0 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:41.035769 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b678b327-b367-46de-aab1-b0ca1cee0ed0 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:41.036998 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b678b327-b367-46de-aab1-b0ca1cee0ed0 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:41.037735 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b678b327-b367-46de-aab1-b0ca1cee0ed0 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:41.038363 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b678b327-b367-46de-aab1-b0ca1cee0ed0 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:41.051318 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:41.056875 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-0a68aacb-bf56-4025-af85-a2c3ba4c3213 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lazy-loading 'services' on Instance uuid 2c5b301d-f84c-4395-add9-b84311fa785c {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:15:41.059681 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-b678b327-b367-46de-aab1-b0ca1cee0ed0 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Getting quotas for project c653b9bf1e064528b2ffe8c9b57fa48d. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:15:41.064929 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-b678b327-b367-46de-aab1-b0ca1cee0ed0 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Getting quotas for user 9e6512cfbbbf412cbc4c40b80669b637 and project c653b9bf1e064528b2ffe8c9b57fa48d. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:15:41.077871 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b678b327-b367-46de-aab1-b0ca1cee0ed0 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:15:41.080218 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b678b327-b367-46de-aab1-b0ca1cee0ed0 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] [instance: 60ecf54f-3d14-4927-9d7a-5a26778cad70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:15:41.085247 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0a68aacb-bf56-4025-af85-a2c3ba4c3213 tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 200 len: 1933 microversion: 2.75 time: 0.152013 Oct 30 01:15:41.085247 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 339/685] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:40 2022] GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 1933 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:41.089328 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e631ce55-2703-4852-9676-c332c771de42 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:41.090683 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e631ce55-2703-4852-9676-c332c771de42 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:41.101191 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e631ce55-2703-4852-9676-c332c771de42 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:41.101710 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e631ce55-2703-4852-9676-c332c771de42 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:41.102314 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e631ce55-2703-4852-9676-c332c771de42 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:41.103150 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e631ce55-2703-4852-9676-c332c771de42 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:41.103643 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e631ce55-2703-4852-9676-c332c771de42 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:41.104047 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e631ce55-2703-4852-9676-c332c771de42 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:41.241773 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e631ce55-2703-4852-9676-c332c771de42 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:41.249942 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e631ce55-2703-4852-9676-c332c771de42 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f" status: 200 len: 1472 microversion: 2.1 time: 0.165505 Oct 30 01:15:41.250514 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 340/686] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:41 2022] GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f => generated 1472 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:41.255039 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9f9534fc-2eef-495b-8548-08d70fb79187 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:41.255752 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9f9534fc-2eef-495b-8548-08d70fb79187 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 3f60e45a-0e20-4280-be86-275d598fd552] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:41.262189 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9f9534fc-2eef-495b-8548-08d70fb79187 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:41.262636 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9f9534fc-2eef-495b-8548-08d70fb79187 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:41.263065 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9f9534fc-2eef-495b-8548-08d70fb79187 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:41.263750 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9f9534fc-2eef-495b-8548-08d70fb79187 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:41.264202 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9f9534fc-2eef-495b-8548-08d70fb79187 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:41.264748 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9f9534fc-2eef-495b-8548-08d70fb79187 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:41.280555 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b678b327-b367-46de-aab1-b0ca1cee0ed0 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.699156 Oct 30 01:15:41.281413 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 347/687] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:15:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:15:41.286853 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-09e196cc-9e1b-4736-b7c9-58ec98f3646f tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:41.287698 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-09e196cc-9e1b-4736-b7c9-58ec98f3646f tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:41.374695 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-09e196cc-9e1b-4736-b7c9-58ec98f3646f tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:41.382657 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-09e196cc-9e1b-4736-b7c9-58ec98f3646f tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd" status: 200 len: 1234 microversion: 2.1 time: 0.100161 Oct 30 01:15:41.383315 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 348/688] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:41 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd => generated 1234 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:41.389847 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fa9c9ed0-d23d-4046-adda-2695b24d4208 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:41.390527 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fa9c9ed0-d23d-4046-adda-2695b24d4208 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] [instance: 60ecf54f-3d14-4927-9d7a-5a26778cad70] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:41.453812 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-fa9c9ed0-d23d-4046-adda-2695b24d4208 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e6512cfbbbf412cbc4c40b80669b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c653b9bf1e064528b2ffe8c9b57fa48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:41.465752 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fa9c9ed0-d23d-4046-adda-2695b24d4208 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] 10.222.0.13 "GET /compute/v2.1/servers/60ecf54f-3d14-4927-9d7a-5a26778cad70" status: 200 len: 1223 microversion: 2.1 time: 0.081290 Oct 30 01:15:41.466551 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 349/689] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:41 2022] GET /compute/v2.1/servers/60ecf54f-3d14-4927-9d7a-5a26778cad70 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:41.471071 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9f9534fc-2eef-495b-8548-08d70fb79187 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:41.471240 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cf827b87-e59e-431a-88cc-731244e3bfa1 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:41.471936 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cf827b87-e59e-431a-88cc-731244e3bfa1 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: d19d848f-99bc-4f10-b837-d66aaa5258a6] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:41.479799 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cf827b87-e59e-431a-88cc-731244e3bfa1 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:41.480007 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cf827b87-e59e-431a-88cc-731244e3bfa1 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:41.480430 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cf827b87-e59e-431a-88cc-731244e3bfa1 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:41.481135 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cf827b87-e59e-431a-88cc-731244e3bfa1 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:41.481793 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cf827b87-e59e-431a-88cc-731244e3bfa1 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:41.482409 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cf827b87-e59e-431a-88cc-731244e3bfa1 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:41.484176 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9f9534fc-2eef-495b-8548-08d70fb79187 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:41.486217 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9f9534fc-2eef-495b-8548-08d70fb79187 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:41.487832 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9f9534fc-2eef-495b-8548-08d70fb79187 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552" status: 200 len: 1556 microversion: 2.25 time: 0.236258 Oct 30 01:15:41.490647 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 341/690] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:41 2022] GET /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552 => generated 1556 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:41.516114 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b99faf39-3e84-487f-a3d8-a82b969ca508 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:41.516866 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b99faf39-3e84-487f-a3d8-a82b969ca508 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] [instance: 3f60e45a-0e20-4280-be86-275d598fd552] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:41.523723 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b99faf39-3e84-487f-a3d8-a82b969ca508 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:41.524848 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b99faf39-3e84-487f-a3d8-a82b969ca508 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:41.525474 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b99faf39-3e84-487f-a3d8-a82b969ca508 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:41.526283 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b99faf39-3e84-487f-a3d8-a82b969ca508 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:41.527413 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b99faf39-3e84-487f-a3d8-a82b969ca508 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:41.527861 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b99faf39-3e84-487f-a3d8-a82b969ca508 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:41.558176 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-cf827b87-e59e-431a-88cc-731244e3bfa1 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:41.567751 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cf827b87-e59e-431a-88cc-731244e3bfa1 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/d19d848f-99bc-4f10-b837-d66aaa5258a6" status: 200 len: 1212 microversion: 2.1 time: 0.100223 Oct 30 01:15:41.568572 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 350/691] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:41 2022] GET /compute/v2.1/servers/d19d848f-99bc-4f10-b837-d66aaa5258a6 => generated 1212 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:41.602456 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cfdd2c3d-5821-4fbd-ada0-a2802b577da9 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:41.603403 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cfdd2c3d-5821-4fbd-ada0-a2802b577da9 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] [instance: 4f47f49f-e5a9-46d5-9622-c9c887891646] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:41.610226 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cfdd2c3d-5821-4fbd-ada0-a2802b577da9 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:41.610726 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cfdd2c3d-5821-4fbd-ada0-a2802b577da9 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:41.611169 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cfdd2c3d-5821-4fbd-ada0-a2802b577da9 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:41.612099 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cfdd2c3d-5821-4fbd-ada0-a2802b577da9 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:41.612726 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cfdd2c3d-5821-4fbd-ada0-a2802b577da9 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:41.613247 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cfdd2c3d-5821-4fbd-ada0-a2802b577da9 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:41.648362 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cfdd2c3d-5821-4fbd-ada0-a2802b577da9 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:41.649007 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cfdd2c3d-5821-4fbd-ada0-a2802b577da9 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:41.649970 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cfdd2c3d-5821-4fbd-ada0-a2802b577da9 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:41.650438 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-cfdd2c3d-5821-4fbd-ada0-a2802b577da9 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lazy-loading 'fault' on Instance uuid 4f47f49f-e5a9-46d5-9622-c9c887891646 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:15:41.669411 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:41.675271 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-b99faf39-3e84-487f-a3d8-a82b969ca508 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lazy-loading 'services' on Instance uuid 3f60e45a-0e20-4280-be86-275d598fd552 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:15:41.689872 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b99faf39-3e84-487f-a3d8-a82b969ca508 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552" status: 200 len: 2048 microversion: 2.25 time: 0.178047 Oct 30 01:15:41.690453 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 342/692] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:41 2022] GET /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552 => generated 2048 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:15:41.695029 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-cfdd2c3d-5821-4fbd-ada0-a2802b577da9 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ccc0bfdee94961aa198e3abf0d85cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee1e04c04bc40568e43eb98df39e7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:41.702759 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cfdd2c3d-5821-4fbd-ada0-a2802b577da9 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] 10.222.0.13 "GET /compute/v2.1/servers/4f47f49f-e5a9-46d5-9622-c9c887891646" status: 200 len: 1310 microversion: 2.1 time: 0.104304 Oct 30 01:15:41.703325 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 351/693] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:41 2022] GET /compute/v2.1/servers/4f47f49f-e5a9-46d5-9622-c9c887891646 => generated 1310 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:15:41.715783 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d3db20b4-9f6f-4cc6-808f-c336bc82de15 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:41.716400 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d3db20b4-9f6f-4cc6-808f-c336bc82de15 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] [instance: 3f60e45a-0e20-4280-be86-275d598fd552] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:41.722774 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d3db20b4-9f6f-4cc6-808f-c336bc82de15 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:41.723256 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d3db20b4-9f6f-4cc6-808f-c336bc82de15 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:41.727067 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d3db20b4-9f6f-4cc6-808f-c336bc82de15 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:41.727067 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d3db20b4-9f6f-4cc6-808f-c336bc82de15 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:41.727067 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d3db20b4-9f6f-4cc6-808f-c336bc82de15 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:41.727342 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d3db20b4-9f6f-4cc6-808f-c336bc82de15 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:41.858028 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-d3db20b4-9f6f-4cc6-808f-c336bc82de15 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lazy-loading 'services' on Instance uuid 3f60e45a-0e20-4280-be86-275d598fd552 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:15:41.877776 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d3db20b4-9f6f-4cc6-808f-c336bc82de15 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552" status: 200 len: 2048 microversion: 2.25 time: 0.165990 Oct 30 01:15:41.878564 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 343/694] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:41 2022] GET /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552 => generated 2048 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:41.904090 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8fd57520-ac03-4ee7-979d-fce27f710c10 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:41.908112 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8fd57520-ac03-4ee7-979d-fce27f710c10 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:41.912008 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8fd57520-ac03-4ee7-979d-fce27f710c10 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:41.912575 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8fd57520-ac03-4ee7-979d-fce27f710c10 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:41.914701 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8fd57520-ac03-4ee7-979d-fce27f710c10 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:41.915236 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8fd57520-ac03-4ee7-979d-fce27f710c10 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:41.915748 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8fd57520-ac03-4ee7-979d-fce27f710c10 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:41.940582 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8fd57520-ac03-4ee7-979d-fce27f710c10 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.040835 Oct 30 01:15:41.941767 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 352/695] 10.222.0.13 () {60 vars in 1217 bytes} [Sun Oct 30 01:15:41 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:15:41.954271 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b1dcbaf2-6de0-4c1c-be88-b4ef11772acf tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:41.955960 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b1dcbaf2-6de0-4c1c-be88-b4ef11772acf tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] [instance: 3f60e45a-0e20-4280-be86-275d598fd552] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:41.960738 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1dcbaf2-6de0-4c1c-be88-b4ef11772acf tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:41.961218 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1dcbaf2-6de0-4c1c-be88-b4ef11772acf tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:41.961683 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1dcbaf2-6de0-4c1c-be88-b4ef11772acf tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:41.962440 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1dcbaf2-6de0-4c1c-be88-b4ef11772acf tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:41.962896 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1dcbaf2-6de0-4c1c-be88-b4ef11772acf tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:41.963315 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1dcbaf2-6de0-4c1c-be88-b4ef11772acf tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:42.112063 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-94788c2a-62a5-4842-a3aa-5c85b643f7ce tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:42.112770 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-94788c2a-62a5-4842-a3aa-5c85b643f7ce tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:42.119601 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-94788c2a-62a5-4842-a3aa-5c85b643f7ce tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:42.120087 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-94788c2a-62a5-4842-a3aa-5c85b643f7ce tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:42.120528 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-94788c2a-62a5-4842-a3aa-5c85b643f7ce tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:42.121228 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-94788c2a-62a5-4842-a3aa-5c85b643f7ce tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:42.122310 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-94788c2a-62a5-4842-a3aa-5c85b643f7ce tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:42.122310 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-94788c2a-62a5-4842-a3aa-5c85b643f7ce tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:42.199162 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-94788c2a-62a5-4842-a3aa-5c85b643f7ce tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] Lazy-loading 'services' on Instance uuid 2c5b301d-f84c-4395-add9-b84311fa785c {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:15:42.207744 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b1dcbaf2-6de0-4c1c-be88-b4ef11772acf tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552/action" status: 202 len: 0 microversion: 2.25 time: 0.256914 Oct 30 01:15:42.212515 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 344/696] 10.222.0.13 () {62 vars in 1319 bytes} [Sun Oct 30 01:15:41 2022] POST /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:15:42.218931 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f5ed060d-f772-44ca-b345-7cc2fccf2a19 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:42.219631 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f5ed060d-f772-44ca-b345-7cc2fccf2a19 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] [instance: 3f60e45a-0e20-4280-be86-275d598fd552] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:42.227260 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f5ed060d-f772-44ca-b345-7cc2fccf2a19 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:42.227787 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f5ed060d-f772-44ca-b345-7cc2fccf2a19 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:42.228227 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f5ed060d-f772-44ca-b345-7cc2fccf2a19 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:42.228996 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f5ed060d-f772-44ca-b345-7cc2fccf2a19 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:42.229641 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f5ed060d-f772-44ca-b345-7cc2fccf2a19 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:42.230258 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f5ed060d-f772-44ca-b345-7cc2fccf2a19 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:42.232683 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-94788c2a-62a5-4842-a3aa-5c85b643f7ce tempest-ServersAdmin275Test-552821409 tempest-ServersAdmin275Test-552821409-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 200 len: 1918 microversion: 2.75 time: 0.124356 Oct 30 01:15:42.233255 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 353/697] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:42 2022] GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 1918 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:15:42.273379 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-224292be-a8cd-47d6-ac3d-26307c11cb0d tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:42.273964 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-224292be-a8cd-47d6-ac3d-26307c11cb0d tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:42.299448 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-224292be-a8cd-47d6-ac3d-26307c11cb0d tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:42.301676 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-224292be-a8cd-47d6-ac3d-26307c11cb0d tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:42.302298 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-224292be-a8cd-47d6-ac3d-26307c11cb0d tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:42.303236 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-224292be-a8cd-47d6-ac3d-26307c11cb0d tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:42.305273 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-224292be-a8cd-47d6-ac3d-26307c11cb0d tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:42.306011 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-224292be-a8cd-47d6-ac3d-26307c11cb0d tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:42.340849 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-224292be-a8cd-47d6-ac3d-26307c11cb0d tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:15:42.402006 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-f5ed060d-f772-44ca-b345-7cc2fccf2a19 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lazy-loading 'services' on Instance uuid 3f60e45a-0e20-4280-be86-275d598fd552 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:15:42.415402 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f5ed060d-f772-44ca-b345-7cc2fccf2a19 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552" status: 200 len: 2053 microversion: 2.25 time: 0.201330 Oct 30 01:15:42.415991 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 345/698] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:42 2022] GET /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552 => generated 2053 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:42.420938 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6d855736-3731-460c-aa9d-86aeba77ecd4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:42.421582 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6d855736-3731-460c-aa9d-86aeba77ecd4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:42.428168 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6d855736-3731-460c-aa9d-86aeba77ecd4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:42.428759 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6d855736-3731-460c-aa9d-86aeba77ecd4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:42.429240 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6d855736-3731-460c-aa9d-86aeba77ecd4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:42.430007 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6d855736-3731-460c-aa9d-86aeba77ecd4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:42.430535 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6d855736-3731-460c-aa9d-86aeba77ecd4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:42.431029 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6d855736-3731-460c-aa9d-86aeba77ecd4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:42.572328 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6d855736-3731-460c-aa9d-86aeba77ecd4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:42.581687 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6d855736-3731-460c-aa9d-86aeba77ecd4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f" status: 200 len: 1472 microversion: 2.1 time: 0.164609 Oct 30 01:15:42.582492 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 346/699] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:42 2022] GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f => generated 1472 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:42.587724 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-beb1c4e2-32a7-4637-a4f4-86ed49bef85d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:42.588331 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-beb1c4e2-32a7-4637-a4f4-86ed49bef85d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:42.594388 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-beb1c4e2-32a7-4637-a4f4-86ed49bef85d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:42.595041 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-beb1c4e2-32a7-4637-a4f4-86ed49bef85d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:42.595477 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-beb1c4e2-32a7-4637-a4f4-86ed49bef85d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:42.596171 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-beb1c4e2-32a7-4637-a4f4-86ed49bef85d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:42.596617 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-beb1c4e2-32a7-4637-a4f4-86ed49bef85d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:42.597034 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-beb1c4e2-32a7-4637-a4f4-86ed49bef85d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:42.662859 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-224292be-a8cd-47d6-ac3d-26307c11cb0d tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 204 len: 0 microversion: 2.75 time: 0.394956 Oct 30 01:15:42.666540 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 354/700] 10.222.0.13 () {60 vars in 1280 bytes} [Sun Oct 30 01:15:42 2022] DELETE /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 30 01:15:42.666719 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-beb1c4e2-32a7-4637-a4f4-86ed49bef85d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:42.669617 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e221f7fc-d56f-40c4-bb1b-8ea6b0a80ca3 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:42.670310 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e221f7fc-d56f-40c4-bb1b-8ea6b0a80ca3 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] [instance: 60ecf54f-3d14-4927-9d7a-5a26778cad70] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:42.673403 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-beb1c4e2-32a7-4637-a4f4-86ed49bef85d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd" status: 200 len: 1230 microversion: 2.1 time: 0.089707 Oct 30 01:15:42.673985 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 347/701] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:42 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd => generated 1230 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:42.676271 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e221f7fc-d56f-40c4-bb1b-8ea6b0a80ca3 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:42.676760 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e221f7fc-d56f-40c4-bb1b-8ea6b0a80ca3 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:42.677186 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e221f7fc-d56f-40c4-bb1b-8ea6b0a80ca3 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:42.677912 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e221f7fc-d56f-40c4-bb1b-8ea6b0a80ca3 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:42.678361 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e221f7fc-d56f-40c4-bb1b-8ea6b0a80ca3 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:42.678780 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e221f7fc-d56f-40c4-bb1b-8ea6b0a80ca3 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:42.679297 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-537af89b-23e8-4cc9-b082-adc4016dff19 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:42.679916 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-537af89b-23e8-4cc9-b082-adc4016dff19 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: d19d848f-99bc-4f10-b837-d66aaa5258a6] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:42.686191 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-537af89b-23e8-4cc9-b082-adc4016dff19 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:42.686683 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-537af89b-23e8-4cc9-b082-adc4016dff19 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:42.687124 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-537af89b-23e8-4cc9-b082-adc4016dff19 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:42.687825 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-537af89b-23e8-4cc9-b082-adc4016dff19 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:42.688553 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-537af89b-23e8-4cc9-b082-adc4016dff19 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:42.688983 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-537af89b-23e8-4cc9-b082-adc4016dff19 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:42.753052 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e221f7fc-d56f-40c4-bb1b-8ea6b0a80ca3 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e6512cfbbbf412cbc4c40b80669b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c653b9bf1e064528b2ffe8c9b57fa48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:42.760894 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e221f7fc-d56f-40c4-bb1b-8ea6b0a80ca3 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] 10.222.0.13 "GET /compute/v2.1/servers/60ecf54f-3d14-4927-9d7a-5a26778cad70" status: 200 len: 1227 microversion: 2.1 time: 0.096231 Oct 30 01:15:42.761495 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 355/702] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:42 2022] GET /compute/v2.1/servers/60ecf54f-3d14-4927-9d7a-5a26778cad70 => generated 1227 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:42.765982 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fbfebc36-a70d-4bc4-8acb-08bb638f8a48 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:42.766594 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fbfebc36-a70d-4bc4-8acb-08bb638f8a48 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:42.770096 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-537af89b-23e8-4cc9-b082-adc4016dff19 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:42.770250 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:42.774700 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fbfebc36-a70d-4bc4-8acb-08bb638f8a48 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:42.779311 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fbfebc36-a70d-4bc4-8acb-08bb638f8a48 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:42.779311 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fbfebc36-a70d-4bc4-8acb-08bb638f8a48 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:42.779311 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fbfebc36-a70d-4bc4-8acb-08bb638f8a48 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:42.779311 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fbfebc36-a70d-4bc4-8acb-08bb638f8a48 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:42.779625 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fbfebc36-a70d-4bc4-8acb-08bb638f8a48 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:42.779699 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-537af89b-23e8-4cc9-b082-adc4016dff19 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/d19d848f-99bc-4f10-b837-d66aaa5258a6" status: 200 len: 1268 microversion: 2.1 time: 0.103631 Oct 30 01:15:42.779699 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 348/703] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:42 2022] GET /compute/v2.1/servers/d19d848f-99bc-4f10-b837-d66aaa5258a6 => generated 1268 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:42.793365 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e9f9e2a4-fe24-4c79-b9f5-fd64a010fc6f tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:42.794015 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e9f9e2a4-fe24-4c79-b9f5-fd64a010fc6f tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] [instance: 4f47f49f-e5a9-46d5-9622-c9c887891646] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:42.800181 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e9f9e2a4-fe24-4c79-b9f5-fd64a010fc6f tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:42.800706 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e9f9e2a4-fe24-4c79-b9f5-fd64a010fc6f tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:42.801129 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e9f9e2a4-fe24-4c79-b9f5-fd64a010fc6f tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:42.801858 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e9f9e2a4-fe24-4c79-b9f5-fd64a010fc6f tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:42.802305 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e9f9e2a4-fe24-4c79-b9f5-fd64a010fc6f tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:42.802735 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e9f9e2a4-fe24-4c79-b9f5-fd64a010fc6f tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:42.840368 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e9f9e2a4-fe24-4c79-b9f5-fd64a010fc6f tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:42.840860 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e9f9e2a4-fe24-4c79-b9f5-fd64a010fc6f tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:42.841292 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e9f9e2a4-fe24-4c79-b9f5-fd64a010fc6f tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:42.841758 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-e9f9e2a4-fe24-4c79-b9f5-fd64a010fc6f tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lazy-loading 'fault' on Instance uuid 4f47f49f-e5a9-46d5-9622-c9c887891646 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:15:42.849988 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-fbfebc36-a70d-4bc4-8acb-08bb638f8a48 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:42.859540 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-fbfebc36-a70d-4bc4-8acb-08bb638f8a48 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:42.865505 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-fbfebc36-a70d-4bc4-8acb-08bb638f8a48 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:42.866268 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fbfebc36-a70d-4bc4-8acb-08bb638f8a48 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] 10.222.0.13 "GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 200 len: 1443 microversion: 2.75 time: 0.103781 Oct 30 01:15:42.866845 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 356/704] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:42 2022] GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 1443 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:42.884961 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e9f9e2a4-fe24-4c79-b9f5-fd64a010fc6f tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ccc0bfdee94961aa198e3abf0d85cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee1e04c04bc40568e43eb98df39e7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:42.898271 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e9f9e2a4-fe24-4c79-b9f5-fd64a010fc6f tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] 10.222.0.13 "GET /compute/v2.1/servers/4f47f49f-e5a9-46d5-9622-c9c887891646" status: 200 len: 1310 microversion: 2.1 time: 0.108935 Oct 30 01:15:42.899402 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 349/705] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:42 2022] GET /compute/v2.1/servers/4f47f49f-e5a9-46d5-9622-c9c887891646 => generated 1310 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:43.442313 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-782c77fd-6171-4549-b800-e2a19653d5ae tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:43.443030 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-782c77fd-6171-4549-b800-e2a19653d5ae tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] [instance: 3f60e45a-0e20-4280-be86-275d598fd552] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:43.450356 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-782c77fd-6171-4549-b800-e2a19653d5ae tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:43.450841 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-782c77fd-6171-4549-b800-e2a19653d5ae tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:43.451279 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-782c77fd-6171-4549-b800-e2a19653d5ae tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:43.451983 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-782c77fd-6171-4549-b800-e2a19653d5ae tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:43.452440 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-782c77fd-6171-4549-b800-e2a19653d5ae tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:43.456189 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-782c77fd-6171-4549-b800-e2a19653d5ae tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:43.582188 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-782c77fd-6171-4549-b800-e2a19653d5ae tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lazy-loading 'services' on Instance uuid 3f60e45a-0e20-4280-be86-275d598fd552 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:15:43.595163 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-782c77fd-6171-4549-b800-e2a19653d5ae tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552" status: 200 len: 2033 microversion: 2.25 time: 0.157222 Oct 30 01:15:43.595762 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 357/706] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:43 2022] GET /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552 => generated 2033 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:43.605918 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-dcce6013-1b96-4149-932b-c296084399d5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:43.606570 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-dcce6013-1b96-4149-932b-c296084399d5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:43.614146 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dcce6013-1b96-4149-932b-c296084399d5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:43.614622 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dcce6013-1b96-4149-932b-c296084399d5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:43.615053 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dcce6013-1b96-4149-932b-c296084399d5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:43.615734 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dcce6013-1b96-4149-932b-c296084399d5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:43.616194 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dcce6013-1b96-4149-932b-c296084399d5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:43.616601 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dcce6013-1b96-4149-932b-c296084399d5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:43.620984 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4ce72d45-e258-4522-92e1-04c8fd6a40a4 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": "auto"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:43.623576 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4ce72d45-e258-4522-92e1-04c8fd6a40a4 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] [instance: 3f60e45a-0e20-4280-be86-275d598fd552] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:43.630095 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4ce72d45-e258-4522-92e1-04c8fd6a40a4 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:43.633973 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4ce72d45-e258-4522-92e1-04c8fd6a40a4 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:43.633973 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4ce72d45-e258-4522-92e1-04c8fd6a40a4 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:43.633973 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4ce72d45-e258-4522-92e1-04c8fd6a40a4 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:43.634300 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4ce72d45-e258-4522-92e1-04c8fd6a40a4 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:43.634300 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4ce72d45-e258-4522-92e1-04c8fd6a40a4 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:43.658213 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-4ce72d45-e258-4522-92e1-04c8fd6a40a4 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lazy-loading 'flavor' on Instance uuid 3f60e45a-0e20-4280-be86-275d598fd552 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:15:43.670519 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4ce72d45-e258-4522-92e1-04c8fd6a40a4 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] [instance: 3f60e45a-0e20-4280-be86-275d598fd552] Going to try to live migrate instance to n-h2-master-1 {{(pid=121102) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 30 01:15:43.749565 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-dcce6013-1b96-4149-932b-c296084399d5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:43.757305 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-dcce6013-1b96-4149-932b-c296084399d5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f" status: 200 len: 1472 microversion: 2.1 time: 0.155400 Oct 30 01:15:43.757894 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 350/707] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:43 2022] GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f => generated 1472 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:43.762846 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c66c1bcf-356a-4bc2-9272-f7e464ff8e9d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:43.768191 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c66c1bcf-356a-4bc2-9272-f7e464ff8e9d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:43.769625 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c66c1bcf-356a-4bc2-9272-f7e464ff8e9d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:43.770215 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c66c1bcf-356a-4bc2-9272-f7e464ff8e9d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:43.770744 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c66c1bcf-356a-4bc2-9272-f7e464ff8e9d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:43.771535 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c66c1bcf-356a-4bc2-9272-f7e464ff8e9d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:43.772098 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c66c1bcf-356a-4bc2-9272-f7e464ff8e9d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:43.772609 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c66c1bcf-356a-4bc2-9272-f7e464ff8e9d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:43.838795 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c66c1bcf-356a-4bc2-9272-f7e464ff8e9d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:43.846435 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c66c1bcf-356a-4bc2-9272-f7e464ff8e9d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd" status: 200 len: 1230 microversion: 2.1 time: 0.087592 Oct 30 01:15:43.846993 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 351/708] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:43 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd => generated 1230 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:43.852154 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-de5bf5d4-1fa3-42bf-a9a7-1a32971cc9ea tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:43.852763 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-de5bf5d4-1fa3-42bf-a9a7-1a32971cc9ea tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] [instance: 60ecf54f-3d14-4927-9d7a-5a26778cad70] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:43.858486 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de5bf5d4-1fa3-42bf-a9a7-1a32971cc9ea tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:43.858965 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de5bf5d4-1fa3-42bf-a9a7-1a32971cc9ea tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:43.860122 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de5bf5d4-1fa3-42bf-a9a7-1a32971cc9ea tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:43.860122 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de5bf5d4-1fa3-42bf-a9a7-1a32971cc9ea tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:43.860617 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de5bf5d4-1fa3-42bf-a9a7-1a32971cc9ea tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:43.861227 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de5bf5d4-1fa3-42bf-a9a7-1a32971cc9ea tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:43.923859 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-de5bf5d4-1fa3-42bf-a9a7-1a32971cc9ea tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e6512cfbbbf412cbc4c40b80669b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c653b9bf1e064528b2ffe8c9b57fa48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:43.934271 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-de5bf5d4-1fa3-42bf-a9a7-1a32971cc9ea tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] 10.222.0.13 "GET /compute/v2.1/servers/60ecf54f-3d14-4927-9d7a-5a26778cad70" status: 200 len: 1219 microversion: 2.1 time: 0.085737 Oct 30 01:15:43.935126 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 352/709] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:43 2022] GET /compute/v2.1/servers/60ecf54f-3d14-4927-9d7a-5a26778cad70 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:43.940254 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e0a9d2c9-b8ab-479e-99ea-d21cccd6db10 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:43.940859 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e0a9d2c9-b8ab-479e-99ea-d21cccd6db10 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: d19d848f-99bc-4f10-b837-d66aaa5258a6] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:43.949164 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e0a9d2c9-b8ab-479e-99ea-d21cccd6db10 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:43.949164 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e0a9d2c9-b8ab-479e-99ea-d21cccd6db10 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:43.949164 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e0a9d2c9-b8ab-479e-99ea-d21cccd6db10 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:43.949522 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e0a9d2c9-b8ab-479e-99ea-d21cccd6db10 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:43.949957 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e0a9d2c9-b8ab-479e-99ea-d21cccd6db10 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:43.950378 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e0a9d2c9-b8ab-479e-99ea-d21cccd6db10 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:44.013746 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e0a9d2c9-b8ab-479e-99ea-d21cccd6db10 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:44.021575 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e0a9d2c9-b8ab-479e-99ea-d21cccd6db10 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/d19d848f-99bc-4f10-b837-d66aaa5258a6" status: 200 len: 1276 microversion: 2.1 time: 0.085402 Oct 30 01:15:44.022142 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 353/710] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:43 2022] GET /compute/v2.1/servers/d19d848f-99bc-4f10-b837-d66aaa5258a6 => generated 1276 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:44.026657 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3a94c6de-7f23-48c2-9187-bd7b9d2a9091 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:44.027257 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3a94c6de-7f23-48c2-9187-bd7b9d2a9091 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:44.033044 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3a94c6de-7f23-48c2-9187-bd7b9d2a9091 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:44.033554 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3a94c6de-7f23-48c2-9187-bd7b9d2a9091 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:44.033985 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3a94c6de-7f23-48c2-9187-bd7b9d2a9091 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:44.034671 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3a94c6de-7f23-48c2-9187-bd7b9d2a9091 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:44.035644 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3a94c6de-7f23-48c2-9187-bd7b9d2a9091 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:44.036062 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3a94c6de-7f23-48c2-9187-bd7b9d2a9091 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:44.106672 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3a94c6de-7f23-48c2-9187-bd7b9d2a9091 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:44.117634 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3a94c6de-7f23-48c2-9187-bd7b9d2a9091 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:44.119370 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3a94c6de-7f23-48c2-9187-bd7b9d2a9091 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:44.124723 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3a94c6de-7f23-48c2-9187-bd7b9d2a9091 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] 10.222.0.13 "GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 200 len: 1443 microversion: 2.75 time: 0.101599 Oct 30 01:15:44.137711 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 354/711] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:44 2022] GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 1443 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:44.137711 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b0ea0629-2dce-4d6e-9f4b-5bcc9d5103ec tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:44.137711 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b0ea0629-2dce-4d6e-9f4b-5bcc9d5103ec tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] [instance: 4f47f49f-e5a9-46d5-9622-c9c887891646] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:44.138534 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b0ea0629-2dce-4d6e-9f4b-5bcc9d5103ec tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:44.138779 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b0ea0629-2dce-4d6e-9f4b-5bcc9d5103ec tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:44.139221 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b0ea0629-2dce-4d6e-9f4b-5bcc9d5103ec tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:44.139958 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b0ea0629-2dce-4d6e-9f4b-5bcc9d5103ec tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:44.140510 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b0ea0629-2dce-4d6e-9f4b-5bcc9d5103ec tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:44.140935 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b0ea0629-2dce-4d6e-9f4b-5bcc9d5103ec tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:44.177665 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b0ea0629-2dce-4d6e-9f4b-5bcc9d5103ec tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:44.178153 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b0ea0629-2dce-4d6e-9f4b-5bcc9d5103ec tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:44.178582 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b0ea0629-2dce-4d6e-9f4b-5bcc9d5103ec tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:44.179217 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-b0ea0629-2dce-4d6e-9f4b-5bcc9d5103ec tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lazy-loading 'fault' on Instance uuid 4f47f49f-e5a9-46d5-9622-c9c887891646 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:15:44.226036 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b0ea0629-2dce-4d6e-9f4b-5bcc9d5103ec tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ccc0bfdee94961aa198e3abf0d85cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee1e04c04bc40568e43eb98df39e7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:44.233894 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b0ea0629-2dce-4d6e-9f4b-5bcc9d5103ec tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] 10.222.0.13 "GET /compute/v2.1/servers/4f47f49f-e5a9-46d5-9622-c9c887891646" status: 200 len: 1310 microversion: 2.1 time: 0.107584 Oct 30 01:15:44.234455 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 355/712] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:44 2022] GET /compute/v2.1/servers/4f47f49f-e5a9-46d5-9622-c9c887891646 => generated 1310 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:44.780046 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d6ac47a0-ac03-43a4-aa00-4f26a5fd95ce tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:44.780653 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d6ac47a0-ac03-43a4-aa00-4f26a5fd95ce tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:44.787308 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d6ac47a0-ac03-43a4-aa00-4f26a5fd95ce tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:44.787783 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d6ac47a0-ac03-43a4-aa00-4f26a5fd95ce tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:44.788216 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d6ac47a0-ac03-43a4-aa00-4f26a5fd95ce tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:44.795094 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d6ac47a0-ac03-43a4-aa00-4f26a5fd95ce tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:44.795094 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d6ac47a0-ac03-43a4-aa00-4f26a5fd95ce tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:44.795094 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d6ac47a0-ac03-43a4-aa00-4f26a5fd95ce tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:44.943393 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d6ac47a0-ac03-43a4-aa00-4f26a5fd95ce tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:44.951352 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:44.957065 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d6ac47a0-ac03-43a4-aa00-4f26a5fd95ce tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f" status: 200 len: 1472 microversion: 2.1 time: 0.180809 Oct 30 01:15:44.966618 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 356/713] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:44 2022] GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f => generated 1472 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:15:44.977479 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-abe4eec4-6802-4725-8c91-22f01dfea079 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:44.979179 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-abe4eec4-6802-4725-8c91-22f01dfea079 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:44.990991 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-abe4eec4-6802-4725-8c91-22f01dfea079 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:44.990991 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-abe4eec4-6802-4725-8c91-22f01dfea079 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:44.990991 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-abe4eec4-6802-4725-8c91-22f01dfea079 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:44.990991 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-abe4eec4-6802-4725-8c91-22f01dfea079 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:44.991659 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-abe4eec4-6802-4725-8c91-22f01dfea079 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:44.992288 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-abe4eec4-6802-4725-8c91-22f01dfea079 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:45.061607 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-abe4eec4-6802-4725-8c91-22f01dfea079 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:45.069933 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-abe4eec4-6802-4725-8c91-22f01dfea079 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd" status: 200 len: 1230 microversion: 2.1 time: 0.102151 Oct 30 01:15:45.070655 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 357/714] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:44 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd => generated 1230 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:45.075646 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4c59c451-64de-46e6-a0c3-e1fab9927c88 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:45.076359 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4c59c451-64de-46e6-a0c3-e1fab9927c88 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] [instance: 60ecf54f-3d14-4927-9d7a-5a26778cad70] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:45.082841 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4c59c451-64de-46e6-a0c3-e1fab9927c88 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:45.083418 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4c59c451-64de-46e6-a0c3-e1fab9927c88 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:45.084110 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4c59c451-64de-46e6-a0c3-e1fab9927c88 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:45.085636 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4c59c451-64de-46e6-a0c3-e1fab9927c88 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:45.086174 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4c59c451-64de-46e6-a0c3-e1fab9927c88 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:45.086724 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4c59c451-64de-46e6-a0c3-e1fab9927c88 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:45.157510 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4c59c451-64de-46e6-a0c3-e1fab9927c88 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e6512cfbbbf412cbc4c40b80669b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c653b9bf1e064528b2ffe8c9b57fa48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:45.167077 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4c59c451-64de-46e6-a0c3-e1fab9927c88 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] 10.222.0.13 "GET /compute/v2.1/servers/60ecf54f-3d14-4927-9d7a-5a26778cad70" status: 200 len: 1219 microversion: 2.1 time: 0.094831 Oct 30 01:15:45.167880 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 358/715] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:45 2022] GET /compute/v2.1/servers/60ecf54f-3d14-4927-9d7a-5a26778cad70 => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:45.173417 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-38987435-7edc-49d2-b4af-bddd7ea2f052 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:45.174333 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-38987435-7edc-49d2-b4af-bddd7ea2f052 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: d19d848f-99bc-4f10-b837-d66aaa5258a6] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:45.181688 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38987435-7edc-49d2-b4af-bddd7ea2f052 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:45.182543 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38987435-7edc-49d2-b4af-bddd7ea2f052 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:45.183193 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38987435-7edc-49d2-b4af-bddd7ea2f052 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:45.184113 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38987435-7edc-49d2-b4af-bddd7ea2f052 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:45.185029 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38987435-7edc-49d2-b4af-bddd7ea2f052 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:45.189879 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38987435-7edc-49d2-b4af-bddd7ea2f052 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:45.274274 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-38987435-7edc-49d2-b4af-bddd7ea2f052 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:45.283148 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-38987435-7edc-49d2-b4af-bddd7ea2f052 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/d19d848f-99bc-4f10-b837-d66aaa5258a6" status: 200 len: 1274 microversion: 2.1 time: 0.114072 Oct 30 01:15:45.284308 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 359/716] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:45 2022] GET /compute/v2.1/servers/d19d848f-99bc-4f10-b837-d66aaa5258a6 => generated 1274 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:45.294460 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-347c7f00-1815-45ed-a612-9c08fccf9d97 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:45.295294 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-347c7f00-1815-45ed-a612-9c08fccf9d97 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:45.310674 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-347c7f00-1815-45ed-a612-9c08fccf9d97 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:45.311410 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-347c7f00-1815-45ed-a612-9c08fccf9d97 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:45.311841 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-347c7f00-1815-45ed-a612-9c08fccf9d97 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:45.312779 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-347c7f00-1815-45ed-a612-9c08fccf9d97 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:45.316846 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-347c7f00-1815-45ed-a612-9c08fccf9d97 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:45.316846 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-347c7f00-1815-45ed-a612-9c08fccf9d97 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:45.359535 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-347c7f00-1815-45ed-a612-9c08fccf9d97 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:45.360344 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-347c7f00-1815-45ed-a612-9c08fccf9d97 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:45.361178 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-347c7f00-1815-45ed-a612-9c08fccf9d97 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:45.361519 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-347c7f00-1815-45ed-a612-9c08fccf9d97 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lazy-loading 'fault' on Instance uuid 2c5b301d-f84c-4395-add9-b84311fa785c {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:15:45.422072 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-347c7f00-1815-45ed-a612-9c08fccf9d97 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:45.428448 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-347c7f00-1815-45ed-a612-9c08fccf9d97 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:45.430095 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-347c7f00-1815-45ed-a612-9c08fccf9d97 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:45.436040 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-347c7f00-1815-45ed-a612-9c08fccf9d97 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] 10.222.0.13 "GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 200 len: 1448 microversion: 2.75 time: 0.150410 Oct 30 01:15:45.437004 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 360/717] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:45 2022] GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 1448 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:45.442528 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0b671d18-66c5-42f8-a160-bb113e11f0fe tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:45.443141 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0b671d18-66c5-42f8-a160-bb113e11f0fe tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] [instance: 4f47f49f-e5a9-46d5-9622-c9c887891646] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:45.449587 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b671d18-66c5-42f8-a160-bb113e11f0fe tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:45.450344 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b671d18-66c5-42f8-a160-bb113e11f0fe tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:45.450878 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b671d18-66c5-42f8-a160-bb113e11f0fe tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:45.451541 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b671d18-66c5-42f8-a160-bb113e11f0fe tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:45.451989 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b671d18-66c5-42f8-a160-bb113e11f0fe tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:45.452498 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b671d18-66c5-42f8-a160-bb113e11f0fe tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:45.486824 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b671d18-66c5-42f8-a160-bb113e11f0fe tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:45.488472 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b671d18-66c5-42f8-a160-bb113e11f0fe tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:45.488774 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b671d18-66c5-42f8-a160-bb113e11f0fe tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:45.489238 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-0b671d18-66c5-42f8-a160-bb113e11f0fe tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lazy-loading 'fault' on Instance uuid 4f47f49f-e5a9-46d5-9622-c9c887891646 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:15:45.540708 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0b671d18-66c5-42f8-a160-bb113e11f0fe tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ccc0bfdee94961aa198e3abf0d85cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee1e04c04bc40568e43eb98df39e7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:45.553753 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0b671d18-66c5-42f8-a160-bb113e11f0fe tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] 10.222.0.13 "GET /compute/v2.1/servers/4f47f49f-e5a9-46d5-9622-c9c887891646" status: 200 len: 1310 microversion: 2.1 time: 0.115446 Oct 30 01:15:45.557494 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 361/718] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:45 2022] GET /compute/v2.1/servers/4f47f49f-e5a9-46d5-9622-c9c887891646 => generated 1310 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:45.990782 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6c3ec309-9bf6-4061-a67a-b8ede0191b56 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:45.991431 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6c3ec309-9bf6-4061-a67a-b8ede0191b56 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:46.000821 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c3ec309-9bf6-4061-a67a-b8ede0191b56 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:46.001207 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c3ec309-9bf6-4061-a67a-b8ede0191b56 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:46.002477 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c3ec309-9bf6-4061-a67a-b8ede0191b56 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:46.003249 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c3ec309-9bf6-4061-a67a-b8ede0191b56 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:46.003939 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c3ec309-9bf6-4061-a67a-b8ede0191b56 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:46.004871 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c3ec309-9bf6-4061-a67a-b8ede0191b56 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:46.242327 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6c3ec309-9bf6-4061-a67a-b8ede0191b56 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:46.250450 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6c3ec309-9bf6-4061-a67a-b8ede0191b56 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f" status: 200 len: 1472 microversion: 2.1 time: 0.266011 Oct 30 01:15:46.251044 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 362/719] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:45 2022] GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f => generated 1472 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:46.261865 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-90ef0389-e14e-4275-9071-c1f9c0ba34c5 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:46.262479 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-90ef0389-e14e-4275-9071-c1f9c0ba34c5 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:46.268777 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-90ef0389-e14e-4275-9071-c1f9c0ba34c5 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:46.269283 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-90ef0389-e14e-4275-9071-c1f9c0ba34c5 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:46.270004 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-90ef0389-e14e-4275-9071-c1f9c0ba34c5 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:46.270704 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-90ef0389-e14e-4275-9071-c1f9c0ba34c5 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:46.271159 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-90ef0389-e14e-4275-9071-c1f9c0ba34c5 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:46.271583 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-90ef0389-e14e-4275-9071-c1f9c0ba34c5 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:46.335399 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-90ef0389-e14e-4275-9071-c1f9c0ba34c5 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:46.348135 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-90ef0389-e14e-4275-9071-c1f9c0ba34c5 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd" status: 200 len: 1230 microversion: 2.1 time: 0.092737 Oct 30 01:15:46.348135 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 363/720] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:46 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd => generated 1230 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:46.351173 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-98ea7f7c-85be-40e9-b434-54f8443b03a5 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:46.351787 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-98ea7f7c-85be-40e9-b434-54f8443b03a5 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] [instance: 60ecf54f-3d14-4927-9d7a-5a26778cad70] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:46.353697 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:46.358679 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-98ea7f7c-85be-40e9-b434-54f8443b03a5 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:46.359197 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-98ea7f7c-85be-40e9-b434-54f8443b03a5 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:46.359641 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-98ea7f7c-85be-40e9-b434-54f8443b03a5 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:46.360338 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-98ea7f7c-85be-40e9-b434-54f8443b03a5 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:46.360799 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-98ea7f7c-85be-40e9-b434-54f8443b03a5 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:46.361220 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-98ea7f7c-85be-40e9-b434-54f8443b03a5 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:46.428557 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-98ea7f7c-85be-40e9-b434-54f8443b03a5 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e6512cfbbbf412cbc4c40b80669b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c653b9bf1e064528b2ffe8c9b57fa48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:46.436670 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-98ea7f7c-85be-40e9-b434-54f8443b03a5 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] 10.222.0.13 "GET /compute/v2.1/servers/60ecf54f-3d14-4927-9d7a-5a26778cad70" status: 200 len: 1219 microversion: 2.1 time: 0.090136 Oct 30 01:15:46.437248 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 364/721] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:46 2022] GET /compute/v2.1/servers/60ecf54f-3d14-4927-9d7a-5a26778cad70 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:46.442186 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-feef1508-f4a5-49ab-ba94-3bb11c4f90cf tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:46.442405 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-feef1508-f4a5-49ab-ba94-3bb11c4f90cf tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: d19d848f-99bc-4f10-b837-d66aaa5258a6] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:46.448209 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-feef1508-f4a5-49ab-ba94-3bb11c4f90cf tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:46.448729 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-feef1508-f4a5-49ab-ba94-3bb11c4f90cf tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:46.449125 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-feef1508-f4a5-49ab-ba94-3bb11c4f90cf tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:46.449851 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-feef1508-f4a5-49ab-ba94-3bb11c4f90cf tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:46.450530 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-feef1508-f4a5-49ab-ba94-3bb11c4f90cf tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:46.450778 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-feef1508-f4a5-49ab-ba94-3bb11c4f90cf tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:46.601007 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-feef1508-f4a5-49ab-ba94-3bb11c4f90cf tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:46.610091 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-feef1508-f4a5-49ab-ba94-3bb11c4f90cf tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/d19d848f-99bc-4f10-b837-d66aaa5258a6" status: 200 len: 1316 microversion: 2.1 time: 0.171692 Oct 30 01:15:46.610673 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 365/722] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:46 2022] GET /compute/v2.1/servers/d19d848f-99bc-4f10-b837-d66aaa5258a6 => generated 1316 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:46.617916 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-aa93585f-683f-4d94-9232-b809b5321290 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:46.625469 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-aa93585f-683f-4d94-9232-b809b5321290 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:46.626498 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa93585f-683f-4d94-9232-b809b5321290 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:46.627090 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa93585f-683f-4d94-9232-b809b5321290 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:46.627642 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa93585f-683f-4d94-9232-b809b5321290 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:46.629035 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa93585f-683f-4d94-9232-b809b5321290 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:46.629669 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa93585f-683f-4d94-9232-b809b5321290 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:46.631020 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa93585f-683f-4d94-9232-b809b5321290 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:46.670018 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa93585f-683f-4d94-9232-b809b5321290 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:46.670510 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa93585f-683f-4d94-9232-b809b5321290 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:46.670954 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa93585f-683f-4d94-9232-b809b5321290 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:46.671410 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-aa93585f-683f-4d94-9232-b809b5321290 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lazy-loading 'fault' on Instance uuid 2c5b301d-f84c-4395-add9-b84311fa785c {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:15:46.717474 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-aa93585f-683f-4d94-9232-b809b5321290 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:46.726263 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-aa93585f-683f-4d94-9232-b809b5321290 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:46.727719 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-aa93585f-683f-4d94-9232-b809b5321290 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:46.732489 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-aa93585f-683f-4d94-9232-b809b5321290 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] 10.222.0.13 "GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 200 len: 1448 microversion: 2.75 time: 0.120876 Oct 30 01:15:46.733048 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 366/723] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:46 2022] GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 1448 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:46.737458 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-58c84dab-d3b5-4c5f-a028-d45e5061ac24 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:46.738071 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-58c84dab-d3b5-4c5f-a028-d45e5061ac24 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] [instance: 4f47f49f-e5a9-46d5-9622-c9c887891646] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:46.743610 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58c84dab-d3b5-4c5f-a028-d45e5061ac24 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:46.744094 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58c84dab-d3b5-4c5f-a028-d45e5061ac24 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:46.744529 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58c84dab-d3b5-4c5f-a028-d45e5061ac24 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:46.745308 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58c84dab-d3b5-4c5f-a028-d45e5061ac24 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:46.745787 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58c84dab-d3b5-4c5f-a028-d45e5061ac24 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:46.746208 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58c84dab-d3b5-4c5f-a028-d45e5061ac24 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:46.759832 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-58c84dab-d3b5-4c5f-a028-d45e5061ac24 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] HTTP exception thrown: Instance 4f47f49f-e5a9-46d5-9622-c9c887891646 could not be found. Oct 30 01:15:46.761539 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-58c84dab-d3b5-4c5f-a028-d45e5061ac24 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Request method failure captured: Oct 30 01:15:46.761539 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/4f47f49f-e5a9-46d5-9622-c9c887891646 HTTP/1.1 Oct 30 01:15:46.761539 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:15:46.761539 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:15:46.761539 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:15:46.761539 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:15:46.761539 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:15:46.761539 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:15:46.761539 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:15:46.761539 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:15:46.761539 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdAEQIsI5zTiUPdhbte40Alwapm0ZYUhAbkZ95pXiYWxCfsqPTH7z49blJiiblFtNo7Itk_wdHlUaz3fd15G3kPM9Hxx2LIA_4QQvRnz0AcgtbCrJQi67Dq9ZSD1MICXpuYCqBs2oALiVTVbw8u3jYcw2nTy3n9uZUYMg6ciMh7yu7I Oct 30 01:15:46.761539 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:15:46.761539 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:15:46.761539 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:15:46.761539 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:15:46.761539 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:15:46.761539 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:15:46.761539 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 3ee1e04c04bc40568e43eb98df39e7e6 Oct 30 01:15:46.761539 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-703885089 Oct 30 01:15:46.761539 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:15:46.761539 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:15:46.763289 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3ee1e04c04bc40568e43eb98df39e7e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3ee1e04c04bc40568e43eb98df39e7e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3ee1e04c04bc40568e43eb98df39e7e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3ee1e04c04bc40568e43eb98df39e7e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:15:46.763289 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersAdminNegativeTestJSON-703885089 Oct 30 01:15:46.763289 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 3ee1e04c04bc40568e43eb98df39e7e6 Oct 30 01:15:46.763289 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-703885089 Oct 30 01:15:46.763289 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersAdminNegativeTestJSON-703885089-project Oct 30 01:15:46.763289 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:15:46.763289 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:15:46.763289 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 51ccc0bfdee94961aa198e3abf0d85cc Oct 30 01:15:46.763289 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersAdminNegativeTestJSON-703885089-project Oct 30 01:15:46.763289 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:15:46.763289 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 4f47f49f-e5a9-46d5-9622-c9c887891646 could not be found. Oct 30 01:15:46.763289 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '4f47f49f-e5a9-46d5-9622-c9c887891646'} Oct 30 01:15:46.764323 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:15:46.764323 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:15:46.764323 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:15:46.764323 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:15:46.764323 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:15:46.764323 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:15:46.764323 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:15:46.764323 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:15:46.764323 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:15:46.764323 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:15:46.764323 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f47f49f-e5a9-46d5-9622-c9c887891646 could not be found. Oct 30 01:15:46.764323 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:46.764323 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:15:46.764323 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:46.764323 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:15:46.764323 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:15:46.764323 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:15:46.764323 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:15:46.764323 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:15:46.764323 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:15:46.765709 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:15:46.765709 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:15:46.765709 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:15:46.765709 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:15:46.765709 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:15:46.765709 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:15:46.765709 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:15:46.765709 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f47f49f-e5a9-46d5-9622-c9c887891646 could not be found. Oct 30 01:15:46.765709 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:46.765709 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:15:46.765709 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:46.765709 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:15:46.765709 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:15:46.765709 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:15:46.765709 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:15:46.765709 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:15:46.765709 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f47f49f-e5a9-46d5-9622-c9c887891646 could not be found. Oct 30 01:15:46.765709 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:46.768046 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-58c84dab-d3b5-4c5f-a028-d45e5061ac24 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] Returning 404 to user: Instance 4f47f49f-e5a9-46d5-9622-c9c887891646 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:15:46.768046 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-58c84dab-d3b5-4c5f-a028-d45e5061ac24 tempest-ServersAdminNegativeTestJSON-703885089 tempest-ServersAdminNegativeTestJSON-703885089-project] 10.222.0.13 "GET /compute/v2.1/servers/4f47f49f-e5a9-46d5-9622-c9c887891646" status: 404 len: 111 microversion: 2.1 time: 0.029016 Oct 30 01:15:46.768046 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 367/724] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:46 2022] GET /compute/v2.1/servers/4f47f49f-e5a9-46d5-9622-c9c887891646 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:15:46.805751 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4ce72d45-e258-4522-92e1-04c8fd6a40a4 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552/action" status: 202 len: 0 microversion: 2.25 time: 3.188362 Oct 30 01:15:46.809459 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 358/725] 10.222.0.13 () {62 vars in 1319 bytes} [Sun Oct 30 01:15:43 2022] POST /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552/action => generated 0 bytes in 3190 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:15:46.814998 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f3001e16-3f0a-4628-af52-cee9aed09b2a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:46.815611 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f3001e16-3f0a-4628-af52-cee9aed09b2a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 3f60e45a-0e20-4280-be86-275d598fd552] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:46.822016 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f3001e16-3f0a-4628-af52-cee9aed09b2a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:46.822510 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f3001e16-3f0a-4628-af52-cee9aed09b2a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:46.822946 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f3001e16-3f0a-4628-af52-cee9aed09b2a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:46.823641 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f3001e16-3f0a-4628-af52-cee9aed09b2a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:46.824089 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f3001e16-3f0a-4628-af52-cee9aed09b2a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:46.824516 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f3001e16-3f0a-4628-af52-cee9aed09b2a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:46.855841 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-21c38c4b-5f05-4a43-bb14-694c9ddffd65 req-1ab9b845-ddc4-4881-96da-a32495fa9f45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d19d848f-99bc-4f10-b837-d66aaa5258a6", "tag": "ae765166-b140-4959-be8f-cb89a2eec37b"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:46.871022 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-21c38c4b-5f05-4a43-bb14-694c9ddffd65 req-1ab9b845-ddc4-4881-96da-a32495fa9f45 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:46.872123 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-21c38c4b-5f05-4a43-bb14-694c9ddffd65 req-1ab9b845-ddc4-4881-96da-a32495fa9f45 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:46.872776 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-21c38c4b-5f05-4a43-bb14-694c9ddffd65 req-1ab9b845-ddc4-4881-96da-a32495fa9f45 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:46.892730 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-21c38c4b-5f05-4a43-bb14-694c9ddffd65 req-1ab9b845-ddc4-4881-96da-a32495fa9f45 service nova] Creating event network-changed:ae765166-b140-4959-be8f-cb89a2eec37b for instance d19d848f-99bc-4f10-b837-d66aaa5258a6 on n-h1-master-1 Oct 30 01:15:46.899204 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-21c38c4b-5f05-4a43-bb14-694c9ddffd65 req-1ab9b845-ddc4-4881-96da-a32495fa9f45 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049809 Oct 30 01:15:46.899913 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 359/726] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:15:46.983384 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f3001e16-3f0a-4628-af52-cee9aed09b2a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:46.992711 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f3001e16-3f0a-4628-af52-cee9aed09b2a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:46.995914 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f3001e16-3f0a-4628-af52-cee9aed09b2a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:46.997896 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f3001e16-3f0a-4628-af52-cee9aed09b2a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552" status: 200 len: 1566 microversion: 2.25 time: 0.186996 Oct 30 01:15:46.998561 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 368/727] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:46 2022] GET /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552 => generated 1566 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:47.279166 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-125c4835-32af-4363-8d21-4622b19e93e8 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:47.280320 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-125c4835-32af-4363-8d21-4622b19e93e8 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:47.290548 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-125c4835-32af-4363-8d21-4622b19e93e8 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:47.291297 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-125c4835-32af-4363-8d21-4622b19e93e8 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:47.291892 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-125c4835-32af-4363-8d21-4622b19e93e8 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:47.292895 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-125c4835-32af-4363-8d21-4622b19e93e8 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:47.293420 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-125c4835-32af-4363-8d21-4622b19e93e8 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:47.294111 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-125c4835-32af-4363-8d21-4622b19e93e8 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:47.372442 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b3c82276-9c1e-4d1d-9fc9-896ae488d13d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:47.373183 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b3c82276-9c1e-4d1d-9fc9-896ae488d13d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:47.386221 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3c82276-9c1e-4d1d-9fc9-896ae488d13d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:47.386716 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3c82276-9c1e-4d1d-9fc9-896ae488d13d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:47.390032 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3c82276-9c1e-4d1d-9fc9-896ae488d13d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:47.390823 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3c82276-9c1e-4d1d-9fc9-896ae488d13d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:47.391296 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3c82276-9c1e-4d1d-9fc9-896ae488d13d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:47.391724 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3c82276-9c1e-4d1d-9fc9-896ae488d13d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:47.544239 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b3c82276-9c1e-4d1d-9fc9-896ae488d13d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:47.564187 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b3c82276-9c1e-4d1d-9fc9-896ae488d13d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd" status: 200 len: 1294 microversion: 2.1 time: 0.199300 Oct 30 01:15:47.565368 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 369/728] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:47 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd => generated 1294 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:15:47.570332 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a699cb01-fd0b-48df-968d-e03a766ffcf3 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:47.571337 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a699cb01-fd0b-48df-968d-e03a766ffcf3 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] [instance: 60ecf54f-3d14-4927-9d7a-5a26778cad70] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:47.578127 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a699cb01-fd0b-48df-968d-e03a766ffcf3 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:47.578885 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a699cb01-fd0b-48df-968d-e03a766ffcf3 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:47.579538 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a699cb01-fd0b-48df-968d-e03a766ffcf3 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:47.580445 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a699cb01-fd0b-48df-968d-e03a766ffcf3 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:47.580999 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a699cb01-fd0b-48df-968d-e03a766ffcf3 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:47.581526 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a699cb01-fd0b-48df-968d-e03a766ffcf3 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:47.743774 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a699cb01-fd0b-48df-968d-e03a766ffcf3 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e6512cfbbbf412cbc4c40b80669b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c653b9bf1e064528b2ffe8c9b57fa48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:47.752230 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a699cb01-fd0b-48df-968d-e03a766ffcf3 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] 10.222.0.13 "GET /compute/v2.1/servers/60ecf54f-3d14-4927-9d7a-5a26778cad70" status: 200 len: 1275 microversion: 2.1 time: 0.185572 Oct 30 01:15:47.752806 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 370/729] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:47 2022] GET /compute/v2.1/servers/60ecf54f-3d14-4927-9d7a-5a26778cad70 => generated 1275 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:47.757398 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-125c4835-32af-4363-8d21-4622b19e93e8 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:47.757685 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2c269f44-588e-4d74-a8e1-9529f533d061 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:47.758295 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2c269f44-588e-4d74-a8e1-9529f533d061 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: d19d848f-99bc-4f10-b837-d66aaa5258a6] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:47.769259 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-125c4835-32af-4363-8d21-4622b19e93e8 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f" status: 200 len: 1477 microversion: 2.1 time: 0.499027 Oct 30 01:15:47.770416 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 360/730] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:47 2022] GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f => generated 1477 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:47.775724 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2c269f44-588e-4d74-a8e1-9529f533d061 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:47.776293 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2c269f44-588e-4d74-a8e1-9529f533d061 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:47.776426 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b74953ef-fc52-4e7c-ad49-a45b135fd062 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:47.776738 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2c269f44-588e-4d74-a8e1-9529f533d061 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:47.776907 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b74953ef-fc52-4e7c-ad49-a45b135fd062 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:47.777506 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2c269f44-588e-4d74-a8e1-9529f533d061 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:47.777958 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2c269f44-588e-4d74-a8e1-9529f533d061 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:47.778381 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2c269f44-588e-4d74-a8e1-9529f533d061 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:47.788556 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b74953ef-fc52-4e7c-ad49-a45b135fd062 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:47.789377 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b74953ef-fc52-4e7c-ad49-a45b135fd062 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:47.789992 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b74953ef-fc52-4e7c-ad49-a45b135fd062 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:47.790938 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b74953ef-fc52-4e7c-ad49-a45b135fd062 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:47.791374 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b74953ef-fc52-4e7c-ad49-a45b135fd062 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:47.791800 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b74953ef-fc52-4e7c-ad49-a45b135fd062 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:47.834011 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b74953ef-fc52-4e7c-ad49-a45b135fd062 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:47.834664 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b74953ef-fc52-4e7c-ad49-a45b135fd062 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:47.834951 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b74953ef-fc52-4e7c-ad49-a45b135fd062 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:47.835406 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-b74953ef-fc52-4e7c-ad49-a45b135fd062 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lazy-loading 'fault' on Instance uuid 2c5b301d-f84c-4395-add9-b84311fa785c {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:15:47.949040 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b74953ef-fc52-4e7c-ad49-a45b135fd062 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:47.958641 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b74953ef-fc52-4e7c-ad49-a45b135fd062 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:47.963070 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b74953ef-fc52-4e7c-ad49-a45b135fd062 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:47.965839 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b74953ef-fc52-4e7c-ad49-a45b135fd062 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] 10.222.0.13 "GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 200 len: 1448 microversion: 2.75 time: 0.193641 Oct 30 01:15:47.967135 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 361/731] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:47 2022] GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 1448 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:48.024547 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0223f463-6d1f-4231-a3ab-bc0ec337fd87 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:48.025311 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0223f463-6d1f-4231-a3ab-bc0ec337fd87 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 3f60e45a-0e20-4280-be86-275d598fd552] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:48.040925 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0223f463-6d1f-4231-a3ab-bc0ec337fd87 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:48.041443 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0223f463-6d1f-4231-a3ab-bc0ec337fd87 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:48.041886 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0223f463-6d1f-4231-a3ab-bc0ec337fd87 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:48.042597 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0223f463-6d1f-4231-a3ab-bc0ec337fd87 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:48.043049 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0223f463-6d1f-4231-a3ab-bc0ec337fd87 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:48.043651 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0223f463-6d1f-4231-a3ab-bc0ec337fd87 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:48.226456 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2c269f44-588e-4d74-a8e1-9529f533d061 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:48.248204 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2c269f44-588e-4d74-a8e1-9529f533d061 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/d19d848f-99bc-4f10-b837-d66aaa5258a6" status: 200 len: 1316 microversion: 2.1 time: 0.493202 Oct 30 01:15:48.249082 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 371/732] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:47 2022] GET /compute/v2.1/servers/d19d848f-99bc-4f10-b837-d66aaa5258a6 => generated 1316 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:48.408729 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0223f463-6d1f-4231-a3ab-bc0ec337fd87 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:48.412273 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:48.424411 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0223f463-6d1f-4231-a3ab-bc0ec337fd87 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:48.425963 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0223f463-6d1f-4231-a3ab-bc0ec337fd87 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:48.427153 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0223f463-6d1f-4231-a3ab-bc0ec337fd87 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552" status: 200 len: 1566 microversion: 2.25 time: 0.406579 Oct 30 01:15:48.433744 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 362/733] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:48 2022] GET /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552 => generated 1566 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:48.592339 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b570e939-484d-4411-88a7-23b7cc3b425a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:48.592959 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b570e939-484d-4411-88a7-23b7cc3b425a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:48.602795 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b570e939-484d-4411-88a7-23b7cc3b425a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:48.603437 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b570e939-484d-4411-88a7-23b7cc3b425a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:48.603795 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b570e939-484d-4411-88a7-23b7cc3b425a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:48.607931 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b570e939-484d-4411-88a7-23b7cc3b425a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:48.608761 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b570e939-484d-4411-88a7-23b7cc3b425a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:48.609229 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b570e939-484d-4411-88a7-23b7cc3b425a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:48.771515 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b570e939-484d-4411-88a7-23b7cc3b425a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:48.778779 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9f6d965b-f4bf-43bb-9023-1e454a248e1c tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:48.779463 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9f6d965b-f4bf-43bb-9023-1e454a248e1c tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] [instance: 60ecf54f-3d14-4927-9d7a-5a26778cad70] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:48.780888 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b570e939-484d-4411-88a7-23b7cc3b425a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd" status: 200 len: 1360 microversion: 2.1 time: 0.192569 Oct 30 01:15:48.787930 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9f6d965b-f4bf-43bb-9023-1e454a248e1c tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:48.788785 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9f6d965b-f4bf-43bb-9023-1e454a248e1c tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:48.789322 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9f6d965b-f4bf-43bb-9023-1e454a248e1c tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:48.790119 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9f6d965b-f4bf-43bb-9023-1e454a248e1c tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:48.790646 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9f6d965b-f4bf-43bb-9023-1e454a248e1c tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:48.792314 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9f6d965b-f4bf-43bb-9023-1e454a248e1c tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:48.795575 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 372/734] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:48 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd => generated 1360 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:48.803258 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3d446928-6f87-4603-ba56-925642af7a9e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:48.807914 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3d446928-6f87-4603-ba56-925642af7a9e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:48.814055 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3d446928-6f87-4603-ba56-925642af7a9e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:48.815090 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3d446928-6f87-4603-ba56-925642af7a9e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:48.815699 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3d446928-6f87-4603-ba56-925642af7a9e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:48.817659 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3d446928-6f87-4603-ba56-925642af7a9e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:48.818520 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3d446928-6f87-4603-ba56-925642af7a9e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:48.819125 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3d446928-6f87-4603-ba56-925642af7a9e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:48.844770 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=100 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:48.884836 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9f6d965b-f4bf-43bb-9023-1e454a248e1c tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e6512cfbbbf412cbc4c40b80669b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c653b9bf1e064528b2ffe8c9b57fa48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:48.900005 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9f6d965b-f4bf-43bb-9023-1e454a248e1c tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] 10.222.0.13 "GET /compute/v2.1/servers/60ecf54f-3d14-4927-9d7a-5a26778cad70" status: 200 len: 1293 microversion: 2.1 time: 0.125561 Oct 30 01:15:48.916163 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 363/735] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:48 2022] GET /compute/v2.1/servers/60ecf54f-3d14-4927-9d7a-5a26778cad70 => generated 1293 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:15:48.995509 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-86323ea5-9dd2-4f73-a8d1-d5296dafde50 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:48.996515 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-86323ea5-9dd2-4f73-a8d1-d5296dafde50 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:49.002881 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86323ea5-9dd2-4f73-a8d1-d5296dafde50 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:49.003651 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86323ea5-9dd2-4f73-a8d1-d5296dafde50 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:49.004319 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86323ea5-9dd2-4f73-a8d1-d5296dafde50 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:49.005551 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86323ea5-9dd2-4f73-a8d1-d5296dafde50 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:49.006254 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86323ea5-9dd2-4f73-a8d1-d5296dafde50 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:49.006880 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86323ea5-9dd2-4f73-a8d1-d5296dafde50 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:49.043887 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86323ea5-9dd2-4f73-a8d1-d5296dafde50 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:49.044465 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86323ea5-9dd2-4f73-a8d1-d5296dafde50 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:49.045089 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86323ea5-9dd2-4f73-a8d1-d5296dafde50 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:49.045784 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-86323ea5-9dd2-4f73-a8d1-d5296dafde50 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lazy-loading 'fault' on Instance uuid 2c5b301d-f84c-4395-add9-b84311fa785c {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:15:49.094825 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3d446928-6f87-4603-ba56-925642af7a9e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:49.103524 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3d446928-6f87-4603-ba56-925642af7a9e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f" status: 200 len: 1477 microversion: 2.1 time: 0.306588 Oct 30 01:15:49.104108 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 373/736] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:48 2022] GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f => generated 1477 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:49.122196 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-86323ea5-9dd2-4f73-a8d1-d5296dafde50 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:49.131889 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-86323ea5-9dd2-4f73-a8d1-d5296dafde50 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:49.133575 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-86323ea5-9dd2-4f73-a8d1-d5296dafde50 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9e2d5caf6c64b5eb508c47bbbc13892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c345b7715cca426599dce98b8906ef8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:49.138936 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-86323ea5-9dd2-4f73-a8d1-d5296dafde50 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] 10.222.0.13 "GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 200 len: 1448 microversion: 2.75 time: 0.147310 Oct 30 01:15:49.140114 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 364/737] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:48 2022] GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 1448 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:15:49.276302 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c8877825-9f21-4e81-9144-000e32f719c2 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:49.278138 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c8877825-9f21-4e81-9144-000e32f719c2 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: d19d848f-99bc-4f10-b837-d66aaa5258a6] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:49.284591 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c8877825-9f21-4e81-9144-000e32f719c2 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:49.285639 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c8877825-9f21-4e81-9144-000e32f719c2 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:49.287752 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c8877825-9f21-4e81-9144-000e32f719c2 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:49.287752 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c8877825-9f21-4e81-9144-000e32f719c2 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:49.287752 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c8877825-9f21-4e81-9144-000e32f719c2 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:49.288209 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c8877825-9f21-4e81-9144-000e32f719c2 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:49.405152 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-aacc939c-be9c-4d08-931b-bcd608f79dd1 req-83b2af45-6d75-4bd4-a2c0-f92d9d630e6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f60e45a-0e20-4280-be86-275d598fd552", "name": "network-vif-unplugged", "status": "completed", "tag": "c8a94bc2-b259-4ae7-9a0e-3c02ee3a39c3"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:49.416905 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-aacc939c-be9c-4d08-931b-bcd608f79dd1 req-83b2af45-6d75-4bd4-a2c0-f92d9d630e6f service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:49.417418 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-aacc939c-be9c-4d08-931b-bcd608f79dd1 req-83b2af45-6d75-4bd4-a2c0-f92d9d630e6f service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:49.418171 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-aacc939c-be9c-4d08-931b-bcd608f79dd1 req-83b2af45-6d75-4bd4-a2c0-f92d9d630e6f service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:49.430829 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-aacc939c-be9c-4d08-931b-bcd608f79dd1 req-83b2af45-6d75-4bd4-a2c0-f92d9d630e6f service nova] Creating event network-vif-unplugged:c8a94bc2-b259-4ae7-9a0e-3c02ee3a39c3 for instance 3f60e45a-0e20-4280-be86-275d598fd552 on n-h1-master-1 Oct 30 01:15:49.436411 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-aacc939c-be9c-4d08-931b-bcd608f79dd1 req-83b2af45-6d75-4bd4-a2c0-f92d9d630e6f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035100 Oct 30 01:15:49.437013 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 365/738] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:15:49.458398 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8acbe559-2c52-4cbe-8f46-040721bf40f3 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:49.460183 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8acbe559-2c52-4cbe-8f46-040721bf40f3 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 3f60e45a-0e20-4280-be86-275d598fd552] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:49.466926 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8acbe559-2c52-4cbe-8f46-040721bf40f3 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:49.467567 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8acbe559-2c52-4cbe-8f46-040721bf40f3 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:49.468114 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8acbe559-2c52-4cbe-8f46-040721bf40f3 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:49.469427 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8acbe559-2c52-4cbe-8f46-040721bf40f3 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:49.469992 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8acbe559-2c52-4cbe-8f46-040721bf40f3 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:49.470844 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8acbe559-2c52-4cbe-8f46-040721bf40f3 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:49.478607 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c8877825-9f21-4e81-9144-000e32f719c2 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:49.487169 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c8877825-9f21-4e81-9144-000e32f719c2 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/d19d848f-99bc-4f10-b837-d66aaa5258a6" status: 200 len: 1316 microversion: 2.1 time: 0.215336 Oct 30 01:15:49.487888 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 374/739] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:49 2022] GET /compute/v2.1/servers/d19d848f-99bc-4f10-b837-d66aaa5258a6 => generated 1316 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:49.715583 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8acbe559-2c52-4cbe-8f46-040721bf40f3 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:49.728537 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8acbe559-2c52-4cbe-8f46-040721bf40f3 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:49.730868 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8acbe559-2c52-4cbe-8f46-040721bf40f3 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:49.732181 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8acbe559-2c52-4cbe-8f46-040721bf40f3 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552" status: 200 len: 1566 microversion: 2.25 time: 0.279025 Oct 30 01:15:49.734132 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 366/740] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:49 2022] GET /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552 => generated 1566 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:15:49.809993 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8d4bb0a3-39fd-4ad8-89d6-4c91735e6d87 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:49.811372 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8d4bb0a3-39fd-4ad8-89d6-4c91735e6d87 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:49.830325 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8d4bb0a3-39fd-4ad8-89d6-4c91735e6d87 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:49.831216 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8d4bb0a3-39fd-4ad8-89d6-4c91735e6d87 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:49.836847 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8d4bb0a3-39fd-4ad8-89d6-4c91735e6d87 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:49.836847 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8d4bb0a3-39fd-4ad8-89d6-4c91735e6d87 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:49.836847 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8d4bb0a3-39fd-4ad8-89d6-4c91735e6d87 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:49.836847 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8d4bb0a3-39fd-4ad8-89d6-4c91735e6d87 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:49.924569 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f89c15c1-356d-482a-b72c-81336e2c0607 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:49.927439 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f89c15c1-356d-482a-b72c-81336e2c0607 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] [instance: 60ecf54f-3d14-4927-9d7a-5a26778cad70] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:49.936340 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f89c15c1-356d-482a-b72c-81336e2c0607 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:49.937027 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f89c15c1-356d-482a-b72c-81336e2c0607 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:49.937725 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f89c15c1-356d-482a-b72c-81336e2c0607 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:49.938731 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f89c15c1-356d-482a-b72c-81336e2c0607 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:49.940263 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f89c15c1-356d-482a-b72c-81336e2c0607 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:49.942998 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f89c15c1-356d-482a-b72c-81336e2c0607 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:50.043907 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f89c15c1-356d-482a-b72c-81336e2c0607 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e6512cfbbbf412cbc4c40b80669b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c653b9bf1e064528b2ffe8c9b57fa48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:50.052109 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f89c15c1-356d-482a-b72c-81336e2c0607 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] 10.222.0.13 "GET /compute/v2.1/servers/60ecf54f-3d14-4927-9d7a-5a26778cad70" status: 200 len: 1281 microversion: 2.1 time: 0.133280 Oct 30 01:15:50.053171 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 367/741] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:49 2022] GET /compute/v2.1/servers/60ecf54f-3d14-4927-9d7a-5a26778cad70 => generated 1281 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:15:50.064971 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-dd1f1308-c977-4fa8-ab63-963d582ed0a5 req-2935d234-c019-49a2-827d-3d596d8b4af7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b368660-effb-411d-b713-455fc7fd44cd", "tag": "be63e75e-18fe-4000-8f59-5722fd84c310"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:50.098050 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-dd1f1308-c977-4fa8-ab63-963d582ed0a5 req-2935d234-c019-49a2-827d-3d596d8b4af7 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:50.098560 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-dd1f1308-c977-4fa8-ab63-963d582ed0a5 req-2935d234-c019-49a2-827d-3d596d8b4af7 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:50.099182 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-dd1f1308-c977-4fa8-ab63-963d582ed0a5 req-2935d234-c019-49a2-827d-3d596d8b4af7 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:50.137972 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-dd1f1308-c977-4fa8-ab63-963d582ed0a5 req-2935d234-c019-49a2-827d-3d596d8b4af7 service nova] Creating event network-changed:be63e75e-18fe-4000-8f59-5722fd84c310 for instance 6b368660-effb-411d-b713-455fc7fd44cd on n-h1-master-1 Oct 30 01:15:50.150492 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-dd1f1308-c977-4fa8-ab63-963d582ed0a5 req-2935d234-c019-49a2-827d-3d596d8b4af7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095272 Oct 30 01:15:50.151800 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 368/742] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:15:50.169484 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c4d1aa49-c92b-40ed-b7bd-9d1fe3e72f10 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:50.171228 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c4d1aa49-c92b-40ed-b7bd-9d1fe3e72f10 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:50.180384 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4d1aa49-c92b-40ed-b7bd-9d1fe3e72f10 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:50.180884 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4d1aa49-c92b-40ed-b7bd-9d1fe3e72f10 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:50.181322 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4d1aa49-c92b-40ed-b7bd-9d1fe3e72f10 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:50.182967 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4d1aa49-c92b-40ed-b7bd-9d1fe3e72f10 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:50.183630 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4d1aa49-c92b-40ed-b7bd-9d1fe3e72f10 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:50.184546 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4d1aa49-c92b-40ed-b7bd-9d1fe3e72f10 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:50.511497 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8d4bb0a3-39fd-4ad8-89d6-4c91735e6d87 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:50.520964 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8d4bb0a3-39fd-4ad8-89d6-4c91735e6d87 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd" status: 200 len: 1360 microversion: 2.1 time: 0.718317 Oct 30 01:15:50.522049 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 375/743] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:49 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd => generated 1360 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:50.528003 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-69491dda-437f-4d64-aed6-605649d10d76 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:50.531663 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-69491dda-437f-4d64-aed6-605649d10d76 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] [instance: 2c5b301d-f84c-4395-add9-b84311fa785c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:50.535678 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-69491dda-437f-4d64-aed6-605649d10d76 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:50.536240 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-69491dda-437f-4d64-aed6-605649d10d76 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:50.536833 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-69491dda-437f-4d64-aed6-605649d10d76 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:50.537864 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-69491dda-437f-4d64-aed6-605649d10d76 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:50.539096 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-69491dda-437f-4d64-aed6-605649d10d76 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:50.539740 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-69491dda-437f-4d64-aed6-605649d10d76 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:50.560444 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-69491dda-437f-4d64-aed6-605649d10d76 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] HTTP exception thrown: Instance 2c5b301d-f84c-4395-add9-b84311fa785c could not be found. Oct 30 01:15:50.562516 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-69491dda-437f-4d64-aed6-605649d10d76 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Request method failure captured: Oct 30 01:15:50.562516 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c HTTP/1.1 Oct 30 01:15:50.562516 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:15:50.562516 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:15:50.562516 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:15:50.562516 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:15:50.562516 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:15:50.562516 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:15:50.562516 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:15:50.562516 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:15:50.562516 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXc_sjEY3znunKfOjVsEEB9PEIb39hm0zwQySTbkeKcI08QKOwgusFuSHre6aeej8b5K0W5Wj14TqtUtMVIQ7m9q8rxsMPxvHFL6Ssdn_IYbICqkRKyFauOXxBKN3au17R226NGzJBLW6lQqtBgyfvfXdPO5-PVPAkBFAzaaonQUXWR8 Oct 30 01:15:50.562516 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:15:50.562516 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:15:50.562516 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:15:50.562516 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:15:50.562516 n-d-master-1 devstack@n-api.service[121103]: X-Openstack-Nova-Api-Version: 2.75 Oct 30 01:15:50.562516 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:15:50.562516 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:15:50.562516 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: c345b7715cca426599dce98b8906ef8e Oct 30 01:15:50.562516 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersAdmin275Test-1799629014 Oct 30 01:15:50.562516 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:15:50.562516 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:15:50.564008 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c345b7715cca426599dce98b8906ef8e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c345b7715cca426599dce98b8906ef8e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c345b7715cca426599dce98b8906ef8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c345b7715cca426599dce98b8906ef8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:15:50.564008 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersAdmin275Test-1799629014 Oct 30 01:15:50.564008 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: c345b7715cca426599dce98b8906ef8e Oct 30 01:15:50.564008 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersAdmin275Test-1799629014 Oct 30 01:15:50.564008 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersAdmin275Test-1799629014-project Oct 30 01:15:50.564008 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:15:50.564008 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:15:50.564008 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: c9e2d5caf6c64b5eb508c47bbbc13892 Oct 30 01:15:50.564008 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersAdmin275Test-1799629014-project Oct 30 01:15:50.564008 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:15:50.564008 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 2c5b301d-f84c-4395-add9-b84311fa785c could not be found. Oct 30 01:15:50.564008 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '2c5b301d-f84c-4395-add9-b84311fa785c'} Oct 30 01:15:50.564726 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:15:50.564726 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:15:50.564726 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:15:50.564726 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:15:50.564726 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:15:50.564726 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:15:50.564726 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:15:50.564726 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:15:50.564726 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:15:50.564726 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:15:50.564726 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c5b301d-f84c-4395-add9-b84311fa785c could not be found. Oct 30 01:15:50.564726 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:50.564726 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:15:50.564726 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:50.564726 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:15:50.564726 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:15:50.564726 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:15:50.564726 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:15:50.564726 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:15:50.564726 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:15:50.565986 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:15:50.565986 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:15:50.565986 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:15:50.565986 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:15:50.565986 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:15:50.565986 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:15:50.565986 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:15:50.565986 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c5b301d-f84c-4395-add9-b84311fa785c could not be found. Oct 30 01:15:50.565986 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:50.565986 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:15:50.565986 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:50.565986 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:15:50.565986 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:15:50.565986 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:15:50.565986 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:15:50.565986 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:15:50.565986 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c5b301d-f84c-4395-add9-b84311fa785c could not be found. Oct 30 01:15:50.565986 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:50.568465 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-69491dda-437f-4d64-aed6-605649d10d76 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] Returning 404 to user: Instance 2c5b301d-f84c-4395-add9-b84311fa785c could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:15:50.570272 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-69491dda-437f-4d64-aed6-605649d10d76 tempest-ServersAdmin275Test-1799629014 tempest-ServersAdmin275Test-1799629014-project] 10.222.0.13 "GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c" status: 404 len: 111 microversion: 2.75 time: 0.046389 Oct 30 01:15:50.571075 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 376/744] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:50 2022] GET /compute/v2.1/servers/2c5b301d-f84c-4395-add9-b84311fa785c => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:15:50.581511 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bb8d3e27-5b97-4bf9-bc9a-52ea5c584930 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:50.582608 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-bb8d3e27-5b97-4bf9-bc9a-52ea5c584930 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: d19d848f-99bc-4f10-b837-d66aaa5258a6] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:50.590009 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb8d3e27-5b97-4bf9-bc9a-52ea5c584930 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:50.593602 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb8d3e27-5b97-4bf9-bc9a-52ea5c584930 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:50.593602 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb8d3e27-5b97-4bf9-bc9a-52ea5c584930 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:50.593602 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb8d3e27-5b97-4bf9-bc9a-52ea5c584930 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:50.593602 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb8d3e27-5b97-4bf9-bc9a-52ea5c584930 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:50.593971 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb8d3e27-5b97-4bf9-bc9a-52ea5c584930 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:50.640308 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c4d1aa49-c92b-40ed-b7bd-9d1fe3e72f10 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:50.650881 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c4d1aa49-c92b-40ed-b7bd-9d1fe3e72f10 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f" status: 200 len: 1477 microversion: 2.1 time: 0.494823 Oct 30 01:15:50.654153 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 369/745] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:50 2022] GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f => generated 1477 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:50.758375 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:50.759834 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9b9e1589-b096-4d7e-af53-9ca4c0225702 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:50.760381 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9b9e1589-b096-4d7e-af53-9ca4c0225702 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 3f60e45a-0e20-4280-be86-275d598fd552] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:50.777650 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b9e1589-b096-4d7e-af53-9ca4c0225702 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:50.778141 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b9e1589-b096-4d7e-af53-9ca4c0225702 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:50.778577 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b9e1589-b096-4d7e-af53-9ca4c0225702 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:50.781169 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=6 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:50.787148 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b9e1589-b096-4d7e-af53-9ca4c0225702 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:50.787655 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b9e1589-b096-4d7e-af53-9ca4c0225702 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:50.788089 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b9e1589-b096-4d7e-af53-9ca4c0225702 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:50.813283 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-bb8d3e27-5b97-4bf9-bc9a-52ea5c584930 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:50.823491 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bb8d3e27-5b97-4bf9-bc9a-52ea5c584930 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/d19d848f-99bc-4f10-b837-d66aaa5258a6" status: 200 len: 1316 microversion: 2.1 time: 0.246978 Oct 30 01:15:50.839234 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 377/746] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:50 2022] GET /compute/v2.1/servers/d19d848f-99bc-4f10-b837-d66aaa5258a6 => generated 1316 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:51.003494 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9b9e1589-b096-4d7e-af53-9ca4c0225702 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:51.014534 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9b9e1589-b096-4d7e-af53-9ca4c0225702 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:51.016195 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9b9e1589-b096-4d7e-af53-9ca4c0225702 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:51.017585 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9b9e1589-b096-4d7e-af53-9ca4c0225702 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552" status: 200 len: 1566 microversion: 2.25 time: 0.262110 Oct 30 01:15:51.018708 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 370/747] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:50 2022] GET /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552 => generated 1566 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:51.083178 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-163d2fd7-0687-4111-8a7c-c8e5657e9039 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:51.084149 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-163d2fd7-0687-4111-8a7c-c8e5657e9039 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] [instance: 60ecf54f-3d14-4927-9d7a-5a26778cad70] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:51.093904 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-163d2fd7-0687-4111-8a7c-c8e5657e9039 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:51.094649 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-163d2fd7-0687-4111-8a7c-c8e5657e9039 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:51.095379 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-163d2fd7-0687-4111-8a7c-c8e5657e9039 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:51.096557 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-163d2fd7-0687-4111-8a7c-c8e5657e9039 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:51.098224 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-163d2fd7-0687-4111-8a7c-c8e5657e9039 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:51.098819 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-163d2fd7-0687-4111-8a7c-c8e5657e9039 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:51.276193 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-163d2fd7-0687-4111-8a7c-c8e5657e9039 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e6512cfbbbf412cbc4c40b80669b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c653b9bf1e064528b2ffe8c9b57fa48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:51.284823 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-163d2fd7-0687-4111-8a7c-c8e5657e9039 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] 10.222.0.13 "GET /compute/v2.1/servers/60ecf54f-3d14-4927-9d7a-5a26778cad70" status: 200 len: 1323 microversion: 2.1 time: 0.209340 Oct 30 01:15:51.285595 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 378/748] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:51 2022] GET /compute/v2.1/servers/60ecf54f-3d14-4927-9d7a-5a26778cad70 => generated 1323 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:51.454910 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-0721bf2c-13b3-412f-98c0-badde190f4d3 req-0899bdf7-5a22-451d-bfa6-fdcd501ca98d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f60e45a-0e20-4280-be86-275d598fd552", "tag": "c8a94bc2-b259-4ae7-9a0e-3c02ee3a39c3"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:51.463779 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-0721bf2c-13b3-412f-98c0-badde190f4d3 req-0899bdf7-5a22-451d-bfa6-fdcd501ca98d service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:51.464257 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-0721bf2c-13b3-412f-98c0-badde190f4d3 req-0899bdf7-5a22-451d-bfa6-fdcd501ca98d service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:51.464680 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-0721bf2c-13b3-412f-98c0-badde190f4d3 req-0899bdf7-5a22-451d-bfa6-fdcd501ca98d service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:51.469456 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=36 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:51.479375 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-0721bf2c-13b3-412f-98c0-badde190f4d3 req-0899bdf7-5a22-451d-bfa6-fdcd501ca98d service nova] Creating event network-changed:c8a94bc2-b259-4ae7-9a0e-3c02ee3a39c3 for instance 3f60e45a-0e20-4280-be86-275d598fd552 on n-h1-master-1 Oct 30 01:15:51.485052 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-0721bf2c-13b3-412f-98c0-badde190f4d3 req-0899bdf7-5a22-451d-bfa6-fdcd501ca98d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036957 Oct 30 01:15:51.496414 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 371/749] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:15:51.544350 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fd54279f-c2ba-46da-be3c-ea3ff54582bd tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:51.544974 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-fd54279f-c2ba-46da-be3c-ea3ff54582bd tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:51.552214 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fd54279f-c2ba-46da-be3c-ea3ff54582bd tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:51.552742 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fd54279f-c2ba-46da-be3c-ea3ff54582bd tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:51.553180 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fd54279f-c2ba-46da-be3c-ea3ff54582bd tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:51.553914 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fd54279f-c2ba-46da-be3c-ea3ff54582bd tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:51.554889 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fd54279f-c2ba-46da-be3c-ea3ff54582bd tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:51.555329 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fd54279f-c2ba-46da-be3c-ea3ff54582bd tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:51.674493 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5e630ed5-3809-4fe5-bad0-6f4a0c0b1b51 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:51.675199 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5e630ed5-3809-4fe5-bad0-6f4a0c0b1b51 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:51.681992 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5e630ed5-3809-4fe5-bad0-6f4a0c0b1b51 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:51.682485 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5e630ed5-3809-4fe5-bad0-6f4a0c0b1b51 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:51.682925 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5e630ed5-3809-4fe5-bad0-6f4a0c0b1b51 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:51.683680 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5e630ed5-3809-4fe5-bad0-6f4a0c0b1b51 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:51.684097 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5e630ed5-3809-4fe5-bad0-6f4a0c0b1b51 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:51.684525 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5e630ed5-3809-4fe5-bad0-6f4a0c0b1b51 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:51.699374 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-fd54279f-c2ba-46da-be3c-ea3ff54582bd tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:51.708074 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fd54279f-c2ba-46da-be3c-ea3ff54582bd tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd" status: 200 len: 1360 microversion: 2.1 time: 0.167855 Oct 30 01:15:51.708649 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 379/750] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:51 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd => generated 1360 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:51.840920 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5e630ed5-3809-4fe5-bad0-6f4a0c0b1b51 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:51.850452 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-927df6a2-dc4e-411f-91df-e52065e92161 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:51.851069 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-927df6a2-dc4e-411f-91df-e52065e92161 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: d19d848f-99bc-4f10-b837-d66aaa5258a6] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:51.864823 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5e630ed5-3809-4fe5-bad0-6f4a0c0b1b51 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f" status: 200 len: 1477 microversion: 2.1 time: 0.194619 Oct 30 01:15:51.865271 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-927df6a2-dc4e-411f-91df-e52065e92161 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:51.866077 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-927df6a2-dc4e-411f-91df-e52065e92161 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:51.867508 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-927df6a2-dc4e-411f-91df-e52065e92161 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:51.868747 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-927df6a2-dc4e-411f-91df-e52065e92161 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:51.868987 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 372/751] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:51 2022] GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f => generated 1477 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:15:51.869679 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-927df6a2-dc4e-411f-91df-e52065e92161 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:51.870296 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-927df6a2-dc4e-411f-91df-e52065e92161 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:52.015850 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-927df6a2-dc4e-411f-91df-e52065e92161 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:52.023689 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-927df6a2-dc4e-411f-91df-e52065e92161 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/d19d848f-99bc-4f10-b837-d66aaa5258a6" status: 200 len: 1316 microversion: 2.1 time: 0.177542 Oct 30 01:15:52.024258 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 380/752] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:51 2022] GET /compute/v2.1/servers/d19d848f-99bc-4f10-b837-d66aaa5258a6 => generated 1316 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:52.051986 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-50cff5b0-fef6-4463-b541-a11744daaa46 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:52.052615 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-50cff5b0-fef6-4463-b541-a11744daaa46 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 3f60e45a-0e20-4280-be86-275d598fd552] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:52.054661 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=5 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:52.061031 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-50cff5b0-fef6-4463-b541-a11744daaa46 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:52.061628 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-50cff5b0-fef6-4463-b541-a11744daaa46 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:52.062125 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-50cff5b0-fef6-4463-b541-a11744daaa46 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:52.062914 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-50cff5b0-fef6-4463-b541-a11744daaa46 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:52.063432 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-50cff5b0-fef6-4463-b541-a11744daaa46 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:52.063858 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-50cff5b0-fef6-4463-b541-a11744daaa46 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:52.264992 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-50cff5b0-fef6-4463-b541-a11744daaa46 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:52.274315 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-50cff5b0-fef6-4463-b541-a11744daaa46 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:52.276323 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-50cff5b0-fef6-4463-b541-a11744daaa46 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:52.278020 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-50cff5b0-fef6-4463-b541-a11744daaa46 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552" status: 200 len: 1566 microversion: 2.25 time: 0.235263 Oct 30 01:15:52.289407 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 373/753] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:52 2022] GET /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552 => generated 1566 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:15:52.289407 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-9d4f6be2-7dfe-4b31-8f0c-fba82c75cda3 req-23afb6b2-ca83-48f4-bd52-6a61a131b455 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60ecf54f-3d14-4927-9d7a-5a26778cad70", "tag": "c2d9c4e2-ae4a-4acf-b671-4697188a5416"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:52.311501 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-9d4f6be2-7dfe-4b31-8f0c-fba82c75cda3 req-23afb6b2-ca83-48f4-bd52-6a61a131b455 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:52.312064 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-9d4f6be2-7dfe-4b31-8f0c-fba82c75cda3 req-23afb6b2-ca83-48f4-bd52-6a61a131b455 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:52.312717 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-9d4f6be2-7dfe-4b31-8f0c-fba82c75cda3 req-23afb6b2-ca83-48f4-bd52-6a61a131b455 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:52.333108 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-9d4f6be2-7dfe-4b31-8f0c-fba82c75cda3 req-23afb6b2-ca83-48f4-bd52-6a61a131b455 service nova] Creating event network-changed:c2d9c4e2-ae4a-4acf-b671-4697188a5416 for instance 60ecf54f-3d14-4927-9d7a-5a26778cad70 on n-h1-master-1 Oct 30 01:15:52.338498 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-9d4f6be2-7dfe-4b31-8f0c-fba82c75cda3 req-23afb6b2-ca83-48f4-bd52-6a61a131b455 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057976 Oct 30 01:15:52.339412 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 374/754] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:15:52.345854 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-12038237-09d4-48e3-9d7a-6738f5a1775c tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:52.346547 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-12038237-09d4-48e3-9d7a-6738f5a1775c tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] [instance: 60ecf54f-3d14-4927-9d7a-5a26778cad70] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:52.353981 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-12038237-09d4-48e3-9d7a-6738f5a1775c tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:52.354481 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-12038237-09d4-48e3-9d7a-6738f5a1775c tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:52.355048 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-12038237-09d4-48e3-9d7a-6738f5a1775c tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:52.355770 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-12038237-09d4-48e3-9d7a-6738f5a1775c tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:52.356227 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-12038237-09d4-48e3-9d7a-6738f5a1775c tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:52.356654 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-12038237-09d4-48e3-9d7a-6738f5a1775c tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:52.397479 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bb9e2bf2-3bd4-4ac8-bf24-9f08f9c72b28 tempest-ServicesAdminNegativeTestJSON-1620884930 tempest-ServicesAdminNegativeTestJSON-1620884930-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:52.401809 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb9e2bf2-3bd4-4ac8-bf24-9f08f9c72b28 tempest-ServicesAdminNegativeTestJSON-1620884930 tempest-ServicesAdminNegativeTestJSON-1620884930-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:52.402474 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb9e2bf2-3bd4-4ac8-bf24-9f08f9c72b28 tempest-ServicesAdminNegativeTestJSON-1620884930 tempest-ServicesAdminNegativeTestJSON-1620884930-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:52.403069 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb9e2bf2-3bd4-4ac8-bf24-9f08f9c72b28 tempest-ServicesAdminNegativeTestJSON-1620884930 tempest-ServicesAdminNegativeTestJSON-1620884930-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:52.403965 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb9e2bf2-3bd4-4ac8-bf24-9f08f9c72b28 tempest-ServicesAdminNegativeTestJSON-1620884930 tempest-ServicesAdminNegativeTestJSON-1620884930-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:52.404580 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb9e2bf2-3bd4-4ac8-bf24-9f08f9c72b28 tempest-ServicesAdminNegativeTestJSON-1620884930 tempest-ServicesAdminNegativeTestJSON-1620884930-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:52.405327 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb9e2bf2-3bd4-4ac8-bf24-9f08f9c72b28 tempest-ServicesAdminNegativeTestJSON-1620884930 tempest-ServicesAdminNegativeTestJSON-1620884930-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:52.436136 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bb9e2bf2-3bd4-4ac8-bf24-9f08f9c72b28 tempest-ServicesAdminNegativeTestJSON-1620884930 tempest-ServicesAdminNegativeTestJSON-1620884930-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.389512 Oct 30 01:15:52.436897 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 381/755] 10.222.0.13 () {58 vars in 1137 bytes} [Sun Oct 30 01:15:52 2022] GET /compute/v2.1/os-services => generated 944 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:15:52.449559 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e8933aac-6d41-4908-8500-cc18c17c178c tempest-ServicesAdminNegativeTestJSON-1620884930 tempest-ServicesAdminNegativeTestJSON-1620884930-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:52.453696 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e8933aac-6d41-4908-8500-cc18c17c178c tempest-ServicesAdminNegativeTestJSON-1620884930 tempest-ServicesAdminNegativeTestJSON-1620884930-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:52.454442 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e8933aac-6d41-4908-8500-cc18c17c178c tempest-ServicesAdminNegativeTestJSON-1620884930 tempest-ServicesAdminNegativeTestJSON-1620884930-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:52.455010 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e8933aac-6d41-4908-8500-cc18c17c178c tempest-ServicesAdminNegativeTestJSON-1620884930 tempest-ServicesAdminNegativeTestJSON-1620884930-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:52.455765 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e8933aac-6d41-4908-8500-cc18c17c178c tempest-ServicesAdminNegativeTestJSON-1620884930 tempest-ServicesAdminNegativeTestJSON-1620884930-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:52.456194 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e8933aac-6d41-4908-8500-cc18c17c178c tempest-ServicesAdminNegativeTestJSON-1620884930 tempest-ServicesAdminNegativeTestJSON-1620884930-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:52.456623 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e8933aac-6d41-4908-8500-cc18c17c178c tempest-ServicesAdminNegativeTestJSON-1620884930 tempest-ServicesAdminNegativeTestJSON-1620884930-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:52.485462 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e8933aac-6d41-4908-8500-cc18c17c178c tempest-ServicesAdminNegativeTestJSON-1620884930 tempest-ServicesAdminNegativeTestJSON-1620884930-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.039471 Oct 30 01:15:52.486161 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 382/756] 10.222.0.13 () {58 vars in 1170 bytes} [Sun Oct 30 01:15:52 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:15:52.502624 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c9630f19-1e7f-4e54-8ee8-a30a8b90bd62 tempest-ServicesAdminNegativeTestJSON-1620884930 tempest-ServicesAdminNegativeTestJSON-1620884930-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:52.506658 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c9630f19-1e7f-4e54-8ee8-a30a8b90bd62 tempest-ServicesAdminNegativeTestJSON-1620884930 tempest-ServicesAdminNegativeTestJSON-1620884930-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:52.507977 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c9630f19-1e7f-4e54-8ee8-a30a8b90bd62 tempest-ServicesAdminNegativeTestJSON-1620884930 tempest-ServicesAdminNegativeTestJSON-1620884930-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:52.508864 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c9630f19-1e7f-4e54-8ee8-a30a8b90bd62 tempest-ServicesAdminNegativeTestJSON-1620884930 tempest-ServicesAdminNegativeTestJSON-1620884930-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:52.509953 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c9630f19-1e7f-4e54-8ee8-a30a8b90bd62 tempest-ServicesAdminNegativeTestJSON-1620884930 tempest-ServicesAdminNegativeTestJSON-1620884930-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:52.510559 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c9630f19-1e7f-4e54-8ee8-a30a8b90bd62 tempest-ServicesAdminNegativeTestJSON-1620884930 tempest-ServicesAdminNegativeTestJSON-1620884930-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:52.511132 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c9630f19-1e7f-4e54-8ee8-a30a8b90bd62 tempest-ServicesAdminNegativeTestJSON-1620884930 tempest-ServicesAdminNegativeTestJSON-1620884930-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:52.540835 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c9630f19-1e7f-4e54-8ee8-a30a8b90bd62 tempest-ServicesAdminNegativeTestJSON-1620884930 tempest-ServicesAdminNegativeTestJSON-1620884930-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.042798 Oct 30 01:15:52.541716 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 383/757] 10.222.0.13 () {58 vars in 1137 bytes} [Sun Oct 30 01:15:52 2022] GET /compute/v2.1/os-services => generated 944 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:15:52.554194 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a9d8983d-26de-4b15-a968-0bafd7f85123 tempest-ServicesAdminNegativeTestJSON-1620884930 tempest-ServicesAdminNegativeTestJSON-1620884930-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:52.558544 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a9d8983d-26de-4b15-a968-0bafd7f85123 tempest-ServicesAdminNegativeTestJSON-1620884930 tempest-ServicesAdminNegativeTestJSON-1620884930-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:52.559124 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a9d8983d-26de-4b15-a968-0bafd7f85123 tempest-ServicesAdminNegativeTestJSON-1620884930 tempest-ServicesAdminNegativeTestJSON-1620884930-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:52.560015 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a9d8983d-26de-4b15-a968-0bafd7f85123 tempest-ServicesAdminNegativeTestJSON-1620884930 tempest-ServicesAdminNegativeTestJSON-1620884930-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:52.560967 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a9d8983d-26de-4b15-a968-0bafd7f85123 tempest-ServicesAdminNegativeTestJSON-1620884930 tempest-ServicesAdminNegativeTestJSON-1620884930-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:52.561606 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a9d8983d-26de-4b15-a968-0bafd7f85123 tempest-ServicesAdminNegativeTestJSON-1620884930 tempest-ServicesAdminNegativeTestJSON-1620884930-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:52.562251 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a9d8983d-26de-4b15-a968-0bafd7f85123 tempest-ServicesAdminNegativeTestJSON-1620884930 tempest-ServicesAdminNegativeTestJSON-1620884930-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:52.590966 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a9d8983d-26de-4b15-a968-0bafd7f85123 tempest-ServicesAdminNegativeTestJSON-1620884930 tempest-ServicesAdminNegativeTestJSON-1620884930-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?host=n-d-master-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.040337 Oct 30 01:15:52.593500 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 384/758] 10.222.0.13 () {58 vars in 1194 bytes} [Sun Oct 30 01:15:52 2022] GET /compute/v2.1/os-services?host=n-d-master-1&binary=xxx => generated 16 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:15:52.604290 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-12038237-09d4-48e3-9d7a-6738f5a1775c tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e6512cfbbbf412cbc4c40b80669b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c653b9bf1e064528b2ffe8c9b57fa48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:52.609484 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0ab960f1-c68e-451f-bb95-b9fa885ab3b8 tempest-ServicesAdminNegativeTestJSON-1620884930 tempest-ServicesAdminNegativeTestJSON-1620884930-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:52.617236 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0ab960f1-c68e-451f-bb95-b9fa885ab3b8 tempest-ServicesAdminNegativeTestJSON-1620884930 tempest-ServicesAdminNegativeTestJSON-1620884930-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:52.618616 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0ab960f1-c68e-451f-bb95-b9fa885ab3b8 tempest-ServicesAdminNegativeTestJSON-1620884930 tempest-ServicesAdminNegativeTestJSON-1620884930-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:52.620128 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0ab960f1-c68e-451f-bb95-b9fa885ab3b8 tempest-ServicesAdminNegativeTestJSON-1620884930 tempest-ServicesAdminNegativeTestJSON-1620884930-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:52.620898 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-12038237-09d4-48e3-9d7a-6738f5a1775c tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] 10.222.0.13 "GET /compute/v2.1/servers/60ecf54f-3d14-4927-9d7a-5a26778cad70" status: 200 len: 1323 microversion: 2.1 time: 0.279739 Oct 30 01:15:52.621428 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0ab960f1-c68e-451f-bb95-b9fa885ab3b8 tempest-ServicesAdminNegativeTestJSON-1620884930 tempest-ServicesAdminNegativeTestJSON-1620884930-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:52.621994 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0ab960f1-c68e-451f-bb95-b9fa885ab3b8 tempest-ServicesAdminNegativeTestJSON-1620884930 tempest-ServicesAdminNegativeTestJSON-1620884930-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:52.622548 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0ab960f1-c68e-451f-bb95-b9fa885ab3b8 tempest-ServicesAdminNegativeTestJSON-1620884930 tempest-ServicesAdminNegativeTestJSON-1620884930-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:52.623835 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 375/759] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:52 2022] GET /compute/v2.1/servers/60ecf54f-3d14-4927-9d7a-5a26778cad70 => generated 1323 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:52.655253 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0ab960f1-c68e-451f-bb95-b9fa885ab3b8 tempest-ServicesAdminNegativeTestJSON-1620884930 tempest-ServicesAdminNegativeTestJSON-1620884930-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.053684 Oct 30 01:15:52.656126 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 385/760] 10.222.0.13 () {58 vars in 1137 bytes} [Sun Oct 30 01:15:52 2022] GET /compute/v2.1/os-services => generated 944 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:15:52.669374 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-81999c23-33a4-4acb-ac08-0c73eef62903 tempest-ServicesAdminNegativeTestJSON-1620884930 tempest-ServicesAdminNegativeTestJSON-1620884930-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:52.673508 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-81999c23-33a4-4acb-ac08-0c73eef62903 tempest-ServicesAdminNegativeTestJSON-1620884930 tempest-ServicesAdminNegativeTestJSON-1620884930-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:52.674186 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-81999c23-33a4-4acb-ac08-0c73eef62903 tempest-ServicesAdminNegativeTestJSON-1620884930 tempest-ServicesAdminNegativeTestJSON-1620884930-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:52.674808 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-81999c23-33a4-4acb-ac08-0c73eef62903 tempest-ServicesAdminNegativeTestJSON-1620884930 tempest-ServicesAdminNegativeTestJSON-1620884930-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:52.675808 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-81999c23-33a4-4acb-ac08-0c73eef62903 tempest-ServicesAdminNegativeTestJSON-1620884930 tempest-ServicesAdminNegativeTestJSON-1620884930-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:52.676437 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-81999c23-33a4-4acb-ac08-0c73eef62903 tempest-ServicesAdminNegativeTestJSON-1620884930 tempest-ServicesAdminNegativeTestJSON-1620884930-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:52.676861 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-81999c23-33a4-4acb-ac08-0c73eef62903 tempest-ServicesAdminNegativeTestJSON-1620884930 tempest-ServicesAdminNegativeTestJSON-1620884930-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:52.702490 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-81999c23-33a4-4acb-ac08-0c73eef62903 tempest-ServicesAdminNegativeTestJSON-1620884930 tempest-ServicesAdminNegativeTestJSON-1620884930-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.037209 Oct 30 01:15:52.703262 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 376/761] 10.222.0.13 () {58 vars in 1198 bytes} [Sun Oct 30 01:15:52 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:15:52.738358 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7b080f58-6d99-431a-b831-7a5aea4d4679 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:52.740353 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7b080f58-6d99-431a-b831-7a5aea4d4679 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:52.747452 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b080f58-6d99-431a-b831-7a5aea4d4679 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:52.748296 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b080f58-6d99-431a-b831-7a5aea4d4679 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:52.748944 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b080f58-6d99-431a-b831-7a5aea4d4679 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:52.750349 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b080f58-6d99-431a-b831-7a5aea4d4679 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:52.751066 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b080f58-6d99-431a-b831-7a5aea4d4679 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:52.751705 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b080f58-6d99-431a-b831-7a5aea4d4679 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:52.976920 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bd21451f-5bbe-460f-ab61-97134dcd1e9a tempest-ServicesAdminNegativeTestJSON-1137622611 tempest-ServicesAdminNegativeTestJSON-1137622611-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:52.982189 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-bd21451f-5bbe-460f-ab61-97134dcd1e9a tempest-ServicesAdminNegativeTestJSON-1137622611 tempest-ServicesAdminNegativeTestJSON-1137622611-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '9ddfb96c41d8427c9e3691dac10c2129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8119c8826f3b448b97c68624dc1deab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:52.984581 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bd21451f-5bbe-460f-ab61-97134dcd1e9a tempest-ServicesAdminNegativeTestJSON-1137622611 tempest-ServicesAdminNegativeTestJSON-1137622611-project] Request method failure captured: Oct 30 01:15:52.984581 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 30 01:15:52.984581 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:15:52.984581 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:15:52.984581 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:15:52.984581 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:15:52.984581 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:15:52.984581 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:15:52.984581 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:15:52.984581 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:15:52.984581 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdBH9jDaLhBADtOBz6YRKlhg6Fsorc-QIRF7kwuEy5MlD0P3zMTV2q8tNf1B32BG-Xqg0yo2CT_zREewBnxAicIjWZEOM5lqkay730yiItBWImF1mXtGAQ2EXM5old9_iDAEIGzN6XJWGfZL3yAu06B8zcyj_-EGUDyukTHPnZgO6iQ Oct 30 01:15:52.984581 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:15:52.984581 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:15:52.984581 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:15:52.984581 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:15:52.984581 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:15:52.984581 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:15:52.984581 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 8119c8826f3b448b97c68624dc1deab3 Oct 30 01:15:52.984581 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1137622611 Oct 30 01:15:52.984581 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:15:52.984581 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:15:52.986080 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8119c8826f3b448b97c68624dc1deab3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8119c8826f3b448b97c68624dc1deab3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8119c8826f3b448b97c68624dc1deab3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8119c8826f3b448b97c68624dc1deab3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:15:52.986080 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1137622611 Oct 30 01:15:52.986080 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 8119c8826f3b448b97c68624dc1deab3 Oct 30 01:15:52.986080 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1137622611 Oct 30 01:15:52.986080 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServicesAdminNegativeTestJSON-1137622611-project Oct 30 01:15:52.986080 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:15:52.986080 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:15:52.986080 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 9ddfb96c41d8427c9e3691dac10c2129 Oct 30 01:15:52.986080 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1137622611-project Oct 30 01:15:52.986080 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:15:52.986080 n-d-master-1 devstack@n-api.service[121103]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 30 01:15:52.986080 n-d-master-1 devstack@n-api.service[121103]: action_args: {} Oct 30 01:15:52.987054 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:15:52.987054 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:15:52.987054 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:15:52.987054 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:15:52.987054 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:15:52.987054 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:15:52.987054 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 30 01:15:52.987054 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:15:52.987054 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 30 01:15:52.987054 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:15:52.987054 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:15:52.987054 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:15:52.987054 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 30 01:15:52.987054 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 30 01:15:52.987054 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 30 01:15:52.987054 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 30 01:15:52.987054 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 30 01:15:52.987054 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 30 01:15:52.987054 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 01:15:52.992917 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 30 01:15:52.992917 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 01:15:52.992917 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise self.value Oct 30 01:15:52.992917 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 30 01:15:52.992917 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 30 01:15:52.992917 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 30 01:15:52.992917 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 30 01:15:52.992917 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 30 01:15:52.992917 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 30 01:15:52.992917 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 30 01:15:52.992917 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:52.992917 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:15:52.992917 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:52.992917 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:15:52.992917 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:15:52.992917 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:15:52.992917 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 30 01:15:52.992917 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 30 01:15:52.992917 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 30 01:15:52.992917 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:15:52.994531 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bd21451f-5bbe-460f-ab61-97134dcd1e9a tempest-ServicesAdminNegativeTestJSON-1137622611 tempest-ServicesAdminNegativeTestJSON-1137622611-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:15:52.994531 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bd21451f-5bbe-460f-ab61-97134dcd1e9a tempest-ServicesAdminNegativeTestJSON-1137622611 tempest-ServicesAdminNegativeTestJSON-1137622611-project] 10.222.0.13 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.275042 Oct 30 01:15:52.994531 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 386/762] 10.222.0.13 () {58 vars in 1137 bytes} [Sun Oct 30 01:15:52 2022] GET /compute/v2.1/os-services => generated 112 bytes in 276 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:15:52.997063 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-443e9154-1009-43b9-af42-b21944be5f7f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:52.997720 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-443e9154-1009-43b9-af42-b21944be5f7f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:53.011136 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-443e9154-1009-43b9-af42-b21944be5f7f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:53.011804 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-443e9154-1009-43b9-af42-b21944be5f7f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:53.016928 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-443e9154-1009-43b9-af42-b21944be5f7f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:53.016928 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-443e9154-1009-43b9-af42-b21944be5f7f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:53.016928 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-443e9154-1009-43b9-af42-b21944be5f7f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:53.016928 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-443e9154-1009-43b9-af42-b21944be5f7f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:53.071369 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7b080f58-6d99-431a-b831-7a5aea4d4679 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:53.086576 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7b080f58-6d99-431a-b831-7a5aea4d4679 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd" status: 200 len: 1360 microversion: 2.1 time: 0.352965 Oct 30 01:15:53.088981 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 377/763] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:52 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd => generated 1360 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:15:53.107474 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0cca0b18-a15d-4e1f-a434-1835ccd05044 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:53.108899 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0cca0b18-a15d-4e1f-a434-1835ccd05044 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: d19d848f-99bc-4f10-b837-d66aaa5258a6] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:53.120111 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0cca0b18-a15d-4e1f-a434-1835ccd05044 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:53.126132 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0cca0b18-a15d-4e1f-a434-1835ccd05044 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:53.126132 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0cca0b18-a15d-4e1f-a434-1835ccd05044 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:53.126132 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0cca0b18-a15d-4e1f-a434-1835ccd05044 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:53.126132 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0cca0b18-a15d-4e1f-a434-1835ccd05044 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:53.126800 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0cca0b18-a15d-4e1f-a434-1835ccd05044 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:53.310844 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-443e9154-1009-43b9-af42-b21944be5f7f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:53.320465 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-443e9154-1009-43b9-af42-b21944be5f7f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f" status: 200 len: 1477 microversion: 2.1 time: 0.331099 Oct 30 01:15:53.321203 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 387/764] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:52 2022] GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f => generated 1477 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:53.328292 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4d6725c5-7d04-43ee-872d-d433bb2b1af7 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:53.329838 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4d6725c5-7d04-43ee-872d-d433bb2b1af7 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 3f60e45a-0e20-4280-be86-275d598fd552] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:53.338322 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4d6725c5-7d04-43ee-872d-d433bb2b1af7 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:53.338969 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4d6725c5-7d04-43ee-872d-d433bb2b1af7 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:53.339504 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4d6725c5-7d04-43ee-872d-d433bb2b1af7 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:53.340327 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4d6725c5-7d04-43ee-872d-d433bb2b1af7 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:53.341038 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4d6725c5-7d04-43ee-872d-d433bb2b1af7 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:53.341756 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4d6725c5-7d04-43ee-872d-d433bb2b1af7 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:53.427318 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0cca0b18-a15d-4e1f-a434-1835ccd05044 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:53.436254 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0cca0b18-a15d-4e1f-a434-1835ccd05044 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/d19d848f-99bc-4f10-b837-d66aaa5258a6" status: 200 len: 1316 microversion: 2.1 time: 0.344709 Oct 30 01:15:53.437575 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 378/765] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:53 2022] GET /compute/v2.1/servers/d19d848f-99bc-4f10-b837-d66aaa5258a6 => generated 1316 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:53.510404 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4d6725c5-7d04-43ee-872d-d433bb2b1af7 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:53.518738 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4d6725c5-7d04-43ee-872d-d433bb2b1af7 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:53.520246 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4d6725c5-7d04-43ee-872d-d433bb2b1af7 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:53.521446 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4d6725c5-7d04-43ee-872d-d433bb2b1af7 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552" status: 200 len: 1566 microversion: 2.25 time: 0.198978 Oct 30 01:15:53.522080 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 388/766] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:53 2022] GET /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552 => generated 1566 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:53.650364 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1baea323-c8c2-4121-a77d-bb052d742f1e tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:53.651078 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1baea323-c8c2-4121-a77d-bb052d742f1e tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] [instance: 60ecf54f-3d14-4927-9d7a-5a26778cad70] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:53.658679 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1baea323-c8c2-4121-a77d-bb052d742f1e tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:53.659845 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1baea323-c8c2-4121-a77d-bb052d742f1e tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:53.660999 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1baea323-c8c2-4121-a77d-bb052d742f1e tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:53.661962 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1baea323-c8c2-4121-a77d-bb052d742f1e tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:53.662611 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1baea323-c8c2-4121-a77d-bb052d742f1e tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:53.663253 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1baea323-c8c2-4121-a77d-bb052d742f1e tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:53.838680 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1baea323-c8c2-4121-a77d-bb052d742f1e tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e6512cfbbbf412cbc4c40b80669b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c653b9bf1e064528b2ffe8c9b57fa48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:53.846396 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1baea323-c8c2-4121-a77d-bb052d742f1e tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] 10.222.0.13 "GET /compute/v2.1/servers/60ecf54f-3d14-4927-9d7a-5a26778cad70" status: 200 len: 1323 microversion: 2.1 time: 0.202161 Oct 30 01:15:53.846984 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 379/767] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:53 2022] GET /compute/v2.1/servers/60ecf54f-3d14-4927-9d7a-5a26778cad70 => generated 1323 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:54.112995 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-44e1ba21-a0c8-4146-8170-8868ef4cf06a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:54.115137 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-44e1ba21-a0c8-4146-8170-8868ef4cf06a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:54.124112 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-44e1ba21-a0c8-4146-8170-8868ef4cf06a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:54.124927 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-44e1ba21-a0c8-4146-8170-8868ef4cf06a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:54.131495 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-44e1ba21-a0c8-4146-8170-8868ef4cf06a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:54.131495 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-44e1ba21-a0c8-4146-8170-8868ef4cf06a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:54.131495 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-44e1ba21-a0c8-4146-8170-8868ef4cf06a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:54.131495 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-44e1ba21-a0c8-4146-8170-8868ef4cf06a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:54.346386 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5344f62c-5933-4c94-9a78-7cc3bc6661ee tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:54.347217 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5344f62c-5933-4c94-9a78-7cc3bc6661ee tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:54.353805 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-44e1ba21-a0c8-4146-8170-8868ef4cf06a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:54.358634 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5344f62c-5933-4c94-9a78-7cc3bc6661ee tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:54.360576 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5344f62c-5933-4c94-9a78-7cc3bc6661ee tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:54.360576 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5344f62c-5933-4c94-9a78-7cc3bc6661ee tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:54.364310 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5344f62c-5933-4c94-9a78-7cc3bc6661ee tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:54.366457 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5344f62c-5933-4c94-9a78-7cc3bc6661ee tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:54.371213 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-44e1ba21-a0c8-4146-8170-8868ef4cf06a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd" status: 200 len: 1360 microversion: 2.1 time: 0.262093 Oct 30 01:15:54.382002 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5344f62c-5933-4c94-9a78-7cc3bc6661ee tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:54.409555 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 389/768] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:54 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd => generated 1360 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:54.462701 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ff83c9a0-78bb-48c3-a2a1-090ca77e3913 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:54.463736 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ff83c9a0-78bb-48c3-a2a1-090ca77e3913 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: d19d848f-99bc-4f10-b837-d66aaa5258a6] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:54.475490 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ff83c9a0-78bb-48c3-a2a1-090ca77e3913 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:54.476153 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ff83c9a0-78bb-48c3-a2a1-090ca77e3913 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:54.476808 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ff83c9a0-78bb-48c3-a2a1-090ca77e3913 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:54.478235 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ff83c9a0-78bb-48c3-a2a1-090ca77e3913 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:54.478999 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ff83c9a0-78bb-48c3-a2a1-090ca77e3913 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:54.479939 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ff83c9a0-78bb-48c3-a2a1-090ca77e3913 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:54.838628 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5344f62c-5933-4c94-9a78-7cc3bc6661ee tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:54.845720 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ff83c9a0-78bb-48c3-a2a1-090ca77e3913 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:54.846405 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5344f62c-5933-4c94-9a78-7cc3bc6661ee tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f" status: 200 len: 1477 microversion: 2.1 time: 0.505847 Oct 30 01:15:54.847125 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 380/769] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:54 2022] GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f => generated 1477 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:54.854555 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ff83c9a0-78bb-48c3-a2a1-090ca77e3913 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/d19d848f-99bc-4f10-b837-d66aaa5258a6" status: 200 len: 1316 microversion: 2.1 time: 0.398206 Oct 30 01:15:54.855234 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 390/770] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:54 2022] GET /compute/v2.1/servers/d19d848f-99bc-4f10-b837-d66aaa5258a6 => generated 1316 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:55.036078 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e31d3199-0f9e-4c55-b9fe-197b89f75fca tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:55.036078 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e31d3199-0f9e-4c55-b9fe-197b89f75fca tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 3f60e45a-0e20-4280-be86-275d598fd552] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:55.036078 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e31d3199-0f9e-4c55-b9fe-197b89f75fca tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:55.037408 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4972abbb-fa6f-4d2d-b0d1-989f9ccee5c9 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:55.037505 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e31d3199-0f9e-4c55-b9fe-197b89f75fca tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:55.037597 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4972abbb-fa6f-4d2d-b0d1-989f9ccee5c9 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] [instance: 60ecf54f-3d14-4927-9d7a-5a26778cad70] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:55.037679 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e31d3199-0f9e-4c55-b9fe-197b89f75fca tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:55.037679 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e31d3199-0f9e-4c55-b9fe-197b89f75fca tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:55.037679 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e31d3199-0f9e-4c55-b9fe-197b89f75fca tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:55.037679 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e31d3199-0f9e-4c55-b9fe-197b89f75fca tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:55.037970 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4972abbb-fa6f-4d2d-b0d1-989f9ccee5c9 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:55.037970 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4972abbb-fa6f-4d2d-b0d1-989f9ccee5c9 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:55.037970 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4972abbb-fa6f-4d2d-b0d1-989f9ccee5c9 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:55.037970 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4972abbb-fa6f-4d2d-b0d1-989f9ccee5c9 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:55.038267 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4972abbb-fa6f-4d2d-b0d1-989f9ccee5c9 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:55.038267 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4972abbb-fa6f-4d2d-b0d1-989f9ccee5c9 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:55.135363 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4972abbb-fa6f-4d2d-b0d1-989f9ccee5c9 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e6512cfbbbf412cbc4c40b80669b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c653b9bf1e064528b2ffe8c9b57fa48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:55.138338 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e31d3199-0f9e-4c55-b9fe-197b89f75fca tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:55.148822 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e31d3199-0f9e-4c55-b9fe-197b89f75fca tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:55.150826 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4972abbb-fa6f-4d2d-b0d1-989f9ccee5c9 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] 10.222.0.13 "GET /compute/v2.1/servers/60ecf54f-3d14-4927-9d7a-5a26778cad70" status: 200 len: 1323 microversion: 2.1 time: 0.284332 Oct 30 01:15:55.151738 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e31d3199-0f9e-4c55-b9fe-197b89f75fca tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:55.153089 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e31d3199-0f9e-4c55-b9fe-197b89f75fca tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552" status: 200 len: 1566 microversion: 2.25 time: 0.294423 Oct 30 01:15:55.153832 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 381/771] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:54 2022] GET /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552 => generated 1566 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:55.156999 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 391/772] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:54 2022] GET /compute/v2.1/servers/60ecf54f-3d14-4927-9d7a-5a26778cad70 => generated 1323 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:15:55.426527 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c3fd6a40-d589-4f77-9e65-68bf26318cfd tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:55.428608 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c3fd6a40-d589-4f77-9e65-68bf26318cfd tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:55.441493 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c3fd6a40-d589-4f77-9e65-68bf26318cfd tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:55.443046 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c3fd6a40-d589-4f77-9e65-68bf26318cfd tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:55.444051 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c3fd6a40-d589-4f77-9e65-68bf26318cfd tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:55.445541 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c3fd6a40-d589-4f77-9e65-68bf26318cfd tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:55.446608 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c3fd6a40-d589-4f77-9e65-68bf26318cfd tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:55.447599 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c3fd6a40-d589-4f77-9e65-68bf26318cfd tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:55.484908 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:55.642042 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-ca6cbf0b-f949-47dd-a758-bc2fd39b2848 req-0c0b54ea-d5dc-4b5c-8315-457f42cfad27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d19d848f-99bc-4f10-b837-d66aaa5258a6", "name": "network-vif-plugged", "status": "completed", "tag": "ae765166-b140-4959-be8f-cb89a2eec37b"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:55.642352 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c3fd6a40-d589-4f77-9e65-68bf26318cfd tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:55.651278 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c3fd6a40-d589-4f77-9e65-68bf26318cfd tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd" status: 200 len: 1360 microversion: 2.1 time: 0.232167 Oct 30 01:15:55.651870 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 382/773] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:55 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd => generated 1360 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:55.658002 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ca6cbf0b-f949-47dd-a758-bc2fd39b2848 req-0c0b54ea-d5dc-4b5c-8315-457f42cfad27 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:55.658562 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ca6cbf0b-f949-47dd-a758-bc2fd39b2848 req-0c0b54ea-d5dc-4b5c-8315-457f42cfad27 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:55.659084 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ca6cbf0b-f949-47dd-a758-bc2fd39b2848 req-0c0b54ea-d5dc-4b5c-8315-457f42cfad27 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:55.671571 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-ca6cbf0b-f949-47dd-a758-bc2fd39b2848 req-0c0b54ea-d5dc-4b5c-8315-457f42cfad27 service nova] Creating event network-vif-plugged:ae765166-b140-4959-be8f-cb89a2eec37b for instance d19d848f-99bc-4f10-b837-d66aaa5258a6 on n-h1-master-1 Oct 30 01:15:55.676996 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-ca6cbf0b-f949-47dd-a758-bc2fd39b2848 req-0c0b54ea-d5dc-4b5c-8315-457f42cfad27 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041241 Oct 30 01:15:55.677692 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 392/774] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:15:55.870587 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1b6e12ce-bdb1-425e-8dac-b565705aa402 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:55.871213 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1b6e12ce-bdb1-425e-8dac-b565705aa402 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:55.881140 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-08cba919-0ea0-496d-bd15-5d6e0a41cbc7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:55.882190 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-08cba919-0ea0-496d-bd15-5d6e0a41cbc7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: d19d848f-99bc-4f10-b837-d66aaa5258a6] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:55.889196 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1b6e12ce-bdb1-425e-8dac-b565705aa402 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:55.903146 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08cba919-0ea0-496d-bd15-5d6e0a41cbc7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:55.903774 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08cba919-0ea0-496d-bd15-5d6e0a41cbc7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:55.908511 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08cba919-0ea0-496d-bd15-5d6e0a41cbc7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:55.908854 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08cba919-0ea0-496d-bd15-5d6e0a41cbc7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:55.909599 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08cba919-0ea0-496d-bd15-5d6e0a41cbc7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:55.910127 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1b6e12ce-bdb1-425e-8dac-b565705aa402 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:55.910620 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1b6e12ce-bdb1-425e-8dac-b565705aa402 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:55.911389 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1b6e12ce-bdb1-425e-8dac-b565705aa402 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:55.911833 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08cba919-0ea0-496d-bd15-5d6e0a41cbc7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:55.911946 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1b6e12ce-bdb1-425e-8dac-b565705aa402 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:55.912289 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1b6e12ce-bdb1-425e-8dac-b565705aa402 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:56.236726 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-08cba919-0ea0-496d-bd15-5d6e0a41cbc7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:56.247221 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-08cba919-0ea0-496d-bd15-5d6e0a41cbc7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/d19d848f-99bc-4f10-b837-d66aaa5258a6" status: 200 len: 1316 microversion: 2.1 time: 0.370860 Oct 30 01:15:56.248979 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 393/775] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:55 2022] GET /compute/v2.1/servers/d19d848f-99bc-4f10-b837-d66aaa5258a6 => generated 1316 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:15:56.251753 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1b6e12ce-bdb1-425e-8dac-b565705aa402 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:56.253249 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f000a82b-5ac8-4499-8ee7-95cd7351165f tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:56.255049 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f000a82b-5ac8-4499-8ee7-95cd7351165f tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] [instance: 60ecf54f-3d14-4927-9d7a-5a26778cad70] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:56.262311 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f000a82b-5ac8-4499-8ee7-95cd7351165f tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:56.263067 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f000a82b-5ac8-4499-8ee7-95cd7351165f tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:56.263487 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f000a82b-5ac8-4499-8ee7-95cd7351165f tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:56.264287 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f000a82b-5ac8-4499-8ee7-95cd7351165f tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:56.264749 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f000a82b-5ac8-4499-8ee7-95cd7351165f tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:56.265314 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f000a82b-5ac8-4499-8ee7-95cd7351165f tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:56.270167 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1b6e12ce-bdb1-425e-8dac-b565705aa402 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f" status: 200 len: 1477 microversion: 2.1 time: 0.403388 Oct 30 01:15:56.270834 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 383/776] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:55 2022] GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f => generated 1477 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:15:56.276436 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c1eb8d61-edab-4f14-9bf3-74e928f12d24 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:56.277256 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c1eb8d61-edab-4f14-9bf3-74e928f12d24 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 3f60e45a-0e20-4280-be86-275d598fd552] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:56.284301 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c1eb8d61-edab-4f14-9bf3-74e928f12d24 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:56.289504 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c1eb8d61-edab-4f14-9bf3-74e928f12d24 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:56.289504 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c1eb8d61-edab-4f14-9bf3-74e928f12d24 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:56.289504 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c1eb8d61-edab-4f14-9bf3-74e928f12d24 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:56.289504 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c1eb8d61-edab-4f14-9bf3-74e928f12d24 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:56.290056 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c1eb8d61-edab-4f14-9bf3-74e928f12d24 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:56.584199 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c1eb8d61-edab-4f14-9bf3-74e928f12d24 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:56.584199 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c1eb8d61-edab-4f14-9bf3-74e928f12d24 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:56.584986 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c1eb8d61-edab-4f14-9bf3-74e928f12d24 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:56.584986 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c1eb8d61-edab-4f14-9bf3-74e928f12d24 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552" status: 200 len: 1566 microversion: 2.25 time: 0.310249 Oct 30 01:15:56.584986 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 384/777] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:56 2022] GET /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552 => generated 1566 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:56.608271 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f000a82b-5ac8-4499-8ee7-95cd7351165f tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e6512cfbbbf412cbc4c40b80669b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c653b9bf1e064528b2ffe8c9b57fa48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:56.616985 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f000a82b-5ac8-4499-8ee7-95cd7351165f tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] 10.222.0.13 "GET /compute/v2.1/servers/60ecf54f-3d14-4927-9d7a-5a26778cad70" status: 200 len: 1323 microversion: 2.1 time: 0.367633 Oct 30 01:15:56.625387 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 394/778] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:56 2022] GET /compute/v2.1/servers/60ecf54f-3d14-4927-9d7a-5a26778cad70 => generated 1323 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:56.674948 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bc0221fb-16b7-4e37-a5ee-b826d60f3650 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:56.675560 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bc0221fb-16b7-4e37-a5ee-b826d60f3650 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:56.682216 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bc0221fb-16b7-4e37-a5ee-b826d60f3650 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:56.682703 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bc0221fb-16b7-4e37-a5ee-b826d60f3650 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:56.683137 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bc0221fb-16b7-4e37-a5ee-b826d60f3650 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:56.684107 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bc0221fb-16b7-4e37-a5ee-b826d60f3650 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:56.684559 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bc0221fb-16b7-4e37-a5ee-b826d60f3650 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:56.685482 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bc0221fb-16b7-4e37-a5ee-b826d60f3650 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:56.879301 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bc0221fb-16b7-4e37-a5ee-b826d60f3650 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:56.887642 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bc0221fb-16b7-4e37-a5ee-b826d60f3650 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd" status: 200 len: 1360 microversion: 2.1 time: 0.216530 Oct 30 01:15:56.901544 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 385/779] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:56 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd => generated 1360 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:56.941691 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8ee3d7a9-725f-4119-8b83-803d02ace270 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-2122024902", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:57.012231 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-8ee3d7a9-725f-4119-8b83-803d02ace270 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] validate_networks() for None {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:15:57.256879 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-8ee3d7a9-725f-4119-8b83-803d02ace270 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:15:57.257491 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-8ee3d7a9-725f-4119-8b83-803d02ace270 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:15:57.258142 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-8ee3d7a9-725f-4119-8b83-803d02ace270 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:15:57.258645 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-8ee3d7a9-725f-4119-8b83-803d02ace270 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:15:57.259150 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-8ee3d7a9-725f-4119-8b83-803d02ace270 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:15:57.272579 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a21b4c3d-c778-4c60-b568-0f77069a27cf tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:57.273313 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a21b4c3d-c778-4c60-b568-0f77069a27cf tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: d19d848f-99bc-4f10-b837-d66aaa5258a6] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:57.279768 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ee3d7a9-725f-4119-8b83-803d02ace270 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:57.280018 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a21b4c3d-c778-4c60-b568-0f77069a27cf tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:57.280564 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a21b4c3d-c778-4c60-b568-0f77069a27cf tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:57.280696 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ee3d7a9-725f-4119-8b83-803d02ace270 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:57.281169 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a21b4c3d-c778-4c60-b568-0f77069a27cf tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:57.281768 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ee3d7a9-725f-4119-8b83-803d02ace270 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:57.281997 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a21b4c3d-c778-4c60-b568-0f77069a27cf tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:57.282525 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a21b4c3d-c778-4c60-b568-0f77069a27cf tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:57.282622 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ee3d7a9-725f-4119-8b83-803d02ace270 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:57.283025 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a21b4c3d-c778-4c60-b568-0f77069a27cf tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:57.283122 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ee3d7a9-725f-4119-8b83-803d02ace270 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:57.283540 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ee3d7a9-725f-4119-8b83-803d02ace270 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:57.305010 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-8ee3d7a9-725f-4119-8b83-803d02ace270 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Getting quotas for project b90a3225f0bb4bb6a90847078c27720d. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:15:57.311225 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-8ee3d7a9-725f-4119-8b83-803d02ace270 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Getting quotas for user f33a2fe009b74c1285df84f614f38866 and project b90a3225f0bb4bb6a90847078c27720d. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:15:57.327984 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8ee3d7a9-725f-4119-8b83-803d02ace270 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:15:57.331470 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8ee3d7a9-725f-4119-8b83-803d02ace270 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:15:57.455814 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a21b4c3d-c778-4c60-b568-0f77069a27cf tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:57.464532 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a21b4c3d-c778-4c60-b568-0f77069a27cf tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/d19d848f-99bc-4f10-b837-d66aaa5258a6" status: 200 len: 1465 microversion: 2.1 time: 0.197636 Oct 30 01:15:57.465122 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 386/780] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:57 2022] GET /compute/v2.1/servers/d19d848f-99bc-4f10-b837-d66aaa5258a6 => generated 1465 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:57.469836 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-29dab581-9d47-4018-9b21-c04a9cb070e7 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:57.470452 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-29dab581-9d47-4018-9b21-c04a9cb070e7 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:57.482315 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-29dab581-9d47-4018-9b21-c04a9cb070e7 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:57.482993 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-29dab581-9d47-4018-9b21-c04a9cb070e7 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:57.483611 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-29dab581-9d47-4018-9b21-c04a9cb070e7 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:57.484562 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-29dab581-9d47-4018-9b21-c04a9cb070e7 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:57.485216 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-29dab581-9d47-4018-9b21-c04a9cb070e7 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:57.485849 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-29dab581-9d47-4018-9b21-c04a9cb070e7 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:57.543750 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8ee3d7a9-725f-4119-8b83-803d02ace270 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.738990 Oct 30 01:15:57.543750 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 395/781] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:15:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:15:57.724598 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-29dab581-9d47-4018-9b21-c04a9cb070e7 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:57.741448 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-29dab581-9d47-4018-9b21-c04a9cb070e7 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f" status: 200 len: 1477 microversion: 2.1 time: 0.275104 Oct 30 01:15:57.742355 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 387/782] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:57 2022] GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f => generated 1477 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:57.771529 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0b2918ac-65ea-408f-87b1-dff0f7459aa9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:57.774720 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0b2918ac-65ea-408f-87b1-dff0f7459aa9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 3f60e45a-0e20-4280-be86-275d598fd552] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:57.797501 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b2918ac-65ea-408f-87b1-dff0f7459aa9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:57.798018 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b2918ac-65ea-408f-87b1-dff0f7459aa9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:57.798429 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b2918ac-65ea-408f-87b1-dff0f7459aa9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:57.799141 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b2918ac-65ea-408f-87b1-dff0f7459aa9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:57.799598 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b2918ac-65ea-408f-87b1-dff0f7459aa9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:57.800021 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b2918ac-65ea-408f-87b1-dff0f7459aa9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:57.943613 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5727235c-4111-4d31-8393-03c038313e4d tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:57.944242 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5727235c-4111-4d31-8393-03c038313e4d tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] [instance: d19d848f-99bc-4f10-b837-d66aaa5258a6] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:57.953898 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5727235c-4111-4d31-8393-03c038313e4d tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:57.958548 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5727235c-4111-4d31-8393-03c038313e4d tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:57.959077 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5727235c-4111-4d31-8393-03c038313e4d tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:57.960031 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5727235c-4111-4d31-8393-03c038313e4d tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:57.960844 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5727235c-4111-4d31-8393-03c038313e4d tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:57.961485 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5727235c-4111-4d31-8393-03c038313e4d tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:57.968236 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=100 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:57.984329 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0b2918ac-65ea-408f-87b1-dff0f7459aa9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:57.996452 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0b2918ac-65ea-408f-87b1-dff0f7459aa9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:57.998430 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0b2918ac-65ea-408f-87b1-dff0f7459aa9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:58.017642 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0b2918ac-65ea-408f-87b1-dff0f7459aa9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552" status: 200 len: 1541 microversion: 2.25 time: 0.255470 Oct 30 01:15:58.017642 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 388/783] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:57 2022] GET /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552 => generated 1541 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:58.017642 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ca271918-7c1b-4be6-b59f-12820857ffb5 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:58.017642 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ca271918-7c1b-4be6-b59f-12820857ffb5 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] [instance: 60ecf54f-3d14-4927-9d7a-5a26778cad70] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:58.026221 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ca271918-7c1b-4be6-b59f-12820857ffb5 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:58.027093 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ca271918-7c1b-4be6-b59f-12820857ffb5 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:58.027738 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ca271918-7c1b-4be6-b59f-12820857ffb5 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:58.028857 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ca271918-7c1b-4be6-b59f-12820857ffb5 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:58.029793 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ca271918-7c1b-4be6-b59f-12820857ffb5 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:58.030461 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ca271918-7c1b-4be6-b59f-12820857ffb5 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:58.216938 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ca271918-7c1b-4be6-b59f-12820857ffb5 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e6512cfbbbf412cbc4c40b80669b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c653b9bf1e064528b2ffe8c9b57fa48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:58.225171 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ca271918-7c1b-4be6-b59f-12820857ffb5 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] 10.222.0.13 "GET /compute/v2.1/servers/60ecf54f-3d14-4927-9d7a-5a26778cad70" status: 200 len: 1323 microversion: 2.1 time: 0.218013 Oct 30 01:15:58.225776 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 389/784] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:58 2022] GET /compute/v2.1/servers/60ecf54f-3d14-4927-9d7a-5a26778cad70 => generated 1323 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:58.230226 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-3d5f2cc3-e51e-476b-b225-952bb4a6d149 req-aa88c5f0-4f38-49bf-89cd-9f39862dd333 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b368660-effb-411d-b713-455fc7fd44cd", "name": "network-vif-plugged", "status": "completed", "tag": "be63e75e-18fe-4000-8f59-5722fd84c310"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:58.241086 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-3d5f2cc3-e51e-476b-b225-952bb4a6d149 req-aa88c5f0-4f38-49bf-89cd-9f39862dd333 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:58.242800 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-3d5f2cc3-e51e-476b-b225-952bb4a6d149 req-aa88c5f0-4f38-49bf-89cd-9f39862dd333 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:58.242800 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-3d5f2cc3-e51e-476b-b225-952bb4a6d149 req-aa88c5f0-4f38-49bf-89cd-9f39862dd333 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:58.253940 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-3d5f2cc3-e51e-476b-b225-952bb4a6d149 req-aa88c5f0-4f38-49bf-89cd-9f39862dd333 service nova] Creating event network-vif-plugged:be63e75e-18fe-4000-8f59-5722fd84c310 for instance 6b368660-effb-411d-b713-455fc7fd44cd on n-h1-master-1 Oct 30 01:15:58.259007 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-3d5f2cc3-e51e-476b-b225-952bb4a6d149 req-aa88c5f0-4f38-49bf-89cd-9f39862dd333 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032099 Oct 30 01:15:58.260131 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 390/785] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:15:58.265483 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-54df710b-e5b6-4d58-a8b1-9d71a87665dc tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1705896174", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:58.323820 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-54df710b-e5b6-4d58-a8b1-9d71a87665dc tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] validate_networks() for None {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:15:58.447795 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5727235c-4111-4d31-8393-03c038313e4d tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/d19d848f-99bc-4f10-b837-d66aaa5258a6" status: 200 len: 1616 microversion: 2.1 time: 0.914772 Oct 30 01:15:58.452775 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 396/786] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:57 2022] GET /compute/v2.1/servers/d19d848f-99bc-4f10-b837-d66aaa5258a6 => generated 1616 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:58.458300 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e8b891cf-6d14-453e-b001-854069b83903 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:58.461686 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e8b891cf-6d14-453e-b001-854069b83903 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:58.469181 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e8b891cf-6d14-453e-b001-854069b83903 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:58.469715 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e8b891cf-6d14-453e-b001-854069b83903 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:58.470352 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e8b891cf-6d14-453e-b001-854069b83903 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:58.471080 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e8b891cf-6d14-453e-b001-854069b83903 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:58.472423 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e8b891cf-6d14-453e-b001-854069b83903 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:58.473026 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e8b891cf-6d14-453e-b001-854069b83903 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:58.663375 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-54df710b-e5b6-4d58-a8b1-9d71a87665dc tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:15:58.664271 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-54df710b-e5b6-4d58-a8b1-9d71a87665dc tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:15:58.664743 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-54df710b-e5b6-4d58-a8b1-9d71a87665dc tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:15:58.665906 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-54df710b-e5b6-4d58-a8b1-9d71a87665dc tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:15:58.666480 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-54df710b-e5b6-4d58-a8b1-9d71a87665dc tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:15:58.677275 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-54df710b-e5b6-4d58-a8b1-9d71a87665dc tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:58.680743 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-54df710b-e5b6-4d58-a8b1-9d71a87665dc tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:58.680743 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-54df710b-e5b6-4d58-a8b1-9d71a87665dc tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:58.680743 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-54df710b-e5b6-4d58-a8b1-9d71a87665dc tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:58.680743 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-54df710b-e5b6-4d58-a8b1-9d71a87665dc tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:58.681137 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-54df710b-e5b6-4d58-a8b1-9d71a87665dc tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:58.694134 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e8b891cf-6d14-453e-b001-854069b83903 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:58.699380 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-54df710b-e5b6-4d58-a8b1-9d71a87665dc tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Getting quotas for project b90a3225f0bb4bb6a90847078c27720d. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:15:58.702577 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e8b891cf-6d14-453e-b001-854069b83903 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd" status: 200 len: 1360 microversion: 2.1 time: 0.248280 Oct 30 01:15:58.703467 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 397/787] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:58 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd => generated 1360 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:58.717553 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-54df710b-e5b6-4d58-a8b1-9d71a87665dc tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Getting quotas for user f33a2fe009b74c1285df84f614f38866 and project b90a3225f0bb4bb6a90847078c27720d. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:15:58.717553 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-54df710b-e5b6-4d58-a8b1-9d71a87665dc tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:15:58.720241 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-54df710b-e5b6-4d58-a8b1-9d71a87665dc tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: 25a595ee-91e9-4d66-9898-15c577c9bcec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:15:58.725119 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3fce251e-cdef-4a7e-aa6a-986d2c2166ac tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Calling method '.version_select at 0x7f44cc71f670>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:58.729076 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3fce251e-cdef-4a7e-aa6a-986d2c2166ac tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:58.729762 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3fce251e-cdef-4a7e-aa6a-986d2c2166ac tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:58.730467 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3fce251e-cdef-4a7e-aa6a-986d2c2166ac tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:58.741430 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3fce251e-cdef-4a7e-aa6a-986d2c2166ac tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] 10.222.0.13 "GET /compute/v2.1/os-migrations" status: 200 len: 2364 microversion: 2.25 time: 0.021567 Oct 30 01:15:58.742039 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 398/788] 10.222.0.13 () {60 vars in 1184 bytes} [Sun Oct 30 01:15:58 2022] GET /compute/v2.1/os-migrations => generated 2364 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:58.748450 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-57032dc6-5127-4c84-81eb-a9ee4849f357 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Action: 'create', calling method: .version_select at 0x7f44cc78f5e0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-35611321", "policies": ["affinity"]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:58.776116 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-57032dc6-5127-4c84-81eb-a9ee4849f357 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Getting quotas for project 76b6f7b705f5428b9a3a3a8c4f86ff48. Resources: {'server_groups'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:15:58.778313 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:58.781260 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-57032dc6-5127-4c84-81eb-a9ee4849f357 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Getting quotas for user c536d41a93ad4337909fe2e2cb949e03 and project 76b6f7b705f5428b9a3a3a8c4f86ff48. Resources: {'server_groups'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:15:58.859143 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-54df710b-e5b6-4d58-a8b1-9d71a87665dc tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.597590 Oct 30 01:15:58.859984 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 391/789] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:15:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:15:58.878508 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2c87b2e4-916a-4715-806d-d900fef125a9 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:58.879428 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2c87b2e4-916a-4715-806d-d900fef125a9 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] [instance: 3f60e45a-0e20-4280-be86-275d598fd552] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:58.884125 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-57032dc6-5127-4c84-81eb-a9ee4849f357 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Getting quotas for project 76b6f7b705f5428b9a3a3a8c4f86ff48. Resources: {'server_groups'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:15:58.890754 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-57032dc6-5127-4c84-81eb-a9ee4849f357 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Getting quotas for user c536d41a93ad4337909fe2e2cb949e03 and project 76b6f7b705f5428b9a3a3a8c4f86ff48. Resources: {'server_groups'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:15:58.890887 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:58.892723 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2c87b2e4-916a-4715-806d-d900fef125a9 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:58.893220 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2c87b2e4-916a-4715-806d-d900fef125a9 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:58.893686 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2c87b2e4-916a-4715-806d-d900fef125a9 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:58.894525 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2c87b2e4-916a-4715-806d-d900fef125a9 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:58.894991 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2c87b2e4-916a-4715-806d-d900fef125a9 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:58.895417 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2c87b2e4-916a-4715-806d-d900fef125a9 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:58.908278 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-57032dc6-5127-4c84-81eb-a9ee4849f357 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "POST /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.163902 Oct 30 01:15:58.908278 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 399/790] 10.222.0.13 () {60 vars in 1174 bytes} [Sun Oct 30 01:15:58 2022] POST /compute/v2.1/os-server-groups => generated 186 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:15:58.912896 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-80c084be-b23d-4ed3-b5e9-72727a3ebaea tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:58.913552 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-80c084be-b23d-4ed3-b5e9-72727a3ebaea tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:58.919706 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-80c084be-b23d-4ed3-b5e9-72727a3ebaea tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:58.920466 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-80c084be-b23d-4ed3-b5e9-72727a3ebaea tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:58.921100 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-80c084be-b23d-4ed3-b5e9-72727a3ebaea tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:58.926595 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-80c084be-b23d-4ed3-b5e9-72727a3ebaea tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:58.926595 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-80c084be-b23d-4ed3-b5e9-72727a3ebaea tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:58.926595 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-80c084be-b23d-4ed3-b5e9-72727a3ebaea tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:59.146087 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-80c084be-b23d-4ed3-b5e9-72727a3ebaea tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:59.154797 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-80c084be-b23d-4ed3-b5e9-72727a3ebaea tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f" status: 200 len: 1477 microversion: 2.1 time: 0.246007 Oct 30 01:15:59.162313 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-2c87b2e4-916a-4715-806d-d900fef125a9 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lazy-loading 'services' on Instance uuid 3f60e45a-0e20-4280-be86-275d598fd552 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:15:59.169780 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 400/791] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:58 2022] GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f => generated 1477 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:59.176783 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d7f30807-d4d6-4c09-b8d5-c3eb647a1c21 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:59.177538 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d7f30807-d4d6-4c09-b8d5-c3eb647a1c21 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: 25a595ee-91e9-4d66-9898-15c577c9bcec] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:59.180172 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2c87b2e4-916a-4715-806d-d900fef125a9 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552" status: 200 len: 2033 microversion: 2.25 time: 0.314371 Oct 30 01:15:59.181110 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 392/792] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:15:58 2022] GET /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552 => generated 2033 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:15:59.249975 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d7f30807-d4d6-4c09-b8d5-c3eb647a1c21 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:59.257134 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d7f30807-d4d6-4c09-b8d5-c3eb647a1c21 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/25a595ee-91e9-4d66-9898-15c577c9bcec" status: 200 len: 1214 microversion: 2.1 time: 0.086227 Oct 30 01:15:59.257741 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 401/793] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:59 2022] GET /compute/v2.1/servers/25a595ee-91e9-4d66-9898-15c577c9bcec => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:59.262327 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-daed0d5f-2ae7-4191-9a3d-5cdcea4bc8fd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1376524116", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "c7c0390c-1b84-4cf1-ac23-fcc988b47bcf"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:59.323432 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7d6695b7-f095-473b-b03b-e2ff3a13a605 tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Action: 'update', calling method: .version_select at 0x7f44cc5d5d30>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:59.328690 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7d6695b7-f095-473b-b03b-e2ff3a13a605 tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:59.329192 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7d6695b7-f095-473b-b03b-e2ff3a13a605 tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:59.329654 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7d6695b7-f095-473b-b03b-e2ff3a13a605 tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:59.332404 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-daed0d5f-2ae7-4191-9a3d-5cdcea4bc8fd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] validate_networks() for None {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:15:59.339889 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7d6695b7-f095-473b-b03b-e2ff3a13a605 tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:59.340484 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7d6695b7-f095-473b-b03b-e2ff3a13a605 tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:59.340918 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7d6695b7-f095-473b-b03b-e2ff3a13a605 tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:59.353623 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-7d6695b7-f095-473b-b03b-e2ff3a13a605 tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] HTTP exception thrown: Service 1f8fd3ff-26f3-424d-9905-097db8f450f1 could not be found. Oct 30 01:15:59.356907 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7d6695b7-f095-473b-b03b-e2ff3a13a605 tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Request method failure captured: Oct 30 01:15:59.356907 n-d-master-1 devstack@n-api.service[121102]: request: PUT /compute/v2.1/os-services/1f8fd3ff-26f3-424d-9905-097db8f450f1 HTTP/1.1 Oct 30 01:15:59.356907 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:15:59.356907 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:15:59.356907 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:15:59.356907 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 56 Oct 30 01:15:59.356907 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:15:59.356907 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:15:59.356907 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:15:59.356907 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:15:59.356907 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdBOz9gYS0CKExBRLjiLYsoQCK1xItz9baPpBupQEb4-8AQ7a687t8SVGHKPheJKdl8X7WfkZiqYXPkspngIw1PCg6n2Uwq0pkNvn693GAnFCBqC1McApWU8yOBEzXaBBAHDfD1evkNU26zObZJ5yDrBtkuN7I82mZreBkb2IOqzJBk Oct 30 01:15:59.356907 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:15:59.356907 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:15:59.356907 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:15:59.356907 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:15:59.356907 n-d-master-1 devstack@n-api.service[121102]: X-Openstack-Nova-Api-Version: 2.53 Oct 30 01:15:59.356907 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:15:59.356907 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:15:59.356907 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 809924b4f9694e9c937d5220397454e5 Oct 30 01:15:59.356907 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1133195310 Oct 30 01:15:59.356907 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,admin,reader Oct 30 01:15:59.356907 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,admin,reader Oct 30 01:15:59.366448 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/809924b4f9694e9c937d5220397454e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_809924b4f9694e9c937d5220397454e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/809924b4f9694e9c937d5220397454e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/809924b4f9694e9c937d5220397454e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:15:59.366448 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1133195310 Oct 30 01:15:59.366448 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 809924b4f9694e9c937d5220397454e5 Oct 30 01:15:59.366448 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1133195310 Oct 30 01:15:59.366448 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin Oct 30 01:15:59.366448 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:15:59.366448 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:15:59.366448 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 8a03d244579c4ed9b4d0a10079edd840 Oct 30 01:15:59.366448 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin Oct 30 01:15:59.366448 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:15:59.366448 n-d-master-1 devstack@n-api.service[121102]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 30 01:15:59.366448 n-d-master-1 devstack@n-api.service[121102]: method: Oct 30 01:15:59.366448 n-d-master-1 devstack@n-api.service[121102]: exception: Service 1f8fd3ff-26f3-424d-9905-097db8f450f1 could not be found. Oct 30 01:15:59.367672 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '1f8fd3ff-26f3-424d-9905-097db8f450f1', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 30 01:15:59.367672 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:15:59.367672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:15:59.367672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 30 01:15:59.367672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 30 01:15:59.367672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 30 01:15:59.367672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 30 01:15:59.367672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 30 01:15:59.367672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:15:59.367672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:15:59.367672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:15:59.367672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:15:59.367672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 30 01:15:59.367672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 30 01:15:59.367672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 30 01:15:59.367672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 30 01:15:59.367672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 1f8fd3ff-26f3-424d-9905-097db8f450f1 could not be found. Oct 30 01:15:59.367672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:15:59.367672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:15:59.367672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:15:59.367672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:15:59.369239 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:15:59.369239 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:15:59.369239 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:15:59.369239 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:15:59.369239 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:15:59.369239 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:15:59.369239 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:15:59.369239 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:15:59.369239 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:15:59.369239 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:15:59.369239 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 30 01:15:59.369239 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:15:59.369239 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 1f8fd3ff-26f3-424d-9905-097db8f450f1 could not be found. Oct 30 01:15:59.369239 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:15:59.369239 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:15:59.369239 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:15:59.369239 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:15:59.369239 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:15:59.369239 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:15:59.369239 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:15:59.370772 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:15:59.370772 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 1f8fd3ff-26f3-424d-9905-097db8f450f1 could not be found. Oct 30 01:15:59.370772 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:15:59.370772 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7d6695b7-f095-473b-b03b-e2ff3a13a605 tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Returning 404 to user: Service 1f8fd3ff-26f3-424d-9905-097db8f450f1 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:15:59.370772 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7d6695b7-f095-473b-b03b-e2ff3a13a605 tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-services/1f8fd3ff-26f3-424d-9905-097db8f450f1" status: 404 len: 110 microversion: 2.53 time: 0.176009 Oct 30 01:15:59.370772 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 393/794] 10.222.0.13 () {62 vars in 1309 bytes} [Sun Oct 30 01:15:59 2022] PUT /compute/v2.1/os-services/1f8fd3ff-26f3-424d-9905-097db8f450f1 => generated 110 bytes in 178 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:15:59.371263 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-881673db-806f-452a-acae-e637b9f17f49 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Action: 'create', calling method: .version_select at 0x7f44cc9450d0>, body: {"keypair": {"name": "tempest-keypair-1016787881", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPvh85+2n5f+eE6zSVZYDKnDk90uaUnnjXBzSc4Q8kwsq976oxtJmiJ+51+MBuFRtts15NNDlMYaCHlo7U12yxcO9s7i475XiqadvQMSBRKtNFcmOG5+hXTmIdbr052r1A=="}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:59.385174 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-881673db-806f-452a-acae-e637b9f17f49 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Getting quotas for project 301cee87901844ed94e635eca054960d. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:15:59.391997 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-881673db-806f-452a-acae-e637b9f17f49 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Getting quotas for user 2096bbb8aff742b1837931e52ac1c9ae and project 301cee87901844ed94e635eca054960d. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:15:59.497052 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-881673db-806f-452a-acae-e637b9f17f49 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.136193 Oct 30 01:15:59.498031 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 394/795] 10.222.0.13 () {62 vars in 1200 bytes} [Sun Oct 30 01:15:59 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 138 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 30 01:15:59.504259 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-870148e7-2c52-4185-a153-b066e6260a9b tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:59.506368 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-870148e7-2c52-4185-a153-b066e6260a9b tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] [instance: 60ecf54f-3d14-4927-9d7a-5a26778cad70] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:59.515003 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-870148e7-2c52-4185-a153-b066e6260a9b tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:59.515477 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-870148e7-2c52-4185-a153-b066e6260a9b tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:59.515914 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-870148e7-2c52-4185-a153-b066e6260a9b tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:59.516996 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-870148e7-2c52-4185-a153-b066e6260a9b tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:59.517407 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-870148e7-2c52-4185-a153-b066e6260a9b tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:59.517839 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-870148e7-2c52-4185-a153-b066e6260a9b tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:59.864779 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-870148e7-2c52-4185-a153-b066e6260a9b tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e6512cfbbbf412cbc4c40b80669b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c653b9bf1e064528b2ffe8c9b57fa48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:15:59.872943 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-870148e7-2c52-4185-a153-b066e6260a9b tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] 10.222.0.13 "GET /compute/v2.1/servers/60ecf54f-3d14-4927-9d7a-5a26778cad70" status: 200 len: 1323 microversion: 2.1 time: 0.373337 Oct 30 01:15:59.873565 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 395/796] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:59 2022] GET /compute/v2.1/servers/60ecf54f-3d14-4927-9d7a-5a26778cad70 => generated 1323 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:15:59.894332 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-caf7c6e0-09de-4230-812c-57d39a8a9baa tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Action: 'update', calling method: .version_select at 0x7f44ccb30160>, body: {"status": "disabled"} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:15:59.903943 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-caf7c6e0-09de-4230-812c-57d39a8a9baa tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:59.903943 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-caf7c6e0-09de-4230-812c-57d39a8a9baa tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:59.903943 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-caf7c6e0-09de-4230-812c-57d39a8a9baa tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:59.905361 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-caf7c6e0-09de-4230-812c-57d39a8a9baa tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:59.905883 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-caf7c6e0-09de-4230-812c-57d39a8a9baa tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:59.906588 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-caf7c6e0-09de-4230-812c-57d39a8a9baa tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:59.912461 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-caf7c6e0-09de-4230-812c-57d39a8a9baa tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] HTTP exception thrown: Service 1f8fd3ff-26f3-424d-9905-097db8f450f1 could not be found. Oct 30 01:15:59.914114 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-caf7c6e0-09de-4230-812c-57d39a8a9baa tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Request method failure captured: Oct 30 01:15:59.914114 n-d-master-1 devstack@n-api.service[121102]: request: PUT /compute/v2.1/os-services/1f8fd3ff-26f3-424d-9905-097db8f450f1 HTTP/1.1 Oct 30 01:15:59.914114 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:15:59.914114 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:15:59.914114 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:15:59.914114 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 22 Oct 30 01:15:59.914114 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:15:59.914114 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:15:59.914114 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:15:59.914114 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:15:59.914114 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdBOz9gYS0CKExBRLjiLYsoQCK1xItz9baPpBupQEb4-8AQ7a687t8SVGHKPheJKdl8X7WfkZiqYXPkspngIw1PCg6n2Uwq0pkNvn693GAnFCBqC1McApWU8yOBEzXaBBAHDfD1evkNU26zObZJ5yDrBtkuN7I82mZreBkb2IOqzJBk Oct 30 01:15:59.914114 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:15:59.914114 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:15:59.914114 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:15:59.914114 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:15:59.914114 n-d-master-1 devstack@n-api.service[121102]: X-Openstack-Nova-Api-Version: 2.53 Oct 30 01:15:59.914114 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:15:59.914114 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:15:59.914114 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 809924b4f9694e9c937d5220397454e5 Oct 30 01:15:59.914114 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1133195310 Oct 30 01:15:59.914114 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,admin,reader Oct 30 01:15:59.914114 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,admin,reader Oct 30 01:15:59.915814 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/809924b4f9694e9c937d5220397454e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_809924b4f9694e9c937d5220397454e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/809924b4f9694e9c937d5220397454e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/809924b4f9694e9c937d5220397454e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:15:59.915814 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1133195310 Oct 30 01:15:59.915814 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 809924b4f9694e9c937d5220397454e5 Oct 30 01:15:59.915814 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1133195310 Oct 30 01:15:59.915814 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin Oct 30 01:15:59.915814 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:15:59.915814 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:15:59.915814 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 8a03d244579c4ed9b4d0a10079edd840 Oct 30 01:15:59.915814 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin Oct 30 01:15:59.915814 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:15:59.915814 n-d-master-1 devstack@n-api.service[121102]: {"status": "disabled"} Oct 30 01:15:59.915814 n-d-master-1 devstack@n-api.service[121102]: method: Oct 30 01:15:59.915814 n-d-master-1 devstack@n-api.service[121102]: exception: Service 1f8fd3ff-26f3-424d-9905-097db8f450f1 could not be found. Oct 30 01:15:59.915814 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '1f8fd3ff-26f3-424d-9905-097db8f450f1', 'body': {'status': 'disabled'}} Oct 30 01:15:59.916680 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:15:59.916680 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:15:59.916680 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 30 01:15:59.916680 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 30 01:15:59.916680 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 30 01:15:59.916680 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 30 01:15:59.916680 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 30 01:15:59.916680 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:15:59.916680 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:15:59.916680 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:15:59.916680 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:15:59.916680 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 30 01:15:59.916680 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 30 01:15:59.916680 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 30 01:15:59.916680 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 30 01:15:59.916680 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 1f8fd3ff-26f3-424d-9905-097db8f450f1 could not be found. Oct 30 01:15:59.916680 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:15:59.916680 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:15:59.916680 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:15:59.916680 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:15:59.916680 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:15:59.919008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:15:59.919008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:15:59.919008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:15:59.919008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:15:59.919008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:15:59.919008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:15:59.919008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:15:59.919008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:15:59.919008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:15:59.919008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 30 01:15:59.919008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:15:59.919008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 1f8fd3ff-26f3-424d-9905-097db8f450f1 could not be found. Oct 30 01:15:59.919008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:15:59.919008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:15:59.919008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:15:59.919008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:15:59.919008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:15:59.919008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:15:59.919008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:15:59.919008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:15:59.922085 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 1f8fd3ff-26f3-424d-9905-097db8f450f1 could not be found. Oct 30 01:15:59.922085 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:15:59.922371 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-daed0d5f-2ae7-4191-9a3d-5cdcea4bc8fd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:15:59.922868 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-caf7c6e0-09de-4230-812c-57d39a8a9baa tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Returning 404 to user: Service 1f8fd3ff-26f3-424d-9905-097db8f450f1 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:15:59.923032 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-daed0d5f-2ae7-4191-9a3d-5cdcea4bc8fd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:15:59.923032 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-daed0d5f-2ae7-4191-9a3d-5cdcea4bc8fd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:15:59.923362 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-caf7c6e0-09de-4230-812c-57d39a8a9baa tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-services/1f8fd3ff-26f3-424d-9905-097db8f450f1" status: 404 len: 110 microversion: 2.53 time: 0.028936 Oct 30 01:15:59.923519 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-daed0d5f-2ae7-4191-9a3d-5cdcea4bc8fd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:15:59.923671 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 396/797] 10.222.0.13 () {62 vars in 1309 bytes} [Sun Oct 30 01:15:59 2022] PUT /compute/v2.1/os-services/1f8fd3ff-26f3-424d-9905-097db8f450f1 => generated 110 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:15:59.923818 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-daed0d5f-2ae7-4191-9a3d-5cdcea4bc8fd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:15:59.923981 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0312c320-05a7-40f6-bb9c-8a09527e45f2 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:15:59.924358 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0312c320-05a7-40f6-bb9c-8a09527e45f2 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:15:59.938991 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0312c320-05a7-40f6-bb9c-8a09527e45f2 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:59.939489 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0312c320-05a7-40f6-bb9c-8a09527e45f2 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:59.940032 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0312c320-05a7-40f6-bb9c-8a09527e45f2 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:59.940810 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0312c320-05a7-40f6-bb9c-8a09527e45f2 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:59.941959 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0312c320-05a7-40f6-bb9c-8a09527e45f2 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:59.942391 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0312c320-05a7-40f6-bb9c-8a09527e45f2 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:59.975414 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-daed0d5f-2ae7-4191-9a3d-5cdcea4bc8fd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:59.976061 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-daed0d5f-2ae7-4191-9a3d-5cdcea4bc8fd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:59.977444 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-daed0d5f-2ae7-4191-9a3d-5cdcea4bc8fd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:59.983719 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-daed0d5f-2ae7-4191-9a3d-5cdcea4bc8fd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:15:59.983719 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-daed0d5f-2ae7-4191-9a3d-5cdcea4bc8fd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:15:59.983719 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-daed0d5f-2ae7-4191-9a3d-5cdcea4bc8fd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:15:59.999255 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-daed0d5f-2ae7-4191-9a3d-5cdcea4bc8fd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Getting quotas for project 76b6f7b705f5428b9a3a3a8c4f86ff48. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:16:00.005329 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-daed0d5f-2ae7-4191-9a3d-5cdcea4bc8fd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Getting quotas for user c536d41a93ad4337909fe2e2cb949e03 and project 76b6f7b705f5428b9a3a3a8c4f86ff48. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:16:00.021220 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-daed0d5f-2ae7-4191-9a3d-5cdcea4bc8fd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Going to run 2 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:16:00.021220 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-daed0d5f-2ae7-4191-9a3d-5cdcea4bc8fd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: a294dd33-efb1-4d8b-a83c-817b50cdc138] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:16:00.097724 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0312c320-05a7-40f6-bb9c-8a09527e45f2 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:00.114100 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0312c320-05a7-40f6-bb9c-8a09527e45f2 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd" status: 200 len: 1543 microversion: 2.1 time: 0.194813 Oct 30 01:16:00.115442 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 397/798] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:15:59 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd => generated 1543 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:00.127259 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-945a3513-f40e-47d2-857c-d05468ac97eb tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Action: 'update', calling method: .version_select at 0x7f44cc6f5ca0>, body: {"status": "enabled"} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:16:00.131653 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-945a3513-f40e-47d2-857c-d05468ac97eb tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:00.132688 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-945a3513-f40e-47d2-857c-d05468ac97eb tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:00.134536 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-945a3513-f40e-47d2-857c-d05468ac97eb tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:00.144009 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-945a3513-f40e-47d2-857c-d05468ac97eb tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:00.145244 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-945a3513-f40e-47d2-857c-d05468ac97eb tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:00.146325 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-945a3513-f40e-47d2-857c-d05468ac97eb tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:00.148095 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-daed0d5f-2ae7-4191-9a3d-5cdcea4bc8fd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=121103) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 30 01:16:00.156927 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-945a3513-f40e-47d2-857c-d05468ac97eb tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] HTTP exception thrown: Service 1f8fd3ff-26f3-424d-9905-097db8f450f1 could not be found. Oct 30 01:16:00.160744 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-945a3513-f40e-47d2-857c-d05468ac97eb tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Request method failure captured: Oct 30 01:16:00.160744 n-d-master-1 devstack@n-api.service[121102]: request: PUT /compute/v2.1/os-services/1f8fd3ff-26f3-424d-9905-097db8f450f1 HTTP/1.1 Oct 30 01:16:00.160744 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:16:00.160744 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:16:00.160744 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:16:00.160744 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 21 Oct 30 01:16:00.160744 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:16:00.160744 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:16:00.160744 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:16:00.160744 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:16:00.160744 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdBOz9gYS0CKExBRLjiLYsoQCK1xItz9baPpBupQEb4-8AQ7a687t8SVGHKPheJKdl8X7WfkZiqYXPkspngIw1PCg6n2Uwq0pkNvn693GAnFCBqC1McApWU8yOBEzXaBBAHDfD1evkNU26zObZJ5yDrBtkuN7I82mZreBkb2IOqzJBk Oct 30 01:16:00.160744 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:16:00.160744 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:16:00.160744 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:16:00.160744 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:16:00.160744 n-d-master-1 devstack@n-api.service[121102]: X-Openstack-Nova-Api-Version: 2.53 Oct 30 01:16:00.160744 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:16:00.160744 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:16:00.160744 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 809924b4f9694e9c937d5220397454e5 Oct 30 01:16:00.160744 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1133195310 Oct 30 01:16:00.160744 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,admin,reader Oct 30 01:16:00.160744 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,admin,reader Oct 30 01:16:00.162564 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/809924b4f9694e9c937d5220397454e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_809924b4f9694e9c937d5220397454e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/809924b4f9694e9c937d5220397454e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/809924b4f9694e9c937d5220397454e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:16:00.162564 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1133195310 Oct 30 01:16:00.162564 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 809924b4f9694e9c937d5220397454e5 Oct 30 01:16:00.162564 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1133195310 Oct 30 01:16:00.162564 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin Oct 30 01:16:00.162564 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:16:00.162564 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:16:00.162564 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 8a03d244579c4ed9b4d0a10079edd840 Oct 30 01:16:00.162564 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin Oct 30 01:16:00.162564 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:16:00.162564 n-d-master-1 devstack@n-api.service[121102]: {"status": "enabled"} Oct 30 01:16:00.162564 n-d-master-1 devstack@n-api.service[121102]: method: Oct 30 01:16:00.162564 n-d-master-1 devstack@n-api.service[121102]: exception: Service 1f8fd3ff-26f3-424d-9905-097db8f450f1 could not be found. Oct 30 01:16:00.162564 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '1f8fd3ff-26f3-424d-9905-097db8f450f1', 'body': {'status': 'enabled'}} Oct 30 01:16:00.163406 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:16:00.163406 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:16:00.163406 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 30 01:16:00.163406 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 30 01:16:00.163406 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 30 01:16:00.163406 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 30 01:16:00.163406 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 30 01:16:00.163406 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:16:00.163406 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:16:00.163406 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:16:00.163406 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:16:00.163406 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 30 01:16:00.163406 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 30 01:16:00.163406 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 30 01:16:00.163406 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 30 01:16:00.163406 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 1f8fd3ff-26f3-424d-9905-097db8f450f1 could not be found. Oct 30 01:16:00.163406 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:16:00.163406 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:16:00.163406 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:16:00.163406 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:16:00.163406 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:16:00.164600 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:16:00.164600 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:16:00.164600 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:16:00.164600 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:16:00.164600 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:16:00.164600 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:16:00.164600 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:16:00.164600 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:16:00.164600 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:16:00.164600 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 30 01:16:00.164600 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:16:00.164600 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 1f8fd3ff-26f3-424d-9905-097db8f450f1 could not be found. Oct 30 01:16:00.164600 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:16:00.164600 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:16:00.164600 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:16:00.164600 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:16:00.164600 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:16:00.164600 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:16:00.164600 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:16:00.164600 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:16:00.165975 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 1f8fd3ff-26f3-424d-9905-097db8f450f1 could not be found. Oct 30 01:16:00.165975 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:16:00.165975 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-945a3513-f40e-47d2-857c-d05468ac97eb tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Returning 404 to user: Service 1f8fd3ff-26f3-424d-9905-097db8f450f1 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:16:00.165975 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-945a3513-f40e-47d2-857c-d05468ac97eb tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-services/1f8fd3ff-26f3-424d-9905-097db8f450f1" status: 404 len: 110 microversion: 2.53 time: 0.046353 Oct 30 01:16:00.165975 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 398/799] 10.222.0.13 () {62 vars in 1309 bytes} [Sun Oct 30 01:16:00 2022] PUT /compute/v2.1/os-services/1f8fd3ff-26f3-424d-9905-097db8f450f1 => generated 110 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:16:00.174747 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c78456b8-c8a6-4992-87e4-5adcb350c638 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:00.175206 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c78456b8-c8a6-4992-87e4-5adcb350c638 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:00.183943 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c78456b8-c8a6-4992-87e4-5adcb350c638 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:00.184610 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c78456b8-c8a6-4992-87e4-5adcb350c638 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:00.185305 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c78456b8-c8a6-4992-87e4-5adcb350c638 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:00.188067 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c78456b8-c8a6-4992-87e4-5adcb350c638 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:00.188067 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c78456b8-c8a6-4992-87e4-5adcb350c638 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:00.188067 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c78456b8-c8a6-4992-87e4-5adcb350c638 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:00.208900 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-daed0d5f-2ae7-4191-9a3d-5cdcea4bc8fd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Getting quotas for project 76b6f7b705f5428b9a3a3a8c4f86ff48. Resources: {'server_group_members'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:16:00.223107 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-daed0d5f-2ae7-4191-9a3d-5cdcea4bc8fd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Getting quotas for user c536d41a93ad4337909fe2e2cb949e03 and project 76b6f7b705f5428b9a3a3a8c4f86ff48. Resources: {'server_group_members'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:16:00.302533 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c78456b8-c8a6-4992-87e4-5adcb350c638 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.134911 Oct 30 01:16:00.303115 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 399/800] 10.222.0.13 () {58 vars in 1275 bytes} [Sun Oct 30 01:16:00 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd/os-interface => generated 285 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:16:00.307828 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-80829ae9-0f1d-4789-ba09-15a9257148d6 tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:00.311847 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-80829ae9-0f1d-4789-ba09-15a9257148d6 tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:00.312334 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-80829ae9-0f1d-4789-ba09-15a9257148d6 tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:00.312773 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-80829ae9-0f1d-4789-ba09-15a9257148d6 tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:00.313534 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-80829ae9-0f1d-4789-ba09-15a9257148d6 tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:00.313985 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-80829ae9-0f1d-4789-ba09-15a9257148d6 tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:00.314514 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-80829ae9-0f1d-4789-ba09-15a9257148d6 tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:00.339271 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-80829ae9-0f1d-4789-ba09-15a9257148d6 tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.034947 Oct 30 01:16:00.339885 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 400/801] 10.222.0.13 () {60 vars in 1178 bytes} [Sun Oct 30 01:16:00 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:16:00.344477 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-df06cdee-1c61-456b-873a-8f8df25b68cf tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:00.345084 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-df06cdee-1c61-456b-873a-8f8df25b68cf tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:00.352121 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df06cdee-1c61-456b-873a-8f8df25b68cf tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:00.352532 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df06cdee-1c61-456b-873a-8f8df25b68cf tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:00.353153 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df06cdee-1c61-456b-873a-8f8df25b68cf tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:00.354074 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df06cdee-1c61-456b-873a-8f8df25b68cf tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:00.354528 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df06cdee-1c61-456b-873a-8f8df25b68cf tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:00.354950 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df06cdee-1c61-456b-873a-8f8df25b68cf tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:00.405311 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-daed0d5f-2ae7-4191-9a3d-5cdcea4bc8fd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Getting quotas for project 76b6f7b705f5428b9a3a3a8c4f86ff48. Resources: {'server_group_members'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:16:00.410822 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-daed0d5f-2ae7-4191-9a3d-5cdcea4bc8fd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Getting quotas for user c536d41a93ad4337909fe2e2cb949e03 and project 76b6f7b705f5428b9a3a3a8c4f86ff48. Resources: {'server_group_members'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:16:00.425763 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-daed0d5f-2ae7-4191-9a3d-5cdcea4bc8fd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: f86d0786-3c99-494f-aa6b-47adf07fca7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=a294dd33-efb1-4d8b-a83c-817b50cdc138,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:16:00.612947 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-df06cdee-1c61-456b-873a-8f8df25b68cf tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:00.641706 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-df06cdee-1c61-456b-873a-8f8df25b68cf tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f" status: 200 len: 1477 microversion: 2.1 time: 0.300699 Oct 30 01:16:00.642351 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 401/802] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:00 2022] GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f => generated 1477 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:00.647894 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-366b23a6-b75a-4952-b80c-0d1fb4bc88b7 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:00.648699 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-366b23a6-b75a-4952-b80c-0d1fb4bc88b7 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: 25a595ee-91e9-4d66-9898-15c577c9bcec] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:00.656153 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-366b23a6-b75a-4952-b80c-0d1fb4bc88b7 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:00.656848 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-366b23a6-b75a-4952-b80c-0d1fb4bc88b7 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:00.657284 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-366b23a6-b75a-4952-b80c-0d1fb4bc88b7 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:00.658024 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-366b23a6-b75a-4952-b80c-0d1fb4bc88b7 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:00.658486 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-366b23a6-b75a-4952-b80c-0d1fb4bc88b7 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:00.658928 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-366b23a6-b75a-4952-b80c-0d1fb4bc88b7 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:00.690235 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-daed0d5f-2ae7-4191-9a3d-5cdcea4bc8fd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Getting quotas for project 76b6f7b705f5428b9a3a3a8c4f86ff48. Resources: {'server_group_members'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:16:00.695348 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-daed0d5f-2ae7-4191-9a3d-5cdcea4bc8fd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Getting quotas for user c536d41a93ad4337909fe2e2cb949e03 and project 76b6f7b705f5428b9a3a3a8c4f86ff48. Resources: {'server_group_members'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:16:00.782845 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-366b23a6-b75a-4952-b80c-0d1fb4bc88b7 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:00.792712 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-366b23a6-b75a-4952-b80c-0d1fb4bc88b7 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/25a595ee-91e9-4d66-9898-15c577c9bcec" status: 200 len: 1210 microversion: 2.1 time: 0.148915 Oct 30 01:16:00.805462 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 402/803] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:00 2022] GET /compute/v2.1/servers/25a595ee-91e9-4d66-9898-15c577c9bcec => generated 1210 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:00.811196 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-43b1da10-598d-4770-bd6b-eafa2441aa64 req-d2538748-8ce1-489d-9045-688738ba77cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60ecf54f-3d14-4927-9d7a-5a26778cad70", "name": "network-vif-plugged", "status": "completed", "tag": "c2d9c4e2-ae4a-4acf-b671-4697188a5416"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:16:00.821205 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-43b1da10-598d-4770-bd6b-eafa2441aa64 req-d2538748-8ce1-489d-9045-688738ba77cd service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:00.821943 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-43b1da10-598d-4770-bd6b-eafa2441aa64 req-d2538748-8ce1-489d-9045-688738ba77cd service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:00.822366 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-43b1da10-598d-4770-bd6b-eafa2441aa64 req-d2538748-8ce1-489d-9045-688738ba77cd service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:00.836425 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-43b1da10-598d-4770-bd6b-eafa2441aa64 req-d2538748-8ce1-489d-9045-688738ba77cd service nova] Creating event network-vif-plugged:c2d9c4e2-ae4a-4acf-b671-4697188a5416 for instance 60ecf54f-3d14-4927-9d7a-5a26778cad70 on n-h1-master-1 Oct 30 01:16:00.842262 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-43b1da10-598d-4770-bd6b-eafa2441aa64 req-d2538748-8ce1-489d-9045-688738ba77cd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035346 Oct 30 01:16:00.845106 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 403/804] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:16:00.848673 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6cc53875-827b-4e4e-8dff-6a02ecd8c025 tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:00.852449 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6cc53875-827b-4e4e-8dff-6a02ecd8c025 tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:00.852944 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6cc53875-827b-4e4e-8dff-6a02ecd8c025 tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:00.853656 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6cc53875-827b-4e4e-8dff-6a02ecd8c025 tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:00.854560 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6cc53875-827b-4e4e-8dff-6a02ecd8c025 tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:00.855254 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6cc53875-827b-4e4e-8dff-6a02ecd8c025 tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:00.855857 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6cc53875-827b-4e4e-8dff-6a02ecd8c025 tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:00.884221 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6cc53875-827b-4e4e-8dff-6a02ecd8c025 tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.040068 Oct 30 01:16:00.884841 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 404/805] 10.222.0.13 () {60 vars in 1211 bytes} [Sun Oct 30 01:16:00 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:16:00.900449 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9c3d74dc-d130-4988-83e8-93724157a373 tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:00.904945 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9c3d74dc-d130-4988-83e8-93724157a373 tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:00.907943 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9c3d74dc-d130-4988-83e8-93724157a373 tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:00.907943 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9c3d74dc-d130-4988-83e8-93724157a373 tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:00.907943 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9c3d74dc-d130-4988-83e8-93724157a373 tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:00.908261 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9c3d74dc-d130-4988-83e8-93724157a373 tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:00.908261 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9c3d74dc-d130-4988-83e8-93724157a373 tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:00.936566 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9c3d74dc-d130-4988-83e8-93724157a373 tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.040105 Oct 30 01:16:00.945785 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 405/806] 10.222.0.13 () {60 vars in 1178 bytes} [Sun Oct 30 01:16:00 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:16:00.953874 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-134ace98-0f32-49ca-9e25-e148e8912561 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:00.954099 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-daed0d5f-2ae7-4191-9a3d-5cdcea4bc8fd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Getting quotas for project 76b6f7b705f5428b9a3a3a8c4f86ff48. Resources: {'server_group_members'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:16:00.954680 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-134ace98-0f32-49ca-9e25-e148e8912561 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] [instance: 60ecf54f-3d14-4927-9d7a-5a26778cad70] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:00.961706 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-134ace98-0f32-49ca-9e25-e148e8912561 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:00.962189 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-134ace98-0f32-49ca-9e25-e148e8912561 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:00.962664 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-134ace98-0f32-49ca-9e25-e148e8912561 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:00.963370 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-134ace98-0f32-49ca-9e25-e148e8912561 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:00.963837 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-134ace98-0f32-49ca-9e25-e148e8912561 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:00.964615 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-134ace98-0f32-49ca-9e25-e148e8912561 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:00.969551 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:00.971837 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-daed0d5f-2ae7-4191-9a3d-5cdcea4bc8fd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Getting quotas for user c536d41a93ad4337909fe2e2cb949e03 and project 76b6f7b705f5428b9a3a3a8c4f86ff48. Resources: {'server_group_members'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:16:01.013037 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-daed0d5f-2ae7-4191-9a3d-5cdcea4bc8fd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.754037 Oct 30 01:16:01.017283 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 402/807] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:15:59 2022] POST /compute/v2.1/servers => generated 32 bytes in 1759 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 30 01:16:01.023451 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b85aa55c-d351-4dbd-a8e8-5a937bb23e87 tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:01.027816 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b85aa55c-d351-4dbd-a8e8-5a937bb23e87 tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:01.029491 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b85aa55c-d351-4dbd-a8e8-5a937bb23e87 tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:01.030070 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b85aa55c-d351-4dbd-a8e8-5a937bb23e87 tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:01.030934 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b85aa55c-d351-4dbd-a8e8-5a937bb23e87 tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:01.031626 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b85aa55c-d351-4dbd-a8e8-5a937bb23e87 tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:01.042154 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b85aa55c-d351-4dbd-a8e8-5a937bb23e87 tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:01.075546 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b85aa55c-d351-4dbd-a8e8-5a937bb23e87 tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?host=n-d-master-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.056885 Oct 30 01:16:01.076699 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 403/808] 10.222.0.13 () {60 vars in 1235 bytes} [Sun Oct 30 01:16:01 2022] GET /compute/v2.1/os-services?host=n-d-master-1&binary=xxx => generated 16 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:01.097246 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4ba4304c-fe1d-43dc-ba08-c9dcc21531ed tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:01.110208 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4ba4304c-fe1d-43dc-ba08-c9dcc21531ed tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:01.111040 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4ba4304c-fe1d-43dc-ba08-c9dcc21531ed tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Searching by: {'deleted': False, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48'} {{(pid=121103) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 30 01:16:01.132525 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4ba4304c-fe1d-43dc-ba08-c9dcc21531ed tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:01.133018 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4ba4304c-fe1d-43dc-ba08-c9dcc21531ed tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:01.137296 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4ba4304c-fe1d-43dc-ba08-c9dcc21531ed tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:01.137296 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4ba4304c-fe1d-43dc-ba08-c9dcc21531ed tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:01.137296 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4ba4304c-fe1d-43dc-ba08-c9dcc21531ed tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:01.137296 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4ba4304c-fe1d-43dc-ba08-c9dcc21531ed tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:01.241253 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:01.243405 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.multi_cell_list [None req-4ba4304c-fe1d-43dc-ba08-c9dcc21531ed tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=121103) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 30 01:16:01.387097 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-134ace98-0f32-49ca-9e25-e148e8912561 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e6512cfbbbf412cbc4c40b80669b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c653b9bf1e064528b2ffe8c9b57fa48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:01.389620 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4ba4304c-fe1d-43dc-ba08-c9dcc21531ed tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.299764 Oct 30 01:16:01.390417 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 404/809] 10.222.0.13 () {58 vars in 1125 bytes} [Sun Oct 30 01:16:01 2022] GET /compute/v2.1/servers => generated 1003 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:01.395064 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-90134543-1ce5-48b5-8c96-9b9d8136b3b7 tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:01.399511 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-90134543-1ce5-48b5-8c96-9b9d8136b3b7 tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:01.400003 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-90134543-1ce5-48b5-8c96-9b9d8136b3b7 tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:01.400619 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-90134543-1ce5-48b5-8c96-9b9d8136b3b7 tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:01.402012 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-90134543-1ce5-48b5-8c96-9b9d8136b3b7 tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:01.402401 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-90134543-1ce5-48b5-8c96-9b9d8136b3b7 tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:01.403146 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-90134543-1ce5-48b5-8c96-9b9d8136b3b7 tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:01.407992 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-134ace98-0f32-49ca-9e25-e148e8912561 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] 10.222.0.13 "GET /compute/v2.1/servers/60ecf54f-3d14-4927-9d7a-5a26778cad70" status: 200 len: 1323 microversion: 2.1 time: 0.460488 Oct 30 01:16:01.420031 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 406/810] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:00 2022] GET /compute/v2.1/servers/60ecf54f-3d14-4927-9d7a-5a26778cad70 => generated 1323 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:01.430501 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-41807e97-b309-45cc-bf27-62cdf112a222 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:01.431349 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-41807e97-b309-45cc-bf27-62cdf112a222 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: f86d0786-3c99-494f-aa6b-47adf07fca7c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:01.446237 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-90134543-1ce5-48b5-8c96-9b9d8136b3b7 tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.049805 Oct 30 01:16:01.446237 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 405/811] 10.222.0.13 () {60 vars in 1178 bytes} [Sun Oct 30 01:16:01 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:16:01.458510 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e083d4a3-6ad5-495e-a2bc-c72dcc923bb8 tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:01.463020 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e083d4a3-6ad5-495e-a2bc-c72dcc923bb8 tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:01.463580 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e083d4a3-6ad5-495e-a2bc-c72dcc923bb8 tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:01.464106 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e083d4a3-6ad5-495e-a2bc-c72dcc923bb8 tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:01.464845 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e083d4a3-6ad5-495e-a2bc-c72dcc923bb8 tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:01.465428 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e083d4a3-6ad5-495e-a2bc-c72dcc923bb8 tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:01.465900 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e083d4a3-6ad5-495e-a2bc-c72dcc923bb8 tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:01.491356 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e083d4a3-6ad5-495e-a2bc-c72dcc923bb8 tempest-ServicesAdminNegativeV253TestJSON-1133195310 tempest-ServicesAdminNegativeV253TestJSON-1133195310-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor" status: 200 len: 16 microversion: 2.53 time: 0.036552 Oct 30 01:16:01.493743 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 406/812] 10.222.0.13 () {60 vars in 1239 bytes} [Sun Oct 30 01:16:01 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor => generated 16 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:16:01.606266 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-41807e97-b309-45cc-bf27-62cdf112a222 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:01.616541 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-431ef620-339b-4ec6-9956-d4ca708f9aa2 tempest-ServicesAdminNegativeV253TestJSON-932055119 tempest-ServicesAdminNegativeV253TestJSON-932055119-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:01.621721 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-41807e97-b309-45cc-bf27-62cdf112a222 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/f86d0786-3c99-494f-aa6b-47adf07fca7c" status: 200 len: 1219 microversion: 2.1 time: 0.200553 Oct 30 01:16:01.623371 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 407/813] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:01 2022] GET /compute/v2.1/servers/f86d0786-3c99-494f-aa6b-47adf07fca7c => generated 1219 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:01.625015 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-431ef620-339b-4ec6-9956-d4ca708f9aa2 tempest-ServicesAdminNegativeV253TestJSON-932055119 tempest-ServicesAdminNegativeV253TestJSON-932055119-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'a39e5b4caf174e059b5a6b63cdf2f5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c20224e5a4ab3b6acc7285d2eb69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:01.626804 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-431ef620-339b-4ec6-9956-d4ca708f9aa2 tempest-ServicesAdminNegativeV253TestJSON-932055119 tempest-ServicesAdminNegativeV253TestJSON-932055119-project] Request method failure captured: Oct 30 01:16:01.626804 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 30 01:16:01.626804 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:16:01.626804 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:16:01.626804 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:16:01.626804 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:16:01.626804 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:16:01.626804 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:16:01.626804 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:16:01.626804 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:16:01.626804 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdBNhmk2YZssxFP3nX_RMkBDlESsi6OI8X5s9cpFthSbgnkEh47BYyuKVkvwXoxxK2ucf1DqvNmhr8VV-gIEk3EKjLHSrgDkwab8O3SWIicgV2Wu1xy_7L84n-h2lmQbAbOWVlzfu1sw7fOZ0ZL-rX8K9JdgjevQgeq6DDyZqQftWzM Oct 30 01:16:01.626804 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:16:01.626804 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:16:01.626804 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:16:01.626804 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:16:01.626804 n-d-master-1 devstack@n-api.service[121103]: X-Openstack-Nova-Api-Version: 2.53 Oct 30 01:16:01.626804 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:16:01.626804 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:16:01.626804 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 604c20224e5a4ab3b6acc7285d2eb69d Oct 30 01:16:01.626804 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-932055119 Oct 30 01:16:01.626804 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:16:01.626804 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:16:01.628140 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/604c20224e5a4ab3b6acc7285d2eb69d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_604c20224e5a4ab3b6acc7285d2eb69d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/604c20224e5a4ab3b6acc7285d2eb69d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/604c20224e5a4ab3b6acc7285d2eb69d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:16:01.628140 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-932055119 Oct 30 01:16:01.628140 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 604c20224e5a4ab3b6acc7285d2eb69d Oct 30 01:16:01.628140 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-932055119 Oct 30 01:16:01.628140 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServicesAdminNegativeV253TestJSON-932055119-project Oct 30 01:16:01.628140 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:16:01.628140 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:16:01.628140 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: a39e5b4caf174e059b5a6b63cdf2f5d7 Oct 30 01:16:01.628140 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-932055119-project Oct 30 01:16:01.628140 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:16:01.628140 n-d-master-1 devstack@n-api.service[121103]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 30 01:16:01.628140 n-d-master-1 devstack@n-api.service[121103]: action_args: {} Oct 30 01:16:01.638154 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:16:01.638154 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:16:01.638154 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:16:01.638154 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:16:01.638154 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:16:01.638154 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:16:01.638154 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 30 01:16:01.638154 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:16:01.638154 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 30 01:16:01.638154 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:16:01.638154 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:16:01.638154 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:16:01.638154 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 30 01:16:01.638154 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 30 01:16:01.638154 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 30 01:16:01.638154 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 30 01:16:01.638154 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 30 01:16:01.638154 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 30 01:16:01.638154 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 01:16:01.639488 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 30 01:16:01.639488 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 01:16:01.639488 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise self.value Oct 30 01:16:01.639488 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 30 01:16:01.639488 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 30 01:16:01.639488 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 30 01:16:01.639488 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 30 01:16:01.639488 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 30 01:16:01.639488 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 30 01:16:01.639488 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 30 01:16:01.639488 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:16:01.639488 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:16:01.639488 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:16:01.639488 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:16:01.639488 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:16:01.639488 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:16:01.639488 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 30 01:16:01.639488 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 30 01:16:01.639488 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 30 01:16:01.639488 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:16:01.640878 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-431ef620-339b-4ec6-9956-d4ca708f9aa2 tempest-ServicesAdminNegativeV253TestJSON-932055119 tempest-ServicesAdminNegativeV253TestJSON-932055119-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:16:01.640878 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-431ef620-339b-4ec6-9956-d4ca708f9aa2 tempest-ServicesAdminNegativeV253TestJSON-932055119 tempest-ServicesAdminNegativeV253TestJSON-932055119-project] 10.222.0.13 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.127835 Oct 30 01:16:01.640878 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 407/814] 10.222.0.13 () {60 vars in 1178 bytes} [Sun Oct 30 01:16:01 2022] GET /compute/v2.1/os-services => generated 112 bytes in 129 msecs (HTTP/1.1 403) 9 headers in 381 bytes (2 switches on core 0) Oct 30 01:16:01.665282 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-457eceda-4885-4214-891c-2a27101fa04a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:01.665916 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-457eceda-4885-4214-891c-2a27101fa04a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:01.671866 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-457eceda-4885-4214-891c-2a27101fa04a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:01.672355 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-457eceda-4885-4214-891c-2a27101fa04a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:01.672791 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-457eceda-4885-4214-891c-2a27101fa04a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:01.673514 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-457eceda-4885-4214-891c-2a27101fa04a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:01.673970 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-457eceda-4885-4214-891c-2a27101fa04a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:01.674400 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-457eceda-4885-4214-891c-2a27101fa04a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:01.823224 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a7192822-3c00-4218-9a16-791c6d50278c tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:01.823729 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a7192822-3c00-4218-9a16-791c6d50278c tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: 25a595ee-91e9-4d66-9898-15c577c9bcec] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:01.830743 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a7192822-3c00-4218-9a16-791c6d50278c tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:01.831310 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a7192822-3c00-4218-9a16-791c6d50278c tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:01.833734 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a7192822-3c00-4218-9a16-791c6d50278c tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:01.833734 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a7192822-3c00-4218-9a16-791c6d50278c tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:01.833734 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a7192822-3c00-4218-9a16-791c6d50278c tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:01.833734 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a7192822-3c00-4218-9a16-791c6d50278c tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:01.960601 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a7192822-3c00-4218-9a16-791c6d50278c tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:01.983754 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a7192822-3c00-4218-9a16-791c6d50278c tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/25a595ee-91e9-4d66-9898-15c577c9bcec" status: 200 len: 1266 microversion: 2.1 time: 0.164562 Oct 30 01:16:01.985976 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 408/815] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:01 2022] GET /compute/v2.1/servers/25a595ee-91e9-4d66-9898-15c577c9bcec => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:02.064130 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-457eceda-4885-4214-891c-2a27101fa04a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:02.074162 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-457eceda-4885-4214-891c-2a27101fa04a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f" status: 200 len: 1477 microversion: 2.1 time: 0.412743 Oct 30 01:16:02.075204 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 408/816] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:01 2022] GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f => generated 1477 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:02.433322 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-da820f3d-3074-4d8f-bd9f-f17e3987bd9a tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:02.433970 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-da820f3d-3074-4d8f-bd9f-f17e3987bd9a tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] [instance: 60ecf54f-3d14-4927-9d7a-5a26778cad70] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:02.440093 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-4d27d8ac-800e-4a2e-aca1-34ab0c09cfd4 req-3d49502a-1f71-445b-81b4-e709c004e4e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b368660-effb-411d-b713-455fc7fd44cd", "tag": "be63e75e-18fe-4000-8f59-5722fd84c310"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:16:02.451307 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da820f3d-3074-4d8f-bd9f-f17e3987bd9a tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:02.452217 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da820f3d-3074-4d8f-bd9f-f17e3987bd9a tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:02.453467 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da820f3d-3074-4d8f-bd9f-f17e3987bd9a tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:02.454467 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da820f3d-3074-4d8f-bd9f-f17e3987bd9a tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:02.454754 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-4d27d8ac-800e-4a2e-aca1-34ab0c09cfd4 req-3d49502a-1f71-445b-81b4-e709c004e4e4 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:02.456141 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-4d27d8ac-800e-4a2e-aca1-34ab0c09cfd4 req-3d49502a-1f71-445b-81b4-e709c004e4e4 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:02.456767 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-4d27d8ac-800e-4a2e-aca1-34ab0c09cfd4 req-3d49502a-1f71-445b-81b4-e709c004e4e4 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:02.457578 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da820f3d-3074-4d8f-bd9f-f17e3987bd9a tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:02.458148 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da820f3d-3074-4d8f-bd9f-f17e3987bd9a tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:02.474150 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-4d27d8ac-800e-4a2e-aca1-34ab0c09cfd4 req-3d49502a-1f71-445b-81b4-e709c004e4e4 service nova] Creating event network-changed:be63e75e-18fe-4000-8f59-5722fd84c310 for instance 6b368660-effb-411d-b713-455fc7fd44cd on n-h1-master-1 Oct 30 01:16:02.482647 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-4d27d8ac-800e-4a2e-aca1-34ab0c09cfd4 req-3d49502a-1f71-445b-81b4-e709c004e4e4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047316 Oct 30 01:16:02.483816 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 409/817] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:16:02.648708 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-444704cf-f242-43de-a89f-c2adbb5303b7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:02.649578 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-444704cf-f242-43de-a89f-c2adbb5303b7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: f86d0786-3c99-494f-aa6b-47adf07fca7c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:02.960879 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-444704cf-f242-43de-a89f-c2adbb5303b7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:02.980799 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-444704cf-f242-43de-a89f-c2adbb5303b7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/f86d0786-3c99-494f-aa6b-47adf07fca7c" status: 200 len: 1219 microversion: 2.1 time: 0.337666 Oct 30 01:16:02.981706 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 410/818] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:02 2022] GET /compute/v2.1/servers/f86d0786-3c99-494f-aa6b-47adf07fca7c => generated 1219 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:16:03.008812 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0b1adbb5-9df6-41c3-8cf0-b8ff168db387 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:03.009541 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0b1adbb5-9df6-41c3-8cf0-b8ff168db387 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: 25a595ee-91e9-4d66-9898-15c577c9bcec] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:03.025696 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b1adbb5-9df6-41c3-8cf0-b8ff168db387 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:03.026193 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b1adbb5-9df6-41c3-8cf0-b8ff168db387 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:03.026633 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b1adbb5-9df6-41c3-8cf0-b8ff168db387 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:03.027335 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b1adbb5-9df6-41c3-8cf0-b8ff168db387 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:03.027782 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b1adbb5-9df6-41c3-8cf0-b8ff168db387 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:03.028430 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b1adbb5-9df6-41c3-8cf0-b8ff168db387 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:03.171720 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0b1adbb5-9df6-41c3-8cf0-b8ff168db387 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:03.197645 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0b1adbb5-9df6-41c3-8cf0-b8ff168db387 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/25a595ee-91e9-4d66-9898-15c577c9bcec" status: 200 len: 1272 microversion: 2.1 time: 0.193314 Oct 30 01:16:03.215808 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 411/819] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:03 2022] GET /compute/v2.1/servers/25a595ee-91e9-4d66-9898-15c577c9bcec => generated 1272 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:16:03.223239 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fb50bcbc-43eb-4c6f-be7f-de2f6a8eca80 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:03.224368 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fb50bcbc-43eb-4c6f-be7f-de2f6a8eca80 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:03.231648 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb50bcbc-43eb-4c6f-be7f-de2f6a8eca80 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:03.232512 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb50bcbc-43eb-4c6f-be7f-de2f6a8eca80 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:03.233180 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb50bcbc-43eb-4c6f-be7f-de2f6a8eca80 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:03.234047 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb50bcbc-43eb-4c6f-be7f-de2f6a8eca80 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:03.234762 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb50bcbc-43eb-4c6f-be7f-de2f6a8eca80 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:03.235414 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb50bcbc-43eb-4c6f-be7f-de2f6a8eca80 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:03.237303 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-da820f3d-3074-4d8f-bd9f-f17e3987bd9a tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e6512cfbbbf412cbc4c40b80669b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c653b9bf1e064528b2ffe8c9b57fa48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:03.254147 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-da820f3d-3074-4d8f-bd9f-f17e3987bd9a tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] 10.222.0.13 "GET /compute/v2.1/servers/60ecf54f-3d14-4927-9d7a-5a26778cad70" status: 200 len: 1323 microversion: 2.1 time: 0.825595 Oct 30 01:16:03.254748 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 409/820] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:02 2022] GET /compute/v2.1/servers/60ecf54f-3d14-4927-9d7a-5a26778cad70 => generated 1323 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:03.577646 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-fb50bcbc-43eb-4c6f-be7f-de2f6a8eca80 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:03.587490 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fb50bcbc-43eb-4c6f-be7f-de2f6a8eca80 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f" status: 200 len: 1477 microversion: 2.1 time: 0.370157 Oct 30 01:16:03.588183 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 412/821] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:03 2022] GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f => generated 1477 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:04.020894 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-69485e6a-f6b8-44c1-a345-b551582709ad tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:04.024488 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-69485e6a-f6b8-44c1-a345-b551582709ad tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: f86d0786-3c99-494f-aa6b-47adf07fca7c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:04.042537 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-69485e6a-f6b8-44c1-a345-b551582709ad tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:04.044394 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-69485e6a-f6b8-44c1-a345-b551582709ad tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:04.045047 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-69485e6a-f6b8-44c1-a345-b551582709ad tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:04.046625 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-69485e6a-f6b8-44c1-a345-b551582709ad tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:04.050868 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-69485e6a-f6b8-44c1-a345-b551582709ad tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:04.051744 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-69485e6a-f6b8-44c1-a345-b551582709ad tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:04.143791 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0ab2df9f-7362-401a-9972-e9c273f02b7e tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-373517935", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "a3d745df-bc10-475b-bfb1-2cc9b94a14da"}], "security_groups": [{"name": "tempest-securitygroup--1833016420"}], "key_name": "tempest-keypair-1016787881", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:16:04.231247 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-69485e6a-f6b8-44c1-a345-b551582709ad tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:04.247317 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-69485e6a-f6b8-44c1-a345-b551582709ad tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/f86d0786-3c99-494f-aa6b-47adf07fca7c" status: 200 len: 1215 microversion: 2.1 time: 0.243794 Oct 30 01:16:04.257913 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 410/822] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:04 2022] GET /compute/v2.1/servers/f86d0786-3c99-494f-aa6b-47adf07fca7c => generated 1215 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:04.266673 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4027716f-65c0-48a4-bd1d-d623d17ab154 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:04.268461 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4027716f-65c0-48a4-bd1d-d623d17ab154 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: 25a595ee-91e9-4d66-9898-15c577c9bcec] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:04.275269 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4027716f-65c0-48a4-bd1d-d623d17ab154 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:04.276058 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4027716f-65c0-48a4-bd1d-d623d17ab154 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:04.276485 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4027716f-65c0-48a4-bd1d-d623d17ab154 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:04.277394 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4027716f-65c0-48a4-bd1d-d623d17ab154 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:04.278129 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4027716f-65c0-48a4-bd1d-d623d17ab154 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:04.278702 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4027716f-65c0-48a4-bd1d-d623d17ab154 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:04.409743 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-0ab2df9f-7362-401a-9972-e9c273f02b7e tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] validate_networks() for [('a3d745df-bc10-475b-bfb1-2cc9b94a14da', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:16:04.678707 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4027716f-65c0-48a4-bd1d-d623d17ab154 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:04.691060 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4027716f-65c0-48a4-bd1d-d623d17ab154 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/25a595ee-91e9-4d66-9898-15c577c9bcec" status: 200 len: 1314 microversion: 2.1 time: 0.431657 Oct 30 01:16:04.692439 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 411/823] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:04 2022] GET /compute/v2.1/servers/25a595ee-91e9-4d66-9898-15c577c9bcec => generated 1314 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:04.702698 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-15b7e473-273d-4793-abb9-208de145e7ee tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:04.703623 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-15b7e473-273d-4793-abb9-208de145e7ee tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] [instance: 60ecf54f-3d14-4927-9d7a-5a26778cad70] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:04.720239 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-15b7e473-273d-4793-abb9-208de145e7ee tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:04.721033 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-15b7e473-273d-4793-abb9-208de145e7ee tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:04.721509 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-15b7e473-273d-4793-abb9-208de145e7ee tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:04.722223 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-15b7e473-273d-4793-abb9-208de145e7ee tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:04.723431 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-15b7e473-273d-4793-abb9-208de145e7ee tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:04.724021 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-15b7e473-273d-4793-abb9-208de145e7ee tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:05.054807 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-15b7e473-273d-4793-abb9-208de145e7ee tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e6512cfbbbf412cbc4c40b80669b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c653b9bf1e064528b2ffe8c9b57fa48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:05.064288 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-15b7e473-273d-4793-abb9-208de145e7ee tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] 10.222.0.13 "GET /compute/v2.1/servers/60ecf54f-3d14-4927-9d7a-5a26778cad70" status: 200 len: 1472 microversion: 2.1 time: 0.369941 Oct 30 01:16:05.064872 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 412/824] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:04 2022] GET /compute/v2.1/servers/60ecf54f-3d14-4927-9d7a-5a26778cad70 => generated 1472 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:05.070588 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-94642faf-e60e-4b84-ba0e-bb7afc6aeedb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:05.071502 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-94642faf-e60e-4b84-ba0e-bb7afc6aeedb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:05.079547 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94642faf-e60e-4b84-ba0e-bb7afc6aeedb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:05.080280 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94642faf-e60e-4b84-ba0e-bb7afc6aeedb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:05.081719 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94642faf-e60e-4b84-ba0e-bb7afc6aeedb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:05.083226 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94642faf-e60e-4b84-ba0e-bb7afc6aeedb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:05.083848 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94642faf-e60e-4b84-ba0e-bb7afc6aeedb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:05.084407 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94642faf-e60e-4b84-ba0e-bb7afc6aeedb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:05.376690 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-0ab2df9f-7362-401a-9972-e9c273f02b7e tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:16:05.376690 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-0ab2df9f-7362-401a-9972-e9c273f02b7e tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:16:05.377431 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-0ab2df9f-7362-401a-9972-e9c273f02b7e tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:16:05.378079 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-0ab2df9f-7362-401a-9972-e9c273f02b7e tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:16:05.378701 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-0ab2df9f-7362-401a-9972-e9c273f02b7e tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:16:05.392104 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0ab2df9f-7362-401a-9972-e9c273f02b7e tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:05.392597 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0ab2df9f-7362-401a-9972-e9c273f02b7e tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:05.393126 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0ab2df9f-7362-401a-9972-e9c273f02b7e tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:05.393788 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0ab2df9f-7362-401a-9972-e9c273f02b7e tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:05.394468 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0ab2df9f-7362-401a-9972-e9c273f02b7e tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:05.395048 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0ab2df9f-7362-401a-9972-e9c273f02b7e tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:05.420499 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-0ab2df9f-7362-401a-9972-e9c273f02b7e tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Getting quotas for project 301cee87901844ed94e635eca054960d. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:16:05.427438 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-0ab2df9f-7362-401a-9972-e9c273f02b7e tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Getting quotas for user 2096bbb8aff742b1837931e52ac1c9ae and project 301cee87901844ed94e635eca054960d. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:16:05.432143 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-94642faf-e60e-4b84-ba0e-bb7afc6aeedb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:05.445257 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0ab2df9f-7362-401a-9972-e9c273f02b7e tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:16:05.447948 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0ab2df9f-7362-401a-9972-e9c273f02b7e tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:16:05.449314 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-94642faf-e60e-4b84-ba0e-bb7afc6aeedb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f" status: 200 len: 1477 microversion: 2.1 time: 0.382286 Oct 30 01:16:05.451070 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 413/825] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:05 2022] GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f => generated 1477 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:05.458649 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e025de5b-d02e-4a62-940e-a3fb72297ec6 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:05.461003 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e025de5b-d02e-4a62-940e-a3fb72297ec6 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] [instance: 60ecf54f-3d14-4927-9d7a-5a26778cad70] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:05.490184 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e025de5b-d02e-4a62-940e-a3fb72297ec6 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:05.490681 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e025de5b-d02e-4a62-940e-a3fb72297ec6 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:05.491113 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e025de5b-d02e-4a62-940e-a3fb72297ec6 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:05.492008 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e025de5b-d02e-4a62-940e-a3fb72297ec6 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:05.492467 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e025de5b-d02e-4a62-940e-a3fb72297ec6 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:05.492896 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e025de5b-d02e-4a62-940e-a3fb72297ec6 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:05.522043 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e025de5b-d02e-4a62-940e-a3fb72297ec6 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '9e6512cfbbbf412cbc4c40b80669b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c653b9bf1e064528b2ffe8c9b57fa48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:05.523825 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e025de5b-d02e-4a62-940e-a3fb72297ec6 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Request method failure captured: Oct 30 01:16:05.523825 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/60ecf54f-3d14-4927-9d7a-5a26778cad70/diagnostics HTTP/1.1 Oct 30 01:16:05.523825 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:16:05.523825 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:16:05.523825 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:16:05.523825 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:16:05.523825 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:16:05.523825 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:16:05.523825 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:16:05.523825 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:16:05.523825 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdA7_D_wWbkIzevSQf9T9sJkw9hMA383gXGkEQvtDjDgpwzuDI9-zz6OaIMF_OKFzHYGcaGh0XVdbTLgX_gqdTCX0TxDD84rHFa65rdNoAryCSWIXRGSJz5tz8VvElTLp94cpliFtxvz4HhQix-FUQtBdDM9Awl_g7f4H_wP2MBipuY Oct 30 01:16:05.523825 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:16:05.523825 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:16:05.523825 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:16:05.523825 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:16:05.523825 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:16:05.523825 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:16:05.523825 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: c653b9bf1e064528b2ffe8c9b57fa48d Oct 30 01:16:05.523825 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1600780651 Oct 30 01:16:05.523825 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:16:05.523825 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:16:05.525259 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c653b9bf1e064528b2ffe8c9b57fa48d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c653b9bf1e064528b2ffe8c9b57fa48d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c653b9bf1e064528b2ffe8c9b57fa48d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c653b9bf1e064528b2ffe8c9b57fa48d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:16:05.525259 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1600780651 Oct 30 01:16:05.525259 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: c653b9bf1e064528b2ffe8c9b57fa48d Oct 30 01:16:05.525259 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1600780651 Oct 30 01:16:05.525259 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServerDiagnosticsNegativeTest-1600780651-project Oct 30 01:16:05.525259 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:16:05.525259 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:16:05.525259 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 9e6512cfbbbf412cbc4c40b80669b637 Oct 30 01:16:05.525259 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1600780651-project Oct 30 01:16:05.525259 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:16:05.525259 n-d-master-1 devstack@n-api.service[121103]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 30 01:16:05.526097 n-d-master-1 devstack@n-api.service[121103]: action_args: {'server_id': '60ecf54f-3d14-4927-9d7a-5a26778cad70'} Oct 30 01:16:05.526097 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:16:05.526097 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:16:05.526097 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:16:05.526097 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:16:05.526097 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:16:05.526097 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:16:05.526097 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:16:05.526097 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:16:05.526097 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 30 01:16:05.526097 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 30 01:16:05.526097 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 30 01:16:05.526097 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 30 01:16:05.526097 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 30 01:16:05.526097 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 30 01:16:05.526097 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 01:16:05.526097 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 30 01:16:05.526097 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 01:16:05.526097 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise self.value Oct 30 01:16:05.526097 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 30 01:16:05.527273 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 30 01:16:05.527273 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 30 01:16:05.527273 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 30 01:16:05.527273 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 30 01:16:05.527273 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 30 01:16:05.527273 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 30 01:16:05.527273 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:16:05.527273 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:16:05.527273 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:16:05.527273 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:16:05.527273 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:16:05.527273 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:16:05.527273 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 30 01:16:05.527273 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 30 01:16:05.527273 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 30 01:16:05.527273 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:16:05.527273 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e025de5b-d02e-4a62-940e-a3fb72297ec6 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:16:05.529540 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e025de5b-d02e-4a62-940e-a3fb72297ec6 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] 10.222.0.13 "GET /compute/v2.1/servers/60ecf54f-3d14-4927-9d7a-5a26778cad70/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.072999 Oct 30 01:16:05.530883 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 414/826] 10.222.0.13 () {58 vars in 1272 bytes} [Sun Oct 30 01:16:05 2022] GET /compute/v2.1/servers/60ecf54f-3d14-4927-9d7a-5a26778cad70/diagnostics => generated 117 bytes in 79 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:16:05.536077 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ddf83484-7f3e-46c0-af6c-3d2ecabda7e4 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:05.536689 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ddf83484-7f3e-46c0-af6c-3d2ecabda7e4 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: f86d0786-3c99-494f-aa6b-47adf07fca7c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:05.542478 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ddf83484-7f3e-46c0-af6c-3d2ecabda7e4 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:05.547053 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ddf83484-7f3e-46c0-af6c-3d2ecabda7e4 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:05.547053 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ddf83484-7f3e-46c0-af6c-3d2ecabda7e4 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:05.547053 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ddf83484-7f3e-46c0-af6c-3d2ecabda7e4 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:05.547053 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ddf83484-7f3e-46c0-af6c-3d2ecabda7e4 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:05.547384 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ddf83484-7f3e-46c0-af6c-3d2ecabda7e4 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:05.625664 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ddf83484-7f3e-46c0-af6c-3d2ecabda7e4 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:05.633619 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ddf83484-7f3e-46c0-af6c-3d2ecabda7e4 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/f86d0786-3c99-494f-aa6b-47adf07fca7c" status: 200 len: 1271 microversion: 2.1 time: 0.101635 Oct 30 01:16:05.634197 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 415/827] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:05 2022] GET /compute/v2.1/servers/f86d0786-3c99-494f-aa6b-47adf07fca7c => generated 1271 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:05.665121 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9bb7d9d6-5eee-4c49-acec-63f74ab49651 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:05.670540 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9bb7d9d6-5eee-4c49-acec-63f74ab49651 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] [instance: 60ecf54f-3d14-4927-9d7a-5a26778cad70] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:05.675670 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0ab2df9f-7362-401a-9972-e9c273f02b7e tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 1.533810 Oct 30 01:16:05.678648 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 413/828] 10.222.0.13 () {62 vars in 1188 bytes} [Sun Oct 30 01:16:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 1539 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 30 01:16:05.688520 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9bb7d9d6-5eee-4c49-acec-63f74ab49651 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:05.689297 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9bb7d9d6-5eee-4c49-acec-63f74ab49651 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:05.689939 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9bb7d9d6-5eee-4c49-acec-63f74ab49651 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:05.692583 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-cbea5049-addb-4091-a4dd-ec7bf00b6721 req-a7fc3ef5-8611-40be-bda7-7f158c03625a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f10b90ae-23e1-4ca1-b95e-9404e606e5d9", "tag": "9f14e853-78c5-4b79-8df2-448f8f1726ff"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:16:05.696874 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9bb7d9d6-5eee-4c49-acec-63f74ab49651 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:05.698063 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9bb7d9d6-5eee-4c49-acec-63f74ab49651 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:05.698830 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9bb7d9d6-5eee-4c49-acec-63f74ab49651 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:05.717171 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-cbea5049-addb-4091-a4dd-ec7bf00b6721 req-a7fc3ef5-8611-40be-bda7-7f158c03625a service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:05.721102 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-cbea5049-addb-4091-a4dd-ec7bf00b6721 req-a7fc3ef5-8611-40be-bda7-7f158c03625a service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:05.721559 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-cbea5049-addb-4091-a4dd-ec7bf00b6721 req-a7fc3ef5-8611-40be-bda7-7f158c03625a service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:05.751545 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-cbea5049-addb-4091-a4dd-ec7bf00b6721 req-a7fc3ef5-8611-40be-bda7-7f158c03625a service nova] Creating event network-changed:9f14e853-78c5-4b79-8df2-448f8f1726ff for instance f10b90ae-23e1-4ca1-b95e-9404e606e5d9 on n-h2-master-1 Oct 30 01:16:05.753234 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9bb7d9d6-5eee-4c49-acec-63f74ab49651 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] [instance: 60ecf54f-3d14-4927-9d7a-5a26778cad70] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:16:05.766681 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-cbea5049-addb-4091-a4dd-ec7bf00b6721 req-a7fc3ef5-8611-40be-bda7-7f158c03625a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086515 Oct 30 01:16:05.767245 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 414/829] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:16:05.783153 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-aacdb89d-4400-4d2f-9ab2-56fc54fa5c67 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:05.785009 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-aacdb89d-4400-4d2f-9ab2-56fc54fa5c67 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:05.959523 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-aacdb89d-4400-4d2f-9ab2-56fc54fa5c67 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:05.977295 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-aacdb89d-4400-4d2f-9ab2-56fc54fa5c67 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:05.981478 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-aacdb89d-4400-4d2f-9ab2-56fc54fa5c67 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:05.982709 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-aacdb89d-4400-4d2f-9ab2-56fc54fa5c67 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 200 len: 1285 microversion: 2.25 time: 0.211958 Oct 30 01:16:05.989639 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 415/830] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:16:05 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 1285 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:16:05.998571 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7a43a940-3cc5-490a-a805-8f9725fea1c1 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:06.000270 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7a43a940-3cc5-490a-a805-8f9725fea1c1 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: 25a595ee-91e9-4d66-9898-15c577c9bcec] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:06.007773 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7a43a940-3cc5-490a-a805-8f9725fea1c1 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:06.008607 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7a43a940-3cc5-490a-a805-8f9725fea1c1 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:06.009276 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7a43a940-3cc5-490a-a805-8f9725fea1c1 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:06.010230 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7a43a940-3cc5-490a-a805-8f9725fea1c1 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:06.010895 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7a43a940-3cc5-490a-a805-8f9725fea1c1 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:06.011551 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7a43a940-3cc5-490a-a805-8f9725fea1c1 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:06.170201 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9bb7d9d6-5eee-4c49-acec-63f74ab49651 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] 10.222.0.13 "DELETE /compute/v2.1/servers/60ecf54f-3d14-4927-9d7a-5a26778cad70" status: 204 len: 0 microversion: 2.1 time: 0.516486 Oct 30 01:16:06.174719 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 416/831] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:16:05 2022] DELETE /compute/v2.1/servers/60ecf54f-3d14-4927-9d7a-5a26778cad70 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:16:06.192089 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-38afce21-f2fe-4310-a848-9b1f37a2ea87 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:06.195476 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-38afce21-f2fe-4310-a848-9b1f37a2ea87 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] [instance: 60ecf54f-3d14-4927-9d7a-5a26778cad70] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:06.210554 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38afce21-f2fe-4310-a848-9b1f37a2ea87 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:06.212491 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38afce21-f2fe-4310-a848-9b1f37a2ea87 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:06.213022 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38afce21-f2fe-4310-a848-9b1f37a2ea87 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:06.213950 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38afce21-f2fe-4310-a848-9b1f37a2ea87 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:06.215431 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38afce21-f2fe-4310-a848-9b1f37a2ea87 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:06.215739 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38afce21-f2fe-4310-a848-9b1f37a2ea87 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:06.240237 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:06.707546 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7a43a940-3cc5-490a-a805-8f9725fea1c1 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:06.716463 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7a43a940-3cc5-490a-a805-8f9725fea1c1 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/25a595ee-91e9-4d66-9898-15c577c9bcec" status: 200 len: 1314 microversion: 2.1 time: 0.725641 Oct 30 01:16:06.726175 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 416/832] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:05 2022] GET /compute/v2.1/servers/25a595ee-91e9-4d66-9898-15c577c9bcec => generated 1314 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:06.735259 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-7b277fce-a652-404e-a58d-b4fe3751fe66 req-31a76b4b-2e69-4db2-a5b8-9aaa538b54b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25a595ee-91e9-4d66-9898-15c577c9bcec", "tag": "e7c9bc55-bd5d-480e-bb9f-48e2f7c98104"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:16:06.753288 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-7b277fce-a652-404e-a58d-b4fe3751fe66 req-31a76b4b-2e69-4db2-a5b8-9aaa538b54b5 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:06.753944 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-7b277fce-a652-404e-a58d-b4fe3751fe66 req-31a76b4b-2e69-4db2-a5b8-9aaa538b54b5 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:06.755447 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-7b277fce-a652-404e-a58d-b4fe3751fe66 req-31a76b4b-2e69-4db2-a5b8-9aaa538b54b5 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:06.770264 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-7b277fce-a652-404e-a58d-b4fe3751fe66 req-31a76b4b-2e69-4db2-a5b8-9aaa538b54b5 service nova] Creating event network-changed:e7c9bc55-bd5d-480e-bb9f-48e2f7c98104 for instance 25a595ee-91e9-4d66-9898-15c577c9bcec on n-h2-master-1 Oct 30 01:16:06.775231 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-7b277fce-a652-404e-a58d-b4fe3751fe66 req-31a76b4b-2e69-4db2-a5b8-9aaa538b54b5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047565 Oct 30 01:16:06.776156 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 417/833] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:16:06.782289 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d56a46e6-649a-4d69-a2f7-6ceadf7967b8 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:06.782994 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d56a46e6-649a-4d69-a2f7-6ceadf7967b8 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:06.786383 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-38afce21-f2fe-4310-a848-9b1f37a2ea87 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e6512cfbbbf412cbc4c40b80669b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c653b9bf1e064528b2ffe8c9b57fa48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:06.789386 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d56a46e6-649a-4d69-a2f7-6ceadf7967b8 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:06.790172 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d56a46e6-649a-4d69-a2f7-6ceadf7967b8 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:06.790760 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d56a46e6-649a-4d69-a2f7-6ceadf7967b8 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:06.791618 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d56a46e6-649a-4d69-a2f7-6ceadf7967b8 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:06.792238 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d56a46e6-649a-4d69-a2f7-6ceadf7967b8 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:06.792805 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d56a46e6-649a-4d69-a2f7-6ceadf7967b8 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:06.797702 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-38afce21-f2fe-4310-a848-9b1f37a2ea87 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] 10.222.0.13 "GET /compute/v2.1/servers/60ecf54f-3d14-4927-9d7a-5a26778cad70" status: 200 len: 1478 microversion: 2.1 time: 0.617403 Oct 30 01:16:06.798776 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 417/834] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:06 2022] GET /compute/v2.1/servers/60ecf54f-3d14-4927-9d7a-5a26778cad70 => generated 1478 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:06.805712 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ba2ca241-01f6-43a6-8fc6-1c95cfced521 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:06.806557 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ba2ca241-01f6-43a6-8fc6-1c95cfced521 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: f86d0786-3c99-494f-aa6b-47adf07fca7c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:06.813454 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ba2ca241-01f6-43a6-8fc6-1c95cfced521 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:06.814002 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ba2ca241-01f6-43a6-8fc6-1c95cfced521 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:06.818954 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ba2ca241-01f6-43a6-8fc6-1c95cfced521 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:06.818954 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ba2ca241-01f6-43a6-8fc6-1c95cfced521 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:06.818954 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ba2ca241-01f6-43a6-8fc6-1c95cfced521 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:06.818954 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ba2ca241-01f6-43a6-8fc6-1c95cfced521 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:06.904902 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ba2ca241-01f6-43a6-8fc6-1c95cfced521 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:06.912669 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ba2ca241-01f6-43a6-8fc6-1c95cfced521 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/f86d0786-3c99-494f-aa6b-47adf07fca7c" status: 200 len: 1289 microversion: 2.1 time: 0.112862 Oct 30 01:16:06.916334 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 418/835] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:06 2022] GET /compute/v2.1/servers/f86d0786-3c99-494f-aa6b-47adf07fca7c => generated 1289 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:07.007893 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-77c5b071-26b5-4205-8ce8-92ffcf9ca8fc tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:07.008742 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-77c5b071-26b5-4205-8ce8-92ffcf9ca8fc tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:07.047854 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d56a46e6-649a-4d69-a2f7-6ceadf7967b8 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:07.057633 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d56a46e6-649a-4d69-a2f7-6ceadf7967b8 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f" status: 200 len: 1477 microversion: 2.1 time: 0.280010 Oct 30 01:16:07.058828 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 418/836] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:06 2022] GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f => generated 1477 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:07.097430 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-77c5b071-26b5-4205-8ce8-92ffcf9ca8fc tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:07.106590 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-77c5b071-26b5-4205-8ce8-92ffcf9ca8fc tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:07.108561 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-77c5b071-26b5-4205-8ce8-92ffcf9ca8fc tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:07.109705 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-77c5b071-26b5-4205-8ce8-92ffcf9ca8fc tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 200 len: 1285 microversion: 2.25 time: 0.106030 Oct 30 01:16:07.110753 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 419/837] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:16:07 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 1285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:16:07.750541 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-48eab7ab-c3e3-4f3f-80e7-4b4d1c7b84c9 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:07.751232 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-48eab7ab-c3e3-4f3f-80e7-4b4d1c7b84c9 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: 25a595ee-91e9-4d66-9898-15c577c9bcec] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:07.758694 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-48eab7ab-c3e3-4f3f-80e7-4b4d1c7b84c9 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:07.759190 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-48eab7ab-c3e3-4f3f-80e7-4b4d1c7b84c9 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:07.759627 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-48eab7ab-c3e3-4f3f-80e7-4b4d1c7b84c9 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:07.760340 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-48eab7ab-c3e3-4f3f-80e7-4b4d1c7b84c9 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:07.760798 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-48eab7ab-c3e3-4f3f-80e7-4b4d1c7b84c9 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:07.761227 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-48eab7ab-c3e3-4f3f-80e7-4b4d1c7b84c9 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:07.827174 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3baef3da-b891-41e3-aa66-af98ff7e15a2 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:07.827919 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3baef3da-b891-41e3-aa66-af98ff7e15a2 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] [instance: 60ecf54f-3d14-4927-9d7a-5a26778cad70] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:07.835978 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3baef3da-b891-41e3-aa66-af98ff7e15a2 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:07.836466 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3baef3da-b891-41e3-aa66-af98ff7e15a2 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:07.837104 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3baef3da-b891-41e3-aa66-af98ff7e15a2 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:07.837872 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3baef3da-b891-41e3-aa66-af98ff7e15a2 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:07.838425 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3baef3da-b891-41e3-aa66-af98ff7e15a2 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:07.838841 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3baef3da-b891-41e3-aa66-af98ff7e15a2 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:07.943356 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-48eab7ab-c3e3-4f3f-80e7-4b4d1c7b84c9 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:07.954100 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-48eab7ab-c3e3-4f3f-80e7-4b4d1c7b84c9 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/25a595ee-91e9-4d66-9898-15c577c9bcec" status: 200 len: 1314 microversion: 2.1 time: 0.207356 Oct 30 01:16:07.955265 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 419/838] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:07 2022] GET /compute/v2.1/servers/25a595ee-91e9-4d66-9898-15c577c9bcec => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:07.970672 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-25ffbefc-901e-4322-9067-a3c353b32693 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:07.971664 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-25ffbefc-901e-4322-9067-a3c353b32693 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: f86d0786-3c99-494f-aa6b-47adf07fca7c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:07.980942 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25ffbefc-901e-4322-9067-a3c353b32693 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:07.981900 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25ffbefc-901e-4322-9067-a3c353b32693 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:07.982538 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25ffbefc-901e-4322-9067-a3c353b32693 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:07.984677 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25ffbefc-901e-4322-9067-a3c353b32693 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:07.986560 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25ffbefc-901e-4322-9067-a3c353b32693 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:07.987244 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25ffbefc-901e-4322-9067-a3c353b32693 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:08.072440 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-25ffbefc-901e-4322-9067-a3c353b32693 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:08.081159 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-25ffbefc-901e-4322-9067-a3c353b32693 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/f86d0786-3c99-494f-aa6b-47adf07fca7c" status: 200 len: 1277 microversion: 2.1 time: 0.124504 Oct 30 01:16:08.095002 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 420/839] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:07 2022] GET /compute/v2.1/servers/f86d0786-3c99-494f-aa6b-47adf07fca7c => generated 1277 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:08.096823 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3baef3da-b891-41e3-aa66-af98ff7e15a2 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e6512cfbbbf412cbc4c40b80669b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c653b9bf1e064528b2ffe8c9b57fa48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:08.104647 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cc044706-9002-4c9f-99f4-b4062483a659 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:08.105293 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cc044706-9002-4c9f-99f4-b4062483a659 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:08.112143 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cc044706-9002-4c9f-99f4-b4062483a659 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:08.112646 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cc044706-9002-4c9f-99f4-b4062483a659 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:08.114225 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3baef3da-b891-41e3-aa66-af98ff7e15a2 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] 10.222.0.13 "GET /compute/v2.1/servers/60ecf54f-3d14-4927-9d7a-5a26778cad70" status: 200 len: 1478 microversion: 2.1 time: 0.290173 Oct 30 01:16:08.114348 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cc044706-9002-4c9f-99f4-b4062483a659 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:08.115083 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cc044706-9002-4c9f-99f4-b4062483a659 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:08.115552 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cc044706-9002-4c9f-99f4-b4062483a659 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:08.115900 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 420/840] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:07 2022] GET /compute/v2.1/servers/60ecf54f-3d14-4927-9d7a-5a26778cad70 => generated 1478 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:16:08.116354 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cc044706-9002-4c9f-99f4-b4062483a659 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:08.135867 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-275bf862-91a7-4e58-878f-a171724a362b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:08.136904 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-275bf862-91a7-4e58-878f-a171724a362b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:08.146246 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-275bf862-91a7-4e58-878f-a171724a362b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:08.147081 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-275bf862-91a7-4e58-878f-a171724a362b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:08.147981 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-275bf862-91a7-4e58-878f-a171724a362b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:08.148917 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-275bf862-91a7-4e58-878f-a171724a362b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:08.149760 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-275bf862-91a7-4e58-878f-a171724a362b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:08.150389 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-275bf862-91a7-4e58-878f-a171724a362b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:08.274479 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-275bf862-91a7-4e58-878f-a171724a362b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:08.283810 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-275bf862-91a7-4e58-878f-a171724a362b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:08.286021 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-275bf862-91a7-4e58-878f-a171724a362b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:08.287216 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-275bf862-91a7-4e58-878f-a171724a362b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 200 len: 1289 microversion: 2.25 time: 0.156839 Oct 30 01:16:08.287859 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 421/841] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:16:08 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 1289 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:16:08.364511 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-cc044706-9002-4c9f-99f4-b4062483a659 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:08.372809 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cc044706-9002-4c9f-99f4-b4062483a659 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f" status: 200 len: 1477 microversion: 2.1 time: 0.276649 Oct 30 01:16:08.373721 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 421/842] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:08 2022] GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f => generated 1477 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:08.575325 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d1f7153b-e67c-40b2-bb7f-d87c1cf3a91e tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:08.575841 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d1f7153b-e67c-40b2-bb7f-d87c1cf3a91e tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] [instance: f9c8bf32-6f0e-4183-88be-031de936bb81] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:08.588445 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d1f7153b-e67c-40b2-bb7f-d87c1cf3a91e tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:08.588952 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d1f7153b-e67c-40b2-bb7f-d87c1cf3a91e tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:08.589412 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d1f7153b-e67c-40b2-bb7f-d87c1cf3a91e tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:08.590199 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d1f7153b-e67c-40b2-bb7f-d87c1cf3a91e tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:08.590656 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d1f7153b-e67c-40b2-bb7f-d87c1cf3a91e tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:08.591082 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d1f7153b-e67c-40b2-bb7f-d87c1cf3a91e tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:08.659821 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d1f7153b-e67c-40b2-bb7f-d87c1cf3a91e tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] [instance: f9c8bf32-6f0e-4183-88be-031de936bb81] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:16:08.979436 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-988b06b4-ea3d-47f5-893d-700a714e20a2 req-1a0baf3f-b08a-42bd-9deb-ec54ccfc5b63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a294dd33-efb1-4d8b-a83c-817b50cdc138", "tag": "7878fd43-0a39-4f54-a5fa-8c4667f94608"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:16:09.001765 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-988b06b4-ea3d-47f5-893d-700a714e20a2 req-1a0baf3f-b08a-42bd-9deb-ec54ccfc5b63 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:09.005014 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-988b06b4-ea3d-47f5-893d-700a714e20a2 req-1a0baf3f-b08a-42bd-9deb-ec54ccfc5b63 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:09.015488 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-988b06b4-ea3d-47f5-893d-700a714e20a2 req-1a0baf3f-b08a-42bd-9deb-ec54ccfc5b63 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:09.032920 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-988b06b4-ea3d-47f5-893d-700a714e20a2 req-1a0baf3f-b08a-42bd-9deb-ec54ccfc5b63 service nova] Creating event network-changed:7878fd43-0a39-4f54-a5fa-8c4667f94608 for instance a294dd33-efb1-4d8b-a83c-817b50cdc138 on n-h1-master-1 Oct 30 01:16:09.045519 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-988b06b4-ea3d-47f5-893d-700a714e20a2 req-1a0baf3f-b08a-42bd-9deb-ec54ccfc5b63 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070689 Oct 30 01:16:09.045519 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 422/843] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:16:09.056924 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-54aa33c8-87f0-431f-bec9-0525331a278a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:09.058289 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-54aa33c8-87f0-431f-bec9-0525331a278a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: 25a595ee-91e9-4d66-9898-15c577c9bcec] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:09.071008 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-54aa33c8-87f0-431f-bec9-0525331a278a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:09.071920 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-54aa33c8-87f0-431f-bec9-0525331a278a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:09.072346 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-54aa33c8-87f0-431f-bec9-0525331a278a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:09.073582 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-54aa33c8-87f0-431f-bec9-0525331a278a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:09.083437 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-54aa33c8-87f0-431f-bec9-0525331a278a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:09.083437 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-54aa33c8-87f0-431f-bec9-0525331a278a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:09.148602 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d1f7153b-e67c-40b2-bb7f-d87c1cf3a91e tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f9c8bf32-6f0e-4183-88be-031de936bb81" status: 204 len: 0 microversion: 2.1 time: 0.580611 Oct 30 01:16:09.149539 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 422/844] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:16:08 2022] DELETE /compute/v2.1/servers/f9c8bf32-6f0e-4183-88be-031de936bb81 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:16:09.157068 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-21a57411-d06d-4fa4-9811-2683503e5ecd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:09.157821 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-21a57411-d06d-4fa4-9811-2683503e5ecd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: f86d0786-3c99-494f-aa6b-47adf07fca7c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:09.174193 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21a57411-d06d-4fa4-9811-2683503e5ecd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:09.175081 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21a57411-d06d-4fa4-9811-2683503e5ecd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:09.175598 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21a57411-d06d-4fa4-9811-2683503e5ecd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:09.177059 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21a57411-d06d-4fa4-9811-2683503e5ecd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:09.177558 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21a57411-d06d-4fa4-9811-2683503e5ecd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:09.178078 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21a57411-d06d-4fa4-9811-2683503e5ecd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:09.451599 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-54aa33c8-87f0-431f-bec9-0525331a278a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:09.460903 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-54aa33c8-87f0-431f-bec9-0525331a278a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/25a595ee-91e9-4d66-9898-15c577c9bcec" status: 200 len: 1314 microversion: 2.1 time: 0.413968 Oct 30 01:16:09.462144 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 423/845] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:09 2022] GET /compute/v2.1/servers/25a595ee-91e9-4d66-9898-15c577c9bcec => generated 1314 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:09.478463 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-27cf30e8-88e7-46e6-8f81-a668797f46c7 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:09.479388 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-27cf30e8-88e7-46e6-8f81-a668797f46c7 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] [instance: 60ecf54f-3d14-4927-9d7a-5a26778cad70] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:09.485921 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27cf30e8-88e7-46e6-8f81-a668797f46c7 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:09.486586 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27cf30e8-88e7-46e6-8f81-a668797f46c7 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:09.487213 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27cf30e8-88e7-46e6-8f81-a668797f46c7 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:09.488099 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27cf30e8-88e7-46e6-8f81-a668797f46c7 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:09.489098 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27cf30e8-88e7-46e6-8f81-a668797f46c7 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:09.489566 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27cf30e8-88e7-46e6-8f81-a668797f46c7 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:09.504231 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-21a57411-d06d-4fa4-9811-2683503e5ecd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:09.522095 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-21a57411-d06d-4fa4-9811-2683503e5ecd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/f86d0786-3c99-494f-aa6b-47adf07fca7c" status: 200 len: 1319 microversion: 2.1 time: 0.370224 Oct 30 01:16:09.523785 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 423/846] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:09 2022] GET /compute/v2.1/servers/f86d0786-3c99-494f-aa6b-47adf07fca7c => generated 1319 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:09.525326 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27cf30e8-88e7-46e6-8f81-a668797f46c7 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:09.525999 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27cf30e8-88e7-46e6-8f81-a668797f46c7 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:09.526439 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27cf30e8-88e7-46e6-8f81-a668797f46c7 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:09.527033 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-27cf30e8-88e7-46e6-8f81-a668797f46c7 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lazy-loading 'fault' on Instance uuid 60ecf54f-3d14-4927-9d7a-5a26778cad70 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:16:09.530858 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c6ed1393-d2ef-4ba7-912d-b45a2ba8a307 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:09.532435 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c6ed1393-d2ef-4ba7-912d-b45a2ba8a307 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] [instance: f9c8bf32-6f0e-4183-88be-031de936bb81] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:09.547350 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6ed1393-d2ef-4ba7-912d-b45a2ba8a307 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:09.547838 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6ed1393-d2ef-4ba7-912d-b45a2ba8a307 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:09.548414 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6ed1393-d2ef-4ba7-912d-b45a2ba8a307 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:09.549113 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6ed1393-d2ef-4ba7-912d-b45a2ba8a307 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:09.549585 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6ed1393-d2ef-4ba7-912d-b45a2ba8a307 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:09.553931 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6ed1393-d2ef-4ba7-912d-b45a2ba8a307 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:09.625814 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-27cf30e8-88e7-46e6-8f81-a668797f46c7 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e6512cfbbbf412cbc4c40b80669b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c653b9bf1e064528b2ffe8c9b57fa48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:09.635784 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-27cf30e8-88e7-46e6-8f81-a668797f46c7 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] 10.222.0.13 "GET /compute/v2.1/servers/60ecf54f-3d14-4927-9d7a-5a26778cad70" status: 200 len: 1313 microversion: 2.1 time: 0.171590 Oct 30 01:16:09.636534 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 424/847] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:09 2022] GET /compute/v2.1/servers/60ecf54f-3d14-4927-9d7a-5a26778cad70 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:09.642078 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8b73d6f3-195d-4d24-bab8-9e3f7e28b148 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:09.642958 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8b73d6f3-195d-4d24-bab8-9e3f7e28b148 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:09.651653 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:09.653478 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b73d6f3-195d-4d24-bab8-9e3f7e28b148 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:09.654197 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b73d6f3-195d-4d24-bab8-9e3f7e28b148 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:09.654754 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b73d6f3-195d-4d24-bab8-9e3f7e28b148 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:09.656202 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b73d6f3-195d-4d24-bab8-9e3f7e28b148 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:09.656861 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b73d6f3-195d-4d24-bab8-9e3f7e28b148 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:09.657522 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b73d6f3-195d-4d24-bab8-9e3f7e28b148 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:09.750279 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8b73d6f3-195d-4d24-bab8-9e3f7e28b148 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:09.760396 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8b73d6f3-195d-4d24-bab8-9e3f7e28b148 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:09.761983 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8b73d6f3-195d-4d24-bab8-9e3f7e28b148 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:09.763167 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8b73d6f3-195d-4d24-bab8-9e3f7e28b148 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 200 len: 1281 microversion: 2.25 time: 0.125405 Oct 30 01:16:09.763725 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 425/848] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:16:09 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 1281 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:16:09.773558 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2faa0a71-82c2-44bf-9d2d-447dca1c7f30 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:09.773558 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2faa0a71-82c2-44bf-9d2d-447dca1c7f30 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:09.778574 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2faa0a71-82c2-44bf-9d2d-447dca1c7f30 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:09.778574 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2faa0a71-82c2-44bf-9d2d-447dca1c7f30 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:09.778574 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2faa0a71-82c2-44bf-9d2d-447dca1c7f30 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:09.778574 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2faa0a71-82c2-44bf-9d2d-447dca1c7f30 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:09.779214 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2faa0a71-82c2-44bf-9d2d-447dca1c7f30 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:09.779214 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2faa0a71-82c2-44bf-9d2d-447dca1c7f30 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:09.825852 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c6ed1393-d2ef-4ba7-912d-b45a2ba8a307 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056e59c7d4c2475eb66b64e0e24367be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6f42c16eeb4e97b65cebf891105008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:09.834705 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c6ed1393-d2ef-4ba7-912d-b45a2ba8a307 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] 10.222.0.13 "GET /compute/v2.1/servers/f9c8bf32-6f0e-4183-88be-031de936bb81" status: 200 len: 1712 microversion: 2.1 time: 0.309594 Oct 30 01:16:09.836765 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 424/849] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:09 2022] GET /compute/v2.1/servers/f9c8bf32-6f0e-4183-88be-031de936bb81 => generated 1712 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:10.015589 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2faa0a71-82c2-44bf-9d2d-447dca1c7f30 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:10.025777 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2faa0a71-82c2-44bf-9d2d-447dca1c7f30 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f" status: 200 len: 1477 microversion: 2.1 time: 0.260965 Oct 30 01:16:10.026362 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 426/850] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:09 2022] GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f => generated 1477 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:10.132442 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-d237f893-ec66-4339-a441-c7dacf166151 req-440bb336-40ed-45e1-b8f0-fc18ac3c1a58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f86d0786-3c99-494f-aa6b-47adf07fca7c", "tag": "5abfe263-7efa-46a6-b0cd-7471fa65ad22"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:16:10.143418 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d237f893-ec66-4339-a441-c7dacf166151 req-440bb336-40ed-45e1-b8f0-fc18ac3c1a58 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:10.144060 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d237f893-ec66-4339-a441-c7dacf166151 req-440bb336-40ed-45e1-b8f0-fc18ac3c1a58 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:10.144568 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d237f893-ec66-4339-a441-c7dacf166151 req-440bb336-40ed-45e1-b8f0-fc18ac3c1a58 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:10.158541 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-d237f893-ec66-4339-a441-c7dacf166151 req-440bb336-40ed-45e1-b8f0-fc18ac3c1a58 service nova] Creating event network-changed:5abfe263-7efa-46a6-b0cd-7471fa65ad22 for instance f86d0786-3c99-494f-aa6b-47adf07fca7c on n-h1-master-1 Oct 30 01:16:10.163963 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-d237f893-ec66-4339-a441-c7dacf166151 req-440bb336-40ed-45e1-b8f0-fc18ac3c1a58 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037024 Oct 30 01:16:10.164567 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 425/851] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:16:10.485115 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-74fca888-f657-4723-bcdf-533ab2be3762 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:10.485859 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-74fca888-f657-4723-bcdf-533ab2be3762 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: 25a595ee-91e9-4d66-9898-15c577c9bcec] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:10.492545 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-74fca888-f657-4723-bcdf-533ab2be3762 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:10.493039 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-74fca888-f657-4723-bcdf-533ab2be3762 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:10.493526 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-74fca888-f657-4723-bcdf-533ab2be3762 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:10.494222 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-74fca888-f657-4723-bcdf-533ab2be3762 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:10.494685 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-74fca888-f657-4723-bcdf-533ab2be3762 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:10.495113 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-74fca888-f657-4723-bcdf-533ab2be3762 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:10.549462 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a436ce04-2e1b-44c6-b405-ad911acdc84b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:10.550579 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a436ce04-2e1b-44c6-b405-ad911acdc84b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: f86d0786-3c99-494f-aa6b-47adf07fca7c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:10.557831 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a436ce04-2e1b-44c6-b405-ad911acdc84b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:10.558322 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a436ce04-2e1b-44c6-b405-ad911acdc84b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:10.559624 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a436ce04-2e1b-44c6-b405-ad911acdc84b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:10.560922 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a436ce04-2e1b-44c6-b405-ad911acdc84b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:10.561600 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a436ce04-2e1b-44c6-b405-ad911acdc84b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:10.562178 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a436ce04-2e1b-44c6-b405-ad911acdc84b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:11.114925 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-74fca888-f657-4723-bcdf-533ab2be3762 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:11.126296 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-74fca888-f657-4723-bcdf-533ab2be3762 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/25a595ee-91e9-4d66-9898-15c577c9bcec" status: 200 len: 1314 microversion: 2.1 time: 0.645142 Oct 30 01:16:11.142093 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 427/852] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:10 2022] GET /compute/v2.1/servers/25a595ee-91e9-4d66-9898-15c577c9bcec => generated 1314 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:11.167095 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5c938f9f-6a6f-458d-b696-039d261179f6 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:11.168766 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5c938f9f-6a6f-458d-b696-039d261179f6 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] [instance: 60ecf54f-3d14-4927-9d7a-5a26778cad70] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:11.183174 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c938f9f-6a6f-458d-b696-039d261179f6 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:11.192040 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c938f9f-6a6f-458d-b696-039d261179f6 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:11.192490 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c938f9f-6a6f-458d-b696-039d261179f6 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:11.193232 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c938f9f-6a6f-458d-b696-039d261179f6 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:11.193708 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c938f9f-6a6f-458d-b696-039d261179f6 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:11.202459 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c938f9f-6a6f-458d-b696-039d261179f6 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:11.211124 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a436ce04-2e1b-44c6-b405-ad911acdc84b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:11.224502 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a436ce04-2e1b-44c6-b405-ad911acdc84b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/f86d0786-3c99-494f-aa6b-47adf07fca7c" status: 200 len: 1319 microversion: 2.1 time: 0.679874 Oct 30 01:16:11.225524 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 426/853] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:10 2022] GET /compute/v2.1/servers/f86d0786-3c99-494f-aa6b-47adf07fca7c => generated 1319 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:11.247818 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4233d25a-7254-4d31-bbe2-099d677c7b7d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:11.249044 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4233d25a-7254-4d31-bbe2-099d677c7b7d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:11.256309 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4233d25a-7254-4d31-bbe2-099d677c7b7d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:11.257058 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4233d25a-7254-4d31-bbe2-099d677c7b7d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:11.257691 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4233d25a-7254-4d31-bbe2-099d677c7b7d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:11.258560 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4233d25a-7254-4d31-bbe2-099d677c7b7d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:11.259168 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4233d25a-7254-4d31-bbe2-099d677c7b7d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:11.259807 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4233d25a-7254-4d31-bbe2-099d677c7b7d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:11.275565 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c938f9f-6a6f-458d-b696-039d261179f6 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:11.276112 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c938f9f-6a6f-458d-b696-039d261179f6 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:11.276668 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c938f9f-6a6f-458d-b696-039d261179f6 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:11.277134 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-5c938f9f-6a6f-458d-b696-039d261179f6 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lazy-loading 'fault' on Instance uuid 60ecf54f-3d14-4927-9d7a-5a26778cad70 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:16:11.280287 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:11.385846 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5c938f9f-6a6f-458d-b696-039d261179f6 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e6512cfbbbf412cbc4c40b80669b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c653b9bf1e064528b2ffe8c9b57fa48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:11.395144 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5c938f9f-6a6f-458d-b696-039d261179f6 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] 10.222.0.13 "GET /compute/v2.1/servers/60ecf54f-3d14-4927-9d7a-5a26778cad70" status: 200 len: 1313 microversion: 2.1 time: 0.251576 Oct 30 01:16:11.396068 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 428/854] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:11 2022] GET /compute/v2.1/servers/60ecf54f-3d14-4927-9d7a-5a26778cad70 => generated 1313 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:11.409155 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4233d25a-7254-4d31-bbe2-099d677c7b7d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:11.418359 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8510f52a-2ede-408b-aa8e-e98df3e3be6f tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:11.423537 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8510f52a-2ede-408b-aa8e-e98df3e3be6f tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] [instance: f9c8bf32-6f0e-4183-88be-031de936bb81] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:11.423690 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4233d25a-7254-4d31-bbe2-099d677c7b7d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:11.423690 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4233d25a-7254-4d31-bbe2-099d677c7b7d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:11.423690 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4233d25a-7254-4d31-bbe2-099d677c7b7d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 200 len: 1337 microversion: 2.25 time: 0.192517 Oct 30 01:16:11.430179 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 427/855] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:16:11 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 1337 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:16:11.432680 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8510f52a-2ede-408b-aa8e-e98df3e3be6f tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:11.434152 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8510f52a-2ede-408b-aa8e-e98df3e3be6f tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:11.435003 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8510f52a-2ede-408b-aa8e-e98df3e3be6f tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:11.436396 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8510f52a-2ede-408b-aa8e-e98df3e3be6f tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:11.437938 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8510f52a-2ede-408b-aa8e-e98df3e3be6f tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:11.438605 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8510f52a-2ede-408b-aa8e-e98df3e3be6f tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:11.445905 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1600e83e-fb95-4915-b183-f2f097d31d7e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:11.446694 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1600e83e-fb95-4915-b183-f2f097d31d7e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:11.452881 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1600e83e-fb95-4915-b183-f2f097d31d7e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:11.455935 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1600e83e-fb95-4915-b183-f2f097d31d7e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:11.456553 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1600e83e-fb95-4915-b183-f2f097d31d7e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:11.457864 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1600e83e-fb95-4915-b183-f2f097d31d7e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:11.458334 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1600e83e-fb95-4915-b183-f2f097d31d7e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:11.458769 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1600e83e-fb95-4915-b183-f2f097d31d7e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:11.474000 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=22 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:11.915695 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8510f52a-2ede-408b-aa8e-e98df3e3be6f tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056e59c7d4c2475eb66b64e0e24367be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6f42c16eeb4e97b65cebf891105008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:11.928901 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8510f52a-2ede-408b-aa8e-e98df3e3be6f tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] 10.222.0.13 "GET /compute/v2.1/servers/f9c8bf32-6f0e-4183-88be-031de936bb81" status: 200 len: 1712 microversion: 2.1 time: 0.531348 Oct 30 01:16:11.944349 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 429/856] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:11 2022] GET /compute/v2.1/servers/f9c8bf32-6f0e-4183-88be-031de936bb81 => generated 1712 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:11.944349 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-e8deb8c2-077f-4a84-bb1a-58d02dc869b8 req-a67689a5-00c4-4ffe-8fad-252d02cb4be2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60ecf54f-3d14-4927-9d7a-5a26778cad70", "name": "network-vif-deleted", "tag": "c2d9c4e2-ae4a-4acf-b671-4697188a5416"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:16:11.959589 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1600e83e-fb95-4915-b183-f2f097d31d7e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:11.966794 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-e8deb8c2-077f-4a84-bb1a-58d02dc869b8 req-a67689a5-00c4-4ffe-8fad-252d02cb4be2 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:11.967280 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-e8deb8c2-077f-4a84-bb1a-58d02dc869b8 req-a67689a5-00c4-4ffe-8fad-252d02cb4be2 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:11.967710 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-e8deb8c2-077f-4a84-bb1a-58d02dc869b8 req-a67689a5-00c4-4ffe-8fad-252d02cb4be2 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:11.972135 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1600e83e-fb95-4915-b183-f2f097d31d7e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f" status: 200 len: 1477 microversion: 2.1 time: 0.540802 Oct 30 01:16:11.993213 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 428/857] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:11 2022] GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f => generated 1477 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:12.000131 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-e8deb8c2-077f-4a84-bb1a-58d02dc869b8 req-a67689a5-00c4-4ffe-8fad-252d02cb4be2 service nova] Creating event network-vif-deleted:c2d9c4e2-ae4a-4acf-b671-4697188a5416 for instance 60ecf54f-3d14-4927-9d7a-5a26778cad70 on n-h1-master-1 Oct 30 01:16:12.018936 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-e8deb8c2-077f-4a84-bb1a-58d02dc869b8 req-a67689a5-00c4-4ffe-8fad-252d02cb4be2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087582 Oct 30 01:16:12.021351 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 430/858] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:16:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:16:12.158784 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-02b2588e-6ce0-482c-a981-abf25c089e0c tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:12.159497 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-02b2588e-6ce0-482c-a981-abf25c089e0c tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: 25a595ee-91e9-4d66-9898-15c577c9bcec] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:12.170036 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-02b2588e-6ce0-482c-a981-abf25c089e0c tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:12.170534 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-02b2588e-6ce0-482c-a981-abf25c089e0c tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:12.170972 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-02b2588e-6ce0-482c-a981-abf25c089e0c tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:12.171688 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-02b2588e-6ce0-482c-a981-abf25c089e0c tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:12.172143 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-02b2588e-6ce0-482c-a981-abf25c089e0c tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:12.172565 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-02b2588e-6ce0-482c-a981-abf25c089e0c tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:12.254998 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-33b5318e-63b1-465f-9630-a0a040182aa5 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:12.255895 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-33b5318e-63b1-465f-9630-a0a040182aa5 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: f86d0786-3c99-494f-aa6b-47adf07fca7c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:12.268437 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-33b5318e-63b1-465f-9630-a0a040182aa5 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:12.271881 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-33b5318e-63b1-465f-9630-a0a040182aa5 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:12.272525 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-33b5318e-63b1-465f-9630-a0a040182aa5 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:12.273447 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-33b5318e-63b1-465f-9630-a0a040182aa5 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:12.274085 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-33b5318e-63b1-465f-9630-a0a040182aa5 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:12.274730 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-33b5318e-63b1-465f-9630-a0a040182aa5 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:12.628670 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-02b2588e-6ce0-482c-a981-abf25c089e0c tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:12.640616 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-02b2588e-6ce0-482c-a981-abf25c089e0c tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/25a595ee-91e9-4d66-9898-15c577c9bcec" status: 200 len: 1314 microversion: 2.1 time: 0.485014 Oct 30 01:16:12.641735 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 429/859] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:12 2022] GET /compute/v2.1/servers/25a595ee-91e9-4d66-9898-15c577c9bcec => generated 1314 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:12.646928 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-33b5318e-63b1-465f-9630-a0a040182aa5 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:12.649031 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b99dac9e-21fe-4c25-a8d9-a7c1aca88b83 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:12.650128 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b99dac9e-21fe-4c25-a8d9-a7c1aca88b83 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] [instance: 60ecf54f-3d14-4927-9d7a-5a26778cad70] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:12.657751 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b99dac9e-21fe-4c25-a8d9-a7c1aca88b83 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:12.667345 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-33b5318e-63b1-465f-9630-a0a040182aa5 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/f86d0786-3c99-494f-aa6b-47adf07fca7c" status: 200 len: 1319 microversion: 2.1 time: 0.415992 Oct 30 01:16:12.674606 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 431/860] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:12 2022] GET /compute/v2.1/servers/f86d0786-3c99-494f-aa6b-47adf07fca7c => generated 1319 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:12.681674 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b99dac9e-21fe-4c25-a8d9-a7c1aca88b83 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:12.682133 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b99dac9e-21fe-4c25-a8d9-a7c1aca88b83 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:12.693483 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b99dac9e-21fe-4c25-a8d9-a7c1aca88b83 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:12.693988 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b99dac9e-21fe-4c25-a8d9-a7c1aca88b83 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:12.698743 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b99dac9e-21fe-4c25-a8d9-a7c1aca88b83 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:12.698918 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ece53c28-ad47-44bf-860d-3878de48d176 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:12.699239 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ece53c28-ad47-44bf-860d-3878de48d176 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:12.717566 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ece53c28-ad47-44bf-860d-3878de48d176 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:12.720500 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ece53c28-ad47-44bf-860d-3878de48d176 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:12.721230 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ece53c28-ad47-44bf-860d-3878de48d176 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:12.724840 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ece53c28-ad47-44bf-860d-3878de48d176 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:12.725636 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ece53c28-ad47-44bf-860d-3878de48d176 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:12.727159 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ece53c28-ad47-44bf-860d-3878de48d176 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:12.760710 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-b99dac9e-21fe-4c25-a8d9-a7c1aca88b83 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] HTTP exception thrown: Instance 60ecf54f-3d14-4927-9d7a-5a26778cad70 could not be found. Oct 30 01:16:12.762970 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b99dac9e-21fe-4c25-a8d9-a7c1aca88b83 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Request method failure captured: Oct 30 01:16:12.762970 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/60ecf54f-3d14-4927-9d7a-5a26778cad70 HTTP/1.1 Oct 30 01:16:12.762970 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:16:12.762970 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:16:12.762970 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:16:12.762970 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:16:12.762970 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:16:12.762970 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:16:12.762970 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:16:12.762970 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:16:12.762970 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdA7_D_wWbkIzevSQf9T9sJkw9hMA383gXGkEQvtDjDgpwzuDI9-zz6OaIMF_OKFzHYGcaGh0XVdbTLgX_gqdTCX0TxDD84rHFa65rdNoAryCSWIXRGSJz5tz8VvElTLp94cpliFtxvz4HhQix-FUQtBdDM9Awl_g7f4H_wP2MBipuY Oct 30 01:16:12.762970 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:16:12.762970 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:16:12.762970 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:16:12.762970 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:16:12.762970 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:16:12.762970 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:16:12.762970 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: c653b9bf1e064528b2ffe8c9b57fa48d Oct 30 01:16:12.762970 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1600780651 Oct 30 01:16:12.762970 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:16:12.762970 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:16:12.764491 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c653b9bf1e064528b2ffe8c9b57fa48d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c653b9bf1e064528b2ffe8c9b57fa48d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c653b9bf1e064528b2ffe8c9b57fa48d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c653b9bf1e064528b2ffe8c9b57fa48d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:16:12.764491 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1600780651 Oct 30 01:16:12.764491 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: c653b9bf1e064528b2ffe8c9b57fa48d Oct 30 01:16:12.764491 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1600780651 Oct 30 01:16:12.764491 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServerDiagnosticsNegativeTest-1600780651-project Oct 30 01:16:12.764491 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:16:12.764491 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:16:12.764491 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 9e6512cfbbbf412cbc4c40b80669b637 Oct 30 01:16:12.764491 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1600780651-project Oct 30 01:16:12.764491 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:16:12.764491 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 60ecf54f-3d14-4927-9d7a-5a26778cad70 could not be found. Oct 30 01:16:12.764491 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '60ecf54f-3d14-4927-9d7a-5a26778cad70'} Oct 30 01:16:12.765396 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:16:12.765396 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:16:12.765396 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:16:12.765396 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:16:12.765396 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:16:12.765396 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:16:12.765396 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:16:12.765396 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:16:12.765396 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:16:12.765396 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:16:12.765396 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60ecf54f-3d14-4927-9d7a-5a26778cad70 could not be found. Oct 30 01:16:12.765396 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:16:12.765396 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:16:12.765396 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:16:12.765396 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:16:12.765396 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:16:12.765396 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:16:12.765396 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:16:12.765396 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:16:12.765396 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:16:12.768275 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:16:12.768275 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:16:12.768275 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:16:12.768275 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:16:12.768275 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:16:12.768275 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:16:12.768275 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:16:12.768275 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60ecf54f-3d14-4927-9d7a-5a26778cad70 could not be found. Oct 30 01:16:12.768275 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:16:12.768275 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:16:12.768275 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:16:12.768275 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:16:12.768275 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:16:12.768275 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:16:12.768275 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:16:12.768275 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:16:12.768275 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60ecf54f-3d14-4927-9d7a-5a26778cad70 could not be found. Oct 30 01:16:12.768275 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:16:12.788751 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b99dac9e-21fe-4c25-a8d9-a7c1aca88b83 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] Returning 404 to user: Instance 60ecf54f-3d14-4927-9d7a-5a26778cad70 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:16:12.792362 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b99dac9e-21fe-4c25-a8d9-a7c1aca88b83 tempest-ServerDiagnosticsNegativeTest-1600780651 tempest-ServerDiagnosticsNegativeTest-1600780651-project] 10.222.0.13 "GET /compute/v2.1/servers/60ecf54f-3d14-4927-9d7a-5a26778cad70" status: 404 len: 111 microversion: 2.1 time: 0.147653 Oct 30 01:16:12.793678 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 430/861] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:12 2022] GET /compute/v2.1/servers/60ecf54f-3d14-4927-9d7a-5a26778cad70 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:16:12.914193 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ece53c28-ad47-44bf-860d-3878de48d176 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:12.926902 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ece53c28-ad47-44bf-860d-3878de48d176 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:12.934601 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ece53c28-ad47-44bf-860d-3878de48d176 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:12.940123 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ece53c28-ad47-44bf-860d-3878de48d176 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 200 len: 1337 microversion: 2.25 time: 0.264199 Oct 30 01:16:12.941474 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 432/862] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:16:12 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 1337 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:16:12.953590 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-52586645-adb5-4732-a967-066d706ba8e7 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:12.955924 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-52586645-adb5-4732-a967-066d706ba8e7 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] [instance: f9c8bf32-6f0e-4183-88be-031de936bb81] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:12.961123 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52586645-adb5-4732-a967-066d706ba8e7 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:12.961638 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52586645-adb5-4732-a967-066d706ba8e7 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:12.962068 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52586645-adb5-4732-a967-066d706ba8e7 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:12.962830 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52586645-adb5-4732-a967-066d706ba8e7 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:12.963216 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52586645-adb5-4732-a967-066d706ba8e7 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:12.963635 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52586645-adb5-4732-a967-066d706ba8e7 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:12.998147 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e9a2c999-2f8c-458a-8dbc-3b4c75564ba1 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:12.998761 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e9a2c999-2f8c-458a-8dbc-3b4c75564ba1 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:13.008066 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9a2c999-2f8c-458a-8dbc-3b4c75564ba1 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:13.008552 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9a2c999-2f8c-458a-8dbc-3b4c75564ba1 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:13.008988 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9a2c999-2f8c-458a-8dbc-3b4c75564ba1 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:13.009726 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9a2c999-2f8c-458a-8dbc-3b4c75564ba1 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:13.013258 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9a2c999-2f8c-458a-8dbc-3b4c75564ba1 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:13.015911 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9a2c999-2f8c-458a-8dbc-3b4c75564ba1 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:13.495724 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-52586645-adb5-4732-a967-066d706ba8e7 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056e59c7d4c2475eb66b64e0e24367be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6f42c16eeb4e97b65cebf891105008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:13.505727 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-52586645-adb5-4732-a967-066d706ba8e7 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] 10.222.0.13 "GET /compute/v2.1/servers/f9c8bf32-6f0e-4183-88be-031de936bb81" status: 200 len: 1712 microversion: 2.1 time: 0.555956 Oct 30 01:16:13.517875 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 431/863] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:12 2022] GET /compute/v2.1/servers/f9c8bf32-6f0e-4183-88be-031de936bb81 => generated 1712 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:13.523489 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e9a2c999-2f8c-458a-8dbc-3b4c75564ba1 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:13.528270 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-84333c77-2010-4269-a23b-dcb46cb9b4e0 req-5d8fc130-e52b-4fd4-98df-7e69c0629c1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12ca60c1-7c35-420c-b177-c7f3915a989f", "name": "network-vif-unplugged", "status": "completed", "tag": "0230e7b6-4d30-48c3-b9ab-066d496072ad"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:16:13.530095 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e9a2c999-2f8c-458a-8dbc-3b4c75564ba1 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f" status: 200 len: 1476 microversion: 2.1 time: 0.535733 Oct 30 01:16:13.546249 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 433/864] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:12 2022] GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f => generated 1476 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:13.567910 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-84333c77-2010-4269-a23b-dcb46cb9b4e0 req-5d8fc130-e52b-4fd4-98df-7e69c0629c1c service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:13.568672 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-84333c77-2010-4269-a23b-dcb46cb9b4e0 req-5d8fc130-e52b-4fd4-98df-7e69c0629c1c service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:13.569116 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-84333c77-2010-4269-a23b-dcb46cb9b4e0 req-5d8fc130-e52b-4fd4-98df-7e69c0629c1c service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:13.583028 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-84333c77-2010-4269-a23b-dcb46cb9b4e0 req-5d8fc130-e52b-4fd4-98df-7e69c0629c1c service nova] Creating event network-vif-unplugged:0230e7b6-4d30-48c3-b9ab-066d496072ad for instance 12ca60c1-7c35-420c-b177-c7f3915a989f on n-h1-master-1 Oct 30 01:16:13.593568 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [req-84333c77-2010-4269-a23b-dcb46cb9b4e0 req-5d8fc130-e52b-4fd4-98df-7e69c0629c1c service nova] Instance 12ca60c1-7c35-420c-b177-c7f3915a989f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=121103) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 30 01:16:13.605150 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-84333c77-2010-4269-a23b-dcb46cb9b4e0 req-5d8fc130-e52b-4fd4-98df-7e69c0629c1c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085692 Oct 30 01:16:13.606177 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 432/865] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:16:13.664223 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2f6fbece-3109-43ed-9d87-358a89a6eca6 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:13.665178 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2f6fbece-3109-43ed-9d87-358a89a6eca6 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: 25a595ee-91e9-4d66-9898-15c577c9bcec] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:13.676959 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2f6fbece-3109-43ed-9d87-358a89a6eca6 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:13.677587 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2f6fbece-3109-43ed-9d87-358a89a6eca6 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:13.678102 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2f6fbece-3109-43ed-9d87-358a89a6eca6 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:13.678904 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2f6fbece-3109-43ed-9d87-358a89a6eca6 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:13.679433 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2f6fbece-3109-43ed-9d87-358a89a6eca6 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:13.679933 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2f6fbece-3109-43ed-9d87-358a89a6eca6 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:13.694839 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b3f2d356-1533-4a93-928f-5f8e252af394 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:13.695574 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b3f2d356-1533-4a93-928f-5f8e252af394 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: f86d0786-3c99-494f-aa6b-47adf07fca7c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:13.703344 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3f2d356-1533-4a93-928f-5f8e252af394 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:13.703949 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3f2d356-1533-4a93-928f-5f8e252af394 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:13.704465 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3f2d356-1533-4a93-928f-5f8e252af394 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:13.705559 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3f2d356-1533-4a93-928f-5f8e252af394 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:13.706449 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3f2d356-1533-4a93-928f-5f8e252af394 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:13.707150 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3f2d356-1533-4a93-928f-5f8e252af394 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:14.218285 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b3f2d356-1533-4a93-928f-5f8e252af394 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:14.234289 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b3f2d356-1533-4a93-928f-5f8e252af394 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/f86d0786-3c99-494f-aa6b-47adf07fca7c" status: 200 len: 1319 microversion: 2.1 time: 0.544478 Oct 30 01:16:14.234883 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 433/866] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:13 2022] GET /compute/v2.1/servers/f86d0786-3c99-494f-aa6b-47adf07fca7c => generated 1319 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:16:14.240101 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-64ad4bc1-3a0b-47b6-85fe-a3f782bfb7ee tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:14.240721 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-64ad4bc1-3a0b-47b6-85fe-a3f782bfb7ee tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:14.253687 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-64ad4bc1-3a0b-47b6-85fe-a3f782bfb7ee tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:14.255933 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-64ad4bc1-3a0b-47b6-85fe-a3f782bfb7ee tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:14.256610 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-64ad4bc1-3a0b-47b6-85fe-a3f782bfb7ee tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:14.257354 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2f6fbece-3109-43ed-9d87-358a89a6eca6 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:14.262525 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-64ad4bc1-3a0b-47b6-85fe-a3f782bfb7ee tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:14.263372 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-64ad4bc1-3a0b-47b6-85fe-a3f782bfb7ee tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:14.264019 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-64ad4bc1-3a0b-47b6-85fe-a3f782bfb7ee tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:14.279697 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2f6fbece-3109-43ed-9d87-358a89a6eca6 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/25a595ee-91e9-4d66-9898-15c577c9bcec" status: 200 len: 1314 microversion: 2.1 time: 0.619281 Oct 30 01:16:14.284255 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 434/867] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:13 2022] GET /compute/v2.1/servers/25a595ee-91e9-4d66-9898-15c577c9bcec => generated 1314 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:14.357323 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-64ad4bc1-3a0b-47b6-85fe-a3f782bfb7ee tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:14.373263 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-64ad4bc1-3a0b-47b6-85fe-a3f782bfb7ee tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:14.375666 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-64ad4bc1-3a0b-47b6-85fe-a3f782bfb7ee tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:14.377326 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-64ad4bc1-3a0b-47b6-85fe-a3f782bfb7ee tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 200 len: 1343 microversion: 2.25 time: 0.141309 Oct 30 01:16:14.378589 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 434/868] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:16:14 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 1343 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:16:14.531588 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-44280b00-ce00-432f-8507-b1fe3f1d3846 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:14.532758 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-44280b00-ce00-432f-8507-b1fe3f1d3846 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] [instance: f9c8bf32-6f0e-4183-88be-031de936bb81] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:14.542865 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44280b00-ce00-432f-8507-b1fe3f1d3846 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:14.543365 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44280b00-ce00-432f-8507-b1fe3f1d3846 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:14.545172 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44280b00-ce00-432f-8507-b1fe3f1d3846 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:14.545172 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44280b00-ce00-432f-8507-b1fe3f1d3846 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:14.545172 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44280b00-ce00-432f-8507-b1fe3f1d3846 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:14.545517 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44280b00-ce00-432f-8507-b1fe3f1d3846 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:14.554548 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2ce97350-77c8-404d-8227-36c0e3ba8a84 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:14.555406 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2ce97350-77c8-404d-8227-36c0e3ba8a84 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:14.562191 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2ce97350-77c8-404d-8227-36c0e3ba8a84 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:14.562896 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2ce97350-77c8-404d-8227-36c0e3ba8a84 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:14.563657 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2ce97350-77c8-404d-8227-36c0e3ba8a84 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:14.564765 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2ce97350-77c8-404d-8227-36c0e3ba8a84 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:14.565400 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2ce97350-77c8-404d-8227-36c0e3ba8a84 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:14.567883 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2ce97350-77c8-404d-8227-36c0e3ba8a84 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:14.595988 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:14.625008 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-44280b00-ce00-432f-8507-b1fe3f1d3846 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056e59c7d4c2475eb66b64e0e24367be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6f42c16eeb4e97b65cebf891105008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:14.635280 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-44280b00-ce00-432f-8507-b1fe3f1d3846 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] 10.222.0.13 "GET /compute/v2.1/servers/f9c8bf32-6f0e-4183-88be-031de936bb81" status: 200 len: 1645 microversion: 2.1 time: 0.107637 Oct 30 01:16:14.636435 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 435/869] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:14 2022] GET /compute/v2.1/servers/f9c8bf32-6f0e-4183-88be-031de936bb81 => generated 1645 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:14.799491 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2ce97350-77c8-404d-8227-36c0e3ba8a84 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:14.809582 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2ce97350-77c8-404d-8227-36c0e3ba8a84 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f" status: 200 len: 1476 microversion: 2.1 time: 0.259174 Oct 30 01:16:14.811457 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 435/870] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:14 2022] GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f => generated 1476 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:15.261721 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0b077a67-2a10-485c-8f06-5bb93465cdca tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:15.262434 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0b077a67-2a10-485c-8f06-5bb93465cdca tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: f86d0786-3c99-494f-aa6b-47adf07fca7c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:15.280991 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b077a67-2a10-485c-8f06-5bb93465cdca tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:15.281529 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b077a67-2a10-485c-8f06-5bb93465cdca tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:15.281968 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b077a67-2a10-485c-8f06-5bb93465cdca tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:15.283018 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b077a67-2a10-485c-8f06-5bb93465cdca tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:15.283669 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b077a67-2a10-485c-8f06-5bb93465cdca tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:15.284609 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b077a67-2a10-485c-8f06-5bb93465cdca tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:15.311993 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e8e4665e-3306-4e1e-8d35-e7152fa25766 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:15.313663 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e8e4665e-3306-4e1e-8d35-e7152fa25766 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: 25a595ee-91e9-4d66-9898-15c577c9bcec] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:15.322618 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e8e4665e-3306-4e1e-8d35-e7152fa25766 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:15.323105 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e8e4665e-3306-4e1e-8d35-e7152fa25766 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:15.323537 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e8e4665e-3306-4e1e-8d35-e7152fa25766 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:15.324248 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e8e4665e-3306-4e1e-8d35-e7152fa25766 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:15.324697 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e8e4665e-3306-4e1e-8d35-e7152fa25766 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:15.325117 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e8e4665e-3306-4e1e-8d35-e7152fa25766 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:15.403863 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=18 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:15.840407 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0b077a67-2a10-485c-8f06-5bb93465cdca tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:15.850045 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0b077a67-2a10-485c-8f06-5bb93465cdca tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/f86d0786-3c99-494f-aa6b-47adf07fca7c" status: 200 len: 1319 microversion: 2.1 time: 0.592243 Oct 30 01:16:15.855617 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 436/871] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:15 2022] GET /compute/v2.1/servers/f86d0786-3c99-494f-aa6b-47adf07fca7c => generated 1319 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:15.860617 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a616c54d-0df5-4fbb-b114-495f3fd24d8d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:15.865730 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a616c54d-0df5-4fbb-b114-495f3fd24d8d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:15.882994 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a616c54d-0df5-4fbb-b114-495f3fd24d8d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:15.885082 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a616c54d-0df5-4fbb-b114-495f3fd24d8d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:15.886319 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a616c54d-0df5-4fbb-b114-495f3fd24d8d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:15.889253 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a616c54d-0df5-4fbb-b114-495f3fd24d8d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:15.889960 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a616c54d-0df5-4fbb-b114-495f3fd24d8d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:15.890557 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a616c54d-0df5-4fbb-b114-495f3fd24d8d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:15.965892 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=22 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:16.087952 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e8e4665e-3306-4e1e-8d35-e7152fa25766 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:16.114004 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e8e4665e-3306-4e1e-8d35-e7152fa25766 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/25a595ee-91e9-4d66-9898-15c577c9bcec" status: 200 len: 1314 microversion: 2.1 time: 0.805696 Oct 30 01:16:16.114604 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 436/872] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:15 2022] GET /compute/v2.1/servers/25a595ee-91e9-4d66-9898-15c577c9bcec => generated 1314 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:16:16.131331 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-656d67e7-2e16-4425-9730-dc5109dd3385 req-99bb07ef-cdd0-4cbf-9b45-5829dc20cbb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9c8bf32-6f0e-4183-88be-031de936bb81", "name": "network-vif-deleted", "tag": "04c8c04f-f3e1-4927-a35a-2de5c05a0259"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:16:16.172636 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-656d67e7-2e16-4425-9730-dc5109dd3385 req-99bb07ef-cdd0-4cbf-9b45-5829dc20cbb8 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:16.175902 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-656d67e7-2e16-4425-9730-dc5109dd3385 req-99bb07ef-cdd0-4cbf-9b45-5829dc20cbb8 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:16.177771 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-656d67e7-2e16-4425-9730-dc5109dd3385 req-99bb07ef-cdd0-4cbf-9b45-5829dc20cbb8 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:16.226210 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a616c54d-0df5-4fbb-b114-495f3fd24d8d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:16.230236 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-656d67e7-2e16-4425-9730-dc5109dd3385 req-99bb07ef-cdd0-4cbf-9b45-5829dc20cbb8 service nova] Creating event network-vif-deleted:04c8c04f-f3e1-4927-a35a-2de5c05a0259 for instance f9c8bf32-6f0e-4183-88be-031de936bb81 on n-h2-master-1 Oct 30 01:16:16.236637 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a616c54d-0df5-4fbb-b114-495f3fd24d8d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:16.238147 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-656d67e7-2e16-4425-9730-dc5109dd3385 req-99bb07ef-cdd0-4cbf-9b45-5829dc20cbb8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119171 Oct 30 01:16:16.238324 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a616c54d-0df5-4fbb-b114-495f3fd24d8d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:16.239493 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 437/873] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:16:16.247967 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-42564358-19cd-4bd9-ab31-81fc2459ab0a tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:16.249651 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-42564358-19cd-4bd9-ab31-81fc2459ab0a tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] [instance: f9c8bf32-6f0e-4183-88be-031de936bb81] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:16.251778 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a616c54d-0df5-4fbb-b114-495f3fd24d8d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 200 len: 1411 microversion: 2.25 time: 0.382701 Oct 30 01:16:16.255248 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 437/874] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:16:15 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 1411 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:16:16.259565 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42564358-19cd-4bd9-ab31-81fc2459ab0a tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:16.260280 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42564358-19cd-4bd9-ab31-81fc2459ab0a tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:16.261637 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42564358-19cd-4bd9-ab31-81fc2459ab0a tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:16.262629 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42564358-19cd-4bd9-ab31-81fc2459ab0a tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:16.263290 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42564358-19cd-4bd9-ab31-81fc2459ab0a tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:16.263906 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42564358-19cd-4bd9-ab31-81fc2459ab0a tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:16.277895 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-09b7c7c9-c831-4925-8ac3-1b3cb1269c04 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:16.280530 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-09b7c7c9-c831-4925-8ac3-1b3cb1269c04 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:16.299768 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-09b7c7c9-c831-4925-8ac3-1b3cb1269c04 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:16.302099 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-09b7c7c9-c831-4925-8ac3-1b3cb1269c04 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:16.305154 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-09b7c7c9-c831-4925-8ac3-1b3cb1269c04 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:16.307576 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-09b7c7c9-c831-4925-8ac3-1b3cb1269c04 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:16.308716 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-09b7c7c9-c831-4925-8ac3-1b3cb1269c04 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:16.311358 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-09b7c7c9-c831-4925-8ac3-1b3cb1269c04 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:16.348903 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42564358-19cd-4bd9-ab31-81fc2459ab0a tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:16.350501 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42564358-19cd-4bd9-ab31-81fc2459ab0a tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:16.356422 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42564358-19cd-4bd9-ab31-81fc2459ab0a tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:16.357116 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-42564358-19cd-4bd9-ab31-81fc2459ab0a tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lazy-loading 'fault' on Instance uuid f9c8bf32-6f0e-4183-88be-031de936bb81 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:16:16.480484 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-42564358-19cd-4bd9-ab31-81fc2459ab0a tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056e59c7d4c2475eb66b64e0e24367be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6f42c16eeb4e97b65cebf891105008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:16.493148 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-42564358-19cd-4bd9-ab31-81fc2459ab0a tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] 10.222.0.13 "GET /compute/v2.1/servers/f9c8bf32-6f0e-4183-88be-031de936bb81" status: 200 len: 1354 microversion: 2.1 time: 0.252092 Oct 30 01:16:16.494568 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 438/875] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:16 2022] GET /compute/v2.1/servers/f9c8bf32-6f0e-4183-88be-031de936bb81 => generated 1354 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:16.500610 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-bfb5cd08-4120-4982-bd8d-162d04216061 req-0a28d841-807a-4586-8cba-66258c25400e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f10b90ae-23e1-4ca1-b95e-9404e606e5d9", "name": "network-vif-plugged", "status": "completed", "tag": "9f14e853-78c5-4b79-8df2-448f8f1726ff"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:16:16.533236 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-bfb5cd08-4120-4982-bd8d-162d04216061 req-0a28d841-807a-4586-8cba-66258c25400e service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:16.534315 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-bfb5cd08-4120-4982-bd8d-162d04216061 req-0a28d841-807a-4586-8cba-66258c25400e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:16.534949 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-bfb5cd08-4120-4982-bd8d-162d04216061 req-0a28d841-807a-4586-8cba-66258c25400e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:16.559505 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-bfb5cd08-4120-4982-bd8d-162d04216061 req-0a28d841-807a-4586-8cba-66258c25400e service nova] Creating event network-vif-plugged:9f14e853-78c5-4b79-8df2-448f8f1726ff for instance f10b90ae-23e1-4ca1-b95e-9404e606e5d9 on n-h2-master-1 Oct 30 01:16:16.573730 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-bfb5cd08-4120-4982-bd8d-162d04216061 req-0a28d841-807a-4586-8cba-66258c25400e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077294 Oct 30 01:16:16.577817 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 439/876] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:16:16.706033 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-09b7c7c9-c831-4925-8ac3-1b3cb1269c04 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:16.718092 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-09b7c7c9-c831-4925-8ac3-1b3cb1269c04 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f" status: 200 len: 1476 microversion: 2.1 time: 0.458057 Oct 30 01:16:16.720635 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 438/877] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:16 2022] GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f => generated 1476 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:16.891111 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f6b14f35-f6c0-4d9c-bf18-adc97c0dfabd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:16.894568 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f6b14f35-f6c0-4d9c-bf18-adc97c0dfabd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: f86d0786-3c99-494f-aa6b-47adf07fca7c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:16.907373 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f6b14f35-f6c0-4d9c-bf18-adc97c0dfabd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:16.908258 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f6b14f35-f6c0-4d9c-bf18-adc97c0dfabd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:16.911200 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f6b14f35-f6c0-4d9c-bf18-adc97c0dfabd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:16.912435 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f6b14f35-f6c0-4d9c-bf18-adc97c0dfabd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:16.913189 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f6b14f35-f6c0-4d9c-bf18-adc97c0dfabd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:16.914225 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f6b14f35-f6c0-4d9c-bf18-adc97c0dfabd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:17.103859 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=40 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:17.140781 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-60c04b27-cfb6-480a-b4af-97ce1e71af0f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:17.142475 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-60c04b27-cfb6-480a-b4af-97ce1e71af0f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: 25a595ee-91e9-4d66-9898-15c577c9bcec] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:17.153318 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-60c04b27-cfb6-480a-b4af-97ce1e71af0f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:17.154322 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-60c04b27-cfb6-480a-b4af-97ce1e71af0f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:17.155000 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-60c04b27-cfb6-480a-b4af-97ce1e71af0f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:17.156638 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-60c04b27-cfb6-480a-b4af-97ce1e71af0f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:17.157586 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-60c04b27-cfb6-480a-b4af-97ce1e71af0f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:17.158394 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-60c04b27-cfb6-480a-b4af-97ce1e71af0f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:17.819314 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-60c04b27-cfb6-480a-b4af-97ce1e71af0f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:17.822542 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f6b14f35-f6c0-4d9c-bf18-adc97c0dfabd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:17.836078 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f6b14f35-f6c0-4d9c-bf18-adc97c0dfabd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/f86d0786-3c99-494f-aa6b-47adf07fca7c" status: 200 len: 1319 microversion: 2.1 time: 0.960283 Oct 30 01:16:17.849283 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 440/878] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:16 2022] GET /compute/v2.1/servers/f86d0786-3c99-494f-aa6b-47adf07fca7c => generated 1319 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:17.854876 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-60c04b27-cfb6-480a-b4af-97ce1e71af0f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/25a595ee-91e9-4d66-9898-15c577c9bcec" status: 200 len: 1314 microversion: 2.1 time: 0.716085 Oct 30 01:16:17.854876 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 439/879] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:17 2022] GET /compute/v2.1/servers/25a595ee-91e9-4d66-9898-15c577c9bcec => generated 1314 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:16:17.871988 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c6405d27-dbef-4e89-a3d1-07663e82ec17 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:17.872876 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c6405d27-dbef-4e89-a3d1-07663e82ec17 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:17.881610 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6405d27-dbef-4e89-a3d1-07663e82ec17 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:17.882511 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6405d27-dbef-4e89-a3d1-07663e82ec17 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:17.883438 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6405d27-dbef-4e89-a3d1-07663e82ec17 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:17.884362 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6405d27-dbef-4e89-a3d1-07663e82ec17 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:17.884978 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6405d27-dbef-4e89-a3d1-07663e82ec17 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:17.885586 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6405d27-dbef-4e89-a3d1-07663e82ec17 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:17.887038 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b127c2dc-641d-4545-a377-4aa0e73fc3dd tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:17.887741 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b127c2dc-641d-4545-a377-4aa0e73fc3dd tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] [instance: f9c8bf32-6f0e-4183-88be-031de936bb81] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:17.911007 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b127c2dc-641d-4545-a377-4aa0e73fc3dd tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:17.911812 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b127c2dc-641d-4545-a377-4aa0e73fc3dd tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:17.912274 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b127c2dc-641d-4545-a377-4aa0e73fc3dd tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:17.913019 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b127c2dc-641d-4545-a377-4aa0e73fc3dd tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:17.913510 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b127c2dc-641d-4545-a377-4aa0e73fc3dd tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:17.913945 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b127c2dc-641d-4545-a377-4aa0e73fc3dd tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:17.933909 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-b127c2dc-641d-4545-a377-4aa0e73fc3dd tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] HTTP exception thrown: Instance f9c8bf32-6f0e-4183-88be-031de936bb81 could not be found. Oct 30 01:16:17.935989 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b127c2dc-641d-4545-a377-4aa0e73fc3dd tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Request method failure captured: Oct 30 01:16:17.935989 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/f9c8bf32-6f0e-4183-88be-031de936bb81 HTTP/1.1 Oct 30 01:16:17.935989 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:16:17.935989 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:16:17.935989 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:16:17.935989 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:16:17.935989 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:16:17.935989 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:16:17.935989 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:16:17.935989 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:16:17.935989 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXc_EWK59eAKufdhKM9IttFURSpdNaALHXHfxK5osRCNtqd2aUByDtYBd4njkNUK7MxutQH10XI1SCok0F98MCH3zAxuivHgz7t03cKabRESluyqbkpJwJPRtizYBv5MOVvEs8776_TxSqZTIGBGOeQLfVoxcZQqc7sYPShD3xTAxOMg Oct 30 01:16:17.935989 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:16:17.935989 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:16:17.935989 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:16:17.935989 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:16:17.935989 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:16:17.935989 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:16:17.935989 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 8e6f42c16eeb4e97b65cebf891105008 Oct 30 01:16:17.935989 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-573551596 Oct 30 01:16:17.935989 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:16:17.935989 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:16:17.937694 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8e6f42c16eeb4e97b65cebf891105008"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8e6f42c16eeb4e97b65cebf891105008"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8e6f42c16eeb4e97b65cebf891105008"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8e6f42c16eeb4e97b65cebf891105008"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:16:17.937694 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-573551596 Oct 30 01:16:17.937694 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 8e6f42c16eeb4e97b65cebf891105008 Oct 30 01:16:17.937694 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-573551596 Oct 30 01:16:17.937694 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServersWithSpecificFlavorTestJSON-573551596-project Oct 30 01:16:17.937694 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:16:17.937694 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:16:17.937694 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 056e59c7d4c2475eb66b64e0e24367be Oct 30 01:16:17.937694 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-573551596-project Oct 30 01:16:17.937694 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:16:17.937694 n-d-master-1 devstack@n-api.service[121102]: exception: Instance f9c8bf32-6f0e-4183-88be-031de936bb81 could not be found. Oct 30 01:16:17.937694 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'f9c8bf32-6f0e-4183-88be-031de936bb81'} Oct 30 01:16:17.938446 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:16:17.938446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:16:17.938446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:16:17.938446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:16:17.938446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:16:17.938446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:16:17.938446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:16:17.938446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:16:17.938446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:16:17.938446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:16:17.938446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9c8bf32-6f0e-4183-88be-031de936bb81 could not be found. Oct 30 01:16:17.938446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:16:17.938446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:16:17.938446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:16:17.938446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:16:17.938446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:16:17.938446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:16:17.938446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:16:17.938446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:16:17.938446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:16:17.939710 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:16:17.939710 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:16:17.939710 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:16:17.939710 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:16:17.939710 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:16:17.939710 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:16:17.939710 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:16:17.939710 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9c8bf32-6f0e-4183-88be-031de936bb81 could not be found. Oct 30 01:16:17.939710 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:16:17.939710 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:16:17.939710 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:16:17.939710 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:16:17.939710 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:16:17.939710 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:16:17.939710 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:16:17.939710 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:16:17.939710 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9c8bf32-6f0e-4183-88be-031de936bb81 could not be found. Oct 30 01:16:17.939710 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:16:17.940961 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b127c2dc-641d-4545-a377-4aa0e73fc3dd tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Returning 404 to user: Instance f9c8bf32-6f0e-4183-88be-031de936bb81 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:16:17.940961 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b127c2dc-641d-4545-a377-4aa0e73fc3dd tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] 10.222.0.13 "GET /compute/v2.1/servers/f9c8bf32-6f0e-4183-88be-031de936bb81" status: 404 len: 111 microversion: 2.1 time: 0.081140 Oct 30 01:16:17.942287 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 440/880] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:17 2022] GET /compute/v2.1/servers/f9c8bf32-6f0e-4183-88be-031de936bb81 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:16:17.949251 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ff0d5c92-4fde-4969-854c-48b075569559 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:17.950421 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ff0d5c92-4fde-4969-854c-48b075569559 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:17.959027 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ff0d5c92-4fde-4969-854c-48b075569559 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:17.959649 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ff0d5c92-4fde-4969-854c-48b075569559 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:17.960305 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ff0d5c92-4fde-4969-854c-48b075569559 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:17.967340 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ff0d5c92-4fde-4969-854c-48b075569559 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:17.967340 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ff0d5c92-4fde-4969-854c-48b075569559 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:17.967340 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ff0d5c92-4fde-4969-854c-48b075569559 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:18.228023 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c6405d27-dbef-4e89-a3d1-07663e82ec17 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:18.243121 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c6405d27-dbef-4e89-a3d1-07663e82ec17 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:18.244744 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c6405d27-dbef-4e89-a3d1-07663e82ec17 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:18.248145 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c6405d27-dbef-4e89-a3d1-07663e82ec17 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 200 len: 1411 microversion: 2.25 time: 0.397462 Oct 30 01:16:18.272371 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 441/881] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:16:17 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 1411 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:16:18.285323 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2edefd68-abbb-4d58-9645-84d68f7cb180 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:18.285905 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2edefd68-abbb-4d58-9645-84d68f7cb180 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] [instance: 7571f255-6ff3-4fc7-bcaa-4837bc05dbf5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:18.305399 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2edefd68-abbb-4d58-9645-84d68f7cb180 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:18.305930 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2edefd68-abbb-4d58-9645-84d68f7cb180 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:18.306374 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2edefd68-abbb-4d58-9645-84d68f7cb180 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:18.307101 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2edefd68-abbb-4d58-9645-84d68f7cb180 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:18.307554 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2edefd68-abbb-4d58-9645-84d68f7cb180 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:18.307979 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2edefd68-abbb-4d58-9645-84d68f7cb180 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:18.347910 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-2edefd68-abbb-4d58-9645-84d68f7cb180 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] HTTP exception thrown: Instance 7571f255-6ff3-4fc7-bcaa-4837bc05dbf5 could not be found. Oct 30 01:16:18.349668 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2edefd68-abbb-4d58-9645-84d68f7cb180 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Request method failure captured: Oct 30 01:16:18.349668 n-d-master-1 devstack@n-api.service[121103]: request: DELETE /compute/v2.1/servers/7571f255-6ff3-4fc7-bcaa-4837bc05dbf5 HTTP/1.1 Oct 30 01:16:18.349668 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:16:18.349668 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:16:18.349668 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:16:18.349668 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:16:18.349668 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:16:18.349668 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:16:18.349668 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:16:18.349668 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:16:18.349668 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXc_EWK59eAKufdhKM9IttFURSpdNaALHXHfxK5osRCNtqd2aUByDtYBd4njkNUK7MxutQH10XI1SCok0F98MCH3zAxuivHgz7t03cKabRESluyqbkpJwJPRtizYBv5MOVvEs8776_TxSqZTIGBGOeQLfVoxcZQqc7sYPShD3xTAxOMg Oct 30 01:16:18.349668 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:16:18.349668 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:16:18.349668 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:16:18.349668 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:16:18.349668 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:16:18.349668 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:16:18.349668 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 8e6f42c16eeb4e97b65cebf891105008 Oct 30 01:16:18.349668 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-573551596 Oct 30 01:16:18.349668 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:16:18.349668 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:16:18.351277 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8e6f42c16eeb4e97b65cebf891105008"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8e6f42c16eeb4e97b65cebf891105008"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8e6f42c16eeb4e97b65cebf891105008"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8e6f42c16eeb4e97b65cebf891105008"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:16:18.351277 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-573551596 Oct 30 01:16:18.351277 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 8e6f42c16eeb4e97b65cebf891105008 Oct 30 01:16:18.351277 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-573551596 Oct 30 01:16:18.351277 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersWithSpecificFlavorTestJSON-573551596-project Oct 30 01:16:18.351277 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:16:18.351277 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:16:18.351277 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 056e59c7d4c2475eb66b64e0e24367be Oct 30 01:16:18.351277 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-573551596-project Oct 30 01:16:18.351277 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:16:18.351277 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 7571f255-6ff3-4fc7-bcaa-4837bc05dbf5 could not be found. Oct 30 01:16:18.351277 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '7571f255-6ff3-4fc7-bcaa-4837bc05dbf5'} Oct 30 01:16:18.352249 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:16:18.352249 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:16:18.352249 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:16:18.352249 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:16:18.352249 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:16:18.352249 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:16:18.352249 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:16:18.352249 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:16:18.352249 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:16:18.352249 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:16:18.352249 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7571f255-6ff3-4fc7-bcaa-4837bc05dbf5 could not be found. Oct 30 01:16:18.352249 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:16:18.352249 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:16:18.352249 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:16:18.352249 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:16:18.352249 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:16:18.352249 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:16:18.352249 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:16:18.352249 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:16:18.352249 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:16:18.353717 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:16:18.353717 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:16:18.353717 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:16:18.353717 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:16:18.353717 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:16:18.353717 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:16:18.353717 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:16:18.353717 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:16:18.353717 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:16:18.353717 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7571f255-6ff3-4fc7-bcaa-4837bc05dbf5 could not be found. Oct 30 01:16:18.353717 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:16:18.353717 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:16:18.353717 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:16:18.353717 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:16:18.353717 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:16:18.353717 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:16:18.353717 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:16:18.353717 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:16:18.353717 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7571f255-6ff3-4fc7-bcaa-4837bc05dbf5 could not be found. Oct 30 01:16:18.353717 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:16:18.357834 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2edefd68-abbb-4d58-9645-84d68f7cb180 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Returning 404 to user: Instance 7571f255-6ff3-4fc7-bcaa-4837bc05dbf5 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:16:18.360301 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2edefd68-abbb-4d58-9645-84d68f7cb180 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7571f255-6ff3-4fc7-bcaa-4837bc05dbf5" status: 404 len: 111 microversion: 2.1 time: 0.085336 Oct 30 01:16:18.362065 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 442/882] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:16:18 2022] DELETE /compute/v2.1/servers/7571f255-6ff3-4fc7-bcaa-4837bc05dbf5 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:16:18.374487 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-8e2fbbb1-8626-49b2-9ecb-c8a155d377ab req-4d4946b8-042f-4db8-b5e8-21b1982d8c2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12ca60c1-7c35-420c-b177-c7f3915a989f", "tag": "0230e7b6-4d30-48c3-b9ab-066d496072ad"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:16:18.392610 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:18.410889 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-8e2fbbb1-8626-49b2-9ecb-c8a155d377ab req-4d4946b8-042f-4db8-b5e8-21b1982d8c2e service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:18.411378 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-8e2fbbb1-8626-49b2-9ecb-c8a155d377ab req-4d4946b8-042f-4db8-b5e8-21b1982d8c2e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:18.412403 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-8e2fbbb1-8626-49b2-9ecb-c8a155d377ab req-4d4946b8-042f-4db8-b5e8-21b1982d8c2e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:18.443414 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-8e2fbbb1-8626-49b2-9ecb-c8a155d377ab req-4d4946b8-042f-4db8-b5e8-21b1982d8c2e service nova] Creating event network-changed:0230e7b6-4d30-48c3-b9ab-066d496072ad for instance 12ca60c1-7c35-420c-b177-c7f3915a989f on n-h1-master-1 Oct 30 01:16:18.456269 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ff0d5c92-4fde-4969-854c-48b075569559 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:18.465737 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [req-8e2fbbb1-8626-49b2-9ecb-c8a155d377ab req-4d4946b8-042f-4db8-b5e8-21b1982d8c2e service nova] Instance 12ca60c1-7c35-420c-b177-c7f3915a989f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=121103) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 30 01:16:18.475337 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ff0d5c92-4fde-4969-854c-48b075569559 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f" status: 200 len: 1476 microversion: 2.1 time: 0.529255 Oct 30 01:16:18.487078 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 441/883] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:17 2022] GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f => generated 1476 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:18.498205 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-740889f4-076d-43af-979f-9de44605bb81 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:18.498840 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-740889f4-076d-43af-979f-9de44605bb81 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] [instance: 7571f255-6ff3-4fc7-bcaa-4837bc05dbf5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:18.500436 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-8e2fbbb1-8626-49b2-9ecb-c8a155d377ab req-4d4946b8-042f-4db8-b5e8-21b1982d8c2e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134661 Oct 30 01:16:18.501601 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 443/884] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:16:18.516764 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-740889f4-076d-43af-979f-9de44605bb81 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:18.517839 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-740889f4-076d-43af-979f-9de44605bb81 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:18.520865 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-740889f4-076d-43af-979f-9de44605bb81 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:18.521892 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-740889f4-076d-43af-979f-9de44605bb81 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:18.529390 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-740889f4-076d-43af-979f-9de44605bb81 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:18.535929 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-740889f4-076d-43af-979f-9de44605bb81 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:18.566055 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-740889f4-076d-43af-979f-9de44605bb81 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] HTTP exception thrown: Instance 7571f255-6ff3-4fc7-bcaa-4837bc05dbf5 could not be found. Oct 30 01:16:18.589212 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-740889f4-076d-43af-979f-9de44605bb81 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Request method failure captured: Oct 30 01:16:18.589212 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/7571f255-6ff3-4fc7-bcaa-4837bc05dbf5 HTTP/1.1 Oct 30 01:16:18.589212 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:16:18.589212 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:16:18.589212 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:16:18.589212 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:16:18.589212 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:16:18.589212 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:16:18.589212 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:16:18.589212 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:16:18.589212 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXc_EWK59eAKufdhKM9IttFURSpdNaALHXHfxK5osRCNtqd2aUByDtYBd4njkNUK7MxutQH10XI1SCok0F98MCH3zAxuivHgz7t03cKabRESluyqbkpJwJPRtizYBv5MOVvEs8776_TxSqZTIGBGOeQLfVoxcZQqc7sYPShD3xTAxOMg Oct 30 01:16:18.589212 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:16:18.589212 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:16:18.589212 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:16:18.589212 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:16:18.589212 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:16:18.589212 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:16:18.589212 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 8e6f42c16eeb4e97b65cebf891105008 Oct 30 01:16:18.589212 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-573551596 Oct 30 01:16:18.589212 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:16:18.589212 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:16:18.590595 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8e6f42c16eeb4e97b65cebf891105008"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8e6f42c16eeb4e97b65cebf891105008"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8e6f42c16eeb4e97b65cebf891105008"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8e6f42c16eeb4e97b65cebf891105008"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:16:18.590595 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-573551596 Oct 30 01:16:18.590595 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 8e6f42c16eeb4e97b65cebf891105008 Oct 30 01:16:18.590595 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-573551596 Oct 30 01:16:18.590595 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServersWithSpecificFlavorTestJSON-573551596-project Oct 30 01:16:18.590595 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:16:18.590595 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:16:18.590595 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 056e59c7d4c2475eb66b64e0e24367be Oct 30 01:16:18.590595 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-573551596-project Oct 30 01:16:18.590595 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:16:18.590595 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 7571f255-6ff3-4fc7-bcaa-4837bc05dbf5 could not be found. Oct 30 01:16:18.590595 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '7571f255-6ff3-4fc7-bcaa-4837bc05dbf5'} Oct 30 01:16:18.592369 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:16:18.592369 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:16:18.592369 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:16:18.592369 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:16:18.592369 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:16:18.592369 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:16:18.592369 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:16:18.592369 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:16:18.592369 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:16:18.592369 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:16:18.592369 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7571f255-6ff3-4fc7-bcaa-4837bc05dbf5 could not be found. Oct 30 01:16:18.592369 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:16:18.592369 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:16:18.592369 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:16:18.592369 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:16:18.592369 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:16:18.592369 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:16:18.592369 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:16:18.592369 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:16:18.592369 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:16:18.594571 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:16:18.594571 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:16:18.594571 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:16:18.594571 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:16:18.594571 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:16:18.594571 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:16:18.594571 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:16:18.594571 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7571f255-6ff3-4fc7-bcaa-4837bc05dbf5 could not be found. Oct 30 01:16:18.594571 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:16:18.594571 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:16:18.594571 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:16:18.594571 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:16:18.594571 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:16:18.594571 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:16:18.594571 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:16:18.594571 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:16:18.594571 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7571f255-6ff3-4fc7-bcaa-4837bc05dbf5 could not be found. Oct 30 01:16:18.594571 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:16:18.596290 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-740889f4-076d-43af-979f-9de44605bb81 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Returning 404 to user: Instance 7571f255-6ff3-4fc7-bcaa-4837bc05dbf5 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:16:18.596290 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-740889f4-076d-43af-979f-9de44605bb81 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] 10.222.0.13 "GET /compute/v2.1/servers/7571f255-6ff3-4fc7-bcaa-4837bc05dbf5" status: 404 len: 111 microversion: 2.1 time: 0.114009 Oct 30 01:16:18.596290 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 442/885] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:18 2022] GET /compute/v2.1/servers/7571f255-6ff3-4fc7-bcaa-4837bc05dbf5 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:16:18.604432 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-10b9d5c1-d9f9-4c5d-9b0c-7377fdc89e29 req-eda42767-37de-401c-a34b-99ff6aa11be1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a294dd33-efb1-4d8b-a83c-817b50cdc138", "name": "network-vif-plugged", "status": "completed", "tag": "7878fd43-0a39-4f54-a5fa-8c4667f94608"}, {"server_uuid": "25a595ee-91e9-4d66-9898-15c577c9bcec", "name": "network-vif-plugged", "status": "completed", "tag": "e7c9bc55-bd5d-480e-bb9f-48e2f7c98104"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:16:18.636260 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-10b9d5c1-d9f9-4c5d-9b0c-7377fdc89e29 req-eda42767-37de-401c-a34b-99ff6aa11be1 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:18.637424 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0ed97fc1-ab30-4d5a-8f50-6c951cd28c68 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Calling method '.version_select at 0x7f44cca044c0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:18.645514 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-10b9d5c1-d9f9-4c5d-9b0c-7377fdc89e29 req-eda42767-37de-401c-a34b-99ff6aa11be1 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:18.646543 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-10b9d5c1-d9f9-4c5d-9b0c-7377fdc89e29 req-eda42767-37de-401c-a34b-99ff6aa11be1 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:18.668660 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-10b9d5c1-d9f9-4c5d-9b0c-7377fdc89e29 req-eda42767-37de-401c-a34b-99ff6aa11be1 service nova] Creating event network-vif-plugged:7878fd43-0a39-4f54-a5fa-8c4667f94608 for instance a294dd33-efb1-4d8b-a83c-817b50cdc138 on n-h1-master-1 Oct 30 01:16:18.669327 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-10b9d5c1-d9f9-4c5d-9b0c-7377fdc89e29 req-eda42767-37de-401c-a34b-99ff6aa11be1 service nova] Creating event network-vif-plugged:e7c9bc55-bd5d-480e-bb9f-48e2f7c98104 for instance 25a595ee-91e9-4d66-9898-15c577c9bcec on n-h2-master-1 Oct 30 01:16:18.678678 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-10b9d5c1-d9f9-4c5d-9b0c-7377fdc89e29 req-eda42767-37de-401c-a34b-99ff6aa11be1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.083699 Oct 30 01:16:18.679556 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 444/886] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:16:18.753703 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0ed97fc1-ab30-4d5a-8f50-6c951cd28c68 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-548259820" status: 202 len: 0 microversion: 2.1 time: 0.138576 Oct 30 01:16:18.755010 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 443/887] 10.222.0.13 () {58 vars in 1218 bytes} [Sun Oct 30 01:16:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-548259820 => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:16:18.866533 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5a980864-df66-4e26-987c-88bfb6ab473d tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:18.867482 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5a980864-df66-4e26-987c-88bfb6ab473d tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: f86d0786-3c99-494f-aa6b-47adf07fca7c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:18.889252 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bb8b2cab-e3a0-4249-941b-2ef4848a7e53 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:18.897962 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bb8b2cab-e3a0-4249-941b-2ef4848a7e53 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: 25a595ee-91e9-4d66-9898-15c577c9bcec] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:18.904594 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5a980864-df66-4e26-987c-88bfb6ab473d tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:18.913167 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb8b2cab-e3a0-4249-941b-2ef4848a7e53 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:18.915064 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5a980864-df66-4e26-987c-88bfb6ab473d tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:18.915064 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5a980864-df66-4e26-987c-88bfb6ab473d tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:18.915064 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5a980864-df66-4e26-987c-88bfb6ab473d tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:18.915482 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5a980864-df66-4e26-987c-88bfb6ab473d tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:18.916083 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb8b2cab-e3a0-4249-941b-2ef4848a7e53 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:18.916691 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb8b2cab-e3a0-4249-941b-2ef4848a7e53 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:18.917699 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5a980864-df66-4e26-987c-88bfb6ab473d tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:18.918860 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb8b2cab-e3a0-4249-941b-2ef4848a7e53 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:18.920518 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb8b2cab-e3a0-4249-941b-2ef4848a7e53 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:18.921132 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb8b2cab-e3a0-4249-941b-2ef4848a7e53 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:19.490235 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bb8b2cab-e3a0-4249-941b-2ef4848a7e53 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:19.504857 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bb8b2cab-e3a0-4249-941b-2ef4848a7e53 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/25a595ee-91e9-4d66-9898-15c577c9bcec" status: 200 len: 1314 microversion: 2.1 time: 0.616666 Oct 30 01:16:19.505549 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 444/888] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:18 2022] GET /compute/v2.1/servers/25a595ee-91e9-4d66-9898-15c577c9bcec => generated 1314 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:19.514134 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2171b8c4-5e4c-4725-b2cb-2f96de54649d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:19.515095 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2171b8c4-5e4c-4725-b2cb-2f96de54649d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:19.527351 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2171b8c4-5e4c-4725-b2cb-2f96de54649d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:19.527855 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2171b8c4-5e4c-4725-b2cb-2f96de54649d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:19.528341 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2171b8c4-5e4c-4725-b2cb-2f96de54649d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:19.529105 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2171b8c4-5e4c-4725-b2cb-2f96de54649d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:19.529598 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2171b8c4-5e4c-4725-b2cb-2f96de54649d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:19.530023 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2171b8c4-5e4c-4725-b2cb-2f96de54649d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:19.563734 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5a980864-df66-4e26-987c-88bfb6ab473d tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:19.584520 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5a980864-df66-4e26-987c-88bfb6ab473d tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/f86d0786-3c99-494f-aa6b-47adf07fca7c" status: 200 len: 1319 microversion: 2.1 time: 0.724249 Oct 30 01:16:19.595023 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 445/889] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:18 2022] GET /compute/v2.1/servers/f86d0786-3c99-494f-aa6b-47adf07fca7c => generated 1319 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:19.605979 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-34c80cb6-0409-45da-97a4-ec2f6cb00a95 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:19.610254 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-34c80cb6-0409-45da-97a4-ec2f6cb00a95 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:19.628002 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-34c80cb6-0409-45da-97a4-ec2f6cb00a95 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:19.629701 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-34c80cb6-0409-45da-97a4-ec2f6cb00a95 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:19.629701 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-34c80cb6-0409-45da-97a4-ec2f6cb00a95 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:19.629701 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-34c80cb6-0409-45da-97a4-ec2f6cb00a95 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:19.630145 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-34c80cb6-0409-45da-97a4-ec2f6cb00a95 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:19.630557 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-34c80cb6-0409-45da-97a4-ec2f6cb00a95 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:19.999789 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2171b8c4-5e4c-4725-b2cb-2f96de54649d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:20.014398 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2171b8c4-5e4c-4725-b2cb-2f96de54649d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:20.018339 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2171b8c4-5e4c-4725-b2cb-2f96de54649d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:20.024580 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2171b8c4-5e4c-4725-b2cb-2f96de54649d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 200 len: 1411 microversion: 2.25 time: 0.513248 Oct 30 01:16:20.025267 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 445/890] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:16:19 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 1411 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:16:20.115527 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-34c80cb6-0409-45da-97a4-ec2f6cb00a95 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:20.124472 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-34c80cb6-0409-45da-97a4-ec2f6cb00a95 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f" status: 200 len: 1474 microversion: 2.1 time: 0.537712 Oct 30 01:16:20.128020 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 446/891] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:19 2022] GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f => generated 1474 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:20.528408 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8831042c-38ba-4823-8ff4-c9d0d2cf478d tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:20.529085 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8831042c-38ba-4823-8ff4-c9d0d2cf478d tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: 25a595ee-91e9-4d66-9898-15c577c9bcec] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:20.538843 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8831042c-38ba-4823-8ff4-c9d0d2cf478d tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:20.539579 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8831042c-38ba-4823-8ff4-c9d0d2cf478d tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:20.543780 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8831042c-38ba-4823-8ff4-c9d0d2cf478d tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:20.543780 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8831042c-38ba-4823-8ff4-c9d0d2cf478d tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:20.543780 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8831042c-38ba-4823-8ff4-c9d0d2cf478d tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:20.543780 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8831042c-38ba-4823-8ff4-c9d0d2cf478d tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:20.611362 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-90ab4ccc-a53f-4d05-83ba-d6e58c14471f tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:20.612043 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-90ab4ccc-a53f-4d05-83ba-d6e58c14471f tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: f86d0786-3c99-494f-aa6b-47adf07fca7c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:20.629385 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-90ab4ccc-a53f-4d05-83ba-d6e58c14471f tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:20.629891 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-90ab4ccc-a53f-4d05-83ba-d6e58c14471f tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:20.630342 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-90ab4ccc-a53f-4d05-83ba-d6e58c14471f tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:20.631066 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-90ab4ccc-a53f-4d05-83ba-d6e58c14471f tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:20.631710 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-90ab4ccc-a53f-4d05-83ba-d6e58c14471f tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:20.632294 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-90ab4ccc-a53f-4d05-83ba-d6e58c14471f tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:20.873805 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8831042c-38ba-4823-8ff4-c9d0d2cf478d tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:20.883164 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8831042c-38ba-4823-8ff4-c9d0d2cf478d tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/25a595ee-91e9-4d66-9898-15c577c9bcec" status: 200 len: 1314 microversion: 2.1 time: 0.358621 Oct 30 01:16:20.886498 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 446/892] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:20 2022] GET /compute/v2.1/servers/25a595ee-91e9-4d66-9898-15c577c9bcec => generated 1314 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:16:20.893655 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-92095835-3519-4bae-b6fe-5918b744e064 req-7265d994-d743-49cd-b981-9e9a31691753 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3141e23-1b24-4315-aac8-fb785005e789", "tag": "ec5e536f-901e-4b24-a661-499fb1eb2a1f"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:16:20.929610 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-92095835-3519-4bae-b6fe-5918b744e064 req-7265d994-d743-49cd-b981-9e9a31691753 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:20.931805 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-92095835-3519-4bae-b6fe-5918b744e064 req-7265d994-d743-49cd-b981-9e9a31691753 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:20.933589 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-92095835-3519-4bae-b6fe-5918b744e064 req-7265d994-d743-49cd-b981-9e9a31691753 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:20.944322 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-90ab4ccc-a53f-4d05-83ba-d6e58c14471f tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:20.956588 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-92095835-3519-4bae-b6fe-5918b744e064 req-7265d994-d743-49cd-b981-9e9a31691753 service nova] Creating event network-changed:ec5e536f-901e-4b24-a661-499fb1eb2a1f for instance f3141e23-1b24-4315-aac8-fb785005e789 on n-h2-master-1 Oct 30 01:16:20.963878 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-92095835-3519-4bae-b6fe-5918b744e064 req-7265d994-d743-49cd-b981-9e9a31691753 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076037 Oct 30 01:16:20.964960 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 447/893] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:16:20.966854 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-90ab4ccc-a53f-4d05-83ba-d6e58c14471f tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/f86d0786-3c99-494f-aa6b-47adf07fca7c" status: 200 len: 1319 microversion: 2.1 time: 0.359249 Oct 30 01:16:20.968163 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 447/894] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:20 2022] GET /compute/v2.1/servers/f86d0786-3c99-494f-aa6b-47adf07fca7c => generated 1319 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:20.986808 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-ea178fc0-0bd3-4a3d-9d97-a9299301ae3d req-15c07ea8-8ea1-4d45-96dd-e065549f3975 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f86d0786-3c99-494f-aa6b-47adf07fca7c", "name": "network-vif-plugged", "status": "completed", "tag": "5abfe263-7efa-46a6-b0cd-7471fa65ad22"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:16:21.001220 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ea178fc0-0bd3-4a3d-9d97-a9299301ae3d req-15c07ea8-8ea1-4d45-96dd-e065549f3975 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:21.001751 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ea178fc0-0bd3-4a3d-9d97-a9299301ae3d req-15c07ea8-8ea1-4d45-96dd-e065549f3975 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:21.002349 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ea178fc0-0bd3-4a3d-9d97-a9299301ae3d req-15c07ea8-8ea1-4d45-96dd-e065549f3975 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:21.021103 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-ea178fc0-0bd3-4a3d-9d97-a9299301ae3d req-15c07ea8-8ea1-4d45-96dd-e065549f3975 service nova] Creating event network-vif-plugged:5abfe263-7efa-46a6-b0cd-7471fa65ad22 for instance f86d0786-3c99-494f-aa6b-47adf07fca7c on n-h1-master-1 Oct 30 01:16:21.027820 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-ea178fc0-0bd3-4a3d-9d97-a9299301ae3d req-15c07ea8-8ea1-4d45-96dd-e065549f3975 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061255 Oct 30 01:16:21.037828 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 448/895] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:16:21.054691 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9cfc091b-b1e1-45ec-8211-7fc3828c57bc tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:21.054911 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ffe357ee-bcc6-4a64-8029-3efd429f1c98 tempest-ServersWithSpecificFlavorTestJSON-2035413001 tempest-ServersWithSpecificFlavorTestJSON-2035413001-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:21.060930 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9cfc091b-b1e1-45ec-8211-7fc3828c57bc tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:21.063573 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9cfc091b-b1e1-45ec-8211-7fc3828c57bc tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:21.064380 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9cfc091b-b1e1-45ec-8211-7fc3828c57bc tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:21.064979 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9cfc091b-b1e1-45ec-8211-7fc3828c57bc tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:21.065973 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9cfc091b-b1e1-45ec-8211-7fc3828c57bc tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:21.066986 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9cfc091b-b1e1-45ec-8211-7fc3828c57bc tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:21.068107 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9cfc091b-b1e1-45ec-8211-7fc3828c57bc tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:21.146481 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ffe357ee-bcc6-4a64-8029-3efd429f1c98 tempest-ServersWithSpecificFlavorTestJSON-2035413001 tempest-ServersWithSpecificFlavorTestJSON-2035413001-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/2127731727" status: 202 len: 0 microversion: 2.1 time: 0.095932 Oct 30 01:16:21.151528 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 449/896] 10.222.0.13 () {58 vars in 1161 bytes} [Sun Oct 30 01:16:21 2022] DELETE /compute/v2.1/flavors/2127731727 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:16:21.161859 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8c94c261-3daf-49d9-8afe-c9ee20053003 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:21.162885 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8c94c261-3daf-49d9-8afe-c9ee20053003 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:21.187330 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8c94c261-3daf-49d9-8afe-c9ee20053003 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:21.188103 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8c94c261-3daf-49d9-8afe-c9ee20053003 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:21.189319 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8c94c261-3daf-49d9-8afe-c9ee20053003 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:21.190309 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8c94c261-3daf-49d9-8afe-c9ee20053003 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:21.192497 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8c94c261-3daf-49d9-8afe-c9ee20053003 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:21.193252 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8c94c261-3daf-49d9-8afe-c9ee20053003 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:21.217564 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:21.360804 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9cfc091b-b1e1-45ec-8211-7fc3828c57bc tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:21.370241 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9cfc091b-b1e1-45ec-8211-7fc3828c57bc tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:21.372168 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9cfc091b-b1e1-45ec-8211-7fc3828c57bc tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:21.373738 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9cfc091b-b1e1-45ec-8211-7fc3828c57bc tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 200 len: 1411 microversion: 2.25 time: 0.324891 Oct 30 01:16:21.389682 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 448/897] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:16:21 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 1411 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:16:21.403664 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-995795a0-622e-4e95-8749-72df12645e08 tempest-ServersWithSpecificFlavorTestJSON-2035413001 tempest-ServersWithSpecificFlavorTestJSON-2035413001-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:21.422751 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8c94c261-3daf-49d9-8afe-c9ee20053003 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:21.429125 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-995795a0-622e-4e95-8749-72df12645e08 tempest-ServersWithSpecificFlavorTestJSON-2035413001 tempest-ServersWithSpecificFlavorTestJSON-2035413001-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.037999 Oct 30 01:16:21.429842 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 449/898] 10.222.0.13 () {58 vars in 1146 bytes} [Sun Oct 30 01:16:21 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:21.432409 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8c94c261-3daf-49d9-8afe-c9ee20053003 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f" status: 200 len: 1471 microversion: 2.1 time: 0.278557 Oct 30 01:16:21.442124 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 450/899] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:21 2022] GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f => generated 1471 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:21.450093 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e2225dfd-22ff-4c5a-9d17-dc7545f8d477 tempest-ServersWithSpecificFlavorTestJSON-2035413001 tempest-ServersWithSpecificFlavorTestJSON-2035413001-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:21.456800 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-884183b6-5421-4950-b9d5-a72189ab197e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:16:21.458269 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-884183b6-5421-4950-b9d5-a72189ab197e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:21.465156 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-884183b6-5421-4950-b9d5-a72189ab197e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:21.465959 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-884183b6-5421-4950-b9d5-a72189ab197e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:21.466387 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-884183b6-5421-4950-b9d5-a72189ab197e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:21.467096 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-884183b6-5421-4950-b9d5-a72189ab197e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:21.467541 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-884183b6-5421-4950-b9d5-a72189ab197e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:21.468152 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-884183b6-5421-4950-b9d5-a72189ab197e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:21.550894 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e2225dfd-22ff-4c5a-9d17-dc7545f8d477 tempest-ServersWithSpecificFlavorTestJSON-2035413001 tempest-ServersWithSpecificFlavorTestJSON-2035413001-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1196629979" status: 202 len: 0 microversion: 2.1 time: 0.102506 Oct 30 01:16:21.550894 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 450/900] 10.222.0.13 () {58 vars in 1161 bytes} [Sun Oct 30 01:16:21 2022] DELETE /compute/v2.1/flavors/1196629979 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:16:21.558118 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-35e5cb17-35c2-4456-b933-90f8cdceb07b tempest-ServersWithSpecificFlavorTestJSON-2035413001 tempest-ServersWithSpecificFlavorTestJSON-2035413001-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:21.586523 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-35e5cb17-35c2-4456-b933-90f8cdceb07b tempest-ServersWithSpecificFlavorTestJSON-2035413001 tempest-ServersWithSpecificFlavorTestJSON-2035413001-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032035 Oct 30 01:16:21.588443 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 451/901] 10.222.0.13 () {58 vars in 1146 bytes} [Sun Oct 30 01:16:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:21.616186 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ff78ddb9-550e-4f23-8762-b0b8a28e140a tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:21.616798 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ff78ddb9-550e-4f23-8762-b0b8a28e140a tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] [instance: f9c8bf32-6f0e-4183-88be-031de936bb81] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:21.623820 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ff78ddb9-550e-4f23-8762-b0b8a28e140a tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:21.624314 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ff78ddb9-550e-4f23-8762-b0b8a28e140a tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:21.624762 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ff78ddb9-550e-4f23-8762-b0b8a28e140a tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:21.625535 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ff78ddb9-550e-4f23-8762-b0b8a28e140a tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:21.625994 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ff78ddb9-550e-4f23-8762-b0b8a28e140a tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:21.626640 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ff78ddb9-550e-4f23-8762-b0b8a28e140a tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:21.641456 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-ff78ddb9-550e-4f23-8762-b0b8a28e140a tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] HTTP exception thrown: Instance f9c8bf32-6f0e-4183-88be-031de936bb81 could not be found. Oct 30 01:16:21.643216 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ff78ddb9-550e-4f23-8762-b0b8a28e140a tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Request method failure captured: Oct 30 01:16:21.643216 n-d-master-1 devstack@n-api.service[121103]: request: DELETE /compute/v2.1/servers/f9c8bf32-6f0e-4183-88be-031de936bb81 HTTP/1.1 Oct 30 01:16:21.643216 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:16:21.643216 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:16:21.643216 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:16:21.643216 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:16:21.643216 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:16:21.643216 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:16:21.643216 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:16:21.643216 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:16:21.643216 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXc_EWK59eAKufdhKM9IttFURSpdNaALHXHfxK5osRCNtqd2aUByDtYBd4njkNUK7MxutQH10XI1SCok0F98MCH3zAxuivHgz7t03cKabRESluyqbkpJwJPRtizYBv5MOVvEs8776_TxSqZTIGBGOeQLfVoxcZQqc7sYPShD3xTAxOMg Oct 30 01:16:21.643216 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:16:21.643216 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:16:21.643216 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:16:21.643216 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:16:21.643216 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:16:21.643216 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:16:21.643216 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 8e6f42c16eeb4e97b65cebf891105008 Oct 30 01:16:21.643216 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-573551596 Oct 30 01:16:21.643216 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:16:21.643216 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:16:21.649832 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8e6f42c16eeb4e97b65cebf891105008"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8e6f42c16eeb4e97b65cebf891105008"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8e6f42c16eeb4e97b65cebf891105008"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8e6f42c16eeb4e97b65cebf891105008"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:16:21.649832 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-573551596 Oct 30 01:16:21.649832 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 8e6f42c16eeb4e97b65cebf891105008 Oct 30 01:16:21.649832 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-573551596 Oct 30 01:16:21.649832 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersWithSpecificFlavorTestJSON-573551596-project Oct 30 01:16:21.649832 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:16:21.649832 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:16:21.649832 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 056e59c7d4c2475eb66b64e0e24367be Oct 30 01:16:21.649832 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-573551596-project Oct 30 01:16:21.649832 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:16:21.649832 n-d-master-1 devstack@n-api.service[121103]: exception: Instance f9c8bf32-6f0e-4183-88be-031de936bb81 could not be found. Oct 30 01:16:21.649832 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'f9c8bf32-6f0e-4183-88be-031de936bb81'} Oct 30 01:16:21.650863 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:16:21.650863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:16:21.650863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:16:21.650863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:16:21.650863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:16:21.650863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:16:21.650863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:16:21.650863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:16:21.650863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:16:21.650863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:16:21.650863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9c8bf32-6f0e-4183-88be-031de936bb81 could not be found. Oct 30 01:16:21.650863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:16:21.650863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:16:21.650863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:16:21.650863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:16:21.650863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:16:21.650863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:16:21.650863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:16:21.650863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:16:21.650863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:16:21.652355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:16:21.652355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:16:21.652355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:16:21.652355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:16:21.652355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:16:21.652355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:16:21.652355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:16:21.652355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:16:21.652355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:16:21.652355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9c8bf32-6f0e-4183-88be-031de936bb81 could not be found. Oct 30 01:16:21.652355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:16:21.652355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:16:21.652355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:16:21.652355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:16:21.652355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:16:21.652355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:16:21.652355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:16:21.652355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:16:21.652355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9c8bf32-6f0e-4183-88be-031de936bb81 could not be found. Oct 30 01:16:21.652355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:16:21.653811 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ff78ddb9-550e-4f23-8762-b0b8a28e140a tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Returning 404 to user: Instance f9c8bf32-6f0e-4183-88be-031de936bb81 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:16:21.653811 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ff78ddb9-550e-4f23-8762-b0b8a28e140a tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f9c8bf32-6f0e-4183-88be-031de936bb81" status: 404 len: 111 microversion: 2.1 time: 0.032933 Oct 30 01:16:21.653811 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 452/902] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:16:21 2022] DELETE /compute/v2.1/servers/f9c8bf32-6f0e-4183-88be-031de936bb81 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:16:21.654550 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2f729850-1bb2-4689-aeff-f046df7794db tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:21.654946 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2f729850-1bb2-4689-aeff-f046df7794db tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] [instance: f9c8bf32-6f0e-4183-88be-031de936bb81] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:21.662139 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f729850-1bb2-4689-aeff-f046df7794db tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:21.662645 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f729850-1bb2-4689-aeff-f046df7794db tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:21.663233 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f729850-1bb2-4689-aeff-f046df7794db tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:21.663944 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f729850-1bb2-4689-aeff-f046df7794db tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:21.664399 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f729850-1bb2-4689-aeff-f046df7794db tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:21.664991 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f729850-1bb2-4689-aeff-f046df7794db tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:21.688449 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-2f729850-1bb2-4689-aeff-f046df7794db tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] HTTP exception thrown: Instance f9c8bf32-6f0e-4183-88be-031de936bb81 could not be found. Oct 30 01:16:21.690038 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2f729850-1bb2-4689-aeff-f046df7794db tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Request method failure captured: Oct 30 01:16:21.690038 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/f9c8bf32-6f0e-4183-88be-031de936bb81 HTTP/1.1 Oct 30 01:16:21.690038 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:16:21.690038 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:16:21.690038 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:16:21.690038 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:16:21.690038 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:16:21.690038 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:16:21.690038 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:16:21.690038 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:16:21.690038 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXc_EWK59eAKufdhKM9IttFURSpdNaALHXHfxK5osRCNtqd2aUByDtYBd4njkNUK7MxutQH10XI1SCok0F98MCH3zAxuivHgz7t03cKabRESluyqbkpJwJPRtizYBv5MOVvEs8776_TxSqZTIGBGOeQLfVoxcZQqc7sYPShD3xTAxOMg Oct 30 01:16:21.690038 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:16:21.690038 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:16:21.690038 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:16:21.690038 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:16:21.690038 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:16:21.690038 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:16:21.690038 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 8e6f42c16eeb4e97b65cebf891105008 Oct 30 01:16:21.690038 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-573551596 Oct 30 01:16:21.690038 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:16:21.690038 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:16:21.692343 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8e6f42c16eeb4e97b65cebf891105008"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8e6f42c16eeb4e97b65cebf891105008"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8e6f42c16eeb4e97b65cebf891105008"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8e6f42c16eeb4e97b65cebf891105008"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:16:21.692343 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-573551596 Oct 30 01:16:21.692343 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 8e6f42c16eeb4e97b65cebf891105008 Oct 30 01:16:21.692343 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-573551596 Oct 30 01:16:21.692343 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersWithSpecificFlavorTestJSON-573551596-project Oct 30 01:16:21.692343 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:16:21.692343 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:16:21.692343 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 056e59c7d4c2475eb66b64e0e24367be Oct 30 01:16:21.692343 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-573551596-project Oct 30 01:16:21.692343 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:16:21.692343 n-d-master-1 devstack@n-api.service[121103]: exception: Instance f9c8bf32-6f0e-4183-88be-031de936bb81 could not be found. Oct 30 01:16:21.692343 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'f9c8bf32-6f0e-4183-88be-031de936bb81'} Oct 30 01:16:21.693285 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:16:21.693285 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:16:21.693285 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:16:21.693285 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:16:21.693285 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:16:21.693285 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:16:21.693285 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:16:21.693285 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:16:21.693285 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:16:21.693285 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:16:21.693285 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9c8bf32-6f0e-4183-88be-031de936bb81 could not be found. Oct 30 01:16:21.693285 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:16:21.693285 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:16:21.693285 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:16:21.693285 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:16:21.693285 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:16:21.693285 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:16:21.693285 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:16:21.693285 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:16:21.693285 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:16:21.694699 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:16:21.694699 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:16:21.694699 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:16:21.694699 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:16:21.694699 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:16:21.694699 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:16:21.694699 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:16:21.694699 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9c8bf32-6f0e-4183-88be-031de936bb81 could not be found. Oct 30 01:16:21.694699 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:16:21.694699 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:16:21.694699 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:16:21.694699 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:16:21.694699 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:16:21.694699 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:16:21.694699 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:16:21.694699 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:16:21.694699 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9c8bf32-6f0e-4183-88be-031de936bb81 could not be found. Oct 30 01:16:21.694699 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:16:21.697859 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2f729850-1bb2-4689-aeff-f046df7794db tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Returning 404 to user: Instance f9c8bf32-6f0e-4183-88be-031de936bb81 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:16:21.698918 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2f729850-1bb2-4689-aeff-f046df7794db tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] 10.222.0.13 "GET /compute/v2.1/servers/f9c8bf32-6f0e-4183-88be-031de936bb81" status: 404 len: 111 microversion: 2.1 time: 0.048952 Oct 30 01:16:21.704330 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 453/903] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:21 2022] GET /compute/v2.1/servers/f9c8bf32-6f0e-4183-88be-031de936bb81 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:16:21.713537 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5e7d867c-800f-46d0-9cac-ee69ed3fc598 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:21.714589 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5e7d867c-800f-46d0-9cac-ee69ed3fc598 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] [instance: 7571f255-6ff3-4fc7-bcaa-4837bc05dbf5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:21.739721 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5e7d867c-800f-46d0-9cac-ee69ed3fc598 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:21.745901 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5e7d867c-800f-46d0-9cac-ee69ed3fc598 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:21.746589 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5e7d867c-800f-46d0-9cac-ee69ed3fc598 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:21.747538 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5e7d867c-800f-46d0-9cac-ee69ed3fc598 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:21.748563 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5e7d867c-800f-46d0-9cac-ee69ed3fc598 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:21.749312 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5e7d867c-800f-46d0-9cac-ee69ed3fc598 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:21.763303 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-884183b6-5421-4950-b9d5-a72189ab197e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "POST /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f/action" status: 204 len: 0 microversion: 2.1 time: 0.310324 Oct 30 01:16:21.764355 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 451/904] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:16:21 2022] POST /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f/action => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:16:21.777558 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4ef979d4-25ac-4c24-8975-10ee65db16af tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:21.779734 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4ef979d4-25ac-4c24-8975-10ee65db16af tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:21.780407 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-5e7d867c-800f-46d0-9cac-ee69ed3fc598 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] HTTP exception thrown: Instance 7571f255-6ff3-4fc7-bcaa-4837bc05dbf5 could not be found. Oct 30 01:16:21.782167 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5e7d867c-800f-46d0-9cac-ee69ed3fc598 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Request method failure captured: Oct 30 01:16:21.782167 n-d-master-1 devstack@n-api.service[121103]: request: DELETE /compute/v2.1/servers/7571f255-6ff3-4fc7-bcaa-4837bc05dbf5 HTTP/1.1 Oct 30 01:16:21.782167 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:16:21.782167 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:16:21.782167 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:16:21.782167 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:16:21.782167 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:16:21.782167 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:16:21.782167 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:16:21.782167 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:16:21.782167 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXc_EWK59eAKufdhKM9IttFURSpdNaALHXHfxK5osRCNtqd2aUByDtYBd4njkNUK7MxutQH10XI1SCok0F98MCH3zAxuivHgz7t03cKabRESluyqbkpJwJPRtizYBv5MOVvEs8776_TxSqZTIGBGOeQLfVoxcZQqc7sYPShD3xTAxOMg Oct 30 01:16:21.782167 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:16:21.782167 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:16:21.782167 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:16:21.782167 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:16:21.782167 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:16:21.782167 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:16:21.782167 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 8e6f42c16eeb4e97b65cebf891105008 Oct 30 01:16:21.782167 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-573551596 Oct 30 01:16:21.782167 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:16:21.782167 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:16:21.783607 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8e6f42c16eeb4e97b65cebf891105008"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8e6f42c16eeb4e97b65cebf891105008"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8e6f42c16eeb4e97b65cebf891105008"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8e6f42c16eeb4e97b65cebf891105008"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:16:21.783607 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-573551596 Oct 30 01:16:21.783607 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 8e6f42c16eeb4e97b65cebf891105008 Oct 30 01:16:21.783607 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-573551596 Oct 30 01:16:21.783607 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersWithSpecificFlavorTestJSON-573551596-project Oct 30 01:16:21.783607 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:16:21.783607 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:16:21.783607 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 056e59c7d4c2475eb66b64e0e24367be Oct 30 01:16:21.783607 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-573551596-project Oct 30 01:16:21.783607 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:16:21.783607 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 7571f255-6ff3-4fc7-bcaa-4837bc05dbf5 could not be found. Oct 30 01:16:21.783607 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '7571f255-6ff3-4fc7-bcaa-4837bc05dbf5'} Oct 30 01:16:21.784330 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:16:21.784330 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:16:21.784330 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:16:21.784330 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:16:21.784330 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:16:21.784330 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:16:21.784330 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:16:21.784330 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:16:21.784330 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:16:21.784330 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:16:21.784330 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7571f255-6ff3-4fc7-bcaa-4837bc05dbf5 could not be found. Oct 30 01:16:21.784330 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:16:21.784330 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:16:21.784330 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:16:21.784330 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:16:21.784330 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:16:21.784330 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:16:21.784330 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:16:21.784330 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:16:21.784330 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:16:21.785562 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:16:21.785562 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:16:21.785562 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:16:21.785562 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:16:21.785562 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:16:21.785562 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:16:21.785562 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:16:21.785562 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:16:21.785562 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:16:21.785562 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7571f255-6ff3-4fc7-bcaa-4837bc05dbf5 could not be found. Oct 30 01:16:21.785562 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:16:21.785562 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:16:21.785562 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:16:21.785562 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:16:21.785562 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:16:21.785562 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:16:21.785562 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:16:21.785562 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:16:21.785562 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7571f255-6ff3-4fc7-bcaa-4837bc05dbf5 could not be found. Oct 30 01:16:21.785562 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:16:21.787269 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5e7d867c-800f-46d0-9cac-ee69ed3fc598 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Returning 404 to user: Instance 7571f255-6ff3-4fc7-bcaa-4837bc05dbf5 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:16:21.787269 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5e7d867c-800f-46d0-9cac-ee69ed3fc598 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7571f255-6ff3-4fc7-bcaa-4837bc05dbf5" status: 404 len: 111 microversion: 2.1 time: 0.078614 Oct 30 01:16:21.789327 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 454/905] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:16:21 2022] DELETE /compute/v2.1/servers/7571f255-6ff3-4fc7-bcaa-4837bc05dbf5 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:16:21.794992 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3e9c527a-fa18-4af5-bd97-a19700910587 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:21.796672 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3e9c527a-fa18-4af5-bd97-a19700910587 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] [instance: 7571f255-6ff3-4fc7-bcaa-4837bc05dbf5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:21.802313 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4ef979d4-25ac-4c24-8975-10ee65db16af tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:21.802751 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4ef979d4-25ac-4c24-8975-10ee65db16af tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:21.803191 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4ef979d4-25ac-4c24-8975-10ee65db16af tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:21.803994 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4ef979d4-25ac-4c24-8975-10ee65db16af tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:21.804321 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3e9c527a-fa18-4af5-bd97-a19700910587 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:21.804440 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4ef979d4-25ac-4c24-8975-10ee65db16af tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:21.804814 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3e9c527a-fa18-4af5-bd97-a19700910587 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:21.805248 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3e9c527a-fa18-4af5-bd97-a19700910587 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:21.805577 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4ef979d4-25ac-4c24-8975-10ee65db16af tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:21.805984 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3e9c527a-fa18-4af5-bd97-a19700910587 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:21.806437 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3e9c527a-fa18-4af5-bd97-a19700910587 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:21.806859 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3e9c527a-fa18-4af5-bd97-a19700910587 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:21.854625 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-3e9c527a-fa18-4af5-bd97-a19700910587 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] HTTP exception thrown: Instance 7571f255-6ff3-4fc7-bcaa-4837bc05dbf5 could not be found. Oct 30 01:16:21.860188 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3e9c527a-fa18-4af5-bd97-a19700910587 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Request method failure captured: Oct 30 01:16:21.860188 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/7571f255-6ff3-4fc7-bcaa-4837bc05dbf5 HTTP/1.1 Oct 30 01:16:21.860188 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:16:21.860188 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:16:21.860188 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:16:21.860188 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:16:21.860188 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:16:21.860188 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:16:21.860188 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:16:21.860188 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:16:21.860188 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXc_EWK59eAKufdhKM9IttFURSpdNaALHXHfxK5osRCNtqd2aUByDtYBd4njkNUK7MxutQH10XI1SCok0F98MCH3zAxuivHgz7t03cKabRESluyqbkpJwJPRtizYBv5MOVvEs8776_TxSqZTIGBGOeQLfVoxcZQqc7sYPShD3xTAxOMg Oct 30 01:16:21.860188 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:16:21.860188 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:16:21.860188 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:16:21.860188 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:16:21.860188 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:16:21.860188 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:16:21.860188 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 8e6f42c16eeb4e97b65cebf891105008 Oct 30 01:16:21.860188 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-573551596 Oct 30 01:16:21.860188 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:16:21.860188 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:16:21.861776 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8e6f42c16eeb4e97b65cebf891105008"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8e6f42c16eeb4e97b65cebf891105008"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8e6f42c16eeb4e97b65cebf891105008"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8e6f42c16eeb4e97b65cebf891105008"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:16:21.861776 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-573551596 Oct 30 01:16:21.861776 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 8e6f42c16eeb4e97b65cebf891105008 Oct 30 01:16:21.861776 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-573551596 Oct 30 01:16:21.861776 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersWithSpecificFlavorTestJSON-573551596-project Oct 30 01:16:21.861776 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:16:21.861776 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:16:21.861776 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 056e59c7d4c2475eb66b64e0e24367be Oct 30 01:16:21.861776 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-573551596-project Oct 30 01:16:21.861776 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:16:21.861776 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 7571f255-6ff3-4fc7-bcaa-4837bc05dbf5 could not be found. Oct 30 01:16:21.861776 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '7571f255-6ff3-4fc7-bcaa-4837bc05dbf5'} Oct 30 01:16:21.862508 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:16:21.862508 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:16:21.862508 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:16:21.862508 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:16:21.862508 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:16:21.862508 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:16:21.862508 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:16:21.862508 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:16:21.862508 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:16:21.862508 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:16:21.862508 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7571f255-6ff3-4fc7-bcaa-4837bc05dbf5 could not be found. Oct 30 01:16:21.862508 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:16:21.862508 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:16:21.862508 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:16:21.862508 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:16:21.862508 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:16:21.862508 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:16:21.862508 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:16:21.862508 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:16:21.862508 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:16:21.864297 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:16:21.864297 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:16:21.864297 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:16:21.864297 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:16:21.864297 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:16:21.864297 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:16:21.864297 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:16:21.864297 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7571f255-6ff3-4fc7-bcaa-4837bc05dbf5 could not be found. Oct 30 01:16:21.864297 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:16:21.864297 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:16:21.864297 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:16:21.864297 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:16:21.864297 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:16:21.864297 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:16:21.864297 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:16:21.864297 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:16:21.864297 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7571f255-6ff3-4fc7-bcaa-4837bc05dbf5 could not be found. Oct 30 01:16:21.864297 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:16:21.869649 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3e9c527a-fa18-4af5-bd97-a19700910587 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] Returning 404 to user: Instance 7571f255-6ff3-4fc7-bcaa-4837bc05dbf5 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:16:21.870831 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3e9c527a-fa18-4af5-bd97-a19700910587 tempest-ServersWithSpecificFlavorTestJSON-573551596 tempest-ServersWithSpecificFlavorTestJSON-573551596-project] 10.222.0.13 "GET /compute/v2.1/servers/7571f255-6ff3-4fc7-bcaa-4837bc05dbf5" status: 404 len: 111 microversion: 2.1 time: 0.080491 Oct 30 01:16:21.871493 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 455/906] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:21 2022] GET /compute/v2.1/servers/7571f255-6ff3-4fc7-bcaa-4837bc05dbf5 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:16:21.915888 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c7341e97-db49-439e-868f-f67fe1227f07 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:21.916515 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c7341e97-db49-439e-868f-f67fe1227f07 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: 25a595ee-91e9-4d66-9898-15c577c9bcec] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:21.933050 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c7341e97-db49-439e-868f-f67fe1227f07 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:21.937720 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c7341e97-db49-439e-868f-f67fe1227f07 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:21.938723 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c7341e97-db49-439e-868f-f67fe1227f07 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:21.939896 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c7341e97-db49-439e-868f-f67fe1227f07 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:21.941419 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c7341e97-db49-439e-868f-f67fe1227f07 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:21.942701 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c7341e97-db49-439e-868f-f67fe1227f07 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:22.308608 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4ef979d4-25ac-4c24-8975-10ee65db16af tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:22.330141 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4ef979d4-25ac-4c24-8975-10ee65db16af tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f" status: 200 len: 1471 microversion: 2.1 time: 0.561607 Oct 30 01:16:22.330685 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 452/907] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:21 2022] GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f => generated 1471 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:16:22.345072 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-44cf9d77-eed9-4262-a689-6f3386ae410e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:22.345712 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-44cf9d77-eed9-4262-a689-6f3386ae410e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: f86d0786-3c99-494f-aa6b-47adf07fca7c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:22.357452 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44cf9d77-eed9-4262-a689-6f3386ae410e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:22.358231 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44cf9d77-eed9-4262-a689-6f3386ae410e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:22.358825 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44cf9d77-eed9-4262-a689-6f3386ae410e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:22.360500 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44cf9d77-eed9-4262-a689-6f3386ae410e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:22.361251 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44cf9d77-eed9-4262-a689-6f3386ae410e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:22.361966 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44cf9d77-eed9-4262-a689-6f3386ae410e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:22.427801 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c7341e97-db49-439e-868f-f67fe1227f07 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:22.436099 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c7341e97-db49-439e-868f-f67fe1227f07 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/25a595ee-91e9-4d66-9898-15c577c9bcec" status: 200 len: 1464 microversion: 2.1 time: 0.525889 Oct 30 01:16:22.437073 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 456/908] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:21 2022] GET /compute/v2.1/servers/25a595ee-91e9-4d66-9898-15c577c9bcec => generated 1464 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:22.453591 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cda571d1-7a1d-4e86-be5c-bade312cb3e1 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:22.454589 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-cda571d1-7a1d-4e86-be5c-bade312cb3e1 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:22.461477 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cda571d1-7a1d-4e86-be5c-bade312cb3e1 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:22.462398 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cda571d1-7a1d-4e86-be5c-bade312cb3e1 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:22.462918 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cda571d1-7a1d-4e86-be5c-bade312cb3e1 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:22.463862 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cda571d1-7a1d-4e86-be5c-bade312cb3e1 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:22.464593 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cda571d1-7a1d-4e86-be5c-bade312cb3e1 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:22.465237 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cda571d1-7a1d-4e86-be5c-bade312cb3e1 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:23.582589 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-44cf9d77-eed9-4262-a689-6f3386ae410e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:23.592214 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-44cf9d77-eed9-4262-a689-6f3386ae410e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/f86d0786-3c99-494f-aa6b-47adf07fca7c" status: 200 len: 1319 microversion: 2.1 time: 1.259748 Oct 30 01:16:23.593500 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 453/909] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:22 2022] GET /compute/v2.1/servers/f86d0786-3c99-494f-aa6b-47adf07fca7c => generated 1319 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:23.610938 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ed7203cf-6303-45fb-bad0-88501bf0c205 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:23.613014 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ed7203cf-6303-45fb-bad0-88501bf0c205 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:23.621876 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed7203cf-6303-45fb-bad0-88501bf0c205 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:23.623170 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed7203cf-6303-45fb-bad0-88501bf0c205 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:23.623791 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed7203cf-6303-45fb-bad0-88501bf0c205 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:23.625787 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed7203cf-6303-45fb-bad0-88501bf0c205 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:23.626487 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed7203cf-6303-45fb-bad0-88501bf0c205 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:23.627244 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed7203cf-6303-45fb-bad0-88501bf0c205 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:23.727790 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-cda571d1-7a1d-4e86-be5c-bade312cb3e1 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:23.742663 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-cda571d1-7a1d-4e86-be5c-bade312cb3e1 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:23.744494 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-cda571d1-7a1d-4e86-be5c-bade312cb3e1 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:23.745258 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cda571d1-7a1d-4e86-be5c-bade312cb3e1 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 200 len: 1411 microversion: 2.25 time: 1.306997 Oct 30 01:16:23.745860 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 457/910] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:16:22 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 1411 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:16:23.775074 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-26219ac4-09ab-4d74-ada9-0d823d2708c4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:23.778200 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-26219ac4-09ab-4d74-ada9-0d823d2708c4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:23.790030 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-26219ac4-09ab-4d74-ada9-0d823d2708c4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:23.791094 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-26219ac4-09ab-4d74-ada9-0d823d2708c4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:23.791696 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-26219ac4-09ab-4d74-ada9-0d823d2708c4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:23.792569 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-26219ac4-09ab-4d74-ada9-0d823d2708c4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:23.793177 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-26219ac4-09ab-4d74-ada9-0d823d2708c4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:23.793848 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-26219ac4-09ab-4d74-ada9-0d823d2708c4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:24.548660 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ed7203cf-6303-45fb-bad0-88501bf0c205 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:24.567333 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ed7203cf-6303-45fb-bad0-88501bf0c205 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1463 microversion: 2.1 time: 0.969509 Oct 30 01:16:24.567333 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 454/911] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:23 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1463 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:24.579165 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-26219ac4-09ab-4d74-ada9-0d823d2708c4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:24.590897 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-b5253fec-5799-42da-98e9-0b3a379e8ea9 req-e9f25990-3a68-433c-8459-3d2c5abae10c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12ca60c1-7c35-420c-b177-c7f3915a989f", "name": "network-vif-plugged", "status": "completed", "tag": "0230e7b6-4d30-48c3-b9ab-066d496072ad"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:16:24.611592 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-b5253fec-5799-42da-98e9-0b3a379e8ea9 req-e9f25990-3a68-433c-8459-3d2c5abae10c service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:24.616070 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-b5253fec-5799-42da-98e9-0b3a379e8ea9 req-e9f25990-3a68-433c-8459-3d2c5abae10c service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:24.616799 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-b5253fec-5799-42da-98e9-0b3a379e8ea9 req-e9f25990-3a68-433c-8459-3d2c5abae10c service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:24.633628 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-26219ac4-09ab-4d74-ada9-0d823d2708c4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f" status: 200 len: 1471 microversion: 2.1 time: 0.868421 Oct 30 01:16:24.634261 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 458/912] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:23 2022] GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f => generated 1471 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:24.652078 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-b5253fec-5799-42da-98e9-0b3a379e8ea9 req-e9f25990-3a68-433c-8459-3d2c5abae10c service nova] Creating event network-vif-plugged:0230e7b6-4d30-48c3-b9ab-066d496072ad for instance 12ca60c1-7c35-420c-b177-c7f3915a989f on n-h1-master-1 Oct 30 01:16:24.652210 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8cbd6fe4-5499-4692-95ec-f89b6b3b6869 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:24.662295 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [req-b5253fec-5799-42da-98e9-0b3a379e8ea9 req-e9f25990-3a68-433c-8459-3d2c5abae10c service nova] Instance 12ca60c1-7c35-420c-b177-c7f3915a989f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=121102) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 30 01:16:24.664104 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8cbd6fe4-5499-4692-95ec-f89b6b3b6869 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: f86d0786-3c99-494f-aa6b-47adf07fca7c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:24.693797 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8cbd6fe4-5499-4692-95ec-f89b6b3b6869 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:24.706697 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8cbd6fe4-5499-4692-95ec-f89b6b3b6869 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:24.707693 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8cbd6fe4-5499-4692-95ec-f89b6b3b6869 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:24.708445 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8cbd6fe4-5499-4692-95ec-f89b6b3b6869 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:24.708898 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8cbd6fe4-5499-4692-95ec-f89b6b3b6869 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:24.709316 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8cbd6fe4-5499-4692-95ec-f89b6b3b6869 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:24.718426 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-b5253fec-5799-42da-98e9-0b3a379e8ea9 req-e9f25990-3a68-433c-8459-3d2c5abae10c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151768 Oct 30 01:16:24.721698 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 455/913] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:16:24.774915 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-068607d5-fa92-4c84-a332-b2afb57da332 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:24.775893 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-068607d5-fa92-4c84-a332-b2afb57da332 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:24.793618 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-068607d5-fa92-4c84-a332-b2afb57da332 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:24.795569 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-068607d5-fa92-4c84-a332-b2afb57da332 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:24.796522 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-068607d5-fa92-4c84-a332-b2afb57da332 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:24.798690 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-068607d5-fa92-4c84-a332-b2afb57da332 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:24.799732 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-068607d5-fa92-4c84-a332-b2afb57da332 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:24.801859 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-068607d5-fa92-4c84-a332-b2afb57da332 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:25.197891 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-068607d5-fa92-4c84-a332-b2afb57da332 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:25.214891 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-068607d5-fa92-4c84-a332-b2afb57da332 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:25.218420 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-068607d5-fa92-4c84-a332-b2afb57da332 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:25.223960 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-068607d5-fa92-4c84-a332-b2afb57da332 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 200 len: 1411 microversion: 2.25 time: 0.453910 Oct 30 01:16:25.227055 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 456/914] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:16:24 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 1411 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:16:25.236848 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-343e7e50-075d-417e-82d5-77e31d71a952 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-203520582", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "f10b90ae-23e1-4ca1-b95e-9404e606e5d9"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:16:25.348887 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-343e7e50-075d-417e-82d5-77e31d71a952 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] validate_networks() for None {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:16:25.654256 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8cbd6fe4-5499-4692-95ec-f89b6b3b6869 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:25.664989 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8cbd6fe4-5499-4692-95ec-f89b6b3b6869 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/f86d0786-3c99-494f-aa6b-47adf07fca7c" status: 200 len: 1468 microversion: 2.1 time: 1.021621 Oct 30 01:16:25.670702 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 459/915] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:24 2022] GET /compute/v2.1/servers/f86d0786-3c99-494f-aa6b-47adf07fca7c => generated 1468 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:25.680630 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b857c0f7-ce33-463a-b343-ec19aa3b117e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:25.681921 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b857c0f7-ce33-463a-b343-ec19aa3b117e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:25.698280 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b857c0f7-ce33-463a-b343-ec19aa3b117e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:25.704325 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b857c0f7-ce33-463a-b343-ec19aa3b117e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:25.705045 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b857c0f7-ce33-463a-b343-ec19aa3b117e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:25.705971 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b857c0f7-ce33-463a-b343-ec19aa3b117e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:25.706575 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b857c0f7-ce33-463a-b343-ec19aa3b117e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:25.707373 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b857c0f7-ce33-463a-b343-ec19aa3b117e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:25.715116 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=100 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:26.227400 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-343e7e50-075d-417e-82d5-77e31d71a952 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:16:26.228755 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-343e7e50-075d-417e-82d5-77e31d71a952 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:16:26.229244 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-343e7e50-075d-417e-82d5-77e31d71a952 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:16:26.233620 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-343e7e50-075d-417e-82d5-77e31d71a952 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:16:26.233620 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-343e7e50-075d-417e-82d5-77e31d71a952 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:16:26.249901 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b857c0f7-ce33-463a-b343-ec19aa3b117e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:26.265534 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-343e7e50-075d-417e-82d5-77e31d71a952 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:26.265534 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-343e7e50-075d-417e-82d5-77e31d71a952 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:26.265534 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-343e7e50-075d-417e-82d5-77e31d71a952 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:26.266227 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b857c0f7-ce33-463a-b343-ec19aa3b117e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f" status: 200 len: 1471 microversion: 2.1 time: 0.586825 Oct 30 01:16:26.267054 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 460/916] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:25 2022] GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f => generated 1471 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:26.267680 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-343e7e50-075d-417e-82d5-77e31d71a952 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:26.270995 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-343e7e50-075d-417e-82d5-77e31d71a952 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:26.271457 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-343e7e50-075d-417e-82d5-77e31d71a952 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:26.275664 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-712de854-2f07-448e-af0d-0430ebb80a44 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:26.279948 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-712de854-2f07-448e-af0d-0430ebb80a44 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: a294dd33-efb1-4d8b-a83c-817b50cdc138] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:26.299772 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-712de854-2f07-448e-af0d-0430ebb80a44 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:26.300571 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-712de854-2f07-448e-af0d-0430ebb80a44 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:26.301222 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-712de854-2f07-448e-af0d-0430ebb80a44 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:26.302138 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-712de854-2f07-448e-af0d-0430ebb80a44 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:26.303514 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-712de854-2f07-448e-af0d-0430ebb80a44 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:26.304136 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-712de854-2f07-448e-af0d-0430ebb80a44 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:26.355657 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-343e7e50-075d-417e-82d5-77e31d71a952 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Getting quotas for project b90a3225f0bb4bb6a90847078c27720d. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:16:26.381968 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-343e7e50-075d-417e-82d5-77e31d71a952 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Getting quotas for user f33a2fe009b74c1285df84f614f38866 and project b90a3225f0bb4bb6a90847078c27720d. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:16:26.447176 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-343e7e50-075d-417e-82d5-77e31d71a952 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:16:26.450359 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-343e7e50-075d-417e-82d5-77e31d71a952 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: 773bba47-dab6-4fbb-91a3-c3a447cd5008] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:16:26.658798 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-343e7e50-075d-417e-82d5-77e31d71a952 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.430538 Oct 30 01:16:26.666578 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 457/917] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:16:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1439 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:16:26.686115 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-30afef1f-ff9c-404a-9b1c-5fdf383dfcc2 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:26.691292 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-30afef1f-ff9c-404a-9b1c-5fdf383dfcc2 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:26.705738 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-30afef1f-ff9c-404a-9b1c-5fdf383dfcc2 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:26.708761 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-30afef1f-ff9c-404a-9b1c-5fdf383dfcc2 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:26.708761 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-30afef1f-ff9c-404a-9b1c-5fdf383dfcc2 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:26.708761 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-30afef1f-ff9c-404a-9b1c-5fdf383dfcc2 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:26.708761 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-30afef1f-ff9c-404a-9b1c-5fdf383dfcc2 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:26.710419 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-30afef1f-ff9c-404a-9b1c-5fdf383dfcc2 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:26.890851 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-712de854-2f07-448e-af0d-0430ebb80a44 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:26.909512 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-712de854-2f07-448e-af0d-0430ebb80a44 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/a294dd33-efb1-4d8b-a83c-817b50cdc138" status: 200 len: 1467 microversion: 2.1 time: 0.638147 Oct 30 01:16:26.940867 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 461/918] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:26 2022] GET /compute/v2.1/servers/a294dd33-efb1-4d8b-a83c-817b50cdc138 => generated 1467 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:26.964374 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d93fa692-245c-49fb-a1a6-eb2908a8d27d tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:26.965063 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d93fa692-245c-49fb-a1a6-eb2908a8d27d tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: 773bba47-dab6-4fbb-91a3-c3a447cd5008] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:27.106427 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d93fa692-245c-49fb-a1a6-eb2908a8d27d tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:27.115268 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d93fa692-245c-49fb-a1a6-eb2908a8d27d tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/773bba47-dab6-4fbb-91a3-c3a447cd5008" status: 200 len: 1213 microversion: 2.1 time: 0.173099 Oct 30 01:16:27.118522 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 462/919] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:26 2022] GET /compute/v2.1/servers/773bba47-dab6-4fbb-91a3-c3a447cd5008 => generated 1213 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:27.129975 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1781326a-3274-45c2-b6e6-a602c5899961 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:27.144396 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1781326a-3274-45c2-b6e6-a602c5899961 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:27.149136 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1781326a-3274-45c2-b6e6-a602c5899961 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Searching by: {'reservation_id': 'r-dsn3qe32', 'deleted': False, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48'} {{(pid=121103) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 30 01:16:27.161962 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1781326a-3274-45c2-b6e6-a602c5899961 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:27.162796 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1781326a-3274-45c2-b6e6-a602c5899961 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:27.164008 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1781326a-3274-45c2-b6e6-a602c5899961 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:27.167372 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1781326a-3274-45c2-b6e6-a602c5899961 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:27.168297 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1781326a-3274-45c2-b6e6-a602c5899961 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:27.170770 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1781326a-3274-45c2-b6e6-a602c5899961 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:27.247930 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-30afef1f-ff9c-404a-9b1c-5fdf383dfcc2 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:27.273546 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-30afef1f-ff9c-404a-9b1c-5fdf383dfcc2 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:27.278120 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-30afef1f-ff9c-404a-9b1c-5fdf383dfcc2 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:27.284712 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-30afef1f-ff9c-404a-9b1c-5fdf383dfcc2 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 200 len: 1411 microversion: 2.25 time: 0.616859 Oct 30 01:16:27.296945 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 458/920] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:16:26 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 1411 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:16:27.321866 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-f7460699-3eba-43e6-acf6-242829e9f436 req-de4dd6b2-78e4-4dd2-a0d7-e93e1b7be0dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3141e23-1b24-4315-aac8-fb785005e789", "name": "network-vif-plugged", "status": "completed", "tag": "ec5e536f-901e-4b24-a661-499fb1eb2a1f"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:16:27.333717 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-f7460699-3eba-43e6-acf6-242829e9f436 req-de4dd6b2-78e4-4dd2-a0d7-e93e1b7be0dd service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:27.335236 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-f7460699-3eba-43e6-acf6-242829e9f436 req-de4dd6b2-78e4-4dd2-a0d7-e93e1b7be0dd service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:27.336559 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-f7460699-3eba-43e6-acf6-242829e9f436 req-de4dd6b2-78e4-4dd2-a0d7-e93e1b7be0dd service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:27.350444 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-f7460699-3eba-43e6-acf6-242829e9f436 req-de4dd6b2-78e4-4dd2-a0d7-e93e1b7be0dd service nova] Creating event network-vif-plugged:ec5e536f-901e-4b24-a661-499fb1eb2a1f for instance f3141e23-1b24-4315-aac8-fb785005e789 on n-h2-master-1 Oct 30 01:16:27.356342 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-f7460699-3eba-43e6-acf6-242829e9f436 req-de4dd6b2-78e4-4dd2-a0d7-e93e1b7be0dd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044794 Oct 30 01:16:27.357427 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 459/921] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:16:27.364412 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4f4f4f39-ab90-4bb8-9da8-e73f425d26f5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:27.365492 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4f4f4f39-ab90-4bb8-9da8-e73f425d26f5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:27.374065 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4f4f4f39-ab90-4bb8-9da8-e73f425d26f5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:27.374898 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4f4f4f39-ab90-4bb8-9da8-e73f425d26f5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:27.375600 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4f4f4f39-ab90-4bb8-9da8-e73f425d26f5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:27.379969 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4f4f4f39-ab90-4bb8-9da8-e73f425d26f5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:27.379969 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4f4f4f39-ab90-4bb8-9da8-e73f425d26f5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:27.379969 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4f4f4f39-ab90-4bb8-9da8-e73f425d26f5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:27.592424 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.multi_cell_list [None req-1781326a-3274-45c2-b6e6-a602c5899961 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=121103) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 30 01:16:27.748601 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1781326a-3274-45c2-b6e6-a602c5899961 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:27.763977 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1781326a-3274-45c2-b6e6-a602c5899961 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:27.764461 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1781326a-3274-45c2-b6e6-a602c5899961 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:27.766749 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1781326a-3274-45c2-b6e6-a602c5899961 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:28.096917 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1781326a-3274-45c2-b6e6-a602c5899961 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/detail?reservation_id=r-dsn3qe32" status: 200 len: 2928 microversion: 2.1 time: 0.975199 Oct 30 01:16:28.098001 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 463/922] 10.222.0.13 () {58 vars in 1197 bytes} [Sun Oct 30 01:16:27 2022] GET /compute/v2.1/servers/detail?reservation_id=r-dsn3qe32 => generated 2928 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:28.120731 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4f4f4f39-ab90-4bb8-9da8-e73f425d26f5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:28.132687 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-547a5e24-ab64-4719-a08b-01b6cef4fed2 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:28.168792 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4f4f4f39-ab90-4bb8-9da8-e73f425d26f5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f" status: 200 len: 1471 microversion: 2.1 time: 0.805697 Oct 30 01:16:28.177033 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 460/923] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:27 2022] GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f => generated 1471 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:28.205707 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d7339b33-5a06-4995-93ce-dbdf5e2d1099 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:28.205707 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d7339b33-5a06-4995-93ce-dbdf5e2d1099 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: 773bba47-dab6-4fbb-91a3-c3a447cd5008] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:28.219866 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.compute.server_groups [None req-547a5e24-ab64-4719-a08b-01b6cef4fed2 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Querying cell 7a264aef-b8bb-4843-8958-43bc38c25cb0(cell1) for 2 instances {{(pid=121103) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 30 01:16:28.220587 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-547a5e24-ab64-4719-a08b-01b6cef4fed2 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:28.221808 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7339b33-5a06-4995-93ce-dbdf5e2d1099 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:28.222322 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7339b33-5a06-4995-93ce-dbdf5e2d1099 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:28.223009 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7339b33-5a06-4995-93ce-dbdf5e2d1099 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:28.223907 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7339b33-5a06-4995-93ce-dbdf5e2d1099 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:28.225299 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-547a5e24-ab64-4719-a08b-01b6cef4fed2 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:28.225773 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-547a5e24-ab64-4719-a08b-01b6cef4fed2 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:28.226219 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7339b33-5a06-4995-93ce-dbdf5e2d1099 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:28.226827 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7339b33-5a06-4995-93ce-dbdf5e2d1099 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:28.322969 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-547a5e24-ab64-4719-a08b-01b6cef4fed2 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/os-server-groups/c7c0390c-1b84-4cf1-ac23-fcc988b47bcf" status: 200 len: 264 microversion: 2.1 time: 0.200177 Oct 30 01:16:28.329589 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 464/924] 10.222.0.13 () {58 vars in 1263 bytes} [Sun Oct 30 01:16:28 2022] GET /compute/v2.1/os-server-groups/c7c0390c-1b84-4cf1-ac23-fcc988b47bcf => generated 264 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:16:28.336345 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a8b5a44b-971a-4048-a118-f84c65c369d3 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:28.336967 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a8b5a44b-971a-4048-a118-f84c65c369d3 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:28.357192 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a8b5a44b-971a-4048-a118-f84c65c369d3 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:28.361318 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a8b5a44b-971a-4048-a118-f84c65c369d3 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:28.361318 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a8b5a44b-971a-4048-a118-f84c65c369d3 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:28.361318 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a8b5a44b-971a-4048-a118-f84c65c369d3 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:28.361731 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a8b5a44b-971a-4048-a118-f84c65c369d3 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:28.365730 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a8b5a44b-971a-4048-a118-f84c65c369d3 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:28.445724 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d7339b33-5a06-4995-93ce-dbdf5e2d1099 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:28.459933 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d7339b33-5a06-4995-93ce-dbdf5e2d1099 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/773bba47-dab6-4fbb-91a3-c3a447cd5008" status: 200 len: 1217 microversion: 2.1 time: 0.281193 Oct 30 01:16:28.478470 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 461/925] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:28 2022] GET /compute/v2.1/servers/773bba47-dab6-4fbb-91a3-c3a447cd5008 => generated 1217 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:28.494175 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1f68bdd8-0f4a-48ef-ad46-3039551c3328 tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:28.494809 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1f68bdd8-0f4a-48ef-ad46-3039551c3328 tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] [instance: a294dd33-efb1-4d8b-a83c-817b50cdc138] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:28.530007 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1f68bdd8-0f4a-48ef-ad46-3039551c3328 tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:28.535385 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1f68bdd8-0f4a-48ef-ad46-3039551c3328 tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:28.536334 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1f68bdd8-0f4a-48ef-ad46-3039551c3328 tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:28.537119 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1f68bdd8-0f4a-48ef-ad46-3039551c3328 tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:28.537570 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1f68bdd8-0f4a-48ef-ad46-3039551c3328 tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:28.538467 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1f68bdd8-0f4a-48ef-ad46-3039551c3328 tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:28.875006 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a8b5a44b-971a-4048-a118-f84c65c369d3 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:28.888479 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a8b5a44b-971a-4048-a118-f84c65c369d3 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:28.889963 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a8b5a44b-971a-4048-a118-f84c65c369d3 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:28.905358 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a8b5a44b-971a-4048-a118-f84c65c369d3 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 200 len: 1411 microversion: 2.25 time: 0.562322 Oct 30 01:16:28.905358 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 465/926] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:16:28 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 1411 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:16:28.958567 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1f68bdd8-0f4a-48ef-ad46-3039551c3328 tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/a294dd33-efb1-4d8b-a83c-817b50cdc138" status: 200 len: 1618 microversion: 2.1 time: 0.477958 Oct 30 01:16:28.959171 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 462/927] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:28 2022] GET /compute/v2.1/servers/a294dd33-efb1-4d8b-a83c-817b50cdc138 => generated 1618 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:28.986173 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-571c858b-e4db-43ab-8dd8-0a9b39161d04 tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:28.991993 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-571c858b-e4db-43ab-8dd8-0a9b39161d04 tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] [instance: f86d0786-3c99-494f-aa6b-47adf07fca7c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:28.999327 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-571c858b-e4db-43ab-8dd8-0a9b39161d04 tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:28.999815 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-571c858b-e4db-43ab-8dd8-0a9b39161d04 tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:29.000438 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-571c858b-e4db-43ab-8dd8-0a9b39161d04 tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:29.001306 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-571c858b-e4db-43ab-8dd8-0a9b39161d04 tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:29.001931 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-571c858b-e4db-43ab-8dd8-0a9b39161d04 tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:29.002509 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-571c858b-e4db-43ab-8dd8-0a9b39161d04 tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:29.192670 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a202730c-95b4-48ee-aea6-fbb8c235aa51 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:29.193274 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a202730c-95b4-48ee-aea6-fbb8c235aa51 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:29.203780 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a202730c-95b4-48ee-aea6-fbb8c235aa51 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:29.207686 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a202730c-95b4-48ee-aea6-fbb8c235aa51 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:29.208355 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a202730c-95b4-48ee-aea6-fbb8c235aa51 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:29.209289 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a202730c-95b4-48ee-aea6-fbb8c235aa51 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:29.211908 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a202730c-95b4-48ee-aea6-fbb8c235aa51 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:29.214747 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a202730c-95b4-48ee-aea6-fbb8c235aa51 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:29.937651 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-571c858b-e4db-43ab-8dd8-0a9b39161d04 tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/f86d0786-3c99-494f-aa6b-47adf07fca7c" status: 200 len: 1619 microversion: 2.1 time: 0.954958 Oct 30 01:16:29.939244 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 466/928] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:28 2022] GET /compute/v2.1/servers/f86d0786-3c99-494f-aa6b-47adf07fca7c => generated 1619 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:29.944265 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2e990382-1e59-4678-acc6-e0c330048bbb tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:29.945307 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2e990382-1e59-4678-acc6-e0c330048bbb tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: 773bba47-dab6-4fbb-91a3-c3a447cd5008] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:29.967022 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2e990382-1e59-4678-acc6-e0c330048bbb tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:29.967639 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2e990382-1e59-4678-acc6-e0c330048bbb tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:29.968083 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2e990382-1e59-4678-acc6-e0c330048bbb tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:29.968833 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2e990382-1e59-4678-acc6-e0c330048bbb tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:29.969268 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2e990382-1e59-4678-acc6-e0c330048bbb tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:29.971504 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2e990382-1e59-4678-acc6-e0c330048bbb tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:30.101505 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2e990382-1e59-4678-acc6-e0c330048bbb tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:30.110377 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2e990382-1e59-4678-acc6-e0c330048bbb tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/773bba47-dab6-4fbb-91a3-c3a447cd5008" status: 200 len: 1265 microversion: 2.1 time: 0.169833 Oct 30 01:16:30.114667 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 467/929] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:29 2022] GET /compute/v2.1/servers/773bba47-dab6-4fbb-91a3-c3a447cd5008 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:30.123073 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1834d389-5f86-42f5-a6d5-1629ca98acbf tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:30.127760 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1834d389-5f86-42f5-a6d5-1629ca98acbf tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:30.139433 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1834d389-5f86-42f5-a6d5-1629ca98acbf tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:30.143238 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1834d389-5f86-42f5-a6d5-1629ca98acbf tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:30.144422 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1834d389-5f86-42f5-a6d5-1629ca98acbf tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:30.149644 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1834d389-5f86-42f5-a6d5-1629ca98acbf tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:30.150513 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1834d389-5f86-42f5-a6d5-1629ca98acbf tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:30.151182 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1834d389-5f86-42f5-a6d5-1629ca98acbf tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:30.158613 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a202730c-95b4-48ee-aea6-fbb8c235aa51 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:30.167503 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a202730c-95b4-48ee-aea6-fbb8c235aa51 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f" status: 200 len: 1463 microversion: 2.1 time: 0.979337 Oct 30 01:16:30.179371 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 463/930] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:29 2022] GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f => generated 1463 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:16:30.184541 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c5368cd8-0712-4aa1-ac1a-46800a262f27 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Action: 'create', calling method: .version_select at 0x7f44cca66790>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-685899024", "policies": ["anti-affinity"]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:16:30.199099 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=4,nova_api:INSERT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:30.229962 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-c5368cd8-0712-4aa1-ac1a-46800a262f27 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Getting quotas for project 76b6f7b705f5428b9a3a3a8c4f86ff48. Resources: {'server_groups'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:16:30.250082 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-c5368cd8-0712-4aa1-ac1a-46800a262f27 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Getting quotas for user c536d41a93ad4337909fe2e2cb949e03 and project 76b6f7b705f5428b9a3a3a8c4f86ff48. Resources: {'server_groups'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:16:30.437541 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-c5368cd8-0712-4aa1-ac1a-46800a262f27 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Getting quotas for project 76b6f7b705f5428b9a3a3a8c4f86ff48. Resources: {'server_groups'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:16:30.450086 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-c5368cd8-0712-4aa1-ac1a-46800a262f27 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Getting quotas for user c536d41a93ad4337909fe2e2cb949e03 and project 76b6f7b705f5428b9a3a3a8c4f86ff48. Resources: {'server_groups'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:16:30.482045 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c5368cd8-0712-4aa1-ac1a-46800a262f27 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.301440 Oct 30 01:16:30.482775 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 464/931] 10.222.0.13 () {60 vars in 1174 bytes} [Sun Oct 30 01:16:30 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:16:30.495544 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-83047bc2-9d8b-4cb5-9efb-db2d9cadb023 tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:30.499786 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-83047bc2-9d8b-4cb5-9efb-db2d9cadb023 tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:30.518457 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-83047bc2-9d8b-4cb5-9efb-db2d9cadb023 tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:30.518959 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-83047bc2-9d8b-4cb5-9efb-db2d9cadb023 tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:30.525176 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-83047bc2-9d8b-4cb5-9efb-db2d9cadb023 tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:30.526438 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-83047bc2-9d8b-4cb5-9efb-db2d9cadb023 tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:30.526928 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-83047bc2-9d8b-4cb5-9efb-db2d9cadb023 tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:30.527360 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-83047bc2-9d8b-4cb5-9efb-db2d9cadb023 tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:30.804273 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1834d389-5f86-42f5-a6d5-1629ca98acbf tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:30.824219 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1834d389-5f86-42f5-a6d5-1629ca98acbf tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:30.837157 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1834d389-5f86-42f5-a6d5-1629ca98acbf tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:30.842399 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1834d389-5f86-42f5-a6d5-1629ca98acbf tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 200 len: 1606 microversion: 2.25 time: 0.722187 Oct 30 01:16:30.845252 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 468/932] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:16:30 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 1606 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:16:30.857147 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-84b63b06-2b91-4a49-b29e-c9c6476a0ed5 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-835947023", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "f7e3152a-37f1-42e3-a872-4e09c4000d62"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:16:30.993804 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-84b63b06-2b91-4a49-b29e-c9c6476a0ed5 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] validate_networks() for None {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:16:31.455091 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-83047bc2-9d8b-4cb5-9efb-db2d9cadb023 tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f" status: 200 len: 1614 microversion: 2.1 time: 0.970157 Oct 30 01:16:31.461287 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 465/933] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:30 2022] GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f => generated 1614 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:31.473011 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-51d100d8-70ca-4523-a001-180b274aff53 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:31.473951 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-51d100d8-70ca-4523-a001-180b274aff53 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:31.487632 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51d100d8-70ca-4523-a001-180b274aff53 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:31.493035 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51d100d8-70ca-4523-a001-180b274aff53 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:31.493748 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51d100d8-70ca-4523-a001-180b274aff53 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:31.494759 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51d100d8-70ca-4523-a001-180b274aff53 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:31.495488 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51d100d8-70ca-4523-a001-180b274aff53 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:31.496186 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51d100d8-70ca-4523-a001-180b274aff53 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:31.900777 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-51d100d8-70ca-4523-a001-180b274aff53 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.436770 Oct 30 01:16:31.906214 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 466/934] 10.222.0.13 () {60 vars in 1316 bytes} [Sun Oct 30 01:16:31 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789/os-interface => generated 285 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:16:31.916502 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3362cdb2-4cdc-4e46-9bc4-0965a71aa4dd tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:31.918348 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3362cdb2-4cdc-4e46-9bc4-0965a71aa4dd tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: 773bba47-dab6-4fbb-91a3-c3a447cd5008] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:31.943830 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3362cdb2-4cdc-4e46-9bc4-0965a71aa4dd tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:31.945852 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3362cdb2-4cdc-4e46-9bc4-0965a71aa4dd tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:31.948045 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3362cdb2-4cdc-4e46-9bc4-0965a71aa4dd tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:31.949061 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3362cdb2-4cdc-4e46-9bc4-0965a71aa4dd tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:31.950821 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3362cdb2-4cdc-4e46-9bc4-0965a71aa4dd tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:31.952129 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3362cdb2-4cdc-4e46-9bc4-0965a71aa4dd tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:32.220537 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-84b63b06-2b91-4a49-b29e-c9c6476a0ed5 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:16:32.222660 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-84b63b06-2b91-4a49-b29e-c9c6476a0ed5 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:16:32.226578 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-84b63b06-2b91-4a49-b29e-c9c6476a0ed5 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:16:32.226578 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-84b63b06-2b91-4a49-b29e-c9c6476a0ed5 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:16:32.226578 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-84b63b06-2b91-4a49-b29e-c9c6476a0ed5 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:16:32.273150 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-84b63b06-2b91-4a49-b29e-c9c6476a0ed5 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:32.274868 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-84b63b06-2b91-4a49-b29e-c9c6476a0ed5 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:32.275737 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-84b63b06-2b91-4a49-b29e-c9c6476a0ed5 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:32.276999 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-84b63b06-2b91-4a49-b29e-c9c6476a0ed5 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:32.280724 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-84b63b06-2b91-4a49-b29e-c9c6476a0ed5 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:32.282365 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-84b63b06-2b91-4a49-b29e-c9c6476a0ed5 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:32.340607 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-84b63b06-2b91-4a49-b29e-c9c6476a0ed5 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Getting quotas for project 76b6f7b705f5428b9a3a3a8c4f86ff48. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:16:32.346868 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-84b63b06-2b91-4a49-b29e-c9c6476a0ed5 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Getting quotas for user c536d41a93ad4337909fe2e2cb949e03 and project 76b6f7b705f5428b9a3a3a8c4f86ff48. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:16:32.367540 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3362cdb2-4cdc-4e46-9bc4-0965a71aa4dd tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:32.383775 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3362cdb2-4cdc-4e46-9bc4-0965a71aa4dd tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/773bba47-dab6-4fbb-91a3-c3a447cd5008" status: 200 len: 1271 microversion: 2.1 time: 0.475418 Oct 30 01:16:32.384478 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 467/935] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:31 2022] GET /compute/v2.1/servers/773bba47-dab6-4fbb-91a3-c3a447cd5008 => generated 1271 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:32.394342 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0473aad2-cba8-4f1e-98d2-c7c7f075fa17 tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] Calling method '.version_select at 0x7f44cc546dc0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:32.411832 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-84b63b06-2b91-4a49-b29e-c9c6476a0ed5 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Going to run 2 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:16:32.414117 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0473aad2-cba8-4f1e-98d2-c7c7f075fa17 tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:32.414621 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0473aad2-cba8-4f1e-98d2-c7c7f075fa17 tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:32.415246 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0473aad2-cba8-4f1e-98d2-c7c7f075fa17 tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:32.416921 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-84b63b06-2b91-4a49-b29e-c9c6476a0ed5 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 16620e75-9ac1-4f76-97eb-d4281e2f0d88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:16:32.461172 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0473aad2-cba8-4f1e-98d2-c7c7f075fa17 tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] 10.222.0.13 "GET /compute/v2.1/os-migrations" status: 200 len: 1945 microversion: 2.1 time: 0.075299 Oct 30 01:16:32.475743 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 468/936] 10.222.0.13 () {58 vars in 1143 bytes} [Sun Oct 30 01:16:32 2022] GET /compute/v2.1/os-migrations => generated 1945 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:32.607476 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-84b63b06-2b91-4a49-b29e-c9c6476a0ed5 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Getting quotas for project 76b6f7b705f5428b9a3a3a8c4f86ff48. Resources: {'server_group_members'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:16:32.624466 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-84b63b06-2b91-4a49-b29e-c9c6476a0ed5 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Getting quotas for user c536d41a93ad4337909fe2e2cb949e03 and project 76b6f7b705f5428b9a3a3a8c4f86ff48. Resources: {'server_group_members'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:16:32.633285 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3fa2a312-9e9f-404f-b990-652fab143722 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-816716314", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:16:32.753016 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-3fa2a312-9e9f-404f-b990-652fab143722 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] validate_networks() for None {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:16:32.772116 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-84b63b06-2b91-4a49-b29e-c9c6476a0ed5 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Getting quotas for project 76b6f7b705f5428b9a3a3a8c4f86ff48. Resources: {'server_group_members'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:16:32.784552 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-84b63b06-2b91-4a49-b29e-c9c6476a0ed5 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Getting quotas for user c536d41a93ad4337909fe2e2cb949e03 and project 76b6f7b705f5428b9a3a3a8c4f86ff48. Resources: {'server_group_members'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:16:32.787415 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:INSERT=4 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:32.819658 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-84b63b06-2b91-4a49-b29e-c9c6476a0ed5 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: d1fee870-9d6d-4086-9138-4a9709e2d26c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=16620e75-9ac1-4f76-97eb-d4281e2f0d88,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:16:33.035093 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-84b63b06-2b91-4a49-b29e-c9c6476a0ed5 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Getting quotas for project 76b6f7b705f5428b9a3a3a8c4f86ff48. Resources: {'server_group_members'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:16:33.055646 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-84b63b06-2b91-4a49-b29e-c9c6476a0ed5 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Getting quotas for user c536d41a93ad4337909fe2e2cb949e03 and project 76b6f7b705f5428b9a3a3a8c4f86ff48. Resources: {'server_group_members'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:16:33.188680 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-84b63b06-2b91-4a49-b29e-c9c6476a0ed5 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Getting quotas for project 76b6f7b705f5428b9a3a3a8c4f86ff48. Resources: {'server_group_members'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:16:33.208274 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-84b63b06-2b91-4a49-b29e-c9c6476a0ed5 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Getting quotas for user c536d41a93ad4337909fe2e2cb949e03 and project 76b6f7b705f5428b9a3a3a8c4f86ff48. Resources: {'server_group_members'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:16:33.313068 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-84b63b06-2b91-4a49-b29e-c9c6476a0ed5 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.466466 Oct 30 01:16:33.321380 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 469/937] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:16:30 2022] POST /compute/v2.1/servers => generated 32 bytes in 2475 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 30 01:16:33.326625 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-de29325e-a28b-4b4f-8060-d9832bedb579 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:33.346077 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-de29325e-a28b-4b4f-8060-d9832bedb579 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:33.347140 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-de29325e-a28b-4b4f-8060-d9832bedb579 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Searching by: {'deleted': False, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48'} {{(pid=121103) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 30 01:16:33.384405 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de29325e-a28b-4b4f-8060-d9832bedb579 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:33.385292 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de29325e-a28b-4b4f-8060-d9832bedb579 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:33.386158 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de29325e-a28b-4b4f-8060-d9832bedb579 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:33.387771 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de29325e-a28b-4b4f-8060-d9832bedb579 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:33.388511 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de29325e-a28b-4b4f-8060-d9832bedb579 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:33.389328 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de29325e-a28b-4b4f-8060-d9832bedb579 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:33.437981 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.multi_cell_list [None req-de29325e-a28b-4b4f-8060-d9832bedb579 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=121103) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 30 01:16:33.542005 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-de29325e-a28b-4b4f-8060-d9832bedb579 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 1663 microversion: 2.1 time: 0.216626 Oct 30 01:16:33.545718 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 470/938] 10.222.0.13 () {58 vars in 1125 bytes} [Sun Oct 30 01:16:33 2022] GET /compute/v2.1/servers => generated 1663 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:33.554612 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8c4ca113-4f5f-43f9-82c4-15dcbb871f57 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:33.560425 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8c4ca113-4f5f-43f9-82c4-15dcbb871f57 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: 773bba47-dab6-4fbb-91a3-c3a447cd5008] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:33.577892 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8c4ca113-4f5f-43f9-82c4-15dcbb871f57 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:33.579700 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8c4ca113-4f5f-43f9-82c4-15dcbb871f57 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:33.580244 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8c4ca113-4f5f-43f9-82c4-15dcbb871f57 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:33.584005 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8c4ca113-4f5f-43f9-82c4-15dcbb871f57 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:33.587114 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8c4ca113-4f5f-43f9-82c4-15dcbb871f57 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:33.587703 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8c4ca113-4f5f-43f9-82c4-15dcbb871f57 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:33.785364 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8c4ca113-4f5f-43f9-82c4-15dcbb871f57 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:33.794050 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8c4ca113-4f5f-43f9-82c4-15dcbb871f57 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/773bba47-dab6-4fbb-91a3-c3a447cd5008" status: 200 len: 1271 microversion: 2.1 time: 0.246725 Oct 30 01:16:33.798435 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 471/939] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:33 2022] GET /compute/v2.1/servers/773bba47-dab6-4fbb-91a3-c3a447cd5008 => generated 1271 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:33.811695 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1e0669aa-26fd-49c2-a684-2aedcb5bd18a tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:33.812476 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1e0669aa-26fd-49c2-a684-2aedcb5bd18a tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: d1fee870-9d6d-4086-9138-4a9709e2d26c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:33.987780 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-3fa2a312-9e9f-404f-b990-652fab143722 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:16:33.988319 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-3fa2a312-9e9f-404f-b990-652fab143722 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:16:33.989425 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-3fa2a312-9e9f-404f-b990-652fab143722 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:16:33.989924 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-3fa2a312-9e9f-404f-b990-652fab143722 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:16:33.991172 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-3fa2a312-9e9f-404f-b990-652fab143722 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:16:34.022966 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3fa2a312-9e9f-404f-b990-652fab143722 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:34.024537 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3fa2a312-9e9f-404f-b990-652fab143722 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:34.034498 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3fa2a312-9e9f-404f-b990-652fab143722 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:34.036559 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3fa2a312-9e9f-404f-b990-652fab143722 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:34.037053 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3fa2a312-9e9f-404f-b990-652fab143722 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:34.040735 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3fa2a312-9e9f-404f-b990-652fab143722 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:34.070659 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1e0669aa-26fd-49c2-a684-2aedcb5bd18a tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:34.078941 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-3fa2a312-9e9f-404f-b990-652fab143722 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Getting quotas for project ad621909b99143dd9885006238de72a6. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:16:34.079343 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1e0669aa-26fd-49c2-a684-2aedcb5bd18a tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/d1fee870-9d6d-4086-9138-4a9709e2d26c" status: 200 len: 1218 microversion: 2.1 time: 0.279537 Oct 30 01:16:34.085238 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-3fa2a312-9e9f-404f-b990-652fab143722 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Getting quotas for user 4f1fe6e04e064dfba969b07d4188ab38 and project ad621909b99143dd9885006238de72a6. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:16:34.085719 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 472/940] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:33 2022] GET /compute/v2.1/servers/d1fee870-9d6d-4086-9138-4a9709e2d26c => generated 1218 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:34.112964 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3fa2a312-9e9f-404f-b990-652fab143722 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:16:34.120216 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3fa2a312-9e9f-404f-b990-652fab143722 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:16:34.317849 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3fa2a312-9e9f-404f-b990-652fab143722 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.696307 Oct 30 01:16:34.329679 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 469/941] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:16:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 30 01:16:34.336878 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0c88e992-46e1-40bc-98cc-09360514451a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:34.338261 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0c88e992-46e1-40bc-98cc-09360514451a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:34.503578 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0c88e992-46e1-40bc-98cc-09360514451a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:34.553680 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0c88e992-46e1-40bc-98cc-09360514451a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1212 microversion: 2.1 time: 0.220075 Oct 30 01:16:34.555048 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 473/942] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:34 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1212 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:34.823705 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4ffc9ab2-409c-4e7c-a276-4fae09beb729 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:34.833096 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4ffc9ab2-409c-4e7c-a276-4fae09beb729 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: 773bba47-dab6-4fbb-91a3-c3a447cd5008] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:34.850819 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4ffc9ab2-409c-4e7c-a276-4fae09beb729 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:34.856147 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4ffc9ab2-409c-4e7c-a276-4fae09beb729 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:34.859791 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4ffc9ab2-409c-4e7c-a276-4fae09beb729 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:34.862385 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4ffc9ab2-409c-4e7c-a276-4fae09beb729 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:34.863048 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4ffc9ab2-409c-4e7c-a276-4fae09beb729 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:34.863682 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4ffc9ab2-409c-4e7c-a276-4fae09beb729 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:34.973190 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-23871bb8-b1b9-442f-b57a-5a86871f0f72 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-884605480", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "c383b18e-d32f-47dc-90a2-236912a6d567"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:16:35.061475 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-23871bb8-b1b9-442f-b57a-5a86871f0f72 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] validate_networks() for [('c383b18e-d32f-47dc-90a2-236912a6d567', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:16:36.979948 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4ffc9ab2-409c-4e7c-a276-4fae09beb729 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:36.992678 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4ffc9ab2-409c-4e7c-a276-4fae09beb729 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/773bba47-dab6-4fbb-91a3-c3a447cd5008" status: 200 len: 1313 microversion: 2.1 time: 2.174291 Oct 30 01:16:36.998182 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 474/943] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:34 2022] GET /compute/v2.1/servers/773bba47-dab6-4fbb-91a3-c3a447cd5008 => generated 1313 bytes in 2181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:16:37.003069 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-dc4b49b3-4b30-4ff1-90fc-f9e672732f4d tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:37.003935 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-dc4b49b3-4b30-4ff1-90fc-f9e672732f4d tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: d1fee870-9d6d-4086-9138-4a9709e2d26c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:37.004504 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-23871bb8-b1b9-442f-b57a-5a86871f0f72 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:16:37.004971 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-23871bb8-b1b9-442f-b57a-5a86871f0f72 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:16:37.005737 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-23871bb8-b1b9-442f-b57a-5a86871f0f72 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:16:37.006214 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-23871bb8-b1b9-442f-b57a-5a86871f0f72 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:16:37.006631 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-23871bb8-b1b9-442f-b57a-5a86871f0f72 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:16:37.011898 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc4b49b3-4b30-4ff1-90fc-f9e672732f4d tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:37.012608 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc4b49b3-4b30-4ff1-90fc-f9e672732f4d tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:37.013158 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc4b49b3-4b30-4ff1-90fc-f9e672732f4d tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:37.014265 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc4b49b3-4b30-4ff1-90fc-f9e672732f4d tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:37.014776 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc4b49b3-4b30-4ff1-90fc-f9e672732f4d tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:37.015426 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc4b49b3-4b30-4ff1-90fc-f9e672732f4d tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:37.021952 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-23871bb8-b1b9-442f-b57a-5a86871f0f72 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:37.022480 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-23871bb8-b1b9-442f-b57a-5a86871f0f72 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:37.026010 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-23871bb8-b1b9-442f-b57a-5a86871f0f72 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:37.026010 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-23871bb8-b1b9-442f-b57a-5a86871f0f72 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:37.026010 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-23871bb8-b1b9-442f-b57a-5a86871f0f72 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:37.026010 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-23871bb8-b1b9-442f-b57a-5a86871f0f72 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:37.063871 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:37.103580 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-23871bb8-b1b9-442f-b57a-5a86871f0f72 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Getting quotas for project 10e2bdadb00745888a171041c5714bd9. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:16:37.112815 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-23871bb8-b1b9-442f-b57a-5a86871f0f72 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Getting quotas for user 71f11109f32d4013aed5ab9320d8295b and project 10e2bdadb00745888a171041c5714bd9. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:16:37.135395 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-23871bb8-b1b9-442f-b57a-5a86871f0f72 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:16:37.138049 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-23871bb8-b1b9-442f-b57a-5a86871f0f72 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: e19edf61-5458-4f12-84b2-346b41506ff3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:16:37.205564 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-dc4b49b3-4b30-4ff1-90fc-f9e672732f4d tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:37.218646 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-dc4b49b3-4b30-4ff1-90fc-f9e672732f4d tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/d1fee870-9d6d-4086-9138-4a9709e2d26c" status: 200 len: 1270 microversion: 2.1 time: 0.219315 Oct 30 01:16:37.231976 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 475/944] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:36 2022] GET /compute/v2.1/servers/d1fee870-9d6d-4086-9138-4a9709e2d26c => generated 1270 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:37.231976 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-b0d3ee35-ad1f-455f-a25e-122601b86978 req-8658a9b0-d9e4-4e4e-b393-4b4b6ea46fa1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3141e23-1b24-4315-aac8-fb785005e789", "tag": "ec5e536f-901e-4b24-a661-499fb1eb2a1f"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:16:37.267616 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-b0d3ee35-ad1f-455f-a25e-122601b86978 req-8658a9b0-d9e4-4e4e-b393-4b4b6ea46fa1 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:37.268081 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-b0d3ee35-ad1f-455f-a25e-122601b86978 req-8658a9b0-d9e4-4e4e-b393-4b4b6ea46fa1 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:37.268511 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-b0d3ee35-ad1f-455f-a25e-122601b86978 req-8658a9b0-d9e4-4e4e-b393-4b4b6ea46fa1 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:37.312769 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-b0d3ee35-ad1f-455f-a25e-122601b86978 req-8658a9b0-d9e4-4e4e-b393-4b4b6ea46fa1 service nova] Creating event network-changed:ec5e536f-901e-4b24-a661-499fb1eb2a1f for instance f3141e23-1b24-4315-aac8-fb785005e789 on n-h2-master-1 Oct 30 01:16:37.326825 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-b0d3ee35-ad1f-455f-a25e-122601b86978 req-8658a9b0-d9e4-4e4e-b393-4b4b6ea46fa1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105566 Oct 30 01:16:37.327445 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 476/945] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:16:37.340444 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-33c0b386-702a-41e5-9e4d-c89d4eb59ed8 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:37.341882 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-33c0b386-702a-41e5-9e4d-c89d4eb59ed8 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:37.352273 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-33c0b386-702a-41e5-9e4d-c89d4eb59ed8 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:37.353056 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-33c0b386-702a-41e5-9e4d-c89d4eb59ed8 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:37.353687 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-33c0b386-702a-41e5-9e4d-c89d4eb59ed8 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:37.358840 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-33c0b386-702a-41e5-9e4d-c89d4eb59ed8 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:37.358840 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-33c0b386-702a-41e5-9e4d-c89d4eb59ed8 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:37.358840 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-33c0b386-702a-41e5-9e4d-c89d4eb59ed8 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:37.409934 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-23871bb8-b1b9-442f-b57a-5a86871f0f72 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.778747 Oct 30 01:16:37.411652 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 470/946] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:16:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:16:37.608903 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-33c0b386-702a-41e5-9e4d-c89d4eb59ed8 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:37.619913 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-33c0b386-702a-41e5-9e4d-c89d4eb59ed8 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1208 microversion: 2.1 time: 0.289132 Oct 30 01:16:37.620524 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 477/947] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:37 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1208 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:37.676191 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d4127960-bed5-4596-9d67-feb8dd76787a tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:37.679672 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d4127960-bed5-4596-9d67-feb8dd76787a tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: e19edf61-5458-4f12-84b2-346b41506ff3] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:37.754987 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0e57019b-3a2c-4aaa-81ea-d35684cd1343 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Action: 'create', calling method: .version_select at 0x7f44cc6d2940>, body: {"keypair": {"name": "tempest-keypair-1764706091", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNk2ycdELgTi4N2WZR25oHvpxuno9eBKeGl5K1RrecgX+xO/gDt3ER46UVtHcjEbE11i5aHdJUxSXvzPg7SzCaa6SpuhEv7gv+WuG+x5tMldnOQeAg9m2oDnHv8m5EXQ7g=="}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:16:37.825042 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-0e57019b-3a2c-4aaa-81ea-d35684cd1343 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Getting quotas for project d4681ed2d06840f995b37e550323d6ad. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:16:37.836307 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-0e57019b-3a2c-4aaa-81ea-d35684cd1343 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Getting quotas for user ec7269dc6d56440ca8691179f7275aeb and project d4681ed2d06840f995b37e550323d6ad. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:16:37.916666 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d4127960-bed5-4596-9d67-feb8dd76787a tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f11109f32d4013aed5ab9320d8295b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e2bdadb00745888a171041c5714bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:37.937986 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d4127960-bed5-4596-9d67-feb8dd76787a tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] 10.222.0.13 "GET /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3" status: 200 len: 1223 microversion: 2.1 time: 0.281696 Oct 30 01:16:37.941136 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 478/948] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:37 2022] GET /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3 => generated 1223 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:37.979293 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0e57019b-3a2c-4aaa-81ea-d35684cd1343 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.563335 Oct 30 01:16:37.986223 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 471/949] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 30 01:16:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:16:38.019617 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6ce2895f-1b1d-4089-99f0-2909d59163e5 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:38.020813 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6ce2895f-1b1d-4089-99f0-2909d59163e5 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: 773bba47-dab6-4fbb-91a3-c3a447cd5008] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:38.030726 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ce2895f-1b1d-4089-99f0-2909d59163e5 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:38.031428 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ce2895f-1b1d-4089-99f0-2909d59163e5 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:38.032169 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ce2895f-1b1d-4089-99f0-2909d59163e5 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:38.033434 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ce2895f-1b1d-4089-99f0-2909d59163e5 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:38.034579 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ce2895f-1b1d-4089-99f0-2909d59163e5 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:38.035409 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ce2895f-1b1d-4089-99f0-2909d59163e5 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:38.245922 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7e7941f7-5db9-49be-8841-47c825a63c0f tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:38.246538 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7e7941f7-5db9-49be-8841-47c825a63c0f tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: d1fee870-9d6d-4086-9138-4a9709e2d26c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:38.260141 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e7941f7-5db9-49be-8841-47c825a63c0f tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:38.272506 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e7941f7-5db9-49be-8841-47c825a63c0f tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:38.275590 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e7941f7-5db9-49be-8841-47c825a63c0f tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:38.275590 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e7941f7-5db9-49be-8841-47c825a63c0f tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:38.275590 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e7941f7-5db9-49be-8841-47c825a63c0f tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:38.275590 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e7941f7-5db9-49be-8841-47c825a63c0f tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:38.308975 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6ce2895f-1b1d-4089-99f0-2909d59163e5 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:38.322079 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6ce2895f-1b1d-4089-99f0-2909d59163e5 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/773bba47-dab6-4fbb-91a3-c3a447cd5008" status: 200 len: 1313 microversion: 2.1 time: 0.306717 Oct 30 01:16:38.326341 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 479/950] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:38 2022] GET /compute/v2.1/servers/773bba47-dab6-4fbb-91a3-c3a447cd5008 => generated 1313 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:38.388019 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-7ed7d4fd-ffbe-415f-b614-02afff5a5fb6 req-350968f4-c743-4c8e-8280-c4bfca4707eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "773bba47-dab6-4fbb-91a3-c3a447cd5008", "tag": "37f0b88d-5907-4ea6-ab74-1b880457b341"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:16:38.411727 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-7ed7d4fd-ffbe-415f-b614-02afff5a5fb6 req-350968f4-c743-4c8e-8280-c4bfca4707eb service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:38.412205 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-7ed7d4fd-ffbe-415f-b614-02afff5a5fb6 req-350968f4-c743-4c8e-8280-c4bfca4707eb service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:38.412631 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-7ed7d4fd-ffbe-415f-b614-02afff5a5fb6 req-350968f4-c743-4c8e-8280-c4bfca4707eb service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:38.433692 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-7ed7d4fd-ffbe-415f-b614-02afff5a5fb6 req-350968f4-c743-4c8e-8280-c4bfca4707eb service nova] Creating event network-changed:37f0b88d-5907-4ea6-ab74-1b880457b341 for instance 773bba47-dab6-4fbb-91a3-c3a447cd5008 on n-h2-master-1 Oct 30 01:16:38.444559 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-7ed7d4fd-ffbe-415f-b614-02afff5a5fb6 req-350968f4-c743-4c8e-8280-c4bfca4707eb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060132 Oct 30 01:16:38.445828 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 480/951] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:16:38.449682 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7e7941f7-5db9-49be-8841-47c825a63c0f tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:38.458501 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7e7941f7-5db9-49be-8841-47c825a63c0f tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/d1fee870-9d6d-4086-9138-4a9709e2d26c" status: 200 len: 1270 microversion: 2.1 time: 0.216552 Oct 30 01:16:38.459770 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 472/952] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:38 2022] GET /compute/v2.1/servers/d1fee870-9d6d-4086-9138-4a9709e2d26c => generated 1270 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:38.651339 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-aca9e099-d9c9-4287-baff-c3e8b7680eb2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:38.652432 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-aca9e099-d9c9-4287-baff-c3e8b7680eb2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:38.659252 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aca9e099-d9c9-4287-baff-c3e8b7680eb2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:38.660084 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aca9e099-d9c9-4287-baff-c3e8b7680eb2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:38.661276 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aca9e099-d9c9-4287-baff-c3e8b7680eb2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:38.662294 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aca9e099-d9c9-4287-baff-c3e8b7680eb2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:38.662846 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aca9e099-d9c9-4287-baff-c3e8b7680eb2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:38.663475 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aca9e099-d9c9-4287-baff-c3e8b7680eb2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:38.800002 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-aca9e099-d9c9-4287-baff-c3e8b7680eb2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:38.817240 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-aca9e099-d9c9-4287-baff-c3e8b7680eb2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1264 microversion: 2.1 time: 0.167013 Oct 30 01:16:38.817240 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 481/953] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:38 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:38.987185 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-212450b0-16e8-4427-b1f6-aeb04f444b06 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:38.987185 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-212450b0-16e8-4427-b1f6-aeb04f444b06 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: e19edf61-5458-4f12-84b2-346b41506ff3] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:38.993976 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9e3da30c-533c-4e3e-9752-a05ee952476b tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:38.996736 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9e3da30c-533c-4e3e-9752-a05ee952476b tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:39.011385 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9e3da30c-533c-4e3e-9752-a05ee952476b tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:39.013388 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9e3da30c-533c-4e3e-9752-a05ee952476b tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:39.013388 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9e3da30c-533c-4e3e-9752-a05ee952476b tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:39.015114 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9e3da30c-533c-4e3e-9752-a05ee952476b tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:39.016127 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9e3da30c-533c-4e3e-9752-a05ee952476b tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:39.016729 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9e3da30c-533c-4e3e-9752-a05ee952476b tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:39.095199 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-212450b0-16e8-4427-b1f6-aeb04f444b06 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f11109f32d4013aed5ab9320d8295b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e2bdadb00745888a171041c5714bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:39.110390 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-212450b0-16e8-4427-b1f6-aeb04f444b06 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] 10.222.0.13 "GET /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3" status: 200 len: 1223 microversion: 2.1 time: 0.131314 Oct 30 01:16:39.110985 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 482/954] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:38 2022] GET /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3 => generated 1223 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:39.351062 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8deec8f1-73d7-40f2-9960-d23ad07a1714 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:39.351689 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8deec8f1-73d7-40f2-9960-d23ad07a1714 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: 773bba47-dab6-4fbb-91a3-c3a447cd5008] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:39.358854 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8deec8f1-73d7-40f2-9960-d23ad07a1714 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:39.359795 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8deec8f1-73d7-40f2-9960-d23ad07a1714 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:39.360441 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8deec8f1-73d7-40f2-9960-d23ad07a1714 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:39.361383 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8deec8f1-73d7-40f2-9960-d23ad07a1714 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:39.362047 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8deec8f1-73d7-40f2-9960-d23ad07a1714 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:39.362772 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8deec8f1-73d7-40f2-9960-d23ad07a1714 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:39.371647 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=100 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:39.497694 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9e3da30c-533c-4e3e-9752-a05ee952476b tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd" status: 200 len: 1811 microversion: 2.1 time: 0.518024 Oct 30 01:16:39.509402 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 473/955] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:38 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd => generated 1811 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:39.534847 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-29c4f276-c3d7-46d6-8b68-6ddf1a5145d7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:39.539357 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-29c4f276-c3d7-46d6-8b68-6ddf1a5145d7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: d1fee870-9d6d-4086-9138-4a9709e2d26c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:39.563545 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-29c4f276-c3d7-46d6-8b68-6ddf1a5145d7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:39.566108 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-29c4f276-c3d7-46d6-8b68-6ddf1a5145d7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:39.566567 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-29c4f276-c3d7-46d6-8b68-6ddf1a5145d7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:39.568020 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-29c4f276-c3d7-46d6-8b68-6ddf1a5145d7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:39.574459 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-29c4f276-c3d7-46d6-8b68-6ddf1a5145d7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:39.575012 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-29c4f276-c3d7-46d6-8b68-6ddf1a5145d7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:39.741965 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-29c4f276-c3d7-46d6-8b68-6ddf1a5145d7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:39.744975 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8deec8f1-73d7-40f2-9960-d23ad07a1714 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:39.752158 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-29c4f276-c3d7-46d6-8b68-6ddf1a5145d7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/d1fee870-9d6d-4086-9138-4a9709e2d26c" status: 200 len: 1276 microversion: 2.1 time: 0.251723 Oct 30 01:16:39.752611 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8deec8f1-73d7-40f2-9960-d23ad07a1714 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/773bba47-dab6-4fbb-91a3-c3a447cd5008" status: 200 len: 1313 microversion: 2.1 time: 0.405498 Oct 30 01:16:39.756441 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 474/956] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:39 2022] GET /compute/v2.1/servers/d1fee870-9d6d-4086-9138-4a9709e2d26c => generated 1276 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:39.771934 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 483/957] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:39 2022] GET /compute/v2.1/servers/773bba47-dab6-4fbb-91a3-c3a447cd5008 => generated 1313 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:39.775677 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c7a8a204-c115-40cb-bca0-a2324908cde6 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:39.781322 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c7a8a204-c115-40cb-bca0-a2324908cde6 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:39.782942 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c7a8a204-c115-40cb-bca0-a2324908cde6 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:39.785200 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c7a8a204-c115-40cb-bca0-a2324908cde6 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:39.786405 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c7a8a204-c115-40cb-bca0-a2324908cde6 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:39.792671 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c7a8a204-c115-40cb-bca0-a2324908cde6 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:39.793676 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c7a8a204-c115-40cb-bca0-a2324908cde6 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:39.837499 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-da09243c-36ef-457a-b31d-aa490d0615ba tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:39.838119 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-da09243c-36ef-457a-b31d-aa490d0615ba tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:39.846071 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da09243c-36ef-457a-b31d-aa490d0615ba tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:39.853809 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da09243c-36ef-457a-b31d-aa490d0615ba tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:39.854512 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da09243c-36ef-457a-b31d-aa490d0615ba tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:39.855624 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da09243c-36ef-457a-b31d-aa490d0615ba tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:39.857847 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da09243c-36ef-457a-b31d-aa490d0615ba tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:39.858500 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da09243c-36ef-457a-b31d-aa490d0615ba tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:39.868977 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c7a8a204-c115-40cb-bca0-a2324908cde6 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.111301 Oct 30 01:16:39.869636 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 475/958] 10.222.0.13 () {58 vars in 1176 bytes} [Sun Oct 30 01:16:39 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:16:40.032982 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-da09243c-36ef-457a-b31d-aa490d0615ba tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:40.043908 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-da09243c-36ef-457a-b31d-aa490d0615ba tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1272 microversion: 2.1 time: 0.210448 Oct 30 01:16:40.050231 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 484/959] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:39 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1272 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:16:40.142387 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-706e6975-50fb-4db3-8f66-a5179e2a42ad tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:40.143145 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-706e6975-50fb-4db3-8f66-a5179e2a42ad tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: e19edf61-5458-4f12-84b2-346b41506ff3] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:40.165439 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-706e6975-50fb-4db3-8f66-a5179e2a42ad tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:40.166514 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-706e6975-50fb-4db3-8f66-a5179e2a42ad tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:40.170411 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-706e6975-50fb-4db3-8f66-a5179e2a42ad tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:40.171426 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-706e6975-50fb-4db3-8f66-a5179e2a42ad tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:40.173472 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-706e6975-50fb-4db3-8f66-a5179e2a42ad tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:40.174527 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-706e6975-50fb-4db3-8f66-a5179e2a42ad tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:40.378085 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-706e6975-50fb-4db3-8f66-a5179e2a42ad tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f11109f32d4013aed5ab9320d8295b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e2bdadb00745888a171041c5714bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:40.403457 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-706e6975-50fb-4db3-8f66-a5179e2a42ad tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] 10.222.0.13 "GET /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3" status: 200 len: 1219 microversion: 2.1 time: 0.264157 Oct 30 01:16:40.418340 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 476/960] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:40 2022] GET /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3 => generated 1219 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:40.777379 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cef3c1a7-443a-4b43-974c-b1be1aebde2d tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:40.779343 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-cef3c1a7-443a-4b43-974c-b1be1aebde2d tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: 773bba47-dab6-4fbb-91a3-c3a447cd5008] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:40.786415 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7d0ba40d-ba37-425e-a110-0652a4faf90a tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:40.787025 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7d0ba40d-ba37-425e-a110-0652a4faf90a tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: d1fee870-9d6d-4086-9138-4a9709e2d26c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:40.792665 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cef3c1a7-443a-4b43-974c-b1be1aebde2d tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:40.798282 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cef3c1a7-443a-4b43-974c-b1be1aebde2d tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:40.798282 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cef3c1a7-443a-4b43-974c-b1be1aebde2d tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:40.798282 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cef3c1a7-443a-4b43-974c-b1be1aebde2d tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:40.798282 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cef3c1a7-443a-4b43-974c-b1be1aebde2d tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:40.798653 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7d0ba40d-ba37-425e-a110-0652a4faf90a tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:40.798753 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cef3c1a7-443a-4b43-974c-b1be1aebde2d tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:40.798832 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7d0ba40d-ba37-425e-a110-0652a4faf90a tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:40.798832 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7d0ba40d-ba37-425e-a110-0652a4faf90a tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:40.799888 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7d0ba40d-ba37-425e-a110-0652a4faf90a tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:40.800354 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7d0ba40d-ba37-425e-a110-0652a4faf90a tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:40.800780 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7d0ba40d-ba37-425e-a110-0652a4faf90a tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:41.080624 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7d0ba40d-ba37-425e-a110-0652a4faf90a tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:41.098466 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7d0ba40d-ba37-425e-a110-0652a4faf90a tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/d1fee870-9d6d-4086-9138-4a9709e2d26c" status: 200 len: 1276 microversion: 2.1 time: 0.316243 Oct 30 01:16:41.103800 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 477/961] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:40 2022] GET /compute/v2.1/servers/d1fee870-9d6d-4086-9138-4a9709e2d26c => generated 1276 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:16:41.131194 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ada65fd7-7b4e-45e3-a007-d48e1c91c615 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:41.131865 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ada65fd7-7b4e-45e3-a007-d48e1c91c615 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:41.149168 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ada65fd7-7b4e-45e3-a007-d48e1c91c615 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:41.149709 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ada65fd7-7b4e-45e3-a007-d48e1c91c615 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:41.150157 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ada65fd7-7b4e-45e3-a007-d48e1c91c615 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:41.150902 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ada65fd7-7b4e-45e3-a007-d48e1c91c615 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:41.151363 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ada65fd7-7b4e-45e3-a007-d48e1c91c615 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:41.151811 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ada65fd7-7b4e-45e3-a007-d48e1c91c615 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:41.243001 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-cef3c1a7-443a-4b43-974c-b1be1aebde2d tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:41.268136 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cef3c1a7-443a-4b43-974c-b1be1aebde2d tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/773bba47-dab6-4fbb-91a3-c3a447cd5008" status: 200 len: 1313 microversion: 2.1 time: 0.494879 Oct 30 01:16:41.271714 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 485/962] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:40 2022] GET /compute/v2.1/servers/773bba47-dab6-4fbb-91a3-c3a447cd5008 => generated 1313 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:41.432585 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f4d6d6d4-6d89-4c0d-923a-4da1370e0984 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:41.433295 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f4d6d6d4-6d89-4c0d-923a-4da1370e0984 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: e19edf61-5458-4f12-84b2-346b41506ff3] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:41.446133 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f4d6d6d4-6d89-4c0d-923a-4da1370e0984 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:41.449497 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f4d6d6d4-6d89-4c0d-923a-4da1370e0984 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:41.451421 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f4d6d6d4-6d89-4c0d-923a-4da1370e0984 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:41.452194 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f4d6d6d4-6d89-4c0d-923a-4da1370e0984 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:41.452667 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f4d6d6d4-6d89-4c0d-923a-4da1370e0984 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:41.453096 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f4d6d6d4-6d89-4c0d-923a-4da1370e0984 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:41.459264 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ada65fd7-7b4e-45e3-a007-d48e1c91c615 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:41.469715 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ada65fd7-7b4e-45e3-a007-d48e1c91c615 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1270 microversion: 2.1 time: 0.364672 Oct 30 01:16:41.472000 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 478/963] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:41 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1270 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:41.637103 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f4d6d6d4-6d89-4c0d-923a-4da1370e0984 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f11109f32d4013aed5ab9320d8295b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e2bdadb00745888a171041c5714bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:41.667085 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f4d6d6d4-6d89-4c0d-923a-4da1370e0984 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] 10.222.0.13 "GET /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3" status: 200 len: 1275 microversion: 2.1 time: 0.237128 Oct 30 01:16:41.669804 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 486/964] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:41 2022] GET /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3 => generated 1275 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:16:42.125641 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ea8c3dc3-d86f-44b4-83ea-3fb7b6408cba tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:42.126374 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ea8c3dc3-d86f-44b4-83ea-3fb7b6408cba tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: d1fee870-9d6d-4086-9138-4a9709e2d26c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:42.143218 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea8c3dc3-d86f-44b4-83ea-3fb7b6408cba tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:42.144250 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea8c3dc3-d86f-44b4-83ea-3fb7b6408cba tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:42.145312 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea8c3dc3-d86f-44b4-83ea-3fb7b6408cba tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:42.146170 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea8c3dc3-d86f-44b4-83ea-3fb7b6408cba tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:42.146731 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea8c3dc3-d86f-44b4-83ea-3fb7b6408cba tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:42.147260 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea8c3dc3-d86f-44b4-83ea-3fb7b6408cba tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:42.293663 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c19d4f2f-8c7e-4974-b510-c253966d0aba tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:42.294349 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c19d4f2f-8c7e-4974-b510-c253966d0aba tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: 773bba47-dab6-4fbb-91a3-c3a447cd5008] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:42.300883 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c19d4f2f-8c7e-4974-b510-c253966d0aba tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:42.306444 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c19d4f2f-8c7e-4974-b510-c253966d0aba tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:42.307036 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c19d4f2f-8c7e-4974-b510-c253966d0aba tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:42.308209 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c19d4f2f-8c7e-4974-b510-c253966d0aba tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:42.310277 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c19d4f2f-8c7e-4974-b510-c253966d0aba tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:42.313225 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c19d4f2f-8c7e-4974-b510-c253966d0aba tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:42.349065 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ea8c3dc3-d86f-44b4-83ea-3fb7b6408cba tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:42.357967 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ea8c3dc3-d86f-44b4-83ea-3fb7b6408cba tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/d1fee870-9d6d-4086-9138-4a9709e2d26c" status: 200 len: 1276 microversion: 2.1 time: 0.236385 Oct 30 01:16:42.362046 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 479/965] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:42 2022] GET /compute/v2.1/servers/d1fee870-9d6d-4086-9138-4a9709e2d26c => generated 1276 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:16:42.497443 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ae449bbc-c3a8-4df8-a573-75f87fe4aecc tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:42.498447 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ae449bbc-c3a8-4df8-a573-75f87fe4aecc tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:42.508701 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae449bbc-c3a8-4df8-a573-75f87fe4aecc tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:42.511074 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae449bbc-c3a8-4df8-a573-75f87fe4aecc tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:42.511074 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae449bbc-c3a8-4df8-a573-75f87fe4aecc tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:42.511074 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae449bbc-c3a8-4df8-a573-75f87fe4aecc tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:42.515484 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae449bbc-c3a8-4df8-a573-75f87fe4aecc tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:42.516257 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae449bbc-c3a8-4df8-a573-75f87fe4aecc tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:42.717433 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ae449bbc-c3a8-4df8-a573-75f87fe4aecc tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:42.730823 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ae449bbc-c3a8-4df8-a573-75f87fe4aecc tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1270 microversion: 2.1 time: 0.236948 Oct 30 01:16:42.731734 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 480/966] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:42 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1270 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:16:42.746449 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-68bc3970-7848-4f04-baf7-acda75fce294 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:42.751256 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-68bc3970-7848-4f04-baf7-acda75fce294 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: e19edf61-5458-4f12-84b2-346b41506ff3] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:42.768072 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-68bc3970-7848-4f04-baf7-acda75fce294 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:42.768827 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-68bc3970-7848-4f04-baf7-acda75fce294 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:42.771211 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-68bc3970-7848-4f04-baf7-acda75fce294 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:42.772401 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-68bc3970-7848-4f04-baf7-acda75fce294 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:42.774454 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-68bc3970-7848-4f04-baf7-acda75fce294 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:42.775238 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-68bc3970-7848-4f04-baf7-acda75fce294 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:42.949749 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-68bc3970-7848-4f04-baf7-acda75fce294 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f11109f32d4013aed5ab9320d8295b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e2bdadb00745888a171041c5714bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:42.967068 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-68bc3970-7848-4f04-baf7-acda75fce294 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] 10.222.0.13 "GET /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3" status: 200 len: 1281 microversion: 2.1 time: 0.232430 Oct 30 01:16:42.982219 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 481/967] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:42 2022] GET /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3 => generated 1281 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:43.011237 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c19d4f2f-8c7e-4974-b510-c253966d0aba tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:43.022366 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c19d4f2f-8c7e-4974-b510-c253966d0aba tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/773bba47-dab6-4fbb-91a3-c3a447cd5008" status: 200 len: 1313 microversion: 2.1 time: 0.732729 Oct 30 01:16:43.024470 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 487/968] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:42 2022] GET /compute/v2.1/servers/773bba47-dab6-4fbb-91a3-c3a447cd5008 => generated 1313 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:43.385706 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-44dfab73-8c56-460b-ad71-76cd290f76b9 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:43.386218 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-44dfab73-8c56-460b-ad71-76cd290f76b9 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: d1fee870-9d6d-4086-9138-4a9709e2d26c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:43.392774 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:43.406215 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44dfab73-8c56-460b-ad71-76cd290f76b9 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:43.406215 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44dfab73-8c56-460b-ad71-76cd290f76b9 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:43.406215 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44dfab73-8c56-460b-ad71-76cd290f76b9 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:43.406215 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44dfab73-8c56-460b-ad71-76cd290f76b9 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:43.406651 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44dfab73-8c56-460b-ad71-76cd290f76b9 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:43.406651 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44dfab73-8c56-460b-ad71-76cd290f76b9 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:43.696338 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-44dfab73-8c56-460b-ad71-76cd290f76b9 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:43.749748 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-44dfab73-8c56-460b-ad71-76cd290f76b9 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/d1fee870-9d6d-4086-9138-4a9709e2d26c" status: 200 len: 1276 microversion: 2.1 time: 0.360580 Oct 30 01:16:43.750476 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 482/969] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:43 2022] GET /compute/v2.1/servers/d1fee870-9d6d-4086-9138-4a9709e2d26c => generated 1276 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:43.772628 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f292a618-b430-448e-8cad-3fe56e48b1f5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:43.773383 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f292a618-b430-448e-8cad-3fe56e48b1f5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:43.776024 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=6 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:43.792378 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f292a618-b430-448e-8cad-3fe56e48b1f5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:43.793249 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f292a618-b430-448e-8cad-3fe56e48b1f5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:43.793994 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f292a618-b430-448e-8cad-3fe56e48b1f5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:43.794950 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f292a618-b430-448e-8cad-3fe56e48b1f5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:43.795706 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f292a618-b430-448e-8cad-3fe56e48b1f5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:43.796529 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f292a618-b430-448e-8cad-3fe56e48b1f5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:43.993245 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-23d22469-6a53-467a-b2f2-2c62fb0d6314 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:43.996277 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-23d22469-6a53-467a-b2f2-2c62fb0d6314 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: e19edf61-5458-4f12-84b2-346b41506ff3] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:44.019361 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-23d22469-6a53-467a-b2f2-2c62fb0d6314 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:44.020792 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-23d22469-6a53-467a-b2f2-2c62fb0d6314 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:44.025798 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-23d22469-6a53-467a-b2f2-2c62fb0d6314 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:44.026807 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-23d22469-6a53-467a-b2f2-2c62fb0d6314 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:44.027442 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-23d22469-6a53-467a-b2f2-2c62fb0d6314 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:44.028037 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-23d22469-6a53-467a-b2f2-2c62fb0d6314 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:44.317000 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-23d22469-6a53-467a-b2f2-2c62fb0d6314 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f11109f32d4013aed5ab9320d8295b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e2bdadb00745888a171041c5714bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:44.334532 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-23d22469-6a53-467a-b2f2-2c62fb0d6314 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] 10.222.0.13 "GET /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3" status: 200 len: 1281 microversion: 2.1 time: 0.344966 Oct 30 01:16:44.335133 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 483/970] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:43 2022] GET /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3 => generated 1281 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:16:44.339732 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-69c2af85-29fc-4b03-9d53-c2769e625054 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:44.340599 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-69c2af85-29fc-4b03-9d53-c2769e625054 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: 773bba47-dab6-4fbb-91a3-c3a447cd5008] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:44.363226 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-69c2af85-29fc-4b03-9d53-c2769e625054 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:44.363961 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-69c2af85-29fc-4b03-9d53-c2769e625054 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:44.364549 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-69c2af85-29fc-4b03-9d53-c2769e625054 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:44.365536 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-69c2af85-29fc-4b03-9d53-c2769e625054 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:44.366162 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-69c2af85-29fc-4b03-9d53-c2769e625054 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:44.366924 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-69c2af85-29fc-4b03-9d53-c2769e625054 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:44.679065 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f292a618-b430-448e-8cad-3fe56e48b1f5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:44.693463 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f292a618-b430-448e-8cad-3fe56e48b1f5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1312 microversion: 2.1 time: 0.924067 Oct 30 01:16:44.697205 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 488/971] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:43 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1312 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:44.779866 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c48e2ff3-3938-466b-b03b-e5201055f913 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:44.780987 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c48e2ff3-3938-466b-b03b-e5201055f913 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: d1fee870-9d6d-4086-9138-4a9709e2d26c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:44.788290 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c48e2ff3-3938-466b-b03b-e5201055f913 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:44.789192 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c48e2ff3-3938-466b-b03b-e5201055f913 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:44.789676 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c48e2ff3-3938-466b-b03b-e5201055f913 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:44.790394 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c48e2ff3-3938-466b-b03b-e5201055f913 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:44.791186 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c48e2ff3-3938-466b-b03b-e5201055f913 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:44.791769 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c48e2ff3-3938-466b-b03b-e5201055f913 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:45.022824 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-69c2af85-29fc-4b03-9d53-c2769e625054 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:45.031075 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-69c2af85-29fc-4b03-9d53-c2769e625054 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/773bba47-dab6-4fbb-91a3-c3a447cd5008" status: 200 len: 1313 microversion: 2.1 time: 0.694743 Oct 30 01:16:45.031500 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 484/972] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:44 2022] GET /compute/v2.1/servers/773bba47-dab6-4fbb-91a3-c3a447cd5008 => generated 1313 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:45.167372 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c48e2ff3-3938-466b-b03b-e5201055f913 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:45.181069 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c48e2ff3-3938-466b-b03b-e5201055f913 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/d1fee870-9d6d-4086-9138-4a9709e2d26c" status: 200 len: 1318 microversion: 2.1 time: 0.405384 Oct 30 01:16:45.182194 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 489/973] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:44 2022] GET /compute/v2.1/servers/d1fee870-9d6d-4086-9138-4a9709e2d26c => generated 1318 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:45.185087 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5f2e234f-3fc4-4503-add9-e62f207bd01e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1825559755", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "cfc888ea-0e91-4003-b88f-59c6a1470ebe"}], "security_groups": [{"name": "tempest-securitygroup--1627289465"}], "key_name": "tempest-keypair-1764706091", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:16:45.360731 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-88c7168c-ec98-4478-acf2-e0263e14210f tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:45.361753 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-88c7168c-ec98-4478-acf2-e0263e14210f tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: e19edf61-5458-4f12-84b2-346b41506ff3] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:45.375467 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-88c7168c-ec98-4478-acf2-e0263e14210f tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:45.376114 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-88c7168c-ec98-4478-acf2-e0263e14210f tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:45.376554 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-88c7168c-ec98-4478-acf2-e0263e14210f tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:45.377278 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-88c7168c-ec98-4478-acf2-e0263e14210f tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:45.377760 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-88c7168c-ec98-4478-acf2-e0263e14210f tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:45.378231 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-88c7168c-ec98-4478-acf2-e0263e14210f tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:45.465400 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-5f2e234f-3fc4-4503-add9-e62f207bd01e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] validate_networks() for [('cfc888ea-0e91-4003-b88f-59c6a1470ebe', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:16:45.486482 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-88c7168c-ec98-4478-acf2-e0263e14210f tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f11109f32d4013aed5ab9320d8295b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e2bdadb00745888a171041c5714bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:45.499759 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-88c7168c-ec98-4478-acf2-e0263e14210f tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] 10.222.0.13 "GET /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3" status: 200 len: 1281 microversion: 2.1 time: 0.144056 Oct 30 01:16:45.517537 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 490/974] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:45 2022] GET /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3 => generated 1281 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:16:45.719444 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-194fc1f2-84ca-46d9-907e-003ed3a0e8e9 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:45.720454 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-194fc1f2-84ca-46d9-907e-003ed3a0e8e9 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:45.728495 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-194fc1f2-84ca-46d9-907e-003ed3a0e8e9 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:45.729319 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-194fc1f2-84ca-46d9-907e-003ed3a0e8e9 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:45.730167 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-194fc1f2-84ca-46d9-907e-003ed3a0e8e9 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:45.731116 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-194fc1f2-84ca-46d9-907e-003ed3a0e8e9 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:45.732058 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-194fc1f2-84ca-46d9-907e-003ed3a0e8e9 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:45.733130 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-194fc1f2-84ca-46d9-907e-003ed3a0e8e9 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:46.212667 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-194fc1f2-84ca-46d9-907e-003ed3a0e8e9 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:46.226642 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-194fc1f2-84ca-46d9-907e-003ed3a0e8e9 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1312 microversion: 2.1 time: 0.510966 Oct 30 01:16:46.232150 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 491/975] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:45 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1312 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:46.232294 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-5f2e234f-3fc4-4503-add9-e62f207bd01e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:16:46.232294 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-5f2e234f-3fc4-4503-add9-e62f207bd01e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:16:46.232294 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-5f2e234f-3fc4-4503-add9-e62f207bd01e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:16:46.232853 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-5f2e234f-3fc4-4503-add9-e62f207bd01e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:16:46.232853 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-5f2e234f-3fc4-4503-add9-e62f207bd01e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:16:46.234324 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e54085c3-8ebd-4137-a0ae-ed72c2cffb3b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "99059930-a27c-495b-825b-72b6b0274148", "device": "/dev/xvdb"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:16:46.238973 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e54085c3-8ebd-4137-a0ae-ed72c2cffb3b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:46.245879 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e54085c3-8ebd-4137-a0ae-ed72c2cffb3b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:46.246914 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e54085c3-8ebd-4137-a0ae-ed72c2cffb3b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:46.247552 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f2e234f-3fc4-4503-add9-e62f207bd01e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:46.247790 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e54085c3-8ebd-4137-a0ae-ed72c2cffb3b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:46.248039 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f2e234f-3fc4-4503-add9-e62f207bd01e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:46.248753 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f2e234f-3fc4-4503-add9-e62f207bd01e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:46.249203 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e54085c3-8ebd-4137-a0ae-ed72c2cffb3b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:46.250082 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f2e234f-3fc4-4503-add9-e62f207bd01e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:46.250252 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e54085c3-8ebd-4137-a0ae-ed72c2cffb3b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:46.250545 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f2e234f-3fc4-4503-add9-e62f207bd01e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:46.251252 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f2e234f-3fc4-4503-add9-e62f207bd01e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:46.251672 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e54085c3-8ebd-4137-a0ae-ed72c2cffb3b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:46.302610 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-5f2e234f-3fc4-4503-add9-e62f207bd01e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Getting quotas for project d4681ed2d06840f995b37e550323d6ad. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:16:46.317273 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-5f2e234f-3fc4-4503-add9-e62f207bd01e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Getting quotas for user ec7269dc6d56440ca8691179f7275aeb and project d4681ed2d06840f995b37e550323d6ad. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:16:46.349463 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5f2e234f-3fc4-4503-add9-e62f207bd01e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:16:46.372459 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5f2e234f-3fc4-4503-add9-e62f207bd01e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] [instance: 1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:16:46.532058 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5f2e234f-3fc4-4503-add9-e62f207bd01e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.351535 Oct 30 01:16:46.533320 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 485/976] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:16:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 1354 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:16:46.538833 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-2c93d8de-d492-4e11-83ab-eb6fa02ae529 req-6e9106c6-0d02-4976-a833-a3fbf0191a24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76c32172-798a-49f6-8247-6f86860dbdc5", "tag": "e96e6262-0ade-4db0-aeff-c6471cd42e45"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:16:46.558034 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-2c93d8de-d492-4e11-83ab-eb6fa02ae529 req-6e9106c6-0d02-4976-a833-a3fbf0191a24 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:46.559543 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-2c93d8de-d492-4e11-83ab-eb6fa02ae529 req-6e9106c6-0d02-4976-a833-a3fbf0191a24 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:46.560137 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-2c93d8de-d492-4e11-83ab-eb6fa02ae529 req-6e9106c6-0d02-4976-a833-a3fbf0191a24 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:46.587074 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-2c93d8de-d492-4e11-83ab-eb6fa02ae529 req-6e9106c6-0d02-4976-a833-a3fbf0191a24 service nova] Creating event network-changed:e96e6262-0ade-4db0-aeff-c6471cd42e45 for instance 76c32172-798a-49f6-8247-6f86860dbdc5 on n-h1-master-1 Oct 30 01:16:46.594511 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-2c93d8de-d492-4e11-83ab-eb6fa02ae529 req-6e9106c6-0d02-4976-a833-a3fbf0191a24 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059003 Oct 30 01:16:46.595659 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 486/977] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:16:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:16:46.603757 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-44843158-002f-49f2-8c64-bd91b8488387 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:46.604786 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-44843158-002f-49f2-8c64-bd91b8488387 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: 773bba47-dab6-4fbb-91a3-c3a447cd5008] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:46.615229 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44843158-002f-49f2-8c64-bd91b8488387 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:46.615794 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44843158-002f-49f2-8c64-bd91b8488387 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:46.616231 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44843158-002f-49f2-8c64-bd91b8488387 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:46.617030 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44843158-002f-49f2-8c64-bd91b8488387 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:46.618092 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44843158-002f-49f2-8c64-bd91b8488387 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:46.618579 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44843158-002f-49f2-8c64-bd91b8488387 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:46.959254 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-44843158-002f-49f2-8c64-bd91b8488387 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:46.980833 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-44843158-002f-49f2-8c64-bd91b8488387 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/773bba47-dab6-4fbb-91a3-c3a447cd5008" status: 200 len: 1313 microversion: 2.1 time: 0.371518 Oct 30 01:16:46.980833 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 487/978] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:46 2022] GET /compute/v2.1/servers/773bba47-dab6-4fbb-91a3-c3a447cd5008 => generated 1313 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:46.980833 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bc8d82c6-7cbd-4a27-91f6-200435df2f5b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:46.980833 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bc8d82c6-7cbd-4a27-91f6-200435df2f5b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: d1fee870-9d6d-4086-9138-4a9709e2d26c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:46.984025 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bc8d82c6-7cbd-4a27-91f6-200435df2f5b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:46.984746 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bc8d82c6-7cbd-4a27-91f6-200435df2f5b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:46.985187 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bc8d82c6-7cbd-4a27-91f6-200435df2f5b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:46.985932 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bc8d82c6-7cbd-4a27-91f6-200435df2f5b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:46.986494 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bc8d82c6-7cbd-4a27-91f6-200435df2f5b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:46.987093 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bc8d82c6-7cbd-4a27-91f6-200435df2f5b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:47.150098 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bc8d82c6-7cbd-4a27-91f6-200435df2f5b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:47.158242 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bc8d82c6-7cbd-4a27-91f6-200435df2f5b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/d1fee870-9d6d-4086-9138-4a9709e2d26c" status: 200 len: 1318 microversion: 2.1 time: 0.186314 Oct 30 01:16:47.159283 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 488/979] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:46 2022] GET /compute/v2.1/servers/d1fee870-9d6d-4086-9138-4a9709e2d26c => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:47.164486 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-3b1c53ba-cd1a-49fc-96f3-699f20f15153 req-048b0c4c-c795-4065-8812-8bd2c9ffc403 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16620e75-9ac1-4f76-97eb-d4281e2f0d88", "tag": "c81c587a-677a-4762-8cc7-d0cac55df293"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:16:47.174909 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-3b1c53ba-cd1a-49fc-96f3-699f20f15153 req-048b0c4c-c795-4065-8812-8bd2c9ffc403 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:47.175425 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-3b1c53ba-cd1a-49fc-96f3-699f20f15153 req-048b0c4c-c795-4065-8812-8bd2c9ffc403 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:47.176077 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-3b1c53ba-cd1a-49fc-96f3-699f20f15153 req-048b0c4c-c795-4065-8812-8bd2c9ffc403 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:47.190165 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-3b1c53ba-cd1a-49fc-96f3-699f20f15153 req-048b0c4c-c795-4065-8812-8bd2c9ffc403 service nova] Creating event network-changed:c81c587a-677a-4762-8cc7-d0cac55df293 for instance 16620e75-9ac1-4f76-97eb-d4281e2f0d88 on n-h1-master-1 Oct 30 01:16:47.197846 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-3b1c53ba-cd1a-49fc-96f3-699f20f15153 req-048b0c4c-c795-4065-8812-8bd2c9ffc403 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036242 Oct 30 01:16:47.199602 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 489/980] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:16:47.204210 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b843d29c-4fe7-45c6-b7aa-e798219d5686 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:47.205667 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b843d29c-4fe7-45c6-b7aa-e798219d5686 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: e19edf61-5458-4f12-84b2-346b41506ff3] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:47.213447 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b843d29c-4fe7-45c6-b7aa-e798219d5686 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:47.214138 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b843d29c-4fe7-45c6-b7aa-e798219d5686 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:47.214609 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b843d29c-4fe7-45c6-b7aa-e798219d5686 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:47.216905 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b843d29c-4fe7-45c6-b7aa-e798219d5686 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:47.216905 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b843d29c-4fe7-45c6-b7aa-e798219d5686 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:47.216905 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b843d29c-4fe7-45c6-b7aa-e798219d5686 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:47.277172 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e54085c3-8ebd-4137-a0ae-ed72c2cffb3b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "POST /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.047826 Oct 30 01:16:47.278362 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 492/981] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 30 01:16:46 2022] POST /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd/os-volume_attachments => generated 194 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:16:47.298471 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ca5336ec-df64-4574-a8fe-3907f9652220 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:47.298643 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ca5336ec-df64-4574-a8fe-3907f9652220 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] [instance: 1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:47.446220 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b843d29c-4fe7-45c6-b7aa-e798219d5686 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f11109f32d4013aed5ab9320d8295b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e2bdadb00745888a171041c5714bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:47.456909 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b843d29c-4fe7-45c6-b7aa-e798219d5686 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] 10.222.0.13 "GET /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3" status: 200 len: 1323 microversion: 2.1 time: 0.256891 Oct 30 01:16:47.459616 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 490/982] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:47 2022] GET /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3 => generated 1323 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:47.481568 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ca5336ec-df64-4574-a8fe-3907f9652220 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7269dc6d56440ca8691179f7275aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4681ed2d06840f995b37e550323d6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:47.489514 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-f3753aa7-5219-4e01-9abf-00f7d9f8a8bf req-4d1866ff-8029-436f-8715-27ff2255fa69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "773bba47-dab6-4fbb-91a3-c3a447cd5008", "name": "network-vif-plugged", "status": "completed", "tag": "37f0b88d-5907-4ea6-ab74-1b880457b341"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:16:47.491063 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ca5336ec-df64-4574-a8fe-3907f9652220 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] 10.222.0.13 "GET /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1" status: 200 len: 1242 microversion: 2.1 time: 0.202556 Oct 30 01:16:47.505238 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 493/983] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:47 2022] GET /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1 => generated 1242 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:47.514308 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-300e5d16-8a41-497a-b168-e4e7a009caf5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:47.514308 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-300e5d16-8a41-497a-b168-e4e7a009caf5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:47.521579 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-300e5d16-8a41-497a-b168-e4e7a009caf5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:47.522170 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-f3753aa7-5219-4e01-9abf-00f7d9f8a8bf req-4d1866ff-8029-436f-8715-27ff2255fa69 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:47.522577 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-300e5d16-8a41-497a-b168-e4e7a009caf5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:47.522715 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-f3753aa7-5219-4e01-9abf-00f7d9f8a8bf req-4d1866ff-8029-436f-8715-27ff2255fa69 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:47.523143 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-f3753aa7-5219-4e01-9abf-00f7d9f8a8bf req-4d1866ff-8029-436f-8715-27ff2255fa69 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:47.523485 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-300e5d16-8a41-497a-b168-e4e7a009caf5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:47.525497 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-300e5d16-8a41-497a-b168-e4e7a009caf5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:47.526152 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-300e5d16-8a41-497a-b168-e4e7a009caf5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:47.526741 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-300e5d16-8a41-497a-b168-e4e7a009caf5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:47.537405 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:47.554862 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-f3753aa7-5219-4e01-9abf-00f7d9f8a8bf req-4d1866ff-8029-436f-8715-27ff2255fa69 service nova] Creating event network-vif-plugged:37f0b88d-5907-4ea6-ab74-1b880457b341 for instance 773bba47-dab6-4fbb-91a3-c3a447cd5008 on n-h2-master-1 Oct 30 01:16:47.568341 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-f3753aa7-5219-4e01-9abf-00f7d9f8a8bf req-4d1866ff-8029-436f-8715-27ff2255fa69 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106757 Oct 30 01:16:47.568958 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 491/984] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:16:47.687298 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-300e5d16-8a41-497a-b168-e4e7a009caf5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:47.695503 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-300e5d16-8a41-497a-b168-e4e7a009caf5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1312 microversion: 2.1 time: 0.189029 Oct 30 01:16:47.696080 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 494/985] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:47 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1312 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:47.995641 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-753a7ebf-c1b9-4a52-8cab-eef3aae77c16 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:47.996876 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-753a7ebf-c1b9-4a52-8cab-eef3aae77c16 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: 773bba47-dab6-4fbb-91a3-c3a447cd5008] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:48.003187 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-753a7ebf-c1b9-4a52-8cab-eef3aae77c16 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:48.003804 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-753a7ebf-c1b9-4a52-8cab-eef3aae77c16 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:48.004305 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-753a7ebf-c1b9-4a52-8cab-eef3aae77c16 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:48.005098 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-753a7ebf-c1b9-4a52-8cab-eef3aae77c16 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:48.005637 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-753a7ebf-c1b9-4a52-8cab-eef3aae77c16 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:48.006123 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-753a7ebf-c1b9-4a52-8cab-eef3aae77c16 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:48.155063 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-753a7ebf-c1b9-4a52-8cab-eef3aae77c16 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:48.163579 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-753a7ebf-c1b9-4a52-8cab-eef3aae77c16 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/773bba47-dab6-4fbb-91a3-c3a447cd5008" status: 200 len: 1313 microversion: 2.1 time: 0.173042 Oct 30 01:16:48.173630 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 492/986] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:47 2022] GET /compute/v2.1/servers/773bba47-dab6-4fbb-91a3-c3a447cd5008 => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:48.185565 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4e7c7915-1eff-4329-85c0-74c66087f87a tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:48.186452 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4e7c7915-1eff-4329-85c0-74c66087f87a tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: d1fee870-9d6d-4086-9138-4a9709e2d26c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:48.193825 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4e7c7915-1eff-4329-85c0-74c66087f87a tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:48.194600 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4e7c7915-1eff-4329-85c0-74c66087f87a tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:48.195072 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4e7c7915-1eff-4329-85c0-74c66087f87a tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:48.195950 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4e7c7915-1eff-4329-85c0-74c66087f87a tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:48.196412 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4e7c7915-1eff-4329-85c0-74c66087f87a tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:48.196835 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4e7c7915-1eff-4329-85c0-74c66087f87a tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:48.415572 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4e7c7915-1eff-4329-85c0-74c66087f87a tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:48.426009 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4e7c7915-1eff-4329-85c0-74c66087f87a tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/d1fee870-9d6d-4086-9138-4a9709e2d26c" status: 200 len: 1318 microversion: 2.1 time: 0.244182 Oct 30 01:16:48.451874 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 495/987] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:48 2022] GET /compute/v2.1/servers/d1fee870-9d6d-4086-9138-4a9709e2d26c => generated 1318 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:48.485290 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2cf16383-644c-4963-b729-01f276334222 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:48.486500 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2cf16383-644c-4963-b729-01f276334222 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: e19edf61-5458-4f12-84b2-346b41506ff3] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:48.507961 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2cf16383-644c-4963-b729-01f276334222 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:48.508641 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2cf16383-644c-4963-b729-01f276334222 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:48.509080 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2cf16383-644c-4963-b729-01f276334222 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:48.509860 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2cf16383-644c-4963-b729-01f276334222 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:48.510497 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2cf16383-644c-4963-b729-01f276334222 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:48.511118 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2cf16383-644c-4963-b729-01f276334222 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:48.521929 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1544fc5c-9f21-4111-bf0e-41a3e26f59c9 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:48.522168 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1544fc5c-9f21-4111-bf0e-41a3e26f59c9 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] [instance: 1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:48.533148 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1544fc5c-9f21-4111-bf0e-41a3e26f59c9 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:48.534654 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1544fc5c-9f21-4111-bf0e-41a3e26f59c9 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:48.535134 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1544fc5c-9f21-4111-bf0e-41a3e26f59c9 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:48.535989 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1544fc5c-9f21-4111-bf0e-41a3e26f59c9 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:48.537911 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1544fc5c-9f21-4111-bf0e-41a3e26f59c9 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:48.539685 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1544fc5c-9f21-4111-bf0e-41a3e26f59c9 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:48.647589 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1544fc5c-9f21-4111-bf0e-41a3e26f59c9 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7269dc6d56440ca8691179f7275aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4681ed2d06840f995b37e550323d6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:48.658266 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1544fc5c-9f21-4111-bf0e-41a3e26f59c9 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] 10.222.0.13 "GET /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1" status: 200 len: 1246 microversion: 2.1 time: 0.141447 Oct 30 01:16:48.658866 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 496/988] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:48 2022] GET /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1 => generated 1246 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:48.719304 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d2d751cb-e2a5-45d6-94fe-68851f189385 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:48.720302 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d2d751cb-e2a5-45d6-94fe-68851f189385 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:48.726951 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d2d751cb-e2a5-45d6-94fe-68851f189385 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:48.727147 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2cf16383-644c-4963-b729-01f276334222 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f11109f32d4013aed5ab9320d8295b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e2bdadb00745888a171041c5714bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:48.727880 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d2d751cb-e2a5-45d6-94fe-68851f189385 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:48.728724 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d2d751cb-e2a5-45d6-94fe-68851f189385 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:48.729806 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d2d751cb-e2a5-45d6-94fe-68851f189385 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:48.730497 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d2d751cb-e2a5-45d6-94fe-68851f189385 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:48.731142 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d2d751cb-e2a5-45d6-94fe-68851f189385 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:48.738499 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2cf16383-644c-4963-b729-01f276334222 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] 10.222.0.13 "GET /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3" status: 200 len: 1323 microversion: 2.1 time: 0.256935 Oct 30 01:16:48.756257 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 493/989] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:48 2022] GET /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3 => generated 1323 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:48.939697 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d2d751cb-e2a5-45d6-94fe-68851f189385 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:48.950180 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d2d751cb-e2a5-45d6-94fe-68851f189385 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1312 microversion: 2.1 time: 0.234620 Oct 30 01:16:48.950775 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 497/990] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:48 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1312 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:49.188917 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5bcb9cfa-04e3-4ef5-a7c6-368fe1abdbd1 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:49.190020 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5bcb9cfa-04e3-4ef5-a7c6-368fe1abdbd1 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: 773bba47-dab6-4fbb-91a3-c3a447cd5008] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:49.200171 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5bcb9cfa-04e3-4ef5-a7c6-368fe1abdbd1 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:49.201031 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5bcb9cfa-04e3-4ef5-a7c6-368fe1abdbd1 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:49.201808 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5bcb9cfa-04e3-4ef5-a7c6-368fe1abdbd1 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:49.202705 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5bcb9cfa-04e3-4ef5-a7c6-368fe1abdbd1 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:49.203310 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5bcb9cfa-04e3-4ef5-a7c6-368fe1abdbd1 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:49.204103 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5bcb9cfa-04e3-4ef5-a7c6-368fe1abdbd1 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:49.303508 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-dc265a2a-3d0d-4ea7-9a5d-bf4f4ceb705b req-75c83b25-bd80-4bb6-bfca-b1d947f3b334 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1fee870-9d6d-4086-9138-4a9709e2d26c", "tag": "17d00fc2-d99f-4ce9-a60f-4718f0b667da"}, {"name": "network-changed", "server_uuid": "e19edf61-5458-4f12-84b2-346b41506ff3", "tag": "dfced65c-3e28-40bf-b025-33cddcb37142"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:16:49.318459 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-dc265a2a-3d0d-4ea7-9a5d-bf4f4ceb705b req-75c83b25-bd80-4bb6-bfca-b1d947f3b334 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:49.319189 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-dc265a2a-3d0d-4ea7-9a5d-bf4f4ceb705b req-75c83b25-bd80-4bb6-bfca-b1d947f3b334 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:49.319796 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-dc265a2a-3d0d-4ea7-9a5d-bf4f4ceb705b req-75c83b25-bd80-4bb6-bfca-b1d947f3b334 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:49.336109 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-dc265a2a-3d0d-4ea7-9a5d-bf4f4ceb705b req-75c83b25-bd80-4bb6-bfca-b1d947f3b334 service nova] Creating event network-changed:17d00fc2-d99f-4ce9-a60f-4718f0b667da for instance d1fee870-9d6d-4086-9138-4a9709e2d26c on n-h2-master-1 Oct 30 01:16:49.336898 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-dc265a2a-3d0d-4ea7-9a5d-bf4f4ceb705b req-75c83b25-bd80-4bb6-bfca-b1d947f3b334 service nova] Creating event network-changed:dfced65c-3e28-40bf-b025-33cddcb37142 for instance e19edf61-5458-4f12-84b2-346b41506ff3 on n-h1-master-1 Oct 30 01:16:49.347630 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-dc265a2a-3d0d-4ea7-9a5d-bf4f4ceb705b req-75c83b25-bd80-4bb6-bfca-b1d947f3b334 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.051429 Oct 30 01:16:49.349076 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 498/991] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:16:49 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:16:49.458900 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-79856db3-bf4c-401c-99ed-9ab66b0fb0c2 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:49.467220 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-79856db3-bf4c-401c-99ed-9ab66b0fb0c2 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: d1fee870-9d6d-4086-9138-4a9709e2d26c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:49.475377 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:49.478091 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-79856db3-bf4c-401c-99ed-9ab66b0fb0c2 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:49.478842 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-79856db3-bf4c-401c-99ed-9ab66b0fb0c2 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:49.479983 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-79856db3-bf4c-401c-99ed-9ab66b0fb0c2 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:49.481095 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-79856db3-bf4c-401c-99ed-9ab66b0fb0c2 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:49.482293 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-79856db3-bf4c-401c-99ed-9ab66b0fb0c2 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:49.483156 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-79856db3-bf4c-401c-99ed-9ab66b0fb0c2 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:49.680217 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5bcb9cfa-04e3-4ef5-a7c6-368fe1abdbd1 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:49.709607 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5bcb9cfa-04e3-4ef5-a7c6-368fe1abdbd1 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/773bba47-dab6-4fbb-91a3-c3a447cd5008" status: 200 len: 1313 microversion: 2.1 time: 0.523785 Oct 30 01:16:49.713454 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 494/992] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:49 2022] GET /compute/v2.1/servers/773bba47-dab6-4fbb-91a3-c3a447cd5008 => generated 1313 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:49.733681 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-50476a10-8d97-4e8f-8bab-7a47671a684f tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:49.734403 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-50476a10-8d97-4e8f-8bab-7a47671a684f tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] [instance: 1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:49.751143 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-50476a10-8d97-4e8f-8bab-7a47671a684f tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:49.751848 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-50476a10-8d97-4e8f-8bab-7a47671a684f tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:49.756494 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-50476a10-8d97-4e8f-8bab-7a47671a684f tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:49.756494 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-50476a10-8d97-4e8f-8bab-7a47671a684f tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:49.756494 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-50476a10-8d97-4e8f-8bab-7a47671a684f tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:49.756494 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-50476a10-8d97-4e8f-8bab-7a47671a684f tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:49.766687 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-79856db3-bf4c-401c-99ed-9ab66b0fb0c2 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:49.776742 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-79856db3-bf4c-401c-99ed-9ab66b0fb0c2 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/d1fee870-9d6d-4086-9138-4a9709e2d26c" status: 200 len: 1318 microversion: 2.1 time: 0.323825 Oct 30 01:16:49.778721 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 499/993] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:49 2022] GET /compute/v2.1/servers/d1fee870-9d6d-4086-9138-4a9709e2d26c => generated 1318 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:49.794535 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-940af9d3-c805-46e5-b8df-325e174872ec tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:49.796219 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-940af9d3-c805-46e5-b8df-325e174872ec tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: e19edf61-5458-4f12-84b2-346b41506ff3] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:49.805637 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-940af9d3-c805-46e5-b8df-325e174872ec tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:49.806240 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-940af9d3-c805-46e5-b8df-325e174872ec tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:49.806682 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-940af9d3-c805-46e5-b8df-325e174872ec tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:49.807389 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-940af9d3-c805-46e5-b8df-325e174872ec tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:49.807834 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-940af9d3-c805-46e5-b8df-325e174872ec tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:49.809841 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-940af9d3-c805-46e5-b8df-325e174872ec tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:49.819117 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:49.877310 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-50476a10-8d97-4e8f-8bab-7a47671a684f tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7269dc6d56440ca8691179f7275aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4681ed2d06840f995b37e550323d6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:49.891131 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-50476a10-8d97-4e8f-8bab-7a47671a684f tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] 10.222.0.13 "GET /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1" status: 200 len: 1294 microversion: 2.1 time: 0.172936 Oct 30 01:16:49.912441 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 495/994] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:49 2022] GET /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1 => generated 1294 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:49.974780 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-037afdbb-8c62-43e9-a5eb-ac52904610ed tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:49.975475 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-037afdbb-8c62-43e9-a5eb-ac52904610ed tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:49.993425 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-037afdbb-8c62-43e9-a5eb-ac52904610ed tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:49.993968 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-037afdbb-8c62-43e9-a5eb-ac52904610ed tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:49.994425 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-037afdbb-8c62-43e9-a5eb-ac52904610ed tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:49.995277 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-037afdbb-8c62-43e9-a5eb-ac52904610ed tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:49.995634 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-037afdbb-8c62-43e9-a5eb-ac52904610ed tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:49.998282 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-037afdbb-8c62-43e9-a5eb-ac52904610ed tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:50.201253 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-940af9d3-c805-46e5-b8df-325e174872ec tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f11109f32d4013aed5ab9320d8295b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e2bdadb00745888a171041c5714bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:50.210104 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-940af9d3-c805-46e5-b8df-325e174872ec tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] 10.222.0.13 "GET /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3" status: 200 len: 1323 microversion: 2.1 time: 0.428966 Oct 30 01:16:50.211310 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 500/995] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:49 2022] GET /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3 => generated 1323 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:50.274589 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-037afdbb-8c62-43e9-a5eb-ac52904610ed tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:50.282773 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-037afdbb-8c62-43e9-a5eb-ac52904610ed tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1312 microversion: 2.1 time: 0.313478 Oct 30 01:16:50.283437 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 496/996] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:49 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1312 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:16:50.738280 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c58729f5-1a05-422d-9ade-47aff060bea7 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:50.738949 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c58729f5-1a05-422d-9ade-47aff060bea7 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: 773bba47-dab6-4fbb-91a3-c3a447cd5008] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:50.747168 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c58729f5-1a05-422d-9ade-47aff060bea7 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:50.747862 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c58729f5-1a05-422d-9ade-47aff060bea7 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:50.748294 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c58729f5-1a05-422d-9ade-47aff060bea7 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:50.748991 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c58729f5-1a05-422d-9ade-47aff060bea7 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:50.749557 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c58729f5-1a05-422d-9ade-47aff060bea7 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:50.749874 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c58729f5-1a05-422d-9ade-47aff060bea7 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:50.803185 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3f0a885f-e32f-48a6-af68-6908aef4a22d tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:50.804777 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3f0a885f-e32f-48a6-af68-6908aef4a22d tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: d1fee870-9d6d-4086-9138-4a9709e2d26c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:50.816488 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f0a885f-e32f-48a6-af68-6908aef4a22d tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:50.818044 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f0a885f-e32f-48a6-af68-6908aef4a22d tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:50.818817 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f0a885f-e32f-48a6-af68-6908aef4a22d tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:50.819776 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f0a885f-e32f-48a6-af68-6908aef4a22d tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:50.820465 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f0a885f-e32f-48a6-af68-6908aef4a22d tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:50.821092 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f0a885f-e32f-48a6-af68-6908aef4a22d tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:51.017069 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c58729f5-1a05-422d-9ade-47aff060bea7 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:51.034679 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c58729f5-1a05-422d-9ade-47aff060bea7 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/773bba47-dab6-4fbb-91a3-c3a447cd5008" status: 200 len: 1463 microversion: 2.1 time: 0.295271 Oct 30 01:16:51.050933 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 501/997] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:50 2022] GET /compute/v2.1/servers/773bba47-dab6-4fbb-91a3-c3a447cd5008 => generated 1463 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:51.060400 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-38cb1d38-6c4b-4a21-a142-8fcb91f2e810 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:51.061986 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-38cb1d38-6c4b-4a21-a142-8fcb91f2e810 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] [instance: 1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:51.071891 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3f0a885f-e32f-48a6-af68-6908aef4a22d tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:51.075890 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38cb1d38-6c4b-4a21-a142-8fcb91f2e810 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:51.076487 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38cb1d38-6c4b-4a21-a142-8fcb91f2e810 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:51.076926 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38cb1d38-6c4b-4a21-a142-8fcb91f2e810 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:51.077668 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38cb1d38-6c4b-4a21-a142-8fcb91f2e810 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:51.078317 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38cb1d38-6c4b-4a21-a142-8fcb91f2e810 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:51.078910 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38cb1d38-6c4b-4a21-a142-8fcb91f2e810 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:51.080746 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3f0a885f-e32f-48a6-af68-6908aef4a22d tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/d1fee870-9d6d-4086-9138-4a9709e2d26c" status: 200 len: 1318 microversion: 2.1 time: 0.281893 Oct 30 01:16:51.081625 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 497/998] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:50 2022] GET /compute/v2.1/servers/d1fee870-9d6d-4086-9138-4a9709e2d26c => generated 1318 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:51.181190 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-38cb1d38-6c4b-4a21-a142-8fcb91f2e810 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7269dc6d56440ca8691179f7275aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4681ed2d06840f995b37e550323d6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:51.192098 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-38cb1d38-6c4b-4a21-a142-8fcb91f2e810 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] 10.222.0.13 "GET /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1" status: 200 len: 1302 microversion: 2.1 time: 0.136224 Oct 30 01:16:51.192757 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 502/999] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:51 2022] GET /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1 => generated 1302 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:51.236082 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-641b6303-a641-4318-a100-cfd6456bb194 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:51.236729 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-641b6303-a641-4318-a100-cfd6456bb194 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: e19edf61-5458-4f12-84b2-346b41506ff3] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:51.265878 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-641b6303-a641-4318-a100-cfd6456bb194 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:51.268103 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-641b6303-a641-4318-a100-cfd6456bb194 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:51.268594 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-641b6303-a641-4318-a100-cfd6456bb194 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:51.271502 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-641b6303-a641-4318-a100-cfd6456bb194 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:51.272027 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-641b6303-a641-4318-a100-cfd6456bb194 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:51.272472 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-641b6303-a641-4318-a100-cfd6456bb194 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:51.487320 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-641b6303-a641-4318-a100-cfd6456bb194 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f11109f32d4013aed5ab9320d8295b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e2bdadb00745888a171041c5714bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:51.495996 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-641b6303-a641-4318-a100-cfd6456bb194 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] 10.222.0.13 "GET /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3" status: 200 len: 1323 microversion: 2.1 time: 0.263932 Oct 30 01:16:51.506200 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 503/1000] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:51 2022] GET /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3 => generated 1323 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:51.516659 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-28035147-e00e-431a-9a5e-ec915bf45f34 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:51.517908 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-28035147-e00e-431a-9a5e-ec915bf45f34 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:51.530728 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-28035147-e00e-431a-9a5e-ec915bf45f34 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:51.531459 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-28035147-e00e-431a-9a5e-ec915bf45f34 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:51.531904 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-28035147-e00e-431a-9a5e-ec915bf45f34 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:51.532598 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-28035147-e00e-431a-9a5e-ec915bf45f34 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:51.533038 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-28035147-e00e-431a-9a5e-ec915bf45f34 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:51.533484 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-28035147-e00e-431a-9a5e-ec915bf45f34 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:51.598416 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-244a92ff-69b9-4ad9-991c-596749dac3f4 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:51.623849 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-244a92ff-69b9-4ad9-991c-596749dac3f4 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Searching by: {'deleted': False, 'project_id': 'c10bd75c265f49afb096a2b57616b71e'} {{(pid=121102) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 30 01:16:51.644020 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-244a92ff-69b9-4ad9-991c-596749dac3f4 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:51.644498 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-244a92ff-69b9-4ad9-991c-596749dac3f4 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:51.644968 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-244a92ff-69b9-4ad9-991c-596749dac3f4 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:51.660535 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-244a92ff-69b9-4ad9-991c-596749dac3f4 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:51.663045 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-244a92ff-69b9-4ad9-991c-596749dac3f4 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:51.663506 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-244a92ff-69b9-4ad9-991c-596749dac3f4 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:51.755095 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-28035147-e00e-431a-9a5e-ec915bf45f34 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:51.771110 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-28035147-e00e-431a-9a5e-ec915bf45f34 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1312 microversion: 2.1 time: 0.262549 Oct 30 01:16:51.772454 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 504/1001] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:51 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1312 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:51.864712 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-244a92ff-69b9-4ad9-991c-596749dac3f4 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.764849 Oct 30 01:16:51.866476 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 498/1002] 10.222.0.13 () {58 vars in 1146 bytes} [Sun Oct 30 01:16:51 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:16:51.893864 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e2024c90-a2cf-4683-bc57-b44f34c60589 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:51.912244 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e2024c90-a2cf-4683-bc57-b44f34c60589 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Searching by: {'deleted': False} {{(pid=121103) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 30 01:16:51.922862 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2024c90-a2cf-4683-bc57-b44f34c60589 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:51.923756 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2024c90-a2cf-4683-bc57-b44f34c60589 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:51.924441 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2024c90-a2cf-4683-bc57-b44f34c60589 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:51.925681 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2024c90-a2cf-4683-bc57-b44f34c60589 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:51.927022 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2024c90-a2cf-4683-bc57-b44f34c60589 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:51.927885 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2024c90-a2cf-4683-bc57-b44f34c60589 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:52.066100 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.multi_cell_list [None req-e2024c90-a2cf-4683-bc57-b44f34c60589 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Listed batch of 18 results from cell out of 1000 limit. Returned 18 total so far. {{(pid=121103) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 30 01:16:52.108040 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-eb85dbe6-0293-42ba-9c6a-c415eef496e8 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:52.108751 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-eb85dbe6-0293-42ba-9c6a-c415eef496e8 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: d1fee870-9d6d-4086-9138-4a9709e2d26c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:52.115941 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eb85dbe6-0293-42ba-9c6a-c415eef496e8 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:52.122434 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eb85dbe6-0293-42ba-9c6a-c415eef496e8 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:52.123187 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eb85dbe6-0293-42ba-9c6a-c415eef496e8 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:52.124103 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eb85dbe6-0293-42ba-9c6a-c415eef496e8 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:52.138059 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eb85dbe6-0293-42ba-9c6a-c415eef496e8 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:52.138285 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eb85dbe6-0293-42ba-9c6a-c415eef496e8 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:52.162037 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=37 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:52.195211 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2024c90-a2cf-4683-bc57-b44f34c60589 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:52.196411 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2024c90-a2cf-4683-bc57-b44f34c60589 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:52.197152 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2024c90-a2cf-4683-bc57-b44f34c60589 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:52.394747 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-eb85dbe6-0293-42ba-9c6a-c415eef496e8 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:52.410011 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-eb85dbe6-0293-42ba-9c6a-c415eef496e8 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/d1fee870-9d6d-4086-9138-4a9709e2d26c" status: 200 len: 1318 microversion: 2.1 time: 0.303761 Oct 30 01:16:52.410011 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 499/1003] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:52 2022] GET /compute/v2.1/servers/d1fee870-9d6d-4086-9138-4a9709e2d26c => generated 1318 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:16:52.414455 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-047aa5b7-83c1-416d-8890-fee3e7d5039e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:52.415402 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-047aa5b7-83c1-416d-8890-fee3e7d5039e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] [instance: 1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:52.423631 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-047aa5b7-83c1-416d-8890-fee3e7d5039e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:52.424458 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-047aa5b7-83c1-416d-8890-fee3e7d5039e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:52.425291 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-047aa5b7-83c1-416d-8890-fee3e7d5039e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:52.431049 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-047aa5b7-83c1-416d-8890-fee3e7d5039e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:52.434254 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-047aa5b7-83c1-416d-8890-fee3e7d5039e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:52.438293 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-047aa5b7-83c1-416d-8890-fee3e7d5039e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:52.550763 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-047aa5b7-83c1-416d-8890-fee3e7d5039e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7269dc6d56440ca8691179f7275aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4681ed2d06840f995b37e550323d6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:52.562479 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-047aa5b7-83c1-416d-8890-fee3e7d5039e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] 10.222.0.13 "GET /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1" status: 200 len: 1312 microversion: 2.1 time: 0.155916 Oct 30 01:16:52.580827 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 500/1004] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:52 2022] GET /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1 => generated 1312 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:52.586824 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bb1eb512-d95e-4f50-b0e3-8f9e117cc43a tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:52.587658 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bb1eb512-d95e-4f50-b0e3-8f9e117cc43a tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: e19edf61-5458-4f12-84b2-346b41506ff3] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:52.594133 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb1eb512-d95e-4f50-b0e3-8f9e117cc43a tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:52.594626 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb1eb512-d95e-4f50-b0e3-8f9e117cc43a tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:52.595206 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb1eb512-d95e-4f50-b0e3-8f9e117cc43a tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:52.595925 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb1eb512-d95e-4f50-b0e3-8f9e117cc43a tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:52.596379 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb1eb512-d95e-4f50-b0e3-8f9e117cc43a tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:52.596803 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb1eb512-d95e-4f50-b0e3-8f9e117cc43a tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:52.841655 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bb1eb512-d95e-4f50-b0e3-8f9e117cc43a tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f11109f32d4013aed5ab9320d8295b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e2bdadb00745888a171041c5714bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:52.851477 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bb1eb512-d95e-4f50-b0e3-8f9e117cc43a tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] 10.222.0.13 "GET /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3" status: 200 len: 1323 microversion: 2.1 time: 0.269384 Oct 30 01:16:52.852655 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 501/1005] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:52 2022] GET /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3 => generated 1323 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:52.858348 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-396d4185-ec8d-4540-9108-abebf2822464 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:52.859551 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-396d4185-ec8d-4540-9108-abebf2822464 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:52.869629 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-396d4185-ec8d-4540-9108-abebf2822464 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:52.870836 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-396d4185-ec8d-4540-9108-abebf2822464 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:52.871789 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-396d4185-ec8d-4540-9108-abebf2822464 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:52.872723 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-396d4185-ec8d-4540-9108-abebf2822464 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:52.873400 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-396d4185-ec8d-4540-9108-abebf2822464 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:52.880095 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-396d4185-ec8d-4540-9108-abebf2822464 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:53.067676 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e2024c90-a2cf-4683-bc57-b44f34c60589 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 28761 microversion: 2.1 time: 1.178982 Oct 30 01:16:53.068379 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 505/1006] 10.222.0.13 () {58 vars in 1171 bytes} [Sun Oct 30 01:16:51 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 28761 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:16:53.138181 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-abc61bc4-c199-4cdf-be5d-b76279aa744e tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:53.143354 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-abc61bc4-c199-4cdf-be5d-b76279aa744e tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Searching by: {'deleted': False, 'project_id': 'c10bd75c265f49afb096a2b57616b71e'} {{(pid=121103) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 30 01:16:53.153717 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-abc61bc4-c199-4cdf-be5d-b76279aa744e tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:53.162340 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-abc61bc4-c199-4cdf-be5d-b76279aa744e tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:53.164631 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-abc61bc4-c199-4cdf-be5d-b76279aa744e tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:53.165653 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-abc61bc4-c199-4cdf-be5d-b76279aa744e tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:53.168740 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-abc61bc4-c199-4cdf-be5d-b76279aa744e tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:53.170085 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-abc61bc4-c199-4cdf-be5d-b76279aa744e tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:53.227897 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-396d4185-ec8d-4540-9108-abebf2822464 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:53.243533 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-396d4185-ec8d-4540-9108-abebf2822464 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1312 microversion: 2.1 time: 0.387949 Oct 30 01:16:53.257208 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 502/1007] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:52 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1312 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:53.322125 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-abc61bc4-c199-4cdf-be5d-b76279aa744e tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/detail?tenant_id=b90a3225f0bb4bb6a90847078c27720d" status: 200 len: 15 microversion: 2.1 time: 0.187508 Oct 30 01:16:53.326814 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 506/1008] 10.222.0.13 () {58 vars in 1231 bytes} [Sun Oct 30 01:16:53 2022] GET /compute/v2.1/servers/detail?tenant_id=b90a3225f0bb4bb6a90847078c27720d => generated 15 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:16:53.348071 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-836a9ec5-73d6-45a5-847e-a385b442f971 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:53.367745 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-836a9ec5-73d6-45a5-847e-a385b442f971 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Searching by: {'tenant_id': 'b90a3225f0bb4bb6a90847078c27720d', 'deleted': False} {{(pid=121102) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 30 01:16:53.389830 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-836a9ec5-73d6-45a5-847e-a385b442f971 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:53.390314 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-836a9ec5-73d6-45a5-847e-a385b442f971 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:53.400398 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-836a9ec5-73d6-45a5-847e-a385b442f971 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:53.412340 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-836a9ec5-73d6-45a5-847e-a385b442f971 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:53.412340 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-836a9ec5-73d6-45a5-847e-a385b442f971 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:53.412340 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-836a9ec5-73d6-45a5-847e-a385b442f971 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:53.445377 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-53fb5c5a-292f-4d81-9170-899b4af61158 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:53.447781 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-53fb5c5a-292f-4d81-9170-899b4af61158 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: d1fee870-9d6d-4086-9138-4a9709e2d26c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:53.453282 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.multi_cell_list [None req-836a9ec5-73d6-45a5-847e-a385b442f971 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121102) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 30 01:16:53.479212 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-53fb5c5a-292f-4d81-9170-899b4af61158 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:53.480765 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-53fb5c5a-292f-4d81-9170-899b4af61158 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:53.482052 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-53fb5c5a-292f-4d81-9170-899b4af61158 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:53.484076 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-53fb5c5a-292f-4d81-9170-899b4af61158 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:53.485215 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-53fb5c5a-292f-4d81-9170-899b4af61158 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:53.488450 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-53fb5c5a-292f-4d81-9170-899b4af61158 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:53.638959 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=37 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:53.673456 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-836a9ec5-73d6-45a5-847e-a385b442f971 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:53.674242 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-836a9ec5-73d6-45a5-847e-a385b442f971 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:53.674696 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-836a9ec5-73d6-45a5-847e-a385b442f971 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:53.763785 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-53fb5c5a-292f-4d81-9170-899b4af61158 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:53.773108 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-53fb5c5a-292f-4d81-9170-899b4af61158 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/d1fee870-9d6d-4086-9138-4a9709e2d26c" status: 200 len: 1318 microversion: 2.1 time: 0.345219 Oct 30 01:16:53.786595 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 507/1009] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:53 2022] GET /compute/v2.1/servers/d1fee870-9d6d-4086-9138-4a9709e2d26c => generated 1318 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:53.794910 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-80c3d6a9-dbe6-4882-9d6a-f321f127388e req-283b3e7e-557f-4203-8059-1edacfadd62e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76c32172-798a-49f6-8247-6f86860dbdc5", "name": "network-vif-plugged", "status": "completed", "tag": "e96e6262-0ade-4db0-aeff-c6471cd42e45"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:16:53.806085 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-80c3d6a9-dbe6-4882-9d6a-f321f127388e req-283b3e7e-557f-4203-8059-1edacfadd62e service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:53.807215 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-80c3d6a9-dbe6-4882-9d6a-f321f127388e req-283b3e7e-557f-4203-8059-1edacfadd62e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:53.807829 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-80c3d6a9-dbe6-4882-9d6a-f321f127388e req-283b3e7e-557f-4203-8059-1edacfadd62e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:53.820818 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-80c3d6a9-dbe6-4882-9d6a-f321f127388e req-283b3e7e-557f-4203-8059-1edacfadd62e service nova] Creating event network-vif-plugged:e96e6262-0ade-4db0-aeff-c6471cd42e45 for instance 76c32172-798a-49f6-8247-6f86860dbdc5 on n-h1-master-1 Oct 30 01:16:53.828143 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-80c3d6a9-dbe6-4882-9d6a-f321f127388e req-283b3e7e-557f-4203-8059-1edacfadd62e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039959 Oct 30 01:16:53.828743 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 508/1010] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:16:53.833932 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-21a475f8-20f3-4dfa-84fa-f57506307f8e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:53.834628 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-21a475f8-20f3-4dfa-84fa-f57506307f8e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] [instance: 1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:53.841430 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21a475f8-20f3-4dfa-84fa-f57506307f8e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:53.842200 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21a475f8-20f3-4dfa-84fa-f57506307f8e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:53.842786 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21a475f8-20f3-4dfa-84fa-f57506307f8e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:53.843681 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21a475f8-20f3-4dfa-84fa-f57506307f8e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:53.844234 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21a475f8-20f3-4dfa-84fa-f57506307f8e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:53.845421 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21a475f8-20f3-4dfa-84fa-f57506307f8e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:53.921634 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-21a475f8-20f3-4dfa-84fa-f57506307f8e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7269dc6d56440ca8691179f7275aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4681ed2d06840f995b37e550323d6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:53.934227 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-21a475f8-20f3-4dfa-84fa-f57506307f8e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] 10.222.0.13 "GET /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1" status: 200 len: 1300 microversion: 2.1 time: 0.103717 Oct 30 01:16:53.935529 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 509/1011] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:53 2022] GET /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1 => generated 1300 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:53.944017 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-354cb79e-5b6d-4709-8c07-55e502ea250c tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:53.946708 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-354cb79e-5b6d-4709-8c07-55e502ea250c tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: e19edf61-5458-4f12-84b2-346b41506ff3] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:53.962729 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-354cb79e-5b6d-4709-8c07-55e502ea250c tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:53.963605 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-354cb79e-5b6d-4709-8c07-55e502ea250c tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:53.964471 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-354cb79e-5b6d-4709-8c07-55e502ea250c tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:53.965465 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-354cb79e-5b6d-4709-8c07-55e502ea250c tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:53.966135 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-354cb79e-5b6d-4709-8c07-55e502ea250c tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:53.966772 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-354cb79e-5b6d-4709-8c07-55e502ea250c tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:53.997502 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-836a9ec5-73d6-45a5-847e-a385b442f971 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=b90a3225f0bb4bb6a90847078c27720d" status: 200 len: 4826 microversion: 2.1 time: 0.653144 Oct 30 01:16:53.998534 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 503/1012] 10.222.0.13 () {58 vars in 1257 bytes} [Sun Oct 30 01:16:53 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=b90a3225f0bb4bb6a90847078c27720d => generated 4826 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:54.030579 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5f4dc0de-519d-40af-804c-e58e96fe8e6f tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:54.037781 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5f4dc0de-519d-40af-804c-e58e96fe8e6f tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Searching by: {'tenant_id': 'c10bd75c265f49afb096a2b57616b71e', 'deleted': False} {{(pid=121102) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 30 01:16:54.064315 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f4dc0de-519d-40af-804c-e58e96fe8e6f tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:54.065260 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f4dc0de-519d-40af-804c-e58e96fe8e6f tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:54.065947 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f4dc0de-519d-40af-804c-e58e96fe8e6f tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:54.067119 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f4dc0de-519d-40af-804c-e58e96fe8e6f tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:54.068092 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f4dc0de-519d-40af-804c-e58e96fe8e6f tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:54.068930 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f4dc0de-519d-40af-804c-e58e96fe8e6f tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:54.135363 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5f4dc0de-519d-40af-804c-e58e96fe8e6f tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=c10bd75c265f49afb096a2b57616b71e" status: 200 len: 15 microversion: 2.1 time: 0.105864 Oct 30 01:16:54.137007 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 504/1013] 10.222.0.13 () {58 vars in 1257 bytes} [Sun Oct 30 01:16:54 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=c10bd75c265f49afb096a2b57616b71e => generated 15 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 30 01:16:54.160485 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e5d82985-1126-44aa-bb51-fed0a8364d30 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:54.166970 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e5d82985-1126-44aa-bb51-fed0a8364d30 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.010562 Oct 30 01:16:54.183737 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 505/1014] 10.222.0.13 () {58 vars in 1189 bytes} [Sun Oct 30 01:16:54 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 30 01:16:54.190886 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f351cf49-ec3b-4968-80d7-bab80f3aa79a tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:16:54.193623 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f351cf49-ec3b-4968-80d7-bab80f3aa79a tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:54.209064 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f351cf49-ec3b-4968-80d7-bab80f3aa79a tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:54.209766 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f351cf49-ec3b-4968-80d7-bab80f3aa79a tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:54.210310 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f351cf49-ec3b-4968-80d7-bab80f3aa79a tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:54.211152 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f351cf49-ec3b-4968-80d7-bab80f3aa79a tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:54.211708 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f351cf49-ec3b-4968-80d7-bab80f3aa79a tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:54.212232 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f351cf49-ec3b-4968-80d7-bab80f3aa79a tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:54.241628 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-354cb79e-5b6d-4709-8c07-55e502ea250c tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f11109f32d4013aed5ab9320d8295b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e2bdadb00745888a171041c5714bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:54.254174 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-354cb79e-5b6d-4709-8c07-55e502ea250c tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] 10.222.0.13 "GET /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3" status: 200 len: 1323 microversion: 2.1 time: 0.313741 Oct 30 01:16:54.255691 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 510/1015] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:53 2022] GET /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3 => generated 1323 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:54.282367 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cce9beea-cb17-41a6-9727-83db0d6a742d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:54.282982 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-cce9beea-cb17-41a6-9727-83db0d6a742d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:54.290882 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cce9beea-cb17-41a6-9727-83db0d6a742d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:54.291369 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cce9beea-cb17-41a6-9727-83db0d6a742d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:54.294140 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cce9beea-cb17-41a6-9727-83db0d6a742d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:54.297511 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cce9beea-cb17-41a6-9727-83db0d6a742d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:54.297511 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cce9beea-cb17-41a6-9727-83db0d6a742d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:54.297511 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cce9beea-cb17-41a6-9727-83db0d6a742d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:54.506399 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-cce9beea-cb17-41a6-9727-83db0d6a742d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:54.515535 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cce9beea-cb17-41a6-9727-83db0d6a742d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1312 microversion: 2.1 time: 0.237114 Oct 30 01:16:54.516489 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 511/1016] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:54 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1312 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:54.595197 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f351cf49-ec3b-4968-80d7-bab80f3aa79a tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9/action" status: 202 len: 0 microversion: 2.1 time: 0.408080 Oct 30 01:16:54.597547 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 506/1017] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:16:54 2022] POST /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9/action => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 30 01:16:54.614546 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5f742916-433f-4e91-88f8-e7b7e07f5553 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:54.619996 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5f742916-433f-4e91-88f8-e7b7e07f5553 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:54.620804 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5f742916-433f-4e91-88f8-e7b7e07f5553 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d'} {{(pid=121103) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 30 01:16:54.628807 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f742916-433f-4e91-88f8-e7b7e07f5553 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:54.629375 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f742916-433f-4e91-88f8-e7b7e07f5553 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:54.632684 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f742916-433f-4e91-88f8-e7b7e07f5553 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:54.632684 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f742916-433f-4e91-88f8-e7b7e07f5553 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:54.632684 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f742916-433f-4e91-88f8-e7b7e07f5553 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:54.632684 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f742916-433f-4e91-88f8-e7b7e07f5553 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:54.740819 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.multi_cell_list [None req-5f742916-433f-4e91-88f8-e7b7e07f5553 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121103) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 30 01:16:54.798884 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-44d05bca-b831-41e6-abbb-57e1e7efa870 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:54.799636 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-44d05bca-b831-41e6-abbb-57e1e7efa870 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: d1fee870-9d6d-4086-9138-4a9709e2d26c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:54.810832 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44d05bca-b831-41e6-abbb-57e1e7efa870 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:54.816369 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44d05bca-b831-41e6-abbb-57e1e7efa870 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:54.816883 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44d05bca-b831-41e6-abbb-57e1e7efa870 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:54.819671 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44d05bca-b831-41e6-abbb-57e1e7efa870 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:54.819671 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44d05bca-b831-41e6-abbb-57e1e7efa870 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:54.819671 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44d05bca-b831-41e6-abbb-57e1e7efa870 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:54.839353 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5f742916-433f-4e91-88f8-e7b7e07f5553 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.229139 Oct 30 01:16:54.840594 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 512/1018] 10.222.0.13 () {58 vars in 1150 bytes} [Sun Oct 30 01:16:54 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:16:54.852471 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-87c3f82f-f6f2-446e-a0fd-a9def899d1fc tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:16:54.854837 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-87c3f82f-f6f2-446e-a0fd-a9def899d1fc tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:54.862820 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-87c3f82f-f6f2-446e-a0fd-a9def899d1fc tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:54.863313 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-87c3f82f-f6f2-446e-a0fd-a9def899d1fc tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:54.864343 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-87c3f82f-f6f2-446e-a0fd-a9def899d1fc tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:54.864999 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-87c3f82f-f6f2-446e-a0fd-a9def899d1fc tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:54.865519 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-87c3f82f-f6f2-446e-a0fd-a9def899d1fc tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:54.865943 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-87c3f82f-f6f2-446e-a0fd-a9def899d1fc tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:54.991945 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-44d05bca-b831-41e6-abbb-57e1e7efa870 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:55.007184 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-44d05bca-b831-41e6-abbb-57e1e7efa870 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/d1fee870-9d6d-4086-9138-4a9709e2d26c" status: 200 len: 1318 microversion: 2.1 time: 0.206852 Oct 30 01:16:55.008844 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 507/1019] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:54 2022] GET /compute/v2.1/servers/d1fee870-9d6d-4086-9138-4a9709e2d26c => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:55.016611 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c7f37c15-eb97-4d41-a3b2-eee09e2712eb tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:55.022470 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c7f37c15-eb97-4d41-a3b2-eee09e2712eb tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] [instance: 1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:55.049156 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c7f37c15-eb97-4d41-a3b2-eee09e2712eb tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:55.049728 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c7f37c15-eb97-4d41-a3b2-eee09e2712eb tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:55.050179 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c7f37c15-eb97-4d41-a3b2-eee09e2712eb tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:55.050913 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c7f37c15-eb97-4d41-a3b2-eee09e2712eb tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:55.051944 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c7f37c15-eb97-4d41-a3b2-eee09e2712eb tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:55.052365 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c7f37c15-eb97-4d41-a3b2-eee09e2712eb tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:55.206005 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-87c3f82f-f6f2-446e-a0fd-a9def899d1fc tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9/action" status: 202 len: 0 microversion: 2.1 time: 0.357185 Oct 30 01:16:55.207073 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 513/1020] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:16:54 2022] POST /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9/action => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:16:55.214859 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6460f2ed-6514-48e8-9d87-22053681e884 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:55.215594 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6460f2ed-6514-48e8-9d87-22053681e884 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:55.229081 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6460f2ed-6514-48e8-9d87-22053681e884 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:55.229942 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6460f2ed-6514-48e8-9d87-22053681e884 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:55.230632 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6460f2ed-6514-48e8-9d87-22053681e884 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:55.231623 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6460f2ed-6514-48e8-9d87-22053681e884 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:55.232229 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6460f2ed-6514-48e8-9d87-22053681e884 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:55.238002 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6460f2ed-6514-48e8-9d87-22053681e884 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:55.381114 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c7f37c15-eb97-4d41-a3b2-eee09e2712eb tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7269dc6d56440ca8691179f7275aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4681ed2d06840f995b37e550323d6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:55.385101 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:55.392118 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c7f37c15-eb97-4d41-a3b2-eee09e2712eb tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] 10.222.0.13 "GET /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1" status: 200 len: 1368 microversion: 2.1 time: 0.382127 Oct 30 01:16:55.398484 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 508/1021] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:55 2022] GET /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1 => generated 1368 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:55.407139 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6082d5fc-9c3d-496d-867e-aca4bedd284a tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:55.407925 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6082d5fc-9c3d-496d-867e-aca4bedd284a tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: e19edf61-5458-4f12-84b2-346b41506ff3] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:55.432440 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6082d5fc-9c3d-496d-867e-aca4bedd284a tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:55.434603 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6082d5fc-9c3d-496d-867e-aca4bedd284a tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:55.436602 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6082d5fc-9c3d-496d-867e-aca4bedd284a tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:55.441210 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6082d5fc-9c3d-496d-867e-aca4bedd284a tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:55.441937 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6082d5fc-9c3d-496d-867e-aca4bedd284a tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:55.442564 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6082d5fc-9c3d-496d-867e-aca4bedd284a tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:55.497994 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6460f2ed-6514-48e8-9d87-22053681e884 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1614 microversion: 2.1 time: 0.285658 Oct 30 01:16:55.516226 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 514/1022] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:55 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1614 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:55.675954 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6082d5fc-9c3d-496d-867e-aca4bedd284a tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f11109f32d4013aed5ab9320d8295b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e2bdadb00745888a171041c5714bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:55.686955 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6082d5fc-9c3d-496d-867e-aca4bedd284a tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] 10.222.0.13 "GET /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3" status: 200 len: 1323 microversion: 2.1 time: 0.286708 Oct 30 01:16:55.700295 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 509/1023] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:55 2022] GET /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3 => generated 1323 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:55.705011 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-58d2d4d5-66e9-42a6-a8bf-29b473774da4 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-2092774798", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:16:55.711776 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4f1dd540-922b-4062-bfcd-36fad2e6589d tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:55.712840 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4f1dd540-922b-4062-bfcd-36fad2e6589d tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:55.722009 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4f1dd540-922b-4062-bfcd-36fad2e6589d tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:55.722893 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4f1dd540-922b-4062-bfcd-36fad2e6589d tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:55.726984 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4f1dd540-922b-4062-bfcd-36fad2e6589d tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:55.726984 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4f1dd540-922b-4062-bfcd-36fad2e6589d tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:55.726984 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4f1dd540-922b-4062-bfcd-36fad2e6589d tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:55.726984 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4f1dd540-922b-4062-bfcd-36fad2e6589d tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:55.817955 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-58d2d4d5-66e9-42a6-a8bf-29b473774da4 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] validate_networks() for None {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:16:55.979650 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4f1dd540-922b-4062-bfcd-36fad2e6589d tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1614 microversion: 2.1 time: 0.277596 Oct 30 01:16:55.980635 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 510/1024] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:55 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1614 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:55.986520 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2951d726-a802-4caa-8483-5a47eb988f5e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:55.987535 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2951d726-a802-4caa-8483-5a47eb988f5e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:55.995630 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2951d726-a802-4caa-8483-5a47eb988f5e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:55.996641 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2951d726-a802-4caa-8483-5a47eb988f5e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:55.997303 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2951d726-a802-4caa-8483-5a47eb988f5e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:55.999001 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2951d726-a802-4caa-8483-5a47eb988f5e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:55.999692 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2951d726-a802-4caa-8483-5a47eb988f5e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:56.000464 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2951d726-a802-4caa-8483-5a47eb988f5e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:56.124538 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-58d2d4d5-66e9-42a6-a8bf-29b473774da4 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:16:56.125552 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-58d2d4d5-66e9-42a6-a8bf-29b473774da4 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:16:56.126468 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-58d2d4d5-66e9-42a6-a8bf-29b473774da4 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:16:56.127152 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-58d2d4d5-66e9-42a6-a8bf-29b473774da4 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:16:56.127942 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-58d2d4d5-66e9-42a6-a8bf-29b473774da4 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:16:56.141877 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58d2d4d5-66e9-42a6-a8bf-29b473774da4 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:56.142898 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58d2d4d5-66e9-42a6-a8bf-29b473774da4 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:56.143642 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58d2d4d5-66e9-42a6-a8bf-29b473774da4 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:56.144559 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58d2d4d5-66e9-42a6-a8bf-29b473774da4 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:56.145279 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58d2d4d5-66e9-42a6-a8bf-29b473774da4 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:56.146161 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58d2d4d5-66e9-42a6-a8bf-29b473774da4 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:56.170142 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-58d2d4d5-66e9-42a6-a8bf-29b473774da4 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Getting quotas for project feea74354a0b4753a363fc5d4f6d4f13. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:16:56.176873 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-58d2d4d5-66e9-42a6-a8bf-29b473774da4 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Getting quotas for user 7d87ef57cf344734b662bd792022c4b7 and project feea74354a0b4753a363fc5d4f6d4f13. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:16:56.196625 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-58d2d4d5-66e9-42a6-a8bf-29b473774da4 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:16:56.199891 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-58d2d4d5-66e9-42a6-a8bf-29b473774da4 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] [instance: d444d587-7d6e-498e-9770-6ac5f8fbd0e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:16:56.204104 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2951d726-a802-4caa-8483-5a47eb988f5e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:56.211968 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2951d726-a802-4caa-8483-5a47eb988f5e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1312 microversion: 2.1 time: 0.230093 Oct 30 01:16:56.212532 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 511/1025] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:55 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1312 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:56.220886 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-ce2f4a37-2ef8-4e80-ba61-8ae38272ccb1 req-31590da2-6f9e-46b0-9716-1a869c8e4bce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16620e75-9ac1-4f76-97eb-d4281e2f0d88", "name": "network-vif-plugged", "status": "completed", "tag": "c81c587a-677a-4762-8cc7-d0cac55df293"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:16:56.231223 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ce2f4a37-2ef8-4e80-ba61-8ae38272ccb1 req-31590da2-6f9e-46b0-9716-1a869c8e4bce service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:56.231694 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ce2f4a37-2ef8-4e80-ba61-8ae38272ccb1 req-31590da2-6f9e-46b0-9716-1a869c8e4bce service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:56.232117 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ce2f4a37-2ef8-4e80-ba61-8ae38272ccb1 req-31590da2-6f9e-46b0-9716-1a869c8e4bce service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:56.244637 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-ce2f4a37-2ef8-4e80-ba61-8ae38272ccb1 req-31590da2-6f9e-46b0-9716-1a869c8e4bce service nova] Creating event network-vif-plugged:c81c587a-677a-4762-8cc7-d0cac55df293 for instance 16620e75-9ac1-4f76-97eb-d4281e2f0d88 on n-h1-master-1 Oct 30 01:16:56.249521 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-ce2f4a37-2ef8-4e80-ba61-8ae38272ccb1 req-31590da2-6f9e-46b0-9716-1a869c8e4bce service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035611 Oct 30 01:16:56.250328 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 512/1026] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:16:56.256624 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fa37982a-3b59-4a1b-8875-b84769470649 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:56.262379 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fa37982a-3b59-4a1b-8875-b84769470649 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Searching by: {'host': 'n-h2-master-1', 'deleted': False} {{(pid=121102) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 30 01:16:56.268003 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fa37982a-3b59-4a1b-8875-b84769470649 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:56.268475 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fa37982a-3b59-4a1b-8875-b84769470649 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:56.268901 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fa37982a-3b59-4a1b-8875-b84769470649 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:56.269722 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fa37982a-3b59-4a1b-8875-b84769470649 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:56.270128 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fa37982a-3b59-4a1b-8875-b84769470649 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:56.270592 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fa37982a-3b59-4a1b-8875-b84769470649 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:56.294807 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=17 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:56.365310 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.multi_cell_list [None req-fa37982a-3b59-4a1b-8875-b84769470649 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Listed batch of 9 results from cell out of 1000 limit. Returned 9 total so far. {{(pid=121102) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 30 01:16:56.377378 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-58d2d4d5-66e9-42a6-a8bf-29b473774da4 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.859414 Oct 30 01:16:56.379232 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 515/1027] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:16:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 862 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:16:56.406726 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-69eb8aa4-efc8-4493-bb3d-c39600546984 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:56.411450 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-69eb8aa4-efc8-4493-bb3d-c39600546984 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: d1fee870-9d6d-4086-9138-4a9709e2d26c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:56.450944 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-69eb8aa4-efc8-4493-bb3d-c39600546984 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:56.452197 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-69eb8aa4-efc8-4493-bb3d-c39600546984 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:56.452838 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-69eb8aa4-efc8-4493-bb3d-c39600546984 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:56.455252 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-69eb8aa4-efc8-4493-bb3d-c39600546984 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:56.458614 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-69eb8aa4-efc8-4493-bb3d-c39600546984 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:56.464523 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-69eb8aa4-efc8-4493-bb3d-c39600546984 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:56.491629 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fa37982a-3b59-4a1b-8875-b84769470649 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] 10.222.0.13 "GET /compute/v2.1/servers?host=n-h2-master-1&all_tenants=1" status: 200 len: 2966 microversion: 2.1 time: 0.239859 Oct 30 01:16:56.494172 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:56.496231 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 513/1028] 10.222.0.13 () {58 vars in 1190 bytes} [Sun Oct 30 01:16:56 2022] GET /compute/v2.1/servers?host=n-h2-master-1&all_tenants=1 => generated 2966 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:56.503019 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-7440fb07-eb64-40a3-83e8-fcc3943dec93 req-59836a36-2c18-4200-b277-da854efefddb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1", "tag": "5bb2b2c2-2ed3-4110-a964-fde80b9cd12f"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:16:56.525579 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-7440fb07-eb64-40a3-83e8-fcc3943dec93 req-59836a36-2c18-4200-b277-da854efefddb service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:56.526129 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-7440fb07-eb64-40a3-83e8-fcc3943dec93 req-59836a36-2c18-4200-b277-da854efefddb service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:56.526622 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-7440fb07-eb64-40a3-83e8-fcc3943dec93 req-59836a36-2c18-4200-b277-da854efefddb service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:56.544570 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-7440fb07-eb64-40a3-83e8-fcc3943dec93 req-59836a36-2c18-4200-b277-da854efefddb service nova] Creating event network-changed:5bb2b2c2-2ed3-4110-a964-fde80b9cd12f for instance 1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1 on n-h2-master-1 Oct 30 01:16:56.549814 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-7440fb07-eb64-40a3-83e8-fcc3943dec93 req-59836a36-2c18-4200-b277-da854efefddb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053374 Oct 30 01:16:56.551485 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 514/1029] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:16:56.557431 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2ccb683e-b206-471c-8a12-5952c94278d4 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:56.558415 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2ccb683e-b206-471c-8a12-5952c94278d4 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] [instance: d444d587-7d6e-498e-9770-6ac5f8fbd0e1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:56.900085 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2ccb683e-b206-471c-8a12-5952c94278d4 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d87ef57cf344734b662bd792022c4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea74354a0b4753a363fc5d4f6d4f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:56.912647 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2ccb683e-b206-471c-8a12-5952c94278d4 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] 10.222.0.13 "GET /compute/v2.1/servers/d444d587-7d6e-498e-9770-6ac5f8fbd0e1" status: 200 len: 1220 microversion: 2.1 time: 0.359641 Oct 30 01:16:56.914425 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 515/1030] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:56 2022] GET /compute/v2.1/servers/d444d587-7d6e-498e-9770-6ac5f8fbd0e1 => generated 1220 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:56.921551 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-56f95b0c-05e0-40bb-8c03-ffa5f528740b tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:56.922681 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-56f95b0c-05e0-40bb-8c03-ffa5f528740b tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] [instance: 1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:56.932577 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-69eb8aa4-efc8-4493-bb3d-c39600546984 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:56.937887 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-56f95b0c-05e0-40bb-8c03-ffa5f528740b tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:56.938528 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-56f95b0c-05e0-40bb-8c03-ffa5f528740b tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:56.938967 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-56f95b0c-05e0-40bb-8c03-ffa5f528740b tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:56.939671 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-56f95b0c-05e0-40bb-8c03-ffa5f528740b tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:56.940277 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-56f95b0c-05e0-40bb-8c03-ffa5f528740b tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:56.940709 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-56f95b0c-05e0-40bb-8c03-ffa5f528740b tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:56.944088 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-69eb8aa4-efc8-4493-bb3d-c39600546984 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/d1fee870-9d6d-4086-9138-4a9709e2d26c" status: 200 len: 1318 microversion: 2.1 time: 0.560097 Oct 30 01:16:57.015696 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 516/1031] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:56 2022] GET /compute/v2.1/servers/d1fee870-9d6d-4086-9138-4a9709e2d26c => generated 1318 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:57.015696 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9f441ad2-f49c-4e94-b3bf-519dbd118773 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:57.015696 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9f441ad2-f49c-4e94-b3bf-519dbd118773 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=121103) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 30 01:16:57.015696 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9f441ad2-f49c-4e94-b3bf-519dbd118773 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:57.016263 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9f441ad2-f49c-4e94-b3bf-519dbd118773 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:57.016263 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9f441ad2-f49c-4e94-b3bf-519dbd118773 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:57.016263 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9f441ad2-f49c-4e94-b3bf-519dbd118773 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:57.016263 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9f441ad2-f49c-4e94-b3bf-519dbd118773 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:57.016885 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9f441ad2-f49c-4e94-b3bf-519dbd118773 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:57.069218 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9f441ad2-f49c-4e94-b3bf-519dbd118773 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] 10.222.0.13 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.123012 Oct 30 01:16:57.072575 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 517/1032] 10.222.0.13 () {58 vars in 1196 bytes} [Sun Oct 30 01:16:56 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:16:57.074316 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-25f736fc-3a81-4efb-9657-dc769cb6b4bc tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:57.074923 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-25f736fc-3a81-4efb-9657-dc769cb6b4bc tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: e19edf61-5458-4f12-84b2-346b41506ff3] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:57.079361 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-56f95b0c-05e0-40bb-8c03-ffa5f528740b tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7269dc6d56440ca8691179f7275aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4681ed2d06840f995b37e550323d6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:57.081889 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-25f736fc-3a81-4efb-9657-dc769cb6b4bc tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:57.082379 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-25f736fc-3a81-4efb-9657-dc769cb6b4bc tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:57.082862 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-25f736fc-3a81-4efb-9657-dc769cb6b4bc tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:57.083570 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-25f736fc-3a81-4efb-9657-dc769cb6b4bc tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:57.084019 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-25f736fc-3a81-4efb-9657-dc769cb6b4bc tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:57.084440 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-25f736fc-3a81-4efb-9657-dc769cb6b4bc tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:57.087424 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-56f95b0c-05e0-40bb-8c03-ffa5f528740b tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] 10.222.0.13 "GET /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1" status: 200 len: 1368 microversion: 2.1 time: 0.171390 Oct 30 01:16:57.087996 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 516/1033] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:56 2022] GET /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1 => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:57.092464 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-041adfc0-f984-47fe-9e72-3450350356ef tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:16:57.094792 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-041adfc0-f984-47fe-9e72-3450350356ef tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:57.100700 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-041adfc0-f984-47fe-9e72-3450350356ef tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:57.101477 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-041adfc0-f984-47fe-9e72-3450350356ef tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:57.102061 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-041adfc0-f984-47fe-9e72-3450350356ef tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:57.102939 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-041adfc0-f984-47fe-9e72-3450350356ef tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:57.103518 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-041adfc0-f984-47fe-9e72-3450350356ef tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:57.103948 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-041adfc0-f984-47fe-9e72-3450350356ef tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:57.228078 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-25f736fc-3a81-4efb-9657-dc769cb6b4bc tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f11109f32d4013aed5ab9320d8295b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e2bdadb00745888a171041c5714bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:57.238124 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-25f736fc-3a81-4efb-9657-dc769cb6b4bc tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] 10.222.0.13 "GET /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3" status: 200 len: 1323 microversion: 2.1 time: 0.167249 Oct 30 01:16:57.239549 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 518/1034] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:57 2022] GET /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3 => generated 1323 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:57.259772 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0c1651ee-9364-48f4-9bc9-7344e7a5a003 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:57.260462 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0c1651ee-9364-48f4-9bc9-7344e7a5a003 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:57.267416 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c1651ee-9364-48f4-9bc9-7344e7a5a003 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:57.267909 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c1651ee-9364-48f4-9bc9-7344e7a5a003 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:57.268342 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c1651ee-9364-48f4-9bc9-7344e7a5a003 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:57.269042 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c1651ee-9364-48f4-9bc9-7344e7a5a003 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:57.269518 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c1651ee-9364-48f4-9bc9-7344e7a5a003 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:57.269966 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c1651ee-9364-48f4-9bc9-7344e7a5a003 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:57.418285 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0c1651ee-9364-48f4-9bc9-7344e7a5a003 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:57.425979 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0c1651ee-9364-48f4-9bc9-7344e7a5a003 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1462 microversion: 2.1 time: 0.170271 Oct 30 01:16:57.427127 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 519/1035] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:57 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1462 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:57.449859 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-02f64f50-973d-435d-9450-0095d8fad9ad tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:16:57.452245 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-02f64f50-973d-435d-9450-0095d8fad9ad tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:57.458438 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-02f64f50-973d-435d-9450-0095d8fad9ad tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:57.458928 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-02f64f50-973d-435d-9450-0095d8fad9ad tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:57.459392 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-02f64f50-973d-435d-9450-0095d8fad9ad tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:57.460092 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-02f64f50-973d-435d-9450-0095d8fad9ad tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:57.460539 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-02f64f50-973d-435d-9450-0095d8fad9ad tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:57.460986 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-02f64f50-973d-435d-9450-0095d8fad9ad tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:57.552675 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-02f64f50-973d-435d-9450-0095d8fad9ad tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:57.559203 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-02f64f50-973d-435d-9450-0095d8fad9ad tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Old instance type m1.heat2, new instance type m1.heat {{(pid=121103) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 30 01:16:57.565908 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-02f64f50-973d-435d-9450-0095d8fad9ad tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:16:57.569026 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-02f64f50-973d-435d-9450-0095d8fad9ad tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:16:57.569026 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-02f64f50-973d-435d-9450-0095d8fad9ad tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:16:57.569026 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-02f64f50-973d-435d-9450-0095d8fad9ad tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:16:57.569026 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-02f64f50-973d-435d-9450-0095d8fad9ad tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:16:57.589241 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-041adfc0-f984-47fe-9e72-3450350356ef tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9/action" status: 202 len: 0 microversion: 2.1 time: 0.500152 Oct 30 01:16:57.590287 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 517/1036] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:16:57 2022] POST /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9/action => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:16:57.598918 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fc2046f0-1cc5-4a91-83ff-0296b4a0138b tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "deb14158-45d8-4539-889d-ff9726d046d7"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:16:57.602141 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fc2046f0-1cc5-4a91-83ff-0296b4a0138b tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:57.608214 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fc2046f0-1cc5-4a91-83ff-0296b4a0138b tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:57.609275 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fc2046f0-1cc5-4a91-83ff-0296b4a0138b tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:57.609275 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fc2046f0-1cc5-4a91-83ff-0296b4a0138b tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:57.609862 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fc2046f0-1cc5-4a91-83ff-0296b4a0138b tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:57.610314 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fc2046f0-1cc5-4a91-83ff-0296b4a0138b tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:57.610734 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fc2046f0-1cc5-4a91-83ff-0296b4a0138b tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:57.695846 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-fc2046f0-1cc5-4a91-83ff-0296b4a0138b tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:16:57.696275 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-fc2046f0-1cc5-4a91-83ff-0296b4a0138b tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:16:57.696781 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-fc2046f0-1cc5-4a91-83ff-0296b4a0138b tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:16:57.697160 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-fc2046f0-1cc5-4a91-83ff-0296b4a0138b tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:16:57.697604 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-fc2046f0-1cc5-4a91-83ff-0296b4a0138b tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:16:57.856999 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fc2046f0-1cc5-4a91-83ff-0296b4a0138b tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:57.863798 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fc2046f0-1cc5-4a91-83ff-0296b4a0138b tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:57.864357 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fc2046f0-1cc5-4a91-83ff-0296b4a0138b tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:57.864854 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fc2046f0-1cc5-4a91-83ff-0296b4a0138b tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:57.865897 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fc2046f0-1cc5-4a91-83ff-0296b4a0138b tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:57.866466 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fc2046f0-1cc5-4a91-83ff-0296b4a0138b tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:57.866941 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fc2046f0-1cc5-4a91-83ff-0296b4a0138b tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:57.901367 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fc2046f0-1cc5-4a91-83ff-0296b4a0138b tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "POST /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9/action" status: 202 len: 1067 microversion: 2.1 time: 0.306737 Oct 30 01:16:57.902090 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 518/1037] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:16:57 2022] POST /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9/action => generated 1067 bytes in 308 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Oct 30 01:16:57.920958 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a10b14a7-a9e2-4cc8-af15-941198f4ef19 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:57.921587 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a10b14a7-a9e2-4cc8-af15-941198f4ef19 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:57.924570 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:57.928218 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a10b14a7-a9e2-4cc8-af15-941198f4ef19 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:57.928985 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a10b14a7-a9e2-4cc8-af15-941198f4ef19 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:57.929465 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a10b14a7-a9e2-4cc8-af15-941198f4ef19 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:57.930166 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a10b14a7-a9e2-4cc8-af15-941198f4ef19 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:57.930616 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a10b14a7-a9e2-4cc8-af15-941198f4ef19 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:57.931117 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a10b14a7-a9e2-4cc8-af15-941198f4ef19 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:58.040369 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-02f64f50-973d-435d-9450-0095d8fad9ad tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "POST /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5/action" status: 202 len: 0 microversion: 2.1 time: 0.594497 Oct 30 01:16:58.042275 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 520/1038] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:16:57 2022] POST /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5/action => generated 0 bytes in 597 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 30 01:16:58.053177 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f74b283a-cde4-4e7b-9c9b-d2ada6b0c1bc tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:58.054146 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f74b283a-cde4-4e7b-9c9b-d2ada6b0c1bc tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] [instance: d444d587-7d6e-498e-9770-6ac5f8fbd0e1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:58.085745 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a10b14a7-a9e2-4cc8-af15-941198f4ef19 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:58.108602 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a10b14a7-a9e2-4cc8-af15-941198f4ef19 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1471 microversion: 2.1 time: 0.191201 Oct 30 01:16:58.124328 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 519/1039] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:57 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1471 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:16:58.129905 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-94c772dd-5539-4150-98c1-e07486bda8a3 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:58.130481 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-94c772dd-5539-4150-98c1-e07486bda8a3 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: d1fee870-9d6d-4086-9138-4a9709e2d26c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:58.136904 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-94c772dd-5539-4150-98c1-e07486bda8a3 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:58.137722 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-94c772dd-5539-4150-98c1-e07486bda8a3 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:58.138157 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-94c772dd-5539-4150-98c1-e07486bda8a3 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:58.138866 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-94c772dd-5539-4150-98c1-e07486bda8a3 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:58.139316 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-94c772dd-5539-4150-98c1-e07486bda8a3 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:58.139837 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-94c772dd-5539-4150-98c1-e07486bda8a3 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:58.145900 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f74b283a-cde4-4e7b-9c9b-d2ada6b0c1bc tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d87ef57cf344734b662bd792022c4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea74354a0b4753a363fc5d4f6d4f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:58.153480 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f74b283a-cde4-4e7b-9c9b-d2ada6b0c1bc tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] 10.222.0.13 "GET /compute/v2.1/servers/d444d587-7d6e-498e-9770-6ac5f8fbd0e1" status: 200 len: 1220 microversion: 2.1 time: 0.109233 Oct 30 01:16:58.154539 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 521/1040] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:58 2022] GET /compute/v2.1/servers/d444d587-7d6e-498e-9770-6ac5f8fbd0e1 => generated 1220 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:58.159703 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3ef9c402-c2d2-4c7a-8bf7-96f01b8a0b31 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:58.160520 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3ef9c402-c2d2-4c7a-8bf7-96f01b8a0b31 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:58.166771 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3ef9c402-c2d2-4c7a-8bf7-96f01b8a0b31 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:58.167525 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3ef9c402-c2d2-4c7a-8bf7-96f01b8a0b31 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:58.168281 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3ef9c402-c2d2-4c7a-8bf7-96f01b8a0b31 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:58.169218 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3ef9c402-c2d2-4c7a-8bf7-96f01b8a0b31 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:58.169693 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3ef9c402-c2d2-4c7a-8bf7-96f01b8a0b31 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:58.170118 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3ef9c402-c2d2-4c7a-8bf7-96f01b8a0b31 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:58.410908 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-94c772dd-5539-4150-98c1-e07486bda8a3 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:58.411692 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3ef9c402-c2d2-4c7a-8bf7-96f01b8a0b31 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:58.418826 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-94c772dd-5539-4150-98c1-e07486bda8a3 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/d1fee870-9d6d-4086-9138-4a9709e2d26c" status: 200 len: 1318 microversion: 2.1 time: 0.293261 Oct 30 01:16:58.419408 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 520/1041] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:58 2022] GET /compute/v2.1/servers/d1fee870-9d6d-4086-9138-4a9709e2d26c => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:58.428252 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3ef9c402-c2d2-4c7a-8bf7-96f01b8a0b31 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1471 microversion: 2.1 time: 0.264301 Oct 30 01:16:58.428252 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 522/1042] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:58 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1471 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:58.433848 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ca4c3052-6f7a-4683-b8c6-6b4fbb43e2fe tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:58.433848 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ca4c3052-6f7a-4683-b8c6-6b4fbb43e2fe tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] [instance: 1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:58.434035 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-376a29d0-7eb9-4e8d-9d96-776969c3bf08 req-949d3912-7436-4828-8ba0-15f77862b2f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1fee870-9d6d-4086-9138-4a9709e2d26c", "name": "network-vif-plugged", "status": "completed", "tag": "17d00fc2-d99f-4ce9-a60f-4718f0b667da"}, {"server_uuid": "e19edf61-5458-4f12-84b2-346b41506ff3", "name": "network-vif-plugged", "status": "completed", "tag": "dfced65c-3e28-40bf-b025-33cddcb37142"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:16:58.435810 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ca4c3052-6f7a-4683-b8c6-6b4fbb43e2fe tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:58.436659 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ca4c3052-6f7a-4683-b8c6-6b4fbb43e2fe tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:58.437392 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ca4c3052-6f7a-4683-b8c6-6b4fbb43e2fe tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:58.438233 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ca4c3052-6f7a-4683-b8c6-6b4fbb43e2fe tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:58.438768 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ca4c3052-6f7a-4683-b8c6-6b4fbb43e2fe tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:58.439355 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ca4c3052-6f7a-4683-b8c6-6b4fbb43e2fe tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:58.444323 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-376a29d0-7eb9-4e8d-9d96-776969c3bf08 req-949d3912-7436-4828-8ba0-15f77862b2f5 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:58.444814 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-376a29d0-7eb9-4e8d-9d96-776969c3bf08 req-949d3912-7436-4828-8ba0-15f77862b2f5 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:58.445246 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-376a29d0-7eb9-4e8d-9d96-776969c3bf08 req-949d3912-7436-4828-8ba0-15f77862b2f5 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:58.459855 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-376a29d0-7eb9-4e8d-9d96-776969c3bf08 req-949d3912-7436-4828-8ba0-15f77862b2f5 service nova] Creating event network-vif-plugged:17d00fc2-d99f-4ce9-a60f-4718f0b667da for instance d1fee870-9d6d-4086-9138-4a9709e2d26c on n-h2-master-1 Oct 30 01:16:58.459855 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-376a29d0-7eb9-4e8d-9d96-776969c3bf08 req-949d3912-7436-4828-8ba0-15f77862b2f5 service nova] Creating event network-vif-plugged:dfced65c-3e28-40bf-b025-33cddcb37142 for instance e19edf61-5458-4f12-84b2-346b41506ff3 on n-h1-master-1 Oct 30 01:16:58.467749 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-376a29d0-7eb9-4e8d-9d96-776969c3bf08 req-949d3912-7436-4828-8ba0-15f77862b2f5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.045482 Oct 30 01:16:58.468371 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 523/1043] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:16:58.475192 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b9ccbd96-a5bd-4856-92fa-2ec064c6ff9b tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:58.475932 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b9ccbd96-a5bd-4856-92fa-2ec064c6ff9b tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: e19edf61-5458-4f12-84b2-346b41506ff3] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:58.483013 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b9ccbd96-a5bd-4856-92fa-2ec064c6ff9b tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:58.483970 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b9ccbd96-a5bd-4856-92fa-2ec064c6ff9b tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:58.484812 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b9ccbd96-a5bd-4856-92fa-2ec064c6ff9b tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:58.485612 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b9ccbd96-a5bd-4856-92fa-2ec064c6ff9b tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:58.486218 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b9ccbd96-a5bd-4856-92fa-2ec064c6ff9b tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:58.486651 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b9ccbd96-a5bd-4856-92fa-2ec064c6ff9b tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:58.664097 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ca4c3052-6f7a-4683-b8c6-6b4fbb43e2fe tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7269dc6d56440ca8691179f7275aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4681ed2d06840f995b37e550323d6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:58.684588 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ca4c3052-6f7a-4683-b8c6-6b4fbb43e2fe tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] 10.222.0.13 "GET /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1" status: 200 len: 1368 microversion: 2.1 time: 0.264048 Oct 30 01:16:58.687234 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 521/1044] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:58 2022] GET /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1 => generated 1368 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:58.703839 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b9ccbd96-a5bd-4856-92fa-2ec064c6ff9b tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f11109f32d4013aed5ab9320d8295b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e2bdadb00745888a171041c5714bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:58.711988 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b9ccbd96-a5bd-4856-92fa-2ec064c6ff9b tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] 10.222.0.13 "GET /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3" status: 200 len: 1323 microversion: 2.1 time: 0.241208 Oct 30 01:16:58.712861 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 524/1045] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:58 2022] GET /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3 => generated 1323 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:59.131613 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e01aba5b-15a8-41ec-80d0-6775dda13486 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:59.132269 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e01aba5b-15a8-41ec-80d0-6775dda13486 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:59.139920 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e01aba5b-15a8-41ec-80d0-6775dda13486 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:59.140407 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e01aba5b-15a8-41ec-80d0-6775dda13486 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:59.140828 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e01aba5b-15a8-41ec-80d0-6775dda13486 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:59.141607 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e01aba5b-15a8-41ec-80d0-6775dda13486 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:59.142050 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e01aba5b-15a8-41ec-80d0-6775dda13486 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:59.142495 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e01aba5b-15a8-41ec-80d0-6775dda13486 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:59.184191 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cc43b6e7-494b-4328-8ac1-45bf28449687 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:59.185320 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-cc43b6e7-494b-4328-8ac1-45bf28449687 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] [instance: d444d587-7d6e-498e-9770-6ac5f8fbd0e1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:59.194098 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cc43b6e7-494b-4328-8ac1-45bf28449687 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:59.194676 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cc43b6e7-494b-4328-8ac1-45bf28449687 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:59.195187 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cc43b6e7-494b-4328-8ac1-45bf28449687 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:59.195991 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cc43b6e7-494b-4328-8ac1-45bf28449687 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:59.196661 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cc43b6e7-494b-4328-8ac1-45bf28449687 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:59.197320 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cc43b6e7-494b-4328-8ac1-45bf28449687 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:59.321194 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-cc43b6e7-494b-4328-8ac1-45bf28449687 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d87ef57cf344734b662bd792022c4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea74354a0b4753a363fc5d4f6d4f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:59.331544 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cc43b6e7-494b-4328-8ac1-45bf28449687 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] 10.222.0.13 "GET /compute/v2.1/servers/d444d587-7d6e-498e-9770-6ac5f8fbd0e1" status: 200 len: 1272 microversion: 2.1 time: 0.157617 Oct 30 01:16:59.333782 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 525/1046] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:59 2022] GET /compute/v2.1/servers/d444d587-7d6e-498e-9770-6ac5f8fbd0e1 => generated 1272 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:59.410033 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e01aba5b-15a8-41ec-80d0-6775dda13486 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:59.419387 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e01aba5b-15a8-41ec-80d0-6775dda13486 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1471 microversion: 2.1 time: 0.291566 Oct 30 01:16:59.419977 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 522/1047] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:59 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1471 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:59.443592 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-692cadec-8dbd-4dbe-9f43-4a4f6979434e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:59.444252 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-692cadec-8dbd-4dbe-9f43-4a4f6979434e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: d1fee870-9d6d-4086-9138-4a9709e2d26c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:59.446817 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-824bf425-5169-4d38-acac-2006157bdb74 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:59.447645 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-824bf425-5169-4d38-acac-2006157bdb74 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:59.450891 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-692cadec-8dbd-4dbe-9f43-4a4f6979434e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:59.451400 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-692cadec-8dbd-4dbe-9f43-4a4f6979434e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:59.451837 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-692cadec-8dbd-4dbe-9f43-4a4f6979434e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:59.452575 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-692cadec-8dbd-4dbe-9f43-4a4f6979434e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:59.453033 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-692cadec-8dbd-4dbe-9f43-4a4f6979434e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:59.453492 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-692cadec-8dbd-4dbe-9f43-4a4f6979434e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:59.455670 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-824bf425-5169-4d38-acac-2006157bdb74 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:59.456573 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-824bf425-5169-4d38-acac-2006157bdb74 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:59.457124 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-824bf425-5169-4d38-acac-2006157bdb74 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:59.460109 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-824bf425-5169-4d38-acac-2006157bdb74 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:59.460705 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-824bf425-5169-4d38-acac-2006157bdb74 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:59.461432 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-824bf425-5169-4d38-acac-2006157bdb74 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:59.665686 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-692cadec-8dbd-4dbe-9f43-4a4f6979434e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:59.672243 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-824bf425-5169-4d38-acac-2006157bdb74 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:16:59.673443 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:59.676102 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-692cadec-8dbd-4dbe-9f43-4a4f6979434e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/d1fee870-9d6d-4086-9138-4a9709e2d26c" status: 200 len: 1318 microversion: 2.1 time: 0.236874 Oct 30 01:16:59.689577 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 526/1048] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:59 2022] GET /compute/v2.1/servers/d1fee870-9d6d-4086-9138-4a9709e2d26c => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:16:59.690398 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-824bf425-5169-4d38-acac-2006157bdb74 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1471 microversion: 2.1 time: 0.238003 Oct 30 01:16:59.690398 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 523/1049] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:59 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1471 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:16:59.712700 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5583d509-2952-447a-bb64-1a094214c93a tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:59.713597 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5583d509-2952-447a-bb64-1a094214c93a tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] [instance: 1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:59.720951 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5583d509-2952-447a-bb64-1a094214c93a tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:59.721476 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5583d509-2952-447a-bb64-1a094214c93a tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:59.721913 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5583d509-2952-447a-bb64-1a094214c93a tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:59.722624 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5583d509-2952-447a-bb64-1a094214c93a tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:59.723111 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5583d509-2952-447a-bb64-1a094214c93a tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:59.723546 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5583d509-2952-447a-bb64-1a094214c93a tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:59.736619 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-015fcc8b-cc9c-4abd-9c20-df103731f130 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:16:59.737244 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-015fcc8b-cc9c-4abd-9c20-df103731f130 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: e19edf61-5458-4f12-84b2-346b41506ff3] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:16:59.744588 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-015fcc8b-cc9c-4abd-9c20-df103731f130 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:59.745251 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-015fcc8b-cc9c-4abd-9c20-df103731f130 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:59.746199 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-015fcc8b-cc9c-4abd-9c20-df103731f130 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:16:59.746967 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-015fcc8b-cc9c-4abd-9c20-df103731f130 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:16:59.747441 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-015fcc8b-cc9c-4abd-9c20-df103731f130 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:16:59.747900 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-015fcc8b-cc9c-4abd-9c20-df103731f130 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:00.027890 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5583d509-2952-447a-bb64-1a094214c93a tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7269dc6d56440ca8691179f7275aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4681ed2d06840f995b37e550323d6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:00.027890 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5583d509-2952-447a-bb64-1a094214c93a tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] 10.222.0.13 "GET /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1" status: 200 len: 1368 microversion: 2.1 time: 0.305397 Oct 30 01:17:00.027890 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 527/1050] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:59 2022] GET /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1 => generated 1368 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:17:00.029192 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-015fcc8b-cc9c-4abd-9c20-df103731f130 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f11109f32d4013aed5ab9320d8295b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e2bdadb00745888a171041c5714bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:00.036797 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-015fcc8b-cc9c-4abd-9c20-df103731f130 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] 10.222.0.13 "GET /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3" status: 200 len: 1323 microversion: 2.1 time: 0.304469 Oct 30 01:17:00.038179 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 524/1051] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:16:59 2022] GET /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3 => generated 1323 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:17:00.371955 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6da87667-1b14-4455-b41d-c031138ccfd2 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:00.372674 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6da87667-1b14-4455-b41d-c031138ccfd2 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] [instance: d444d587-7d6e-498e-9770-6ac5f8fbd0e1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:00.380386 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6da87667-1b14-4455-b41d-c031138ccfd2 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:00.380893 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6da87667-1b14-4455-b41d-c031138ccfd2 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:00.381362 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6da87667-1b14-4455-b41d-c031138ccfd2 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:00.382082 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6da87667-1b14-4455-b41d-c031138ccfd2 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:00.382544 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6da87667-1b14-4455-b41d-c031138ccfd2 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:00.382974 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6da87667-1b14-4455-b41d-c031138ccfd2 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:00.450505 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-21eaa2a6-c5e2-44bb-b60a-f95a3fafcf33 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:00.450505 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-21eaa2a6-c5e2-44bb-b60a-f95a3fafcf33 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:00.472490 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6da87667-1b14-4455-b41d-c031138ccfd2 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d87ef57cf344734b662bd792022c4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea74354a0b4753a363fc5d4f6d4f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:00.486731 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6da87667-1b14-4455-b41d-c031138ccfd2 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] 10.222.0.13 "GET /compute/v2.1/servers/d444d587-7d6e-498e-9770-6ac5f8fbd0e1" status: 200 len: 1272 microversion: 2.1 time: 0.118483 Oct 30 01:17:00.495200 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 528/1052] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:00 2022] GET /compute/v2.1/servers/d444d587-7d6e-498e-9770-6ac5f8fbd0e1 => generated 1272 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:00.496463 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-21eaa2a6-c5e2-44bb-b60a-f95a3fafcf33 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:00.496463 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-21eaa2a6-c5e2-44bb-b60a-f95a3fafcf33 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:00.496463 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-21eaa2a6-c5e2-44bb-b60a-f95a3fafcf33 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:00.496463 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-21eaa2a6-c5e2-44bb-b60a-f95a3fafcf33 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:00.496818 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-21eaa2a6-c5e2-44bb-b60a-f95a3fafcf33 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:00.496818 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-21eaa2a6-c5e2-44bb-b60a-f95a3fafcf33 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:00.652601 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-21eaa2a6-c5e2-44bb-b60a-f95a3fafcf33 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:00.660435 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-21eaa2a6-c5e2-44bb-b60a-f95a3fafcf33 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1471 microversion: 2.1 time: 0.221371 Oct 30 01:17:00.661637 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 525/1053] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:00 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1471 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:00.704155 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7365953f-2ab0-4982-8f07-e7570bc31327 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:00.704771 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7365953f-2ab0-4982-8f07-e7570bc31327 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: d1fee870-9d6d-4086-9138-4a9709e2d26c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:00.704946 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-834386fa-edd9-4dbb-baff-64bc4d4549f9 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:00.705586 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-834386fa-edd9-4dbb-baff-64bc4d4549f9 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:00.711568 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7365953f-2ab0-4982-8f07-e7570bc31327 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:00.712929 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7365953f-2ab0-4982-8f07-e7570bc31327 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:00.713062 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-834386fa-edd9-4dbb-baff-64bc4d4549f9 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:00.713160 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7365953f-2ab0-4982-8f07-e7570bc31327 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:00.713268 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-834386fa-edd9-4dbb-baff-64bc4d4549f9 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:00.713379 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7365953f-2ab0-4982-8f07-e7570bc31327 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:00.713460 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-834386fa-edd9-4dbb-baff-64bc4d4549f9 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:00.713547 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7365953f-2ab0-4982-8f07-e7570bc31327 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:00.713907 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7365953f-2ab0-4982-8f07-e7570bc31327 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:00.714015 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-834386fa-edd9-4dbb-baff-64bc4d4549f9 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:00.714397 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-834386fa-edd9-4dbb-baff-64bc4d4549f9 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:00.714816 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-834386fa-edd9-4dbb-baff-64bc4d4549f9 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:00.917237 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7365953f-2ab0-4982-8f07-e7570bc31327 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:00.937780 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-834386fa-edd9-4dbb-baff-64bc4d4549f9 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:00.938217 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7365953f-2ab0-4982-8f07-e7570bc31327 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/d1fee870-9d6d-4086-9138-4a9709e2d26c" status: 200 len: 1467 microversion: 2.1 time: 0.238078 Oct 30 01:17:00.938834 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 529/1054] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:00 2022] GET /compute/v2.1/servers/d1fee870-9d6d-4086-9138-4a9709e2d26c => generated 1467 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:00.945690 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-834386fa-edd9-4dbb-baff-64bc4d4549f9 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1471 microversion: 2.1 time: 0.244406 Oct 30 01:17:00.946262 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 526/1055] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:00 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1471 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:17:00.964566 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e2c620ba-a2dd-4329-b7d7-f9380b0d6aa5 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:00.965179 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e2c620ba-a2dd-4329-b7d7-f9380b0d6aa5 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 16620e75-9ac1-4f76-97eb-d4281e2f0d88] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:00.971117 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2c620ba-a2dd-4329-b7d7-f9380b0d6aa5 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:00.971595 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2c620ba-a2dd-4329-b7d7-f9380b0d6aa5 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:00.972026 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2c620ba-a2dd-4329-b7d7-f9380b0d6aa5 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:00.972733 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2c620ba-a2dd-4329-b7d7-f9380b0d6aa5 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:00.973992 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2c620ba-a2dd-4329-b7d7-f9380b0d6aa5 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:00.974430 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2c620ba-a2dd-4329-b7d7-f9380b0d6aa5 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:01.037916 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-790eed7b-7194-49e4-8459-ce746da3f9a3 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:01.038652 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-790eed7b-7194-49e4-8459-ce746da3f9a3 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] [instance: 1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:01.045186 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-790eed7b-7194-49e4-8459-ce746da3f9a3 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:01.046008 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-790eed7b-7194-49e4-8459-ce746da3f9a3 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:01.046623 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-790eed7b-7194-49e4-8459-ce746da3f9a3 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:01.047332 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-790eed7b-7194-49e4-8459-ce746da3f9a3 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:01.047786 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-790eed7b-7194-49e4-8459-ce746da3f9a3 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:01.048286 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-790eed7b-7194-49e4-8459-ce746da3f9a3 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:01.164912 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e2c620ba-a2dd-4329-b7d7-f9380b0d6aa5 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:01.173531 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e2c620ba-a2dd-4329-b7d7-f9380b0d6aa5 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/16620e75-9ac1-4f76-97eb-d4281e2f0d88" status: 200 len: 1467 microversion: 2.1 time: 0.212660 Oct 30 01:17:01.174138 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 530/1056] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:00 2022] GET /compute/v2.1/servers/16620e75-9ac1-4f76-97eb-d4281e2f0d88 => generated 1467 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:01.180010 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3cb8be96-6432-47c9-b771-671fc8fb557a tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:01.180621 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3cb8be96-6432-47c9-b771-671fc8fb557a tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: e19edf61-5458-4f12-84b2-346b41506ff3] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:01.201219 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3cb8be96-6432-47c9-b771-671fc8fb557a tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:01.201749 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3cb8be96-6432-47c9-b771-671fc8fb557a tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:01.202465 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3cb8be96-6432-47c9-b771-671fc8fb557a tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:01.203392 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3cb8be96-6432-47c9-b771-671fc8fb557a tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:01.204098 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3cb8be96-6432-47c9-b771-671fc8fb557a tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:01.204695 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3cb8be96-6432-47c9-b771-671fc8fb557a tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:01.219308 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-790eed7b-7194-49e4-8459-ce746da3f9a3 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7269dc6d56440ca8691179f7275aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4681ed2d06840f995b37e550323d6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:01.235080 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-790eed7b-7194-49e4-8459-ce746da3f9a3 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] 10.222.0.13 "GET /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1" status: 200 len: 1368 microversion: 2.1 time: 0.202779 Oct 30 01:17:01.235783 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 527/1057] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:01 2022] GET /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1 => generated 1368 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:17:01.240457 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3e264d42-8833-4605-b797-dfa9e3180acd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:01.245649 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3e264d42-8833-4605-b797-dfa9e3180acd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:01.246531 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3e264d42-8833-4605-b797-dfa9e3180acd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Searching by: {'reservation_id': 'r-acbi2z0i', 'deleted': False, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48'} {{(pid=121102) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 30 01:17:01.271308 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3e264d42-8833-4605-b797-dfa9e3180acd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:01.271746 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3e264d42-8833-4605-b797-dfa9e3180acd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:01.272175 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3e264d42-8833-4605-b797-dfa9e3180acd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:01.272886 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3e264d42-8833-4605-b797-dfa9e3180acd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:01.273327 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3e264d42-8833-4605-b797-dfa9e3180acd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:01.273816 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3e264d42-8833-4605-b797-dfa9e3180acd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:01.367682 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3cb8be96-6432-47c9-b771-671fc8fb557a tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f11109f32d4013aed5ab9320d8295b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e2bdadb00745888a171041c5714bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:01.376478 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3cb8be96-6432-47c9-b771-671fc8fb557a tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] 10.222.0.13 "GET /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3" status: 200 len: 1518 microversion: 2.1 time: 0.201232 Oct 30 01:17:01.380022 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 531/1058] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:01 2022] GET /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3 => generated 1518 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:01.381191 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.multi_cell_list [None req-3e264d42-8833-4605-b797-dfa9e3180acd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=121102) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 30 01:17:01.404792 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fcf2189b-19bc-4cf7-b610-d7eafec3e42e tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Action: 'create', calling method: .version_select at 0x7f44cc2c0a60>, body: {"pool": null} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:01.463578 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3e264d42-8833-4605-b797-dfa9e3180acd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:01.470987 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3e264d42-8833-4605-b797-dfa9e3180acd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:01.471748 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3e264d42-8833-4605-b797-dfa9e3180acd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:01.472789 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3e264d42-8833-4605-b797-dfa9e3180acd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:01.719885 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3e264d42-8833-4605-b797-dfa9e3180acd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/detail?reservation_id=r-acbi2z0i" status: 200 len: 2927 microversion: 2.1 time: 0.482977 Oct 30 01:17:01.727795 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 528/1059] 10.222.0.13 () {58 vars in 1197 bytes} [Sun Oct 30 01:17:01 2022] GET /compute/v2.1/servers/detail?reservation_id=r-acbi2z0i => generated 2927 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:01.727795 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-32da69f0-9243-4c68-a736-b2a07d919287 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:01.727795 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-32da69f0-9243-4c68-a736-b2a07d919287 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] [instance: d444d587-7d6e-498e-9770-6ac5f8fbd0e1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:01.732500 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-32da69f0-9243-4c68-a736-b2a07d919287 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:01.734469 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-32da69f0-9243-4c68-a736-b2a07d919287 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:01.734469 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-32da69f0-9243-4c68-a736-b2a07d919287 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:01.734469 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-32da69f0-9243-4c68-a736-b2a07d919287 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:01.734774 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-32da69f0-9243-4c68-a736-b2a07d919287 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:01.734920 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-32da69f0-9243-4c68-a736-b2a07d919287 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:01.800044 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-32da69f0-9243-4c68-a736-b2a07d919287 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d87ef57cf344734b662bd792022c4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea74354a0b4753a363fc5d4f6d4f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:01.808602 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-32da69f0-9243-4c68-a736-b2a07d919287 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] 10.222.0.13 "GET /compute/v2.1/servers/d444d587-7d6e-498e-9770-6ac5f8fbd0e1" status: 200 len: 1290 microversion: 2.1 time: 0.086911 Oct 30 01:17:01.809169 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 529/1060] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:01 2022] GET /compute/v2.1/servers/d444d587-7d6e-498e-9770-6ac5f8fbd0e1 => generated 1290 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:01.814362 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c1749155-d3f8-45b3-af03-a8531fd08aac tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:01.815915 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c1749155-d3f8-45b3-af03-a8531fd08aac tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:01.820782 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c1749155-d3f8-45b3-af03-a8531fd08aac tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:01.821276 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c1749155-d3f8-45b3-af03-a8531fd08aac tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:01.821786 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c1749155-d3f8-45b3-af03-a8531fd08aac tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:01.822495 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c1749155-d3f8-45b3-af03-a8531fd08aac tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:01.822943 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c1749155-d3f8-45b3-af03-a8531fd08aac tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:01.823388 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c1749155-d3f8-45b3-af03-a8531fd08aac tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:02.071985 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c1749155-d3f8-45b3-af03-a8531fd08aac tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:02.080236 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c1749155-d3f8-45b3-af03-a8531fd08aac tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1471 microversion: 2.1 time: 0.269686 Oct 30 01:17:02.080982 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 530/1061] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:01 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1471 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:02.085908 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d2817444-5316-4311-be19-48d1b31a7f40 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:02.113251 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.compute.server_groups [None req-d2817444-5316-4311-be19-48d1b31a7f40 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Querying cell 7a264aef-b8bb-4843-8958-43bc38c25cb0(cell1) for 2 instances {{(pid=121102) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 30 01:17:02.114578 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2817444-5316-4311-be19-48d1b31a7f40 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:02.115047 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2817444-5316-4311-be19-48d1b31a7f40 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:02.115468 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2817444-5316-4311-be19-48d1b31a7f40 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:02.149187 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d2817444-5316-4311-be19-48d1b31a7f40 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/os-server-groups/f7e3152a-37f1-42e3-a872-4e09c4000d62" status: 200 len: 270 microversion: 2.1 time: 0.067024 Oct 30 01:17:02.149830 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 531/1062] 10.222.0.13 () {58 vars in 1263 bytes} [Sun Oct 30 01:17:02 2022] GET /compute/v2.1/os-server-groups/f7e3152a-37f1-42e3-a872-4e09c4000d62 => generated 270 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:17:02.154462 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3fc59b36-4cff-4358-8130-9ebfc486dbff tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:02.155073 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3fc59b36-4cff-4358-8130-9ebfc486dbff tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:02.162097 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3fc59b36-4cff-4358-8130-9ebfc486dbff tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:02.162595 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3fc59b36-4cff-4358-8130-9ebfc486dbff tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:02.163025 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3fc59b36-4cff-4358-8130-9ebfc486dbff tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:02.163745 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3fc59b36-4cff-4358-8130-9ebfc486dbff tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:02.164192 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3fc59b36-4cff-4358-8130-9ebfc486dbff tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:02.164611 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3fc59b36-4cff-4358-8130-9ebfc486dbff tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:02.356860 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3fc59b36-4cff-4358-8130-9ebfc486dbff tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:02.365211 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3fc59b36-4cff-4358-8130-9ebfc486dbff tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1471 microversion: 2.1 time: 0.214320 Oct 30 01:17:02.365829 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 532/1063] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:02 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1471 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:02.379521 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-244473a6-c765-44a5-8bf7-ec8f1e14c1e1 tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:02.379521 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-244473a6-c765-44a5-8bf7-ec8f1e14c1e1 tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] [instance: 16620e75-9ac1-4f76-97eb-d4281e2f0d88] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:02.379521 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-244473a6-c765-44a5-8bf7-ec8f1e14c1e1 tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:02.379521 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-244473a6-c765-44a5-8bf7-ec8f1e14c1e1 tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:02.380297 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-244473a6-c765-44a5-8bf7-ec8f1e14c1e1 tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:02.380297 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-244473a6-c765-44a5-8bf7-ec8f1e14c1e1 tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:02.380297 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-244473a6-c765-44a5-8bf7-ec8f1e14c1e1 tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:02.380297 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-244473a6-c765-44a5-8bf7-ec8f1e14c1e1 tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:02.637354 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-244473a6-c765-44a5-8bf7-ec8f1e14c1e1 tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/16620e75-9ac1-4f76-97eb-d4281e2f0d88" status: 200 len: 1618 microversion: 2.1 time: 0.269965 Oct 30 01:17:02.638437 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 533/1064] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:02 2022] GET /compute/v2.1/servers/16620e75-9ac1-4f76-97eb-d4281e2f0d88 => generated 1618 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:02.643121 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8eda7ff6-bedf-47ec-ab14-f1cc96dd6965 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:02.643987 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8eda7ff6-bedf-47ec-ab14-f1cc96dd6965 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] [instance: 1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:02.655494 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8eda7ff6-bedf-47ec-ab14-f1cc96dd6965 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:02.658656 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8eda7ff6-bedf-47ec-ab14-f1cc96dd6965 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:02.658656 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8eda7ff6-bedf-47ec-ab14-f1cc96dd6965 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:02.658656 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8eda7ff6-bedf-47ec-ab14-f1cc96dd6965 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:02.658656 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8eda7ff6-bedf-47ec-ab14-f1cc96dd6965 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:02.659119 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8eda7ff6-bedf-47ec-ab14-f1cc96dd6965 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:02.872710 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8eda7ff6-bedf-47ec-ab14-f1cc96dd6965 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7269dc6d56440ca8691179f7275aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4681ed2d06840f995b37e550323d6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:02.883174 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8eda7ff6-bedf-47ec-ab14-f1cc96dd6965 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] 10.222.0.13 "GET /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1" status: 200 len: 1368 microversion: 2.1 time: 0.243474 Oct 30 01:17:02.884016 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 534/1065] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:02 2022] GET /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1 => generated 1368 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:02.888839 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f32bf286-fcdf-43f6-a096-868139fcf97a tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:02.889465 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f32bf286-fcdf-43f6-a096-868139fcf97a tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] [instance: d1fee870-9d6d-4086-9138-4a9709e2d26c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:02.902419 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f32bf286-fcdf-43f6-a096-868139fcf97a tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:02.911925 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f32bf286-fcdf-43f6-a096-868139fcf97a tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:02.911925 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f32bf286-fcdf-43f6-a096-868139fcf97a tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:02.911925 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f32bf286-fcdf-43f6-a096-868139fcf97a tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:02.911925 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f32bf286-fcdf-43f6-a096-868139fcf97a tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:02.912307 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f32bf286-fcdf-43f6-a096-868139fcf97a tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:03.083058 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f32bf286-fcdf-43f6-a096-868139fcf97a tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/d1fee870-9d6d-4086-9138-4a9709e2d26c" status: 200 len: 1618 microversion: 2.1 time: 0.197789 Oct 30 01:17:03.083714 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 535/1066] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:02 2022] GET /compute/v2.1/servers/d1fee870-9d6d-4086-9138-4a9709e2d26c => generated 1618 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:03.088570 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c2ac23ce-ee54-431a-99a0-4f6624972179 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:03.089686 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c2ac23ce-ee54-431a-99a0-4f6624972179 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] [instance: d444d587-7d6e-498e-9770-6ac5f8fbd0e1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:03.095665 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c2ac23ce-ee54-431a-99a0-4f6624972179 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:03.096420 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c2ac23ce-ee54-431a-99a0-4f6624972179 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:03.097048 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c2ac23ce-ee54-431a-99a0-4f6624972179 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:03.097933 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c2ac23ce-ee54-431a-99a0-4f6624972179 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:03.098865 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c2ac23ce-ee54-431a-99a0-4f6624972179 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:03.099292 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c2ac23ce-ee54-431a-99a0-4f6624972179 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:03.227597 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c2ac23ce-ee54-431a-99a0-4f6624972179 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d87ef57cf344734b662bd792022c4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea74354a0b4753a363fc5d4f6d4f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:03.242269 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c2ac23ce-ee54-431a-99a0-4f6624972179 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] 10.222.0.13 "GET /compute/v2.1/servers/d444d587-7d6e-498e-9770-6ac5f8fbd0e1" status: 200 len: 1278 microversion: 2.1 time: 0.156695 Oct 30 01:17:03.242945 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 536/1067] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:03 2022] GET /compute/v2.1/servers/d444d587-7d6e-498e-9770-6ac5f8fbd0e1 => generated 1278 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:03.249419 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-9cf38007-5ff2-4472-b8f1-92cc80bfd773 req-e55cf13d-5b8c-4c87-9561-baa546db6d24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1", "name": "network-vif-plugged", "status": "completed", "tag": "5bb2b2c2-2ed3-4110-a964-fde80b9cd12f"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:03.259770 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-9cf38007-5ff2-4472-b8f1-92cc80bfd773 req-e55cf13d-5b8c-4c87-9561-baa546db6d24 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:03.260047 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-9cf38007-5ff2-4472-b8f1-92cc80bfd773 req-e55cf13d-5b8c-4c87-9561-baa546db6d24 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:03.260380 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-9cf38007-5ff2-4472-b8f1-92cc80bfd773 req-e55cf13d-5b8c-4c87-9561-baa546db6d24 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:03.272513 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-9cf38007-5ff2-4472-b8f1-92cc80bfd773 req-e55cf13d-5b8c-4c87-9561-baa546db6d24 service nova] Creating event network-vif-plugged:5bb2b2c2-2ed3-4110-a964-fde80b9cd12f for instance 1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1 on n-h2-master-1 Oct 30 01:17:03.277616 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-9cf38007-5ff2-4472-b8f1-92cc80bfd773 req-e55cf13d-5b8c-4c87-9561-baa546db6d24 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033529 Oct 30 01:17:03.278276 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 537/1068] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:17:03.283278 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d532aec4-6dd4-4128-b12b-ab01b066df81 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:03.283961 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d532aec4-6dd4-4128-b12b-ab01b066df81 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:03.290702 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d532aec4-6dd4-4128-b12b-ab01b066df81 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:03.291176 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d532aec4-6dd4-4128-b12b-ab01b066df81 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:03.291604 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d532aec4-6dd4-4128-b12b-ab01b066df81 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:03.292298 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d532aec4-6dd4-4128-b12b-ab01b066df81 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:03.292744 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d532aec4-6dd4-4128-b12b-ab01b066df81 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:03.293161 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d532aec4-6dd4-4128-b12b-ab01b066df81 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:03.578216 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d532aec4-6dd4-4128-b12b-ab01b066df81 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:03.588822 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d532aec4-6dd4-4128-b12b-ab01b066df81 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1471 microversion: 2.1 time: 0.309318 Oct 30 01:17:03.601788 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 538/1069] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:03 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1471 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:03.612261 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9ebf589b-bae6-4889-884b-bf6b4e08b7c7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-120997504", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "d19d848f-99bc-4f10-b837-d66aaa5258a6"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:03.620579 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fcf2189b-19bc-4cf7-b610-d7eafec3e42e tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] 10.222.0.13 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.219206 Oct 30 01:17:03.622234 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 532/1070] 10.222.0.13 () {60 vars in 1170 bytes} [Sun Oct 30 01:17:01 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:17:03.633638 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e41ff24e-cf32-4089-b234-77b17b4a337b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:03.634346 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e41ff24e-cf32-4089-b234-77b17b4a337b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:03.641458 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e41ff24e-cf32-4089-b234-77b17b4a337b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:03.642028 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e41ff24e-cf32-4089-b234-77b17b4a337b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:03.642654 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e41ff24e-cf32-4089-b234-77b17b4a337b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:03.643548 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e41ff24e-cf32-4089-b234-77b17b4a337b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:03.644159 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e41ff24e-cf32-4089-b234-77b17b4a337b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:03.644851 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e41ff24e-cf32-4089-b234-77b17b4a337b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:03.697721 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-9ebf589b-bae6-4889-884b-bf6b4e08b7c7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] validate_networks() for None {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:17:04.164260 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e41ff24e-cf32-4089-b234-77b17b4a337b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:04.177016 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e41ff24e-cf32-4089-b234-77b17b4a337b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1471 microversion: 2.1 time: 0.553671 Oct 30 01:17:04.178185 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 533/1071] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:03 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1471 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:04.185106 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c6466cbf-12c9-4abf-baa3-4e0b5c7925af tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1207054664", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "c383b18e-d32f-47dc-90a2-236912a6d567"}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:04.281630 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-9ebf589b-bae6-4889-884b-bf6b4e08b7c7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:17:04.281630 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-9ebf589b-bae6-4889-884b-bf6b4e08b7c7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:17:04.281630 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-9ebf589b-bae6-4889-884b-bf6b4e08b7c7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:17:04.281630 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-9ebf589b-bae6-4889-884b-bf6b4e08b7c7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:17:04.282491 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-9ebf589b-bae6-4889-884b-bf6b4e08b7c7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:17:04.291089 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-c6466cbf-12c9-4abf-baa3-4e0b5c7925af tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] validate_networks() for [('c383b18e-d32f-47dc-90a2-236912a6d567', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:17:04.299718 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9ebf589b-bae6-4889-884b-bf6b4e08b7c7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:04.300214 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9ebf589b-bae6-4889-884b-bf6b4e08b7c7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:04.300646 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9ebf589b-bae6-4889-884b-bf6b4e08b7c7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:04.301738 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9ebf589b-bae6-4889-884b-bf6b4e08b7c7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:04.302706 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9ebf589b-bae6-4889-884b-bf6b4e08b7c7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:04.303141 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9ebf589b-bae6-4889-884b-bf6b4e08b7c7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:04.323449 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-9ebf589b-bae6-4889-884b-bf6b4e08b7c7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Getting quotas for project 76b6f7b705f5428b9a3a3a8c4f86ff48. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:17:04.329014 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-9ebf589b-bae6-4889-884b-bf6b4e08b7c7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Getting quotas for user c536d41a93ad4337909fe2e2cb949e03 and project 76b6f7b705f5428b9a3a3a8c4f86ff48. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:17:04.342882 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9ebf589b-bae6-4889-884b-bf6b4e08b7c7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:17:04.345497 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9ebf589b-bae6-4889-884b-bf6b4e08b7c7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 50f83abd-f45c-4217-8130-30a7bebd08b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:17:04.554182 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9ebf589b-bae6-4889-884b-bf6b4e08b7c7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.949917 Oct 30 01:17:04.554182 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 539/1072] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:17:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 951 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:17:04.564183 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2651207b-9e71-48b6-9fa7-4ca4b2f8dd58 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:04.564801 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2651207b-9e71-48b6-9fa7-4ca4b2f8dd58 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] [instance: 1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:04.578207 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2651207b-9e71-48b6-9fa7-4ca4b2f8dd58 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:04.578207 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2651207b-9e71-48b6-9fa7-4ca4b2f8dd58 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:04.578207 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2651207b-9e71-48b6-9fa7-4ca4b2f8dd58 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:04.578207 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2651207b-9e71-48b6-9fa7-4ca4b2f8dd58 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:04.578512 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2651207b-9e71-48b6-9fa7-4ca4b2f8dd58 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:04.578512 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2651207b-9e71-48b6-9fa7-4ca4b2f8dd58 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:04.756247 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2651207b-9e71-48b6-9fa7-4ca4b2f8dd58 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7269dc6d56440ca8691179f7275aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4681ed2d06840f995b37e550323d6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:04.764165 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2651207b-9e71-48b6-9fa7-4ca4b2f8dd58 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] 10.222.0.13 "GET /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1" status: 200 len: 1368 microversion: 2.1 time: 0.208728 Oct 30 01:17:04.765611 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 540/1073] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:04 2022] GET /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1 => generated 1368 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:04.782590 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6a349354-4dac-4642-9734-8375e5807732 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:04.783206 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6a349354-4dac-4642-9734-8375e5807732 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] [instance: d444d587-7d6e-498e-9770-6ac5f8fbd0e1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:04.798708 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a349354-4dac-4642-9734-8375e5807732 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:04.799209 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a349354-4dac-4642-9734-8375e5807732 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:04.799644 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a349354-4dac-4642-9734-8375e5807732 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:04.800348 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a349354-4dac-4642-9734-8375e5807732 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:04.800792 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a349354-4dac-4642-9734-8375e5807732 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:04.801209 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a349354-4dac-4642-9734-8375e5807732 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:04.838116 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:17:04.854323 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-c6466cbf-12c9-4abf-baa3-4e0b5c7925af tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:17:04.854788 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-c6466cbf-12c9-4abf-baa3-4e0b5c7925af tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:17:04.855213 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-c6466cbf-12c9-4abf-baa3-4e0b5c7925af tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:17:04.859558 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-c6466cbf-12c9-4abf-baa3-4e0b5c7925af tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:17:04.860841 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-c6466cbf-12c9-4abf-baa3-4e0b5c7925af tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:17:04.883906 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6466cbf-12c9-4abf-baa3-4e0b5c7925af tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:04.884370 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6466cbf-12c9-4abf-baa3-4e0b5c7925af tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:04.884810 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6466cbf-12c9-4abf-baa3-4e0b5c7925af tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:04.887456 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6466cbf-12c9-4abf-baa3-4e0b5c7925af tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:04.887946 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6466cbf-12c9-4abf-baa3-4e0b5c7925af tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:04.888391 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6466cbf-12c9-4abf-baa3-4e0b5c7925af tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:04.919812 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-c6466cbf-12c9-4abf-baa3-4e0b5c7925af tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Getting quotas for project 10e2bdadb00745888a171041c5714bd9. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:17:04.928107 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-c6466cbf-12c9-4abf-baa3-4e0b5c7925af tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Getting quotas for user 71f11109f32d4013aed5ab9320d8295b and project 10e2bdadb00745888a171041c5714bd9. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:17:04.931562 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:17:04.956308 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c6466cbf-12c9-4abf-baa3-4e0b5c7925af tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:17:04.958992 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c6466cbf-12c9-4abf-baa3-4e0b5c7925af tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: 04619e4f-8b79-4196-9794-f27d605c4328] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:17:05.025086 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6a349354-4dac-4642-9734-8375e5807732 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d87ef57cf344734b662bd792022c4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea74354a0b4753a363fc5d4f6d4f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:05.033316 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6a349354-4dac-4642-9734-8375e5807732 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] 10.222.0.13 "GET /compute/v2.1/servers/d444d587-7d6e-498e-9770-6ac5f8fbd0e1" status: 200 len: 1320 microversion: 2.1 time: 0.266433 Oct 30 01:17:05.038180 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 541/1074] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:04 2022] GET /compute/v2.1/servers/d444d587-7d6e-498e-9770-6ac5f8fbd0e1 => generated 1320 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:05.042290 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b3d59b2a-5194-4e4f-9130-bd0904e0e2f1 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:05.043135 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b3d59b2a-5194-4e4f-9130-bd0904e0e2f1 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 50f83abd-f45c-4217-8130-30a7bebd08b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:05.102681 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b3d59b2a-5194-4e4f-9130-bd0904e0e2f1 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:05.111143 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b3d59b2a-5194-4e4f-9130-bd0904e0e2f1 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/50f83abd-f45c-4217-8130-30a7bebd08b9" status: 200 len: 1216 microversion: 2.1 time: 0.075397 Oct 30 01:17:05.115443 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 542/1075] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:05 2022] GET /compute/v2.1/servers/50f83abd-f45c-4217-8130-30a7bebd08b9 => generated 1216 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:05.117309 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d00641ea-ea8d-44d1-a57b-5a623835565f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:05.117938 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d00641ea-ea8d-44d1-a57b-5a623835565f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:05.124112 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d00641ea-ea8d-44d1-a57b-5a623835565f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:05.124834 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d00641ea-ea8d-44d1-a57b-5a623835565f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:05.125559 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d00641ea-ea8d-44d1-a57b-5a623835565f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:05.126327 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d00641ea-ea8d-44d1-a57b-5a623835565f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:05.126979 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d00641ea-ea8d-44d1-a57b-5a623835565f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:05.127464 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d00641ea-ea8d-44d1-a57b-5a623835565f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:05.239247 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c6466cbf-12c9-4abf-baa3-4e0b5c7925af tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.059537 Oct 30 01:17:05.240740 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 534/1076] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:17:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1062 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:17:05.246006 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f6048730-fdfc-4671-bfa6-4131ef4aff8b tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:05.252720 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f6048730-fdfc-4671-bfa6-4131ef4aff8b tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:05.261012 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f6048730-fdfc-4671-bfa6-4131ef4aff8b tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:05.261547 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f6048730-fdfc-4671-bfa6-4131ef4aff8b tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:05.261989 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f6048730-fdfc-4671-bfa6-4131ef4aff8b tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:05.262710 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f6048730-fdfc-4671-bfa6-4131ef4aff8b tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:05.263195 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f6048730-fdfc-4671-bfa6-4131ef4aff8b tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:05.263600 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f6048730-fdfc-4671-bfa6-4131ef4aff8b tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:05.369646 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d00641ea-ea8d-44d1-a57b-5a623835565f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:05.381097 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d00641ea-ea8d-44d1-a57b-5a623835565f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1471 microversion: 2.1 time: 0.268142 Oct 30 01:17:05.393364 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 543/1077] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:05 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1471 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:05.393364 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0b8b91e5-66a7-4437-8c35-df847a4c04ac tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:05.393364 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0b8b91e5-66a7-4437-8c35-df847a4c04ac tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:05.400310 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b8b91e5-66a7-4437-8c35-df847a4c04ac tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:05.401586 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b8b91e5-66a7-4437-8c35-df847a4c04ac tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:05.402171 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b8b91e5-66a7-4437-8c35-df847a4c04ac tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:05.415806 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b8b91e5-66a7-4437-8c35-df847a4c04ac tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:05.416315 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b8b91e5-66a7-4437-8c35-df847a4c04ac tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:05.416761 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b8b91e5-66a7-4437-8c35-df847a4c04ac tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:05.514939 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:17:05.524776 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f6048730-fdfc-4671-bfa6-4131ef4aff8b tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd" status: 200 len: 1857 microversion: 2.1 time: 0.281954 Oct 30 01:17:05.537370 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 535/1078] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:05 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd => generated 1857 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:05.537370 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c0ad0456-e74f-4d13-a9a5-5b3df9a4a2e2 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:05.537370 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c0ad0456-e74f-4d13-a9a5-5b3df9a4a2e2 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: 04619e4f-8b79-4196-9794-f27d605c4328] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:05.625307 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c0ad0456-e74f-4d13-a9a5-5b3df9a4a2e2 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f11109f32d4013aed5ab9320d8295b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e2bdadb00745888a171041c5714bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:05.633731 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0b8b91e5-66a7-4437-8c35-df847a4c04ac tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:05.634733 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c0ad0456-e74f-4d13-a9a5-5b3df9a4a2e2 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] 10.222.0.13 "GET /compute/v2.1/servers/04619e4f-8b79-4196-9794-f27d605c4328" status: 200 len: 1224 microversion: 2.1 time: 0.105996 Oct 30 01:17:05.646321 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 536/1079] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:05 2022] GET /compute/v2.1/servers/04619e4f-8b79-4196-9794-f27d605c4328 => generated 1224 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:05.646650 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0b8b91e5-66a7-4437-8c35-df847a4c04ac tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1471 microversion: 2.1 time: 0.258848 Oct 30 01:17:05.646739 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-0a9f5ecf-46f3-461e-b480-6e4ff1383c63 req-a480db49-8086-4b0e-a835-66a3a5c3a633 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d444d587-7d6e-498e-9770-6ac5f8fbd0e1", "tag": "13f52f67-7cfe-43f7-b294-bbbec18aab84"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:05.646843 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 544/1080] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:05 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1471 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:05.651933 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b21cb358-5936-402d-af81-14741b18e38f tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:05.655366 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b21cb358-5936-402d-af81-14741b18e38f tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:05.664224 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b21cb358-5936-402d-af81-14741b18e38f tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:05.665077 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b21cb358-5936-402d-af81-14741b18e38f tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:05.665559 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b21cb358-5936-402d-af81-14741b18e38f tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:05.666743 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b21cb358-5936-402d-af81-14741b18e38f tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:05.667919 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b21cb358-5936-402d-af81-14741b18e38f tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:05.669738 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b21cb358-5936-402d-af81-14741b18e38f tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:05.670065 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-0a9f5ecf-46f3-461e-b480-6e4ff1383c63 req-a480db49-8086-4b0e-a835-66a3a5c3a633 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:05.670618 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-0a9f5ecf-46f3-461e-b480-6e4ff1383c63 req-a480db49-8086-4b0e-a835-66a3a5c3a633 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:05.671053 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-0a9f5ecf-46f3-461e-b480-6e4ff1383c63 req-a480db49-8086-4b0e-a835-66a3a5c3a633 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:05.684070 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-0a9f5ecf-46f3-461e-b480-6e4ff1383c63 req-a480db49-8086-4b0e-a835-66a3a5c3a633 service nova] Creating event network-changed:13f52f67-7cfe-43f7-b294-bbbec18aab84 for instance d444d587-7d6e-498e-9770-6ac5f8fbd0e1 on n-h1-master-1 Oct 30 01:17:05.690184 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-0a9f5ecf-46f3-461e-b480-6e4ff1383c63 req-a480db49-8086-4b0e-a835-66a3a5c3a633 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052552 Oct 30 01:17:05.691161 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 537/1081] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:17:05.700763 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-b21cb358-5936-402d-af81-14741b18e38f tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lazy-loading 'flavor' on Instance uuid 6b368660-effb-411d-b713-455fc7fd44cd {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:17:05.718175 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b21cb358-5936-402d-af81-14741b18e38f tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Going to try to live migrate instance to n-h2-master-1 {{(pid=121102) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 30 01:17:05.787267 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fffeb9b7-95f5-4e8e-b289-4025069f8101 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:05.788083 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-fffeb9b7-95f5-4e8e-b289-4025069f8101 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] [instance: 1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:05.794641 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fffeb9b7-95f5-4e8e-b289-4025069f8101 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:05.795232 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fffeb9b7-95f5-4e8e-b289-4025069f8101 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:05.795740 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fffeb9b7-95f5-4e8e-b289-4025069f8101 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:05.796525 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fffeb9b7-95f5-4e8e-b289-4025069f8101 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:05.796990 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fffeb9b7-95f5-4e8e-b289-4025069f8101 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:05.797450 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fffeb9b7-95f5-4e8e-b289-4025069f8101 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:05.974475 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-fffeb9b7-95f5-4e8e-b289-4025069f8101 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7269dc6d56440ca8691179f7275aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4681ed2d06840f995b37e550323d6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:05.983020 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fffeb9b7-95f5-4e8e-b289-4025069f8101 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] 10.222.0.13 "GET /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1" status: 200 len: 1558 microversion: 2.1 time: 0.199946 Oct 30 01:17:05.998009 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 538/1082] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:05 2022] GET /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1 => generated 1558 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:06.008532 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1aaa3a40-8e78-4dd4-bd6b-cf32696de42d tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:06.009026 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1aaa3a40-8e78-4dd4-bd6b-cf32696de42d tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] [instance: 1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:06.017126 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1aaa3a40-8e78-4dd4-bd6b-cf32696de42d tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:06.017986 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1aaa3a40-8e78-4dd4-bd6b-cf32696de42d tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:06.018677 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1aaa3a40-8e78-4dd4-bd6b-cf32696de42d tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:06.019616 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1aaa3a40-8e78-4dd4-bd6b-cf32696de42d tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:06.020140 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1aaa3a40-8e78-4dd4-bd6b-cf32696de42d tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:06.020953 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1aaa3a40-8e78-4dd4-bd6b-cf32696de42d tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:06.112627 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1aaa3a40-8e78-4dd4-bd6b-cf32696de42d tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] 10.222.0.13 "GET /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.108729 Oct 30 01:17:06.116408 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 539/1083] 10.222.0.13 () {58 vars in 1275 bytes} [Sun Oct 30 01:17:06 2022] GET /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:17:06.121712 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c7329644-a2dd-478f-acfa-585efc72652a tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:06.124037 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c7329644-a2dd-478f-acfa-585efc72652a tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] [instance: d444d587-7d6e-498e-9770-6ac5f8fbd0e1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:06.131193 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c7329644-a2dd-478f-acfa-585efc72652a tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:06.131697 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c7329644-a2dd-478f-acfa-585efc72652a tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:06.132136 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c7329644-a2dd-478f-acfa-585efc72652a tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:06.133058 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c7329644-a2dd-478f-acfa-585efc72652a tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:06.133624 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c7329644-a2dd-478f-acfa-585efc72652a tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:06.134658 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c7329644-a2dd-478f-acfa-585efc72652a tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:06.407570 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c7329644-a2dd-478f-acfa-585efc72652a tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d87ef57cf344734b662bd792022c4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea74354a0b4753a363fc5d4f6d4f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:06.416955 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c7329644-a2dd-478f-acfa-585efc72652a tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] 10.222.0.13 "GET /compute/v2.1/servers/d444d587-7d6e-498e-9770-6ac5f8fbd0e1" status: 200 len: 1320 microversion: 2.1 time: 0.300906 Oct 30 01:17:06.417645 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 540/1084] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:06 2022] GET /compute/v2.1/servers/d444d587-7d6e-498e-9770-6ac5f8fbd0e1 => generated 1320 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:06.435241 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a1a1dfd2-3a50-4d1b-87a0-c9b492367eb3 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:06.435913 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a1a1dfd2-3a50-4d1b-87a0-c9b492367eb3 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 50f83abd-f45c-4217-8130-30a7bebd08b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:06.443674 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a1a1dfd2-3a50-4d1b-87a0-c9b492367eb3 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:06.444173 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a1a1dfd2-3a50-4d1b-87a0-c9b492367eb3 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:06.444660 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a1a1dfd2-3a50-4d1b-87a0-c9b492367eb3 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:06.445380 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a1a1dfd2-3a50-4d1b-87a0-c9b492367eb3 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:06.445842 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a1a1dfd2-3a50-4d1b-87a0-c9b492367eb3 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:06.446268 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a1a1dfd2-3a50-4d1b-87a0-c9b492367eb3 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:06.574407 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a1a1dfd2-3a50-4d1b-87a0-c9b492367eb3 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:06.582689 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a1a1dfd2-3a50-4d1b-87a0-c9b492367eb3 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/50f83abd-f45c-4217-8130-30a7bebd08b9" status: 200 len: 1212 microversion: 2.1 time: 0.151368 Oct 30 01:17:06.583280 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 541/1085] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:06 2022] GET /compute/v2.1/servers/50f83abd-f45c-4217-8130-30a7bebd08b9 => generated 1212 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:06.588327 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-686a4f18-fd3b-4cf7-a99d-6f30cb68a44e tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:06.588979 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-686a4f18-fd3b-4cf7-a99d-6f30cb68a44e tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:06.596479 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-686a4f18-fd3b-4cf7-a99d-6f30cb68a44e tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:06.597611 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-686a4f18-fd3b-4cf7-a99d-6f30cb68a44e tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:06.598717 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-686a4f18-fd3b-4cf7-a99d-6f30cb68a44e tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:06.599842 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-686a4f18-fd3b-4cf7-a99d-6f30cb68a44e tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:06.600473 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-686a4f18-fd3b-4cf7-a99d-6f30cb68a44e tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:06.600903 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-686a4f18-fd3b-4cf7-a99d-6f30cb68a44e tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:06.818971 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-686a4f18-fd3b-4cf7-a99d-6f30cb68a44e tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:06.828335 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-686a4f18-fd3b-4cf7-a99d-6f30cb68a44e tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1471 microversion: 2.1 time: 0.243814 Oct 30 01:17:06.828915 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 542/1086] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:06 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1471 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:06.834368 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e85c37ca-1e1f-4e9b-8b24-81039293a3b4 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:06.834976 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e85c37ca-1e1f-4e9b-8b24-81039293a3b4 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: 04619e4f-8b79-4196-9794-f27d605c4328] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:06.841568 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e85c37ca-1e1f-4e9b-8b24-81039293a3b4 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:06.843172 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e85c37ca-1e1f-4e9b-8b24-81039293a3b4 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:06.843172 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e85c37ca-1e1f-4e9b-8b24-81039293a3b4 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:06.844136 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e85c37ca-1e1f-4e9b-8b24-81039293a3b4 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:06.844869 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e85c37ca-1e1f-4e9b-8b24-81039293a3b4 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:06.845749 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e85c37ca-1e1f-4e9b-8b24-81039293a3b4 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:06.915411 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e85c37ca-1e1f-4e9b-8b24-81039293a3b4 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f11109f32d4013aed5ab9320d8295b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e2bdadb00745888a171041c5714bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:06.923645 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e85c37ca-1e1f-4e9b-8b24-81039293a3b4 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] 10.222.0.13 "GET /compute/v2.1/servers/04619e4f-8b79-4196-9794-f27d605c4328" status: 200 len: 1220 microversion: 2.1 time: 0.093448 Oct 30 01:17:06.932824 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 543/1087] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:06 2022] GET /compute/v2.1/servers/04619e4f-8b79-4196-9794-f27d605c4328 => generated 1220 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:06.938555 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c73471de-d8c3-4f98-9001-be5f7cbe4e43 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:06.939464 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c73471de-d8c3-4f98-9001-be5f7cbe4e43 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:06.946129 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c73471de-d8c3-4f98-9001-be5f7cbe4e43 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:06.946915 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c73471de-d8c3-4f98-9001-be5f7cbe4e43 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:06.947425 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c73471de-d8c3-4f98-9001-be5f7cbe4e43 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:06.948328 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c73471de-d8c3-4f98-9001-be5f7cbe4e43 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:06.948953 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c73471de-d8c3-4f98-9001-be5f7cbe4e43 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:06.949662 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c73471de-d8c3-4f98-9001-be5f7cbe4e43 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:07.203255 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c73471de-d8c3-4f98-9001-be5f7cbe4e43 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:07.213194 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c73471de-d8c3-4f98-9001-be5f7cbe4e43 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1471 microversion: 2.1 time: 0.278915 Oct 30 01:17:07.220656 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 544/1088] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:06 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1471 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:07.441147 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fe6bbac8-396b-43f6-ba7d-6b1778c6a697 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:07.442664 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-fe6bbac8-396b-43f6-ba7d-6b1778c6a697 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] [instance: d444d587-7d6e-498e-9770-6ac5f8fbd0e1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:07.450765 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe6bbac8-396b-43f6-ba7d-6b1778c6a697 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:07.451315 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe6bbac8-396b-43f6-ba7d-6b1778c6a697 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:07.452064 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe6bbac8-396b-43f6-ba7d-6b1778c6a697 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:07.452792 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe6bbac8-396b-43f6-ba7d-6b1778c6a697 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:07.453323 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe6bbac8-396b-43f6-ba7d-6b1778c6a697 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:07.453936 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe6bbac8-396b-43f6-ba7d-6b1778c6a697 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:07.593486 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-fe6bbac8-396b-43f6-ba7d-6b1778c6a697 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d87ef57cf344734b662bd792022c4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea74354a0b4753a363fc5d4f6d4f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:07.601732 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fe6bbac8-396b-43f6-ba7d-6b1778c6a697 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] 10.222.0.13 "GET /compute/v2.1/servers/d444d587-7d6e-498e-9770-6ac5f8fbd0e1" status: 200 len: 1320 microversion: 2.1 time: 0.165215 Oct 30 01:17:07.602691 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 545/1089] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:07 2022] GET /compute/v2.1/servers/d444d587-7d6e-498e-9770-6ac5f8fbd0e1 => generated 1320 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:17:07.608768 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-e78a7094-8346-4155-895a-fa66bc995b75 req-eb694567-8412-4f93-8ba5-0c3336e1951e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1", "tag": "5bb2b2c2-2ed3-4110-a964-fde80b9cd12f"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:07.619666 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e78a7094-8346-4155-895a-fa66bc995b75 req-eb694567-8412-4f93-8ba5-0c3336e1951e service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:07.620412 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e78a7094-8346-4155-895a-fa66bc995b75 req-eb694567-8412-4f93-8ba5-0c3336e1951e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:07.620844 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e78a7094-8346-4155-895a-fa66bc995b75 req-eb694567-8412-4f93-8ba5-0c3336e1951e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:07.636084 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-e78a7094-8346-4155-895a-fa66bc995b75 req-eb694567-8412-4f93-8ba5-0c3336e1951e service nova] Creating event network-changed:5bb2b2c2-2ed3-4110-a964-fde80b9cd12f for instance 1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1 on n-h2-master-1 Oct 30 01:17:07.641106 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-e78a7094-8346-4155-895a-fa66bc995b75 req-eb694567-8412-4f93-8ba5-0c3336e1951e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037294 Oct 30 01:17:07.645560 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 546/1090] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:17:07.647153 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5710e293-35a6-46f8-93d2-f0ed848a7b09 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:07.648043 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5710e293-35a6-46f8-93d2-f0ed848a7b09 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 50f83abd-f45c-4217-8130-30a7bebd08b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:07.654508 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5710e293-35a6-46f8-93d2-f0ed848a7b09 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:07.655010 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5710e293-35a6-46f8-93d2-f0ed848a7b09 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:07.655468 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5710e293-35a6-46f8-93d2-f0ed848a7b09 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:07.656810 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5710e293-35a6-46f8-93d2-f0ed848a7b09 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:07.656810 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5710e293-35a6-46f8-93d2-f0ed848a7b09 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:07.657207 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5710e293-35a6-46f8-93d2-f0ed848a7b09 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:07.724488 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5710e293-35a6-46f8-93d2-f0ed848a7b09 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:07.732890 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5710e293-35a6-46f8-93d2-f0ed848a7b09 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/50f83abd-f45c-4217-8130-30a7bebd08b9" status: 200 len: 1268 microversion: 2.1 time: 0.089950 Oct 30 01:17:07.733925 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 547/1091] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:07 2022] GET /compute/v2.1/servers/50f83abd-f45c-4217-8130-30a7bebd08b9 => generated 1268 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:07.852827 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-92dd3fc6-bce2-4d22-b4a2-77e5bcdd7839 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:07.854134 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-92dd3fc6-bce2-4d22-b4a2-77e5bcdd7839 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:07.867192 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-92dd3fc6-bce2-4d22-b4a2-77e5bcdd7839 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:07.868403 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-92dd3fc6-bce2-4d22-b4a2-77e5bcdd7839 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:07.868973 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-92dd3fc6-bce2-4d22-b4a2-77e5bcdd7839 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:07.869983 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-92dd3fc6-bce2-4d22-b4a2-77e5bcdd7839 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:07.870454 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-92dd3fc6-bce2-4d22-b4a2-77e5bcdd7839 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:07.870899 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-92dd3fc6-bce2-4d22-b4a2-77e5bcdd7839 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:08.030207 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-92dd3fc6-bce2-4d22-b4a2-77e5bcdd7839 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:08.039040 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-92dd3fc6-bce2-4d22-b4a2-77e5bcdd7839 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1471 microversion: 2.1 time: 0.190410 Oct 30 01:17:08.040312 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 548/1092] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:07 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1471 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:08.046239 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2f0856f5-0c60-482b-9b4e-4b8cbd9d39d3 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:08.046470 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2f0856f5-0c60-482b-9b4e-4b8cbd9d39d3 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: 04619e4f-8b79-4196-9794-f27d605c4328] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:08.053893 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f0856f5-0c60-482b-9b4e-4b8cbd9d39d3 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:08.054546 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f0856f5-0c60-482b-9b4e-4b8cbd9d39d3 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:08.055091 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f0856f5-0c60-482b-9b4e-4b8cbd9d39d3 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:08.056037 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f0856f5-0c60-482b-9b4e-4b8cbd9d39d3 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:08.056611 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f0856f5-0c60-482b-9b4e-4b8cbd9d39d3 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:08.057760 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f0856f5-0c60-482b-9b4e-4b8cbd9d39d3 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:08.134060 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2f0856f5-0c60-482b-9b4e-4b8cbd9d39d3 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f11109f32d4013aed5ab9320d8295b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e2bdadb00745888a171041c5714bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:08.140648 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2f0856f5-0c60-482b-9b4e-4b8cbd9d39d3 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] 10.222.0.13 "GET /compute/v2.1/servers/04619e4f-8b79-4196-9794-f27d605c4328" status: 200 len: 1276 microversion: 2.1 time: 0.099094 Oct 30 01:17:08.153360 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 549/1093] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:08 2022] GET /compute/v2.1/servers/04619e4f-8b79-4196-9794-f27d605c4328 => generated 1276 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:08.236475 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-52f94238-b238-4dd6-80e0-8ee884f010b6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:08.237152 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-52f94238-b238-4dd6-80e0-8ee884f010b6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:08.248609 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52f94238-b238-4dd6-80e0-8ee884f010b6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:08.249121 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52f94238-b238-4dd6-80e0-8ee884f010b6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:08.249947 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52f94238-b238-4dd6-80e0-8ee884f010b6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:08.253593 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52f94238-b238-4dd6-80e0-8ee884f010b6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:08.253965 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52f94238-b238-4dd6-80e0-8ee884f010b6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:08.254466 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52f94238-b238-4dd6-80e0-8ee884f010b6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:08.446354 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-52f94238-b238-4dd6-80e0-8ee884f010b6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:08.455301 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-52f94238-b238-4dd6-80e0-8ee884f010b6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1471 microversion: 2.1 time: 0.222581 Oct 30 01:17:08.456247 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 550/1094] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:08 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1471 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:17:08.628292 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-de8b58c1-70e5-4807-8273-6040ee5f08e6 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:08.630166 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-de8b58c1-70e5-4807-8273-6040ee5f08e6 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] [instance: d444d587-7d6e-498e-9770-6ac5f8fbd0e1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:08.644264 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de8b58c1-70e5-4807-8273-6040ee5f08e6 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:08.644913 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de8b58c1-70e5-4807-8273-6040ee5f08e6 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:08.646123 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de8b58c1-70e5-4807-8273-6040ee5f08e6 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:08.647023 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de8b58c1-70e5-4807-8273-6040ee5f08e6 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:08.647717 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de8b58c1-70e5-4807-8273-6040ee5f08e6 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:08.648319 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de8b58c1-70e5-4807-8273-6040ee5f08e6 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:09.188154 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-de8b58c1-70e5-4807-8273-6040ee5f08e6 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d87ef57cf344734b662bd792022c4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea74354a0b4753a363fc5d4f6d4f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:09.201562 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-de8b58c1-70e5-4807-8273-6040ee5f08e6 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] 10.222.0.13 "GET /compute/v2.1/servers/d444d587-7d6e-498e-9770-6ac5f8fbd0e1" status: 200 len: 1320 microversion: 2.1 time: 0.578666 Oct 30 01:17:09.202527 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 551/1095] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:08 2022] GET /compute/v2.1/servers/d444d587-7d6e-498e-9770-6ac5f8fbd0e1 => generated 1320 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:17:09.210619 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b96f9ad2-1ed2-4756-8015-40623f178d1c tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:09.211490 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b96f9ad2-1ed2-4756-8015-40623f178d1c tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 50f83abd-f45c-4217-8130-30a7bebd08b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:09.220264 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b96f9ad2-1ed2-4756-8015-40623f178d1c tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:09.220761 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b96f9ad2-1ed2-4756-8015-40623f178d1c tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:09.221199 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b96f9ad2-1ed2-4756-8015-40623f178d1c tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:09.222004 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b96f9ad2-1ed2-4756-8015-40623f178d1c tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:09.222640 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b96f9ad2-1ed2-4756-8015-40623f178d1c tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:09.223832 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b96f9ad2-1ed2-4756-8015-40623f178d1c tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:09.326328 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b96f9ad2-1ed2-4756-8015-40623f178d1c tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:09.335248 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b96f9ad2-1ed2-4756-8015-40623f178d1c tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/50f83abd-f45c-4217-8130-30a7bebd08b9" status: 200 len: 1274 microversion: 2.1 time: 0.131486 Oct 30 01:17:09.336410 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 552/1096] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:09 2022] GET /compute/v2.1/servers/50f83abd-f45c-4217-8130-30a7bebd08b9 => generated 1274 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:09.341290 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2a01025c-3340-4ac2-9530-c1bc0cd112bd tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:09.341925 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2a01025c-3340-4ac2-9530-c1bc0cd112bd tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:09.347996 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a01025c-3340-4ac2-9530-c1bc0cd112bd tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:09.349006 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a01025c-3340-4ac2-9530-c1bc0cd112bd tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:09.349471 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a01025c-3340-4ac2-9530-c1bc0cd112bd tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:09.350177 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a01025c-3340-4ac2-9530-c1bc0cd112bd tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:09.350630 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a01025c-3340-4ac2-9530-c1bc0cd112bd tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:09.351168 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a01025c-3340-4ac2-9530-c1bc0cd112bd tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:09.544555 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2a01025c-3340-4ac2-9530-c1bc0cd112bd tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:09.555877 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2a01025c-3340-4ac2-9530-c1bc0cd112bd tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1471 microversion: 2.1 time: 0.218227 Oct 30 01:17:09.556685 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 553/1097] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:09 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1471 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:09.569383 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1629d7a1-3582-4439-be8a-1c207b3dffa6 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:09.570330 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1629d7a1-3582-4439-be8a-1c207b3dffa6 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: 04619e4f-8b79-4196-9794-f27d605c4328] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:09.577675 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1629d7a1-3582-4439-be8a-1c207b3dffa6 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:09.578461 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1629d7a1-3582-4439-be8a-1c207b3dffa6 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:09.579092 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1629d7a1-3582-4439-be8a-1c207b3dffa6 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:09.579975 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1629d7a1-3582-4439-be8a-1c207b3dffa6 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:09.580531 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1629d7a1-3582-4439-be8a-1c207b3dffa6 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:09.581057 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1629d7a1-3582-4439-be8a-1c207b3dffa6 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:09.664762 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1629d7a1-3582-4439-be8a-1c207b3dffa6 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f11109f32d4013aed5ab9320d8295b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e2bdadb00745888a171041c5714bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:09.704437 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1629d7a1-3582-4439-be8a-1c207b3dffa6 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] 10.222.0.13 "GET /compute/v2.1/servers/04619e4f-8b79-4196-9794-f27d605c4328" status: 200 len: 1284 microversion: 2.1 time: 0.140862 Oct 30 01:17:09.708258 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 554/1098] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:09 2022] GET /compute/v2.1/servers/04619e4f-8b79-4196-9794-f27d605c4328 => generated 1284 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:09.725940 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3df9f955-d124-44c0-b92f-bd3fb87f2520 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:09.733573 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3df9f955-d124-44c0-b92f-bd3fb87f2520 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:09.742985 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3df9f955-d124-44c0-b92f-bd3fb87f2520 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:09.744396 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3df9f955-d124-44c0-b92f-bd3fb87f2520 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:09.745224 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3df9f955-d124-44c0-b92f-bd3fb87f2520 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:09.746647 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3df9f955-d124-44c0-b92f-bd3fb87f2520 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:09.747566 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3df9f955-d124-44c0-b92f-bd3fb87f2520 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:09.748495 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3df9f955-d124-44c0-b92f-bd3fb87f2520 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:09.781729 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=100 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:17:09.952886 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b21cb358-5936-402d-af81-14741b18e38f tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd/action" status: 202 len: 0 microversion: 2.1 time: 4.307777 Oct 30 01:17:09.953438 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 545/1099] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:17:05 2022] POST /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd/action => generated 0 bytes in 4310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:17:09.969977 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5bec6200-e614-49e4-ad8a-aea527f94d39 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:09.972599 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5bec6200-e614-49e4-ad8a-aea527f94d39 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:09.993707 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5bec6200-e614-49e4-ad8a-aea527f94d39 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:09.995934 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5bec6200-e614-49e4-ad8a-aea527f94d39 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:09.997127 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5bec6200-e614-49e4-ad8a-aea527f94d39 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:09.998844 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5bec6200-e614-49e4-ad8a-aea527f94d39 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:10.000776 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5bec6200-e614-49e4-ad8a-aea527f94d39 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:10.002336 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5bec6200-e614-49e4-ad8a-aea527f94d39 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:10.190823 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3df9f955-d124-44c0-b92f-bd3fb87f2520 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:10.202234 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3df9f955-d124-44c0-b92f-bd3fb87f2520 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1476 microversion: 2.1 time: 0.492338 Oct 30 01:17:10.217819 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 555/1100] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:09 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1476 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:10.229752 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-16461997-4904-48ae-b9ec-d4f8000bd9ed tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:10.230579 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-16461997-4904-48ae-b9ec-d4f8000bd9ed tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] [instance: d444d587-7d6e-498e-9770-6ac5f8fbd0e1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:10.237581 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-16461997-4904-48ae-b9ec-d4f8000bd9ed tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:10.238295 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-16461997-4904-48ae-b9ec-d4f8000bd9ed tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:10.238966 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-16461997-4904-48ae-b9ec-d4f8000bd9ed tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:10.239975 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-16461997-4904-48ae-b9ec-d4f8000bd9ed tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:10.240694 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-16461997-4904-48ae-b9ec-d4f8000bd9ed tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:10.241369 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-16461997-4904-48ae-b9ec-d4f8000bd9ed tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:10.347525 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5bec6200-e614-49e4-ad8a-aea527f94d39 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:10.359136 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5bec6200-e614-49e4-ad8a-aea527f94d39 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd" status: 200 len: 1716 microversion: 2.1 time: 0.399632 Oct 30 01:17:10.361102 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 546/1101] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:09 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd => generated 1716 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:17:10.366892 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2d510645-75d2-40fa-9b8e-c66316f59e61 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:10.368015 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2d510645-75d2-40fa-9b8e-c66316f59e61 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 50f83abd-f45c-4217-8130-30a7bebd08b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:10.374882 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2d510645-75d2-40fa-9b8e-c66316f59e61 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:10.375995 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2d510645-75d2-40fa-9b8e-c66316f59e61 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:10.376790 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2d510645-75d2-40fa-9b8e-c66316f59e61 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:10.377606 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2d510645-75d2-40fa-9b8e-c66316f59e61 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:10.378120 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2d510645-75d2-40fa-9b8e-c66316f59e61 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:10.378627 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2d510645-75d2-40fa-9b8e-c66316f59e61 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:10.453012 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-16461997-4904-48ae-b9ec-d4f8000bd9ed tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d87ef57cf344734b662bd792022c4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea74354a0b4753a363fc5d4f6d4f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:10.466464 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-16461997-4904-48ae-b9ec-d4f8000bd9ed tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] 10.222.0.13 "GET /compute/v2.1/servers/d444d587-7d6e-498e-9770-6ac5f8fbd0e1" status: 200 len: 1320 microversion: 2.1 time: 0.239588 Oct 30 01:17:10.466464 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 556/1102] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:10 2022] GET /compute/v2.1/servers/d444d587-7d6e-498e-9770-6ac5f8fbd0e1 => generated 1320 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:10.580804 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f7ed3738-31eb-44dc-af7e-e36e4f04665a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:10.581642 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f7ed3738-31eb-44dc-af7e-e36e4f04665a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:10.588139 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f7ed3738-31eb-44dc-af7e-e36e4f04665a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:10.588789 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f7ed3738-31eb-44dc-af7e-e36e4f04665a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:10.589993 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f7ed3738-31eb-44dc-af7e-e36e4f04665a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:10.590240 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f7ed3738-31eb-44dc-af7e-e36e4f04665a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:10.590786 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f7ed3738-31eb-44dc-af7e-e36e4f04665a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:10.592871 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f7ed3738-31eb-44dc-af7e-e36e4f04665a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:10.625755 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2d510645-75d2-40fa-9b8e-c66316f59e61 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:10.636313 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2d510645-75d2-40fa-9b8e-c66316f59e61 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/50f83abd-f45c-4217-8130-30a7bebd08b9" status: 200 len: 1316 microversion: 2.1 time: 0.273805 Oct 30 01:17:10.636908 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 547/1103] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:10 2022] GET /compute/v2.1/servers/50f83abd-f45c-4217-8130-30a7bebd08b9 => generated 1316 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:10.733137 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-dbaa83a4-44cb-4f1c-b724-05ad34572383 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:10.734386 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-dbaa83a4-44cb-4f1c-b724-05ad34572383 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: 04619e4f-8b79-4196-9794-f27d605c4328] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:10.744194 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dbaa83a4-44cb-4f1c-b724-05ad34572383 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:10.748362 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dbaa83a4-44cb-4f1c-b724-05ad34572383 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:10.748362 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dbaa83a4-44cb-4f1c-b724-05ad34572383 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:10.748362 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dbaa83a4-44cb-4f1c-b724-05ad34572383 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:10.748660 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dbaa83a4-44cb-4f1c-b724-05ad34572383 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:10.748917 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dbaa83a4-44cb-4f1c-b724-05ad34572383 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:10.840344 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f7ed3738-31eb-44dc-af7e-e36e4f04665a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:10.849811 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-dbaa83a4-44cb-4f1c-b724-05ad34572383 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f11109f32d4013aed5ab9320d8295b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e2bdadb00745888a171041c5714bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:10.850099 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f7ed3738-31eb-44dc-af7e-e36e4f04665a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1471 microversion: 2.1 time: 0.273364 Oct 30 01:17:10.850884 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 557/1104] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:10 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1471 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:10.859620 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-dbaa83a4-44cb-4f1c-b724-05ad34572383 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] 10.222.0.13 "GET /compute/v2.1/servers/04619e4f-8b79-4196-9794-f27d605c4328" status: 200 len: 1282 microversion: 2.1 time: 0.131153 Oct 30 01:17:10.860747 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 548/1105] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:10 2022] GET /compute/v2.1/servers/04619e4f-8b79-4196-9794-f27d605c4328 => generated 1282 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:17:11.229190 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a41e7c46-abdb-4f42-a71a-95619d845f36 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:11.230764 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a41e7c46-abdb-4f42-a71a-95619d845f36 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:11.240535 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a41e7c46-abdb-4f42-a71a-95619d845f36 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:11.241125 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a41e7c46-abdb-4f42-a71a-95619d845f36 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:11.243789 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a41e7c46-abdb-4f42-a71a-95619d845f36 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:11.243789 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a41e7c46-abdb-4f42-a71a-95619d845f36 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:11.243789 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a41e7c46-abdb-4f42-a71a-95619d845f36 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:11.243789 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a41e7c46-abdb-4f42-a71a-95619d845f36 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:11.387985 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-74857c86-568d-4404-bfda-a4e1e78af177 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:11.389250 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-74857c86-568d-4404-bfda-a4e1e78af177 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:11.397846 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-74857c86-568d-4404-bfda-a4e1e78af177 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:11.398970 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-74857c86-568d-4404-bfda-a4e1e78af177 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:11.398970 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-74857c86-568d-4404-bfda-a4e1e78af177 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:11.399750 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-74857c86-568d-4404-bfda-a4e1e78af177 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:11.400280 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-74857c86-568d-4404-bfda-a4e1e78af177 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:11.400714 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-74857c86-568d-4404-bfda-a4e1e78af177 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:11.417152 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a41e7c46-abdb-4f42-a71a-95619d845f36 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:11.427204 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a41e7c46-abdb-4f42-a71a-95619d845f36 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1476 microversion: 2.1 time: 0.203267 Oct 30 01:17:11.427798 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 558/1106] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:11 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1476 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:11.488686 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-363f1e41-c980-49f6-9210-155613414fc7 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:11.491144 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-363f1e41-c980-49f6-9210-155613414fc7 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] [instance: d444d587-7d6e-498e-9770-6ac5f8fbd0e1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:11.498977 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-363f1e41-c980-49f6-9210-155613414fc7 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:11.498977 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-363f1e41-c980-49f6-9210-155613414fc7 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:11.499237 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-363f1e41-c980-49f6-9210-155613414fc7 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:11.499933 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-363f1e41-c980-49f6-9210-155613414fc7 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:11.500571 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-363f1e41-c980-49f6-9210-155613414fc7 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:11.500998 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-363f1e41-c980-49f6-9210-155613414fc7 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:11.586348 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-74857c86-568d-4404-bfda-a4e1e78af177 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:11.599156 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-74857c86-568d-4404-bfda-a4e1e78af177 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd" status: 200 len: 1716 microversion: 2.1 time: 0.216196 Oct 30 01:17:11.599768 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 549/1107] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:11 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd => generated 1716 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:17:11.604940 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-ea6ba705-b86e-48a1-aedf-767fdc583bb1 req-00833b5f-dd78-42aa-b765-24c342564fe7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50f83abd-f45c-4217-8130-30a7bebd08b9", "tag": "d2f79325-a6b2-470b-8e09-f0e2f2e2fd35"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:11.615799 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ea6ba705-b86e-48a1-aedf-767fdc583bb1 req-00833b5f-dd78-42aa-b765-24c342564fe7 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:11.622413 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ea6ba705-b86e-48a1-aedf-767fdc583bb1 req-00833b5f-dd78-42aa-b765-24c342564fe7 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:11.622413 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ea6ba705-b86e-48a1-aedf-767fdc583bb1 req-00833b5f-dd78-42aa-b765-24c342564fe7 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:11.629016 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-ea6ba705-b86e-48a1-aedf-767fdc583bb1 req-00833b5f-dd78-42aa-b765-24c342564fe7 service nova] Creating event network-changed:d2f79325-a6b2-470b-8e09-f0e2f2e2fd35 for instance 50f83abd-f45c-4217-8130-30a7bebd08b9 on n-h2-master-1 Oct 30 01:17:11.634504 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-ea6ba705-b86e-48a1-aedf-767fdc583bb1 req-00833b5f-dd78-42aa-b765-24c342564fe7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033260 Oct 30 01:17:11.635117 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 550/1108] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:17:11.660344 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e8688b61-eff7-4ee8-8918-f76c583e4457 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:11.661387 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e8688b61-eff7-4ee8-8918-f76c583e4457 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 50f83abd-f45c-4217-8130-30a7bebd08b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:11.669291 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e8688b61-eff7-4ee8-8918-f76c583e4457 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:11.670017 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e8688b61-eff7-4ee8-8918-f76c583e4457 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:11.670710 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e8688b61-eff7-4ee8-8918-f76c583e4457 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:11.671434 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e8688b61-eff7-4ee8-8918-f76c583e4457 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:11.671896 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e8688b61-eff7-4ee8-8918-f76c583e4457 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:11.672328 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e8688b61-eff7-4ee8-8918-f76c583e4457 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:11.681049 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-363f1e41-c980-49f6-9210-155613414fc7 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d87ef57cf344734b662bd792022c4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea74354a0b4753a363fc5d4f6d4f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:11.690229 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-363f1e41-c980-49f6-9210-155613414fc7 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] 10.222.0.13 "GET /compute/v2.1/servers/d444d587-7d6e-498e-9770-6ac5f8fbd0e1" status: 200 len: 1320 microversion: 2.1 time: 0.205416 Oct 30 01:17:11.705558 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 559/1109] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:11 2022] GET /compute/v2.1/servers/d444d587-7d6e-498e-9770-6ac5f8fbd0e1 => generated 1320 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:17:11.823509 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e8688b61-eff7-4ee8-8918-f76c583e4457 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:11.831917 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e8688b61-eff7-4ee8-8918-f76c583e4457 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/50f83abd-f45c-4217-8130-30a7bebd08b9" status: 200 len: 1316 microversion: 2.1 time: 0.175877 Oct 30 01:17:11.832679 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 551/1110] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:11 2022] GET /compute/v2.1/servers/50f83abd-f45c-4217-8130-30a7bebd08b9 => generated 1316 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:17:11.889063 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ac5918c0-1c8c-4800-89e8-aa9ff26d92e0 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:11.889716 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ac5918c0-1c8c-4800-89e8-aa9ff26d92e0 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: 04619e4f-8b79-4196-9794-f27d605c4328] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:11.898529 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ac5918c0-1c8c-4800-89e8-aa9ff26d92e0 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:11.898932 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ac5918c0-1c8c-4800-89e8-aa9ff26d92e0 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:11.899371 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ac5918c0-1c8c-4800-89e8-aa9ff26d92e0 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:11.900100 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ac5918c0-1c8c-4800-89e8-aa9ff26d92e0 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:11.900565 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ac5918c0-1c8c-4800-89e8-aa9ff26d92e0 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:11.900995 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ac5918c0-1c8c-4800-89e8-aa9ff26d92e0 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:11.907795 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4fac043b-a570-4a33-b7d4-3fc5561cad5b tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:11.910292 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4fac043b-a570-4a33-b7d4-3fc5561cad5b tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:11.914912 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4fac043b-a570-4a33-b7d4-3fc5561cad5b tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:11.915419 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4fac043b-a570-4a33-b7d4-3fc5561cad5b tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:11.915864 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4fac043b-a570-4a33-b7d4-3fc5561cad5b tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:11.916590 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4fac043b-a570-4a33-b7d4-3fc5561cad5b tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:11.918011 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4fac043b-a570-4a33-b7d4-3fc5561cad5b tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:11.918455 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4fac043b-a570-4a33-b7d4-3fc5561cad5b tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:12.124444 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ac5918c0-1c8c-4800-89e8-aa9ff26d92e0 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f11109f32d4013aed5ab9320d8295b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e2bdadb00745888a171041c5714bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:12.135817 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ac5918c0-1c8c-4800-89e8-aa9ff26d92e0 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] 10.222.0.13 "GET /compute/v2.1/servers/04619e4f-8b79-4196-9794-f27d605c4328" status: 200 len: 1324 microversion: 2.1 time: 0.252575 Oct 30 01:17:12.143006 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 552/1111] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:11 2022] GET /compute/v2.1/servers/04619e4f-8b79-4196-9794-f27d605c4328 => generated 1324 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:12.155973 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4fac043b-a570-4a33-b7d4-3fc5561cad5b tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:12.164268 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4fac043b-a570-4a33-b7d4-3fc5561cad5b tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1471 microversion: 2.1 time: 0.281183 Oct 30 01:17:12.165055 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 560/1112] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:11 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1471 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:17:12.454455 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-92f5f791-8908-4eff-a897-38cdd8d022a1 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:12.455683 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-92f5f791-8908-4eff-a897-38cdd8d022a1 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:12.477542 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92f5f791-8908-4eff-a897-38cdd8d022a1 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:12.478260 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92f5f791-8908-4eff-a897-38cdd8d022a1 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:12.478865 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92f5f791-8908-4eff-a897-38cdd8d022a1 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:12.480518 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92f5f791-8908-4eff-a897-38cdd8d022a1 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:12.481258 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92f5f791-8908-4eff-a897-38cdd8d022a1 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:12.481860 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92f5f791-8908-4eff-a897-38cdd8d022a1 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:12.622874 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8df1cb1b-355d-44f9-a5f1-a7379ef537ed tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:12.624942 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8df1cb1b-355d-44f9-a5f1-a7379ef537ed tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:12.638637 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8df1cb1b-355d-44f9-a5f1-a7379ef537ed tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:12.639376 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8df1cb1b-355d-44f9-a5f1-a7379ef537ed tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:12.639979 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8df1cb1b-355d-44f9-a5f1-a7379ef537ed tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:12.640885 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8df1cb1b-355d-44f9-a5f1-a7379ef537ed tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:12.641633 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8df1cb1b-355d-44f9-a5f1-a7379ef537ed tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:12.642299 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8df1cb1b-355d-44f9-a5f1-a7379ef537ed tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:12.739526 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-92f5f791-8908-4eff-a897-38cdd8d022a1 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:12.749928 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-92f5f791-8908-4eff-a897-38cdd8d022a1 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1476 microversion: 2.1 time: 0.301614 Oct 30 01:17:12.763306 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 553/1113] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:12 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1476 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:12.776449 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0eab780b-71cf-4042-8a22-fb23d2b4c47a tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:12.777075 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0eab780b-71cf-4042-8a22-fb23d2b4c47a tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] [instance: d444d587-7d6e-498e-9770-6ac5f8fbd0e1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:12.785446 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0eab780b-71cf-4042-8a22-fb23d2b4c47a tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:12.787516 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0eab780b-71cf-4042-8a22-fb23d2b4c47a tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:12.787987 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0eab780b-71cf-4042-8a22-fb23d2b4c47a tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:12.788734 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0eab780b-71cf-4042-8a22-fb23d2b4c47a tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:12.789195 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0eab780b-71cf-4042-8a22-fb23d2b4c47a tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:12.789661 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0eab780b-71cf-4042-8a22-fb23d2b4c47a tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:13.005432 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8df1cb1b-355d-44f9-a5f1-a7379ef537ed tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:13.028058 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8df1cb1b-355d-44f9-a5f1-a7379ef537ed tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd" status: 200 len: 1716 microversion: 2.1 time: 0.408743 Oct 30 01:17:13.050942 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 561/1114] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:12 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd => generated 1716 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:13.063280 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5f85a729-0691-4a36-a28f-e4e6c12c2a34 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:13.063993 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5f85a729-0691-4a36-a28f-e4e6c12c2a34 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 50f83abd-f45c-4217-8130-30a7bebd08b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:13.073854 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0eab780b-71cf-4042-8a22-fb23d2b4c47a tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d87ef57cf344734b662bd792022c4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea74354a0b4753a363fc5d4f6d4f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:13.076046 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f85a729-0691-4a36-a28f-e4e6c12c2a34 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:13.076787 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f85a729-0691-4a36-a28f-e4e6c12c2a34 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:13.078146 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f85a729-0691-4a36-a28f-e4e6c12c2a34 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:13.079237 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f85a729-0691-4a36-a28f-e4e6c12c2a34 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:13.079768 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f85a729-0691-4a36-a28f-e4e6c12c2a34 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:13.080209 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f85a729-0691-4a36-a28f-e4e6c12c2a34 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:13.083629 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0eab780b-71cf-4042-8a22-fb23d2b4c47a tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] 10.222.0.13 "GET /compute/v2.1/servers/d444d587-7d6e-498e-9770-6ac5f8fbd0e1" status: 200 len: 1320 microversion: 2.1 time: 0.316551 Oct 30 01:17:13.085271 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 554/1115] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:12 2022] GET /compute/v2.1/servers/d444d587-7d6e-498e-9770-6ac5f8fbd0e1 => generated 1320 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:13.160318 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3192ee56-7a1b-4590-8969-0461efa60032 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:13.161391 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3192ee56-7a1b-4590-8969-0461efa60032 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: 04619e4f-8b79-4196-9794-f27d605c4328] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:13.171121 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3192ee56-7a1b-4590-8969-0461efa60032 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:13.178746 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3192ee56-7a1b-4590-8969-0461efa60032 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:13.180595 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3192ee56-7a1b-4590-8969-0461efa60032 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:13.185665 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3192ee56-7a1b-4590-8969-0461efa60032 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:13.186219 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3192ee56-7a1b-4590-8969-0461efa60032 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:13.186668 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3192ee56-7a1b-4590-8969-0461efa60032 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:13.303546 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5f85a729-0691-4a36-a28f-e4e6c12c2a34 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:13.319971 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5f85a729-0691-4a36-a28f-e4e6c12c2a34 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/50f83abd-f45c-4217-8130-30a7bebd08b9" status: 200 len: 1316 microversion: 2.1 time: 0.263225 Oct 30 01:17:13.320566 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 562/1116] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:13 2022] GET /compute/v2.1/servers/50f83abd-f45c-4217-8130-30a7bebd08b9 => generated 1316 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:13.326486 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-083436fc-bd77-49bd-9cf9-e5543842d77a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:13.327348 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-083436fc-bd77-49bd-9cf9-e5543842d77a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:13.335062 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-083436fc-bd77-49bd-9cf9-e5543842d77a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:13.335818 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-083436fc-bd77-49bd-9cf9-e5543842d77a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:13.336439 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-083436fc-bd77-49bd-9cf9-e5543842d77a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:13.337170 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-083436fc-bd77-49bd-9cf9-e5543842d77a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:13.349022 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-083436fc-bd77-49bd-9cf9-e5543842d77a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:13.353883 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-083436fc-bd77-49bd-9cf9-e5543842d77a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:13.369509 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3192ee56-7a1b-4590-8969-0461efa60032 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f11109f32d4013aed5ab9320d8295b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e2bdadb00745888a171041c5714bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:13.381699 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3192ee56-7a1b-4590-8969-0461efa60032 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] 10.222.0.13 "GET /compute/v2.1/servers/04619e4f-8b79-4196-9794-f27d605c4328" status: 200 len: 1324 microversion: 2.1 time: 0.224840 Oct 30 01:17:13.393677 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 555/1117] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:13 2022] GET /compute/v2.1/servers/04619e4f-8b79-4196-9794-f27d605c4328 => generated 1324 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:17:13.507333 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-083436fc-bd77-49bd-9cf9-e5543842d77a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:13.515437 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-083436fc-bd77-49bd-9cf9-e5543842d77a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1471 microversion: 2.1 time: 0.193673 Oct 30 01:17:13.517714 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 563/1118] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:13 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1471 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:13.650743 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-fbcfd07b-aeda-4cda-b38b-25049e396232 req-bc617999-0c91-49b4-ac03-939af904eb8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04619e4f-8b79-4196-9794-f27d605c4328", "tag": "6a9b0f09-5783-40cf-a067-b3a5f5f29ea0"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:13.661635 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-fbcfd07b-aeda-4cda-b38b-25049e396232 req-bc617999-0c91-49b4-ac03-939af904eb8e service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:13.662110 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-fbcfd07b-aeda-4cda-b38b-25049e396232 req-bc617999-0c91-49b4-ac03-939af904eb8e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:13.662532 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-fbcfd07b-aeda-4cda-b38b-25049e396232 req-bc617999-0c91-49b4-ac03-939af904eb8e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:13.673804 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-fbcfd07b-aeda-4cda-b38b-25049e396232 req-bc617999-0c91-49b4-ac03-939af904eb8e service nova] Creating event network-changed:6a9b0f09-5783-40cf-a067-b3a5f5f29ea0 for instance 04619e4f-8b79-4196-9794-f27d605c4328 on n-h2-master-1 Oct 30 01:17:13.679358 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-fbcfd07b-aeda-4cda-b38b-25049e396232 req-bc617999-0c91-49b4-ac03-939af904eb8e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032689 Oct 30 01:17:13.680108 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 556/1119] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:17:13.773076 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f280cad9-548d-420d-8a1c-b7883ba89677 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:13.773660 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f280cad9-548d-420d-8a1c-b7883ba89677 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:13.781109 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f280cad9-548d-420d-8a1c-b7883ba89677 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:13.781647 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f280cad9-548d-420d-8a1c-b7883ba89677 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:13.782082 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f280cad9-548d-420d-8a1c-b7883ba89677 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:13.782844 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f280cad9-548d-420d-8a1c-b7883ba89677 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:13.783344 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f280cad9-548d-420d-8a1c-b7883ba89677 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:13.783770 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f280cad9-548d-420d-8a1c-b7883ba89677 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:13.927422 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f280cad9-548d-420d-8a1c-b7883ba89677 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:13.935570 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f280cad9-548d-420d-8a1c-b7883ba89677 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1476 microversion: 2.1 time: 0.166639 Oct 30 01:17:13.936217 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 564/1120] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:13 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1476 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:17:14.062655 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5cfa71ee-fc0f-4f1c-b2e5-235b28d8c550 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:14.063221 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5cfa71ee-fc0f-4f1c-b2e5-235b28d8c550 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:14.069945 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5cfa71ee-fc0f-4f1c-b2e5-235b28d8c550 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:14.070432 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5cfa71ee-fc0f-4f1c-b2e5-235b28d8c550 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:14.070862 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5cfa71ee-fc0f-4f1c-b2e5-235b28d8c550 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:14.071568 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5cfa71ee-fc0f-4f1c-b2e5-235b28d8c550 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:14.072019 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5cfa71ee-fc0f-4f1c-b2e5-235b28d8c550 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:14.072439 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5cfa71ee-fc0f-4f1c-b2e5-235b28d8c550 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:14.112631 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-94fb3eda-f223-43c5-be66-467bf05f7e02 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:14.113855 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-94fb3eda-f223-43c5-be66-467bf05f7e02 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] [instance: d444d587-7d6e-498e-9770-6ac5f8fbd0e1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:14.127346 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94fb3eda-f223-43c5-be66-467bf05f7e02 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:14.127857 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94fb3eda-f223-43c5-be66-467bf05f7e02 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:14.128338 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94fb3eda-f223-43c5-be66-467bf05f7e02 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:14.129070 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94fb3eda-f223-43c5-be66-467bf05f7e02 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:14.129619 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94fb3eda-f223-43c5-be66-467bf05f7e02 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:14.130083 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94fb3eda-f223-43c5-be66-467bf05f7e02 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:14.294693 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5cfa71ee-fc0f-4f1c-b2e5-235b28d8c550 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:14.303683 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5cfa71ee-fc0f-4f1c-b2e5-235b28d8c550 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd" status: 200 len: 1716 microversion: 2.1 time: 0.245864 Oct 30 01:17:14.304718 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 557/1121] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:14 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd => generated 1716 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:17:14.323303 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-94fb3eda-f223-43c5-be66-467bf05f7e02 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d87ef57cf344734b662bd792022c4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea74354a0b4753a363fc5d4f6d4f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:14.331596 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-94fb3eda-f223-43c5-be66-467bf05f7e02 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] 10.222.0.13 "GET /compute/v2.1/servers/d444d587-7d6e-498e-9770-6ac5f8fbd0e1" status: 200 len: 1320 microversion: 2.1 time: 0.226743 Oct 30 01:17:14.332188 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 565/1122] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:14 2022] GET /compute/v2.1/servers/d444d587-7d6e-498e-9770-6ac5f8fbd0e1 => generated 1320 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:14.343395 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-82b09573-cb2e-4f00-8d9f-917f74215142 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:14.344312 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-82b09573-cb2e-4f00-8d9f-917f74215142 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 50f83abd-f45c-4217-8130-30a7bebd08b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:14.350753 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=5 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:17:14.351663 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:17:14.353662 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-82b09573-cb2e-4f00-8d9f-917f74215142 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:14.354304 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-82b09573-cb2e-4f00-8d9f-917f74215142 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:14.354809 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-82b09573-cb2e-4f00-8d9f-917f74215142 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:14.355625 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-82b09573-cb2e-4f00-8d9f-917f74215142 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:14.356280 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-82b09573-cb2e-4f00-8d9f-917f74215142 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:14.360903 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-82b09573-cb2e-4f00-8d9f-917f74215142 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:14.377596 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:17:14.410739 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-eef34032-9a73-4a72-a9ac-632effdd6e46 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:14.412308 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-eef34032-9a73-4a72-a9ac-632effdd6e46 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: 04619e4f-8b79-4196-9794-f27d605c4328] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:14.419138 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eef34032-9a73-4a72-a9ac-632effdd6e46 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:14.419695 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eef34032-9a73-4a72-a9ac-632effdd6e46 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:14.420275 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eef34032-9a73-4a72-a9ac-632effdd6e46 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:14.421248 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eef34032-9a73-4a72-a9ac-632effdd6e46 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:14.421830 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eef34032-9a73-4a72-a9ac-632effdd6e46 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:14.422362 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eef34032-9a73-4a72-a9ac-632effdd6e46 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:14.576085 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-82b09573-cb2e-4f00-8d9f-917f74215142 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:14.586425 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-82b09573-cb2e-4f00-8d9f-917f74215142 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/50f83abd-f45c-4217-8130-30a7bebd08b9" status: 200 len: 1316 microversion: 2.1 time: 0.247235 Oct 30 01:17:14.600879 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 558/1123] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:14 2022] GET /compute/v2.1/servers/50f83abd-f45c-4217-8130-30a7bebd08b9 => generated 1316 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:17:14.610154 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3d2b2213-2da8-4160-a704-3cf2f298d5ef tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:14.610154 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3d2b2213-2da8-4160-a704-3cf2f298d5ef tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:14.617371 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d2b2213-2da8-4160-a704-3cf2f298d5ef tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:14.618064 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d2b2213-2da8-4160-a704-3cf2f298d5ef tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:14.618626 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d2b2213-2da8-4160-a704-3cf2f298d5ef tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:14.619632 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d2b2213-2da8-4160-a704-3cf2f298d5ef tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:14.620365 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d2b2213-2da8-4160-a704-3cf2f298d5ef tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:14.620953 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d2b2213-2da8-4160-a704-3cf2f298d5ef tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:14.627276 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-eef34032-9a73-4a72-a9ac-632effdd6e46 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f11109f32d4013aed5ab9320d8295b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e2bdadb00745888a171041c5714bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:14.636716 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-eef34032-9a73-4a72-a9ac-632effdd6e46 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] 10.222.0.13 "GET /compute/v2.1/servers/04619e4f-8b79-4196-9794-f27d605c4328" status: 200 len: 1324 microversion: 2.1 time: 0.229877 Oct 30 01:17:14.646361 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 566/1124] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:14 2022] GET /compute/v2.1/servers/04619e4f-8b79-4196-9794-f27d605c4328 => generated 1324 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:14.659674 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-d3492354-67dc-4dff-946b-05e49aa75257 req-d424dcf4-a14f-4090-8a9e-a9857ef7e1c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d444d587-7d6e-498e-9770-6ac5f8fbd0e1", "name": "network-vif-plugged", "status": "completed", "tag": "13f52f67-7cfe-43f7-b294-bbbec18aab84"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:14.672765 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d3492354-67dc-4dff-946b-05e49aa75257 req-d424dcf4-a14f-4090-8a9e-a9857ef7e1c3 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:14.673255 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d3492354-67dc-4dff-946b-05e49aa75257 req-d424dcf4-a14f-4090-8a9e-a9857ef7e1c3 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:14.673824 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d3492354-67dc-4dff-946b-05e49aa75257 req-d424dcf4-a14f-4090-8a9e-a9857ef7e1c3 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:14.687216 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-d3492354-67dc-4dff-946b-05e49aa75257 req-d424dcf4-a14f-4090-8a9e-a9857ef7e1c3 service nova] Creating event network-vif-plugged:13f52f67-7cfe-43f7-b294-bbbec18aab84 for instance d444d587-7d6e-498e-9770-6ac5f8fbd0e1 on n-h1-master-1 Oct 30 01:17:14.693917 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-d3492354-67dc-4dff-946b-05e49aa75257 req-d424dcf4-a14f-4090-8a9e-a9857ef7e1c3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045555 Oct 30 01:17:14.694504 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 567/1125] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:17:14.788528 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3d2b2213-2da8-4160-a704-3cf2f298d5ef tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:14.798487 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3d2b2213-2da8-4160-a704-3cf2f298d5ef tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1471 microversion: 2.1 time: 0.196164 Oct 30 01:17:14.799463 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 559/1126] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:14 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1471 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:14.960583 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c0ff3676-cbfa-4755-ad3c-f47c5c6458b2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:14.961298 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c0ff3676-cbfa-4755-ad3c-f47c5c6458b2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:14.964283 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=12 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:17:14.970096 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0ff3676-cbfa-4755-ad3c-f47c5c6458b2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:14.970594 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0ff3676-cbfa-4755-ad3c-f47c5c6458b2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:14.973507 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0ff3676-cbfa-4755-ad3c-f47c5c6458b2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:14.973507 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0ff3676-cbfa-4755-ad3c-f47c5c6458b2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:14.973507 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0ff3676-cbfa-4755-ad3c-f47c5c6458b2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:14.973507 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0ff3676-cbfa-4755-ad3c-f47c5c6458b2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:15.119757 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c0ff3676-cbfa-4755-ad3c-f47c5c6458b2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:15.128033 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c0ff3676-cbfa-4755-ad3c-f47c5c6458b2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1476 microversion: 2.1 time: 0.171999 Oct 30 01:17:15.128615 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 568/1127] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:14 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1476 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:15.332130 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-74efbbca-4362-4074-895a-d52f573459e5 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:15.333318 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-74efbbca-4362-4074-895a-d52f573459e5 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:15.336862 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=13 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:17:15.346165 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-74efbbca-4362-4074-895a-d52f573459e5 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:15.347071 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-74efbbca-4362-4074-895a-d52f573459e5 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:15.348960 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-74efbbca-4362-4074-895a-d52f573459e5 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:15.349833 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-74efbbca-4362-4074-895a-d52f573459e5 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:15.350529 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-74efbbca-4362-4074-895a-d52f573459e5 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:15.350939 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-74efbbca-4362-4074-895a-d52f573459e5 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:15.355922 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5f6d4d9e-37f6-4b00-a84b-40ffeb1bdad5 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:15.356929 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5f6d4d9e-37f6-4b00-a84b-40ffeb1bdad5 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] [instance: d444d587-7d6e-498e-9770-6ac5f8fbd0e1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:15.363879 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f6d4d9e-37f6-4b00-a84b-40ffeb1bdad5 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:15.364951 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f6d4d9e-37f6-4b00-a84b-40ffeb1bdad5 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:15.365505 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f6d4d9e-37f6-4b00-a84b-40ffeb1bdad5 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:15.366130 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f6d4d9e-37f6-4b00-a84b-40ffeb1bdad5 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:15.366580 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f6d4d9e-37f6-4b00-a84b-40ffeb1bdad5 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:15.367020 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f6d4d9e-37f6-4b00-a84b-40ffeb1bdad5 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:15.565286 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-74efbbca-4362-4074-895a-d52f573459e5 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:15.568139 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5f6d4d9e-37f6-4b00-a84b-40ffeb1bdad5 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d87ef57cf344734b662bd792022c4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea74354a0b4753a363fc5d4f6d4f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:15.574339 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-74efbbca-4362-4074-895a-d52f573459e5 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd" status: 200 len: 1716 microversion: 2.1 time: 0.249968 Oct 30 01:17:15.574936 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 560/1128] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:15 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd => generated 1716 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:15.576105 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5f6d4d9e-37f6-4b00-a84b-40ffeb1bdad5 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] 10.222.0.13 "GET /compute/v2.1/servers/d444d587-7d6e-498e-9770-6ac5f8fbd0e1" status: 200 len: 1320 microversion: 2.1 time: 0.224094 Oct 30 01:17:15.576675 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 569/1129] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:15 2022] GET /compute/v2.1/servers/d444d587-7d6e-498e-9770-6ac5f8fbd0e1 => generated 1320 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:15.616357 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-27acc1b9-c54d-49e1-9e39-7acfc50badf1 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:15.616961 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-27acc1b9-c54d-49e1-9e39-7acfc50badf1 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 50f83abd-f45c-4217-8130-30a7bebd08b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:15.623928 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27acc1b9-c54d-49e1-9e39-7acfc50badf1 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:15.624410 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27acc1b9-c54d-49e1-9e39-7acfc50badf1 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:15.624837 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27acc1b9-c54d-49e1-9e39-7acfc50badf1 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:15.625576 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27acc1b9-c54d-49e1-9e39-7acfc50badf1 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:15.626025 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27acc1b9-c54d-49e1-9e39-7acfc50badf1 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:15.626441 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27acc1b9-c54d-49e1-9e39-7acfc50badf1 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:15.664274 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3bc5a8a4-b913-4348-b233-ae62915959b4 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:15.664902 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3bc5a8a4-b913-4348-b233-ae62915959b4 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: 04619e4f-8b79-4196-9794-f27d605c4328] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:15.666794 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=17 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:17:15.682303 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3bc5a8a4-b913-4348-b233-ae62915959b4 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:15.682816 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3bc5a8a4-b913-4348-b233-ae62915959b4 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:15.683258 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3bc5a8a4-b913-4348-b233-ae62915959b4 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:15.684168 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3bc5a8a4-b913-4348-b233-ae62915959b4 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:15.684836 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3bc5a8a4-b913-4348-b233-ae62915959b4 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:15.685269 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3bc5a8a4-b913-4348-b233-ae62915959b4 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:15.818763 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-27acc1b9-c54d-49e1-9e39-7acfc50badf1 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:15.831214 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-27acc1b9-c54d-49e1-9e39-7acfc50badf1 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/50f83abd-f45c-4217-8130-30a7bebd08b9" status: 200 len: 1316 microversion: 2.1 time: 0.218611 Oct 30 01:17:15.832414 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 561/1130] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:15 2022] GET /compute/v2.1/servers/50f83abd-f45c-4217-8130-30a7bebd08b9 => generated 1316 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:15.845127 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bbc785f8-c69a-475a-b548-f69768d13ea2 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:15.846384 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bbc785f8-c69a-475a-b548-f69768d13ea2 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:15.855229 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bbc785f8-c69a-475a-b548-f69768d13ea2 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:15.856307 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bbc785f8-c69a-475a-b548-f69768d13ea2 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:15.856926 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bbc785f8-c69a-475a-b548-f69768d13ea2 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:15.858212 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bbc785f8-c69a-475a-b548-f69768d13ea2 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:15.858699 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bbc785f8-c69a-475a-b548-f69768d13ea2 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:15.859118 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bbc785f8-c69a-475a-b548-f69768d13ea2 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:15.860967 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3bc5a8a4-b913-4348-b233-ae62915959b4 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f11109f32d4013aed5ab9320d8295b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e2bdadb00745888a171041c5714bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:15.869630 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3bc5a8a4-b913-4348-b233-ae62915959b4 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] 10.222.0.13 "GET /compute/v2.1/servers/04619e4f-8b79-4196-9794-f27d605c4328" status: 200 len: 1324 microversion: 2.1 time: 0.210069 Oct 30 01:17:15.870614 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 570/1131] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:15 2022] GET /compute/v2.1/servers/04619e4f-8b79-4196-9794-f27d605c4328 => generated 1324 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:17:16.011443 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bbc785f8-c69a-475a-b548-f69768d13ea2 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:16.019349 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bbc785f8-c69a-475a-b548-f69768d13ea2 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1471 microversion: 2.1 time: 0.184889 Oct 30 01:17:16.019921 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 562/1132] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:15 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1471 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:16.152939 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-023eaea9-8591-4a1f-9900-a0b5857154f0 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:16.153593 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-023eaea9-8591-4a1f-9900-a0b5857154f0 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:16.160865 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-023eaea9-8591-4a1f-9900-a0b5857154f0 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:16.161385 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-023eaea9-8591-4a1f-9900-a0b5857154f0 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:16.161828 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-023eaea9-8591-4a1f-9900-a0b5857154f0 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:16.162544 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-023eaea9-8591-4a1f-9900-a0b5857154f0 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:16.163001 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-023eaea9-8591-4a1f-9900-a0b5857154f0 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:16.163428 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-023eaea9-8591-4a1f-9900-a0b5857154f0 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:16.300497 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-023eaea9-8591-4a1f-9900-a0b5857154f0 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:16.309305 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-023eaea9-8591-4a1f-9900-a0b5857154f0 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1476 microversion: 2.1 time: 0.160212 Oct 30 01:17:16.310051 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 571/1133] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:16 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1476 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:16.598485 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-52670464-941a-4b47-95d0-e16db786d76d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:16.599109 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-52670464-941a-4b47-95d0-e16db786d76d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:16.599419 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-38a0e5e6-768c-4f7e-ad3a-961b6038d912 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:16.600052 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-38a0e5e6-768c-4f7e-ad3a-961b6038d912 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] [instance: d444d587-7d6e-498e-9770-6ac5f8fbd0e1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:16.605633 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-52670464-941a-4b47-95d0-e16db786d76d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:16.606072 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-52670464-941a-4b47-95d0-e16db786d76d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:16.606504 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-52670464-941a-4b47-95d0-e16db786d76d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:16.606870 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38a0e5e6-768c-4f7e-ad3a-961b6038d912 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:16.607209 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-52670464-941a-4b47-95d0-e16db786d76d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:16.607355 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38a0e5e6-768c-4f7e-ad3a-961b6038d912 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:16.607669 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-52670464-941a-4b47-95d0-e16db786d76d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:16.607783 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38a0e5e6-768c-4f7e-ad3a-961b6038d912 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:16.608091 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-52670464-941a-4b47-95d0-e16db786d76d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:16.608500 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38a0e5e6-768c-4f7e-ad3a-961b6038d912 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:16.608956 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38a0e5e6-768c-4f7e-ad3a-961b6038d912 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:16.609414 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38a0e5e6-768c-4f7e-ad3a-961b6038d912 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:16.626836 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=100 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:17:16.817287 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-52670464-941a-4b47-95d0-e16db786d76d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:16.823237 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-38a0e5e6-768c-4f7e-ad3a-961b6038d912 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d87ef57cf344734b662bd792022c4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea74354a0b4753a363fc5d4f6d4f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:16.827619 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-52670464-941a-4b47-95d0-e16db786d76d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd" status: 200 len: 1716 microversion: 2.1 time: 0.233217 Oct 30 01:17:16.833976 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 563/1134] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:16 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd => generated 1716 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:16.841498 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-38a0e5e6-768c-4f7e-ad3a-961b6038d912 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] 10.222.0.13 "GET /compute/v2.1/servers/d444d587-7d6e-498e-9770-6ac5f8fbd0e1" status: 200 len: 1469 microversion: 2.1 time: 0.245844 Oct 30 01:17:16.845791 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 572/1135] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:16 2022] GET /compute/v2.1/servers/d444d587-7d6e-498e-9770-6ac5f8fbd0e1 => generated 1469 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:16.861711 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-08bce6bb-4b64-434c-9070-6998d98f700e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:16.862648 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-08bce6bb-4b64-434c-9070-6998d98f700e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 50f83abd-f45c-4217-8130-30a7bebd08b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:16.871083 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08bce6bb-4b64-434c-9070-6998d98f700e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:16.871579 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08bce6bb-4b64-434c-9070-6998d98f700e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:16.872006 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08bce6bb-4b64-434c-9070-6998d98f700e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:16.872888 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08bce6bb-4b64-434c-9070-6998d98f700e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:16.873601 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08bce6bb-4b64-434c-9070-6998d98f700e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:16.874176 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08bce6bb-4b64-434c-9070-6998d98f700e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:16.944472 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d885b085-41d5-4fce-a9ef-08e68f0ec65f tempest-DeleteServersAdminTestJSON-1308973293 tempest-DeleteServersAdminTestJSON-1308973293-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:16.944992 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d885b085-41d5-4fce-a9ef-08e68f0ec65f tempest-DeleteServersAdminTestJSON-1308973293 tempest-DeleteServersAdminTestJSON-1308973293-project-admin] [instance: d444d587-7d6e-498e-9770-6ac5f8fbd0e1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:16.953868 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d885b085-41d5-4fce-a9ef-08e68f0ec65f tempest-DeleteServersAdminTestJSON-1308973293 tempest-DeleteServersAdminTestJSON-1308973293-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:16.954484 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d885b085-41d5-4fce-a9ef-08e68f0ec65f tempest-DeleteServersAdminTestJSON-1308973293 tempest-DeleteServersAdminTestJSON-1308973293-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:16.955752 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d885b085-41d5-4fce-a9ef-08e68f0ec65f tempest-DeleteServersAdminTestJSON-1308973293 tempest-DeleteServersAdminTestJSON-1308973293-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:16.956520 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d885b085-41d5-4fce-a9ef-08e68f0ec65f tempest-DeleteServersAdminTestJSON-1308973293 tempest-DeleteServersAdminTestJSON-1308973293-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:16.956988 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d885b085-41d5-4fce-a9ef-08e68f0ec65f tempest-DeleteServersAdminTestJSON-1308973293 tempest-DeleteServersAdminTestJSON-1308973293-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:16.957445 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d885b085-41d5-4fce-a9ef-08e68f0ec65f tempest-DeleteServersAdminTestJSON-1308973293 tempest-DeleteServersAdminTestJSON-1308973293-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:16.992948 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d885b085-41d5-4fce-a9ef-08e68f0ec65f tempest-DeleteServersAdminTestJSON-1308973293 tempest-DeleteServersAdminTestJSON-1308973293-project-admin] [instance: d444d587-7d6e-498e-9770-6ac5f8fbd0e1] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:17:17.054468 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-08bce6bb-4b64-434c-9070-6998d98f700e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:17.064040 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-08bce6bb-4b64-434c-9070-6998d98f700e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/50f83abd-f45c-4217-8130-30a7bebd08b9" status: 200 len: 1316 microversion: 2.1 time: 0.208584 Oct 30 01:17:17.065173 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 564/1136] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:16 2022] GET /compute/v2.1/servers/50f83abd-f45c-4217-8130-30a7bebd08b9 => generated 1316 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:17.070156 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1383dcf2-5663-4033-9735-7a3dc76f4de4 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:17.070772 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1383dcf2-5663-4033-9735-7a3dc76f4de4 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: 04619e4f-8b79-4196-9794-f27d605c4328] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:17.080162 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1383dcf2-5663-4033-9735-7a3dc76f4de4 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:17.080162 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1383dcf2-5663-4033-9735-7a3dc76f4de4 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:17.080162 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1383dcf2-5663-4033-9735-7a3dc76f4de4 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:17.080162 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1383dcf2-5663-4033-9735-7a3dc76f4de4 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:17.092515 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1383dcf2-5663-4033-9735-7a3dc76f4de4 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:17.092515 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1383dcf2-5663-4033-9735-7a3dc76f4de4 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:17.219933 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1383dcf2-5663-4033-9735-7a3dc76f4de4 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f11109f32d4013aed5ab9320d8295b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e2bdadb00745888a171041c5714bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:17.229281 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1383dcf2-5663-4033-9735-7a3dc76f4de4 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] 10.222.0.13 "GET /compute/v2.1/servers/04619e4f-8b79-4196-9794-f27d605c4328" status: 200 len: 1324 microversion: 2.1 time: 0.162850 Oct 30 01:17:17.229996 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 565/1137] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:17 2022] GET /compute/v2.1/servers/04619e4f-8b79-4196-9794-f27d605c4328 => generated 1324 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:17.234924 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5c0497cc-bbc8-4ffd-8790-3a3b23d0cc2d tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:17.235498 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5c0497cc-bbc8-4ffd-8790-3a3b23d0cc2d tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:17.245373 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c0497cc-bbc8-4ffd-8790-3a3b23d0cc2d tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:17.245873 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c0497cc-bbc8-4ffd-8790-3a3b23d0cc2d tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:17.246321 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c0497cc-bbc8-4ffd-8790-3a3b23d0cc2d tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:17.247036 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c0497cc-bbc8-4ffd-8790-3a3b23d0cc2d tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:17.247496 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c0497cc-bbc8-4ffd-8790-3a3b23d0cc2d tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:17.247930 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c0497cc-bbc8-4ffd-8790-3a3b23d0cc2d tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:17.406189 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d885b085-41d5-4fce-a9ef-08e68f0ec65f tempest-DeleteServersAdminTestJSON-1308973293 tempest-DeleteServersAdminTestJSON-1308973293-project-admin] 10.222.0.13 "DELETE /compute/v2.1/servers/d444d587-7d6e-498e-9770-6ac5f8fbd0e1" status: 204 len: 0 microversion: 2.1 time: 0.537837 Oct 30 01:17:17.406809 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 573/1138] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:17:16 2022] DELETE /compute/v2.1/servers/d444d587-7d6e-498e-9770-6ac5f8fbd0e1 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 30 01:17:17.409676 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5c0497cc-bbc8-4ffd-8790-3a3b23d0cc2d tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:17.415647 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-45a7041f-afe5-418b-92d8-e87c99688868 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:17.416358 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-45a7041f-afe5-418b-92d8-e87c99688868 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:17.420638 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5c0497cc-bbc8-4ffd-8790-3a3b23d0cc2d tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1471 microversion: 2.1 time: 0.189619 Oct 30 01:17:17.421667 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 566/1139] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:17 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1471 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:17.422312 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45a7041f-afe5-418b-92d8-e87c99688868 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:17.422807 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45a7041f-afe5-418b-92d8-e87c99688868 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:17.423346 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45a7041f-afe5-418b-92d8-e87c99688868 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:17.423954 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45a7041f-afe5-418b-92d8-e87c99688868 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:17.424410 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45a7041f-afe5-418b-92d8-e87c99688868 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:17.424835 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45a7041f-afe5-418b-92d8-e87c99688868 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:17.437755 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b4b17c7e-7b5a-455b-8a04-05eaa6339280 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:17.438615 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b4b17c7e-7b5a-455b-8a04-05eaa6339280 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] [instance: d444d587-7d6e-498e-9770-6ac5f8fbd0e1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:17.448377 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b4b17c7e-7b5a-455b-8a04-05eaa6339280 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:17.448377 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b4b17c7e-7b5a-455b-8a04-05eaa6339280 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:17.448377 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b4b17c7e-7b5a-455b-8a04-05eaa6339280 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:17.448377 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b4b17c7e-7b5a-455b-8a04-05eaa6339280 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:17.448782 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b4b17c7e-7b5a-455b-8a04-05eaa6339280 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:17.448782 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b4b17c7e-7b5a-455b-8a04-05eaa6339280 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:17.642332 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-45a7041f-afe5-418b-92d8-e87c99688868 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:17.644306 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b4b17c7e-7b5a-455b-8a04-05eaa6339280 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d87ef57cf344734b662bd792022c4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea74354a0b4753a363fc5d4f6d4f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:17.647981 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-45a7041f-afe5-418b-92d8-e87c99688868 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1476 microversion: 2.1 time: 0.237120 Oct 30 01:17:17.648565 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 574/1140] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:17 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1476 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:17.652808 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b4b17c7e-7b5a-455b-8a04-05eaa6339280 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] 10.222.0.13 "GET /compute/v2.1/servers/d444d587-7d6e-498e-9770-6ac5f8fbd0e1" status: 200 len: 1475 microversion: 2.1 time: 0.230527 Oct 30 01:17:17.653392 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 567/1141] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:17 2022] GET /compute/v2.1/servers/d444d587-7d6e-498e-9770-6ac5f8fbd0e1 => generated 1475 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:17.852662 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1bcb36f1-9584-48b1-8ab3-fe2a60ff78b2 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:17.853282 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1bcb36f1-9584-48b1-8ab3-fe2a60ff78b2 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:17.860005 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1bcb36f1-9584-48b1-8ab3-fe2a60ff78b2 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:17.860506 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1bcb36f1-9584-48b1-8ab3-fe2a60ff78b2 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:17.861002 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1bcb36f1-9584-48b1-8ab3-fe2a60ff78b2 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:17.861743 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1bcb36f1-9584-48b1-8ab3-fe2a60ff78b2 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:17.862201 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1bcb36f1-9584-48b1-8ab3-fe2a60ff78b2 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:17.862626 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1bcb36f1-9584-48b1-8ab3-fe2a60ff78b2 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:18.003580 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1bcb36f1-9584-48b1-8ab3-fe2a60ff78b2 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:18.013635 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1bcb36f1-9584-48b1-8ab3-fe2a60ff78b2 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd" status: 200 len: 1716 microversion: 2.1 time: 0.164948 Oct 30 01:17:18.014228 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 575/1142] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:17 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd => generated 1716 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:18.087640 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ae041723-c8f3-4eef-bbcc-dc50d04363d7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:18.088454 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ae041723-c8f3-4eef-bbcc-dc50d04363d7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 50f83abd-f45c-4217-8130-30a7bebd08b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:18.096442 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae041723-c8f3-4eef-bbcc-dc50d04363d7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:18.097013 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae041723-c8f3-4eef-bbcc-dc50d04363d7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:18.097560 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae041723-c8f3-4eef-bbcc-dc50d04363d7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:18.098377 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae041723-c8f3-4eef-bbcc-dc50d04363d7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:18.098901 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae041723-c8f3-4eef-bbcc-dc50d04363d7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:18.099403 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae041723-c8f3-4eef-bbcc-dc50d04363d7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:18.241318 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ae041723-c8f3-4eef-bbcc-dc50d04363d7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:18.249360 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ae041723-c8f3-4eef-bbcc-dc50d04363d7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/50f83abd-f45c-4217-8130-30a7bebd08b9" status: 200 len: 1316 microversion: 2.1 time: 0.165756 Oct 30 01:17:18.250095 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 568/1143] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:18 2022] GET /compute/v2.1/servers/50f83abd-f45c-4217-8130-30a7bebd08b9 => generated 1316 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:17:18.252549 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-58ebc214-88fd-4cfd-9ff0-ac064d34da2b tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:18.253260 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-58ebc214-88fd-4cfd-9ff0-ac064d34da2b tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: 04619e4f-8b79-4196-9794-f27d605c4328] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:18.260076 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58ebc214-88fd-4cfd-9ff0-ac064d34da2b tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:18.260560 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58ebc214-88fd-4cfd-9ff0-ac064d34da2b tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:18.262742 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58ebc214-88fd-4cfd-9ff0-ac064d34da2b tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:18.262742 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58ebc214-88fd-4cfd-9ff0-ac064d34da2b tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:18.262742 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58ebc214-88fd-4cfd-9ff0-ac064d34da2b tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:18.262742 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58ebc214-88fd-4cfd-9ff0-ac064d34da2b tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:18.398523 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-58ebc214-88fd-4cfd-9ff0-ac064d34da2b tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f11109f32d4013aed5ab9320d8295b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e2bdadb00745888a171041c5714bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:18.406616 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-58ebc214-88fd-4cfd-9ff0-ac064d34da2b tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] 10.222.0.13 "GET /compute/v2.1/servers/04619e4f-8b79-4196-9794-f27d605c4328" status: 200 len: 1324 microversion: 2.1 time: 0.158391 Oct 30 01:17:18.407228 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 576/1144] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:18 2022] GET /compute/v2.1/servers/04619e4f-8b79-4196-9794-f27d605c4328 => generated 1324 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:17:18.444302 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-88249e5d-679d-4a6e-920d-45c2f2c3e5f4 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:18.444946 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-88249e5d-679d-4a6e-920d-45c2f2c3e5f4 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:18.451590 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-88249e5d-679d-4a6e-920d-45c2f2c3e5f4 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:18.452351 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-88249e5d-679d-4a6e-920d-45c2f2c3e5f4 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:18.453876 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-88249e5d-679d-4a6e-920d-45c2f2c3e5f4 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:18.454798 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-88249e5d-679d-4a6e-920d-45c2f2c3e5f4 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:18.455418 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-88249e5d-679d-4a6e-920d-45c2f2c3e5f4 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:18.456568 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-88249e5d-679d-4a6e-920d-45c2f2c3e5f4 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:18.603494 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-88249e5d-679d-4a6e-920d-45c2f2c3e5f4 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:18.611407 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-88249e5d-679d-4a6e-920d-45c2f2c3e5f4 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1489 microversion: 2.1 time: 0.171095 Oct 30 01:17:18.611971 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 569/1145] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:18 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1489 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:17:18.673149 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-25eed8d0-1640-4746-8f82-06c445239094 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:18.673814 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-25eed8d0-1640-4746-8f82-06c445239094 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:18.682133 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-455196b7-5724-4faa-b46c-cdb9fbe22158 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:18.682612 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:17:18.683455 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-455196b7-5724-4faa-b46c-cdb9fbe22158 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] [instance: d444d587-7d6e-498e-9770-6ac5f8fbd0e1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:18.690554 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-25eed8d0-1640-4746-8f82-06c445239094 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:18.691245 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-455196b7-5724-4faa-b46c-cdb9fbe22158 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:18.691517 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-25eed8d0-1640-4746-8f82-06c445239094 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:18.691517 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-25eed8d0-1640-4746-8f82-06c445239094 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:18.691858 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-455196b7-5724-4faa-b46c-cdb9fbe22158 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:18.692131 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-455196b7-5724-4faa-b46c-cdb9fbe22158 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:18.692240 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-25eed8d0-1640-4746-8f82-06c445239094 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:18.692818 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-455196b7-5724-4faa-b46c-cdb9fbe22158 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:18.692930 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-25eed8d0-1640-4746-8f82-06c445239094 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:18.693154 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-455196b7-5724-4faa-b46c-cdb9fbe22158 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:18.693315 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-25eed8d0-1640-4746-8f82-06c445239094 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:18.693587 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-455196b7-5724-4faa-b46c-cdb9fbe22158 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:18.900582 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-25eed8d0-1640-4746-8f82-06c445239094 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:18.905265 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-455196b7-5724-4faa-b46c-cdb9fbe22158 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d87ef57cf344734b662bd792022c4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea74354a0b4753a363fc5d4f6d4f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:18.908933 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-25eed8d0-1640-4746-8f82-06c445239094 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1476 microversion: 2.1 time: 0.240056 Oct 30 01:17:18.909562 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 577/1146] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:18 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1476 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:18.914354 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-455196b7-5724-4faa-b46c-cdb9fbe22158 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] 10.222.0.13 "GET /compute/v2.1/servers/d444d587-7d6e-498e-9770-6ac5f8fbd0e1" status: 200 len: 1475 microversion: 2.1 time: 0.241990 Oct 30 01:17:18.915486 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 570/1147] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:18 2022] GET /compute/v2.1/servers/d444d587-7d6e-498e-9770-6ac5f8fbd0e1 => generated 1475 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:19.038588 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c46d514a-7e94-4120-ab59-acd6815e0da9 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:19.039161 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c46d514a-7e94-4120-ab59-acd6815e0da9 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:19.045939 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c46d514a-7e94-4120-ab59-acd6815e0da9 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:19.046346 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c46d514a-7e94-4120-ab59-acd6815e0da9 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:19.046807 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c46d514a-7e94-4120-ab59-acd6815e0da9 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:19.047506 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c46d514a-7e94-4120-ab59-acd6815e0da9 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:19.047967 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c46d514a-7e94-4120-ab59-acd6815e0da9 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:19.048397 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c46d514a-7e94-4120-ab59-acd6815e0da9 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:19.195137 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c46d514a-7e94-4120-ab59-acd6815e0da9 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:19.204871 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c46d514a-7e94-4120-ab59-acd6815e0da9 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd" status: 200 len: 1716 microversion: 2.1 time: 0.170277 Oct 30 01:17:19.205787 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 578/1148] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:19 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd => generated 1716 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:19.274013 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c1bb721d-835a-4b1a-914d-1af1a56ca606 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:19.274623 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c1bb721d-835a-4b1a-914d-1af1a56ca606 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 50f83abd-f45c-4217-8130-30a7bebd08b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:19.288970 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c1bb721d-835a-4b1a-914d-1af1a56ca606 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:19.289500 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c1bb721d-835a-4b1a-914d-1af1a56ca606 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:19.289842 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c1bb721d-835a-4b1a-914d-1af1a56ca606 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:19.290564 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c1bb721d-835a-4b1a-914d-1af1a56ca606 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:19.291052 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c1bb721d-835a-4b1a-914d-1af1a56ca606 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:19.291471 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c1bb721d-835a-4b1a-914d-1af1a56ca606 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:19.431500 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c36fbf9f-d1f7-452e-998d-7854ae14b56d tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:19.432898 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c36fbf9f-d1f7-452e-998d-7854ae14b56d tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: 04619e4f-8b79-4196-9794-f27d605c4328] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:19.441493 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c36fbf9f-d1f7-452e-998d-7854ae14b56d tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:19.442321 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c36fbf9f-d1f7-452e-998d-7854ae14b56d tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:19.442997 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c36fbf9f-d1f7-452e-998d-7854ae14b56d tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:19.443950 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c36fbf9f-d1f7-452e-998d-7854ae14b56d tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:19.444642 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c36fbf9f-d1f7-452e-998d-7854ae14b56d tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:19.445290 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c36fbf9f-d1f7-452e-998d-7854ae14b56d tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:19.698708 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c36fbf9f-d1f7-452e-998d-7854ae14b56d tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f11109f32d4013aed5ab9320d8295b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e2bdadb00745888a171041c5714bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:19.709856 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c36fbf9f-d1f7-452e-998d-7854ae14b56d tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] 10.222.0.13 "GET /compute/v2.1/servers/04619e4f-8b79-4196-9794-f27d605c4328" status: 200 len: 1324 microversion: 2.1 time: 0.283140 Oct 30 01:17:19.712843 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 579/1149] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:19 2022] GET /compute/v2.1/servers/04619e4f-8b79-4196-9794-f27d605c4328 => generated 1324 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:19.717907 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1934df34-f05d-438c-88ff-c29b50e21277 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:19.718953 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1934df34-f05d-438c-88ff-c29b50e21277 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:19.728721 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1934df34-f05d-438c-88ff-c29b50e21277 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:19.729435 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1934df34-f05d-438c-88ff-c29b50e21277 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:19.730020 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1934df34-f05d-438c-88ff-c29b50e21277 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:19.731208 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1934df34-f05d-438c-88ff-c29b50e21277 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:19.731942 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1934df34-f05d-438c-88ff-c29b50e21277 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:19.732583 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1934df34-f05d-438c-88ff-c29b50e21277 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:19.786495 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c1bb721d-835a-4b1a-914d-1af1a56ca606 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:19.796389 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c1bb721d-835a-4b1a-914d-1af1a56ca606 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/50f83abd-f45c-4217-8130-30a7bebd08b9" status: 200 len: 1316 microversion: 2.1 time: 0.526954 Oct 30 01:17:19.798831 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 571/1150] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:19 2022] GET /compute/v2.1/servers/50f83abd-f45c-4217-8130-30a7bebd08b9 => generated 1316 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:19.813855 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-39568db9-9aea-4c4a-b089-7224fe0dd208 req-8801c563-e213-4841-8ef4-b8b5a1002541 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50f83abd-f45c-4217-8130-30a7bebd08b9", "name": "network-vif-plugged", "status": "completed", "tag": "d2f79325-a6b2-470b-8e09-f0e2f2e2fd35"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:19.829693 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-39568db9-9aea-4c4a-b089-7224fe0dd208 req-8801c563-e213-4841-8ef4-b8b5a1002541 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:19.835265 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-39568db9-9aea-4c4a-b089-7224fe0dd208 req-8801c563-e213-4841-8ef4-b8b5a1002541 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:19.838274 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-39568db9-9aea-4c4a-b089-7224fe0dd208 req-8801c563-e213-4841-8ef4-b8b5a1002541 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:19.852420 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-39568db9-9aea-4c4a-b089-7224fe0dd208 req-8801c563-e213-4841-8ef4-b8b5a1002541 service nova] Creating event network-vif-plugged:d2f79325-a6b2-470b-8e09-f0e2f2e2fd35 for instance 50f83abd-f45c-4217-8130-30a7bebd08b9 on n-h2-master-1 Oct 30 01:17:19.859294 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-39568db9-9aea-4c4a-b089-7224fe0dd208 req-8801c563-e213-4841-8ef4-b8b5a1002541 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049806 Oct 30 01:17:19.860518 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 572/1151] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:17:19.867431 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4dc902ca-7ef5-43f6-867d-b90c3e60e223 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:19.868471 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4dc902ca-7ef5-43f6-867d-b90c3e60e223 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:19.875860 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4dc902ca-7ef5-43f6-867d-b90c3e60e223 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:19.876765 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4dc902ca-7ef5-43f6-867d-b90c3e60e223 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:19.877411 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4dc902ca-7ef5-43f6-867d-b90c3e60e223 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:19.878457 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4dc902ca-7ef5-43f6-867d-b90c3e60e223 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:19.879305 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4dc902ca-7ef5-43f6-867d-b90c3e60e223 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:19.880483 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4dc902ca-7ef5-43f6-867d-b90c3e60e223 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:20.063494 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1934df34-f05d-438c-88ff-c29b50e21277 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:20.104051 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1934df34-f05d-438c-88ff-c29b50e21277 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1477 microversion: 2.1 time: 0.391526 Oct 30 01:17:20.105767 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 580/1152] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:19 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1477 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:20.115520 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cc806e55-591e-4957-95ef-29f73edc8d69 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:20.117787 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-cc806e55-591e-4957-95ef-29f73edc8d69 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:20.130616 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cc806e55-591e-4957-95ef-29f73edc8d69 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:20.131661 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cc806e55-591e-4957-95ef-29f73edc8d69 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:20.137594 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cc806e55-591e-4957-95ef-29f73edc8d69 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:20.137594 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cc806e55-591e-4957-95ef-29f73edc8d69 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:20.137594 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cc806e55-591e-4957-95ef-29f73edc8d69 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:20.137594 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cc806e55-591e-4957-95ef-29f73edc8d69 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:20.208692 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-4dc902ca-7ef5-43f6-867d-b90c3e60e223 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lazy-loading 'services' on Instance uuid f3141e23-1b24-4315-aac8-fb785005e789 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:17:20.226178 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4dc902ca-7ef5-43f6-867d-b90c3e60e223 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 200 len: 2343 microversion: 2.25 time: 0.364180 Oct 30 01:17:20.226770 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 573/1153] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:17:19 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 2343 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:17:20.232383 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5e3fba8c-be22-4dac-b5b2-54800c2a9e4c tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:20.233151 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5e3fba8c-be22-4dac-b5b2-54800c2a9e4c tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] [instance: d444d587-7d6e-498e-9770-6ac5f8fbd0e1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:20.240842 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5e3fba8c-be22-4dac-b5b2-54800c2a9e4c tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:20.241373 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5e3fba8c-be22-4dac-b5b2-54800c2a9e4c tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:20.242091 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5e3fba8c-be22-4dac-b5b2-54800c2a9e4c tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:20.242975 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5e3fba8c-be22-4dac-b5b2-54800c2a9e4c tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:20.243435 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5e3fba8c-be22-4dac-b5b2-54800c2a9e4c tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:20.243863 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5e3fba8c-be22-4dac-b5b2-54800c2a9e4c tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:20.388565 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5e3fba8c-be22-4dac-b5b2-54800c2a9e4c tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d87ef57cf344734b662bd792022c4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea74354a0b4753a363fc5d4f6d4f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:20.403355 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5e3fba8c-be22-4dac-b5b2-54800c2a9e4c tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] 10.222.0.13 "GET /compute/v2.1/servers/d444d587-7d6e-498e-9770-6ac5f8fbd0e1" status: 200 len: 1433 microversion: 2.1 time: 0.174623 Oct 30 01:17:20.405458 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 574/1154] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:20 2022] GET /compute/v2.1/servers/d444d587-7d6e-498e-9770-6ac5f8fbd0e1 => generated 1433 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:20.414737 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-53e6de11-68c7-47c7-8356-ff8ae76a0fce req-84a6adf2-a171-4377-b206-be17be259f61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d444d587-7d6e-498e-9770-6ac5f8fbd0e1", "name": "network-vif-deleted", "tag": "13f52f67-7cfe-43f7-b294-bbbec18aab84"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:20.425621 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-53e6de11-68c7-47c7-8356-ff8ae76a0fce req-84a6adf2-a171-4377-b206-be17be259f61 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:20.426115 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-53e6de11-68c7-47c7-8356-ff8ae76a0fce req-84a6adf2-a171-4377-b206-be17be259f61 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:20.428041 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-53e6de11-68c7-47c7-8356-ff8ae76a0fce req-84a6adf2-a171-4377-b206-be17be259f61 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:20.444233 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-cc806e55-591e-4957-95ef-29f73edc8d69 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:20.444757 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-53e6de11-68c7-47c7-8356-ff8ae76a0fce req-84a6adf2-a171-4377-b206-be17be259f61 service nova] Creating event network-vif-deleted:13f52f67-7cfe-43f7-b294-bbbec18aab84 for instance d444d587-7d6e-498e-9770-6ac5f8fbd0e1 on n-h1-master-1 Oct 30 01:17:20.452655 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-53e6de11-68c7-47c7-8356-ff8ae76a0fce req-84a6adf2-a171-4377-b206-be17be259f61 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044946 Oct 30 01:17:20.453873 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 575/1155] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:17:20.461658 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0fe1a2a1-f6d6-44db-b37b-b0dbd8d13526 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:20.462533 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0fe1a2a1-f6d6-44db-b37b-b0dbd8d13526 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:20.463740 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cc806e55-591e-4957-95ef-29f73edc8d69 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1476 microversion: 2.1 time: 0.356414 Oct 30 01:17:20.464524 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 581/1156] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:20 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1476 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:20.469628 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f6ebb925-1fb9-47e2-ae4f-d733b488a0f4 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:20.469833 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0fe1a2a1-f6d6-44db-b37b-b0dbd8d13526 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:20.470600 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0fe1a2a1-f6d6-44db-b37b-b0dbd8d13526 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:20.470600 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0fe1a2a1-f6d6-44db-b37b-b0dbd8d13526 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:20.471297 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0fe1a2a1-f6d6-44db-b37b-b0dbd8d13526 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:20.471746 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0fe1a2a1-f6d6-44db-b37b-b0dbd8d13526 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:20.472169 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0fe1a2a1-f6d6-44db-b37b-b0dbd8d13526 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:20.476102 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f6ebb925-1fb9-47e2-ae4f-d733b488a0f4 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:20.476925 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f6ebb925-1fb9-47e2-ae4f-d733b488a0f4 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:20.477279 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:17:20.477863 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f6ebb925-1fb9-47e2-ae4f-d733b488a0f4 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:20.478872 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f6ebb925-1fb9-47e2-ae4f-d733b488a0f4 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:20.479455 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f6ebb925-1fb9-47e2-ae4f-d733b488a0f4 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:20.479992 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f6ebb925-1fb9-47e2-ae4f-d733b488a0f4 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:20.510996 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f6ebb925-1fb9-47e2-ae4f-d733b488a0f4 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.045113 Oct 30 01:17:20.512118 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 582/1157] 10.222.0.13 () {60 vars in 1217 bytes} [Sun Oct 30 01:17:20 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:17:20.670166 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0fe1a2a1-f6d6-44db-b37b-b0dbd8d13526 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:20.682850 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0fe1a2a1-f6d6-44db-b37b-b0dbd8d13526 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd" status: 200 len: 1716 microversion: 2.1 time: 0.227691 Oct 30 01:17:20.687974 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 576/1158] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:20 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd => generated 1716 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:20.747971 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-44dbfa2a-559d-4994-9ffb-28174cb21e34 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:20.748596 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-44dbfa2a-559d-4994-9ffb-28174cb21e34 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: 04619e4f-8b79-4196-9794-f27d605c4328] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:20.755976 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-44dbfa2a-559d-4994-9ffb-28174cb21e34 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:20.756472 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-44dbfa2a-559d-4994-9ffb-28174cb21e34 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:20.756903 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-44dbfa2a-559d-4994-9ffb-28174cb21e34 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:20.757698 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-44dbfa2a-559d-4994-9ffb-28174cb21e34 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:20.758150 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-44dbfa2a-559d-4994-9ffb-28174cb21e34 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:20.758577 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-44dbfa2a-559d-4994-9ffb-28174cb21e34 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:20.833086 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-00e547cb-ffb8-40d6-a021-f0cf8baac6cc tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:20.834073 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-00e547cb-ffb8-40d6-a021-f0cf8baac6cc tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 50f83abd-f45c-4217-8130-30a7bebd08b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:20.841179 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00e547cb-ffb8-40d6-a021-f0cf8baac6cc tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:20.841834 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00e547cb-ffb8-40d6-a021-f0cf8baac6cc tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:20.842463 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00e547cb-ffb8-40d6-a021-f0cf8baac6cc tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:20.843261 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00e547cb-ffb8-40d6-a021-f0cf8baac6cc tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:20.843782 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00e547cb-ffb8-40d6-a021-f0cf8baac6cc tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:20.844631 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00e547cb-ffb8-40d6-a021-f0cf8baac6cc tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:20.984891 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-44dbfa2a-559d-4994-9ffb-28174cb21e34 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f11109f32d4013aed5ab9320d8295b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e2bdadb00745888a171041c5714bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:20.994136 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-44dbfa2a-559d-4994-9ffb-28174cb21e34 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] 10.222.0.13 "GET /compute/v2.1/servers/04619e4f-8b79-4196-9794-f27d605c4328" status: 200 len: 1324 microversion: 2.1 time: 0.250575 Oct 30 01:17:20.994996 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 583/1159] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:20 2022] GET /compute/v2.1/servers/04619e4f-8b79-4196-9794-f27d605c4328 => generated 1324 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:17:21.065992 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-00e547cb-ffb8-40d6-a021-f0cf8baac6cc tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:21.074347 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-00e547cb-ffb8-40d6-a021-f0cf8baac6cc tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/50f83abd-f45c-4217-8130-30a7bebd08b9" status: 200 len: 1316 microversion: 2.1 time: 0.245973 Oct 30 01:17:21.075041 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 577/1160] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:20 2022] GET /compute/v2.1/servers/50f83abd-f45c-4217-8130-30a7bebd08b9 => generated 1316 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:21.133032 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5f41b459-206b-4b74-91ed-6b00c2bad8bc tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:21.133761 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5f41b459-206b-4b74-91ed-6b00c2bad8bc tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:21.140233 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f41b459-206b-4b74-91ed-6b00c2bad8bc tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:21.140806 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f41b459-206b-4b74-91ed-6b00c2bad8bc tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:21.141312 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f41b459-206b-4b74-91ed-6b00c2bad8bc tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:21.142109 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f41b459-206b-4b74-91ed-6b00c2bad8bc tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:21.142643 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f41b459-206b-4b74-91ed-6b00c2bad8bc tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:21.143530 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f41b459-206b-4b74-91ed-6b00c2bad8bc tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:21.293078 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5f41b459-206b-4b74-91ed-6b00c2bad8bc tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:21.307893 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5f41b459-206b-4b74-91ed-6b00c2bad8bc tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1477 microversion: 2.1 time: 0.178386 Oct 30 01:17:21.308981 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 584/1161] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:21 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1477 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:21.428474 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-67c68bc2-ad9c-487d-841d-4282f554afb6 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:21.429143 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-67c68bc2-ad9c-487d-841d-4282f554afb6 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] [instance: d444d587-7d6e-498e-9770-6ac5f8fbd0e1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:21.436386 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67c68bc2-ad9c-487d-841d-4282f554afb6 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:21.436877 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67c68bc2-ad9c-487d-841d-4282f554afb6 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:21.437593 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67c68bc2-ad9c-487d-841d-4282f554afb6 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:21.438304 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67c68bc2-ad9c-487d-841d-4282f554afb6 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:21.438760 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67c68bc2-ad9c-487d-841d-4282f554afb6 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:21.439632 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67c68bc2-ad9c-487d-841d-4282f554afb6 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:21.476985 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67c68bc2-ad9c-487d-841d-4282f554afb6 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:21.477506 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67c68bc2-ad9c-487d-841d-4282f554afb6 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:21.477945 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67c68bc2-ad9c-487d-841d-4282f554afb6 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:21.478400 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-67c68bc2-ad9c-487d-841d-4282f554afb6 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lazy-loading 'fault' on Instance uuid d444d587-7d6e-498e-9770-6ac5f8fbd0e1 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:17:21.488393 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cfd60b2e-2c04-4d5b-a330-e4e0cf76d5c5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:21.489116 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-cfd60b2e-2c04-4d5b-a330-e4e0cf76d5c5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:21.498695 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cfd60b2e-2c04-4d5b-a330-e4e0cf76d5c5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:21.499409 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cfd60b2e-2c04-4d5b-a330-e4e0cf76d5c5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:21.500210 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cfd60b2e-2c04-4d5b-a330-e4e0cf76d5c5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:21.501116 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cfd60b2e-2c04-4d5b-a330-e4e0cf76d5c5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:21.501615 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cfd60b2e-2c04-4d5b-a330-e4e0cf76d5c5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:21.502187 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cfd60b2e-2c04-4d5b-a330-e4e0cf76d5c5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:21.532463 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-67c68bc2-ad9c-487d-841d-4282f554afb6 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d87ef57cf344734b662bd792022c4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea74354a0b4753a363fc5d4f6d4f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:21.540982 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-67c68bc2-ad9c-487d-841d-4282f554afb6 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] 10.222.0.13 "GET /compute/v2.1/servers/d444d587-7d6e-498e-9770-6ac5f8fbd0e1" status: 200 len: 1310 microversion: 2.1 time: 0.116675 Oct 30 01:17:21.541906 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 578/1162] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:21 2022] GET /compute/v2.1/servers/d444d587-7d6e-498e-9770-6ac5f8fbd0e1 => generated 1310 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:21.684122 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-cfd60b2e-2c04-4d5b-a330-e4e0cf76d5c5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:21.693699 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cfd60b2e-2c04-4d5b-a330-e4e0cf76d5c5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1476 microversion: 2.1 time: 0.209450 Oct 30 01:17:21.694294 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 585/1163] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:21 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1476 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:17:21.714975 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9b525537-50c6-431f-a744-e703593fd2c6 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:21.715696 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9b525537-50c6-431f-a744-e703593fd2c6 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:21.722334 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b525537-50c6-431f-a744-e703593fd2c6 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:21.722961 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b525537-50c6-431f-a744-e703593fd2c6 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:21.723514 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b525537-50c6-431f-a744-e703593fd2c6 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:21.724284 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b525537-50c6-431f-a744-e703593fd2c6 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:21.724924 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b525537-50c6-431f-a744-e703593fd2c6 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:21.725449 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b525537-50c6-431f-a744-e703593fd2c6 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:21.881425 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9b525537-50c6-431f-a744-e703593fd2c6 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:21.893120 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9b525537-50c6-431f-a744-e703593fd2c6 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd" status: 200 len: 1716 microversion: 2.1 time: 0.185237 Oct 30 01:17:21.909434 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 579/1164] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:21 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd => generated 1716 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:22.022539 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9a5aa183-6b8f-4fb2-8c7a-15bd1752b198 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:22.023609 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9a5aa183-6b8f-4fb2-8c7a-15bd1752b198 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: 04619e4f-8b79-4196-9794-f27d605c4328] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:22.031793 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9a5aa183-6b8f-4fb2-8c7a-15bd1752b198 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:22.032293 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9a5aa183-6b8f-4fb2-8c7a-15bd1752b198 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:22.032948 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9a5aa183-6b8f-4fb2-8c7a-15bd1752b198 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:22.033911 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9a5aa183-6b8f-4fb2-8c7a-15bd1752b198 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:22.034607 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9a5aa183-6b8f-4fb2-8c7a-15bd1752b198 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:22.035038 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9a5aa183-6b8f-4fb2-8c7a-15bd1752b198 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:22.104145 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6b19cb17-bdce-4369-b683-1edc6aff0c78 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:22.104919 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6b19cb17-bdce-4369-b683-1edc6aff0c78 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 50f83abd-f45c-4217-8130-30a7bebd08b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:22.121582 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b19cb17-bdce-4369-b683-1edc6aff0c78 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:22.128936 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b19cb17-bdce-4369-b683-1edc6aff0c78 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:22.128936 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b19cb17-bdce-4369-b683-1edc6aff0c78 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:22.128936 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b19cb17-bdce-4369-b683-1edc6aff0c78 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:22.128936 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b19cb17-bdce-4369-b683-1edc6aff0c78 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:22.129321 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b19cb17-bdce-4369-b683-1edc6aff0c78 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:22.276596 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9a5aa183-6b8f-4fb2-8c7a-15bd1752b198 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f11109f32d4013aed5ab9320d8295b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e2bdadb00745888a171041c5714bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:22.305516 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9a5aa183-6b8f-4fb2-8c7a-15bd1752b198 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] 10.222.0.13 "GET /compute/v2.1/servers/04619e4f-8b79-4196-9794-f27d605c4328" status: 200 len: 1324 microversion: 2.1 time: 0.287423 Oct 30 01:17:22.309531 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 586/1165] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:22 2022] GET /compute/v2.1/servers/04619e4f-8b79-4196-9794-f27d605c4328 => generated 1324 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:22.342482 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4467972c-d0f0-4b1a-b8f5-b92bfae48d84 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:22.343430 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4467972c-d0f0-4b1a-b8f5-b92bfae48d84 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:22.352968 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4467972c-d0f0-4b1a-b8f5-b92bfae48d84 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:22.353949 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4467972c-d0f0-4b1a-b8f5-b92bfae48d84 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:22.355495 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4467972c-d0f0-4b1a-b8f5-b92bfae48d84 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:22.356556 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4467972c-d0f0-4b1a-b8f5-b92bfae48d84 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:22.357139 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4467972c-d0f0-4b1a-b8f5-b92bfae48d84 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:22.360963 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4467972c-d0f0-4b1a-b8f5-b92bfae48d84 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:22.393010 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6b19cb17-bdce-4369-b683-1edc6aff0c78 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:22.417223 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6b19cb17-bdce-4369-b683-1edc6aff0c78 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/50f83abd-f45c-4217-8130-30a7bebd08b9" status: 200 len: 1316 microversion: 2.1 time: 0.308360 Oct 30 01:17:22.438890 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 580/1166] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:22 2022] GET /compute/v2.1/servers/50f83abd-f45c-4217-8130-30a7bebd08b9 => generated 1316 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:22.471221 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-a5026d1f-3fc6-4f04-b233-cfe2e552da9c req-9f92b351-4b37-4e2b-a0e8-1d7ce9b5f8a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04619e4f-8b79-4196-9794-f27d605c4328", "name": "network-vif-plugged", "status": "completed", "tag": "6a9b0f09-5783-40cf-a067-b3a5f5f29ea0"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:22.517612 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-a5026d1f-3fc6-4f04-b233-cfe2e552da9c req-9f92b351-4b37-4e2b-a0e8-1d7ce9b5f8a4 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:22.520080 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-a5026d1f-3fc6-4f04-b233-cfe2e552da9c req-9f92b351-4b37-4e2b-a0e8-1d7ce9b5f8a4 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:22.523571 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-a5026d1f-3fc6-4f04-b233-cfe2e552da9c req-9f92b351-4b37-4e2b-a0e8-1d7ce9b5f8a4 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:22.577692 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-a5026d1f-3fc6-4f04-b233-cfe2e552da9c req-9f92b351-4b37-4e2b-a0e8-1d7ce9b5f8a4 service nova] Creating event network-vif-plugged:6a9b0f09-5783-40cf-a067-b3a5f5f29ea0 for instance 04619e4f-8b79-4196-9794-f27d605c4328 on n-h2-master-1 Oct 30 01:17:22.596027 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-a5026d1f-3fc6-4f04-b233-cfe2e552da9c req-9f92b351-4b37-4e2b-a0e8-1d7ce9b5f8a4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152231 Oct 30 01:17:22.601161 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 581/1167] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:17:22.612553 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8f3247dd-2a35-4c08-a39d-4aeeb71fd443 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:22.614134 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8f3247dd-2a35-4c08-a39d-4aeeb71fd443 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] [instance: d444d587-7d6e-498e-9770-6ac5f8fbd0e1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:22.630585 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8f3247dd-2a35-4c08-a39d-4aeeb71fd443 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:22.631092 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8f3247dd-2a35-4c08-a39d-4aeeb71fd443 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:22.631531 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8f3247dd-2a35-4c08-a39d-4aeeb71fd443 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:22.632295 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8f3247dd-2a35-4c08-a39d-4aeeb71fd443 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:22.632762 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8f3247dd-2a35-4c08-a39d-4aeeb71fd443 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:22.633188 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8f3247dd-2a35-4c08-a39d-4aeeb71fd443 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:22.682507 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-8f3247dd-2a35-4c08-a39d-4aeeb71fd443 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] HTTP exception thrown: Instance d444d587-7d6e-498e-9770-6ac5f8fbd0e1 could not be found. Oct 30 01:17:22.691675 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8f3247dd-2a35-4c08-a39d-4aeeb71fd443 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Request method failure captured: Oct 30 01:17:22.691675 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/d444d587-7d6e-498e-9770-6ac5f8fbd0e1 HTTP/1.1 Oct 30 01:17:22.691675 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:17:22.691675 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:17:22.691675 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:17:22.691675 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:17:22.691675 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:17:22.691675 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:17:22.691675 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:17:22.691675 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:17:22.691675 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdCF7VF6jencz3ODp2nz3osj06SKM8bVCdTGdUDqZMVdxhkR_O3BHLVJz0vrvBc_EIDHZ5d0xlCa7bPVb7T5vikkC-MEYWBr02mEacWzv3jbTaP1-AYvYqtyGotcp6nA2c1ROiYmPkZwSB6jCyfsv2Hn4y7-G8aBOwIxiHfTVK_W1-g Oct 30 01:17:22.691675 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:17:22.691675 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:17:22.691675 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:17:22.691675 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:17:22.691675 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:17:22.691675 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:17:22.691675 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: feea74354a0b4753a363fc5d4f6d4f13 Oct 30 01:17:22.691675 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1635185820 Oct 30 01:17:22.691675 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:17:22.691675 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:17:22.693247 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/feea74354a0b4753a363fc5d4f6d4f13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_feea74354a0b4753a363fc5d4f6d4f13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/feea74354a0b4753a363fc5d4f6d4f13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/feea74354a0b4753a363fc5d4f6d4f13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:17:22.693247 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-DeleteServersAdminTestJSON-1635185820 Oct 30 01:17:22.693247 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: feea74354a0b4753a363fc5d4f6d4f13 Oct 30 01:17:22.693247 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1635185820 Oct 30 01:17:22.693247 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-DeleteServersAdminTestJSON-1635185820-project Oct 30 01:17:22.693247 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:17:22.693247 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:17:22.693247 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 7d87ef57cf344734b662bd792022c4b7 Oct 30 01:17:22.693247 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-DeleteServersAdminTestJSON-1635185820-project Oct 30 01:17:22.693247 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:17:22.693247 n-d-master-1 devstack@n-api.service[121102]: exception: Instance d444d587-7d6e-498e-9770-6ac5f8fbd0e1 could not be found. Oct 30 01:17:22.693247 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'd444d587-7d6e-498e-9770-6ac5f8fbd0e1'} Oct 30 01:17:22.699353 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:17:22.699353 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:17:22.699353 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:17:22.699353 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:17:22.699353 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:17:22.699353 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:17:22.699353 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:17:22.699353 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:17:22.699353 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:17:22.699353 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:17:22.699353 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d444d587-7d6e-498e-9770-6ac5f8fbd0e1 could not be found. Oct 30 01:17:22.699353 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:17:22.699353 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:17:22.699353 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:17:22.699353 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:17:22.699353 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:17:22.699353 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:17:22.699353 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:17:22.699353 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:17:22.699353 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:17:22.700620 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:17:22.700620 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:17:22.700620 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:17:22.700620 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:17:22.700620 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:17:22.700620 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:17:22.700620 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:17:22.700620 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d444d587-7d6e-498e-9770-6ac5f8fbd0e1 could not be found. Oct 30 01:17:22.700620 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:17:22.700620 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:17:22.700620 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:17:22.700620 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:17:22.700620 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:17:22.700620 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:17:22.700620 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:17:22.700620 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:17:22.700620 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d444d587-7d6e-498e-9770-6ac5f8fbd0e1 could not be found. Oct 30 01:17:22.700620 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:17:22.703259 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8f3247dd-2a35-4c08-a39d-4aeeb71fd443 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Returning 404 to user: Instance d444d587-7d6e-498e-9770-6ac5f8fbd0e1 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:17:22.703259 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8f3247dd-2a35-4c08-a39d-4aeeb71fd443 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] 10.222.0.13 "GET /compute/v2.1/servers/d444d587-7d6e-498e-9770-6ac5f8fbd0e1" status: 404 len: 111 microversion: 2.1 time: 0.087711 Oct 30 01:17:22.703259 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 582/1168] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:22 2022] GET /compute/v2.1/servers/d444d587-7d6e-498e-9770-6ac5f8fbd0e1 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:17:22.719402 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2ef99b70-0e45-4d7c-9df2-a566ba2e4966 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:22.719992 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2ef99b70-0e45-4d7c-9df2-a566ba2e4966 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:22.733033 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ef99b70-0e45-4d7c-9df2-a566ba2e4966 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:22.736170 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ef99b70-0e45-4d7c-9df2-a566ba2e4966 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:22.737001 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ef99b70-0e45-4d7c-9df2-a566ba2e4966 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:22.738025 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ef99b70-0e45-4d7c-9df2-a566ba2e4966 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:22.740091 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ef99b70-0e45-4d7c-9df2-a566ba2e4966 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:22.740744 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ef99b70-0e45-4d7c-9df2-a566ba2e4966 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:22.784525 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4467972c-d0f0-4b1a-b8f5-b92bfae48d84 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:22.810660 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4467972c-d0f0-4b1a-b8f5-b92bfae48d84 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1477 microversion: 2.1 time: 0.472966 Oct 30 01:17:22.810660 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 587/1169] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:22 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1477 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:22.837903 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7e7971ac-c192-4599-ad42-8c8dc605be56 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-472198172", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:22.928990 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-7e7971ac-c192-4599-ad42-8c8dc605be56 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] validate_networks() for None {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:17:23.329751 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2ef99b70-0e45-4d7c-9df2-a566ba2e4966 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:23.340043 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2ef99b70-0e45-4d7c-9df2-a566ba2e4966 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1476 microversion: 2.1 time: 0.626526 Oct 30 01:17:23.340697 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 583/1170] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:22 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1476 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:17:23.346346 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3baa806b-a228-404f-88fb-59d8a1cb9072 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:23.346973 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3baa806b-a228-404f-88fb-59d8a1cb9072 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:23.353258 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3baa806b-a228-404f-88fb-59d8a1cb9072 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:23.353837 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3baa806b-a228-404f-88fb-59d8a1cb9072 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:23.354271 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3baa806b-a228-404f-88fb-59d8a1cb9072 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:23.354981 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3baa806b-a228-404f-88fb-59d8a1cb9072 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:23.355437 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3baa806b-a228-404f-88fb-59d8a1cb9072 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:23.355867 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3baa806b-a228-404f-88fb-59d8a1cb9072 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:23.425402 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-7e7971ac-c192-4599-ad42-8c8dc605be56 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:17:23.425824 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-7e7971ac-c192-4599-ad42-8c8dc605be56 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:17:23.426292 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-7e7971ac-c192-4599-ad42-8c8dc605be56 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:17:23.427221 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-7e7971ac-c192-4599-ad42-8c8dc605be56 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:17:23.427843 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-7e7971ac-c192-4599-ad42-8c8dc605be56 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:17:23.437808 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7e7971ac-c192-4599-ad42-8c8dc605be56 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:23.438295 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7e7971ac-c192-4599-ad42-8c8dc605be56 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:23.438727 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7e7971ac-c192-4599-ad42-8c8dc605be56 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:23.439623 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7e7971ac-c192-4599-ad42-8c8dc605be56 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:23.440078 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7e7971ac-c192-4599-ad42-8c8dc605be56 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:23.440500 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7e7971ac-c192-4599-ad42-8c8dc605be56 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:23.448354 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:17:23.460946 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-7e7971ac-c192-4599-ad42-8c8dc605be56 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Getting quotas for project feea74354a0b4753a363fc5d4f6d4f13. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:17:23.466022 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-7e7971ac-c192-4599-ad42-8c8dc605be56 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Getting quotas for user 7d87ef57cf344734b662bd792022c4b7 and project feea74354a0b4753a363fc5d4f6d4f13. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:17:23.479465 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7e7971ac-c192-4599-ad42-8c8dc605be56 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:17:23.481823 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7e7971ac-c192-4599-ad42-8c8dc605be56 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] [instance: 8ebd67c2-b4d9-4e1b-9946-c8e05013170d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:17:23.561760 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3baa806b-a228-404f-88fb-59d8a1cb9072 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:23.570644 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3baa806b-a228-404f-88fb-59d8a1cb9072 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd" status: 200 len: 1716 microversion: 2.1 time: 0.228887 Oct 30 01:17:23.571789 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 584/1171] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:23 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd => generated 1716 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:23.577124 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7580caca-1e60-4e25-bfcf-ef1374d775dc tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:23.581813 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7580caca-1e60-4e25-bfcf-ef1374d775dc tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: 04619e4f-8b79-4196-9794-f27d605c4328] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:23.583622 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7580caca-1e60-4e25-bfcf-ef1374d775dc tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:23.584117 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7580caca-1e60-4e25-bfcf-ef1374d775dc tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:23.584545 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7580caca-1e60-4e25-bfcf-ef1374d775dc tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:23.585266 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7580caca-1e60-4e25-bfcf-ef1374d775dc tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:23.585790 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7580caca-1e60-4e25-bfcf-ef1374d775dc tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:23.586223 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7580caca-1e60-4e25-bfcf-ef1374d775dc tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:23.616052 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7e7971ac-c192-4599-ad42-8c8dc605be56 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.794211 Oct 30 01:17:23.617074 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 588/1172] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:17:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:17:23.622194 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a98bd258-d6af-4559-8bf4-0124cb3682e2 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:23.623081 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a98bd258-d6af-4559-8bf4-0124cb3682e2 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 50f83abd-f45c-4217-8130-30a7bebd08b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:23.634016 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a98bd258-d6af-4559-8bf4-0124cb3682e2 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:23.634790 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a98bd258-d6af-4559-8bf4-0124cb3682e2 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:23.635235 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a98bd258-d6af-4559-8bf4-0124cb3682e2 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:23.636003 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a98bd258-d6af-4559-8bf4-0124cb3682e2 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:23.636438 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a98bd258-d6af-4559-8bf4-0124cb3682e2 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:23.636866 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a98bd258-d6af-4559-8bf4-0124cb3682e2 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:23.797791 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7580caca-1e60-4e25-bfcf-ef1374d775dc tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f11109f32d4013aed5ab9320d8295b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e2bdadb00745888a171041c5714bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:23.809286 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7580caca-1e60-4e25-bfcf-ef1374d775dc tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] 10.222.0.13 "GET /compute/v2.1/servers/04619e4f-8b79-4196-9794-f27d605c4328" status: 200 len: 1324 microversion: 2.1 time: 0.236180 Oct 30 01:17:23.810120 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 585/1173] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:23 2022] GET /compute/v2.1/servers/04619e4f-8b79-4196-9794-f27d605c4328 => generated 1324 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:23.816176 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b004c21c-5ab5-4b75-a17c-e430d1252445 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e3264834-9e39-42ce-833c-39e7e44e15c7", "device": "/dev/xvdb"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:23.819331 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b004c21c-5ab5-4b75-a17c-e430d1252445 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:23.827097 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a98bd258-d6af-4559-8bf4-0124cb3682e2 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:23.827609 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b004c21c-5ab5-4b75-a17c-e430d1252445 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:23.827985 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b004c21c-5ab5-4b75-a17c-e430d1252445 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:23.828498 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b004c21c-5ab5-4b75-a17c-e430d1252445 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:23.829407 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b004c21c-5ab5-4b75-a17c-e430d1252445 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:23.829955 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b004c21c-5ab5-4b75-a17c-e430d1252445 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:23.830469 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b004c21c-5ab5-4b75-a17c-e430d1252445 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:23.835888 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a98bd258-d6af-4559-8bf4-0124cb3682e2 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/50f83abd-f45c-4217-8130-30a7bebd08b9" status: 200 len: 1465 microversion: 2.1 time: 0.217400 Oct 30 01:17:23.836569 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 589/1174] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:23 2022] GET /compute/v2.1/servers/50f83abd-f45c-4217-8130-30a7bebd08b9 => generated 1465 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:23.841541 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c7f938bb-5942-4027-8eda-4b055d03a1cb tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:23.842396 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c7f938bb-5942-4027-8eda-4b055d03a1cb tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] [instance: 8ebd67c2-b4d9-4e1b-9946-c8e05013170d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:23.906857 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c7f938bb-5942-4027-8eda-4b055d03a1cb tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d87ef57cf344734b662bd792022c4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea74354a0b4753a363fc5d4f6d4f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:23.915211 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c7f938bb-5942-4027-8eda-4b055d03a1cb tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] 10.222.0.13 "GET /compute/v2.1/servers/8ebd67c2-b4d9-4e1b-9946-c8e05013170d" status: 200 len: 1219 microversion: 2.1 time: 0.077399 Oct 30 01:17:23.915885 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 590/1175] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:23 2022] GET /compute/v2.1/servers/8ebd67c2-b4d9-4e1b-9946-c8e05013170d => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:23.920706 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-601e7aae-9336-471b-8335-ae32137cb9b8 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:23.921751 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-601e7aae-9336-471b-8335-ae32137cb9b8 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:23.930085 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-601e7aae-9336-471b-8335-ae32137cb9b8 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:23.931185 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-601e7aae-9336-471b-8335-ae32137cb9b8 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:23.931773 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-601e7aae-9336-471b-8335-ae32137cb9b8 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:23.932601 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-601e7aae-9336-471b-8335-ae32137cb9b8 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:23.933124 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-601e7aae-9336-471b-8335-ae32137cb9b8 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:23.933677 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-601e7aae-9336-471b-8335-ae32137cb9b8 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:24.093598 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-601e7aae-9336-471b-8335-ae32137cb9b8 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:24.109213 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-601e7aae-9336-471b-8335-ae32137cb9b8 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1477 microversion: 2.1 time: 0.192039 Oct 30 01:17:24.121918 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 591/1176] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:23 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1477 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:24.121918 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ad88601c-8bda-4454-b452-4206b1206d78 tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:24.121918 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ad88601c-8bda-4454-b452-4206b1206d78 tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] [instance: 50f83abd-f45c-4217-8130-30a7bebd08b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:24.127433 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ad88601c-8bda-4454-b452-4206b1206d78 tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:24.127931 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ad88601c-8bda-4454-b452-4206b1206d78 tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:24.128374 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ad88601c-8bda-4454-b452-4206b1206d78 tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:24.129084 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ad88601c-8bda-4454-b452-4206b1206d78 tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:24.129772 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ad88601c-8bda-4454-b452-4206b1206d78 tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:24.130404 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ad88601c-8bda-4454-b452-4206b1206d78 tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:24.278355 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ad88601c-8bda-4454-b452-4206b1206d78 tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/50f83abd-f45c-4217-8130-30a7bebd08b9" status: 200 len: 1616 microversion: 2.1 time: 0.165968 Oct 30 01:17:24.278949 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 592/1177] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:24 2022] GET /compute/v2.1/servers/50f83abd-f45c-4217-8130-30a7bebd08b9 => generated 1616 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:24.342977 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7134e4ad-b31d-470d-b24c-1d9cb8c9dd4e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-364496033", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["d19d848f-99bc-4f10-b837-d66aaa5258a6"]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:24.397192 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-7134e4ad-b31d-470d-b24c-1d9cb8c9dd4e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] validate_networks() for None {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:17:24.638772 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-7134e4ad-b31d-470d-b24c-1d9cb8c9dd4e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:17:24.639194 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-7134e4ad-b31d-470d-b24c-1d9cb8c9dd4e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:17:24.639664 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-7134e4ad-b31d-470d-b24c-1d9cb8c9dd4e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:17:24.640096 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-7134e4ad-b31d-470d-b24c-1d9cb8c9dd4e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:17:24.640507 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-7134e4ad-b31d-470d-b24c-1d9cb8c9dd4e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:17:24.658588 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7134e4ad-b31d-470d-b24c-1d9cb8c9dd4e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:24.659192 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7134e4ad-b31d-470d-b24c-1d9cb8c9dd4e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:24.659734 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7134e4ad-b31d-470d-b24c-1d9cb8c9dd4e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:24.660551 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7134e4ad-b31d-470d-b24c-1d9cb8c9dd4e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:24.661220 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7134e4ad-b31d-470d-b24c-1d9cb8c9dd4e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:24.661750 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7134e4ad-b31d-470d-b24c-1d9cb8c9dd4e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:24.682022 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-7134e4ad-b31d-470d-b24c-1d9cb8c9dd4e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Getting quotas for project 76b6f7b705f5428b9a3a3a8c4f86ff48. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:17:24.687555 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-7134e4ad-b31d-470d-b24c-1d9cb8c9dd4e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Getting quotas for user c536d41a93ad4337909fe2e2cb949e03 and project 76b6f7b705f5428b9a3a3a8c4f86ff48. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:17:24.702321 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7134e4ad-b31d-470d-b24c-1d9cb8c9dd4e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:17:24.705729 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7134e4ad-b31d-470d-b24c-1d9cb8c9dd4e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 5387ae83-7934-49d6-a893-3661477ffe69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:17:24.899358 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7134e4ad-b31d-470d-b24c-1d9cb8c9dd4e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.560373 Oct 30 01:17:24.906318 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 593/1178] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:17:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 30 01:17:24.906318 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bcc13538-98c0-42ae-a09d-6949c8926a58 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:24.906318 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-bcc13538-98c0-42ae-a09d-6949c8926a58 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:24.913719 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bcc13538-98c0-42ae-a09d-6949c8926a58 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:24.914228 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bcc13538-98c0-42ae-a09d-6949c8926a58 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:24.914670 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bcc13538-98c0-42ae-a09d-6949c8926a58 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:24.915396 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bcc13538-98c0-42ae-a09d-6949c8926a58 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:24.915855 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bcc13538-98c0-42ae-a09d-6949c8926a58 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:24.916930 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bcc13538-98c0-42ae-a09d-6949c8926a58 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:25.110932 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-bcc13538-98c0-42ae-a09d-6949c8926a58 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:25.123475 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bcc13538-98c0-42ae-a09d-6949c8926a58 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1476 microversion: 2.1 time: 0.221865 Oct 30 01:17:25.124269 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 594/1179] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:24 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1476 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:25.130369 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fe044a1d-bd3e-476a-9d5e-3133aebaf007 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:25.130985 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-fe044a1d-bd3e-476a-9d5e-3133aebaf007 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:25.138263 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe044a1d-bd3e-476a-9d5e-3133aebaf007 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:25.138757 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe044a1d-bd3e-476a-9d5e-3133aebaf007 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:25.139196 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe044a1d-bd3e-476a-9d5e-3133aebaf007 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:25.139910 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe044a1d-bd3e-476a-9d5e-3133aebaf007 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:25.140363 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe044a1d-bd3e-476a-9d5e-3133aebaf007 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:25.140785 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe044a1d-bd3e-476a-9d5e-3133aebaf007 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:25.299106 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-fe044a1d-bd3e-476a-9d5e-3133aebaf007 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:25.313113 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fe044a1d-bd3e-476a-9d5e-3133aebaf007 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd" status: 200 len: 1716 microversion: 2.1 time: 0.187935 Oct 30 01:17:25.313855 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 595/1180] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:25 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd => generated 1716 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:25.318965 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-d1ff7626-b4b1-4028-b3ac-9448d4b03cdb req-59661428-18e0-4955-b288-464aa5dd459a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f10b90ae-23e1-4ca1-b95e-9404e606e5d9", "name": "network-vif-unplugged", "status": "completed", "tag": "9f14e853-78c5-4b79-8df2-448f8f1726ff"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:25.330431 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d1ff7626-b4b1-4028-b3ac-9448d4b03cdb req-59661428-18e0-4955-b288-464aa5dd459a service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:25.342501 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d1ff7626-b4b1-4028-b3ac-9448d4b03cdb req-59661428-18e0-4955-b288-464aa5dd459a service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:25.342965 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d1ff7626-b4b1-4028-b3ac-9448d4b03cdb req-59661428-18e0-4955-b288-464aa5dd459a service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:25.370093 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-d1ff7626-b4b1-4028-b3ac-9448d4b03cdb req-59661428-18e0-4955-b288-464aa5dd459a service nova] Creating event network-vif-unplugged:9f14e853-78c5-4b79-8df2-448f8f1726ff for instance f10b90ae-23e1-4ca1-b95e-9404e606e5d9 on n-h2-master-1 Oct 30 01:17:25.377033 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-d1ff7626-b4b1-4028-b3ac-9448d4b03cdb req-59661428-18e0-4955-b288-464aa5dd459a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061397 Oct 30 01:17:25.377997 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 596/1181] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:17:25.386595 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ed2b3fa4-57bf-479f-bbc5-bfc82868e28c tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:25.387322 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ed2b3fa4-57bf-479f-bbc5-bfc82868e28c tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: 04619e4f-8b79-4196-9794-f27d605c4328] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:25.394421 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ed2b3fa4-57bf-479f-bbc5-bfc82868e28c tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:25.394933 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ed2b3fa4-57bf-479f-bbc5-bfc82868e28c tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:25.395863 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ed2b3fa4-57bf-479f-bbc5-bfc82868e28c tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:25.396599 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ed2b3fa4-57bf-479f-bbc5-bfc82868e28c tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:25.397158 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ed2b3fa4-57bf-479f-bbc5-bfc82868e28c tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:25.397571 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ed2b3fa4-57bf-479f-bbc5-bfc82868e28c tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:25.591884 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ed2b3fa4-57bf-479f-bbc5-bfc82868e28c tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f11109f32d4013aed5ab9320d8295b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e2bdadb00745888a171041c5714bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:25.603095 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ed2b3fa4-57bf-479f-bbc5-bfc82868e28c tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] 10.222.0.13 "GET /compute/v2.1/servers/04619e4f-8b79-4196-9794-f27d605c4328" status: 200 len: 1519 microversion: 2.1 time: 0.220949 Oct 30 01:17:25.617929 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 597/1182] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:25 2022] GET /compute/v2.1/servers/04619e4f-8b79-4196-9794-f27d605c4328 => generated 1519 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:25.627133 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a75197fc-f50b-4064-afea-17fd11106250 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:25.627947 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a75197fc-f50b-4064-afea-17fd11106250 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 5387ae83-7934-49d6-a893-3661477ffe69] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:25.689905 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a75197fc-f50b-4064-afea-17fd11106250 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:25.699849 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a75197fc-f50b-4064-afea-17fd11106250 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/5387ae83-7934-49d6-a893-3661477ffe69" status: 200 len: 1216 microversion: 2.1 time: 0.080584 Oct 30 01:17:25.700941 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 598/1183] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:25 2022] GET /compute/v2.1/servers/5387ae83-7934-49d6-a893-3661477ffe69 => generated 1216 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:25.706035 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-dc6c93ad-12be-4963-8693-c430f7bb6770 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:25.706754 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-dc6c93ad-12be-4963-8693-c430f7bb6770 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] [instance: 8ebd67c2-b4d9-4e1b-9946-c8e05013170d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:25.713569 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc6c93ad-12be-4963-8693-c430f7bb6770 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:25.714153 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc6c93ad-12be-4963-8693-c430f7bb6770 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:25.714657 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc6c93ad-12be-4963-8693-c430f7bb6770 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:25.715438 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc6c93ad-12be-4963-8693-c430f7bb6770 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:25.715963 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc6c93ad-12be-4963-8693-c430f7bb6770 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:25.716452 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc6c93ad-12be-4963-8693-c430f7bb6770 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:25.806634 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-dc6c93ad-12be-4963-8693-c430f7bb6770 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d87ef57cf344734b662bd792022c4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea74354a0b4753a363fc5d4f6d4f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:25.823977 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-dc6c93ad-12be-4963-8693-c430f7bb6770 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] 10.222.0.13 "GET /compute/v2.1/servers/8ebd67c2-b4d9-4e1b-9946-c8e05013170d" status: 200 len: 1271 microversion: 2.1 time: 0.121669 Oct 30 01:17:25.831067 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 599/1184] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:25 2022] GET /compute/v2.1/servers/8ebd67c2-b4d9-4e1b-9946-c8e05013170d => generated 1271 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:25.832229 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1f925303-0111-4cbd-8bff-c4e250a39246 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:25.833148 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1f925303-0111-4cbd-8bff-c4e250a39246 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:25.842074 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1f925303-0111-4cbd-8bff-c4e250a39246 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:25.842840 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1f925303-0111-4cbd-8bff-c4e250a39246 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:25.843545 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1f925303-0111-4cbd-8bff-c4e250a39246 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:25.844935 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1f925303-0111-4cbd-8bff-c4e250a39246 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:25.845724 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1f925303-0111-4cbd-8bff-c4e250a39246 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:25.846688 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1f925303-0111-4cbd-8bff-c4e250a39246 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:26.036631 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1f925303-0111-4cbd-8bff-c4e250a39246 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:26.044780 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1f925303-0111-4cbd-8bff-c4e250a39246 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1477 microversion: 2.1 time: 0.217221 Oct 30 01:17:26.045486 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 600/1185] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:25 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1477 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:26.050542 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-32ce19d3-8c6d-4f5b-82d6-a96dcad6c592 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Action: 'action', calling method: .version_select at 0x7f44ce805ee0>, body: {"addFloatingIp": {"address": "172.35.5.126"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:26.053872 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-32ce19d3-8c6d-4f5b-82d6-a96dcad6c592 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: e19edf61-5458-4f12-84b2-346b41506ff3] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:26.060227 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-32ce19d3-8c6d-4f5b-82d6-a96dcad6c592 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:26.060799 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-32ce19d3-8c6d-4f5b-82d6-a96dcad6c592 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:26.061311 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-32ce19d3-8c6d-4f5b-82d6-a96dcad6c592 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:26.062509 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-32ce19d3-8c6d-4f5b-82d6-a96dcad6c592 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:26.063043 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-32ce19d3-8c6d-4f5b-82d6-a96dcad6c592 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:26.063548 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-32ce19d3-8c6d-4f5b-82d6-a96dcad6c592 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:26.132454 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-32ce19d3-8c6d-4f5b-82d6-a96dcad6c592 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "refresh_cache-e19edf61-5458-4f12-84b2-346b41506ff3" {{(pid=121103) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 30 01:17:26.132858 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-32ce19d3-8c6d-4f5b-82d6-a96dcad6c592 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquired lock "refresh_cache-e19edf61-5458-4f12-84b2-346b41506ff3" {{(pid=121103) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 30 01:17:26.434862 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b004c21c-5ab5-4b75-a17c-e430d1252445 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "POST /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 2.623241 Oct 30 01:17:26.442008 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 586/1186] 10.222.0.13 () {62 vars in 1364 bytes} [Sun Oct 30 01:17:23 2022] POST /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789/os-volume_attachments => generated 194 bytes in 2625 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:17:26.442401 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5b75c672-432f-4624-82e1-3642ee474f59 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:26.443316 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5b75c672-432f-4624-82e1-3642ee474f59 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:26.452510 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5b75c672-432f-4624-82e1-3642ee474f59 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:26.453238 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5b75c672-432f-4624-82e1-3642ee474f59 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:26.453724 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5b75c672-432f-4624-82e1-3642ee474f59 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:26.454618 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5b75c672-432f-4624-82e1-3642ee474f59 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:26.455115 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5b75c672-432f-4624-82e1-3642ee474f59 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:26.455555 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5b75c672-432f-4624-82e1-3642ee474f59 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:26.703749 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5b75c672-432f-4624-82e1-3642ee474f59 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:26.714725 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5b75c672-432f-4624-82e1-3642ee474f59 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1476 microversion: 2.1 time: 0.277368 Oct 30 01:17:26.724723 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 587/1187] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:26 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1476 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:26.749043 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8c9f0d97-951c-4015-bcad-9eaff289ead5 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:26.750219 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8c9f0d97-951c-4015-bcad-9eaff289ead5 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:26.767441 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8c9f0d97-951c-4015-bcad-9eaff289ead5 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:26.768268 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8c9f0d97-951c-4015-bcad-9eaff289ead5 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:26.768969 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8c9f0d97-951c-4015-bcad-9eaff289ead5 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:26.770147 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8c9f0d97-951c-4015-bcad-9eaff289ead5 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:26.772196 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8c9f0d97-951c-4015-bcad-9eaff289ead5 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:26.772422 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8c9f0d97-951c-4015-bcad-9eaff289ead5 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:26.995720 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8c9f0d97-951c-4015-bcad-9eaff289ead5 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:27.006023 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8c9f0d97-951c-4015-bcad-9eaff289ead5 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd" status: 200 len: 1716 microversion: 2.1 time: 0.289235 Oct 30 01:17:27.007021 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 588/1188] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:26 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd => generated 1716 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:27.012752 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-994bc95b-e40e-4a4e-8f2e-d74b88cef114 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:27.013439 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-994bc95b-e40e-4a4e-8f2e-d74b88cef114 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 5387ae83-7934-49d6-a893-3661477ffe69] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:27.024104 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-994bc95b-e40e-4a4e-8f2e-d74b88cef114 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:27.024661 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-994bc95b-e40e-4a4e-8f2e-d74b88cef114 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:27.025107 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-994bc95b-e40e-4a4e-8f2e-d74b88cef114 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:27.025865 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-994bc95b-e40e-4a4e-8f2e-d74b88cef114 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:27.026326 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-994bc95b-e40e-4a4e-8f2e-d74b88cef114 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:27.027120 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-994bc95b-e40e-4a4e-8f2e-d74b88cef114 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:27.131297 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-994bc95b-e40e-4a4e-8f2e-d74b88cef114 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:27.139791 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-994bc95b-e40e-4a4e-8f2e-d74b88cef114 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/5387ae83-7934-49d6-a893-3661477ffe69" status: 200 len: 1220 microversion: 2.1 time: 0.131511 Oct 30 01:17:27.140391 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 589/1189] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:27 2022] GET /compute/v2.1/servers/5387ae83-7934-49d6-a893-3661477ffe69 => generated 1220 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:27.153763 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5f468efd-fb6e-49f1-b4ec-17496f8814fd tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:27.155379 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5f468efd-fb6e-49f1-b4ec-17496f8814fd tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] [instance: 8ebd67c2-b4d9-4e1b-9946-c8e05013170d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:27.168837 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f468efd-fb6e-49f1-b4ec-17496f8814fd tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:27.170207 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f468efd-fb6e-49f1-b4ec-17496f8814fd tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:27.171314 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f468efd-fb6e-49f1-b4ec-17496f8814fd tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:27.172779 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f468efd-fb6e-49f1-b4ec-17496f8814fd tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:27.173769 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f468efd-fb6e-49f1-b4ec-17496f8814fd tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:27.174693 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f468efd-fb6e-49f1-b4ec-17496f8814fd tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:27.304007 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5f468efd-fb6e-49f1-b4ec-17496f8814fd tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d87ef57cf344734b662bd792022c4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea74354a0b4753a363fc5d4f6d4f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:27.313174 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5f468efd-fb6e-49f1-b4ec-17496f8814fd tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] 10.222.0.13 "GET /compute/v2.1/servers/8ebd67c2-b4d9-4e1b-9946-c8e05013170d" status: 200 len: 1277 microversion: 2.1 time: 0.171305 Oct 30 01:17:27.315203 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 590/1190] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:27 2022] GET /compute/v2.1/servers/8ebd67c2-b4d9-4e1b-9946-c8e05013170d => generated 1277 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:27.319658 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-feba5dc1-59f6-4ee4-9372-82a2415ec05f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:27.320515 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-feba5dc1-59f6-4ee4-9372-82a2415ec05f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:27.331693 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-feba5dc1-59f6-4ee4-9372-82a2415ec05f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:27.332682 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-feba5dc1-59f6-4ee4-9372-82a2415ec05f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:27.333833 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-feba5dc1-59f6-4ee4-9372-82a2415ec05f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:27.335041 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-feba5dc1-59f6-4ee4-9372-82a2415ec05f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:27.335712 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-feba5dc1-59f6-4ee4-9372-82a2415ec05f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:27.336499 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-feba5dc1-59f6-4ee4-9372-82a2415ec05f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:27.618014 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-feba5dc1-59f6-4ee4-9372-82a2415ec05f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:27.628982 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-feba5dc1-59f6-4ee4-9372-82a2415ec05f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1477 microversion: 2.1 time: 0.311620 Oct 30 01:17:27.629659 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 591/1191] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:27 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1477 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:27.741617 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c71c2b51-d222-46d8-ad22-eaf0c8eb8d9e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:27.742563 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c71c2b51-d222-46d8-ad22-eaf0c8eb8d9e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:27.753025 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c71c2b51-d222-46d8-ad22-eaf0c8eb8d9e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:27.755031 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c71c2b51-d222-46d8-ad22-eaf0c8eb8d9e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:27.756164 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c71c2b51-d222-46d8-ad22-eaf0c8eb8d9e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:27.757891 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c71c2b51-d222-46d8-ad22-eaf0c8eb8d9e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:27.758715 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c71c2b51-d222-46d8-ad22-eaf0c8eb8d9e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:27.760029 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c71c2b51-d222-46d8-ad22-eaf0c8eb8d9e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:27.793956 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:17:27.987284 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-32ce19d3-8c6d-4f5b-82d6-a96dcad6c592 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: e19edf61-5458-4f12-84b2-346b41506ff3] Building network info cache for instance {{(pid=121103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 30 01:17:28.327028 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c71c2b51-d222-46d8-ad22-eaf0c8eb8d9e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:28.337980 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c71c2b51-d222-46d8-ad22-eaf0c8eb8d9e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1476 microversion: 2.1 time: 0.601601 Oct 30 01:17:28.364701 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 592/1192] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:27 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1476 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:28.374595 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-ec019671-8b45-400f-9c73-4af551ebdea2 req-d256db49-35d9-47fa-8ad5-4fa3d33ec17b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e19edf61-5458-4f12-84b2-346b41506ff3", "tag": "dfced65c-3e28-40bf-b025-33cddcb37142"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:28.405646 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ec019671-8b45-400f-9c73-4af551ebdea2 req-d256db49-35d9-47fa-8ad5-4fa3d33ec17b service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:28.406295 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ec019671-8b45-400f-9c73-4af551ebdea2 req-d256db49-35d9-47fa-8ad5-4fa3d33ec17b service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:28.406736 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ec019671-8b45-400f-9c73-4af551ebdea2 req-d256db49-35d9-47fa-8ad5-4fa3d33ec17b service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:28.431426 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-ec019671-8b45-400f-9c73-4af551ebdea2 req-d256db49-35d9-47fa-8ad5-4fa3d33ec17b service nova] Creating event network-changed:dfced65c-3e28-40bf-b025-33cddcb37142 for instance e19edf61-5458-4f12-84b2-346b41506ff3 on n-h1-master-1 Oct 30 01:17:28.459832 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-ec019671-8b45-400f-9c73-4af551ebdea2 req-d256db49-35d9-47fa-8ad5-4fa3d33ec17b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081180 Oct 30 01:17:28.460537 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 593/1193] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:17:28.479281 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e67be3ab-be4f-47a6-ad52-1dafbee1798f tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:28.484540 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e67be3ab-be4f-47a6-ad52-1dafbee1798f tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:28.501607 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e67be3ab-be4f-47a6-ad52-1dafbee1798f tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:28.502539 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e67be3ab-be4f-47a6-ad52-1dafbee1798f tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:28.503234 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e67be3ab-be4f-47a6-ad52-1dafbee1798f tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:28.504666 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e67be3ab-be4f-47a6-ad52-1dafbee1798f tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:28.505966 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e67be3ab-be4f-47a6-ad52-1dafbee1798f tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:28.506616 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e67be3ab-be4f-47a6-ad52-1dafbee1798f tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:28.756172 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e67be3ab-be4f-47a6-ad52-1dafbee1798f tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:28.772310 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e67be3ab-be4f-47a6-ad52-1dafbee1798f tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd" status: 200 len: 1716 microversion: 2.1 time: 0.310376 Oct 30 01:17:28.774753 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 594/1194] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:28 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd => generated 1716 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:28.783042 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-be163048-66f0-44b7-a351-7641024d6140 req-70628288-5395-4e1d-8395-84a89fed86cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b368660-effb-411d-b713-455fc7fd44cd", "name": "network-vif-unplugged", "status": "completed", "tag": "be63e75e-18fe-4000-8f59-5722fd84c310"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:28.806616 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-be163048-66f0-44b7-a351-7641024d6140 req-70628288-5395-4e1d-8395-84a89fed86cc service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:28.807633 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-be163048-66f0-44b7-a351-7641024d6140 req-70628288-5395-4e1d-8395-84a89fed86cc service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:28.808205 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-be163048-66f0-44b7-a351-7641024d6140 req-70628288-5395-4e1d-8395-84a89fed86cc service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:28.836775 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-be163048-66f0-44b7-a351-7641024d6140 req-70628288-5395-4e1d-8395-84a89fed86cc service nova] Creating event network-vif-unplugged:be63e75e-18fe-4000-8f59-5722fd84c310 for instance 6b368660-effb-411d-b713-455fc7fd44cd on n-h1-master-1 Oct 30 01:17:28.847729 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-be163048-66f0-44b7-a351-7641024d6140 req-70628288-5395-4e1d-8395-84a89fed86cc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070716 Oct 30 01:17:28.854839 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 595/1195] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:17:28.862153 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4eef92d2-9df4-48ae-b8bf-41ea7b1cb894 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:28.867905 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4eef92d2-9df4-48ae-b8bf-41ea7b1cb894 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 5387ae83-7934-49d6-a893-3661477ffe69] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:28.878377 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4eef92d2-9df4-48ae-b8bf-41ea7b1cb894 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:28.880080 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4eef92d2-9df4-48ae-b8bf-41ea7b1cb894 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:28.880808 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4eef92d2-9df4-48ae-b8bf-41ea7b1cb894 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:28.881833 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4eef92d2-9df4-48ae-b8bf-41ea7b1cb894 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:28.882524 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4eef92d2-9df4-48ae-b8bf-41ea7b1cb894 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:28.883175 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4eef92d2-9df4-48ae-b8bf-41ea7b1cb894 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:29.045391 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4eef92d2-9df4-48ae-b8bf-41ea7b1cb894 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:29.054699 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4eef92d2-9df4-48ae-b8bf-41ea7b1cb894 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/5387ae83-7934-49d6-a893-3661477ffe69" status: 200 len: 1212 microversion: 2.1 time: 0.198257 Oct 30 01:17:29.077823 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 596/1196] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:28 2022] GET /compute/v2.1/servers/5387ae83-7934-49d6-a893-3661477ffe69 => generated 1212 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:29.080339 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7064ab4b-c512-454b-b73f-1fe6b7436eed tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:29.081055 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7064ab4b-c512-454b-b73f-1fe6b7436eed tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] [instance: 8ebd67c2-b4d9-4e1b-9946-c8e05013170d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:29.087641 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7064ab4b-c512-454b-b73f-1fe6b7436eed tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:29.088186 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7064ab4b-c512-454b-b73f-1fe6b7436eed tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:29.088924 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7064ab4b-c512-454b-b73f-1fe6b7436eed tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:29.089714 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7064ab4b-c512-454b-b73f-1fe6b7436eed tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:29.090184 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7064ab4b-c512-454b-b73f-1fe6b7436eed tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:29.090615 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7064ab4b-c512-454b-b73f-1fe6b7436eed tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:29.244759 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-32ce19d3-8c6d-4f5b-82d6-a96dcad6c592 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: e19edf61-5458-4f12-84b2-346b41506ff3] Updating instance_info_cache with network_info: [{"id": "dfced65c-3e28-40bf-b025-33cddcb37142", "address": "fa:16:3e:72:cd:9f", "network": {"id": "c383b18e-d32f-47dc-90a2-236912a6d567", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-257091766-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.5.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "10e2bdadb00745888a171041c5714bd9", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapdfced65c-3e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 30 01:17:29.332702 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7064ab4b-c512-454b-b73f-1fe6b7436eed tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d87ef57cf344734b662bd792022c4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea74354a0b4753a363fc5d4f6d4f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:29.345447 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-32ce19d3-8c6d-4f5b-82d6-a96dcad6c592 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Releasing lock "refresh_cache-e19edf61-5458-4f12-84b2-346b41506ff3" {{(pid=121103) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 30 01:17:29.349326 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-32ce19d3-8c6d-4f5b-82d6-a96dcad6c592 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] 10.222.0.13 "POST /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3/action" status: 202 len: 0 microversion: 2.1 time: 3.300109 Oct 30 01:17:29.353143 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 601/1197] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:17:26 2022] POST /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3/action => generated 0 bytes in 3304 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 30 01:17:29.362538 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-ffd9c25a-0b9b-418d-99f7-04590b9f662d req-4f24b316-cb80-4ffc-ba96-ddef238ab610 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f10b90ae-23e1-4ca1-b95e-9404e606e5d9", "name": "network-vif-plugged", "status": "completed", "tag": "9f14e853-78c5-4b79-8df2-448f8f1726ff"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:29.374592 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7064ab4b-c512-454b-b73f-1fe6b7436eed tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] 10.222.0.13 "GET /compute/v2.1/servers/8ebd67c2-b4d9-4e1b-9946-c8e05013170d" status: 200 len: 1319 microversion: 2.1 time: 0.301674 Oct 30 01:17:29.375831 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 597/1198] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:29 2022] GET /compute/v2.1/servers/8ebd67c2-b4d9-4e1b-9946-c8e05013170d => generated 1319 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:29.382902 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ffd9c25a-0b9b-418d-99f7-04590b9f662d req-4f24b316-cb80-4ffc-ba96-ddef238ab610 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:29.384405 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ffd9c25a-0b9b-418d-99f7-04590b9f662d req-4f24b316-cb80-4ffc-ba96-ddef238ab610 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:29.385478 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ffd9c25a-0b9b-418d-99f7-04590b9f662d req-4f24b316-cb80-4ffc-ba96-ddef238ab610 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:29.404729 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cc152983-6d2f-4195-96e8-4762467a85f7 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:29.415137 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cc152983-6d2f-4195-96e8-4762467a85f7 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:29.429107 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cc152983-6d2f-4195-96e8-4762467a85f7 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:29.429107 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cc152983-6d2f-4195-96e8-4762467a85f7 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:29.431659 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-ffd9c25a-0b9b-418d-99f7-04590b9f662d req-4f24b316-cb80-4ffc-ba96-ddef238ab610 service nova] Creating event network-vif-plugged:9f14e853-78c5-4b79-8df2-448f8f1726ff for instance f10b90ae-23e1-4ca1-b95e-9404e606e5d9 on n-h2-master-1 Oct 30 01:17:29.441688 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cc152983-6d2f-4195-96e8-4762467a85f7 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:29.445709 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-ffd9c25a-0b9b-418d-99f7-04590b9f662d req-4f24b316-cb80-4ffc-ba96-ddef238ab610 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092043 Oct 30 01:17:29.447084 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 602/1199] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:17:29.454990 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cc152983-6d2f-4195-96e8-4762467a85f7 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:29.456386 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cc152983-6d2f-4195-96e8-4762467a85f7 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:29.456963 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cc152983-6d2f-4195-96e8-4762467a85f7 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:29.480217 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9bee5859-f605-49da-8558-ab8f10fd838d tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.5.126"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:29.487836 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9bee5859-f605-49da-8558-ab8f10fd838d tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: 04619e4f-8b79-4196-9794-f27d605c4328] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:29.502465 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9bee5859-f605-49da-8558-ab8f10fd838d tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:29.529037 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9bee5859-f605-49da-8558-ab8f10fd838d tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:29.530586 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9bee5859-f605-49da-8558-ab8f10fd838d tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:29.532051 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9bee5859-f605-49da-8558-ab8f10fd838d tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:29.532973 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9bee5859-f605-49da-8558-ab8f10fd838d tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:29.533651 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9bee5859-f605-49da-8558-ab8f10fd838d tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:29.573725 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9bee5859-f605-49da-8558-ab8f10fd838d tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "refresh_cache-04619e4f-8b79-4196-9794-f27d605c4328" {{(pid=121103) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 30 01:17:29.574102 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9bee5859-f605-49da-8558-ab8f10fd838d tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquired lock "refresh_cache-04619e4f-8b79-4196-9794-f27d605c4328" {{(pid=121103) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 30 01:17:29.805844 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-cc152983-6d2f-4195-96e8-4762467a85f7 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:29.832058 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cc152983-6d2f-4195-96e8-4762467a85f7 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1477 microversion: 2.1 time: 0.454838 Oct 30 01:17:29.832572 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 598/1200] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:29 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1477 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:29.861574 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-02ea1bc4-1537-4d5f-a233-7635d750b151 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:29.862269 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-02ea1bc4-1537-4d5f-a233-7635d750b151 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:29.891024 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-02ea1bc4-1537-4d5f-a233-7635d750b151 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:29.897120 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-02ea1bc4-1537-4d5f-a233-7635d750b151 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:29.897120 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-02ea1bc4-1537-4d5f-a233-7635d750b151 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:29.897120 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-02ea1bc4-1537-4d5f-a233-7635d750b151 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:29.897120 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-02ea1bc4-1537-4d5f-a233-7635d750b151 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:29.897588 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-02ea1bc4-1537-4d5f-a233-7635d750b151 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:30.532334 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-02ea1bc4-1537-4d5f-a233-7635d750b151 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:30.546438 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-02ea1bc4-1537-4d5f-a233-7635d750b151 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1476 microversion: 2.1 time: 0.698284 Oct 30 01:17:30.569635 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 599/1201] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:29 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1476 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:30.575744 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-10a92279-e0e1-4253-808e-9c9a9c52dab7 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:30.577665 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-10a92279-e0e1-4253-808e-9c9a9c52dab7 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:30.584732 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-10a92279-e0e1-4253-808e-9c9a9c52dab7 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:30.585246 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-10a92279-e0e1-4253-808e-9c9a9c52dab7 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:30.585727 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-10a92279-e0e1-4253-808e-9c9a9c52dab7 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:30.587791 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-10a92279-e0e1-4253-808e-9c9a9c52dab7 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:30.588560 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-10a92279-e0e1-4253-808e-9c9a9c52dab7 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:30.589192 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-10a92279-e0e1-4253-808e-9c9a9c52dab7 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:30.882029 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-10a92279-e0e1-4253-808e-9c9a9c52dab7 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:30.896364 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-10a92279-e0e1-4253-808e-9c9a9c52dab7 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd" status: 200 len: 1716 microversion: 2.1 time: 0.325444 Oct 30 01:17:30.901400 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 600/1202] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:30 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd => generated 1716 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:30.902659 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1c9d81b6-02f4-4a7d-bbb9-43375b1a30cc tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:30.902859 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1c9d81b6-02f4-4a7d-bbb9-43375b1a30cc tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 5387ae83-7934-49d6-a893-3661477ffe69] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:30.929042 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1c9d81b6-02f4-4a7d-bbb9-43375b1a30cc tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:30.929818 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1c9d81b6-02f4-4a7d-bbb9-43375b1a30cc tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:30.930447 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1c9d81b6-02f4-4a7d-bbb9-43375b1a30cc tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:30.931331 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1c9d81b6-02f4-4a7d-bbb9-43375b1a30cc tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:30.931974 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1c9d81b6-02f4-4a7d-bbb9-43375b1a30cc tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:30.932403 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1c9d81b6-02f4-4a7d-bbb9-43375b1a30cc tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:31.010786 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1c9d81b6-02f4-4a7d-bbb9-43375b1a30cc tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:31.019377 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1c9d81b6-02f4-4a7d-bbb9-43375b1a30cc tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/5387ae83-7934-49d6-a893-3661477ffe69" status: 200 len: 1268 microversion: 2.1 time: 0.120809 Oct 30 01:17:31.019980 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 601/1203] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:30 2022] GET /compute/v2.1/servers/5387ae83-7934-49d6-a893-3661477ffe69 => generated 1268 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:31.025499 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4d6a92a2-e7ac-4ba9-9f8f-68b2562d2faf tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:31.026430 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4d6a92a2-e7ac-4ba9-9f8f-68b2562d2faf tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] [instance: 8ebd67c2-b4d9-4e1b-9946-c8e05013170d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:31.033687 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d6a92a2-e7ac-4ba9-9f8f-68b2562d2faf tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:31.034486 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d6a92a2-e7ac-4ba9-9f8f-68b2562d2faf tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:31.035144 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d6a92a2-e7ac-4ba9-9f8f-68b2562d2faf tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:31.036589 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d6a92a2-e7ac-4ba9-9f8f-68b2562d2faf tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:31.037208 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d6a92a2-e7ac-4ba9-9f8f-68b2562d2faf tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:31.037833 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d6a92a2-e7ac-4ba9-9f8f-68b2562d2faf tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:31.293457 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4d6a92a2-e7ac-4ba9-9f8f-68b2562d2faf tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d87ef57cf344734b662bd792022c4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea74354a0b4753a363fc5d4f6d4f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:31.302266 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4d6a92a2-e7ac-4ba9-9f8f-68b2562d2faf tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] 10.222.0.13 "GET /compute/v2.1/servers/8ebd67c2-b4d9-4e1b-9946-c8e05013170d" status: 200 len: 1319 microversion: 2.1 time: 0.280272 Oct 30 01:17:31.303498 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 602/1204] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:31 2022] GET /compute/v2.1/servers/8ebd67c2-b4d9-4e1b-9946-c8e05013170d => generated 1319 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:31.309095 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-04431ec9-ccce-4da2-b511-23a743578fde tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:31.309987 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-04431ec9-ccce-4da2-b511-23a743578fde tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:31.317521 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04431ec9-ccce-4da2-b511-23a743578fde tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:31.318004 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04431ec9-ccce-4da2-b511-23a743578fde tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:31.318656 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04431ec9-ccce-4da2-b511-23a743578fde tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:31.319410 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04431ec9-ccce-4da2-b511-23a743578fde tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:31.319868 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04431ec9-ccce-4da2-b511-23a743578fde tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:31.320288 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04431ec9-ccce-4da2-b511-23a743578fde tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:31.502939 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-04431ec9-ccce-4da2-b511-23a743578fde tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:31.513113 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-04431ec9-ccce-4da2-b511-23a743578fde tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1477 microversion: 2.1 time: 0.208092 Oct 30 01:17:31.530240 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 603/1205] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:31 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1477 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:31.534303 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-16f31e43-80cf-405f-8d64-f9313fe4cfc4 req-dc53cadf-8af4-4ae8-8130-e2fb10a9d17c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b368660-effb-411d-b713-455fc7fd44cd", "tag": "be63e75e-18fe-4000-8f59-5722fd84c310"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:31.545478 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-16f31e43-80cf-405f-8d64-f9313fe4cfc4 req-dc53cadf-8af4-4ae8-8130-e2fb10a9d17c service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:31.545970 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-16f31e43-80cf-405f-8d64-f9313fe4cfc4 req-dc53cadf-8af4-4ae8-8130-e2fb10a9d17c service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:31.546397 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-16f31e43-80cf-405f-8d64-f9313fe4cfc4 req-dc53cadf-8af4-4ae8-8130-e2fb10a9d17c service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:31.558690 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-16f31e43-80cf-405f-8d64-f9313fe4cfc4 req-dc53cadf-8af4-4ae8-8130-e2fb10a9d17c service nova] Creating event network-changed:be63e75e-18fe-4000-8f59-5722fd84c310 for instance 6b368660-effb-411d-b713-455fc7fd44cd on n-h1-master-1 Oct 30 01:17:31.564234 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-16f31e43-80cf-405f-8d64-f9313fe4cfc4 req-dc53cadf-8af4-4ae8-8130-e2fb10a9d17c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037215 Oct 30 01:17:31.565268 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 604/1206] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:17:31.581209 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4b77e9d3-864e-4e3c-ada8-884ac80717a7 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:31.587752 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4b77e9d3-864e-4e3c-ada8-884ac80717a7 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:31.590613 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b77e9d3-864e-4e3c-ada8-884ac80717a7 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:31.591483 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b77e9d3-864e-4e3c-ada8-884ac80717a7 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:31.592071 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b77e9d3-864e-4e3c-ada8-884ac80717a7 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:31.593063 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b77e9d3-864e-4e3c-ada8-884ac80717a7 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:31.593972 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b77e9d3-864e-4e3c-ada8-884ac80717a7 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:31.594524 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b77e9d3-864e-4e3c-ada8-884ac80717a7 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:31.850921 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4b77e9d3-864e-4e3c-ada8-884ac80717a7 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:31.859869 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4b77e9d3-864e-4e3c-ada8-884ac80717a7 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1476 microversion: 2.1 time: 0.283724 Oct 30 01:17:31.860454 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 605/1207] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:31 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1476 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:31.921626 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-41c1bead-ab43-4a7e-b13d-6282619c95d1 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:31.922706 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-41c1bead-ab43-4a7e-b13d-6282619c95d1 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:31.929790 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-41c1bead-ab43-4a7e-b13d-6282619c95d1 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:31.930445 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-41c1bead-ab43-4a7e-b13d-6282619c95d1 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:31.931246 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-41c1bead-ab43-4a7e-b13d-6282619c95d1 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:31.932999 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-41c1bead-ab43-4a7e-b13d-6282619c95d1 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:31.933656 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-41c1bead-ab43-4a7e-b13d-6282619c95d1 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:31.935120 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-41c1bead-ab43-4a7e-b13d-6282619c95d1 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:32.190146 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-41c1bead-ab43-4a7e-b13d-6282619c95d1 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:32.199096 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-41c1bead-ab43-4a7e-b13d-6282619c95d1 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd" status: 200 len: 1716 microversion: 2.1 time: 0.282379 Oct 30 01:17:32.213769 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 606/1208] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:31 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd => generated 1716 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:17:32.220206 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-51ba5fe4-6f55-47b2-939a-e51256bf4820 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:32.223071 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-51ba5fe4-6f55-47b2-939a-e51256bf4820 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 5387ae83-7934-49d6-a893-3661477ffe69] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:32.227007 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:17:32.228638 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51ba5fe4-6f55-47b2-939a-e51256bf4820 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:32.229315 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51ba5fe4-6f55-47b2-939a-e51256bf4820 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:32.229970 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51ba5fe4-6f55-47b2-939a-e51256bf4820 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:32.230921 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51ba5fe4-6f55-47b2-939a-e51256bf4820 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:32.231530 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51ba5fe4-6f55-47b2-939a-e51256bf4820 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:32.232115 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51ba5fe4-6f55-47b2-939a-e51256bf4820 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:32.321047 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-51ba5fe4-6f55-47b2-939a-e51256bf4820 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:32.339897 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-51ba5fe4-6f55-47b2-939a-e51256bf4820 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/5387ae83-7934-49d6-a893-3661477ffe69" status: 200 len: 1268 microversion: 2.1 time: 0.124153 Oct 30 01:17:32.354319 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 607/1209] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:32 2022] GET /compute/v2.1/servers/5387ae83-7934-49d6-a893-3661477ffe69 => generated 1268 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:32.354319 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b5a8429a-3e19-4b71-839b-5e7fccc0325e tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:32.354319 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b5a8429a-3e19-4b71-839b-5e7fccc0325e tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] [instance: 8ebd67c2-b4d9-4e1b-9946-c8e05013170d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:32.359410 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b5a8429a-3e19-4b71-839b-5e7fccc0325e tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:32.361591 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b5a8429a-3e19-4b71-839b-5e7fccc0325e tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:32.363247 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b5a8429a-3e19-4b71-839b-5e7fccc0325e tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:32.373668 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b5a8429a-3e19-4b71-839b-5e7fccc0325e tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:32.374262 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b5a8429a-3e19-4b71-839b-5e7fccc0325e tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:32.374719 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b5a8429a-3e19-4b71-839b-5e7fccc0325e tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:32.645602 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b5a8429a-3e19-4b71-839b-5e7fccc0325e tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d87ef57cf344734b662bd792022c4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea74354a0b4753a363fc5d4f6d4f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:32.654028 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b5a8429a-3e19-4b71-839b-5e7fccc0325e tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] 10.222.0.13 "GET /compute/v2.1/servers/8ebd67c2-b4d9-4e1b-9946-c8e05013170d" status: 200 len: 1319 microversion: 2.1 time: 0.312427 Oct 30 01:17:32.664415 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 608/1210] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:32 2022] GET /compute/v2.1/servers/8ebd67c2-b4d9-4e1b-9946-c8e05013170d => generated 1319 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:32.669650 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-23bb22b8-7a42-40d2-83fd-cb2f2bfe77d4 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:32.670491 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-23bb22b8-7a42-40d2-83fd-cb2f2bfe77d4 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:32.685115 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-23bb22b8-7a42-40d2-83fd-cb2f2bfe77d4 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:32.685951 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-23bb22b8-7a42-40d2-83fd-cb2f2bfe77d4 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:32.690314 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-23bb22b8-7a42-40d2-83fd-cb2f2bfe77d4 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:32.691348 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-23bb22b8-7a42-40d2-83fd-cb2f2bfe77d4 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:32.691994 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-23bb22b8-7a42-40d2-83fd-cb2f2bfe77d4 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:32.692619 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-23bb22b8-7a42-40d2-83fd-cb2f2bfe77d4 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:32.920686 n-d-master-1 devstack@n-api.service[121103]: INFO nova.network.neutron [None req-9bee5859-f605-49da-8558-ab8f10fd838d tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: 04619e4f-8b79-4196-9794-f27d605c4328] re-assign floating IP 172.35.5.126 from instance e19edf61-5458-4f12-84b2-346b41506ff3 Oct 30 01:17:32.997725 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-9bee5859-f605-49da-8558-ab8f10fd838d tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: e19edf61-5458-4f12-84b2-346b41506ff3] Building network info cache for instance {{(pid=121103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 30 01:17:32.999008 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-23bb22b8-7a42-40d2-83fd-cb2f2bfe77d4 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:33.021059 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-23bb22b8-7a42-40d2-83fd-cb2f2bfe77d4 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1463 microversion: 2.1 time: 0.353563 Oct 30 01:17:33.024564 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 609/1211] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:32 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1463 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:33.050929 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-378607d4-c3d2-4e4e-a848-7d62125c7997 req-84dfb6e2-eb03-4041-aefa-33a98ee3c164 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e19edf61-5458-4f12-84b2-346b41506ff3", "tag": "dfced65c-3e28-40bf-b025-33cddcb37142"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:33.063189 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-378607d4-c3d2-4e4e-a848-7d62125c7997 req-84dfb6e2-eb03-4041-aefa-33a98ee3c164 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:33.063667 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-378607d4-c3d2-4e4e-a848-7d62125c7997 req-84dfb6e2-eb03-4041-aefa-33a98ee3c164 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:33.064107 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-378607d4-c3d2-4e4e-a848-7d62125c7997 req-84dfb6e2-eb03-4041-aefa-33a98ee3c164 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:33.076673 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-378607d4-c3d2-4e4e-a848-7d62125c7997 req-84dfb6e2-eb03-4041-aefa-33a98ee3c164 service nova] Creating event network-changed:dfced65c-3e28-40bf-b025-33cddcb37142 for instance e19edf61-5458-4f12-84b2-346b41506ff3 on n-h1-master-1 Oct 30 01:17:33.101550 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-378607d4-c3d2-4e4e-a848-7d62125c7997 req-84dfb6e2-eb03-4041-aefa-33a98ee3c164 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054630 Oct 30 01:17:33.107109 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 610/1212] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:17:33.107382 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-742de01d-1747-4acd-9ab7-9f2ea57a4093 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:33.122718 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-742de01d-1747-4acd-9ab7-9f2ea57a4093 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:33.129759 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-742de01d-1747-4acd-9ab7-9f2ea57a4093 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:33.131101 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-742de01d-1747-4acd-9ab7-9f2ea57a4093 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:33.131347 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-742de01d-1747-4acd-9ab7-9f2ea57a4093 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:33.132086 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-742de01d-1747-4acd-9ab7-9f2ea57a4093 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:33.132588 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-742de01d-1747-4acd-9ab7-9f2ea57a4093 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:33.132963 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-742de01d-1747-4acd-9ab7-9f2ea57a4093 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:33.376178 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-742de01d-1747-4acd-9ab7-9f2ea57a4093 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:33.380718 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:17:33.412713 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-742de01d-1747-4acd-9ab7-9f2ea57a4093 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1476 microversion: 2.1 time: 0.291866 Oct 30 01:17:33.412713 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 611/1213] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:33 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1476 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:33.412713 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-db264f51-251d-4d0b-803c-60405233afe4 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:33.412713 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-db264f51-251d-4d0b-803c-60405233afe4 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:33.427291 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-db264f51-251d-4d0b-803c-60405233afe4 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:33.430658 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-db264f51-251d-4d0b-803c-60405233afe4 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:33.433556 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-db264f51-251d-4d0b-803c-60405233afe4 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:33.433556 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-db264f51-251d-4d0b-803c-60405233afe4 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:33.433556 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-db264f51-251d-4d0b-803c-60405233afe4 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:33.433556 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-db264f51-251d-4d0b-803c-60405233afe4 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:33.750965 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-db264f51-251d-4d0b-803c-60405233afe4 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:33.760111 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-db264f51-251d-4d0b-803c-60405233afe4 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1463 microversion: 2.1 time: 0.357213 Oct 30 01:17:33.764035 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 612/1214] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:33 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1463 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:33.770234 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b47d62a5-c495-41b5-b4e7-6aadf029f0f2 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:33.776053 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b47d62a5-c495-41b5-b4e7-6aadf029f0f2 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:33.779588 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b47d62a5-c495-41b5-b4e7-6aadf029f0f2 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:33.780347 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b47d62a5-c495-41b5-b4e7-6aadf029f0f2 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:33.781005 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b47d62a5-c495-41b5-b4e7-6aadf029f0f2 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:33.781951 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b47d62a5-c495-41b5-b4e7-6aadf029f0f2 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:33.782681 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b47d62a5-c495-41b5-b4e7-6aadf029f0f2 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:33.783314 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b47d62a5-c495-41b5-b4e7-6aadf029f0f2 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:34.086234 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b47d62a5-c495-41b5-b4e7-6aadf029f0f2 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:34.101451 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b47d62a5-c495-41b5-b4e7-6aadf029f0f2 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd" status: 200 len: 1716 microversion: 2.1 time: 0.333679 Oct 30 01:17:34.104149 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 613/1215] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:33 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd => generated 1716 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:34.107303 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-9bee5859-f605-49da-8558-ab8f10fd838d tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: e19edf61-5458-4f12-84b2-346b41506ff3] Updating instance_info_cache with network_info: [{"id": "dfced65c-3e28-40bf-b025-33cddcb37142", "address": "fa:16:3e:72:cd:9f", "network": {"id": "c383b18e-d32f-47dc-90a2-236912a6d567", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-257091766-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "10e2bdadb00745888a171041c5714bd9", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapdfced65c-3e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 30 01:17:34.112265 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b05c44af-ebfa-4891-be49-8d7dafdb6d65 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:34.113187 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b05c44af-ebfa-4891-be49-8d7dafdb6d65 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 5387ae83-7934-49d6-a893-3661477ffe69] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:34.122882 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b05c44af-ebfa-4891-be49-8d7dafdb6d65 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:34.128204 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b05c44af-ebfa-4891-be49-8d7dafdb6d65 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:34.128204 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b05c44af-ebfa-4891-be49-8d7dafdb6d65 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:34.128204 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b05c44af-ebfa-4891-be49-8d7dafdb6d65 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:34.128204 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b05c44af-ebfa-4891-be49-8d7dafdb6d65 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:34.128701 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b05c44af-ebfa-4891-be49-8d7dafdb6d65 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:34.167763 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-9bee5859-f605-49da-8558-ab8f10fd838d tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: 04619e4f-8b79-4196-9794-f27d605c4328] Building network info cache for instance {{(pid=121103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 30 01:17:34.610729 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b05c44af-ebfa-4891-be49-8d7dafdb6d65 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:34.624245 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b05c44af-ebfa-4891-be49-8d7dafdb6d65 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/5387ae83-7934-49d6-a893-3661477ffe69" status: 200 len: 1274 microversion: 2.1 time: 0.516701 Oct 30 01:17:34.624896 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 614/1216] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:34 2022] GET /compute/v2.1/servers/5387ae83-7934-49d6-a893-3661477ffe69 => generated 1274 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:34.648847 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-a7eb259c-b7dc-46ec-9996-6501f9b2ad5d req-d2cff7f2-7c5c-4f85-810d-288439905b99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ebd67c2-b4d9-4e1b-9946-c8e05013170d", "tag": "12167317-3164-48af-bd53-4155aaa88a38"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:34.669114 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=6 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:17:34.677535 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-a7eb259c-b7dc-46ec-9996-6501f9b2ad5d req-d2cff7f2-7c5c-4f85-810d-288439905b99 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:34.678299 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-a7eb259c-b7dc-46ec-9996-6501f9b2ad5d req-d2cff7f2-7c5c-4f85-810d-288439905b99 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:34.678915 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-a7eb259c-b7dc-46ec-9996-6501f9b2ad5d req-d2cff7f2-7c5c-4f85-810d-288439905b99 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:34.701185 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-a7eb259c-b7dc-46ec-9996-6501f9b2ad5d req-d2cff7f2-7c5c-4f85-810d-288439905b99 service nova] Creating event network-changed:12167317-3164-48af-bd53-4155aaa88a38 for instance 8ebd67c2-b4d9-4e1b-9946-c8e05013170d on n-h1-master-1 Oct 30 01:17:34.736920 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-a7eb259c-b7dc-46ec-9996-6501f9b2ad5d req-d2cff7f2-7c5c-4f85-810d-288439905b99 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095911 Oct 30 01:17:34.738698 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 615/1217] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:17:34.746656 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9f55c991-2a68-42a3-8124-54a01f7fcafe tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:34.747611 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9f55c991-2a68-42a3-8124-54a01f7fcafe tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] [instance: 8ebd67c2-b4d9-4e1b-9946-c8e05013170d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:34.757305 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9f55c991-2a68-42a3-8124-54a01f7fcafe tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:34.760108 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9f55c991-2a68-42a3-8124-54a01f7fcafe tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:34.760768 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9f55c991-2a68-42a3-8124-54a01f7fcafe tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:34.761732 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9f55c991-2a68-42a3-8124-54a01f7fcafe tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:34.764412 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9f55c991-2a68-42a3-8124-54a01f7fcafe tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:34.765436 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9f55c991-2a68-42a3-8124-54a01f7fcafe tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:35.163764 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9f55c991-2a68-42a3-8124-54a01f7fcafe tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d87ef57cf344734b662bd792022c4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea74354a0b4753a363fc5d4f6d4f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:35.172812 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9f55c991-2a68-42a3-8124-54a01f7fcafe tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] 10.222.0.13 "GET /compute/v2.1/servers/8ebd67c2-b4d9-4e1b-9946-c8e05013170d" status: 200 len: 1319 microversion: 2.1 time: 0.431425 Oct 30 01:17:35.174983 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 616/1218] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:34 2022] GET /compute/v2.1/servers/8ebd67c2-b4d9-4e1b-9946-c8e05013170d => generated 1319 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:35.186545 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4414a6f7-4e43-4e84-b602-a7543c1c499f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "deb14158-45d8-4539-889d-ff9726d046d7"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:35.195138 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4414a6f7-4e43-4e84-b602-a7543c1c499f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:35.211767 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4414a6f7-4e43-4e84-b602-a7543c1c499f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:35.212888 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4414a6f7-4e43-4e84-b602-a7543c1c499f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:35.212888 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4414a6f7-4e43-4e84-b602-a7543c1c499f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:35.213461 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4414a6f7-4e43-4e84-b602-a7543c1c499f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:35.213995 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4414a6f7-4e43-4e84-b602-a7543c1c499f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:35.214362 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4414a6f7-4e43-4e84-b602-a7543c1c499f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:35.396163 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-4414a6f7-4e43-4e84-b602-a7543c1c499f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:17:35.396888 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-4414a6f7-4e43-4e84-b602-a7543c1c499f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:17:35.402551 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-4414a6f7-4e43-4e84-b602-a7543c1c499f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:17:35.402551 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-4414a6f7-4e43-4e84-b602-a7543c1c499f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:17:35.402551 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-4414a6f7-4e43-4e84-b602-a7543c1c499f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:17:35.675813 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4414a6f7-4e43-4e84-b602-a7543c1c499f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:35.690082 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4414a6f7-4e43-4e84-b602-a7543c1c499f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:35.693812 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4414a6f7-4e43-4e84-b602-a7543c1c499f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:35.694316 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4414a6f7-4e43-4e84-b602-a7543c1c499f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:35.695087 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4414a6f7-4e43-4e84-b602-a7543c1c499f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:35.697281 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4414a6f7-4e43-4e84-b602-a7543c1c499f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:35.699204 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4414a6f7-4e43-4e84-b602-a7543c1c499f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:35.699498 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=16 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:17:35.731706 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4414a6f7-4e43-4e84-b602-a7543c1c499f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "POST /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9/action" status: 202 len: 1067 microversion: 2.1 time: 0.555607 Oct 30 01:17:35.747518 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 617/1219] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:17:35 2022] POST /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9/action => generated 1067 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 30 01:17:35.753167 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-30299fcb-a364-4d83-95f9-81bf62352973 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:35.754166 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-30299fcb-a364-4d83-95f9-81bf62352973 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:35.760808 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-30299fcb-a364-4d83-95f9-81bf62352973 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:35.761593 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-30299fcb-a364-4d83-95f9-81bf62352973 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:35.762192 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-30299fcb-a364-4d83-95f9-81bf62352973 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:35.763152 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-30299fcb-a364-4d83-95f9-81bf62352973 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:35.763773 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-30299fcb-a364-4d83-95f9-81bf62352973 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:35.764365 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-30299fcb-a364-4d83-95f9-81bf62352973 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:35.923280 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-9bee5859-f605-49da-8558-ab8f10fd838d tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: 04619e4f-8b79-4196-9794-f27d605c4328] Updating instance_info_cache with network_info: [{"id": "6a9b0f09-5783-40cf-a067-b3a5f5f29ea0", "address": "fa:16:3e:ef:28:7d", "network": {"id": "c383b18e-d32f-47dc-90a2-236912a6d567", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-257091766-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.5.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "10e2bdadb00745888a171041c5714bd9", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6a9b0f09-57", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 30 01:17:36.024197 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-30299fcb-a364-4d83-95f9-81bf62352973 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:36.025450 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9bee5859-f605-49da-8558-ab8f10fd838d tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Releasing lock "refresh_cache-04619e4f-8b79-4196-9794-f27d605c4328" {{(pid=121103) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 30 01:17:36.030849 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9bee5859-f605-49da-8558-ab8f10fd838d tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] 10.222.0.13 "POST /compute/v2.1/servers/04619e4f-8b79-4196-9794-f27d605c4328/action" status: 202 len: 0 microversion: 2.1 time: 6.577711 Oct 30 01:17:36.032597 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-30299fcb-a364-4d83-95f9-81bf62352973 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1476 microversion: 2.1 time: 0.283577 Oct 30 01:17:36.043636 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 603/1220] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:17:29 2022] POST /compute/v2.1/servers/04619e4f-8b79-4196-9794-f27d605c4328/action => generated 0 bytes in 6586 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 30 01:17:36.044651 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 618/1221] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:35 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1476 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:36.054769 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-f2426416-10b2-4485-83c9-6ac85436b24c req-228f12b5-8c24-4455-b1fb-99c0a7160cc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04619e4f-8b79-4196-9794-f27d605c4328", "tag": "6a9b0f09-5783-40cf-a067-b3a5f5f29ea0"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:36.058303 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bea02d89-3a90-45a8-8b8a-14a704f5c594 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:36.061481 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bea02d89-3a90-45a8-8b8a-14a704f5c594 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:36.061669 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-f2426416-10b2-4485-83c9-6ac85436b24c req-228f12b5-8c24-4455-b1fb-99c0a7160cc7 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:36.061669 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-f2426416-10b2-4485-83c9-6ac85436b24c req-228f12b5-8c24-4455-b1fb-99c0a7160cc7 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:36.061669 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-f2426416-10b2-4485-83c9-6ac85436b24c req-228f12b5-8c24-4455-b1fb-99c0a7160cc7 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:36.066145 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bea02d89-3a90-45a8-8b8a-14a704f5c594 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:36.066851 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bea02d89-3a90-45a8-8b8a-14a704f5c594 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:36.067318 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bea02d89-3a90-45a8-8b8a-14a704f5c594 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:36.068126 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bea02d89-3a90-45a8-8b8a-14a704f5c594 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:36.068638 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bea02d89-3a90-45a8-8b8a-14a704f5c594 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:36.069227 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bea02d89-3a90-45a8-8b8a-14a704f5c594 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:36.073206 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-f2426416-10b2-4485-83c9-6ac85436b24c req-228f12b5-8c24-4455-b1fb-99c0a7160cc7 service nova] Creating event network-changed:6a9b0f09-5783-40cf-a067-b3a5f5f29ea0 for instance 04619e4f-8b79-4196-9794-f27d605c4328 on n-h2-master-1 Oct 30 01:17:36.078544 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-f2426416-10b2-4485-83c9-6ac85436b24c req-228f12b5-8c24-4455-b1fb-99c0a7160cc7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041790 Oct 30 01:17:36.080751 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 604/1222] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:17:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:17:36.089800 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e30aa838-7980-4a6a-a7e7-9d2003a392fd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:36.089965 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e30aa838-7980-4a6a-a7e7-9d2003a392fd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 5387ae83-7934-49d6-a893-3661477ffe69] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:36.096696 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e30aa838-7980-4a6a-a7e7-9d2003a392fd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:36.097225 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e30aa838-7980-4a6a-a7e7-9d2003a392fd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:36.097715 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e30aa838-7980-4a6a-a7e7-9d2003a392fd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:36.099201 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e30aa838-7980-4a6a-a7e7-9d2003a392fd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:36.099822 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e30aa838-7980-4a6a-a7e7-9d2003a392fd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:36.100269 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e30aa838-7980-4a6a-a7e7-9d2003a392fd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:36.300889 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bea02d89-3a90-45a8-8b8a-14a704f5c594 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:36.311303 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e30aa838-7980-4a6a-a7e7-9d2003a392fd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:36.319636 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bea02d89-3a90-45a8-8b8a-14a704f5c594 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd" status: 200 len: 1716 microversion: 2.1 time: 0.273096 Oct 30 01:17:36.320185 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e30aa838-7980-4a6a-a7e7-9d2003a392fd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/5387ae83-7934-49d6-a893-3661477ffe69" status: 200 len: 1316 microversion: 2.1 time: 0.238081 Oct 30 01:17:36.325711 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 605/1223] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:36 2022] GET /compute/v2.1/servers/5387ae83-7934-49d6-a893-3661477ffe69 => generated 1316 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:36.332594 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 619/1224] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:36 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd => generated 1716 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:36.337703 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2bc1f08d-a6e1-4a9d-8b8b-cc24cfe7ce5e tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:36.338513 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2bc1f08d-a6e1-4a9d-8b8b-cc24cfe7ce5e tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:36.342062 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ec91528b-1f88-4d94-ae8b-0302a53db646 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Action: 'action', calling method: .version_select at 0x7f44cde52c10>, body: {"removeFloatingIp": {"address": "172.35.5.126"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:36.345948 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2bc1f08d-a6e1-4a9d-8b8b-cc24cfe7ce5e tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:36.346652 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2bc1f08d-a6e1-4a9d-8b8b-cc24cfe7ce5e tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:36.347250 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2bc1f08d-a6e1-4a9d-8b8b-cc24cfe7ce5e tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:36.348139 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2bc1f08d-a6e1-4a9d-8b8b-cc24cfe7ce5e tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:36.348847 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2bc1f08d-a6e1-4a9d-8b8b-cc24cfe7ce5e tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:36.349467 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2bc1f08d-a6e1-4a9d-8b8b-cc24cfe7ce5e tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:36.525460 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ec91528b-1f88-4d94-ae8b-0302a53db646 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: 04619e4f-8b79-4196-9794-f27d605c4328] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:36.531953 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ec91528b-1f88-4d94-ae8b-0302a53db646 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:36.532562 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ec91528b-1f88-4d94-ae8b-0302a53db646 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:36.533073 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ec91528b-1f88-4d94-ae8b-0302a53db646 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:36.533875 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ec91528b-1f88-4d94-ae8b-0302a53db646 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:36.534400 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ec91528b-1f88-4d94-ae8b-0302a53db646 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:36.535052 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ec91528b-1f88-4d94-ae8b-0302a53db646 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:36.553092 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2bc1f08d-a6e1-4a9d-8b8b-cc24cfe7ce5e tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:36.557177 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=91,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=3,nova_cell1:RELEASE=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:17:36.562995 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2bc1f08d-a6e1-4a9d-8b8b-cc24cfe7ce5e tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1472 microversion: 2.1 time: 0.235752 Oct 30 01:17:36.567003 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 606/1225] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:36 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1472 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:36.570271 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c73c0d38-1b72-49f9-8f4a-588b84665e0e tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:36.571004 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c73c0d38-1b72-49f9-8f4a-588b84665e0e tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] [instance: 8ebd67c2-b4d9-4e1b-9946-c8e05013170d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:36.579429 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c73c0d38-1b72-49f9-8f4a-588b84665e0e tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:36.580196 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c73c0d38-1b72-49f9-8f4a-588b84665e0e tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:36.580751 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c73c0d38-1b72-49f9-8f4a-588b84665e0e tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:36.581725 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c73c0d38-1b72-49f9-8f4a-588b84665e0e tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:36.582338 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c73c0d38-1b72-49f9-8f4a-588b84665e0e tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:36.583567 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c73c0d38-1b72-49f9-8f4a-588b84665e0e tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:36.837752 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c73c0d38-1b72-49f9-8f4a-588b84665e0e tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d87ef57cf344734b662bd792022c4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea74354a0b4753a363fc5d4f6d4f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:36.848103 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c73c0d38-1b72-49f9-8f4a-588b84665e0e tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] 10.222.0.13 "GET /compute/v2.1/servers/8ebd67c2-b4d9-4e1b-9946-c8e05013170d" status: 200 len: 1319 microversion: 2.1 time: 0.282877 Oct 30 01:17:36.849694 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 607/1226] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:36 2022] GET /compute/v2.1/servers/8ebd67c2-b4d9-4e1b-9946-c8e05013170d => generated 1319 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:36.869855 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-8192b348-72c5-4983-88fc-4b9a8dad7258 req-af37a3ea-9e46-4bce-b0fd-8bb402f6821c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5387ae83-7934-49d6-a893-3661477ffe69", "tag": "b034ba77-a38e-49d8-95c0-5b54d7b838ee"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:36.879474 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-ec91528b-1f88-4d94-ae8b-0302a53db646 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] HTTP exception thrown: Floating IP 172.35.5.126 is not associated with instance e19edf61-5458-4f12-84b2-346b41506ff3. Oct 30 01:17:36.879941 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-8192b348-72c5-4983-88fc-4b9a8dad7258 req-af37a3ea-9e46-4bce-b0fd-8bb402f6821c service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:36.880416 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-8192b348-72c5-4983-88fc-4b9a8dad7258 req-af37a3ea-9e46-4bce-b0fd-8bb402f6821c service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:36.880835 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-8192b348-72c5-4983-88fc-4b9a8dad7258 req-af37a3ea-9e46-4bce-b0fd-8bb402f6821c service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:36.881802 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ec91528b-1f88-4d94-ae8b-0302a53db646 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Request method failure captured: Oct 30 01:17:36.881802 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3/action HTTP/1.1 Oct 30 01:17:36.881802 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:17:36.881802 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:17:36.881802 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:17:36.881802 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 49 Oct 30 01:17:36.881802 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:17:36.881802 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:17:36.881802 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:17:36.881802 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:17:36.881802 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdByN13wkk5DgvOeo_jKNC9cRtQsQmiWI2QnB_9dRMHNp37q0W-3hZraYRC6GeA6h4hCxjm0IfbEaSK-OP5OJBCVSwbVJUgWSEjLc_h5yNX1yO4Fk_6a6z6rzb3cWwY4lnvNKUvFnNcTUcMPZOfShBnI6qh7TYPuSwAho1bqB7NHCE8 Oct 30 01:17:36.881802 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:17:36.881802 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:17:36.881802 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:17:36.881802 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:17:36.881802 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:17:36.881802 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:17:36.881802 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 10e2bdadb00745888a171041c5714bd9 Oct 30 01:17:36.881802 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1236579116 Oct 30 01:17:36.881802 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:17:36.881802 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:17:36.883497 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/10e2bdadb00745888a171041c5714bd9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_10e2bdadb00745888a171041c5714bd9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/10e2bdadb00745888a171041c5714bd9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/10e2bdadb00745888a171041c5714bd9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:17:36.883497 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1236579116 Oct 30 01:17:36.883497 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 10e2bdadb00745888a171041c5714bd9 Oct 30 01:17:36.883497 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1236579116 Oct 30 01:17:36.883497 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-FloatingIPsAssociationTestJSON-1236579116-project Oct 30 01:17:36.883497 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:17:36.883497 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:17:36.883497 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 71f11109f32d4013aed5ab9320d8295b Oct 30 01:17:36.883497 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1236579116-project Oct 30 01:17:36.883497 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:17:36.883497 n-d-master-1 devstack@n-api.service[121102]: {"removeFloatingIp": {"address": "172.35.5.126"}} Oct 30 01:17:36.883497 n-d-master-1 devstack@n-api.service[121102]: method: Oct 30 01:17:36.883497 n-d-master-1 devstack@n-api.service[121102]: exception: Floating IP 172.35.5.126 is not associated with instance e19edf61-5458-4f12-84b2-346b41506ff3. Oct 30 01:17:36.885001 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'e19edf61-5458-4f12-84b2-346b41506ff3', 'body': {'removeFloatingIp': {'address': '172.35.5.126'}}} Oct 30 01:17:36.885001 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:17:36.885001 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:17:36.885001 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:17:36.885001 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:17:36.885001 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:17:36.885001 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:17:36.885001 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:17:36.885001 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:17:36.885001 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:17:36.885001 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:17:36.885001 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:17:36.885001 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:17:36.885001 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 30 01:17:36.885001 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 30 01:17:36.885001 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.35.5.126 is not associated with instance e19edf61-5458-4f12-84b2-346b41506ff3. Oct 30 01:17:36.885001 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:17:36.885001 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:17:36.885001 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:17:36.885001 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:17:36.888136 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:17:36.888136 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:17:36.888136 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:17:36.888136 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:17:36.888136 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.35.5.126 is not associated with instance e19edf61-5458-4f12-84b2-346b41506ff3. Oct 30 01:17:36.888136 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:17:36.888777 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ec91528b-1f88-4d94-ae8b-0302a53db646 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Returning 409 to user: Floating IP 172.35.5.126 is not associated with instance e19edf61-5458-4f12-84b2-346b41506ff3. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:17:36.890218 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ec91528b-1f88-4d94-ae8b-0302a53db646 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] 10.222.0.13 "POST /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3/action" status: 409 len: 146 microversion: 2.1 time: 0.553383 Oct 30 01:17:36.890872 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 620/1227] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:17:36 2022] POST /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3/action => generated 146 bytes in 558 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:17:36.902114 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7b821be0-667c-44ca-86f4-9263b3395ceb tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.5.126"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:36.902533 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-8192b348-72c5-4983-88fc-4b9a8dad7258 req-af37a3ea-9e46-4bce-b0fd-8bb402f6821c service nova] Creating event network-changed:b034ba77-a38e-49d8-95c0-5b54d7b838ee for instance 5387ae83-7934-49d6-a893-3661477ffe69 on n-h2-master-1 Oct 30 01:17:36.907501 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-8192b348-72c5-4983-88fc-4b9a8dad7258 req-af37a3ea-9e46-4bce-b0fd-8bb402f6821c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044073 Oct 30 01:17:36.908636 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 608/1228] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:17:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:17:37.035631 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7b821be0-667c-44ca-86f4-9263b3395ceb tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: 04619e4f-8b79-4196-9794-f27d605c4328] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:37.039691 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b821be0-667c-44ca-86f4-9263b3395ceb tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:37.040211 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b821be0-667c-44ca-86f4-9263b3395ceb tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:37.040644 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b821be0-667c-44ca-86f4-9263b3395ceb tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:37.041378 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b821be0-667c-44ca-86f4-9263b3395ceb tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:37.041937 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b821be0-667c-44ca-86f4-9263b3395ceb tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:37.042362 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b821be0-667c-44ca-86f4-9263b3395ceb tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:37.063895 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4f3c0949-1003-4a85-9a99-fc2a56bd6e20 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:37.068346 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4f3c0949-1003-4a85-9a99-fc2a56bd6e20 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:37.071920 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4f3c0949-1003-4a85-9a99-fc2a56bd6e20 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:37.072574 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4f3c0949-1003-4a85-9a99-fc2a56bd6e20 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:37.073015 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4f3c0949-1003-4a85-9a99-fc2a56bd6e20 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:37.073745 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4f3c0949-1003-4a85-9a99-fc2a56bd6e20 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:37.074308 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4f3c0949-1003-4a85-9a99-fc2a56bd6e20 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:37.074621 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4f3c0949-1003-4a85-9a99-fc2a56bd6e20 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:37.300186 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4f3c0949-1003-4a85-9a99-fc2a56bd6e20 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:37.308936 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4f3c0949-1003-4a85-9a99-fc2a56bd6e20 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1476 microversion: 2.1 time: 0.250107 Oct 30 01:17:37.309557 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 609/1229] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:37 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1476 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:17:37.334661 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b821be0-667c-44ca-86f4-9263b3395ceb tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "refresh_cache-04619e4f-8b79-4196-9794-f27d605c4328" {{(pid=121102) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 30 01:17:37.335178 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b821be0-667c-44ca-86f4-9263b3395ceb tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquired lock "refresh_cache-04619e4f-8b79-4196-9794-f27d605c4328" {{(pid=121102) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 30 01:17:37.345262 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-eda56a82-0d89-45c0-8c79-51a25f115d56 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:37.345936 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-eda56a82-0d89-45c0-8c79-51a25f115d56 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 5387ae83-7934-49d6-a893-3661477ffe69] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:37.348852 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:17:37.353776 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eda56a82-0d89-45c0-8c79-51a25f115d56 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:37.354270 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eda56a82-0d89-45c0-8c79-51a25f115d56 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:37.354703 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eda56a82-0d89-45c0-8c79-51a25f115d56 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:37.355412 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eda56a82-0d89-45c0-8c79-51a25f115d56 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:37.357973 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eda56a82-0d89-45c0-8c79-51a25f115d56 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:37.357973 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eda56a82-0d89-45c0-8c79-51a25f115d56 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:37.605880 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-eda56a82-0d89-45c0-8c79-51a25f115d56 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:37.613980 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-eda56a82-0d89-45c0-8c79-51a25f115d56 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/5387ae83-7934-49d6-a893-3661477ffe69" status: 200 len: 1316 microversion: 2.1 time: 0.272746 Oct 30 01:17:37.615915 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 610/1230] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:37 2022] GET /compute/v2.1/servers/5387ae83-7934-49d6-a893-3661477ffe69 => generated 1316 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:17:37.619778 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ae87d0ba-6494-4760-b499-c1c35639ae6a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:37.620391 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ae87d0ba-6494-4760-b499-c1c35639ae6a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:37.626425 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ae87d0ba-6494-4760-b499-c1c35639ae6a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:37.626911 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ae87d0ba-6494-4760-b499-c1c35639ae6a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:37.627342 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ae87d0ba-6494-4760-b499-c1c35639ae6a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:37.628201 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ae87d0ba-6494-4760-b499-c1c35639ae6a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:37.628828 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ae87d0ba-6494-4760-b499-c1c35639ae6a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:37.629283 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ae87d0ba-6494-4760-b499-c1c35639ae6a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:37.802288 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ae87d0ba-6494-4760-b499-c1c35639ae6a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:37.810876 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ae87d0ba-6494-4760-b499-c1c35639ae6a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd" status: 200 len: 1716 microversion: 2.1 time: 0.194774 Oct 30 01:17:37.821712 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 611/1231] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:37 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd => generated 1716 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:37.821712 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d0a39666-a087-47b9-b0fa-b2f48b179efc tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:37.821712 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d0a39666-a087-47b9-b0fa-b2f48b179efc tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:37.827943 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d0a39666-a087-47b9-b0fa-b2f48b179efc tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:37.827943 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d0a39666-a087-47b9-b0fa-b2f48b179efc tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:37.827943 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d0a39666-a087-47b9-b0fa-b2f48b179efc tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:37.827943 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d0a39666-a087-47b9-b0fa-b2f48b179efc tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:37.828232 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d0a39666-a087-47b9-b0fa-b2f48b179efc tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:37.828232 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d0a39666-a087-47b9-b0fa-b2f48b179efc tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:38.061300 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d0a39666-a087-47b9-b0fa-b2f48b179efc tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:38.069948 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d0a39666-a087-47b9-b0fa-b2f48b179efc tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1472 microversion: 2.1 time: 0.257488 Oct 30 01:17:38.070530 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 612/1232] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:37 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1472 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:38.075034 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d68b0e0d-4ccf-462b-b4a8-715209615501 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:38.075646 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d68b0e0d-4ccf-462b-b4a8-715209615501 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] [instance: 8ebd67c2-b4d9-4e1b-9946-c8e05013170d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:38.081453 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d68b0e0d-4ccf-462b-b4a8-715209615501 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:38.082127 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d68b0e0d-4ccf-462b-b4a8-715209615501 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:38.082559 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d68b0e0d-4ccf-462b-b4a8-715209615501 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:38.083435 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d68b0e0d-4ccf-462b-b4a8-715209615501 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:38.083906 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d68b0e0d-4ccf-462b-b4a8-715209615501 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:38.084319 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d68b0e0d-4ccf-462b-b4a8-715209615501 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:38.289314 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d68b0e0d-4ccf-462b-b4a8-715209615501 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d87ef57cf344734b662bd792022c4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea74354a0b4753a363fc5d4f6d4f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:38.296335 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-7b821be0-667c-44ca-86f4-9263b3395ceb tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: 04619e4f-8b79-4196-9794-f27d605c4328] Building network info cache for instance {{(pid=121102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 30 01:17:38.298285 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d68b0e0d-4ccf-462b-b4a8-715209615501 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] 10.222.0.13 "GET /compute/v2.1/servers/8ebd67c2-b4d9-4e1b-9946-c8e05013170d" status: 200 len: 1319 microversion: 2.1 time: 0.226128 Oct 30 01:17:38.313710 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 613/1233] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:38 2022] GET /compute/v2.1/servers/8ebd67c2-b4d9-4e1b-9946-c8e05013170d => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:38.318408 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-e608da33-6da9-4f44-ae6a-936f3447e161 req-db329a1f-5a02-4082-842e-361131fed705 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04619e4f-8b79-4196-9794-f27d605c4328", "tag": "6a9b0f09-5783-40cf-a067-b3a5f5f29ea0"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:38.328482 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e608da33-6da9-4f44-ae6a-936f3447e161 req-db329a1f-5a02-4082-842e-361131fed705 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:38.328958 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e608da33-6da9-4f44-ae6a-936f3447e161 req-db329a1f-5a02-4082-842e-361131fed705 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:38.329404 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e608da33-6da9-4f44-ae6a-936f3447e161 req-db329a1f-5a02-4082-842e-361131fed705 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:38.341526 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-e608da33-6da9-4f44-ae6a-936f3447e161 req-db329a1f-5a02-4082-842e-361131fed705 service nova] Creating event network-changed:6a9b0f09-5783-40cf-a067-b3a5f5f29ea0 for instance 04619e4f-8b79-4196-9794-f27d605c4328 on n-h2-master-1 Oct 30 01:17:38.346380 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-e608da33-6da9-4f44-ae6a-936f3447e161 req-db329a1f-5a02-4082-842e-361131fed705 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031534 Oct 30 01:17:38.347134 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 614/1234] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:17:38.353167 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a34961c0-883a-4785-8c5c-7038a366dea5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:38.353900 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a34961c0-883a-4785-8c5c-7038a366dea5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:38.360825 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a34961c0-883a-4785-8c5c-7038a366dea5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:38.361319 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a34961c0-883a-4785-8c5c-7038a366dea5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:38.361775 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a34961c0-883a-4785-8c5c-7038a366dea5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:38.362479 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a34961c0-883a-4785-8c5c-7038a366dea5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:38.362933 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a34961c0-883a-4785-8c5c-7038a366dea5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:38.363716 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a34961c0-883a-4785-8c5c-7038a366dea5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:38.835665 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a34961c0-883a-4785-8c5c-7038a366dea5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:38.843970 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a34961c0-883a-4785-8c5c-7038a366dea5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1476 microversion: 2.1 time: 0.495746 Oct 30 01:17:38.844811 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 615/1235] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:38 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1476 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:38.858626 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-78ff2818-ad27-4849-ba7e-0868c5171531 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:38.859508 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-78ff2818-ad27-4849-ba7e-0868c5171531 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 5387ae83-7934-49d6-a893-3661477ffe69] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:38.867129 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-78ff2818-ad27-4849-ba7e-0868c5171531 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:38.867844 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-78ff2818-ad27-4849-ba7e-0868c5171531 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:38.868277 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-78ff2818-ad27-4849-ba7e-0868c5171531 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:38.868982 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-78ff2818-ad27-4849-ba7e-0868c5171531 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:38.869466 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-78ff2818-ad27-4849-ba7e-0868c5171531 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:38.869947 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-78ff2818-ad27-4849-ba7e-0868c5171531 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:39.097648 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-78ff2818-ad27-4849-ba7e-0868c5171531 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:39.114902 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-78ff2818-ad27-4849-ba7e-0868c5171531 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/5387ae83-7934-49d6-a893-3661477ffe69" status: 200 len: 1316 microversion: 2.1 time: 0.265111 Oct 30 01:17:39.114902 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 616/1236] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:38 2022] GET /compute/v2.1/servers/5387ae83-7934-49d6-a893-3661477ffe69 => generated 1316 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:39.130786 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1bae2462-bc93-421e-bc84-c6a90f2f6c51 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:39.131408 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1bae2462-bc93-421e-bc84-c6a90f2f6c51 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:39.137990 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1bae2462-bc93-421e-bc84-c6a90f2f6c51 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:39.145302 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1bae2462-bc93-421e-bc84-c6a90f2f6c51 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:39.145302 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1bae2462-bc93-421e-bc84-c6a90f2f6c51 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:39.145302 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1bae2462-bc93-421e-bc84-c6a90f2f6c51 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:39.145302 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1bae2462-bc93-421e-bc84-c6a90f2f6c51 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:39.145740 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1bae2462-bc93-421e-bc84-c6a90f2f6c51 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:39.284955 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-7b821be0-667c-44ca-86f4-9263b3395ceb tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: 04619e4f-8b79-4196-9794-f27d605c4328] Updating instance_info_cache with network_info: [{"id": "6a9b0f09-5783-40cf-a067-b3a5f5f29ea0", "address": "fa:16:3e:ef:28:7d", "network": {"id": "c383b18e-d32f-47dc-90a2-236912a6d567", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-257091766-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "10e2bdadb00745888a171041c5714bd9", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6a9b0f09-57", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 30 01:17:39.326552 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1bae2462-bc93-421e-bc84-c6a90f2f6c51 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:39.336550 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1bae2462-bc93-421e-bc84-c6a90f2f6c51 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd" status: 200 len: 1716 microversion: 2.1 time: 0.222206 Oct 30 01:17:39.337227 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 617/1237] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:39 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd => generated 1716 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:39.341965 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b53e0628-f441-4c7e-a19c-48dd37c2f11a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:39.342664 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b53e0628-f441-4c7e-a19c-48dd37c2f11a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:39.350270 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b53e0628-f441-4c7e-a19c-48dd37c2f11a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:39.350563 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b53e0628-f441-4c7e-a19c-48dd37c2f11a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:39.351060 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b53e0628-f441-4c7e-a19c-48dd37c2f11a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:39.352012 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b53e0628-f441-4c7e-a19c-48dd37c2f11a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:39.352507 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b53e0628-f441-4c7e-a19c-48dd37c2f11a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:39.353495 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b53e0628-f441-4c7e-a19c-48dd37c2f11a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:39.371726 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b821be0-667c-44ca-86f4-9263b3395ceb tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Releasing lock "refresh_cache-04619e4f-8b79-4196-9794-f27d605c4328" {{(pid=121102) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 30 01:17:39.389651 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7b821be0-667c-44ca-86f4-9263b3395ceb tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] 10.222.0.13 "POST /compute/v2.1/servers/04619e4f-8b79-4196-9794-f27d605c4328/action" status: 202 len: 0 microversion: 2.1 time: 2.477294 Oct 30 01:17:39.389651 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 621/1238] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:17:36 2022] POST /compute/v2.1/servers/04619e4f-8b79-4196-9794-f27d605c4328/action => generated 0 bytes in 2479 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 30 01:17:39.389651 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-def82ccc-b161-4885-a2f7-5675737667a9 req-18f454fa-0f77-4665-a0db-8def8e99445b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ebd67c2-b4d9-4e1b-9946-c8e05013170d", "name": "network-vif-plugged", "status": "completed", "tag": "12167317-3164-48af-bd53-4155aaa88a38"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:39.389651 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-def82ccc-b161-4885-a2f7-5675737667a9 req-18f454fa-0f77-4665-a0db-8def8e99445b service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:39.390174 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-def82ccc-b161-4885-a2f7-5675737667a9 req-18f454fa-0f77-4665-a0db-8def8e99445b service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:39.390676 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-def82ccc-b161-4885-a2f7-5675737667a9 req-18f454fa-0f77-4665-a0db-8def8e99445b service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:39.407810 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-def82ccc-b161-4885-a2f7-5675737667a9 req-18f454fa-0f77-4665-a0db-8def8e99445b service nova] Creating event network-vif-plugged:12167317-3164-48af-bd53-4155aaa88a38 for instance 8ebd67c2-b4d9-4e1b-9946-c8e05013170d on n-h1-master-1 Oct 30 01:17:39.414523 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-def82ccc-b161-4885-a2f7-5675737667a9 req-18f454fa-0f77-4665-a0db-8def8e99445b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039061 Oct 30 01:17:39.415245 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 622/1239] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:17:39.421936 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-22184fb0-1294-4479-84b5-e75361009e99 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:39.422882 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-22184fb0-1294-4479-84b5-e75361009e99 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] [instance: 8ebd67c2-b4d9-4e1b-9946-c8e05013170d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:39.430484 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-22184fb0-1294-4479-84b5-e75361009e99 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:39.431080 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-22184fb0-1294-4479-84b5-e75361009e99 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:39.431604 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-22184fb0-1294-4479-84b5-e75361009e99 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:39.432593 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-22184fb0-1294-4479-84b5-e75361009e99 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:39.433145 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-22184fb0-1294-4479-84b5-e75361009e99 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:39.433878 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-22184fb0-1294-4479-84b5-e75361009e99 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:39.546864 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b53e0628-f441-4c7e-a19c-48dd37c2f11a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:39.552521 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b53e0628-f441-4c7e-a19c-48dd37c2f11a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1472 microversion: 2.1 time: 0.213574 Oct 30 01:17:39.553555 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 618/1240] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:39 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1472 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:39.558096 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-415948a7-6dd2-4f09-82d6-1ba4bfe86153 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:39.558598 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-415948a7-6dd2-4f09-82d6-1ba4bfe86153 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: 04619e4f-8b79-4196-9794-f27d605c4328] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:39.568221 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-415948a7-6dd2-4f09-82d6-1ba4bfe86153 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:39.568723 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-415948a7-6dd2-4f09-82d6-1ba4bfe86153 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:39.569166 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-415948a7-6dd2-4f09-82d6-1ba4bfe86153 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:39.570007 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-415948a7-6dd2-4f09-82d6-1ba4bfe86153 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:39.570515 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-415948a7-6dd2-4f09-82d6-1ba4bfe86153 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:39.570935 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-415948a7-6dd2-4f09-82d6-1ba4bfe86153 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:39.607541 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-415948a7-6dd2-4f09-82d6-1ba4bfe86153 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: 04619e4f-8b79-4196-9794-f27d605c4328] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:17:39.611666 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-22184fb0-1294-4479-84b5-e75361009e99 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d87ef57cf344734b662bd792022c4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea74354a0b4753a363fc5d4f6d4f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:39.621197 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-22184fb0-1294-4479-84b5-e75361009e99 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] 10.222.0.13 "GET /compute/v2.1/servers/8ebd67c2-b4d9-4e1b-9946-c8e05013170d" status: 200 len: 1319 microversion: 2.1 time: 0.204402 Oct 30 01:17:39.622230 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 623/1241] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:39 2022] GET /compute/v2.1/servers/8ebd67c2-b4d9-4e1b-9946-c8e05013170d => generated 1319 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:39.868102 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c8e87104-3c3e-4071-8f8c-9d9c7d9d988f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:39.869019 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c8e87104-3c3e-4071-8f8c-9d9c7d9d988f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:39.876021 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c8e87104-3c3e-4071-8f8c-9d9c7d9d988f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:39.876516 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c8e87104-3c3e-4071-8f8c-9d9c7d9d988f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:39.876954 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c8e87104-3c3e-4071-8f8c-9d9c7d9d988f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:39.877697 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c8e87104-3c3e-4071-8f8c-9d9c7d9d988f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:39.878154 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c8e87104-3c3e-4071-8f8c-9d9c7d9d988f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:39.878580 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c8e87104-3c3e-4071-8f8c-9d9c7d9d988f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:39.883492 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-415948a7-6dd2-4f09-82d6-1ba4bfe86153 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] 10.222.0.13 "DELETE /compute/v2.1/servers/04619e4f-8b79-4196-9794-f27d605c4328" status: 204 len: 0 microversion: 2.1 time: 0.328691 Oct 30 01:17:39.884245 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 619/1242] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:17:39 2022] DELETE /compute/v2.1/servers/04619e4f-8b79-4196-9794-f27d605c4328 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:17:39.897056 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-98d43d2a-7615-4b12-a972-d2ce12743bac tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.5.126"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:39.899743 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-98d43d2a-7615-4b12-a972-d2ce12743bac tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: e19edf61-5458-4f12-84b2-346b41506ff3] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:39.906958 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-98d43d2a-7615-4b12-a972-d2ce12743bac tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:39.907695 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-98d43d2a-7615-4b12-a972-d2ce12743bac tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:39.908129 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-98d43d2a-7615-4b12-a972-d2ce12743bac tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:39.913057 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-98d43d2a-7615-4b12-a972-d2ce12743bac tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:39.913274 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-98d43d2a-7615-4b12-a972-d2ce12743bac tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:39.918582 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-98d43d2a-7615-4b12-a972-d2ce12743bac tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:39.941252 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-98d43d2a-7615-4b12-a972-d2ce12743bac tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "refresh_cache-e19edf61-5458-4f12-84b2-346b41506ff3" {{(pid=121103) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 30 01:17:39.941675 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-98d43d2a-7615-4b12-a972-d2ce12743bac tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquired lock "refresh_cache-e19edf61-5458-4f12-84b2-346b41506ff3" {{(pid=121103) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 30 01:17:40.138069 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c8e87104-3c3e-4071-8f8c-9d9c7d9d988f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:40.146611 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c8e87104-3c3e-4071-8f8c-9d9c7d9d988f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1476 microversion: 2.1 time: 0.282577 Oct 30 01:17:40.147198 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 624/1243] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:39 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1476 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:17:40.151745 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7e4fc703-72f1-4154-adcf-ccfef473c24c tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:40.152358 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7e4fc703-72f1-4154-adcf-ccfef473c24c tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 5387ae83-7934-49d6-a893-3661477ffe69] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:40.158430 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e4fc703-72f1-4154-adcf-ccfef473c24c tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:40.158918 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e4fc703-72f1-4154-adcf-ccfef473c24c tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:40.159348 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e4fc703-72f1-4154-adcf-ccfef473c24c tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:40.160048 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e4fc703-72f1-4154-adcf-ccfef473c24c tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:40.160498 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e4fc703-72f1-4154-adcf-ccfef473c24c tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:40.160911 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e4fc703-72f1-4154-adcf-ccfef473c24c tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:40.386218 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7e4fc703-72f1-4154-adcf-ccfef473c24c tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:40.393928 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7e4fc703-72f1-4154-adcf-ccfef473c24c tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/5387ae83-7934-49d6-a893-3661477ffe69" status: 200 len: 1316 microversion: 2.1 time: 0.245739 Oct 30 01:17:40.394513 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 625/1244] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:40 2022] GET /compute/v2.1/servers/5387ae83-7934-49d6-a893-3661477ffe69 => generated 1316 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:40.399086 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6fc4c235-1968-4108-90a8-08b11a4094f0 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:40.399687 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6fc4c235-1968-4108-90a8-08b11a4094f0 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:40.405639 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6fc4c235-1968-4108-90a8-08b11a4094f0 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:40.406132 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6fc4c235-1968-4108-90a8-08b11a4094f0 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:40.406558 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6fc4c235-1968-4108-90a8-08b11a4094f0 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:40.407438 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6fc4c235-1968-4108-90a8-08b11a4094f0 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:40.407890 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6fc4c235-1968-4108-90a8-08b11a4094f0 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:40.408312 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6fc4c235-1968-4108-90a8-08b11a4094f0 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:40.663577 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6fc4c235-1968-4108-90a8-08b11a4094f0 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:40.673201 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6fc4c235-1968-4108-90a8-08b11a4094f0 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd" status: 200 len: 1716 microversion: 2.1 time: 0.277601 Oct 30 01:17:40.674124 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 626/1245] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:40 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd => generated 1716 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:40.679297 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6c6f8802-ae8e-4f53-90a9-cb26e236eecc tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:40.679986 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6c6f8802-ae8e-4f53-90a9-cb26e236eecc tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:40.686519 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c6f8802-ae8e-4f53-90a9-cb26e236eecc tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:40.687092 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c6f8802-ae8e-4f53-90a9-cb26e236eecc tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:40.687833 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c6f8802-ae8e-4f53-90a9-cb26e236eecc tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:40.699568 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c6f8802-ae8e-4f53-90a9-cb26e236eecc tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:40.699568 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c6f8802-ae8e-4f53-90a9-cb26e236eecc tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:40.699568 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c6f8802-ae8e-4f53-90a9-cb26e236eecc tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:40.706935 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:17:40.887278 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6c6f8802-ae8e-4f53-90a9-cb26e236eecc tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:40.900759 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6c6f8802-ae8e-4f53-90a9-cb26e236eecc tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1472 microversion: 2.1 time: 0.220130 Oct 30 01:17:40.900759 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 627/1246] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:40 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1472 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:40.900759 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e057c66e-ac7c-4555-bff8-67c990191126 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:40.901633 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e057c66e-ac7c-4555-bff8-67c990191126 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] [instance: 8ebd67c2-b4d9-4e1b-9946-c8e05013170d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:40.908362 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e057c66e-ac7c-4555-bff8-67c990191126 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:40.908849 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e057c66e-ac7c-4555-bff8-67c990191126 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:40.909286 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e057c66e-ac7c-4555-bff8-67c990191126 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:40.910172 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e057c66e-ac7c-4555-bff8-67c990191126 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:40.910734 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e057c66e-ac7c-4555-bff8-67c990191126 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:40.911706 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e057c66e-ac7c-4555-bff8-67c990191126 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:41.138927 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e057c66e-ac7c-4555-bff8-67c990191126 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d87ef57cf344734b662bd792022c4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea74354a0b4753a363fc5d4f6d4f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:41.147061 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e057c66e-ac7c-4555-bff8-67c990191126 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] 10.222.0.13 "GET /compute/v2.1/servers/8ebd67c2-b4d9-4e1b-9946-c8e05013170d" status: 200 len: 1319 microversion: 2.1 time: 0.250016 Oct 30 01:17:41.147633 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 628/1247] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:40 2022] GET /compute/v2.1/servers/8ebd67c2-b4d9-4e1b-9946-c8e05013170d => generated 1319 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:41.169850 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a4f131d8-2ceb-4968-a636-25757a114f8f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:41.170469 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a4f131d8-2ceb-4968-a636-25757a114f8f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:41.176546 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a4f131d8-2ceb-4968-a636-25757a114f8f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:41.177038 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a4f131d8-2ceb-4968-a636-25757a114f8f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:41.177515 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a4f131d8-2ceb-4968-a636-25757a114f8f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:41.178221 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a4f131d8-2ceb-4968-a636-25757a114f8f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:41.178680 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a4f131d8-2ceb-4968-a636-25757a114f8f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:41.179111 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a4f131d8-2ceb-4968-a636-25757a114f8f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:41.407131 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a4f131d8-2ceb-4968-a636-25757a114f8f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:41.417600 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a4f131d8-2ceb-4968-a636-25757a114f8f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1476 microversion: 2.1 time: 0.251534 Oct 30 01:17:41.434016 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 629/1248] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:41 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1476 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:17:41.436669 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-98d43d2a-7615-4b12-a972-d2ce12743bac tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: e19edf61-5458-4f12-84b2-346b41506ff3] Building network info cache for instance {{(pid=121103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 30 01:17:41.440798 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-97f4b988-e9ba-4358-8666-bccddd8b3b88 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:41.441452 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-97f4b988-e9ba-4358-8666-bccddd8b3b88 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 5387ae83-7934-49d6-a893-3661477ffe69] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:41.447710 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-97f4b988-e9ba-4358-8666-bccddd8b3b88 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:41.448206 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-97f4b988-e9ba-4358-8666-bccddd8b3b88 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:41.448641 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-97f4b988-e9ba-4358-8666-bccddd8b3b88 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:41.449370 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-97f4b988-e9ba-4358-8666-bccddd8b3b88 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:41.449832 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-97f4b988-e9ba-4358-8666-bccddd8b3b88 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:41.450257 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-97f4b988-e9ba-4358-8666-bccddd8b3b88 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:41.672441 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-97f4b988-e9ba-4358-8666-bccddd8b3b88 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:41.683006 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-97f4b988-e9ba-4358-8666-bccddd8b3b88 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/5387ae83-7934-49d6-a893-3661477ffe69" status: 200 len: 1316 microversion: 2.1 time: 0.247918 Oct 30 01:17:41.683933 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 630/1249] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:41 2022] GET /compute/v2.1/servers/5387ae83-7934-49d6-a893-3661477ffe69 => generated 1316 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:41.690478 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-cd6d9828-8f6b-4862-b3a0-4a104ca3811f req-71ee9da9-ccea-447e-81ba-560656b32002 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e19edf61-5458-4f12-84b2-346b41506ff3", "tag": "dfced65c-3e28-40bf-b025-33cddcb37142"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:41.701063 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-cd6d9828-8f6b-4862-b3a0-4a104ca3811f req-71ee9da9-ccea-447e-81ba-560656b32002 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:41.701603 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-cd6d9828-8f6b-4862-b3a0-4a104ca3811f req-71ee9da9-ccea-447e-81ba-560656b32002 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:41.702039 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-cd6d9828-8f6b-4862-b3a0-4a104ca3811f req-71ee9da9-ccea-447e-81ba-560656b32002 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:41.714483 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-cd6d9828-8f6b-4862-b3a0-4a104ca3811f req-71ee9da9-ccea-447e-81ba-560656b32002 service nova] Creating event network-changed:dfced65c-3e28-40bf-b025-33cddcb37142 for instance e19edf61-5458-4f12-84b2-346b41506ff3 on n-h1-master-1 Oct 30 01:17:41.719484 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-cd6d9828-8f6b-4862-b3a0-4a104ca3811f req-71ee9da9-ccea-447e-81ba-560656b32002 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034199 Oct 30 01:17:41.720274 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 631/1250] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:17:41.725175 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-822e6522-4d3f-4d3a-acb8-d510cb241c08 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:41.725906 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-822e6522-4d3f-4d3a-acb8-d510cb241c08 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:41.732246 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-822e6522-4d3f-4d3a-acb8-d510cb241c08 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:41.732782 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-822e6522-4d3f-4d3a-acb8-d510cb241c08 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:41.733221 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-822e6522-4d3f-4d3a-acb8-d510cb241c08 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:41.734560 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-822e6522-4d3f-4d3a-acb8-d510cb241c08 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:41.735028 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-822e6522-4d3f-4d3a-acb8-d510cb241c08 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:41.736645 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-822e6522-4d3f-4d3a-acb8-d510cb241c08 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:41.954068 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-822e6522-4d3f-4d3a-acb8-d510cb241c08 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:41.961026 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-822e6522-4d3f-4d3a-acb8-d510cb241c08 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd" status: 200 len: 1716 microversion: 2.1 time: 0.239721 Oct 30 01:17:41.962091 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 632/1251] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:41 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd => generated 1716 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:41.966796 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2f649ba7-0ecc-4143-aeaa-176a470f776e tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:41.967662 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2f649ba7-0ecc-4143-aeaa-176a470f776e tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:41.978477 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2f649ba7-0ecc-4143-aeaa-176a470f776e tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:41.979252 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2f649ba7-0ecc-4143-aeaa-176a470f776e tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:41.979849 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2f649ba7-0ecc-4143-aeaa-176a470f776e tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:41.980716 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2f649ba7-0ecc-4143-aeaa-176a470f776e tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:41.981173 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2f649ba7-0ecc-4143-aeaa-176a470f776e tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:41.981617 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2f649ba7-0ecc-4143-aeaa-176a470f776e tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:42.197799 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2f649ba7-0ecc-4143-aeaa-176a470f776e tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:42.207411 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2f649ba7-0ecc-4143-aeaa-176a470f776e tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1472 microversion: 2.1 time: 0.244145 Oct 30 01:17:42.208463 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 633/1252] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:41 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1472 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:42.212701 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-98d43d2a-7615-4b12-a972-d2ce12743bac tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: e19edf61-5458-4f12-84b2-346b41506ff3] Updating instance_info_cache with network_info: [{"id": "dfced65c-3e28-40bf-b025-33cddcb37142", "address": "fa:16:3e:72:cd:9f", "network": {"id": "c383b18e-d32f-47dc-90a2-236912a6d567", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-257091766-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.5.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "10e2bdadb00745888a171041c5714bd9", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapdfced65c-3e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 30 01:17:42.213060 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-32b8d0c2-ced2-4e19-95f6-b298ff2cf7a9 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:42.213699 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-32b8d0c2-ced2-4e19-95f6-b298ff2cf7a9 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] [instance: 8ebd67c2-b4d9-4e1b-9946-c8e05013170d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:42.227052 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-32b8d0c2-ced2-4e19-95f6-b298ff2cf7a9 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:42.227671 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-32b8d0c2-ced2-4e19-95f6-b298ff2cf7a9 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:42.228330 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-32b8d0c2-ced2-4e19-95f6-b298ff2cf7a9 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:42.229114 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-32b8d0c2-ced2-4e19-95f6-b298ff2cf7a9 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:42.229648 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-32b8d0c2-ced2-4e19-95f6-b298ff2cf7a9 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:42.230098 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-32b8d0c2-ced2-4e19-95f6-b298ff2cf7a9 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:42.299689 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-98d43d2a-7615-4b12-a972-d2ce12743bac tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Releasing lock "refresh_cache-e19edf61-5458-4f12-84b2-346b41506ff3" {{(pid=121103) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 30 01:17:42.300913 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-98d43d2a-7615-4b12-a972-d2ce12743bac tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] 10.222.0.13 "POST /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3/action" status: 202 len: 0 microversion: 2.1 time: 2.410032 Oct 30 01:17:42.305128 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 620/1253] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:17:39 2022] POST /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3/action => generated 0 bytes in 2412 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 30 01:17:42.310796 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3ba9b6bd-571a-4e48-9127-6a1c6c6466e3 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Calling method '.version_select at 0x7f44cc34af70>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:42.415745 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-32b8d0c2-ced2-4e19-95f6-b298ff2cf7a9 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d87ef57cf344734b662bd792022c4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea74354a0b4753a363fc5d4f6d4f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:42.424594 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-32b8d0c2-ced2-4e19-95f6-b298ff2cf7a9 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] 10.222.0.13 "GET /compute/v2.1/servers/8ebd67c2-b4d9-4e1b-9946-c8e05013170d" status: 200 len: 1319 microversion: 2.1 time: 0.215077 Oct 30 01:17:42.425179 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 634/1254] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:42 2022] GET /compute/v2.1/servers/8ebd67c2-b4d9-4e1b-9946-c8e05013170d => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:42.444226 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c2852295-ec97-4254-9a3a-1e37701ec7bb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:42.444876 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c2852295-ec97-4254-9a3a-1e37701ec7bb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:42.450992 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c2852295-ec97-4254-9a3a-1e37701ec7bb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:42.451477 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c2852295-ec97-4254-9a3a-1e37701ec7bb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:42.451909 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c2852295-ec97-4254-9a3a-1e37701ec7bb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:42.452636 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c2852295-ec97-4254-9a3a-1e37701ec7bb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:42.453070 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c2852295-ec97-4254-9a3a-1e37701ec7bb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:42.453522 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c2852295-ec97-4254-9a3a-1e37701ec7bb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:42.617486 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3ba9b6bd-571a-4e48-9127-6a1c6c6466e3 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] 10.222.0.13 "GET /compute/v2.1/os-floating-ips/4d9ab861-e261-48c1-b70d-4d7dba0e6946" status: 200 len: 184 microversion: 2.1 time: 0.310821 Oct 30 01:17:42.618134 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 621/1255] 10.222.0.13 () {58 vars in 1260 bytes} [Sun Oct 30 01:17:42 2022] GET /compute/v2.1/os-floating-ips/4d9ab861-e261-48c1-b70d-4d7dba0e6946 => generated 184 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:17:42.631091 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0de7a6b7-a535-466e-b98a-faf73705a249 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Action: 'action', calling method: .version_select at 0x7f44ce7a33a0>, body: {"removeFloatingIp": {"address": "172.35.5.126"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:42.646098 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c2852295-ec97-4254-9a3a-1e37701ec7bb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:42.654466 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c2852295-ec97-4254-9a3a-1e37701ec7bb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1476 microversion: 2.1 time: 0.217688 Oct 30 01:17:42.664992 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 635/1256] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:42 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1476 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:17:42.708418 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-772795ea-9ec0-479a-9dfe-b6795b7ab3d7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:42.709221 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-772795ea-9ec0-479a-9dfe-b6795b7ab3d7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 5387ae83-7934-49d6-a893-3661477ffe69] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:42.730349 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-772795ea-9ec0-479a-9dfe-b6795b7ab3d7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:42.730868 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-772795ea-9ec0-479a-9dfe-b6795b7ab3d7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:42.731260 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-772795ea-9ec0-479a-9dfe-b6795b7ab3d7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:42.732346 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-772795ea-9ec0-479a-9dfe-b6795b7ab3d7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:42.732830 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-772795ea-9ec0-479a-9dfe-b6795b7ab3d7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:42.733248 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-772795ea-9ec0-479a-9dfe-b6795b7ab3d7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:42.769920 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0de7a6b7-a535-466e-b98a-faf73705a249 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: e19edf61-5458-4f12-84b2-346b41506ff3] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:42.777615 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0de7a6b7-a535-466e-b98a-faf73705a249 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:42.778353 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0de7a6b7-a535-466e-b98a-faf73705a249 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:42.778790 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0de7a6b7-a535-466e-b98a-faf73705a249 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:42.779518 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0de7a6b7-a535-466e-b98a-faf73705a249 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:42.779965 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0de7a6b7-a535-466e-b98a-faf73705a249 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:42.780388 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0de7a6b7-a535-466e-b98a-faf73705a249 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:43.013011 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-772795ea-9ec0-479a-9dfe-b6795b7ab3d7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:43.025149 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-772795ea-9ec0-479a-9dfe-b6795b7ab3d7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/5387ae83-7934-49d6-a893-3661477ffe69" status: 200 len: 1316 microversion: 2.1 time: 0.320721 Oct 30 01:17:43.042793 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 636/1257] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:42 2022] GET /compute/v2.1/servers/5387ae83-7934-49d6-a893-3661477ffe69 => generated 1316 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:17:43.054948 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0809d5f4-5f7c-4a4d-8d7e-a313c1bc532a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:43.055947 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0809d5f4-5f7c-4a4d-8d7e-a313c1bc532a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:43.063677 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0809d5f4-5f7c-4a4d-8d7e-a313c1bc532a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:43.064525 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0809d5f4-5f7c-4a4d-8d7e-a313c1bc532a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:43.065240 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0809d5f4-5f7c-4a4d-8d7e-a313c1bc532a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:43.066137 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0809d5f4-5f7c-4a4d-8d7e-a313c1bc532a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:43.066761 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0809d5f4-5f7c-4a4d-8d7e-a313c1bc532a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:43.068384 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0809d5f4-5f7c-4a4d-8d7e-a313c1bc532a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:43.203497 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0de7a6b7-a535-466e-b98a-faf73705a249 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "refresh_cache-e19edf61-5458-4f12-84b2-346b41506ff3" {{(pid=121103) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 30 01:17:43.205533 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0de7a6b7-a535-466e-b98a-faf73705a249 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquired lock "refresh_cache-e19edf61-5458-4f12-84b2-346b41506ff3" {{(pid=121103) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 30 01:17:43.436082 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0809d5f4-5f7c-4a4d-8d7e-a313c1bc532a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:43.445382 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0809d5f4-5f7c-4a4d-8d7e-a313c1bc532a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd" status: 200 len: 1716 microversion: 2.1 time: 0.400831 Oct 30 01:17:43.445978 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 637/1258] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:43 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd => generated 1716 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:43.461479 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3b529240-36fc-4540-aae1-8abc5c01ff88 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:43.461479 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3b529240-36fc-4540-aae1-8abc5c01ff88 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:43.461479 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3b529240-36fc-4540-aae1-8abc5c01ff88 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:43.461479 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3b529240-36fc-4540-aae1-8abc5c01ff88 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:43.462082 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3b529240-36fc-4540-aae1-8abc5c01ff88 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:43.462082 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3b529240-36fc-4540-aae1-8abc5c01ff88 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:43.462082 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3b529240-36fc-4540-aae1-8abc5c01ff88 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:43.462082 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3b529240-36fc-4540-aae1-8abc5c01ff88 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:44.113009 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3b529240-36fc-4540-aae1-8abc5c01ff88 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:44.126754 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3b529240-36fc-4540-aae1-8abc5c01ff88 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1472 microversion: 2.1 time: 0.679642 Oct 30 01:17:44.127350 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 638/1259] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:43 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1472 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:44.132599 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6fc86cc7-35d0-43c9-aa12-3bbb318b5c34 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:44.133211 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6fc86cc7-35d0-43c9-aa12-3bbb318b5c34 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] [instance: 8ebd67c2-b4d9-4e1b-9946-c8e05013170d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:44.139180 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6fc86cc7-35d0-43c9-aa12-3bbb318b5c34 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:44.139666 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6fc86cc7-35d0-43c9-aa12-3bbb318b5c34 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:44.140101 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6fc86cc7-35d0-43c9-aa12-3bbb318b5c34 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:44.140803 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6fc86cc7-35d0-43c9-aa12-3bbb318b5c34 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:44.141255 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6fc86cc7-35d0-43c9-aa12-3bbb318b5c34 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:44.141707 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6fc86cc7-35d0-43c9-aa12-3bbb318b5c34 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:44.499627 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6fc86cc7-35d0-43c9-aa12-3bbb318b5c34 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d87ef57cf344734b662bd792022c4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea74354a0b4753a363fc5d4f6d4f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:44.512437 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6fc86cc7-35d0-43c9-aa12-3bbb318b5c34 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] 10.222.0.13 "GET /compute/v2.1/servers/8ebd67c2-b4d9-4e1b-9946-c8e05013170d" status: 200 len: 1319 microversion: 2.1 time: 0.383882 Oct 30 01:17:44.513059 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 639/1260] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:44 2022] GET /compute/v2.1/servers/8ebd67c2-b4d9-4e1b-9946-c8e05013170d => generated 1319 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:44.518360 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ac668304-7e1d-44bf-a49e-1fcecef6bda6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:44.518995 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ac668304-7e1d-44bf-a49e-1fcecef6bda6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:44.525900 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ac668304-7e1d-44bf-a49e-1fcecef6bda6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:44.526667 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ac668304-7e1d-44bf-a49e-1fcecef6bda6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:44.527326 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ac668304-7e1d-44bf-a49e-1fcecef6bda6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:44.528206 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ac668304-7e1d-44bf-a49e-1fcecef6bda6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:44.528817 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ac668304-7e1d-44bf-a49e-1fcecef6bda6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:44.529432 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ac668304-7e1d-44bf-a49e-1fcecef6bda6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:44.726722 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ac668304-7e1d-44bf-a49e-1fcecef6bda6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:44.735515 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ac668304-7e1d-44bf-a49e-1fcecef6bda6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1476 microversion: 2.1 time: 0.221009 Oct 30 01:17:44.736866 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 640/1261] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:44 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1476 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:44.744448 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-31a4390d-b5ed-49ef-b44a-caef38a82efc tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:44.745131 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-31a4390d-b5ed-49ef-b44a-caef38a82efc tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 5387ae83-7934-49d6-a893-3661477ffe69] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:44.751772 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-31a4390d-b5ed-49ef-b44a-caef38a82efc tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:44.752548 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-31a4390d-b5ed-49ef-b44a-caef38a82efc tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:44.753090 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-31a4390d-b5ed-49ef-b44a-caef38a82efc tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:44.754106 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-31a4390d-b5ed-49ef-b44a-caef38a82efc tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:44.754588 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-31a4390d-b5ed-49ef-b44a-caef38a82efc tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:44.755248 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-31a4390d-b5ed-49ef-b44a-caef38a82efc tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:44.824863 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-0de7a6b7-a535-466e-b98a-faf73705a249 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: e19edf61-5458-4f12-84b2-346b41506ff3] Building network info cache for instance {{(pid=121103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 30 01:17:45.013511 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-31a4390d-b5ed-49ef-b44a-caef38a82efc tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:45.030172 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-31a4390d-b5ed-49ef-b44a-caef38a82efc tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/5387ae83-7934-49d6-a893-3661477ffe69" status: 200 len: 1316 microversion: 2.1 time: 0.291858 Oct 30 01:17:45.032073 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 641/1262] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:44 2022] GET /compute/v2.1/servers/5387ae83-7934-49d6-a893-3661477ffe69 => generated 1316 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:45.038848 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7e2d9ec5-9f43-4ace-868d-121bc3995d42 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:45.039630 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7e2d9ec5-9f43-4ace-868d-121bc3995d42 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:45.050157 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e2d9ec5-9f43-4ace-868d-121bc3995d42 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:45.050687 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e2d9ec5-9f43-4ace-868d-121bc3995d42 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:45.051098 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e2d9ec5-9f43-4ace-868d-121bc3995d42 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:45.051854 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e2d9ec5-9f43-4ace-868d-121bc3995d42 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:45.052310 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e2d9ec5-9f43-4ace-868d-121bc3995d42 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:45.052734 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e2d9ec5-9f43-4ace-868d-121bc3995d42 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:45.260726 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-7e2d9ec5-9f43-4ace-868d-121bc3995d42 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lazy-loading 'services' on Instance uuid f3141e23-1b24-4315-aac8-fb785005e789 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:17:45.287055 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7e2d9ec5-9f43-4ace-868d-121bc3995d42 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 200 len: 2421 microversion: 2.25 time: 0.252532 Oct 30 01:17:45.288180 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 642/1263] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:17:45 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 2421 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:17:45.294014 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-013160ce-19eb-4ec4-a532-5bee78a05fcd req-5a97cd43-0d77-4332-bd1e-9c51945be88f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04619e4f-8b79-4196-9794-f27d605c4328", "name": "network-vif-deleted", "tag": "6a9b0f09-5783-40cf-a067-b3a5f5f29ea0"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:45.307271 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-013160ce-19eb-4ec4-a532-5bee78a05fcd req-5a97cd43-0d77-4332-bd1e-9c51945be88f service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:45.308442 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-013160ce-19eb-4ec4-a532-5bee78a05fcd req-5a97cd43-0d77-4332-bd1e-9c51945be88f service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:45.309032 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-013160ce-19eb-4ec4-a532-5bee78a05fcd req-5a97cd43-0d77-4332-bd1e-9c51945be88f service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:45.337448 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-013160ce-19eb-4ec4-a532-5bee78a05fcd req-5a97cd43-0d77-4332-bd1e-9c51945be88f service nova] Creating event network-vif-deleted:6a9b0f09-5783-40cf-a067-b3a5f5f29ea0 for instance 04619e4f-8b79-4196-9794-f27d605c4328 on n-h2-master-1 Oct 30 01:17:45.354866 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-013160ce-19eb-4ec4-a532-5bee78a05fcd req-5a97cd43-0d77-4332-bd1e-9c51945be88f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064893 Oct 30 01:17:45.355900 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 643/1264] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:17:45.367433 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e4d0eac8-b90f-4c4f-9f25-e3f999be382f tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:45.368967 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e4d0eac8-b90f-4c4f-9f25-e3f999be382f tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:45.379612 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e4d0eac8-b90f-4c4f-9f25-e3f999be382f tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:45.381184 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e4d0eac8-b90f-4c4f-9f25-e3f999be382f tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:45.381184 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e4d0eac8-b90f-4c4f-9f25-e3f999be382f tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:45.381411 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e4d0eac8-b90f-4c4f-9f25-e3f999be382f tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:45.386961 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e4d0eac8-b90f-4c4f-9f25-e3f999be382f tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:45.387434 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e4d0eac8-b90f-4c4f-9f25-e3f999be382f tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:45.659179 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e4d0eac8-b90f-4c4f-9f25-e3f999be382f tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:45.668402 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e4d0eac8-b90f-4c4f-9f25-e3f999be382f tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd" status: 200 len: 1716 microversion: 2.1 time: 0.311052 Oct 30 01:17:45.669284 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 644/1265] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:45 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd => generated 1716 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:45.674332 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-be39ad63-8ab0-4ed7-881e-c59b0b276294 req-c0d4746c-fd5e-430b-a86e-f3111b77f0ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5387ae83-7934-49d6-a893-3661477ffe69", "name": "network-vif-plugged", "status": "completed", "tag": "b034ba77-a38e-49d8-95c0-5b54d7b838ee"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:45.676395 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-0de7a6b7-a535-466e-b98a-faf73705a249 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: e19edf61-5458-4f12-84b2-346b41506ff3] Updating instance_info_cache with network_info: [{"id": "dfced65c-3e28-40bf-b025-33cddcb37142", "address": "fa:16:3e:72:cd:9f", "network": {"id": "c383b18e-d32f-47dc-90a2-236912a6d567", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-257091766-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "10e2bdadb00745888a171041c5714bd9", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapdfced65c-3e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 30 01:17:45.686091 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:17:45.686289 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-be39ad63-8ab0-4ed7-881e-c59b0b276294 req-c0d4746c-fd5e-430b-a86e-f3111b77f0ae service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:45.686796 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-be39ad63-8ab0-4ed7-881e-c59b0b276294 req-c0d4746c-fd5e-430b-a86e-f3111b77f0ae service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:45.687139 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-be39ad63-8ab0-4ed7-881e-c59b0b276294 req-c0d4746c-fd5e-430b-a86e-f3111b77f0ae service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:45.691457 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:17:45.698745 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-be39ad63-8ab0-4ed7-881e-c59b0b276294 req-c0d4746c-fd5e-430b-a86e-f3111b77f0ae service nova] Creating event network-vif-plugged:b034ba77-a38e-49d8-95c0-5b54d7b838ee for instance 5387ae83-7934-49d6-a893-3661477ffe69 on n-h2-master-1 Oct 30 01:17:45.703501 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-be39ad63-8ab0-4ed7-881e-c59b0b276294 req-c0d4746c-fd5e-430b-a86e-f3111b77f0ae service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032948 Oct 30 01:17:45.704080 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 645/1266] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:17:45.711200 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9a5ffbf5-59a7-41ef-9c42-a18ea13c69b4 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:45.712042 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9a5ffbf5-59a7-41ef-9c42-a18ea13c69b4 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:45.718827 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9a5ffbf5-59a7-41ef-9c42-a18ea13c69b4 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:45.719347 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9a5ffbf5-59a7-41ef-9c42-a18ea13c69b4 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:45.725116 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9a5ffbf5-59a7-41ef-9c42-a18ea13c69b4 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:45.725116 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9a5ffbf5-59a7-41ef-9c42-a18ea13c69b4 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:45.725116 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9a5ffbf5-59a7-41ef-9c42-a18ea13c69b4 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:45.725116 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9a5ffbf5-59a7-41ef-9c42-a18ea13c69b4 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:45.744872 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0de7a6b7-a535-466e-b98a-faf73705a249 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Releasing lock "refresh_cache-e19edf61-5458-4f12-84b2-346b41506ff3" {{(pid=121103) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 30 01:17:45.745789 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0de7a6b7-a535-466e-b98a-faf73705a249 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] 10.222.0.13 "POST /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3/action" status: 202 len: 0 microversion: 2.1 time: 3.118644 Oct 30 01:17:45.751136 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 622/1267] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:17:42 2022] POST /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3/action => generated 0 bytes in 3124 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Oct 30 01:17:45.764676 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-612abc96-85a7-47a9-b4c1-fe69e0830e37 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": "auto"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:45.769233 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-612abc96-85a7-47a9-b4c1-fe69e0830e37 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:45.778561 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-612abc96-85a7-47a9-b4c1-fe69e0830e37 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:45.779313 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-612abc96-85a7-47a9-b4c1-fe69e0830e37 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:45.783591 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-612abc96-85a7-47a9-b4c1-fe69e0830e37 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:45.783591 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-612abc96-85a7-47a9-b4c1-fe69e0830e37 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:45.783591 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-612abc96-85a7-47a9-b4c1-fe69e0830e37 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:45.783898 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-612abc96-85a7-47a9-b4c1-fe69e0830e37 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:45.810822 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-612abc96-85a7-47a9-b4c1-fe69e0830e37 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lazy-loading 'flavor' on Instance uuid f3141e23-1b24-4315-aac8-fb785005e789 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:17:45.844426 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-612abc96-85a7-47a9-b4c1-fe69e0830e37 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Going to try to live migrate instance to n-h1-master-1 {{(pid=121103) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 30 01:17:45.925424 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9a5ffbf5-59a7-41ef-9c42-a18ea13c69b4 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:45.933736 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9a5ffbf5-59a7-41ef-9c42-a18ea13c69b4 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1472 microversion: 2.1 time: 0.228486 Oct 30 01:17:45.934563 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 646/1268] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:45 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1472 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:45.940038 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1752b0a4-8162-4c2b-80ba-a25641a6b2e2 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:45.940858 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1752b0a4-8162-4c2b-80ba-a25641a6b2e2 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] [instance: 8ebd67c2-b4d9-4e1b-9946-c8e05013170d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:45.960442 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1752b0a4-8162-4c2b-80ba-a25641a6b2e2 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:45.973380 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1752b0a4-8162-4c2b-80ba-a25641a6b2e2 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:45.974685 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1752b0a4-8162-4c2b-80ba-a25641a6b2e2 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:45.975732 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1752b0a4-8162-4c2b-80ba-a25641a6b2e2 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:45.976235 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1752b0a4-8162-4c2b-80ba-a25641a6b2e2 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:45.976711 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1752b0a4-8162-4c2b-80ba-a25641a6b2e2 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:46.116406 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1752b0a4-8162-4c2b-80ba-a25641a6b2e2 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d87ef57cf344734b662bd792022c4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea74354a0b4753a363fc5d4f6d4f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:46.124229 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1752b0a4-8162-4c2b-80ba-a25641a6b2e2 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] 10.222.0.13 "GET /compute/v2.1/servers/8ebd67c2-b4d9-4e1b-9946-c8e05013170d" status: 200 len: 1319 microversion: 2.1 time: 0.188496 Oct 30 01:17:46.124842 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 647/1269] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:45 2022] GET /compute/v2.1/servers/8ebd67c2-b4d9-4e1b-9946-c8e05013170d => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:46.130999 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1adbb294-da1e-45a4-927f-4e6b3c038f30 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:46.131509 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1adbb294-da1e-45a4-927f-4e6b3c038f30 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: 04619e4f-8b79-4196-9794-f27d605c4328] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:46.138066 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1adbb294-da1e-45a4-927f-4e6b3c038f30 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:46.138975 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1adbb294-da1e-45a4-927f-4e6b3c038f30 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:46.139420 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1adbb294-da1e-45a4-927f-4e6b3c038f30 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:46.140246 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1adbb294-da1e-45a4-927f-4e6b3c038f30 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:46.140984 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1adbb294-da1e-45a4-927f-4e6b3c038f30 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:46.141619 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1adbb294-da1e-45a4-927f-4e6b3c038f30 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:46.171589 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1adbb294-da1e-45a4-927f-4e6b3c038f30 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: 04619e4f-8b79-4196-9794-f27d605c4328] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:17:46.493124 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1adbb294-da1e-45a4-927f-4e6b3c038f30 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] 10.222.0.13 "DELETE /compute/v2.1/servers/04619e4f-8b79-4196-9794-f27d605c4328" status: 204 len: 0 microversion: 2.1 time: 0.366920 Oct 30 01:17:46.494024 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 648/1270] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:17:46 2022] DELETE /compute/v2.1/servers/04619e4f-8b79-4196-9794-f27d605c4328 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:17:46.515299 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ae2514c6-1a3c-4a81-97f9-0d48478f4b4c tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:46.515709 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ae2514c6-1a3c-4a81-97f9-0d48478f4b4c tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:46.535017 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae2514c6-1a3c-4a81-97f9-0d48478f4b4c tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:46.535514 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae2514c6-1a3c-4a81-97f9-0d48478f4b4c tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:46.535951 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae2514c6-1a3c-4a81-97f9-0d48478f4b4c tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:46.538088 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae2514c6-1a3c-4a81-97f9-0d48478f4b4c tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:46.541769 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae2514c6-1a3c-4a81-97f9-0d48478f4b4c tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:46.542424 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae2514c6-1a3c-4a81-97f9-0d48478f4b4c tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:46.791144 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ae2514c6-1a3c-4a81-97f9-0d48478f4b4c tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:46.803261 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ae2514c6-1a3c-4a81-97f9-0d48478f4b4c tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1476 microversion: 2.1 time: 0.298650 Oct 30 01:17:46.803993 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 649/1271] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:46 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1476 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:46.809907 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d7c3a1e9-a7c1-4ce8-b2ba-d83108bed818 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:46.810656 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d7c3a1e9-a7c1-4ce8-b2ba-d83108bed818 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 5387ae83-7934-49d6-a893-3661477ffe69] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:46.820505 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7c3a1e9-a7c1-4ce8-b2ba-d83108bed818 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:46.821421 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7c3a1e9-a7c1-4ce8-b2ba-d83108bed818 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:46.821985 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7c3a1e9-a7c1-4ce8-b2ba-d83108bed818 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:46.822854 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7c3a1e9-a7c1-4ce8-b2ba-d83108bed818 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:46.823390 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7c3a1e9-a7c1-4ce8-b2ba-d83108bed818 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:46.824160 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7c3a1e9-a7c1-4ce8-b2ba-d83108bed818 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:46.968255 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d7c3a1e9-a7c1-4ce8-b2ba-d83108bed818 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:46.990146 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d7c3a1e9-a7c1-4ce8-b2ba-d83108bed818 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/5387ae83-7934-49d6-a893-3661477ffe69" status: 200 len: 1316 microversion: 2.1 time: 0.176675 Oct 30 01:17:46.990146 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 650/1272] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:46 2022] GET /compute/v2.1/servers/5387ae83-7934-49d6-a893-3661477ffe69 => generated 1316 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:46.990146 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-82d61117-e557-48ee-aa63-a0bee7dd26ae tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:46.990146 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-82d61117-e557-48ee-aa63-a0bee7dd26ae tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: 04619e4f-8b79-4196-9794-f27d605c4328] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:46.994171 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-82d61117-e557-48ee-aa63-a0bee7dd26ae tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:46.994664 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-82d61117-e557-48ee-aa63-a0bee7dd26ae tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:46.995107 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-82d61117-e557-48ee-aa63-a0bee7dd26ae tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:46.995796 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-82d61117-e557-48ee-aa63-a0bee7dd26ae tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:46.996333 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-82d61117-e557-48ee-aa63-a0bee7dd26ae tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:46.996929 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-82d61117-e557-48ee-aa63-a0bee7dd26ae tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:47.022797 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-82d61117-e557-48ee-aa63-a0bee7dd26ae tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] HTTP exception thrown: Instance 04619e4f-8b79-4196-9794-f27d605c4328 could not be found. Oct 30 01:17:47.024511 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-82d61117-e557-48ee-aa63-a0bee7dd26ae tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Request method failure captured: Oct 30 01:17:47.024511 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/04619e4f-8b79-4196-9794-f27d605c4328 HTTP/1.1 Oct 30 01:17:47.024511 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:17:47.024511 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:17:47.024511 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:17:47.024511 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:17:47.024511 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:17:47.024511 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:17:47.024511 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:17:47.024511 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:17:47.024511 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdByN13wkk5DgvOeo_jKNC9cRtQsQmiWI2QnB_9dRMHNp37q0W-3hZraYRC6GeA6h4hCxjm0IfbEaSK-OP5OJBCVSwbVJUgWSEjLc_h5yNX1yO4Fk_6a6z6rzb3cWwY4lnvNKUvFnNcTUcMPZOfShBnI6qh7TYPuSwAho1bqB7NHCE8 Oct 30 01:17:47.024511 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:17:47.024511 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:17:47.024511 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:17:47.024511 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:17:47.024511 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:17:47.024511 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:17:47.024511 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 10e2bdadb00745888a171041c5714bd9 Oct 30 01:17:47.024511 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1236579116 Oct 30 01:17:47.024511 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:17:47.024511 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:17:47.026169 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/10e2bdadb00745888a171041c5714bd9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_10e2bdadb00745888a171041c5714bd9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/10e2bdadb00745888a171041c5714bd9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/10e2bdadb00745888a171041c5714bd9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:17:47.026169 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1236579116 Oct 30 01:17:47.026169 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 10e2bdadb00745888a171041c5714bd9 Oct 30 01:17:47.026169 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1236579116 Oct 30 01:17:47.026169 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-FloatingIPsAssociationTestJSON-1236579116-project Oct 30 01:17:47.026169 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:17:47.026169 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:17:47.026169 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 71f11109f32d4013aed5ab9320d8295b Oct 30 01:17:47.026169 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1236579116-project Oct 30 01:17:47.026169 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:17:47.026169 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 04619e4f-8b79-4196-9794-f27d605c4328 could not be found. Oct 30 01:17:47.026169 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '04619e4f-8b79-4196-9794-f27d605c4328'} Oct 30 01:17:47.026961 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:17:47.026961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:17:47.026961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:17:47.026961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:17:47.026961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:17:47.026961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:17:47.026961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:17:47.026961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:17:47.026961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:17:47.026961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:17:47.026961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04619e4f-8b79-4196-9794-f27d605c4328 could not be found. Oct 30 01:17:47.026961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:17:47.026961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:17:47.026961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:17:47.026961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:17:47.026961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:17:47.026961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:17:47.026961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:17:47.026961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:17:47.026961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:17:47.028972 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:17:47.028972 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:17:47.028972 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:17:47.028972 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:17:47.028972 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:17:47.028972 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:17:47.028972 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:17:47.028972 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04619e4f-8b79-4196-9794-f27d605c4328 could not be found. Oct 30 01:17:47.028972 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:17:47.028972 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:17:47.028972 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:17:47.028972 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:17:47.028972 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:17:47.028972 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:17:47.028972 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:17:47.028972 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:17:47.028972 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04619e4f-8b79-4196-9794-f27d605c4328 could not be found. Oct 30 01:17:47.028972 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:17:47.031755 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-82d61117-e557-48ee-aa63-a0bee7dd26ae tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Returning 404 to user: Instance 04619e4f-8b79-4196-9794-f27d605c4328 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:17:47.031755 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-82d61117-e557-48ee-aa63-a0bee7dd26ae tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] 10.222.0.13 "GET /compute/v2.1/servers/04619e4f-8b79-4196-9794-f27d605c4328" status: 404 len: 111 microversion: 2.1 time: 0.043546 Oct 30 01:17:47.031755 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 651/1273] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:46 2022] GET /compute/v2.1/servers/04619e4f-8b79-4196-9794-f27d605c4328 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:17:47.035959 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5129772b-687b-48bd-a7ab-340680997396 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:47.036609 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5129772b-687b-48bd-a7ab-340680997396 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:47.043016 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5129772b-687b-48bd-a7ab-340680997396 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:47.043508 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5129772b-687b-48bd-a7ab-340680997396 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:47.043945 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5129772b-687b-48bd-a7ab-340680997396 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:47.044648 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5129772b-687b-48bd-a7ab-340680997396 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:47.045099 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5129772b-687b-48bd-a7ab-340680997396 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:47.045571 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5129772b-687b-48bd-a7ab-340680997396 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:47.206199 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5129772b-687b-48bd-a7ab-340680997396 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:47.216001 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5129772b-687b-48bd-a7ab-340680997396 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd" status: 200 len: 1716 microversion: 2.1 time: 0.183748 Oct 30 01:17:47.216900 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 652/1274] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:47 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd => generated 1716 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:47.222094 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8528ff35-a0ad-468e-8790-cd5925431c20 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:47.222714 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8528ff35-a0ad-468e-8790-cd5925431c20 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:47.228496 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:17:47.230406 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8528ff35-a0ad-468e-8790-cd5925431c20 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:47.231082 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8528ff35-a0ad-468e-8790-cd5925431c20 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:47.231791 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8528ff35-a0ad-468e-8790-cd5925431c20 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:47.232678 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8528ff35-a0ad-468e-8790-cd5925431c20 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:47.233361 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8528ff35-a0ad-468e-8790-cd5925431c20 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:47.233961 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8528ff35-a0ad-468e-8790-cd5925431c20 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:47.397550 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8528ff35-a0ad-468e-8790-cd5925431c20 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:47.413303 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8528ff35-a0ad-468e-8790-cd5925431c20 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1472 microversion: 2.1 time: 0.189156 Oct 30 01:17:47.417822 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 653/1275] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:47 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1472 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:47.423818 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8d6a04a9-95fd-4442-9079-ac483ed4f7bc tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Calling method '.version_select at 0x7f44cca66f70>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:49.462925 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8d6a04a9-95fd-4442-9079-ac483ed4f7bc tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] 10.222.0.13 "DELETE /compute/v2.1/os-floating-ips/4d9ab861-e261-48c1-b70d-4d7dba0e6946" status: 202 len: 0 microversion: 2.1 time: 2.043746 Oct 30 01:17:49.464396 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 654/1276] 10.222.0.13 () {58 vars in 1263 bytes} [Sun Oct 30 01:17:47 2022] DELETE /compute/v2.1/os-floating-ips/4d9ab861-e261-48c1-b70d-4d7dba0e6946 => generated 0 bytes in 2046 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:17:49.469739 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a20c453c-6f28-4f1e-b5ed-9f56119fdc1d tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:49.470638 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a20c453c-6f28-4f1e-b5ed-9f56119fdc1d tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] [instance: 8ebd67c2-b4d9-4e1b-9946-c8e05013170d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:49.477859 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a20c453c-6f28-4f1e-b5ed-9f56119fdc1d tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:49.478341 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a20c453c-6f28-4f1e-b5ed-9f56119fdc1d tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:49.478774 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a20c453c-6f28-4f1e-b5ed-9f56119fdc1d tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:49.479517 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a20c453c-6f28-4f1e-b5ed-9f56119fdc1d tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:49.479970 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a20c453c-6f28-4f1e-b5ed-9f56119fdc1d tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:49.480534 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a20c453c-6f28-4f1e-b5ed-9f56119fdc1d tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:49.540824 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-612abc96-85a7-47a9-b4c1-fe69e0830e37 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789/action" status: 202 len: 0 microversion: 2.25 time: 3.788371 Oct 30 01:17:49.541776 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 623/1277] 10.222.0.13 () {62 vars in 1319 bytes} [Sun Oct 30 01:17:45 2022] POST /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789/action => generated 0 bytes in 3790 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:17:49.548287 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-37156742-07d3-4b36-b51d-dbc7e101ad05 req-7584cc7f-fd9f-4010-8081-6863194f0e26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e19edf61-5458-4f12-84b2-346b41506ff3", "tag": "dfced65c-3e28-40bf-b025-33cddcb37142"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:49.559152 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-37156742-07d3-4b36-b51d-dbc7e101ad05 req-7584cc7f-fd9f-4010-8081-6863194f0e26 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:49.559945 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-37156742-07d3-4b36-b51d-dbc7e101ad05 req-7584cc7f-fd9f-4010-8081-6863194f0e26 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:49.560556 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-37156742-07d3-4b36-b51d-dbc7e101ad05 req-7584cc7f-fd9f-4010-8081-6863194f0e26 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:49.573761 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-37156742-07d3-4b36-b51d-dbc7e101ad05 req-7584cc7f-fd9f-4010-8081-6863194f0e26 service nova] Creating event network-changed:dfced65c-3e28-40bf-b025-33cddcb37142 for instance e19edf61-5458-4f12-84b2-346b41506ff3 on n-h1-master-1 Oct 30 01:17:49.580000 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-37156742-07d3-4b36-b51d-dbc7e101ad05 req-7584cc7f-fd9f-4010-8081-6863194f0e26 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037215 Oct 30 01:17:49.580879 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 624/1278] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:17:49.587398 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3d2b5c02-e978-49b2-8ffe-0a994692d681 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:49.588887 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3d2b5c02-e978-49b2-8ffe-0a994692d681 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:49.596022 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3d2b5c02-e978-49b2-8ffe-0a994692d681 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:49.596510 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3d2b5c02-e978-49b2-8ffe-0a994692d681 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:49.596948 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3d2b5c02-e978-49b2-8ffe-0a994692d681 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:49.597692 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3d2b5c02-e978-49b2-8ffe-0a994692d681 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:49.598147 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3d2b5c02-e978-49b2-8ffe-0a994692d681 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:49.598600 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3d2b5c02-e978-49b2-8ffe-0a994692d681 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:49.639312 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a20c453c-6f28-4f1e-b5ed-9f56119fdc1d tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d87ef57cf344734b662bd792022c4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea74354a0b4753a363fc5d4f6d4f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:49.648116 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a20c453c-6f28-4f1e-b5ed-9f56119fdc1d tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] 10.222.0.13 "GET /compute/v2.1/servers/8ebd67c2-b4d9-4e1b-9946-c8e05013170d" status: 200 len: 1469 microversion: 2.1 time: 0.182350 Oct 30 01:17:49.648800 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 655/1279] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:49 2022] GET /compute/v2.1/servers/8ebd67c2-b4d9-4e1b-9946-c8e05013170d => generated 1469 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:49.659261 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-118d423b-9a04-4ed2-8af9-eda8cd994360 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:49.660177 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-118d423b-9a04-4ed2-8af9-eda8cd994360 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 5387ae83-7934-49d6-a893-3661477ffe69] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:49.668013 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-118d423b-9a04-4ed2-8af9-eda8cd994360 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:49.668501 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-118d423b-9a04-4ed2-8af9-eda8cd994360 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:49.670529 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-118d423b-9a04-4ed2-8af9-eda8cd994360 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:49.670529 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-118d423b-9a04-4ed2-8af9-eda8cd994360 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:49.670529 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-118d423b-9a04-4ed2-8af9-eda8cd994360 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:49.670829 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-118d423b-9a04-4ed2-8af9-eda8cd994360 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:49.792934 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3d2b5c02-e978-49b2-8ffe-0a994692d681 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:49.808981 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3d2b5c02-e978-49b2-8ffe-0a994692d681 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1473 microversion: 2.1 time: 0.226123 Oct 30 01:17:49.812371 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 625/1280] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:49 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1473 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:49.822474 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-82c533a0-a580-4357-ba19-fb3b197642c7 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:49.823466 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-82c533a0-a580-4357-ba19-fb3b197642c7 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:49.831035 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-82c533a0-a580-4357-ba19-fb3b197642c7 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:49.831626 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-82c533a0-a580-4357-ba19-fb3b197642c7 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:49.832403 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-82c533a0-a580-4357-ba19-fb3b197642c7 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:49.833762 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-82c533a0-a580-4357-ba19-fb3b197642c7 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:49.834526 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-82c533a0-a580-4357-ba19-fb3b197642c7 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:49.835144 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-82c533a0-a580-4357-ba19-fb3b197642c7 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:49.852681 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-118d423b-9a04-4ed2-8af9-eda8cd994360 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:49.862733 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-118d423b-9a04-4ed2-8af9-eda8cd994360 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/5387ae83-7934-49d6-a893-3661477ffe69" status: 200 len: 1466 microversion: 2.1 time: 0.207495 Oct 30 01:17:49.864041 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 656/1281] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:49 2022] GET /compute/v2.1/servers/5387ae83-7934-49d6-a893-3661477ffe69 => generated 1466 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:49.868932 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cfad5af3-eaf4-40f3-8e77-f51d05c12560 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:49.869777 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cfad5af3-eaf4-40f3-8e77-f51d05c12560 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:49.876764 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cfad5af3-eaf4-40f3-8e77-f51d05c12560 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:49.877516 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cfad5af3-eaf4-40f3-8e77-f51d05c12560 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:49.878245 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cfad5af3-eaf4-40f3-8e77-f51d05c12560 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:49.879212 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cfad5af3-eaf4-40f3-8e77-f51d05c12560 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:49.880405 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cfad5af3-eaf4-40f3-8e77-f51d05c12560 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:49.881013 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cfad5af3-eaf4-40f3-8e77-f51d05c12560 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:50.032297 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-82c533a0-a580-4357-ba19-fb3b197642c7 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:50.042728 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-82c533a0-a580-4357-ba19-fb3b197642c7 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd" status: 200 len: 1706 microversion: 2.1 time: 0.227902 Oct 30 01:17:50.043714 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 626/1282] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:49 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd => generated 1706 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:50.049611 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-7d9ae5ea-7b5b-45f9-898f-34dd008930ad req-6d7a1940-b226-413e-91b0-165c14f371ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76c32172-798a-49f6-8247-6f86860dbdc5", "name": "network-vif-unplugged", "status": "completed", "tag": "e96e6262-0ade-4db0-aeff-c6471cd42e45"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:50.059400 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-7d9ae5ea-7b5b-45f9-898f-34dd008930ad req-6d7a1940-b226-413e-91b0-165c14f371ce service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:50.060014 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-7d9ae5ea-7b5b-45f9-898f-34dd008930ad req-6d7a1940-b226-413e-91b0-165c14f371ce service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:50.060540 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-7d9ae5ea-7b5b-45f9-898f-34dd008930ad req-6d7a1940-b226-413e-91b0-165c14f371ce service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:50.064313 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-cfad5af3-eaf4-40f3-8e77-f51d05c12560 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:50.072737 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cfad5af3-eaf4-40f3-8e77-f51d05c12560 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1472 microversion: 2.1 time: 0.207553 Oct 30 01:17:50.073550 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-7d9ae5ea-7b5b-45f9-898f-34dd008930ad req-6d7a1940-b226-413e-91b0-165c14f371ce service nova] Creating event network-vif-unplugged:e96e6262-0ade-4db0-aeff-c6471cd42e45 for instance 76c32172-798a-49f6-8247-6f86860dbdc5 on n-h1-master-1 Oct 30 01:17:50.073705 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 657/1283] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:49 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1472 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:50.078874 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [req-7d9ae5ea-7b5b-45f9-898f-34dd008930ad req-6d7a1940-b226-413e-91b0-165c14f371ce service nova] Instance 76c32172-798a-49f6-8247-6f86860dbdc5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1'} {{(pid=121103) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 30 01:17:50.083651 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-634d233f-f78d-4f2f-b846-c1f826b295a3 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:50.084455 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-634d233f-f78d-4f2f-b846-c1f826b295a3 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: e19edf61-5458-4f12-84b2-346b41506ff3] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:50.085938 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-7d9ae5ea-7b5b-45f9-898f-34dd008930ad req-6d7a1940-b226-413e-91b0-165c14f371ce service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040345 Oct 30 01:17:50.086536 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 627/1284] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:17:50.092110 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-64f669d9-a630-47fb-838f-4236a15f132c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:50.092799 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-64f669d9-a630-47fb-838f-4236a15f132c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:50.094794 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-634d233f-f78d-4f2f-b846-c1f826b295a3 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:50.095302 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-634d233f-f78d-4f2f-b846-c1f826b295a3 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:50.095723 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-634d233f-f78d-4f2f-b846-c1f826b295a3 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:50.097903 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-634d233f-f78d-4f2f-b846-c1f826b295a3 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:50.097903 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-634d233f-f78d-4f2f-b846-c1f826b295a3 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:50.097903 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-634d233f-f78d-4f2f-b846-c1f826b295a3 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:50.099078 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-64f669d9-a630-47fb-838f-4236a15f132c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:50.099559 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-64f669d9-a630-47fb-838f-4236a15f132c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:50.099987 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-64f669d9-a630-47fb-838f-4236a15f132c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:50.100677 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-64f669d9-a630-47fb-838f-4236a15f132c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:50.101128 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-64f669d9-a630-47fb-838f-4236a15f132c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:50.101575 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-64f669d9-a630-47fb-838f-4236a15f132c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:50.123621 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-634d233f-f78d-4f2f-b846-c1f826b295a3 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: e19edf61-5458-4f12-84b2-346b41506ff3] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:17:50.240106 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-64f669d9-a630-47fb-838f-4236a15f132c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:50.249373 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-64f669d9-a630-47fb-838f-4236a15f132c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:50.250876 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-64f669d9-a630-47fb-838f-4236a15f132c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:50.252058 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-64f669d9-a630-47fb-838f-4236a15f132c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 200 len: 1813 microversion: 2.25 time: 0.164262 Oct 30 01:17:50.252623 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 628/1285] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:17:50 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 1813 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:17:50.257996 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-53e24f19-7ac2-486b-bb44-a3e3bb3ee74b tempest-DeleteServersAdminTestJSON-1308973293 tempest-DeleteServersAdminTestJSON-1308973293-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:50.260348 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-53e24f19-7ac2-486b-bb44-a3e3bb3ee74b tempest-DeleteServersAdminTestJSON-1308973293 tempest-DeleteServersAdminTestJSON-1308973293-project-admin] [instance: 8ebd67c2-b4d9-4e1b-9946-c8e05013170d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:50.266730 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-53e24f19-7ac2-486b-bb44-a3e3bb3ee74b tempest-DeleteServersAdminTestJSON-1308973293 tempest-DeleteServersAdminTestJSON-1308973293-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:50.267218 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-53e24f19-7ac2-486b-bb44-a3e3bb3ee74b tempest-DeleteServersAdminTestJSON-1308973293 tempest-DeleteServersAdminTestJSON-1308973293-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:50.268193 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-53e24f19-7ac2-486b-bb44-a3e3bb3ee74b tempest-DeleteServersAdminTestJSON-1308973293 tempest-DeleteServersAdminTestJSON-1308973293-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:50.268315 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-53e24f19-7ac2-486b-bb44-a3e3bb3ee74b tempest-DeleteServersAdminTestJSON-1308973293 tempest-DeleteServersAdminTestJSON-1308973293-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:50.268767 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-53e24f19-7ac2-486b-bb44-a3e3bb3ee74b tempest-DeleteServersAdminTestJSON-1308973293 tempest-DeleteServersAdminTestJSON-1308973293-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:50.269187 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-53e24f19-7ac2-486b-bb44-a3e3bb3ee74b tempest-DeleteServersAdminTestJSON-1308973293 tempest-DeleteServersAdminTestJSON-1308973293-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:50.419561 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-634d233f-f78d-4f2f-b846-c1f826b295a3 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3" status: 204 len: 0 microversion: 2.1 time: 0.340181 Oct 30 01:17:50.420186 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 658/1286] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:17:50 2022] DELETE /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:17:50.425384 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-df89f7f0-074a-42aa-95e2-dea14e0b9bb4 tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:50.426074 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-df89f7f0-074a-42aa-95e2-dea14e0b9bb4 tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] [instance: 5387ae83-7934-49d6-a893-3661477ffe69] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:50.432512 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df89f7f0-074a-42aa-95e2-dea14e0b9bb4 tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:50.432988 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df89f7f0-074a-42aa-95e2-dea14e0b9bb4 tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:50.433444 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df89f7f0-074a-42aa-95e2-dea14e0b9bb4 tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:50.434221 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df89f7f0-074a-42aa-95e2-dea14e0b9bb4 tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:50.434606 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df89f7f0-074a-42aa-95e2-dea14e0b9bb4 tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:50.435021 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df89f7f0-074a-42aa-95e2-dea14e0b9bb4 tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:50.565250 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-df89f7f0-074a-42aa-95e2-dea14e0b9bb4 tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/5387ae83-7934-49d6-a893-3661477ffe69" status: 200 len: 1617 microversion: 2.1 time: 0.143829 Oct 30 01:17:50.565992 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 659/1287] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:50 2022] GET /compute/v2.1/servers/5387ae83-7934-49d6-a893-3661477ffe69 => generated 1617 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:50.570742 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-41be7b26-14f1-4715-bb92-c32bd1a7a116 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Calling method '.version_select at 0x7f44cc6f3550>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:50.574376 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-41be7b26-14f1-4715-bb92-c32bd1a7a116 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:50.574933 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-41be7b26-14f1-4715-bb92-c32bd1a7a116 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:50.575447 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-41be7b26-14f1-4715-bb92-c32bd1a7a116 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:50.601056 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-41be7b26-14f1-4715-bb92-c32bd1a7a116 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] 10.222.0.13 "GET /compute/v2.1/os-migrations" status: 200 len: 3108 microversion: 2.1 time: 0.033539 Oct 30 01:17:50.602407 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 660/1288] 10.222.0.13 () {58 vars in 1143 bytes} [Sun Oct 30 01:17:50 2022] GET /compute/v2.1/os-migrations => generated 3108 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:50.618066 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fde8492b-e8d9-433d-bdc5-507edd8fa45f tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:50.618066 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fde8492b-e8d9-433d-bdc5-507edd8fa45f tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: e19edf61-5458-4f12-84b2-346b41506ff3] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:50.623599 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-53e24f19-7ac2-486b-bb44-a3e3bb3ee74b tempest-DeleteServersAdminTestJSON-1308973293 tempest-DeleteServersAdminTestJSON-1308973293-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/8ebd67c2-b4d9-4e1b-9946-c8e05013170d/action" status: 202 len: 0 microversion: 2.1 time: 0.369859 Oct 30 01:17:50.625168 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fde8492b-e8d9-433d-bdc5-507edd8fa45f tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:50.626545 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fde8492b-e8d9-433d-bdc5-507edd8fa45f tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:50.626545 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fde8492b-e8d9-433d-bdc5-507edd8fa45f tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:50.627038 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fde8492b-e8d9-433d-bdc5-507edd8fa45f tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:50.627982 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fde8492b-e8d9-433d-bdc5-507edd8fa45f tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:50.628673 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fde8492b-e8d9-433d-bdc5-507edd8fa45f tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:50.633390 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 629/1289] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:17:50 2022] POST /compute/v2.1/servers/8ebd67c2-b4d9-4e1b-9946-c8e05013170d/action => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:17:50.640224 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-3141996a-2575-4605-b869-712216e6ad33 req-2de04dad-c32c-4337-8b07-6e72121d6f4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b368660-effb-411d-b713-455fc7fd44cd", "tag": "be63e75e-18fe-4000-8f59-5722fd84c310"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:50.647022 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:17:50.660034 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-3141996a-2575-4605-b869-712216e6ad33 req-2de04dad-c32c-4337-8b07-6e72121d6f4e service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:50.660630 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-3141996a-2575-4605-b869-712216e6ad33 req-2de04dad-c32c-4337-8b07-6e72121d6f4e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:50.661681 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-3141996a-2575-4605-b869-712216e6ad33 req-2de04dad-c32c-4337-8b07-6e72121d6f4e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:50.676073 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-3141996a-2575-4605-b869-712216e6ad33 req-2de04dad-c32c-4337-8b07-6e72121d6f4e service nova] Creating event network-changed:be63e75e-18fe-4000-8f59-5722fd84c310 for instance 6b368660-effb-411d-b713-455fc7fd44cd on n-h1-master-1 Oct 30 01:17:50.685657 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-3141996a-2575-4605-b869-712216e6ad33 req-2de04dad-c32c-4337-8b07-6e72121d6f4e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050941 Oct 30 01:17:50.686267 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 630/1290] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:17:50.691609 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bc50266f-ecbf-4fab-9789-d3e916f1f4e2 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:50.695252 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-bc50266f-ecbf-4fab-9789-d3e916f1f4e2 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:50.699863 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bc50266f-ecbf-4fab-9789-d3e916f1f4e2 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:50.700868 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bc50266f-ecbf-4fab-9789-d3e916f1f4e2 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:50.700868 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bc50266f-ecbf-4fab-9789-d3e916f1f4e2 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:50.701573 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bc50266f-ecbf-4fab-9789-d3e916f1f4e2 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:50.702032 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bc50266f-ecbf-4fab-9789-d3e916f1f4e2 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:50.702797 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bc50266f-ecbf-4fab-9789-d3e916f1f4e2 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:50.841358 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-fde8492b-e8d9-433d-bdc5-507edd8fa45f tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f11109f32d4013aed5ab9320d8295b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e2bdadb00745888a171041c5714bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:50.851756 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fde8492b-e8d9-433d-bdc5-507edd8fa45f tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] 10.222.0.13 "GET /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3" status: 200 len: 1524 microversion: 2.1 time: 0.247489 Oct 30 01:17:50.853287 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 661/1291] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:50 2022] GET /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3 => generated 1524 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:50.865911 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fb7f8617-ad57-4efa-b67a-db3c16d337e4 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:50.866851 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fb7f8617-ad57-4efa-b67a-db3c16d337e4 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] [instance: 8ebd67c2-b4d9-4e1b-9946-c8e05013170d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:50.873551 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb7f8617-ad57-4efa-b67a-db3c16d337e4 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:50.874277 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb7f8617-ad57-4efa-b67a-db3c16d337e4 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:50.874870 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb7f8617-ad57-4efa-b67a-db3c16d337e4 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:50.875803 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb7f8617-ad57-4efa-b67a-db3c16d337e4 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:50.876610 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb7f8617-ad57-4efa-b67a-db3c16d337e4 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:50.877220 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb7f8617-ad57-4efa-b67a-db3c16d337e4 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:50.904732 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bc50266f-ecbf-4fab-9789-d3e916f1f4e2 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd" status: 200 len: 1857 microversion: 2.1 time: 0.217223 Oct 30 01:17:50.906145 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 631/1292] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:50 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd => generated 1857 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:50.913112 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c7035c3e-71a9-405b-bf36-089e6fac45dc tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1509459453", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "d19d848f-99bc-4f10-b837-d66aaa5258a6"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:50.950450 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb7f8617-ad57-4efa-b67a-db3c16d337e4 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:50.951257 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb7f8617-ad57-4efa-b67a-db3c16d337e4 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:50.951843 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb7f8617-ad57-4efa-b67a-db3c16d337e4 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:50.952603 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-fb7f8617-ad57-4efa-b67a-db3c16d337e4 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lazy-loading 'fault' on Instance uuid 8ebd67c2-b4d9-4e1b-9946-c8e05013170d {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:17:50.996766 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-c7035c3e-71a9-405b-bf36-089e6fac45dc tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] validate_networks() for None {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:17:51.179804 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-fb7f8617-ad57-4efa-b67a-db3c16d337e4 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d87ef57cf344734b662bd792022c4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea74354a0b4753a363fc5d4f6d4f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:51.188933 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fb7f8617-ad57-4efa-b67a-db3c16d337e4 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] 10.222.0.13 "GET /compute/v2.1/servers/8ebd67c2-b4d9-4e1b-9946-c8e05013170d" status: 200 len: 1452 microversion: 2.1 time: 0.329563 Oct 30 01:17:51.190185 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 662/1293] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:50 2022] GET /compute/v2.1/servers/8ebd67c2-b4d9-4e1b-9946-c8e05013170d => generated 1452 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:51.195966 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7856f103-b152-4ffe-93d6-1d06dd95158b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:51.196900 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7856f103-b152-4ffe-93d6-1d06dd95158b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:51.204337 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7856f103-b152-4ffe-93d6-1d06dd95158b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:51.205123 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7856f103-b152-4ffe-93d6-1d06dd95158b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:51.205801 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7856f103-b152-4ffe-93d6-1d06dd95158b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:51.206980 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7856f103-b152-4ffe-93d6-1d06dd95158b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:51.207532 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7856f103-b152-4ffe-93d6-1d06dd95158b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:51.208579 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7856f103-b152-4ffe-93d6-1d06dd95158b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:51.325968 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-c7035c3e-71a9-405b-bf36-089e6fac45dc tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:17:51.326411 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-c7035c3e-71a9-405b-bf36-089e6fac45dc tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:17:51.326887 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-c7035c3e-71a9-405b-bf36-089e6fac45dc tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:17:51.327296 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-c7035c3e-71a9-405b-bf36-089e6fac45dc tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:17:51.327701 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-c7035c3e-71a9-405b-bf36-089e6fac45dc tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:17:51.337536 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c7035c3e-71a9-405b-bf36-089e6fac45dc tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:51.341647 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c7035c3e-71a9-405b-bf36-089e6fac45dc tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:51.341647 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c7035c3e-71a9-405b-bf36-089e6fac45dc tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:51.341647 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c7035c3e-71a9-405b-bf36-089e6fac45dc tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:51.341647 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c7035c3e-71a9-405b-bf36-089e6fac45dc tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:51.342040 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c7035c3e-71a9-405b-bf36-089e6fac45dc tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:51.357480 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-c7035c3e-71a9-405b-bf36-089e6fac45dc tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Getting quotas for project 76b6f7b705f5428b9a3a3a8c4f86ff48. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:17:51.362538 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-c7035c3e-71a9-405b-bf36-089e6fac45dc tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Getting quotas for user c536d41a93ad4337909fe2e2cb949e03 and project 76b6f7b705f5428b9a3a3a8c4f86ff48. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:17:51.375380 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c7035c3e-71a9-405b-bf36-089e6fac45dc tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:17:51.377845 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c7035c3e-71a9-405b-bf36-089e6fac45dc tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 5904b0d2-fd7a-4f0e-92b9-757c056620fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:17:51.388156 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7856f103-b152-4ffe-93d6-1d06dd95158b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:51.396646 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7856f103-b152-4ffe-93d6-1d06dd95158b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1473 microversion: 2.1 time: 0.205174 Oct 30 01:17:51.397209 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 663/1294] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:51 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1473 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:51.401986 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-368c3d82-fad3-455f-9cb1-d0194e57854b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:51.402479 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-368c3d82-fad3-455f-9cb1-d0194e57854b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:51.408866 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-368c3d82-fad3-455f-9cb1-d0194e57854b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:51.409378 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-368c3d82-fad3-455f-9cb1-d0194e57854b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:51.409806 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-368c3d82-fad3-455f-9cb1-d0194e57854b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:51.410615 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-368c3d82-fad3-455f-9cb1-d0194e57854b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:51.411071 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-368c3d82-fad3-455f-9cb1-d0194e57854b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:51.411512 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-368c3d82-fad3-455f-9cb1-d0194e57854b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:51.542288 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-368c3d82-fad3-455f-9cb1-d0194e57854b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lazy-loading 'services' on Instance uuid 6b368660-effb-411d-b713-455fc7fd44cd {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:17:51.546248 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c7035c3e-71a9-405b-bf36-089e6fac45dc tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.638034 Oct 30 01:17:51.547062 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 632/1295] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:17:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:17:51.557593 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-399ddebb-2eaa-4a21-a7d8-3038fc126cb0 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:51.558209 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-399ddebb-2eaa-4a21-a7d8-3038fc126cb0 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:51.567848 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-399ddebb-2eaa-4a21-a7d8-3038fc126cb0 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:51.568360 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-399ddebb-2eaa-4a21-a7d8-3038fc126cb0 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:51.569418 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-399ddebb-2eaa-4a21-a7d8-3038fc126cb0 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:51.569519 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-399ddebb-2eaa-4a21-a7d8-3038fc126cb0 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:51.570020 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-399ddebb-2eaa-4a21-a7d8-3038fc126cb0 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:51.570382 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-399ddebb-2eaa-4a21-a7d8-3038fc126cb0 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:51.720995 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-399ddebb-2eaa-4a21-a7d8-3038fc126cb0 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:51.730150 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-399ddebb-2eaa-4a21-a7d8-3038fc126cb0 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1472 microversion: 2.1 time: 0.175815 Oct 30 01:17:51.730338 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 633/1296] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:51 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1472 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:51.737229 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-eeb6fff8-ec0d-4278-bf74-b722fece69a3 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:51.737951 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-eeb6fff8-ec0d-4278-bf74-b722fece69a3 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] [instance: 8ebd67c2-b4d9-4e1b-9946-c8e05013170d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:51.744938 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eeb6fff8-ec0d-4278-bf74-b722fece69a3 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:51.745574 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eeb6fff8-ec0d-4278-bf74-b722fece69a3 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:51.746254 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eeb6fff8-ec0d-4278-bf74-b722fece69a3 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:51.747197 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eeb6fff8-ec0d-4278-bf74-b722fece69a3 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:51.747735 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eeb6fff8-ec0d-4278-bf74-b722fece69a3 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:51.748230 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eeb6fff8-ec0d-4278-bf74-b722fece69a3 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:51.775520 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-eeb6fff8-ec0d-4278-bf74-b722fece69a3 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] [instance: 8ebd67c2-b4d9-4e1b-9946-c8e05013170d] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:17:51.807049 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-368c3d82-fad3-455f-9cb1-d0194e57854b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd/os-volume_attachments/99059930-a27c-495b-825b-72b6b0274148" status: 202 len: 0 microversion: 2.1 time: 0.408540 Oct 30 01:17:51.807804 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 664/1297] 10.222.0.13 () {58 vars in 1416 bytes} [Sun Oct 30 01:17:51 2022] DELETE /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd/os-volume_attachments/99059930-a27c-495b-825b-72b6b0274148 => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:17:51.813628 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-62f74a7e-1f2b-4c71-aaf9-5e704bb0163a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:51.814354 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-62f74a7e-1f2b-4c71-aaf9-5e704bb0163a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:51.822558 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-62f74a7e-1f2b-4c71-aaf9-5e704bb0163a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:51.823087 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-62f74a7e-1f2b-4c71-aaf9-5e704bb0163a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:51.823513 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-62f74a7e-1f2b-4c71-aaf9-5e704bb0163a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:51.824208 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-62f74a7e-1f2b-4c71-aaf9-5e704bb0163a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:51.824655 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-62f74a7e-1f2b-4c71-aaf9-5e704bb0163a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:51.825070 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-62f74a7e-1f2b-4c71-aaf9-5e704bb0163a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:51.968089 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-62f74a7e-1f2b-4c71-aaf9-5e704bb0163a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:51.979691 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-62f74a7e-1f2b-4c71-aaf9-5e704bb0163a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:51.981207 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-62f74a7e-1f2b-4c71-aaf9-5e704bb0163a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:51.982539 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-62f74a7e-1f2b-4c71-aaf9-5e704bb0163a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 200 len: 1813 microversion: 2.25 time: 0.173494 Oct 30 01:17:51.997543 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 665/1298] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:17:51 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 1813 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:17:52.005982 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bbecda63-62b6-40ea-85c6-b8dda22276fd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:52.006592 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bbecda63-62b6-40ea-85c6-b8dda22276fd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 5904b0d2-fd7a-4f0e-92b9-757c056620fc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:52.058560 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bbecda63-62b6-40ea-85c6-b8dda22276fd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:52.065810 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bbecda63-62b6-40ea-85c6-b8dda22276fd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/5904b0d2-fd7a-4f0e-92b9-757c056620fc" status: 200 len: 1217 microversion: 2.1 time: 0.067163 Oct 30 01:17:52.066368 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 666/1299] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:51 2022] GET /compute/v2.1/servers/5904b0d2-fd7a-4f0e-92b9-757c056620fc => generated 1217 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:52.070925 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f4a8b70e-1de1-41bd-80b4-cdb168bf66d6 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:52.073136 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f4a8b70e-1de1-41bd-80b4-cdb168bf66d6 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:52.079832 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f4a8b70e-1de1-41bd-80b4-cdb168bf66d6 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:52.080317 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f4a8b70e-1de1-41bd-80b4-cdb168bf66d6 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:52.080748 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f4a8b70e-1de1-41bd-80b4-cdb168bf66d6 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:52.081462 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f4a8b70e-1de1-41bd-80b4-cdb168bf66d6 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:52.081910 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f4a8b70e-1de1-41bd-80b4-cdb168bf66d6 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:52.082327 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f4a8b70e-1de1-41bd-80b4-cdb168bf66d6 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:52.099863 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-eeb6fff8-ec0d-4278-bf74-b722fece69a3 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8ebd67c2-b4d9-4e1b-9946-c8e05013170d" status: 204 len: 0 microversion: 2.1 time: 0.367841 Oct 30 01:17:52.100459 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 634/1300] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:17:51 2022] DELETE /compute/v2.1/servers/8ebd67c2-b4d9-4e1b-9946-c8e05013170d => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:17:52.105757 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f115d734-1fcd-4fae-a5f5-97d41b12b3ce tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:52.109713 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f115d734-1fcd-4fae-a5f5-97d41b12b3ce tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: e19edf61-5458-4f12-84b2-346b41506ff3] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:52.112750 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f115d734-1fcd-4fae-a5f5-97d41b12b3ce tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:52.113273 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f115d734-1fcd-4fae-a5f5-97d41b12b3ce tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:52.113745 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f115d734-1fcd-4fae-a5f5-97d41b12b3ce tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:52.113870 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f4a8b70e-1de1-41bd-80b4-cdb168bf66d6 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046337 Oct 30 01:17:52.115262 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f115d734-1fcd-4fae-a5f5-97d41b12b3ce tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:52.115691 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 667/1301] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 01:17:52 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:17:52.115899 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f115d734-1fcd-4fae-a5f5-97d41b12b3ce tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:52.116474 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f115d734-1fcd-4fae-a5f5-97d41b12b3ce tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:52.120091 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-85242527-6b32-4fff-9ba1-ddf569705856 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:52.120696 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-85242527-6b32-4fff-9ba1-ddf569705856 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] [instance: 8ebd67c2-b4d9-4e1b-9946-c8e05013170d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:52.126379 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-85242527-6b32-4fff-9ba1-ddf569705856 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:52.126860 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-85242527-6b32-4fff-9ba1-ddf569705856 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:52.127291 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-85242527-6b32-4fff-9ba1-ddf569705856 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:52.127982 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-85242527-6b32-4fff-9ba1-ddf569705856 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:52.128432 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-85242527-6b32-4fff-9ba1-ddf569705856 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:52.128851 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-85242527-6b32-4fff-9ba1-ddf569705856 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:52.164552 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-85242527-6b32-4fff-9ba1-ddf569705856 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:52.165039 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-85242527-6b32-4fff-9ba1-ddf569705856 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:52.165504 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-85242527-6b32-4fff-9ba1-ddf569705856 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:52.165957 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-85242527-6b32-4fff-9ba1-ddf569705856 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lazy-loading 'fault' on Instance uuid 8ebd67c2-b4d9-4e1b-9946-c8e05013170d {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:17:52.320731 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f115d734-1fcd-4fae-a5f5-97d41b12b3ce tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f11109f32d4013aed5ab9320d8295b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e2bdadb00745888a171041c5714bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:52.325465 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-85242527-6b32-4fff-9ba1-ddf569705856 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d87ef57cf344734b662bd792022c4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea74354a0b4753a363fc5d4f6d4f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:52.330641 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f115d734-1fcd-4fae-a5f5-97d41b12b3ce tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] 10.222.0.13 "GET /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3" status: 200 len: 1524 microversion: 2.1 time: 0.228986 Oct 30 01:17:52.331794 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 635/1302] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:52 2022] GET /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3 => generated 1524 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:52.339605 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-85242527-6b32-4fff-9ba1-ddf569705856 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] 10.222.0.13 "GET /compute/v2.1/servers/8ebd67c2-b4d9-4e1b-9946-c8e05013170d" status: 200 len: 1458 microversion: 2.1 time: 0.222907 Oct 30 01:17:52.346126 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 668/1303] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:52 2022] GET /compute/v2.1/servers/8ebd67c2-b4d9-4e1b-9946-c8e05013170d => generated 1458 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:52.419485 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4354db2c-a780-419b-8d6a-12bfbf262030 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:52.420084 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4354db2c-a780-419b-8d6a-12bfbf262030 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:52.426100 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4354db2c-a780-419b-8d6a-12bfbf262030 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:52.426575 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4354db2c-a780-419b-8d6a-12bfbf262030 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:52.427025 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4354db2c-a780-419b-8d6a-12bfbf262030 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:52.427710 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4354db2c-a780-419b-8d6a-12bfbf262030 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:52.428159 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4354db2c-a780-419b-8d6a-12bfbf262030 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:52.428615 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4354db2c-a780-419b-8d6a-12bfbf262030 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:52.443644 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:UPDATE=6,nova_cell1:RELEASE=1,nova_cell1:SELECT=90,nova_cell1:INSERT=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:17:52.557855 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4354db2c-a780-419b-8d6a-12bfbf262030 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:52.565915 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4354db2c-a780-419b-8d6a-12bfbf262030 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1473 microversion: 2.1 time: 0.150285 Oct 30 01:17:52.566493 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 636/1304] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:52 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1473 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:52.754155 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ab098ecc-b829-4054-83af-0ab766f1779a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:52.755455 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ab098ecc-b829-4054-83af-0ab766f1779a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:52.762402 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ab098ecc-b829-4054-83af-0ab766f1779a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:52.762829 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ab098ecc-b829-4054-83af-0ab766f1779a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:52.763267 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ab098ecc-b829-4054-83af-0ab766f1779a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:52.763969 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ab098ecc-b829-4054-83af-0ab766f1779a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:52.764424 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ab098ecc-b829-4054-83af-0ab766f1779a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:52.764854 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ab098ecc-b829-4054-83af-0ab766f1779a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:52.971512 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ab098ecc-b829-4054-83af-0ab766f1779a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:52.979326 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ab098ecc-b829-4054-83af-0ab766f1779a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1472 microversion: 2.1 time: 0.229085 Oct 30 01:17:52.980073 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 669/1305] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:52 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1472 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:53.012835 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0c71583e-5dc2-4990-bf1f-17235be7c246 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:53.013756 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0c71583e-5dc2-4990-bf1f-17235be7c246 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:53.022073 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c71583e-5dc2-4990-bf1f-17235be7c246 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:53.022554 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c71583e-5dc2-4990-bf1f-17235be7c246 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:53.022983 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c71583e-5dc2-4990-bf1f-17235be7c246 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:53.023738 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c71583e-5dc2-4990-bf1f-17235be7c246 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:53.024192 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c71583e-5dc2-4990-bf1f-17235be7c246 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:53.024608 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c71583e-5dc2-4990-bf1f-17235be7c246 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:53.088682 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c613720d-dc49-4ae8-89ef-a5ed66b000bd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:53.089290 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c613720d-dc49-4ae8-89ef-a5ed66b000bd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 5904b0d2-fd7a-4f0e-92b9-757c056620fc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:53.095474 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c613720d-dc49-4ae8-89ef-a5ed66b000bd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:53.095969 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c613720d-dc49-4ae8-89ef-a5ed66b000bd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:53.096404 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c613720d-dc49-4ae8-89ef-a5ed66b000bd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:53.097138 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c613720d-dc49-4ae8-89ef-a5ed66b000bd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:53.097615 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c613720d-dc49-4ae8-89ef-a5ed66b000bd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:53.098071 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c613720d-dc49-4ae8-89ef-a5ed66b000bd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:53.168539 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c613720d-dc49-4ae8-89ef-a5ed66b000bd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:53.177696 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c613720d-dc49-4ae8-89ef-a5ed66b000bd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/5904b0d2-fd7a-4f0e-92b9-757c056620fc" status: 200 len: 1221 microversion: 2.1 time: 0.092349 Oct 30 01:17:53.178489 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 670/1306] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:53 2022] GET /compute/v2.1/servers/5904b0d2-fd7a-4f0e-92b9-757c056620fc => generated 1221 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:17:53.183349 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-eecd0f80-d13b-4457-9348-04bf174c7290 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:53.185846 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-eecd0f80-d13b-4457-9348-04bf174c7290 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:53.193713 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0c71583e-5dc2-4990-bf1f-17235be7c246 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:53.194248 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eecd0f80-d13b-4457-9348-04bf174c7290 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:53.194986 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eecd0f80-d13b-4457-9348-04bf174c7290 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:53.195469 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eecd0f80-d13b-4457-9348-04bf174c7290 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:53.196926 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eecd0f80-d13b-4457-9348-04bf174c7290 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:53.197291 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eecd0f80-d13b-4457-9348-04bf174c7290 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:53.198028 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eecd0f80-d13b-4457-9348-04bf174c7290 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:53.204833 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0c71583e-5dc2-4990-bf1f-17235be7c246 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:53.206574 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0c71583e-5dc2-4990-bf1f-17235be7c246 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:53.208230 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0c71583e-5dc2-4990-bf1f-17235be7c246 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 200 len: 1813 microversion: 2.25 time: 0.199981 Oct 30 01:17:53.208906 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 637/1307] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:17:53 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 1813 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:17:53.232203 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-eecd0f80-d13b-4457-9348-04bf174c7290 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052780 Oct 30 01:17:53.232765 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 671/1308] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 01:17:53 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:17:53.354065 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ed3f915f-24d9-4583-805d-d88b5e01c2c6 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:53.354678 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ed3f915f-24d9-4583-805d-d88b5e01c2c6 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: e19edf61-5458-4f12-84b2-346b41506ff3] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:53.360750 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ed3f915f-24d9-4583-805d-d88b5e01c2c6 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:53.361221 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ed3f915f-24d9-4583-805d-d88b5e01c2c6 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:53.361684 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ed3f915f-24d9-4583-805d-d88b5e01c2c6 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:53.362457 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ed3f915f-24d9-4583-805d-d88b5e01c2c6 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:53.362913 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ed3f915f-24d9-4583-805d-d88b5e01c2c6 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:53.363333 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ed3f915f-24d9-4583-805d-d88b5e01c2c6 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:53.369544 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-294c663b-67b0-42ce-b874-606a35eac55e tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:53.369544 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-294c663b-67b0-42ce-b874-606a35eac55e tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] [instance: 8ebd67c2-b4d9-4e1b-9946-c8e05013170d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:53.374712 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-294c663b-67b0-42ce-b874-606a35eac55e tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:53.375202 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-294c663b-67b0-42ce-b874-606a35eac55e tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:53.375631 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-294c663b-67b0-42ce-b874-606a35eac55e tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:53.376319 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-294c663b-67b0-42ce-b874-606a35eac55e tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:53.376918 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-294c663b-67b0-42ce-b874-606a35eac55e tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:53.377363 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-294c663b-67b0-42ce-b874-606a35eac55e tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:53.412646 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-294c663b-67b0-42ce-b874-606a35eac55e tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:53.413273 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-294c663b-67b0-42ce-b874-606a35eac55e tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:53.413750 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-294c663b-67b0-42ce-b874-606a35eac55e tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:53.414207 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-294c663b-67b0-42ce-b874-606a35eac55e tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lazy-loading 'fault' on Instance uuid 8ebd67c2-b4d9-4e1b-9946-c8e05013170d {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:17:53.571185 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ed3f915f-24d9-4583-805d-d88b5e01c2c6 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f11109f32d4013aed5ab9320d8295b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e2bdadb00745888a171041c5714bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:53.579439 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ed3f915f-24d9-4583-805d-d88b5e01c2c6 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] 10.222.0.13 "GET /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3" status: 200 len: 1524 microversion: 2.1 time: 0.229403 Oct 30 01:17:53.580042 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 638/1309] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:53 2022] GET /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3 => generated 1524 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:53.581069 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-294c663b-67b0-42ce-b874-606a35eac55e tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d87ef57cf344734b662bd792022c4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea74354a0b4753a363fc5d4f6d4f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:53.590437 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-294c663b-67b0-42ce-b874-606a35eac55e tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] 10.222.0.13 "GET /compute/v2.1/servers/8ebd67c2-b4d9-4e1b-9946-c8e05013170d" status: 200 len: 1458 microversion: 2.1 time: 0.226932 Oct 30 01:17:53.597139 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-69213493-6e61-4d11-b66b-7f137a1e2996 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:53.597892 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-69213493-6e61-4d11-b66b-7f137a1e2996 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:53.598947 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 672/1310] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:53 2022] GET /compute/v2.1/servers/8ebd67c2-b4d9-4e1b-9946-c8e05013170d => generated 1458 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:17:53.606535 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-69213493-6e61-4d11-b66b-7f137a1e2996 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:53.607440 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-69213493-6e61-4d11-b66b-7f137a1e2996 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:53.608162 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-69213493-6e61-4d11-b66b-7f137a1e2996 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:53.609390 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-69213493-6e61-4d11-b66b-7f137a1e2996 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:53.610179 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-69213493-6e61-4d11-b66b-7f137a1e2996 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:53.610891 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-69213493-6e61-4d11-b66b-7f137a1e2996 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:53.751733 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-69213493-6e61-4d11-b66b-7f137a1e2996 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:53.759623 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-69213493-6e61-4d11-b66b-7f137a1e2996 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1470 microversion: 2.1 time: 0.168084 Oct 30 01:17:53.760250 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 639/1311] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:53 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1470 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:17:53.783396 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e36d49f5-5df1-4b7d-9002-c1833ede17fa tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:53.783924 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e36d49f5-5df1-4b7d-9002-c1833ede17fa tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:53.791030 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e36d49f5-5df1-4b7d-9002-c1833ede17fa tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:53.791514 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e36d49f5-5df1-4b7d-9002-c1833ede17fa tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:53.791947 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e36d49f5-5df1-4b7d-9002-c1833ede17fa tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:53.792645 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e36d49f5-5df1-4b7d-9002-c1833ede17fa tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:53.793094 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e36d49f5-5df1-4b7d-9002-c1833ede17fa tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:53.793558 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e36d49f5-5df1-4b7d-9002-c1833ede17fa tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:53.979733 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e36d49f5-5df1-4b7d-9002-c1833ede17fa tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "POST /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5/action" status: 204 len: 0 microversion: 2.1 time: 0.199943 Oct 30 01:17:53.980437 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 673/1312] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:17:53 2022] POST /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5/action => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:17:53.988661 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-665552e4-b44b-4318-a0d6-0411a9f9da8d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:53.989328 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-665552e4-b44b-4318-a0d6-0411a9f9da8d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:53.995393 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-665552e4-b44b-4318-a0d6-0411a9f9da8d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:53.995875 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-665552e4-b44b-4318-a0d6-0411a9f9da8d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:53.996364 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-665552e4-b44b-4318-a0d6-0411a9f9da8d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:53.997036 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-665552e4-b44b-4318-a0d6-0411a9f9da8d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:53.997519 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-665552e4-b44b-4318-a0d6-0411a9f9da8d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:53.997936 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-665552e4-b44b-4318-a0d6-0411a9f9da8d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:54.003496 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8fa12217-78d5-4326-9149-0b39f2b02e83 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:54.004280 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8fa12217-78d5-4326-9149-0b39f2b02e83 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:54.010666 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8fa12217-78d5-4326-9149-0b39f2b02e83 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:54.011157 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8fa12217-78d5-4326-9149-0b39f2b02e83 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:54.011641 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8fa12217-78d5-4326-9149-0b39f2b02e83 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:54.012358 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8fa12217-78d5-4326-9149-0b39f2b02e83 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:54.012816 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8fa12217-78d5-4326-9149-0b39f2b02e83 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:54.013387 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8fa12217-78d5-4326-9149-0b39f2b02e83 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:54.201463 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-665552e4-b44b-4318-a0d6-0411a9f9da8d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:54.204526 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8fa12217-78d5-4326-9149-0b39f2b02e83 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:54.211220 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-665552e4-b44b-4318-a0d6-0411a9f9da8d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1470 microversion: 2.1 time: 0.226217 Oct 30 01:17:54.213548 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8fa12217-78d5-4326-9149-0b39f2b02e83 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1472 microversion: 2.1 time: 0.214340 Oct 30 01:17:54.214118 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 674/1313] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:53 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1472 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:17:54.221450 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 640/1314] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:53 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1470 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:54.224249 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-43a3b799-1b05-40df-9df4-401e2b959489 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:54.231448 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-43a3b799-1b05-40df-9df4-401e2b959489 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 5904b0d2-fd7a-4f0e-92b9-757c056620fc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:54.232552 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-43a3b799-1b05-40df-9df4-401e2b959489 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:54.233035 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-43a3b799-1b05-40df-9df4-401e2b959489 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:54.233684 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-43a3b799-1b05-40df-9df4-401e2b959489 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:54.234391 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-43a3b799-1b05-40df-9df4-401e2b959489 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:54.234837 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-43a3b799-1b05-40df-9df4-401e2b959489 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:54.235250 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-43a3b799-1b05-40df-9df4-401e2b959489 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:54.238810 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7df3e31c-920c-4003-a7e9-d281a6f35fe8 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:54.239799 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7df3e31c-920c-4003-a7e9-d281a6f35fe8 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:54.247105 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7df3e31c-920c-4003-a7e9-d281a6f35fe8 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:54.247605 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7df3e31c-920c-4003-a7e9-d281a6f35fe8 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:54.248045 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7df3e31c-920c-4003-a7e9-d281a6f35fe8 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:54.249285 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7df3e31c-920c-4003-a7e9-d281a6f35fe8 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:54.249772 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7df3e31c-920c-4003-a7e9-d281a6f35fe8 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:54.250394 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7df3e31c-920c-4003-a7e9-d281a6f35fe8 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:54.302714 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-43a3b799-1b05-40df-9df4-401e2b959489 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:54.310674 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-43a3b799-1b05-40df-9df4-401e2b959489 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/5904b0d2-fd7a-4f0e-92b9-757c056620fc" status: 200 len: 1221 microversion: 2.1 time: 0.095360 Oct 30 01:17:54.311253 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 675/1315] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:54 2022] GET /compute/v2.1/servers/5904b0d2-fd7a-4f0e-92b9-757c056620fc => generated 1221 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:54.316097 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9b6243e0-f08e-43d3-b01a-bdc0ca22fa12 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:54.318940 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9b6243e0-f08e-43d3-b01a-bdc0ca22fa12 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:54.324800 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b6243e0-f08e-43d3-b01a-bdc0ca22fa12 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:54.325275 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b6243e0-f08e-43d3-b01a-bdc0ca22fa12 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:54.325733 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b6243e0-f08e-43d3-b01a-bdc0ca22fa12 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:54.326421 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b6243e0-f08e-43d3-b01a-bdc0ca22fa12 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:54.326871 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b6243e0-f08e-43d3-b01a-bdc0ca22fa12 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:54.327283 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b6243e0-f08e-43d3-b01a-bdc0ca22fa12 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:54.331241 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:17:54.360479 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9b6243e0-f08e-43d3-b01a-bdc0ca22fa12 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048172 Oct 30 01:17:54.365256 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 676/1316] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 01:17:54 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:17:54.400304 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7df3e31c-920c-4003-a7e9-d281a6f35fe8 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:54.409127 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7df3e31c-920c-4003-a7e9-d281a6f35fe8 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:54.410611 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7df3e31c-920c-4003-a7e9-d281a6f35fe8 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:54.411839 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7df3e31c-920c-4003-a7e9-d281a6f35fe8 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 200 len: 1813 microversion: 2.25 time: 0.178374 Oct 30 01:17:54.412407 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 641/1317] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:17:54 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 1813 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:17:54.603305 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f00af818-bb80-4e5f-bfa9-229ed0a770fd tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:54.604115 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f00af818-bb80-4e5f-bfa9-229ed0a770fd tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: e19edf61-5458-4f12-84b2-346b41506ff3] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:54.611316 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f00af818-bb80-4e5f-bfa9-229ed0a770fd tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:54.611899 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f00af818-bb80-4e5f-bfa9-229ed0a770fd tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:54.612402 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f00af818-bb80-4e5f-bfa9-229ed0a770fd tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:54.613171 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f00af818-bb80-4e5f-bfa9-229ed0a770fd tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:54.613580 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-85dfaf8a-9412-4f12-8640-ea2c01fce301 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:54.613791 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f00af818-bb80-4e5f-bfa9-229ed0a770fd tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:54.614195 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-85dfaf8a-9412-4f12-8640-ea2c01fce301 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] [instance: 8ebd67c2-b4d9-4e1b-9946-c8e05013170d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:54.614362 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f00af818-bb80-4e5f-bfa9-229ed0a770fd tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:54.638124 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-85dfaf8a-9412-4f12-8640-ea2c01fce301 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:54.638570 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-85dfaf8a-9412-4f12-8640-ea2c01fce301 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:54.639017 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-85dfaf8a-9412-4f12-8640-ea2c01fce301 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:54.639732 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-85dfaf8a-9412-4f12-8640-ea2c01fce301 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:54.640185 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-85dfaf8a-9412-4f12-8640-ea2c01fce301 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:54.640608 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-85dfaf8a-9412-4f12-8640-ea2c01fce301 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:54.673712 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-85dfaf8a-9412-4f12-8640-ea2c01fce301 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:54.674197 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-85dfaf8a-9412-4f12-8640-ea2c01fce301 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:54.674638 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-85dfaf8a-9412-4f12-8640-ea2c01fce301 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:54.675097 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-85dfaf8a-9412-4f12-8640-ea2c01fce301 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lazy-loading 'fault' on Instance uuid 8ebd67c2-b4d9-4e1b-9946-c8e05013170d {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:17:54.864196 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f00af818-bb80-4e5f-bfa9-229ed0a770fd tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f11109f32d4013aed5ab9320d8295b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e2bdadb00745888a171041c5714bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:54.873308 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f00af818-bb80-4e5f-bfa9-229ed0a770fd tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] 10.222.0.13 "GET /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3" status: 200 len: 1524 microversion: 2.1 time: 0.273817 Oct 30 01:17:54.873915 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 677/1318] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:54 2022] GET /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3 => generated 1524 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:54.885126 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-85dfaf8a-9412-4f12-8640-ea2c01fce301 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d87ef57cf344734b662bd792022c4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea74354a0b4753a363fc5d4f6d4f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:54.894847 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-85dfaf8a-9412-4f12-8640-ea2c01fce301 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] 10.222.0.13 "GET /compute/v2.1/servers/8ebd67c2-b4d9-4e1b-9946-c8e05013170d" status: 200 len: 1458 microversion: 2.1 time: 0.285611 Oct 30 01:17:54.895442 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 642/1319] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:54 2022] GET /compute/v2.1/servers/8ebd67c2-b4d9-4e1b-9946-c8e05013170d => generated 1458 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:55.234620 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3eec9194-871f-4f46-8006-df4217ef9b79 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:55.235230 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3eec9194-871f-4f46-8006-df4217ef9b79 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:55.239759 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4c00ffc0-c924-4efc-b94b-1bdc1d47a051 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:55.241814 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4c00ffc0-c924-4efc-b94b-1bdc1d47a051 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:55.242634 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3eec9194-871f-4f46-8006-df4217ef9b79 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:55.243119 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3eec9194-871f-4f46-8006-df4217ef9b79 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:55.243545 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3eec9194-871f-4f46-8006-df4217ef9b79 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:55.244429 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3eec9194-871f-4f46-8006-df4217ef9b79 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:55.245197 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3eec9194-871f-4f46-8006-df4217ef9b79 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:55.245643 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3eec9194-871f-4f46-8006-df4217ef9b79 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:55.248217 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4c00ffc0-c924-4efc-b94b-1bdc1d47a051 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:55.248712 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4c00ffc0-c924-4efc-b94b-1bdc1d47a051 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:55.249147 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4c00ffc0-c924-4efc-b94b-1bdc1d47a051 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:55.250050 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4c00ffc0-c924-4efc-b94b-1bdc1d47a051 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:55.250522 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4c00ffc0-c924-4efc-b94b-1bdc1d47a051 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:55.251250 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4c00ffc0-c924-4efc-b94b-1bdc1d47a051 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:55.950178 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4c00ffc0-c924-4efc-b94b-1bdc1d47a051 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:55.960316 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4c00ffc0-c924-4efc-b94b-1bdc1d47a051 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1472 microversion: 2.1 time: 0.723254 Oct 30 01:17:55.960921 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 643/1320] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:55 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1472 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:55.977283 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bb72dbc0-18e6-4dfa-9a27-f7f6f6bb2d89 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:55.978196 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-bb72dbc0-18e6-4dfa-9a27-f7f6f6bb2d89 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 5904b0d2-fd7a-4f0e-92b9-757c056620fc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:55.990600 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb72dbc0-18e6-4dfa-9a27-f7f6f6bb2d89 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:55.991371 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb72dbc0-18e6-4dfa-9a27-f7f6f6bb2d89 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:55.992004 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb72dbc0-18e6-4dfa-9a27-f7f6f6bb2d89 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:55.992868 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb72dbc0-18e6-4dfa-9a27-f7f6f6bb2d89 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:55.993516 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb72dbc0-18e6-4dfa-9a27-f7f6f6bb2d89 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:55.994096 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb72dbc0-18e6-4dfa-9a27-f7f6f6bb2d89 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:56.206450 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-bb72dbc0-18e6-4dfa-9a27-f7f6f6bb2d89 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:56.216222 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3eec9194-871f-4f46-8006-df4217ef9b79 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:56.239734 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3eec9194-871f-4f46-8006-df4217ef9b79 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1470 microversion: 2.1 time: 0.995374 Oct 30 01:17:56.241030 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bb72dbc0-18e6-4dfa-9a27-f7f6f6bb2d89 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/5904b0d2-fd7a-4f0e-92b9-757c056620fc" status: 200 len: 1269 microversion: 2.1 time: 0.263339 Oct 30 01:17:56.241412 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 678/1321] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:55 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1470 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:56.241740 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 644/1322] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:55 2022] GET /compute/v2.1/servers/5904b0d2-fd7a-4f0e-92b9-757c056620fc => generated 1269 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:56.241740 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-36cd4b05-6f60-4cb5-a128-238ed0b48a88 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:56.241740 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-36cd4b05-6f60-4cb5-a128-238ed0b48a88 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:56.241740 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-36cd4b05-6f60-4cb5-a128-238ed0b48a88 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:56.242257 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-36cd4b05-6f60-4cb5-a128-238ed0b48a88 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:56.242752 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-36cd4b05-6f60-4cb5-a128-238ed0b48a88 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:56.243570 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-36cd4b05-6f60-4cb5-a128-238ed0b48a88 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:56.246554 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-36cd4b05-6f60-4cb5-a128-238ed0b48a88 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:56.246554 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-36cd4b05-6f60-4cb5-a128-238ed0b48a88 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:56.250494 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bed60d6d-cf7d-4a42-b3a0-44de36e5508c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:56.252902 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bed60d6d-cf7d-4a42-b3a0-44de36e5508c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:56.260763 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bed60d6d-cf7d-4a42-b3a0-44de36e5508c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:56.261530 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bed60d6d-cf7d-4a42-b3a0-44de36e5508c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:56.262116 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bed60d6d-cf7d-4a42-b3a0-44de36e5508c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:56.263016 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bed60d6d-cf7d-4a42-b3a0-44de36e5508c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:56.263729 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bed60d6d-cf7d-4a42-b3a0-44de36e5508c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:56.264300 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bed60d6d-cf7d-4a42-b3a0-44de36e5508c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:56.310630 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bed60d6d-cf7d-4a42-b3a0-44de36e5508c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067381 Oct 30 01:17:56.311683 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 679/1323] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 01:17:56 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:17:56.316948 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-3910a92e-b505-425b-81d1-10285d1d7420 req-cfa9701c-444d-4be2-9927-e1193be3c9c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e19edf61-5458-4f12-84b2-346b41506ff3", "name": "network-vif-deleted", "tag": "dfced65c-3e28-40bf-b025-33cddcb37142"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:56.333283 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-3910a92e-b505-425b-81d1-10285d1d7420 req-cfa9701c-444d-4be2-9927-e1193be3c9c0 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:56.333283 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-3910a92e-b505-425b-81d1-10285d1d7420 req-cfa9701c-444d-4be2-9927-e1193be3c9c0 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:56.333283 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-3910a92e-b505-425b-81d1-10285d1d7420 req-cfa9701c-444d-4be2-9927-e1193be3c9c0 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:56.343014 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-3910a92e-b505-425b-81d1-10285d1d7420 req-cfa9701c-444d-4be2-9927-e1193be3c9c0 service nova] Creating event network-vif-deleted:dfced65c-3e28-40bf-b025-33cddcb37142 for instance e19edf61-5458-4f12-84b2-346b41506ff3 on n-h1-master-1 Oct 30 01:17:56.348253 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-3910a92e-b505-425b-81d1-10285d1d7420 req-cfa9701c-444d-4be2-9927-e1193be3c9c0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035283 Oct 30 01:17:56.349039 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 680/1324] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:17:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:17:56.357207 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-c44c4085-2b88-4c9e-ab86-7f2c04c3edd8 req-9eb87c74-4970-4655-97aa-777db367913e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76c32172-798a-49f6-8247-6f86860dbdc5", "name": "network-vif-plugged", "status": "completed", "tag": "e96e6262-0ade-4db0-aeff-c6471cd42e45"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:56.370016 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-c44c4085-2b88-4c9e-ab86-7f2c04c3edd8 req-9eb87c74-4970-4655-97aa-777db367913e service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:56.370937 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-c44c4085-2b88-4c9e-ab86-7f2c04c3edd8 req-9eb87c74-4970-4655-97aa-777db367913e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:56.371640 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-c44c4085-2b88-4c9e-ab86-7f2c04c3edd8 req-9eb87c74-4970-4655-97aa-777db367913e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:56.385617 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-c44c4085-2b88-4c9e-ab86-7f2c04c3edd8 req-9eb87c74-4970-4655-97aa-777db367913e service nova] Creating event network-vif-plugged:e96e6262-0ade-4db0-aeff-c6471cd42e45 for instance 76c32172-798a-49f6-8247-6f86860dbdc5 on n-h1-master-1 Oct 30 01:17:56.393374 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [req-c44c4085-2b88-4c9e-ab86-7f2c04c3edd8 req-9eb87c74-4970-4655-97aa-777db367913e service nova] Instance 76c32172-798a-49f6-8247-6f86860dbdc5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1'} {{(pid=121102) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 30 01:17:56.405891 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-c44c4085-2b88-4c9e-ab86-7f2c04c3edd8 req-9eb87c74-4970-4655-97aa-777db367913e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054510 Oct 30 01:17:56.406842 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 681/1325] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:17:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:17:56.416369 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-49e06aa2-11ba-477b-8b3e-afa4bc0ddd45 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:56.418175 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-49e06aa2-11ba-477b-8b3e-afa4bc0ddd45 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: e19edf61-5458-4f12-84b2-346b41506ff3] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:56.428444 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-49e06aa2-11ba-477b-8b3e-afa4bc0ddd45 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:56.431107 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-49e06aa2-11ba-477b-8b3e-afa4bc0ddd45 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:56.431107 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-49e06aa2-11ba-477b-8b3e-afa4bc0ddd45 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:56.431107 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-49e06aa2-11ba-477b-8b3e-afa4bc0ddd45 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:56.431107 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-49e06aa2-11ba-477b-8b3e-afa4bc0ddd45 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:56.432319 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-49e06aa2-11ba-477b-8b3e-afa4bc0ddd45 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:56.490804 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-49e06aa2-11ba-477b-8b3e-afa4bc0ddd45 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:56.491479 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-49e06aa2-11ba-477b-8b3e-afa4bc0ddd45 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:56.492165 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-49e06aa2-11ba-477b-8b3e-afa4bc0ddd45 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:56.492832 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-49e06aa2-11ba-477b-8b3e-afa4bc0ddd45 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lazy-loading 'fault' on Instance uuid e19edf61-5458-4f12-84b2-346b41506ff3 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:17:56.612811 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-49e06aa2-11ba-477b-8b3e-afa4bc0ddd45 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f11109f32d4013aed5ab9320d8295b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e2bdadb00745888a171041c5714bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:56.626245 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-49e06aa2-11ba-477b-8b3e-afa4bc0ddd45 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] 10.222.0.13 "GET /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3" status: 200 len: 1313 microversion: 2.1 time: 0.217262 Oct 30 01:17:56.627376 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 682/1326] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:56 2022] GET /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3 => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:56.633513 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a69d7eea-6698-40c9-9b68-a4f9a6b30e82 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:56.634649 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a69d7eea-6698-40c9-9b68-a4f9a6b30e82 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] [instance: 8ebd67c2-b4d9-4e1b-9946-c8e05013170d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:56.651484 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a69d7eea-6698-40c9-9b68-a4f9a6b30e82 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:56.652388 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a69d7eea-6698-40c9-9b68-a4f9a6b30e82 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:56.653071 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a69d7eea-6698-40c9-9b68-a4f9a6b30e82 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:56.654146 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a69d7eea-6698-40c9-9b68-a4f9a6b30e82 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:56.654854 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a69d7eea-6698-40c9-9b68-a4f9a6b30e82 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:56.655431 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a69d7eea-6698-40c9-9b68-a4f9a6b30e82 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:56.712041 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a69d7eea-6698-40c9-9b68-a4f9a6b30e82 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:56.712539 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a69d7eea-6698-40c9-9b68-a4f9a6b30e82 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:56.712980 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a69d7eea-6698-40c9-9b68-a4f9a6b30e82 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:56.714066 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-a69d7eea-6698-40c9-9b68-a4f9a6b30e82 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lazy-loading 'fault' on Instance uuid 8ebd67c2-b4d9-4e1b-9946-c8e05013170d {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:17:56.778762 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-36cd4b05-6f60-4cb5-a128-238ed0b48a88 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:56.793898 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-36cd4b05-6f60-4cb5-a128-238ed0b48a88 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:56.795602 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-36cd4b05-6f60-4cb5-a128-238ed0b48a88 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:56.798564 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-36cd4b05-6f60-4cb5-a128-238ed0b48a88 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 200 len: 1813 microversion: 2.25 time: 0.569127 Oct 30 01:17:56.817710 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 645/1327] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:17:56 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 1813 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:17:56.981567 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a69d7eea-6698-40c9-9b68-a4f9a6b30e82 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d87ef57cf344734b662bd792022c4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea74354a0b4753a363fc5d4f6d4f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:56.985881 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-31ed3ab7-bb54-47a7-a4ec-f69737919184 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:56.986942 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-31ed3ab7-bb54-47a7-a4ec-f69737919184 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:56.989301 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:17:56.997783 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a69d7eea-6698-40c9-9b68-a4f9a6b30e82 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] 10.222.0.13 "GET /compute/v2.1/servers/8ebd67c2-b4d9-4e1b-9946-c8e05013170d" status: 200 len: 1458 microversion: 2.1 time: 0.360915 Oct 30 01:17:56.998749 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 683/1328] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:56 2022] GET /compute/v2.1/servers/8ebd67c2-b4d9-4e1b-9946-c8e05013170d => generated 1458 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:56.999769 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-31ed3ab7-bb54-47a7-a4ec-f69737919184 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:57.009112 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-31ed3ab7-bb54-47a7-a4ec-f69737919184 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:57.009918 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-31ed3ab7-bb54-47a7-a4ec-f69737919184 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:57.013952 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-31ed3ab7-bb54-47a7-a4ec-f69737919184 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:57.014657 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-31ed3ab7-bb54-47a7-a4ec-f69737919184 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:57.015307 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-31ed3ab7-bb54-47a7-a4ec-f69737919184 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:57.253144 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-48e0e310-6db1-4436-a8d2-fa698dc4d0f2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:57.254952 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-48e0e310-6db1-4436-a8d2-fa698dc4d0f2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:57.262800 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-48e0e310-6db1-4436-a8d2-fa698dc4d0f2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:57.263290 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-48e0e310-6db1-4436-a8d2-fa698dc4d0f2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:57.263742 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-48e0e310-6db1-4436-a8d2-fa698dc4d0f2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:57.264727 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-48e0e310-6db1-4436-a8d2-fa698dc4d0f2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:57.265567 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-48e0e310-6db1-4436-a8d2-fa698dc4d0f2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:57.266151 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-48e0e310-6db1-4436-a8d2-fa698dc4d0f2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:57.616369 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-48e0e310-6db1-4436-a8d2-fa698dc4d0f2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:57.620620 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-31ed3ab7-bb54-47a7-a4ec-f69737919184 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:57.625770 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-48e0e310-6db1-4436-a8d2-fa698dc4d0f2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1470 microversion: 2.1 time: 0.376938 Oct 30 01:17:57.626729 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 684/1329] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:57 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1470 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:17:57.630427 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-31ed3ab7-bb54-47a7-a4ec-f69737919184 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1472 microversion: 2.1 time: 0.650308 Oct 30 01:17:57.645373 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 646/1330] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:56 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1472 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:17:57.645633 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1aa8b3d3-7610-484c-b938-3799aac01931 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:57.645633 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1aa8b3d3-7610-484c-b938-3799aac01931 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 5904b0d2-fd7a-4f0e-92b9-757c056620fc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:57.645844 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-54e75a08-58f5-491f-8572-81fa881bc6a5 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:57.648795 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-54e75a08-58f5-491f-8572-81fa881bc6a5 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:57.649650 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1aa8b3d3-7610-484c-b938-3799aac01931 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:57.650160 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1aa8b3d3-7610-484c-b938-3799aac01931 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:57.650601 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1aa8b3d3-7610-484c-b938-3799aac01931 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:57.651597 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1aa8b3d3-7610-484c-b938-3799aac01931 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:57.652544 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1aa8b3d3-7610-484c-b938-3799aac01931 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:57.652544 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1aa8b3d3-7610-484c-b938-3799aac01931 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:57.656535 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-54e75a08-58f5-491f-8572-81fa881bc6a5 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:57.657178 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-54e75a08-58f5-491f-8572-81fa881bc6a5 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:57.657756 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-54e75a08-58f5-491f-8572-81fa881bc6a5 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:57.658601 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-54e75a08-58f5-491f-8572-81fa881bc6a5 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:57.659166 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-54e75a08-58f5-491f-8572-81fa881bc6a5 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:57.659692 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-54e75a08-58f5-491f-8572-81fa881bc6a5 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:57.696855 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-54e75a08-58f5-491f-8572-81fa881bc6a5 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063623 Oct 30 01:17:57.701373 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 647/1331] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 01:17:57 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:17:57.706148 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-b2533373-3ff3-4dc3-acae-7a4c0ae048a7 req-9cd75149-5dfb-4a46-ac77-694037f2e414 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ebd67c2-b4d9-4e1b-9946-c8e05013170d", "name": "network-vif-deleted", "tag": "12167317-3164-48af-bd53-4155aaa88a38"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:17:57.716029 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-b2533373-3ff3-4dc3-acae-7a4c0ae048a7 req-9cd75149-5dfb-4a46-ac77-694037f2e414 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:57.716522 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-b2533373-3ff3-4dc3-acae-7a4c0ae048a7 req-9cd75149-5dfb-4a46-ac77-694037f2e414 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:57.716950 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-b2533373-3ff3-4dc3-acae-7a4c0ae048a7 req-9cd75149-5dfb-4a46-ac77-694037f2e414 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:57.729228 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-b2533373-3ff3-4dc3-acae-7a4c0ae048a7 req-9cd75149-5dfb-4a46-ac77-694037f2e414 service nova] Creating event network-vif-deleted:12167317-3164-48af-bd53-4155aaa88a38 for instance 8ebd67c2-b4d9-4e1b-9946-c8e05013170d on n-h1-master-1 Oct 30 01:17:57.734528 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-b2533373-3ff3-4dc3-acae-7a4c0ae048a7 req-9cd75149-5dfb-4a46-ac77-694037f2e414 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031896 Oct 30 01:17:57.735397 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 648/1332] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:17:57.735727 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1aa8b3d3-7610-484c-b938-3799aac01931 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:57.741160 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d49462b0-2380-4428-8f6f-a584b92f78b3 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:57.741887 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d49462b0-2380-4428-8f6f-a584b92f78b3 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: e19edf61-5458-4f12-84b2-346b41506ff3] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:57.745009 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1aa8b3d3-7610-484c-b938-3799aac01931 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/5904b0d2-fd7a-4f0e-92b9-757c056620fc" status: 200 len: 1275 microversion: 2.1 time: 0.116886 Oct 30 01:17:57.746594 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 685/1333] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:57 2022] GET /compute/v2.1/servers/5904b0d2-fd7a-4f0e-92b9-757c056620fc => generated 1275 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:57.758004 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d49462b0-2380-4428-8f6f-a584b92f78b3 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:57.758496 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d49462b0-2380-4428-8f6f-a584b92f78b3 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:57.758933 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d49462b0-2380-4428-8f6f-a584b92f78b3 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:57.762371 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d49462b0-2380-4428-8f6f-a584b92f78b3 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:57.762371 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d49462b0-2380-4428-8f6f-a584b92f78b3 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:57.762371 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d49462b0-2380-4428-8f6f-a584b92f78b3 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:57.792908 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d49462b0-2380-4428-8f6f-a584b92f78b3 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:57.793411 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d49462b0-2380-4428-8f6f-a584b92f78b3 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:57.793855 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d49462b0-2380-4428-8f6f-a584b92f78b3 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:57.794286 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-d49462b0-2380-4428-8f6f-a584b92f78b3 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lazy-loading 'fault' on Instance uuid e19edf61-5458-4f12-84b2-346b41506ff3 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:17:57.825687 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-08e8c159-ba58-4841-acf9-75fdf26cc75e tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:57.826369 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-08e8c159-ba58-4841-acf9-75fdf26cc75e tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:57.834004 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08e8c159-ba58-4841-acf9-75fdf26cc75e tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:57.834419 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08e8c159-ba58-4841-acf9-75fdf26cc75e tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:57.834848 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08e8c159-ba58-4841-acf9-75fdf26cc75e tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:57.835553 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08e8c159-ba58-4841-acf9-75fdf26cc75e tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:57.835985 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08e8c159-ba58-4841-acf9-75fdf26cc75e tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:57.836401 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08e8c159-ba58-4841-acf9-75fdf26cc75e tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:57.935001 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d49462b0-2380-4428-8f6f-a584b92f78b3 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f11109f32d4013aed5ab9320d8295b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e2bdadb00745888a171041c5714bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:57.944929 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d49462b0-2380-4428-8f6f-a584b92f78b3 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] 10.222.0.13 "GET /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3" status: 200 len: 1487 microversion: 2.1 time: 0.208514 Oct 30 01:17:57.945646 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 649/1334] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:57 2022] GET /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3 => generated 1487 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:58.025648 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-79d4f21b-82b2-4215-a9b4-4043b5ae8d50 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:58.026579 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-79d4f21b-82b2-4215-a9b4-4043b5ae8d50 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] [instance: 8ebd67c2-b4d9-4e1b-9946-c8e05013170d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:58.033531 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-79d4f21b-82b2-4215-a9b4-4043b5ae8d50 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:58.034400 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-79d4f21b-82b2-4215-a9b4-4043b5ae8d50 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:58.035022 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-79d4f21b-82b2-4215-a9b4-4043b5ae8d50 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:58.036016 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-79d4f21b-82b2-4215-a9b4-4043b5ae8d50 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:58.036704 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-79d4f21b-82b2-4215-a9b4-4043b5ae8d50 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:58.038028 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-79d4f21b-82b2-4215-a9b4-4043b5ae8d50 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:58.093723 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-79d4f21b-82b2-4215-a9b4-4043b5ae8d50 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:58.095199 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-79d4f21b-82b2-4215-a9b4-4043b5ae8d50 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:58.096084 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-79d4f21b-82b2-4215-a9b4-4043b5ae8d50 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:58.097074 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-79d4f21b-82b2-4215-a9b4-4043b5ae8d50 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lazy-loading 'fault' on Instance uuid 8ebd67c2-b4d9-4e1b-9946-c8e05013170d {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:17:58.116108 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-08e8c159-ba58-4841-acf9-75fdf26cc75e tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:58.129457 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-08e8c159-ba58-4841-acf9-75fdf26cc75e tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:58.132627 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-08e8c159-ba58-4841-acf9-75fdf26cc75e tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:58.134251 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-08e8c159-ba58-4841-acf9-75fdf26cc75e tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 200 len: 1813 microversion: 2.25 time: 0.313022 Oct 30 01:17:58.145591 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 686/1335] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:17:57 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 1813 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:17:58.149979 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-79d4f21b-82b2-4215-a9b4-4043b5ae8d50 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d87ef57cf344734b662bd792022c4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea74354a0b4753a363fc5d4f6d4f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:58.158781 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-79d4f21b-82b2-4215-a9b4-4043b5ae8d50 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] 10.222.0.13 "GET /compute/v2.1/servers/8ebd67c2-b4d9-4e1b-9946-c8e05013170d" status: 200 len: 1287 microversion: 2.1 time: 0.138096 Oct 30 01:17:58.162810 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 650/1336] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:58 2022] GET /compute/v2.1/servers/8ebd67c2-b4d9-4e1b-9946-c8e05013170d => generated 1287 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:58.651541 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f507b4c6-82b0-4054-8f9b-91aca4acc444 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:58.654813 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f507b4c6-82b0-4054-8f9b-91aca4acc444 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:58.655610 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1242efd1-967c-414a-a148-a2c9cf0cdffd tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:58.656561 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1242efd1-967c-414a-a148-a2c9cf0cdffd tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:58.668236 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1242efd1-967c-414a-a148-a2c9cf0cdffd tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:58.668728 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1242efd1-967c-414a-a148-a2c9cf0cdffd tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:58.669400 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f507b4c6-82b0-4054-8f9b-91aca4acc444 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:58.670299 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f507b4c6-82b0-4054-8f9b-91aca4acc444 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:58.670772 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1242efd1-967c-414a-a148-a2c9cf0cdffd tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:58.671327 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f507b4c6-82b0-4054-8f9b-91aca4acc444 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:58.671531 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1242efd1-967c-414a-a148-a2c9cf0cdffd tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:58.671999 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1242efd1-967c-414a-a148-a2c9cf0cdffd tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:58.672422 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1242efd1-967c-414a-a148-a2c9cf0cdffd tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:58.672898 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f507b4c6-82b0-4054-8f9b-91aca4acc444 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:58.673759 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f507b4c6-82b0-4054-8f9b-91aca4acc444 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:58.675434 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f507b4c6-82b0-4054-8f9b-91aca4acc444 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:59.074396 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f507b4c6-82b0-4054-8f9b-91aca4acc444 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:59.082009 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1242efd1-967c-414a-a148-a2c9cf0cdffd tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:59.091489 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f507b4c6-82b0-4054-8f9b-91aca4acc444 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1470 microversion: 2.1 time: 0.445184 Oct 30 01:17:59.097922 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1242efd1-967c-414a-a148-a2c9cf0cdffd tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1472 microversion: 2.1 time: 0.446365 Oct 30 01:17:59.098120 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 687/1337] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:58 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1470 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:59.099544 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 651/1338] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:58 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1472 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:17:59.104345 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6b1523bb-cabd-436e-868e-708314a6a7f6 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:59.105115 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9ab9fd4a-8d7d-4a41-9933-652774ff80ae tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:59.108181 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9ab9fd4a-8d7d-4a41-9933-652774ff80ae tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:59.109456 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6b1523bb-cabd-436e-868e-708314a6a7f6 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 5904b0d2-fd7a-4f0e-92b9-757c056620fc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:59.119415 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9ab9fd4a-8d7d-4a41-9933-652774ff80ae tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:59.120253 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9ab9fd4a-8d7d-4a41-9933-652774ff80ae tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:59.120695 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9ab9fd4a-8d7d-4a41-9933-652774ff80ae tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:59.121443 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9ab9fd4a-8d7d-4a41-9933-652774ff80ae tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:59.122034 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9ab9fd4a-8d7d-4a41-9933-652774ff80ae tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:59.122460 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9ab9fd4a-8d7d-4a41-9933-652774ff80ae tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:59.124919 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6b1523bb-cabd-436e-868e-708314a6a7f6 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:59.125460 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6b1523bb-cabd-436e-868e-708314a6a7f6 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:59.126341 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6b1523bb-cabd-436e-868e-708314a6a7f6 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:59.127271 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6b1523bb-cabd-436e-868e-708314a6a7f6 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:59.129293 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6b1523bb-cabd-436e-868e-708314a6a7f6 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:59.129989 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6b1523bb-cabd-436e-868e-708314a6a7f6 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:59.162046 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9ab9fd4a-8d7d-4a41-9933-652774ff80ae tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061887 Oct 30 01:17:59.162709 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 688/1339] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 01:17:59 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:17:59.169402 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-934e7869-b20e-4d29-bce7-433293b07c52 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:59.172322 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-934e7869-b20e-4d29-bce7-433293b07c52 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] [instance: e19edf61-5458-4f12-84b2-346b41506ff3] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:59.178658 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-934e7869-b20e-4d29-bce7-433293b07c52 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:59.179536 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-934e7869-b20e-4d29-bce7-433293b07c52 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:59.180154 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-934e7869-b20e-4d29-bce7-433293b07c52 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:59.181671 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-934e7869-b20e-4d29-bce7-433293b07c52 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:59.182305 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-934e7869-b20e-4d29-bce7-433293b07c52 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:59.182983 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-934e7869-b20e-4d29-bce7-433293b07c52 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:59.202010 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-934e7869-b20e-4d29-bce7-433293b07c52 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] HTTP exception thrown: Instance e19edf61-5458-4f12-84b2-346b41506ff3 could not be found. Oct 30 01:17:59.204016 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-934e7869-b20e-4d29-bce7-433293b07c52 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Request method failure captured: Oct 30 01:17:59.204016 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3 HTTP/1.1 Oct 30 01:17:59.204016 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:17:59.204016 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:17:59.204016 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:17:59.204016 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:17:59.204016 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:17:59.204016 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:17:59.204016 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:17:59.204016 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:17:59.204016 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdByN13wkk5DgvOeo_jKNC9cRtQsQmiWI2QnB_9dRMHNp37q0W-3hZraYRC6GeA6h4hCxjm0IfbEaSK-OP5OJBCVSwbVJUgWSEjLc_h5yNX1yO4Fk_6a6z6rzb3cWwY4lnvNKUvFnNcTUcMPZOfShBnI6qh7TYPuSwAho1bqB7NHCE8 Oct 30 01:17:59.204016 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:17:59.204016 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:17:59.204016 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:17:59.204016 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:17:59.204016 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:17:59.204016 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:17:59.204016 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 10e2bdadb00745888a171041c5714bd9 Oct 30 01:17:59.204016 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1236579116 Oct 30 01:17:59.204016 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:17:59.204016 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:17:59.205781 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/10e2bdadb00745888a171041c5714bd9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_10e2bdadb00745888a171041c5714bd9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/10e2bdadb00745888a171041c5714bd9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/10e2bdadb00745888a171041c5714bd9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:17:59.205781 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1236579116 Oct 30 01:17:59.205781 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 10e2bdadb00745888a171041c5714bd9 Oct 30 01:17:59.205781 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1236579116 Oct 30 01:17:59.205781 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-FloatingIPsAssociationTestJSON-1236579116-project Oct 30 01:17:59.205781 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:17:59.205781 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:17:59.205781 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 71f11109f32d4013aed5ab9320d8295b Oct 30 01:17:59.205781 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1236579116-project Oct 30 01:17:59.205781 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:17:59.205781 n-d-master-1 devstack@n-api.service[121102]: exception: Instance e19edf61-5458-4f12-84b2-346b41506ff3 could not be found. Oct 30 01:17:59.205781 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'e19edf61-5458-4f12-84b2-346b41506ff3'} Oct 30 01:17:59.206724 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:17:59.206724 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:17:59.206724 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:17:59.206724 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:17:59.206724 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:17:59.206724 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:17:59.206724 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:17:59.206724 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:17:59.206724 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:17:59.206724 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:17:59.206724 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e19edf61-5458-4f12-84b2-346b41506ff3 could not be found. Oct 30 01:17:59.206724 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:17:59.206724 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:17:59.206724 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:17:59.206724 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:17:59.206724 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:17:59.206724 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:17:59.206724 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:17:59.206724 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:17:59.206724 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:17:59.209228 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:17:59.209228 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:17:59.209228 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:17:59.209228 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:17:59.209228 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:17:59.209228 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:17:59.209228 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:17:59.209228 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e19edf61-5458-4f12-84b2-346b41506ff3 could not be found. Oct 30 01:17:59.209228 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:17:59.209228 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:17:59.209228 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:17:59.209228 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:17:59.209228 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:17:59.209228 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:17:59.209228 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:17:59.209228 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:17:59.209228 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e19edf61-5458-4f12-84b2-346b41506ff3 could not be found. Oct 30 01:17:59.209228 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:17:59.214562 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-934e7869-b20e-4d29-bce7-433293b07c52 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] Returning 404 to user: Instance e19edf61-5458-4f12-84b2-346b41506ff3 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:17:59.214562 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-934e7869-b20e-4d29-bce7-433293b07c52 tempest-FloatingIPsAssociationTestJSON-1236579116 tempest-FloatingIPsAssociationTestJSON-1236579116-project] 10.222.0.13 "GET /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3" status: 404 len: 111 microversion: 2.1 time: 0.047819 Oct 30 01:17:59.214562 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 689/1340] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:59 2022] GET /compute/v2.1/servers/e19edf61-5458-4f12-84b2-346b41506ff3 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:17:59.220195 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-780ed594-f612-4af0-9d34-d8cace68e06a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:59.221079 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-780ed594-f612-4af0-9d34-d8cace68e06a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:59.227834 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-780ed594-f612-4af0-9d34-d8cace68e06a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:59.229025 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-780ed594-f612-4af0-9d34-d8cace68e06a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:59.229785 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-780ed594-f612-4af0-9d34-d8cace68e06a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:59.231163 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-780ed594-f612-4af0-9d34-d8cace68e06a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:59.231837 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-780ed594-f612-4af0-9d34-d8cace68e06a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:59.232465 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-780ed594-f612-4af0-9d34-d8cace68e06a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:59.436385 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6b1523bb-cabd-436e-868e-708314a6a7f6 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:59.439459 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=100 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:17:59.446913 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6b1523bb-cabd-436e-868e-708314a6a7f6 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/5904b0d2-fd7a-4f0e-92b9-757c056620fc" status: 200 len: 1317 microversion: 2.1 time: 0.346077 Oct 30 01:17:59.453447 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 652/1341] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:59 2022] GET /compute/v2.1/servers/5904b0d2-fd7a-4f0e-92b9-757c056620fc => generated 1317 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:17:59.461517 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-10b8fc65-d4f7-4d79-b66a-cad21b5ff9c2 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:17:59.466219 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-10b8fc65-d4f7-4d79-b66a-cad21b5ff9c2 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] [instance: 8ebd67c2-b4d9-4e1b-9946-c8e05013170d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:17:59.481137 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-10b8fc65-d4f7-4d79-b66a-cad21b5ff9c2 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:59.483590 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-10b8fc65-d4f7-4d79-b66a-cad21b5ff9c2 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:59.488531 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-10b8fc65-d4f7-4d79-b66a-cad21b5ff9c2 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:59.489677 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-10b8fc65-d4f7-4d79-b66a-cad21b5ff9c2 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:59.490938 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-10b8fc65-d4f7-4d79-b66a-cad21b5ff9c2 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:59.494419 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-10b8fc65-d4f7-4d79-b66a-cad21b5ff9c2 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:59.594323 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-10b8fc65-d4f7-4d79-b66a-cad21b5ff9c2 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:17:59.594828 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-10b8fc65-d4f7-4d79-b66a-cad21b5ff9c2 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:17:59.597816 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-10b8fc65-d4f7-4d79-b66a-cad21b5ff9c2 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:17:59.598345 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-10b8fc65-d4f7-4d79-b66a-cad21b5ff9c2 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lazy-loading 'fault' on Instance uuid 8ebd67c2-b4d9-4e1b-9946-c8e05013170d {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:17:59.655515 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-780ed594-f612-4af0-9d34-d8cace68e06a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:59.670656 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-780ed594-f612-4af0-9d34-d8cace68e06a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:59.674735 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-780ed594-f612-4af0-9d34-d8cace68e06a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:59.679960 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-780ed594-f612-4af0-9d34-d8cace68e06a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 200 len: 1813 microversion: 2.25 time: 0.466240 Oct 30 01:17:59.683336 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 690/1342] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:17:59 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 1813 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:17:59.708062 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-10b8fc65-d4f7-4d79-b66a-cad21b5ff9c2 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d87ef57cf344734b662bd792022c4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feea74354a0b4753a363fc5d4f6d4f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:17:59.726008 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-10b8fc65-d4f7-4d79-b66a-cad21b5ff9c2 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] 10.222.0.13 "GET /compute/v2.1/servers/8ebd67c2-b4d9-4e1b-9946-c8e05013170d" status: 200 len: 1309 microversion: 2.1 time: 0.266163 Oct 30 01:17:59.737523 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 653/1343] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:17:59 2022] GET /compute/v2.1/servers/8ebd67c2-b4d9-4e1b-9946-c8e05013170d => generated 1309 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:00.115436 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d4553452-6479-4b03-b2e4-db9fd80b3fc8 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:00.116136 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d4553452-6479-4b03-b2e4-db9fd80b3fc8 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:00.126744 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1e7224db-6324-4156-ae9f-e1bde14755c1 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:00.127722 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1e7224db-6324-4156-ae9f-e1bde14755c1 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:00.134961 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4553452-6479-4b03-b2e4-db9fd80b3fc8 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:00.137175 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4553452-6479-4b03-b2e4-db9fd80b3fc8 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:00.137868 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1e7224db-6324-4156-ae9f-e1bde14755c1 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:00.138826 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4553452-6479-4b03-b2e4-db9fd80b3fc8 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:00.139500 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1e7224db-6324-4156-ae9f-e1bde14755c1 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:00.140288 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4553452-6479-4b03-b2e4-db9fd80b3fc8 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:00.140909 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1e7224db-6324-4156-ae9f-e1bde14755c1 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:00.142182 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1e7224db-6324-4156-ae9f-e1bde14755c1 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:00.142627 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4553452-6479-4b03-b2e4-db9fd80b3fc8 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:00.143240 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4553452-6479-4b03-b2e4-db9fd80b3fc8 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:00.143885 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1e7224db-6324-4156-ae9f-e1bde14755c1 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:00.149792 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1e7224db-6324-4156-ae9f-e1bde14755c1 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:00.466507 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1e7224db-6324-4156-ae9f-e1bde14755c1 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:00.473830 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d4553452-6479-4b03-b2e4-db9fd80b3fc8 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:00.479627 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1e7224db-6324-4156-ae9f-e1bde14755c1 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1472 microversion: 2.1 time: 0.357433 Oct 30 01:18:00.488824 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d4553452-6479-4b03-b2e4-db9fd80b3fc8 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1462 microversion: 2.1 time: 0.377252 Oct 30 01:18:00.490097 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 691/1344] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:00 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1462 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:00.491921 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 654/1345] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:00 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1472 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:00.495954 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d7bf5ae0-40aa-49cd-9ade-a40588505197 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:00.498296 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d7bf5ae0-40aa-49cd-9ade-a40588505197 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:00.512126 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7bf5ae0-40aa-49cd-9ade-a40588505197 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:00.512734 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7bf5ae0-40aa-49cd-9ade-a40588505197 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:00.513465 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7bf5ae0-40aa-49cd-9ade-a40588505197 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:00.514489 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7bf5ae0-40aa-49cd-9ade-a40588505197 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:00.515155 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7bf5ae0-40aa-49cd-9ade-a40588505197 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:00.515638 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7bf5ae0-40aa-49cd-9ade-a40588505197 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:00.516801 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ac4168a5-3c8c-4caa-9d90-b404b59b4209 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:00.518784 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ac4168a5-3c8c-4caa-9d90-b404b59b4209 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 5904b0d2-fd7a-4f0e-92b9-757c056620fc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:00.531785 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ac4168a5-3c8c-4caa-9d90-b404b59b4209 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:00.532478 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ac4168a5-3c8c-4caa-9d90-b404b59b4209 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:00.533527 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ac4168a5-3c8c-4caa-9d90-b404b59b4209 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:00.538914 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ac4168a5-3c8c-4caa-9d90-b404b59b4209 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:00.538914 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ac4168a5-3c8c-4caa-9d90-b404b59b4209 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:00.538914 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ac4168a5-3c8c-4caa-9d90-b404b59b4209 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:00.586926 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d7bf5ae0-40aa-49cd-9ade-a40588505197 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095344 Oct 30 01:18:00.588258 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 692/1346] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 01:18:00 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:18:00.593327 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c81a110a-3812-40f3-af6a-397d6928e589 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:00.593962 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c81a110a-3812-40f3-af6a-397d6928e589 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:00.600150 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c81a110a-3812-40f3-af6a-397d6928e589 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:00.600625 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c81a110a-3812-40f3-af6a-397d6928e589 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:00.601277 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c81a110a-3812-40f3-af6a-397d6928e589 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:00.602179 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c81a110a-3812-40f3-af6a-397d6928e589 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:00.602795 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c81a110a-3812-40f3-af6a-397d6928e589 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:00.603211 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c81a110a-3812-40f3-af6a-397d6928e589 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:00.904602 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c81a110a-3812-40f3-af6a-397d6928e589 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:00.919608 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:00.919608 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c81a110a-3812-40f3-af6a-397d6928e589 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1462 microversion: 2.1 time: 0.326887 Oct 30 01:18:00.919608 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 693/1347] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:00 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1462 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:00.919944 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ac4168a5-3c8c-4caa-9d90-b404b59b4209 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:00.922418 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a39e5c42-5b0b-4d62-a46e-5810eef72a90 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:00.923026 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a39e5c42-5b0b-4d62-a46e-5810eef72a90 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:00.928245 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ac4168a5-3c8c-4caa-9d90-b404b59b4209 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/5904b0d2-fd7a-4f0e-92b9-757c056620fc" status: 200 len: 1317 microversion: 2.1 time: 0.434661 Oct 30 01:18:00.928838 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 655/1348] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:00 2022] GET /compute/v2.1/servers/5904b0d2-fd7a-4f0e-92b9-757c056620fc => generated 1317 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:00.930756 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a39e5c42-5b0b-4d62-a46e-5810eef72a90 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:00.931310 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a39e5c42-5b0b-4d62-a46e-5810eef72a90 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:00.931733 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a39e5c42-5b0b-4d62-a46e-5810eef72a90 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:00.932534 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a39e5c42-5b0b-4d62-a46e-5810eef72a90 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:00.932974 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a39e5c42-5b0b-4d62-a46e-5810eef72a90 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:00.933425 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a39e5c42-5b0b-4d62-a46e-5810eef72a90 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:00.952230 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5038b0cb-6e9c-4e96-9da9-cb9f471f6617 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:00.952774 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5038b0cb-6e9c-4e96-9da9-cb9f471f6617 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] [instance: 8ebd67c2-b4d9-4e1b-9946-c8e05013170d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:00.969395 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5038b0cb-6e9c-4e96-9da9-cb9f471f6617 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:00.969946 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5038b0cb-6e9c-4e96-9da9-cb9f471f6617 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:00.970318 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5038b0cb-6e9c-4e96-9da9-cb9f471f6617 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:00.971038 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5038b0cb-6e9c-4e96-9da9-cb9f471f6617 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:00.971497 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5038b0cb-6e9c-4e96-9da9-cb9f471f6617 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:00.972059 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5038b0cb-6e9c-4e96-9da9-cb9f471f6617 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:01.011212 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-5038b0cb-6e9c-4e96-9da9-cb9f471f6617 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] HTTP exception thrown: Instance 8ebd67c2-b4d9-4e1b-9946-c8e05013170d could not be found. Oct 30 01:18:01.012978 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5038b0cb-6e9c-4e96-9da9-cb9f471f6617 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Request method failure captured: Oct 30 01:18:01.012978 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/8ebd67c2-b4d9-4e1b-9946-c8e05013170d HTTP/1.1 Oct 30 01:18:01.012978 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:18:01.012978 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:18:01.012978 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:18:01.012978 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:18:01.012978 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:18:01.012978 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:18:01.012978 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:18:01.012978 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:18:01.012978 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdCF7VF6jencz3ODp2nz3osj06SKM8bVCdTGdUDqZMVdxhkR_O3BHLVJz0vrvBc_EIDHZ5d0xlCa7bPVb7T5vikkC-MEYWBr02mEacWzv3jbTaP1-AYvYqtyGotcp6nA2c1ROiYmPkZwSB6jCyfsv2Hn4y7-G8aBOwIxiHfTVK_W1-g Oct 30 01:18:01.012978 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:18:01.012978 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:18:01.012978 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:18:01.012978 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:18:01.012978 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:18:01.012978 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:18:01.012978 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: feea74354a0b4753a363fc5d4f6d4f13 Oct 30 01:18:01.012978 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1635185820 Oct 30 01:18:01.012978 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:18:01.012978 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:18:01.014625 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/feea74354a0b4753a363fc5d4f6d4f13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_feea74354a0b4753a363fc5d4f6d4f13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/feea74354a0b4753a363fc5d4f6d4f13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/feea74354a0b4753a363fc5d4f6d4f13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:18:01.014625 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-DeleteServersAdminTestJSON-1635185820 Oct 30 01:18:01.014625 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: feea74354a0b4753a363fc5d4f6d4f13 Oct 30 01:18:01.014625 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1635185820 Oct 30 01:18:01.014625 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-DeleteServersAdminTestJSON-1635185820-project Oct 30 01:18:01.014625 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:18:01.014625 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:18:01.014625 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 7d87ef57cf344734b662bd792022c4b7 Oct 30 01:18:01.014625 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-DeleteServersAdminTestJSON-1635185820-project Oct 30 01:18:01.014625 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:18:01.014625 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 8ebd67c2-b4d9-4e1b-9946-c8e05013170d could not be found. Oct 30 01:18:01.014625 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '8ebd67c2-b4d9-4e1b-9946-c8e05013170d'} Oct 30 01:18:01.015421 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:18:01.015421 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:01.015421 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:18:01.015421 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:18:01.015421 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:18:01.015421 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:18:01.015421 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:18:01.015421 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:18:01.015421 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:18:01.015421 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:18:01.015421 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ebd67c2-b4d9-4e1b-9946-c8e05013170d could not be found. Oct 30 01:18:01.015421 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:01.015421 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:18:01.015421 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:01.015421 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:01.015421 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:18:01.015421 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:18:01.015421 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:18:01.015421 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:18:01.015421 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:18:01.016626 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:18:01.016626 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:18:01.016626 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:18:01.016626 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:18:01.016626 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:18:01.016626 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:18:01.016626 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:18:01.016626 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ebd67c2-b4d9-4e1b-9946-c8e05013170d could not be found. Oct 30 01:18:01.016626 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:01.016626 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:18:01.016626 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:01.016626 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:01.016626 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:18:01.016626 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:18:01.016626 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:18:01.016626 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:18:01.016626 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ebd67c2-b4d9-4e1b-9946-c8e05013170d could not be found. Oct 30 01:18:01.016626 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:01.017812 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5038b0cb-6e9c-4e96-9da9-cb9f471f6617 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Returning 404 to user: Instance 8ebd67c2-b4d9-4e1b-9946-c8e05013170d could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:18:01.017812 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5038b0cb-6e9c-4e96-9da9-cb9f471f6617 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] 10.222.0.13 "GET /compute/v2.1/servers/8ebd67c2-b4d9-4e1b-9946-c8e05013170d" status: 404 len: 111 microversion: 2.1 time: 0.066196 Oct 30 01:18:01.018954 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 656/1349] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:00 2022] GET /compute/v2.1/servers/8ebd67c2-b4d9-4e1b-9946-c8e05013170d => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:18:01.030233 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-91d0f8cd-b3e7-49f4-aa5f-e89cd0384de4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Action: 'create', calling method: .version_select at 0x7f44c7e7eee0>, body: {"keypair": {"name": "tempest-keypair-950828976", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJZm2tXZBEj1JUfTuWP1EpRI57m9Qt4niuPyTm5Bv/TP6lAMAxKv/r0c6G0iBzWxdiELhMeLXieHW+EAY+GfHp2nb3NbMsJiZZvxaOaWNHKSmeCxNMZmavW8qqeGl6Eig=="}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:18:01.051390 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-91d0f8cd-b3e7-49f4-aa5f-e89cd0384de4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Getting quotas for project ad621909b99143dd9885006238de72a6. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:18:01.057375 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-91d0f8cd-b3e7-49f4-aa5f-e89cd0384de4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Getting quotas for user 4f1fe6e04e064dfba969b07d4188ab38 and project ad621909b99143dd9885006238de72a6. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:18:01.146565 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-91d0f8cd-b3e7-49f4-aa5f-e89cd0384de4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.126230 Oct 30 01:18:01.147873 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 657/1350] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 30 01:18:01 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:18:01.153866 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5f8e34e9-349e-4a3d-9797-0409ef9b9984 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:01.156172 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5f8e34e9-349e-4a3d-9797-0409ef9b9984 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] [instance: 8ebd67c2-b4d9-4e1b-9946-c8e05013170d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:01.171809 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f8e34e9-349e-4a3d-9797-0409ef9b9984 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:01.172316 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f8e34e9-349e-4a3d-9797-0409ef9b9984 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:01.172747 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f8e34e9-349e-4a3d-9797-0409ef9b9984 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:01.176683 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f8e34e9-349e-4a3d-9797-0409ef9b9984 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:01.177227 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f8e34e9-349e-4a3d-9797-0409ef9b9984 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:01.181604 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f8e34e9-349e-4a3d-9797-0409ef9b9984 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:01.200997 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-5f8e34e9-349e-4a3d-9797-0409ef9b9984 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] HTTP exception thrown: Instance 8ebd67c2-b4d9-4e1b-9946-c8e05013170d could not be found. Oct 30 01:18:01.203532 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5f8e34e9-349e-4a3d-9797-0409ef9b9984 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Request method failure captured: Oct 30 01:18:01.203532 n-d-master-1 devstack@n-api.service[121103]: request: DELETE /compute/v2.1/servers/8ebd67c2-b4d9-4e1b-9946-c8e05013170d HTTP/1.1 Oct 30 01:18:01.203532 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:18:01.203532 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:18:01.203532 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:18:01.203532 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:18:01.203532 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:18:01.203532 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:18:01.203532 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:18:01.203532 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:18:01.203532 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdCF7VF6jencz3ODp2nz3osj06SKM8bVCdTGdUDqZMVdxhkR_O3BHLVJz0vrvBc_EIDHZ5d0xlCa7bPVb7T5vikkC-MEYWBr02mEacWzv3jbTaP1-AYvYqtyGotcp6nA2c1ROiYmPkZwSB6jCyfsv2Hn4y7-G8aBOwIxiHfTVK_W1-g Oct 30 01:18:01.203532 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:18:01.203532 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:18:01.203532 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:18:01.203532 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:18:01.203532 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:18:01.203532 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:18:01.203532 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: feea74354a0b4753a363fc5d4f6d4f13 Oct 30 01:18:01.203532 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1635185820 Oct 30 01:18:01.203532 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:18:01.203532 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:18:01.205001 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/feea74354a0b4753a363fc5d4f6d4f13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_feea74354a0b4753a363fc5d4f6d4f13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/feea74354a0b4753a363fc5d4f6d4f13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/feea74354a0b4753a363fc5d4f6d4f13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:18:01.205001 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-DeleteServersAdminTestJSON-1635185820 Oct 30 01:18:01.205001 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: feea74354a0b4753a363fc5d4f6d4f13 Oct 30 01:18:01.205001 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1635185820 Oct 30 01:18:01.205001 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-DeleteServersAdminTestJSON-1635185820-project Oct 30 01:18:01.205001 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:18:01.205001 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:18:01.205001 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 7d87ef57cf344734b662bd792022c4b7 Oct 30 01:18:01.205001 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-DeleteServersAdminTestJSON-1635185820-project Oct 30 01:18:01.205001 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:18:01.205001 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 8ebd67c2-b4d9-4e1b-9946-c8e05013170d could not be found. Oct 30 01:18:01.205001 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '8ebd67c2-b4d9-4e1b-9946-c8e05013170d'} Oct 30 01:18:01.205919 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:18:01.205919 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:01.205919 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:18:01.205919 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:18:01.205919 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:18:01.205919 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:18:01.205919 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:18:01.205919 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:18:01.205919 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:18:01.205919 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:18:01.205919 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ebd67c2-b4d9-4e1b-9946-c8e05013170d could not be found. Oct 30 01:18:01.205919 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:01.205919 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:18:01.205919 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:01.205919 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:01.205919 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:18:01.205919 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:18:01.205919 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:18:01.205919 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:18:01.205919 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:18:01.207311 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:18:01.207311 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:18:01.207311 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:18:01.207311 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:18:01.207311 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:18:01.207311 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:18:01.207311 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:18:01.207311 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:18:01.207311 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:18:01.207311 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ebd67c2-b4d9-4e1b-9946-c8e05013170d could not be found. Oct 30 01:18:01.207311 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:01.207311 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:18:01.207311 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:01.207311 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:01.207311 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:18:01.207311 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:18:01.207311 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:18:01.207311 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:18:01.207311 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ebd67c2-b4d9-4e1b-9946-c8e05013170d could not be found. Oct 30 01:18:01.207311 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:01.210194 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5f8e34e9-349e-4a3d-9797-0409ef9b9984 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Returning 404 to user: Instance 8ebd67c2-b4d9-4e1b-9946-c8e05013170d could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:18:01.211245 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5f8e34e9-349e-4a3d-9797-0409ef9b9984 tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8ebd67c2-b4d9-4e1b-9946-c8e05013170d" status: 404 len: 111 microversion: 2.1 time: 0.062440 Oct 30 01:18:01.212465 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 658/1351] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:18:01 2022] DELETE /compute/v2.1/servers/8ebd67c2-b4d9-4e1b-9946-c8e05013170d => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:18:01.221560 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e36fd04f-4d11-4602-832d-eadf160e7f9c tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:01.222471 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e36fd04f-4d11-4602-832d-eadf160e7f9c tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] [instance: 8ebd67c2-b4d9-4e1b-9946-c8e05013170d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:01.230252 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e36fd04f-4d11-4602-832d-eadf160e7f9c tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:01.230968 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e36fd04f-4d11-4602-832d-eadf160e7f9c tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:01.231584 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e36fd04f-4d11-4602-832d-eadf160e7f9c tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:01.232503 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e36fd04f-4d11-4602-832d-eadf160e7f9c tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:01.233687 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e36fd04f-4d11-4602-832d-eadf160e7f9c tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:01.234267 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e36fd04f-4d11-4602-832d-eadf160e7f9c tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:01.258538 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-e36fd04f-4d11-4602-832d-eadf160e7f9c tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] HTTP exception thrown: Instance 8ebd67c2-b4d9-4e1b-9946-c8e05013170d could not be found. Oct 30 01:18:01.260865 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e36fd04f-4d11-4602-832d-eadf160e7f9c tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Request method failure captured: Oct 30 01:18:01.260865 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/8ebd67c2-b4d9-4e1b-9946-c8e05013170d HTTP/1.1 Oct 30 01:18:01.260865 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:18:01.260865 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:18:01.260865 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:18:01.260865 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:18:01.260865 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:18:01.260865 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:18:01.260865 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:18:01.260865 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:18:01.260865 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdCF7VF6jencz3ODp2nz3osj06SKM8bVCdTGdUDqZMVdxhkR_O3BHLVJz0vrvBc_EIDHZ5d0xlCa7bPVb7T5vikkC-MEYWBr02mEacWzv3jbTaP1-AYvYqtyGotcp6nA2c1ROiYmPkZwSB6jCyfsv2Hn4y7-G8aBOwIxiHfTVK_W1-g Oct 30 01:18:01.260865 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:18:01.260865 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:18:01.260865 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:18:01.260865 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:18:01.260865 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:18:01.260865 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:18:01.260865 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: feea74354a0b4753a363fc5d4f6d4f13 Oct 30 01:18:01.260865 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1635185820 Oct 30 01:18:01.260865 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:18:01.260865 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:18:01.262428 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/feea74354a0b4753a363fc5d4f6d4f13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_feea74354a0b4753a363fc5d4f6d4f13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/feea74354a0b4753a363fc5d4f6d4f13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/feea74354a0b4753a363fc5d4f6d4f13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:18:01.262428 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-DeleteServersAdminTestJSON-1635185820 Oct 30 01:18:01.262428 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: feea74354a0b4753a363fc5d4f6d4f13 Oct 30 01:18:01.262428 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1635185820 Oct 30 01:18:01.262428 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-DeleteServersAdminTestJSON-1635185820-project Oct 30 01:18:01.262428 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:18:01.262428 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:18:01.262428 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 7d87ef57cf344734b662bd792022c4b7 Oct 30 01:18:01.262428 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-DeleteServersAdminTestJSON-1635185820-project Oct 30 01:18:01.262428 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:18:01.262428 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 8ebd67c2-b4d9-4e1b-9946-c8e05013170d could not be found. Oct 30 01:18:01.262428 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '8ebd67c2-b4d9-4e1b-9946-c8e05013170d'} Oct 30 01:18:01.263481 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:18:01.263481 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:01.263481 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:18:01.263481 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:18:01.263481 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:18:01.263481 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:18:01.263481 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:18:01.263481 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:18:01.263481 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:18:01.263481 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:18:01.263481 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ebd67c2-b4d9-4e1b-9946-c8e05013170d could not be found. Oct 30 01:18:01.263481 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:01.263481 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:18:01.263481 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:01.263481 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:01.263481 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:18:01.263481 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:18:01.263481 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:18:01.263481 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:18:01.263481 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:18:01.265196 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:18:01.265196 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:18:01.265196 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:18:01.265196 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:18:01.265196 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:18:01.265196 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:18:01.265196 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:18:01.265196 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ebd67c2-b4d9-4e1b-9946-c8e05013170d could not be found. Oct 30 01:18:01.265196 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:01.265196 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:18:01.265196 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:01.265196 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:01.265196 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:18:01.265196 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:18:01.265196 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:18:01.265196 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:18:01.265196 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ebd67c2-b4d9-4e1b-9946-c8e05013170d could not be found. Oct 30 01:18:01.265196 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:01.267508 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e36fd04f-4d11-4602-832d-eadf160e7f9c tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Returning 404 to user: Instance 8ebd67c2-b4d9-4e1b-9946-c8e05013170d could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:18:01.268530 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e36fd04f-4d11-4602-832d-eadf160e7f9c tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] 10.222.0.13 "GET /compute/v2.1/servers/8ebd67c2-b4d9-4e1b-9946-c8e05013170d" status: 404 len: 111 microversion: 2.1 time: 0.051646 Oct 30 01:18:01.269623 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 659/1352] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:01 2022] GET /compute/v2.1/servers/8ebd67c2-b4d9-4e1b-9946-c8e05013170d => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:18:01.280154 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-01fc0821-c7b2-41ff-8d16-a9a4b3924d6c tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:01.281473 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-01fc0821-c7b2-41ff-8d16-a9a4b3924d6c tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] [instance: d444d587-7d6e-498e-9770-6ac5f8fbd0e1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:01.294361 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-01fc0821-c7b2-41ff-8d16-a9a4b3924d6c tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:01.294361 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-01fc0821-c7b2-41ff-8d16-a9a4b3924d6c tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:01.294361 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-01fc0821-c7b2-41ff-8d16-a9a4b3924d6c tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:01.294361 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-01fc0821-c7b2-41ff-8d16-a9a4b3924d6c tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:01.294800 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-01fc0821-c7b2-41ff-8d16-a9a4b3924d6c tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:01.294800 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-01fc0821-c7b2-41ff-8d16-a9a4b3924d6c tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:01.311788 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-01fc0821-c7b2-41ff-8d16-a9a4b3924d6c tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] HTTP exception thrown: Instance d444d587-7d6e-498e-9770-6ac5f8fbd0e1 could not be found. Oct 30 01:18:01.313851 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-01fc0821-c7b2-41ff-8d16-a9a4b3924d6c tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Request method failure captured: Oct 30 01:18:01.313851 n-d-master-1 devstack@n-api.service[121103]: request: DELETE /compute/v2.1/servers/d444d587-7d6e-498e-9770-6ac5f8fbd0e1 HTTP/1.1 Oct 30 01:18:01.313851 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:18:01.313851 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:18:01.313851 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:18:01.313851 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:18:01.313851 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:18:01.313851 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:18:01.313851 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:18:01.313851 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:18:01.313851 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdCF7VF6jencz3ODp2nz3osj06SKM8bVCdTGdUDqZMVdxhkR_O3BHLVJz0vrvBc_EIDHZ5d0xlCa7bPVb7T5vikkC-MEYWBr02mEacWzv3jbTaP1-AYvYqtyGotcp6nA2c1ROiYmPkZwSB6jCyfsv2Hn4y7-G8aBOwIxiHfTVK_W1-g Oct 30 01:18:01.313851 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:18:01.313851 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:18:01.313851 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:18:01.313851 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:18:01.313851 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:18:01.313851 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:18:01.313851 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: feea74354a0b4753a363fc5d4f6d4f13 Oct 30 01:18:01.313851 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1635185820 Oct 30 01:18:01.313851 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:18:01.313851 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:18:01.315450 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/feea74354a0b4753a363fc5d4f6d4f13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_feea74354a0b4753a363fc5d4f6d4f13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/feea74354a0b4753a363fc5d4f6d4f13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/feea74354a0b4753a363fc5d4f6d4f13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:18:01.315450 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-DeleteServersAdminTestJSON-1635185820 Oct 30 01:18:01.315450 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: feea74354a0b4753a363fc5d4f6d4f13 Oct 30 01:18:01.315450 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1635185820 Oct 30 01:18:01.315450 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-DeleteServersAdminTestJSON-1635185820-project Oct 30 01:18:01.315450 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:18:01.315450 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:18:01.315450 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 7d87ef57cf344734b662bd792022c4b7 Oct 30 01:18:01.315450 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-DeleteServersAdminTestJSON-1635185820-project Oct 30 01:18:01.315450 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:18:01.315450 n-d-master-1 devstack@n-api.service[121103]: exception: Instance d444d587-7d6e-498e-9770-6ac5f8fbd0e1 could not be found. Oct 30 01:18:01.315450 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'd444d587-7d6e-498e-9770-6ac5f8fbd0e1'} Oct 30 01:18:01.316320 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:18:01.316320 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:01.316320 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:18:01.316320 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:18:01.316320 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:18:01.316320 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:18:01.316320 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:18:01.316320 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:18:01.316320 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:18:01.316320 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:18:01.316320 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d444d587-7d6e-498e-9770-6ac5f8fbd0e1 could not be found. Oct 30 01:18:01.316320 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:01.316320 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:18:01.316320 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:01.316320 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:01.316320 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:18:01.316320 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:18:01.316320 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:18:01.316320 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:18:01.316320 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:18:01.318014 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:18:01.318014 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:18:01.318014 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:18:01.318014 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:18:01.318014 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:18:01.318014 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:18:01.318014 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:18:01.318014 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:18:01.318014 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:18:01.318014 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d444d587-7d6e-498e-9770-6ac5f8fbd0e1 could not be found. Oct 30 01:18:01.318014 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:01.318014 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:18:01.318014 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:01.318014 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:01.318014 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:18:01.318014 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:18:01.318014 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:18:01.318014 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:18:01.318014 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d444d587-7d6e-498e-9770-6ac5f8fbd0e1 could not be found. Oct 30 01:18:01.318014 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:01.320302 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-01fc0821-c7b2-41ff-8d16-a9a4b3924d6c tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Returning 404 to user: Instance d444d587-7d6e-498e-9770-6ac5f8fbd0e1 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:18:01.326416 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-01fc0821-c7b2-41ff-8d16-a9a4b3924d6c tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d444d587-7d6e-498e-9770-6ac5f8fbd0e1" status: 404 len: 111 microversion: 2.1 time: 0.052310 Oct 30 01:18:01.329285 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 660/1353] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:18:01 2022] DELETE /compute/v2.1/servers/d444d587-7d6e-498e-9770-6ac5f8fbd0e1 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:18:01.345326 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-46b13658-93c1-4db2-87a9-ac500133748c tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:01.346404 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-46b13658-93c1-4db2-87a9-ac500133748c tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] [instance: d444d587-7d6e-498e-9770-6ac5f8fbd0e1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:01.356558 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:01.359276 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-46b13658-93c1-4db2-87a9-ac500133748c tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:01.359973 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-46b13658-93c1-4db2-87a9-ac500133748c tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:01.360594 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-46b13658-93c1-4db2-87a9-ac500133748c tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:01.362492 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-46b13658-93c1-4db2-87a9-ac500133748c tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:01.363862 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-46b13658-93c1-4db2-87a9-ac500133748c tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:01.364496 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-46b13658-93c1-4db2-87a9-ac500133748c tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:01.381948 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-46b13658-93c1-4db2-87a9-ac500133748c tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] HTTP exception thrown: Instance d444d587-7d6e-498e-9770-6ac5f8fbd0e1 could not be found. Oct 30 01:18:01.384531 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-46b13658-93c1-4db2-87a9-ac500133748c tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Request method failure captured: Oct 30 01:18:01.384531 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/d444d587-7d6e-498e-9770-6ac5f8fbd0e1 HTTP/1.1 Oct 30 01:18:01.384531 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:18:01.384531 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:18:01.384531 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:18:01.384531 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:18:01.384531 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:18:01.384531 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:18:01.384531 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:18:01.384531 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:18:01.384531 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdCF7VF6jencz3ODp2nz3osj06SKM8bVCdTGdUDqZMVdxhkR_O3BHLVJz0vrvBc_EIDHZ5d0xlCa7bPVb7T5vikkC-MEYWBr02mEacWzv3jbTaP1-AYvYqtyGotcp6nA2c1ROiYmPkZwSB6jCyfsv2Hn4y7-G8aBOwIxiHfTVK_W1-g Oct 30 01:18:01.384531 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:18:01.384531 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:18:01.384531 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:18:01.384531 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:18:01.384531 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:18:01.384531 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:18:01.384531 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: feea74354a0b4753a363fc5d4f6d4f13 Oct 30 01:18:01.384531 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1635185820 Oct 30 01:18:01.384531 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:18:01.384531 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:18:01.390054 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/feea74354a0b4753a363fc5d4f6d4f13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_feea74354a0b4753a363fc5d4f6d4f13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/feea74354a0b4753a363fc5d4f6d4f13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/feea74354a0b4753a363fc5d4f6d4f13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:18:01.390054 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-DeleteServersAdminTestJSON-1635185820 Oct 30 01:18:01.390054 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: feea74354a0b4753a363fc5d4f6d4f13 Oct 30 01:18:01.390054 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1635185820 Oct 30 01:18:01.390054 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-DeleteServersAdminTestJSON-1635185820-project Oct 30 01:18:01.390054 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:18:01.390054 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:18:01.390054 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 7d87ef57cf344734b662bd792022c4b7 Oct 30 01:18:01.390054 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-DeleteServersAdminTestJSON-1635185820-project Oct 30 01:18:01.390054 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:18:01.390054 n-d-master-1 devstack@n-api.service[121103]: exception: Instance d444d587-7d6e-498e-9770-6ac5f8fbd0e1 could not be found. Oct 30 01:18:01.390054 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'd444d587-7d6e-498e-9770-6ac5f8fbd0e1'} Oct 30 01:18:01.390823 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:18:01.390823 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:01.390823 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:18:01.390823 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:18:01.390823 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:18:01.390823 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:18:01.390823 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:18:01.390823 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:18:01.390823 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:18:01.390823 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:18:01.390823 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d444d587-7d6e-498e-9770-6ac5f8fbd0e1 could not be found. Oct 30 01:18:01.390823 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:01.390823 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:18:01.390823 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:01.390823 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:01.390823 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:18:01.390823 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:18:01.390823 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:18:01.390823 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:18:01.390823 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:18:01.391992 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:18:01.391992 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:18:01.391992 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:18:01.391992 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:18:01.391992 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:18:01.391992 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:18:01.391992 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:18:01.391992 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d444d587-7d6e-498e-9770-6ac5f8fbd0e1 could not be found. Oct 30 01:18:01.391992 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:01.391992 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:18:01.391992 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:01.391992 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:01.391992 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:18:01.391992 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:18:01.391992 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:18:01.391992 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:18:01.391992 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d444d587-7d6e-498e-9770-6ac5f8fbd0e1 could not be found. Oct 30 01:18:01.391992 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:01.393119 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-46b13658-93c1-4db2-87a9-ac500133748c tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] Returning 404 to user: Instance d444d587-7d6e-498e-9770-6ac5f8fbd0e1 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:18:01.393119 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-46b13658-93c1-4db2-87a9-ac500133748c tempest-DeleteServersAdminTestJSON-1635185820 tempest-DeleteServersAdminTestJSON-1635185820-project] 10.222.0.13 "GET /compute/v2.1/servers/d444d587-7d6e-498e-9770-6ac5f8fbd0e1" status: 404 len: 111 microversion: 2.1 time: 0.055536 Oct 30 01:18:01.393119 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 661/1354] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:01 2022] GET /compute/v2.1/servers/d444d587-7d6e-498e-9770-6ac5f8fbd0e1 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 01:18:01.430399 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a39e5c42-5b0b-4d62-a46e-5810eef72a90 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:01.449005 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a39e5c42-5b0b-4d62-a46e-5810eef72a90 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:01.450958 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a39e5c42-5b0b-4d62-a46e-5810eef72a90 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:01.452446 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a39e5c42-5b0b-4d62-a46e-5810eef72a90 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 200 len: 1813 microversion: 2.25 time: 0.533796 Oct 30 01:18:01.453012 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 694/1355] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:00 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 1813 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:18:01.516174 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d99aa0e4-cfb5-4149-b295-ced8fe5eaee6 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:01.517698 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d99aa0e4-cfb5-4149-b295-ced8fe5eaee6 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:01.530703 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d99aa0e4-cfb5-4149-b295-ced8fe5eaee6 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:01.531692 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d99aa0e4-cfb5-4149-b295-ced8fe5eaee6 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:01.542444 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d99aa0e4-cfb5-4149-b295-ced8fe5eaee6 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:01.542444 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d99aa0e4-cfb5-4149-b295-ced8fe5eaee6 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:01.542444 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d99aa0e4-cfb5-4149-b295-ced8fe5eaee6 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:01.542444 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d99aa0e4-cfb5-4149-b295-ced8fe5eaee6 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:01.560551 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-e19ea34a-4de1-4612-8fb0-23e468780f00 req-e04ff9fe-cb2d-4dd4-8e9f-9ea1cdcb59a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5904b0d2-fd7a-4f0e-92b9-757c056620fc", "tag": "7310a5fc-570a-4302-9485-9d166be6ece5"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:18:01.589018 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-e19ea34a-4de1-4612-8fb0-23e468780f00 req-e04ff9fe-cb2d-4dd4-8e9f-9ea1cdcb59a7 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:01.592531 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-e19ea34a-4de1-4612-8fb0-23e468780f00 req-e04ff9fe-cb2d-4dd4-8e9f-9ea1cdcb59a7 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:01.595938 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-e19ea34a-4de1-4612-8fb0-23e468780f00 req-e04ff9fe-cb2d-4dd4-8e9f-9ea1cdcb59a7 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:01.635778 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-e19ea34a-4de1-4612-8fb0-23e468780f00 req-e04ff9fe-cb2d-4dd4-8e9f-9ea1cdcb59a7 service nova] Creating event network-changed:7310a5fc-570a-4302-9485-9d166be6ece5 for instance 5904b0d2-fd7a-4f0e-92b9-757c056620fc on n-h1-master-1 Oct 30 01:18:01.645208 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-e19ea34a-4de1-4612-8fb0-23e468780f00 req-e04ff9fe-cb2d-4dd4-8e9f-9ea1cdcb59a7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089085 Oct 30 01:18:01.647393 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 695/1356] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:18:01.661918 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-218713e5-e061-4a22-a697-b576de165fd9 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:01.666631 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-218713e5-e061-4a22-a697-b576de165fd9 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:01.670010 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:01.677933 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-218713e5-e061-4a22-a697-b576de165fd9 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:01.678545 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-218713e5-e061-4a22-a697-b576de165fd9 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:01.679081 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-218713e5-e061-4a22-a697-b576de165fd9 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:01.680229 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-218713e5-e061-4a22-a697-b576de165fd9 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:01.680785 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-218713e5-e061-4a22-a697-b576de165fd9 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:01.681589 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-218713e5-e061-4a22-a697-b576de165fd9 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:01.738173 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-218713e5-e061-4a22-a697-b576de165fd9 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.089294 Oct 30 01:18:01.740579 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 696/1357] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 01:18:01 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd/os-volume_attachments => generated 25 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:18:01.956210 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b49f76c5-f194-44fd-bd88-90e375c0dfd5 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:01.956838 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b49f76c5-f194-44fd-bd88-90e375c0dfd5 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 5904b0d2-fd7a-4f0e-92b9-757c056620fc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:01.970184 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b49f76c5-f194-44fd-bd88-90e375c0dfd5 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:01.974064 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b49f76c5-f194-44fd-bd88-90e375c0dfd5 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:01.975143 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b49f76c5-f194-44fd-bd88-90e375c0dfd5 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:01.975908 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b49f76c5-f194-44fd-bd88-90e375c0dfd5 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:01.976380 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b49f76c5-f194-44fd-bd88-90e375c0dfd5 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:01.979287 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b49f76c5-f194-44fd-bd88-90e375c0dfd5 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:02.029542 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d99aa0e4-cfb5-4149-b295-ced8fe5eaee6 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:02.056696 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d99aa0e4-cfb5-4149-b295-ced8fe5eaee6 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1472 microversion: 2.1 time: 0.544420 Oct 30 01:18:02.062175 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 662/1358] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:01 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1472 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:02.091470 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:02.483061 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8aeb7be7-6c78-4d5e-a013-c55184a4e0ec tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:02.483675 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8aeb7be7-6c78-4d5e-a013-c55184a4e0ec tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:02.490964 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8aeb7be7-6c78-4d5e-a013-c55184a4e0ec tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:02.503921 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8aeb7be7-6c78-4d5e-a013-c55184a4e0ec tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:02.504526 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8aeb7be7-6c78-4d5e-a013-c55184a4e0ec tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:02.505505 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8aeb7be7-6c78-4d5e-a013-c55184a4e0ec tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:02.506208 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8aeb7be7-6c78-4d5e-a013-c55184a4e0ec tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:02.506964 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8aeb7be7-6c78-4d5e-a013-c55184a4e0ec tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:02.743556 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b49f76c5-f194-44fd-bd88-90e375c0dfd5 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:02.754833 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b49f76c5-f194-44fd-bd88-90e375c0dfd5 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/5904b0d2-fd7a-4f0e-92b9-757c056620fc" status: 200 len: 1317 microversion: 2.1 time: 0.803393 Oct 30 01:18:02.758884 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 697/1359] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:01 2022] GET /compute/v2.1/servers/5904b0d2-fd7a-4f0e-92b9-757c056620fc => generated 1317 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:02.883866 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8aeb7be7-6c78-4d5e-a013-c55184a4e0ec tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:02.906419 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8aeb7be7-6c78-4d5e-a013-c55184a4e0ec tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:02.907948 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8aeb7be7-6c78-4d5e-a013-c55184a4e0ec tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:02.909172 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8aeb7be7-6c78-4d5e-a013-c55184a4e0ec tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 200 len: 1813 microversion: 2.25 time: 0.432197 Oct 30 01:18:02.914239 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 663/1360] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:02 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 1813 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:18:03.088398 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-859ba558-9416-4643-9d8e-89d76851bd89 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:03.091006 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-859ba558-9416-4643-9d8e-89d76851bd89 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:03.115959 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-859ba558-9416-4643-9d8e-89d76851bd89 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:03.116743 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-859ba558-9416-4643-9d8e-89d76851bd89 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:03.117596 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-859ba558-9416-4643-9d8e-89d76851bd89 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:03.120770 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-859ba558-9416-4643-9d8e-89d76851bd89 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:03.121485 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-859ba558-9416-4643-9d8e-89d76851bd89 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:03.129171 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-859ba558-9416-4643-9d8e-89d76851bd89 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:03.349042 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-859ba558-9416-4643-9d8e-89d76851bd89 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:03.358615 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-859ba558-9416-4643-9d8e-89d76851bd89 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1472 microversion: 2.1 time: 0.281218 Oct 30 01:18:03.364005 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 698/1361] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:03 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1472 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:18:03.782995 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2814c1c8-925a-41f2-8560-f5693a9fb786 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:03.783559 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2814c1c8-925a-41f2-8560-f5693a9fb786 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 5904b0d2-fd7a-4f0e-92b9-757c056620fc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:03.797018 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2814c1c8-925a-41f2-8560-f5693a9fb786 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:03.798983 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2814c1c8-925a-41f2-8560-f5693a9fb786 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:03.798983 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2814c1c8-925a-41f2-8560-f5693a9fb786 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:03.798983 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2814c1c8-925a-41f2-8560-f5693a9fb786 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:03.799244 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2814c1c8-925a-41f2-8560-f5693a9fb786 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:03.799563 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2814c1c8-925a-41f2-8560-f5693a9fb786 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:03.939729 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-11d77146-2707-4b59-a8da-c3c03dfaea83 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:03.940358 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-11d77146-2707-4b59-a8da-c3c03dfaea83 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:03.949288 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-11d77146-2707-4b59-a8da-c3c03dfaea83 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:03.950025 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-11d77146-2707-4b59-a8da-c3c03dfaea83 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:03.950679 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-11d77146-2707-4b59-a8da-c3c03dfaea83 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:03.951646 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-11d77146-2707-4b59-a8da-c3c03dfaea83 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:03.952204 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-11d77146-2707-4b59-a8da-c3c03dfaea83 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:03.952841 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-11d77146-2707-4b59-a8da-c3c03dfaea83 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:04.151640 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2814c1c8-925a-41f2-8560-f5693a9fb786 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:04.170133 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2814c1c8-925a-41f2-8560-f5693a9fb786 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/5904b0d2-fd7a-4f0e-92b9-757c056620fc" status: 200 len: 1317 microversion: 2.1 time: 0.387626 Oct 30 01:18:04.172066 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 664/1362] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:03 2022] GET /compute/v2.1/servers/5904b0d2-fd7a-4f0e-92b9-757c056620fc => generated 1317 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:04.234409 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-11d77146-2707-4b59-a8da-c3c03dfaea83 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:04.262091 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-11d77146-2707-4b59-a8da-c3c03dfaea83 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:04.266280 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-11d77146-2707-4b59-a8da-c3c03dfaea83 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:04.270361 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-11d77146-2707-4b59-a8da-c3c03dfaea83 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 200 len: 1813 microversion: 2.25 time: 0.334690 Oct 30 01:18:04.272017 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 699/1363] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:03 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 1813 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:18:04.386300 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-455b9788-835a-48ca-8064-cc812a08ad61 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:04.387289 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-455b9788-835a-48ca-8064-cc812a08ad61 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:04.394954 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-455b9788-835a-48ca-8064-cc812a08ad61 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:04.397660 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-455b9788-835a-48ca-8064-cc812a08ad61 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:04.398403 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-455b9788-835a-48ca-8064-cc812a08ad61 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:04.399372 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-455b9788-835a-48ca-8064-cc812a08ad61 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:04.400040 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-455b9788-835a-48ca-8064-cc812a08ad61 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:04.400647 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-455b9788-835a-48ca-8064-cc812a08ad61 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:04.887974 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-455b9788-835a-48ca-8064-cc812a08ad61 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:04.911339 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-455b9788-835a-48ca-8064-cc812a08ad61 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1472 microversion: 2.1 time: 0.527738 Oct 30 01:18:04.917858 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 665/1364] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:04 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1472 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:05.199579 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f8f15926-9993-428c-8236-cd997e40fbab tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:05.201530 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f8f15926-9993-428c-8236-cd997e40fbab tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 5904b0d2-fd7a-4f0e-92b9-757c056620fc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:05.215176 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f8f15926-9993-428c-8236-cd997e40fbab tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:05.216634 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f8f15926-9993-428c-8236-cd997e40fbab tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:05.217931 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f8f15926-9993-428c-8236-cd997e40fbab tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:05.218793 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f8f15926-9993-428c-8236-cd997e40fbab tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:05.220033 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f8f15926-9993-428c-8236-cd997e40fbab tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:05.221250 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f8f15926-9993-428c-8236-cd997e40fbab tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:05.306245 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-38a5b515-efa1-4f38-8b37-a4e8e3e6008b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:05.307791 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-38a5b515-efa1-4f38-8b37-a4e8e3e6008b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:05.335189 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38a5b515-efa1-4f38-8b37-a4e8e3e6008b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:05.340995 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38a5b515-efa1-4f38-8b37-a4e8e3e6008b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:05.344043 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38a5b515-efa1-4f38-8b37-a4e8e3e6008b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:05.345996 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38a5b515-efa1-4f38-8b37-a4e8e3e6008b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:05.351646 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38a5b515-efa1-4f38-8b37-a4e8e3e6008b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:05.355811 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38a5b515-efa1-4f38-8b37-a4e8e3e6008b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:05.713042 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f8f15926-9993-428c-8236-cd997e40fbab tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:05.727793 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f8f15926-9993-428c-8236-cd997e40fbab tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/5904b0d2-fd7a-4f0e-92b9-757c056620fc" status: 200 len: 1317 microversion: 2.1 time: 0.534852 Oct 30 01:18:05.729986 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 700/1365] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:05 2022] GET /compute/v2.1/servers/5904b0d2-fd7a-4f0e-92b9-757c056620fc => generated 1317 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:05.764393 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-38a5b515-efa1-4f38-8b37-a4e8e3e6008b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:05.776062 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-38a5b515-efa1-4f38-8b37-a4e8e3e6008b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:05.778503 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-38a5b515-efa1-4f38-8b37-a4e8e3e6008b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:05.779914 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-38a5b515-efa1-4f38-8b37-a4e8e3e6008b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 200 len: 1813 microversion: 2.25 time: 0.478464 Oct 30 01:18:05.781163 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 666/1366] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:05 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 1813 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:18:05.939187 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3684058b-71c4-4cc0-9c69-6d53df2dbd3f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:05.940140 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3684058b-71c4-4cc0-9c69-6d53df2dbd3f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:05.955279 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3684058b-71c4-4cc0-9c69-6d53df2dbd3f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:05.956483 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3684058b-71c4-4cc0-9c69-6d53df2dbd3f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:05.957372 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3684058b-71c4-4cc0-9c69-6d53df2dbd3f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:05.958394 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3684058b-71c4-4cc0-9c69-6d53df2dbd3f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:05.959097 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3684058b-71c4-4cc0-9c69-6d53df2dbd3f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:05.960216 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3684058b-71c4-4cc0-9c69-6d53df2dbd3f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:06.236248 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3684058b-71c4-4cc0-9c69-6d53df2dbd3f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:06.251496 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3684058b-71c4-4cc0-9c69-6d53df2dbd3f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1478 microversion: 2.1 time: 0.316713 Oct 30 01:18:06.254045 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 701/1367] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:05 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1478 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:18:06.757257 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f309ad31-93ed-4289-b69a-ff767685667e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:06.759562 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f309ad31-93ed-4289-b69a-ff767685667e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 5904b0d2-fd7a-4f0e-92b9-757c056620fc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:06.784300 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f309ad31-93ed-4289-b69a-ff767685667e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:06.785830 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f309ad31-93ed-4289-b69a-ff767685667e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:06.789730 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f309ad31-93ed-4289-b69a-ff767685667e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:06.791374 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f309ad31-93ed-4289-b69a-ff767685667e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:06.796830 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f309ad31-93ed-4289-b69a-ff767685667e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:06.798707 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f309ad31-93ed-4289-b69a-ff767685667e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:06.810203 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4a3f09bf-8852-423d-bfa3-553b8d6c7284 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:06.818533 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4a3f09bf-8852-423d-bfa3-553b8d6c7284 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:06.823938 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a3f09bf-8852-423d-bfa3-553b8d6c7284 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:06.824415 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a3f09bf-8852-423d-bfa3-553b8d6c7284 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:06.824854 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a3f09bf-8852-423d-bfa3-553b8d6c7284 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:06.826756 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a3f09bf-8852-423d-bfa3-553b8d6c7284 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:06.827225 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a3f09bf-8852-423d-bfa3-553b8d6c7284 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:06.827658 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a3f09bf-8852-423d-bfa3-553b8d6c7284 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:07.059659 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f309ad31-93ed-4289-b69a-ff767685667e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:07.070590 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f309ad31-93ed-4289-b69a-ff767685667e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/5904b0d2-fd7a-4f0e-92b9-757c056620fc" status: 200 len: 1317 microversion: 2.1 time: 0.320851 Oct 30 01:18:07.086820 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 667/1368] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:06 2022] GET /compute/v2.1/servers/5904b0d2-fd7a-4f0e-92b9-757c056620fc => generated 1317 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:18:07.095649 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7418cc6b-66e1-4a57-a651-3959f3d6e6e1 tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] Calling method '.version_select at 0x7f44cc7bc310>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:07.100922 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7418cc6b-66e1-4a57-a651-3959f3d6e6e1 tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:07.101780 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7418cc6b-66e1-4a57-a651-3959f3d6e6e1 tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:07.102444 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7418cc6b-66e1-4a57-a651-3959f3d6e6e1 tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:07.116775 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7418cc6b-66e1-4a57-a651-3959f3d6e6e1 tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] 10.222.0.13 "GET /compute/v2.1/os-migrations" status: 200 len: 3103 microversion: 2.1 time: 0.027927 Oct 30 01:18:07.129667 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 668/1369] 10.222.0.13 () {58 vars in 1143 bytes} [Sun Oct 30 01:18:07 2022] GET /compute/v2.1/os-migrations => generated 3103 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:07.147977 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-29f88eef-1a10-40e6-bf6f-47dad891e3b6 tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:07.160502 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4a3f09bf-8852-423d-bfa3-553b8d6c7284 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:07.181956 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-29f88eef-1a10-40e6-bf6f-47dad891e3b6 tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.031346 Oct 30 01:18:07.181956 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 669/1370] 10.222.0.13 () {58 vars in 1137 bytes} [Sun Oct 30 01:18:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:18:07.182834 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4a3f09bf-8852-423d-bfa3-553b8d6c7284 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:07.185050 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4a3f09bf-8852-423d-bfa3-553b8d6c7284 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:07.186591 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4a3f09bf-8852-423d-bfa3-553b8d6c7284 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 200 len: 1813 microversion: 2.25 time: 0.381777 Oct 30 01:18:07.204055 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 702/1371] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:06 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 1813 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:18:07.204227 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f3c8eadb-d398-4b96-9e07-54cbe0e5a723 tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1716548241", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:18:07.280615 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-17f1f197-a7da-4581-aa72-de0ae54fd914 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:07.281267 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-17f1f197-a7da-4581-aa72-de0ae54fd914 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:07.295488 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-17f1f197-a7da-4581-aa72-de0ae54fd914 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:07.295488 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-17f1f197-a7da-4581-aa72-de0ae54fd914 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:07.295488 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-17f1f197-a7da-4581-aa72-de0ae54fd914 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:07.295488 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-17f1f197-a7da-4581-aa72-de0ae54fd914 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:07.295817 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-17f1f197-a7da-4581-aa72-de0ae54fd914 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:07.295817 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-17f1f197-a7da-4581-aa72-de0ae54fd914 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:07.342695 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f3c8eadb-d398-4b96-9e07-54cbe0e5a723 tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.159417 Oct 30 01:18:07.351358 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 670/1372] 10.222.0.13 () {60 vars in 1146 bytes} [Sun Oct 30 01:18:07 2022] POST /compute/v2.1/flavors => generated 499 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:18:07.359347 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6cef0a8b-0205-441f-8a08-57d331c845be tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:07.386815 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6cef0a8b-0205-441f-8a08-57d331c845be tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.033639 Oct 30 01:18:07.388534 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 671/1373] 10.222.0.13 () {58 vars in 1182 bytes} [Sun Oct 30 01:18:07 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:18:07.453989 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-17f1f197-a7da-4581-aa72-de0ae54fd914 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:07.464377 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-17f1f197-a7da-4581-aa72-de0ae54fd914 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1478 microversion: 2.1 time: 0.187934 Oct 30 01:18:07.466220 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 703/1374] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:07 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1478 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:07.583341 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b9a08eaf-ebdd-4171-82af-2f22a06b364a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1360198679", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "9e6ff59f-7364-4d1d-bbe2-085a6800db3f"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:18:07.702499 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-b9a08eaf-ebdd-4171-82af-2f22a06b364a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] validate_networks() for None {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:18:08.013115 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-b9a08eaf-ebdd-4171-82af-2f22a06b364a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:18:08.013941 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-b9a08eaf-ebdd-4171-82af-2f22a06b364a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:18:08.014282 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-b9a08eaf-ebdd-4171-82af-2f22a06b364a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:18:08.014747 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-b9a08eaf-ebdd-4171-82af-2f22a06b364a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:18:08.015349 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-b9a08eaf-ebdd-4171-82af-2f22a06b364a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:18:08.026345 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b9a08eaf-ebdd-4171-82af-2f22a06b364a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:08.035400 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b9a08eaf-ebdd-4171-82af-2f22a06b364a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:08.035400 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b9a08eaf-ebdd-4171-82af-2f22a06b364a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:08.035400 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b9a08eaf-ebdd-4171-82af-2f22a06b364a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:08.035400 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b9a08eaf-ebdd-4171-82af-2f22a06b364a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:08.036086 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b9a08eaf-ebdd-4171-82af-2f22a06b364a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:08.095840 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-b9a08eaf-ebdd-4171-82af-2f22a06b364a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Getting quotas for project ad621909b99143dd9885006238de72a6. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:18:08.101474 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d7020c64-22a9-406a-ab80-7da463e54b73 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:08.102815 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d7020c64-22a9-406a-ab80-7da463e54b73 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 5904b0d2-fd7a-4f0e-92b9-757c056620fc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:08.109363 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-b9a08eaf-ebdd-4171-82af-2f22a06b364a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Getting quotas for user 4f1fe6e04e064dfba969b07d4188ab38 and project ad621909b99143dd9885006238de72a6. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:18:08.121393 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7020c64-22a9-406a-ab80-7da463e54b73 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:08.122687 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7020c64-22a9-406a-ab80-7da463e54b73 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:08.123872 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7020c64-22a9-406a-ab80-7da463e54b73 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:08.132220 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7020c64-22a9-406a-ab80-7da463e54b73 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:08.133850 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7020c64-22a9-406a-ab80-7da463e54b73 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:08.134505 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7020c64-22a9-406a-ab80-7da463e54b73 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:08.153757 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b9a08eaf-ebdd-4171-82af-2f22a06b364a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:18:08.164906 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b9a08eaf-ebdd-4171-82af-2f22a06b364a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 03d9aff4-215d-48fa-b741-2257b62fc597] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:18:08.339134 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b9a08eaf-ebdd-4171-82af-2f22a06b364a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.762618 Oct 30 01:18:08.340211 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 672/1375] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:18:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:18:08.346716 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-8921fd60-537e-4606-8329-3c58c4734d06 req-0ef0c2f9-ebff-45e8-b94d-480144e31692 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5904b0d2-fd7a-4f0e-92b9-757c056620fc", "name": "network-vif-plugged", "status": "completed", "tag": "7310a5fc-570a-4302-9485-9d166be6ece5"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:18:08.399663 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-8921fd60-537e-4606-8329-3c58c4734d06 req-0ef0c2f9-ebff-45e8-b94d-480144e31692 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:08.400273 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-8921fd60-537e-4606-8329-3c58c4734d06 req-0ef0c2f9-ebff-45e8-b94d-480144e31692 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:08.400724 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-8921fd60-537e-4606-8329-3c58c4734d06 req-0ef0c2f9-ebff-45e8-b94d-480144e31692 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:08.422433 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d7020c64-22a9-406a-ab80-7da463e54b73 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:08.434895 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-8921fd60-537e-4606-8329-3c58c4734d06 req-0ef0c2f9-ebff-45e8-b94d-480144e31692 service nova] Creating event network-vif-plugged:7310a5fc-570a-4302-9485-9d166be6ece5 for instance 5904b0d2-fd7a-4f0e-92b9-757c056620fc on n-h1-master-1 Oct 30 01:18:08.440829 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d7020c64-22a9-406a-ab80-7da463e54b73 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/5904b0d2-fd7a-4f0e-92b9-757c056620fc" status: 200 len: 1317 microversion: 2.1 time: 0.343275 Oct 30 01:18:08.442841 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 704/1376] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:08 2022] GET /compute/v2.1/servers/5904b0d2-fd7a-4f0e-92b9-757c056620fc => generated 1317 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:08.459929 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-889f21af-8100-4f0a-9404-93231b738bed tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:08.459929 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-889f21af-8100-4f0a-9404-93231b738bed tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:08.460279 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-889f21af-8100-4f0a-9404-93231b738bed tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:08.460977 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-889f21af-8100-4f0a-9404-93231b738bed tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:08.461155 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-8921fd60-537e-4606-8329-3c58c4734d06 req-0ef0c2f9-ebff-45e8-b94d-480144e31692 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118198 Oct 30 01:18:08.462219 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-889f21af-8100-4f0a-9404-93231b738bed tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:08.466727 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 673/1377] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:18:08.475331 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-889f21af-8100-4f0a-9404-93231b738bed tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:08.476197 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-889f21af-8100-4f0a-9404-93231b738bed tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:08.478427 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-889f21af-8100-4f0a-9404-93231b738bed tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:08.485042 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fd1e3831-2093-4036-b604-032f2d92ad8d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:08.485042 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-fd1e3831-2093-4036-b604-032f2d92ad8d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 03d9aff4-215d-48fa-b741-2257b62fc597] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:08.809848 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-fd1e3831-2093-4036-b604-032f2d92ad8d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:08.819161 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fd1e3831-2093-4036-b604-032f2d92ad8d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597" status: 200 len: 1279 microversion: 2.1 time: 0.350628 Oct 30 01:18:08.833568 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 674/1378] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:08 2022] GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597 => generated 1279 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:08.844693 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ad75a298-9012-444c-99da-9adc72de8e5b tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:08.844693 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ad75a298-9012-444c-99da-9adc72de8e5b tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:08.858441 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ad75a298-9012-444c-99da-9adc72de8e5b tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:08.861489 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ad75a298-9012-444c-99da-9adc72de8e5b tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:08.862301 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ad75a298-9012-444c-99da-9adc72de8e5b tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:08.864823 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ad75a298-9012-444c-99da-9adc72de8e5b tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:08.865870 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ad75a298-9012-444c-99da-9adc72de8e5b tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:08.866311 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ad75a298-9012-444c-99da-9adc72de8e5b tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:08.967051 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-889f21af-8100-4f0a-9404-93231b738bed tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:08.972895 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-889f21af-8100-4f0a-9404-93231b738bed tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:08.974393 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-889f21af-8100-4f0a-9404-93231b738bed tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:08.985505 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-889f21af-8100-4f0a-9404-93231b738bed tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 200 len: 1813 microversion: 2.25 time: 0.540552 Oct 30 01:18:08.986107 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 705/1379] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:08 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 1813 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:18:09.197840 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ad75a298-9012-444c-99da-9adc72de8e5b tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:09.215241 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ad75a298-9012-444c-99da-9adc72de8e5b tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1478 microversion: 2.1 time: 0.384831 Oct 30 01:18:09.227440 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 675/1380] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:08 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1478 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:09.475221 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-be7fbcb3-2b06-42aa-8009-b7bd6e7f12ac tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:09.475221 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-be7fbcb3-2b06-42aa-8009-b7bd6e7f12ac tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 5904b0d2-fd7a-4f0e-92b9-757c056620fc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:09.489066 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-be7fbcb3-2b06-42aa-8009-b7bd6e7f12ac tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:09.491044 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-be7fbcb3-2b06-42aa-8009-b7bd6e7f12ac tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:09.491511 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-be7fbcb3-2b06-42aa-8009-b7bd6e7f12ac tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:09.504343 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-be7fbcb3-2b06-42aa-8009-b7bd6e7f12ac tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:09.504343 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-be7fbcb3-2b06-42aa-8009-b7bd6e7f12ac tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:09.504343 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-be7fbcb3-2b06-42aa-8009-b7bd6e7f12ac tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:09.504810 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9235da6c-383f-48c3-8c5f-84bf2684f348 tempest-FlavorsV255TestJSON-1980104491 tempest-FlavorsV255TestJSON-1980104491-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-252982413", "id": 391546765, "os-flavor-access:is_public": "True"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:18:09.603387 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9235da6c-383f-48c3-8c5f-84bf2684f348 tempest-FlavorsV255TestJSON-1980104491 tempest-FlavorsV255TestJSON-1980104491-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 445 microversion: 2.55 time: 0.588135 Oct 30 01:18:09.603963 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 706/1381] 10.222.0.13 () {62 vars in 1188 bytes} [Sun Oct 30 01:18:09 2022] POST /compute/v2.1/flavors => generated 445 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 30 01:18:09.680915 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-be7fbcb3-2b06-42aa-8009-b7bd6e7f12ac tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:09.691076 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-be7fbcb3-2b06-42aa-8009-b7bd6e7f12ac tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/5904b0d2-fd7a-4f0e-92b9-757c056620fc" status: 200 len: 1317 microversion: 2.1 time: 0.224808 Oct 30 01:18:09.697497 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 676/1382] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:09 2022] GET /compute/v2.1/servers/5904b0d2-fd7a-4f0e-92b9-757c056620fc => generated 1317 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:09.769264 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0009b861-21b8-4337-a282-f8bb2a0f28d5 tempest-FlavorsV255TestJSON-1953940230 tempest-FlavorsV255TestJSON-1953940230-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:09.779461 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0009b861-21b8-4337-a282-f8bb2a0f28d5 tempest-FlavorsV255TestJSON-1953940230 tempest-FlavorsV255TestJSON-1953940230-project] 10.222.0.13 "GET /compute/v2.1/flavors/391546765" status: 200 len: 445 microversion: 2.55 time: 0.165601 Oct 30 01:18:09.780042 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 707/1383] 10.222.0.13 () {60 vars in 1196 bytes} [Sun Oct 30 01:18:09 2022] GET /compute/v2.1/flavors/391546765 => generated 445 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 30 01:18:09.793913 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-65c5afc1-f20b-4942-a63c-9de8aa7a06cb tempest-FlavorsV255TestJSON-1980104491 tempest-FlavorsV255TestJSON-1980104491-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:18:09.845640 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-860b5e5b-bebd-48f2-9bd2-bd7bcbc0ccec tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:09.846764 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-860b5e5b-bebd-48f2-9bd2-bd7bcbc0ccec tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 03d9aff4-215d-48fa-b741-2257b62fc597] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:09.853541 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-860b5e5b-bebd-48f2-9bd2-bd7bcbc0ccec tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:09.854744 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-860b5e5b-bebd-48f2-9bd2-bd7bcbc0ccec tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:09.855396 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-860b5e5b-bebd-48f2-9bd2-bd7bcbc0ccec tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:09.856468 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-860b5e5b-bebd-48f2-9bd2-bd7bcbc0ccec tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:09.857233 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-860b5e5b-bebd-48f2-9bd2-bd7bcbc0ccec tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:09.858358 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-860b5e5b-bebd-48f2-9bd2-bd7bcbc0ccec tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:09.924513 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:09.929980 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-65c5afc1-f20b-4942-a63c-9de8aa7a06cb tempest-FlavorsV255TestJSON-1980104491 tempest-FlavorsV255TestJSON-1980104491-project-admin] 10.222.0.13 "PUT /compute/v2.1/flavors/391546765" status: 200 len: 446 microversion: 2.55 time: 0.139714 Oct 30 01:18:09.930772 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 677/1384] 10.222.0.13 () {62 vars in 1216 bytes} [Sun Oct 30 01:18:09 2022] PUT /compute/v2.1/flavors/391546765 => generated 446 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:18:09.939694 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fad3031c-f383-481f-bdeb-4da5f4b0b1db tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a441626-42b8-4f6e-af0c-8d51ce0d0d76"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:18:09.942504 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-fad3031c-f383-481f-bdeb-4da5f4b0b1db tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] [instance: 1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:09.946845 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-860b5e5b-bebd-48f2-9bd2-bd7bcbc0ccec tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:09.970276 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-860b5e5b-bebd-48f2-9bd2-bd7bcbc0ccec tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597" status: 200 len: 1283 microversion: 2.1 time: 0.113789 Oct 30 01:18:09.970276 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 708/1385] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:09 2022] GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597 => generated 1283 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:18:09.970276 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ca44d748-19ac-418b-8ab0-94a2306f6ac0 tempest-FlavorsV255TestJSON-1953940230 tempest-FlavorsV255TestJSON-1953940230-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:09.980985 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fad3031c-f383-481f-bdeb-4da5f4b0b1db tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:09.981637 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fad3031c-f383-481f-bdeb-4da5f4b0b1db tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:09.982084 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fad3031c-f383-481f-bdeb-4da5f4b0b1db tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:09.982810 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fad3031c-f383-481f-bdeb-4da5f4b0b1db tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:09.983275 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fad3031c-f383-481f-bdeb-4da5f4b0b1db tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:09.983987 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fad3031c-f383-481f-bdeb-4da5f4b0b1db tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:09.992138 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ca44d748-19ac-418b-8ab0-94a2306f6ac0 tempest-FlavorsV255TestJSON-1953940230 tempest-FlavorsV255TestJSON-1953940230-project] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 6231 microversion: 2.55 time: 0.035336 Oct 30 01:18:09.992734 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 709/1386] 10.222.0.13 () {60 vars in 1187 bytes} [Sun Oct 30 01:18:09 2022] GET /compute/v2.1/flavors/detail => generated 6231 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:18:10.015369 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9578631a-65ba-49bd-be74-bf40d4102722 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:10.017092 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9578631a-65ba-49bd-be74-bf40d4102722 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:10.029258 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9578631a-65ba-49bd-be74-bf40d4102722 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:10.031061 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9578631a-65ba-49bd-be74-bf40d4102722 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:10.031946 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9578631a-65ba-49bd-be74-bf40d4102722 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:10.033277 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9578631a-65ba-49bd-be74-bf40d4102722 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:10.034614 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9578631a-65ba-49bd-be74-bf40d4102722 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:10.035054 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9578631a-65ba-49bd-be74-bf40d4102722 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:10.210103 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9578631a-65ba-49bd-be74-bf40d4102722 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:10.219752 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9578631a-65ba-49bd-be74-bf40d4102722 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:10.221181 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9578631a-65ba-49bd-be74-bf40d4102722 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:10.222409 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9578631a-65ba-49bd-be74-bf40d4102722 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 200 len: 1813 microversion: 2.25 time: 0.213722 Oct 30 01:18:10.223128 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 710/1387] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:10 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 1813 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:18:10.227767 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6d572cb4-020d-4b8e-97ca-5e8e7416d1fd tempest-FlavorsV255TestJSON-1953940230 tempest-FlavorsV255TestJSON-1953940230-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:10.249233 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6d572cb4-020d-4b8e-97ca-5e8e7416d1fd tempest-FlavorsV255TestJSON-1953940230 tempest-FlavorsV255TestJSON-1953940230-project] 10.222.0.13 "GET /compute/v2.1/flavors" status: 200 len: 3492 microversion: 2.55 time: 0.024817 Oct 30 01:18:10.249850 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 711/1388] 10.222.0.13 () {60 vars in 1166 bytes} [Sun Oct 30 01:18:10 2022] GET /compute/v2.1/flavors => generated 3492 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:18:10.254538 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1e994c84-e15b-4602-bf61-e559ad135d69 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:10.255290 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1e994c84-e15b-4602-bf61-e559ad135d69 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:10.262099 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1e994c84-e15b-4602-bf61-e559ad135d69 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:10.262820 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1e994c84-e15b-4602-bf61-e559ad135d69 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:10.263500 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1e994c84-e15b-4602-bf61-e559ad135d69 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:10.264143 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1e994c84-e15b-4602-bf61-e559ad135d69 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:10.264674 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1e994c84-e15b-4602-bf61-e559ad135d69 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:10.265456 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1e994c84-e15b-4602-bf61-e559ad135d69 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:10.457503 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1e994c84-e15b-4602-bf61-e559ad135d69 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:10.467304 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1e994c84-e15b-4602-bf61-e559ad135d69 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1478 microversion: 2.1 time: 0.216142 Oct 30 01:18:10.470263 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 712/1389] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:10 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1478 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:10.480208 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1d6dc683-c37a-450f-a5a9-caf0924100af tempest-FlavorsV255TestJSON-1980104491 tempest-FlavorsV255TestJSON-1980104491-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:10.574877 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1d6dc683-c37a-450f-a5a9-caf0924100af tempest-FlavorsV255TestJSON-1980104491 tempest-FlavorsV255TestJSON-1980104491-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/391546765" status: 202 len: 0 microversion: 2.55 time: 0.102216 Oct 30 01:18:10.575634 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 713/1390] 10.222.0.13 () {60 vars in 1199 bytes} [Sun Oct 30 01:18:10 2022] DELETE /compute/v2.1/flavors/391546765 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:18:10.584239 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-7c275e39-d65c-4637-9952-8fcd17080523 req-dccc921b-36df-4c2d-bbee-97f7566a9de5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f10b90ae-23e1-4ca1-b95e-9404e606e5d9", "name": "network-vif-unplugged", "status": "completed", "tag": "9f14e853-78c5-4b79-8df2-448f8f1726ff"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:18:10.595932 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-7c275e39-d65c-4637-9952-8fcd17080523 req-dccc921b-36df-4c2d-bbee-97f7566a9de5 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:10.596420 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-7c275e39-d65c-4637-9952-8fcd17080523 req-dccc921b-36df-4c2d-bbee-97f7566a9de5 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:10.596852 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-7c275e39-d65c-4637-9952-8fcd17080523 req-dccc921b-36df-4c2d-bbee-97f7566a9de5 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:10.609915 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-7c275e39-d65c-4637-9952-8fcd17080523 req-dccc921b-36df-4c2d-bbee-97f7566a9de5 service nova] Creating event network-vif-unplugged:9f14e853-78c5-4b79-8df2-448f8f1726ff for instance f10b90ae-23e1-4ca1-b95e-9404e606e5d9 on n-h2-master-1 Oct 30 01:18:10.615130 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-7c275e39-d65c-4637-9952-8fcd17080523 req-dccc921b-36df-4c2d-bbee-97f7566a9de5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038114 Oct 30 01:18:10.616611 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 714/1391] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:18:10.622353 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fb7adb85-59d2-4976-b42f-efb2b5db5fbe tempest-FlavorsV255TestJSON-1980104491 tempest-FlavorsV255TestJSON-1980104491-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:10.644228 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fb7adb85-59d2-4976-b42f-efb2b5db5fbe tempest-FlavorsV255TestJSON-1980104491 tempest-FlavorsV255TestJSON-1980104491-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5795 microversion: 2.55 time: 0.026329 Oct 30 01:18:10.649501 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 715/1392] 10.222.0.13 () {60 vars in 1187 bytes} [Sun Oct 30 01:18:10 2022] GET /compute/v2.1/flavors/detail => generated 5795 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:18:10.723509 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1125a8e3-e4f2-4b08-8a6a-6271f8df1ae7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:10.726635 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1125a8e3-e4f2-4b08-8a6a-6271f8df1ae7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 5904b0d2-fd7a-4f0e-92b9-757c056620fc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:10.735492 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1125a8e3-e4f2-4b08-8a6a-6271f8df1ae7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:10.736350 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1125a8e3-e4f2-4b08-8a6a-6271f8df1ae7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:10.737043 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1125a8e3-e4f2-4b08-8a6a-6271f8df1ae7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:10.737887 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1125a8e3-e4f2-4b08-8a6a-6271f8df1ae7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:10.738547 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1125a8e3-e4f2-4b08-8a6a-6271f8df1ae7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:10.739046 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1125a8e3-e4f2-4b08-8a6a-6271f8df1ae7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:10.929283 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fad3031c-f383-481f-bdeb-4da5f4b0b1db tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] 10.222.0.13 "POST /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.996884 Oct 30 01:18:10.931148 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 678/1393] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 30 01:18:09 2022] POST /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1/os-volume_attachments => generated 194 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:18:10.940517 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1125a8e3-e4f2-4b08-8a6a-6271f8df1ae7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:10.951783 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1125a8e3-e4f2-4b08-8a6a-6271f8df1ae7 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/5904b0d2-fd7a-4f0e-92b9-757c056620fc" status: 200 len: 1467 microversion: 2.1 time: 0.240610 Oct 30 01:18:10.954634 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 716/1394] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:10 2022] GET /compute/v2.1/servers/5904b0d2-fd7a-4f0e-92b9-757c056620fc => generated 1467 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:10.993713 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8386cbd5-99e7-4a7a-b75a-d61c6034e97a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:10.994646 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8386cbd5-99e7-4a7a-b75a-d61c6034e97a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 03d9aff4-215d-48fa-b741-2257b62fc597] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:10.998492 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f7b77d94-883a-4d42-90bb-b88a1b208806 tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:10.999112 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f7b77d94-883a-4d42-90bb-b88a1b208806 tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] [instance: 5904b0d2-fd7a-4f0e-92b9-757c056620fc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:11.006708 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8386cbd5-99e7-4a7a-b75a-d61c6034e97a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:11.007525 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8386cbd5-99e7-4a7a-b75a-d61c6034e97a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:11.009306 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8386cbd5-99e7-4a7a-b75a-d61c6034e97a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:11.010548 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8386cbd5-99e7-4a7a-b75a-d61c6034e97a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:11.011217 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8386cbd5-99e7-4a7a-b75a-d61c6034e97a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:11.012333 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8386cbd5-99e7-4a7a-b75a-d61c6034e97a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:11.019073 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:11.031712 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f7b77d94-883a-4d42-90bb-b88a1b208806 tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:11.032218 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f7b77d94-883a-4d42-90bb-b88a1b208806 tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:11.032658 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f7b77d94-883a-4d42-90bb-b88a1b208806 tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:11.039637 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f7b77d94-883a-4d42-90bb-b88a1b208806 tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:11.041815 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f7b77d94-883a-4d42-90bb-b88a1b208806 tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:11.042336 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f7b77d94-883a-4d42-90bb-b88a1b208806 tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:11.166961 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8386cbd5-99e7-4a7a-b75a-d61c6034e97a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:11.194824 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8386cbd5-99e7-4a7a-b75a-d61c6034e97a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597" status: 200 len: 1331 microversion: 2.1 time: 0.198473 Oct 30 01:18:11.197223 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 679/1395] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:10 2022] GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597 => generated 1331 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:11.249677 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fb1b3651-bba0-4ca6-b1a1-4176fa8f26ea tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:11.264157 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-fb1b3651-bba0-4ca6-b1a1-4176fa8f26ea tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:11.278133 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fb1b3651-bba0-4ca6-b1a1-4176fa8f26ea tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:11.279919 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fb1b3651-bba0-4ca6-b1a1-4176fa8f26ea tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:11.281365 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fb1b3651-bba0-4ca6-b1a1-4176fa8f26ea tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:11.283842 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fb1b3651-bba0-4ca6-b1a1-4176fa8f26ea tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:11.284474 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fb1b3651-bba0-4ca6-b1a1-4176fa8f26ea tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:11.286887 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fb1b3651-bba0-4ca6-b1a1-4176fa8f26ea tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:11.484936 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:11.492543 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f7b77d94-883a-4d42-90bb-b88a1b208806 tempest-ServersOnMultiNodesTest-587661016 tempest-ServersOnMultiNodesTest-587661016-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/5904b0d2-fd7a-4f0e-92b9-757c056620fc" status: 200 len: 1618 microversion: 2.1 time: 0.501891 Oct 30 01:18:11.493680 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 717/1396] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:10 2022] GET /compute/v2.1/servers/5904b0d2-fd7a-4f0e-92b9-757c056620fc => generated 1618 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:11.498791 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3f293ad3-64c8-445d-a3a3-7a8605a326f6 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:11.500031 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3f293ad3-64c8-445d-a3a3-7a8605a326f6 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:11.515415 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f293ad3-64c8-445d-a3a3-7a8605a326f6 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:11.516350 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f293ad3-64c8-445d-a3a3-7a8605a326f6 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:11.517065 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f293ad3-64c8-445d-a3a3-7a8605a326f6 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:11.518025 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f293ad3-64c8-445d-a3a3-7a8605a326f6 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:11.518853 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f293ad3-64c8-445d-a3a3-7a8605a326f6 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:11.521981 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f293ad3-64c8-445d-a3a3-7a8605a326f6 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:11.721728 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-fb1b3651-bba0-4ca6-b1a1-4176fa8f26ea tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:11.736136 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-fb1b3651-bba0-4ca6-b1a1-4176fa8f26ea tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:11.737654 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-fb1b3651-bba0-4ca6-b1a1-4176fa8f26ea tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:11.743922 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fb1b3651-bba0-4ca6-b1a1-4176fa8f26ea tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 200 len: 1813 microversion: 2.25 time: 0.499966 Oct 30 01:18:11.762192 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 680/1397] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:11 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 1813 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:18:11.772379 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b4fd0234-c26d-44e1-95a8-6455b2a54141 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:11.775889 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b4fd0234-c26d-44e1-95a8-6455b2a54141 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 5904b0d2-fd7a-4f0e-92b9-757c056620fc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:11.783119 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4fd0234-c26d-44e1-95a8-6455b2a54141 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:11.783864 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4fd0234-c26d-44e1-95a8-6455b2a54141 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:11.784469 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4fd0234-c26d-44e1-95a8-6455b2a54141 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:11.785390 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4fd0234-c26d-44e1-95a8-6455b2a54141 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:11.794136 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4fd0234-c26d-44e1-95a8-6455b2a54141 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:11.794990 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4fd0234-c26d-44e1-95a8-6455b2a54141 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:11.850746 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b4fd0234-c26d-44e1-95a8-6455b2a54141 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 5904b0d2-fd7a-4f0e-92b9-757c056620fc] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:18:11.876509 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3f293ad3-64c8-445d-a3a3-7a8605a326f6 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:11.913704 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3f293ad3-64c8-445d-a3a3-7a8605a326f6 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1478 microversion: 2.1 time: 0.399545 Oct 30 01:18:11.916872 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 718/1398] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:11 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1478 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:12.220765 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a3b6741d-4941-41e1-aa64-5c7139bca518 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:12.221578 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a3b6741d-4941-41e1-aa64-5c7139bca518 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 03d9aff4-215d-48fa-b741-2257b62fc597] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:12.229442 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a3b6741d-4941-41e1-aa64-5c7139bca518 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:12.230376 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a3b6741d-4941-41e1-aa64-5c7139bca518 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:12.231005 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a3b6741d-4941-41e1-aa64-5c7139bca518 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:12.233215 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a3b6741d-4941-41e1-aa64-5c7139bca518 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:12.234667 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a3b6741d-4941-41e1-aa64-5c7139bca518 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:12.235444 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a3b6741d-4941-41e1-aa64-5c7139bca518 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:12.336202 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b4fd0234-c26d-44e1-95a8-6455b2a54141 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5904b0d2-fd7a-4f0e-92b9-757c056620fc" status: 204 len: 0 microversion: 2.1 time: 0.576220 Oct 30 01:18:12.337164 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 681/1399] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:18:11 2022] DELETE /compute/v2.1/servers/5904b0d2-fd7a-4f0e-92b9-757c056620fc => generated 0 bytes in 578 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:18:12.346136 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c38356ca-a001-47d8-8e04-968e7665a951 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:12.349266 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c38356ca-a001-47d8-8e04-968e7665a951 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 5904b0d2-fd7a-4f0e-92b9-757c056620fc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:12.367597 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c38356ca-a001-47d8-8e04-968e7665a951 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:12.368115 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c38356ca-a001-47d8-8e04-968e7665a951 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:12.368557 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c38356ca-a001-47d8-8e04-968e7665a951 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:12.373092 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c38356ca-a001-47d8-8e04-968e7665a951 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:12.374205 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c38356ca-a001-47d8-8e04-968e7665a951 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:12.374853 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c38356ca-a001-47d8-8e04-968e7665a951 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:12.469873 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a3b6741d-4941-41e1-aa64-5c7139bca518 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:12.483170 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a3b6741d-4941-41e1-aa64-5c7139bca518 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597" status: 200 len: 1331 microversion: 2.1 time: 0.266661 Oct 30 01:18:12.506645 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 719/1400] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:12 2022] GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597 => generated 1331 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:12.646617 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c38356ca-a001-47d8-8e04-968e7665a951 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:12.657017 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c38356ca-a001-47d8-8e04-968e7665a951 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/5904b0d2-fd7a-4f0e-92b9-757c056620fc" status: 200 len: 1473 microversion: 2.1 time: 0.315637 Oct 30 01:18:12.658878 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 682/1401] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:12 2022] GET /compute/v2.1/servers/5904b0d2-fd7a-4f0e-92b9-757c056620fc => generated 1473 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:18:12.774794 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-078379a3-6502-4541-a0bb-1749932c2490 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:12.776482 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-078379a3-6502-4541-a0bb-1749932c2490 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:12.797385 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-078379a3-6502-4541-a0bb-1749932c2490 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:12.798462 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-078379a3-6502-4541-a0bb-1749932c2490 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:12.798462 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-078379a3-6502-4541-a0bb-1749932c2490 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:12.799272 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-078379a3-6502-4541-a0bb-1749932c2490 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:12.800278 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-078379a3-6502-4541-a0bb-1749932c2490 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:12.800956 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-078379a3-6502-4541-a0bb-1749932c2490 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:12.948038 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bcccab36-621b-4aaa-9dc5-76f4484220fd tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:12.948998 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-bcccab36-621b-4aaa-9dc5-76f4484220fd tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:12.956303 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bcccab36-621b-4aaa-9dc5-76f4484220fd tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:12.957103 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bcccab36-621b-4aaa-9dc5-76f4484220fd tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:12.958583 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bcccab36-621b-4aaa-9dc5-76f4484220fd tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:12.959693 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bcccab36-621b-4aaa-9dc5-76f4484220fd tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:12.960463 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bcccab36-621b-4aaa-9dc5-76f4484220fd tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:12.961077 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bcccab36-621b-4aaa-9dc5-76f4484220fd tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:13.038375 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-078379a3-6502-4541-a0bb-1749932c2490 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:13.047822 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-078379a3-6502-4541-a0bb-1749932c2490 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:13.058087 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-078379a3-6502-4541-a0bb-1749932c2490 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:13.059604 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-078379a3-6502-4541-a0bb-1749932c2490 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 200 len: 1813 microversion: 2.25 time: 0.288907 Oct 30 01:18:13.060203 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 720/1402] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:12 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 1813 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:18:13.195024 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-bcccab36-621b-4aaa-9dc5-76f4484220fd tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:13.205301 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bcccab36-621b-4aaa-9dc5-76f4484220fd tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1478 microversion: 2.1 time: 0.265021 Oct 30 01:18:13.206812 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 683/1403] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:12 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1478 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:13.471337 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-8715ee14-474b-4c51-b173-331f502df323 req-12c2bb6c-b1ca-480d-8219-36aaee41a2e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f10b90ae-23e1-4ca1-b95e-9404e606e5d9", "name": "network-vif-plugged", "status": "completed", "tag": "9f14e853-78c5-4b79-8df2-448f8f1726ff"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:18:13.493782 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-8715ee14-474b-4c51-b173-331f502df323 req-12c2bb6c-b1ca-480d-8219-36aaee41a2e5 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:13.499499 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-8715ee14-474b-4c51-b173-331f502df323 req-12c2bb6c-b1ca-480d-8219-36aaee41a2e5 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:13.500054 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-8715ee14-474b-4c51-b173-331f502df323 req-12c2bb6c-b1ca-480d-8219-36aaee41a2e5 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:13.508540 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e2891d9f-3ba9-4da0-a340-e709d787824c tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:13.516669 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e2891d9f-3ba9-4da0-a340-e709d787824c tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 03d9aff4-215d-48fa-b741-2257b62fc597] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:13.525691 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2891d9f-3ba9-4da0-a340-e709d787824c tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:13.526710 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2891d9f-3ba9-4da0-a340-e709d787824c tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:13.528579 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2891d9f-3ba9-4da0-a340-e709d787824c tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:13.532172 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2891d9f-3ba9-4da0-a340-e709d787824c tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:13.534471 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2891d9f-3ba9-4da0-a340-e709d787824c tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:13.535192 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2891d9f-3ba9-4da0-a340-e709d787824c tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:13.542736 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-8715ee14-474b-4c51-b173-331f502df323 req-12c2bb6c-b1ca-480d-8219-36aaee41a2e5 service nova] Creating event network-vif-plugged:9f14e853-78c5-4b79-8df2-448f8f1726ff for instance f10b90ae-23e1-4ca1-b95e-9404e606e5d9 on n-h2-master-1 Oct 30 01:18:13.568162 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-8715ee14-474b-4c51-b173-331f502df323 req-12c2bb6c-b1ca-480d-8219-36aaee41a2e5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100197 Oct 30 01:18:13.572811 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 721/1404] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:18:13.673125 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e2891d9f-3ba9-4da0-a340-e709d787824c tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:13.682906 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1cccbca2-a316-42a4-b6ae-0e80dc57377b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:13.684891 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1cccbca2-a316-42a4-b6ae-0e80dc57377b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 5904b0d2-fd7a-4f0e-92b9-757c056620fc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:13.692900 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e2891d9f-3ba9-4da0-a340-e709d787824c tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597" status: 200 len: 1339 microversion: 2.1 time: 0.188378 Oct 30 01:18:13.715355 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1cccbca2-a316-42a4-b6ae-0e80dc57377b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:13.715355 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1cccbca2-a316-42a4-b6ae-0e80dc57377b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:13.715355 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1cccbca2-a316-42a4-b6ae-0e80dc57377b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:13.715355 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1cccbca2-a316-42a4-b6ae-0e80dc57377b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:13.715836 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1cccbca2-a316-42a4-b6ae-0e80dc57377b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:13.715836 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1cccbca2-a316-42a4-b6ae-0e80dc57377b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:13.716972 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 684/1405] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:13 2022] GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597 => generated 1339 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:14.035487 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1cccbca2-a316-42a4-b6ae-0e80dc57377b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:14.045813 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1cccbca2-a316-42a4-b6ae-0e80dc57377b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/5904b0d2-fd7a-4f0e-92b9-757c056620fc" status: 200 len: 1473 microversion: 2.1 time: 0.367696 Oct 30 01:18:14.069405 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 722/1406] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:13 2022] GET /compute/v2.1/servers/5904b0d2-fd7a-4f0e-92b9-757c056620fc => generated 1473 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:18:14.092880 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0abb183d-31dc-4854-afd7-fa00fef1c816 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:14.095936 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0abb183d-31dc-4854-afd7-fa00fef1c816 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:14.117587 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0abb183d-31dc-4854-afd7-fa00fef1c816 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:14.118077 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0abb183d-31dc-4854-afd7-fa00fef1c816 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:14.118515 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0abb183d-31dc-4854-afd7-fa00fef1c816 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:14.119234 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0abb183d-31dc-4854-afd7-fa00fef1c816 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:14.119686 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0abb183d-31dc-4854-afd7-fa00fef1c816 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:14.124394 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0abb183d-31dc-4854-afd7-fa00fef1c816 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:14.236495 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-acd45e00-52e1-47ba-91a1-d91d9ed4bf21 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:14.237441 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-acd45e00-52e1-47ba-91a1-d91d9ed4bf21 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:14.249963 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-acd45e00-52e1-47ba-91a1-d91d9ed4bf21 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:14.250463 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-acd45e00-52e1-47ba-91a1-d91d9ed4bf21 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:14.259310 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-acd45e00-52e1-47ba-91a1-d91d9ed4bf21 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:14.260099 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-acd45e00-52e1-47ba-91a1-d91d9ed4bf21 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:14.260578 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-acd45e00-52e1-47ba-91a1-d91d9ed4bf21 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:14.261010 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-acd45e00-52e1-47ba-91a1-d91d9ed4bf21 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:15.360144 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-acd45e00-52e1-47ba-91a1-d91d9ed4bf21 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:15.372399 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0abb183d-31dc-4854-afd7-fa00fef1c816 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:15.375999 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-acd45e00-52e1-47ba-91a1-d91d9ed4bf21 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1478 microversion: 2.1 time: 1.145327 Oct 30 01:18:15.383316 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0abb183d-31dc-4854-afd7-fa00fef1c816 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:15.399200 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 723/1407] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:14 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1478 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:15.409538 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0abb183d-31dc-4854-afd7-fa00fef1c816 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:15.414987 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0abb183d-31dc-4854-afd7-fa00fef1c816 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 200 len: 1813 microversion: 2.25 time: 1.328428 Oct 30 01:18:15.416679 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 685/1408] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:14 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 1813 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:18:15.439541 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8e7af86a-82d4-4c16-93a6-a8846eff15db tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:15.440165 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8e7af86a-82d4-4c16-93a6-a8846eff15db tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 03d9aff4-215d-48fa-b741-2257b62fc597] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:15.452559 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5cfa49b1-09c3-48e2-b5f1-9da944191564 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:15.453404 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5cfa49b1-09c3-48e2-b5f1-9da944191564 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 5904b0d2-fd7a-4f0e-92b9-757c056620fc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:15.465121 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5cfa49b1-09c3-48e2-b5f1-9da944191564 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:15.468141 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5cfa49b1-09c3-48e2-b5f1-9da944191564 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:15.470106 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5cfa49b1-09c3-48e2-b5f1-9da944191564 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:15.472504 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5cfa49b1-09c3-48e2-b5f1-9da944191564 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:15.473170 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5cfa49b1-09c3-48e2-b5f1-9da944191564 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:15.473654 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5cfa49b1-09c3-48e2-b5f1-9da944191564 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:15.477184 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8e7af86a-82d4-4c16-93a6-a8846eff15db tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:15.484899 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8e7af86a-82d4-4c16-93a6-a8846eff15db tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:15.486503 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8e7af86a-82d4-4c16-93a6-a8846eff15db tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:15.492452 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8e7af86a-82d4-4c16-93a6-a8846eff15db tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:15.493033 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8e7af86a-82d4-4c16-93a6-a8846eff15db tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:15.499458 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8e7af86a-82d4-4c16-93a6-a8846eff15db tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:15.916209 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8e7af86a-82d4-4c16-93a6-a8846eff15db tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:15.929618 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8e7af86a-82d4-4c16-93a6-a8846eff15db tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597" status: 200 len: 1337 microversion: 2.1 time: 0.543686 Oct 30 01:18:15.934425 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 724/1409] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:15 2022] GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597 => generated 1337 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:16.341586 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5cfa49b1-09c3-48e2-b5f1-9da944191564 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:16.361297 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5cfa49b1-09c3-48e2-b5f1-9da944191564 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/5904b0d2-fd7a-4f0e-92b9-757c056620fc" status: 200 len: 1473 microversion: 2.1 time: 0.928938 Oct 30 01:18:16.363519 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 686/1410] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:15 2022] GET /compute/v2.1/servers/5904b0d2-fd7a-4f0e-92b9-757c056620fc => generated 1473 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:16.408190 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7c1c8900-5427-4686-a529-f84a9885b429 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:16.408921 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7c1c8900-5427-4686-a529-f84a9885b429 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:16.430636 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7c1c8900-5427-4686-a529-f84a9885b429 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:16.433070 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7c1c8900-5427-4686-a529-f84a9885b429 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:16.433767 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7c1c8900-5427-4686-a529-f84a9885b429 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:16.436130 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7c1c8900-5427-4686-a529-f84a9885b429 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:16.437407 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7c1c8900-5427-4686-a529-f84a9885b429 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:16.438077 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7c1c8900-5427-4686-a529-f84a9885b429 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:16.454913 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-949fdc78-aa77-44e2-83a5-f0483634c344 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:16.456821 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-949fdc78-aa77-44e2-83a5-f0483634c344 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:16.475253 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-949fdc78-aa77-44e2-83a5-f0483634c344 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:16.475253 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-949fdc78-aa77-44e2-83a5-f0483634c344 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:16.475253 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-949fdc78-aa77-44e2-83a5-f0483634c344 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:16.475253 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-949fdc78-aa77-44e2-83a5-f0483634c344 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:16.475593 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-949fdc78-aa77-44e2-83a5-f0483634c344 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:16.475593 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-949fdc78-aa77-44e2-83a5-f0483634c344 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:18.060245 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:18.098439 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7c1c8900-5427-4686-a529-f84a9885b429 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:18.111299 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7c1c8900-5427-4686-a529-f84a9885b429 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1463 microversion: 2.1 time: 1.707557 Oct 30 01:18:18.115070 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 725/1411] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:16 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1463 bytes in 1712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:18.146474 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3aefbd40-dd39-4772-bec6-38f60ea2eaac tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:18.146672 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-949fdc78-aa77-44e2-83a5-f0483634c344 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:18.148359 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3aefbd40-dd39-4772-bec6-38f60ea2eaac tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 03d9aff4-215d-48fa-b741-2257b62fc597] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:18.161306 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3aefbd40-dd39-4772-bec6-38f60ea2eaac tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:18.162105 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-949fdc78-aa77-44e2-83a5-f0483634c344 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:18.163598 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-949fdc78-aa77-44e2-83a5-f0483634c344 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:18.166489 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3aefbd40-dd39-4772-bec6-38f60ea2eaac tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:18.167232 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3aefbd40-dd39-4772-bec6-38f60ea2eaac tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:18.168853 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3aefbd40-dd39-4772-bec6-38f60ea2eaac tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:18.170564 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3aefbd40-dd39-4772-bec6-38f60ea2eaac tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:18.172625 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3aefbd40-dd39-4772-bec6-38f60ea2eaac tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:18.173725 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-949fdc78-aa77-44e2-83a5-f0483634c344 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 200 len: 1813 microversion: 2.25 time: 1.730368 Oct 30 01:18:18.178561 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 687/1412] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:16 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 1813 bytes in 1736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:18:18.198417 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d1411531-0c24-4782-bcec-12dedf72993d tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:18.199056 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d1411531-0c24-4782-bcec-12dedf72993d tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 5904b0d2-fd7a-4f0e-92b9-757c056620fc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:18.254083 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d1411531-0c24-4782-bcec-12dedf72993d tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:18.255073 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d1411531-0c24-4782-bcec-12dedf72993d tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:18.255650 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d1411531-0c24-4782-bcec-12dedf72993d tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:18.256726 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d1411531-0c24-4782-bcec-12dedf72993d tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:18.257866 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d1411531-0c24-4782-bcec-12dedf72993d tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:18.261152 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d1411531-0c24-4782-bcec-12dedf72993d tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:18.818088 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=18 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:19.040569 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d1411531-0c24-4782-bcec-12dedf72993d tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:19.059891 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d1411531-0c24-4782-bcec-12dedf72993d tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/5904b0d2-fd7a-4f0e-92b9-757c056620fc" status: 200 len: 1302 microversion: 2.1 time: 0.874273 Oct 30 01:18:19.064839 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 688/1413] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:18 2022] GET /compute/v2.1/servers/5904b0d2-fd7a-4f0e-92b9-757c056620fc => generated 1302 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:19.081985 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-b6db8a50-524b-4bb4-a0ea-31bfc0458e51 req-4c840e5c-e0bc-4adb-b1db-a4616c7bbdd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5904b0d2-fd7a-4f0e-92b9-757c056620fc", "name": "network-vif-deleted", "tag": "7310a5fc-570a-4302-9485-9d166be6ece5"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:18:19.119692 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-b6db8a50-524b-4bb4-a0ea-31bfc0458e51 req-4c840e5c-e0bc-4adb-b1db-a4616c7bbdd4 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:19.141726 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-b6db8a50-524b-4bb4-a0ea-31bfc0458e51 req-4c840e5c-e0bc-4adb-b1db-a4616c7bbdd4 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:19.141726 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-b6db8a50-524b-4bb4-a0ea-31bfc0458e51 req-4c840e5c-e0bc-4adb-b1db-a4616c7bbdd4 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:19.192694 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-b6db8a50-524b-4bb4-a0ea-31bfc0458e51 req-4c840e5c-e0bc-4adb-b1db-a4616c7bbdd4 service nova] Creating event network-vif-deleted:7310a5fc-570a-4302-9485-9d166be6ece5 for instance 5904b0d2-fd7a-4f0e-92b9-757c056620fc on n-h1-master-1 Oct 30 01:18:19.222654 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-b6db8a50-524b-4bb4-a0ea-31bfc0458e51 req-4c840e5c-e0bc-4adb-b1db-a4616c7bbdd4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155050 Oct 30 01:18:19.232047 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 689/1414] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:18:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:18:19.261947 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-26baadc9-22ea-4e25-ae19-d382e60ab2b7 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:18:19.264938 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-26baadc9-22ea-4e25-ae19-d382e60ab2b7 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:19.293470 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-26baadc9-22ea-4e25-ae19-d382e60ab2b7 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:19.294358 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-26baadc9-22ea-4e25-ae19-d382e60ab2b7 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:19.299012 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-26baadc9-22ea-4e25-ae19-d382e60ab2b7 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:19.299012 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-26baadc9-22ea-4e25-ae19-d382e60ab2b7 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:19.299012 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-26baadc9-22ea-4e25-ae19-d382e60ab2b7 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:19.300724 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-26baadc9-22ea-4e25-ae19-d382e60ab2b7 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:19.689221 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3aefbd40-dd39-4772-bec6-38f60ea2eaac tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:19.698885 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3aefbd40-dd39-4772-bec6-38f60ea2eaac tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597" status: 200 len: 1379 microversion: 2.1 time: 1.582151 Oct 30 01:18:19.704597 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 726/1415] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:18 2022] GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597 => generated 1379 bytes in 1589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:19.758640 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-26baadc9-22ea-4e25-ae19-d382e60ab2b7 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9/action" status: 202 len: 0 microversion: 2.1 time: 0.524752 Oct 30 01:18:19.761472 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 690/1416] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:18:19 2022] POST /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9/action => generated 0 bytes in 529 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:18:19.775690 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b38afb45-2926-4996-a57e-31d40fd11ffc tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:19.777230 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b38afb45-2926-4996-a57e-31d40fd11ffc tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:19.823795 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b38afb45-2926-4996-a57e-31d40fd11ffc tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:19.830684 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b38afb45-2926-4996-a57e-31d40fd11ffc tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:19.833212 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b38afb45-2926-4996-a57e-31d40fd11ffc tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:19.840393 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b38afb45-2926-4996-a57e-31d40fd11ffc tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:19.844954 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b38afb45-2926-4996-a57e-31d40fd11ffc tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:19.845376 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b38afb45-2926-4996-a57e-31d40fd11ffc tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:20.202962 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-032f78cc-9686-4e8d-ba20-8700cb8ce303 tempest-HypervisorAdminNegativeTestJSON-204969714 tempest-HypervisorAdminNegativeTestJSON-204969714-project] Calling method '.version_select at 0x7f44cc03f9d0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:20.204973 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-032f78cc-9686-4e8d-ba20-8700cb8ce303 tempest-HypervisorAdminNegativeTestJSON-204969714 tempest-HypervisorAdminNegativeTestJSON-204969714-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '74770187af4e41469fc13f21d61b0550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21528130be244950b9cbbe640dfd3cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:20.206908 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-032f78cc-9686-4e8d-ba20-8700cb8ce303 tempest-HypervisorAdminNegativeTestJSON-204969714 tempest-HypervisorAdminNegativeTestJSON-204969714-project] Request method failure captured: Oct 30 01:18:20.206908 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 30 01:18:20.206908 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:18:20.206908 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:18:20.206908 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:18:20.206908 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:18:20.206908 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:18:20.206908 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:18:20.206908 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:18:20.206908 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:18:20.206908 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdDYyZFCsMvQHZ7gXpKCQ6VhJLz_JnXR7oKgJ0789ZMMEkdfg0BgU051pX4OtMqWgd3os4frnVjZL9I3v3h3_4HLdQYtFxpEjq9iAB0rGGDs4hiknPTVq0e1A1B4_FiXy3giYzdKnHgm9nM9WM1scH6rseTJ8dipZpsdvU9TxXN97hQ Oct 30 01:18:20.206908 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:18:20.206908 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:18:20.206908 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:18:20.206908 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:18:20.206908 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:18:20.206908 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:18:20.206908 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 21528130be244950b9cbbe640dfd3cf4 Oct 30 01:18:20.206908 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-204969714 Oct 30 01:18:20.206908 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:18:20.206908 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:18:20.214626 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/21528130be244950b9cbbe640dfd3cf4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_21528130be244950b9cbbe640dfd3cf4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/21528130be244950b9cbbe640dfd3cf4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/21528130be244950b9cbbe640dfd3cf4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:18:20.214626 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-204969714 Oct 30 01:18:20.214626 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 21528130be244950b9cbbe640dfd3cf4 Oct 30 01:18:20.214626 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-204969714 Oct 30 01:18:20.214626 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-HypervisorAdminNegativeTestJSON-204969714-project Oct 30 01:18:20.214626 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:18:20.214626 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:18:20.214626 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 74770187af4e41469fc13f21d61b0550 Oct 30 01:18:20.214626 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-204969714-project Oct 30 01:18:20.214626 n-d-master-1 devstack@n-api.service[121102]: method: Oct 30 01:18:20.214626 n-d-master-1 devstack@n-api.service[121102]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 30 01:18:20.214626 n-d-master-1 devstack@n-api.service[121102]: action_args: {} Oct 30 01:18:20.214626 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:18:20.215605 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:20.215605 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:18:20.215605 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:18:20.215605 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:18:20.215605 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:18:20.215605 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:18:20.215605 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:18:20.215605 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:18:20.215605 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:18:20.215605 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 30 01:18:20.215605 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 30 01:18:20.215605 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 30 01:18:20.215605 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 30 01:18:20.215605 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 30 01:18:20.215605 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 30 01:18:20.215605 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 30 01:18:20.215605 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 30 01:18:20.215605 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 01:18:20.215605 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 30 01:18:20.217063 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 01:18:20.217063 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise self.value Oct 30 01:18:20.217063 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 30 01:18:20.217063 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 30 01:18:20.217063 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 30 01:18:20.217063 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 30 01:18:20.217063 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 30 01:18:20.217063 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 30 01:18:20.217063 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 30 01:18:20.217063 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:18:20.217063 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:18:20.217063 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:18:20.217063 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:20.217063 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:18:20.217063 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:18:20.217063 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 30 01:18:20.217063 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 30 01:18:20.217063 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 30 01:18:20.217063 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:18:20.218551 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-032f78cc-9686-4e8d-ba20-8700cb8ce303 tempest-HypervisorAdminNegativeTestJSON-204969714 tempest-HypervisorAdminNegativeTestJSON-204969714-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:18:20.218551 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-032f78cc-9686-4e8d-ba20-8700cb8ce303 tempest-HypervisorAdminNegativeTestJSON-204969714 tempest-HypervisorAdminNegativeTestJSON-204969714-project] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.496063 Oct 30 01:18:20.218551 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 727/1417] 10.222.0.13 () {58 vars in 1167 bytes} [Sun Oct 30 01:18:19 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 505 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:18:20.233412 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1260ecaf-6534-4bf6-bfa6-43335fa5462b tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:20.234296 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1260ecaf-6534-4bf6-bfa6-43335fa5462b tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:20.243856 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1260ecaf-6534-4bf6-bfa6-43335fa5462b tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:20.244631 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1260ecaf-6534-4bf6-bfa6-43335fa5462b tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:20.246784 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1260ecaf-6534-4bf6-bfa6-43335fa5462b tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:20.247726 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1260ecaf-6534-4bf6-bfa6-43335fa5462b tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:20.250585 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1260ecaf-6534-4bf6-bfa6-43335fa5462b tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:20.251208 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1260ecaf-6534-4bf6-bfa6-43335fa5462b tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:20.312145 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1260ecaf-6534-4bf6-bfa6-43335fa5462b tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:20.312942 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1260ecaf-6534-4bf6-bfa6-43335fa5462b tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:20.314086 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1260ecaf-6534-4bf6-bfa6-43335fa5462b tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:20.314896 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-1260ecaf-6534-4bf6-bfa6-43335fa5462b tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lazy-loading 'fault' on Instance uuid f10b90ae-23e1-4ca1-b95e-9404e606e5d9 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:18:20.678265 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b38afb45-2926-4996-a57e-31d40fd11ffc tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:20.695439 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b38afb45-2926-4996-a57e-31d40fd11ffc tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:20.702513 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b38afb45-2926-4996-a57e-31d40fd11ffc tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:20.706365 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b38afb45-2926-4996-a57e-31d40fd11ffc tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 200 len: 1813 microversion: 2.25 time: 0.943806 Oct 30 01:18:20.710486 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 691/1418] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:19 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 1813 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:18:20.722166 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8662dc7e-85ed-4dac-bcc4-5a9bf94cb1d9 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:20.723992 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8662dc7e-85ed-4dac-bcc4-5a9bf94cb1d9 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 5904b0d2-fd7a-4f0e-92b9-757c056620fc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:20.743786 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8662dc7e-85ed-4dac-bcc4-5a9bf94cb1d9 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:20.744309 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8662dc7e-85ed-4dac-bcc4-5a9bf94cb1d9 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:20.744744 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8662dc7e-85ed-4dac-bcc4-5a9bf94cb1d9 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:20.745563 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8662dc7e-85ed-4dac-bcc4-5a9bf94cb1d9 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:20.746199 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8662dc7e-85ed-4dac-bcc4-5a9bf94cb1d9 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:20.746785 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8662dc7e-85ed-4dac-bcc4-5a9bf94cb1d9 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:20.784469 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-8662dc7e-85ed-4dac-bcc4-5a9bf94cb1d9 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] HTTP exception thrown: Instance 5904b0d2-fd7a-4f0e-92b9-757c056620fc could not be found. Oct 30 01:18:20.786546 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8662dc7e-85ed-4dac-bcc4-5a9bf94cb1d9 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Request method failure captured: Oct 30 01:18:20.786546 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/5904b0d2-fd7a-4f0e-92b9-757c056620fc HTTP/1.1 Oct 30 01:18:20.786546 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:18:20.786546 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:18:20.786546 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:18:20.786546 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:18:20.786546 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:18:20.786546 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:18:20.786546 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:18:20.786546 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:18:20.786546 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdAyWG8ULueMlzGM_sHwJ9SOWADIPTb7By9fNsRcbHROHwygMRdk9IkmaCTF8DGTaB-qJmpNM38UnmXLKL5MROOCKmetoapYOI7trRPWkBfioCQrOG4AuSuVej_G20QC_MDzAmUbQ-QTCr2g6dCwwHCik9ACvFc8hu-sRLY-wv25V6Q Oct 30 01:18:20.786546 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:18:20.786546 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:18:20.786546 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:18:20.786546 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:18:20.786546 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:18:20.786546 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:18:20.786546 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 76b6f7b705f5428b9a3a3a8c4f86ff48 Oct 30 01:18:20.786546 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersOnMultiNodesTest-1214334609 Oct 30 01:18:20.786546 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:18:20.786546 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:18:20.787963 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/76b6f7b705f5428b9a3a3a8c4f86ff48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_76b6f7b705f5428b9a3a3a8c4f86ff48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/76b6f7b705f5428b9a3a3a8c4f86ff48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/76b6f7b705f5428b9a3a3a8c4f86ff48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:18:20.787963 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersOnMultiNodesTest-1214334609 Oct 30 01:18:20.787963 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 76b6f7b705f5428b9a3a3a8c4f86ff48 Oct 30 01:18:20.787963 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1214334609 Oct 30 01:18:20.787963 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersOnMultiNodesTest-1214334609-project Oct 30 01:18:20.787963 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:18:20.787963 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:18:20.787963 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: c536d41a93ad4337909fe2e2cb949e03 Oct 30 01:18:20.787963 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersOnMultiNodesTest-1214334609-project Oct 30 01:18:20.787963 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:18:20.787963 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 5904b0d2-fd7a-4f0e-92b9-757c056620fc could not be found. Oct 30 01:18:20.787963 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '5904b0d2-fd7a-4f0e-92b9-757c056620fc'} Oct 30 01:18:20.788768 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:18:20.788768 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:20.788768 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:18:20.788768 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:18:20.788768 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:18:20.788768 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:18:20.788768 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:18:20.788768 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:18:20.788768 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:18:20.788768 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:18:20.788768 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5904b0d2-fd7a-4f0e-92b9-757c056620fc could not be found. Oct 30 01:18:20.788768 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:20.788768 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:18:20.788768 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:20.788768 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:20.788768 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:18:20.788768 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:18:20.788768 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:18:20.788768 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:18:20.788768 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:18:20.790125 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:18:20.790125 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:18:20.790125 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:18:20.790125 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:18:20.790125 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:18:20.790125 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:18:20.790125 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:18:20.790125 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5904b0d2-fd7a-4f0e-92b9-757c056620fc could not be found. Oct 30 01:18:20.790125 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:20.790125 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:18:20.790125 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:20.790125 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:20.790125 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:18:20.790125 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:18:20.790125 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:18:20.790125 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:18:20.790125 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5904b0d2-fd7a-4f0e-92b9-757c056620fc could not be found. Oct 30 01:18:20.790125 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:20.793804 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8662dc7e-85ed-4dac-bcc4-5a9bf94cb1d9 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Returning 404 to user: Instance 5904b0d2-fd7a-4f0e-92b9-757c056620fc could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:18:20.795025 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8662dc7e-85ed-4dac-bcc4-5a9bf94cb1d9 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/5904b0d2-fd7a-4f0e-92b9-757c056620fc" status: 404 len: 111 microversion: 2.1 time: 0.083089 Oct 30 01:18:20.799222 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 692/1419] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:20 2022] GET /compute/v2.1/servers/5904b0d2-fd7a-4f0e-92b9-757c056620fc => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:18:20.804252 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c39c61ad-05b8-4231-83a2-6dadfb427078 tempest-HypervisorAdminNegativeTestJSON-204969714 tempest-HypervisorAdminNegativeTestJSON-204969714-project] Calling method '.version_select at 0x7f44c7e7e0d0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:20.806379 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c39c61ad-05b8-4231-83a2-6dadfb427078 tempest-HypervisorAdminNegativeTestJSON-204969714 tempest-HypervisorAdminNegativeTestJSON-204969714-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '74770187af4e41469fc13f21d61b0550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21528130be244950b9cbbe640dfd3cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:20.808029 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c39c61ad-05b8-4231-83a2-6dadfb427078 tempest-HypervisorAdminNegativeTestJSON-204969714 tempest-HypervisorAdminNegativeTestJSON-204969714-project] Request method failure captured: Oct 30 01:18:20.808029 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 30 01:18:20.808029 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:18:20.808029 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:18:20.808029 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:18:20.808029 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:18:20.808029 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:18:20.808029 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:18:20.808029 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:18:20.808029 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:18:20.808029 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdDYyZFCsMvQHZ7gXpKCQ6VhJLz_JnXR7oKgJ0789ZMMEkdfg0BgU051pX4OtMqWgd3os4frnVjZL9I3v3h3_4HLdQYtFxpEjq9iAB0rGGDs4hiknPTVq0e1A1B4_FiXy3giYzdKnHgm9nM9WM1scH6rseTJ8dipZpsdvU9TxXN97hQ Oct 30 01:18:20.808029 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:18:20.808029 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:18:20.808029 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:18:20.808029 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:18:20.808029 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:18:20.808029 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:18:20.808029 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 21528130be244950b9cbbe640dfd3cf4 Oct 30 01:18:20.808029 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-204969714 Oct 30 01:18:20.808029 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:18:20.808029 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:18:20.809409 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/21528130be244950b9cbbe640dfd3cf4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_21528130be244950b9cbbe640dfd3cf4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/21528130be244950b9cbbe640dfd3cf4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/21528130be244950b9cbbe640dfd3cf4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:18:20.809409 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-204969714 Oct 30 01:18:20.809409 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 21528130be244950b9cbbe640dfd3cf4 Oct 30 01:18:20.809409 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-204969714 Oct 30 01:18:20.809409 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-HypervisorAdminNegativeTestJSON-204969714-project Oct 30 01:18:20.809409 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:18:20.809409 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:18:20.809409 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 74770187af4e41469fc13f21d61b0550 Oct 30 01:18:20.809409 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-204969714-project Oct 30 01:18:20.809409 n-d-master-1 devstack@n-api.service[121103]: method: Oct 30 01:18:20.809409 n-d-master-1 devstack@n-api.service[121103]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 30 01:18:20.809409 n-d-master-1 devstack@n-api.service[121103]: action_args: {} Oct 30 01:18:20.809409 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:18:20.810261 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:20.810261 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:18:20.810261 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:18:20.810261 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:18:20.810261 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:18:20.810261 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:18:20.810261 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:18:20.810261 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:18:20.810261 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:18:20.810261 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 30 01:18:20.810261 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 30 01:18:20.810261 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 30 01:18:20.810261 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 30 01:18:20.810261 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 30 01:18:20.810261 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 30 01:18:20.810261 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 30 01:18:20.810261 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 30 01:18:20.810261 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 01:18:20.810261 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 30 01:18:20.811584 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 01:18:20.811584 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise self.value Oct 30 01:18:20.811584 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 30 01:18:20.811584 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 30 01:18:20.811584 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 30 01:18:20.811584 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 30 01:18:20.811584 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 30 01:18:20.811584 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 30 01:18:20.811584 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 30 01:18:20.811584 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:20.811584 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:18:20.811584 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:20.811584 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:20.811584 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:18:20.811584 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:18:20.811584 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 30 01:18:20.811584 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 30 01:18:20.811584 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 30 01:18:20.811584 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:20.812763 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c39c61ad-05b8-4231-83a2-6dadfb427078 tempest-HypervisorAdminNegativeTestJSON-204969714 tempest-HypervisorAdminNegativeTestJSON-204969714-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:18:20.812763 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c39c61ad-05b8-4231-83a2-6dadfb427078 tempest-HypervisorAdminNegativeTestJSON-204969714 tempest-HypervisorAdminNegativeTestJSON-204969714-project] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.009092 Oct 30 01:18:20.812763 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 693/1420] 10.222.0.13 () {58 vars in 1146 bytes} [Sun Oct 30 01:18:20 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:18:20.882509 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1260ecaf-6534-4bf6-bfa6-43335fa5462b tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1597 microversion: 2.1 time: 0.666086 Oct 30 01:18:20.885056 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 728/1421] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:20 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1597 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:20.893494 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3bdd8627-9cb4-436c-aaeb-5f6384e6686f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:20.894118 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3bdd8627-9cb4-436c-aaeb-5f6384e6686f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 03d9aff4-215d-48fa-b741-2257b62fc597] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:20.911219 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3bdd8627-9cb4-436c-aaeb-5f6384e6686f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:20.916351 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3bdd8627-9cb4-436c-aaeb-5f6384e6686f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:20.917456 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3bdd8627-9cb4-436c-aaeb-5f6384e6686f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:20.919459 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3bdd8627-9cb4-436c-aaeb-5f6384e6686f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:20.926784 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3bdd8627-9cb4-436c-aaeb-5f6384e6686f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:20.926784 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3bdd8627-9cb4-436c-aaeb-5f6384e6686f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:20.946041 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-69e4ef5b-6849-43b7-bfd1-8ee3ddef7675 tempest-FloatingIPDetailsNegativeTestJSON-408330737 tempest-FloatingIPDetailsNegativeTestJSON-408330737-project] Calling method '.version_select at 0x7f44c7de6550>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:21.561988 n-d-master-1 devstack@n-api.service[121103]: DEBUG neutronclient.v2_0.client [None req-69e4ef5b-6849-43b7-bfd1-8ee3ddef7675 tempest-FloatingIPDetailsNegativeTestJSON-408330737 tempest-FloatingIPDetailsNegativeTestJSON-408330737-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 993c3a5a-b079-4337-88b3-1a80b6f0df38 could not be found", "detail": ""}} {{(pid=121103) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 30 01:18:21.562682 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-69e4ef5b-6849-43b7-bfd1-8ee3ddef7675 tempest-FloatingIPDetailsNegativeTestJSON-408330737 tempest-FloatingIPDetailsNegativeTestJSON-408330737-project] HTTP exception thrown: Floating IP not found for ID 993c3a5a-b079-4337-88b3-1a80b6f0df38 Oct 30 01:18:21.587099 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-69e4ef5b-6849-43b7-bfd1-8ee3ddef7675 tempest-FloatingIPDetailsNegativeTestJSON-408330737 tempest-FloatingIPDetailsNegativeTestJSON-408330737-project] Request method failure captured: Oct 30 01:18:21.587099 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/os-floating-ips/993c3a5a-b079-4337-88b3-1a80b6f0df38 HTTP/1.1 Oct 30 01:18:21.587099 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:18:21.587099 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:18:21.587099 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:18:21.587099 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:18:21.587099 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:18:21.587099 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:18:21.587099 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:18:21.587099 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:18:21.587099 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdDcDEKWngoQkKxyVCw3Lj2q4z_TV7UtEm0eSKiwrBLiuAifF9bK836S4RC9G3df5V_viuF39y5wrZH-nK1ArqktTGB6kGHI7VtdQxCoI8i_GKLcyHKA62-VLVHhIA9z0GLXMtnVt3U19ouX1Sc-jwdrC5Ui9hMMfbWE-Cmwqrfp6j0 Oct 30 01:18:21.587099 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:18:21.587099 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:18:21.587099 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:18:21.587099 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:18:21.587099 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:18:21.587099 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:18:21.587099 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: e70c0e4e43f849f393ca200c3d838e23 Oct 30 01:18:21.587099 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-408330737 Oct 30 01:18:21.587099 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:18:21.587099 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:18:21.589192 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e70c0e4e43f849f393ca200c3d838e23"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e70c0e4e43f849f393ca200c3d838e23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e70c0e4e43f849f393ca200c3d838e23"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e70c0e4e43f849f393ca200c3d838e23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:18:21.589192 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-408330737 Oct 30 01:18:21.589192 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: e70c0e4e43f849f393ca200c3d838e23 Oct 30 01:18:21.589192 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-408330737 Oct 30 01:18:21.589192 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-408330737-project Oct 30 01:18:21.589192 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:18:21.589192 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:18:21.589192 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: e9f264c3e1ff43e7926ee1200a9c4d09 Oct 30 01:18:21.589192 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-408330737-project Oct 30 01:18:21.589192 n-d-master-1 devstack@n-api.service[121103]: method: Oct 30 01:18:21.589192 n-d-master-1 devstack@n-api.service[121103]: exception: Floating IP not found for ID 993c3a5a-b079-4337-88b3-1a80b6f0df38 Oct 30 01:18:21.589192 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '993c3a5a-b079-4337-88b3-1a80b6f0df38'} Oct 30 01:18:21.592468 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:18:21.592468 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:21.592468 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 30 01:18:21.592468 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 30 01:18:21.592468 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:18:21.592468 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:18:21.592468 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 30 01:18:21.592468 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 30 01:18:21.592468 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:18:21.592468 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:18:21.592468 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 30 01:18:21.592468 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 30 01:18:21.592468 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:18:21.592468 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:18:21.592468 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 30 01:18:21.592468 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 30 01:18:21.592468 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:18:21.592468 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:18:21.592468 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 30 01:18:21.596615 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 30 01:18:21.596615 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:18:21.596615 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:18:21.596615 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 30 01:18:21.596615 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 30 01:18:21.596615 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 30 01:18:21.596615 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 30 01:18:21.596615 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 993c3a5a-b079-4337-88b3-1a80b6f0df38 could not be found Oct 30 01:18:21.596615 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d65bd66c-bb17-4688-8136-b3d76cfbe6c6'] Oct 30 01:18:21.596615 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:21.596615 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:18:21.596615 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:21.596615 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:21.596615 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 30 01:18:21.596615 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 30 01:18:21.596615 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 30 01:18:21.596615 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 30 01:18:21.596615 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 993c3a5a-b079-4337-88b3-1a80b6f0df38. Oct 30 01:18:21.596615 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:21.602221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:18:21.602221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:21.602221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:21.602221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:18:21.602221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:18:21.602221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:18:21.602221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:18:21.602221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:18:21.602221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:18:21.602221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:18:21.602221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:18:21.602221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 30 01:18:21.602221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 30 01:18:21.602221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 993c3a5a-b079-4337-88b3-1a80b6f0df38 Oct 30 01:18:21.602221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:21.602221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:18:21.602221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:21.602221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:21.602221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:18:21.602221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:18:21.602221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:18:21.605381 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:18:21.605381 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 993c3a5a-b079-4337-88b3-1a80b6f0df38 Oct 30 01:18:21.605381 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:21.605381 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-69e4ef5b-6849-43b7-bfd1-8ee3ddef7675 tempest-FloatingIPDetailsNegativeTestJSON-408330737 tempest-FloatingIPDetailsNegativeTestJSON-408330737-project] Returning 404 to user: Floating IP not found for ID 993c3a5a-b079-4337-88b3-1a80b6f0df38 {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:18:21.605381 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-69e4ef5b-6849-43b7-bfd1-8ee3ddef7675 tempest-FloatingIPDetailsNegativeTestJSON-408330737 tempest-FloatingIPDetailsNegativeTestJSON-408330737-project] 10.222.0.13 "GET /compute/v2.1/os-floating-ips/993c3a5a-b079-4337-88b3-1a80b6f0df38" status: 404 len: 111 microversion: 2.1 time: 0.777493 Oct 30 01:18:21.605381 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 694/1422] 10.222.0.13 () {58 vars in 1260 bytes} [Sun Oct 30 01:18:20 2022] GET /compute/v2.1/os-floating-ips/993c3a5a-b079-4337-88b3-1a80b6f0df38 => generated 111 bytes in 782 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:18:21.605381 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3e79b896-c5eb-43a8-8b1d-0093591dc42d tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:21.606269 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3e79b896-c5eb-43a8-8b1d-0093591dc42d tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 5387ae83-7934-49d6-a893-3661477ffe69] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:21.626262 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3e79b896-c5eb-43a8-8b1d-0093591dc42d tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:21.627473 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3e79b896-c5eb-43a8-8b1d-0093591dc42d tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:21.628653 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3e79b896-c5eb-43a8-8b1d-0093591dc42d tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:21.630243 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3e79b896-c5eb-43a8-8b1d-0093591dc42d tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:21.631580 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3e79b896-c5eb-43a8-8b1d-0093591dc42d tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:21.632822 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3e79b896-c5eb-43a8-8b1d-0093591dc42d tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:21.694533 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3e79b896-c5eb-43a8-8b1d-0093591dc42d tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 5387ae83-7934-49d6-a893-3661477ffe69] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:18:21.714950 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:21.723080 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3bdd8627-9cb4-436c-aaeb-5f6384e6686f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:21.737646 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3bdd8627-9cb4-436c-aaeb-5f6384e6686f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597" status: 200 len: 1379 microversion: 2.1 time: 0.851200 Oct 30 01:18:21.738515 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 729/1423] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:20 2022] GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597 => generated 1379 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:21.749742 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-828a51a2-e57c-4f54-8b93-d7123068a5d6 tempest-HypervisorAdminNegativeTestJSON-204969714 tempest-HypervisorAdminNegativeTestJSON-204969714-project] Calling method '.version_select at 0x7f44c7f34af0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:21.762208 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-828a51a2-e57c-4f54-8b93-d7123068a5d6 tempest-HypervisorAdminNegativeTestJSON-204969714 tempest-HypervisorAdminNegativeTestJSON-204969714-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '74770187af4e41469fc13f21d61b0550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21528130be244950b9cbbe640dfd3cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:21.764928 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-828a51a2-e57c-4f54-8b93-d7123068a5d6 tempest-HypervisorAdminNegativeTestJSON-204969714 tempest-HypervisorAdminNegativeTestJSON-204969714-project] Request method failure captured: Oct 30 01:18:21.764928 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 30 01:18:21.764928 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:18:21.764928 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:18:21.764928 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:18:21.764928 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:18:21.764928 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:18:21.764928 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:18:21.764928 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:18:21.764928 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:18:21.764928 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdDYyZFCsMvQHZ7gXpKCQ6VhJLz_JnXR7oKgJ0789ZMMEkdfg0BgU051pX4OtMqWgd3os4frnVjZL9I3v3h3_4HLdQYtFxpEjq9iAB0rGGDs4hiknPTVq0e1A1B4_FiXy3giYzdKnHgm9nM9WM1scH6rseTJ8dipZpsdvU9TxXN97hQ Oct 30 01:18:21.764928 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:18:21.764928 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:18:21.764928 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:18:21.764928 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:18:21.764928 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:18:21.764928 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:18:21.764928 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 21528130be244950b9cbbe640dfd3cf4 Oct 30 01:18:21.764928 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-204969714 Oct 30 01:18:21.764928 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:18:21.764928 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:18:21.766344 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/21528130be244950b9cbbe640dfd3cf4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_21528130be244950b9cbbe640dfd3cf4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/21528130be244950b9cbbe640dfd3cf4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/21528130be244950b9cbbe640dfd3cf4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:18:21.766344 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-204969714 Oct 30 01:18:21.766344 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 21528130be244950b9cbbe640dfd3cf4 Oct 30 01:18:21.766344 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-204969714 Oct 30 01:18:21.766344 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-HypervisorAdminNegativeTestJSON-204969714-project Oct 30 01:18:21.766344 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:18:21.766344 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:18:21.766344 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 74770187af4e41469fc13f21d61b0550 Oct 30 01:18:21.766344 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-204969714-project Oct 30 01:18:21.766344 n-d-master-1 devstack@n-api.service[121102]: method: Oct 30 01:18:21.766344 n-d-master-1 devstack@n-api.service[121102]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 30 01:18:21.766344 n-d-master-1 devstack@n-api.service[121102]: action_args: {} Oct 30 01:18:21.766344 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:18:21.767234 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:21.767234 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:18:21.767234 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:18:21.767234 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:18:21.767234 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:18:21.767234 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:18:21.767234 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:18:21.767234 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:18:21.767234 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:18:21.767234 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 30 01:18:21.767234 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 30 01:18:21.767234 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 30 01:18:21.767234 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 30 01:18:21.767234 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 30 01:18:21.767234 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 30 01:18:21.767234 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 01:18:21.767234 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 30 01:18:21.767234 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 01:18:21.767234 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise self.value Oct 30 01:18:21.768638 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 30 01:18:21.768638 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 30 01:18:21.768638 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 30 01:18:21.768638 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 30 01:18:21.768638 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 30 01:18:21.768638 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 30 01:18:21.768638 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 30 01:18:21.768638 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:18:21.768638 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:18:21.768638 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:18:21.768638 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:21.768638 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:18:21.768638 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:18:21.768638 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 30 01:18:21.768638 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 30 01:18:21.768638 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 30 01:18:21.768638 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:18:21.770745 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-828a51a2-e57c-4f54-8b93-d7123068a5d6 tempest-HypervisorAdminNegativeTestJSON-204969714 tempest-HypervisorAdminNegativeTestJSON-204969714-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:18:21.773151 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-828a51a2-e57c-4f54-8b93-d7123068a5d6 tempest-HypervisorAdminNegativeTestJSON-204969714 tempest-HypervisorAdminNegativeTestJSON-204969714-project] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.030115 Oct 30 01:18:21.774304 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 730/1424] 10.222.0.13 () {58 vars in 1179 bytes} [Sun Oct 30 01:18:21 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:18:21.779107 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e1e766fb-84e4-4c0c-9a11-55ca9ffa5b7c tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:18:21.792515 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e1e766fb-84e4-4c0c-9a11-55ca9ffa5b7c tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:21.808240 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e1e766fb-84e4-4c0c-9a11-55ca9ffa5b7c tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:21.811745 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e1e766fb-84e4-4c0c-9a11-55ca9ffa5b7c tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:21.812528 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e1e766fb-84e4-4c0c-9a11-55ca9ffa5b7c tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:21.816821 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e1e766fb-84e4-4c0c-9a11-55ca9ffa5b7c tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:21.817954 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e1e766fb-84e4-4c0c-9a11-55ca9ffa5b7c tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:21.820098 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e1e766fb-84e4-4c0c-9a11-55ca9ffa5b7c tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:22.203559 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3e79b896-c5eb-43a8-8b1d-0093591dc42d tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5387ae83-7934-49d6-a893-3661477ffe69" status: 204 len: 0 microversion: 2.1 time: 0.609499 Oct 30 01:18:22.204430 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 695/1425] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:18:21 2022] DELETE /compute/v2.1/servers/5387ae83-7934-49d6-a893-3661477ffe69 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:18:22.210199 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-77e2b870-19f2-4806-b2fd-418c40f78a5f req-66f1d5ae-04eb-4c0a-86da-c45466253a1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3141e23-1b24-4315-aac8-fb785005e789", "name": "network-vif-unplugged", "status": "completed", "tag": "ec5e536f-901e-4b24-a661-499fb1eb2a1f"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:18:22.232190 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-77e2b870-19f2-4806-b2fd-418c40f78a5f req-66f1d5ae-04eb-4c0a-86da-c45466253a1d service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:22.233092 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-77e2b870-19f2-4806-b2fd-418c40f78a5f req-66f1d5ae-04eb-4c0a-86da-c45466253a1d service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:22.233927 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-77e2b870-19f2-4806-b2fd-418c40f78a5f req-66f1d5ae-04eb-4c0a-86da-c45466253a1d service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:22.247484 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-77e2b870-19f2-4806-b2fd-418c40f78a5f req-66f1d5ae-04eb-4c0a-86da-c45466253a1d service nova] Creating event network-vif-unplugged:ec5e536f-901e-4b24-a661-499fb1eb2a1f for instance f3141e23-1b24-4315-aac8-fb785005e789 on n-h2-master-1 Oct 30 01:18:22.252913 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-77e2b870-19f2-4806-b2fd-418c40f78a5f req-66f1d5ae-04eb-4c0a-86da-c45466253a1d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046953 Oct 30 01:18:22.258480 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 696/1426] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:18:22.260549 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-aee09c1e-ec8e-42bc-b2b5-18cdab0bd3d3 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:22.261581 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-aee09c1e-ec8e-42bc-b2b5-18cdab0bd3d3 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:22.268851 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aee09c1e-ec8e-42bc-b2b5-18cdab0bd3d3 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:22.269764 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aee09c1e-ec8e-42bc-b2b5-18cdab0bd3d3 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:22.270464 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aee09c1e-ec8e-42bc-b2b5-18cdab0bd3d3 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:22.271673 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aee09c1e-ec8e-42bc-b2b5-18cdab0bd3d3 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:22.272351 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aee09c1e-ec8e-42bc-b2b5-18cdab0bd3d3 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:22.272998 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aee09c1e-ec8e-42bc-b2b5-18cdab0bd3d3 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:22.305910 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e1e766fb-84e4-4c0c-9a11-55ca9ffa5b7c tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9/action" status: 202 len: 0 microversion: 2.1 time: 0.530294 Oct 30 01:18:22.307423 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 731/1427] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:18:21 2022] POST /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9/action => generated 0 bytes in 532 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:18:22.398395 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c2e0f961-bcaa-4ee4-ab60-6f4e328b4e41 tempest-HypervisorAdminNegativeTestJSON-913614732 tempest-HypervisorAdminNegativeTestJSON-913614732-project-admin] Calling method '.version_select at 0x7f44cc5afa60>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:22.403091 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c2e0f961-bcaa-4ee4-ab60-6f4e328b4e41 tempest-HypervisorAdminNegativeTestJSON-913614732 tempest-HypervisorAdminNegativeTestJSON-913614732-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:22.404537 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c2e0f961-bcaa-4ee4-ab60-6f4e328b4e41 tempest-HypervisorAdminNegativeTestJSON-913614732 tempest-HypervisorAdminNegativeTestJSON-913614732-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:22.405215 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c2e0f961-bcaa-4ee4-ab60-6f4e328b4e41 tempest-HypervisorAdminNegativeTestJSON-913614732 tempest-HypervisorAdminNegativeTestJSON-913614732-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:22.433088 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c2e0f961-bcaa-4ee4-ab60-6f4e328b4e41 tempest-HypervisorAdminNegativeTestJSON-913614732 tempest-HypervisorAdminNegativeTestJSON-913614732-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:22.433974 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c2e0f961-bcaa-4ee4-ab60-6f4e328b4e41 tempest-HypervisorAdminNegativeTestJSON-913614732 tempest-HypervisorAdminNegativeTestJSON-913614732-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:22.435470 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c2e0f961-bcaa-4ee4-ab60-6f4e328b4e41 tempest-HypervisorAdminNegativeTestJSON-913614732 tempest-HypervisorAdminNegativeTestJSON-913614732-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:22.461528 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c2e0f961-bcaa-4ee4-ab60-6f4e328b4e41 tempest-HypervisorAdminNegativeTestJSON-913614732 tempest-HypervisorAdminNegativeTestJSON-913614732-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:22.462658 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c2e0f961-bcaa-4ee4-ab60-6f4e328b4e41 tempest-HypervisorAdminNegativeTestJSON-913614732 tempest-HypervisorAdminNegativeTestJSON-913614732-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:22.463347 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c2e0f961-bcaa-4ee4-ab60-6f4e328b4e41 tempest-HypervisorAdminNegativeTestJSON-913614732 tempest-HypervisorAdminNegativeTestJSON-913614732-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:22.471239 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c2e0f961-bcaa-4ee4-ab60-6f4e328b4e41 tempest-HypervisorAdminNegativeTestJSON-913614732 tempest-HypervisorAdminNegativeTestJSON-913614732-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.162423 Oct 30 01:18:22.479312 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 732/1428] 10.222.0.13 () {58 vars in 1146 bytes} [Sun Oct 30 01:18:22 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:18:22.485532 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-260a22f3-c103-4c2a-82cc-4fb382d7d48f tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:22.486445 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-260a22f3-c103-4c2a-82cc-4fb382d7d48f tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 5387ae83-7934-49d6-a893-3661477ffe69] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:22.496227 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-260a22f3-c103-4c2a-82cc-4fb382d7d48f tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:22.497051 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-260a22f3-c103-4c2a-82cc-4fb382d7d48f tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:22.497758 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-260a22f3-c103-4c2a-82cc-4fb382d7d48f tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:22.498740 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-260a22f3-c103-4c2a-82cc-4fb382d7d48f tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:22.499705 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-260a22f3-c103-4c2a-82cc-4fb382d7d48f tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:22.500364 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-260a22f3-c103-4c2a-82cc-4fb382d7d48f tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:22.535795 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-aee09c1e-ec8e-42bc-b2b5-18cdab0bd3d3 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:22.553181 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-aee09c1e-ec8e-42bc-b2b5-18cdab0bd3d3 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:22.555476 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-aee09c1e-ec8e-42bc-b2b5-18cdab0bd3d3 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:22.556937 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-aee09c1e-ec8e-42bc-b2b5-18cdab0bd3d3 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 200 len: 1813 microversion: 2.25 time: 0.301778 Oct 30 01:18:22.558724 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 697/1429] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:22 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 1813 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:18:22.564335 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9371de78-47d7-4ff4-9db1-56b25fdf7237 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:22.565426 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9371de78-47d7-4ff4-9db1-56b25fdf7237 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:22.582924 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9371de78-47d7-4ff4-9db1-56b25fdf7237 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:22.583847 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9371de78-47d7-4ff4-9db1-56b25fdf7237 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:22.585008 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9371de78-47d7-4ff4-9db1-56b25fdf7237 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:22.587015 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9371de78-47d7-4ff4-9db1-56b25fdf7237 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:22.592159 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9371de78-47d7-4ff4-9db1-56b25fdf7237 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:22.594139 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9371de78-47d7-4ff4-9db1-56b25fdf7237 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:22.929759 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9371de78-47d7-4ff4-9db1-56b25fdf7237 tempest-ServersAdminTestJSON-1157918874 tempest-ServersAdminTestJSON-1157918874-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1614 microversion: 2.1 time: 0.368964 Oct 30 01:18:22.932145 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 698/1430] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:22 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1614 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:22.944951 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0cf21732-364f-4fb7-86ad-976fa3a17935 tempest-HypervisorAdminNegativeTestJSON-204969714 tempest-HypervisorAdminNegativeTestJSON-204969714-project] Calling method '.version_select at 0x7f44c7e18940>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:22.947106 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0cf21732-364f-4fb7-86ad-976fa3a17935 tempest-HypervisorAdminNegativeTestJSON-204969714 tempest-HypervisorAdminNegativeTestJSON-204969714-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '74770187af4e41469fc13f21d61b0550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21528130be244950b9cbbe640dfd3cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:22.950427 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0cf21732-364f-4fb7-86ad-976fa3a17935 tempest-HypervisorAdminNegativeTestJSON-204969714 tempest-HypervisorAdminNegativeTestJSON-204969714-project] Request method failure captured: Oct 30 01:18:22.950427 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 30 01:18:22.950427 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:18:22.950427 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:18:22.950427 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:18:22.950427 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:18:22.950427 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:18:22.950427 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:18:22.950427 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:18:22.950427 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:18:22.950427 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdDYyZFCsMvQHZ7gXpKCQ6VhJLz_JnXR7oKgJ0789ZMMEkdfg0BgU051pX4OtMqWgd3os4frnVjZL9I3v3h3_4HLdQYtFxpEjq9iAB0rGGDs4hiknPTVq0e1A1B4_FiXy3giYzdKnHgm9nM9WM1scH6rseTJ8dipZpsdvU9TxXN97hQ Oct 30 01:18:22.950427 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:18:22.950427 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:18:22.950427 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:18:22.950427 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:18:22.950427 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:18:22.950427 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:18:22.950427 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 21528130be244950b9cbbe640dfd3cf4 Oct 30 01:18:22.950427 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-204969714 Oct 30 01:18:22.950427 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:18:22.950427 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:18:22.952102 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/21528130be244950b9cbbe640dfd3cf4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_21528130be244950b9cbbe640dfd3cf4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/21528130be244950b9cbbe640dfd3cf4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/21528130be244950b9cbbe640dfd3cf4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:18:22.952102 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-204969714 Oct 30 01:18:22.952102 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 21528130be244950b9cbbe640dfd3cf4 Oct 30 01:18:22.952102 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-204969714 Oct 30 01:18:22.952102 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-HypervisorAdminNegativeTestJSON-204969714-project Oct 30 01:18:22.952102 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:18:22.952102 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:18:22.952102 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 74770187af4e41469fc13f21d61b0550 Oct 30 01:18:22.952102 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-204969714-project Oct 30 01:18:22.952102 n-d-master-1 devstack@n-api.service[121103]: method: Oct 30 01:18:22.952102 n-d-master-1 devstack@n-api.service[121103]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 30 01:18:22.952102 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '1'} Oct 30 01:18:22.952102 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:18:22.953084 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:22.953084 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:18:22.953084 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:18:22.953084 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:18:22.953084 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:18:22.953084 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:18:22.953084 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:18:22.953084 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:18:22.953084 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:18:22.953084 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 30 01:18:22.953084 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 30 01:18:22.953084 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 30 01:18:22.953084 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 30 01:18:22.953084 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 30 01:18:22.953084 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 30 01:18:22.953084 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 01:18:22.953084 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 30 01:18:22.953084 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 01:18:22.953084 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise self.value Oct 30 01:18:22.954594 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 30 01:18:22.954594 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 30 01:18:22.954594 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 30 01:18:22.954594 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 30 01:18:22.954594 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 30 01:18:22.954594 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 30 01:18:22.954594 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 30 01:18:22.954594 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:22.954594 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:18:22.954594 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:22.954594 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:22.954594 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:18:22.954594 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:18:22.954594 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 30 01:18:22.954594 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 30 01:18:22.954594 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 30 01:18:22.954594 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:22.957098 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0cf21732-364f-4fb7-86ad-976fa3a17935 tempest-HypervisorAdminNegativeTestJSON-204969714 tempest-HypervisorAdminNegativeTestJSON-204969714-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:18:22.958191 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0cf21732-364f-4fb7-86ad-976fa3a17935 tempest-HypervisorAdminNegativeTestJSON-204969714 tempest-HypervisorAdminNegativeTestJSON-204969714-project] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.024069 Oct 30 01:18:22.963986 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 699/1431] 10.222.0.13 () {58 vars in 1173 bytes} [Sun Oct 30 01:18:22 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:18:22.970728 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-aa3d3f5d-8ab2-424f-b838-6923315211d6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:22.971697 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-aa3d3f5d-8ab2-424f-b838-6923315211d6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 03d9aff4-215d-48fa-b741-2257b62fc597] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:22.984628 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa3d3f5d-8ab2-424f-b838-6923315211d6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:22.985141 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa3d3f5d-8ab2-424f-b838-6923315211d6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:22.985676 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa3d3f5d-8ab2-424f-b838-6923315211d6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:22.986694 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa3d3f5d-8ab2-424f-b838-6923315211d6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:22.987589 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa3d3f5d-8ab2-424f-b838-6923315211d6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:22.988035 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa3d3f5d-8ab2-424f-b838-6923315211d6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:23.064439 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-260a22f3-c103-4c2a-82cc-4fb382d7d48f tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:23.078571 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-260a22f3-c103-4c2a-82cc-4fb382d7d48f tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/5387ae83-7934-49d6-a893-3661477ffe69" status: 200 len: 1472 microversion: 2.1 time: 0.596302 Oct 30 01:18:23.084813 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 733/1432] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:22 2022] GET /compute/v2.1/servers/5387ae83-7934-49d6-a893-3661477ffe69 => generated 1472 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:23.099732 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8d66820b-53f9-401d-b3bf-c43b51939178 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:23.101775 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8d66820b-53f9-401d-b3bf-c43b51939178 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: 773bba47-dab6-4fbb-91a3-c3a447cd5008] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:23.126532 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d66820b-53f9-401d-b3bf-c43b51939178 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:23.127044 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d66820b-53f9-401d-b3bf-c43b51939178 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:23.136233 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d66820b-53f9-401d-b3bf-c43b51939178 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:23.136233 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d66820b-53f9-401d-b3bf-c43b51939178 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:23.136233 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d66820b-53f9-401d-b3bf-c43b51939178 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:23.136551 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d66820b-53f9-401d-b3bf-c43b51939178 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:23.257478 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8d66820b-53f9-401d-b3bf-c43b51939178 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: 773bba47-dab6-4fbb-91a3-c3a447cd5008] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:18:23.360368 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:23.565199 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-aa3d3f5d-8ab2-424f-b838-6923315211d6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:23.574232 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-aa3d3f5d-8ab2-424f-b838-6923315211d6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597" status: 200 len: 1379 microversion: 2.1 time: 0.612019 Oct 30 01:18:23.580370 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 700/1433] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:22 2022] GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597 => generated 1379 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:23.590173 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ab934a2b-00bf-4c59-864a-8098ee2ecbd8 tempest-HypervisorAdminNegativeTestJSON-913614732 tempest-HypervisorAdminNegativeTestJSON-913614732-project-admin] Calling method '.version_select at 0x7f44c7e18700>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:23.598442 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-ab934a2b-00bf-4c59-864a-8098ee2ecbd8 tempest-HypervisorAdminNegativeTestJSON-913614732 tempest-HypervisorAdminNegativeTestJSON-913614732-project-admin] HTTP exception thrown: Hypervisor with ID 'f5385cdf-37fa-4839-8cd9-114b5a665d0c' could not be found. Oct 30 01:18:23.612776 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ab934a2b-00bf-4c59-864a-8098ee2ecbd8 tempest-HypervisorAdminNegativeTestJSON-913614732 tempest-HypervisorAdminNegativeTestJSON-913614732-project-admin] Request method failure captured: Oct 30 01:18:23.612776 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/os-hypervisors/f5385cdf-37fa-4839-8cd9-114b5a665d0c/uptime HTTP/1.1 Oct 30 01:18:23.612776 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:18:23.612776 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:18:23.612776 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:18:23.612776 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:18:23.612776 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:18:23.612776 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:18:23.612776 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:18:23.612776 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:18:23.612776 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdDavxf4wghWofmAs3rXia5WneZrDG1EhAIHPIyxbDDDopYoU1GAZwljRIq_5Nu6PEjZNOXnQuEjmsiWsYO7WGh7sULWfmLgGjCXepL0ytHmHfkIS2d5qEVzsNeVTdvGVocpqzS3XIVf9V5hJsXZVO-TL8KdeFTFXZcnEKDmy0SAbi0 Oct 30 01:18:23.612776 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:18:23.612776 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:18:23.612776 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:18:23.612776 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:18:23.612776 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:18:23.612776 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:18:23.612776 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 308e073236624c65ad478dde9450994f Oct 30 01:18:23.612776 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-913614732 Oct 30 01:18:23.612776 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,admin,reader Oct 30 01:18:23.612776 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,admin,reader Oct 30 01:18:23.614590 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/308e073236624c65ad478dde9450994f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_308e073236624c65ad478dde9450994f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/308e073236624c65ad478dde9450994f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/308e073236624c65ad478dde9450994f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:18:23.614590 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-913614732 Oct 30 01:18:23.614590 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 308e073236624c65ad478dde9450994f Oct 30 01:18:23.614590 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-913614732 Oct 30 01:18:23.614590 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-HypervisorAdminNegativeTestJSON-913614732-project-admin Oct 30 01:18:23.614590 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:18:23.614590 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:18:23.614590 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 76435443ffaa464cbcf8de651606ce35 Oct 30 01:18:23.614590 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-913614732-project-admin Oct 30 01:18:23.614590 n-d-master-1 devstack@n-api.service[121103]: method: Oct 30 01:18:23.614590 n-d-master-1 devstack@n-api.service[121103]: exception: Hypervisor with ID 'f5385cdf-37fa-4839-8cd9-114b5a665d0c' could not be found. Oct 30 01:18:23.614590 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'f5385cdf-37fa-4839-8cd9-114b5a665d0c'} Oct 30 01:18:23.616112 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:18:23.616112 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:23.616112 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 30 01:18:23.616112 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 30 01:18:23.616112 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'f5385cdf-37fa-4839-8cd9-114b5a665d0c' Oct 30 01:18:23.616112 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:23.616112 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:18:23.616112 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:23.616112 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:23.616112 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 30 01:18:23.616112 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 30 01:18:23.616112 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 30 01:18:23.616112 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 30 01:18:23.616112 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 30 01:18:23.616112 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:23.616112 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:18:23.616112 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:23.616112 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:23.616112 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 30 01:18:23.616112 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 30 01:18:23.616112 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 30 01:18:23.616112 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 30 01:18:23.617839 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 30 01:18:23.617839 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:23.617839 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:18:23.617839 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:23.617839 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:23.617839 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:18:23.617839 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:18:23.617839 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:18:23.617839 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:18:23.617839 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:18:23.617839 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:18:23.617839 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:18:23.617839 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:18:23.617839 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 30 01:18:23.617839 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 30 01:18:23.617839 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 30 01:18:23.617839 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 30 01:18:23.617839 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'f5385cdf-37fa-4839-8cd9-114b5a665d0c' could not be found. Oct 30 01:18:23.617839 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:23.617839 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:18:23.617839 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:23.619823 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:23.619823 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:18:23.619823 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:18:23.619823 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:18:23.619823 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:18:23.619823 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'f5385cdf-37fa-4839-8cd9-114b5a665d0c' could not be found. Oct 30 01:18:23.619823 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:23.621708 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ab934a2b-00bf-4c59-864a-8098ee2ecbd8 tempest-HypervisorAdminNegativeTestJSON-913614732 tempest-HypervisorAdminNegativeTestJSON-913614732-project-admin] Returning 404 to user: Hypervisor with ID 'f5385cdf-37fa-4839-8cd9-114b5a665d0c' could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:18:23.622796 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ab934a2b-00bf-4c59-864a-8098ee2ecbd8 tempest-HypervisorAdminNegativeTestJSON-913614732 tempest-HypervisorAdminNegativeTestJSON-913614732-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/f5385cdf-37fa-4839-8cd9-114b5a665d0c/uptime" status: 404 len: 123 microversion: 2.1 time: 0.041022 Oct 30 01:18:23.628309 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 701/1434] 10.222.0.13 () {58 vars in 1278 bytes} [Sun Oct 30 01:18:23 2022] GET /compute/v2.1/os-hypervisors/f5385cdf-37fa-4839-8cd9-114b5a665d0c/uptime => generated 123 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:18:23.636042 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-06c1a037-9452-464f-aa8a-68072dc9e6b7 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:23.636662 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-06c1a037-9452-464f-aa8a-68072dc9e6b7 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:23.647513 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-06c1a037-9452-464f-aa8a-68072dc9e6b7 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:23.648013 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-06c1a037-9452-464f-aa8a-68072dc9e6b7 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:23.648445 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-06c1a037-9452-464f-aa8a-68072dc9e6b7 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:23.649167 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-06c1a037-9452-464f-aa8a-68072dc9e6b7 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:23.649681 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-06c1a037-9452-464f-aa8a-68072dc9e6b7 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:23.650105 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-06c1a037-9452-464f-aa8a-68072dc9e6b7 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:23.747730 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8d66820b-53f9-401d-b3bf-c43b51939178 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "DELETE /compute/v2.1/servers/773bba47-dab6-4fbb-91a3-c3a447cd5008" status: 204 len: 0 microversion: 2.1 time: 0.661372 Oct 30 01:18:23.748261 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 734/1435] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:18:23 2022] DELETE /compute/v2.1/servers/773bba47-dab6-4fbb-91a3-c3a447cd5008 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:18:23.754959 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cf235507-247a-4543-a0f6-6bb96acdf0a9 tempest-HypervisorAdminNegativeTestJSON-913614732 tempest-HypervisorAdminNegativeTestJSON-913614732-project-admin] Calling method '.version_select at 0x7f44cc6f3820>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:23.757111 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cf235507-247a-4543-a0f6-6bb96acdf0a9 tempest-HypervisorAdminNegativeTestJSON-913614732 tempest-HypervisorAdminNegativeTestJSON-913614732-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:23.757642 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cf235507-247a-4543-a0f6-6bb96acdf0a9 tempest-HypervisorAdminNegativeTestJSON-913614732 tempest-HypervisorAdminNegativeTestJSON-913614732-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:23.758071 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cf235507-247a-4543-a0f6-6bb96acdf0a9 tempest-HypervisorAdminNegativeTestJSON-913614732 tempest-HypervisorAdminNegativeTestJSON-913614732-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:23.774110 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cf235507-247a-4543-a0f6-6bb96acdf0a9 tempest-HypervisorAdminNegativeTestJSON-913614732 tempest-HypervisorAdminNegativeTestJSON-913614732-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:23.775004 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cf235507-247a-4543-a0f6-6bb96acdf0a9 tempest-HypervisorAdminNegativeTestJSON-913614732 tempest-HypervisorAdminNegativeTestJSON-913614732-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:23.775942 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cf235507-247a-4543-a0f6-6bb96acdf0a9 tempest-HypervisorAdminNegativeTestJSON-913614732 tempest-HypervisorAdminNegativeTestJSON-913614732-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:23.789172 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cf235507-247a-4543-a0f6-6bb96acdf0a9 tempest-HypervisorAdminNegativeTestJSON-913614732 tempest-HypervisorAdminNegativeTestJSON-913614732-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:23.789935 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cf235507-247a-4543-a0f6-6bb96acdf0a9 tempest-HypervisorAdminNegativeTestJSON-913614732 tempest-HypervisorAdminNegativeTestJSON-913614732-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:23.790365 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cf235507-247a-4543-a0f6-6bb96acdf0a9 tempest-HypervisorAdminNegativeTestJSON-913614732 tempest-HypervisorAdminNegativeTestJSON-913614732-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:23.797733 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cf235507-247a-4543-a0f6-6bb96acdf0a9 tempest-HypervisorAdminNegativeTestJSON-913614732 tempest-HypervisorAdminNegativeTestJSON-913614732-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.047978 Oct 30 01:18:23.798359 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 735/1436] 10.222.0.13 () {58 vars in 1146 bytes} [Sun Oct 30 01:18:23 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:18:23.803645 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-773d12d5-31ae-4ffe-9f73-d3154c63ec0f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:23.804688 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-773d12d5-31ae-4ffe-9f73-d3154c63ec0f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: 773bba47-dab6-4fbb-91a3-c3a447cd5008] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:23.811563 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-773d12d5-31ae-4ffe-9f73-d3154c63ec0f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:23.816669 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-773d12d5-31ae-4ffe-9f73-d3154c63ec0f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:23.816669 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-773d12d5-31ae-4ffe-9f73-d3154c63ec0f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:23.816669 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-773d12d5-31ae-4ffe-9f73-d3154c63ec0f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:23.816669 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-773d12d5-31ae-4ffe-9f73-d3154c63ec0f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:23.817076 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-773d12d5-31ae-4ffe-9f73-d3154c63ec0f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:23.846803 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-06c1a037-9452-464f-aa8a-68072dc9e6b7 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:23.864775 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-06c1a037-9452-464f-aa8a-68072dc9e6b7 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:23.870810 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-06c1a037-9452-464f-aa8a-68072dc9e6b7 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:23.872351 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-06c1a037-9452-464f-aa8a-68072dc9e6b7 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 200 len: 1813 microversion: 2.25 time: 0.242516 Oct 30 01:18:23.873542 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 702/1437] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:23 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 1813 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:18:23.879581 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9410394b-bd70-4d00-ba3e-f672c9ef28de tempest-HypervisorAdminNegativeTestJSON-204969714 tempest-HypervisorAdminNegativeTestJSON-204969714-project] Calling method '.version_select at 0x7f44c7de6a60>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:23.881804 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9410394b-bd70-4d00-ba3e-f672c9ef28de tempest-HypervisorAdminNegativeTestJSON-204969714 tempest-HypervisorAdminNegativeTestJSON-204969714-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '74770187af4e41469fc13f21d61b0550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21528130be244950b9cbbe640dfd3cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:23.883638 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9410394b-bd70-4d00-ba3e-f672c9ef28de tempest-HypervisorAdminNegativeTestJSON-204969714 tempest-HypervisorAdminNegativeTestJSON-204969714-project] Request method failure captured: Oct 30 01:18:23.883638 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 30 01:18:23.883638 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:18:23.883638 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:18:23.883638 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:18:23.883638 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:18:23.883638 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:18:23.883638 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:18:23.883638 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:18:23.883638 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:18:23.883638 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdDYyZFCsMvQHZ7gXpKCQ6VhJLz_JnXR7oKgJ0789ZMMEkdfg0BgU051pX4OtMqWgd3os4frnVjZL9I3v3h3_4HLdQYtFxpEjq9iAB0rGGDs4hiknPTVq0e1A1B4_FiXy3giYzdKnHgm9nM9WM1scH6rseTJ8dipZpsdvU9TxXN97hQ Oct 30 01:18:23.883638 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:18:23.883638 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:18:23.883638 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:18:23.883638 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:18:23.883638 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:18:23.883638 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:18:23.883638 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 21528130be244950b9cbbe640dfd3cf4 Oct 30 01:18:23.883638 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-204969714 Oct 30 01:18:23.883638 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:18:23.883638 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:18:23.884960 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/21528130be244950b9cbbe640dfd3cf4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_21528130be244950b9cbbe640dfd3cf4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/21528130be244950b9cbbe640dfd3cf4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/21528130be244950b9cbbe640dfd3cf4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:18:23.884960 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-204969714 Oct 30 01:18:23.884960 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 21528130be244950b9cbbe640dfd3cf4 Oct 30 01:18:23.884960 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-204969714 Oct 30 01:18:23.884960 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-HypervisorAdminNegativeTestJSON-204969714-project Oct 30 01:18:23.884960 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:18:23.884960 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:18:23.884960 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 74770187af4e41469fc13f21d61b0550 Oct 30 01:18:23.884960 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-204969714-project Oct 30 01:18:23.884960 n-d-master-1 devstack@n-api.service[121103]: method: Oct 30 01:18:23.884960 n-d-master-1 devstack@n-api.service[121103]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 30 01:18:23.884960 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '1'} Oct 30 01:18:23.884960 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:18:23.885792 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:23.885792 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:18:23.885792 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:18:23.885792 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:18:23.885792 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:18:23.885792 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:18:23.885792 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:18:23.885792 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:18:23.885792 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:18:23.885792 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 30 01:18:23.885792 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 30 01:18:23.885792 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 30 01:18:23.885792 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 30 01:18:23.885792 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 30 01:18:23.885792 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 30 01:18:23.885792 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 30 01:18:23.885792 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 30 01:18:23.885792 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 01:18:23.885792 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 30 01:18:23.886922 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 01:18:23.886922 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise self.value Oct 30 01:18:23.886922 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 30 01:18:23.886922 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 30 01:18:23.886922 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 30 01:18:23.886922 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 30 01:18:23.886922 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 30 01:18:23.886922 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 30 01:18:23.886922 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 30 01:18:23.886922 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:23.886922 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:18:23.886922 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:23.886922 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:23.886922 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:18:23.886922 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:18:23.886922 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 30 01:18:23.886922 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 30 01:18:23.886922 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 30 01:18:23.886922 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:23.893004 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9410394b-bd70-4d00-ba3e-f672c9ef28de tempest-HypervisorAdminNegativeTestJSON-204969714 tempest-HypervisorAdminNegativeTestJSON-204969714-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:18:23.899315 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9410394b-bd70-4d00-ba3e-f672c9ef28de tempest-HypervisorAdminNegativeTestJSON-204969714 tempest-HypervisorAdminNegativeTestJSON-204969714-project] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.021224 Oct 30 01:18:23.906079 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 703/1438] 10.222.0.13 () {58 vars in 1152 bytes} [Sun Oct 30 01:18:23 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:18:23.916749 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ceb85dc4-dc90-4577-8ec0-9e7d91aba1be tempest-HypervisorAdminNegativeTestJSON-913614732 tempest-HypervisorAdminNegativeTestJSON-913614732-project-admin] Calling method '.version_select at 0x7f44c7e7edc0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:23.922284 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-ceb85dc4-dc90-4577-8ec0-9e7d91aba1be tempest-HypervisorAdminNegativeTestJSON-913614732 tempest-HypervisorAdminNegativeTestJSON-913614732-project-admin] HTTP exception thrown: Hypervisor with ID '92b83146-3aa0-478f-9893-5f163432cd65' could not be found. Oct 30 01:18:23.924002 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ceb85dc4-dc90-4577-8ec0-9e7d91aba1be tempest-HypervisorAdminNegativeTestJSON-913614732 tempest-HypervisorAdminNegativeTestJSON-913614732-project-admin] Request method failure captured: Oct 30 01:18:23.924002 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/os-hypervisors/92b83146-3aa0-478f-9893-5f163432cd65 HTTP/1.1 Oct 30 01:18:23.924002 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:18:23.924002 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:18:23.924002 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:18:23.924002 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:18:23.924002 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:18:23.924002 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:18:23.924002 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:18:23.924002 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:18:23.924002 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdDavxf4wghWofmAs3rXia5WneZrDG1EhAIHPIyxbDDDopYoU1GAZwljRIq_5Nu6PEjZNOXnQuEjmsiWsYO7WGh7sULWfmLgGjCXepL0ytHmHfkIS2d5qEVzsNeVTdvGVocpqzS3XIVf9V5hJsXZVO-TL8KdeFTFXZcnEKDmy0SAbi0 Oct 30 01:18:23.924002 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:18:23.924002 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:18:23.924002 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:18:23.924002 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:18:23.924002 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:18:23.924002 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:18:23.924002 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 308e073236624c65ad478dde9450994f Oct 30 01:18:23.924002 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-913614732 Oct 30 01:18:23.924002 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,admin,reader Oct 30 01:18:23.924002 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,admin,reader Oct 30 01:18:23.925625 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/308e073236624c65ad478dde9450994f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_308e073236624c65ad478dde9450994f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/308e073236624c65ad478dde9450994f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/308e073236624c65ad478dde9450994f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:18:23.925625 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-913614732 Oct 30 01:18:23.925625 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 308e073236624c65ad478dde9450994f Oct 30 01:18:23.925625 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-913614732 Oct 30 01:18:23.925625 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-HypervisorAdminNegativeTestJSON-913614732-project-admin Oct 30 01:18:23.925625 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:18:23.925625 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:18:23.925625 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 76435443ffaa464cbcf8de651606ce35 Oct 30 01:18:23.925625 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-913614732-project-admin Oct 30 01:18:23.925625 n-d-master-1 devstack@n-api.service[121103]: method: Oct 30 01:18:23.925625 n-d-master-1 devstack@n-api.service[121103]: exception: Hypervisor with ID '92b83146-3aa0-478f-9893-5f163432cd65' could not be found. Oct 30 01:18:23.925625 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '92b83146-3aa0-478f-9893-5f163432cd65'} Oct 30 01:18:23.926588 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:18:23.926588 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:23.926588 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 30 01:18:23.926588 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 30 01:18:23.926588 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '92b83146-3aa0-478f-9893-5f163432cd65' Oct 30 01:18:23.926588 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:23.926588 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:18:23.926588 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:23.926588 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:23.926588 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 30 01:18:23.926588 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 30 01:18:23.926588 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 30 01:18:23.926588 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 30 01:18:23.926588 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 30 01:18:23.926588 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:23.926588 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:18:23.926588 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:23.926588 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:23.926588 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 30 01:18:23.926588 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 30 01:18:23.926588 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 30 01:18:23.926588 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 30 01:18:23.928633 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 30 01:18:23.928633 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:23.928633 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:18:23.928633 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:23.928633 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:23.928633 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:18:23.928633 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:18:23.928633 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:18:23.928633 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:18:23.928633 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:18:23.928633 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:18:23.928633 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:18:23.928633 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:18:23.928633 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 30 01:18:23.928633 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 30 01:18:23.928633 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 30 01:18:23.928633 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 30 01:18:23.928633 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 30 01:18:23.928633 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 30 01:18:23.928633 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '92b83146-3aa0-478f-9893-5f163432cd65' could not be found. Oct 30 01:18:23.936473 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:23.936473 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:18:23.936473 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:23.936473 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:23.936473 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:18:23.936473 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:18:23.936473 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:18:23.936473 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:18:23.936473 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '92b83146-3aa0-478f-9893-5f163432cd65' could not be found. Oct 30 01:18:23.936473 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:23.936473 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ceb85dc4-dc90-4577-8ec0-9e7d91aba1be tempest-HypervisorAdminNegativeTestJSON-913614732 tempest-HypervisorAdminNegativeTestJSON-913614732-project-admin] Returning 404 to user: Hypervisor with ID '92b83146-3aa0-478f-9893-5f163432cd65' could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:18:23.936473 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ceb85dc4-dc90-4577-8ec0-9e7d91aba1be tempest-HypervisorAdminNegativeTestJSON-913614732 tempest-HypervisorAdminNegativeTestJSON-913614732-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/92b83146-3aa0-478f-9893-5f163432cd65" status: 404 len: 123 microversion: 2.1 time: 0.017422 Oct 30 01:18:23.936473 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 704/1439] 10.222.0.13 () {58 vars in 1257 bytes} [Sun Oct 30 01:18:23 2022] GET /compute/v2.1/os-hypervisors/92b83146-3aa0-478f-9893-5f163432cd65 => generated 123 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:18:24.109236 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-276a6796-71d1-4de7-9e4d-2340b18e6d1e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:24.110585 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-276a6796-71d1-4de7-9e4d-2340b18e6d1e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 5387ae83-7934-49d6-a893-3661477ffe69] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:24.120463 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-276a6796-71d1-4de7-9e4d-2340b18e6d1e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:24.121246 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-276a6796-71d1-4de7-9e4d-2340b18e6d1e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:24.121671 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-773d12d5-31ae-4ffe-9f73-d3154c63ec0f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:24.122091 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-276a6796-71d1-4de7-9e4d-2340b18e6d1e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:24.122997 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-276a6796-71d1-4de7-9e4d-2340b18e6d1e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:24.123627 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-276a6796-71d1-4de7-9e4d-2340b18e6d1e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:24.124217 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-276a6796-71d1-4de7-9e4d-2340b18e6d1e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:24.166287 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-773d12d5-31ae-4ffe-9f73-d3154c63ec0f tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/773bba47-dab6-4fbb-91a3-c3a447cd5008" status: 200 len: 1469 microversion: 2.1 time: 0.366698 Oct 30 01:18:24.167276 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 736/1440] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:23 2022] GET /compute/v2.1/servers/773bba47-dab6-4fbb-91a3-c3a447cd5008 => generated 1469 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:24.289399 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-689a9f01-1da1-4f99-a781-1a1cf11d1e95 req-40830ccb-5f50-40d2-88b9-797c3557c83c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3141e23-1b24-4315-aac8-fb785005e789", "tag": "ec5e536f-901e-4b24-a661-499fb1eb2a1f"}, {"name": "network-changed", "server_uuid": "03d9aff4-215d-48fa-b741-2257b62fc597", "tag": "f852959f-05e2-49d9-95ba-a62b3b029d75"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:18:24.303173 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-689a9f01-1da1-4f99-a781-1a1cf11d1e95 req-40830ccb-5f50-40d2-88b9-797c3557c83c service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:24.306505 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-689a9f01-1da1-4f99-a781-1a1cf11d1e95 req-40830ccb-5f50-40d2-88b9-797c3557c83c service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:24.307220 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-689a9f01-1da1-4f99-a781-1a1cf11d1e95 req-40830ccb-5f50-40d2-88b9-797c3557c83c service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:24.322200 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-276a6796-71d1-4de7-9e4d-2340b18e6d1e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:24.336054 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-276a6796-71d1-4de7-9e4d-2340b18e6d1e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/5387ae83-7934-49d6-a893-3661477ffe69" status: 200 len: 1472 microversion: 2.1 time: 0.236285 Oct 30 01:18:24.341379 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-689a9f01-1da1-4f99-a781-1a1cf11d1e95 req-40830ccb-5f50-40d2-88b9-797c3557c83c service nova] Creating event network-changed:ec5e536f-901e-4b24-a661-499fb1eb2a1f for instance f3141e23-1b24-4315-aac8-fb785005e789 on n-h2-master-1 Oct 30 01:18:24.344142 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-689a9f01-1da1-4f99-a781-1a1cf11d1e95 req-40830ccb-5f50-40d2-88b9-797c3557c83c service nova] Creating event network-changed:f852959f-05e2-49d9-95ba-a62b3b029d75 for instance 03d9aff4-215d-48fa-b741-2257b62fc597 on n-h1-master-1 Oct 30 01:18:24.353559 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 705/1441] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:24 2022] GET /compute/v2.1/servers/5387ae83-7934-49d6-a893-3661477ffe69 => generated 1472 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:18:24.359434 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-689a9f01-1da1-4f99-a781-1a1cf11d1e95 req-40830ccb-5f50-40d2-88b9-797c3557c83c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.073712 Oct 30 01:18:24.360957 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 737/1442] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:18:24.601731 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a7027fe1-e25f-4408-853f-dca0a86e540b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:24.602520 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a7027fe1-e25f-4408-853f-dca0a86e540b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 03d9aff4-215d-48fa-b741-2257b62fc597] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:24.609465 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a7027fe1-e25f-4408-853f-dca0a86e540b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:24.610396 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a7027fe1-e25f-4408-853f-dca0a86e540b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:24.610936 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a7027fe1-e25f-4408-853f-dca0a86e540b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:24.611754 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a7027fe1-e25f-4408-853f-dca0a86e540b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:24.612411 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a7027fe1-e25f-4408-853f-dca0a86e540b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:24.613041 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a7027fe1-e25f-4408-853f-dca0a86e540b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:24.857218 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a7027fe1-e25f-4408-853f-dca0a86e540b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:24.868102 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a7027fe1-e25f-4408-853f-dca0a86e540b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597" status: 200 len: 1379 microversion: 2.1 time: 0.270924 Oct 30 01:18:24.868689 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 706/1443] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:24 2022] GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597 => generated 1379 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:24.900738 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d9ac032a-6cbe-4ec8-b7de-7a931d917905 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:24.901876 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d9ac032a-6cbe-4ec8-b7de-7a931d917905 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:24.911051 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=1,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:24.913721 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9ac032a-6cbe-4ec8-b7de-7a931d917905 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:24.914623 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9ac032a-6cbe-4ec8-b7de-7a931d917905 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:24.915488 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9ac032a-6cbe-4ec8-b7de-7a931d917905 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:24.916890 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9ac032a-6cbe-4ec8-b7de-7a931d917905 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:24.917768 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9ac032a-6cbe-4ec8-b7de-7a931d917905 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:24.918603 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9ac032a-6cbe-4ec8-b7de-7a931d917905 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:25.150003 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d9ac032a-6cbe-4ec8-b7de-7a931d917905 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:25.160418 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d9ac032a-6cbe-4ec8-b7de-7a931d917905 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:25.171569 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d9ac032a-6cbe-4ec8-b7de-7a931d917905 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:25.175118 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d9ac032a-6cbe-4ec8-b7de-7a931d917905 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 200 len: 1813 microversion: 2.25 time: 0.279738 Oct 30 01:18:25.177483 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 738/1444] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:24 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 1813 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:18:25.193146 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0342443b-4e81-48f5-bed6-81186f386c07 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:25.195097 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0342443b-4e81-48f5-bed6-81186f386c07 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: 773bba47-dab6-4fbb-91a3-c3a447cd5008] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:25.203047 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0342443b-4e81-48f5-bed6-81186f386c07 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:25.204189 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0342443b-4e81-48f5-bed6-81186f386c07 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:25.216551 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0342443b-4e81-48f5-bed6-81186f386c07 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:25.218811 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0342443b-4e81-48f5-bed6-81186f386c07 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:25.222363 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0342443b-4e81-48f5-bed6-81186f386c07 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:25.228974 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0342443b-4e81-48f5-bed6-81186f386c07 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:25.363070 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0039435b-97e8-4a7a-b030-dfb570c3d8da tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:25.367174 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0039435b-97e8-4a7a-b030-dfb570c3d8da tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 5387ae83-7934-49d6-a893-3661477ffe69] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:25.390146 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0039435b-97e8-4a7a-b030-dfb570c3d8da tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:25.390647 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0039435b-97e8-4a7a-b030-dfb570c3d8da tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:25.391089 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0039435b-97e8-4a7a-b030-dfb570c3d8da tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:25.391802 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0039435b-97e8-4a7a-b030-dfb570c3d8da tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:25.395612 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0039435b-97e8-4a7a-b030-dfb570c3d8da tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:25.398400 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0039435b-97e8-4a7a-b030-dfb570c3d8da tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:25.655651 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0342443b-4e81-48f5-bed6-81186f386c07 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:25.667361 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0342443b-4e81-48f5-bed6-81186f386c07 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/773bba47-dab6-4fbb-91a3-c3a447cd5008" status: 200 len: 1469 microversion: 2.1 time: 0.479050 Oct 30 01:18:25.685368 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 707/1445] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:25 2022] GET /compute/v2.1/servers/773bba47-dab6-4fbb-91a3-c3a447cd5008 => generated 1469 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:25.761585 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0039435b-97e8-4a7a-b030-dfb570c3d8da tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:25.769770 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0039435b-97e8-4a7a-b030-dfb570c3d8da tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/5387ae83-7934-49d6-a893-3661477ffe69" status: 200 len: 1472 microversion: 2.1 time: 0.413445 Oct 30 01:18:25.770352 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 739/1446] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:25 2022] GET /compute/v2.1/servers/5387ae83-7934-49d6-a893-3661477ffe69 => generated 1472 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:18:25.913210 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-20c01b76-bff2-4c03-a84d-28e82bd32cde tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:25.913210 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-20c01b76-bff2-4c03-a84d-28e82bd32cde tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 03d9aff4-215d-48fa-b741-2257b62fc597] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:25.913210 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-20c01b76-bff2-4c03-a84d-28e82bd32cde tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:25.913210 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-20c01b76-bff2-4c03-a84d-28e82bd32cde tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:25.913674 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-20c01b76-bff2-4c03-a84d-28e82bd32cde tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:25.913674 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-20c01b76-bff2-4c03-a84d-28e82bd32cde tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:25.913674 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-20c01b76-bff2-4c03-a84d-28e82bd32cde tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:25.913674 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-20c01b76-bff2-4c03-a84d-28e82bd32cde tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:26.201621 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4b1e7634-0c19-4c2b-a0f7-ca079150df26 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:26.202652 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4b1e7634-0c19-4c2b-a0f7-ca079150df26 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:26.220111 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b1e7634-0c19-4c2b-a0f7-ca079150df26 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:26.220111 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b1e7634-0c19-4c2b-a0f7-ca079150df26 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:26.220111 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b1e7634-0c19-4c2b-a0f7-ca079150df26 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:26.220111 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b1e7634-0c19-4c2b-a0f7-ca079150df26 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:26.220484 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b1e7634-0c19-4c2b-a0f7-ca079150df26 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:26.220484 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b1e7634-0c19-4c2b-a0f7-ca079150df26 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:26.671097 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-20c01b76-bff2-4c03-a84d-28e82bd32cde tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:26.712363 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-20c01b76-bff2-4c03-a84d-28e82bd32cde tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597" status: 200 len: 1379 microversion: 2.1 time: 0.820603 Oct 30 01:18:26.714118 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 708/1447] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:25 2022] GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597 => generated 1379 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:26.727460 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-de8dadd5-68b8-47bd-9655-896e5cbeca43 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:26.729684 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-de8dadd5-68b8-47bd-9655-896e5cbeca43 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: 773bba47-dab6-4fbb-91a3-c3a447cd5008] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:26.746610 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de8dadd5-68b8-47bd-9655-896e5cbeca43 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:26.748295 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de8dadd5-68b8-47bd-9655-896e5cbeca43 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:26.749773 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de8dadd5-68b8-47bd-9655-896e5cbeca43 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:26.751005 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de8dadd5-68b8-47bd-9655-896e5cbeca43 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:26.752565 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de8dadd5-68b8-47bd-9655-896e5cbeca43 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:26.753652 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de8dadd5-68b8-47bd-9655-896e5cbeca43 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:26.929908 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4b1e7634-0c19-4c2b-a0f7-ca079150df26 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:26.944866 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4b1e7634-0c19-4c2b-a0f7-ca079150df26 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:26.949954 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4b1e7634-0c19-4c2b-a0f7-ca079150df26 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:26.954321 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4b1e7634-0c19-4c2b-a0f7-ca079150df26 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 200 len: 1813 microversion: 2.25 time: 0.756746 Oct 30 01:18:26.964856 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 740/1448] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:26 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 1813 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:18:26.982870 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-01f9aff1-eba0-4fe0-a050-5997e73406ee tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:26.982870 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-01f9aff1-eba0-4fe0-a050-5997e73406ee tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 5387ae83-7934-49d6-a893-3661477ffe69] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:26.990303 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-01f9aff1-eba0-4fe0-a050-5997e73406ee tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:26.995050 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-01f9aff1-eba0-4fe0-a050-5997e73406ee tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:26.998063 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-01f9aff1-eba0-4fe0-a050-5997e73406ee tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:27.001890 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-01f9aff1-eba0-4fe0-a050-5997e73406ee tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:27.002384 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-01f9aff1-eba0-4fe0-a050-5997e73406ee tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:27.006004 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-01f9aff1-eba0-4fe0-a050-5997e73406ee tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:27.454104 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-de8dadd5-68b8-47bd-9655-896e5cbeca43 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:27.468206 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-de8dadd5-68b8-47bd-9655-896e5cbeca43 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/773bba47-dab6-4fbb-91a3-c3a447cd5008" status: 200 len: 1427 microversion: 2.1 time: 0.749837 Oct 30 01:18:27.468818 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 709/1449] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:26 2022] GET /compute/v2.1/servers/773bba47-dab6-4fbb-91a3-c3a447cd5008 => generated 1427 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:27.482347 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-3383d833-0d98-4895-9426-7a49e1f0f253 req-43de7fd1-3878-42b5-8b45-bfe7bce36d33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "773bba47-dab6-4fbb-91a3-c3a447cd5008", "name": "network-vif-deleted", "tag": "37f0b88d-5907-4ea6-ab74-1b880457b341"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:18:27.511394 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-3383d833-0d98-4895-9426-7a49e1f0f253 req-43de7fd1-3878-42b5-8b45-bfe7bce36d33 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:27.513074 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-3383d833-0d98-4895-9426-7a49e1f0f253 req-43de7fd1-3878-42b5-8b45-bfe7bce36d33 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:27.515235 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-3383d833-0d98-4895-9426-7a49e1f0f253 req-43de7fd1-3878-42b5-8b45-bfe7bce36d33 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:27.531258 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-3383d833-0d98-4895-9426-7a49e1f0f253 req-43de7fd1-3878-42b5-8b45-bfe7bce36d33 service nova] Creating event network-vif-deleted:37f0b88d-5907-4ea6-ab74-1b880457b341 for instance 773bba47-dab6-4fbb-91a3-c3a447cd5008 on n-h2-master-1 Oct 30 01:18:27.537475 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-3383d833-0d98-4895-9426-7a49e1f0f253 req-43de7fd1-3878-42b5-8b45-bfe7bce36d33 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064054 Oct 30 01:18:27.539384 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 710/1450] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:18:27.742815 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d1ae13ba-7955-4ccf-bf3f-81a7b8df13d2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:27.744424 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d1ae13ba-7955-4ccf-bf3f-81a7b8df13d2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 03d9aff4-215d-48fa-b741-2257b62fc597] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:27.754678 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d1ae13ba-7955-4ccf-bf3f-81a7b8df13d2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:27.755519 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d1ae13ba-7955-4ccf-bf3f-81a7b8df13d2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:27.756745 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d1ae13ba-7955-4ccf-bf3f-81a7b8df13d2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:27.757753 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d1ae13ba-7955-4ccf-bf3f-81a7b8df13d2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:27.759320 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d1ae13ba-7955-4ccf-bf3f-81a7b8df13d2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:27.760157 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d1ae13ba-7955-4ccf-bf3f-81a7b8df13d2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:28.440903 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-01f9aff1-eba0-4fe0-a050-5997e73406ee tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:28.454362 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-01f9aff1-eba0-4fe0-a050-5997e73406ee tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/5387ae83-7934-49d6-a893-3661477ffe69" status: 200 len: 1472 microversion: 2.1 time: 1.487957 Oct 30 01:18:28.473058 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 741/1451] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:26 2022] GET /compute/v2.1/servers/5387ae83-7934-49d6-a893-3661477ffe69 => generated 1472 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:28.473058 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-11ce1a3f-0e3c-4a13-a39e-a2a170777112 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:28.473058 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-11ce1a3f-0e3c-4a13-a39e-a2a170777112 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:28.484852 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-11ce1a3f-0e3c-4a13-a39e-a2a170777112 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:28.487851 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-11ce1a3f-0e3c-4a13-a39e-a2a170777112 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:28.488477 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-11ce1a3f-0e3c-4a13-a39e-a2a170777112 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:28.489213 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-11ce1a3f-0e3c-4a13-a39e-a2a170777112 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:28.491663 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-11ce1a3f-0e3c-4a13-a39e-a2a170777112 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:28.492726 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-11ce1a3f-0e3c-4a13-a39e-a2a170777112 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:28.562724 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d1ae13ba-7955-4ccf-bf3f-81a7b8df13d2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:28.571881 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d1ae13ba-7955-4ccf-bf3f-81a7b8df13d2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597" status: 200 len: 1379 microversion: 2.1 time: 0.835786 Oct 30 01:18:28.575446 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 711/1452] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:27 2022] GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597 => generated 1379 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:18:29.039898 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-11ce1a3f-0e3c-4a13-a39e-a2a170777112 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:29.073912 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-11ce1a3f-0e3c-4a13-a39e-a2a170777112 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:29.078255 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-11ce1a3f-0e3c-4a13-a39e-a2a170777112 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:29.083061 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-11ce1a3f-0e3c-4a13-a39e-a2a170777112 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 200 len: 1813 microversion: 2.25 time: 0.623560 Oct 30 01:18:29.086723 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 742/1453] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:28 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 1813 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:18:29.106093 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-60d196e3-6fd8-4f68-9689-ce2d74833d55 tempest-VolumesAdminNegativeTest-130726783 tempest-VolumesAdminNegativeTest-130726783-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "d5695747-d614-4071-ad6d-25dc7b106b02"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:18:29.110489 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-60d196e3-6fd8-4f68-9689-ce2d74833d55 tempest-VolumesAdminNegativeTest-130726783 tempest-VolumesAdminNegativeTest-130726783-project-admin] [instance: 1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:29.124576 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f5c05c6a-ec87-44eb-b041-465f046170aa tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:29.125643 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f5c05c6a-ec87-44eb-b041-465f046170aa tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: 773bba47-dab6-4fbb-91a3-c3a447cd5008] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:29.150494 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-60d196e3-6fd8-4f68-9689-ce2d74833d55 tempest-VolumesAdminNegativeTest-130726783 tempest-VolumesAdminNegativeTest-130726783-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:29.150989 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-60d196e3-6fd8-4f68-9689-ce2d74833d55 tempest-VolumesAdminNegativeTest-130726783 tempest-VolumesAdminNegativeTest-130726783-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:29.151427 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-60d196e3-6fd8-4f68-9689-ce2d74833d55 tempest-VolumesAdminNegativeTest-130726783 tempest-VolumesAdminNegativeTest-130726783-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:29.152153 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-60d196e3-6fd8-4f68-9689-ce2d74833d55 tempest-VolumesAdminNegativeTest-130726783 tempest-VolumesAdminNegativeTest-130726783-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:29.152628 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-60d196e3-6fd8-4f68-9689-ce2d74833d55 tempest-VolumesAdminNegativeTest-130726783 tempest-VolumesAdminNegativeTest-130726783-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:29.153051 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-60d196e3-6fd8-4f68-9689-ce2d74833d55 tempest-VolumesAdminNegativeTest-130726783 tempest-VolumesAdminNegativeTest-130726783-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:29.157224 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5c05c6a-ec87-44eb-b041-465f046170aa tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:29.158647 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5c05c6a-ec87-44eb-b041-465f046170aa tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:29.159269 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5c05c6a-ec87-44eb-b041-465f046170aa tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:29.160144 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5c05c6a-ec87-44eb-b041-465f046170aa tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:29.160800 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5c05c6a-ec87-44eb-b041-465f046170aa tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:29.161682 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5c05c6a-ec87-44eb-b041-465f046170aa tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:29.265648 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5c05c6a-ec87-44eb-b041-465f046170aa tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:29.266653 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5c05c6a-ec87-44eb-b041-465f046170aa tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:29.268544 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5c05c6a-ec87-44eb-b041-465f046170aa tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:29.271330 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-f5c05c6a-ec87-44eb-b041-465f046170aa tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lazy-loading 'fault' on Instance uuid 773bba47-dab6-4fbb-91a3-c3a447cd5008 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:18:29.400919 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-60d196e3-6fd8-4f68-9689-ce2d74833d55 tempest-VolumesAdminNegativeTest-130726783 tempest-VolumesAdminNegativeTest-130726783-project-admin] HTTP exception thrown: Volume d5695747-d614-4071-ad6d-25dc7b106b02 could not be found. Oct 30 01:18:29.405287 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-60d196e3-6fd8-4f68-9689-ce2d74833d55 tempest-VolumesAdminNegativeTest-130726783 tempest-VolumesAdminNegativeTest-130726783-project-admin] Request method failure captured: Oct 30 01:18:29.405287 n-d-master-1 devstack@n-api.service[121103]: request: PUT /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1/os-volume_attachments/2a441626-42b8-4f6e-af0c-8d51ce0d0d76 HTTP/1.1 Oct 30 01:18:29.405287 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:18:29.405287 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:18:29.405287 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:18:29.405287 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 74 Oct 30 01:18:29.405287 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:18:29.405287 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:18:29.405287 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:18:29.405287 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:18:29.405287 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdB0QEwkQzHxTzNXXzAJZOHuMZNAVkQQKprzSxwZPPiYWTxx7NfBIQ4rk_TV2spNqANZJ90nZTDd0_jdD1XVTCGKCO5Qj80xuzI-yoJ7z3se6gI2H5RPOf9snoAQ2_jJP974xAXICqoGDPORZm8wRoi0RuLtjzz9skv8flER0fBko1c Oct 30 01:18:29.405287 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:18:29.405287 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:18:29.405287 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:18:29.405287 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:18:29.405287 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:18:29.405287 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:18:29.405287 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 2556fe0c4670451aade5425cf399f4d0 Oct 30 01:18:29.405287 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-VolumesAdminNegativeTest-130726783 Oct 30 01:18:29.405287 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,admin,reader Oct 30 01:18:29.405287 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,admin,reader Oct 30 01:18:29.407134 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2556fe0c4670451aade5425cf399f4d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2556fe0c4670451aade5425cf399f4d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2556fe0c4670451aade5425cf399f4d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2556fe0c4670451aade5425cf399f4d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:18:29.407134 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-VolumesAdminNegativeTest-130726783 Oct 30 01:18:29.407134 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 2556fe0c4670451aade5425cf399f4d0 Oct 30 01:18:29.407134 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-130726783 Oct 30 01:18:29.407134 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-VolumesAdminNegativeTest-130726783-project-admin Oct 30 01:18:29.407134 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:18:29.407134 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:18:29.407134 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 5b99e0cac1eb48818c5b58a0c9cd8d63 Oct 30 01:18:29.407134 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-VolumesAdminNegativeTest-130726783-project-admin Oct 30 01:18:29.407134 n-d-master-1 devstack@n-api.service[121103]: Oct 30 01:18:29.407134 n-d-master-1 devstack@n-api.service[121103]: {"volumeAttachment": {"volumeId": "d5695747-d614-4071-ad6d-25dc7b106b02"}} Oct 30 01:18:29.407134 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:18:29.407134 n-d-master-1 devstack@n-api.service[121103]: exception: Volume d5695747-d614-4071-ad6d-25dc7b106b02 could not be found. Oct 30 01:18:29.408130 n-d-master-1 devstack@n-api.service[121103]: action_args: {'server_id': '1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1', 'id': '2a441626-42b8-4f6e-af0c-8d51ce0d0d76', 'body': {'volumeAttachment': {'volumeId': 'd5695747-d614-4071-ad6d-25dc7b106b02'}}} Oct 30 01:18:29.408130 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:18:29.408130 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:29.408130 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 30 01:18:29.408130 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 30 01:18:29.408130 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 30 01:18:29.408130 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 30 01:18:29.408130 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 30 01:18:29.408130 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 30 01:18:29.408130 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 30 01:18:29.408130 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 30 01:18:29.408130 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 30 01:18:29.408130 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 30 01:18:29.408130 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 30 01:18:29.408130 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 30 01:18:29.408130 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 30 01:18:29.408130 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 30 01:18:29.409316 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d5695747-d614-4071-ad6d-25dc7b106b02 could not be found. (HTTP 404) (Request-ID: req-c84a2013-b08f-46e4-9704-4133c8eea4d9) Oct 30 01:18:29.409316 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:29.409316 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:18:29.409316 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:29.409316 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:29.409316 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 30 01:18:29.409316 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 30 01:18:29.409316 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 30 01:18:29.409316 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 30 01:18:29.409316 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 30 01:18:29.409316 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 30 01:18:29.409316 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 30 01:18:29.409316 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 30 01:18:29.409316 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 30 01:18:29.409316 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 30 01:18:29.409316 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 30 01:18:29.409316 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 30 01:18:29.409316 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 30 01:18:29.409316 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 30 01:18:29.412490 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 30 01:18:29.412490 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 30 01:18:29.412490 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 30 01:18:29.412490 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 30 01:18:29.412490 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 30 01:18:29.412490 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 30 01:18:29.412490 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 30 01:18:29.412490 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 30 01:18:29.412490 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d5695747-d614-4071-ad6d-25dc7b106b02 could not be found. Oct 30 01:18:29.412490 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:29.412490 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:18:29.412490 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:29.412490 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:29.412490 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:18:29.412490 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:18:29.412490 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:18:29.412490 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:18:29.412490 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:18:29.412490 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:18:29.415170 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:18:29.415170 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:18:29.415170 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:18:29.415170 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:18:29.415170 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 30 01:18:29.415170 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 30 01:18:29.415170 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 30 01:18:29.415170 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 30 01:18:29.415170 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume d5695747-d614-4071-ad6d-25dc7b106b02 could not be found. Oct 30 01:18:29.415170 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:29.415170 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:18:29.415170 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:29.415170 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:29.415170 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:18:29.415170 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:18:29.415170 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:18:29.415170 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:18:29.415170 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d5695747-d614-4071-ad6d-25dc7b106b02 could not be found. Oct 30 01:18:29.415170 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:29.425038 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-60d196e3-6fd8-4f68-9689-ce2d74833d55 tempest-VolumesAdminNegativeTest-130726783 tempest-VolumesAdminNegativeTest-130726783-project-admin] Returning 400 to user: Volume d5695747-d614-4071-ad6d-25dc7b106b02 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:18:29.425038 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-60d196e3-6fd8-4f68-9689-ce2d74833d55 tempest-VolumesAdminNegativeTest-130726783 tempest-VolumesAdminNegativeTest-130726783-project-admin] 10.222.0.13 "PUT /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1/os-volume_attachments/2a441626-42b8-4f6e-af0c-8d51ce0d0d76" status: 400 len: 107 microversion: 2.1 time: 0.843717 Oct 30 01:18:29.426531 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 712/1454] 10.222.0.13 () {60 vars in 1433 bytes} [Sun Oct 30 01:18:28 2022] PUT /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1/os-volume_attachments/2a441626-42b8-4f6e-af0c-8d51ce0d0d76 => generated 107 bytes in 850 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:18:29.440965 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-95c9a304-0bfa-4ed8-9840-f9fb0721253b req-a1c8ada1-d35f-4c1e-b764-57ef6ea3c9c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5387ae83-7934-49d6-a893-3661477ffe69", "name": "network-vif-deleted", "tag": "b034ba77-a38e-49d8-95c0-5b54d7b838ee"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:18:29.458255 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f5c05c6a-ec87-44eb-b041-465f046170aa tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:29.467555 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f5c05c6a-ec87-44eb-b041-465f046170aa tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/773bba47-dab6-4fbb-91a3-c3a447cd5008" status: 200 len: 1303 microversion: 2.1 time: 0.379350 Oct 30 01:18:29.468144 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 743/1455] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:29 2022] GET /compute/v2.1/servers/773bba47-dab6-4fbb-91a3-c3a447cd5008 => generated 1303 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:29.486149 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3d8a38f4-dde1-47dd-a9fa-e1964fb03a3b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:29.488087 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3d8a38f4-dde1-47dd-a9fa-e1964fb03a3b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 5387ae83-7934-49d6-a893-3661477ffe69] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:29.494688 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-95c9a304-0bfa-4ed8-9840-f9fb0721253b req-a1c8ada1-d35f-4c1e-b764-57ef6ea3c9c2 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:29.495547 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-95c9a304-0bfa-4ed8-9840-f9fb0721253b req-a1c8ada1-d35f-4c1e-b764-57ef6ea3c9c2 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:29.496197 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-95c9a304-0bfa-4ed8-9840-f9fb0721253b req-a1c8ada1-d35f-4c1e-b764-57ef6ea3c9c2 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:29.509289 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-95c9a304-0bfa-4ed8-9840-f9fb0721253b req-a1c8ada1-d35f-4c1e-b764-57ef6ea3c9c2 service nova] Creating event network-vif-deleted:b034ba77-a38e-49d8-95c0-5b54d7b838ee for instance 5387ae83-7934-49d6-a893-3661477ffe69 on n-h2-master-1 Oct 30 01:18:29.516395 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d8a38f4-dde1-47dd-a9fa-e1964fb03a3b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:29.518603 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-95c9a304-0bfa-4ed8-9840-f9fb0721253b req-a1c8ada1-d35f-4c1e-b764-57ef6ea3c9c2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090722 Oct 30 01:18:29.519418 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d8a38f4-dde1-47dd-a9fa-e1964fb03a3b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:29.519923 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d8a38f4-dde1-47dd-a9fa-e1964fb03a3b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:29.520372 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 713/1456] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:18:29.524032 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d8a38f4-dde1-47dd-a9fa-e1964fb03a3b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:29.524517 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d8a38f4-dde1-47dd-a9fa-e1964fb03a3b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:29.524952 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d8a38f4-dde1-47dd-a9fa-e1964fb03a3b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:29.545863 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2dd749d7-b650-402d-a7b3-1c14b5da92be tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:29.547829 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2dd749d7-b650-402d-a7b3-1c14b5da92be tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] [instance: 1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:29.556678 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2dd749d7-b650-402d-a7b3-1c14b5da92be tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:29.558343 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2dd749d7-b650-402d-a7b3-1c14b5da92be tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:29.559028 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2dd749d7-b650-402d-a7b3-1c14b5da92be tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:29.560014 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2dd749d7-b650-402d-a7b3-1c14b5da92be tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:29.560685 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2dd749d7-b650-402d-a7b3-1c14b5da92be tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:29.561236 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2dd749d7-b650-402d-a7b3-1c14b5da92be tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:29.585020 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d8a38f4-dde1-47dd-a9fa-e1964fb03a3b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:29.585730 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d8a38f4-dde1-47dd-a9fa-e1964fb03a3b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:29.586173 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d8a38f4-dde1-47dd-a9fa-e1964fb03a3b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:29.586683 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-3d8a38f4-dde1-47dd-a9fa-e1964fb03a3b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lazy-loading 'fault' on Instance uuid 5387ae83-7934-49d6-a893-3661477ffe69 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:18:29.650243 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3d8a38f4-dde1-47dd-a9fa-e1964fb03a3b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:29.672483 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3d8a38f4-dde1-47dd-a9fa-e1964fb03a3b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/5387ae83-7934-49d6-a893-3661477ffe69" status: 200 len: 1306 microversion: 2.1 time: 0.194956 Oct 30 01:18:29.678749 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 744/1457] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:29 2022] GET /compute/v2.1/servers/5387ae83-7934-49d6-a893-3661477ffe69 => generated 1306 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:29.698655 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-abaf7f87-11b0-4c15-bb26-61903cf9b18f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:29.699589 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-abaf7f87-11b0-4c15-bb26-61903cf9b18f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 03d9aff4-215d-48fa-b741-2257b62fc597] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:29.707950 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-abaf7f87-11b0-4c15-bb26-61903cf9b18f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:29.708652 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-abaf7f87-11b0-4c15-bb26-61903cf9b18f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:29.709406 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-abaf7f87-11b0-4c15-bb26-61903cf9b18f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:29.710467 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-abaf7f87-11b0-4c15-bb26-61903cf9b18f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:29.711119 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-abaf7f87-11b0-4c15-bb26-61903cf9b18f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:29.711737 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-abaf7f87-11b0-4c15-bb26-61903cf9b18f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:29.767940 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-2dd749d7-b650-402d-a7b3-1c14b5da92be tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lazy-loading 'services' on Instance uuid 1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:18:29.940675 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-abaf7f87-11b0-4c15-bb26-61903cf9b18f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:29.952180 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-abaf7f87-11b0-4c15-bb26-61903cf9b18f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597" status: 200 len: 1379 microversion: 2.1 time: 0.275809 Oct 30 01:18:29.953622 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 745/1458] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:29 2022] GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597 => generated 1379 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:30.119610 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-44adb2f9-efa2-4fdb-a9a1-a58e5cd0a4e0 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:30.120744 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-44adb2f9-efa2-4fdb-a9a1-a58e5cd0a4e0 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:30.135686 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44adb2f9-efa2-4fdb-a9a1-a58e5cd0a4e0 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:30.136745 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44adb2f9-efa2-4fdb-a9a1-a58e5cd0a4e0 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:30.140975 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44adb2f9-efa2-4fdb-a9a1-a58e5cd0a4e0 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:30.140975 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44adb2f9-efa2-4fdb-a9a1-a58e5cd0a4e0 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:30.140975 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44adb2f9-efa2-4fdb-a9a1-a58e5cd0a4e0 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:30.140975 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44adb2f9-efa2-4fdb-a9a1-a58e5cd0a4e0 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:30.207991 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2dd749d7-b650-402d-a7b3-1c14b5da92be tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] 10.222.0.13 "DELETE /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1/os-volume_attachments/2a441626-42b8-4f6e-af0c-8d51ce0d0d76" status: 202 len: 0 microversion: 2.1 time: 0.667269 Oct 30 01:18:30.208619 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 714/1459] 10.222.0.13 () {58 vars in 1416 bytes} [Sun Oct 30 01:18:29 2022] DELETE /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1/os-volume_attachments/2a441626-42b8-4f6e-af0c-8d51ce0d0d76 => generated 0 bytes in 669 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:18:30.219700 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6291bd7a-61b8-4d5c-9b81-e211b653fddb tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:30.221999 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6291bd7a-61b8-4d5c-9b81-e211b653fddb tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] [instance: 1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:30.268803 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6291bd7a-61b8-4d5c-9b81-e211b653fddb tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:30.270340 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6291bd7a-61b8-4d5c-9b81-e211b653fddb tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:30.272911 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6291bd7a-61b8-4d5c-9b81-e211b653fddb tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:30.277136 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6291bd7a-61b8-4d5c-9b81-e211b653fddb tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:30.277556 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6291bd7a-61b8-4d5c-9b81-e211b653fddb tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:30.279450 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6291bd7a-61b8-4d5c-9b81-e211b653fddb tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:30.408533 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-44adb2f9-efa2-4fdb-a9a1-a58e5cd0a4e0 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:30.419264 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6291bd7a-61b8-4d5c-9b81-e211b653fddb tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] 10.222.0.13 "GET /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.197395 Oct 30 01:18:30.419264 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 715/1460] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 01:18:30 2022] GET /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1/os-volume_attachments => generated 197 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:18:30.430087 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-44adb2f9-efa2-4fdb-a9a1-a58e5cd0a4e0 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:30.433788 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-44adb2f9-efa2-4fdb-a9a1-a58e5cd0a4e0 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:30.437376 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-44adb2f9-efa2-4fdb-a9a1-a58e5cd0a4e0 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 200 len: 1813 microversion: 2.25 time: 0.329466 Oct 30 01:18:30.438602 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 746/1461] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:30 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 1813 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:18:30.501543 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0bcd7060-2c26-41dd-8eef-541031f9cd92 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:30.501934 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0bcd7060-2c26-41dd-8eef-541031f9cd92 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: 773bba47-dab6-4fbb-91a3-c3a447cd5008] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:30.513758 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0bcd7060-2c26-41dd-8eef-541031f9cd92 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:30.514332 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0bcd7060-2c26-41dd-8eef-541031f9cd92 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:30.517593 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0bcd7060-2c26-41dd-8eef-541031f9cd92 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:30.525488 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0bcd7060-2c26-41dd-8eef-541031f9cd92 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:30.526071 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0bcd7060-2c26-41dd-8eef-541031f9cd92 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:30.530333 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0bcd7060-2c26-41dd-8eef-541031f9cd92 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:30.567595 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:30.586835 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0bcd7060-2c26-41dd-8eef-541031f9cd92 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:30.587490 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0bcd7060-2c26-41dd-8eef-541031f9cd92 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:30.587996 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0bcd7060-2c26-41dd-8eef-541031f9cd92 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:30.588456 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-0bcd7060-2c26-41dd-8eef-541031f9cd92 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lazy-loading 'fault' on Instance uuid 773bba47-dab6-4fbb-91a3-c3a447cd5008 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:18:30.653631 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0bcd7060-2c26-41dd-8eef-541031f9cd92 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:30.665231 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0bcd7060-2c26-41dd-8eef-541031f9cd92 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/773bba47-dab6-4fbb-91a3-c3a447cd5008" status: 200 len: 1303 microversion: 2.1 time: 0.165287 Oct 30 01:18:30.665876 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 716/1462] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:30 2022] GET /compute/v2.1/servers/773bba47-dab6-4fbb-91a3-c3a447cd5008 => generated 1303 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:30.700699 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a4529600-5b5a-4015-8a9d-9f5418234cba tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:30.709019 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a4529600-5b5a-4015-8a9d-9f5418234cba tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 5387ae83-7934-49d6-a893-3661477ffe69] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:30.709019 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a4529600-5b5a-4015-8a9d-9f5418234cba tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:30.710149 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a4529600-5b5a-4015-8a9d-9f5418234cba tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:30.710770 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a4529600-5b5a-4015-8a9d-9f5418234cba tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:30.711650 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a4529600-5b5a-4015-8a9d-9f5418234cba tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:30.712711 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a4529600-5b5a-4015-8a9d-9f5418234cba tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:30.713307 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a4529600-5b5a-4015-8a9d-9f5418234cba tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:30.749963 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a4529600-5b5a-4015-8a9d-9f5418234cba tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:30.750689 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a4529600-5b5a-4015-8a9d-9f5418234cba tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:30.751287 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a4529600-5b5a-4015-8a9d-9f5418234cba tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:30.752061 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-a4529600-5b5a-4015-8a9d-9f5418234cba tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lazy-loading 'fault' on Instance uuid 5387ae83-7934-49d6-a893-3661477ffe69 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:18:30.801032 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a4529600-5b5a-4015-8a9d-9f5418234cba tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:30.810775 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a4529600-5b5a-4015-8a9d-9f5418234cba tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/5387ae83-7934-49d6-a893-3661477ffe69" status: 200 len: 1306 microversion: 2.1 time: 0.114207 Oct 30 01:18:30.811629 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 747/1463] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:30 2022] GET /compute/v2.1/servers/5387ae83-7934-49d6-a893-3661477ffe69 => generated 1306 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:30.976835 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fc8ce0df-7c8e-44bc-aaec-af25144aa859 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:30.977623 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-fc8ce0df-7c8e-44bc-aaec-af25144aa859 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 03d9aff4-215d-48fa-b741-2257b62fc597] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:30.986321 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fc8ce0df-7c8e-44bc-aaec-af25144aa859 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:30.986911 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fc8ce0df-7c8e-44bc-aaec-af25144aa859 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:30.988079 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fc8ce0df-7c8e-44bc-aaec-af25144aa859 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:30.988816 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fc8ce0df-7c8e-44bc-aaec-af25144aa859 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:30.989429 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fc8ce0df-7c8e-44bc-aaec-af25144aa859 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:30.996342 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fc8ce0df-7c8e-44bc-aaec-af25144aa859 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:31.340866 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-fc8ce0df-7c8e-44bc-aaec-af25144aa859 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:31.349531 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fc8ce0df-7c8e-44bc-aaec-af25144aa859 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597" status: 200 len: 1379 microversion: 2.1 time: 0.377281 Oct 30 01:18:31.352492 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 717/1464] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:30 2022] GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597 => generated 1379 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:31.427889 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8ccd5700-570a-4d15-af30-338c784d4c40 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:31.430705 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8ccd5700-570a-4d15-af30-338c784d4c40 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] [instance: 1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:31.439389 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8ccd5700-570a-4d15-af30-338c784d4c40 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:31.440994 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8ccd5700-570a-4d15-af30-338c784d4c40 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:31.440994 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8ccd5700-570a-4d15-af30-338c784d4c40 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:31.440994 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8ccd5700-570a-4d15-af30-338c784d4c40 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:31.441509 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8ccd5700-570a-4d15-af30-338c784d4c40 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:31.441936 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8ccd5700-570a-4d15-af30-338c784d4c40 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:31.465635 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3423170e-2b5e-495a-8fed-4e863443a60a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:31.469778 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3423170e-2b5e-495a-8fed-4e863443a60a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:31.473562 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3423170e-2b5e-495a-8fed-4e863443a60a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:31.474339 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3423170e-2b5e-495a-8fed-4e863443a60a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:31.475106 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3423170e-2b5e-495a-8fed-4e863443a60a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:31.475991 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3423170e-2b5e-495a-8fed-4e863443a60a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:31.476610 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3423170e-2b5e-495a-8fed-4e863443a60a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:31.477265 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3423170e-2b5e-495a-8fed-4e863443a60a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:31.511305 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8ccd5700-570a-4d15-af30-338c784d4c40 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] 10.222.0.13 "GET /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087892 Oct 30 01:18:31.516436 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 748/1465] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 01:18:31 2022] GET /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:18:31.689144 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7488f5d4-6abb-4067-8b5a-f30a96307d54 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:31.689809 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7488f5d4-6abb-4067-8b5a-f30a96307d54 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: 773bba47-dab6-4fbb-91a3-c3a447cd5008] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:31.702223 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7488f5d4-6abb-4067-8b5a-f30a96307d54 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:31.705351 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7488f5d4-6abb-4067-8b5a-f30a96307d54 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:31.706314 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7488f5d4-6abb-4067-8b5a-f30a96307d54 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:31.707273 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7488f5d4-6abb-4067-8b5a-f30a96307d54 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:31.708858 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7488f5d4-6abb-4067-8b5a-f30a96307d54 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:31.710190 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7488f5d4-6abb-4067-8b5a-f30a96307d54 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:31.741280 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-7488f5d4-6abb-4067-8b5a-f30a96307d54 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] HTTP exception thrown: Instance 773bba47-dab6-4fbb-91a3-c3a447cd5008 could not be found. Oct 30 01:18:31.743340 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7488f5d4-6abb-4067-8b5a-f30a96307d54 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Request method failure captured: Oct 30 01:18:31.743340 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/773bba47-dab6-4fbb-91a3-c3a447cd5008 HTTP/1.1 Oct 30 01:18:31.743340 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:18:31.743340 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:18:31.743340 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:18:31.743340 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:18:31.743340 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:18:31.743340 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:18:31.743340 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:18:31.743340 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:18:31.743340 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdBLIr-HQgkI-rSu4DbpiRy1V13PfvGTP624UYMiOCdGmuBqdCR6ZXBiD5GM13AKoQSgdQS8eDOFUl5XDTh2OfCVYuKBu9hi10IP7DN1i38HNQdNw2vy91w_U8U2akAexTgOeY8RA_6D56erlCEw53cT0RaTjARVr810cdgiCXo6doY Oct 30 01:18:31.743340 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:18:31.743340 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:18:31.743340 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:18:31.743340 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:18:31.743340 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:18:31.743340 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:18:31.743340 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: b90a3225f0bb4bb6a90847078c27720d Oct 30 01:18:31.743340 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServersAdminTestJSON-1617649150 Oct 30 01:18:31.743340 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:18:31.743340 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:18:31.744919 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b90a3225f0bb4bb6a90847078c27720d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b90a3225f0bb4bb6a90847078c27720d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b90a3225f0bb4bb6a90847078c27720d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b90a3225f0bb4bb6a90847078c27720d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:18:31.744919 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServersAdminTestJSON-1617649150 Oct 30 01:18:31.744919 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: b90a3225f0bb4bb6a90847078c27720d Oct 30 01:18:31.744919 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServersAdminTestJSON-1617649150 Oct 30 01:18:31.744919 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServersAdminTestJSON-1617649150-project Oct 30 01:18:31.744919 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:18:31.744919 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:18:31.744919 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: f33a2fe009b74c1285df84f614f38866 Oct 30 01:18:31.744919 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServersAdminTestJSON-1617649150-project Oct 30 01:18:31.744919 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:18:31.744919 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 773bba47-dab6-4fbb-91a3-c3a447cd5008 could not be found. Oct 30 01:18:31.744919 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '773bba47-dab6-4fbb-91a3-c3a447cd5008'} Oct 30 01:18:31.745717 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:18:31.745717 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:31.745717 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:18:31.745717 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:18:31.745717 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:18:31.745717 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:18:31.745717 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:18:31.745717 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:18:31.745717 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:18:31.745717 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:18:31.745717 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 773bba47-dab6-4fbb-91a3-c3a447cd5008 could not be found. Oct 30 01:18:31.745717 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:18:31.745717 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:18:31.745717 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:18:31.745717 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:31.745717 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:18:31.745717 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:18:31.745717 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:18:31.745717 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:18:31.745717 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:18:31.746969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:18:31.746969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:18:31.746969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:18:31.746969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:18:31.746969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:18:31.746969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:18:31.746969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:18:31.746969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 773bba47-dab6-4fbb-91a3-c3a447cd5008 could not be found. Oct 30 01:18:31.746969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:18:31.746969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:18:31.746969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:18:31.746969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:31.746969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:18:31.746969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:18:31.746969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:18:31.746969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:18:31.746969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 773bba47-dab6-4fbb-91a3-c3a447cd5008 could not be found. Oct 30 01:18:31.746969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:18:31.748163 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7488f5d4-6abb-4067-8b5a-f30a96307d54 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Returning 404 to user: Instance 773bba47-dab6-4fbb-91a3-c3a447cd5008 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:18:31.752394 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7488f5d4-6abb-4067-8b5a-f30a96307d54 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/773bba47-dab6-4fbb-91a3-c3a447cd5008" status: 404 len: 111 microversion: 2.1 time: 0.064654 Oct 30 01:18:31.753910 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 749/1466] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:31 2022] GET /compute/v2.1/servers/773bba47-dab6-4fbb-91a3-c3a447cd5008 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:18:31.763090 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e7c16412-8b78-4041-95d1-417b508469f1 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:31.763598 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e7c16412-8b78-4041-95d1-417b508469f1 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: 25a595ee-91e9-4d66-9898-15c577c9bcec] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:31.784158 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e7c16412-8b78-4041-95d1-417b508469f1 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:31.786982 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e7c16412-8b78-4041-95d1-417b508469f1 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:31.786982 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e7c16412-8b78-4041-95d1-417b508469f1 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:31.786982 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e7c16412-8b78-4041-95d1-417b508469f1 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:31.788399 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e7c16412-8b78-4041-95d1-417b508469f1 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:31.789176 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e7c16412-8b78-4041-95d1-417b508469f1 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:31.838492 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e7c16412-8b78-4041-95d1-417b508469f1 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: 25a595ee-91e9-4d66-9898-15c577c9bcec] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:18:31.850664 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:31.955791 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3423170e-2b5e-495a-8fed-4e863443a60a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:31.965845 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3423170e-2b5e-495a-8fed-4e863443a60a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:31.972768 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3423170e-2b5e-495a-8fed-4e863443a60a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:31.974114 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3423170e-2b5e-495a-8fed-4e863443a60a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 200 len: 1813 microversion: 2.25 time: 0.513206 Oct 30 01:18:31.976790 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 718/1467] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:31 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 1813 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:18:31.988950 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4387f116-8f15-4ccc-a478-869374aa13e4 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:31.990002 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4387f116-8f15-4ccc-a478-869374aa13e4 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 5387ae83-7934-49d6-a893-3661477ffe69] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:32.030764 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4387f116-8f15-4ccc-a478-869374aa13e4 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:32.031623 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4387f116-8f15-4ccc-a478-869374aa13e4 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:32.032319 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4387f116-8f15-4ccc-a478-869374aa13e4 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:32.033119 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4387f116-8f15-4ccc-a478-869374aa13e4 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:32.033671 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4387f116-8f15-4ccc-a478-869374aa13e4 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:32.034268 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4387f116-8f15-4ccc-a478-869374aa13e4 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:32.067221 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-4387f116-8f15-4ccc-a478-869374aa13e4 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] HTTP exception thrown: Instance 5387ae83-7934-49d6-a893-3661477ffe69 could not be found. Oct 30 01:18:32.075233 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4387f116-8f15-4ccc-a478-869374aa13e4 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Request method failure captured: Oct 30 01:18:32.075233 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/5387ae83-7934-49d6-a893-3661477ffe69 HTTP/1.1 Oct 30 01:18:32.075233 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:18:32.075233 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:18:32.075233 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:18:32.075233 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:18:32.075233 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:18:32.075233 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:18:32.075233 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:18:32.075233 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:18:32.075233 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdAyWG8ULueMlzGM_sHwJ9SOWADIPTb7By9fNsRcbHROHwygMRdk9IkmaCTF8DGTaB-qJmpNM38UnmXLKL5MROOCKmetoapYOI7trRPWkBfioCQrOG4AuSuVej_G20QC_MDzAmUbQ-QTCr2g6dCwwHCik9ACvFc8hu-sRLY-wv25V6Q Oct 30 01:18:32.075233 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:18:32.075233 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:18:32.075233 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:18:32.075233 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:18:32.075233 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:18:32.075233 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:18:32.075233 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 76b6f7b705f5428b9a3a3a8c4f86ff48 Oct 30 01:18:32.075233 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersOnMultiNodesTest-1214334609 Oct 30 01:18:32.075233 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:18:32.075233 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:18:32.076689 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/76b6f7b705f5428b9a3a3a8c4f86ff48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_76b6f7b705f5428b9a3a3a8c4f86ff48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/76b6f7b705f5428b9a3a3a8c4f86ff48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/76b6f7b705f5428b9a3a3a8c4f86ff48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:18:32.076689 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersOnMultiNodesTest-1214334609 Oct 30 01:18:32.076689 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 76b6f7b705f5428b9a3a3a8c4f86ff48 Oct 30 01:18:32.076689 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1214334609 Oct 30 01:18:32.076689 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersOnMultiNodesTest-1214334609-project Oct 30 01:18:32.076689 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:18:32.076689 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:18:32.076689 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: c536d41a93ad4337909fe2e2cb949e03 Oct 30 01:18:32.076689 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersOnMultiNodesTest-1214334609-project Oct 30 01:18:32.076689 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:18:32.076689 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 5387ae83-7934-49d6-a893-3661477ffe69 could not be found. Oct 30 01:18:32.076689 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '5387ae83-7934-49d6-a893-3661477ffe69'} Oct 30 01:18:32.079614 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:18:32.079614 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:32.079614 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:18:32.079614 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:18:32.079614 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:18:32.079614 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:18:32.079614 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:18:32.079614 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:18:32.079614 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:18:32.079614 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:18:32.079614 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5387ae83-7934-49d6-a893-3661477ffe69 could not be found. Oct 30 01:18:32.079614 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:32.079614 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:18:32.079614 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:32.079614 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:32.079614 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:18:32.079614 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:18:32.079614 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:18:32.079614 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:18:32.079614 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:18:32.081129 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:18:32.081129 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:18:32.081129 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:18:32.081129 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:18:32.081129 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:18:32.081129 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:18:32.081129 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:18:32.081129 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5387ae83-7934-49d6-a893-3661477ffe69 could not be found. Oct 30 01:18:32.081129 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:32.081129 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:18:32.081129 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:32.081129 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:32.081129 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:18:32.081129 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:18:32.081129 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:18:32.081129 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:18:32.081129 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5387ae83-7934-49d6-a893-3661477ffe69 could not be found. Oct 30 01:18:32.081129 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:18:32.083297 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4387f116-8f15-4ccc-a478-869374aa13e4 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Returning 404 to user: Instance 5387ae83-7934-49d6-a893-3661477ffe69 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:18:32.085090 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4387f116-8f15-4ccc-a478-869374aa13e4 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/5387ae83-7934-49d6-a893-3661477ffe69" status: 404 len: 111 microversion: 2.1 time: 0.103349 Oct 30 01:18:32.085807 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 719/1468] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:31 2022] GET /compute/v2.1/servers/5387ae83-7934-49d6-a893-3661477ffe69 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:18:32.101523 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-79629bdb-5d40-4717-9ad5-0c148b520e18 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:32.102041 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-79629bdb-5d40-4717-9ad5-0c148b520e18 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 50f83abd-f45c-4217-8130-30a7bebd08b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:32.111161 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-79629bdb-5d40-4717-9ad5-0c148b520e18 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:32.112168 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-79629bdb-5d40-4717-9ad5-0c148b520e18 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:32.112715 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-79629bdb-5d40-4717-9ad5-0c148b520e18 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:32.114083 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-79629bdb-5d40-4717-9ad5-0c148b520e18 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:32.115056 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-79629bdb-5d40-4717-9ad5-0c148b520e18 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:32.116576 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-79629bdb-5d40-4717-9ad5-0c148b520e18 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:32.152770 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-79629bdb-5d40-4717-9ad5-0c148b520e18 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 50f83abd-f45c-4217-8130-30a7bebd08b9] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:18:32.272511 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e7c16412-8b78-4041-95d1-417b508469f1 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "DELETE /compute/v2.1/servers/25a595ee-91e9-4d66-9898-15c577c9bcec" status: 204 len: 0 microversion: 2.1 time: 0.514269 Oct 30 01:18:32.273274 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 750/1469] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:18:31 2022] DELETE /compute/v2.1/servers/25a595ee-91e9-4d66-9898-15c577c9bcec => generated 0 bytes in 516 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:18:32.283403 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1040a69b-d6c5-4146-8142-718a4ffd4791 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:32.284437 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1040a69b-d6c5-4146-8142-718a4ffd4791 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: 25a595ee-91e9-4d66-9898-15c577c9bcec] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:32.307790 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1040a69b-d6c5-4146-8142-718a4ffd4791 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:32.308284 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1040a69b-d6c5-4146-8142-718a4ffd4791 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:32.308717 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1040a69b-d6c5-4146-8142-718a4ffd4791 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:32.321681 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1040a69b-d6c5-4146-8142-718a4ffd4791 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:32.324059 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1040a69b-d6c5-4146-8142-718a4ffd4791 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:32.324520 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1040a69b-d6c5-4146-8142-718a4ffd4791 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:32.478467 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-79629bdb-5d40-4717-9ad5-0c148b520e18 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "DELETE /compute/v2.1/servers/50f83abd-f45c-4217-8130-30a7bebd08b9" status: 204 len: 0 microversion: 2.1 time: 0.387584 Oct 30 01:18:32.480717 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 720/1470] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:18:32 2022] DELETE /compute/v2.1/servers/50f83abd-f45c-4217-8130-30a7bebd08b9 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:18:32.485280 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cf473971-2f8f-45c1-b6b0-4da94b5ab00a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:32.487888 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-cf473971-2f8f-45c1-b6b0-4da94b5ab00a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 03d9aff4-215d-48fa-b741-2257b62fc597] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:32.493452 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cf473971-2f8f-45c1-b6b0-4da94b5ab00a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:32.494289 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cf473971-2f8f-45c1-b6b0-4da94b5ab00a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:32.495082 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cf473971-2f8f-45c1-b6b0-4da94b5ab00a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:32.495974 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cf473971-2f8f-45c1-b6b0-4da94b5ab00a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:32.496589 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cf473971-2f8f-45c1-b6b0-4da94b5ab00a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:32.497184 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cf473971-2f8f-45c1-b6b0-4da94b5ab00a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:32.531348 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1040a69b-d6c5-4146-8142-718a4ffd4791 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:32.541522 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1040a69b-d6c5-4146-8142-718a4ffd4791 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/25a595ee-91e9-4d66-9898-15c577c9bcec" status: 200 len: 1470 microversion: 2.1 time: 0.263255 Oct 30 01:18:32.556067 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 751/1471] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:32 2022] GET /compute/v2.1/servers/25a595ee-91e9-4d66-9898-15c577c9bcec => generated 1470 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:18:32.556067 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-477c2e6b-8818-4060-b929-7e9dbb27e8aa tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:32.556067 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-477c2e6b-8818-4060-b929-7e9dbb27e8aa tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 50f83abd-f45c-4217-8130-30a7bebd08b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:32.557547 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-477c2e6b-8818-4060-b929-7e9dbb27e8aa tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:32.558548 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-477c2e6b-8818-4060-b929-7e9dbb27e8aa tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:32.559150 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-477c2e6b-8818-4060-b929-7e9dbb27e8aa tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:32.560099 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-477c2e6b-8818-4060-b929-7e9dbb27e8aa tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:32.560810 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-477c2e6b-8818-4060-b929-7e9dbb27e8aa tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:32.564777 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-477c2e6b-8818-4060-b929-7e9dbb27e8aa tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:32.820594 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-cf473971-2f8f-45c1-b6b0-4da94b5ab00a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:32.839804 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cf473971-2f8f-45c1-b6b0-4da94b5ab00a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597" status: 200 len: 1379 microversion: 2.1 time: 0.348558 Oct 30 01:18:32.845825 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 721/1472] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:32 2022] GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597 => generated 1379 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:32.878267 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-477c2e6b-8818-4060-b929-7e9dbb27e8aa tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:32.888452 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-477c2e6b-8818-4060-b929-7e9dbb27e8aa tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/50f83abd-f45c-4217-8130-30a7bebd08b9" status: 200 len: 1471 microversion: 2.1 time: 0.343786 Oct 30 01:18:32.905791 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7cde3a8d-aafa-438e-afdb-3414e95ec54e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:32.913708 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7cde3a8d-aafa-438e-afdb-3414e95ec54e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] [instance: 1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:32.915829 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 752/1473] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:32 2022] GET /compute/v2.1/servers/50f83abd-f45c-4217-8130-30a7bebd08b9 => generated 1471 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:32.926595 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7cde3a8d-aafa-438e-afdb-3414e95ec54e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:32.932255 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7cde3a8d-aafa-438e-afdb-3414e95ec54e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:32.932740 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7cde3a8d-aafa-438e-afdb-3414e95ec54e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:32.933554 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7cde3a8d-aafa-438e-afdb-3414e95ec54e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:32.934028 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7cde3a8d-aafa-438e-afdb-3414e95ec54e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:32.934454 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7cde3a8d-aafa-438e-afdb-3414e95ec54e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:33.003913 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b96d58a4-cc57-48f0-87a3-66d403a692ec tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:33.004863 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b96d58a4-cc57-48f0-87a3-66d403a692ec tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:33.015335 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b96d58a4-cc57-48f0-87a3-66d403a692ec tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:33.016126 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b96d58a4-cc57-48f0-87a3-66d403a692ec tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:33.023039 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b96d58a4-cc57-48f0-87a3-66d403a692ec tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:33.024053 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b96d58a4-cc57-48f0-87a3-66d403a692ec tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:33.024691 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b96d58a4-cc57-48f0-87a3-66d403a692ec tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:33.025926 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b96d58a4-cc57-48f0-87a3-66d403a692ec tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:33.034056 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7cde3a8d-aafa-438e-afdb-3414e95ec54e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] 10.222.0.13 "GET /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.183141 Oct 30 01:18:33.035909 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 722/1474] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 01:18:32 2022] GET /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1/os-volume_attachments => generated 197 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:18:33.232635 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b96d58a4-cc57-48f0-87a3-66d403a692ec tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:33.243906 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b96d58a4-cc57-48f0-87a3-66d403a692ec tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:33.248838 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b96d58a4-cc57-48f0-87a3-66d403a692ec tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:33.248838 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b96d58a4-cc57-48f0-87a3-66d403a692ec tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 200 len: 1813 microversion: 2.25 time: 0.248536 Oct 30 01:18:33.248838 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 753/1475] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:32 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 1813 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:18:33.346960 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-f71cd45e-34af-4c8a-9f5f-0c3de1552460 req-83217602-bfc6-4e94-9e54-71deab6a472c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03d9aff4-215d-48fa-b741-2257b62fc597", "name": "network-vif-plugged", "status": "completed", "tag": "f852959f-05e2-49d9-95ba-a62b3b029d75"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:18:33.354930 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:33.362860 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-f71cd45e-34af-4c8a-9f5f-0c3de1552460 req-83217602-bfc6-4e94-9e54-71deab6a472c service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:33.365874 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-f71cd45e-34af-4c8a-9f5f-0c3de1552460 req-83217602-bfc6-4e94-9e54-71deab6a472c service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:33.366347 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-f71cd45e-34af-4c8a-9f5f-0c3de1552460 req-83217602-bfc6-4e94-9e54-71deab6a472c service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:33.390237 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-f71cd45e-34af-4c8a-9f5f-0c3de1552460 req-83217602-bfc6-4e94-9e54-71deab6a472c service nova] Creating event network-vif-plugged:f852959f-05e2-49d9-95ba-a62b3b029d75 for instance 03d9aff4-215d-48fa-b741-2257b62fc597 on n-h1-master-1 Oct 30 01:18:33.408909 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-f71cd45e-34af-4c8a-9f5f-0c3de1552460 req-83217602-bfc6-4e94-9e54-71deab6a472c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075358 Oct 30 01:18:33.409550 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 723/1476] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:18:33.570946 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0d15560b-8466-4797-840a-859027d1b490 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:33.571560 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0d15560b-8466-4797-840a-859027d1b490 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: 25a595ee-91e9-4d66-9898-15c577c9bcec] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:33.581268 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0d15560b-8466-4797-840a-859027d1b490 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:33.581789 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0d15560b-8466-4797-840a-859027d1b490 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:33.582240 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0d15560b-8466-4797-840a-859027d1b490 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:33.582943 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0d15560b-8466-4797-840a-859027d1b490 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:33.588928 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0d15560b-8466-4797-840a-859027d1b490 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:33.589513 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0d15560b-8466-4797-840a-859027d1b490 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:33.864728 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f616ed2c-94ac-4580-aa88-03050e8029aa tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:33.866153 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f616ed2c-94ac-4580-aa88-03050e8029aa tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 03d9aff4-215d-48fa-b741-2257b62fc597] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:33.875848 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f616ed2c-94ac-4580-aa88-03050e8029aa tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:33.882582 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f616ed2c-94ac-4580-aa88-03050e8029aa tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:33.884938 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f616ed2c-94ac-4580-aa88-03050e8029aa tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:33.884938 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f616ed2c-94ac-4580-aa88-03050e8029aa tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:33.884938 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f616ed2c-94ac-4580-aa88-03050e8029aa tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:33.884938 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f616ed2c-94ac-4580-aa88-03050e8029aa tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:33.914721 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0d15560b-8466-4797-840a-859027d1b490 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:33.924742 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0d15560b-8466-4797-840a-859027d1b490 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/25a595ee-91e9-4d66-9898-15c577c9bcec" status: 200 len: 1470 microversion: 2.1 time: 0.358133 Oct 30 01:18:33.930587 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 754/1477] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:33 2022] GET /compute/v2.1/servers/25a595ee-91e9-4d66-9898-15c577c9bcec => generated 1470 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:33.942018 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e381693f-2324-4916-b732-b59898fd82ee tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:33.942906 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e381693f-2324-4916-b732-b59898fd82ee tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 50f83abd-f45c-4217-8130-30a7bebd08b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:33.962350 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e381693f-2324-4916-b732-b59898fd82ee tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:33.963128 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e381693f-2324-4916-b732-b59898fd82ee tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:33.963769 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e381693f-2324-4916-b732-b59898fd82ee tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:33.964761 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e381693f-2324-4916-b732-b59898fd82ee tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:33.965428 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e381693f-2324-4916-b732-b59898fd82ee tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:33.966108 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e381693f-2324-4916-b732-b59898fd82ee tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:34.219592 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f616ed2c-94ac-4580-aa88-03050e8029aa tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:34.228820 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e381693f-2324-4916-b732-b59898fd82ee tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:34.235111 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f616ed2c-94ac-4580-aa88-03050e8029aa tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597" status: 200 len: 1379 microversion: 2.1 time: 0.374224 Oct 30 01:18:34.236195 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 724/1478] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:33 2022] GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597 => generated 1379 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:34.243562 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-31ae2520-658b-4f0b-8520-9b13987aabd0 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:34.246401 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-31ae2520-658b-4f0b-8520-9b13987aabd0 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] [instance: 1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:34.253215 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e381693f-2324-4916-b732-b59898fd82ee tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/50f83abd-f45c-4217-8130-30a7bebd08b9" status: 200 len: 1471 microversion: 2.1 time: 0.320529 Oct 30 01:18:34.257182 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-31ae2520-658b-4f0b-8520-9b13987aabd0 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:34.257821 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-31ae2520-658b-4f0b-8520-9b13987aabd0 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:34.258633 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-31ae2520-658b-4f0b-8520-9b13987aabd0 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:34.259233 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-31ae2520-658b-4f0b-8520-9b13987aabd0 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:34.259741 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-31ae2520-658b-4f0b-8520-9b13987aabd0 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:34.260165 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-31ae2520-658b-4f0b-8520-9b13987aabd0 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:34.260686 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 755/1479] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:33 2022] GET /compute/v2.1/servers/50f83abd-f45c-4217-8130-30a7bebd08b9 => generated 1471 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:34.281691 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ae52190a-2859-41d5-86a3-8ba8d76fa41c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:34.283412 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ae52190a-2859-41d5-86a3-8ba8d76fa41c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:34.295934 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae52190a-2859-41d5-86a3-8ba8d76fa41c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:34.301897 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae52190a-2859-41d5-86a3-8ba8d76fa41c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:34.302541 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae52190a-2859-41d5-86a3-8ba8d76fa41c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:34.304438 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae52190a-2859-41d5-86a3-8ba8d76fa41c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:34.309878 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae52190a-2859-41d5-86a3-8ba8d76fa41c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:34.310769 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae52190a-2859-41d5-86a3-8ba8d76fa41c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:34.317760 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-31ae2520-658b-4f0b-8520-9b13987aabd0 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] 10.222.0.13 "GET /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079766 Oct 30 01:18:34.326056 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 725/1480] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 01:18:34 2022] GET /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:18:34.611882 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ae52190a-2859-41d5-86a3-8ba8d76fa41c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:34.634391 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ae52190a-2859-41d5-86a3-8ba8d76fa41c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:34.642057 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ae52190a-2859-41d5-86a3-8ba8d76fa41c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:34.643589 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ae52190a-2859-41d5-86a3-8ba8d76fa41c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 200 len: 1813 microversion: 2.25 time: 0.371258 Oct 30 01:18:34.663538 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 756/1481] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:34 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 1813 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:18:34.956382 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d6d6d0ae-907a-4b7e-8693-854b1270ed82 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:34.960141 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d6d6d0ae-907a-4b7e-8693-854b1270ed82 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: 25a595ee-91e9-4d66-9898-15c577c9bcec] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:34.966634 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d6d6d0ae-907a-4b7e-8693-854b1270ed82 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:34.967746 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d6d6d0ae-907a-4b7e-8693-854b1270ed82 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:34.969757 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d6d6d0ae-907a-4b7e-8693-854b1270ed82 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:34.970651 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d6d6d0ae-907a-4b7e-8693-854b1270ed82 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:34.971272 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d6d6d0ae-907a-4b7e-8693-854b1270ed82 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:34.971857 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d6d6d0ae-907a-4b7e-8693-854b1270ed82 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:35.139045 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d6d6d0ae-907a-4b7e-8693-854b1270ed82 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:35.149168 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d6d6d0ae-907a-4b7e-8693-854b1270ed82 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/25a595ee-91e9-4d66-9898-15c577c9bcec" status: 200 len: 1470 microversion: 2.1 time: 0.197673 Oct 30 01:18:35.151791 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 726/1482] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:34 2022] GET /compute/v2.1/servers/25a595ee-91e9-4d66-9898-15c577c9bcec => generated 1470 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:35.265217 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a4e362df-a568-4911-a69b-4306d098abeb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:35.266072 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a4e362df-a568-4911-a69b-4306d098abeb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 03d9aff4-215d-48fa-b741-2257b62fc597] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:35.273204 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a4e362df-a568-4911-a69b-4306d098abeb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:35.273930 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a4e362df-a568-4911-a69b-4306d098abeb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:35.274690 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a4e362df-a568-4911-a69b-4306d098abeb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:35.275852 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a4e362df-a568-4911-a69b-4306d098abeb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:35.276813 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a4e362df-a568-4911-a69b-4306d098abeb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:35.277935 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a4e362df-a568-4911-a69b-4306d098abeb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:35.284565 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-09c4d493-1b3c-4f46-8768-c701b2e0e189 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:35.285788 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-09c4d493-1b3c-4f46-8768-c701b2e0e189 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 50f83abd-f45c-4217-8130-30a7bebd08b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:35.299693 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-09c4d493-1b3c-4f46-8768-c701b2e0e189 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:35.300521 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-09c4d493-1b3c-4f46-8768-c701b2e0e189 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:35.301142 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-09c4d493-1b3c-4f46-8768-c701b2e0e189 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:35.302064 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-09c4d493-1b3c-4f46-8768-c701b2e0e189 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:35.302681 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-09c4d493-1b3c-4f46-8768-c701b2e0e189 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:35.307249 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-09c4d493-1b3c-4f46-8768-c701b2e0e189 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:35.702033 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-09c4d493-1b3c-4f46-8768-c701b2e0e189 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:35.716928 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-09c4d493-1b3c-4f46-8768-c701b2e0e189 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/50f83abd-f45c-4217-8130-30a7bebd08b9" status: 200 len: 1471 microversion: 2.1 time: 0.436702 Oct 30 01:18:35.729442 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 727/1483] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:35 2022] GET /compute/v2.1/servers/50f83abd-f45c-4217-8130-30a7bebd08b9 => generated 1471 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:35.736362 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0dc826ac-18fb-4011-94af-aded62d81895 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:35.736362 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0dc826ac-18fb-4011-94af-aded62d81895 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] [instance: 1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:35.748869 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a4e362df-a568-4911-a69b-4306d098abeb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:35.749501 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0dc826ac-18fb-4011-94af-aded62d81895 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:35.750006 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0dc826ac-18fb-4011-94af-aded62d81895 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:35.750446 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0dc826ac-18fb-4011-94af-aded62d81895 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:35.751156 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0dc826ac-18fb-4011-94af-aded62d81895 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:35.756805 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0dc826ac-18fb-4011-94af-aded62d81895 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:35.757257 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0dc826ac-18fb-4011-94af-aded62d81895 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:35.760483 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a4e362df-a568-4911-a69b-4306d098abeb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597" status: 200 len: 1379 microversion: 2.1 time: 0.498391 Oct 30 01:18:35.771574 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 757/1484] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:35 2022] GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597 => generated 1379 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:35.784792 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-af295cc0-1f14-4aab-a7fc-a4090d0737df tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:35.785431 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-af295cc0-1f14-4aab-a7fc-a4090d0737df tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:35.796019 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af295cc0-1f14-4aab-a7fc-a4090d0737df tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:35.800071 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af295cc0-1f14-4aab-a7fc-a4090d0737df tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:35.800071 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af295cc0-1f14-4aab-a7fc-a4090d0737df tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:35.800071 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af295cc0-1f14-4aab-a7fc-a4090d0737df tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:35.800071 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af295cc0-1f14-4aab-a7fc-a4090d0737df tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:35.800517 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af295cc0-1f14-4aab-a7fc-a4090d0737df tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:35.835662 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0dc826ac-18fb-4011-94af-aded62d81895 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] 10.222.0.13 "GET /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115954 Oct 30 01:18:35.840302 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 728/1485] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 01:18:35 2022] GET /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:18:36.182445 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9d62bd5c-5e54-4c1f-bccf-d7b84a80a541 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:36.183199 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9d62bd5c-5e54-4c1f-bccf-d7b84a80a541 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: 25a595ee-91e9-4d66-9898-15c577c9bcec] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:36.196035 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9d62bd5c-5e54-4c1f-bccf-d7b84a80a541 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:36.201436 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9d62bd5c-5e54-4c1f-bccf-d7b84a80a541 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:36.203731 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9d62bd5c-5e54-4c1f-bccf-d7b84a80a541 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:36.205825 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9d62bd5c-5e54-4c1f-bccf-d7b84a80a541 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:36.206682 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9d62bd5c-5e54-4c1f-bccf-d7b84a80a541 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:36.207392 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9d62bd5c-5e54-4c1f-bccf-d7b84a80a541 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:36.417198 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9d62bd5c-5e54-4c1f-bccf-d7b84a80a541 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:36.429827 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9d62bd5c-5e54-4c1f-bccf-d7b84a80a541 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/25a595ee-91e9-4d66-9898-15c577c9bcec" status: 200 len: 1428 microversion: 2.1 time: 0.249141 Oct 30 01:18:36.432370 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 729/1486] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:36 2022] GET /compute/v2.1/servers/25a595ee-91e9-4d66-9898-15c577c9bcec => generated 1428 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:36.440903 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-ab35ea85-a528-4437-b877-6aba80681c14 req-ba7f2770-7b6e-4875-b0da-d43f5710a2a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25a595ee-91e9-4d66-9898-15c577c9bcec", "name": "network-vif-deleted", "tag": "e7c9bc55-bd5d-480e-bb9f-48e2f7c98104"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:18:36.450705 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-af295cc0-1f14-4aab-a7fc-a4090d0737df tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:36.458905 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ab35ea85-a528-4437-b877-6aba80681c14 req-ba7f2770-7b6e-4875-b0da-d43f5710a2a3 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:36.459433 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ab35ea85-a528-4437-b877-6aba80681c14 req-ba7f2770-7b6e-4875-b0da-d43f5710a2a3 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:36.459861 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ab35ea85-a528-4437-b877-6aba80681c14 req-ba7f2770-7b6e-4875-b0da-d43f5710a2a3 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:36.463839 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-af295cc0-1f14-4aab-a7fc-a4090d0737df tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:36.466162 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-af295cc0-1f14-4aab-a7fc-a4090d0737df tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:36.467848 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-af295cc0-1f14-4aab-a7fc-a4090d0737df tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 200 len: 1813 microversion: 2.25 time: 0.687090 Oct 30 01:18:36.468991 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 758/1487] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:35 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 1813 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:18:36.489077 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-ab35ea85-a528-4437-b877-6aba80681c14 req-ba7f2770-7b6e-4875-b0da-d43f5710a2a3 service nova] Creating event network-vif-deleted:e7c9bc55-bd5d-480e-bb9f-48e2f7c98104 for instance 25a595ee-91e9-4d66-9898-15c577c9bcec on n-h2-master-1 Oct 30 01:18:36.502414 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-ab35ea85-a528-4437-b877-6aba80681c14 req-ba7f2770-7b6e-4875-b0da-d43f5710a2a3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067203 Oct 30 01:18:36.503094 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 730/1488] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:18:36.751403 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1305b21b-555f-4a5a-89ce-c4f70d4d533b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:36.753472 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1305b21b-555f-4a5a-89ce-c4f70d4d533b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 50f83abd-f45c-4217-8130-30a7bebd08b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:36.786965 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1305b21b-555f-4a5a-89ce-c4f70d4d533b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:36.789533 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-adcceb8e-7164-4f28-9ace-c7aad6186a7a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:36.790713 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-adcceb8e-7164-4f28-9ace-c7aad6186a7a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 03d9aff4-215d-48fa-b741-2257b62fc597] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:36.795457 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1305b21b-555f-4a5a-89ce-c4f70d4d533b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:36.796132 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1305b21b-555f-4a5a-89ce-c4f70d4d533b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:36.796913 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1305b21b-555f-4a5a-89ce-c4f70d4d533b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:36.797436 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1305b21b-555f-4a5a-89ce-c4f70d4d533b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:36.797822 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1305b21b-555f-4a5a-89ce-c4f70d4d533b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:36.799700 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-adcceb8e-7164-4f28-9ace-c7aad6186a7a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:36.800400 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-adcceb8e-7164-4f28-9ace-c7aad6186a7a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:36.801088 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-adcceb8e-7164-4f28-9ace-c7aad6186a7a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:36.802237 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-adcceb8e-7164-4f28-9ace-c7aad6186a7a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:36.802913 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-adcceb8e-7164-4f28-9ace-c7aad6186a7a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:36.803605 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-adcceb8e-7164-4f28-9ace-c7aad6186a7a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:36.970380 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1305b21b-555f-4a5a-89ce-c4f70d4d533b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:36.991685 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1305b21b-555f-4a5a-89ce-c4f70d4d533b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/50f83abd-f45c-4217-8130-30a7bebd08b9" status: 200 len: 1429 microversion: 2.1 time: 0.250289 Oct 30 01:18:36.993429 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 759/1489] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:36 2022] GET /compute/v2.1/servers/50f83abd-f45c-4217-8130-30a7bebd08b9 => generated 1429 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:37.005933 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a9a8e145-80bb-4e2d-a779-08af94640f8e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:37.011340 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a9a8e145-80bb-4e2d-a779-08af94640f8e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] [instance: 1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:37.028200 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a9a8e145-80bb-4e2d-a779-08af94640f8e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:37.031557 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a9a8e145-80bb-4e2d-a779-08af94640f8e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:37.032405 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a9a8e145-80bb-4e2d-a779-08af94640f8e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:37.033605 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a9a8e145-80bb-4e2d-a779-08af94640f8e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:37.035631 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a9a8e145-80bb-4e2d-a779-08af94640f8e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:37.036364 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a9a8e145-80bb-4e2d-a779-08af94640f8e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:37.115807 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a9a8e145-80bb-4e2d-a779-08af94640f8e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] 10.222.0.13 "GET /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120713 Oct 30 01:18:37.120045 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 760/1490] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 01:18:36 2022] GET /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:18:37.137611 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-add6f524-9a2f-47eb-bbb6-fdf32588ecc0 req-6c75719e-11cd-4851-823c-71f8afed0796 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50f83abd-f45c-4217-8130-30a7bebd08b9", "name": "network-vif-deleted", "tag": "d2f79325-a6b2-470b-8e09-f0e2f2e2fd35"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:18:37.149408 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-add6f524-9a2f-47eb-bbb6-fdf32588ecc0 req-6c75719e-11cd-4851-823c-71f8afed0796 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:37.150403 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-add6f524-9a2f-47eb-bbb6-fdf32588ecc0 req-6c75719e-11cd-4851-823c-71f8afed0796 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:37.151086 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-add6f524-9a2f-47eb-bbb6-fdf32588ecc0 req-6c75719e-11cd-4851-823c-71f8afed0796 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:37.166904 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-add6f524-9a2f-47eb-bbb6-fdf32588ecc0 req-6c75719e-11cd-4851-823c-71f8afed0796 service nova] Creating event network-vif-deleted:d2f79325-a6b2-470b-8e09-f0e2f2e2fd35 for instance 50f83abd-f45c-4217-8130-30a7bebd08b9 on n-h2-master-1 Oct 30 01:18:37.172483 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-add6f524-9a2f-47eb-bbb6-fdf32588ecc0 req-6c75719e-11cd-4851-823c-71f8afed0796 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039802 Oct 30 01:18:37.181445 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 761/1491] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:18:37.456542 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-059e788a-749c-4e06-81df-fe3214eef25a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:37.460735 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-059e788a-749c-4e06-81df-fe3214eef25a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: 25a595ee-91e9-4d66-9898-15c577c9bcec] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:37.480269 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-059e788a-749c-4e06-81df-fe3214eef25a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:37.481257 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-059e788a-749c-4e06-81df-fe3214eef25a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:37.482222 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-059e788a-749c-4e06-81df-fe3214eef25a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:37.484362 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-059e788a-749c-4e06-81df-fe3214eef25a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:37.487181 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-059e788a-749c-4e06-81df-fe3214eef25a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:37.488775 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-059e788a-749c-4e06-81df-fe3214eef25a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:37.550751 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-059e788a-749c-4e06-81df-fe3214eef25a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:37.556490 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-059e788a-749c-4e06-81df-fe3214eef25a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:37.557835 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-059e788a-749c-4e06-81df-fe3214eef25a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:37.558551 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-059e788a-749c-4e06-81df-fe3214eef25a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lazy-loading 'fault' on Instance uuid 25a595ee-91e9-4d66-9898-15c577c9bcec {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:18:37.620089 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-059e788a-749c-4e06-81df-fe3214eef25a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:37.636472 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-059e788a-749c-4e06-81df-fe3214eef25a tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/25a595ee-91e9-4d66-9898-15c577c9bcec" status: 200 len: 1304 microversion: 2.1 time: 0.180516 Oct 30 01:18:37.636472 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 762/1492] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:37 2022] GET /compute/v2.1/servers/25a595ee-91e9-4d66-9898-15c577c9bcec => generated 1304 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:37.649635 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a29324c4-d085-4711-8713-49cf71b68a3c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:37.650412 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a29324c4-d085-4711-8713-49cf71b68a3c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:37.668779 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a29324c4-d085-4711-8713-49cf71b68a3c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:37.670761 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a29324c4-d085-4711-8713-49cf71b68a3c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:37.672841 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a29324c4-d085-4711-8713-49cf71b68a3c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:37.674021 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a29324c4-d085-4711-8713-49cf71b68a3c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:37.676284 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a29324c4-d085-4711-8713-49cf71b68a3c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:37.679556 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a29324c4-d085-4711-8713-49cf71b68a3c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:37.696409 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-adcceb8e-7164-4f28-9ace-c7aad6186a7a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:37.704791 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-adcceb8e-7164-4f28-9ace-c7aad6186a7a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597" status: 200 len: 1529 microversion: 2.1 time: 0.921498 Oct 30 01:18:37.728147 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 731/1493] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:36 2022] GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597 => generated 1529 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:37.745171 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-27a082f4-034d-420e-8073-f9d580275bb6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:37.746197 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-27a082f4-034d-420e-8073-f9d580275bb6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 03d9aff4-215d-48fa-b741-2257b62fc597] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:37.762242 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-27a082f4-034d-420e-8073-f9d580275bb6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:37.762958 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-27a082f4-034d-420e-8073-f9d580275bb6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:37.763557 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-27a082f4-034d-420e-8073-f9d580275bb6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:37.767365 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-27a082f4-034d-420e-8073-f9d580275bb6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:37.768073 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-27a082f4-034d-420e-8073-f9d580275bb6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:37.769706 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-27a082f4-034d-420e-8073-f9d580275bb6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:38.126574 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a29324c4-d085-4711-8713-49cf71b68a3c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:38.146332 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a29324c4-d085-4711-8713-49cf71b68a3c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:38.148427 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a29324c4-d085-4711-8713-49cf71b68a3c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:38.150446 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a29324c4-d085-4711-8713-49cf71b68a3c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 200 len: 1813 microversion: 2.25 time: 0.511979 Oct 30 01:18:38.154910 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 763/1494] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:37 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 1813 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:18:38.164812 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1878550b-9c36-4a67-b639-b2cc285f1237 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:38.167918 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1878550b-9c36-4a67-b639-b2cc285f1237 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 50f83abd-f45c-4217-8130-30a7bebd08b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:38.189740 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1878550b-9c36-4a67-b639-b2cc285f1237 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:38.191868 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1878550b-9c36-4a67-b639-b2cc285f1237 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:38.197474 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1878550b-9c36-4a67-b639-b2cc285f1237 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:38.199936 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1878550b-9c36-4a67-b639-b2cc285f1237 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:38.201570 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1878550b-9c36-4a67-b639-b2cc285f1237 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:38.209281 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1878550b-9c36-4a67-b639-b2cc285f1237 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:38.234505 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-27a082f4-034d-420e-8073-f9d580275bb6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:38.258709 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-27a082f4-034d-420e-8073-f9d580275bb6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597" status: 200 len: 1529 microversion: 2.1 time: 0.515660 Oct 30 01:18:38.262305 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 732/1495] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:37 2022] GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597 => generated 1529 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:38.267410 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4691bc31-cd01-4437-8f2c-39030606bd4e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:38.274672 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1878550b-9c36-4a67-b639-b2cc285f1237 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:38.276820 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1878550b-9c36-4a67-b639-b2cc285f1237 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:38.277524 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1878550b-9c36-4a67-b639-b2cc285f1237 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:38.278484 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-1878550b-9c36-4a67-b639-b2cc285f1237 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lazy-loading 'fault' on Instance uuid 50f83abd-f45c-4217-8130-30a7bebd08b9 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:18:38.295020 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4691bc31-cd01-4437-8f2c-39030606bd4e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] [instance: 1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:38.308576 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4691bc31-cd01-4437-8f2c-39030606bd4e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:38.309465 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4691bc31-cd01-4437-8f2c-39030606bd4e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:38.310415 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4691bc31-cd01-4437-8f2c-39030606bd4e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:38.311418 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4691bc31-cd01-4437-8f2c-39030606bd4e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:38.312161 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4691bc31-cd01-4437-8f2c-39030606bd4e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:38.312787 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4691bc31-cd01-4437-8f2c-39030606bd4e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:38.317871 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:38.356809 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4691bc31-cd01-4437-8f2c-39030606bd4e tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] 10.222.0.13 "GET /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093358 Oct 30 01:18:38.358129 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 733/1496] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 01:18:38 2022] GET /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:18:38.363406 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-893e3c02-677a-49d5-b87b-73d850b0eee8 tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:38.450876 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1878550b-9c36-4a67-b639-b2cc285f1237 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:38.471893 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1878550b-9c36-4a67-b639-b2cc285f1237 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/50f83abd-f45c-4217-8130-30a7bebd08b9" status: 200 len: 1306 microversion: 2.1 time: 0.315184 Oct 30 01:18:38.489483 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 764/1497] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:38 2022] GET /compute/v2.1/servers/50f83abd-f45c-4217-8130-30a7bebd08b9 => generated 1306 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:38.500573 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-893e3c02-677a-49d5-b87b-73d850b0eee8 tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/9e6ff59f-7364-4d1d-bbe2-085a6800db3f" status: 202 len: 0 microversion: 2.1 time: 0.141187 Oct 30 01:18:38.501148 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 734/1498] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:18:38 2022] DELETE /compute/v2.1/flavors/9e6ff59f-7364-4d1d-bbe2-085a6800db3f => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:18:38.517866 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-17f73e45-abd8-40b1-b73c-1df72548f15b tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:38.568684 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-17f73e45-abd8-40b1-b73c-1df72548f15b tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.062035 Oct 30 01:18:38.573014 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 765/1499] 10.222.0.13 () {58 vars in 1146 bytes} [Sun Oct 30 01:18:38 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:38.593190 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c3ce77d3-155a-47bf-b610-3e2a141f84b6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:18:38.596810 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c3ce77d3-155a-47bf-b610-3e2a141f84b6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 03d9aff4-215d-48fa-b741-2257b62fc597] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:38.611906 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c3ce77d3-155a-47bf-b610-3e2a141f84b6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:38.612847 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c3ce77d3-155a-47bf-b610-3e2a141f84b6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:38.614359 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c3ce77d3-155a-47bf-b610-3e2a141f84b6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:38.620501 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c3ce77d3-155a-47bf-b610-3e2a141f84b6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:38.621116 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c3ce77d3-155a-47bf-b610-3e2a141f84b6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:38.621597 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c3ce77d3-155a-47bf-b610-3e2a141f84b6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:38.661909 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-78bd7f3c-cdc4-47f5-a88d-ee4ec93f8009 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:38.662947 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-78bd7f3c-cdc4-47f5-a88d-ee4ec93f8009 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: 25a595ee-91e9-4d66-9898-15c577c9bcec] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:38.680140 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-78bd7f3c-cdc4-47f5-a88d-ee4ec93f8009 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:38.680889 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-78bd7f3c-cdc4-47f5-a88d-ee4ec93f8009 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:38.682689 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-78bd7f3c-cdc4-47f5-a88d-ee4ec93f8009 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:38.686401 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-78bd7f3c-cdc4-47f5-a88d-ee4ec93f8009 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:38.687270 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-78bd7f3c-cdc4-47f5-a88d-ee4ec93f8009 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:38.687950 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-78bd7f3c-cdc4-47f5-a88d-ee4ec93f8009 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:38.710206 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c3ce77d3-155a-47bf-b610-3e2a141f84b6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:38.718712 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-78bd7f3c-cdc4-47f5-a88d-ee4ec93f8009 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] HTTP exception thrown: Instance 25a595ee-91e9-4d66-9898-15c577c9bcec could not be found. Oct 30 01:18:38.723002 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-78bd7f3c-cdc4-47f5-a88d-ee4ec93f8009 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Request method failure captured: Oct 30 01:18:38.723002 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/25a595ee-91e9-4d66-9898-15c577c9bcec HTTP/1.1 Oct 30 01:18:38.723002 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:18:38.723002 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:18:38.723002 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:18:38.723002 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:18:38.723002 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:18:38.723002 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:18:38.723002 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:18:38.723002 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:18:38.723002 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdBLIr-HQgkI-rSu4DbpiRy1V13PfvGTP624UYMiOCdGmuBqdCR6ZXBiD5GM13AKoQSgdQS8eDOFUl5XDTh2OfCVYuKBu9hi10IP7DN1i38HNQdNw2vy91w_U8U2akAexTgOeY8RA_6D56erlCEw53cT0RaTjARVr810cdgiCXo6doY Oct 30 01:18:38.723002 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:18:38.723002 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:18:38.723002 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:18:38.723002 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:18:38.723002 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:18:38.723002 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:18:38.723002 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: b90a3225f0bb4bb6a90847078c27720d Oct 30 01:18:38.723002 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServersAdminTestJSON-1617649150 Oct 30 01:18:38.723002 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:18:38.723002 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:18:38.725570 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b90a3225f0bb4bb6a90847078c27720d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b90a3225f0bb4bb6a90847078c27720d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b90a3225f0bb4bb6a90847078c27720d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b90a3225f0bb4bb6a90847078c27720d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:18:38.725570 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServersAdminTestJSON-1617649150 Oct 30 01:18:38.725570 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: b90a3225f0bb4bb6a90847078c27720d Oct 30 01:18:38.725570 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServersAdminTestJSON-1617649150 Oct 30 01:18:38.725570 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServersAdminTestJSON-1617649150-project Oct 30 01:18:38.725570 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:18:38.725570 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:18:38.725570 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: f33a2fe009b74c1285df84f614f38866 Oct 30 01:18:38.725570 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServersAdminTestJSON-1617649150-project Oct 30 01:18:38.725570 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:18:38.725570 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 25a595ee-91e9-4d66-9898-15c577c9bcec could not be found. Oct 30 01:18:38.725570 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '25a595ee-91e9-4d66-9898-15c577c9bcec'} Oct 30 01:18:38.726778 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:18:38.726778 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:38.726778 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:18:38.726778 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:18:38.726778 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:18:38.726778 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:18:38.726778 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:18:38.726778 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:18:38.726778 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:18:38.726778 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:18:38.726778 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25a595ee-91e9-4d66-9898-15c577c9bcec could not be found. Oct 30 01:18:38.726778 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:18:38.726778 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:18:38.726778 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:18:38.726778 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:38.726778 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:18:38.726778 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:18:38.726778 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:18:38.726778 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:18:38.726778 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:18:38.728677 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:18:38.728677 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:18:38.728677 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:18:38.728677 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:18:38.728677 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:18:38.728677 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:18:38.728677 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:18:38.728677 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25a595ee-91e9-4d66-9898-15c577c9bcec could not be found. Oct 30 01:18:38.728677 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:18:38.728677 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:18:38.728677 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:18:38.728677 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:38.728677 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:18:38.728677 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:18:38.728677 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:18:38.728677 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:18:38.728677 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25a595ee-91e9-4d66-9898-15c577c9bcec could not be found. Oct 30 01:18:38.728677 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:18:38.730998 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c3ce77d3-155a-47bf-b610-3e2a141f84b6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 03d9aff4-215d-48fa-b741-2257b62fc597] Old instance type tempest-test_resize_flavor_-1716548241, new instance type m1.heat {{(pid=121103) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 30 01:18:38.735012 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-78bd7f3c-cdc4-47f5-a88d-ee4ec93f8009 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Returning 404 to user: Instance 25a595ee-91e9-4d66-9898-15c577c9bcec could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:18:38.738370 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-78bd7f3c-cdc4-47f5-a88d-ee4ec93f8009 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/25a595ee-91e9-4d66-9898-15c577c9bcec" status: 404 len: 111 microversion: 2.1 time: 0.078465 Oct 30 01:18:38.739559 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 766/1500] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:38 2022] GET /compute/v2.1/servers/25a595ee-91e9-4d66-9898-15c577c9bcec => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 01:18:38.749922 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-c3ce77d3-155a-47bf-b610-3e2a141f84b6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:18:38.752726 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-c3ce77d3-155a-47bf-b610-3e2a141f84b6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:18:38.753550 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-c3ce77d3-155a-47bf-b610-3e2a141f84b6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:18:38.754116 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-c3ce77d3-155a-47bf-b610-3e2a141f84b6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:18:38.754641 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-c3ce77d3-155a-47bf-b610-3e2a141f84b6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:18:38.756938 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b1cd0bd0-e10f-4163-b9e6-045c121683d0 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:38.757728 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b1cd0bd0-e10f-4163-b9e6-045c121683d0 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:38.767624 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b1cd0bd0-e10f-4163-b9e6-045c121683d0 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:38.773357 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b1cd0bd0-e10f-4163-b9e6-045c121683d0 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:38.774354 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b1cd0bd0-e10f-4163-b9e6-045c121683d0 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:38.775335 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b1cd0bd0-e10f-4163-b9e6-045c121683d0 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:38.775998 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b1cd0bd0-e10f-4163-b9e6-045c121683d0 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:38.776641 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b1cd0bd0-e10f-4163-b9e6-045c121683d0 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:38.837044 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:38.844491 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b1cd0bd0-e10f-4163-b9e6-045c121683d0 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:18:39.171485 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c3ce77d3-155a-47bf-b610-3e2a141f84b6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "POST /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597/action" status: 202 len: 0 microversion: 2.1 time: 0.582978 Oct 30 01:18:39.172278 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 735/1501] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:18:38 2022] POST /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597/action => generated 0 bytes in 585 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:18:39.185727 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f8a3f424-2866-4774-acaa-caf95b216afe tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:39.187106 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f8a3f424-2866-4774-acaa-caf95b216afe tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 03d9aff4-215d-48fa-b741-2257b62fc597] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:39.198725 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f8a3f424-2866-4774-acaa-caf95b216afe tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:39.203086 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f8a3f424-2866-4774-acaa-caf95b216afe tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:39.203086 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f8a3f424-2866-4774-acaa-caf95b216afe tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:39.203086 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f8a3f424-2866-4774-acaa-caf95b216afe tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:39.203086 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f8a3f424-2866-4774-acaa-caf95b216afe tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:39.203772 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f8a3f424-2866-4774-acaa-caf95b216afe tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:39.386860 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b1cd0bd0-e10f-4163-b9e6-045c121683d0 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 204 len: 0 microversion: 2.1 time: 0.634800 Oct 30 01:18:39.387528 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 767/1502] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:18:38 2022] DELETE /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 30 01:18:39.403789 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b339d288-8539-4ca0-bc5d-354c815ad5d8 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:39.404679 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b339d288-8539-4ca0-bc5d-354c815ad5d8 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:39.429139 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b339d288-8539-4ca0-bc5d-354c815ad5d8 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:39.435493 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b339d288-8539-4ca0-bc5d-354c815ad5d8 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:39.435921 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b339d288-8539-4ca0-bc5d-354c815ad5d8 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:39.443495 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b339d288-8539-4ca0-bc5d-354c815ad5d8 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:39.444552 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b339d288-8539-4ca0-bc5d-354c815ad5d8 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:39.445008 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b339d288-8539-4ca0-bc5d-354c815ad5d8 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:39.988597 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b339d288-8539-4ca0-bc5d-354c815ad5d8 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:40.000278 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b339d288-8539-4ca0-bc5d-354c815ad5d8 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:40.008760 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b339d288-8539-4ca0-bc5d-354c815ad5d8 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:40.008760 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b339d288-8539-4ca0-bc5d-354c815ad5d8 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 200 len: 1813 microversion: 2.25 time: 0.616750 Oct 30 01:18:40.008760 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 768/1503] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:39 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 1813 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:18:40.012339 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-185ae836-cb9e-41cd-9fac-b812f6d9e0fb tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:40.014609 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-185ae836-cb9e-41cd-9fac-b812f6d9e0fb tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] [instance: 1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:40.020053 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f8a3f424-2866-4774-acaa-caf95b216afe tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:40.022862 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-185ae836-cb9e-41cd-9fac-b812f6d9e0fb tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:40.023583 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-185ae836-cb9e-41cd-9fac-b812f6d9e0fb tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:40.024273 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-185ae836-cb9e-41cd-9fac-b812f6d9e0fb tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:40.025199 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-185ae836-cb9e-41cd-9fac-b812f6d9e0fb tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:40.025894 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-185ae836-cb9e-41cd-9fac-b812f6d9e0fb tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:40.026583 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-185ae836-cb9e-41cd-9fac-b812f6d9e0fb tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:40.040116 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f8a3f424-2866-4774-acaa-caf95b216afe tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597" status: 200 len: 1538 microversion: 2.1 time: 0.863516 Oct 30 01:18:40.040719 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 736/1504] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:39 2022] GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597 => generated 1538 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:40.048387 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-07b0f25e-5f0b-4a5a-af59-4d2f6a9cd720 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:40.049636 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-07b0f25e-5f0b-4a5a-af59-4d2f6a9cd720 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:40.057609 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-07b0f25e-5f0b-4a5a-af59-4d2f6a9cd720 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:40.060320 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-07b0f25e-5f0b-4a5a-af59-4d2f6a9cd720 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:40.060320 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-07b0f25e-5f0b-4a5a-af59-4d2f6a9cd720 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:40.060320 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-07b0f25e-5f0b-4a5a-af59-4d2f6a9cd720 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:40.060964 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-07b0f25e-5f0b-4a5a-af59-4d2f6a9cd720 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:40.061610 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-07b0f25e-5f0b-4a5a-af59-4d2f6a9cd720 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:40.062549 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-185ae836-cb9e-41cd-9fac-b812f6d9e0fb tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] 10.222.0.13 "GET /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054450 Oct 30 01:18:40.069306 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 769/1505] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 01:18:40 2022] GET /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:18:40.074488 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e527235d-e9e1-4a63-8ffe-9b6dc2d42f5b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:40.074488 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e527235d-e9e1-4a63-8ffe-9b6dc2d42f5b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 50f83abd-f45c-4217-8130-30a7bebd08b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:40.100823 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e527235d-e9e1-4a63-8ffe-9b6dc2d42f5b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:40.100823 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e527235d-e9e1-4a63-8ffe-9b6dc2d42f5b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:40.100823 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e527235d-e9e1-4a63-8ffe-9b6dc2d42f5b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:40.100823 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e527235d-e9e1-4a63-8ffe-9b6dc2d42f5b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:40.101236 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e527235d-e9e1-4a63-8ffe-9b6dc2d42f5b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:40.101236 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e527235d-e9e1-4a63-8ffe-9b6dc2d42f5b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:40.156798 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-e527235d-e9e1-4a63-8ffe-9b6dc2d42f5b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] HTTP exception thrown: Instance 50f83abd-f45c-4217-8130-30a7bebd08b9 could not be found. Oct 30 01:18:40.156905 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e527235d-e9e1-4a63-8ffe-9b6dc2d42f5b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Request method failure captured: Oct 30 01:18:40.156905 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/50f83abd-f45c-4217-8130-30a7bebd08b9 HTTP/1.1 Oct 30 01:18:40.156905 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:18:40.156905 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:18:40.156905 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:18:40.156905 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:18:40.156905 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:18:40.156905 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:18:40.156905 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:18:40.156905 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:18:40.156905 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdAyWG8ULueMlzGM_sHwJ9SOWADIPTb7By9fNsRcbHROHwygMRdk9IkmaCTF8DGTaB-qJmpNM38UnmXLKL5MROOCKmetoapYOI7trRPWkBfioCQrOG4AuSuVej_G20QC_MDzAmUbQ-QTCr2g6dCwwHCik9ACvFc8hu-sRLY-wv25V6Q Oct 30 01:18:40.156905 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:18:40.156905 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:18:40.156905 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:18:40.156905 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:18:40.156905 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:18:40.156905 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:18:40.156905 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 76b6f7b705f5428b9a3a3a8c4f86ff48 Oct 30 01:18:40.156905 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServersOnMultiNodesTest-1214334609 Oct 30 01:18:40.156905 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:18:40.156905 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:18:40.158271 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/76b6f7b705f5428b9a3a3a8c4f86ff48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_76b6f7b705f5428b9a3a3a8c4f86ff48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/76b6f7b705f5428b9a3a3a8c4f86ff48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/76b6f7b705f5428b9a3a3a8c4f86ff48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:18:40.158271 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServersOnMultiNodesTest-1214334609 Oct 30 01:18:40.158271 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 76b6f7b705f5428b9a3a3a8c4f86ff48 Oct 30 01:18:40.158271 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1214334609 Oct 30 01:18:40.158271 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServersOnMultiNodesTest-1214334609-project Oct 30 01:18:40.158271 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:18:40.158271 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:18:40.158271 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: c536d41a93ad4337909fe2e2cb949e03 Oct 30 01:18:40.158271 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServersOnMultiNodesTest-1214334609-project Oct 30 01:18:40.158271 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:18:40.158271 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 50f83abd-f45c-4217-8130-30a7bebd08b9 could not be found. Oct 30 01:18:40.158271 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '50f83abd-f45c-4217-8130-30a7bebd08b9'} Oct 30 01:18:40.159071 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:18:40.159071 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:40.159071 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:18:40.159071 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:18:40.159071 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:18:40.159071 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:18:40.159071 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:18:40.159071 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:18:40.159071 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:18:40.159071 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:18:40.159071 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50f83abd-f45c-4217-8130-30a7bebd08b9 could not be found. Oct 30 01:18:40.159071 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:18:40.159071 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:18:40.159071 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:18:40.159071 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:40.159071 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:18:40.159071 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:18:40.159071 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:18:40.159071 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:18:40.159071 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:18:40.160387 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:18:40.160387 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:18:40.160387 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:18:40.160387 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:18:40.160387 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:18:40.160387 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:18:40.160387 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:18:40.160387 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50f83abd-f45c-4217-8130-30a7bebd08b9 could not be found. Oct 30 01:18:40.160387 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:18:40.160387 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:18:40.160387 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:18:40.160387 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:40.160387 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:18:40.160387 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:18:40.160387 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:18:40.160387 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:18:40.160387 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50f83abd-f45c-4217-8130-30a7bebd08b9 could not be found. Oct 30 01:18:40.160387 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:18:40.164381 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e527235d-e9e1-4a63-8ffe-9b6dc2d42f5b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Returning 404 to user: Instance 50f83abd-f45c-4217-8130-30a7bebd08b9 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:18:40.164381 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e527235d-e9e1-4a63-8ffe-9b6dc2d42f5b tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/50f83abd-f45c-4217-8130-30a7bebd08b9" status: 404 len: 111 microversion: 2.1 time: 0.093521 Oct 30 01:18:40.164381 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 770/1506] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:40 2022] GET /compute/v2.1/servers/50f83abd-f45c-4217-8130-30a7bebd08b9 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:18:40.169786 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8669acad-c249-4c9d-95bb-cf9560263cdd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:40.170289 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8669acad-c249-4c9d-95bb-cf9560263cdd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 16620e75-9ac1-4f76-97eb-d4281e2f0d88] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:40.198417 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8669acad-c249-4c9d-95bb-cf9560263cdd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:40.198756 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8669acad-c249-4c9d-95bb-cf9560263cdd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:40.199203 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8669acad-c249-4c9d-95bb-cf9560263cdd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:40.199923 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8669acad-c249-4c9d-95bb-cf9560263cdd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:40.200376 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8669acad-c249-4c9d-95bb-cf9560263cdd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:40.201110 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8669acad-c249-4c9d-95bb-cf9560263cdd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:40.234464 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8669acad-c249-4c9d-95bb-cf9560263cdd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 16620e75-9ac1-4f76-97eb-d4281e2f0d88] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:18:40.566240 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-07b0f25e-5f0b-4a5a-af59-4d2f6a9cd720 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:40.622173 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-07b0f25e-5f0b-4a5a-af59-4d2f6a9cd720 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1469 microversion: 2.1 time: 0.580211 Oct 30 01:18:40.626678 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 737/1507] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:40 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1469 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:40.648633 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a2523826-41f6-464e-9ad1-613c56a918ee tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-549406976", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "cfc888ea-0e91-4003-b88f-59c6a1470ebe"}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:18:40.737756 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8669acad-c249-4c9d-95bb-cf9560263cdd tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "DELETE /compute/v2.1/servers/16620e75-9ac1-4f76-97eb-d4281e2f0d88" status: 204 len: 0 microversion: 2.1 time: 0.572873 Oct 30 01:18:40.741734 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 771/1508] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:18:40 2022] DELETE /compute/v2.1/servers/16620e75-9ac1-4f76-97eb-d4281e2f0d88 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:18:40.753048 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-05924fd2-cd6a-47d3-96a3-abab227a4a90 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:40.760302 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-05924fd2-cd6a-47d3-96a3-abab227a4a90 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: d1fee870-9d6d-4086-9138-4a9709e2d26c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:40.772366 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-05924fd2-cd6a-47d3-96a3-abab227a4a90 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:40.772734 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-05924fd2-cd6a-47d3-96a3-abab227a4a90 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:40.773174 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-05924fd2-cd6a-47d3-96a3-abab227a4a90 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:40.773922 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-05924fd2-cd6a-47d3-96a3-abab227a4a90 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:40.774371 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-05924fd2-cd6a-47d3-96a3-abab227a4a90 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:40.774791 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-05924fd2-cd6a-47d3-96a3-abab227a4a90 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:40.796832 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-a2523826-41f6-464e-9ad1-613c56a918ee tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] validate_networks() for [('cfc888ea-0e91-4003-b88f-59c6a1470ebe', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:18:40.876555 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-05924fd2-cd6a-47d3-96a3-abab227a4a90 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: d1fee870-9d6d-4086-9138-4a9709e2d26c] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:18:41.245629 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:41.380838 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-05924fd2-cd6a-47d3-96a3-abab227a4a90 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d1fee870-9d6d-4086-9138-4a9709e2d26c" status: 204 len: 0 microversion: 2.1 time: 0.634421 Oct 30 01:18:41.381535 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 772/1509] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:18:40 2022] DELETE /compute/v2.1/servers/d1fee870-9d6d-4086-9138-4a9709e2d26c => generated 0 bytes in 636 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 30 01:18:41.389874 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-53d8435b-30bb-402d-8774-3cfacfd1dcf5 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:41.393728 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-53d8435b-30bb-402d-8774-3cfacfd1dcf5 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:41.419736 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53d8435b-30bb-402d-8774-3cfacfd1dcf5 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:41.420230 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53d8435b-30bb-402d-8774-3cfacfd1dcf5 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:41.420716 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53d8435b-30bb-402d-8774-3cfacfd1dcf5 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:41.421560 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53d8435b-30bb-402d-8774-3cfacfd1dcf5 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:41.422374 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53d8435b-30bb-402d-8774-3cfacfd1dcf5 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:41.422759 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53d8435b-30bb-402d-8774-3cfacfd1dcf5 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:41.766127 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-a2523826-41f6-464e-9ad1-613c56a918ee tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:18:41.767285 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-a2523826-41f6-464e-9ad1-613c56a918ee tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:18:41.767285 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-a2523826-41f6-464e-9ad1-613c56a918ee tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:18:41.767490 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-a2523826-41f6-464e-9ad1-613c56a918ee tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:18:41.767779 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-a2523826-41f6-464e-9ad1-613c56a918ee tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:18:41.774206 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-53d8435b-30bb-402d-8774-3cfacfd1dcf5 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:41.787951 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a2523826-41f6-464e-9ad1-613c56a918ee tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:41.788443 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a2523826-41f6-464e-9ad1-613c56a918ee tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:41.788877 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a2523826-41f6-464e-9ad1-613c56a918ee tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:41.789617 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a2523826-41f6-464e-9ad1-613c56a918ee tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:41.799057 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a2523826-41f6-464e-9ad1-613c56a918ee tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:41.799842 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a2523826-41f6-464e-9ad1-613c56a918ee tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:41.801393 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-53d8435b-30bb-402d-8774-3cfacfd1dcf5 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:41.816164 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-53d8435b-30bb-402d-8774-3cfacfd1dcf5 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:41.817264 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-53d8435b-30bb-402d-8774-3cfacfd1dcf5 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 200 len: 1813 microversion: 2.25 time: 0.434119 Oct 30 01:18:41.818118 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 773/1510] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:41 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 1813 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:18:41.832309 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-86cd9f03-09e8-4592-a9c6-f0a20bbc11cf tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:41.838689 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-86cd9f03-09e8-4592-a9c6-f0a20bbc11cf tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 03d9aff4-215d-48fa-b741-2257b62fc597] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:41.860538 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86cd9f03-09e8-4592-a9c6-f0a20bbc11cf tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:41.871577 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86cd9f03-09e8-4592-a9c6-f0a20bbc11cf tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:41.871577 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86cd9f03-09e8-4592-a9c6-f0a20bbc11cf tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:41.871577 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86cd9f03-09e8-4592-a9c6-f0a20bbc11cf tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:41.871577 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86cd9f03-09e8-4592-a9c6-f0a20bbc11cf tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:41.871973 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86cd9f03-09e8-4592-a9c6-f0a20bbc11cf tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:41.872072 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-a2523826-41f6-464e-9ad1-613c56a918ee tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Getting quotas for project d4681ed2d06840f995b37e550323d6ad. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:18:41.878429 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-a2523826-41f6-464e-9ad1-613c56a918ee tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Getting quotas for user ec7269dc6d56440ca8691179f7275aeb and project d4681ed2d06840f995b37e550323d6ad. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:18:41.940653 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a2523826-41f6-464e-9ad1-613c56a918ee tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:18:41.943594 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a2523826-41f6-464e-9ad1-613c56a918ee tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] [instance: 0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:18:42.192355 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a2523826-41f6-464e-9ad1-613c56a918ee tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.562583 Oct 30 01:18:42.196809 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 738/1511] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:18:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:18:42.212675 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-06d60f20-5db8-4694-8b37-d6d8cfd98f06 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:42.213907 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-06d60f20-5db8-4694-8b37-d6d8cfd98f06 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 16620e75-9ac1-4f76-97eb-d4281e2f0d88] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:42.224070 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-06d60f20-5db8-4694-8b37-d6d8cfd98f06 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:42.226980 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-06d60f20-5db8-4694-8b37-d6d8cfd98f06 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:42.228251 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-06d60f20-5db8-4694-8b37-d6d8cfd98f06 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:42.229281 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-06d60f20-5db8-4694-8b37-d6d8cfd98f06 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:42.230062 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-06d60f20-5db8-4694-8b37-d6d8cfd98f06 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:42.230724 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-06d60f20-5db8-4694-8b37-d6d8cfd98f06 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:42.235845 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-86cd9f03-09e8-4592-a9c6-f0a20bbc11cf tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:42.249642 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-86cd9f03-09e8-4592-a9c6-f0a20bbc11cf tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597" status: 200 len: 1538 microversion: 2.1 time: 0.430188 Oct 30 01:18:42.251976 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 774/1512] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:41 2022] GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597 => generated 1538 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:42.317710 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0e109cbe-66a9-4289-8047-b709b8c786d5 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:42.320299 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0e109cbe-66a9-4289-8047-b709b8c786d5 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:42.328798 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e109cbe-66a9-4289-8047-b709b8c786d5 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:42.329896 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e109cbe-66a9-4289-8047-b709b8c786d5 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:42.330567 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e109cbe-66a9-4289-8047-b709b8c786d5 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:42.331690 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e109cbe-66a9-4289-8047-b709b8c786d5 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:42.332363 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e109cbe-66a9-4289-8047-b709b8c786d5 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:42.333049 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e109cbe-66a9-4289-8047-b709b8c786d5 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:42.617563 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0e109cbe-66a9-4289-8047-b709b8c786d5 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:42.631855 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0e109cbe-66a9-4289-8047-b709b8c786d5 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1427 microversion: 2.1 time: 0.324697 Oct 30 01:18:42.635879 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 775/1513] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:42 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1427 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:42.659940 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-778111c7-942e-4927-8e11-ed577934a6ad tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:42.660837 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-778111c7-942e-4927-8e11-ed577934a6ad tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] [instance: 0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:43.072891 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-778111c7-942e-4927-8e11-ed577934a6ad tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7269dc6d56440ca8691179f7275aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4681ed2d06840f995b37e550323d6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:43.084504 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-06d60f20-5db8-4694-8b37-d6d8cfd98f06 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:43.093227 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-778111c7-942e-4927-8e11-ed577934a6ad tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] 10.222.0.13 "GET /compute/v2.1/servers/0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23" status: 200 len: 1217 microversion: 2.1 time: 0.452373 Oct 30 01:18:43.094141 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 776/1514] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:42 2022] GET /compute/v2.1/servers/0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23 => generated 1217 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:43.097755 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-06d60f20-5db8-4694-8b37-d6d8cfd98f06 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/16620e75-9ac1-4f76-97eb-d4281e2f0d88" status: 200 len: 1473 microversion: 2.1 time: 0.899499 Oct 30 01:18:43.099132 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-2a614186-6ece-4981-b3df-c20124984645 req-9dae3a41-3a15-4893-bd0b-f60253ddb42e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f10b90ae-23e1-4ca1-b95e-9404e606e5d9", "name": "network-vif-deleted", "tag": "9f14e853-78c5-4b79-8df2-448f8f1726ff"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:18:43.101970 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 739/1515] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:42 2022] GET /compute/v2.1/servers/16620e75-9ac1-4f76-97eb-d4281e2f0d88 => generated 1473 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:43.115002 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a8c6776e-b350-4a62-9e14-1d6981759c71 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:43.117290 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a8c6776e-b350-4a62-9e14-1d6981759c71 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:43.135074 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a8c6776e-b350-4a62-9e14-1d6981759c71 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:43.135833 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a8c6776e-b350-4a62-9e14-1d6981759c71 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:43.136478 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a8c6776e-b350-4a62-9e14-1d6981759c71 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:43.139689 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a8c6776e-b350-4a62-9e14-1d6981759c71 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:43.140162 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a8c6776e-b350-4a62-9e14-1d6981759c71 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:43.144143 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a8c6776e-b350-4a62-9e14-1d6981759c71 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:43.145279 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-2a614186-6ece-4981-b3df-c20124984645 req-9dae3a41-3a15-4893-bd0b-f60253ddb42e service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:43.147260 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-2a614186-6ece-4981-b3df-c20124984645 req-9dae3a41-3a15-4893-bd0b-f60253ddb42e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:43.147723 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-2a614186-6ece-4981-b3df-c20124984645 req-9dae3a41-3a15-4893-bd0b-f60253ddb42e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:43.204986 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-2a614186-6ece-4981-b3df-c20124984645 req-9dae3a41-3a15-4893-bd0b-f60253ddb42e service nova] Creating event network-vif-deleted:9f14e853-78c5-4b79-8df2-448f8f1726ff for instance f10b90ae-23e1-4ca1-b95e-9404e606e5d9 on n-h2-master-1 Oct 30 01:18:43.222251 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-2a614186-6ece-4981-b3df-c20124984645 req-9dae3a41-3a15-4893-bd0b-f60253ddb42e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126701 Oct 30 01:18:43.228811 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 777/1516] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:18:43.280892 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ad5a37ad-c170-42ad-ae20-7acac9b7d9db tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:43.282889 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ad5a37ad-c170-42ad-ae20-7acac9b7d9db tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 03d9aff4-215d-48fa-b741-2257b62fc597] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:43.292170 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ad5a37ad-c170-42ad-ae20-7acac9b7d9db tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:43.292700 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ad5a37ad-c170-42ad-ae20-7acac9b7d9db tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:43.293143 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ad5a37ad-c170-42ad-ae20-7acac9b7d9db tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:43.293890 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ad5a37ad-c170-42ad-ae20-7acac9b7d9db tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:43.294383 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ad5a37ad-c170-42ad-ae20-7acac9b7d9db tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:43.297252 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ad5a37ad-c170-42ad-ae20-7acac9b7d9db tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:44.355822 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a8c6776e-b350-4a62-9e14-1d6981759c71 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:44.365052 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a8c6776e-b350-4a62-9e14-1d6981759c71 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:44.372798 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a8c6776e-b350-4a62-9e14-1d6981759c71 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:44.374309 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a8c6776e-b350-4a62-9e14-1d6981759c71 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 200 len: 1813 microversion: 2.25 time: 1.271108 Oct 30 01:18:44.390667 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 740/1517] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:43 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 1813 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:18:44.401368 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-aa3ca2a5-5957-42c0-ae59-5cd8f7e21e82 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:44.402336 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-aa3ca2a5-5957-42c0-ae59-5cd8f7e21e82 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:44.411300 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa3ca2a5-5957-42c0-ae59-5cd8f7e21e82 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:44.413144 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa3ca2a5-5957-42c0-ae59-5cd8f7e21e82 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:44.413855 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa3ca2a5-5957-42c0-ae59-5cd8f7e21e82 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:44.415141 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa3ca2a5-5957-42c0-ae59-5cd8f7e21e82 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:44.415842 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa3ca2a5-5957-42c0-ae59-5cd8f7e21e82 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:44.416494 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa3ca2a5-5957-42c0-ae59-5cd8f7e21e82 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:44.460296 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa3ca2a5-5957-42c0-ae59-5cd8f7e21e82 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:44.461107 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa3ca2a5-5957-42c0-ae59-5cd8f7e21e82 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:44.461930 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa3ca2a5-5957-42c0-ae59-5cd8f7e21e82 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:44.462618 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-aa3ca2a5-5957-42c0-ae59-5cd8f7e21e82 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lazy-loading 'fault' on Instance uuid f10b90ae-23e1-4ca1-b95e-9404e606e5d9 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:18:44.652705 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-aa3ca2a5-5957-42c0-ae59-5cd8f7e21e82 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:44.664770 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-aa3ca2a5-5957-42c0-ae59-5cd8f7e21e82 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1304 microversion: 2.1 time: 0.267624 Oct 30 01:18:44.681661 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 741/1518] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:44 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1304 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:44.687466 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-22648988-c3e4-4125-9a58-4377f36a24d8 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:44.688773 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-22648988-c3e4-4125-9a58-4377f36a24d8 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 16620e75-9ac1-4f76-97eb-d4281e2f0d88] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:44.696201 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22648988-c3e4-4125-9a58-4377f36a24d8 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:44.698594 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22648988-c3e4-4125-9a58-4377f36a24d8 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:44.698594 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22648988-c3e4-4125-9a58-4377f36a24d8 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:44.698594 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22648988-c3e4-4125-9a58-4377f36a24d8 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:44.699005 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22648988-c3e4-4125-9a58-4377f36a24d8 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:44.699398 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22648988-c3e4-4125-9a58-4377f36a24d8 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:44.806592 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ad5a37ad-c170-42ad-ae20-7acac9b7d9db tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:44.837919 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ad5a37ad-c170-42ad-ae20-7acac9b7d9db tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597" status: 200 len: 1538 microversion: 2.1 time: 1.543707 Oct 30 01:18:44.837919 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 778/1519] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:43 2022] GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597 => generated 1538 bytes in 1556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:44.852688 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0585ffaf-7452-4763-8643-9ba7a2ec6fbe tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:44.853639 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0585ffaf-7452-4763-8643-9ba7a2ec6fbe tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] [instance: 0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:44.867685 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0585ffaf-7452-4763-8643-9ba7a2ec6fbe tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:44.868201 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0585ffaf-7452-4763-8643-9ba7a2ec6fbe tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:44.868749 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0585ffaf-7452-4763-8643-9ba7a2ec6fbe tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:44.869726 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0585ffaf-7452-4763-8643-9ba7a2ec6fbe tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:44.870397 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0585ffaf-7452-4763-8643-9ba7a2ec6fbe tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:44.873517 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0585ffaf-7452-4763-8643-9ba7a2ec6fbe tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:45.273694 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0585ffaf-7452-4763-8643-9ba7a2ec6fbe tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7269dc6d56440ca8691179f7275aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4681ed2d06840f995b37e550323d6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:45.286276 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0585ffaf-7452-4763-8643-9ba7a2ec6fbe tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] 10.222.0.13 "GET /compute/v2.1/servers/0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23" status: 200 len: 1221 microversion: 2.1 time: 0.450438 Oct 30 01:18:45.287310 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 779/1520] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:44 2022] GET /compute/v2.1/servers/0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23 => generated 1221 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:45.390045 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-22648988-c3e4-4125-9a58-4377f36a24d8 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:45.409303 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-00979327-9a84-40a8-9f72-1b1ea9e754a0 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:45.410024 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-00979327-9a84-40a8-9f72-1b1ea9e754a0 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:45.425830 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-22648988-c3e4-4125-9a58-4377f36a24d8 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/16620e75-9ac1-4f76-97eb-d4281e2f0d88" status: 200 len: 1473 microversion: 2.1 time: 0.742438 Oct 30 01:18:45.432102 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00979327-9a84-40a8-9f72-1b1ea9e754a0 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:45.432576 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00979327-9a84-40a8-9f72-1b1ea9e754a0 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:45.436251 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 742/1521] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:44 2022] GET /compute/v2.1/servers/16620e75-9ac1-4f76-97eb-d4281e2f0d88 => generated 1473 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:45.436563 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00979327-9a84-40a8-9f72-1b1ea9e754a0 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:45.439066 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00979327-9a84-40a8-9f72-1b1ea9e754a0 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:45.440614 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00979327-9a84-40a8-9f72-1b1ea9e754a0 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:45.443566 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00979327-9a84-40a8-9f72-1b1ea9e754a0 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:45.473273 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-15dc5a4a-bf8d-40a9-a843-310ad50e7b44 req-6e9fd25e-3007-4c71-905d-8b1e7e92223c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1fee870-9d6d-4086-9138-4a9709e2d26c", "name": "network-vif-deleted", "tag": "17d00fc2-d99f-4ce9-a60f-4718f0b667da"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:18:45.502744 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-15dc5a4a-bf8d-40a9-a843-310ad50e7b44 req-6e9fd25e-3007-4c71-905d-8b1e7e92223c service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:45.504111 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-15dc5a4a-bf8d-40a9-a843-310ad50e7b44 req-6e9fd25e-3007-4c71-905d-8b1e7e92223c service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:45.510007 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-15dc5a4a-bf8d-40a9-a843-310ad50e7b44 req-6e9fd25e-3007-4c71-905d-8b1e7e92223c service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:45.551985 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-15dc5a4a-bf8d-40a9-a843-310ad50e7b44 req-6e9fd25e-3007-4c71-905d-8b1e7e92223c service nova] Creating event network-vif-deleted:17d00fc2-d99f-4ce9-a60f-4718f0b667da for instance d1fee870-9d6d-4086-9138-4a9709e2d26c on n-h2-master-1 Oct 30 01:18:45.577192 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-15dc5a4a-bf8d-40a9-a843-310ad50e7b44 req-6e9fd25e-3007-4c71-905d-8b1e7e92223c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107975 Oct 30 01:18:45.580126 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 743/1522] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:18:45.692808 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2f08fe93-3f95-4787-860c-89be0246fd32 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:45.692808 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2f08fe93-3f95-4787-860c-89be0246fd32 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:45.710701 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f08fe93-3f95-4787-860c-89be0246fd32 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:45.713149 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f08fe93-3f95-4787-860c-89be0246fd32 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:45.722936 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f08fe93-3f95-4787-860c-89be0246fd32 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:45.724299 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f08fe93-3f95-4787-860c-89be0246fd32 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:45.727998 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f08fe93-3f95-4787-860c-89be0246fd32 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:45.728638 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f08fe93-3f95-4787-860c-89be0246fd32 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:45.828920 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f08fe93-3f95-4787-860c-89be0246fd32 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:45.835796 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f08fe93-3f95-4787-860c-89be0246fd32 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:45.836599 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f08fe93-3f95-4787-860c-89be0246fd32 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:45.837242 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-2f08fe93-3f95-4787-860c-89be0246fd32 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lazy-loading 'fault' on Instance uuid f10b90ae-23e1-4ca1-b95e-9404e606e5d9 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:18:46.353797 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2f08fe93-3f95-4787-860c-89be0246fd32 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33a2fe009b74c1285df84f614f38866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90a3225f0bb4bb6a90847078c27720d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:46.384158 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2f08fe93-3f95-4787-860c-89be0246fd32 tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 200 len: 1304 microversion: 2.1 time: 0.699200 Oct 30 01:18:46.395277 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 744/1523] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:45 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 1304 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:46.417653 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2ee4308f-5c7c-45e5-988d-849cfc7725d6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:46.419196 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2ee4308f-5c7c-45e5-988d-849cfc7725d6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 03d9aff4-215d-48fa-b741-2257b62fc597] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:46.439671 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2ee4308f-5c7c-45e5-988d-849cfc7725d6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:46.440167 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2ee4308f-5c7c-45e5-988d-849cfc7725d6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:46.440615 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2ee4308f-5c7c-45e5-988d-849cfc7725d6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:46.446438 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2ee4308f-5c7c-45e5-988d-849cfc7725d6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:46.455312 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2ee4308f-5c7c-45e5-988d-849cfc7725d6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:46.455884 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2ee4308f-5c7c-45e5-988d-849cfc7725d6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:46.898269 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-00979327-9a84-40a8-9f72-1b1ea9e754a0 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:46.915997 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-00979327-9a84-40a8-9f72-1b1ea9e754a0 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:46.925108 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-00979327-9a84-40a8-9f72-1b1ea9e754a0 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:46.933384 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-00979327-9a84-40a8-9f72-1b1ea9e754a0 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 200 len: 1813 microversion: 2.25 time: 1.532252 Oct 30 01:18:46.934328 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 780/1524] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:45 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 1813 bytes in 1535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:18:46.956227 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-28540c11-068c-4f28-802f-7a4b5a948fb2 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:46.963314 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-28540c11-068c-4f28-802f-7a4b5a948fb2 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] [instance: 0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:46.982667 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-28540c11-068c-4f28-802f-7a4b5a948fb2 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:46.985082 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-28540c11-068c-4f28-802f-7a4b5a948fb2 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:46.986450 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-28540c11-068c-4f28-802f-7a4b5a948fb2 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:46.992271 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-28540c11-068c-4f28-802f-7a4b5a948fb2 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:46.993183 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-28540c11-068c-4f28-802f-7a4b5a948fb2 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:47.003987 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-28540c11-068c-4f28-802f-7a4b5a948fb2 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:47.030731 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2ee4308f-5c7c-45e5-988d-849cfc7725d6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:47.035325 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2ee4308f-5c7c-45e5-988d-849cfc7725d6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597" status: 200 len: 1538 microversion: 2.1 time: 0.633726 Oct 30 01:18:47.045564 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 745/1525] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:46 2022] GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597 => generated 1538 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:47.055721 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:47.070639 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-2d11084f-cbaa-46d1-8816-c230c017a23b req-05d206c7-9651-42c4-be15-8738bd59d20c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16620e75-9ac1-4f76-97eb-d4281e2f0d88", "name": "network-vif-deleted", "tag": "c81c587a-677a-4762-8cc7-d0cac55df293"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:18:47.099120 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-2d11084f-cbaa-46d1-8816-c230c017a23b req-05d206c7-9651-42c4-be15-8738bd59d20c service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:47.099612 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-2d11084f-cbaa-46d1-8816-c230c017a23b req-05d206c7-9651-42c4-be15-8738bd59d20c service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:47.100090 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-2d11084f-cbaa-46d1-8816-c230c017a23b req-05d206c7-9651-42c4-be15-8738bd59d20c service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:47.132139 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-2d11084f-cbaa-46d1-8816-c230c017a23b req-05d206c7-9651-42c4-be15-8738bd59d20c service nova] Creating event network-vif-deleted:c81c587a-677a-4762-8cc7-d0cac55df293 for instance 16620e75-9ac1-4f76-97eb-d4281e2f0d88 on n-h1-master-1 Oct 30 01:18:47.154271 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-2d11084f-cbaa-46d1-8816-c230c017a23b req-05d206c7-9651-42c4-be15-8738bd59d20c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105447 Oct 30 01:18:47.157824 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 746/1526] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:18:47.197167 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6f61db86-87e2-45c6-b8d3-63f9ba445047 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:47.198231 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6f61db86-87e2-45c6-b8d3-63f9ba445047 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 16620e75-9ac1-4f76-97eb-d4281e2f0d88] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:47.214738 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f61db86-87e2-45c6-b8d3-63f9ba445047 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:47.215230 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f61db86-87e2-45c6-b8d3-63f9ba445047 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:47.215663 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f61db86-87e2-45c6-b8d3-63f9ba445047 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:47.216376 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f61db86-87e2-45c6-b8d3-63f9ba445047 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:47.216823 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f61db86-87e2-45c6-b8d3-63f9ba445047 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:47.217259 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f61db86-87e2-45c6-b8d3-63f9ba445047 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:47.365410 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f61db86-87e2-45c6-b8d3-63f9ba445047 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:47.366347 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f61db86-87e2-45c6-b8d3-63f9ba445047 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:47.367334 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f61db86-87e2-45c6-b8d3-63f9ba445047 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:47.369910 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-6f61db86-87e2-45c6-b8d3-63f9ba445047 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lazy-loading 'fault' on Instance uuid 16620e75-9ac1-4f76-97eb-d4281e2f0d88 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:18:47.434834 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-28540c11-068c-4f28-802f-7a4b5a948fb2 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7269dc6d56440ca8691179f7275aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4681ed2d06840f995b37e550323d6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:47.444466 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-28540c11-068c-4f28-802f-7a4b5a948fb2 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] 10.222.0.13 "GET /compute/v2.1/servers/0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23" status: 200 len: 1269 microversion: 2.1 time: 0.506500 Oct 30 01:18:47.454131 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 781/1527] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:46 2022] GET /compute/v2.1/servers/0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23 => generated 1269 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:47.460788 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-98cf8b5a-9d80-441c-92b6-8f6cca9ed8cc tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:47.461829 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-98cf8b5a-9d80-441c-92b6-8f6cca9ed8cc tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] [instance: f10b90ae-23e1-4ca1-b95e-9404e606e5d9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:47.471279 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-98cf8b5a-9d80-441c-92b6-8f6cca9ed8cc tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:47.472324 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-98cf8b5a-9d80-441c-92b6-8f6cca9ed8cc tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:47.473012 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-98cf8b5a-9d80-441c-92b6-8f6cca9ed8cc tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:47.474599 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-98cf8b5a-9d80-441c-92b6-8f6cca9ed8cc tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:47.478625 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-98cf8b5a-9d80-441c-92b6-8f6cca9ed8cc tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:47.479461 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-98cf8b5a-9d80-441c-92b6-8f6cca9ed8cc tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:47.495941 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-98cf8b5a-9d80-441c-92b6-8f6cca9ed8cc tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] HTTP exception thrown: Instance f10b90ae-23e1-4ca1-b95e-9404e606e5d9 could not be found. Oct 30 01:18:47.498021 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-98cf8b5a-9d80-441c-92b6-8f6cca9ed8cc tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Request method failure captured: Oct 30 01:18:47.498021 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 HTTP/1.1 Oct 30 01:18:47.498021 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:18:47.498021 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:18:47.498021 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:18:47.498021 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:18:47.498021 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:18:47.498021 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:18:47.498021 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:18:47.498021 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:18:47.498021 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdBLIr-HQgkI-rSu4DbpiRy1V13PfvGTP624UYMiOCdGmuBqdCR6ZXBiD5GM13AKoQSgdQS8eDOFUl5XDTh2OfCVYuKBu9hi10IP7DN1i38HNQdNw2vy91w_U8U2akAexTgOeY8RA_6D56erlCEw53cT0RaTjARVr810cdgiCXo6doY Oct 30 01:18:47.498021 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:18:47.498021 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:18:47.498021 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:18:47.498021 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:18:47.498021 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:18:47.498021 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:18:47.498021 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: b90a3225f0bb4bb6a90847078c27720d Oct 30 01:18:47.498021 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServersAdminTestJSON-1617649150 Oct 30 01:18:47.498021 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:18:47.498021 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:18:47.499516 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b90a3225f0bb4bb6a90847078c27720d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b90a3225f0bb4bb6a90847078c27720d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b90a3225f0bb4bb6a90847078c27720d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b90a3225f0bb4bb6a90847078c27720d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:18:47.499516 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServersAdminTestJSON-1617649150 Oct 30 01:18:47.499516 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: b90a3225f0bb4bb6a90847078c27720d Oct 30 01:18:47.499516 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServersAdminTestJSON-1617649150 Oct 30 01:18:47.499516 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServersAdminTestJSON-1617649150-project Oct 30 01:18:47.499516 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:18:47.499516 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:18:47.499516 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: f33a2fe009b74c1285df84f614f38866 Oct 30 01:18:47.499516 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServersAdminTestJSON-1617649150-project Oct 30 01:18:47.499516 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:18:47.499516 n-d-master-1 devstack@n-api.service[121102]: exception: Instance f10b90ae-23e1-4ca1-b95e-9404e606e5d9 could not be found. Oct 30 01:18:47.499516 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'f10b90ae-23e1-4ca1-b95e-9404e606e5d9'} Oct 30 01:18:47.500268 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:18:47.500268 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:47.500268 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:18:47.500268 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:18:47.500268 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:18:47.500268 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:18:47.500268 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:18:47.500268 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:18:47.500268 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:18:47.500268 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:18:47.500268 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f10b90ae-23e1-4ca1-b95e-9404e606e5d9 could not be found. Oct 30 01:18:47.500268 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:18:47.500268 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:18:47.500268 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:18:47.500268 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:47.500268 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:18:47.500268 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:18:47.500268 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:18:47.500268 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:18:47.500268 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:18:47.501544 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:18:47.501544 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:18:47.501544 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:18:47.501544 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:18:47.501544 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:18:47.501544 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:18:47.501544 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:18:47.501544 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f10b90ae-23e1-4ca1-b95e-9404e606e5d9 could not be found. Oct 30 01:18:47.501544 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:18:47.501544 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:18:47.501544 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:18:47.501544 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:47.501544 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:18:47.501544 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:18:47.501544 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:18:47.501544 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:18:47.501544 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f10b90ae-23e1-4ca1-b95e-9404e606e5d9 could not be found. Oct 30 01:18:47.501544 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:18:47.509287 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-98cf8b5a-9d80-441c-92b6-8f6cca9ed8cc tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] Returning 404 to user: Instance f10b90ae-23e1-4ca1-b95e-9404e606e5d9 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:18:47.510961 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-98cf8b5a-9d80-441c-92b6-8f6cca9ed8cc tempest-ServersAdminTestJSON-1617649150 tempest-ServersAdminTestJSON-1617649150-project] 10.222.0.13 "GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9" status: 404 len: 111 microversion: 2.1 time: 0.055380 Oct 30 01:18:47.512094 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 782/1528] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:47 2022] GET /compute/v2.1/servers/f10b90ae-23e1-4ca1-b95e-9404e606e5d9 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:18:47.620894 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6f61db86-87e2-45c6-b8d3-63f9ba445047 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:47.652169 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6f61db86-87e2-45c6-b8d3-63f9ba445047 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/16620e75-9ac1-4f76-97eb-d4281e2f0d88" status: 200 len: 1308 microversion: 2.1 time: 0.489134 Oct 30 01:18:47.671858 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 747/1529] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:47 2022] GET /compute/v2.1/servers/16620e75-9ac1-4f76-97eb-d4281e2f0d88 => generated 1308 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:47.962564 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e2285ae9-372f-4d5f-803a-33d762dbe019 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:47.963555 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e2285ae9-372f-4d5f-803a-33d762dbe019 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:47.977828 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2285ae9-372f-4d5f-803a-33d762dbe019 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:47.978837 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2285ae9-372f-4d5f-803a-33d762dbe019 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:47.980210 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2285ae9-372f-4d5f-803a-33d762dbe019 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:47.982105 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2285ae9-372f-4d5f-803a-33d762dbe019 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:47.985542 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2285ae9-372f-4d5f-803a-33d762dbe019 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:47.986893 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2285ae9-372f-4d5f-803a-33d762dbe019 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:48.029981 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e4c3cc0c-f309-4f91-886c-bf33c33fc057 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-426320937", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "a974e348-14e9-416b-aba2-e255412b1fdd"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:18:48.151235 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-e4c3cc0c-f309-4f91-886c-bf33c33fc057 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] validate_networks() for [('a974e348-14e9-416b-aba2-e255412b1fdd', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:18:48.718130 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e2285ae9-372f-4d5f-803a-33d762dbe019 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:48.729292 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e2285ae9-372f-4d5f-803a-33d762dbe019 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:48.735145 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e2285ae9-372f-4d5f-803a-33d762dbe019 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:48.743723 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e2285ae9-372f-4d5f-803a-33d762dbe019 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 200 len: 1813 microversion: 2.25 time: 0.784859 Oct 30 01:18:48.744602 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 748/1530] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:47 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 1813 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:18:48.762084 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-234cdff1-2176-4ed1-bc98-f9f0eb3b3860 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:48.762978 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-234cdff1-2176-4ed1-bc98-f9f0eb3b3860 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 03d9aff4-215d-48fa-b741-2257b62fc597] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:48.769599 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-234cdff1-2176-4ed1-bc98-f9f0eb3b3860 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:48.773948 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-234cdff1-2176-4ed1-bc98-f9f0eb3b3860 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:48.774647 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-234cdff1-2176-4ed1-bc98-f9f0eb3b3860 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:48.775588 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-234cdff1-2176-4ed1-bc98-f9f0eb3b3860 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:48.776253 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-234cdff1-2176-4ed1-bc98-f9f0eb3b3860 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:48.776886 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-234cdff1-2176-4ed1-bc98-f9f0eb3b3860 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:49.282849 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-234cdff1-2176-4ed1-bc98-f9f0eb3b3860 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:49.291737 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-234cdff1-2176-4ed1-bc98-f9f0eb3b3860 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597" status: 200 len: 1538 microversion: 2.1 time: 0.545766 Oct 30 01:18:49.308626 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 749/1531] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:48 2022] GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597 => generated 1538 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:49.311244 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-09a808e2-bfd0-4d27-b368-46682cbb3e15 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1721203567", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "b4253cc9-9396-4e97-b0c0-e8b6bb730934"}], "block_device_mapping_v2": [{"uuid": "4a014d4e-54ff-4fcc-a2fb-44a37632592f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:18:49.435210 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-09a808e2-bfd0-4d27-b368-46682cbb3e15 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] validate_networks() for [('b4253cc9-9396-4e97-b0c0-e8b6bb730934', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:18:49.613885 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-e4c3cc0c-f309-4f91-886c-bf33c33fc057 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:18:49.614472 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-e4c3cc0c-f309-4f91-886c-bf33c33fc057 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:18:49.616156 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-e4c3cc0c-f309-4f91-886c-bf33c33fc057 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:18:49.616156 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-e4c3cc0c-f309-4f91-886c-bf33c33fc057 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:18:49.616490 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-e4c3cc0c-f309-4f91-886c-bf33c33fc057 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:18:49.649304 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e4c3cc0c-f309-4f91-886c-bf33c33fc057 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:49.651622 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e4c3cc0c-f309-4f91-886c-bf33c33fc057 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:49.652112 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e4c3cc0c-f309-4f91-886c-bf33c33fc057 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:49.652927 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e4c3cc0c-f309-4f91-886c-bf33c33fc057 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:49.659190 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e4c3cc0c-f309-4f91-886c-bf33c33fc057 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:49.660580 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e4c3cc0c-f309-4f91-886c-bf33c33fc057 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:49.711982 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-e4c3cc0c-f309-4f91-886c-bf33c33fc057 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Getting quotas for project 8c2cd7e4b04741e3bb1cb9852612db57. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:18:49.728914 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-e4c3cc0c-f309-4f91-886c-bf33c33fc057 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Getting quotas for user c114d44d0a314c75902da53fca797f62 and project 8c2cd7e4b04741e3bb1cb9852612db57. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:18:49.762473 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e4c3cc0c-f309-4f91-886c-bf33c33fc057 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:18:49.769118 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e4c3cc0c-f309-4f91-886c-bf33c33fc057 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: c74142c0-5f39-44d8-b754-9c9ee956850a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:18:50.008206 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e4c3cc0c-f309-4f91-886c-bf33c33fc057 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.281862 Oct 30 01:18:50.022757 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 783/1532] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:18:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2296 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:18:50.070883 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-324c1c4e-c30b-4a9a-84c7-0d5dbc50afaf tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:50.071760 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-324c1c4e-c30b-4a9a-84c7-0d5dbc50afaf tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] [instance: 0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:50.083541 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-324c1c4e-c30b-4a9a-84c7-0d5dbc50afaf tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:50.084297 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-324c1c4e-c30b-4a9a-84c7-0d5dbc50afaf tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:50.085570 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-324c1c4e-c30b-4a9a-84c7-0d5dbc50afaf tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:50.087953 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-324c1c4e-c30b-4a9a-84c7-0d5dbc50afaf tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:50.089826 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-324c1c4e-c30b-4a9a-84c7-0d5dbc50afaf tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:50.090525 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-324c1c4e-c30b-4a9a-84c7-0d5dbc50afaf tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:50.413802 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-324c1c4e-c30b-4a9a-84c7-0d5dbc50afaf tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7269dc6d56440ca8691179f7275aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4681ed2d06840f995b37e550323d6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:50.430754 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-324c1c4e-c30b-4a9a-84c7-0d5dbc50afaf tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] 10.222.0.13 "GET /compute/v2.1/servers/0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23" status: 200 len: 1275 microversion: 2.1 time: 0.374893 Oct 30 01:18:50.445383 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 784/1533] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:50 2022] GET /compute/v2.1/servers/0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23 => generated 1275 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:50.449910 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-53d926d5-ab35-4dde-9971-94342aa21219 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:50.450784 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-53d926d5-ab35-4dde-9971-94342aa21219 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: 16620e75-9ac1-4f76-97eb-d4281e2f0d88] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:50.470531 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53d926d5-ab35-4dde-9971-94342aa21219 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:50.471264 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53d926d5-ab35-4dde-9971-94342aa21219 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:50.471928 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53d926d5-ab35-4dde-9971-94342aa21219 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:50.472913 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53d926d5-ab35-4dde-9971-94342aa21219 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:50.474594 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53d926d5-ab35-4dde-9971-94342aa21219 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:50.475808 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53d926d5-ab35-4dde-9971-94342aa21219 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:50.505672 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-53d926d5-ab35-4dde-9971-94342aa21219 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] HTTP exception thrown: Instance 16620e75-9ac1-4f76-97eb-d4281e2f0d88 could not be found. Oct 30 01:18:50.507754 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-53d926d5-ab35-4dde-9971-94342aa21219 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Request method failure captured: Oct 30 01:18:50.507754 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/16620e75-9ac1-4f76-97eb-d4281e2f0d88 HTTP/1.1 Oct 30 01:18:50.507754 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:18:50.507754 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:18:50.507754 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:18:50.507754 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:18:50.507754 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:18:50.507754 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:18:50.507754 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:18:50.507754 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:18:50.507754 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdAyWG8ULueMlzGM_sHwJ9SOWADIPTb7By9fNsRcbHROHwygMRdk9IkmaCTF8DGTaB-qJmpNM38UnmXLKL5MROOCKmetoapYOI7trRPWkBfioCQrOG4AuSuVej_G20QC_MDzAmUbQ-QTCr2g6dCwwHCik9ACvFc8hu-sRLY-wv25V6Q Oct 30 01:18:50.507754 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:18:50.507754 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:18:50.507754 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:18:50.507754 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:18:50.507754 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:18:50.507754 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:18:50.507754 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 76b6f7b705f5428b9a3a3a8c4f86ff48 Oct 30 01:18:50.507754 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServersOnMultiNodesTest-1214334609 Oct 30 01:18:50.507754 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:18:50.507754 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:18:50.509417 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/76b6f7b705f5428b9a3a3a8c4f86ff48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_76b6f7b705f5428b9a3a3a8c4f86ff48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/76b6f7b705f5428b9a3a3a8c4f86ff48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/76b6f7b705f5428b9a3a3a8c4f86ff48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:18:50.509417 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServersOnMultiNodesTest-1214334609 Oct 30 01:18:50.509417 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 76b6f7b705f5428b9a3a3a8c4f86ff48 Oct 30 01:18:50.509417 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1214334609 Oct 30 01:18:50.509417 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServersOnMultiNodesTest-1214334609-project Oct 30 01:18:50.509417 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:18:50.509417 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:18:50.509417 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: c536d41a93ad4337909fe2e2cb949e03 Oct 30 01:18:50.509417 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServersOnMultiNodesTest-1214334609-project Oct 30 01:18:50.509417 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:18:50.509417 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 16620e75-9ac1-4f76-97eb-d4281e2f0d88 could not be found. Oct 30 01:18:50.509417 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '16620e75-9ac1-4f76-97eb-d4281e2f0d88'} Oct 30 01:18:50.510331 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:18:50.510331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:50.510331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:18:50.510331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:18:50.510331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:18:50.510331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:18:50.510331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:18:50.510331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:18:50.510331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:18:50.510331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:18:50.510331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16620e75-9ac1-4f76-97eb-d4281e2f0d88 could not be found. Oct 30 01:18:50.510331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:18:50.510331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:18:50.510331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:18:50.510331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:50.510331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:18:50.510331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:18:50.510331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:18:50.510331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:18:50.510331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:18:50.512527 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:18:50.512527 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:18:50.512527 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:18:50.512527 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:18:50.512527 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:18:50.512527 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:18:50.512527 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:18:50.512527 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16620e75-9ac1-4f76-97eb-d4281e2f0d88 could not be found. Oct 30 01:18:50.512527 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:18:50.512527 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:18:50.512527 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:18:50.512527 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:50.512527 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:18:50.512527 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:18:50.512527 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:18:50.512527 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:18:50.512527 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16620e75-9ac1-4f76-97eb-d4281e2f0d88 could not be found. Oct 30 01:18:50.512527 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:18:50.517025 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-53d926d5-ab35-4dde-9971-94342aa21219 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Returning 404 to user: Instance 16620e75-9ac1-4f76-97eb-d4281e2f0d88 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:18:50.518082 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-53d926d5-ab35-4dde-9971-94342aa21219 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/16620e75-9ac1-4f76-97eb-d4281e2f0d88" status: 404 len: 111 microversion: 2.1 time: 0.082148 Oct 30 01:18:50.529936 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 785/1534] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:50 2022] GET /compute/v2.1/servers/16620e75-9ac1-4f76-97eb-d4281e2f0d88 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:18:50.537262 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ae07a1b0-54a1-4d60-9729-0d415942816f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:50.537999 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ae07a1b0-54a1-4d60-9729-0d415942816f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:50.544870 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae07a1b0-54a1-4d60-9729-0d415942816f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:50.545513 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae07a1b0-54a1-4d60-9729-0d415942816f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:50.546437 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae07a1b0-54a1-4d60-9729-0d415942816f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:50.549118 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae07a1b0-54a1-4d60-9729-0d415942816f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:50.549713 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae07a1b0-54a1-4d60-9729-0d415942816f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:50.550149 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae07a1b0-54a1-4d60-9729-0d415942816f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:51.328282 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ae07a1b0-54a1-4d60-9729-0d415942816f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:51.363517 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ae07a1b0-54a1-4d60-9729-0d415942816f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:51.371886 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ae07a1b0-54a1-4d60-9729-0d415942816f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:51.377678 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ae07a1b0-54a1-4d60-9729-0d415942816f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 200 len: 1813 microversion: 2.25 time: 0.845806 Oct 30 01:18:51.379875 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 786/1535] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:50 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 1813 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:18:51.404415 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8ae4deda-aaf5-4c49-9e2c-629b70beae97 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:51.406434 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8ae4deda-aaf5-4c49-9e2c-629b70beae97 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: c74142c0-5f39-44d8-b754-9c9ee956850a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:51.609746 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8ae4deda-aaf5-4c49-9e2c-629b70beae97 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:51.619350 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8ae4deda-aaf5-4c49-9e2c-629b70beae97 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a" status: 200 len: 1224 microversion: 2.1 time: 0.234760 Oct 30 01:18:51.628015 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 787/1536] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:51 2022] GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a => generated 1224 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:51.628901 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-487f4eac-8cb8-495a-bdfc-88f1faf98860 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:51.632409 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-487f4eac-8cb8-495a-bdfc-88f1faf98860 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 03d9aff4-215d-48fa-b741-2257b62fc597] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:51.649266 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-487f4eac-8cb8-495a-bdfc-88f1faf98860 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:51.663727 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-487f4eac-8cb8-495a-bdfc-88f1faf98860 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:51.664197 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-487f4eac-8cb8-495a-bdfc-88f1faf98860 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:51.665167 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-487f4eac-8cb8-495a-bdfc-88f1faf98860 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:51.665843 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-487f4eac-8cb8-495a-bdfc-88f1faf98860 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:51.666449 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-487f4eac-8cb8-495a-bdfc-88f1faf98860 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:51.810170 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:51.926378 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=6 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:51.995516 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-09a808e2-bfd0-4d27-b368-46682cbb3e15 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:18:51.996361 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-09a808e2-bfd0-4d27-b368-46682cbb3e15 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:18:51.997075 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-09a808e2-bfd0-4d27-b368-46682cbb3e15 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:18:51.997882 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-09a808e2-bfd0-4d27-b368-46682cbb3e15 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:18:51.998526 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-09a808e2-bfd0-4d27-b368-46682cbb3e15 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:18:52.013161 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-09a808e2-bfd0-4d27-b368-46682cbb3e15 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:52.014091 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-09a808e2-bfd0-4d27-b368-46682cbb3e15 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:52.014798 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-09a808e2-bfd0-4d27-b368-46682cbb3e15 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:52.015804 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-09a808e2-bfd0-4d27-b368-46682cbb3e15 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:52.016498 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-09a808e2-bfd0-4d27-b368-46682cbb3e15 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:52.017152 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-09a808e2-bfd0-4d27-b368-46682cbb3e15 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:52.052400 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-09a808e2-bfd0-4d27-b368-46682cbb3e15 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Getting quotas for project 283e7fd477334b879db6b49ee5cc509f. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:18:52.059660 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-09a808e2-bfd0-4d27-b368-46682cbb3e15 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Getting quotas for user c7334417689847d18bc4c1b27d173a23 and project 283e7fd477334b879db6b49ee5cc509f. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:18:52.071134 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-487f4eac-8cb8-495a-bdfc-88f1faf98860 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:52.092963 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-487f4eac-8cb8-495a-bdfc-88f1faf98860 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597" status: 200 len: 1543 microversion: 2.1 time: 0.455972 Oct 30 01:18:52.093711 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 788/1537] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:51 2022] GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597 => generated 1543 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:52.118161 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8c092ead-9127-4443-9736-49915913f28f tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:52.120112 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8c092ead-9127-4443-9736-49915913f28f tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: d1fee870-9d6d-4086-9138-4a9709e2d26c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:52.130042 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8c092ead-9127-4443-9736-49915913f28f tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:52.130534 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8c092ead-9127-4443-9736-49915913f28f tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:52.135007 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8c092ead-9127-4443-9736-49915913f28f tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:52.136064 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8c092ead-9127-4443-9736-49915913f28f tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:52.138689 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8c092ead-9127-4443-9736-49915913f28f tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:52.139403 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8c092ead-9127-4443-9736-49915913f28f tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:52.188123 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-09a808e2-bfd0-4d27-b368-46682cbb3e15 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:18:52.194620 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-09a808e2-bfd0-4d27-b368-46682cbb3e15 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0ec8b27d-8af5-45d7-892b-09297e5cb2d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4a014d4e-54ff-4fcc-a2fb-44a37632592f',volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:18:52.200024 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-8c092ead-9127-4443-9736-49915913f28f tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] HTTP exception thrown: Instance d1fee870-9d6d-4086-9138-4a9709e2d26c could not be found. Oct 30 01:18:52.201678 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8c092ead-9127-4443-9736-49915913f28f tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Request method failure captured: Oct 30 01:18:52.201678 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/d1fee870-9d6d-4086-9138-4a9709e2d26c HTTP/1.1 Oct 30 01:18:52.201678 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:18:52.201678 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:18:52.201678 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:18:52.201678 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:18:52.201678 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:18:52.201678 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:18:52.201678 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:18:52.201678 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:18:52.201678 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdAyWG8ULueMlzGM_sHwJ9SOWADIPTb7By9fNsRcbHROHwygMRdk9IkmaCTF8DGTaB-qJmpNM38UnmXLKL5MROOCKmetoapYOI7trRPWkBfioCQrOG4AuSuVej_G20QC_MDzAmUbQ-QTCr2g6dCwwHCik9ACvFc8hu-sRLY-wv25V6Q Oct 30 01:18:52.201678 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:18:52.201678 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:18:52.201678 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:18:52.201678 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:18:52.201678 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:18:52.201678 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:18:52.201678 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 76b6f7b705f5428b9a3a3a8c4f86ff48 Oct 30 01:18:52.201678 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServersOnMultiNodesTest-1214334609 Oct 30 01:18:52.201678 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:18:52.201678 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:18:52.203021 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/76b6f7b705f5428b9a3a3a8c4f86ff48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_76b6f7b705f5428b9a3a3a8c4f86ff48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/76b6f7b705f5428b9a3a3a8c4f86ff48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/76b6f7b705f5428b9a3a3a8c4f86ff48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:18:52.203021 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServersOnMultiNodesTest-1214334609 Oct 30 01:18:52.203021 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 76b6f7b705f5428b9a3a3a8c4f86ff48 Oct 30 01:18:52.203021 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1214334609 Oct 30 01:18:52.203021 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServersOnMultiNodesTest-1214334609-project Oct 30 01:18:52.203021 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:18:52.203021 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:18:52.203021 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: c536d41a93ad4337909fe2e2cb949e03 Oct 30 01:18:52.203021 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServersOnMultiNodesTest-1214334609-project Oct 30 01:18:52.203021 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:18:52.203021 n-d-master-1 devstack@n-api.service[121102]: exception: Instance d1fee870-9d6d-4086-9138-4a9709e2d26c could not be found. Oct 30 01:18:52.203021 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'd1fee870-9d6d-4086-9138-4a9709e2d26c'} Oct 30 01:18:52.203984 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:18:52.203984 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:52.203984 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:18:52.203984 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:18:52.203984 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:18:52.203984 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:18:52.203984 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:18:52.203984 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:18:52.203984 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:18:52.203984 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:18:52.203984 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1fee870-9d6d-4086-9138-4a9709e2d26c could not be found. Oct 30 01:18:52.203984 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:18:52.203984 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:18:52.203984 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:18:52.203984 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:52.203984 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:18:52.203984 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:18:52.203984 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:18:52.203984 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:18:52.203984 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:18:52.205209 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:18:52.205209 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:18:52.205209 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:18:52.205209 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:18:52.205209 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:18:52.205209 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:18:52.205209 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:18:52.205209 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1fee870-9d6d-4086-9138-4a9709e2d26c could not be found. Oct 30 01:18:52.205209 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:18:52.205209 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:18:52.205209 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:18:52.205209 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:52.205209 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:18:52.205209 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:18:52.205209 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:18:52.205209 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:18:52.205209 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1fee870-9d6d-4086-9138-4a9709e2d26c could not be found. Oct 30 01:18:52.205209 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:18:52.208191 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8c092ead-9127-4443-9736-49915913f28f tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Returning 404 to user: Instance d1fee870-9d6d-4086-9138-4a9709e2d26c could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:18:52.208191 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8c092ead-9127-4443-9736-49915913f28f tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/d1fee870-9d6d-4086-9138-4a9709e2d26c" status: 404 len: 111 microversion: 2.1 time: 0.108115 Oct 30 01:18:52.217660 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 789/1538] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:52 2022] GET /compute/v2.1/servers/d1fee870-9d6d-4086-9138-4a9709e2d26c => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:18:52.261384 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f5d702c3-19ba-4437-a6fc-246392400a41 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:52.266104 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f5d702c3-19ba-4437-a6fc-246392400a41 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] [instance: 0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:52.306355 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5d702c3-19ba-4437-a6fc-246392400a41 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:52.307166 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5d702c3-19ba-4437-a6fc-246392400a41 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:52.310444 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5d702c3-19ba-4437-a6fc-246392400a41 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:52.311335 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5d702c3-19ba-4437-a6fc-246392400a41 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:52.313804 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5d702c3-19ba-4437-a6fc-246392400a41 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:52.319049 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5d702c3-19ba-4437-a6fc-246392400a41 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:52.806163 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-09a808e2-bfd0-4d27-b368-46682cbb3e15 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.495482 Oct 30 01:18:52.809023 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 750/1539] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:18:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 3503 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:18:52.848733 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9396d8d8-649a-4208-9489-9dee488c3eac tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:52.968858 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=3,nova_api:INSERT=6 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:52.988578 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f5d702c3-19ba-4437-a6fc-246392400a41 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7269dc6d56440ca8691179f7275aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4681ed2d06840f995b37e550323d6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:53.000454 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f5d702c3-19ba-4437-a6fc-246392400a41 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] 10.222.0.13 "GET /compute/v2.1/servers/0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23" status: 200 len: 1317 microversion: 2.1 time: 0.781897 Oct 30 01:18:53.008198 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 790/1540] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:52 2022] GET /compute/v2.1/servers/0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23 => generated 1317 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:53.019729 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-43c2c16a-19a7-4870-b963-7e83341981e8 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:53.027812 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-43c2c16a-19a7-4870-b963-7e83341981e8 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:53.059939 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-43c2c16a-19a7-4870-b963-7e83341981e8 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:53.060441 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-43c2c16a-19a7-4870-b963-7e83341981e8 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:53.060875 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-43c2c16a-19a7-4870-b963-7e83341981e8 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:53.063520 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9396d8d8-649a-4208-9489-9dee488c3eac tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/f7e3152a-37f1-42e3-a872-4e09c4000d62" status: 204 len: 0 microversion: 2.1 time: 0.253319 Oct 30 01:18:53.064759 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 751/1541] 10.222.0.13 () {58 vars in 1266 bytes} [Sun Oct 30 01:18:52 2022] DELETE /compute/v2.1/os-server-groups/f7e3152a-37f1-42e3-a872-4e09c4000d62 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:18:53.069569 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-43c2c16a-19a7-4870-b963-7e83341981e8 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:53.075064 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-43c2c16a-19a7-4870-b963-7e83341981e8 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:53.076295 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-34af9eda-c815-427c-a8d1-c1b36defea6b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:53.080790 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-34af9eda-c815-427c-a8d1-c1b36defea6b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: c74142c0-5f39-44d8-b754-9c9ee956850a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:53.082070 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-43c2c16a-19a7-4870-b963-7e83341981e8 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:53.102409 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-34af9eda-c815-427c-a8d1-c1b36defea6b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:53.108324 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-34af9eda-c815-427c-a8d1-c1b36defea6b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:53.108324 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-34af9eda-c815-427c-a8d1-c1b36defea6b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:53.108324 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-34af9eda-c815-427c-a8d1-c1b36defea6b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:53.108324 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-34af9eda-c815-427c-a8d1-c1b36defea6b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:53.108885 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-34af9eda-c815-427c-a8d1-c1b36defea6b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:53.198897 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:53.543738 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-34af9eda-c815-427c-a8d1-c1b36defea6b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:53.551973 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-34af9eda-c815-427c-a8d1-c1b36defea6b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a" status: 200 len: 1276 microversion: 2.1 time: 0.485881 Oct 30 01:18:53.558475 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 752/1542] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:53 2022] GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a => generated 1276 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:53.577483 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-45a0c1b9-3d26-4842-b34b-becbbe50fd5b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:53.578404 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-45a0c1b9-3d26-4842-b34b-becbbe50fd5b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0ec8b27d-8af5-45d7-892b-09297e5cb2d8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:53.765761 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-43c2c16a-19a7-4870-b963-7e83341981e8 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:53.780324 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-45a0c1b9-3d26-4842-b34b-becbbe50fd5b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:53.791717 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-43c2c16a-19a7-4870-b963-7e83341981e8 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:53.793579 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-43c2c16a-19a7-4870-b963-7e83341981e8 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:53.794813 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-43c2c16a-19a7-4870-b963-7e83341981e8 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 200 len: 1803 microversion: 2.25 time: 0.785575 Oct 30 01:18:53.795383 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 791/1543] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:53 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 1803 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:18:53.796784 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-45a0c1b9-3d26-4842-b34b-becbbe50fd5b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8" status: 200 len: 1053 microversion: 2.1 time: 0.229453 Oct 30 01:18:53.797448 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 753/1544] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:53 2022] GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8 => generated 1053 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:53.815405 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b0c2fbc5-5790-4798-a9ac-4e955d95aa5a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:53.818429 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b0c2fbc5-5790-4798-a9ac-4e955d95aa5a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 03d9aff4-215d-48fa-b741-2257b62fc597] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:53.822710 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6d541212-081b-4cc4-a2d8-8729b4130117 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:53.822710 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6d541212-081b-4cc4-a2d8-8729b4130117 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: a294dd33-efb1-4d8b-a83c-817b50cdc138] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:53.843158 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b0c2fbc5-5790-4798-a9ac-4e955d95aa5a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:53.843673 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b0c2fbc5-5790-4798-a9ac-4e955d95aa5a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:53.844295 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b0c2fbc5-5790-4798-a9ac-4e955d95aa5a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:53.846026 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b0c2fbc5-5790-4798-a9ac-4e955d95aa5a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:53.846496 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b0c2fbc5-5790-4798-a9ac-4e955d95aa5a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:53.846930 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b0c2fbc5-5790-4798-a9ac-4e955d95aa5a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:53.852090 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d541212-081b-4cc4-a2d8-8729b4130117 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:53.854775 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d541212-081b-4cc4-a2d8-8729b4130117 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:53.855231 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d541212-081b-4cc4-a2d8-8729b4130117 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:53.856124 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d541212-081b-4cc4-a2d8-8729b4130117 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:53.857677 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d541212-081b-4cc4-a2d8-8729b4130117 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:53.859184 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d541212-081b-4cc4-a2d8-8729b4130117 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:53.959296 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6d541212-081b-4cc4-a2d8-8729b4130117 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: a294dd33-efb1-4d8b-a83c-817b50cdc138] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:18:54.363900 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b0c2fbc5-5790-4798-a9ac-4e955d95aa5a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:54.380891 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b0c2fbc5-5790-4798-a9ac-4e955d95aa5a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597" status: 200 len: 1543 microversion: 2.1 time: 0.582048 Oct 30 01:18:54.383864 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 754/1545] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:53 2022] GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597 => generated 1543 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:54.403245 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e6af7491-73ab-441d-a880-1f187ab612a3 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Calling method '.version_select at 0x7f44c7c17790>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:54.417561 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e6af7491-73ab-441d-a880-1f187ab612a3 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:54.419630 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e6af7491-73ab-441d-a880-1f187ab612a3 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:54.420652 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e6af7491-73ab-441d-a880-1f187ab612a3 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:54.455349 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e6af7491-73ab-441d-a880-1f187ab612a3 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] 10.222.0.13 "GET /compute/v2.1/os-migrations" status: 200 len: 4043 microversion: 2.25 time: 0.065859 Oct 30 01:18:54.459345 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 755/1546] 10.222.0.13 () {60 vars in 1184 bytes} [Sun Oct 30 01:18:54 2022] GET /compute/v2.1/os-migrations => generated 4043 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:18:54.471937 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a6d4ee91-76ca-4ae3-ab9a-a7b41454dc03 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:54.473774 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a6d4ee91-76ca-4ae3-ab9a-a7b41454dc03 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] [instance: 0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:54.485379 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6d541212-081b-4cc4-a2d8-8729b4130117 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a294dd33-efb1-4d8b-a83c-817b50cdc138" status: 204 len: 0 microversion: 2.1 time: 0.688629 Oct 30 01:18:54.486094 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 792/1547] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:18:53 2022] DELETE /compute/v2.1/servers/a294dd33-efb1-4d8b-a83c-817b50cdc138 => generated 0 bytes in 690 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:18:54.488927 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a6d4ee91-76ca-4ae3-ab9a-a7b41454dc03 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:54.489710 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a6d4ee91-76ca-4ae3-ab9a-a7b41454dc03 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:54.491544 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a6d4ee91-76ca-4ae3-ab9a-a7b41454dc03 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:54.495429 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a6d4ee91-76ca-4ae3-ab9a-a7b41454dc03 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:54.495429 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a6d4ee91-76ca-4ae3-ab9a-a7b41454dc03 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:54.495896 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a6d4ee91-76ca-4ae3-ab9a-a7b41454dc03 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:54.496303 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bd657477-bf38-437d-af8b-98ec53b72861 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:54.497113 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bd657477-bf38-437d-af8b-98ec53b72861 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:54.515300 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bd657477-bf38-437d-af8b-98ec53b72861 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:54.515808 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bd657477-bf38-437d-af8b-98ec53b72861 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:54.516248 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bd657477-bf38-437d-af8b-98ec53b72861 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:54.516969 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bd657477-bf38-437d-af8b-98ec53b72861 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:54.520873 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bd657477-bf38-437d-af8b-98ec53b72861 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:54.520873 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bd657477-bf38-437d-af8b-98ec53b72861 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:54.975717 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a6d4ee91-76ca-4ae3-ab9a-a7b41454dc03 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7269dc6d56440ca8691179f7275aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4681ed2d06840f995b37e550323d6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:54.984514 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a6d4ee91-76ca-4ae3-ab9a-a7b41454dc03 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] 10.222.0.13 "GET /compute/v2.1/servers/0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23" status: 200 len: 1317 microversion: 2.1 time: 0.523080 Oct 30 01:18:54.985094 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 756/1548] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:54 2022] GET /compute/v2.1/servers/0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23 => generated 1317 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:54.999807 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8f15ab56-6a35-46bb-84ce-fae1d0251d33 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:55.000355 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8f15ab56-6a35-46bb-84ce-fae1d0251d33 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: f86d0786-3c99-494f-aa6b-47adf07fca7c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:55.023401 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f15ab56-6a35-46bb-84ce-fae1d0251d33 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:55.024514 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f15ab56-6a35-46bb-84ce-fae1d0251d33 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:55.027389 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f15ab56-6a35-46bb-84ce-fae1d0251d33 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:55.027615 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-bd657477-bf38-437d-af8b-98ec53b72861 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lazy-loading 'services' on Instance uuid f3141e23-1b24-4315-aac8-fb785005e789 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:18:55.028872 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f15ab56-6a35-46bb-84ce-fae1d0251d33 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:55.029841 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f15ab56-6a35-46bb-84ce-fae1d0251d33 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:55.030672 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f15ab56-6a35-46bb-84ce-fae1d0251d33 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:55.056884 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bd657477-bf38-437d-af8b-98ec53b72861 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 200 len: 2421 microversion: 2.25 time: 0.569493 Oct 30 01:18:55.081644 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 793/1549] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:54 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 2421 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:18:55.087299 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ef9310ea-a1ea-4a66-9675-d7a40ac06d19 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:55.089173 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8f15ab56-6a35-46bb-84ce-fae1d0251d33 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: f86d0786-3c99-494f-aa6b-47adf07fca7c] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:18:55.097445 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ef9310ea-a1ea-4a66-9675-d7a40ac06d19 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: c74142c0-5f39-44d8-b754-9c9ee956850a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:55.107982 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ef9310ea-a1ea-4a66-9675-d7a40ac06d19 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:55.108773 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ef9310ea-a1ea-4a66-9675-d7a40ac06d19 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:55.111551 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ef9310ea-a1ea-4a66-9675-d7a40ac06d19 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:55.112672 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ef9310ea-a1ea-4a66-9675-d7a40ac06d19 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:55.112966 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ef9310ea-a1ea-4a66-9675-d7a40ac06d19 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:55.114564 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ef9310ea-a1ea-4a66-9675-d7a40ac06d19 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:55.253388 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ef9310ea-a1ea-4a66-9675-d7a40ac06d19 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:55.278180 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ef9310ea-a1ea-4a66-9675-d7a40ac06d19 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a" status: 200 len: 1282 microversion: 2.1 time: 0.195232 Oct 30 01:18:55.279254 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 794/1550] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:55 2022] GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a => generated 1282 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:55.287221 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-de1ac1f4-7ee3-4010-8c4e-8be9691e42dc tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:55.288094 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-de1ac1f4-7ee3-4010-8c4e-8be9691e42dc tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0ec8b27d-8af5-45d7-892b-09297e5cb2d8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:55.294920 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-de1ac1f4-7ee3-4010-8c4e-8be9691e42dc tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:55.297214 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-de1ac1f4-7ee3-4010-8c4e-8be9691e42dc tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:55.297214 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-de1ac1f4-7ee3-4010-8c4e-8be9691e42dc tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:55.297214 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-de1ac1f4-7ee3-4010-8c4e-8be9691e42dc tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:55.297214 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-de1ac1f4-7ee3-4010-8c4e-8be9691e42dc tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:55.297663 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-de1ac1f4-7ee3-4010-8c4e-8be9691e42dc tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:55.378725 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-de1ac1f4-7ee3-4010-8c4e-8be9691e42dc tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:55.387590 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-de1ac1f4-7ee3-4010-8c4e-8be9691e42dc tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8" status: 200 len: 1103 microversion: 2.1 time: 0.104990 Oct 30 01:18:55.392576 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 795/1551] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:55 2022] GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8 => generated 1103 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:55.486541 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8f15ab56-6a35-46bb-84ce-fae1d0251d33 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f86d0786-3c99-494f-aa6b-47adf07fca7c" status: 204 len: 0 microversion: 2.1 time: 0.499006 Oct 30 01:18:55.486541 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 757/1552] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:18:54 2022] DELETE /compute/v2.1/servers/f86d0786-3c99-494f-aa6b-47adf07fca7c => generated 0 bytes in 501 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:18:55.494641 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-794295ca-02de-4144-88fc-224994323da5 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:55.497028 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-794295ca-02de-4144-88fc-224994323da5 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:55.520613 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-794295ca-02de-4144-88fc-224994323da5 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:55.521085 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-794295ca-02de-4144-88fc-224994323da5 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:55.526582 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-794295ca-02de-4144-88fc-224994323da5 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:55.530657 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-794295ca-02de-4144-88fc-224994323da5 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:55.531182 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-794295ca-02de-4144-88fc-224994323da5 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:55.534535 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-794295ca-02de-4144-88fc-224994323da5 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:55.632812 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-40d97dd3-db02-4862-b23a-a22b870fb957 tempest-TenantUsagesNegativeTestJSON-1903991582 tempest-TenantUsagesNegativeTestJSON-1903991582-project-admin] 10.222.0.13 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-29T01%3A18%3A54.979308&end=2022-10-31T01%3A18%3A54.979308" status: 404 len: 112 microversion: - time: 0.238438 Oct 30 01:18:55.633407 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 796/1553] 10.222.0.13 () {58 vars in 1316 bytes} [Sun Oct 30 01:18:55 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-29T01%3A18%3A54.979308&end=2022-10-31T01%3A18%3A54.979308 => generated 112 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 30 01:18:55.638658 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c151c5d6-3c4d-4692-9429-c578f2707e46 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:55.639512 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c151c5d6-3c4d-4692-9429-c578f2707e46 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 03d9aff4-215d-48fa-b741-2257b62fc597] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:55.647332 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c151c5d6-3c4d-4692-9429-c578f2707e46 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:55.647332 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c151c5d6-3c4d-4692-9429-c578f2707e46 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:55.647332 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c151c5d6-3c4d-4692-9429-c578f2707e46 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:55.647737 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c151c5d6-3c4d-4692-9429-c578f2707e46 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:55.648196 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c151c5d6-3c4d-4692-9429-c578f2707e46 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:55.648620 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c151c5d6-3c4d-4692-9429-c578f2707e46 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:55.941992 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c151c5d6-3c4d-4692-9429-c578f2707e46 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:55.950246 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-794295ca-02de-4144-88fc-224994323da5 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lazy-loading 'services' on Instance uuid f3141e23-1b24-4315-aac8-fb785005e789 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:18:55.954648 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c151c5d6-3c4d-4692-9429-c578f2707e46 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597" status: 200 len: 1543 microversion: 2.1 time: 0.319216 Oct 30 01:18:55.973059 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 797/1554] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:55 2022] GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597 => generated 1543 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:55.988139 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-794295ca-02de-4144-88fc-224994323da5 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 200 len: 2421 microversion: 2.25 time: 0.499613 Oct 30 01:18:55.989317 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 758/1555] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:18:55 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 2421 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:18:55.996363 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6590ca7c-9f02-4670-8d9d-2e14b32120f2 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:55.997218 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6590ca7c-9f02-4670-8d9d-2e14b32120f2 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: a294dd33-efb1-4d8b-a83c-817b50cdc138] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:56.005182 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6590ca7c-9f02-4670-8d9d-2e14b32120f2 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:56.005910 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6590ca7c-9f02-4670-8d9d-2e14b32120f2 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:56.006703 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6590ca7c-9f02-4670-8d9d-2e14b32120f2 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:56.007571 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6590ca7c-9f02-4670-8d9d-2e14b32120f2 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:56.008184 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6590ca7c-9f02-4670-8d9d-2e14b32120f2 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:56.008746 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6590ca7c-9f02-4670-8d9d-2e14b32120f2 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:56.108507 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-68034d41-8aed-405c-b7f2-7b545ca05d6e req-c13ea0aa-fdca-4b6a-a3dd-a214bb7ea12c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23", "tag": "ee56c5cb-786f-4755-b5e1-0380da8d4ae3"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:18:56.120691 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-68034d41-8aed-405c-b7f2-7b545ca05d6e req-c13ea0aa-fdca-4b6a-a3dd-a214bb7ea12c service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:56.121483 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-68034d41-8aed-405c-b7f2-7b545ca05d6e req-c13ea0aa-fdca-4b6a-a3dd-a214bb7ea12c service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:56.122161 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-68034d41-8aed-405c-b7f2-7b545ca05d6e req-c13ea0aa-fdca-4b6a-a3dd-a214bb7ea12c service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:56.137659 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-68034d41-8aed-405c-b7f2-7b545ca05d6e req-c13ea0aa-fdca-4b6a-a3dd-a214bb7ea12c service nova] Creating event network-changed:ee56c5cb-786f-4755-b5e1-0380da8d4ae3 for instance 0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23 on n-h2-master-1 Oct 30 01:18:56.144018 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-68034d41-8aed-405c-b7f2-7b545ca05d6e req-c13ea0aa-fdca-4b6a-a3dd-a214bb7ea12c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183731 Oct 30 01:18:56.145378 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 798/1556] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:18:56.151365 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3a068bb0-cd57-4d2f-9d90-3e078c5da83d tempest-TenantUsagesNegativeTestJSON-1903991582 tempest-TenantUsagesNegativeTestJSON-1903991582-project-admin] Calling method '.version_select at 0x7f44d05238b0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:56.158865 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-3a068bb0-cd57-4d2f-9d90-3e078c5da83d tempest-TenantUsagesNegativeTestJSON-1903991582 tempest-TenantUsagesNegativeTestJSON-1903991582-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 30 01:18:56.160945 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3a068bb0-cd57-4d2f-9d90-3e078c5da83d tempest-TenantUsagesNegativeTestJSON-1903991582 tempest-TenantUsagesNegativeTestJSON-1903991582-project-admin] Request method failure captured: Oct 30 01:18:56.160945 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/os-simple-tenant-usage/dff8a9cb1f7041289dc376b8a8bc91f5?start=2022-10-31T01%3A18%3A54.979308&end=2022-10-29T01%3A18%3A54.979308 HTTP/1.1 Oct 30 01:18:56.160945 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:18:56.160945 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:18:56.160945 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:18:56.160945 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:18:56.160945 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:18:56.160945 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:18:56.160945 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:18:56.160945 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:18:56.160945 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdD-3F7G9EOkVySR0AyBMBLBONvw4revuQ-683n4rb_B-7sKMYzwFY_j5Anmq3a-owjU58jDOYtgJ0hF-Ouzb4wwjCyCwrERLI4h3Dq57jD0pI73hlneMpa3whXurPeAOXv9jTnFNrUWRhAdBRUBjBXEKctXAChfSdEfoPb89Ov0_JM Oct 30 01:18:56.160945 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:18:56.160945 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:18:56.160945 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:18:56.160945 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:18:56.160945 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:18:56.160945 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:18:56.160945 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: f4c1bf45655b4f7da8641e218bc44a23 Oct 30 01:18:56.160945 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1903991582 Oct 30 01:18:56.160945 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,admin,reader Oct 30 01:18:56.160945 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,admin,reader Oct 30 01:18:56.168776 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f4c1bf45655b4f7da8641e218bc44a23"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f4c1bf45655b4f7da8641e218bc44a23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f4c1bf45655b4f7da8641e218bc44a23"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f4c1bf45655b4f7da8641e218bc44a23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:18:56.168776 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1903991582 Oct 30 01:18:56.168776 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: f4c1bf45655b4f7da8641e218bc44a23 Oct 30 01:18:56.168776 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1903991582 Oct 30 01:18:56.168776 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-TenantUsagesNegativeTestJSON-1903991582-project-admin Oct 30 01:18:56.168776 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:18:56.168776 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:18:56.168776 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 536f4e656ac94fef9322565e37cbb558 Oct 30 01:18:56.168776 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1903991582-project-admin Oct 30 01:18:56.168776 n-d-master-1 devstack@n-api.service[121102]: method: Oct 30 01:18:56.168776 n-d-master-1 devstack@n-api.service[121102]: exception: Invalid start time. The start time cannot occur after the end time. Oct 30 01:18:56.168776 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'dff8a9cb1f7041289dc376b8a8bc91f5'} Oct 30 01:18:56.169856 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:18:56.169856 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:56.169856 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:18:56.169856 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:18:56.169856 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:18:56.169856 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:18:56.169856 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:18:56.169856 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:18:56.169856 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 30 01:18:56.169856 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:18:56.169856 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:18:56.169856 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:18:56.169856 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 30 01:18:56.169856 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 30 01:18:56.169856 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 30 01:18:56.169856 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 30 01:18:56.169856 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 30 01:18:56.169856 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 30 01:18:56.169856 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 30 01:18:56.171340 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:18:56.171340 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:18:56.171340 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:18:56.171340 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:56.171340 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:18:56.171340 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:18:56.171340 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:18:56.171340 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:18:56.171340 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 30 01:18:56.171340 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:18:56.171340 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3a068bb0-cd57-4d2f-9d90-3e078c5da83d tempest-TenantUsagesNegativeTestJSON-1903991582 tempest-TenantUsagesNegativeTestJSON-1903991582-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:18:56.171340 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3a068bb0-cd57-4d2f-9d90-3e078c5da83d tempest-TenantUsagesNegativeTestJSON-1903991582 tempest-TenantUsagesNegativeTestJSON-1903991582-project-admin] 10.222.0.13 "GET /compute/v2.1/os-simple-tenant-usage/dff8a9cb1f7041289dc376b8a8bc91f5?start=2022-10-31T01%3A18%3A54.979308&end=2022-10-29T01%3A18%3A54.979308" status: 400 len: 111 microversion: 2.1 time: 0.016214 Oct 30 01:18:56.172467 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 799/1557] 10.222.0.13 () {58 vars in 1412 bytes} [Sun Oct 30 01:18:56 2022] GET /compute/v2.1/os-simple-tenant-usage/dff8a9cb1f7041289dc376b8a8bc91f5?start=2022-10-31T01%3A18%3A54.979308&end=2022-10-29T01%3A18%3A54.979308 => generated 111 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:18:56.175191 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3efd6570-acef-4b3e-b7f5-01b22692d21a tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:56.176111 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3efd6570-acef-4b3e-b7f5-01b22692d21a tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] [instance: 0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:56.184056 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3efd6570-acef-4b3e-b7f5-01b22692d21a tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:56.184956 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3efd6570-acef-4b3e-b7f5-01b22692d21a tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:56.185784 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3efd6570-acef-4b3e-b7f5-01b22692d21a tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:56.186683 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3efd6570-acef-4b3e-b7f5-01b22692d21a tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:56.187296 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3efd6570-acef-4b3e-b7f5-01b22692d21a tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:56.187879 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3efd6570-acef-4b3e-b7f5-01b22692d21a tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:56.497423 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6590ca7c-9f02-4670-8d9d-2e14b32120f2 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:56.507749 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6590ca7c-9f02-4670-8d9d-2e14b32120f2 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/a294dd33-efb1-4d8b-a83c-817b50cdc138" status: 200 len: 1473 microversion: 2.1 time: 0.517016 Oct 30 01:18:56.508354 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 759/1558] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:55 2022] GET /compute/v2.1/servers/a294dd33-efb1-4d8b-a83c-817b50cdc138 => generated 1473 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:56.523794 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0b912d9d-fa47-4f3d-96b6-46307d45dbdc tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:56.530175 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0b912d9d-fa47-4f3d-96b6-46307d45dbdc tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:56.546569 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b912d9d-fa47-4f3d-96b6-46307d45dbdc tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:56.547732 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b912d9d-fa47-4f3d-96b6-46307d45dbdc tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:56.550033 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b912d9d-fa47-4f3d-96b6-46307d45dbdc tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:56.551011 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b912d9d-fa47-4f3d-96b6-46307d45dbdc tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:56.552073 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b912d9d-fa47-4f3d-96b6-46307d45dbdc tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:56.553977 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b912d9d-fa47-4f3d-96b6-46307d45dbdc tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:56.692062 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3efd6570-acef-4b3e-b7f5-01b22692d21a tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7269dc6d56440ca8691179f7275aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4681ed2d06840f995b37e550323d6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:56.703777 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3efd6570-acef-4b3e-b7f5-01b22692d21a tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] 10.222.0.13 "GET /compute/v2.1/servers/0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23" status: 200 len: 1317 microversion: 2.1 time: 0.538368 Oct 30 01:18:56.704850 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 800/1559] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:56 2022] GET /compute/v2.1/servers/0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23 => generated 1317 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:56.727640 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-0b912d9d-fa47-4f3d-96b6-46307d45dbdc tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lazy-loading 'services' on Instance uuid f3141e23-1b24-4315-aac8-fb785005e789 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:18:56.904595 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-18e2eaba-8876-4cd7-9d12-be8805121ad5 tempest-TenantUsagesNegativeTestJSON-2095081782 tempest-TenantUsagesNegativeTestJSON-2095081782-project] Calling method '.version_select at 0x7f44d0536c10>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:56.909074 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-18e2eaba-8876-4cd7-9d12-be8805121ad5 tempest-TenantUsagesNegativeTestJSON-2095081782 tempest-TenantUsagesNegativeTestJSON-2095081782-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '8a0d0ccd0c0c4e2da7e4fc61663b1a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff8a9cb1f7041289dc376b8a8bc91f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:56.910813 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-18e2eaba-8876-4cd7-9d12-be8805121ad5 tempest-TenantUsagesNegativeTestJSON-2095081782 tempest-TenantUsagesNegativeTestJSON-2095081782-project] Request method failure captured: Oct 30 01:18:56.910813 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-29T01%3A18%3A54.979308&end=2022-10-31T01%3A18%3A54.979308&detailed=1 HTTP/1.1 Oct 30 01:18:56.910813 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:18:56.910813 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:18:56.910813 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:18:56.910813 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:18:56.910813 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:18:56.910813 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:18:56.910813 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:18:56.910813 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:18:56.910813 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdD9aABI1nJWS_Z1Ly4_p0jFlWtH-nWDOT4l6PiyYUbzYFwlF6ehFYCcobCsIzPPjW92vuvl5E6Rq-vSi2NHdtvXabpr3IoewKSK9h0A-RPFf0xWmCI8LYRkZm78w0htVvuJ893Oo9_z9mH_LtYb3cPpjNPtPpIVf8oFMpZmsscF-z8 Oct 30 01:18:56.910813 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:18:56.910813 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:18:56.910813 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:18:56.910813 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:18:56.910813 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:18:56.910813 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:18:56.910813 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: dff8a9cb1f7041289dc376b8a8bc91f5 Oct 30 01:18:56.910813 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-2095081782 Oct 30 01:18:56.910813 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:18:56.910813 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:18:56.912485 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dff8a9cb1f7041289dc376b8a8bc91f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_dff8a9cb1f7041289dc376b8a8bc91f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/dff8a9cb1f7041289dc376b8a8bc91f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dff8a9cb1f7041289dc376b8a8bc91f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:18:56.912485 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-2095081782 Oct 30 01:18:56.912485 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: dff8a9cb1f7041289dc376b8a8bc91f5 Oct 30 01:18:56.912485 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-2095081782 Oct 30 01:18:56.912485 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-TenantUsagesNegativeTestJSON-2095081782-project Oct 30 01:18:56.912485 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:18:56.912485 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:18:56.912485 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 8a0d0ccd0c0c4e2da7e4fc61663b1a38 Oct 30 01:18:56.912485 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-2095081782-project Oct 30 01:18:56.912485 n-d-master-1 devstack@n-api.service[121102]: method: Oct 30 01:18:56.912485 n-d-master-1 devstack@n-api.service[121102]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 30 01:18:56.912485 n-d-master-1 devstack@n-api.service[121102]: action_args: {} Oct 30 01:18:56.912485 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:18:56.913560 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:56.913560 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:18:56.913560 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:18:56.913560 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:18:56.913560 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:18:56.913560 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:18:56.913560 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:18:56.913560 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 30 01:18:56.913560 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:18:56.913560 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:18:56.913560 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:18:56.913560 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 30 01:18:56.913560 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 30 01:18:56.913560 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 30 01:18:56.913560 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 30 01:18:56.913560 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 30 01:18:56.913560 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 30 01:18:56.913560 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 30 01:18:56.913560 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 30 01:18:56.915080 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 01:18:56.915080 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 30 01:18:56.915080 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 01:18:56.915080 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise self.value Oct 30 01:18:56.915080 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 30 01:18:56.915080 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 30 01:18:56.915080 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 30 01:18:56.915080 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 30 01:18:56.915080 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 30 01:18:56.915080 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 30 01:18:56.915080 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 30 01:18:56.915080 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:18:56.915080 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:18:56.915080 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:18:56.915080 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:18:56.915080 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:18:56.915080 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:18:56.915080 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 30 01:18:56.915080 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 30 01:18:56.916883 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 30 01:18:56.916883 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:18:56.918248 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-18e2eaba-8876-4cd7-9d12-be8805121ad5 tempest-TenantUsagesNegativeTestJSON-2095081782 tempest-TenantUsagesNegativeTestJSON-2095081782-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:18:56.919849 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-18e2eaba-8876-4cd7-9d12-be8805121ad5 tempest-TenantUsagesNegativeTestJSON-2095081782 tempest-TenantUsagesNegativeTestJSON-2095081782-project] 10.222.0.13 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-29T01%3A18%3A54.979308&end=2022-10-31T01%3A18%3A54.979308&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.213247 Oct 30 01:18:56.920068 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 801/1560] 10.222.0.13 () {58 vars in 1335 bytes} [Sun Oct 30 01:18:56 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-29T01%3A18%3A54.979308&end=2022-10-31T01%3A18%3A54.979308&detailed=1 => generated 123 bytes in 215 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:18:56.927218 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-769f1c56-4c4b-43d8-8cbe-d3732f6c58a7 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:56.929440 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-769f1c56-4c4b-43d8-8cbe-d3732f6c58a7 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: c74142c0-5f39-44d8-b754-9c9ee956850a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:56.935621 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-769f1c56-4c4b-43d8-8cbe-d3732f6c58a7 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:56.936392 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-769f1c56-4c4b-43d8-8cbe-d3732f6c58a7 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:56.937153 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-769f1c56-4c4b-43d8-8cbe-d3732f6c58a7 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:56.937991 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-769f1c56-4c4b-43d8-8cbe-d3732f6c58a7 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:56.938612 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-769f1c56-4c4b-43d8-8cbe-d3732f6c58a7 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:56.942906 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-769f1c56-4c4b-43d8-8cbe-d3732f6c58a7 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:57.023670 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0b912d9d-fa47-4f3d-96b6-46307d45dbdc tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789/os-volume_attachments/e3264834-9e39-42ce-833c-39e7e44e15c7" status: 202 len: 0 microversion: 2.25 time: 0.505658 Oct 30 01:18:57.023670 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 760/1561] 10.222.0.13 () {60 vars in 1457 bytes} [Sun Oct 30 01:18:56 2022] DELETE /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789/os-volume_attachments/e3264834-9e39-42ce-833c-39e7e44e15c7 => generated 0 bytes in 507 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:18:57.031072 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c5a58b6d-8423-4f51-a88c-6702d48c68c1 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:57.031783 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c5a58b6d-8423-4f51-a88c-6702d48c68c1 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0ec8b27d-8af5-45d7-892b-09297e5cb2d8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:57.050286 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c5a58b6d-8423-4f51-a88c-6702d48c68c1 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:57.053758 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c5a58b6d-8423-4f51-a88c-6702d48c68c1 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:57.054219 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c5a58b6d-8423-4f51-a88c-6702d48c68c1 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:57.055256 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c5a58b6d-8423-4f51-a88c-6702d48c68c1 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:57.055881 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c5a58b6d-8423-4f51-a88c-6702d48c68c1 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:57.064079 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c5a58b6d-8423-4f51-a88c-6702d48c68c1 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:57.202784 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c5a58b6d-8423-4f51-a88c-6702d48c68c1 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:57.214134 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c5a58b6d-8423-4f51-a88c-6702d48c68c1 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8" status: 200 len: 1103 microversion: 2.1 time: 0.191004 Oct 30 01:18:57.227695 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 761/1562] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:57 2022] GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8 => generated 1103 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:57.235810 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a64e9056-babc-4cb4-92eb-1a1e3c2267e4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:57.238572 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a64e9056-babc-4cb4-92eb-1a1e3c2267e4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 03d9aff4-215d-48fa-b741-2257b62fc597] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:57.247513 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a64e9056-babc-4cb4-92eb-1a1e3c2267e4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:57.248331 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a64e9056-babc-4cb4-92eb-1a1e3c2267e4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:57.249110 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a64e9056-babc-4cb4-92eb-1a1e3c2267e4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:57.250077 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a64e9056-babc-4cb4-92eb-1a1e3c2267e4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:57.250705 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a64e9056-babc-4cb4-92eb-1a1e3c2267e4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:57.251324 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a64e9056-babc-4cb4-92eb-1a1e3c2267e4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:57.264270 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-769f1c56-4c4b-43d8-8cbe-d3732f6c58a7 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:57.272472 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-769f1c56-4c4b-43d8-8cbe-d3732f6c58a7 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a" status: 200 len: 1324 microversion: 2.1 time: 0.351060 Oct 30 01:18:57.274379 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 802/1563] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:56 2022] GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a => generated 1324 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:57.289041 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-aa894505-0fc5-4aaa-8953-9205b6df6786 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:57.292189 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-aa894505-0fc5-4aaa-8953-9205b6df6786 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:57.300268 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aa894505-0fc5-4aaa-8953-9205b6df6786 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:57.300747 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aa894505-0fc5-4aaa-8953-9205b6df6786 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:57.301461 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aa894505-0fc5-4aaa-8953-9205b6df6786 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:57.302356 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aa894505-0fc5-4aaa-8953-9205b6df6786 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:57.302813 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aa894505-0fc5-4aaa-8953-9205b6df6786 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:57.303341 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aa894505-0fc5-4aaa-8953-9205b6df6786 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:57.323443 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:57.347400 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-aa894505-0fc5-4aaa-8953-9205b6df6786 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.071673 Oct 30 01:18:57.348588 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 803/1564] 10.222.0.13 () {60 vars in 1343 bytes} [Sun Oct 30 01:18:57 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:18:57.442670 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a64e9056-babc-4cb4-92eb-1a1e3c2267e4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:57.455558 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a64e9056-babc-4cb4-92eb-1a1e3c2267e4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597" status: 200 len: 1543 microversion: 2.1 time: 0.224483 Oct 30 01:18:57.456299 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 762/1565] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:57 2022] GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597 => generated 1543 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:57.531383 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-92882b89-221f-4f4e-960d-beef204a7665 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:57.532327 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-92882b89-221f-4f4e-960d-beef204a7665 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: a294dd33-efb1-4d8b-a83c-817b50cdc138] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:57.553962 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92882b89-221f-4f4e-960d-beef204a7665 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:57.554462 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92882b89-221f-4f4e-960d-beef204a7665 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:57.554899 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92882b89-221f-4f4e-960d-beef204a7665 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:57.555620 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92882b89-221f-4f4e-960d-beef204a7665 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:57.556065 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92882b89-221f-4f4e-960d-beef204a7665 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:57.556712 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92882b89-221f-4f4e-960d-beef204a7665 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:57.741059 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9f9fc2b5-2b76-4fca-aba7-71b7c98595b4 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:57.741751 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9f9fc2b5-2b76-4fca-aba7-71b7c98595b4 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] [instance: 0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:57.753656 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9f9fc2b5-2b76-4fca-aba7-71b7c98595b4 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:57.754200 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9f9fc2b5-2b76-4fca-aba7-71b7c98595b4 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:57.754595 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9f9fc2b5-2b76-4fca-aba7-71b7c98595b4 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:57.755307 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9f9fc2b5-2b76-4fca-aba7-71b7c98595b4 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:57.758776 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9f9fc2b5-2b76-4fca-aba7-71b7c98595b4 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:57.759591 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9f9fc2b5-2b76-4fca-aba7-71b7c98595b4 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:58.820048 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9f9fc2b5-2b76-4fca-aba7-71b7c98595b4 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7269dc6d56440ca8691179f7275aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4681ed2d06840f995b37e550323d6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:58.831995 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9f9fc2b5-2b76-4fca-aba7-71b7c98595b4 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] 10.222.0.13 "GET /compute/v2.1/servers/0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23" status: 200 len: 1317 microversion: 2.1 time: 1.104861 Oct 30 01:18:58.840285 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 763/1566] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:57 2022] GET /compute/v2.1/servers/0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23 => generated 1317 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:18:58.843925 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-92882b89-221f-4f4e-960d-beef204a7665 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:58.873619 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-92882b89-221f-4f4e-960d-beef204a7665 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/a294dd33-efb1-4d8b-a83c-817b50cdc138" status: 200 len: 1473 microversion: 2.1 time: 1.330657 Oct 30 01:18:58.873619 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 804/1567] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:57 2022] GET /compute/v2.1/servers/a294dd33-efb1-4d8b-a83c-817b50cdc138 => generated 1473 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:58.874052 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-803d905f-590c-43a0-ae69-16b41e34f050 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:58.874052 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-803d905f-590c-43a0-ae69-16b41e34f050 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0ec8b27d-8af5-45d7-892b-09297e5cb2d8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:58.874052 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-803d905f-590c-43a0-ae69-16b41e34f050 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:58.874052 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-803d905f-590c-43a0-ae69-16b41e34f050 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:58.874431 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-803d905f-590c-43a0-ae69-16b41e34f050 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:58.874431 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-803d905f-590c-43a0-ae69-16b41e34f050 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:58.874431 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-803d905f-590c-43a0-ae69-16b41e34f050 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:58.874431 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-803d905f-590c-43a0-ae69-16b41e34f050 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:58.889424 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-be79b51f-7b86-4f28-8b97-a0135742a919 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:58.891909 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-be79b51f-7b86-4f28-8b97-a0135742a919 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: c74142c0-5f39-44d8-b754-9c9ee956850a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:58.913393 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-be79b51f-7b86-4f28-8b97-a0135742a919 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:58.914012 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-be79b51f-7b86-4f28-8b97-a0135742a919 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:58.914524 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-be79b51f-7b86-4f28-8b97-a0135742a919 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:58.915313 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-be79b51f-7b86-4f28-8b97-a0135742a919 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:58.915828 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-be79b51f-7b86-4f28-8b97-a0135742a919 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:58.916255 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-be79b51f-7b86-4f28-8b97-a0135742a919 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:59.068545 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-803d905f-590c-43a0-ae69-16b41e34f050 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:59.089023 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-803d905f-590c-43a0-ae69-16b41e34f050 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8" status: 200 len: 1151 microversion: 2.1 time: 0.234948 Oct 30 01:18:59.091112 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 764/1568] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:58 2022] GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8 => generated 1151 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:59.097737 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a0611a77-9822-45be-8c7d-85c027c31a23 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:59.103052 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a0611a77-9822-45be-8c7d-85c027c31a23 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:59.111175 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a0611a77-9822-45be-8c7d-85c027c31a23 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:59.112108 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a0611a77-9822-45be-8c7d-85c027c31a23 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:59.112884 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a0611a77-9822-45be-8c7d-85c027c31a23 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:59.114435 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a0611a77-9822-45be-8c7d-85c027c31a23 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:59.116087 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a0611a77-9822-45be-8c7d-85c027c31a23 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:59.116788 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a0611a77-9822-45be-8c7d-85c027c31a23 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:59.163597 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a0611a77-9822-45be-8c7d-85c027c31a23 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.070223 Oct 30 01:18:59.169409 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 765/1569] 10.222.0.13 () {60 vars in 1343 bytes} [Sun Oct 30 01:18:59 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:18:59.175499 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-33e1d8e4-d579-4b5b-af4a-140991832b9e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:59.176388 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-33e1d8e4-d579-4b5b-af4a-140991832b9e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 03d9aff4-215d-48fa-b741-2257b62fc597] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:59.183418 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-33e1d8e4-d579-4b5b-af4a-140991832b9e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:59.184343 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-33e1d8e4-d579-4b5b-af4a-140991832b9e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:59.184995 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-33e1d8e4-d579-4b5b-af4a-140991832b9e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:59.185980 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-33e1d8e4-d579-4b5b-af4a-140991832b9e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:59.186687 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-33e1d8e4-d579-4b5b-af4a-140991832b9e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:59.187309 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-33e1d8e4-d579-4b5b-af4a-140991832b9e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:59.494695 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-be79b51f-7b86-4f28-8b97-a0135742a919 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:59.504320 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-be79b51f-7b86-4f28-8b97-a0135742a919 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a" status: 200 len: 1324 microversion: 2.1 time: 0.641861 Oct 30 01:18:59.507441 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 805/1570] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:58 2022] GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a => generated 1324 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:59.847813 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-33e1d8e4-d579-4b5b-af4a-140991832b9e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:18:59.856653 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b98b9a2c-cdc2-4d4a-8020-974aeb420c52 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:59.859322 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b98b9a2c-cdc2-4d4a-8020-974aeb420c52 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] [instance: 0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:59.865205 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:59.876914 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-33e1d8e4-d579-4b5b-af4a-140991832b9e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597" status: 200 len: 1543 microversion: 2.1 time: 0.705934 Oct 30 01:18:59.880635 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b98b9a2c-cdc2-4d4a-8020-974aeb420c52 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:59.884382 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 766/1571] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:59 2022] GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597 => generated 1543 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:18:59.885427 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b98b9a2c-cdc2-4d4a-8020-974aeb420c52 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:59.887089 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b98b9a2c-cdc2-4d4a-8020-974aeb420c52 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:59.896699 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b98b9a2c-cdc2-4d4a-8020-974aeb420c52 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:59.897473 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b98b9a2c-cdc2-4d4a-8020-974aeb420c52 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:59.899190 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b98b9a2c-cdc2-4d4a-8020-974aeb420c52 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:59.900673 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-65f7d8a0-6781-4e85-8ae6-61da1d00d573 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:18:59.907148 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-65f7d8a0-6781-4e85-8ae6-61da1d00d573 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: a294dd33-efb1-4d8b-a83c-817b50cdc138] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:18:59.935450 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-65f7d8a0-6781-4e85-8ae6-61da1d00d573 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:59.936426 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-65f7d8a0-6781-4e85-8ae6-61da1d00d573 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:59.936871 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-65f7d8a0-6781-4e85-8ae6-61da1d00d573 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:18:59.941313 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-65f7d8a0-6781-4e85-8ae6-61da1d00d573 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:18:59.942213 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-65f7d8a0-6781-4e85-8ae6-61da1d00d573 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:18:59.942852 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-65f7d8a0-6781-4e85-8ae6-61da1d00d573 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:00.234351 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-65f7d8a0-6781-4e85-8ae6-61da1d00d573 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:00.247321 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:00.250698 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-65f7d8a0-6781-4e85-8ae6-61da1d00d573 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/a294dd33-efb1-4d8b-a83c-817b50cdc138" status: 200 len: 1431 microversion: 2.1 time: 0.360571 Oct 30 01:19:00.252647 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 767/1572] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:59 2022] GET /compute/v2.1/servers/a294dd33-efb1-4d8b-a83c-817b50cdc138 => generated 1431 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:00.266122 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-5328698f-a37b-476e-ade2-797898c7b8b6 req-73193333-28f8-4168-ac56-65f7c5d9538e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c74142c0-5f39-44d8-b754-9c9ee956850a", "tag": "6e6c0345-ef0b-4f04-abb3-43794b3a90ad"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:19:00.290964 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-5328698f-a37b-476e-ade2-797898c7b8b6 req-73193333-28f8-4168-ac56-65f7c5d9538e service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:00.293177 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-5328698f-a37b-476e-ade2-797898c7b8b6 req-73193333-28f8-4168-ac56-65f7c5d9538e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:00.293310 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-5328698f-a37b-476e-ade2-797898c7b8b6 req-73193333-28f8-4168-ac56-65f7c5d9538e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:00.327560 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-5328698f-a37b-476e-ade2-797898c7b8b6 req-73193333-28f8-4168-ac56-65f7c5d9538e service nova] Creating event network-changed:6e6c0345-ef0b-4f04-abb3-43794b3a90ad for instance c74142c0-5f39-44d8-b754-9c9ee956850a on n-h2-master-1 Oct 30 01:19:00.342997 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-5328698f-a37b-476e-ade2-797898c7b8b6 req-73193333-28f8-4168-ac56-65f7c5d9538e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088737 Oct 30 01:19:00.343893 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 768/1573] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:19:00.356603 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1759dc03-26fb-4bb9-b1b8-fc55686fc954 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:00.357440 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1759dc03-26fb-4bb9-b1b8-fc55686fc954 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0ec8b27d-8af5-45d7-892b-09297e5cb2d8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:00.373252 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1759dc03-26fb-4bb9-b1b8-fc55686fc954 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:00.379101 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1759dc03-26fb-4bb9-b1b8-fc55686fc954 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:00.379101 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1759dc03-26fb-4bb9-b1b8-fc55686fc954 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:00.379101 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1759dc03-26fb-4bb9-b1b8-fc55686fc954 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:00.379101 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1759dc03-26fb-4bb9-b1b8-fc55686fc954 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:00.379601 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1759dc03-26fb-4bb9-b1b8-fc55686fc954 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:00.605231 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1759dc03-26fb-4bb9-b1b8-fc55686fc954 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:00.616277 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1759dc03-26fb-4bb9-b1b8-fc55686fc954 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8" status: 200 len: 1169 microversion: 2.1 time: 0.268713 Oct 30 01:19:00.619339 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 769/1574] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:00 2022] GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8 => generated 1169 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:00.631984 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-72ebee9f-e649-46eb-8d76-0e8848a7dae7 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:00.636359 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-72ebee9f-e649-46eb-8d76-0e8848a7dae7 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:00.653482 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-72ebee9f-e649-46eb-8d76-0e8848a7dae7 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:00.654140 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-72ebee9f-e649-46eb-8d76-0e8848a7dae7 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:00.654601 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-72ebee9f-e649-46eb-8d76-0e8848a7dae7 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:00.657500 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-72ebee9f-e649-46eb-8d76-0e8848a7dae7 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:00.658147 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-72ebee9f-e649-46eb-8d76-0e8848a7dae7 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:00.658595 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-72ebee9f-e649-46eb-8d76-0e8848a7dae7 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:00.734672 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-72ebee9f-e649-46eb-8d76-0e8848a7dae7 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.112653 Oct 30 01:19:00.741194 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 770/1575] 10.222.0.13 () {60 vars in 1343 bytes} [Sun Oct 30 01:19:00 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:19:00.752587 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-25029645-d473-41c5-ba43-b8aa0a584db5 req-3add6837-70c9-4634-8c8f-de3a73d84c04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a294dd33-efb1-4d8b-a83c-817b50cdc138", "name": "network-vif-deleted", "tag": "7878fd43-0a39-4f54-a5fa-8c4667f94608"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:19:00.789833 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-25029645-d473-41c5-ba43-b8aa0a584db5 req-3add6837-70c9-4634-8c8f-de3a73d84c04 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:00.792685 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-25029645-d473-41c5-ba43-b8aa0a584db5 req-3add6837-70c9-4634-8c8f-de3a73d84c04 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:00.793190 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-25029645-d473-41c5-ba43-b8aa0a584db5 req-3add6837-70c9-4634-8c8f-de3a73d84c04 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:00.841833 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-25029645-d473-41c5-ba43-b8aa0a584db5 req-3add6837-70c9-4634-8c8f-de3a73d84c04 service nova] Creating event network-vif-deleted:7878fd43-0a39-4f54-a5fa-8c4667f94608 for instance a294dd33-efb1-4d8b-a83c-817b50cdc138 on n-h1-master-1 Oct 30 01:19:00.855341 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-25029645-d473-41c5-ba43-b8aa0a584db5 req-3add6837-70c9-4634-8c8f-de3a73d84c04 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107629 Oct 30 01:19:00.857105 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 771/1576] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:19:00.871536 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-27c42aeb-f649-47db-b7b2-76f7eb6fa1ab tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:00.872687 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-27c42aeb-f649-47db-b7b2-76f7eb6fa1ab tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: c74142c0-5f39-44d8-b754-9c9ee956850a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:00.891451 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-27c42aeb-f649-47db-b7b2-76f7eb6fa1ab tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:00.892288 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-27c42aeb-f649-47db-b7b2-76f7eb6fa1ab tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:00.894615 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-27c42aeb-f649-47db-b7b2-76f7eb6fa1ab tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:00.899792 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-27c42aeb-f649-47db-b7b2-76f7eb6fa1ab tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:00.899792 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-27c42aeb-f649-47db-b7b2-76f7eb6fa1ab tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:00.899792 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-27c42aeb-f649-47db-b7b2-76f7eb6fa1ab tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:01.016931 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b98b9a2c-cdc2-4d4a-8020-974aeb420c52 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7269dc6d56440ca8691179f7275aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4681ed2d06840f995b37e550323d6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:01.033020 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b98b9a2c-cdc2-4d4a-8020-974aeb420c52 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] 10.222.0.13 "GET /compute/v2.1/servers/0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23" status: 200 len: 1317 microversion: 2.1 time: 1.178094 Oct 30 01:19:01.048704 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 806/1577] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:18:59 2022] GET /compute/v2.1/servers/0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23 => generated 1317 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:01.053871 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c3a8dce9-ebd0-4976-a0f1-b9f024f81f03 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:01.054500 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c3a8dce9-ebd0-4976-a0f1-b9f024f81f03 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 03d9aff4-215d-48fa-b741-2257b62fc597] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:01.077327 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c3a8dce9-ebd0-4976-a0f1-b9f024f81f03 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:01.078165 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c3a8dce9-ebd0-4976-a0f1-b9f024f81f03 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:01.081031 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c3a8dce9-ebd0-4976-a0f1-b9f024f81f03 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:01.083682 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c3a8dce9-ebd0-4976-a0f1-b9f024f81f03 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:01.086194 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c3a8dce9-ebd0-4976-a0f1-b9f024f81f03 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:01.086803 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c3a8dce9-ebd0-4976-a0f1-b9f024f81f03 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:01.530210 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-27c42aeb-f649-47db-b7b2-76f7eb6fa1ab tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:01.540803 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-27c42aeb-f649-47db-b7b2-76f7eb6fa1ab tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a" status: 200 len: 1324 microversion: 2.1 time: 0.681460 Oct 30 01:19:01.541379 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 772/1578] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:00 2022] GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a => generated 1324 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:01.551423 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b1861c94-7c13-46e4-a099-9f16654c8681 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:01.553827 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b1861c94-7c13-46e4-a099-9f16654c8681 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: a294dd33-efb1-4d8b-a83c-817b50cdc138] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:01.571406 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1861c94-7c13-46e4-a099-9f16654c8681 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:01.571925 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1861c94-7c13-46e4-a099-9f16654c8681 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:01.572366 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1861c94-7c13-46e4-a099-9f16654c8681 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:01.573937 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1861c94-7c13-46e4-a099-9f16654c8681 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:01.578270 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1861c94-7c13-46e4-a099-9f16654c8681 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:01.579207 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1861c94-7c13-46e4-a099-9f16654c8681 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:01.618551 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=10 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:01.663899 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c3a8dce9-ebd0-4976-a0f1-b9f024f81f03 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:01.682552 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c3a8dce9-ebd0-4976-a0f1-b9f024f81f03 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597" status: 200 len: 1543 microversion: 2.1 time: 0.632550 Oct 30 01:19:01.683148 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 807/1579] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:01 2022] GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597 => generated 1543 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:01.707763 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1861c94-7c13-46e4-a099-9f16654c8681 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:01.711910 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-185e063c-b2f4-45ee-b7cf-dbbc5a59d621 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:01.716101 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1861c94-7c13-46e4-a099-9f16654c8681 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:01.717497 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-185e063c-b2f4-45ee-b7cf-dbbc5a59d621 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0ec8b27d-8af5-45d7-892b-09297e5cb2d8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:01.717879 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1861c94-7c13-46e4-a099-9f16654c8681 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:01.718697 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-b1861c94-7c13-46e4-a099-9f16654c8681 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lazy-loading 'fault' on Instance uuid a294dd33-efb1-4d8b-a83c-817b50cdc138 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:19:01.740051 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-185e063c-b2f4-45ee-b7cf-dbbc5a59d621 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:01.748220 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-185e063c-b2f4-45ee-b7cf-dbbc5a59d621 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:01.752512 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-185e063c-b2f4-45ee-b7cf-dbbc5a59d621 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:01.754276 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-185e063c-b2f4-45ee-b7cf-dbbc5a59d621 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:01.755170 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-185e063c-b2f4-45ee-b7cf-dbbc5a59d621 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:01.759834 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-185e063c-b2f4-45ee-b7cf-dbbc5a59d621 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:01.857623 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b1861c94-7c13-46e4-a099-9f16654c8681 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:01.869404 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b1861c94-7c13-46e4-a099-9f16654c8681 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/a294dd33-efb1-4d8b-a83c-817b50cdc138" status: 200 len: 1309 microversion: 2.1 time: 0.323986 Oct 30 01:19:01.880650 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 773/1580] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:01 2022] GET /compute/v2.1/servers/a294dd33-efb1-4d8b-a83c-817b50cdc138 => generated 1309 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:01.888869 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9d750703-d36a-4954-bb86-cb96926cf565 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:01.894881 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9d750703-d36a-4954-bb86-cb96926cf565 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:01.920536 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9d750703-d36a-4954-bb86-cb96926cf565 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:01.924087 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9d750703-d36a-4954-bb86-cb96926cf565 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:01.924975 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9d750703-d36a-4954-bb86-cb96926cf565 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:01.927317 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9d750703-d36a-4954-bb86-cb96926cf565 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:01.934450 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9d750703-d36a-4954-bb86-cb96926cf565 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:01.935958 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9d750703-d36a-4954-bb86-cb96926cf565 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:02.041306 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9d750703-d36a-4954-bb86-cb96926cf565 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.157375 Oct 30 01:19:02.043651 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 774/1581] 10.222.0.13 () {60 vars in 1343 bytes} [Sun Oct 30 01:19:01 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:19:02.056499 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2f70f744-7f77-456c-a206-f28ed49d4c29 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:02.057465 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2f70f744-7f77-456c-a206-f28ed49d4c29 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] [instance: 0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:02.073378 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f70f744-7f77-456c-a206-f28ed49d4c29 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:02.074785 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f70f744-7f77-456c-a206-f28ed49d4c29 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:02.076350 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f70f744-7f77-456c-a206-f28ed49d4c29 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:02.077855 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f70f744-7f77-456c-a206-f28ed49d4c29 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:02.080382 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f70f744-7f77-456c-a206-f28ed49d4c29 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:02.081003 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f70f744-7f77-456c-a206-f28ed49d4c29 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:02.140342 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-185e063c-b2f4-45ee-b7cf-dbbc5a59d621 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:02.151824 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-185e063c-b2f4-45ee-b7cf-dbbc5a59d621 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8" status: 200 len: 1169 microversion: 2.1 time: 0.457827 Oct 30 01:19:02.159386 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 808/1582] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:01 2022] GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8 => generated 1169 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:02.570147 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-05737e82-2caa-4c23-8f28-c5da92d4cb9a tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:02.570993 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-05737e82-2caa-4c23-8f28-c5da92d4cb9a tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: c74142c0-5f39-44d8-b754-9c9ee956850a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:02.578280 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-05737e82-2caa-4c23-8f28-c5da92d4cb9a tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:02.578774 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-05737e82-2caa-4c23-8f28-c5da92d4cb9a tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:02.579214 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-05737e82-2caa-4c23-8f28-c5da92d4cb9a tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:02.593572 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-05737e82-2caa-4c23-8f28-c5da92d4cb9a tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:02.594280 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-05737e82-2caa-4c23-8f28-c5da92d4cb9a tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:02.610207 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-05737e82-2caa-4c23-8f28-c5da92d4cb9a tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:02.690814 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:02.999017 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2f70f744-7f77-456c-a206-f28ed49d4c29 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7269dc6d56440ca8691179f7275aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4681ed2d06840f995b37e550323d6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:03.009122 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2f70f744-7f77-456c-a206-f28ed49d4c29 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] 10.222.0.13 "GET /compute/v2.1/servers/0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23" status: 200 len: 1317 microversion: 2.1 time: 0.957099 Oct 30 01:19:03.009750 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 775/1583] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:02 2022] GET /compute/v2.1/servers/0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23 => generated 1317 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:19:03.029929 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0baa29ff-2bfa-496e-ac3d-b5cb9262173d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:03.035124 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0baa29ff-2bfa-496e-ac3d-b5cb9262173d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 03d9aff4-215d-48fa-b741-2257b62fc597] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:03.051561 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0baa29ff-2bfa-496e-ac3d-b5cb9262173d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:03.052071 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0baa29ff-2bfa-496e-ac3d-b5cb9262173d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:03.052515 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0baa29ff-2bfa-496e-ac3d-b5cb9262173d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:03.058039 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0baa29ff-2bfa-496e-ac3d-b5cb9262173d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:03.058725 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0baa29ff-2bfa-496e-ac3d-b5cb9262173d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:03.065588 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0baa29ff-2bfa-496e-ac3d-b5cb9262173d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:03.165755 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-05737e82-2caa-4c23-8f28-c5da92d4cb9a tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:03.181255 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-05737e82-2caa-4c23-8f28-c5da92d4cb9a tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a" status: 200 len: 1324 microversion: 2.1 time: 0.609207 Oct 30 01:19:03.183812 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 809/1584] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:02 2022] GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a => generated 1324 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:03.197721 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cd043c6b-daca-431c-bb56-e7857068f985 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:03.199906 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cd043c6b-daca-431c-bb56-e7857068f985 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: a294dd33-efb1-4d8b-a83c-817b50cdc138] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:03.223364 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cd043c6b-daca-431c-bb56-e7857068f985 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:03.227743 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cd043c6b-daca-431c-bb56-e7857068f985 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:03.233620 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cd043c6b-daca-431c-bb56-e7857068f985 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:03.234193 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cd043c6b-daca-431c-bb56-e7857068f985 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:03.234674 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cd043c6b-daca-431c-bb56-e7857068f985 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:03.235100 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cd043c6b-daca-431c-bb56-e7857068f985 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:03.260769 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-cd043c6b-daca-431c-bb56-e7857068f985 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] HTTP exception thrown: Instance a294dd33-efb1-4d8b-a83c-817b50cdc138 could not be found. Oct 30 01:19:03.260769 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cd043c6b-daca-431c-bb56-e7857068f985 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Request method failure captured: Oct 30 01:19:03.260769 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/a294dd33-efb1-4d8b-a83c-817b50cdc138 HTTP/1.1 Oct 30 01:19:03.260769 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:19:03.260769 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:19:03.260769 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:19:03.260769 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:19:03.260769 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:19:03.260769 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:19:03.260769 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:19:03.260769 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:19:03.260769 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdAyWG8ULueMlzGM_sHwJ9SOWADIPTb7By9fNsRcbHROHwygMRdk9IkmaCTF8DGTaB-qJmpNM38UnmXLKL5MROOCKmetoapYOI7trRPWkBfioCQrOG4AuSuVej_G20QC_MDzAmUbQ-QTCr2g6dCwwHCik9ACvFc8hu-sRLY-wv25V6Q Oct 30 01:19:03.260769 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:19:03.260769 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:19:03.260769 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:19:03.260769 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:19:03.260769 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:19:03.260769 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:19:03.260769 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 76b6f7b705f5428b9a3a3a8c4f86ff48 Oct 30 01:19:03.260769 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServersOnMultiNodesTest-1214334609 Oct 30 01:19:03.260769 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:19:03.260769 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:19:03.262330 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/76b6f7b705f5428b9a3a3a8c4f86ff48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_76b6f7b705f5428b9a3a3a8c4f86ff48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/76b6f7b705f5428b9a3a3a8c4f86ff48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/76b6f7b705f5428b9a3a3a8c4f86ff48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:19:03.262330 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServersOnMultiNodesTest-1214334609 Oct 30 01:19:03.262330 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 76b6f7b705f5428b9a3a3a8c4f86ff48 Oct 30 01:19:03.262330 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1214334609 Oct 30 01:19:03.262330 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServersOnMultiNodesTest-1214334609-project Oct 30 01:19:03.262330 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:19:03.262330 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:19:03.262330 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: c536d41a93ad4337909fe2e2cb949e03 Oct 30 01:19:03.262330 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServersOnMultiNodesTest-1214334609-project Oct 30 01:19:03.262330 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:19:03.262330 n-d-master-1 devstack@n-api.service[121102]: exception: Instance a294dd33-efb1-4d8b-a83c-817b50cdc138 could not be found. Oct 30 01:19:03.262330 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'a294dd33-efb1-4d8b-a83c-817b50cdc138'} Oct 30 01:19:03.263242 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:19:03.263242 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:19:03.263242 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:19:03.263242 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:19:03.263242 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:19:03.263242 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:19:03.263242 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:19:03.263242 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:19:03.263242 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:19:03.263242 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:19:03.263242 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a294dd33-efb1-4d8b-a83c-817b50cdc138 could not be found. Oct 30 01:19:03.263242 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:19:03.263242 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:19:03.263242 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:19:03.263242 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:19:03.263242 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:19:03.263242 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:19:03.263242 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:19:03.263242 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:19:03.263242 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:19:03.264518 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:19:03.264518 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:19:03.264518 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:19:03.264518 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:19:03.264518 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:19:03.264518 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:19:03.264518 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:19:03.264518 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a294dd33-efb1-4d8b-a83c-817b50cdc138 could not be found. Oct 30 01:19:03.264518 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:19:03.264518 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:19:03.264518 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:19:03.264518 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:19:03.264518 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:19:03.264518 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:19:03.264518 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:19:03.264518 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:19:03.264518 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a294dd33-efb1-4d8b-a83c-817b50cdc138 could not be found. Oct 30 01:19:03.264518 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:19:03.266314 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cd043c6b-daca-431c-bb56-e7857068f985 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Returning 404 to user: Instance a294dd33-efb1-4d8b-a83c-817b50cdc138 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:19:03.266314 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cd043c6b-daca-431c-bb56-e7857068f985 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/a294dd33-efb1-4d8b-a83c-817b50cdc138" status: 404 len: 111 microversion: 2.1 time: 0.072753 Oct 30 01:19:03.266314 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 810/1585] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:03 2022] GET /compute/v2.1/servers/a294dd33-efb1-4d8b-a83c-817b50cdc138 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:19:03.266634 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-a25aac32-c61b-4625-8207-35b070428e04 req-0557555a-a8ac-473d-9506-f4bdf2c7e482 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f86d0786-3c99-494f-aa6b-47adf07fca7c", "name": "network-vif-deleted", "tag": "5abfe263-7efa-46a6-b0cd-7471fa65ad22"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:19:03.277249 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-a25aac32-c61b-4625-8207-35b070428e04 req-0557555a-a8ac-473d-9506-f4bdf2c7e482 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:03.278094 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-a25aac32-c61b-4625-8207-35b070428e04 req-0557555a-a8ac-473d-9506-f4bdf2c7e482 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:03.283885 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-a25aac32-c61b-4625-8207-35b070428e04 req-0557555a-a8ac-473d-9506-f4bdf2c7e482 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:03.295267 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-a25aac32-c61b-4625-8207-35b070428e04 req-0557555a-a8ac-473d-9506-f4bdf2c7e482 service nova] Creating event network-vif-deleted:5abfe263-7efa-46a6-b0cd-7471fa65ad22 for instance f86d0786-3c99-494f-aa6b-47adf07fca7c on n-h1-master-1 Oct 30 01:19:03.303210 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-a25aac32-c61b-4625-8207-35b070428e04 req-0557555a-a8ac-473d-9506-f4bdf2c7e482 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039966 Oct 30 01:19:03.305036 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 811/1586] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:19:03.311306 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1ffbe660-fd34-4d3b-b1aa-fe6ac42f1ae7 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:03.314081 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1ffbe660-fd34-4d3b-b1aa-fe6ac42f1ae7 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:03.322306 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:UPDATE=2,nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:03.324628 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ffbe660-fd34-4d3b-b1aa-fe6ac42f1ae7 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:03.325302 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ffbe660-fd34-4d3b-b1aa-fe6ac42f1ae7 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:03.325923 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ffbe660-fd34-4d3b-b1aa-fe6ac42f1ae7 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:03.326810 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ffbe660-fd34-4d3b-b1aa-fe6ac42f1ae7 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:03.327488 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ffbe660-fd34-4d3b-b1aa-fe6ac42f1ae7 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:03.328216 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ffbe660-fd34-4d3b-b1aa-fe6ac42f1ae7 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:03.396398 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1ffbe660-fd34-4d3b-b1aa-fe6ac42f1ae7 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.089638 Oct 30 01:19:03.397683 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 812/1587] 10.222.0.13 () {60 vars in 1343 bytes} [Sun Oct 30 01:19:03 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:19:03.406350 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-95984d11-7544-42bf-b901-980f3e25f682 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:03.407251 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-95984d11-7544-42bf-b901-980f3e25f682 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0ec8b27d-8af5-45d7-892b-09297e5cb2d8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:03.416798 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-95984d11-7544-42bf-b901-980f3e25f682 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:03.417578 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-95984d11-7544-42bf-b901-980f3e25f682 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:03.418181 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-95984d11-7544-42bf-b901-980f3e25f682 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:03.419141 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-95984d11-7544-42bf-b901-980f3e25f682 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:03.419976 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-95984d11-7544-42bf-b901-980f3e25f682 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:03.421565 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-95984d11-7544-42bf-b901-980f3e25f682 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:03.501915 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0baa29ff-2bfa-496e-ac3d-b5cb9262173d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:03.516440 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0baa29ff-2bfa-496e-ac3d-b5cb9262173d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597" status: 200 len: 1543 microversion: 2.1 time: 0.501016 Oct 30 01:19:03.517692 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 776/1588] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:03 2022] GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597 => generated 1543 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:03.527105 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-da55c4ab-381b-4b44-9d78-96de3cbcc741 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:03.528010 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-da55c4ab-381b-4b44-9d78-96de3cbcc741 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: f86d0786-3c99-494f-aa6b-47adf07fca7c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:03.546517 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da55c4ab-381b-4b44-9d78-96de3cbcc741 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:03.547276 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da55c4ab-381b-4b44-9d78-96de3cbcc741 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:03.549039 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da55c4ab-381b-4b44-9d78-96de3cbcc741 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:03.550127 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da55c4ab-381b-4b44-9d78-96de3cbcc741 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:03.551412 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da55c4ab-381b-4b44-9d78-96de3cbcc741 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:03.552558 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da55c4ab-381b-4b44-9d78-96de3cbcc741 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:03.617997 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da55c4ab-381b-4b44-9d78-96de3cbcc741 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:03.618979 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da55c4ab-381b-4b44-9d78-96de3cbcc741 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:03.619806 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da55c4ab-381b-4b44-9d78-96de3cbcc741 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:03.621733 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-da55c4ab-381b-4b44-9d78-96de3cbcc741 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lazy-loading 'fault' on Instance uuid f86d0786-3c99-494f-aa6b-47adf07fca7c {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:19:03.631090 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-95984d11-7544-42bf-b901-980f3e25f682 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:03.646076 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-95984d11-7544-42bf-b901-980f3e25f682 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8" status: 200 len: 1169 microversion: 2.1 time: 0.246040 Oct 30 01:19:03.658675 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 813/1589] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:03 2022] GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8 => generated 1169 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:03.785485 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=8 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:03.865008 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-da55c4ab-381b-4b44-9d78-96de3cbcc741 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:03.878918 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-da55c4ab-381b-4b44-9d78-96de3cbcc741 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/f86d0786-3c99-494f-aa6b-47adf07fca7c" status: 200 len: 1309 microversion: 2.1 time: 0.356890 Oct 30 01:19:03.882151 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 777/1590] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:03 2022] GET /compute/v2.1/servers/f86d0786-3c99-494f-aa6b-47adf07fca7c => generated 1309 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:04.035233 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-898d1dba-5d7d-4b5d-afd3-2269277907e5 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:04.037187 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-898d1dba-5d7d-4b5d-afd3-2269277907e5 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] [instance: 0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:04.052732 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-898d1dba-5d7d-4b5d-afd3-2269277907e5 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:04.057835 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-898d1dba-5d7d-4b5d-afd3-2269277907e5 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:04.058627 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-898d1dba-5d7d-4b5d-afd3-2269277907e5 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:04.067339 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-898d1dba-5d7d-4b5d-afd3-2269277907e5 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:04.069629 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-898d1dba-5d7d-4b5d-afd3-2269277907e5 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:04.071223 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-898d1dba-5d7d-4b5d-afd3-2269277907e5 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:04.207856 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cc4f7d52-663d-466c-83cc-3ace2f43d3a6 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:04.209350 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-cc4f7d52-663d-466c-83cc-3ace2f43d3a6 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: c74142c0-5f39-44d8-b754-9c9ee956850a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:04.238854 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cc4f7d52-663d-466c-83cc-3ace2f43d3a6 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:04.242333 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cc4f7d52-663d-466c-83cc-3ace2f43d3a6 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:04.248269 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cc4f7d52-663d-466c-83cc-3ace2f43d3a6 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:04.254214 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cc4f7d52-663d-466c-83cc-3ace2f43d3a6 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:04.255887 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cc4f7d52-663d-466c-83cc-3ace2f43d3a6 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:04.259517 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cc4f7d52-663d-466c-83cc-3ace2f43d3a6 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:04.789533 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-898d1dba-5d7d-4b5d-afd3-2269277907e5 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7269dc6d56440ca8691179f7275aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4681ed2d06840f995b37e550323d6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:04.805290 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-898d1dba-5d7d-4b5d-afd3-2269277907e5 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] 10.222.0.13 "GET /compute/v2.1/servers/0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23" status: 200 len: 1317 microversion: 2.1 time: 0.777186 Oct 30 01:19:04.809119 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 814/1591] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:04 2022] GET /compute/v2.1/servers/0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23 => generated 1317 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:04.828334 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d6ab1aa7-0426-4460-a41c-9da8ca3f83d2 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:04.831601 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d6ab1aa7-0426-4460-a41c-9da8ca3f83d2 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:04.851792 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d6ab1aa7-0426-4460-a41c-9da8ca3f83d2 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:04.852656 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d6ab1aa7-0426-4460-a41c-9da8ca3f83d2 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:04.853294 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d6ab1aa7-0426-4460-a41c-9da8ca3f83d2 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:04.854228 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d6ab1aa7-0426-4460-a41c-9da8ca3f83d2 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:04.854895 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d6ab1aa7-0426-4460-a41c-9da8ca3f83d2 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:04.855491 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d6ab1aa7-0426-4460-a41c-9da8ca3f83d2 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:04.892645 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d6ab1aa7-0426-4460-a41c-9da8ca3f83d2 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.082157 Oct 30 01:19:04.904373 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 815/1592] 10.222.0.13 () {60 vars in 1343 bytes} [Sun Oct 30 01:19:04 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:19:04.934421 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ee95250c-936b-4170-a0e8-792137eedd91 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:04.936163 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ee95250c-936b-4170-a0e8-792137eedd91 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 03d9aff4-215d-48fa-b741-2257b62fc597] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:04.943360 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-cc4f7d52-663d-466c-83cc-3ace2f43d3a6 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:04.950896 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee95250c-936b-4170-a0e8-792137eedd91 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:04.951412 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee95250c-936b-4170-a0e8-792137eedd91 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:04.955512 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee95250c-936b-4170-a0e8-792137eedd91 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:04.956313 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee95250c-936b-4170-a0e8-792137eedd91 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:04.956819 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee95250c-936b-4170-a0e8-792137eedd91 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:04.957266 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee95250c-936b-4170-a0e8-792137eedd91 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:04.958725 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cc4f7d52-663d-466c-83cc-3ace2f43d3a6 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a" status: 200 len: 1324 microversion: 2.1 time: 0.753841 Oct 30 01:19:04.960644 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 778/1593] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:04 2022] GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a => generated 1324 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:19:04.966720 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-347e63f7-a349-4247-b53a-aa51bcea31dc tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:04.969112 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-347e63f7-a349-4247-b53a-aa51bcea31dc tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0ec8b27d-8af5-45d7-892b-09297e5cb2d8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:04.977777 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-347e63f7-a349-4247-b53a-aa51bcea31dc tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:04.979507 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-347e63f7-a349-4247-b53a-aa51bcea31dc tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:04.979956 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-347e63f7-a349-4247-b53a-aa51bcea31dc tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:04.980683 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-347e63f7-a349-4247-b53a-aa51bcea31dc tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:04.981137 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-347e63f7-a349-4247-b53a-aa51bcea31dc tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:04.985548 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-347e63f7-a349-4247-b53a-aa51bcea31dc tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:05.851302 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ee95250c-936b-4170-a0e8-792137eedd91 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:05.859371 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ee95250c-936b-4170-a0e8-792137eedd91 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597" status: 200 len: 1543 microversion: 2.1 time: 0.946363 Oct 30 01:19:05.863395 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 816/1594] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:04 2022] GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597 => generated 1543 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:05.873917 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-eac11a49-60cb-4a2b-95d8-d5650402d19a tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:05.879586 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-eac11a49-60cb-4a2b-95d8-d5650402d19a tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: f86d0786-3c99-494f-aa6b-47adf07fca7c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:05.892227 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eac11a49-60cb-4a2b-95d8-d5650402d19a tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:05.900264 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eac11a49-60cb-4a2b-95d8-d5650402d19a tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:05.900733 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eac11a49-60cb-4a2b-95d8-d5650402d19a tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:05.902726 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eac11a49-60cb-4a2b-95d8-d5650402d19a tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:05.903200 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eac11a49-60cb-4a2b-95d8-d5650402d19a tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:05.907485 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eac11a49-60cb-4a2b-95d8-d5650402d19a tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:05.958672 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-eac11a49-60cb-4a2b-95d8-d5650402d19a tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] HTTP exception thrown: Instance f86d0786-3c99-494f-aa6b-47adf07fca7c could not be found. Oct 30 01:19:05.971028 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-eac11a49-60cb-4a2b-95d8-d5650402d19a tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Request method failure captured: Oct 30 01:19:05.971028 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/f86d0786-3c99-494f-aa6b-47adf07fca7c HTTP/1.1 Oct 30 01:19:05.971028 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:19:05.971028 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:19:05.971028 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:19:05.971028 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:19:05.971028 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:19:05.971028 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:19:05.971028 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:19:05.971028 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:19:05.971028 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdAyWG8ULueMlzGM_sHwJ9SOWADIPTb7By9fNsRcbHROHwygMRdk9IkmaCTF8DGTaB-qJmpNM38UnmXLKL5MROOCKmetoapYOI7trRPWkBfioCQrOG4AuSuVej_G20QC_MDzAmUbQ-QTCr2g6dCwwHCik9ACvFc8hu-sRLY-wv25V6Q Oct 30 01:19:05.971028 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:19:05.971028 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:19:05.971028 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:19:05.971028 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:19:05.971028 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:19:05.971028 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:19:05.971028 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 76b6f7b705f5428b9a3a3a8c4f86ff48 Oct 30 01:19:05.971028 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServersOnMultiNodesTest-1214334609 Oct 30 01:19:05.971028 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:19:05.971028 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:19:05.972665 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/76b6f7b705f5428b9a3a3a8c4f86ff48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_76b6f7b705f5428b9a3a3a8c4f86ff48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/76b6f7b705f5428b9a3a3a8c4f86ff48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/76b6f7b705f5428b9a3a3a8c4f86ff48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:19:05.972665 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServersOnMultiNodesTest-1214334609 Oct 30 01:19:05.972665 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 76b6f7b705f5428b9a3a3a8c4f86ff48 Oct 30 01:19:05.972665 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1214334609 Oct 30 01:19:05.972665 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServersOnMultiNodesTest-1214334609-project Oct 30 01:19:05.972665 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:19:05.972665 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:19:05.972665 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: c536d41a93ad4337909fe2e2cb949e03 Oct 30 01:19:05.972665 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServersOnMultiNodesTest-1214334609-project Oct 30 01:19:05.972665 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:19:05.972665 n-d-master-1 devstack@n-api.service[121102]: exception: Instance f86d0786-3c99-494f-aa6b-47adf07fca7c could not be found. Oct 30 01:19:05.972665 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'f86d0786-3c99-494f-aa6b-47adf07fca7c'} Oct 30 01:19:05.973869 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:19:05.973869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:19:05.973869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:19:05.973869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:19:05.973869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:19:05.973869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:19:05.973869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:19:05.973869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:19:05.973869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:19:05.973869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:19:05.973869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f86d0786-3c99-494f-aa6b-47adf07fca7c could not be found. Oct 30 01:19:05.973869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:19:05.973869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:19:05.973869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:19:05.973869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:19:05.973869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:19:05.973869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:19:05.973869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:19:05.973869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:19:05.973869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:19:05.975454 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:19:05.975454 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:19:05.975454 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:19:05.975454 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:19:05.975454 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:19:05.975454 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:19:05.975454 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:19:05.975454 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f86d0786-3c99-494f-aa6b-47adf07fca7c could not be found. Oct 30 01:19:05.975454 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:19:05.975454 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:19:05.975454 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:19:05.975454 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:19:05.975454 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:19:05.975454 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:19:05.975454 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:19:05.975454 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:19:05.975454 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f86d0786-3c99-494f-aa6b-47adf07fca7c could not be found. Oct 30 01:19:05.975454 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:19:05.977870 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-eac11a49-60cb-4a2b-95d8-d5650402d19a tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Returning 404 to user: Instance f86d0786-3c99-494f-aa6b-47adf07fca7c could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:19:05.977870 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-eac11a49-60cb-4a2b-95d8-d5650402d19a tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/f86d0786-3c99-494f-aa6b-47adf07fca7c" status: 404 len: 111 microversion: 2.1 time: 0.107803 Oct 30 01:19:05.977870 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 817/1595] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:05 2022] GET /compute/v2.1/servers/f86d0786-3c99-494f-aa6b-47adf07fca7c => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:19:05.985732 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-eee38172-bcdc-4ba2-a6b7-f95b86ce727c req-617d4317-2309-42ce-839e-25329e5ff5e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23", "name": "network-vif-plugged", "status": "completed", "tag": "ee56c5cb-786f-4755-b5e1-0380da8d4ae3"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:19:06.017064 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-eee38172-bcdc-4ba2-a6b7-f95b86ce727c req-617d4317-2309-42ce-839e-25329e5ff5e1 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:06.020818 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-eee38172-bcdc-4ba2-a6b7-f95b86ce727c req-617d4317-2309-42ce-839e-25329e5ff5e1 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:06.021298 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-eee38172-bcdc-4ba2-a6b7-f95b86ce727c req-617d4317-2309-42ce-839e-25329e5ff5e1 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:06.049804 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-eee38172-bcdc-4ba2-a6b7-f95b86ce727c req-617d4317-2309-42ce-839e-25329e5ff5e1 service nova] Creating event network-vif-plugged:ee56c5cb-786f-4755-b5e1-0380da8d4ae3 for instance 0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23 on n-h2-master-1 Oct 30 01:19:06.060327 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-eee38172-bcdc-4ba2-a6b7-f95b86ce727c req-617d4317-2309-42ce-839e-25329e5ff5e1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085128 Oct 30 01:19:06.062903 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 818/1596] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:19:06.068611 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d9cb1196-6735-444e-b3ef-8bb4e2f6ba75 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:06.072952 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d9cb1196-6735-444e-b3ef-8bb4e2f6ba75 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] [instance: 0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:06.087594 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9cb1196-6735-444e-b3ef-8bb4e2f6ba75 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:06.091554 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9cb1196-6735-444e-b3ef-8bb4e2f6ba75 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:06.091554 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9cb1196-6735-444e-b3ef-8bb4e2f6ba75 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:06.091554 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9cb1196-6735-444e-b3ef-8bb4e2f6ba75 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:06.092131 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9cb1196-6735-444e-b3ef-8bb4e2f6ba75 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:06.092727 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9cb1196-6735-444e-b3ef-8bb4e2f6ba75 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:06.320717 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-347e63f7-a349-4247-b53a-aa51bcea31dc tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:06.320717 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-347e63f7-a349-4247-b53a-aa51bcea31dc tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8" status: 200 len: 1211 microversion: 2.1 time: 1.284229 Oct 30 01:19:06.320717 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 779/1597] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:04 2022] GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8 => generated 1211 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:06.320717 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e14e53dd-b502-4335-b242-a3d3a2a7a840 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:06.321703 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e14e53dd-b502-4335-b242-a3d3a2a7a840 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:06.321703 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e14e53dd-b502-4335-b242-a3d3a2a7a840 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:06.321703 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e14e53dd-b502-4335-b242-a3d3a2a7a840 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:06.321703 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e14e53dd-b502-4335-b242-a3d3a2a7a840 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:06.322639 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e14e53dd-b502-4335-b242-a3d3a2a7a840 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:06.322639 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e14e53dd-b502-4335-b242-a3d3a2a7a840 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:06.322639 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e14e53dd-b502-4335-b242-a3d3a2a7a840 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:06.323629 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d9cb1196-6735-444e-b3ef-8bb4e2f6ba75 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7269dc6d56440ca8691179f7275aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4681ed2d06840f995b37e550323d6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:06.323629 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d9cb1196-6735-444e-b3ef-8bb4e2f6ba75 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] 10.222.0.13 "GET /compute/v2.1/servers/0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23" status: 200 len: 1317 microversion: 2.1 time: 0.241423 Oct 30 01:19:06.323629 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 819/1598] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:06 2022] GET /compute/v2.1/servers/0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23 => generated 1317 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:06.323629 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-71ab2bc5-9517-49db-9ee2-6e7216756586 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:06.374160 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e14e53dd-b502-4335-b242-a3d3a2a7a840 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.126293 Oct 30 01:19:06.389058 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 780/1599] 10.222.0.13 () {60 vars in 1343 bytes} [Sun Oct 30 01:19:06 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:19:06.389058 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-96dbf5dc-7aa4-414e-9d06-4e0672a9df56 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:06.389058 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-96dbf5dc-7aa4-414e-9d06-4e0672a9df56 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: c74142c0-5f39-44d8-b754-9c9ee956850a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:06.389058 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-96dbf5dc-7aa4-414e-9d06-4e0672a9df56 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:06.389539 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-96dbf5dc-7aa4-414e-9d06-4e0672a9df56 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:06.389998 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-96dbf5dc-7aa4-414e-9d06-4e0672a9df56 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:06.390766 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-96dbf5dc-7aa4-414e-9d06-4e0672a9df56 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:06.391290 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-96dbf5dc-7aa4-414e-9d06-4e0672a9df56 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:06.391920 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-96dbf5dc-7aa4-414e-9d06-4e0672a9df56 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:06.601321 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-71ab2bc5-9517-49db-9ee2-6e7216756586 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/c7c0390c-1b84-4cf1-ac23-fcc988b47bcf" status: 204 len: 0 microversion: 2.1 time: 0.291555 Oct 30 01:19:06.602113 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 820/1600] 10.222.0.13 () {58 vars in 1266 bytes} [Sun Oct 30 01:19:06 2022] DELETE /compute/v2.1/os-server-groups/c7c0390c-1b84-4cf1-ac23-fcc988b47bcf => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:19:06.610525 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-31078f64-fec7-432e-9f53-657b3df9262a tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:06.611007 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-31078f64-fec7-432e-9f53-657b3df9262a tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: d19d848f-99bc-4f10-b837-d66aaa5258a6] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:06.627563 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-31078f64-fec7-432e-9f53-657b3df9262a tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:06.631072 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-31078f64-fec7-432e-9f53-657b3df9262a tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:06.631777 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-31078f64-fec7-432e-9f53-657b3df9262a tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:06.633853 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-31078f64-fec7-432e-9f53-657b3df9262a tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:06.638859 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-31078f64-fec7-432e-9f53-657b3df9262a tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:06.639595 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-31078f64-fec7-432e-9f53-657b3df9262a tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:06.714910 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-31078f64-fec7-432e-9f53-657b3df9262a tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: d19d848f-99bc-4f10-b837-d66aaa5258a6] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:19:06.904401 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-96dbf5dc-7aa4-414e-9d06-4e0672a9df56 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:06.922926 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-96dbf5dc-7aa4-414e-9d06-4e0672a9df56 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a" status: 200 len: 1324 microversion: 2.1 time: 0.545890 Oct 30 01:19:06.926737 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 781/1601] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:06 2022] GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a => generated 1324 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:06.934256 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8cc31da6-ec2a-48d1-a752-842f741b3b89 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:06.935742 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8cc31da6-ec2a-48d1-a752-842f741b3b89 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 03d9aff4-215d-48fa-b741-2257b62fc597] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:06.944855 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8cc31da6-ec2a-48d1-a752-842f741b3b89 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:06.957467 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8cc31da6-ec2a-48d1-a752-842f741b3b89 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:06.957467 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8cc31da6-ec2a-48d1-a752-842f741b3b89 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:06.957467 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8cc31da6-ec2a-48d1-a752-842f741b3b89 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:06.957467 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8cc31da6-ec2a-48d1-a752-842f741b3b89 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:06.957921 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8cc31da6-ec2a-48d1-a752-842f741b3b89 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:07.143320 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-31078f64-fec7-432e-9f53-657b3df9262a tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d19d848f-99bc-4f10-b837-d66aaa5258a6" status: 204 len: 0 microversion: 2.1 time: 0.536515 Oct 30 01:19:07.149026 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 821/1602] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:19:06 2022] DELETE /compute/v2.1/servers/d19d848f-99bc-4f10-b837-d66aaa5258a6 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 30 01:19:07.156552 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-219ef819-d7fa-4e49-b44c-5cb7c0980f09 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:07.161438 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-219ef819-d7fa-4e49-b44c-5cb7c0980f09 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: d19d848f-99bc-4f10-b837-d66aaa5258a6] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:07.200921 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-219ef819-d7fa-4e49-b44c-5cb7c0980f09 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:07.202068 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-219ef819-d7fa-4e49-b44c-5cb7c0980f09 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:07.202793 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-219ef819-d7fa-4e49-b44c-5cb7c0980f09 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:07.203478 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-219ef819-d7fa-4e49-b44c-5cb7c0980f09 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:07.203962 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-219ef819-d7fa-4e49-b44c-5cb7c0980f09 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:07.204378 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-219ef819-d7fa-4e49-b44c-5cb7c0980f09 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:07.211194 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:07.216203 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8cc31da6-ec2a-48d1-a752-842f741b3b89 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:07.228576 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8cc31da6-ec2a-48d1-a752-842f741b3b89 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597" status: 200 len: 1543 microversion: 2.1 time: 0.300299 Oct 30 01:19:07.229516 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 782/1603] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:06 2022] GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597 => generated 1543 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:07.338616 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-9e4af622-a58f-485e-bede-bf89c9bae480 req-f2072568-2f59-451c-9622-4d52b114d8d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ec8b27d-8af5-45d7-892b-09297e5cb2d8", "tag": "f2512753-a87d-49fe-8f90-bf6f3cdfb7b3"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:19:07.352890 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-9e4af622-a58f-485e-bede-bf89c9bae480 req-f2072568-2f59-451c-9622-4d52b114d8d0 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:07.361408 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-9e4af622-a58f-485e-bede-bf89c9bae480 req-f2072568-2f59-451c-9622-4d52b114d8d0 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:07.361408 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-9e4af622-a58f-485e-bede-bf89c9bae480 req-f2072568-2f59-451c-9622-4d52b114d8d0 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:07.375545 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-9e4af622-a58f-485e-bede-bf89c9bae480 req-f2072568-2f59-451c-9622-4d52b114d8d0 service nova] Creating event network-changed:f2512753-a87d-49fe-8f90-bf6f3cdfb7b3 for instance 0ec8b27d-8af5-45d7-892b-09297e5cb2d8 on n-h1-master-1 Oct 30 01:19:07.384072 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-9e4af622-a58f-485e-bede-bf89c9bae480 req-f2072568-2f59-451c-9622-4d52b114d8d0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059660 Oct 30 01:19:07.385746 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 783/1604] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:19:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:19:07.393848 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c91b0fbe-02a3-4552-830e-6357bbe37c8d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:07.395555 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c91b0fbe-02a3-4552-830e-6357bbe37c8d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0ec8b27d-8af5-45d7-892b-09297e5cb2d8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:07.402961 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c91b0fbe-02a3-4552-830e-6357bbe37c8d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:07.404171 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c91b0fbe-02a3-4552-830e-6357bbe37c8d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:07.404979 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c91b0fbe-02a3-4552-830e-6357bbe37c8d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:07.406164 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c91b0fbe-02a3-4552-830e-6357bbe37c8d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:07.406791 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c91b0fbe-02a3-4552-830e-6357bbe37c8d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:07.408288 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c91b0fbe-02a3-4552-830e-6357bbe37c8d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:07.688467 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-219ef819-d7fa-4e49-b44c-5cb7c0980f09 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:07.698937 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-219ef819-d7fa-4e49-b44c-5cb7c0980f09 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/d19d848f-99bc-4f10-b837-d66aaa5258a6" status: 200 len: 1471 microversion: 2.1 time: 0.547857 Oct 30 01:19:07.700542 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 822/1605] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:07 2022] GET /compute/v2.1/servers/d19d848f-99bc-4f10-b837-d66aaa5258a6 => generated 1471 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:07.711510 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4a7deaa9-9ec2-4c52-9d59-e7a0094f7a65 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:07.711510 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4a7deaa9-9ec2-4c52-9d59-e7a0094f7a65 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] [instance: 0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:07.713327 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a7deaa9-9ec2-4c52-9d59-e7a0094f7a65 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:07.714052 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a7deaa9-9ec2-4c52-9d59-e7a0094f7a65 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:07.714590 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a7deaa9-9ec2-4c52-9d59-e7a0094f7a65 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:07.715432 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a7deaa9-9ec2-4c52-9d59-e7a0094f7a65 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:07.716123 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a7deaa9-9ec2-4c52-9d59-e7a0094f7a65 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:07.716648 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a7deaa9-9ec2-4c52-9d59-e7a0094f7a65 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:07.820928 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c91b0fbe-02a3-4552-830e-6357bbe37c8d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:07.829599 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c91b0fbe-02a3-4552-830e-6357bbe37c8d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8" status: 200 len: 1211 microversion: 2.1 time: 0.441761 Oct 30 01:19:07.837038 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 784/1606] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:07 2022] GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8 => generated 1211 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:07.842391 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b2176a86-0522-4dd6-b80f-399f7e893333 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:07.858804 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b2176a86-0522-4dd6-b80f-399f7e893333 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:07.866983 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b2176a86-0522-4dd6-b80f-399f7e893333 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:07.867799 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b2176a86-0522-4dd6-b80f-399f7e893333 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:07.868729 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b2176a86-0522-4dd6-b80f-399f7e893333 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:07.869635 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b2176a86-0522-4dd6-b80f-399f7e893333 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:07.870238 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b2176a86-0522-4dd6-b80f-399f7e893333 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:07.870885 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b2176a86-0522-4dd6-b80f-399f7e893333 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:07.920644 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=100 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:07.923989 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b2176a86-0522-4dd6-b80f-399f7e893333 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.085433 Oct 30 01:19:07.925147 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 785/1607] 10.222.0.13 () {60 vars in 1343 bytes} [Sun Oct 30 01:19:07 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789/os-volume_attachments => generated 25 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:07.949828 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-32358bfd-ffb6-4dad-beb1-a9303724666b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:07.950875 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-32358bfd-ffb6-4dad-beb1-a9303724666b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: c74142c0-5f39-44d8-b754-9c9ee956850a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:07.966247 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-32358bfd-ffb6-4dad-beb1-a9303724666b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:07.967288 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-32358bfd-ffb6-4dad-beb1-a9303724666b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:07.968020 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-32358bfd-ffb6-4dad-beb1-a9303724666b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:07.968961 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-32358bfd-ffb6-4dad-beb1-a9303724666b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:07.969604 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-32358bfd-ffb6-4dad-beb1-a9303724666b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:07.970482 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-32358bfd-ffb6-4dad-beb1-a9303724666b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:08.191787 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4a7deaa9-9ec2-4c52-9d59-e7a0094f7a65 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7269dc6d56440ca8691179f7275aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4681ed2d06840f995b37e550323d6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:08.201237 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4a7deaa9-9ec2-4c52-9d59-e7a0094f7a65 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] 10.222.0.13 "GET /compute/v2.1/servers/0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23" status: 200 len: 1317 microversion: 2.1 time: 0.499603 Oct 30 01:19:08.213365 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 823/1608] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:07 2022] GET /compute/v2.1/servers/0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23 => generated 1317 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:08.252177 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0d9e62c2-be77-4103-8bd4-786420d5bc50 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:08.252931 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0d9e62c2-be77-4103-8bd4-786420d5bc50 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 03d9aff4-215d-48fa-b741-2257b62fc597] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:08.279212 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0d9e62c2-be77-4103-8bd4-786420d5bc50 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:08.280829 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0d9e62c2-be77-4103-8bd4-786420d5bc50 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:08.281404 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0d9e62c2-be77-4103-8bd4-786420d5bc50 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:08.282255 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0d9e62c2-be77-4103-8bd4-786420d5bc50 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:08.282777 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0d9e62c2-be77-4103-8bd4-786420d5bc50 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:08.283427 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0d9e62c2-be77-4103-8bd4-786420d5bc50 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:08.494369 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-32358bfd-ffb6-4dad-beb1-a9303724666b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:08.505921 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-32358bfd-ffb6-4dad-beb1-a9303724666b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a" status: 200 len: 1324 microversion: 2.1 time: 0.559363 Oct 30 01:19:08.508699 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 786/1609] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:07 2022] GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a => generated 1324 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:19:08.683231 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-d42b793d-9449-43c6-9acc-c1080087fcd7 req-65298191-a310-43f0-b748-e8c18d3b3b30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c74142c0-5f39-44d8-b754-9c9ee956850a", "name": "network-vif-plugged", "status": "completed", "tag": "6e6c0345-ef0b-4f04-abb3-43794b3a90ad"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:19:08.710503 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d42b793d-9449-43c6-9acc-c1080087fcd7 req-65298191-a310-43f0-b748-e8c18d3b3b30 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:08.710503 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d42b793d-9449-43c6-9acc-c1080087fcd7 req-65298191-a310-43f0-b748-e8c18d3b3b30 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:08.710503 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d42b793d-9449-43c6-9acc-c1080087fcd7 req-65298191-a310-43f0-b748-e8c18d3b3b30 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:08.739208 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-d42b793d-9449-43c6-9acc-c1080087fcd7 req-65298191-a310-43f0-b748-e8c18d3b3b30 service nova] Creating event network-vif-plugged:6e6c0345-ef0b-4f04-abb3-43794b3a90ad for instance c74142c0-5f39-44d8-b754-9c9ee956850a on n-h2-master-1 Oct 30 01:19:08.746721 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-d42b793d-9449-43c6-9acc-c1080087fcd7 req-65298191-a310-43f0-b748-e8c18d3b3b30 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066982 Oct 30 01:19:08.751491 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 787/1610] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:19:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:19:08.757544 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c137ec6e-352b-4efc-a797-a097a9c010bf tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:08.763464 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c137ec6e-352b-4efc-a797-a097a9c010bf tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: d19d848f-99bc-4f10-b837-d66aaa5258a6] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:08.775259 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c137ec6e-352b-4efc-a797-a097a9c010bf tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:08.778445 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c137ec6e-352b-4efc-a797-a097a9c010bf tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:08.778445 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c137ec6e-352b-4efc-a797-a097a9c010bf tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:08.779011 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c137ec6e-352b-4efc-a797-a097a9c010bf tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:08.783124 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0d9e62c2-be77-4103-8bd4-786420d5bc50 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:08.785436 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c137ec6e-352b-4efc-a797-a097a9c010bf tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:08.785848 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c137ec6e-352b-4efc-a797-a097a9c010bf tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:08.796833 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0d9e62c2-be77-4103-8bd4-786420d5bc50 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597" status: 200 len: 1542 microversion: 2.1 time: 0.548724 Oct 30 01:19:08.802878 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 824/1611] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:08 2022] GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597 => generated 1542 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:08.863382 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-707ef852-b6cf-4b41-85e4-ff67d63cb3aa tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:08.864410 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-707ef852-b6cf-4b41-85e4-ff67d63cb3aa tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0ec8b27d-8af5-45d7-892b-09297e5cb2d8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:08.877951 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-707ef852-b6cf-4b41-85e4-ff67d63cb3aa tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:08.883991 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-707ef852-b6cf-4b41-85e4-ff67d63cb3aa tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:08.885864 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-707ef852-b6cf-4b41-85e4-ff67d63cb3aa tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:08.886897 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-707ef852-b6cf-4b41-85e4-ff67d63cb3aa tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:08.890471 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-707ef852-b6cf-4b41-85e4-ff67d63cb3aa tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:08.891239 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-707ef852-b6cf-4b41-85e4-ff67d63cb3aa tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:09.651265 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c137ec6e-352b-4efc-a797-a097a9c010bf tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:09.673264 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c137ec6e-352b-4efc-a797-a097a9c010bf tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/d19d848f-99bc-4f10-b837-d66aaa5258a6" status: 200 len: 1471 microversion: 2.1 time: 0.920349 Oct 30 01:19:09.674213 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 788/1612] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:08 2022] GET /compute/v2.1/servers/d19d848f-99bc-4f10-b837-d66aaa5258a6 => generated 1471 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:09.678970 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-44a55078-436b-4826-923a-9a458019dd31 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:09.679587 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-44a55078-436b-4826-923a-9a458019dd31 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] [instance: 0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:09.694182 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-707ef852-b6cf-4b41-85e4-ff67d63cb3aa tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:09.698302 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-44a55078-436b-4826-923a-9a458019dd31 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:09.698793 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-44a55078-436b-4826-923a-9a458019dd31 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:09.705068 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-44a55078-436b-4826-923a-9a458019dd31 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:09.706144 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-44a55078-436b-4826-923a-9a458019dd31 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:09.706773 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-44a55078-436b-4826-923a-9a458019dd31 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:09.707405 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-44a55078-436b-4826-923a-9a458019dd31 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:09.715926 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-707ef852-b6cf-4b41-85e4-ff67d63cb3aa tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8" status: 200 len: 1211 microversion: 2.1 time: 0.856952 Oct 30 01:19:09.718174 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 825/1613] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:08 2022] GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8 => generated 1211 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:09.732057 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-efa403c6-18c7-4e34-8deb-5dbfbb38dbff req-259c9fd5-0f69-4de7-b56c-dd190fea6a79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03d9aff4-215d-48fa-b741-2257b62fc597", "name": "network-vif-unplugged", "status": "completed", "tag": "f852959f-05e2-49d9-95ba-a62b3b029d75"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:19:09.761002 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-efa403c6-18c7-4e34-8deb-5dbfbb38dbff req-259c9fd5-0f69-4de7-b56c-dd190fea6a79 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:09.763013 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-efa403c6-18c7-4e34-8deb-5dbfbb38dbff req-259c9fd5-0f69-4de7-b56c-dd190fea6a79 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:09.765590 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-efa403c6-18c7-4e34-8deb-5dbfbb38dbff req-259c9fd5-0f69-4de7-b56c-dd190fea6a79 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:09.800274 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-efa403c6-18c7-4e34-8deb-5dbfbb38dbff req-259c9fd5-0f69-4de7-b56c-dd190fea6a79 service nova] Creating event network-vif-unplugged:f852959f-05e2-49d9-95ba-a62b3b029d75 for instance 03d9aff4-215d-48fa-b741-2257b62fc597 on n-h2-master-1 Oct 30 01:19:09.816073 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [req-efa403c6-18c7-4e34-8deb-5dbfbb38dbff req-259c9fd5-0f69-4de7-b56c-dd190fea6a79 service nova] Instance 03d9aff4-215d-48fa-b741-2257b62fc597 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=121102) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 30 01:19:09.841644 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-efa403c6-18c7-4e34-8deb-5dbfbb38dbff req-259c9fd5-0f69-4de7-b56c-dd190fea6a79 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.120749 Oct 30 01:19:09.847416 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 826/1614] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:19:09.857355 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3ace9503-8534-4476-a26b-7d8a8b700bdc tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:09.868504 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3ace9503-8534-4476-a26b-7d8a8b700bdc tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: c74142c0-5f39-44d8-b754-9c9ee956850a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:09.886989 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3ace9503-8534-4476-a26b-7d8a8b700bdc tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:09.889042 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3ace9503-8534-4476-a26b-7d8a8b700bdc tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:09.892477 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3ace9503-8534-4476-a26b-7d8a8b700bdc tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:09.896660 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3ace9503-8534-4476-a26b-7d8a8b700bdc tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:09.896660 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3ace9503-8534-4476-a26b-7d8a8b700bdc tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:09.896660 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3ace9503-8534-4476-a26b-7d8a8b700bdc tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:11.012050 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-44a55078-436b-4826-923a-9a458019dd31 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7269dc6d56440ca8691179f7275aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4681ed2d06840f995b37e550323d6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:11.025472 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-44a55078-436b-4826-923a-9a458019dd31 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] 10.222.0.13 "GET /compute/v2.1/servers/0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23" status: 200 len: 1507 microversion: 2.1 time: 1.350145 Oct 30 01:19:11.026778 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 789/1615] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:09 2022] GET /compute/v2.1/servers/0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23 => generated 1507 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:11.031673 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a6d47d6d-3bc2-430b-a794-a18cbe902f67 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:11.041311 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a6d47d6d-3bc2-430b-a794-a18cbe902f67 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 03d9aff4-215d-48fa-b741-2257b62fc597] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:11.067978 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a6d47d6d-3bc2-430b-a794-a18cbe902f67 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:11.068510 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a6d47d6d-3bc2-430b-a794-a18cbe902f67 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:11.068954 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a6d47d6d-3bc2-430b-a794-a18cbe902f67 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:11.070234 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a6d47d6d-3bc2-430b-a794-a18cbe902f67 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:11.070695 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a6d47d6d-3bc2-430b-a794-a18cbe902f67 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:11.071128 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a6d47d6d-3bc2-430b-a794-a18cbe902f67 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:11.176450 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3ace9503-8534-4476-a26b-7d8a8b700bdc tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:11.191956 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3ace9503-8534-4476-a26b-7d8a8b700bdc tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a" status: 200 len: 1324 microversion: 2.1 time: 1.339316 Oct 30 01:19:11.195667 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 827/1616] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:09 2022] GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a => generated 1324 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:11.215976 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-dbfb736c-847d-4a0e-b5ad-1b9b0735707e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:11.220019 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-dbfb736c-847d-4a0e-b5ad-1b9b0735707e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: d19d848f-99bc-4f10-b837-d66aaa5258a6] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:11.243081 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dbfb736c-847d-4a0e-b5ad-1b9b0735707e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:11.250677 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dbfb736c-847d-4a0e-b5ad-1b9b0735707e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:11.253163 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dbfb736c-847d-4a0e-b5ad-1b9b0735707e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:11.254149 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dbfb736c-847d-4a0e-b5ad-1b9b0735707e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:11.254821 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dbfb736c-847d-4a0e-b5ad-1b9b0735707e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:11.256053 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dbfb736c-847d-4a0e-b5ad-1b9b0735707e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:11.670166 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a6d47d6d-3bc2-430b-a794-a18cbe902f67 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:11.684816 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a6d47d6d-3bc2-430b-a794-a18cbe902f67 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597" status: 200 len: 1542 microversion: 2.1 time: 0.652564 Oct 30 01:19:11.705520 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 790/1617] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:11 2022] GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597 => generated 1542 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:11.713750 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6209abb0-7ece-4a7f-8a4b-8b879b15aed8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:11.716096 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6209abb0-7ece-4a7f-8a4b-8b879b15aed8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0ec8b27d-8af5-45d7-892b-09297e5cb2d8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:11.730896 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6209abb0-7ece-4a7f-8a4b-8b879b15aed8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:11.733603 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6209abb0-7ece-4a7f-8a4b-8b879b15aed8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:11.734125 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6209abb0-7ece-4a7f-8a4b-8b879b15aed8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:11.734889 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6209abb0-7ece-4a7f-8a4b-8b879b15aed8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:11.735549 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6209abb0-7ece-4a7f-8a4b-8b879b15aed8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:11.736142 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6209abb0-7ece-4a7f-8a4b-8b879b15aed8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:12.456307 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-dbfb736c-847d-4a0e-b5ad-1b9b0735707e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:12.465958 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-dbfb736c-847d-4a0e-b5ad-1b9b0735707e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/d19d848f-99bc-4f10-b837-d66aaa5258a6" status: 200 len: 1471 microversion: 2.1 time: 1.268120 Oct 30 01:19:12.470471 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 828/1618] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:11 2022] GET /compute/v2.1/servers/d19d848f-99bc-4f10-b837-d66aaa5258a6 => generated 1471 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:12.497781 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-39c92824-fc02-452d-9d5b-94a6819e660c req-e36f95e7-8bad-4ddc-96e3-e79a2df0e6d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03d9aff4-215d-48fa-b741-2257b62fc597", "tag": "f852959f-05e2-49d9-95ba-a62b3b029d75"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:19:12.508450 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-39c92824-fc02-452d-9d5b-94a6819e660c req-e36f95e7-8bad-4ddc-96e3-e79a2df0e6d9 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:12.510381 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-39c92824-fc02-452d-9d5b-94a6819e660c req-e36f95e7-8bad-4ddc-96e3-e79a2df0e6d9 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:12.511038 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-39c92824-fc02-452d-9d5b-94a6819e660c req-e36f95e7-8bad-4ddc-96e3-e79a2df0e6d9 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:12.544429 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-39c92824-fc02-452d-9d5b-94a6819e660c req-e36f95e7-8bad-4ddc-96e3-e79a2df0e6d9 service nova] Creating event network-changed:f852959f-05e2-49d9-95ba-a62b3b029d75 for instance 03d9aff4-215d-48fa-b741-2257b62fc597 on n-h2-master-1 Oct 30 01:19:12.561805 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [req-39c92824-fc02-452d-9d5b-94a6819e660c req-e36f95e7-8bad-4ddc-96e3-e79a2df0e6d9 service nova] Instance 03d9aff4-215d-48fa-b741-2257b62fc597 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=121102) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 30 01:19:12.597298 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-39c92824-fc02-452d-9d5b-94a6819e660c req-e36f95e7-8bad-4ddc-96e3-e79a2df0e6d9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119571 Oct 30 01:19:12.598161 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 829/1619] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:19:12.612922 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2a8c9900-f3f1-4ae8-a176-ea2c328ddbed tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:12.614042 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2a8c9900-f3f1-4ae8-a176-ea2c328ddbed tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: c74142c0-5f39-44d8-b754-9c9ee956850a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:12.630667 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a8c9900-f3f1-4ae8-a176-ea2c328ddbed tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:12.632885 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a8c9900-f3f1-4ae8-a176-ea2c328ddbed tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:12.633709 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a8c9900-f3f1-4ae8-a176-ea2c328ddbed tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:12.644150 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6209abb0-7ece-4a7f-8a4b-8b879b15aed8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:12.644720 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a8c9900-f3f1-4ae8-a176-ea2c328ddbed tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:12.644720 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a8c9900-f3f1-4ae8-a176-ea2c328ddbed tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:12.645089 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a8c9900-f3f1-4ae8-a176-ea2c328ddbed tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:12.670148 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6209abb0-7ece-4a7f-8a4b-8b879b15aed8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8" status: 200 len: 1211 microversion: 2.1 time: 0.963067 Oct 30 01:19:12.674658 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 791/1620] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:11 2022] GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8 => generated 1211 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:12.679928 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-ad01fea6-9c78-4b08-90f7-418c168e03ed req-0150cc8f-c661-4849-91d2-65b4dc7b26b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d19d848f-99bc-4f10-b837-d66aaa5258a6", "name": "network-vif-deleted", "tag": "ae765166-b140-4959-be8f-cb89a2eec37b"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:19:12.715943 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ad01fea6-9c78-4b08-90f7-418c168e03ed req-0150cc8f-c661-4849-91d2-65b4dc7b26b5 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:12.727254 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ad01fea6-9c78-4b08-90f7-418c168e03ed req-0150cc8f-c661-4849-91d2-65b4dc7b26b5 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:12.728307 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ad01fea6-9c78-4b08-90f7-418c168e03ed req-0150cc8f-c661-4849-91d2-65b4dc7b26b5 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:12.779017 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-ad01fea6-9c78-4b08-90f7-418c168e03ed req-0150cc8f-c661-4849-91d2-65b4dc7b26b5 service nova] Creating event network-vif-deleted:ae765166-b140-4959-be8f-cb89a2eec37b for instance d19d848f-99bc-4f10-b837-d66aaa5258a6 on n-h1-master-1 Oct 30 01:19:12.791051 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-ad01fea6-9c78-4b08-90f7-418c168e03ed req-0150cc8f-c661-4849-91d2-65b4dc7b26b5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114026 Oct 30 01:19:12.792431 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 792/1621] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:19:12.817800 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-74c588be-8f06-4862-958e-2782add5e9be tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:12.822625 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-74c588be-8f06-4862-958e-2782add5e9be tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 03d9aff4-215d-48fa-b741-2257b62fc597] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:12.880249 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-74c588be-8f06-4862-958e-2782add5e9be tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:12.894234 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-74c588be-8f06-4862-958e-2782add5e9be tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:12.895022 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-74c588be-8f06-4862-958e-2782add5e9be tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:12.900867 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-74c588be-8f06-4862-958e-2782add5e9be tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:12.908612 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-74c588be-8f06-4862-958e-2782add5e9be tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:12.912832 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-74c588be-8f06-4862-958e-2782add5e9be tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:13.553260 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2a8c9900-f3f1-4ae8-a176-ea2c328ddbed tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:13.553260 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2a8c9900-f3f1-4ae8-a176-ea2c328ddbed tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a" status: 200 len: 1520 microversion: 2.1 time: 0.924748 Oct 30 01:19:13.553260 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 830/1622] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:12 2022] GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a => generated 1520 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:13.553260 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-69451e2d-8191-4b16-908f-78efd21eb71e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:13.554626 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-69451e2d-8191-4b16-908f-78efd21eb71e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: d19d848f-99bc-4f10-b837-d66aaa5258a6] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:13.579768 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-69451e2d-8191-4b16-908f-78efd21eb71e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:13.581309 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-69451e2d-8191-4b16-908f-78efd21eb71e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:13.583152 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-69451e2d-8191-4b16-908f-78efd21eb71e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:13.583925 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-69451e2d-8191-4b16-908f-78efd21eb71e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:13.584396 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-69451e2d-8191-4b16-908f-78efd21eb71e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:13.584875 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-69451e2d-8191-4b16-908f-78efd21eb71e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:13.704077 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-69451e2d-8191-4b16-908f-78efd21eb71e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:13.704599 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-69451e2d-8191-4b16-908f-78efd21eb71e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:13.705048 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-69451e2d-8191-4b16-908f-78efd21eb71e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:13.706098 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-69451e2d-8191-4b16-908f-78efd21eb71e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lazy-loading 'fault' on Instance uuid d19d848f-99bc-4f10-b837-d66aaa5258a6 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:19:13.772343 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-74c588be-8f06-4862-958e-2782add5e9be tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:13.799158 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-74c588be-8f06-4862-958e-2782add5e9be tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597" status: 200 len: 1542 microversion: 2.1 time: 1.000997 Oct 30 01:19:13.805523 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 793/1623] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:12 2022] GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597 => generated 1542 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:13.820030 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-19721563-3579-43d0-8ed4-457eb26b1520 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:13.823025 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-19721563-3579-43d0-8ed4-457eb26b1520 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: c74142c0-5f39-44d8-b754-9c9ee956850a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:13.828941 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:13.829092 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-69451e2d-8191-4b16-908f-78efd21eb71e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c536d41a93ad4337909fe2e2cb949e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:13.842067 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-69451e2d-8191-4b16-908f-78efd21eb71e tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/d19d848f-99bc-4f10-b837-d66aaa5258a6" status: 200 len: 1306 microversion: 2.1 time: 0.315545 Oct 30 01:19:13.844527 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 831/1624] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:13 2022] GET /compute/v2.1/servers/d19d848f-99bc-4f10-b837-d66aaa5258a6 => generated 1306 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:13.848655 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-19721563-3579-43d0-8ed4-457eb26b1520 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:13.849842 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-19721563-3579-43d0-8ed4-457eb26b1520 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:13.852145 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-19721563-3579-43d0-8ed4-457eb26b1520 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:13.856163 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9c16738f-55d4-4b1a-b381-1b5345b9dfd5 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:13.857288 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-19721563-3579-43d0-8ed4-457eb26b1520 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:13.857965 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-19721563-3579-43d0-8ed4-457eb26b1520 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:13.859580 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9c16738f-55d4-4b1a-b381-1b5345b9dfd5 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0ec8b27d-8af5-45d7-892b-09297e5cb2d8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:13.866811 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-19721563-3579-43d0-8ed4-457eb26b1520 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:13.883934 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9c16738f-55d4-4b1a-b381-1b5345b9dfd5 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:13.896207 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9c16738f-55d4-4b1a-b381-1b5345b9dfd5 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:13.897904 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9c16738f-55d4-4b1a-b381-1b5345b9dfd5 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:13.898914 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9c16738f-55d4-4b1a-b381-1b5345b9dfd5 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:13.899396 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9c16738f-55d4-4b1a-b381-1b5345b9dfd5 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:13.899813 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9c16738f-55d4-4b1a-b381-1b5345b9dfd5 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:14.653292 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-19721563-3579-43d0-8ed4-457eb26b1520 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:14.668885 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-19721563-3579-43d0-8ed4-457eb26b1520 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a" status: 200 len: 1520 microversion: 2.1 time: 0.862209 Oct 30 01:19:14.669896 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 794/1625] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:13 2022] GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a => generated 1520 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:14.670651 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9c16738f-55d4-4b1a-b381-1b5345b9dfd5 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:14.687900 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9c16738f-55d4-4b1a-b381-1b5345b9dfd5 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8" status: 200 len: 1211 microversion: 2.1 time: 0.841708 Oct 30 01:19:14.693044 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 832/1626] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:13 2022] GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8 => generated 1211 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:14.712440 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-90ca58a7-1e1f-4e51-9d69-0f9e75e659d6 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1341293827", "metadata": {"": ""}}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:19:14.718320 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-90ca58a7-1e1f-4e51-9d69-0f9e75e659d6 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Request method failure captured: Oct 30 01:19:14.718320 n-d-master-1 devstack@n-api.service[121103]: request: POST /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a/action HTTP/1.1 Oct 30 01:19:14.718320 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:19:14.718320 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:19:14.718320 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:19:14.718320 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 107 Oct 30 01:19:14.718320 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:19:14.718320 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:19:14.718320 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:19:14.718320 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:19:14.718320 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdD3IhIPYY_sTvEXpI9r1a34kazQy3xsqStabQonrlcEF0HpNl2ztWpirnqs0lietV1LWWVyHjCqAxxd5t3TuUU6o10qW3LK2oIPKGmvwXDy1lrrZEL1UVe632zfYCdkIUu5geJi4tWcEpwgvNOLoS3eMkj37BIJt_45I78bzhHVIS8 Oct 30 01:19:14.718320 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:19:14.718320 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:19:14.718320 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:19:14.718320 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:19:14.718320 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:19:14.718320 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:19:14.718320 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 8c2cd7e4b04741e3bb1cb9852612db57 Oct 30 01:19:14.718320 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1966575233 Oct 30 01:19:14.718320 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:19:14.718320 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:19:14.719884 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c2cd7e4b04741e3bb1cb9852612db57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8c2cd7e4b04741e3bb1cb9852612db57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8c2cd7e4b04741e3bb1cb9852612db57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c2cd7e4b04741e3bb1cb9852612db57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:19:14.719884 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1966575233 Oct 30 01:19:14.719884 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 8c2cd7e4b04741e3bb1cb9852612db57 Oct 30 01:19:14.719884 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1966575233 Oct 30 01:19:14.719884 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ImagesOneServerNegativeTestJSON-1966575233-project Oct 30 01:19:14.719884 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:19:14.719884 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:19:14.719884 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: c114d44d0a314c75902da53fca797f62 Oct 30 01:19:14.719884 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1966575233-project Oct 30 01:19:14.719884 n-d-master-1 devstack@n-api.service[121103]: Oct 30 01:19:14.719884 n-d-master-1 devstack@n-api.service[121103]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1341293827", "metadata": {"": ""}}} Oct 30 01:19:14.719884 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:19:14.720882 n-d-master-1 devstack@n-api.service[121103]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 30 01:19:14.720882 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'c74142c0-5f39-44d8-b754-9c9ee956850a', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1341293827', 'metadata': {'': ''}}}} Oct 30 01:19:14.720882 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:19:14.720882 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:19:14.720882 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 30 01:19:14.720882 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 30 01:19:14.720882 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 30 01:19:14.720882 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise error Oct 30 01:19:14.720882 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 30 01:19:14.720882 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:19:14.720882 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 30 01:19:14.720882 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 30 01:19:14.720882 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 30 01:19:14.720882 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 30 01:19:14.720882 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 30 01:19:14.720882 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:19:14.720882 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 30 01:19:14.720882 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi {'': ''} Oct 30 01:19:14.720882 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:19:14.720882 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:19:14.720882 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:19:14.722623 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:19:14.722623 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:19:14.722623 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:19:14.722623 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:19:14.722623 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:19:14.722623 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:19:14.722623 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:19:14.722623 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:19:14.722623 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:19:14.722623 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 30 01:19:14.722623 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 30 01:19:14.722623 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 30 01:19:14.722623 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 30 01:19:14.722623 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 30 01:19:14.722623 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 30 01:19:14.722623 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 30 01:19:14.722623 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:19:14.722623 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:19:14.722623 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:19:14.722623 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:19:14.724271 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:19:14.724271 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:19:14.724271 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 30 01:19:14.724271 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 30 01:19:14.724271 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 30 01:19:14.724271 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:19:14.726200 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-90ca58a7-1e1f-4e51-9d69-0f9e75e659d6 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:19:14.727231 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-90ca58a7-1e1f-4e51-9d69-0f9e75e659d6 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "POST /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a/action" status: 400 len: 170 microversion: 2.1 time: 0.020613 Oct 30 01:19:14.729039 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 795/1627] 10.222.0.13 () {60 vars in 1279 bytes} [Sun Oct 30 01:19:14 2022] POST /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a/action => generated 170 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:19:14.737489 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3a6ae135-704c-4046-a6e7-b76b90f4160b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:14.738434 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3a6ae135-704c-4046-a6e7-b76b90f4160b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: c74142c0-5f39-44d8-b754-9c9ee956850a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:14.745798 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a6ae135-704c-4046-a6e7-b76b90f4160b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:14.746641 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a6ae135-704c-4046-a6e7-b76b90f4160b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:14.747287 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a6ae135-704c-4046-a6e7-b76b90f4160b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:14.748168 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a6ae135-704c-4046-a6e7-b76b90f4160b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:14.748772 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a6ae135-704c-4046-a6e7-b76b90f4160b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:14.749423 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a6ae135-704c-4046-a6e7-b76b90f4160b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:14.825355 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6eea1f1f-7a26-4a89-96af-a221cdd2ccb7 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:14.827368 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6eea1f1f-7a26-4a89-96af-a221cdd2ccb7 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 03d9aff4-215d-48fa-b741-2257b62fc597] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:14.843290 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6eea1f1f-7a26-4a89-96af-a221cdd2ccb7 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:14.843808 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6eea1f1f-7a26-4a89-96af-a221cdd2ccb7 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:14.844265 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6eea1f1f-7a26-4a89-96af-a221cdd2ccb7 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:14.847334 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6eea1f1f-7a26-4a89-96af-a221cdd2ccb7 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:14.849125 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6eea1f1f-7a26-4a89-96af-a221cdd2ccb7 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:14.849812 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6eea1f1f-7a26-4a89-96af-a221cdd2ccb7 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:15.186510 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3a6ae135-704c-4046-a6e7-b76b90f4160b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:15.197817 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3a6ae135-704c-4046-a6e7-b76b90f4160b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a" status: 200 len: 1520 microversion: 2.1 time: 0.464224 Oct 30 01:19:15.201071 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 833/1628] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:14 2022] GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a => generated 1520 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:15.211183 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9b5bcc17-ab9b-44cd-839f-96718a2dba88 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:15.213163 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9b5bcc17-ab9b-44cd-839f-96718a2dba88 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] [instance: d19d848f-99bc-4f10-b837-d66aaa5258a6] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:15.224659 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b5bcc17-ab9b-44cd-839f-96718a2dba88 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:15.229947 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b5bcc17-ab9b-44cd-839f-96718a2dba88 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:15.231922 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b5bcc17-ab9b-44cd-839f-96718a2dba88 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:15.232828 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b5bcc17-ab9b-44cd-839f-96718a2dba88 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:15.233240 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b5bcc17-ab9b-44cd-839f-96718a2dba88 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:15.237622 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b5bcc17-ab9b-44cd-839f-96718a2dba88 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:15.261666 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-9b5bcc17-ab9b-44cd-839f-96718a2dba88 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] HTTP exception thrown: Instance d19d848f-99bc-4f10-b837-d66aaa5258a6 could not be found. Oct 30 01:19:15.263699 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9b5bcc17-ab9b-44cd-839f-96718a2dba88 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Request method failure captured: Oct 30 01:19:15.263699 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/d19d848f-99bc-4f10-b837-d66aaa5258a6 HTTP/1.1 Oct 30 01:19:15.263699 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:19:15.263699 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:19:15.263699 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:19:15.263699 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:19:15.263699 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:19:15.263699 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:19:15.263699 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:19:15.263699 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:19:15.263699 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdAyWG8ULueMlzGM_sHwJ9SOWADIPTb7By9fNsRcbHROHwygMRdk9IkmaCTF8DGTaB-qJmpNM38UnmXLKL5MROOCKmetoapYOI7trRPWkBfioCQrOG4AuSuVej_G20QC_MDzAmUbQ-QTCr2g6dCwwHCik9ACvFc8hu-sRLY-wv25V6Q Oct 30 01:19:15.263699 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:19:15.263699 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:19:15.263699 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:19:15.263699 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:19:15.263699 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:19:15.263699 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:19:15.263699 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 76b6f7b705f5428b9a3a3a8c4f86ff48 Oct 30 01:19:15.263699 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServersOnMultiNodesTest-1214334609 Oct 30 01:19:15.263699 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:19:15.263699 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:19:15.265116 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/76b6f7b705f5428b9a3a3a8c4f86ff48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_76b6f7b705f5428b9a3a3a8c4f86ff48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/76b6f7b705f5428b9a3a3a8c4f86ff48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/76b6f7b705f5428b9a3a3a8c4f86ff48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:19:15.265116 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServersOnMultiNodesTest-1214334609 Oct 30 01:19:15.265116 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 76b6f7b705f5428b9a3a3a8c4f86ff48 Oct 30 01:19:15.265116 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1214334609 Oct 30 01:19:15.265116 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServersOnMultiNodesTest-1214334609-project Oct 30 01:19:15.265116 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:19:15.265116 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:19:15.265116 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: c536d41a93ad4337909fe2e2cb949e03 Oct 30 01:19:15.265116 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServersOnMultiNodesTest-1214334609-project Oct 30 01:19:15.265116 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:19:15.265116 n-d-master-1 devstack@n-api.service[121102]: exception: Instance d19d848f-99bc-4f10-b837-d66aaa5258a6 could not be found. Oct 30 01:19:15.265116 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'd19d848f-99bc-4f10-b837-d66aaa5258a6'} Oct 30 01:19:15.265976 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:19:15.265976 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:19:15.265976 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:19:15.265976 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:19:15.265976 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:19:15.265976 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:19:15.265976 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:19:15.265976 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:19:15.265976 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:19:15.265976 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:19:15.265976 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d19d848f-99bc-4f10-b837-d66aaa5258a6 could not be found. Oct 30 01:19:15.265976 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:19:15.265976 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:19:15.265976 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:19:15.265976 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:19:15.265976 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:19:15.265976 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:19:15.265976 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:19:15.265976 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:19:15.265976 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:19:15.267267 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:19:15.267267 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:19:15.267267 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:19:15.267267 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:19:15.267267 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:19:15.267267 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:19:15.267267 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:19:15.267267 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d19d848f-99bc-4f10-b837-d66aaa5258a6 could not be found. Oct 30 01:19:15.267267 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:19:15.267267 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:19:15.267267 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:19:15.267267 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:19:15.267267 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:19:15.267267 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:19:15.267267 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:19:15.267267 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:19:15.267267 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d19d848f-99bc-4f10-b837-d66aaa5258a6 could not be found. Oct 30 01:19:15.267267 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:19:15.270563 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9b5bcc17-ab9b-44cd-839f-96718a2dba88 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] Returning 404 to user: Instance d19d848f-99bc-4f10-b837-d66aaa5258a6 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:19:15.271698 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9b5bcc17-ab9b-44cd-839f-96718a2dba88 tempest-ServersOnMultiNodesTest-1214334609 tempest-ServersOnMultiNodesTest-1214334609-project] 10.222.0.13 "GET /compute/v2.1/servers/d19d848f-99bc-4f10-b837-d66aaa5258a6" status: 404 len: 111 microversion: 2.1 time: 0.068134 Oct 30 01:19:15.273576 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 834/1629] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:15 2022] GET /compute/v2.1/servers/d19d848f-99bc-4f10-b837-d66aaa5258a6 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:19:15.280507 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ed1a93ae-e113-4777-9d7d-968fd24181e6 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:15.281472 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ed1a93ae-e113-4777-9d7d-968fd24181e6 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: c74142c0-5f39-44d8-b754-9c9ee956850a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:15.288834 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed1a93ae-e113-4777-9d7d-968fd24181e6 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:15.289803 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed1a93ae-e113-4777-9d7d-968fd24181e6 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:15.290492 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed1a93ae-e113-4777-9d7d-968fd24181e6 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:15.293693 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed1a93ae-e113-4777-9d7d-968fd24181e6 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:15.293693 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed1a93ae-e113-4777-9d7d-968fd24181e6 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:15.293693 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed1a93ae-e113-4777-9d7d-968fd24181e6 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:15.742056 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6eea1f1f-7a26-4a89-96af-a221cdd2ccb7 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:15.762151 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6eea1f1f-7a26-4a89-96af-a221cdd2ccb7 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597" status: 200 len: 1474 microversion: 2.1 time: 0.941582 Oct 30 01:19:15.766477 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 796/1630] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:14 2022] GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597 => generated 1474 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:15.779820 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-dfbf0da7-40b4-4f9b-ad3f-c91f5e58e5e9 tempest-VolumesAdminNegativeTest-130726783 tempest-VolumesAdminNegativeTest-130726783-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "8ba87c67-15a5-404b-b624-4d7ec903ad82"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:19:15.787733 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-dfbf0da7-40b4-4f9b-ad3f-c91f5e58e5e9 tempest-VolumesAdminNegativeTest-130726783 tempest-VolumesAdminNegativeTest-130726783-project-admin] [instance: 0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:15.799217 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dfbf0da7-40b4-4f9b-ad3f-c91f5e58e5e9 tempest-VolumesAdminNegativeTest-130726783 tempest-VolumesAdminNegativeTest-130726783-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:15.799791 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dfbf0da7-40b4-4f9b-ad3f-c91f5e58e5e9 tempest-VolumesAdminNegativeTest-130726783 tempest-VolumesAdminNegativeTest-130726783-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:15.800598 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dfbf0da7-40b4-4f9b-ad3f-c91f5e58e5e9 tempest-VolumesAdminNegativeTest-130726783 tempest-VolumesAdminNegativeTest-130726783-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:15.801589 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dfbf0da7-40b4-4f9b-ad3f-c91f5e58e5e9 tempest-VolumesAdminNegativeTest-130726783 tempest-VolumesAdminNegativeTest-130726783-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:15.802242 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dfbf0da7-40b4-4f9b-ad3f-c91f5e58e5e9 tempest-VolumesAdminNegativeTest-130726783 tempest-VolumesAdminNegativeTest-130726783-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:15.802892 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dfbf0da7-40b4-4f9b-ad3f-c91f5e58e5e9 tempest-VolumesAdminNegativeTest-130726783 tempest-VolumesAdminNegativeTest-130726783-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:15.893839 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-dfbf0da7-40b4-4f9b-ad3f-c91f5e58e5e9 tempest-VolumesAdminNegativeTest-130726783 tempest-VolumesAdminNegativeTest-130726783-project-admin] HTTP exception thrown: Volume 5ad9c7d3-ac62-4af6-b464-ce31f97f4880 could not be found. Oct 30 01:19:15.897374 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-dfbf0da7-40b4-4f9b-ad3f-c91f5e58e5e9 tempest-VolumesAdminNegativeTest-130726783 tempest-VolumesAdminNegativeTest-130726783-project-admin] Request method failure captured: Oct 30 01:19:15.897374 n-d-master-1 devstack@n-api.service[121103]: request: PUT /compute/v2.1/servers/0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23/os-volume_attachments/5ad9c7d3-ac62-4af6-b464-ce31f97f4880 HTTP/1.1 Oct 30 01:19:15.897374 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:19:15.897374 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:19:15.897374 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:19:15.897374 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 74 Oct 30 01:19:15.897374 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:19:15.897374 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:19:15.897374 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:19:15.897374 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:19:15.897374 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdB0QEwkQzHxTzNXXzAJZOHuMZNAVkQQKprzSxwZPPiYWTxx7NfBIQ4rk_TV2spNqANZJ90nZTDd0_jdD1XVTCGKCO5Qj80xuzI-yoJ7z3se6gI2H5RPOf9snoAQ2_jJP974xAXICqoGDPORZm8wRoi0RuLtjzz9skv8flER0fBko1c Oct 30 01:19:15.897374 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:19:15.897374 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:19:15.897374 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:19:15.897374 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:19:15.897374 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:19:15.897374 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:19:15.897374 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 2556fe0c4670451aade5425cf399f4d0 Oct 30 01:19:15.897374 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-VolumesAdminNegativeTest-130726783 Oct 30 01:19:15.897374 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,admin,reader Oct 30 01:19:15.897374 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,admin,reader Oct 30 01:19:15.898897 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2556fe0c4670451aade5425cf399f4d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2556fe0c4670451aade5425cf399f4d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2556fe0c4670451aade5425cf399f4d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2556fe0c4670451aade5425cf399f4d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:19:15.898897 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-VolumesAdminNegativeTest-130726783 Oct 30 01:19:15.898897 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 2556fe0c4670451aade5425cf399f4d0 Oct 30 01:19:15.898897 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-130726783 Oct 30 01:19:15.898897 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-VolumesAdminNegativeTest-130726783-project-admin Oct 30 01:19:15.898897 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:19:15.898897 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:19:15.898897 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 5b99e0cac1eb48818c5b58a0c9cd8d63 Oct 30 01:19:15.898897 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-VolumesAdminNegativeTest-130726783-project-admin Oct 30 01:19:15.898897 n-d-master-1 devstack@n-api.service[121103]: Oct 30 01:19:15.898897 n-d-master-1 devstack@n-api.service[121103]: {"volumeAttachment": {"volumeId": "8ba87c67-15a5-404b-b624-4d7ec903ad82"}} Oct 30 01:19:15.898897 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:19:15.898897 n-d-master-1 devstack@n-api.service[121103]: exception: Volume 5ad9c7d3-ac62-4af6-b464-ce31f97f4880 could not be found. Oct 30 01:19:15.899736 n-d-master-1 devstack@n-api.service[121103]: action_args: {'server_id': '0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23', 'id': '5ad9c7d3-ac62-4af6-b464-ce31f97f4880', 'body': {'volumeAttachment': {'volumeId': '8ba87c67-15a5-404b-b624-4d7ec903ad82'}}} Oct 30 01:19:15.899736 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:19:15.899736 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:19:15.899736 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 30 01:19:15.899736 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 30 01:19:15.899736 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 30 01:19:15.899736 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 30 01:19:15.899736 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 30 01:19:15.899736 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 30 01:19:15.899736 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 30 01:19:15.899736 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 30 01:19:15.899736 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 30 01:19:15.899736 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 30 01:19:15.899736 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 30 01:19:15.899736 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 30 01:19:15.899736 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 30 01:19:15.899736 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 30 01:19:15.901489 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5ad9c7d3-ac62-4af6-b464-ce31f97f4880 could not be found. (HTTP 404) (Request-ID: req-faa33e8d-5d9b-4d36-897c-e7b32fca390a) Oct 30 01:19:15.901489 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:19:15.901489 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:19:15.901489 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:19:15.901489 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:19:15.901489 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 30 01:19:15.901489 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 30 01:19:15.901489 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 30 01:19:15.901489 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 30 01:19:15.901489 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 30 01:19:15.901489 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 30 01:19:15.901489 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 30 01:19:15.901489 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 30 01:19:15.901489 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 30 01:19:15.901489 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 30 01:19:15.901489 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 30 01:19:15.901489 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 30 01:19:15.901489 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 30 01:19:15.901489 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 30 01:19:15.904302 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 30 01:19:15.904302 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 30 01:19:15.904302 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 30 01:19:15.904302 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 30 01:19:15.904302 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 30 01:19:15.904302 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 30 01:19:15.904302 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 30 01:19:15.904302 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 30 01:19:15.904302 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5ad9c7d3-ac62-4af6-b464-ce31f97f4880 could not be found. Oct 30 01:19:15.904302 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:19:15.904302 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:19:15.904302 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:19:15.904302 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:19:15.904302 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:19:15.904302 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:19:15.904302 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:19:15.904302 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:19:15.904302 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:19:15.904302 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:19:15.907905 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:19:15.907905 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:19:15.907905 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:19:15.907905 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:19:15.907905 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 30 01:19:15.907905 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 30 01:19:15.907905 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 30 01:19:15.907905 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:19:15.907905 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5ad9c7d3-ac62-4af6-b464-ce31f97f4880 could not be found. Oct 30 01:19:15.907905 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:19:15.907905 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:19:15.907905 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:19:15.907905 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:19:15.907905 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:19:15.907905 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:19:15.907905 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:19:15.907905 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:19:15.907905 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5ad9c7d3-ac62-4af6-b464-ce31f97f4880 could not be found. Oct 30 01:19:15.907905 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:19:15.915483 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-dfbf0da7-40b4-4f9b-ad3f-c91f5e58e5e9 tempest-VolumesAdminNegativeTest-130726783 tempest-VolumesAdminNegativeTest-130726783-project-admin] Returning 404 to user: Volume 5ad9c7d3-ac62-4af6-b464-ce31f97f4880 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:19:15.915483 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-dfbf0da7-40b4-4f9b-ad3f-c91f5e58e5e9 tempest-VolumesAdminNegativeTest-130726783 tempest-VolumesAdminNegativeTest-130726783-project-admin] 10.222.0.13 "PUT /compute/v2.1/servers/0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23/os-volume_attachments/5ad9c7d3-ac62-4af6-b464-ce31f97f4880" status: 404 len: 109 microversion: 2.1 time: 0.144982 Oct 30 01:19:15.915483 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 797/1631] 10.222.0.13 () {60 vars in 1433 bytes} [Sun Oct 30 01:19:15 2022] PUT /compute/v2.1/servers/0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23/os-volume_attachments/5ad9c7d3-ac62-4af6-b464-ce31f97f4880 => generated 109 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:19:15.921708 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-39afd306-8b2c-4734-8ea8-95afa194f8e8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:15.923877 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-39afd306-8b2c-4734-8ea8-95afa194f8e8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0ec8b27d-8af5-45d7-892b-09297e5cb2d8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:15.938038 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-39afd306-8b2c-4734-8ea8-95afa194f8e8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:15.939372 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-39afd306-8b2c-4734-8ea8-95afa194f8e8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:15.941900 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-39afd306-8b2c-4734-8ea8-95afa194f8e8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:15.950389 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-39afd306-8b2c-4734-8ea8-95afa194f8e8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:15.950389 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-39afd306-8b2c-4734-8ea8-95afa194f8e8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:15.950389 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-39afd306-8b2c-4734-8ea8-95afa194f8e8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:16.070393 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ed1a93ae-e113-4777-9d7d-968fd24181e6 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:16.083536 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ed1a93ae-e113-4777-9d7d-968fd24181e6 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a" status: 200 len: 1520 microversion: 2.1 time: 0.807539 Oct 30 01:19:16.086247 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 835/1632] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:15 2022] GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a => generated 1520 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:16.110814 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0913b985-332e-4e1a-b88c-239cc2b11e85 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-852654202", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:19:16.121198 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0913b985-332e-4e1a-b88c-239cc2b11e85 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Request method failure captured: Oct 30 01:19:16.121198 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a/action HTTP/1.1 Oct 30 01:19:16.121198 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:19:16.121198 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:19:16.121198 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:19:16.121198 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 618 Oct 30 01:19:16.121198 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:19:16.121198 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:19:16.121198 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:19:16.121198 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:19:16.121198 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdD3IhIPYY_sTvEXpI9r1a34kazQy3xsqStabQonrlcEF0HpNl2ztWpirnqs0lietV1LWWVyHjCqAxxd5t3TuUU6o10qW3LK2oIPKGmvwXDy1lrrZEL1UVe632zfYCdkIUu5geJi4tWcEpwgvNOLoS3eMkj37BIJt_45I78bzhHVIS8 Oct 30 01:19:16.121198 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:19:16.121198 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:19:16.121198 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:19:16.121198 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:19:16.121198 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:19:16.121198 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:19:16.121198 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 8c2cd7e4b04741e3bb1cb9852612db57 Oct 30 01:19:16.121198 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1966575233 Oct 30 01:19:16.121198 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:19:16.121198 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:19:16.122649 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c2cd7e4b04741e3bb1cb9852612db57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8c2cd7e4b04741e3bb1cb9852612db57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8c2cd7e4b04741e3bb1cb9852612db57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c2cd7e4b04741e3bb1cb9852612db57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:19:16.122649 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1966575233 Oct 30 01:19:16.122649 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 8c2cd7e4b04741e3bb1cb9852612db57 Oct 30 01:19:16.122649 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1966575233 Oct 30 01:19:16.122649 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ImagesOneServerNegativeTestJSON-1966575233-project Oct 30 01:19:16.122649 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:19:16.122649 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:19:16.122649 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: c114d44d0a314c75902da53fca797f62 Oct 30 01:19:16.122649 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1966575233-project Oct 30 01:19:16.122649 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:19:16.123433 n-d-master-1 devstack@n-api.service[121102]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-852654202", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 30 01:19:16.123433 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:19:16.123433 n-d-master-1 devstack@n-api.service[121102]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 30 01:19:16.123692 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'c74142c0-5f39-44d8-b754-9c9ee956850a', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-852654202', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 30 01:19:16.123692 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:19:16.123692 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:19:16.123692 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 30 01:19:16.123692 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 30 01:19:16.123692 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 30 01:19:16.123692 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise error Oct 30 01:19:16.123692 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 30 01:19:16.123692 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:19:16.123692 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 30 01:19:16.123692 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 30 01:19:16.124406 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 30 01:19:16.124406 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 30 01:19:16.124406 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 30 01:19:16.124406 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:19:16.124406 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 30 01:19:16.124406 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 30 01:19:16.124406 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:19:16.124406 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:19:16.124406 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:19:16.124406 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:19:16.124406 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:19:16.124406 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:19:16.124406 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:19:16.124406 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:19:16.124406 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:19:16.124406 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:19:16.124406 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:19:16.125523 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:19:16.125523 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 30 01:19:16.125523 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 30 01:19:16.125523 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 30 01:19:16.125523 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 30 01:19:16.125523 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 30 01:19:16.125523 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 30 01:19:16.125523 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 30 01:19:16.125523 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:19:16.125523 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:19:16.125523 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:19:16.125523 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:19:16.126357 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:19:16.126357 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:19:16.126357 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 30 01:19:16.126357 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 30 01:19:16.126357 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 30 01:19:16.126357 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:19:16.132569 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0913b985-332e-4e1a-b88c-239cc2b11e85 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:19:16.136103 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0913b985-332e-4e1a-b88c-239cc2b11e85 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "POST /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a/action" status: 400 len: 938 microversion: 2.1 time: 0.028598 Oct 30 01:19:16.137212 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 836/1633] 10.222.0.13 () {60 vars in 1279 bytes} [Sun Oct 30 01:19:16 2022] POST /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a/action => generated 938 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:19:16.156759 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8a68efb3-8bc7-474f-b7a4-857e5d4b8810 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:16.156759 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8a68efb3-8bc7-474f-b7a4-857e5d4b8810 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: c74142c0-5f39-44d8-b754-9c9ee956850a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:16.171113 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8a68efb3-8bc7-474f-b7a4-857e5d4b8810 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:16.187985 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8a68efb3-8bc7-474f-b7a4-857e5d4b8810 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:16.189995 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8a68efb3-8bc7-474f-b7a4-857e5d4b8810 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:16.192168 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8a68efb3-8bc7-474f-b7a4-857e5d4b8810 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:16.197088 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8a68efb3-8bc7-474f-b7a4-857e5d4b8810 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:16.200428 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8a68efb3-8bc7-474f-b7a4-857e5d4b8810 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:16.395305 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-39afd306-8b2c-4734-8ea8-95afa194f8e8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:16.405020 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-39afd306-8b2c-4734-8ea8-95afa194f8e8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8" status: 200 len: 1199 microversion: 2.1 time: 0.491789 Oct 30 01:19:16.408111 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 798/1634] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:15 2022] GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8 => generated 1199 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:16.639604 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8a68efb3-8bc7-474f-b7a4-857e5d4b8810 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:16.652123 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8a68efb3-8bc7-474f-b7a4-857e5d4b8810 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a" status: 200 len: 1520 microversion: 2.1 time: 0.506351 Oct 30 01:19:16.659219 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 837/1635] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:16 2022] GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a => generated 1520 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:16.707389 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-26824ad5-18da-4cb9-82b9-dc2d8ce6347f tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:16.708848 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-26824ad5-18da-4cb9-82b9-dc2d8ce6347f tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: c74142c0-5f39-44d8-b754-9c9ee956850a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:16.727485 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-26824ad5-18da-4cb9-82b9-dc2d8ce6347f tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:16.728227 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-26824ad5-18da-4cb9-82b9-dc2d8ce6347f tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:16.729957 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-26824ad5-18da-4cb9-82b9-dc2d8ce6347f tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:16.732707 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-26824ad5-18da-4cb9-82b9-dc2d8ce6347f tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:16.733411 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-26824ad5-18da-4cb9-82b9-dc2d8ce6347f tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:16.735304 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-26824ad5-18da-4cb9-82b9-dc2d8ce6347f tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:16.794637 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6b2c20cf-df1d-48f2-ac53-1c1a045eb7ef tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:16.795239 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6b2c20cf-df1d-48f2-ac53-1c1a045eb7ef tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 03d9aff4-215d-48fa-b741-2257b62fc597] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:16.808399 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b2c20cf-df1d-48f2-ac53-1c1a045eb7ef tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:16.810866 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b2c20cf-df1d-48f2-ac53-1c1a045eb7ef tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:16.815718 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b2c20cf-df1d-48f2-ac53-1c1a045eb7ef tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:16.815718 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b2c20cf-df1d-48f2-ac53-1c1a045eb7ef tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:16.815718 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b2c20cf-df1d-48f2-ac53-1c1a045eb7ef tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:16.815718 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b2c20cf-df1d-48f2-ac53-1c1a045eb7ef tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:17.174999 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-26824ad5-18da-4cb9-82b9-dc2d8ce6347f tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:17.212248 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-26824ad5-18da-4cb9-82b9-dc2d8ce6347f tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a" status: 200 len: 1520 microversion: 2.1 time: 0.526092 Oct 30 01:19:17.214651 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 799/1636] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:16 2022] GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a => generated 1520 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:17.235744 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-17f4d844-319c-4b28-b89c-4eb7ece46692 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:19:17.240503 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-17f4d844-319c-4b28-b89c-4eb7ece46692 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Request method failure captured: Oct 30 01:19:17.240503 n-d-master-1 devstack@n-api.service[121103]: request: POST /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a/action HTTP/1.1 Oct 30 01:19:17.240503 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:19:17.240503 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:19:17.240503 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:19:17.240503 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 285 Oct 30 01:19:17.240503 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:19:17.240503 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:19:17.240503 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:19:17.240503 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:19:17.240503 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdD3IhIPYY_sTvEXpI9r1a34kazQy3xsqStabQonrlcEF0HpNl2ztWpirnqs0lietV1LWWVyHjCqAxxd5t3TuUU6o10qW3LK2oIPKGmvwXDy1lrrZEL1UVe632zfYCdkIUu5geJi4tWcEpwgvNOLoS3eMkj37BIJt_45I78bzhHVIS8 Oct 30 01:19:17.240503 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:19:17.240503 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:19:17.240503 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:19:17.240503 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:19:17.240503 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:19:17.240503 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:19:17.240503 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 8c2cd7e4b04741e3bb1cb9852612db57 Oct 30 01:19:17.240503 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1966575233 Oct 30 01:19:17.240503 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:19:17.240503 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:19:17.242826 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c2cd7e4b04741e3bb1cb9852612db57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8c2cd7e4b04741e3bb1cb9852612db57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8c2cd7e4b04741e3bb1cb9852612db57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c2cd7e4b04741e3bb1cb9852612db57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:19:17.242826 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1966575233 Oct 30 01:19:17.242826 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 8c2cd7e4b04741e3bb1cb9852612db57 Oct 30 01:19:17.242826 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1966575233 Oct 30 01:19:17.242826 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ImagesOneServerNegativeTestJSON-1966575233-project Oct 30 01:19:17.242826 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:19:17.242826 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:19:17.242826 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: c114d44d0a314c75902da53fca797f62 Oct 30 01:19:17.242826 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1966575233-project Oct 30 01:19:17.242826 n-d-master-1 devstack@n-api.service[121103]: Oct 30 01:19:17.242826 n-d-master-1 devstack@n-api.service[121103]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 30 01:19:17.243680 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:19:17.243680 n-d-master-1 devstack@n-api.service[121103]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 30 01:19:17.243680 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'c74142c0-5f39-44d8-b754-9c9ee956850a', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 30 01:19:17.243680 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:19:17.243680 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:19:17.243680 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 30 01:19:17.243680 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 30 01:19:17.243680 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 30 01:19:17.243680 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise error Oct 30 01:19:17.243680 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 30 01:19:17.244478 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:19:17.244478 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 30 01:19:17.244478 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 30 01:19:17.244478 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:19:17.244478 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 30 01:19:17.244478 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 30 01:19:17.244478 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:19:17.244478 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:19:17.244478 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:19:17.244478 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:19:17.244478 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:19:17.244478 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:19:17.244478 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:19:17.244478 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:19:17.244478 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:19:17.244478 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:19:17.244478 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:19:17.244478 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:19:17.244478 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 30 01:19:17.244478 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 30 01:19:17.248309 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 30 01:19:17.248309 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 30 01:19:17.248309 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 30 01:19:17.248309 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 30 01:19:17.248309 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 30 01:19:17.248309 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:19:17.248309 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:19:17.248309 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:19:17.248309 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:19:17.248309 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:19:17.248309 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:19:17.248309 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 30 01:19:17.248309 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 30 01:19:17.250111 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 30 01:19:17.250111 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:19:17.252884 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-17f4d844-319c-4b28-b89c-4eb7ece46692 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:19:17.252884 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-17f4d844-319c-4b28-b89c-4eb7ece46692 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "POST /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a/action" status: 400 len: 619 microversion: 2.1 time: 0.021435 Oct 30 01:19:17.258635 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 800/1637] 10.222.0.13 () {60 vars in 1279 bytes} [Sun Oct 30 01:19:17 2022] POST /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a/action => generated 619 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 30 01:19:17.270526 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-621768b1-8f18-4640-8492-91efd18bef36 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:17.271294 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-621768b1-8f18-4640-8492-91efd18bef36 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: c74142c0-5f39-44d8-b754-9c9ee956850a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:17.285421 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-621768b1-8f18-4640-8492-91efd18bef36 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:17.285930 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-621768b1-8f18-4640-8492-91efd18bef36 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:17.287957 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-621768b1-8f18-4640-8492-91efd18bef36 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:17.290314 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6b2c20cf-df1d-48f2-ac53-1c1a045eb7ef tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:17.292681 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-621768b1-8f18-4640-8492-91efd18bef36 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:17.293348 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-621768b1-8f18-4640-8492-91efd18bef36 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:17.293929 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-621768b1-8f18-4640-8492-91efd18bef36 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:17.314032 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6b2c20cf-df1d-48f2-ac53-1c1a045eb7ef tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597" status: 200 len: 1474 microversion: 2.1 time: 0.524927 Oct 30 01:19:17.328252 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 838/1638] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:16 2022] GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597 => generated 1474 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:17.446210 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7ba0e4b6-0c72-44a3-aded-7a1836c28a74 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:17.447852 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7ba0e4b6-0c72-44a3-aded-7a1836c28a74 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0ec8b27d-8af5-45d7-892b-09297e5cb2d8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:17.455567 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7ba0e4b6-0c72-44a3-aded-7a1836c28a74 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:17.457754 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7ba0e4b6-0c72-44a3-aded-7a1836c28a74 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:17.458718 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7ba0e4b6-0c72-44a3-aded-7a1836c28a74 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:17.460065 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7ba0e4b6-0c72-44a3-aded-7a1836c28a74 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:17.460768 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7ba0e4b6-0c72-44a3-aded-7a1836c28a74 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:17.462040 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7ba0e4b6-0c72-44a3-aded-7a1836c28a74 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:17.811652 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-621768b1-8f18-4640-8492-91efd18bef36 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:17.820874 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-621768b1-8f18-4640-8492-91efd18bef36 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a" status: 200 len: 1520 microversion: 2.1 time: 0.560114 Oct 30 01:19:17.822278 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 801/1639] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:17 2022] GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a => generated 1520 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:17.850455 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f6c1ac56-d96b-4be6-b5cc-7aaf48bcdeac tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:17.852385 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f6c1ac56-d96b-4be6-b5cc-7aaf48bcdeac tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: c74142c0-5f39-44d8-b754-9c9ee956850a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:17.880398 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f6c1ac56-d96b-4be6-b5cc-7aaf48bcdeac tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:17.881124 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f6c1ac56-d96b-4be6-b5cc-7aaf48bcdeac tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:17.881929 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f6c1ac56-d96b-4be6-b5cc-7aaf48bcdeac tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:17.885426 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f6c1ac56-d96b-4be6-b5cc-7aaf48bcdeac tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:17.885426 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f6c1ac56-d96b-4be6-b5cc-7aaf48bcdeac tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:17.885426 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f6c1ac56-d96b-4be6-b5cc-7aaf48bcdeac tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:18.183301 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7ba0e4b6-0c72-44a3-aded-7a1836c28a74 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:18.196217 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7ba0e4b6-0c72-44a3-aded-7a1836c28a74 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8" status: 200 len: 1199 microversion: 2.1 time: 0.753944 Oct 30 01:19:18.196217 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 839/1640] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:17 2022] GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8 => generated 1199 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:19:18.344060 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d1c878fe-9b54-4e88-908c-4353f7b9bb7c tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:18.344735 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d1c878fe-9b54-4e88-908c-4353f7b9bb7c tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 03d9aff4-215d-48fa-b741-2257b62fc597] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:18.353990 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1c878fe-9b54-4e88-908c-4353f7b9bb7c tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:18.354481 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1c878fe-9b54-4e88-908c-4353f7b9bb7c tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:18.354912 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1c878fe-9b54-4e88-908c-4353f7b9bb7c tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:18.355657 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1c878fe-9b54-4e88-908c-4353f7b9bb7c tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:18.356105 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1c878fe-9b54-4e88-908c-4353f7b9bb7c tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:18.365761 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1c878fe-9b54-4e88-908c-4353f7b9bb7c tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:18.386059 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f6c1ac56-d96b-4be6-b5cc-7aaf48bcdeac tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:18.406175 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f6c1ac56-d96b-4be6-b5cc-7aaf48bcdeac tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a" status: 200 len: 1520 microversion: 2.1 time: 0.560433 Oct 30 01:19:18.407754 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 802/1641] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:17 2022] GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a => generated 1520 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:18.438884 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c22e7eb9-96ac-4f28-850c-228da79698a9 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1393229546"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:19:18.449813 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c22e7eb9-96ac-4f28-850c-228da79698a9 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: c74142c0-5f39-44d8-b754-9c9ee956850a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:18.479558 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c22e7eb9-96ac-4f28-850c-228da79698a9 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:18.480450 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c22e7eb9-96ac-4f28-850c-228da79698a9 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:18.499675 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c22e7eb9-96ac-4f28-850c-228da79698a9 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:18.500649 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c22e7eb9-96ac-4f28-850c-228da79698a9 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:18.501295 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c22e7eb9-96ac-4f28-850c-228da79698a9 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:18.504183 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c22e7eb9-96ac-4f28-850c-228da79698a9 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:18.631177 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d1c878fe-9b54-4e88-908c-4353f7b9bb7c tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:18.636877 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:18.653426 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d1c878fe-9b54-4e88-908c-4353f7b9bb7c tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597" status: 200 len: 1471 microversion: 2.1 time: 0.309278 Oct 30 01:19:18.661554 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 840/1642] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:18 2022] GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597 => generated 1471 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:18.680900 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-665cabd1-0ec7-40cd-8050-a833a6e2fa36 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:19:18.681463 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-665cabd1-0ec7-40cd-8050-a833a6e2fa36 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 03d9aff4-215d-48fa-b741-2257b62fc597] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:18.718524 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-665cabd1-0ec7-40cd-8050-a833a6e2fa36 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:18.719032 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-665cabd1-0ec7-40cd-8050-a833a6e2fa36 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:18.719471 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-665cabd1-0ec7-40cd-8050-a833a6e2fa36 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:18.720194 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-665cabd1-0ec7-40cd-8050-a833a6e2fa36 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:18.720642 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-665cabd1-0ec7-40cd-8050-a833a6e2fa36 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:18.731425 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-665cabd1-0ec7-40cd-8050-a833a6e2fa36 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:18.922483 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-665cabd1-0ec7-40cd-8050-a833a6e2fa36 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:18.940487 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-665cabd1-0ec7-40cd-8050-a833a6e2fa36 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:18.943565 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-665cabd1-0ec7-40cd-8050-a833a6e2fa36 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:18.944585 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-665cabd1-0ec7-40cd-8050-a833a6e2fa36 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:18.950850 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-665cabd1-0ec7-40cd-8050-a833a6e2fa36 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:18.953425 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-665cabd1-0ec7-40cd-8050-a833a6e2fa36 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:19.065609 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-665cabd1-0ec7-40cd-8050-a833a6e2fa36 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Getting quotas for project ad621909b99143dd9885006238de72a6. Resources: {'ram', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:19:19.104625 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-665cabd1-0ec7-40cd-8050-a833a6e2fa36 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Getting quotas for user 4f1fe6e04e064dfba969b07d4188ab38 and project ad621909b99143dd9885006238de72a6. Resources: {'ram', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:19:19.516580 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c22e7eb9-96ac-4f28-850c-228da79698a9 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "POST /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a/action" status: 202 len: 0 microversion: 2.1 time: 1.085563 Oct 30 01:19:19.518111 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 803/1643] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:19:18 2022] POST /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a/action => generated 0 bytes in 1088 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 30 01:19:19.529603 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c16bd58a-98fd-4aa4-8736-a0385ce77a96 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:19.530813 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c16bd58a-98fd-4aa4-8736-a0385ce77a96 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0ec8b27d-8af5-45d7-892b-09297e5cb2d8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:19.553497 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c16bd58a-98fd-4aa4-8736-a0385ce77a96 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:19.555405 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c16bd58a-98fd-4aa4-8736-a0385ce77a96 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:19.563029 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c16bd58a-98fd-4aa4-8736-a0385ce77a96 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:19.564184 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c16bd58a-98fd-4aa4-8736-a0385ce77a96 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:19.564889 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c16bd58a-98fd-4aa4-8736-a0385ce77a96 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:19.565922 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c16bd58a-98fd-4aa4-8736-a0385ce77a96 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:19.707025 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-665cabd1-0ec7-40cd-8050-a833a6e2fa36 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "POST /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597/action" status: 202 len: 0 microversion: 2.1 time: 1.032198 Oct 30 01:19:19.711818 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 841/1644] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:19:18 2022] POST /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597/action => generated 0 bytes in 1038 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:19:19.746866 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-706cc8d1-36b2-444b-9204-1f0b5b5dbf77 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1345130471"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:19:19.755564 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-706cc8d1-36b2-444b-9204-1f0b5b5dbf77 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: c74142c0-5f39-44d8-b754-9c9ee956850a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:19.800037 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-706cc8d1-36b2-444b-9204-1f0b5b5dbf77 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:19.800903 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-706cc8d1-36b2-444b-9204-1f0b5b5dbf77 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:19.801584 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-706cc8d1-36b2-444b-9204-1f0b5b5dbf77 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:19.802667 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-706cc8d1-36b2-444b-9204-1f0b5b5dbf77 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:19.817943 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-706cc8d1-36b2-444b-9204-1f0b5b5dbf77 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:19.823194 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-706cc8d1-36b2-444b-9204-1f0b5b5dbf77 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:19.966348 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-706cc8d1-36b2-444b-9204-1f0b5b5dbf77 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] HTTP exception thrown: Cannot 'createImage' instance c74142c0-5f39-44d8-b754-9c9ee956850a while it is in task_state image_snapshot_pending Oct 30 01:19:19.968528 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-706cc8d1-36b2-444b-9204-1f0b5b5dbf77 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Request method failure captured: Oct 30 01:19:19.968528 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a/action HTTP/1.1 Oct 30 01:19:19.968528 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:19:19.968528 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:19:19.968528 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:19:19.968528 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 85 Oct 30 01:19:19.968528 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:19:19.968528 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:19:19.968528 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:19:19.968528 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:19:19.968528 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdD3IhIPYY_sTvEXpI9r1a34kazQy3xsqStabQonrlcEF0HpNl2ztWpirnqs0lietV1LWWVyHjCqAxxd5t3TuUU6o10qW3LK2oIPKGmvwXDy1lrrZEL1UVe632zfYCdkIUu5geJi4tWcEpwgvNOLoS3eMkj37BIJt_45I78bzhHVIS8 Oct 30 01:19:19.968528 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:19:19.968528 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:19:19.968528 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:19:19.968528 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:19:19.968528 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:19:19.968528 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:19:19.968528 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 8c2cd7e4b04741e3bb1cb9852612db57 Oct 30 01:19:19.968528 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1966575233 Oct 30 01:19:19.968528 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:19:19.968528 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:19:19.970088 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c2cd7e4b04741e3bb1cb9852612db57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8c2cd7e4b04741e3bb1cb9852612db57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8c2cd7e4b04741e3bb1cb9852612db57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c2cd7e4b04741e3bb1cb9852612db57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:19:19.970088 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1966575233 Oct 30 01:19:19.970088 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 8c2cd7e4b04741e3bb1cb9852612db57 Oct 30 01:19:19.970088 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1966575233 Oct 30 01:19:19.970088 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ImagesOneServerNegativeTestJSON-1966575233-project Oct 30 01:19:19.970088 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:19:19.970088 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:19:19.970088 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: c114d44d0a314c75902da53fca797f62 Oct 30 01:19:19.970088 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1966575233-project Oct 30 01:19:19.970088 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:19:19.970088 n-d-master-1 devstack@n-api.service[121102]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1345130471"}} Oct 30 01:19:19.970088 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:19:19.970897 n-d-master-1 devstack@n-api.service[121102]: exception: Cannot 'createImage' instance c74142c0-5f39-44d8-b754-9c9ee956850a while it is in task_state image_snapshot_pending Oct 30 01:19:19.970897 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'c74142c0-5f39-44d8-b754-9c9ee956850a', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1345130471'}}} Oct 30 01:19:19.970897 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:19:19.970897 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:19:19.970897 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 30 01:19:19.970897 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 30 01:19:19.970897 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 30 01:19:19.970897 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 30 01:19:19.970897 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c74142c0-5f39-44d8-b754-9c9ee956850a in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Oct 30 01:19:19.970897 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:19:19.970897 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:19:19.970897 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:19:19.970897 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:19:19.970897 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:19:19.970897 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:19:19.970897 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:19:19.970897 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:19:19.970897 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:19:19.970897 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:19:19.972207 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:19:19.972207 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:19:19.972207 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:19:19.972207 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:19:19.972207 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 30 01:19:19.972207 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 30 01:19:19.972207 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 30 01:19:19.972207 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 30 01:19:19.972207 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance c74142c0-5f39-44d8-b754-9c9ee956850a while it is in task_state image_snapshot_pending Oct 30 01:19:19.972207 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:19:19.972207 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:19:19.972207 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:19:19.972207 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:19:19.972207 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:19:19.972207 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:19:19.972207 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:19:19.972207 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:19:19.972207 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance c74142c0-5f39-44d8-b754-9c9ee956850a while it is in task_state image_snapshot_pending Oct 30 01:19:19.972207 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:19:19.977416 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-706cc8d1-36b2-444b-9204-1f0b5b5dbf77 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Returning 409 to user: Cannot 'createImage' instance c74142c0-5f39-44d8-b754-9c9ee956850a while it is in task_state image_snapshot_pending {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:19:19.978528 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-706cc8d1-36b2-444b-9204-1f0b5b5dbf77 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "POST /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a/action" status: 409 len: 167 microversion: 2.1 time: 0.262518 Oct 30 01:19:19.979612 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 842/1645] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:19:19 2022] POST /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a/action => generated 167 bytes in 264 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:19:19.989019 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8b77cca7-a6a3-4c80-a86f-b670894ae689 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:19.993515 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8b77cca7-a6a3-4c80-a86f-b670894ae689 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 03d9aff4-215d-48fa-b741-2257b62fc597] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:20.011018 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b77cca7-a6a3-4c80-a86f-b670894ae689 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:20.011588 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b77cca7-a6a3-4c80-a86f-b670894ae689 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:20.012121 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b77cca7-a6a3-4c80-a86f-b670894ae689 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:20.013947 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b77cca7-a6a3-4c80-a86f-b670894ae689 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:20.014567 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b77cca7-a6a3-4c80-a86f-b670894ae689 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:20.015095 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b77cca7-a6a3-4c80-a86f-b670894ae689 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:20.873089 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c16bd58a-98fd-4aa4-8736-a0385ce77a96 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:20.879311 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:20.890948 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c16bd58a-98fd-4aa4-8736-a0385ce77a96 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8" status: 200 len: 1199 microversion: 2.1 time: 1.370558 Oct 30 01:19:20.895290 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 804/1646] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:19 2022] GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8 => generated 1199 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:20.909647 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-40d1b6dd-14c0-45d9-9f3a-f4ce023a8cf8 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '.version_select at 0x7f44c7be4040>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:20.927201 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8b77cca7-a6a3-4c80-a86f-b670894ae689 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:20.936188 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8b77cca7-a6a3-4c80-a86f-b670894ae689 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597" status: 200 len: 1470 microversion: 2.1 time: 0.955200 Oct 30 01:19:20.940138 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 843/1647] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:19 2022] GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597 => generated 1470 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:21.492285 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-40d1b6dd-14c0-45d9-9f3a-f4ce023a8cf8 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "DELETE /compute/v2.1/images/e7d33be2-2763-4cce-92bd-f7a11ff81ac1" status: 204 len: 0 microversion: 2.1 time: 0.594710 Oct 30 01:19:21.494023 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 805/1648] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:20 2022] DELETE /compute/v2.1/images/e7d33be2-2763-4cce-92bd-f7a11ff81ac1 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:19:21.506438 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-63252bd0-d9ac-469a-82c5-744555e5361c tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:21.507322 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-63252bd0-d9ac-469a-82c5-744555e5361c tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: c74142c0-5f39-44d8-b754-9c9ee956850a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:21.525838 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-63252bd0-d9ac-469a-82c5-744555e5361c tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:21.528466 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-63252bd0-d9ac-469a-82c5-744555e5361c tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:21.529011 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-63252bd0-d9ac-469a-82c5-744555e5361c tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:21.529733 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-63252bd0-d9ac-469a-82c5-744555e5361c tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:21.535377 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-63252bd0-d9ac-469a-82c5-744555e5361c tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:21.536057 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-63252bd0-d9ac-469a-82c5-744555e5361c tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:22.227145 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-63252bd0-d9ac-469a-82c5-744555e5361c tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:22.238559 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-63252bd0-d9ac-469a-82c5-744555e5361c tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a" status: 200 len: 1538 microversion: 2.1 time: 0.740283 Oct 30 01:19:22.245424 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 844/1649] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:21 2022] GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a => generated 1538 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:22.268365 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-eea2a112-423c-4349-a755-0ad68b4b6e98 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:22.268917 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-eea2a112-423c-4349-a755-0ad68b4b6e98 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] [instance: 0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:22.284295 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eea2a112-423c-4349-a755-0ad68b4b6e98 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:22.285918 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eea2a112-423c-4349-a755-0ad68b4b6e98 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:22.287049 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eea2a112-423c-4349-a755-0ad68b4b6e98 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:22.289422 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eea2a112-423c-4349-a755-0ad68b4b6e98 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:22.292974 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eea2a112-423c-4349-a755-0ad68b4b6e98 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:22.293702 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eea2a112-423c-4349-a755-0ad68b4b6e98 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:22.342932 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-eea2a112-423c-4349-a755-0ad68b4b6e98 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] [instance: 0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:19:22.388039 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-46eb9aae-d766-4365-9a8e-1e57c2e2251e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-859437596", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "19e0e4e2-b502-4a02-810a-996c246e8c64"}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:19:22.495492 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-46eb9aae-d766-4365-9a8e-1e57c2e2251e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] validate_networks() for [('19e0e4e2-b502-4a02-810a-996c246e8c64', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:19:22.629859 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-eea2a112-423c-4349-a755-0ad68b4b6e98 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23" status: 204 len: 0 microversion: 2.1 time: 0.381536 Oct 30 01:19:22.630979 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 845/1650] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:19:22 2022] DELETE /compute/v2.1/servers/0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:19:22.639162 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-09cd1b5e-90de-4486-823f-b85d29c44dff tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:22.640513 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-09cd1b5e-90de-4486-823f-b85d29c44dff tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0ec8b27d-8af5-45d7-892b-09297e5cb2d8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:22.644415 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=3,nova_api:UPDATE=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:22.652131 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-09cd1b5e-90de-4486-823f-b85d29c44dff tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:22.652984 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-09cd1b5e-90de-4486-823f-b85d29c44dff tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:22.653928 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-09cd1b5e-90de-4486-823f-b85d29c44dff tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:22.658139 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-09cd1b5e-90de-4486-823f-b85d29c44dff tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:22.662437 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-09cd1b5e-90de-4486-823f-b85d29c44dff tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:22.663775 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-09cd1b5e-90de-4486-823f-b85d29c44dff tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:22.972492 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-09cd1b5e-90de-4486-823f-b85d29c44dff tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:22.987667 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-09cd1b5e-90de-4486-823f-b85d29c44dff tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8" status: 200 len: 1199 microversion: 2.1 time: 0.352308 Oct 30 01:19:22.989492 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 846/1651] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:22 2022] GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8 => generated 1199 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:22.997026 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cfd18116-7143-4df8-9f82-0586b7c4f20e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:22.997946 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cfd18116-7143-4df8-9f82-0586b7c4f20e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 03d9aff4-215d-48fa-b741-2257b62fc597] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:23.011247 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cfd18116-7143-4df8-9f82-0586b7c4f20e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:23.012579 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cfd18116-7143-4df8-9f82-0586b7c4f20e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:23.013273 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cfd18116-7143-4df8-9f82-0586b7c4f20e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:23.015331 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cfd18116-7143-4df8-9f82-0586b7c4f20e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:23.017082 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cfd18116-7143-4df8-9f82-0586b7c4f20e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:23.017620 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cfd18116-7143-4df8-9f82-0586b7c4f20e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:23.746956 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-cfd18116-7143-4df8-9f82-0586b7c4f20e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:23.761371 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cfd18116-7143-4df8-9f82-0586b7c4f20e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597" status: 200 len: 1470 microversion: 2.1 time: 0.770309 Oct 30 01:19:23.763388 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 847/1652] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:22 2022] GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597 => generated 1470 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:23.770249 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5521ae91-05e2-4ed5-b084-baad407cb2e6 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:23.771098 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5521ae91-05e2-4ed5-b084-baad407cb2e6 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] [instance: 0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:23.778597 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5521ae91-05e2-4ed5-b084-baad407cb2e6 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:23.779703 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5521ae91-05e2-4ed5-b084-baad407cb2e6 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:23.780511 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5521ae91-05e2-4ed5-b084-baad407cb2e6 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:23.783301 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5521ae91-05e2-4ed5-b084-baad407cb2e6 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:23.784497 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5521ae91-05e2-4ed5-b084-baad407cb2e6 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:23.785733 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5521ae91-05e2-4ed5-b084-baad407cb2e6 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:23.836290 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-46eb9aae-d766-4365-9a8e-1e57c2e2251e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:19:23.839002 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-46eb9aae-d766-4365-9a8e-1e57c2e2251e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:19:23.839002 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-46eb9aae-d766-4365-9a8e-1e57c2e2251e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:19:23.839002 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-46eb9aae-d766-4365-9a8e-1e57c2e2251e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:19:23.839002 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-46eb9aae-d766-4365-9a8e-1e57c2e2251e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:19:23.884579 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-46eb9aae-d766-4365-9a8e-1e57c2e2251e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:23.896248 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-46eb9aae-d766-4365-9a8e-1e57c2e2251e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:23.904387 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-46eb9aae-d766-4365-9a8e-1e57c2e2251e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:23.904387 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-46eb9aae-d766-4365-9a8e-1e57c2e2251e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:23.904387 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-46eb9aae-d766-4365-9a8e-1e57c2e2251e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:23.904387 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-46eb9aae-d766-4365-9a8e-1e57c2e2251e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:23.970402 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-46eb9aae-d766-4365-9a8e-1e57c2e2251e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Getting quotas for project 8c95e97cd7e4461682b9028abb568dce. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:19:23.983039 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-46eb9aae-d766-4365-9a8e-1e57c2e2251e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Getting quotas for user 33691c943ec040ddb04b6648b6e945ab and project 8c95e97cd7e4461682b9028abb568dce. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:19:24.020497 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-46eb9aae-d766-4365-9a8e-1e57c2e2251e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:19:24.025416 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-46eb9aae-d766-4365-9a8e-1e57c2e2251e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 4e90ab5e-2dd7-4267-a5d2-9fc034e66c48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:19:24.120393 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5521ae91-05e2-4ed5-b084-baad407cb2e6 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7269dc6d56440ca8691179f7275aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4681ed2d06840f995b37e550323d6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:24.131267 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5521ae91-05e2-4ed5-b084-baad407cb2e6 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] 10.222.0.13 "GET /compute/v2.1/servers/0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23" status: 200 len: 1513 microversion: 2.1 time: 0.365628 Oct 30 01:19:24.144200 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 848/1653] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:23 2022] GET /compute/v2.1/servers/0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23 => generated 1513 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:24.156106 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2ed3a916-0f4a-4925-879d-16b63bd179b1 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:24.156106 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2ed3a916-0f4a-4925-879d-16b63bd179b1 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: c74142c0-5f39-44d8-b754-9c9ee956850a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:24.163762 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ed3a916-0f4a-4925-879d-16b63bd179b1 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:24.169012 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ed3a916-0f4a-4925-879d-16b63bd179b1 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:24.169012 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ed3a916-0f4a-4925-879d-16b63bd179b1 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:24.169012 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ed3a916-0f4a-4925-879d-16b63bd179b1 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:24.169012 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ed3a916-0f4a-4925-879d-16b63bd179b1 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:24.169483 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ed3a916-0f4a-4925-879d-16b63bd179b1 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:24.251403 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-46eb9aae-d766-4365-9a8e-1e57c2e2251e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.422501 Oct 30 01:19:24.260208 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 806/1654] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:19:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2432 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:19:24.598846 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2ed3a916-0f4a-4925-879d-16b63bd179b1 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:24.614129 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2ed3a916-0f4a-4925-879d-16b63bd179b1 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a" status: 200 len: 1538 microversion: 2.1 time: 0.460114 Oct 30 01:19:24.614865 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 849/1655] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:24 2022] GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a => generated 1538 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:24.713817 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-7a6a3d87-1864-45a2-850d-f6211edc1ec4 req-e2f8cdda-86b1-44eb-bbf0-202644b4c515 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03d9aff4-215d-48fa-b741-2257b62fc597", "name": "network-vif-plugged", "status": "completed", "tag": "f852959f-05e2-49d9-95ba-a62b3b029d75"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:19:24.751747 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-7a6a3d87-1864-45a2-850d-f6211edc1ec4 req-e2f8cdda-86b1-44eb-bbf0-202644b4c515 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:24.756392 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-7a6a3d87-1864-45a2-850d-f6211edc1ec4 req-e2f8cdda-86b1-44eb-bbf0-202644b4c515 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:24.758808 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-7a6a3d87-1864-45a2-850d-f6211edc1ec4 req-e2f8cdda-86b1-44eb-bbf0-202644b4c515 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:24.776282 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-7a6a3d87-1864-45a2-850d-f6211edc1ec4 req-e2f8cdda-86b1-44eb-bbf0-202644b4c515 service nova] Creating event network-vif-plugged:f852959f-05e2-49d9-95ba-a62b3b029d75 for instance 03d9aff4-215d-48fa-b741-2257b62fc597 on n-h2-master-1 Oct 30 01:19:24.791787 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [req-7a6a3d87-1864-45a2-850d-f6211edc1ec4 req-e2f8cdda-86b1-44eb-bbf0-202644b4c515 service nova] Instance 03d9aff4-215d-48fa-b741-2257b62fc597 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=121103) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 30 01:19:24.820045 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-7a6a3d87-1864-45a2-850d-f6211edc1ec4 req-e2f8cdda-86b1-44eb-bbf0-202644b4c515 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.556267 Oct 30 01:19:24.825011 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 807/1656] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:19:24.838338 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c8be8878-8755-47b8-873f-5bd36747f83c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:24.840189 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c8be8878-8755-47b8-873f-5bd36747f83c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0ec8b27d-8af5-45d7-892b-09297e5cb2d8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:24.848036 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c8be8878-8755-47b8-873f-5bd36747f83c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:24.855602 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c8be8878-8755-47b8-873f-5bd36747f83c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:24.855602 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c8be8878-8755-47b8-873f-5bd36747f83c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:24.855602 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c8be8878-8755-47b8-873f-5bd36747f83c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:24.855602 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c8be8878-8755-47b8-873f-5bd36747f83c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:24.855989 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c8be8878-8755-47b8-873f-5bd36747f83c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:24.862704 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-33194302-f9de-478f-ac79-6f28dde6db8c tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-1135603679", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": "none"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:19:24.957744 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-33194302-f9de-478f-ac79-6f28dde6db8c tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:19:24.958798 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-33194302-f9de-478f-ac79-6f28dde6db8c tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:19:24.959474 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-33194302-f9de-478f-ac79-6f28dde6db8c tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:19:24.960070 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-33194302-f9de-478f-ac79-6f28dde6db8c tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:19:24.960747 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-33194302-f9de-478f-ac79-6f28dde6db8c tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:19:24.970465 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-33194302-f9de-478f-ac79-6f28dde6db8c tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:24.971433 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-33194302-f9de-478f-ac79-6f28dde6db8c tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:24.972104 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-33194302-f9de-478f-ac79-6f28dde6db8c tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:24.973052 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-33194302-f9de-478f-ac79-6f28dde6db8c tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:24.974078 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-33194302-f9de-478f-ac79-6f28dde6db8c tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:24.974934 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-33194302-f9de-478f-ac79-6f28dde6db8c tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:25.005275 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-33194302-f9de-478f-ac79-6f28dde6db8c tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Getting quotas for project 8c9fa6465cb74679921935af37294eca. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:19:25.011163 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-33194302-f9de-478f-ac79-6f28dde6db8c tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Getting quotas for user d815becbdc9d40e8b0ab90e97488018a and project 8c9fa6465cb74679921935af37294eca. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:19:25.026108 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-33194302-f9de-478f-ac79-6f28dde6db8c tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:19:25.028463 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-33194302-f9de-478f-ac79-6f28dde6db8c tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:19:25.126211 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c8be8878-8755-47b8-873f-5bd36747f83c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:25.140392 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-33194302-f9de-478f-ac79-6f28dde6db8c tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.523225 Oct 30 01:19:25.141958 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 850/1657] 10.222.0.13 () {62 vars in 1188 bytes} [Sun Oct 30 01:19:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 527 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 30 01:19:25.148271 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-401eb1cd-ff27-4a5a-809f-6763317c21c5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:25.148884 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-401eb1cd-ff27-4a5a-809f-6763317c21c5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 4e90ab5e-2dd7-4267-a5d2-9fc034e66c48] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:25.162807 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c8be8878-8755-47b8-873f-5bd36747f83c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8" status: 200 len: 1199 microversion: 2.1 time: 0.336168 Oct 30 01:19:25.167176 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 808/1658] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:24 2022] GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8 => generated 1199 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:25.193697 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c7355b4f-4d7e-4ffc-bcca-41f039354b0c tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:25.195594 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c7355b4f-4d7e-4ffc-bcca-41f039354b0c tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 03d9aff4-215d-48fa-b741-2257b62fc597] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:25.211504 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c7355b4f-4d7e-4ffc-bcca-41f039354b0c tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:25.212194 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c7355b4f-4d7e-4ffc-bcca-41f039354b0c tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:25.217663 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c7355b4f-4d7e-4ffc-bcca-41f039354b0c tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:25.235043 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c7355b4f-4d7e-4ffc-bcca-41f039354b0c tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:25.237435 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c7355b4f-4d7e-4ffc-bcca-41f039354b0c tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:25.246776 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c7355b4f-4d7e-4ffc-bcca-41f039354b0c tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:25.362785 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-401eb1cd-ff27-4a5a-809f-6763317c21c5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:25.372046 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-401eb1cd-ff27-4a5a-809f-6763317c21c5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/4e90ab5e-2dd7-4267-a5d2-9fc034e66c48" status: 200 len: 1214 microversion: 2.1 time: 0.226616 Oct 30 01:19:25.372863 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 851/1659] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:25 2022] GET /compute/v2.1/servers/4e90ab5e-2dd7-4267-a5d2-9fc034e66c48 => generated 1214 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:25.379460 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b79ec091-3ebd-4033-ae4d-520d928b0f1d tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:25.385587 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b79ec091-3ebd-4033-ae4d-520d928b0f1d tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:25.518520 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b79ec091-3ebd-4033-ae4d-520d928b0f1d tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:25.530300 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b79ec091-3ebd-4033-ae4d-520d928b0f1d tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:25.534071 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b79ec091-3ebd-4033-ae4d-520d928b0f1d tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:25.546163 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b79ec091-3ebd-4033-ae4d-520d928b0f1d tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1454 microversion: 2.91 time: 0.168063 Oct 30 01:19:25.548554 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 852/1660] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:19:25 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1454 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:19:25.554527 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6a18481f-05df-45d2-9349-bbd8e087caa7 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:25.556002 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6a18481f-05df-45d2-9349-bbd8e087caa7 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] [instance: 0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:25.586473 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a18481f-05df-45d2-9349-bbd8e087caa7 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:25.587240 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a18481f-05df-45d2-9349-bbd8e087caa7 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:25.590622 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a18481f-05df-45d2-9349-bbd8e087caa7 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:25.591868 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a18481f-05df-45d2-9349-bbd8e087caa7 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:25.592573 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a18481f-05df-45d2-9349-bbd8e087caa7 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:25.594663 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a18481f-05df-45d2-9349-bbd8e087caa7 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:25.658579 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c7355b4f-4d7e-4ffc-bcca-41f039354b0c tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:25.667343 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c7355b4f-4d7e-4ffc-bcca-41f039354b0c tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597" status: 200 len: 1470 microversion: 2.1 time: 0.498870 Oct 30 01:19:25.673380 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 809/1661] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:25 2022] GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597 => generated 1470 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:25.674578 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-663cac63-56d0-4ecc-aa41-3b31df823778 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:25.676112 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-663cac63-56d0-4ecc-aa41-3b31df823778 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: c74142c0-5f39-44d8-b754-9c9ee956850a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:25.694115 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-663cac63-56d0-4ecc-aa41-3b31df823778 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:25.695187 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-663cac63-56d0-4ecc-aa41-3b31df823778 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:25.695617 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-663cac63-56d0-4ecc-aa41-3b31df823778 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:25.696321 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-663cac63-56d0-4ecc-aa41-3b31df823778 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:25.696769 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-663cac63-56d0-4ecc-aa41-3b31df823778 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:25.697185 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-663cac63-56d0-4ecc-aa41-3b31df823778 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:26.049826 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6a18481f-05df-45d2-9349-bbd8e087caa7 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7269dc6d56440ca8691179f7275aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4681ed2d06840f995b37e550323d6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:26.068150 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6a18481f-05df-45d2-9349-bbd8e087caa7 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] 10.222.0.13 "GET /compute/v2.1/servers/0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23" status: 200 len: 1513 microversion: 2.1 time: 0.517218 Oct 30 01:19:26.080929 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 853/1662] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:25 2022] GET /compute/v2.1/servers/0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23 => generated 1513 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:26.199999 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6cb0fa5a-ff70-46e5-9fe9-ad9ef29a4a1e tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:26.202272 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6cb0fa5a-ff70-46e5-9fe9-ad9ef29a4a1e tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0ec8b27d-8af5-45d7-892b-09297e5cb2d8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:26.245491 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6cb0fa5a-ff70-46e5-9fe9-ad9ef29a4a1e tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:26.246062 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6cb0fa5a-ff70-46e5-9fe9-ad9ef29a4a1e tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:26.246515 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6cb0fa5a-ff70-46e5-9fe9-ad9ef29a4a1e tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:26.247266 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6cb0fa5a-ff70-46e5-9fe9-ad9ef29a4a1e tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:26.247725 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6cb0fa5a-ff70-46e5-9fe9-ad9ef29a4a1e tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:26.255147 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6cb0fa5a-ff70-46e5-9fe9-ad9ef29a4a1e tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:27.066817 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-663cac63-56d0-4ecc-aa41-3b31df823778 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:27.083067 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-663cac63-56d0-4ecc-aa41-3b31df823778 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a" status: 200 len: 1538 microversion: 2.1 time: 1.412839 Oct 30 01:19:27.089519 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 810/1663] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:25 2022] GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a => generated 1538 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:27.097024 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-634e5af7-d6a1-4575-81ef-af324bc2588a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:27.100054 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-634e5af7-d6a1-4575-81ef-af324bc2588a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 4e90ab5e-2dd7-4267-a5d2-9fc034e66c48] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:27.114177 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-634e5af7-d6a1-4575-81ef-af324bc2588a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:27.119915 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-634e5af7-d6a1-4575-81ef-af324bc2588a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:27.119915 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-634e5af7-d6a1-4575-81ef-af324bc2588a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:27.120277 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-634e5af7-d6a1-4575-81ef-af324bc2588a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:27.120734 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-634e5af7-d6a1-4575-81ef-af324bc2588a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:27.124048 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-634e5af7-d6a1-4575-81ef-af324bc2588a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:27.410595 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6cb0fa5a-ff70-46e5-9fe9-ad9ef29a4a1e tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:27.448904 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6cb0fa5a-ff70-46e5-9fe9-ad9ef29a4a1e tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8" status: 200 len: 1199 microversion: 2.1 time: 1.255382 Oct 30 01:19:27.450788 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 854/1664] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:26 2022] GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8 => generated 1199 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:27.462683 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cd25f48d-3852-4666-b418-80d7aecb3962 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:27.463312 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cd25f48d-3852-4666-b418-80d7aecb3962 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:27.481137 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cd25f48d-3852-4666-b418-80d7aecb3962 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:27.483796 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cd25f48d-3852-4666-b418-80d7aecb3962 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:27.483796 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cd25f48d-3852-4666-b418-80d7aecb3962 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:27.483796 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cd25f48d-3852-4666-b418-80d7aecb3962 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:27.483796 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cd25f48d-3852-4666-b418-80d7aecb3962 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:27.487430 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cd25f48d-3852-4666-b418-80d7aecb3962 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:27.498644 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-634e5af7-d6a1-4575-81ef-af324bc2588a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:27.519219 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-634e5af7-d6a1-4575-81ef-af324bc2588a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/4e90ab5e-2dd7-4267-a5d2-9fc034e66c48" status: 200 len: 1210 microversion: 2.1 time: 0.428952 Oct 30 01:19:27.526618 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 811/1665] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:27 2022] GET /compute/v2.1/servers/4e90ab5e-2dd7-4267-a5d2-9fc034e66c48 => generated 1210 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:27.537574 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1de9e395-1837-47c9-9a79-20c29f2ccb8f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:27.552549 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1de9e395-1837-47c9-9a79-20c29f2ccb8f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 03d9aff4-215d-48fa-b741-2257b62fc597] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:27.556088 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:27.576692 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1de9e395-1837-47c9-9a79-20c29f2ccb8f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:27.580394 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1de9e395-1837-47c9-9a79-20c29f2ccb8f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:27.583365 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1de9e395-1837-47c9-9a79-20c29f2ccb8f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:27.590238 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1de9e395-1837-47c9-9a79-20c29f2ccb8f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:27.590870 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1de9e395-1837-47c9-9a79-20c29f2ccb8f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:27.592789 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1de9e395-1837-47c9-9a79-20c29f2ccb8f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:27.721299 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-cd25f48d-3852-4666-b418-80d7aecb3962 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:27.731601 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-cd25f48d-3852-4666-b418-80d7aecb3962 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:27.732882 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-cd25f48d-3852-4666-b418-80d7aecb3962 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:27.739670 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cd25f48d-3852-4666-b418-80d7aecb3962 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1458 microversion: 2.91 time: 0.285599 Oct 30 01:19:27.741388 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 855/1666] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:19:27 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1458 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:19:27.747557 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-0d326e24-946c-4642-9036-a04780869d2d req-2864ff41-7c37-483d-9974-3088fdc23fa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ec8b27d-8af5-45d7-892b-09297e5cb2d8", "name": "network-vif-plugged", "status": "completed", "tag": "f2512753-a87d-49fe-8f90-bf6f3cdfb7b3"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:19:27.763356 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-0d326e24-946c-4642-9036-a04780869d2d req-2864ff41-7c37-483d-9974-3088fdc23fa7 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:27.763356 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-0d326e24-946c-4642-9036-a04780869d2d req-2864ff41-7c37-483d-9974-3088fdc23fa7 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:27.763356 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-0d326e24-946c-4642-9036-a04780869d2d req-2864ff41-7c37-483d-9974-3088fdc23fa7 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:27.779938 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-0d326e24-946c-4642-9036-a04780869d2d req-2864ff41-7c37-483d-9974-3088fdc23fa7 service nova] Creating event network-vif-plugged:f2512753-a87d-49fe-8f90-bf6f3cdfb7b3 for instance 0ec8b27d-8af5-45d7-892b-09297e5cb2d8 on n-h1-master-1 Oct 30 01:19:27.787307 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-0d326e24-946c-4642-9036-a04780869d2d req-2864ff41-7c37-483d-9974-3088fdc23fa7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044342 Oct 30 01:19:27.789054 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 856/1667] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:19:27.796987 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3a5d3df5-6e18-4e8a-a89d-49fac1aba377 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:27.798298 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3a5d3df5-6e18-4e8a-a89d-49fac1aba377 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] [instance: 0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:27.807972 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a5d3df5-6e18-4e8a-a89d-49fac1aba377 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:27.808694 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a5d3df5-6e18-4e8a-a89d-49fac1aba377 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:27.809307 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a5d3df5-6e18-4e8a-a89d-49fac1aba377 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:27.810739 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a5d3df5-6e18-4e8a-a89d-49fac1aba377 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:27.811359 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a5d3df5-6e18-4e8a-a89d-49fac1aba377 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:27.812152 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a5d3df5-6e18-4e8a-a89d-49fac1aba377 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:28.030870 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3a5d3df5-6e18-4e8a-a89d-49fac1aba377 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7269dc6d56440ca8691179f7275aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4681ed2d06840f995b37e550323d6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:28.039411 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3a5d3df5-6e18-4e8a-a89d-49fac1aba377 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] 10.222.0.13 "GET /compute/v2.1/servers/0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23" status: 200 len: 1302 microversion: 2.1 time: 0.248625 Oct 30 01:19:28.050096 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 857/1668] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:27 2022] GET /compute/v2.1/servers/0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23 => generated 1302 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:28.208147 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1de9e395-1837-47c9-9a79-20c29f2ccb8f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:28.221693 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-53fc2900-4a40-4374-8348-40356d40e8f0 req-37930866-7882-4b34-8d43-654b05b5bb2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23", "name": "network-vif-deleted", "tag": "ee56c5cb-786f-4755-b5e1-0380da8d4ae3"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:19:28.237090 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-53fc2900-4a40-4374-8348-40356d40e8f0 req-37930866-7882-4b34-8d43-654b05b5bb2b service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:28.248641 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-53fc2900-4a40-4374-8348-40356d40e8f0 req-37930866-7882-4b34-8d43-654b05b5bb2b service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:28.248641 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-53fc2900-4a40-4374-8348-40356d40e8f0 req-37930866-7882-4b34-8d43-654b05b5bb2b service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:28.248951 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1de9e395-1837-47c9-9a79-20c29f2ccb8f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597" status: 200 len: 1536 microversion: 2.1 time: 0.718080 Oct 30 01:19:28.256042 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 812/1669] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:27 2022] GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597 => generated 1536 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:28.290299 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-53fc2900-4a40-4374-8348-40356d40e8f0 req-37930866-7882-4b34-8d43-654b05b5bb2b service nova] Creating event network-vif-deleted:ee56c5cb-786f-4755-b5e1-0380da8d4ae3 for instance 0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23 on n-h2-master-1 Oct 30 01:19:28.295543 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-53fc2900-4a40-4374-8348-40356d40e8f0 req-37930866-7882-4b34-8d43-654b05b5bb2b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.241979 Oct 30 01:19:28.296464 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 858/1670] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:19:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:19:28.303646 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e23ddd86-f745-4f66-9023-550287699a3b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:28.303646 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e23ddd86-f745-4f66-9023-550287699a3b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: c74142c0-5f39-44d8-b754-9c9ee956850a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:28.309488 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e23ddd86-f745-4f66-9023-550287699a3b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:28.310249 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e23ddd86-f745-4f66-9023-550287699a3b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:28.311023 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e23ddd86-f745-4f66-9023-550287699a3b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:28.311913 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e23ddd86-f745-4f66-9023-550287699a3b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:28.312547 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e23ddd86-f745-4f66-9023-550287699a3b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:28.312977 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e23ddd86-f745-4f66-9023-550287699a3b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:28.372545 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-17c2374a-1d9f-43a5-8ca0-262e24841cc5 tempest-NetworksTest-1500615105 tempest-NetworksTest-1500615105-project-admin] Calling method '.version_select at 0x7f44c7e7eb80>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:28.822521 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-17c2374a-1d9f-43a5-8ca0-262e24841cc5 tempest-NetworksTest-1500615105 tempest-NetworksTest-1500615105-project-admin] 10.222.0.13 "GET /compute/v2.1/os-networks" status: 200 len: 7422 microversion: 2.1 time: 0.564119 Oct 30 01:19:28.828197 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 813/1671] 10.222.0.13 () {58 vars in 1137 bytes} [Sun Oct 30 01:19:28 2022] GET /compute/v2.1/os-networks => generated 7422 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:28.844375 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9124b631-995c-456f-9ee4-912f500ade17 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:28.846095 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9124b631-995c-456f-9ee4-912f500ade17 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0ec8b27d-8af5-45d7-892b-09297e5cb2d8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:28.847625 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e23ddd86-f745-4f66-9023-550287699a3b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:28.868959 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e23ddd86-f745-4f66-9023-550287699a3b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a" status: 200 len: 1520 microversion: 2.1 time: 0.571263 Oct 30 01:19:28.869637 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 859/1672] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:28 2022] GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a => generated 1520 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:28.892297 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c995dd50-ccab-46b4-81c3-df6a321f1620 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:28.923194 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c995dd50-ccab-46b4-81c3-df6a321f1620 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 4e90ab5e-2dd7-4267-a5d2-9fc034e66c48] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:28.923652 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9124b631-995c-456f-9ee4-912f500ade17 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:28.923652 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9124b631-995c-456f-9ee4-912f500ade17 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:28.923867 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c995dd50-ccab-46b4-81c3-df6a321f1620 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:28.923867 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c995dd50-ccab-46b4-81c3-df6a321f1620 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:28.924057 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9124b631-995c-456f-9ee4-912f500ade17 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:28.924152 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c995dd50-ccab-46b4-81c3-df6a321f1620 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:28.924261 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9124b631-995c-456f-9ee4-912f500ade17 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:28.924261 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9124b631-995c-456f-9ee4-912f500ade17 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:28.926743 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9124b631-995c-456f-9ee4-912f500ade17 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:28.927061 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c995dd50-ccab-46b4-81c3-df6a321f1620 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:28.928104 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c995dd50-ccab-46b4-81c3-df6a321f1620 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:28.929360 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c995dd50-ccab-46b4-81c3-df6a321f1620 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:29.160500 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c995dd50-ccab-46b4-81c3-df6a321f1620 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:29.174827 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c995dd50-ccab-46b4-81c3-df6a321f1620 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/4e90ab5e-2dd7-4267-a5d2-9fc034e66c48" status: 200 len: 1274 microversion: 2.1 time: 0.303719 Oct 30 01:19:29.175684 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 860/1673] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:28 2022] GET /compute/v2.1/servers/4e90ab5e-2dd7-4267-a5d2-9fc034e66c48 => generated 1274 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:29.180609 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-be874ab3-dab3-4040-a0e7-e4aa1aa4e674 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:29.189465 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-be874ab3-dab3-4040-a0e7-e4aa1aa4e674 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:29.205049 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-be874ab3-dab3-4040-a0e7-e4aa1aa4e674 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:29.205611 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-be874ab3-dab3-4040-a0e7-e4aa1aa4e674 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:29.209297 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-be874ab3-dab3-4040-a0e7-e4aa1aa4e674 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:29.209297 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-be874ab3-dab3-4040-a0e7-e4aa1aa4e674 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:29.209297 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-be874ab3-dab3-4040-a0e7-e4aa1aa4e674 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:29.209297 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-be874ab3-dab3-4040-a0e7-e4aa1aa4e674 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:29.291129 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-be874ab3-dab3-4040-a0e7-e4aa1aa4e674 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:29.295755 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9124b631-995c-456f-9ee4-912f500ade17 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:29.302014 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-be874ab3-dab3-4040-a0e7-e4aa1aa4e674 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:29.303459 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-be874ab3-dab3-4040-a0e7-e4aa1aa4e674 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:29.306418 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9124b631-995c-456f-9ee4-912f500ade17 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8" status: 200 len: 1199 microversion: 2.1 time: 0.476743 Oct 30 01:19:29.307807 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 814/1674] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:28 2022] GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8 => generated 1199 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:29.309545 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-be874ab3-dab3-4040-a0e7-e4aa1aa4e674 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1506 microversion: 2.91 time: 0.132678 Oct 30 01:19:29.310222 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 861/1675] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:19:29 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1506 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:19:29.313701 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d78e8b7d-eaaf-4604-b6b4-0aadf681a989 tempest-NetworksTest-1500615105 tempest-NetworksTest-1500615105-project-admin] Calling method '.version_select at 0x7f44c7c001f0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:29.318202 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ff1bccc9-f284-48ff-b19e-0c9f69da7cd6 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:29.318770 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ff1bccc9-f284-48ff-b19e-0c9f69da7cd6 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: c74142c0-5f39-44d8-b754-9c9ee956850a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:29.325094 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ff1bccc9-f284-48ff-b19e-0c9f69da7cd6 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:29.325721 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ff1bccc9-f284-48ff-b19e-0c9f69da7cd6 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:29.326155 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ff1bccc9-f284-48ff-b19e-0c9f69da7cd6 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:29.326862 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ff1bccc9-f284-48ff-b19e-0c9f69da7cd6 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:29.327315 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ff1bccc9-f284-48ff-b19e-0c9f69da7cd6 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:29.327740 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ff1bccc9-f284-48ff-b19e-0c9f69da7cd6 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:29.388414 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ff1bccc9-f284-48ff-b19e-0c9f69da7cd6 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: c74142c0-5f39-44d8-b754-9c9ee956850a] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:19:29.436104 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d78e8b7d-eaaf-4604-b6b4-0aadf681a989 tempest-NetworksTest-1500615105 tempest-NetworksTest-1500615105-project-admin] 10.222.0.13 "GET /compute/v2.1/os-networks/2814ffb0-9699-49c0-8244-030e5edcf7e8" status: 200 len: 652 microversion: 2.1 time: 0.126954 Oct 30 01:19:29.437003 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 815/1676] 10.222.0.13 () {58 vars in 1248 bytes} [Sun Oct 30 01:19:29 2022] GET /compute/v2.1/os-networks/2814ffb0-9699-49c0-8244-030e5edcf7e8 => generated 652 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:19:29.445381 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9c7fb62c-f4ad-49a2-a8d2-f1581f99ff59 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:29.447938 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9c7fb62c-f4ad-49a2-a8d2-f1581f99ff59 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] [instance: 0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:29.452995 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9c7fb62c-f4ad-49a2-a8d2-f1581f99ff59 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:29.453823 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9c7fb62c-f4ad-49a2-a8d2-f1581f99ff59 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:29.454429 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9c7fb62c-f4ad-49a2-a8d2-f1581f99ff59 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:29.455512 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9c7fb62c-f4ad-49a2-a8d2-f1581f99ff59 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:29.456129 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9c7fb62c-f4ad-49a2-a8d2-f1581f99ff59 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:29.456705 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9c7fb62c-f4ad-49a2-a8d2-f1581f99ff59 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:29.498714 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9c7fb62c-f4ad-49a2-a8d2-f1581f99ff59 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:29.499206 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9c7fb62c-f4ad-49a2-a8d2-f1581f99ff59 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:29.499642 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9c7fb62c-f4ad-49a2-a8d2-f1581f99ff59 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:29.500102 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-9c7fb62c-f4ad-49a2-a8d2-f1581f99ff59 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lazy-loading 'fault' on Instance uuid 0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:19:29.554206 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9c7fb62c-f4ad-49a2-a8d2-f1581f99ff59 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7269dc6d56440ca8691179f7275aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4681ed2d06840f995b37e550323d6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:29.562994 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9c7fb62c-f4ad-49a2-a8d2-f1581f99ff59 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] 10.222.0.13 "GET /compute/v2.1/servers/0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23" status: 200 len: 1307 microversion: 2.1 time: 0.124738 Oct 30 01:19:29.563862 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 816/1677] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:29 2022] GET /compute/v2.1/servers/0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23 => generated 1307 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:29.569733 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-359f296c-0e00-445a-8097-f62eacd62786 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:29.575614 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-359f296c-0e00-445a-8097-f62eacd62786 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 03d9aff4-215d-48fa-b741-2257b62fc597] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:29.577140 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-359f296c-0e00-445a-8097-f62eacd62786 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:29.577828 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-359f296c-0e00-445a-8097-f62eacd62786 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:29.578423 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-359f296c-0e00-445a-8097-f62eacd62786 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:29.579407 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-359f296c-0e00-445a-8097-f62eacd62786 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:29.582568 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-359f296c-0e00-445a-8097-f62eacd62786 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:29.583905 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-359f296c-0e00-445a-8097-f62eacd62786 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:29.709932 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ff1bccc9-f284-48ff-b19e-0c9f69da7cd6 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a" status: 204 len: 0 microversion: 2.1 time: 0.397442 Oct 30 01:19:29.712078 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 862/1678] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:19:29 2022] DELETE /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:19:29.718631 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b67fa06d-b6c5-4fe8-8af2-146419121c4f tempest-NetworksTest-1500615105 tempest-NetworksTest-1500615105-project-admin] Calling method '.version_select at 0x7f44c7eddaf0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:29.935806 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-359f296c-0e00-445a-8097-f62eacd62786 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:29.945622 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-359f296c-0e00-445a-8097-f62eacd62786 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597" status: 200 len: 1536 microversion: 2.1 time: 0.380254 Oct 30 01:19:29.957357 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 817/1679] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:29 2022] GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597 => generated 1536 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:29.957357 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-86a663fd-b47b-468b-af6c-9c5647ebcfb4 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:29.957357 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-86a663fd-b47b-468b-af6c-9c5647ebcfb4 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: c74142c0-5f39-44d8-b754-9c9ee956850a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:29.975157 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-86a663fd-b47b-468b-af6c-9c5647ebcfb4 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:29.976790 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-86a663fd-b47b-468b-af6c-9c5647ebcfb4 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:29.977984 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-86a663fd-b47b-468b-af6c-9c5647ebcfb4 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:29.980432 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-86a663fd-b47b-468b-af6c-9c5647ebcfb4 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:29.983445 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-86a663fd-b47b-468b-af6c-9c5647ebcfb4 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:29.985284 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-86a663fd-b47b-468b-af6c-9c5647ebcfb4 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:30.242372 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b67fa06d-b6c5-4fe8-8af2-146419121c4f tempest-NetworksTest-1500615105 tempest-NetworksTest-1500615105-project-admin] 10.222.0.13 "GET /compute/v2.1/os-networks" status: 200 len: 7422 microversion: 2.1 time: 0.527719 Oct 30 01:19:30.248104 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 863/1680] 10.222.0.13 () {58 vars in 1137 bytes} [Sun Oct 30 01:19:29 2022] GET /compute/v2.1/os-networks => generated 7422 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:30.254685 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-5af08bf7-511a-46b6-8ce4-d9468bd080fe req-d920754c-8dc4-4d0b-a3b2-ecac35b4c45e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c74142c0-5f39-44d8-b754-9c9ee956850a", "name": "network-vif-plugged", "status": "completed", "tag": "6e6c0345-ef0b-4f04-abb3-43794b3a90ad"}, {"server_uuid": "03d9aff4-215d-48fa-b741-2257b62fc597", "name": "network-vif-unplugged", "status": "completed", "tag": "f852959f-05e2-49d9-95ba-a62b3b029d75"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:19:30.269500 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-5af08bf7-511a-46b6-8ce4-d9468bd080fe req-d920754c-8dc4-4d0b-a3b2-ecac35b4c45e service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:30.270082 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-5af08bf7-511a-46b6-8ce4-d9468bd080fe req-d920754c-8dc4-4d0b-a3b2-ecac35b4c45e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:30.270458 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-5af08bf7-511a-46b6-8ce4-d9468bd080fe req-d920754c-8dc4-4d0b-a3b2-ecac35b4c45e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:30.290954 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-5af08bf7-511a-46b6-8ce4-d9468bd080fe req-d920754c-8dc4-4d0b-a3b2-ecac35b4c45e service nova] Creating event network-vif-plugged:6e6c0345-ef0b-4f04-abb3-43794b3a90ad for instance c74142c0-5f39-44d8-b754-9c9ee956850a on n-h2-master-1 Oct 30 01:19:30.291471 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-5af08bf7-511a-46b6-8ce4-d9468bd080fe req-d920754c-8dc4-4d0b-a3b2-ecac35b4c45e service nova] Creating event network-vif-unplugged:f852959f-05e2-49d9-95ba-a62b3b029d75 for instance 03d9aff4-215d-48fa-b741-2257b62fc597 on n-h1-master-1 Oct 30 01:19:30.299403 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [req-5af08bf7-511a-46b6-8ce4-d9468bd080fe req-d920754c-8dc4-4d0b-a3b2-ecac35b4c45e service nova] Instance 03d9aff4-215d-48fa-b741-2257b62fc597 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=121102) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 30 01:19:30.309095 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-86a663fd-b47b-468b-af6c-9c5647ebcfb4 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:30.319719 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-86a663fd-b47b-468b-af6c-9c5647ebcfb4 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a" status: 200 len: 1526 microversion: 2.1 time: 0.371722 Oct 30 01:19:30.335103 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 818/1681] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:29 2022] GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a => generated 1526 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:30.340382 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-5af08bf7-511a-46b6-8ce4-d9468bd080fe req-d920754c-8dc4-4d0b-a3b2-ecac35b4c45e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.090097 Oct 30 01:19:30.343979 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7536208b-9a77-47e0-88ed-6381ef58214e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:30.344393 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 864/1682] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:19:30.344992 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7536208b-9a77-47e0-88ed-6381ef58214e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 4e90ab5e-2dd7-4267-a5d2-9fc034e66c48] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:30.352634 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7536208b-9a77-47e0-88ed-6381ef58214e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:30.353412 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7536208b-9a77-47e0-88ed-6381ef58214e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:30.354026 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7536208b-9a77-47e0-88ed-6381ef58214e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:30.354891 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7536208b-9a77-47e0-88ed-6381ef58214e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:30.355503 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7536208b-9a77-47e0-88ed-6381ef58214e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:30.356326 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7536208b-9a77-47e0-88ed-6381ef58214e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:30.356722 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fd49a891-3cd3-46f0-97b9-23cec9f0b701 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:30.357478 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fd49a891-3cd3-46f0-97b9-23cec9f0b701 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0ec8b27d-8af5-45d7-892b-09297e5cb2d8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:30.373234 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fd49a891-3cd3-46f0-97b9-23cec9f0b701 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:30.374723 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fd49a891-3cd3-46f0-97b9-23cec9f0b701 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:30.382091 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fd49a891-3cd3-46f0-97b9-23cec9f0b701 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:30.383772 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fd49a891-3cd3-46f0-97b9-23cec9f0b701 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:30.384426 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fd49a891-3cd3-46f0-97b9-23cec9f0b701 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:30.385026 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fd49a891-3cd3-46f0-97b9-23cec9f0b701 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:30.653185 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7536208b-9a77-47e0-88ed-6381ef58214e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:30.661952 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7536208b-9a77-47e0-88ed-6381ef58214e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/4e90ab5e-2dd7-4267-a5d2-9fc034e66c48" status: 200 len: 1314 microversion: 2.1 time: 0.325321 Oct 30 01:19:30.662846 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 819/1683] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:30 2022] GET /compute/v2.1/servers/4e90ab5e-2dd7-4267-a5d2-9fc034e66c48 => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:30.670448 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-001df885-70a8-4184-98d0-00f50ad7bede tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:30.670793 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-001df885-70a8-4184-98d0-00f50ad7bede tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:30.671645 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-fd49a891-3cd3-46f0-97b9-23cec9f0b701 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:30.677360 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-001df885-70a8-4184-98d0-00f50ad7bede tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:30.678084 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-001df885-70a8-4184-98d0-00f50ad7bede tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:30.678645 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-001df885-70a8-4184-98d0-00f50ad7bede tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:30.679440 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-001df885-70a8-4184-98d0-00f50ad7bede tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:30.680140 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-001df885-70a8-4184-98d0-00f50ad7bede tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:30.680649 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-001df885-70a8-4184-98d0-00f50ad7bede tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:30.692642 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fd49a891-3cd3-46f0-97b9-23cec9f0b701 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8" status: 200 len: 1381 microversion: 2.1 time: 0.346455 Oct 30 01:19:30.694612 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 865/1684] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:30 2022] GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8 => generated 1381 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:30.700732 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-65c1c721-8e24-4134-8b77-840ca5b937e3 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:30.702098 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-65c1c721-8e24-4134-8b77-840ca5b937e3 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] [instance: 0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:30.714614 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-65c1c721-8e24-4134-8b77-840ca5b937e3 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:30.716177 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-65c1c721-8e24-4134-8b77-840ca5b937e3 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:30.717039 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-65c1c721-8e24-4134-8b77-840ca5b937e3 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:30.718298 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-65c1c721-8e24-4134-8b77-840ca5b937e3 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:30.719133 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-65c1c721-8e24-4134-8b77-840ca5b937e3 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:30.719730 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-65c1c721-8e24-4134-8b77-840ca5b937e3 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:30.739917 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-65c1c721-8e24-4134-8b77-840ca5b937e3 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] HTTP exception thrown: Instance 0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23 could not be found. Oct 30 01:19:30.741668 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-65c1c721-8e24-4134-8b77-840ca5b937e3 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Request method failure captured: Oct 30 01:19:30.741668 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23 HTTP/1.1 Oct 30 01:19:30.741668 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:19:30.741668 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:19:30.741668 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:19:30.741668 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:19:30.741668 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:19:30.741668 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:19:30.741668 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:19:30.741668 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:19:30.741668 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdBk0xP6qLxS5sPWxFYE5bz5ktt7IfA6J8qqZRy3Y39z4Qs7ncWPS8sQP0r-8b0chqJK7xLL4zbfOjp0fRJBTUFL4Xq44BrrOsYJ7ol7ActaK1dVYDOseFtct-wS2VTr5WT8c2-Vw6w4jGSj0n79X3CJsaG5bzUPRJQQSQGA6PB415g Oct 30 01:19:30.741668 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:19:30.741668 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:19:30.741668 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:19:30.741668 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:19:30.741668 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:19:30.741668 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:19:30.741668 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: d4681ed2d06840f995b37e550323d6ad Oct 30 01:19:30.741668 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-VolumesAdminNegativeTest-1892705985 Oct 30 01:19:30.741668 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:19:30.741668 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:19:30.743695 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d4681ed2d06840f995b37e550323d6ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d4681ed2d06840f995b37e550323d6ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d4681ed2d06840f995b37e550323d6ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d4681ed2d06840f995b37e550323d6ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:19:30.743695 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-VolumesAdminNegativeTest-1892705985 Oct 30 01:19:30.743695 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: d4681ed2d06840f995b37e550323d6ad Oct 30 01:19:30.743695 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1892705985 Oct 30 01:19:30.743695 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-VolumesAdminNegativeTest-1892705985-project Oct 30 01:19:30.743695 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:19:30.743695 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:19:30.743695 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: ec7269dc6d56440ca8691179f7275aeb Oct 30 01:19:30.743695 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-VolumesAdminNegativeTest-1892705985-project Oct 30 01:19:30.743695 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:19:30.743695 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23 could not be found. Oct 30 01:19:30.743695 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23'} Oct 30 01:19:30.744966 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:19:30.744966 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:19:30.744966 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:19:30.744966 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:19:30.744966 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:19:30.744966 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:19:30.744966 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:19:30.744966 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:19:30.744966 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:19:30.744966 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:19:30.744966 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23 could not be found. Oct 30 01:19:30.744966 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:19:30.744966 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:19:30.744966 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:19:30.744966 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:19:30.744966 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:19:30.744966 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:19:30.744966 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:19:30.744966 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:19:30.744966 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:19:30.746808 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:19:30.746808 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:19:30.746808 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:19:30.746808 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:19:30.746808 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:19:30.746808 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:19:30.746808 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:19:30.746808 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23 could not be found. Oct 30 01:19:30.746808 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:19:30.746808 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:19:30.746808 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:19:30.746808 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:19:30.746808 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:19:30.746808 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:19:30.746808 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:19:30.746808 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:19:30.746808 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23 could not be found. Oct 30 01:19:30.746808 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:19:30.748294 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-65c1c721-8e24-4134-8b77-840ca5b937e3 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Returning 404 to user: Instance 0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:19:30.748294 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-65c1c721-8e24-4134-8b77-840ca5b937e3 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] 10.222.0.13 "GET /compute/v2.1/servers/0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23" status: 404 len: 111 microversion: 2.1 time: 0.047358 Oct 30 01:19:30.748294 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 866/1685] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:30 2022] GET /compute/v2.1/servers/0eb06f0a-c45d-4f0c-b442-fbdf8cf9ea23 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:19:30.772921 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-001df885-70a8-4184-98d0-00f50ad7bede tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:30.793581 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-001df885-70a8-4184-98d0-00f50ad7bede tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:30.794496 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-001df885-70a8-4184-98d0-00f50ad7bede tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:30.801938 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-001df885-70a8-4184-98d0-00f50ad7bede tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1512 microversion: 2.91 time: 0.136765 Oct 30 01:19:30.803464 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 820/1686] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:19:30 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1512 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:19:30.963559 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fdfd8d3f-0a31-4057-a011-76c1dd7dd679 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:30.965611 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fdfd8d3f-0a31-4057-a011-76c1dd7dd679 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] [instance: 0ec8b27d-8af5-45d7-892b-09297e5cb2d8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:30.971721 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d9f7457e-33a8-4d20-a3f8-2ece4e6c1ac4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:30.972415 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d9f7457e-33a8-4d20-a3f8-2ece4e6c1ac4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 03d9aff4-215d-48fa-b741-2257b62fc597] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:30.974042 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fdfd8d3f-0a31-4057-a011-76c1dd7dd679 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:30.974963 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fdfd8d3f-0a31-4057-a011-76c1dd7dd679 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:30.975573 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fdfd8d3f-0a31-4057-a011-76c1dd7dd679 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:30.976892 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fdfd8d3f-0a31-4057-a011-76c1dd7dd679 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:30.977536 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fdfd8d3f-0a31-4057-a011-76c1dd7dd679 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:30.978243 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fdfd8d3f-0a31-4057-a011-76c1dd7dd679 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:30.987534 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d9f7457e-33a8-4d20-a3f8-2ece4e6c1ac4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:30.989101 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d9f7457e-33a8-4d20-a3f8-2ece4e6c1ac4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:30.989597 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d9f7457e-33a8-4d20-a3f8-2ece4e6c1ac4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:30.990353 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d9f7457e-33a8-4d20-a3f8-2ece4e6c1ac4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:30.994633 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d9f7457e-33a8-4d20-a3f8-2ece4e6c1ac4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:30.999383 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d9f7457e-33a8-4d20-a3f8-2ece4e6c1ac4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:31.391465 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fdfd8d3f-0a31-4057-a011-76c1dd7dd679 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8" status: 200 len: 1532 microversion: 2.1 time: 0.644541 Oct 30 01:19:31.392940 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 867/1687] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:30 2022] GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8 => generated 1532 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:31.404863 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-60f46d0a-73b7-473a-81b9-67326d40d0bd tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:31.406382 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-60f46d0a-73b7-473a-81b9-67326d40d0bd tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: c74142c0-5f39-44d8-b754-9c9ee956850a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:31.425760 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-60f46d0a-73b7-473a-81b9-67326d40d0bd tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:31.429829 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-60f46d0a-73b7-473a-81b9-67326d40d0bd tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:31.430626 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-60f46d0a-73b7-473a-81b9-67326d40d0bd tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:31.433164 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-60f46d0a-73b7-473a-81b9-67326d40d0bd tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:31.434754 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-60f46d0a-73b7-473a-81b9-67326d40d0bd tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:31.439227 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d9f7457e-33a8-4d20-a3f8-2ece4e6c1ac4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:31.446080 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-60f46d0a-73b7-473a-81b9-67326d40d0bd tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:31.452608 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d9f7457e-33a8-4d20-a3f8-2ece4e6c1ac4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597" status: 200 len: 1536 microversion: 2.1 time: 0.485427 Oct 30 01:19:31.455014 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 821/1688] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:30 2022] GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597 => generated 1536 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:19:31.461887 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3704e982-2f4a-41f3-9297-d702821ba698 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:31.463501 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3704e982-2f4a-41f3-9297-d702821ba698 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] [instance: 0ec8b27d-8af5-45d7-892b-09297e5cb2d8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:31.471419 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3704e982-2f4a-41f3-9297-d702821ba698 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:31.472380 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3704e982-2f4a-41f3-9297-d702821ba698 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:31.473927 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3704e982-2f4a-41f3-9297-d702821ba698 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:31.477069 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3704e982-2f4a-41f3-9297-d702821ba698 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:31.477913 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3704e982-2f4a-41f3-9297-d702821ba698 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:31.487523 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3704e982-2f4a-41f3-9297-d702821ba698 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:31.737869 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-60f46d0a-73b7-473a-81b9-67326d40d0bd tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:31.747804 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-60f46d0a-73b7-473a-81b9-67326d40d0bd tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a" status: 200 len: 1526 microversion: 2.1 time: 0.352500 Oct 30 01:19:31.751313 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 868/1689] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:31 2022] GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a => generated 1526 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:31.762003 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-551881d9-76d1-4e12-a098-926c0128dae6 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:31.768531 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-551881d9-76d1-4e12-a098-926c0128dae6 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 4e90ab5e-2dd7-4267-a5d2-9fc034e66c48] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:31.782748 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-551881d9-76d1-4e12-a098-926c0128dae6 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:31.783442 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-551881d9-76d1-4e12-a098-926c0128dae6 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:31.805668 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-551881d9-76d1-4e12-a098-926c0128dae6 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:31.807294 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-551881d9-76d1-4e12-a098-926c0128dae6 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:31.807720 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3704e982-2f4a-41f3-9297-d702821ba698 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8" status: 200 len: 1532 microversion: 2.1 time: 0.350189 Oct 30 01:19:31.809961 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 822/1690] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:31 2022] GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8 => generated 1532 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:31.810342 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-551881d9-76d1-4e12-a098-926c0128dae6 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:31.810970 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-551881d9-76d1-4e12-a098-926c0128dae6 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:31.832776 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c5a2dbac-1f79-4ef1-85f6-073e14edbdb5 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:31.833550 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c5a2dbac-1f79-4ef1-85f6-073e14edbdb5 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:31.842729 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c5a2dbac-1f79-4ef1-85f6-073e14edbdb5 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:31.846523 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c5a2dbac-1f79-4ef1-85f6-073e14edbdb5 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:31.847513 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c5a2dbac-1f79-4ef1-85f6-073e14edbdb5 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:31.849549 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c5a2dbac-1f79-4ef1-85f6-073e14edbdb5 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:31.851899 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c5a2dbac-1f79-4ef1-85f6-073e14edbdb5 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:31.852467 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c5a2dbac-1f79-4ef1-85f6-073e14edbdb5 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:32.456762 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c5a2dbac-1f79-4ef1-85f6-073e14edbdb5 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:32.471901 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c5a2dbac-1f79-4ef1-85f6-073e14edbdb5 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:32.477636 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c5a2dbac-1f79-4ef1-85f6-073e14edbdb5 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:32.489529 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c5a2dbac-1f79-4ef1-85f6-073e14edbdb5 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1512 microversion: 2.91 time: 0.660007 Oct 30 01:19:32.492880 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 823/1691] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:19:31 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1512 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:19:32.508652 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0577fba4-6ad6-45bf-aeeb-4ca9c2cf92bd tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:32.512844 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0577fba4-6ad6-45bf-aeeb-4ca9c2cf92bd tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:32.513572 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0577fba4-6ad6-45bf-aeeb-4ca9c2cf92bd tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:32.514176 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0577fba4-6ad6-45bf-aeeb-4ca9c2cf92bd tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:32.515107 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0577fba4-6ad6-45bf-aeeb-4ca9c2cf92bd tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:32.515747 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0577fba4-6ad6-45bf-aeeb-4ca9c2cf92bd tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:32.517220 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0577fba4-6ad6-45bf-aeeb-4ca9c2cf92bd tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:32.591543 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0577fba4-6ad6-45bf-aeeb-4ca9c2cf92bd tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.097137 Oct 30 01:19:32.602111 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 824/1692] 10.222.0.13 () {58 vars in 1176 bytes} [Sun Oct 30 01:19:32 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:19:32.607303 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-91d6ed37-7c2d-431f-a665-9eef0c85d5ac req-95ba9dc4-28ec-492e-a2bf-9a598cdd6c39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03d9aff4-215d-48fa-b741-2257b62fc597", "tag": "f852959f-05e2-49d9-95ba-a62b3b029d75"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:19:32.629402 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-91d6ed37-7c2d-431f-a665-9eef0c85d5ac req-95ba9dc4-28ec-492e-a2bf-9a598cdd6c39 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:32.638156 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-91d6ed37-7c2d-431f-a665-9eef0c85d5ac req-95ba9dc4-28ec-492e-a2bf-9a598cdd6c39 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:32.638899 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-91d6ed37-7c2d-431f-a665-9eef0c85d5ac req-95ba9dc4-28ec-492e-a2bf-9a598cdd6c39 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:32.648465 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-551881d9-76d1-4e12-a098-926c0128dae6 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:32.661494 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-91d6ed37-7c2d-431f-a665-9eef0c85d5ac req-95ba9dc4-28ec-492e-a2bf-9a598cdd6c39 service nova] Creating event network-changed:f852959f-05e2-49d9-95ba-a62b3b029d75 for instance 03d9aff4-215d-48fa-b741-2257b62fc597 on n-h1-master-1 Oct 30 01:19:32.671761 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [req-91d6ed37-7c2d-431f-a665-9eef0c85d5ac req-95ba9dc4-28ec-492e-a2bf-9a598cdd6c39 service nova] Instance 03d9aff4-215d-48fa-b741-2257b62fc597 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=121103) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 30 01:19:32.681598 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-551881d9-76d1-4e12-a098-926c0128dae6 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/4e90ab5e-2dd7-4267-a5d2-9fc034e66c48" status: 200 len: 1314 microversion: 2.1 time: 0.925941 Oct 30 01:19:32.682953 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 869/1693] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:31 2022] GET /compute/v2.1/servers/4e90ab5e-2dd7-4267-a5d2-9fc034e66c48 => generated 1314 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:32.684574 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-91d6ed37-7c2d-431f-a665-9eef0c85d5ac req-95ba9dc4-28ec-492e-a2bf-9a598cdd6c39 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080769 Oct 30 01:19:32.685677 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 825/1694] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:19:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:19:32.694948 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4ddd3e6d-750b-4a1f-b28c-c6fb157dd394 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:32.700327 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4ddd3e6d-750b-4a1f-b28c-c6fb157dd394 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 03d9aff4-215d-48fa-b741-2257b62fc597] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:32.700934 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-6b41d86d-f295-48db-a23c-3d4a2c03cdb2 req-167650a1-1158-4bc2-a6a2-502d5164b351 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c74142c0-5f39-44d8-b754-9c9ee956850a", "name": "network-vif-unplugged", "status": "completed", "tag": "6e6c0345-ef0b-4f04-abb3-43794b3a90ad"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:19:32.703820 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4ddd3e6d-750b-4a1f-b28c-c6fb157dd394 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:32.704368 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4ddd3e6d-750b-4a1f-b28c-c6fb157dd394 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:32.704951 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4ddd3e6d-750b-4a1f-b28c-c6fb157dd394 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:32.705926 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4ddd3e6d-750b-4a1f-b28c-c6fb157dd394 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:32.707255 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4ddd3e6d-750b-4a1f-b28c-c6fb157dd394 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:32.707870 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4ddd3e6d-750b-4a1f-b28c-c6fb157dd394 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:32.713595 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=100 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:32.738165 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-6b41d86d-f295-48db-a23c-3d4a2c03cdb2 req-167650a1-1158-4bc2-a6a2-502d5164b351 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:32.744265 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-6b41d86d-f295-48db-a23c-3d4a2c03cdb2 req-167650a1-1158-4bc2-a6a2-502d5164b351 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:32.746397 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-6b41d86d-f295-48db-a23c-3d4a2c03cdb2 req-167650a1-1158-4bc2-a6a2-502d5164b351 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:32.765620 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-6b41d86d-f295-48db-a23c-3d4a2c03cdb2 req-167650a1-1158-4bc2-a6a2-502d5164b351 service nova] Creating event network-vif-unplugged:6e6c0345-ef0b-4f04-abb3-43794b3a90ad for instance c74142c0-5f39-44d8-b754-9c9ee956850a on n-h2-master-1 Oct 30 01:19:32.774418 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-6b41d86d-f295-48db-a23c-3d4a2c03cdb2 req-167650a1-1158-4bc2-a6a2-502d5164b351 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087827 Oct 30 01:19:32.775188 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 870/1695] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:19:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:19:32.787776 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9e635526-58f5-4379-9f50-9f1ef6ac3dc3 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": false, "disk_over_commit": false}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:19:32.793702 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9e635526-58f5-4379-9f50-9f1ef6ac3dc3 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] [instance: 0ec8b27d-8af5-45d7-892b-09297e5cb2d8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:32.804992 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9e635526-58f5-4379-9f50-9f1ef6ac3dc3 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:32.806743 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9e635526-58f5-4379-9f50-9f1ef6ac3dc3 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:32.807569 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9e635526-58f5-4379-9f50-9f1ef6ac3dc3 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:32.808587 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9e635526-58f5-4379-9f50-9f1ef6ac3dc3 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:32.816049 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9e635526-58f5-4379-9f50-9f1ef6ac3dc3 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:32.816917 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9e635526-58f5-4379-9f50-9f1ef6ac3dc3 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:32.862164 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-9e635526-58f5-4379-9f50-9f1ef6ac3dc3 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lazy-loading 'flavor' on Instance uuid 0ec8b27d-8af5-45d7-892b-09297e5cb2d8 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:19:32.877187 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9e635526-58f5-4379-9f50-9f1ef6ac3dc3 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] [instance: 0ec8b27d-8af5-45d7-892b-09297e5cb2d8] Going to try to live migrate instance to n-h2-master-1 {{(pid=121102) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 30 01:19:33.088292 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4ddd3e6d-750b-4a1f-b28c-c6fb157dd394 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:33.100786 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4ddd3e6d-750b-4a1f-b28c-c6fb157dd394 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597" status: 200 len: 1536 microversion: 2.1 time: 0.413470 Oct 30 01:19:33.103550 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 826/1696] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:32 2022] GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597 => generated 1536 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:33.111557 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7e97748f-804d-4acd-b756-b1b5ee6f233e tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:33.136209 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7e97748f-804d-4acd-b756-b1b5ee6f233e tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: c74142c0-5f39-44d8-b754-9c9ee956850a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:33.136209 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7e97748f-804d-4acd-b756-b1b5ee6f233e tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:33.136209 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7e97748f-804d-4acd-b756-b1b5ee6f233e tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:33.136209 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7e97748f-804d-4acd-b756-b1b5ee6f233e tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:33.136863 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7e97748f-804d-4acd-b756-b1b5ee6f233e tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:33.136863 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7e97748f-804d-4acd-b756-b1b5ee6f233e tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:33.136863 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7e97748f-804d-4acd-b756-b1b5ee6f233e tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:33.592859 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7e97748f-804d-4acd-b756-b1b5ee6f233e tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:33.592859 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7e97748f-804d-4acd-b756-b1b5ee6f233e tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a" status: 200 len: 1526 microversion: 2.1 time: 0.432075 Oct 30 01:19:33.592859 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 827/1697] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:33 2022] GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a => generated 1526 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:33.592859 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1b77debb-cbb6-417d-acc6-3ef63e3f2085 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:33.593867 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1b77debb-cbb6-417d-acc6-3ef63e3f2085 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:33.593867 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1b77debb-cbb6-417d-acc6-3ef63e3f2085 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:33.593867 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1b77debb-cbb6-417d-acc6-3ef63e3f2085 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:33.593867 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1b77debb-cbb6-417d-acc6-3ef63e3f2085 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:33.594352 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1b77debb-cbb6-417d-acc6-3ef63e3f2085 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:33.594352 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1b77debb-cbb6-417d-acc6-3ef63e3f2085 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:33.594352 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1b77debb-cbb6-417d-acc6-3ef63e3f2085 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:33.658460 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1b77debb-cbb6-417d-acc6-3ef63e3f2085 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:33.668772 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1b77debb-cbb6-417d-acc6-3ef63e3f2085 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:33.671032 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1b77debb-cbb6-417d-acc6-3ef63e3f2085 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:33.677530 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1b77debb-cbb6-417d-acc6-3ef63e3f2085 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1533 microversion: 2.91 time: 0.136325 Oct 30 01:19:33.678199 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 828/1698] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:19:33 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1533 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:19:33.965909 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f177a218-3bc1-4fcd-ab97-57948dfcf3af tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:33.966542 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f177a218-3bc1-4fcd-ab97-57948dfcf3af tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:33.973653 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f177a218-3bc1-4fcd-ab97-57948dfcf3af tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:33.974399 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f177a218-3bc1-4fcd-ab97-57948dfcf3af tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:33.975013 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f177a218-3bc1-4fcd-ab97-57948dfcf3af tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:33.976519 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f177a218-3bc1-4fcd-ab97-57948dfcf3af tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:33.977312 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f177a218-3bc1-4fcd-ab97-57948dfcf3af tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:33.978134 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f177a218-3bc1-4fcd-ab97-57948dfcf3af tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:34.003920 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=6 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:34.059179 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-f177a218-3bc1-4fcd-ab97-57948dfcf3af tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] Lazy-loading 'services' on Instance uuid 7f48eff5-378b-4991-be0f-3657d6af305d {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:19:34.080622 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f177a218-3bc1-4fcd-ab97-57948dfcf3af tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1938 microversion: 2.91 time: 0.371981 Oct 30 01:19:34.081806 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 829/1699] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:19:33 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1938 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:19:34.087435 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f67a8427-9fc7-47e8-910b-b23e07d931c9 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:34.088267 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f67a8427-9fc7-47e8-910b-b23e07d931c9 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 4e90ab5e-2dd7-4267-a5d2-9fc034e66c48] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:34.094904 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f67a8427-9fc7-47e8-910b-b23e07d931c9 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:34.095644 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f67a8427-9fc7-47e8-910b-b23e07d931c9 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:34.096319 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f67a8427-9fc7-47e8-910b-b23e07d931c9 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:34.097189 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f67a8427-9fc7-47e8-910b-b23e07d931c9 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:34.097824 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f67a8427-9fc7-47e8-910b-b23e07d931c9 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:34.098398 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f67a8427-9fc7-47e8-910b-b23e07d931c9 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:34.477997 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f67a8427-9fc7-47e8-910b-b23e07d931c9 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:34.496721 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f67a8427-9fc7-47e8-910b-b23e07d931c9 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/4e90ab5e-2dd7-4267-a5d2-9fc034e66c48" status: 200 len: 1314 microversion: 2.1 time: 0.413677 Oct 30 01:19:34.497538 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 830/1700] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:34 2022] GET /compute/v2.1/servers/4e90ab5e-2dd7-4267-a5d2-9fc034e66c48 => generated 1314 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:34.512078 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3e4a2914-d907-45e1-8066-23e39d1f0adc tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:34.512708 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3e4a2914-d907-45e1-8066-23e39d1f0adc tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:34.523787 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3e4a2914-d907-45e1-8066-23e39d1f0adc tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:34.524617 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3e4a2914-d907-45e1-8066-23e39d1f0adc tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:34.525642 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3e4a2914-d907-45e1-8066-23e39d1f0adc tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:34.526576 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3e4a2914-d907-45e1-8066-23e39d1f0adc tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:34.527229 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3e4a2914-d907-45e1-8066-23e39d1f0adc tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:34.527853 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3e4a2914-d907-45e1-8066-23e39d1f0adc tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:34.646262 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-3e4a2914-d907-45e1-8066-23e39d1f0adc tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] Lazy-loading 'services' on Instance uuid 7f48eff5-378b-4991-be0f-3657d6af305d {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:19:34.687529 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3e4a2914-d907-45e1-8066-23e39d1f0adc tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1938 microversion: 2.91 time: 0.186989 Oct 30 01:19:34.691377 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 831/1701] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:19:34 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1938 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:19:34.704201 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4910a889-26b4-479c-96a0-b78d828b8b13 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:34.706073 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4910a889-26b4-479c-96a0-b78d828b8b13 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 03d9aff4-215d-48fa-b741-2257b62fc597] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:34.727711 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4910a889-26b4-479c-96a0-b78d828b8b13 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:34.728635 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4910a889-26b4-479c-96a0-b78d828b8b13 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:34.729310 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4910a889-26b4-479c-96a0-b78d828b8b13 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:34.734046 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4910a889-26b4-479c-96a0-b78d828b8b13 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:34.734815 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4910a889-26b4-479c-96a0-b78d828b8b13 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:34.735651 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4910a889-26b4-479c-96a0-b78d828b8b13 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:34.989815 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=5 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:35.010387 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4910a889-26b4-479c-96a0-b78d828b8b13 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:35.018351 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4910a889-26b4-479c-96a0-b78d828b8b13 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597" status: 200 len: 1536 microversion: 2.1 time: 0.325244 Oct 30 01:19:35.019023 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 832/1702] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:34 2022] GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597 => generated 1536 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:35.026149 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-b489c229-1da9-4db4-ab14-f1e7372e5490 req-930ab3aa-caaf-4c49-8bf9-7467c99f052b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e90ab5e-2dd7-4267-a5d2-9fc034e66c48", "tag": "6e7071a6-b59c-4b5b-8430-fdd0113ad41b"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:19:35.051898 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-b489c229-1da9-4db4-ab14-f1e7372e5490 req-930ab3aa-caaf-4c49-8bf9-7467c99f052b service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:35.053689 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-b489c229-1da9-4db4-ab14-f1e7372e5490 req-930ab3aa-caaf-4c49-8bf9-7467c99f052b service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:35.056373 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-b489c229-1da9-4db4-ab14-f1e7372e5490 req-930ab3aa-caaf-4c49-8bf9-7467c99f052b service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:35.080051 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-b489c229-1da9-4db4-ab14-f1e7372e5490 req-930ab3aa-caaf-4c49-8bf9-7467c99f052b service nova] Creating event network-changed:6e7071a6-b59c-4b5b-8430-fdd0113ad41b for instance 4e90ab5e-2dd7-4267-a5d2-9fc034e66c48 on n-h2-master-1 Oct 30 01:19:35.092694 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-b489c229-1da9-4db4-ab14-f1e7372e5490 req-930ab3aa-caaf-4c49-8bf9-7467c99f052b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072399 Oct 30 01:19:35.096612 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 833/1703] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:19:35.102949 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-176c6bca-2051-48a9-816c-9cf454f9aaf7 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:35.110961 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-176c6bca-2051-48a9-816c-9cf454f9aaf7 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: c74142c0-5f39-44d8-b754-9c9ee956850a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:35.122746 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-176c6bca-2051-48a9-816c-9cf454f9aaf7 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:35.125446 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-176c6bca-2051-48a9-816c-9cf454f9aaf7 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:35.128512 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-176c6bca-2051-48a9-816c-9cf454f9aaf7 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:35.129601 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-176c6bca-2051-48a9-816c-9cf454f9aaf7 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:35.130298 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-176c6bca-2051-48a9-816c-9cf454f9aaf7 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:35.130965 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-176c6bca-2051-48a9-816c-9cf454f9aaf7 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:35.188316 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:35.192825 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-176c6bca-2051-48a9-816c-9cf454f9aaf7 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:35.193624 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-176c6bca-2051-48a9-816c-9cf454f9aaf7 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:35.194591 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-176c6bca-2051-48a9-816c-9cf454f9aaf7 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:35.195242 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-176c6bca-2051-48a9-816c-9cf454f9aaf7 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lazy-loading 'fault' on Instance uuid c74142c0-5f39-44d8-b754-9c9ee956850a {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:19:35.243522 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-176c6bca-2051-48a9-816c-9cf454f9aaf7 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:35.254069 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-176c6bca-2051-48a9-816c-9cf454f9aaf7 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a" status: 200 len: 1314 microversion: 2.1 time: 0.154091 Oct 30 01:19:35.254069 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 834/1704] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:35 2022] GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:35.258354 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-08490780-c415-4e03-9a89-f34352df2159 tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:35.262289 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08490780-c415-4e03-9a89-f34352df2159 tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:35.262989 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08490780-c415-4e03-9a89-f34352df2159 tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:35.263611 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08490780-c415-4e03-9a89-f34352df2159 tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:35.264732 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08490780-c415-4e03-9a89-f34352df2159 tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:35.265499 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08490780-c415-4e03-9a89-f34352df2159 tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:35.266163 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08490780-c415-4e03-9a89-f34352df2159 tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:35.298876 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-08490780-c415-4e03-9a89-f34352df2159 tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.043971 Oct 30 01:19:35.306463 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 835/1705] 10.222.0.13 () {60 vars in 1217 bytes} [Sun Oct 30 01:19:35 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:19:35.312719 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-017090b0-ed64-45d7-8d5e-75de70e7e8bf req-2de8a9d3-5d13-40cf-a7c4-34a0dd6e67d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c74142c0-5f39-44d8-b754-9c9ee956850a", "name": "network-vif-deleted", "tag": "6e6c0345-ef0b-4f04-abb3-43794b3a90ad"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:19:35.323006 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-017090b0-ed64-45d7-8d5e-75de70e7e8bf req-2de8a9d3-5d13-40cf-a7c4-34a0dd6e67d8 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:35.323473 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-017090b0-ed64-45d7-8d5e-75de70e7e8bf req-2de8a9d3-5d13-40cf-a7c4-34a0dd6e67d8 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:35.332295 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-017090b0-ed64-45d7-8d5e-75de70e7e8bf req-2de8a9d3-5d13-40cf-a7c4-34a0dd6e67d8 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:35.339041 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-017090b0-ed64-45d7-8d5e-75de70e7e8bf req-2de8a9d3-5d13-40cf-a7c4-34a0dd6e67d8 service nova] Creating event network-vif-deleted:6e6c0345-ef0b-4f04-abb3-43794b3a90ad for instance c74142c0-5f39-44d8-b754-9c9ee956850a on n-h2-master-1 Oct 30 01:19:35.344253 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-017090b0-ed64-45d7-8d5e-75de70e7e8bf req-2de8a9d3-5d13-40cf-a7c4-34a0dd6e67d8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041408 Oct 30 01:19:35.345201 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 836/1706] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:19:35.355087 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-aac9496b-0e09-4f5d-8c7d-014149d4c1b8 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:19:35.355722 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-aac9496b-0e09-4f5d-8c7d-014149d4c1b8 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:35.362502 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aac9496b-0e09-4f5d-8c7d-014149d4c1b8 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:35.363016 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aac9496b-0e09-4f5d-8c7d-014149d4c1b8 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:35.363479 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aac9496b-0e09-4f5d-8c7d-014149d4c1b8 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:35.364197 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aac9496b-0e09-4f5d-8c7d-014149d4c1b8 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:35.364649 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aac9496b-0e09-4f5d-8c7d-014149d4c1b8 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:35.365074 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aac9496b-0e09-4f5d-8c7d-014149d4c1b8 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:35.449038 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-aac9496b-0e09-4f5d-8c7d-014149d4c1b8 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lazy-loading 'flavor' on Instance uuid 7f48eff5-378b-4991-be0f-3657d6af305d {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:19:35.529211 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=10 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:36.063299 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-aac9496b-0e09-4f5d-8c7d-014149d4c1b8 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "POST /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d/action" status: 202 len: 0 microversion: 2.91 time: 0.716682 Oct 30 01:19:36.064587 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 837/1707] 10.222.0.13 () {62 vars in 1319 bytes} [Sun Oct 30 01:19:35 2022] POST /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d/action => generated 0 bytes in 719 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:19:36.103532 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6f29c895-611e-498f-8bc4-f53913a35a52 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:36.104600 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6f29c895-611e-498f-8bc4-f53913a35a52 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 4e90ab5e-2dd7-4267-a5d2-9fc034e66c48] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:36.115669 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f29c895-611e-498f-8bc4-f53913a35a52 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:36.116059 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f29c895-611e-498f-8bc4-f53913a35a52 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:36.117373 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f29c895-611e-498f-8bc4-f53913a35a52 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:36.118188 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f29c895-611e-498f-8bc4-f53913a35a52 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:36.118745 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f29c895-611e-498f-8bc4-f53913a35a52 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:36.120077 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f29c895-611e-498f-8bc4-f53913a35a52 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:36.340432 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6f29c895-611e-498f-8bc4-f53913a35a52 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:36.348204 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6f29c895-611e-498f-8bc4-f53913a35a52 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/4e90ab5e-2dd7-4267-a5d2-9fc034e66c48" status: 200 len: 1314 microversion: 2.1 time: 0.273176 Oct 30 01:19:36.349407 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 838/1708] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:36 2022] GET /compute/v2.1/servers/4e90ab5e-2dd7-4267-a5d2-9fc034e66c48 => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:36.354726 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b5f24134-c3df-4943-ba28-e9760e3aad3a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:36.355543 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b5f24134-c3df-4943-ba28-e9760e3aad3a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 03d9aff4-215d-48fa-b741-2257b62fc597] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:36.375630 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b5f24134-c3df-4943-ba28-e9760e3aad3a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:36.376434 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b5f24134-c3df-4943-ba28-e9760e3aad3a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:36.377061 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b5f24134-c3df-4943-ba28-e9760e3aad3a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:36.378094 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b5f24134-c3df-4943-ba28-e9760e3aad3a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:36.378709 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b5f24134-c3df-4943-ba28-e9760e3aad3a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:36.379350 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b5f24134-c3df-4943-ba28-e9760e3aad3a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:36.543244 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b5f24134-c3df-4943-ba28-e9760e3aad3a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:36.555287 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b5f24134-c3df-4943-ba28-e9760e3aad3a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597" status: 200 len: 1529 microversion: 2.1 time: 0.204607 Oct 30 01:19:36.559308 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 839/1709] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:36 2022] GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597 => generated 1529 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:36.569928 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-83efb33a-aef4-433e-b701-ff8ac8dbca66 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:36.575561 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-83efb33a-aef4-433e-b701-ff8ac8dbca66 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:36.588762 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-83efb33a-aef4-433e-b701-ff8ac8dbca66 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:36.589547 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-83efb33a-aef4-433e-b701-ff8ac8dbca66 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:36.590675 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-83efb33a-aef4-433e-b701-ff8ac8dbca66 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:36.593818 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-83efb33a-aef4-433e-b701-ff8ac8dbca66 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:36.597696 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-83efb33a-aef4-433e-b701-ff8ac8dbca66 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:36.598450 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-83efb33a-aef4-433e-b701-ff8ac8dbca66 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:36.712572 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-83efb33a-aef4-433e-b701-ff8ac8dbca66 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:36.721872 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-83efb33a-aef4-433e-b701-ff8ac8dbca66 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:36.723771 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-83efb33a-aef4-433e-b701-ff8ac8dbca66 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:36.729718 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-83efb33a-aef4-433e-b701-ff8ac8dbca66 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1539 microversion: 2.91 time: 0.169142 Oct 30 01:19:36.730907 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 840/1710] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:19:36 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1539 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:19:36.735901 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a8acae71-c161-473a-8113-bd248f386cb7 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:36.739291 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a8acae71-c161-473a-8113-bd248f386cb7 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: c74142c0-5f39-44d8-b754-9c9ee956850a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:36.743739 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a8acae71-c161-473a-8113-bd248f386cb7 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:36.744536 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a8acae71-c161-473a-8113-bd248f386cb7 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:36.745232 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a8acae71-c161-473a-8113-bd248f386cb7 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:36.746286 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a8acae71-c161-473a-8113-bd248f386cb7 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:36.746955 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a8acae71-c161-473a-8113-bd248f386cb7 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:36.747653 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a8acae71-c161-473a-8113-bd248f386cb7 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:36.823676 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a8acae71-c161-473a-8113-bd248f386cb7 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:36.824198 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a8acae71-c161-473a-8113-bd248f386cb7 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:36.824638 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a8acae71-c161-473a-8113-bd248f386cb7 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:36.825112 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-a8acae71-c161-473a-8113-bd248f386cb7 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lazy-loading 'fault' on Instance uuid c74142c0-5f39-44d8-b754-9c9ee956850a {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:19:36.851659 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:36.921686 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a8acae71-c161-473a-8113-bd248f386cb7 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:36.931035 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a8acae71-c161-473a-8113-bd248f386cb7 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a" status: 200 len: 1314 microversion: 2.1 time: 0.198747 Oct 30 01:19:36.935988 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 841/1711] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:36 2022] GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:36.946449 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3b05ed31-27d8-423c-8187-9fd2f129f64f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:36.946449 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3b05ed31-27d8-423c-8187-9fd2f129f64f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 03d9aff4-215d-48fa-b741-2257b62fc597] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:36.949552 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b05ed31-27d8-423c-8187-9fd2f129f64f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:36.949552 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b05ed31-27d8-423c-8187-9fd2f129f64f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:36.949552 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b05ed31-27d8-423c-8187-9fd2f129f64f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:36.949552 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b05ed31-27d8-423c-8187-9fd2f129f64f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:36.949989 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b05ed31-27d8-423c-8187-9fd2f129f64f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:36.949989 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b05ed31-27d8-423c-8187-9fd2f129f64f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:37.164724 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3b05ed31-27d8-423c-8187-9fd2f129f64f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:37.181568 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3b05ed31-27d8-423c-8187-9fd2f129f64f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597" status: 200 len: 1529 microversion: 2.1 time: 0.247467 Oct 30 01:19:37.195065 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 842/1712] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:36 2022] GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597 => generated 1529 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:37.215349 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0884ad00-10d3-49bc-85b6-3c3b441c8f44 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:37.215878 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0884ad00-10d3-49bc-85b6-3c3b441c8f44 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] [instance: 1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:37.222642 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0884ad00-10d3-49bc-85b6-3c3b441c8f44 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:37.223163 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0884ad00-10d3-49bc-85b6-3c3b441c8f44 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:37.223721 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0884ad00-10d3-49bc-85b6-3c3b441c8f44 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:37.225245 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0884ad00-10d3-49bc-85b6-3c3b441c8f44 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:37.226490 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0884ad00-10d3-49bc-85b6-3c3b441c8f44 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:37.226929 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0884ad00-10d3-49bc-85b6-3c3b441c8f44 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:37.264679 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0884ad00-10d3-49bc-85b6-3c3b441c8f44 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] [instance: 1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:19:37.630408 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0884ad00-10d3-49bc-85b6-3c3b441c8f44 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] 10.222.0.13 "DELETE /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1" status: 204 len: 0 microversion: 2.1 time: 0.431705 Oct 30 01:19:37.630586 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 843/1713] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:19:37 2022] DELETE /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:19:37.638274 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-85db9357-9a75-4538-a46d-9f72dd52db14 tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:37.648217 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-85db9357-9a75-4538-a46d-9f72dd52db14 tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] HTTP exception thrown: Flavor 9e6ff59f-7364-4d1d-bbe2-085a6800db3f could not be found. Oct 30 01:19:37.651669 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-85db9357-9a75-4538-a46d-9f72dd52db14 tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] Request method failure captured: Oct 30 01:19:37.651669 n-d-master-1 devstack@n-api.service[121103]: request: DELETE /compute/v2.1/flavors/9e6ff59f-7364-4d1d-bbe2-085a6800db3f HTTP/1.1 Oct 30 01:19:37.651669 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:19:37.651669 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:19:37.651669 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:19:37.651669 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:19:37.651669 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:19:37.651669 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:19:37.651669 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:19:37.651669 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:19:37.651669 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdAcMzia7vJbRi73thm2qA-WgYYVDQPHd_s8nLtmBXaQxG5ygzNCAw28mnNcjtPint3gkTwrhmNfRSOHpg_RmEuhEDJ7SoN3KVUCNur80mopeVc-XNtbSSYHIULLmt3ZvPUJ4esWS3vd6BNyKVob4gb66xb3Jag4WfqDFv-FvUuzjas Oct 30 01:19:37.651669 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:19:37.651669 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:19:37.651669 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:19:37.651669 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:19:37.651669 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:19:37.651669 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:19:37.651669 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 8212ea2596df443dbc6cf5494d994b7b Oct 30 01:19:37.651669 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-MigrationsAdminTest-807149175 Oct 30 01:19:37.651669 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,admin,reader Oct 30 01:19:37.651669 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,admin,reader Oct 30 01:19:37.653509 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8212ea2596df443dbc6cf5494d994b7b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8212ea2596df443dbc6cf5494d994b7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8212ea2596df443dbc6cf5494d994b7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8212ea2596df443dbc6cf5494d994b7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:19:37.653509 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-MigrationsAdminTest-807149175 Oct 30 01:19:37.653509 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 8212ea2596df443dbc6cf5494d994b7b Oct 30 01:19:37.653509 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-MigrationsAdminTest-807149175 Oct 30 01:19:37.653509 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-MigrationsAdminTest-807149175-project-admin Oct 30 01:19:37.653509 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:19:37.653509 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:19:37.653509 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 1d811dc93ede4dbebc25f91027b6dfa9 Oct 30 01:19:37.653509 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-MigrationsAdminTest-807149175-project-admin Oct 30 01:19:37.653509 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:19:37.653509 n-d-master-1 devstack@n-api.service[121103]: exception: Flavor 9e6ff59f-7364-4d1d-bbe2-085a6800db3f could not be found. Oct 30 01:19:37.653509 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '9e6ff59f-7364-4d1d-bbe2-085a6800db3f'} Oct 30 01:19:37.654687 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:19:37.654687 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:19:37.654687 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 30 01:19:37.654687 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 30 01:19:37.654687 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 30 01:19:37.654687 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 30 01:19:37.654687 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 30 01:19:37.654687 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 30 01:19:37.654687 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 30 01:19:37.654687 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 30 01:19:37.654687 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 30 01:19:37.654687 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 30 01:19:37.654687 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 30 01:19:37.654687 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 30 01:19:37.654687 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 9e6ff59f-7364-4d1d-bbe2-085a6800db3f could not be found. Oct 30 01:19:37.654687 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:19:37.654687 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:19:37.654687 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:19:37.654687 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:19:37.654687 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:19:37.656775 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:19:37.656775 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:19:37.656775 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:19:37.656775 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:19:37.656775 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:19:37.656775 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 30 01:19:37.656775 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:19:37.656775 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 9e6ff59f-7364-4d1d-bbe2-085a6800db3f could not be found. Oct 30 01:19:37.656775 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:19:37.656775 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:19:37.656775 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:19:37.656775 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:19:37.656775 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:19:37.656775 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:19:37.656775 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:19:37.656775 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:19:37.656775 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 9e6ff59f-7364-4d1d-bbe2-085a6800db3f could not be found. Oct 30 01:19:37.656775 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:19:37.661471 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-85db9357-9a75-4538-a46d-9f72dd52db14 tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] Returning 404 to user: Flavor 9e6ff59f-7364-4d1d-bbe2-085a6800db3f could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:19:37.662539 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-85db9357-9a75-4538-a46d-9f72dd52db14 tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/9e6ff59f-7364-4d1d-bbe2-085a6800db3f" status: 404 len: 109 microversion: 2.1 time: 0.030498 Oct 30 01:19:37.664040 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 844/1714] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:19:37 2022] DELETE /compute/v2.1/flavors/9e6ff59f-7364-4d1d-bbe2-085a6800db3f => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:19:37.671286 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3ce220f7-5efc-42dd-af0e-bd5bdcb6fadc tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:37.672345 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3ce220f7-5efc-42dd-af0e-bd5bdcb6fadc tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 4e90ab5e-2dd7-4267-a5d2-9fc034e66c48] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:37.682359 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3ce220f7-5efc-42dd-af0e-bd5bdcb6fadc tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:37.683147 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3ce220f7-5efc-42dd-af0e-bd5bdcb6fadc tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:37.684765 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3ce220f7-5efc-42dd-af0e-bd5bdcb6fadc tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:37.685699 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3ce220f7-5efc-42dd-af0e-bd5bdcb6fadc tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:37.686318 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3ce220f7-5efc-42dd-af0e-bd5bdcb6fadc tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:37.687570 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3ce220f7-5efc-42dd-af0e-bd5bdcb6fadc tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:38.064116 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3ce220f7-5efc-42dd-af0e-bd5bdcb6fadc tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:38.077842 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3ce220f7-5efc-42dd-af0e-bd5bdcb6fadc tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/4e90ab5e-2dd7-4267-a5d2-9fc034e66c48" status: 200 len: 1314 microversion: 2.1 time: 0.412504 Oct 30 01:19:38.078790 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 845/1715] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:37 2022] GET /compute/v2.1/servers/4e90ab5e-2dd7-4267-a5d2-9fc034e66c48 => generated 1314 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:38.099015 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0ce06533-c83e-4979-ba28-81e5d8506493 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:38.101614 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0ce06533-c83e-4979-ba28-81e5d8506493 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] [instance: 1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:38.116668 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0ce06533-c83e-4979-ba28-81e5d8506493 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:38.117422 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0ce06533-c83e-4979-ba28-81e5d8506493 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:38.118009 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0ce06533-c83e-4979-ba28-81e5d8506493 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:38.118873 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0ce06533-c83e-4979-ba28-81e5d8506493 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:38.119436 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0ce06533-c83e-4979-ba28-81e5d8506493 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:38.119977 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0ce06533-c83e-4979-ba28-81e5d8506493 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:38.288357 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0ce06533-c83e-4979-ba28-81e5d8506493 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7269dc6d56440ca8691179f7275aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4681ed2d06840f995b37e550323d6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:38.299383 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0ce06533-c83e-4979-ba28-81e5d8506493 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] 10.222.0.13 "GET /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1" status: 200 len: 1683 microversion: 2.1 time: 0.219253 Oct 30 01:19:38.309534 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 846/1716] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:38 2022] GET /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1 => generated 1683 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:38.314204 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a6bd7009-1b8d-495d-aff9-ce08d36b486e tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:38.314984 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a6bd7009-1b8d-495d-aff9-ce08d36b486e tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:38.324804 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a6bd7009-1b8d-495d-aff9-ce08d36b486e tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:38.326781 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a6bd7009-1b8d-495d-aff9-ce08d36b486e tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:38.326781 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a6bd7009-1b8d-495d-aff9-ce08d36b486e tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:38.326781 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a6bd7009-1b8d-495d-aff9-ce08d36b486e tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:38.327148 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a6bd7009-1b8d-495d-aff9-ce08d36b486e tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:38.327413 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a6bd7009-1b8d-495d-aff9-ce08d36b486e tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:38.419664 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a6bd7009-1b8d-495d-aff9-ce08d36b486e tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:38.428645 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a6bd7009-1b8d-495d-aff9-ce08d36b486e tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:38.430842 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a6bd7009-1b8d-495d-aff9-ce08d36b486e tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:38.437267 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a6bd7009-1b8d-495d-aff9-ce08d36b486e tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1539 microversion: 2.91 time: 0.136077 Oct 30 01:19:38.437884 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 847/1717] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:19:38 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1539 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:19:38.460418 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-4089b63f-3e74-4b4f-97ff-c26c8b2e171b req-2dc4a9e7-59f6-444d-824e-31002894d8cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03d9aff4-215d-48fa-b741-2257b62fc597", "name": "network-vif-plugged", "status": "completed", "tag": "f852959f-05e2-49d9-95ba-a62b3b029d75"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:19:38.470130 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-4089b63f-3e74-4b4f-97ff-c26c8b2e171b req-2dc4a9e7-59f6-444d-824e-31002894d8cd service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:38.470617 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-4089b63f-3e74-4b4f-97ff-c26c8b2e171b req-2dc4a9e7-59f6-444d-824e-31002894d8cd service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:38.471051 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-4089b63f-3e74-4b4f-97ff-c26c8b2e171b req-2dc4a9e7-59f6-444d-824e-31002894d8cd service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:38.482834 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-4089b63f-3e74-4b4f-97ff-c26c8b2e171b req-2dc4a9e7-59f6-444d-824e-31002894d8cd service nova] Creating event network-vif-plugged:f852959f-05e2-49d9-95ba-a62b3b029d75 for instance 03d9aff4-215d-48fa-b741-2257b62fc597 on n-h1-master-1 Oct 30 01:19:38.487746 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-4089b63f-3e74-4b4f-97ff-c26c8b2e171b req-2dc4a9e7-59f6-444d-824e-31002894d8cd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047557 Oct 30 01:19:38.488573 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 848/1718] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:19:38.494965 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3693ec68-043a-4500-a469-f293e0f8aec5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-124221089", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:19:38.495347 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9e635526-58f5-4379-9f50-9f1ef6ac3dc3 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8/action" status: 202 len: 0 microversion: 2.1 time: 5.717728 Oct 30 01:19:38.499164 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 871/1719] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:19:32 2022] POST /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8/action => generated 0 bytes in 5721 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:19:38.500913 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3e187c4a-bbe4-449f-828a-30297be2fe1e tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:38.501750 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3e187c4a-bbe4-449f-828a-30297be2fe1e tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: c74142c0-5f39-44d8-b754-9c9ee956850a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:38.508433 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3e187c4a-bbe4-449f-828a-30297be2fe1e tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:38.508928 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3e187c4a-bbe4-449f-828a-30297be2fe1e tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:38.509394 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3e187c4a-bbe4-449f-828a-30297be2fe1e tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:38.510114 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3e187c4a-bbe4-449f-828a-30297be2fe1e tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:38.510644 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3e187c4a-bbe4-449f-828a-30297be2fe1e tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:38.511087 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3e187c4a-bbe4-449f-828a-30297be2fe1e tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:38.527841 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-3e187c4a-bbe4-449f-828a-30297be2fe1e tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] HTTP exception thrown: Instance c74142c0-5f39-44d8-b754-9c9ee956850a could not be found. Oct 30 01:19:38.529838 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3e187c4a-bbe4-449f-828a-30297be2fe1e tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Request method failure captured: Oct 30 01:19:38.529838 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a HTTP/1.1 Oct 30 01:19:38.529838 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:19:38.529838 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:19:38.529838 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:19:38.529838 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:19:38.529838 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:19:38.529838 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:19:38.529838 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:19:38.529838 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:19:38.529838 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdD3IhIPYY_sTvEXpI9r1a34kazQy3xsqStabQonrlcEF0HpNl2ztWpirnqs0lietV1LWWVyHjCqAxxd5t3TuUU6o10qW3LK2oIPKGmvwXDy1lrrZEL1UVe632zfYCdkIUu5geJi4tWcEpwgvNOLoS3eMkj37BIJt_45I78bzhHVIS8 Oct 30 01:19:38.529838 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:19:38.529838 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:19:38.529838 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:19:38.529838 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:19:38.529838 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:19:38.529838 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:19:38.529838 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 8c2cd7e4b04741e3bb1cb9852612db57 Oct 30 01:19:38.529838 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1966575233 Oct 30 01:19:38.529838 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:19:38.529838 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:19:38.531601 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c2cd7e4b04741e3bb1cb9852612db57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8c2cd7e4b04741e3bb1cb9852612db57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8c2cd7e4b04741e3bb1cb9852612db57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c2cd7e4b04741e3bb1cb9852612db57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:19:38.531601 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1966575233 Oct 30 01:19:38.531601 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 8c2cd7e4b04741e3bb1cb9852612db57 Oct 30 01:19:38.531601 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1966575233 Oct 30 01:19:38.531601 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ImagesOneServerNegativeTestJSON-1966575233-project Oct 30 01:19:38.531601 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:19:38.531601 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:19:38.531601 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: c114d44d0a314c75902da53fca797f62 Oct 30 01:19:38.531601 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1966575233-project Oct 30 01:19:38.531601 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:19:38.531601 n-d-master-1 devstack@n-api.service[121102]: exception: Instance c74142c0-5f39-44d8-b754-9c9ee956850a could not be found. Oct 30 01:19:38.531601 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'c74142c0-5f39-44d8-b754-9c9ee956850a'} Oct 30 01:19:38.532546 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:19:38.532546 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:19:38.532546 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:19:38.532546 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:19:38.532546 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:19:38.532546 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:19:38.532546 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:19:38.532546 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:19:38.532546 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:19:38.532546 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:19:38.532546 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c74142c0-5f39-44d8-b754-9c9ee956850a could not be found. Oct 30 01:19:38.532546 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:19:38.532546 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:19:38.532546 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:19:38.532546 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:19:38.532546 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:19:38.532546 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:19:38.532546 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:19:38.532546 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:19:38.532546 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:19:38.534287 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:19:38.534287 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:19:38.534287 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:19:38.534287 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:19:38.534287 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:19:38.534287 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:19:38.534287 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:19:38.534287 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c74142c0-5f39-44d8-b754-9c9ee956850a could not be found. Oct 30 01:19:38.534287 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:19:38.534287 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:19:38.534287 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:19:38.534287 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:19:38.534287 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:19:38.534287 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:19:38.534287 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:19:38.534287 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:19:38.534287 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c74142c0-5f39-44d8-b754-9c9ee956850a could not be found. Oct 30 01:19:38.534287 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:19:38.536376 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3e187c4a-bbe4-449f-828a-30297be2fe1e tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Returning 404 to user: Instance c74142c0-5f39-44d8-b754-9c9ee956850a could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:19:38.537522 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3e187c4a-bbe4-449f-828a-30297be2fe1e tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a" status: 404 len: 111 microversion: 2.1 time: 0.040385 Oct 30 01:19:38.539179 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 872/1720] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:38 2022] GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:19:38.577090 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-3693ec68-043a-4500-a469-f293e0f8aec5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] validate_networks() for None {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:19:38.703793 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ae51843f-2225-4f86-a8fc-7b05455e7342 tempest-QuotaClassesAdminTestJSON-164601860 tempest-QuotaClassesAdminTestJSON-164601860-project-admin] Calling method '.version_select at 0x7f44d0455ee0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:38.720696 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ae51843f-2225-4f86-a8fc-7b05455e7342 tempest-QuotaClassesAdminTestJSON-164601860 tempest-QuotaClassesAdminTestJSON-164601860-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.180135 Oct 30 01:19:38.721649 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 873/1721] 10.222.0.13 () {58 vars in 1185 bytes} [Sun Oct 30 01:19:38 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:19:38.733453 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-25d7eb53-79d4-4892-aef5-6be7192504a2 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:38.734354 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-25d7eb53-79d4-4892-aef5-6be7192504a2 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0ec8b27d-8af5-45d7-892b-09297e5cb2d8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:38.740479 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25d7eb53-79d4-4892-aef5-6be7192504a2 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:38.740965 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25d7eb53-79d4-4892-aef5-6be7192504a2 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:38.742148 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25d7eb53-79d4-4892-aef5-6be7192504a2 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:38.746159 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25d7eb53-79d4-4892-aef5-6be7192504a2 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:38.746159 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25d7eb53-79d4-4892-aef5-6be7192504a2 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:38.746159 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25d7eb53-79d4-4892-aef5-6be7192504a2 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:38.748867 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:38.838275 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-3693ec68-043a-4500-a469-f293e0f8aec5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:19:38.838703 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-3693ec68-043a-4500-a469-f293e0f8aec5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:19:38.839183 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-3693ec68-043a-4500-a469-f293e0f8aec5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:19:38.839596 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-3693ec68-043a-4500-a469-f293e0f8aec5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:19:38.843494 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-3693ec68-043a-4500-a469-f293e0f8aec5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:19:38.850115 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3693ec68-043a-4500-a469-f293e0f8aec5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:38.850689 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3693ec68-043a-4500-a469-f293e0f8aec5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:38.851886 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3693ec68-043a-4500-a469-f293e0f8aec5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:38.852544 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3693ec68-043a-4500-a469-f293e0f8aec5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:38.853017 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3693ec68-043a-4500-a469-f293e0f8aec5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:38.853513 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3693ec68-043a-4500-a469-f293e0f8aec5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:38.894523 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-3693ec68-043a-4500-a469-f293e0f8aec5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Getting quotas for project ad621909b99143dd9885006238de72a6. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:19:38.907796 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-3693ec68-043a-4500-a469-f293e0f8aec5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Getting quotas for user 4f1fe6e04e064dfba969b07d4188ab38 and project ad621909b99143dd9885006238de72a6. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:19:38.925112 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-25d7eb53-79d4-4892-aef5-6be7192504a2 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:38.936389 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3693ec68-043a-4500-a469-f293e0f8aec5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:19:38.937002 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-25d7eb53-79d4-4892-aef5-6be7192504a2 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8" status: 200 len: 1391 microversion: 2.1 time: 0.213701 Oct 30 01:19:38.938251 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 874/1722] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:38 2022] GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8 => generated 1391 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:38.944063 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ed8a1177-d93c-43e4-8289-74aeeac53c1e tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Action: 'create', calling method: .version_select at 0x7f44d0474b80>, body: {"keypair": {"name": "tempest-keypair-903860967", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFVrpOhySEpAQUjL96cdDvBXghM3cxY54tqqdBdBODZBrSQDx8yiZXNzIJJrscJzIaQCiZjE7XSc4r++7GZD1Fnek9q7WZVikNBkim4ntKifBk6FVrMP1y18Bj39sAsbg=="}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:19:38.946202 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3693ec68-043a-4500-a469-f293e0f8aec5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: e7ff7c82-b3f6-4172-be0d-1c67c30db4f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:19:38.965867 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-ed8a1177-d93c-43e4-8289-74aeeac53c1e tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Getting quotas for project 8c2cd7e4b04741e3bb1cb9852612db57. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:19:38.987576 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-ed8a1177-d93c-43e4-8289-74aeeac53c1e tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Getting quotas for user c114d44d0a314c75902da53fca797f62 and project 8c2cd7e4b04741e3bb1cb9852612db57. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:19:39.089655 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ed8a1177-d93c-43e4-8289-74aeeac53c1e tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.149856 Oct 30 01:19:39.090371 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 875/1723] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 30 01:19:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:19:39.095872 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-28cd58f2-1c73-47d2-846d-2a521b28a130 tempest-QuotaClassesAdminTestJSON-164601860 tempest-QuotaClassesAdminTestJSON-164601860-project-admin] Action: 'update', calling method: .version_select at 0x7f44d03ff550>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:19:39.102921 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:39.166004 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3693ec68-043a-4500-a469-f293e0f8aec5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.676280 Oct 30 01:19:39.167279 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 849/1724] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:19:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:19:39.171762 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0d073854-9b39-4c4d-b45f-d4b5c3a56bd3 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:39.172490 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0d073854-9b39-4c4d-b45f-d4b5c3a56bd3 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 4e90ab5e-2dd7-4267-a5d2-9fc034e66c48] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:39.180314 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d073854-9b39-4c4d-b45f-d4b5c3a56bd3 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:39.180963 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d073854-9b39-4c4d-b45f-d4b5c3a56bd3 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:39.182431 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d073854-9b39-4c4d-b45f-d4b5c3a56bd3 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:39.183644 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d073854-9b39-4c4d-b45f-d4b5c3a56bd3 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:39.184223 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d073854-9b39-4c4d-b45f-d4b5c3a56bd3 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:39.185327 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d073854-9b39-4c4d-b45f-d4b5c3a56bd3 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:39.573943 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0d073854-9b39-4c4d-b45f-d4b5c3a56bd3 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:39.585099 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0d073854-9b39-4c4d-b45f-d4b5c3a56bd3 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/4e90ab5e-2dd7-4267-a5d2-9fc034e66c48" status: 200 len: 1314 microversion: 2.1 time: 0.416557 Oct 30 01:19:39.603624 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 850/1725] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:39 2022] GET /compute/v2.1/servers/4e90ab5e-2dd7-4267-a5d2-9fc034e66c48 => generated 1314 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:39.618652 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4e1a03c0-2a63-46d8-9595-ebead5866224 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:39.620622 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4e1a03c0-2a63-46d8-9595-ebead5866224 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: e7ff7c82-b3f6-4172-be0d-1c67c30db4f7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:39.790599 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4e1a03c0-2a63-46d8-9595-ebead5866224 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:39.801988 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4e1a03c0-2a63-46d8-9595-ebead5866224 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7" status: 200 len: 1212 microversion: 2.1 time: 0.194204 Oct 30 01:19:39.803040 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 851/1726] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:39 2022] GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 => generated 1212 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:39.815059 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-acfb39ea-5fdd-4021-8363-51075e4aef2f tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:39.817441 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-acfb39ea-5fdd-4021-8363-51075e4aef2f tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] [instance: 1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:39.831195 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-acfb39ea-5fdd-4021-8363-51075e4aef2f tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:39.833933 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-acfb39ea-5fdd-4021-8363-51075e4aef2f tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:39.835848 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-acfb39ea-5fdd-4021-8363-51075e4aef2f tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:39.837706 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-acfb39ea-5fdd-4021-8363-51075e4aef2f tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:39.838418 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-acfb39ea-5fdd-4021-8363-51075e4aef2f tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:39.840162 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-acfb39ea-5fdd-4021-8363-51075e4aef2f tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:40.240667 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-acfb39ea-5fdd-4021-8363-51075e4aef2f tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7269dc6d56440ca8691179f7275aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4681ed2d06840f995b37e550323d6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:40.249773 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-acfb39ea-5fdd-4021-8363-51075e4aef2f tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] 10.222.0.13 "GET /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1" status: 200 len: 1683 microversion: 2.1 time: 0.445534 Oct 30 01:19:40.250515 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 852/1727] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:39 2022] GET /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1 => generated 1683 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:40.255518 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0b3a3bfa-7353-4c53-9b0a-1ac97adfe582 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:40.256401 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0b3a3bfa-7353-4c53-9b0a-1ac97adfe582 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:40.262785 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b3a3bfa-7353-4c53-9b0a-1ac97adfe582 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:40.266148 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b3a3bfa-7353-4c53-9b0a-1ac97adfe582 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:40.266148 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b3a3bfa-7353-4c53-9b0a-1ac97adfe582 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:40.266148 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b3a3bfa-7353-4c53-9b0a-1ac97adfe582 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:40.266148 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b3a3bfa-7353-4c53-9b0a-1ac97adfe582 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:40.266561 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b3a3bfa-7353-4c53-9b0a-1ac97adfe582 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:40.388176 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0b3a3bfa-7353-4c53-9b0a-1ac97adfe582 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:40.392540 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0b3a3bfa-7353-4c53-9b0a-1ac97adfe582 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:40.395067 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0b3a3bfa-7353-4c53-9b0a-1ac97adfe582 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:40.401535 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0b3a3bfa-7353-4c53-9b0a-1ac97adfe582 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1539 microversion: 2.91 time: 0.149702 Oct 30 01:19:40.402125 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 853/1728] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:19:40 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1539 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:19:40.408212 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-22a0cfe4-daab-4bdb-9801-b0b3f516f71e tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:40.409505 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-22a0cfe4-daab-4bdb-9801-b0b3f516f71e tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0ec8b27d-8af5-45d7-892b-09297e5cb2d8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:40.418105 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22a0cfe4-daab-4bdb-9801-b0b3f516f71e tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:40.421845 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22a0cfe4-daab-4bdb-9801-b0b3f516f71e tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:40.423031 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22a0cfe4-daab-4bdb-9801-b0b3f516f71e tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:40.423958 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22a0cfe4-daab-4bdb-9801-b0b3f516f71e tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:40.425190 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22a0cfe4-daab-4bdb-9801-b0b3f516f71e tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:40.425933 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22a0cfe4-daab-4bdb-9801-b0b3f516f71e tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:40.583827 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-28cd58f2-1c73-47d2-846d-2a521b28a130 tempest-QuotaClassesAdminTestJSON-164601860 tempest-QuotaClassesAdminTestJSON-164601860-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 1.492300 Oct 30 01:19:40.585832 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 876/1729] 10.222.0.13 () {60 vars in 1206 bytes} [Sun Oct 30 01:19:39 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:19:40.598180 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-91fec473-f972-430a-a041-05b078282e4a tempest-QuotaClassesAdminTestJSON-164601860 tempest-QuotaClassesAdminTestJSON-164601860-project-admin] Calling method '.version_select at 0x7f44d04a9670>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:40.625929 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-91fec473-f972-430a-a041-05b078282e4a tempest-QuotaClassesAdminTestJSON-164601860 tempest-QuotaClassesAdminTestJSON-164601860-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.031497 Oct 30 01:19:40.634803 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 877/1730] 10.222.0.13 () {58 vars in 1185 bytes} [Sun Oct 30 01:19:40 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:19:40.641599 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-01559676-140a-472a-888a-763056355610 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:40.642622 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-01559676-140a-472a-888a-763056355610 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 4e90ab5e-2dd7-4267-a5d2-9fc034e66c48] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:40.651878 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-01559676-140a-472a-888a-763056355610 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:40.652630 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-01559676-140a-472a-888a-763056355610 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:40.653292 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-01559676-140a-472a-888a-763056355610 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:40.654323 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-01559676-140a-472a-888a-763056355610 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:40.655293 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-01559676-140a-472a-888a-763056355610 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:40.655902 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-01559676-140a-472a-888a-763056355610 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:40.689197 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-22a0cfe4-daab-4bdb-9801-b0b3f516f71e tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:40.704615 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-22a0cfe4-daab-4bdb-9801-b0b3f516f71e tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8" status: 200 len: 1391 microversion: 2.1 time: 0.300171 Oct 30 01:19:40.705557 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 854/1731] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:40 2022] GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8 => generated 1391 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:40.719277 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-33a7c007-6298-4164-ae5e-86f217e4adab tempest-QuotaClassesAdminTestJSON-164601860 tempest-QuotaClassesAdminTestJSON-164601860-project-admin] Action: 'update', calling method: .version_select at 0x7f44c7b51820>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:19:40.816875 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-01559676-140a-472a-888a-763056355610 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:40.827217 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-01559676-140a-472a-888a-763056355610 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/4e90ab5e-2dd7-4267-a5d2-9fc034e66c48" status: 200 len: 1314 microversion: 2.1 time: 0.190410 Oct 30 01:19:40.828094 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 878/1732] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:40 2022] GET /compute/v2.1/servers/4e90ab5e-2dd7-4267-a5d2-9fc034e66c48 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:40.834647 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bba37fe8-8200-4f23-bc53-57553f558359 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:40.835838 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bba37fe8-8200-4f23-bc53-57553f558359 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: e7ff7c82-b3f6-4172-be0d-1c67c30db4f7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:40.854514 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bba37fe8-8200-4f23-bc53-57553f558359 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:40.855453 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bba37fe8-8200-4f23-bc53-57553f558359 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:40.856095 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bba37fe8-8200-4f23-bc53-57553f558359 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:40.856949 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bba37fe8-8200-4f23-bc53-57553f558359 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:40.857619 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bba37fe8-8200-4f23-bc53-57553f558359 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:40.858087 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bba37fe8-8200-4f23-bc53-57553f558359 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:40.990409 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bba37fe8-8200-4f23-bc53-57553f558359 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:41.010813 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bba37fe8-8200-4f23-bc53-57553f558359 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7" status: 200 len: 1216 microversion: 2.1 time: 0.181479 Oct 30 01:19:41.011430 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 879/1733] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:40 2022] GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 => generated 1216 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:41.276551 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bd8e7d5c-c723-44ea-b26a-4c1cace533b1 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:41.277614 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bd8e7d5c-c723-44ea-b26a-4c1cace533b1 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] [instance: 1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:41.287565 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bd8e7d5c-c723-44ea-b26a-4c1cace533b1 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:41.288261 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bd8e7d5c-c723-44ea-b26a-4c1cace533b1 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:41.288742 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bd8e7d5c-c723-44ea-b26a-4c1cace533b1 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:41.294603 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bd8e7d5c-c723-44ea-b26a-4c1cace533b1 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:41.295579 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bd8e7d5c-c723-44ea-b26a-4c1cace533b1 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:41.296190 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bd8e7d5c-c723-44ea-b26a-4c1cace533b1 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:41.540659 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bd8e7d5c-c723-44ea-b26a-4c1cace533b1 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7269dc6d56440ca8691179f7275aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4681ed2d06840f995b37e550323d6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:41.564126 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bd8e7d5c-c723-44ea-b26a-4c1cace533b1 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] 10.222.0.13 "GET /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1" status: 200 len: 1615 microversion: 2.1 time: 0.292347 Oct 30 01:19:41.578935 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 880/1734] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:41 2022] GET /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1 => generated 1615 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:19:41.589284 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-af9514b5-6060-4cf9-bf56-9013f8738cca req-d59af330-37e1-4b05-833e-bb8134f7cb92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e90ab5e-2dd7-4267-a5d2-9fc034e66c48", "name": "network-vif-plugged", "status": "completed", "tag": "6e7071a6-b59c-4b5b-8430-fdd0113ad41b"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:19:41.618253 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-af9514b5-6060-4cf9-bf56-9013f8738cca req-d59af330-37e1-4b05-833e-bb8134f7cb92 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:41.618770 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-af9514b5-6060-4cf9-bf56-9013f8738cca req-d59af330-37e1-4b05-833e-bb8134f7cb92 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:41.619236 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-af9514b5-6060-4cf9-bf56-9013f8738cca req-d59af330-37e1-4b05-833e-bb8134f7cb92 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:41.650806 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-af9514b5-6060-4cf9-bf56-9013f8738cca req-d59af330-37e1-4b05-833e-bb8134f7cb92 service nova] Creating event network-vif-plugged:6e7071a6-b59c-4b5b-8430-fdd0113ad41b for instance 4e90ab5e-2dd7-4267-a5d2-9fc034e66c48 on n-h2-master-1 Oct 30 01:19:41.657837 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-af9514b5-6060-4cf9-bf56-9013f8738cca req-d59af330-37e1-4b05-833e-bb8134f7cb92 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077207 Oct 30 01:19:41.659005 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 881/1735] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:19:41.665391 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bd3a74d1-095b-4a1a-9195-2e451dcd7359 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:41.666526 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bd3a74d1-095b-4a1a-9195-2e451dcd7359 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:41.674723 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bd3a74d1-095b-4a1a-9195-2e451dcd7359 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:41.675989 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bd3a74d1-095b-4a1a-9195-2e451dcd7359 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:41.676661 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bd3a74d1-095b-4a1a-9195-2e451dcd7359 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:41.677616 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bd3a74d1-095b-4a1a-9195-2e451dcd7359 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:41.678373 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bd3a74d1-095b-4a1a-9195-2e451dcd7359 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:41.679087 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bd3a74d1-095b-4a1a-9195-2e451dcd7359 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:41.850849 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bd3a74d1-095b-4a1a-9195-2e451dcd7359 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:41.878563 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bd3a74d1-095b-4a1a-9195-2e451dcd7359 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:41.887983 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bd3a74d1-095b-4a1a-9195-2e451dcd7359 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:41.911666 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bd3a74d1-095b-4a1a-9195-2e451dcd7359 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1539 microversion: 2.91 time: 0.251126 Oct 30 01:19:41.923173 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 882/1736] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:19:41 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1539 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:19:41.942195 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d11033b2-324a-4353-b25d-efb70bf0bee7 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:41.943137 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d11033b2-324a-4353-b25d-efb70bf0bee7 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0ec8b27d-8af5-45d7-892b-09297e5cb2d8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:41.953081 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d11033b2-324a-4353-b25d-efb70bf0bee7 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:41.954185 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d11033b2-324a-4353-b25d-efb70bf0bee7 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:41.955625 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d11033b2-324a-4353-b25d-efb70bf0bee7 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:41.957038 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d11033b2-324a-4353-b25d-efb70bf0bee7 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:41.957932 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d11033b2-324a-4353-b25d-efb70bf0bee7 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:41.958573 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d11033b2-324a-4353-b25d-efb70bf0bee7 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:42.164423 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d11033b2-324a-4353-b25d-efb70bf0bee7 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:42.173489 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d11033b2-324a-4353-b25d-efb70bf0bee7 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8" status: 200 len: 1391 microversion: 2.1 time: 0.245989 Oct 30 01:19:42.174811 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 883/1737] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:41 2022] GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8 => generated 1391 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:42.181177 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-73bc5d9b-31c7-45b2-b2a7-63731b330caf req-39324459-92c5-4736-98c3-1bd39fe2e752 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1", "name": "network-vif-deleted", "tag": "5bb2b2c2-2ed3-4110-a964-fde80b9cd12f"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:19:42.192524 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-73bc5d9b-31c7-45b2-b2a7-63731b330caf req-39324459-92c5-4736-98c3-1bd39fe2e752 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:42.193152 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-73bc5d9b-31c7-45b2-b2a7-63731b330caf req-39324459-92c5-4736-98c3-1bd39fe2e752 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:42.193915 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-73bc5d9b-31c7-45b2-b2a7-63731b330caf req-39324459-92c5-4736-98c3-1bd39fe2e752 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:42.207900 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-73bc5d9b-31c7-45b2-b2a7-63731b330caf req-39324459-92c5-4736-98c3-1bd39fe2e752 service nova] Creating event network-vif-deleted:5bb2b2c2-2ed3-4110-a964-fde80b9cd12f for instance 1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1 on n-h2-master-1 Oct 30 01:19:42.214080 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-73bc5d9b-31c7-45b2-b2a7-63731b330caf req-39324459-92c5-4736-98c3-1bd39fe2e752 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037503 Oct 30 01:19:42.215269 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 884/1738] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:19:42.222655 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5a054b17-2db4-40e6-9dde-85cf585e849b tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:42.223745 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5a054b17-2db4-40e6-9dde-85cf585e849b tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 4e90ab5e-2dd7-4267-a5d2-9fc034e66c48] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:42.232069 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a054b17-2db4-40e6-9dde-85cf585e849b tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:42.232931 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a054b17-2db4-40e6-9dde-85cf585e849b tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:42.233682 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a054b17-2db4-40e6-9dde-85cf585e849b tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:42.234828 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a054b17-2db4-40e6-9dde-85cf585e849b tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:42.235565 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a054b17-2db4-40e6-9dde-85cf585e849b tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:42.236255 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a054b17-2db4-40e6-9dde-85cf585e849b tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:42.397095 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5a054b17-2db4-40e6-9dde-85cf585e849b tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:42.406055 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5a054b17-2db4-40e6-9dde-85cf585e849b tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/4e90ab5e-2dd7-4267-a5d2-9fc034e66c48" status: 200 len: 1314 microversion: 2.1 time: 0.188942 Oct 30 01:19:42.409487 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 885/1739] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:42 2022] GET /compute/v2.1/servers/4e90ab5e-2dd7-4267-a5d2-9fc034e66c48 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:42.415610 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1f3d6822-47c6-479f-b873-eaadfc5a548d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:42.416315 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1f3d6822-47c6-479f-b873-eaadfc5a548d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: e7ff7c82-b3f6-4172-be0d-1c67c30db4f7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:42.423197 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1f3d6822-47c6-479f-b873-eaadfc5a548d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:42.423692 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1f3d6822-47c6-479f-b873-eaadfc5a548d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:42.424176 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1f3d6822-47c6-479f-b873-eaadfc5a548d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:42.424888 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1f3d6822-47c6-479f-b873-eaadfc5a548d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:42.425450 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1f3d6822-47c6-479f-b873-eaadfc5a548d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:42.425898 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1f3d6822-47c6-479f-b873-eaadfc5a548d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:42.497054 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1f3d6822-47c6-479f-b873-eaadfc5a548d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:42.505748 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1f3d6822-47c6-479f-b873-eaadfc5a548d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7" status: 200 len: 1264 microversion: 2.1 time: 0.097839 Oct 30 01:19:42.506570 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 886/1740] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:42 2022] GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 => generated 1264 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:42.562250 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-33a7c007-6298-4164-ae5e-86f217e4adab tempest-QuotaClassesAdminTestJSON-164601860 tempest-QuotaClassesAdminTestJSON-164601860-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 1.854408 Oct 30 01:19:42.563672 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 855/1741] 10.222.0.13 () {60 vars in 1206 bytes} [Sun Oct 30 01:19:40 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 1857 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:19:42.594454 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-667f8b41-65a1-4810-be56-c2f0d9576b96 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:42.595674 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-667f8b41-65a1-4810-be56-c2f0d9576b96 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] [instance: 1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:42.604065 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-667f8b41-65a1-4810-be56-c2f0d9576b96 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:42.605149 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-667f8b41-65a1-4810-be56-c2f0d9576b96 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:42.605994 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-667f8b41-65a1-4810-be56-c2f0d9576b96 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:42.607335 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-667f8b41-65a1-4810-be56-c2f0d9576b96 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:42.607928 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-667f8b41-65a1-4810-be56-c2f0d9576b96 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:42.608460 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-667f8b41-65a1-4810-be56-c2f0d9576b96 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:42.671708 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-667f8b41-65a1-4810-be56-c2f0d9576b96 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:42.673488 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-667f8b41-65a1-4810-be56-c2f0d9576b96 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:42.673488 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-667f8b41-65a1-4810-be56-c2f0d9576b96 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:42.673712 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-667f8b41-65a1-4810-be56-c2f0d9576b96 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lazy-loading 'fault' on Instance uuid 1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:19:42.740246 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-667f8b41-65a1-4810-be56-c2f0d9576b96 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7269dc6d56440ca8691179f7275aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4681ed2d06840f995b37e550323d6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:42.750300 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-667f8b41-65a1-4810-be56-c2f0d9576b96 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] 10.222.0.13 "GET /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1" status: 200 len: 1332 microversion: 2.1 time: 0.161119 Oct 30 01:19:42.752388 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 887/1742] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:42 2022] GET /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1 => generated 1332 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:42.944269 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-19c862e7-c773-4113-bc14-96fbf7484de5 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:42.947370 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-19c862e7-c773-4113-bc14-96fbf7484de5 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:42.950840 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=13,nova_api:INSERT=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:42.959140 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-19c862e7-c773-4113-bc14-96fbf7484de5 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:42.961940 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-19c862e7-c773-4113-bc14-96fbf7484de5 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:42.962911 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-19c862e7-c773-4113-bc14-96fbf7484de5 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:42.964588 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-19c862e7-c773-4113-bc14-96fbf7484de5 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:42.965455 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-19c862e7-c773-4113-bc14-96fbf7484de5 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:42.966752 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-19c862e7-c773-4113-bc14-96fbf7484de5 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:43.066352 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-19c862e7-c773-4113-bc14-96fbf7484de5 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:43.076006 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-19c862e7-c773-4113-bc14-96fbf7484de5 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:43.077928 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-19c862e7-c773-4113-bc14-96fbf7484de5 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:43.085618 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-19c862e7-c773-4113-bc14-96fbf7484de5 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1539 microversion: 2.91 time: 0.145363 Oct 30 01:19:43.101845 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 856/1743] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:19:42 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1539 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:19:43.209480 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c2d4c19b-49d8-42fc-a51f-160ab97c79be tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:43.209480 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c2d4c19b-49d8-42fc-a51f-160ab97c79be tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0ec8b27d-8af5-45d7-892b-09297e5cb2d8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:43.211264 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c2d4c19b-49d8-42fc-a51f-160ab97c79be tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:43.211772 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c2d4c19b-49d8-42fc-a51f-160ab97c79be tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:43.212208 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c2d4c19b-49d8-42fc-a51f-160ab97c79be tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:43.215560 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c2d4c19b-49d8-42fc-a51f-160ab97c79be tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:43.230140 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c2d4c19b-49d8-42fc-a51f-160ab97c79be tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:43.230906 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c2d4c19b-49d8-42fc-a51f-160ab97c79be tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:43.429954 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c2d4c19b-49d8-42fc-a51f-160ab97c79be tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:43.432297 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-15340064-b47b-4bae-83a2-789cd8457504 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:43.432702 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-15340064-b47b-4bae-83a2-789cd8457504 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 4e90ab5e-2dd7-4267-a5d2-9fc034e66c48] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:43.445403 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-15340064-b47b-4bae-83a2-789cd8457504 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:43.448478 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-15340064-b47b-4bae-83a2-789cd8457504 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:43.448977 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-15340064-b47b-4bae-83a2-789cd8457504 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:43.449756 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-15340064-b47b-4bae-83a2-789cd8457504 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:43.450226 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-15340064-b47b-4bae-83a2-789cd8457504 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:43.450655 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-15340064-b47b-4bae-83a2-789cd8457504 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:43.450800 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c2d4c19b-49d8-42fc-a51f-160ab97c79be tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8" status: 200 len: 1391 microversion: 2.1 time: 0.254504 Oct 30 01:19:43.451303 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 888/1744] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:43 2022] GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8 => generated 1391 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:43.530026 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9a3dac9d-b9d5-4e11-a79b-ce94a658fb28 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:43.530746 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9a3dac9d-b9d5-4e11-a79b-ce94a658fb28 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: e7ff7c82-b3f6-4172-be0d-1c67c30db4f7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:43.547661 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9a3dac9d-b9d5-4e11-a79b-ce94a658fb28 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:43.548167 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9a3dac9d-b9d5-4e11-a79b-ce94a658fb28 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:43.548609 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9a3dac9d-b9d5-4e11-a79b-ce94a658fb28 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:43.555240 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9a3dac9d-b9d5-4e11-a79b-ce94a658fb28 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:43.555758 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9a3dac9d-b9d5-4e11-a79b-ce94a658fb28 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:43.556198 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9a3dac9d-b9d5-4e11-a79b-ce94a658fb28 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:43.730566 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-15340064-b47b-4bae-83a2-789cd8457504 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:43.741075 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-15340064-b47b-4bae-83a2-789cd8457504 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/4e90ab5e-2dd7-4267-a5d2-9fc034e66c48" status: 200 len: 1314 microversion: 2.1 time: 0.313374 Oct 30 01:19:43.742749 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 857/1745] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:43 2022] GET /compute/v2.1/servers/4e90ab5e-2dd7-4267-a5d2-9fc034e66c48 => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:19:43.775926 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9a3dac9d-b9d5-4e11-a79b-ce94a658fb28 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:43.781228 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fbdb4555-076f-4614-8706-6c2c12ee63f7 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:43.781881 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-fbdb4555-076f-4614-8706-6c2c12ee63f7 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] [instance: 1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:43.786323 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9a3dac9d-b9d5-4e11-a79b-ce94a658fb28 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7" status: 200 len: 1272 microversion: 2.1 time: 0.260208 Oct 30 01:19:43.787857 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 889/1746] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:43 2022] GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 => generated 1272 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:19:43.808462 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fbdb4555-076f-4614-8706-6c2c12ee63f7 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:43.809969 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fbdb4555-076f-4614-8706-6c2c12ee63f7 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:43.814912 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fbdb4555-076f-4614-8706-6c2c12ee63f7 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:43.814912 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fbdb4555-076f-4614-8706-6c2c12ee63f7 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:43.814912 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fbdb4555-076f-4614-8706-6c2c12ee63f7 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:43.814912 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fbdb4555-076f-4614-8706-6c2c12ee63f7 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:43.860404 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fbdb4555-076f-4614-8706-6c2c12ee63f7 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:43.860818 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fbdb4555-076f-4614-8706-6c2c12ee63f7 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:43.861256 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fbdb4555-076f-4614-8706-6c2c12ee63f7 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:43.861747 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-fbdb4555-076f-4614-8706-6c2c12ee63f7 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lazy-loading 'fault' on Instance uuid 1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:19:43.946276 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-fbdb4555-076f-4614-8706-6c2c12ee63f7 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7269dc6d56440ca8691179f7275aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4681ed2d06840f995b37e550323d6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:43.960040 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fbdb4555-076f-4614-8706-6c2c12ee63f7 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] 10.222.0.13 "GET /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1" status: 200 len: 1332 microversion: 2.1 time: 0.183684 Oct 30 01:19:43.960963 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 858/1747] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:43 2022] GET /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1 => generated 1332 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:19:44.114805 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-100d8506-9b3d-4a91-8eaf-9210534c9c32 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:44.116526 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-100d8506-9b3d-4a91-8eaf-9210534c9c32 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:44.122924 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-100d8506-9b3d-4a91-8eaf-9210534c9c32 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:44.123609 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-100d8506-9b3d-4a91-8eaf-9210534c9c32 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:44.124414 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-100d8506-9b3d-4a91-8eaf-9210534c9c32 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:44.124946 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-100d8506-9b3d-4a91-8eaf-9210534c9c32 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:44.125591 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-100d8506-9b3d-4a91-8eaf-9210534c9c32 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:44.126573 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-100d8506-9b3d-4a91-8eaf-9210534c9c32 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:44.195388 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-100d8506-9b3d-4a91-8eaf-9210534c9c32 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:44.203518 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-100d8506-9b3d-4a91-8eaf-9210534c9c32 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:44.204982 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-100d8506-9b3d-4a91-8eaf-9210534c9c32 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:44.219301 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-100d8506-9b3d-4a91-8eaf-9210534c9c32 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1539 microversion: 2.91 time: 0.108395 Oct 30 01:19:44.219894 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 890/1748] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:19:44 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1539 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:19:44.325859 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7a36e759-75f3-4008-ac0f-adc8281f5610 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1345270965", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:19:44.393614 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-7a36e759-75f3-4008-ac0f-adc8281f5610 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] validate_networks() for [('a974e348-14e9-416b-aba2-e255412b1fdd', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:19:44.477012 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-136de73a-2c25-454b-af9a-7b19806877e8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:44.479688 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-136de73a-2c25-454b-af9a-7b19806877e8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0ec8b27d-8af5-45d7-892b-09297e5cb2d8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:44.486067 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-136de73a-2c25-454b-af9a-7b19806877e8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:44.486628 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-136de73a-2c25-454b-af9a-7b19806877e8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:44.487356 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-136de73a-2c25-454b-af9a-7b19806877e8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:44.488095 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-136de73a-2c25-454b-af9a-7b19806877e8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:44.488777 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-136de73a-2c25-454b-af9a-7b19806877e8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:44.489465 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-136de73a-2c25-454b-af9a-7b19806877e8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:44.756222 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-136de73a-2c25-454b-af9a-7b19806877e8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:44.766971 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-136de73a-2c25-454b-af9a-7b19806877e8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8" status: 200 len: 1391 microversion: 2.1 time: 0.294432 Oct 30 01:19:44.768103 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 891/1749] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:44 2022] GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8 => generated 1391 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:44.785549 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e5327b60-5c8d-4703-ad85-251b5ded3c21 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:44.786264 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e5327b60-5c8d-4703-ad85-251b5ded3c21 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 4e90ab5e-2dd7-4267-a5d2-9fc034e66c48] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:44.799494 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e5327b60-5c8d-4703-ad85-251b5ded3c21 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:44.799994 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e5327b60-5c8d-4703-ad85-251b5ded3c21 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:44.800432 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e5327b60-5c8d-4703-ad85-251b5ded3c21 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:44.801143 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e5327b60-5c8d-4703-ad85-251b5ded3c21 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:44.801615 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e5327b60-5c8d-4703-ad85-251b5ded3c21 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:44.802292 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e5327b60-5c8d-4703-ad85-251b5ded3c21 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:45.025185 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-7a36e759-75f3-4008-ac0f-adc8281f5610 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:19:45.025733 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-7a36e759-75f3-4008-ac0f-adc8281f5610 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:19:45.026813 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-7a36e759-75f3-4008-ac0f-adc8281f5610 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:19:45.027213 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-7a36e759-75f3-4008-ac0f-adc8281f5610 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:19:45.027685 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-7a36e759-75f3-4008-ac0f-adc8281f5610 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:19:45.037582 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7a36e759-75f3-4008-ac0f-adc8281f5610 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:45.039929 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7a36e759-75f3-4008-ac0f-adc8281f5610 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:45.039929 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7a36e759-75f3-4008-ac0f-adc8281f5610 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:45.039929 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7a36e759-75f3-4008-ac0f-adc8281f5610 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:45.040237 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7a36e759-75f3-4008-ac0f-adc8281f5610 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:45.040410 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7a36e759-75f3-4008-ac0f-adc8281f5610 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:45.046772 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e5327b60-5c8d-4703-ad85-251b5ded3c21 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:45.055775 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e5327b60-5c8d-4703-ad85-251b5ded3c21 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/4e90ab5e-2dd7-4267-a5d2-9fc034e66c48" status: 200 len: 1502 microversion: 2.1 time: 0.286440 Oct 30 01:19:45.061381 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 892/1750] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:44 2022] GET /compute/v2.1/servers/4e90ab5e-2dd7-4267-a5d2-9fc034e66c48 => generated 1502 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:45.061636 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b41cffce-1240-4beb-ad99-ba59b5a68c3a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:45.062256 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b41cffce-1240-4beb-ad99-ba59b5a68c3a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: e7ff7c82-b3f6-4172-be0d-1c67c30db4f7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:45.071750 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b41cffce-1240-4beb-ad99-ba59b5a68c3a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:45.072230 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b41cffce-1240-4beb-ad99-ba59b5a68c3a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:45.072679 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b41cffce-1240-4beb-ad99-ba59b5a68c3a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:45.073617 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b41cffce-1240-4beb-ad99-ba59b5a68c3a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:45.074232 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b41cffce-1240-4beb-ad99-ba59b5a68c3a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:45.074671 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b41cffce-1240-4beb-ad99-ba59b5a68c3a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:45.075512 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-7a36e759-75f3-4008-ac0f-adc8281f5610 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Getting quotas for project 8c2cd7e4b04741e3bb1cb9852612db57. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:19:45.083058 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-7a36e759-75f3-4008-ac0f-adc8281f5610 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Getting quotas for user c114d44d0a314c75902da53fca797f62 and project 8c2cd7e4b04741e3bb1cb9852612db57. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:19:45.098236 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7a36e759-75f3-4008-ac0f-adc8281f5610 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:19:45.100879 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7a36e759-75f3-4008-ac0f-adc8281f5610 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: 65a083f8-3b0d-43fd-93be-e9abb278e0ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:19:45.274175 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7a36e759-75f3-4008-ac0f-adc8281f5610 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.954479 Oct 30 01:19:45.285553 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 859/1751] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:19:44 2022] POST /compute/v2.1/servers => generated 383 bytes in 966 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:19:45.297242 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6c88e61b-722a-42f4-941d-d6eab75e6070 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:45.298227 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6c88e61b-722a-42f4-941d-d6eab75e6070 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] [instance: 1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:45.313475 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c88e61b-722a-42f4-941d-d6eab75e6070 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:45.314191 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c88e61b-722a-42f4-941d-d6eab75e6070 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:45.314795 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c88e61b-722a-42f4-941d-d6eab75e6070 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:45.315490 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b41cffce-1240-4beb-ad99-ba59b5a68c3a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:45.316196 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c88e61b-722a-42f4-941d-d6eab75e6070 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:45.317461 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c88e61b-722a-42f4-941d-d6eab75e6070 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:45.318923 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c88e61b-722a-42f4-941d-d6eab75e6070 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:45.335190 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b41cffce-1240-4beb-ad99-ba59b5a68c3a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7" status: 200 len: 1312 microversion: 2.1 time: 0.268563 Oct 30 01:19:45.336707 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 893/1752] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:45 2022] GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 => generated 1312 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:45.362640 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-76fcb454-affe-4a5d-b16c-1a297680bc06 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:45.363180 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-76fcb454-affe-4a5d-b16c-1a297680bc06 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 4e90ab5e-2dd7-4267-a5d2-9fc034e66c48] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:45.365075 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-6c88e61b-722a-42f4-941d-d6eab75e6070 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] HTTP exception thrown: Instance 1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1 could not be found. Oct 30 01:19:45.367486 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6c88e61b-722a-42f4-941d-d6eab75e6070 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Request method failure captured: Oct 30 01:19:45.367486 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1 HTTP/1.1 Oct 30 01:19:45.367486 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:19:45.367486 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:19:45.367486 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:19:45.367486 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:19:45.367486 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:19:45.367486 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:19:45.367486 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:19:45.367486 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:19:45.367486 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdBk0xP6qLxS5sPWxFYE5bz5ktt7IfA6J8qqZRy3Y39z4Qs7ncWPS8sQP0r-8b0chqJK7xLL4zbfOjp0fRJBTUFL4Xq44BrrOsYJ7ol7ActaK1dVYDOseFtct-wS2VTr5WT8c2-Vw6w4jGSj0n79X3CJsaG5bzUPRJQQSQGA6PB415g Oct 30 01:19:45.367486 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:19:45.367486 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:19:45.367486 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:19:45.367486 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:19:45.367486 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:19:45.367486 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:19:45.367486 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: d4681ed2d06840f995b37e550323d6ad Oct 30 01:19:45.367486 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-VolumesAdminNegativeTest-1892705985 Oct 30 01:19:45.367486 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:19:45.367486 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:19:45.369251 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d4681ed2d06840f995b37e550323d6ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d4681ed2d06840f995b37e550323d6ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d4681ed2d06840f995b37e550323d6ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d4681ed2d06840f995b37e550323d6ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:19:45.369251 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-VolumesAdminNegativeTest-1892705985 Oct 30 01:19:45.369251 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: d4681ed2d06840f995b37e550323d6ad Oct 30 01:19:45.369251 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1892705985 Oct 30 01:19:45.369251 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-VolumesAdminNegativeTest-1892705985-project Oct 30 01:19:45.369251 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:19:45.369251 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:19:45.369251 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: ec7269dc6d56440ca8691179f7275aeb Oct 30 01:19:45.369251 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-VolumesAdminNegativeTest-1892705985-project Oct 30 01:19:45.369251 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:19:45.369251 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1 could not be found. Oct 30 01:19:45.369251 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1'} Oct 30 01:19:45.370274 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:19:45.370274 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:19:45.370274 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:19:45.370274 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:19:45.370274 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:19:45.370274 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:19:45.370274 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:19:45.370274 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:19:45.370274 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:19:45.370274 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:19:45.370274 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1 could not be found. Oct 30 01:19:45.370274 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:19:45.370274 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:19:45.370274 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:19:45.370274 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:19:45.370274 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:19:45.370274 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:19:45.370274 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:19:45.370274 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:19:45.370274 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:19:45.371944 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:19:45.371944 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:19:45.371944 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:19:45.371944 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:19:45.371944 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:19:45.371944 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:19:45.371944 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:19:45.371944 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1 could not be found. Oct 30 01:19:45.371944 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:19:45.371944 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:19:45.371944 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:19:45.371944 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:19:45.371944 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:19:45.371944 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:19:45.371944 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:19:45.371944 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:19:45.371944 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1 could not be found. Oct 30 01:19:45.371944 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:19:45.374105 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6c88e61b-722a-42f4-941d-d6eab75e6070 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Returning 404 to user: Instance 1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:19:45.374105 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6c88e61b-722a-42f4-941d-d6eab75e6070 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] 10.222.0.13 "GET /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1" status: 404 len: 111 microversion: 2.1 time: 0.086641 Oct 30 01:19:45.374105 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 860/1753] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:45 2022] GET /compute/v2.1/servers/1d79560a-ac0c-4555-a1b3-1a6d5f8bd5d1 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:19:45.376538 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-76fcb454-affe-4a5d-b16c-1a297680bc06 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:45.381354 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2e4d9ae4-347e-4a96-ae1a-275bce01641b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:45.382004 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2e4d9ae4-347e-4a96-ae1a-275bce01641b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:45.384139 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-76fcb454-affe-4a5d-b16c-1a297680bc06 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:45.384918 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-76fcb454-affe-4a5d-b16c-1a297680bc06 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:45.392403 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-76fcb454-affe-4a5d-b16c-1a297680bc06 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:45.392403 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-76fcb454-affe-4a5d-b16c-1a297680bc06 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:45.392403 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-76fcb454-affe-4a5d-b16c-1a297680bc06 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:45.408658 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2e4d9ae4-347e-4a96-ae1a-275bce01641b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:45.409226 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2e4d9ae4-347e-4a96-ae1a-275bce01641b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:45.409674 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2e4d9ae4-347e-4a96-ae1a-275bce01641b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:45.415352 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2e4d9ae4-347e-4a96-ae1a-275bce01641b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:45.415352 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2e4d9ae4-347e-4a96-ae1a-275bce01641b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:45.415352 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2e4d9ae4-347e-4a96-ae1a-275bce01641b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:45.441165 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-76fcb454-affe-4a5d-b16c-1a297680bc06 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 4e90ab5e-2dd7-4267-a5d2-9fc034e66c48] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:19:45.447365 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:45.571816 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2e4d9ae4-347e-4a96-ae1a-275bce01641b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:45.575531 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:45.584221 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2e4d9ae4-347e-4a96-ae1a-275bce01641b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:45.594245 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2e4d9ae4-347e-4a96-ae1a-275bce01641b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:45.596076 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2e4d9ae4-347e-4a96-ae1a-275bce01641b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1539 microversion: 2.91 time: 0.221035 Oct 30 01:19:45.597246 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 861/1754] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:19:45 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1539 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:19:45.604487 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-eb77177d-753f-4b2b-8bbb-dc484500045a tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:45.605839 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-eb77177d-753f-4b2b-8bbb-dc484500045a tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: 65a083f8-3b0d-43fd-93be-e9abb278e0ee] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:45.676577 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-eb77177d-753f-4b2b-8bbb-dc484500045a tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:45.685188 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-eb77177d-753f-4b2b-8bbb-dc484500045a tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/65a083f8-3b0d-43fd-93be-e9abb278e0ee" status: 200 len: 1225 microversion: 2.1 time: 0.086277 Oct 30 01:19:45.686124 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 862/1755] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:45 2022] GET /compute/v2.1/servers/65a083f8-3b0d-43fd-93be-e9abb278e0ee => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:45.696631 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a330d54f-01e5-4c35-b64f-3ee247bf8059 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] Calling method '.version_select at 0x7f44c7d36310>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:45.863379 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a330d54f-01e5-4c35-b64f-3ee247bf8059 tempest-VolumesAdminNegativeTest-1892705985 tempest-VolumesAdminNegativeTest-1892705985-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1764706091" status: 202 len: 0 microversion: 2.1 time: 0.175633 Oct 30 01:19:45.864705 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 863/1756] 10.222.0.13 () {58 vars in 1221 bytes} [Sun Oct 30 01:19:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1764706091 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:19:45.877479 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9ac3f238-f0d9-492e-8313-b1a099c30df8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:45.886012 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9ac3f238-f0d9-492e-8313-b1a099c30df8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0ec8b27d-8af5-45d7-892b-09297e5cb2d8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:45.914829 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9ac3f238-f0d9-492e-8313-b1a099c30df8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:45.916977 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9ac3f238-f0d9-492e-8313-b1a099c30df8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:45.919719 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9ac3f238-f0d9-492e-8313-b1a099c30df8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:45.921573 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9ac3f238-f0d9-492e-8313-b1a099c30df8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:45.923549 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9ac3f238-f0d9-492e-8313-b1a099c30df8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:45.924393 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9ac3f238-f0d9-492e-8313-b1a099c30df8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:46.061649 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-76fcb454-affe-4a5d-b16c-1a297680bc06 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "DELETE /compute/v2.1/servers/4e90ab5e-2dd7-4267-a5d2-9fc034e66c48" status: 204 len: 0 microversion: 2.1 time: 0.709072 Oct 30 01:19:46.067172 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 894/1757] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:19:45 2022] DELETE /compute/v2.1/servers/4e90ab5e-2dd7-4267-a5d2-9fc034e66c48 => generated 0 bytes in 725 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:19:46.072342 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b748c787-1466-47ea-b875-138b51fea0ab tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:46.073060 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b748c787-1466-47ea-b875-138b51fea0ab tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 4e90ab5e-2dd7-4267-a5d2-9fc034e66c48] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:46.084723 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b748c787-1466-47ea-b875-138b51fea0ab tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:46.085834 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b748c787-1466-47ea-b875-138b51fea0ab tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:46.086520 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b748c787-1466-47ea-b875-138b51fea0ab tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:46.087420 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b748c787-1466-47ea-b875-138b51fea0ab tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:46.088041 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b748c787-1466-47ea-b875-138b51fea0ab tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:46.088618 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b748c787-1466-47ea-b875-138b51fea0ab tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:46.367897 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9ac3f238-f0d9-492e-8313-b1a099c30df8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:46.384480 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9ac3f238-f0d9-492e-8313-b1a099c30df8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8" status: 200 len: 1391 microversion: 2.1 time: 0.517437 Oct 30 01:19:46.386376 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 864/1758] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:45 2022] GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8 => generated 1391 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:46.391819 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0d5b2d4c-a115-4b38-9403-463009f63ddb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:46.392728 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0d5b2d4c-a115-4b38-9403-463009f63ddb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: e7ff7c82-b3f6-4172-be0d-1c67c30db4f7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:46.402480 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d5b2d4c-a115-4b38-9403-463009f63ddb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:46.405613 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d5b2d4c-a115-4b38-9403-463009f63ddb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:46.405613 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d5b2d4c-a115-4b38-9403-463009f63ddb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:46.405613 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d5b2d4c-a115-4b38-9403-463009f63ddb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:46.405613 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d5b2d4c-a115-4b38-9403-463009f63ddb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:46.406946 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d5b2d4c-a115-4b38-9403-463009f63ddb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:46.424126 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b748c787-1466-47ea-b875-138b51fea0ab tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:46.438911 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b748c787-1466-47ea-b875-138b51fea0ab tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/4e90ab5e-2dd7-4267-a5d2-9fc034e66c48" status: 200 len: 1508 microversion: 2.1 time: 0.371631 Oct 30 01:19:46.440692 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 895/1759] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:46 2022] GET /compute/v2.1/servers/4e90ab5e-2dd7-4267-a5d2-9fc034e66c48 => generated 1508 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:19:46.628718 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9fcf6cca-22e3-4000-b506-ef33b1393dd4 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:46.631866 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9fcf6cca-22e3-4000-b506-ef33b1393dd4 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:46.637400 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9fcf6cca-22e3-4000-b506-ef33b1393dd4 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:46.638556 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9fcf6cca-22e3-4000-b506-ef33b1393dd4 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:46.639180 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9fcf6cca-22e3-4000-b506-ef33b1393dd4 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:46.640368 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9fcf6cca-22e3-4000-b506-ef33b1393dd4 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:46.641018 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9fcf6cca-22e3-4000-b506-ef33b1393dd4 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:46.641650 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9fcf6cca-22e3-4000-b506-ef33b1393dd4 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:46.646949 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0d5b2d4c-a115-4b38-9403-463009f63ddb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:46.657220 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0d5b2d4c-a115-4b38-9403-463009f63ddb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7" status: 200 len: 1312 microversion: 2.1 time: 0.269491 Oct 30 01:19:46.658399 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 865/1760] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:46 2022] GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 => generated 1312 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:46.712558 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c3bdf6f0-1cad-4cf3-a0f7-154347825927 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:46.713733 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c3bdf6f0-1cad-4cf3-a0f7-154347825927 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: 65a083f8-3b0d-43fd-93be-e9abb278e0ee] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:46.716342 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9fcf6cca-22e3-4000-b506-ef33b1393dd4 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:46.726641 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9fcf6cca-22e3-4000-b506-ef33b1393dd4 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:46.728136 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9fcf6cca-22e3-4000-b506-ef33b1393dd4 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:46.733077 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:UPDATE=13,nova_api:SELECT=80,nova_api:INSERT=7 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:46.735228 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9fcf6cca-22e3-4000-b506-ef33b1393dd4 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1539 microversion: 2.91 time: 0.110449 Oct 30 01:19:46.736013 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 896/1761] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:19:46 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1539 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:19:46.793545 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c3bdf6f0-1cad-4cf3-a0f7-154347825927 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:46.823422 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c3bdf6f0-1cad-4cf3-a0f7-154347825927 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/65a083f8-3b0d-43fd-93be-e9abb278e0ee" status: 200 len: 1225 microversion: 2.1 time: 0.100746 Oct 30 01:19:46.823422 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 866/1762] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:46 2022] GET /compute/v2.1/servers/65a083f8-3b0d-43fd-93be-e9abb278e0ee => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:47.056845 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-fa0c076a-2cd5-4699-a393-8dde8b335d8c req-12e0fec1-c4ea-425b-8046-1b0a802f6f21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7ff7c82-b3f6-4172-be0d-1c67c30db4f7", "tag": "6187e4ac-5fa7-409a-870a-b11e4dc8fc91"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:19:47.071044 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-fa0c076a-2cd5-4699-a393-8dde8b335d8c req-12e0fec1-c4ea-425b-8046-1b0a802f6f21 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:47.082649 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-fa0c076a-2cd5-4699-a393-8dde8b335d8c req-12e0fec1-c4ea-425b-8046-1b0a802f6f21 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:47.084053 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-fa0c076a-2cd5-4699-a393-8dde8b335d8c req-12e0fec1-c4ea-425b-8046-1b0a802f6f21 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:47.109392 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-fa0c076a-2cd5-4699-a393-8dde8b335d8c req-12e0fec1-c4ea-425b-8046-1b0a802f6f21 service nova] Creating event network-changed:6187e4ac-5fa7-409a-870a-b11e4dc8fc91 for instance e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 on n-h2-master-1 Oct 30 01:19:47.123789 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-fa0c076a-2cd5-4699-a393-8dde8b335d8c req-12e0fec1-c4ea-425b-8046-1b0a802f6f21 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071987 Oct 30 01:19:47.125027 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 897/1763] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:19:47.431018 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ade11420-2c3c-4966-b104-14d859e087c5 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:47.431634 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ade11420-2c3c-4966-b104-14d859e087c5 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0ec8b27d-8af5-45d7-892b-09297e5cb2d8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:47.439881 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ade11420-2c3c-4966-b104-14d859e087c5 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:47.442047 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ade11420-2c3c-4966-b104-14d859e087c5 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:47.442958 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ade11420-2c3c-4966-b104-14d859e087c5 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:47.444081 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ade11420-2c3c-4966-b104-14d859e087c5 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:47.444550 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ade11420-2c3c-4966-b104-14d859e087c5 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:47.446622 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ade11420-2c3c-4966-b104-14d859e087c5 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:47.466965 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1b05618e-7dbd-4e22-8434-dc333da52853 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:47.467663 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1b05618e-7dbd-4e22-8434-dc333da52853 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 4e90ab5e-2dd7-4267-a5d2-9fc034e66c48] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:47.486042 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1b05618e-7dbd-4e22-8434-dc333da52853 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:47.486531 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1b05618e-7dbd-4e22-8434-dc333da52853 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:47.496653 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1b05618e-7dbd-4e22-8434-dc333da52853 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:47.496653 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1b05618e-7dbd-4e22-8434-dc333da52853 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:47.496653 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1b05618e-7dbd-4e22-8434-dc333da52853 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:47.496653 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1b05618e-7dbd-4e22-8434-dc333da52853 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:47.946930 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ade11420-2c3c-4966-b104-14d859e087c5 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:47.951071 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1b05618e-7dbd-4e22-8434-dc333da52853 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:47.963547 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1b05618e-7dbd-4e22-8434-dc333da52853 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/4e90ab5e-2dd7-4267-a5d2-9fc034e66c48" status: 200 len: 1508 microversion: 2.1 time: 0.500677 Oct 30 01:19:47.965393 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 898/1764] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:47 2022] GET /compute/v2.1/servers/4e90ab5e-2dd7-4267-a5d2-9fc034e66c48 => generated 1508 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:47.965576 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ade11420-2c3c-4966-b104-14d859e087c5 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8" status: 200 len: 1391 microversion: 2.1 time: 0.536232 Oct 30 01:19:47.966093 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 867/1765] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:47 2022] GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8 => generated 1391 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:19:47.970902 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-011292ef-4a4b-42c5-b121-5080bec84e7d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:47.971962 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-011292ef-4a4b-42c5-b121-5080bec84e7d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: e7ff7c82-b3f6-4172-be0d-1c67c30db4f7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:47.977705 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f53fbca0-3b04-4c0d-92cf-265ba17b2f3a tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:47.978783 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f53fbca0-3b04-4c0d-92cf-265ba17b2f3a tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:47.988645 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-011292ef-4a4b-42c5-b121-5080bec84e7d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:47.989524 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-011292ef-4a4b-42c5-b121-5080bec84e7d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:47.990254 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-011292ef-4a4b-42c5-b121-5080bec84e7d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:47.991173 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-011292ef-4a4b-42c5-b121-5080bec84e7d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:47.991877 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-011292ef-4a4b-42c5-b121-5080bec84e7d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:47.993101 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-011292ef-4a4b-42c5-b121-5080bec84e7d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:48.011018 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f53fbca0-3b04-4c0d-92cf-265ba17b2f3a tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:48.011569 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f53fbca0-3b04-4c0d-92cf-265ba17b2f3a tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:48.012095 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f53fbca0-3b04-4c0d-92cf-265ba17b2f3a tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:48.012773 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f53fbca0-3b04-4c0d-92cf-265ba17b2f3a tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:48.013267 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f53fbca0-3b04-4c0d-92cf-265ba17b2f3a tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:48.013886 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f53fbca0-3b04-4c0d-92cf-265ba17b2f3a tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:48.207935 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f53fbca0-3b04-4c0d-92cf-265ba17b2f3a tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:48.221114 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f53fbca0-3b04-4c0d-92cf-265ba17b2f3a tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:48.221114 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f53fbca0-3b04-4c0d-92cf-265ba17b2f3a tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:48.225473 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f53fbca0-3b04-4c0d-92cf-265ba17b2f3a tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1539 microversion: 2.91 time: 0.257279 Oct 30 01:19:48.226175 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 868/1766] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:19:47 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1539 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:19:48.243287 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1acc9658-04e4-4d81-b89d-fb16b025ec16 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:48.244359 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1acc9658-04e4-4d81-b89d-fb16b025ec16 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: 65a083f8-3b0d-43fd-93be-e9abb278e0ee] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:48.255826 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1acc9658-04e4-4d81-b89d-fb16b025ec16 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:48.256318 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1acc9658-04e4-4d81-b89d-fb16b025ec16 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:48.256751 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1acc9658-04e4-4d81-b89d-fb16b025ec16 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:48.257483 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1acc9658-04e4-4d81-b89d-fb16b025ec16 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:48.258466 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1acc9658-04e4-4d81-b89d-fb16b025ec16 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:48.259071 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1acc9658-04e4-4d81-b89d-fb16b025ec16 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:48.372129 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1acc9658-04e4-4d81-b89d-fb16b025ec16 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:48.380313 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1acc9658-04e4-4d81-b89d-fb16b025ec16 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/65a083f8-3b0d-43fd-93be-e9abb278e0ee" status: 200 len: 1277 microversion: 2.1 time: 0.152472 Oct 30 01:19:48.381186 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 869/1767] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:48 2022] GET /compute/v2.1/servers/65a083f8-3b0d-43fd-93be-e9abb278e0ee => generated 1277 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:48.422417 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-011292ef-4a4b-42c5-b121-5080bec84e7d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:48.431104 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-011292ef-4a4b-42c5-b121-5080bec84e7d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7" status: 200 len: 1312 microversion: 2.1 time: 0.464179 Oct 30 01:19:48.431993 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 899/1768] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:47 2022] GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 => generated 1312 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:48.889475 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-d4dc7beb-5ffe-48f6-a30e-8ec57bfeb158 req-2fcf8ac8-2f21-444c-908a-05b8b7ec6f6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e90ab5e-2dd7-4267-a5d2-9fc034e66c48", "name": "network-vif-deleted", "tag": "6e7071a6-b59c-4b5b-8430-fdd0113ad41b"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:19:48.901790 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d4dc7beb-5ffe-48f6-a30e-8ec57bfeb158 req-2fcf8ac8-2f21-444c-908a-05b8b7ec6f6b service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:48.904764 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d4dc7beb-5ffe-48f6-a30e-8ec57bfeb158 req-2fcf8ac8-2f21-444c-908a-05b8b7ec6f6b service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:48.904764 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d4dc7beb-5ffe-48f6-a30e-8ec57bfeb158 req-2fcf8ac8-2f21-444c-908a-05b8b7ec6f6b service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:48.915170 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-d4dc7beb-5ffe-48f6-a30e-8ec57bfeb158 req-2fcf8ac8-2f21-444c-908a-05b8b7ec6f6b service nova] Creating event network-vif-deleted:6e7071a6-b59c-4b5b-8430-fdd0113ad41b for instance 4e90ab5e-2dd7-4267-a5d2-9fc034e66c48 on n-h2-master-1 Oct 30 01:19:48.924670 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-d4dc7beb-5ffe-48f6-a30e-8ec57bfeb158 req-2fcf8ac8-2f21-444c-908a-05b8b7ec6f6b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038820 Oct 30 01:19:48.925279 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 870/1769] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:19:48.988069 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-dca08391-9a99-4482-9b7b-604414850aad tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:48.988678 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-dca08391-9a99-4482-9b7b-604414850aad tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 4e90ab5e-2dd7-4267-a5d2-9fc034e66c48] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:48.996593 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dca08391-9a99-4482-9b7b-604414850aad tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:48.997078 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dca08391-9a99-4482-9b7b-604414850aad tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:48.997589 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dca08391-9a99-4482-9b7b-604414850aad tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:48.998349 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dca08391-9a99-4482-9b7b-604414850aad tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:48.998741 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dca08391-9a99-4482-9b7b-604414850aad tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:48.999154 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dca08391-9a99-4482-9b7b-604414850aad tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:49.012027 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7ef8ce45-d427-4d1f-ac1a-949cfd4fc10c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:49.013112 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7ef8ce45-d427-4d1f-ac1a-949cfd4fc10c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0ec8b27d-8af5-45d7-892b-09297e5cb2d8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:49.021314 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7ef8ce45-d427-4d1f-ac1a-949cfd4fc10c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:49.021892 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7ef8ce45-d427-4d1f-ac1a-949cfd4fc10c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:49.022334 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7ef8ce45-d427-4d1f-ac1a-949cfd4fc10c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:49.024233 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7ef8ce45-d427-4d1f-ac1a-949cfd4fc10c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:49.024726 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7ef8ce45-d427-4d1f-ac1a-949cfd4fc10c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:49.025161 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7ef8ce45-d427-4d1f-ac1a-949cfd4fc10c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:49.094285 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-dca08391-9a99-4482-9b7b-604414850aad tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:49.103590 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-dca08391-9a99-4482-9b7b-604414850aad tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/4e90ab5e-2dd7-4267-a5d2-9fc034e66c48" status: 200 len: 1466 microversion: 2.1 time: 0.119335 Oct 30 01:19:49.104248 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 900/1770] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:48 2022] GET /compute/v2.1/servers/4e90ab5e-2dd7-4267-a5d2-9fc034e66c48 => generated 1466 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:49.245091 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7ef8ce45-d427-4d1f-ac1a-949cfd4fc10c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:49.254830 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-334390d5-20bd-412e-a2a5-f008fdd1ac40 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:49.255624 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-334390d5-20bd-412e-a2a5-f008fdd1ac40 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:49.266701 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7ef8ce45-d427-4d1f-ac1a-949cfd4fc10c tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8" status: 200 len: 1391 microversion: 2.1 time: 0.259408 Oct 30 01:19:49.267375 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 871/1771] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:49 2022] GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8 => generated 1391 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:19:49.269460 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-334390d5-20bd-412e-a2a5-f008fdd1ac40 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:49.270015 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-334390d5-20bd-412e-a2a5-f008fdd1ac40 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:49.270632 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-334390d5-20bd-412e-a2a5-f008fdd1ac40 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:49.272231 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-334390d5-20bd-412e-a2a5-f008fdd1ac40 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:49.272573 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-334390d5-20bd-412e-a2a5-f008fdd1ac40 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:49.273006 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-334390d5-20bd-412e-a2a5-f008fdd1ac40 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:49.346026 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-334390d5-20bd-412e-a2a5-f008fdd1ac40 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:49.356160 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-334390d5-20bd-412e-a2a5-f008fdd1ac40 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:49.358028 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-334390d5-20bd-412e-a2a5-f008fdd1ac40 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:49.363526 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-334390d5-20bd-412e-a2a5-f008fdd1ac40 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1539 microversion: 2.91 time: 0.113142 Oct 30 01:19:49.364378 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 901/1772] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:19:49 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1539 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:19:49.404822 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c765c68f-6e56-4de5-bee7-d4fae91500a5 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:49.405622 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c765c68f-6e56-4de5-bee7-d4fae91500a5 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: 65a083f8-3b0d-43fd-93be-e9abb278e0ee] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:49.412396 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c765c68f-6e56-4de5-bee7-d4fae91500a5 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:49.412970 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c765c68f-6e56-4de5-bee7-d4fae91500a5 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:49.413508 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c765c68f-6e56-4de5-bee7-d4fae91500a5 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:49.414855 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c765c68f-6e56-4de5-bee7-d4fae91500a5 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:49.415373 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c765c68f-6e56-4de5-bee7-d4fae91500a5 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:49.416014 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c765c68f-6e56-4de5-bee7-d4fae91500a5 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:49.455408 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-34a87681-90fd-45c7-a133-18c3f9978d46 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:49.456003 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-34a87681-90fd-45c7-a133-18c3f9978d46 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: e7ff7c82-b3f6-4172-be0d-1c67c30db4f7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:49.463003 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-34a87681-90fd-45c7-a133-18c3f9978d46 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:49.463502 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-34a87681-90fd-45c7-a133-18c3f9978d46 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:49.464014 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-34a87681-90fd-45c7-a133-18c3f9978d46 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:49.464757 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-34a87681-90fd-45c7-a133-18c3f9978d46 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:49.465214 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-34a87681-90fd-45c7-a133-18c3f9978d46 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:49.465956 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-34a87681-90fd-45c7-a133-18c3f9978d46 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:49.514208 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c765c68f-6e56-4de5-bee7-d4fae91500a5 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:49.527110 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c765c68f-6e56-4de5-bee7-d4fae91500a5 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/65a083f8-3b0d-43fd-93be-e9abb278e0ee" status: 200 len: 1277 microversion: 2.1 time: 0.126090 Oct 30 01:19:49.528450 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 872/1773] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:49 2022] GET /compute/v2.1/servers/65a083f8-3b0d-43fd-93be-e9abb278e0ee => generated 1277 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:49.776225 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-34a87681-90fd-45c7-a133-18c3f9978d46 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:49.791533 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-34a87681-90fd-45c7-a133-18c3f9978d46 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7" status: 200 len: 1312 microversion: 2.1 time: 0.340041 Oct 30 01:19:49.792326 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 902/1774] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:49 2022] GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 => generated 1312 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:50.133691 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-55dfd33c-1578-4b78-9c84-f77497d3a19d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:50.136622 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-55dfd33c-1578-4b78-9c84-f77497d3a19d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 4e90ab5e-2dd7-4267-a5d2-9fc034e66c48] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:50.148059 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-55dfd33c-1578-4b78-9c84-f77497d3a19d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:50.148862 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-55dfd33c-1578-4b78-9c84-f77497d3a19d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:50.150119 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-55dfd33c-1578-4b78-9c84-f77497d3a19d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:50.151062 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-55dfd33c-1578-4b78-9c84-f77497d3a19d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:50.151870 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-55dfd33c-1578-4b78-9c84-f77497d3a19d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:50.152480 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-55dfd33c-1578-4b78-9c84-f77497d3a19d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:50.223939 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-55dfd33c-1578-4b78-9c84-f77497d3a19d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:50.225293 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-55dfd33c-1578-4b78-9c84-f77497d3a19d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:50.225941 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-55dfd33c-1578-4b78-9c84-f77497d3a19d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:50.226409 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-55dfd33c-1578-4b78-9c84-f77497d3a19d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lazy-loading 'fault' on Instance uuid 4e90ab5e-2dd7-4267-a5d2-9fc034e66c48 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:19:50.297840 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-752a21a9-1f90-49a5-ac7c-63e5463af3fb tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:50.299250 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-752a21a9-1f90-49a5-ac7c-63e5463af3fb tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0ec8b27d-8af5-45d7-892b-09297e5cb2d8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:50.323271 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-752a21a9-1f90-49a5-ac7c-63e5463af3fb tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:50.323271 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-752a21a9-1f90-49a5-ac7c-63e5463af3fb tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:50.323271 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-752a21a9-1f90-49a5-ac7c-63e5463af3fb tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:50.329794 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-752a21a9-1f90-49a5-ac7c-63e5463af3fb tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:50.331681 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-752a21a9-1f90-49a5-ac7c-63e5463af3fb tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:50.332991 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-752a21a9-1f90-49a5-ac7c-63e5463af3fb tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:50.623963 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=31,nova_cell0:UPDATE=7 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:50.659686 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-55dfd33c-1578-4b78-9c84-f77497d3a19d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:50.669033 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-55dfd33c-1578-4b78-9c84-f77497d3a19d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/4e90ab5e-2dd7-4267-a5d2-9fc034e66c48" status: 200 len: 1304 microversion: 2.1 time: 0.540364 Oct 30 01:19:50.669845 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 873/1775] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:50 2022] GET /compute/v2.1/servers/4e90ab5e-2dd7-4267-a5d2-9fc034e66c48 => generated 1304 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:50.689382 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0325cd99-735b-4306-9b55-1f0346cd9b78 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:50.690076 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0325cd99-735b-4306-9b55-1f0346cd9b78 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:50.707589 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0325cd99-735b-4306-9b55-1f0346cd9b78 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:50.708221 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0325cd99-735b-4306-9b55-1f0346cd9b78 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:50.708734 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0325cd99-735b-4306-9b55-1f0346cd9b78 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:50.709580 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0325cd99-735b-4306-9b55-1f0346cd9b78 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:50.710239 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0325cd99-735b-4306-9b55-1f0346cd9b78 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:50.710669 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0325cd99-735b-4306-9b55-1f0346cd9b78 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:50.868549 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0325cd99-735b-4306-9b55-1f0346cd9b78 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:50.878842 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0325cd99-735b-4306-9b55-1f0346cd9b78 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:50.880284 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0325cd99-735b-4306-9b55-1f0346cd9b78 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:50.898308 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0325cd99-735b-4306-9b55-1f0346cd9b78 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1539 microversion: 2.91 time: 0.224955 Oct 30 01:19:50.899328 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 874/1776] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:19:50 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1539 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:19:50.904052 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9f4e5216-c832-431b-80d6-ce70e255036c tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:50.904662 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9f4e5216-c832-431b-80d6-ce70e255036c tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: 65a083f8-3b0d-43fd-93be-e9abb278e0ee] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:50.930711 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9f4e5216-c832-431b-80d6-ce70e255036c tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:50.931212 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9f4e5216-c832-431b-80d6-ce70e255036c tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:50.931646 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9f4e5216-c832-431b-80d6-ce70e255036c tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:50.932362 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9f4e5216-c832-431b-80d6-ce70e255036c tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:50.941951 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9f4e5216-c832-431b-80d6-ce70e255036c tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:50.942404 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9f4e5216-c832-431b-80d6-ce70e255036c tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:51.125005 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9f4e5216-c832-431b-80d6-ce70e255036c tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:51.135160 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9f4e5216-c832-431b-80d6-ce70e255036c tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/65a083f8-3b0d-43fd-93be-e9abb278e0ee" status: 200 len: 1295 microversion: 2.1 time: 0.234719 Oct 30 01:19:51.161388 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 875/1777] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:50 2022] GET /compute/v2.1/servers/65a083f8-3b0d-43fd-93be-e9abb278e0ee => generated 1295 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:51.175960 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f37c364c-6c7a-4931-b5df-c95ffef42930 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:51.176572 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f37c364c-6c7a-4931-b5df-c95ffef42930 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: e7ff7c82-b3f6-4172-be0d-1c67c30db4f7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:51.187426 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f37c364c-6c7a-4931-b5df-c95ffef42930 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:51.189071 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f37c364c-6c7a-4931-b5df-c95ffef42930 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:51.189581 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f37c364c-6c7a-4931-b5df-c95ffef42930 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:51.190325 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f37c364c-6c7a-4931-b5df-c95ffef42930 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:51.190783 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f37c364c-6c7a-4931-b5df-c95ffef42930 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:51.194394 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f37c364c-6c7a-4931-b5df-c95ffef42930 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:51.198861 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-752a21a9-1f90-49a5-ac7c-63e5463af3fb tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:51.213595 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-752a21a9-1f90-49a5-ac7c-63e5463af3fb tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8" status: 200 len: 1391 microversion: 2.1 time: 0.925662 Oct 30 01:19:51.215145 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 903/1778] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:50 2022] GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8 => generated 1391 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:51.584211 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f37c364c-6c7a-4931-b5df-c95ffef42930 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:51.592261 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f37c364c-6c7a-4931-b5df-c95ffef42930 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7" status: 200 len: 1312 microversion: 2.1 time: 0.429309 Oct 30 01:19:51.592851 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 876/1779] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:51 2022] GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 => generated 1312 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:51.704624 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d1dfed68-6766-49b7-a3a5-9ef8fd203c06 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:51.705243 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d1dfed68-6766-49b7-a3a5-9ef8fd203c06 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 4e90ab5e-2dd7-4267-a5d2-9fc034e66c48] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:51.718044 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1dfed68-6766-49b7-a3a5-9ef8fd203c06 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:51.718406 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1dfed68-6766-49b7-a3a5-9ef8fd203c06 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:51.719373 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1dfed68-6766-49b7-a3a5-9ef8fd203c06 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:51.719662 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1dfed68-6766-49b7-a3a5-9ef8fd203c06 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:51.720098 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1dfed68-6766-49b7-a3a5-9ef8fd203c06 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:51.720523 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1dfed68-6766-49b7-a3a5-9ef8fd203c06 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:51.736187 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-d1dfed68-6766-49b7-a3a5-9ef8fd203c06 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] HTTP exception thrown: Instance 4e90ab5e-2dd7-4267-a5d2-9fc034e66c48 could not be found. Oct 30 01:19:51.739491 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d1dfed68-6766-49b7-a3a5-9ef8fd203c06 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Request method failure captured: Oct 30 01:19:51.739491 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/4e90ab5e-2dd7-4267-a5d2-9fc034e66c48 HTTP/1.1 Oct 30 01:19:51.739491 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:19:51.739491 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:19:51.739491 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:19:51.739491 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:19:51.739491 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:19:51.739491 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:19:51.739491 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:19:51.739491 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:19:51.739491 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdEZHAwNEyYVN8mbZetD1IgknrDb-nJfmTHtgPgtOr9AeQL99EuTYclSviV8aikzXcemJ-XkTVClxHn6U4xG48gAdXZcIs0fYa7Kdvvi7PzFjDxYMfOtgAp7wAvvVW7kd-J_XMzQX3yJBWm7NW5-QhmguztBnHz9UniQWs2CmNftHaI Oct 30 01:19:51.739491 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:19:51.739491 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:19:51.739491 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:19:51.739491 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:19:51.739491 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:19:51.739491 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:19:51.739491 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 8c95e97cd7e4461682b9028abb568dce Oct 30 01:19:51.739491 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:19:51.739491 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:19:51.739491 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:19:51.741017 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:19:51.741017 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:19:51.741017 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 8c95e97cd7e4461682b9028abb568dce Oct 30 01:19:51.741017 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:19:51.741017 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-DeleteServersTestJSON-1379968241-project Oct 30 01:19:51.741017 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:19:51.741017 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:19:51.741017 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 33691c943ec040ddb04b6648b6e945ab Oct 30 01:19:51.741017 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-DeleteServersTestJSON-1379968241-project Oct 30 01:19:51.741017 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:19:51.741017 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 4e90ab5e-2dd7-4267-a5d2-9fc034e66c48 could not be found. Oct 30 01:19:51.741017 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '4e90ab5e-2dd7-4267-a5d2-9fc034e66c48'} Oct 30 01:19:51.741913 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:19:51.741913 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:19:51.741913 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:19:51.741913 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:19:51.741913 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:19:51.741913 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:19:51.741913 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:19:51.741913 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:19:51.741913 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:19:51.741913 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:19:51.741913 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e90ab5e-2dd7-4267-a5d2-9fc034e66c48 could not be found. Oct 30 01:19:51.741913 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:19:51.741913 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:19:51.741913 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:19:51.741913 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:19:51.741913 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:19:51.741913 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:19:51.741913 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:19:51.741913 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:19:51.741913 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:19:51.744240 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:19:51.744240 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:19:51.744240 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:19:51.744240 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:19:51.744240 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:19:51.744240 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:19:51.744240 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:19:51.744240 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e90ab5e-2dd7-4267-a5d2-9fc034e66c48 could not be found. Oct 30 01:19:51.744240 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:19:51.744240 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:19:51.744240 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:19:51.744240 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:19:51.744240 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:19:51.744240 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:19:51.744240 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:19:51.744240 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:19:51.744240 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e90ab5e-2dd7-4267-a5d2-9fc034e66c48 could not be found. Oct 30 01:19:51.744240 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:19:51.746494 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d1dfed68-6766-49b7-a3a5-9ef8fd203c06 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Returning 404 to user: Instance 4e90ab5e-2dd7-4267-a5d2-9fc034e66c48 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:19:51.746494 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d1dfed68-6766-49b7-a3a5-9ef8fd203c06 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/4e90ab5e-2dd7-4267-a5d2-9fc034e66c48" status: 404 len: 111 microversion: 2.1 time: 0.040329 Oct 30 01:19:51.753908 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 904/1780] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:51 2022] GET /compute/v2.1/servers/4e90ab5e-2dd7-4267-a5d2-9fc034e66c48 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:19:51.928286 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1d6411c9-e1f5-4a90-8826-b9fd139a4570 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:51.928889 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1d6411c9-e1f5-4a90-8826-b9fd139a4570 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:51.931106 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3fb47e34-9f8c-494c-b50f-88480bbd1343 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1541997311", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "19e0e4e2-b502-4a02-810a-996c246e8c64"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:19:51.935476 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1d6411c9-e1f5-4a90-8826-b9fd139a4570 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:51.936287 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1d6411c9-e1f5-4a90-8826-b9fd139a4570 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:51.936750 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1d6411c9-e1f5-4a90-8826-b9fd139a4570 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:51.937674 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1d6411c9-e1f5-4a90-8826-b9fd139a4570 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:51.938103 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1d6411c9-e1f5-4a90-8826-b9fd139a4570 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:51.938748 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1d6411c9-e1f5-4a90-8826-b9fd139a4570 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:52.025292 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-3fb47e34-9f8c-494c-b50f-88480bbd1343 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] validate_networks() for [('19e0e4e2-b502-4a02-810a-996c246e8c64', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:19:52.036354 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1d6411c9-e1f5-4a90-8826-b9fd139a4570 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:52.047617 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1d6411c9-e1f5-4a90-8826-b9fd139a4570 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:52.049696 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1d6411c9-e1f5-4a90-8826-b9fd139a4570 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:52.057690 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1d6411c9-e1f5-4a90-8826-b9fd139a4570 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1539 microversion: 2.91 time: 0.132917 Oct 30 01:19:52.058651 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 877/1781] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:19:51 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1539 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:19:52.165892 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-34610039-1ef0-435d-8242-45cf3113cc7d tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:52.167507 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-34610039-1ef0-435d-8242-45cf3113cc7d tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: 65a083f8-3b0d-43fd-93be-e9abb278e0ee] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:52.181142 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-34610039-1ef0-435d-8242-45cf3113cc7d tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:52.181142 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-34610039-1ef0-435d-8242-45cf3113cc7d tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:52.181142 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-34610039-1ef0-435d-8242-45cf3113cc7d tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:52.183281 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-34610039-1ef0-435d-8242-45cf3113cc7d tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:52.184109 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-34610039-1ef0-435d-8242-45cf3113cc7d tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:52.184736 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-34610039-1ef0-435d-8242-45cf3113cc7d tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:52.358368 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-34610039-1ef0-435d-8242-45cf3113cc7d tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:52.370978 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-34610039-1ef0-435d-8242-45cf3113cc7d tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/65a083f8-3b0d-43fd-93be-e9abb278e0ee" status: 200 len: 1283 microversion: 2.1 time: 0.209404 Oct 30 01:19:52.381370 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 878/1782] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:52 2022] GET /compute/v2.1/servers/65a083f8-3b0d-43fd-93be-e9abb278e0ee => generated 1283 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:19:52.389937 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fb6eee5b-1e7e-498b-9a32-b6d3fda3a8f4 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:52.389937 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-fb6eee5b-1e7e-498b-9a32-b6d3fda3a8f4 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0ec8b27d-8af5-45d7-892b-09297e5cb2d8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:52.397197 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fb6eee5b-1e7e-498b-9a32-b6d3fda3a8f4 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:52.399535 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fb6eee5b-1e7e-498b-9a32-b6d3fda3a8f4 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:52.400154 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fb6eee5b-1e7e-498b-9a32-b6d3fda3a8f4 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:52.401414 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fb6eee5b-1e7e-498b-9a32-b6d3fda3a8f4 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:52.402035 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fb6eee5b-1e7e-498b-9a32-b6d3fda3a8f4 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:52.402641 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fb6eee5b-1e7e-498b-9a32-b6d3fda3a8f4 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:52.889416 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-fb6eee5b-1e7e-498b-9a32-b6d3fda3a8f4 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:52.916746 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fb6eee5b-1e7e-498b-9a32-b6d3fda3a8f4 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8" status: 200 len: 1391 microversion: 2.1 time: 0.539703 Oct 30 01:19:52.919499 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 879/1783] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:52 2022] GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8 => generated 1391 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:52.947838 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-45bfa3e1-d0ef-4878-b2ff-82499e871e95 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:52.951195 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-45bfa3e1-d0ef-4878-b2ff-82499e871e95 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: e7ff7c82-b3f6-4172-be0d-1c67c30db4f7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:52.981429 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45bfa3e1-d0ef-4878-b2ff-82499e871e95 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:52.982573 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45bfa3e1-d0ef-4878-b2ff-82499e871e95 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:52.984704 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45bfa3e1-d0ef-4878-b2ff-82499e871e95 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:52.993927 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45bfa3e1-d0ef-4878-b2ff-82499e871e95 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:52.998655 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45bfa3e1-d0ef-4878-b2ff-82499e871e95 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:52.998655 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45bfa3e1-d0ef-4878-b2ff-82499e871e95 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:53.670613 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-45bfa3e1-d0ef-4878-b2ff-82499e871e95 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:53.692681 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-45bfa3e1-d0ef-4878-b2ff-82499e871e95 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7" status: 200 len: 1312 microversion: 2.1 time: 0.766476 Oct 30 01:19:53.708821 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 880/1784] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:52 2022] GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 => generated 1312 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:53.708821 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ce9fb62f-4420-42d0-800f-fa7334bae851 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:53.708821 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ce9fb62f-4420-42d0-800f-fa7334bae851 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:53.722215 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ce9fb62f-4420-42d0-800f-fa7334bae851 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:53.723012 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ce9fb62f-4420-42d0-800f-fa7334bae851 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:53.723360 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ce9fb62f-4420-42d0-800f-fa7334bae851 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:53.724136 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ce9fb62f-4420-42d0-800f-fa7334bae851 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:53.724594 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ce9fb62f-4420-42d0-800f-fa7334bae851 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:53.725033 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ce9fb62f-4420-42d0-800f-fa7334bae851 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:53.775998 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-3fb47e34-9f8c-494c-b50f-88480bbd1343 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:19:53.776505 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-3fb47e34-9f8c-494c-b50f-88480bbd1343 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:19:53.776934 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-3fb47e34-9f8c-494c-b50f-88480bbd1343 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:19:53.777372 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-3fb47e34-9f8c-494c-b50f-88480bbd1343 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:19:53.777835 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-3fb47e34-9f8c-494c-b50f-88480bbd1343 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:19:53.795301 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3fb47e34-9f8c-494c-b50f-88480bbd1343 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:53.795974 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3fb47e34-9f8c-494c-b50f-88480bbd1343 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:53.796491 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3fb47e34-9f8c-494c-b50f-88480bbd1343 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:53.797515 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3fb47e34-9f8c-494c-b50f-88480bbd1343 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:53.798219 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3fb47e34-9f8c-494c-b50f-88480bbd1343 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:53.799127 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3fb47e34-9f8c-494c-b50f-88480bbd1343 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:53.836146 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-3fb47e34-9f8c-494c-b50f-88480bbd1343 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Getting quotas for project 8c95e97cd7e4461682b9028abb568dce. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:19:53.845286 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-3fb47e34-9f8c-494c-b50f-88480bbd1343 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Getting quotas for user 33691c943ec040ddb04b6648b6e945ab and project 8c95e97cd7e4461682b9028abb568dce. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:19:53.860212 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3fb47e34-9f8c-494c-b50f-88480bbd1343 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:19:53.863320 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3fb47e34-9f8c-494c-b50f-88480bbd1343 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 22fce0cc-6498-4b95-b265-a44519f4fd9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:19:53.866335 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ce9fb62f-4420-42d0-800f-fa7334bae851 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:53.870436 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=100 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:53.876881 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ce9fb62f-4420-42d0-800f-fa7334bae851 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:53.881758 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ce9fb62f-4420-42d0-800f-fa7334bae851 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:53.888917 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ce9fb62f-4420-42d0-800f-fa7334bae851 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1539 microversion: 2.91 time: 0.194182 Oct 30 01:19:53.889900 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 881/1785] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:19:53 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1539 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:19:53.911881 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-12bf0251-6f50-4df3-9848-31444d675d1c req-ea692776-1abf-447f-82d0-582918a71b98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7ff7c82-b3f6-4172-be0d-1c67c30db4f7", "name": "network-vif-plugged", "status": "completed", "tag": "6187e4ac-5fa7-409a-870a-b11e4dc8fc91"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:19:53.938381 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-12bf0251-6f50-4df3-9848-31444d675d1c req-ea692776-1abf-447f-82d0-582918a71b98 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:53.939160 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-12bf0251-6f50-4df3-9848-31444d675d1c req-ea692776-1abf-447f-82d0-582918a71b98 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:53.939857 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-12bf0251-6f50-4df3-9848-31444d675d1c req-ea692776-1abf-447f-82d0-582918a71b98 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:53.957024 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-12bf0251-6f50-4df3-9848-31444d675d1c req-ea692776-1abf-447f-82d0-582918a71b98 service nova] Creating event network-vif-plugged:6187e4ac-5fa7-409a-870a-b11e4dc8fc91 for instance e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 on n-h2-master-1 Oct 30 01:19:53.962774 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-12bf0251-6f50-4df3-9848-31444d675d1c req-ea692776-1abf-447f-82d0-582918a71b98 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071359 Oct 30 01:19:53.963756 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 882/1786] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:19:53.970521 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3c50fd5b-f828-429a-abd7-50f6270195c3 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:53.971522 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3c50fd5b-f828-429a-abd7-50f6270195c3 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: 65a083f8-3b0d-43fd-93be-e9abb278e0ee] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:53.981652 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3c50fd5b-f828-429a-abd7-50f6270195c3 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:53.983338 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3c50fd5b-f828-429a-abd7-50f6270195c3 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:53.985690 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3c50fd5b-f828-429a-abd7-50f6270195c3 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:53.985690 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3c50fd5b-f828-429a-abd7-50f6270195c3 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:53.986364 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3c50fd5b-f828-429a-abd7-50f6270195c3 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:53.987003 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3c50fd5b-f828-429a-abd7-50f6270195c3 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:54.038448 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3fb47e34-9f8c-494c-b50f-88480bbd1343 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.113124 Oct 30 01:19:54.046771 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 905/1787] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:19:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2122 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:19:54.064050 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a7eeb004-e490-442f-8005-777a5adaa1b4 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:54.065231 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a7eeb004-e490-442f-8005-777a5adaa1b4 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0ec8b27d-8af5-45d7-892b-09297e5cb2d8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:54.081265 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7eeb004-e490-442f-8005-777a5adaa1b4 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:54.081265 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7eeb004-e490-442f-8005-777a5adaa1b4 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:54.081265 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7eeb004-e490-442f-8005-777a5adaa1b4 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:54.081265 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7eeb004-e490-442f-8005-777a5adaa1b4 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:54.081659 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7eeb004-e490-442f-8005-777a5adaa1b4 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:54.081659 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7eeb004-e490-442f-8005-777a5adaa1b4 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:54.833526 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3c50fd5b-f828-429a-abd7-50f6270195c3 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:54.848503 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3c50fd5b-f828-429a-abd7-50f6270195c3 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/65a083f8-3b0d-43fd-93be-e9abb278e0ee" status: 200 len: 1325 microversion: 2.1 time: 0.882568 Oct 30 01:19:54.850939 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 883/1788] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:53 2022] GET /compute/v2.1/servers/65a083f8-3b0d-43fd-93be-e9abb278e0ee => generated 1325 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:54.865156 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2e6f9455-ccb0-451f-8773-ca5e9636e2a6 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:54.865156 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2e6f9455-ccb0-451f-8773-ca5e9636e2a6 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 22fce0cc-6498-4b95-b265-a44519f4fd9a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:54.980972 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2e6f9455-ccb0-451f-8773-ca5e9636e2a6 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:54.981172 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a7eeb004-e490-442f-8005-777a5adaa1b4 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:54.988053 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2e6f9455-ccb0-451f-8773-ca5e9636e2a6 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/22fce0cc-6498-4b95-b265-a44519f4fd9a" status: 200 len: 1215 microversion: 2.1 time: 0.136032 Oct 30 01:19:54.989011 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 884/1789] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:54 2022] GET /compute/v2.1/servers/22fce0cc-6498-4b95-b265-a44519f4fd9a => generated 1215 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:54.994627 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ef5ebf9a-318c-4d05-a921-07ecc8aa9947 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1071093548", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "a3d745df-bc10-475b-bfb1-2cc9b94a14da"}], "block_device_mapping_v2": [{"uuid": "44805fd9-f819-44b3-9a15-e1fc3b88182b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:19:55.002618 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a7eeb004-e490-442f-8005-777a5adaa1b4 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8" status: 200 len: 1391 microversion: 2.1 time: 0.948692 Oct 30 01:19:55.003960 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 906/1790] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:54 2022] GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8 => generated 1391 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:55.042645 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-afc7f90b-1894-4ee8-9bb6-888958d647c6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:55.043263 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-afc7f90b-1894-4ee8-9bb6-888958d647c6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: e7ff7c82-b3f6-4172-be0d-1c67c30db4f7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:55.052556 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=10 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:55.081745 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-afc7f90b-1894-4ee8-9bb6-888958d647c6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:55.082277 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-afc7f90b-1894-4ee8-9bb6-888958d647c6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:55.082727 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-afc7f90b-1894-4ee8-9bb6-888958d647c6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:55.084076 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-afc7f90b-1894-4ee8-9bb6-888958d647c6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:55.084546 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-afc7f90b-1894-4ee8-9bb6-888958d647c6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:55.085413 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-afc7f90b-1894-4ee8-9bb6-888958d647c6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:55.087204 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-ef5ebf9a-318c-4d05-a921-07ecc8aa9947 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] validate_networks() for [('a3d745df-bc10-475b-bfb1-2cc9b94a14da', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:19:55.426194 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-afc7f90b-1894-4ee8-9bb6-888958d647c6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:55.442295 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-afc7f90b-1894-4ee8-9bb6-888958d647c6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7" status: 200 len: 1312 microversion: 2.1 time: 0.415966 Oct 30 01:19:55.453822 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 907/1791] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:55 2022] GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 => generated 1312 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:55.466697 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-0da34a5a-31d7-4872-b660-4bb8af99cf53 req-57652a4c-32da-443d-86dd-9e079b6502bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ec8b27d-8af5-45d7-892b-09297e5cb2d8", "name": "network-vif-unplugged", "status": "completed", "tag": "f2512753-a87d-49fe-8f90-bf6f3cdfb7b3"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:19:55.477557 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-0da34a5a-31d7-4872-b660-4bb8af99cf53 req-57652a4c-32da-443d-86dd-9e079b6502bf service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:55.478376 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-0da34a5a-31d7-4872-b660-4bb8af99cf53 req-57652a4c-32da-443d-86dd-9e079b6502bf service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:55.479056 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-0da34a5a-31d7-4872-b660-4bb8af99cf53 req-57652a4c-32da-443d-86dd-9e079b6502bf service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:55.491519 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-0da34a5a-31d7-4872-b660-4bb8af99cf53 req-57652a4c-32da-443d-86dd-9e079b6502bf service nova] Creating event network-vif-unplugged:f2512753-a87d-49fe-8f90-bf6f3cdfb7b3 for instance 0ec8b27d-8af5-45d7-892b-09297e5cb2d8 on n-h1-master-1 Oct 30 01:19:55.501283 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-0da34a5a-31d7-4872-b660-4bb8af99cf53 req-57652a4c-32da-443d-86dd-9e079b6502bf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039133 Oct 30 01:19:55.502228 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 908/1792] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:19:55.507601 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0d06e433-4e44-4454-9317-09bc125cd37b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:55.508960 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0d06e433-4e44-4454-9317-09bc125cd37b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:55.516007 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0d06e433-4e44-4454-9317-09bc125cd37b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:55.518049 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0d06e433-4e44-4454-9317-09bc125cd37b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:55.518049 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0d06e433-4e44-4454-9317-09bc125cd37b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:55.518049 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0d06e433-4e44-4454-9317-09bc125cd37b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:55.518662 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0d06e433-4e44-4454-9317-09bc125cd37b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:55.518868 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0d06e433-4e44-4454-9317-09bc125cd37b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:55.647446 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0d06e433-4e44-4454-9317-09bc125cd37b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:55.658064 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0d06e433-4e44-4454-9317-09bc125cd37b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:55.659986 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0d06e433-4e44-4454-9317-09bc125cd37b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:55.667135 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0d06e433-4e44-4454-9317-09bc125cd37b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1539 microversion: 2.91 time: 0.163827 Oct 30 01:19:55.678438 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 909/1793] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:19:55 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1539 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:19:55.884857 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3f2eef35-27cf-4670-baf2-a5d4f0e88cb2 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:55.885569 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3f2eef35-27cf-4670-baf2-a5d4f0e88cb2 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: 65a083f8-3b0d-43fd-93be-e9abb278e0ee] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:55.893098 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f2eef35-27cf-4670-baf2-a5d4f0e88cb2 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:55.893757 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f2eef35-27cf-4670-baf2-a5d4f0e88cb2 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:55.894190 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f2eef35-27cf-4670-baf2-a5d4f0e88cb2 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:55.894945 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f2eef35-27cf-4670-baf2-a5d4f0e88cb2 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:55.895402 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f2eef35-27cf-4670-baf2-a5d4f0e88cb2 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:55.895814 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f2eef35-27cf-4670-baf2-a5d4f0e88cb2 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:55.938626 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-ef5ebf9a-318c-4d05-a921-07ecc8aa9947 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:19:55.938626 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-ef5ebf9a-318c-4d05-a921-07ecc8aa9947 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:19:55.939082 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-ef5ebf9a-318c-4d05-a921-07ecc8aa9947 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:19:55.939367 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-ef5ebf9a-318c-4d05-a921-07ecc8aa9947 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:19:55.939760 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-ef5ebf9a-318c-4d05-a921-07ecc8aa9947 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:19:55.954709 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ef5ebf9a-318c-4d05-a921-07ecc8aa9947 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:55.955198 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ef5ebf9a-318c-4d05-a921-07ecc8aa9947 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:55.955709 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ef5ebf9a-318c-4d05-a921-07ecc8aa9947 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:55.956491 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ef5ebf9a-318c-4d05-a921-07ecc8aa9947 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:55.956945 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ef5ebf9a-318c-4d05-a921-07ecc8aa9947 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:55.957625 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ef5ebf9a-318c-4d05-a921-07ecc8aa9947 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:55.973277 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:55.979318 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-ef5ebf9a-318c-4d05-a921-07ecc8aa9947 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Getting quotas for project 301cee87901844ed94e635eca054960d. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:19:55.985190 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-ef5ebf9a-318c-4d05-a921-07ecc8aa9947 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Getting quotas for user 2096bbb8aff742b1837931e52ac1c9ae and project 301cee87901844ed94e635eca054960d. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:19:56.057632 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ef5ebf9a-318c-4d05-a921-07ecc8aa9947 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:19:56.059886 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ef5ebf9a-318c-4d05-a921-07ecc8aa9947 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 5ed38927-680d-4e93-b57a-21fb407c6b33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='44805fd9-f819-44b3-9a15-e1fc3b88182b',volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:19:56.210456 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3f2eef35-27cf-4670-baf2-a5d4f0e88cb2 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:56.226270 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3f2eef35-27cf-4670-baf2-a5d4f0e88cb2 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/65a083f8-3b0d-43fd-93be-e9abb278e0ee" status: 200 len: 1325 microversion: 2.1 time: 0.353305 Oct 30 01:19:56.228821 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 910/1794] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:55 2022] GET /compute/v2.1/servers/65a083f8-3b0d-43fd-93be-e9abb278e0ee => generated 1325 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:19:56.243132 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a7efe906-6bf4-411e-834d-48c614ac23e1 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:56.244228 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a7efe906-6bf4-411e-834d-48c614ac23e1 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 22fce0cc-6498-4b95-b265-a44519f4fd9a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:56.251544 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7efe906-6bf4-411e-834d-48c614ac23e1 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:56.252424 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7efe906-6bf4-411e-834d-48c614ac23e1 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:56.253130 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7efe906-6bf4-411e-834d-48c614ac23e1 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:56.253926 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7efe906-6bf4-411e-834d-48c614ac23e1 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:56.254567 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7efe906-6bf4-411e-834d-48c614ac23e1 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:56.255168 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7efe906-6bf4-411e-834d-48c614ac23e1 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:56.393494 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a7efe906-6bf4-411e-834d-48c614ac23e1 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:56.403924 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a7efe906-6bf4-411e-834d-48c614ac23e1 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/22fce0cc-6498-4b95-b265-a44519f4fd9a" status: 200 len: 1211 microversion: 2.1 time: 0.169309 Oct 30 01:19:56.408078 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 911/1795] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:56 2022] GET /compute/v2.1/servers/22fce0cc-6498-4b95-b265-a44519f4fd9a => generated 1211 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:56.422729 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-16ea4920-3c70-42ab-a44e-5bbc9568f1c8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:56.424736 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-16ea4920-3c70-42ab-a44e-5bbc9568f1c8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0ec8b27d-8af5-45d7-892b-09297e5cb2d8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:56.431640 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-16ea4920-3c70-42ab-a44e-5bbc9568f1c8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:56.432147 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-16ea4920-3c70-42ab-a44e-5bbc9568f1c8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:56.435689 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-16ea4920-3c70-42ab-a44e-5bbc9568f1c8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:56.436584 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-16ea4920-3c70-42ab-a44e-5bbc9568f1c8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:56.437072 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-16ea4920-3c70-42ab-a44e-5bbc9568f1c8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:56.437571 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-16ea4920-3c70-42ab-a44e-5bbc9568f1c8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:56.472217 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:56.678340 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ef5ebf9a-318c-4d05-a921-07ecc8aa9947 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.687965 Oct 30 01:19:56.691136 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 885/1796] 10.222.0.13 () {62 vars in 1188 bytes} [Sun Oct 30 01:19:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1701 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 30 01:19:56.703861 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-a75a36aa-8d16-4e6f-9bf3-fe6acdaf9678 req-d261fd7c-1216-48d3-866f-f2b8c1572f4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65a083f8-3b0d-43fd-93be-e9abb278e0ee", "tag": "fb95a055-7db7-4eeb-ad46-76acd5e22198"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:19:56.716840 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-a75a36aa-8d16-4e6f-9bf3-fe6acdaf9678 req-d261fd7c-1216-48d3-866f-f2b8c1572f4c service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:56.717631 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-a75a36aa-8d16-4e6f-9bf3-fe6acdaf9678 req-d261fd7c-1216-48d3-866f-f2b8c1572f4c service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:56.718838 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-a75a36aa-8d16-4e6f-9bf3-fe6acdaf9678 req-d261fd7c-1216-48d3-866f-f2b8c1572f4c service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:56.764548 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-a75a36aa-8d16-4e6f-9bf3-fe6acdaf9678 req-d261fd7c-1216-48d3-866f-f2b8c1572f4c service nova] Creating event network-changed:fb95a055-7db7-4eeb-ad46-76acd5e22198 for instance 65a083f8-3b0d-43fd-93be-e9abb278e0ee on n-h2-master-1 Oct 30 01:19:56.770084 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-a75a36aa-8d16-4e6f-9bf3-fe6acdaf9678 req-d261fd7c-1216-48d3-866f-f2b8c1572f4c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077345 Oct 30 01:19:56.771214 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 886/1797] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:19:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:19:56.778057 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7865b5bf-6857-4b57-b700-4b74452e362d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:56.778997 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7865b5bf-6857-4b57-b700-4b74452e362d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: e7ff7c82-b3f6-4172-be0d-1c67c30db4f7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:56.787530 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7865b5bf-6857-4b57-b700-4b74452e362d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:56.789836 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7865b5bf-6857-4b57-b700-4b74452e362d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:56.789836 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7865b5bf-6857-4b57-b700-4b74452e362d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:56.790678 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7865b5bf-6857-4b57-b700-4b74452e362d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:56.791357 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7865b5bf-6857-4b57-b700-4b74452e362d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:56.792015 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7865b5bf-6857-4b57-b700-4b74452e362d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:56.805765 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-16ea4920-3c70-42ab-a44e-5bbc9568f1c8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:56.816860 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-16ea4920-3c70-42ab-a44e-5bbc9568f1c8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8" status: 200 len: 1391 microversion: 2.1 time: 0.407277 Oct 30 01:19:56.817677 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 912/1798] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:56 2022] GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8 => generated 1391 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:56.844855 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a28ca197-d607-47ba-b1dc-00a3470f433c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:56.846970 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a28ca197-d607-47ba-b1dc-00a3470f433c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 5ed38927-680d-4e93-b57a-21fb407c6b33] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:56.979567 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a28ca197-d607-47ba-b1dc-00a3470f433c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:56.989358 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a28ca197-d607-47ba-b1dc-00a3470f433c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:56.991171 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a28ca197-d607-47ba-b1dc-00a3470f433c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:56.992648 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a28ca197-d607-47ba-b1dc-00a3470f433c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33" status: 200 len: 1104 microversion: 2.25 time: 0.152923 Oct 30 01:19:56.993324 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 913/1799] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:19:56 2022] GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33 => generated 1104 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:19:56.999913 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1686ed91-60b0-45b3-90ac-b2ee379a8329 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:57.000892 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1686ed91-60b0-45b3-90ac-b2ee379a8329 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:57.012715 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1686ed91-60b0-45b3-90ac-b2ee379a8329 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:57.013679 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1686ed91-60b0-45b3-90ac-b2ee379a8329 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:57.014324 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1686ed91-60b0-45b3-90ac-b2ee379a8329 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:57.017702 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1686ed91-60b0-45b3-90ac-b2ee379a8329 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:57.018284 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1686ed91-60b0-45b3-90ac-b2ee379a8329 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:57.019041 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1686ed91-60b0-45b3-90ac-b2ee379a8329 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:57.067805 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7865b5bf-6857-4b57-b700-4b74452e362d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:57.076276 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7865b5bf-6857-4b57-b700-4b74452e362d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7" status: 200 len: 1462 microversion: 2.1 time: 0.303561 Oct 30 01:19:57.110380 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 887/1800] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:56 2022] GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 => generated 1462 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:57.120847 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1686ed91-60b0-45b3-90ac-b2ee379a8329 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:57.121646 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cbfbd8ac-0111-42b7-ac7b-d03b38c0a0a0 tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:57.122500 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-cbfbd8ac-0111-42b7-ac7b-d03b38c0a0a0 tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] [instance: e7ff7c82-b3f6-4172-be0d-1c67c30db4f7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:57.129180 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cbfbd8ac-0111-42b7-ac7b-d03b38c0a0a0 tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:57.130990 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cbfbd8ac-0111-42b7-ac7b-d03b38c0a0a0 tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:57.131686 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cbfbd8ac-0111-42b7-ac7b-d03b38c0a0a0 tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:57.132646 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cbfbd8ac-0111-42b7-ac7b-d03b38c0a0a0 tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:57.133503 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cbfbd8ac-0111-42b7-ac7b-d03b38c0a0a0 tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:57.134182 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cbfbd8ac-0111-42b7-ac7b-d03b38c0a0a0 tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:57.138424 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1686ed91-60b0-45b3-90ac-b2ee379a8329 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:57.142749 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1686ed91-60b0-45b3-90ac-b2ee379a8329 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:57.149157 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1686ed91-60b0-45b3-90ac-b2ee379a8329 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1539 microversion: 2.91 time: 0.153162 Oct 30 01:19:57.150103 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 914/1801] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:19:56 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1539 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:19:57.263164 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d8968def-0c41-4b5f-83ab-73bb44f4d91f tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:57.263954 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d8968def-0c41-4b5f-83ab-73bb44f4d91f tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: 65a083f8-3b0d-43fd-93be-e9abb278e0ee] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:57.282598 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8968def-0c41-4b5f-83ab-73bb44f4d91f tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:57.284832 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8968def-0c41-4b5f-83ab-73bb44f4d91f tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:57.287791 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8968def-0c41-4b5f-83ab-73bb44f4d91f tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:57.290023 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8968def-0c41-4b5f-83ab-73bb44f4d91f tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:57.290792 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8968def-0c41-4b5f-83ab-73bb44f4d91f tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:57.291634 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8968def-0c41-4b5f-83ab-73bb44f4d91f tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:57.416116 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cbfbd8ac-0111-42b7-ac7b-d03b38c0a0a0 tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7" status: 200 len: 1613 microversion: 2.1 time: 0.298766 Oct 30 01:19:57.424476 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 888/1802] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:57 2022] GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 => generated 1613 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:57.435558 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-603e5b32-4905-4f11-909d-c726bd2e1765 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:57.436967 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-603e5b32-4905-4f11-909d-c726bd2e1765 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 22fce0cc-6498-4b95-b265-a44519f4fd9a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:57.443632 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-603e5b32-4905-4f11-909d-c726bd2e1765 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:57.444560 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-603e5b32-4905-4f11-909d-c726bd2e1765 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:57.444560 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-603e5b32-4905-4f11-909d-c726bd2e1765 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:57.445267 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-603e5b32-4905-4f11-909d-c726bd2e1765 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:57.446300 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-603e5b32-4905-4f11-909d-c726bd2e1765 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:57.446716 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-603e5b32-4905-4f11-909d-c726bd2e1765 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:57.475821 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d8968def-0c41-4b5f-83ab-73bb44f4d91f tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:57.484891 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d8968def-0c41-4b5f-83ab-73bb44f4d91f tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/65a083f8-3b0d-43fd-93be-e9abb278e0ee" status: 200 len: 1325 microversion: 2.1 time: 0.228836 Oct 30 01:19:57.497508 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 915/1803] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:57 2022] GET /compute/v2.1/servers/65a083f8-3b0d-43fd-93be-e9abb278e0ee => generated 1325 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:19:57.503011 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-27ad7552-decb-4119-a4c5-6f12c87e9d4e tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:19:57.503586 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-27ad7552-decb-4119-a4c5-6f12c87e9d4e tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] [instance: e7ff7c82-b3f6-4172-be0d-1c67c30db4f7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:57.510611 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27ad7552-decb-4119-a4c5-6f12c87e9d4e tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:57.511101 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27ad7552-decb-4119-a4c5-6f12c87e9d4e tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:57.511534 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27ad7552-decb-4119-a4c5-6f12c87e9d4e tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:57.512230 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27ad7552-decb-4119-a4c5-6f12c87e9d4e tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:57.512675 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27ad7552-decb-4119-a4c5-6f12c87e9d4e tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:57.512794 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-603e5b32-4905-4f11-909d-c726bd2e1765 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:57.513096 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27ad7552-decb-4119-a4c5-6f12c87e9d4e tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:57.522028 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-603e5b32-4905-4f11-909d-c726bd2e1765 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/22fce0cc-6498-4b95-b265-a44519f4fd9a" status: 200 len: 1275 microversion: 2.1 time: 0.090831 Oct 30 01:19:57.522614 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 889/1804] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:57 2022] GET /compute/v2.1/servers/22fce0cc-6498-4b95-b265-a44519f4fd9a => generated 1275 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:57.544374 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-27ad7552-decb-4119-a4c5-6f12c87e9d4e tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '1d811dc93ede4dbebc25f91027b6dfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8212ea2596df443dbc6cf5494d994b7b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:57.545044 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-27ad7552-decb-4119-a4c5-6f12c87e9d4e tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] [instance: e7ff7c82-b3f6-4172-be0d-1c67c30db4f7] flavor_id is None. Assuming migration. {{(pid=121102) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 30 01:19:57.545621 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-27ad7552-decb-4119-a4c5-6f12c87e9d4e tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] [instance: e7ff7c82-b3f6-4172-be0d-1c67c30db4f7] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=121102) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 30 01:19:57.574560 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-ec26a1a6-bebf-4e1f-8449-1edd833679f9 req-b3d244da-e26b-4e05-8ac1-91c2ffb1026c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ec8b27d-8af5-45d7-892b-09297e5cb2d8", "tag": "f2512753-a87d-49fe-8f90-bf6f3cdfb7b3"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:19:57.588729 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ec26a1a6-bebf-4e1f-8449-1edd833679f9 req-b3d244da-e26b-4e05-8ac1-91c2ffb1026c service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:57.589213 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ec26a1a6-bebf-4e1f-8449-1edd833679f9 req-b3d244da-e26b-4e05-8ac1-91c2ffb1026c service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:57.589680 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ec26a1a6-bebf-4e1f-8449-1edd833679f9 req-b3d244da-e26b-4e05-8ac1-91c2ffb1026c service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:57.604117 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-ec26a1a6-bebf-4e1f-8449-1edd833679f9 req-b3d244da-e26b-4e05-8ac1-91c2ffb1026c service nova] Creating event network-changed:f2512753-a87d-49fe-8f90-bf6f3cdfb7b3 for instance 0ec8b27d-8af5-45d7-892b-09297e5cb2d8 on n-h1-master-1 Oct 30 01:19:57.611308 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-ec26a1a6-bebf-4e1f-8449-1edd833679f9 req-b3d244da-e26b-4e05-8ac1-91c2ffb1026c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041546 Oct 30 01:19:57.612541 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 890/1805] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:19:57.846879 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-63b99a99-099e-4c15-af22-1f87145ae5e1 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:57.847754 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-63b99a99-099e-4c15-af22-1f87145ae5e1 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0ec8b27d-8af5-45d7-892b-09297e5cb2d8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:57.855043 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-63b99a99-099e-4c15-af22-1f87145ae5e1 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:57.855547 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-63b99a99-099e-4c15-af22-1f87145ae5e1 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:57.855984 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-63b99a99-099e-4c15-af22-1f87145ae5e1 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:57.856695 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-63b99a99-099e-4c15-af22-1f87145ae5e1 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:57.857361 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-63b99a99-099e-4c15-af22-1f87145ae5e1 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:57.857784 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-63b99a99-099e-4c15-af22-1f87145ae5e1 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:57.995311 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-27ad7552-decb-4119-a4c5-6f12c87e9d4e tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7/action" status: 202 len: 0 microversion: 2.1 time: 0.498155 Oct 30 01:19:57.996682 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 916/1806] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:19:57 2022] POST /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7/action => generated 0 bytes in 500 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:19:58.004691 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-21bad923-01b7-411f-85ee-3339e60c8321 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:58.005696 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-21bad923-01b7-411f-85ee-3339e60c8321 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: e7ff7c82-b3f6-4172-be0d-1c67c30db4f7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:58.013961 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-21bad923-01b7-411f-85ee-3339e60c8321 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:58.014860 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-21bad923-01b7-411f-85ee-3339e60c8321 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:58.015308 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-21bad923-01b7-411f-85ee-3339e60c8321 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:58.016319 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-21bad923-01b7-411f-85ee-3339e60c8321 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:58.016779 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-21bad923-01b7-411f-85ee-3339e60c8321 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:58.017451 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-21bad923-01b7-411f-85ee-3339e60c8321 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:58.132843 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-63b99a99-099e-4c15-af22-1f87145ae5e1 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:58.156945 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-63b99a99-099e-4c15-af22-1f87145ae5e1 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8" status: 200 len: 1391 microversion: 2.1 time: 0.311160 Oct 30 01:19:58.156945 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 891/1807] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:57 2022] GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8 => generated 1391 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:19:58.163885 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-37eeee1a-34f1-4130-bcd4-577060cf6312 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:58.165701 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-37eeee1a-34f1-4130-bcd4-577060cf6312 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 5ed38927-680d-4e93-b57a-21fb407c6b33] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:58.186206 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-37eeee1a-34f1-4130-bcd4-577060cf6312 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:58.186712 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-37eeee1a-34f1-4130-bcd4-577060cf6312 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:58.187151 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-37eeee1a-34f1-4130-bcd4-577060cf6312 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:58.187873 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-37eeee1a-34f1-4130-bcd4-577060cf6312 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:58.188351 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-37eeee1a-34f1-4130-bcd4-577060cf6312 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:58.188744 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-37eeee1a-34f1-4130-bcd4-577060cf6312 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:58.286298 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-37eeee1a-34f1-4130-bcd4-577060cf6312 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:58.331648 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-37eeee1a-34f1-4130-bcd4-577060cf6312 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:58.336793 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-37eeee1a-34f1-4130-bcd4-577060cf6312 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:58.338403 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-37eeee1a-34f1-4130-bcd4-577060cf6312 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33" status: 200 len: 1185 microversion: 2.25 time: 0.182901 Oct 30 01:19:58.344172 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 892/1808] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:19:58 2022] GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33 => generated 1185 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:19:58.351340 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-801a6f9f-5644-45e2-acb5-f1fc16c0fcf5 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:58.353461 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-801a6f9f-5644-45e2-acb5-f1fc16c0fcf5 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:58.362390 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-801a6f9f-5644-45e2-acb5-f1fc16c0fcf5 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:58.363845 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-801a6f9f-5644-45e2-acb5-f1fc16c0fcf5 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:58.364558 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-801a6f9f-5644-45e2-acb5-f1fc16c0fcf5 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:58.365647 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-801a6f9f-5644-45e2-acb5-f1fc16c0fcf5 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:58.366637 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-801a6f9f-5644-45e2-acb5-f1fc16c0fcf5 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:58.367809 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-801a6f9f-5644-45e2-acb5-f1fc16c0fcf5 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:58.399186 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-21bad923-01b7-411f-85ee-3339e60c8321 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:58.418011 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-21bad923-01b7-411f-85ee-3339e60c8321 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7" status: 200 len: 1471 microversion: 2.1 time: 0.411818 Oct 30 01:19:58.419179 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 917/1809] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:57 2022] GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 => generated 1471 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:19:58.493210 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-801a6f9f-5644-45e2-acb5-f1fc16c0fcf5 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:58.505859 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-801a6f9f-5644-45e2-acb5-f1fc16c0fcf5 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:58.507923 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-801a6f9f-5644-45e2-acb5-f1fc16c0fcf5 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:58.510824 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9db48555-0e4b-4b95-8261-9ff48a2ee903 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:58.512720 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9db48555-0e4b-4b95-8261-9ff48a2ee903 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: 65a083f8-3b0d-43fd-93be-e9abb278e0ee] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:58.521887 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-801a6f9f-5644-45e2-acb5-f1fc16c0fcf5 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1539 microversion: 2.91 time: 0.174394 Oct 30 01:19:58.524561 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 893/1810] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:19:58 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1539 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:19:58.537634 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9db48555-0e4b-4b95-8261-9ff48a2ee903 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:58.538437 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9db48555-0e4b-4b95-8261-9ff48a2ee903 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:58.542745 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9db48555-0e4b-4b95-8261-9ff48a2ee903 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:58.545720 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9db48555-0e4b-4b95-8261-9ff48a2ee903 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:58.547189 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9db48555-0e4b-4b95-8261-9ff48a2ee903 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:58.547439 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f6412221-b131-4422-a1cb-39f9c2d8db17 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:58.547988 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9db48555-0e4b-4b95-8261-9ff48a2ee903 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:58.548114 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f6412221-b131-4422-a1cb-39f9c2d8db17 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 22fce0cc-6498-4b95-b265-a44519f4fd9a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:58.570766 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f6412221-b131-4422-a1cb-39f9c2d8db17 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:58.571367 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f6412221-b131-4422-a1cb-39f9c2d8db17 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:58.571864 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f6412221-b131-4422-a1cb-39f9c2d8db17 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:58.572647 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f6412221-b131-4422-a1cb-39f9c2d8db17 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:58.575277 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f6412221-b131-4422-a1cb-39f9c2d8db17 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:58.575886 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f6412221-b131-4422-a1cb-39f9c2d8db17 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:58.825716 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f6412221-b131-4422-a1cb-39f9c2d8db17 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:58.852435 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f6412221-b131-4422-a1cb-39f9c2d8db17 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/22fce0cc-6498-4b95-b265-a44519f4fd9a" status: 200 len: 1275 microversion: 2.1 time: 0.293881 Oct 30 01:19:58.853129 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 894/1811] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:58 2022] GET /compute/v2.1/servers/22fce0cc-6498-4b95-b265-a44519f4fd9a => generated 1275 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:59.194952 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2404ff42-add6-4509-a04b-56d9d0100d3b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:59.197403 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2404ff42-add6-4509-a04b-56d9d0100d3b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0ec8b27d-8af5-45d7-892b-09297e5cb2d8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:59.226017 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2404ff42-add6-4509-a04b-56d9d0100d3b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:59.227216 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2404ff42-add6-4509-a04b-56d9d0100d3b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:59.228565 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2404ff42-add6-4509-a04b-56d9d0100d3b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:59.229945 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2404ff42-add6-4509-a04b-56d9d0100d3b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:59.230768 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2404ff42-add6-4509-a04b-56d9d0100d3b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:59.231522 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2404ff42-add6-4509-a04b-56d9d0100d3b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:59.235718 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9db48555-0e4b-4b95-8261-9ff48a2ee903 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:59.251966 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9db48555-0e4b-4b95-8261-9ff48a2ee903 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/65a083f8-3b0d-43fd-93be-e9abb278e0ee" status: 200 len: 1325 microversion: 2.1 time: 0.745011 Oct 30 01:19:59.252618 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 918/1812] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:58 2022] GET /compute/v2.1/servers/65a083f8-3b0d-43fd-93be-e9abb278e0ee => generated 1325 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:59.374728 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3a6d6966-9f7d-46d4-b83c-1b4af5a1cd84 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:59.375681 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3a6d6966-9f7d-46d4-b83c-1b4af5a1cd84 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 5ed38927-680d-4e93-b57a-21fb407c6b33] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:59.397467 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a6d6966-9f7d-46d4-b83c-1b4af5a1cd84 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:59.398194 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a6d6966-9f7d-46d4-b83c-1b4af5a1cd84 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:59.398873 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a6d6966-9f7d-46d4-b83c-1b4af5a1cd84 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:59.399799 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a6d6966-9f7d-46d4-b83c-1b4af5a1cd84 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:59.400903 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a6d6966-9f7d-46d4-b83c-1b4af5a1cd84 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:59.402102 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a6d6966-9f7d-46d4-b83c-1b4af5a1cd84 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:59.531124 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3a6d6966-9f7d-46d4-b83c-1b4af5a1cd84 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:59.546088 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3a6d6966-9f7d-46d4-b83c-1b4af5a1cd84 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:59.551844 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3a6d6966-9f7d-46d4-b83c-1b4af5a1cd84 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:59.553306 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3a6d6966-9f7d-46d4-b83c-1b4af5a1cd84 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33" status: 200 len: 1233 microversion: 2.25 time: 0.183099 Oct 30 01:19:59.554377 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 919/1813] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:19:59 2022] GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33 => generated 1233 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:19:59.560354 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0f631935-5afc-4617-8272-8ab5eb1cd22c tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:59.561319 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0f631935-5afc-4617-8272-8ab5eb1cd22c tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: e7ff7c82-b3f6-4172-be0d-1c67c30db4f7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:59.568331 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0f631935-5afc-4617-8272-8ab5eb1cd22c tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:59.569392 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0f631935-5afc-4617-8272-8ab5eb1cd22c tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:59.570029 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0f631935-5afc-4617-8272-8ab5eb1cd22c tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:59.570775 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0f631935-5afc-4617-8272-8ab5eb1cd22c tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:59.571321 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0f631935-5afc-4617-8272-8ab5eb1cd22c tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:59.571746 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0f631935-5afc-4617-8272-8ab5eb1cd22c tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:59.592483 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2404ff42-add6-4509-a04b-56d9d0100d3b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:59.603227 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2404ff42-add6-4509-a04b-56d9d0100d3b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8" status: 200 len: 1391 microversion: 2.1 time: 0.431169 Oct 30 01:19:59.620535 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 895/1814] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:59 2022] GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8 => generated 1391 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:19:59.627842 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ef5f0ab4-0f8e-4289-b521-dd91fbf3a370 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:59.628770 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ef5f0ab4-0f8e-4289-b521-dd91fbf3a370 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:59.636271 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ef5f0ab4-0f8e-4289-b521-dd91fbf3a370 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:59.637015 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ef5f0ab4-0f8e-4289-b521-dd91fbf3a370 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:59.638085 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ef5f0ab4-0f8e-4289-b521-dd91fbf3a370 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:59.639107 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ef5f0ab4-0f8e-4289-b521-dd91fbf3a370 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:59.639908 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ef5f0ab4-0f8e-4289-b521-dd91fbf3a370 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:59.640558 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ef5f0ab4-0f8e-4289-b521-dd91fbf3a370 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:59.785147 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ef5f0ab4-0f8e-4289-b521-dd91fbf3a370 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:59.799060 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ef5f0ab4-0f8e-4289-b521-dd91fbf3a370 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:59.817766 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ef5f0ab4-0f8e-4289-b521-dd91fbf3a370 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:59.829126 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ef5f0ab4-0f8e-4289-b521-dd91fbf3a370 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1539 microversion: 2.91 time: 0.206970 Oct 30 01:19:59.831123 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 896/1815] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:19:59 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1539 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:19:59.905305 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0ab9164c-5135-4948-b09e-736987bbe093 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:19:59.905996 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0ab9164c-5135-4948-b09e-736987bbe093 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 22fce0cc-6498-4b95-b265-a44519f4fd9a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:19:59.923972 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0ab9164c-5135-4948-b09e-736987bbe093 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:59.924818 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0ab9164c-5135-4948-b09e-736987bbe093 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:59.927118 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0ab9164c-5135-4948-b09e-736987bbe093 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:59.929576 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0ab9164c-5135-4948-b09e-736987bbe093 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:19:59.931617 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0ab9164c-5135-4948-b09e-736987bbe093 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:19:59.932246 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0ab9164c-5135-4948-b09e-736987bbe093 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:19:59.935706 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0f631935-5afc-4617-8272-8ab5eb1cd22c tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:19:59.948741 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0f631935-5afc-4617-8272-8ab5eb1cd22c tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7" status: 200 len: 1471 microversion: 2.1 time: 0.392443 Oct 30 01:19:59.949363 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 920/1816] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:59 2022] GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 => generated 1471 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:00.078978 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0ab9164c-5135-4948-b09e-736987bbe093 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:00.093287 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0ab9164c-5135-4948-b09e-736987bbe093 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/22fce0cc-6498-4b95-b265-a44519f4fd9a" status: 200 len: 1273 microversion: 2.1 time: 0.191871 Oct 30 01:20:00.095829 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 897/1817] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:19:59 2022] GET /compute/v2.1/servers/22fce0cc-6498-4b95-b265-a44519f4fd9a => generated 1273 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:20:00.305684 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bbd1c319-5be9-4471-b8f9-8133664f9e43 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:00.317995 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bbd1c319-5be9-4471-b8f9-8133664f9e43 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: 65a083f8-3b0d-43fd-93be-e9abb278e0ee] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:00.338683 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bbd1c319-5be9-4471-b8f9-8133664f9e43 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:00.339202 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bbd1c319-5be9-4471-b8f9-8133664f9e43 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:00.340836 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bbd1c319-5be9-4471-b8f9-8133664f9e43 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:00.341810 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bbd1c319-5be9-4471-b8f9-8133664f9e43 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:00.343867 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bbd1c319-5be9-4471-b8f9-8133664f9e43 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:00.345889 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bbd1c319-5be9-4471-b8f9-8133664f9e43 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:00.588190 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4868115c-7280-4592-9b6c-cd930d53e1c4 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:00.588808 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4868115c-7280-4592-9b6c-cd930d53e1c4 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 5ed38927-680d-4e93-b57a-21fb407c6b33] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:00.597517 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4868115c-7280-4592-9b6c-cd930d53e1c4 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:00.598009 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4868115c-7280-4592-9b6c-cd930d53e1c4 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:00.598438 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4868115c-7280-4592-9b6c-cd930d53e1c4 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:00.599157 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4868115c-7280-4592-9b6c-cd930d53e1c4 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:00.609607 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4868115c-7280-4592-9b6c-cd930d53e1c4 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:00.610448 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4868115c-7280-4592-9b6c-cd930d53e1c4 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:01.127193 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4868115c-7280-4592-9b6c-cd930d53e1c4 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:01.138839 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4868115c-7280-4592-9b6c-cd930d53e1c4 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:01.149562 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4868115c-7280-4592-9b6c-cd930d53e1c4 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:01.152736 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4868115c-7280-4592-9b6c-cd930d53e1c4 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33" status: 200 len: 1241 microversion: 2.25 time: 0.568949 Oct 30 01:20:01.170875 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 898/1818] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:20:00 2022] GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33 => generated 1241 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:20:01.184383 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d5d1ec3f-7227-4faa-9e49-68cc2435ed4d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:01.184997 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d5d1ec3f-7227-4faa-9e49-68cc2435ed4d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0ec8b27d-8af5-45d7-892b-09297e5cb2d8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:01.191735 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d5d1ec3f-7227-4faa-9e49-68cc2435ed4d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:01.192269 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d5d1ec3f-7227-4faa-9e49-68cc2435ed4d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:01.192703 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d5d1ec3f-7227-4faa-9e49-68cc2435ed4d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:01.193548 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d5d1ec3f-7227-4faa-9e49-68cc2435ed4d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:01.194002 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d5d1ec3f-7227-4faa-9e49-68cc2435ed4d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:01.194426 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d5d1ec3f-7227-4faa-9e49-68cc2435ed4d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:01.360136 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bbd1c319-5be9-4471-b8f9-8133664f9e43 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:01.372795 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bbd1c319-5be9-4471-b8f9-8133664f9e43 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/65a083f8-3b0d-43fd-93be-e9abb278e0ee" status: 200 len: 1325 microversion: 2.1 time: 1.072382 Oct 30 01:20:01.373813 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 921/1819] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:00 2022] GET /compute/v2.1/servers/65a083f8-3b0d-43fd-93be-e9abb278e0ee => generated 1325 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:01.386764 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c4e0c8c2-5982-47e9-83ab-d1cf97597e77 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:01.394436 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c4e0c8c2-5982-47e9-83ab-d1cf97597e77 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:01.413181 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4e0c8c2-5982-47e9-83ab-d1cf97597e77 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:01.433614 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4e0c8c2-5982-47e9-83ab-d1cf97597e77 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:01.438339 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4e0c8c2-5982-47e9-83ab-d1cf97597e77 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:01.443055 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4e0c8c2-5982-47e9-83ab-d1cf97597e77 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:01.444122 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4e0c8c2-5982-47e9-83ab-d1cf97597e77 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:01.444784 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4e0c8c2-5982-47e9-83ab-d1cf97597e77 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:01.801491 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c4e0c8c2-5982-47e9-83ab-d1cf97597e77 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:01.816104 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c4e0c8c2-5982-47e9-83ab-d1cf97597e77 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:01.823369 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c4e0c8c2-5982-47e9-83ab-d1cf97597e77 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:01.849574 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c4e0c8c2-5982-47e9-83ab-d1cf97597e77 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1539 microversion: 2.91 time: 0.468936 Oct 30 01:20:01.850183 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 922/1820] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:20:01 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1539 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:20:01.925001 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9dfacfb3-f16c-49ad-a164-cede5dda22a4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:01.925001 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9dfacfb3-f16c-49ad-a164-cede5dda22a4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: e7ff7c82-b3f6-4172-be0d-1c67c30db4f7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:01.931505 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9dfacfb3-f16c-49ad-a164-cede5dda22a4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:01.932730 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9dfacfb3-f16c-49ad-a164-cede5dda22a4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:01.933526 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9dfacfb3-f16c-49ad-a164-cede5dda22a4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:01.934601 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9dfacfb3-f16c-49ad-a164-cede5dda22a4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:01.935297 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9dfacfb3-f16c-49ad-a164-cede5dda22a4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:01.935955 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9dfacfb3-f16c-49ad-a164-cede5dda22a4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:02.485573 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d5d1ec3f-7227-4faa-9e49-68cc2435ed4d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:02.497819 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d5d1ec3f-7227-4faa-9e49-68cc2435ed4d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8" status: 200 len: 1391 microversion: 2.1 time: 1.317744 Oct 30 01:20:02.501091 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 899/1821] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:01 2022] GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8 => generated 1391 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:02.518922 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-66a75e89-1ddd-4e4a-850f-d445bad099d4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:02.523615 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-66a75e89-1ddd-4e4a-850f-d445bad099d4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 22fce0cc-6498-4b95-b265-a44519f4fd9a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:02.541903 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-66a75e89-1ddd-4e4a-850f-d445bad099d4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:02.542680 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-66a75e89-1ddd-4e4a-850f-d445bad099d4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:02.543319 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-66a75e89-1ddd-4e4a-850f-d445bad099d4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:02.544346 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-66a75e89-1ddd-4e4a-850f-d445bad099d4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:02.547413 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-66a75e89-1ddd-4e4a-850f-d445bad099d4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:02.550168 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-66a75e89-1ddd-4e4a-850f-d445bad099d4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:03.454389 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9dfacfb3-f16c-49ad-a164-cede5dda22a4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:03.461174 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9dfacfb3-f16c-49ad-a164-cede5dda22a4 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7" status: 200 len: 1471 microversion: 2.1 time: 1.575980 Oct 30 01:20:03.467339 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 923/1822] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:01 2022] GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 => generated 1471 bytes in 1612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:03.483518 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4a8b5876-1bdc-4c75-9b8c-0bc9e307b022 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:03.484624 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4a8b5876-1bdc-4c75-9b8c-0bc9e307b022 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 5ed38927-680d-4e93-b57a-21fb407c6b33] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:03.498769 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a8b5876-1bdc-4c75-9b8c-0bc9e307b022 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:03.504008 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a8b5876-1bdc-4c75-9b8c-0bc9e307b022 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:03.504008 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a8b5876-1bdc-4c75-9b8c-0bc9e307b022 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:03.504008 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a8b5876-1bdc-4c75-9b8c-0bc9e307b022 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:03.504008 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a8b5876-1bdc-4c75-9b8c-0bc9e307b022 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:03.504784 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a8b5876-1bdc-4c75-9b8c-0bc9e307b022 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:03.813845 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:20:04.004752 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4a8b5876-1bdc-4c75-9b8c-0bc9e307b022 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:04.015045 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4a8b5876-1bdc-4c75-9b8c-0bc9e307b022 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:04.016498 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4a8b5876-1bdc-4c75-9b8c-0bc9e307b022 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:04.017665 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4a8b5876-1bdc-4c75-9b8c-0bc9e307b022 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33" status: 200 len: 1251 microversion: 2.25 time: 0.549198 Oct 30 01:20:04.018241 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 924/1823] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:20:03 2022] GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33 => generated 1251 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:20:04.020883 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-66a75e89-1ddd-4e4a-850f-d445bad099d4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:04.033760 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d9daa774-8e7a-471f-803f-dcf6bbbb7d61 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:04.035007 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-66a75e89-1ddd-4e4a-850f-d445bad099d4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/22fce0cc-6498-4b95-b265-a44519f4fd9a" status: 200 len: 1315 microversion: 2.1 time: 1.530317 Oct 30 01:20:04.045435 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 900/1824] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:02 2022] GET /compute/v2.1/servers/22fce0cc-6498-4b95-b265-a44519f4fd9a => generated 1315 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:04.054731 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d9daa774-8e7a-471f-803f-dcf6bbbb7d61 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: 65a083f8-3b0d-43fd-93be-e9abb278e0ee] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:04.054891 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a5c085f9-f1ed-4fd7-9972-e0e3efa65090 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:04.054891 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a5c085f9-f1ed-4fd7-9972-e0e3efa65090 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:04.064876 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a5c085f9-f1ed-4fd7-9972-e0e3efa65090 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:04.065398 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a5c085f9-f1ed-4fd7-9972-e0e3efa65090 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:04.065844 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a5c085f9-f1ed-4fd7-9972-e0e3efa65090 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:04.066817 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a5c085f9-f1ed-4fd7-9972-e0e3efa65090 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:04.067273 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a5c085f9-f1ed-4fd7-9972-e0e3efa65090 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:04.067699 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a5c085f9-f1ed-4fd7-9972-e0e3efa65090 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:04.070059 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9daa774-8e7a-471f-803f-dcf6bbbb7d61 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:04.071463 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9daa774-8e7a-471f-803f-dcf6bbbb7d61 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:04.071463 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9daa774-8e7a-471f-803f-dcf6bbbb7d61 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:04.082905 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9daa774-8e7a-471f-803f-dcf6bbbb7d61 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:04.083666 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9daa774-8e7a-471f-803f-dcf6bbbb7d61 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:04.084338 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9daa774-8e7a-471f-803f-dcf6bbbb7d61 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:04.419802 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a5c085f9-f1ed-4fd7-9972-e0e3efa65090 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:04.429048 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a5c085f9-f1ed-4fd7-9972-e0e3efa65090 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:04.431414 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a5c085f9-f1ed-4fd7-9972-e0e3efa65090 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:04.438693 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a5c085f9-f1ed-4fd7-9972-e0e3efa65090 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1539 microversion: 2.91 time: 0.399634 Oct 30 01:20:04.439773 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 901/1825] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:20:04 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1539 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:20:04.445964 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bd9de778-2f42-43cd-b45d-70e8bc0169ad tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:04.446973 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-bd9de778-2f42-43cd-b45d-70e8bc0169ad tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0ec8b27d-8af5-45d7-892b-09297e5cb2d8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:04.454345 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd9de778-2f42-43cd-b45d-70e8bc0169ad tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:04.455252 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd9de778-2f42-43cd-b45d-70e8bc0169ad tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:04.456064 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd9de778-2f42-43cd-b45d-70e8bc0169ad tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:04.457422 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd9de778-2f42-43cd-b45d-70e8bc0169ad tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:04.458291 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd9de778-2f42-43cd-b45d-70e8bc0169ad tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:04.464129 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd9de778-2f42-43cd-b45d-70e8bc0169ad tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:04.465096 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=100 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:20:04.698922 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d9daa774-8e7a-471f-803f-dcf6bbbb7d61 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:04.713155 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d9daa774-8e7a-471f-803f-dcf6bbbb7d61 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/65a083f8-3b0d-43fd-93be-e9abb278e0ee" status: 200 len: 1325 microversion: 2.1 time: 0.686834 Oct 30 01:20:04.714159 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 925/1826] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:04 2022] GET /compute/v2.1/servers/65a083f8-3b0d-43fd-93be-e9abb278e0ee => generated 1325 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:04.742221 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-44a618bd-5212-4bfc-8dc4-85d52f64a25f req-ff34c284-3870-4ca2-ab20-10ee5cccf096 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65a083f8-3b0d-43fd-93be-e9abb278e0ee", "name": "network-vif-plugged", "status": "completed", "tag": "fb95a055-7db7-4eeb-ad46-76acd5e22198"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:20:04.782858 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-44a618bd-5212-4bfc-8dc4-85d52f64a25f req-ff34c284-3870-4ca2-ab20-10ee5cccf096 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:04.783793 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-44a618bd-5212-4bfc-8dc4-85d52f64a25f req-ff34c284-3870-4ca2-ab20-10ee5cccf096 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:04.784476 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-44a618bd-5212-4bfc-8dc4-85d52f64a25f req-ff34c284-3870-4ca2-ab20-10ee5cccf096 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:04.815646 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-44a618bd-5212-4bfc-8dc4-85d52f64a25f req-ff34c284-3870-4ca2-ab20-10ee5cccf096 service nova] Creating event network-vif-plugged:fb95a055-7db7-4eeb-ad46-76acd5e22198 for instance 65a083f8-3b0d-43fd-93be-e9abb278e0ee on n-h2-master-1 Oct 30 01:20:04.825223 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-44a618bd-5212-4bfc-8dc4-85d52f64a25f req-ff34c284-3870-4ca2-ab20-10ee5cccf096 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109575 Oct 30 01:20:04.828548 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 926/1827] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:20:04.837810 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-288b068a-cb3b-4526-933a-0c8cdc6dcb16 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:04.841189 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-288b068a-cb3b-4526-933a-0c8cdc6dcb16 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: e7ff7c82-b3f6-4172-be0d-1c67c30db4f7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:04.856429 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-288b068a-cb3b-4526-933a-0c8cdc6dcb16 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:04.862306 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-288b068a-cb3b-4526-933a-0c8cdc6dcb16 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:04.863202 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-288b068a-cb3b-4526-933a-0c8cdc6dcb16 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:04.864291 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-288b068a-cb3b-4526-933a-0c8cdc6dcb16 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:04.865082 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-288b068a-cb3b-4526-933a-0c8cdc6dcb16 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:04.865785 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-288b068a-cb3b-4526-933a-0c8cdc6dcb16 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:05.358892 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-bd9de778-2f42-43cd-b45d-70e8bc0169ad tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:05.369283 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bd9de778-2f42-43cd-b45d-70e8bc0169ad tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8" status: 200 len: 1391 microversion: 2.1 time: 0.928101 Oct 30 01:20:05.371765 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 902/1828] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:04 2022] GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8 => generated 1391 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:05.381670 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-f8db4f35-d044-482c-b776-4014f3258557 req-e30e7272-429a-4565-b398-f4b7ef29bb4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22fce0cc-6498-4b95-b265-a44519f4fd9a", "tag": "66baa2d3-656a-431a-a07b-408d352ae21e"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:20:05.406560 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-f8db4f35-d044-482c-b776-4014f3258557 req-e30e7272-429a-4565-b398-f4b7ef29bb4e service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:05.407054 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-f8db4f35-d044-482c-b776-4014f3258557 req-e30e7272-429a-4565-b398-f4b7ef29bb4e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:05.411879 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-f8db4f35-d044-482c-b776-4014f3258557 req-e30e7272-429a-4565-b398-f4b7ef29bb4e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:05.432739 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-f8db4f35-d044-482c-b776-4014f3258557 req-e30e7272-429a-4565-b398-f4b7ef29bb4e service nova] Creating event network-changed:66baa2d3-656a-431a-a07b-408d352ae21e for instance 22fce0cc-6498-4b95-b265-a44519f4fd9a on n-h2-master-1 Oct 30 01:20:05.440213 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-f8db4f35-d044-482c-b776-4014f3258557 req-e30e7272-429a-4565-b398-f4b7ef29bb4e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066796 Oct 30 01:20:05.442719 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 903/1829] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:20:05.449771 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-dcb691e9-94fb-4074-893c-0e248943d6f9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:05.451626 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-dcb691e9-94fb-4074-893c-0e248943d6f9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 5ed38927-680d-4e93-b57a-21fb407c6b33] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:05.463070 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dcb691e9-94fb-4074-893c-0e248943d6f9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:05.463941 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dcb691e9-94fb-4074-893c-0e248943d6f9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:05.464585 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dcb691e9-94fb-4074-893c-0e248943d6f9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:05.465642 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dcb691e9-94fb-4074-893c-0e248943d6f9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:05.466333 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dcb691e9-94fb-4074-893c-0e248943d6f9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:05.467682 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dcb691e9-94fb-4074-893c-0e248943d6f9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:05.742230 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-dcb691e9-94fb-4074-893c-0e248943d6f9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:05.756379 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-dcb691e9-94fb-4074-893c-0e248943d6f9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:05.760375 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-dcb691e9-94fb-4074-893c-0e248943d6f9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:05.762029 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-dcb691e9-94fb-4074-893c-0e248943d6f9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33" status: 200 len: 1293 microversion: 2.25 time: 0.318589 Oct 30 01:20:05.762841 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 904/1830] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:20:05 2022] GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33 => generated 1293 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:20:05.768631 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-160e5078-54e6-4111-8e41-1a9250fb6c88 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:05.769543 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-160e5078-54e6-4111-8e41-1a9250fb6c88 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 22fce0cc-6498-4b95-b265-a44519f4fd9a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:05.776985 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-160e5078-54e6-4111-8e41-1a9250fb6c88 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:05.777807 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-160e5078-54e6-4111-8e41-1a9250fb6c88 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:05.780617 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-160e5078-54e6-4111-8e41-1a9250fb6c88 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:05.780617 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-160e5078-54e6-4111-8e41-1a9250fb6c88 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:05.780617 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-160e5078-54e6-4111-8e41-1a9250fb6c88 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:05.780617 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-160e5078-54e6-4111-8e41-1a9250fb6c88 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:05.822924 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-288b068a-cb3b-4526-933a-0c8cdc6dcb16 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:05.833509 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-288b068a-cb3b-4526-933a-0c8cdc6dcb16 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7" status: 200 len: 1471 microversion: 2.1 time: 1.002823 Oct 30 01:20:05.847696 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 927/1831] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:04 2022] GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 => generated 1471 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:05.865819 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9dac7145-ba30-403f-b0e8-8d4b736bf9ac tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:05.869867 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9dac7145-ba30-403f-b0e8-8d4b736bf9ac tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:05.913605 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9dac7145-ba30-403f-b0e8-8d4b736bf9ac tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:05.915330 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9dac7145-ba30-403f-b0e8-8d4b736bf9ac tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:05.919547 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9dac7145-ba30-403f-b0e8-8d4b736bf9ac tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:05.922210 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9dac7145-ba30-403f-b0e8-8d4b736bf9ac tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:05.923922 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9dac7145-ba30-403f-b0e8-8d4b736bf9ac tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:05.925152 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9dac7145-ba30-403f-b0e8-8d4b736bf9ac tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:05.994051 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=28 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:20:06.066464 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:20:06.355295 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9dac7145-ba30-403f-b0e8-8d4b736bf9ac tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:06.366153 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9dac7145-ba30-403f-b0e8-8d4b736bf9ac tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:06.368176 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9dac7145-ba30-403f-b0e8-8d4b736bf9ac tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:06.388892 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9dac7145-ba30-403f-b0e8-8d4b736bf9ac tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1539 microversion: 2.91 time: 0.537868 Oct 30 01:20:06.391535 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 928/1832] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:20:05 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1539 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:20:06.406485 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-25d024c4-f878-4678-9056-e7a0757351b6 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:06.409139 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-25d024c4-f878-4678-9056-e7a0757351b6 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: 65a083f8-3b0d-43fd-93be-e9abb278e0ee] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:06.425940 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25d024c4-f878-4678-9056-e7a0757351b6 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:06.426752 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25d024c4-f878-4678-9056-e7a0757351b6 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:06.427196 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25d024c4-f878-4678-9056-e7a0757351b6 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:06.430553 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25d024c4-f878-4678-9056-e7a0757351b6 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:06.431029 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25d024c4-f878-4678-9056-e7a0757351b6 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:06.431705 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25d024c4-f878-4678-9056-e7a0757351b6 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:06.438082 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:20:06.627429 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-160e5078-54e6-4111-8e41-1a9250fb6c88 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:06.636489 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-160e5078-54e6-4111-8e41-1a9250fb6c88 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/22fce0cc-6498-4b95-b265-a44519f4fd9a" status: 200 len: 1315 microversion: 2.1 time: 0.872042 Oct 30 01:20:06.637136 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 905/1833] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:05 2022] GET /compute/v2.1/servers/22fce0cc-6498-4b95-b265-a44519f4fd9a => generated 1315 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:06.655564 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-af1619fc-06cf-497c-bac6-7fb20e1be8bd tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:06.655564 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-af1619fc-06cf-497c-bac6-7fb20e1be8bd tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0ec8b27d-8af5-45d7-892b-09297e5cb2d8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:06.685114 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af1619fc-06cf-497c-bac6-7fb20e1be8bd tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:06.689926 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af1619fc-06cf-497c-bac6-7fb20e1be8bd tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:06.690978 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af1619fc-06cf-497c-bac6-7fb20e1be8bd tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:06.695228 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af1619fc-06cf-497c-bac6-7fb20e1be8bd tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:06.698429 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af1619fc-06cf-497c-bac6-7fb20e1be8bd tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:06.698883 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af1619fc-06cf-497c-bac6-7fb20e1be8bd tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:06.931980 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-25d024c4-f878-4678-9056-e7a0757351b6 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:06.942988 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-25d024c4-f878-4678-9056-e7a0757351b6 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/65a083f8-3b0d-43fd-93be-e9abb278e0ee" status: 200 len: 1325 microversion: 2.1 time: 0.549158 Oct 30 01:20:06.943971 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 929/1834] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:06 2022] GET /compute/v2.1/servers/65a083f8-3b0d-43fd-93be-e9abb278e0ee => generated 1325 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:06.950918 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0a7be7d2-3224-4e72-9e85-4c3997d5903b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:06.951987 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0a7be7d2-3224-4e72-9e85-4c3997d5903b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 5ed38927-680d-4e93-b57a-21fb407c6b33] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:06.961941 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0a7be7d2-3224-4e72-9e85-4c3997d5903b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:06.962802 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0a7be7d2-3224-4e72-9e85-4c3997d5903b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:06.963748 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0a7be7d2-3224-4e72-9e85-4c3997d5903b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:06.965083 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0a7be7d2-3224-4e72-9e85-4c3997d5903b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:06.965837 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0a7be7d2-3224-4e72-9e85-4c3997d5903b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:06.966558 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0a7be7d2-3224-4e72-9e85-4c3997d5903b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:06.994570 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=8 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:20:07.046754 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-af1619fc-06cf-497c-bac6-7fb20e1be8bd tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:07.061109 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-af1619fc-06cf-497c-bac6-7fb20e1be8bd tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8" status: 200 len: 1391 microversion: 2.1 time: 0.416250 Oct 30 01:20:07.061960 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 906/1835] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:06 2022] GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8 => generated 1391 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:07.073969 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1bf8fad5-2aa2-4278-9a2a-0c11ed076be9 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:07.074627 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1bf8fad5-2aa2-4278-9a2a-0c11ed076be9 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: e7ff7c82-b3f6-4172-be0d-1c67c30db4f7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:07.087858 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1bf8fad5-2aa2-4278-9a2a-0c11ed076be9 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:07.088341 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1bf8fad5-2aa2-4278-9a2a-0c11ed076be9 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:07.088795 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1bf8fad5-2aa2-4278-9a2a-0c11ed076be9 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:07.089832 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1bf8fad5-2aa2-4278-9a2a-0c11ed076be9 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:07.097420 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1bf8fad5-2aa2-4278-9a2a-0c11ed076be9 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:07.098160 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1bf8fad5-2aa2-4278-9a2a-0c11ed076be9 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:07.382036 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0a7be7d2-3224-4e72-9e85-4c3997d5903b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:07.398511 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0a7be7d2-3224-4e72-9e85-4c3997d5903b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:07.400501 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0a7be7d2-3224-4e72-9e85-4c3997d5903b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:07.413866 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0a7be7d2-3224-4e72-9e85-4c3997d5903b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33" status: 200 len: 1293 microversion: 2.25 time: 0.456028 Oct 30 01:20:07.415188 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 930/1836] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:20:06 2022] GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33 => generated 1293 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:20:07.442243 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6fe8daa2-ebf4-4377-9a5a-b46a71f78496 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:07.451505 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6fe8daa2-ebf4-4377-9a5a-b46a71f78496 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:07.467422 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6fe8daa2-ebf4-4377-9a5a-b46a71f78496 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:07.470788 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6fe8daa2-ebf4-4377-9a5a-b46a71f78496 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:07.470788 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6fe8daa2-ebf4-4377-9a5a-b46a71f78496 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:07.471341 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6fe8daa2-ebf4-4377-9a5a-b46a71f78496 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:07.472029 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6fe8daa2-ebf4-4377-9a5a-b46a71f78496 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:07.472670 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6fe8daa2-ebf4-4377-9a5a-b46a71f78496 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:07.513684 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1bf8fad5-2aa2-4278-9a2a-0c11ed076be9 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:07.524585 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1bf8fad5-2aa2-4278-9a2a-0c11ed076be9 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7" status: 200 len: 1476 microversion: 2.1 time: 0.461233 Oct 30 01:20:07.525175 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 907/1837] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:07 2022] GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 => generated 1476 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:07.612115 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6fe8daa2-ebf4-4377-9a5a-b46a71f78496 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:07.639415 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6fe8daa2-ebf4-4377-9a5a-b46a71f78496 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:07.641240 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6fe8daa2-ebf4-4377-9a5a-b46a71f78496 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:07.645164 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:20:07.655179 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6fe8daa2-ebf4-4377-9a5a-b46a71f78496 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1560 microversion: 2.91 time: 0.224483 Oct 30 01:20:07.656045 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 931/1838] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:20:07 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1560 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:20:07.666034 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c214ef1d-64a9-41ef-b373-80ff71041600 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:07.669499 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c214ef1d-64a9-41ef-b373-80ff71041600 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 22fce0cc-6498-4b95-b265-a44519f4fd9a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:07.688084 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c214ef1d-64a9-41ef-b373-80ff71041600 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:07.694094 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c214ef1d-64a9-41ef-b373-80ff71041600 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:07.694730 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c214ef1d-64a9-41ef-b373-80ff71041600 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:07.696022 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c214ef1d-64a9-41ef-b373-80ff71041600 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:07.697153 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c214ef1d-64a9-41ef-b373-80ff71041600 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:07.697797 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c214ef1d-64a9-41ef-b373-80ff71041600 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:07.931074 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c214ef1d-64a9-41ef-b373-80ff71041600 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:07.959925 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-65c82534-5b58-4c6f-8213-27ec45b99264 req-6fc8fbcd-7324-439a-b26e-a2cc9416602a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ed38927-680d-4e93-b57a-21fb407c6b33", "tag": "1e47508a-754d-4221-8472-e44defed87c1"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:20:07.978766 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c214ef1d-64a9-41ef-b373-80ff71041600 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/22fce0cc-6498-4b95-b265-a44519f4fd9a" status: 200 len: 1315 microversion: 2.1 time: 0.318484 Oct 30 01:20:07.981698 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 908/1839] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:07 2022] GET /compute/v2.1/servers/22fce0cc-6498-4b95-b265-a44519f4fd9a => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:07.989896 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-65c82534-5b58-4c6f-8213-27ec45b99264 req-6fc8fbcd-7324-439a-b26e-a2cc9416602a service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:07.991760 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-65c82534-5b58-4c6f-8213-27ec45b99264 req-6fc8fbcd-7324-439a-b26e-a2cc9416602a service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:07.994348 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-65c82534-5b58-4c6f-8213-27ec45b99264 req-6fc8fbcd-7324-439a-b26e-a2cc9416602a service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:07.997091 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4aebcb94-878f-4b2a-b476-2a447119448a tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:07.999625 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4aebcb94-878f-4b2a-b476-2a447119448a tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: 65a083f8-3b0d-43fd-93be-e9abb278e0ee] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:08.022829 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4aebcb94-878f-4b2a-b476-2a447119448a tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:08.023526 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4aebcb94-878f-4b2a-b476-2a447119448a tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:08.026236 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4aebcb94-878f-4b2a-b476-2a447119448a tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:08.027880 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4aebcb94-878f-4b2a-b476-2a447119448a tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:08.028303 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4aebcb94-878f-4b2a-b476-2a447119448a tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:08.028745 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4aebcb94-878f-4b2a-b476-2a447119448a tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:08.035059 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-65c82534-5b58-4c6f-8213-27ec45b99264 req-6fc8fbcd-7324-439a-b26e-a2cc9416602a service nova] Creating event network-changed:1e47508a-754d-4221-8472-e44defed87c1 for instance 5ed38927-680d-4e93-b57a-21fb407c6b33 on n-h1-master-1 Oct 30 01:20:08.050577 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-65c82534-5b58-4c6f-8213-27ec45b99264 req-6fc8fbcd-7324-439a-b26e-a2cc9416602a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095933 Oct 30 01:20:08.052953 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 932/1840] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:20:08.121136 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-306c659a-3f65-4288-aa47-b51141f0bfd3 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:08.122141 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-306c659a-3f65-4288-aa47-b51141f0bfd3 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0ec8b27d-8af5-45d7-892b-09297e5cb2d8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:08.154922 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-306c659a-3f65-4288-aa47-b51141f0bfd3 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:08.155545 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-306c659a-3f65-4288-aa47-b51141f0bfd3 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:08.156055 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-306c659a-3f65-4288-aa47-b51141f0bfd3 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:08.156985 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-306c659a-3f65-4288-aa47-b51141f0bfd3 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:08.157976 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-306c659a-3f65-4288-aa47-b51141f0bfd3 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:08.159336 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-306c659a-3f65-4288-aa47-b51141f0bfd3 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:08.512659 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4aebcb94-878f-4b2a-b476-2a447119448a tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:08.533567 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4aebcb94-878f-4b2a-b476-2a447119448a tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/65a083f8-3b0d-43fd-93be-e9abb278e0ee" status: 200 len: 1522 microversion: 2.1 time: 0.538350 Oct 30 01:20:08.533567 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 909/1841] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:07 2022] GET /compute/v2.1/servers/65a083f8-3b0d-43fd-93be-e9abb278e0ee => generated 1522 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:08.533567 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1b4fffa8-9313-4ec4-9225-569e956c9573 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:08.533567 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1b4fffa8-9313-4ec4-9225-569e956c9573 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 5ed38927-680d-4e93-b57a-21fb407c6b33] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:08.550763 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1b4fffa8-9313-4ec4-9225-569e956c9573 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:08.550763 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1b4fffa8-9313-4ec4-9225-569e956c9573 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:08.550763 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1b4fffa8-9313-4ec4-9225-569e956c9573 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:08.558289 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1b4fffa8-9313-4ec4-9225-569e956c9573 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:08.558789 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1b4fffa8-9313-4ec4-9225-569e956c9573 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:08.559241 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1b4fffa8-9313-4ec4-9225-569e956c9573 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:08.767951 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-306c659a-3f65-4288-aa47-b51141f0bfd3 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:08.779510 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-306c659a-3f65-4288-aa47-b51141f0bfd3 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8" status: 200 len: 1391 microversion: 2.1 time: 0.693450 Oct 30 01:20:08.780401 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 933/1842] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:08 2022] GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8 => generated 1391 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:20:08.954632 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1b4fffa8-9313-4ec4-9225-569e956c9573 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:08.969788 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1b4fffa8-9313-4ec4-9225-569e956c9573 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:08.976458 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1b4fffa8-9313-4ec4-9225-569e956c9573 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:08.982318 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1b4fffa8-9313-4ec4-9225-569e956c9573 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33" status: 200 len: 1293 microversion: 2.25 time: 0.457926 Oct 30 01:20:08.985375 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 910/1843] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:20:08 2022] GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33 => generated 1293 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:20:08.995145 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9f22100c-a340-47af-989f-f3506a035569 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:08.998340 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9f22100c-a340-47af-989f-f3506a035569 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: 65a083f8-3b0d-43fd-93be-e9abb278e0ee] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:09.013269 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9f22100c-a340-47af-989f-f3506a035569 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:09.019001 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9f22100c-a340-47af-989f-f3506a035569 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:09.020063 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9f22100c-a340-47af-989f-f3506a035569 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:09.021020 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9f22100c-a340-47af-989f-f3506a035569 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:09.024652 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9f22100c-a340-47af-989f-f3506a035569 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:09.025303 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9f22100c-a340-47af-989f-f3506a035569 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:09.343505 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2504069b-e549-47ba-a8f6-69642761011d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:09.344897 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2504069b-e549-47ba-a8f6-69642761011d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: e7ff7c82-b3f6-4172-be0d-1c67c30db4f7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:09.354406 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2504069b-e549-47ba-a8f6-69642761011d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:09.355270 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2504069b-e549-47ba-a8f6-69642761011d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:09.356702 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2504069b-e549-47ba-a8f6-69642761011d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:09.360435 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2504069b-e549-47ba-a8f6-69642761011d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:09.363619 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2504069b-e549-47ba-a8f6-69642761011d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:09.364326 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2504069b-e549-47ba-a8f6-69642761011d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:09.977637 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9f22100c-a340-47af-989f-f3506a035569 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:09.990828 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9f22100c-a340-47af-989f-f3506a035569 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/65a083f8-3b0d-43fd-93be-e9abb278e0ee" status: 200 len: 1522 microversion: 2.1 time: 1.000431 Oct 30 01:20:09.997451 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 911/1844] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:08 2022] GET /compute/v2.1/servers/65a083f8-3b0d-43fd-93be-e9abb278e0ee => generated 1522 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:10.002651 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f041be83-9194-48be-a242-a7a7dca112eb tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:10.006554 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f041be83-9194-48be-a242-a7a7dca112eb tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:10.022209 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f041be83-9194-48be-a242-a7a7dca112eb tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:10.023001 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f041be83-9194-48be-a242-a7a7dca112eb tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:10.023775 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f041be83-9194-48be-a242-a7a7dca112eb tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:10.024723 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f041be83-9194-48be-a242-a7a7dca112eb tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:10.027120 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f041be83-9194-48be-a242-a7a7dca112eb tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:10.032760 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f041be83-9194-48be-a242-a7a7dca112eb tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:10.076546 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2504069b-e549-47ba-a8f6-69642761011d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:10.088023 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2504069b-e549-47ba-a8f6-69642761011d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7" status: 200 len: 1476 microversion: 2.1 time: 1.306325 Oct 30 01:20:10.091050 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 934/1845] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:08 2022] GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 => generated 1476 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:10.102586 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6d851c9f-f455-4aae-8089-079117dc32fa tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:10.106089 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6d851c9f-f455-4aae-8089-079117dc32fa tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 22fce0cc-6498-4b95-b265-a44519f4fd9a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:10.120588 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d851c9f-f455-4aae-8089-079117dc32fa tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:10.121327 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d851c9f-f455-4aae-8089-079117dc32fa tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:10.123450 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d851c9f-f455-4aae-8089-079117dc32fa tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:10.124423 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d851c9f-f455-4aae-8089-079117dc32fa tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:10.125875 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d851c9f-f455-4aae-8089-079117dc32fa tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:10.127738 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d851c9f-f455-4aae-8089-079117dc32fa tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:10.367452 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f041be83-9194-48be-a242-a7a7dca112eb tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:10.404245 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f041be83-9194-48be-a242-a7a7dca112eb tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:10.404602 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f041be83-9194-48be-a242-a7a7dca112eb tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:10.432496 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f041be83-9194-48be-a242-a7a7dca112eb tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1555 microversion: 2.91 time: 0.433448 Oct 30 01:20:10.436660 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 912/1846] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:20:09 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1555 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:20:10.476015 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-eb56eb81-d0e1-41f6-b204-00541f23d314 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:10.479509 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-eb56eb81-d0e1-41f6-b204-00541f23d314 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0ec8b27d-8af5-45d7-892b-09297e5cb2d8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:10.498839 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eb56eb81-d0e1-41f6-b204-00541f23d314 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:10.500075 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eb56eb81-d0e1-41f6-b204-00541f23d314 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:10.501868 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eb56eb81-d0e1-41f6-b204-00541f23d314 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:10.504099 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eb56eb81-d0e1-41f6-b204-00541f23d314 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:10.504588 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eb56eb81-d0e1-41f6-b204-00541f23d314 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:10.505900 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eb56eb81-d0e1-41f6-b204-00541f23d314 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:10.552170 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6d851c9f-f455-4aae-8089-079117dc32fa tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:10.574599 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6d851c9f-f455-4aae-8089-079117dc32fa tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/22fce0cc-6498-4b95-b265-a44519f4fd9a" status: 200 len: 1315 microversion: 2.1 time: 0.480992 Oct 30 01:20:10.577517 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 935/1847] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:10 2022] GET /compute/v2.1/servers/22fce0cc-6498-4b95-b265-a44519f4fd9a => generated 1315 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:11.250849 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-eb56eb81-d0e1-41f6-b204-00541f23d314 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:11.266373 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-eb56eb81-d0e1-41f6-b204-00541f23d314 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8" status: 200 len: 1391 microversion: 2.1 time: 0.826857 Oct 30 01:20:11.266989 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 913/1848] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:10 2022] GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8 => generated 1391 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:11.299116 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-faed22a0-5bf5-46b4-b53f-c8fe6c582e14 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:11.303025 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-faed22a0-5bf5-46b4-b53f-c8fe6c582e14 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 5ed38927-680d-4e93-b57a-21fb407c6b33] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:11.342746 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-faed22a0-5bf5-46b4-b53f-c8fe6c582e14 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:11.345602 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-faed22a0-5bf5-46b4-b53f-c8fe6c582e14 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:11.350857 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-faed22a0-5bf5-46b4-b53f-c8fe6c582e14 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:11.350857 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-faed22a0-5bf5-46b4-b53f-c8fe6c582e14 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:11.352155 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-faed22a0-5bf5-46b4-b53f-c8fe6c582e14 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:11.354267 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-faed22a0-5bf5-46b4-b53f-c8fe6c582e14 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:11.426359 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-dea88461-7cd1-4c79-965a-3739fd66c730 tempest-FloatingIPsNegativeTestJSON-461968820 tempest-FloatingIPsNegativeTestJSON-461968820-project] Calling method '.version_select at 0x7f44d04d0790>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:11.542089 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-dea88461-7cd1-4c79-965a-3739fd66c730 tempest-FloatingIPsNegativeTestJSON-461968820 tempest-FloatingIPsNegativeTestJSON-461968820-project] 10.222.0.13 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.960793 Oct 30 01:20:11.542844 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 936/1849] 10.222.0.13 () {58 vars in 1149 bytes} [Sun Oct 30 01:20:10 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:20:11.547813 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f45c04e0-3cf2-4147-a7c7-ac4f34ca118b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-633938635"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:20:11.553391 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f45c04e0-3cf2-4147-a7c7-ac4f34ca118b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: 65a083f8-3b0d-43fd-93be-e9abb278e0ee] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:11.566300 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f45c04e0-3cf2-4147-a7c7-ac4f34ca118b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:11.567294 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f45c04e0-3cf2-4147-a7c7-ac4f34ca118b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:11.568420 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f45c04e0-3cf2-4147-a7c7-ac4f34ca118b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:11.576297 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f45c04e0-3cf2-4147-a7c7-ac4f34ca118b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:11.577181 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f45c04e0-3cf2-4147-a7c7-ac4f34ca118b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:11.577893 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f45c04e0-3cf2-4147-a7c7-ac4f34ca118b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:11.647527 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-faed22a0-5bf5-46b4-b53f-c8fe6c582e14 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:11.658648 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-faed22a0-5bf5-46b4-b53f-c8fe6c582e14 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:11.666396 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-faed22a0-5bf5-46b4-b53f-c8fe6c582e14 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:11.667881 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-faed22a0-5bf5-46b4-b53f-c8fe6c582e14 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33" status: 200 len: 1281 microversion: 2.25 time: 0.394468 Oct 30 01:20:11.670737 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 914/1850] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:20:11 2022] GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33 => generated 1281 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:20:11.694755 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a7e439a0-77f8-4bd1-9324-e1fc06a75894 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:11.696192 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a7e439a0-77f8-4bd1-9324-e1fc06a75894 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: e7ff7c82-b3f6-4172-be0d-1c67c30db4f7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:11.710697 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a7e439a0-77f8-4bd1-9324-e1fc06a75894 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:11.718367 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a7e439a0-77f8-4bd1-9324-e1fc06a75894 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:11.723464 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a7e439a0-77f8-4bd1-9324-e1fc06a75894 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:11.724465 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a7e439a0-77f8-4bd1-9324-e1fc06a75894 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:11.725195 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a7e439a0-77f8-4bd1-9324-e1fc06a75894 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:11.725930 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a7e439a0-77f8-4bd1-9324-e1fc06a75894 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:12.133173 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f45c04e0-3cf2-4147-a7c7-ac4f34ca118b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "POST /compute/v2.1/servers/65a083f8-3b0d-43fd-93be-e9abb278e0ee/action" status: 202 len: 0 microversion: 2.1 time: 0.588737 Oct 30 01:20:12.136362 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 937/1851] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:20:11 2022] POST /compute/v2.1/servers/65a083f8-3b0d-43fd-93be-e9abb278e0ee/action => generated 0 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 30 01:20:12.148039 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d769bb6e-eaa9-4d60-acc1-db874a6273a2 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:12.150444 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d769bb6e-eaa9-4d60-acc1-db874a6273a2 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:12.175994 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d769bb6e-eaa9-4d60-acc1-db874a6273a2 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:12.180053 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d769bb6e-eaa9-4d60-acc1-db874a6273a2 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:12.183098 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d769bb6e-eaa9-4d60-acc1-db874a6273a2 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:12.184299 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d769bb6e-eaa9-4d60-acc1-db874a6273a2 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:12.187129 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d769bb6e-eaa9-4d60-acc1-db874a6273a2 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:12.190046 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d769bb6e-eaa9-4d60-acc1-db874a6273a2 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:12.374869 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d769bb6e-eaa9-4d60-acc1-db874a6273a2 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:12.377878 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a7e439a0-77f8-4bd1-9324-e1fc06a75894 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:12.403003 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a7e439a0-77f8-4bd1-9324-e1fc06a75894 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7" status: 200 len: 1476 microversion: 2.1 time: 0.727903 Oct 30 01:20:12.403724 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 915/1852] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:11 2022] GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 => generated 1476 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:12.427154 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d769bb6e-eaa9-4d60-acc1-db874a6273a2 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:12.430928 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d769bb6e-eaa9-4d60-acc1-db874a6273a2 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:12.433545 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5240c99d-f159-43aa-aeea-0a824026a48c tempest-FloatingIPsNegativeTestJSON-461968820 tempest-FloatingIPsNegativeTestJSON-461968820-project] Action: 'create', calling method: .version_select at 0x7f44c7a90700>, body: {"pool": "non_exist_pool"} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:20:12.469316 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d769bb6e-eaa9-4d60-acc1-db874a6273a2 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1555 microversion: 2.91 time: 0.331559 Oct 30 01:20:12.470882 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 938/1853] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:20:12 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1555 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:20:12.496299 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c165e8d4-2b31-4cf4-bbd4-65f2d5d6d8e7 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:12.503264 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c165e8d4-2b31-4cf4-bbd4-65f2d5d6d8e7 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 22fce0cc-6498-4b95-b265-a44519f4fd9a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:12.516799 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c165e8d4-2b31-4cf4-bbd4-65f2d5d6d8e7 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:12.518272 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c165e8d4-2b31-4cf4-bbd4-65f2d5d6d8e7 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:12.518925 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c165e8d4-2b31-4cf4-bbd4-65f2d5d6d8e7 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:12.521251 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c165e8d4-2b31-4cf4-bbd4-65f2d5d6d8e7 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:12.524692 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c165e8d4-2b31-4cf4-bbd4-65f2d5d6d8e7 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:12.533464 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-5240c99d-f159-43aa-aeea-0a824026a48c tempest-FloatingIPsNegativeTestJSON-461968820 tempest-FloatingIPsNegativeTestJSON-461968820-project] HTTP exception thrown: Floating IP pool not found. Oct 30 01:20:12.533464 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5240c99d-f159-43aa-aeea-0a824026a48c tempest-FloatingIPsNegativeTestJSON-461968820 tempest-FloatingIPsNegativeTestJSON-461968820-project] Request method failure captured: Oct 30 01:20:12.533464 n-d-master-1 devstack@n-api.service[121103]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 30 01:20:12.533464 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:20:12.533464 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:20:12.533464 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:20:12.533464 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 26 Oct 30 01:20:12.533464 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:20:12.533464 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:20:12.533464 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:20:12.533464 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:20:12.533464 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdFJS_bA7SoGxn7-CrQlFz0pAEfFcDTgmLlWg3lpRwM1vYCT_5vsQgTso2gNnwxis-HcCxMHwEwYRH4wpPyKPETz-GI3yFmmy6qOqTsE5H7VQIpdPdlXCWsy0uAnB3ETzQ9ia83ijtlHT1kbVkxZOS6flKHgaEmU2_E32xlVIhAAh8w Oct 30 01:20:12.533464 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:20:12.533464 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:20:12.533464 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:20:12.533464 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:20:12.533464 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:20:12.533464 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:20:12.533464 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 65c8af3991c444b58755762d76bccb1c Oct 30 01:20:12.533464 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-461968820 Oct 30 01:20:12.533464 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:20:12.533464 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:20:12.537197 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/65c8af3991c444b58755762d76bccb1c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_65c8af3991c444b58755762d76bccb1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/65c8af3991c444b58755762d76bccb1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/65c8af3991c444b58755762d76bccb1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:20:12.537197 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-461968820 Oct 30 01:20:12.537197 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 65c8af3991c444b58755762d76bccb1c Oct 30 01:20:12.537197 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-461968820 Oct 30 01:20:12.537197 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-FloatingIPsNegativeTestJSON-461968820-project Oct 30 01:20:12.537197 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:20:12.537197 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:20:12.537197 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: e125f4fd68a048d1bb1f677d994e8181 Oct 30 01:20:12.537197 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-461968820-project Oct 30 01:20:12.537197 n-d-master-1 devstack@n-api.service[121103]: Oct 30 01:20:12.537197 n-d-master-1 devstack@n-api.service[121103]: {"pool": "non_exist_pool"} Oct 30 01:20:12.537197 n-d-master-1 devstack@n-api.service[121103]: method: Oct 30 01:20:12.537197 n-d-master-1 devstack@n-api.service[121103]: exception: Floating IP pool not found. Oct 30 01:20:12.537197 n-d-master-1 devstack@n-api.service[121103]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 30 01:20:12.537197 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:20:12.538497 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:12.538497 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 30 01:20:12.538497 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 30 01:20:12.538497 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 30 01:20:12.538497 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 30 01:20:12.538497 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 30 01:20:12.538497 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 30 01:20:12.538497 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 30 01:20:12.538497 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:20:12.538497 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:12.538497 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:20:12.538497 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:12.538497 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:20:12.538497 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:20:12.538497 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:20:12.538497 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:20:12.538497 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:20:12.538497 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:20:12.538497 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:20:12.538497 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:20:12.540283 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 30 01:20:12.540283 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:20:12.540283 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 30 01:20:12.540283 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:20:12.540283 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:12.540283 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:20:12.540283 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:12.540283 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:20:12.540283 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:20:12.540283 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:20:12.540283 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:20:12.540283 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 30 01:20:12.540283 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:20:12.540283 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5240c99d-f159-43aa-aeea-0a824026a48c tempest-FloatingIPsNegativeTestJSON-461968820 tempest-FloatingIPsNegativeTestJSON-461968820-project] Returning 404 to user: Floating IP pool not found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:20:12.540283 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5240c99d-f159-43aa-aeea-0a824026a48c tempest-FloatingIPsNegativeTestJSON-461968820 tempest-FloatingIPsNegativeTestJSON-461968820-project] 10.222.0.13 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.105070 Oct 30 01:20:12.541582 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 916/1854] 10.222.0.13 () {60 vars in 1170 bytes} [Sun Oct 30 01:20:12 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:20:12.546190 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7e053711-63f1-4d95-ba7a-15e41fa99597 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '.version_select at 0x7f44c7a9f160>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:12.550631 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c165e8d4-2b31-4cf4-bbd4-65f2d5d6d8e7 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:12.861691 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c165e8d4-2b31-4cf4-bbd4-65f2d5d6d8e7 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:12.879650 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c165e8d4-2b31-4cf4-bbd4-65f2d5d6d8e7 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/22fce0cc-6498-4b95-b265-a44519f4fd9a" status: 200 len: 1315 microversion: 2.1 time: 0.407412 Oct 30 01:20:12.890990 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 939/1855] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:12 2022] GET /compute/v2.1/servers/22fce0cc-6498-4b95-b265-a44519f4fd9a => generated 1315 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:12.890990 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9c01b871-d653-43a8-b703-b28afd0acde4 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:12.896412 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9c01b871-d653-43a8-b703-b28afd0acde4 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0ec8b27d-8af5-45d7-892b-09297e5cb2d8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:12.914137 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9c01b871-d653-43a8-b703-b28afd0acde4 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:12.917389 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9c01b871-d653-43a8-b703-b28afd0acde4 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:12.919284 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9c01b871-d653-43a8-b703-b28afd0acde4 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:12.920856 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9c01b871-d653-43a8-b703-b28afd0acde4 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:12.921355 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9c01b871-d653-43a8-b703-b28afd0acde4 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:12.921811 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9c01b871-d653-43a8-b703-b28afd0acde4 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:13.354467 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9c01b871-d653-43a8-b703-b28afd0acde4 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:13.354467 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9c01b871-d653-43a8-b703-b28afd0acde4 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8" status: 200 len: 1381 microversion: 2.1 time: 0.323490 Oct 30 01:20:13.354467 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 940/1856] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:12 2022] GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8 => generated 1381 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:13.354467 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a389a65a-a080-4bb9-997b-c584abe2a08b tempest-FloatingIPsNegativeTestJSON-461968820 tempest-FloatingIPsNegativeTestJSON-461968820-project] Calling method '.version_select at 0x7f44d0474670>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:13.363044 n-d-master-1 devstack@n-api.service[121102]: DEBUG neutronclient.v2_0.client [None req-a389a65a-a080-4bb9-997b-c584abe2a08b tempest-FloatingIPsNegativeTestJSON-461968820 tempest-FloatingIPsNegativeTestJSON-461968820-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 93cfff6a-c0eb-4931-a6bc-c0e8a446492d could not be found", "detail": ""}} {{(pid=121102) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 30 01:20:13.363044 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-a389a65a-a080-4bb9-997b-c584abe2a08b tempest-FloatingIPsNegativeTestJSON-461968820 tempest-FloatingIPsNegativeTestJSON-461968820-project] HTTP exception thrown: Floating IP not found for ID 93cfff6a-c0eb-4931-a6bc-c0e8a446492d Oct 30 01:20:13.363044 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a389a65a-a080-4bb9-997b-c584abe2a08b tempest-FloatingIPsNegativeTestJSON-461968820 tempest-FloatingIPsNegativeTestJSON-461968820-project] Request method failure captured: Oct 30 01:20:13.363044 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/os-floating-ips/93cfff6a-c0eb-4931-a6bc-c0e8a446492d HTTP/1.1 Oct 30 01:20:13.363044 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:20:13.363044 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:20:13.363044 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:20:13.363044 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:20:13.363044 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:20:13.363044 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:20:13.363044 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:20:13.363044 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:20:13.363044 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdFJS_bA7SoGxn7-CrQlFz0pAEfFcDTgmLlWg3lpRwM1vYCT_5vsQgTso2gNnwxis-HcCxMHwEwYRH4wpPyKPETz-GI3yFmmy6qOqTsE5H7VQIpdPdlXCWsy0uAnB3ETzQ9ia83ijtlHT1kbVkxZOS6flKHgaEmU2_E32xlVIhAAh8w Oct 30 01:20:13.363044 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:20:13.363044 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:20:13.363044 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:20:13.363044 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:20:13.363044 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:20:13.363044 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:20:13.363044 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 65c8af3991c444b58755762d76bccb1c Oct 30 01:20:13.363044 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-461968820 Oct 30 01:20:13.363044 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:20:13.363044 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:20:13.372826 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/65c8af3991c444b58755762d76bccb1c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_65c8af3991c444b58755762d76bccb1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/65c8af3991c444b58755762d76bccb1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/65c8af3991c444b58755762d76bccb1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:20:13.372826 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-461968820 Oct 30 01:20:13.372826 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 65c8af3991c444b58755762d76bccb1c Oct 30 01:20:13.372826 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-461968820 Oct 30 01:20:13.372826 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-FloatingIPsNegativeTestJSON-461968820-project Oct 30 01:20:13.372826 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:20:13.372826 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:20:13.372826 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: e125f4fd68a048d1bb1f677d994e8181 Oct 30 01:20:13.372826 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-461968820-project Oct 30 01:20:13.372826 n-d-master-1 devstack@n-api.service[121102]: method: Oct 30 01:20:13.372826 n-d-master-1 devstack@n-api.service[121102]: exception: Floating IP not found for ID 93cfff6a-c0eb-4931-a6bc-c0e8a446492d Oct 30 01:20:13.372826 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '93cfff6a-c0eb-4931-a6bc-c0e8a446492d'} Oct 30 01:20:13.372826 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:20:13.378869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:13.378869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 30 01:20:13.378869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 30 01:20:13.378869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:20:13.378869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:20:13.378869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 30 01:20:13.378869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 30 01:20:13.378869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:20:13.378869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:20:13.378869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 30 01:20:13.378869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 30 01:20:13.378869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:20:13.378869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:20:13.378869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 30 01:20:13.378869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 30 01:20:13.378869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:20:13.378869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:20:13.378869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 30 01:20:13.378869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 30 01:20:13.384009 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:20:13.384009 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:20:13.384009 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 30 01:20:13.384009 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 30 01:20:13.384009 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 30 01:20:13.384009 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 30 01:20:13.384009 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 93cfff6a-c0eb-4931-a6bc-c0e8a446492d could not be found Oct 30 01:20:13.384009 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-526f1c9a-e318-4fb4-8795-0951b05923d1'] Oct 30 01:20:13.384009 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:20:13.384009 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:13.384009 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:20:13.384009 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:13.384009 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 30 01:20:13.384009 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 30 01:20:13.384009 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 30 01:20:13.384009 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 30 01:20:13.384009 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 93cfff6a-c0eb-4931-a6bc-c0e8a446492d. Oct 30 01:20:13.384009 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:20:13.384009 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:13.384009 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:20:13.390798 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:13.390798 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:20:13.390798 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:20:13.390798 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:20:13.390798 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:20:13.390798 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:20:13.390798 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:20:13.390798 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:20:13.390798 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:20:13.390798 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 30 01:20:13.390798 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 30 01:20:13.390798 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 93cfff6a-c0eb-4931-a6bc-c0e8a446492d Oct 30 01:20:13.390798 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:20:13.390798 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:13.390798 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:20:13.390798 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:13.390798 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:20:13.390798 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:20:13.390798 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:20:13.390798 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:20:13.394588 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 93cfff6a-c0eb-4931-a6bc-c0e8a446492d Oct 30 01:20:13.394588 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:20:13.394588 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a389a65a-a080-4bb9-997b-c584abe2a08b tempest-FloatingIPsNegativeTestJSON-461968820 tempest-FloatingIPsNegativeTestJSON-461968820-project] Returning 404 to user: Floating IP not found for ID 93cfff6a-c0eb-4931-a6bc-c0e8a446492d {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:20:13.394588 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a389a65a-a080-4bb9-997b-c584abe2a08b tempest-FloatingIPsNegativeTestJSON-461968820 tempest-FloatingIPsNegativeTestJSON-461968820-project] 10.222.0.13 "DELETE /compute/v2.1/os-floating-ips/93cfff6a-c0eb-4931-a6bc-c0e8a446492d" status: 404 len: 111 microversion: 2.1 time: 0.063092 Oct 30 01:20:13.394588 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 941/1857] 10.222.0.13 () {58 vars in 1263 bytes} [Sun Oct 30 01:20:13 2022] DELETE /compute/v2.1/os-floating-ips/93cfff6a-c0eb-4931-a6bc-c0e8a446492d => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:20:13.394588 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-36f09fac-e506-4cdf-9bf8-8069ea31e55b req-bcd2b042-2b81-459d-b799-0700eafac6dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22fce0cc-6498-4b95-b265-a44519f4fd9a", "name": "network-vif-plugged", "status": "completed", "tag": "66baa2d3-656a-431a-a07b-408d352ae21e"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:20:13.396775 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-36f09fac-e506-4cdf-9bf8-8069ea31e55b req-bcd2b042-2b81-459d-b799-0700eafac6dc service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:13.396775 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-36f09fac-e506-4cdf-9bf8-8069ea31e55b req-bcd2b042-2b81-459d-b799-0700eafac6dc service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:13.396775 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-36f09fac-e506-4cdf-9bf8-8069ea31e55b req-bcd2b042-2b81-459d-b799-0700eafac6dc service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:13.396775 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-36f09fac-e506-4cdf-9bf8-8069ea31e55b req-bcd2b042-2b81-459d-b799-0700eafac6dc service nova] Creating event network-vif-plugged:66baa2d3-656a-431a-a07b-408d352ae21e for instance 22fce0cc-6498-4b95-b265-a44519f4fd9a on n-h2-master-1 Oct 30 01:20:13.396775 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-36f09fac-e506-4cdf-9bf8-8069ea31e55b req-bcd2b042-2b81-459d-b799-0700eafac6dc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072563 Oct 30 01:20:13.397940 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 942/1858] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:20:13.397940 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-53466a14-9da3-469a-a8b3-191c6bee0d30 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:13.397940 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-53466a14-9da3-469a-a8b3-191c6bee0d30 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 5ed38927-680d-4e93-b57a-21fb407c6b33] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:13.401434 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53466a14-9da3-469a-a8b3-191c6bee0d30 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:13.401434 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53466a14-9da3-469a-a8b3-191c6bee0d30 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:13.401434 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53466a14-9da3-469a-a8b3-191c6bee0d30 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:13.401869 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53466a14-9da3-469a-a8b3-191c6bee0d30 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:13.402323 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53466a14-9da3-469a-a8b3-191c6bee0d30 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:13.402941 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53466a14-9da3-469a-a8b3-191c6bee0d30 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:13.514644 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7e053711-63f1-4d95-ba7a-15e41fa99597 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "DELETE /compute/v2.1/images/fa6497ba-e11f-4ffc-9600-7d1bcd8910b2" status: 204 len: 0 microversion: 2.1 time: 0.975832 Oct 30 01:20:13.514644 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 917/1859] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:12 2022] DELETE /compute/v2.1/images/fa6497ba-e11f-4ffc-9600-7d1bcd8910b2 => generated 0 bytes in 980 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:20:13.519678 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c640ef0b-3d65-4d3b-834e-108448d8f9a2 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Calling method '.version_select at 0x7f44c7af1040>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:13.524896 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c640ef0b-3d65-4d3b-834e-108448d8f9a2 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:13.525825 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c640ef0b-3d65-4d3b-834e-108448d8f9a2 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:13.526556 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c640ef0b-3d65-4d3b-834e-108448d8f9a2 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:13.543490 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c640ef0b-3d65-4d3b-834e-108448d8f9a2 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] 10.222.0.13 "GET /compute/v2.1/os-migrations" status: 200 len: 4272 microversion: 2.1 time: 0.029376 Oct 30 01:20:13.555760 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 918/1860] 10.222.0.13 () {58 vars in 1143 bytes} [Sun Oct 30 01:20:13 2022] GET /compute/v2.1/os-migrations => generated 4272 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:13.567104 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-91a834ee-3a35-40fb-8023-00f42200dfa8 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:13.568348 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-91a834ee-3a35-40fb-8023-00f42200dfa8 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: e7ff7c82-b3f6-4172-be0d-1c67c30db4f7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:13.576280 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91a834ee-3a35-40fb-8023-00f42200dfa8 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:13.577219 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91a834ee-3a35-40fb-8023-00f42200dfa8 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:13.577966 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91a834ee-3a35-40fb-8023-00f42200dfa8 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:13.584262 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91a834ee-3a35-40fb-8023-00f42200dfa8 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:13.584262 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91a834ee-3a35-40fb-8023-00f42200dfa8 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:13.584262 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91a834ee-3a35-40fb-8023-00f42200dfa8 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:13.996430 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-53466a14-9da3-469a-a8b3-191c6bee0d30 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:14.014184 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-53466a14-9da3-469a-a8b3-191c6bee0d30 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:14.019355 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-53466a14-9da3-469a-a8b3-191c6bee0d30 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:14.020181 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-53466a14-9da3-469a-a8b3-191c6bee0d30 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33" status: 200 len: 1281 microversion: 2.25 time: 0.656299 Oct 30 01:20:14.020744 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 943/1861] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:20:13 2022] GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33 => generated 1281 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:20:14.036892 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5582da76-b350-4633-8426-6d653f243407 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:14.052781 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5582da76-b350-4633-8426-6d653f243407 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:14.077444 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5582da76-b350-4633-8426-6d653f243407 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:14.078188 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5582da76-b350-4633-8426-6d653f243407 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:14.079024 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5582da76-b350-4633-8426-6d653f243407 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:14.080907 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5582da76-b350-4633-8426-6d653f243407 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:14.081796 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5582da76-b350-4633-8426-6d653f243407 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:14.082418 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5582da76-b350-4633-8426-6d653f243407 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:14.082716 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-91a834ee-3a35-40fb-8023-00f42200dfa8 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:14.102312 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-91a834ee-3a35-40fb-8023-00f42200dfa8 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7" status: 200 len: 1476 microversion: 2.1 time: 0.544944 Oct 30 01:20:14.107854 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 919/1862] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:13 2022] GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 => generated 1476 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:14.145491 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8971b7e2-e955-4d42-84c1-808f034494c1 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '.version_select at 0x7f44c7aa9790>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:14.185548 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5582da76-b350-4633-8426-6d653f243407 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:14.193100 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-8971b7e2-e955-4d42-84c1-808f034494c1 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] HTTP exception thrown: Image not found. Oct 30 01:20:14.204479 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5582da76-b350-4633-8426-6d653f243407 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:14.214004 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5582da76-b350-4633-8426-6d653f243407 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:14.222507 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5582da76-b350-4633-8426-6d653f243407 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1555 microversion: 2.91 time: 0.197020 Oct 30 01:20:14.222918 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8971b7e2-e955-4d42-84c1-808f034494c1 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Request method failure captured: Oct 30 01:20:14.222918 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/images/fa6497ba-e11f-4ffc-9600-7d1bcd8910b2 HTTP/1.1 Oct 30 01:20:14.222918 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:20:14.222918 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:20:14.222918 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:20:14.222918 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:20:14.222918 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:20:14.222918 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:20:14.222918 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:20:14.222918 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:20:14.222918 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdD3IhIPYY_sTvEXpI9r1a34kazQy3xsqStabQonrlcEF0HpNl2ztWpirnqs0lietV1LWWVyHjCqAxxd5t3TuUU6o10qW3LK2oIPKGmvwXDy1lrrZEL1UVe632zfYCdkIUu5geJi4tWcEpwgvNOLoS3eMkj37BIJt_45I78bzhHVIS8 Oct 30 01:20:14.222918 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:20:14.222918 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:20:14.222918 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:20:14.222918 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:20:14.222918 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:20:14.222918 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:20:14.222918 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 8c2cd7e4b04741e3bb1cb9852612db57 Oct 30 01:20:14.222918 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1966575233 Oct 30 01:20:14.222918 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:20:14.222918 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:20:14.224789 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c2cd7e4b04741e3bb1cb9852612db57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8c2cd7e4b04741e3bb1cb9852612db57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8c2cd7e4b04741e3bb1cb9852612db57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c2cd7e4b04741e3bb1cb9852612db57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:20:14.224789 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1966575233 Oct 30 01:20:14.224789 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 8c2cd7e4b04741e3bb1cb9852612db57 Oct 30 01:20:14.224789 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1966575233 Oct 30 01:20:14.224789 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ImagesOneServerNegativeTestJSON-1966575233-project Oct 30 01:20:14.224789 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:20:14.224789 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:20:14.224789 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: c114d44d0a314c75902da53fca797f62 Oct 30 01:20:14.224789 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1966575233-project Oct 30 01:20:14.224789 n-d-master-1 devstack@n-api.service[121103]: method: Oct 30 01:20:14.224789 n-d-master-1 devstack@n-api.service[121103]: exception: Image not found. Oct 30 01:20:14.224789 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'fa6497ba-e11f-4ffc-9600-7d1bcd8910b2'} Oct 30 01:20:14.224789 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:20:14.225863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:14.225863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 30 01:20:14.225863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 30 01:20:14.225863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 30 01:20:14.225863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 30 01:20:14.225863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 30 01:20:14.225863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 30 01:20:14.225863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 30 01:20:14.225863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 30 01:20:14.225863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 30 01:20:14.225863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 30 01:20:14.225863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 30 01:20:14.225863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 30 01:20:14.225863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 30 01:20:14.225863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 30 01:20:14.225863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 30 01:20:14.225863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 30 01:20:14.225863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID fa6497ba-e11f-4ffc-9600-7d1bcd8910b2 Oct 30 01:20:14.227478 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:20:14.227478 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:14.227478 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:20:14.227478 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:14.227478 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 30 01:20:14.227478 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 30 01:20:14.227478 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 30 01:20:14.227478 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 30 01:20:14.227478 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 30 01:20:14.227478 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 30 01:20:14.227478 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 30 01:20:14.227478 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 30 01:20:14.227478 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 30 01:20:14.227478 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 30 01:20:14.227478 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 30 01:20:14.227478 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 30 01:20:14.227478 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 30 01:20:14.227478 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 30 01:20:14.227478 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 30 01:20:14.227478 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 30 01:20:14.229196 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 30 01:20:14.229196 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 30 01:20:14.229196 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 30 01:20:14.229196 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 30 01:20:14.229196 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 30 01:20:14.229196 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 30 01:20:14.229196 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 30 01:20:14.229196 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 30 01:20:14.229196 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fa6497ba-e11f-4ffc-9600-7d1bcd8910b2 could not be found. Oct 30 01:20:14.229196 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:20:14.229196 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:14.229196 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:20:14.229196 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:14.229196 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:20:14.229196 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:20:14.229196 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:20:14.229196 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:20:14.229196 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:20:14.229196 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:20:14.233721 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:20:14.233721 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:20:14.233721 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 30 01:20:14.233721 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 30 01:20:14.233721 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 30 01:20:14.233721 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:20:14.233721 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:14.233721 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:20:14.233721 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:14.233721 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:20:14.233721 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:20:14.233721 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:20:14.233721 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:20:14.233721 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 30 01:20:14.233721 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:20:14.233721 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8971b7e2-e955-4d42-84c1-808f034494c1 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Returning 404 to user: Image not found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:20:14.235114 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8971b7e2-e955-4d42-84c1-808f034494c1 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/images/fa6497ba-e11f-4ffc-9600-7d1bcd8910b2" status: 404 len: 62 microversion: 2.1 time: 0.113849 Oct 30 01:20:14.235114 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 920/1863] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:20:14 2022] GET /compute/v2.1/images/fa6497ba-e11f-4ffc-9600-7d1bcd8910b2 => generated 62 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:20:14.235114 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1bf88c96-868c-41c2-9f32-85f98102aa91 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:14.235114 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1bf88c96-868c-41c2-9f32-85f98102aa91 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] [instance: 0ec8b27d-8af5-45d7-892b-09297e5cb2d8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:14.235482 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 944/1864] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:20:14 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1555 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:20:14.239540 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1bf88c96-868c-41c2-9f32-85f98102aa91 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:14.240141 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-682810e7-e2b6-4ff6-81f7-dfede9a5fdf7 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:14.240663 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1bf88c96-868c-41c2-9f32-85f98102aa91 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:14.241112 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1bf88c96-868c-41c2-9f32-85f98102aa91 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:14.241605 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-682810e7-e2b6-4ff6-81f7-dfede9a5fdf7 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 22fce0cc-6498-4b95-b265-a44519f4fd9a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:14.242154 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1bf88c96-868c-41c2-9f32-85f98102aa91 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:14.243162 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1bf88c96-868c-41c2-9f32-85f98102aa91 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:14.243623 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1bf88c96-868c-41c2-9f32-85f98102aa91 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:14.249180 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-682810e7-e2b6-4ff6-81f7-dfede9a5fdf7 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:14.249961 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-682810e7-e2b6-4ff6-81f7-dfede9a5fdf7 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:14.250393 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-682810e7-e2b6-4ff6-81f7-dfede9a5fdf7 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:14.251282 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-682810e7-e2b6-4ff6-81f7-dfede9a5fdf7 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:14.252303 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-682810e7-e2b6-4ff6-81f7-dfede9a5fdf7 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:14.252901 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-682810e7-e2b6-4ff6-81f7-dfede9a5fdf7 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:14.513279 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-682810e7-e2b6-4ff6-81f7-dfede9a5fdf7 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:14.528142 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-682810e7-e2b6-4ff6-81f7-dfede9a5fdf7 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/22fce0cc-6498-4b95-b265-a44519f4fd9a" status: 200 len: 1315 microversion: 2.1 time: 0.294930 Oct 30 01:20:14.529225 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 945/1865] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:14 2022] GET /compute/v2.1/servers/22fce0cc-6498-4b95-b265-a44519f4fd9a => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:14.535203 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9faf3f49-2d53-4a27-83e4-7dd66a4ad72c tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:14.539312 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9faf3f49-2d53-4a27-83e4-7dd66a4ad72c tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: 65a083f8-3b0d-43fd-93be-e9abb278e0ee] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:14.564339 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1bf88c96-868c-41c2-9f32-85f98102aa91 tempest-LiveMigrationTest-1598896867 tempest-LiveMigrationTest-1598896867-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8" status: 200 len: 1532 microversion: 2.1 time: 0.335863 Oct 30 01:20:14.567743 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 921/1866] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:14 2022] GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8 => generated 1532 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:14.575152 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9faf3f49-2d53-4a27-83e4-7dd66a4ad72c tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:14.575656 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9faf3f49-2d53-4a27-83e4-7dd66a4ad72c tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:14.576107 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9faf3f49-2d53-4a27-83e4-7dd66a4ad72c tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:14.578009 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9faf3f49-2d53-4a27-83e4-7dd66a4ad72c tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:14.578646 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9faf3f49-2d53-4a27-83e4-7dd66a4ad72c tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:14.579245 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9faf3f49-2d53-4a27-83e4-7dd66a4ad72c tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:14.608821 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1198f7ed-8f9c-4c06-9232-d718cd742b50 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:14.609646 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1198f7ed-8f9c-4c06-9232-d718cd742b50 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0ec8b27d-8af5-45d7-892b-09297e5cb2d8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:14.616472 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1198f7ed-8f9c-4c06-9232-d718cd742b50 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:14.617245 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1198f7ed-8f9c-4c06-9232-d718cd742b50 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:14.617914 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1198f7ed-8f9c-4c06-9232-d718cd742b50 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:14.618821 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1198f7ed-8f9c-4c06-9232-d718cd742b50 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:14.619444 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1198f7ed-8f9c-4c06-9232-d718cd742b50 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:14.620033 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1198f7ed-8f9c-4c06-9232-d718cd742b50 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:14.706483 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1198f7ed-8f9c-4c06-9232-d718cd742b50 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0ec8b27d-8af5-45d7-892b-09297e5cb2d8] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:20:14.753167 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=100 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:20:14.876744 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9faf3f49-2d53-4a27-83e4-7dd66a4ad72c tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:14.893655 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9faf3f49-2d53-4a27-83e4-7dd66a4ad72c tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/65a083f8-3b0d-43fd-93be-e9abb278e0ee" status: 200 len: 1540 microversion: 2.1 time: 0.363436 Oct 30 01:20:14.913277 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 946/1867] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:14 2022] GET /compute/v2.1/servers/65a083f8-3b0d-43fd-93be-e9abb278e0ee => generated 1540 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:15.052087 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-19f69f25-b062-4d0a-8191-715736f89a81 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:15.053566 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-19f69f25-b062-4d0a-8191-715736f89a81 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 5ed38927-680d-4e93-b57a-21fb407c6b33] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:15.064209 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-19f69f25-b062-4d0a-8191-715736f89a81 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:15.067249 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-19f69f25-b062-4d0a-8191-715736f89a81 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:15.067249 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-19f69f25-b062-4d0a-8191-715736f89a81 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:15.067249 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-19f69f25-b062-4d0a-8191-715736f89a81 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:15.067853 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-19f69f25-b062-4d0a-8191-715736f89a81 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:15.068283 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-19f69f25-b062-4d0a-8191-715736f89a81 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:15.109639 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1198f7ed-8f9c-4c06-9232-d718cd742b50 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8" status: 204 len: 0 microversion: 2.1 time: 0.506032 Oct 30 01:20:15.110615 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 922/1868] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:20:14 2022] DELETE /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 30 01:20:15.123746 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c6f01ab2-41ec-4d97-a0e2-f8d1ad324dda tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:15.124487 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c6f01ab2-41ec-4d97-a0e2-f8d1ad324dda tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0ec8b27d-8af5-45d7-892b-09297e5cb2d8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:15.143212 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6f01ab2-41ec-4d97-a0e2-f8d1ad324dda tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:15.144998 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6f01ab2-41ec-4d97-a0e2-f8d1ad324dda tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:15.145663 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6f01ab2-41ec-4d97-a0e2-f8d1ad324dda tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:15.146863 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6f01ab2-41ec-4d97-a0e2-f8d1ad324dda tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:15.149226 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6f01ab2-41ec-4d97-a0e2-f8d1ad324dda tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:15.150543 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6f01ab2-41ec-4d97-a0e2-f8d1ad324dda tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:15.357132 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-19f69f25-b062-4d0a-8191-715736f89a81 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:15.360615 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:20:15.371183 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-19f69f25-b062-4d0a-8191-715736f89a81 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:15.373560 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-19f69f25-b062-4d0a-8191-715736f89a81 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:15.375018 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-19f69f25-b062-4d0a-8191-715736f89a81 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33" status: 200 len: 1281 microversion: 2.25 time: 0.327152 Oct 30 01:20:15.376068 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 947/1869] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:20:15 2022] GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33 => generated 1281 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:20:15.392707 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-aabcfb78-4d54-427e-b919-30570d6890ca tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:15.394622 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-aabcfb78-4d54-427e-b919-30570d6890ca tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: e7ff7c82-b3f6-4172-be0d-1c67c30db4f7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:15.411660 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aabcfb78-4d54-427e-b919-30570d6890ca tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:15.412357 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aabcfb78-4d54-427e-b919-30570d6890ca tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:15.412917 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aabcfb78-4d54-427e-b919-30570d6890ca tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:15.413918 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aabcfb78-4d54-427e-b919-30570d6890ca tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:15.415054 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aabcfb78-4d54-427e-b919-30570d6890ca tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:15.415595 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aabcfb78-4d54-427e-b919-30570d6890ca tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:15.499894 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c6f01ab2-41ec-4d97-a0e2-f8d1ad324dda tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:15.509050 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c6f01ab2-41ec-4d97-a0e2-f8d1ad324dda tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8" status: 200 len: 1387 microversion: 2.1 time: 0.393393 Oct 30 01:20:15.509670 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 923/1870] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:15 2022] GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8 => generated 1387 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:20:15.530796 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f5971fb9-e698-45d0-9871-652438d05727 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:15.536253 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f5971fb9-e698-45d0-9871-652438d05727 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:15.547361 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f5971fb9-e698-45d0-9871-652438d05727 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:15.547924 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f5971fb9-e698-45d0-9871-652438d05727 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:15.548373 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f5971fb9-e698-45d0-9871-652438d05727 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:15.550067 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f5971fb9-e698-45d0-9871-652438d05727 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:15.551237 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f5971fb9-e698-45d0-9871-652438d05727 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:15.551850 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f5971fb9-e698-45d0-9871-652438d05727 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:15.656101 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f5971fb9-e698-45d0-9871-652438d05727 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:15.668473 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f5971fb9-e698-45d0-9871-652438d05727 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:15.671171 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f5971fb9-e698-45d0-9871-652438d05727 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:15.678663 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f5971fb9-e698-45d0-9871-652438d05727 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1555 microversion: 2.91 time: 0.165798 Oct 30 01:20:15.679893 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 924/1871] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:20:15 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1555 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:20:15.685946 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ad23b48e-d0a3-4e74-92e8-baefef7f648d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:15.687039 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ad23b48e-d0a3-4e74-92e8-baefef7f648d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 22fce0cc-6498-4b95-b265-a44519f4fd9a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:15.717216 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ad23b48e-d0a3-4e74-92e8-baefef7f648d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:15.718923 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ad23b48e-d0a3-4e74-92e8-baefef7f648d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:15.719663 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ad23b48e-d0a3-4e74-92e8-baefef7f648d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:15.721686 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ad23b48e-d0a3-4e74-92e8-baefef7f648d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:15.728174 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ad23b48e-d0a3-4e74-92e8-baefef7f648d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:15.729202 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-aabcfb78-4d54-427e-b919-30570d6890ca tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:15.729876 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ad23b48e-d0a3-4e74-92e8-baefef7f648d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:15.738502 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-aabcfb78-4d54-427e-b919-30570d6890ca tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7" status: 200 len: 1476 microversion: 2.1 time: 0.360171 Oct 30 01:20:15.743993 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 948/1872] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:15 2022] GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 => generated 1476 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:15.927826 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-272aa9fd-3cd3-4d7b-8bbd-c5418356b8ab tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:15.933478 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-272aa9fd-3cd3-4d7b-8bbd-c5418356b8ab tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: 65a083f8-3b0d-43fd-93be-e9abb278e0ee] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:15.955591 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-272aa9fd-3cd3-4d7b-8bbd-c5418356b8ab tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:15.958381 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-272aa9fd-3cd3-4d7b-8bbd-c5418356b8ab tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:15.962262 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-272aa9fd-3cd3-4d7b-8bbd-c5418356b8ab tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:15.963431 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-272aa9fd-3cd3-4d7b-8bbd-c5418356b8ab tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:15.967269 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-272aa9fd-3cd3-4d7b-8bbd-c5418356b8ab tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:15.970240 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-272aa9fd-3cd3-4d7b-8bbd-c5418356b8ab tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:16.290871 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ad23b48e-d0a3-4e74-92e8-baefef7f648d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:16.301287 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ad23b48e-d0a3-4e74-92e8-baefef7f648d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/22fce0cc-6498-4b95-b265-a44519f4fd9a" status: 200 len: 1502 microversion: 2.1 time: 0.619561 Oct 30 01:20:16.302576 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 925/1873] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:15 2022] GET /compute/v2.1/servers/22fce0cc-6498-4b95-b265-a44519f4fd9a => generated 1502 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:16.409443 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ebea5405-5f10-42dc-b697-274d9c303507 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:16.411162 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ebea5405-5f10-42dc-b697-274d9c303507 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 5ed38927-680d-4e93-b57a-21fb407c6b33] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:16.421509 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:20:16.448301 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ebea5405-5f10-42dc-b697-274d9c303507 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:16.450272 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ebea5405-5f10-42dc-b697-274d9c303507 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:16.450272 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ebea5405-5f10-42dc-b697-274d9c303507 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:16.450272 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ebea5405-5f10-42dc-b697-274d9c303507 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:16.450692 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ebea5405-5f10-42dc-b697-274d9c303507 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:16.451023 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ebea5405-5f10-42dc-b697-274d9c303507 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:16.637629 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-272aa9fd-3cd3-4d7b-8bbd-c5418356b8ab tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:16.646633 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-272aa9fd-3cd3-4d7b-8bbd-c5418356b8ab tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/65a083f8-3b0d-43fd-93be-e9abb278e0ee" status: 200 len: 1540 microversion: 2.1 time: 0.730247 Oct 30 01:20:16.652544 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 949/1874] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:15 2022] GET /compute/v2.1/servers/65a083f8-3b0d-43fd-93be-e9abb278e0ee => generated 1540 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:16.676615 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4943e5ad-26bf-4349-a56f-7fc280546d43 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:16.682056 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4943e5ad-26bf-4349-a56f-7fc280546d43 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0ec8b27d-8af5-45d7-892b-09297e5cb2d8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:16.702358 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4943e5ad-26bf-4349-a56f-7fc280546d43 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:16.703177 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4943e5ad-26bf-4349-a56f-7fc280546d43 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:16.703839 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4943e5ad-26bf-4349-a56f-7fc280546d43 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:16.707615 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4943e5ad-26bf-4349-a56f-7fc280546d43 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:16.708360 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4943e5ad-26bf-4349-a56f-7fc280546d43 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:16.708989 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4943e5ad-26bf-4349-a56f-7fc280546d43 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:17.805759 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ebea5405-5f10-42dc-b697-274d9c303507 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:17.813221 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4943e5ad-26bf-4349-a56f-7fc280546d43 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:17.821663 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4943e5ad-26bf-4349-a56f-7fc280546d43 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8" status: 200 len: 1387 microversion: 2.1 time: 1.164332 Oct 30 01:20:17.833359 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 950/1875] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:16 2022] GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8 => generated 1387 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:17.833359 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a8b6626e-d1f9-4fb9-8aa2-34a37412e2d0 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:17.833359 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a8b6626e-d1f9-4fb9-8aa2-34a37412e2d0 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:17.838127 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a8b6626e-d1f9-4fb9-8aa2-34a37412e2d0 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:17.838669 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ebea5405-5f10-42dc-b697-274d9c303507 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:17.839238 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a8b6626e-d1f9-4fb9-8aa2-34a37412e2d0 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:17.839919 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a8b6626e-d1f9-4fb9-8aa2-34a37412e2d0 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:17.841161 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ebea5405-5f10-42dc-b697-274d9c303507 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:17.842351 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ebea5405-5f10-42dc-b697-274d9c303507 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33" status: 200 len: 1281 microversion: 2.25 time: 1.439067 Oct 30 01:20:17.843899 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 926/1876] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:20:16 2022] GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33 => generated 1281 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:20:17.848541 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a8b6626e-d1f9-4fb9-8aa2-34a37412e2d0 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:17.851421 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a8b6626e-d1f9-4fb9-8aa2-34a37412e2d0 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:17.855135 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a8b6626e-d1f9-4fb9-8aa2-34a37412e2d0 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:17.863882 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5751fae4-368a-40cc-8e13-a2ad96f6a4f2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:17.878420 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5751fae4-368a-40cc-8e13-a2ad96f6a4f2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: e7ff7c82-b3f6-4172-be0d-1c67c30db4f7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:17.898631 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5751fae4-368a-40cc-8e13-a2ad96f6a4f2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:17.900570 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5751fae4-368a-40cc-8e13-a2ad96f6a4f2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:17.901027 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5751fae4-368a-40cc-8e13-a2ad96f6a4f2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:17.905096 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5751fae4-368a-40cc-8e13-a2ad96f6a4f2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:17.908933 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5751fae4-368a-40cc-8e13-a2ad96f6a4f2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:17.910256 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5751fae4-368a-40cc-8e13-a2ad96f6a4f2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:18.022902 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a8b6626e-d1f9-4fb9-8aa2-34a37412e2d0 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:18.034420 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a8b6626e-d1f9-4fb9-8aa2-34a37412e2d0 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:18.036274 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a8b6626e-d1f9-4fb9-8aa2-34a37412e2d0 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:18.049326 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a8b6626e-d1f9-4fb9-8aa2-34a37412e2d0 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1555 microversion: 2.91 time: 0.223495 Oct 30 01:20:18.049326 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 951/1877] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:20:17 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1555 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:20:18.053252 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-eabf0e2b-31cb-4932-8e9a-cb7aac2c2530 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:18.053983 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-eabf0e2b-31cb-4932-8e9a-cb7aac2c2530 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: 65a083f8-3b0d-43fd-93be-e9abb278e0ee] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:18.069216 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eabf0e2b-31cb-4932-8e9a-cb7aac2c2530 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:18.070117 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eabf0e2b-31cb-4932-8e9a-cb7aac2c2530 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:18.071082 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eabf0e2b-31cb-4932-8e9a-cb7aac2c2530 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:18.072426 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eabf0e2b-31cb-4932-8e9a-cb7aac2c2530 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:18.073169 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eabf0e2b-31cb-4932-8e9a-cb7aac2c2530 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:18.073916 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eabf0e2b-31cb-4932-8e9a-cb7aac2c2530 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:18.824962 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5751fae4-368a-40cc-8e13-a2ad96f6a4f2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:18.846694 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5751fae4-368a-40cc-8e13-a2ad96f6a4f2 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7" status: 200 len: 1476 microversion: 2.1 time: 0.984341 Oct 30 01:20:18.849858 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 927/1878] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:17 2022] GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 => generated 1476 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:18.862527 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bb180d35-da32-4f1e-9b6c-140e744ce4f6 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:18.865817 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-bb180d35-da32-4f1e-9b6c-140e744ce4f6 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0ec8b27d-8af5-45d7-892b-09297e5cb2d8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:18.882367 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb180d35-da32-4f1e-9b6c-140e744ce4f6 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:18.885360 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb180d35-da32-4f1e-9b6c-140e744ce4f6 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:18.885995 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb180d35-da32-4f1e-9b6c-140e744ce4f6 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:18.888918 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb180d35-da32-4f1e-9b6c-140e744ce4f6 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:18.894009 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb180d35-da32-4f1e-9b6c-140e744ce4f6 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:18.894915 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb180d35-da32-4f1e-9b6c-140e744ce4f6 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:19.030839 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-eabf0e2b-31cb-4932-8e9a-cb7aac2c2530 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:19.045538 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-eabf0e2b-31cb-4932-8e9a-cb7aac2c2530 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/65a083f8-3b0d-43fd-93be-e9abb278e0ee" status: 200 len: 1522 microversion: 2.1 time: 0.996583 Oct 30 01:20:19.047832 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 952/1879] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:18 2022] GET /compute/v2.1/servers/65a083f8-3b0d-43fd-93be-e9abb278e0ee => generated 1522 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:19.058678 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fb791260-6815-49ef-8e21-056376c547f6 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:19.062596 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fb791260-6815-49ef-8e21-056376c547f6 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 5ed38927-680d-4e93-b57a-21fb407c6b33] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:19.076527 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb791260-6815-49ef-8e21-056376c547f6 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:19.082776 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb791260-6815-49ef-8e21-056376c547f6 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:19.084027 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb791260-6815-49ef-8e21-056376c547f6 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:19.084969 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb791260-6815-49ef-8e21-056376c547f6 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:19.085830 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb791260-6815-49ef-8e21-056376c547f6 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:19.086487 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb791260-6815-49ef-8e21-056376c547f6 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:19.614531 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-bb180d35-da32-4f1e-9b6c-140e744ce4f6 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:19.629760 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bb180d35-da32-4f1e-9b6c-140e744ce4f6 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8" status: 200 len: 1387 microversion: 2.1 time: 0.777385 Oct 30 01:20:19.630655 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 928/1880] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:18 2022] GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8 => generated 1387 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:19.635742 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-68703e86-4ab7-4904-b9d8-47f089ca46ff tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:19.644765 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-68703e86-4ab7-4904-b9d8-47f089ca46ff tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:19.662283 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-68703e86-4ab7-4904-b9d8-47f089ca46ff tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:19.667847 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-68703e86-4ab7-4904-b9d8-47f089ca46ff tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:19.667847 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-68703e86-4ab7-4904-b9d8-47f089ca46ff tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:19.667847 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-68703e86-4ab7-4904-b9d8-47f089ca46ff tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:19.667847 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-68703e86-4ab7-4904-b9d8-47f089ca46ff tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:19.670459 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-68703e86-4ab7-4904-b9d8-47f089ca46ff tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:19.760247 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-fb791260-6815-49ef-8e21-056376c547f6 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:19.785548 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-fb791260-6815-49ef-8e21-056376c547f6 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:19.800525 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-fb791260-6815-49ef-8e21-056376c547f6 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:19.800985 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fb791260-6815-49ef-8e21-056376c547f6 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33" status: 200 len: 1281 microversion: 2.25 time: 0.749530 Oct 30 01:20:19.805262 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 953/1881] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:20:19 2022] GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33 => generated 1281 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:20:19.826760 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-97653508-de5d-4cd5-89cf-9d009f98fc4a tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:19.827518 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-97653508-de5d-4cd5-89cf-9d009f98fc4a tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: 65a083f8-3b0d-43fd-93be-e9abb278e0ee] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:19.839093 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-97653508-de5d-4cd5-89cf-9d009f98fc4a tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:19.840561 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-97653508-de5d-4cd5-89cf-9d009f98fc4a tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:19.843815 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-97653508-de5d-4cd5-89cf-9d009f98fc4a tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:19.845048 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-97653508-de5d-4cd5-89cf-9d009f98fc4a tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:19.845829 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-97653508-de5d-4cd5-89cf-9d009f98fc4a tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:19.846515 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-97653508-de5d-4cd5-89cf-9d009f98fc4a tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:19.901209 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-68703e86-4ab7-4904-b9d8-47f089ca46ff tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:19.912065 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-68703e86-4ab7-4904-b9d8-47f089ca46ff tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:19.920971 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-68703e86-4ab7-4904-b9d8-47f089ca46ff tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:19.934373 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-97653508-de5d-4cd5-89cf-9d009f98fc4a tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: 65a083f8-3b0d-43fd-93be-e9abb278e0ee] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:20:19.950427 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-68703e86-4ab7-4904-b9d8-47f089ca46ff tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1555 microversion: 2.91 time: 0.318483 Oct 30 01:20:19.959759 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 929/1882] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:20:19 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1555 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:20:19.965214 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-92297b29-356d-4eeb-917a-be96245f1419 req-d4e46f8d-c3af-4771-9ac0-1103a1b852dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65a083f8-3b0d-43fd-93be-e9abb278e0ee", "name": "network-vif-plugged", "status": "completed", "tag": "fb95a055-7db7-4eeb-ad46-76acd5e22198"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:20:20.001368 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-92297b29-356d-4eeb-917a-be96245f1419 req-d4e46f8d-c3af-4771-9ac0-1103a1b852dd service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:20.001868 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-92297b29-356d-4eeb-917a-be96245f1419 req-d4e46f8d-c3af-4771-9ac0-1103a1b852dd service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:20.002299 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-92297b29-356d-4eeb-917a-be96245f1419 req-d4e46f8d-c3af-4771-9ac0-1103a1b852dd service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:20.055899 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-92297b29-356d-4eeb-917a-be96245f1419 req-d4e46f8d-c3af-4771-9ac0-1103a1b852dd service nova] Creating event network-vif-plugged:fb95a055-7db7-4eeb-ad46-76acd5e22198 for instance 65a083f8-3b0d-43fd-93be-e9abb278e0ee on n-h2-master-1 Oct 30 01:20:20.073952 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-92297b29-356d-4eeb-917a-be96245f1419 req-d4e46f8d-c3af-4771-9ac0-1103a1b852dd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112118 Oct 30 01:20:20.076042 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 930/1883] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:20:20.094830 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-79fc7bc3-05b4-42f2-b964-36280452f057 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:20.095538 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-79fc7bc3-05b4-42f2-b964-36280452f057 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: e7ff7c82-b3f6-4172-be0d-1c67c30db4f7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:20.124292 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-79fc7bc3-05b4-42f2-b964-36280452f057 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:20.124797 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-79fc7bc3-05b4-42f2-b964-36280452f057 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:20.125232 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-79fc7bc3-05b4-42f2-b964-36280452f057 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:20.126013 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-79fc7bc3-05b4-42f2-b964-36280452f057 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:20.126464 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-79fc7bc3-05b4-42f2-b964-36280452f057 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:20.126886 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-79fc7bc3-05b4-42f2-b964-36280452f057 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:20.424083 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-97653508-de5d-4cd5-89cf-9d009f98fc4a tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "DELETE /compute/v2.1/servers/65a083f8-3b0d-43fd-93be-e9abb278e0ee" status: 204 len: 0 microversion: 2.1 time: 0.616871 Oct 30 01:20:20.425244 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 954/1884] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:20:19 2022] DELETE /compute/v2.1/servers/65a083f8-3b0d-43fd-93be-e9abb278e0ee => generated 0 bytes in 619 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:20:20.433209 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-7ba73802-6d57-4def-8a56-722e51950c31 req-ab0d2e31-2a24-42f1-a0ba-2c273da3cf25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ec8b27d-8af5-45d7-892b-09297e5cb2d8", "name": "network-vif-deleted", "tag": "f2512753-a87d-49fe-8f90-bf6f3cdfb7b3"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:20:20.473434 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-7ba73802-6d57-4def-8a56-722e51950c31 req-ab0d2e31-2a24-42f1-a0ba-2c273da3cf25 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:20.473937 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-7ba73802-6d57-4def-8a56-722e51950c31 req-ab0d2e31-2a24-42f1-a0ba-2c273da3cf25 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:20.474376 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-7ba73802-6d57-4def-8a56-722e51950c31 req-ab0d2e31-2a24-42f1-a0ba-2c273da3cf25 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:20.708219 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-79fc7bc3-05b4-42f2-b964-36280452f057 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:20.720755 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-79fc7bc3-05b4-42f2-b964-36280452f057 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7" status: 200 len: 1476 microversion: 2.1 time: 0.641429 Oct 30 01:20:20.732604 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 931/1885] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:20 2022] GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 => generated 1476 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:20.747198 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-650193cf-c799-49ab-8ff9-49ddb5889a10 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:20.754220 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-650193cf-c799-49ab-8ff9-49ddb5889a10 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: 65a083f8-3b0d-43fd-93be-e9abb278e0ee] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:20.774289 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-650193cf-c799-49ab-8ff9-49ddb5889a10 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:20.774787 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-650193cf-c799-49ab-8ff9-49ddb5889a10 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:20.775223 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-650193cf-c799-49ab-8ff9-49ddb5889a10 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:20.775938 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-650193cf-c799-49ab-8ff9-49ddb5889a10 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:20.776384 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-650193cf-c799-49ab-8ff9-49ddb5889a10 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:20.776801 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-650193cf-c799-49ab-8ff9-49ddb5889a10 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:21.191118 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-7ba73802-6d57-4def-8a56-722e51950c31 req-ab0d2e31-2a24-42f1-a0ba-2c273da3cf25 service nova] Creating event network-vif-deleted:f2512753-a87d-49fe-8f90-bf6f3cdfb7b3 for instance 0ec8b27d-8af5-45d7-892b-09297e5cb2d8 on n-h2-master-1 Oct 30 01:20:21.217785 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-7ba73802-6d57-4def-8a56-722e51950c31 req-ab0d2e31-2a24-42f1-a0ba-2c273da3cf25 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.790817 Oct 30 01:20:21.220848 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 955/1886] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:20:21.236277 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bc2061d7-8172-42e4-8fa2-674d0dd7830a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:21.237431 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bc2061d7-8172-42e4-8fa2-674d0dd7830a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0ec8b27d-8af5-45d7-892b-09297e5cb2d8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:21.258087 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bc2061d7-8172-42e4-8fa2-674d0dd7830a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:21.264568 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bc2061d7-8172-42e4-8fa2-674d0dd7830a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:21.265285 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bc2061d7-8172-42e4-8fa2-674d0dd7830a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:21.268329 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bc2061d7-8172-42e4-8fa2-674d0dd7830a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:21.271086 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bc2061d7-8172-42e4-8fa2-674d0dd7830a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:21.276016 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bc2061d7-8172-42e4-8fa2-674d0dd7830a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:21.315654 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-650193cf-c799-49ab-8ff9-49ddb5889a10 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:21.336734 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-650193cf-c799-49ab-8ff9-49ddb5889a10 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/65a083f8-3b0d-43fd-93be-e9abb278e0ee" status: 200 len: 1528 microversion: 2.1 time: 0.602801 Oct 30 01:20:21.350206 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 932/1887] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:20 2022] GET /compute/v2.1/servers/65a083f8-3b0d-43fd-93be-e9abb278e0ee => generated 1528 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:21.366711 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6b8bc141-7000-4fa6-a575-4323eb6390e2 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:21.375695 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6b8bc141-7000-4fa6-a575-4323eb6390e2 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 5ed38927-680d-4e93-b57a-21fb407c6b33] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:21.397289 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6b8bc141-7000-4fa6-a575-4323eb6390e2 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:21.400804 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6b8bc141-7000-4fa6-a575-4323eb6390e2 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:21.411272 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6b8bc141-7000-4fa6-a575-4323eb6390e2 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:21.412081 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6b8bc141-7000-4fa6-a575-4323eb6390e2 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:21.412661 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6b8bc141-7000-4fa6-a575-4323eb6390e2 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:21.413805 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6b8bc141-7000-4fa6-a575-4323eb6390e2 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:21.540488 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bc2061d7-8172-42e4-8fa2-674d0dd7830a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:21.551119 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bc2061d7-8172-42e4-8fa2-674d0dd7830a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8" status: 200 len: 1184 microversion: 2.1 time: 0.328877 Oct 30 01:20:21.571164 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 956/1888] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:21 2022] GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8 => generated 1184 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:21.587808 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ad37eb6f-591b-4bfa-b3df-45c030a2940e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c59c19da-ff47-418b-9c17-c03d5612d2d1"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:20:21.598567 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ad37eb6f-591b-4bfa-b3df-45c030a2940e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 22fce0cc-6498-4b95-b265-a44519f4fd9a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:21.605499 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ad37eb6f-591b-4bfa-b3df-45c030a2940e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:21.606001 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ad37eb6f-591b-4bfa-b3df-45c030a2940e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:21.614258 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ad37eb6f-591b-4bfa-b3df-45c030a2940e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:21.615060 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ad37eb6f-591b-4bfa-b3df-45c030a2940e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:21.615606 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ad37eb6f-591b-4bfa-b3df-45c030a2940e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:21.616051 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ad37eb6f-591b-4bfa-b3df-45c030a2940e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:21.849704 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6b8bc141-7000-4fa6-a575-4323eb6390e2 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:21.862040 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6b8bc141-7000-4fa6-a575-4323eb6390e2 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:21.866976 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6b8bc141-7000-4fa6-a575-4323eb6390e2 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:21.868436 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6b8bc141-7000-4fa6-a575-4323eb6390e2 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33" status: 200 len: 1281 microversion: 2.25 time: 0.517135 Oct 30 01:20:21.885757 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 933/1889] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:20:21 2022] GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33 => generated 1281 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:20:21.903601 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0c3e96f9-bcad-42a1-8e7c-bdaa5a91b2cc tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:21.904258 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0c3e96f9-bcad-42a1-8e7c-bdaa5a91b2cc tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:21.927778 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c3e96f9-bcad-42a1-8e7c-bdaa5a91b2cc tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:21.928825 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c3e96f9-bcad-42a1-8e7c-bdaa5a91b2cc tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:21.932328 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c3e96f9-bcad-42a1-8e7c-bdaa5a91b2cc tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:21.933400 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c3e96f9-bcad-42a1-8e7c-bdaa5a91b2cc tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:21.934084 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c3e96f9-bcad-42a1-8e7c-bdaa5a91b2cc tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:21.934697 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c3e96f9-bcad-42a1-8e7c-bdaa5a91b2cc tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:22.048842 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0c3e96f9-bcad-42a1-8e7c-bdaa5a91b2cc tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:22.060850 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0c3e96f9-bcad-42a1-8e7c-bdaa5a91b2cc tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:22.063000 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0c3e96f9-bcad-42a1-8e7c-bdaa5a91b2cc tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:22.076819 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0c3e96f9-bcad-42a1-8e7c-bdaa5a91b2cc tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1555 microversion: 2.91 time: 0.189837 Oct 30 01:20:22.079612 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 934/1890] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:20:21 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1555 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:20:22.085235 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ccf6cdaf-8ed9-4b40-bc79-96b26a315365 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:22.086173 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ccf6cdaf-8ed9-4b40-bc79-96b26a315365 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: e7ff7c82-b3f6-4172-be0d-1c67c30db4f7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:22.104062 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ccf6cdaf-8ed9-4b40-bc79-96b26a315365 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:22.107105 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ccf6cdaf-8ed9-4b40-bc79-96b26a315365 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:22.107552 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ccf6cdaf-8ed9-4b40-bc79-96b26a315365 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:22.116918 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ccf6cdaf-8ed9-4b40-bc79-96b26a315365 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:22.117784 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ccf6cdaf-8ed9-4b40-bc79-96b26a315365 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:22.118501 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ccf6cdaf-8ed9-4b40-bc79-96b26a315365 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:22.690510 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ccf6cdaf-8ed9-4b40-bc79-96b26a315365 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:22.710411 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ccf6cdaf-8ed9-4b40-bc79-96b26a315365 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7" status: 200 len: 1476 microversion: 2.1 time: 0.629437 Oct 30 01:20:22.716042 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 935/1891] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:22 2022] GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 => generated 1476 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:22.730496 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-6e5d89f6-a355-49f7-a509-9809e201224e req-948cd9f4-b7bb-4b91-9376-86507861c613 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65a083f8-3b0d-43fd-93be-e9abb278e0ee", "name": "network-vif-unplugged", "status": "completed", "tag": "fb95a055-7db7-4eeb-ad46-76acd5e22198"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:20:22.759656 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-6e5d89f6-a355-49f7-a509-9809e201224e req-948cd9f4-b7bb-4b91-9376-86507861c613 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:22.760529 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-6e5d89f6-a355-49f7-a509-9809e201224e req-948cd9f4-b7bb-4b91-9376-86507861c613 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:22.761142 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-6e5d89f6-a355-49f7-a509-9809e201224e req-948cd9f4-b7bb-4b91-9376-86507861c613 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:22.787804 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-6e5d89f6-a355-49f7-a509-9809e201224e req-948cd9f4-b7bb-4b91-9376-86507861c613 service nova] Creating event network-vif-unplugged:fb95a055-7db7-4eeb-ad46-76acd5e22198 for instance 65a083f8-3b0d-43fd-93be-e9abb278e0ee on n-h2-master-1 Oct 30 01:20:22.795723 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-6e5d89f6-a355-49f7-a509-9809e201224e req-948cd9f4-b7bb-4b91-9376-86507861c613 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076383 Oct 30 01:20:22.800174 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 936/1892] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:20:22.819081 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d731373d-240a-4649-b2f5-95cc1ab41430 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:22.822438 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d731373d-240a-4649-b2f5-95cc1ab41430 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: 65a083f8-3b0d-43fd-93be-e9abb278e0ee] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:22.835723 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d731373d-240a-4649-b2f5-95cc1ab41430 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:22.838509 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d731373d-240a-4649-b2f5-95cc1ab41430 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:22.841519 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d731373d-240a-4649-b2f5-95cc1ab41430 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:22.842697 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d731373d-240a-4649-b2f5-95cc1ab41430 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:22.843349 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d731373d-240a-4649-b2f5-95cc1ab41430 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:22.844505 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d731373d-240a-4649-b2f5-95cc1ab41430 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:23.271753 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ad37eb6f-591b-4bfa-b3df-45c030a2940e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "POST /compute/v2.1/servers/22fce0cc-6498-4b95-b265-a44519f4fd9a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.698531 Oct 30 01:20:23.273310 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 957/1893] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 30 01:20:21 2022] POST /compute/v2.1/servers/22fce0cc-6498-4b95-b265-a44519f4fd9a/os-volume_attachments => generated 194 bytes in 1701 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:20:23.305361 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6b325c33-a56a-4d0b-b35e-8d087daf3f11 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:23.309813 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6b325c33-a56a-4d0b-b35e-8d087daf3f11 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0ec8b27d-8af5-45d7-892b-09297e5cb2d8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:23.332102 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b325c33-a56a-4d0b-b35e-8d087daf3f11 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:23.340130 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b325c33-a56a-4d0b-b35e-8d087daf3f11 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:23.340656 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b325c33-a56a-4d0b-b35e-8d087daf3f11 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:23.347676 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b325c33-a56a-4d0b-b35e-8d087daf3f11 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:23.348552 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b325c33-a56a-4d0b-b35e-8d087daf3f11 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:23.356325 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b325c33-a56a-4d0b-b35e-8d087daf3f11 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:23.433429 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d731373d-240a-4649-b2f5-95cc1ab41430 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:23.466600 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d731373d-240a-4649-b2f5-95cc1ab41430 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/65a083f8-3b0d-43fd-93be-e9abb278e0ee" status: 200 len: 1528 microversion: 2.1 time: 0.665039 Oct 30 01:20:23.467219 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 937/1894] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:22 2022] GET /compute/v2.1/servers/65a083f8-3b0d-43fd-93be-e9abb278e0ee => generated 1528 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:23.487217 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b3c33d6d-89e2-486f-bff1-87cd2f576696 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:23.487832 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b3c33d6d-89e2-486f-bff1-87cd2f576696 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 5ed38927-680d-4e93-b57a-21fb407c6b33] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:23.500478 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3c33d6d-89e2-486f-bff1-87cd2f576696 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:23.500986 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3c33d6d-89e2-486f-bff1-87cd2f576696 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:23.523346 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3c33d6d-89e2-486f-bff1-87cd2f576696 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:23.526840 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3c33d6d-89e2-486f-bff1-87cd2f576696 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:23.527348 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3c33d6d-89e2-486f-bff1-87cd2f576696 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:23.527799 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3c33d6d-89e2-486f-bff1-87cd2f576696 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:23.676363 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6b325c33-a56a-4d0b-b35e-8d087daf3f11 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:23.690043 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6b325c33-a56a-4d0b-b35e-8d087daf3f11 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8" status: 200 len: 1184 microversion: 2.1 time: 0.414574 Oct 30 01:20:23.693322 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 958/1895] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:23 2022] GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8 => generated 1184 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:23.722982 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2e9c6869-1268-4ba9-8532-db8938b63185 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:23.723744 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2e9c6869-1268-4ba9-8532-db8938b63185 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:23.748822 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2e9c6869-1268-4ba9-8532-db8938b63185 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:23.749380 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2e9c6869-1268-4ba9-8532-db8938b63185 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:23.753252 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2e9c6869-1268-4ba9-8532-db8938b63185 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:23.757034 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2e9c6869-1268-4ba9-8532-db8938b63185 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:23.757750 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2e9c6869-1268-4ba9-8532-db8938b63185 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:23.761588 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2e9c6869-1268-4ba9-8532-db8938b63185 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:24.074208 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2e9c6869-1268-4ba9-8532-db8938b63185 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:24.095245 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2e9c6869-1268-4ba9-8532-db8938b63185 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:24.098999 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2e9c6869-1268-4ba9-8532-db8938b63185 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:24.140649 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2e9c6869-1268-4ba9-8532-db8938b63185 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1555 microversion: 2.91 time: 0.443829 Oct 30 01:20:24.154627 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 959/1896] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:20:23 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1555 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:20:24.179652 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-59e139df-64c8-4d39-9f1e-275823ec2291 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:24.190088 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-59e139df-64c8-4d39-9f1e-275823ec2291 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: e7ff7c82-b3f6-4172-be0d-1c67c30db4f7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:24.223722 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-59e139df-64c8-4d39-9f1e-275823ec2291 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:24.224271 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-59e139df-64c8-4d39-9f1e-275823ec2291 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:24.224715 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-59e139df-64c8-4d39-9f1e-275823ec2291 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:24.238405 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-59e139df-64c8-4d39-9f1e-275823ec2291 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:24.239205 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-59e139df-64c8-4d39-9f1e-275823ec2291 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:24.241916 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-59e139df-64c8-4d39-9f1e-275823ec2291 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:24.335574 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b3c33d6d-89e2-486f-bff1-87cd2f576696 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:24.410521 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b3c33d6d-89e2-486f-bff1-87cd2f576696 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:24.424513 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b3c33d6d-89e2-486f-bff1-87cd2f576696 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:24.443277 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b3c33d6d-89e2-486f-bff1-87cd2f576696 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33" status: 200 len: 1281 microversion: 2.25 time: 0.957543 Oct 30 01:20:24.444704 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 938/1897] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:20:23 2022] GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33 => generated 1281 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:20:24.507020 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7ea40145-f0d0-4926-84b7-9fcca9fa326e tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:24.507987 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7ea40145-f0d0-4926-84b7-9fcca9fa326e tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: 65a083f8-3b0d-43fd-93be-e9abb278e0ee] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:24.525032 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7ea40145-f0d0-4926-84b7-9fcca9fa326e tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:24.527519 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7ea40145-f0d0-4926-84b7-9fcca9fa326e tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:24.528547 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7ea40145-f0d0-4926-84b7-9fcca9fa326e tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:24.530653 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7ea40145-f0d0-4926-84b7-9fcca9fa326e tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:24.531814 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7ea40145-f0d0-4926-84b7-9fcca9fa326e tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:24.536976 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7ea40145-f0d0-4926-84b7-9fcca9fa326e tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:24.922209 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-59e139df-64c8-4d39-9f1e-275823ec2291 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:24.936514 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-59e139df-64c8-4d39-9f1e-275823ec2291 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7" status: 200 len: 1476 microversion: 2.1 time: 0.777841 Oct 30 01:20:24.941737 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 960/1898] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:24 2022] GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 => generated 1476 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:24.959775 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e45c985c-37e0-411a-a60f-a46e5fbb7259 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:24.963862 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e45c985c-37e0-411a-a60f-a46e5fbb7259 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0ec8b27d-8af5-45d7-892b-09297e5cb2d8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:24.982096 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e45c985c-37e0-411a-a60f-a46e5fbb7259 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:24.987997 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e45c985c-37e0-411a-a60f-a46e5fbb7259 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:24.992039 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e45c985c-37e0-411a-a60f-a46e5fbb7259 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:24.994325 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e45c985c-37e0-411a-a60f-a46e5fbb7259 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:24.999344 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e45c985c-37e0-411a-a60f-a46e5fbb7259 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:25.000321 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e45c985c-37e0-411a-a60f-a46e5fbb7259 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:25.201285 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e45c985c-37e0-411a-a60f-a46e5fbb7259 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:25.214963 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e45c985c-37e0-411a-a60f-a46e5fbb7259 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8" status: 200 len: 1184 microversion: 2.1 time: 0.271800 Oct 30 01:20:25.215813 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 961/1899] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:24 2022] GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8 => generated 1184 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:25.219794 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:20:25.231731 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-ec5dc918-49f9-4e91-9c54-7b208bd5b707 req-1b6aa85f-d396-4a79-8589-7c9e3f06325d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ed38927-680d-4e93-b57a-21fb407c6b33", "name": "network-vif-plugged", "status": "completed", "tag": "1e47508a-754d-4221-8472-e44defed87c1"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:20:25.259989 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ec5dc918-49f9-4e91-9c54-7b208bd5b707 req-1b6aa85f-d396-4a79-8589-7c9e3f06325d service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:25.263486 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ec5dc918-49f9-4e91-9c54-7b208bd5b707 req-1b6aa85f-d396-4a79-8589-7c9e3f06325d service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:25.264974 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ec5dc918-49f9-4e91-9c54-7b208bd5b707 req-1b6aa85f-d396-4a79-8589-7c9e3f06325d service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:25.278131 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:20:25.297895 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-ec5dc918-49f9-4e91-9c54-7b208bd5b707 req-1b6aa85f-d396-4a79-8589-7c9e3f06325d service nova] Creating event network-vif-plugged:1e47508a-754d-4221-8472-e44defed87c1 for instance 5ed38927-680d-4e93-b57a-21fb407c6b33 on n-h1-master-1 Oct 30 01:20:25.314261 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-ec5dc918-49f9-4e91-9c54-7b208bd5b707 req-1b6aa85f-d396-4a79-8589-7c9e3f06325d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094553 Oct 30 01:20:25.315570 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 962/1900] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:20:25.617087 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-422732ef-5625-4953-9328-be239dbb97fd tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] Action: 'create', calling method: .version_select at 0x7f44d03ffb80>, body: {"keypair": {"name": "tempest-keypair-1402421429", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPdLQvvPHLWP5VWqE97hlvZDybhS6B+jpkWyGwTeUbiCnoLpnZgdI4Rq/U/hFpyTS35k6QmCszRnBYH4yD0zgVO0tTjbD+Q5EFM4w8fhPUajnUDqwBN57DN8xCRTPdUVg=="}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:20:25.696985 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-422732ef-5625-4953-9328-be239dbb97fd tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] Getting quotas for project 8b9a5f8165c24556b4769fc2b43a7f1c. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:20:25.720486 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-422732ef-5625-4953-9328-be239dbb97fd tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] Getting quotas for user 1e982798802a46b5b880dcc4a99e359b and project 8b9a5f8165c24556b4769fc2b43a7f1c. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:20:25.821403 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-422732ef-5625-4953-9328-be239dbb97fd tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.503415 Oct 30 01:20:25.824868 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 963/1901] 10.222.0.13 () {62 vars in 1199 bytes} [Sun Oct 30 01:20:25 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 508 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 30 01:20:25.835500 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9d55f5f4-e5be-4338-90d1-13709ee3ef56 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:25.838156 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9d55f5f4-e5be-4338-90d1-13709ee3ef56 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:25.865880 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9d55f5f4-e5be-4338-90d1-13709ee3ef56 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:25.867539 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9d55f5f4-e5be-4338-90d1-13709ee3ef56 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:25.870466 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9d55f5f4-e5be-4338-90d1-13709ee3ef56 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:25.873300 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9d55f5f4-e5be-4338-90d1-13709ee3ef56 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:25.874951 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9d55f5f4-e5be-4338-90d1-13709ee3ef56 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:25.876111 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9d55f5f4-e5be-4338-90d1-13709ee3ef56 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:25.896415 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7ea40145-f0d0-4926-84b7-9fcca9fa326e tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:25.907504 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7ea40145-f0d0-4926-84b7-9fcca9fa326e tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/65a083f8-3b0d-43fd-93be-e9abb278e0ee" status: 200 len: 1528 microversion: 2.1 time: 1.416031 Oct 30 01:20:25.931518 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 939/1902] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:24 2022] GET /compute/v2.1/servers/65a083f8-3b0d-43fd-93be-e9abb278e0ee => generated 1528 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:20:25.955722 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-85cb01e8-b758-4821-b212-8efba693b260 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:25.964248 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-85cb01e8-b758-4821-b212-8efba693b260 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 5ed38927-680d-4e93-b57a-21fb407c6b33] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:25.988163 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-85cb01e8-b758-4821-b212-8efba693b260 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:25.998579 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-85cb01e8-b758-4821-b212-8efba693b260 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:25.999958 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-85cb01e8-b758-4821-b212-8efba693b260 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:26.000899 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-85cb01e8-b758-4821-b212-8efba693b260 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:26.001583 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-85cb01e8-b758-4821-b212-8efba693b260 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:26.002696 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-85cb01e8-b758-4821-b212-8efba693b260 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:26.118154 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9d55f5f4-e5be-4338-90d1-13709ee3ef56 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:26.147646 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9d55f5f4-e5be-4338-90d1-13709ee3ef56 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:26.150284 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9d55f5f4-e5be-4338-90d1-13709ee3ef56 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:26.163411 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9d55f5f4-e5be-4338-90d1-13709ee3ef56 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1555 microversion: 2.91 time: 0.337069 Oct 30 01:20:26.164377 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 964/1903] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:20:25 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1555 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:20:26.170472 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-fea26011-b69d-42b8-8da4-e8f92f674fc2 req-a11cf02e-8caa-407a-8fd9-5b80b49fbeb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65a083f8-3b0d-43fd-93be-e9abb278e0ee", "name": "network-vif-deleted", "tag": "fb95a055-7db7-4eeb-ad46-76acd5e22198"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:20:26.182770 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-fea26011-b69d-42b8-8da4-e8f92f674fc2 req-a11cf02e-8caa-407a-8fd9-5b80b49fbeb3 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:26.183269 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-fea26011-b69d-42b8-8da4-e8f92f674fc2 req-a11cf02e-8caa-407a-8fd9-5b80b49fbeb3 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:26.184230 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-fea26011-b69d-42b8-8da4-e8f92f674fc2 req-a11cf02e-8caa-407a-8fd9-5b80b49fbeb3 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:26.230557 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-fea26011-b69d-42b8-8da4-e8f92f674fc2 req-a11cf02e-8caa-407a-8fd9-5b80b49fbeb3 service nova] Creating event network-vif-deleted:fb95a055-7db7-4eeb-ad46-76acd5e22198 for instance 65a083f8-3b0d-43fd-93be-e9abb278e0ee on n-h2-master-1 Oct 30 01:20:26.275462 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-fea26011-b69d-42b8-8da4-e8f92f674fc2 req-a11cf02e-8caa-407a-8fd9-5b80b49fbeb3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107604 Oct 30 01:20:26.276992 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 965/1904] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:20:26.285245 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5878e1cc-f8a6-4c99-b24f-ab5fa8d83f3a tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] Calling method '.version_select at 0x7f44d0474ee0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:26.297730 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5878e1cc-f8a6-4c99-b24f-ab5fa8d83f3a tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] 10.222.0.13 "GET /compute/v2.1/os-keypairs/tempest-keypair-1402421429" status: 200 len: 513 microversion: 2.2 time: 0.019319 Oct 30 01:20:26.298681 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 966/1905] 10.222.0.13 () {60 vars in 1258 bytes} [Sun Oct 30 01:20:26 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1402421429 => generated 513 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:20:26.306924 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-112b0fe5-46f0-48b8-ba38-44734ec81285 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:26.307875 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-112b0fe5-46f0-48b8-ba38-44734ec81285 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: e7ff7c82-b3f6-4172-be0d-1c67c30db4f7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:26.316488 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-112b0fe5-46f0-48b8-ba38-44734ec81285 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:26.317802 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-112b0fe5-46f0-48b8-ba38-44734ec81285 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:26.318254 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-112b0fe5-46f0-48b8-ba38-44734ec81285 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:26.319043 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-112b0fe5-46f0-48b8-ba38-44734ec81285 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:26.319504 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-112b0fe5-46f0-48b8-ba38-44734ec81285 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:26.319933 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-112b0fe5-46f0-48b8-ba38-44734ec81285 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:26.401764 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-85cb01e8-b758-4821-b212-8efba693b260 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:26.416103 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-85cb01e8-b758-4821-b212-8efba693b260 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:26.418061 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-85cb01e8-b758-4821-b212-8efba693b260 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:26.429236 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-85cb01e8-b758-4821-b212-8efba693b260 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33" status: 200 len: 1281 microversion: 2.25 time: 0.491948 Oct 30 01:20:26.438089 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 940/1906] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:20:25 2022] GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33 => generated 1281 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:20:26.453935 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9e5c812a-6b20-432f-a18c-72012b66d92d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:26.462831 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9e5c812a-6b20-432f-a18c-72012b66d92d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0ec8b27d-8af5-45d7-892b-09297e5cb2d8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:26.491212 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e5c812a-6b20-432f-a18c-72012b66d92d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:26.491812 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e5c812a-6b20-432f-a18c-72012b66d92d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:26.492255 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e5c812a-6b20-432f-a18c-72012b66d92d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:26.493003 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e5c812a-6b20-432f-a18c-72012b66d92d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:26.493477 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e5c812a-6b20-432f-a18c-72012b66d92d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:26.493897 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e5c812a-6b20-432f-a18c-72012b66d92d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:26.651670 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9e5c812a-6b20-432f-a18c-72012b66d92d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:26.660777 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9e5c812a-6b20-432f-a18c-72012b66d92d tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8" status: 200 len: 1184 microversion: 2.1 time: 0.210693 Oct 30 01:20:26.661400 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 941/1907] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:26 2022] GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8 => generated 1184 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:26.677268 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-eba29a92-23d2-471b-85aa-d1aa3204b30e tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] Calling method '.version_select at 0x7f44c7a98a60>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:26.733371 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-112b0fe5-46f0-48b8-ba38-44734ec81285 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:26.752619 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-112b0fe5-46f0-48b8-ba38-44734ec81285 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7" status: 200 len: 1476 microversion: 2.1 time: 0.452789 Oct 30 01:20:26.753422 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 967/1908] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:26 2022] GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 => generated 1476 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:26.819858 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-eba29a92-23d2-471b-85aa-d1aa3204b30e tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1402421429" status: 204 len: 0 microversion: 2.2 time: 0.157251 Oct 30 01:20:26.822073 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 942/1909] 10.222.0.13 () {60 vars in 1261 bytes} [Sun Oct 30 01:20:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1402421429 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:20:26.833834 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e8aa2024-71ed-4d3b-b2df-01da89da5a64 tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] Action: 'create', calling method: .version_select at 0x7f44d03ffc10>, body: {"keypair": {"name": "tempest-keypair-46155787", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6P5UUyaNAILSUAyqhqZkvhRJ3ZtJ0mqospFytydZMecZLX3eK9P0Z3yV8NHb3GnDGrPMgSNelen80IIJdsk111USqGks5wTdO0Wzzuh/X47G9sQ6ad83zI5tJc6zuFUQ=="}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:20:26.856087 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-e8aa2024-71ed-4d3b-b2df-01da89da5a64 tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] Getting quotas for project 8b9a5f8165c24556b4769fc2b43a7f1c. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:20:26.860173 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:20:26.861736 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-e8aa2024-71ed-4d3b-b2df-01da89da5a64 tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] Getting quotas for user 1e982798802a46b5b880dcc4a99e359b and project 8b9a5f8165c24556b4769fc2b43a7f1c. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:20:26.938094 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f32055a7-178e-4392-800b-e24f450ce3d2 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:26.938726 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f32055a7-178e-4392-800b-e24f450ce3d2 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: 65a083f8-3b0d-43fd-93be-e9abb278e0ee] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:26.945802 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f32055a7-178e-4392-800b-e24f450ce3d2 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:26.954586 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f32055a7-178e-4392-800b-e24f450ce3d2 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:26.955254 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f32055a7-178e-4392-800b-e24f450ce3d2 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:26.955646 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f32055a7-178e-4392-800b-e24f450ce3d2 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:26.962734 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e8aa2024-71ed-4d3b-b2df-01da89da5a64 tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.2 time: 0.133068 Oct 30 01:20:26.964457 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 968/1910] 10.222.0.13 () {62 vars in 1199 bytes} [Sun Oct 30 01:20:26 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 135 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 30 01:20:26.967672 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f32055a7-178e-4392-800b-e24f450ce3d2 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:26.977500 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b259be12-6dc7-486d-8707-26cf405d4148 tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] Calling method '.version_select at 0x7f44d03d95e0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:26.980753 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f32055a7-178e-4392-800b-e24f450ce3d2 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:27.085265 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b259be12-6dc7-486d-8707-26cf405d4148 tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-46155787" status: 204 len: 0 microversion: 2.2 time: 0.113631 Oct 30 01:20:27.087523 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 969/1911] 10.222.0.13 () {60 vars in 1255 bytes} [Sun Oct 30 01:20:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-46155787 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:20:27.098272 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b28bf6f4-e393-4dc7-a8b0-defb7bc6135f tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] Action: 'create', calling method: .version_select at 0x7f44d049dee0>, body: {"keypair": {"name": "tempest-keypair-1779011162", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:20:27.112923 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f32055a7-178e-4392-800b-e24f450ce3d2 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:27.119737 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f32055a7-178e-4392-800b-e24f450ce3d2 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:27.119737 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f32055a7-178e-4392-800b-e24f450ce3d2 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:27.120284 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-f32055a7-178e-4392-800b-e24f450ce3d2 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lazy-loading 'fault' on Instance uuid 65a083f8-3b0d-43fd-93be-e9abb278e0ee {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:20:27.207168 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-b28bf6f4-e393-4dc7-a8b0-defb7bc6135f tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] Getting quotas for project 8b9a5f8165c24556b4769fc2b43a7f1c. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:20:27.219771 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f32055a7-178e-4392-800b-e24f450ce3d2 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:27.225453 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-b28bf6f4-e393-4dc7-a8b0-defb7bc6135f tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] Getting quotas for user 1e982798802a46b5b880dcc4a99e359b and project 8b9a5f8165c24556b4769fc2b43a7f1c. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:20:27.229509 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f32055a7-178e-4392-800b-e24f450ce3d2 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/65a083f8-3b0d-43fd-93be-e9abb278e0ee" status: 200 len: 1315 microversion: 2.1 time: 0.293057 Oct 30 01:20:27.232780 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 943/1912] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:26 2022] GET /compute/v2.1/servers/65a083f8-3b0d-43fd-93be-e9abb278e0ee => generated 1315 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:27.249516 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a723d4c9-dc86-4e42-862b-ea07878e0cab tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:27.250160 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a723d4c9-dc86-4e42-862b-ea07878e0cab tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:27.275026 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a723d4c9-dc86-4e42-862b-ea07878e0cab tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:27.276088 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a723d4c9-dc86-4e42-862b-ea07878e0cab tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:27.276840 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a723d4c9-dc86-4e42-862b-ea07878e0cab tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:27.277829 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a723d4c9-dc86-4e42-862b-ea07878e0cab tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:27.278485 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a723d4c9-dc86-4e42-862b-ea07878e0cab tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:27.279099 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a723d4c9-dc86-4e42-862b-ea07878e0cab tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:27.350834 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b28bf6f4-e393-4dc7-a8b0-defb7bc6135f tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.256566 Oct 30 01:20:27.352063 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 970/1913] 10.222.0.13 () {62 vars in 1199 bytes} [Sun Oct 30 01:20:27 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 258 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 30 01:20:27.366419 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8385c1e1-ecb3-4fc9-8507-d78384c85a91 tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] Calling method '.version_select at 0x7f44d039a700>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:27.459584 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a723d4c9-dc86-4e42-862b-ea07878e0cab tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:27.477457 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a723d4c9-dc86-4e42-862b-ea07878e0cab tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:27.493471 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a723d4c9-dc86-4e42-862b-ea07878e0cab tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:27.496548 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8385c1e1-ecb3-4fc9-8507-d78384c85a91 tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1779011162" status: 204 len: 0 microversion: 2.2 time: 0.135464 Oct 30 01:20:27.499492 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 971/1914] 10.222.0.13 () {60 vars in 1261 bytes} [Sun Oct 30 01:20:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1779011162 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:20:27.515044 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a723d4c9-dc86-4e42-862b-ea07878e0cab tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1555 microversion: 2.91 time: 0.281059 Oct 30 01:20:27.515649 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 944/1915] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:20:27 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1555 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:20:27.540033 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fa1fed5f-59d9-438b-88fa-0747a7aedb10 tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] Action: 'create', calling method: .version_select at 0x7f44c7ac9670>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1333452205", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZaCAPJLyjs2ZTUj+rHr7+PEXGVBK9ndBepjioea0LXVR/VnlylyPkYoU4Ju/oFDURj22pQTfs/fcMy3mlaZtYcU/dNDKO9T4Jp6zEjISOZGb7nsR5o0mkAm8Xu9Qy4LQ=="}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:20:27.542712 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e90ee7f0-ebfe-4a0d-85bb-badad6addc9d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:27.566127 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e90ee7f0-ebfe-4a0d-85bb-badad6addc9d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 5ed38927-680d-4e93-b57a-21fb407c6b33] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:27.618484 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e90ee7f0-ebfe-4a0d-85bb-badad6addc9d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:27.623616 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e90ee7f0-ebfe-4a0d-85bb-badad6addc9d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:27.624204 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e90ee7f0-ebfe-4a0d-85bb-badad6addc9d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:27.625012 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e90ee7f0-ebfe-4a0d-85bb-badad6addc9d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:27.629449 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e90ee7f0-ebfe-4a0d-85bb-badad6addc9d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:27.637707 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e90ee7f0-ebfe-4a0d-85bb-badad6addc9d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:27.662706 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-fa1fed5f-59d9-438b-88fa-0747a7aedb10 tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] Getting quotas for project 8b9a5f8165c24556b4769fc2b43a7f1c. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:20:27.691903 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-fa1fed5f-59d9-438b-88fa-0747a7aedb10 tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] Getting quotas for user 1e982798802a46b5b880dcc4a99e359b and project 8b9a5f8165c24556b4769fc2b43a7f1c. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:20:27.893320 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e90ee7f0-ebfe-4a0d-85bb-badad6addc9d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:27.906242 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e90ee7f0-ebfe-4a0d-85bb-badad6addc9d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:27.908315 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e90ee7f0-ebfe-4a0d-85bb-badad6addc9d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:27.909840 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e90ee7f0-ebfe-4a0d-85bb-badad6addc9d tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33" status: 200 len: 1281 microversion: 2.25 time: 0.408773 Oct 30 01:20:27.910639 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 972/1916] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:20:27 2022] GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33 => generated 1281 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:20:27.915688 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5f4f2e37-b24d-41ec-b66c-c36b09ae1e06 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:27.916558 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5f4f2e37-b24d-41ec-b66c-c36b09ae1e06 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0ec8b27d-8af5-45d7-892b-09297e5cb2d8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:27.929721 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f4f2e37-b24d-41ec-b66c-c36b09ae1e06 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:27.931239 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f4f2e37-b24d-41ec-b66c-c36b09ae1e06 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:27.931851 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f4f2e37-b24d-41ec-b66c-c36b09ae1e06 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:27.932746 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f4f2e37-b24d-41ec-b66c-c36b09ae1e06 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:27.933390 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f4f2e37-b24d-41ec-b66c-c36b09ae1e06 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:27.933986 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f4f2e37-b24d-41ec-b66c-c36b09ae1e06 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:28.014007 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5f4f2e37-b24d-41ec-b66c-c36b09ae1e06 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:28.024881 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5f4f2e37-b24d-41ec-b66c-c36b09ae1e06 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8" status: 200 len: 1184 microversion: 2.1 time: 0.112613 Oct 30 01:20:28.025646 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 973/1917] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:27 2022] GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8 => generated 1184 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:28.031087 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c48bd583-0f15-4441-b853-cf85f253836f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:28.032017 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c48bd583-0f15-4441-b853-cf85f253836f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: e7ff7c82-b3f6-4172-be0d-1c67c30db4f7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:28.042982 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c48bd583-0f15-4441-b853-cf85f253836f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:28.043484 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c48bd583-0f15-4441-b853-cf85f253836f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:28.043949 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c48bd583-0f15-4441-b853-cf85f253836f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:28.048065 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c48bd583-0f15-4441-b853-cf85f253836f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:28.048746 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c48bd583-0f15-4441-b853-cf85f253836f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:28.049194 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c48bd583-0f15-4441-b853-cf85f253836f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:28.177643 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fa1fed5f-59d9-438b-88fa-0747a7aedb10 tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.652380 Oct 30 01:20:28.179905 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 945/1918] 10.222.0.13 () {62 vars in 1199 bytes} [Sun Oct 30 01:20:27 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 657 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 30 01:20:28.259017 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c48bd583-0f15-4441-b853-cf85f253836f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:28.281832 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c48bd583-0f15-4441-b853-cf85f253836f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7" status: 200 len: 1476 microversion: 2.1 time: 0.241907 Oct 30 01:20:28.281832 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 974/1919] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:28 2022] GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 => generated 1476 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:28.281832 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ec83c5aa-7b9a-4021-8e04-ce2b9b6453be tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] Action: 'create', calling method: .version_select at 0x7f44d03ffdc0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-593768070", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyQ/uv9uV9ePjdU9S6H52MRZ2y0qxPx537OW2DChoPmurGZSrkCtURPWZkHUcQK3NHFXcjjIEI9PTqyH70wjFhyTzUwoMbLs+nyTNw2Obt3Uk4ntoKawBnwkDF8Noka/g=="}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:20:28.347595 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c1fda095-c6ac-4e09-a191-b19350554c29 tempest-FloatingIPsTestJSON-1385162609 tempest-FloatingIPsTestJSON-1385162609-project] Action: 'create', calling method: .version_select at 0x7f44c7b60b80>, body: {"pool": null} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:20:28.371234 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-ec83c5aa-7b9a-4021-8e04-ce2b9b6453be tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] Getting quotas for project 8b9a5f8165c24556b4769fc2b43a7f1c. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:20:28.397867 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-ec83c5aa-7b9a-4021-8e04-ce2b9b6453be tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] Getting quotas for user 1e982798802a46b5b880dcc4a99e359b and project 8b9a5f8165c24556b4769fc2b43a7f1c. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:20:28.523026 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ec83c5aa-7b9a-4021-8e04-ce2b9b6453be tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.252470 Oct 30 01:20:28.523765 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 975/1920] 10.222.0.13 () {62 vars in 1199 bytes} [Sun Oct 30 01:20:28 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 254 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 30 01:20:28.542556 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c066c8c6-ae0f-4368-b5d3-857be4dece4e tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:28.543196 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c066c8c6-ae0f-4368-b5d3-857be4dece4e tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: 65a083f8-3b0d-43fd-93be-e9abb278e0ee] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:28.557482 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c066c8c6-ae0f-4368-b5d3-857be4dece4e tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:28.557986 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c066c8c6-ae0f-4368-b5d3-857be4dece4e tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:28.558547 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c066c8c6-ae0f-4368-b5d3-857be4dece4e tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:28.559208 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c066c8c6-ae0f-4368-b5d3-857be4dece4e tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:28.570203 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c066c8c6-ae0f-4368-b5d3-857be4dece4e tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:28.570203 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c066c8c6-ae0f-4368-b5d3-857be4dece4e tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:28.651062 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-c066c8c6-ae0f-4368-b5d3-857be4dece4e tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] HTTP exception thrown: Instance 65a083f8-3b0d-43fd-93be-e9abb278e0ee could not be found. Oct 30 01:20:28.652897 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c066c8c6-ae0f-4368-b5d3-857be4dece4e tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Request method failure captured: Oct 30 01:20:28.652897 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/65a083f8-3b0d-43fd-93be-e9abb278e0ee HTTP/1.1 Oct 30 01:20:28.652897 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:20:28.652897 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:20:28.652897 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:20:28.652897 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:20:28.652897 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:20:28.652897 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:20:28.652897 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:20:28.652897 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:20:28.652897 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdD3IhIPYY_sTvEXpI9r1a34kazQy3xsqStabQonrlcEF0HpNl2ztWpirnqs0lietV1LWWVyHjCqAxxd5t3TuUU6o10qW3LK2oIPKGmvwXDy1lrrZEL1UVe632zfYCdkIUu5geJi4tWcEpwgvNOLoS3eMkj37BIJt_45I78bzhHVIS8 Oct 30 01:20:28.652897 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:20:28.652897 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:20:28.652897 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:20:28.652897 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:20:28.652897 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:20:28.652897 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:20:28.652897 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 8c2cd7e4b04741e3bb1cb9852612db57 Oct 30 01:20:28.652897 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1966575233 Oct 30 01:20:28.652897 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:20:28.652897 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:20:28.654493 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c2cd7e4b04741e3bb1cb9852612db57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8c2cd7e4b04741e3bb1cb9852612db57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8c2cd7e4b04741e3bb1cb9852612db57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c2cd7e4b04741e3bb1cb9852612db57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:20:28.654493 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1966575233 Oct 30 01:20:28.654493 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 8c2cd7e4b04741e3bb1cb9852612db57 Oct 30 01:20:28.654493 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1966575233 Oct 30 01:20:28.654493 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ImagesOneServerNegativeTestJSON-1966575233-project Oct 30 01:20:28.654493 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:20:28.654493 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:20:28.654493 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: c114d44d0a314c75902da53fca797f62 Oct 30 01:20:28.654493 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1966575233-project Oct 30 01:20:28.654493 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:20:28.654493 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 65a083f8-3b0d-43fd-93be-e9abb278e0ee could not be found. Oct 30 01:20:28.654493 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '65a083f8-3b0d-43fd-93be-e9abb278e0ee'} Oct 30 01:20:28.655370 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:20:28.655370 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:28.655370 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:20:28.655370 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:20:28.655370 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:20:28.655370 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:20:28.655370 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:20:28.655370 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:20:28.655370 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:20:28.655370 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:20:28.655370 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65a083f8-3b0d-43fd-93be-e9abb278e0ee could not be found. Oct 30 01:20:28.655370 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:20:28.655370 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:28.655370 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:20:28.655370 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:28.655370 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:20:28.655370 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:20:28.655370 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:20:28.655370 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:20:28.655370 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:20:28.658143 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:20:28.658143 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:20:28.658143 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:20:28.658143 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:20:28.658143 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:20:28.658143 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:20:28.658143 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:20:28.658143 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65a083f8-3b0d-43fd-93be-e9abb278e0ee could not be found. Oct 30 01:20:28.658143 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:20:28.658143 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:28.658143 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:20:28.658143 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:28.658143 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:20:28.658143 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:20:28.658143 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:20:28.658143 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:20:28.658143 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65a083f8-3b0d-43fd-93be-e9abb278e0ee could not be found. Oct 30 01:20:28.658143 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:20:28.660821 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c066c8c6-ae0f-4368-b5d3-857be4dece4e tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Returning 404 to user: Instance 65a083f8-3b0d-43fd-93be-e9abb278e0ee could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:20:28.660821 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c066c8c6-ae0f-4368-b5d3-857be4dece4e tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/65a083f8-3b0d-43fd-93be-e9abb278e0ee" status: 404 len: 111 microversion: 2.1 time: 0.129729 Oct 30 01:20:28.666370 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 976/1921] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:28 2022] GET /compute/v2.1/servers/65a083f8-3b0d-43fd-93be-e9abb278e0ee => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:20:28.672993 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0d2bed3e-605f-4cc1-924a-63de61d3bab9 tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] Action: 'create', calling method: .version_select at 0x7f44d02cdb80>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1822623529", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/1tJ/g8hq0c/v/SAmqIBP4hY3bnxkPRykg2ddJ8+2hIXWPnTat051Shks1O7CPPqrVFPTdrz91EgYZVO7RxMVylSMsf3t1UjakDbvAUee7I205yuRBfVXk9nEa2NblYA=="}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:20:28.692908 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-0d2bed3e-605f-4cc1-924a-63de61d3bab9 tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] Getting quotas for project 8b9a5f8165c24556b4769fc2b43a7f1c. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:20:28.700571 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-0d2bed3e-605f-4cc1-924a-63de61d3bab9 tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] Getting quotas for user 1e982798802a46b5b880dcc4a99e359b and project 8b9a5f8165c24556b4769fc2b43a7f1c. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:20:28.849701 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0d2bed3e-605f-4cc1-924a-63de61d3bab9 tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.182066 Oct 30 01:20:28.859348 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 977/1922] 10.222.0.13 () {62 vars in 1199 bytes} [Sun Oct 30 01:20:28 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 193 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 30 01:20:28.880329 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9a159c2d-961f-4599-b8e3-f641b392b51f tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:28.880970 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9a159c2d-961f-4599-b8e3-f641b392b51f tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:28.895059 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9a159c2d-961f-4599-b8e3-f641b392b51f tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:28.895730 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9a159c2d-961f-4599-b8e3-f641b392b51f tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:28.904586 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9a159c2d-961f-4599-b8e3-f641b392b51f tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:28.907813 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9a159c2d-961f-4599-b8e3-f641b392b51f tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:28.908603 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9a159c2d-961f-4599-b8e3-f641b392b51f tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:28.909257 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9a159c2d-961f-4599-b8e3-f641b392b51f tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:29.525047 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9a159c2d-961f-4599-b8e3-f641b392b51f tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:29.538584 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9a159c2d-961f-4599-b8e3-f641b392b51f tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:29.540899 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9a159c2d-961f-4599-b8e3-f641b392b51f tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:29.553270 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9a159c2d-961f-4599-b8e3-f641b392b51f tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1555 microversion: 2.91 time: 0.692545 Oct 30 01:20:29.571807 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 978/1923] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:20:28 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1555 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:20:29.582820 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3a4d312a-cb07-4275-84b6-98767c8da2b0 tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] Calling method '.version_select at 0x7f44d0474310>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:29.587537 n-d-master-1 devstack@n-api.service[121102]: WARNING oslo_db.sqlalchemy.utils [None req-3a4d312a-cb07-4275-84b6-98767c8da2b0 tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 30 01:20:29.598877 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3a4d312a-cb07-4275-84b6-98767c8da2b0 tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] 10.222.0.13 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.025578 Oct 30 01:20:29.601422 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 979/1924] 10.222.0.13 () {60 vars in 1177 bytes} [Sun Oct 30 01:20:29 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:29.614772 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cfc9ae2d-a755-4191-a93b-cd649d82a81b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-768721428", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:20:29.722239 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-cfc9ae2d-a755-4191-a93b-cd649d82a81b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] validate_networks() for [('a974e348-14e9-416b-aba2-e255412b1fdd', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:20:30.630113 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-cfc9ae2d-a755-4191-a93b-cd649d82a81b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:20:30.639654 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-cfc9ae2d-a755-4191-a93b-cd649d82a81b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:20:30.639654 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-cfc9ae2d-a755-4191-a93b-cd649d82a81b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:20:30.639654 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-cfc9ae2d-a755-4191-a93b-cd649d82a81b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:20:30.639654 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-cfc9ae2d-a755-4191-a93b-cd649d82a81b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:20:30.656822 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cfc9ae2d-a755-4191-a93b-cd649d82a81b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:30.657436 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cfc9ae2d-a755-4191-a93b-cd649d82a81b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:30.657902 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cfc9ae2d-a755-4191-a93b-cd649d82a81b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:30.658619 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cfc9ae2d-a755-4191-a93b-cd649d82a81b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:30.659111 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cfc9ae2d-a755-4191-a93b-cd649d82a81b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:30.659515 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cfc9ae2d-a755-4191-a93b-cd649d82a81b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:30.707892 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-cfc9ae2d-a755-4191-a93b-cd649d82a81b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Getting quotas for project 8c2cd7e4b04741e3bb1cb9852612db57. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:20:30.726120 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-cfc9ae2d-a755-4191-a93b-cd649d82a81b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Getting quotas for user c114d44d0a314c75902da53fca797f62 and project 8c2cd7e4b04741e3bb1cb9852612db57. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:20:30.752136 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cfc9ae2d-a755-4191-a93b-cd649d82a81b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:20:30.754532 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cfc9ae2d-a755-4191-a93b-cd649d82a81b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: 51bbcade-43f8-4f2d-a572-3dc9e98aa391] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:20:30.925031 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cfc9ae2d-a755-4191-a93b-cd649d82a81b tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.321574 Oct 30 01:20:30.928519 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 980/1925] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:20:29 2022] POST /compute/v2.1/servers => generated 383 bytes in 1326 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:20:30.936903 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a7e858c2-98ea-42e2-a8ff-0baa069c4824 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:30.940813 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a7e858c2-98ea-42e2-a8ff-0baa069c4824 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 5ed38927-680d-4e93-b57a-21fb407c6b33] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:30.954738 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7e858c2-98ea-42e2-a8ff-0baa069c4824 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:30.955560 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7e858c2-98ea-42e2-a8ff-0baa069c4824 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:30.956518 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7e858c2-98ea-42e2-a8ff-0baa069c4824 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:30.958763 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7e858c2-98ea-42e2-a8ff-0baa069c4824 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:30.960761 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7e858c2-98ea-42e2-a8ff-0baa069c4824 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:30.961494 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7e858c2-98ea-42e2-a8ff-0baa069c4824 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:31.546565 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a7e858c2-98ea-42e2-a8ff-0baa069c4824 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:31.559325 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a7e858c2-98ea-42e2-a8ff-0baa069c4824 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:31.561205 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a7e858c2-98ea-42e2-a8ff-0baa069c4824 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:31.564095 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a7e858c2-98ea-42e2-a8ff-0baa069c4824 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33" status: 200 len: 1475 microversion: 2.25 time: 0.632833 Oct 30 01:20:31.565847 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 981/1926] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:20:30 2022] GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33 => generated 1475 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:20:31.581326 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-532c15d4-ef4a-475d-b2ba-9754b1d4ea67 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:31.582323 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-532c15d4-ef4a-475d-b2ba-9754b1d4ea67 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0ec8b27d-8af5-45d7-892b-09297e5cb2d8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:31.591696 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-532c15d4-ef4a-475d-b2ba-9754b1d4ea67 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:31.594645 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-532c15d4-ef4a-475d-b2ba-9754b1d4ea67 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:31.594645 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-532c15d4-ef4a-475d-b2ba-9754b1d4ea67 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:31.594645 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-532c15d4-ef4a-475d-b2ba-9754b1d4ea67 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:31.594645 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-532c15d4-ef4a-475d-b2ba-9754b1d4ea67 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:31.595194 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-532c15d4-ef4a-475d-b2ba-9754b1d4ea67 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:31.638906 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-532c15d4-ef4a-475d-b2ba-9754b1d4ea67 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] HTTP exception thrown: Instance 0ec8b27d-8af5-45d7-892b-09297e5cb2d8 could not be found. Oct 30 01:20:31.640737 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-532c15d4-ef4a-475d-b2ba-9754b1d4ea67 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Request method failure captured: Oct 30 01:20:31.640737 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8 HTTP/1.1 Oct 30 01:20:31.640737 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:20:31.640737 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:20:31.640737 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:20:31.640737 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:20:31.640737 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:20:31.640737 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:20:31.640737 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:20:31.640737 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:20:31.640737 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXc_KQ69GfMeJ3jN4J1TPXQ8bGOBoI0WTBTMDe__y-DAo2JjL2ORnQbmCeuZLneRCYcs3kYLHyIaNHHXu_K6nKvgKp3dW6RkvCZlVFmQEQtSKQwNbPyCCeYKzvViBngiAhBCQkceHgL-negWQA5TNaEjJqlsKIeoNOaaRa4HQnkUFlGY Oct 30 01:20:31.640737 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:20:31.640737 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:20:31.640737 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:20:31.640737 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:20:31.640737 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:20:31.640737 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:20:31.640737 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 283e7fd477334b879db6b49ee5cc509f Oct 30 01:20:31.640737 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-LiveMigrationTest-879299357 Oct 30 01:20:31.640737 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:20:31.640737 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:20:31.642369 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/283e7fd477334b879db6b49ee5cc509f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_283e7fd477334b879db6b49ee5cc509f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/283e7fd477334b879db6b49ee5cc509f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/283e7fd477334b879db6b49ee5cc509f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:20:31.642369 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-LiveMigrationTest-879299357 Oct 30 01:20:31.642369 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 283e7fd477334b879db6b49ee5cc509f Oct 30 01:20:31.642369 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-LiveMigrationTest-879299357 Oct 30 01:20:31.642369 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-LiveMigrationTest-879299357-project Oct 30 01:20:31.642369 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:20:31.642369 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:20:31.642369 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: c7334417689847d18bc4c1b27d173a23 Oct 30 01:20:31.642369 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-LiveMigrationTest-879299357-project Oct 30 01:20:31.642369 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:20:31.642369 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 0ec8b27d-8af5-45d7-892b-09297e5cb2d8 could not be found. Oct 30 01:20:31.642369 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '0ec8b27d-8af5-45d7-892b-09297e5cb2d8'} Oct 30 01:20:31.643267 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:20:31.643267 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:31.643267 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:20:31.643267 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:20:31.643267 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:20:31.643267 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:20:31.643267 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:20:31.643267 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:20:31.643267 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:20:31.643267 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:20:31.643267 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ec8b27d-8af5-45d7-892b-09297e5cb2d8 could not be found. Oct 30 01:20:31.643267 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:20:31.643267 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:31.643267 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:20:31.643267 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:31.643267 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:20:31.643267 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:20:31.643267 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:20:31.643267 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:20:31.643267 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:20:31.644710 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:20:31.644710 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:20:31.644710 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:20:31.644710 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:20:31.644710 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:20:31.644710 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:20:31.644710 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:20:31.644710 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ec8b27d-8af5-45d7-892b-09297e5cb2d8 could not be found. Oct 30 01:20:31.644710 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:20:31.644710 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:31.644710 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:20:31.644710 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:31.644710 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:20:31.644710 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:20:31.644710 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:20:31.644710 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:20:31.644710 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ec8b27d-8af5-45d7-892b-09297e5cb2d8 could not be found. Oct 30 01:20:31.644710 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:20:31.652588 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-532c15d4-ef4a-475d-b2ba-9754b1d4ea67 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Returning 404 to user: Instance 0ec8b27d-8af5-45d7-892b-09297e5cb2d8 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:20:31.652588 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-532c15d4-ef4a-475d-b2ba-9754b1d4ea67 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8" status: 404 len: 111 microversion: 2.1 time: 0.075210 Oct 30 01:20:31.652588 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 982/1927] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:31 2022] GET /compute/v2.1/servers/0ec8b27d-8af5-45d7-892b-09297e5cb2d8 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:20:31.660296 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2652a35b-1912-419b-85fb-ad5588166a89 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:31.661123 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2652a35b-1912-419b-85fb-ad5588166a89 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: e7ff7c82-b3f6-4172-be0d-1c67c30db4f7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:31.678570 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2652a35b-1912-419b-85fb-ad5588166a89 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:31.680707 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2652a35b-1912-419b-85fb-ad5588166a89 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:31.681175 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2652a35b-1912-419b-85fb-ad5588166a89 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:31.682917 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2652a35b-1912-419b-85fb-ad5588166a89 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:31.685725 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2652a35b-1912-419b-85fb-ad5588166a89 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:31.686340 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2652a35b-1912-419b-85fb-ad5588166a89 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:32.037496 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2652a35b-1912-419b-85fb-ad5588166a89 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:32.046306 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2652a35b-1912-419b-85fb-ad5588166a89 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7" status: 200 len: 1476 microversion: 2.1 time: 0.390954 Oct 30 01:20:32.050632 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 983/1928] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:31 2022] GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 => generated 1476 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:32.061723 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-704ee4d3-82be-4ec1-a6bf-ecfec838106b tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] Calling method '.version_select at 0x7f44d04530d0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:32.231463 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-704ee4d3-82be-4ec1-a6bf-ecfec838106b tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1822623529" status: 204 len: 0 microversion: 2.2 time: 0.176088 Oct 30 01:20:32.232402 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 984/1929] 10.222.0.13 () {60 vars in 1321 bytes} [Sun Oct 30 01:20:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1822623529 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:20:32.237691 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1f7c0cb0-a5e4-4562-97d1-2efb13f2548f tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:32.238825 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1f7c0cb0-a5e4-4562-97d1-2efb13f2548f tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:32.255238 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1f7c0cb0-a5e4-4562-97d1-2efb13f2548f tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:32.256176 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1f7c0cb0-a5e4-4562-97d1-2efb13f2548f tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:32.256858 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1f7c0cb0-a5e4-4562-97d1-2efb13f2548f tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:32.257870 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1f7c0cb0-a5e4-4562-97d1-2efb13f2548f tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:32.259120 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1f7c0cb0-a5e4-4562-97d1-2efb13f2548f tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:32.260225 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1f7c0cb0-a5e4-4562-97d1-2efb13f2548f tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:32.335326 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c1fda095-c6ac-4e09-a191-b19350554c29 tempest-FloatingIPsTestJSON-1385162609 tempest-FloatingIPsTestJSON-1385162609-project] 10.222.0.13 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 4.152075 Oct 30 01:20:32.336043 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 946/1930] 10.222.0.13 () {60 vars in 1170 bytes} [Sun Oct 30 01:20:28 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 4154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:20:32.343048 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-983914ff-cbe6-45fe-92fc-f7d79daf3fef tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:32.344760 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-983914ff-cbe6-45fe-92fc-f7d79daf3fef tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: 51bbcade-43f8-4f2d-a572-3dc9e98aa391] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:32.420808 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1f7c0cb0-a5e4-4562-97d1-2efb13f2548f tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:32.431452 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1f7c0cb0-a5e4-4562-97d1-2efb13f2548f tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:32.435960 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-983914ff-cbe6-45fe-92fc-f7d79daf3fef tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:32.437012 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1f7c0cb0-a5e4-4562-97d1-2efb13f2548f tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:32.447837 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-983914ff-cbe6-45fe-92fc-f7d79daf3fef tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/51bbcade-43f8-4f2d-a572-3dc9e98aa391" status: 200 len: 1224 microversion: 2.1 time: 0.109288 Oct 30 01:20:32.449520 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 947/1931] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:32 2022] GET /compute/v2.1/servers/51bbcade-43f8-4f2d-a572-3dc9e98aa391 => generated 1224 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:32.466291 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1f7c0cb0-a5e4-4562-97d1-2efb13f2548f tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1555 microversion: 2.91 time: 0.232423 Oct 30 01:20:32.466888 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 985/1932] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:20:32 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1555 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:20:32.472766 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cf06d36a-b6b9-4b20-ae7e-5faa3918ed40 tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] Calling method '.version_select at 0x7f44d03de160>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:32.551339 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cf06d36a-b6b9-4b20-ae7e-5faa3918ed40 tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-593768070" status: 204 len: 0 microversion: 2.2 time: 0.082166 Oct 30 01:20:32.551940 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 986/1933] 10.222.0.13 () {60 vars in 1318 bytes} [Sun Oct 30 01:20:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-593768070 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:20:32.559989 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5b2baa97-4920-45cb-8adc-9eaf8430c243 tempest-FloatingIPsTestJSON-1385162609 tempest-FloatingIPsTestJSON-1385162609-project] Calling method '.version_select at 0x7f44d03ffb80>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:32.670278 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b5b78a90-9f16-4228-96e1-c978949c3874 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:32.671357 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b5b78a90-9f16-4228-96e1-c978949c3874 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] [instance: 5ed38927-680d-4e93-b57a-21fb407c6b33] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:32.687638 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b5b78a90-9f16-4228-96e1-c978949c3874 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:32.689035 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b5b78a90-9f16-4228-96e1-c978949c3874 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:32.691347 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b5b78a90-9f16-4228-96e1-c978949c3874 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:32.692832 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b5b78a90-9f16-4228-96e1-c978949c3874 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:32.694910 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b5b78a90-9f16-4228-96e1-c978949c3874 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:32.696829 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b5b78a90-9f16-4228-96e1-c978949c3874 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:33.013934 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-b5b78a90-9f16-4228-96e1-c978949c3874 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lazy-loading 'services' on Instance uuid 5ed38927-680d-4e93-b57a-21fb407c6b33 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:20:33.017760 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5b2baa97-4920-45cb-8adc-9eaf8430c243 tempest-FloatingIPsTestJSON-1385162609 tempest-FloatingIPsTestJSON-1385162609-project] 10.222.0.13 "GET /compute/v2.1/os-floating-ips/594c3f3a-4c1e-40c4-99f8-5cc342ba70a4" status: 200 len: 140 microversion: 2.1 time: 0.464384 Oct 30 01:20:33.019692 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 987/1934] 10.222.0.13 () {58 vars in 1260 bytes} [Sun Oct 30 01:20:32 2022] GET /compute/v2.1/os-floating-ips/594c3f3a-4c1e-40c4-99f8-5cc342ba70a4 => generated 140 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:20:33.031272 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6fc37d08-3aae-42a1-8a67-0169ff4a9fec tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] Calling method '.version_select at 0x7f44d049d0d0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:33.063159 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b5b78a90-9f16-4228-96e1-c978949c3874 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33" status: 200 len: 1968 microversion: 2.25 time: 0.611750 Oct 30 01:20:33.063755 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 948/1935] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:20:32 2022] GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33 => generated 1968 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:20:33.064954 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=7,nova_api:DELETE=4 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:20:33.094676 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1cafd82f-2212-4e23-adba-91c6bcb118c5 tempest-FloatingIPsTestJSON-1385162609 tempest-FloatingIPsTestJSON-1385162609-project] Calling method '.version_select at 0x7f44ccc8a280>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:33.180280 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6fc37d08-3aae-42a1-8a67-0169ff4a9fec tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1333452205" status: 204 len: 0 microversion: 2.2 time: 0.158899 Oct 30 01:20:33.181386 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 988/1936] 10.222.0.13 () {60 vars in 1321 bytes} [Sun Oct 30 01:20:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1333452205 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:20:33.193961 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d969d948-df58-405a-9c98-e5e3c1fa4853 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:33.194594 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d969d948-df58-405a-9c98-e5e3c1fa4853 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: e7ff7c82-b3f6-4172-be0d-1c67c30db4f7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:33.224500 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d969d948-df58-405a-9c98-e5e3c1fa4853 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:33.225550 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d969d948-df58-405a-9c98-e5e3c1fa4853 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:33.226174 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d969d948-df58-405a-9c98-e5e3c1fa4853 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:33.227115 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d969d948-df58-405a-9c98-e5e3c1fa4853 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:33.227815 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d969d948-df58-405a-9c98-e5e3c1fa4853 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:33.228416 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d969d948-df58-405a-9c98-e5e3c1fa4853 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:33.654668 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1cafd82f-2212-4e23-adba-91c6bcb118c5 tempest-FloatingIPsTestJSON-1385162609 tempest-FloatingIPsTestJSON-1385162609-project] 10.222.0.13 "GET /compute/v2.1/os-floating-ips" status: 200 len: 143 microversion: 2.1 time: 0.565034 Oct 30 01:20:33.655251 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 949/1937] 10.222.0.13 () {58 vars in 1149 bytes} [Sun Oct 30 01:20:33 2022] GET /compute/v2.1/os-floating-ips => generated 143 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:20:33.660175 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fa2e742f-2847-4b19-8cfb-4fa4dd75478d tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:33.660793 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-fa2e742f-2847-4b19-8cfb-4fa4dd75478d tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] [instance: 5ed38927-680d-4e93-b57a-21fb407c6b33] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:33.671247 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fa2e742f-2847-4b19-8cfb-4fa4dd75478d tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:33.672218 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fa2e742f-2847-4b19-8cfb-4fa4dd75478d tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:33.672864 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fa2e742f-2847-4b19-8cfb-4fa4dd75478d tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:33.674107 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fa2e742f-2847-4b19-8cfb-4fa4dd75478d tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:33.674750 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fa2e742f-2847-4b19-8cfb-4fa4dd75478d tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:33.675516 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fa2e742f-2847-4b19-8cfb-4fa4dd75478d tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:33.804874 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d969d948-df58-405a-9c98-e5e3c1fa4853 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:33.813022 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d969d948-df58-405a-9c98-e5e3c1fa4853 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7" status: 200 len: 1475 microversion: 2.1 time: 0.629992 Oct 30 01:20:33.826125 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 989/1938] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:33 2022] GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 => generated 1475 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:33.831149 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cdd108e3-2d54-43b5-9ccc-e3892dc45dfb tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] Action: 'create', calling method: .version_select at 0x7f44d03de430>, body: {"keypair": {"name": "tempest-keypair-1922267285", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENCLX7NAsT+1d5b4CV8y/8kyEWQZBxrUv8E6XnHoJYcGywLjrh09sDw3LLtytPlWXNse+wjwul0/3vvxuyKFB3poBq3yCz1X7R8dal9XQvMprgrhR9BXgInWEB++9lIFQ=="}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:20:33.862607 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-cdd108e3-2d54-43b5-9ccc-e3892dc45dfb tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] Getting quotas for project 8b9a5f8165c24556b4769fc2b43a7f1c. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:20:33.876911 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-cdd108e3-2d54-43b5-9ccc-e3892dc45dfb tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] Getting quotas for user 1e982798802a46b5b880dcc4a99e359b and project 8b9a5f8165c24556b4769fc2b43a7f1c. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:20:33.986286 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cdd108e3-2d54-43b5-9ccc-e3892dc45dfb tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.158932 Oct 30 01:20:33.987582 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 990/1939] 10.222.0.13 () {62 vars in 1199 bytes} [Sun Oct 30 01:20:33 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 161 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 30 01:20:33.993923 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9e9fbfe6-04c3-419f-a420-cdd88ad7c811 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:33.994859 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9e9fbfe6-04c3-419f-a420-cdd88ad7c811 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: 51bbcade-43f8-4f2d-a572-3dc9e98aa391] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:34.001749 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9e9fbfe6-04c3-419f-a420-cdd88ad7c811 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:34.002692 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9e9fbfe6-04c3-419f-a420-cdd88ad7c811 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:34.003394 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9e9fbfe6-04c3-419f-a420-cdd88ad7c811 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:34.004303 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9e9fbfe6-04c3-419f-a420-cdd88ad7c811 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:34.005012 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9e9fbfe6-04c3-419f-a420-cdd88ad7c811 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:34.005729 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9e9fbfe6-04c3-419f-a420-cdd88ad7c811 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:34.109908 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9e9fbfe6-04c3-419f-a420-cdd88ad7c811 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:34.120951 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9e9fbfe6-04c3-419f-a420-cdd88ad7c811 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/51bbcade-43f8-4f2d-a572-3dc9e98aa391" status: 200 len: 1276 microversion: 2.1 time: 0.132041 Oct 30 01:20:34.121572 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 991/1940] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:33 2022] GET /compute/v2.1/servers/51bbcade-43f8-4f2d-a572-3dc9e98aa391 => generated 1276 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:34.138698 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-06c2faea-08b0-47c0-8f6b-5f466ef9527c tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:34.139443 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-06c2faea-08b0-47c0-8f6b-5f466ef9527c tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:34.163974 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-06c2faea-08b0-47c0-8f6b-5f466ef9527c tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:34.164466 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-06c2faea-08b0-47c0-8f6b-5f466ef9527c tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:34.164946 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-06c2faea-08b0-47c0-8f6b-5f466ef9527c tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:34.165693 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-06c2faea-08b0-47c0-8f6b-5f466ef9527c tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:34.174136 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-06c2faea-08b0-47c0-8f6b-5f466ef9527c tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:34.174661 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-06c2faea-08b0-47c0-8f6b-5f466ef9527c tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:34.509039 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-06c2faea-08b0-47c0-8f6b-5f466ef9527c tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:34.520739 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-06c2faea-08b0-47c0-8f6b-5f466ef9527c tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:34.529585 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-06c2faea-08b0-47c0-8f6b-5f466ef9527c tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:34.540643 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-06c2faea-08b0-47c0-8f6b-5f466ef9527c tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1555 microversion: 2.91 time: 0.417974 Oct 30 01:20:34.548096 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 992/1941] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:20:34 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1555 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:20:34.554694 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-340b3ca3-bca0-4162-824e-07246e264bf4 tempest-FloatingIPsTestJSON-1385162609 tempest-FloatingIPsTestJSON-1385162609-project] Calling method '.version_select at 0x7f44d03de4c0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:34.562974 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-fa2e742f-2847-4b19-8cfb-4fa4dd75478d tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lazy-loading 'services' on Instance uuid 5ed38927-680d-4e93-b57a-21fb407c6b33 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:20:34.584605 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fa2e742f-2847-4b19-8cfb-4fa4dd75478d tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33" status: 200 len: 1968 microversion: 2.25 time: 0.928224 Oct 30 01:20:34.588346 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 950/1942] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:20:33 2022] GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33 => generated 1968 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:20:34.593767 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-aee9acec-37b6-4bec-b7fd-7f693131aae3 tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] Calling method '.version_select at 0x7f44c7b60160>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:34.608181 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-aee9acec-37b6-4bec-b7fd-7f693131aae3 tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] 10.222.0.13 "GET /compute/v2.1/os-keypairs/tempest-keypair-1922267285" status: 200 len: 513 microversion: 2.2 time: 0.018695 Oct 30 01:20:34.609556 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 951/1943] 10.222.0.13 () {60 vars in 1258 bytes} [Sun Oct 30 01:20:34 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1922267285 => generated 513 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:20:34.623654 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-245a9643-ec1d-403d-a225-ab0f482676e6 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:34.629828 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-245a9643-ec1d-403d-a225-ab0f482676e6 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:34.630946 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-245a9643-ec1d-403d-a225-ab0f482676e6 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:34.631634 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-245a9643-ec1d-403d-a225-ab0f482676e6 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:34.632656 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-245a9643-ec1d-403d-a225-ab0f482676e6 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:34.633969 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-245a9643-ec1d-403d-a225-ab0f482676e6 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:34.634726 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-245a9643-ec1d-403d-a225-ab0f482676e6 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:34.708578 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-245a9643-ec1d-403d-a225-ab0f482676e6 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.091583 Oct 30 01:20:34.724806 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 952/1944] 10.222.0.13 () {60 vars in 1217 bytes} [Sun Oct 30 01:20:34 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:20:34.738997 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b0a4b702-21a7-4d31-a2d6-f990f60365bf tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] Calling method '.version_select at 0x7f44c7a98dc0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:34.761758 n-d-master-1 devstack@n-api.service[121103]: WARNING oslo_db.sqlalchemy.utils [None req-b0a4b702-21a7-4d31-a2d6-f990f60365bf tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 30 01:20:34.786106 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b0a4b702-21a7-4d31-a2d6-f990f60365bf tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] 10.222.0.13 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.058428 Oct 30 01:20:34.787763 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 953/1945] 10.222.0.13 () {60 vars in 1177 bytes} [Sun Oct 30 01:20:34 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:20:34.807592 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d5f6214b-767c-46ff-8f56-33eab9f8f820 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": "auto"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:20:34.813526 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d5f6214b-767c-46ff-8f56-33eab9f8f820 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] [instance: 5ed38927-680d-4e93-b57a-21fb407c6b33] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:34.821320 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d5f6214b-767c-46ff-8f56-33eab9f8f820 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:34.823110 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d5f6214b-767c-46ff-8f56-33eab9f8f820 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:34.825170 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d5f6214b-767c-46ff-8f56-33eab9f8f820 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:34.826167 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d5f6214b-767c-46ff-8f56-33eab9f8f820 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:34.827197 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d5f6214b-767c-46ff-8f56-33eab9f8f820 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:34.828944 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d5f6214b-767c-46ff-8f56-33eab9f8f820 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:34.883647 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-d5f6214b-767c-46ff-8f56-33eab9f8f820 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lazy-loading 'flavor' on Instance uuid 5ed38927-680d-4e93-b57a-21fb407c6b33 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:20:34.910729 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d5f6214b-767c-46ff-8f56-33eab9f8f820 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] [instance: 5ed38927-680d-4e93-b57a-21fb407c6b33] Going to try to live migrate instance to n-h2-master-1 {{(pid=121103) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 30 01:20:37.646917 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-340b3ca3-bca0-4162-824e-07246e264bf4 tempest-FloatingIPsTestJSON-1385162609 tempest-FloatingIPsTestJSON-1385162609-project] 10.222.0.13 "DELETE /compute/v2.1/os-floating-ips/594c3f3a-4c1e-40c4-99f8-5cc342ba70a4" status: 202 len: 0 microversion: 2.1 time: 3.099681 Oct 30 01:20:37.648842 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 993/1946] 10.222.0.13 () {58 vars in 1263 bytes} [Sun Oct 30 01:20:34 2022] DELETE /compute/v2.1/os-floating-ips/594c3f3a-4c1e-40c4-99f8-5cc342ba70a4 => generated 0 bytes in 3102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:20:37.655013 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-393aafa4-3e44-4e09-b443-7efe4aab9663 tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] Calling method '.version_select at 0x7f44d04e50d0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:37.775708 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-393aafa4-3e44-4e09-b443-7efe4aab9663 tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1922267285" status: 204 len: 0 microversion: 2.2 time: 0.124703 Oct 30 01:20:37.781512 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 994/1947] 10.222.0.13 () {60 vars in 1261 bytes} [Sun Oct 30 01:20:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1922267285 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:20:37.782689 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ae22278a-4df0-4299-95d4-a396b42f0072 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:37.783708 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ae22278a-4df0-4299-95d4-a396b42f0072 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: e7ff7c82-b3f6-4172-be0d-1c67c30db4f7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:37.796332 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae22278a-4df0-4299-95d4-a396b42f0072 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:37.797217 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae22278a-4df0-4299-95d4-a396b42f0072 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:37.798173 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae22278a-4df0-4299-95d4-a396b42f0072 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:37.799653 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae22278a-4df0-4299-95d4-a396b42f0072 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:37.800402 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae22278a-4df0-4299-95d4-a396b42f0072 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:37.801693 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae22278a-4df0-4299-95d4-a396b42f0072 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:38.112467 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ae22278a-4df0-4299-95d4-a396b42f0072 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:38.123188 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ae22278a-4df0-4299-95d4-a396b42f0072 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7" status: 200 len: 1475 microversion: 2.1 time: 0.345082 Oct 30 01:20:38.128499 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 995/1948] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:37 2022] GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 => generated 1475 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:38.138583 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ca64c0c7-1394-442c-a83e-c49f4e0582f8 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:38.141953 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ca64c0c7-1394-442c-a83e-c49f4e0582f8 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: 51bbcade-43f8-4f2d-a572-3dc9e98aa391] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:38.146652 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ca64c0c7-1394-442c-a83e-c49f4e0582f8 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:38.147521 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ca64c0c7-1394-442c-a83e-c49f4e0582f8 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:38.148096 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ca64c0c7-1394-442c-a83e-c49f4e0582f8 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:38.150433 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ca64c0c7-1394-442c-a83e-c49f4e0582f8 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:38.151111 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ca64c0c7-1394-442c-a83e-c49f4e0582f8 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:38.151718 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ca64c0c7-1394-442c-a83e-c49f4e0582f8 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:38.729523 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ca64c0c7-1394-442c-a83e-c49f4e0582f8 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:38.739823 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ca64c0c7-1394-442c-a83e-c49f4e0582f8 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/51bbcade-43f8-4f2d-a572-3dc9e98aa391" status: 200 len: 1324 microversion: 2.1 time: 0.609973 Oct 30 01:20:38.741246 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 996/1949] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:38 2022] GET /compute/v2.1/servers/51bbcade-43f8-4f2d-a572-3dc9e98aa391 => generated 1324 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:38.747842 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bb2bd2b4-468f-46e7-ab6f-7f343c2f008b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:38.752851 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bb2bd2b4-468f-46e7-ab6f-7f343c2f008b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:38.765032 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb2bd2b4-468f-46e7-ab6f-7f343c2f008b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:38.766966 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb2bd2b4-468f-46e7-ab6f-7f343c2f008b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:38.773313 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb2bd2b4-468f-46e7-ab6f-7f343c2f008b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:38.775945 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb2bd2b4-468f-46e7-ab6f-7f343c2f008b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:38.776445 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb2bd2b4-468f-46e7-ab6f-7f343c2f008b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:38.776888 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb2bd2b4-468f-46e7-ab6f-7f343c2f008b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:39.099617 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bb2bd2b4-468f-46e7-ab6f-7f343c2f008b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:39.115564 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bb2bd2b4-468f-46e7-ab6f-7f343c2f008b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:39.118407 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bb2bd2b4-468f-46e7-ab6f-7f343c2f008b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:39.127895 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bb2bd2b4-468f-46e7-ab6f-7f343c2f008b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1555 microversion: 2.91 time: 0.385086 Oct 30 01:20:39.128867 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 997/1950] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:20:38 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1555 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:20:39.135527 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-1d7c3a22-f7dd-44b6-a72c-45868574c0b7 req-24bf2acd-2532-4239-95c0-eeb2e128148c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7ff7c82-b3f6-4172-be0d-1c67c30db4f7", "name": "network-vif-unplugged", "status": "completed", "tag": "6187e4ac-5fa7-409a-870a-b11e4dc8fc91"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:20:39.146969 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-1d7c3a22-f7dd-44b6-a72c-45868574c0b7 req-24bf2acd-2532-4239-95c0-eeb2e128148c service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:39.147751 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-1d7c3a22-f7dd-44b6-a72c-45868574c0b7 req-24bf2acd-2532-4239-95c0-eeb2e128148c service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:39.148476 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-1d7c3a22-f7dd-44b6-a72c-45868574c0b7 req-24bf2acd-2532-4239-95c0-eeb2e128148c service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:39.153116 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:20:39.167974 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-1d7c3a22-f7dd-44b6-a72c-45868574c0b7 req-24bf2acd-2532-4239-95c0-eeb2e128148c service nova] Creating event network-vif-unplugged:6187e4ac-5fa7-409a-870a-b11e4dc8fc91 for instance e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 on n-h1-master-1 Oct 30 01:20:39.175057 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [req-1d7c3a22-f7dd-44b6-a72c-45868574c0b7 req-24bf2acd-2532-4239-95c0-eeb2e128148c service nova] Instance e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=121102) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 30 01:20:39.193154 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-1d7c3a22-f7dd-44b6-a72c-45868574c0b7 req-24bf2acd-2532-4239-95c0-eeb2e128148c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062606 Oct 30 01:20:39.193786 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 998/1951] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:20:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:20:39.199987 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8ed562e5-c98b-4d0c-b776-bf6baac93f5a tempest-FloatingIPsTestJSON-1385162609 tempest-FloatingIPsTestJSON-1385162609-project] Action: 'create', calling method: .version_select at 0x7f44d04a9280>, body: {"pool": null} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:20:40.682735 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:20:40.769745 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d5f6214b-767c-46ff-8f56-33eab9f8f820 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33/action" status: 202 len: 0 microversion: 2.25 time: 5.975542 Oct 30 01:20:40.770881 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 954/1952] 10.222.0.13 () {62 vars in 1319 bytes} [Sun Oct 30 01:20:34 2022] POST /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33/action => generated 0 bytes in 5977 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:20:40.775928 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4eed8286-d14a-4b3a-9377-4515f67de3e8 tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] Action: 'create', calling method: .version_select at 0x7f44c7c78af0>, body: {"keypair": {"name": "tempest-keypair-1544526916", "type": "x509"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:20:40.795423 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-4eed8286-d14a-4b3a-9377-4515f67de3e8 tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] Getting quotas for project 8b9a5f8165c24556b4769fc2b43a7f1c. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:20:40.801813 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-4eed8286-d14a-4b3a-9377-4515f67de3e8 tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] Getting quotas for user 1e982798802a46b5b880dcc4a99e359b and project 8b9a5f8165c24556b4769fc2b43a7f1c. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:20:40.822247 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.processutils [None req-4eed8286-d14a-4b3a-9377-4515f67de3e8 tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp_pz504gq/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp_pz504gq/temp.key -subj /CN=1e982798802a46b5b880dcc4a99e359b -extensions v3_req_client {{(pid=121103) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 30 01:20:41.049111 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.processutils [None req-4eed8286-d14a-4b3a-9377-4515f67de3e8 tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp_pz504gq/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp_pz504gq/temp.key -subj /CN=1e982798802a46b5b880dcc4a99e359b -extensions v3_req_client" returned: 0 in 0.226s {{(pid=121103) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 30 01:20:41.051492 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.processutils [None req-4eed8286-d14a-4b3a-9377-4515f67de3e8 tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp_pz504gq/temp.key -password pass: {{(pid=121103) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 30 01:20:41.078780 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.processutils [None req-4eed8286-d14a-4b3a-9377-4515f67de3e8 tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp_pz504gq/temp.key -password pass:" returned: 0 in 0.027s {{(pid=121103) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 30 01:20:41.236568 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-4eed8286-d14a-4b3a-9377-4515f67de3e8 tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] Getting quotas for project 8b9a5f8165c24556b4769fc2b43a7f1c. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:20:41.242364 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-4eed8286-d14a-4b3a-9377-4515f67de3e8 tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] Getting quotas for user 1e982798802a46b5b880dcc4a99e359b and project 8b9a5f8165c24556b4769fc2b43a7f1c. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:20:41.251152 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:INSERT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:20:41.259491 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4eed8286-d14a-4b3a-9377-4515f67de3e8 tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.487443 Oct 30 01:20:41.260550 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 955/1953] 10.222.0.13 () {62 vars in 1198 bytes} [Sun Oct 30 01:20:40 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 489 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:20:41.266241 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2adf54fb-581e-42d6-b9c1-b8ce3f241c98 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:41.266950 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2adf54fb-581e-42d6-b9c1-b8ce3f241c98 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: e7ff7c82-b3f6-4172-be0d-1c67c30db4f7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:41.273851 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2adf54fb-581e-42d6-b9c1-b8ce3f241c98 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:41.274900 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2adf54fb-581e-42d6-b9c1-b8ce3f241c98 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:41.275342 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2adf54fb-581e-42d6-b9c1-b8ce3f241c98 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:41.276104 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2adf54fb-581e-42d6-b9c1-b8ce3f241c98 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:41.276557 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2adf54fb-581e-42d6-b9c1-b8ce3f241c98 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:41.276974 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2adf54fb-581e-42d6-b9c1-b8ce3f241c98 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:41.651612 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2adf54fb-581e-42d6-b9c1-b8ce3f241c98 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:41.660252 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2adf54fb-581e-42d6-b9c1-b8ce3f241c98 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7" status: 200 len: 1475 microversion: 2.1 time: 0.398632 Oct 30 01:20:41.661152 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 956/1954] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:41 2022] GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 => generated 1475 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:41.666348 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ee64cd6b-e08f-4631-84a6-f746c917506d tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:41.666964 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ee64cd6b-e08f-4631-84a6-f746c917506d tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: 51bbcade-43f8-4f2d-a572-3dc9e98aa391] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:41.673541 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ee64cd6b-e08f-4631-84a6-f746c917506d tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:41.674425 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ee64cd6b-e08f-4631-84a6-f746c917506d tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:41.675103 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ee64cd6b-e08f-4631-84a6-f746c917506d tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:41.676123 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ee64cd6b-e08f-4631-84a6-f746c917506d tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:41.676795 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ee64cd6b-e08f-4631-84a6-f746c917506d tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:41.677447 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ee64cd6b-e08f-4631-84a6-f746c917506d tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:41.896998 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ee64cd6b-e08f-4631-84a6-f746c917506d tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:41.906440 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ee64cd6b-e08f-4631-84a6-f746c917506d tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/51bbcade-43f8-4f2d-a572-3dc9e98aa391" status: 200 len: 1324 microversion: 2.1 time: 0.244146 Oct 30 01:20:41.908586 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 957/1955] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:41 2022] GET /compute/v2.1/servers/51bbcade-43f8-4f2d-a572-3dc9e98aa391 => generated 1324 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:41.912227 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7492cbb9-a547-4c6c-a6bf-0495893e8737 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:41.913004 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7492cbb9-a547-4c6c-a6bf-0495893e8737 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:41.919226 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7492cbb9-a547-4c6c-a6bf-0495893e8737 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:41.919743 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7492cbb9-a547-4c6c-a6bf-0495893e8737 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:41.920363 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7492cbb9-a547-4c6c-a6bf-0495893e8737 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:41.921305 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7492cbb9-a547-4c6c-a6bf-0495893e8737 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:41.921964 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7492cbb9-a547-4c6c-a6bf-0495893e8737 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:41.922559 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7492cbb9-a547-4c6c-a6bf-0495893e8737 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:41.952860 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7492cbb9-a547-4c6c-a6bf-0495893e8737 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:20:42.224470 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7492cbb9-a547-4c6c-a6bf-0495893e8737 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd" status: 204 len: 0 microversion: 2.1 time: 0.315803 Oct 30 01:20:42.225084 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 958/1956] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:20:41 2022] DELETE /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:20:42.231271 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-885d0c47-de5c-43ae-b15a-60b92b38ece2 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:42.231982 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-885d0c47-de5c-43ae-b15a-60b92b38ece2 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:42.238376 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-885d0c47-de5c-43ae-b15a-60b92b38ece2 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:42.238973 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-885d0c47-de5c-43ae-b15a-60b92b38ece2 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:42.239409 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-885d0c47-de5c-43ae-b15a-60b92b38ece2 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:42.240125 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-885d0c47-de5c-43ae-b15a-60b92b38ece2 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:42.240580 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-885d0c47-de5c-43ae-b15a-60b92b38ece2 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:42.241007 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-885d0c47-de5c-43ae-b15a-60b92b38ece2 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:42.300435 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8ed562e5-c98b-4d0c-b776-bf6baac93f5a tempest-FloatingIPsTestJSON-1385162609 tempest-FloatingIPsTestJSON-1385162609-project] 10.222.0.13 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.105344 Oct 30 01:20:42.301410 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 999/1957] 10.222.0.13 () {60 vars in 1170 bytes} [Sun Oct 30 01:20:39 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:20:42.306940 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3e09eafe-b2ff-4e79-9fee-b3cbefac09ae tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:42.308324 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3e09eafe-b2ff-4e79-9fee-b3cbefac09ae tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 5ed38927-680d-4e93-b57a-21fb407c6b33] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:42.315142 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3e09eafe-b2ff-4e79-9fee-b3cbefac09ae tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:42.315599 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3e09eafe-b2ff-4e79-9fee-b3cbefac09ae tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:42.316032 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3e09eafe-b2ff-4e79-9fee-b3cbefac09ae tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:42.316899 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3e09eafe-b2ff-4e79-9fee-b3cbefac09ae tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:42.317381 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3e09eafe-b2ff-4e79-9fee-b3cbefac09ae tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:42.317936 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-885d0c47-de5c-43ae-b15a-60b92b38ece2 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:42.318080 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3e09eafe-b2ff-4e79-9fee-b3cbefac09ae tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:42.326585 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-885d0c47-de5c-43ae-b15a-60b92b38ece2 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:42.328422 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-885d0c47-de5c-43ae-b15a-60b92b38ece2 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:42.333530 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-885d0c47-de5c-43ae-b15a-60b92b38ece2 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1540 microversion: 2.91 time: 0.107209 Oct 30 01:20:42.334356 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 959/1958] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:20:42 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1540 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:20:42.338660 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-793e6828-2eeb-48cc-9616-89a32c5e22bc tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] Calling method '.version_select at 0x7f44c7a98b80>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:42.347989 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-793e6828-2eeb-48cc-9616-89a32c5e22bc tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] 10.222.0.13 "GET /compute/v2.1/os-keypairs/tempest-keypair-1544526916" status: 200 len: 1534 microversion: 2.2 time: 0.012694 Oct 30 01:20:42.348868 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 960/1959] 10.222.0.13 () {60 vars in 1258 bytes} [Sun Oct 30 01:20:42 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1544526916 => generated 1534 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:42.354150 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-5014af4a-98da-423c-8ac0-22326c89edb8 req-0f0ed844-e51e-44de-993b-b13b24170fe2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7ff7c82-b3f6-4172-be0d-1c67c30db4f7", "tag": "6187e4ac-5fa7-409a-870a-b11e4dc8fc91"}, {"name": "network-changed", "server_uuid": "51bbcade-43f8-4f2d-a572-3dc9e98aa391", "tag": "0ea2c6d3-efc2-4811-88e6-b4727e52617a"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:20:42.365172 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-5014af4a-98da-423c-8ac0-22326c89edb8 req-0f0ed844-e51e-44de-993b-b13b24170fe2 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:42.365706 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-5014af4a-98da-423c-8ac0-22326c89edb8 req-0f0ed844-e51e-44de-993b-b13b24170fe2 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:42.366139 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-5014af4a-98da-423c-8ac0-22326c89edb8 req-0f0ed844-e51e-44de-993b-b13b24170fe2 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:42.371234 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:20:42.381501 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-5014af4a-98da-423c-8ac0-22326c89edb8 req-0f0ed844-e51e-44de-993b-b13b24170fe2 service nova] Creating event network-changed:6187e4ac-5fa7-409a-870a-b11e4dc8fc91 for instance e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 on n-h1-master-1 Oct 30 01:20:42.382048 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-5014af4a-98da-423c-8ac0-22326c89edb8 req-0f0ed844-e51e-44de-993b-b13b24170fe2 service nova] Creating event network-changed:0ea2c6d3-efc2-4811-88e6-b4727e52617a for instance 51bbcade-43f8-4f2d-a572-3dc9e98aa391 on n-h2-master-1 Oct 30 01:20:42.388046 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [req-5014af4a-98da-423c-8ac0-22326c89edb8 req-0f0ed844-e51e-44de-993b-b13b24170fe2 service nova] Instance e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=121103) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 30 01:20:42.401403 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-5014af4a-98da-423c-8ac0-22326c89edb8 req-0f0ed844-e51e-44de-993b-b13b24170fe2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.051121 Oct 30 01:20:42.401965 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 961/1960] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:20:42 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:20:42.407127 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d6f928fa-50ee-41ef-9a94-35334d8cd720 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:42.407816 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d6f928fa-50ee-41ef-9a94-35334d8cd720 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:42.415465 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d6f928fa-50ee-41ef-9a94-35334d8cd720 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:42.416043 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d6f928fa-50ee-41ef-9a94-35334d8cd720 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:42.416642 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d6f928fa-50ee-41ef-9a94-35334d8cd720 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:42.417262 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d6f928fa-50ee-41ef-9a94-35334d8cd720 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:42.417695 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d6f928fa-50ee-41ef-9a94-35334d8cd720 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:42.418111 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d6f928fa-50ee-41ef-9a94-35334d8cd720 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:42.453657 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3e09eafe-b2ff-4e79-9fee-b3cbefac09ae tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:42.462231 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3e09eafe-b2ff-4e79-9fee-b3cbefac09ae tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:42.463701 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3e09eafe-b2ff-4e79-9fee-b3cbefac09ae tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:42.464891 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3e09eafe-b2ff-4e79-9fee-b3cbefac09ae tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33" status: 200 len: 1485 microversion: 2.25 time: 0.162488 Oct 30 01:20:42.465478 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1000/1961] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:20:42 2022] GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33 => generated 1485 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:20:42.470409 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d262aa1a-4d5f-4da3-818c-dda0d44d9201 tempest-FloatingIPsTestJSON-1385162609 tempest-FloatingIPsTestJSON-1385162609-project] Calling method '.version_select at 0x7f44d051b280>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:42.647150 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d6f928fa-50ee-41ef-9a94-35334d8cd720 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:42.656157 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d6f928fa-50ee-41ef-9a94-35334d8cd720 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd" status: 200 len: 1666 microversion: 2.1 time: 0.253031 Oct 30 01:20:42.656995 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 962/1962] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:42 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd => generated 1666 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:42.666914 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7587569d-a987-4ca1-84ac-7c17938b4c14 tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] Calling method '.version_select at 0x7f44c7de6550>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:42.670865 n-d-master-1 devstack@n-api.service[121103]: WARNING oslo_db.sqlalchemy.utils [None req-7587569d-a987-4ca1-84ac-7c17938b4c14 tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 30 01:20:42.676326 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7587569d-a987-4ca1-84ac-7c17938b4c14 tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] 10.222.0.13 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.013699 Oct 30 01:20:42.677201 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 963/1963] 10.222.0.13 () {60 vars in 1177 bytes} [Sun Oct 30 01:20:42 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:42.687441 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-83d106d4-7c2a-41ed-9609-f17ec0585482 tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-master-1"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:20:42.689891 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-83d106d4-7c2a-41ed-9609-f17ec0585482 tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:42.696283 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-83d106d4-7c2a-41ed-9609-f17ec0585482 tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:42.696767 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-83d106d4-7c2a-41ed-9609-f17ec0585482 tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:42.697276 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-83d106d4-7c2a-41ed-9609-f17ec0585482 tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:42.698001 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-83d106d4-7c2a-41ed-9609-f17ec0585482 tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:42.698450 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-83d106d4-7c2a-41ed-9609-f17ec0585482 tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:42.698870 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-83d106d4-7c2a-41ed-9609-f17ec0585482 tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:42.751232 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-83d106d4-7c2a-41ed-9609-f17ec0585482 tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-master-1". {{(pid=121103) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 30 01:20:43.055599 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-83d106d4-7c2a-41ed-9609-f17ec0585482 tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d/action" status: 202 len: 0 microversion: 2.91 time: 0.371856 Oct 30 01:20:43.059951 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 964/1964] 10.222.0.13 () {62 vars in 1319 bytes} [Sun Oct 30 01:20:42 2022] POST /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d/action => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:20:43.066728 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-868a80f7-c3ec-4f5f-86b5-da31e5e610c9 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:43.066728 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-868a80f7-c3ec-4f5f-86b5-da31e5e610c9 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: e7ff7c82-b3f6-4172-be0d-1c67c30db4f7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:43.073993 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-868a80f7-c3ec-4f5f-86b5-da31e5e610c9 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:43.074543 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-868a80f7-c3ec-4f5f-86b5-da31e5e610c9 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:43.075080 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-868a80f7-c3ec-4f5f-86b5-da31e5e610c9 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:43.075882 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-868a80f7-c3ec-4f5f-86b5-da31e5e610c9 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:43.076428 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-868a80f7-c3ec-4f5f-86b5-da31e5e610c9 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:43.076947 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-868a80f7-c3ec-4f5f-86b5-da31e5e610c9 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:43.377707 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-868a80f7-c3ec-4f5f-86b5-da31e5e610c9 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:43.386729 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-868a80f7-c3ec-4f5f-86b5-da31e5e610c9 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7" status: 200 len: 1473 microversion: 2.1 time: 0.325813 Oct 30 01:20:43.387452 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 965/1965] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:43 2022] GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 => generated 1473 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:43.392528 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2a8cab47-ebe5-4f57-a2fa-8ff8fcfc0d52 tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] Calling method '.version_select at 0x7f44c7b60040>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:43.506440 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2a8cab47-ebe5-4f57-a2fa-8ff8fcfc0d52 tempest-KeyPairsV22TestJSON-1343234951 tempest-KeyPairsV22TestJSON-1343234951-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1544526916" status: 204 len: 0 microversion: 2.2 time: 0.117775 Oct 30 01:20:43.507310 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 966/1966] 10.222.0.13 () {60 vars in 1261 bytes} [Sun Oct 30 01:20:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1544526916 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:20:43.516105 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-118f66a3-bf42-442a-b3c2-a93bd315bc78 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:43.516733 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-118f66a3-bf42-442a-b3c2-a93bd315bc78 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: 51bbcade-43f8-4f2d-a572-3dc9e98aa391] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:43.524817 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-118f66a3-bf42-442a-b3c2-a93bd315bc78 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:43.525311 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-118f66a3-bf42-442a-b3c2-a93bd315bc78 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:43.525784 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-118f66a3-bf42-442a-b3c2-a93bd315bc78 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:43.526496 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-118f66a3-bf42-442a-b3c2-a93bd315bc78 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:43.526950 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-118f66a3-bf42-442a-b3c2-a93bd315bc78 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:43.527375 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-118f66a3-bf42-442a-b3c2-a93bd315bc78 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:43.658853 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d262aa1a-4d5f-4da3-818c-dda0d44d9201 tempest-FloatingIPsTestJSON-1385162609 tempest-FloatingIPsTestJSON-1385162609-project] 10.222.0.13 "DELETE /compute/v2.1/os-floating-ips/7cc3f207-2393-4f67-abe2-ffbef37464b7" status: 202 len: 0 microversion: 2.1 time: 1.192109 Oct 30 01:20:43.660418 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1001/1967] 10.222.0.13 () {58 vars in 1263 bytes} [Sun Oct 30 01:20:42 2022] DELETE /compute/v2.1/os-floating-ips/7cc3f207-2393-4f67-abe2-ffbef37464b7 => generated 0 bytes in 1194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:20:43.666685 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-dadba3bd-06d1-43c2-a28e-285d6e7640e3 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:43.667635 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-dadba3bd-06d1-43c2-a28e-285d6e7640e3 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:43.677150 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dadba3bd-06d1-43c2-a28e-285d6e7640e3 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:43.678106 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dadba3bd-06d1-43c2-a28e-285d6e7640e3 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:43.679103 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dadba3bd-06d1-43c2-a28e-285d6e7640e3 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:43.680974 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dadba3bd-06d1-43c2-a28e-285d6e7640e3 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:43.682606 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dadba3bd-06d1-43c2-a28e-285d6e7640e3 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:43.683469 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dadba3bd-06d1-43c2-a28e-285d6e7640e3 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:43.835353 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-dadba3bd-06d1-43c2-a28e-285d6e7640e3 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:43.851154 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-dadba3bd-06d1-43c2-a28e-285d6e7640e3 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:43.854727 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-dadba3bd-06d1-43c2-a28e-285d6e7640e3 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:43.863346 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-dadba3bd-06d1-43c2-a28e-285d6e7640e3 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1548 microversion: 2.91 time: 0.200327 Oct 30 01:20:43.864672 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1002/1968] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:20:43 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1548 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:20:43.871109 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7d53b456-9083-4638-b9ed-8a6dfe037515 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:43.871773 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7d53b456-9083-4638-b9ed-8a6dfe037515 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 5ed38927-680d-4e93-b57a-21fb407c6b33] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:43.879060 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7d53b456-9083-4638-b9ed-8a6dfe037515 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:43.880170 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7d53b456-9083-4638-b9ed-8a6dfe037515 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:43.880987 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7d53b456-9083-4638-b9ed-8a6dfe037515 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:43.882946 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7d53b456-9083-4638-b9ed-8a6dfe037515 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:43.884263 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7d53b456-9083-4638-b9ed-8a6dfe037515 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:43.885097 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7d53b456-9083-4638-b9ed-8a6dfe037515 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:43.916349 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=30 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:20:44.032011 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-118f66a3-bf42-442a-b3c2-a93bd315bc78 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:44.040075 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-118f66a3-bf42-442a-b3c2-a93bd315bc78 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/51bbcade-43f8-4f2d-a572-3dc9e98aa391" status: 200 len: 1324 microversion: 2.1 time: 0.531187 Oct 30 01:20:44.053907 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 967/1969] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:43 2022] GET /compute/v2.1/servers/51bbcade-43f8-4f2d-a572-3dc9e98aa391 => generated 1324 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:44.065980 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-53265fad-fb55-434c-81ef-be0e76cd2c8c tempest-FloatingIPsTestJSON-1385162609 tempest-FloatingIPsTestJSON-1385162609-project] Calling method '.version_select at 0x7f44c7b605e0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:44.519589 n-d-master-1 devstack@n-api.service[121103]: DEBUG neutronclient.v2_0.client [None req-53265fad-fb55-434c-81ef-be0e76cd2c8c tempest-FloatingIPsTestJSON-1385162609 tempest-FloatingIPsTestJSON-1385162609-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 7cc3f207-2393-4f67-abe2-ffbef37464b7 could not be found", "detail": ""}} {{(pid=121103) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 30 01:20:44.520923 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-53265fad-fb55-434c-81ef-be0e76cd2c8c tempest-FloatingIPsTestJSON-1385162609 tempest-FloatingIPsTestJSON-1385162609-project] HTTP exception thrown: Floating IP not found for ID 7cc3f207-2393-4f67-abe2-ffbef37464b7 Oct 30 01:20:44.524989 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-53265fad-fb55-434c-81ef-be0e76cd2c8c tempest-FloatingIPsTestJSON-1385162609 tempest-FloatingIPsTestJSON-1385162609-project] Request method failure captured: Oct 30 01:20:44.524989 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/os-floating-ips/7cc3f207-2393-4f67-abe2-ffbef37464b7 HTTP/1.1 Oct 30 01:20:44.524989 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:20:44.524989 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:20:44.524989 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:20:44.524989 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:20:44.524989 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:20:44.524989 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:20:44.524989 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:20:44.524989 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:20:44.524989 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdFb6cz4wSnzcz9xQrMZVpnmcuSvCqLFypkIOrlcUvMPGTgdAaB6mIGLBaD18ZbGxjq9pIjrc6vWyDFDoAmQTyMj6rusPxuom2oQ9erHtv7HDefSUhIaRvpSw1N8egJjjTwBJMhytAbCf7OYCzvwyZjiCm52LvhqJX178CfadahY2XI Oct 30 01:20:44.524989 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:20:44.524989 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:20:44.524989 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:20:44.524989 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:20:44.524989 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:20:44.524989 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:20:44.524989 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 8c4168ae431b492fa5f8bfbb637e039b Oct 30 01:20:44.524989 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-FloatingIPsTestJSON-1385162609 Oct 30 01:20:44.524989 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:20:44.524989 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:20:44.526949 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c4168ae431b492fa5f8bfbb637e039b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8c4168ae431b492fa5f8bfbb637e039b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8c4168ae431b492fa5f8bfbb637e039b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c4168ae431b492fa5f8bfbb637e039b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:20:44.526949 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-FloatingIPsTestJSON-1385162609 Oct 30 01:20:44.526949 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 8c4168ae431b492fa5f8bfbb637e039b Oct 30 01:20:44.526949 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1385162609 Oct 30 01:20:44.526949 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-FloatingIPsTestJSON-1385162609-project Oct 30 01:20:44.526949 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:20:44.526949 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:20:44.526949 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: a4cc56ce5e3c4a20b574d42a974a6faa Oct 30 01:20:44.526949 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-FloatingIPsTestJSON-1385162609-project Oct 30 01:20:44.526949 n-d-master-1 devstack@n-api.service[121103]: method: Oct 30 01:20:44.526949 n-d-master-1 devstack@n-api.service[121103]: exception: Floating IP not found for ID 7cc3f207-2393-4f67-abe2-ffbef37464b7 Oct 30 01:20:44.526949 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '7cc3f207-2393-4f67-abe2-ffbef37464b7'} Oct 30 01:20:44.526949 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:20:44.528108 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:44.528108 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 30 01:20:44.528108 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 30 01:20:44.528108 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:20:44.528108 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:20:44.528108 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 30 01:20:44.528108 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 30 01:20:44.528108 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:20:44.528108 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:20:44.528108 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 30 01:20:44.528108 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 30 01:20:44.528108 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:20:44.528108 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:20:44.528108 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 30 01:20:44.528108 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 30 01:20:44.528108 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:20:44.528108 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:20:44.528108 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 30 01:20:44.528108 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 30 01:20:44.530513 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:20:44.530513 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:20:44.530513 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 30 01:20:44.530513 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 30 01:20:44.530513 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 30 01:20:44.530513 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 30 01:20:44.530513 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 7cc3f207-2393-4f67-abe2-ffbef37464b7 could not be found Oct 30 01:20:44.530513 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-12272e1e-4622-4169-8994-73e787699de0'] Oct 30 01:20:44.530513 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:20:44.530513 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:44.530513 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:20:44.530513 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:44.530513 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 30 01:20:44.530513 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 30 01:20:44.530513 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 30 01:20:44.530513 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 30 01:20:44.530513 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 7cc3f207-2393-4f67-abe2-ffbef37464b7. Oct 30 01:20:44.530513 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:20:44.530513 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:44.530513 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:20:44.532414 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:44.532414 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:20:44.532414 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:20:44.532414 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:20:44.532414 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:20:44.532414 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:20:44.532414 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:20:44.532414 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:20:44.532414 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:20:44.532414 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 30 01:20:44.532414 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 30 01:20:44.532414 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 7cc3f207-2393-4f67-abe2-ffbef37464b7 Oct 30 01:20:44.532414 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:20:44.532414 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:44.532414 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:20:44.532414 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:44.532414 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:20:44.532414 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:20:44.532414 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:20:44.532414 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:20:44.534738 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 7cc3f207-2393-4f67-abe2-ffbef37464b7 Oct 30 01:20:44.534738 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:20:44.542690 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-53265fad-fb55-434c-81ef-be0e76cd2c8c tempest-FloatingIPsTestJSON-1385162609 tempest-FloatingIPsTestJSON-1385162609-project] Returning 404 to user: Floating IP not found for ID 7cc3f207-2393-4f67-abe2-ffbef37464b7 {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:20:44.542690 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-53265fad-fb55-434c-81ef-be0e76cd2c8c tempest-FloatingIPsTestJSON-1385162609 tempest-FloatingIPsTestJSON-1385162609-project] 10.222.0.13 "GET /compute/v2.1/os-floating-ips/7cc3f207-2393-4f67-abe2-ffbef37464b7" status: 404 len: 111 microversion: 2.1 time: 0.482265 Oct 30 01:20:44.542690 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 968/1970] 10.222.0.13 () {58 vars in 1260 bytes} [Sun Oct 30 01:20:44 2022] GET /compute/v2.1/os-floating-ips/7cc3f207-2393-4f67-abe2-ffbef37464b7 => generated 111 bytes in 483 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:20:44.549484 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-52d63ab4-e83d-41a2-a0b4-9a841e14713b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:44.550398 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-52d63ab4-e83d-41a2-a0b4-9a841e14713b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:44.560524 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52d63ab4-e83d-41a2-a0b4-9a841e14713b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:44.561323 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52d63ab4-e83d-41a2-a0b4-9a841e14713b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:44.561801 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52d63ab4-e83d-41a2-a0b4-9a841e14713b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:44.562528 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52d63ab4-e83d-41a2-a0b4-9a841e14713b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:44.562984 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52d63ab4-e83d-41a2-a0b4-9a841e14713b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:44.563423 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52d63ab4-e83d-41a2-a0b4-9a841e14713b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:44.571222 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7d53b456-9083-4638-b9ed-8a6dfe037515 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:44.580938 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7d53b456-9083-4638-b9ed-8a6dfe037515 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:44.583080 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7d53b456-9083-4638-b9ed-8a6dfe037515 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:44.584636 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7d53b456-9083-4638-b9ed-8a6dfe037515 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33" status: 200 len: 1485 microversion: 2.25 time: 0.718648 Oct 30 01:20:44.604098 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1003/1971] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:20:43 2022] GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33 => generated 1485 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:20:44.609474 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c22b9313-8512-4ad6-8b22-4ea959edc86b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:44.610452 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c22b9313-8512-4ad6-8b22-4ea959edc86b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: e7ff7c82-b3f6-4172-be0d-1c67c30db4f7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:44.617379 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c22b9313-8512-4ad6-8b22-4ea959edc86b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:44.617952 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c22b9313-8512-4ad6-8b22-4ea959edc86b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:44.619017 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c22b9313-8512-4ad6-8b22-4ea959edc86b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:44.619784 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c22b9313-8512-4ad6-8b22-4ea959edc86b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:44.620246 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c22b9313-8512-4ad6-8b22-4ea959edc86b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:44.620691 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c22b9313-8512-4ad6-8b22-4ea959edc86b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:44.646048 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:20:44.755067 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-52d63ab4-e83d-41a2-a0b4-9a841e14713b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:44.767340 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-52d63ab4-e83d-41a2-a0b4-9a841e14713b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd" status: 200 len: 1666 microversion: 2.1 time: 0.222777 Oct 30 01:20:44.771112 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 969/1972] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:44 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd => generated 1666 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:44.777473 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7feb55dd-844a-4a20-b777-f81fa67d1922 tempest-FloatingIPsTestJSON-1385162609 tempest-FloatingIPsTestJSON-1385162609-project] Calling method '.version_select at 0x7f44c7c78310>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:44.831573 n-d-master-1 devstack@n-api.service[121103]: DEBUG neutronclient.v2_0.client [None req-7feb55dd-844a-4a20-b777-f81fa67d1922 tempest-FloatingIPsTestJSON-1385162609 tempest-FloatingIPsTestJSON-1385162609-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 7cc3f207-2393-4f67-abe2-ffbef37464b7 could not be found", "detail": ""}} {{(pid=121103) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 30 01:20:44.832740 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-7feb55dd-844a-4a20-b777-f81fa67d1922 tempest-FloatingIPsTestJSON-1385162609 tempest-FloatingIPsTestJSON-1385162609-project] HTTP exception thrown: Floating IP not found for ID 7cc3f207-2393-4f67-abe2-ffbef37464b7 Oct 30 01:20:44.835180 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7feb55dd-844a-4a20-b777-f81fa67d1922 tempest-FloatingIPsTestJSON-1385162609 tempest-FloatingIPsTestJSON-1385162609-project] Request method failure captured: Oct 30 01:20:44.835180 n-d-master-1 devstack@n-api.service[121103]: request: DELETE /compute/v2.1/os-floating-ips/7cc3f207-2393-4f67-abe2-ffbef37464b7 HTTP/1.1 Oct 30 01:20:44.835180 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:20:44.835180 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:20:44.835180 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:20:44.835180 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:20:44.835180 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:20:44.835180 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:20:44.835180 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:20:44.835180 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:20:44.835180 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdFb6cz4wSnzcz9xQrMZVpnmcuSvCqLFypkIOrlcUvMPGTgdAaB6mIGLBaD18ZbGxjq9pIjrc6vWyDFDoAmQTyMj6rusPxuom2oQ9erHtv7HDefSUhIaRvpSw1N8egJjjTwBJMhytAbCf7OYCzvwyZjiCm52LvhqJX178CfadahY2XI Oct 30 01:20:44.835180 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:20:44.835180 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:20:44.835180 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:20:44.835180 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:20:44.835180 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:20:44.835180 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:20:44.835180 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 8c4168ae431b492fa5f8bfbb637e039b Oct 30 01:20:44.835180 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-FloatingIPsTestJSON-1385162609 Oct 30 01:20:44.835180 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:20:44.835180 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:20:44.837794 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c4168ae431b492fa5f8bfbb637e039b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8c4168ae431b492fa5f8bfbb637e039b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8c4168ae431b492fa5f8bfbb637e039b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c4168ae431b492fa5f8bfbb637e039b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:20:44.837794 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-FloatingIPsTestJSON-1385162609 Oct 30 01:20:44.837794 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 8c4168ae431b492fa5f8bfbb637e039b Oct 30 01:20:44.837794 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1385162609 Oct 30 01:20:44.837794 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-FloatingIPsTestJSON-1385162609-project Oct 30 01:20:44.837794 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:20:44.837794 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:20:44.837794 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: a4cc56ce5e3c4a20b574d42a974a6faa Oct 30 01:20:44.837794 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-FloatingIPsTestJSON-1385162609-project Oct 30 01:20:44.837794 n-d-master-1 devstack@n-api.service[121103]: method: Oct 30 01:20:44.837794 n-d-master-1 devstack@n-api.service[121103]: exception: Floating IP not found for ID 7cc3f207-2393-4f67-abe2-ffbef37464b7 Oct 30 01:20:44.837794 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '7cc3f207-2393-4f67-abe2-ffbef37464b7'} Oct 30 01:20:44.837794 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:20:44.839109 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:44.839109 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 30 01:20:44.839109 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 30 01:20:44.839109 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:20:44.839109 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:20:44.839109 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 30 01:20:44.839109 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 30 01:20:44.839109 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:20:44.839109 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:20:44.839109 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 30 01:20:44.839109 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 30 01:20:44.839109 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:20:44.839109 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:20:44.839109 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 30 01:20:44.839109 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 30 01:20:44.839109 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:20:44.839109 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:20:44.839109 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 30 01:20:44.839109 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 30 01:20:44.840962 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:20:44.840962 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:20:44.840962 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 30 01:20:44.840962 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 30 01:20:44.840962 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 30 01:20:44.840962 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 30 01:20:44.840962 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 7cc3f207-2393-4f67-abe2-ffbef37464b7 could not be found Oct 30 01:20:44.840962 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ca7c6a4a-b56c-4e50-81b0-cd208d941e20'] Oct 30 01:20:44.840962 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:20:44.840962 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:44.840962 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:20:44.840962 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:44.840962 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 30 01:20:44.840962 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 30 01:20:44.840962 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 30 01:20:44.840962 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 30 01:20:44.840962 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 7cc3f207-2393-4f67-abe2-ffbef37464b7. Oct 30 01:20:44.840962 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:20:44.840962 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:44.840962 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:20:44.845065 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:44.845065 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:20:44.845065 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:20:44.845065 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:20:44.845065 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:20:44.845065 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:20:44.845065 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:20:44.845065 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:20:44.845065 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:20:44.845065 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 30 01:20:44.845065 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 30 01:20:44.845065 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 7cc3f207-2393-4f67-abe2-ffbef37464b7 Oct 30 01:20:44.845065 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:20:44.845065 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:44.845065 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:20:44.845065 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:44.845065 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:20:44.845065 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:20:44.845065 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:20:44.845065 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:20:44.847228 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 7cc3f207-2393-4f67-abe2-ffbef37464b7 Oct 30 01:20:44.847228 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:20:44.847228 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7feb55dd-844a-4a20-b777-f81fa67d1922 tempest-FloatingIPsTestJSON-1385162609 tempest-FloatingIPsTestJSON-1385162609-project] Returning 404 to user: Floating IP not found for ID 7cc3f207-2393-4f67-abe2-ffbef37464b7 {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:20:44.848312 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7feb55dd-844a-4a20-b777-f81fa67d1922 tempest-FloatingIPsTestJSON-1385162609 tempest-FloatingIPsTestJSON-1385162609-project] 10.222.0.13 "DELETE /compute/v2.1/os-floating-ips/7cc3f207-2393-4f67-abe2-ffbef37464b7" status: 404 len: 111 microversion: 2.1 time: 0.075823 Oct 30 01:20:44.848995 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 970/1973] 10.222.0.13 () {58 vars in 1263 bytes} [Sun Oct 30 01:20:44 2022] DELETE /compute/v2.1/os-floating-ips/7cc3f207-2393-4f67-abe2-ffbef37464b7 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:20:44.879535 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c22b9313-8512-4ad6-8b22-4ea959edc86b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:44.901170 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4859299a-1aee-42c8-88f2-e79e4423f3d0 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:44.901997 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4859299a-1aee-42c8-88f2-e79e4423f3d0 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:44.904746 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c22b9313-8512-4ad6-8b22-4ea959edc86b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7" status: 200 len: 1473 microversion: 2.1 time: 0.299127 Oct 30 01:20:44.907281 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1004/1974] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:44 2022] GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 => generated 1473 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:44.938744 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4859299a-1aee-42c8-88f2-e79e4423f3d0 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:44.939524 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4859299a-1aee-42c8-88f2-e79e4423f3d0 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:44.941131 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4859299a-1aee-42c8-88f2-e79e4423f3d0 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:44.943126 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4859299a-1aee-42c8-88f2-e79e4423f3d0 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:44.944010 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4859299a-1aee-42c8-88f2-e79e4423f3d0 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:44.944613 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4859299a-1aee-42c8-88f2-e79e4423f3d0 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:45.030499 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4859299a-1aee-42c8-88f2-e79e4423f3d0 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:45.041143 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4859299a-1aee-42c8-88f2-e79e4423f3d0 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:45.042631 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4859299a-1aee-42c8-88f2-e79e4423f3d0 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:45.052737 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4859299a-1aee-42c8-88f2-e79e4423f3d0 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1548 microversion: 2.91 time: 0.161451 Oct 30 01:20:45.055671 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 971/1975] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:20:44 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1548 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:20:45.068116 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7427df88-1ee6-491b-94b5-66324524151c tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:45.069612 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7427df88-1ee6-491b-94b5-66324524151c tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: 51bbcade-43f8-4f2d-a572-3dc9e98aa391] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:45.078712 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7427df88-1ee6-491b-94b5-66324524151c tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:45.079637 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7427df88-1ee6-491b-94b5-66324524151c tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:45.080181 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7427df88-1ee6-491b-94b5-66324524151c tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:45.082621 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7427df88-1ee6-491b-94b5-66324524151c tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:45.083546 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7427df88-1ee6-491b-94b5-66324524151c tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:45.084044 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7427df88-1ee6-491b-94b5-66324524151c tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:45.356908 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7427df88-1ee6-491b-94b5-66324524151c tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:45.370687 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7427df88-1ee6-491b-94b5-66324524151c tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/51bbcade-43f8-4f2d-a572-3dc9e98aa391" status: 200 len: 1324 microversion: 2.1 time: 0.307969 Oct 30 01:20:45.371643 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1005/1976] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:45 2022] GET /compute/v2.1/servers/51bbcade-43f8-4f2d-a572-3dc9e98aa391 => generated 1324 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:45.407750 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f49e18df-67f0-483e-8852-3203f7caa7f9 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:45.408416 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f49e18df-67f0-483e-8852-3203f7caa7f9 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 22fce0cc-6498-4b95-b265-a44519f4fd9a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:45.423764 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f49e18df-67f0-483e-8852-3203f7caa7f9 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:45.425582 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f49e18df-67f0-483e-8852-3203f7caa7f9 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:45.425582 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f49e18df-67f0-483e-8852-3203f7caa7f9 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:45.426308 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f49e18df-67f0-483e-8852-3203f7caa7f9 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:45.426988 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f49e18df-67f0-483e-8852-3203f7caa7f9 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:45.427602 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f49e18df-67f0-483e-8852-3203f7caa7f9 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:45.458558 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f49e18df-67f0-483e-8852-3203f7caa7f9 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 22fce0cc-6498-4b95-b265-a44519f4fd9a] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:20:45.611633 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0026bf80-0be1-4a4d-bc51-3c546aec0d7c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:45.612591 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0026bf80-0be1-4a4d-bc51-3c546aec0d7c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 5ed38927-680d-4e93-b57a-21fb407c6b33] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:45.626527 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0026bf80-0be1-4a4d-bc51-3c546aec0d7c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:45.643654 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0026bf80-0be1-4a4d-bc51-3c546aec0d7c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:45.643654 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0026bf80-0be1-4a4d-bc51-3c546aec0d7c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:45.643654 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0026bf80-0be1-4a4d-bc51-3c546aec0d7c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:45.643654 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0026bf80-0be1-4a4d-bc51-3c546aec0d7c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:45.644257 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0026bf80-0be1-4a4d-bc51-3c546aec0d7c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:45.898038 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f49e18df-67f0-483e-8852-3203f7caa7f9 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "DELETE /compute/v2.1/servers/22fce0cc-6498-4b95-b265-a44519f4fd9a" status: 204 len: 0 microversion: 2.1 time: 0.493958 Oct 30 01:20:45.898642 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 972/1977] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:20:45 2022] DELETE /compute/v2.1/servers/22fce0cc-6498-4b95-b265-a44519f4fd9a => generated 0 bytes in 496 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:20:45.907088 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-baf74102-d705-4cf1-90de-4eb95fd3547b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:45.909533 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-baf74102-d705-4cf1-90de-4eb95fd3547b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:45.923021 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-baf74102-d705-4cf1-90de-4eb95fd3547b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:45.923529 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-baf74102-d705-4cf1-90de-4eb95fd3547b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:45.923965 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-baf74102-d705-4cf1-90de-4eb95fd3547b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:45.924687 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-baf74102-d705-4cf1-90de-4eb95fd3547b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:45.925140 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-baf74102-d705-4cf1-90de-4eb95fd3547b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:45.925592 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-baf74102-d705-4cf1-90de-4eb95fd3547b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:45.966159 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0026bf80-0be1-4a4d-bc51-3c546aec0d7c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:45.978772 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0026bf80-0be1-4a4d-bc51-3c546aec0d7c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:45.980870 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0026bf80-0be1-4a4d-bc51-3c546aec0d7c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:45.982424 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0026bf80-0be1-4a4d-bc51-3c546aec0d7c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33" status: 200 len: 1485 microversion: 2.25 time: 0.375230 Oct 30 01:20:45.983535 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1006/1978] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:20:45 2022] GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33 => generated 1485 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:20:46.006024 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9c1f6258-38ca-4811-b901-9c0cfe845f32 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:46.006955 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9c1f6258-38ca-4811-b901-9c0cfe845f32 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 22fce0cc-6498-4b95-b265-a44519f4fd9a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:46.016481 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9c1f6258-38ca-4811-b901-9c0cfe845f32 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:46.017313 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9c1f6258-38ca-4811-b901-9c0cfe845f32 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:46.018162 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9c1f6258-38ca-4811-b901-9c0cfe845f32 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:46.019067 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9c1f6258-38ca-4811-b901-9c0cfe845f32 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:46.019792 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9c1f6258-38ca-4811-b901-9c0cfe845f32 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:46.020879 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9c1f6258-38ca-4811-b901-9c0cfe845f32 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:46.269546 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-baf74102-d705-4cf1-90de-4eb95fd3547b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:46.279643 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-baf74102-d705-4cf1-90de-4eb95fd3547b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd" status: 200 len: 1666 microversion: 2.1 time: 0.379044 Oct 30 01:20:46.280511 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 973/1979] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:45 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd => generated 1666 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:46.299434 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4cb51da9-8fd6-42be-b39c-64a49b02a9eb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:46.300364 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4cb51da9-8fd6-42be-b39c-64a49b02a9eb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: e7ff7c82-b3f6-4172-be0d-1c67c30db4f7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:46.307503 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4cb51da9-8fd6-42be-b39c-64a49b02a9eb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:46.308001 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4cb51da9-8fd6-42be-b39c-64a49b02a9eb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:46.308440 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4cb51da9-8fd6-42be-b39c-64a49b02a9eb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:46.309163 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4cb51da9-8fd6-42be-b39c-64a49b02a9eb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:46.309754 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4cb51da9-8fd6-42be-b39c-64a49b02a9eb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:46.310062 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4cb51da9-8fd6-42be-b39c-64a49b02a9eb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:46.447050 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9c1f6258-38ca-4811-b901-9c0cfe845f32 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:46.459372 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9c1f6258-38ca-4811-b901-9c0cfe845f32 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/22fce0cc-6498-4b95-b265-a44519f4fd9a" status: 200 len: 1554 microversion: 2.1 time: 0.473781 Oct 30 01:20:46.470100 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1007/1980] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:45 2022] GET /compute/v2.1/servers/22fce0cc-6498-4b95-b265-a44519f4fd9a => generated 1554 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:46.485621 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-78414c5f-5f36-493a-994e-1c3214730441 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:46.486349 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-78414c5f-5f36-493a-994e-1c3214730441 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:46.497747 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-78414c5f-5f36-493a-994e-1c3214730441 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:46.498249 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-78414c5f-5f36-493a-994e-1c3214730441 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:46.498695 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-78414c5f-5f36-493a-994e-1c3214730441 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:46.499545 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-78414c5f-5f36-493a-994e-1c3214730441 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:46.499872 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-78414c5f-5f36-493a-994e-1c3214730441 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:46.500298 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-78414c5f-5f36-493a-994e-1c3214730441 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:46.707120 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-78414c5f-5f36-493a-994e-1c3214730441 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:46.718545 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-78414c5f-5f36-493a-994e-1c3214730441 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:46.720003 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-78414c5f-5f36-493a-994e-1c3214730441 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:46.736629 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-78414c5f-5f36-493a-994e-1c3214730441 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1548 microversion: 2.91 time: 0.262935 Oct 30 01:20:46.738029 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1008/1981] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:20:46 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1548 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:20:46.753376 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e9732e30-fc8b-49a7-a7a4-6393820789bd tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:46.754245 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e9732e30-fc8b-49a7-a7a4-6393820789bd tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: 51bbcade-43f8-4f2d-a572-3dc9e98aa391] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:46.760681 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9732e30-fc8b-49a7-a7a4-6393820789bd tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:46.766063 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9732e30-fc8b-49a7-a7a4-6393820789bd tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:46.770863 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9732e30-fc8b-49a7-a7a4-6393820789bd tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:46.770863 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9732e30-fc8b-49a7-a7a4-6393820789bd tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:46.770863 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9732e30-fc8b-49a7-a7a4-6393820789bd tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:46.770863 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9732e30-fc8b-49a7-a7a4-6393820789bd tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:47.016842 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4cb51da9-8fd6-42be-b39c-64a49b02a9eb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:47.041450 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4cb51da9-8fd6-42be-b39c-64a49b02a9eb tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7" status: 200 len: 1470 microversion: 2.1 time: 0.753181 Oct 30 01:20:47.041450 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 974/1982] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:46 2022] GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 => generated 1470 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:47.047402 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-d4d6e684-0b37-419f-9cb2-00913ce83a1f req-69a3d6a8-7a92-45f8-bbd8-acc8fd8f0e2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51bbcade-43f8-4f2d-a572-3dc9e98aa391", "name": "network-vif-plugged", "status": "completed", "tag": "0ea2c6d3-efc2-4811-88e6-b4727e52617a"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:20:47.062076 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d4d6e684-0b37-419f-9cb2-00913ce83a1f req-69a3d6a8-7a92-45f8-bbd8-acc8fd8f0e2e service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:47.064008 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d4d6e684-0b37-419f-9cb2-00913ce83a1f req-69a3d6a8-7a92-45f8-bbd8-acc8fd8f0e2e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:47.064727 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d4d6e684-0b37-419f-9cb2-00913ce83a1f req-69a3d6a8-7a92-45f8-bbd8-acc8fd8f0e2e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:47.088015 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-d4d6e684-0b37-419f-9cb2-00913ce83a1f req-69a3d6a8-7a92-45f8-bbd8-acc8fd8f0e2e service nova] Creating event network-vif-plugged:0ea2c6d3-efc2-4811-88e6-b4727e52617a for instance 51bbcade-43f8-4f2d-a572-3dc9e98aa391 on n-h2-master-1 Oct 30 01:20:47.100671 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-d4d6e684-0b37-419f-9cb2-00913ce83a1f req-69a3d6a8-7a92-45f8-bbd8-acc8fd8f0e2e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059617 Oct 30 01:20:47.103250 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 975/1983] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:20:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:20:47.113422 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3801cb4b-10c5-4182-82bf-1c81ca26fb0a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:47.115125 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3801cb4b-10c5-4182-82bf-1c81ca26fb0a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 5ed38927-680d-4e93-b57a-21fb407c6b33] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:47.134282 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3801cb4b-10c5-4182-82bf-1c81ca26fb0a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:47.135468 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3801cb4b-10c5-4182-82bf-1c81ca26fb0a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:47.136428 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3801cb4b-10c5-4182-82bf-1c81ca26fb0a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:47.137781 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3801cb4b-10c5-4182-82bf-1c81ca26fb0a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:47.140441 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3801cb4b-10c5-4182-82bf-1c81ca26fb0a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:47.141257 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3801cb4b-10c5-4182-82bf-1c81ca26fb0a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:47.263037 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e9732e30-fc8b-49a7-a7a4-6393820789bd tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:47.275028 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e9732e30-fc8b-49a7-a7a4-6393820789bd tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/51bbcade-43f8-4f2d-a572-3dc9e98aa391" status: 200 len: 1324 microversion: 2.1 time: 0.535707 Oct 30 01:20:47.285095 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1009/1984] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:46 2022] GET /compute/v2.1/servers/51bbcade-43f8-4f2d-a572-3dc9e98aa391 => generated 1324 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:47.285095 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a7e7a53c-f441-4b9b-961d-fb039c608d50 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:20:47.285095 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a7e7a53c-f441-4b9b-961d-fb039c608d50 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: e7ff7c82-b3f6-4172-be0d-1c67c30db4f7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:47.293375 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7e7a53c-f441-4b9b-961d-fb039c608d50 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:47.294870 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7e7a53c-f441-4b9b-961d-fb039c608d50 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:47.295320 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7e7a53c-f441-4b9b-961d-fb039c608d50 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:47.299646 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7e7a53c-f441-4b9b-961d-fb039c608d50 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:47.300395 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7e7a53c-f441-4b9b-961d-fb039c608d50 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:47.301803 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7e7a53c-f441-4b9b-961d-fb039c608d50 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:47.652313 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3801cb4b-10c5-4182-82bf-1c81ca26fb0a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:47.675071 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3801cb4b-10c5-4182-82bf-1c81ca26fb0a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:47.692484 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3801cb4b-10c5-4182-82bf-1c81ca26fb0a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:47.694554 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3801cb4b-10c5-4182-82bf-1c81ca26fb0a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33" status: 200 len: 1485 microversion: 2.25 time: 0.589719 Oct 30 01:20:47.713057 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 976/1985] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:20:47 2022] GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33 => generated 1485 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:20:47.731600 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-46334443-cde6-440a-b8ed-719582ab0524 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:47.735701 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-46334443-cde6-440a-b8ed-719582ab0524 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:47.754113 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-46334443-cde6-440a-b8ed-719582ab0524 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:47.755081 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-46334443-cde6-440a-b8ed-719582ab0524 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:47.755773 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-46334443-cde6-440a-b8ed-719582ab0524 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:47.757464 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-46334443-cde6-440a-b8ed-719582ab0524 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:47.759522 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-46334443-cde6-440a-b8ed-719582ab0524 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:47.762369 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-46334443-cde6-440a-b8ed-719582ab0524 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:47.899877 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a7e7a53c-f441-4b9b-961d-fb039c608d50 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "POST /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7/action" status: 202 len: 0 microversion: 2.1 time: 0.621951 Oct 30 01:20:47.902980 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1010/1986] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:20:47 2022] POST /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7/action => generated 0 bytes in 626 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:20:47.915541 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4b852b8f-21bc-4f5b-bc6d-9cbb92c02755 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:47.916447 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4b852b8f-21bc-4f5b-bc6d-9cbb92c02755 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 22fce0cc-6498-4b95-b265-a44519f4fd9a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:47.927741 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b852b8f-21bc-4f5b-bc6d-9cbb92c02755 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:47.929675 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b852b8f-21bc-4f5b-bc6d-9cbb92c02755 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:47.930320 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b852b8f-21bc-4f5b-bc6d-9cbb92c02755 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:47.932514 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b852b8f-21bc-4f5b-bc6d-9cbb92c02755 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:47.934253 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b852b8f-21bc-4f5b-bc6d-9cbb92c02755 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:47.935047 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b852b8f-21bc-4f5b-bc6d-9cbb92c02755 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:48.771130 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4b852b8f-21bc-4f5b-bc6d-9cbb92c02755 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:48.789833 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4b852b8f-21bc-4f5b-bc6d-9cbb92c02755 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/22fce0cc-6498-4b95-b265-a44519f4fd9a" status: 200 len: 1554 microversion: 2.1 time: 0.885183 Oct 30 01:20:48.792217 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1011/1987] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:47 2022] GET /compute/v2.1/servers/22fce0cc-6498-4b95-b265-a44519f4fd9a => generated 1554 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:48.812042 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8fa86b2b-781d-4d2c-bac3-3b4f8dc6db24 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:48.812042 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8fa86b2b-781d-4d2c-bac3-3b4f8dc6db24 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:48.826710 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8fa86b2b-781d-4d2c-bac3-3b4f8dc6db24 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:48.827235 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8fa86b2b-781d-4d2c-bac3-3b4f8dc6db24 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:48.831080 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8fa86b2b-781d-4d2c-bac3-3b4f8dc6db24 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:48.832235 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8fa86b2b-781d-4d2c-bac3-3b4f8dc6db24 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:48.834980 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8fa86b2b-781d-4d2c-bac3-3b4f8dc6db24 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:48.838663 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8fa86b2b-781d-4d2c-bac3-3b4f8dc6db24 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:48.931046 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-46334443-cde6-440a-b8ed-719582ab0524 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:48.943392 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-46334443-cde6-440a-b8ed-719582ab0524 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd" status: 200 len: 1666 microversion: 2.1 time: 1.227791 Oct 30 01:20:48.945653 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 977/1988] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:47 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd => generated 1666 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:48.957414 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-22c2edcf-e5af-4e3b-85b7-c5974ab6b51b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:48.958349 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-22c2edcf-e5af-4e3b-85b7-c5974ab6b51b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: e7ff7c82-b3f6-4172-be0d-1c67c30db4f7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:48.976535 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22c2edcf-e5af-4e3b-85b7-c5974ab6b51b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:48.977989 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22c2edcf-e5af-4e3b-85b7-c5974ab6b51b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:48.978638 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22c2edcf-e5af-4e3b-85b7-c5974ab6b51b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:48.979618 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22c2edcf-e5af-4e3b-85b7-c5974ab6b51b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:48.981249 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22c2edcf-e5af-4e3b-85b7-c5974ab6b51b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:48.982575 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22c2edcf-e5af-4e3b-85b7-c5974ab6b51b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:49.078585 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8fa86b2b-781d-4d2c-bac3-3b4f8dc6db24 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:49.088674 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8fa86b2b-781d-4d2c-bac3-3b4f8dc6db24 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:49.096408 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8fa86b2b-781d-4d2c-bac3-3b4f8dc6db24 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:49.114124 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8fa86b2b-781d-4d2c-bac3-3b4f8dc6db24 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1546 microversion: 2.91 time: 0.317424 Oct 30 01:20:49.125966 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1012/1989] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:20:48 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1546 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:20:49.139036 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-410b0ace-24c0-461b-97e6-28256e8b3d17 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:49.144022 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-410b0ace-24c0-461b-97e6-28256e8b3d17 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: 51bbcade-43f8-4f2d-a572-3dc9e98aa391] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:49.163183 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-410b0ace-24c0-461b-97e6-28256e8b3d17 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:49.164211 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-410b0ace-24c0-461b-97e6-28256e8b3d17 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:49.164655 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-410b0ace-24c0-461b-97e6-28256e8b3d17 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:49.167989 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-410b0ace-24c0-461b-97e6-28256e8b3d17 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:49.168657 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-410b0ace-24c0-461b-97e6-28256e8b3d17 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:49.169182 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-410b0ace-24c0-461b-97e6-28256e8b3d17 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:49.668880 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-22c2edcf-e5af-4e3b-85b7-c5974ab6b51b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:49.680706 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-22c2edcf-e5af-4e3b-85b7-c5974ab6b51b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7" status: 200 len: 1469 microversion: 2.1 time: 0.731172 Oct 30 01:20:49.692433 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 978/1990] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:48 2022] GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 => generated 1469 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:49.692433 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2f0219ec-d436-4ab7-a00a-6a6c188b1e96 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:49.692433 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2f0219ec-d436-4ab7-a00a-6a6c188b1e96 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 5ed38927-680d-4e93-b57a-21fb407c6b33] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:49.700607 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f0219ec-d436-4ab7-a00a-6a6c188b1e96 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:49.700607 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f0219ec-d436-4ab7-a00a-6a6c188b1e96 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:49.700607 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f0219ec-d436-4ab7-a00a-6a6c188b1e96 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:49.700607 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f0219ec-d436-4ab7-a00a-6a6c188b1e96 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:49.701050 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f0219ec-d436-4ab7-a00a-6a6c188b1e96 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:49.703542 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f0219ec-d436-4ab7-a00a-6a6c188b1e96 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:49.801660 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-410b0ace-24c0-461b-97e6-28256e8b3d17 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:49.816630 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-410b0ace-24c0-461b-97e6-28256e8b3d17 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/51bbcade-43f8-4f2d-a572-3dc9e98aa391" status: 200 len: 1520 microversion: 2.1 time: 0.681926 Oct 30 01:20:49.825686 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1013/1991] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:49 2022] GET /compute/v2.1/servers/51bbcade-43f8-4f2d-a572-3dc9e98aa391 => generated 1520 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:49.831139 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-f4aedcae-e886-4cd5-bc41-1216ab754393 req-92217df5-5990-4f3c-bee1-20bea8f94d0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7ff7c82-b3f6-4172-be0d-1c67c30db4f7", "name": "network-vif-plugged", "status": "completed", "tag": "6187e4ac-5fa7-409a-870a-b11e4dc8fc91"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:20:49.852872 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-f4aedcae-e886-4cd5-bc41-1216ab754393 req-92217df5-5990-4f3c-bee1-20bea8f94d0f service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:49.854767 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-f4aedcae-e886-4cd5-bc41-1216ab754393 req-92217df5-5990-4f3c-bee1-20bea8f94d0f service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:49.856806 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-f4aedcae-e886-4cd5-bc41-1216ab754393 req-92217df5-5990-4f3c-bee1-20bea8f94d0f service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:49.882262 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-f4aedcae-e886-4cd5-bc41-1216ab754393 req-92217df5-5990-4f3c-bee1-20bea8f94d0f service nova] Creating event network-vif-plugged:6187e4ac-5fa7-409a-870a-b11e4dc8fc91 for instance e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 on n-h1-master-1 Oct 30 01:20:49.901252 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [req-f4aedcae-e886-4cd5-bc41-1216ab754393 req-92217df5-5990-4f3c-bee1-20bea8f94d0f service nova] Instance e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=121102) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 30 01:20:49.927030 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-f4aedcae-e886-4cd5-bc41-1216ab754393 req-92217df5-5990-4f3c-bee1-20bea8f94d0f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099658 Oct 30 01:20:49.928256 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1014/1992] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:20:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:20:49.934386 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-49b1c8fd-f348-4e51-91d1-00fcc9442ecb req-51bc78e9-9302-4069-ba0d-298126ed1444 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22fce0cc-6498-4b95-b265-a44519f4fd9a", "name": "network-vif-deleted", "tag": "66baa2d3-656a-431a-a07b-408d352ae21e"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:20:49.957790 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-49b1c8fd-f348-4e51-91d1-00fcc9442ecb req-51bc78e9-9302-4069-ba0d-298126ed1444 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:49.958622 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-49b1c8fd-f348-4e51-91d1-00fcc9442ecb req-51bc78e9-9302-4069-ba0d-298126ed1444 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:49.959259 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-49b1c8fd-f348-4e51-91d1-00fcc9442ecb req-51bc78e9-9302-4069-ba0d-298126ed1444 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:50.010383 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-49b1c8fd-f348-4e51-91d1-00fcc9442ecb req-51bc78e9-9302-4069-ba0d-298126ed1444 service nova] Creating event network-vif-deleted:66baa2d3-656a-431a-a07b-408d352ae21e for instance 22fce0cc-6498-4b95-b265-a44519f4fd9a on n-h2-master-1 Oct 30 01:20:50.022258 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-49b1c8fd-f348-4e51-91d1-00fcc9442ecb req-51bc78e9-9302-4069-ba0d-298126ed1444 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090889 Oct 30 01:20:50.024487 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1015/1993] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:20:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:20:50.051851 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6af788ba-42e6-4a2d-8ad5-7a35bc7b420f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:50.053599 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6af788ba-42e6-4a2d-8ad5-7a35bc7b420f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 22fce0cc-6498-4b95-b265-a44519f4fd9a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:50.070183 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6af788ba-42e6-4a2d-8ad5-7a35bc7b420f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:50.070713 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6af788ba-42e6-4a2d-8ad5-7a35bc7b420f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:50.071219 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6af788ba-42e6-4a2d-8ad5-7a35bc7b420f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:50.075761 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6af788ba-42e6-4a2d-8ad5-7a35bc7b420f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:50.076320 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6af788ba-42e6-4a2d-8ad5-7a35bc7b420f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:50.078536 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6af788ba-42e6-4a2d-8ad5-7a35bc7b420f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:50.092572 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:20:50.501951 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6af788ba-42e6-4a2d-8ad5-7a35bc7b420f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:50.510955 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6af788ba-42e6-4a2d-8ad5-7a35bc7b420f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/22fce0cc-6498-4b95-b265-a44519f4fd9a" status: 200 len: 1346 microversion: 2.1 time: 0.482472 Oct 30 01:20:50.527344 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1016/1994] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:50 2022] GET /compute/v2.1/servers/22fce0cc-6498-4b95-b265-a44519f4fd9a => generated 1346 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:50.556317 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d2b0ff38-c2c8-486a-83d1-ab9aa73a43f5 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:50.556835 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d2b0ff38-c2c8-486a-83d1-ab9aa73a43f5 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: 51bbcade-43f8-4f2d-a572-3dc9e98aa391] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:50.599572 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2b0ff38-c2c8-486a-83d1-ab9aa73a43f5 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:50.600078 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2b0ff38-c2c8-486a-83d1-ab9aa73a43f5 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:50.604036 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2b0ff38-c2c8-486a-83d1-ab9aa73a43f5 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:50.606362 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2b0ff38-c2c8-486a-83d1-ab9aa73a43f5 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:50.607000 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2b0ff38-c2c8-486a-83d1-ab9aa73a43f5 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:50.608940 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2b0ff38-c2c8-486a-83d1-ab9aa73a43f5 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:50.725600 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d2b0ff38-c2c8-486a-83d1-ab9aa73a43f5 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: 51bbcade-43f8-4f2d-a572-3dc9e98aa391] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:20:50.835526 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2f0219ec-d436-4ab7-a00a-6a6c188b1e96 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:50.843259 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:20:50.851260 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2f0219ec-d436-4ab7-a00a-6a6c188b1e96 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:50.866255 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2f0219ec-d436-4ab7-a00a-6a6c188b1e96 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:50.869918 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2f0219ec-d436-4ab7-a00a-6a6c188b1e96 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33" status: 200 len: 1485 microversion: 2.25 time: 1.186378 Oct 30 01:20:50.870525 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 979/1995] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:20:49 2022] GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33 => generated 1485 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:20:50.890325 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bf8c5542-034d-4724-bdde-2cafaf1c749a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:50.893646 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-bf8c5542-034d-4724-bdde-2cafaf1c749a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:50.936616 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bf8c5542-034d-4724-bdde-2cafaf1c749a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:50.941121 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bf8c5542-034d-4724-bdde-2cafaf1c749a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:50.948971 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bf8c5542-034d-4724-bdde-2cafaf1c749a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:50.950145 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bf8c5542-034d-4724-bdde-2cafaf1c749a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:50.951079 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bf8c5542-034d-4724-bdde-2cafaf1c749a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:50.951805 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bf8c5542-034d-4724-bdde-2cafaf1c749a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:51.143586 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d2b0ff38-c2c8-486a-83d1-ab9aa73a43f5 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "DELETE /compute/v2.1/servers/51bbcade-43f8-4f2d-a572-3dc9e98aa391" status: 204 len: 0 microversion: 2.1 time: 0.607782 Oct 30 01:20:51.145560 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1017/1996] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:20:50 2022] DELETE /compute/v2.1/servers/51bbcade-43f8-4f2d-a572-3dc9e98aa391 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:20:51.157674 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f1f28912-bca7-46d6-a222-31b18b8c08ae tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:51.160769 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f1f28912-bca7-46d6-a222-31b18b8c08ae tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:51.189551 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f1f28912-bca7-46d6-a222-31b18b8c08ae tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:51.190306 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f1f28912-bca7-46d6-a222-31b18b8c08ae tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:51.192277 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f1f28912-bca7-46d6-a222-31b18b8c08ae tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:51.193302 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f1f28912-bca7-46d6-a222-31b18b8c08ae tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:51.196888 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f1f28912-bca7-46d6-a222-31b18b8c08ae tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:51.204795 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f1f28912-bca7-46d6-a222-31b18b8c08ae tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:51.249852 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=14 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:20:51.355939 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-bf8c5542-034d-4724-bdde-2cafaf1c749a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:51.374280 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bf8c5542-034d-4724-bdde-2cafaf1c749a tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd" status: 200 len: 1598 microversion: 2.1 time: 0.495169 Oct 30 01:20:51.391524 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 980/1997] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:50 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd => generated 1598 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:51.406816 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f7a6c081-b7fa-4313-820b-7c71c0e289f9 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:51.410731 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f7a6c081-b7fa-4313-820b-7c71c0e289f9 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: e7ff7c82-b3f6-4172-be0d-1c67c30db4f7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:51.426787 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f7a6c081-b7fa-4313-820b-7c71c0e289f9 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:51.427693 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f7a6c081-b7fa-4313-820b-7c71c0e289f9 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:51.428469 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f7a6c081-b7fa-4313-820b-7c71c0e289f9 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:51.429565 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f7a6c081-b7fa-4313-820b-7c71c0e289f9 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:51.436131 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f7a6c081-b7fa-4313-820b-7c71c0e289f9 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:51.436970 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f7a6c081-b7fa-4313-820b-7c71c0e289f9 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:51.457101 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f1f28912-bca7-46d6-a222-31b18b8c08ae tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:51.482722 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f1f28912-bca7-46d6-a222-31b18b8c08ae tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:51.491012 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f1f28912-bca7-46d6-a222-31b18b8c08ae tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:51.500624 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f1f28912-bca7-46d6-a222-31b18b8c08ae tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1546 microversion: 2.91 time: 0.352689 Oct 30 01:20:51.504359 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1018/1998] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:20:51 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1546 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:20:51.516545 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c83a98cf-69f1-41d1-b94a-b2028df864c8 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:51.517173 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c83a98cf-69f1-41d1-b94a-b2028df864c8 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: 51bbcade-43f8-4f2d-a572-3dc9e98aa391] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:51.535603 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c83a98cf-69f1-41d1-b94a-b2028df864c8 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:51.536282 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c83a98cf-69f1-41d1-b94a-b2028df864c8 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:51.536667 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c83a98cf-69f1-41d1-b94a-b2028df864c8 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:51.538943 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c83a98cf-69f1-41d1-b94a-b2028df864c8 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:51.539433 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c83a98cf-69f1-41d1-b94a-b2028df864c8 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:51.541895 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c83a98cf-69f1-41d1-b94a-b2028df864c8 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:52.097687 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f7a6c081-b7fa-4313-820b-7c71c0e289f9 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:52.115671 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f7a6c081-b7fa-4313-820b-7c71c0e289f9 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7" status: 200 len: 1469 microversion: 2.1 time: 0.722648 Oct 30 01:20:52.120720 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 981/1999] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:51 2022] GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 => generated 1469 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:52.136880 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f04a0f74-6446-4687-a968-89f4717db3ea tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:52.138347 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f04a0f74-6446-4687-a968-89f4717db3ea tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 22fce0cc-6498-4b95-b265-a44519f4fd9a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:52.169310 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f04a0f74-6446-4687-a968-89f4717db3ea tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:52.170227 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f04a0f74-6446-4687-a968-89f4717db3ea tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:52.171768 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f04a0f74-6446-4687-a968-89f4717db3ea tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:52.175661 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f04a0f74-6446-4687-a968-89f4717db3ea tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:52.176280 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f04a0f74-6446-4687-a968-89f4717db3ea tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:52.176734 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f04a0f74-6446-4687-a968-89f4717db3ea tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:52.203838 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c83a98cf-69f1-41d1-b94a-b2028df864c8 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:52.218264 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c83a98cf-69f1-41d1-b94a-b2028df864c8 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/51bbcade-43f8-4f2d-a572-3dc9e98aa391" status: 200 len: 1526 microversion: 2.1 time: 0.711463 Oct 30 01:20:52.220791 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1019/2000] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:51 2022] GET /compute/v2.1/servers/51bbcade-43f8-4f2d-a572-3dc9e98aa391 => generated 1526 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:52.229237 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-403ac4b8-5d69-4dee-9ba0-d865a9a8d0b7 req-04971f1c-71db-4f89-810c-77b37bcec3fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b368660-effb-411d-b713-455fc7fd44cd", "name": "network-vif-deleted", "tag": "be63e75e-18fe-4000-8f59-5722fd84c310"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:20:52.282756 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-403ac4b8-5d69-4dee-9ba0-d865a9a8d0b7 req-04971f1c-71db-4f89-810c-77b37bcec3fe service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:52.283413 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-403ac4b8-5d69-4dee-9ba0-d865a9a8d0b7 req-04971f1c-71db-4f89-810c-77b37bcec3fe service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:52.284013 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-403ac4b8-5d69-4dee-9ba0-d865a9a8d0b7 req-04971f1c-71db-4f89-810c-77b37bcec3fe service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:52.311752 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-403ac4b8-5d69-4dee-9ba0-d865a9a8d0b7 req-04971f1c-71db-4f89-810c-77b37bcec3fe service nova] Creating event network-vif-deleted:be63e75e-18fe-4000-8f59-5722fd84c310 for instance 6b368660-effb-411d-b713-455fc7fd44cd on n-h1-master-1 Oct 30 01:20:52.319348 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-403ac4b8-5d69-4dee-9ba0-d865a9a8d0b7 req-04971f1c-71db-4f89-810c-77b37bcec3fe service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097189 Oct 30 01:20:52.320555 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1020/2001] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:20:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:20:52.334543 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9eda8443-2340-4480-9706-2941d319ee00 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:52.335113 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9eda8443-2340-4480-9706-2941d319ee00 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 5ed38927-680d-4e93-b57a-21fb407c6b33] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:52.350699 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9eda8443-2340-4480-9706-2941d319ee00 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:52.351325 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9eda8443-2340-4480-9706-2941d319ee00 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:52.352167 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9eda8443-2340-4480-9706-2941d319ee00 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:52.352814 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9eda8443-2340-4480-9706-2941d319ee00 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:52.353511 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9eda8443-2340-4480-9706-2941d319ee00 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:52.354032 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9eda8443-2340-4480-9706-2941d319ee00 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:52.522678 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f04a0f74-6446-4687-a968-89f4717db3ea tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:52.537084 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f04a0f74-6446-4687-a968-89f4717db3ea tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/22fce0cc-6498-4b95-b265-a44519f4fd9a" status: 200 len: 1346 microversion: 2.1 time: 0.411524 Oct 30 01:20:52.541467 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 982/2002] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:52 2022] GET /compute/v2.1/servers/22fce0cc-6498-4b95-b265-a44519f4fd9a => generated 1346 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:52.551939 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-14f9f27e-b18e-45ee-8e24-1bbaeab7222e tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:52.553788 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-14f9f27e-b18e-45ee-8e24-1bbaeab7222e tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:52.571523 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14f9f27e-b18e-45ee-8e24-1bbaeab7222e tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:52.572926 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14f9f27e-b18e-45ee-8e24-1bbaeab7222e tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:52.573712 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14f9f27e-b18e-45ee-8e24-1bbaeab7222e tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:52.574513 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14f9f27e-b18e-45ee-8e24-1bbaeab7222e tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:52.574995 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14f9f27e-b18e-45ee-8e24-1bbaeab7222e tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:52.581792 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14f9f27e-b18e-45ee-8e24-1bbaeab7222e tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:52.681445 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14f9f27e-b18e-45ee-8e24-1bbaeab7222e tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:52.682549 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14f9f27e-b18e-45ee-8e24-1bbaeab7222e tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:52.685833 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14f9f27e-b18e-45ee-8e24-1bbaeab7222e tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:52.687068 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-14f9f27e-b18e-45ee-8e24-1bbaeab7222e tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lazy-loading 'fault' on Instance uuid 6b368660-effb-411d-b713-455fc7fd44cd {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:20:52.863270 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-14f9f27e-b18e-45ee-8e24-1bbaeab7222e tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:52.886450 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-14f9f27e-b18e-45ee-8e24-1bbaeab7222e tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd" status: 200 len: 1324 microversion: 2.1 time: 0.329692 Oct 30 01:20:52.922070 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 983/2003] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:52 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd => generated 1324 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:52.944665 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d2e598c2-3a51-4993-8b78-49b91f723df1 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:52.944665 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d2e598c2-3a51-4993-8b78-49b91f723df1 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:52.960624 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d2e598c2-3a51-4993-8b78-49b91f723df1 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:52.961241 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d2e598c2-3a51-4993-8b78-49b91f723df1 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:52.961587 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d2e598c2-3a51-4993-8b78-49b91f723df1 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:52.967280 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d2e598c2-3a51-4993-8b78-49b91f723df1 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:52.967280 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d2e598c2-3a51-4993-8b78-49b91f723df1 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:52.971553 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d2e598c2-3a51-4993-8b78-49b91f723df1 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:53.104810 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9eda8443-2340-4480-9706-2941d319ee00 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:53.119661 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9eda8443-2340-4480-9706-2941d319ee00 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:53.123556 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9eda8443-2340-4480-9706-2941d319ee00 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:53.127668 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9eda8443-2340-4480-9706-2941d319ee00 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33" status: 200 len: 1485 microversion: 2.25 time: 0.805233 Oct 30 01:20:53.133164 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d2e598c2-3a51-4993-8b78-49b91f723df1 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:53.136967 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1021/2004] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:20:52 2022] GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33 => generated 1485 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:20:53.151851 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6f1d38b5-cc72-4293-8b0d-95e3ab8e7b5e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:53.153125 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6f1d38b5-cc72-4293-8b0d-95e3ab8e7b5e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: e7ff7c82-b3f6-4172-be0d-1c67c30db4f7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:53.156968 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d2e598c2-3a51-4993-8b78-49b91f723df1 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:53.158908 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d2e598c2-3a51-4993-8b78-49b91f723df1 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:53.178174 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6f1d38b5-cc72-4293-8b0d-95e3ab8e7b5e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:53.178690 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6f1d38b5-cc72-4293-8b0d-95e3ab8e7b5e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:53.179414 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d2e598c2-3a51-4993-8b78-49b91f723df1 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1546 microversion: 2.91 time: 0.256304 Oct 30 01:20:53.180091 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6f1d38b5-cc72-4293-8b0d-95e3ab8e7b5e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:53.182391 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6f1d38b5-cc72-4293-8b0d-95e3ab8e7b5e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:53.183077 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6f1d38b5-cc72-4293-8b0d-95e3ab8e7b5e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:53.186181 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 984/2005] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:20:52 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1546 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:20:53.186450 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6f1d38b5-cc72-4293-8b0d-95e3ab8e7b5e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:53.251278 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-644a33cf-65d4-4d44-875f-49c68d13025f tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:53.251899 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-644a33cf-65d4-4d44-875f-49c68d13025f tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: 51bbcade-43f8-4f2d-a572-3dc9e98aa391] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:53.268280 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-644a33cf-65d4-4d44-875f-49c68d13025f tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:53.271174 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-644a33cf-65d4-4d44-875f-49c68d13025f tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:53.271519 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-644a33cf-65d4-4d44-875f-49c68d13025f tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:53.272283 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-644a33cf-65d4-4d44-875f-49c68d13025f tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:53.272742 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-644a33cf-65d4-4d44-875f-49c68d13025f tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:53.273171 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-644a33cf-65d4-4d44-875f-49c68d13025f tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:53.704572 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6f1d38b5-cc72-4293-8b0d-95e3ab8e7b5e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:53.715880 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6f1d38b5-cc72-4293-8b0d-95e3ab8e7b5e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7" status: 200 len: 1469 microversion: 2.1 time: 0.575133 Oct 30 01:20:53.727983 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1022/2006] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:53 2022] GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 => generated 1469 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:53.740411 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fb972c2b-c01e-4d27-a2f9-db415405c05d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:53.746163 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fb972c2b-c01e-4d27-a2f9-db415405c05d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 22fce0cc-6498-4b95-b265-a44519f4fd9a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:53.758898 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=2,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:20:53.771033 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb972c2b-c01e-4d27-a2f9-db415405c05d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:53.777442 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb972c2b-c01e-4d27-a2f9-db415405c05d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:53.777442 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb972c2b-c01e-4d27-a2f9-db415405c05d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:53.777442 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb972c2b-c01e-4d27-a2f9-db415405c05d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:53.777442 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb972c2b-c01e-4d27-a2f9-db415405c05d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:53.786834 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb972c2b-c01e-4d27-a2f9-db415405c05d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:53.822250 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-644a33cf-65d4-4d44-875f-49c68d13025f tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:53.834362 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-644a33cf-65d4-4d44-875f-49c68d13025f tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/51bbcade-43f8-4f2d-a572-3dc9e98aa391" status: 200 len: 1526 microversion: 2.1 time: 0.587196 Oct 30 01:20:53.838359 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 985/2007] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:53 2022] GET /compute/v2.1/servers/51bbcade-43f8-4f2d-a572-3dc9e98aa391 => generated 1526 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:53.928191 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e2cc73da-fabd-4aa0-8134-c6484b3af1fe tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:53.929118 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e2cc73da-fabd-4aa0-8134-c6484b3af1fe tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:53.934023 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-fb972c2b-c01e-4d27-a2f9-db415405c05d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:53.939397 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2cc73da-fabd-4aa0-8134-c6484b3af1fe tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:53.943403 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2cc73da-fabd-4aa0-8134-c6484b3af1fe tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:53.944025 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2cc73da-fabd-4aa0-8134-c6484b3af1fe tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:53.944693 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fb972c2b-c01e-4d27-a2f9-db415405c05d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/22fce0cc-6498-4b95-b265-a44519f4fd9a" status: 200 len: 1346 microversion: 2.1 time: 0.215051 Oct 30 01:20:53.945657 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1023/2008] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:53 2022] GET /compute/v2.1/servers/22fce0cc-6498-4b95-b265-a44519f4fd9a => generated 1346 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:53.947743 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2cc73da-fabd-4aa0-8134-c6484b3af1fe tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:53.949374 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2cc73da-fabd-4aa0-8134-c6484b3af1fe tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:53.951781 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2cc73da-fabd-4aa0-8134-c6484b3af1fe tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:54.050435 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2cc73da-fabd-4aa0-8134-c6484b3af1fe tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:54.051005 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2cc73da-fabd-4aa0-8134-c6484b3af1fe tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:54.051451 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2cc73da-fabd-4aa0-8134-c6484b3af1fe tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:54.051918 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-e2cc73da-fabd-4aa0-8134-c6484b3af1fe tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lazy-loading 'fault' on Instance uuid 6b368660-effb-411d-b713-455fc7fd44cd {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:20:54.134749 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e2cc73da-fabd-4aa0-8134-c6484b3af1fe tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:54.154101 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e2cc73da-fabd-4aa0-8134-c6484b3af1fe tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd" status: 200 len: 1324 microversion: 2.1 time: 0.230263 Oct 30 01:20:54.170252 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e760ea45-8d00-4872-bb17-016043aed94e tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:54.170252 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e760ea45-8d00-4872-bb17-016043aed94e tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 5ed38927-680d-4e93-b57a-21fb407c6b33] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:54.170632 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 986/2009] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:53 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd => generated 1324 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:54.175182 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e760ea45-8d00-4872-bb17-016043aed94e tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:54.175486 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e760ea45-8d00-4872-bb17-016043aed94e tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:54.175840 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e760ea45-8d00-4872-bb17-016043aed94e tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:54.177592 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e760ea45-8d00-4872-bb17-016043aed94e tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:54.181915 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e760ea45-8d00-4872-bb17-016043aed94e tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:54.181915 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e760ea45-8d00-4872-bb17-016043aed94e tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:54.217856 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cf581266-478d-4ce4-8294-ef346e3bbd21 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:54.218842 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-cf581266-478d-4ce4-8294-ef346e3bbd21 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:54.240624 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cf581266-478d-4ce4-8294-ef346e3bbd21 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:54.242497 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cf581266-478d-4ce4-8294-ef346e3bbd21 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:54.244398 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cf581266-478d-4ce4-8294-ef346e3bbd21 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:54.245563 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cf581266-478d-4ce4-8294-ef346e3bbd21 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:54.246056 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cf581266-478d-4ce4-8294-ef346e3bbd21 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:54.256537 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cf581266-478d-4ce4-8294-ef346e3bbd21 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:54.400458 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-cf581266-478d-4ce4-8294-ef346e3bbd21 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:54.413303 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-cf581266-478d-4ce4-8294-ef346e3bbd21 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:54.420646 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-cf581266-478d-4ce4-8294-ef346e3bbd21 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:54.434414 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cf581266-478d-4ce4-8294-ef346e3bbd21 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1546 microversion: 2.91 time: 0.226636 Oct 30 01:20:54.451221 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 987/2010] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:20:54 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1546 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:20:54.469035 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-a8d42b04-a7a0-4914-87b7-d4725cb57991 req-03561afd-fa10-44e2-ba3d-3cf9ff25fb5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51bbcade-43f8-4f2d-a572-3dc9e98aa391", "name": "network-vif-deleted", "tag": "0ea2c6d3-efc2-4811-88e6-b4727e52617a"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:20:54.498614 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-a8d42b04-a7a0-4914-87b7-d4725cb57991 req-03561afd-fa10-44e2-ba3d-3cf9ff25fb5b service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:54.499113 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-a8d42b04-a7a0-4914-87b7-d4725cb57991 req-03561afd-fa10-44e2-ba3d-3cf9ff25fb5b service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:54.499559 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-a8d42b04-a7a0-4914-87b7-d4725cb57991 req-03561afd-fa10-44e2-ba3d-3cf9ff25fb5b service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:54.514054 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e760ea45-8d00-4872-bb17-016043aed94e tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:54.519254 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-a8d42b04-a7a0-4914-87b7-d4725cb57991 req-03561afd-fa10-44e2-ba3d-3cf9ff25fb5b service nova] Creating event network-vif-deleted:0ea2c6d3-efc2-4811-88e6-b4727e52617a for instance 51bbcade-43f8-4f2d-a572-3dc9e98aa391 on n-h2-master-1 Oct 30 01:20:54.527980 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-a8d42b04-a7a0-4914-87b7-d4725cb57991 req-03561afd-fa10-44e2-ba3d-3cf9ff25fb5b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067246 Oct 30 01:20:54.528613 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 988/2011] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:20:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:20:54.530369 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e760ea45-8d00-4872-bb17-016043aed94e tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:54.547058 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e760ea45-8d00-4872-bb17-016043aed94e tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:54.548912 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e760ea45-8d00-4872-bb17-016043aed94e tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33" status: 200 len: 1485 microversion: 2.25 time: 0.393490 Oct 30 01:20:54.550076 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1024/2012] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:20:54 2022] GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33 => generated 1485 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:20:54.752272 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0ac1fbc4-ac52-45b2-8a4e-dc4b5c91d182 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:54.752886 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0ac1fbc4-ac52-45b2-8a4e-dc4b5c91d182 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: e7ff7c82-b3f6-4172-be0d-1c67c30db4f7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:54.764454 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0ac1fbc4-ac52-45b2-8a4e-dc4b5c91d182 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:54.765184 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0ac1fbc4-ac52-45b2-8a4e-dc4b5c91d182 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:54.766876 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0ac1fbc4-ac52-45b2-8a4e-dc4b5c91d182 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:54.771875 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0ac1fbc4-ac52-45b2-8a4e-dc4b5c91d182 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:54.772560 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0ac1fbc4-ac52-45b2-8a4e-dc4b5c91d182 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:54.773213 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0ac1fbc4-ac52-45b2-8a4e-dc4b5c91d182 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:54.862355 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d166370a-22a6-4c43-ac36-64ebf39a9480 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:54.864067 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d166370a-22a6-4c43-ac36-64ebf39a9480 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: 51bbcade-43f8-4f2d-a572-3dc9e98aa391] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:54.894793 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d166370a-22a6-4c43-ac36-64ebf39a9480 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:54.895722 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d166370a-22a6-4c43-ac36-64ebf39a9480 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:54.909406 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d166370a-22a6-4c43-ac36-64ebf39a9480 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:54.910774 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d166370a-22a6-4c43-ac36-64ebf39a9480 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:54.911510 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d166370a-22a6-4c43-ac36-64ebf39a9480 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:54.912200 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d166370a-22a6-4c43-ac36-64ebf39a9480 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:55.036305 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0ac1fbc4-ac52-45b2-8a4e-dc4b5c91d182 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:55.046657 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0ac1fbc4-ac52-45b2-8a4e-dc4b5c91d182 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7" status: 200 len: 1469 microversion: 2.1 time: 0.298736 Oct 30 01:20:55.047213 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 989/2013] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:54 2022] GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 => generated 1469 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:55.076991 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2bdf31b5-7c2d-41ac-b7b8-bd44a1a98ecd tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:55.081168 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2bdf31b5-7c2d-41ac-b7b8-bd44a1a98ecd tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 22fce0cc-6498-4b95-b265-a44519f4fd9a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:55.096558 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2bdf31b5-7c2d-41ac-b7b8-bd44a1a98ecd tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:55.097671 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2bdf31b5-7c2d-41ac-b7b8-bd44a1a98ecd tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:55.097671 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2bdf31b5-7c2d-41ac-b7b8-bd44a1a98ecd tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:55.099060 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2bdf31b5-7c2d-41ac-b7b8-bd44a1a98ecd tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:55.101963 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2bdf31b5-7c2d-41ac-b7b8-bd44a1a98ecd tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:55.103001 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2bdf31b5-7c2d-41ac-b7b8-bd44a1a98ecd tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:55.155923 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d166370a-22a6-4c43-ac36-64ebf39a9480 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114d44d0a314c75902da53fca797f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2cd7e4b04741e3bb1cb9852612db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:55.186615 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d166370a-22a6-4c43-ac36-64ebf39a9480 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/51bbcade-43f8-4f2d-a572-3dc9e98aa391" status: 200 len: 1309 microversion: 2.1 time: 0.307181 Oct 30 01:20:55.199459 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1025/2014] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:54 2022] GET /compute/v2.1/servers/51bbcade-43f8-4f2d-a572-3dc9e98aa391 => generated 1309 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:20:55.205992 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e9526ca4-47ab-43bb-a36e-555a1fcba92b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:55.208601 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e9526ca4-47ab-43bb-a36e-555a1fcba92b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:55.222211 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9526ca4-47ab-43bb-a36e-555a1fcba92b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:55.222923 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9526ca4-47ab-43bb-a36e-555a1fcba92b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:55.223427 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9526ca4-47ab-43bb-a36e-555a1fcba92b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:55.224270 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9526ca4-47ab-43bb-a36e-555a1fcba92b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:55.224848 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9526ca4-47ab-43bb-a36e-555a1fcba92b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:55.225593 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9526ca4-47ab-43bb-a36e-555a1fcba92b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:55.327144 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2bdf31b5-7c2d-41ac-b7b8-bd44a1a98ecd tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:55.337608 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2bdf31b5-7c2d-41ac-b7b8-bd44a1a98ecd tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/22fce0cc-6498-4b95-b265-a44519f4fd9a" status: 200 len: 1346 microversion: 2.1 time: 0.269932 Oct 30 01:20:55.349372 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9526ca4-47ab-43bb-a36e-555a1fcba92b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:55.349372 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9526ca4-47ab-43bb-a36e-555a1fcba92b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:55.349372 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9526ca4-47ab-43bb-a36e-555a1fcba92b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:55.349372 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-e9526ca4-47ab-43bb-a36e-555a1fcba92b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lazy-loading 'fault' on Instance uuid 6b368660-effb-411d-b713-455fc7fd44cd {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:20:55.350397 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 990/2015] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:55 2022] GET /compute/v2.1/servers/22fce0cc-6498-4b95-b265-a44519f4fd9a => generated 1346 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:55.468893 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-78c7cb6c-fd3c-4fe9-bd6e-1d18932e4da9 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:55.469820 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-78c7cb6c-fd3c-4fe9-bd6e-1d18932e4da9 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:55.483360 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:20:55.485149 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-78c7cb6c-fd3c-4fe9-bd6e-1d18932e4da9 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:55.489835 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e9526ca4-47ab-43bb-a36e-555a1fcba92b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:55.499284 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-78c7cb6c-fd3c-4fe9-bd6e-1d18932e4da9 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:55.500072 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-78c7cb6c-fd3c-4fe9-bd6e-1d18932e4da9 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:55.501945 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e9526ca4-47ab-43bb-a36e-555a1fcba92b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd" status: 200 len: 1324 microversion: 2.1 time: 0.312932 Oct 30 01:20:55.503366 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-78c7cb6c-fd3c-4fe9-bd6e-1d18932e4da9 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:55.517029 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-78c7cb6c-fd3c-4fe9-bd6e-1d18932e4da9 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:55.517540 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-78c7cb6c-fd3c-4fe9-bd6e-1d18932e4da9 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:55.528247 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1026/2016] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:55 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd => generated 1324 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:55.582640 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-820c1c59-de90-4db8-b688-db29e7b7924a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:55.584351 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-820c1c59-de90-4db8-b688-db29e7b7924a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 5ed38927-680d-4e93-b57a-21fb407c6b33] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:55.601868 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-820c1c59-de90-4db8-b688-db29e7b7924a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:55.602428 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-820c1c59-de90-4db8-b688-db29e7b7924a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:55.610759 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-820c1c59-de90-4db8-b688-db29e7b7924a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:55.612035 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-820c1c59-de90-4db8-b688-db29e7b7924a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:55.612620 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-820c1c59-de90-4db8-b688-db29e7b7924a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:55.613104 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-820c1c59-de90-4db8-b688-db29e7b7924a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:55.715751 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-78c7cb6c-fd3c-4fe9-bd6e-1d18932e4da9 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:55.734804 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-78c7cb6c-fd3c-4fe9-bd6e-1d18932e4da9 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:55.747706 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-78c7cb6c-fd3c-4fe9-bd6e-1d18932e4da9 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:55.754986 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-78c7cb6c-fd3c-4fe9-bd6e-1d18932e4da9 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1546 microversion: 2.91 time: 0.290695 Oct 30 01:20:55.773775 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 991/2017] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:20:55 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1546 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:20:56.074201 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5ee0b170-5538-4bf0-bc53-7ba6989f6e81 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:56.074826 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5ee0b170-5538-4bf0-bc53-7ba6989f6e81 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: e7ff7c82-b3f6-4172-be0d-1c67c30db4f7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:56.091011 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ee0b170-5538-4bf0-bc53-7ba6989f6e81 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:56.091518 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ee0b170-5538-4bf0-bc53-7ba6989f6e81 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:56.092014 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ee0b170-5538-4bf0-bc53-7ba6989f6e81 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:56.092681 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ee0b170-5538-4bf0-bc53-7ba6989f6e81 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:56.093145 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ee0b170-5538-4bf0-bc53-7ba6989f6e81 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:56.105662 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ee0b170-5538-4bf0-bc53-7ba6989f6e81 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:56.806765 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-820c1c59-de90-4db8-b688-db29e7b7924a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:56.832529 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-820c1c59-de90-4db8-b688-db29e7b7924a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:56.837409 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-820c1c59-de90-4db8-b688-db29e7b7924a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:56.839012 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-820c1c59-de90-4db8-b688-db29e7b7924a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33" status: 200 len: 1485 microversion: 2.25 time: 1.262402 Oct 30 01:20:56.842430 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1027/2018] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:20:55 2022] GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33 => generated 1485 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:20:56.844816 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5ee0b170-5538-4bf0-bc53-7ba6989f6e81 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:56.852953 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-06346e4c-beaf-4caf-a890-6476322f6c67 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:56.856856 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-06346e4c-beaf-4caf-a890-6476322f6c67 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: 51bbcade-43f8-4f2d-a572-3dc9e98aa391] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:56.856989 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5ee0b170-5538-4bf0-bc53-7ba6989f6e81 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7" status: 200 len: 1469 microversion: 2.1 time: 0.786305 Oct 30 01:20:56.857135 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 992/2019] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:56 2022] GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 => generated 1469 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:56.876722 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-05047ccc-c956-46db-afde-a3d7849167fe tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:56.881494 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-05047ccc-c956-46db-afde-a3d7849167fe tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 22fce0cc-6498-4b95-b265-a44519f4fd9a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:56.882409 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-06346e4c-beaf-4caf-a890-6476322f6c67 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:56.883133 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-06346e4c-beaf-4caf-a890-6476322f6c67 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:56.884312 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-06346e4c-beaf-4caf-a890-6476322f6c67 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:56.885436 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-06346e4c-beaf-4caf-a890-6476322f6c67 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:56.886731 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-06346e4c-beaf-4caf-a890-6476322f6c67 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:56.887384 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-06346e4c-beaf-4caf-a890-6476322f6c67 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:56.891008 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-05047ccc-c956-46db-afde-a3d7849167fe tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:56.901222 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-05047ccc-c956-46db-afde-a3d7849167fe tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:56.901222 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-05047ccc-c956-46db-afde-a3d7849167fe tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:56.901222 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-05047ccc-c956-46db-afde-a3d7849167fe tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:56.901222 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-05047ccc-c956-46db-afde-a3d7849167fe tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:56.902500 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-05047ccc-c956-46db-afde-a3d7849167fe tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:56.904930 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-06346e4c-beaf-4caf-a890-6476322f6c67 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] HTTP exception thrown: Instance 51bbcade-43f8-4f2d-a572-3dc9e98aa391 could not be found. Oct 30 01:20:56.906938 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-06346e4c-beaf-4caf-a890-6476322f6c67 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Request method failure captured: Oct 30 01:20:56.906938 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/51bbcade-43f8-4f2d-a572-3dc9e98aa391 HTTP/1.1 Oct 30 01:20:56.906938 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:20:56.906938 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:20:56.906938 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:20:56.906938 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:20:56.906938 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:20:56.906938 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:20:56.906938 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:20:56.906938 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:20:56.906938 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdD3IhIPYY_sTvEXpI9r1a34kazQy3xsqStabQonrlcEF0HpNl2ztWpirnqs0lietV1LWWVyHjCqAxxd5t3TuUU6o10qW3LK2oIPKGmvwXDy1lrrZEL1UVe632zfYCdkIUu5geJi4tWcEpwgvNOLoS3eMkj37BIJt_45I78bzhHVIS8 Oct 30 01:20:56.906938 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:20:56.906938 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:20:56.906938 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:20:56.906938 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:20:56.906938 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:20:56.906938 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:20:56.906938 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 8c2cd7e4b04741e3bb1cb9852612db57 Oct 30 01:20:56.906938 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1966575233 Oct 30 01:20:56.906938 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:20:56.906938 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:20:56.908658 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c2cd7e4b04741e3bb1cb9852612db57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8c2cd7e4b04741e3bb1cb9852612db57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8c2cd7e4b04741e3bb1cb9852612db57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c2cd7e4b04741e3bb1cb9852612db57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:20:56.908658 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1966575233 Oct 30 01:20:56.908658 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 8c2cd7e4b04741e3bb1cb9852612db57 Oct 30 01:20:56.908658 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1966575233 Oct 30 01:20:56.908658 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ImagesOneServerNegativeTestJSON-1966575233-project Oct 30 01:20:56.908658 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:20:56.908658 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:20:56.908658 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: c114d44d0a314c75902da53fca797f62 Oct 30 01:20:56.908658 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1966575233-project Oct 30 01:20:56.908658 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:20:56.908658 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 51bbcade-43f8-4f2d-a572-3dc9e98aa391 could not be found. Oct 30 01:20:56.908658 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '51bbcade-43f8-4f2d-a572-3dc9e98aa391'} Oct 30 01:20:56.909773 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:20:56.909773 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:56.909773 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:20:56.909773 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:20:56.909773 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:20:56.909773 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:20:56.909773 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:20:56.909773 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:20:56.909773 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:20:56.909773 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:20:56.909773 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51bbcade-43f8-4f2d-a572-3dc9e98aa391 could not be found. Oct 30 01:20:56.909773 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:20:56.909773 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:56.909773 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:20:56.909773 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:56.909773 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:20:56.909773 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:20:56.909773 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:20:56.909773 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:20:56.909773 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:20:56.911615 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:20:56.911615 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:20:56.911615 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:20:56.911615 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:20:56.911615 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:20:56.911615 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:20:56.911615 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:20:56.911615 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51bbcade-43f8-4f2d-a572-3dc9e98aa391 could not be found. Oct 30 01:20:56.911615 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:20:56.911615 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:56.911615 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:20:56.911615 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:56.911615 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:20:56.911615 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:20:56.911615 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:20:56.911615 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:20:56.911615 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51bbcade-43f8-4f2d-a572-3dc9e98aa391 could not be found. Oct 30 01:20:56.911615 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:20:56.914962 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-06346e4c-beaf-4caf-a890-6476322f6c67 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Returning 404 to user: Instance 51bbcade-43f8-4f2d-a572-3dc9e98aa391 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:20:56.916105 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-06346e4c-beaf-4caf-a890-6476322f6c67 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/51bbcade-43f8-4f2d-a572-3dc9e98aa391" status: 404 len: 111 microversion: 2.1 time: 0.072401 Oct 30 01:20:56.916898 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1028/2020] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:56 2022] GET /compute/v2.1/servers/51bbcade-43f8-4f2d-a572-3dc9e98aa391 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:20:56.928975 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5add298e-65c7-4036-b24c-7d042d2b8a32 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:56.929984 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5add298e-65c7-4036-b24c-7d042d2b8a32 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 6b368660-effb-411d-b713-455fc7fd44cd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:56.938282 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5add298e-65c7-4036-b24c-7d042d2b8a32 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:56.939166 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5add298e-65c7-4036-b24c-7d042d2b8a32 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:56.939800 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5add298e-65c7-4036-b24c-7d042d2b8a32 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:56.940748 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5add298e-65c7-4036-b24c-7d042d2b8a32 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:56.941431 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5add298e-65c7-4036-b24c-7d042d2b8a32 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:56.942051 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5add298e-65c7-4036-b24c-7d042d2b8a32 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:56.959175 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-5add298e-65c7-4036-b24c-7d042d2b8a32 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] HTTP exception thrown: Instance 6b368660-effb-411d-b713-455fc7fd44cd could not be found. Oct 30 01:20:56.961123 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5add298e-65c7-4036-b24c-7d042d2b8a32 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Request method failure captured: Oct 30 01:20:56.961123 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd HTTP/1.1 Oct 30 01:20:56.961123 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:20:56.961123 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:20:56.961123 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:20:56.961123 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:20:56.961123 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:20:56.961123 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:20:56.961123 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:20:56.961123 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:20:56.961123 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXc_KQ69GfMeJ3jN4J1TPXQ8bGOBoI0WTBTMDe__y-DAo2JjL2ORnQbmCeuZLneRCYcs3kYLHyIaNHHXu_K6nKvgKp3dW6RkvCZlVFmQEQtSKQwNbPyCCeYKzvViBngiAhBCQkceHgL-negWQA5TNaEjJqlsKIeoNOaaRa4HQnkUFlGY Oct 30 01:20:56.961123 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:20:56.961123 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:20:56.961123 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:20:56.961123 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:20:56.961123 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:20:56.961123 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:20:56.961123 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 283e7fd477334b879db6b49ee5cc509f Oct 30 01:20:56.961123 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-LiveMigrationTest-879299357 Oct 30 01:20:56.961123 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:20:56.961123 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:20:56.962817 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/283e7fd477334b879db6b49ee5cc509f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_283e7fd477334b879db6b49ee5cc509f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/283e7fd477334b879db6b49ee5cc509f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/283e7fd477334b879db6b49ee5cc509f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:20:56.962817 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-LiveMigrationTest-879299357 Oct 30 01:20:56.962817 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 283e7fd477334b879db6b49ee5cc509f Oct 30 01:20:56.962817 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-LiveMigrationTest-879299357 Oct 30 01:20:56.962817 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-LiveMigrationTest-879299357-project Oct 30 01:20:56.962817 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:20:56.962817 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:20:56.962817 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: c7334417689847d18bc4c1b27d173a23 Oct 30 01:20:56.962817 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-LiveMigrationTest-879299357-project Oct 30 01:20:56.962817 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:20:56.962817 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 6b368660-effb-411d-b713-455fc7fd44cd could not be found. Oct 30 01:20:56.962817 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '6b368660-effb-411d-b713-455fc7fd44cd'} Oct 30 01:20:56.963802 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:20:56.963802 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:56.963802 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:20:56.963802 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:20:56.963802 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:20:56.963802 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:20:56.963802 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:20:56.963802 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:20:56.963802 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:20:56.963802 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:20:56.963802 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b368660-effb-411d-b713-455fc7fd44cd could not be found. Oct 30 01:20:56.963802 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:20:56.963802 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:56.963802 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:20:56.963802 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:56.963802 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:20:56.963802 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:20:56.963802 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:20:56.963802 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:20:56.963802 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:20:56.970249 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:20:56.970249 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:20:56.970249 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:20:56.970249 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:20:56.970249 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:20:56.970249 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:20:56.970249 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:20:56.970249 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b368660-effb-411d-b713-455fc7fd44cd could not be found. Oct 30 01:20:56.970249 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:20:56.970249 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:56.970249 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:20:56.970249 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:56.970249 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:20:56.970249 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:20:56.970249 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:20:56.970249 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:20:56.970249 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b368660-effb-411d-b713-455fc7fd44cd could not be found. Oct 30 01:20:56.970249 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:20:56.971587 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5add298e-65c7-4036-b24c-7d042d2b8a32 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Returning 404 to user: Instance 6b368660-effb-411d-b713-455fc7fd44cd could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:20:56.971587 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5add298e-65c7-4036-b24c-7d042d2b8a32 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd" status: 404 len: 111 microversion: 2.1 time: 0.049696 Oct 30 01:20:56.971587 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1029/2021] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:56 2022] GET /compute/v2.1/servers/6b368660-effb-411d-b713-455fc7fd44cd => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:20:56.989111 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-54588944-744b-44b0-8414-0346207938f6 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:56.993635 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-54588944-744b-44b0-8414-0346207938f6 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:56.998554 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-54588944-744b-44b0-8414-0346207938f6 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:56.999720 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-54588944-744b-44b0-8414-0346207938f6 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:57.000416 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-54588944-744b-44b0-8414-0346207938f6 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:57.001857 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-54588944-744b-44b0-8414-0346207938f6 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:57.002793 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-54588944-744b-44b0-8414-0346207938f6 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:57.003727 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-54588944-744b-44b0-8414-0346207938f6 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:57.110398 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-05047ccc-c956-46db-afde-a3d7849167fe tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:57.124629 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-05047ccc-c956-46db-afde-a3d7849167fe tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/22fce0cc-6498-4b95-b265-a44519f4fd9a" status: 200 len: 1346 microversion: 2.1 time: 0.261575 Oct 30 01:20:57.141307 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 993/2022] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:56 2022] GET /compute/v2.1/servers/22fce0cc-6498-4b95-b265-a44519f4fd9a => generated 1346 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:57.160494 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2c5e1626-a0cf-42c6-ab5b-78a6ca8676f8 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '.version_select at 0x7f44c7d38c10>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:57.234576 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-54588944-744b-44b0-8414-0346207938f6 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:57.249712 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-2c5e1626-a0cf-42c6-ab5b-78a6ca8676f8 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] HTTP exception thrown: Image not found. Oct 30 01:20:57.255288 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2c5e1626-a0cf-42c6-ab5b-78a6ca8676f8 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Request method failure captured: Oct 30 01:20:57.255288 n-d-master-1 devstack@n-api.service[121103]: request: DELETE /compute/v2.1/images/fa6497ba-e11f-4ffc-9600-7d1bcd8910b2 HTTP/1.1 Oct 30 01:20:57.255288 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:20:57.255288 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:20:57.255288 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:20:57.255288 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:20:57.255288 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:20:57.255288 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:20:57.255288 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:20:57.255288 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:20:57.255288 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdD3IhIPYY_sTvEXpI9r1a34kazQy3xsqStabQonrlcEF0HpNl2ztWpirnqs0lietV1LWWVyHjCqAxxd5t3TuUU6o10qW3LK2oIPKGmvwXDy1lrrZEL1UVe632zfYCdkIUu5geJi4tWcEpwgvNOLoS3eMkj37BIJt_45I78bzhHVIS8 Oct 30 01:20:57.255288 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:20:57.255288 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:20:57.255288 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:20:57.255288 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:20:57.255288 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:20:57.255288 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:20:57.255288 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 8c2cd7e4b04741e3bb1cb9852612db57 Oct 30 01:20:57.255288 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1966575233 Oct 30 01:20:57.255288 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:20:57.255288 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:20:57.256923 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c2cd7e4b04741e3bb1cb9852612db57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8c2cd7e4b04741e3bb1cb9852612db57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8c2cd7e4b04741e3bb1cb9852612db57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c2cd7e4b04741e3bb1cb9852612db57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:20:57.256923 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1966575233 Oct 30 01:20:57.256923 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 8c2cd7e4b04741e3bb1cb9852612db57 Oct 30 01:20:57.256923 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1966575233 Oct 30 01:20:57.256923 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ImagesOneServerNegativeTestJSON-1966575233-project Oct 30 01:20:57.256923 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:20:57.256923 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:20:57.256923 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: c114d44d0a314c75902da53fca797f62 Oct 30 01:20:57.256923 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1966575233-project Oct 30 01:20:57.256923 n-d-master-1 devstack@n-api.service[121103]: method: Oct 30 01:20:57.256923 n-d-master-1 devstack@n-api.service[121103]: exception: Image not found. Oct 30 01:20:57.256923 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'fa6497ba-e11f-4ffc-9600-7d1bcd8910b2'} Oct 30 01:20:57.256923 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:20:57.257870 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:57.257870 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 30 01:20:57.257870 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 30 01:20:57.257870 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 30 01:20:57.257870 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 30 01:20:57.257870 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 30 01:20:57.257870 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 30 01:20:57.257870 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 30 01:20:57.257870 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 30 01:20:57.257870 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 30 01:20:57.257870 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 30 01:20:57.257870 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 30 01:20:57.257870 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 30 01:20:57.257870 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 30 01:20:57.257870 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 30 01:20:57.257870 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image fa6497ba-e11f-4ffc-9600-7d1bcd8910b2 to delete Oct 30 01:20:57.257870 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:20:57.257870 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:57.257870 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:20:57.259834 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:57.259834 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 30 01:20:57.259834 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 30 01:20:57.259834 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 30 01:20:57.259834 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 30 01:20:57.259834 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 30 01:20:57.259834 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 30 01:20:57.259834 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fa6497ba-e11f-4ffc-9600-7d1bcd8910b2 could not be found. Oct 30 01:20:57.259834 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:20:57.259834 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:57.259834 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:20:57.259834 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:57.259834 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:20:57.259834 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:20:57.259834 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:20:57.259834 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:20:57.259834 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:20:57.259834 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:20:57.259834 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:20:57.259834 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:20:57.261249 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 30 01:20:57.261249 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 30 01:20:57.261249 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 30 01:20:57.261249 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:20:57.261249 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:57.261249 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:20:57.261249 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:57.261249 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:20:57.261249 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:20:57.261249 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:20:57.261249 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:20:57.261249 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 30 01:20:57.261249 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:20:57.261249 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2c5e1626-a0cf-42c6-ab5b-78a6ca8676f8 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Returning 404 to user: Image not found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:20:57.261249 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2c5e1626-a0cf-42c6-ab5b-78a6ca8676f8 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "DELETE /compute/v2.1/images/fa6497ba-e11f-4ffc-9600-7d1bcd8910b2" status: 404 len: 62 microversion: 2.1 time: 0.110265 Oct 30 01:20:57.263450 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 994/2023] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:57 2022] DELETE /compute/v2.1/images/fa6497ba-e11f-4ffc-9600-7d1bcd8910b2 => generated 62 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:20:57.268756 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-54588944-744b-44b0-8414-0346207938f6 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:57.286507 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1691ae1a-5154-480b-b5d6-b97aba5355e6 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '.version_select at 0x7f44c7bacf70>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:57.288135 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-54588944-744b-44b0-8414-0346207938f6 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:57.304698 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-54588944-744b-44b0-8414-0346207938f6 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1546 microversion: 2.91 time: 0.333950 Oct 30 01:20:57.308938 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1030/2024] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:20:56 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1546 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:20:57.320693 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3b0e1ac1-7f15-4550-bf67-204aa4dd5a82 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:57.323413 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3b0e1ac1-7f15-4550-bf67-204aa4dd5a82 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: 65a083f8-3b0d-43fd-93be-e9abb278e0ee] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:57.333834 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3b0e1ac1-7f15-4550-bf67-204aa4dd5a82 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:57.334723 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3b0e1ac1-7f15-4550-bf67-204aa4dd5a82 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:57.335642 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3b0e1ac1-7f15-4550-bf67-204aa4dd5a82 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:57.336374 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3b0e1ac1-7f15-4550-bf67-204aa4dd5a82 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:57.337737 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3b0e1ac1-7f15-4550-bf67-204aa4dd5a82 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:57.338458 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3b0e1ac1-7f15-4550-bf67-204aa4dd5a82 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:57.356964 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-3b0e1ac1-7f15-4550-bf67-204aa4dd5a82 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] HTTP exception thrown: Instance 65a083f8-3b0d-43fd-93be-e9abb278e0ee could not be found. Oct 30 01:20:57.359102 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3b0e1ac1-7f15-4550-bf67-204aa4dd5a82 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Request method failure captured: Oct 30 01:20:57.359102 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/servers/65a083f8-3b0d-43fd-93be-e9abb278e0ee HTTP/1.1 Oct 30 01:20:57.359102 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:20:57.359102 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:20:57.359102 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:20:57.359102 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:20:57.359102 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:20:57.359102 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:20:57.359102 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:20:57.359102 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:20:57.359102 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdD3IhIPYY_sTvEXpI9r1a34kazQy3xsqStabQonrlcEF0HpNl2ztWpirnqs0lietV1LWWVyHjCqAxxd5t3TuUU6o10qW3LK2oIPKGmvwXDy1lrrZEL1UVe632zfYCdkIUu5geJi4tWcEpwgvNOLoS3eMkj37BIJt_45I78bzhHVIS8 Oct 30 01:20:57.359102 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:20:57.359102 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:20:57.359102 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:20:57.359102 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:20:57.359102 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:20:57.359102 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:20:57.359102 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 8c2cd7e4b04741e3bb1cb9852612db57 Oct 30 01:20:57.359102 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1966575233 Oct 30 01:20:57.359102 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:20:57.359102 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:20:57.360697 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c2cd7e4b04741e3bb1cb9852612db57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8c2cd7e4b04741e3bb1cb9852612db57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8c2cd7e4b04741e3bb1cb9852612db57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c2cd7e4b04741e3bb1cb9852612db57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:20:57.360697 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1966575233 Oct 30 01:20:57.360697 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 8c2cd7e4b04741e3bb1cb9852612db57 Oct 30 01:20:57.360697 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1966575233 Oct 30 01:20:57.360697 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ImagesOneServerNegativeTestJSON-1966575233-project Oct 30 01:20:57.360697 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:20:57.360697 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:20:57.360697 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: c114d44d0a314c75902da53fca797f62 Oct 30 01:20:57.360697 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1966575233-project Oct 30 01:20:57.360697 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:20:57.360697 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 65a083f8-3b0d-43fd-93be-e9abb278e0ee could not be found. Oct 30 01:20:57.360697 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '65a083f8-3b0d-43fd-93be-e9abb278e0ee'} Oct 30 01:20:57.361666 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:20:57.361666 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:57.361666 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:20:57.361666 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:20:57.361666 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:20:57.361666 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:20:57.361666 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:20:57.361666 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:20:57.361666 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:20:57.361666 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:20:57.361666 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65a083f8-3b0d-43fd-93be-e9abb278e0ee could not be found. Oct 30 01:20:57.361666 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:20:57.361666 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:57.361666 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:20:57.361666 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:57.361666 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:20:57.361666 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:20:57.361666 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:20:57.361666 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:20:57.361666 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:20:57.363057 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:20:57.363057 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:20:57.363057 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:20:57.363057 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:20:57.363057 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:20:57.363057 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:20:57.363057 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:20:57.363057 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:20:57.363057 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:20:57.363057 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65a083f8-3b0d-43fd-93be-e9abb278e0ee could not be found. Oct 30 01:20:57.363057 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:20:57.363057 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:57.363057 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:20:57.363057 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:57.363057 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:20:57.363057 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:20:57.363057 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:20:57.363057 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:20:57.363057 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65a083f8-3b0d-43fd-93be-e9abb278e0ee could not be found. Oct 30 01:20:57.363057 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:20:57.369201 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3b0e1ac1-7f15-4550-bf67-204aa4dd5a82 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Returning 404 to user: Instance 65a083f8-3b0d-43fd-93be-e9abb278e0ee could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:20:57.370211 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3b0e1ac1-7f15-4550-bf67-204aa4dd5a82 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "DELETE /compute/v2.1/servers/65a083f8-3b0d-43fd-93be-e9abb278e0ee" status: 404 len: 111 microversion: 2.1 time: 0.058042 Oct 30 01:20:57.371377 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1031/2025] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:20:57 2022] DELETE /compute/v2.1/servers/65a083f8-3b0d-43fd-93be-e9abb278e0ee => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:20:57.380974 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e7789ef2-babf-4d65-9fcf-8ac0e2605590 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:57.382054 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e7789ef2-babf-4d65-9fcf-8ac0e2605590 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: 65a083f8-3b0d-43fd-93be-e9abb278e0ee] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:57.390252 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e7789ef2-babf-4d65-9fcf-8ac0e2605590 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:57.391127 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e7789ef2-babf-4d65-9fcf-8ac0e2605590 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:57.391795 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e7789ef2-babf-4d65-9fcf-8ac0e2605590 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:57.392816 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e7789ef2-babf-4d65-9fcf-8ac0e2605590 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:57.393625 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e7789ef2-babf-4d65-9fcf-8ac0e2605590 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:57.394320 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e7789ef2-babf-4d65-9fcf-8ac0e2605590 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:57.410741 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1691ae1a-5154-480b-b5d6-b97aba5355e6 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-207035062" status: 202 len: 0 microversion: 2.1 time: 0.146040 Oct 30 01:20:57.412662 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 995/2026] 10.222.0.13 () {58 vars in 1218 bytes} [Sun Oct 30 01:20:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-207035062 => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:20:57.421890 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-e7789ef2-babf-4d65-9fcf-8ac0e2605590 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] HTTP exception thrown: Instance 65a083f8-3b0d-43fd-93be-e9abb278e0ee could not be found. Oct 30 01:20:57.423850 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e7789ef2-babf-4d65-9fcf-8ac0e2605590 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Request method failure captured: Oct 30 01:20:57.423850 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/65a083f8-3b0d-43fd-93be-e9abb278e0ee HTTP/1.1 Oct 30 01:20:57.423850 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:20:57.423850 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:20:57.423850 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:20:57.423850 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:20:57.423850 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:20:57.423850 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:20:57.423850 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:20:57.423850 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:20:57.423850 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdD3IhIPYY_sTvEXpI9r1a34kazQy3xsqStabQonrlcEF0HpNl2ztWpirnqs0lietV1LWWVyHjCqAxxd5t3TuUU6o10qW3LK2oIPKGmvwXDy1lrrZEL1UVe632zfYCdkIUu5geJi4tWcEpwgvNOLoS3eMkj37BIJt_45I78bzhHVIS8 Oct 30 01:20:57.423850 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:20:57.423850 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:20:57.423850 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:20:57.423850 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:20:57.423850 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:20:57.423850 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:20:57.423850 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 8c2cd7e4b04741e3bb1cb9852612db57 Oct 30 01:20:57.423850 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1966575233 Oct 30 01:20:57.423850 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:20:57.423850 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:20:57.425449 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c2cd7e4b04741e3bb1cb9852612db57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8c2cd7e4b04741e3bb1cb9852612db57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8c2cd7e4b04741e3bb1cb9852612db57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c2cd7e4b04741e3bb1cb9852612db57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:20:57.425449 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1966575233 Oct 30 01:20:57.425449 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 8c2cd7e4b04741e3bb1cb9852612db57 Oct 30 01:20:57.425449 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1966575233 Oct 30 01:20:57.425449 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ImagesOneServerNegativeTestJSON-1966575233-project Oct 30 01:20:57.425449 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:20:57.425449 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:20:57.425449 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: c114d44d0a314c75902da53fca797f62 Oct 30 01:20:57.425449 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1966575233-project Oct 30 01:20:57.425449 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:20:57.425449 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 65a083f8-3b0d-43fd-93be-e9abb278e0ee could not be found. Oct 30 01:20:57.425449 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '65a083f8-3b0d-43fd-93be-e9abb278e0ee'} Oct 30 01:20:57.426316 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:20:57.426316 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:57.426316 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:20:57.426316 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:20:57.426316 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:20:57.426316 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:20:57.426316 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:20:57.426316 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:20:57.426316 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:20:57.426316 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:20:57.426316 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65a083f8-3b0d-43fd-93be-e9abb278e0ee could not be found. Oct 30 01:20:57.426316 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:20:57.426316 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:57.426316 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:20:57.426316 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:57.426316 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:20:57.426316 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:20:57.426316 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:20:57.426316 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:20:57.426316 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:20:57.427682 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:20:57.427682 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:20:57.427682 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:20:57.427682 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:20:57.427682 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:20:57.427682 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:20:57.427682 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:20:57.427682 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65a083f8-3b0d-43fd-93be-e9abb278e0ee could not be found. Oct 30 01:20:57.427682 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:20:57.427682 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:20:57.427682 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:20:57.427682 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:20:57.427682 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:20:57.427682 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:20:57.427682 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:20:57.427682 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:20:57.427682 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65a083f8-3b0d-43fd-93be-e9abb278e0ee could not be found. Oct 30 01:20:57.427682 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:20:57.436289 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e7789ef2-babf-4d65-9fcf-8ac0e2605590 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Returning 404 to user: Instance 65a083f8-3b0d-43fd-93be-e9abb278e0ee could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:20:57.438316 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e7789ef2-babf-4d65-9fcf-8ac0e2605590 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/65a083f8-3b0d-43fd-93be-e9abb278e0ee" status: 404 len: 111 microversion: 2.1 time: 0.061740 Oct 30 01:20:57.440486 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1032/2027] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:57 2022] GET /compute/v2.1/servers/65a083f8-3b0d-43fd-93be-e9abb278e0ee => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:20:57.451312 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-247c281c-c0d6-40d0-90c8-f4dbc791af89 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '.version_select at 0x7f44c7ac94c0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:57.554729 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-247c281c-c0d6-40d0-90c8-f4dbc791af89 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-903860967" status: 202 len: 0 microversion: 2.1 time: 0.109086 Oct 30 01:20:57.559569 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 996/2028] 10.222.0.13 () {58 vars in 1218 bytes} [Sun Oct 30 01:20:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-903860967 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:20:57.877550 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-da77bee1-68c4-42a3-8dc4-191d7859e1b9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:57.878964 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-da77bee1-68c4-42a3-8dc4-191d7859e1b9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 5ed38927-680d-4e93-b57a-21fb407c6b33] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:57.888992 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5f4ef017-cc8f-4c58-a9ae-466f7211374d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:57.891953 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5f4ef017-cc8f-4c58-a9ae-466f7211374d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: e7ff7c82-b3f6-4172-be0d-1c67c30db4f7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:57.915714 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f4ef017-cc8f-4c58-a9ae-466f7211374d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:57.916242 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f4ef017-cc8f-4c58-a9ae-466f7211374d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:57.919108 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-da77bee1-68c4-42a3-8dc4-191d7859e1b9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:57.919664 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-da77bee1-68c4-42a3-8dc4-191d7859e1b9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:57.920158 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-da77bee1-68c4-42a3-8dc4-191d7859e1b9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:57.920933 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-da77bee1-68c4-42a3-8dc4-191d7859e1b9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:57.921412 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-da77bee1-68c4-42a3-8dc4-191d7859e1b9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:57.921927 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-da77bee1-68c4-42a3-8dc4-191d7859e1b9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:57.925168 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f4ef017-cc8f-4c58-a9ae-466f7211374d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:57.929764 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f4ef017-cc8f-4c58-a9ae-466f7211374d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:57.931916 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f4ef017-cc8f-4c58-a9ae-466f7211374d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:57.932396 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f4ef017-cc8f-4c58-a9ae-466f7211374d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:58.578799 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5f4ef017-cc8f-4c58-a9ae-466f7211374d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:58.589468 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5f4ef017-cc8f-4c58-a9ae-466f7211374d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7" status: 200 len: 1469 microversion: 2.1 time: 0.707257 Oct 30 01:20:58.591080 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 997/2029] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:57 2022] GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 => generated 1469 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:58.626508 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f909d362-9f73-4dd7-a4f9-a5919fda451f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:58.627680 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f909d362-9f73-4dd7-a4f9-a5919fda451f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 22fce0cc-6498-4b95-b265-a44519f4fd9a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:58.675677 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f909d362-9f73-4dd7-a4f9-a5919fda451f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:58.677411 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f909d362-9f73-4dd7-a4f9-a5919fda451f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:58.679470 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f909d362-9f73-4dd7-a4f9-a5919fda451f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:58.695961 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f909d362-9f73-4dd7-a4f9-a5919fda451f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:58.699766 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f909d362-9f73-4dd7-a4f9-a5919fda451f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:58.701934 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-da77bee1-68c4-42a3-8dc4-191d7859e1b9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:58.702560 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f909d362-9f73-4dd7-a4f9-a5919fda451f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:58.724720 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-da77bee1-68c4-42a3-8dc4-191d7859e1b9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:58.726238 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-da77bee1-68c4-42a3-8dc4-191d7859e1b9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:58.727471 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-da77bee1-68c4-42a3-8dc4-191d7859e1b9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33" status: 200 len: 1485 microversion: 2.25 time: 0.858281 Oct 30 01:20:58.728042 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1033/2030] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:20:57 2022] GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33 => generated 1485 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:20:58.754193 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6c7ea16b-5aba-4ed4-a2e2-fd17605853cf tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:58.755111 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6c7ea16b-5aba-4ed4-a2e2-fd17605853cf tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:58.778969 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c7ea16b-5aba-4ed4-a2e2-fd17605853cf tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:58.781491 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c7ea16b-5aba-4ed4-a2e2-fd17605853cf tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:58.784285 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c7ea16b-5aba-4ed4-a2e2-fd17605853cf tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:58.785303 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c7ea16b-5aba-4ed4-a2e2-fd17605853cf tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:58.785981 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c7ea16b-5aba-4ed4-a2e2-fd17605853cf tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:58.786617 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c7ea16b-5aba-4ed4-a2e2-fd17605853cf tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:58.861509 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:20:58.922646 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f909d362-9f73-4dd7-a4f9-a5919fda451f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:58.924523 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f909d362-9f73-4dd7-a4f9-a5919fda451f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/22fce0cc-6498-4b95-b265-a44519f4fd9a" status: 200 len: 1346 microversion: 2.1 time: 0.313038 Oct 30 01:20:58.935437 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 998/2031] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:58 2022] GET /compute/v2.1/servers/22fce0cc-6498-4b95-b265-a44519f4fd9a => generated 1346 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:20:58.968468 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6c7ea16b-5aba-4ed4-a2e2-fd17605853cf tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:58.986031 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6c7ea16b-5aba-4ed4-a2e2-fd17605853cf tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:58.988182 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6c7ea16b-5aba-4ed4-a2e2-fd17605853cf tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:20:59.006997 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6c7ea16b-5aba-4ed4-a2e2-fd17605853cf tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1546 microversion: 2.91 time: 0.266434 Oct 30 01:20:59.008062 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1034/2032] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:20:58 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1546 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:20:59.620121 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-aa1bc5f3-4027-49a0-9e50-cdb3b9189062 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:59.621015 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-aa1bc5f3-4027-49a0-9e50-cdb3b9189062 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: e7ff7c82-b3f6-4172-be0d-1c67c30db4f7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:59.642493 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa1bc5f3-4027-49a0-9e50-cdb3b9189062 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:59.643289 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa1bc5f3-4027-49a0-9e50-cdb3b9189062 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:59.643901 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa1bc5f3-4027-49a0-9e50-cdb3b9189062 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:59.644873 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa1bc5f3-4027-49a0-9e50-cdb3b9189062 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:59.645544 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa1bc5f3-4027-49a0-9e50-cdb3b9189062 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:59.649397 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa1bc5f3-4027-49a0-9e50-cdb3b9189062 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:59.689044 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=100 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:20:59.768331 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-de95886c-f7f6-4f9b-ab96-8cf038f015b1 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:20:59.771739 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-de95886c-f7f6-4f9b-ab96-8cf038f015b1 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 5ed38927-680d-4e93-b57a-21fb407c6b33] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:20:59.793461 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-de95886c-f7f6-4f9b-ab96-8cf038f015b1 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:59.794404 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-de95886c-f7f6-4f9b-ab96-8cf038f015b1 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:59.794404 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-de95886c-f7f6-4f9b-ab96-8cf038f015b1 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:20:59.795630 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-de95886c-f7f6-4f9b-ab96-8cf038f015b1 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:20:59.796076 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-de95886c-f7f6-4f9b-ab96-8cf038f015b1 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:20:59.796498 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-de95886c-f7f6-4f9b-ab96-8cf038f015b1 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:00.243660 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-aa1bc5f3-4027-49a0-9e50-cdb3b9189062 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:00.267496 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-aa1bc5f3-4027-49a0-9e50-cdb3b9189062 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7" status: 200 len: 1469 microversion: 2.1 time: 0.652208 Oct 30 01:21:00.268701 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 999/2033] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:20:59 2022] GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 => generated 1469 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:00.278024 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a97e91c5-ce29-4fe3-a4f3-07a7c7bec6b4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:00.279984 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a97e91c5-ce29-4fe3-a4f3-07a7c7bec6b4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 22fce0cc-6498-4b95-b265-a44519f4fd9a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:00.293263 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a97e91c5-ce29-4fe3-a4f3-07a7c7bec6b4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:00.295653 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a97e91c5-ce29-4fe3-a4f3-07a7c7bec6b4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:00.298163 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a97e91c5-ce29-4fe3-a4f3-07a7c7bec6b4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:00.299153 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a97e91c5-ce29-4fe3-a4f3-07a7c7bec6b4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:00.307426 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a97e91c5-ce29-4fe3-a4f3-07a7c7bec6b4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:00.307426 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a97e91c5-ce29-4fe3-a4f3-07a7c7bec6b4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:00.430657 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a97e91c5-ce29-4fe3-a4f3-07a7c7bec6b4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:00.431905 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a97e91c5-ce29-4fe3-a4f3-07a7c7bec6b4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:00.434214 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a97e91c5-ce29-4fe3-a4f3-07a7c7bec6b4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:00.434879 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-a97e91c5-ce29-4fe3-a4f3-07a7c7bec6b4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lazy-loading 'fault' on Instance uuid 22fce0cc-6498-4b95-b265-a44519f4fd9a {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:21:00.456906 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-de95886c-f7f6-4f9b-ab96-8cf038f015b1 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:00.470529 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-de95886c-f7f6-4f9b-ab96-8cf038f015b1 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:00.472012 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-de95886c-f7f6-4f9b-ab96-8cf038f015b1 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:00.473304 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-de95886c-f7f6-4f9b-ab96-8cf038f015b1 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33" status: 200 len: 1485 microversion: 2.25 time: 0.709055 Oct 30 01:21:00.478271 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1035/2034] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:20:59 2022] GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33 => generated 1485 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:21:00.483745 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-07890984-0383-43e9-90fc-3d4aa334df6f req-329cc61a-3900-41f4-b0fd-c96a5c7857d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7ff7c82-b3f6-4172-be0d-1c67c30db4f7", "name": "network-vif-unplugged", "status": "completed", "tag": "6187e4ac-5fa7-409a-870a-b11e4dc8fc91"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:21:00.510892 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-07890984-0383-43e9-90fc-3d4aa334df6f req-329cc61a-3900-41f4-b0fd-c96a5c7857d0 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:00.513979 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-07890984-0383-43e9-90fc-3d4aa334df6f req-329cc61a-3900-41f4-b0fd-c96a5c7857d0 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:00.514665 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-07890984-0383-43e9-90fc-3d4aa334df6f req-329cc61a-3900-41f4-b0fd-c96a5c7857d0 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:00.526709 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a97e91c5-ce29-4fe3-a4f3-07a7c7bec6b4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:00.534327 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-07890984-0383-43e9-90fc-3d4aa334df6f req-329cc61a-3900-41f4-b0fd-c96a5c7857d0 service nova] Creating event network-vif-unplugged:6187e4ac-5fa7-409a-870a-b11e4dc8fc91 for instance e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 on n-h2-master-1 Oct 30 01:21:00.569286 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [req-07890984-0383-43e9-90fc-3d4aa334df6f req-329cc61a-3900-41f4-b0fd-c96a5c7857d0 service nova] Instance e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=121102) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 30 01:21:00.575889 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a97e91c5-ce29-4fe3-a4f3-07a7c7bec6b4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/22fce0cc-6498-4b95-b265-a44519f4fd9a" status: 200 len: 1351 microversion: 2.1 time: 0.302428 Oct 30 01:21:00.577871 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1000/2035] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:00 2022] GET /compute/v2.1/servers/22fce0cc-6498-4b95-b265-a44519f4fd9a => generated 1351 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:00.597918 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2f972b3c-fbe8-4504-a671-3c6d80f59aa5 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:00.604743 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2f972b3c-fbe8-4504-a671-3c6d80f59aa5 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:00.607279 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-07890984-0383-43e9-90fc-3d4aa334df6f req-329cc61a-3900-41f4-b0fd-c96a5c7857d0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.127372 Oct 30 01:21:00.607912 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1036/2036] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:21:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:21:00.654057 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f972b3c-fbe8-4504-a671-3c6d80f59aa5 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:00.656355 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f972b3c-fbe8-4504-a671-3c6d80f59aa5 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:00.657185 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f972b3c-fbe8-4504-a671-3c6d80f59aa5 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:00.659587 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f972b3c-fbe8-4504-a671-3c6d80f59aa5 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:00.673765 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f972b3c-fbe8-4504-a671-3c6d80f59aa5 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:00.674889 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f972b3c-fbe8-4504-a671-3c6d80f59aa5 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:00.833639 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2f972b3c-fbe8-4504-a671-3c6d80f59aa5 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:00.842412 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2f972b3c-fbe8-4504-a671-3c6d80f59aa5 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:00.843926 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2f972b3c-fbe8-4504-a671-3c6d80f59aa5 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:00.880088 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2f972b3c-fbe8-4504-a671-3c6d80f59aa5 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1546 microversion: 2.91 time: 0.298332 Oct 30 01:21:00.881615 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1001/2037] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:21:00 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1546 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:21:00.922507 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-de73cfb3-a561-40d7-aff8-a2754392fc23 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '.version_select at 0x7f44d04cfd30>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:00.971133 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-de73cfb3-a561-40d7-aff8-a2754392fc23 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] HTTP exception thrown: Image not found. Oct 30 01:21:00.982930 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-de73cfb3-a561-40d7-aff8-a2754392fc23 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Request method failure captured: Oct 30 01:21:00.982930 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/images/e7d33be2-2763-4cce-92bd-f7a11ff81ac1 HTTP/1.1 Oct 30 01:21:00.982930 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:21:00.982930 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:21:00.982930 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:21:00.982930 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:21:00.982930 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:21:00.982930 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:21:00.982930 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:21:00.982930 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:21:00.982930 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdD3IhIPYY_sTvEXpI9r1a34kazQy3xsqStabQonrlcEF0HpNl2ztWpirnqs0lietV1LWWVyHjCqAxxd5t3TuUU6o10qW3LK2oIPKGmvwXDy1lrrZEL1UVe632zfYCdkIUu5geJi4tWcEpwgvNOLoS3eMkj37BIJt_45I78bzhHVIS8 Oct 30 01:21:00.982930 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:21:00.982930 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:21:00.982930 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:21:00.982930 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:21:00.982930 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:21:00.982930 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:21:00.982930 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 8c2cd7e4b04741e3bb1cb9852612db57 Oct 30 01:21:00.982930 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1966575233 Oct 30 01:21:00.982930 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:21:00.982930 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:21:00.985004 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c2cd7e4b04741e3bb1cb9852612db57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8c2cd7e4b04741e3bb1cb9852612db57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8c2cd7e4b04741e3bb1cb9852612db57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c2cd7e4b04741e3bb1cb9852612db57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:21:00.985004 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1966575233 Oct 30 01:21:00.985004 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 8c2cd7e4b04741e3bb1cb9852612db57 Oct 30 01:21:00.985004 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1966575233 Oct 30 01:21:00.985004 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ImagesOneServerNegativeTestJSON-1966575233-project Oct 30 01:21:00.985004 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:21:00.985004 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:21:00.985004 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: c114d44d0a314c75902da53fca797f62 Oct 30 01:21:00.985004 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1966575233-project Oct 30 01:21:00.985004 n-d-master-1 devstack@n-api.service[121102]: method: Oct 30 01:21:00.985004 n-d-master-1 devstack@n-api.service[121102]: exception: Image not found. Oct 30 01:21:00.985004 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'e7d33be2-2763-4cce-92bd-f7a11ff81ac1'} Oct 30 01:21:00.985004 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:21:00.986898 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:00.986898 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 30 01:21:00.986898 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 30 01:21:00.986898 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 30 01:21:00.986898 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 30 01:21:00.986898 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 30 01:21:00.986898 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 30 01:21:00.986898 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 30 01:21:00.986898 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 30 01:21:00.986898 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 30 01:21:00.986898 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 30 01:21:00.986898 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 30 01:21:00.986898 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 30 01:21:00.986898 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 30 01:21:00.986898 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 30 01:21:00.986898 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e7d33be2-2763-4cce-92bd-f7a11ff81ac1 to delete Oct 30 01:21:00.986898 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:00.986898 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:21:00.986898 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:00.989144 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:00.989144 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 30 01:21:00.989144 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 30 01:21:00.989144 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 30 01:21:00.989144 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 30 01:21:00.989144 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 30 01:21:00.989144 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 30 01:21:00.989144 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e7d33be2-2763-4cce-92bd-f7a11ff81ac1 could not be found. Oct 30 01:21:00.989144 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:00.989144 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:21:00.989144 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:00.989144 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:00.989144 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:21:00.989144 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:21:00.989144 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:21:00.989144 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:21:00.989144 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:21:00.989144 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:21:00.989144 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:21:00.989144 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:21:00.991097 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 30 01:21:00.991097 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 30 01:21:00.991097 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 30 01:21:00.991097 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:00.991097 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:21:00.991097 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:00.991097 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:00.991097 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:21:00.991097 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:21:00.991097 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:21:00.991097 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:21:00.991097 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 30 01:21:00.991097 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:00.994910 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-de73cfb3-a561-40d7-aff8-a2754392fc23 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Returning 404 to user: Image not found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:21:00.996117 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-de73cfb3-a561-40d7-aff8-a2754392fc23 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "DELETE /compute/v2.1/images/e7d33be2-2763-4cce-92bd-f7a11ff81ac1" status: 404 len: 62 microversion: 2.1 time: 0.079673 Oct 30 01:21:01.009619 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2c2d76a9-b454-4d4e-a45f-6ef8a8b428f4 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:01.010433 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2c2d76a9-b454-4d4e-a45f-6ef8a8b428f4 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: c74142c0-5f39-44d8-b754-9c9ee956850a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:01.015524 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1037/2038] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:00 2022] DELETE /compute/v2.1/images/e7d33be2-2763-4cce-92bd-f7a11ff81ac1 => generated 62 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:21:01.028732 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2c2d76a9-b454-4d4e-a45f-6ef8a8b428f4 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:01.029682 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2c2d76a9-b454-4d4e-a45f-6ef8a8b428f4 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:01.031292 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2c2d76a9-b454-4d4e-a45f-6ef8a8b428f4 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:01.032253 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2c2d76a9-b454-4d4e-a45f-6ef8a8b428f4 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:01.035952 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2c2d76a9-b454-4d4e-a45f-6ef8a8b428f4 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:01.036755 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2c2d76a9-b454-4d4e-a45f-6ef8a8b428f4 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:01.074307 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-2c2d76a9-b454-4d4e-a45f-6ef8a8b428f4 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] HTTP exception thrown: Instance c74142c0-5f39-44d8-b754-9c9ee956850a could not be found. Oct 30 01:21:01.083767 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2c2d76a9-b454-4d4e-a45f-6ef8a8b428f4 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Request method failure captured: Oct 30 01:21:01.083767 n-d-master-1 devstack@n-api.service[121103]: request: DELETE /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a HTTP/1.1 Oct 30 01:21:01.083767 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:21:01.083767 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:21:01.083767 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:21:01.083767 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:21:01.083767 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:21:01.083767 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:21:01.083767 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:21:01.083767 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:21:01.083767 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdD3IhIPYY_sTvEXpI9r1a34kazQy3xsqStabQonrlcEF0HpNl2ztWpirnqs0lietV1LWWVyHjCqAxxd5t3TuUU6o10qW3LK2oIPKGmvwXDy1lrrZEL1UVe632zfYCdkIUu5geJi4tWcEpwgvNOLoS3eMkj37BIJt_45I78bzhHVIS8 Oct 30 01:21:01.083767 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:21:01.083767 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:21:01.083767 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:21:01.083767 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:21:01.083767 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:21:01.083767 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:21:01.083767 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 8c2cd7e4b04741e3bb1cb9852612db57 Oct 30 01:21:01.083767 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1966575233 Oct 30 01:21:01.083767 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:21:01.083767 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:21:01.086000 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c2cd7e4b04741e3bb1cb9852612db57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8c2cd7e4b04741e3bb1cb9852612db57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8c2cd7e4b04741e3bb1cb9852612db57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c2cd7e4b04741e3bb1cb9852612db57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:21:01.086000 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1966575233 Oct 30 01:21:01.086000 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 8c2cd7e4b04741e3bb1cb9852612db57 Oct 30 01:21:01.086000 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1966575233 Oct 30 01:21:01.086000 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ImagesOneServerNegativeTestJSON-1966575233-project Oct 30 01:21:01.086000 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:21:01.086000 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:21:01.086000 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: c114d44d0a314c75902da53fca797f62 Oct 30 01:21:01.086000 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1966575233-project Oct 30 01:21:01.086000 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:21:01.086000 n-d-master-1 devstack@n-api.service[121103]: exception: Instance c74142c0-5f39-44d8-b754-9c9ee956850a could not be found. Oct 30 01:21:01.086000 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'c74142c0-5f39-44d8-b754-9c9ee956850a'} Oct 30 01:21:01.087067 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:21:01.087067 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:01.087067 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:21:01.087067 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:21:01.087067 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:21:01.087067 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:21:01.087067 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:21:01.087067 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:21:01.087067 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:21:01.087067 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:21:01.087067 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c74142c0-5f39-44d8-b754-9c9ee956850a could not be found. Oct 30 01:21:01.087067 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:21:01.087067 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:21:01.087067 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:21:01.087067 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:01.087067 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:21:01.087067 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:21:01.087067 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:21:01.087067 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:21:01.087067 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:21:01.089939 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:21:01.089939 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:21:01.089939 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:21:01.089939 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:21:01.089939 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:21:01.089939 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:21:01.089939 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:21:01.089939 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:21:01.089939 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:21:01.089939 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c74142c0-5f39-44d8-b754-9c9ee956850a could not be found. Oct 30 01:21:01.089939 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:21:01.089939 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:21:01.089939 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:21:01.089939 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:01.089939 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:21:01.089939 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:21:01.089939 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:21:01.089939 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:21:01.089939 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c74142c0-5f39-44d8-b754-9c9ee956850a could not be found. Oct 30 01:21:01.089939 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:21:01.110013 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2c2d76a9-b454-4d4e-a45f-6ef8a8b428f4 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Returning 404 to user: Instance c74142c0-5f39-44d8-b754-9c9ee956850a could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:21:01.112769 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2c2d76a9-b454-4d4e-a45f-6ef8a8b428f4 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a" status: 404 len: 111 microversion: 2.1 time: 0.109405 Oct 30 01:21:01.125638 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c3f99ea2-7e01-4e70-a140-e47337bf59e5 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:01.125638 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c3f99ea2-7e01-4e70-a140-e47337bf59e5 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] [instance: c74142c0-5f39-44d8-b754-9c9ee956850a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:01.128523 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1002/2039] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:21:01 2022] DELETE /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 01:21:01.136015 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c3f99ea2-7e01-4e70-a140-e47337bf59e5 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:01.136965 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c3f99ea2-7e01-4e70-a140-e47337bf59e5 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:01.138856 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c3f99ea2-7e01-4e70-a140-e47337bf59e5 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:01.140002 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c3f99ea2-7e01-4e70-a140-e47337bf59e5 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:01.141953 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c3f99ea2-7e01-4e70-a140-e47337bf59e5 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:01.142608 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c3f99ea2-7e01-4e70-a140-e47337bf59e5 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:01.166537 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-c3f99ea2-7e01-4e70-a140-e47337bf59e5 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] HTTP exception thrown: Instance c74142c0-5f39-44d8-b754-9c9ee956850a could not be found. Oct 30 01:21:01.169261 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c3f99ea2-7e01-4e70-a140-e47337bf59e5 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Request method failure captured: Oct 30 01:21:01.169261 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a HTTP/1.1 Oct 30 01:21:01.169261 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:21:01.169261 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:21:01.169261 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:21:01.169261 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:21:01.169261 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:21:01.169261 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:21:01.169261 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:21:01.169261 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:21:01.169261 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdD3IhIPYY_sTvEXpI9r1a34kazQy3xsqStabQonrlcEF0HpNl2ztWpirnqs0lietV1LWWVyHjCqAxxd5t3TuUU6o10qW3LK2oIPKGmvwXDy1lrrZEL1UVe632zfYCdkIUu5geJi4tWcEpwgvNOLoS3eMkj37BIJt_45I78bzhHVIS8 Oct 30 01:21:01.169261 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:21:01.169261 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:21:01.169261 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:21:01.169261 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:21:01.169261 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:21:01.169261 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:21:01.169261 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 8c2cd7e4b04741e3bb1cb9852612db57 Oct 30 01:21:01.169261 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1966575233 Oct 30 01:21:01.169261 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:21:01.169261 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:21:01.171050 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c2cd7e4b04741e3bb1cb9852612db57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8c2cd7e4b04741e3bb1cb9852612db57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8c2cd7e4b04741e3bb1cb9852612db57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c2cd7e4b04741e3bb1cb9852612db57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:21:01.171050 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1966575233 Oct 30 01:21:01.171050 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 8c2cd7e4b04741e3bb1cb9852612db57 Oct 30 01:21:01.171050 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1966575233 Oct 30 01:21:01.171050 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ImagesOneServerNegativeTestJSON-1966575233-project Oct 30 01:21:01.171050 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:21:01.171050 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:21:01.171050 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: c114d44d0a314c75902da53fca797f62 Oct 30 01:21:01.171050 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1966575233-project Oct 30 01:21:01.171050 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:21:01.171050 n-d-master-1 devstack@n-api.service[121102]: exception: Instance c74142c0-5f39-44d8-b754-9c9ee956850a could not be found. Oct 30 01:21:01.171050 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'c74142c0-5f39-44d8-b754-9c9ee956850a'} Oct 30 01:21:01.171929 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:21:01.171929 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:01.171929 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:21:01.171929 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:21:01.171929 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:21:01.171929 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:21:01.171929 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:21:01.171929 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:21:01.171929 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:21:01.171929 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:21:01.171929 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c74142c0-5f39-44d8-b754-9c9ee956850a could not be found. Oct 30 01:21:01.171929 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:01.171929 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:21:01.171929 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:01.171929 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:01.171929 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:21:01.171929 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:21:01.171929 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:21:01.171929 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:21:01.171929 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:21:01.175391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:21:01.175391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:21:01.175391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:21:01.175391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:21:01.175391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:21:01.175391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:21:01.175391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:21:01.175391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c74142c0-5f39-44d8-b754-9c9ee956850a could not be found. Oct 30 01:21:01.175391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:01.175391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:21:01.175391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:01.175391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:01.175391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:21:01.175391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:21:01.175391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:21:01.175391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:21:01.175391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c74142c0-5f39-44d8-b754-9c9ee956850a could not be found. Oct 30 01:21:01.175391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:01.179786 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c3f99ea2-7e01-4e70-a140-e47337bf59e5 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] Returning 404 to user: Instance c74142c0-5f39-44d8-b754-9c9ee956850a could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:21:01.181682 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c3f99ea2-7e01-4e70-a140-e47337bf59e5 tempest-ImagesOneServerNegativeTestJSON-1966575233 tempest-ImagesOneServerNegativeTestJSON-1966575233-project] 10.222.0.13 "GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a" status: 404 len: 111 microversion: 2.1 time: 0.062506 Oct 30 01:21:01.186444 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1038/2040] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:01 2022] GET /compute/v2.1/servers/c74142c0-5f39-44d8-b754-9c9ee956850a => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:21:01.294913 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4fc77d1f-36a8-4a7e-9a12-9566177411f7 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:01.296747 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4fc77d1f-36a8-4a7e-9a12-9566177411f7 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: e7ff7c82-b3f6-4172-be0d-1c67c30db4f7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:01.310891 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4fc77d1f-36a8-4a7e-9a12-9566177411f7 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:01.313194 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4fc77d1f-36a8-4a7e-9a12-9566177411f7 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:01.315417 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4fc77d1f-36a8-4a7e-9a12-9566177411f7 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:01.320129 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4fc77d1f-36a8-4a7e-9a12-9566177411f7 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:01.322552 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4fc77d1f-36a8-4a7e-9a12-9566177411f7 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:01.323319 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4fc77d1f-36a8-4a7e-9a12-9566177411f7 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:01.511179 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f5caeb44-ddfc-4c24-811f-3ae474ee1576 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:01.511805 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f5caeb44-ddfc-4c24-811f-3ae474ee1576 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 5ed38927-680d-4e93-b57a-21fb407c6b33] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:01.520924 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5caeb44-ddfc-4c24-811f-3ae474ee1576 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:01.521460 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5caeb44-ddfc-4c24-811f-3ae474ee1576 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:01.521906 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5caeb44-ddfc-4c24-811f-3ae474ee1576 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:01.522628 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5caeb44-ddfc-4c24-811f-3ae474ee1576 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:01.523080 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5caeb44-ddfc-4c24-811f-3ae474ee1576 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:01.530193 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5caeb44-ddfc-4c24-811f-3ae474ee1576 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:02.171056 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4fc77d1f-36a8-4a7e-9a12-9566177411f7 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:02.183191 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4fc77d1f-36a8-4a7e-9a12-9566177411f7 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7" status: 200 len: 1469 microversion: 2.1 time: 0.894888 Oct 30 01:21:02.214042 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1003/2041] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:01 2022] GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 => generated 1469 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:02.219587 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3e9c356b-0d60-4be8-82c9-b7977c20e962 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:02.220283 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3e9c356b-0d60-4be8-82c9-b7977c20e962 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 22fce0cc-6498-4b95-b265-a44519f4fd9a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:02.232321 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3e9c356b-0d60-4be8-82c9-b7977c20e962 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:02.247243 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3e9c356b-0d60-4be8-82c9-b7977c20e962 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:02.248060 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3e9c356b-0d60-4be8-82c9-b7977c20e962 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:02.249073 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3e9c356b-0d60-4be8-82c9-b7977c20e962 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:02.249797 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3e9c356b-0d60-4be8-82c9-b7977c20e962 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:02.250481 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3e9c356b-0d60-4be8-82c9-b7977c20e962 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:02.280230 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-3e9c356b-0d60-4be8-82c9-b7977c20e962 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] HTTP exception thrown: Instance 22fce0cc-6498-4b95-b265-a44519f4fd9a could not be found. Oct 30 01:21:02.282220 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3e9c356b-0d60-4be8-82c9-b7977c20e962 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Request method failure captured: Oct 30 01:21:02.282220 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/22fce0cc-6498-4b95-b265-a44519f4fd9a HTTP/1.1 Oct 30 01:21:02.282220 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:21:02.282220 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:21:02.282220 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:21:02.282220 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:21:02.282220 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:21:02.282220 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:21:02.282220 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:21:02.282220 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:21:02.282220 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdEZHAwNEyYVN8mbZetD1IgknrDb-nJfmTHtgPgtOr9AeQL99EuTYclSviV8aikzXcemJ-XkTVClxHn6U4xG48gAdXZcIs0fYa7Kdvvi7PzFjDxYMfOtgAp7wAvvVW7kd-J_XMzQX3yJBWm7NW5-QhmguztBnHz9UniQWs2CmNftHaI Oct 30 01:21:02.282220 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:21:02.282220 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:21:02.282220 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:21:02.282220 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:21:02.282220 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:21:02.282220 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:21:02.282220 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 8c95e97cd7e4461682b9028abb568dce Oct 30 01:21:02.282220 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:21:02.282220 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:21:02.282220 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:21:02.284123 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:21:02.284123 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:21:02.284123 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 8c95e97cd7e4461682b9028abb568dce Oct 30 01:21:02.284123 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:21:02.284123 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-DeleteServersTestJSON-1379968241-project Oct 30 01:21:02.284123 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:21:02.284123 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:21:02.284123 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 33691c943ec040ddb04b6648b6e945ab Oct 30 01:21:02.284123 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-DeleteServersTestJSON-1379968241-project Oct 30 01:21:02.284123 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:21:02.284123 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 22fce0cc-6498-4b95-b265-a44519f4fd9a could not be found. Oct 30 01:21:02.284123 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '22fce0cc-6498-4b95-b265-a44519f4fd9a'} Oct 30 01:21:02.285186 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:21:02.285186 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:02.285186 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:21:02.285186 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:21:02.285186 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:21:02.285186 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:21:02.285186 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:21:02.285186 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:21:02.285186 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:21:02.285186 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:21:02.285186 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22fce0cc-6498-4b95-b265-a44519f4fd9a could not be found. Oct 30 01:21:02.285186 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:21:02.285186 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:21:02.285186 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:21:02.285186 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:02.285186 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:21:02.285186 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:21:02.285186 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:21:02.285186 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:21:02.285186 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:21:02.287122 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:21:02.287122 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:21:02.287122 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:21:02.287122 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:21:02.287122 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:21:02.287122 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:21:02.287122 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:21:02.287122 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22fce0cc-6498-4b95-b265-a44519f4fd9a could not be found. Oct 30 01:21:02.287122 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:21:02.287122 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:21:02.287122 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:21:02.287122 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:02.287122 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:21:02.287122 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:21:02.287122 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:21:02.287122 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:21:02.287122 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22fce0cc-6498-4b95-b265-a44519f4fd9a could not be found. Oct 30 01:21:02.287122 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:21:02.289886 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3e9c356b-0d60-4be8-82c9-b7977c20e962 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Returning 404 to user: Instance 22fce0cc-6498-4b95-b265-a44519f4fd9a could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:21:02.291541 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3e9c356b-0d60-4be8-82c9-b7977c20e962 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/22fce0cc-6498-4b95-b265-a44519f4fd9a" status: 404 len: 111 microversion: 2.1 time: 0.076080 Oct 30 01:21:02.292308 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1004/2042] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:02 2022] GET /compute/v2.1/servers/22fce0cc-6498-4b95-b265-a44519f4fd9a => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:21:02.340946 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-21e7c923-373a-40e4-8a44-53d6319388dd tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:02.343527 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-21e7c923-373a-40e4-8a44-53d6319388dd tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0dd3f0e2-2c15-4915-88b0-2df9e312cc4c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:02.366560 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21e7c923-373a-40e4-8a44-53d6319388dd tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:02.366560 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21e7c923-373a-40e4-8a44-53d6319388dd tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:02.366560 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21e7c923-373a-40e4-8a44-53d6319388dd tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:02.366560 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21e7c923-373a-40e4-8a44-53d6319388dd tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:02.366981 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21e7c923-373a-40e4-8a44-53d6319388dd tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:02.367854 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21e7c923-373a-40e4-8a44-53d6319388dd tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:02.486228 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-21e7c923-373a-40e4-8a44-53d6319388dd tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0dd3f0e2-2c15-4915-88b0-2df9e312cc4c] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:21:02.525496 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f5caeb44-ddfc-4c24-811f-3ae474ee1576 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:02.554978 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f5caeb44-ddfc-4c24-811f-3ae474ee1576 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:02.556493 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f5caeb44-ddfc-4c24-811f-3ae474ee1576 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:02.577206 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f5caeb44-ddfc-4c24-811f-3ae474ee1576 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33" status: 200 len: 1485 microversion: 2.25 time: 1.071457 Oct 30 01:21:02.579928 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1039/2043] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:21:01 2022] GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33 => generated 1485 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:21:02.615511 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2ccba200-15c1-4c72-ab3c-3083dc24a8e6 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:02.627206 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2ccba200-15c1-4c72-ab3c-3083dc24a8e6 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:02.656946 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ccba200-15c1-4c72-ab3c-3083dc24a8e6 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:02.677187 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ccba200-15c1-4c72-ab3c-3083dc24a8e6 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:02.678050 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ccba200-15c1-4c72-ab3c-3083dc24a8e6 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:02.679058 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ccba200-15c1-4c72-ab3c-3083dc24a8e6 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:02.679739 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ccba200-15c1-4c72-ab3c-3083dc24a8e6 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:02.680375 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ccba200-15c1-4c72-ab3c-3083dc24a8e6 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:03.002781 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2ccba200-15c1-4c72-ab3c-3083dc24a8e6 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:03.014723 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2ccba200-15c1-4c72-ab3c-3083dc24a8e6 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:03.016270 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2ccba200-15c1-4c72-ab3c-3083dc24a8e6 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:03.031529 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2ccba200-15c1-4c72-ab3c-3083dc24a8e6 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1546 microversion: 2.91 time: 0.450450 Oct 30 01:21:03.041725 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1040/2044] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:21:02 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1546 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:21:03.057657 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d8c9f416-9f90-4acd-ab65-e22e26223250 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:03.060366 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d8c9f416-9f90-4acd-ab65-e22e26223250 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 22fce0cc-6498-4b95-b265-a44519f4fd9a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:03.078836 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8c9f416-9f90-4acd-ab65-e22e26223250 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:03.079412 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8c9f416-9f90-4acd-ab65-e22e26223250 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:03.095699 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8c9f416-9f90-4acd-ab65-e22e26223250 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:03.098207 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8c9f416-9f90-4acd-ab65-e22e26223250 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:03.099445 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8c9f416-9f90-4acd-ab65-e22e26223250 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:03.100067 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8c9f416-9f90-4acd-ab65-e22e26223250 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:03.119055 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-d8c9f416-9f90-4acd-ab65-e22e26223250 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] HTTP exception thrown: Instance 22fce0cc-6498-4b95-b265-a44519f4fd9a could not be found. Oct 30 01:21:03.121979 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d8c9f416-9f90-4acd-ab65-e22e26223250 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Request method failure captured: Oct 30 01:21:03.121979 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/22fce0cc-6498-4b95-b265-a44519f4fd9a/os-volume_attachments HTTP/1.1 Oct 30 01:21:03.121979 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:21:03.121979 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:21:03.121979 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:21:03.121979 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:21:03.121979 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:21:03.121979 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:21:03.121979 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:21:03.121979 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:21:03.121979 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdEZHAwNEyYVN8mbZetD1IgknrDb-nJfmTHtgPgtOr9AeQL99EuTYclSviV8aikzXcemJ-XkTVClxHn6U4xG48gAdXZcIs0fYa7Kdvvi7PzFjDxYMfOtgAp7wAvvVW7kd-J_XMzQX3yJBWm7NW5-QhmguztBnHz9UniQWs2CmNftHaI Oct 30 01:21:03.121979 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:21:03.121979 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:21:03.121979 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:21:03.121979 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:21:03.121979 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:21:03.121979 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:21:03.121979 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 8c95e97cd7e4461682b9028abb568dce Oct 30 01:21:03.121979 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:21:03.121979 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:21:03.121979 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:21:03.123958 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:21:03.123958 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:21:03.123958 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 8c95e97cd7e4461682b9028abb568dce Oct 30 01:21:03.123958 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:21:03.123958 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-DeleteServersTestJSON-1379968241-project Oct 30 01:21:03.123958 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:21:03.123958 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:21:03.123958 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 33691c943ec040ddb04b6648b6e945ab Oct 30 01:21:03.123958 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-DeleteServersTestJSON-1379968241-project Oct 30 01:21:03.123958 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:21:03.123958 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 22fce0cc-6498-4b95-b265-a44519f4fd9a could not be found. Oct 30 01:21:03.123958 n-d-master-1 devstack@n-api.service[121102]: action_args: {'server_id': '22fce0cc-6498-4b95-b265-a44519f4fd9a'} Oct 30 01:21:03.124835 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:21:03.124835 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:03.124835 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:21:03.124835 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:21:03.124835 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:21:03.124835 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:21:03.124835 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:21:03.124835 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:21:03.124835 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:21:03.124835 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:21:03.124835 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22fce0cc-6498-4b95-b265-a44519f4fd9a could not be found. Oct 30 01:21:03.124835 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:03.124835 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:21:03.124835 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:03.124835 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:03.124835 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:21:03.124835 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:21:03.124835 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:21:03.124835 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:21:03.124835 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:21:03.126830 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:21:03.126830 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 30 01:21:03.126830 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:21:03.126830 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 30 01:21:03.126830 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:21:03.126830 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 30 01:21:03.126830 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 30 01:21:03.126830 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:21:03.126830 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:21:03.126830 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22fce0cc-6498-4b95-b265-a44519f4fd9a could not be found. Oct 30 01:21:03.126830 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:03.126830 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:21:03.126830 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:03.126830 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:03.126830 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:21:03.126830 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:21:03.126830 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:21:03.126830 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:21:03.126830 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22fce0cc-6498-4b95-b265-a44519f4fd9a could not be found. Oct 30 01:21:03.126830 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:03.130424 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d8c9f416-9f90-4acd-ab65-e22e26223250 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Returning 404 to user: Instance 22fce0cc-6498-4b95-b265-a44519f4fd9a could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:21:03.131438 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d8c9f416-9f90-4acd-ab65-e22e26223250 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/22fce0cc-6498-4b95-b265-a44519f4fd9a/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.088268 Oct 30 01:21:03.132124 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1041/2045] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 01:21:03 2022] GET /compute/v2.1/servers/22fce0cc-6498-4b95-b265-a44519f4fd9a/os-volume_attachments => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:21:03.139162 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-776913c6-8a52-4eb7-8167-5a132dfaccba req-ccd9d99d-f8f5-4b82-a8d8-7d4a72fb894a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7ff7c82-b3f6-4172-be0d-1c67c30db4f7", "tag": "6187e4ac-5fa7-409a-870a-b11e4dc8fc91"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:21:03.163120 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-776913c6-8a52-4eb7-8167-5a132dfaccba req-ccd9d99d-f8f5-4b82-a8d8-7d4a72fb894a service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:03.163931 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-776913c6-8a52-4eb7-8167-5a132dfaccba req-ccd9d99d-f8f5-4b82-a8d8-7d4a72fb894a service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:03.164562 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-776913c6-8a52-4eb7-8167-5a132dfaccba req-ccd9d99d-f8f5-4b82-a8d8-7d4a72fb894a service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:03.188049 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-776913c6-8a52-4eb7-8167-5a132dfaccba req-ccd9d99d-f8f5-4b82-a8d8-7d4a72fb894a service nova] Creating event network-changed:6187e4ac-5fa7-409a-870a-b11e4dc8fc91 for instance e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 on n-h2-master-1 Oct 30 01:21:03.203011 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-21e7c923-373a-40e4-8a44-53d6319388dd tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c" status: 204 len: 0 microversion: 2.1 time: 0.906944 Oct 30 01:21:03.208092 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1005/2046] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:21:02 2022] DELETE /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c => generated 0 bytes in 910 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:21:03.219798 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cd306582-05ad-4a6e-95d3-2ace5c89fa7e tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:03.223699 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-cd306582-05ad-4a6e-95d3-2ace5c89fa7e tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0dd3f0e2-2c15-4915-88b0-2df9e312cc4c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:03.234468 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [req-776913c6-8a52-4eb7-8167-5a132dfaccba req-ccd9d99d-f8f5-4b82-a8d8-7d4a72fb894a service nova] Instance e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=121102) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 30 01:21:03.241830 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd306582-05ad-4a6e-95d3-2ace5c89fa7e tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:03.244023 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd306582-05ad-4a6e-95d3-2ace5c89fa7e tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:03.247501 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd306582-05ad-4a6e-95d3-2ace5c89fa7e tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:03.248602 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd306582-05ad-4a6e-95d3-2ace5c89fa7e tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:03.249630 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd306582-05ad-4a6e-95d3-2ace5c89fa7e tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:03.251401 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd306582-05ad-4a6e-95d3-2ace5c89fa7e tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:03.281661 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-776913c6-8a52-4eb7-8167-5a132dfaccba req-ccd9d99d-f8f5-4b82-a8d8-7d4a72fb894a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138162 Oct 30 01:21:03.283014 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1042/2047] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:21:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:21:03.302753 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ca8829bd-2d11-4095-a4ff-769b09baa319 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:03.314257 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ca8829bd-2d11-4095-a4ff-769b09baa319 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: e7ff7c82-b3f6-4172-be0d-1c67c30db4f7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:03.348986 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ca8829bd-2d11-4095-a4ff-769b09baa319 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:03.349535 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ca8829bd-2d11-4095-a4ff-769b09baa319 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:03.349985 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ca8829bd-2d11-4095-a4ff-769b09baa319 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:03.351307 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ca8829bd-2d11-4095-a4ff-769b09baa319 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:03.351986 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ca8829bd-2d11-4095-a4ff-769b09baa319 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:03.352618 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ca8829bd-2d11-4095-a4ff-769b09baa319 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:04.570667 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-cd306582-05ad-4a6e-95d3-2ace5c89fa7e tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:04.591899 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cd306582-05ad-4a6e-95d3-2ace5c89fa7e tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c" status: 200 len: 1484 microversion: 2.1 time: 1.382134 Oct 30 01:21:04.592501 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1006/2048] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:03 2022] GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c => generated 1484 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:04.598770 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7e865b71-086d-49eb-831d-4047b39116cb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-52443213", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "19e0e4e2-b502-4a02-810a-996c246e8c64"}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:21:04.692069 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ca8829bd-2d11-4095-a4ff-769b09baa319 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:04.705204 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ca8829bd-2d11-4095-a4ff-769b09baa319 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7" status: 200 len: 1469 microversion: 2.1 time: 1.420247 Oct 30 01:21:04.706099 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1043/2049] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:03 2022] GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 => generated 1469 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:04.713009 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-293f2a11-d39c-4f19-b1c3-fa0687e3c495 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:04.713613 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-293f2a11-d39c-4f19-b1c3-fa0687e3c495 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 5ed38927-680d-4e93-b57a-21fb407c6b33] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:04.743872 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-7e865b71-086d-49eb-831d-4047b39116cb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] validate_networks() for [('19e0e4e2-b502-4a02-810a-996c246e8c64', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:21:04.750820 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-293f2a11-d39c-4f19-b1c3-fa0687e3c495 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:04.752547 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-293f2a11-d39c-4f19-b1c3-fa0687e3c495 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:04.755817 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-293f2a11-d39c-4f19-b1c3-fa0687e3c495 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:04.756824 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-293f2a11-d39c-4f19-b1c3-fa0687e3c495 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:04.757525 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-293f2a11-d39c-4f19-b1c3-fa0687e3c495 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:04.758167 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-293f2a11-d39c-4f19-b1c3-fa0687e3c495 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:05.562621 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-293f2a11-d39c-4f19-b1c3-fa0687e3c495 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:05.577820 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-293f2a11-d39c-4f19-b1c3-fa0687e3c495 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:05.587849 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-293f2a11-d39c-4f19-b1c3-fa0687e3c495 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:05.590640 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-293f2a11-d39c-4f19-b1c3-fa0687e3c495 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33" status: 200 len: 1485 microversion: 2.25 time: 0.881893 Oct 30 01:21:05.591941 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1044/2050] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:21:04 2022] GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33 => generated 1485 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:21:05.605803 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-faed23ba-fb9b-43fc-bb2a-cd2cf6cac366 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:05.608502 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-faed23ba-fb9b-43fc-bb2a-cd2cf6cac366 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:05.626691 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-faed23ba-fb9b-43fc-bb2a-cd2cf6cac366 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:05.630251 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-faed23ba-fb9b-43fc-bb2a-cd2cf6cac366 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:05.631006 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-faed23ba-fb9b-43fc-bb2a-cd2cf6cac366 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:05.635169 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-faed23ba-fb9b-43fc-bb2a-cd2cf6cac366 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:05.635805 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-faed23ba-fb9b-43fc-bb2a-cd2cf6cac366 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:05.636358 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-faed23ba-fb9b-43fc-bb2a-cd2cf6cac366 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:05.830810 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-faed23ba-fb9b-43fc-bb2a-cd2cf6cac366 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:05.878490 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-faed23ba-fb9b-43fc-bb2a-cd2cf6cac366 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:05.891848 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-faed23ba-fb9b-43fc-bb2a-cd2cf6cac366 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:05.914294 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-faed23ba-fb9b-43fc-bb2a-cd2cf6cac366 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1546 microversion: 2.91 time: 0.319983 Oct 30 01:21:05.942248 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1045/2051] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:21:05 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1546 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:21:06.253764 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-092ca9a3-9964-4c6c-9a48-1c53bc54daff tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-348400952", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "6ae09145-3064-454e-ae22-5abe90269604"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:21:06.353107 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-092ca9a3-9964-4c6c-9a48-1c53bc54daff tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] validate_networks() for [('6ae09145-3064-454e-ae22-5abe90269604', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:21:06.727531 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-7e865b71-086d-49eb-831d-4047b39116cb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:21:06.729172 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-7e865b71-086d-49eb-831d-4047b39116cb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:21:06.730105 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-7e865b71-086d-49eb-831d-4047b39116cb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:21:06.731146 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-7e865b71-086d-49eb-831d-4047b39116cb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:21:06.731738 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-7e865b71-086d-49eb-831d-4047b39116cb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:21:06.763492 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7e865b71-086d-49eb-831d-4047b39116cb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:06.766159 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7e865b71-086d-49eb-831d-4047b39116cb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:06.773142 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7e865b71-086d-49eb-831d-4047b39116cb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:06.775412 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7e865b71-086d-49eb-831d-4047b39116cb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:06.776476 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7e865b71-086d-49eb-831d-4047b39116cb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:06.777158 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7e865b71-086d-49eb-831d-4047b39116cb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:06.807607 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-7e865b71-086d-49eb-831d-4047b39116cb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Getting quotas for project 8c95e97cd7e4461682b9028abb568dce. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:21:06.816570 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-7e865b71-086d-49eb-831d-4047b39116cb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Getting quotas for user 33691c943ec040ddb04b6648b6e945ab and project 8c95e97cd7e4461682b9028abb568dce. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:21:06.845819 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7e865b71-086d-49eb-831d-4047b39116cb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:21:06.850387 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7e865b71-086d-49eb-831d-4047b39116cb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 24828782-5e5e-402e-9e2b-644b166cf844] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:21:07.064634 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7e865b71-086d-49eb-831d-4047b39116cb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.469055 Oct 30 01:21:07.070688 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1007/2052] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:21:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2477 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:21:07.088350 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8ae20127-4625-42d2-9ebf-c93bc36118b2 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:07.090913 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8ae20127-4625-42d2-9ebf-c93bc36118b2 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0dd3f0e2-2c15-4915-88b0-2df9e312cc4c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:07.108711 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ae20127-4625-42d2-9ebf-c93bc36118b2 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:07.110263 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ae20127-4625-42d2-9ebf-c93bc36118b2 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:07.112206 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ae20127-4625-42d2-9ebf-c93bc36118b2 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:07.116955 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ae20127-4625-42d2-9ebf-c93bc36118b2 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:07.118487 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ae20127-4625-42d2-9ebf-c93bc36118b2 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:07.119958 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ae20127-4625-42d2-9ebf-c93bc36118b2 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:07.409423 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8ae20127-4625-42d2-9ebf-c93bc36118b2 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:07.419770 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8ae20127-4625-42d2-9ebf-c93bc36118b2 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c" status: 200 len: 1442 microversion: 2.1 time: 0.343982 Oct 30 01:21:07.422661 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1008/2053] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:07 2022] GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c => generated 1442 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:07.440731 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3805fc20-0bdb-40a0-9232-13c797475cf7 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:07.440731 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3805fc20-0bdb-40a0-9232-13c797475cf7 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: e7ff7c82-b3f6-4172-be0d-1c67c30db4f7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:07.471801 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3805fc20-0bdb-40a0-9232-13c797475cf7 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:07.472568 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3805fc20-0bdb-40a0-9232-13c797475cf7 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:07.474334 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3805fc20-0bdb-40a0-9232-13c797475cf7 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:07.475180 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3805fc20-0bdb-40a0-9232-13c797475cf7 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:07.479160 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3805fc20-0bdb-40a0-9232-13c797475cf7 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:07.481272 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3805fc20-0bdb-40a0-9232-13c797475cf7 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:08.555008 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-092ca9a3-9964-4c6c-9a48-1c53bc54daff tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:21:08.556478 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-092ca9a3-9964-4c6c-9a48-1c53bc54daff tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:21:08.557285 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-092ca9a3-9964-4c6c-9a48-1c53bc54daff tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:21:08.557730 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-092ca9a3-9964-4c6c-9a48-1c53bc54daff tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:21:08.558144 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-092ca9a3-9964-4c6c-9a48-1c53bc54daff tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:21:08.558700 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3805fc20-0bdb-40a0-9232-13c797475cf7 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:08.577738 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3805fc20-0bdb-40a0-9232-13c797475cf7 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7" status: 200 len: 1462 microversion: 2.1 time: 1.150166 Oct 30 01:21:08.579206 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1009/2054] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:07 2022] GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 => generated 1462 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:08.593475 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8c0ba6b4-3e69-4a72-85f8-62526197734f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:08.594440 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8c0ba6b4-3e69-4a72-85f8-62526197734f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 5ed38927-680d-4e93-b57a-21fb407c6b33] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:08.595661 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-092ca9a3-9964-4c6c-9a48-1c53bc54daff tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:08.598439 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-092ca9a3-9964-4c6c-9a48-1c53bc54daff tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:08.601295 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-092ca9a3-9964-4c6c-9a48-1c53bc54daff tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:08.612782 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-092ca9a3-9964-4c6c-9a48-1c53bc54daff tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:08.612782 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-092ca9a3-9964-4c6c-9a48-1c53bc54daff tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:08.612782 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-092ca9a3-9964-4c6c-9a48-1c53bc54daff tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:08.613172 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8c0ba6b4-3e69-4a72-85f8-62526197734f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:08.613172 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8c0ba6b4-3e69-4a72-85f8-62526197734f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:08.613172 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8c0ba6b4-3e69-4a72-85f8-62526197734f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:08.613505 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8c0ba6b4-3e69-4a72-85f8-62526197734f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:08.614075 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8c0ba6b4-3e69-4a72-85f8-62526197734f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:08.614351 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8c0ba6b4-3e69-4a72-85f8-62526197734f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:08.654974 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-092ca9a3-9964-4c6c-9a48-1c53bc54daff tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Getting quotas for project a766acde7eab4b05866a2c33f5dd3606. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:21:08.674854 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-092ca9a3-9964-4c6c-9a48-1c53bc54daff tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Getting quotas for user ce9f71f892094c2685b175e111fe7cf9 and project a766acde7eab4b05866a2c33f5dd3606. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:21:08.721873 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-092ca9a3-9964-4c6c-9a48-1c53bc54daff tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:21:08.724406 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-092ca9a3-9964-4c6c-9a48-1c53bc54daff tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] [instance: d190bf6d-50f5-454f-a9fa-4296cd25bddd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:21:08.889855 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-092ca9a3-9964-4c6c-9a48-1c53bc54daff tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.940739 Oct 30 01:21:08.896626 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1046/2055] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:21:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2948 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:21:08.904915 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3d7e2e3d-8df0-44d5-afcd-ff0d35793940 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:08.906130 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3d7e2e3d-8df0-44d5-afcd-ff0d35793940 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:08.934003 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d7e2e3d-8df0-44d5-afcd-ff0d35793940 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:08.934843 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d7e2e3d-8df0-44d5-afcd-ff0d35793940 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:08.935474 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d7e2e3d-8df0-44d5-afcd-ff0d35793940 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:08.936393 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d7e2e3d-8df0-44d5-afcd-ff0d35793940 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:08.938017 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d7e2e3d-8df0-44d5-afcd-ff0d35793940 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:08.938644 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d7e2e3d-8df0-44d5-afcd-ff0d35793940 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:09.045245 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8c0ba6b4-3e69-4a72-85f8-62526197734f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:09.059202 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8c0ba6b4-3e69-4a72-85f8-62526197734f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:09.066354 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8c0ba6b4-3e69-4a72-85f8-62526197734f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:09.067711 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8c0ba6b4-3e69-4a72-85f8-62526197734f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33" status: 200 len: 1485 microversion: 2.25 time: 0.485210 Oct 30 01:21:09.073747 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1010/2056] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:21:08 2022] GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33 => generated 1485 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:21:09.087232 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-992aa554-3ea0-4da6-be2e-7e6c95d583d4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:09.092150 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-992aa554-3ea0-4da6-be2e-7e6c95d583d4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 24828782-5e5e-402e-9e2b-644b166cf844] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:09.108443 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-992aa554-3ea0-4da6-be2e-7e6c95d583d4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:09.109189 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-992aa554-3ea0-4da6-be2e-7e6c95d583d4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:09.110671 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-992aa554-3ea0-4da6-be2e-7e6c95d583d4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:09.114327 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-992aa554-3ea0-4da6-be2e-7e6c95d583d4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:09.115085 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-992aa554-3ea0-4da6-be2e-7e6c95d583d4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:09.117361 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-992aa554-3ea0-4da6-be2e-7e6c95d583d4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:09.133881 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3d7e2e3d-8df0-44d5-afcd-ff0d35793940 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:09.147204 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3d7e2e3d-8df0-44d5-afcd-ff0d35793940 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:09.150877 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3d7e2e3d-8df0-44d5-afcd-ff0d35793940 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:09.182061 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3d7e2e3d-8df0-44d5-afcd-ff0d35793940 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1546 microversion: 2.91 time: 0.282219 Oct 30 01:21:09.182718 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1047/2057] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:21:08 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1546 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:21:09.187688 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-3347f747-c564-4ea5-ac07-edb2e547fced req-965c9d97-57df-4e6e-bcd7-de252d150cb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dd3f0e2-2c15-4915-88b0-2df9e312cc4c", "name": "network-vif-deleted", "tag": "57a305e2-e962-4bb1-a776-09d4a458a514"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:21:09.213968 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-3347f747-c564-4ea5-ac07-edb2e547fced req-965c9d97-57df-4e6e-bcd7-de252d150cb7 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:09.214600 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-3347f747-c564-4ea5-ac07-edb2e547fced req-965c9d97-57df-4e6e-bcd7-de252d150cb7 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:09.215117 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-3347f747-c564-4ea5-ac07-edb2e547fced req-965c9d97-57df-4e6e-bcd7-de252d150cb7 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:09.248351 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-3347f747-c564-4ea5-ac07-edb2e547fced req-965c9d97-57df-4e6e-bcd7-de252d150cb7 service nova] Creating event network-vif-deleted:57a305e2-e962-4bb1-a776-09d4a458a514 for instance 0dd3f0e2-2c15-4915-88b0-2df9e312cc4c on n-h2-master-1 Oct 30 01:21:09.260366 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-3347f747-c564-4ea5-ac07-edb2e547fced req-965c9d97-57df-4e6e-bcd7-de252d150cb7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076101 Oct 30 01:21:09.261826 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1048/2058] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:21:09.267222 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-dcf07587-9515-4f17-b4d6-330d91995d26 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:09.268032 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-dcf07587-9515-4f17-b4d6-330d91995d26 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0dd3f0e2-2c15-4915-88b0-2df9e312cc4c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:09.276781 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-992aa554-3ea0-4da6-be2e-7e6c95d583d4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:09.288911 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-992aa554-3ea0-4da6-be2e-7e6c95d583d4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/24828782-5e5e-402e-9e2b-644b166cf844" status: 200 len: 1217 microversion: 2.1 time: 0.210777 Oct 30 01:21:09.291404 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1011/2059] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:09 2022] GET /compute/v2.1/servers/24828782-5e5e-402e-9e2b-644b166cf844 => generated 1217 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:09.313369 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dcf07587-9515-4f17-b4d6-330d91995d26 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:09.314251 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dcf07587-9515-4f17-b4d6-330d91995d26 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:09.314707 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dcf07587-9515-4f17-b4d6-330d91995d26 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:09.315444 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dcf07587-9515-4f17-b4d6-330d91995d26 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:09.315903 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dcf07587-9515-4f17-b4d6-330d91995d26 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:09.316549 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dcf07587-9515-4f17-b4d6-330d91995d26 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:09.381702 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dcf07587-9515-4f17-b4d6-330d91995d26 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:09.382247 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dcf07587-9515-4f17-b4d6-330d91995d26 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:09.385433 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dcf07587-9515-4f17-b4d6-330d91995d26 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:09.386125 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-dcf07587-9515-4f17-b4d6-330d91995d26 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lazy-loading 'fault' on Instance uuid 0dd3f0e2-2c15-4915-88b0-2df9e312cc4c {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:21:09.539888 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-dcf07587-9515-4f17-b4d6-330d91995d26 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:09.549977 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-dcf07587-9515-4f17-b4d6-330d91995d26 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c" status: 200 len: 1301 microversion: 2.1 time: 0.286679 Oct 30 01:21:09.572242 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1049/2060] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:09 2022] GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c => generated 1301 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:09.605541 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a5dd84b9-92d2-4d9e-b02c-5209e83ce66e tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:09.608344 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a5dd84b9-92d2-4d9e-b02c-5209e83ce66e tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] [instance: d190bf6d-50f5-454f-a9fa-4296cd25bddd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:09.630406 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1f2219a6-f7eb-44e5-a2f4-a8ac04c90ce2 tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:09.631054 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1f2219a6-f7eb-44e5-a2f4-a8ac04c90ce2 tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] [instance: e7ff7c82-b3f6-4172-be0d-1c67c30db4f7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:09.647541 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1f2219a6-f7eb-44e5-a2f4-a8ac04c90ce2 tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:09.648447 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1f2219a6-f7eb-44e5-a2f4-a8ac04c90ce2 tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:09.649206 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1f2219a6-f7eb-44e5-a2f4-a8ac04c90ce2 tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:09.650565 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1f2219a6-f7eb-44e5-a2f4-a8ac04c90ce2 tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:09.651337 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1f2219a6-f7eb-44e5-a2f4-a8ac04c90ce2 tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:09.651831 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1f2219a6-f7eb-44e5-a2f4-a8ac04c90ce2 tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:09.954999 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a5dd84b9-92d2-4d9e-b02c-5209e83ce66e tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9f71f892094c2685b175e111fe7cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a766acde7eab4b05866a2c33f5dd3606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:09.963971 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a5dd84b9-92d2-4d9e-b02c-5209e83ce66e tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] 10.222.0.13 "GET /compute/v2.1/servers/d190bf6d-50f5-454f-a9fa-4296cd25bddd" status: 200 len: 1216 microversion: 2.1 time: 0.389328 Oct 30 01:21:09.973201 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1050/2061] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:09 2022] GET /compute/v2.1/servers/d190bf6d-50f5-454f-a9fa-4296cd25bddd => generated 1216 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:09.991099 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-bff089ab-0648-4c86-b753-606aa1688170 req-92847004-e2db-4aeb-9cbf-1f18c78646f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7ff7c82-b3f6-4172-be0d-1c67c30db4f7", "name": "network-vif-plugged", "status": "completed", "tag": "6187e4ac-5fa7-409a-870a-b11e4dc8fc91"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:21:10.015000 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-bff089ab-0648-4c86-b753-606aa1688170 req-92847004-e2db-4aeb-9cbf-1f18c78646f6 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:10.015670 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-bff089ab-0648-4c86-b753-606aa1688170 req-92847004-e2db-4aeb-9cbf-1f18c78646f6 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:10.016287 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-bff089ab-0648-4c86-b753-606aa1688170 req-92847004-e2db-4aeb-9cbf-1f18c78646f6 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:10.033586 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-bff089ab-0648-4c86-b753-606aa1688170 req-92847004-e2db-4aeb-9cbf-1f18c78646f6 service nova] Creating event network-vif-plugged:6187e4ac-5fa7-409a-870a-b11e4dc8fc91 for instance e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 on n-h2-master-1 Oct 30 01:21:10.040310 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-bff089ab-0648-4c86-b753-606aa1688170 req-92847004-e2db-4aeb-9cbf-1f18c78646f6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068621 Oct 30 01:21:10.041416 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1051/2062] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:21:10.047845 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fe588334-8e7b-49a1-a4c8-8b2f0e151f07 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:10.054664 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fe588334-8e7b-49a1-a4c8-8b2f0e151f07 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 24828782-5e5e-402e-9e2b-644b166cf844] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:10.067554 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fe588334-8e7b-49a1-a4c8-8b2f0e151f07 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:10.069215 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fe588334-8e7b-49a1-a4c8-8b2f0e151f07 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:10.069985 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fe588334-8e7b-49a1-a4c8-8b2f0e151f07 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:10.073146 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fe588334-8e7b-49a1-a4c8-8b2f0e151f07 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:10.074088 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fe588334-8e7b-49a1-a4c8-8b2f0e151f07 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:10.074911 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fe588334-8e7b-49a1-a4c8-8b2f0e151f07 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:10.094187 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1f2219a6-f7eb-44e5-a2f4-a8ac04c90ce2 tempest-MigrationsAdminTest-807149175 tempest-MigrationsAdminTest-807149175-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7" status: 200 len: 1613 microversion: 2.1 time: 0.801384 Oct 30 01:21:10.118253 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1012/2063] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:09 2022] GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 => generated 1613 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:10.123987 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fe588334-8e7b-49a1-a4c8-8b2f0e151f07 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 24828782-5e5e-402e-9e2b-644b166cf844] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:21:10.126626 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-88512503-2708-41c0-aab4-a9477e4635ce tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:10.127252 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-88512503-2708-41c0-aab4-a9477e4635ce tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 5ed38927-680d-4e93-b57a-21fb407c6b33] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:10.139729 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fe588334-8e7b-49a1-a4c8-8b2f0e151f07 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:10.140303 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fe588334-8e7b-49a1-a4c8-8b2f0e151f07 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:10.143420 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fe588334-8e7b-49a1-a4c8-8b2f0e151f07 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:10.153513 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-88512503-2708-41c0-aab4-a9477e4635ce tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:10.154120 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-88512503-2708-41c0-aab4-a9477e4635ce tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:10.154570 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-88512503-2708-41c0-aab4-a9477e4635ce tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:10.158205 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-88512503-2708-41c0-aab4-a9477e4635ce tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:10.158699 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-88512503-2708-41c0-aab4-a9477e4635ce tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:10.162291 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-88512503-2708-41c0-aab4-a9477e4635ce tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:10.232947 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-fe588334-8e7b-49a1-a4c8-8b2f0e151f07 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lazy-loading 'flavor' on Instance uuid 24828782-5e5e-402e-9e2b-644b166cf844 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:21:10.335343 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-fe588334-8e7b-49a1-a4c8-8b2f0e151f07 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lazy-loading 'system_metadata' on Instance uuid 24828782-5e5e-402e-9e2b-644b166cf844 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:21:10.439916 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-fe588334-8e7b-49a1-a4c8-8b2f0e151f07 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lazy-loading 'metadata' on Instance uuid 24828782-5e5e-402e-9e2b-644b166cf844 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:21:10.581945 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-88512503-2708-41c0-aab4-a9477e4635ce tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:10.606198 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-88512503-2708-41c0-aab4-a9477e4635ce tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:10.608314 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-88512503-2708-41c0-aab4-a9477e4635ce tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:10.609897 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-88512503-2708-41c0-aab4-a9477e4635ce tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33" status: 200 len: 1485 microversion: 2.25 time: 0.487300 Oct 30 01:21:10.618691 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1013/2064] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:21:10 2022] GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33 => generated 1485 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:21:10.627349 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-eea1ecc0-565f-455e-a603-996a6a6d7c52 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:10.630055 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-eea1ecc0-565f-455e-a603-996a6a6d7c52 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: e7ff7c82-b3f6-4172-be0d-1c67c30db4f7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:10.646707 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eea1ecc0-565f-455e-a603-996a6a6d7c52 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:10.648069 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eea1ecc0-565f-455e-a603-996a6a6d7c52 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:10.649111 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eea1ecc0-565f-455e-a603-996a6a6d7c52 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:10.650272 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eea1ecc0-565f-455e-a603-996a6a6d7c52 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:10.650848 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eea1ecc0-565f-455e-a603-996a6a6d7c52 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:10.651632 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eea1ecc0-565f-455e-a603-996a6a6d7c52 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:10.669456 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fe588334-8e7b-49a1-a4c8-8b2f0e151f07 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:10.675867 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fe588334-8e7b-49a1-a4c8-8b2f0e151f07 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:10.676623 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fe588334-8e7b-49a1-a4c8-8b2f0e151f07 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:10.717362 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-eea1ecc0-565f-455e-a603-996a6a6d7c52 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: e7ff7c82-b3f6-4172-be0d-1c67c30db4f7] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:21:10.777669 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:10.991545 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:11.214738 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fe588334-8e7b-49a1-a4c8-8b2f0e151f07 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "DELETE /compute/v2.1/servers/24828782-5e5e-402e-9e2b-644b166cf844" status: 204 len: 0 microversion: 2.1 time: 1.171209 Oct 30 01:21:11.218403 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-eea1ecc0-565f-455e-a603-996a6a6d7c52 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7" status: 204 len: 0 microversion: 2.1 time: 0.597951 Oct 30 01:21:11.219005 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1052/2065] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:21:10 2022] DELETE /compute/v2.1/servers/24828782-5e5e-402e-9e2b-644b166cf844 => generated 0 bytes in 1174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:21:11.219967 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1014/2066] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:21:10 2022] DELETE /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:21:11.226163 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6e8025c4-9347-4f76-87d2-2f32d7a1b8b7 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:11.226899 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6e8025c4-9347-4f76-87d2-2f32d7a1b8b7 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:11.234651 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b4358618-039b-4564-a681-bc16cc149ca8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:11.241479 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b4358618-039b-4564-a681-bc16cc149ca8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 0dd3f0e2-2c15-4915-88b0-2df9e312cc4c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:11.241644 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:11.246625 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e8025c4-9347-4f76-87d2-2f32d7a1b8b7 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:11.247132 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e8025c4-9347-4f76-87d2-2f32d7a1b8b7 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:11.247575 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e8025c4-9347-4f76-87d2-2f32d7a1b8b7 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:11.253449 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4358618-039b-4564-a681-bc16cc149ca8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:11.253971 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4358618-039b-4564-a681-bc16cc149ca8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:11.254421 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4358618-039b-4564-a681-bc16cc149ca8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:11.254590 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e8025c4-9347-4f76-87d2-2f32d7a1b8b7 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:11.255380 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e8025c4-9347-4f76-87d2-2f32d7a1b8b7 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:11.256066 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e8025c4-9347-4f76-87d2-2f32d7a1b8b7 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:11.257847 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4358618-039b-4564-a681-bc16cc149ca8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:11.258523 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4358618-039b-4564-a681-bc16cc149ca8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:11.259687 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4358618-039b-4564-a681-bc16cc149ca8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:11.320914 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-b4358618-039b-4564-a681-bc16cc149ca8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] HTTP exception thrown: Instance 0dd3f0e2-2c15-4915-88b0-2df9e312cc4c could not be found. Oct 30 01:21:11.327613 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b4358618-039b-4564-a681-bc16cc149ca8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Request method failure captured: Oct 30 01:21:11.327613 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c HTTP/1.1 Oct 30 01:21:11.327613 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:21:11.327613 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:21:11.327613 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:21:11.327613 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:21:11.327613 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:21:11.327613 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:21:11.327613 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:21:11.327613 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:21:11.327613 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXc_KQ69GfMeJ3jN4J1TPXQ8bGOBoI0WTBTMDe__y-DAo2JjL2ORnQbmCeuZLneRCYcs3kYLHyIaNHHXu_K6nKvgKp3dW6RkvCZlVFmQEQtSKQwNbPyCCeYKzvViBngiAhBCQkceHgL-negWQA5TNaEjJqlsKIeoNOaaRa4HQnkUFlGY Oct 30 01:21:11.327613 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:21:11.327613 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:21:11.327613 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:21:11.327613 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:21:11.327613 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:21:11.327613 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:21:11.327613 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 283e7fd477334b879db6b49ee5cc509f Oct 30 01:21:11.327613 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-LiveMigrationTest-879299357 Oct 30 01:21:11.327613 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:21:11.327613 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:21:11.329355 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/283e7fd477334b879db6b49ee5cc509f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_283e7fd477334b879db6b49ee5cc509f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/283e7fd477334b879db6b49ee5cc509f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/283e7fd477334b879db6b49ee5cc509f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:21:11.329355 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-LiveMigrationTest-879299357 Oct 30 01:21:11.329355 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 283e7fd477334b879db6b49ee5cc509f Oct 30 01:21:11.329355 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-LiveMigrationTest-879299357 Oct 30 01:21:11.329355 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-LiveMigrationTest-879299357-project Oct 30 01:21:11.329355 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:21:11.329355 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:21:11.329355 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: c7334417689847d18bc4c1b27d173a23 Oct 30 01:21:11.329355 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-LiveMigrationTest-879299357-project Oct 30 01:21:11.329355 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:21:11.329355 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 0dd3f0e2-2c15-4915-88b0-2df9e312cc4c could not be found. Oct 30 01:21:11.329355 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '0dd3f0e2-2c15-4915-88b0-2df9e312cc4c'} Oct 30 01:21:11.330249 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:21:11.330249 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:11.330249 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:21:11.330249 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:21:11.330249 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:21:11.330249 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:21:11.330249 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:21:11.330249 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:21:11.330249 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:21:11.330249 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:21:11.330249 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dd3f0e2-2c15-4915-88b0-2df9e312cc4c could not be found. Oct 30 01:21:11.330249 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:21:11.330249 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:21:11.330249 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:21:11.330249 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:11.330249 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:21:11.330249 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:21:11.330249 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:21:11.330249 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:21:11.330249 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:21:11.331646 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:21:11.331646 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:21:11.331646 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:21:11.331646 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:21:11.331646 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:21:11.331646 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:21:11.331646 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:21:11.331646 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dd3f0e2-2c15-4915-88b0-2df9e312cc4c could not be found. Oct 30 01:21:11.331646 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:21:11.331646 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:21:11.331646 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:21:11.331646 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:11.331646 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:21:11.331646 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:21:11.331646 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:21:11.331646 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:21:11.331646 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dd3f0e2-2c15-4915-88b0-2df9e312cc4c could not be found. Oct 30 01:21:11.331646 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:21:11.338270 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b4358618-039b-4564-a681-bc16cc149ca8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Returning 404 to user: Instance 0dd3f0e2-2c15-4915-88b0-2df9e312cc4c could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:21:11.343480 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b4358618-039b-4564-a681-bc16cc149ca8 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c" status: 404 len: 111 microversion: 2.1 time: 0.117887 Oct 30 01:21:11.350942 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1015/2067] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:11 2022] GET /compute/v2.1/servers/0dd3f0e2-2c15-4915-88b0-2df9e312cc4c => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:21:11.362129 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-32d72c5d-3bf2-4975-8301-6c5a1a75f12b tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:11.363051 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-32d72c5d-3bf2-4975-8301-6c5a1a75f12b tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] [instance: d190bf6d-50f5-454f-a9fa-4296cd25bddd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:11.378955 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-32d72c5d-3bf2-4975-8301-6c5a1a75f12b tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:11.384740 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-32d72c5d-3bf2-4975-8301-6c5a1a75f12b tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:11.385209 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-32d72c5d-3bf2-4975-8301-6c5a1a75f12b tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:11.386006 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-32d72c5d-3bf2-4975-8301-6c5a1a75f12b tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:11.386478 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-32d72c5d-3bf2-4975-8301-6c5a1a75f12b tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:11.386909 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-32d72c5d-3bf2-4975-8301-6c5a1a75f12b tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:11.465218 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6e8025c4-9347-4f76-87d2-2f32d7a1b8b7 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:11.478553 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6e8025c4-9347-4f76-87d2-2f32d7a1b8b7 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:11.482472 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6e8025c4-9347-4f76-87d2-2f32d7a1b8b7 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:11.495014 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6e8025c4-9347-4f76-87d2-2f32d7a1b8b7 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1546 microversion: 2.91 time: 0.274642 Oct 30 01:21:11.515639 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1053/2068] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:21:11 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1546 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:21:11.522167 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-32d72c5d-3bf2-4975-8301-6c5a1a75f12b tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9f71f892094c2685b175e111fe7cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a766acde7eab4b05866a2c33f5dd3606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:11.530760 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d0e2c3c0-387d-4445-9602-4b76273485ac tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:11.531392 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d0e2c3c0-387d-4445-9602-4b76273485ac tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 24828782-5e5e-402e-9e2b-644b166cf844] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:11.537292 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-32d72c5d-3bf2-4975-8301-6c5a1a75f12b tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] 10.222.0.13 "GET /compute/v2.1/servers/d190bf6d-50f5-454f-a9fa-4296cd25bddd" status: 200 len: 1220 microversion: 2.1 time: 0.184871 Oct 30 01:21:11.549618 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1016/2069] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:11 2022] GET /compute/v2.1/servers/d190bf6d-50f5-454f-a9fa-4296cd25bddd => generated 1220 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:11.549744 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d0e2c3c0-387d-4445-9602-4b76273485ac tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:11.549744 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d0e2c3c0-387d-4445-9602-4b76273485ac tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:11.549744 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d0e2c3c0-387d-4445-9602-4b76273485ac tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:11.549744 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d0e2c3c0-387d-4445-9602-4b76273485ac tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:11.550850 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d0e2c3c0-387d-4445-9602-4b76273485ac tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:11.551325 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d0e2c3c0-387d-4445-9602-4b76273485ac tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:11.559629 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8e945344-77b7-4515-9944-6fb605862435 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:11.560105 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8e945344-77b7-4515-9944-6fb605862435 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: e7ff7c82-b3f6-4172-be0d-1c67c30db4f7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:11.575551 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8e945344-77b7-4515-9944-6fb605862435 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:11.578340 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8e945344-77b7-4515-9944-6fb605862435 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:11.578922 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8e945344-77b7-4515-9944-6fb605862435 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:11.579851 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8e945344-77b7-4515-9944-6fb605862435 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:11.581577 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8e945344-77b7-4515-9944-6fb605862435 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:11.583197 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8e945344-77b7-4515-9944-6fb605862435 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:11.706335 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d0e2c3c0-387d-4445-9602-4b76273485ac tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:11.714938 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d0e2c3c0-387d-4445-9602-4b76273485ac tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/24828782-5e5e-402e-9e2b-644b166cf844" status: 200 len: 1271 microversion: 2.1 time: 0.197785 Oct 30 01:21:11.731530 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1054/2070] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:11 2022] GET /compute/v2.1/servers/24828782-5e5e-402e-9e2b-644b166cf844 => generated 1271 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:11.738177 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c28885ce-94fc-47a9-bcc1-fe252304c3a9 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:11.738990 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c28885ce-94fc-47a9-bcc1-fe252304c3a9 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 7e81dcfb-dcbe-4e05-91a4-541ff2c404ae] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:11.745721 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c28885ce-94fc-47a9-bcc1-fe252304c3a9 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:11.746560 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c28885ce-94fc-47a9-bcc1-fe252304c3a9 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:11.747294 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c28885ce-94fc-47a9-bcc1-fe252304c3a9 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:11.748326 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c28885ce-94fc-47a9-bcc1-fe252304c3a9 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:11.748991 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c28885ce-94fc-47a9-bcc1-fe252304c3a9 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:11.749707 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c28885ce-94fc-47a9-bcc1-fe252304c3a9 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:11.799256 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c28885ce-94fc-47a9-bcc1-fe252304c3a9 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 7e81dcfb-dcbe-4e05-91a4-541ff2c404ae] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:21:12.020318 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8e945344-77b7-4515-9944-6fb605862435 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:12.029201 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8e945344-77b7-4515-9944-6fb605862435 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7" status: 200 len: 1468 microversion: 2.1 time: 0.486605 Oct 30 01:21:12.037540 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1017/2071] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:11 2022] GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 => generated 1468 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:12.057712 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-307622ad-2690-4928-8b6d-9738e7bdd048 req-848a0aed-d96a-422d-85ee-a3575aa70b47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ed38927-680d-4e93-b57a-21fb407c6b33", "name": "network-vif-unplugged", "status": "completed", "tag": "1e47508a-754d-4221-8472-e44defed87c1"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:21:12.107263 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-307622ad-2690-4928-8b6d-9738e7bdd048 req-848a0aed-d96a-422d-85ee-a3575aa70b47 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:12.109084 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-307622ad-2690-4928-8b6d-9738e7bdd048 req-848a0aed-d96a-422d-85ee-a3575aa70b47 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:12.109576 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-307622ad-2690-4928-8b6d-9738e7bdd048 req-848a0aed-d96a-422d-85ee-a3575aa70b47 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:12.138212 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-307622ad-2690-4928-8b6d-9738e7bdd048 req-848a0aed-d96a-422d-85ee-a3575aa70b47 service nova] Creating event network-vif-unplugged:1e47508a-754d-4221-8472-e44defed87c1 for instance 5ed38927-680d-4e93-b57a-21fb407c6b33 on n-h1-master-1 Oct 30 01:21:12.148167 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-307622ad-2690-4928-8b6d-9738e7bdd048 req-848a0aed-d96a-422d-85ee-a3575aa70b47 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108963 Oct 30 01:21:12.149486 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1018/2072] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:21:12.163808 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-947e13a0-840f-46e2-a42f-d25f2efea380 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:12.175240 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-947e13a0-840f-46e2-a42f-d25f2efea380 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 5ed38927-680d-4e93-b57a-21fb407c6b33] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:12.187826 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-947e13a0-840f-46e2-a42f-d25f2efea380 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:12.188802 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-947e13a0-840f-46e2-a42f-d25f2efea380 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:12.189563 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-947e13a0-840f-46e2-a42f-d25f2efea380 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:12.190532 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-947e13a0-840f-46e2-a42f-d25f2efea380 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:12.191224 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-947e13a0-840f-46e2-a42f-d25f2efea380 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:12.192187 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-947e13a0-840f-46e2-a42f-d25f2efea380 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:12.380716 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c28885ce-94fc-47a9-bcc1-fe252304c3a9 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae" status: 204 len: 0 microversion: 2.1 time: 0.645459 Oct 30 01:21:12.382103 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1055/2073] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:21:11 2022] DELETE /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae => generated 0 bytes in 650 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:21:12.392248 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6fbf0783-2509-4b30-b8d0-b2f4d95d1f1b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:12.393120 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6fbf0783-2509-4b30-b8d0-b2f4d95d1f1b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 7e81dcfb-dcbe-4e05-91a4-541ff2c404ae] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:12.405182 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6fbf0783-2509-4b30-b8d0-b2f4d95d1f1b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:12.406013 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6fbf0783-2509-4b30-b8d0-b2f4d95d1f1b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:12.406686 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6fbf0783-2509-4b30-b8d0-b2f4d95d1f1b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:12.408329 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6fbf0783-2509-4b30-b8d0-b2f4d95d1f1b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:12.409039 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6fbf0783-2509-4b30-b8d0-b2f4d95d1f1b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:12.409963 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6fbf0783-2509-4b30-b8d0-b2f4d95d1f1b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:12.720898 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-947e13a0-840f-46e2-a42f-d25f2efea380 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:12.740613 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-947e13a0-840f-46e2-a42f-d25f2efea380 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:12.752903 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-947e13a0-840f-46e2-a42f-d25f2efea380 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:12.752903 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-947e13a0-840f-46e2-a42f-d25f2efea380 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33" status: 200 len: 1485 microversion: 2.25 time: 0.598551 Oct 30 01:21:12.752903 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1019/2074] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:21:12 2022] GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33 => generated 1485 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:21:12.762285 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ba6aa31e-c151-4563-8df4-2444cc264fef tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:12.762912 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ba6aa31e-c151-4563-8df4-2444cc264fef tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:12.782445 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ba6aa31e-c151-4563-8df4-2444cc264fef tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:12.782947 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ba6aa31e-c151-4563-8df4-2444cc264fef tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:12.783398 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ba6aa31e-c151-4563-8df4-2444cc264fef tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:12.784206 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ba6aa31e-c151-4563-8df4-2444cc264fef tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:12.784952 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ba6aa31e-c151-4563-8df4-2444cc264fef tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:12.786047 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ba6aa31e-c151-4563-8df4-2444cc264fef tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:12.822920 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6fbf0783-2509-4b30-b8d0-b2f4d95d1f1b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:12.833989 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6fbf0783-2509-4b30-b8d0-b2f4d95d1f1b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae" status: 200 len: 1499 microversion: 2.1 time: 0.446771 Oct 30 01:21:12.834889 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1056/2075] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:12 2022] GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae => generated 1499 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:21:12.849392 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ce8ac166-3b37-417c-87c4-ad3847f387f5 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:12.854235 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ce8ac166-3b37-417c-87c4-ad3847f387f5 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] [instance: d190bf6d-50f5-454f-a9fa-4296cd25bddd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:12.861191 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce8ac166-3b37-417c-87c4-ad3847f387f5 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:12.862005 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce8ac166-3b37-417c-87c4-ad3847f387f5 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:12.862670 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce8ac166-3b37-417c-87c4-ad3847f387f5 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:12.863757 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce8ac166-3b37-417c-87c4-ad3847f387f5 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:12.864596 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce8ac166-3b37-417c-87c4-ad3847f387f5 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:12.865188 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce8ac166-3b37-417c-87c4-ad3847f387f5 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:12.888333 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ba6aa31e-c151-4563-8df4-2444cc264fef tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:12.912924 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ba6aa31e-c151-4563-8df4-2444cc264fef tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:12.916004 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ba6aa31e-c151-4563-8df4-2444cc264fef tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:12.923052 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ba6aa31e-c151-4563-8df4-2444cc264fef tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1533 microversion: 2.91 time: 0.168332 Oct 30 01:21:12.934937 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1020/2076] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:21:12 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1533 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:21:12.956407 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-507d2de3-2060-4a0e-b765-78cf74257e5c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:12.959373 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-507d2de3-2060-4a0e-b765-78cf74257e5c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 24828782-5e5e-402e-9e2b-644b166cf844] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:12.970161 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-507d2de3-2060-4a0e-b765-78cf74257e5c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:12.976323 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-507d2de3-2060-4a0e-b765-78cf74257e5c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:12.976323 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-507d2de3-2060-4a0e-b765-78cf74257e5c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:12.976323 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-507d2de3-2060-4a0e-b765-78cf74257e5c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:12.976323 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-507d2de3-2060-4a0e-b765-78cf74257e5c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:12.976795 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-507d2de3-2060-4a0e-b765-78cf74257e5c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:13.180811 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-507d2de3-2060-4a0e-b765-78cf74257e5c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:13.198561 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-507d2de3-2060-4a0e-b765-78cf74257e5c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/24828782-5e5e-402e-9e2b-644b166cf844" status: 200 len: 1215 microversion: 2.1 time: 0.259566 Oct 30 01:21:13.202376 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1021/2077] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:12 2022] GET /compute/v2.1/servers/24828782-5e5e-402e-9e2b-644b166cf844 => generated 1215 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:13.215405 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e55a4263-f8ad-4ce2-b511-163e13a2b109 tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:13.216429 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e55a4263-f8ad-4ce2-b511-163e13a2b109 tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:13.238810 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e55a4263-f8ad-4ce2-b511-163e13a2b109 tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:13.239376 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e55a4263-f8ad-4ce2-b511-163e13a2b109 tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:13.239836 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e55a4263-f8ad-4ce2-b511-163e13a2b109 tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:13.242963 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e55a4263-f8ad-4ce2-b511-163e13a2b109 tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:13.245889 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e55a4263-f8ad-4ce2-b511-163e13a2b109 tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:13.249229 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e55a4263-f8ad-4ce2-b511-163e13a2b109 tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:13.321404 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ce8ac166-3b37-417c-87c4-ad3847f387f5 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9f71f892094c2685b175e111fe7cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a766acde7eab4b05866a2c33f5dd3606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:13.334187 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ce8ac166-3b37-417c-87c4-ad3847f387f5 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] 10.222.0.13 "GET /compute/v2.1/servers/d190bf6d-50f5-454f-a9fa-4296cd25bddd" status: 200 len: 1212 microversion: 2.1 time: 0.496901 Oct 30 01:21:13.335163 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1057/2078] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:12 2022] GET /compute/v2.1/servers/d190bf6d-50f5-454f-a9fa-4296cd25bddd => generated 1212 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:13.346010 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cb27874a-d2ad-4814-a62a-a3d2c1520ebf tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:13.347914 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cb27874a-d2ad-4814-a62a-a3d2c1520ebf tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: e7ff7c82-b3f6-4172-be0d-1c67c30db4f7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:13.364148 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cb27874a-d2ad-4814-a62a-a3d2c1520ebf tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:13.364469 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cb27874a-d2ad-4814-a62a-a3d2c1520ebf tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:13.365069 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cb27874a-d2ad-4814-a62a-a3d2c1520ebf tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:13.365825 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cb27874a-d2ad-4814-a62a-a3d2c1520ebf tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:13.368020 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cb27874a-d2ad-4814-a62a-a3d2c1520ebf tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:13.368020 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cb27874a-d2ad-4814-a62a-a3d2c1520ebf tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:13.486576 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-e55a4263-f8ad-4ce2-b511-163e13a2b109 tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] Lazy-loading 'services' on Instance uuid 7f48eff5-378b-4991-be0f-3657d6af305d {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:21:13.528188 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=2,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:13.546342 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e55a4263-f8ad-4ce2-b511-163e13a2b109 tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1938 microversion: 2.91 time: 0.332504 Oct 30 01:21:13.550125 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1022/2079] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:21:13 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1938 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:21:13.585462 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-acd01512-2533-444f-81bc-0523f7150f35 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:21:13.586248 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-acd01512-2533-444f-81bc-0523f7150f35 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:13.596556 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-acd01512-2533-444f-81bc-0523f7150f35 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:13.602121 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-acd01512-2533-444f-81bc-0523f7150f35 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:13.603941 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-acd01512-2533-444f-81bc-0523f7150f35 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:13.609631 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-acd01512-2533-444f-81bc-0523f7150f35 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:13.610764 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-acd01512-2533-444f-81bc-0523f7150f35 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:13.611712 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-acd01512-2533-444f-81bc-0523f7150f35 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:13.670681 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-acd01512-2533-444f-81bc-0523f7150f35 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lazy-loading 'flavor' on Instance uuid 7f48eff5-378b-4991-be0f-3657d6af305d {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:21:13.752541 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-cb27874a-d2ad-4814-a62a-a3d2c1520ebf tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:13.770730 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cb27874a-d2ad-4814-a62a-a3d2c1520ebf tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7" status: 200 len: 1468 microversion: 2.1 time: 0.434297 Oct 30 01:21:13.786381 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1058/2080] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:13 2022] GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 => generated 1468 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:13.796588 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0a9da0ff-d462-4007-b8ba-fb36ef6327c1 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:13.797636 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0a9da0ff-d462-4007-b8ba-fb36ef6327c1 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 5ed38927-680d-4e93-b57a-21fb407c6b33] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:13.823149 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0a9da0ff-d462-4007-b8ba-fb36ef6327c1 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:13.824992 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0a9da0ff-d462-4007-b8ba-fb36ef6327c1 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:13.826979 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0a9da0ff-d462-4007-b8ba-fb36ef6327c1 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:13.828078 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0a9da0ff-d462-4007-b8ba-fb36ef6327c1 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:13.828779 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0a9da0ff-d462-4007-b8ba-fb36ef6327c1 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:13.829741 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0a9da0ff-d462-4007-b8ba-fb36ef6327c1 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:14.419450 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0a9da0ff-d462-4007-b8ba-fb36ef6327c1 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:14.438491 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0a9da0ff-d462-4007-b8ba-fb36ef6327c1 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:14.440058 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0a9da0ff-d462-4007-b8ba-fb36ef6327c1 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:14.441307 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0a9da0ff-d462-4007-b8ba-fb36ef6327c1 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33" status: 200 len: 1485 microversion: 2.25 time: 0.653779 Oct 30 01:21:14.445777 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1059/2081] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:21:13 2022] GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33 => generated 1485 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:21:14.457230 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e9e67219-9295-4081-883d-c7770bdab097 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:14.463489 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e9e67219-9295-4081-883d-c7770bdab097 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 7e81dcfb-dcbe-4e05-91a4-541ff2c404ae] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:14.475728 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9e67219-9295-4081-883d-c7770bdab097 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:14.480802 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9e67219-9295-4081-883d-c7770bdab097 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:14.481323 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9e67219-9295-4081-883d-c7770bdab097 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:14.482213 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9e67219-9295-4081-883d-c7770bdab097 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:14.482784 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9e67219-9295-4081-883d-c7770bdab097 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:14.483327 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9e67219-9295-4081-883d-c7770bdab097 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:14.533248 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-acd01512-2533-444f-81bc-0523f7150f35 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "POST /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d/action" status: 202 len: 0 microversion: 2.91 time: 0.955175 Oct 30 01:21:14.539086 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1023/2082] 10.222.0.13 () {62 vars in 1319 bytes} [Sun Oct 30 01:21:13 2022] POST /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d/action => generated 0 bytes in 961 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 30 01:21:14.554518 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3750dc28-acb7-48f7-ab1a-f1b1c1db9f46 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:14.555640 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3750dc28-acb7-48f7-ab1a-f1b1c1db9f46 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 24828782-5e5e-402e-9e2b-644b166cf844] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:14.570313 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3750dc28-acb7-48f7-ab1a-f1b1c1db9f46 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:14.572199 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3750dc28-acb7-48f7-ab1a-f1b1c1db9f46 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:14.572822 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3750dc28-acb7-48f7-ab1a-f1b1c1db9f46 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:14.577828 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3750dc28-acb7-48f7-ab1a-f1b1c1db9f46 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:14.578675 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3750dc28-acb7-48f7-ab1a-f1b1c1db9f46 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:14.580191 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3750dc28-acb7-48f7-ab1a-f1b1c1db9f46 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:15.180842 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3750dc28-acb7-48f7-ab1a-f1b1c1db9f46 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:15.195125 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3750dc28-acb7-48f7-ab1a-f1b1c1db9f46 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/24828782-5e5e-402e-9e2b-644b166cf844" status: 200 len: 1215 microversion: 2.1 time: 0.654497 Oct 30 01:21:15.196283 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1024/2083] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:14 2022] GET /compute/v2.1/servers/24828782-5e5e-402e-9e2b-644b166cf844 => generated 1215 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:15.214812 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-85fe105d-5a40-48c4-8608-012bccefaeba req-dadeadb6-2d98-40e7-acda-f2ab7e0d669a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ed38927-680d-4e93-b57a-21fb407c6b33", "tag": "1e47508a-754d-4221-8472-e44defed87c1"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:21:15.243486 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-85fe105d-5a40-48c4-8608-012bccefaeba req-dadeadb6-2d98-40e7-acda-f2ab7e0d669a service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:15.244191 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-85fe105d-5a40-48c4-8608-012bccefaeba req-dadeadb6-2d98-40e7-acda-f2ab7e0d669a service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:15.244860 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-85fe105d-5a40-48c4-8608-012bccefaeba req-dadeadb6-2d98-40e7-acda-f2ab7e0d669a service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:15.266431 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-85fe105d-5a40-48c4-8608-012bccefaeba req-dadeadb6-2d98-40e7-acda-f2ab7e0d669a service nova] Creating event network-changed:1e47508a-754d-4221-8472-e44defed87c1 for instance 5ed38927-680d-4e93-b57a-21fb407c6b33 on n-h1-master-1 Oct 30 01:21:15.287798 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-85fe105d-5a40-48c4-8608-012bccefaeba req-dadeadb6-2d98-40e7-acda-f2ab7e0d669a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089152 Oct 30 01:21:15.293167 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1025/2084] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:21:15.304835 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f2ca6a23-47cc-44ba-8e0d-47af6177f23b tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:15.307456 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f2ca6a23-47cc-44ba-8e0d-47af6177f23b tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] [instance: d190bf6d-50f5-454f-a9fa-4296cd25bddd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:15.325521 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f2ca6a23-47cc-44ba-8e0d-47af6177f23b tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:15.326266 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f2ca6a23-47cc-44ba-8e0d-47af6177f23b tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:15.329110 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f2ca6a23-47cc-44ba-8e0d-47af6177f23b tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:15.331043 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f2ca6a23-47cc-44ba-8e0d-47af6177f23b tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:15.333295 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f2ca6a23-47cc-44ba-8e0d-47af6177f23b tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:15.333977 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f2ca6a23-47cc-44ba-8e0d-47af6177f23b tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:15.516016 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f2ca6a23-47cc-44ba-8e0d-47af6177f23b tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9f71f892094c2685b175e111fe7cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a766acde7eab4b05866a2c33f5dd3606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:15.526591 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f2ca6a23-47cc-44ba-8e0d-47af6177f23b tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] 10.222.0.13 "GET /compute/v2.1/servers/d190bf6d-50f5-454f-a9fa-4296cd25bddd" status: 200 len: 1276 microversion: 2.1 time: 0.230392 Oct 30 01:21:15.530460 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1026/2085] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:15 2022] GET /compute/v2.1/servers/d190bf6d-50f5-454f-a9fa-4296cd25bddd => generated 1276 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:15.552083 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-048614bf-aa0f-43b8-99a9-0fbeb70221bb tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:15.561829 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-048614bf-aa0f-43b8-99a9-0fbeb70221bb tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:15.564240 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e9e67219-9295-4081-883d-c7770bdab097 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:15.573532 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-048614bf-aa0f-43b8-99a9-0fbeb70221bb tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:15.574328 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-048614bf-aa0f-43b8-99a9-0fbeb70221bb tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:15.575267 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-048614bf-aa0f-43b8-99a9-0fbeb70221bb tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:15.576271 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-048614bf-aa0f-43b8-99a9-0fbeb70221bb tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:15.576797 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-048614bf-aa0f-43b8-99a9-0fbeb70221bb tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:15.577490 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-048614bf-aa0f-43b8-99a9-0fbeb70221bb tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:15.577845 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e9e67219-9295-4081-883d-c7770bdab097 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae" status: 200 len: 1499 microversion: 2.1 time: 1.129929 Oct 30 01:21:15.578470 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1060/2086] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:14 2022] GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae => generated 1499 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:15.598367 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-57ab4148-e047-42ce-840f-d8a7f56a1a6a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:15.598998 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-57ab4148-e047-42ce-840f-d8a7f56a1a6a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: e7ff7c82-b3f6-4172-be0d-1c67c30db4f7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:15.616095 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-57ab4148-e047-42ce-840f-d8a7f56a1a6a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:15.616398 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-57ab4148-e047-42ce-840f-d8a7f56a1a6a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:15.617711 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-57ab4148-e047-42ce-840f-d8a7f56a1a6a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:15.621163 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-57ab4148-e047-42ce-840f-d8a7f56a1a6a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:15.621706 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-57ab4148-e047-42ce-840f-d8a7f56a1a6a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:15.622147 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-57ab4148-e047-42ce-840f-d8a7f56a1a6a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:15.944309 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-048614bf-aa0f-43b8-99a9-0fbeb70221bb tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:15.954122 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-048614bf-aa0f-43b8-99a9-0fbeb70221bb tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:15.955599 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-048614bf-aa0f-43b8-99a9-0fbeb70221bb tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:15.971305 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-048614bf-aa0f-43b8-99a9-0fbeb70221bb tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1539 microversion: 2.91 time: 0.426014 Oct 30 01:21:15.972186 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1027/2087] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:21:15 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1539 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:21:15.978973 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-57ab4148-e047-42ce-840f-d8a7f56a1a6a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:15.988534 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-104272f9-1953-4705-a68c-de7b14b9afef tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:15.989384 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-104272f9-1953-4705-a68c-de7b14b9afef tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 5ed38927-680d-4e93-b57a-21fb407c6b33] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:16.001156 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-104272f9-1953-4705-a68c-de7b14b9afef tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:16.002098 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-104272f9-1953-4705-a68c-de7b14b9afef tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:16.005934 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-104272f9-1953-4705-a68c-de7b14b9afef tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:16.010335 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-104272f9-1953-4705-a68c-de7b14b9afef tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:16.011359 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-57ab4148-e047-42ce-840f-d8a7f56a1a6a tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7" status: 200 len: 1426 microversion: 2.1 time: 0.430583 Oct 30 01:21:16.015266 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-104272f9-1953-4705-a68c-de7b14b9afef tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:16.015410 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1061/2088] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:15 2022] GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 => generated 1426 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:16.015514 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-104272f9-1953-4705-a68c-de7b14b9afef tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:16.139694 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-626777e2-de07-4d47-a8d4-5e5d146af2cd tempest-SecurityGroupsNegativeTestJSON-1335353662 tempest-SecurityGroupsNegativeTestJSON-1335353662-project] Calling method '.version_select at 0x7f44cc60ca60>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:16.248807 n-d-master-1 devstack@n-api.service[121102]: DEBUG neutronclient.v2_0.client [None req-626777e2-de07-4d47-a8d4-5e5d146af2cd tempest-SecurityGroupsNegativeTestJSON-1335353662 tempest-SecurityGroupsNegativeTestJSON-1335353662-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b8f7be8a-c15d-453f-aacc-d0c39710080a does not exist", "detail": ""}} {{(pid=121102) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 30 01:21:16.248807 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.security_group_api [None req-626777e2-de07-4d47-a8d4-5e5d146af2cd tempest-SecurityGroupsNegativeTestJSON-1335353662 tempest-SecurityGroupsNegativeTestJSON-1335353662-project] Neutron security group b8f7be8a-c15d-453f-aacc-d0c39710080a not found {{(pid=121102) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 30 01:21:16.248807 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-626777e2-de07-4d47-a8d4-5e5d146af2cd tempest-SecurityGroupsNegativeTestJSON-1335353662 tempest-SecurityGroupsNegativeTestJSON-1335353662-project] HTTP exception thrown: Security group b8f7be8a-c15d-453f-aacc-d0c39710080a does not exist Oct 30 01:21:16.248807 n-d-master-1 devstack@n-api.service[121102]: Neutron server returns request_ids: ['req-e26bb892-ff17-45cb-a4c4-05cf2edcfda2'] Oct 30 01:21:16.248807 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-626777e2-de07-4d47-a8d4-5e5d146af2cd tempest-SecurityGroupsNegativeTestJSON-1335353662 tempest-SecurityGroupsNegativeTestJSON-1335353662-project] Request method failure captured: Oct 30 01:21:16.248807 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/os-security-groups/b8f7be8a-c15d-453f-aacc-d0c39710080a HTTP/1.1 Oct 30 01:21:16.248807 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:21:16.248807 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:21:16.248807 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:21:16.248807 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:21:16.248807 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:21:16.248807 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:21:16.248807 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:21:16.248807 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:21:16.250004 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdGLkcfWpjNTRpQPugVfoSxuMKWk8ZqiTPSdN62BPtsvGGseB5rDHL1vTOwiT370NYFl3E6s-fqaxsOulZEMk2OrfbgL0dveRXxHXRzPUEXYWucVy5Zd7_-5IXqqu-gi1Byg-bVw70SyJoYd2OybRQ313O2hVk2JYQZrBDskAr5I4uc Oct 30 01:21:16.250004 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:21:16.250004 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:21:16.250004 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:21:16.250004 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:21:16.250004 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:21:16.250004 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:21:16.250004 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 4fc1f6311290483885e60eff6225a4f1 Oct 30 01:21:16.250004 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1335353662 Oct 30 01:21:16.250004 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:21:16.250004 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:21:16.250004 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4fc1f6311290483885e60eff6225a4f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4fc1f6311290483885e60eff6225a4f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4fc1f6311290483885e60eff6225a4f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4fc1f6311290483885e60eff6225a4f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:21:16.250004 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1335353662 Oct 30 01:21:16.250004 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 4fc1f6311290483885e60eff6225a4f1 Oct 30 01:21:16.250004 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1335353662 Oct 30 01:21:16.251061 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-SecurityGroupsNegativeTestJSON-1335353662-project Oct 30 01:21:16.251061 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:21:16.251061 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:21:16.251061 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 0677bca630fd40088dd32981f81bce20 Oct 30 01:21:16.251061 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1335353662-project Oct 30 01:21:16.251061 n-d-master-1 devstack@n-api.service[121102]: method: Oct 30 01:21:16.251061 n-d-master-1 devstack@n-api.service[121102]: exception: Security group b8f7be8a-c15d-453f-aacc-d0c39710080a does not exist Oct 30 01:21:16.251061 n-d-master-1 devstack@n-api.service[121102]: Neutron server returns request_ids: ['req-e26bb892-ff17-45cb-a4c4-05cf2edcfda2'] Oct 30 01:21:16.251061 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'b8f7be8a-c15d-453f-aacc-d0c39710080a'} Oct 30 01:21:16.251061 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:21:16.251061 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:16.251061 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 30 01:21:16.251061 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 30 01:21:16.251061 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:21:16.251061 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:21:16.251061 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 30 01:21:16.251061 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 30 01:21:16.251061 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:21:16.251061 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:21:16.251061 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 30 01:21:16.251061 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 30 01:21:16.251061 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:21:16.251061 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:21:16.252709 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 30 01:21:16.252709 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 30 01:21:16.252709 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:21:16.252709 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:21:16.252709 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 30 01:21:16.252709 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 30 01:21:16.252709 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:21:16.252709 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:21:16.252709 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 30 01:21:16.252709 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 30 01:21:16.252709 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 30 01:21:16.252709 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 30 01:21:16.252709 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b8f7be8a-c15d-453f-aacc-d0c39710080a does not exist Oct 30 01:21:16.252709 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e26bb892-ff17-45cb-a4c4-05cf2edcfda2'] Oct 30 01:21:16.252709 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:16.252709 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:21:16.252709 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:16.252709 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:16.252709 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 30 01:21:16.256072 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 30 01:21:16.256072 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 30 01:21:16.256072 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 30 01:21:16.256072 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b8f7be8a-c15d-453f-aacc-d0c39710080a does not exist Oct 30 01:21:16.256072 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e26bb892-ff17-45cb-a4c4-05cf2edcfda2'] Oct 30 01:21:16.256072 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:16.256072 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:21:16.256072 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:16.256072 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:16.256072 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:21:16.256072 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:21:16.256072 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:21:16.256072 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:21:16.256072 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:21:16.256072 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:21:16.256072 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:21:16.256072 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:21:16.256072 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 30 01:21:16.256072 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 30 01:21:16.259909 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b8f7be8a-c15d-453f-aacc-d0c39710080a does not exist Oct 30 01:21:16.259909 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e26bb892-ff17-45cb-a4c4-05cf2edcfda2'] Oct 30 01:21:16.259909 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:16.259909 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:21:16.259909 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:16.259909 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:16.259909 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:21:16.259909 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:21:16.259909 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:21:16.259909 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:21:16.259909 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b8f7be8a-c15d-453f-aacc-d0c39710080a does not exist Oct 30 01:21:16.259909 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e26bb892-ff17-45cb-a4c4-05cf2edcfda2'] Oct 30 01:21:16.259909 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:16.259909 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-626777e2-de07-4d47-a8d4-5e5d146af2cd tempest-SecurityGroupsNegativeTestJSON-1335353662 tempest-SecurityGroupsNegativeTestJSON-1335353662-project] Returning 404 to user: Security group b8f7be8a-c15d-453f-aacc-d0c39710080a does not exist Oct 30 01:21:16.259909 n-d-master-1 devstack@n-api.service[121102]: Neutron server returns request_ids: ['req-e26bb892-ff17-45cb-a4c4-05cf2edcfda2'] {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:21:16.265135 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-626777e2-de07-4d47-a8d4-5e5d146af2cd tempest-SecurityGroupsNegativeTestJSON-1335353662 tempest-SecurityGroupsNegativeTestJSON-1335353662-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/b8f7be8a-c15d-453f-aacc-d0c39710080a" status: 404 len: 194 microversion: 2.1 time: 0.248844 Oct 30 01:21:16.265637 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1062/2089] 10.222.0.13 () {58 vars in 1272 bytes} [Sun Oct 30 01:21:16 2022] DELETE /compute/v2.1/os-security-groups/b8f7be8a-c15d-453f-aacc-d0c39710080a => generated 194 bytes in 252 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:21:16.291966 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-97275a06-190c-45cd-acef-b8f22794669a req-5167e2bc-304e-4b3a-af44-60145b58591b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7ff7c82-b3f6-4172-be0d-1c67c30db4f7", "name": "network-vif-deleted", "tag": "6187e4ac-5fa7-409a-870a-b11e4dc8fc91"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:21:16.339819 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-97275a06-190c-45cd-acef-b8f22794669a req-5167e2bc-304e-4b3a-af44-60145b58591b service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:16.340312 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-97275a06-190c-45cd-acef-b8f22794669a req-5167e2bc-304e-4b3a-af44-60145b58591b service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:16.340758 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-97275a06-190c-45cd-acef-b8f22794669a req-5167e2bc-304e-4b3a-af44-60145b58591b service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:16.363729 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-97275a06-190c-45cd-acef-b8f22794669a req-5167e2bc-304e-4b3a-af44-60145b58591b service nova] Creating event network-vif-deleted:6187e4ac-5fa7-409a-870a-b11e4dc8fc91 for instance e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 on n-h2-master-1 Oct 30 01:21:16.377036 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-97275a06-190c-45cd-acef-b8f22794669a req-5167e2bc-304e-4b3a-af44-60145b58591b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109680 Oct 30 01:21:16.378232 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1063/2090] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:21:16.385102 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-dc55c516-e322-498b-9079-cf79329954b2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:16.386110 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-dc55c516-e322-498b-9079-cf79329954b2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 24828782-5e5e-402e-9e2b-644b166cf844] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:16.409490 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dc55c516-e322-498b-9079-cf79329954b2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:16.412055 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dc55c516-e322-498b-9079-cf79329954b2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:16.412722 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dc55c516-e322-498b-9079-cf79329954b2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:16.414342 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dc55c516-e322-498b-9079-cf79329954b2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:16.417713 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dc55c516-e322-498b-9079-cf79329954b2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:16.418413 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dc55c516-e322-498b-9079-cf79329954b2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:16.626177 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-dc55c516-e322-498b-9079-cf79329954b2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:16.635055 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-dc55c516-e322-498b-9079-cf79329954b2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/24828782-5e5e-402e-9e2b-644b166cf844" status: 200 len: 1217 microversion: 2.1 time: 0.255443 Oct 30 01:21:16.638672 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1064/2091] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:16 2022] GET /compute/v2.1/servers/24828782-5e5e-402e-9e2b-644b166cf844 => generated 1217 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:16.644814 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-77bd9a65-1fb8-44ae-bec9-f61b050d267f tempest-SecurityGroupsNegativeTestJSON-1335353662 tempest-SecurityGroupsNegativeTestJSON-1335353662-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.004480 Oct 30 01:21:16.645394 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1065/2092] 10.222.0.13 () {58 vars in 1164 bytes} [Sun Oct 30 01:21:16 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 30 01:21:16.660157 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fb62cfa6-f5b4-498e-bd8f-f1f481904511 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:16.660872 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fb62cfa6-f5b4-498e-bd8f-f1f481904511 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] [instance: d190bf6d-50f5-454f-a9fa-4296cd25bddd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:16.670805 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb62cfa6-f5b4-498e-bd8f-f1f481904511 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:16.671351 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb62cfa6-f5b4-498e-bd8f-f1f481904511 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:16.671828 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb62cfa6-f5b4-498e-bd8f-f1f481904511 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:16.673955 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb62cfa6-f5b4-498e-bd8f-f1f481904511 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:16.674470 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb62cfa6-f5b4-498e-bd8f-f1f481904511 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:16.674895 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb62cfa6-f5b4-498e-bd8f-f1f481904511 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:16.751477 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-104272f9-1953-4705-a68c-de7b14b9afef tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:16.769366 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-104272f9-1953-4705-a68c-de7b14b9afef tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:16.776457 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-104272f9-1953-4705-a68c-de7b14b9afef tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:16.778467 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-104272f9-1953-4705-a68c-de7b14b9afef tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33" status: 200 len: 1485 microversion: 2.25 time: 0.805108 Oct 30 01:21:16.783890 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1028/2093] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:21:15 2022] GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33 => generated 1485 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:21:16.792096 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-fb62cfa6-f5b4-498e-bd8f-f1f481904511 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9f71f892094c2685b175e111fe7cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a766acde7eab4b05866a2c33f5dd3606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:16.793637 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0c92602c-80f4-468e-be12-cd4e40a12f53 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:16.797039 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0c92602c-80f4-468e-be12-cd4e40a12f53 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 7e81dcfb-dcbe-4e05-91a4-541ff2c404ae] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:16.801249 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fb62cfa6-f5b4-498e-bd8f-f1f481904511 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] 10.222.0.13 "GET /compute/v2.1/servers/d190bf6d-50f5-454f-a9fa-4296cd25bddd" status: 200 len: 1274 microversion: 2.1 time: 0.154345 Oct 30 01:21:16.801867 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1066/2094] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:16 2022] GET /compute/v2.1/servers/d190bf6d-50f5-454f-a9fa-4296cd25bddd => generated 1274 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:16.808838 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:16.810656 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c92602c-80f4-468e-be12-cd4e40a12f53 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:16.812841 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c92602c-80f4-468e-be12-cd4e40a12f53 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:16.813461 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c92602c-80f4-468e-be12-cd4e40a12f53 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:16.814432 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c92602c-80f4-468e-be12-cd4e40a12f53 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:16.815083 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c92602c-80f4-468e-be12-cd4e40a12f53 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:16.815647 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c92602c-80f4-468e-be12-cd4e40a12f53 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:16.816663 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3a9d82b7-030d-4f6d-8417-1c26282da48e tempest-SecurityGroupsNegativeTestJSON-1335353662 tempest-SecurityGroupsNegativeTestJSON-1335353662-project] Calling method '.version_select at 0x7f44cc578550>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:16.839178 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=6 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:16.858853 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c92602c-80f4-468e-be12-cd4e40a12f53 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:16.859735 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c92602c-80f4-468e-be12-cd4e40a12f53 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:16.860342 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c92602c-80f4-468e-be12-cd4e40a12f53 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:16.865040 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-0c92602c-80f4-468e-be12-cd4e40a12f53 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lazy-loading 'fault' on Instance uuid 7e81dcfb-dcbe-4e05-91a4-541ff2c404ae {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:21:16.958188 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0c92602c-80f4-468e-be12-cd4e40a12f53 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7334417689847d18bc4c1b27d173a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e7fd477334b879db6b49ee5cc509f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:17.010971 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0c92602c-80f4-468e-be12-cd4e40a12f53 tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae" status: 200 len: 1301 microversion: 2.1 time: 0.200296 Oct 30 01:21:17.011886 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1029/2095] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:16 2022] GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae => generated 1301 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:17.035606 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-70d5b8ff-b4c9-4e0d-abdb-7c0c79f2a1a4 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:17.036060 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-70d5b8ff-b4c9-4e0d-abdb-7c0c79f2a1a4 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:17.060011 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-70d5b8ff-b4c9-4e0d-abdb-7c0c79f2a1a4 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:17.061457 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-70d5b8ff-b4c9-4e0d-abdb-7c0c79f2a1a4 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:17.062085 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-70d5b8ff-b4c9-4e0d-abdb-7c0c79f2a1a4 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:17.063014 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-70d5b8ff-b4c9-4e0d-abdb-7c0c79f2a1a4 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:17.065576 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-70d5b8ff-b4c9-4e0d-abdb-7c0c79f2a1a4 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:17.066283 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-70d5b8ff-b4c9-4e0d-abdb-7c0c79f2a1a4 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:17.117322 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:17.509530 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-70d5b8ff-b4c9-4e0d-abdb-7c0c79f2a1a4 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:17.526190 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-70d5b8ff-b4c9-4e0d-abdb-7c0c79f2a1a4 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:17.531213 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-70d5b8ff-b4c9-4e0d-abdb-7c0c79f2a1a4 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:17.536891 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-70d5b8ff-b4c9-4e0d-abdb-7c0c79f2a1a4 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1539 microversion: 2.91 time: 0.510405 Oct 30 01:21:17.538294 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1030/2096] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:21:17 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1539 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:21:17.556792 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f4548621-f14a-47e3-a9b9-622a01862087 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:17.561723 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f4548621-f14a-47e3-a9b9-622a01862087 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: e7ff7c82-b3f6-4172-be0d-1c67c30db4f7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:17.567187 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f4548621-f14a-47e3-a9b9-622a01862087 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:17.568031 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f4548621-f14a-47e3-a9b9-622a01862087 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:17.568933 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f4548621-f14a-47e3-a9b9-622a01862087 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:17.570038 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f4548621-f14a-47e3-a9b9-622a01862087 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:17.570719 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f4548621-f14a-47e3-a9b9-622a01862087 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:17.571693 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f4548621-f14a-47e3-a9b9-622a01862087 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:17.588040 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-f4548621-f14a-47e3-a9b9-622a01862087 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] HTTP exception thrown: Instance e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 could not be found. Oct 30 01:21:17.591045 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f4548621-f14a-47e3-a9b9-622a01862087 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Request method failure captured: Oct 30 01:21:17.591045 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 HTTP/1.1 Oct 30 01:21:17.591045 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:21:17.591045 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:21:17.591045 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:21:17.591045 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:21:17.591045 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:21:17.591045 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:21:17.591045 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:21:17.591045 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:21:17.591045 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdAbPw23hQwPLJ2dU_HGxIRXsCw9bNiHATqQCht5o0qGPfa2Kq5AEX3T7chQWWhhzZVhFyT3KvFvR56kHfMj1Zajs4NLQn3E320ctHWtprwOHSTCEWkNIrqgzNyOQZaTDcuGkDNQhWjJqRPxebZIC-U_OIIsgwPUj899YmuUCbv3e-U Oct 30 01:21:17.591045 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:21:17.591045 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:21:17.591045 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:21:17.591045 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:21:17.591045 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:21:17.591045 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:21:17.591045 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: ad621909b99143dd9885006238de72a6 Oct 30 01:21:17.591045 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-MigrationsAdminTest-1982618098 Oct 30 01:21:17.591045 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:21:17.591045 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:21:17.592626 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ad621909b99143dd9885006238de72a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ad621909b99143dd9885006238de72a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ad621909b99143dd9885006238de72a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ad621909b99143dd9885006238de72a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:21:17.592626 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-MigrationsAdminTest-1982618098 Oct 30 01:21:17.592626 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: ad621909b99143dd9885006238de72a6 Oct 30 01:21:17.592626 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-MigrationsAdminTest-1982618098 Oct 30 01:21:17.592626 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-MigrationsAdminTest-1982618098-project Oct 30 01:21:17.592626 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:21:17.592626 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:21:17.592626 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 4f1fe6e04e064dfba969b07d4188ab38 Oct 30 01:21:17.592626 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-MigrationsAdminTest-1982618098-project Oct 30 01:21:17.592626 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:21:17.592626 n-d-master-1 devstack@n-api.service[121103]: exception: Instance e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 could not be found. Oct 30 01:21:17.592626 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'e7ff7c82-b3f6-4172-be0d-1c67c30db4f7'} Oct 30 01:21:17.593543 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:21:17.593543 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:17.593543 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:21:17.593543 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:21:17.593543 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:21:17.593543 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:21:17.593543 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:21:17.593543 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:21:17.593543 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:21:17.593543 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:21:17.593543 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 could not be found. Oct 30 01:21:17.593543 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:21:17.593543 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:21:17.593543 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:21:17.593543 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:17.593543 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:21:17.593543 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:21:17.593543 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:21:17.593543 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:21:17.593543 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:21:17.596667 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:21:17.596667 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:21:17.596667 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:21:17.596667 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:21:17.596667 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:21:17.596667 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:21:17.596667 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:21:17.596667 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 could not be found. Oct 30 01:21:17.596667 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:21:17.596667 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:21:17.596667 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:21:17.596667 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:17.596667 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:21:17.596667 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:21:17.596667 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:21:17.596667 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:21:17.596667 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 could not be found. Oct 30 01:21:17.596667 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:21:17.600811 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f4548621-f14a-47e3-a9b9-622a01862087 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Returning 404 to user: Instance e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:21:17.603220 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f4548621-f14a-47e3-a9b9-622a01862087 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7" status: 404 len: 111 microversion: 2.1 time: 0.061549 Oct 30 01:21:17.604485 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1031/2097] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:17 2022] GET /compute/v2.1/servers/e7ff7c82-b3f6-4172-be0d-1c67c30db4f7 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:21:17.613640 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-97aad6d7-834c-4304-899a-949112230018 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:17.614464 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-97aad6d7-834c-4304-899a-949112230018 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 03d9aff4-215d-48fa-b741-2257b62fc597] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:17.622827 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-97aad6d7-834c-4304-899a-949112230018 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:17.623731 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-97aad6d7-834c-4304-899a-949112230018 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:17.624388 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-97aad6d7-834c-4304-899a-949112230018 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:17.626159 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-97aad6d7-834c-4304-899a-949112230018 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:17.627032 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-97aad6d7-834c-4304-899a-949112230018 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:17.627530 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-97aad6d7-834c-4304-899a-949112230018 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:17.665788 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-97aad6d7-834c-4304-899a-949112230018 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 03d9aff4-215d-48fa-b741-2257b62fc597] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:21:17.746149 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3a9d82b7-030d-4f6d-8417-1c26282da48e tempest-SecurityGroupsNegativeTestJSON-1335353662 tempest-SecurityGroupsNegativeTestJSON-1335353662-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.937524 Oct 30 01:21:17.752526 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1067/2098] 10.222.0.13 () {58 vars in 1158 bytes} [Sun Oct 30 01:21:16 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:21:17.761126 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d9151730-0ff1-450a-8f9d-61481a975ff0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:17.762287 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d9151730-0ff1-450a-8f9d-61481a975ff0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 24828782-5e5e-402e-9e2b-644b166cf844] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:17.771737 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9151730-0ff1-450a-8f9d-61481a975ff0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:17.772920 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9151730-0ff1-450a-8f9d-61481a975ff0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:17.773603 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9151730-0ff1-450a-8f9d-61481a975ff0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:17.774744 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9151730-0ff1-450a-8f9d-61481a975ff0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:17.775671 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9151730-0ff1-450a-8f9d-61481a975ff0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:17.776364 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9151730-0ff1-450a-8f9d-61481a975ff0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:17.912801 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d9151730-0ff1-450a-8f9d-61481a975ff0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:17.923056 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d9151730-0ff1-450a-8f9d-61481a975ff0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/24828782-5e5e-402e-9e2b-644b166cf844" status: 200 len: 1217 microversion: 2.1 time: 0.168337 Oct 30 01:21:17.924920 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1068/2099] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:17 2022] GET /compute/v2.1/servers/24828782-5e5e-402e-9e2b-644b166cf844 => generated 1217 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:17.930253 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-59b1cb18-d2f7-4dd3-9630-9c4b4bb7ce81 tempest-SecurityGroupsNegativeTestJSON-1335353662 tempest-SecurityGroupsNegativeTestJSON-1335353662-project] Calling method '.version_select at 0x7f44cc6f3820>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:17.953407 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-97aad6d7-834c-4304-899a-949112230018 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "DELETE /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597" status: 204 len: 0 microversion: 2.1 time: 0.344552 Oct 30 01:21:17.960208 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1032/2100] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:21:17 2022] DELETE /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:21:17.965780 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b1869576-cda8-49da-b47e-b834bcebea42 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:17.966952 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b1869576-cda8-49da-b47e-b834bcebea42 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 5ed38927-680d-4e93-b57a-21fb407c6b33] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:17.974677 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1869576-cda8-49da-b47e-b834bcebea42 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:17.975580 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1869576-cda8-49da-b47e-b834bcebea42 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:17.976661 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1869576-cda8-49da-b47e-b834bcebea42 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:17.978924 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1869576-cda8-49da-b47e-b834bcebea42 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:17.979772 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1869576-cda8-49da-b47e-b834bcebea42 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:17.980589 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1869576-cda8-49da-b47e-b834bcebea42 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:18.202216 n-d-master-1 devstack@n-api.service[121102]: DEBUG neutronclient.v2_0.client [None req-59b1cb18-d2f7-4dd3-9630-9c4b4bb7ce81 tempest-SecurityGroupsNegativeTestJSON-1335353662 tempest-SecurityGroupsNegativeTestJSON-1335353662-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=121102) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 30 01:21:18.202945 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-59b1cb18-d2f7-4dd3-9630-9c4b4bb7ce81 tempest-SecurityGroupsNegativeTestJSON-1335353662 tempest-SecurityGroupsNegativeTestJSON-1335353662-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 30 01:21:18.202945 n-d-master-1 devstack@n-api.service[121102]: Neutron server returns request_ids: ['req-b771eb6e-ab10-4cec-acef-26e34d134d75'] Oct 30 01:21:18.206779 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-59b1cb18-d2f7-4dd3-9630-9c4b4bb7ce81 tempest-SecurityGroupsNegativeTestJSON-1335353662 tempest-SecurityGroupsNegativeTestJSON-1335353662-project] Request method failure captured: Oct 30 01:21:18.206779 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/os-security-groups/715aa711-0c80-461f-9a59-4f1b4967e8fd HTTP/1.1 Oct 30 01:21:18.206779 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:21:18.206779 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:21:18.206779 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:21:18.206779 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:21:18.206779 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:21:18.206779 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:21:18.206779 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:21:18.206779 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:21:18.206779 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdGLkcfWpjNTRpQPugVfoSxuMKWk8ZqiTPSdN62BPtsvGGseB5rDHL1vTOwiT370NYFl3E6s-fqaxsOulZEMk2OrfbgL0dveRXxHXRzPUEXYWucVy5Zd7_-5IXqqu-gi1Byg-bVw70SyJoYd2OybRQ313O2hVk2JYQZrBDskAr5I4uc Oct 30 01:21:18.206779 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:21:18.206779 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:21:18.206779 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:21:18.206779 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:21:18.206779 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:21:18.206779 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:21:18.206779 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 4fc1f6311290483885e60eff6225a4f1 Oct 30 01:21:18.206779 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1335353662 Oct 30 01:21:18.206779 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:21:18.206779 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:21:18.212663 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4fc1f6311290483885e60eff6225a4f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4fc1f6311290483885e60eff6225a4f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4fc1f6311290483885e60eff6225a4f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4fc1f6311290483885e60eff6225a4f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:21:18.212663 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1335353662 Oct 30 01:21:18.212663 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 4fc1f6311290483885e60eff6225a4f1 Oct 30 01:21:18.212663 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1335353662 Oct 30 01:21:18.212663 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-SecurityGroupsNegativeTestJSON-1335353662-project Oct 30 01:21:18.212663 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:21:18.212663 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:21:18.212663 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 0677bca630fd40088dd32981f81bce20 Oct 30 01:21:18.212663 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1335353662-project Oct 30 01:21:18.212663 n-d-master-1 devstack@n-api.service[121102]: method: Oct 30 01:21:18.212663 n-d-master-1 devstack@n-api.service[121102]: exception: Insufficient rights for removing default security group. Oct 30 01:21:18.212663 n-d-master-1 devstack@n-api.service[121102]: Neutron server returns request_ids: ['req-b771eb6e-ab10-4cec-acef-26e34d134d75'] Oct 30 01:21:18.212663 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '715aa711-0c80-461f-9a59-4f1b4967e8fd'} Oct 30 01:21:18.213792 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:21:18.213792 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:18.213792 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 30 01:21:18.213792 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 30 01:21:18.213792 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:21:18.213792 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:21:18.213792 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 30 01:21:18.213792 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 30 01:21:18.213792 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:21:18.213792 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:21:18.213792 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 30 01:21:18.213792 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 30 01:21:18.213792 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:21:18.213792 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:21:18.213792 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 30 01:21:18.213792 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 30 01:21:18.213792 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:21:18.213792 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:21:18.213792 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 30 01:21:18.215145 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 30 01:21:18.215145 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:21:18.215145 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:21:18.215145 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 30 01:21:18.215145 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 30 01:21:18.215145 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 30 01:21:18.215145 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 30 01:21:18.215145 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 30 01:21:18.215145 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b771eb6e-ab10-4cec-acef-26e34d134d75'] Oct 30 01:21:18.215145 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:18.215145 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:21:18.215145 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:18.215145 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:18.215145 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 30 01:21:18.215145 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 30 01:21:18.215145 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 30 01:21:18.215145 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 30 01:21:18.215145 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 30 01:21:18.215145 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b771eb6e-ab10-4cec-acef-26e34d134d75'] Oct 30 01:21:18.216451 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:18.216451 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:21:18.216451 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:18.216451 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:18.216451 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:21:18.216451 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:21:18.216451 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:21:18.216451 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:21:18.216451 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:21:18.216451 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:21:18.216451 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:21:18.216451 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:21:18.216451 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 30 01:21:18.216451 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 30 01:21:18.216451 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 30 01:21:18.216451 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b771eb6e-ab10-4cec-acef-26e34d134d75'] Oct 30 01:21:18.216451 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:18.216451 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:21:18.216451 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:18.216451 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:18.216451 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:21:18.218371 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:21:18.218371 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:21:18.218371 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:21:18.218371 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 30 01:21:18.218371 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b771eb6e-ab10-4cec-acef-26e34d134d75'] Oct 30 01:21:18.218371 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:18.218371 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-59b1cb18-d2f7-4dd3-9630-9c4b4bb7ce81 tempest-SecurityGroupsNegativeTestJSON-1335353662 tempest-SecurityGroupsNegativeTestJSON-1335353662-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 30 01:21:18.218371 n-d-master-1 devstack@n-api.service[121102]: Neutron server returns request_ids: ['req-b771eb6e-ab10-4cec-acef-26e34d134d75'] {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:21:18.218371 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-59b1cb18-d2f7-4dd3-9630-9c4b4bb7ce81 tempest-SecurityGroupsNegativeTestJSON-1335353662 tempest-SecurityGroupsNegativeTestJSON-1335353662-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/715aa711-0c80-461f-9a59-4f1b4967e8fd" status: 400 len: 182 microversion: 2.1 time: 0.282508 Oct 30 01:21:18.218371 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1069/2101] 10.222.0.13 () {58 vars in 1272 bytes} [Sun Oct 30 01:21:17 2022] DELETE /compute/v2.1/os-security-groups/715aa711-0c80-461f-9a59-4f1b4967e8fd => generated 182 bytes in 284 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:21:18.224308 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cc11eef4-8aa9-4304-8f21-1f64ffb52dd5 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:18.229067 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cc11eef4-8aa9-4304-8f21-1f64ffb52dd5 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] [instance: d190bf6d-50f5-454f-a9fa-4296cd25bddd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:18.261964 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cc11eef4-8aa9-4304-8f21-1f64ffb52dd5 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:18.262391 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cc11eef4-8aa9-4304-8f21-1f64ffb52dd5 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:18.262849 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cc11eef4-8aa9-4304-8f21-1f64ffb52dd5 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:18.263898 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cc11eef4-8aa9-4304-8f21-1f64ffb52dd5 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:18.264563 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cc11eef4-8aa9-4304-8f21-1f64ffb52dd5 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:18.265257 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cc11eef4-8aa9-4304-8f21-1f64ffb52dd5 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:18.311258 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b1869576-cda8-49da-b47e-b834bcebea42 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:18.324590 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b1869576-cda8-49da-b47e-b834bcebea42 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:18.327050 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b1869576-cda8-49da-b47e-b834bcebea42 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:18.329593 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b1869576-cda8-49da-b47e-b834bcebea42 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33" status: 200 len: 1485 microversion: 2.25 time: 0.372131 Oct 30 01:21:18.331013 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1033/2102] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:21:17 2022] GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33 => generated 1485 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:21:18.339189 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-be005c73-81bd-4abf-be0b-02e17a521ab5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:18.340596 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-be005c73-81bd-4abf-be0b-02e17a521ab5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 03d9aff4-215d-48fa-b741-2257b62fc597] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:18.348774 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-be005c73-81bd-4abf-be0b-02e17a521ab5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:18.350636 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-be005c73-81bd-4abf-be0b-02e17a521ab5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:18.351354 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-be005c73-81bd-4abf-be0b-02e17a521ab5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:18.354066 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-be005c73-81bd-4abf-be0b-02e17a521ab5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:18.354766 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-be005c73-81bd-4abf-be0b-02e17a521ab5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:18.360595 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-be005c73-81bd-4abf-be0b-02e17a521ab5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:18.556436 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-be005c73-81bd-4abf-be0b-02e17a521ab5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:18.566521 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-be005c73-81bd-4abf-be0b-02e17a521ab5 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597" status: 200 len: 1535 microversion: 2.1 time: 0.233111 Oct 30 01:21:18.567126 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1034/2103] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:18 2022] GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597 => generated 1535 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:18.589117 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a6328050-eb5a-4321-ad94-2682d26c6a2b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:18.591573 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a6328050-eb5a-4321-ad94-2682d26c6a2b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] [instance: 7e81dcfb-dcbe-4e05-91a4-541ff2c404ae] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:18.612756 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-cc11eef4-8aa9-4304-8f21-1f64ffb52dd5 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9f71f892094c2685b175e111fe7cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a766acde7eab4b05866a2c33f5dd3606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:18.613177 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a6328050-eb5a-4321-ad94-2682d26c6a2b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:18.613177 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a6328050-eb5a-4321-ad94-2682d26c6a2b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:18.613543 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a6328050-eb5a-4321-ad94-2682d26c6a2b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:18.615151 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a6328050-eb5a-4321-ad94-2682d26c6a2b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:18.615850 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a6328050-eb5a-4321-ad94-2682d26c6a2b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:18.616668 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a6328050-eb5a-4321-ad94-2682d26c6a2b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:18.620031 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cc11eef4-8aa9-4304-8f21-1f64ffb52dd5 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] 10.222.0.13 "GET /compute/v2.1/servers/d190bf6d-50f5-454f-a9fa-4296cd25bddd" status: 200 len: 1316 microversion: 2.1 time: 0.401257 Oct 30 01:21:18.633213 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-a6328050-eb5a-4321-ad94-2682d26c6a2b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] HTTP exception thrown: Instance 7e81dcfb-dcbe-4e05-91a4-541ff2c404ae could not be found. Oct 30 01:21:18.634622 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1070/2104] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:18 2022] GET /compute/v2.1/servers/d190bf6d-50f5-454f-a9fa-4296cd25bddd => generated 1316 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:18.636140 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a6328050-eb5a-4321-ad94-2682d26c6a2b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Request method failure captured: Oct 30 01:21:18.636140 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae HTTP/1.1 Oct 30 01:21:18.636140 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:21:18.636140 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:21:18.636140 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:21:18.636140 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:21:18.636140 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:21:18.636140 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:21:18.636140 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:21:18.636140 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:21:18.636140 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXc_KQ69GfMeJ3jN4J1TPXQ8bGOBoI0WTBTMDe__y-DAo2JjL2ORnQbmCeuZLneRCYcs3kYLHyIaNHHXu_K6nKvgKp3dW6RkvCZlVFmQEQtSKQwNbPyCCeYKzvViBngiAhBCQkceHgL-negWQA5TNaEjJqlsKIeoNOaaRa4HQnkUFlGY Oct 30 01:21:18.636140 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:21:18.636140 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:21:18.636140 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:21:18.636140 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:21:18.636140 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:21:18.636140 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:21:18.636140 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 283e7fd477334b879db6b49ee5cc509f Oct 30 01:21:18.636140 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-LiveMigrationTest-879299357 Oct 30 01:21:18.636140 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:21:18.636140 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:21:18.644424 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/283e7fd477334b879db6b49ee5cc509f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_283e7fd477334b879db6b49ee5cc509f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/283e7fd477334b879db6b49ee5cc509f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/283e7fd477334b879db6b49ee5cc509f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:21:18.644424 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-LiveMigrationTest-879299357 Oct 30 01:21:18.644424 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 283e7fd477334b879db6b49ee5cc509f Oct 30 01:21:18.644424 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-LiveMigrationTest-879299357 Oct 30 01:21:18.644424 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-LiveMigrationTest-879299357-project Oct 30 01:21:18.644424 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:21:18.644424 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:21:18.644424 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: c7334417689847d18bc4c1b27d173a23 Oct 30 01:21:18.644424 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-LiveMigrationTest-879299357-project Oct 30 01:21:18.644424 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:21:18.644424 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 7e81dcfb-dcbe-4e05-91a4-541ff2c404ae could not be found. Oct 30 01:21:18.644424 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '7e81dcfb-dcbe-4e05-91a4-541ff2c404ae'} Oct 30 01:21:18.645436 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:21:18.645436 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:18.645436 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:21:18.645436 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:21:18.645436 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:21:18.645436 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:21:18.645436 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:21:18.645436 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:21:18.645436 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:21:18.645436 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:21:18.645436 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e81dcfb-dcbe-4e05-91a4-541ff2c404ae could not be found. Oct 30 01:21:18.645436 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:21:18.645436 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:21:18.645436 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:21:18.645436 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:18.645436 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:21:18.645436 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:21:18.645436 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:21:18.645436 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:21:18.645436 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:21:18.646847 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:21:18.646847 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:21:18.646847 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:21:18.646847 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:21:18.646847 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:21:18.646847 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:21:18.646847 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:21:18.646847 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e81dcfb-dcbe-4e05-91a4-541ff2c404ae could not be found. Oct 30 01:21:18.646847 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:21:18.646847 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:21:18.646847 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:21:18.646847 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:18.646847 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:21:18.646847 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:21:18.646847 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:21:18.646847 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:21:18.646847 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e81dcfb-dcbe-4e05-91a4-541ff2c404ae could not be found. Oct 30 01:21:18.646847 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:21:18.648150 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a6328050-eb5a-4321-ad94-2682d26c6a2b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] Returning 404 to user: Instance 7e81dcfb-dcbe-4e05-91a4-541ff2c404ae could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:21:18.648150 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a6328050-eb5a-4321-ad94-2682d26c6a2b tempest-LiveMigrationTest-879299357 tempest-LiveMigrationTest-879299357-project] 10.222.0.13 "GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae" status: 404 len: 111 microversion: 2.1 time: 0.059592 Oct 30 01:21:18.648150 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1035/2105] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:18 2022] GET /compute/v2.1/servers/7e81dcfb-dcbe-4e05-91a4-541ff2c404ae => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:21:18.648377 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d26745dd-edb6-4fdb-a30d-d134f82482d7 tempest-SecurityGroupsNegativeTestJSON-1335353662 tempest-SecurityGroupsNegativeTestJSON-1335353662-project] Calling method '.version_select at 0x7f44cc578ca0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:18.648377 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:18.654786 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-92aa7130-2052-48fc-a7d6-3cc3f34ceae5 req-0df83bf7-ca4f-4369-918e-b37e9bedb00a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e81dcfb-dcbe-4e05-91a4-541ff2c404ae", "name": "network-vif-deleted", "tag": "8c9bf831-4693-4fde-804b-2216247d9310"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:21:18.665708 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-92aa7130-2052-48fc-a7d6-3cc3f34ceae5 req-0df83bf7-ca4f-4369-918e-b37e9bedb00a service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:18.666577 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-92aa7130-2052-48fc-a7d6-3cc3f34ceae5 req-0df83bf7-ca4f-4369-918e-b37e9bedb00a service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:18.667251 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-92aa7130-2052-48fc-a7d6-3cc3f34ceae5 req-0df83bf7-ca4f-4369-918e-b37e9bedb00a service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:18.681283 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-92aa7130-2052-48fc-a7d6-3cc3f34ceae5 req-0df83bf7-ca4f-4369-918e-b37e9bedb00a service nova] Creating event network-vif-deleted:8c9bf831-4693-4fde-804b-2216247d9310 for instance 7e81dcfb-dcbe-4e05-91a4-541ff2c404ae on n-h2-master-1 Oct 30 01:21:18.687152 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-92aa7130-2052-48fc-a7d6-3cc3f34ceae5 req-0df83bf7-ca4f-4369-918e-b37e9bedb00a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046154 Oct 30 01:21:18.690582 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1036/2106] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:21:18.696306 n-d-master-1 devstack@n-api.service[121102]: DEBUG neutronclient.v2_0.client [None req-d26745dd-edb6-4fdb-a30d-d134f82482d7 tempest-SecurityGroupsNegativeTestJSON-1335353662 tempest-SecurityGroupsNegativeTestJSON-1335353662-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 939c9aec-990e-4be1-b8e7-bbf6eb05f001 does not exist", "detail": ""}} {{(pid=121102) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 30 01:21:18.697574 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.security_group_api [None req-d26745dd-edb6-4fdb-a30d-d134f82482d7 tempest-SecurityGroupsNegativeTestJSON-1335353662 tempest-SecurityGroupsNegativeTestJSON-1335353662-project] Neutron security group 939c9aec-990e-4be1-b8e7-bbf6eb05f001 not found {{(pid=121102) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 30 01:21:18.698113 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-d26745dd-edb6-4fdb-a30d-d134f82482d7 tempest-SecurityGroupsNegativeTestJSON-1335353662 tempest-SecurityGroupsNegativeTestJSON-1335353662-project] HTTP exception thrown: Security group 939c9aec-990e-4be1-b8e7-bbf6eb05f001 does not exist Oct 30 01:21:18.698113 n-d-master-1 devstack@n-api.service[121102]: Neutron server returns request_ids: ['req-340c01ee-d8fd-4a3c-8120-53366065d57a'] Oct 30 01:21:18.700514 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d26745dd-edb6-4fdb-a30d-d134f82482d7 tempest-SecurityGroupsNegativeTestJSON-1335353662 tempest-SecurityGroupsNegativeTestJSON-1335353662-project] Request method failure captured: Oct 30 01:21:18.700514 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/os-security-groups/939c9aec-990e-4be1-b8e7-bbf6eb05f001 HTTP/1.1 Oct 30 01:21:18.700514 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:21:18.700514 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:21:18.700514 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:21:18.700514 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:21:18.700514 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:21:18.700514 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:21:18.700514 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:21:18.700514 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:21:18.700514 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdGLkcfWpjNTRpQPugVfoSxuMKWk8ZqiTPSdN62BPtsvGGseB5rDHL1vTOwiT370NYFl3E6s-fqaxsOulZEMk2OrfbgL0dveRXxHXRzPUEXYWucVy5Zd7_-5IXqqu-gi1Byg-bVw70SyJoYd2OybRQ313O2hVk2JYQZrBDskAr5I4uc Oct 30 01:21:18.700514 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:21:18.700514 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:21:18.700514 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:21:18.700514 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:21:18.700514 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:21:18.700514 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:21:18.700514 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 4fc1f6311290483885e60eff6225a4f1 Oct 30 01:21:18.700514 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1335353662 Oct 30 01:21:18.700514 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:21:18.700514 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:21:18.702366 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4fc1f6311290483885e60eff6225a4f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4fc1f6311290483885e60eff6225a4f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4fc1f6311290483885e60eff6225a4f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4fc1f6311290483885e60eff6225a4f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:21:18.702366 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1335353662 Oct 30 01:21:18.702366 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 4fc1f6311290483885e60eff6225a4f1 Oct 30 01:21:18.702366 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1335353662 Oct 30 01:21:18.702366 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-SecurityGroupsNegativeTestJSON-1335353662-project Oct 30 01:21:18.702366 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:21:18.702366 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:21:18.702366 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 0677bca630fd40088dd32981f81bce20 Oct 30 01:21:18.702366 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1335353662-project Oct 30 01:21:18.702366 n-d-master-1 devstack@n-api.service[121102]: method: Oct 30 01:21:18.702366 n-d-master-1 devstack@n-api.service[121102]: exception: Security group 939c9aec-990e-4be1-b8e7-bbf6eb05f001 does not exist Oct 30 01:21:18.702366 n-d-master-1 devstack@n-api.service[121102]: Neutron server returns request_ids: ['req-340c01ee-d8fd-4a3c-8120-53366065d57a'] Oct 30 01:21:18.702366 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '939c9aec-990e-4be1-b8e7-bbf6eb05f001'} Oct 30 01:21:18.708028 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:21:18.708028 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:18.708028 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 30 01:21:18.708028 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 30 01:21:18.708028 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:21:18.708028 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:21:18.708028 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 30 01:21:18.708028 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 30 01:21:18.708028 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:21:18.708028 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:21:18.708028 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 30 01:21:18.708028 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 30 01:21:18.708028 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:21:18.708028 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:21:18.708028 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 30 01:21:18.708028 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 30 01:21:18.708028 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:21:18.708028 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:21:18.708028 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 30 01:21:18.709763 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 30 01:21:18.709763 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:21:18.709763 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:21:18.709763 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 30 01:21:18.709763 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 30 01:21:18.709763 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 30 01:21:18.709763 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 30 01:21:18.709763 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 939c9aec-990e-4be1-b8e7-bbf6eb05f001 does not exist Oct 30 01:21:18.709763 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-340c01ee-d8fd-4a3c-8120-53366065d57a'] Oct 30 01:21:18.709763 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:18.709763 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:21:18.709763 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:18.709763 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:18.709763 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 30 01:21:18.709763 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 30 01:21:18.709763 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 30 01:21:18.709763 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 30 01:21:18.709763 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 939c9aec-990e-4be1-b8e7-bbf6eb05f001 does not exist Oct 30 01:21:18.711288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-340c01ee-d8fd-4a3c-8120-53366065d57a'] Oct 30 01:21:18.711288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:18.711288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:21:18.711288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:18.711288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:18.711288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:21:18.711288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:21:18.711288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:21:18.711288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:21:18.711288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:21:18.711288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:21:18.711288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:21:18.711288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:21:18.711288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 30 01:21:18.711288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 30 01:21:18.711288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 939c9aec-990e-4be1-b8e7-bbf6eb05f001 does not exist Oct 30 01:21:18.711288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-340c01ee-d8fd-4a3c-8120-53366065d57a'] Oct 30 01:21:18.711288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:18.711288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:21:18.711288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:18.711288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:18.713104 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:21:18.713104 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:21:18.713104 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:21:18.713104 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:21:18.713104 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 939c9aec-990e-4be1-b8e7-bbf6eb05f001 does not exist Oct 30 01:21:18.713104 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-340c01ee-d8fd-4a3c-8120-53366065d57a'] Oct 30 01:21:18.713104 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:18.713104 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d26745dd-edb6-4fdb-a30d-d134f82482d7 tempest-SecurityGroupsNegativeTestJSON-1335353662 tempest-SecurityGroupsNegativeTestJSON-1335353662-project] Returning 404 to user: Security group 939c9aec-990e-4be1-b8e7-bbf6eb05f001 does not exist Oct 30 01:21:18.713104 n-d-master-1 devstack@n-api.service[121102]: Neutron server returns request_ids: ['req-340c01ee-d8fd-4a3c-8120-53366065d57a'] {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:21:18.713104 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d26745dd-edb6-4fdb-a30d-d134f82482d7 tempest-SecurityGroupsNegativeTestJSON-1335353662 tempest-SecurityGroupsNegativeTestJSON-1335353662-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups/939c9aec-990e-4be1-b8e7-bbf6eb05f001" status: 404 len: 194 microversion: 2.1 time: 0.066343 Oct 30 01:21:18.713104 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1071/2107] 10.222.0.13 () {58 vars in 1269 bytes} [Sun Oct 30 01:21:18 2022] GET /compute/v2.1/os-security-groups/939c9aec-990e-4be1-b8e7-bbf6eb05f001 => generated 194 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:21:18.714843 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5fae48ee-d937-4cd3-a59a-2da0f9282d87 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:18.714843 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5fae48ee-d937-4cd3-a59a-2da0f9282d87 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:18.715371 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3e678fe8-1190-4e3d-926e-5a3e44f6b7f1 tempest-SecurityGroupsNegativeTestJSON-1335353662 tempest-SecurityGroupsNegativeTestJSON-1335353662-project] Action: 'update', calling method: .version_select at 0x7f44d03ce940>, body: {"security_group": {"name": "tempest-sg-471735734", "description": "tempest-description-719511843"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:21:18.729111 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5fae48ee-d937-4cd3-a59a-2da0f9282d87 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:18.730086 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5fae48ee-d937-4cd3-a59a-2da0f9282d87 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:18.730859 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5fae48ee-d937-4cd3-a59a-2da0f9282d87 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:18.732137 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5fae48ee-d937-4cd3-a59a-2da0f9282d87 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:18.732727 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5fae48ee-d937-4cd3-a59a-2da0f9282d87 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:18.733208 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5fae48ee-d937-4cd3-a59a-2da0f9282d87 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:18.761399 n-d-master-1 devstack@n-api.service[121102]: DEBUG neutronclient.v2_0.client [None req-3e678fe8-1190-4e3d-926e-5a3e44f6b7f1 tempest-SecurityGroupsNegativeTestJSON-1335353662 tempest-SecurityGroupsNegativeTestJSON-1335353662-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 94def999-5c8e-4430-85c4-4e6cf9c062ce does not exist", "detail": ""}} {{(pid=121102) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 30 01:21:18.762015 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.security_group_api [None req-3e678fe8-1190-4e3d-926e-5a3e44f6b7f1 tempest-SecurityGroupsNegativeTestJSON-1335353662 tempest-SecurityGroupsNegativeTestJSON-1335353662-project] Neutron security group 94def999-5c8e-4430-85c4-4e6cf9c062ce not found {{(pid=121102) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 30 01:21:18.762544 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-3e678fe8-1190-4e3d-926e-5a3e44f6b7f1 tempest-SecurityGroupsNegativeTestJSON-1335353662 tempest-SecurityGroupsNegativeTestJSON-1335353662-project] HTTP exception thrown: Security group 94def999-5c8e-4430-85c4-4e6cf9c062ce does not exist Oct 30 01:21:18.762544 n-d-master-1 devstack@n-api.service[121102]: Neutron server returns request_ids: ['req-bd5fab9e-0605-4804-bccd-bfa3373f0ed2'] Oct 30 01:21:18.765704 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3e678fe8-1190-4e3d-926e-5a3e44f6b7f1 tempest-SecurityGroupsNegativeTestJSON-1335353662 tempest-SecurityGroupsNegativeTestJSON-1335353662-project] Request method failure captured: Oct 30 01:21:18.765704 n-d-master-1 devstack@n-api.service[121102]: request: PUT /compute/v2.1/os-security-groups/94def999-5c8e-4430-85c4-4e6cf9c062ce HTTP/1.1 Oct 30 01:21:18.765704 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:21:18.765704 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:21:18.765704 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:21:18.765704 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 100 Oct 30 01:21:18.765704 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:21:18.765704 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:21:18.765704 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:21:18.765704 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:21:18.765704 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdGLkcfWpjNTRpQPugVfoSxuMKWk8ZqiTPSdN62BPtsvGGseB5rDHL1vTOwiT370NYFl3E6s-fqaxsOulZEMk2OrfbgL0dveRXxHXRzPUEXYWucVy5Zd7_-5IXqqu-gi1Byg-bVw70SyJoYd2OybRQ313O2hVk2JYQZrBDskAr5I4uc Oct 30 01:21:18.765704 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:21:18.765704 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:21:18.765704 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:21:18.765704 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:21:18.765704 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:21:18.765704 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:21:18.765704 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 4fc1f6311290483885e60eff6225a4f1 Oct 30 01:21:18.765704 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1335353662 Oct 30 01:21:18.765704 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:21:18.765704 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:21:18.767252 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4fc1f6311290483885e60eff6225a4f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4fc1f6311290483885e60eff6225a4f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4fc1f6311290483885e60eff6225a4f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4fc1f6311290483885e60eff6225a4f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:21:18.767252 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1335353662 Oct 30 01:21:18.767252 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 4fc1f6311290483885e60eff6225a4f1 Oct 30 01:21:18.767252 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1335353662 Oct 30 01:21:18.767252 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-SecurityGroupsNegativeTestJSON-1335353662-project Oct 30 01:21:18.767252 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:21:18.767252 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:21:18.767252 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 0677bca630fd40088dd32981f81bce20 Oct 30 01:21:18.767252 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1335353662-project Oct 30 01:21:18.767252 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:21:18.767252 n-d-master-1 devstack@n-api.service[121102]: {"security_group": {"name": "tempest-sg-471735734", "description": "tempest-description-719511843"}} Oct 30 01:21:18.767252 n-d-master-1 devstack@n-api.service[121102]: method: Oct 30 01:21:18.767252 n-d-master-1 devstack@n-api.service[121102]: exception: Security group 94def999-5c8e-4430-85c4-4e6cf9c062ce does not exist Oct 30 01:21:18.768295 n-d-master-1 devstack@n-api.service[121102]: Neutron server returns request_ids: ['req-bd5fab9e-0605-4804-bccd-bfa3373f0ed2'] Oct 30 01:21:18.768295 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '94def999-5c8e-4430-85c4-4e6cf9c062ce', 'body': {'security_group': {'name': 'tempest-sg-471735734', 'description': 'tempest-description-719511843'}}} Oct 30 01:21:18.768295 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:21:18.768295 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:18.768295 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 30 01:21:18.768295 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 30 01:21:18.768295 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:21:18.768295 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:21:18.768295 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 30 01:21:18.768295 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 30 01:21:18.768295 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:21:18.768295 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:21:18.768295 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 30 01:21:18.768295 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 30 01:21:18.768295 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:21:18.768295 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:21:18.768295 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 30 01:21:18.768295 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 30 01:21:18.769696 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:21:18.769696 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:21:18.769696 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 30 01:21:18.769696 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 30 01:21:18.769696 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:21:18.769696 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:21:18.769696 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 30 01:21:18.769696 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 30 01:21:18.769696 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 30 01:21:18.769696 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 30 01:21:18.769696 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 94def999-5c8e-4430-85c4-4e6cf9c062ce does not exist Oct 30 01:21:18.769696 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bd5fab9e-0605-4804-bccd-bfa3373f0ed2'] Oct 30 01:21:18.769696 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:18.769696 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:21:18.769696 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:18.769696 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:18.769696 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 30 01:21:18.769696 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 30 01:21:18.769696 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 30 01:21:18.771961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 30 01:21:18.771961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 94def999-5c8e-4430-85c4-4e6cf9c062ce does not exist Oct 30 01:21:18.771961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bd5fab9e-0605-4804-bccd-bfa3373f0ed2'] Oct 30 01:21:18.771961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:18.771961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:21:18.771961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:18.771961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:18.771961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:21:18.771961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:21:18.771961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:21:18.771961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:21:18.771961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:21:18.771961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:21:18.771961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:21:18.771961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:21:18.771961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 30 01:21:18.771961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 30 01:21:18.771961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 94def999-5c8e-4430-85c4-4e6cf9c062ce does not exist Oct 30 01:21:18.771961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bd5fab9e-0605-4804-bccd-bfa3373f0ed2'] Oct 30 01:21:18.771961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:18.774755 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:21:18.774755 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:18.774755 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:18.774755 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:21:18.774755 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:21:18.774755 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:21:18.774755 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:21:18.774755 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 94def999-5c8e-4430-85c4-4e6cf9c062ce does not exist Oct 30 01:21:18.774755 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bd5fab9e-0605-4804-bccd-bfa3373f0ed2'] Oct 30 01:21:18.774755 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:18.774755 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3e678fe8-1190-4e3d-926e-5a3e44f6b7f1 tempest-SecurityGroupsNegativeTestJSON-1335353662 tempest-SecurityGroupsNegativeTestJSON-1335353662-project] Returning 404 to user: Security group 94def999-5c8e-4430-85c4-4e6cf9c062ce does not exist Oct 30 01:21:18.774755 n-d-master-1 devstack@n-api.service[121102]: Neutron server returns request_ids: ['req-bd5fab9e-0605-4804-bccd-bfa3373f0ed2'] {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:21:18.774755 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3e678fe8-1190-4e3d-926e-5a3e44f6b7f1 tempest-SecurityGroupsNegativeTestJSON-1335353662 tempest-SecurityGroupsNegativeTestJSON-1335353662-project] 10.222.0.13 "PUT /compute/v2.1/os-security-groups/94def999-5c8e-4430-85c4-4e6cf9c062ce" status: 404 len: 194 microversion: 2.1 time: 0.058898 Oct 30 01:21:18.776644 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1072/2108] 10.222.0.13 () {60 vars in 1290 bytes} [Sun Oct 30 01:21:18 2022] PUT /compute/v2.1/os-security-groups/94def999-5c8e-4430-85c4-4e6cf9c062ce => generated 194 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 01:21:18.889172 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5fae48ee-d937-4cd3-a59a-2da0f9282d87 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:18.902723 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5fae48ee-d937-4cd3-a59a-2da0f9282d87 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:18.906540 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5fae48ee-d937-4cd3-a59a-2da0f9282d87 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:18.922188 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5fae48ee-d937-4cd3-a59a-2da0f9282d87 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1539 microversion: 2.91 time: 0.230219 Oct 30 01:21:18.926601 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1037/2109] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:21:18 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1539 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:21:18.951798 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a5eb34bb-6c6d-4dae-870e-3d02296176bb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:18.953500 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a5eb34bb-6c6d-4dae-870e-3d02296176bb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 24828782-5e5e-402e-9e2b-644b166cf844] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:18.970026 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a5eb34bb-6c6d-4dae-870e-3d02296176bb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:18.970755 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a5eb34bb-6c6d-4dae-870e-3d02296176bb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:18.971551 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a5eb34bb-6c6d-4dae-870e-3d02296176bb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:18.972490 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a5eb34bb-6c6d-4dae-870e-3d02296176bb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:18.977116 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a5eb34bb-6c6d-4dae-870e-3d02296176bb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:18.979219 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a5eb34bb-6c6d-4dae-870e-3d02296176bb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:19.042338 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-a5eb34bb-6c6d-4dae-870e-3d02296176bb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] HTTP exception thrown: Instance 24828782-5e5e-402e-9e2b-644b166cf844 could not be found. Oct 30 01:21:19.044120 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a5eb34bb-6c6d-4dae-870e-3d02296176bb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Request method failure captured: Oct 30 01:21:19.044120 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/24828782-5e5e-402e-9e2b-644b166cf844 HTTP/1.1 Oct 30 01:21:19.044120 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:21:19.044120 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:21:19.044120 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:21:19.044120 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:21:19.044120 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:21:19.044120 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:21:19.044120 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:21:19.044120 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:21:19.044120 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdEZHAwNEyYVN8mbZetD1IgknrDb-nJfmTHtgPgtOr9AeQL99EuTYclSviV8aikzXcemJ-XkTVClxHn6U4xG48gAdXZcIs0fYa7Kdvvi7PzFjDxYMfOtgAp7wAvvVW7kd-J_XMzQX3yJBWm7NW5-QhmguztBnHz9UniQWs2CmNftHaI Oct 30 01:21:19.044120 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:21:19.044120 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:21:19.044120 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:21:19.044120 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:21:19.044120 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:21:19.044120 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:21:19.044120 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 8c95e97cd7e4461682b9028abb568dce Oct 30 01:21:19.044120 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:21:19.044120 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:21:19.044120 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:21:19.045819 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:21:19.045819 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:21:19.045819 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 8c95e97cd7e4461682b9028abb568dce Oct 30 01:21:19.045819 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:21:19.045819 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-DeleteServersTestJSON-1379968241-project Oct 30 01:21:19.045819 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:21:19.045819 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:21:19.045819 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 33691c943ec040ddb04b6648b6e945ab Oct 30 01:21:19.045819 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-DeleteServersTestJSON-1379968241-project Oct 30 01:21:19.045819 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:21:19.045819 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 24828782-5e5e-402e-9e2b-644b166cf844 could not be found. Oct 30 01:21:19.045819 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '24828782-5e5e-402e-9e2b-644b166cf844'} Oct 30 01:21:19.046704 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:21:19.046704 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:19.046704 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:21:19.046704 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:21:19.046704 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:21:19.046704 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:21:19.046704 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:21:19.046704 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:21:19.046704 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:21:19.046704 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:21:19.046704 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24828782-5e5e-402e-9e2b-644b166cf844 could not be found. Oct 30 01:21:19.046704 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:19.046704 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:21:19.046704 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:19.046704 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:19.046704 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:21:19.046704 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:21:19.046704 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:21:19.046704 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:21:19.046704 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:21:19.048127 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:21:19.048127 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:21:19.048127 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:21:19.048127 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:21:19.048127 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:21:19.048127 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:21:19.048127 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:21:19.048127 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24828782-5e5e-402e-9e2b-644b166cf844 could not be found. Oct 30 01:21:19.048127 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:19.048127 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:21:19.048127 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:19.048127 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:19.048127 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:21:19.048127 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:21:19.048127 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:21:19.048127 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:21:19.048127 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24828782-5e5e-402e-9e2b-644b166cf844 could not be found. Oct 30 01:21:19.048127 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:19.050268 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a5eb34bb-6c6d-4dae-870e-3d02296176bb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Returning 404 to user: Instance 24828782-5e5e-402e-9e2b-644b166cf844 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:21:19.050268 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a5eb34bb-6c6d-4dae-870e-3d02296176bb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/24828782-5e5e-402e-9e2b-644b166cf844" status: 404 len: 111 microversion: 2.1 time: 0.101038 Oct 30 01:21:19.052494 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1073/2110] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:18 2022] GET /compute/v2.1/servers/24828782-5e5e-402e-9e2b-644b166cf844 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:21:19.239153 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c06aabb7-fa20-42c8-b2a5-39c243077391 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-632827594", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "19e0e4e2-b502-4a02-810a-996c246e8c64"}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:21:19.360845 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5cc36e27-a4c6-475b-b124-b808dd3e1c5f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:19.361499 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5cc36e27-a4c6-475b-b124-b808dd3e1c5f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 5ed38927-680d-4e93-b57a-21fb407c6b33] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:19.364721 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-c06aabb7-fa20-42c8-b2a5-39c243077391 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] validate_networks() for [('19e0e4e2-b502-4a02-810a-996c246e8c64', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:21:19.370623 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5cc36e27-a4c6-475b-b124-b808dd3e1c5f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:19.375459 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5cc36e27-a4c6-475b-b124-b808dd3e1c5f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:19.376033 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5cc36e27-a4c6-475b-b124-b808dd3e1c5f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:19.376805 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5cc36e27-a4c6-475b-b124-b808dd3e1c5f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:19.377311 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5cc36e27-a4c6-475b-b124-b808dd3e1c5f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:19.377829 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5cc36e27-a4c6-475b-b124-b808dd3e1c5f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:19.390685 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:19.961075 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=8 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:20.222668 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5cc36e27-a4c6-475b-b124-b808dd3e1c5f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:20.238483 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5cc36e27-a4c6-475b-b124-b808dd3e1c5f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:20.245725 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5cc36e27-a4c6-475b-b124-b808dd3e1c5f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:20.247037 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5cc36e27-a4c6-475b-b124-b808dd3e1c5f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33" status: 200 len: 1485 microversion: 2.25 time: 0.891992 Oct 30 01:21:20.248154 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1074/2111] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:21:19 2022] GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33 => generated 1485 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:21:20.258648 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8e5fe4d5-a5b3-424b-a89c-8f32eb01d40e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:20.263597 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8e5fe4d5-a5b3-424b-a89c-8f32eb01d40e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 03d9aff4-215d-48fa-b741-2257b62fc597] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:20.287699 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8e5fe4d5-a5b3-424b-a89c-8f32eb01d40e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:20.295373 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8e5fe4d5-a5b3-424b-a89c-8f32eb01d40e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:20.295373 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8e5fe4d5-a5b3-424b-a89c-8f32eb01d40e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:20.295373 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8e5fe4d5-a5b3-424b-a89c-8f32eb01d40e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:20.296149 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8e5fe4d5-a5b3-424b-a89c-8f32eb01d40e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:20.296779 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8e5fe4d5-a5b3-424b-a89c-8f32eb01d40e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:21.425038 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8e5fe4d5-a5b3-424b-a89c-8f32eb01d40e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:21.437809 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8e5fe4d5-a5b3-424b-a89c-8f32eb01d40e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597" status: 200 len: 1535 microversion: 2.1 time: 1.186609 Oct 30 01:21:21.437809 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1075/2112] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:20 2022] GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597 => generated 1535 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:21.444243 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2af190d4-7d6e-443d-a2ee-8644373eff9f tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:21.444861 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2af190d4-7d6e-443d-a2ee-8644373eff9f tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] [instance: d190bf6d-50f5-454f-a9fa-4296cd25bddd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:21.454413 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2af190d4-7d6e-443d-a2ee-8644373eff9f tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:21.456132 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2af190d4-7d6e-443d-a2ee-8644373eff9f tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:21.456746 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2af190d4-7d6e-443d-a2ee-8644373eff9f tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:21.457513 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2af190d4-7d6e-443d-a2ee-8644373eff9f tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:21.457966 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2af190d4-7d6e-443d-a2ee-8644373eff9f tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:21.458386 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2af190d4-7d6e-443d-a2ee-8644373eff9f tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:22.009951 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-c06aabb7-fa20-42c8-b2a5-39c243077391 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:21:22.010730 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-c06aabb7-fa20-42c8-b2a5-39c243077391 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:21:22.010931 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-c06aabb7-fa20-42c8-b2a5-39c243077391 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:21:22.011301 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-c06aabb7-fa20-42c8-b2a5-39c243077391 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:21:22.011829 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-c06aabb7-fa20-42c8-b2a5-39c243077391 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:21:22.022293 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c06aabb7-fa20-42c8-b2a5-39c243077391 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:22.022828 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c06aabb7-fa20-42c8-b2a5-39c243077391 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:22.023342 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c06aabb7-fa20-42c8-b2a5-39c243077391 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:22.024235 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c06aabb7-fa20-42c8-b2a5-39c243077391 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:22.024699 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c06aabb7-fa20-42c8-b2a5-39c243077391 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:22.025125 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c06aabb7-fa20-42c8-b2a5-39c243077391 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:22.028224 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2af190d4-7d6e-443d-a2ee-8644373eff9f tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9f71f892094c2685b175e111fe7cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a766acde7eab4b05866a2c33f5dd3606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:22.036682 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2af190d4-7d6e-443d-a2ee-8644373eff9f tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] 10.222.0.13 "GET /compute/v2.1/servers/d190bf6d-50f5-454f-a9fa-4296cd25bddd" status: 200 len: 1316 microversion: 2.1 time: 0.597631 Oct 30 01:21:22.050789 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-c06aabb7-fa20-42c8-b2a5-39c243077391 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Getting quotas for project 8c95e97cd7e4461682b9028abb568dce. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:21:22.054136 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1076/2113] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:21 2022] GET /compute/v2.1/servers/d190bf6d-50f5-454f-a9fa-4296cd25bddd => generated 1316 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:22.057009 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-c06aabb7-fa20-42c8-b2a5-39c243077391 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Getting quotas for user 33691c943ec040ddb04b6648b6e945ab and project 8c95e97cd7e4461682b9028abb568dce. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:21:22.060485 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a8c60de6-9829-4f99-ac70-1c87ce63f592 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:22.063701 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a8c60de6-9829-4f99-ac70-1c87ce63f592 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:22.068481 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a8c60de6-9829-4f99-ac70-1c87ce63f592 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:22.069491 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a8c60de6-9829-4f99-ac70-1c87ce63f592 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:22.070114 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a8c60de6-9829-4f99-ac70-1c87ce63f592 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:22.071010 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a8c60de6-9829-4f99-ac70-1c87ce63f592 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:22.071327 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c06aabb7-fa20-42c8-b2a5-39c243077391 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:21:22.071889 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a8c60de6-9829-4f99-ac70-1c87ce63f592 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:22.072327 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a8c60de6-9829-4f99-ac70-1c87ce63f592 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:22.073756 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c06aabb7-fa20-42c8-b2a5-39c243077391 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 2b103487-3d7a-4186-aede-cb565cd34449] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:21:22.188139 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c06aabb7-fa20-42c8-b2a5-39c243077391 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.953046 Oct 30 01:21:22.196022 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1038/2114] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:21:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2962 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:21:22.237181 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a8c60de6-9829-4f99-ac70-1c87ce63f592 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:22.253441 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a8c60de6-9829-4f99-ac70-1c87ce63f592 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:22.255812 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a8c60de6-9829-4f99-ac70-1c87ce63f592 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:22.269278 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a8c60de6-9829-4f99-ac70-1c87ce63f592 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1539 microversion: 2.91 time: 0.213560 Oct 30 01:21:22.280698 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1077/2115] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:21:22 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1539 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:21:22.298843 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-11b24aed-8b9c-43f0-b245-871e379f86f0 req-3209dfa5-c91e-4893-9441-f484b8977e89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d190bf6d-50f5-454f-a9fa-4296cd25bddd", "tag": "54eedcfa-243d-4a94-9210-f1a09802d1b6"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:21:22.312220 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-11b24aed-8b9c-43f0-b245-871e379f86f0 req-3209dfa5-c91e-4893-9441-f484b8977e89 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:22.312956 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-11b24aed-8b9c-43f0-b245-871e379f86f0 req-3209dfa5-c91e-4893-9441-f484b8977e89 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:22.313629 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-11b24aed-8b9c-43f0-b245-871e379f86f0 req-3209dfa5-c91e-4893-9441-f484b8977e89 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:22.331934 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-11b24aed-8b9c-43f0-b245-871e379f86f0 req-3209dfa5-c91e-4893-9441-f484b8977e89 service nova] Creating event network-changed:54eedcfa-243d-4a94-9210-f1a09802d1b6 for instance d190bf6d-50f5-454f-a9fa-4296cd25bddd on n-h2-master-1 Oct 30 01:21:22.339521 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-11b24aed-8b9c-43f0-b245-871e379f86f0 req-3209dfa5-c91e-4893-9441-f484b8977e89 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052637 Oct 30 01:21:22.341483 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1078/2116] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:21:22.348902 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f3a06c83-ffe8-4b62-b985-c0391e22a3ff tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:22.349456 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f3a06c83-ffe8-4b62-b985-c0391e22a3ff tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 5ed38927-680d-4e93-b57a-21fb407c6b33] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:22.357552 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3a06c83-ffe8-4b62-b985-c0391e22a3ff tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:22.358273 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3a06c83-ffe8-4b62-b985-c0391e22a3ff tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:22.358932 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3a06c83-ffe8-4b62-b985-c0391e22a3ff tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:22.359787 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3a06c83-ffe8-4b62-b985-c0391e22a3ff tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:22.360909 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3a06c83-ffe8-4b62-b985-c0391e22a3ff tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:22.361840 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3a06c83-ffe8-4b62-b985-c0391e22a3ff tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:22.475981 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-213861ae-8f60-45b1-b1e2-ec70b119207e tempest-ListImageFiltersNegativeTestJSON-777947180 tempest-ListImageFiltersNegativeTestJSON-777947180-project] Calling method '.version_select at 0x7f44c7b8c4c0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:22.515885 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-213861ae-8f60-45b1-b1e2-ec70b119207e tempest-ListImageFiltersNegativeTestJSON-777947180 tempest-ListImageFiltersNegativeTestJSON-777947180-project] HTTP exception thrown: Image not found. Oct 30 01:21:22.518534 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-213861ae-8f60-45b1-b1e2-ec70b119207e tempest-ListImageFiltersNegativeTestJSON-777947180 tempest-ListImageFiltersNegativeTestJSON-777947180-project] Request method failure captured: Oct 30 01:21:22.518534 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/images/16b1abbc-ae6d-494d-9eb7-e2beaf64afc9 HTTP/1.1 Oct 30 01:21:22.518534 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:21:22.518534 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:21:22.518534 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:21:22.518534 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:21:22.518534 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:21:22.518534 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:21:22.518534 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:21:22.518534 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:21:22.518534 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdGQ1p7LZs3_tYb6JWoVLrvdAqD4b4nrwMlZ7-fapShByArigrOCqAWX3sNtyp8TumOwLzgrsELSPPH1fGjlnmLm-DFpw6hQ7FRQTbuBrkdV-DKVz_GGpJkUqwlER7mxAYv1nzEUT9ObO35tZv4SDvEvpjF-3cEkTRA6kouo_wypMSM Oct 30 01:21:22.518534 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:21:22.518534 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:21:22.518534 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:21:22.518534 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:21:22.518534 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:21:22.518534 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:21:22.518534 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: f15acd9335914ed28820ad05a7b46120 Oct 30 01:21:22.518534 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-777947180 Oct 30 01:21:22.518534 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:21:22.518534 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:21:22.520293 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f15acd9335914ed28820ad05a7b46120"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f15acd9335914ed28820ad05a7b46120"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f15acd9335914ed28820ad05a7b46120"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f15acd9335914ed28820ad05a7b46120"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:21:22.520293 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-777947180 Oct 30 01:21:22.520293 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: f15acd9335914ed28820ad05a7b46120 Oct 30 01:21:22.520293 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-777947180 Oct 30 01:21:22.520293 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ListImageFiltersNegativeTestJSON-777947180-project Oct 30 01:21:22.520293 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:21:22.520293 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:21:22.520293 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 568cdd06354f4e22ae62e1e88a65edf3 Oct 30 01:21:22.520293 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-777947180-project Oct 30 01:21:22.520293 n-d-master-1 devstack@n-api.service[121103]: method: Oct 30 01:21:22.520293 n-d-master-1 devstack@n-api.service[121103]: exception: Image not found. Oct 30 01:21:22.520293 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '16b1abbc-ae6d-494d-9eb7-e2beaf64afc9'} Oct 30 01:21:22.520293 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:21:22.521272 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:22.521272 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 30 01:21:22.521272 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 30 01:21:22.521272 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 30 01:21:22.521272 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 30 01:21:22.521272 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 30 01:21:22.521272 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 30 01:21:22.521272 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 30 01:21:22.521272 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 30 01:21:22.521272 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 30 01:21:22.521272 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 30 01:21:22.521272 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 30 01:21:22.521272 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 30 01:21:22.521272 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 30 01:21:22.521272 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 30 01:21:22.521272 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 30 01:21:22.521272 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 30 01:21:22.521272 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 16b1abbc-ae6d-494d-9eb7-e2beaf64afc9 Oct 30 01:21:22.522640 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:21:22.522640 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:21:22.522640 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:21:22.522640 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:22.522640 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 30 01:21:22.522640 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 30 01:21:22.522640 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 30 01:21:22.522640 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 30 01:21:22.522640 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 30 01:21:22.522640 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 30 01:21:22.522640 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 30 01:21:22.522640 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 30 01:21:22.522640 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 30 01:21:22.522640 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 30 01:21:22.522640 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 30 01:21:22.522640 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 30 01:21:22.522640 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 30 01:21:22.522640 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 30 01:21:22.522640 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 30 01:21:22.522640 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 30 01:21:22.524016 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 30 01:21:22.524016 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 30 01:21:22.524016 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 30 01:21:22.524016 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 30 01:21:22.524016 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 30 01:21:22.524016 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 30 01:21:22.524016 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 30 01:21:22.524016 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 30 01:21:22.524016 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 16b1abbc-ae6d-494d-9eb7-e2beaf64afc9 could not be found. Oct 30 01:21:22.524016 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:21:22.524016 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:21:22.524016 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:21:22.524016 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:22.524016 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:21:22.524016 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:21:22.524016 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:21:22.524016 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:21:22.524016 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:21:22.524016 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:21:22.529887 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:21:22.529887 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:21:22.529887 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 30 01:21:22.529887 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 30 01:21:22.529887 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 30 01:21:22.529887 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:21:22.529887 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:21:22.529887 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:21:22.529887 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:22.529887 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:21:22.529887 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:21:22.529887 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:21:22.529887 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:21:22.529887 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 30 01:21:22.529887 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:21:22.529887 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-213861ae-8f60-45b1-b1e2-ec70b119207e tempest-ListImageFiltersNegativeTestJSON-777947180 tempest-ListImageFiltersNegativeTestJSON-777947180-project] Returning 404 to user: Image not found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:21:22.531008 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-213861ae-8f60-45b1-b1e2-ec70b119207e tempest-ListImageFiltersNegativeTestJSON-777947180 tempest-ListImageFiltersNegativeTestJSON-777947180-project] 10.222.0.13 "GET /compute/v2.1/images/16b1abbc-ae6d-494d-9eb7-e2beaf64afc9" status: 404 len: 62 microversion: 2.1 time: 0.325510 Oct 30 01:21:22.531008 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1039/2117] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:21:22 2022] GET /compute/v2.1/images/16b1abbc-ae6d-494d-9eb7-e2beaf64afc9 => generated 62 bytes in 330 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:21:22.551559 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ea7b0ae2-b1a9-4f05-aba8-bbe0a2e62cda tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:22.553409 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ea7b0ae2-b1a9-4f05-aba8-bbe0a2e62cda tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 2b103487-3d7a-4186-aede-cb565cd34449] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:22.802372 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ea7b0ae2-b1a9-4f05-aba8-bbe0a2e62cda tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:22.816750 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ea7b0ae2-b1a9-4f05-aba8-bbe0a2e62cda tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/2b103487-3d7a-4186-aede-cb565cd34449" status: 200 len: 1214 microversion: 2.1 time: 0.288146 Oct 30 01:21:22.818412 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1040/2118] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:22 2022] GET /compute/v2.1/servers/2b103487-3d7a-4186-aede-cb565cd34449 => generated 1214 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:22.851946 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-462a7bb1-6dba-4b0c-9f88-948919a5dc8d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:22.855357 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-462a7bb1-6dba-4b0c-9f88-948919a5dc8d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 03d9aff4-215d-48fa-b741-2257b62fc597] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:22.871363 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-462a7bb1-6dba-4b0c-9f88-948919a5dc8d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:22.871887 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-462a7bb1-6dba-4b0c-9f88-948919a5dc8d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:22.872343 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-462a7bb1-6dba-4b0c-9f88-948919a5dc8d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:22.873083 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-462a7bb1-6dba-4b0c-9f88-948919a5dc8d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:22.873591 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-462a7bb1-6dba-4b0c-9f88-948919a5dc8d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:22.874029 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-462a7bb1-6dba-4b0c-9f88-948919a5dc8d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:23.101392 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-462a7bb1-6dba-4b0c-9f88-948919a5dc8d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:23.132374 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-462a7bb1-6dba-4b0c-9f88-948919a5dc8d tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597" status: 200 len: 1493 microversion: 2.1 time: 0.311100 Oct 30 01:21:23.135917 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1041/2119] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:22 2022] GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597 => generated 1493 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:23.155854 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-d5f6fa42-6d60-4df7-9398-fb98ba5ae8f0 req-d6067f41-3f42-422d-b2ab-fd684139826a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03d9aff4-215d-48fa-b741-2257b62fc597", "name": "network-vif-deleted", "tag": "f852959f-05e2-49d9-95ba-a62b3b029d75"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:21:23.166438 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f3a06c83-ffe8-4b62-b985-c0391e22a3ff tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:23.182544 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d5f6fa42-6d60-4df7-9398-fb98ba5ae8f0 req-d6067f41-3f42-422d-b2ab-fd684139826a service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:23.184406 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d5f6fa42-6d60-4df7-9398-fb98ba5ae8f0 req-d6067f41-3f42-422d-b2ab-fd684139826a service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:23.186237 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d5f6fa42-6d60-4df7-9398-fb98ba5ae8f0 req-d6067f41-3f42-422d-b2ab-fd684139826a service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:23.197369 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f3a06c83-ffe8-4b62-b985-c0391e22a3ff tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:23.207422 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f3a06c83-ffe8-4b62-b985-c0391e22a3ff tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:23.208858 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-d5f6fa42-6d60-4df7-9398-fb98ba5ae8f0 req-d6067f41-3f42-422d-b2ab-fd684139826a service nova] Creating event network-vif-deleted:f852959f-05e2-49d9-95ba-a62b3b029d75 for instance 03d9aff4-215d-48fa-b741-2257b62fc597 on n-h1-master-1 Oct 30 01:21:23.212823 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f3a06c83-ffe8-4b62-b985-c0391e22a3ff tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33" status: 200 len: 1485 microversion: 2.25 time: 0.864972 Oct 30 01:21:23.218983 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1079/2120] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:21:22 2022] GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33 => generated 1485 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:21:23.224092 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-d5f6fa42-6d60-4df7-9398-fb98ba5ae8f0 req-d6067f41-3f42-422d-b2ab-fd684139826a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080664 Oct 30 01:21:23.227814 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1042/2121] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:21:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:21:23.236272 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0e5556d5-a8f8-44c8-90c7-1a462f97adfb tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:23.238216 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0e5556d5-a8f8-44c8-90c7-1a462f97adfb tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] [instance: d190bf6d-50f5-454f-a9fa-4296cd25bddd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:23.257834 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e5556d5-a8f8-44c8-90c7-1a462f97adfb tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:23.258270 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e5556d5-a8f8-44c8-90c7-1a462f97adfb tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:23.263124 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e5556d5-a8f8-44c8-90c7-1a462f97adfb tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:23.266422 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e5556d5-a8f8-44c8-90c7-1a462f97adfb tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:23.268928 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e5556d5-a8f8-44c8-90c7-1a462f97adfb tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:23.269642 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e5556d5-a8f8-44c8-90c7-1a462f97adfb tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:23.302558 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a0bc0711-d8e2-401e-ae70-3cb6bb24bfab tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:23.303538 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a0bc0711-d8e2-401e-ae70-3cb6bb24bfab tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:23.312604 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a0bc0711-d8e2-401e-ae70-3cb6bb24bfab tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:23.317674 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a0bc0711-d8e2-401e-ae70-3cb6bb24bfab tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:23.319337 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a0bc0711-d8e2-401e-ae70-3cb6bb24bfab tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:23.320474 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a0bc0711-d8e2-401e-ae70-3cb6bb24bfab tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:23.321111 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a0bc0711-d8e2-401e-ae70-3cb6bb24bfab tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:23.322001 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a0bc0711-d8e2-401e-ae70-3cb6bb24bfab tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:23.816334 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a0bc0711-d8e2-401e-ae70-3cb6bb24bfab tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:23.838166 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a0bc0711-d8e2-401e-ae70-3cb6bb24bfab tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:23.840715 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a0bc0711-d8e2-401e-ae70-3cb6bb24bfab tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:23.849622 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a0bc0711-d8e2-401e-ae70-3cb6bb24bfab tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1539 microversion: 2.91 time: 0.549650 Oct 30 01:21:23.850759 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1043/2122] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:21:23 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1539 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:21:23.856441 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b8e2754b-e343-4eb3-8e74-d7834f69ec46 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:23.857283 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b8e2754b-e343-4eb3-8e74-d7834f69ec46 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 2b103487-3d7a-4186-aede-cb565cd34449] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:23.864310 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b8e2754b-e343-4eb3-8e74-d7834f69ec46 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:23.869591 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b8e2754b-e343-4eb3-8e74-d7834f69ec46 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:23.869591 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b8e2754b-e343-4eb3-8e74-d7834f69ec46 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:23.869591 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b8e2754b-e343-4eb3-8e74-d7834f69ec46 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:23.869591 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b8e2754b-e343-4eb3-8e74-d7834f69ec46 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:23.870117 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b8e2754b-e343-4eb3-8e74-d7834f69ec46 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:24.074378 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b8e2754b-e343-4eb3-8e74-d7834f69ec46 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:24.085374 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b8e2754b-e343-4eb3-8e74-d7834f69ec46 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/2b103487-3d7a-4186-aede-cb565cd34449" status: 200 len: 1218 microversion: 2.1 time: 0.233077 Oct 30 01:21:24.099572 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1044/2123] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:23 2022] GET /compute/v2.1/servers/2b103487-3d7a-4186-aede-cb565cd34449 => generated 1218 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:24.169085 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0d238b37-fb4e-4f23-aa25-002ad6416aa1 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:24.169679 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0d238b37-fb4e-4f23-aa25-002ad6416aa1 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 03d9aff4-215d-48fa-b741-2257b62fc597] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:24.176824 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0e5556d5-a8f8-44c8-90c7-1a462f97adfb tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9f71f892094c2685b175e111fe7cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a766acde7eab4b05866a2c33f5dd3606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:24.182113 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d238b37-fb4e-4f23-aa25-002ad6416aa1 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:24.185914 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d238b37-fb4e-4f23-aa25-002ad6416aa1 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:24.192587 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0e5556d5-a8f8-44c8-90c7-1a462f97adfb tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] 10.222.0.13 "GET /compute/v2.1/servers/d190bf6d-50f5-454f-a9fa-4296cd25bddd" status: 200 len: 1316 microversion: 2.1 time: 0.972237 Oct 30 01:21:24.194844 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1080/2124] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:23 2022] GET /compute/v2.1/servers/d190bf6d-50f5-454f-a9fa-4296cd25bddd => generated 1316 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:24.220956 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d238b37-fb4e-4f23-aa25-002ad6416aa1 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:24.223403 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d238b37-fb4e-4f23-aa25-002ad6416aa1 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:24.225561 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d238b37-fb4e-4f23-aa25-002ad6416aa1 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:24.226646 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d238b37-fb4e-4f23-aa25-002ad6416aa1 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:24.248089 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-92c9ca16-9c4c-41e6-973f-f4cb9e55a732 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:24.248702 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-92c9ca16-9c4c-41e6-973f-f4cb9e55a732 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 5ed38927-680d-4e93-b57a-21fb407c6b33] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:24.260471 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92c9ca16-9c4c-41e6-973f-f4cb9e55a732 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:24.263792 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92c9ca16-9c4c-41e6-973f-f4cb9e55a732 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:24.264443 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92c9ca16-9c4c-41e6-973f-f4cb9e55a732 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:24.265620 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92c9ca16-9c4c-41e6-973f-f4cb9e55a732 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:24.267696 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92c9ca16-9c4c-41e6-973f-f4cb9e55a732 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:24.268343 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92c9ca16-9c4c-41e6-973f-f4cb9e55a732 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:24.320191 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d238b37-fb4e-4f23-aa25-002ad6416aa1 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:24.320677 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d238b37-fb4e-4f23-aa25-002ad6416aa1 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:24.321510 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d238b37-fb4e-4f23-aa25-002ad6416aa1 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:24.321674 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-0d238b37-fb4e-4f23-aa25-002ad6416aa1 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lazy-loading 'fault' on Instance uuid 03d9aff4-215d-48fa-b741-2257b62fc597 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:21:24.444863 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0d238b37-fb4e-4f23-aa25-002ad6416aa1 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:24.479954 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0d238b37-fb4e-4f23-aa25-002ad6416aa1 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597" status: 200 len: 1369 microversion: 2.1 time: 0.317079 Oct 30 01:21:24.499208 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1045/2125] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:24 2022] GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597 => generated 1369 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:21:24.619169 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-92c9ca16-9c4c-41e6-973f-f4cb9e55a732 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:24.630134 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-92c9ca16-9c4c-41e6-973f-f4cb9e55a732 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:24.632046 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-92c9ca16-9c4c-41e6-973f-f4cb9e55a732 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:24.634185 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-92c9ca16-9c4c-41e6-973f-f4cb9e55a732 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33" status: 200 len: 1485 microversion: 2.25 time: 0.390105 Oct 30 01:21:24.634957 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1081/2126] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:21:24 2022] GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33 => generated 1485 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:21:24.889800 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c2d0b4ee-7e1d-4d25-ba41-9905aeb2a89a tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:24.890458 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c2d0b4ee-7e1d-4d25-ba41-9905aeb2a89a tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:24.916077 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c2d0b4ee-7e1d-4d25-ba41-9905aeb2a89a tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:24.916077 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c2d0b4ee-7e1d-4d25-ba41-9905aeb2a89a tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:24.916077 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c2d0b4ee-7e1d-4d25-ba41-9905aeb2a89a tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:24.916077 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c2d0b4ee-7e1d-4d25-ba41-9905aeb2a89a tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:24.916830 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c2d0b4ee-7e1d-4d25-ba41-9905aeb2a89a tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:24.916830 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c2d0b4ee-7e1d-4d25-ba41-9905aeb2a89a tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:25.113701 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a056ab25-2d21-4342-be7d-2463cca85d36 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:25.114606 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a056ab25-2d21-4342-be7d-2463cca85d36 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 2b103487-3d7a-4186-aede-cb565cd34449] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:25.127346 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a056ab25-2d21-4342-be7d-2463cca85d36 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:25.127699 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a056ab25-2d21-4342-be7d-2463cca85d36 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:25.128140 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a056ab25-2d21-4342-be7d-2463cca85d36 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:25.128864 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a056ab25-2d21-4342-be7d-2463cca85d36 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:25.129322 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a056ab25-2d21-4342-be7d-2463cca85d36 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:25.129767 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a056ab25-2d21-4342-be7d-2463cca85d36 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:25.134634 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c2d0b4ee-7e1d-4d25-ba41-9905aeb2a89a tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:25.152592 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c2d0b4ee-7e1d-4d25-ba41-9905aeb2a89a tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:25.159169 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c2d0b4ee-7e1d-4d25-ba41-9905aeb2a89a tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:25.180487 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c2d0b4ee-7e1d-4d25-ba41-9905aeb2a89a tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1539 microversion: 2.91 time: 0.304014 Oct 30 01:21:25.181458 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1046/2127] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:21:24 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1539 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:21:25.190886 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-7afc379a-0587-432e-8999-632dacee894e req-02036fce-e55d-4301-839c-d57b5cafde28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d190bf6d-50f5-454f-a9fa-4296cd25bddd", "name": "network-vif-plugged", "status": "completed", "tag": "54eedcfa-243d-4a94-9210-f1a09802d1b6"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:21:25.215468 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-7afc379a-0587-432e-8999-632dacee894e req-02036fce-e55d-4301-839c-d57b5cafde28 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:25.215958 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-7afc379a-0587-432e-8999-632dacee894e req-02036fce-e55d-4301-839c-d57b5cafde28 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:25.222650 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-7afc379a-0587-432e-8999-632dacee894e req-02036fce-e55d-4301-839c-d57b5cafde28 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:25.241220 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-7afc379a-0587-432e-8999-632dacee894e req-02036fce-e55d-4301-839c-d57b5cafde28 service nova] Creating event network-vif-plugged:54eedcfa-243d-4a94-9210-f1a09802d1b6 for instance d190bf6d-50f5-454f-a9fa-4296cd25bddd on n-h2-master-1 Oct 30 01:21:25.247374 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-7afc379a-0587-432e-8999-632dacee894e req-02036fce-e55d-4301-839c-d57b5cafde28 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064384 Oct 30 01:21:25.248608 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1047/2128] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:21:25.255693 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-88b505f9-f8b9-414f-ae04-fb169e898907 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:25.256633 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-88b505f9-f8b9-414f-ae04-fb169e898907 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] [instance: d190bf6d-50f5-454f-a9fa-4296cd25bddd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:25.267049 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-88b505f9-f8b9-414f-ae04-fb169e898907 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:25.267547 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-88b505f9-f8b9-414f-ae04-fb169e898907 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:25.269553 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-88b505f9-f8b9-414f-ae04-fb169e898907 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:25.270322 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-88b505f9-f8b9-414f-ae04-fb169e898907 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:25.270989 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-88b505f9-f8b9-414f-ae04-fb169e898907 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:25.271421 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-88b505f9-f8b9-414f-ae04-fb169e898907 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:25.305795 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a056ab25-2d21-4342-be7d-2463cca85d36 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:25.324878 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a056ab25-2d21-4342-be7d-2463cca85d36 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/2b103487-3d7a-4186-aede-cb565cd34449" status: 200 len: 1266 microversion: 2.1 time: 0.219275 Oct 30 01:21:25.340525 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1082/2129] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:25 2022] GET /compute/v2.1/servers/2b103487-3d7a-4186-aede-cb565cd34449 => generated 1266 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:25.510142 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-49185e63-ff89-47c5-9aaf-80237cab026b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:25.510772 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-49185e63-ff89-47c5-9aaf-80237cab026b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 03d9aff4-215d-48fa-b741-2257b62fc597] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:25.517930 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-49185e63-ff89-47c5-9aaf-80237cab026b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:25.518611 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-49185e63-ff89-47c5-9aaf-80237cab026b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:25.519413 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-49185e63-ff89-47c5-9aaf-80237cab026b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:25.520470 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-49185e63-ff89-47c5-9aaf-80237cab026b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:25.521095 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-49185e63-ff89-47c5-9aaf-80237cab026b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:25.521965 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-49185e63-ff89-47c5-9aaf-80237cab026b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:25.542013 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-49185e63-ff89-47c5-9aaf-80237cab026b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] HTTP exception thrown: Instance 03d9aff4-215d-48fa-b741-2257b62fc597 could not be found. Oct 30 01:21:25.543736 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-49185e63-ff89-47c5-9aaf-80237cab026b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Request method failure captured: Oct 30 01:21:25.543736 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597 HTTP/1.1 Oct 30 01:21:25.543736 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:21:25.543736 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:21:25.543736 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:21:25.543736 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:21:25.543736 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:21:25.543736 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:21:25.543736 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:21:25.543736 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:21:25.543736 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdAbPw23hQwPLJ2dU_HGxIRXsCw9bNiHATqQCht5o0qGPfa2Kq5AEX3T7chQWWhhzZVhFyT3KvFvR56kHfMj1Zajs4NLQn3E320ctHWtprwOHSTCEWkNIrqgzNyOQZaTDcuGkDNQhWjJqRPxebZIC-U_OIIsgwPUj899YmuUCbv3e-U Oct 30 01:21:25.543736 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:21:25.543736 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:21:25.543736 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:21:25.543736 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:21:25.543736 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:21:25.543736 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:21:25.543736 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: ad621909b99143dd9885006238de72a6 Oct 30 01:21:25.543736 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-MigrationsAdminTest-1982618098 Oct 30 01:21:25.543736 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:21:25.543736 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:21:25.545395 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ad621909b99143dd9885006238de72a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ad621909b99143dd9885006238de72a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ad621909b99143dd9885006238de72a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ad621909b99143dd9885006238de72a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:21:25.545395 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-MigrationsAdminTest-1982618098 Oct 30 01:21:25.545395 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: ad621909b99143dd9885006238de72a6 Oct 30 01:21:25.545395 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-MigrationsAdminTest-1982618098 Oct 30 01:21:25.545395 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-MigrationsAdminTest-1982618098-project Oct 30 01:21:25.545395 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:21:25.545395 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:21:25.545395 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 4f1fe6e04e064dfba969b07d4188ab38 Oct 30 01:21:25.545395 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-MigrationsAdminTest-1982618098-project Oct 30 01:21:25.545395 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:21:25.545395 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 03d9aff4-215d-48fa-b741-2257b62fc597 could not be found. Oct 30 01:21:25.545395 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '03d9aff4-215d-48fa-b741-2257b62fc597'} Oct 30 01:21:25.546302 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:21:25.546302 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:25.546302 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:21:25.546302 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:21:25.546302 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:21:25.546302 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:21:25.546302 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:21:25.546302 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:21:25.546302 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:21:25.546302 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:21:25.546302 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03d9aff4-215d-48fa-b741-2257b62fc597 could not be found. Oct 30 01:21:25.546302 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:25.546302 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:21:25.546302 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:25.546302 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:25.546302 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:21:25.546302 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:21:25.546302 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:21:25.546302 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:21:25.546302 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:21:25.547797 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:21:25.547797 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:21:25.547797 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:21:25.547797 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:21:25.547797 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:21:25.547797 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:21:25.547797 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:21:25.547797 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03d9aff4-215d-48fa-b741-2257b62fc597 could not be found. Oct 30 01:21:25.547797 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:25.547797 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:21:25.547797 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:25.547797 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:25.547797 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:21:25.547797 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:21:25.547797 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:21:25.547797 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:21:25.547797 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03d9aff4-215d-48fa-b741-2257b62fc597 could not be found. Oct 30 01:21:25.547797 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:25.552003 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-49185e63-ff89-47c5-9aaf-80237cab026b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Returning 404 to user: Instance 03d9aff4-215d-48fa-b741-2257b62fc597 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:21:25.553119 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-49185e63-ff89-47c5-9aaf-80237cab026b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597" status: 404 len: 111 microversion: 2.1 time: 0.047525 Oct 30 01:21:25.554193 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1083/2130] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:25 2022] GET /compute/v2.1/servers/03d9aff4-215d-48fa-b741-2257b62fc597 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 01:21:25.564148 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1b7e1e17-1ad5-4058-9a72-15c2aae0bc19 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '.version_select at 0x7f44cca78c10>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:25.639178 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-88b505f9-f8b9-414f-ae04-fb169e898907 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9f71f892094c2685b175e111fe7cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a766acde7eab4b05866a2c33f5dd3606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:25.648290 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-88b505f9-f8b9-414f-ae04-fb169e898907 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] 10.222.0.13 "GET /compute/v2.1/servers/d190bf6d-50f5-454f-a9fa-4296cd25bddd" status: 200 len: 1316 microversion: 2.1 time: 0.397676 Oct 30 01:21:25.649075 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1048/2131] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:25 2022] GET /compute/v2.1/servers/d190bf6d-50f5-454f-a9fa-4296cd25bddd => generated 1316 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:25.672461 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-24ecfeed-8360-4bf0-afc3-de5c76d0fa2f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:25.673187 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-24ecfeed-8360-4bf0-afc3-de5c76d0fa2f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 5ed38927-680d-4e93-b57a-21fb407c6b33] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:25.673494 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1b7e1e17-1ad5-4058-9a72-15c2aae0bc19 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-950828976" status: 202 len: 0 microversion: 2.1 time: 0.114078 Oct 30 01:21:25.674365 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1084/2132] 10.222.0.13 () {58 vars in 1218 bytes} [Sun Oct 30 01:21:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-950828976 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:21:25.683097 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-24ecfeed-8360-4bf0-afc3-de5c76d0fa2f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:25.683766 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-24ecfeed-8360-4bf0-afc3-de5c76d0fa2f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:25.684424 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-24ecfeed-8360-4bf0-afc3-de5c76d0fa2f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:25.685634 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-24ecfeed-8360-4bf0-afc3-de5c76d0fa2f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:25.686270 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-24ecfeed-8360-4bf0-afc3-de5c76d0fa2f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:25.686871 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-24ecfeed-8360-4bf0-afc3-de5c76d0fa2f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:26.301269 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0cd5d8ff-47da-4a56-a8d1-960927ab0d3e tempest-ListImagesTestJSON-888219979 tempest-ListImagesTestJSON-888219979-project] Calling method '.version_select at 0x7f44cc7f5280>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:26.387625 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0cd5d8ff-47da-4a56-a8d1-960927ab0d3e tempest-ListImagesTestJSON-888219979 tempest-ListImagesTestJSON-888219979-project] 10.222.0.13 "GET /compute/v2.1/images/deb14158-45d8-4539-889d-ff9726d046d7" status: 200 len: 784 microversion: 2.1 time: 0.341652 Oct 30 01:21:26.389714 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1085/2133] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:21:26 2022] GET /compute/v2.1/images/deb14158-45d8-4539-889d-ff9726d046d7 => generated 784 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:21:26.396379 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-90cfb6f2-bca6-4f00-9e68-8cb41adccdfe tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:26.398204 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-90cfb6f2-bca6-4f00-9e68-8cb41adccdfe tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:26.407480 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-90cfb6f2-bca6-4f00-9e68-8cb41adccdfe tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:26.408444 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-90cfb6f2-bca6-4f00-9e68-8cb41adccdfe tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:26.409312 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-90cfb6f2-bca6-4f00-9e68-8cb41adccdfe tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:26.410445 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-90cfb6f2-bca6-4f00-9e68-8cb41adccdfe tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:26.411063 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-90cfb6f2-bca6-4f00-9e68-8cb41adccdfe tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:26.411694 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-90cfb6f2-bca6-4f00-9e68-8cb41adccdfe tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:26.851967 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-24ecfeed-8360-4bf0-afc3-de5c76d0fa2f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:26.857361 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-90cfb6f2-bca6-4f00-9e68-8cb41adccdfe tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:26.865482 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-24ecfeed-8360-4bf0-afc3-de5c76d0fa2f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:26.867166 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-24ecfeed-8360-4bf0-afc3-de5c76d0fa2f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:26.874976 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-24ecfeed-8360-4bf0-afc3-de5c76d0fa2f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33" status: 200 len: 1485 microversion: 2.25 time: 1.204476 Oct 30 01:21:26.877460 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1049/2134] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:21:25 2022] GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33 => generated 1485 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:21:26.881515 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bf5d6f51-ea00-4755-9906-4f5c84107698 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:26.882325 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-bf5d6f51-ea00-4755-9906-4f5c84107698 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 2b103487-3d7a-4186-aede-cb565cd34449] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:26.884748 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-90cfb6f2-bca6-4f00-9e68-8cb41adccdfe tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:26.887208 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-90cfb6f2-bca6-4f00-9e68-8cb41adccdfe tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:26.890758 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bf5d6f51-ea00-4755-9906-4f5c84107698 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:26.891516 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bf5d6f51-ea00-4755-9906-4f5c84107698 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:26.892125 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bf5d6f51-ea00-4755-9906-4f5c84107698 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:26.893011 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bf5d6f51-ea00-4755-9906-4f5c84107698 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:26.893859 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bf5d6f51-ea00-4755-9906-4f5c84107698 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:26.894444 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bf5d6f51-ea00-4755-9906-4f5c84107698 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:26.894721 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-90cfb6f2-bca6-4f00-9e68-8cb41adccdfe tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1539 microversion: 2.91 time: 0.503772 Oct 30 01:21:26.895784 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1086/2135] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:21:26 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1539 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:21:26.904983 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f0010d6e-ee70-4ad3-88f9-06e15d23d4a1 tempest-ListImagesTestJSON-888219979 tempest-ListImagesTestJSON-888219979-project] Calling method '.version_select at 0x7f44cc60cc10>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:27.091684 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f0010d6e-ee70-4ad3-88f9-06e15d23d4a1 tempest-ListImagesTestJSON-888219979 tempest-ListImagesTestJSON-888219979-project] 10.222.0.13 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.194362 Oct 30 01:21:27.092851 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1087/2136] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:21:26 2022] GET /compute/v2.1/images => generated 445 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:21:27.097782 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f53c6d6d-4084-45ab-a1eb-a2acdb7af260 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:27.100155 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f53c6d6d-4084-45ab-a1eb-a2acdb7af260 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] [instance: d190bf6d-50f5-454f-a9fa-4296cd25bddd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:27.112881 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f53c6d6d-4084-45ab-a1eb-a2acdb7af260 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:27.120135 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f53c6d6d-4084-45ab-a1eb-a2acdb7af260 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:27.129800 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f53c6d6d-4084-45ab-a1eb-a2acdb7af260 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:27.132621 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f53c6d6d-4084-45ab-a1eb-a2acdb7af260 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:27.133277 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f53c6d6d-4084-45ab-a1eb-a2acdb7af260 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:27.137620 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f53c6d6d-4084-45ab-a1eb-a2acdb7af260 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:27.280086 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-bf5d6f51-ea00-4755-9906-4f5c84107698 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:27.290561 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bf5d6f51-ea00-4755-9906-4f5c84107698 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/2b103487-3d7a-4186-aede-cb565cd34449" status: 200 len: 1272 microversion: 2.1 time: 0.413029 Oct 30 01:21:27.296833 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1050/2137] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:26 2022] GET /compute/v2.1/servers/2b103487-3d7a-4186-aede-cb565cd34449 => generated 1272 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:27.302465 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-03938e22-a61a-4d98-9b0c-2474ca5e13b6 tempest-ListImagesTestJSON-888219979 tempest-ListImagesTestJSON-888219979-project] Calling method '.version_select at 0x7f44c7e4dd30>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:27.370979 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-03938e22-a61a-4d98-9b0c-2474ca5e13b6 tempest-ListImagesTestJSON-888219979 tempest-ListImagesTestJSON-888219979-project] 10.222.0.13 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.072144 Oct 30 01:21:27.371581 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1051/2138] 10.222.0.13 () {58 vars in 1143 bytes} [Sun Oct 30 01:21:27 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:21:27.842656 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f53c6d6d-4084-45ab-a1eb-a2acdb7af260 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9f71f892094c2685b175e111fe7cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a766acde7eab4b05866a2c33f5dd3606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:27.857060 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f53c6d6d-4084-45ab-a1eb-a2acdb7af260 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] 10.222.0.13 "GET /compute/v2.1/servers/d190bf6d-50f5-454f-a9fa-4296cd25bddd" status: 200 len: 1316 microversion: 2.1 time: 0.761737 Oct 30 01:21:27.860274 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1088/2139] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:27 2022] GET /compute/v2.1/servers/d190bf6d-50f5-454f-a9fa-4296cd25bddd => generated 1316 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:27.926517 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fe5aff9f-26ba-443b-bd4d-52ee610ef3fe tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:27.931365 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-fe5aff9f-26ba-443b-bd4d-52ee610ef3fe tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 5ed38927-680d-4e93-b57a-21fb407c6b33] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:27.937136 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1885bbb9-7bd7-4021-b01e-26fed6022a43 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:27.937539 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1885bbb9-7bd7-4021-b01e-26fed6022a43 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:27.946248 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1885bbb9-7bd7-4021-b01e-26fed6022a43 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:27.947551 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe5aff9f-26ba-443b-bd4d-52ee610ef3fe tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:27.948296 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1885bbb9-7bd7-4021-b01e-26fed6022a43 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:27.949211 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1885bbb9-7bd7-4021-b01e-26fed6022a43 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:27.950022 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe5aff9f-26ba-443b-bd4d-52ee610ef3fe tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:27.951227 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe5aff9f-26ba-443b-bd4d-52ee610ef3fe tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:27.951728 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1885bbb9-7bd7-4021-b01e-26fed6022a43 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:27.952570 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe5aff9f-26ba-443b-bd4d-52ee610ef3fe tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:27.953075 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1885bbb9-7bd7-4021-b01e-26fed6022a43 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:27.953794 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1885bbb9-7bd7-4021-b01e-26fed6022a43 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:27.954246 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe5aff9f-26ba-443b-bd4d-52ee610ef3fe tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:27.955288 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe5aff9f-26ba-443b-bd4d-52ee610ef3fe tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:27.970156 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:28.070538 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1885bbb9-7bd7-4021-b01e-26fed6022a43 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:28.114186 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1885bbb9-7bd7-4021-b01e-26fed6022a43 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:28.120130 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1885bbb9-7bd7-4021-b01e-26fed6022a43 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:28.153372 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1885bbb9-7bd7-4021-b01e-26fed6022a43 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1539 microversion: 2.91 time: 0.221899 Oct 30 01:21:28.156050 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1089/2140] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:21:27 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1539 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:21:28.330232 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f8788e92-f499-470e-8758-836e14f4d380 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:28.337045 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f8788e92-f499-470e-8758-836e14f4d380 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 2b103487-3d7a-4186-aede-cb565cd34449] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:28.369018 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f8788e92-f499-470e-8758-836e14f4d380 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:28.369018 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f8788e92-f499-470e-8758-836e14f4d380 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:28.369018 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f8788e92-f499-470e-8758-836e14f4d380 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:28.369018 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f8788e92-f499-470e-8758-836e14f4d380 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:28.370239 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f8788e92-f499-470e-8758-836e14f4d380 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:28.370239 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f8788e92-f499-470e-8758-836e14f4d380 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:28.551172 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f8788e92-f499-470e-8758-836e14f4d380 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:28.561318 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f8788e92-f499-470e-8758-836e14f4d380 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/2b103487-3d7a-4186-aede-cb565cd34449" status: 200 len: 1272 microversion: 2.1 time: 0.238069 Oct 30 01:21:28.581854 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1090/2141] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:28 2022] GET /compute/v2.1/servers/2b103487-3d7a-4186-aede-cb565cd34449 => generated 1272 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:28.589668 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-92bb325d-d025-4e70-b81b-1b8614340fbe tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:28.590500 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-92bb325d-d025-4e70-b81b-1b8614340fbe tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:28.597717 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92bb325d-d025-4e70-b81b-1b8614340fbe tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:28.598670 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92bb325d-d025-4e70-b81b-1b8614340fbe tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:28.599472 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92bb325d-d025-4e70-b81b-1b8614340fbe tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:28.600757 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92bb325d-d025-4e70-b81b-1b8614340fbe tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:28.601505 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92bb325d-d025-4e70-b81b-1b8614340fbe tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:28.602133 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92bb325d-d025-4e70-b81b-1b8614340fbe tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:28.635545 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-92bb325d-d025-4e70-b81b-1b8614340fbe tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:21:28.645928 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-fe5aff9f-26ba-443b-bd4d-52ee610ef3fe tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:28.656433 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-fe5aff9f-26ba-443b-bd4d-52ee610ef3fe tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:28.658195 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-fe5aff9f-26ba-443b-bd4d-52ee610ef3fe tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:28.659643 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fe5aff9f-26ba-443b-bd4d-52ee610ef3fe tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33" status: 200 len: 1475 microversion: 2.25 time: 0.740165 Oct 30 01:21:28.666410 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1052/2142] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:21:27 2022] GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33 => generated 1475 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:21:28.689032 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d413ff06-2c59-4ba2-b669-bb687231d865 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Calling method '.version_select at 0x7f44c7d36280>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:28.692773 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d413ff06-2c59-4ba2-b669-bb687231d865 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:28.693266 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d413ff06-2c59-4ba2-b669-bb687231d865 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:28.693743 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d413ff06-2c59-4ba2-b669-bb687231d865 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:28.705011 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d413ff06-2c59-4ba2-b669-bb687231d865 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] 10.222.0.13 "GET /compute/v2.1/os-migrations" status: 200 len: 2788 microversion: 2.25 time: 0.023700 Oct 30 01:21:28.705824 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1053/2143] 10.222.0.13 () {60 vars in 1184 bytes} [Sun Oct 30 01:21:28 2022] GET /compute/v2.1/os-migrations => generated 2788 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:21:28.721611 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-47d35f09-dbbc-414f-a68e-11c376f73b97 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:28.722264 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-47d35f09-dbbc-414f-a68e-11c376f73b97 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] [instance: 5ed38927-680d-4e93-b57a-21fb407c6b33] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:28.730149 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-47d35f09-dbbc-414f-a68e-11c376f73b97 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:28.730728 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-47d35f09-dbbc-414f-a68e-11c376f73b97 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:28.731272 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-47d35f09-dbbc-414f-a68e-11c376f73b97 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:28.732194 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-47d35f09-dbbc-414f-a68e-11c376f73b97 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:28.732795 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-47d35f09-dbbc-414f-a68e-11c376f73b97 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:28.733250 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-47d35f09-dbbc-414f-a68e-11c376f73b97 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:28.872856 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-47d35f09-dbbc-414f-a68e-11c376f73b97 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] Lazy-loading 'services' on Instance uuid 5ed38927-680d-4e93-b57a-21fb407c6b33 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:21:28.892189 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-47d35f09-dbbc-414f-a68e-11c376f73b97 tempest-LiveAutoBlockMigrationV225Test-1667633354 tempest-LiveAutoBlockMigrationV225Test-1667633354-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33" status: 200 len: 1968 microversion: 2.25 time: 0.174429 Oct 30 01:21:28.893170 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1054/2144] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:21:28 2022] GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33 => generated 1968 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:21:28.898836 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fe214aed-cbd9-456a-a11e-29e6d0bc91cc tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:28.899826 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-fe214aed-cbd9-456a-a11e-29e6d0bc91cc tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] [instance: d190bf6d-50f5-454f-a9fa-4296cd25bddd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:28.906730 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe214aed-cbd9-456a-a11e-29e6d0bc91cc tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:28.907584 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe214aed-cbd9-456a-a11e-29e6d0bc91cc tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:28.908298 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe214aed-cbd9-456a-a11e-29e6d0bc91cc tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:28.909322 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe214aed-cbd9-456a-a11e-29e6d0bc91cc tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:28.913902 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe214aed-cbd9-456a-a11e-29e6d0bc91cc tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:28.914721 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe214aed-cbd9-456a-a11e-29e6d0bc91cc tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:29.256716 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-92bb325d-d025-4e70-b81b-1b8614340fbe tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "DELETE /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 204 len: 0 microversion: 2.1 time: 0.672555 Oct 30 01:21:29.257361 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1091/2145] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:21:28 2022] DELETE /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 0 bytes in 675 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:21:29.273039 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b94cad2e-07ed-43f9-8b8e-b3ed48fd3203 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:29.284984 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b94cad2e-07ed-43f9-8b8e-b3ed48fd3203 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 5ed38927-680d-4e93-b57a-21fb407c6b33] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:29.295353 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b94cad2e-07ed-43f9-8b8e-b3ed48fd3203 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:29.296465 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b94cad2e-07ed-43f9-8b8e-b3ed48fd3203 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:29.296910 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b94cad2e-07ed-43f9-8b8e-b3ed48fd3203 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:29.297778 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b94cad2e-07ed-43f9-8b8e-b3ed48fd3203 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:29.298238 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b94cad2e-07ed-43f9-8b8e-b3ed48fd3203 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:29.298814 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b94cad2e-07ed-43f9-8b8e-b3ed48fd3203 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:29.335820 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b94cad2e-07ed-43f9-8b8e-b3ed48fd3203 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 5ed38927-680d-4e93-b57a-21fb407c6b33] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:21:29.372464 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:29.572315 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-fe214aed-cbd9-456a-a11e-29e6d0bc91cc tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9f71f892094c2685b175e111fe7cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a766acde7eab4b05866a2c33f5dd3606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:29.627738 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fe214aed-cbd9-456a-a11e-29e6d0bc91cc tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] 10.222.0.13 "GET /compute/v2.1/servers/d190bf6d-50f5-454f-a9fa-4296cd25bddd" status: 200 len: 1505 microversion: 2.1 time: 0.686590 Oct 30 01:21:29.627738 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1055/2146] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:28 2022] GET /compute/v2.1/servers/d190bf6d-50f5-454f-a9fa-4296cd25bddd => generated 1505 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:29.627738 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4b954947-20af-449d-8ef8-56e96d948f1e tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:29.627738 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4b954947-20af-449d-8ef8-56e96d948f1e tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:29.627738 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4b954947-20af-449d-8ef8-56e96d948f1e tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:29.628565 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4b954947-20af-449d-8ef8-56e96d948f1e tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:29.628565 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4b954947-20af-449d-8ef8-56e96d948f1e tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:29.628565 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4b954947-20af-449d-8ef8-56e96d948f1e tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:29.628565 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4b954947-20af-449d-8ef8-56e96d948f1e tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:29.628970 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4b954947-20af-449d-8ef8-56e96d948f1e tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:29.679763 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4b954947-20af-449d-8ef8-56e96d948f1e tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:29.688354 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4b954947-20af-449d-8ef8-56e96d948f1e tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:29.689849 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4b954947-20af-449d-8ef8-56e96d948f1e tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:29.692533 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:29.695612 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4b954947-20af-449d-8ef8-56e96d948f1e tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1539 microversion: 2.91 time: 0.111337 Oct 30 01:21:29.696184 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1056/2147] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:21:29 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1539 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:21:29.701283 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c3d28222-395e-4668-b7db-0fc68fbc864b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:29.701873 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c3d28222-395e-4668-b7db-0fc68fbc864b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:29.707847 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c3d28222-395e-4668-b7db-0fc68fbc864b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:29.708332 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c3d28222-395e-4668-b7db-0fc68fbc864b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:29.708768 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c3d28222-395e-4668-b7db-0fc68fbc864b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:29.709619 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c3d28222-395e-4668-b7db-0fc68fbc864b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:29.710094 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c3d28222-395e-4668-b7db-0fc68fbc864b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:29.710543 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c3d28222-395e-4668-b7db-0fc68fbc864b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:29.848814 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c3d28222-395e-4668-b7db-0fc68fbc864b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:29.856491 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c3d28222-395e-4668-b7db-0fc68fbc864b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1468 microversion: 2.1 time: 0.158843 Oct 30 01:21:29.857059 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1057/2148] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:29 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1468 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:29.861658 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9bb3d51b-b6e1-4188-af3a-a4c95850d5c0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:29.862465 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9bb3d51b-b6e1-4188-af3a-a4c95850d5c0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 2b103487-3d7a-4186-aede-cb565cd34449] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:29.870199 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9bb3d51b-b6e1-4188-af3a-a4c95850d5c0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:29.871085 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9bb3d51b-b6e1-4188-af3a-a4c95850d5c0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:29.871751 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9bb3d51b-b6e1-4188-af3a-a4c95850d5c0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:29.872668 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9bb3d51b-b6e1-4188-af3a-a4c95850d5c0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:29.873533 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9bb3d51b-b6e1-4188-af3a-a4c95850d5c0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:29.874551 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9bb3d51b-b6e1-4188-af3a-a4c95850d5c0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:30.088926 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b94cad2e-07ed-43f9-8b8e-b3ed48fd3203 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33" status: 204 len: 0 microversion: 2.25 time: 0.824465 Oct 30 01:21:30.092977 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1092/2149] 10.222.0.13 () {60 vars in 1280 bytes} [Sun Oct 30 01:21:29 2022] DELETE /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33 => generated 0 bytes in 826 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 30 01:21:30.096342 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-df84df0b-8810-40b9-868c-d91670e8029a tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:30.097617 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-df84df0b-8810-40b9-868c-d91670e8029a tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] [instance: d190bf6d-50f5-454f-a9fa-4296cd25bddd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:30.113477 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df84df0b-8810-40b9-868c-d91670e8029a tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:30.114003 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df84df0b-8810-40b9-868c-d91670e8029a tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:30.115996 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df84df0b-8810-40b9-868c-d91670e8029a tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:30.116755 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df84df0b-8810-40b9-868c-d91670e8029a tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:30.117221 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df84df0b-8810-40b9-868c-d91670e8029a tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:30.122130 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df84df0b-8810-40b9-868c-d91670e8029a tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:30.189561 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-df84df0b-8810-40b9-868c-d91670e8029a tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'ce9f71f892094c2685b175e111fe7cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a766acde7eab4b05866a2c33f5dd3606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:30.193638 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-df84df0b-8810-40b9-868c-d91670e8029a tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] 10.222.0.13 "GET /compute/v2.1/servers/d190bf6d-50f5-454f-a9fa-4296cd25bddd/os-instance-actions/req-092ca9a3-9964-4c6c-9a48-1c53bc54daff" status: 200 len: 313 microversion: 2.1 time: 0.099692 Oct 30 01:21:30.193638 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1093/2150] 10.222.0.13 () {58 vars in 1419 bytes} [Sun Oct 30 01:21:30 2022] GET /compute/v2.1/servers/d190bf6d-50f5-454f-a9fa-4296cd25bddd/os-instance-actions/req-092ca9a3-9964-4c6c-9a48-1c53bc54daff => generated 313 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:21:30.196420 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9048ebbd-8ac1-476a-8f9d-ee1e1a6349b9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:30.198075 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9048ebbd-8ac1-476a-8f9d-ee1e1a6349b9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 5ed38927-680d-4e93-b57a-21fb407c6b33] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:30.204915 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9048ebbd-8ac1-476a-8f9d-ee1e1a6349b9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:30.205805 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9048ebbd-8ac1-476a-8f9d-ee1e1a6349b9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:30.206577 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9048ebbd-8ac1-476a-8f9d-ee1e1a6349b9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:30.207645 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9048ebbd-8ac1-476a-8f9d-ee1e1a6349b9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:30.208268 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9048ebbd-8ac1-476a-8f9d-ee1e1a6349b9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:30.208846 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9048ebbd-8ac1-476a-8f9d-ee1e1a6349b9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:30.255535 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9bb3d51b-b6e1-4188-af3a-a4c95850d5c0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:30.263901 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9bb3d51b-b6e1-4188-af3a-a4c95850d5c0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/2b103487-3d7a-4186-aede-cb565cd34449" status: 200 len: 1314 microversion: 2.1 time: 0.405734 Oct 30 01:21:30.264494 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1058/2151] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:29 2022] GET /compute/v2.1/servers/2b103487-3d7a-4186-aede-cb565cd34449 => generated 1314 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:30.287301 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5ca6af07-81dc-414d-8857-1c3b323d181c tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:21:30.291968 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5ca6af07-81dc-414d-8857-1c3b323d181c tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] [instance: d190bf6d-50f5-454f-a9fa-4296cd25bddd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:30.299313 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ca6af07-81dc-414d-8857-1c3b323d181c tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:30.299813 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ca6af07-81dc-414d-8857-1c3b323d181c tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:30.300482 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ca6af07-81dc-414d-8857-1c3b323d181c tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:30.301212 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ca6af07-81dc-414d-8857-1c3b323d181c tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:30.301703 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ca6af07-81dc-414d-8857-1c3b323d181c tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:30.302324 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ca6af07-81dc-414d-8857-1c3b323d181c tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:30.442083 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9048ebbd-8ac1-476a-8f9d-ee1e1a6349b9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:30.452851 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9048ebbd-8ac1-476a-8f9d-ee1e1a6349b9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:30.456438 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9048ebbd-8ac1-476a-8f9d-ee1e1a6349b9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:30.461856 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9048ebbd-8ac1-476a-8f9d-ee1e1a6349b9 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33" status: 200 len: 1481 microversion: 2.25 time: 0.269523 Oct 30 01:21:30.462437 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1094/2152] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:21:30 2022] GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33 => generated 1481 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:21:30.627205 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5ca6af07-81dc-414d-8857-1c3b323d181c tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] 10.222.0.13 "POST /compute/v2.1/servers/d190bf6d-50f5-454f-a9fa-4296cd25bddd/action" status: 202 len: 0 microversion: 2.1 time: 0.350502 Oct 30 01:21:30.634479 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1059/2153] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:21:30 2022] POST /compute/v2.1/servers/d190bf6d-50f5-454f-a9fa-4296cd25bddd/action => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:21:30.642647 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-65976ae7-84cd-4999-8a68-07af0343531f tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:30.643606 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-65976ae7-84cd-4999-8a68-07af0343531f tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] [instance: d190bf6d-50f5-454f-a9fa-4296cd25bddd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:30.656235 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-65976ae7-84cd-4999-8a68-07af0343531f tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:30.663962 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-65976ae7-84cd-4999-8a68-07af0343531f tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:30.666105 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-65976ae7-84cd-4999-8a68-07af0343531f tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:30.667785 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-65976ae7-84cd-4999-8a68-07af0343531f tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:30.668436 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-65976ae7-84cd-4999-8a68-07af0343531f tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:30.670362 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-65976ae7-84cd-4999-8a68-07af0343531f tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:30.726717 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-07d452f9-4e47-42df-941c-5984db4eecee tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:30.727731 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-07d452f9-4e47-42df-941c-5984db4eecee tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:30.737557 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-07d452f9-4e47-42df-941c-5984db4eecee tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:30.744679 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-07d452f9-4e47-42df-941c-5984db4eecee tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:30.745632 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-07d452f9-4e47-42df-941c-5984db4eecee tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:30.746588 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-07d452f9-4e47-42df-941c-5984db4eecee tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:30.747425 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-07d452f9-4e47-42df-941c-5984db4eecee tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:30.748101 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-07d452f9-4e47-42df-941c-5984db4eecee tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:31.631405 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-07d452f9-4e47-42df-941c-5984db4eecee tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:31.642064 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-07d452f9-4e47-42df-941c-5984db4eecee tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:31.644178 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-07d452f9-4e47-42df-941c-5984db4eecee tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:31.653544 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-07d452f9-4e47-42df-941c-5984db4eecee tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1539 microversion: 2.91 time: 0.931419 Oct 30 01:21:31.670605 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1060/2154] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:21:30 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1539 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:21:31.679376 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a06a6403-dd4b-4241-a177-99e6c0be51b6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:31.680284 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a06a6403-dd4b-4241-a177-99e6c0be51b6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:31.688332 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a06a6403-dd4b-4241-a177-99e6c0be51b6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:31.689700 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a06a6403-dd4b-4241-a177-99e6c0be51b6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:31.690358 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a06a6403-dd4b-4241-a177-99e6c0be51b6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:31.691342 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a06a6403-dd4b-4241-a177-99e6c0be51b6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:31.691995 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a06a6403-dd4b-4241-a177-99e6c0be51b6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:31.692626 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a06a6403-dd4b-4241-a177-99e6c0be51b6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:32.042766 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:32.054242 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-65976ae7-84cd-4999-8a68-07af0343531f tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9f71f892094c2685b175e111fe7cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a766acde7eab4b05866a2c33f5dd3606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:32.063423 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-65976ae7-84cd-4999-8a68-07af0343531f tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] 10.222.0.13 "GET /compute/v2.1/servers/d190bf6d-50f5-454f-a9fa-4296cd25bddd" status: 200 len: 1507 microversion: 2.1 time: 1.427006 Oct 30 01:21:32.077797 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1095/2155] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:30 2022] GET /compute/v2.1/servers/d190bf6d-50f5-454f-a9fa-4296cd25bddd => generated 1507 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:32.084791 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cb3fb6f0-b095-4fd1-862a-1de350cae12c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:32.085728 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cb3fb6f0-b095-4fd1-862a-1de350cae12c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 2b103487-3d7a-4186-aede-cb565cd34449] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:32.093321 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cb3fb6f0-b095-4fd1-862a-1de350cae12c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:32.094105 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cb3fb6f0-b095-4fd1-862a-1de350cae12c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:32.094752 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cb3fb6f0-b095-4fd1-862a-1de350cae12c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:32.095621 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cb3fb6f0-b095-4fd1-862a-1de350cae12c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:32.097127 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cb3fb6f0-b095-4fd1-862a-1de350cae12c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:32.097770 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cb3fb6f0-b095-4fd1-862a-1de350cae12c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:32.330688 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a06a6403-dd4b-4241-a177-99e6c0be51b6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:32.360786 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a06a6403-dd4b-4241-a177-99e6c0be51b6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1468 microversion: 2.1 time: 0.685047 Oct 30 01:21:32.364511 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1061/2156] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:31 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1468 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:32.375268 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c875c6e2-d973-4165-9691-6f903d992796 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:32.376157 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c875c6e2-d973-4165-9691-6f903d992796 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 5ed38927-680d-4e93-b57a-21fb407c6b33] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:32.392950 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c875c6e2-d973-4165-9691-6f903d992796 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:32.393936 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c875c6e2-d973-4165-9691-6f903d992796 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:32.394792 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c875c6e2-d973-4165-9691-6f903d992796 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:32.395888 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c875c6e2-d973-4165-9691-6f903d992796 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:32.396805 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c875c6e2-d973-4165-9691-6f903d992796 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:32.397679 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c875c6e2-d973-4165-9691-6f903d992796 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:32.584576 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c875c6e2-d973-4165-9691-6f903d992796 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:32.605889 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c875c6e2-d973-4165-9691-6f903d992796 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:32.609638 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c875c6e2-d973-4165-9691-6f903d992796 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:32.611879 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c875c6e2-d973-4165-9691-6f903d992796 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33" status: 200 len: 1439 microversion: 2.25 time: 0.244773 Oct 30 01:21:32.612655 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1062/2157] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:21:32 2022] GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33 => generated 1439 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:21:32.635199 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-be3b3479-0c31-4378-8bc3-0484ad8921f9 req-1ef43b73-83fa-4810-a69d-8b1a113cc899 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ed38927-680d-4e93-b57a-21fb407c6b33", "name": "network-vif-deleted", "tag": "1e47508a-754d-4221-8472-e44defed87c1"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:21:32.645402 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-be3b3479-0c31-4378-8bc3-0484ad8921f9 req-1ef43b73-83fa-4810-a69d-8b1a113cc899 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:32.646015 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-be3b3479-0c31-4378-8bc3-0484ad8921f9 req-1ef43b73-83fa-4810-a69d-8b1a113cc899 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:32.646454 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-be3b3479-0c31-4378-8bc3-0484ad8921f9 req-1ef43b73-83fa-4810-a69d-8b1a113cc899 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:32.658661 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-be3b3479-0c31-4378-8bc3-0484ad8921f9 req-1ef43b73-83fa-4810-a69d-8b1a113cc899 service nova] Creating event network-vif-deleted:1e47508a-754d-4221-8472-e44defed87c1 for instance 5ed38927-680d-4e93-b57a-21fb407c6b33 on n-h2-master-1 Oct 30 01:21:32.664579 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-be3b3479-0c31-4378-8bc3-0484ad8921f9 req-1ef43b73-83fa-4810-a69d-8b1a113cc899 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044289 Oct 30 01:21:32.666217 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1063/2158] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:21:32.668481 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-cb3fb6f0-b095-4fd1-862a-1de350cae12c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:32.675493 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cb3fb6f0-b095-4fd1-862a-1de350cae12c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/2b103487-3d7a-4186-aede-cb565cd34449" status: 200 len: 1314 microversion: 2.1 time: 0.596520 Oct 30 01:21:32.690361 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1096/2159] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:32 2022] GET /compute/v2.1/servers/2b103487-3d7a-4186-aede-cb565cd34449 => generated 1314 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:32.699486 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7b2dd992-aaf6-48ad-a120-03703afda6e9 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:32.704205 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7b2dd992-aaf6-48ad-a120-03703afda6e9 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:32.712500 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b2dd992-aaf6-48ad-a120-03703afda6e9 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:32.713161 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b2dd992-aaf6-48ad-a120-03703afda6e9 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:32.713732 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b2dd992-aaf6-48ad-a120-03703afda6e9 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:32.714553 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b2dd992-aaf6-48ad-a120-03703afda6e9 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:32.715115 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b2dd992-aaf6-48ad-a120-03703afda6e9 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:32.715647 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b2dd992-aaf6-48ad-a120-03703afda6e9 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:32.811346 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=8 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:32.981082 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7b2dd992-aaf6-48ad-a120-03703afda6e9 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:33.005968 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7b2dd992-aaf6-48ad-a120-03703afda6e9 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:33.010509 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7b2dd992-aaf6-48ad-a120-03703afda6e9 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:33.026942 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7b2dd992-aaf6-48ad-a120-03703afda6e9 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1555 microversion: 2.91 time: 0.339829 Oct 30 01:21:33.053508 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1064/2160] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:21:32 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1555 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:21:33.089573 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d327de95-2b75-48b1-b2b2-5c718cbc1eee tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:33.090226 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d327de95-2b75-48b1-b2b2-5c718cbc1eee tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] [instance: d190bf6d-50f5-454f-a9fa-4296cd25bddd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:33.102032 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:33.104106 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d327de95-2b75-48b1-b2b2-5c718cbc1eee tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:33.104608 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d327de95-2b75-48b1-b2b2-5c718cbc1eee tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:33.105050 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d327de95-2b75-48b1-b2b2-5c718cbc1eee tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:33.105792 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d327de95-2b75-48b1-b2b2-5c718cbc1eee tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:33.106246 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d327de95-2b75-48b1-b2b2-5c718cbc1eee tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:33.110046 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d327de95-2b75-48b1-b2b2-5c718cbc1eee tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:33.388172 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b3b8c404-4227-44e6-a51c-45ace3eee4f6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:33.393813 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b3b8c404-4227-44e6-a51c-45ace3eee4f6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:33.407534 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3b8c404-4227-44e6-a51c-45ace3eee4f6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:33.408044 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3b8c404-4227-44e6-a51c-45ace3eee4f6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:33.408488 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3b8c404-4227-44e6-a51c-45ace3eee4f6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:33.409215 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3b8c404-4227-44e6-a51c-45ace3eee4f6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:33.409900 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3b8c404-4227-44e6-a51c-45ace3eee4f6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:33.410504 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3b8c404-4227-44e6-a51c-45ace3eee4f6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:33.598355 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b3b8c404-4227-44e6-a51c-45ace3eee4f6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:33.613235 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b3b8c404-4227-44e6-a51c-45ace3eee4f6 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1426 microversion: 2.1 time: 0.229498 Oct 30 01:21:33.613991 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1065/2161] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:33 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1426 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:21:33.639986 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5d8684f6-8ff3-48de-9292-0c6ddc88a113 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:33.640742 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5d8684f6-8ff3-48de-9292-0c6ddc88a113 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 5ed38927-680d-4e93-b57a-21fb407c6b33] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:33.653271 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5d8684f6-8ff3-48de-9292-0c6ddc88a113 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:33.654906 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5d8684f6-8ff3-48de-9292-0c6ddc88a113 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:33.657107 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5d8684f6-8ff3-48de-9292-0c6ddc88a113 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:33.662350 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5d8684f6-8ff3-48de-9292-0c6ddc88a113 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:33.662850 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5d8684f6-8ff3-48de-9292-0c6ddc88a113 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:33.664537 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5d8684f6-8ff3-48de-9292-0c6ddc88a113 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:33.671456 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d327de95-2b75-48b1-b2b2-5c718cbc1eee tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9f71f892094c2685b175e111fe7cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a766acde7eab4b05866a2c33f5dd3606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:33.678969 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d327de95-2b75-48b1-b2b2-5c718cbc1eee tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] 10.222.0.13 "GET /compute/v2.1/servers/d190bf6d-50f5-454f-a9fa-4296cd25bddd" status: 200 len: 1512 microversion: 2.1 time: 0.594408 Oct 30 01:21:33.682028 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1097/2162] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:33 2022] GET /compute/v2.1/servers/d190bf6d-50f5-454f-a9fa-4296cd25bddd => generated 1512 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:33.700409 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fda76c26-a5fe-4591-abd0-a20e4aa6bce7 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:33.701478 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fda76c26-a5fe-4591-abd0-a20e4aa6bce7 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 2b103487-3d7a-4186-aede-cb565cd34449] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:33.714141 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fda76c26-a5fe-4591-abd0-a20e4aa6bce7 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:33.715210 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fda76c26-a5fe-4591-abd0-a20e4aa6bce7 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:33.715882 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fda76c26-a5fe-4591-abd0-a20e4aa6bce7 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:33.722795 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fda76c26-a5fe-4591-abd0-a20e4aa6bce7 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:33.724242 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fda76c26-a5fe-4591-abd0-a20e4aa6bce7 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:33.725476 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fda76c26-a5fe-4591-abd0-a20e4aa6bce7 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:34.109065 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5d8684f6-8ff3-48de-9292-0c6ddc88a113 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:34.123041 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5d8684f6-8ff3-48de-9292-0c6ddc88a113 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:34.125287 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5d8684f6-8ff3-48de-9292-0c6ddc88a113 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:34.131862 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5d8684f6-8ff3-48de-9292-0c6ddc88a113 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33" status: 200 len: 1266 microversion: 2.25 time: 0.493837 Oct 30 01:21:34.132686 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1066/2163] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:21:33 2022] GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33 => generated 1266 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:21:34.144330 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5ec741db-861f-4eb4-b79c-d97d3bf1a5cb tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:34.159233 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5ec741db-861f-4eb4-b79c-d97d3bf1a5cb tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:34.178753 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ec741db-861f-4eb4-b79c-d97d3bf1a5cb tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:34.180971 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ec741db-861f-4eb4-b79c-d97d3bf1a5cb tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:34.180971 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ec741db-861f-4eb4-b79c-d97d3bf1a5cb tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:34.180971 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ec741db-861f-4eb4-b79c-d97d3bf1a5cb tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:34.180971 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ec741db-861f-4eb4-b79c-d97d3bf1a5cb tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:34.181401 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ec741db-861f-4eb4-b79c-d97d3bf1a5cb tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:34.582669 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5ec741db-861f-4eb4-b79c-d97d3bf1a5cb tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:34.600166 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5ec741db-861f-4eb4-b79c-d97d3bf1a5cb tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:34.602241 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5ec741db-861f-4eb4-b79c-d97d3bf1a5cb tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:34.613007 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5ec741db-861f-4eb4-b79c-d97d3bf1a5cb tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1555 microversion: 2.91 time: 0.476125 Oct 30 01:21:34.620862 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1067/2164] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:21:34 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1555 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:21:34.636702 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-6320f50d-6efe-4f7a-9c0c-2ad60e52002a req-736445f3-1741-45d4-a75d-4813fa4e5c7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76c32172-798a-49f6-8247-6f86860dbdc5", "name": "network-vif-deleted", "tag": "e96e6262-0ade-4db0-aeff-c6471cd42e45"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:21:34.655317 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-6320f50d-6efe-4f7a-9c0c-2ad60e52002a req-736445f3-1741-45d4-a75d-4813fa4e5c7a service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:34.662222 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-6320f50d-6efe-4f7a-9c0c-2ad60e52002a req-736445f3-1741-45d4-a75d-4813fa4e5c7a service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:34.662847 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-6320f50d-6efe-4f7a-9c0c-2ad60e52002a req-736445f3-1741-45d4-a75d-4813fa4e5c7a service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:34.702068 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-6320f50d-6efe-4f7a-9c0c-2ad60e52002a req-736445f3-1741-45d4-a75d-4813fa4e5c7a service nova] Creating event network-vif-deleted:e96e6262-0ade-4db0-aeff-c6471cd42e45 for instance 76c32172-798a-49f6-8247-6f86860dbdc5 on n-h1-master-1 Oct 30 01:21:34.723168 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-6320f50d-6efe-4f7a-9c0c-2ad60e52002a req-736445f3-1741-45d4-a75d-4813fa4e5c7a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100761 Oct 30 01:21:34.729031 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1068/2165] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:21:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:21:34.747767 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6bb28ef1-9940-4cd6-a4ac-ba9f1f95b02e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:34.748770 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6bb28ef1-9940-4cd6-a4ac-ba9f1f95b02e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:34.771713 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6bb28ef1-9940-4cd6-a4ac-ba9f1f95b02e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:34.774541 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6bb28ef1-9940-4cd6-a4ac-ba9f1f95b02e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:34.775726 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6bb28ef1-9940-4cd6-a4ac-ba9f1f95b02e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:34.785719 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6bb28ef1-9940-4cd6-a4ac-ba9f1f95b02e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:34.791382 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6bb28ef1-9940-4cd6-a4ac-ba9f1f95b02e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:34.791382 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6bb28ef1-9940-4cd6-a4ac-ba9f1f95b02e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:34.834295 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:34.861220 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6bb28ef1-9940-4cd6-a4ac-ba9f1f95b02e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:34.864022 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6bb28ef1-9940-4cd6-a4ac-ba9f1f95b02e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:34.864595 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6bb28ef1-9940-4cd6-a4ac-ba9f1f95b02e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:34.865178 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-6bb28ef1-9940-4cd6-a4ac-ba9f1f95b02e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lazy-loading 'fault' on Instance uuid 76c32172-798a-49f6-8247-6f86860dbdc5 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:21:34.991185 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6bb28ef1-9940-4cd6-a4ac-ba9f1f95b02e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:35.010404 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6bb28ef1-9940-4cd6-a4ac-ba9f1f95b02e tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1302 microversion: 2.1 time: 0.264757 Oct 30 01:21:35.027476 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1069/2166] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:34 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1302 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:35.032919 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-dd203b70-d36d-4b59-9a2d-a77d83f297e3 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:35.033909 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-dd203b70-d36d-4b59-9a2d-a77d83f297e3 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] [instance: d190bf6d-50f5-454f-a9fa-4296cd25bddd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:35.041784 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dd203b70-d36d-4b59-9a2d-a77d83f297e3 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:35.042566 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dd203b70-d36d-4b59-9a2d-a77d83f297e3 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:35.043276 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dd203b70-d36d-4b59-9a2d-a77d83f297e3 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:35.044272 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dd203b70-d36d-4b59-9a2d-a77d83f297e3 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:35.044970 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dd203b70-d36d-4b59-9a2d-a77d83f297e3 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:35.045656 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dd203b70-d36d-4b59-9a2d-a77d83f297e3 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:35.050333 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-fda76c26-a5fe-4591-abd0-a20e4aa6bce7 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:35.063435 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fda76c26-a5fe-4591-abd0-a20e4aa6bce7 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/2b103487-3d7a-4186-aede-cb565cd34449" status: 200 len: 1314 microversion: 2.1 time: 1.366739 Oct 30 01:21:35.080905 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1098/2167] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:33 2022] GET /compute/v2.1/servers/2b103487-3d7a-4186-aede-cb565cd34449 => generated 1314 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:35.160512 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a2ee4032-f1aa-4604-a8c4-6513782d7943 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:35.162606 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a2ee4032-f1aa-4604-a8c4-6513782d7943 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 5ed38927-680d-4e93-b57a-21fb407c6b33] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:35.181754 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a2ee4032-f1aa-4604-a8c4-6513782d7943 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:35.181754 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a2ee4032-f1aa-4604-a8c4-6513782d7943 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:35.181754 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a2ee4032-f1aa-4604-a8c4-6513782d7943 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:35.188048 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a2ee4032-f1aa-4604-a8c4-6513782d7943 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:35.193047 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a2ee4032-f1aa-4604-a8c4-6513782d7943 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:35.193047 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a2ee4032-f1aa-4604-a8c4-6513782d7943 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:35.514606 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a2ee4032-f1aa-4604-a8c4-6513782d7943 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:35.527855 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a2ee4032-f1aa-4604-a8c4-6513782d7943 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:35.535818 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a2ee4032-f1aa-4604-a8c4-6513782d7943 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:35.546954 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a2ee4032-f1aa-4604-a8c4-6513782d7943 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33" status: 200 len: 1266 microversion: 2.25 time: 0.391283 Oct 30 01:21:35.550758 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1099/2168] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:21:35 2022] GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33 => generated 1266 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:21:35.662287 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-42f545b4-6a4b-4fb6-adbe-783bd351418e tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:35.663347 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-42f545b4-6a4b-4fb6-adbe-783bd351418e tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:35.677566 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-42f545b4-6a4b-4fb6-adbe-783bd351418e tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:35.678444 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-42f545b4-6a4b-4fb6-adbe-783bd351418e tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:35.680833 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-42f545b4-6a4b-4fb6-adbe-783bd351418e tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:35.683122 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-42f545b4-6a4b-4fb6-adbe-783bd351418e tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:35.684462 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-42f545b4-6a4b-4fb6-adbe-783bd351418e tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:35.685193 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-42f545b4-6a4b-4fb6-adbe-783bd351418e tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:35.936156 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-42f545b4-6a4b-4fb6-adbe-783bd351418e tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:35.950549 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-42f545b4-6a4b-4fb6-adbe-783bd351418e tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:35.953231 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-42f545b4-6a4b-4fb6-adbe-783bd351418e tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:35.971913 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-42f545b4-6a4b-4fb6-adbe-783bd351418e tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1555 microversion: 2.91 time: 0.327302 Oct 30 01:21:35.977239 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1100/2169] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:21:35 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1555 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:21:36.042773 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-646c3ab2-fe62-401b-8bf7-0fb7866e70d1 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:36.046149 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-646c3ab2-fe62-401b-8bf7-0fb7866e70d1 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:36.076332 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-646c3ab2-fe62-401b-8bf7-0fb7866e70d1 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:36.080582 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-646c3ab2-fe62-401b-8bf7-0fb7866e70d1 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:36.081830 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-646c3ab2-fe62-401b-8bf7-0fb7866e70d1 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:36.086861 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-646c3ab2-fe62-401b-8bf7-0fb7866e70d1 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:36.090713 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-646c3ab2-fe62-401b-8bf7-0fb7866e70d1 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:36.091419 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-646c3ab2-fe62-401b-8bf7-0fb7866e70d1 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:36.150789 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-dd203b70-d36d-4b59-9a2d-a77d83f297e3 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9f71f892094c2685b175e111fe7cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a766acde7eab4b05866a2c33f5dd3606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:36.167241 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-dd203b70-d36d-4b59-9a2d-a77d83f297e3 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] 10.222.0.13 "GET /compute/v2.1/servers/d190bf6d-50f5-454f-a9fa-4296cd25bddd" status: 200 len: 1505 microversion: 2.1 time: 1.130479 Oct 30 01:21:36.168974 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1070/2170] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:35 2022] GET /compute/v2.1/servers/d190bf6d-50f5-454f-a9fa-4296cd25bddd => generated 1505 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:36.187328 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-646c3ab2-fe62-401b-8bf7-0fb7866e70d1 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:36.189500 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b25a6a21-7e85-4361-a023-a9acd0b55056 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:36.193750 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-646c3ab2-fe62-401b-8bf7-0fb7866e70d1 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:36.193750 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-646c3ab2-fe62-401b-8bf7-0fb7866e70d1 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:36.193750 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-646c3ab2-fe62-401b-8bf7-0fb7866e70d1 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lazy-loading 'fault' on Instance uuid 76c32172-798a-49f6-8247-6f86860dbdc5 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:21:36.195661 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b25a6a21-7e85-4361-a023-a9acd0b55056 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 2b103487-3d7a-4186-aede-cb565cd34449] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:36.209814 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b25a6a21-7e85-4361-a023-a9acd0b55056 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:36.211146 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b25a6a21-7e85-4361-a023-a9acd0b55056 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:36.213147 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b25a6a21-7e85-4361-a023-a9acd0b55056 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:36.219816 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b25a6a21-7e85-4361-a023-a9acd0b55056 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:36.224298 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b25a6a21-7e85-4361-a023-a9acd0b55056 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:36.225303 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b25a6a21-7e85-4361-a023-a9acd0b55056 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:36.764474 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-646c3ab2-fe62-401b-8bf7-0fb7866e70d1 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:36.775588 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-646c3ab2-fe62-401b-8bf7-0fb7866e70d1 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 200 len: 1302 microversion: 2.1 time: 0.744713 Oct 30 01:21:36.777534 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1101/2171] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:36 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 1302 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:36.806499 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ee9622a3-429f-4d36-86b1-c8e74a5e0f04 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Calling method '.version_select at 0x7f44cc96b8b0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:36.807327 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ee9622a3-429f-4d36-86b1-c8e74a5e0f04 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] [instance: d190bf6d-50f5-454f-a9fa-4296cd25bddd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:36.828210 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee9622a3-429f-4d36-86b1-c8e74a5e0f04 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:36.828611 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee9622a3-429f-4d36-86b1-c8e74a5e0f04 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:36.829207 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee9622a3-429f-4d36-86b1-c8e74a5e0f04 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:36.829943 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee9622a3-429f-4d36-86b1-c8e74a5e0f04 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:36.830395 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee9622a3-429f-4d36-86b1-c8e74a5e0f04 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:36.830825 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee9622a3-429f-4d36-86b1-c8e74a5e0f04 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:36.948748 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ee9622a3-429f-4d36-86b1-c8e74a5e0f04 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] 10.222.0.13 "GET /compute/v2.1/servers/d190bf6d-50f5-454f-a9fa-4296cd25bddd/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.162735 Oct 30 01:21:36.949394 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1102/2172] 10.222.0.13 () {58 vars in 1296 bytes} [Sun Oct 30 01:21:36 2022] GET /compute/v2.1/servers/d190bf6d-50f5-454f-a9fa-4296cd25bddd/os-instance-actions => generated 611 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:21:36.954125 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8cf17ff8-c38b-40b1-a336-6d26199d0f5a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:36.969933 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8cf17ff8-c38b-40b1-a336-6d26199d0f5a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 5ed38927-680d-4e93-b57a-21fb407c6b33] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:37.003668 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8cf17ff8-c38b-40b1-a336-6d26199d0f5a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:37.004176 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8cf17ff8-c38b-40b1-a336-6d26199d0f5a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:37.004673 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8cf17ff8-c38b-40b1-a336-6d26199d0f5a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:37.006300 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8cf17ff8-c38b-40b1-a336-6d26199d0f5a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:37.008082 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8cf17ff8-c38b-40b1-a336-6d26199d0f5a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:37.008537 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8cf17ff8-c38b-40b1-a336-6d26199d0f5a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:37.294239 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b25a6a21-7e85-4361-a023-a9acd0b55056 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:37.303224 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8cf17ff8-c38b-40b1-a336-6d26199d0f5a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:37.316313 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b25a6a21-7e85-4361-a023-a9acd0b55056 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/2b103487-3d7a-4186-aede-cb565cd34449" status: 200 len: 1314 microversion: 2.1 time: 1.143791 Oct 30 01:21:37.316920 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1071/2173] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:36 2022] GET /compute/v2.1/servers/2b103487-3d7a-4186-aede-cb565cd34449 => generated 1314 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:37.318390 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8cf17ff8-c38b-40b1-a336-6d26199d0f5a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:37.323868 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-825655e5-fae7-4944-b6b6-185c023c5dfc tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:37.324882 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-825655e5-fae7-4944-b6b6-185c023c5dfc tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] [instance: d190bf6d-50f5-454f-a9fa-4296cd25bddd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:37.327126 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8cf17ff8-c38b-40b1-a336-6d26199d0f5a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:37.331952 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8cf17ff8-c38b-40b1-a336-6d26199d0f5a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33" status: 200 len: 1266 microversion: 2.25 time: 0.377968 Oct 30 01:21:37.336924 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1103/2174] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:21:36 2022] GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33 => generated 1266 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:21:37.338779 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-825655e5-fae7-4944-b6b6-185c023c5dfc tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:37.339563 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-825655e5-fae7-4944-b6b6-185c023c5dfc tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:37.342448 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-825655e5-fae7-4944-b6b6-185c023c5dfc tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:37.343438 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-825655e5-fae7-4944-b6b6-185c023c5dfc tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:37.344107 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-825655e5-fae7-4944-b6b6-185c023c5dfc tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:37.344686 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-825655e5-fae7-4944-b6b6-185c023c5dfc tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:37.361913 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-d145982e-3b51-49e1-93b4-d82129d0cdee req-84f73092-c4a4-4d0b-8bc6-239b839c06fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b103487-3d7a-4186-aede-cb565cd34449", "tag": "164b70a4-3958-4932-91b3-cc105285c757"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:21:37.387752 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-825655e5-fae7-4944-b6b6-185c023c5dfc tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] [instance: d190bf6d-50f5-454f-a9fa-4296cd25bddd] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:21:37.396569 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-d145982e-3b51-49e1-93b4-d82129d0cdee req-84f73092-c4a4-4d0b-8bc6-239b839c06fc service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:37.398753 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-d145982e-3b51-49e1-93b4-d82129d0cdee req-84f73092-c4a4-4d0b-8bc6-239b839c06fc service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:37.398753 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-d145982e-3b51-49e1-93b4-d82129d0cdee req-84f73092-c4a4-4d0b-8bc6-239b839c06fc service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:37.435468 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-d145982e-3b51-49e1-93b4-d82129d0cdee req-84f73092-c4a4-4d0b-8bc6-239b839c06fc service nova] Creating event network-changed:164b70a4-3958-4932-91b3-cc105285c757 for instance 2b103487-3d7a-4186-aede-cb565cd34449 on n-h1-master-1 Oct 30 01:21:37.442660 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-d145982e-3b51-49e1-93b4-d82129d0cdee req-84f73092-c4a4-4d0b-8bc6-239b839c06fc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103680 Oct 30 01:21:37.448077 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1104/2175] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:21:37.456130 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2f74af73-8cc7-4def-85f3-e1be2981811b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:37.456130 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2f74af73-8cc7-4def-85f3-e1be2981811b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:37.466252 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2f74af73-8cc7-4def-85f3-e1be2981811b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:37.467110 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2f74af73-8cc7-4def-85f3-e1be2981811b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:37.467737 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2f74af73-8cc7-4def-85f3-e1be2981811b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:37.468729 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2f74af73-8cc7-4def-85f3-e1be2981811b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:37.469231 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2f74af73-8cc7-4def-85f3-e1be2981811b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:37.469688 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2f74af73-8cc7-4def-85f3-e1be2981811b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:37.754018 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2f74af73-8cc7-4def-85f3-e1be2981811b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:37.775289 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2f74af73-8cc7-4def-85f3-e1be2981811b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:37.782296 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2f74af73-8cc7-4def-85f3-e1be2981811b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:37.820036 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2f74af73-8cc7-4def-85f3-e1be2981811b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1555 microversion: 2.91 time: 0.370276 Oct 30 01:21:37.825725 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-825655e5-fae7-4944-b6b6-185c023c5dfc tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d190bf6d-50f5-454f-a9fa-4296cd25bddd" status: 204 len: 0 microversion: 2.1 time: 0.503760 Oct 30 01:21:37.826585 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1072/2176] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:21:37 2022] DELETE /compute/v2.1/servers/d190bf6d-50f5-454f-a9fa-4296cd25bddd => generated 0 bytes in 509 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:21:37.829482 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1105/2177] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:21:37 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1555 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:21:37.832983 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-25c823e3-5fab-4258-88b8-846795a92f2b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:37.834136 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-25c823e3-5fab-4258-88b8-846795a92f2b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 76c32172-798a-49f6-8247-6f86860dbdc5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:37.846604 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-24468296-db17-4d0e-b1b9-17d9fe4d44e3 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:37.856524 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-25c823e3-5fab-4258-88b8-846795a92f2b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:37.857079 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-24468296-db17-4d0e-b1b9-17d9fe4d44e3 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] [instance: d190bf6d-50f5-454f-a9fa-4296cd25bddd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:37.857745 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-25c823e3-5fab-4258-88b8-846795a92f2b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:37.865554 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-25c823e3-5fab-4258-88b8-846795a92f2b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:37.865554 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-25c823e3-5fab-4258-88b8-846795a92f2b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:37.865554 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-25c823e3-5fab-4258-88b8-846795a92f2b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:37.865554 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-25c823e3-5fab-4258-88b8-846795a92f2b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:37.882643 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24468296-db17-4d0e-b1b9-17d9fe4d44e3 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:37.883446 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24468296-db17-4d0e-b1b9-17d9fe4d44e3 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:37.884068 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24468296-db17-4d0e-b1b9-17d9fe4d44e3 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:37.884989 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24468296-db17-4d0e-b1b9-17d9fe4d44e3 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:37.885628 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24468296-db17-4d0e-b1b9-17d9fe4d44e3 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:37.886384 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24468296-db17-4d0e-b1b9-17d9fe4d44e3 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:37.898604 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-25c823e3-5fab-4258-88b8-846795a92f2b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] HTTP exception thrown: Instance 76c32172-798a-49f6-8247-6f86860dbdc5 could not be found. Oct 30 01:21:37.905029 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-25c823e3-5fab-4258-88b8-846795a92f2b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Request method failure captured: Oct 30 01:21:37.905029 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 HTTP/1.1 Oct 30 01:21:37.905029 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:21:37.905029 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:21:37.905029 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:21:37.905029 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:21:37.905029 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:21:37.905029 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:21:37.905029 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:21:37.905029 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:21:37.905029 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdAbPw23hQwPLJ2dU_HGxIRXsCw9bNiHATqQCht5o0qGPfa2Kq5AEX3T7chQWWhhzZVhFyT3KvFvR56kHfMj1Zajs4NLQn3E320ctHWtprwOHSTCEWkNIrqgzNyOQZaTDcuGkDNQhWjJqRPxebZIC-U_OIIsgwPUj899YmuUCbv3e-U Oct 30 01:21:37.905029 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:21:37.905029 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:21:37.905029 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:21:37.905029 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:21:37.905029 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:21:37.905029 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:21:37.905029 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: ad621909b99143dd9885006238de72a6 Oct 30 01:21:37.905029 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-MigrationsAdminTest-1982618098 Oct 30 01:21:37.905029 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:21:37.905029 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:21:37.907126 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ad621909b99143dd9885006238de72a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ad621909b99143dd9885006238de72a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ad621909b99143dd9885006238de72a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ad621909b99143dd9885006238de72a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:21:37.907126 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-MigrationsAdminTest-1982618098 Oct 30 01:21:37.907126 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: ad621909b99143dd9885006238de72a6 Oct 30 01:21:37.907126 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-MigrationsAdminTest-1982618098 Oct 30 01:21:37.907126 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-MigrationsAdminTest-1982618098-project Oct 30 01:21:37.907126 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:21:37.907126 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:21:37.907126 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 4f1fe6e04e064dfba969b07d4188ab38 Oct 30 01:21:37.907126 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-MigrationsAdminTest-1982618098-project Oct 30 01:21:37.907126 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:21:37.907126 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 76c32172-798a-49f6-8247-6f86860dbdc5 could not be found. Oct 30 01:21:37.907126 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '76c32172-798a-49f6-8247-6f86860dbdc5'} Oct 30 01:21:37.908289 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:21:37.908289 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:37.908289 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:21:37.908289 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:21:37.908289 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:21:37.908289 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:21:37.908289 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:21:37.908289 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:21:37.908289 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:21:37.908289 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:21:37.908289 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76c32172-798a-49f6-8247-6f86860dbdc5 could not be found. Oct 30 01:21:37.908289 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:21:37.908289 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:21:37.908289 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:21:37.908289 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:37.908289 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:21:37.908289 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:21:37.908289 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:21:37.908289 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:21:37.908289 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:21:37.910070 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:21:37.910070 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:21:37.910070 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:21:37.910070 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:21:37.910070 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:21:37.910070 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:21:37.910070 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:21:37.910070 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76c32172-798a-49f6-8247-6f86860dbdc5 could not be found. Oct 30 01:21:37.910070 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:21:37.910070 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:21:37.910070 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:21:37.910070 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:37.910070 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:21:37.910070 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:21:37.910070 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:21:37.910070 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:21:37.910070 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76c32172-798a-49f6-8247-6f86860dbdc5 could not be found. Oct 30 01:21:37.910070 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:21:37.912658 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-25c823e3-5fab-4258-88b8-846795a92f2b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Returning 404 to user: Instance 76c32172-798a-49f6-8247-6f86860dbdc5 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:21:37.913768 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-25c823e3-5fab-4258-88b8-846795a92f2b tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5" status: 404 len: 111 microversion: 2.1 time: 0.085860 Oct 30 01:21:37.914572 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1073/2178] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:37 2022] GET /compute/v2.1/servers/76c32172-798a-49f6-8247-6f86860dbdc5 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:21:37.923893 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c6e1132e-1490-4727-852e-5ac6f29c8c50 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:37.924402 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c6e1132e-1490-4727-852e-5ac6f29c8c50 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:37.952384 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6e1132e-1490-4727-852e-5ac6f29c8c50 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:37.952919 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6e1132e-1490-4727-852e-5ac6f29c8c50 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:37.953388 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6e1132e-1490-4727-852e-5ac6f29c8c50 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:37.955109 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6e1132e-1490-4727-852e-5ac6f29c8c50 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:37.955109 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6e1132e-1490-4727-852e-5ac6f29c8c50 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:37.967189 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6e1132e-1490-4727-852e-5ac6f29c8c50 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:38.050164 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c6e1132e-1490-4727-852e-5ac6f29c8c50 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:21:38.534522 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-24468296-db17-4d0e-b1b9-17d9fe4d44e3 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9f71f892094c2685b175e111fe7cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a766acde7eab4b05866a2c33f5dd3606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:38.535294 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c6e1132e-1490-4727-852e-5ac6f29c8c50 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "DELETE /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f" status: 204 len: 0 microversion: 2.1 time: 0.615377 Oct 30 01:21:38.536157 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1074/2179] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:21:37 2022] DELETE /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f => generated 0 bytes in 617 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:21:38.542511 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9c0c668b-7972-405c-af2e-47d067d66f7c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:38.543374 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9c0c668b-7972-405c-af2e-47d067d66f7c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 2b103487-3d7a-4186-aede-cb565cd34449] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:38.548853 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-24468296-db17-4d0e-b1b9-17d9fe4d44e3 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] 10.222.0.13 "GET /compute/v2.1/servers/d190bf6d-50f5-454f-a9fa-4296cd25bddd" status: 200 len: 1511 microversion: 2.1 time: 0.706893 Oct 30 01:21:38.566512 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1106/2180] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:37 2022] GET /compute/v2.1/servers/d190bf6d-50f5-454f-a9fa-4296cd25bddd => generated 1511 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:38.569785 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9c0c668b-7972-405c-af2e-47d067d66f7c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:38.578159 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9c0c668b-7972-405c-af2e-47d067d66f7c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:38.579063 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-35485fa6-b6f8-4ceb-9fa7-fdba5f79befc tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:38.579694 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-35485fa6-b6f8-4ceb-9fa7-fdba5f79befc tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 5ed38927-680d-4e93-b57a-21fb407c6b33] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:38.581552 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9c0c668b-7972-405c-af2e-47d067d66f7c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:38.584502 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9c0c668b-7972-405c-af2e-47d067d66f7c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:38.588126 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9c0c668b-7972-405c-af2e-47d067d66f7c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:38.593782 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-35485fa6-b6f8-4ceb-9fa7-fdba5f79befc tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:38.594829 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-35485fa6-b6f8-4ceb-9fa7-fdba5f79befc tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:38.595495 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-35485fa6-b6f8-4ceb-9fa7-fdba5f79befc tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:38.595639 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9c0c668b-7972-405c-af2e-47d067d66f7c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:38.596306 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-35485fa6-b6f8-4ceb-9fa7-fdba5f79befc tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:38.607268 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-35485fa6-b6f8-4ceb-9fa7-fdba5f79befc tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:38.609490 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-35485fa6-b6f8-4ceb-9fa7-fdba5f79befc tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:38.925120 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-35485fa6-b6f8-4ceb-9fa7-fdba5f79befc tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:38.935067 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-35485fa6-b6f8-4ceb-9fa7-fdba5f79befc tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:38.946019 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-35485fa6-b6f8-4ceb-9fa7-fdba5f79befc tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:38.948111 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-35485fa6-b6f8-4ceb-9fa7-fdba5f79befc tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33" status: 200 len: 1266 microversion: 2.25 time: 0.380500 Oct 30 01:21:38.981781 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1107/2181] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:21:38 2022] GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33 => generated 1266 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:21:38.991756 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-81e5db71-f144-4a29-aa83-5d031fc7ec46 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:38.992812 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-81e5db71-f144-4a29-aa83-5d031fc7ec46 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:39.001942 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-81e5db71-f144-4a29-aa83-5d031fc7ec46 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:39.002777 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-81e5db71-f144-4a29-aa83-5d031fc7ec46 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:39.003449 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-81e5db71-f144-4a29-aa83-5d031fc7ec46 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:39.004993 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-81e5db71-f144-4a29-aa83-5d031fc7ec46 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:39.005771 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-81e5db71-f144-4a29-aa83-5d031fc7ec46 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:39.006462 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-81e5db71-f144-4a29-aa83-5d031fc7ec46 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:40.332717 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9c0c668b-7972-405c-af2e-47d067d66f7c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:40.355124 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9c0c668b-7972-405c-af2e-47d067d66f7c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/2b103487-3d7a-4186-aede-cb565cd34449" status: 200 len: 1314 microversion: 2.1 time: 1.816914 Oct 30 01:21:40.358523 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1075/2182] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:38 2022] GET /compute/v2.1/servers/2b103487-3d7a-4186-aede-cb565cd34449 => generated 1314 bytes in 1822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:40.384067 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b4b78623-ae8f-45c0-b74f-2d66e3b27dba tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:40.385599 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b4b78623-ae8f-45c0-b74f-2d66e3b27dba tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:40.404097 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4b78623-ae8f-45c0-b74f-2d66e3b27dba tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:40.404905 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4b78623-ae8f-45c0-b74f-2d66e3b27dba tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:40.405573 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4b78623-ae8f-45c0-b74f-2d66e3b27dba tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:40.406482 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4b78623-ae8f-45c0-b74f-2d66e3b27dba tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:40.407111 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4b78623-ae8f-45c0-b74f-2d66e3b27dba tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:40.409015 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4b78623-ae8f-45c0-b74f-2d66e3b27dba tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:40.432432 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-81e5db71-f144-4a29-aa83-5d031fc7ec46 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:40.436739 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:40.455335 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-81e5db71-f144-4a29-aa83-5d031fc7ec46 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f" status: 200 len: 1469 microversion: 2.1 time: 1.471936 Oct 30 01:21:40.462218 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1108/2183] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:38 2022] GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f => generated 1469 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:40.467183 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2c34340a-d53d-41e9-bcb5-5eb21a0fda6a tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:40.467805 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2c34340a-d53d-41e9-bcb5-5eb21a0fda6a tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] [instance: d190bf6d-50f5-454f-a9fa-4296cd25bddd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:40.482412 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2c34340a-d53d-41e9-bcb5-5eb21a0fda6a tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:40.482918 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2c34340a-d53d-41e9-bcb5-5eb21a0fda6a tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:40.483353 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2c34340a-d53d-41e9-bcb5-5eb21a0fda6a tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:40.484079 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2c34340a-d53d-41e9-bcb5-5eb21a0fda6a tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:40.484532 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2c34340a-d53d-41e9-bcb5-5eb21a0fda6a tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:40.484958 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2c34340a-d53d-41e9-bcb5-5eb21a0fda6a tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:40.977048 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b4b78623-ae8f-45c0-b74f-2d66e3b27dba tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:40.995944 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b4b78623-ae8f-45c0-b74f-2d66e3b27dba tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:41.014846 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b4b78623-ae8f-45c0-b74f-2d66e3b27dba tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:41.036785 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b4b78623-ae8f-45c0-b74f-2d66e3b27dba tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1555 microversion: 2.91 time: 0.656907 Oct 30 01:21:41.068231 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1076/2184] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:21:40 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1555 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:21:41.084312 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ac5472d7-2667-47f6-a304-94497b0bab5c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:41.098425 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ac5472d7-2667-47f6-a304-94497b0bab5c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 5ed38927-680d-4e93-b57a-21fb407c6b33] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:41.121212 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ac5472d7-2667-47f6-a304-94497b0bab5c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:41.129357 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ac5472d7-2667-47f6-a304-94497b0bab5c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:41.134092 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ac5472d7-2667-47f6-a304-94497b0bab5c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:41.135294 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ac5472d7-2667-47f6-a304-94497b0bab5c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:41.136050 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ac5472d7-2667-47f6-a304-94497b0bab5c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:41.143548 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ac5472d7-2667-47f6-a304-94497b0bab5c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:41.441697 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2c34340a-d53d-41e9-bcb5-5eb21a0fda6a tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9f71f892094c2685b175e111fe7cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a766acde7eab4b05866a2c33f5dd3606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:41.454713 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2c34340a-d53d-41e9-bcb5-5eb21a0fda6a tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] 10.222.0.13 "GET /compute/v2.1/servers/d190bf6d-50f5-454f-a9fa-4296cd25bddd" status: 200 len: 1511 microversion: 2.1 time: 0.988751 Oct 30 01:21:41.455347 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1109/2185] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:40 2022] GET /compute/v2.1/servers/d190bf6d-50f5-454f-a9fa-4296cd25bddd => generated 1511 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:41.475961 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-c95eaaf7-6017-43c7-8965-523518e60b4c req-d65d37dd-5c46-4a7e-8ab9-3716bb2ad464 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d190bf6d-50f5-454f-a9fa-4296cd25bddd", "name": "network-vif-deleted", "tag": "54eedcfa-243d-4a94-9210-f1a09802d1b6"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:21:41.478706 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ac5472d7-2667-47f6-a304-94497b0bab5c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:41.496046 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-c95eaaf7-6017-43c7-8965-523518e60b4c req-d65d37dd-5c46-4a7e-8ab9-3716bb2ad464 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:41.497396 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-c95eaaf7-6017-43c7-8965-523518e60b4c req-d65d37dd-5c46-4a7e-8ab9-3716bb2ad464 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:41.504718 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-c95eaaf7-6017-43c7-8965-523518e60b4c req-d65d37dd-5c46-4a7e-8ab9-3716bb2ad464 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:41.512000 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ac5472d7-2667-47f6-a304-94497b0bab5c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:41.515223 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ac5472d7-2667-47f6-a304-94497b0bab5c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:41.518574 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ac5472d7-2667-47f6-a304-94497b0bab5c tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33" status: 200 len: 1266 microversion: 2.25 time: 0.447771 Oct 30 01:21:41.523424 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1077/2186] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:21:41 2022] GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33 => generated 1266 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:21:41.542145 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-095bb235-422f-4d93-bf23-751f2bff4dfe tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:41.543091 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-095bb235-422f-4d93-bf23-751f2bff4dfe tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 2b103487-3d7a-4186-aede-cb565cd34449] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:41.547178 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-c95eaaf7-6017-43c7-8965-523518e60b4c req-d65d37dd-5c46-4a7e-8ab9-3716bb2ad464 service nova] Creating event network-vif-deleted:54eedcfa-243d-4a94-9210-f1a09802d1b6 for instance d190bf6d-50f5-454f-a9fa-4296cd25bddd on n-h2-master-1 Oct 30 01:21:41.563746 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-c95eaaf7-6017-43c7-8965-523518e60b4c req-d65d37dd-5c46-4a7e-8ab9-3716bb2ad464 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105480 Oct 30 01:21:41.569088 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-095bb235-422f-4d93-bf23-751f2bff4dfe tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:41.574442 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-095bb235-422f-4d93-bf23-751f2bff4dfe tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:41.579430 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-095bb235-422f-4d93-bf23-751f2bff4dfe tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:41.579430 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-095bb235-422f-4d93-bf23-751f2bff4dfe tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:41.579430 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-095bb235-422f-4d93-bf23-751f2bff4dfe tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:41.579430 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-095bb235-422f-4d93-bf23-751f2bff4dfe tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:41.581420 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1110/2187] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:21:41.609599 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1280115c-0a48-4ce1-95f6-2131ba40881f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:41.610313 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1280115c-0a48-4ce1-95f6-2131ba40881f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:41.651196 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1280115c-0a48-4ce1-95f6-2131ba40881f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:41.651698 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1280115c-0a48-4ce1-95f6-2131ba40881f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:41.652138 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1280115c-0a48-4ce1-95f6-2131ba40881f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:41.652863 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1280115c-0a48-4ce1-95f6-2131ba40881f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:41.653325 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1280115c-0a48-4ce1-95f6-2131ba40881f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:41.653779 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1280115c-0a48-4ce1-95f6-2131ba40881f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:42.705622 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-095bb235-422f-4d93-bf23-751f2bff4dfe tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:42.720261 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-095bb235-422f-4d93-bf23-751f2bff4dfe tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/2b103487-3d7a-4186-aede-cb565cd34449" status: 200 len: 1314 microversion: 2.1 time: 1.191248 Oct 30 01:21:42.725649 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1078/2188] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:41 2022] GET /compute/v2.1/servers/2b103487-3d7a-4186-aede-cb565cd34449 => generated 1314 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:42.754652 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-afd1c9c9-9772-4b54-964a-8ab062d18443 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:42.756160 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-afd1c9c9-9772-4b54-964a-8ab062d18443 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:42.782665 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-afd1c9c9-9772-4b54-964a-8ab062d18443 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:42.784855 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-afd1c9c9-9772-4b54-964a-8ab062d18443 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:42.786075 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-afd1c9c9-9772-4b54-964a-8ab062d18443 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:42.788016 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-afd1c9c9-9772-4b54-964a-8ab062d18443 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:42.788931 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-afd1c9c9-9772-4b54-964a-8ab062d18443 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:42.791986 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-afd1c9c9-9772-4b54-964a-8ab062d18443 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:42.950159 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1280115c-0a48-4ce1-95f6-2131ba40881f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:42.966103 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1280115c-0a48-4ce1-95f6-2131ba40881f tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f" status: 200 len: 1469 microversion: 2.1 time: 1.381489 Oct 30 01:21:42.969205 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1111/2189] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:41 2022] GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f => generated 1469 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:42.981596 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b8b0c4f0-6776-4274-889b-a4bb51652b11 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:42.984691 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b8b0c4f0-6776-4274-889b-a4bb51652b11 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] [instance: d190bf6d-50f5-454f-a9fa-4296cd25bddd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:43.000679 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b8b0c4f0-6776-4274-889b-a4bb51652b11 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:43.002442 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-afd1c9c9-9772-4b54-964a-8ab062d18443 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:43.003236 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b8b0c4f0-6776-4274-889b-a4bb51652b11 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:43.013182 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-afd1c9c9-9772-4b54-964a-8ab062d18443 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:43.013840 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b8b0c4f0-6776-4274-889b-a4bb51652b11 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:43.014966 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b8b0c4f0-6776-4274-889b-a4bb51652b11 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:43.016497 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b8b0c4f0-6776-4274-889b-a4bb51652b11 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:43.031155 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b8b0c4f0-6776-4274-889b-a4bb51652b11 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:43.045418 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-afd1c9c9-9772-4b54-964a-8ab062d18443 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:43.065439 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-afd1c9c9-9772-4b54-964a-8ab062d18443 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1555 microversion: 2.91 time: 0.336606 Oct 30 01:21:43.093500 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1079/2190] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:21:42 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1555 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:21:43.107220 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0c25c971-a605-499c-8435-023e620a268a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:43.107859 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0c25c971-a605-499c-8435-023e620a268a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 5ed38927-680d-4e93-b57a-21fb407c6b33] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:43.122549 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c25c971-a605-499c-8435-023e620a268a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:43.122970 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c25c971-a605-499c-8435-023e620a268a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:43.123406 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c25c971-a605-499c-8435-023e620a268a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:43.124138 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c25c971-a605-499c-8435-023e620a268a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:43.124589 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c25c971-a605-499c-8435-023e620a268a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:43.125015 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c25c971-a605-499c-8435-023e620a268a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:43.160246 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b8b0c4f0-6776-4274-889b-a4bb51652b11 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:43.161658 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b8b0c4f0-6776-4274-889b-a4bb51652b11 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:43.163555 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b8b0c4f0-6776-4274-889b-a4bb51652b11 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:43.164498 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-b8b0c4f0-6776-4274-889b-a4bb51652b11 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lazy-loading 'fault' on Instance uuid d190bf6d-50f5-454f-a9fa-4296cd25bddd {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:21:43.236826 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c25c971-a605-499c-8435-023e620a268a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:43.240638 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c25c971-a605-499c-8435-023e620a268a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:43.241390 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c25c971-a605-499c-8435-023e620a268a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:43.242036 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-0c25c971-a605-499c-8435-023e620a268a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lazy-loading 'fault' on Instance uuid 5ed38927-680d-4e93-b57a-21fb407c6b33 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:21:43.341362 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b8b0c4f0-6776-4274-889b-a4bb51652b11 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9f71f892094c2685b175e111fe7cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a766acde7eab4b05866a2c33f5dd3606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:43.361237 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b8b0c4f0-6776-4274-889b-a4bb51652b11 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] 10.222.0.13 "GET /compute/v2.1/servers/d190bf6d-50f5-454f-a9fa-4296cd25bddd" status: 200 len: 1306 microversion: 2.1 time: 0.390599 Oct 30 01:21:43.369297 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1112/2191] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:42 2022] GET /compute/v2.1/servers/d190bf6d-50f5-454f-a9fa-4296cd25bddd => generated 1306 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:43.400462 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-49ad3e56-63e7-4280-b1e5-46a54ed4eb4d req-f86ece3d-c37e-4ec2-a0a4-4f1f8375c04f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12ca60c1-7c35-420c-b177-c7f3915a989f", "name": "network-vif-deleted", "tag": "0230e7b6-4d30-48c3-b9ab-066d496072ad"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:21:43.414392 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-49ad3e56-63e7-4280-b1e5-46a54ed4eb4d req-f86ece3d-c37e-4ec2-a0a4-4f1f8375c04f service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:43.415439 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-49ad3e56-63e7-4280-b1e5-46a54ed4eb4d req-f86ece3d-c37e-4ec2-a0a4-4f1f8375c04f service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:43.416163 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-49ad3e56-63e7-4280-b1e5-46a54ed4eb4d req-f86ece3d-c37e-4ec2-a0a4-4f1f8375c04f service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:43.432658 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-49ad3e56-63e7-4280-b1e5-46a54ed4eb4d req-f86ece3d-c37e-4ec2-a0a4-4f1f8375c04f service nova] Creating event network-vif-deleted:0230e7b6-4d30-48c3-b9ab-066d496072ad for instance 12ca60c1-7c35-420c-b177-c7f3915a989f on n-h1-master-1 Oct 30 01:21:43.442460 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-49ad3e56-63e7-4280-b1e5-46a54ed4eb4d req-f86ece3d-c37e-4ec2-a0a4-4f1f8375c04f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048931 Oct 30 01:21:43.443757 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1113/2192] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:21:43.494214 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0c25c971-a605-499c-8435-023e620a268a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:43.515881 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0c25c971-a605-499c-8435-023e620a268a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:43.517677 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0c25c971-a605-499c-8435-023e620a268a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:43.521192 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0c25c971-a605-499c-8435-023e620a268a tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33" status: 200 len: 1271 microversion: 2.25 time: 0.425856 Oct 30 01:21:43.525950 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1080/2193] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:21:43 2022] GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33 => generated 1271 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:21:43.756589 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f621e2cd-80b4-4f37-b82a-cfb5dd28686f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:43.759792 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f621e2cd-80b4-4f37-b82a-cfb5dd28686f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 2b103487-3d7a-4186-aede-cb565cd34449] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:43.786938 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f621e2cd-80b4-4f37-b82a-cfb5dd28686f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:43.805308 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f621e2cd-80b4-4f37-b82a-cfb5dd28686f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:43.809447 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f621e2cd-80b4-4f37-b82a-cfb5dd28686f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:43.813532 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f621e2cd-80b4-4f37-b82a-cfb5dd28686f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:43.814659 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f621e2cd-80b4-4f37-b82a-cfb5dd28686f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:43.816592 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f621e2cd-80b4-4f37-b82a-cfb5dd28686f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:43.992027 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3ba9ccaf-3443-4ee4-8de4-5435088ad485 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:43.993628 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3ba9ccaf-3443-4ee4-8de4-5435088ad485 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:44.003996 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3ba9ccaf-3443-4ee4-8de4-5435088ad485 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:44.004869 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3ba9ccaf-3443-4ee4-8de4-5435088ad485 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:44.006148 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3ba9ccaf-3443-4ee4-8de4-5435088ad485 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:44.007301 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3ba9ccaf-3443-4ee4-8de4-5435088ad485 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:44.008004 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3ba9ccaf-3443-4ee4-8de4-5435088ad485 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:44.008665 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3ba9ccaf-3443-4ee4-8de4-5435088ad485 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:44.087143 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3ba9ccaf-3443-4ee4-8de4-5435088ad485 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:44.088206 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3ba9ccaf-3443-4ee4-8de4-5435088ad485 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:44.088642 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3ba9ccaf-3443-4ee4-8de4-5435088ad485 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:44.089098 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-3ba9ccaf-3443-4ee4-8de4-5435088ad485 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lazy-loading 'fault' on Instance uuid 12ca60c1-7c35-420c-b177-c7f3915a989f {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:21:44.235759 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3ba9ccaf-3443-4ee4-8de4-5435088ad485 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:44.278105 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3ba9ccaf-3443-4ee4-8de4-5435088ad485 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f" status: 200 len: 1303 microversion: 2.1 time: 0.264623 Oct 30 01:21:44.278105 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1081/2194] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:43 2022] GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f => generated 1303 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:21:44.278105 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c217857b-8077-43a8-b98b-5ae476d870df tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:44.278105 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c217857b-8077-43a8-b98b-5ae476d870df tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:44.282860 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c217857b-8077-43a8-b98b-5ae476d870df tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:44.283800 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c217857b-8077-43a8-b98b-5ae476d870df tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:44.284506 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c217857b-8077-43a8-b98b-5ae476d870df tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:44.285479 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c217857b-8077-43a8-b98b-5ae476d870df tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:44.287270 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c217857b-8077-43a8-b98b-5ae476d870df tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:44.287867 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c217857b-8077-43a8-b98b-5ae476d870df tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:44.321182 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:44.889191 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c217857b-8077-43a8-b98b-5ae476d870df tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:44.897135 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f621e2cd-80b4-4f37-b82a-cfb5dd28686f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:44.908798 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f621e2cd-80b4-4f37-b82a-cfb5dd28686f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/2b103487-3d7a-4186-aede-cb565cd34449" status: 200 len: 1314 microversion: 2.1 time: 1.159995 Oct 30 01:21:44.911381 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1114/2195] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:43 2022] GET /compute/v2.1/servers/2b103487-3d7a-4186-aede-cb565cd34449 => generated 1314 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:44.917250 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bfe096b7-f7df-4ad1-8e42-9ff40a7eb1c1 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:44.918170 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bfe096b7-f7df-4ad1-8e42-9ff40a7eb1c1 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] [instance: d190bf6d-50f5-454f-a9fa-4296cd25bddd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:44.930100 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c217857b-8077-43a8-b98b-5ae476d870df tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:44.936073 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c217857b-8077-43a8-b98b-5ae476d870df tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:44.940036 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bfe096b7-f7df-4ad1-8e42-9ff40a7eb1c1 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:44.942087 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bfe096b7-f7df-4ad1-8e42-9ff40a7eb1c1 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:44.942732 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bfe096b7-f7df-4ad1-8e42-9ff40a7eb1c1 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:44.944944 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bfe096b7-f7df-4ad1-8e42-9ff40a7eb1c1 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:44.945954 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bfe096b7-f7df-4ad1-8e42-9ff40a7eb1c1 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:44.949052 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bfe096b7-f7df-4ad1-8e42-9ff40a7eb1c1 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:44.982197 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c217857b-8077-43a8-b98b-5ae476d870df tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1555 microversion: 2.91 time: 0.725688 Oct 30 01:21:44.985386 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-bfe096b7-f7df-4ad1-8e42-9ff40a7eb1c1 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] HTTP exception thrown: Instance d190bf6d-50f5-454f-a9fa-4296cd25bddd could not be found. Oct 30 01:21:44.988300 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bfe096b7-f7df-4ad1-8e42-9ff40a7eb1c1 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Request method failure captured: Oct 30 01:21:44.988300 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/d190bf6d-50f5-454f-a9fa-4296cd25bddd HTTP/1.1 Oct 30 01:21:44.988300 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:21:44.988300 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:21:44.988300 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:21:44.988300 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:21:44.988300 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:21:44.988300 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:21:44.988300 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:21:44.988300 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:21:44.988300 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdGAFR0DwjzUZduH9JakPljlP_xJkDxshbq_yTYRi0zFo_edhAqYYdo1qsg9TR_TDwSEPl5i2a8KmrefLgSxx3vowggIJBJTHwyJO54GGvp1cOL97HaA75FR83mgtZYpvaq0nDWckTK8HfUHM1lb9pmhlYJNIIL-iZQwPMldIR5unsY Oct 30 01:21:44.988300 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:21:44.988300 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:21:44.988300 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:21:44.988300 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:21:44.988300 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:21:44.988300 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:21:44.988300 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: a766acde7eab4b05866a2c33f5dd3606 Oct 30 01:21:44.988300 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-InstanceActionsTestJSON-1561170272 Oct 30 01:21:44.988300 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:21:44.988300 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:21:44.990289 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a766acde7eab4b05866a2c33f5dd3606"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a766acde7eab4b05866a2c33f5dd3606"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a766acde7eab4b05866a2c33f5dd3606"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a766acde7eab4b05866a2c33f5dd3606"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:21:44.990289 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-InstanceActionsTestJSON-1561170272 Oct 30 01:21:44.990289 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: a766acde7eab4b05866a2c33f5dd3606 Oct 30 01:21:44.990289 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1561170272 Oct 30 01:21:44.990289 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-InstanceActionsTestJSON-1561170272-project Oct 30 01:21:44.990289 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:21:44.990289 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:21:44.990289 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: ce9f71f892094c2685b175e111fe7cf9 Oct 30 01:21:44.990289 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-InstanceActionsTestJSON-1561170272-project Oct 30 01:21:44.990289 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:21:44.990289 n-d-master-1 devstack@n-api.service[121102]: exception: Instance d190bf6d-50f5-454f-a9fa-4296cd25bddd could not be found. Oct 30 01:21:44.990289 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'd190bf6d-50f5-454f-a9fa-4296cd25bddd'} Oct 30 01:21:44.991225 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:21:44.991225 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:44.991225 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:21:44.991225 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:21:44.991225 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:21:44.991225 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:21:44.991225 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:21:44.991225 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:21:44.991225 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:21:44.991225 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:21:44.991225 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d190bf6d-50f5-454f-a9fa-4296cd25bddd could not be found. Oct 30 01:21:44.991225 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:44.991225 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:21:44.991225 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:44.991225 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:44.991225 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:21:44.991225 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:21:44.991225 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:21:44.991225 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:21:44.991225 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:21:44.992647 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:21:44.992647 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:21:44.992647 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:21:44.992647 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:21:44.992647 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:21:44.992647 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:21:44.992647 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:21:44.992647 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d190bf6d-50f5-454f-a9fa-4296cd25bddd could not be found. Oct 30 01:21:44.992647 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:44.992647 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:21:44.992647 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:44.992647 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:44.992647 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:21:44.992647 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:21:44.992647 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:21:44.992647 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:21:44.992647 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d190bf6d-50f5-454f-a9fa-4296cd25bddd could not be found. Oct 30 01:21:44.992647 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:44.994519 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1082/2196] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:21:44 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1555 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:21:44.997232 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bfe096b7-f7df-4ad1-8e42-9ff40a7eb1c1 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] Returning 404 to user: Instance d190bf6d-50f5-454f-a9fa-4296cd25bddd could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:21:45.000101 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bfe096b7-f7df-4ad1-8e42-9ff40a7eb1c1 tempest-InstanceActionsTestJSON-1561170272 tempest-InstanceActionsTestJSON-1561170272-project] 10.222.0.13 "GET /compute/v2.1/servers/d190bf6d-50f5-454f-a9fa-4296cd25bddd" status: 404 len: 111 microversion: 2.1 time: 0.087365 Oct 30 01:21:45.000926 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1115/2197] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:44 2022] GET /compute/v2.1/servers/d190bf6d-50f5-454f-a9fa-4296cd25bddd => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:21:45.006621 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2a479d61-5931-4151-af57-c1046548fe84 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:45.011987 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2a479d61-5931-4151-af57-c1046548fe84 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 5ed38927-680d-4e93-b57a-21fb407c6b33] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:45.036076 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a479d61-5931-4151-af57-c1046548fe84 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:45.036652 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a479d61-5931-4151-af57-c1046548fe84 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:45.037111 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a479d61-5931-4151-af57-c1046548fe84 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:45.039403 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a479d61-5931-4151-af57-c1046548fe84 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:45.039403 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a479d61-5931-4151-af57-c1046548fe84 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:45.039403 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a479d61-5931-4151-af57-c1046548fe84 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:45.080341 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-2a479d61-5931-4151-af57-c1046548fe84 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] HTTP exception thrown: Instance 5ed38927-680d-4e93-b57a-21fb407c6b33 could not be found. Oct 30 01:21:45.091569 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2a479d61-5931-4151-af57-c1046548fe84 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Request method failure captured: Oct 30 01:21:45.091569 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33 HTTP/1.1 Oct 30 01:21:45.091569 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:21:45.091569 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:21:45.091569 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:21:45.091569 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:21:45.091569 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:21:45.091569 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:21:45.091569 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:21:45.091569 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:21:45.091569 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXc_0mq1CplEa1aPZYhbxi5TgeBxQWTmjClFo0UfdQuaAzHtvsfPo7DIwhN5B-1KrVIJgRZREDX2FdwcYtrgO-sGBBjWKIgNfqF5a_ixLdQhWHkdNNoRoBEy0QOJ0a8XcozziR4bS4aIcMvE2mkuQo7KqsWXnzNtZabfb-7ZRMd_V1QY Oct 30 01:21:45.091569 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:21:45.091569 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:21:45.091569 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:21:45.091569 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:21:45.091569 n-d-master-1 devstack@n-api.service[121103]: X-Openstack-Nova-Api-Version: 2.25 Oct 30 01:21:45.091569 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:21:45.091569 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:21:45.091569 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 301cee87901844ed94e635eca054960d Oct 30 01:21:45.091569 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1274178165 Oct 30 01:21:45.091569 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:21:45.091569 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:21:45.093823 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/301cee87901844ed94e635eca054960d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_301cee87901844ed94e635eca054960d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/301cee87901844ed94e635eca054960d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/301cee87901844ed94e635eca054960d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:21:45.093823 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1274178165 Oct 30 01:21:45.093823 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 301cee87901844ed94e635eca054960d Oct 30 01:21:45.093823 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1274178165 Oct 30 01:21:45.093823 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-LiveAutoBlockMigrationV225Test-1274178165-project Oct 30 01:21:45.093823 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:21:45.093823 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:21:45.093823 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 2096bbb8aff742b1837931e52ac1c9ae Oct 30 01:21:45.093823 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1274178165-project Oct 30 01:21:45.093823 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:21:45.093823 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 5ed38927-680d-4e93-b57a-21fb407c6b33 could not be found. Oct 30 01:21:45.093823 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '5ed38927-680d-4e93-b57a-21fb407c6b33'} Oct 30 01:21:45.094958 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:21:45.094958 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:45.094958 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:21:45.094958 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:21:45.094958 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:21:45.094958 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:21:45.094958 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:21:45.094958 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:21:45.094958 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:21:45.094958 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:21:45.094958 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ed38927-680d-4e93-b57a-21fb407c6b33 could not be found. Oct 30 01:21:45.094958 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:21:45.094958 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:21:45.094958 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:21:45.094958 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:45.094958 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:21:45.094958 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:21:45.094958 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:21:45.094958 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:21:45.094958 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:21:45.096738 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:21:45.096738 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:21:45.096738 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:21:45.096738 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:21:45.096738 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:21:45.096738 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:21:45.096738 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:21:45.096738 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ed38927-680d-4e93-b57a-21fb407c6b33 could not be found. Oct 30 01:21:45.096738 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:21:45.096738 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:21:45.096738 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:21:45.096738 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:45.096738 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:21:45.096738 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:21:45.096738 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:21:45.096738 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:21:45.096738 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ed38927-680d-4e93-b57a-21fb407c6b33 could not be found. Oct 30 01:21:45.096738 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:21:45.103181 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2a479d61-5931-4151-af57-c1046548fe84 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Returning 404 to user: Instance 5ed38927-680d-4e93-b57a-21fb407c6b33 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:21:45.103181 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2a479d61-5931-4151-af57-c1046548fe84 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33" status: 404 len: 111 microversion: 2.25 time: 0.100860 Oct 30 01:21:45.103181 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1083/2198] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:21:44 2022] GET /compute/v2.1/servers/5ed38927-680d-4e93-b57a-21fb407c6b33 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:21:45.304897 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-28276a77-50cd-4c27-8f10-936e1a4ba032 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:45.308904 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-28276a77-50cd-4c27-8f10-936e1a4ba032 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:45.323085 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-28276a77-50cd-4c27-8f10-936e1a4ba032 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:45.324903 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-28276a77-50cd-4c27-8f10-936e1a4ba032 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:45.328186 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-28276a77-50cd-4c27-8f10-936e1a4ba032 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:45.329174 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-28276a77-50cd-4c27-8f10-936e1a4ba032 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:45.329937 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-28276a77-50cd-4c27-8f10-936e1a4ba032 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:45.330657 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-28276a77-50cd-4c27-8f10-936e1a4ba032 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:45.436942 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-28276a77-50cd-4c27-8f10-936e1a4ba032 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:45.437893 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-28276a77-50cd-4c27-8f10-936e1a4ba032 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:45.441212 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-28276a77-50cd-4c27-8f10-936e1a4ba032 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:45.442017 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-28276a77-50cd-4c27-8f10-936e1a4ba032 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lazy-loading 'fault' on Instance uuid 12ca60c1-7c35-420c-b177-c7f3915a989f {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:21:45.610726 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-28276a77-50cd-4c27-8f10-936e1a4ba032 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1fe6e04e064dfba969b07d4188ab38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad621909b99143dd9885006238de72a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:45.626259 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-28276a77-50cd-4c27-8f10-936e1a4ba032 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f" status: 200 len: 1303 microversion: 2.1 time: 0.331839 Oct 30 01:21:45.636444 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1116/2199] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:45 2022] GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f => generated 1303 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:45.656091 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-e9e05de9-f963-40ea-982f-3027eb5f1e32 req-0f293eb5-a8a2-4cdb-88c5-1134f55ebbe6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b103487-3d7a-4186-aede-cb565cd34449", "name": "network-vif-plugged", "status": "completed", "tag": "164b70a4-3958-4932-91b3-cc105285c757"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:21:45.720900 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e9e05de9-f963-40ea-982f-3027eb5f1e32 req-0f293eb5-a8a2-4cdb-88c5-1134f55ebbe6 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:45.725831 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e9e05de9-f963-40ea-982f-3027eb5f1e32 req-0f293eb5-a8a2-4cdb-88c5-1134f55ebbe6 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:45.729290 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e9e05de9-f963-40ea-982f-3027eb5f1e32 req-0f293eb5-a8a2-4cdb-88c5-1134f55ebbe6 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:45.822670 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-e9e05de9-f963-40ea-982f-3027eb5f1e32 req-0f293eb5-a8a2-4cdb-88c5-1134f55ebbe6 service nova] Creating event network-vif-plugged:164b70a4-3958-4932-91b3-cc105285c757 for instance 2b103487-3d7a-4186-aede-cb565cd34449 on n-h1-master-1 Oct 30 01:21:45.848601 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-e9e05de9-f963-40ea-982f-3027eb5f1e32 req-0f293eb5-a8a2-4cdb-88c5-1134f55ebbe6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.197132 Oct 30 01:21:45.854675 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1084/2200] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:21:45.932248 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4693628f-6759-4d75-a30b-077647da7cbe tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:45.933703 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4693628f-6759-4d75-a30b-077647da7cbe tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 2b103487-3d7a-4186-aede-cb565cd34449] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:45.947988 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4693628f-6759-4d75-a30b-077647da7cbe tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:45.949025 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4693628f-6759-4d75-a30b-077647da7cbe tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:45.949774 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4693628f-6759-4d75-a30b-077647da7cbe tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:45.951890 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4693628f-6759-4d75-a30b-077647da7cbe tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:45.952722 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4693628f-6759-4d75-a30b-077647da7cbe tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:45.953892 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4693628f-6759-4d75-a30b-077647da7cbe tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:46.020767 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b70b7259-963d-4264-9f27-927b15a3cae1 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:46.021742 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b70b7259-963d-4264-9f27-927b15a3cae1 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:46.043496 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b70b7259-963d-4264-9f27-927b15a3cae1 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:46.043993 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b70b7259-963d-4264-9f27-927b15a3cae1 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:46.044447 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b70b7259-963d-4264-9f27-927b15a3cae1 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:46.045182 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b70b7259-963d-4264-9f27-927b15a3cae1 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:46.045672 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b70b7259-963d-4264-9f27-927b15a3cae1 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:46.046106 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b70b7259-963d-4264-9f27-927b15a3cae1 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:46.539780 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b70b7259-963d-4264-9f27-927b15a3cae1 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:46.562299 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b70b7259-963d-4264-9f27-927b15a3cae1 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:46.564252 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b70b7259-963d-4264-9f27-927b15a3cae1 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:46.570806 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b70b7259-963d-4264-9f27-927b15a3cae1 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1555 microversion: 2.91 time: 0.554435 Oct 30 01:21:46.572028 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1085/2201] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:21:46 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1555 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:21:46.656406 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d61c6ec0-e8c5-408c-83c9-fb95c12da961 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:46.657036 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d61c6ec0-e8c5-408c-83c9-fb95c12da961 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] [instance: 12ca60c1-7c35-420c-b177-c7f3915a989f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:46.664124 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d61c6ec0-e8c5-408c-83c9-fb95c12da961 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:46.664623 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d61c6ec0-e8c5-408c-83c9-fb95c12da961 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:46.665069 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d61c6ec0-e8c5-408c-83c9-fb95c12da961 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:46.693053 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d61c6ec0-e8c5-408c-83c9-fb95c12da961 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:46.693841 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d61c6ec0-e8c5-408c-83c9-fb95c12da961 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:46.697758 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d61c6ec0-e8c5-408c-83c9-fb95c12da961 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:46.744525 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-d61c6ec0-e8c5-408c-83c9-fb95c12da961 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] HTTP exception thrown: Instance 12ca60c1-7c35-420c-b177-c7f3915a989f could not be found. Oct 30 01:21:46.757020 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d61c6ec0-e8c5-408c-83c9-fb95c12da961 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Request method failure captured: Oct 30 01:21:46.757020 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f HTTP/1.1 Oct 30 01:21:46.757020 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:21:46.757020 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:21:46.757020 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:21:46.757020 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:21:46.757020 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:21:46.757020 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:21:46.757020 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:21:46.757020 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:21:46.757020 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdAbPw23hQwPLJ2dU_HGxIRXsCw9bNiHATqQCht5o0qGPfa2Kq5AEX3T7chQWWhhzZVhFyT3KvFvR56kHfMj1Zajs4NLQn3E320ctHWtprwOHSTCEWkNIrqgzNyOQZaTDcuGkDNQhWjJqRPxebZIC-U_OIIsgwPUj899YmuUCbv3e-U Oct 30 01:21:46.757020 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:21:46.757020 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:21:46.757020 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:21:46.757020 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:21:46.757020 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:21:46.757020 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:21:46.757020 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: ad621909b99143dd9885006238de72a6 Oct 30 01:21:46.757020 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-MigrationsAdminTest-1982618098 Oct 30 01:21:46.757020 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:21:46.757020 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:21:46.758792 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ad621909b99143dd9885006238de72a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ad621909b99143dd9885006238de72a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ad621909b99143dd9885006238de72a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ad621909b99143dd9885006238de72a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:21:46.758792 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-MigrationsAdminTest-1982618098 Oct 30 01:21:46.758792 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: ad621909b99143dd9885006238de72a6 Oct 30 01:21:46.758792 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-MigrationsAdminTest-1982618098 Oct 30 01:21:46.758792 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-MigrationsAdminTest-1982618098-project Oct 30 01:21:46.758792 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:21:46.758792 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:21:46.758792 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 4f1fe6e04e064dfba969b07d4188ab38 Oct 30 01:21:46.758792 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-MigrationsAdminTest-1982618098-project Oct 30 01:21:46.758792 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:21:46.758792 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 12ca60c1-7c35-420c-b177-c7f3915a989f could not be found. Oct 30 01:21:46.758792 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '12ca60c1-7c35-420c-b177-c7f3915a989f'} Oct 30 01:21:46.759790 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:21:46.759790 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:46.759790 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:21:46.759790 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:21:46.759790 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:21:46.759790 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:21:46.759790 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:21:46.759790 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:21:46.759790 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:21:46.759790 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:21:46.759790 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12ca60c1-7c35-420c-b177-c7f3915a989f could not be found. Oct 30 01:21:46.759790 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:21:46.759790 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:21:46.759790 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:21:46.759790 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:46.759790 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:21:46.759790 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:21:46.759790 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:21:46.759790 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:21:46.759790 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:21:46.761223 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:21:46.761223 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:21:46.761223 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:21:46.761223 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:21:46.761223 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:21:46.761223 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:21:46.761223 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:21:46.761223 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12ca60c1-7c35-420c-b177-c7f3915a989f could not be found. Oct 30 01:21:46.761223 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:21:46.761223 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:21:46.761223 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:21:46.761223 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:46.761223 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:21:46.761223 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:21:46.761223 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:21:46.761223 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:21:46.761223 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12ca60c1-7c35-420c-b177-c7f3915a989f could not be found. Oct 30 01:21:46.761223 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:21:46.765994 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d61c6ec0-e8c5-408c-83c9-fb95c12da961 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] Returning 404 to user: Instance 12ca60c1-7c35-420c-b177-c7f3915a989f could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:21:46.765994 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d61c6ec0-e8c5-408c-83c9-fb95c12da961 tempest-MigrationsAdminTest-1982618098 tempest-MigrationsAdminTest-1982618098-project] 10.222.0.13 "GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f" status: 404 len: 111 microversion: 2.1 time: 0.106670 Oct 30 01:21:46.766711 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1086/2202] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:46 2022] GET /compute/v2.1/servers/12ca60c1-7c35-420c-b177-c7f3915a989f => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:21:47.218525 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4693628f-6759-4d75-a30b-077647da7cbe tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:47.232197 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4693628f-6759-4d75-a30b-077647da7cbe tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/2b103487-3d7a-4186-aede-cb565cd34449" status: 200 len: 1314 microversion: 2.1 time: 1.304294 Oct 30 01:21:47.240595 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1117/2203] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:45 2022] GET /compute/v2.1/servers/2b103487-3d7a-4186-aede-cb565cd34449 => generated 1314 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:47.600247 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a27c64d9-3ec7-471b-ad1d-0855fb67518f tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:47.600869 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a27c64d9-3ec7-471b-ad1d-0855fb67518f tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:47.616948 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a27c64d9-3ec7-471b-ad1d-0855fb67518f tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:47.622057 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a27c64d9-3ec7-471b-ad1d-0855fb67518f tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:47.625175 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a27c64d9-3ec7-471b-ad1d-0855fb67518f tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:47.629428 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a27c64d9-3ec7-471b-ad1d-0855fb67518f tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:47.632259 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a27c64d9-3ec7-471b-ad1d-0855fb67518f tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:47.633871 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a27c64d9-3ec7-471b-ad1d-0855fb67518f tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:47.990731 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a27c64d9-3ec7-471b-ad1d-0855fb67518f tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:48.005538 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a27c64d9-3ec7-471b-ad1d-0855fb67518f tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:48.011468 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a27c64d9-3ec7-471b-ad1d-0855fb67518f tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:48.036940 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a27c64d9-3ec7-471b-ad1d-0855fb67518f tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1555 microversion: 2.91 time: 0.441065 Oct 30 01:21:48.038299 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1087/2204] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:21:47 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1555 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:21:48.258703 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-af276481-5598-4b56-9119-63dc6ccba802 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:48.259374 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-af276481-5598-4b56-9119-63dc6ccba802 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 2b103487-3d7a-4186-aede-cb565cd34449] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:48.269969 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af276481-5598-4b56-9119-63dc6ccba802 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:48.270479 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af276481-5598-4b56-9119-63dc6ccba802 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:48.270900 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af276481-5598-4b56-9119-63dc6ccba802 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:48.271624 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af276481-5598-4b56-9119-63dc6ccba802 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:48.272078 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af276481-5598-4b56-9119-63dc6ccba802 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:48.272507 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af276481-5598-4b56-9119-63dc6ccba802 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:48.983936 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-31da4555-b5e6-4b5a-abc4-ddef1963b520 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] Calling method '.version_select at 0x7f44c7e7e790>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:49.117578 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:49.140157 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-31da4555-b5e6-4b5a-abc4-ddef1963b520 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/8fb45c128cef4500a837862a5609284f" status: 200 len: 371 microversion: 2.1 time: 0.525484 Oct 30 01:21:49.148222 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1088/2205] 10.222.0.13 () {58 vars in 1242 bytes} [Sun Oct 30 01:21:48 2022] GET /compute/v2.1/os-quota-sets/8fb45c128cef4500a837862a5609284f => generated 371 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:21:49.161249 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-15e47eaf-4d0c-4ead-a195-55eaf6ca881e tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:49.163438 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-af276481-5598-4b56-9119-63dc6ccba802 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:49.169197 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-15e47eaf-4d0c-4ead-a195-55eaf6ca881e tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:49.188425 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-af276481-5598-4b56-9119-63dc6ccba802 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/2b103487-3d7a-4186-aede-cb565cd34449" status: 200 len: 1314 microversion: 2.1 time: 0.933487 Oct 30 01:21:49.190135 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-15e47eaf-4d0c-4ead-a195-55eaf6ca881e tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:49.190940 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-15e47eaf-4d0c-4ead-a195-55eaf6ca881e tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:49.191577 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-15e47eaf-4d0c-4ead-a195-55eaf6ca881e tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:49.192498 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-15e47eaf-4d0c-4ead-a195-55eaf6ca881e tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:49.193162 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-15e47eaf-4d0c-4ead-a195-55eaf6ca881e tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:49.201241 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-15e47eaf-4d0c-4ead-a195-55eaf6ca881e tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:49.222505 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1118/2206] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:48 2022] GET /compute/v2.1/servers/2b103487-3d7a-4186-aede-cb565cd34449 => generated 1314 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:49.230548 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c9903437-1409-4680-9ee1-139e8dcb6bd7 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] Action: 'update', calling method: .version_select at 0x7f44cc0a0f70>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:21:49.482361 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c9903437-1409-4680-9ee1-139e8dcb6bd7 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:49.483048 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c9903437-1409-4680-9ee1-139e8dcb6bd7 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:49.483522 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c9903437-1409-4680-9ee1-139e8dcb6bd7 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:49.485071 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c9903437-1409-4680-9ee1-139e8dcb6bd7 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:49.485679 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c9903437-1409-4680-9ee1-139e8dcb6bd7 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:49.486204 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c9903437-1409-4680-9ee1-139e8dcb6bd7 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:49.713990 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c9903437-1409-4680-9ee1-139e8dcb6bd7 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/8fb45c128cef4500a837862a5609284f" status: 200 len: 328 microversion: 2.1 time: 0.489838 Oct 30 01:21:49.733368 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1119/2207] 10.222.0.13 () {60 vars in 1262 bytes} [Sun Oct 30 01:21:49 2022] PUT /compute/v2.1/os-quota-sets/8fb45c128cef4500a837862a5609284f => generated 328 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:21:50.303513 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-15e47eaf-4d0c-4ead-a195-55eaf6ca881e tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:50.326832 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-15e47eaf-4d0c-4ead-a195-55eaf6ca881e tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:50.338201 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-15e47eaf-4d0c-4ead-a195-55eaf6ca881e tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:50.372135 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-15e47eaf-4d0c-4ead-a195-55eaf6ca881e tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1555 microversion: 2.91 time: 1.222436 Oct 30 01:21:50.397021 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1089/2208] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:21:49 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1555 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:21:50.420508 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f0e7f4e6-eec7-40e2-8e94-a643e49e19d1 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:50.426203 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f0e7f4e6-eec7-40e2-8e94-a643e49e19d1 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 2b103487-3d7a-4186-aede-cb565cd34449] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:50.462307 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f0e7f4e6-eec7-40e2-8e94-a643e49e19d1 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:50.465871 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f0e7f4e6-eec7-40e2-8e94-a643e49e19d1 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:50.471376 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f0e7f4e6-eec7-40e2-8e94-a643e49e19d1 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:50.473814 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f0e7f4e6-eec7-40e2-8e94-a643e49e19d1 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:50.477413 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f0e7f4e6-eec7-40e2-8e94-a643e49e19d1 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:50.480949 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f0e7f4e6-eec7-40e2-8e94-a643e49e19d1 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:50.626428 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-73d7805b-aaec-403c-bc3e-16345515c256 tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1797300128", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:21:50.715581 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-73d7805b-aaec-403c-bc3e-16345515c256 tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] validate_networks() for None {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:21:51.987110 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f0e7f4e6-eec7-40e2-8e94-a643e49e19d1 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:51.997005 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f0e7f4e6-eec7-40e2-8e94-a643e49e19d1 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/2b103487-3d7a-4186-aede-cb565cd34449" status: 200 len: 1501 microversion: 2.1 time: 1.598410 Oct 30 01:21:51.999418 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1090/2209] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:50 2022] GET /compute/v2.1/servers/2b103487-3d7a-4186-aede-cb565cd34449 => generated 1501 bytes in 1601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:52.018980 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a911ad11-fc76-418a-bdf2-7c50f178ad6b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:52.019984 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a911ad11-fc76-418a-bdf2-7c50f178ad6b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:52.036347 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a911ad11-fc76-418a-bdf2-7c50f178ad6b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:52.037861 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a911ad11-fc76-418a-bdf2-7c50f178ad6b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:52.039641 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a911ad11-fc76-418a-bdf2-7c50f178ad6b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:52.044873 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a911ad11-fc76-418a-bdf2-7c50f178ad6b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:52.045774 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a911ad11-fc76-418a-bdf2-7c50f178ad6b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:52.046421 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a911ad11-fc76-418a-bdf2-7c50f178ad6b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:52.488288 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-73d7805b-aaec-403c-bc3e-16345515c256 tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:21:52.488768 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-73d7805b-aaec-403c-bc3e-16345515c256 tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:21:52.489167 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-73d7805b-aaec-403c-bc3e-16345515c256 tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:21:52.489598 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-73d7805b-aaec-403c-bc3e-16345515c256 tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:21:52.490355 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-73d7805b-aaec-403c-bc3e-16345515c256 tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:21:52.518100 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-73d7805b-aaec-403c-bc3e-16345515c256 tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:52.518520 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-73d7805b-aaec-403c-bc3e-16345515c256 tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:52.518940 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-73d7805b-aaec-403c-bc3e-16345515c256 tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:52.519669 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-73d7805b-aaec-403c-bc3e-16345515c256 tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:52.520122 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-73d7805b-aaec-403c-bc3e-16345515c256 tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:52.520551 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-73d7805b-aaec-403c-bc3e-16345515c256 tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:52.539441 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a911ad11-fc76-418a-bdf2-7c50f178ad6b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:52.548708 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a911ad11-fc76-418a-bdf2-7c50f178ad6b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:52.570476 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a911ad11-fc76-418a-bdf2-7c50f178ad6b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:52.601245 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a911ad11-fc76-418a-bdf2-7c50f178ad6b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1555 microversion: 2.91 time: 0.600480 Oct 30 01:21:52.612151 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1091/2210] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:21:51 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1555 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:21:52.636284 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2a8be478-acbe-4385-821b-6a74bec85299 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:21:52.636842 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2a8be478-acbe-4385-821b-6a74bec85299 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 2b103487-3d7a-4186-aede-cb565cd34449] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:52.675814 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-73d7805b-aaec-403c-bc3e-16345515c256 tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] Getting quotas for project 8fb45c128cef4500a837862a5609284f. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:21:52.697709 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a8be478-acbe-4385-821b-6a74bec85299 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:52.700470 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a8be478-acbe-4385-821b-6a74bec85299 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:52.700984 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a8be478-acbe-4385-821b-6a74bec85299 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:52.701733 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a8be478-acbe-4385-821b-6a74bec85299 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:52.709028 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-73d7805b-aaec-403c-bc3e-16345515c256 tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] Getting quotas for user 90371d04c0ad4aeba7780f85721cf7cc and project 8fb45c128cef4500a837862a5609284f. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:21:52.711556 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a8be478-acbe-4385-821b-6a74bec85299 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:52.712036 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a8be478-acbe-4385-821b-6a74bec85299 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:52.784445 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.utils [None req-73d7805b-aaec-403c-bc3e-16345515c256 tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] cores quota exceeded for 8fb45c128cef4500a837862a5609284f, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=121102) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 30 01:21:52.785187 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-73d7805b-aaec-403c-bc3e-16345515c256 tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 30 01:21:52.814789 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-73d7805b-aaec-403c-bc3e-16345515c256 tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] Request method failure captured: Oct 30 01:21:52.814789 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 30 01:21:52.814789 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:21:52.814789 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:21:52.814789 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:21:52.814789 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 145 Oct 30 01:21:52.814789 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:21:52.814789 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:21:52.814789 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:21:52.814789 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:21:52.814789 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdGqfgZU1Lx8GJdFNShqpcNEz81pXVxjZGMWqC6jcqg9KgFMS5NUCn29JQwEV3kb5vhSMLBAB0lHtNIDpNeo8NQys6OVW3d2iNFEJJ-A2vCbFYgEbHFwqns_rHdUF7nZ_tOeXuBi6YMoDL4ixvlKuAH6Lhj0Yh6EOddq5TuuBMMGOeE Oct 30 01:21:52.814789 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:21:52.814789 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:21:52.814789 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:21:52.814789 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:21:52.814789 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:21:52.814789 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:21:52.814789 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 8fb45c128cef4500a837862a5609284f Oct 30 01:21:52.814789 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-QuotasAdminNegativeTest-224013508 Oct 30 01:21:52.814789 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:21:52.814789 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:21:52.816445 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8fb45c128cef4500a837862a5609284f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8fb45c128cef4500a837862a5609284f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8fb45c128cef4500a837862a5609284f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8fb45c128cef4500a837862a5609284f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:21:52.816445 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-QuotasAdminNegativeTest-224013508 Oct 30 01:21:52.816445 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 8fb45c128cef4500a837862a5609284f Oct 30 01:21:52.816445 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-224013508 Oct 30 01:21:52.816445 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-QuotasAdminNegativeTest-224013508-project Oct 30 01:21:52.816445 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:21:52.816445 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:21:52.816445 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 90371d04c0ad4aeba7780f85721cf7cc Oct 30 01:21:52.816445 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-QuotasAdminNegativeTest-224013508-project Oct 30 01:21:52.816445 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:21:52.816445 n-d-master-1 devstack@n-api.service[121102]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1797300128", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452"}} Oct 30 01:21:52.816445 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:21:52.817732 n-d-master-1 devstack@n-api.service[121102]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 30 01:21:52.817732 n-d-master-1 devstack@n-api.service[121102]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1797300128', 'imageRef': 'deb14158-45d8-4539-889d-ff9726d046d7', 'flavorRef': '452'}}} Oct 30 01:21:52.817732 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:21:52.817732 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:52.817732 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 30 01:21:52.817732 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 30 01:21:52.817732 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 01:21:52.817732 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 01:21:52.817732 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 30 01:21:52.817732 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc Oct 30 01:21:52.817732 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 30 01:21:52.817732 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 30 01:21:52.817732 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 01:21:52.817732 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 01:21:52.817732 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 30 01:21:52.817732 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 30 01:21:52.817732 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 30 01:21:52.817732 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 30 01:21:52.824020 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 30 01:21:52.824020 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 30 01:21:52.824020 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 30 01:21:52.824020 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:52.824020 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:21:52.824020 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:52.824020 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:52.824020 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 30 01:21:52.824020 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 30 01:21:52.824020 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 30 01:21:52.824020 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 30 01:21:52.824020 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 30 01:21:52.824020 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 30 01:21:52.824020 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 30 01:21:52.824020 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 30 01:21:52.824020 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 30 01:21:52.824020 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 30 01:21:52.824020 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 30 01:21:52.824020 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:52.824020 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:21:52.824020 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:52.826103 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:52.826103 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:21:52.826103 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:21:52.826103 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:21:52.826103 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:21:52.826103 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:21:52.826103 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:21:52.826103 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:21:52.826103 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:21:52.826103 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:21:52.826103 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:21:52.826103 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:21:52.826103 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:21:52.826103 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 30 01:21:52.826103 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 30 01:21:52.826103 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 30 01:21:52.826103 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 30 01:21:52.826103 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:52.826103 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:21:52.826103 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:52.826103 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:52.827979 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:21:52.827979 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:21:52.827979 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:21:52.827979 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:21:52.827979 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 30 01:21:52.827979 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:21:52.827979 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-73d7805b-aaec-403c-bc3e-16345515c256 tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:21:52.827979 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-73d7805b-aaec-403c-bc3e-16345515c256 tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 2.755404 Oct 30 01:21:52.837036 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1120/2211] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:21:50 2022] POST /compute/v2.1/servers => generated 111 bytes in 2777 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 30 01:21:52.857449 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a4c00e9e-76b7-415f-b32a-e738966ffb81 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] Action: 'update', calling method: .version_select at 0x7f44cc047ca0>, body: {"quota_set": {"cores": 20}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:21:53.048004 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2a8be478-acbe-4385-821b-6a74bec85299 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "POST /compute/v2.1/servers/2b103487-3d7a-4186-aede-cb565cd34449/action" status: 202 len: 0 microversion: 2.1 time: 0.427927 Oct 30 01:21:53.051537 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1092/2212] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:21:52 2022] POST /compute/v2.1/servers/2b103487-3d7a-4186-aede-cb565cd34449/action => generated 0 bytes in 430 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:21:53.089581 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bedb89b5-1809-4a3a-94e9-84b66fb5e016 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:53.090587 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-bedb89b5-1809-4a3a-94e9-84b66fb5e016 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 2b103487-3d7a-4186-aede-cb565cd34449] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:53.126061 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bedb89b5-1809-4a3a-94e9-84b66fb5e016 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:53.131080 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bedb89b5-1809-4a3a-94e9-84b66fb5e016 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:53.137007 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bedb89b5-1809-4a3a-94e9-84b66fb5e016 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:53.141465 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bedb89b5-1809-4a3a-94e9-84b66fb5e016 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:53.141465 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bedb89b5-1809-4a3a-94e9-84b66fb5e016 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:53.151126 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bedb89b5-1809-4a3a-94e9-84b66fb5e016 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:53.589835 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a4c00e9e-76b7-415f-b32a-e738966ffb81 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:53.590534 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a4c00e9e-76b7-415f-b32a-e738966ffb81 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:53.590988 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a4c00e9e-76b7-415f-b32a-e738966ffb81 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:53.610539 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a4c00e9e-76b7-415f-b32a-e738966ffb81 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:53.616068 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a4c00e9e-76b7-415f-b32a-e738966ffb81 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:53.618070 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a4c00e9e-76b7-415f-b32a-e738966ffb81 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:53.922719 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-bedb89b5-1809-4a3a-94e9-84b66fb5e016 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:53.933591 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bedb89b5-1809-4a3a-94e9-84b66fb5e016 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/2b103487-3d7a-4186-aede-cb565cd34449" status: 200 len: 1506 microversion: 2.1 time: 0.869355 Oct 30 01:21:53.936627 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1093/2213] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:53 2022] GET /compute/v2.1/servers/2b103487-3d7a-4186-aede-cb565cd34449 => generated 1506 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:53.943771 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f62d0107-66c5-4c71-892c-d4f0d29a44d8 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:53.949992 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f62d0107-66c5-4c71-892c-d4f0d29a44d8 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:53.966846 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f62d0107-66c5-4c71-892c-d4f0d29a44d8 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:53.967699 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f62d0107-66c5-4c71-892c-d4f0d29a44d8 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:53.968324 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f62d0107-66c5-4c71-892c-d4f0d29a44d8 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:53.969355 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f62d0107-66c5-4c71-892c-d4f0d29a44d8 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:53.975603 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f62d0107-66c5-4c71-892c-d4f0d29a44d8 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:53.976369 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f62d0107-66c5-4c71-892c-d4f0d29a44d8 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:53.985651 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a4c00e9e-76b7-415f-b32a-e738966ffb81 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/8fb45c128cef4500a837862a5609284f" status: 200 len: 329 microversion: 2.1 time: 1.145482 Oct 30 01:21:53.986250 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1121/2214] 10.222.0.13 () {60 vars in 1262 bytes} [Sun Oct 30 01:21:52 2022] PUT /compute/v2.1/os-quota-sets/8fb45c128cef4500a837862a5609284f => generated 329 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:21:54.004966 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-87828645-224c-4507-9999-dec1c145cd7d tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] Calling method '.version_select at 0x7f44cc03fc10>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:54.166514 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f62d0107-66c5-4c71-892c-d4f0d29a44d8 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:54.184156 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f62d0107-66c5-4c71-892c-d4f0d29a44d8 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:54.188401 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f62d0107-66c5-4c71-892c-d4f0d29a44d8 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:54.225696 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f62d0107-66c5-4c71-892c-d4f0d29a44d8 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1555 microversion: 2.91 time: 0.287642 Oct 30 01:21:54.231687 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1094/2215] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:21:53 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1555 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:21:54.443894 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-87828645-224c-4507-9999-dec1c145cd7d tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/8fb45c128cef4500a837862a5609284f" status: 200 len: 371 microversion: 2.1 time: 0.445526 Oct 30 01:21:54.468759 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9f1cb62d-9c6f-4b67-b6cd-9fda544aae37 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] Action: 'update', calling method: .version_select at 0x7f44cc6bc700>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:21:54.474356 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1122/2216] 10.222.0.13 () {58 vars in 1242 bytes} [Sun Oct 30 01:21:53 2022] GET /compute/v2.1/os-quota-sets/8fb45c128cef4500a837862a5609284f => generated 371 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:21:54.589166 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f4cece4b-0dda-447b-9a22-824b75bdaa81 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:54.590066 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f4cece4b-0dda-447b-9a22-824b75bdaa81 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:54.599295 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:54.606814 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f4cece4b-0dda-447b-9a22-824b75bdaa81 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:54.610594 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f4cece4b-0dda-447b-9a22-824b75bdaa81 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:54.612948 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f4cece4b-0dda-447b-9a22-824b75bdaa81 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:54.615388 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f4cece4b-0dda-447b-9a22-824b75bdaa81 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:54.616546 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f4cece4b-0dda-447b-9a22-824b75bdaa81 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:54.620010 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f4cece4b-0dda-447b-9a22-824b75bdaa81 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:54.735564 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f4cece4b-0dda-447b-9a22-824b75bdaa81 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:21:54.871946 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9f1cb62d-9c6f-4b67-b6cd-9fda544aae37 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:54.872611 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9f1cb62d-9c6f-4b67-b6cd-9fda544aae37 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:54.882768 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9f1cb62d-9c6f-4b67-b6cd-9fda544aae37 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:54.883611 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9f1cb62d-9c6f-4b67-b6cd-9fda544aae37 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:54.884085 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9f1cb62d-9c6f-4b67-b6cd-9fda544aae37 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:54.885085 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9f1cb62d-9c6f-4b67-b6cd-9fda544aae37 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:55.262916 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9f1cb62d-9c6f-4b67-b6cd-9fda544aae37 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/8fb45c128cef4500a837862a5609284f" status: 200 len: 328 microversion: 2.1 time: 0.786484 Oct 30 01:21:55.262916 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1095/2217] 10.222.0.13 () {60 vars in 1262 bytes} [Sun Oct 30 01:21:54 2022] PUT /compute/v2.1/os-quota-sets/8fb45c128cef4500a837862a5609284f => generated 328 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:21:55.272163 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0b517036-9d93-46d8-9f79-a94b5b14c161 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:55.273217 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0b517036-9d93-46d8-9f79-a94b5b14c161 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 2b103487-3d7a-4186-aede-cb565cd34449] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:55.294485 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b517036-9d93-46d8-9f79-a94b5b14c161 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:55.297215 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b517036-9d93-46d8-9f79-a94b5b14c161 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:55.298162 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b517036-9d93-46d8-9f79-a94b5b14c161 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:55.301431 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b517036-9d93-46d8-9f79-a94b5b14c161 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:55.305094 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b517036-9d93-46d8-9f79-a94b5b14c161 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:55.305799 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b517036-9d93-46d8-9f79-a94b5b14c161 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:55.311608 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f4cece4b-0dda-447b-9a22-824b75bdaa81 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 204 len: 0 microversion: 2.25 time: 0.726222 Oct 30 01:21:55.312398 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1123/2218] 10.222.0.13 () {60 vars in 1280 bytes} [Sun Oct 30 01:21:54 2022] DELETE /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 0 bytes in 728 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 30 01:21:55.318053 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d151594d-fc03-4210-8cf2-40ba6ce2802d tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:55.318837 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d151594d-fc03-4210-8cf2-40ba6ce2802d tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:55.342892 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d151594d-fc03-4210-8cf2-40ba6ce2802d tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:55.343393 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d151594d-fc03-4210-8cf2-40ba6ce2802d tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:55.343823 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d151594d-fc03-4210-8cf2-40ba6ce2802d tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:55.344530 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d151594d-fc03-4210-8cf2-40ba6ce2802d tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:55.379510 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d151594d-fc03-4210-8cf2-40ba6ce2802d tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:55.380396 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d151594d-fc03-4210-8cf2-40ba6ce2802d tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:55.712745 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d151594d-fc03-4210-8cf2-40ba6ce2802d tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:55.740355 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d151594d-fc03-4210-8cf2-40ba6ce2802d tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:55.757023 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d151594d-fc03-4210-8cf2-40ba6ce2802d tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:55.794436 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d151594d-fc03-4210-8cf2-40ba6ce2802d tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1555 microversion: 2.91 time: 0.480653 Oct 30 01:21:55.813283 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1124/2219] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:21:55 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1555 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:21:55.840610 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c29eac33-29c3-40dc-8353-6b17d2107cca tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:55.841232 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c29eac33-29c3-40dc-8353-6b17d2107cca tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:55.876723 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c29eac33-29c3-40dc-8353-6b17d2107cca tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:55.877230 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c29eac33-29c3-40dc-8353-6b17d2107cca tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:55.877689 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c29eac33-29c3-40dc-8353-6b17d2107cca tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:55.880408 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c29eac33-29c3-40dc-8353-6b17d2107cca tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:55.887992 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c29eac33-29c3-40dc-8353-6b17d2107cca tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:55.889860 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c29eac33-29c3-40dc-8353-6b17d2107cca tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:56.803827 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0b517036-9d93-46d8-9f79-a94b5b14c161 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:56.860842 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0b517036-9d93-46d8-9f79-a94b5b14c161 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/2b103487-3d7a-4186-aede-cb565cd34449" status: 200 len: 1486 microversion: 2.1 time: 1.613994 Oct 30 01:21:56.868831 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1096/2220] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:21:55 2022] GET /compute/v2.1/servers/2b103487-3d7a-4186-aede-cb565cd34449 => generated 1486 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:21:56.890887 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bd5a3858-012e-47b2-a67b-ce4beda60ca9 tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-503251172", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:21:57.002475 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-bd5a3858-012e-47b2-a67b-ce4beda60ca9 tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] validate_networks() for None {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:21:57.101774 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c29eac33-29c3-40dc-8353-6b17d2107cca tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:57.113184 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c29eac33-29c3-40dc-8353-6b17d2107cca tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:57.122079 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c29eac33-29c3-40dc-8353-6b17d2107cca tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:57.123320 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c29eac33-29c3-40dc-8353-6b17d2107cca tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 200 len: 1731 microversion: 2.25 time: 1.304584 Oct 30 01:21:57.123904 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1125/2221] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:21:55 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 1731 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:21:57.509943 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b9283056-8166-4e42-ba9a-37704c355a10 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Action: 'create', calling method: .version_select at 0x7f44cc05bee0>, body: {"keypair": {"name": "tempest-keypair-12148639", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMczpyWk2NNmaUbLFKTLNwumOeJfY7MgWRir4ksnykmpCVLypALlt9prMRbHpEHuzhgzIZ9c/aiDopx+pgmOTqGmo5YAlVuymyA7sbUpij38Go1nIT31FLSjT5o96F/Skw=="}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:21:57.541117 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-b9283056-8166-4e42-ba9a-37704c355a10 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Getting quotas for project 7f383493aa6b46c9884b54cb82063b30. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:21:57.561104 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-b9283056-8166-4e42-ba9a-37704c355a10 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Getting quotas for user d6e0e5acf53b4abe99c3418c82d47ab3 and project 7f383493aa6b46c9884b54cb82063b30. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:21:57.691694 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b9283056-8166-4e42-ba9a-37704c355a10 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.556867 Oct 30 01:21:57.692928 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1126/2222] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 30 01:21:57 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:21:57.699498 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0090a07d-b17c-4292-8261-560c84d17a8b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:57.700499 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0090a07d-b17c-4292-8261-560c84d17a8b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:57.718730 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0090a07d-b17c-4292-8261-560c84d17a8b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:57.719523 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0090a07d-b17c-4292-8261-560c84d17a8b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:57.720140 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0090a07d-b17c-4292-8261-560c84d17a8b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:57.721029 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0090a07d-b17c-4292-8261-560c84d17a8b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:57.725417 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0090a07d-b17c-4292-8261-560c84d17a8b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:57.726134 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0090a07d-b17c-4292-8261-560c84d17a8b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:57.964836 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0090a07d-b17c-4292-8261-560c84d17a8b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:57.975486 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-bd5a3858-012e-47b2-a67b-ce4beda60ca9 tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:21:57.977070 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-bd5a3858-012e-47b2-a67b-ce4beda60ca9 tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:21:57.977779 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-bd5a3858-012e-47b2-a67b-ce4beda60ca9 tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:21:57.979308 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-bd5a3858-012e-47b2-a67b-ce4beda60ca9 tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:21:57.979962 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-bd5a3858-012e-47b2-a67b-ce4beda60ca9 tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:21:57.993575 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0090a07d-b17c-4292-8261-560c84d17a8b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:58.002704 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0090a07d-b17c-4292-8261-560c84d17a8b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:58.008969 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd5a3858-012e-47b2-a67b-ce4beda60ca9 tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:58.010656 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd5a3858-012e-47b2-a67b-ce4beda60ca9 tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:58.011392 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd5a3858-012e-47b2-a67b-ce4beda60ca9 tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:58.012394 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd5a3858-012e-47b2-a67b-ce4beda60ca9 tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:58.014262 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd5a3858-012e-47b2-a67b-ce4beda60ca9 tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:58.015102 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd5a3858-012e-47b2-a67b-ce4beda60ca9 tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:58.017311 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0090a07d-b17c-4292-8261-560c84d17a8b tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1555 microversion: 2.91 time: 0.322658 Oct 30 01:21:58.039446 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1127/2223] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:21:57 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1555 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:21:58.061418 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8ac2aeab-9dc0-48e9-9bc1-93613a561c48 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:58.065364 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8ac2aeab-9dc0-48e9-9bc1-93613a561c48 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 2b103487-3d7a-4186-aede-cb565cd34449] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:58.080638 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8ac2aeab-9dc0-48e9-9bc1-93613a561c48 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:58.081462 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8ac2aeab-9dc0-48e9-9bc1-93613a561c48 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:58.089947 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8ac2aeab-9dc0-48e9-9bc1-93613a561c48 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:58.089947 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8ac2aeab-9dc0-48e9-9bc1-93613a561c48 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:58.089947 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8ac2aeab-9dc0-48e9-9bc1-93613a561c48 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:58.089947 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8ac2aeab-9dc0-48e9-9bc1-93613a561c48 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:58.092116 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-bd5a3858-012e-47b2-a67b-ce4beda60ca9 tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] Getting quotas for project 8fb45c128cef4500a837862a5609284f. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:21:58.107709 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-bd5a3858-012e-47b2-a67b-ce4beda60ca9 tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] Getting quotas for user 90371d04c0ad4aeba7780f85721cf7cc and project 8fb45c128cef4500a837862a5609284f. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:21:58.138326 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.utils [None req-bd5a3858-012e-47b2-a67b-ce4beda60ca9 tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] instances quota exceeded for 8fb45c128cef4500a837862a5609284f, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=121103) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 30 01:21:58.142727 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-bd5a3858-012e-47b2-a67b-ce4beda60ca9 tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 30 01:21:58.148547 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8ac2aeab-9dc0-48e9-9bc1-93613a561c48 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 2b103487-3d7a-4186-aede-cb565cd34449] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:21:58.151988 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bd5a3858-012e-47b2-a67b-ce4beda60ca9 tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] Request method failure captured: Oct 30 01:21:58.151988 n-d-master-1 devstack@n-api.service[121103]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 30 01:21:58.151988 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:21:58.151988 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:21:58.151988 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:21:58.151988 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 144 Oct 30 01:21:58.151988 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:21:58.151988 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:21:58.151988 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:21:58.151988 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:21:58.151988 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdGqfgZU1Lx8GJdFNShqpcNEz81pXVxjZGMWqC6jcqg9KgFMS5NUCn29JQwEV3kb5vhSMLBAB0lHtNIDpNeo8NQys6OVW3d2iNFEJJ-A2vCbFYgEbHFwqns_rHdUF7nZ_tOeXuBi6YMoDL4ixvlKuAH6Lhj0Yh6EOddq5TuuBMMGOeE Oct 30 01:21:58.151988 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:21:58.151988 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:21:58.151988 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:21:58.151988 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:21:58.151988 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:21:58.151988 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:21:58.151988 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 8fb45c128cef4500a837862a5609284f Oct 30 01:21:58.151988 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-QuotasAdminNegativeTest-224013508 Oct 30 01:21:58.151988 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:21:58.151988 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:21:58.153590 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8fb45c128cef4500a837862a5609284f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8fb45c128cef4500a837862a5609284f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8fb45c128cef4500a837862a5609284f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8fb45c128cef4500a837862a5609284f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:21:58.153590 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-QuotasAdminNegativeTest-224013508 Oct 30 01:21:58.153590 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 8fb45c128cef4500a837862a5609284f Oct 30 01:21:58.153590 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-224013508 Oct 30 01:21:58.153590 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-QuotasAdminNegativeTest-224013508-project Oct 30 01:21:58.153590 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:21:58.153590 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:21:58.153590 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 90371d04c0ad4aeba7780f85721cf7cc Oct 30 01:21:58.153590 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-QuotasAdminNegativeTest-224013508-project Oct 30 01:21:58.153590 n-d-master-1 devstack@n-api.service[121103]: Oct 30 01:21:58.153590 n-d-master-1 devstack@n-api.service[121103]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-503251172", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452"}} Oct 30 01:21:58.153590 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:21:58.159398 n-d-master-1 devstack@n-api.service[121103]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 30 01:21:58.159398 n-d-master-1 devstack@n-api.service[121103]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-503251172', 'imageRef': 'deb14158-45d8-4539-889d-ff9726d046d7', 'flavorRef': '452'}}} Oct 30 01:21:58.159398 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:21:58.159398 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:58.159398 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 30 01:21:58.159398 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 30 01:21:58.159398 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 01:21:58.159398 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 01:21:58.159398 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 30 01:21:58.159398 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc Oct 30 01:21:58.159398 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 30 01:21:58.159398 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 30 01:21:58.159398 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 01:21:58.159398 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 01:21:58.159398 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 30 01:21:58.159398 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 30 01:21:58.159398 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 30 01:21:58.159398 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 30 01:21:58.160925 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 30 01:21:58.160925 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 30 01:21:58.160925 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 30 01:21:58.160925 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:21:58.160925 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:21:58.160925 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:21:58.160925 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:58.160925 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 30 01:21:58.160925 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 30 01:21:58.160925 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 30 01:21:58.160925 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 30 01:21:58.160925 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 30 01:21:58.160925 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 30 01:21:58.160925 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 30 01:21:58.160925 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 30 01:21:58.160925 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 30 01:21:58.160925 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 30 01:21:58.160925 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 30 01:21:58.160925 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:21:58.160925 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:21:58.160925 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:21:58.162566 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:58.162566 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:21:58.162566 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:21:58.162566 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:21:58.162566 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:21:58.162566 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:21:58.162566 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:21:58.162566 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:21:58.162566 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:21:58.162566 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:21:58.162566 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:21:58.162566 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:21:58.162566 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:21:58.162566 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 30 01:21:58.162566 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 30 01:21:58.162566 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 30 01:21:58.162566 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 30 01:21:58.162566 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:21:58.162566 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:21:58.162566 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:21:58.162566 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:21:58.164595 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:21:58.164595 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:21:58.164595 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:21:58.164595 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:21:58.164595 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 30 01:21:58.164595 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:21:58.164595 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bd5a3858-012e-47b2-a67b-ce4beda60ca9 tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:21:58.164595 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bd5a3858-012e-47b2-a67b-ce4beda60ca9 tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.284558 Oct 30 01:21:58.166520 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1097/2224] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:21:56 2022] POST /compute/v2.1/servers => generated 119 bytes in 1292 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:21:58.202243 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:58.270029 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-11d63af7-c98a-4625-a1cc-a00d30e60671 tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] Action: 'create', calling method: .version_select at 0x7f44c7ebbb80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-388227693", "description": "tempest-description-167502697"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:21:58.651568 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8ac2aeab-9dc0-48e9-9bc1-93613a561c48 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2b103487-3d7a-4186-aede-cb565cd34449" status: 204 len: 0 microversion: 2.1 time: 0.609282 Oct 30 01:21:58.653510 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1128/2225] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:21:58 2022] DELETE /compute/v2.1/servers/2b103487-3d7a-4186-aede-cb565cd34449 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:21:58.674842 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-517485c7-e47d-43b2-a649-4517f305aa1e tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:21:58.675709 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-517485c7-e47d-43b2-a649-4517f305aa1e tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:21:58.689534 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-517485c7-e47d-43b2-a649-4517f305aa1e tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:58.693293 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-517485c7-e47d-43b2-a649-4517f305aa1e tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:58.693293 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-517485c7-e47d-43b2-a649-4517f305aa1e tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:58.693293 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-517485c7-e47d-43b2-a649-4517f305aa1e tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:58.693293 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-517485c7-e47d-43b2-a649-4517f305aa1e tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:58.693936 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-517485c7-e47d-43b2-a649-4517f305aa1e tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:59.377867 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-517485c7-e47d-43b2-a649-4517f305aa1e tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:59.390667 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-517485c7-e47d-43b2-a649-4517f305aa1e tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:59.395955 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-517485c7-e47d-43b2-a649-4517f305aa1e tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:21:59.406263 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-517485c7-e47d-43b2-a649-4517f305aa1e tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 200 len: 1731 microversion: 2.25 time: 0.750982 Oct 30 01:21:59.408180 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1129/2226] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:21:58 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 1731 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:21:59.425991 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-51192313-3dde-4d59-8a8e-f745cde00393 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] Action: 'update', calling method: .version_select at 0x7f44cc05bf70>, body: {"quota_set": {"instances": 10}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:21:59.707200 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51192313-3dde-4d59-8a8e-f745cde00393 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:59.707975 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51192313-3dde-4d59-8a8e-f745cde00393 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:59.708585 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51192313-3dde-4d59-8a8e-f745cde00393 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:21:59.709920 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51192313-3dde-4d59-8a8e-f745cde00393 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:21:59.710562 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51192313-3dde-4d59-8a8e-f745cde00393 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:21:59.711191 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51192313-3dde-4d59-8a8e-f745cde00393 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:00.351329 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-51192313-3dde-4d59-8a8e-f745cde00393 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/8fb45c128cef4500a837862a5609284f" status: 200 len: 329 microversion: 2.1 time: 0.938782 Oct 30 01:22:00.373100 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1130/2227] 10.222.0.13 () {60 vars in 1262 bytes} [Sun Oct 30 01:21:59 2022] PUT /compute/v2.1/os-quota-sets/8fb45c128cef4500a837862a5609284f => generated 329 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:22:00.394525 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9ca86cda-df01-4c53-aaf8-c312b0a8e5a5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:00.399375 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9ca86cda-df01-4c53-aaf8-c312b0a8e5a5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 2b103487-3d7a-4186-aede-cb565cd34449] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:00.440606 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9ca86cda-df01-4c53-aaf8-c312b0a8e5a5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:00.441115 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9ca86cda-df01-4c53-aaf8-c312b0a8e5a5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:00.441617 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9ca86cda-df01-4c53-aaf8-c312b0a8e5a5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:00.458807 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9ca86cda-df01-4c53-aaf8-c312b0a8e5a5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:00.461801 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9ca86cda-df01-4c53-aaf8-c312b0a8e5a5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:00.464228 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9ca86cda-df01-4c53-aaf8-c312b0a8e5a5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:00.507350 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-11d63af7-c98a-4625-a1cc-a00d30e60671 tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 2.312279 Oct 30 01:22:00.507350 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1098/2228] 10.222.0.13 () {60 vars in 1180 bytes} [Sun Oct 30 01:21:58 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 2315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:22:00.507350 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c6030340-cd89-4c40-aa29-6f4fea857e00 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:00.507350 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c6030340-cd89-4c40-aa29-6f4fea857e00 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:00.507350 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6030340-cd89-4c40-aa29-6f4fea857e00 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:00.508556 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6030340-cd89-4c40-aa29-6f4fea857e00 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:00.508556 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6030340-cd89-4c40-aa29-6f4fea857e00 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:00.508556 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6030340-cd89-4c40-aa29-6f4fea857e00 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:00.508556 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6030340-cd89-4c40-aa29-6f4fea857e00 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:00.509042 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6030340-cd89-4c40-aa29-6f4fea857e00 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:01.312519 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c6030340-cd89-4c40-aa29-6f4fea857e00 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:01.332263 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c6030340-cd89-4c40-aa29-6f4fea857e00 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:01.341910 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c6030340-cd89-4c40-aa29-6f4fea857e00 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:01.357717 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c6030340-cd89-4c40-aa29-6f4fea857e00 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1555 microversion: 2.91 time: 0.873270 Oct 30 01:22:01.358520 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1099/2229] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:22:00 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1555 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:22:01.381439 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0e32aace-a046-48fb-b34b-2a776614cd41 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] Calling method '.version_select at 0x7f44cc8db670>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:01.564946 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0e32aace-a046-48fb-b34b-2a776614cd41 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/8fb45c128cef4500a837862a5609284f" status: 200 len: 371 microversion: 2.1 time: 0.202456 Oct 30 01:22:01.565804 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1100/2230] 10.222.0.13 () {58 vars in 1242 bytes} [Sun Oct 30 01:22:01 2022] GET /compute/v2.1/os-quota-sets/8fb45c128cef4500a837862a5609284f => generated 371 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:22:01.582997 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3a2a48e3-206d-43d5-acc9-7e64e6d5a16f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:01.583806 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3a2a48e3-206d-43d5-acc9-7e64e6d5a16f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:01.602794 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3a2a48e3-206d-43d5-acc9-7e64e6d5a16f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:01.604415 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3a2a48e3-206d-43d5-acc9-7e64e6d5a16f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:01.605550 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3a2a48e3-206d-43d5-acc9-7e64e6d5a16f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:01.609140 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3a2a48e3-206d-43d5-acc9-7e64e6d5a16f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:01.612435 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3a2a48e3-206d-43d5-acc9-7e64e6d5a16f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:01.613109 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3a2a48e3-206d-43d5-acc9-7e64e6d5a16f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:01.899022 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3a2a48e3-206d-43d5-acc9-7e64e6d5a16f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:01.909318 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3a2a48e3-206d-43d5-acc9-7e64e6d5a16f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:01.912995 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3a2a48e3-206d-43d5-acc9-7e64e6d5a16f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:01.928284 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3a2a48e3-206d-43d5-acc9-7e64e6d5a16f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 200 len: 1663 microversion: 2.25 time: 0.360858 Oct 30 01:22:01.929372 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1101/2231] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:22:01 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 1663 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:22:01.942156 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2698fd43-eac4-4e9e-934d-18010c30d298 tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] Action: 'create', calling method: .version_select at 0x7f44cc7df670>, body: {"security_group_rule": {"parent_group_id": "047ac7a0-46dd-4387-ad1b-01fa3590ba4f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:22:02.417263 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9ca86cda-df01-4c53-aaf8-c312b0a8e5a5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:02.432383 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9ca86cda-df01-4c53-aaf8-c312b0a8e5a5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/2b103487-3d7a-4186-aede-cb565cd34449" status: 200 len: 1492 microversion: 2.1 time: 2.058009 Oct 30 01:22:02.438661 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1131/2232] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:22:00 2022] GET /compute/v2.1/servers/2b103487-3d7a-4186-aede-cb565cd34449 => generated 1492 bytes in 2065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:22:02.459070 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-c731ab6c-5902-4d5a-86ca-4c1babf43be5 req-478564d5-ea66-4e5b-a2cd-31b805e3f369 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3141e23-1b24-4315-aac8-fb785005e789", "name": "network-vif-deleted", "tag": "ec5e536f-901e-4b24-a661-499fb1eb2a1f"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:22:02.489710 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-c731ab6c-5902-4d5a-86ca-4c1babf43be5 req-478564d5-ea66-4e5b-a2cd-31b805e3f369 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:02.491260 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-c731ab6c-5902-4d5a-86ca-4c1babf43be5 req-478564d5-ea66-4e5b-a2cd-31b805e3f369 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:02.491980 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-c731ab6c-5902-4d5a-86ca-4c1babf43be5 req-478564d5-ea66-4e5b-a2cd-31b805e3f369 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:02.528900 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-c731ab6c-5902-4d5a-86ca-4c1babf43be5 req-478564d5-ea66-4e5b-a2cd-31b805e3f369 service nova] Creating event network-vif-deleted:ec5e536f-901e-4b24-a661-499fb1eb2a1f for instance f3141e23-1b24-4315-aac8-fb785005e789 on n-h1-master-1 Oct 30 01:22:02.557536 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-c731ab6c-5902-4d5a-86ca-4c1babf43be5 req-478564d5-ea66-4e5b-a2cd-31b805e3f369 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113324 Oct 30 01:22:02.560218 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1132/2233] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:22:02.568776 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-828edf9f-7914-4865-b0e3-9aab8672ee1a tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] Action: 'update', calling method: .version_select at 0x7f44cc179820>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:22:02.718418 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-828edf9f-7914-4865-b0e3-9aab8672ee1a tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:02.719146 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-828edf9f-7914-4865-b0e3-9aab8672ee1a tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:02.719808 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-828edf9f-7914-4865-b0e3-9aab8672ee1a tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:02.723549 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-828edf9f-7914-4865-b0e3-9aab8672ee1a tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:02.724713 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-828edf9f-7914-4865-b0e3-9aab8672ee1a tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:02.725410 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-828edf9f-7914-4865-b0e3-9aab8672ee1a tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:02.998582 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-828edf9f-7914-4865-b0e3-9aab8672ee1a tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/8fb45c128cef4500a837862a5609284f" status: 200 len: 325 microversion: 2.1 time: 0.429979 Oct 30 01:22:03.002227 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1133/2234] 10.222.0.13 () {60 vars in 1262 bytes} [Sun Oct 30 01:22:02 2022] PUT /compute/v2.1/os-quota-sets/8fb45c128cef4500a837862a5609284f => generated 325 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:22:03.013586 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ed649ec4-a3b5-4881-b660-24d91c444754 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:03.029107 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ed649ec4-a3b5-4881-b660-24d91c444754 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:03.051563 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed649ec4-a3b5-4881-b660-24d91c444754 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:03.052075 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed649ec4-a3b5-4881-b660-24d91c444754 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:03.052520 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed649ec4-a3b5-4881-b660-24d91c444754 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:03.061074 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed649ec4-a3b5-4881-b660-24d91c444754 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:03.064480 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed649ec4-a3b5-4881-b660-24d91c444754 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:03.064480 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed649ec4-a3b5-4881-b660-24d91c444754 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:03.335089 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ed649ec4-a3b5-4881-b660-24d91c444754 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:03.361864 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ed649ec4-a3b5-4881-b660-24d91c444754 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:03.373962 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ed649ec4-a3b5-4881-b660-24d91c444754 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:03.422855 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ed649ec4-a3b5-4881-b660-24d91c444754 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1555 microversion: 2.91 time: 0.419194 Oct 30 01:22:03.433227 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1134/2235] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:22:03 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1555 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:22:03.441152 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b4935d99-e710-436e-b18a-a8d001be223b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:03.441888 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b4935d99-e710-436e-b18a-a8d001be223b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: f3141e23-1b24-4315-aac8-fb785005e789] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:03.471388 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b4935d99-e710-436e-b18a-a8d001be223b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:03.471921 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b4935d99-e710-436e-b18a-a8d001be223b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:03.472369 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b4935d99-e710-436e-b18a-a8d001be223b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:03.473096 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b4935d99-e710-436e-b18a-a8d001be223b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:03.473585 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b4935d99-e710-436e-b18a-a8d001be223b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:03.474025 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b4935d99-e710-436e-b18a-a8d001be223b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:03.510015 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-b4935d99-e710-436e-b18a-a8d001be223b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] HTTP exception thrown: Instance f3141e23-1b24-4315-aac8-fb785005e789 could not be found. Oct 30 01:22:03.511743 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b4935d99-e710-436e-b18a-a8d001be223b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Request method failure captured: Oct 30 01:22:03.511743 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 HTTP/1.1 Oct 30 01:22:03.511743 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:22:03.511743 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:22:03.511743 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:22:03.511743 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:22:03.511743 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:22:03.511743 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:22:03.511743 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:22:03.511743 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:22:03.511743 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXc_0mq1CplEa1aPZYhbxi5TgeBxQWTmjClFo0UfdQuaAzHtvsfPo7DIwhN5B-1KrVIJgRZREDX2FdwcYtrgO-sGBBjWKIgNfqF5a_ixLdQhWHkdNNoRoBEy0QOJ0a8XcozziR4bS4aIcMvE2mkuQo7KqsWXnzNtZabfb-7ZRMd_V1QY Oct 30 01:22:03.511743 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:22:03.511743 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:22:03.511743 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:22:03.511743 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:22:03.511743 n-d-master-1 devstack@n-api.service[121102]: X-Openstack-Nova-Api-Version: 2.25 Oct 30 01:22:03.511743 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:22:03.511743 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:22:03.511743 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 301cee87901844ed94e635eca054960d Oct 30 01:22:03.511743 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1274178165 Oct 30 01:22:03.511743 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:22:03.511743 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:22:03.513843 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/301cee87901844ed94e635eca054960d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_301cee87901844ed94e635eca054960d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/301cee87901844ed94e635eca054960d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/301cee87901844ed94e635eca054960d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:22:03.513843 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1274178165 Oct 30 01:22:03.513843 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 301cee87901844ed94e635eca054960d Oct 30 01:22:03.513843 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1274178165 Oct 30 01:22:03.513843 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-LiveAutoBlockMigrationV225Test-1274178165-project Oct 30 01:22:03.513843 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:22:03.513843 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:22:03.513843 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 2096bbb8aff742b1837931e52ac1c9ae Oct 30 01:22:03.513843 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1274178165-project Oct 30 01:22:03.513843 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:22:03.513843 n-d-master-1 devstack@n-api.service[121102]: exception: Instance f3141e23-1b24-4315-aac8-fb785005e789 could not be found. Oct 30 01:22:03.513843 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'f3141e23-1b24-4315-aac8-fb785005e789'} Oct 30 01:22:03.514943 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:22:03.514943 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:22:03.514943 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:22:03.514943 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:22:03.514943 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:22:03.514943 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:22:03.514943 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:22:03.514943 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:22:03.514943 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:22:03.514943 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:22:03.514943 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3141e23-1b24-4315-aac8-fb785005e789 could not be found. Oct 30 01:22:03.514943 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:03.514943 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:22:03.514943 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:03.514943 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:22:03.514943 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:22:03.514943 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:22:03.514943 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:22:03.514943 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:22:03.514943 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:22:03.516944 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:22:03.516944 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:22:03.516944 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:22:03.516944 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:22:03.516944 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:22:03.516944 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:22:03.516944 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:22:03.516944 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3141e23-1b24-4315-aac8-fb785005e789 could not be found. Oct 30 01:22:03.516944 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:03.516944 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:22:03.516944 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:03.516944 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:22:03.516944 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:22:03.516944 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:22:03.516944 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:22:03.516944 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:22:03.516944 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3141e23-1b24-4315-aac8-fb785005e789 could not be found. Oct 30 01:22:03.516944 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:03.521280 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b4935d99-e710-436e-b18a-a8d001be223b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Returning 404 to user: Instance f3141e23-1b24-4315-aac8-fb785005e789 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:22:03.521280 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b4935d99-e710-436e-b18a-a8d001be223b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789" status: 404 len: 111 microversion: 2.25 time: 0.083017 Oct 30 01:22:03.521280 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1135/2236] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:22:03 2022] GET /compute/v2.1/servers/f3141e23-1b24-4315-aac8-fb785005e789 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:22:03.535631 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-aabaf61d-6ac0-4a9f-a837-ceda3cf38a6d tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-109567626", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:22:03.572579 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2698fd43-eac4-4e9e-934d-18010c30d298 tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.641546 Oct 30 01:22:03.580295 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1102/2237] 10.222.0.13 () {60 vars in 1195 bytes} [Sun Oct 30 01:22:01 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1650 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:22:03.593245 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-15c63817-2e5f-4776-8281-5ef9dd6ed707 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:03.593902 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-15c63817-2e5f-4776-8281-5ef9dd6ed707 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 2b103487-3d7a-4186-aede-cb565cd34449] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:03.607580 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-15c63817-2e5f-4776-8281-5ef9dd6ed707 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:03.608360 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-15c63817-2e5f-4776-8281-5ef9dd6ed707 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:03.612321 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-15c63817-2e5f-4776-8281-5ef9dd6ed707 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:03.613455 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-15c63817-2e5f-4776-8281-5ef9dd6ed707 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:03.617763 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-15c63817-2e5f-4776-8281-5ef9dd6ed707 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:03.617763 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-15c63817-2e5f-4776-8281-5ef9dd6ed707 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:03.668852 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-aabaf61d-6ac0-4a9f-a837-ceda3cf38a6d tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] validate_networks() for None {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:22:03.690115 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-15c63817-2e5f-4776-8281-5ef9dd6ed707 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:03.697792 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-15c63817-2e5f-4776-8281-5ef9dd6ed707 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:03.698274 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-15c63817-2e5f-4776-8281-5ef9dd6ed707 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:03.698937 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-15c63817-2e5f-4776-8281-5ef9dd6ed707 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lazy-loading 'fault' on Instance uuid 2b103487-3d7a-4186-aede-cb565cd34449 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:22:03.827513 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-15c63817-2e5f-4776-8281-5ef9dd6ed707 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:03.845093 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-15c63817-2e5f-4776-8281-5ef9dd6ed707 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/2b103487-3d7a-4186-aede-cb565cd34449" status: 200 len: 1304 microversion: 2.1 time: 0.263599 Oct 30 01:22:03.846040 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1103/2238] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:22:03 2022] GET /compute/v2.1/servers/2b103487-3d7a-4186-aede-cb565cd34449 => generated 1304 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:22:03.851244 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a8c33a66-b55d-43de-add9-ef59fd9bbd5f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '.version_select at 0x7f44cc1eb820>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:03.954375 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a8c33a66-b55d-43de-add9-ef59fd9bbd5f tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1016787881" status: 204 len: 0 microversion: 2.25 time: 0.107249 Oct 30 01:22:03.958302 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1104/2239] 10.222.0.13 () {60 vars in 1262 bytes} [Sun Oct 30 01:22:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1016787881 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 30 01:22:03.959843 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-adb8d5d9-5f48-4800-8c00-bae69f48bb63 tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] Action: 'create', calling method: .version_select at 0x7f44c7ea7310>, body: {"security_group_rule": {"parent_group_id": "047ac7a0-46dd-4387-ad1b-01fa3590ba4f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:22:04.375468 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-adb8d5d9-5f48-4800-8c00-bae69f48bb63 tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] HTTP exception thrown: This rule already exists in group 047ac7a0-46dd-4387-ad1b-01fa3590ba4f Oct 30 01:22:04.378347 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-adb8d5d9-5f48-4800-8c00-bae69f48bb63 tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] Request method failure captured: Oct 30 01:22:04.378347 n-d-master-1 devstack@n-api.service[121103]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 30 01:22:04.378347 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:22:04.378347 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:22:04.378347 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:22:04.378347 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 138 Oct 30 01:22:04.378347 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:22:04.378347 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:22:04.378347 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:22:04.378347 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:22:04.378347 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdG1eX1lJtxupxoFo_uXBMSOlKRWj_He6cmW6d6HLx8S7gxARQTzSPTrf8LFy3GTD6B5mNWg7R0771Al8DAD_gzGcHY1zp6jHUSyeGUpsuEWNzxsVuG_I-dIqTCm8V7WINBe5dwfdHhRcRs7J16UBINwMNt_jWZhTfSUoyeJF62jdk0 Oct 30 01:22:04.378347 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:22:04.378347 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:22:04.378347 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:22:04.378347 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:22:04.378347 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:22:04.378347 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:22:04.378347 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 6cd2df29276f4bcdbf3329c684d5086a Oct 30 01:22:04.378347 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1000406765 Oct 30 01:22:04.378347 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:22:04.378347 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:22:04.380372 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6cd2df29276f4bcdbf3329c684d5086a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6cd2df29276f4bcdbf3329c684d5086a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6cd2df29276f4bcdbf3329c684d5086a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6cd2df29276f4bcdbf3329c684d5086a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:22:04.380372 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1000406765 Oct 30 01:22:04.380372 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 6cd2df29276f4bcdbf3329c684d5086a Oct 30 01:22:04.380372 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1000406765 Oct 30 01:22:04.380372 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project Oct 30 01:22:04.380372 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:22:04.380372 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:22:04.380372 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 4f1e4052cfb4446b9c89288f8fc7e76c Oct 30 01:22:04.380372 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project Oct 30 01:22:04.380372 n-d-master-1 devstack@n-api.service[121103]: Oct 30 01:22:04.380372 n-d-master-1 devstack@n-api.service[121103]: {"security_group_rule": {"parent_group_id": "047ac7a0-46dd-4387-ad1b-01fa3590ba4f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 30 01:22:04.380372 n-d-master-1 devstack@n-api.service[121103]: method: Oct 30 01:22:04.381476 n-d-master-1 devstack@n-api.service[121103]: exception: This rule already exists in group 047ac7a0-46dd-4387-ad1b-01fa3590ba4f Oct 30 01:22:04.381476 n-d-master-1 devstack@n-api.service[121103]: action_args: {'body': {'security_group_rule': {'parent_group_id': '047ac7a0-46dd-4387-ad1b-01fa3590ba4f', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 30 01:22:04.381476 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:22:04.381476 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:22:04.381476 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 30 01:22:04.381476 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 30 01:22:04.381476 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 30 01:22:04.381476 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 30 01:22:04.381476 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 047ac7a0-46dd-4387-ad1b-01fa3590ba4f Oct 30 01:22:04.381476 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:22:04.381476 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:22:04.381476 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:22:04.381476 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:22:04.381476 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:22:04.381476 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:22:04.381476 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:22:04.381476 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:22:04.381476 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:22:04.381476 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:22:04.381476 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:22:04.383328 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:22:04.383328 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 30 01:22:04.383328 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 30 01:22:04.383328 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 047ac7a0-46dd-4387-ad1b-01fa3590ba4f Oct 30 01:22:04.383328 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:22:04.383328 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:22:04.383328 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:22:04.383328 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:22:04.383328 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:22:04.383328 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:22:04.383328 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:22:04.383328 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:22:04.383328 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 047ac7a0-46dd-4387-ad1b-01fa3590ba4f Oct 30 01:22:04.383328 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:22:04.385482 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-adb8d5d9-5f48-4800-8c00-bae69f48bb63 tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] Returning 400 to user: This rule already exists in group 047ac7a0-46dd-4387-ad1b-01fa3590ba4f {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:22:04.386980 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-adb8d5d9-5f48-4800-8c00-bae69f48bb63 tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.430931 Oct 30 01:22:04.387762 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1105/2240] 10.222.0.13 () {60 vars in 1195 bytes} [Sun Oct 30 01:22:03 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 432 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:22:04.422865 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4a24857b-a12d-44ce-9823-1a7111b704a5 tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] Calling method '.version_select at 0x7f44c7d385e0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:04.840123 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-aabaf61d-6ac0-4a9f-a837-ceda3cf38a6d tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:22:04.841774 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-aabaf61d-6ac0-4a9f-a837-ceda3cf38a6d tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:22:04.842535 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-aabaf61d-6ac0-4a9f-a837-ceda3cf38a6d tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:22:04.843717 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-aabaf61d-6ac0-4a9f-a837-ceda3cf38a6d tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:22:04.844396 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-aabaf61d-6ac0-4a9f-a837-ceda3cf38a6d tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:22:04.867732 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aabaf61d-6ac0-4a9f-a837-ceda3cf38a6d tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:04.868363 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aabaf61d-6ac0-4a9f-a837-ceda3cf38a6d tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:04.871208 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aabaf61d-6ac0-4a9f-a837-ceda3cf38a6d tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:04.888047 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aabaf61d-6ac0-4a9f-a837-ceda3cf38a6d tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:04.889970 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aabaf61d-6ac0-4a9f-a837-ceda3cf38a6d tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:04.891473 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aabaf61d-6ac0-4a9f-a837-ceda3cf38a6d tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:04.979411 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-aabaf61d-6ac0-4a9f-a837-ceda3cf38a6d tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] Getting quotas for project 8fb45c128cef4500a837862a5609284f. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:22:05.007826 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-aabaf61d-6ac0-4a9f-a837-ceda3cf38a6d tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] Getting quotas for user 90371d04c0ad4aeba7780f85721cf7cc and project 8fb45c128cef4500a837862a5609284f. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:22:05.068264 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.utils [None req-aabaf61d-6ac0-4a9f-a837-ceda3cf38a6d tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] ram quota exceeded for 8fb45c128cef4500a837862a5609284f, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=121102) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 30 01:22:05.071175 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-aabaf61d-6ac0-4a9f-a837-ceda3cf38a6d tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 30 01:22:05.078264 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-aabaf61d-6ac0-4a9f-a837-ceda3cf38a6d tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] Request method failure captured: Oct 30 01:22:05.078264 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 30 01:22:05.078264 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:22:05.078264 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:22:05.078264 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:22:05.078264 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 144 Oct 30 01:22:05.078264 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:22:05.078264 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:22:05.078264 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:22:05.078264 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:22:05.078264 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdGqfgZU1Lx8GJdFNShqpcNEz81pXVxjZGMWqC6jcqg9KgFMS5NUCn29JQwEV3kb5vhSMLBAB0lHtNIDpNeo8NQys6OVW3d2iNFEJJ-A2vCbFYgEbHFwqns_rHdUF7nZ_tOeXuBi6YMoDL4ixvlKuAH6Lhj0Yh6EOddq5TuuBMMGOeE Oct 30 01:22:05.078264 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:22:05.078264 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:22:05.078264 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:22:05.078264 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:22:05.078264 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:22:05.078264 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:22:05.078264 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 8fb45c128cef4500a837862a5609284f Oct 30 01:22:05.078264 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-QuotasAdminNegativeTest-224013508 Oct 30 01:22:05.078264 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:22:05.078264 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:22:05.082888 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8fb45c128cef4500a837862a5609284f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8fb45c128cef4500a837862a5609284f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8fb45c128cef4500a837862a5609284f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8fb45c128cef4500a837862a5609284f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:22:05.082888 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-QuotasAdminNegativeTest-224013508 Oct 30 01:22:05.082888 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 8fb45c128cef4500a837862a5609284f Oct 30 01:22:05.082888 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-224013508 Oct 30 01:22:05.082888 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-QuotasAdminNegativeTest-224013508-project Oct 30 01:22:05.082888 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:22:05.082888 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:22:05.082888 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 90371d04c0ad4aeba7780f85721cf7cc Oct 30 01:22:05.082888 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-QuotasAdminNegativeTest-224013508-project Oct 30 01:22:05.082888 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:22:05.082888 n-d-master-1 devstack@n-api.service[121102]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-109567626", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452"}} Oct 30 01:22:05.082888 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:22:05.084334 n-d-master-1 devstack@n-api.service[121102]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 30 01:22:05.084334 n-d-master-1 devstack@n-api.service[121102]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-109567626', 'imageRef': 'deb14158-45d8-4539-889d-ff9726d046d7', 'flavorRef': '452'}}} Oct 30 01:22:05.084334 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:22:05.084334 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:22:05.084334 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 30 01:22:05.084334 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 30 01:22:05.084334 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 01:22:05.084334 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 01:22:05.084334 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 30 01:22:05.084334 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc Oct 30 01:22:05.084334 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 30 01:22:05.084334 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 30 01:22:05.084334 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 01:22:05.084334 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 01:22:05.084334 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 30 01:22:05.084334 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 30 01:22:05.084334 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 30 01:22:05.084334 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 30 01:22:05.086075 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 30 01:22:05.086075 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 30 01:22:05.086075 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 30 01:22:05.086075 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:05.086075 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:22:05.086075 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:05.086075 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:22:05.086075 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 30 01:22:05.086075 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 30 01:22:05.086075 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 30 01:22:05.086075 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 30 01:22:05.086075 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 30 01:22:05.086075 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 30 01:22:05.086075 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 30 01:22:05.086075 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 30 01:22:05.086075 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 30 01:22:05.086075 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 30 01:22:05.086075 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 30 01:22:05.086075 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:05.086075 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:22:05.086075 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:05.088049 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:22:05.088049 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:22:05.088049 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:22:05.088049 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:22:05.088049 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:22:05.088049 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:22:05.088049 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:22:05.088049 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:22:05.088049 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:22:05.088049 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:22:05.088049 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:22:05.088049 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:22:05.088049 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:22:05.088049 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 30 01:22:05.088049 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 30 01:22:05.088049 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 30 01:22:05.088049 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 30 01:22:05.088049 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:05.088049 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:22:05.088049 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:05.088049 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:22:05.090063 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:22:05.090063 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:22:05.090063 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:22:05.090063 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:22:05.090063 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 30 01:22:05.090063 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:05.090063 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-aabaf61d-6ac0-4a9f-a837-ceda3cf38a6d tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:22:05.091847 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-aabaf61d-6ac0-4a9f-a837-ceda3cf38a6d tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 1.565345 Oct 30 01:22:05.106409 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1136/2241] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:22:03 2022] POST /compute/v2.1/servers => generated 110 bytes in 1588 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:22:05.112219 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8977c721-5e32-499f-a641-fa08bb3e235d tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:05.120336 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8977c721-5e32-499f-a641-fa08bb3e235d tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:05.131684 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8977c721-5e32-499f-a641-fa08bb3e235d tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:05.135756 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8977c721-5e32-499f-a641-fa08bb3e235d tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:05.138888 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8977c721-5e32-499f-a641-fa08bb3e235d tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:05.138888 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8977c721-5e32-499f-a641-fa08bb3e235d tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:05.138888 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8977c721-5e32-499f-a641-fa08bb3e235d tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:05.138888 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8977c721-5e32-499f-a641-fa08bb3e235d tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:05.435127 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8977c721-5e32-499f-a641-fa08bb3e235d tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:05.454486 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8977c721-5e32-499f-a641-fa08bb3e235d tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:05.461990 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8977c721-5e32-499f-a641-fa08bb3e235d tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:05.487247 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8977c721-5e32-499f-a641-fa08bb3e235d tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1555 microversion: 2.91 time: 0.377228 Oct 30 01:22:05.495079 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1137/2242] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:22:05 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1555 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:22:05.503128 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-c19cd464-e9e4-4155-9119-6c5a7fecac8d req-eaa367ef-f516-4ffd-ba0b-252f5c570640 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b103487-3d7a-4186-aede-cb565cd34449", "name": "network-vif-deleted", "tag": "164b70a4-3958-4932-91b3-cc105285c757"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:22:05.529897 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-c19cd464-e9e4-4155-9119-6c5a7fecac8d req-eaa367ef-f516-4ffd-ba0b-252f5c570640 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:05.530636 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-c19cd464-e9e4-4155-9119-6c5a7fecac8d req-eaa367ef-f516-4ffd-ba0b-252f5c570640 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:05.536056 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-c19cd464-e9e4-4155-9119-6c5a7fecac8d req-eaa367ef-f516-4ffd-ba0b-252f5c570640 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:05.566351 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-c19cd464-e9e4-4155-9119-6c5a7fecac8d req-eaa367ef-f516-4ffd-ba0b-252f5c570640 service nova] Creating event network-vif-deleted:164b70a4-3958-4932-91b3-cc105285c757 for instance 2b103487-3d7a-4186-aede-cb565cd34449 on n-h1-master-1 Oct 30 01:22:05.582239 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-c19cd464-e9e4-4155-9119-6c5a7fecac8d req-eaa367ef-f516-4ffd-ba0b-252f5c570640 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084591 Oct 30 01:22:05.584030 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1138/2243] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:22:05.604715 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9552de01-29bd-4986-ab96-ed71bfbbf183 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:05.606214 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9552de01-29bd-4986-ab96-ed71bfbbf183 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 2b103487-3d7a-4186-aede-cb565cd34449] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:05.645162 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9552de01-29bd-4986-ab96-ed71bfbbf183 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:05.645975 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9552de01-29bd-4986-ab96-ed71bfbbf183 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:05.646727 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9552de01-29bd-4986-ab96-ed71bfbbf183 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:05.647819 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9552de01-29bd-4986-ab96-ed71bfbbf183 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:05.648882 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9552de01-29bd-4986-ab96-ed71bfbbf183 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:05.649619 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9552de01-29bd-4986-ab96-ed71bfbbf183 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:05.673869 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-9552de01-29bd-4986-ab96-ed71bfbbf183 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] HTTP exception thrown: Instance 2b103487-3d7a-4186-aede-cb565cd34449 could not be found. Oct 30 01:22:05.676109 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9552de01-29bd-4986-ab96-ed71bfbbf183 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Request method failure captured: Oct 30 01:22:05.676109 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/2b103487-3d7a-4186-aede-cb565cd34449 HTTP/1.1 Oct 30 01:22:05.676109 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:22:05.676109 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:22:05.676109 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:22:05.676109 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:22:05.676109 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:22:05.676109 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:22:05.676109 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:22:05.676109 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:22:05.676109 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdEZHAwNEyYVN8mbZetD1IgknrDb-nJfmTHtgPgtOr9AeQL99EuTYclSviV8aikzXcemJ-XkTVClxHn6U4xG48gAdXZcIs0fYa7Kdvvi7PzFjDxYMfOtgAp7wAvvVW7kd-J_XMzQX3yJBWm7NW5-QhmguztBnHz9UniQWs2CmNftHaI Oct 30 01:22:05.676109 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:22:05.676109 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:22:05.676109 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:22:05.676109 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:22:05.676109 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:22:05.676109 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:22:05.676109 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 8c95e97cd7e4461682b9028abb568dce Oct 30 01:22:05.676109 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:22:05.676109 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:22:05.676109 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:22:05.677877 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:22:05.677877 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:22:05.677877 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 8c95e97cd7e4461682b9028abb568dce Oct 30 01:22:05.677877 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:22:05.677877 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-DeleteServersTestJSON-1379968241-project Oct 30 01:22:05.677877 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:22:05.677877 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:22:05.677877 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 33691c943ec040ddb04b6648b6e945ab Oct 30 01:22:05.677877 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-DeleteServersTestJSON-1379968241-project Oct 30 01:22:05.677877 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:22:05.677877 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 2b103487-3d7a-4186-aede-cb565cd34449 could not be found. Oct 30 01:22:05.677877 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '2b103487-3d7a-4186-aede-cb565cd34449'} Oct 30 01:22:05.678849 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:22:05.678849 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:22:05.678849 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:22:05.678849 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:22:05.678849 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:22:05.678849 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:22:05.678849 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:22:05.678849 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:22:05.678849 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:22:05.678849 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:22:05.678849 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b103487-3d7a-4186-aede-cb565cd34449 could not be found. Oct 30 01:22:05.678849 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:05.678849 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:22:05.678849 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:05.678849 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:22:05.678849 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:22:05.678849 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:22:05.678849 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:22:05.678849 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:22:05.678849 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:22:05.680284 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:22:05.680284 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:22:05.680284 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:22:05.680284 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:22:05.680284 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:22:05.680284 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:22:05.680284 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:22:05.680284 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b103487-3d7a-4186-aede-cb565cd34449 could not be found. Oct 30 01:22:05.680284 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:05.680284 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:22:05.680284 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:05.680284 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:22:05.680284 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:22:05.680284 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:22:05.680284 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:22:05.680284 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:22:05.680284 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b103487-3d7a-4186-aede-cb565cd34449 could not be found. Oct 30 01:22:05.680284 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:05.686999 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9552de01-29bd-4986-ab96-ed71bfbbf183 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Returning 404 to user: Instance 2b103487-3d7a-4186-aede-cb565cd34449 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:22:05.688332 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9552de01-29bd-4986-ab96-ed71bfbbf183 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/2b103487-3d7a-4186-aede-cb565cd34449" status: 404 len: 111 microversion: 2.1 time: 0.102785 Oct 30 01:22:05.689488 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1139/2244] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:22:05 2022] GET /compute/v2.1/servers/2b103487-3d7a-4186-aede-cb565cd34449 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:22:05.698903 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6f892c58-d00b-4fa7-8ca3-09f3f2bcca31 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] Action: 'update', calling method: .version_select at 0x7f44cca66f70>, body: {"quota_set": {"ram": 51200}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:22:05.930941 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:22:05.951502 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6f892c58-d00b-4fa7-8ca3-09f3f2bcca31 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:05.952595 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6f892c58-d00b-4fa7-8ca3-09f3f2bcca31 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:05.959062 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6f892c58-d00b-4fa7-8ca3-09f3f2bcca31 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:05.962315 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6f892c58-d00b-4fa7-8ca3-09f3f2bcca31 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:05.964840 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6f892c58-d00b-4fa7-8ca3-09f3f2bcca31 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:05.966283 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6f892c58-d00b-4fa7-8ca3-09f3f2bcca31 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:06.365396 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6f892c58-d00b-4fa7-8ca3-09f3f2bcca31 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/8fb45c128cef4500a837862a5609284f" status: 200 len: 329 microversion: 2.1 time: 0.674480 Oct 30 01:22:06.381431 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1140/2245] 10.222.0.13 () {60 vars in 1262 bytes} [Sun Oct 30 01:22:05 2022] PUT /compute/v2.1/os-quota-sets/8fb45c128cef4500a837862a5609284f => generated 329 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:22:06.405849 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1fdd7417-0af6-4d4c-b323-bf71b9f4065d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-814783943", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "19e0e4e2-b502-4a02-810a-996c246e8c64"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:22:06.549472 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-1fdd7417-0af6-4d4c-b323-bf71b9f4065d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] validate_networks() for [('19e0e4e2-b502-4a02-810a-996c246e8c64', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:22:06.588179 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4a24857b-a12d-44ce-9823-1a7111b704a5 tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-group-rules/c4615072-d9d6-4db8-aa2d-6a5de713c178" status: 202 len: 0 microversion: 2.1 time: 2.192998 Oct 30 01:22:06.589606 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1106/2246] 10.222.0.13 () {58 vars in 1287 bytes} [Sun Oct 30 01:22:04 2022] DELETE /compute/v2.1/os-security-group-rules/c4615072-d9d6-4db8-aa2d-6a5de713c178 => generated 0 bytes in 2198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 30 01:22:06.601318 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-944464c2-d644-46c0-b3a9-7a95c4d1d23d tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] Action: 'update', calling method: .version_select at 0x7f44cc631c10>, body: {"quota_set": {"ram": 0}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:22:06.608952 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-944464c2-d644-46c0-b3a9-7a95c4d1d23d tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '90371d04c0ad4aeba7780f85721cf7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb45c128cef4500a837862a5609284f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:06.614011 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-944464c2-d644-46c0-b3a9-7a95c4d1d23d tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] Request method failure captured: Oct 30 01:22:06.614011 n-d-master-1 devstack@n-api.service[121103]: request: PUT /compute/v2.1/os-quota-sets/8fb45c128cef4500a837862a5609284f HTTP/1.1 Oct 30 01:22:06.614011 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:22:06.614011 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:22:06.614011 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:22:06.614011 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 25 Oct 30 01:22:06.614011 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:22:06.614011 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:22:06.614011 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:22:06.614011 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:22:06.614011 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdGqfgZU1Lx8GJdFNShqpcNEz81pXVxjZGMWqC6jcqg9KgFMS5NUCn29JQwEV3kb5vhSMLBAB0lHtNIDpNeo8NQys6OVW3d2iNFEJJ-A2vCbFYgEbHFwqns_rHdUF7nZ_tOeXuBi6YMoDL4ixvlKuAH6Lhj0Yh6EOddq5TuuBMMGOeE Oct 30 01:22:06.614011 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:22:06.614011 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:22:06.614011 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:22:06.614011 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:22:06.614011 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:22:06.614011 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:22:06.614011 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 8fb45c128cef4500a837862a5609284f Oct 30 01:22:06.614011 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-QuotasAdminNegativeTest-224013508 Oct 30 01:22:06.614011 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:22:06.614011 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:22:06.616574 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8fb45c128cef4500a837862a5609284f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8fb45c128cef4500a837862a5609284f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8fb45c128cef4500a837862a5609284f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8fb45c128cef4500a837862a5609284f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:22:06.616574 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-QuotasAdminNegativeTest-224013508 Oct 30 01:22:06.616574 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 8fb45c128cef4500a837862a5609284f Oct 30 01:22:06.616574 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-224013508 Oct 30 01:22:06.616574 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-QuotasAdminNegativeTest-224013508-project Oct 30 01:22:06.616574 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:22:06.616574 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:22:06.616574 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 90371d04c0ad4aeba7780f85721cf7cc Oct 30 01:22:06.616574 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-QuotasAdminNegativeTest-224013508-project Oct 30 01:22:06.616574 n-d-master-1 devstack@n-api.service[121103]: Oct 30 01:22:06.616574 n-d-master-1 devstack@n-api.service[121103]: {"quota_set": {"ram": 0}} Oct 30 01:22:06.616574 n-d-master-1 devstack@n-api.service[121103]: method: Oct 30 01:22:06.616574 n-d-master-1 devstack@n-api.service[121103]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 30 01:22:06.616574 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '8fb45c128cef4500a837862a5609284f', 'body': {'quota_set': {'ram': 0}}} Oct 30 01:22:06.618493 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:22:06.618493 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:22:06.618493 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:22:06.618493 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:22:06.618493 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:22:06.618493 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:22:06.618493 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:22:06.618493 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:22:06.618493 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:22:06.618493 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:22:06.618493 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:22:06.618493 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:22:06.618493 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 30 01:22:06.618493 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 30 01:22:06.618493 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 30 01:22:06.618493 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:22:06.618493 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 30 01:22:06.618493 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:22:06.618493 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 30 01:22:06.621141 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 30 01:22:06.621141 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 30 01:22:06.621141 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 30 01:22:06.621141 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 30 01:22:06.621141 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 30 01:22:06.621141 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 01:22:06.621141 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 30 01:22:06.621141 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 01:22:06.621141 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise self.value Oct 30 01:22:06.621141 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 30 01:22:06.621141 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 30 01:22:06.621141 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 30 01:22:06.621141 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 30 01:22:06.621141 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 30 01:22:06.621141 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 30 01:22:06.621141 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 30 01:22:06.621141 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:22:06.621141 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:22:06.621141 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:22:06.621141 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:22:06.624137 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:22:06.624137 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:22:06.624137 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 30 01:22:06.624137 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 30 01:22:06.624137 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 30 01:22:06.624137 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:22:06.634848 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-944464c2-d644-46c0-b3a9-7a95c4d1d23d tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:22:06.639186 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-944464c2-d644-46c0-b3a9-7a95c4d1d23d tempest-QuotasAdminNegativeTest-224013508 tempest-QuotasAdminNegativeTest-224013508-project] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/8fb45c128cef4500a837862a5609284f" status: 403 len: 116 microversion: 2.1 time: 0.046844 Oct 30 01:22:06.641264 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1107/2247] 10.222.0.13 () {60 vars in 1262 bytes} [Sun Oct 30 01:22:06 2022] PUT /compute/v2.1/os-quota-sets/8fb45c128cef4500a837862a5609284f => generated 116 bytes in 51 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:22:06.652911 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-19e37267-f5cb-4a2b-9341-63f5b9dd8ee6 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:06.654591 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-19e37267-f5cb-4a2b-9341-63f5b9dd8ee6 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:06.679338 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-19e37267-f5cb-4a2b-9341-63f5b9dd8ee6 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:06.682460 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-19e37267-f5cb-4a2b-9341-63f5b9dd8ee6 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:06.683230 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-19e37267-f5cb-4a2b-9341-63f5b9dd8ee6 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:06.684377 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-19e37267-f5cb-4a2b-9341-63f5b9dd8ee6 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:06.685826 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-19e37267-f5cb-4a2b-9341-63f5b9dd8ee6 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:06.686688 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-19e37267-f5cb-4a2b-9341-63f5b9dd8ee6 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:07.015566 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-19e37267-f5cb-4a2b-9341-63f5b9dd8ee6 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:07.039042 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-19e37267-f5cb-4a2b-9341-63f5b9dd8ee6 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:07.041192 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-19e37267-f5cb-4a2b-9341-63f5b9dd8ee6 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:07.047895 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-19e37267-f5cb-4a2b-9341-63f5b9dd8ee6 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1555 microversion: 2.91 time: 0.405263 Oct 30 01:22:07.069372 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1108/2248] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:22:06 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1555 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:22:07.069372 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1a1dae67-86b1-47b1-bf83-e8069ea10a87 tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] Action: 'create', calling method: .version_select at 0x7f44cc3c88b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1422501818", "description": "tempest-description-125532886"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:22:07.823541 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-1fdd7417-0af6-4d4c-b323-bf71b9f4065d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:22:07.824056 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-1fdd7417-0af6-4d4c-b323-bf71b9f4065d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:22:07.824961 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-1fdd7417-0af6-4d4c-b323-bf71b9f4065d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:22:07.824961 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-1fdd7417-0af6-4d4c-b323-bf71b9f4065d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:22:07.825297 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-1fdd7417-0af6-4d4c-b323-bf71b9f4065d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:22:07.851695 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1fdd7417-0af6-4d4c-b323-bf71b9f4065d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:07.853995 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1fdd7417-0af6-4d4c-b323-bf71b9f4065d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:07.855882 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1fdd7417-0af6-4d4c-b323-bf71b9f4065d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:07.859586 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1fdd7417-0af6-4d4c-b323-bf71b9f4065d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:07.860788 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1fdd7417-0af6-4d4c-b323-bf71b9f4065d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:07.863323 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1fdd7417-0af6-4d4c-b323-bf71b9f4065d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:07.920517 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1a1dae67-86b1-47b1-bf83-e8069ea10a87 tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.863744 Oct 30 01:22:07.923426 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1109/2249] 10.222.0.13 () {60 vars in 1180 bytes} [Sun Oct 30 01:22:07 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:22:07.928893 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-082da482-08fe-4f62-a15b-70e42ef6ae93 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:07.929605 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-082da482-08fe-4f62-a15b-70e42ef6ae93 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 3f60e45a-0e20-4280-be86-275d598fd552] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:07.951266 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-1fdd7417-0af6-4d4c-b323-bf71b9f4065d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Getting quotas for project 8c95e97cd7e4461682b9028abb568dce. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:22:07.951976 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-082da482-08fe-4f62-a15b-70e42ef6ae93 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:07.954751 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-082da482-08fe-4f62-a15b-70e42ef6ae93 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:07.955336 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-082da482-08fe-4f62-a15b-70e42ef6ae93 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:07.960202 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-082da482-08fe-4f62-a15b-70e42ef6ae93 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:07.961437 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-082da482-08fe-4f62-a15b-70e42ef6ae93 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:07.963119 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-082da482-08fe-4f62-a15b-70e42ef6ae93 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:07.972979 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-1fdd7417-0af6-4d4c-b323-bf71b9f4065d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Getting quotas for user 33691c943ec040ddb04b6648b6e945ab and project 8c95e97cd7e4461682b9028abb568dce. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:22:07.995773 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:22:08.042375 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1fdd7417-0af6-4d4c-b323-bf71b9f4065d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:22:08.044740 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1fdd7417-0af6-4d4c-b323-bf71b9f4065d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7f629426-c4e6-4c3f-8e54-efd452d14dd7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:22:08.069856 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=4 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:22:08.081266 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-082da482-08fe-4f62-a15b-70e42ef6ae93 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 3f60e45a-0e20-4280-be86-275d598fd552] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:22:08.284780 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1fdd7417-0af6-4d4c-b323-bf71b9f4065d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.901695 Oct 30 01:22:08.294877 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1141/2250] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:22:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1907 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:22:08.312375 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e9490b43-586d-48d1-962e-5ec093696ea1 tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] Action: 'create', calling method: .version_select at 0x7f44cc7f5ca0>, body: {"security_group_rule": {"parent_group_id": "40fffad4-2972-45d7-80cb-72a91f87d005", "ip_protocol": "tcp", "from_port": 1253273506, "to_port": 22}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:22:08.557931 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-e9490b43-586d-48d1-962e-5ec093696ea1 tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] HTTP exception thrown: Invalid port range 1253273506:22. Former value cannot be greater than the later Oct 30 01:22:08.559833 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e9490b43-586d-48d1-962e-5ec093696ea1 tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] Request method failure captured: Oct 30 01:22:08.559833 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 30 01:22:08.559833 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:22:08.559833 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:22:08.559833 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:22:08.559833 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 146 Oct 30 01:22:08.559833 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:22:08.559833 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:22:08.559833 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:22:08.559833 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:22:08.559833 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdG1eX1lJtxupxoFo_uXBMSOlKRWj_He6cmW6d6HLx8S7gxARQTzSPTrf8LFy3GTD6B5mNWg7R0771Al8DAD_gzGcHY1zp6jHUSyeGUpsuEWNzxsVuG_I-dIqTCm8V7WINBe5dwfdHhRcRs7J16UBINwMNt_jWZhTfSUoyeJF62jdk0 Oct 30 01:22:08.559833 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:22:08.559833 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:22:08.559833 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:22:08.559833 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:22:08.559833 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:22:08.559833 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:22:08.559833 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 6cd2df29276f4bcdbf3329c684d5086a Oct 30 01:22:08.559833 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1000406765 Oct 30 01:22:08.559833 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:22:08.559833 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:22:08.561713 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6cd2df29276f4bcdbf3329c684d5086a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6cd2df29276f4bcdbf3329c684d5086a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6cd2df29276f4bcdbf3329c684d5086a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6cd2df29276f4bcdbf3329c684d5086a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:22:08.561713 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1000406765 Oct 30 01:22:08.561713 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 6cd2df29276f4bcdbf3329c684d5086a Oct 30 01:22:08.561713 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1000406765 Oct 30 01:22:08.561713 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project Oct 30 01:22:08.561713 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:22:08.561713 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:22:08.561713 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 4f1e4052cfb4446b9c89288f8fc7e76c Oct 30 01:22:08.561713 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project Oct 30 01:22:08.561713 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:22:08.561713 n-d-master-1 devstack@n-api.service[121102]: {"security_group_rule": {"parent_group_id": "40fffad4-2972-45d7-80cb-72a91f87d005", "ip_protocol": "tcp", "from_port": 1253273506, "to_port": 22}} Oct 30 01:22:08.561713 n-d-master-1 devstack@n-api.service[121102]: method: Oct 30 01:22:08.562591 n-d-master-1 devstack@n-api.service[121102]: exception: Invalid port range 1253273506:22. Former value cannot be greater than the later Oct 30 01:22:08.562591 n-d-master-1 devstack@n-api.service[121102]: action_args: {'body': {'security_group_rule': {'parent_group_id': '40fffad4-2972-45d7-80cb-72a91f87d005', 'ip_protocol': 'tcp', 'from_port': 1253273506, 'to_port': 22}}} Oct 30 01:22:08.562591 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:22:08.562591 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:22:08.562591 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 30 01:22:08.562591 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 30 01:22:08.562591 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 30 01:22:08.562591 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 30 01:22:08.562591 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 30 01:22:08.562591 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 30 01:22:08.562591 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 30 01:22:08.562591 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 30 01:22:08.562591 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1253273506:22. Former value cannot be greater than the later Oct 30 01:22:08.562591 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:08.562591 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:22:08.562591 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:08.562591 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:22:08.562591 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:22:08.562591 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:22:08.563973 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:22:08.563973 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:22:08.563973 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:22:08.563973 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:22:08.563973 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:22:08.563973 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:22:08.563973 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 30 01:22:08.563973 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 30 01:22:08.563973 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1253273506:22. Former value cannot be greater than the later Oct 30 01:22:08.563973 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:08.563973 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:22:08.563973 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:08.563973 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:22:08.563973 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:22:08.563973 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:22:08.563973 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:22:08.563973 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:22:08.563973 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1253273506:22. Former value cannot be greater than the later Oct 30 01:22:08.563973 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:08.565315 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e9490b43-586d-48d1-962e-5ec093696ea1 tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] Returning 400 to user: Invalid port range 1253273506:22. Former value cannot be greater than the later {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:22:08.565315 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e9490b43-586d-48d1-962e-5ec093696ea1 tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.264906 Oct 30 01:22:08.565315 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1142/2251] 10.222.0.13 () {60 vars in 1195 bytes} [Sun Oct 30 01:22:08 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 266 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:22:08.566389 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3a7e1d4e-452c-4610-b71c-c08facd6837d tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:08.581151 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3a7e1d4e-452c-4610-b71c-c08facd6837d tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:08.595757 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-082da482-08fe-4f62-a15b-70e42ef6ae93 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552" status: 204 len: 0 microversion: 2.25 time: 0.669170 Oct 30 01:22:08.596472 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1110/2252] 10.222.0.13 () {60 vars in 1280 bytes} [Sun Oct 30 01:22:07 2022] DELETE /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 30 01:22:08.605571 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a7e1d4e-452c-4610-b71c-c08facd6837d tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:08.606088 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a7e1d4e-452c-4610-b71c-c08facd6837d tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:08.606535 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a7e1d4e-452c-4610-b71c-c08facd6837d tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:08.607249 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a7e1d4e-452c-4610-b71c-c08facd6837d tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:08.607707 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a7e1d4e-452c-4610-b71c-c08facd6837d tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:08.608149 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a7e1d4e-452c-4610-b71c-c08facd6837d tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:08.609663 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b9361486-6b53-4614-9d2a-4de0c0372d09 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "b5a4c18a-7b67-4af5-ac68-f08c73e0283e"}], "security_groups": [{"name": "tempest-securitygroup--2021234285"}], "key_name": "tempest-keypair-12148639", "user_data": "}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:22:08.931733 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3a7e1d4e-452c-4610-b71c-c08facd6837d tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:08.949779 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3a7e1d4e-452c-4610-b71c-c08facd6837d tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:08.955392 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3a7e1d4e-452c-4610-b71c-c08facd6837d tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:08.968870 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3a7e1d4e-452c-4610-b71c-c08facd6837d tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1555 microversion: 2.91 time: 0.405964 Oct 30 01:22:08.971317 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1143/2253] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:22:08 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1555 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:22:08.983128 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3614c42a-5864-4694-a5d9-176215dc05c4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:08.985623 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3614c42a-5864-4694-a5d9-176215dc05c4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7f629426-c4e6-4c3f-8e54-efd452d14dd7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:09.005728 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-b9361486-6b53-4614-9d2a-4de0c0372d09 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] validate_networks() for [('b5a4c18a-7b67-4af5-ac68-f08c73e0283e', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:22:09.200907 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3614c42a-5864-4694-a5d9-176215dc05c4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:09.212539 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3614c42a-5864-4694-a5d9-176215dc05c4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7" status: 200 len: 1214 microversion: 2.1 time: 0.239384 Oct 30 01:22:09.217494 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1144/2254] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:22:08 2022] GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7 => generated 1214 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:22:09.235343 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-415d3d00-c19b-48c4-9773-fd8e5354ce26 tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] Action: 'create', calling method: .version_select at 0x7f44cc6f5040>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1182645956", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:22:09.244003 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-415d3d00-c19b-48c4-9773-fd8e5354ce26 tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] HTTP exception thrown: Security group id should be uuid Oct 30 01:22:09.246587 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-415d3d00-c19b-48c4-9773-fd8e5354ce26 tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] Request method failure captured: Oct 30 01:22:09.246587 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 30 01:22:09.246587 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:22:09.246587 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:22:09.246587 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:22:09.246587 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 131 Oct 30 01:22:09.246587 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:22:09.246587 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:22:09.246587 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:22:09.246587 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:22:09.246587 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdG1eX1lJtxupxoFo_uXBMSOlKRWj_He6cmW6d6HLx8S7gxARQTzSPTrf8LFy3GTD6B5mNWg7R0771Al8DAD_gzGcHY1zp6jHUSyeGUpsuEWNzxsVuG_I-dIqTCm8V7WINBe5dwfdHhRcRs7J16UBINwMNt_jWZhTfSUoyeJF62jdk0 Oct 30 01:22:09.246587 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:22:09.246587 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:22:09.246587 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:22:09.246587 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:22:09.246587 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:22:09.246587 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:22:09.246587 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 6cd2df29276f4bcdbf3329c684d5086a Oct 30 01:22:09.246587 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1000406765 Oct 30 01:22:09.246587 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:22:09.246587 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:22:09.248537 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6cd2df29276f4bcdbf3329c684d5086a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6cd2df29276f4bcdbf3329c684d5086a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6cd2df29276f4bcdbf3329c684d5086a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6cd2df29276f4bcdbf3329c684d5086a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:22:09.248537 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1000406765 Oct 30 01:22:09.248537 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 6cd2df29276f4bcdbf3329c684d5086a Oct 30 01:22:09.248537 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1000406765 Oct 30 01:22:09.248537 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project Oct 30 01:22:09.248537 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:22:09.248537 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:22:09.248537 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 4f1e4052cfb4446b9c89288f8fc7e76c Oct 30 01:22:09.248537 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project Oct 30 01:22:09.248537 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:22:09.248537 n-d-master-1 devstack@n-api.service[121102]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1182645956", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 30 01:22:09.248537 n-d-master-1 devstack@n-api.service[121102]: method: Oct 30 01:22:09.248537 n-d-master-1 devstack@n-api.service[121102]: exception: Security group id should be uuid Oct 30 01:22:09.249544 n-d-master-1 devstack@n-api.service[121102]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1182645956', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 30 01:22:09.249544 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:22:09.249544 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:22:09.249544 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 30 01:22:09.249544 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 30 01:22:09.249544 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 30 01:22:09.249544 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 30 01:22:09.249544 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 30 01:22:09.249544 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:09.249544 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:22:09.249544 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:09.249544 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:22:09.249544 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:22:09.249544 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:22:09.249544 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:22:09.249544 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:22:09.249544 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:22:09.249544 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:22:09.249544 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:22:09.249544 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:22:09.251047 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 30 01:22:09.251047 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 30 01:22:09.251047 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 30 01:22:09.251047 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:09.251047 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:22:09.251047 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:09.251047 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:22:09.251047 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:22:09.251047 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:22:09.251047 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:22:09.251047 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:22:09.251047 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 30 01:22:09.251047 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:09.251047 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-415d3d00-c19b-48c4-9773-fd8e5354ce26 tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] Returning 400 to user: Security group id should be uuid {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:22:09.251047 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-415d3d00-c19b-48c4-9773-fd8e5354ce26 tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.027417 Oct 30 01:22:09.252681 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1145/2255] 10.222.0.13 () {60 vars in 1195 bytes} [Sun Oct 30 01:22:09 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 30 01:22:09.273652 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6c592fc0-78c3-4aa2-90a2-94de2e7bd585 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:09.273652 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6c592fc0-78c3-4aa2-90a2-94de2e7bd585 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 3f60e45a-0e20-4280-be86-275d598fd552] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:09.287966 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c592fc0-78c3-4aa2-90a2-94de2e7bd585 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:09.288472 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c592fc0-78c3-4aa2-90a2-94de2e7bd585 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:09.288913 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c592fc0-78c3-4aa2-90a2-94de2e7bd585 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:09.289660 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c592fc0-78c3-4aa2-90a2-94de2e7bd585 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:09.290118 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c592fc0-78c3-4aa2-90a2-94de2e7bd585 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:09.290543 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c592fc0-78c3-4aa2-90a2-94de2e7bd585 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:09.852891 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6c592fc0-78c3-4aa2-90a2-94de2e7bd585 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:09.866537 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6c592fc0-78c3-4aa2-90a2-94de2e7bd585 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:09.870202 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6c592fc0-78c3-4aa2-90a2-94de2e7bd585 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:09.872339 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6c592fc0-78c3-4aa2-90a2-94de2e7bd585 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552" status: 200 len: 1547 microversion: 2.25 time: 0.622042 Oct 30 01:22:09.873928 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1146/2256] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:22:09 2022] GET /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552 => generated 1547 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:22:09.880961 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-38def573-e812-42f8-98be-942da4bb64d8 tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] Action: 'create', calling method: .version_select at 0x7f44ccb135e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-356342637", "description": "tempest-description-478620274"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:22:10.683211 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-b9361486-6b53-4614-9d2a-4de0c0372d09 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:22:10.684459 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-b9361486-6b53-4614-9d2a-4de0c0372d09 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:22:10.685164 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-b9361486-6b53-4614-9d2a-4de0c0372d09 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:22:10.685810 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-b9361486-6b53-4614-9d2a-4de0c0372d09 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:22:10.686699 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-b9361486-6b53-4614-9d2a-4de0c0372d09 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:22:10.711235 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b9361486-6b53-4614-9d2a-4de0c0372d09 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:10.714138 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b9361486-6b53-4614-9d2a-4de0c0372d09 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:10.714885 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b9361486-6b53-4614-9d2a-4de0c0372d09 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:10.716635 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b9361486-6b53-4614-9d2a-4de0c0372d09 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:10.717886 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b9361486-6b53-4614-9d2a-4de0c0372d09 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:10.733715 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b9361486-6b53-4614-9d2a-4de0c0372d09 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:10.769090 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-b9361486-6b53-4614-9d2a-4de0c0372d09 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Getting quotas for project 7f383493aa6b46c9884b54cb82063b30. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:22:10.776791 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-b9361486-6b53-4614-9d2a-4de0c0372d09 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Getting quotas for user d6e0e5acf53b4abe99c3418c82d47ab3 and project 7f383493aa6b46c9884b54cb82063b30. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:22:10.797491 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b9361486-6b53-4614-9d2a-4de0c0372d09 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:22:10.803181 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b9361486-6b53-4614-9d2a-4de0c0372d09 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] [instance: 0c5133ba-8270-419a-80cb-43feb76f94c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:22:11.036621 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b9361486-6b53-4614-9d2a-4de0c0372d09 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.437754 Oct 30 01:22:11.044782 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1111/2257] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:22:08 2022] POST /compute/v2.1/servers => generated 409 bytes in 2442 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:22:11.054584 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7d93383a-59ba-40b0-a1a2-8e2422b8c392 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:11.057301 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7d93383a-59ba-40b0-a1a2-8e2422b8c392 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:11.076179 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7d93383a-59ba-40b0-a1a2-8e2422b8c392 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:11.089357 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7d93383a-59ba-40b0-a1a2-8e2422b8c392 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:11.092167 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7d93383a-59ba-40b0-a1a2-8e2422b8c392 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:11.099218 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7d93383a-59ba-40b0-a1a2-8e2422b8c392 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:11.100008 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7d93383a-59ba-40b0-a1a2-8e2422b8c392 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:11.101687 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7d93383a-59ba-40b0-a1a2-8e2422b8c392 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:11.280255 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-38def573-e812-42f8-98be-942da4bb64d8 tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 1.404845 Oct 30 01:22:11.281622 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1147/2258] 10.222.0.13 () {60 vars in 1180 bytes} [Sun Oct 30 01:22:09 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:22:11.295311 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7854b647-6275-48c7-9d19-71056e7cbe2d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:11.298167 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7854b647-6275-48c7-9d19-71056e7cbe2d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7f629426-c4e6-4c3f-8e54-efd452d14dd7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:11.325293 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7854b647-6275-48c7-9d19-71056e7cbe2d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:11.325293 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7854b647-6275-48c7-9d19-71056e7cbe2d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:11.326163 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7854b647-6275-48c7-9d19-71056e7cbe2d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:11.330446 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7d93383a-59ba-40b0-a1a2-8e2422b8c392 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:11.346160 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7d93383a-59ba-40b0-a1a2-8e2422b8c392 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:11.353055 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7d93383a-59ba-40b0-a1a2-8e2422b8c392 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:11.360212 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7854b647-6275-48c7-9d19-71056e7cbe2d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:11.363726 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7854b647-6275-48c7-9d19-71056e7cbe2d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:11.364196 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7d93383a-59ba-40b0-a1a2-8e2422b8c392 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1537 microversion: 2.91 time: 0.323287 Oct 30 01:22:11.365135 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7854b647-6275-48c7-9d19-71056e7cbe2d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:11.378513 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1112/2259] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:22:11 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1537 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:22:11.400429 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f7db50b5-6f7d-4f89-834d-610e7f2d67ce tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:11.401400 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f7db50b5-6f7d-4f89-834d-610e7f2d67ce tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 3f60e45a-0e20-4280-be86-275d598fd552] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:11.408445 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:22:11.412729 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f7db50b5-6f7d-4f89-834d-610e7f2d67ce tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:11.416447 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f7db50b5-6f7d-4f89-834d-610e7f2d67ce tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:11.416447 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f7db50b5-6f7d-4f89-834d-610e7f2d67ce tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:11.416447 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f7db50b5-6f7d-4f89-834d-610e7f2d67ce tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:11.418505 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f7db50b5-6f7d-4f89-834d-610e7f2d67ce tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:11.418952 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f7db50b5-6f7d-4f89-834d-610e7f2d67ce tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:11.561276 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7854b647-6275-48c7-9d19-71056e7cbe2d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:11.571740 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7854b647-6275-48c7-9d19-71056e7cbe2d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7" status: 200 len: 1266 microversion: 2.1 time: 0.281016 Oct 30 01:22:11.574900 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1148/2260] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:22:11 2022] GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7 => generated 1266 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:22:11.577972 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f7bc6737-a8b2-4e19-9375-128ac214433a tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:11.579035 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f7bc6737-a8b2-4e19-9375-128ac214433a tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] [instance: 0c5133ba-8270-419a-80cb-43feb76f94c1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:11.615746 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f7db50b5-6f7d-4f89-834d-610e7f2d67ce tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:11.627825 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f7db50b5-6f7d-4f89-834d-610e7f2d67ce tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:11.629985 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f7db50b5-6f7d-4f89-834d-610e7f2d67ce tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:11.631044 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f7db50b5-6f7d-4f89-834d-610e7f2d67ce tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552" status: 200 len: 1331 microversion: 2.25 time: 0.251450 Oct 30 01:22:11.646523 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1113/2261] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:22:11 2022] GET /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552 => generated 1331 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:22:11.658307 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-52c1be76-f9b4-4025-b78e-bf7047ca4249 req-80053c67-3d83-42cd-9dcf-ef89b8031284 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f60e45a-0e20-4280-be86-275d598fd552", "name": "network-vif-deleted", "tag": "c8a94bc2-b259-4ae7-9a0e-3c02ee3a39c3"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:22:11.671769 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f7bc6737-a8b2-4e19-9375-128ac214433a tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e0e5acf53b4abe99c3418c82d47ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f383493aa6b46c9884b54cb82063b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:11.675165 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-52c1be76-f9b4-4025-b78e-bf7047ca4249 req-80053c67-3d83-42cd-9dcf-ef89b8031284 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:11.675873 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-52c1be76-f9b4-4025-b78e-bf7047ca4249 req-80053c67-3d83-42cd-9dcf-ef89b8031284 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:11.676490 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-52c1be76-f9b4-4025-b78e-bf7047ca4249 req-80053c67-3d83-42cd-9dcf-ef89b8031284 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:11.689808 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-52c1be76-f9b4-4025-b78e-bf7047ca4249 req-80053c67-3d83-42cd-9dcf-ef89b8031284 service nova] Creating event network-vif-deleted:c8a94bc2-b259-4ae7-9a0e-3c02ee3a39c3 for instance 3f60e45a-0e20-4280-be86-275d598fd552 on n-h2-master-1 Oct 30 01:22:11.697159 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-52c1be76-f9b4-4025-b78e-bf7047ca4249 req-80053c67-3d83-42cd-9dcf-ef89b8031284 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048685 Oct 30 01:22:11.699428 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1114/2262] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:22:11.699602 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=67 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:22:11.711051 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f7bc6737-a8b2-4e19-9375-128ac214433a tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] 10.222.0.13 "GET /compute/v2.1/servers/0c5133ba-8270-419a-80cb-43feb76f94c1" status: 200 len: 1224 microversion: 2.1 time: 0.134153 Oct 30 01:22:11.712136 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1149/2263] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:22:11 2022] GET /compute/v2.1/servers/0c5133ba-8270-419a-80cb-43feb76f94c1 => generated 1224 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:22:11.722582 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a3afe858-1853-4579-96fc-2a0495ca4f51 tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] Action: 'create', calling method: .version_select at 0x7f44cc343040>, body: {"security_group_rule": {"parent_group_id": "0d1c98b2-a1e6-4608-839f-a88676dfbeab", "ip_protocol": "tempest-999-1061529287", "from_port": 22, "to_port": 22}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:22:11.789696 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-a3afe858-1853-4579-96fc-2a0495ca4f51 tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] HTTP exception thrown: Invalid IP protocol tempest-999-1061529287. Oct 30 01:22:11.790010 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a3afe858-1853-4579-96fc-2a0495ca4f51 tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] Request method failure captured: Oct 30 01:22:11.790010 n-d-master-1 devstack@n-api.service[121103]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 30 01:22:11.790010 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:22:11.790010 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:22:11.790010 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:22:11.790010 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 157 Oct 30 01:22:11.790010 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:22:11.790010 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:22:11.790010 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:22:11.790010 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:22:11.790010 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdG1eX1lJtxupxoFo_uXBMSOlKRWj_He6cmW6d6HLx8S7gxARQTzSPTrf8LFy3GTD6B5mNWg7R0771Al8DAD_gzGcHY1zp6jHUSyeGUpsuEWNzxsVuG_I-dIqTCm8V7WINBe5dwfdHhRcRs7J16UBINwMNt_jWZhTfSUoyeJF62jdk0 Oct 30 01:22:11.790010 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:22:11.790010 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:22:11.790010 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:22:11.790010 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:22:11.790010 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:22:11.790010 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:22:11.790010 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 6cd2df29276f4bcdbf3329c684d5086a Oct 30 01:22:11.790010 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1000406765 Oct 30 01:22:11.790010 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:22:11.790010 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:22:11.792399 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6cd2df29276f4bcdbf3329c684d5086a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6cd2df29276f4bcdbf3329c684d5086a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6cd2df29276f4bcdbf3329c684d5086a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6cd2df29276f4bcdbf3329c684d5086a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:22:11.792399 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1000406765 Oct 30 01:22:11.792399 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 6cd2df29276f4bcdbf3329c684d5086a Oct 30 01:22:11.792399 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1000406765 Oct 30 01:22:11.792399 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project Oct 30 01:22:11.792399 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:22:11.792399 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:22:11.792399 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 4f1e4052cfb4446b9c89288f8fc7e76c Oct 30 01:22:11.792399 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project Oct 30 01:22:11.792399 n-d-master-1 devstack@n-api.service[121103]: Oct 30 01:22:11.792399 n-d-master-1 devstack@n-api.service[121103]: {"security_group_rule": {"parent_group_id": "0d1c98b2-a1e6-4608-839f-a88676dfbeab", "ip_protocol": "tempest-999-1061529287", "from_port": 22, "to_port": 22}} Oct 30 01:22:11.792399 n-d-master-1 devstack@n-api.service[121103]: method: Oct 30 01:22:11.793527 n-d-master-1 devstack@n-api.service[121103]: exception: Invalid IP protocol tempest-999-1061529287. Oct 30 01:22:11.793527 n-d-master-1 devstack@n-api.service[121103]: action_args: {'body': {'security_group_rule': {'parent_group_id': '0d1c98b2-a1e6-4608-839f-a88676dfbeab', 'ip_protocol': 'tempest-999-1061529287', 'from_port': 22, 'to_port': 22}}} Oct 30 01:22:11.793527 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:22:11.793527 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:22:11.793527 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 30 01:22:11.793527 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 30 01:22:11.793527 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 30 01:22:11.793527 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 30 01:22:11.793527 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 30 01:22:11.793527 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 30 01:22:11.793527 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 30 01:22:11.793527 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 30 01:22:11.793527 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1061529287. Oct 30 01:22:11.793527 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:22:11.793527 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:22:11.793527 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:22:11.793527 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:22:11.793527 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:22:11.793527 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:22:11.795193 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:22:11.795193 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:22:11.795193 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:22:11.795193 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:22:11.795193 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:22:11.795193 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:22:11.795193 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 30 01:22:11.795193 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 30 01:22:11.795193 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1061529287. Oct 30 01:22:11.795193 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:22:11.795193 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:22:11.795193 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:22:11.795193 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:22:11.795193 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:22:11.795193 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:22:11.795193 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:22:11.795193 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:22:11.795193 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1061529287. Oct 30 01:22:11.795193 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:22:11.796659 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a3afe858-1853-4579-96fc-2a0495ca4f51 tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] Returning 400 to user: Invalid IP protocol tempest-999-1061529287. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:22:11.796659 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a3afe858-1853-4579-96fc-2a0495ca4f51 tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.082876 Oct 30 01:22:11.804206 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1115/2264] 10.222.0.13 () {60 vars in 1195 bytes} [Sun Oct 30 01:22:11 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 30 01:22:11.804878 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e76f963b-1735-4a6e-8c86-dc8526539c9f tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] Action: 'create', calling method: .version_select at 0x7f44c7ecdd30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1350282457", "description": "tempest-description-2090785475"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:22:12.401754 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d9217f81-b913-41d4-9896-d8a834656bdb tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:12.403664 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d9217f81-b913-41d4-9896-d8a834656bdb tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:12.424082 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d9217f81-b913-41d4-9896-d8a834656bdb tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:12.424082 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d9217f81-b913-41d4-9896-d8a834656bdb tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:12.424082 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d9217f81-b913-41d4-9896-d8a834656bdb tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:12.424082 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d9217f81-b913-41d4-9896-d8a834656bdb tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:12.424564 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d9217f81-b913-41d4-9896-d8a834656bdb tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:12.424564 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d9217f81-b913-41d4-9896-d8a834656bdb tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:12.428770 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e76f963b-1735-4a6e-8c86-dc8526539c9f tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.630365 Oct 30 01:22:12.429708 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1150/2265] 10.222.0.13 () {60 vars in 1180 bytes} [Sun Oct 30 01:22:11 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:22:12.443004 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bfa3cce3-18b1-49de-ab91-5534bd331f1f tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] Action: 'create', calling method: .version_select at 0x7f44d03f55e0>, body: {"security_group_rule": {"parent_group_id": "3b8691fb-f5d9-4334-9d86-af171e30c16b", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:22:12.577430 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d9217f81-b913-41d4-9896-d8a834656bdb tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:12.588603 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d9217f81-b913-41d4-9896-d8a834656bdb tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:12.591869 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d9217f81-b913-41d4-9896-d8a834656bdb tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:12.607195 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d9217f81-b913-41d4-9896-d8a834656bdb tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1537 microversion: 2.91 time: 0.210375 Oct 30 01:22:12.627965 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1116/2266] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:22:12 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1537 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:22:12.648803 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-99d6ec1a-f961-4b65-be21-6ffeadd105e0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:12.649789 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-99d6ec1a-f961-4b65-be21-6ffeadd105e0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7f629426-c4e6-4c3f-8e54-efd452d14dd7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:12.665322 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-99d6ec1a-f961-4b65-be21-6ffeadd105e0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:12.665992 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-99d6ec1a-f961-4b65-be21-6ffeadd105e0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:12.668759 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-99d6ec1a-f961-4b65-be21-6ffeadd105e0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:12.669768 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-99d6ec1a-f961-4b65-be21-6ffeadd105e0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:12.671353 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-99d6ec1a-f961-4b65-be21-6ffeadd105e0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:12.673158 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-99d6ec1a-f961-4b65-be21-6ffeadd105e0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:12.698615 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-bfa3cce3-18b1-49de-ab91-5534bd331f1f tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 30 01:22:12.704151 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bfa3cce3-18b1-49de-ab91-5534bd331f1f tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] Request method failure captured: Oct 30 01:22:12.704151 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 30 01:22:12.704151 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:22:12.704151 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:22:12.704151 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:22:12.704151 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 138 Oct 30 01:22:12.704151 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:22:12.704151 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:22:12.704151 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:22:12.704151 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:22:12.704151 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdG1eX1lJtxupxoFo_uXBMSOlKRWj_He6cmW6d6HLx8S7gxARQTzSPTrf8LFy3GTD6B5mNWg7R0771Al8DAD_gzGcHY1zp6jHUSyeGUpsuEWNzxsVuG_I-dIqTCm8V7WINBe5dwfdHhRcRs7J16UBINwMNt_jWZhTfSUoyeJF62jdk0 Oct 30 01:22:12.704151 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:22:12.704151 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:22:12.704151 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:22:12.704151 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:22:12.704151 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:22:12.704151 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:22:12.704151 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 6cd2df29276f4bcdbf3329c684d5086a Oct 30 01:22:12.704151 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1000406765 Oct 30 01:22:12.704151 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:22:12.704151 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:22:12.706587 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6cd2df29276f4bcdbf3329c684d5086a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6cd2df29276f4bcdbf3329c684d5086a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6cd2df29276f4bcdbf3329c684d5086a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6cd2df29276f4bcdbf3329c684d5086a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:22:12.706587 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1000406765 Oct 30 01:22:12.706587 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 6cd2df29276f4bcdbf3329c684d5086a Oct 30 01:22:12.706587 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1000406765 Oct 30 01:22:12.706587 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project Oct 30 01:22:12.706587 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:22:12.706587 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:22:12.706587 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 4f1e4052cfb4446b9c89288f8fc7e76c Oct 30 01:22:12.706587 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project Oct 30 01:22:12.706587 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:22:12.706587 n-d-master-1 devstack@n-api.service[121102]: {"security_group_rule": {"parent_group_id": "3b8691fb-f5d9-4334-9d86-af171e30c16b", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 30 01:22:12.706587 n-d-master-1 devstack@n-api.service[121102]: method: Oct 30 01:22:12.707518 n-d-master-1 devstack@n-api.service[121102]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 30 01:22:12.707518 n-d-master-1 devstack@n-api.service[121102]: action_args: {'body': {'security_group_rule': {'parent_group_id': '3b8691fb-f5d9-4334-9d86-af171e30c16b', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 30 01:22:12.707518 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:22:12.707518 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:22:12.707518 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 30 01:22:12.707518 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 30 01:22:12.707518 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 30 01:22:12.707518 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 30 01:22:12.707518 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 30 01:22:12.707518 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 30 01:22:12.707518 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 30 01:22:12.707518 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 30 01:22:12.707518 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 30 01:22:12.707518 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:12.707518 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:22:12.707518 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:12.707518 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:22:12.707518 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:22:12.707518 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:22:12.709349 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:22:12.709349 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:22:12.709349 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:22:12.709349 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:22:12.709349 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:22:12.709349 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:22:12.709349 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 30 01:22:12.709349 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 30 01:22:12.709349 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 30 01:22:12.709349 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:12.709349 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:22:12.709349 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:12.709349 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:22:12.709349 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:22:12.709349 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:22:12.709349 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:22:12.709349 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:22:12.709349 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 30 01:22:12.709349 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:12.713611 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bfa3cce3-18b1-49de-ab91-5534bd331f1f tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:22:12.714722 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bfa3cce3-18b1-49de-ab91-5534bd331f1f tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.275744 Oct 30 01:22:12.716790 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1151/2267] 10.222.0.13 () {60 vars in 1195 bytes} [Sun Oct 30 01:22:12 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 277 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:22:12.731642 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a816cd9e-19e1-4253-b3e9-95035d45f133 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:12.734238 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a816cd9e-19e1-4253-b3e9-95035d45f133 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 3f60e45a-0e20-4280-be86-275d598fd552] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:12.748193 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a816cd9e-19e1-4253-b3e9-95035d45f133 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:12.748700 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a816cd9e-19e1-4253-b3e9-95035d45f133 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:12.749207 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a816cd9e-19e1-4253-b3e9-95035d45f133 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:12.753754 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a816cd9e-19e1-4253-b3e9-95035d45f133 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:12.754243 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a816cd9e-19e1-4253-b3e9-95035d45f133 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:12.754677 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a816cd9e-19e1-4253-b3e9-95035d45f133 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:12.780120 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-a816cd9e-19e1-4253-b3e9-95035d45f133 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] HTTP exception thrown: Instance 3f60e45a-0e20-4280-be86-275d598fd552 could not be found. Oct 30 01:22:12.780368 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a816cd9e-19e1-4253-b3e9-95035d45f133 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Request method failure captured: Oct 30 01:22:12.780368 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552 HTTP/1.1 Oct 30 01:22:12.780368 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:22:12.780368 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:22:12.780368 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:22:12.780368 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:22:12.780368 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:22:12.780368 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:22:12.780368 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:22:12.780368 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:22:12.780368 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXc_0mq1CplEa1aPZYhbxi5TgeBxQWTmjClFo0UfdQuaAzHtvsfPo7DIwhN5B-1KrVIJgRZREDX2FdwcYtrgO-sGBBjWKIgNfqF5a_ixLdQhWHkdNNoRoBEy0QOJ0a8XcozziR4bS4aIcMvE2mkuQo7KqsWXnzNtZabfb-7ZRMd_V1QY Oct 30 01:22:12.780368 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:22:12.780368 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:22:12.780368 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:22:12.780368 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:22:12.780368 n-d-master-1 devstack@n-api.service[121102]: X-Openstack-Nova-Api-Version: 2.25 Oct 30 01:22:12.780368 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:22:12.780368 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:22:12.780368 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 301cee87901844ed94e635eca054960d Oct 30 01:22:12.780368 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1274178165 Oct 30 01:22:12.780368 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:22:12.780368 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:22:12.782460 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/301cee87901844ed94e635eca054960d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_301cee87901844ed94e635eca054960d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/301cee87901844ed94e635eca054960d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/301cee87901844ed94e635eca054960d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:22:12.782460 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1274178165 Oct 30 01:22:12.782460 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 301cee87901844ed94e635eca054960d Oct 30 01:22:12.782460 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1274178165 Oct 30 01:22:12.782460 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-LiveAutoBlockMigrationV225Test-1274178165-project Oct 30 01:22:12.782460 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:22:12.782460 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:22:12.782460 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 2096bbb8aff742b1837931e52ac1c9ae Oct 30 01:22:12.782460 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1274178165-project Oct 30 01:22:12.782460 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:22:12.782460 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 3f60e45a-0e20-4280-be86-275d598fd552 could not be found. Oct 30 01:22:12.782460 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '3f60e45a-0e20-4280-be86-275d598fd552'} Oct 30 01:22:12.783637 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:22:12.783637 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:22:12.783637 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:22:12.783637 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:22:12.783637 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:22:12.783637 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:22:12.783637 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:22:12.783637 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:22:12.783637 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:22:12.783637 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:22:12.783637 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f60e45a-0e20-4280-be86-275d598fd552 could not be found. Oct 30 01:22:12.783637 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:12.783637 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:22:12.783637 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:12.783637 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:22:12.783637 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:22:12.783637 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:22:12.783637 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:22:12.783637 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:22:12.783637 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:22:12.785763 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:22:12.785763 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:22:12.785763 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:22:12.785763 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:22:12.785763 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:22:12.785763 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:22:12.785763 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:22:12.785763 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f60e45a-0e20-4280-be86-275d598fd552 could not be found. Oct 30 01:22:12.785763 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:12.785763 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:22:12.785763 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:12.785763 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:22:12.785763 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:22:12.785763 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:22:12.785763 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:22:12.785763 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:22:12.785763 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f60e45a-0e20-4280-be86-275d598fd552 could not be found. Oct 30 01:22:12.785763 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:12.790149 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a816cd9e-19e1-4253-b3e9-95035d45f133 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Returning 404 to user: Instance 3f60e45a-0e20-4280-be86-275d598fd552 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:22:12.790433 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-99d6ec1a-f961-4b65-be21-6ffeadd105e0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:12.794605 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a816cd9e-19e1-4253-b3e9-95035d45f133 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552" status: 404 len: 111 microversion: 2.25 time: 0.072295 Oct 30 01:22:12.795569 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1152/2268] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:22:12 2022] GET /compute/v2.1/servers/3f60e45a-0e20-4280-be86-275d598fd552 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:22:12.817659 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-99d6ec1a-f961-4b65-be21-6ffeadd105e0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7" status: 200 len: 1272 microversion: 2.1 time: 0.177060 Oct 30 01:22:12.817659 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1117/2269] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:22:12 2022] GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7 => generated 1272 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:22:12.817659 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3890222f-5492-4c19-ad07-e11c5a251d72 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:12.817659 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3890222f-5492-4c19-ad07-e11c5a251d72 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] [instance: 0c5133ba-8270-419a-80cb-43feb76f94c1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:12.818151 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a6762be8-8e16-439a-92a7-7e76c71410bb tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] Action: 'create', calling method: .version_select at 0x7f44cc6f5040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-379078791", "description": "tempest-description-1885156735"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:22:12.824075 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3890222f-5492-4c19-ad07-e11c5a251d72 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:12.825794 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3890222f-5492-4c19-ad07-e11c5a251d72 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:12.826465 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3890222f-5492-4c19-ad07-e11c5a251d72 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:12.827578 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3890222f-5492-4c19-ad07-e11c5a251d72 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:12.828293 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3890222f-5492-4c19-ad07-e11c5a251d72 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:12.829618 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3890222f-5492-4c19-ad07-e11c5a251d72 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:12.986163 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3890222f-5492-4c19-ad07-e11c5a251d72 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e0e5acf53b4abe99c3418c82d47ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f383493aa6b46c9884b54cb82063b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:12.999999 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3890222f-5492-4c19-ad07-e11c5a251d72 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] 10.222.0.13 "GET /compute/v2.1/servers/0c5133ba-8270-419a-80cb-43feb76f94c1" status: 200 len: 1228 microversion: 2.1 time: 0.191028 Oct 30 01:22:13.001175 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1118/2270] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:22:12 2022] GET /compute/v2.1/servers/0c5133ba-8270-419a-80cb-43feb76f94c1 => generated 1228 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:22:13.018450 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1db30954-c363-4dca-9234-16ea27c3e350 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:13.020844 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1db30954-c363-4dca-9234-16ea27c3e350 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:13.040321 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1db30954-c363-4dca-9234-16ea27c3e350 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:13.042188 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1db30954-c363-4dca-9234-16ea27c3e350 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:13.043948 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1db30954-c363-4dca-9234-16ea27c3e350 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:13.045178 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1db30954-c363-4dca-9234-16ea27c3e350 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:13.049988 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1db30954-c363-4dca-9234-16ea27c3e350 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:13.049988 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1db30954-c363-4dca-9234-16ea27c3e350 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:13.108997 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1db30954-c363-4dca-9234-16ea27c3e350 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:22:13.486371 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1db30954-c363-4dca-9234-16ea27c3e350 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3" status: 204 len: 0 microversion: 2.25 time: 0.481590 Oct 30 01:22:13.488438 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a6762be8-8e16-439a-92a7-7e76c71410bb tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.691457 Oct 30 01:22:13.492215 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1119/2271] 10.222.0.13 () {60 vars in 1280 bytes} [Sun Oct 30 01:22:13 2022] DELETE /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 30 01:22:13.498387 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1153/2272] 10.222.0.13 () {60 vars in 1180 bytes} [Sun Oct 30 01:22:12 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:22:13.506070 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4d0e4ad7-0217-4c89-a559-6be1516b343c tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] Action: 'create', calling method: .version_select at 0x7f44d03f5700>, body: {"security_group_rule": {"parent_group_id": "f40634c5-c525-41c9-9903-9d2a7e121afd", "ip_protocol": "tcp", "from_port": 22, "to_port": 1825430034}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:22:13.512830 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-57497beb-3ce2-4c7c-b28e-9ff1bfc15de6 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:13.513631 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-57497beb-3ce2-4c7c-b28e-9ff1bfc15de6 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:13.537031 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-57497beb-3ce2-4c7c-b28e-9ff1bfc15de6 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:13.542556 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-57497beb-3ce2-4c7c-b28e-9ff1bfc15de6 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:13.546020 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-57497beb-3ce2-4c7c-b28e-9ff1bfc15de6 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:13.546810 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-57497beb-3ce2-4c7c-b28e-9ff1bfc15de6 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:13.547461 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-57497beb-3ce2-4c7c-b28e-9ff1bfc15de6 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:13.548031 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-57497beb-3ce2-4c7c-b28e-9ff1bfc15de6 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:13.580895 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-4d0e4ad7-0217-4c89-a559-6be1516b343c tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] HTTP exception thrown: Invalid port range 22:1825430034. Valid TCP ports should be between 1-65535 Oct 30 01:22:13.582952 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4d0e4ad7-0217-4c89-a559-6be1516b343c tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] Request method failure captured: Oct 30 01:22:13.582952 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 30 01:22:13.582952 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:22:13.582952 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:22:13.582952 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:22:13.582952 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 146 Oct 30 01:22:13.582952 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:22:13.582952 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:22:13.582952 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:22:13.582952 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:22:13.582952 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdG1eX1lJtxupxoFo_uXBMSOlKRWj_He6cmW6d6HLx8S7gxARQTzSPTrf8LFy3GTD6B5mNWg7R0771Al8DAD_gzGcHY1zp6jHUSyeGUpsuEWNzxsVuG_I-dIqTCm8V7WINBe5dwfdHhRcRs7J16UBINwMNt_jWZhTfSUoyeJF62jdk0 Oct 30 01:22:13.582952 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:22:13.582952 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:22:13.582952 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:22:13.582952 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:22:13.582952 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:22:13.582952 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:22:13.582952 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 6cd2df29276f4bcdbf3329c684d5086a Oct 30 01:22:13.582952 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1000406765 Oct 30 01:22:13.582952 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:22:13.582952 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:22:13.589895 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6cd2df29276f4bcdbf3329c684d5086a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6cd2df29276f4bcdbf3329c684d5086a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6cd2df29276f4bcdbf3329c684d5086a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6cd2df29276f4bcdbf3329c684d5086a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:22:13.589895 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1000406765 Oct 30 01:22:13.589895 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 6cd2df29276f4bcdbf3329c684d5086a Oct 30 01:22:13.589895 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1000406765 Oct 30 01:22:13.589895 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project Oct 30 01:22:13.589895 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:22:13.589895 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:22:13.589895 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 4f1e4052cfb4446b9c89288f8fc7e76c Oct 30 01:22:13.589895 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project Oct 30 01:22:13.589895 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:22:13.589895 n-d-master-1 devstack@n-api.service[121102]: {"security_group_rule": {"parent_group_id": "f40634c5-c525-41c9-9903-9d2a7e121afd", "ip_protocol": "tcp", "from_port": 22, "to_port": 1825430034}} Oct 30 01:22:13.589895 n-d-master-1 devstack@n-api.service[121102]: method: Oct 30 01:22:13.590894 n-d-master-1 devstack@n-api.service[121102]: exception: Invalid port range 22:1825430034. Valid TCP ports should be between 1-65535 Oct 30 01:22:13.590894 n-d-master-1 devstack@n-api.service[121102]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'f40634c5-c525-41c9-9903-9d2a7e121afd', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1825430034}}} Oct 30 01:22:13.590894 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:22:13.590894 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:22:13.590894 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 30 01:22:13.590894 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 30 01:22:13.590894 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 30 01:22:13.590894 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 30 01:22:13.590894 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 30 01:22:13.590894 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 30 01:22:13.590894 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 30 01:22:13.590894 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 30 01:22:13.590894 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1825430034. Valid TCP ports should be between 1-65535 Oct 30 01:22:13.590894 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:13.590894 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:22:13.590894 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:13.590894 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:22:13.590894 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:22:13.590894 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:22:13.592245 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:22:13.592245 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:22:13.592245 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:22:13.592245 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:22:13.592245 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:22:13.592245 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:22:13.592245 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 30 01:22:13.592245 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 30 01:22:13.592245 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1825430034. Valid TCP ports should be between 1-65535 Oct 30 01:22:13.592245 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:13.592245 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:22:13.592245 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:13.592245 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:22:13.592245 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:22:13.592245 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:22:13.592245 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:22:13.592245 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:22:13.592245 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1825430034. Valid TCP ports should be between 1-65535 Oct 30 01:22:13.592245 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:13.593930 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4d0e4ad7-0217-4c89-a559-6be1516b343c tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] Returning 400 to user: Invalid port range 22:1825430034. Valid TCP ports should be between 1-65535 {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:22:13.593930 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4d0e4ad7-0217-4c89-a559-6be1516b343c tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.084125 Oct 30 01:22:13.593930 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1154/2273] 10.222.0.13 () {60 vars in 1195 bytes} [Sun Oct 30 01:22:13 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 86 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:22:13.600532 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7f02acf4-aae0-46e7-b0b1-6eaeeb4ca792 tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] Action: 'create', calling method: .version_select at 0x7f44c7ecda60>, body: {"security_group_rule": {"parent_group_id": "3836a81e-67c3-476b-9743-829c52dc0ac1", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:22:13.644722 n-d-master-1 devstack@n-api.service[121102]: DEBUG neutronclient.v2_0.client [None req-7f02acf4-aae0-46e7-b0b1-6eaeeb4ca792 tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3836a81e-67c3-476b-9743-829c52dc0ac1 does not exist", "detail": ""}} {{(pid=121102) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 30 01:22:13.651147 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.security_group_api [None req-7f02acf4-aae0-46e7-b0b1-6eaeeb4ca792 tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] Neutron security group 3836a81e-67c3-476b-9743-829c52dc0ac1 not found {{(pid=121102) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 30 01:22:13.651147 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-7f02acf4-aae0-46e7-b0b1-6eaeeb4ca792 tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] HTTP exception thrown: Security group 3836a81e-67c3-476b-9743-829c52dc0ac1 does not exist Oct 30 01:22:13.651147 n-d-master-1 devstack@n-api.service[121102]: Neutron server returns request_ids: ['req-ecc999da-940e-477d-954c-5aa145173a9a'] Oct 30 01:22:13.651147 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7f02acf4-aae0-46e7-b0b1-6eaeeb4ca792 tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] Request method failure captured: Oct 30 01:22:13.651147 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 30 01:22:13.651147 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:22:13.651147 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:22:13.651147 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:22:13.651147 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 138 Oct 30 01:22:13.651147 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:22:13.651147 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:22:13.651147 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:22:13.651147 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:22:13.651147 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdG1eX1lJtxupxoFo_uXBMSOlKRWj_He6cmW6d6HLx8S7gxARQTzSPTrf8LFy3GTD6B5mNWg7R0771Al8DAD_gzGcHY1zp6jHUSyeGUpsuEWNzxsVuG_I-dIqTCm8V7WINBe5dwfdHhRcRs7J16UBINwMNt_jWZhTfSUoyeJF62jdk0 Oct 30 01:22:13.651147 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:22:13.651147 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:22:13.651147 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:22:13.651147 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:22:13.651147 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:22:13.651147 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:22:13.651147 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 6cd2df29276f4bcdbf3329c684d5086a Oct 30 01:22:13.651147 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1000406765 Oct 30 01:22:13.651147 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:22:13.651147 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:22:13.652995 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6cd2df29276f4bcdbf3329c684d5086a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6cd2df29276f4bcdbf3329c684d5086a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6cd2df29276f4bcdbf3329c684d5086a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6cd2df29276f4bcdbf3329c684d5086a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:22:13.652995 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1000406765 Oct 30 01:22:13.652995 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 6cd2df29276f4bcdbf3329c684d5086a Oct 30 01:22:13.652995 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1000406765 Oct 30 01:22:13.652995 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project Oct 30 01:22:13.652995 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:22:13.652995 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:22:13.652995 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 4f1e4052cfb4446b9c89288f8fc7e76c Oct 30 01:22:13.652995 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project Oct 30 01:22:13.652995 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:22:13.652995 n-d-master-1 devstack@n-api.service[121102]: {"security_group_rule": {"parent_group_id": "3836a81e-67c3-476b-9743-829c52dc0ac1", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 30 01:22:13.652995 n-d-master-1 devstack@n-api.service[121102]: method: Oct 30 01:22:13.654244 n-d-master-1 devstack@n-api.service[121102]: exception: Security group 3836a81e-67c3-476b-9743-829c52dc0ac1 does not exist Oct 30 01:22:13.654244 n-d-master-1 devstack@n-api.service[121102]: Neutron server returns request_ids: ['req-ecc999da-940e-477d-954c-5aa145173a9a'] Oct 30 01:22:13.654244 n-d-master-1 devstack@n-api.service[121102]: action_args: {'body': {'security_group_rule': {'parent_group_id': '3836a81e-67c3-476b-9743-829c52dc0ac1', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 30 01:22:13.654244 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:22:13.654244 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:22:13.654244 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 30 01:22:13.654244 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 30 01:22:13.654244 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:22:13.654244 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:22:13.654244 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 30 01:22:13.654244 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 30 01:22:13.654244 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:22:13.654244 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:22:13.654244 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 30 01:22:13.654244 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 30 01:22:13.654244 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:22:13.654244 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:22:13.654244 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 30 01:22:13.654244 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 30 01:22:13.655910 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:22:13.655910 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:22:13.655910 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 30 01:22:13.655910 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 30 01:22:13.655910 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:22:13.655910 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:22:13.655910 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 30 01:22:13.655910 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 30 01:22:13.655910 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 30 01:22:13.655910 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 30 01:22:13.655910 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3836a81e-67c3-476b-9743-829c52dc0ac1 does not exist Oct 30 01:22:13.655910 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ecc999da-940e-477d-954c-5aa145173a9a'] Oct 30 01:22:13.655910 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:13.655910 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:22:13.655910 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:13.655910 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:22:13.655910 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 30 01:22:13.655910 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 30 01:22:13.655910 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 30 01:22:13.657558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 30 01:22:13.657558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3836a81e-67c3-476b-9743-829c52dc0ac1 does not exist Oct 30 01:22:13.657558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ecc999da-940e-477d-954c-5aa145173a9a'] Oct 30 01:22:13.657558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:13.657558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:22:13.657558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:13.657558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:22:13.657558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:22:13.657558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:22:13.657558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:22:13.657558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:22:13.657558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:22:13.657558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:22:13.657558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:22:13.657558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:22:13.657558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 30 01:22:13.657558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 30 01:22:13.657558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3836a81e-67c3-476b-9743-829c52dc0ac1 does not exist Oct 30 01:22:13.657558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ecc999da-940e-477d-954c-5aa145173a9a'] Oct 30 01:22:13.657558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:13.660644 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:22:13.660644 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:13.660644 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:22:13.660644 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:22:13.660644 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:22:13.660644 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:22:13.660644 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:22:13.660644 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3836a81e-67c3-476b-9743-829c52dc0ac1 does not exist Oct 30 01:22:13.660644 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ecc999da-940e-477d-954c-5aa145173a9a'] Oct 30 01:22:13.660644 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:13.660644 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7f02acf4-aae0-46e7-b0b1-6eaeeb4ca792 tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] Returning 404 to user: Security group 3836a81e-67c3-476b-9743-829c52dc0ac1 does not exist Oct 30 01:22:13.660644 n-d-master-1 devstack@n-api.service[121102]: Neutron server returns request_ids: ['req-ecc999da-940e-477d-954c-5aa145173a9a'] {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:22:13.660644 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7f02acf4-aae0-46e7-b0b1-6eaeeb4ca792 tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.057471 Oct 30 01:22:13.664060 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1155/2274] 10.222.0.13 () {60 vars in 1195 bytes} [Sun Oct 30 01:22:13 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:22:13.664060 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-44556d74-6180-418b-812f-d64c8782bcfa tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:13.664060 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-44556d74-6180-418b-812f-d64c8782bcfa tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:13.675371 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44556d74-6180-418b-812f-d64c8782bcfa tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:13.676166 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44556d74-6180-418b-812f-d64c8782bcfa tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:13.678784 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44556d74-6180-418b-812f-d64c8782bcfa tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:13.680757 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44556d74-6180-418b-812f-d64c8782bcfa tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:13.681846 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44556d74-6180-418b-812f-d64c8782bcfa tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:13.685793 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44556d74-6180-418b-812f-d64c8782bcfa tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:13.909839 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-44556d74-6180-418b-812f-d64c8782bcfa tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:13.926120 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-44556d74-6180-418b-812f-d64c8782bcfa tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:13.936068 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-44556d74-6180-418b-812f-d64c8782bcfa tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:13.957514 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-44556d74-6180-418b-812f-d64c8782bcfa tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1480 microversion: 2.91 time: 0.305150 Oct 30 01:22:13.958363 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1156/2275] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:22:13 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1480 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:22:13.995592 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fd6510b7-fa35-4cbc-91b2-fe659d811d5c tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] Calling method '.version_select at 0x7f44d02d6ca0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:14.087768 n-d-master-1 devstack@n-api.service[121102]: DEBUG neutronclient.v2_0.client [None req-fd6510b7-fa35-4cbc-91b2-fe659d811d5c tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule ca45ead8-ae0b-4664-a139-1be8a855abc3 does not exist", "detail": ""}} {{(pid=121102) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 30 01:22:14.089612 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.security_group_api [None req-fd6510b7-fa35-4cbc-91b2-fe659d811d5c tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] Neutron security group rule ca45ead8-ae0b-4664-a139-1be8a855abc3 not found {{(pid=121102) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 30 01:22:14.090387 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-fd6510b7-fa35-4cbc-91b2-fe659d811d5c tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] HTTP exception thrown: Security group rule ca45ead8-ae0b-4664-a139-1be8a855abc3 does not exist Oct 30 01:22:14.090387 n-d-master-1 devstack@n-api.service[121102]: Neutron server returns request_ids: ['req-49fe1b6f-7867-4d09-8412-f3827c12e676'] Oct 30 01:22:14.093006 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fd6510b7-fa35-4cbc-91b2-fe659d811d5c tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] Request method failure captured: Oct 30 01:22:14.093006 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/os-security-group-rules/ca45ead8-ae0b-4664-a139-1be8a855abc3 HTTP/1.1 Oct 30 01:22:14.093006 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:22:14.093006 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:22:14.093006 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:22:14.093006 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:22:14.093006 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:22:14.093006 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:22:14.093006 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:22:14.093006 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:22:14.093006 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdG1eX1lJtxupxoFo_uXBMSOlKRWj_He6cmW6d6HLx8S7gxARQTzSPTrf8LFy3GTD6B5mNWg7R0771Al8DAD_gzGcHY1zp6jHUSyeGUpsuEWNzxsVuG_I-dIqTCm8V7WINBe5dwfdHhRcRs7J16UBINwMNt_jWZhTfSUoyeJF62jdk0 Oct 30 01:22:14.093006 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:22:14.093006 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:22:14.093006 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:22:14.093006 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:22:14.093006 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:22:14.093006 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:22:14.093006 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 6cd2df29276f4bcdbf3329c684d5086a Oct 30 01:22:14.093006 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1000406765 Oct 30 01:22:14.093006 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:22:14.093006 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:22:14.094880 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6cd2df29276f4bcdbf3329c684d5086a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6cd2df29276f4bcdbf3329c684d5086a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6cd2df29276f4bcdbf3329c684d5086a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6cd2df29276f4bcdbf3329c684d5086a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:22:14.094880 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1000406765 Oct 30 01:22:14.094880 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 6cd2df29276f4bcdbf3329c684d5086a Oct 30 01:22:14.094880 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1000406765 Oct 30 01:22:14.094880 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project Oct 30 01:22:14.094880 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:22:14.094880 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:22:14.094880 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 4f1e4052cfb4446b9c89288f8fc7e76c Oct 30 01:22:14.094880 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project Oct 30 01:22:14.094880 n-d-master-1 devstack@n-api.service[121102]: method: Oct 30 01:22:14.094880 n-d-master-1 devstack@n-api.service[121102]: exception: Security group rule ca45ead8-ae0b-4664-a139-1be8a855abc3 does not exist Oct 30 01:22:14.094880 n-d-master-1 devstack@n-api.service[121102]: Neutron server returns request_ids: ['req-49fe1b6f-7867-4d09-8412-f3827c12e676'] Oct 30 01:22:14.096152 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'ca45ead8-ae0b-4664-a139-1be8a855abc3'} Oct 30 01:22:14.096152 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:22:14.096152 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:22:14.096152 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 30 01:22:14.096152 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 30 01:22:14.096152 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:22:14.096152 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:22:14.096152 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 30 01:22:14.096152 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 30 01:22:14.096152 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:22:14.096152 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:22:14.096152 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 30 01:22:14.096152 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 30 01:22:14.096152 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:22:14.096152 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:22:14.096152 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 30 01:22:14.096152 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 30 01:22:14.096152 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:22:14.096152 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:22:14.099213 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 30 01:22:14.099213 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 30 01:22:14.099213 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:22:14.099213 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:22:14.099213 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 30 01:22:14.099213 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 30 01:22:14.099213 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 30 01:22:14.099213 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 30 01:22:14.099213 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule ca45ead8-ae0b-4664-a139-1be8a855abc3 does not exist Oct 30 01:22:14.099213 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-49fe1b6f-7867-4d09-8412-f3827c12e676'] Oct 30 01:22:14.099213 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:14.099213 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:22:14.099213 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:14.099213 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:22:14.099213 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 30 01:22:14.099213 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 30 01:22:14.099213 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 30 01:22:14.099213 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 30 01:22:14.101706 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule ca45ead8-ae0b-4664-a139-1be8a855abc3 does not exist Oct 30 01:22:14.101706 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-49fe1b6f-7867-4d09-8412-f3827c12e676'] Oct 30 01:22:14.101706 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:14.101706 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:22:14.101706 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:14.101706 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:22:14.101706 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:22:14.101706 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:22:14.101706 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:22:14.101706 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:22:14.101706 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:22:14.101706 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:22:14.101706 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:22:14.101706 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:22:14.101706 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 30 01:22:14.101706 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 30 01:22:14.101706 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule ca45ead8-ae0b-4664-a139-1be8a855abc3 does not exist Oct 30 01:22:14.101706 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-49fe1b6f-7867-4d09-8412-f3827c12e676'] Oct 30 01:22:14.101706 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:14.101706 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:22:14.103431 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:14.103431 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:22:14.103431 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:22:14.103431 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:22:14.103431 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:22:14.103431 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:22:14.103431 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule ca45ead8-ae0b-4664-a139-1be8a855abc3 does not exist Oct 30 01:22:14.103431 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-49fe1b6f-7867-4d09-8412-f3827c12e676'] Oct 30 01:22:14.103431 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:14.113468 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fd6510b7-fa35-4cbc-91b2-fe659d811d5c tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] Returning 404 to user: Security group rule ca45ead8-ae0b-4664-a139-1be8a855abc3 does not exist Oct 30 01:22:14.113468 n-d-master-1 devstack@n-api.service[121102]: Neutron server returns request_ids: ['req-49fe1b6f-7867-4d09-8412-f3827c12e676'] {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:22:14.114869 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fd6510b7-fa35-4cbc-91b2-fe659d811d5c tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-group-rules/ca45ead8-ae0b-4664-a139-1be8a855abc3" status: 404 len: 199 microversion: 2.1 time: 0.131531 Oct 30 01:22:14.117210 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1157/2276] 10.222.0.13 () {58 vars in 1287 bytes} [Sun Oct 30 01:22:13 2022] DELETE /compute/v2.1/os-security-group-rules/ca45ead8-ae0b-4664-a139-1be8a855abc3 => generated 199 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:22:14.130001 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d627d836-457c-497c-ae69-29c4b7cf49e2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:14.131126 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d627d836-457c-497c-ae69-29c4b7cf49e2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7f629426-c4e6-4c3f-8e54-efd452d14dd7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:14.145980 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d627d836-457c-497c-ae69-29c4b7cf49e2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:14.146832 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d627d836-457c-497c-ae69-29c4b7cf49e2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:14.147495 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d627d836-457c-497c-ae69-29c4b7cf49e2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:14.148422 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d627d836-457c-497c-ae69-29c4b7cf49e2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:14.149082 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d627d836-457c-497c-ae69-29c4b7cf49e2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:14.149741 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-57497beb-3ce2-4c7c-b28e-9ff1bfc15de6 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:14.150317 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d627d836-457c-497c-ae69-29c4b7cf49e2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:14.166479 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-57497beb-3ce2-4c7c-b28e-9ff1bfc15de6 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:14.170971 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-57497beb-3ce2-4c7c-b28e-9ff1bfc15de6 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:14.172480 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-57497beb-3ce2-4c7c-b28e-9ff1bfc15de6 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3" status: 200 len: 1561 microversion: 2.25 time: 0.678798 Oct 30 01:22:14.173086 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1120/2277] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:22:13 2022] GET /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3 => generated 1561 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:22:14.200383 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-dcd40f26-67c4-4322-9f14-ec5c4941e0f0 tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-master-1"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:22:14.202996 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-dcd40f26-67c4-4322-9f14-ec5c4941e0f0 tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:14.210823 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dcd40f26-67c4-4322-9f14-ec5c4941e0f0 tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:14.211618 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dcd40f26-67c4-4322-9f14-ec5c4941e0f0 tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:14.212305 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dcd40f26-67c4-4322-9f14-ec5c4941e0f0 tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:14.213318 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dcd40f26-67c4-4322-9f14-ec5c4941e0f0 tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:14.214069 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dcd40f26-67c4-4322-9f14-ec5c4941e0f0 tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:14.214709 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dcd40f26-67c4-4322-9f14-ec5c4941e0f0 tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:14.270682 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-dcd40f26-67c4-4322-9f14-ec5c4941e0f0 tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-master-1". {{(pid=121103) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 30 01:22:14.514211 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d627d836-457c-497c-ae69-29c4b7cf49e2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:14.526479 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d627d836-457c-497c-ae69-29c4b7cf49e2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7" status: 200 len: 1314 microversion: 2.1 time: 0.407652 Oct 30 01:22:14.527466 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1158/2278] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:22:14 2022] GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7 => generated 1314 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:22:14.532624 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f4936e43-28e8-4681-b4ea-b56a4dfbd0ec tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:14.533752 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f4936e43-28e8-4681-b4ea-b56a4dfbd0ec tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] [instance: 0c5133ba-8270-419a-80cb-43feb76f94c1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:14.540560 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f4936e43-28e8-4681-b4ea-b56a4dfbd0ec tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:14.545962 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f4936e43-28e8-4681-b4ea-b56a4dfbd0ec tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:14.545962 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f4936e43-28e8-4681-b4ea-b56a4dfbd0ec tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:14.545962 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f4936e43-28e8-4681-b4ea-b56a4dfbd0ec tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:14.545962 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f4936e43-28e8-4681-b4ea-b56a4dfbd0ec tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:14.546494 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f4936e43-28e8-4681-b4ea-b56a4dfbd0ec tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:14.586198 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-dcd40f26-67c4-4322-9f14-ec5c4941e0f0 tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d/action" status: 202 len: 0 microversion: 2.91 time: 0.394000 Oct 30 01:22:14.587502 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1121/2279] 10.222.0.13 () {62 vars in 1319 bytes} [Sun Oct 30 01:22:14 2022] POST /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d/action => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:22:14.596108 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-00f7d84a-5f88-43ee-9418-f2ada6eb9600 tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] Calling method '.version_select at 0x7f44cc8e2700>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:14.709836 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f4936e43-28e8-4681-b4ea-b56a4dfbd0ec tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e0e5acf53b4abe99c3418c82d47ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f383493aa6b46c9884b54cb82063b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:14.720721 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f4936e43-28e8-4681-b4ea-b56a4dfbd0ec tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] 10.222.0.13 "GET /compute/v2.1/servers/0c5133ba-8270-419a-80cb-43feb76f94c1" status: 200 len: 1276 microversion: 2.1 time: 0.190223 Oct 30 01:22:14.744599 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1159/2280] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:22:14 2022] GET /compute/v2.1/servers/0c5133ba-8270-419a-80cb-43feb76f94c1 => generated 1276 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:22:14.750715 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-eca4767d-5ade-4d06-81ce-6d8a0e186350 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:14.751636 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-eca4767d-5ade-4d06-81ce-6d8a0e186350 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:14.762891 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eca4767d-5ade-4d06-81ce-6d8a0e186350 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:14.766516 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eca4767d-5ade-4d06-81ce-6d8a0e186350 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:14.766989 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eca4767d-5ade-4d06-81ce-6d8a0e186350 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:14.767743 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eca4767d-5ade-4d06-81ce-6d8a0e186350 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:14.770942 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eca4767d-5ade-4d06-81ce-6d8a0e186350 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:14.771692 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eca4767d-5ade-4d06-81ce-6d8a0e186350 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:15.024176 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-eca4767d-5ade-4d06-81ce-6d8a0e186350 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:15.040252 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-eca4767d-5ade-4d06-81ce-6d8a0e186350 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:15.043347 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-eca4767d-5ade-4d06-81ce-6d8a0e186350 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:15.050365 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-eca4767d-5ade-4d06-81ce-6d8a0e186350 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1488 microversion: 2.91 time: 0.304606 Oct 30 01:22:15.071162 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1160/2281] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:22:14 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1488 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:22:15.204227 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c4003869-97e4-4022-9c99-8e9879ef4c38 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:15.205168 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c4003869-97e4-4022-9c99-8e9879ef4c38 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:15.226517 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4003869-97e4-4022-9c99-8e9879ef4c38 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:15.227272 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4003869-97e4-4022-9c99-8e9879ef4c38 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:15.230730 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4003869-97e4-4022-9c99-8e9879ef4c38 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:15.231913 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4003869-97e4-4022-9c99-8e9879ef4c38 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:15.233213 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4003869-97e4-4022-9c99-8e9879ef4c38 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:15.233787 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4003869-97e4-4022-9c99-8e9879ef4c38 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:15.810208 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-00f7d84a-5f88-43ee-9418-f2ada6eb9600 tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/f40634c5-c525-41c9-9903-9d2a7e121afd" status: 202 len: 0 microversion: 2.1 time: 1.220869 Oct 30 01:22:15.811712 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1122/2282] 10.222.0.13 () {58 vars in 1272 bytes} [Sun Oct 30 01:22:14 2022] DELETE /compute/v2.1/os-security-groups/f40634c5-c525-41c9-9903-9d2a7e121afd => generated 0 bytes in 1223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:22:15.817125 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1a99b218-b749-40a7-9b0d-062d73439e7f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:15.818056 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1a99b218-b749-40a7-9b0d-062d73439e7f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7f629426-c4e6-4c3f-8e54-efd452d14dd7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:15.832065 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a99b218-b749-40a7-9b0d-062d73439e7f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:15.837727 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a99b218-b749-40a7-9b0d-062d73439e7f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:15.838180 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a99b218-b749-40a7-9b0d-062d73439e7f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:15.838961 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a99b218-b749-40a7-9b0d-062d73439e7f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:15.839452 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a99b218-b749-40a7-9b0d-062d73439e7f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:15.839970 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a99b218-b749-40a7-9b0d-062d73439e7f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:15.873317 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c4003869-97e4-4022-9c99-8e9879ef4c38 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:15.882768 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:22:15.936927 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c4003869-97e4-4022-9c99-8e9879ef4c38 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:15.939334 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c4003869-97e4-4022-9c99-8e9879ef4c38 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:15.943932 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c4003869-97e4-4022-9c99-8e9879ef4c38 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3" status: 200 len: 1561 microversion: 2.25 time: 0.745173 Oct 30 01:22:15.962438 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1161/2283] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:22:15 2022] GET /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3 => generated 1561 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:22:15.962438 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-29bc89b6-d72c-4ba8-a41d-f4301e8c3d92 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:15.962438 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-29bc89b6-d72c-4ba8-a41d-f4301e8c3d92 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] [instance: 0c5133ba-8270-419a-80cb-43feb76f94c1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:15.995635 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-29bc89b6-d72c-4ba8-a41d-f4301e8c3d92 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:16.001584 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-29bc89b6-d72c-4ba8-a41d-f4301e8c3d92 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:16.003207 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-29bc89b6-d72c-4ba8-a41d-f4301e8c3d92 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:16.008859 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-29bc89b6-d72c-4ba8-a41d-f4301e8c3d92 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:16.008859 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-29bc89b6-d72c-4ba8-a41d-f4301e8c3d92 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:16.012412 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-29bc89b6-d72c-4ba8-a41d-f4301e8c3d92 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:16.359592 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-29bc89b6-d72c-4ba8-a41d-f4301e8c3d92 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e0e5acf53b4abe99c3418c82d47ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f383493aa6b46c9884b54cb82063b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:16.374451 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-29bc89b6-d72c-4ba8-a41d-f4301e8c3d92 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] 10.222.0.13 "GET /compute/v2.1/servers/0c5133ba-8270-419a-80cb-43feb76f94c1" status: 200 len: 1282 microversion: 2.1 time: 0.428407 Oct 30 01:22:16.375700 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1162/2284] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:22:15 2022] GET /compute/v2.1/servers/0c5133ba-8270-419a-80cb-43feb76f94c1 => generated 1282 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:22:16.389982 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8b084a5f-5aeb-49a8-bb0c-f0f4e5992414 tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] Calling method '.version_select at 0x7f44d02d60d0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:17.018656 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1a99b218-b749-40a7-9b0d-062d73439e7f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:17.033486 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1a99b218-b749-40a7-9b0d-062d73439e7f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7" status: 200 len: 1314 microversion: 2.1 time: 1.220307 Oct 30 01:22:17.035037 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1123/2285] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:22:15 2022] GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7 => generated 1314 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:22:17.048278 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e10e6e13-7f1f-4513-bc97-a2373c6b7a1a tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:17.054155 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e10e6e13-7f1f-4513-bc97-a2373c6b7a1a tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:17.069700 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e10e6e13-7f1f-4513-bc97-a2373c6b7a1a tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:17.070229 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e10e6e13-7f1f-4513-bc97-a2373c6b7a1a tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:17.073259 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e10e6e13-7f1f-4513-bc97-a2373c6b7a1a tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:17.073259 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e10e6e13-7f1f-4513-bc97-a2373c6b7a1a tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:17.073592 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e10e6e13-7f1f-4513-bc97-a2373c6b7a1a tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:17.074334 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e10e6e13-7f1f-4513-bc97-a2373c6b7a1a tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:17.516770 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e10e6e13-7f1f-4513-bc97-a2373c6b7a1a tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:17.538697 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e10e6e13-7f1f-4513-bc97-a2373c6b7a1a tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:17.543575 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e10e6e13-7f1f-4513-bc97-a2373c6b7a1a tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:17.557466 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e10e6e13-7f1f-4513-bc97-a2373c6b7a1a tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1546 microversion: 2.91 time: 0.521332 Oct 30 01:22:17.580176 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1124/2286] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:22:17 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1546 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:22:17.597717 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-64210943-4edc-4ae7-8744-aefaa9a6bbc6 req-119a7c6d-6c55-42a4-875b-16790e9b4276 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f629426-c4e6-4c3f-8e54-efd452d14dd7", "tag": "0be1ebe4-f222-4d74-8298-cd63a4bc397c"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:22:17.622377 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-64210943-4edc-4ae7-8744-aefaa9a6bbc6 req-119a7c6d-6c55-42a4-875b-16790e9b4276 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:17.623127 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-64210943-4edc-4ae7-8744-aefaa9a6bbc6 req-119a7c6d-6c55-42a4-875b-16790e9b4276 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:17.623821 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-64210943-4edc-4ae7-8744-aefaa9a6bbc6 req-119a7c6d-6c55-42a4-875b-16790e9b4276 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:17.652696 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-64210943-4edc-4ae7-8744-aefaa9a6bbc6 req-119a7c6d-6c55-42a4-875b-16790e9b4276 service nova] Creating event network-changed:0be1ebe4-f222-4d74-8298-cd63a4bc397c for instance 7f629426-c4e6-4c3f-8e54-efd452d14dd7 on n-h2-master-1 Oct 30 01:22:17.659285 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-64210943-4edc-4ae7-8744-aefaa9a6bbc6 req-119a7c6d-6c55-42a4-875b-16790e9b4276 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077222 Oct 30 01:22:17.660417 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1125/2287] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:22:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:22:17.670382 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-5532f123-4ba1-434e-992c-da281de8c5c0 req-947dfa9c-cadf-4b6b-9361-3894f61d9b33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3", "name": "network-vif-deleted", "tag": "158902f2-0cf8-4485-a0b9-8ba513a59715"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:22:17.684508 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-5532f123-4ba1-434e-992c-da281de8c5c0 req-947dfa9c-cadf-4b6b-9361-3894f61d9b33 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:17.685619 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-5532f123-4ba1-434e-992c-da281de8c5c0 req-947dfa9c-cadf-4b6b-9361-3894f61d9b33 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:17.686581 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-5532f123-4ba1-434e-992c-da281de8c5c0 req-947dfa9c-cadf-4b6b-9361-3894f61d9b33 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:17.694136 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:22:17.714413 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-5532f123-4ba1-434e-992c-da281de8c5c0 req-947dfa9c-cadf-4b6b-9361-3894f61d9b33 service nova] Creating event network-vif-deleted:158902f2-0cf8-4485-a0b9-8ba513a59715 for instance 6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3 on n-h1-master-1 Oct 30 01:22:17.727172 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-5532f123-4ba1-434e-992c-da281de8c5c0 req-947dfa9c-cadf-4b6b-9361-3894f61d9b33 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065120 Oct 30 01:22:17.728423 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1126/2288] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:22:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:22:17.746871 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-251b094b-9d0d-43d1-a0bc-f313a2124f2b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:17.747732 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-251b094b-9d0d-43d1-a0bc-f313a2124f2b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:17.755357 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-251b094b-9d0d-43d1-a0bc-f313a2124f2b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:17.756436 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-251b094b-9d0d-43d1-a0bc-f313a2124f2b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:17.756896 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-251b094b-9d0d-43d1-a0bc-f313a2124f2b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:17.757768 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-251b094b-9d0d-43d1-a0bc-f313a2124f2b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:17.758237 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-251b094b-9d0d-43d1-a0bc-f313a2124f2b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:17.758669 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-251b094b-9d0d-43d1-a0bc-f313a2124f2b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:17.817655 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-251b094b-9d0d-43d1-a0bc-f313a2124f2b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:17.825435 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-251b094b-9d0d-43d1-a0bc-f313a2124f2b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:17.826314 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-251b094b-9d0d-43d1-a0bc-f313a2124f2b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:17.826971 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-251b094b-9d0d-43d1-a0bc-f313a2124f2b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lazy-loading 'fault' on Instance uuid 6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:22:17.900396 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=16 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:22:18.494684 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-251b094b-9d0d-43d1-a0bc-f313a2124f2b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:18.515907 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-251b094b-9d0d-43d1-a0bc-f313a2124f2b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:18.521035 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-251b094b-9d0d-43d1-a0bc-f313a2124f2b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096bbb8aff742b1837931e52ac1c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301cee87901844ed94e635eca054960d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:18.529057 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-251b094b-9d0d-43d1-a0bc-f313a2124f2b tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3" status: 200 len: 1351 microversion: 2.25 time: 0.797117 Oct 30 01:22:18.535584 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1127/2289] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:22:17 2022] GET /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3 => generated 1351 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:22:18.549469 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b90b5aa2-3598-4397-a3f2-9e84b5abe6ad tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:18.550457 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b90b5aa2-3598-4397-a3f2-9e84b5abe6ad tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] [instance: 0c5133ba-8270-419a-80cb-43feb76f94c1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:18.559805 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b90b5aa2-3598-4397-a3f2-9e84b5abe6ad tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:18.568733 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b90b5aa2-3598-4397-a3f2-9e84b5abe6ad tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:18.568733 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b90b5aa2-3598-4397-a3f2-9e84b5abe6ad tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:18.568733 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b90b5aa2-3598-4397-a3f2-9e84b5abe6ad tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:18.568733 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b90b5aa2-3598-4397-a3f2-9e84b5abe6ad tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:18.569138 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b90b5aa2-3598-4397-a3f2-9e84b5abe6ad tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:18.630420 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8b084a5f-5aeb-49a8-bb0c-f0f4e5992414 tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/3b8691fb-f5d9-4334-9d86-af171e30c16b" status: 202 len: 0 microversion: 2.1 time: 2.253231 Oct 30 01:22:18.631470 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1163/2290] 10.222.0.13 () {58 vars in 1272 bytes} [Sun Oct 30 01:22:16 2022] DELETE /compute/v2.1/os-security-groups/3b8691fb-f5d9-4334-9d86-af171e30c16b => generated 0 bytes in 2255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:22:18.637839 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d5a5b996-f7a6-4fba-b026-1ec52132f794 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:18.639020 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d5a5b996-f7a6-4fba-b026-1ec52132f794 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7f629426-c4e6-4c3f-8e54-efd452d14dd7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:18.657236 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5a5b996-f7a6-4fba-b026-1ec52132f794 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:18.658334 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5a5b996-f7a6-4fba-b026-1ec52132f794 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:18.659094 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5a5b996-f7a6-4fba-b026-1ec52132f794 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:18.660478 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5a5b996-f7a6-4fba-b026-1ec52132f794 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:18.661596 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5a5b996-f7a6-4fba-b026-1ec52132f794 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:18.662409 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5a5b996-f7a6-4fba-b026-1ec52132f794 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:18.763119 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b90b5aa2-3598-4397-a3f2-9e84b5abe6ad tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e0e5acf53b4abe99c3418c82d47ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f383493aa6b46c9884b54cb82063b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:18.773131 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b90b5aa2-3598-4397-a3f2-9e84b5abe6ad tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] 10.222.0.13 "GET /compute/v2.1/servers/0c5133ba-8270-419a-80cb-43feb76f94c1" status: 200 len: 1282 microversion: 2.1 time: 0.231680 Oct 30 01:22:18.774646 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1128/2291] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:22:18 2022] GET /compute/v2.1/servers/0c5133ba-8270-419a-80cb-43feb76f94c1 => generated 1282 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:22:18.781664 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6cfd4d14-640e-48d7-8400-22f03877fec3 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:18.782443 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6cfd4d14-640e-48d7-8400-22f03877fec3 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:18.832723 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6cfd4d14-640e-48d7-8400-22f03877fec3 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:18.836703 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6cfd4d14-640e-48d7-8400-22f03877fec3 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:18.837433 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6cfd4d14-640e-48d7-8400-22f03877fec3 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:18.840923 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6cfd4d14-640e-48d7-8400-22f03877fec3 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:18.846019 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6cfd4d14-640e-48d7-8400-22f03877fec3 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:18.854238 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6cfd4d14-640e-48d7-8400-22f03877fec3 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:19.020169 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6cfd4d14-640e-48d7-8400-22f03877fec3 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:19.030338 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6cfd4d14-640e-48d7-8400-22f03877fec3 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:19.036082 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6cfd4d14-640e-48d7-8400-22f03877fec3 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:19.054230 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6cfd4d14-640e-48d7-8400-22f03877fec3 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1546 microversion: 2.91 time: 0.277527 Oct 30 01:22:19.055516 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1129/2292] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:22:18 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1546 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:22:19.061125 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a55b8dfe-9097-4b3f-89bb-e862bb1718b5 tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] Calling method '.version_select at 0x7f44cc4c7820>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:19.407294 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d5a5b996-f7a6-4fba-b026-1ec52132f794 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:19.448568 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d5a5b996-f7a6-4fba-b026-1ec52132f794 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7" status: 200 len: 1314 microversion: 2.1 time: 0.814229 Oct 30 01:22:19.451656 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1164/2293] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:22:18 2022] GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7 => generated 1314 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:22:19.578770 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-dad1224e-0dc5-4e86-a874-091146514698 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:19.580858 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-dad1224e-0dc5-4e86-a874-091146514698 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] [instance: 6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:19.596096 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dad1224e-0dc5-4e86-a874-091146514698 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:19.598963 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dad1224e-0dc5-4e86-a874-091146514698 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:19.602429 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dad1224e-0dc5-4e86-a874-091146514698 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:19.604139 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dad1224e-0dc5-4e86-a874-091146514698 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:19.607557 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dad1224e-0dc5-4e86-a874-091146514698 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:19.608683 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dad1224e-0dc5-4e86-a874-091146514698 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:19.650271 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-dad1224e-0dc5-4e86-a874-091146514698 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] HTTP exception thrown: Instance 6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3 could not be found. Oct 30 01:22:19.656660 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-dad1224e-0dc5-4e86-a874-091146514698 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Request method failure captured: Oct 30 01:22:19.656660 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3 HTTP/1.1 Oct 30 01:22:19.656660 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:22:19.656660 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:22:19.656660 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:22:19.656660 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:22:19.656660 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:22:19.656660 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:22:19.656660 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:22:19.656660 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:22:19.656660 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXc_0mq1CplEa1aPZYhbxi5TgeBxQWTmjClFo0UfdQuaAzHtvsfPo7DIwhN5B-1KrVIJgRZREDX2FdwcYtrgO-sGBBjWKIgNfqF5a_ixLdQhWHkdNNoRoBEy0QOJ0a8XcozziR4bS4aIcMvE2mkuQo7KqsWXnzNtZabfb-7ZRMd_V1QY Oct 30 01:22:19.656660 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:22:19.656660 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:22:19.656660 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:22:19.656660 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:22:19.656660 n-d-master-1 devstack@n-api.service[121102]: X-Openstack-Nova-Api-Version: 2.25 Oct 30 01:22:19.656660 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:22:19.656660 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:22:19.656660 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 301cee87901844ed94e635eca054960d Oct 30 01:22:19.656660 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1274178165 Oct 30 01:22:19.656660 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:22:19.656660 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:22:19.658437 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/301cee87901844ed94e635eca054960d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_301cee87901844ed94e635eca054960d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/301cee87901844ed94e635eca054960d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/301cee87901844ed94e635eca054960d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:22:19.658437 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1274178165 Oct 30 01:22:19.658437 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 301cee87901844ed94e635eca054960d Oct 30 01:22:19.658437 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1274178165 Oct 30 01:22:19.658437 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-LiveAutoBlockMigrationV225Test-1274178165-project Oct 30 01:22:19.658437 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:22:19.658437 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:22:19.658437 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 2096bbb8aff742b1837931e52ac1c9ae Oct 30 01:22:19.658437 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1274178165-project Oct 30 01:22:19.658437 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:22:19.658437 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3 could not be found. Oct 30 01:22:19.658437 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3'} Oct 30 01:22:19.662221 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:22:19.662221 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:22:19.662221 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:22:19.662221 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:22:19.662221 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:22:19.662221 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:22:19.662221 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:22:19.662221 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:22:19.662221 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:22:19.662221 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:22:19.662221 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3 could not be found. Oct 30 01:22:19.662221 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:19.662221 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:22:19.662221 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:19.662221 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:22:19.662221 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:22:19.662221 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:22:19.662221 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:22:19.662221 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:22:19.662221 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:22:19.664101 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:22:19.664101 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:22:19.664101 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:22:19.664101 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:22:19.664101 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:22:19.664101 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:22:19.664101 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:22:19.664101 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3 could not be found. Oct 30 01:22:19.664101 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:19.664101 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:22:19.664101 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:19.664101 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:22:19.664101 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:22:19.664101 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:22:19.664101 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:22:19.664101 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:22:19.664101 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3 could not be found. Oct 30 01:22:19.664101 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:22:19.671451 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-dad1224e-0dc5-4e86-a874-091146514698 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] Returning 404 to user: Instance 6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:22:19.672668 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-dad1224e-0dc5-4e86-a874-091146514698 tempest-LiveAutoBlockMigrationV225Test-1274178165 tempest-LiveAutoBlockMigrationV225Test-1274178165-project] 10.222.0.13 "GET /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3" status: 404 len: 111 microversion: 2.25 time: 0.100183 Oct 30 01:22:19.679796 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1165/2294] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:22:19 2022] GET /compute/v2.1/servers/6c20ab8e-0b0a-4946-9c34-08ab3efb1ac3 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 30 01:22:19.800515 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-11edbf1b-8a38-425a-852a-02c47256d4e9 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:19.801453 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-11edbf1b-8a38-425a-852a-02c47256d4e9 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] [instance: 0c5133ba-8270-419a-80cb-43feb76f94c1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:19.816630 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-11edbf1b-8a38-425a-852a-02c47256d4e9 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:19.819455 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-11edbf1b-8a38-425a-852a-02c47256d4e9 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:19.820190 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-11edbf1b-8a38-425a-852a-02c47256d4e9 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:19.821410 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-11edbf1b-8a38-425a-852a-02c47256d4e9 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:19.824290 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-11edbf1b-8a38-425a-852a-02c47256d4e9 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:19.825803 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-11edbf1b-8a38-425a-852a-02c47256d4e9 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:20.754664 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:22:20.789086 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=24 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:22:20.812879 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a55b8dfe-9097-4b3f-89bb-e862bb1718b5 tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/0d1c98b2-a1e6-4608-839f-a88676dfbeab" status: 202 len: 0 microversion: 2.1 time: 1.755647 Oct 30 01:22:20.814116 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1130/2295] 10.222.0.13 () {58 vars in 1272 bytes} [Sun Oct 30 01:22:19 2022] DELETE /compute/v2.1/os-security-groups/0d1c98b2-a1e6-4608-839f-a88676dfbeab => generated 0 bytes in 1758 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:22:20.824054 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ec734e2b-8bff-475a-a15b-dd78c986ce25 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:20.826495 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ec734e2b-8bff-475a-a15b-dd78c986ce25 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:20.858506 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ec734e2b-8bff-475a-a15b-dd78c986ce25 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:20.863988 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ec734e2b-8bff-475a-a15b-dd78c986ce25 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:20.865580 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ec734e2b-8bff-475a-a15b-dd78c986ce25 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:20.870318 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ec734e2b-8bff-475a-a15b-dd78c986ce25 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:20.871933 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ec734e2b-8bff-475a-a15b-dd78c986ce25 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:20.878025 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ec734e2b-8bff-475a-a15b-dd78c986ce25 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:21.492755 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-11edbf1b-8a38-425a-852a-02c47256d4e9 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e0e5acf53b4abe99c3418c82d47ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f383493aa6b46c9884b54cb82063b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:21.515013 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-11edbf1b-8a38-425a-852a-02c47256d4e9 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] 10.222.0.13 "GET /compute/v2.1/servers/0c5133ba-8270-419a-80cb-43feb76f94c1" status: 200 len: 1350 microversion: 2.1 time: 1.720059 Oct 30 01:22:21.521668 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1166/2296] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:22:19 2022] GET /compute/v2.1/servers/0c5133ba-8270-419a-80cb-43feb76f94c1 => generated 1350 bytes in 1727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:22:21.523621 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ec734e2b-8bff-475a-a15b-dd78c986ce25 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:21.536815 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-975ce743-6ebd-4c94-bcd4-5d3dd5cc294c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:21.538748 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ec734e2b-8bff-475a-a15b-dd78c986ce25 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:21.547904 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-975ce743-6ebd-4c94-bcd4-5d3dd5cc294c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7f629426-c4e6-4c3f-8e54-efd452d14dd7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:21.548150 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ec734e2b-8bff-475a-a15b-dd78c986ce25 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:21.565769 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-975ce743-6ebd-4c94-bcd4-5d3dd5cc294c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:21.567782 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-975ce743-6ebd-4c94-bcd4-5d3dd5cc294c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:21.570974 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-975ce743-6ebd-4c94-bcd4-5d3dd5cc294c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:21.570974 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-975ce743-6ebd-4c94-bcd4-5d3dd5cc294c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:21.571217 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ec734e2b-8bff-475a-a15b-dd78c986ce25 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1546 microversion: 2.91 time: 0.753640 Oct 30 01:22:21.571329 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-975ce743-6ebd-4c94-bcd4-5d3dd5cc294c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:21.571329 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-975ce743-6ebd-4c94-bcd4-5d3dd5cc294c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:21.571519 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1131/2297] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:22:20 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1546 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:22:21.588044 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-77891b05-46c7-42aa-bece-dee25d247c1a tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] Calling method '.version_select at 0x7f44c7ea75e0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:22.090158 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:22:22.950571 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-975ce743-6ebd-4c94-bcd4-5d3dd5cc294c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:22.959150 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-975ce743-6ebd-4c94-bcd4-5d3dd5cc294c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7" status: 200 len: 1314 microversion: 2.1 time: 1.436110 Oct 30 01:22:22.964043 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1167/2298] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:22:21 2022] GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7 => generated 1314 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:22:22.984480 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ee146f6e-39d1-4143-a079-96e172d4d87b tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:22.985227 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ee146f6e-39d1-4143-a079-96e172d4d87b tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] [instance: 0c5133ba-8270-419a-80cb-43feb76f94c1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:23.009254 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee146f6e-39d1-4143-a079-96e172d4d87b tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:23.012242 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee146f6e-39d1-4143-a079-96e172d4d87b tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:23.012242 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee146f6e-39d1-4143-a079-96e172d4d87b tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:23.012242 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee146f6e-39d1-4143-a079-96e172d4d87b tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:23.012242 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee146f6e-39d1-4143-a079-96e172d4d87b tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:23.012648 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee146f6e-39d1-4143-a079-96e172d4d87b tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:24.783491 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-77891b05-46c7-42aa-bece-dee25d247c1a tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/40fffad4-2972-45d7-80cb-72a91f87d005" status: 202 len: 0 microversion: 2.1 time: 3.210538 Oct 30 01:22:24.795690 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1132/2299] 10.222.0.13 () {58 vars in 1272 bytes} [Sun Oct 30 01:22:21 2022] DELETE /compute/v2.1/os-security-groups/40fffad4-2972-45d7-80cb-72a91f87d005 => generated 0 bytes in 3224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:22:24.801385 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-dedf8eb9-c744-4ed1-b26f-fafd95f2f0e4 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:24.804523 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-dedf8eb9-c744-4ed1-b26f-fafd95f2f0e4 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:24.811557 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ee146f6e-39d1-4143-a079-96e172d4d87b tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e0e5acf53b4abe99c3418c82d47ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f383493aa6b46c9884b54cb82063b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:24.832916 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ee146f6e-39d1-4143-a079-96e172d4d87b tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] 10.222.0.13 "GET /compute/v2.1/servers/0c5133ba-8270-419a-80cb-43feb76f94c1" status: 200 len: 1350 microversion: 2.1 time: 1.867652 Oct 30 01:22:24.839683 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1168/2300] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:22:22 2022] GET /compute/v2.1/servers/0c5133ba-8270-419a-80cb-43feb76f94c1 => generated 1350 bytes in 1875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:22:24.857402 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dedf8eb9-c744-4ed1-b26f-fafd95f2f0e4 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:24.858131 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dedf8eb9-c744-4ed1-b26f-fafd95f2f0e4 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:24.858770 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dedf8eb9-c744-4ed1-b26f-fafd95f2f0e4 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:24.865460 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5c83bae2-f869-46c4-86d8-babfc3b72b58 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:24.866108 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5c83bae2-f869-46c4-86d8-babfc3b72b58 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7f629426-c4e6-4c3f-8e54-efd452d14dd7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:24.868013 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dedf8eb9-c744-4ed1-b26f-fafd95f2f0e4 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:24.870306 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dedf8eb9-c744-4ed1-b26f-fafd95f2f0e4 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:24.872281 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dedf8eb9-c744-4ed1-b26f-fafd95f2f0e4 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:24.911042 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c83bae2-f869-46c4-86d8-babfc3b72b58 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:24.913074 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c83bae2-f869-46c4-86d8-babfc3b72b58 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:24.920084 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c83bae2-f869-46c4-86d8-babfc3b72b58 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:24.922131 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c83bae2-f869-46c4-86d8-babfc3b72b58 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:24.924014 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c83bae2-f869-46c4-86d8-babfc3b72b58 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:24.926770 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c83bae2-f869-46c4-86d8-babfc3b72b58 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:25.485415 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-dedf8eb9-c744-4ed1-b26f-fafd95f2f0e4 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:25.510616 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-dedf8eb9-c744-4ed1-b26f-fafd95f2f0e4 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:25.512249 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-dedf8eb9-c744-4ed1-b26f-fafd95f2f0e4 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:25.518667 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-dedf8eb9-c744-4ed1-b26f-fafd95f2f0e4 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1546 microversion: 2.91 time: 0.721575 Oct 30 01:22:25.519880 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1133/2301] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:22:24 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1546 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:22:25.539021 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3f18e0ca-0b14-4f2b-887e-a613e224b6bb tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] Calling method '.version_select at 0x7f44cc4c78b0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:26.148738 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5c83bae2-f869-46c4-86d8-babfc3b72b58 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:26.178514 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5c83bae2-f869-46c4-86d8-babfc3b72b58 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7" status: 200 len: 1314 microversion: 2.1 time: 1.323077 Oct 30 01:22:26.179820 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1169/2302] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:22:24 2022] GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7 => generated 1314 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:22:26.188456 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-394c693d-faa7-40ff-9655-b96937e417b0 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:26.190087 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-394c693d-faa7-40ff-9655-b96937e417b0 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] [instance: 0c5133ba-8270-419a-80cb-43feb76f94c1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:26.204419 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-394c693d-faa7-40ff-9655-b96937e417b0 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:26.205907 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-394c693d-faa7-40ff-9655-b96937e417b0 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:26.210319 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-394c693d-faa7-40ff-9655-b96937e417b0 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:26.211415 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-394c693d-faa7-40ff-9655-b96937e417b0 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:26.212119 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-394c693d-faa7-40ff-9655-b96937e417b0 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:26.214406 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-394c693d-faa7-40ff-9655-b96937e417b0 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:27.019732 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-394c693d-faa7-40ff-9655-b96937e417b0 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e0e5acf53b4abe99c3418c82d47ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f383493aa6b46c9884b54cb82063b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:27.059529 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-394c693d-faa7-40ff-9655-b96937e417b0 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] 10.222.0.13 "GET /compute/v2.1/servers/0c5133ba-8270-419a-80cb-43feb76f94c1" status: 200 len: 1350 microversion: 2.1 time: 0.877850 Oct 30 01:22:27.066021 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1170/2303] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:22:26 2022] GET /compute/v2.1/servers/0c5133ba-8270-419a-80cb-43feb76f94c1 => generated 1350 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:22:27.071376 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-fbfb3bae-3252-45cd-812c-1027531e2d61 req-dda0b822-d0b1-4604-a8f2-56242f20dca1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f629426-c4e6-4c3f-8e54-efd452d14dd7", "name": "network-vif-plugged", "status": "completed", "tag": "0be1ebe4-f222-4d74-8298-cd63a4bc397c"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:22:27.093021 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-fbfb3bae-3252-45cd-812c-1027531e2d61 req-dda0b822-d0b1-4604-a8f2-56242f20dca1 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:27.094150 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-fbfb3bae-3252-45cd-812c-1027531e2d61 req-dda0b822-d0b1-4604-a8f2-56242f20dca1 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:27.094966 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-fbfb3bae-3252-45cd-812c-1027531e2d61 req-dda0b822-d0b1-4604-a8f2-56242f20dca1 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:27.125494 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-fbfb3bae-3252-45cd-812c-1027531e2d61 req-dda0b822-d0b1-4604-a8f2-56242f20dca1 service nova] Creating event network-vif-plugged:0be1ebe4-f222-4d74-8298-cd63a4bc397c for instance 7f629426-c4e6-4c3f-8e54-efd452d14dd7 on n-h2-master-1 Oct 30 01:22:27.131373 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-fbfb3bae-3252-45cd-812c-1027531e2d61 req-dda0b822-d0b1-4604-a8f2-56242f20dca1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063813 Oct 30 01:22:27.132299 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1171/2304] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:22:27.141084 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c3b876ab-5370-4b29-8145-ea012d79d791 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:27.142194 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c3b876ab-5370-4b29-8145-ea012d79d791 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:27.170713 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c3b876ab-5370-4b29-8145-ea012d79d791 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:27.171332 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c3b876ab-5370-4b29-8145-ea012d79d791 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:27.175586 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c3b876ab-5370-4b29-8145-ea012d79d791 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:27.176716 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c3b876ab-5370-4b29-8145-ea012d79d791 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:27.180069 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c3b876ab-5370-4b29-8145-ea012d79d791 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:27.180808 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c3b876ab-5370-4b29-8145-ea012d79d791 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:27.461491 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3f18e0ca-0b14-4f2b-887e-a613e224b6bb tempest-SecurityGroupRulesNegativeTestJSON-1000406765 tempest-SecurityGroupRulesNegativeTestJSON-1000406765-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/047ac7a0-46dd-4387-ad1b-01fa3590ba4f" status: 202 len: 0 microversion: 2.1 time: 1.940286 Oct 30 01:22:27.463557 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1134/2305] 10.222.0.13 () {58 vars in 1272 bytes} [Sun Oct 30 01:22:25 2022] DELETE /compute/v2.1/os-security-groups/047ac7a0-46dd-4387-ad1b-01fa3590ba4f => generated 0 bytes in 1942 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:22:27.814534 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c3b876ab-5370-4b29-8145-ea012d79d791 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:27.824941 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c3b876ab-5370-4b29-8145-ea012d79d791 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:27.838352 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4608aef9-7ecd-48d9-8458-b65700825d96 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1726023257", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "7284c157-9cb4-471c-9d5a-e380f7e549f5"}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:22:27.851513 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c3b876ab-5370-4b29-8145-ea012d79d791 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:27.884380 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c3b876ab-5370-4b29-8145-ea012d79d791 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1546 microversion: 2.91 time: 0.750254 Oct 30 01:22:27.896433 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1172/2306] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:22:27 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1546 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:22:27.896433 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2b822553-68d0-4b36-8dd7-067fc9f6d4d3 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:27.896433 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2b822553-68d0-4b36-8dd7-067fc9f6d4d3 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7f629426-c4e6-4c3f-8e54-efd452d14dd7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:27.937123 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2b822553-68d0-4b36-8dd7-067fc9f6d4d3 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:27.939663 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2b822553-68d0-4b36-8dd7-067fc9f6d4d3 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:27.944340 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2b822553-68d0-4b36-8dd7-067fc9f6d4d3 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:27.945545 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2b822553-68d0-4b36-8dd7-067fc9f6d4d3 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:27.951724 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2b822553-68d0-4b36-8dd7-067fc9f6d4d3 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:27.954355 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2b822553-68d0-4b36-8dd7-067fc9f6d4d3 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:28.002730 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-4608aef9-7ecd-48d9-8458-b65700825d96 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] validate_networks() for [('7284c157-9cb4-471c-9d5a-e380f7e549f5', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:22:29.542868 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2b822553-68d0-4b36-8dd7-067fc9f6d4d3 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:29.557075 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2b822553-68d0-4b36-8dd7-067fc9f6d4d3 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7" status: 200 len: 1314 microversion: 2.1 time: 1.666640 Oct 30 01:22:29.562168 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1173/2307] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:22:27 2022] GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7 => generated 1314 bytes in 1672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:22:29.575072 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-57ec8f58-b112-4e32-9fac-aab6a5b66505 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:29.575895 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-57ec8f58-b112-4e32-9fac-aab6a5b66505 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] [instance: 0c5133ba-8270-419a-80cb-43feb76f94c1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:29.601268 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-57ec8f58-b112-4e32-9fac-aab6a5b66505 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:29.601852 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-57ec8f58-b112-4e32-9fac-aab6a5b66505 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:29.602298 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-57ec8f58-b112-4e32-9fac-aab6a5b66505 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:29.603039 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-57ec8f58-b112-4e32-9fac-aab6a5b66505 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:29.603544 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-57ec8f58-b112-4e32-9fac-aab6a5b66505 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:29.603992 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-57ec8f58-b112-4e32-9fac-aab6a5b66505 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:31.386433 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-57ec8f58-b112-4e32-9fac-aab6a5b66505 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e0e5acf53b4abe99c3418c82d47ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f383493aa6b46c9884b54cb82063b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:31.404339 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-57ec8f58-b112-4e32-9fac-aab6a5b66505 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] 10.222.0.13 "GET /compute/v2.1/servers/0c5133ba-8270-419a-80cb-43feb76f94c1" status: 200 len: 1350 microversion: 2.1 time: 1.840871 Oct 30 01:22:31.405101 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1174/2308] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:22:29 2022] GET /compute/v2.1/servers/0c5133ba-8270-419a-80cb-43feb76f94c1 => generated 1350 bytes in 1842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:22:31.414995 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-548a72cb-b3a1-4b9e-ad14-9d884b2d5bac req-3ff6ddab-0f66-4e5c-af13-3aed1459905f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c5133ba-8270-419a-80cb-43feb76f94c1", "tag": "160f2013-8ad6-419e-a7f1-6a2b4d7e1229"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:22:31.427716 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-548a72cb-b3a1-4b9e-ad14-9d884b2d5bac req-3ff6ddab-0f66-4e5c-af13-3aed1459905f service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:31.428442 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-548a72cb-b3a1-4b9e-ad14-9d884b2d5bac req-3ff6ddab-0f66-4e5c-af13-3aed1459905f service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:31.429171 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-548a72cb-b3a1-4b9e-ad14-9d884b2d5bac req-3ff6ddab-0f66-4e5c-af13-3aed1459905f service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:31.448000 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-548a72cb-b3a1-4b9e-ad14-9d884b2d5bac req-3ff6ddab-0f66-4e5c-af13-3aed1459905f service nova] Creating event network-changed:160f2013-8ad6-419e-a7f1-6a2b4d7e1229 for instance 0c5133ba-8270-419a-80cb-43feb76f94c1 on n-h1-master-1 Oct 30 01:22:31.454404 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-548a72cb-b3a1-4b9e-ad14-9d884b2d5bac req-3ff6ddab-0f66-4e5c-af13-3aed1459905f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047947 Oct 30 01:22:31.455751 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1175/2309] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:22:31.464961 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3eb96a36-08c1-4e27-9a16-f491aca02467 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:31.467372 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3eb96a36-08c1-4e27-9a16-f491aca02467 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:31.479389 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3eb96a36-08c1-4e27-9a16-f491aca02467 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:31.480547 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3eb96a36-08c1-4e27-9a16-f491aca02467 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:31.481794 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3eb96a36-08c1-4e27-9a16-f491aca02467 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:31.496879 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3eb96a36-08c1-4e27-9a16-f491aca02467 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:31.498769 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3eb96a36-08c1-4e27-9a16-f491aca02467 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:31.499525 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3eb96a36-08c1-4e27-9a16-f491aca02467 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:32.123544 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3eb96a36-08c1-4e27-9a16-f491aca02467 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:32.141737 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3eb96a36-08c1-4e27-9a16-f491aca02467 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:32.143038 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3eb96a36-08c1-4e27-9a16-f491aca02467 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:32.165637 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3eb96a36-08c1-4e27-9a16-f491aca02467 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1546 microversion: 2.91 time: 0.708414 Oct 30 01:22:32.166784 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1176/2310] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:22:31 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1546 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:22:32.179838 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f4210bb8-346e-45f1-b35b-7f74e56e2c2f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:32.180686 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f4210bb8-346e-45f1-b35b-7f74e56e2c2f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7f629426-c4e6-4c3f-8e54-efd452d14dd7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:32.195374 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f4210bb8-346e-45f1-b35b-7f74e56e2c2f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:32.196131 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f4210bb8-346e-45f1-b35b-7f74e56e2c2f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:32.196561 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f4210bb8-346e-45f1-b35b-7f74e56e2c2f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:32.208466 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f4210bb8-346e-45f1-b35b-7f74e56e2c2f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:32.210134 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f4210bb8-346e-45f1-b35b-7f74e56e2c2f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:32.210722 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f4210bb8-346e-45f1-b35b-7f74e56e2c2f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:33.522285 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f4210bb8-346e-45f1-b35b-7f74e56e2c2f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:33.536083 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f4210bb8-346e-45f1-b35b-7f74e56e2c2f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7" status: 200 len: 1501 microversion: 2.1 time: 1.368063 Oct 30 01:22:33.536703 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1177/2311] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:22:32 2022] GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7 => generated 1501 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:22:33.544933 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f706f89e-7f72-4790-a09e-49883ac2ff16 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:33.545580 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f706f89e-7f72-4790-a09e-49883ac2ff16 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] [instance: 0c5133ba-8270-419a-80cb-43feb76f94c1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:33.559869 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f706f89e-7f72-4790-a09e-49883ac2ff16 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:33.560858 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f706f89e-7f72-4790-a09e-49883ac2ff16 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:33.561833 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f706f89e-7f72-4790-a09e-49883ac2ff16 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:33.562778 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f706f89e-7f72-4790-a09e-49883ac2ff16 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:33.563530 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f706f89e-7f72-4790-a09e-49883ac2ff16 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:33.564163 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f706f89e-7f72-4790-a09e-49883ac2ff16 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:33.612732 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-4608aef9-7ecd-48d9-8458-b65700825d96 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:22:33.613233 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-4608aef9-7ecd-48d9-8458-b65700825d96 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:22:33.613765 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-4608aef9-7ecd-48d9-8458-b65700825d96 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:22:33.614377 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-4608aef9-7ecd-48d9-8458-b65700825d96 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:22:33.614811 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-4608aef9-7ecd-48d9-8458-b65700825d96 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:22:33.648072 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4608aef9-7ecd-48d9-8458-b65700825d96 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:33.648619 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4608aef9-7ecd-48d9-8458-b65700825d96 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:33.649070 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4608aef9-7ecd-48d9-8458-b65700825d96 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:33.649997 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4608aef9-7ecd-48d9-8458-b65700825d96 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:33.650497 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4608aef9-7ecd-48d9-8458-b65700825d96 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:33.650937 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4608aef9-7ecd-48d9-8458-b65700825d96 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:33.675513 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-4608aef9-7ecd-48d9-8458-b65700825d96 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Getting quotas for project 4cd1868480e44540be85a8c2862cd780. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:22:33.684375 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-4608aef9-7ecd-48d9-8458-b65700825d96 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Getting quotas for user 055b96d1eb20418d96450efde939e020 and project 4cd1868480e44540be85a8c2862cd780. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:22:33.698182 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4608aef9-7ecd-48d9-8458-b65700825d96 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Going to run 3 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:22:33.700924 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4608aef9-7ecd-48d9-8458-b65700825d96 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] [instance: 33403d18-1832-4c1f-a824-150b5fbfd22f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:22:33.800844 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4608aef9-7ecd-48d9-8458-b65700825d96 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] [instance: 23cbc0a6-6137-4e64-b264-c67fceba507f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=33403d18-1832-4c1f-a824-150b5fbfd22f,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:22:33.920912 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4608aef9-7ecd-48d9-8458-b65700825d96 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] [instance: 81251939-4cb0-4e30-828c-648f5a48888e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=23cbc0a6-6137-4e64-b264-c67fceba507f,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:22:34.114704 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4608aef9-7ecd-48d9-8458-b65700825d96 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.649513 Oct 30 01:22:34.117395 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1135/2312] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:22:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 6653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:22:34.125146 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-19902e65-96f5-47e2-9e4c-527998e61c91 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:34.126019 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-19902e65-96f5-47e2-9e4c-527998e61c91 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:34.134777 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-19902e65-96f5-47e2-9e4c-527998e61c91 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:34.135614 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-19902e65-96f5-47e2-9e4c-527998e61c91 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:34.139456 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-19902e65-96f5-47e2-9e4c-527998e61c91 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:34.140563 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-19902e65-96f5-47e2-9e4c-527998e61c91 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:34.141268 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-19902e65-96f5-47e2-9e4c-527998e61c91 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:34.141936 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-19902e65-96f5-47e2-9e4c-527998e61c91 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:34.219155 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f706f89e-7f72-4790-a09e-49883ac2ff16 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e0e5acf53b4abe99c3418c82d47ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f383493aa6b46c9884b54cb82063b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:34.230160 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f706f89e-7f72-4790-a09e-49883ac2ff16 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] 10.222.0.13 "GET /compute/v2.1/servers/0c5133ba-8270-419a-80cb-43feb76f94c1" status: 200 len: 1350 microversion: 2.1 time: 0.692384 Oct 30 01:22:34.235474 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1178/2313] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:22:33 2022] GET /compute/v2.1/servers/0c5133ba-8270-419a-80cb-43feb76f94c1 => generated 1350 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:22:34.240678 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-37cbed4b-7fbc-4747-b623-7ded09aee8fa tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:22:34.242648 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-37cbed4b-7fbc-4747-b623-7ded09aee8fa tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7f629426-c4e6-4c3f-8e54-efd452d14dd7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:34.254487 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:22:34.262175 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-37cbed4b-7fbc-4747-b623-7ded09aee8fa tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:34.262175 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-37cbed4b-7fbc-4747-b623-7ded09aee8fa tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:34.262175 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-37cbed4b-7fbc-4747-b623-7ded09aee8fa tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:34.266099 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-37cbed4b-7fbc-4747-b623-7ded09aee8fa tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:34.269874 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-37cbed4b-7fbc-4747-b623-7ded09aee8fa tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:34.272516 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-37cbed4b-7fbc-4747-b623-7ded09aee8fa tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:34.296471 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-19902e65-96f5-47e2-9e4c-527998e61c91 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:34.303935 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-37cbed4b-7fbc-4747-b623-7ded09aee8fa tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lazy-loading 'flavor' on Instance uuid 7f629426-c4e6-4c3f-8e54-efd452d14dd7 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:22:34.317761 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-19902e65-96f5-47e2-9e4c-527998e61c91 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:34.319580 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-19902e65-96f5-47e2-9e4c-527998e61c91 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:34.328410 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-19902e65-96f5-47e2-9e4c-527998e61c91 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1546 microversion: 2.91 time: 0.209755 Oct 30 01:22:34.343506 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1136/2314] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:22:34 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1546 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:22:34.357727 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e7dcc43a-0a31-4bc9-ae3b-48e4bc74c2c2 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:34.363195 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e7dcc43a-0a31-4bc9-ae3b-48e4bc74c2c2 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '055b96d1eb20418d96450efde939e020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1868480e44540be85a8c2862cd780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:34.364029 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e7dcc43a-0a31-4bc9-ae3b-48e4bc74c2c2 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Searching by: {'deleted': False, 'project_id': '4cd1868480e44540be85a8c2862cd780'} {{(pid=121103) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 30 01:22:34.388926 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7dcc43a-0a31-4bc9-ae3b-48e4bc74c2c2 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:34.389961 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7dcc43a-0a31-4bc9-ae3b-48e4bc74c2c2 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:34.390410 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7dcc43a-0a31-4bc9-ae3b-48e4bc74c2c2 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:34.391217 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7dcc43a-0a31-4bc9-ae3b-48e4bc74c2c2 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:34.391868 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7dcc43a-0a31-4bc9-ae3b-48e4bc74c2c2 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:34.392046 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7dcc43a-0a31-4bc9-ae3b-48e4bc74c2c2 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:34.420682 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e7dcc43a-0a31-4bc9-ae3b-48e4bc74c2c2 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.075554 Oct 30 01:22:34.421711 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1137/2315] 10.222.0.13 () {58 vars in 1125 bytes} [Sun Oct 30 01:22:34 2022] GET /compute/v2.1/servers => generated 1018 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:22:34.447243 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7c6db58a-2c4a-4eb8-8753-3d993ba79f9f tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:34.449721 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7c6db58a-2c4a-4eb8-8753-3d993ba79f9f tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] [instance: 81251939-4cb0-4e30-828c-648f5a48888e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:34.638644 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7c6db58a-2c4a-4eb8-8753-3d993ba79f9f tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055b96d1eb20418d96450efde939e020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1868480e44540be85a8c2862cd780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:34.648133 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:22:34.651750 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7c6db58a-2c4a-4eb8-8753-3d993ba79f9f tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] 10.222.0.13 "GET /compute/v2.1/servers/81251939-4cb0-4e30-828c-648f5a48888e" status: 200 len: 1223 microversion: 2.1 time: 0.212657 Oct 30 01:22:34.653242 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1138/2316] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:22:34 2022] GET /compute/v2.1/servers/81251939-4cb0-4e30-828c-648f5a48888e => generated 1223 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:22:35.122614 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-37cbed4b-7fbc-4747-b623-7ded09aee8fa tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "POST /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7/action" status: 202 len: 0 microversion: 2.1 time: 0.885519 Oct 30 01:22:35.123763 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1179/2317] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:22:34 2022] POST /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7/action => generated 0 bytes in 888 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:22:35.132754 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-058bbb43-7ea2-49be-aed3-031e6754515b tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:35.133409 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-058bbb43-7ea2-49be-aed3-031e6754515b tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7f629426-c4e6-4c3f-8e54-efd452d14dd7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:35.143594 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-058bbb43-7ea2-49be-aed3-031e6754515b tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:35.144107 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-058bbb43-7ea2-49be-aed3-031e6754515b tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:35.147166 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-058bbb43-7ea2-49be-aed3-031e6754515b tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:35.148005 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-058bbb43-7ea2-49be-aed3-031e6754515b tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:35.148506 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-058bbb43-7ea2-49be-aed3-031e6754515b tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:35.148941 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-058bbb43-7ea2-49be-aed3-031e6754515b tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:35.264308 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fb9d470e-d2f6-4f60-aad6-55605fda14fe tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:35.265520 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fb9d470e-d2f6-4f60-aad6-55605fda14fe tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] [instance: 0c5133ba-8270-419a-80cb-43feb76f94c1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:35.284650 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb9d470e-d2f6-4f60-aad6-55605fda14fe tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:35.286985 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb9d470e-d2f6-4f60-aad6-55605fda14fe tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:35.288310 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb9d470e-d2f6-4f60-aad6-55605fda14fe tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:35.289262 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb9d470e-d2f6-4f60-aad6-55605fda14fe tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:35.294017 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb9d470e-d2f6-4f60-aad6-55605fda14fe tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:35.295131 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb9d470e-d2f6-4f60-aad6-55605fda14fe tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:36.057370 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-fb9d470e-d2f6-4f60-aad6-55605fda14fe tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e0e5acf53b4abe99c3418c82d47ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f383493aa6b46c9884b54cb82063b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:36.065839 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fb9d470e-d2f6-4f60-aad6-55605fda14fe tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] 10.222.0.13 "GET /compute/v2.1/servers/0c5133ba-8270-419a-80cb-43feb76f94c1" status: 200 len: 1350 microversion: 2.1 time: 0.808009 Oct 30 01:22:36.066428 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1180/2318] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:22:35 2022] GET /compute/v2.1/servers/0c5133ba-8270-419a-80cb-43feb76f94c1 => generated 1350 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:22:36.080672 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-54f9e398-1b58-497c-8072-7950a851ad6e tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:36.083994 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-54f9e398-1b58-497c-8072-7950a851ad6e tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:36.090057 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-058bbb43-7ea2-49be-aed3-031e6754515b tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:36.101187 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-058bbb43-7ea2-49be-aed3-031e6754515b tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7" status: 200 len: 1507 microversion: 2.1 time: 0.969781 Oct 30 01:22:36.101277 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-54f9e398-1b58-497c-8072-7950a851ad6e tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:36.101277 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-54f9e398-1b58-497c-8072-7950a851ad6e tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:36.101277 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-54f9e398-1b58-497c-8072-7950a851ad6e tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:36.101277 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-54f9e398-1b58-497c-8072-7950a851ad6e tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:36.101632 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-54f9e398-1b58-497c-8072-7950a851ad6e tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:36.105376 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1139/2319] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:22:35 2022] GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7 => generated 1507 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:22:36.105951 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-54f9e398-1b58-497c-8072-7950a851ad6e tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:36.110602 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-dc07c925-7419-476b-ad16-9571e7b42093 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:36.127412 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-dc07c925-7419-476b-ad16-9571e7b42093 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] [instance: 81251939-4cb0-4e30-828c-648f5a48888e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:36.334928 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-dc07c925-7419-476b-ad16-9571e7b42093 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055b96d1eb20418d96450efde939e020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1868480e44540be85a8c2862cd780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:36.354641 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-dc07c925-7419-476b-ad16-9571e7b42093 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] 10.222.0.13 "GET /compute/v2.1/servers/81251939-4cb0-4e30-828c-648f5a48888e" status: 200 len: 1223 microversion: 2.1 time: 0.247653 Oct 30 01:22:36.369364 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1140/2320] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:22:36 2022] GET /compute/v2.1/servers/81251939-4cb0-4e30-828c-648f5a48888e => generated 1223 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:22:36.369746 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-54f9e398-1b58-497c-8072-7950a851ad6e tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:36.380911 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-54f9e398-1b58-497c-8072-7950a851ad6e tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:36.382441 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-54f9e398-1b58-497c-8072-7950a851ad6e tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:36.389209 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-54f9e398-1b58-497c-8072-7950a851ad6e tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1546 microversion: 2.91 time: 0.316160 Oct 30 01:22:36.392502 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1181/2321] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:22:36 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1546 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:22:37.097502 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-344d57df-d78d-4c2d-8cd7-5cfb7fda01f3 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:37.099378 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-344d57df-d78d-4c2d-8cd7-5cfb7fda01f3 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] [instance: 0c5133ba-8270-419a-80cb-43feb76f94c1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:37.127196 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3b22ed0f-a1f7-4294-ae61-c3959de13728 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:37.128648 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3b22ed0f-a1f7-4294-ae61-c3959de13728 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7f629426-c4e6-4c3f-8e54-efd452d14dd7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:37.137027 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-344d57df-d78d-4c2d-8cd7-5cfb7fda01f3 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:37.141753 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-344d57df-d78d-4c2d-8cd7-5cfb7fda01f3 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:37.141753 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-344d57df-d78d-4c2d-8cd7-5cfb7fda01f3 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:37.147716 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3b22ed0f-a1f7-4294-ae61-c3959de13728 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:37.148218 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3b22ed0f-a1f7-4294-ae61-c3959de13728 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:37.148658 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3b22ed0f-a1f7-4294-ae61-c3959de13728 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:37.149402 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3b22ed0f-a1f7-4294-ae61-c3959de13728 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:37.149864 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3b22ed0f-a1f7-4294-ae61-c3959de13728 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:37.150306 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3b22ed0f-a1f7-4294-ae61-c3959de13728 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:37.152290 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-344d57df-d78d-4c2d-8cd7-5cfb7fda01f3 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:37.152779 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-344d57df-d78d-4c2d-8cd7-5cfb7fda01f3 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:37.153264 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-344d57df-d78d-4c2d-8cd7-5cfb7fda01f3 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:37.797882 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-344d57df-d78d-4c2d-8cd7-5cfb7fda01f3 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e0e5acf53b4abe99c3418c82d47ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f383493aa6b46c9884b54cb82063b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:37.810356 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-344d57df-d78d-4c2d-8cd7-5cfb7fda01f3 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] 10.222.0.13 "GET /compute/v2.1/servers/0c5133ba-8270-419a-80cb-43feb76f94c1" status: 200 len: 1350 microversion: 2.1 time: 0.720387 Oct 30 01:22:37.811741 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1141/2322] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:22:37 2022] GET /compute/v2.1/servers/0c5133ba-8270-419a-80cb-43feb76f94c1 => generated 1350 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:22:37.817886 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-6aaacbfd-0fc8-40c3-b049-ef5572ae699a req-fa4e8927-0dd2-4b64-aed9-0614c148e864 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c5133ba-8270-419a-80cb-43feb76f94c1", "name": "network-vif-plugged", "status": "completed", "tag": "160f2013-8ad6-419e-a7f1-6a2b4d7e1229"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:22:37.830072 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-6aaacbfd-0fc8-40c3-b049-ef5572ae699a req-fa4e8927-0dd2-4b64-aed9-0614c148e864 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:37.830975 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-6aaacbfd-0fc8-40c3-b049-ef5572ae699a req-fa4e8927-0dd2-4b64-aed9-0614c148e864 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:37.831943 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-6aaacbfd-0fc8-40c3-b049-ef5572ae699a req-fa4e8927-0dd2-4b64-aed9-0614c148e864 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:37.849110 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-6aaacbfd-0fc8-40c3-b049-ef5572ae699a req-fa4e8927-0dd2-4b64-aed9-0614c148e864 service nova] Creating event network-vif-plugged:160f2013-8ad6-419e-a7f1-6a2b4d7e1229 for instance 0c5133ba-8270-419a-80cb-43feb76f94c1 on n-h1-master-1 Oct 30 01:22:37.855684 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-6aaacbfd-0fc8-40c3-b049-ef5572ae699a req-fa4e8927-0dd2-4b64-aed9-0614c148e864 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041718 Oct 30 01:22:37.857103 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1142/2323] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:22:37.866341 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c15edf9b-644e-4da7-8ca1-d82276921519 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:37.867705 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c15edf9b-644e-4da7-8ca1-d82276921519 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] [instance: 81251939-4cb0-4e30-828c-648f5a48888e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:37.875359 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:22:37.881438 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c15edf9b-644e-4da7-8ca1-d82276921519 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:37.890576 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3b22ed0f-a1f7-4294-ae61-c3959de13728 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:37.906077 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3b22ed0f-a1f7-4294-ae61-c3959de13728 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7" status: 200 len: 1507 microversion: 2.1 time: 0.783308 Oct 30 01:22:37.908484 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c15edf9b-644e-4da7-8ca1-d82276921519 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:37.908956 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c15edf9b-644e-4da7-8ca1-d82276921519 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:37.909920 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1182/2324] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:22:37 2022] GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7 => generated 1507 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:22:37.913090 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c15edf9b-644e-4da7-8ca1-d82276921519 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:37.923748 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c15edf9b-644e-4da7-8ca1-d82276921519 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:37.925948 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c15edf9b-644e-4da7-8ca1-d82276921519 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:37.929461 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6064d9c1-617b-4295-8cf9-df0208b14e74 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:37.930246 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6064d9c1-617b-4295-8cf9-df0208b14e74 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:37.951408 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6064d9c1-617b-4295-8cf9-df0208b14e74 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:37.952142 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6064d9c1-617b-4295-8cf9-df0208b14e74 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:37.955055 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6064d9c1-617b-4295-8cf9-df0208b14e74 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:37.956144 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6064d9c1-617b-4295-8cf9-df0208b14e74 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:37.956759 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6064d9c1-617b-4295-8cf9-df0208b14e74 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:37.957438 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6064d9c1-617b-4295-8cf9-df0208b14e74 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:38.276492 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c15edf9b-644e-4da7-8ca1-d82276921519 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055b96d1eb20418d96450efde939e020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1868480e44540be85a8c2862cd780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:38.296915 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c15edf9b-644e-4da7-8ca1-d82276921519 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] 10.222.0.13 "GET /compute/v2.1/servers/81251939-4cb0-4e30-828c-648f5a48888e" status: 200 len: 1227 microversion: 2.1 time: 0.434535 Oct 30 01:22:38.298205 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1143/2325] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:22:37 2022] GET /compute/v2.1/servers/81251939-4cb0-4e30-828c-648f5a48888e => generated 1227 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:22:38.436102 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6064d9c1-617b-4295-8cf9-df0208b14e74 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:38.454528 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6064d9c1-617b-4295-8cf9-df0208b14e74 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:38.472454 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6064d9c1-617b-4295-8cf9-df0208b14e74 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:38.490077 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6064d9c1-617b-4295-8cf9-df0208b14e74 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1546 microversion: 2.91 time: 0.578700 Oct 30 01:22:38.492711 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1183/2326] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:22:37 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1546 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:22:38.669012 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5f695410-6772-4a12-adb7-87fe6e73d95e tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-503674713", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "e006438e-aba1-46be-a97a-88a3153fb746"}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:22:38.762121 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-5f695410-6772-4a12-adb7-87fe6e73d95e tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] validate_networks() for [('e006438e-aba1-46be-a97a-88a3153fb746', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:22:38.846450 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-af2cb219-3a56-4985-8599-04e60dc8b510 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:38.847462 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-af2cb219-3a56-4985-8599-04e60dc8b510 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] [instance: 0c5133ba-8270-419a-80cb-43feb76f94c1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:38.854925 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af2cb219-3a56-4985-8599-04e60dc8b510 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:38.855410 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af2cb219-3a56-4985-8599-04e60dc8b510 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:38.855833 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af2cb219-3a56-4985-8599-04e60dc8b510 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:38.856796 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af2cb219-3a56-4985-8599-04e60dc8b510 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:38.857279 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af2cb219-3a56-4985-8599-04e60dc8b510 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:38.857722 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af2cb219-3a56-4985-8599-04e60dc8b510 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:39.218656 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-af2cb219-3a56-4985-8599-04e60dc8b510 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e0e5acf53b4abe99c3418c82d47ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f383493aa6b46c9884b54cb82063b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:39.242748 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-af2cb219-3a56-4985-8599-04e60dc8b510 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] 10.222.0.13 "GET /compute/v2.1/servers/0c5133ba-8270-419a-80cb-43feb76f94c1" status: 200 len: 1350 microversion: 2.1 time: 0.403973 Oct 30 01:22:39.261580 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1184/2327] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:22:38 2022] GET /compute/v2.1/servers/0c5133ba-8270-419a-80cb-43feb76f94c1 => generated 1350 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:22:39.269944 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cf9ed874-d7b3-4c81-af38-77036667116c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:39.269944 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cf9ed874-d7b3-4c81-af38-77036667116c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7f629426-c4e6-4c3f-8e54-efd452d14dd7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:39.299257 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cf9ed874-d7b3-4c81-af38-77036667116c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:39.314731 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cf9ed874-d7b3-4c81-af38-77036667116c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:39.314731 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cf9ed874-d7b3-4c81-af38-77036667116c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:39.314731 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cf9ed874-d7b3-4c81-af38-77036667116c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:39.314731 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cf9ed874-d7b3-4c81-af38-77036667116c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:39.315145 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cf9ed874-d7b3-4c81-af38-77036667116c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:40.044158 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-cf9ed874-d7b3-4c81-af38-77036667116c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:40.058810 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cf9ed874-d7b3-4c81-af38-77036667116c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7" status: 200 len: 1507 microversion: 2.1 time: 0.796010 Oct 30 01:22:40.062665 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1185/2328] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:22:39 2022] GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7 => generated 1507 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:22:40.076234 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a620ef67-51d8-4786-8edc-4bbc67efd1bb tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:40.077077 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a620ef67-51d8-4786-8edc-4bbc67efd1bb tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] [instance: 81251939-4cb0-4e30-828c-648f5a48888e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:40.084379 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a620ef67-51d8-4786-8edc-4bbc67efd1bb tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:40.092028 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a620ef67-51d8-4786-8edc-4bbc67efd1bb tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:40.092693 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a620ef67-51d8-4786-8edc-4bbc67efd1bb tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:40.093608 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a620ef67-51d8-4786-8edc-4bbc67efd1bb tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:40.106112 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a620ef67-51d8-4786-8edc-4bbc67efd1bb tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:40.106836 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a620ef67-51d8-4786-8edc-4bbc67efd1bb tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:40.636846 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a620ef67-51d8-4786-8edc-4bbc67efd1bb tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055b96d1eb20418d96450efde939e020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1868480e44540be85a8c2862cd780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:40.651757 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a620ef67-51d8-4786-8edc-4bbc67efd1bb tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] 10.222.0.13 "GET /compute/v2.1/servers/81251939-4cb0-4e30-828c-648f5a48888e" status: 200 len: 1283 microversion: 2.1 time: 0.584354 Oct 30 01:22:40.652904 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1186/2329] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:22:40 2022] GET /compute/v2.1/servers/81251939-4cb0-4e30-828c-648f5a48888e => generated 1283 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:22:40.660856 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-807db98b-6bdf-4709-bd06-372eb816083a tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:40.674343 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-807db98b-6bdf-4709-bd06-372eb816083a tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:40.680726 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-807db98b-6bdf-4709-bd06-372eb816083a tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:40.681451 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-807db98b-6bdf-4709-bd06-372eb816083a tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:40.682069 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-807db98b-6bdf-4709-bd06-372eb816083a tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:40.682918 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-807db98b-6bdf-4709-bd06-372eb816083a tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:40.683540 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-807db98b-6bdf-4709-bd06-372eb816083a tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:40.684104 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-807db98b-6bdf-4709-bd06-372eb816083a tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:40.873239 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-807db98b-6bdf-4709-bd06-372eb816083a tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:40.896197 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-807db98b-6bdf-4709-bd06-372eb816083a tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:40.896197 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-807db98b-6bdf-4709-bd06-372eb816083a tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:40.913792 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-807db98b-6bdf-4709-bd06-372eb816083a tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1533 microversion: 2.91 time: 0.259101 Oct 30 01:22:40.915766 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1187/2330] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:22:40 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1533 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:22:40.920493 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1296f7af-d398-4ac9-8e07-f234201ed3c2 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:40.921097 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1296f7af-d398-4ac9-8e07-f234201ed3c2 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] [instance: 0c5133ba-8270-419a-80cb-43feb76f94c1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:40.934695 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1296f7af-d398-4ac9-8e07-f234201ed3c2 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:40.935447 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1296f7af-d398-4ac9-8e07-f234201ed3c2 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:40.936038 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1296f7af-d398-4ac9-8e07-f234201ed3c2 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:40.936879 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1296f7af-d398-4ac9-8e07-f234201ed3c2 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:40.937494 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1296f7af-d398-4ac9-8e07-f234201ed3c2 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:40.938053 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1296f7af-d398-4ac9-8e07-f234201ed3c2 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:41.406599 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-5f695410-6772-4a12-adb7-87fe6e73d95e tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:22:41.407843 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-5f695410-6772-4a12-adb7-87fe6e73d95e tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:22:41.409531 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-5f695410-6772-4a12-adb7-87fe6e73d95e tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:22:41.410243 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-5f695410-6772-4a12-adb7-87fe6e73d95e tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:22:41.410971 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-5f695410-6772-4a12-adb7-87fe6e73d95e tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:22:41.451940 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f695410-6772-4a12-adb7-87fe6e73d95e tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:41.452466 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f695410-6772-4a12-adb7-87fe6e73d95e tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:41.454093 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f695410-6772-4a12-adb7-87fe6e73d95e tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:41.458034 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f695410-6772-4a12-adb7-87fe6e73d95e tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:41.466046 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f695410-6772-4a12-adb7-87fe6e73d95e tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:41.466748 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f695410-6772-4a12-adb7-87fe6e73d95e tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:41.535821 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-5f695410-6772-4a12-adb7-87fe6e73d95e tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Getting quotas for project 4aa9c648b20d41d7b150fbf64cde6fe8. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:22:41.542787 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-5f695410-6772-4a12-adb7-87fe6e73d95e tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Getting quotas for user f857d6b0826e47c6875a307e7ccfb104 and project 4aa9c648b20d41d7b150fbf64cde6fe8. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:22:41.576554 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5f695410-6772-4a12-adb7-87fe6e73d95e tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:22:41.579213 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5f695410-6772-4a12-adb7-87fe6e73d95e tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: e3faeee3-0724-417b-8575-ac8e59663103] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:22:41.683501 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1296f7af-d398-4ac9-8e07-f234201ed3c2 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e0e5acf53b4abe99c3418c82d47ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f383493aa6b46c9884b54cb82063b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:41.712333 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1296f7af-d398-4ac9-8e07-f234201ed3c2 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] 10.222.0.13 "GET /compute/v2.1/servers/0c5133ba-8270-419a-80cb-43feb76f94c1" status: 200 len: 1541 microversion: 2.1 time: 0.795315 Oct 30 01:22:41.715580 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1188/2331] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:22:40 2022] GET /compute/v2.1/servers/0c5133ba-8270-419a-80cb-43feb76f94c1 => generated 1541 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:22:41.743227 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e988ad31-f1bf-4688-97c7-a502186d9421 tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:41.743227 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e988ad31-f1bf-4688-97c7-a502186d9421 tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:41.768839 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e988ad31-f1bf-4688-97c7-a502186d9421 tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:41.771378 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e988ad31-f1bf-4688-97c7-a502186d9421 tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:41.772041 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e988ad31-f1bf-4688-97c7-a502186d9421 tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:41.774403 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e988ad31-f1bf-4688-97c7-a502186d9421 tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:41.775143 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e988ad31-f1bf-4688-97c7-a502186d9421 tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:41.775837 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e988ad31-f1bf-4688-97c7-a502186d9421 tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:41.792119 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5f695410-6772-4a12-adb7-87fe6e73d95e tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.200496 Oct 30 01:22:41.794778 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1144/2332] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:22:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 3205 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:22:41.804135 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fe95513e-c515-4feb-b3fa-c38a059cee2a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:41.804459 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-fe95513e-c515-4feb-b3fa-c38a059cee2a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7f629426-c4e6-4c3f-8e54-efd452d14dd7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:41.824304 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe95513e-c515-4feb-b3fa-c38a059cee2a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:41.825448 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe95513e-c515-4feb-b3fa-c38a059cee2a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:41.826064 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe95513e-c515-4feb-b3fa-c38a059cee2a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:41.828693 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe95513e-c515-4feb-b3fa-c38a059cee2a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:41.832288 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe95513e-c515-4feb-b3fa-c38a059cee2a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:41.833705 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe95513e-c515-4feb-b3fa-c38a059cee2a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:42.276226 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-e988ad31-f1bf-4688-97c7-a502186d9421 tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] Lazy-loading 'services' on Instance uuid 7f48eff5-378b-4991-be0f-3657d6af305d {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:22:42.313817 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e988ad31-f1bf-4688-97c7-a502186d9421 tempest-UnshelveToHostMultiNodesTest-1519922610 tempest-UnshelveToHostMultiNodesTest-1519922610-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1938 microversion: 2.91 time: 0.596850 Oct 30 01:22:42.319414 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1189/2333] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:22:41 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1938 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:22:42.347747 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a3dd818e-9b3f-425d-b5d8-fe4ea4c9329d tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:42.348828 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a3dd818e-9b3f-425d-b5d8-fe4ea4c9329d tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] [instance: 81251939-4cb0-4e30-828c-648f5a48888e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:42.361529 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a3dd818e-9b3f-425d-b5d8-fe4ea4c9329d tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:42.362197 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a3dd818e-9b3f-425d-b5d8-fe4ea4c9329d tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:42.362807 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a3dd818e-9b3f-425d-b5d8-fe4ea4c9329d tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:42.364152 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a3dd818e-9b3f-425d-b5d8-fe4ea4c9329d tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:42.364746 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a3dd818e-9b3f-425d-b5d8-fe4ea4c9329d tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:42.365319 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a3dd818e-9b3f-425d-b5d8-fe4ea4c9329d tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:43.026327 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a3dd818e-9b3f-425d-b5d8-fe4ea4c9329d tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055b96d1eb20418d96450efde939e020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1868480e44540be85a8c2862cd780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:43.042107 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a3dd818e-9b3f-425d-b5d8-fe4ea4c9329d tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] 10.222.0.13 "GET /compute/v2.1/servers/81251939-4cb0-4e30-828c-648f5a48888e" status: 200 len: 1323 microversion: 2.1 time: 0.707208 Oct 30 01:22:43.046538 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1190/2334] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:22:42 2022] GET /compute/v2.1/servers/81251939-4cb0-4e30-828c-648f5a48888e => generated 1323 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:22:43.058068 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6c41f681-602a-4ac1-b23e-e3547a8dce2a tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:43.060669 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6c41f681-602a-4ac1-b23e-e3547a8dce2a tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] [instance: 0c5133ba-8270-419a-80cb-43feb76f94c1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:43.083828 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c41f681-602a-4ac1-b23e-e3547a8dce2a tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:43.085892 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c41f681-602a-4ac1-b23e-e3547a8dce2a tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:43.086620 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c41f681-602a-4ac1-b23e-e3547a8dce2a tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:43.088659 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c41f681-602a-4ac1-b23e-e3547a8dce2a tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:43.090619 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c41f681-602a-4ac1-b23e-e3547a8dce2a tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:43.091252 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c41f681-602a-4ac1-b23e-e3547a8dce2a tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:44.104949 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-fe95513e-c515-4feb-b3fa-c38a059cee2a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:44.136172 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fe95513e-c515-4feb-b3fa-c38a059cee2a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7" status: 200 len: 1507 microversion: 2.1 time: 2.339250 Oct 30 01:22:44.140884 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1145/2335] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:22:41 2022] GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7 => generated 1507 bytes in 2345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:22:44.194780 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e93b3b3e-3843-44c6-92f2-c083b4d0a64a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:44.195428 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e93b3b3e-3843-44c6-92f2-c083b4d0a64a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: e3faeee3-0724-417b-8575-ac8e59663103] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:44.215742 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6c41f681-602a-4ac1-b23e-e3547a8dce2a tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] 10.222.0.13 "GET /compute/v2.1/servers/0c5133ba-8270-419a-80cb-43feb76f94c1/os-interface" status: 200 len: 285 microversion: 2.1 time: 1.167171 Oct 30 01:22:44.216677 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1191/2336] 10.222.0.13 () {58 vars in 1275 bytes} [Sun Oct 30 01:22:43 2022] GET /compute/v2.1/servers/0c5133ba-8270-419a-80cb-43feb76f94c1/os-interface => generated 285 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:22:44.221736 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-234b226e-9206-4439-8fbb-e19718d30761 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:44.222530 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-234b226e-9206-4439-8fbb-e19718d30761 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:44.230243 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e93b3b3e-3843-44c6-92f2-c083b4d0a64a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:44.233305 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e93b3b3e-3843-44c6-92f2-c083b4d0a64a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:44.234467 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e93b3b3e-3843-44c6-92f2-c083b4d0a64a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:44.237820 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e93b3b3e-3843-44c6-92f2-c083b4d0a64a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:44.241642 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e93b3b3e-3843-44c6-92f2-c083b4d0a64a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:44.244432 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e93b3b3e-3843-44c6-92f2-c083b4d0a64a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:44.253230 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-234b226e-9206-4439-8fbb-e19718d30761 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:44.262355 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-234b226e-9206-4439-8fbb-e19718d30761 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:44.262951 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-234b226e-9206-4439-8fbb-e19718d30761 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:44.265028 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-234b226e-9206-4439-8fbb-e19718d30761 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:44.265893 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-234b226e-9206-4439-8fbb-e19718d30761 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:44.270780 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-234b226e-9206-4439-8fbb-e19718d30761 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:44.392389 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-234b226e-9206-4439-8fbb-e19718d30761 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:22:44.915652 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-234b226e-9206-4439-8fbb-e19718d30761 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 204 len: 0 microversion: 2.91 time: 0.697121 Oct 30 01:22:44.917933 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1192/2337] 10.222.0.13 () {60 vars in 1280 bytes} [Sun Oct 30 01:22:44 2022] DELETE /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 0 bytes in 701 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 30 01:22:44.929134 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ba84aa04-6ca0-4d92-99cb-67eecd3d3bf1 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:44.938182 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ba84aa04-6ca0-4d92-99cb-67eecd3d3bf1 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] [instance: 81251939-4cb0-4e30-828c-648f5a48888e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:44.961522 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ba84aa04-6ca0-4d92-99cb-67eecd3d3bf1 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:44.968132 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ba84aa04-6ca0-4d92-99cb-67eecd3d3bf1 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:44.969780 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ba84aa04-6ca0-4d92-99cb-67eecd3d3bf1 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:44.970617 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ba84aa04-6ca0-4d92-99cb-67eecd3d3bf1 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:44.986308 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ba84aa04-6ca0-4d92-99cb-67eecd3d3bf1 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:44.990564 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ba84aa04-6ca0-4d92-99cb-67eecd3d3bf1 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:45.885742 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e93b3b3e-3843-44c6-92f2-c083b4d0a64a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:45.919367 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e93b3b3e-3843-44c6-92f2-c083b4d0a64a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/e3faeee3-0724-417b-8575-ac8e59663103" status: 200 len: 1211 microversion: 2.1 time: 1.735569 Oct 30 01:22:45.934802 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1146/2338] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:22:44 2022] GET /compute/v2.1/servers/e3faeee3-0724-417b-8575-ac8e59663103 => generated 1211 bytes in 1760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:22:45.949525 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a03f7762-bf8e-43f6-87ec-dc44fb50758d tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:45.964394 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a03f7762-bf8e-43f6-87ec-dc44fb50758d tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:45.979324 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a03f7762-bf8e-43f6-87ec-dc44fb50758d tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:45.984156 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a03f7762-bf8e-43f6-87ec-dc44fb50758d tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:45.986073 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a03f7762-bf8e-43f6-87ec-dc44fb50758d tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:45.991773 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a03f7762-bf8e-43f6-87ec-dc44fb50758d tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:45.997683 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a03f7762-bf8e-43f6-87ec-dc44fb50758d tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:45.997683 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a03f7762-bf8e-43f6-87ec-dc44fb50758d tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:46.368109 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a03f7762-bf8e-43f6-87ec-dc44fb50758d tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:46.389569 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a03f7762-bf8e-43f6-87ec-dc44fb50758d tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:46.403691 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a03f7762-bf8e-43f6-87ec-dc44fb50758d tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:46.421379 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a03f7762-bf8e-43f6-87ec-dc44fb50758d tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1539 microversion: 2.91 time: 0.485187 Oct 30 01:22:46.427207 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1147/2339] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:22:45 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1539 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:22:46.455092 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5696e682-e05d-4b7e-811b-cfed23dd42e0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:46.456206 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5696e682-e05d-4b7e-811b-cfed23dd42e0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7f629426-c4e6-4c3f-8e54-efd452d14dd7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:46.479500 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5696e682-e05d-4b7e-811b-cfed23dd42e0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:46.480304 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5696e682-e05d-4b7e-811b-cfed23dd42e0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:46.480960 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5696e682-e05d-4b7e-811b-cfed23dd42e0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:46.482086 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5696e682-e05d-4b7e-811b-cfed23dd42e0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:46.482817 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5696e682-e05d-4b7e-811b-cfed23dd42e0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:46.489062 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5696e682-e05d-4b7e-811b-cfed23dd42e0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:47.526828 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ba84aa04-6ca0-4d92-99cb-67eecd3d3bf1 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055b96d1eb20418d96450efde939e020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1868480e44540be85a8c2862cd780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:47.548955 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ba84aa04-6ca0-4d92-99cb-67eecd3d3bf1 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] 10.222.0.13 "GET /compute/v2.1/servers/81251939-4cb0-4e30-828c-648f5a48888e" status: 200 len: 1323 microversion: 2.1 time: 2.628368 Oct 30 01:22:47.553496 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1193/2340] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:22:44 2022] GET /compute/v2.1/servers/81251939-4cb0-4e30-828c-648f5a48888e => generated 1323 bytes in 2635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:22:47.574528 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-bcb02880-a470-421c-9699-8baf07bebfab req-5848cedc-e668-4868-a33c-452c4b703d11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33403d18-1832-4c1f-a824-150b5fbfd22f", "tag": "857d4752-0815-42d7-a723-7b3544a0a0f5"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:22:47.597824 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-bcb02880-a470-421c-9699-8baf07bebfab req-5848cedc-e668-4868-a33c-452c4b703d11 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:47.598514 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-bcb02880-a470-421c-9699-8baf07bebfab req-5848cedc-e668-4868-a33c-452c4b703d11 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:47.600582 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-bcb02880-a470-421c-9699-8baf07bebfab req-5848cedc-e668-4868-a33c-452c4b703d11 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:47.662417 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-bcb02880-a470-421c-9699-8baf07bebfab req-5848cedc-e668-4868-a33c-452c4b703d11 service nova] Creating event network-changed:857d4752-0815-42d7-a723-7b3544a0a0f5 for instance 33403d18-1832-4c1f-a824-150b5fbfd22f on n-h2-master-1 Oct 30 01:22:47.682274 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-bcb02880-a470-421c-9699-8baf07bebfab req-5848cedc-e668-4868-a33c-452c4b703d11 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122953 Oct 30 01:22:47.688155 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1194/2341] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:22:47.714613 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6de35254-c684-4f26-8637-08b7d7f9f39b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:47.719947 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6de35254-c684-4f26-8637-08b7d7f9f39b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: e3faeee3-0724-417b-8575-ac8e59663103] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:47.742942 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6de35254-c684-4f26-8637-08b7d7f9f39b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:47.745640 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6de35254-c684-4f26-8637-08b7d7f9f39b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:47.746499 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6de35254-c684-4f26-8637-08b7d7f9f39b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:47.749930 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6de35254-c684-4f26-8637-08b7d7f9f39b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:47.750743 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6de35254-c684-4f26-8637-08b7d7f9f39b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:47.751855 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6de35254-c684-4f26-8637-08b7d7f9f39b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:47.769555 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:22:48.062937 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6de35254-c684-4f26-8637-08b7d7f9f39b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:48.076578 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6de35254-c684-4f26-8637-08b7d7f9f39b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/e3faeee3-0724-417b-8575-ac8e59663103" status: 200 len: 1265 microversion: 2.1 time: 0.385367 Oct 30 01:22:48.080608 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1195/2342] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:22:47 2022] GET /compute/v2.1/servers/e3faeee3-0724-417b-8575-ac8e59663103 => generated 1265 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:22:48.085684 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3098903b-8cf6-457d-8065-483941a01318 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:48.098304 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3098903b-8cf6-457d-8065-483941a01318 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:48.114976 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3098903b-8cf6-457d-8065-483941a01318 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:48.121495 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3098903b-8cf6-457d-8065-483941a01318 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:48.121495 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3098903b-8cf6-457d-8065-483941a01318 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:48.121495 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3098903b-8cf6-457d-8065-483941a01318 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:48.121495 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3098903b-8cf6-457d-8065-483941a01318 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:48.121847 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3098903b-8cf6-457d-8065-483941a01318 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:48.247098 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5696e682-e05d-4b7e-811b-cfed23dd42e0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:48.264743 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5696e682-e05d-4b7e-811b-cfed23dd42e0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7" status: 200 len: 1507 microversion: 2.1 time: 1.832764 Oct 30 01:22:48.282210 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1148/2343] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:22:46 2022] GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7 => generated 1507 bytes in 1852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:22:48.397158 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3098903b-8cf6-457d-8065-483941a01318 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:48.422623 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3098903b-8cf6-457d-8065-483941a01318 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:48.433817 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3098903b-8cf6-457d-8065-483941a01318 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd815becbdc9d40e8b0ab90e97488018a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9fa6465cb74679921935af37294eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:48.446789 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3098903b-8cf6-457d-8065-483941a01318 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 200 len: 1539 microversion: 2.91 time: 0.364539 Oct 30 01:22:48.450809 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1196/2344] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:22:48 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 1539 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:22:48.592486 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e2e118c9-3404-45cb-8cc5-24a29958fdc5 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:48.594687 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e2e118c9-3404-45cb-8cc5-24a29958fdc5 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] [instance: 81251939-4cb0-4e30-828c-648f5a48888e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:48.613634 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2e118c9-3404-45cb-8cc5-24a29958fdc5 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:48.614604 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2e118c9-3404-45cb-8cc5-24a29958fdc5 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:48.618453 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2e118c9-3404-45cb-8cc5-24a29958fdc5 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:48.618453 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2e118c9-3404-45cb-8cc5-24a29958fdc5 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:48.621019 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2e118c9-3404-45cb-8cc5-24a29958fdc5 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:48.624914 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2e118c9-3404-45cb-8cc5-24a29958fdc5 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:49.109905 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cbe638c8-73ef-46f8-90b2-5c55fd98fa65 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:49.110686 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cbe638c8-73ef-46f8-90b2-5c55fd98fa65 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: e3faeee3-0724-417b-8575-ac8e59663103] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:49.121551 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cbe638c8-73ef-46f8-90b2-5c55fd98fa65 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:49.127995 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cbe638c8-73ef-46f8-90b2-5c55fd98fa65 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:49.130392 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cbe638c8-73ef-46f8-90b2-5c55fd98fa65 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:49.131376 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cbe638c8-73ef-46f8-90b2-5c55fd98fa65 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:49.133654 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cbe638c8-73ef-46f8-90b2-5c55fd98fa65 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:49.134272 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cbe638c8-73ef-46f8-90b2-5c55fd98fa65 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:49.340767 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-cbe638c8-73ef-46f8-90b2-5c55fd98fa65 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:49.366353 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cbe638c8-73ef-46f8-90b2-5c55fd98fa65 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/e3faeee3-0724-417b-8575-ac8e59663103" status: 200 len: 1265 microversion: 2.1 time: 0.262289 Oct 30 01:22:49.367199 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1197/2345] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:22:49 2022] GET /compute/v2.1/servers/e3faeee3-0724-417b-8575-ac8e59663103 => generated 1265 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:22:49.392413 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-978af1d7-c24b-4447-93fd-eabcaed14e48 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:49.393184 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-978af1d7-c24b-4447-93fd-eabcaed14e48 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7f629426-c4e6-4c3f-8e54-efd452d14dd7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:49.407801 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-978af1d7-c24b-4447-93fd-eabcaed14e48 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:49.408532 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-978af1d7-c24b-4447-93fd-eabcaed14e48 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:49.409537 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-978af1d7-c24b-4447-93fd-eabcaed14e48 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:49.410645 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-978af1d7-c24b-4447-93fd-eabcaed14e48 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:49.411424 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-978af1d7-c24b-4447-93fd-eabcaed14e48 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:49.412079 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-978af1d7-c24b-4447-93fd-eabcaed14e48 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:49.916499 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e2e118c9-3404-45cb-8cc5-24a29958fdc5 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055b96d1eb20418d96450efde939e020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1868480e44540be85a8c2862cd780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:49.921209 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=93 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:22:49.938998 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e2e118c9-3404-45cb-8cc5-24a29958fdc5 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] 10.222.0.13 "GET /compute/v2.1/servers/81251939-4cb0-4e30-828c-648f5a48888e" status: 200 len: 1323 microversion: 2.1 time: 1.362736 Oct 30 01:22:49.940565 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1149/2346] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:22:48 2022] GET /compute/v2.1/servers/81251939-4cb0-4e30-828c-648f5a48888e => generated 1323 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:22:49.964465 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5e4f5d14-0096-415b-b7e5-d8a7d02187f1 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:49.967110 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5e4f5d14-0096-415b-b7e5-d8a7d02187f1 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] [instance: 7f48eff5-378b-4991-be0f-3657d6af305d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:49.975857 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5e4f5d14-0096-415b-b7e5-d8a7d02187f1 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:49.976538 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5e4f5d14-0096-415b-b7e5-d8a7d02187f1 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:49.977128 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5e4f5d14-0096-415b-b7e5-d8a7d02187f1 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:49.978346 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5e4f5d14-0096-415b-b7e5-d8a7d02187f1 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:49.979068 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5e4f5d14-0096-415b-b7e5-d8a7d02187f1 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:49.979649 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5e4f5d14-0096-415b-b7e5-d8a7d02187f1 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:50.065262 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-5e4f5d14-0096-415b-b7e5-d8a7d02187f1 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] HTTP exception thrown: Instance 7f48eff5-378b-4991-be0f-3657d6af305d could not be found. Oct 30 01:22:50.068405 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5e4f5d14-0096-415b-b7e5-d8a7d02187f1 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Request method failure captured: Oct 30 01:22:50.068405 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d HTTP/1.1 Oct 30 01:22:50.068405 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:22:50.068405 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:22:50.068405 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:22:50.068405 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:22:50.068405 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:22:50.068405 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:22:50.068405 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:22:50.068405 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:22:50.068405 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdEZ3CeLAxyHmOnN_YZYrX8LTW8SBMnb8k6jlIqJ6zByEEJGESA1hUj2DhEXnYjP0jiyWjgdbisOQj3OmQyiXYaPXQPZTeOKuBCUy2PeSOyE6uSIJkRAatueGF4eA2EMrEHxcWK3rgKfWbUPpmjO0VJUFZYrNW4OZDyW-VEd9k3xhaw Oct 30 01:22:50.068405 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:22:50.068405 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:22:50.068405 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:22:50.068405 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:22:50.068405 n-d-master-1 devstack@n-api.service[121103]: X-Openstack-Nova-Api-Version: 2.91 Oct 30 01:22:50.068405 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:22:50.068405 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:22:50.068405 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 8c9fa6465cb74679921935af37294eca Oct 30 01:22:50.068405 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-2008727454 Oct 30 01:22:50.068405 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:22:50.068405 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:22:50.069600 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c9fa6465cb74679921935af37294eca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8c9fa6465cb74679921935af37294eca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8c9fa6465cb74679921935af37294eca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c9fa6465cb74679921935af37294eca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:22:50.069600 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-2008727454 Oct 30 01:22:50.069600 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 8c9fa6465cb74679921935af37294eca Oct 30 01:22:50.069600 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-2008727454 Oct 30 01:22:50.069600 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-UnshelveToHostMultiNodesTest-2008727454-project Oct 30 01:22:50.069600 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:22:50.069600 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:22:50.069600 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: d815becbdc9d40e8b0ab90e97488018a Oct 30 01:22:50.069600 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-2008727454-project Oct 30 01:22:50.069600 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:22:50.069600 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 7f48eff5-378b-4991-be0f-3657d6af305d could not be found. Oct 30 01:22:50.069600 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '7f48eff5-378b-4991-be0f-3657d6af305d'} Oct 30 01:22:50.070229 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:22:50.070229 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:22:50.070229 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:22:50.070229 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:22:50.070229 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:22:50.070229 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:22:50.070229 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:22:50.070229 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:22:50.070229 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:22:50.070229 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:22:50.070229 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f48eff5-378b-4991-be0f-3657d6af305d could not be found. Oct 30 01:22:50.070229 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:22:50.070229 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:22:50.070229 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:22:50.070229 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:22:50.070229 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:22:50.070229 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:22:50.070229 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:22:50.070229 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:22:50.070229 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:22:50.071190 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:22:50.071190 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:22:50.071190 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:22:50.071190 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:22:50.071190 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:22:50.071190 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:22:50.071190 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:22:50.071190 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f48eff5-378b-4991-be0f-3657d6af305d could not be found. Oct 30 01:22:50.071190 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:22:50.071190 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:22:50.071190 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:22:50.071190 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:22:50.071190 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:22:50.071190 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:22:50.071190 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:22:50.071190 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:22:50.071190 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f48eff5-378b-4991-be0f-3657d6af305d could not be found. Oct 30 01:22:50.071190 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:22:50.075748 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5e4f5d14-0096-415b-b7e5-d8a7d02187f1 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] Returning 404 to user: Instance 7f48eff5-378b-4991-be0f-3657d6af305d could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:22:50.078789 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5e4f5d14-0096-415b-b7e5-d8a7d02187f1 tempest-UnshelveToHostMultiNodesTest-2008727454 tempest-UnshelveToHostMultiNodesTest-2008727454-project] 10.222.0.13 "GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d" status: 404 len: 111 microversion: 2.91 time: 0.137078 Oct 30 01:22:50.079576 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1150/2347] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:22:49 2022] GET /compute/v2.1/servers/7f48eff5-378b-4991-be0f-3657d6af305d => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:22:50.086919 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-236efbcc-73f1-41a6-9827-6e768366fe8b req-aa1bf55f-2e98-4b7c-8835-f5aac6b67ad5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81251939-4cb0-4e30-828c-648f5a48888e", "tag": "0a420531-b57f-4867-9658-7453f902d395"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:22:50.099582 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-236efbcc-73f1-41a6-9827-6e768366fe8b req-aa1bf55f-2e98-4b7c-8835-f5aac6b67ad5 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:50.100856 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-236efbcc-73f1-41a6-9827-6e768366fe8b req-aa1bf55f-2e98-4b7c-8835-f5aac6b67ad5 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:50.101593 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-236efbcc-73f1-41a6-9827-6e768366fe8b req-aa1bf55f-2e98-4b7c-8835-f5aac6b67ad5 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:50.128635 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-236efbcc-73f1-41a6-9827-6e768366fe8b req-aa1bf55f-2e98-4b7c-8835-f5aac6b67ad5 service nova] Creating event network-changed:0a420531-b57f-4867-9658-7453f902d395 for instance 81251939-4cb0-4e30-828c-648f5a48888e on n-h2-master-1 Oct 30 01:22:50.145708 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-236efbcc-73f1-41a6-9827-6e768366fe8b req-aa1bf55f-2e98-4b7c-8835-f5aac6b67ad5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064195 Oct 30 01:22:50.148106 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1151/2348] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:22:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:22:50.405722 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-544a1be5-2b1b-4552-9337-89dd6bac6d82 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:50.408268 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-544a1be5-2b1b-4552-9337-89dd6bac6d82 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: e3faeee3-0724-417b-8575-ac8e59663103] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:50.424556 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-544a1be5-2b1b-4552-9337-89dd6bac6d82 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:50.426108 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-544a1be5-2b1b-4552-9337-89dd6bac6d82 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:50.426759 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-544a1be5-2b1b-4552-9337-89dd6bac6d82 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:50.428383 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-544a1be5-2b1b-4552-9337-89dd6bac6d82 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:50.429070 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-544a1be5-2b1b-4552-9337-89dd6bac6d82 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:50.429870 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-544a1be5-2b1b-4552-9337-89dd6bac6d82 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:50.733904 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-978af1d7-c24b-4447-93fd-eabcaed14e48 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:50.744431 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-978af1d7-c24b-4447-93fd-eabcaed14e48 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7" status: 200 len: 1507 microversion: 2.1 time: 1.360143 Oct 30 01:22:50.748798 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1198/2349] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:22:49 2022] GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7 => generated 1507 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:22:50.800045 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-544a1be5-2b1b-4552-9337-89dd6bac6d82 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:50.814333 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-544a1be5-2b1b-4552-9337-89dd6bac6d82 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/e3faeee3-0724-417b-8575-ac8e59663103" status: 200 len: 1265 microversion: 2.1 time: 0.421760 Oct 30 01:22:50.826506 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1152/2350] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:22:50 2022] GET /compute/v2.1/servers/e3faeee3-0724-417b-8575-ac8e59663103 => generated 1265 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:22:50.966429 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-997e6390-897f-404c-bfa0-f1c1f7d89531 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:50.967288 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-997e6390-897f-404c-bfa0-f1c1f7d89531 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] [instance: 81251939-4cb0-4e30-828c-648f5a48888e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:50.980779 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-997e6390-897f-404c-bfa0-f1c1f7d89531 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:50.981749 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-997e6390-897f-404c-bfa0-f1c1f7d89531 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:50.982404 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-997e6390-897f-404c-bfa0-f1c1f7d89531 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:50.983285 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-997e6390-897f-404c-bfa0-f1c1f7d89531 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:50.983773 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-997e6390-897f-404c-bfa0-f1c1f7d89531 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:50.984201 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-997e6390-897f-404c-bfa0-f1c1f7d89531 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:51.776295 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cbdad590-0635-4514-b3dc-99f9e84b0de6 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:51.777695 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-cbdad590-0635-4514-b3dc-99f9e84b0de6 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7f629426-c4e6-4c3f-8e54-efd452d14dd7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:51.780528 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=6 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:22:51.782299 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=16 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:22:51.800997 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cbdad590-0635-4514-b3dc-99f9e84b0de6 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:51.802522 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cbdad590-0635-4514-b3dc-99f9e84b0de6 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:51.806602 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cbdad590-0635-4514-b3dc-99f9e84b0de6 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:51.807693 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cbdad590-0635-4514-b3dc-99f9e84b0de6 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:51.812087 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cbdad590-0635-4514-b3dc-99f9e84b0de6 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:51.816608 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cbdad590-0635-4514-b3dc-99f9e84b0de6 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:51.902998 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-997e6390-897f-404c-bfa0-f1c1f7d89531 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055b96d1eb20418d96450efde939e020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1868480e44540be85a8c2862cd780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:51.916947 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-997e6390-897f-404c-bfa0-f1c1f7d89531 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] 10.222.0.13 "GET /compute/v2.1/servers/81251939-4cb0-4e30-828c-648f5a48888e" status: 200 len: 1323 microversion: 2.1 time: 0.949957 Oct 30 01:22:51.926119 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1199/2351] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:22:50 2022] GET /compute/v2.1/servers/81251939-4cb0-4e30-828c-648f5a48888e => generated 1323 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:22:51.947018 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f60dd070-da42-4449-ab22-0f00b61c1ef6 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:51.948699 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f60dd070-da42-4449-ab22-0f00b61c1ef6 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: e3faeee3-0724-417b-8575-ac8e59663103] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:51.968069 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f60dd070-da42-4449-ab22-0f00b61c1ef6 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:51.969630 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f60dd070-da42-4449-ab22-0f00b61c1ef6 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:51.974152 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f60dd070-da42-4449-ab22-0f00b61c1ef6 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:51.975181 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f60dd070-da42-4449-ab22-0f00b61c1ef6 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:51.976811 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f60dd070-da42-4449-ab22-0f00b61c1ef6 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:51.976811 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f60dd070-da42-4449-ab22-0f00b61c1ef6 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:52.519519 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-cbdad590-0635-4514-b3dc-99f9e84b0de6 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:52.534141 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cbdad590-0635-4514-b3dc-99f9e84b0de6 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7" status: 200 len: 1507 microversion: 2.1 time: 0.759310 Oct 30 01:22:52.535015 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1153/2352] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:22:51 2022] GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7 => generated 1507 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:22:52.639731 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-d61d2b0a-0b8c-4adf-b7a6-9f88c5fcce92 req-f263bed2-803a-4ec2-b0a1-5061c5b5a357 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c5133ba-8270-419a-80cb-43feb76f94c1", "tag": "160f2013-8ad6-419e-a7f1-6a2b4d7e1229"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:22:52.651440 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f60dd070-da42-4449-ab22-0f00b61c1ef6 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:52.661495 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f60dd070-da42-4449-ab22-0f00b61c1ef6 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/e3faeee3-0724-417b-8575-ac8e59663103" status: 200 len: 1307 microversion: 2.1 time: 0.733854 Oct 30 01:22:52.664288 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1200/2353] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:22:51 2022] GET /compute/v2.1/servers/e3faeee3-0724-417b-8575-ac8e59663103 => generated 1307 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:22:52.677368 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d61d2b0a-0b8c-4adf-b7a6-9f88c5fcce92 req-f263bed2-803a-4ec2-b0a1-5061c5b5a357 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:52.677368 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d61d2b0a-0b8c-4adf-b7a6-9f88c5fcce92 req-f263bed2-803a-4ec2-b0a1-5061c5b5a357 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:52.677368 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d61d2b0a-0b8c-4adf-b7a6-9f88c5fcce92 req-f263bed2-803a-4ec2-b0a1-5061c5b5a357 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:52.699999 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-d61d2b0a-0b8c-4adf-b7a6-9f88c5fcce92 req-f263bed2-803a-4ec2-b0a1-5061c5b5a357 service nova] Creating event network-changed:160f2013-8ad6-419e-a7f1-6a2b4d7e1229 for instance 0c5133ba-8270-419a-80cb-43feb76f94c1 on n-h1-master-1 Oct 30 01:22:52.705474 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-d61d2b0a-0b8c-4adf-b7a6-9f88c5fcce92 req-f263bed2-803a-4ec2-b0a1-5061c5b5a357 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069967 Oct 30 01:22:52.706592 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1154/2354] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:22:52.962438 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d14d9bde-7171-4d56-9c28-3c8665ee780d tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:52.963894 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d14d9bde-7171-4d56-9c28-3c8665ee780d tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] [instance: 81251939-4cb0-4e30-828c-648f5a48888e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:52.974789 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d14d9bde-7171-4d56-9c28-3c8665ee780d tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:52.977821 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d14d9bde-7171-4d56-9c28-3c8665ee780d tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:52.979805 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d14d9bde-7171-4d56-9c28-3c8665ee780d tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:52.981616 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d14d9bde-7171-4d56-9c28-3c8665ee780d tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:52.984537 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d14d9bde-7171-4d56-9c28-3c8665ee780d tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:52.985296 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d14d9bde-7171-4d56-9c28-3c8665ee780d tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:53.564003 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2146a355-557b-4941-9b0b-e89dedfe5fb4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:53.565464 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2146a355-557b-4941-9b0b-e89dedfe5fb4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7f629426-c4e6-4c3f-8e54-efd452d14dd7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:53.572361 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2146a355-557b-4941-9b0b-e89dedfe5fb4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:53.573422 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2146a355-557b-4941-9b0b-e89dedfe5fb4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:53.574070 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2146a355-557b-4941-9b0b-e89dedfe5fb4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:53.574981 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2146a355-557b-4941-9b0b-e89dedfe5fb4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:53.575659 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2146a355-557b-4941-9b0b-e89dedfe5fb4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:53.576304 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2146a355-557b-4941-9b0b-e89dedfe5fb4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:54.376558 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d14d9bde-7171-4d56-9c28-3c8665ee780d tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055b96d1eb20418d96450efde939e020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1868480e44540be85a8c2862cd780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:54.389622 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d14d9bde-7171-4d56-9c28-3c8665ee780d tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] 10.222.0.13 "GET /compute/v2.1/servers/81251939-4cb0-4e30-828c-648f5a48888e" status: 200 len: 1323 microversion: 2.1 time: 1.442764 Oct 30 01:22:54.390842 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1201/2355] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:22:52 2022] GET /compute/v2.1/servers/81251939-4cb0-4e30-828c-648f5a48888e => generated 1323 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:22:54.397504 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-009359f4-4d07-4cef-848e-fedadd7b5f0f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:54.398704 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-009359f4-4d07-4cef-848e-fedadd7b5f0f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: e3faeee3-0724-417b-8575-ac8e59663103] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:54.403513 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2146a355-557b-4941-9b0b-e89dedfe5fb4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:54.408363 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-009359f4-4d07-4cef-848e-fedadd7b5f0f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:54.409183 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-009359f4-4d07-4cef-848e-fedadd7b5f0f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:54.409887 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-009359f4-4d07-4cef-848e-fedadd7b5f0f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:54.410788 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-009359f4-4d07-4cef-848e-fedadd7b5f0f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:54.411678 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-009359f4-4d07-4cef-848e-fedadd7b5f0f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:54.412248 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-009359f4-4d07-4cef-848e-fedadd7b5f0f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:54.448459 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2146a355-557b-4941-9b0b-e89dedfe5fb4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7" status: 200 len: 1507 microversion: 2.1 time: 0.886317 Oct 30 01:22:54.450958 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1155/2356] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:22:53 2022] GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7 => generated 1507 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:22:54.457865 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-8af04e5c-7e37-4ebc-8b5a-25eda2a3c914 req-f8f817f9-f745-436c-a367-54171240aa7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81251939-4cb0-4e30-828c-648f5a48888e", "name": "network-vif-plugged", "status": "completed", "tag": "0a420531-b57f-4867-9658-7453f902d395"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:22:54.502171 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-8af04e5c-7e37-4ebc-8b5a-25eda2a3c914 req-f8f817f9-f745-436c-a367-54171240aa7b service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:54.502988 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-8af04e5c-7e37-4ebc-8b5a-25eda2a3c914 req-f8f817f9-f745-436c-a367-54171240aa7b service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:54.504814 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-8af04e5c-7e37-4ebc-8b5a-25eda2a3c914 req-f8f817f9-f745-436c-a367-54171240aa7b service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:54.550035 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-8af04e5c-7e37-4ebc-8b5a-25eda2a3c914 req-f8f817f9-f745-436c-a367-54171240aa7b service nova] Creating event network-vif-plugged:0a420531-b57f-4867-9658-7453f902d395 for instance 81251939-4cb0-4e30-828c-648f5a48888e on n-h2-master-1 Oct 30 01:22:54.556746 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-8af04e5c-7e37-4ebc-8b5a-25eda2a3c914 req-f8f817f9-f745-436c-a367-54171240aa7b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104254 Oct 30 01:22:54.558476 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1156/2357] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:22:55.433026 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-95927620-4790-42e3-871f-2d41d65d403e tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:55.433762 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-95927620-4790-42e3-871f-2d41d65d403e tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] [instance: 81251939-4cb0-4e30-828c-648f5a48888e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:55.469121 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-95927620-4790-42e3-871f-2d41d65d403e tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:55.478429 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-95927620-4790-42e3-871f-2d41d65d403e tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:55.480602 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-95927620-4790-42e3-871f-2d41d65d403e tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:55.484553 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-95927620-4790-42e3-871f-2d41d65d403e tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:55.491005 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-95927620-4790-42e3-871f-2d41d65d403e tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:55.491605 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-95927620-4790-42e3-871f-2d41d65d403e tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:55.984932 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-009359f4-4d07-4cef-848e-fedadd7b5f0f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:55.989027 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-009359f4-4d07-4cef-848e-fedadd7b5f0f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/e3faeee3-0724-417b-8575-ac8e59663103" status: 200 len: 1307 microversion: 2.1 time: 1.596739 Oct 30 01:22:55.992544 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1202/2358] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:22:54 2022] GET /compute/v2.1/servers/e3faeee3-0724-417b-8575-ac8e59663103 => generated 1307 bytes in 1601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:22:56.000569 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-026e35cc-0951-4212-9313-9aceb2dbeaf0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:56.003636 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-026e35cc-0951-4212-9313-9aceb2dbeaf0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7f629426-c4e6-4c3f-8e54-efd452d14dd7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:56.012179 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-026e35cc-0951-4212-9313-9aceb2dbeaf0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:56.013612 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-026e35cc-0951-4212-9313-9aceb2dbeaf0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:56.014140 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-026e35cc-0951-4212-9313-9aceb2dbeaf0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:56.014773 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-026e35cc-0951-4212-9313-9aceb2dbeaf0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:56.015404 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-026e35cc-0951-4212-9313-9aceb2dbeaf0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:56.016080 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-026e35cc-0951-4212-9313-9aceb2dbeaf0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:56.112584 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-95927620-4790-42e3-871f-2d41d65d403e tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055b96d1eb20418d96450efde939e020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1868480e44540be85a8c2862cd780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:56.126494 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-95927620-4790-42e3-871f-2d41d65d403e tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] 10.222.0.13 "GET /compute/v2.1/servers/81251939-4cb0-4e30-828c-648f5a48888e" status: 200 len: 1323 microversion: 2.1 time: 0.704353 Oct 30 01:22:56.127401 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1157/2359] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:22:55 2022] GET /compute/v2.1/servers/81251939-4cb0-4e30-828c-648f5a48888e => generated 1323 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:22:56.132072 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-b4e394cd-f710-43c2-9e38-5292e903dbe7 req-8958553c-e595-42d0-bed1-4dd8fe2887cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23cbc0a6-6137-4e64-b264-c67fceba507f", "tag": "de868ba1-8fcb-485f-9548-68c5b674c8dd"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:22:56.143289 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-b4e394cd-f710-43c2-9e38-5292e903dbe7 req-8958553c-e595-42d0-bed1-4dd8fe2887cf service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:56.143731 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-b4e394cd-f710-43c2-9e38-5292e903dbe7 req-8958553c-e595-42d0-bed1-4dd8fe2887cf service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:56.144261 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-b4e394cd-f710-43c2-9e38-5292e903dbe7 req-8958553c-e595-42d0-bed1-4dd8fe2887cf service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:56.159046 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-b4e394cd-f710-43c2-9e38-5292e903dbe7 req-8958553c-e595-42d0-bed1-4dd8fe2887cf service nova] Creating event network-changed:de868ba1-8fcb-485f-9548-68c5b674c8dd for instance 23cbc0a6-6137-4e64-b264-c67fceba507f on n-h1-master-1 Oct 30 01:22:56.164026 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-b4e394cd-f710-43c2-9e38-5292e903dbe7 req-8958553c-e595-42d0-bed1-4dd8fe2887cf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035345 Oct 30 01:22:56.164836 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1158/2360] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:22:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:22:56.288507 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-026e35cc-0951-4212-9313-9aceb2dbeaf0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:56.296683 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-026e35cc-0951-4212-9313-9aceb2dbeaf0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7" status: 200 len: 1507 microversion: 2.1 time: 0.302214 Oct 30 01:22:56.297671 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1203/2361] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:22:55 2022] GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7 => generated 1507 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:22:57.017282 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7722d898-262c-45c2-8d86-473a6fe571ed tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:57.018726 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7722d898-262c-45c2-8d86-473a6fe571ed tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: e3faeee3-0724-417b-8575-ac8e59663103] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:57.031399 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7722d898-262c-45c2-8d86-473a6fe571ed tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:57.032543 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7722d898-262c-45c2-8d86-473a6fe571ed tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:57.033178 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7722d898-262c-45c2-8d86-473a6fe571ed tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:57.045755 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7722d898-262c-45c2-8d86-473a6fe571ed tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:57.047552 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7722d898-262c-45c2-8d86-473a6fe571ed tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:57.048209 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7722d898-262c-45c2-8d86-473a6fe571ed tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:57.152116 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a727981b-785e-4dfe-9b28-71506bad58e0 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:57.152942 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a727981b-785e-4dfe-9b28-71506bad58e0 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] [instance: 81251939-4cb0-4e30-828c-648f5a48888e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:57.165393 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a727981b-785e-4dfe-9b28-71506bad58e0 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:57.166027 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a727981b-785e-4dfe-9b28-71506bad58e0 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:57.167655 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a727981b-785e-4dfe-9b28-71506bad58e0 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:57.169715 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a727981b-785e-4dfe-9b28-71506bad58e0 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:57.170339 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a727981b-785e-4dfe-9b28-71506bad58e0 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:57.171215 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a727981b-785e-4dfe-9b28-71506bad58e0 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:57.583712 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7722d898-262c-45c2-8d86-473a6fe571ed tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:57.596187 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7722d898-262c-45c2-8d86-473a6fe571ed tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/e3faeee3-0724-417b-8575-ac8e59663103" status: 200 len: 1307 microversion: 2.1 time: 0.586057 Oct 30 01:22:57.596784 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1159/2362] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:22:57 2022] GET /compute/v2.1/servers/e3faeee3-0724-417b-8575-ac8e59663103 => generated 1307 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:22:57.612163 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c71b9d4f-b844-4ae2-8c7f-c80d1b99bf4b tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:57.613208 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c71b9d4f-b844-4ae2-8c7f-c80d1b99bf4b tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7f629426-c4e6-4c3f-8e54-efd452d14dd7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:57.636529 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c71b9d4f-b844-4ae2-8c7f-c80d1b99bf4b tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:57.637714 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a727981b-785e-4dfe-9b28-71506bad58e0 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055b96d1eb20418d96450efde939e020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1868480e44540be85a8c2862cd780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:57.655269 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c71b9d4f-b844-4ae2-8c7f-c80d1b99bf4b tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:57.655269 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c71b9d4f-b844-4ae2-8c7f-c80d1b99bf4b tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:57.655269 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c71b9d4f-b844-4ae2-8c7f-c80d1b99bf4b tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:57.655269 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c71b9d4f-b844-4ae2-8c7f-c80d1b99bf4b tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:57.655744 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c71b9d4f-b844-4ae2-8c7f-c80d1b99bf4b tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:57.666927 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a727981b-785e-4dfe-9b28-71506bad58e0 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] 10.222.0.13 "GET /compute/v2.1/servers/81251939-4cb0-4e30-828c-648f5a48888e" status: 200 len: 1516 microversion: 2.1 time: 0.519429 Oct 30 01:22:57.689469 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1204/2363] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:22:57 2022] GET /compute/v2.1/servers/81251939-4cb0-4e30-828c-648f5a48888e => generated 1516 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:22:57.723826 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-57993887-8d4b-4bb0-9b0a-11a4c8ec3fd8 req-04a4010d-b76f-48f9-9bad-7aa212a19307 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33403d18-1832-4c1f-a824-150b5fbfd22f", "name": "network-vif-plugged", "status": "completed", "tag": "857d4752-0815-42d7-a723-7b3544a0a0f5"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:22:57.752580 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-57993887-8d4b-4bb0-9b0a-11a4c8ec3fd8 req-04a4010d-b76f-48f9-9bad-7aa212a19307 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:57.757511 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-57993887-8d4b-4bb0-9b0a-11a4c8ec3fd8 req-04a4010d-b76f-48f9-9bad-7aa212a19307 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:57.758357 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-57993887-8d4b-4bb0-9b0a-11a4c8ec3fd8 req-04a4010d-b76f-48f9-9bad-7aa212a19307 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:57.782825 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-57993887-8d4b-4bb0-9b0a-11a4c8ec3fd8 req-04a4010d-b76f-48f9-9bad-7aa212a19307 service nova] Creating event network-vif-plugged:857d4752-0815-42d7-a723-7b3544a0a0f5 for instance 33403d18-1832-4c1f-a824-150b5fbfd22f on n-h2-master-1 Oct 30 01:22:57.795823 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-57993887-8d4b-4bb0-9b0a-11a4c8ec3fd8 req-04a4010d-b76f-48f9-9bad-7aa212a19307 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102542 Oct 30 01:22:57.797324 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1205/2364] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:22:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:22:57.806272 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-61d362cb-5f3f-441b-a7c5-18af90113d77 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:57.810255 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-61d362cb-5f3f-441b-a7c5-18af90113d77 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] [instance: 23cbc0a6-6137-4e64-b264-c67fceba507f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:57.825011 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-61d362cb-5f3f-441b-a7c5-18af90113d77 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:57.826248 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-61d362cb-5f3f-441b-a7c5-18af90113d77 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:57.827057 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-61d362cb-5f3f-441b-a7c5-18af90113d77 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:57.828301 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-61d362cb-5f3f-441b-a7c5-18af90113d77 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:57.828967 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-61d362cb-5f3f-441b-a7c5-18af90113d77 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:57.829795 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-61d362cb-5f3f-441b-a7c5-18af90113d77 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:58.159516 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c71b9d4f-b844-4ae2-8c7f-c80d1b99bf4b tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:58.167607 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c71b9d4f-b844-4ae2-8c7f-c80d1b99bf4b tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7" status: 200 len: 1507 microversion: 2.1 time: 0.569074 Oct 30 01:22:58.188092 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1160/2365] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:22:57 2022] GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7 => generated 1507 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:22:58.212224 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-9a20e551-8e57-45a7-a36f-74d62dc078ce req-4221c854-e1f5-400e-910b-4c0f8bdf70f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3faeee3-0724-417b-8575-ac8e59663103", "tag": "f422e3db-4c59-447a-b83c-3fe06b9aefaa"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:22:58.251859 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-9a20e551-8e57-45a7-a36f-74d62dc078ce req-4221c854-e1f5-400e-910b-4c0f8bdf70f9 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:58.252354 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-9a20e551-8e57-45a7-a36f-74d62dc078ce req-4221c854-e1f5-400e-910b-4c0f8bdf70f9 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:58.258669 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-9a20e551-8e57-45a7-a36f-74d62dc078ce req-4221c854-e1f5-400e-910b-4c0f8bdf70f9 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:58.260894 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-61d362cb-5f3f-441b-a7c5-18af90113d77 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055b96d1eb20418d96450efde939e020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1868480e44540be85a8c2862cd780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:58.271425 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-61d362cb-5f3f-441b-a7c5-18af90113d77 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] 10.222.0.13 "GET /compute/v2.1/servers/23cbc0a6-6137-4e64-b264-c67fceba507f" status: 200 len: 1323 microversion: 2.1 time: 0.472684 Oct 30 01:22:58.272021 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1206/2366] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:22:57 2022] GET /compute/v2.1/servers/23cbc0a6-6137-4e64-b264-c67fceba507f => generated 1323 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:22:58.309912 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-9a20e551-8e57-45a7-a36f-74d62dc078ce req-4221c854-e1f5-400e-910b-4c0f8bdf70f9 service nova] Creating event network-changed:f422e3db-4c59-447a-b83c-3fe06b9aefaa for instance e3faeee3-0724-417b-8575-ac8e59663103 on n-h1-master-1 Oct 30 01:22:58.315147 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-9a20e551-8e57-45a7-a36f-74d62dc078ce req-4221c854-e1f5-400e-910b-4c0f8bdf70f9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118191 Oct 30 01:22:58.316081 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1161/2367] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:22:58.623849 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-56094d7b-d026-4e7b-8806-9f8a363de01f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:58.624693 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-56094d7b-d026-4e7b-8806-9f8a363de01f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: e3faeee3-0724-417b-8575-ac8e59663103] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:58.642242 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-56094d7b-d026-4e7b-8806-9f8a363de01f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:58.647126 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-56094d7b-d026-4e7b-8806-9f8a363de01f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:58.647843 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-56094d7b-d026-4e7b-8806-9f8a363de01f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:58.650137 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-56094d7b-d026-4e7b-8806-9f8a363de01f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:58.653641 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-56094d7b-d026-4e7b-8806-9f8a363de01f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:58.654361 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-56094d7b-d026-4e7b-8806-9f8a363de01f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:58.939713 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-56094d7b-d026-4e7b-8806-9f8a363de01f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:58.954134 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-56094d7b-d026-4e7b-8806-9f8a363de01f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/e3faeee3-0724-417b-8575-ac8e59663103" status: 200 len: 1307 microversion: 2.1 time: 0.335114 Oct 30 01:22:58.957473 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1207/2368] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:22:58 2022] GET /compute/v2.1/servers/e3faeee3-0724-417b-8575-ac8e59663103 => generated 1307 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:22:59.319039 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ae12ec6c-88da-4be9-85d3-476d3c1d1e5f tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Calling method '.version_select at 0x7f44cc1d15e0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:59.362995 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5ce6419b-11d3-4859-9adc-5d93185d17fa tempest-ServicesAdminTestJSON-1504671147 tempest-ServicesAdminTestJSON-1504671147-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:59.370100 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5ce6419b-11d3-4859-9adc-5d93185d17fa tempest-ServicesAdminTestJSON-1504671147 tempest-ServicesAdminTestJSON-1504671147-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:59.372916 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5ce6419b-11d3-4859-9adc-5d93185d17fa tempest-ServicesAdminTestJSON-1504671147 tempest-ServicesAdminTestJSON-1504671147-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:59.373736 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5ce6419b-11d3-4859-9adc-5d93185d17fa tempest-ServicesAdminTestJSON-1504671147 tempest-ServicesAdminTestJSON-1504671147-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:59.376481 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5ce6419b-11d3-4859-9adc-5d93185d17fa tempest-ServicesAdminTestJSON-1504671147 tempest-ServicesAdminTestJSON-1504671147-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:59.376921 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5ce6419b-11d3-4859-9adc-5d93185d17fa tempest-ServicesAdminTestJSON-1504671147 tempest-ServicesAdminTestJSON-1504671147-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:59.401287 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5ce6419b-11d3-4859-9adc-5d93185d17fa tempest-ServicesAdminTestJSON-1504671147 tempest-ServicesAdminTestJSON-1504671147-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:59.452992 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5ce6419b-11d3-4859-9adc-5d93185d17fa tempest-ServicesAdminTestJSON-1504671147 tempest-ServicesAdminTestJSON-1504671147-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.384303 Oct 30 01:22:59.454848 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1208/2369] 10.222.0.13 () {58 vars in 1137 bytes} [Sun Oct 30 01:22:59 2022] GET /compute/v2.1/os-services => generated 944 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:22:59.467938 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c058c416-8de5-4ae7-9ccb-e795cba7faf3 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:59.470367 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c058c416-8de5-4ae7-9ccb-e795cba7faf3 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7f629426-c4e6-4c3f-8e54-efd452d14dd7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:59.484788 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ae12ec6c-88da-4be9-85d3-476d3c1d1e5f tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/1967c4b534c34af2b66bdde096dbc126" status: 200 len: 371 microversion: 2.1 time: 0.748104 Oct 30 01:22:59.485889 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1162/2370] 10.222.0.13 () {58 vars in 1242 bytes} [Sun Oct 30 01:22:58 2022] GET /compute/v2.1/os-quota-sets/1967c4b534c34af2b66bdde096dbc126 => generated 371 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:22:59.501662 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-df965b3f-30a2-4e2e-9f02-e975c1773cc6 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:59.503564 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-df965b3f-30a2-4e2e-9f02-e975c1773cc6 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] [instance: 23cbc0a6-6137-4e64-b264-c67fceba507f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:22:59.504153 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c058c416-8de5-4ae7-9ccb-e795cba7faf3 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:59.504903 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c058c416-8de5-4ae7-9ccb-e795cba7faf3 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:59.508406 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c058c416-8de5-4ae7-9ccb-e795cba7faf3 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:59.509550 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c058c416-8de5-4ae7-9ccb-e795cba7faf3 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:59.513784 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c058c416-8de5-4ae7-9ccb-e795cba7faf3 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:59.514648 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c058c416-8de5-4ae7-9ccb-e795cba7faf3 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:59.530511 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df965b3f-30a2-4e2e-9f02-e975c1773cc6 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:59.530511 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df965b3f-30a2-4e2e-9f02-e975c1773cc6 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:59.530511 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df965b3f-30a2-4e2e-9f02-e975c1773cc6 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:59.530511 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df965b3f-30a2-4e2e-9f02-e975c1773cc6 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:59.530896 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df965b3f-30a2-4e2e-9f02-e975c1773cc6 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:59.531573 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df965b3f-30a2-4e2e-9f02-e975c1773cc6 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:59.781927 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c058c416-8de5-4ae7-9ccb-e795cba7faf3 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:22:59.792767 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c058c416-8de5-4ae7-9ccb-e795cba7faf3 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7" status: 200 len: 1507 microversion: 2.1 time: 0.336822 Oct 30 01:22:59.794923 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1209/2371] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:22:59 2022] GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7 => generated 1507 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:22:59.805988 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f61e60e9-05ab-4039-a361-28f200123a00 tempest-ServicesAdminTestJSON-1504671147 tempest-ServicesAdminTestJSON-1504671147-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:22:59.817990 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f61e60e9-05ab-4039-a361-28f200123a00 tempest-ServicesAdminTestJSON-1504671147 tempest-ServicesAdminTestJSON-1504671147-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:59.818478 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f61e60e9-05ab-4039-a361-28f200123a00 tempest-ServicesAdminTestJSON-1504671147 tempest-ServicesAdminTestJSON-1504671147-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:59.818913 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f61e60e9-05ab-4039-a361-28f200123a00 tempest-ServicesAdminTestJSON-1504671147 tempest-ServicesAdminTestJSON-1504671147-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:59.819803 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f61e60e9-05ab-4039-a361-28f200123a00 tempest-ServicesAdminTestJSON-1504671147 tempest-ServicesAdminTestJSON-1504671147-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:22:59.822134 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f61e60e9-05ab-4039-a361-28f200123a00 tempest-ServicesAdminTestJSON-1504671147 tempest-ServicesAdminTestJSON-1504671147-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:22:59.823404 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f61e60e9-05ab-4039-a361-28f200123a00 tempest-ServicesAdminTestJSON-1504671147 tempest-ServicesAdminTestJSON-1504671147-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:22:59.879905 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f61e60e9-05ab-4039-a361-28f200123a00 tempest-ServicesAdminTestJSON-1504671147 tempest-ServicesAdminTestJSON-1504671147-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?host=n-d-master-1" status: 200 len: 578 microversion: 2.1 time: 0.083753 Oct 30 01:22:59.880777 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1210/2372] 10.222.0.13 () {58 vars in 1172 bytes} [Sun Oct 30 01:22:59 2022] GET /compute/v2.1/os-services?host=n-d-master-1 => generated 578 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:22:59.892994 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f7272463-1f40-4918-91bd-5b2abbc94494 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Action: 'update', calling method: .version_select at 0x7f44cc047ca0>, body: {"quota_set": {"ram": "5120"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:22:59.999697 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-df965b3f-30a2-4e2e-9f02-e975c1773cc6 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055b96d1eb20418d96450efde939e020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1868480e44540be85a8c2862cd780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:00.022649 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f7272463-1f40-4918-91bd-5b2abbc94494 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:00.023381 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f7272463-1f40-4918-91bd-5b2abbc94494 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:00.023948 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f7272463-1f40-4918-91bd-5b2abbc94494 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:00.024828 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f7272463-1f40-4918-91bd-5b2abbc94494 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:00.025472 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f7272463-1f40-4918-91bd-5b2abbc94494 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:00.026481 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f7272463-1f40-4918-91bd-5b2abbc94494 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:00.027606 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-df965b3f-30a2-4e2e-9f02-e975c1773cc6 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] 10.222.0.13 "GET /compute/v2.1/servers/23cbc0a6-6137-4e64-b264-c67fceba507f" status: 200 len: 1323 microversion: 2.1 time: 0.540384 Oct 30 01:23:00.031412 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1163/2373] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:22:59 2022] GET /compute/v2.1/servers/23cbc0a6-6137-4e64-b264-c67fceba507f => generated 1323 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:00.051448 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7d407c2d-d97e-48e9-a80c-0e57c225779f tempest-ServicesAdminTestJSON-1504671147 tempest-ServicesAdminTestJSON-1504671147-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:00.059557 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7d407c2d-d97e-48e9-a80c-0e57c225779f tempest-ServicesAdminTestJSON-1504671147 tempest-ServicesAdminTestJSON-1504671147-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:00.081651 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7d407c2d-d97e-48e9-a80c-0e57c225779f tempest-ServicesAdminTestJSON-1504671147 tempest-ServicesAdminTestJSON-1504671147-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:00.084887 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7d407c2d-d97e-48e9-a80c-0e57c225779f tempest-ServicesAdminTestJSON-1504671147 tempest-ServicesAdminTestJSON-1504671147-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:00.085912 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7d407c2d-d97e-48e9-a80c-0e57c225779f tempest-ServicesAdminTestJSON-1504671147 tempest-ServicesAdminTestJSON-1504671147-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:00.087235 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7d407c2d-d97e-48e9-a80c-0e57c225779f tempest-ServicesAdminTestJSON-1504671147 tempest-ServicesAdminTestJSON-1504671147-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:00.087822 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7d407c2d-d97e-48e9-a80c-0e57c225779f tempest-ServicesAdminTestJSON-1504671147 tempest-ServicesAdminTestJSON-1504671147-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:00.158471 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7d407c2d-d97e-48e9-a80c-0e57c225779f tempest-ServicesAdminTestJSON-1504671147 tempest-ServicesAdminTestJSON-1504671147-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.125640 Oct 30 01:23:00.159851 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1164/2374] 10.222.0.13 () {58 vars in 1176 bytes} [Sun Oct 30 01:23:00 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:23:00.169892 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f3929830-7981-4b91-9f90-74b732a15da9 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:00.171135 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f3929830-7981-4b91-9f90-74b732a15da9 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: e3faeee3-0724-417b-8575-ac8e59663103] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:00.181764 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f3929830-7981-4b91-9f90-74b732a15da9 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:00.187061 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f3929830-7981-4b91-9f90-74b732a15da9 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:00.187790 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f3929830-7981-4b91-9f90-74b732a15da9 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:00.188583 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f3929830-7981-4b91-9f90-74b732a15da9 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:00.189080 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f3929830-7981-4b91-9f90-74b732a15da9 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:00.189503 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f3929830-7981-4b91-9f90-74b732a15da9 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:00.262306 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f7272463-1f40-4918-91bd-5b2abbc94494 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/1967c4b534c34af2b66bdde096dbc126" status: 200 len: 328 microversion: 2.1 time: 0.380425 Oct 30 01:23:00.271237 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1211/2375] 10.222.0.13 () {60 vars in 1262 bytes} [Sun Oct 30 01:22:59 2022] PUT /compute/v2.1/os-quota-sets/1967c4b534c34af2b66bdde096dbc126 => generated 328 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:23:00.276207 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d93b697b-e2d6-4bdb-8dc5-7d9ebdf13871 tempest-ServicesAdminTestJSON-1504671147 tempest-ServicesAdminTestJSON-1504671147-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:00.282297 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d93b697b-e2d6-4bdb-8dc5-7d9ebdf13871 tempest-ServicesAdminTestJSON-1504671147 tempest-ServicesAdminTestJSON-1504671147-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:00.289033 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d93b697b-e2d6-4bdb-8dc5-7d9ebdf13871 tempest-ServicesAdminTestJSON-1504671147 tempest-ServicesAdminTestJSON-1504671147-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:00.289745 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d93b697b-e2d6-4bdb-8dc5-7d9ebdf13871 tempest-ServicesAdminTestJSON-1504671147 tempest-ServicesAdminTestJSON-1504671147-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:00.290796 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d93b697b-e2d6-4bdb-8dc5-7d9ebdf13871 tempest-ServicesAdminTestJSON-1504671147 tempest-ServicesAdminTestJSON-1504671147-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:00.291908 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d93b697b-e2d6-4bdb-8dc5-7d9ebdf13871 tempest-ServicesAdminTestJSON-1504671147 tempest-ServicesAdminTestJSON-1504671147-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:00.293761 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d93b697b-e2d6-4bdb-8dc5-7d9ebdf13871 tempest-ServicesAdminTestJSON-1504671147 tempest-ServicesAdminTestJSON-1504671147-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:00.345099 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:00.355816 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d93b697b-e2d6-4bdb-8dc5-7d9ebdf13871 tempest-ServicesAdminTestJSON-1504671147 tempest-ServicesAdminTestJSON-1504671147-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.089298 Oct 30 01:23:00.357834 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1212/2376] 10.222.0.13 () {58 vars in 1137 bytes} [Sun Oct 30 01:23:00 2022] GET /compute/v2.1/os-services => generated 944 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:23:00.365866 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f73bc8c1-3b0e-43a7-9377-d64a9f785bbb tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:00.451304 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f73bc8c1-3b0e-43a7-9377-d64a9f785bbb tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-quota-sets/1967c4b534c34af2b66bdde096dbc126" status: 202 len: 0 microversion: 2.1 time: 0.089465 Oct 30 01:23:00.452492 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1213/2377] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 30 01:23:00 2022] DELETE /compute/v2.1/os-quota-sets/1967c4b534c34af2b66bdde096dbc126 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:23:00.460389 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b08116c2-40a1-40d8-98cc-9366afd06157 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Calling method '.version_select at 0x7f44c7ecdf70>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:00.512045 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f3929830-7981-4b91-9f90-74b732a15da9 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:00.521357 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f3929830-7981-4b91-9f90-74b732a15da9 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/e3faeee3-0724-417b-8575-ac8e59663103" status: 200 len: 1307 microversion: 2.1 time: 0.360271 Oct 30 01:23:00.522870 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1165/2378] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:00 2022] GET /compute/v2.1/servers/e3faeee3-0724-417b-8575-ac8e59663103 => generated 1307 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:00.609073 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b08116c2-40a1-40d8-98cc-9366afd06157 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/1967c4b534c34af2b66bdde096dbc126" status: 200 len: 371 microversion: 2.1 time: 0.150449 Oct 30 01:23:00.609073 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1214/2379] 10.222.0.13 () {58 vars in 1242 bytes} [Sun Oct 30 01:23:00 2022] GET /compute/v2.1/os-quota-sets/1967c4b534c34af2b66bdde096dbc126 => generated 371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:23:00.819683 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8c35f9ef-c642-422f-98dc-499e0d1e99d6 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:00.820647 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8c35f9ef-c642-422f-98dc-499e0d1e99d6 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7f629426-c4e6-4c3f-8e54-efd452d14dd7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:00.830990 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8c35f9ef-c642-422f-98dc-499e0d1e99d6 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:00.831782 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8c35f9ef-c642-422f-98dc-499e0d1e99d6 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:00.833560 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8c35f9ef-c642-422f-98dc-499e0d1e99d6 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:00.834810 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8c35f9ef-c642-422f-98dc-499e0d1e99d6 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:00.835934 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8c35f9ef-c642-422f-98dc-499e0d1e99d6 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:00.836671 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8c35f9ef-c642-422f-98dc-499e0d1e99d6 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:01.060392 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5b49dbd7-96fb-49d8-8d1f-c25771a631e6 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:01.061387 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5b49dbd7-96fb-49d8-8d1f-c25771a631e6 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] [instance: 23cbc0a6-6137-4e64-b264-c67fceba507f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:01.075055 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5b49dbd7-96fb-49d8-8d1f-c25771a631e6 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:01.079162 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5b49dbd7-96fb-49d8-8d1f-c25771a631e6 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:01.082033 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5b49dbd7-96fb-49d8-8d1f-c25771a631e6 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:01.083007 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5b49dbd7-96fb-49d8-8d1f-c25771a631e6 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:01.083777 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5b49dbd7-96fb-49d8-8d1f-c25771a631e6 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:01.084685 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5b49dbd7-96fb-49d8-8d1f-c25771a631e6 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:01.120167 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8c35f9ef-c642-422f-98dc-499e0d1e99d6 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:01.128247 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8c35f9ef-c642-422f-98dc-499e0d1e99d6 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7" status: 200 len: 1507 microversion: 2.1 time: 0.313393 Oct 30 01:23:01.150426 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1166/2380] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:00 2022] GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7 => generated 1507 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:01.161543 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ba420e43-e058-4f86-90b8-a784f0c16cdc tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Calling method '.version_select at 0x7f44cc1d15e0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:01.472784 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5b49dbd7-96fb-49d8-8d1f-c25771a631e6 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055b96d1eb20418d96450efde939e020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1868480e44540be85a8c2862cd780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:01.488168 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5b49dbd7-96fb-49d8-8d1f-c25771a631e6 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] 10.222.0.13 "GET /compute/v2.1/servers/23cbc0a6-6137-4e64-b264-c67fceba507f" status: 200 len: 1323 microversion: 2.1 time: 0.434335 Oct 30 01:23:01.501718 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1215/2381] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:01 2022] GET /compute/v2.1/servers/23cbc0a6-6137-4e64-b264-c67fceba507f => generated 1323 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:01.541327 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ba420e43-e058-4f86-90b8-a784f0c16cdc tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/bd1a98f7e93441e1932677676d85d0c7/defaults" status: 200 len: 371 microversion: 2.1 time: 0.388872 Oct 30 01:23:01.542026 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1167/2382] 10.222.0.13 () {58 vars in 1269 bytes} [Sun Oct 30 01:23:01 2022] GET /compute/v2.1/os-quota-sets/bd1a98f7e93441e1932677676d85d0c7/defaults => generated 371 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:23:01.554790 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0b8576c7-f5c0-4395-8613-fc5a7bca7774 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:01.565651 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0b8576c7-f5c0-4395-8613-fc5a7bca7774 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: e3faeee3-0724-417b-8575-ac8e59663103] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:01.578367 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b8576c7-f5c0-4395-8613-fc5a7bca7774 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:01.580146 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b8576c7-f5c0-4395-8613-fc5a7bca7774 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:01.582061 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b8576c7-f5c0-4395-8613-fc5a7bca7774 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:01.583019 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b8576c7-f5c0-4395-8613-fc5a7bca7774 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:01.583643 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b8576c7-f5c0-4395-8613-fc5a7bca7774 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:01.585838 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b8576c7-f5c0-4395-8613-fc5a7bca7774 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:01.716319 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-6e781372-e5c6-4ba2-b49d-3e2bdd7e8a59 req-8e298df3-8154-4542-9083-1300eef3c92c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23cbc0a6-6137-4e64-b264-c67fceba507f", "name": "network-vif-plugged", "status": "completed", "tag": "de868ba1-8fcb-485f-9548-68c5b674c8dd"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:23:01.748283 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-6e781372-e5c6-4ba2-b49d-3e2bdd7e8a59 req-8e298df3-8154-4542-9083-1300eef3c92c service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:01.750126 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-6e781372-e5c6-4ba2-b49d-3e2bdd7e8a59 req-8e298df3-8154-4542-9083-1300eef3c92c service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:01.750126 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-6e781372-e5c6-4ba2-b49d-3e2bdd7e8a59 req-8e298df3-8154-4542-9083-1300eef3c92c service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:01.779736 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-6e781372-e5c6-4ba2-b49d-3e2bdd7e8a59 req-8e298df3-8154-4542-9083-1300eef3c92c service nova] Creating event network-vif-plugged:de868ba1-8fcb-485f-9548-68c5b674c8dd for instance 23cbc0a6-6137-4e64-b264-c67fceba507f on n-h1-master-1 Oct 30 01:23:01.786060 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-6e781372-e5c6-4ba2-b49d-3e2bdd7e8a59 req-8e298df3-8154-4542-9083-1300eef3c92c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076159 Oct 30 01:23:01.787364 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1168/2383] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:23:02.140107 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8ec690e0-65fc-410a-8189-d7a1c29091b3 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Action: 'update', calling method: .version_select at 0x7f44cc3434c0>, body: {"quota_set": {"ram": "5120"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:23:02.204505 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0b8576c7-f5c0-4395-8613-fc5a7bca7774 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:02.213063 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0b8576c7-f5c0-4395-8613-fc5a7bca7774 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/e3faeee3-0724-417b-8575-ac8e59663103" status: 200 len: 1307 microversion: 2.1 time: 0.663337 Oct 30 01:23:02.217818 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1216/2384] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:01 2022] GET /compute/v2.1/servers/e3faeee3-0724-417b-8575-ac8e59663103 => generated 1307 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:02.229787 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b14fdee2-aa65-40db-89bc-2cf1a8e74ba5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:02.230809 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b14fdee2-aa65-40db-89bc-2cf1a8e74ba5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7f629426-c4e6-4c3f-8e54-efd452d14dd7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:02.244289 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b14fdee2-aa65-40db-89bc-2cf1a8e74ba5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:02.250758 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b14fdee2-aa65-40db-89bc-2cf1a8e74ba5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:02.251523 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b14fdee2-aa65-40db-89bc-2cf1a8e74ba5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:02.252445 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b14fdee2-aa65-40db-89bc-2cf1a8e74ba5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:02.253093 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b14fdee2-aa65-40db-89bc-2cf1a8e74ba5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:02.253799 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b14fdee2-aa65-40db-89bc-2cf1a8e74ba5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:02.270246 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:02.475353 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ec690e0-65fc-410a-8189-d7a1c29091b3 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:02.476235 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ec690e0-65fc-410a-8189-d7a1c29091b3 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:02.486843 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ec690e0-65fc-410a-8189-d7a1c29091b3 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:02.486843 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ec690e0-65fc-410a-8189-d7a1c29091b3 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:02.486843 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ec690e0-65fc-410a-8189-d7a1c29091b3 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:02.486843 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ec690e0-65fc-410a-8189-d7a1c29091b3 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:02.613500 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b14fdee2-aa65-40db-89bc-2cf1a8e74ba5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:02.624468 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b14fdee2-aa65-40db-89bc-2cf1a8e74ba5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7" status: 200 len: 1507 microversion: 2.1 time: 0.405349 Oct 30 01:23:02.625904 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1217/2385] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:02 2022] GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7 => generated 1507 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:02.632647 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d38d6de6-9063-4548-94eb-6027915a3a77 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:02.633525 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d38d6de6-9063-4548-94eb-6027915a3a77 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] [instance: 23cbc0a6-6137-4e64-b264-c67fceba507f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:02.640771 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d38d6de6-9063-4548-94eb-6027915a3a77 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:02.641498 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d38d6de6-9063-4548-94eb-6027915a3a77 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:02.642106 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d38d6de6-9063-4548-94eb-6027915a3a77 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:02.643078 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d38d6de6-9063-4548-94eb-6027915a3a77 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:02.643673 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d38d6de6-9063-4548-94eb-6027915a3a77 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:02.644231 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d38d6de6-9063-4548-94eb-6027915a3a77 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:02.658314 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8ec690e0-65fc-410a-8189-d7a1c29091b3 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/7be4ccdd59a44161805b8791f2d7bede" status: 200 len: 328 microversion: 2.1 time: 0.524156 Oct 30 01:23:02.659894 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1169/2386] 10.222.0.13 () {60 vars in 1262 bytes} [Sun Oct 30 01:23:02 2022] PUT /compute/v2.1/os-quota-sets/7be4ccdd59a44161805b8791f2d7bede => generated 328 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:23:02.671365 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-185f887c-7855-4c46-a9cb-ca92c6eb292e tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Calling method '.version_select at 0x7f44cc78f700>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:02.796193 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-185f887c-7855-4c46-a9cb-ca92c6eb292e tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:02.796700 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-185f887c-7855-4c46-a9cb-ca92c6eb292e tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:02.797142 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-185f887c-7855-4c46-a9cb-ca92c6eb292e tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:02.797941 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-185f887c-7855-4c46-a9cb-ca92c6eb292e tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:02.798423 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-185f887c-7855-4c46-a9cb-ca92c6eb292e tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:02.798845 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-185f887c-7855-4c46-a9cb-ca92c6eb292e tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:02.881463 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-185f887c-7855-4c46-a9cb-ca92c6eb292e tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/7be4ccdd59a44161805b8791f2d7bede/detail" status: 200 len: 916 microversion: 2.1 time: 0.209011 Oct 30 01:23:02.884001 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1170/2387] 10.222.0.13 () {58 vars in 1263 bytes} [Sun Oct 30 01:23:02 2022] GET /compute/v2.1/os-quota-sets/7be4ccdd59a44161805b8791f2d7bede/detail => generated 916 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:23:02.955171 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d38d6de6-9063-4548-94eb-6027915a3a77 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055b96d1eb20418d96450efde939e020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1868480e44540be85a8c2862cd780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:02.967497 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d38d6de6-9063-4548-94eb-6027915a3a77 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] 10.222.0.13 "GET /compute/v2.1/servers/23cbc0a6-6137-4e64-b264-c67fceba507f" status: 200 len: 1323 microversion: 2.1 time: 0.339303 Oct 30 01:23:02.969256 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1218/2388] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:02 2022] GET /compute/v2.1/servers/23cbc0a6-6137-4e64-b264-c67fceba507f => generated 1323 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:03.247873 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ee52d2ac-d77f-47cf-be80-463a3e34a377 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:03.249121 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ee52d2ac-d77f-47cf-be80-463a3e34a377 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: e3faeee3-0724-417b-8575-ac8e59663103] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:03.261617 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ee52d2ac-d77f-47cf-be80-463a3e34a377 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:03.261984 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ee52d2ac-d77f-47cf-be80-463a3e34a377 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:03.262768 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ee52d2ac-d77f-47cf-be80-463a3e34a377 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:03.263563 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ee52d2ac-d77f-47cf-be80-463a3e34a377 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:03.264058 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ee52d2ac-d77f-47cf-be80-463a3e34a377 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:03.264822 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ee52d2ac-d77f-47cf-be80-463a3e34a377 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:03.452270 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ee52d2ac-d77f-47cf-be80-463a3e34a377 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:03.462249 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ee52d2ac-d77f-47cf-be80-463a3e34a377 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/e3faeee3-0724-417b-8575-ac8e59663103" status: 200 len: 1307 microversion: 2.1 time: 0.218855 Oct 30 01:23:03.467548 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1171/2389] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:03 2022] GET /compute/v2.1/servers/e3faeee3-0724-417b-8575-ac8e59663103 => generated 1307 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:03.599324 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-616e8eef-a214-4e62-bc40-de700aa5d7f3 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Action: 'update', calling method: .version_select at 0x7f44d0402a60>, body: {"quota_set": {"ram": "2048"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:23:03.653106 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bc1264cb-f9d3-4f6b-8472-b046dbecb46a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:03.653935 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-bc1264cb-f9d3-4f6b-8472-b046dbecb46a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7f629426-c4e6-4c3f-8e54-efd452d14dd7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:03.674660 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bc1264cb-f9d3-4f6b-8472-b046dbecb46a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:03.675805 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bc1264cb-f9d3-4f6b-8472-b046dbecb46a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:03.677447 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bc1264cb-f9d3-4f6b-8472-b046dbecb46a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:03.678963 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bc1264cb-f9d3-4f6b-8472-b046dbecb46a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:03.682722 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bc1264cb-f9d3-4f6b-8472-b046dbecb46a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:03.688247 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bc1264cb-f9d3-4f6b-8472-b046dbecb46a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:03.907410 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-616e8eef-a214-4e62-bc40-de700aa5d7f3 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:03.908265 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-616e8eef-a214-4e62-bc40-de700aa5d7f3 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:03.909429 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-616e8eef-a214-4e62-bc40-de700aa5d7f3 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:03.910493 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-616e8eef-a214-4e62-bc40-de700aa5d7f3 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:03.911055 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-616e8eef-a214-4e62-bc40-de700aa5d7f3 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:03.911579 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-616e8eef-a214-4e62-bc40-de700aa5d7f3 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:04.015794 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-616e8eef-a214-4e62-bc40-de700aa5d7f3 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:04.016308 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-616e8eef-a214-4e62-bc40-de700aa5d7f3 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:04.016747 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-616e8eef-a214-4e62-bc40-de700aa5d7f3 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:04.017533 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-616e8eef-a214-4e62-bc40-de700aa5d7f3 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:04.017987 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-616e8eef-a214-4e62-bc40-de700aa5d7f3 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:04.018414 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-616e8eef-a214-4e62-bc40-de700aa5d7f3 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:04.025186 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-bc1264cb-f9d3-4f6b-8472-b046dbecb46a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:04.038211 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bc1264cb-f9d3-4f6b-8472-b046dbecb46a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7" status: 200 len: 1507 microversion: 2.1 time: 0.390264 Oct 30 01:23:04.042869 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1172/2390] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:03 2022] GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7 => generated 1507 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:04.048440 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-85d850b9-7874-4148-ba7a-d0523c9b74f2 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:04.054234 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-85d850b9-7874-4148-ba7a-d0523c9b74f2 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] [instance: 23cbc0a6-6137-4e64-b264-c67fceba507f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:04.066282 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-85d850b9-7874-4148-ba7a-d0523c9b74f2 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:04.068557 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-85d850b9-7874-4148-ba7a-d0523c9b74f2 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:04.070964 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-85d850b9-7874-4148-ba7a-d0523c9b74f2 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:04.072454 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-85d850b9-7874-4148-ba7a-d0523c9b74f2 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:04.074999 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-85d850b9-7874-4148-ba7a-d0523c9b74f2 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:04.075649 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-85d850b9-7874-4148-ba7a-d0523c9b74f2 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:04.253282 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-616e8eef-a214-4e62-bc40-de700aa5d7f3 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/7be4ccdd59a44161805b8791f2d7bede?user_id=55b367476d0443fb9fdb4193f811a420" status: 200 len: 328 microversion: 2.1 time: 0.654674 Oct 30 01:23:04.253282 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1219/2391] 10.222.0.13 () {60 vars in 1343 bytes} [Sun Oct 30 01:23:03 2022] PUT /compute/v2.1/os-quota-sets/7be4ccdd59a44161805b8791f2d7bede?user_id=55b367476d0443fb9fdb4193f811a420 => generated 328 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:23:04.262312 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-579c3136-6494-4502-bbdc-26c9e9b31ac8 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Calling method '.version_select at 0x7f44d03ed310>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:04.311940 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-85d850b9-7874-4148-ba7a-d0523c9b74f2 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055b96d1eb20418d96450efde939e020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1868480e44540be85a8c2862cd780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:04.324647 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-85d850b9-7874-4148-ba7a-d0523c9b74f2 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] 10.222.0.13 "GET /compute/v2.1/servers/23cbc0a6-6137-4e64-b264-c67fceba507f" status: 200 len: 1323 microversion: 2.1 time: 0.284759 Oct 30 01:23:04.326075 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1173/2392] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:04 2022] GET /compute/v2.1/servers/23cbc0a6-6137-4e64-b264-c67fceba507f => generated 1323 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:04.494425 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-20aa2609-74c7-4fdd-a3d7-92476d5822d7 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:04.495999 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-20aa2609-74c7-4fdd-a3d7-92476d5822d7 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: e3faeee3-0724-417b-8575-ac8e59663103] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:04.509500 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-20aa2609-74c7-4fdd-a3d7-92476d5822d7 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:04.513977 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-20aa2609-74c7-4fdd-a3d7-92476d5822d7 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:04.513977 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-20aa2609-74c7-4fdd-a3d7-92476d5822d7 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:04.515042 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-20aa2609-74c7-4fdd-a3d7-92476d5822d7 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:04.518003 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-20aa2609-74c7-4fdd-a3d7-92476d5822d7 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:04.518908 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-20aa2609-74c7-4fdd-a3d7-92476d5822d7 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:04.657217 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-579c3136-6494-4502-bbdc-26c9e9b31ac8 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/7be4ccdd59a44161805b8791f2d7bede?user_id=55b367476d0443fb9fdb4193f811a420" status: 200 len: 370 microversion: 2.1 time: 0.400101 Oct 30 01:23:04.658389 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1220/2393] 10.222.0.13 () {58 vars in 1323 bytes} [Sun Oct 30 01:23:04 2022] GET /compute/v2.1/os-quota-sets/7be4ccdd59a44161805b8791f2d7bede?user_id=55b367476d0443fb9fdb4193f811a420 => generated 370 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:23:04.784941 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-20aa2609-74c7-4fdd-a3d7-92476d5822d7 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:04.795825 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-20aa2609-74c7-4fdd-a3d7-92476d5822d7 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/e3faeee3-0724-417b-8575-ac8e59663103" status: 200 len: 1307 microversion: 2.1 time: 0.310014 Oct 30 01:23:04.796406 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1174/2394] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:04 2022] GET /compute/v2.1/servers/e3faeee3-0724-417b-8575-ac8e59663103 => generated 1307 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:05.065489 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d4e994a8-01dd-459d-8da8-b026a47ae24a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:05.069380 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d4e994a8-01dd-459d-8da8-b026a47ae24a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7f629426-c4e6-4c3f-8e54-efd452d14dd7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:05.091749 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4e994a8-01dd-459d-8da8-b026a47ae24a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:05.092126 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4e994a8-01dd-459d-8da8-b026a47ae24a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:05.092569 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4e994a8-01dd-459d-8da8-b026a47ae24a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:05.100046 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4e994a8-01dd-459d-8da8-b026a47ae24a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:05.101544 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4e994a8-01dd-459d-8da8-b026a47ae24a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:05.102529 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4e994a8-01dd-459d-8da8-b026a47ae24a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:05.329911 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-cf61caf1-8667-431a-9f98-1fa5c12cd63a req-2943451b-0c80-4ce9-a424-58b8edbc993f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3faeee3-0724-417b-8575-ac8e59663103", "name": "network-vif-plugged", "status": "completed", "tag": "f422e3db-4c59-447a-b83c-3fe06b9aefaa"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:23:05.337898 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:05.357303 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-cf61caf1-8667-431a-9f98-1fa5c12cd63a req-2943451b-0c80-4ce9-a424-58b8edbc993f service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:05.357813 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-cf61caf1-8667-431a-9f98-1fa5c12cd63a req-2943451b-0c80-4ce9-a424-58b8edbc993f service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:05.367288 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-cf61caf1-8667-431a-9f98-1fa5c12cd63a req-2943451b-0c80-4ce9-a424-58b8edbc993f service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:05.377929 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d4e994a8-01dd-459d-8da8-b026a47ae24a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:05.382050 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=100 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:05.388720 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d4e994a8-01dd-459d-8da8-b026a47ae24a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7" status: 200 len: 1507 microversion: 2.1 time: 0.328547 Oct 30 01:23:05.389663 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1221/2395] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:05 2022] GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7 => generated 1507 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:05.394475 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6c62e42d-caf9-4506-860c-b0eda82e40bc tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:05.395322 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6c62e42d-caf9-4506-860c-b0eda82e40bc tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] [instance: 23cbc0a6-6137-4e64-b264-c67fceba507f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:05.402230 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c62e42d-caf9-4506-860c-b0eda82e40bc tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:05.402954 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c62e42d-caf9-4506-860c-b0eda82e40bc tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:05.403610 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c62e42d-caf9-4506-860c-b0eda82e40bc tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:05.404523 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c62e42d-caf9-4506-860c-b0eda82e40bc tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:05.405193 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c62e42d-caf9-4506-860c-b0eda82e40bc tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:05.411051 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c62e42d-caf9-4506-860c-b0eda82e40bc tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:05.414506 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-cf61caf1-8667-431a-9f98-1fa5c12cd63a req-2943451b-0c80-4ce9-a424-58b8edbc993f service nova] Creating event network-vif-plugged:f422e3db-4c59-447a-b83c-3fe06b9aefaa for instance e3faeee3-0724-417b-8575-ac8e59663103 on n-h1-master-1 Oct 30 01:23:05.430877 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-cf61caf1-8667-431a-9f98-1fa5c12cd63a req-2943451b-0c80-4ce9-a424-58b8edbc993f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105030 Oct 30 01:23:05.439536 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1175/2396] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:23:05.635734 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b24fd58f-6ea4-48f4-af77-12f694d5b4ac tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Calling method '.version_select at 0x7f44c7a904c0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:05.797866 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6c62e42d-caf9-4506-860c-b0eda82e40bc tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055b96d1eb20418d96450efde939e020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1868480e44540be85a8c2862cd780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:05.814334 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6c62e42d-caf9-4506-860c-b0eda82e40bc tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] 10.222.0.13 "GET /compute/v2.1/servers/23cbc0a6-6137-4e64-b264-c67fceba507f" status: 200 len: 1516 microversion: 2.1 time: 0.418557 Oct 30 01:23:05.815595 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1222/2397] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:05 2022] GET /compute/v2.1/servers/23cbc0a6-6137-4e64-b264-c67fceba507f => generated 1516 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:05.823540 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6a4c4f4e-5b7b-499e-80c9-9885c7b20090 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:05.828560 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6a4c4f4e-5b7b-499e-80c9-9885c7b20090 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: e3faeee3-0724-417b-8575-ac8e59663103] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:05.846301 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a4c4f4e-5b7b-499e-80c9-9885c7b20090 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:05.854833 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a4c4f4e-5b7b-499e-80c9-9885c7b20090 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:05.856509 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a4c4f4e-5b7b-499e-80c9-9885c7b20090 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:05.859341 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a4c4f4e-5b7b-499e-80c9-9885c7b20090 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:05.861484 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a4c4f4e-5b7b-499e-80c9-9885c7b20090 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:05.863763 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a4c4f4e-5b7b-499e-80c9-9885c7b20090 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:06.109052 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b24fd58f-6ea4-48f4-af77-12f694d5b4ac tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/bd1a98f7e93441e1932677676d85d0c7/defaults" status: 200 len: 371 microversion: 2.1 time: 0.478312 Oct 30 01:23:06.112099 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1176/2398] 10.222.0.13 () {58 vars in 1269 bytes} [Sun Oct 30 01:23:05 2022] GET /compute/v2.1/os-quota-sets/bd1a98f7e93441e1932677676d85d0c7/defaults => generated 371 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:23:06.137967 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-af5c3fce-2d8c-41bf-a744-685ef4cf395c tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:06.144819 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-af5c3fce-2d8c-41bf-a744-685ef4cf395c tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] [instance: 33403d18-1832-4c1f-a824-150b5fbfd22f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:06.146993 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af5c3fce-2d8c-41bf-a744-685ef4cf395c tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:06.148094 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af5c3fce-2d8c-41bf-a744-685ef4cf395c tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:06.148944 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af5c3fce-2d8c-41bf-a744-685ef4cf395c tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:06.149914 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af5c3fce-2d8c-41bf-a744-685ef4cf395c tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:06.150587 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af5c3fce-2d8c-41bf-a744-685ef4cf395c tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:06.151516 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af5c3fce-2d8c-41bf-a744-685ef4cf395c tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:06.160454 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6a4c4f4e-5b7b-499e-80c9-9885c7b20090 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:06.170144 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6a4c4f4e-5b7b-499e-80c9-9885c7b20090 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/e3faeee3-0724-417b-8575-ac8e59663103" status: 200 len: 1307 microversion: 2.1 time: 0.352063 Oct 30 01:23:06.182611 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1223/2399] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:05 2022] GET /compute/v2.1/servers/e3faeee3-0724-417b-8575-ac8e59663103 => generated 1307 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:06.191976 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f33b7dc5-a7d6-467a-b73a-4fa4ca688062 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Action: 'update', calling method: .version_select at 0x7f44cc068040>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:23:06.330207 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-af5c3fce-2d8c-41bf-a744-685ef4cf395c tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055b96d1eb20418d96450efde939e020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1868480e44540be85a8c2862cd780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:06.341303 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-af5c3fce-2d8c-41bf-a744-685ef4cf395c tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] 10.222.0.13 "GET /compute/v2.1/servers/33403d18-1832-4c1f-a824-150b5fbfd22f" status: 200 len: 1517 microversion: 2.1 time: 0.210831 Oct 30 01:23:06.342228 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1177/2400] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:06 2022] GET /compute/v2.1/servers/33403d18-1832-4c1f-a824-150b5fbfd22f => generated 1517 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:06.369231 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3672c094-f577-4000-b9c0-b7fd4fe8152b tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:06.370655 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3672c094-f577-4000-b9c0-b7fd4fe8152b tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] [instance: 33403d18-1832-4c1f-a824-150b5fbfd22f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:06.382383 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3672c094-f577-4000-b9c0-b7fd4fe8152b tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:06.388999 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3672c094-f577-4000-b9c0-b7fd4fe8152b tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:06.389630 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3672c094-f577-4000-b9c0-b7fd4fe8152b tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:06.391176 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3672c094-f577-4000-b9c0-b7fd4fe8152b tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:06.391899 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3672c094-f577-4000-b9c0-b7fd4fe8152b tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:06.392629 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3672c094-f577-4000-b9c0-b7fd4fe8152b tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:06.479909 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3672c094-f577-4000-b9c0-b7fd4fe8152b tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] [instance: 33403d18-1832-4c1f-a824-150b5fbfd22f] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:23:06.760812 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f33b7dc5-a7d6-467a-b73a-4fa4ca688062 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:06.761550 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f33b7dc5-a7d6-467a-b73a-4fa4ca688062 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:06.762206 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f33b7dc5-a7d6-467a-b73a-4fa4ca688062 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:06.763184 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f33b7dc5-a7d6-467a-b73a-4fa4ca688062 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:06.764311 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f33b7dc5-a7d6-467a-b73a-4fa4ca688062 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:06.765658 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f33b7dc5-a7d6-467a-b73a-4fa4ca688062 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:06.904368 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3672c094-f577-4000-b9c0-b7fd4fe8152b tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] 10.222.0.13 "DELETE /compute/v2.1/servers/33403d18-1832-4c1f-a824-150b5fbfd22f" status: 204 len: 0 microversion: 2.1 time: 0.539310 Oct 30 01:23:06.908280 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1178/2401] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:23:06 2022] DELETE /compute/v2.1/servers/33403d18-1832-4c1f-a824-150b5fbfd22f => generated 0 bytes in 541 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 30 01:23:07.162567 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5564e4e2-c092-4317-8f19-cc0cfbeb7018 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Action: 'create', calling method: .version_select at 0x7f44c7a909d0>, body: {"keypair": {"name": "tempest-keypair-509941397", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIImnNmSVUtT9S5n/s0uxMEqPIZT1F+XegUlURDS40NkqCA/P+37LbdC4iHsAGjVnNnbqGDvROLQWRYPW4ubXTw8OAz8/tkhP7TF6tocKN90sjQ354qFVGPK0Rx0x2ylQ=="}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:23:07.213112 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-5564e4e2-c092-4317-8f19-cc0cfbeb7018 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Getting quotas for project 2a5e20978d1a4886b04d37eef4c23d1e. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:23:07.226164 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-5564e4e2-c092-4317-8f19-cc0cfbeb7018 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Getting quotas for user a1e23e3096f740508e6fb6626a29336f and project 2a5e20978d1a4886b04d37eef4c23d1e. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:23:07.355390 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5564e4e2-c092-4317-8f19-cc0cfbeb7018 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.441404 Oct 30 01:23:07.356530 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1179/2402] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 30 01:23:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:23:07.362184 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-05e9b2ce-e36a-4448-898f-8fe956233283 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:07.375918 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-05e9b2ce-e36a-4448-898f-8fe956233283 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7f629426-c4e6-4c3f-8e54-efd452d14dd7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:07.401527 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-05e9b2ce-e36a-4448-898f-8fe956233283 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:07.403743 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-05e9b2ce-e36a-4448-898f-8fe956233283 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:07.404299 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-05e9b2ce-e36a-4448-898f-8fe956233283 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:07.405914 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-05e9b2ce-e36a-4448-898f-8fe956233283 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:07.407243 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-05e9b2ce-e36a-4448-898f-8fe956233283 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:07.408296 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-05e9b2ce-e36a-4448-898f-8fe956233283 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:07.665052 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-05e9b2ce-e36a-4448-898f-8fe956233283 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:07.678198 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-05e9b2ce-e36a-4448-898f-8fe956233283 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7" status: 200 len: 1528 microversion: 2.1 time: 0.318559 Oct 30 01:23:07.695711 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1180/2403] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:07 2022] GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7 => generated 1528 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:07.710595 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ec2d2c73-f92a-45e5-978f-8312df26c1aa tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:07.715175 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ec2d2c73-f92a-45e5-978f-8312df26c1aa tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] [instance: 33403d18-1832-4c1f-a824-150b5fbfd22f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:07.722523 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ec2d2c73-f92a-45e5-978f-8312df26c1aa tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:07.726529 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ec2d2c73-f92a-45e5-978f-8312df26c1aa tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:07.726996 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ec2d2c73-f92a-45e5-978f-8312df26c1aa tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:07.727740 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ec2d2c73-f92a-45e5-978f-8312df26c1aa tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:07.728168 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ec2d2c73-f92a-45e5-978f-8312df26c1aa tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:07.731041 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ec2d2c73-f92a-45e5-978f-8312df26c1aa tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:08.059155 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ec2d2c73-f92a-45e5-978f-8312df26c1aa tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055b96d1eb20418d96450efde939e020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1868480e44540be85a8c2862cd780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:08.068854 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ec2d2c73-f92a-45e5-978f-8312df26c1aa tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] 10.222.0.13 "GET /compute/v2.1/servers/33403d18-1832-4c1f-a824-150b5fbfd22f" status: 200 len: 1523 microversion: 2.1 time: 0.369738 Oct 30 01:23:08.090129 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1181/2404] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:07 2022] GET /compute/v2.1/servers/33403d18-1832-4c1f-a824-150b5fbfd22f => generated 1523 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:08.104682 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a26f1cf6-30c6-4746-9cd7-63ae7fa85844 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:08.105312 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a26f1cf6-30c6-4746-9cd7-63ae7fa85844 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: e3faeee3-0724-417b-8575-ac8e59663103] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:08.112473 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a26f1cf6-30c6-4746-9cd7-63ae7fa85844 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:08.113199 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a26f1cf6-30c6-4746-9cd7-63ae7fa85844 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:08.113830 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a26f1cf6-30c6-4746-9cd7-63ae7fa85844 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:08.114737 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a26f1cf6-30c6-4746-9cd7-63ae7fa85844 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:08.115666 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a26f1cf6-30c6-4746-9cd7-63ae7fa85844 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:08.116622 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a26f1cf6-30c6-4746-9cd7-63ae7fa85844 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:08.344367 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a26f1cf6-30c6-4746-9cd7-63ae7fa85844 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:08.355914 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a26f1cf6-30c6-4746-9cd7-63ae7fa85844 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/e3faeee3-0724-417b-8575-ac8e59663103" status: 200 len: 1487 microversion: 2.1 time: 0.264595 Oct 30 01:23:08.356818 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1182/2405] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:08 2022] GET /compute/v2.1/servers/e3faeee3-0724-417b-8575-ac8e59663103 => generated 1487 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:08.384464 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3b98a141-8b10-4a48-9863-2a3bd382eb4c tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:23:08.385514 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3b98a141-8b10-4a48-9863-2a3bd382eb4c tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: e3faeee3-0724-417b-8575-ac8e59663103] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:08.396474 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b98a141-8b10-4a48-9863-2a3bd382eb4c tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:08.398435 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b98a141-8b10-4a48-9863-2a3bd382eb4c tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:08.398877 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b98a141-8b10-4a48-9863-2a3bd382eb4c tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:08.399633 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b98a141-8b10-4a48-9863-2a3bd382eb4c tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:08.400087 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b98a141-8b10-4a48-9863-2a3bd382eb4c tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:08.400505 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b98a141-8b10-4a48-9863-2a3bd382eb4c tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:08.570755 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f33b7dc5-a7d6-467a-b73a-4fa4ca688062 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/bd1a98f7e93441e1932677676d85d0c7" status: 200 len: 329 microversion: 2.1 time: 2.386657 Oct 30 01:23:08.572584 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1224/2406] 10.222.0.13 () {60 vars in 1263 bytes} [Sun Oct 30 01:23:06 2022] PUT /compute/v2.1/os-quota-sets/bd1a98f7e93441e1932677676d85d0c7 => generated 329 bytes in 2389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:23:08.587628 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-41963565-51ec-49cd-ac6e-6d940b11b133 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Action: 'update', calling method: .version_select at 0x7f44d02bb700>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:23:08.675399 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3b98a141-8b10-4a48-9863-2a3bd382eb4c tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "POST /compute/v2.1/servers/e3faeee3-0724-417b-8575-ac8e59663103/action" status: 202 len: 0 microversion: 2.1 time: 0.295694 Oct 30 01:23:08.679880 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1183/2407] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:23:08 2022] POST /compute/v2.1/servers/e3faeee3-0724-417b-8575-ac8e59663103/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 30 01:23:08.689648 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-29292e6b-b767-476f-b961-a939b80f97f2 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:08.693195 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-29292e6b-b767-476f-b961-a939b80f97f2 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: e3faeee3-0724-417b-8575-ac8e59663103] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:08.715134 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-29292e6b-b767-476f-b961-a939b80f97f2 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:08.717071 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-29292e6b-b767-476f-b961-a939b80f97f2 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:08.721257 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-29292e6b-b767-476f-b961-a939b80f97f2 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:08.722227 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-29292e6b-b767-476f-b961-a939b80f97f2 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:08.722697 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-29292e6b-b767-476f-b961-a939b80f97f2 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:08.723129 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-29292e6b-b767-476f-b961-a939b80f97f2 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:09.023585 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-29292e6b-b767-476f-b961-a939b80f97f2 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:09.034822 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-29292e6b-b767-476f-b961-a939b80f97f2 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/e3faeee3-0724-417b-8575-ac8e59663103" status: 200 len: 1492 microversion: 2.1 time: 0.354236 Oct 30 01:23:09.035946 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1184/2408] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:08 2022] GET /compute/v2.1/servers/e3faeee3-0724-417b-8575-ac8e59663103 => generated 1492 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:09.041032 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-52aba225-5fcb-43e9-b113-175047764f85 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:09.042564 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-52aba225-5fcb-43e9-b113-175047764f85 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7f629426-c4e6-4c3f-8e54-efd452d14dd7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:09.049001 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52aba225-5fcb-43e9-b113-175047764f85 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:09.049852 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52aba225-5fcb-43e9-b113-175047764f85 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:09.050523 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52aba225-5fcb-43e9-b113-175047764f85 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:09.051429 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52aba225-5fcb-43e9-b113-175047764f85 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:09.052028 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52aba225-5fcb-43e9-b113-175047764f85 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:09.052698 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52aba225-5fcb-43e9-b113-175047764f85 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:09.060314 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-41963565-51ec-49cd-ac6e-6d940b11b133 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:09.062237 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-41963565-51ec-49cd-ac6e-6d940b11b133 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:09.063850 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-41963565-51ec-49cd-ac6e-6d940b11b133 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:09.065803 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-41963565-51ec-49cd-ac6e-6d940b11b133 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:09.066314 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-41963565-51ec-49cd-ac6e-6d940b11b133 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:09.066762 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-41963565-51ec-49cd-ac6e-6d940b11b133 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:09.152530 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=2,nova_api:INSERT=16 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:09.290273 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-52aba225-5fcb-43e9-b113-175047764f85 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:09.300689 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-52aba225-5fcb-43e9-b113-175047764f85 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7" status: 200 len: 1523 microversion: 2.1 time: 0.263451 Oct 30 01:23:09.319265 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1185/2409] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:09 2022] GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7 => generated 1523 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:09.473758 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6c6989e9-b563-458c-95a7-467d4f86dde3 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-353280960", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:23:09.772025 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-6c6989e9-b563-458c-95a7-467d4f86dde3 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] validate_networks() for None {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:23:09.931024 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-6c6989e9-b563-458c-95a7-467d4f86dde3 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:23:09.931447 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-6c6989e9-b563-458c-95a7-467d4f86dde3 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:23:09.932035 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-6c6989e9-b563-458c-95a7-467d4f86dde3 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:23:09.932401 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-6c6989e9-b563-458c-95a7-467d4f86dde3 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:23:09.933009 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-6c6989e9-b563-458c-95a7-467d4f86dde3 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:23:09.942609 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c6989e9-b563-458c-95a7-467d4f86dde3 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:09.943124 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c6989e9-b563-458c-95a7-467d4f86dde3 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:09.943564 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c6989e9-b563-458c-95a7-467d4f86dde3 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:09.944316 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c6989e9-b563-458c-95a7-467d4f86dde3 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:09.946535 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c6989e9-b563-458c-95a7-467d4f86dde3 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:09.946535 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c6989e9-b563-458c-95a7-467d4f86dde3 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:09.965478 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-6c6989e9-b563-458c-95a7-467d4f86dde3 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Getting quotas for project 071a4f9e348b484795cea54316963a62. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:23:09.972470 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-6c6989e9-b563-458c-95a7-467d4f86dde3 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Getting quotas for user ab8011ce402b41ca9d3972a7a2a02cad and project 071a4f9e348b484795cea54316963a62. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:23:09.985857 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6c6989e9-b563-458c-95a7-467d4f86dde3 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:23:09.988547 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6c6989e9-b563-458c-95a7-467d4f86dde3 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] [instance: 55ba9ec4-90f4-4ded-b6ad-bc806de38256] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:23:10.305538 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6c6989e9-b563-458c-95a7-467d4f86dde3 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.984525 Oct 30 01:23:10.306435 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1186/2410] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:23:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:23:10.314416 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0b0e2ad9-fa92-4fd6-9f00-fc684e3f6c28 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:10.315526 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0b0e2ad9-fa92-4fd6-9f00-fc684e3f6c28 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] [instance: 33403d18-1832-4c1f-a824-150b5fbfd22f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:10.325680 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b0e2ad9-fa92-4fd6-9f00-fc684e3f6c28 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:10.326399 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b0e2ad9-fa92-4fd6-9f00-fc684e3f6c28 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:10.327633 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b0e2ad9-fa92-4fd6-9f00-fc684e3f6c28 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:10.329143 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b0e2ad9-fa92-4fd6-9f00-fc684e3f6c28 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:10.329977 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b0e2ad9-fa92-4fd6-9f00-fc684e3f6c28 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:10.331757 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b0e2ad9-fa92-4fd6-9f00-fc684e3f6c28 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:10.602637 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0b0e2ad9-fa92-4fd6-9f00-fc684e3f6c28 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055b96d1eb20418d96450efde939e020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1868480e44540be85a8c2862cd780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:10.610907 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0b0e2ad9-fa92-4fd6-9f00-fc684e3f6c28 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] 10.222.0.13 "GET /compute/v2.1/servers/33403d18-1832-4c1f-a824-150b5fbfd22f" status: 200 len: 1481 microversion: 2.1 time: 0.301195 Oct 30 01:23:10.611511 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1187/2411] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:10 2022] GET /compute/v2.1/servers/33403d18-1832-4c1f-a824-150b5fbfd22f => generated 1481 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:10.648492 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-8ada3b36-1adb-4209-88e6-cd77f608c5f6 req-3cf9200d-0af5-41d7-b561-8e04ff460ade service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f629426-c4e6-4c3f-8e54-efd452d14dd7", "name": "network-vif-plugged", "status": "completed", "tag": "0be1ebe4-f222-4d74-8298-cd63a4bc397c"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:23:10.696334 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-8ada3b36-1adb-4209-88e6-cd77f608c5f6 req-3cf9200d-0af5-41d7-b561-8e04ff460ade service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:10.698682 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-8ada3b36-1adb-4209-88e6-cd77f608c5f6 req-3cf9200d-0af5-41d7-b561-8e04ff460ade service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:10.699128 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-8ada3b36-1adb-4209-88e6-cd77f608c5f6 req-3cf9200d-0af5-41d7-b561-8e04ff460ade service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:10.733197 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-8ada3b36-1adb-4209-88e6-cd77f608c5f6 req-3cf9200d-0af5-41d7-b561-8e04ff460ade service nova] Creating event network-vif-plugged:0be1ebe4-f222-4d74-8298-cd63a4bc397c for instance 7f629426-c4e6-4c3f-8e54-efd452d14dd7 on n-h2-master-1 Oct 30 01:23:10.763843 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-8ada3b36-1adb-4209-88e6-cd77f608c5f6 req-3cf9200d-0af5-41d7-b561-8e04ff460ade service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131850 Oct 30 01:23:10.764835 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1188/2412] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:23:10.770471 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1fd90f63-770a-4a50-a112-4b68a9055e42 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:10.772906 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1fd90f63-770a-4a50-a112-4b68a9055e42 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: e3faeee3-0724-417b-8575-ac8e59663103] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:10.792728 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1fd90f63-770a-4a50-a112-4b68a9055e42 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:10.800408 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1fd90f63-770a-4a50-a112-4b68a9055e42 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:10.800965 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1fd90f63-770a-4a50-a112-4b68a9055e42 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:10.801789 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1fd90f63-770a-4a50-a112-4b68a9055e42 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:10.802274 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1fd90f63-770a-4a50-a112-4b68a9055e42 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:10.802711 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1fd90f63-770a-4a50-a112-4b68a9055e42 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:11.781831 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1fd90f63-770a-4a50-a112-4b68a9055e42 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:11.825353 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1fd90f63-770a-4a50-a112-4b68a9055e42 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/e3faeee3-0724-417b-8575-ac8e59663103" status: 200 len: 1472 microversion: 2.1 time: 1.052065 Oct 30 01:23:11.826640 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1189/2413] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:10 2022] GET /compute/v2.1/servers/e3faeee3-0724-417b-8575-ac8e59663103 => generated 1472 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:11.837232 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0a799dfd-8a63-4804-a569-8d5f52643bb9 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:11.839008 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0a799dfd-8a63-4804-a569-8d5f52643bb9 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] [instance: 55ba9ec4-90f4-4ded-b6ad-bc806de38256] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:11.918261 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-41963565-51ec-49cd-ac6e-6d940b11b133 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/bd1a98f7e93441e1932677676d85d0c7" status: 200 len: 329 microversion: 2.1 time: 3.334551 Oct 30 01:23:11.922599 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1225/2414] 10.222.0.13 () {60 vars in 1263 bytes} [Sun Oct 30 01:23:08 2022] PUT /compute/v2.1/os-quota-sets/bd1a98f7e93441e1932677676d85d0c7 => generated 329 bytes in 3339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:23:11.945186 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-139e1d3d-a862-45a4-8806-d2cf24290f2a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:11.946094 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-139e1d3d-a862-45a4-8806-d2cf24290f2a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7f629426-c4e6-4c3f-8e54-efd452d14dd7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:11.970624 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-139e1d3d-a862-45a4-8806-d2cf24290f2a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:11.971387 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-139e1d3d-a862-45a4-8806-d2cf24290f2a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:11.977162 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-139e1d3d-a862-45a4-8806-d2cf24290f2a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:11.978226 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-139e1d3d-a862-45a4-8806-d2cf24290f2a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:11.980917 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-139e1d3d-a862-45a4-8806-d2cf24290f2a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:11.983488 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-139e1d3d-a862-45a4-8806-d2cf24290f2a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:12.037760 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0a799dfd-8a63-4804-a569-8d5f52643bb9 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8011ce402b41ca9d3972a7a2a02cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071a4f9e348b484795cea54316963a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:12.052582 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0a799dfd-8a63-4804-a569-8d5f52643bb9 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] 10.222.0.13 "GET /compute/v2.1/servers/55ba9ec4-90f4-4ded-b6ad-bc806de38256" status: 200 len: 1213 microversion: 2.1 time: 0.221490 Oct 30 01:23:12.053210 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1190/2415] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:11 2022] GET /compute/v2.1/servers/55ba9ec4-90f4-4ded-b6ad-bc806de38256 => generated 1213 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:12.078907 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-a319b285-be90-498e-b86f-8d04d69091df req-e0f10f8b-852d-47af-a8e3-bff415bce498 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33403d18-1832-4c1f-a824-150b5fbfd22f", "name": "network-vif-deleted", "tag": "857d4752-0815-42d7-a723-7b3544a0a0f5"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:23:12.138983 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-a319b285-be90-498e-b86f-8d04d69091df req-e0f10f8b-852d-47af-a8e3-bff415bce498 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:12.145863 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-a319b285-be90-498e-b86f-8d04d69091df req-e0f10f8b-852d-47af-a8e3-bff415bce498 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:12.146573 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-a319b285-be90-498e-b86f-8d04d69091df req-e0f10f8b-852d-47af-a8e3-bff415bce498 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:12.185401 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-a319b285-be90-498e-b86f-8d04d69091df req-e0f10f8b-852d-47af-a8e3-bff415bce498 service nova] Creating event network-vif-deleted:857d4752-0815-42d7-a723-7b3544a0a0f5 for instance 33403d18-1832-4c1f-a824-150b5fbfd22f on n-h2-master-1 Oct 30 01:23:12.200268 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-a319b285-be90-498e-b86f-8d04d69091df req-e0f10f8b-852d-47af-a8e3-bff415bce498 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142181 Oct 30 01:23:12.207676 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1191/2416] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:23:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:23:12.260325 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a9b3a624-3196-4502-8cab-b853333ace76 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:12.262931 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a9b3a624-3196-4502-8cab-b853333ace76 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] [instance: 33403d18-1832-4c1f-a824-150b5fbfd22f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:12.275620 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a9b3a624-3196-4502-8cab-b853333ace76 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:12.276389 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a9b3a624-3196-4502-8cab-b853333ace76 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:12.277499 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a9b3a624-3196-4502-8cab-b853333ace76 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:12.279768 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a9b3a624-3196-4502-8cab-b853333ace76 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:12.282947 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a9b3a624-3196-4502-8cab-b853333ace76 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:12.283610 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a9b3a624-3196-4502-8cab-b853333ace76 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:12.304785 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-a9b3a624-3196-4502-8cab-b853333ace76 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] HTTP exception thrown: Instance 33403d18-1832-4c1f-a824-150b5fbfd22f could not be found. Oct 30 01:23:12.306939 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a9b3a624-3196-4502-8cab-b853333ace76 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Request method failure captured: Oct 30 01:23:12.306939 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/33403d18-1832-4c1f-a824-150b5fbfd22f HTTP/1.1 Oct 30 01:23:12.306939 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:23:12.306939 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:23:12.306939 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:23:12.306939 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:23:12.306939 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:23:12.306939 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:23:12.306939 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:23:12.306939 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:23:12.306939 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdHSJyYe2LQmpJGDpAuH6oijHeoDT5sarvvnYYjVihbFqV_GCaS1tTgRlAOosNzKOnotz-LHdlv0fY7gRz28FWNunXxQpW0q__OQUJm-J87BrpgoPlajglSEBf7KTCwja8RaN0_s8w2XjyG-8Vul-e76vQ6agD8cJtnQMZAlfG8Ap0M Oct 30 01:23:12.306939 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:23:12.306939 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:23:12.306939 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:23:12.306939 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:23:12.306939 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:23:12.306939 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:23:12.306939 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 4cd1868480e44540be85a8c2862cd780 Oct 30 01:23:12.306939 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ListServersNegativeTestJSON-529840825 Oct 30 01:23:12.306939 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:23:12.306939 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:23:12.309068 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4cd1868480e44540be85a8c2862cd780"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4cd1868480e44540be85a8c2862cd780"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4cd1868480e44540be85a8c2862cd780"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4cd1868480e44540be85a8c2862cd780"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:23:12.309068 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ListServersNegativeTestJSON-529840825 Oct 30 01:23:12.309068 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 4cd1868480e44540be85a8c2862cd780 Oct 30 01:23:12.309068 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-529840825 Oct 30 01:23:12.309068 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ListServersNegativeTestJSON-529840825-project Oct 30 01:23:12.309068 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:23:12.309068 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:23:12.309068 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 055b96d1eb20418d96450efde939e020 Oct 30 01:23:12.309068 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ListServersNegativeTestJSON-529840825-project Oct 30 01:23:12.309068 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:23:12.309068 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 33403d18-1832-4c1f-a824-150b5fbfd22f could not be found. Oct 30 01:23:12.309068 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '33403d18-1832-4c1f-a824-150b5fbfd22f'} Oct 30 01:23:12.309916 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:23:12.309916 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:23:12.309916 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:23:12.309916 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:23:12.309916 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:23:12.309916 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:23:12.309916 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:23:12.309916 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:23:12.309916 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:23:12.309916 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:23:12.309916 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33403d18-1832-4c1f-a824-150b5fbfd22f could not be found. Oct 30 01:23:12.309916 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:23:12.309916 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:23:12.309916 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:23:12.309916 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:23:12.309916 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:23:12.309916 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:23:12.309916 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:23:12.309916 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:23:12.309916 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:23:12.311915 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:23:12.311915 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:23:12.311915 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:23:12.311915 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:23:12.311915 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:23:12.311915 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:23:12.311915 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:23:12.311915 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33403d18-1832-4c1f-a824-150b5fbfd22f could not be found. Oct 30 01:23:12.311915 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:23:12.311915 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:23:12.311915 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:23:12.311915 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:23:12.311915 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:23:12.311915 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:23:12.311915 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:23:12.311915 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:23:12.311915 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33403d18-1832-4c1f-a824-150b5fbfd22f could not be found. Oct 30 01:23:12.311915 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:23:12.318249 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a9b3a624-3196-4502-8cab-b853333ace76 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Returning 404 to user: Instance 33403d18-1832-4c1f-a824-150b5fbfd22f could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:23:12.319628 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a9b3a624-3196-4502-8cab-b853333ace76 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] 10.222.0.13 "GET /compute/v2.1/servers/33403d18-1832-4c1f-a824-150b5fbfd22f" status: 404 len: 111 microversion: 2.1 time: 0.110494 Oct 30 01:23:12.327703 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1192/2417] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:12 2022] GET /compute/v2.1/servers/33403d18-1832-4c1f-a824-150b5fbfd22f => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:23:12.343164 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6496acc5-fc6e-4eea-971d-5cf33a47533d tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1812853575"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:23:12.350210 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6496acc5-fc6e-4eea-971d-5cf33a47533d tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: e3faeee3-0724-417b-8575-ac8e59663103] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:12.365087 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6496acc5-fc6e-4eea-971d-5cf33a47533d tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:12.365700 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6496acc5-fc6e-4eea-971d-5cf33a47533d tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:12.366144 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6496acc5-fc6e-4eea-971d-5cf33a47533d tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:12.372492 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6496acc5-fc6e-4eea-971d-5cf33a47533d tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:12.373037 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6496acc5-fc6e-4eea-971d-5cf33a47533d tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:12.373555 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6496acc5-fc6e-4eea-971d-5cf33a47533d tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:12.810303 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-139e1d3d-a862-45a4-8806-d2cf24290f2a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:12.827277 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-139e1d3d-a862-45a4-8806-d2cf24290f2a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7" status: 200 len: 1523 microversion: 2.1 time: 0.901315 Oct 30 01:23:12.828499 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1226/2418] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:11 2022] GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7 => generated 1523 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:12.833373 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7dbbc8c2-ab04-499c-9ce9-bd85be01d3d2 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:12.853068 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7dbbc8c2-ab04-499c-9ce9-bd85be01d3d2 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '055b96d1eb20418d96450efde939e020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1868480e44540be85a8c2862cd780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:12.854871 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7dbbc8c2-ab04-499c-9ce9-bd85be01d3d2 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '4cd1868480e44540be85a8c2862cd780'} {{(pid=121102) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 30 01:23:12.881204 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7dbbc8c2-ab04-499c-9ce9-bd85be01d3d2 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:12.882227 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7dbbc8c2-ab04-499c-9ce9-bd85be01d3d2 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:12.882828 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7dbbc8c2-ab04-499c-9ce9-bd85be01d3d2 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:12.883808 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7dbbc8c2-ab04-499c-9ce9-bd85be01d3d2 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:12.885831 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7dbbc8c2-ab04-499c-9ce9-bd85be01d3d2 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:12.888711 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7dbbc8c2-ab04-499c-9ce9-bd85be01d3d2 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:13.064385 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7dbbc8c2-ab04-499c-9ce9-bd85be01d3d2 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] 10.222.0.13 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.234587 Oct 30 01:23:13.065965 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1227/2419] 10.222.0.13 () {58 vars in 1230 bytes} [Sun Oct 30 01:23:12 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:23:13.080976 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cfd8e660-6fc5-434d-8ab6-0e7ed276197b tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:13.081920 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cfd8e660-6fc5-434d-8ab6-0e7ed276197b tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] [instance: 55ba9ec4-90f4-4ded-b6ad-bc806de38256] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:13.096574 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cfd8e660-6fc5-434d-8ab6-0e7ed276197b tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:13.097044 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cfd8e660-6fc5-434d-8ab6-0e7ed276197b tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:13.097528 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cfd8e660-6fc5-434d-8ab6-0e7ed276197b tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:13.098240 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cfd8e660-6fc5-434d-8ab6-0e7ed276197b tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:13.098696 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cfd8e660-6fc5-434d-8ab6-0e7ed276197b tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:13.099117 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cfd8e660-6fc5-434d-8ab6-0e7ed276197b tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:13.263681 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-cfd8e660-6fc5-434d-8ab6-0e7ed276197b tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8011ce402b41ca9d3972a7a2a02cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071a4f9e348b484795cea54316963a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:13.279300 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cfd8e660-6fc5-434d-8ab6-0e7ed276197b tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] 10.222.0.13 "GET /compute/v2.1/servers/55ba9ec4-90f4-4ded-b6ad-bc806de38256" status: 200 len: 1265 microversion: 2.1 time: 0.208391 Oct 30 01:23:13.284281 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1228/2420] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:13 2022] GET /compute/v2.1/servers/55ba9ec4-90f4-4ded-b6ad-bc806de38256 => generated 1265 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:13.296807 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-265a44d6-658c-4391-b4ee-f351d9e69ff4 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:13.304365 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-265a44d6-658c-4391-b4ee-f351d9e69ff4 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Request method failure captured: Oct 30 01:23:13.304365 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 30 01:23:13.304365 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:23:13.304365 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:23:13.304365 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:23:13.304365 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:23:13.304365 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:23:13.304365 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:23:13.304365 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:23:13.304365 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:23:13.304365 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdHSJyYe2LQmpJGDpAuH6oijHeoDT5sarvvnYYjVihbFqV_GCaS1tTgRlAOosNzKOnotz-LHdlv0fY7gRz28FWNunXxQpW0q__OQUJm-J87BrpgoPlajglSEBf7KTCwja8RaN0_s8w2XjyG-8Vul-e76vQ6agD8cJtnQMZAlfG8Ap0M Oct 30 01:23:13.304365 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:23:13.304365 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:23:13.304365 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:23:13.304365 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:23:13.304365 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:23:13.304365 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:23:13.304365 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 4cd1868480e44540be85a8c2862cd780 Oct 30 01:23:13.304365 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ListServersNegativeTestJSON-529840825 Oct 30 01:23:13.304365 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:23:13.304365 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:23:13.305591 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4cd1868480e44540be85a8c2862cd780"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4cd1868480e44540be85a8c2862cd780"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4cd1868480e44540be85a8c2862cd780"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4cd1868480e44540be85a8c2862cd780"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:23:13.305591 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ListServersNegativeTestJSON-529840825 Oct 30 01:23:13.305591 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 4cd1868480e44540be85a8c2862cd780 Oct 30 01:23:13.305591 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-529840825 Oct 30 01:23:13.305591 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ListServersNegativeTestJSON-529840825-project Oct 30 01:23:13.305591 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:23:13.305591 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:23:13.305591 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 055b96d1eb20418d96450efde939e020 Oct 30 01:23:13.305591 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ListServersNegativeTestJSON-529840825-project Oct 30 01:23:13.305591 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:23:13.305591 n-d-master-1 devstack@n-api.service[121102]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 30 01:23:13.305591 n-d-master-1 devstack@n-api.service[121102]: action_args: {} Oct 30 01:23:13.306191 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:23:13.306191 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:23:13.306191 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 30 01:23:13.306191 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 30 01:23:13.306191 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 30 01:23:13.306191 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise error Oct 30 01:23:13.306191 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 30 01:23:13.306191 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:23:13.306191 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 30 01:23:13.306191 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 30 01:23:13.306191 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:23:13.306191 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 30 01:23:13.306191 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 30 01:23:13.306191 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:23:13.306191 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:23:13.306191 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:23:13.306191 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:23:13.306191 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:23:13.306191 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:23:13.306191 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:23:13.306191 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:23:13.306191 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:23:13.306191 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:23:13.307969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 30 01:23:13.307969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:23:13.307969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 30 01:23:13.307969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:23:13.307969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 30 01:23:13.307969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:23:13.307969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 30 01:23:13.307969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 30 01:23:13.307969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 30 01:23:13.307969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 30 01:23:13.307969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 30 01:23:13.307969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 30 01:23:13.307969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 30 01:23:13.307969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 30 01:23:13.307969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:23:13.307969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:23:13.307969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:23:13.307969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:23:13.307969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:23:13.307969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:23:13.309096 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 30 01:23:13.309096 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 30 01:23:13.309096 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 30 01:23:13.309096 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:23:13.312032 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-265a44d6-658c-4391-b4ee-f351d9e69ff4 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:23:13.316203 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-265a44d6-658c-4391-b4ee-f351d9e69ff4 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] 10.222.0.13 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.027358 Oct 30 01:23:13.316203 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1229/2421] 10.222.0.13 () {58 vars in 1182 bytes} [Sun Oct 30 01:23:13 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:23:13.324581 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-91a0c948-679c-4a18-8b9f-5e3c81ccf7ba tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-985695647", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "a9c900ce-d402-499d-86ac-78230cfda0bf"}], "security_groups": [{"name": "tempest-securitygroup--252833904"}], "key_name": "tempest-keypair-509941397", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:23:18.614552 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6496acc5-fc6e-4eea-971d-5cf33a47533d tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "POST /compute/v2.1/servers/e3faeee3-0724-417b-8575-ac8e59663103/action" status: 202 len: 0 microversion: 2.1 time: 6.274604 Oct 30 01:23:18.621324 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1193/2422] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:23:12 2022] POST /compute/v2.1/servers/e3faeee3-0724-417b-8575-ac8e59663103/action => generated 0 bytes in 6287 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 30 01:23:18.628884 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e17470e0-f347-4666-ae6e-4351bcdb3216 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:18.643342 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e17470e0-f347-4666-ae6e-4351bcdb3216 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '055b96d1eb20418d96450efde939e020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1868480e44540be85a8c2862cd780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:18.644120 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e17470e0-f347-4666-ae6e-4351bcdb3216 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Searching by: {'deleted': False, 'project_id': '4cd1868480e44540be85a8c2862cd780'} {{(pid=121103) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 30 01:23:18.650446 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e17470e0-f347-4666-ae6e-4351bcdb3216 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:18.650940 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e17470e0-f347-4666-ae6e-4351bcdb3216 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:18.651451 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e17470e0-f347-4666-ae6e-4351bcdb3216 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:18.652187 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e17470e0-f347-4666-ae6e-4351bcdb3216 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:18.652642 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e17470e0-f347-4666-ae6e-4351bcdb3216 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:18.653244 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e17470e0-f347-4666-ae6e-4351bcdb3216 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:18.699584 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:18.704483 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.multi_cell_list [None req-e17470e0-f347-4666-ae6e-4351bcdb3216 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=121103) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 30 01:23:18.738486 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e17470e0-f347-4666-ae6e-4351bcdb3216 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.118863 Oct 30 01:23:18.739736 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1194/2423] 10.222.0.13 () {58 vars in 1125 bytes} [Sun Oct 30 01:23:18 2022] GET /compute/v2.1/servers => generated 683 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:23:18.745371 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b4c174f1-fbc6-40c7-8020-cbb91db7bce0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:18.746373 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b4c174f1-fbc6-40c7-8020-cbb91db7bce0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7f629426-c4e6-4c3f-8e54-efd452d14dd7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:18.753248 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4c174f1-fbc6-40c7-8020-cbb91db7bce0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:18.755556 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4c174f1-fbc6-40c7-8020-cbb91db7bce0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:18.755556 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4c174f1-fbc6-40c7-8020-cbb91db7bce0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:18.755556 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4c174f1-fbc6-40c7-8020-cbb91db7bce0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:18.755556 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4c174f1-fbc6-40c7-8020-cbb91db7bce0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:18.755826 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4c174f1-fbc6-40c7-8020-cbb91db7bce0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:18.799392 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-91a0c948-679c-4a18-8b9f-5e3c81ccf7ba tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] validate_networks() for [('a9c900ce-d402-499d-86ac-78230cfda0bf', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:23:19.007170 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b4c174f1-fbc6-40c7-8020-cbb91db7bce0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:19.017673 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b4c174f1-fbc6-40c7-8020-cbb91db7bce0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7" status: 200 len: 1523 microversion: 2.1 time: 0.276540 Oct 30 01:23:19.018271 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1195/2424] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:18 2022] GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7 => generated 1523 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:19.039950 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0f039023-7cac-4b4a-968c-055e6687b346 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:19.040582 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0f039023-7cac-4b4a-968c-055e6687b346 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] [instance: 55ba9ec4-90f4-4ded-b6ad-bc806de38256] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:19.047560 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0f039023-7cac-4b4a-968c-055e6687b346 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:19.048063 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0f039023-7cac-4b4a-968c-055e6687b346 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:19.048513 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0f039023-7cac-4b4a-968c-055e6687b346 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:19.049226 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0f039023-7cac-4b4a-968c-055e6687b346 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:19.049725 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0f039023-7cac-4b4a-968c-055e6687b346 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:19.050157 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0f039023-7cac-4b4a-968c-055e6687b346 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:19.290998 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0f039023-7cac-4b4a-968c-055e6687b346 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8011ce402b41ca9d3972a7a2a02cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071a4f9e348b484795cea54316963a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:19.305173 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0f039023-7cac-4b4a-968c-055e6687b346 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] 10.222.0.13 "GET /compute/v2.1/servers/55ba9ec4-90f4-4ded-b6ad-bc806de38256" status: 200 len: 1313 microversion: 2.1 time: 0.270531 Oct 30 01:23:19.309061 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1196/2425] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:19 2022] GET /compute/v2.1/servers/55ba9ec4-90f4-4ded-b6ad-bc806de38256 => generated 1313 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:19.316376 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9a362658-9427-4bea-90a8-e8cb1ac70f0d tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:19.318122 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9a362658-9427-4bea-90a8-e8cb1ac70f0d tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] [instance: 0c5133ba-8270-419a-80cb-43feb76f94c1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:19.327460 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9a362658-9427-4bea-90a8-e8cb1ac70f0d tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:19.328178 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9a362658-9427-4bea-90a8-e8cb1ac70f0d tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:19.328762 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9a362658-9427-4bea-90a8-e8cb1ac70f0d tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:19.329966 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9a362658-9427-4bea-90a8-e8cb1ac70f0d tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:19.330568 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9a362658-9427-4bea-90a8-e8cb1ac70f0d tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:19.331137 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9a362658-9427-4bea-90a8-e8cb1ac70f0d tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:19.364651 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9a362658-9427-4bea-90a8-e8cb1ac70f0d tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] [instance: 0c5133ba-8270-419a-80cb-43feb76f94c1] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:23:19.433594 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-91a0c948-679c-4a18-8b9f-5e3c81ccf7ba tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Getting quotas for project 2a5e20978d1a4886b04d37eef4c23d1e. Resources: dict_keys(['metadata_items']) {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:23:19.441583 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-91a0c948-679c-4a18-8b9f-5e3c81ccf7ba tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Getting quotas for user a1e23e3096f740508e6fb6626a29336f and project 2a5e20978d1a4886b04d37eef4c23d1e. Resources: dict_keys(['metadata_items']) {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:23:19.470039 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-91a0c948-679c-4a18-8b9f-5e3c81ccf7ba tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:23:19.470455 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-91a0c948-679c-4a18-8b9f-5e3c81ccf7ba tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:23:19.470911 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-91a0c948-679c-4a18-8b9f-5e3c81ccf7ba tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:23:19.471312 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-91a0c948-679c-4a18-8b9f-5e3c81ccf7ba tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:23:19.471717 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-91a0c948-679c-4a18-8b9f-5e3c81ccf7ba tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:23:19.485658 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:19.487431 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-91a0c948-679c-4a18-8b9f-5e3c81ccf7ba tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:19.488014 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-91a0c948-679c-4a18-8b9f-5e3c81ccf7ba tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:19.488519 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-91a0c948-679c-4a18-8b9f-5e3c81ccf7ba tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:19.489418 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-91a0c948-679c-4a18-8b9f-5e3c81ccf7ba tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:19.490104 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-91a0c948-679c-4a18-8b9f-5e3c81ccf7ba tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:19.490725 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-91a0c948-679c-4a18-8b9f-5e3c81ccf7ba tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:19.515556 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-91a0c948-679c-4a18-8b9f-5e3c81ccf7ba tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Getting quotas for project 2a5e20978d1a4886b04d37eef4c23d1e. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:23:19.523014 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-91a0c948-679c-4a18-8b9f-5e3c81ccf7ba tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Getting quotas for user a1e23e3096f740508e6fb6626a29336f and project 2a5e20978d1a4886b04d37eef4c23d1e. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:23:19.540580 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-91a0c948-679c-4a18-8b9f-5e3c81ccf7ba tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:23:19.544376 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-91a0c948-679c-4a18-8b9f-5e3c81ccf7ba tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] [instance: 3b6bf22e-53a4-481d-8764-d6a4b9c95d3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:23:19.679418 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-91a0c948-679c-4a18-8b9f-5e3c81ccf7ba tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 6.362099 Oct 30 01:23:19.680160 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1230/2426] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:23:13 2022] POST /compute/v2.1/servers => generated 408 bytes in 6364 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:23:19.691929 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9a362658-9427-4bea-90a8-e8cb1ac70f0d tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0c5133ba-8270-419a-80cb-43feb76f94c1" status: 204 len: 0 microversion: 2.1 time: 0.381034 Oct 30 01:23:19.695848 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1197/2427] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:23:19 2022] DELETE /compute/v2.1/servers/0c5133ba-8270-419a-80cb-43feb76f94c1 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:23:19.706467 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-efcc1231-139f-4c17-ba66-bbb75065b36b req-f4422a99-88dc-40a5-aded-9c8f55c5fadd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55ba9ec4-90f4-4ded-b6ad-bc806de38256", "tag": "6a9261d9-b077-4bf1-9f81-8aaa59fd35eb"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:23:19.718152 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-efcc1231-139f-4c17-ba66-bbb75065b36b req-f4422a99-88dc-40a5-aded-9c8f55c5fadd service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:19.719031 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-efcc1231-139f-4c17-ba66-bbb75065b36b req-f4422a99-88dc-40a5-aded-9c8f55c5fadd service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:19.719714 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-efcc1231-139f-4c17-ba66-bbb75065b36b req-f4422a99-88dc-40a5-aded-9c8f55c5fadd service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:19.738196 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-efcc1231-139f-4c17-ba66-bbb75065b36b req-f4422a99-88dc-40a5-aded-9c8f55c5fadd service nova] Creating event network-changed:6a9261d9-b077-4bf1-9f81-8aaa59fd35eb for instance 55ba9ec4-90f4-4ded-b6ad-bc806de38256 on n-h2-master-1 Oct 30 01:23:19.748022 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-efcc1231-139f-4c17-ba66-bbb75065b36b req-f4422a99-88dc-40a5-aded-9c8f55c5fadd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059524 Oct 30 01:23:19.749244 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1231/2428] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:23:20.062107 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b556aa88-187d-4aea-834b-6cb5be4835a7 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Action: 'create', calling method: .version_select at 0x7f44cc6129d0>, body: {"keypair": {"name": "tempest-keypair-1477187144", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUAHNK6E9cFQeC4zv/b7vHgOF9BF2glXJCYM3C8IW+8QZroZJboqmmGsL1J3+pc355Y/h4QKiORXXIpZaCKhU/zvIfRnhjYi1g5EyWQVXts+WRtLepWGsUgXihKWSAUKQ=="}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:23:20.068263 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8caa3644-c575-4061-ba2c-284b59c0c147 tempest-FlavorsV2NegativeTest-683094517 tempest-FlavorsV2NegativeTest-683094517-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:20.091582 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8caa3644-c575-4061-ba2c-284b59c0c147 tempest-FlavorsV2NegativeTest-683094517 tempest-FlavorsV2NegativeTest-683094517-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.332840 Oct 30 01:23:20.098375 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1232/2429] 10.222.0.13 () {58 vars in 1137 bytes} [Sun Oct 30 01:23:19 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:23:20.131255 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4c1f7892-da09-464b-a6b0-68d1224a3e94 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44d02d65e0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:20.152254 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-b556aa88-187d-4aea-834b-6cb5be4835a7 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Getting quotas for project d342baf2538340e292e44dfc622b86fc. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:23:20.183016 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-b556aa88-187d-4aea-834b-6cb5be4835a7 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Getting quotas for user 94448bbc2f4a4efaa86792f1511ff15c and project d342baf2538340e292e44dfc622b86fc. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:23:20.304653 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b556aa88-187d-4aea-834b-6cb5be4835a7 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.607367 Oct 30 01:23:20.306106 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1198/2430] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 30 01:23:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:23:20.313208 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-01bc23fe-296f-4122-9c72-d3d5951536f2 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:20.318331 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-01bc23fe-296f-4122-9c72-d3d5951536f2 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '055b96d1eb20418d96450efde939e020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1868480e44540be85a8c2862cd780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:20.319320 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.compute.servers [None req-01bc23fe-296f-4122-9c72-d3d5951536f2 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Removing options 'limit' from query {{(pid=121103) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 30 01:23:20.320392 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-01bc23fe-296f-4122-9c72-d3d5951536f2 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Searching by: {'deleted': False, 'project_id': '4cd1868480e44540be85a8c2862cd780'} {{(pid=121103) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 30 01:23:20.352934 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-01bc23fe-296f-4122-9c72-d3d5951536f2 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:20.356946 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-01bc23fe-296f-4122-9c72-d3d5951536f2 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:20.358224 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-01bc23fe-296f-4122-9c72-d3d5951536f2 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:20.362337 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-01bc23fe-296f-4122-9c72-d3d5951536f2 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:20.363621 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-01bc23fe-296f-4122-9c72-d3d5951536f2 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:20.368082 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-01bc23fe-296f-4122-9c72-d3d5951536f2 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:20.435589 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.multi_cell_list [None req-01bc23fe-296f-4122-9c72-d3d5951536f2 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=121103) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 30 01:23:20.508742 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-01bc23fe-296f-4122-9c72-d3d5951536f2 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] 10.222.0.13 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.201382 Oct 30 01:23:20.509581 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1199/2431] 10.222.0.13 () {58 vars in 1144 bytes} [Sun Oct 30 01:23:20 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:23:20.527187 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ce6a3595-8f7e-4ba4-9a15-86f9cfabc732 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:20.528211 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ce6a3595-8f7e-4ba4-9a15-86f9cfabc732 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] [instance: 3b6bf22e-53a4-481d-8764-d6a4b9c95d3e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:20.539054 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=5 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:20.645750 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ce6a3595-8f7e-4ba4-9a15-86f9cfabc732 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e23e3096f740508e6fb6626a29336f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5e20978d1a4886b04d37eef4c23d1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:20.653421 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ce6a3595-8f7e-4ba4-9a15-86f9cfabc732 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] 10.222.0.13 "GET /compute/v2.1/servers/3b6bf22e-53a4-481d-8764-d6a4b9c95d3e" status: 200 len: 1276 microversion: 2.1 time: 0.130597 Oct 30 01:23:20.654277 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1200/2432] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:20 2022] GET /compute/v2.1/servers/3b6bf22e-53a4-481d-8764-d6a4b9c95d3e => generated 1276 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:20.659222 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d4c336f6-78fc-413c-a115-f3cf93d5384d tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:20.659832 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d4c336f6-78fc-413c-a115-f3cf93d5384d tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] [instance: 0c5133ba-8270-419a-80cb-43feb76f94c1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:20.673074 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d4c336f6-78fc-413c-a115-f3cf93d5384d tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:20.673074 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d4c336f6-78fc-413c-a115-f3cf93d5384d tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:20.673074 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d4c336f6-78fc-413c-a115-f3cf93d5384d tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:20.673793 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d4c336f6-78fc-413c-a115-f3cf93d5384d tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:20.674338 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d4c336f6-78fc-413c-a115-f3cf93d5384d tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:20.674689 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d4c336f6-78fc-413c-a115-f3cf93d5384d tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:20.922533 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d4c336f6-78fc-413c-a115-f3cf93d5384d tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e0e5acf53b4abe99c3418c82d47ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f383493aa6b46c9884b54cb82063b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:20.922533 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d4c336f6-78fc-413c-a115-f3cf93d5384d tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] 10.222.0.13 "GET /compute/v2.1/servers/0c5133ba-8270-419a-80cb-43feb76f94c1" status: 200 len: 1666 microversion: 2.1 time: 0.194934 Oct 30 01:23:20.922533 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1201/2433] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:20 2022] GET /compute/v2.1/servers/0c5133ba-8270-419a-80cb-43feb76f94c1 => generated 1666 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:20.922533 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4a9b6143-337d-40f6-86a9-53fbc8247d8f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:20.923319 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4a9b6143-337d-40f6-86a9-53fbc8247d8f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7f629426-c4e6-4c3f-8e54-efd452d14dd7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:20.923319 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4a9b6143-337d-40f6-86a9-53fbc8247d8f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:20.923319 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4a9b6143-337d-40f6-86a9-53fbc8247d8f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:20.923319 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4a9b6143-337d-40f6-86a9-53fbc8247d8f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:20.923564 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4a9b6143-337d-40f6-86a9-53fbc8247d8f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:20.923564 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4a9b6143-337d-40f6-86a9-53fbc8247d8f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:20.923564 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4a9b6143-337d-40f6-86a9-53fbc8247d8f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:21.011623 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4a9b6143-337d-40f6-86a9-53fbc8247d8f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:21.019656 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4a9b6143-337d-40f6-86a9-53fbc8247d8f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7" status: 200 len: 1523 microversion: 2.1 time: 0.167748 Oct 30 01:23:21.020237 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1202/2434] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:20 2022] GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:21.025759 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e481fbb1-fd38-49c6-b132-6f04b89033df tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:21.027226 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e481fbb1-fd38-49c6-b132-6f04b89033df tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] [instance: 55ba9ec4-90f4-4ded-b6ad-bc806de38256] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:21.035065 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e481fbb1-fd38-49c6-b132-6f04b89033df tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:21.035556 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e481fbb1-fd38-49c6-b132-6f04b89033df tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:21.046614 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e481fbb1-fd38-49c6-b132-6f04b89033df tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:21.046614 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e481fbb1-fd38-49c6-b132-6f04b89033df tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:21.046614 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e481fbb1-fd38-49c6-b132-6f04b89033df tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:21.046614 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e481fbb1-fd38-49c6-b132-6f04b89033df tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:21.207329 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e481fbb1-fd38-49c6-b132-6f04b89033df tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8011ce402b41ca9d3972a7a2a02cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071a4f9e348b484795cea54316963a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:21.225214 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e481fbb1-fd38-49c6-b132-6f04b89033df tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] 10.222.0.13 "GET /compute/v2.1/servers/55ba9ec4-90f4-4ded-b6ad-bc806de38256" status: 200 len: 1313 microversion: 2.1 time: 0.202836 Oct 30 01:23:21.237369 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1203/2435] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:21 2022] GET /compute/v2.1/servers/55ba9ec4-90f4-4ded-b6ad-bc806de38256 => generated 1313 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:21.237369 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-75dccc1a-9180-40f3-9a2e-14279fe74e58 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:21.250864 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-75dccc1a-9180-40f3-9a2e-14279fe74e58 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Request method failure captured: Oct 30 01:23:21.250864 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 30 01:23:21.250864 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:23:21.250864 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:23:21.250864 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:23:21.250864 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:23:21.250864 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:23:21.250864 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:23:21.250864 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:23:21.250864 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:23:21.250864 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdHSJyYe2LQmpJGDpAuH6oijHeoDT5sarvvnYYjVihbFqV_GCaS1tTgRlAOosNzKOnotz-LHdlv0fY7gRz28FWNunXxQpW0q__OQUJm-J87BrpgoPlajglSEBf7KTCwja8RaN0_s8w2XjyG-8Vul-e76vQ6agD8cJtnQMZAlfG8Ap0M Oct 30 01:23:21.250864 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:23:21.250864 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:23:21.250864 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:23:21.250864 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:23:21.250864 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:23:21.250864 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:23:21.250864 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 4cd1868480e44540be85a8c2862cd780 Oct 30 01:23:21.250864 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ListServersNegativeTestJSON-529840825 Oct 30 01:23:21.250864 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:23:21.250864 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:23:21.252331 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4cd1868480e44540be85a8c2862cd780"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4cd1868480e44540be85a8c2862cd780"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4cd1868480e44540be85a8c2862cd780"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4cd1868480e44540be85a8c2862cd780"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:23:21.252331 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ListServersNegativeTestJSON-529840825 Oct 30 01:23:21.252331 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 4cd1868480e44540be85a8c2862cd780 Oct 30 01:23:21.252331 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-529840825 Oct 30 01:23:21.252331 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ListServersNegativeTestJSON-529840825-project Oct 30 01:23:21.252331 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:23:21.252331 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:23:21.252331 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 055b96d1eb20418d96450efde939e020 Oct 30 01:23:21.252331 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ListServersNegativeTestJSON-529840825-project Oct 30 01:23:21.252331 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:23:21.252331 n-d-master-1 devstack@n-api.service[121103]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 30 01:23:21.252331 n-d-master-1 devstack@n-api.service[121103]: action_args: {} Oct 30 01:23:21.253002 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:23:21.253002 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:23:21.253002 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 30 01:23:21.253002 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 30 01:23:21.253002 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 30 01:23:21.253002 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise error Oct 30 01:23:21.253002 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 30 01:23:21.253002 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:23:21.253002 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 30 01:23:21.253002 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 30 01:23:21.253002 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 30 01:23:21.253002 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 30 01:23:21.253002 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 30 01:23:21.253002 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:23:21.253002 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 30 01:23:21.253002 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi '-1' Oct 30 01:23:21.253002 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:23:21.253002 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:23:21.253002 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:23:21.253002 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:23:21.253002 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:23:21.253002 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:23:21.253002 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:23:21.253002 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:23:21.259749 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:23:21.259749 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:23:21.259749 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 30 01:23:21.259749 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:23:21.259749 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 30 01:23:21.259749 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:23:21.259749 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 30 01:23:21.259749 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:23:21.259749 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 30 01:23:21.259749 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 30 01:23:21.259749 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 30 01:23:21.259749 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 30 01:23:21.259749 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 30 01:23:21.259749 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 30 01:23:21.259749 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 30 01:23:21.259749 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 30 01:23:21.259749 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:23:21.259749 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:23:21.259749 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:23:21.259749 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:23:21.261374 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:23:21.261374 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:23:21.261374 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 30 01:23:21.261374 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 30 01:23:21.261374 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 30 01:23:21.261374 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:23:21.261374 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-75dccc1a-9180-40f3-9a2e-14279fe74e58 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:23:21.261374 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-75dccc1a-9180-40f3-9a2e-14279fe74e58 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] 10.222.0.13 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.028233 Oct 30 01:23:21.266824 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1204/2436] 10.222.0.13 () {58 vars in 1142 bytes} [Sun Oct 30 01:23:21 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:23:21.278306 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ad70e1b1-1d48-4ef4-8f5d-4a2c833d21ba tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:21.293261 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ad70e1b1-1d48-4ef4-8f5d-4a2c833d21ba tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Request method failure captured: Oct 30 01:23:21.293261 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 30 01:23:21.293261 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:23:21.293261 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:23:21.293261 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:23:21.293261 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:23:21.293261 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:23:21.293261 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:23:21.293261 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:23:21.293261 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:23:21.293261 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdHSJyYe2LQmpJGDpAuH6oijHeoDT5sarvvnYYjVihbFqV_GCaS1tTgRlAOosNzKOnotz-LHdlv0fY7gRz28FWNunXxQpW0q__OQUJm-J87BrpgoPlajglSEBf7KTCwja8RaN0_s8w2XjyG-8Vul-e76vQ6agD8cJtnQMZAlfG8Ap0M Oct 30 01:23:21.293261 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:23:21.293261 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:23:21.293261 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:23:21.293261 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:23:21.293261 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:23:21.293261 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:23:21.293261 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 4cd1868480e44540be85a8c2862cd780 Oct 30 01:23:21.293261 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ListServersNegativeTestJSON-529840825 Oct 30 01:23:21.293261 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:23:21.293261 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:23:21.299646 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4cd1868480e44540be85a8c2862cd780"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4cd1868480e44540be85a8c2862cd780"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4cd1868480e44540be85a8c2862cd780"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4cd1868480e44540be85a8c2862cd780"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:23:21.299646 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ListServersNegativeTestJSON-529840825 Oct 30 01:23:21.299646 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 4cd1868480e44540be85a8c2862cd780 Oct 30 01:23:21.299646 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-529840825 Oct 30 01:23:21.299646 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ListServersNegativeTestJSON-529840825-project Oct 30 01:23:21.299646 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:23:21.299646 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:23:21.299646 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 055b96d1eb20418d96450efde939e020 Oct 30 01:23:21.299646 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ListServersNegativeTestJSON-529840825-project Oct 30 01:23:21.299646 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:23:21.299646 n-d-master-1 devstack@n-api.service[121103]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 30 01:23:21.299646 n-d-master-1 devstack@n-api.service[121103]: action_args: {} Oct 30 01:23:21.300272 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:23:21.300272 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:23:21.300272 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 30 01:23:21.300272 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 30 01:23:21.300272 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 30 01:23:21.300272 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise error Oct 30 01:23:21.300272 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 30 01:23:21.300272 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:23:21.300272 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 30 01:23:21.300272 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 30 01:23:21.300272 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 30 01:23:21.300272 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 30 01:23:21.300272 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 30 01:23:21.300272 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:23:21.300272 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 30 01:23:21.300272 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi 'testing' Oct 30 01:23:21.300272 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:23:21.300272 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:23:21.300272 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:23:21.300272 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:23:21.300272 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:23:21.300272 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:23:21.300272 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:23:21.300272 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:23:21.303100 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:23:21.303100 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:23:21.303100 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 30 01:23:21.303100 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:23:21.303100 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 30 01:23:21.303100 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:23:21.303100 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 30 01:23:21.303100 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:23:21.303100 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 30 01:23:21.303100 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 30 01:23:21.303100 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 30 01:23:21.303100 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 30 01:23:21.303100 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 30 01:23:21.303100 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 30 01:23:21.303100 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 30 01:23:21.303100 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 30 01:23:21.303100 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:23:21.303100 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:23:21.303100 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:23:21.303100 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:23:21.305862 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:23:21.305862 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:23:21.305862 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 30 01:23:21.305862 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 30 01:23:21.305862 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 30 01:23:21.305862 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:23:21.305862 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ad70e1b1-1d48-4ef4-8f5d-4a2c833d21ba tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:23:21.308145 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ad70e1b1-1d48-4ef4-8f5d-4a2c833d21ba tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] 10.222.0.13 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.040039 Oct 30 01:23:21.311717 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1205/2437] 10.222.0.13 () {58 vars in 1152 bytes} [Sun Oct 30 01:23:21 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:23:21.330028 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ec03326e-7117-47f8-b578-254669411d89 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:21.336325 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ec03326e-7117-47f8-b578-254669411d89 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '055b96d1eb20418d96450efde939e020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1868480e44540be85a8c2862cd780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:21.337613 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ec03326e-7117-47f8-b578-254669411d89 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '4cd1868480e44540be85a8c2862cd780'} {{(pid=121103) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 30 01:23:21.345974 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.compute.servers [None req-ec03326e-7117-47f8-b578-254669411d89 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Flavor 'non_existing_flavor' could not be found {{(pid=121103) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 30 01:23:21.347399 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ec03326e-7117-47f8-b578-254669411d89 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] 10.222.0.13 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.030602 Oct 30 01:23:21.349126 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1206/2438] 10.222.0.13 () {58 vars in 1178 bytes} [Sun Oct 30 01:23:21 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:23:21.367196 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f4c05e57-2301-47d8-bd0d-ab1551785b76 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:21.384747 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f4c05e57-2301-47d8-bd0d-ab1551785b76 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '055b96d1eb20418d96450efde939e020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1868480e44540be85a8c2862cd780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:21.386239 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f4c05e57-2301-47d8-bd0d-ab1551785b76 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '4cd1868480e44540be85a8c2862cd780'} {{(pid=121103) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 30 01:23:21.403156 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f4c05e57-2301-47d8-bd0d-ab1551785b76 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:21.405581 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f4c05e57-2301-47d8-bd0d-ab1551785b76 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:21.406077 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f4c05e57-2301-47d8-bd0d-ab1551785b76 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:21.409190 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f4c05e57-2301-47d8-bd0d-ab1551785b76 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:21.437290 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f4c05e57-2301-47d8-bd0d-ab1551785b76 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:21.440267 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f4c05e57-2301-47d8-bd0d-ab1551785b76 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:21.492508 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4c1f7892-da09-464b-a6b0-68d1224a3e94 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/82fe897f-65b0-4444-8047-364cc9b70689" status: 200 len: 1412 microversion: 2.1 time: 1.391302 Oct 30 01:23:21.494925 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1233/2439] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:23:20 2022] GET /compute/v2.1/images/82fe897f-65b0-4444-8047-364cc9b70689 => generated 1412 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:21.560462 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-59c727a0-c493-4c98-b485-2262b8c179f1 tempest-FlavorsV2NegativeTest-683094517 tempest-FlavorsV2NegativeTest-683094517-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-505681503", "imageRef": "c0c09eb8-5daf-4d77-ad43-0036c7038761", "flavorRef": "452"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:23:21.650936 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-59c727a0-c493-4c98-b485-2262b8c179f1 tempest-FlavorsV2NegativeTest-683094517 tempest-FlavorsV2NegativeTest-683094517-project] validate_networks() for None {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:23:21.673395 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f4c05e57-2301-47d8-bd0d-ab1551785b76 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] 10.222.0.13 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.314990 Oct 30 01:23:21.685184 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1207/2440] 10.222.0.13 () {58 vars in 1174 bytes} [Sun Oct 30 01:23:21 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:23:21.685184 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f25bfc30-42fb-416c-a099-5679cad87e98 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:21.685184 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f25bfc30-42fb-416c-a099-5679cad87e98 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] [instance: 3b6bf22e-53a4-481d-8764-d6a4b9c95d3e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:21.813153 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f25bfc30-42fb-416c-a099-5679cad87e98 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e23e3096f740508e6fb6626a29336f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5e20978d1a4886b04d37eef4c23d1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:21.826890 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f25bfc30-42fb-416c-a099-5679cad87e98 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] 10.222.0.13 "GET /compute/v2.1/servers/3b6bf22e-53a4-481d-8764-d6a4b9c95d3e" status: 200 len: 1276 microversion: 2.1 time: 0.149244 Oct 30 01:23:21.848761 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1208/2441] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:21 2022] GET /compute/v2.1/servers/3b6bf22e-53a4-481d-8764-d6a4b9c95d3e => generated 1276 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:21.853889 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2d1df2ed-3a12-46b1-82dd-e8f4884330dd tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:21.860312 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2d1df2ed-3a12-46b1-82dd-e8f4884330dd tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '055b96d1eb20418d96450efde939e020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1868480e44540be85a8c2862cd780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:21.861256 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2d1df2ed-3a12-46b1-82dd-e8f4884330dd tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '4cd1868480e44540be85a8c2862cd780'} {{(pid=121103) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 30 01:23:21.871930 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2d1df2ed-3a12-46b1-82dd-e8f4884330dd tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:21.872750 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2d1df2ed-3a12-46b1-82dd-e8f4884330dd tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:21.873499 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2d1df2ed-3a12-46b1-82dd-e8f4884330dd tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:21.874474 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2d1df2ed-3a12-46b1-82dd-e8f4884330dd tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:21.875160 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2d1df2ed-3a12-46b1-82dd-e8f4884330dd tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:21.881924 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2d1df2ed-3a12-46b1-82dd-e8f4884330dd tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:21.995932 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2d1df2ed-3a12-46b1-82dd-e8f4884330dd tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] 10.222.0.13 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.145401 Oct 30 01:23:22.005322 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1209/2442] 10.222.0.13 () {58 vars in 1184 bytes} [Sun Oct 30 01:23:21 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:23:22.010787 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7db0a7b5-aae6-4862-abd2-7285d662f9a6 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:22.011716 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7db0a7b5-aae6-4862-abd2-7285d662f9a6 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] [instance: 0c5133ba-8270-419a-80cb-43feb76f94c1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:22.019003 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7db0a7b5-aae6-4862-abd2-7285d662f9a6 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:22.019935 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7db0a7b5-aae6-4862-abd2-7285d662f9a6 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:22.020591 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7db0a7b5-aae6-4862-abd2-7285d662f9a6 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:22.021571 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7db0a7b5-aae6-4862-abd2-7285d662f9a6 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:22.022246 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7db0a7b5-aae6-4862-abd2-7285d662f9a6 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:22.022945 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7db0a7b5-aae6-4862-abd2-7285d662f9a6 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:22.258958 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-59c727a0-c493-4c98-b485-2262b8c179f1 tempest-FlavorsV2NegativeTest-683094517 tempest-FlavorsV2NegativeTest-683094517-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 30 01:23:22.261297 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-59c727a0-c493-4c98-b485-2262b8c179f1 tempest-FlavorsV2NegativeTest-683094517 tempest-FlavorsV2NegativeTest-683094517-project] Request method failure captured: Oct 30 01:23:22.261297 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 30 01:23:22.261297 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:23:22.261297 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:23:22.261297 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:23:22.261297 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 142 Oct 30 01:23:22.261297 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:23:22.261297 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:23:22.261297 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:23:22.261297 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:23:22.261297 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdIGR7r34xkliVEU7n4IrWPAI7qkNLBtxmOM-QMcElaHY8JSVXXw_fwMowC5FU7c7Q5Tym0DaAD9QyBM0dBBCoExyo5Lmbei-ujC6i4jd4ladkMuSGX8A-B5N1y9EPRdzC5eF-tOpco49WgXTzy8mTESem4Wk94pKf-4RmX_3qTo1Us Oct 30 01:23:22.261297 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:23:22.261297 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:23:22.261297 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:23:22.261297 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:23:22.261297 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:23:22.261297 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:23:22.261297 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 7f1b778d34e541fa87ff945108b8f5bd Oct 30 01:23:22.261297 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-FlavorsV2NegativeTest-683094517 Oct 30 01:23:22.261297 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:23:22.261297 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:23:22.262532 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7f1b778d34e541fa87ff945108b8f5bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7f1b778d34e541fa87ff945108b8f5bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7f1b778d34e541fa87ff945108b8f5bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7f1b778d34e541fa87ff945108b8f5bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:23:22.262532 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-FlavorsV2NegativeTest-683094517 Oct 30 01:23:22.262532 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 7f1b778d34e541fa87ff945108b8f5bd Oct 30 01:23:22.262532 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-683094517 Oct 30 01:23:22.262532 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-FlavorsV2NegativeTest-683094517-project Oct 30 01:23:22.262532 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:23:22.262532 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:23:22.262532 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: ace6fd59303f4846b6befb50dbf6d3e0 Oct 30 01:23:22.262532 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-FlavorsV2NegativeTest-683094517-project Oct 30 01:23:22.262532 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:23:22.262532 n-d-master-1 devstack@n-api.service[121102]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-505681503", "imageRef": "c0c09eb8-5daf-4d77-ad43-0036c7038761", "flavorRef": "452"}} Oct 30 01:23:22.262532 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:23:22.263288 n-d-master-1 devstack@n-api.service[121102]: exception: Flavor's memory is too small for requested image. Oct 30 01:23:22.263288 n-d-master-1 devstack@n-api.service[121102]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-505681503', 'imageRef': 'c0c09eb8-5daf-4d77-ad43-0036c7038761', 'flavorRef': '452'}}} Oct 30 01:23:22.263288 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:23:22.263288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:23:22.263288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 30 01:23:22.263288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 30 01:23:22.263288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 30 01:23:22.263288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 30 01:23:22.263288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 30 01:23:22.263288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 30 01:23:22.263288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 30 01:23:22.263288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 30 01:23:22.263288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 30 01:23:22.263288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 30 01:23:22.263288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 30 01:23:22.263288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 30 01:23:22.263288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 30 01:23:22.263288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:23:22.263288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:23:22.263288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:23:22.264423 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:23:22.264423 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:23:22.264423 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:23:22.264423 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:23:22.264423 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:23:22.264423 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:23:22.264423 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:23:22.264423 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:23:22.264423 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:23:22.264423 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:23:22.264423 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:23:22.264423 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:23:22.264423 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:23:22.264423 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 30 01:23:22.264423 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 30 01:23:22.264423 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 30 01:23:22.264423 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 30 01:23:22.264423 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:23:22.264423 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:23:22.264423 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:23:22.264423 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:23:22.265555 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:23:22.265555 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:23:22.265555 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:23:22.265555 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:23:22.265555 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 30 01:23:22.265555 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:23:22.265555 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-59c727a0-c493-4c98-b485-2262b8c179f1 tempest-FlavorsV2NegativeTest-683094517 tempest-FlavorsV2NegativeTest-683094517-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:23:22.265555 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-59c727a0-c493-4c98-b485-2262b8c179f1 tempest-FlavorsV2NegativeTest-683094517 tempest-FlavorsV2NegativeTest-683094517-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.710974 Oct 30 01:23:22.266977 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1234/2443] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:23:21 2022] POST /compute/v2.1/servers => generated 93 bytes in 715 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 30 01:23:22.271745 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-15a5bfb4-29c6-44ff-a94c-dda740663284 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:22.298228 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-15a5bfb4-29c6-44ff-a94c-dda740663284 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '055b96d1eb20418d96450efde939e020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1868480e44540be85a8c2862cd780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:22.299124 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-15a5bfb4-29c6-44ff-a94c-dda740663284 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Searching by: {'deleted': False, 'project_id': '4cd1868480e44540be85a8c2862cd780'} {{(pid=121102) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 30 01:23:22.305024 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-15a5bfb4-29c6-44ff-a94c-dda740663284 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:22.305532 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-15a5bfb4-29c6-44ff-a94c-dda740663284 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:22.305972 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-15a5bfb4-29c6-44ff-a94c-dda740663284 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:22.306683 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-15a5bfb4-29c6-44ff-a94c-dda740663284 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:22.307124 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-15a5bfb4-29c6-44ff-a94c-dda740663284 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:22.308103 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-15a5bfb4-29c6-44ff-a94c-dda740663284 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:22.373892 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.multi_cell_list [None req-15a5bfb4-29c6-44ff-a94c-dda740663284 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=121102) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 30 01:23:22.424948 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-15a5bfb4-29c6-44ff-a94c-dda740663284 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055b96d1eb20418d96450efde939e020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1868480e44540be85a8c2862cd780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:22.429204 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=14,nova_api:INSERT=16 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:22.430367 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7db0a7b5-aae6-4862-abd2-7285d662f9a6 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e0e5acf53b4abe99c3418c82d47ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f383493aa6b46c9884b54cb82063b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:22.435277 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-15a5bfb4-29c6-44ff-a94c-dda740663284 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:22.436184 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-15a5bfb4-29c6-44ff-a94c-dda740663284 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:22.436773 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-15a5bfb4-29c6-44ff-a94c-dda740663284 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:22.440139 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7db0a7b5-aae6-4862-abd2-7285d662f9a6 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] 10.222.0.13 "GET /compute/v2.1/servers/0c5133ba-8270-419a-80cb-43feb76f94c1" status: 200 len: 1666 microversion: 2.1 time: 0.433352 Oct 30 01:23:22.444460 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1210/2444] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:22 2022] GET /compute/v2.1/servers/0c5133ba-8270-419a-80cb-43feb76f94c1 => generated 1666 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:22.455491 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b20ede1e-2667-41a2-a574-7df37a9c898a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:22.456170 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b20ede1e-2667-41a2-a574-7df37a9c898a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7f629426-c4e6-4c3f-8e54-efd452d14dd7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:22.474433 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b20ede1e-2667-41a2-a574-7df37a9c898a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:22.474934 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b20ede1e-2667-41a2-a574-7df37a9c898a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:22.475365 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b20ede1e-2667-41a2-a574-7df37a9c898a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:22.476246 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b20ede1e-2667-41a2-a574-7df37a9c898a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:22.476849 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b20ede1e-2667-41a2-a574-7df37a9c898a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:22.477514 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b20ede1e-2667-41a2-a574-7df37a9c898a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:22.748569 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-15a5bfb4-29c6-44ff-a94c-dda740663284 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] 10.222.0.13 "GET /compute/v2.1/servers/detail" status: 200 len: 3025 microversion: 2.1 time: 0.480400 Oct 30 01:23:22.775932 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1235/2445] 10.222.0.13 () {58 vars in 1146 bytes} [Sun Oct 30 01:23:22 2022] GET /compute/v2.1/servers/detail => generated 3025 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:22.784062 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4a1cd5de-549b-4760-bc27-f881ebf3e53e tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:22.785095 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4a1cd5de-549b-4760-bc27-f881ebf3e53e tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] [instance: 55ba9ec4-90f4-4ded-b6ad-bc806de38256] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:22.793259 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a1cd5de-549b-4760-bc27-f881ebf3e53e tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:22.793993 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a1cd5de-549b-4760-bc27-f881ebf3e53e tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:22.794575 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a1cd5de-549b-4760-bc27-f881ebf3e53e tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:22.795432 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a1cd5de-549b-4760-bc27-f881ebf3e53e tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:22.796028 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a1cd5de-549b-4760-bc27-f881ebf3e53e tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:22.797374 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a1cd5de-549b-4760-bc27-f881ebf3e53e tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:22.826612 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b20ede1e-2667-41a2-a574-7df37a9c898a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:22.835726 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b20ede1e-2667-41a2-a574-7df37a9c898a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7" status: 200 len: 1523 microversion: 2.1 time: 0.390114 Oct 30 01:23:22.855650 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1211/2446] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:22 2022] GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7 => generated 1523 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:22.865674 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-07720374-5fa5-4f97-aa0e-c07b2fbcf72e tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44cc2fdaf0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:23.091044 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-07720374-5fa5-4f97-aa0e-c07b2fbcf72e tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/82fe897f-65b0-4444-8047-364cc9b70689" status: 200 len: 1412 microversion: 2.1 time: 0.233807 Oct 30 01:23:23.091691 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1212/2447] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:23:22 2022] GET /compute/v2.1/images/82fe897f-65b0-4444-8047-364cc9b70689 => generated 1412 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:23.095705 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4a1cd5de-549b-4760-bc27-f881ebf3e53e tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8011ce402b41ca9d3972a7a2a02cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071a4f9e348b484795cea54316963a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:23.106574 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4a1cd5de-549b-4760-bc27-f881ebf3e53e tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] 10.222.0.13 "GET /compute/v2.1/servers/55ba9ec4-90f4-4ded-b6ad-bc806de38256" status: 200 len: 1313 microversion: 2.1 time: 0.338241 Oct 30 01:23:23.108120 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ebefb5f4-9eac-40c8-ae05-03965c5bd7b8 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:23.109665 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1236/2448] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:22 2022] GET /compute/v2.1/servers/55ba9ec4-90f4-4ded-b6ad-bc806de38256 => generated 1313 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:23.137148 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ebefb5f4-9eac-40c8-ae05-03965c5bd7b8 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '055b96d1eb20418d96450efde939e020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1868480e44540be85a8c2862cd780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:23.138326 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ebefb5f4-9eac-40c8-ae05-03965c5bd7b8 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] 10.222.0.13 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.045717 Oct 30 01:23:23.139752 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1213/2449] 10.222.0.13 () {58 vars in 1178 bytes} [Sun Oct 30 01:23:23 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:23:23.146150 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6559277f-f9b4-44af-81ae-dd78ad4e4713 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:23.147701 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6559277f-f9b4-44af-81ae-dd78ad4e4713 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] [instance: 3b6bf22e-53a4-481d-8764-d6a4b9c95d3e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:23.160302 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6559277f-f9b4-44af-81ae-dd78ad4e4713 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:23.163161 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6559277f-f9b4-44af-81ae-dd78ad4e4713 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:23.163759 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6559277f-f9b4-44af-81ae-dd78ad4e4713 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:23.165270 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-09cfbc0a-c472-446e-b452-9bb14d29dc32 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:23.170807 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-09cfbc0a-c472-446e-b452-9bb14d29dc32 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '055b96d1eb20418d96450efde939e020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1868480e44540be85a8c2862cd780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:23.171375 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6559277f-f9b4-44af-81ae-dd78ad4e4713 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:23.172133 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6559277f-f9b4-44af-81ae-dd78ad4e4713 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:23.172788 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6559277f-f9b4-44af-81ae-dd78ad4e4713 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:23.182052 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-09cfbc0a-c472-446e-b452-9bb14d29dc32 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Searching by: {'deleted': False, 'project_id': '4cd1868480e44540be85a8c2862cd780'} {{(pid=121103) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 30 01:23:23.194873 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-09cfbc0a-c472-446e-b452-9bb14d29dc32 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:23.195082 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-09cfbc0a-c472-446e-b452-9bb14d29dc32 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:23.195441 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-09cfbc0a-c472-446e-b452-9bb14d29dc32 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:23.196176 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-09cfbc0a-c472-446e-b452-9bb14d29dc32 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:23.196649 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-09cfbc0a-c472-446e-b452-9bb14d29dc32 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:23.197053 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-09cfbc0a-c472-446e-b452-9bb14d29dc32 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:23.225691 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=17 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:23.266212 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.multi_cell_list [None req-09cfbc0a-c472-446e-b452-9bb14d29dc32 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=121103) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 30 01:23:23.321299 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-09cfbc0a-c472-446e-b452-9bb14d29dc32 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.173716 Oct 30 01:23:23.332433 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1214/2450] 10.222.0.13 () {58 vars in 1125 bytes} [Sun Oct 30 01:23:23 2022] GET /compute/v2.1/servers => generated 683 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:23:23.345363 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-845e4449-af4f-4287-885a-fd47700f30f9 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:23.345363 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-845e4449-af4f-4287-885a-fd47700f30f9 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] [instance: 33403d18-1832-4c1f-a824-150b5fbfd22f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:23.363674 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-845e4449-af4f-4287-885a-fd47700f30f9 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:23.365642 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-845e4449-af4f-4287-885a-fd47700f30f9 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:23.366407 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-845e4449-af4f-4287-885a-fd47700f30f9 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:23.369269 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-845e4449-af4f-4287-885a-fd47700f30f9 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:23.370258 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-845e4449-af4f-4287-885a-fd47700f30f9 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:23.371452 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-845e4449-af4f-4287-885a-fd47700f30f9 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:23.391837 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6559277f-f9b4-44af-81ae-dd78ad4e4713 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e23e3096f740508e6fb6626a29336f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5e20978d1a4886b04d37eef4c23d1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:23.402357 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6559277f-f9b4-44af-81ae-dd78ad4e4713 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] 10.222.0.13 "GET /compute/v2.1/servers/3b6bf22e-53a4-481d-8764-d6a4b9c95d3e" status: 200 len: 1328 microversion: 2.1 time: 0.290498 Oct 30 01:23:23.404364 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1237/2451] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:23 2022] GET /compute/v2.1/servers/3b6bf22e-53a4-481d-8764-d6a4b9c95d3e => generated 1328 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:23.436028 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-845e4449-af4f-4287-885a-fd47700f30f9 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] HTTP exception thrown: Instance 33403d18-1832-4c1f-a824-150b5fbfd22f could not be found. Oct 30 01:23:23.466488 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-845e4449-af4f-4287-885a-fd47700f30f9 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Request method failure captured: Oct 30 01:23:23.466488 n-d-master-1 devstack@n-api.service[121103]: request: DELETE /compute/v2.1/servers/33403d18-1832-4c1f-a824-150b5fbfd22f HTTP/1.1 Oct 30 01:23:23.466488 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:23:23.466488 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:23:23.466488 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:23:23.466488 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:23:23.466488 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:23:23.466488 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:23:23.466488 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:23:23.466488 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:23:23.466488 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdHSJyYe2LQmpJGDpAuH6oijHeoDT5sarvvnYYjVihbFqV_GCaS1tTgRlAOosNzKOnotz-LHdlv0fY7gRz28FWNunXxQpW0q__OQUJm-J87BrpgoPlajglSEBf7KTCwja8RaN0_s8w2XjyG-8Vul-e76vQ6agD8cJtnQMZAlfG8Ap0M Oct 30 01:23:23.466488 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:23:23.466488 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:23:23.466488 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:23:23.466488 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:23:23.466488 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:23:23.466488 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:23:23.466488 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 4cd1868480e44540be85a8c2862cd780 Oct 30 01:23:23.466488 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ListServersNegativeTestJSON-529840825 Oct 30 01:23:23.466488 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:23:23.466488 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:23:23.469005 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4cd1868480e44540be85a8c2862cd780"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4cd1868480e44540be85a8c2862cd780"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4cd1868480e44540be85a8c2862cd780"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4cd1868480e44540be85a8c2862cd780"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:23:23.469005 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ListServersNegativeTestJSON-529840825 Oct 30 01:23:23.469005 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 4cd1868480e44540be85a8c2862cd780 Oct 30 01:23:23.469005 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-529840825 Oct 30 01:23:23.469005 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ListServersNegativeTestJSON-529840825-project Oct 30 01:23:23.469005 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:23:23.469005 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:23:23.469005 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 055b96d1eb20418d96450efde939e020 Oct 30 01:23:23.469005 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ListServersNegativeTestJSON-529840825-project Oct 30 01:23:23.469005 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:23:23.469005 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 33403d18-1832-4c1f-a824-150b5fbfd22f could not be found. Oct 30 01:23:23.469005 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '33403d18-1832-4c1f-a824-150b5fbfd22f'} Oct 30 01:23:23.469872 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:23:23.469872 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:23:23.469872 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:23:23.469872 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:23:23.469872 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:23:23.469872 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:23:23.469872 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:23:23.469872 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:23:23.469872 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:23:23.469872 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:23:23.469872 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33403d18-1832-4c1f-a824-150b5fbfd22f could not be found. Oct 30 01:23:23.469872 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:23:23.469872 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:23:23.469872 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:23:23.469872 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:23:23.469872 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:23:23.469872 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:23:23.469872 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:23:23.469872 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:23:23.469872 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:23:23.471160 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:23:23.471160 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:23:23.471160 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:23:23.471160 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:23:23.471160 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:23:23.471160 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:23:23.471160 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:23:23.471160 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:23:23.471160 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:23:23.471160 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33403d18-1832-4c1f-a824-150b5fbfd22f could not be found. Oct 30 01:23:23.471160 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:23:23.471160 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:23:23.471160 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:23:23.471160 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:23:23.471160 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:23:23.471160 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:23:23.471160 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:23:23.471160 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:23:23.471160 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33403d18-1832-4c1f-a824-150b5fbfd22f could not be found. Oct 30 01:23:23.471160 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:23:23.472593 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2ccea10a-62ac-41b3-89d0-abd9813d84b1 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:23.472593 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2ccea10a-62ac-41b3-89d0-abd9813d84b1 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] [instance: 0c5133ba-8270-419a-80cb-43feb76f94c1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:23.480457 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-845e4449-af4f-4287-885a-fd47700f30f9 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Returning 404 to user: Instance 33403d18-1832-4c1f-a824-150b5fbfd22f could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:23:23.481552 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ccea10a-62ac-41b3-89d0-abd9813d84b1 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:23.482000 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-845e4449-af4f-4287-885a-fd47700f30f9 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] 10.222.0.13 "DELETE /compute/v2.1/servers/33403d18-1832-4c1f-a824-150b5fbfd22f" status: 404 len: 111 microversion: 2.1 time: 0.149751 Oct 30 01:23:23.482116 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ccea10a-62ac-41b3-89d0-abd9813d84b1 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:23.484172 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ccea10a-62ac-41b3-89d0-abd9813d84b1 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:23.485227 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ccea10a-62ac-41b3-89d0-abd9813d84b1 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:23.486986 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ccea10a-62ac-41b3-89d0-abd9813d84b1 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:23.487129 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1215/2452] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:23:23 2022] DELETE /compute/v2.1/servers/33403d18-1832-4c1f-a824-150b5fbfd22f => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 01:23:23.489920 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ccea10a-62ac-41b3-89d0-abd9813d84b1 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:23.500957 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-92a2a0df-1694-4697-8d19-926c1e6db41f tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:23.502709 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-92a2a0df-1694-4697-8d19-926c1e6db41f tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] [instance: 23cbc0a6-6137-4e64-b264-c67fceba507f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:23.514952 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-92a2a0df-1694-4697-8d19-926c1e6db41f tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:23.516378 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-92a2a0df-1694-4697-8d19-926c1e6db41f tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:23.517874 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-92a2a0df-1694-4697-8d19-926c1e6db41f tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:23.518807 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-92a2a0df-1694-4697-8d19-926c1e6db41f tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:23.520079 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-92a2a0df-1694-4697-8d19-926c1e6db41f tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:23.520665 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-92a2a0df-1694-4697-8d19-926c1e6db41f tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:23.564962 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-92a2a0df-1694-4697-8d19-926c1e6db41f tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] [instance: 23cbc0a6-6137-4e64-b264-c67fceba507f] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:23:23.734221 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2ccea10a-62ac-41b3-89d0-abd9813d84b1 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e0e5acf53b4abe99c3418c82d47ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f383493aa6b46c9884b54cb82063b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:23.745970 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2ccea10a-62ac-41b3-89d0-abd9813d84b1 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] 10.222.0.13 "GET /compute/v2.1/servers/0c5133ba-8270-419a-80cb-43feb76f94c1" status: 200 len: 1598 microversion: 2.1 time: 0.283147 Oct 30 01:23:23.746562 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1238/2453] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:23 2022] GET /compute/v2.1/servers/0c5133ba-8270-419a-80cb-43feb76f94c1 => generated 1598 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:23:23.804540 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:23.860848 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-281523a1-75e3-4238-896d-0de181c6504e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:23.861423 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-281523a1-75e3-4238-896d-0de181c6504e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7f629426-c4e6-4c3f-8e54-efd452d14dd7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:23.876847 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-281523a1-75e3-4238-896d-0de181c6504e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:23.877360 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-281523a1-75e3-4238-896d-0de181c6504e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:23.877793 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-281523a1-75e3-4238-896d-0de181c6504e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:23.878598 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-281523a1-75e3-4238-896d-0de181c6504e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:23.879056 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-281523a1-75e3-4238-896d-0de181c6504e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:23.879482 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-281523a1-75e3-4238-896d-0de181c6504e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:24.124004 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-92a2a0df-1694-4697-8d19-926c1e6db41f tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] 10.222.0.13 "DELETE /compute/v2.1/servers/23cbc0a6-6137-4e64-b264-c67fceba507f" status: 204 len: 0 microversion: 2.1 time: 0.634677 Oct 30 01:23:24.124936 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1216/2454] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:23:23 2022] DELETE /compute/v2.1/servers/23cbc0a6-6137-4e64-b264-c67fceba507f => generated 0 bytes in 637 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:23:24.132788 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-e07832f1-8d9e-4a4d-9008-994303444305 req-f3864ef3-e90d-44f8-82e4-a326794b18af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55ba9ec4-90f4-4ded-b6ad-bc806de38256", "name": "network-vif-plugged", "status": "completed", "tag": "6a9261d9-b077-4bf1-9f81-8aaa59fd35eb"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:23:24.161412 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e07832f1-8d9e-4a4d-9008-994303444305 req-f3864ef3-e90d-44f8-82e4-a326794b18af service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:24.163016 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e07832f1-8d9e-4a4d-9008-994303444305 req-f3864ef3-e90d-44f8-82e4-a326794b18af service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:24.163016 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e07832f1-8d9e-4a4d-9008-994303444305 req-f3864ef3-e90d-44f8-82e4-a326794b18af service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:24.191050 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-e07832f1-8d9e-4a4d-9008-994303444305 req-f3864ef3-e90d-44f8-82e4-a326794b18af service nova] Creating event network-vif-plugged:6a9261d9-b077-4bf1-9f81-8aaa59fd35eb for instance 55ba9ec4-90f4-4ded-b6ad-bc806de38256 on n-h2-master-1 Oct 30 01:23:24.204150 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-e07832f1-8d9e-4a4d-9008-994303444305 req-f3864ef3-e90d-44f8-82e4-a326794b18af service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077522 Oct 30 01:23:24.205160 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1217/2455] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:23:24.219619 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8644bf99-2b9e-4315-bf74-8b8cbf811908 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44c79f0ee0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:24.270605 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-281523a1-75e3-4238-896d-0de181c6504e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:24.288550 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-281523a1-75e3-4238-896d-0de181c6504e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7" status: 200 len: 1523 microversion: 2.1 time: 0.429818 Oct 30 01:23:24.306161 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1239/2456] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:23 2022] GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7 => generated 1523 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:23:24.320668 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8644bf99-2b9e-4315-bf74-8b8cbf811908 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/82fe897f-65b0-4444-8047-364cc9b70689" status: 200 len: 1412 microversion: 2.1 time: 0.114175 Oct 30 01:23:24.328866 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1218/2457] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:23:24 2022] GET /compute/v2.1/images/82fe897f-65b0-4444-8047-364cc9b70689 => generated 1412 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:24.329070 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5044f87a-dbd4-49fc-8d3b-d543129a6481 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:24.329070 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5044f87a-dbd4-49fc-8d3b-d543129a6481 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] [instance: 81251939-4cb0-4e30-828c-648f5a48888e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:24.332769 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c9cb5ebb-83ec-4785-8ea8-7b018fafd2f6 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:24.332769 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c9cb5ebb-83ec-4785-8ea8-7b018fafd2f6 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] [instance: 55ba9ec4-90f4-4ded-b6ad-bc806de38256] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:24.336705 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c9cb5ebb-83ec-4785-8ea8-7b018fafd2f6 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:24.337503 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c9cb5ebb-83ec-4785-8ea8-7b018fafd2f6 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:24.338115 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c9cb5ebb-83ec-4785-8ea8-7b018fafd2f6 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:24.339013 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c9cb5ebb-83ec-4785-8ea8-7b018fafd2f6 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:24.339623 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c9cb5ebb-83ec-4785-8ea8-7b018fafd2f6 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:24.340203 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c9cb5ebb-83ec-4785-8ea8-7b018fafd2f6 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:24.349417 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5044f87a-dbd4-49fc-8d3b-d543129a6481 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:24.350100 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5044f87a-dbd4-49fc-8d3b-d543129a6481 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:24.350806 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5044f87a-dbd4-49fc-8d3b-d543129a6481 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:24.351772 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5044f87a-dbd4-49fc-8d3b-d543129a6481 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:24.352439 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5044f87a-dbd4-49fc-8d3b-d543129a6481 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:24.353070 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5044f87a-dbd4-49fc-8d3b-d543129a6481 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:24.391064 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5044f87a-dbd4-49fc-8d3b-d543129a6481 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] [instance: 81251939-4cb0-4e30-828c-648f5a48888e] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:23:24.472977 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:24.639766 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c9cb5ebb-83ec-4785-8ea8-7b018fafd2f6 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8011ce402b41ca9d3972a7a2a02cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071a4f9e348b484795cea54316963a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:24.649968 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c9cb5ebb-83ec-4785-8ea8-7b018fafd2f6 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] 10.222.0.13 "GET /compute/v2.1/servers/55ba9ec4-90f4-4ded-b6ad-bc806de38256" status: 200 len: 1313 microversion: 2.1 time: 0.325214 Oct 30 01:23:24.652881 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1219/2458] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:24 2022] GET /compute/v2.1/servers/55ba9ec4-90f4-4ded-b6ad-bc806de38256 => generated 1313 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:24.677022 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-914c7ed0-2049-4cc7-b679-c46ac44a043e req-c2fd00f3-8b0d-40f7-8528-f8f19e48bd98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c5133ba-8270-419a-80cb-43feb76f94c1", "name": "network-vif-deleted", "tag": "160f2013-8ad6-419e-a7f1-6a2b4d7e1229"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:23:24.689637 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-914c7ed0-2049-4cc7-b679-c46ac44a043e req-c2fd00f3-8b0d-40f7-8528-f8f19e48bd98 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:24.691577 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-914c7ed0-2049-4cc7-b679-c46ac44a043e req-c2fd00f3-8b0d-40f7-8528-f8f19e48bd98 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:24.692859 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-914c7ed0-2049-4cc7-b679-c46ac44a043e req-c2fd00f3-8b0d-40f7-8528-f8f19e48bd98 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:24.718592 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-914c7ed0-2049-4cc7-b679-c46ac44a043e req-c2fd00f3-8b0d-40f7-8528-f8f19e48bd98 service nova] Creating event network-vif-deleted:160f2013-8ad6-419e-a7f1-6a2b4d7e1229 for instance 0c5133ba-8270-419a-80cb-43feb76f94c1 on n-h1-master-1 Oct 30 01:23:24.733107 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-914c7ed0-2049-4cc7-b679-c46ac44a043e req-c2fd00f3-8b0d-40f7-8528-f8f19e48bd98 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076515 Oct 30 01:23:24.734397 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1220/2459] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:23:24.741917 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c60f581c-05f1-4228-a9dc-a1f3ddc811f2 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:24.742888 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c60f581c-05f1-4228-a9dc-a1f3ddc811f2 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] [instance: 3b6bf22e-53a4-481d-8764-d6a4b9c95d3e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:24.750503 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c60f581c-05f1-4228-a9dc-a1f3ddc811f2 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:24.751462 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c60f581c-05f1-4228-a9dc-a1f3ddc811f2 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:24.752076 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c60f581c-05f1-4228-a9dc-a1f3ddc811f2 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:24.753105 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c60f581c-05f1-4228-a9dc-a1f3ddc811f2 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:24.753812 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c60f581c-05f1-4228-a9dc-a1f3ddc811f2 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:24.754463 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c60f581c-05f1-4228-a9dc-a1f3ddc811f2 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:24.843642 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c60f581c-05f1-4228-a9dc-a1f3ddc811f2 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e23e3096f740508e6fb6626a29336f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5e20978d1a4886b04d37eef4c23d1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:24.852833 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c60f581c-05f1-4228-a9dc-a1f3ddc811f2 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] 10.222.0.13 "GET /compute/v2.1/servers/3b6bf22e-53a4-481d-8764-d6a4b9c95d3e" status: 200 len: 1334 microversion: 2.1 time: 0.116980 Oct 30 01:23:24.857684 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1221/2460] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:24 2022] GET /compute/v2.1/servers/3b6bf22e-53a4-481d-8764-d6a4b9c95d3e => generated 1334 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:24.868319 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2452b094-97a4-46dc-85b8-455d1dc2c23f tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:24.871098 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2452b094-97a4-46dc-85b8-455d1dc2c23f tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] [instance: 0c5133ba-8270-419a-80cb-43feb76f94c1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:24.892692 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2452b094-97a4-46dc-85b8-455d1dc2c23f tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:24.893742 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2452b094-97a4-46dc-85b8-455d1dc2c23f tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:24.894107 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2452b094-97a4-46dc-85b8-455d1dc2c23f tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:24.894928 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2452b094-97a4-46dc-85b8-455d1dc2c23f tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:24.895456 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2452b094-97a4-46dc-85b8-455d1dc2c23f tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:24.895948 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2452b094-97a4-46dc-85b8-455d1dc2c23f tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:24.968050 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5044f87a-dbd4-49fc-8d3b-d543129a6481 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] 10.222.0.13 "DELETE /compute/v2.1/servers/81251939-4cb0-4e30-828c-648f5a48888e" status: 204 len: 0 microversion: 2.1 time: 0.660242 Oct 30 01:23:24.970046 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1240/2461] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:23:24 2022] DELETE /compute/v2.1/servers/81251939-4cb0-4e30-828c-648f5a48888e => generated 0 bytes in 663 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:23:24.990235 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1a1a10ea-87e0-477e-ba61-50c7542c8616 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:24.993964 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1a1a10ea-87e0-477e-ba61-50c7542c8616 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] [instance: 33403d18-1832-4c1f-a824-150b5fbfd22f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:25.010432 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1a1a10ea-87e0-477e-ba61-50c7542c8616 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:25.014427 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1a1a10ea-87e0-477e-ba61-50c7542c8616 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:25.014956 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1a1a10ea-87e0-477e-ba61-50c7542c8616 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:25.015804 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1a1a10ea-87e0-477e-ba61-50c7542c8616 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:25.019063 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1a1a10ea-87e0-477e-ba61-50c7542c8616 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:25.019611 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1a1a10ea-87e0-477e-ba61-50c7542c8616 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:25.043829 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2452b094-97a4-46dc-85b8-455d1dc2c23f tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e0e5acf53b4abe99c3418c82d47ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f383493aa6b46c9884b54cb82063b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:25.061849 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2452b094-97a4-46dc-85b8-455d1dc2c23f tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] 10.222.0.13 "GET /compute/v2.1/servers/0c5133ba-8270-419a-80cb-43feb76f94c1" status: 200 len: 1598 microversion: 2.1 time: 0.199988 Oct 30 01:23:25.062754 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1222/2462] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:24 2022] GET /compute/v2.1/servers/0c5133ba-8270-419a-80cb-43feb76f94c1 => generated 1598 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:25.062938 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-1a1a10ea-87e0-477e-ba61-50c7542c8616 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] HTTP exception thrown: Instance 33403d18-1832-4c1f-a824-150b5fbfd22f could not be found. Oct 30 01:23:25.065085 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1a1a10ea-87e0-477e-ba61-50c7542c8616 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Request method failure captured: Oct 30 01:23:25.065085 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/33403d18-1832-4c1f-a824-150b5fbfd22f HTTP/1.1 Oct 30 01:23:25.065085 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:23:25.065085 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:23:25.065085 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:23:25.065085 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:23:25.065085 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:23:25.065085 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:23:25.065085 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:23:25.065085 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:23:25.065085 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdHSJyYe2LQmpJGDpAuH6oijHeoDT5sarvvnYYjVihbFqV_GCaS1tTgRlAOosNzKOnotz-LHdlv0fY7gRz28FWNunXxQpW0q__OQUJm-J87BrpgoPlajglSEBf7KTCwja8RaN0_s8w2XjyG-8Vul-e76vQ6agD8cJtnQMZAlfG8Ap0M Oct 30 01:23:25.065085 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:23:25.065085 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:23:25.065085 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:23:25.065085 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:23:25.065085 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:23:25.065085 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:23:25.065085 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 4cd1868480e44540be85a8c2862cd780 Oct 30 01:23:25.065085 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ListServersNegativeTestJSON-529840825 Oct 30 01:23:25.065085 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:23:25.065085 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:23:25.068158 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4cd1868480e44540be85a8c2862cd780"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4cd1868480e44540be85a8c2862cd780"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4cd1868480e44540be85a8c2862cd780"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4cd1868480e44540be85a8c2862cd780"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:23:25.068158 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ListServersNegativeTestJSON-529840825 Oct 30 01:23:25.068158 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 4cd1868480e44540be85a8c2862cd780 Oct 30 01:23:25.068158 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-529840825 Oct 30 01:23:25.068158 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ListServersNegativeTestJSON-529840825-project Oct 30 01:23:25.068158 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:23:25.068158 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:23:25.068158 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 055b96d1eb20418d96450efde939e020 Oct 30 01:23:25.068158 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ListServersNegativeTestJSON-529840825-project Oct 30 01:23:25.068158 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:23:25.068158 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 33403d18-1832-4c1f-a824-150b5fbfd22f could not be found. Oct 30 01:23:25.068158 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '33403d18-1832-4c1f-a824-150b5fbfd22f'} Oct 30 01:23:25.069021 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:23:25.069021 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:23:25.069021 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:23:25.069021 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:23:25.069021 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:23:25.069021 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:23:25.069021 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:23:25.069021 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:23:25.069021 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:23:25.069021 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:23:25.069021 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33403d18-1832-4c1f-a824-150b5fbfd22f could not be found. Oct 30 01:23:25.069021 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:23:25.069021 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:23:25.069021 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:23:25.069021 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:23:25.069021 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:23:25.069021 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:23:25.069021 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:23:25.069021 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:23:25.069021 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:23:25.070408 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:23:25.070408 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:23:25.070408 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:23:25.070408 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:23:25.070408 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:23:25.070408 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:23:25.070408 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:23:25.070408 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33403d18-1832-4c1f-a824-150b5fbfd22f could not be found. Oct 30 01:23:25.070408 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:23:25.070408 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:23:25.070408 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:23:25.070408 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:23:25.070408 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:23:25.070408 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:23:25.070408 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:23:25.070408 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:23:25.070408 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33403d18-1832-4c1f-a824-150b5fbfd22f could not be found. Oct 30 01:23:25.070408 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:23:25.071634 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1a1a10ea-87e0-477e-ba61-50c7542c8616 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Returning 404 to user: Instance 33403d18-1832-4c1f-a824-150b5fbfd22f could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:23:25.071634 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1a1a10ea-87e0-477e-ba61-50c7542c8616 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] 10.222.0.13 "GET /compute/v2.1/servers/33403d18-1832-4c1f-a824-150b5fbfd22f" status: 404 len: 111 microversion: 2.1 time: 0.090439 Oct 30 01:23:25.076588 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a03cd4c4-7502-4c9e-89ef-da5c502b848c tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-857628679", "imageRef": "1728b189-fd00-4ab7-a205-eb22dcf3bf43", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "09683873-e084-4229-91cf-86d216c688e6"}], "security_groups": [{"name": "tempest-securitygroup--1034851328"}], "key_name": "tempest-keypair-1477187144", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:23:25.089715 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1241/2463] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:24 2022] GET /compute/v2.1/servers/33403d18-1832-4c1f-a824-150b5fbfd22f => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:23:25.095650 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f126d308-4bde-4e12-86c5-70aa50e4b83d tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:25.095650 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f126d308-4bde-4e12-86c5-70aa50e4b83d tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] [instance: 23cbc0a6-6137-4e64-b264-c67fceba507f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:25.111581 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f126d308-4bde-4e12-86c5-70aa50e4b83d tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:25.112184 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f126d308-4bde-4e12-86c5-70aa50e4b83d tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:25.112690 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f126d308-4bde-4e12-86c5-70aa50e4b83d tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:25.113514 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f126d308-4bde-4e12-86c5-70aa50e4b83d tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:25.114038 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f126d308-4bde-4e12-86c5-70aa50e4b83d tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:25.114526 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f126d308-4bde-4e12-86c5-70aa50e4b83d tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:25.341506 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-a03cd4c4-7502-4c9e-89ef-da5c502b848c tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] validate_networks() for [('09683873-e084-4229-91cf-86d216c688e6', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:23:25.599014 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f126d308-4bde-4e12-86c5-70aa50e4b83d tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055b96d1eb20418d96450efde939e020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1868480e44540be85a8c2862cd780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:25.612804 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f126d308-4bde-4e12-86c5-70aa50e4b83d tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] 10.222.0.13 "GET /compute/v2.1/servers/23cbc0a6-6137-4e64-b264-c67fceba507f" status: 200 len: 1522 microversion: 2.1 time: 0.521650 Oct 30 01:23:25.615790 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1242/2464] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:25 2022] GET /compute/v2.1/servers/23cbc0a6-6137-4e64-b264-c67fceba507f => generated 1522 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:25.632665 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7dd1ed82-51f8-41ba-92da-4e02ffda3f92 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:25.633719 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7dd1ed82-51f8-41ba-92da-4e02ffda3f92 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7f629426-c4e6-4c3f-8e54-efd452d14dd7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:25.644078 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7dd1ed82-51f8-41ba-92da-4e02ffda3f92 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:25.652239 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7dd1ed82-51f8-41ba-92da-4e02ffda3f92 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:25.653053 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7dd1ed82-51f8-41ba-92da-4e02ffda3f92 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:25.664363 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7dd1ed82-51f8-41ba-92da-4e02ffda3f92 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:25.668807 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7dd1ed82-51f8-41ba-92da-4e02ffda3f92 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:25.669626 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7dd1ed82-51f8-41ba-92da-4e02ffda3f92 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:26.395803 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-a03cd4c4-7502-4c9e-89ef-da5c502b848c tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:23:26.396642 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-a03cd4c4-7502-4c9e-89ef-da5c502b848c tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:23:26.397133 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-a03cd4c4-7502-4c9e-89ef-da5c502b848c tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:23:26.397571 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-a03cd4c4-7502-4c9e-89ef-da5c502b848c tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:23:26.398181 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-a03cd4c4-7502-4c9e-89ef-da5c502b848c tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:23:26.412203 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=33 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:26.421460 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a03cd4c4-7502-4c9e-89ef-da5c502b848c tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:26.422361 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a03cd4c4-7502-4c9e-89ef-da5c502b848c tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:26.423085 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a03cd4c4-7502-4c9e-89ef-da5c502b848c tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:26.423994 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a03cd4c4-7502-4c9e-89ef-da5c502b848c tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:26.427982 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a03cd4c4-7502-4c9e-89ef-da5c502b848c tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:26.427982 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a03cd4c4-7502-4c9e-89ef-da5c502b848c tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:26.470812 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7dd1ed82-51f8-41ba-92da-4e02ffda3f92 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:26.486798 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7dd1ed82-51f8-41ba-92da-4e02ffda3f92 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7" status: 200 len: 1523 microversion: 2.1 time: 0.868661 Oct 30 01:23:26.487406 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1243/2465] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:25 2022] GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7 => generated 1523 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:26.494275 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-a03cd4c4-7502-4c9e-89ef-da5c502b848c tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Getting quotas for project d342baf2538340e292e44dfc622b86fc. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:23:26.499310 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-aaef62ce-4c94-4ee2-8427-24a03713dacd tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44c778e3a0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:26.516911 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-a03cd4c4-7502-4c9e-89ef-da5c502b848c tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Getting quotas for user 94448bbc2f4a4efaa86792f1511ff15c and project d342baf2538340e292e44dfc622b86fc. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:23:26.569748 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a03cd4c4-7502-4c9e-89ef-da5c502b848c tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:23:26.576833 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a03cd4c4-7502-4c9e-89ef-da5c502b848c tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] [instance: dcb34439-de04-4a9c-b81b-7fb2360af99c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1728b189-fd00-4ab7-a205-eb22dcf3bf43',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:23:26.799850 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a03cd4c4-7502-4c9e-89ef-da5c502b848c tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.728060 Oct 30 01:23:26.801101 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1223/2466] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:23:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 1731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:23:26.806793 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bd194c5e-84b5-4207-94e3-e25eb4f98496 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:26.808422 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-bd194c5e-84b5-4207-94e3-e25eb4f98496 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] [instance: 55ba9ec4-90f4-4ded-b6ad-bc806de38256] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:26.815423 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd194c5e-84b5-4207-94e3-e25eb4f98496 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:26.816212 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd194c5e-84b5-4207-94e3-e25eb4f98496 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:26.817060 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd194c5e-84b5-4207-94e3-e25eb4f98496 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:26.818268 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd194c5e-84b5-4207-94e3-e25eb4f98496 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:26.819240 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd194c5e-84b5-4207-94e3-e25eb4f98496 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:26.825059 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd194c5e-84b5-4207-94e3-e25eb4f98496 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:27.722108 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-bd194c5e-84b5-4207-94e3-e25eb4f98496 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8011ce402b41ca9d3972a7a2a02cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071a4f9e348b484795cea54316963a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:27.729271 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bd194c5e-84b5-4207-94e3-e25eb4f98496 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] 10.222.0.13 "GET /compute/v2.1/servers/55ba9ec4-90f4-4ded-b6ad-bc806de38256" status: 200 len: 1313 microversion: 2.1 time: 0.926810 Oct 30 01:23:27.733122 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1224/2467] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:26 2022] GET /compute/v2.1/servers/55ba9ec4-90f4-4ded-b6ad-bc806de38256 => generated 1313 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:27.758106 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b26af2e1-d96b-4aeb-be9e-71b5bc801e36 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:27.758740 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b26af2e1-d96b-4aeb-be9e-71b5bc801e36 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] [instance: 3b6bf22e-53a4-481d-8764-d6a4b9c95d3e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:27.779941 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b26af2e1-d96b-4aeb-be9e-71b5bc801e36 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:27.784723 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b26af2e1-d96b-4aeb-be9e-71b5bc801e36 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:27.785624 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b26af2e1-d96b-4aeb-be9e-71b5bc801e36 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:27.786576 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b26af2e1-d96b-4aeb-be9e-71b5bc801e36 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:27.790851 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b26af2e1-d96b-4aeb-be9e-71b5bc801e36 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:27.792468 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b26af2e1-d96b-4aeb-be9e-71b5bc801e36 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:28.226776 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b26af2e1-d96b-4aeb-be9e-71b5bc801e36 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e23e3096f740508e6fb6626a29336f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5e20978d1a4886b04d37eef4c23d1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:28.235946 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b26af2e1-d96b-4aeb-be9e-71b5bc801e36 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] 10.222.0.13 "GET /compute/v2.1/servers/3b6bf22e-53a4-481d-8764-d6a4b9c95d3e" status: 200 len: 1401 microversion: 2.1 time: 0.488669 Oct 30 01:23:28.237011 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1225/2468] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:27 2022] GET /compute/v2.1/servers/3b6bf22e-53a4-481d-8764-d6a4b9c95d3e => generated 1401 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:28.255271 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-de260e2d-d510-48f9-bcb9-12c25d2132d2 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:28.256127 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-de260e2d-d510-48f9-bcb9-12c25d2132d2 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] [instance: 0c5133ba-8270-419a-80cb-43feb76f94c1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:28.267858 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de260e2d-d510-48f9-bcb9-12c25d2132d2 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:28.268718 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de260e2d-d510-48f9-bcb9-12c25d2132d2 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:28.272818 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de260e2d-d510-48f9-bcb9-12c25d2132d2 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:28.272818 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de260e2d-d510-48f9-bcb9-12c25d2132d2 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:28.272818 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de260e2d-d510-48f9-bcb9-12c25d2132d2 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:28.272818 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de260e2d-d510-48f9-bcb9-12c25d2132d2 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:28.287965 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-de260e2d-d510-48f9-bcb9-12c25d2132d2 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] HTTP exception thrown: Instance 0c5133ba-8270-419a-80cb-43feb76f94c1 could not be found. Oct 30 01:23:28.290058 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-de260e2d-d510-48f9-bcb9-12c25d2132d2 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Request method failure captured: Oct 30 01:23:28.290058 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/0c5133ba-8270-419a-80cb-43feb76f94c1 HTTP/1.1 Oct 30 01:23:28.290058 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:23:28.290058 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:23:28.290058 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:23:28.290058 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:23:28.290058 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:23:28.290058 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:23:28.290058 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:23:28.290058 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:23:28.290058 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdG0170bNWpfNAL7gc9_QEe7TiA8-Pf0llY0Ahn5ZCmL-GEEX5JPYJ9woNsu0mosgXkTT34pPfe2EGEQaPlN5lHSkrIV_cS3yy9iZhP1jr4uEKgUjGmJDd0c8giIvZmh-10-d4Hmkbs3-Uxq4j7EnLUPJnRRr7nI7qdQ7OkIBgsX5xE Oct 30 01:23:28.290058 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:23:28.290058 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:23:28.290058 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:23:28.290058 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:23:28.290058 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:23:28.290058 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:23:28.290058 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 7f383493aa6b46c9884b54cb82063b30 Oct 30 01:23:28.290058 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersTestFqdnHostnames-98778775 Oct 30 01:23:28.290058 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:23:28.290058 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:23:28.291365 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7f383493aa6b46c9884b54cb82063b30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7f383493aa6b46c9884b54cb82063b30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7f383493aa6b46c9884b54cb82063b30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7f383493aa6b46c9884b54cb82063b30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:23:28.291365 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersTestFqdnHostnames-98778775 Oct 30 01:23:28.291365 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 7f383493aa6b46c9884b54cb82063b30 Oct 30 01:23:28.291365 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-98778775 Oct 30 01:23:28.291365 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersTestFqdnHostnames-98778775-project Oct 30 01:23:28.291365 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:23:28.291365 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:23:28.291365 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: d6e0e5acf53b4abe99c3418c82d47ab3 Oct 30 01:23:28.291365 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersTestFqdnHostnames-98778775-project Oct 30 01:23:28.291365 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:23:28.291365 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 0c5133ba-8270-419a-80cb-43feb76f94c1 could not be found. Oct 30 01:23:28.291365 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '0c5133ba-8270-419a-80cb-43feb76f94c1'} Oct 30 01:23:28.292098 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:23:28.292098 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:23:28.292098 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:23:28.292098 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:23:28.292098 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:23:28.292098 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:23:28.292098 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:23:28.292098 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:23:28.292098 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:23:28.292098 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:23:28.292098 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c5133ba-8270-419a-80cb-43feb76f94c1 could not be found. Oct 30 01:23:28.292098 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:23:28.292098 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:23:28.292098 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:23:28.292098 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:23:28.292098 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:23:28.292098 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:23:28.292098 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:23:28.292098 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:23:28.292098 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:23:28.293223 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:23:28.293223 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:23:28.293223 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:23:28.293223 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:23:28.293223 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:23:28.293223 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:23:28.293223 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:23:28.293223 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c5133ba-8270-419a-80cb-43feb76f94c1 could not be found. Oct 30 01:23:28.293223 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:23:28.293223 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:23:28.293223 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:23:28.293223 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:23:28.293223 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:23:28.293223 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:23:28.293223 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:23:28.293223 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:23:28.293223 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c5133ba-8270-419a-80cb-43feb76f94c1 could not be found. Oct 30 01:23:28.293223 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:23:28.298007 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-de260e2d-d510-48f9-bcb9-12c25d2132d2 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Returning 404 to user: Instance 0c5133ba-8270-419a-80cb-43feb76f94c1 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:23:28.299051 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-de260e2d-d510-48f9-bcb9-12c25d2132d2 tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] 10.222.0.13 "GET /compute/v2.1/servers/0c5133ba-8270-419a-80cb-43feb76f94c1" status: 404 len: 111 microversion: 2.1 time: 0.054380 Oct 30 01:23:28.300141 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1226/2469] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:28 2022] GET /compute/v2.1/servers/0c5133ba-8270-419a-80cb-43feb76f94c1 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:23:28.311000 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e2edeab7-6410-4de1-8304-cd7de19fc87f tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:28.311896 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e2edeab7-6410-4de1-8304-cd7de19fc87f tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] [instance: 23cbc0a6-6137-4e64-b264-c67fceba507f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:28.321511 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2edeab7-6410-4de1-8304-cd7de19fc87f tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:28.322301 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2edeab7-6410-4de1-8304-cd7de19fc87f tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:28.323832 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2edeab7-6410-4de1-8304-cd7de19fc87f tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:28.329140 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2edeab7-6410-4de1-8304-cd7de19fc87f tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:28.330107 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2edeab7-6410-4de1-8304-cd7de19fc87f tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:28.330868 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2edeab7-6410-4de1-8304-cd7de19fc87f tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:28.447160 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e2edeab7-6410-4de1-8304-cd7de19fc87f tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055b96d1eb20418d96450efde939e020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1868480e44540be85a8c2862cd780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:28.469801 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e2edeab7-6410-4de1-8304-cd7de19fc87f tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] 10.222.0.13 "GET /compute/v2.1/servers/23cbc0a6-6137-4e64-b264-c67fceba507f" status: 200 len: 1480 microversion: 2.1 time: 0.168144 Oct 30 01:23:28.479747 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1227/2470] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:28 2022] GET /compute/v2.1/servers/23cbc0a6-6137-4e64-b264-c67fceba507f => generated 1480 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:28.493276 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-24f1f418-5843-45ae-81e9-f2ba607ced73 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:28.496540 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-24f1f418-5843-45ae-81e9-f2ba607ced73 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] [instance: dcb34439-de04-4a9c-b81b-7fb2360af99c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:28.657729 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-24f1f418-5843-45ae-81e9-f2ba607ced73 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94448bbc2f4a4efaa86792f1511ff15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342baf2538340e292e44dfc622b86fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:28.669469 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-24f1f418-5843-45ae-81e9-f2ba607ced73 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] 10.222.0.13 "GET /compute/v2.1/servers/dcb34439-de04-4a9c-b81b-7fb2360af99c" status: 200 len: 1245 microversion: 2.1 time: 0.188244 Oct 30 01:23:28.670066 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1228/2471] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:28 2022] GET /compute/v2.1/servers/dcb34439-de04-4a9c-b81b-7fb2360af99c => generated 1245 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:28.700419 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-fe3d710a-8614-44e4-9481-2cfa3bc459c9 req-ef12b928-ec13-4d16-a4f5-c29150fd03f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3faeee3-0724-417b-8575-ac8e59663103", "name": "network-vif-plugged", "status": "completed", "tag": "f422e3db-4c59-447a-b83c-3fe06b9aefaa"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:23:28.724510 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-fe3d710a-8614-44e4-9481-2cfa3bc459c9 req-ef12b928-ec13-4d16-a4f5-c29150fd03f9 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:28.725310 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-fe3d710a-8614-44e4-9481-2cfa3bc459c9 req-ef12b928-ec13-4d16-a4f5-c29150fd03f9 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:28.725455 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-fe3d710a-8614-44e4-9481-2cfa3bc459c9 req-ef12b928-ec13-4d16-a4f5-c29150fd03f9 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:28.753507 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-fe3d710a-8614-44e4-9481-2cfa3bc459c9 req-ef12b928-ec13-4d16-a4f5-c29150fd03f9 service nova] Creating event network-vif-plugged:f422e3db-4c59-447a-b83c-3fe06b9aefaa for instance e3faeee3-0724-417b-8575-ac8e59663103 on n-h1-master-1 Oct 30 01:23:28.772754 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-fe3d710a-8614-44e4-9481-2cfa3bc459c9 req-ef12b928-ec13-4d16-a4f5-c29150fd03f9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085474 Oct 30 01:23:28.773391 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1229/2472] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:23:28.782995 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1a7b59b7-b5ad-46c3-875f-3dbd59a391c5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:28.782995 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1a7b59b7-b5ad-46c3-875f-3dbd59a391c5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7f629426-c4e6-4c3f-8e54-efd452d14dd7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:28.798452 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a7b59b7-b5ad-46c3-875f-3dbd59a391c5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:28.799209 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a7b59b7-b5ad-46c3-875f-3dbd59a391c5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:28.799895 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a7b59b7-b5ad-46c3-875f-3dbd59a391c5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:28.800894 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a7b59b7-b5ad-46c3-875f-3dbd59a391c5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:28.801536 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a7b59b7-b5ad-46c3-875f-3dbd59a391c5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:28.802108 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a7b59b7-b5ad-46c3-875f-3dbd59a391c5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:29.253594 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1a7b59b7-b5ad-46c3-875f-3dbd59a391c5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:29.265804 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1a7b59b7-b5ad-46c3-875f-3dbd59a391c5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7" status: 200 len: 1523 microversion: 2.1 time: 0.490918 Oct 30 01:23:29.269403 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1230/2473] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:28 2022] GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7 => generated 1523 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:29.274644 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-3dbee744-f552-49d6-a518-b72fdc20106c req-a9361406-8fd3-46c6-9a14-cb0020724d00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23cbc0a6-6137-4e64-b264-c67fceba507f", "name": "network-vif-deleted", "tag": "de868ba1-8fcb-485f-9548-68c5b674c8dd"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:23:29.291354 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-3dbee744-f552-49d6-a518-b72fdc20106c req-a9361406-8fd3-46c6-9a14-cb0020724d00 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:29.292208 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-3dbee744-f552-49d6-a518-b72fdc20106c req-a9361406-8fd3-46c6-9a14-cb0020724d00 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:29.292663 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-3dbee744-f552-49d6-a518-b72fdc20106c req-a9361406-8fd3-46c6-9a14-cb0020724d00 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:29.310644 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-3dbee744-f552-49d6-a518-b72fdc20106c req-a9361406-8fd3-46c6-9a14-cb0020724d00 service nova] Creating event network-vif-deleted:de868ba1-8fcb-485f-9548-68c5b674c8dd for instance 23cbc0a6-6137-4e64-b264-c67fceba507f on n-h1-master-1 Oct 30 01:23:29.321638 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-3dbee744-f552-49d6-a518-b72fdc20106c req-a9361406-8fd3-46c6-9a14-cb0020724d00 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050606 Oct 30 01:23:29.322946 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1231/2474] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:23:29.330244 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-23577690-f611-4238-8277-0f248c0fdabd tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] Calling method '.version_select at 0x7f44d0486280>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:29.537763 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-23577690-f611-4238-8277-0f248c0fdabd tempest-ServersTestFqdnHostnames-98778775 tempest-ServersTestFqdnHostnames-98778775-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-12148639" status: 202 len: 0 microversion: 2.1 time: 0.213007 Oct 30 01:23:29.538714 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1232/2475] 10.222.0.13 () {58 vars in 1215 bytes} [Sun Oct 30 01:23:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-12148639 => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:23:29.544598 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8a3efc27-6a89-4cab-a909-bb9e2c1071fc tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:29.545760 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8a3efc27-6a89-4cab-a909-bb9e2c1071fc tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] [instance: 55ba9ec4-90f4-4ded-b6ad-bc806de38256] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:29.553785 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8a3efc27-6a89-4cab-a909-bb9e2c1071fc tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:29.554440 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8a3efc27-6a89-4cab-a909-bb9e2c1071fc tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:29.555179 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8a3efc27-6a89-4cab-a909-bb9e2c1071fc tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:29.556079 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8a3efc27-6a89-4cab-a909-bb9e2c1071fc tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:29.556686 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8a3efc27-6a89-4cab-a909-bb9e2c1071fc tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:29.557262 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8a3efc27-6a89-4cab-a909-bb9e2c1071fc tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:29.883685 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8a3efc27-6a89-4cab-a909-bb9e2c1071fc tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8011ce402b41ca9d3972a7a2a02cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071a4f9e348b484795cea54316963a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:29.908004 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8a3efc27-6a89-4cab-a909-bb9e2c1071fc tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] 10.222.0.13 "GET /compute/v2.1/servers/55ba9ec4-90f4-4ded-b6ad-bc806de38256" status: 200 len: 1463 microversion: 2.1 time: 0.368116 Oct 30 01:23:29.909155 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1233/2476] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:29 2022] GET /compute/v2.1/servers/55ba9ec4-90f4-4ded-b6ad-bc806de38256 => generated 1463 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:29.918188 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-91c7c84b-3732-479a-bc99-af87ba2e59e0 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:29.921107 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-91c7c84b-3732-479a-bc99-af87ba2e59e0 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] [instance: 3b6bf22e-53a4-481d-8764-d6a4b9c95d3e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:29.937378 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91c7c84b-3732-479a-bc99-af87ba2e59e0 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:29.937947 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91c7c84b-3732-479a-bc99-af87ba2e59e0 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:29.938305 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91c7c84b-3732-479a-bc99-af87ba2e59e0 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:29.939290 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91c7c84b-3732-479a-bc99-af87ba2e59e0 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:29.939739 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91c7c84b-3732-479a-bc99-af87ba2e59e0 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:29.940160 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91c7c84b-3732-479a-bc99-af87ba2e59e0 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:30.137122 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-aaef62ce-4c94-4ee2-8427-24a03713dacd tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/82fe897f-65b0-4444-8047-364cc9b70689" status: 200 len: 1412 microversion: 2.1 time: 3.647149 Oct 30 01:23:30.138552 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1244/2477] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:23:26 2022] GET /compute/v2.1/images/82fe897f-65b0-4444-8047-364cc9b70689 => generated 1412 bytes in 3649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:30.151965 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ada3381f-37b4-42de-aefc-667ec7d93d96 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:30.153313 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ada3381f-37b4-42de-aefc-667ec7d93d96 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] [instance: 23cbc0a6-6137-4e64-b264-c67fceba507f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:30.171638 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ada3381f-37b4-42de-aefc-667ec7d93d96 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:30.173171 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ada3381f-37b4-42de-aefc-667ec7d93d96 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:30.173854 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ada3381f-37b4-42de-aefc-667ec7d93d96 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:30.174770 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ada3381f-37b4-42de-aefc-667ec7d93d96 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:30.175510 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ada3381f-37b4-42de-aefc-667ec7d93d96 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:30.176206 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ada3381f-37b4-42de-aefc-667ec7d93d96 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:30.203080 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-ada3381f-37b4-42de-aefc-667ec7d93d96 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] HTTP exception thrown: Instance 23cbc0a6-6137-4e64-b264-c67fceba507f could not be found. Oct 30 01:23:30.205172 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ada3381f-37b4-42de-aefc-667ec7d93d96 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Request method failure captured: Oct 30 01:23:30.205172 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/23cbc0a6-6137-4e64-b264-c67fceba507f HTTP/1.1 Oct 30 01:23:30.205172 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:23:30.205172 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:23:30.205172 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:23:30.205172 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:23:30.205172 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:23:30.205172 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:23:30.205172 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:23:30.205172 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:23:30.205172 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdHSJyYe2LQmpJGDpAuH6oijHeoDT5sarvvnYYjVihbFqV_GCaS1tTgRlAOosNzKOnotz-LHdlv0fY7gRz28FWNunXxQpW0q__OQUJm-J87BrpgoPlajglSEBf7KTCwja8RaN0_s8w2XjyG-8Vul-e76vQ6agD8cJtnQMZAlfG8Ap0M Oct 30 01:23:30.205172 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:23:30.205172 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:23:30.205172 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:23:30.205172 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:23:30.205172 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:23:30.205172 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:23:30.205172 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 4cd1868480e44540be85a8c2862cd780 Oct 30 01:23:30.205172 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ListServersNegativeTestJSON-529840825 Oct 30 01:23:30.205172 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:23:30.205172 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:23:30.206381 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4cd1868480e44540be85a8c2862cd780"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4cd1868480e44540be85a8c2862cd780"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4cd1868480e44540be85a8c2862cd780"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4cd1868480e44540be85a8c2862cd780"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:23:30.206381 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ListServersNegativeTestJSON-529840825 Oct 30 01:23:30.206381 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 4cd1868480e44540be85a8c2862cd780 Oct 30 01:23:30.206381 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-529840825 Oct 30 01:23:30.206381 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ListServersNegativeTestJSON-529840825-project Oct 30 01:23:30.206381 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:23:30.206381 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:23:30.206381 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 055b96d1eb20418d96450efde939e020 Oct 30 01:23:30.206381 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ListServersNegativeTestJSON-529840825-project Oct 30 01:23:30.206381 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:23:30.206381 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 23cbc0a6-6137-4e64-b264-c67fceba507f could not be found. Oct 30 01:23:30.206381 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '23cbc0a6-6137-4e64-b264-c67fceba507f'} Oct 30 01:23:30.207080 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:23:30.207080 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:23:30.207080 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:23:30.207080 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:23:30.207080 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:23:30.207080 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:23:30.207080 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:23:30.207080 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:23:30.207080 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:23:30.207080 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:23:30.207080 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23cbc0a6-6137-4e64-b264-c67fceba507f could not be found. Oct 30 01:23:30.207080 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:23:30.207080 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:23:30.207080 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:23:30.207080 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:23:30.207080 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:23:30.207080 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:23:30.207080 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:23:30.207080 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:23:30.207080 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:23:30.208163 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:23:30.208163 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:23:30.208163 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:23:30.208163 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:23:30.208163 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:23:30.208163 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:23:30.208163 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:23:30.208163 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23cbc0a6-6137-4e64-b264-c67fceba507f could not be found. Oct 30 01:23:30.208163 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:23:30.208163 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:23:30.208163 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:23:30.208163 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:23:30.208163 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:23:30.208163 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:23:30.208163 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:23:30.208163 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:23:30.208163 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23cbc0a6-6137-4e64-b264-c67fceba507f could not be found. Oct 30 01:23:30.208163 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:23:30.213227 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ada3381f-37b4-42de-aefc-667ec7d93d96 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Returning 404 to user: Instance 23cbc0a6-6137-4e64-b264-c67fceba507f could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:23:30.215254 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ada3381f-37b4-42de-aefc-667ec7d93d96 tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] 10.222.0.13 "GET /compute/v2.1/servers/23cbc0a6-6137-4e64-b264-c67fceba507f" status: 404 len: 111 microversion: 2.1 time: 0.075526 Oct 30 01:23:30.217203 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1245/2478] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:30 2022] GET /compute/v2.1/servers/23cbc0a6-6137-4e64-b264-c67fceba507f => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:23:30.235034 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-663e13b3-9030-462e-b247-1dd7784240d5 req-b4ac779a-9f5e-4b05-b7a2-fd042f207c41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81251939-4cb0-4e30-828c-648f5a48888e", "name": "network-vif-deleted", "tag": "0a420531-b57f-4867-9658-7453f902d395"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:23:30.257611 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-663e13b3-9030-462e-b247-1dd7784240d5 req-b4ac779a-9f5e-4b05-b7a2-fd042f207c41 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:30.263133 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-663e13b3-9030-462e-b247-1dd7784240d5 req-b4ac779a-9f5e-4b05-b7a2-fd042f207c41 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:30.263133 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-663e13b3-9030-462e-b247-1dd7784240d5 req-b4ac779a-9f5e-4b05-b7a2-fd042f207c41 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:30.303651 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-663e13b3-9030-462e-b247-1dd7784240d5 req-b4ac779a-9f5e-4b05-b7a2-fd042f207c41 service nova] Creating event network-vif-deleted:0a420531-b57f-4867-9658-7453f902d395 for instance 81251939-4cb0-4e30-828c-648f5a48888e on n-h2-master-1 Oct 30 01:23:30.311333 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-663e13b3-9030-462e-b247-1dd7784240d5 req-b4ac779a-9f5e-4b05-b7a2-fd042f207c41 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094140 Oct 30 01:23:30.311962 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1246/2479] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:23:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:23:30.330153 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-765dfebd-eb2c-4458-8851-cdd717f41b71 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:30.330797 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-765dfebd-eb2c-4458-8851-cdd717f41b71 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] [instance: dcb34439-de04-4a9c-b81b-7fb2360af99c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:30.339036 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-765dfebd-eb2c-4458-8851-cdd717f41b71 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:30.339817 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-765dfebd-eb2c-4458-8851-cdd717f41b71 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:30.340410 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-765dfebd-eb2c-4458-8851-cdd717f41b71 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:30.341350 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-765dfebd-eb2c-4458-8851-cdd717f41b71 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:30.342000 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-765dfebd-eb2c-4458-8851-cdd717f41b71 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:30.342648 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-765dfebd-eb2c-4458-8851-cdd717f41b71 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:30.782607 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-765dfebd-eb2c-4458-8851-cdd717f41b71 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94448bbc2f4a4efaa86792f1511ff15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342baf2538340e292e44dfc622b86fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:30.791547 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-765dfebd-eb2c-4458-8851-cdd717f41b71 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] 10.222.0.13 "GET /compute/v2.1/servers/dcb34439-de04-4a9c-b81b-7fb2360af99c" status: 200 len: 1241 microversion: 2.1 time: 0.478360 Oct 30 01:23:30.806358 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1247/2480] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:30 2022] GET /compute/v2.1/servers/dcb34439-de04-4a9c-b81b-7fb2360af99c => generated 1241 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:30.871240 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-91c7c84b-3732-479a-bc99-af87ba2e59e0 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e23e3096f740508e6fb6626a29336f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5e20978d1a4886b04d37eef4c23d1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:30.882449 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-91c7c84b-3732-479a-bc99-af87ba2e59e0 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] 10.222.0.13 "GET /compute/v2.1/servers/3b6bf22e-53a4-481d-8764-d6a4b9c95d3e" status: 200 len: 1401 microversion: 2.1 time: 0.971710 Oct 30 01:23:30.897589 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1234/2481] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:29 2022] GET /compute/v2.1/servers/3b6bf22e-53a4-481d-8764-d6a4b9c95d3e => generated 1401 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:30.897589 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e4951be6-4e9a-486f-ac39-3c5d0580471f tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:30.897589 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e4951be6-4e9a-486f-ac39-3c5d0580471f tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] [instance: 81251939-4cb0-4e30-828c-648f5a48888e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:30.921977 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e4951be6-4e9a-486f-ac39-3c5d0580471f tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:30.924867 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e4951be6-4e9a-486f-ac39-3c5d0580471f tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:30.925661 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e4951be6-4e9a-486f-ac39-3c5d0580471f tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:30.927455 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e4951be6-4e9a-486f-ac39-3c5d0580471f tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:30.928296 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e4951be6-4e9a-486f-ac39-3c5d0580471f tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:30.929364 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e4951be6-4e9a-486f-ac39-3c5d0580471f tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:31.010910 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e4951be6-4e9a-486f-ac39-3c5d0580471f tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:31.013351 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e4951be6-4e9a-486f-ac39-3c5d0580471f tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:31.014510 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e4951be6-4e9a-486f-ac39-3c5d0580471f tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:31.015766 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-e4951be6-4e9a-486f-ac39-3c5d0580471f tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lazy-loading 'fault' on Instance uuid 81251939-4cb0-4e30-828c-648f5a48888e {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:23:31.107937 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e4951be6-4e9a-486f-ac39-3c5d0580471f tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055b96d1eb20418d96450efde939e020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1868480e44540be85a8c2862cd780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:31.138140 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e4951be6-4e9a-486f-ac39-3c5d0580471f tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] 10.222.0.13 "GET /compute/v2.1/servers/81251939-4cb0-4e30-828c-648f5a48888e" status: 200 len: 1313 microversion: 2.1 time: 0.249523 Oct 30 01:23:31.138757 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1235/2482] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:30 2022] GET /compute/v2.1/servers/81251939-4cb0-4e30-828c-648f5a48888e => generated 1313 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:31.153170 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-40c22581-61f0-49d7-af07-dd980171c3f2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:31.157753 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-40c22581-61f0-49d7-af07-dd980171c3f2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7f629426-c4e6-4c3f-8e54-efd452d14dd7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:31.173610 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-40c22581-61f0-49d7-af07-dd980171c3f2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:31.174399 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-40c22581-61f0-49d7-af07-dd980171c3f2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:31.174996 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-40c22581-61f0-49d7-af07-dd980171c3f2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:31.178145 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-03b9b280-c91d-4564-b71d-686afe2d867a tempest-TenantUsagesTestJSON-1486725065 tempest-TenantUsagesTestJSON-1486725065-project-admin] Calling method '.version_select at 0x7f44c783ea60>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:31.179770 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-40c22581-61f0-49d7-af07-dd980171c3f2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:31.183736 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-40c22581-61f0-49d7-af07-dd980171c3f2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:31.184188 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-40c22581-61f0-49d7-af07-dd980171c3f2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:31.207698 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-03b9b280-c91d-4564-b71d-686afe2d867a tempest-TenantUsagesTestJSON-1486725065 tempest-TenantUsagesTestJSON-1486725065-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:31.208185 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-03b9b280-c91d-4564-b71d-686afe2d867a tempest-TenantUsagesTestJSON-1486725065 tempest-TenantUsagesTestJSON-1486725065-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:31.208621 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-03b9b280-c91d-4564-b71d-686afe2d867a tempest-TenantUsagesTestJSON-1486725065 tempest-TenantUsagesTestJSON-1486725065-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:31.238695 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=24 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:31.240217 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-03b9b280-c91d-4564-b71d-686afe2d867a tempest-TenantUsagesTestJSON-1486725065 tempest-TenantUsagesTestJSON-1486725065-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:31.241537 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-03b9b280-c91d-4564-b71d-686afe2d867a tempest-TenantUsagesTestJSON-1486725065 tempest-TenantUsagesTestJSON-1486725065-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:31.242004 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-03b9b280-c91d-4564-b71d-686afe2d867a tempest-TenantUsagesTestJSON-1486725065 tempest-TenantUsagesTestJSON-1486725065-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:31.272683 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-03b9b280-c91d-4564-b71d-686afe2d867a tempest-TenantUsagesTestJSON-1486725065 tempest-TenantUsagesTestJSON-1486725065-project-admin] 10.222.0.13 "GET /compute/v2.1/os-simple-tenant-usage/071a4f9e348b484795cea54316963a62?start=2022-10-29T01%3A23%3A29.926558&end=2022-10-31T01%3A23%3A29.926558" status: 200 len: 693 microversion: 2.1 time: 0.465071 Oct 30 01:23:31.274270 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1248/2483] 10.222.0.13 () {58 vars in 1412 bytes} [Sun Oct 30 01:23:30 2022] GET /compute/v2.1/os-simple-tenant-usage/071a4f9e348b484795cea54316963a62?start=2022-10-29T01%3A23%3A29.926558&end=2022-10-31T01%3A23%3A29.926558 => generated 693 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:23:31.303164 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2cb2d057-abd7-406d-99bd-3b129887f81f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44c77edc10>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:31.397362 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2cb2d057-abd7-406d-99bd-3b129887f81f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/82fe897f-65b0-4444-8047-364cc9b70689" status: 200 len: 1412 microversion: 2.1 time: 0.121727 Oct 30 01:23:31.399261 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1249/2484] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:23:31 2022] GET /compute/v2.1/images/82fe897f-65b0-4444-8047-364cc9b70689 => generated 1412 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:31.406820 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1eff5f14-9ae5-432b-88b0-341d8e52b002 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Calling method '.version_select at 0x7f44c7ea9040>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:31.419468 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1eff5f14-9ae5-432b-88b0-341d8e52b002 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:31.420306 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1eff5f14-9ae5-432b-88b0-341d8e52b002 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:31.428246 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1eff5f14-9ae5-432b-88b0-341d8e52b002 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:31.443019 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1eff5f14-9ae5-432b-88b0-341d8e52b002 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:31.444509 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1eff5f14-9ae5-432b-88b0-341d8e52b002 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:31.445182 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1eff5f14-9ae5-432b-88b0-341d8e52b002 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:31.461870 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1eff5f14-9ae5-432b-88b0-341d8e52b002 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] 10.222.0.13 "GET /compute/v2.1/os-simple-tenant-usage/071a4f9e348b484795cea54316963a62?start=2022-10-29T01%3A23%3A29.926558&end=2022-10-31T01%3A23%3A29.926558" status: 200 len: 694 microversion: 2.1 time: 0.061162 Oct 30 01:23:31.468423 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1250/2485] 10.222.0.13 () {58 vars in 1412 bytes} [Sun Oct 30 01:23:31 2022] GET /compute/v2.1/os-simple-tenant-usage/071a4f9e348b484795cea54316963a62?start=2022-10-29T01%3A23%3A29.926558&end=2022-10-31T01%3A23%3A29.926558 => generated 694 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:23:31.483870 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b2e87e31-90ce-4cdb-b276-2c56a292a81c tempest-TenantUsagesTestJSON-1486725065 tempest-TenantUsagesTestJSON-1486725065-project-admin] Calling method '.version_select at 0x7f44c7714940>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:31.507674 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2e87e31-90ce-4cdb-b276-2c56a292a81c tempest-TenantUsagesTestJSON-1486725065 tempest-TenantUsagesTestJSON-1486725065-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:31.508601 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2e87e31-90ce-4cdb-b276-2c56a292a81c tempest-TenantUsagesTestJSON-1486725065 tempest-TenantUsagesTestJSON-1486725065-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:31.509261 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2e87e31-90ce-4cdb-b276-2c56a292a81c tempest-TenantUsagesTestJSON-1486725065 tempest-TenantUsagesTestJSON-1486725065-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:31.548919 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2e87e31-90ce-4cdb-b276-2c56a292a81c tempest-TenantUsagesTestJSON-1486725065 tempest-TenantUsagesTestJSON-1486725065-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:31.549437 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2e87e31-90ce-4cdb-b276-2c56a292a81c tempest-TenantUsagesTestJSON-1486725065 tempest-TenantUsagesTestJSON-1486725065-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:31.555823 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2e87e31-90ce-4cdb-b276-2c56a292a81c tempest-TenantUsagesTestJSON-1486725065 tempest-TenantUsagesTestJSON-1486725065-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:31.813212 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-40c22581-61f0-49d7-af07-dd980171c3f2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:31.828277 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-40c22581-61f0-49d7-af07-dd980171c3f2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7" status: 200 len: 1505 microversion: 2.1 time: 0.686774 Oct 30 01:23:31.845736 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1236/2486] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:31 2022] GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7 => generated 1505 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:31.845736 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-2eaeb9f8-ad65-4ca2-89f7-05aee82b1719 req-dc1d6b15-5171-4fa1-847d-94cf2102a07f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f629426-c4e6-4c3f-8e54-efd452d14dd7", "name": "network-vif-unplugged", "status": "completed", "tag": "0be1ebe4-f222-4d74-8298-cd63a4bc397c"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:23:31.901205 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-2eaeb9f8-ad65-4ca2-89f7-05aee82b1719 req-dc1d6b15-5171-4fa1-847d-94cf2102a07f service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:31.910201 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-2eaeb9f8-ad65-4ca2-89f7-05aee82b1719 req-dc1d6b15-5171-4fa1-847d-94cf2102a07f service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:31.913301 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-2eaeb9f8-ad65-4ca2-89f7-05aee82b1719 req-dc1d6b15-5171-4fa1-847d-94cf2102a07f service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:31.919484 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b2e87e31-90ce-4cdb-b276-2c56a292a81c tempest-TenantUsagesTestJSON-1486725065 tempest-TenantUsagesTestJSON-1486725065-project-admin] 10.222.0.13 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-29T01%3A23%3A29.926558&end=2022-10-31T01%3A23%3A29.926558&detailed=1" status: 200 len: 27550 microversion: 2.1 time: 0.439680 Oct 30 01:23:31.921394 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1251/2487] 10.222.0.13 () {58 vars in 1335 bytes} [Sun Oct 30 01:23:31 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-29T01%3A23%3A29.926558&end=2022-10-31T01%3A23%3A29.926558&detailed=1 => generated 27550 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:23:31.934711 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7d19f473-383e-4037-a6fb-e387f2d22287 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:31.937559 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7d19f473-383e-4037-a6fb-e387f2d22287 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] [instance: dcb34439-de04-4a9c-b81b-7fb2360af99c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:31.956792 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7d19f473-383e-4037-a6fb-e387f2d22287 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:31.959702 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7d19f473-383e-4037-a6fb-e387f2d22287 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:31.962142 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7d19f473-383e-4037-a6fb-e387f2d22287 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:31.966314 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7d19f473-383e-4037-a6fb-e387f2d22287 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:31.967161 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7d19f473-383e-4037-a6fb-e387f2d22287 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:31.968458 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7d19f473-383e-4037-a6fb-e387f2d22287 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:31.986879 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-2eaeb9f8-ad65-4ca2-89f7-05aee82b1719 req-dc1d6b15-5171-4fa1-847d-94cf2102a07f service nova] Creating event network-vif-unplugged:0be1ebe4-f222-4d74-8298-cd63a4bc397c for instance 7f629426-c4e6-4c3f-8e54-efd452d14dd7 on n-h2-master-1 Oct 30 01:23:32.002601 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-2eaeb9f8-ad65-4ca2-89f7-05aee82b1719 req-dc1d6b15-5171-4fa1-847d-94cf2102a07f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.162443 Oct 30 01:23:32.003935 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1237/2488] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:23:32.009712 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7cc0e862-dc95-441a-ab26-99d9fc010fc6 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:32.011780 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7cc0e862-dc95-441a-ab26-99d9fc010fc6 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] [instance: 3b6bf22e-53a4-481d-8764-d6a4b9c95d3e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:32.022599 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7cc0e862-dc95-441a-ab26-99d9fc010fc6 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:32.024759 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7cc0e862-dc95-441a-ab26-99d9fc010fc6 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:32.025937 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7cc0e862-dc95-441a-ab26-99d9fc010fc6 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:32.027514 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7cc0e862-dc95-441a-ab26-99d9fc010fc6 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:32.028359 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7cc0e862-dc95-441a-ab26-99d9fc010fc6 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:32.028997 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7cc0e862-dc95-441a-ab26-99d9fc010fc6 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:32.241957 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7d19f473-383e-4037-a6fb-e387f2d22287 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94448bbc2f4a4efaa86792f1511ff15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342baf2538340e292e44dfc622b86fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:32.253840 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7d19f473-383e-4037-a6fb-e387f2d22287 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] 10.222.0.13 "GET /compute/v2.1/servers/dcb34439-de04-4a9c-b81b-7fb2360af99c" status: 200 len: 1315 microversion: 2.1 time: 0.326134 Oct 30 01:23:32.254822 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1252/2489] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:31 2022] GET /compute/v2.1/servers/dcb34439-de04-4a9c-b81b-7fb2360af99c => generated 1315 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:32.277836 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-95c3741e-3d40-438f-8caa-2fb692cc937b tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:32.279161 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-95c3741e-3d40-438f-8caa-2fb692cc937b tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] [instance: 55ba9ec4-90f4-4ded-b6ad-bc806de38256] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:32.290345 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-95c3741e-3d40-438f-8caa-2fb692cc937b tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:32.291438 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-95c3741e-3d40-438f-8caa-2fb692cc937b tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:32.292605 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-95c3741e-3d40-438f-8caa-2fb692cc937b tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:32.293527 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-95c3741e-3d40-438f-8caa-2fb692cc937b tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:32.294762 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-95c3741e-3d40-438f-8caa-2fb692cc937b tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:32.295346 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-95c3741e-3d40-438f-8caa-2fb692cc937b tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:32.336061 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-95c3741e-3d40-438f-8caa-2fb692cc937b tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] [instance: 55ba9ec4-90f4-4ded-b6ad-bc806de38256] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:23:32.419153 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=6 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:32.620974 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7cc0e862-dc95-441a-ab26-99d9fc010fc6 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e23e3096f740508e6fb6626a29336f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5e20978d1a4886b04d37eef4c23d1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:32.635158 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7cc0e862-dc95-441a-ab26-99d9fc010fc6 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] 10.222.0.13 "GET /compute/v2.1/servers/3b6bf22e-53a4-481d-8764-d6a4b9c95d3e" status: 200 len: 1401 microversion: 2.1 time: 0.625508 Oct 30 01:23:32.637483 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1238/2490] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:32 2022] GET /compute/v2.1/servers/3b6bf22e-53a4-481d-8764-d6a4b9c95d3e => generated 1401 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:32.657186 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8cbc145c-2b02-4a0e-9112-39bae07c06ae tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:32.658059 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8cbc145c-2b02-4a0e-9112-39bae07c06ae tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] [instance: 81251939-4cb0-4e30-828c-648f5a48888e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:32.677944 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8cbc145c-2b02-4a0e-9112-39bae07c06ae tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:32.679949 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8cbc145c-2b02-4a0e-9112-39bae07c06ae tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:32.684411 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8cbc145c-2b02-4a0e-9112-39bae07c06ae tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:32.685360 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8cbc145c-2b02-4a0e-9112-39bae07c06ae tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:32.689167 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8cbc145c-2b02-4a0e-9112-39bae07c06ae tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:32.690046 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8cbc145c-2b02-4a0e-9112-39bae07c06ae tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:32.735862 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-8cbc145c-2b02-4a0e-9112-39bae07c06ae tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] HTTP exception thrown: Instance 81251939-4cb0-4e30-828c-648f5a48888e could not be found. Oct 30 01:23:32.738564 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8cbc145c-2b02-4a0e-9112-39bae07c06ae tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Request method failure captured: Oct 30 01:23:32.738564 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/81251939-4cb0-4e30-828c-648f5a48888e HTTP/1.1 Oct 30 01:23:32.738564 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:23:32.738564 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:23:32.738564 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:23:32.738564 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:23:32.738564 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:23:32.738564 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:23:32.738564 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:23:32.738564 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:23:32.738564 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdHSJyYe2LQmpJGDpAuH6oijHeoDT5sarvvnYYjVihbFqV_GCaS1tTgRlAOosNzKOnotz-LHdlv0fY7gRz28FWNunXxQpW0q__OQUJm-J87BrpgoPlajglSEBf7KTCwja8RaN0_s8w2XjyG-8Vul-e76vQ6agD8cJtnQMZAlfG8Ap0M Oct 30 01:23:32.738564 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:23:32.738564 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:23:32.738564 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:23:32.738564 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:23:32.738564 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:23:32.738564 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:23:32.738564 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 4cd1868480e44540be85a8c2862cd780 Oct 30 01:23:32.738564 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ListServersNegativeTestJSON-529840825 Oct 30 01:23:32.738564 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:23:32.738564 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:23:32.739728 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4cd1868480e44540be85a8c2862cd780"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4cd1868480e44540be85a8c2862cd780"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4cd1868480e44540be85a8c2862cd780"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4cd1868480e44540be85a8c2862cd780"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:23:32.739728 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ListServersNegativeTestJSON-529840825 Oct 30 01:23:32.739728 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 4cd1868480e44540be85a8c2862cd780 Oct 30 01:23:32.739728 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-529840825 Oct 30 01:23:32.739728 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ListServersNegativeTestJSON-529840825-project Oct 30 01:23:32.739728 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:23:32.739728 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:23:32.739728 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 055b96d1eb20418d96450efde939e020 Oct 30 01:23:32.739728 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ListServersNegativeTestJSON-529840825-project Oct 30 01:23:32.739728 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:23:32.739728 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 81251939-4cb0-4e30-828c-648f5a48888e could not be found. Oct 30 01:23:32.739728 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '81251939-4cb0-4e30-828c-648f5a48888e'} Oct 30 01:23:32.740409 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:23:32.740409 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:23:32.740409 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:23:32.740409 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:23:32.740409 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:23:32.740409 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:23:32.740409 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:23:32.740409 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:23:32.740409 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:23:32.740409 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:23:32.740409 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81251939-4cb0-4e30-828c-648f5a48888e could not be found. Oct 30 01:23:32.740409 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:23:32.740409 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:23:32.740409 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:23:32.740409 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:23:32.740409 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:23:32.740409 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:23:32.740409 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:23:32.740409 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:23:32.740409 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:23:32.741545 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:23:32.741545 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:23:32.741545 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:23:32.741545 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:23:32.741545 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:23:32.741545 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:23:32.741545 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:23:32.741545 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81251939-4cb0-4e30-828c-648f5a48888e could not be found. Oct 30 01:23:32.741545 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:23:32.741545 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:23:32.741545 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:23:32.741545 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:23:32.741545 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:23:32.741545 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:23:32.741545 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:23:32.741545 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:23:32.741545 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81251939-4cb0-4e30-828c-648f5a48888e could not be found. Oct 30 01:23:32.741545 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:23:32.744005 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8cbc145c-2b02-4a0e-9112-39bae07c06ae tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] Returning 404 to user: Instance 81251939-4cb0-4e30-828c-648f5a48888e could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:23:32.747231 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-95c3741e-3d40-438f-8caa-2fb692cc937b tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] 10.222.0.13 "DELETE /compute/v2.1/servers/55ba9ec4-90f4-4ded-b6ad-bc806de38256" status: 204 len: 0 microversion: 2.1 time: 0.490933 Oct 30 01:23:32.748365 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1253/2491] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:23:32 2022] DELETE /compute/v2.1/servers/55ba9ec4-90f4-4ded-b6ad-bc806de38256 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:23:32.750125 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8cbc145c-2b02-4a0e-9112-39bae07c06ae tempest-ListServersNegativeTestJSON-529840825 tempest-ListServersNegativeTestJSON-529840825-project] 10.222.0.13 "GET /compute/v2.1/servers/81251939-4cb0-4e30-828c-648f5a48888e" status: 404 len: 111 microversion: 2.1 time: 0.108981 Oct 30 01:23:32.752463 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1239/2492] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:32 2022] GET /compute/v2.1/servers/81251939-4cb0-4e30-828c-648f5a48888e => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:23:32.759117 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-85000b8d-260f-41d1-bed0-69c06fa8f202 req-f74ff5ce-9492-4375-a75a-e2fe90998477 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b6bf22e-53a4-481d-8764-d6a4b9c95d3e", "tag": "e352aa9c-6a08-4d25-ade5-2bdc70668051"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:23:32.768777 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ea86230f-85b1-4714-a52b-55796ea019f7 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44d04845e0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:32.785059 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-85000b8d-260f-41d1-bed0-69c06fa8f202 req-f74ff5ce-9492-4375-a75a-e2fe90998477 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:32.785608 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-85000b8d-260f-41d1-bed0-69c06fa8f202 req-f74ff5ce-9492-4375-a75a-e2fe90998477 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:32.786047 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-85000b8d-260f-41d1-bed0-69c06fa8f202 req-f74ff5ce-9492-4375-a75a-e2fe90998477 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:32.821478 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-85000b8d-260f-41d1-bed0-69c06fa8f202 req-f74ff5ce-9492-4375-a75a-e2fe90998477 service nova] Creating event network-changed:e352aa9c-6a08-4d25-ade5-2bdc70668051 for instance 3b6bf22e-53a4-481d-8764-d6a4b9c95d3e on n-h2-master-1 Oct 30 01:23:32.829438 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-85000b8d-260f-41d1-bed0-69c06fa8f202 req-f74ff5ce-9492-4375-a75a-e2fe90998477 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079596 Oct 30 01:23:32.830702 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1254/2493] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:23:32.847578 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d752695f-6f3d-45d2-bb89-860f4c6b0e12 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:32.849516 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d752695f-6f3d-45d2-bb89-860f4c6b0e12 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] [instance: 55ba9ec4-90f4-4ded-b6ad-bc806de38256] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:32.866541 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d752695f-6f3d-45d2-bb89-860f4c6b0e12 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:32.868967 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d752695f-6f3d-45d2-bb89-860f4c6b0e12 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:32.869817 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d752695f-6f3d-45d2-bb89-860f4c6b0e12 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:32.871326 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d752695f-6f3d-45d2-bb89-860f4c6b0e12 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:32.875320 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d752695f-6f3d-45d2-bb89-860f4c6b0e12 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:32.876067 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d752695f-6f3d-45d2-bb89-860f4c6b0e12 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:33.452709 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d752695f-6f3d-45d2-bb89-860f4c6b0e12 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8011ce402b41ca9d3972a7a2a02cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071a4f9e348b484795cea54316963a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:33.465321 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d752695f-6f3d-45d2-bb89-860f4c6b0e12 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] 10.222.0.13 "GET /compute/v2.1/servers/55ba9ec4-90f4-4ded-b6ad-bc806de38256" status: 200 len: 1469 microversion: 2.1 time: 0.632529 Oct 30 01:23:33.466689 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1255/2494] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:32 2022] GET /compute/v2.1/servers/55ba9ec4-90f4-4ded-b6ad-bc806de38256 => generated 1469 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:33.475509 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-aaa13f2e-59da-46d3-8b64-c1c527efd879 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:33.476358 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-aaa13f2e-59da-46d3-8b64-c1c527efd879 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7f629426-c4e6-4c3f-8e54-efd452d14dd7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:33.483708 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aaa13f2e-59da-46d3-8b64-c1c527efd879 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:33.484394 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aaa13f2e-59da-46d3-8b64-c1c527efd879 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:33.484976 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aaa13f2e-59da-46d3-8b64-c1c527efd879 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:33.485854 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aaa13f2e-59da-46d3-8b64-c1c527efd879 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:33.486476 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aaa13f2e-59da-46d3-8b64-c1c527efd879 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:33.487091 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aaa13f2e-59da-46d3-8b64-c1c527efd879 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:33.929721 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-aaa13f2e-59da-46d3-8b64-c1c527efd879 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:33.938471 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-aaa13f2e-59da-46d3-8b64-c1c527efd879 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7" status: 200 len: 1505 microversion: 2.1 time: 0.470168 Oct 30 01:23:33.939170 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1256/2495] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:33 2022] GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7 => generated 1505 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:33.944023 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bf9de8f3-cc0f-444f-8ddf-f050f5dfa9dd tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:33.944638 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bf9de8f3-cc0f-444f-8ddf-f050f5dfa9dd tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] [instance: dcb34439-de04-4a9c-b81b-7fb2360af99c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:33.952663 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bf9de8f3-cc0f-444f-8ddf-f050f5dfa9dd tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:33.953847 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bf9de8f3-cc0f-444f-8ddf-f050f5dfa9dd tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:33.955679 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bf9de8f3-cc0f-444f-8ddf-f050f5dfa9dd tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:33.957003 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bf9de8f3-cc0f-444f-8ddf-f050f5dfa9dd tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:33.957762 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bf9de8f3-cc0f-444f-8ddf-f050f5dfa9dd tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:33.958544 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bf9de8f3-cc0f-444f-8ddf-f050f5dfa9dd tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:34.144958 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bf9de8f3-cc0f-444f-8ddf-f050f5dfa9dd tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94448bbc2f4a4efaa86792f1511ff15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342baf2538340e292e44dfc622b86fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:34.162685 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bf9de8f3-cc0f-444f-8ddf-f050f5dfa9dd tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] 10.222.0.13 "GET /compute/v2.1/servers/dcb34439-de04-4a9c-b81b-7fb2360af99c" status: 200 len: 1303 microversion: 2.1 time: 0.222229 Oct 30 01:23:34.163800 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1257/2496] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:33 2022] GET /compute/v2.1/servers/dcb34439-de04-4a9c-b81b-7fb2360af99c => generated 1303 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:34.169087 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-320ee767-0b7d-4d4f-a357-6b35f9806349 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:34.169777 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-320ee767-0b7d-4d4f-a357-6b35f9806349 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] [instance: 3b6bf22e-53a4-481d-8764-d6a4b9c95d3e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:34.192516 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-320ee767-0b7d-4d4f-a357-6b35f9806349 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:34.192754 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-320ee767-0b7d-4d4f-a357-6b35f9806349 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:34.193203 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-320ee767-0b7d-4d4f-a357-6b35f9806349 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:34.203805 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-320ee767-0b7d-4d4f-a357-6b35f9806349 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:34.204508 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-320ee767-0b7d-4d4f-a357-6b35f9806349 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:34.206574 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-320ee767-0b7d-4d4f-a357-6b35f9806349 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:35.824359 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-320ee767-0b7d-4d4f-a357-6b35f9806349 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e23e3096f740508e6fb6626a29336f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5e20978d1a4886b04d37eef4c23d1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:35.845249 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-320ee767-0b7d-4d4f-a357-6b35f9806349 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] 10.222.0.13 "GET /compute/v2.1/servers/3b6bf22e-53a4-481d-8764-d6a4b9c95d3e" status: 200 len: 1401 microversion: 2.1 time: 1.675652 Oct 30 01:23:35.848111 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1258/2497] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:34 2022] GET /compute/v2.1/servers/3b6bf22e-53a4-481d-8764-d6a4b9c95d3e => generated 1401 bytes in 1683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:35.862727 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-85cc50e3-c22e-4e2b-a5b5-0e3b780c5145 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:35.863739 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-85cc50e3-c22e-4e2b-a5b5-0e3b780c5145 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] [instance: 55ba9ec4-90f4-4ded-b6ad-bc806de38256] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:35.878115 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-85cc50e3-c22e-4e2b-a5b5-0e3b780c5145 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:35.881295 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-85cc50e3-c22e-4e2b-a5b5-0e3b780c5145 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:35.882056 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-85cc50e3-c22e-4e2b-a5b5-0e3b780c5145 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:35.883034 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-85cc50e3-c22e-4e2b-a5b5-0e3b780c5145 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:35.885528 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-85cc50e3-c22e-4e2b-a5b5-0e3b780c5145 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:35.889510 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-85cc50e3-c22e-4e2b-a5b5-0e3b780c5145 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:36.460955 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:37.885534 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-85cc50e3-c22e-4e2b-a5b5-0e3b780c5145 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8011ce402b41ca9d3972a7a2a02cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071a4f9e348b484795cea54316963a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:37.913531 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-85cc50e3-c22e-4e2b-a5b5-0e3b780c5145 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] 10.222.0.13 "GET /compute/v2.1/servers/55ba9ec4-90f4-4ded-b6ad-bc806de38256" status: 200 len: 1469 microversion: 2.1 time: 2.048856 Oct 30 01:23:37.913531 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1259/2498] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:35 2022] GET /compute/v2.1/servers/55ba9ec4-90f4-4ded-b6ad-bc806de38256 => generated 1469 bytes in 2061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:37.926102 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-869e5e26-3e3f-4815-bcf6-1038f69d07b0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:37.926993 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-869e5e26-3e3f-4815-bcf6-1038f69d07b0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7f629426-c4e6-4c3f-8e54-efd452d14dd7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:37.954961 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-869e5e26-3e3f-4815-bcf6-1038f69d07b0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:37.955743 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-869e5e26-3e3f-4815-bcf6-1038f69d07b0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:37.957532 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-869e5e26-3e3f-4815-bcf6-1038f69d07b0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:37.958626 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-869e5e26-3e3f-4815-bcf6-1038f69d07b0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:37.962171 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-869e5e26-3e3f-4815-bcf6-1038f69d07b0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:37.963947 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-869e5e26-3e3f-4815-bcf6-1038f69d07b0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:38.662197 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=7 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:39.142905 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-869e5e26-3e3f-4815-bcf6-1038f69d07b0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:39.152220 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-869e5e26-3e3f-4815-bcf6-1038f69d07b0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7" status: 200 len: 1508 microversion: 2.1 time: 1.239780 Oct 30 01:23:39.157003 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1260/2499] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:37 2022] GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7 => generated 1508 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:39.166982 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-aefe55e9-3094-437a-9c8c-528387d11894 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:39.176357 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-aefe55e9-3094-437a-9c8c-528387d11894 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] [instance: dcb34439-de04-4a9c-b81b-7fb2360af99c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:39.194567 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aefe55e9-3094-437a-9c8c-528387d11894 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:39.204865 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aefe55e9-3094-437a-9c8c-528387d11894 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:39.205773 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aefe55e9-3094-437a-9c8c-528387d11894 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:39.207520 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aefe55e9-3094-437a-9c8c-528387d11894 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:39.210421 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aefe55e9-3094-437a-9c8c-528387d11894 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:39.212366 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aefe55e9-3094-437a-9c8c-528387d11894 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:39.278651 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:40.366983 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-aefe55e9-3094-437a-9c8c-528387d11894 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94448bbc2f4a4efaa86792f1511ff15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342baf2538340e292e44dfc622b86fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:40.379382 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-aefe55e9-3094-437a-9c8c-528387d11894 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] 10.222.0.13 "GET /compute/v2.1/servers/dcb34439-de04-4a9c-b81b-7fb2360af99c" status: 200 len: 1371 microversion: 2.1 time: 1.220288 Oct 30 01:23:40.383512 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1261/2500] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:39 2022] GET /compute/v2.1/servers/dcb34439-de04-4a9c-b81b-7fb2360af99c => generated 1371 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:40.392868 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b8684ac5-a67d-4878-829d-0b718ac4389c tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:40.397584 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b8684ac5-a67d-4878-829d-0b718ac4389c tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] [instance: 3b6bf22e-53a4-481d-8764-d6a4b9c95d3e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:40.411253 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b8684ac5-a67d-4878-829d-0b718ac4389c tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:40.412038 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b8684ac5-a67d-4878-829d-0b718ac4389c tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:40.413121 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b8684ac5-a67d-4878-829d-0b718ac4389c tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:40.418804 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b8684ac5-a67d-4878-829d-0b718ac4389c tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:40.419588 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b8684ac5-a67d-4878-829d-0b718ac4389c tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:40.420810 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b8684ac5-a67d-4878-829d-0b718ac4389c tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:41.042314 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b8684ac5-a67d-4878-829d-0b718ac4389c tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e23e3096f740508e6fb6626a29336f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5e20978d1a4886b04d37eef4c23d1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:41.073198 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b8684ac5-a67d-4878-829d-0b718ac4389c tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] 10.222.0.13 "GET /compute/v2.1/servers/3b6bf22e-53a4-481d-8764-d6a4b9c95d3e" status: 200 len: 1401 microversion: 2.1 time: 0.685387 Oct 30 01:23:41.077942 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1262/2501] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:40 2022] GET /compute/v2.1/servers/3b6bf22e-53a4-481d-8764-d6a4b9c95d3e => generated 1401 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:41.094910 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-1b4490aa-064e-456f-9a30-b1448fa41a59 req-c3fdb0f8-7a22-4822-9f5c-dd0b10c90a66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b6bf22e-53a4-481d-8764-d6a4b9c95d3e", "name": "network-vif-plugged", "status": "completed", "tag": "e352aa9c-6a08-4d25-ade5-2bdc70668051"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:23:41.129856 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-1b4490aa-064e-456f-9a30-b1448fa41a59 req-c3fdb0f8-7a22-4822-9f5c-dd0b10c90a66 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:41.134642 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-1b4490aa-064e-456f-9a30-b1448fa41a59 req-c3fdb0f8-7a22-4822-9f5c-dd0b10c90a66 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:41.136311 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-1b4490aa-064e-456f-9a30-b1448fa41a59 req-c3fdb0f8-7a22-4822-9f5c-dd0b10c90a66 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:41.182201 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-1b4490aa-064e-456f-9a30-b1448fa41a59 req-c3fdb0f8-7a22-4822-9f5c-dd0b10c90a66 service nova] Creating event network-vif-plugged:e352aa9c-6a08-4d25-ade5-2bdc70668051 for instance 3b6bf22e-53a4-481d-8764-d6a4b9c95d3e on n-h2-master-1 Oct 30 01:23:41.206560 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-1b4490aa-064e-456f-9a30-b1448fa41a59 req-c3fdb0f8-7a22-4822-9f5c-dd0b10c90a66 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118154 Oct 30 01:23:41.210072 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1263/2502] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:23:41.254322 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bce18104-5dbf-4805-8a93-34b123471447 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:41.262182 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bce18104-5dbf-4805-8a93-34b123471447 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] [instance: 55ba9ec4-90f4-4ded-b6ad-bc806de38256] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:41.295729 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bce18104-5dbf-4805-8a93-34b123471447 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:41.303004 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bce18104-5dbf-4805-8a93-34b123471447 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:41.304624 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bce18104-5dbf-4805-8a93-34b123471447 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:41.308496 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bce18104-5dbf-4805-8a93-34b123471447 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:41.313531 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bce18104-5dbf-4805-8a93-34b123471447 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:41.314287 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bce18104-5dbf-4805-8a93-34b123471447 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:41.412508 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bce18104-5dbf-4805-8a93-34b123471447 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:41.413797 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bce18104-5dbf-4805-8a93-34b123471447 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:41.414485 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bce18104-5dbf-4805-8a93-34b123471447 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:41.415583 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-bce18104-5dbf-4805-8a93-34b123471447 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Lazy-loading 'fault' on Instance uuid 55ba9ec4-90f4-4ded-b6ad-bc806de38256 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:23:41.717779 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bce18104-5dbf-4805-8a93-34b123471447 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8011ce402b41ca9d3972a7a2a02cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071a4f9e348b484795cea54316963a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:41.728943 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bce18104-5dbf-4805-8a93-34b123471447 tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] 10.222.0.13 "GET /compute/v2.1/servers/55ba9ec4-90f4-4ded-b6ad-bc806de38256" status: 200 len: 1303 microversion: 2.1 time: 0.516389 Oct 30 01:23:41.730166 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1264/2503] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:41 2022] GET /compute/v2.1/servers/55ba9ec4-90f4-4ded-b6ad-bc806de38256 => generated 1303 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:41.738296 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-622fa2ea-cb4b-41dc-8a54-6980ed42dd41 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:41.745393 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-622fa2ea-cb4b-41dc-8a54-6980ed42dd41 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7f629426-c4e6-4c3f-8e54-efd452d14dd7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:41.753921 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-622fa2ea-cb4b-41dc-8a54-6980ed42dd41 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:41.756723 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-622fa2ea-cb4b-41dc-8a54-6980ed42dd41 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:41.759290 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-622fa2ea-cb4b-41dc-8a54-6980ed42dd41 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:41.760415 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-622fa2ea-cb4b-41dc-8a54-6980ed42dd41 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:41.761819 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-622fa2ea-cb4b-41dc-8a54-6980ed42dd41 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:41.764751 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-622fa2ea-cb4b-41dc-8a54-6980ed42dd41 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:41.838686 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-622fa2ea-cb4b-41dc-8a54-6980ed42dd41 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7f629426-c4e6-4c3f-8e54-efd452d14dd7] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:23:41.858127 n-d-master-1 devstack@n-api.service[121102]: INFO nova.compute.api [None req-622fa2ea-cb4b-41dc-8a54-6980ed42dd41 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7f629426-c4e6-4c3f-8e54-efd452d14dd7] Working on deleting snapshot 2e82c35c-bdde-411a-bb7c-3167f43d6447 from shelved instance... Oct 30 01:23:41.978472 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=5 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:42.676677 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:42.703136 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:51.753769 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:51.845508 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=24 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:52.842536 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ea86230f-85b1-4714-a52b-55796ea019f7 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/82fe897f-65b0-4444-8047-364cc9b70689" status: 200 len: 1421 microversion: 2.1 time: 20.087406 Oct 30 01:23:52.856988 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1240/2504] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:23:32 2022] GET /compute/v2.1/images/82fe897f-65b0-4444-8047-364cc9b70689 => generated 1421 bytes in 20103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:52.862450 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-0e037416-10ee-4be1-b1c5-27c0bd0f6ede req-44bc320a-df73-44d6-9af1-36ca368f2cc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55ba9ec4-90f4-4ded-b6ad-bc806de38256", "name": "network-vif-deleted", "tag": "6a9261d9-b077-4bf1-9f81-8aaa59fd35eb"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:23:52.874217 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-0e037416-10ee-4be1-b1c5-27c0bd0f6ede req-44bc320a-df73-44d6-9af1-36ca368f2cc2 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:52.874704 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-0e037416-10ee-4be1-b1c5-27c0bd0f6ede req-44bc320a-df73-44d6-9af1-36ca368f2cc2 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:52.875300 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-0e037416-10ee-4be1-b1c5-27c0bd0f6ede req-44bc320a-df73-44d6-9af1-36ca368f2cc2 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:52.898869 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-0e037416-10ee-4be1-b1c5-27c0bd0f6ede req-44bc320a-df73-44d6-9af1-36ca368f2cc2 service nova] Creating event network-vif-deleted:6a9261d9-b077-4bf1-9f81-8aaa59fd35eb for instance 55ba9ec4-90f4-4ded-b6ad-bc806de38256 on n-h2-master-1 Oct 30 01:23:52.904630 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-0e037416-10ee-4be1-b1c5-27c0bd0f6ede req-44bc320a-df73-44d6-9af1-36ca368f2cc2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046354 Oct 30 01:23:52.905224 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1241/2505] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:23:52.910896 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6a69066b-24de-4414-8561-bf934b0f2089 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:52.911590 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6a69066b-24de-4414-8561-bf934b0f2089 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] [instance: dcb34439-de04-4a9c-b81b-7fb2360af99c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:52.917784 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a69066b-24de-4414-8561-bf934b0f2089 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:52.918266 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a69066b-24de-4414-8561-bf934b0f2089 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:52.918703 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a69066b-24de-4414-8561-bf934b0f2089 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:52.919384 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a69066b-24de-4414-8561-bf934b0f2089 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:52.919834 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a69066b-24de-4414-8561-bf934b0f2089 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:52.920254 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a69066b-24de-4414-8561-bf934b0f2089 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:53.064168 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6a69066b-24de-4414-8561-bf934b0f2089 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94448bbc2f4a4efaa86792f1511ff15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342baf2538340e292e44dfc622b86fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:53.072943 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6a69066b-24de-4414-8561-bf934b0f2089 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] 10.222.0.13 "GET /compute/v2.1/servers/dcb34439-de04-4a9c-b81b-7fb2360af99c" status: 200 len: 1371 microversion: 2.1 time: 0.165842 Oct 30 01:23:53.074612 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1242/2506] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:52 2022] GET /compute/v2.1/servers/dcb34439-de04-4a9c-b81b-7fb2360af99c => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:53.079312 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-24cf3e0f-3b31-4128-96ca-0e42d9637dc9 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:53.080029 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-24cf3e0f-3b31-4128-96ca-0e42d9637dc9 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] [instance: 3b6bf22e-53a4-481d-8764-d6a4b9c95d3e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:53.086288 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-24cf3e0f-3b31-4128-96ca-0e42d9637dc9 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:53.086788 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-24cf3e0f-3b31-4128-96ca-0e42d9637dc9 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:53.087215 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-24cf3e0f-3b31-4128-96ca-0e42d9637dc9 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:53.087921 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-24cf3e0f-3b31-4128-96ca-0e42d9637dc9 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:53.088373 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-24cf3e0f-3b31-4128-96ca-0e42d9637dc9 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:53.088831 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-24cf3e0f-3b31-4128-96ca-0e42d9637dc9 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:53.406664 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-24cf3e0f-3b31-4128-96ca-0e42d9637dc9 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e23e3096f740508e6fb6626a29336f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5e20978d1a4886b04d37eef4c23d1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:53.416327 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-24cf3e0f-3b31-4128-96ca-0e42d9637dc9 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] 10.222.0.13 "GET /compute/v2.1/servers/3b6bf22e-53a4-481d-8764-d6a4b9c95d3e" status: 200 len: 1587 microversion: 2.1 time: 0.340640 Oct 30 01:23:53.416989 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1243/2507] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:53 2022] GET /compute/v2.1/servers/3b6bf22e-53a4-481d-8764-d6a4b9c95d3e => generated 1587 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:53.440738 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-961c7c2c-3f84-4444-8194-683be4313dbb tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:53.441649 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-961c7c2c-3f84-4444-8194-683be4313dbb tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] [instance: 55ba9ec4-90f4-4ded-b6ad-bc806de38256] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:53.449134 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-961c7c2c-3f84-4444-8194-683be4313dbb tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:53.449911 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-961c7c2c-3f84-4444-8194-683be4313dbb tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:53.450461 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-961c7c2c-3f84-4444-8194-683be4313dbb tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:53.451269 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-961c7c2c-3f84-4444-8194-683be4313dbb tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:53.451945 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-961c7c2c-3f84-4444-8194-683be4313dbb tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:53.452490 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-961c7c2c-3f84-4444-8194-683be4313dbb tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:53.470749 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-961c7c2c-3f84-4444-8194-683be4313dbb tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] HTTP exception thrown: Instance 55ba9ec4-90f4-4ded-b6ad-bc806de38256 could not be found. Oct 30 01:23:53.473131 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-961c7c2c-3f84-4444-8194-683be4313dbb tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Request method failure captured: Oct 30 01:23:53.473131 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/55ba9ec4-90f4-4ded-b6ad-bc806de38256 HTTP/1.1 Oct 30 01:23:53.473131 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:23:53.473131 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:23:53.473131 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:23:53.473131 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:23:53.473131 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:23:53.473131 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:23:53.473131 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:23:53.473131 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:23:53.473131 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdH7WlufdlpmOf_dxLnqLlDrfYVHfCB20T3uCD5tCuf4635pPuKNq_LUQ-Nnh5GbJ5ZKbR49TDN3dh9yuKQsJVwR9pV5a8-eke9KYRAahWTXmTRiwBvbYvLW6jGcQLzLgngAp8XcPdVA6NmPeLxIYWu2_v57cGYtwUBzshkpifAAWII Oct 30 01:23:53.473131 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:23:53.473131 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:23:53.473131 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:23:53.473131 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:23:53.473131 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:23:53.473131 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:23:53.473131 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 071a4f9e348b484795cea54316963a62 Oct 30 01:23:53.473131 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-TenantUsagesTestJSON-817505052 Oct 30 01:23:53.473131 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:23:53.473131 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:23:53.474385 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/071a4f9e348b484795cea54316963a62"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_071a4f9e348b484795cea54316963a62"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/071a4f9e348b484795cea54316963a62"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/071a4f9e348b484795cea54316963a62"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:23:53.474385 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-TenantUsagesTestJSON-817505052 Oct 30 01:23:53.474385 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 071a4f9e348b484795cea54316963a62 Oct 30 01:23:53.474385 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-TenantUsagesTestJSON-817505052 Oct 30 01:23:53.474385 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-TenantUsagesTestJSON-817505052-project Oct 30 01:23:53.474385 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:23:53.474385 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:23:53.474385 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: ab8011ce402b41ca9d3972a7a2a02cad Oct 30 01:23:53.474385 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-TenantUsagesTestJSON-817505052-project Oct 30 01:23:53.474385 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:23:53.474385 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 55ba9ec4-90f4-4ded-b6ad-bc806de38256 could not be found. Oct 30 01:23:53.474385 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '55ba9ec4-90f4-4ded-b6ad-bc806de38256'} Oct 30 01:23:53.475103 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:23:53.475103 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:23:53.475103 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:23:53.475103 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:23:53.475103 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:23:53.475103 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:23:53.475103 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:23:53.475103 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:23:53.475103 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:23:53.475103 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:23:53.475103 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55ba9ec4-90f4-4ded-b6ad-bc806de38256 could not be found. Oct 30 01:23:53.475103 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:23:53.475103 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:23:53.475103 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:23:53.475103 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:23:53.475103 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:23:53.475103 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:23:53.475103 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:23:53.475103 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:23:53.475103 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:23:53.476232 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:23:53.476232 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:23:53.476232 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:23:53.476232 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:23:53.476232 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:23:53.476232 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:23:53.476232 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:23:53.476232 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55ba9ec4-90f4-4ded-b6ad-bc806de38256 could not be found. Oct 30 01:23:53.476232 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:23:53.476232 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:23:53.476232 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:23:53.476232 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:23:53.476232 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:23:53.476232 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:23:53.476232 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:23:53.476232 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:23:53.476232 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55ba9ec4-90f4-4ded-b6ad-bc806de38256 could not be found. Oct 30 01:23:53.476232 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:23:53.478755 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-961c7c2c-3f84-4444-8194-683be4313dbb tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] Returning 404 to user: Instance 55ba9ec4-90f4-4ded-b6ad-bc806de38256 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:23:53.480373 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-961c7c2c-3f84-4444-8194-683be4313dbb tempest-TenantUsagesTestJSON-817505052 tempest-TenantUsagesTestJSON-817505052-project] 10.222.0.13 "GET /compute/v2.1/servers/55ba9ec4-90f4-4ded-b6ad-bc806de38256" status: 404 len: 111 microversion: 2.1 time: 0.051930 Oct 30 01:23:53.485838 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1244/2508] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:53 2022] GET /compute/v2.1/servers/55ba9ec4-90f4-4ded-b6ad-bc806de38256 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:23:53.491991 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-7b9b4595-2c8f-4011-985e-910c863c75a9 req-07a44fe2-82f5-46ab-b7ea-d7b8143aedfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcb34439-de04-4a9c-b81b-7fb2360af99c", "tag": "aba33ea4-cd46-4a87-a95b-e95a41b80f08"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:23:53.504650 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-7b9b4595-2c8f-4011-985e-910c863c75a9 req-07a44fe2-82f5-46ab-b7ea-d7b8143aedfd service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:53.505423 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-7b9b4595-2c8f-4011-985e-910c863c75a9 req-07a44fe2-82f5-46ab-b7ea-d7b8143aedfd service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:53.506122 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-7b9b4595-2c8f-4011-985e-910c863c75a9 req-07a44fe2-82f5-46ab-b7ea-d7b8143aedfd service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:53.529365 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-7b9b4595-2c8f-4011-985e-910c863c75a9 req-07a44fe2-82f5-46ab-b7ea-d7b8143aedfd service nova] Creating event network-changed:aba33ea4-cd46-4a87-a95b-e95a41b80f08 for instance dcb34439-de04-4a9c-b81b-7fb2360af99c on n-h1-master-1 Oct 30 01:23:53.540289 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-7b9b4595-2c8f-4011-985e-910c863c75a9 req-07a44fe2-82f5-46ab-b7ea-d7b8143aedfd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051776 Oct 30 01:23:53.541158 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1245/2509] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:23:53.662936 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-622fa2ea-cb4b-41dc-8a54-6980ed42dd41 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7f629426-c4e6-4c3f-8e54-efd452d14dd7] Doing local delete in cell 7a264aef-b8bb-4843-8958-43bc38c25cb0(cell1) {{(pid=121102) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 30 01:23:53.664303 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-622fa2ea-cb4b-41dc-8a54-6980ed42dd41 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:53.664782 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-622fa2ea-cb4b-41dc-8a54-6980ed42dd41 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:53.665217 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-622fa2ea-cb4b-41dc-8a54-6980ed42dd41 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:53.665663 n-d-master-1 devstack@n-api.service[121102]: INFO nova.compute.api [None req-622fa2ea-cb4b-41dc-8a54-6980ed42dd41 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7f629426-c4e6-4c3f-8e54-efd452d14dd7] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 30 01:23:53.670023 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-622fa2ea-cb4b-41dc-8a54-6980ed42dd41 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7f629426-c4e6-4c3f-8e54-efd452d14dd7] deallocate_for_instance() {{(pid=121102) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 30 01:23:53.740141 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f84b6aea-eedb-4d81-aa4c-e21499471ff7 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-104657528", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "3e8bdef0-4815-4ad6-a6bf-6429286b8c3e"}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:23:53.811928 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-f84b6aea-eedb-4d81-aa4c-e21499471ff7 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] validate_networks() for [('3e8bdef0-4815-4ad6-a6bf-6429286b8c3e', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:23:55.519213 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-f84b6aea-eedb-4d81-aa4c-e21499471ff7 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:23:55.520427 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-f84b6aea-eedb-4d81-aa4c-e21499471ff7 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:23:55.521602 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-f84b6aea-eedb-4d81-aa4c-e21499471ff7 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:23:55.522199 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-f84b6aea-eedb-4d81-aa4c-e21499471ff7 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:23:55.522600 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-f84b6aea-eedb-4d81-aa4c-e21499471ff7 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:23:55.544430 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f84b6aea-eedb-4d81-aa4c-e21499471ff7 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:55.545201 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f84b6aea-eedb-4d81-aa4c-e21499471ff7 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:55.545664 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f84b6aea-eedb-4d81-aa4c-e21499471ff7 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:55.546397 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f84b6aea-eedb-4d81-aa4c-e21499471ff7 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:55.546849 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f84b6aea-eedb-4d81-aa4c-e21499471ff7 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:55.547271 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f84b6aea-eedb-4d81-aa4c-e21499471ff7 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:55.570249 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-f84b6aea-eedb-4d81-aa4c-e21499471ff7 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Getting quotas for project 0e4747ca082b4a9b82bb64c9ea2ec750. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:23:55.576918 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-f84b6aea-eedb-4d81-aa4c-e21499471ff7 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Getting quotas for user 9cb216afb20940ce9cc86b2d1faab962 and project 0e4747ca082b4a9b82bb64c9ea2ec750. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:23:55.591018 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f84b6aea-eedb-4d81-aa4c-e21499471ff7 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:23:55.593508 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f84b6aea-eedb-4d81-aa4c-e21499471ff7 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] [instance: 9bd44e90-60a5-4f4d-ae27-a7dffcb3503e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:23:55.753812 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f84b6aea-eedb-4d81-aa4c-e21499471ff7 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.207147 Oct 30 01:23:55.755082 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1246/2510] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:23:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2213 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:23:55.767490 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8c331a4b-1e6d-4b6f-8c2d-b1e08693601b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44d0484550>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:55.866519 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8c331a4b-1e6d-4b6f-8c2d-b1e08693601b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/82fe897f-65b0-4444-8047-364cc9b70689" status: 200 len: 1421 microversion: 2.1 time: 0.109276 Oct 30 01:23:55.872104 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1247/2511] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:23:55 2022] GET /compute/v2.1/images/82fe897f-65b0-4444-8047-364cc9b70689 => generated 1421 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:55.875775 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8d0c7abc-5605-483a-a930-8b9d11b3ccda tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:55.876452 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8d0c7abc-5605-483a-a930-8b9d11b3ccda tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] [instance: 3b6bf22e-53a4-481d-8764-d6a4b9c95d3e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:55.884569 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8d0c7abc-5605-483a-a930-8b9d11b3ccda tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:55.885308 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8d0c7abc-5605-483a-a930-8b9d11b3ccda tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:55.886157 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8d0c7abc-5605-483a-a930-8b9d11b3ccda tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:55.887037 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8d0c7abc-5605-483a-a930-8b9d11b3ccda tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:55.887809 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8d0c7abc-5605-483a-a930-8b9d11b3ccda tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:55.888413 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8d0c7abc-5605-483a-a930-8b9d11b3ccda tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:56.019503 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-622fa2ea-cb4b-41dc-8a54-6980ed42dd41 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7f629426-c4e6-4c3f-8e54-efd452d14dd7] Updating instance_info_cache with network_info: [] {{(pid=121102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 30 01:23:56.079097 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8d0c7abc-5605-483a-a930-8b9d11b3ccda tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] 10.222.0.13 "GET /compute/v2.1/servers/3b6bf22e-53a4-481d-8764-d6a4b9c95d3e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.209879 Oct 30 01:23:56.081374 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1248/2512] 10.222.0.13 () {58 vars in 1275 bytes} [Sun Oct 30 01:23:55 2022] GET /compute/v2.1/servers/3b6bf22e-53a4-481d-8764-d6a4b9c95d3e/os-interface => generated 284 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:23:56.086333 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-22798da9-10a7-4e98-88be-ab58adaa8b44 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:56.088624 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-22798da9-10a7-4e98-88be-ab58adaa8b44 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] [instance: dcb34439-de04-4a9c-b81b-7fb2360af99c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:56.101426 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22798da9-10a7-4e98-88be-ab58adaa8b44 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:56.101922 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22798da9-10a7-4e98-88be-ab58adaa8b44 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:56.102354 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22798da9-10a7-4e98-88be-ab58adaa8b44 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:56.106065 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22798da9-10a7-4e98-88be-ab58adaa8b44 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:56.106874 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22798da9-10a7-4e98-88be-ab58adaa8b44 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:56.109873 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22798da9-10a7-4e98-88be-ab58adaa8b44 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:56.556756 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-22798da9-10a7-4e98-88be-ab58adaa8b44 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94448bbc2f4a4efaa86792f1511ff15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342baf2538340e292e44dfc622b86fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:56.565367 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-22798da9-10a7-4e98-88be-ab58adaa8b44 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] 10.222.0.13 "GET /compute/v2.1/servers/dcb34439-de04-4a9c-b81b-7fb2360af99c" status: 200 len: 1371 microversion: 2.1 time: 0.482879 Oct 30 01:23:56.577838 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1249/2513] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:56 2022] GET /compute/v2.1/servers/dcb34439-de04-4a9c-b81b-7fb2360af99c => generated 1371 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:56.596217 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b312b9ac-7193-45eb-90ac-c6ea9b58b433 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:56.596217 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b312b9ac-7193-45eb-90ac-c6ea9b58b433 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] [instance: 9bd44e90-60a5-4f4d-ae27-a7dffcb3503e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:56.657718 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b312b9ac-7193-45eb-90ac-c6ea9b58b433 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb216afb20940ce9cc86b2d1faab962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4747ca082b4a9b82bb64c9ea2ec750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:56.666768 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b312b9ac-7193-45eb-90ac-c6ea9b58b433 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] 10.222.0.13 "GET /compute/v2.1/servers/9bd44e90-60a5-4f4d-ae27-a7dffcb3503e" status: 200 len: 1231 microversion: 2.1 time: 0.087745 Oct 30 01:23:56.670148 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1250/2514] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:56 2022] GET /compute/v2.1/servers/9bd44e90-60a5-4f4d-ae27-a7dffcb3503e => generated 1231 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:56.750812 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-622fa2ea-cb4b-41dc-8a54-6980ed42dd41 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7" status: 204 len: 0 microversion: 2.1 time: 15.019247 Oct 30 01:23:56.757623 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1265/2515] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:23:41 2022] DELETE /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7 => generated 0 bytes in 15021 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:23:56.763392 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ea73bd0c-5f36-425a-b076-2f8d9ed596ae tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44c76b9700>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:56.839957 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-e946e7ef-53a1-40b8-9728-90aecd359e8b req-409e021e-a802-4142-90ac-d1b99ded2d9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f629426-c4e6-4c3f-8e54-efd452d14dd7", "name": "network-vif-deleted", "tag": "0be1ebe4-f222-4d74-8298-cd63a4bc397c"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:23:56.860693 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e946e7ef-53a1-40b8-9728-90aecd359e8b req-409e021e-a802-4142-90ac-d1b99ded2d9e service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:56.861319 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e946e7ef-53a1-40b8-9728-90aecd359e8b req-409e021e-a802-4142-90ac-d1b99ded2d9e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:56.861897 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e946e7ef-53a1-40b8-9728-90aecd359e8b req-409e021e-a802-4142-90ac-d1b99ded2d9e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:56.892096 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.compute.server_external_events [req-e946e7ef-53a1-40b8-9728-90aecd359e8b req-409e021e-a802-4142-90ac-d1b99ded2d9e service nova] Unable to find a host for instance 7f629426-c4e6-4c3f-8e54-efd452d14dd7. Dropping event network-vif-deleted {{(pid=121103) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 30 01:23:56.898668 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-e946e7ef-53a1-40b8-9728-90aecd359e8b req-409e021e-a802-4142-90ac-d1b99ded2d9e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.224797 Oct 30 01:23:56.899613 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1251/2516] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:23:56 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 229 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 30 01:23:56.909844 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-95689865-61ed-4c59-9eaa-03a2ca0eaa75 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:56.912832 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-95689865-61ed-4c59-9eaa-03a2ca0eaa75 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7f629426-c4e6-4c3f-8e54-efd452d14dd7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:56.926047 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-95689865-61ed-4c59-9eaa-03a2ca0eaa75 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:56.929499 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-95689865-61ed-4c59-9eaa-03a2ca0eaa75 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:56.930167 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-95689865-61ed-4c59-9eaa-03a2ca0eaa75 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:56.932355 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-95689865-61ed-4c59-9eaa-03a2ca0eaa75 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:56.935202 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-95689865-61ed-4c59-9eaa-03a2ca0eaa75 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:56.937680 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-95689865-61ed-4c59-9eaa-03a2ca0eaa75 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:56.997221 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-95689865-61ed-4c59-9eaa-03a2ca0eaa75 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] HTTP exception thrown: Instance 7f629426-c4e6-4c3f-8e54-efd452d14dd7 could not be found. Oct 30 01:23:57.004900 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-95689865-61ed-4c59-9eaa-03a2ca0eaa75 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Request method failure captured: Oct 30 01:23:57.004900 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7 HTTP/1.1 Oct 30 01:23:57.004900 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:23:57.004900 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:23:57.004900 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:23:57.004900 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:23:57.004900 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:23:57.004900 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:23:57.004900 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:23:57.004900 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:23:57.004900 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdEZHAwNEyYVN8mbZetD1IgknrDb-nJfmTHtgPgtOr9AeQL99EuTYclSviV8aikzXcemJ-XkTVClxHn6U4xG48gAdXZcIs0fYa7Kdvvi7PzFjDxYMfOtgAp7wAvvVW7kd-J_XMzQX3yJBWm7NW5-QhmguztBnHz9UniQWs2CmNftHaI Oct 30 01:23:57.004900 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:23:57.004900 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:23:57.004900 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:23:57.004900 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:23:57.004900 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:23:57.004900 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:23:57.004900 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 8c95e97cd7e4461682b9028abb568dce Oct 30 01:23:57.004900 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:23:57.004900 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:23:57.004900 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:23:57.006152 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:23:57.006152 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:23:57.006152 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 8c95e97cd7e4461682b9028abb568dce Oct 30 01:23:57.006152 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:23:57.006152 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-DeleteServersTestJSON-1379968241-project Oct 30 01:23:57.006152 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:23:57.006152 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:23:57.006152 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 33691c943ec040ddb04b6648b6e945ab Oct 30 01:23:57.006152 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-DeleteServersTestJSON-1379968241-project Oct 30 01:23:57.006152 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:23:57.006152 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 7f629426-c4e6-4c3f-8e54-efd452d14dd7 could not be found. Oct 30 01:23:57.006152 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '7f629426-c4e6-4c3f-8e54-efd452d14dd7'} Oct 30 01:23:57.006846 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:23:57.006846 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:23:57.006846 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:23:57.006846 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:23:57.006846 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:23:57.006846 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:23:57.006846 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:23:57.006846 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:23:57.006846 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:23:57.006846 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:23:57.006846 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f629426-c4e6-4c3f-8e54-efd452d14dd7 could not be found. Oct 30 01:23:57.006846 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:23:57.006846 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:23:57.006846 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:23:57.006846 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:23:57.006846 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:23:57.006846 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:23:57.006846 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:23:57.006846 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:23:57.006846 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:23:57.007950 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:23:57.007950 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:23:57.007950 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:23:57.007950 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:23:57.007950 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:23:57.007950 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:23:57.007950 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:23:57.007950 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f629426-c4e6-4c3f-8e54-efd452d14dd7 could not be found. Oct 30 01:23:57.007950 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:23:57.007950 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:23:57.007950 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:23:57.007950 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:23:57.007950 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:23:57.007950 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:23:57.007950 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:23:57.007950 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:23:57.007950 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f629426-c4e6-4c3f-8e54-efd452d14dd7 could not be found. Oct 30 01:23:57.007950 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:23:57.015120 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-95689865-61ed-4c59-9eaa-03a2ca0eaa75 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Returning 404 to user: Instance 7f629426-c4e6-4c3f-8e54-efd452d14dd7 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:23:57.019078 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-95689865-61ed-4c59-9eaa-03a2ca0eaa75 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7" status: 404 len: 111 microversion: 2.1 time: 0.117309 Oct 30 01:23:57.025513 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1252/2517] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:56 2022] GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:23:57.255857 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-481e0add-4c78-40b7-9ffb-14ce2e4c7676 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-534999687", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "19e0e4e2-b502-4a02-810a-996c246e8c64"}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:23:57.395398 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-481e0add-4c78-40b7-9ffb-14ce2e4c7676 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] validate_networks() for [('19e0e4e2-b502-4a02-810a-996c246e8c64', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:23:58.332996 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-481e0add-4c78-40b7-9ffb-14ce2e4c7676 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:23:58.334925 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-481e0add-4c78-40b7-9ffb-14ce2e4c7676 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:23:58.336344 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-481e0add-4c78-40b7-9ffb-14ce2e4c7676 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:23:58.336918 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-481e0add-4c78-40b7-9ffb-14ce2e4c7676 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:23:58.338467 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-481e0add-4c78-40b7-9ffb-14ce2e4c7676 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:23:58.364058 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-481e0add-4c78-40b7-9ffb-14ce2e4c7676 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:58.372054 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-481e0add-4c78-40b7-9ffb-14ce2e4c7676 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:58.372054 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-481e0add-4c78-40b7-9ffb-14ce2e4c7676 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:58.381978 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-481e0add-4c78-40b7-9ffb-14ce2e4c7676 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:58.384096 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-481e0add-4c78-40b7-9ffb-14ce2e4c7676 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:58.384744 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-481e0add-4c78-40b7-9ffb-14ce2e4c7676 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:58.442001 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-481e0add-4c78-40b7-9ffb-14ce2e4c7676 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Getting quotas for project 8c95e97cd7e4461682b9028abb568dce. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:23:58.452050 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-481e0add-4c78-40b7-9ffb-14ce2e4c7676 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Getting quotas for user 33691c943ec040ddb04b6648b6e945ab and project 8c95e97cd7e4461682b9028abb568dce. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:23:58.468649 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-481e0add-4c78-40b7-9ffb-14ce2e4c7676 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:23:58.471553 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-481e0add-4c78-40b7-9ffb-14ce2e4c7676 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 32c70d3f-96cd-4b23-a743-05aed245baf0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:23:58.654574 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-481e0add-4c78-40b7-9ffb-14ce2e4c7676 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.402611 Oct 30 01:23:58.655588 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1253/2518] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:23:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1404 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:23:58.661245 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f1d0507b-74a5-44fe-870c-c108f949c782 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:58.662200 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f1d0507b-74a5-44fe-870c-c108f949c782 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] [instance: dcb34439-de04-4a9c-b81b-7fb2360af99c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:58.675944 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f1d0507b-74a5-44fe-870c-c108f949c782 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:58.676924 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f1d0507b-74a5-44fe-870c-c108f949c782 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:58.677739 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f1d0507b-74a5-44fe-870c-c108f949c782 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:58.678726 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f1d0507b-74a5-44fe-870c-c108f949c782 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:58.680164 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f1d0507b-74a5-44fe-870c-c108f949c782 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:58.680881 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f1d0507b-74a5-44fe-870c-c108f949c782 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:58.781707 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ea73bd0c-5f36-425a-b076-2f8d9ed596ae tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "DELETE /compute/v2.1/images/82fe897f-65b0-4444-8047-364cc9b70689" status: 204 len: 0 microversion: 2.1 time: 2.025868 Oct 30 01:23:58.782949 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1266/2519] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:56 2022] DELETE /compute/v2.1/images/82fe897f-65b0-4444-8047-364cc9b70689 => generated 0 bytes in 2031 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:23:58.792325 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6b787b50-0eb4-42c7-abb2-380ff7ff69b7 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:58.793171 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6b787b50-0eb4-42c7-abb2-380ff7ff69b7 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] [instance: 9bd44e90-60a5-4f4d-ae27-a7dffcb3503e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:58.809374 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b787b50-0eb4-42c7-abb2-380ff7ff69b7 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:58.810350 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b787b50-0eb4-42c7-abb2-380ff7ff69b7 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:58.812219 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b787b50-0eb4-42c7-abb2-380ff7ff69b7 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:58.813131 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b787b50-0eb4-42c7-abb2-380ff7ff69b7 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:58.816521 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b787b50-0eb4-42c7-abb2-380ff7ff69b7 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:58.817205 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b787b50-0eb4-42c7-abb2-380ff7ff69b7 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:58.981782 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6b787b50-0eb4-42c7-abb2-380ff7ff69b7 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb216afb20940ce9cc86b2d1faab962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4747ca082b4a9b82bb64c9ea2ec750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:58.995408 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6b787b50-0eb4-42c7-abb2-380ff7ff69b7 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] 10.222.0.13 "GET /compute/v2.1/servers/9bd44e90-60a5-4f4d-ae27-a7dffcb3503e" status: 200 len: 1283 microversion: 2.1 time: 0.210572 Oct 30 01:23:58.997284 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1267/2520] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:58 2022] GET /compute/v2.1/servers/9bd44e90-60a5-4f4d-ae27-a7dffcb3503e => generated 1283 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:59.006212 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-3a5f0ef5-cf48-4f58-adac-ecb6efe4d6dd req-6517ce0b-8d85-47b0-aafa-bea81d380153 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3faeee3-0724-417b-8575-ac8e59663103", "name": "network-vif-unplugged", "status": "completed", "tag": "f422e3db-4c59-447a-b83c-3fe06b9aefaa"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:23:59.037017 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-3a5f0ef5-cf48-4f58-adac-ecb6efe4d6dd req-6517ce0b-8d85-47b0-aafa-bea81d380153 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:59.037017 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-3a5f0ef5-cf48-4f58-adac-ecb6efe4d6dd req-6517ce0b-8d85-47b0-aafa-bea81d380153 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:59.037268 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-3a5f0ef5-cf48-4f58-adac-ecb6efe4d6dd req-6517ce0b-8d85-47b0-aafa-bea81d380153 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:59.054098 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-3a5f0ef5-cf48-4f58-adac-ecb6efe4d6dd req-6517ce0b-8d85-47b0-aafa-bea81d380153 service nova] Creating event network-vif-unplugged:f422e3db-4c59-447a-b83c-3fe06b9aefaa for instance e3faeee3-0724-417b-8575-ac8e59663103 on n-h1-master-1 Oct 30 01:23:59.061248 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-3a5f0ef5-cf48-4f58-adac-ecb6efe4d6dd req-6517ce0b-8d85-47b0-aafa-bea81d380153 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059019 Oct 30 01:23:59.061917 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1268/2521] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:23:59.068948 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a6a3d92d-a0a4-48f8-a2d2-1a4e05360fd7 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:59.070322 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a6a3d92d-a0a4-48f8-a2d2-1a4e05360fd7 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 32c70d3f-96cd-4b23-a743-05aed245baf0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:59.212808 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a6a3d92d-a0a4-48f8-a2d2-1a4e05360fd7 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:59.223645 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a6a3d92d-a0a4-48f8-a2d2-1a4e05360fd7 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0" status: 200 len: 1214 microversion: 2.1 time: 0.157919 Oct 30 01:23:59.225321 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1269/2522] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:59 2022] GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0 => generated 1214 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:59.239128 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-697b35f7-f509-47b6-b93b-bf329ca6a954 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:59.240825 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-697b35f7-f509-47b6-b93b-bf329ca6a954 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: e3faeee3-0724-417b-8575-ac8e59663103] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:59.260401 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-697b35f7-f509-47b6-b93b-bf329ca6a954 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:59.260401 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-697b35f7-f509-47b6-b93b-bf329ca6a954 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:59.260697 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-697b35f7-f509-47b6-b93b-bf329ca6a954 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:59.262422 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-697b35f7-f509-47b6-b93b-bf329ca6a954 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:59.264010 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-697b35f7-f509-47b6-b93b-bf329ca6a954 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:59.264563 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-697b35f7-f509-47b6-b93b-bf329ca6a954 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:59.267195 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f1d0507b-74a5-44fe-870c-c108f949c782 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94448bbc2f4a4efaa86792f1511ff15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342baf2538340e292e44dfc622b86fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:23:59.278420 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f1d0507b-74a5-44fe-870c-c108f949c782 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] 10.222.0.13 "GET /compute/v2.1/servers/dcb34439-de04-4a9c-b81b-7fb2360af99c" status: 200 len: 1371 microversion: 2.1 time: 0.621535 Oct 30 01:23:59.279031 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1254/2523] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:58 2022] GET /compute/v2.1/servers/dcb34439-de04-4a9c-b81b-7fb2360af99c => generated 1371 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:23:59.335742 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-697b35f7-f509-47b6-b93b-bf329ca6a954 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: e3faeee3-0724-417b-8575-ac8e59663103] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:23:59.719475 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-697b35f7-f509-47b6-b93b-bf329ca6a954 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e3faeee3-0724-417b-8575-ac8e59663103" status: 204 len: 0 microversion: 2.1 time: 0.485211 Oct 30 01:23:59.722227 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1270/2524] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:23:59 2022] DELETE /compute/v2.1/servers/e3faeee3-0724-417b-8575-ac8e59663103 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:23:59.791081 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-15ccfeed-a39d-4322-9651-da857b84c221 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:23:59.797207 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-15ccfeed-a39d-4322-9651-da857b84c221 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] [instance: 3b6bf22e-53a4-481d-8764-d6a4b9c95d3e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:23:59.806641 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-15ccfeed-a39d-4322-9651-da857b84c221 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:59.807134 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-15ccfeed-a39d-4322-9651-da857b84c221 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:59.809843 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-15ccfeed-a39d-4322-9651-da857b84c221 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:59.810621 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-15ccfeed-a39d-4322-9651-da857b84c221 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:59.811092 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-15ccfeed-a39d-4322-9651-da857b84c221 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:59.814378 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-15ccfeed-a39d-4322-9651-da857b84c221 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:59.862120 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-e2211d9d-0c72-4a16-9ee7-c26b01454d51 req-1cb4cf87-768d-49a7-8364-af5f136a04d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b6bf22e-53a4-481d-8764-d6a4b9c95d3e", "tag": "e352aa9c-6a08-4d25-ade5-2bdc70668051"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:23:59.893437 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-e2211d9d-0c72-4a16-9ee7-c26b01454d51 req-1cb4cf87-768d-49a7-8364-af5f136a04d5 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:23:59.894141 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-e2211d9d-0c72-4a16-9ee7-c26b01454d51 req-1cb4cf87-768d-49a7-8364-af5f136a04d5 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:23:59.894861 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-e2211d9d-0c72-4a16-9ee7-c26b01454d51 req-1cb4cf87-768d-49a7-8364-af5f136a04d5 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:23:59.914732 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-e2211d9d-0c72-4a16-9ee7-c26b01454d51 req-1cb4cf87-768d-49a7-8364-af5f136a04d5 service nova] Creating event network-changed:e352aa9c-6a08-4d25-ade5-2bdc70668051 for instance 3b6bf22e-53a4-481d-8764-d6a4b9c95d3e on n-h2-master-1 Oct 30 01:23:59.922969 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-e2211d9d-0c72-4a16-9ee7-c26b01454d51 req-1cb4cf87-768d-49a7-8364-af5f136a04d5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066192 Oct 30 01:23:59.923834 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1271/2525] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:24:00.025912 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e4f3c645-34eb-4b2f-ae30-62bb52f27472 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:00.027463 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e4f3c645-34eb-4b2f-ae30-62bb52f27472 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] [instance: 9bd44e90-60a5-4f4d-ae27-a7dffcb3503e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:00.090659 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e4f3c645-34eb-4b2f-ae30-62bb52f27472 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:00.091115 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e4f3c645-34eb-4b2f-ae30-62bb52f27472 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:00.091563 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e4f3c645-34eb-4b2f-ae30-62bb52f27472 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:00.092286 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e4f3c645-34eb-4b2f-ae30-62bb52f27472 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:00.103236 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e4f3c645-34eb-4b2f-ae30-62bb52f27472 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:00.104068 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e4f3c645-34eb-4b2f-ae30-62bb52f27472 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:00.234554 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-15ccfeed-a39d-4322-9651-da857b84c221 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e23e3096f740508e6fb6626a29336f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5e20978d1a4886b04d37eef4c23d1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:00.251355 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-15ccfeed-a39d-4322-9651-da857b84c221 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] 10.222.0.13 "GET /compute/v2.1/servers/3b6bf22e-53a4-481d-8764-d6a4b9c95d3e" status: 200 len: 1587 microversion: 2.1 time: 0.465402 Oct 30 01:24:00.254744 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1255/2526] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:23:59 2022] GET /compute/v2.1/servers/3b6bf22e-53a4-481d-8764-d6a4b9c95d3e => generated 1587 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:00.266079 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6752fc8e-f693-4094-b10a-900c4d6afa42 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-971828204", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "e006438e-aba1-46be-a97a-88a3153fb746"}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:24:00.322095 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e4f3c645-34eb-4b2f-ae30-62bb52f27472 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb216afb20940ce9cc86b2d1faab962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4747ca082b4a9b82bb64c9ea2ec750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:00.335705 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e4f3c645-34eb-4b2f-ae30-62bb52f27472 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] 10.222.0.13 "GET /compute/v2.1/servers/9bd44e90-60a5-4f4d-ae27-a7dffcb3503e" status: 200 len: 1289 microversion: 2.1 time: 0.315317 Oct 30 01:24:00.354608 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1272/2527] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:00 2022] GET /compute/v2.1/servers/9bd44e90-60a5-4f4d-ae27-a7dffcb3503e => generated 1289 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:24:00.367293 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c42bb1fa-9c42-4c5c-9acb-71c72e6bc54e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:00.367940 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-6752fc8e-f693-4094-b10a-900c4d6afa42 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] validate_networks() for [('e006438e-aba1-46be-a97a-88a3153fb746', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:24:00.369015 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c42bb1fa-9c42-4c5c-9acb-71c72e6bc54e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 32c70d3f-96cd-4b23-a743-05aed245baf0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:00.383894 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c42bb1fa-9c42-4c5c-9acb-71c72e6bc54e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:00.384631 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c42bb1fa-9c42-4c5c-9acb-71c72e6bc54e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:00.385237 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c42bb1fa-9c42-4c5c-9acb-71c72e6bc54e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:00.387773 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c42bb1fa-9c42-4c5c-9acb-71c72e6bc54e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:00.390944 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c42bb1fa-9c42-4c5c-9acb-71c72e6bc54e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:00.391591 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c42bb1fa-9c42-4c5c-9acb-71c72e6bc54e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:00.568117 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c42bb1fa-9c42-4c5c-9acb-71c72e6bc54e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:00.581729 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c42bb1fa-9c42-4c5c-9acb-71c72e6bc54e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0" status: 200 len: 1218 microversion: 2.1 time: 0.224382 Oct 30 01:24:00.582473 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1273/2528] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:00 2022] GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0 => generated 1218 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:00.602661 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5d141fc0-e460-467d-80bb-6ed8d0efb3cb tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:00.603388 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5d141fc0-e460-467d-80bb-6ed8d0efb3cb tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] [instance: dcb34439-de04-4a9c-b81b-7fb2360af99c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:00.621049 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5d141fc0-e460-467d-80bb-6ed8d0efb3cb tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:00.622019 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5d141fc0-e460-467d-80bb-6ed8d0efb3cb tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:00.625130 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5d141fc0-e460-467d-80bb-6ed8d0efb3cb tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:00.626632 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5d141fc0-e460-467d-80bb-6ed8d0efb3cb tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:00.630324 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5d141fc0-e460-467d-80bb-6ed8d0efb3cb tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:00.630872 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5d141fc0-e460-467d-80bb-6ed8d0efb3cb tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:01.442756 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5d141fc0-e460-467d-80bb-6ed8d0efb3cb tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94448bbc2f4a4efaa86792f1511ff15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342baf2538340e292e44dfc622b86fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:01.468653 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5d141fc0-e460-467d-80bb-6ed8d0efb3cb tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] 10.222.0.13 "GET /compute/v2.1/servers/dcb34439-de04-4a9c-b81b-7fb2360af99c" status: 200 len: 1371 microversion: 2.1 time: 0.877979 Oct 30 01:24:01.471861 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1274/2529] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:00 2022] GET /compute/v2.1/servers/dcb34439-de04-4a9c-b81b-7fb2360af99c => generated 1371 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:01.490796 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-9c1be250-e930-45f7-a1f3-3d456d6d8d30 req-0d99cb4b-cb58-4997-93f0-ed7f03eb4c88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcb34439-de04-4a9c-b81b-7fb2360af99c", "name": "network-vif-plugged", "status": "completed", "tag": "aba33ea4-cd46-4a87-a95b-e95a41b80f08"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:24:01.520439 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-9c1be250-e930-45f7-a1f3-3d456d6d8d30 req-0d99cb4b-cb58-4997-93f0-ed7f03eb4c88 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:01.521235 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-9c1be250-e930-45f7-a1f3-3d456d6d8d30 req-0d99cb4b-cb58-4997-93f0-ed7f03eb4c88 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:01.522321 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-9c1be250-e930-45f7-a1f3-3d456d6d8d30 req-0d99cb4b-cb58-4997-93f0-ed7f03eb4c88 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:01.549823 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-9c1be250-e930-45f7-a1f3-3d456d6d8d30 req-0d99cb4b-cb58-4997-93f0-ed7f03eb4c88 service nova] Creating event network-vif-plugged:aba33ea4-cd46-4a87-a95b-e95a41b80f08 for instance dcb34439-de04-4a9c-b81b-7fb2360af99c on n-h1-master-1 Oct 30 01:24:01.556716 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-9c1be250-e930-45f7-a1f3-3d456d6d8d30 req-0d99cb4b-cb58-4997-93f0-ed7f03eb4c88 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083139 Oct 30 01:24:01.558753 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1275/2530] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:24:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:24:01.568116 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1048aef3-f7e0-4be8-9849-43e3a3fdee7c tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:01.568116 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1048aef3-f7e0-4be8-9849-43e3a3fdee7c tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] [instance: 9bd44e90-60a5-4f4d-ae27-a7dffcb3503e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:01.577509 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1048aef3-f7e0-4be8-9849-43e3a3fdee7c tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:01.578334 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1048aef3-f7e0-4be8-9849-43e3a3fdee7c tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:01.579093 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1048aef3-f7e0-4be8-9849-43e3a3fdee7c tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:01.582175 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1048aef3-f7e0-4be8-9849-43e3a3fdee7c tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:01.582982 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1048aef3-f7e0-4be8-9849-43e3a3fdee7c tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:01.583644 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1048aef3-f7e0-4be8-9849-43e3a3fdee7c tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:01.888779 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1048aef3-f7e0-4be8-9849-43e3a3fdee7c tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb216afb20940ce9cc86b2d1faab962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4747ca082b4a9b82bb64c9ea2ec750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:01.897363 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1048aef3-f7e0-4be8-9849-43e3a3fdee7c tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] 10.222.0.13 "GET /compute/v2.1/servers/9bd44e90-60a5-4f4d-ae27-a7dffcb3503e" status: 200 len: 1289 microversion: 2.1 time: 0.337158 Oct 30 01:24:01.906481 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1276/2531] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:01 2022] GET /compute/v2.1/servers/9bd44e90-60a5-4f4d-ae27-a7dffcb3503e => generated 1289 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:01.912484 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ec928b3d-7215-4e4e-81ee-67ebd823280b tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:01.915576 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ec928b3d-7215-4e4e-81ee-67ebd823280b tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 32c70d3f-96cd-4b23-a743-05aed245baf0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:01.925306 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ec928b3d-7215-4e4e-81ee-67ebd823280b tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:01.928777 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ec928b3d-7215-4e4e-81ee-67ebd823280b tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:01.932935 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ec928b3d-7215-4e4e-81ee-67ebd823280b tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:01.933980 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ec928b3d-7215-4e4e-81ee-67ebd823280b tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:01.946098 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ec928b3d-7215-4e4e-81ee-67ebd823280b tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:01.946850 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ec928b3d-7215-4e4e-81ee-67ebd823280b tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:02.208837 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-6752fc8e-f693-4094-b10a-900c4d6afa42 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:24:02.208837 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-6752fc8e-f693-4094-b10a-900c4d6afa42 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:24:02.208837 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-6752fc8e-f693-4094-b10a-900c4d6afa42 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:24:02.208837 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-6752fc8e-f693-4094-b10a-900c4d6afa42 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:24:02.208837 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-6752fc8e-f693-4094-b10a-900c4d6afa42 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:24:02.225229 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6752fc8e-f693-4094-b10a-900c4d6afa42 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:02.225748 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6752fc8e-f693-4094-b10a-900c4d6afa42 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:02.226190 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6752fc8e-f693-4094-b10a-900c4d6afa42 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:02.226909 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6752fc8e-f693-4094-b10a-900c4d6afa42 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:02.227359 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6752fc8e-f693-4094-b10a-900c4d6afa42 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:02.228054 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6752fc8e-f693-4094-b10a-900c4d6afa42 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:02.274791 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-6752fc8e-f693-4094-b10a-900c4d6afa42 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Getting quotas for project 4aa9c648b20d41d7b150fbf64cde6fe8. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:24:02.280756 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-6752fc8e-f693-4094-b10a-900c4d6afa42 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Getting quotas for user f857d6b0826e47c6875a307e7ccfb104 and project 4aa9c648b20d41d7b150fbf64cde6fe8. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:24:02.288969 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ec928b3d-7215-4e4e-81ee-67ebd823280b tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:02.301368 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ec928b3d-7215-4e4e-81ee-67ebd823280b tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0" status: 200 len: 1266 microversion: 2.1 time: 0.393501 Oct 30 01:24:02.301962 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1277/2532] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:01 2022] GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0 => generated 1266 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:02.313216 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6752fc8e-f693-4094-b10a-900c4d6afa42 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:24:02.316531 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6752fc8e-f693-4094-b10a-900c4d6afa42 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: 403e0292-c082-4655-ad08-b5dc3a7f8305] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:24:02.444976 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6752fc8e-f693-4094-b10a-900c4d6afa42 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.188825 Oct 30 01:24:02.453058 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1256/2533] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:24:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2198 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:24:02.458161 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-349fd0f7-f0b2-495d-a9d4-d8217f01d1cf tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:02.458890 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-349fd0f7-f0b2-495d-a9d4-d8217f01d1cf tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: 403e0292-c082-4655-ad08-b5dc3a7f8305] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:02.498302 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2f457c35-e28b-4064-af0b-55e06fca68e5 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:02.499169 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2f457c35-e28b-4064-af0b-55e06fca68e5 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] [instance: dcb34439-de04-4a9c-b81b-7fb2360af99c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:02.520020 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f457c35-e28b-4064-af0b-55e06fca68e5 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:02.520521 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f457c35-e28b-4064-af0b-55e06fca68e5 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:02.520962 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f457c35-e28b-4064-af0b-55e06fca68e5 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:02.521706 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f457c35-e28b-4064-af0b-55e06fca68e5 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:02.522207 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f457c35-e28b-4064-af0b-55e06fca68e5 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:02.522655 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f457c35-e28b-4064-af0b-55e06fca68e5 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:03.125304 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-349fd0f7-f0b2-495d-a9d4-d8217f01d1cf tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:03.141089 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-349fd0f7-f0b2-495d-a9d4-d8217f01d1cf tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305" status: 200 len: 1207 microversion: 2.1 time: 0.686747 Oct 30 01:24:03.145813 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1278/2534] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:02 2022] GET /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305 => generated 1207 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:24:03.175340 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1f3cbe2e-0d7d-409e-bed8-72984b8b9e15 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:03.179317 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1f3cbe2e-0d7d-409e-bed8-72984b8b9e15 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] [instance: 9bd44e90-60a5-4f4d-ae27-a7dffcb3503e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:03.200581 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1f3cbe2e-0d7d-409e-bed8-72984b8b9e15 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:03.201108 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1f3cbe2e-0d7d-409e-bed8-72984b8b9e15 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:03.201650 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1f3cbe2e-0d7d-409e-bed8-72984b8b9e15 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:03.202449 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1f3cbe2e-0d7d-409e-bed8-72984b8b9e15 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:03.202912 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1f3cbe2e-0d7d-409e-bed8-72984b8b9e15 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:03.203341 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1f3cbe2e-0d7d-409e-bed8-72984b8b9e15 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:03.252234 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:24:03.688508 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2f457c35-e28b-4064-af0b-55e06fca68e5 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94448bbc2f4a4efaa86792f1511ff15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342baf2538340e292e44dfc622b86fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:03.706217 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2f457c35-e28b-4064-af0b-55e06fca68e5 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] 10.222.0.13 "GET /compute/v2.1/servers/dcb34439-de04-4a9c-b81b-7fb2360af99c" status: 200 len: 1371 microversion: 2.1 time: 1.213293 Oct 30 01:24:03.707310 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1257/2535] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:02 2022] GET /compute/v2.1/servers/dcb34439-de04-4a9c-b81b-7fb2360af99c => generated 1371 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:24:03.721218 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c2b858b3-e934-4782-9674-fa0572c654ff tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:03.722211 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c2b858b3-e934-4782-9674-fa0572c654ff tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 32c70d3f-96cd-4b23-a743-05aed245baf0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:03.736939 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c2b858b3-e934-4782-9674-fa0572c654ff tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:03.737384 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c2b858b3-e934-4782-9674-fa0572c654ff tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:03.737826 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c2b858b3-e934-4782-9674-fa0572c654ff tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:03.738536 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c2b858b3-e934-4782-9674-fa0572c654ff tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:03.738985 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c2b858b3-e934-4782-9674-fa0572c654ff tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:03.739404 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c2b858b3-e934-4782-9674-fa0572c654ff tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:03.930809 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c2b858b3-e934-4782-9674-fa0572c654ff tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:03.962815 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c2b858b3-e934-4782-9674-fa0572c654ff tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0" status: 200 len: 1284 microversion: 2.1 time: 0.253704 Oct 30 01:24:03.966981 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1258/2536] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:03 2022] GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0 => generated 1284 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:04.067752 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1f3cbe2e-0d7d-409e-bed8-72984b8b9e15 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb216afb20940ce9cc86b2d1faab962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4747ca082b4a9b82bb64c9ea2ec750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:04.076053 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1f3cbe2e-0d7d-409e-bed8-72984b8b9e15 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] 10.222.0.13 "GET /compute/v2.1/servers/9bd44e90-60a5-4f4d-ae27-a7dffcb3503e" status: 200 len: 1331 microversion: 2.1 time: 0.926499 Oct 30 01:24:04.090053 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1279/2537] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:03 2022] GET /compute/v2.1/servers/9bd44e90-60a5-4f4d-ae27-a7dffcb3503e => generated 1331 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:04.168409 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-65fe24ab-1a24-43eb-82c3-6e135afa4957 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:04.169300 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-65fe24ab-1a24-43eb-82c3-6e135afa4957 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: 403e0292-c082-4655-ad08-b5dc3a7f8305] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:04.185799 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-65fe24ab-1a24-43eb-82c3-6e135afa4957 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:04.186570 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-65fe24ab-1a24-43eb-82c3-6e135afa4957 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:04.188162 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-65fe24ab-1a24-43eb-82c3-6e135afa4957 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:04.188162 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-65fe24ab-1a24-43eb-82c3-6e135afa4957 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:04.188772 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-65fe24ab-1a24-43eb-82c3-6e135afa4957 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:04.190178 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-65fe24ab-1a24-43eb-82c3-6e135afa4957 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:04.448226 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-65fe24ab-1a24-43eb-82c3-6e135afa4957 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:04.478393 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-65fe24ab-1a24-43eb-82c3-6e135afa4957 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305" status: 200 len: 1211 microversion: 2.1 time: 0.314760 Oct 30 01:24:04.512514 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1259/2538] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:04 2022] GET /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305 => generated 1211 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:04.678217 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-3bf1a4ac-7e72-4464-89a3-f10a08946366 req-3ababe2a-718f-46ba-9466-e828aede3ced service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3faeee3-0724-417b-8575-ac8e59663103", "name": "network-vif-deleted", "tag": "f422e3db-4c59-447a-b83c-3fe06b9aefaa"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:24:04.742013 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-3bf1a4ac-7e72-4464-89a3-f10a08946366 req-3ababe2a-718f-46ba-9466-e828aede3ced service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:04.743739 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-3bf1a4ac-7e72-4464-89a3-f10a08946366 req-3ababe2a-718f-46ba-9466-e828aede3ced service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:04.746213 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-3bf1a4ac-7e72-4464-89a3-f10a08946366 req-3ababe2a-718f-46ba-9466-e828aede3ced service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:04.781800 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-3bf1a4ac-7e72-4464-89a3-f10a08946366 req-3ababe2a-718f-46ba-9466-e828aede3ced service nova] Creating event network-vif-deleted:f422e3db-4c59-447a-b83c-3fe06b9aefaa for instance e3faeee3-0724-417b-8575-ac8e59663103 on n-h1-master-1 Oct 30 01:24:04.792004 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-3bf1a4ac-7e72-4464-89a3-f10a08946366 req-3ababe2a-718f-46ba-9466-e828aede3ced service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121561 Oct 30 01:24:04.798119 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1260/2539] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:24:04.807101 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c07a5782-ba23-48b9-8b82-192c54c94776 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:04.809254 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c07a5782-ba23-48b9-8b82-192c54c94776 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] [instance: dcb34439-de04-4a9c-b81b-7fb2360af99c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:04.826387 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c07a5782-ba23-48b9-8b82-192c54c94776 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:04.827703 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c07a5782-ba23-48b9-8b82-192c54c94776 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:04.828429 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c07a5782-ba23-48b9-8b82-192c54c94776 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:04.829614 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c07a5782-ba23-48b9-8b82-192c54c94776 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:04.830530 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c07a5782-ba23-48b9-8b82-192c54c94776 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:04.831233 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c07a5782-ba23-48b9-8b82-192c54c94776 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:04.918474 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6d056eb1-a703-49d7-9519-935b5d0b964f tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1413729634", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "5c03f3af-7aba-4524-a504-745ceaba6a41"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:24:05.046590 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-6d056eb1-a703-49d7-9519-935b5d0b964f tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] validate_networks() for [('5c03f3af-7aba-4524-a504-745ceaba6a41', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:24:05.505468 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c07a5782-ba23-48b9-8b82-192c54c94776 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94448bbc2f4a4efaa86792f1511ff15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342baf2538340e292e44dfc622b86fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:05.525916 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c07a5782-ba23-48b9-8b82-192c54c94776 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] 10.222.0.13 "GET /compute/v2.1/servers/dcb34439-de04-4a9c-b81b-7fb2360af99c" status: 200 len: 1557 microversion: 2.1 time: 0.720593 Oct 30 01:24:05.527049 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1261/2540] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:04 2022] GET /compute/v2.1/servers/dcb34439-de04-4a9c-b81b-7fb2360af99c => generated 1557 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:05.573159 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-22bebd59-7921-43ec-9914-baeb88c7997d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:05.574866 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-22bebd59-7921-43ec-9914-baeb88c7997d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 32c70d3f-96cd-4b23-a743-05aed245baf0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:05.601776 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22bebd59-7921-43ec-9914-baeb88c7997d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:05.602669 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22bebd59-7921-43ec-9914-baeb88c7997d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:05.605813 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22bebd59-7921-43ec-9914-baeb88c7997d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:05.607235 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22bebd59-7921-43ec-9914-baeb88c7997d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:05.609314 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22bebd59-7921-43ec-9914-baeb88c7997d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:05.611073 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22bebd59-7921-43ec-9914-baeb88c7997d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:05.865654 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-22bebd59-7921-43ec-9914-baeb88c7997d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:05.886693 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-22bebd59-7921-43ec-9914-baeb88c7997d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0" status: 200 len: 1272 microversion: 2.1 time: 0.356339 Oct 30 01:24:05.903376 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1262/2541] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:05 2022] GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0 => generated 1272 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:05.907288 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f8295f2d-ed73-4dc3-8682-6b6dc63b9090 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:05.907921 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f8295f2d-ed73-4dc3-8682-6b6dc63b9090 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] [instance: 9bd44e90-60a5-4f4d-ae27-a7dffcb3503e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:05.931370 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f8295f2d-ed73-4dc3-8682-6b6dc63b9090 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:05.931928 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f8295f2d-ed73-4dc3-8682-6b6dc63b9090 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:05.932828 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f8295f2d-ed73-4dc3-8682-6b6dc63b9090 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:05.933614 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f8295f2d-ed73-4dc3-8682-6b6dc63b9090 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:05.934076 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f8295f2d-ed73-4dc3-8682-6b6dc63b9090 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:05.934505 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f8295f2d-ed73-4dc3-8682-6b6dc63b9090 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:06.250442 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f8295f2d-ed73-4dc3-8682-6b6dc63b9090 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb216afb20940ce9cc86b2d1faab962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4747ca082b4a9b82bb64c9ea2ec750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:06.290640 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f8295f2d-ed73-4dc3-8682-6b6dc63b9090 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] 10.222.0.13 "GET /compute/v2.1/servers/9bd44e90-60a5-4f4d-ae27-a7dffcb3503e" status: 200 len: 1331 microversion: 2.1 time: 0.387080 Oct 30 01:24:06.292061 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1263/2542] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:05 2022] GET /compute/v2.1/servers/9bd44e90-60a5-4f4d-ae27-a7dffcb3503e => generated 1331 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:06.304252 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8554a1f7-84f7-4279-816b-d1414dfeaaff tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:06.305997 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8554a1f7-84f7-4279-816b-d1414dfeaaff tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: 403e0292-c082-4655-ad08-b5dc3a7f8305] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:06.315987 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8554a1f7-84f7-4279-816b-d1414dfeaaff tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:06.318962 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8554a1f7-84f7-4279-816b-d1414dfeaaff tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:06.319709 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8554a1f7-84f7-4279-816b-d1414dfeaaff tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:06.321325 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8554a1f7-84f7-4279-816b-d1414dfeaaff tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:06.323058 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8554a1f7-84f7-4279-816b-d1414dfeaaff tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:06.324800 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8554a1f7-84f7-4279-816b-d1414dfeaaff tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:06.556987 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8554a1f7-84f7-4279-816b-d1414dfeaaff tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:06.572395 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8554a1f7-84f7-4279-816b-d1414dfeaaff tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305" status: 200 len: 1277 microversion: 2.1 time: 0.276757 Oct 30 01:24:06.595599 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1264/2543] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:06 2022] GET /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305 => generated 1277 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:06.605893 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-54458156-b0db-4aa4-8cc3-f3fbf513f692 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:06.606546 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-54458156-b0db-4aa4-8cc3-f3fbf513f692 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] [instance: dcb34439-de04-4a9c-b81b-7fb2360af99c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:06.618174 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-54458156-b0db-4aa4-8cc3-f3fbf513f692 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:06.623101 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-54458156-b0db-4aa4-8cc3-f3fbf513f692 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:06.623977 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-54458156-b0db-4aa4-8cc3-f3fbf513f692 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:06.631143 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-54458156-b0db-4aa4-8cc3-f3fbf513f692 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:06.631143 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-54458156-b0db-4aa4-8cc3-f3fbf513f692 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:06.631143 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-54458156-b0db-4aa4-8cc3-f3fbf513f692 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:06.683540 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-6d056eb1-a703-49d7-9519-935b5d0b964f tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:24:06.684517 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-6d056eb1-a703-49d7-9519-935b5d0b964f tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:24:06.685317 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-6d056eb1-a703-49d7-9519-935b5d0b964f tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:24:06.686065 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-6d056eb1-a703-49d7-9519-935b5d0b964f tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:24:06.686625 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-6d056eb1-a703-49d7-9519-935b5d0b964f tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:24:06.711911 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d056eb1-a703-49d7-9519-935b5d0b964f tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:06.712413 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d056eb1-a703-49d7-9519-935b5d0b964f tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:06.712860 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d056eb1-a703-49d7-9519-935b5d0b964f tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:06.713609 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d056eb1-a703-49d7-9519-935b5d0b964f tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:06.714879 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d056eb1-a703-49d7-9519-935b5d0b964f tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:06.715339 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d056eb1-a703-49d7-9519-935b5d0b964f tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:06.736077 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-6d056eb1-a703-49d7-9519-935b5d0b964f tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Getting quotas for project 121fd24a0b6b4eb3aa1cac304dda16a0. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:24:06.747740 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-6d056eb1-a703-49d7-9519-935b5d0b964f tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Getting quotas for user e533367cf3fc4e06a96c6add0540b897 and project 121fd24a0b6b4eb3aa1cac304dda16a0. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:24:06.761482 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6d056eb1-a703-49d7-9519-935b5d0b964f tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:24:06.769066 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6d056eb1-a703-49d7-9519-935b5d0b964f tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] [instance: f5fe2000-b4bf-4636-92fc-72e50c7a7a96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:24:06.820596 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-54458156-b0db-4aa4-8cc3-f3fbf513f692 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] 10.222.0.13 "GET /compute/v2.1/servers/dcb34439-de04-4a9c-b81b-7fb2360af99c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.223636 Oct 30 01:24:06.821815 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1265/2544] 10.222.0.13 () {58 vars in 1275 bytes} [Sun Oct 30 01:24:06 2022] GET /compute/v2.1/servers/dcb34439-de04-4a9c-b81b-7fb2360af99c/os-interface => generated 284 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:24:06.829729 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-b877ef7b-0f20-4aa1-9e20-a8caeba78109 req-8e3078b8-8a54-477f-948f-0e4e2c2268ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bd44e90-60a5-4f4d-ae27-a7dffcb3503e", "tag": "d2ed3272-2b5d-4ab4-90e4-02f9832b391e"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:24:06.859767 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-b877ef7b-0f20-4aa1-9e20-a8caeba78109 req-8e3078b8-8a54-477f-948f-0e4e2c2268ec service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:06.860542 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-b877ef7b-0f20-4aa1-9e20-a8caeba78109 req-8e3078b8-8a54-477f-948f-0e4e2c2268ec service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:06.861877 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-b877ef7b-0f20-4aa1-9e20-a8caeba78109 req-8e3078b8-8a54-477f-948f-0e4e2c2268ec service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:06.867188 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=100 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:24:06.884006 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-b877ef7b-0f20-4aa1-9e20-a8caeba78109 req-8e3078b8-8a54-477f-948f-0e4e2c2268ec service nova] Creating event network-changed:d2ed3272-2b5d-4ab4-90e4-02f9832b391e for instance 9bd44e90-60a5-4f4d-ae27-a7dffcb3503e on n-h2-master-1 Oct 30 01:24:06.898811 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-b877ef7b-0f20-4aa1-9e20-a8caeba78109 req-8e3078b8-8a54-477f-948f-0e4e2c2268ec service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074827 Oct 30 01:24:06.900296 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1266/2545] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:24:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:24:06.947107 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1b1d5e64-dad8-4d5d-bd7c-098e3ce7c1be tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:06.950314 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1b1d5e64-dad8-4d5d-bd7c-098e3ce7c1be tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 32c70d3f-96cd-4b23-a743-05aed245baf0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:06.956075 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6d056eb1-a703-49d7-9519-935b5d0b964f tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.377936 Oct 30 01:24:06.957095 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1280/2546] 10.222.0.13 () {62 vars in 1188 bytes} [Sun Oct 30 01:24:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2383 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 30 01:24:06.962214 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1b1d5e64-dad8-4d5d-bd7c-098e3ce7c1be tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:06.962763 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1b1d5e64-dad8-4d5d-bd7c-098e3ce7c1be tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:06.963347 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1b1d5e64-dad8-4d5d-bd7c-098e3ce7c1be tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:06.965024 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1b1d5e64-dad8-4d5d-bd7c-098e3ce7c1be tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:06.968104 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1b1d5e64-dad8-4d5d-bd7c-098e3ce7c1be tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:06.968833 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1b1d5e64-dad8-4d5d-bd7c-098e3ce7c1be tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:06.970667 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bdac3625-c459-4c60-b79c-58f7a53e2011 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:06.972604 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bdac3625-c459-4c60-b79c-58f7a53e2011 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] [instance: f5fe2000-b4bf-4636-92fc-72e50c7a7a96] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:07.252996 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bdac3625-c459-4c60-b79c-58f7a53e2011 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e533367cf3fc4e06a96c6add0540b897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121fd24a0b6b4eb3aa1cac304dda16a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:07.261933 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bdac3625-c459-4c60-b79c-58f7a53e2011 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e533367cf3fc4e06a96c6add0540b897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121fd24a0b6b4eb3aa1cac304dda16a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:07.269495 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bdac3625-c459-4c60-b79c-58f7a53e2011 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e533367cf3fc4e06a96c6add0540b897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121fd24a0b6b4eb3aa1cac304dda16a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:07.270889 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bdac3625-c459-4c60-b79c-58f7a53e2011 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] 10.222.0.13 "GET /compute/v2.1/servers/f5fe2000-b4bf-4636-92fc-72e50c7a7a96" status: 200 len: 1259 microversion: 2.21 time: 0.306142 Oct 30 01:24:07.275735 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1281/2547] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:24:06 2022] GET /compute/v2.1/servers/f5fe2000-b4bf-4636-92fc-72e50c7a7a96 => generated 1259 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:24:07.318153 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f787a3f6-9a36-4f0a-8c56-259a7ba4f546 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:07.321948 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f787a3f6-9a36-4f0a-8c56-259a7ba4f546 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] [instance: 9bd44e90-60a5-4f4d-ae27-a7dffcb3503e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:07.345970 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f787a3f6-9a36-4f0a-8c56-259a7ba4f546 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:07.346464 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f787a3f6-9a36-4f0a-8c56-259a7ba4f546 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:07.347013 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f787a3f6-9a36-4f0a-8c56-259a7ba4f546 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:07.347896 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f787a3f6-9a36-4f0a-8c56-259a7ba4f546 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:07.350033 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f787a3f6-9a36-4f0a-8c56-259a7ba4f546 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:07.350672 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f787a3f6-9a36-4f0a-8c56-259a7ba4f546 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:08.179602 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1b1d5e64-dad8-4d5d-bd7c-098e3ce7c1be tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:08.208791 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1b1d5e64-dad8-4d5d-bd7c-098e3ce7c1be tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0" status: 200 len: 1314 microversion: 2.1 time: 1.295475 Oct 30 01:24:08.210944 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1267/2548] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:06 2022] GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0 => generated 1314 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:08.220960 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-86f1dda2-3e06-4c54-978b-fe25eaaa9983 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:08.222170 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-86f1dda2-3e06-4c54-978b-fe25eaaa9983 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: 403e0292-c082-4655-ad08-b5dc3a7f8305] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:08.244315 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-86f1dda2-3e06-4c54-978b-fe25eaaa9983 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:08.260250 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f787a3f6-9a36-4f0a-8c56-259a7ba4f546 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb216afb20940ce9cc86b2d1faab962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4747ca082b4a9b82bb64c9ea2ec750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:08.269667 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-86f1dda2-3e06-4c54-978b-fe25eaaa9983 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:08.270290 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-86f1dda2-3e06-4c54-978b-fe25eaaa9983 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:08.271112 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-86f1dda2-3e06-4c54-978b-fe25eaaa9983 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:08.272114 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-86f1dda2-3e06-4c54-978b-fe25eaaa9983 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:08.272698 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-86f1dda2-3e06-4c54-978b-fe25eaaa9983 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:08.359359 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f787a3f6-9a36-4f0a-8c56-259a7ba4f546 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] 10.222.0.13 "GET /compute/v2.1/servers/9bd44e90-60a5-4f4d-ae27-a7dffcb3503e" status: 200 len: 1331 microversion: 2.1 time: 1.045748 Oct 30 01:24:08.398641 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1282/2549] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:07 2022] GET /compute/v2.1/servers/9bd44e90-60a5-4f4d-ae27-a7dffcb3503e => generated 1331 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:24:08.405671 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5f57dd45-e7f7-459a-9ab8-a6677a953f60 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:08.406650 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5f57dd45-e7f7-459a-9ab8-a6677a953f60 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] [instance: f5fe2000-b4bf-4636-92fc-72e50c7a7a96] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:08.599334 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5f57dd45-e7f7-459a-9ab8-a6677a953f60 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e533367cf3fc4e06a96c6add0540b897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121fd24a0b6b4eb3aa1cac304dda16a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:08.624297 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5f57dd45-e7f7-459a-9ab8-a6677a953f60 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e533367cf3fc4e06a96c6add0540b897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121fd24a0b6b4eb3aa1cac304dda16a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:08.630722 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5f57dd45-e7f7-459a-9ab8-a6677a953f60 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e533367cf3fc4e06a96c6add0540b897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121fd24a0b6b4eb3aa1cac304dda16a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:08.633556 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5f57dd45-e7f7-459a-9ab8-a6677a953f60 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] 10.222.0.13 "GET /compute/v2.1/servers/f5fe2000-b4bf-4636-92fc-72e50c7a7a96" status: 200 len: 1259 microversion: 2.21 time: 0.232498 Oct 30 01:24:08.636570 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1283/2550] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:24:08 2022] GET /compute/v2.1/servers/f5fe2000-b4bf-4636-92fc-72e50c7a7a96 => generated 1259 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:24:08.985588 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-86f1dda2-3e06-4c54-978b-fe25eaaa9983 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:09.000064 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-86f1dda2-3e06-4c54-978b-fe25eaaa9983 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305" status: 200 len: 1307 microversion: 2.1 time: 0.784506 Oct 30 01:24:09.002798 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1268/2551] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:08 2022] GET /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305 => generated 1307 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:09.234053 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-86df8764-7a3a-4f51-afba-3ed324b1b1fc tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:09.234685 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-86df8764-7a3a-4f51-afba-3ed324b1b1fc tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 32c70d3f-96cd-4b23-a743-05aed245baf0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:09.254592 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86df8764-7a3a-4f51-afba-3ed324b1b1fc tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:09.255164 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86df8764-7a3a-4f51-afba-3ed324b1b1fc tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:09.255703 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86df8764-7a3a-4f51-afba-3ed324b1b1fc tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:09.261731 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86df8764-7a3a-4f51-afba-3ed324b1b1fc tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:09.262313 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86df8764-7a3a-4f51-afba-3ed324b1b1fc tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:09.262538 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86df8764-7a3a-4f51-afba-3ed324b1b1fc tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:09.416582 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ec5d4f74-2228-4248-ab2f-6f145f4bd30e tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:09.418259 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ec5d4f74-2228-4248-ab2f-6f145f4bd30e tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] [instance: 9bd44e90-60a5-4f4d-ae27-a7dffcb3503e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:09.450727 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:24:09.452392 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ec5d4f74-2228-4248-ab2f-6f145f4bd30e tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:09.452895 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ec5d4f74-2228-4248-ab2f-6f145f4bd30e tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:09.453377 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ec5d4f74-2228-4248-ab2f-6f145f4bd30e tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:09.454073 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ec5d4f74-2228-4248-ab2f-6f145f4bd30e tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:09.467916 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ec5d4f74-2228-4248-ab2f-6f145f4bd30e tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:09.470648 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ec5d4f74-2228-4248-ab2f-6f145f4bd30e tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:10.476107 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ec5d4f74-2228-4248-ab2f-6f145f4bd30e tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb216afb20940ce9cc86b2d1faab962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4747ca082b4a9b82bb64c9ea2ec750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:10.491171 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ec5d4f74-2228-4248-ab2f-6f145f4bd30e tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] 10.222.0.13 "GET /compute/v2.1/servers/9bd44e90-60a5-4f4d-ae27-a7dffcb3503e" status: 200 len: 1331 microversion: 2.1 time: 1.078891 Oct 30 01:24:10.491834 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1269/2552] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:09 2022] GET /compute/v2.1/servers/9bd44e90-60a5-4f4d-ae27-a7dffcb3503e => generated 1331 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:24:10.497182 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d9b84cfb-8912-4dee-89f3-b52f94e3e647 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:10.502041 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d9b84cfb-8912-4dee-89f3-b52f94e3e647 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] [instance: f5fe2000-b4bf-4636-92fc-72e50c7a7a96] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:10.512333 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d9b84cfb-8912-4dee-89f3-b52f94e3e647 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:10.513111 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d9b84cfb-8912-4dee-89f3-b52f94e3e647 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:10.513787 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d9b84cfb-8912-4dee-89f3-b52f94e3e647 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:10.515030 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d9b84cfb-8912-4dee-89f3-b52f94e3e647 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:10.515736 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d9b84cfb-8912-4dee-89f3-b52f94e3e647 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:10.516350 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d9b84cfb-8912-4dee-89f3-b52f94e3e647 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:10.651813 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-86df8764-7a3a-4f51-afba-3ed324b1b1fc tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:10.665207 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-86df8764-7a3a-4f51-afba-3ed324b1b1fc tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0" status: 200 len: 1314 microversion: 2.1 time: 1.435311 Oct 30 01:24:10.665908 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1284/2553] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:09 2022] GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0 => generated 1314 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:10.682061 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8d8e9545-9838-42d3-9fbe-0842932dea19 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:10.682771 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8d8e9545-9838-42d3-9fbe-0842932dea19 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: 403e0292-c082-4655-ad08-b5dc3a7f8305] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:10.705569 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d8e9545-9838-42d3-9fbe-0842932dea19 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:10.707915 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d8e9545-9838-42d3-9fbe-0842932dea19 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:10.708449 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d8e9545-9838-42d3-9fbe-0842932dea19 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:10.709275 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d8e9545-9838-42d3-9fbe-0842932dea19 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:10.715260 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d8e9545-9838-42d3-9fbe-0842932dea19 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:10.716795 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d8e9545-9838-42d3-9fbe-0842932dea19 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:10.781567 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d9b84cfb-8912-4dee-89f3-b52f94e3e647 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e533367cf3fc4e06a96c6add0540b897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121fd24a0b6b4eb3aa1cac304dda16a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:10.790811 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d9b84cfb-8912-4dee-89f3-b52f94e3e647 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e533367cf3fc4e06a96c6add0540b897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121fd24a0b6b4eb3aa1cac304dda16a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:10.798048 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d9b84cfb-8912-4dee-89f3-b52f94e3e647 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e533367cf3fc4e06a96c6add0540b897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121fd24a0b6b4eb3aa1cac304dda16a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:10.799319 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d9b84cfb-8912-4dee-89f3-b52f94e3e647 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] 10.222.0.13 "GET /compute/v2.1/servers/f5fe2000-b4bf-4636-92fc-72e50c7a7a96" status: 200 len: 1319 microversion: 2.21 time: 0.306540 Oct 30 01:24:10.801638 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1270/2554] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:24:10 2022] GET /compute/v2.1/servers/f5fe2000-b4bf-4636-92fc-72e50c7a7a96 => generated 1319 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:24:11.253169 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8d8e9545-9838-42d3-9fbe-0842932dea19 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:11.264373 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8d8e9545-9838-42d3-9fbe-0842932dea19 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305" status: 200 len: 1307 microversion: 2.1 time: 0.596392 Oct 30 01:24:11.265100 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1285/2555] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:10 2022] GET /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305 => generated 1307 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:11.516646 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4dd24742-f361-4adf-a4bd-a327b28dd77d tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:11.518062 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4dd24742-f361-4adf-a4bd-a327b28dd77d tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] [instance: 9bd44e90-60a5-4f4d-ae27-a7dffcb3503e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:11.525781 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4dd24742-f361-4adf-a4bd-a327b28dd77d tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:11.526738 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4dd24742-f361-4adf-a4bd-a327b28dd77d tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:11.527399 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4dd24742-f361-4adf-a4bd-a327b28dd77d tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:11.528340 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4dd24742-f361-4adf-a4bd-a327b28dd77d tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:11.529171 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4dd24742-f361-4adf-a4bd-a327b28dd77d tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:11.529857 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4dd24742-f361-4adf-a4bd-a327b28dd77d tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:11.618594 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-d9741a98-f1fc-482e-b6e2-647566c61725 req-d4b9ea3c-200c-441d-842e-6ea6fc571f09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "403e0292-c082-4655-ad08-b5dc3a7f8305", "tag": "ef3e2c7d-b1a5-43dc-a664-896af7f0b0ed"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:24:11.664099 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-d9741a98-f1fc-482e-b6e2-647566c61725 req-d4b9ea3c-200c-441d-842e-6ea6fc571f09 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:11.672504 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-d9741a98-f1fc-482e-b6e2-647566c61725 req-d4b9ea3c-200c-441d-842e-6ea6fc571f09 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:11.674316 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-d9741a98-f1fc-482e-b6e2-647566c61725 req-d4b9ea3c-200c-441d-842e-6ea6fc571f09 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:11.711341 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-d9741a98-f1fc-482e-b6e2-647566c61725 req-d4b9ea3c-200c-441d-842e-6ea6fc571f09 service nova] Creating event network-changed:ef3e2c7d-b1a5-43dc-a664-896af7f0b0ed for instance 403e0292-c082-4655-ad08-b5dc3a7f8305 on n-h2-master-1 Oct 30 01:24:11.723162 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-d9741a98-f1fc-482e-b6e2-647566c61725 req-d4b9ea3c-200c-441d-842e-6ea6fc571f09 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108181 Oct 30 01:24:11.727173 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1286/2556] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:24:11.733232 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0bcaab37-d495-45d1-b7b3-75c6cf503150 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:11.734140 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0bcaab37-d495-45d1-b7b3-75c6cf503150 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 32c70d3f-96cd-4b23-a743-05aed245baf0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:11.740851 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0bcaab37-d495-45d1-b7b3-75c6cf503150 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:11.741364 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0bcaab37-d495-45d1-b7b3-75c6cf503150 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:11.741810 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0bcaab37-d495-45d1-b7b3-75c6cf503150 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:11.752200 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0bcaab37-d495-45d1-b7b3-75c6cf503150 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:11.752921 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0bcaab37-d495-45d1-b7b3-75c6cf503150 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:11.753591 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0bcaab37-d495-45d1-b7b3-75c6cf503150 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:12.006846 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4dd24742-f361-4adf-a4bd-a327b28dd77d tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb216afb20940ce9cc86b2d1faab962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4747ca082b4a9b82bb64c9ea2ec750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:12.019428 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4dd24742-f361-4adf-a4bd-a327b28dd77d tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] 10.222.0.13 "GET /compute/v2.1/servers/9bd44e90-60a5-4f4d-ae27-a7dffcb3503e" status: 200 len: 1331 microversion: 2.1 time: 0.507023 Oct 30 01:24:12.022745 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1271/2557] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:11 2022] GET /compute/v2.1/servers/9bd44e90-60a5-4f4d-ae27-a7dffcb3503e => generated 1331 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:12.035769 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a3193042-e1c9-4807-97e9-e975a8f60ec8 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:12.037992 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a3193042-e1c9-4807-97e9-e975a8f60ec8 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] [instance: f5fe2000-b4bf-4636-92fc-72e50c7a7a96] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:12.051033 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a3193042-e1c9-4807-97e9-e975a8f60ec8 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:12.051528 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a3193042-e1c9-4807-97e9-e975a8f60ec8 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:12.051941 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a3193042-e1c9-4807-97e9-e975a8f60ec8 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:12.059004 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a3193042-e1c9-4807-97e9-e975a8f60ec8 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:12.059669 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a3193042-e1c9-4807-97e9-e975a8f60ec8 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:12.068713 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a3193042-e1c9-4807-97e9-e975a8f60ec8 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:12.224831 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a3193042-e1c9-4807-97e9-e975a8f60ec8 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e533367cf3fc4e06a96c6add0540b897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121fd24a0b6b4eb3aa1cac304dda16a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:12.237836 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a3193042-e1c9-4807-97e9-e975a8f60ec8 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e533367cf3fc4e06a96c6add0540b897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121fd24a0b6b4eb3aa1cac304dda16a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:12.241602 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a3193042-e1c9-4807-97e9-e975a8f60ec8 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e533367cf3fc4e06a96c6add0540b897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121fd24a0b6b4eb3aa1cac304dda16a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:12.243002 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a3193042-e1c9-4807-97e9-e975a8f60ec8 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] 10.222.0.13 "GET /compute/v2.1/servers/f5fe2000-b4bf-4636-92fc-72e50c7a7a96" status: 200 len: 1317 microversion: 2.21 time: 0.218456 Oct 30 01:24:12.244106 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1272/2558] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:24:12 2022] GET /compute/v2.1/servers/f5fe2000-b4bf-4636-92fc-72e50c7a7a96 => generated 1317 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:24:12.260394 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=6 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:24:12.299849 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0bcaab37-d495-45d1-b7b3-75c6cf503150 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:12.307708 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=20 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:24:12.309960 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0bcaab37-d495-45d1-b7b3-75c6cf503150 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0" status: 200 len: 1314 microversion: 2.1 time: 0.581455 Oct 30 01:24:12.311788 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1287/2559] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:11 2022] GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0 => generated 1314 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:12.322753 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-c8b47756-a714-438b-b8c8-c34a10e758ca req-432b8367-5608-4769-bae8-c973da9d1403 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32c70d3f-96cd-4b23-a743-05aed245baf0", "tag": "42309075-0068-4d9c-83fb-f3e5e8e5a63d"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:24:12.333649 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-c8b47756-a714-438b-b8c8-c34a10e758ca req-432b8367-5608-4769-bae8-c973da9d1403 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:12.334488 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-c8b47756-a714-438b-b8c8-c34a10e758ca req-432b8367-5608-4769-bae8-c973da9d1403 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:12.335941 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-c8b47756-a714-438b-b8c8-c34a10e758ca req-432b8367-5608-4769-bae8-c973da9d1403 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:12.358477 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d3b5344a-ec47-4281-8d05-79cfff6d4e17 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1756901899", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "9c3e4699-5176-48ab-a2ba-0807db051e7a"}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:24:12.361271 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-c8b47756-a714-438b-b8c8-c34a10e758ca req-432b8367-5608-4769-bae8-c973da9d1403 service nova] Creating event network-changed:42309075-0068-4d9c-83fb-f3e5e8e5a63d for instance 32c70d3f-96cd-4b23-a743-05aed245baf0 on n-h1-master-1 Oct 30 01:24:12.366744 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-c8b47756-a714-438b-b8c8-c34a10e758ca req-432b8367-5608-4769-bae8-c973da9d1403 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051960 Oct 30 01:24:12.368286 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1288/2560] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:24:12.374720 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a03a2469-b831-462b-8a65-2c09452177af tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:12.376038 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a03a2469-b831-462b-8a65-2c09452177af tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: 403e0292-c082-4655-ad08-b5dc3a7f8305] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:12.384365 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a03a2469-b831-462b-8a65-2c09452177af tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:12.385998 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a03a2469-b831-462b-8a65-2c09452177af tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:12.389356 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a03a2469-b831-462b-8a65-2c09452177af tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:12.390443 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a03a2469-b831-462b-8a65-2c09452177af tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:12.392484 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a03a2469-b831-462b-8a65-2c09452177af tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:12.393051 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a03a2469-b831-462b-8a65-2c09452177af tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:12.464082 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-d3b5344a-ec47-4281-8d05-79cfff6d4e17 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] validate_networks() for [('9c3e4699-5176-48ab-a2ba-0807db051e7a', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:24:13.068603 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a03a2469-b831-462b-8a65-2c09452177af tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:13.077026 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a03a2469-b831-462b-8a65-2c09452177af tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305" status: 200 len: 1307 microversion: 2.1 time: 0.707004 Oct 30 01:24:13.089717 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1289/2561] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:12 2022] GET /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305 => generated 1307 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:13.094594 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-341a5fe8-cae1-4193-921f-4b4acc294321 req-b33e9d04-40aa-445e-816f-63bf327b2d68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bd44e90-60a5-4f4d-ae27-a7dffcb3503e", "name": "network-vif-plugged", "status": "completed", "tag": "d2ed3272-2b5d-4ab4-90e4-02f9832b391e"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:24:13.109877 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-341a5fe8-cae1-4193-921f-4b4acc294321 req-b33e9d04-40aa-445e-816f-63bf327b2d68 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:13.110356 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-341a5fe8-cae1-4193-921f-4b4acc294321 req-b33e9d04-40aa-445e-816f-63bf327b2d68 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:13.110795 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-341a5fe8-cae1-4193-921f-4b4acc294321 req-b33e9d04-40aa-445e-816f-63bf327b2d68 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:13.126530 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-341a5fe8-cae1-4193-921f-4b4acc294321 req-b33e9d04-40aa-445e-816f-63bf327b2d68 service nova] Creating event network-vif-plugged:d2ed3272-2b5d-4ab4-90e4-02f9832b391e for instance 9bd44e90-60a5-4f4d-ae27-a7dffcb3503e on n-h2-master-1 Oct 30 01:24:13.139509 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-341a5fe8-cae1-4193-921f-4b4acc294321 req-b33e9d04-40aa-445e-816f-63bf327b2d68 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048411 Oct 30 01:24:13.142169 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1290/2562] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:24:13.150788 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b022da27-390f-45d0-be3b-d030da8ba73a tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:13.159822 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b022da27-390f-45d0-be3b-d030da8ba73a tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] [instance: 9bd44e90-60a5-4f4d-ae27-a7dffcb3503e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:13.172159 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b022da27-390f-45d0-be3b-d030da8ba73a tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:13.174974 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b022da27-390f-45d0-be3b-d030da8ba73a tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:13.176021 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b022da27-390f-45d0-be3b-d030da8ba73a tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:13.186171 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b022da27-390f-45d0-be3b-d030da8ba73a tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:13.186938 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b022da27-390f-45d0-be3b-d030da8ba73a tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:13.188189 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b022da27-390f-45d0-be3b-d030da8ba73a tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:13.909874 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b022da27-390f-45d0-be3b-d030da8ba73a tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb216afb20940ce9cc86b2d1faab962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4747ca082b4a9b82bb64c9ea2ec750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:13.930950 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b022da27-390f-45d0-be3b-d030da8ba73a tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] 10.222.0.13 "GET /compute/v2.1/servers/9bd44e90-60a5-4f4d-ae27-a7dffcb3503e" status: 200 len: 1331 microversion: 2.1 time: 0.787351 Oct 30 01:24:13.932135 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1291/2563] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:13 2022] GET /compute/v2.1/servers/9bd44e90-60a5-4f4d-ae27-a7dffcb3503e => generated 1331 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:13.941649 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4b8c52c2-97f6-486d-aac2-3810de94baa5 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:13.942438 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4b8c52c2-97f6-486d-aac2-3810de94baa5 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] [instance: f5fe2000-b4bf-4636-92fc-72e50c7a7a96] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:13.950654 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b8c52c2-97f6-486d-aac2-3810de94baa5 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:13.951444 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b8c52c2-97f6-486d-aac2-3810de94baa5 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:13.952032 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b8c52c2-97f6-486d-aac2-3810de94baa5 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:13.955139 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b8c52c2-97f6-486d-aac2-3810de94baa5 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:13.955820 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b8c52c2-97f6-486d-aac2-3810de94baa5 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:13.958197 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b8c52c2-97f6-486d-aac2-3810de94baa5 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:14.387780 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-d3b5344a-ec47-4281-8d05-79cfff6d4e17 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:24:14.389891 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-d3b5344a-ec47-4281-8d05-79cfff6d4e17 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:24:14.391177 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-d3b5344a-ec47-4281-8d05-79cfff6d4e17 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:24:14.391808 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-d3b5344a-ec47-4281-8d05-79cfff6d4e17 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:24:14.392726 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-d3b5344a-ec47-4281-8d05-79cfff6d4e17 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:24:14.405027 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d3b5344a-ec47-4281-8d05-79cfff6d4e17 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:14.405872 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d3b5344a-ec47-4281-8d05-79cfff6d4e17 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:14.406427 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d3b5344a-ec47-4281-8d05-79cfff6d4e17 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:14.408315 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d3b5344a-ec47-4281-8d05-79cfff6d4e17 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:14.425256 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d3b5344a-ec47-4281-8d05-79cfff6d4e17 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:14.426439 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d3b5344a-ec47-4281-8d05-79cfff6d4e17 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:14.427890 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4b8c52c2-97f6-486d-aac2-3810de94baa5 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e533367cf3fc4e06a96c6add0540b897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121fd24a0b6b4eb3aa1cac304dda16a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:14.443772 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4b8c52c2-97f6-486d-aac2-3810de94baa5 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e533367cf3fc4e06a96c6add0540b897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121fd24a0b6b4eb3aa1cac304dda16a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:14.446149 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4b8c52c2-97f6-486d-aac2-3810de94baa5 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e533367cf3fc4e06a96c6add0540b897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121fd24a0b6b4eb3aa1cac304dda16a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:14.451766 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4b8c52c2-97f6-486d-aac2-3810de94baa5 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] 10.222.0.13 "GET /compute/v2.1/servers/f5fe2000-b4bf-4636-92fc-72e50c7a7a96" status: 200 len: 1359 microversion: 2.21 time: 0.517463 Oct 30 01:24:14.452533 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1292/2564] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:24:13 2022] GET /compute/v2.1/servers/f5fe2000-b4bf-4636-92fc-72e50c7a7a96 => generated 1359 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:24:14.458004 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-d3b5344a-ec47-4281-8d05-79cfff6d4e17 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Getting quotas for project ada31213f567489299af80277ee35f65. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:24:14.461349 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-02c3a443-8fd6-4a1c-ac05-6ccfe4c76c1a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:14.465120 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-02c3a443-8fd6-4a1c-ac05-6ccfe4c76c1a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 32c70d3f-96cd-4b23-a743-05aed245baf0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:14.465932 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-d3b5344a-ec47-4281-8d05-79cfff6d4e17 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Getting quotas for user 6e8b2c03e5294bbe9ee8cda7468c9d86 and project ada31213f567489299af80277ee35f65. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:24:14.481427 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-02c3a443-8fd6-4a1c-ac05-6ccfe4c76c1a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:14.482383 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-02c3a443-8fd6-4a1c-ac05-6ccfe4c76c1a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:14.483021 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-02c3a443-8fd6-4a1c-ac05-6ccfe4c76c1a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:14.483954 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-02c3a443-8fd6-4a1c-ac05-6ccfe4c76c1a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:14.484625 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-02c3a443-8fd6-4a1c-ac05-6ccfe4c76c1a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:14.485430 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-02c3a443-8fd6-4a1c-ac05-6ccfe4c76c1a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:14.489854 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d3b5344a-ec47-4281-8d05-79cfff6d4e17 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:24:14.497314 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d3b5344a-ec47-4281-8d05-79cfff6d4e17 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] [instance: 87b560b8-33af-4f79-9768-7a7285a06a10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:24:14.703176 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d3b5344a-ec47-4281-8d05-79cfff6d4e17 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.457108 Oct 30 01:24:14.709921 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1273/2565] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:24:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2459 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:24:14.768175 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bea8a3e8-4235-4be2-9027-1d61898d3d59 tempest-FloatingIPDetailsTestJSON-1033028491 tempest-FloatingIPDetailsTestJSON-1033028491-project] Action: 'create', calling method: .version_select at 0x7f44d044f790>, body: {"pool": null} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:24:14.796995 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-02c3a443-8fd6-4a1c-ac05-6ccfe4c76c1a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:14.817244 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-02c3a443-8fd6-4a1c-ac05-6ccfe4c76c1a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0" status: 200 len: 1314 microversion: 2.1 time: 0.363442 Oct 30 01:24:14.818066 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1293/2566] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:14 2022] GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0 => generated 1314 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:14.835229 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2e4fadf0-d54d-4dca-9f70-b420c0e3ffeb tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:14.837607 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2e4fadf0-d54d-4dca-9f70-b420c0e3ffeb tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: 403e0292-c082-4655-ad08-b5dc3a7f8305] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:14.858227 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2e4fadf0-d54d-4dca-9f70-b420c0e3ffeb tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:14.859053 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2e4fadf0-d54d-4dca-9f70-b420c0e3ffeb tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:14.859692 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2e4fadf0-d54d-4dca-9f70-b420c0e3ffeb tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:14.862204 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2e4fadf0-d54d-4dca-9f70-b420c0e3ffeb tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:14.862910 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2e4fadf0-d54d-4dca-9f70-b420c0e3ffeb tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:14.864383 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2e4fadf0-d54d-4dca-9f70-b420c0e3ffeb tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:15.524459 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2e4fadf0-d54d-4dca-9f70-b420c0e3ffeb tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:15.533097 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2e4fadf0-d54d-4dca-9f70-b420c0e3ffeb tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305" status: 200 len: 1307 microversion: 2.1 time: 0.713708 Oct 30 01:24:15.533917 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1294/2567] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:14 2022] GET /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305 => generated 1307 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:15.575828 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-6d9308f5-7073-40c7-bce0-72bd87beb800 req-45befcdd-8482-4a72-a42a-11e608e1eb28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcb34439-de04-4a9c-b81b-7fb2360af99c", "tag": "aba33ea4-cd46-4a87-a95b-e95a41b80f08"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:24:15.588356 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-6d9308f5-7073-40c7-bce0-72bd87beb800 req-45befcdd-8482-4a72-a42a-11e608e1eb28 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:15.589228 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-6d9308f5-7073-40c7-bce0-72bd87beb800 req-45befcdd-8482-4a72-a42a-11e608e1eb28 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:15.590458 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-6d9308f5-7073-40c7-bce0-72bd87beb800 req-45befcdd-8482-4a72-a42a-11e608e1eb28 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:15.612634 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-6d9308f5-7073-40c7-bce0-72bd87beb800 req-45befcdd-8482-4a72-a42a-11e608e1eb28 service nova] Creating event network-changed:aba33ea4-cd46-4a87-a95b-e95a41b80f08 for instance dcb34439-de04-4a9c-b81b-7fb2360af99c on n-h1-master-1 Oct 30 01:24:15.626936 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-6d9308f5-7073-40c7-bce0-72bd87beb800 req-45befcdd-8482-4a72-a42a-11e608e1eb28 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059957 Oct 30 01:24:15.629451 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1295/2568] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:24:15.637744 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1c04c7be-0186-45c6-b947-dde91b5ec63f tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:15.638571 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1c04c7be-0186-45c6-b947-dde91b5ec63f tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] [instance: 87b560b8-33af-4f79-9768-7a7285a06a10] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:15.834279 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1c04c7be-0186-45c6-b947-dde91b5ec63f tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8b2c03e5294bbe9ee8cda7468c9d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada31213f567489299af80277ee35f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:15.851401 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1c04c7be-0186-45c6-b947-dde91b5ec63f tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] 10.222.0.13 "GET /compute/v2.1/servers/87b560b8-33af-4f79-9768-7a7285a06a10" status: 200 len: 1224 microversion: 2.1 time: 0.219351 Oct 30 01:24:15.868443 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1296/2569] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:15 2022] GET /compute/v2.1/servers/87b560b8-33af-4f79-9768-7a7285a06a10 => generated 1224 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:15.875651 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6c7be667-8687-48c2-aa67-ff83b5151be8 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:15.876661 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6c7be667-8687-48c2-aa67-ff83b5151be8 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] [instance: 9bd44e90-60a5-4f4d-ae27-a7dffcb3503e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:15.885964 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:24:15.889318 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c7be667-8687-48c2-aa67-ff83b5151be8 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:15.891835 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c7be667-8687-48c2-aa67-ff83b5151be8 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:15.891835 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c7be667-8687-48c2-aa67-ff83b5151be8 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:15.891835 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c7be667-8687-48c2-aa67-ff83b5151be8 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:15.892722 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c7be667-8687-48c2-aa67-ff83b5151be8 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:15.893724 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c7be667-8687-48c2-aa67-ff83b5151be8 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:16.453777 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6c7be667-8687-48c2-aa67-ff83b5151be8 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb216afb20940ce9cc86b2d1faab962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4747ca082b4a9b82bb64c9ea2ec750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:16.461869 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6c7be667-8687-48c2-aa67-ff83b5151be8 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] 10.222.0.13 "GET /compute/v2.1/servers/9bd44e90-60a5-4f4d-ae27-a7dffcb3503e" status: 200 len: 1535 microversion: 2.1 time: 0.590266 Oct 30 01:24:16.462547 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1297/2570] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:15 2022] GET /compute/v2.1/servers/9bd44e90-60a5-4f4d-ae27-a7dffcb3503e => generated 1535 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:16.475007 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-80f02065-e67c-40ab-878c-7b572b5a045b tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:16.487193 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-80f02065-e67c-40ab-878c-7b572b5a045b tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] [instance: f5fe2000-b4bf-4636-92fc-72e50c7a7a96] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:16.487193 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-80f02065-e67c-40ab-878c-7b572b5a045b tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:16.487193 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-80f02065-e67c-40ab-878c-7b572b5a045b tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:16.487193 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-80f02065-e67c-40ab-878c-7b572b5a045b tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:16.487551 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-80f02065-e67c-40ab-878c-7b572b5a045b tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:16.487551 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-80f02065-e67c-40ab-878c-7b572b5a045b tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:16.487551 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-80f02065-e67c-40ab-878c-7b572b5a045b tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:16.726335 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:24:16.985829 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-80f02065-e67c-40ab-878c-7b572b5a045b tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e533367cf3fc4e06a96c6add0540b897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121fd24a0b6b4eb3aa1cac304dda16a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:16.995612 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-80f02065-e67c-40ab-878c-7b572b5a045b tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e533367cf3fc4e06a96c6add0540b897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121fd24a0b6b4eb3aa1cac304dda16a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:16.997072 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-80f02065-e67c-40ab-878c-7b572b5a045b tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e533367cf3fc4e06a96c6add0540b897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121fd24a0b6b4eb3aa1cac304dda16a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:16.998443 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-80f02065-e67c-40ab-878c-7b572b5a045b tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] 10.222.0.13 "GET /compute/v2.1/servers/f5fe2000-b4bf-4636-92fc-72e50c7a7a96" status: 200 len: 1359 microversion: 2.21 time: 0.528479 Oct 30 01:24:16.999178 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1298/2571] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:24:16 2022] GET /compute/v2.1/servers/f5fe2000-b4bf-4636-92fc-72e50c7a7a96 => generated 1359 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:24:17.013318 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-803d0bdb-5698-4f25-bb69-2fc882b57947 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:17.014194 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-803d0bdb-5698-4f25-bb69-2fc882b57947 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 32c70d3f-96cd-4b23-a743-05aed245baf0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:17.021747 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-803d0bdb-5698-4f25-bb69-2fc882b57947 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:17.022484 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-803d0bdb-5698-4f25-bb69-2fc882b57947 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:17.023080 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-803d0bdb-5698-4f25-bb69-2fc882b57947 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:17.023970 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-803d0bdb-5698-4f25-bb69-2fc882b57947 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:17.024582 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-803d0bdb-5698-4f25-bb69-2fc882b57947 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:17.025174 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-803d0bdb-5698-4f25-bb69-2fc882b57947 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:17.494189 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-803d0bdb-5698-4f25-bb69-2fc882b57947 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:17.509014 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-803d0bdb-5698-4f25-bb69-2fc882b57947 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0" status: 200 len: 1314 microversion: 2.1 time: 0.499990 Oct 30 01:24:17.516224 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1299/2572] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:17 2022] GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0 => generated 1314 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:17.518925 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e86ea43e-a599-4459-aae0-cd59465dccd9 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Action: 'create', calling method: .version_select at 0x7f44c76241f0>, body: {"pool": "2814ffb0-9699-49c0-8244-030e5edcf7e8"} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:24:19.848924 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bea8a3e8-4235-4be2-9027-1d61898d3d59 tempest-FloatingIPDetailsTestJSON-1033028491 tempest-FloatingIPDetailsTestJSON-1033028491-project] 10.222.0.13 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.142998 Oct 30 01:24:19.849912 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1274/2573] 10.222.0.13 () {60 vars in 1170 bytes} [Sun Oct 30 01:24:14 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:24:19.872354 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-622b8e80-f8f8-4fe8-88d9-859bdcc0fe55 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:19.872973 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-622b8e80-f8f8-4fe8-88d9-859bdcc0fe55 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: 403e0292-c082-4655-ad08-b5dc3a7f8305] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:19.885657 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-622b8e80-f8f8-4fe8-88d9-859bdcc0fe55 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:19.887398 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-622b8e80-f8f8-4fe8-88d9-859bdcc0fe55 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:19.887398 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-622b8e80-f8f8-4fe8-88d9-859bdcc0fe55 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:19.887874 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-622b8e80-f8f8-4fe8-88d9-859bdcc0fe55 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:19.888341 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-622b8e80-f8f8-4fe8-88d9-859bdcc0fe55 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:19.888760 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-622b8e80-f8f8-4fe8-88d9-859bdcc0fe55 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:20.136128 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-622b8e80-f8f8-4fe8-88d9-859bdcc0fe55 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:20.187401 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-622b8e80-f8f8-4fe8-88d9-859bdcc0fe55 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305" status: 200 len: 1307 microversion: 2.1 time: 0.321409 Oct 30 01:24:20.192689 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1275/2574] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:19 2022] GET /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305 => generated 1307 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:20.200546 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3fb08930-7f0c-4778-9fe7-5679cec95770 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:20.202000 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3fb08930-7f0c-4778-9fe7-5679cec95770 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] [instance: 87b560b8-33af-4f79-9768-7a7285a06a10] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:20.211294 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3fb08930-7f0c-4778-9fe7-5679cec95770 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:20.211797 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3fb08930-7f0c-4778-9fe7-5679cec95770 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:20.212239 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3fb08930-7f0c-4778-9fe7-5679cec95770 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:20.212959 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3fb08930-7f0c-4778-9fe7-5679cec95770 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:20.213624 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3fb08930-7f0c-4778-9fe7-5679cec95770 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:20.214126 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3fb08930-7f0c-4778-9fe7-5679cec95770 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:20.442339 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3fb08930-7f0c-4778-9fe7-5679cec95770 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8b2c03e5294bbe9ee8cda7468c9d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada31213f567489299af80277ee35f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:20.454675 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3fb08930-7f0c-4778-9fe7-5679cec95770 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] 10.222.0.13 "GET /compute/v2.1/servers/87b560b8-33af-4f79-9768-7a7285a06a10" status: 200 len: 1324 microversion: 2.1 time: 0.260794 Oct 30 01:24:20.455406 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1276/2575] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:20 2022] GET /compute/v2.1/servers/87b560b8-33af-4f79-9768-7a7285a06a10 => generated 1324 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:20.462963 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-c1736e9c-4c97-4a10-a8b8-59445c15a928 req-3a2d8747-07ec-428e-a624-d38ca39afc6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5fe2000-b4bf-4636-92fc-72e50c7a7a96", "tag": "24794f52-84dd-4fd4-adc1-1cc798873d5c"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:24:20.483302 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-c1736e9c-4c97-4a10-a8b8-59445c15a928 req-3a2d8747-07ec-428e-a624-d38ca39afc6d service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:20.483921 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-c1736e9c-4c97-4a10-a8b8-59445c15a928 req-3a2d8747-07ec-428e-a624-d38ca39afc6d service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:20.484425 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-c1736e9c-4c97-4a10-a8b8-59445c15a928 req-3a2d8747-07ec-428e-a624-d38ca39afc6d service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:20.502201 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-c1736e9c-4c97-4a10-a8b8-59445c15a928 req-3a2d8747-07ec-428e-a624-d38ca39afc6d service nova] Creating event network-changed:24794f52-84dd-4fd4-adc1-1cc798873d5c for instance f5fe2000-b4bf-4636-92fc-72e50c7a7a96 on n-h1-master-1 Oct 30 01:24:20.508081 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-c1736e9c-4c97-4a10-a8b8-59445c15a928 req-3a2d8747-07ec-428e-a624-d38ca39afc6d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051410 Oct 30 01:24:20.508688 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1277/2576] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:24:20.515244 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a8682f68-3491-4d45-89a7-68074184c318 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:20.516120 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a8682f68-3491-4d45-89a7-68074184c318 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] [instance: f5fe2000-b4bf-4636-92fc-72e50c7a7a96] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:20.525730 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a8682f68-3491-4d45-89a7-68074184c318 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:20.526180 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a8682f68-3491-4d45-89a7-68074184c318 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:20.526829 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a8682f68-3491-4d45-89a7-68074184c318 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:20.527555 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a8682f68-3491-4d45-89a7-68074184c318 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:20.528003 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a8682f68-3491-4d45-89a7-68074184c318 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:20.528623 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a8682f68-3491-4d45-89a7-68074184c318 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:20.883201 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a8682f68-3491-4d45-89a7-68074184c318 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e533367cf3fc4e06a96c6add0540b897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121fd24a0b6b4eb3aa1cac304dda16a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:20.892511 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a8682f68-3491-4d45-89a7-68074184c318 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e533367cf3fc4e06a96c6add0540b897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121fd24a0b6b4eb3aa1cac304dda16a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:20.894164 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a8682f68-3491-4d45-89a7-68074184c318 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e533367cf3fc4e06a96c6add0540b897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121fd24a0b6b4eb3aa1cac304dda16a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:20.895306 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a8682f68-3491-4d45-89a7-68074184c318 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] 10.222.0.13 "GET /compute/v2.1/servers/f5fe2000-b4bf-4636-92fc-72e50c7a7a96" status: 200 len: 1359 microversion: 2.21 time: 0.385134 Oct 30 01:24:20.909759 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1278/2577] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:24:20 2022] GET /compute/v2.1/servers/f5fe2000-b4bf-4636-92fc-72e50c7a7a96 => generated 1359 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:24:20.909759 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-bb829eb6-8569-4101-a98d-3ef022bb1a25 req-7f6f1302-d51b-4591-b72c-694315606733 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "403e0292-c082-4655-ad08-b5dc3a7f8305", "name": "network-vif-plugged", "status": "completed", "tag": "ef3e2c7d-b1a5-43dc-a664-896af7f0b0ed"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:24:20.911789 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e86ea43e-a599-4459-aae0-cd59465dccd9 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] 10.222.0.13 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.399185 Oct 30 01:24:20.912638 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-bb829eb6-8569-4101-a98d-3ef022bb1a25 req-7f6f1302-d51b-4591-b72c-694315606733 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:20.913130 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-bb829eb6-8569-4101-a98d-3ef022bb1a25 req-7f6f1302-d51b-4591-b72c-694315606733 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:20.913589 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-bb829eb6-8569-4101-a98d-3ef022bb1a25 req-7f6f1302-d51b-4591-b72c-694315606733 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:20.914437 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1300/2578] 10.222.0.13 () {60 vars in 1170 bytes} [Sun Oct 30 01:24:17 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:24:20.920190 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cdd3d88b-2573-47d1-b590-915d218559cf tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:20.926088 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-cdd3d88b-2573-47d1-b590-915d218559cf tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a1e23e3096f740508e6fb6626a29336f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5e20978d1a4886b04d37eef4c23d1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:20.926587 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cdd3d88b-2573-47d1-b590-915d218559cf tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Searching by: {'deleted': False, 'project_id': '2a5e20978d1a4886b04d37eef4c23d1e'} {{(pid=121102) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 30 01:24:20.932511 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cdd3d88b-2573-47d1-b590-915d218559cf tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:20.933101 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cdd3d88b-2573-47d1-b590-915d218559cf tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:20.933344 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-bb829eb6-8569-4101-a98d-3ef022bb1a25 req-7f6f1302-d51b-4591-b72c-694315606733 service nova] Creating event network-vif-plugged:ef3e2c7d-b1a5-43dc-a664-896af7f0b0ed for instance 403e0292-c082-4655-ad08-b5dc3a7f8305 on n-h2-master-1 Oct 30 01:24:20.933923 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cdd3d88b-2573-47d1-b590-915d218559cf tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:20.934655 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cdd3d88b-2573-47d1-b590-915d218559cf tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:20.935100 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cdd3d88b-2573-47d1-b590-915d218559cf tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:20.935521 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cdd3d88b-2573-47d1-b590-915d218559cf tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:20.938347 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-bb829eb6-8569-4101-a98d-3ef022bb1a25 req-7f6f1302-d51b-4591-b72c-694315606733 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039019 Oct 30 01:24:20.939430 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1279/2579] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:24:20.946293 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-03b402c7-f80f-4918-af39-a2c49cf4eda5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:20.947204 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-03b402c7-f80f-4918-af39-a2c49cf4eda5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 32c70d3f-96cd-4b23-a743-05aed245baf0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:20.954064 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-03b402c7-f80f-4918-af39-a2c49cf4eda5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:20.954829 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-03b402c7-f80f-4918-af39-a2c49cf4eda5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:20.955455 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-03b402c7-f80f-4918-af39-a2c49cf4eda5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:20.956498 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-03b402c7-f80f-4918-af39-a2c49cf4eda5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:20.957143 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-03b402c7-f80f-4918-af39-a2c49cf4eda5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:20.957786 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-03b402c7-f80f-4918-af39-a2c49cf4eda5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:21.028719 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.multi_cell_list [None req-cdd3d88b-2573-47d1-b590-915d218559cf tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121102) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 30 01:24:21.090796 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cdd3d88b-2573-47d1-b590-915d218559cf tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.175039 Oct 30 01:24:21.091410 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1301/2580] 10.222.0.13 () {58 vars in 1125 bytes} [Sun Oct 30 01:24:20 2022] GET /compute/v2.1/servers => generated 339 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:24:21.099394 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cedb3e69-3d92-4fd2-a4bc-3d85aa963545 tempest-FloatingIPDetailsTestJSON-1033028491 tempest-FloatingIPDetailsTestJSON-1033028491-project] Action: 'create', calling method: .version_select at 0x7f44c761fd30>, body: {"pool": null} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:24:21.234190 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-03b402c7-f80f-4918-af39-a2c49cf4eda5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:21.242310 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-03b402c7-f80f-4918-af39-a2c49cf4eda5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0" status: 200 len: 1314 microversion: 2.1 time: 0.301347 Oct 30 01:24:21.246688 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1280/2581] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:20 2022] GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0 => generated 1314 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:21.256053 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-51613784-4245-407b-9b56-aff0fc4215ee req-76087663-b0fc-43a9-b751-ff91d2fb4718 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87b560b8-33af-4f79-9768-7a7285a06a10", "tag": "b893cb0a-5a5f-4bec-a667-ff7aea4c5048"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:24:21.274065 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-51613784-4245-407b-9b56-aff0fc4215ee req-76087663-b0fc-43a9-b751-ff91d2fb4718 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:21.274651 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-51613784-4245-407b-9b56-aff0fc4215ee req-76087663-b0fc-43a9-b751-ff91d2fb4718 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:21.275093 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-51613784-4245-407b-9b56-aff0fc4215ee req-76087663-b0fc-43a9-b751-ff91d2fb4718 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:21.288026 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-51613784-4245-407b-9b56-aff0fc4215ee req-76087663-b0fc-43a9-b751-ff91d2fb4718 service nova] Creating event network-changed:b893cb0a-5a5f-4bec-a667-ff7aea4c5048 for instance 87b560b8-33af-4f79-9768-7a7285a06a10 on n-h2-master-1 Oct 30 01:24:21.293614 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-51613784-4245-407b-9b56-aff0fc4215ee req-76087663-b0fc-43a9-b751-ff91d2fb4718 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045390 Oct 30 01:24:21.294230 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1281/2582] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:24:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:24:21.301053 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a5b6e3bc-1b05-4ec3-b43e-d4379a245e5d tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.5.105"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:24:21.303847 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a5b6e3bc-1b05-4ec3-b43e-d4379a245e5d tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] [instance: 9bd44e90-60a5-4f4d-ae27-a7dffcb3503e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:21.310483 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a5b6e3bc-1b05-4ec3-b43e-d4379a245e5d tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:21.310944 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a5b6e3bc-1b05-4ec3-b43e-d4379a245e5d tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:21.311559 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a5b6e3bc-1b05-4ec3-b43e-d4379a245e5d tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:21.312272 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a5b6e3bc-1b05-4ec3-b43e-d4379a245e5d tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:21.312887 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a5b6e3bc-1b05-4ec3-b43e-d4379a245e5d tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:21.313522 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a5b6e3bc-1b05-4ec3-b43e-d4379a245e5d tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:21.342538 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a5b6e3bc-1b05-4ec3-b43e-d4379a245e5d tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Acquiring lock "refresh_cache-9bd44e90-60a5-4f4d-ae27-a7dffcb3503e" {{(pid=121103) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 30 01:24:21.342946 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a5b6e3bc-1b05-4ec3-b43e-d4379a245e5d tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Acquired lock "refresh_cache-9bd44e90-60a5-4f4d-ae27-a7dffcb3503e" {{(pid=121103) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 30 01:24:23.331675 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-a5b6e3bc-1b05-4ec3-b43e-d4379a245e5d tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] [instance: 9bd44e90-60a5-4f4d-ae27-a7dffcb3503e] Building network info cache for instance {{(pid=121103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 30 01:24:23.975885 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cedb3e69-3d92-4fd2-a4bc-3d85aa963545 tempest-FloatingIPDetailsTestJSON-1033028491 tempest-FloatingIPDetailsTestJSON-1033028491-project] 10.222.0.13 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.880843 Oct 30 01:24:23.984202 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1302/2583] 10.222.0.13 () {60 vars in 1170 bytes} [Sun Oct 30 01:24:21 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2885 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:24:23.985087 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b76985b5-1585-401f-a63a-bd6549c36332 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:23.992636 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b76985b5-1585-401f-a63a-bd6549c36332 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a1e23e3096f740508e6fb6626a29336f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5e20978d1a4886b04d37eef4c23d1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:23.993597 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b76985b5-1585-401f-a63a-bd6549c36332 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Searching by: {'deleted': False, 'project_id': '2a5e20978d1a4886b04d37eef4c23d1e'} {{(pid=121102) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 30 01:24:23.999519 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b76985b5-1585-401f-a63a-bd6549c36332 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:24.003084 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b76985b5-1585-401f-a63a-bd6549c36332 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:24.003084 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b76985b5-1585-401f-a63a-bd6549c36332 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:24.003084 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b76985b5-1585-401f-a63a-bd6549c36332 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:24.008939 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b76985b5-1585-401f-a63a-bd6549c36332 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:24.010574 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b76985b5-1585-401f-a63a-bd6549c36332 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:24.043811 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.multi_cell_list [None req-b76985b5-1585-401f-a63a-bd6549c36332 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121102) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 30 01:24:24.072530 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:24:24.085648 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=17 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:24:24.088610 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b76985b5-1585-401f-a63a-bd6549c36332 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e23e3096f740508e6fb6626a29336f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5e20978d1a4886b04d37eef4c23d1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:24.095615 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b76985b5-1585-401f-a63a-bd6549c36332 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:24.096107 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b76985b5-1585-401f-a63a-bd6549c36332 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:24.096541 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b76985b5-1585-401f-a63a-bd6549c36332 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:24.109202 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-a5b6e3bc-1b05-4ec3-b43e-d4379a245e5d tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] [instance: 9bd44e90-60a5-4f4d-ae27-a7dffcb3503e] Updating instance_info_cache with network_info: [{"id": "d2ed3272-2b5d-4ab4-90e4-02f9832b391e", "address": "fa:16:3e:89:1a:8c", "network": {"id": "3e8bdef0-4815-4ad6-a6bf-6429286b8c3e", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-631621317-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.5.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "0e4747ca082b4a9b82bb64c9ea2ec750", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd2ed3272-2b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 30 01:24:24.186307 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a5b6e3bc-1b05-4ec3-b43e-d4379a245e5d tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Releasing lock "refresh_cache-9bd44e90-60a5-4f4d-ae27-a7dffcb3503e" {{(pid=121103) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 30 01:24:24.191217 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a5b6e3bc-1b05-4ec3-b43e-d4379a245e5d tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] 10.222.0.13 "POST /compute/v2.1/servers/9bd44e90-60a5-4f4d-ae27-a7dffcb3503e/action" status: 202 len: 0 microversion: 2.1 time: 2.891864 Oct 30 01:24:24.191217 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1282/2584] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:24:21 2022] POST /compute/v2.1/servers/9bd44e90-60a5-4f4d-ae27-a7dffcb3503e/action => generated 0 bytes in 2893 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 30 01:24:24.195417 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bb53e099-4aed-4f65-a147-52f9581de6df tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:24.197202 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-bb53e099-4aed-4f65-a147-52f9581de6df tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: 403e0292-c082-4655-ad08-b5dc3a7f8305] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:24.204662 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb53e099-4aed-4f65-a147-52f9581de6df tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:24.205515 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb53e099-4aed-4f65-a147-52f9581de6df tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:24.206167 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb53e099-4aed-4f65-a147-52f9581de6df tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:24.206951 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb53e099-4aed-4f65-a147-52f9581de6df tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:24.207540 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb53e099-4aed-4f65-a147-52f9581de6df tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:24.208032 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb53e099-4aed-4f65-a147-52f9581de6df tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:24.225501 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b76985b5-1585-401f-a63a-bd6549c36332 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] 10.222.0.13 "GET /compute/v2.1/servers/detail" status: 200 len: 1709 microversion: 2.1 time: 0.245521 Oct 30 01:24:24.231533 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1303/2585] 10.222.0.13 () {58 vars in 1146 bytes} [Sun Oct 30 01:24:23 2022] GET /compute/v2.1/servers/detail => generated 1709 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:24.237108 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c5d5cd6e-4edc-4764-9bbb-6ea5f42bb329 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:24.237863 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c5d5cd6e-4edc-4764-9bbb-6ea5f42bb329 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] [instance: 87b560b8-33af-4f79-9768-7a7285a06a10] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:24.247980 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c5d5cd6e-4edc-4764-9bbb-6ea5f42bb329 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:24.248729 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c5d5cd6e-4edc-4764-9bbb-6ea5f42bb329 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:24.248891 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c5d5cd6e-4edc-4764-9bbb-6ea5f42bb329 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:24.249624 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c5d5cd6e-4edc-4764-9bbb-6ea5f42bb329 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:24.250316 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c5d5cd6e-4edc-4764-9bbb-6ea5f42bb329 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:24.250590 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c5d5cd6e-4edc-4764-9bbb-6ea5f42bb329 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:24.400539 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-bb53e099-4aed-4f65-a147-52f9581de6df tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:24.410274 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bb53e099-4aed-4f65-a147-52f9581de6df tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305" status: 200 len: 1486 microversion: 2.1 time: 0.221243 Oct 30 01:24:24.411617 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1283/2586] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:24 2022] GET /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305 => generated 1486 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:24.423782 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c2b55dfc-7383-4ad4-820d-1e91c4b25071 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:24.424647 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c2b55dfc-7383-4ad4-820d-1e91c4b25071 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] [instance: f5fe2000-b4bf-4636-92fc-72e50c7a7a96] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:24.435343 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c2b55dfc-7383-4ad4-820d-1e91c4b25071 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:24.436122 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c2b55dfc-7383-4ad4-820d-1e91c4b25071 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:24.436555 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c2b55dfc-7383-4ad4-820d-1e91c4b25071 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:24.437499 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c2b55dfc-7383-4ad4-820d-1e91c4b25071 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:24.437962 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c2b55dfc-7383-4ad4-820d-1e91c4b25071 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:24.438392 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c2b55dfc-7383-4ad4-820d-1e91c4b25071 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:24.443133 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:24:24.445475 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c5d5cd6e-4edc-4764-9bbb-6ea5f42bb329 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8b2c03e5294bbe9ee8cda7468c9d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada31213f567489299af80277ee35f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:24.454997 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c5d5cd6e-4edc-4764-9bbb-6ea5f42bb329 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] 10.222.0.13 "GET /compute/v2.1/servers/87b560b8-33af-4f79-9768-7a7285a06a10" status: 200 len: 1324 microversion: 2.1 time: 0.221747 Oct 30 01:24:24.470366 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1304/2587] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:24 2022] GET /compute/v2.1/servers/87b560b8-33af-4f79-9768-7a7285a06a10 => generated 1324 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:24.484130 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=6 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:24:24.585400 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-45c43436-3306-47fa-9b42-d31b0837cd2f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:24.586159 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-45c43436-3306-47fa-9b42-d31b0837cd2f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 32c70d3f-96cd-4b23-a743-05aed245baf0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:24.592954 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-45c43436-3306-47fa-9b42-d31b0837cd2f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:24.593564 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-45c43436-3306-47fa-9b42-d31b0837cd2f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:24.594119 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-45c43436-3306-47fa-9b42-d31b0837cd2f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:24.595000 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-45c43436-3306-47fa-9b42-d31b0837cd2f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:24.595538 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-45c43436-3306-47fa-9b42-d31b0837cd2f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:24.596185 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-45c43436-3306-47fa-9b42-d31b0837cd2f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:24.604146 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c2b55dfc-7383-4ad4-820d-1e91c4b25071 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e533367cf3fc4e06a96c6add0540b897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121fd24a0b6b4eb3aa1cac304dda16a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:24.614272 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c2b55dfc-7383-4ad4-820d-1e91c4b25071 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e533367cf3fc4e06a96c6add0540b897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121fd24a0b6b4eb3aa1cac304dda16a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:24.615892 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c2b55dfc-7383-4ad4-820d-1e91c4b25071 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e533367cf3fc4e06a96c6add0540b897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121fd24a0b6b4eb3aa1cac304dda16a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:24.617307 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c2b55dfc-7383-4ad4-820d-1e91c4b25071 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] 10.222.0.13 "GET /compute/v2.1/servers/f5fe2000-b4bf-4636-92fc-72e50c7a7a96" status: 200 len: 1359 microversion: 2.21 time: 0.204543 Oct 30 01:24:24.617977 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1284/2588] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:24:24 2022] GET /compute/v2.1/servers/f5fe2000-b4bf-4636-92fc-72e50c7a7a96 => generated 1359 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:24:24.623530 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-9d54a4ac-8d7f-4417-9127-d790a4e1594e req-7ffd5af7-3f4c-411f-8544-659020b37cbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32c70d3f-96cd-4b23-a743-05aed245baf0", "name": "network-vif-plugged", "status": "completed", "tag": "42309075-0068-4d9c-83fb-f3e5e8e5a63d"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:24:24.634016 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-9d54a4ac-8d7f-4417-9127-d790a4e1594e req-7ffd5af7-3f4c-411f-8544-659020b37cbc service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:24.634771 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-9d54a4ac-8d7f-4417-9127-d790a4e1594e req-7ffd5af7-3f4c-411f-8544-659020b37cbc service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:24.635394 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-9d54a4ac-8d7f-4417-9127-d790a4e1594e req-7ffd5af7-3f4c-411f-8544-659020b37cbc service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:24.647979 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-9d54a4ac-8d7f-4417-9127-d790a4e1594e req-7ffd5af7-3f4c-411f-8544-659020b37cbc service nova] Creating event network-vif-plugged:42309075-0068-4d9c-83fb-f3e5e8e5a63d for instance 32c70d3f-96cd-4b23-a743-05aed245baf0 on n-h1-master-1 Oct 30 01:24:24.653219 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-9d54a4ac-8d7f-4417-9127-d790a4e1594e req-7ffd5af7-3f4c-411f-8544-659020b37cbc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033783 Oct 30 01:24:24.654217 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1285/2589] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:24:24.659387 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-678f49b6-685f-4af9-8432-fc8e8ce9d6b7 req-27de10a8-f8b2-43cc-afdc-b459ea30d604 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bd44e90-60a5-4f4d-ae27-a7dffcb3503e", "tag": "d2ed3272-2b5d-4ab4-90e4-02f9832b391e"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:24:24.669396 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-678f49b6-685f-4af9-8432-fc8e8ce9d6b7 req-27de10a8-f8b2-43cc-afdc-b459ea30d604 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:24.669948 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-678f49b6-685f-4af9-8432-fc8e8ce9d6b7 req-27de10a8-f8b2-43cc-afdc-b459ea30d604 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:24.670594 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-678f49b6-685f-4af9-8432-fc8e8ce9d6b7 req-27de10a8-f8b2-43cc-afdc-b459ea30d604 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:24.682345 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-678f49b6-685f-4af9-8432-fc8e8ce9d6b7 req-27de10a8-f8b2-43cc-afdc-b459ea30d604 service nova] Creating event network-changed:d2ed3272-2b5d-4ab4-90e4-02f9832b391e for instance 9bd44e90-60a5-4f4d-ae27-a7dffcb3503e on n-h2-master-1 Oct 30 01:24:24.689048 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-678f49b6-685f-4af9-8432-fc8e8ce9d6b7 req-27de10a8-f8b2-43cc-afdc-b459ea30d604 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033592 Oct 30 01:24:24.690094 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1286/2590] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:24:24.695865 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-06c50760-cbd7-49dc-b399-f0dfbe9a2a33 tempest-FloatingIPDetailsTestJSON-1033028491 tempest-FloatingIPDetailsTestJSON-1033028491-project] Action: 'create', calling method: .version_select at 0x7f44d0484040>, body: {"pool": null} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:24:24.845372 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-45c43436-3306-47fa-9b42-d31b0837cd2f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:24.857703 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-45c43436-3306-47fa-9b42-d31b0837cd2f tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0" status: 200 len: 1314 microversion: 2.1 time: 0.400798 Oct 30 01:24:24.859017 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1305/2591] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:24 2022] GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0 => generated 1314 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:24.865378 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a75d2b5c-3742-4603-a5c8-42f4dd4ded00 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Action: 'create', calling method: .version_select at 0x7f44c773b670>, body: {"pool": "2814ffb0-9699-49c0-8244-030e5edcf7e8"} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:24:27.175056 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-06c50760-cbd7-49dc-b399-f0dfbe9a2a33 tempest-FloatingIPDetailsTestJSON-1033028491 tempest-FloatingIPDetailsTestJSON-1033028491-project] 10.222.0.13 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.483289 Oct 30 01:24:27.175667 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1287/2592] 10.222.0.13 () {60 vars in 1170 bytes} [Sun Oct 30 01:24:24 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:24:27.180398 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b98ff026-3e02-451a-aa68-b4f21705c4b5 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:27.189122 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b98ff026-3e02-451a-aa68-b4f21705c4b5 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012361 Oct 30 01:24:27.189903 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1288/2593] 10.222.0.13 () {58 vars in 1137 bytes} [Sun Oct 30 01:24:27 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:24:27.194279 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f2f90418-3a2a-4a37-a499-d9bdd88d6a66 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:24:27.200944 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f2f90418-3a2a-4a37-a499-d9bdd88d6a66 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:27.201458 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f2f90418-3a2a-4a37-a499-d9bdd88d6a66 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:27.201895 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f2f90418-3a2a-4a37-a499-d9bdd88d6a66 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:27.272000 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f2f90418-3a2a-4a37-a499-d9bdd88d6a66 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: 403e0292-c082-4655-ad08-b5dc3a7f8305] Going to try to stop instance {{(pid=121103) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 30 01:24:27.277103 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:24:27.402713 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a75d2b5c-3742-4603-a5c8-42f4dd4ded00 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] 10.222.0.13 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.538033 Oct 30 01:24:27.402713 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1306/2594] 10.222.0.13 () {60 vars in 1170 bytes} [Sun Oct 30 01:24:24 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:24:27.405370 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e56832a5-c4ec-42b0-8674-61fd9a69a652 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:27.405990 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e56832a5-c4ec-42b0-8674-61fd9a69a652 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] [instance: 87b560b8-33af-4f79-9768-7a7285a06a10] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:27.413360 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e56832a5-c4ec-42b0-8674-61fd9a69a652 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:27.413875 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e56832a5-c4ec-42b0-8674-61fd9a69a652 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:27.414314 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e56832a5-c4ec-42b0-8674-61fd9a69a652 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:27.415049 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e56832a5-c4ec-42b0-8674-61fd9a69a652 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:27.415509 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e56832a5-c4ec-42b0-8674-61fd9a69a652 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:27.415937 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e56832a5-c4ec-42b0-8674-61fd9a69a652 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:27.507146 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f2f90418-3a2a-4a37-a499-d9bdd88d6a66 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "POST /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305/action" status: 202 len: 0 microversion: 2.1 time: 0.316135 Oct 30 01:24:27.507862 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1289/2595] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:24:27 2022] POST /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305/action => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:24:27.514505 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-35f70156-39f2-4341-9869-b25be72cff26 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:27.515443 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-35f70156-39f2-4341-9869-b25be72cff26 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] [instance: f5fe2000-b4bf-4636-92fc-72e50c7a7a96] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:27.523052 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-35f70156-39f2-4341-9869-b25be72cff26 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:27.523548 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-35f70156-39f2-4341-9869-b25be72cff26 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:27.523980 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-35f70156-39f2-4341-9869-b25be72cff26 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:27.525361 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-35f70156-39f2-4341-9869-b25be72cff26 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:27.525692 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-35f70156-39f2-4341-9869-b25be72cff26 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:27.526115 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-35f70156-39f2-4341-9869-b25be72cff26 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:27.561212 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e56832a5-c4ec-42b0-8674-61fd9a69a652 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8b2c03e5294bbe9ee8cda7468c9d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada31213f567489299af80277ee35f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:27.569355 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e56832a5-c4ec-42b0-8674-61fd9a69a652 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] 10.222.0.13 "GET /compute/v2.1/servers/87b560b8-33af-4f79-9768-7a7285a06a10" status: 200 len: 1324 microversion: 2.1 time: 0.169263 Oct 30 01:24:27.570079 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1307/2596] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:27 2022] GET /compute/v2.1/servers/87b560b8-33af-4f79-9768-7a7285a06a10 => generated 1324 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:27.575556 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2f30691d-c3f8-4c0a-9172-5b7b52c04f7e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:27.576161 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2f30691d-c3f8-4c0a-9172-5b7b52c04f7e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 32c70d3f-96cd-4b23-a743-05aed245baf0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:27.582046 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2f30691d-c3f8-4c0a-9172-5b7b52c04f7e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:27.582521 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2f30691d-c3f8-4c0a-9172-5b7b52c04f7e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:27.582946 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2f30691d-c3f8-4c0a-9172-5b7b52c04f7e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:27.583844 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2f30691d-c3f8-4c0a-9172-5b7b52c04f7e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:27.584438 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2f30691d-c3f8-4c0a-9172-5b7b52c04f7e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:27.584855 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2f30691d-c3f8-4c0a-9172-5b7b52c04f7e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:27.668987 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-35f70156-39f2-4341-9869-b25be72cff26 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e533367cf3fc4e06a96c6add0540b897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121fd24a0b6b4eb3aa1cac304dda16a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:27.679292 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-35f70156-39f2-4341-9869-b25be72cff26 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e533367cf3fc4e06a96c6add0540b897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121fd24a0b6b4eb3aa1cac304dda16a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:27.681032 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-35f70156-39f2-4341-9869-b25be72cff26 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e533367cf3fc4e06a96c6add0540b897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121fd24a0b6b4eb3aa1cac304dda16a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:27.682464 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-35f70156-39f2-4341-9869-b25be72cff26 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] 10.222.0.13 "GET /compute/v2.1/servers/f5fe2000-b4bf-4636-92fc-72e50c7a7a96" status: 200 len: 1359 microversion: 2.21 time: 0.173229 Oct 30 01:24:27.686416 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1290/2597] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:24:27 2022] GET /compute/v2.1/servers/f5fe2000-b4bf-4636-92fc-72e50c7a7a96 => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:24:27.760394 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-21d72e44-2c3a-417d-98b7-7a66bdad1b60 req-e894b62b-c664-4a72-b607-6511f9b87d19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5fe2000-b4bf-4636-92fc-72e50c7a7a96", "name": "network-vif-plugged", "status": "completed", "tag": "24794f52-84dd-4fd4-adc1-1cc798873d5c"}, {"server_uuid": "87b560b8-33af-4f79-9768-7a7285a06a10", "name": "network-vif-plugged", "status": "completed", "tag": "b893cb0a-5a5f-4bec-a667-ff7aea4c5048"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:24:27.772103 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-21d72e44-2c3a-417d-98b7-7a66bdad1b60 req-e894b62b-c664-4a72-b607-6511f9b87d19 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:27.772589 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-21d72e44-2c3a-417d-98b7-7a66bdad1b60 req-e894b62b-c664-4a72-b607-6511f9b87d19 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:27.773017 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-21d72e44-2c3a-417d-98b7-7a66bdad1b60 req-e894b62b-c664-4a72-b607-6511f9b87d19 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:27.787626 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-21d72e44-2c3a-417d-98b7-7a66bdad1b60 req-e894b62b-c664-4a72-b607-6511f9b87d19 service nova] Creating event network-vif-plugged:24794f52-84dd-4fd4-adc1-1cc798873d5c for instance f5fe2000-b4bf-4636-92fc-72e50c7a7a96 on n-h1-master-1 Oct 30 01:24:27.788131 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-21d72e44-2c3a-417d-98b7-7a66bdad1b60 req-e894b62b-c664-4a72-b607-6511f9b87d19 service nova] Creating event network-vif-plugged:b893cb0a-5a5f-4bec-a667-ff7aea4c5048 for instance 87b560b8-33af-4f79-9768-7a7285a06a10 on n-h2-master-1 Oct 30 01:24:27.796459 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-21d72e44-2c3a-417d-98b7-7a66bdad1b60 req-e894b62b-c664-4a72-b607-6511f9b87d19 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.110732 Oct 30 01:24:27.797278 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1291/2598] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:24:27.802176 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-81fb95fb-8456-42df-acd3-b309543b3036 tempest-FloatingIPDetailsTestJSON-1033028491 tempest-FloatingIPDetailsTestJSON-1033028491-project] Action: 'create', calling method: .version_select at 0x7f44d0437550>, body: {"pool": null} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:24:28.013399 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2f30691d-c3f8-4c0a-9172-5b7b52c04f7e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:28.024213 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2f30691d-c3f8-4c0a-9172-5b7b52c04f7e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0" status: 200 len: 1502 microversion: 2.1 time: 0.450241 Oct 30 01:24:28.024213 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1308/2599] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:27 2022] GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0 => generated 1502 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:28.029204 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0705bad2-8160-468f-8576-6ed798656c86 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Action: 'action', calling method: .version_select at 0x7f44cde52af0>, body: {"addFloatingIp": {"address": "172.35.5.62"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:24:28.031832 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0705bad2-8160-468f-8576-6ed798656c86 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] [instance: 9bd44e90-60a5-4f4d-ae27-a7dffcb3503e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:28.040327 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0705bad2-8160-468f-8576-6ed798656c86 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:28.040965 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0705bad2-8160-468f-8576-6ed798656c86 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:28.041438 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0705bad2-8160-468f-8576-6ed798656c86 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:28.042148 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0705bad2-8160-468f-8576-6ed798656c86 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:28.043102 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0705bad2-8160-468f-8576-6ed798656c86 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:28.043526 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0705bad2-8160-468f-8576-6ed798656c86 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:28.071112 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0705bad2-8160-468f-8576-6ed798656c86 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Acquiring lock "refresh_cache-9bd44e90-60a5-4f4d-ae27-a7dffcb3503e" {{(pid=121102) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 30 01:24:28.071557 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0705bad2-8160-468f-8576-6ed798656c86 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Acquired lock "refresh_cache-9bd44e90-60a5-4f4d-ae27-a7dffcb3503e" {{(pid=121102) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 30 01:24:28.690031 n-d-master-1 devstack@n-api.service[121102]: DEBUG neutronclient.v2_0.client [None req-0705bad2-8160-468f-8576-6ed798656c86 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.35.5.62 (8cb772af-f9d4-4110-8be1-a4feceeca2c0) with port d2ed3272-2b5d-4ab4-90e4-02f9832b391e using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 2814ffb0-9699-49c0-8244-030e5edcf7e8.", "detail": ""}} {{(pid=121102) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 30 01:24:28.691277 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0705bad2-8160-468f-8576-6ed798656c86 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Releasing lock "refresh_cache-9bd44e90-60a5-4f4d-ae27-a7dffcb3503e" {{(pid=121102) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 30 01:24:28.691878 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-0705bad2-8160-468f-8576-6ed798656c86 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] HTTP exception thrown: Cannot associate floating IP 172.35.5.62 (8cb772af-f9d4-4110-8be1-a4feceeca2c0) with port d2ed3272-2b5d-4ab4-90e4-02f9832b391e using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 2814ffb0-9699-49c0-8244-030e5edcf7e8. Oct 30 01:24:28.691878 n-d-master-1 devstack@n-api.service[121102]: Neutron server returns request_ids: ['req-60665915-8d1a-46a9-88f8-61ebbcbdab1a'] Oct 30 01:24:28.694112 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0705bad2-8160-468f-8576-6ed798656c86 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Request method failure captured: Oct 30 01:24:28.694112 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/servers/9bd44e90-60a5-4f4d-ae27-a7dffcb3503e/action HTTP/1.1 Oct 30 01:24:28.694112 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:24:28.694112 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:24:28.694112 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:24:28.694112 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 45 Oct 30 01:24:28.694112 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:24:28.694112 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:24:28.694112 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:24:28.694112 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:24:28.694112 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdIkvQK32ztsDxcYn-yUrHzOz1wf_T9VGlxvk4nwqWdnV76pRk-OA8zN-pznKFXUcdhndGD4RbL17lxTC2Q2LewQsJ61sfedOmJ3hKWxKZTWEATyRzqcietKy_-QJlMYym_dy3A2-cw1_m7OSjVGFG7arQOMCApo5m7M22Zk5TxckzE Oct 30 01:24:28.694112 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:24:28.694112 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:24:28.694112 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:24:28.694112 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:24:28.694112 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:24:28.694112 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:24:28.694112 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 0e4747ca082b4a9b82bb64c9ea2ec750 Oct 30 01:24:28.694112 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 Oct 30 01:24:28.694112 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:24:28.694112 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:24:28.695711 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0e4747ca082b4a9b82bb64c9ea2ec750"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0e4747ca082b4a9b82bb64c9ea2ec750"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0e4747ca082b4a9b82bb64c9ea2ec750"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0e4747ca082b4a9b82bb64c9ea2ec750"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:24:28.695711 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 Oct 30 01:24:28.695711 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 0e4747ca082b4a9b82bb64c9ea2ec750 Oct 30 01:24:28.695711 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 Oct 30 01:24:28.695711 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project Oct 30 01:24:28.695711 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:24:28.695711 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:24:28.695711 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 9cb216afb20940ce9cc86b2d1faab962 Oct 30 01:24:28.695711 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project Oct 30 01:24:28.695711 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:24:28.695711 n-d-master-1 devstack@n-api.service[121102]: {"addFloatingIp": {"address": "172.35.5.62"}} Oct 30 01:24:28.695711 n-d-master-1 devstack@n-api.service[121102]: method: Oct 30 01:24:28.696932 n-d-master-1 devstack@n-api.service[121102]: exception: Cannot associate floating IP 172.35.5.62 (8cb772af-f9d4-4110-8be1-a4feceeca2c0) with port d2ed3272-2b5d-4ab4-90e4-02f9832b391e using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 2814ffb0-9699-49c0-8244-030e5edcf7e8. Oct 30 01:24:28.696932 n-d-master-1 devstack@n-api.service[121102]: Neutron server returns request_ids: ['req-60665915-8d1a-46a9-88f8-61ebbcbdab1a'] Oct 30 01:24:28.696932 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '9bd44e90-60a5-4f4d-ae27-a7dffcb3503e', 'body': {'addFloatingIp': {'address': '172.35.5.62'}}} Oct 30 01:24:28.696932 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:24:28.696932 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:24:28.696932 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 30 01:24:28.696932 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 30 01:24:28.696932 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:24:28.696932 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:24:28.696932 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 30 01:24:28.696932 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 30 01:24:28.696932 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:24:28.696932 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:24:28.696932 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 30 01:24:28.696932 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 30 01:24:28.696932 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:24:28.696932 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:24:28.698155 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 30 01:24:28.698155 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 30 01:24:28.698155 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:24:28.698155 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:24:28.698155 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 30 01:24:28.698155 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 30 01:24:28.698155 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:24:28.698155 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:24:28.698155 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 30 01:24:28.698155 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 30 01:24:28.698155 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:24:28.698155 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:24:28.698155 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 30 01:24:28.698155 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 30 01:24:28.698155 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 30 01:24:28.698155 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 30 01:24:28.700294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.35.5.62 (8cb772af-f9d4-4110-8be1-a4feceeca2c0) with port d2ed3272-2b5d-4ab4-90e4-02f9832b391e using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 2814ffb0-9699-49c0-8244-030e5edcf7e8. Oct 30 01:24:28.700294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-60665915-8d1a-46a9-88f8-61ebbcbdab1a'] Oct 30 01:24:28.700294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:24:28.700294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:24:28.700294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:24:28.700294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:24:28.700294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 30 01:24:28.700294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 30 01:24:28.700294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 30 01:24:28.700294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 30 01:24:28.700294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 30 01:24:28.700294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 30 01:24:28.700294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.35.5.62 (8cb772af-f9d4-4110-8be1-a4feceeca2c0) with port d2ed3272-2b5d-4ab4-90e4-02f9832b391e using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 2814ffb0-9699-49c0-8244-030e5edcf7e8. Oct 30 01:24:28.700294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-60665915-8d1a-46a9-88f8-61ebbcbdab1a'] Oct 30 01:24:28.700294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:24:28.700294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:24:28.701861 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:24:28.701861 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:24:28.701861 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:24:28.701861 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:24:28.701861 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:24:28.701861 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:24:28.701861 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:24:28.701861 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:24:28.701861 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:24:28.701861 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:24:28.701861 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:24:28.701861 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:24:28.701861 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 30 01:24:28.701861 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 30 01:24:28.701861 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.35.5.62 (8cb772af-f9d4-4110-8be1-a4feceeca2c0) with port d2ed3272-2b5d-4ab4-90e4-02f9832b391e using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 2814ffb0-9699-49c0-8244-030e5edcf7e8. Oct 30 01:24:28.701861 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-60665915-8d1a-46a9-88f8-61ebbcbdab1a'] Oct 30 01:24:28.701861 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:24:28.701861 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:24:28.703107 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:24:28.703107 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:24:28.703107 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:24:28.703107 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:24:28.703107 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:24:28.703107 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:24:28.703107 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.35.5.62 (8cb772af-f9d4-4110-8be1-a4feceeca2c0) with port d2ed3272-2b5d-4ab4-90e4-02f9832b391e using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 2814ffb0-9699-49c0-8244-030e5edcf7e8. Oct 30 01:24:28.703107 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-60665915-8d1a-46a9-88f8-61ebbcbdab1a'] Oct 30 01:24:28.703107 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:24:28.703107 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0705bad2-8160-468f-8576-6ed798656c86 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Returning 400 to user: Cannot associate floating IP 172.35.5.62 (8cb772af-f9d4-4110-8be1-a4feceeca2c0) with port d2ed3272-2b5d-4ab4-90e4-02f9832b391e using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 2814ffb0-9699-49c0-8244-030e5edcf7e8. Oct 30 01:24:28.703107 n-d-master-1 devstack@n-api.service[121102]: Neutron server returns request_ids: ['req-60665915-8d1a-46a9-88f8-61ebbcbdab1a'] {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:24:28.703957 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0705bad2-8160-468f-8576-6ed798656c86 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] 10.222.0.13 "POST /compute/v2.1/servers/9bd44e90-60a5-4f4d-ae27-a7dffcb3503e/action" status: 400 len: 381 microversion: 2.1 time: 0.671572 Oct 30 01:24:28.703957 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1309/2600] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:24:28 2022] POST /compute/v2.1/servers/9bd44e90-60a5-4f4d-ae27-a7dffcb3503e/action => generated 381 bytes in 673 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:24:28.703957 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a4909561-bd98-4ecd-8fce-72010177dd31 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:28.703957 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a4909561-bd98-4ecd-8fce-72010177dd31 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: 403e0292-c082-4655-ad08-b5dc3a7f8305] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:28.711358 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a4909561-bd98-4ecd-8fce-72010177dd31 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:28.712218 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a4909561-bd98-4ecd-8fce-72010177dd31 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:28.712352 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a4909561-bd98-4ecd-8fce-72010177dd31 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:28.712946 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a4909561-bd98-4ecd-8fce-72010177dd31 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:28.713441 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a4909561-bd98-4ecd-8fce-72010177dd31 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:28.713837 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a4909561-bd98-4ecd-8fce-72010177dd31 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:28.851189 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a4909561-bd98-4ecd-8fce-72010177dd31 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:28.859110 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a4909561-bd98-4ecd-8fce-72010177dd31 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305" status: 200 len: 1496 microversion: 2.1 time: 0.160250 Oct 30 01:24:28.859674 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1310/2601] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:28 2022] GET /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305 => generated 1496 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:28.864221 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-04611d9e-8c12-435a-93fe-11888de342b5 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:28.864782 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-04611d9e-8c12-435a-93fe-11888de342b5 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] [instance: 3b6bf22e-53a4-481d-8764-d6a4b9c95d3e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:28.870894 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04611d9e-8c12-435a-93fe-11888de342b5 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:28.871387 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04611d9e-8c12-435a-93fe-11888de342b5 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:28.871829 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04611d9e-8c12-435a-93fe-11888de342b5 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:28.872529 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04611d9e-8c12-435a-93fe-11888de342b5 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:28.872983 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04611d9e-8c12-435a-93fe-11888de342b5 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:28.873506 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04611d9e-8c12-435a-93fe-11888de342b5 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:28.904425 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-04611d9e-8c12-435a-93fe-11888de342b5 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] [instance: 3b6bf22e-53a4-481d-8764-d6a4b9c95d3e] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:24:29.204224 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-04611d9e-8c12-435a-93fe-11888de342b5 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3b6bf22e-53a4-481d-8764-d6a4b9c95d3e" status: 204 len: 0 microversion: 2.1 time: 0.343275 Oct 30 01:24:29.204970 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1311/2602] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:24:28 2022] DELETE /compute/v2.1/servers/3b6bf22e-53a4-481d-8764-d6a4b9c95d3e => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:24:29.211488 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f63f5bfd-3736-4eb3-af3a-cf4b2dbfacf4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:24:29.218361 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f63f5bfd-3736-4eb3-af3a-cf4b2dbfacf4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:29.218863 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f63f5bfd-3736-4eb3-af3a-cf4b2dbfacf4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:29.219307 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f63f5bfd-3736-4eb3-af3a-cf4b2dbfacf4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:29.283917 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f63f5bfd-3736-4eb3-af3a-cf4b2dbfacf4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 32c70d3f-96cd-4b23-a743-05aed245baf0] Going to try to stop instance {{(pid=121102) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 30 01:24:29.487054 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f63f5bfd-3736-4eb3-af3a-cf4b2dbfacf4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "POST /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0/action" status: 202 len: 0 microversion: 2.1 time: 0.279824 Oct 30 01:24:29.487582 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1312/2603] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:24:29 2022] POST /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0/action => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:24:29.492562 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a9eec84c-fa51-4267-a440-fb7de26ae962 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:29.493256 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a9eec84c-fa51-4267-a440-fb7de26ae962 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] [instance: 87b560b8-33af-4f79-9768-7a7285a06a10] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:29.501503 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a9eec84c-fa51-4267-a440-fb7de26ae962 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:29.501503 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a9eec84c-fa51-4267-a440-fb7de26ae962 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:29.501503 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a9eec84c-fa51-4267-a440-fb7de26ae962 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:29.501803 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a9eec84c-fa51-4267-a440-fb7de26ae962 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:29.502066 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a9eec84c-fa51-4267-a440-fb7de26ae962 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:29.502484 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a9eec84c-fa51-4267-a440-fb7de26ae962 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:29.743010 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a9eec84c-fa51-4267-a440-fb7de26ae962 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8b2c03e5294bbe9ee8cda7468c9d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada31213f567489299af80277ee35f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:29.751432 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a9eec84c-fa51-4267-a440-fb7de26ae962 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] 10.222.0.13 "GET /compute/v2.1/servers/87b560b8-33af-4f79-9768-7a7285a06a10" status: 200 len: 1520 microversion: 2.1 time: 0.262697 Oct 30 01:24:29.751966 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1313/2604] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:29 2022] GET /compute/v2.1/servers/87b560b8-33af-4f79-9768-7a7285a06a10 => generated 1520 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:29.754959 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-81fb95fb-8456-42df-acd3-b309543b3036 tempest-FloatingIPDetailsTestJSON-1033028491 tempest-FloatingIPDetailsTestJSON-1033028491-project] 10.222.0.13 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.956590 Oct 30 01:24:29.756239 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1292/2605] 10.222.0.13 () {60 vars in 1170 bytes} [Sun Oct 30 01:24:27 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1959 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:24:29.756460 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-efa19813-d1e7-41e9-b58c-027e8b0a1519 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Calling method '.version_select at 0x7f44c7779ca0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:29.762084 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-aa3b1029-80eb-4dd2-8b51-0f4b43754520 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:29.762852 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-aa3b1029-80eb-4dd2-8b51-0f4b43754520 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] [instance: f5fe2000-b4bf-4636-92fc-72e50c7a7a96] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:29.770729 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa3b1029-80eb-4dd2-8b51-0f4b43754520 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:29.772344 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa3b1029-80eb-4dd2-8b51-0f4b43754520 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:29.772344 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa3b1029-80eb-4dd2-8b51-0f4b43754520 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:29.772774 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa3b1029-80eb-4dd2-8b51-0f4b43754520 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:29.773328 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa3b1029-80eb-4dd2-8b51-0f4b43754520 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:29.773878 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa3b1029-80eb-4dd2-8b51-0f4b43754520 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:30.286788 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-aa3b1029-80eb-4dd2-8b51-0f4b43754520 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e533367cf3fc4e06a96c6add0540b897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121fd24a0b6b4eb3aa1cac304dda16a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:30.296611 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-aa3b1029-80eb-4dd2-8b51-0f4b43754520 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e533367cf3fc4e06a96c6add0540b897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121fd24a0b6b4eb3aa1cac304dda16a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:30.298516 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-aa3b1029-80eb-4dd2-8b51-0f4b43754520 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e533367cf3fc4e06a96c6add0540b897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121fd24a0b6b4eb3aa1cac304dda16a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:30.299683 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-aa3b1029-80eb-4dd2-8b51-0f4b43754520 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] 10.222.0.13 "GET /compute/v2.1/servers/f5fe2000-b4bf-4636-92fc-72e50c7a7a96" status: 200 len: 1359 microversion: 2.21 time: 0.542060 Oct 30 01:24:30.300248 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1293/2606] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:24:29 2022] GET /compute/v2.1/servers/f5fe2000-b4bf-4636-92fc-72e50c7a7a96 => generated 1359 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:24:30.304643 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7de31916-11ca-47ba-a2e3-4873f8bbfb00 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:30.305250 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7de31916-11ca-47ba-a2e3-4873f8bbfb00 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] [instance: 3b6bf22e-53a4-481d-8764-d6a4b9c95d3e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:30.313044 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7de31916-11ca-47ba-a2e3-4873f8bbfb00 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:30.313569 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7de31916-11ca-47ba-a2e3-4873f8bbfb00 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:30.314009 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7de31916-11ca-47ba-a2e3-4873f8bbfb00 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:30.314703 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7de31916-11ca-47ba-a2e3-4873f8bbfb00 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:30.315194 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7de31916-11ca-47ba-a2e3-4873f8bbfb00 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:30.315616 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7de31916-11ca-47ba-a2e3-4873f8bbfb00 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:30.581317 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7de31916-11ca-47ba-a2e3-4873f8bbfb00 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e23e3096f740508e6fb6626a29336f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5e20978d1a4886b04d37eef4c23d1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:30.589068 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7de31916-11ca-47ba-a2e3-4873f8bbfb00 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] 10.222.0.13 "GET /compute/v2.1/servers/3b6bf22e-53a4-481d-8764-d6a4b9c95d3e" status: 200 len: 1712 microversion: 2.1 time: 0.287837 Oct 30 01:24:30.589689 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1294/2607] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:30 2022] GET /compute/v2.1/servers/3b6bf22e-53a4-481d-8764-d6a4b9c95d3e => generated 1712 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:30.594109 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4952189a-8084-4693-9ec6-a1ca82629dc4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:30.594937 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4952189a-8084-4693-9ec6-a1ca82629dc4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 32c70d3f-96cd-4b23-a743-05aed245baf0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:30.600380 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4952189a-8084-4693-9ec6-a1ca82629dc4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:30.600863 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4952189a-8084-4693-9ec6-a1ca82629dc4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:30.601305 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4952189a-8084-4693-9ec6-a1ca82629dc4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:30.602029 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4952189a-8084-4693-9ec6-a1ca82629dc4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:30.602486 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4952189a-8084-4693-9ec6-a1ca82629dc4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:30.602914 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4952189a-8084-4693-9ec6-a1ca82629dc4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:30.804402 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4952189a-8084-4693-9ec6-a1ca82629dc4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:30.812725 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4952189a-8084-4693-9ec6-a1ca82629dc4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0" status: 200 len: 1512 microversion: 2.1 time: 0.222065 Oct 30 01:24:30.813307 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1295/2608] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:30 2022] GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0 => generated 1512 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:30.817770 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-69857720-526c-4e67-8712-b3203e80dd35 tempest-FloatingIPDetailsTestJSON-1033028491 tempest-FloatingIPDetailsTestJSON-1033028491-project] Calling method '.version_select at 0x7f44d04753a0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:31.051195 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-69857720-526c-4e67-8712-b3203e80dd35 tempest-FloatingIPDetailsTestJSON-1033028491 tempest-FloatingIPDetailsTestJSON-1033028491-project] 10.222.0.13 "GET /compute/v2.1/os-floating-ips/b9cf0ba5-5b36-4a16-9244-a44ec5ba808a" status: 200 len: 141 microversion: 2.1 time: 0.236790 Oct 30 01:24:31.052007 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1296/2609] 10.222.0.13 () {58 vars in 1260 bytes} [Sun Oct 30 01:24:30 2022] GET /compute/v2.1/os-floating-ips/b9cf0ba5-5b36-4a16-9244-a44ec5ba808a => generated 141 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:24:31.065949 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-411107e3-6a95-421a-8406-aff471900117 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-231824664", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "9c3e4699-5176-48ab-a2ba-0807db051e7a"}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:24:31.071914 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-411107e3-6a95-421a-8406-aff471900117 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Request method failure captured: Oct 30 01:24:31.071914 n-d-master-1 devstack@n-api.service[121103]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 30 01:24:31.071914 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:24:31.071914 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:24:31.071914 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:24:31.071914 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 242 Oct 30 01:24:31.071914 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:24:31.071914 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:24:31.071914 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:24:31.071914 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:24:31.071914 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdI7hXmuB1XI9FOCgUfxzJI5vCMAF9BU13eyJ1J1MmqCYl7o24KgF4cpHFtnJOecvtKlCxL7mDkf35OgczUAmWERkib7Iw2gr_NqZwZXCas5gkF2eMwYl8otydw7z4f_KCB8bmLznDDS0uWUpHBKNLlCCl_QgpBai_9lfdnE9xs2KEQ Oct 30 01:24:31.071914 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:24:31.071914 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:24:31.071914 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:24:31.071914 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:24:31.071914 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:24:31.071914 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:24:31.071914 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: ada31213f567489299af80277ee35f65 Oct 30 01:24:31.071914 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1199645215 Oct 30 01:24:31.071914 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:24:31.071914 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:24:31.073439 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ada31213f567489299af80277ee35f65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ada31213f567489299af80277ee35f65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ada31213f567489299af80277ee35f65"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ada31213f567489299af80277ee35f65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:24:31.073439 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1199645215 Oct 30 01:24:31.073439 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: ada31213f567489299af80277ee35f65 Oct 30 01:24:31.073439 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1199645215 Oct 30 01:24:31.073439 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServerMetadataNegativeTestJSON-1199645215-project Oct 30 01:24:31.073439 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:24:31.073439 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:24:31.073439 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 6e8b2c03e5294bbe9ee8cda7468c9d86 Oct 30 01:24:31.073439 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1199645215-project Oct 30 01:24:31.073439 n-d-master-1 devstack@n-api.service[121103]: Oct 30 01:24:31.073439 n-d-master-1 devstack@n-api.service[121103]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-231824664", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "9c3e4699-5176-48ab-a2ba-0807db051e7a"}]}} Oct 30 01:24:31.074196 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:24:31.074196 n-d-master-1 devstack@n-api.service[121103]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 30 01:24:31.074196 n-d-master-1 devstack@n-api.service[121103]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-231824664', 'imageRef': 'deb14158-45d8-4539-889d-ff9726d046d7', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '9c3e4699-5176-48ab-a2ba-0807db051e7a'}]}}} Oct 30 01:24:31.074196 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:24:31.074196 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:24:31.074196 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 30 01:24:31.074196 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 30 01:24:31.074196 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 30 01:24:31.074196 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise error Oct 30 01:24:31.074196 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 30 01:24:31.074196 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:24:31.074196 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 30 01:24:31.074196 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 30 01:24:31.074196 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 30 01:24:31.074196 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 30 01:24:31.074196 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 30 01:24:31.074196 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:24:31.074196 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 30 01:24:31.074196 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 30 01:24:31.075818 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:24:31.075818 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:24:31.075818 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:24:31.075818 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:24:31.075818 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:24:31.075818 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:24:31.075818 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:24:31.075818 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:24:31.075818 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:24:31.075818 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:24:31.075818 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:24:31.075818 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:24:31.075818 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 30 01:24:31.075818 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 30 01:24:31.075818 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 30 01:24:31.075818 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 30 01:24:31.075818 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 30 01:24:31.075818 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 30 01:24:31.075818 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 30 01:24:31.075818 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:24:31.077252 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:24:31.077252 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:24:31.077252 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:24:31.077252 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:24:31.077252 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:24:31.077252 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 30 01:24:31.077252 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 30 01:24:31.077252 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 30 01:24:31.077252 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:24:31.077252 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-411107e3-6a95-421a-8406-aff471900117 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:24:31.077252 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-411107e3-6a95-421a-8406-aff471900117 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.012374 Oct 30 01:24:31.078090 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1297/2610] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:24:31 2022] POST /compute/v2.1/servers => generated 175 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:24:31.083579 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b14a7a92-62c7-4773-996f-19a2d9d68a24 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:31.084248 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b14a7a92-62c7-4773-996f-19a2d9d68a24 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: 403e0292-c082-4655-ad08-b5dc3a7f8305] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:31.091494 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b14a7a92-62c7-4773-996f-19a2d9d68a24 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:31.092203 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b14a7a92-62c7-4773-996f-19a2d9d68a24 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:31.092704 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b14a7a92-62c7-4773-996f-19a2d9d68a24 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:31.093661 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b14a7a92-62c7-4773-996f-19a2d9d68a24 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:31.094180 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b14a7a92-62c7-4773-996f-19a2d9d68a24 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:31.094692 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b14a7a92-62c7-4773-996f-19a2d9d68a24 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:31.125508 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-efa19813-d1e7-41e9-b58c-027e8b0a1519 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] 10.222.0.13 "DELETE /compute/v2.1/os-floating-ips/8cb772af-f9d4-4110-8be1-a4feceeca2c0" status: 202 len: 0 microversion: 2.1 time: 1.372458 Oct 30 01:24:31.129224 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1314/2611] 10.222.0.13 () {58 vars in 1263 bytes} [Sun Oct 30 01:24:29 2022] DELETE /compute/v2.1/os-floating-ips/8cb772af-f9d4-4110-8be1-a4feceeca2c0 => generated 0 bytes in 1374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:24:31.133323 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-18856362-4163-4da3-917c-a176b743081f tempest-FloatingIPDetailsTestJSON-1033028491 tempest-FloatingIPDetailsTestJSON-1033028491-project] Calling method '.version_select at 0x7f44c76b9040>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:31.325125 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b14a7a92-62c7-4773-996f-19a2d9d68a24 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:31.337903 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b14a7a92-62c7-4773-996f-19a2d9d68a24 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305" status: 200 len: 1496 microversion: 2.1 time: 0.258073 Oct 30 01:24:31.346611 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1298/2612] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:31 2022] GET /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305 => generated 1496 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:31.351500 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f4e1b178-8837-4043-a96d-4c20ce9d6f7a tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:31.352197 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f4e1b178-8837-4043-a96d-4c20ce9d6f7a tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] [instance: 26a407a3-3138-45b9-af94-532bb73efd8f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:31.358708 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-f4e1b178-8837-4043-a96d-4c20ce9d6f7a tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] HTTP exception thrown: Instance 26a407a3-3138-45b9-af94-532bb73efd8f could not be found. Oct 30 01:24:31.369066 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f4e1b178-8837-4043-a96d-4c20ce9d6f7a tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Request method failure captured: Oct 30 01:24:31.369066 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/26a407a3-3138-45b9-af94-532bb73efd8f/metadata HTTP/1.1 Oct 30 01:24:31.369066 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:24:31.369066 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:24:31.369066 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:24:31.369066 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:24:31.369066 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:24:31.369066 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:24:31.369066 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:24:31.369066 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:24:31.369066 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdI7hXmuB1XI9FOCgUfxzJI5vCMAF9BU13eyJ1J1MmqCYl7o24KgF4cpHFtnJOecvtKlCxL7mDkf35OgczUAmWERkib7Iw2gr_NqZwZXCas5gkF2eMwYl8otydw7z4f_KCB8bmLznDDS0uWUpHBKNLlCCl_QgpBai_9lfdnE9xs2KEQ Oct 30 01:24:31.369066 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:24:31.369066 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:24:31.369066 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:24:31.369066 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:24:31.369066 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:24:31.369066 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:24:31.369066 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: ada31213f567489299af80277ee35f65 Oct 30 01:24:31.369066 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1199645215 Oct 30 01:24:31.369066 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:24:31.369066 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:24:31.370583 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ada31213f567489299af80277ee35f65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ada31213f567489299af80277ee35f65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ada31213f567489299af80277ee35f65"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ada31213f567489299af80277ee35f65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:24:31.370583 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1199645215 Oct 30 01:24:31.370583 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: ada31213f567489299af80277ee35f65 Oct 30 01:24:31.370583 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1199645215 Oct 30 01:24:31.370583 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServerMetadataNegativeTestJSON-1199645215-project Oct 30 01:24:31.370583 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:24:31.370583 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:24:31.370583 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 6e8b2c03e5294bbe9ee8cda7468c9d86 Oct 30 01:24:31.370583 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1199645215-project Oct 30 01:24:31.370583 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:24:31.370583 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 26a407a3-3138-45b9-af94-532bb73efd8f could not be found. Oct 30 01:24:31.371362 n-d-master-1 devstack@n-api.service[121103]: action_args: {'server_id': '26a407a3-3138-45b9-af94-532bb73efd8f'} Oct 30 01:24:31.371362 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:24:31.371362 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:24:31.371362 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:24:31.371362 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:24:31.371362 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:24:31.371362 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:24:31.371362 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 30 01:24:31.371362 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 30 01:24:31.371362 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26a407a3-3138-45b9-af94-532bb73efd8f could not be found. Oct 30 01:24:31.371362 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:24:31.371362 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:24:31.371362 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:24:31.371362 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:24:31.371362 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:24:31.371362 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:24:31.371362 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:24:31.371362 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:24:31.371362 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:24:31.371362 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:24:31.372857 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 30 01:24:31.372857 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 30 01:24:31.372857 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:24:31.372857 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:24:31.372857 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26a407a3-3138-45b9-af94-532bb73efd8f could not be found. Oct 30 01:24:31.372857 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:24:31.372857 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:24:31.372857 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:24:31.372857 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:24:31.372857 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:24:31.372857 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:24:31.372857 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:24:31.372857 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:24:31.372857 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26a407a3-3138-45b9-af94-532bb73efd8f could not be found. Oct 30 01:24:31.372857 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:24:31.372857 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f4e1b178-8837-4043-a96d-4c20ce9d6f7a tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Returning 404 to user: Instance 26a407a3-3138-45b9-af94-532bb73efd8f could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:24:31.373997 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f4e1b178-8837-4043-a96d-4c20ce9d6f7a tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] 10.222.0.13 "GET /compute/v2.1/servers/26a407a3-3138-45b9-af94-532bb73efd8f/metadata" status: 404 len: 111 microversion: 2.1 time: 0.022945 Oct 30 01:24:31.378246 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1299/2613] 10.222.0.13 () {58 vars in 1263 bytes} [Sun Oct 30 01:24:31 2022] GET /compute/v2.1/servers/26a407a3-3138-45b9-af94-532bb73efd8f/metadata => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:24:31.383539 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-389401f3-95d6-4a17-abef-409bb5c88dfb tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.5.105"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:24:31.680107 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-389401f3-95d6-4a17-abef-409bb5c88dfb tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] [instance: 9bd44e90-60a5-4f4d-ae27-a7dffcb3503e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:31.687033 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-389401f3-95d6-4a17-abef-409bb5c88dfb tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:31.687533 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-389401f3-95d6-4a17-abef-409bb5c88dfb tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:31.687964 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-389401f3-95d6-4a17-abef-409bb5c88dfb tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:31.689005 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-389401f3-95d6-4a17-abef-409bb5c88dfb tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:31.689775 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-389401f3-95d6-4a17-abef-409bb5c88dfb tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:31.690491 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-389401f3-95d6-4a17-abef-409bb5c88dfb tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:32.000847 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-389401f3-95d6-4a17-abef-409bb5c88dfb tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Acquiring lock "refresh_cache-9bd44e90-60a5-4f4d-ae27-a7dffcb3503e" {{(pid=121103) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 30 01:24:32.001464 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-389401f3-95d6-4a17-abef-409bb5c88dfb tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Acquired lock "refresh_cache-9bd44e90-60a5-4f4d-ae27-a7dffcb3503e" {{(pid=121103) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 30 01:24:32.434971 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-18856362-4163-4da3-917c-a176b743081f tempest-FloatingIPDetailsTestJSON-1033028491 tempest-FloatingIPDetailsTestJSON-1033028491-project] 10.222.0.13 "DELETE /compute/v2.1/os-floating-ips/b9cf0ba5-5b36-4a16-9244-a44ec5ba808a" status: 202 len: 0 microversion: 2.1 time: 1.307450 Oct 30 01:24:32.436015 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1315/2614] 10.222.0.13 () {58 vars in 1263 bytes} [Sun Oct 30 01:24:31 2022] DELETE /compute/v2.1/os-floating-ips/b9cf0ba5-5b36-4a16-9244-a44ec5ba808a => generated 0 bytes in 1309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:24:32.441771 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7efb41a9-14ad-42b2-ae96-8dd5cb7313f0 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:32.441771 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7efb41a9-14ad-42b2-ae96-8dd5cb7313f0 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] [instance: f5fe2000-b4bf-4636-92fc-72e50c7a7a96] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:32.448116 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7efb41a9-14ad-42b2-ae96-8dd5cb7313f0 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:32.448607 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7efb41a9-14ad-42b2-ae96-8dd5cb7313f0 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:32.449865 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7efb41a9-14ad-42b2-ae96-8dd5cb7313f0 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:32.450565 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7efb41a9-14ad-42b2-ae96-8dd5cb7313f0 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:32.451008 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7efb41a9-14ad-42b2-ae96-8dd5cb7313f0 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:32.451429 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7efb41a9-14ad-42b2-ae96-8dd5cb7313f0 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:32.676927 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7efb41a9-14ad-42b2-ae96-8dd5cb7313f0 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e533367cf3fc4e06a96c6add0540b897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121fd24a0b6b4eb3aa1cac304dda16a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:32.688454 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7efb41a9-14ad-42b2-ae96-8dd5cb7313f0 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e533367cf3fc4e06a96c6add0540b897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121fd24a0b6b4eb3aa1cac304dda16a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:32.690535 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7efb41a9-14ad-42b2-ae96-8dd5cb7313f0 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e533367cf3fc4e06a96c6add0540b897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121fd24a0b6b4eb3aa1cac304dda16a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:32.692581 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7efb41a9-14ad-42b2-ae96-8dd5cb7313f0 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] 10.222.0.13 "GET /compute/v2.1/servers/f5fe2000-b4bf-4636-92fc-72e50c7a7a96" status: 200 len: 1553 microversion: 2.21 time: 0.255428 Oct 30 01:24:32.693525 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1316/2615] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:24:32 2022] GET /compute/v2.1/servers/f5fe2000-b4bf-4636-92fc-72e50c7a7a96 => generated 1553 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:24:32.711318 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5f64fa36-80fd-4b88-9d2e-b790b23977cb tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1681739955", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "9c3e4699-5176-48ab-a2ba-0807db051e7a"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:24:32.717892 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5f64fa36-80fd-4b88-9d2e-b790b23977cb tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Request method failure captured: Oct 30 01:24:32.717892 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 30 01:24:32.717892 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:24:32.717892 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:24:32.717892 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:24:32.717892 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 499 Oct 30 01:24:32.717892 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:24:32.717892 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:24:32.717892 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:24:32.717892 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:24:32.717892 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdI7hXmuB1XI9FOCgUfxzJI5vCMAF9BU13eyJ1J1MmqCYl7o24KgF4cpHFtnJOecvtKlCxL7mDkf35OgczUAmWERkib7Iw2gr_NqZwZXCas5gkF2eMwYl8otydw7z4f_KCB8bmLznDDS0uWUpHBKNLlCCl_QgpBai_9lfdnE9xs2KEQ Oct 30 01:24:32.717892 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:24:32.717892 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:24:32.717892 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:24:32.717892 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:24:32.717892 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:24:32.717892 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:24:32.717892 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: ada31213f567489299af80277ee35f65 Oct 30 01:24:32.717892 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1199645215 Oct 30 01:24:32.717892 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:24:32.717892 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:24:32.719349 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ada31213f567489299af80277ee35f65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ada31213f567489299af80277ee35f65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ada31213f567489299af80277ee35f65"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ada31213f567489299af80277ee35f65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:24:32.719349 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1199645215 Oct 30 01:24:32.719349 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: ada31213f567489299af80277ee35f65 Oct 30 01:24:32.719349 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1199645215 Oct 30 01:24:32.719349 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServerMetadataNegativeTestJSON-1199645215-project Oct 30 01:24:32.719349 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:24:32.719349 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:24:32.719349 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 6e8b2c03e5294bbe9ee8cda7468c9d86 Oct 30 01:24:32.719349 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1199645215-project Oct 30 01:24:32.719349 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:24:32.719903 n-d-master-1 devstack@n-api.service[121102]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1681739955", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "9c3e4699-5176-48ab-a2ba-0807db051e7a"}]}} Oct 30 01:24:32.719903 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:24:32.719903 n-d-master-1 devstack@n-api.service[121102]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 30 01:24:32.719903 n-d-master-1 devstack@n-api.service[121102]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1681739955', 'imageRef': 'deb14158-45d8-4539-889d-ff9726d046d7', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '9c3e4699-5176-48ab-a2ba-0807db051e7a'}]}}} Oct 30 01:24:32.719903 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:24:32.719903 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:24:32.720312 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 30 01:24:32.720312 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 30 01:24:32.720312 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 30 01:24:32.720312 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise error Oct 30 01:24:32.720312 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 30 01:24:32.720312 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:24:32.720312 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 30 01:24:32.720312 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 30 01:24:32.720312 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 30 01:24:32.720312 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 30 01:24:32.720312 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 30 01:24:32.720312 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:24:32.720312 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 30 01:24:32.720312 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 30 01:24:32.720312 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:24:32.720312 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:24:32.720312 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:24:32.721397 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:24:32.721397 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:24:32.721397 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:24:32.721397 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:24:32.721397 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:24:32.721397 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:24:32.721397 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:24:32.721397 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:24:32.721397 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:24:32.721397 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 30 01:24:32.721397 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 30 01:24:32.721397 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 30 01:24:32.721397 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 30 01:24:32.721397 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 30 01:24:32.721397 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 30 01:24:32.725639 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 30 01:24:32.725639 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:24:32.725639 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:24:32.725639 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:24:32.725639 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:24:32.725639 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:24:32.725639 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:24:32.725639 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 30 01:24:32.725639 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 30 01:24:32.726289 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 30 01:24:32.726289 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:24:32.726289 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5f64fa36-80fd-4b88-9d2e-b790b23977cb tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:24:32.726501 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5f64fa36-80fd-4b88-9d2e-b790b23977cb tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.028794 Oct 30 01:24:32.726501 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1317/2616] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:24:32 2022] POST /compute/v2.1/servers => generated 687 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:24:32.731456 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-469746a4-1166-437d-8539-2c588b5fc79d tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:32.732778 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-469746a4-1166-437d-8539-2c588b5fc79d tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] [instance: 3b6bf22e-53a4-481d-8764-d6a4b9c95d3e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:32.746906 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-469746a4-1166-437d-8539-2c588b5fc79d tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:32.747464 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-469746a4-1166-437d-8539-2c588b5fc79d tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:32.747900 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-469746a4-1166-437d-8539-2c588b5fc79d tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:32.749241 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-469746a4-1166-437d-8539-2c588b5fc79d tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:32.749732 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-469746a4-1166-437d-8539-2c588b5fc79d tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:32.750156 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-469746a4-1166-437d-8539-2c588b5fc79d tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:32.790154 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-469746a4-1166-437d-8539-2c588b5fc79d tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:32.793625 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-469746a4-1166-437d-8539-2c588b5fc79d tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:32.793625 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-469746a4-1166-437d-8539-2c588b5fc79d tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:32.793625 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-469746a4-1166-437d-8539-2c588b5fc79d tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lazy-loading 'fault' on Instance uuid 3b6bf22e-53a4-481d-8764-d6a4b9c95d3e {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:24:32.845056 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-469746a4-1166-437d-8539-2c588b5fc79d tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e23e3096f740508e6fb6626a29336f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5e20978d1a4886b04d37eef4c23d1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:32.853159 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-469746a4-1166-437d-8539-2c588b5fc79d tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] 10.222.0.13 "GET /compute/v2.1/servers/3b6bf22e-53a4-481d-8764-d6a4b9c95d3e" status: 200 len: 1366 microversion: 2.1 time: 0.128118 Oct 30 01:24:32.854009 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1318/2617] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:32 2022] GET /compute/v2.1/servers/3b6bf22e-53a4-481d-8764-d6a4b9c95d3e => generated 1366 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:32.864681 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0e654f38-e23e-4c60-bd34-43f19ce5ec19 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:32.865540 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0e654f38-e23e-4c60-bd34-43f19ce5ec19 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 32c70d3f-96cd-4b23-a743-05aed245baf0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:32.871971 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e654f38-e23e-4c60-bd34-43f19ce5ec19 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:32.872644 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e654f38-e23e-4c60-bd34-43f19ce5ec19 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:32.873244 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e654f38-e23e-4c60-bd34-43f19ce5ec19 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:32.874118 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e654f38-e23e-4c60-bd34-43f19ce5ec19 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:32.874727 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e654f38-e23e-4c60-bd34-43f19ce5ec19 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:32.875320 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e654f38-e23e-4c60-bd34-43f19ce5ec19 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:33.038087 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-389401f3-95d6-4a17-abef-409bb5c88dfb tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] [instance: 9bd44e90-60a5-4f4d-ae27-a7dffcb3503e] Building network info cache for instance {{(pid=121103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 30 01:24:33.133248 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0e654f38-e23e-4c60-bd34-43f19ce5ec19 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:33.141842 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0e654f38-e23e-4c60-bd34-43f19ce5ec19 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0" status: 200 len: 1512 microversion: 2.1 time: 0.286453 Oct 30 01:24:33.142767 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1319/2618] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:32 2022] GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0 => generated 1512 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:33.215722 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-a2ce5448-ee6c-4d89-b41d-76d2e75d1c7c req-200fc3b5-6208-4ae4-a05d-d0b379d41412 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b6bf22e-53a4-481d-8764-d6a4b9c95d3e", "name": "network-vif-deleted", "tag": "e352aa9c-6a08-4d25-ade5-2bdc70668051"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:24:33.225956 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-a2ce5448-ee6c-4d89-b41d-76d2e75d1c7c req-200fc3b5-6208-4ae4-a05d-d0b379d41412 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:33.226670 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-a2ce5448-ee6c-4d89-b41d-76d2e75d1c7c req-200fc3b5-6208-4ae4-a05d-d0b379d41412 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:33.227206 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-a2ce5448-ee6c-4d89-b41d-76d2e75d1c7c req-200fc3b5-6208-4ae4-a05d-d0b379d41412 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:33.245095 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-a2ce5448-ee6c-4d89-b41d-76d2e75d1c7c req-200fc3b5-6208-4ae4-a05d-d0b379d41412 service nova] Creating event network-vif-deleted:e352aa9c-6a08-4d25-ade5-2bdc70668051 for instance 3b6bf22e-53a4-481d-8764-d6a4b9c95d3e on n-h2-master-1 Oct 30 01:24:33.250538 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-a2ce5448-ee6c-4d89-b41d-76d2e75d1c7c req-200fc3b5-6208-4ae4-a05d-d0b379d41412 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106252 Oct 30 01:24:33.251592 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1320/2619] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:24:33.258192 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fc32d67b-e556-435f-9ca7-3eb5735e315b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:33.259631 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fc32d67b-e556-435f-9ca7-3eb5735e315b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: 403e0292-c082-4655-ad08-b5dc3a7f8305] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:33.267092 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fc32d67b-e556-435f-9ca7-3eb5735e315b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:33.267799 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fc32d67b-e556-435f-9ca7-3eb5735e315b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:33.268416 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fc32d67b-e556-435f-9ca7-3eb5735e315b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:33.269274 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fc32d67b-e556-435f-9ca7-3eb5735e315b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:33.269901 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fc32d67b-e556-435f-9ca7-3eb5735e315b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:33.270468 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fc32d67b-e556-435f-9ca7-3eb5735e315b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:33.529981 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-fc32d67b-e556-435f-9ca7-3eb5735e315b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:33.539256 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fc32d67b-e556-435f-9ca7-3eb5735e315b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305" status: 200 len: 1496 microversion: 2.1 time: 0.286259 Oct 30 01:24:33.539863 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1321/2620] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:33 2022] GET /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305 => generated 1496 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:33.549151 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4f9625ac-f2ed-4f26-b865-4696e0da5347 tempest-FloatingIPDetailsTestJSON-1033028491 tempest-FloatingIPDetailsTestJSON-1033028491-project] Calling method '.version_select at 0x7f44c778e940>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:34.024151 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=4 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:24:34.108334 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4f9625ac-f2ed-4f26-b865-4696e0da5347 tempest-FloatingIPDetailsTestJSON-1033028491 tempest-FloatingIPDetailsTestJSON-1033028491-project] 10.222.0.13 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.567220 Oct 30 01:24:34.108932 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1322/2621] 10.222.0.13 () {58 vars in 1164 bytes} [Sun Oct 30 01:24:33 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:24:34.114362 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-230f289a-6b57-473a-aa19-e160341072b0 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:34.114506 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-230f289a-6b57-473a-aa19-e160341072b0 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] [instance: f5fe2000-b4bf-4636-92fc-72e50c7a7a96] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:34.121268 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-230f289a-6b57-473a-aa19-e160341072b0 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:34.121801 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-230f289a-6b57-473a-aa19-e160341072b0 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:34.122239 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-230f289a-6b57-473a-aa19-e160341072b0 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:34.123042 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-230f289a-6b57-473a-aa19-e160341072b0 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:34.123642 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-230f289a-6b57-473a-aa19-e160341072b0 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:34.124070 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-230f289a-6b57-473a-aa19-e160341072b0 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:34.128538 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:24:34.151623 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-230f289a-6b57-473a-aa19-e160341072b0 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] [instance: f5fe2000-b4bf-4636-92fc-72e50c7a7a96] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:24:34.178469 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-389401f3-95d6-4a17-abef-409bb5c88dfb tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] [instance: 9bd44e90-60a5-4f4d-ae27-a7dffcb3503e] Updating instance_info_cache with network_info: [{"id": "d2ed3272-2b5d-4ab4-90e4-02f9832b391e", "address": "fa:16:3e:89:1a:8c", "network": {"id": "3e8bdef0-4815-4ad6-a6bf-6429286b8c3e", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-631621317-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "0e4747ca082b4a9b82bb64c9ea2ec750", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd2ed3272-2b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 30 01:24:34.250922 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-389401f3-95d6-4a17-abef-409bb5c88dfb tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Releasing lock "refresh_cache-9bd44e90-60a5-4f4d-ae27-a7dffcb3503e" {{(pid=121103) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 30 01:24:34.251801 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-389401f3-95d6-4a17-abef-409bb5c88dfb tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] 10.222.0.13 "POST /compute/v2.1/servers/9bd44e90-60a5-4f4d-ae27-a7dffcb3503e/action" status: 202 len: 0 microversion: 2.1 time: 2.872494 Oct 30 01:24:34.252416 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1300/2622] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:24:31 2022] POST /compute/v2.1/servers/9bd44e90-60a5-4f4d-ae27-a7dffcb3503e/action => generated 0 bytes in 2874 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 30 01:24:34.257521 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6d657570-5c83-4559-8cc4-51bce5bdd6b4 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2135368870", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "9c3e4699-5176-48ab-a2ba-0807db051e7a"}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:24:34.262603 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6d657570-5c83-4559-8cc4-51bce5bdd6b4 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Request method failure captured: Oct 30 01:24:34.262603 n-d-master-1 devstack@n-api.service[121103]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 30 01:24:34.262603 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:24:34.262603 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:24:34.262603 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:24:34.262603 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 500 Oct 30 01:24:34.262603 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:24:34.262603 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:24:34.262603 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:24:34.262603 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:24:34.262603 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdI7hXmuB1XI9FOCgUfxzJI5vCMAF9BU13eyJ1J1MmqCYl7o24KgF4cpHFtnJOecvtKlCxL7mDkf35OgczUAmWERkib7Iw2gr_NqZwZXCas5gkF2eMwYl8otydw7z4f_KCB8bmLznDDS0uWUpHBKNLlCCl_QgpBai_9lfdnE9xs2KEQ Oct 30 01:24:34.262603 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:24:34.262603 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:24:34.262603 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:24:34.262603 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:24:34.262603 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:24:34.262603 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:24:34.262603 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: ada31213f567489299af80277ee35f65 Oct 30 01:24:34.262603 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1199645215 Oct 30 01:24:34.262603 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:24:34.262603 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:24:34.263836 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ada31213f567489299af80277ee35f65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ada31213f567489299af80277ee35f65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ada31213f567489299af80277ee35f65"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ada31213f567489299af80277ee35f65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:24:34.263836 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1199645215 Oct 30 01:24:34.263836 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: ada31213f567489299af80277ee35f65 Oct 30 01:24:34.263836 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1199645215 Oct 30 01:24:34.263836 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServerMetadataNegativeTestJSON-1199645215-project Oct 30 01:24:34.263836 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:24:34.263836 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:24:34.263836 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 6e8b2c03e5294bbe9ee8cda7468c9d86 Oct 30 01:24:34.263836 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1199645215-project Oct 30 01:24:34.263836 n-d-master-1 devstack@n-api.service[121103]: Oct 30 01:24:34.264419 n-d-master-1 devstack@n-api.service[121103]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2135368870", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "9c3e4699-5176-48ab-a2ba-0807db051e7a"}]}} Oct 30 01:24:34.264419 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:24:34.264419 n-d-master-1 devstack@n-api.service[121103]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 30 01:24:34.264419 n-d-master-1 devstack@n-api.service[121103]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-2135368870', 'imageRef': 'deb14158-45d8-4539-889d-ff9726d046d7', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '9c3e4699-5176-48ab-a2ba-0807db051e7a'}]}}} Oct 30 01:24:34.264419 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:24:34.264419 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:24:34.264789 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 30 01:24:34.264789 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 30 01:24:34.264789 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 30 01:24:34.264789 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise error Oct 30 01:24:34.264789 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 30 01:24:34.264789 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:24:34.264789 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 30 01:24:34.264789 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 30 01:24:34.264789 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 30 01:24:34.264789 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 30 01:24:34.264789 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 30 01:24:34.264789 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:24:34.264789 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 30 01:24:34.264789 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 30 01:24:34.264789 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:24:34.264789 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:24:34.264789 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:24:34.266754 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:24:34.266754 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:24:34.266754 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:24:34.266754 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:24:34.266754 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:24:34.266754 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:24:34.266754 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:24:34.266754 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:24:34.266754 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:24:34.266754 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 30 01:24:34.266754 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 30 01:24:34.266754 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 30 01:24:34.266754 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 30 01:24:34.266754 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 30 01:24:34.266754 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 30 01:24:34.267622 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 30 01:24:34.267622 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:24:34.267622 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:24:34.267622 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:24:34.267622 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:24:34.267622 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:24:34.267622 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:24:34.267622 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 30 01:24:34.267622 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 30 01:24:34.269373 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 30 01:24:34.269373 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:24:34.269373 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6d657570-5c83-4559-8cc4-51bce5bdd6b4 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:24:34.269986 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6d657570-5c83-4559-8cc4-51bce5bdd6b4 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.010642 Oct 30 01:24:34.273019 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1301/2623] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:24:34 2022] POST /compute/v2.1/servers => generated 689 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:24:34.278314 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-f5be49bb-be1c-4488-b410-d3f0fa327ec0 req-4cc6e2ac-0594-4671-9cba-dd9677726367 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bd44e90-60a5-4f4d-ae27-a7dffcb3503e", "tag": "d2ed3272-2b5d-4ab4-90e4-02f9832b391e"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:24:34.288811 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-f5be49bb-be1c-4488-b410-d3f0fa327ec0 req-4cc6e2ac-0594-4671-9cba-dd9677726367 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:34.289281 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-f5be49bb-be1c-4488-b410-d3f0fa327ec0 req-4cc6e2ac-0594-4671-9cba-dd9677726367 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:34.289942 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-f5be49bb-be1c-4488-b410-d3f0fa327ec0 req-4cc6e2ac-0594-4671-9cba-dd9677726367 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:34.301763 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-f5be49bb-be1c-4488-b410-d3f0fa327ec0 req-4cc6e2ac-0594-4671-9cba-dd9677726367 service nova] Creating event network-changed:d2ed3272-2b5d-4ab4-90e4-02f9832b391e for instance 9bd44e90-60a5-4f4d-ae27-a7dffcb3503e on n-h2-master-1 Oct 30 01:24:34.309565 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-f5be49bb-be1c-4488-b410-d3f0fa327ec0 req-4cc6e2ac-0594-4671-9cba-dd9677726367 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032911 Oct 30 01:24:34.309565 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1302/2624] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:24:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:24:34.314155 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-86fbca8e-0c00-4498-9475-021963e7e4ac tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:34.314842 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-86fbca8e-0c00-4498-9475-021963e7e4ac tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] [instance: 3b6bf22e-53a4-481d-8764-d6a4b9c95d3e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:34.320900 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-86fbca8e-0c00-4498-9475-021963e7e4ac tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:34.321407 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-86fbca8e-0c00-4498-9475-021963e7e4ac tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:34.321843 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-86fbca8e-0c00-4498-9475-021963e7e4ac tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:34.322530 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-86fbca8e-0c00-4498-9475-021963e7e4ac tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:34.322979 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-86fbca8e-0c00-4498-9475-021963e7e4ac tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:34.323401 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-86fbca8e-0c00-4498-9475-021963e7e4ac tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:34.337354 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-86fbca8e-0c00-4498-9475-021963e7e4ac tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] HTTP exception thrown: Instance 3b6bf22e-53a4-481d-8764-d6a4b9c95d3e could not be found. Oct 30 01:24:34.338973 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-86fbca8e-0c00-4498-9475-021963e7e4ac tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Request method failure captured: Oct 30 01:24:34.338973 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/3b6bf22e-53a4-481d-8764-d6a4b9c95d3e HTTP/1.1 Oct 30 01:24:34.338973 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:24:34.338973 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:24:34.338973 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:24:34.338973 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:24:34.338973 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:24:34.338973 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:24:34.338973 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:24:34.338973 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:24:34.338973 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdH6YOBJz__VjBqQ6rPF6GU-rUITjCKGwsd3W_C4a9C7IdVxBz1A_JA6sSIy9AhX9Jo1nnDylavcIXRjzMDstds48bCrbyFUTOX1oRjo_H4Axy6SzV94hDju9Cu0SKd3g-EGRfcEL4rHS8Vyrz2d0EYq_64bNcpX8eIkXjebSBJ7wAw Oct 30 01:24:34.338973 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:24:34.338973 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:24:34.338973 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:24:34.338973 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:24:34.338973 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:24:34.338973 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:24:34.338973 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 2a5e20978d1a4886b04d37eef4c23d1e Oct 30 01:24:34.338973 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersTestManualDisk-189992788 Oct 30 01:24:34.338973 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:24:34.338973 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:24:34.340485 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2a5e20978d1a4886b04d37eef4c23d1e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2a5e20978d1a4886b04d37eef4c23d1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2a5e20978d1a4886b04d37eef4c23d1e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2a5e20978d1a4886b04d37eef4c23d1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:24:34.340485 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersTestManualDisk-189992788 Oct 30 01:24:34.340485 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 2a5e20978d1a4886b04d37eef4c23d1e Oct 30 01:24:34.340485 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersTestManualDisk-189992788 Oct 30 01:24:34.340485 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersTestManualDisk-189992788-project Oct 30 01:24:34.340485 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:24:34.340485 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:24:34.340485 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: a1e23e3096f740508e6fb6626a29336f Oct 30 01:24:34.340485 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersTestManualDisk-189992788-project Oct 30 01:24:34.340485 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:24:34.340485 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 3b6bf22e-53a4-481d-8764-d6a4b9c95d3e could not be found. Oct 30 01:24:34.340485 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '3b6bf22e-53a4-481d-8764-d6a4b9c95d3e'} Oct 30 01:24:34.341405 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:24:34.341405 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:24:34.341405 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:24:34.341405 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:24:34.341405 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:24:34.341405 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:24:34.341405 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:24:34.341405 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:24:34.341405 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:24:34.341405 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:24:34.341405 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b6bf22e-53a4-481d-8764-d6a4b9c95d3e could not be found. Oct 30 01:24:34.341405 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:24:34.341405 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:24:34.341405 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:24:34.341405 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:24:34.341405 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:24:34.341405 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:24:34.341405 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:24:34.341405 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:24:34.341405 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:24:34.342765 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:24:34.342765 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:24:34.342765 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:24:34.342765 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:24:34.342765 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:24:34.342765 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:24:34.342765 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:24:34.342765 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b6bf22e-53a4-481d-8764-d6a4b9c95d3e could not be found. Oct 30 01:24:34.342765 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:24:34.342765 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:24:34.342765 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:24:34.342765 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:24:34.342765 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:24:34.342765 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:24:34.342765 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:24:34.342765 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:24:34.342765 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b6bf22e-53a4-481d-8764-d6a4b9c95d3e could not be found. Oct 30 01:24:34.342765 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:24:34.344021 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-86fbca8e-0c00-4498-9475-021963e7e4ac tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Returning 404 to user: Instance 3b6bf22e-53a4-481d-8764-d6a4b9c95d3e could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:24:34.344021 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-86fbca8e-0c00-4498-9475-021963e7e4ac tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] 10.222.0.13 "GET /compute/v2.1/servers/3b6bf22e-53a4-481d-8764-d6a4b9c95d3e" status: 404 len: 111 microversion: 2.1 time: 0.030822 Oct 30 01:24:34.344181 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1303/2625] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:34 2022] GET /compute/v2.1/servers/3b6bf22e-53a4-481d-8764-d6a4b9c95d3e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:24:34.348612 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-271dd81b-cd1b-4421-b7b2-e1027ae041ff tempest-FloatingIPDetailsTestJSON-1033028491 tempest-FloatingIPDetailsTestJSON-1033028491-project] Calling method '.version_select at 0x7f44d04755e0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:34.357807 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:24:34.484423 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-230f289a-6b57-473a-aa19-e160341072b0 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f5fe2000-b4bf-4636-92fc-72e50c7a7a96" status: 204 len: 0 microversion: 2.21 time: 0.374140 Oct 30 01:24:34.485126 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1323/2626] 10.222.0.13 () {60 vars in 1280 bytes} [Sun Oct 30 01:24:34 2022] DELETE /compute/v2.1/servers/f5fe2000-b4bf-4636-92fc-72e50c7a7a96 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 30 01:24:34.491665 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-77d0a7ad-1b63-4995-b965-744a681f53da tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:34.492496 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-77d0a7ad-1b63-4995-b965-744a681f53da tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 32c70d3f-96cd-4b23-a743-05aed245baf0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:34.499644 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-77d0a7ad-1b63-4995-b965-744a681f53da tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:34.500145 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-77d0a7ad-1b63-4995-b965-744a681f53da tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:34.501228 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-77d0a7ad-1b63-4995-b965-744a681f53da tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:34.502014 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-77d0a7ad-1b63-4995-b965-744a681f53da tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:34.502471 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-77d0a7ad-1b63-4995-b965-744a681f53da tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:34.502899 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-77d0a7ad-1b63-4995-b965-744a681f53da tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:34.544039 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-271dd81b-cd1b-4421-b7b2-e1027ae041ff tempest-FloatingIPDetailsTestJSON-1033028491 tempest-FloatingIPDetailsTestJSON-1033028491-project] 10.222.0.13 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.198725 Oct 30 01:24:34.544993 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1304/2627] 10.222.0.13 () {58 vars in 1149 bytes} [Sun Oct 30 01:24:34 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:24:34.550829 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3d4025ce-d12c-4717-81e7-0a80311fca23 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Calling method '.version_select at 0x7f44d0437e50>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:34.735858 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-77d0a7ad-1b63-4995-b965-744a681f53da tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:34.745472 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-77d0a7ad-1b63-4995-b965-744a681f53da tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0" status: 200 len: 1512 microversion: 2.1 time: 0.257961 Oct 30 01:24:34.746904 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1324/2628] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:34 2022] GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0 => generated 1512 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:34.766669 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e4e39b9f-951a-4385-a01a-65f4934ac98d tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2032472910", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "9c3e4699-5176-48ab-a2ba-0807db051e7a"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:24:34.771353 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e4e39b9f-951a-4385-a01a-65f4934ac98d tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Request method failure captured: Oct 30 01:24:34.771353 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 30 01:24:34.771353 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:24:34.771353 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:24:34.771353 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:24:34.771353 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 754 Oct 30 01:24:34.771353 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:24:34.771353 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:24:34.771353 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:24:34.771353 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:24:34.771353 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdI7hXmuB1XI9FOCgUfxzJI5vCMAF9BU13eyJ1J1MmqCYl7o24KgF4cpHFtnJOecvtKlCxL7mDkf35OgczUAmWERkib7Iw2gr_NqZwZXCas5gkF2eMwYl8otydw7z4f_KCB8bmLznDDS0uWUpHBKNLlCCl_QgpBai_9lfdnE9xs2KEQ Oct 30 01:24:34.771353 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:24:34.771353 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:24:34.771353 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:24:34.771353 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:24:34.771353 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:24:34.771353 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:24:34.771353 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: ada31213f567489299af80277ee35f65 Oct 30 01:24:34.771353 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1199645215 Oct 30 01:24:34.771353 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:24:34.771353 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:24:34.772943 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ada31213f567489299af80277ee35f65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ada31213f567489299af80277ee35f65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ada31213f567489299af80277ee35f65"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ada31213f567489299af80277ee35f65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:24:34.772943 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1199645215 Oct 30 01:24:34.772943 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: ada31213f567489299af80277ee35f65 Oct 30 01:24:34.772943 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1199645215 Oct 30 01:24:34.772943 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServerMetadataNegativeTestJSON-1199645215-project Oct 30 01:24:34.772943 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:24:34.772943 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:24:34.772943 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 6e8b2c03e5294bbe9ee8cda7468c9d86 Oct 30 01:24:34.772943 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1199645215-project Oct 30 01:24:34.772943 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:24:34.780373 n-d-master-1 devstack@n-api.service[121102]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2032472910", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "9c3e4699-5176-48ab-a2ba-0807db051e7a"}]}} Oct 30 01:24:34.780373 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:24:34.780373 n-d-master-1 devstack@n-api.service[121102]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 30 01:24:34.780664 n-d-master-1 devstack@n-api.service[121102]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-2032472910', 'imageRef': 'deb14158-45d8-4539-889d-ff9726d046d7', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '9c3e4699-5176-48ab-a2ba-0807db051e7a'}]}}} Oct 30 01:24:34.780664 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:24:34.780664 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:24:34.780664 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 30 01:24:34.780664 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 30 01:24:34.780664 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 30 01:24:34.780664 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise error Oct 30 01:24:34.780664 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 30 01:24:34.781422 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:24:34.781422 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 30 01:24:34.781422 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 30 01:24:34.781422 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 30 01:24:34.781422 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 30 01:24:34.781422 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 30 01:24:34.781422 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:24:34.781422 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 30 01:24:34.781422 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 30 01:24:34.781422 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:24:34.781422 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:24:34.781422 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:24:34.781422 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:24:34.781422 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:24:34.781422 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:24:34.781422 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:24:34.781422 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:24:34.782587 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:24:34.782587 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:24:34.782587 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:24:34.782587 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:24:34.782587 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 30 01:24:34.782587 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 30 01:24:34.782587 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 30 01:24:34.782587 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 30 01:24:34.782587 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 30 01:24:34.782587 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 30 01:24:34.783349 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 30 01:24:34.783349 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:24:34.783349 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:24:34.783349 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:24:34.783349 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:24:34.783349 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:24:34.783349 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:24:34.783349 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 30 01:24:34.783349 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 30 01:24:34.784010 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 30 01:24:34.784010 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:24:34.784182 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e4e39b9f-951a-4385-a01a-65f4934ac98d tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:24:34.784182 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e4e39b9f-951a-4385-a01a-65f4934ac98d tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.024825 Oct 30 01:24:34.784365 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1325/2629] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:24:34 2022] POST /compute/v2.1/servers => generated 1197 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 30 01:24:34.784365 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8ff71434-e926-420f-b0a1-b3ee514c6f29 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] Calling method '.version_select at 0x7f44c778e160>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:34.857636 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8ff71434-e926-420f-b0a1-b3ee514c6f29 tempest-ServersTestManualDisk-189992788 tempest-ServersTestManualDisk-189992788-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-509941397" status: 202 len: 0 microversion: 2.1 time: 0.079095 Oct 30 01:24:34.861700 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1326/2630] 10.222.0.13 () {58 vars in 1218 bytes} [Sun Oct 30 01:24:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-509941397 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:24:34.865680 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f0934f66-0a8c-4e41-9332-656506ca6060 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:34.866435 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f0934f66-0a8c-4e41-9332-656506ca6060 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] [instance: f5fe2000-b4bf-4636-92fc-72e50c7a7a96] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:34.873521 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f0934f66-0a8c-4e41-9332-656506ca6060 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:34.873985 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f0934f66-0a8c-4e41-9332-656506ca6060 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:34.874493 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f0934f66-0a8c-4e41-9332-656506ca6060 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:34.875271 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f0934f66-0a8c-4e41-9332-656506ca6060 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:34.875797 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f0934f66-0a8c-4e41-9332-656506ca6060 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:34.876330 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f0934f66-0a8c-4e41-9332-656506ca6060 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:35.149932 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f0934f66-0a8c-4e41-9332-656506ca6060 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e533367cf3fc4e06a96c6add0540b897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121fd24a0b6b4eb3aa1cac304dda16a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:35.166025 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f0934f66-0a8c-4e41-9332-656506ca6060 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e533367cf3fc4e06a96c6add0540b897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121fd24a0b6b4eb3aa1cac304dda16a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:35.168305 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f0934f66-0a8c-4e41-9332-656506ca6060 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e533367cf3fc4e06a96c6add0540b897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121fd24a0b6b4eb3aa1cac304dda16a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:35.169614 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f0934f66-0a8c-4e41-9332-656506ca6060 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] 10.222.0.13 "GET /compute/v2.1/servers/f5fe2000-b4bf-4636-92fc-72e50c7a7a96" status: 200 len: 1559 microversion: 2.21 time: 0.310153 Oct 30 01:24:35.170117 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1327/2631] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:24:34 2022] GET /compute/v2.1/servers/f5fe2000-b4bf-4636-92fc-72e50c7a7a96 => generated 1559 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:24:35.174942 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b60ed6be-22a5-4d52-8d41-52e0f6f5e72a tempest-FloatingIPDetailsTestJSON-1033028491 tempest-FloatingIPDetailsTestJSON-1033028491-project] Calling method '.version_select at 0x7f44c768af70>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:35.807483 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3d4025ce-d12c-4717-81e7-0a80311fca23 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] 10.222.0.13 "DELETE /compute/v2.1/os-floating-ips/2829cc85-6329-48e8-8571-d113850ed32b" status: 202 len: 0 microversion: 2.1 time: 1.261197 Oct 30 01:24:35.815780 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1305/2632] 10.222.0.13 () {58 vars in 1263 bytes} [Sun Oct 30 01:24:34 2022] DELETE /compute/v2.1/os-floating-ips/2829cc85-6329-48e8-8571-d113850ed32b => generated 0 bytes in 1270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:24:35.821658 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9d174e22-d09f-4a9c-af32-b87cd4b63720 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:35.822476 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9d174e22-d09f-4a9c-af32-b87cd4b63720 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: 403e0292-c082-4655-ad08-b5dc3a7f8305] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:35.830144 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9d174e22-d09f-4a9c-af32-b87cd4b63720 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:35.833132 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9d174e22-d09f-4a9c-af32-b87cd4b63720 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:35.833132 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9d174e22-d09f-4a9c-af32-b87cd4b63720 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:35.833132 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9d174e22-d09f-4a9c-af32-b87cd4b63720 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:35.833132 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9d174e22-d09f-4a9c-af32-b87cd4b63720 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:35.833789 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9d174e22-d09f-4a9c-af32-b87cd4b63720 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:36.052999 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9d174e22-d09f-4a9c-af32-b87cd4b63720 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:36.062776 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9d174e22-d09f-4a9c-af32-b87cd4b63720 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305" status: 200 len: 1496 microversion: 2.1 time: 0.245594 Oct 30 01:24:36.063435 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1306/2633] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:35 2022] GET /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305 => generated 1496 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:36.068938 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-dc9d6dea-0509-4b0d-9e1c-74fcbba73dba tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-829363833", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "9c3e4699-5176-48ab-a2ba-0807db051e7a"}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:24:36.075611 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-dc9d6dea-0509-4b0d-9e1c-74fcbba73dba tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Request method failure captured: Oct 30 01:24:36.075611 n-d-master-1 devstack@n-api.service[121103]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 30 01:24:36.075611 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:24:36.075611 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:24:36.075611 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:24:36.075611 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 1265 Oct 30 01:24:36.075611 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:24:36.075611 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:24:36.075611 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:24:36.075611 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:24:36.075611 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdI7hXmuB1XI9FOCgUfxzJI5vCMAF9BU13eyJ1J1MmqCYl7o24KgF4cpHFtnJOecvtKlCxL7mDkf35OgczUAmWERkib7Iw2gr_NqZwZXCas5gkF2eMwYl8otydw7z4f_KCB8bmLznDDS0uWUpHBKNLlCCl_QgpBai_9lfdnE9xs2KEQ Oct 30 01:24:36.075611 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:24:36.075611 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:24:36.075611 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:24:36.075611 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:24:36.075611 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:24:36.075611 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:24:36.075611 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: ada31213f567489299af80277ee35f65 Oct 30 01:24:36.075611 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1199645215 Oct 30 01:24:36.075611 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:24:36.075611 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:24:36.077013 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ada31213f567489299af80277ee35f65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ada31213f567489299af80277ee35f65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ada31213f567489299af80277ee35f65"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ada31213f567489299af80277ee35f65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:24:36.077013 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1199645215 Oct 30 01:24:36.077013 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: ada31213f567489299af80277ee35f65 Oct 30 01:24:36.077013 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1199645215 Oct 30 01:24:36.077013 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServerMetadataNegativeTestJSON-1199645215-project Oct 30 01:24:36.077013 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:24:36.077013 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:24:36.077013 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 6e8b2c03e5294bbe9ee8cda7468c9d86 Oct 30 01:24:36.077013 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1199645215-project Oct 30 01:24:36.077013 n-d-master-1 devstack@n-api.service[121103]: Oct 30 01:24:36.077746 n-d-master-1 devstack@n-api.service[121103]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-829363833", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "9c3e4699-5176-48ab-a2ba-0807db051e7a"}]}} Oct 30 01:24:36.077746 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:24:36.077931 n-d-master-1 devstack@n-api.service[121103]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 30 01:24:36.077931 n-d-master-1 devstack@n-api.service[121103]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-829363833', 'imageRef': 'deb14158-45d8-4539-889d-ff9726d046d7', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '9c3e4699-5176-48ab-a2ba-0807db051e7a'}]}}} Oct 30 01:24:36.077931 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:24:36.077931 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:24:36.077931 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 30 01:24:36.077931 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 30 01:24:36.077931 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 30 01:24:36.077931 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise error Oct 30 01:24:36.077931 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 30 01:24:36.077931 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:24:36.077931 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 30 01:24:36.077931 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 30 01:24:36.077931 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 30 01:24:36.077931 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 30 01:24:36.077931 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 30 01:24:36.077931 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:24:36.077931 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 30 01:24:36.079045 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 30 01:24:36.079045 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:24:36.079045 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:24:36.079045 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:24:36.079045 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:24:36.079045 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:24:36.079045 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:24:36.079045 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:24:36.079045 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:24:36.079045 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:24:36.079045 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:24:36.079045 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:24:36.079045 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:24:36.079045 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 30 01:24:36.079045 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 30 01:24:36.079045 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 30 01:24:36.079045 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 30 01:24:36.079045 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 30 01:24:36.079045 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 30 01:24:36.079045 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 30 01:24:36.079045 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:24:36.079045 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:24:36.079045 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:24:36.079045 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:24:36.079045 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:24:36.079045 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:24:36.079045 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 30 01:24:36.079045 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 30 01:24:36.081272 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 30 01:24:36.081272 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:24:36.082471 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-dc9d6dea-0509-4b0d-9e1c-74fcbba73dba tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:24:36.083535 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-dc9d6dea-0509-4b0d-9e1c-74fcbba73dba tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.018735 Oct 30 01:24:36.084115 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1307/2634] 10.222.0.13 () {60 vars in 1148 bytes} [Sun Oct 30 01:24:36 2022] POST /compute/v2.1/servers => generated 2221 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 30 01:24:36.088666 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1a7aa390-8b16-428b-a9c6-0e7b44950d5e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:36.090362 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1a7aa390-8b16-428b-a9c6-0e7b44950d5e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 32c70d3f-96cd-4b23-a743-05aed245baf0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:36.099243 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a7aa390-8b16-428b-a9c6-0e7b44950d5e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:36.099741 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a7aa390-8b16-428b-a9c6-0e7b44950d5e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:36.100185 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a7aa390-8b16-428b-a9c6-0e7b44950d5e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:36.100891 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a7aa390-8b16-428b-a9c6-0e7b44950d5e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:36.101396 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a7aa390-8b16-428b-a9c6-0e7b44950d5e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:36.101951 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a7aa390-8b16-428b-a9c6-0e7b44950d5e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:36.377152 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b60ed6be-22a5-4d52-8d41-52e0f6f5e72a tempest-FloatingIPDetailsTestJSON-1033028491 tempest-FloatingIPDetailsTestJSON-1033028491-project] 10.222.0.13 "DELETE /compute/v2.1/os-floating-ips/4e20e743-3cb0-44f6-8437-804a1ed9a99a" status: 202 len: 0 microversion: 2.1 time: 1.205901 Oct 30 01:24:36.381864 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1328/2635] 10.222.0.13 () {58 vars in 1263 bytes} [Sun Oct 30 01:24:35 2022] DELETE /compute/v2.1/os-floating-ips/4e20e743-3cb0-44f6-8437-804a1ed9a99a => generated 0 bytes in 1208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:24:36.385706 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-faf707e4-e911-4561-ae6d-6ba42ee84f01 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-faf707e4-e911-4561-ae6d-6ba42ee84f01 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Request method failure captured: Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/servers/9bd44e90-60a5-4f4d-ae27-a7dffcb3503e/action HTTP/1.1 Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 34 Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdIkvQK32ztsDxcYn-yUrHzOz1wf_T9VGlxvk4nwqWdnV76pRk-OA8zN-pznKFXUcdhndGD4RbL17lxTC2Q2LewQsJ61sfedOmJ3hKWxKZTWEATyRzqcietKy_-QJlMYym_dy3A2-cw1_m7OSjVGFG7arQOMCApo5m7M22Zk5TxckzE Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 0e4747ca082b4a9b82bb64c9ea2ec750 Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0e4747ca082b4a9b82bb64c9ea2ec750"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0e4747ca082b4a9b82bb64c9ea2ec750"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0e4747ca082b4a9b82bb64c9ea2ec750"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0e4747ca082b4a9b82bb64c9ea2ec750"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 0e4747ca082b4a9b82bb64c9ea2ec750 Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 9cb216afb20940ce9cc86b2d1faab962 Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: {"addFloatingIp": {"address": ""}} Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: method: Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '9bd44e90-60a5-4f4d-ae27-a7dffcb3503e', 'body': {'addFloatingIp': {'address': ''}}} Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise error Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi '' Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 30 01:24:36.390633 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 30 01:24:36.403129 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 30 01:24:36.403129 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 30 01:24:36.403129 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:24:36.403129 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:24:36.403129 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:24:36.403129 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:24:36.403129 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:24:36.403129 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:24:36.403129 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 30 01:24:36.403129 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 30 01:24:36.403129 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 30 01:24:36.403129 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:24:36.403129 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-faf707e4-e911-4561-ae6d-6ba42ee84f01 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:24:36.403129 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-faf707e4-e911-4561-ae6d-6ba42ee84f01 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] 10.222.0.13 "POST /compute/v2.1/servers/9bd44e90-60a5-4f4d-ae27-a7dffcb3503e/action" status: 400 len: 142 microversion: 2.1 time: 0.011551 Oct 30 01:24:36.403129 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1329/2636] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:24:36 2022] POST /compute/v2.1/servers/9bd44e90-60a5-4f4d-ae27-a7dffcb3503e/action => generated 142 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:24:36.404556 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c298949b-df2b-41df-8fd3-ed73ba674d90 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:36.405116 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c298949b-df2b-41df-8fd3-ed73ba674d90 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] [instance: 5cf56d77-2b61-4dd8-ac90-ac1a8dba174a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:36.412010 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-c298949b-df2b-41df-8fd3-ed73ba674d90 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] HTTP exception thrown: Instance 5cf56d77-2b61-4dd8-ac90-ac1a8dba174a could not be found. Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c298949b-df2b-41df-8fd3-ed73ba674d90 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Request method failure captured: Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/5cf56d77-2b61-4dd8-ac90-ac1a8dba174a/metadata/test2 HTTP/1.1 Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdI7hXmuB1XI9FOCgUfxzJI5vCMAF9BU13eyJ1J1MmqCYl7o24KgF4cpHFtnJOecvtKlCxL7mDkf35OgczUAmWERkib7Iw2gr_NqZwZXCas5gkF2eMwYl8otydw7z4f_KCB8bmLznDDS0uWUpHBKNLlCCl_QgpBai_9lfdnE9xs2KEQ Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: ada31213f567489299af80277ee35f65 Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1199645215 Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ada31213f567489299af80277ee35f65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ada31213f567489299af80277ee35f65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ada31213f567489299af80277ee35f65"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ada31213f567489299af80277ee35f65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1199645215 Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: ada31213f567489299af80277ee35f65 Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1199645215 Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServerMetadataNegativeTestJSON-1199645215-project Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 6e8b2c03e5294bbe9ee8cda7468c9d86 Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1199645215-project Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 5cf56d77-2b61-4dd8-ac90-ac1a8dba174a could not be found. Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: action_args: {'server_id': '5cf56d77-2b61-4dd8-ac90-ac1a8dba174a', 'id': 'test2'} Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cf56d77-2b61-4dd8-ac90-ac1a8dba174a could not be found. Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cf56d77-2b61-4dd8-ac90-ac1a8dba174a could not be found. Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:24:36.414030 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:24:36.418527 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:24:36.418527 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:24:36.418527 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cf56d77-2b61-4dd8-ac90-ac1a8dba174a could not be found. Oct 30 01:24:36.418527 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:24:36.418847 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1a7aa390-8b16-428b-a9c6-0e7b44950d5e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:36.418952 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c298949b-df2b-41df-8fd3-ed73ba674d90 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Returning 404 to user: Instance 5cf56d77-2b61-4dd8-ac90-ac1a8dba174a could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:24:36.420145 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c298949b-df2b-41df-8fd3-ed73ba674d90 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] 10.222.0.13 "GET /compute/v2.1/servers/5cf56d77-2b61-4dd8-ac90-ac1a8dba174a/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.026306 Oct 30 01:24:36.420623 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1330/2637] 10.222.0.13 () {58 vars in 1281 bytes} [Sun Oct 30 01:24:36 2022] GET /compute/v2.1/servers/5cf56d77-2b61-4dd8-ac90-ac1a8dba174a/metadata/test2 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:24:36.425856 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7bb95498-2464-4fe0-989e-b0090a52ddaa tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:36.439610 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7bb95498-2464-4fe0-989e-b0090a52ddaa tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] [instance: f5fe2000-b4bf-4636-92fc-72e50c7a7a96] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:36.439790 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1a7aa390-8b16-428b-a9c6-0e7b44950d5e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0" status: 200 len: 1512 microversion: 2.1 time: 0.342984 Oct 30 01:24:36.439790 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1308/2638] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:36 2022] GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0 => generated 1512 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:36.442231 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7f89fc33-bfe1-460b-8621-509eb1244fdc tempest-FloatingIPDetailsTestJSON-1033028491 tempest-FloatingIPDetailsTestJSON-1033028491-project] Calling method '.version_select at 0x7f44d03da670>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:36.447686 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7bb95498-2464-4fe0-989e-b0090a52ddaa tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:36.448181 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7bb95498-2464-4fe0-989e-b0090a52ddaa tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:36.448615 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7bb95498-2464-4fe0-989e-b0090a52ddaa tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:36.450098 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7bb95498-2464-4fe0-989e-b0090a52ddaa tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:36.450543 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7bb95498-2464-4fe0-989e-b0090a52ddaa tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:36.450984 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7bb95498-2464-4fe0-989e-b0090a52ddaa tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:36.771126 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7bb95498-2464-4fe0-989e-b0090a52ddaa tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e533367cf3fc4e06a96c6add0540b897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121fd24a0b6b4eb3aa1cac304dda16a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:36.782994 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7bb95498-2464-4fe0-989e-b0090a52ddaa tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e533367cf3fc4e06a96c6add0540b897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121fd24a0b6b4eb3aa1cac304dda16a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:36.784473 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7bb95498-2464-4fe0-989e-b0090a52ddaa tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e533367cf3fc4e06a96c6add0540b897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121fd24a0b6b4eb3aa1cac304dda16a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:36.785725 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7bb95498-2464-4fe0-989e-b0090a52ddaa tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] 10.222.0.13 "GET /compute/v2.1/servers/f5fe2000-b4bf-4636-92fc-72e50c7a7a96" status: 200 len: 1559 microversion: 2.21 time: 0.363731 Oct 30 01:24:36.786290 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1331/2639] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:24:36 2022] GET /compute/v2.1/servers/f5fe2000-b4bf-4636-92fc-72e50c7a7a96 => generated 1559 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:24:36.791091 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-57b56d12-efff-43c1-92b8-d0c7f7d8d99b tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:24:36.793606 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-57b56d12-efff-43c1-92b8-d0c7f7d8d99b tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] [instance: 9bd44e90-60a5-4f4d-ae27-a7dffcb3503e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:36.801089 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-57b56d12-efff-43c1-92b8-d0c7f7d8d99b tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:36.801867 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-57b56d12-efff-43c1-92b8-d0c7f7d8d99b tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:36.802466 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-57b56d12-efff-43c1-92b8-d0c7f7d8d99b tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:36.803333 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-57b56d12-efff-43c1-92b8-d0c7f7d8d99b tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:36.803946 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-57b56d12-efff-43c1-92b8-d0c7f7d8d99b tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:36.804528 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-57b56d12-efff-43c1-92b8-d0c7f7d8d99b tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:36.836814 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-57b56d12-efff-43c1-92b8-d0c7f7d8d99b tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Acquiring lock "refresh_cache-9bd44e90-60a5-4f4d-ae27-a7dffcb3503e" {{(pid=121102) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 30 01:24:36.837542 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-57b56d12-efff-43c1-92b8-d0c7f7d8d99b tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Acquired lock "refresh_cache-9bd44e90-60a5-4f4d-ae27-a7dffcb3503e" {{(pid=121102) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 30 01:24:37.078980 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-57b56d12-efff-43c1-92b8-d0c7f7d8d99b tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Releasing lock "refresh_cache-9bd44e90-60a5-4f4d-ae27-a7dffcb3503e" {{(pid=121102) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 30 01:24:37.081055 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-57b56d12-efff-43c1-92b8-d0c7f7d8d99b tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] HTTP exception thrown: floating IP not found Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-57b56d12-efff-43c1-92b8-d0c7f7d8d99b tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Request method failure captured: Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/servers/9bd44e90-60a5-4f4d-ae27-a7dffcb3503e/action HTTP/1.1 Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 41 Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdIkvQK32ztsDxcYn-yUrHzOz1wf_T9VGlxvk4nwqWdnV76pRk-OA8zN-pznKFXUcdhndGD4RbL17lxTC2Q2LewQsJ61sfedOmJ3hKWxKZTWEATyRzqcietKy_-QJlMYym_dy3A2-cw1_m7OSjVGFG7arQOMCApo5m7M22Zk5TxckzE Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 0e4747ca082b4a9b82bb64c9ea2ec750 Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0e4747ca082b4a9b82bb64c9ea2ec750"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0e4747ca082b4a9b82bb64c9ea2ec750"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0e4747ca082b4a9b82bb64c9ea2ec750"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0e4747ca082b4a9b82bb64c9ea2ec750"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 0e4747ca082b4a9b82bb64c9ea2ec750 Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 9cb216afb20940ce9cc86b2d1faab962 Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: method: Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: exception: floating IP not found Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '9bd44e90-60a5-4f4d-ae27-a7dffcb3503e', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 30 01:24:37.084728 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:24:37.088548 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:24:37.088548 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:24:37.088548 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:24:37.088548 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:24:37.088548 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:24:37.088548 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:24:37.088548 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:24:37.088548 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 30 01:24:37.088548 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:24:37.088548 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-57b56d12-efff-43c1-92b8-d0c7f7d8d99b tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Returning 404 to user: floating IP not found {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:24:37.088548 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-57b56d12-efff-43c1-92b8-d0c7f7d8d99b tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] 10.222.0.13 "POST /compute/v2.1/servers/9bd44e90-60a5-4f4d-ae27-a7dffcb3503e/action" status: 404 len: 67 microversion: 2.1 time: 0.299572 Oct 30 01:24:37.089260 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1332/2640] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:24:36 2022] POST /compute/v2.1/servers/9bd44e90-60a5-4f4d-ae27-a7dffcb3503e/action => generated 67 bytes in 302 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:24:37.096272 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-be41be47-00e2-46bc-aba8-ee7172505ea3 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:37.096968 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-be41be47-00e2-46bc-aba8-ee7172505ea3 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] [instance: 87b560b8-33af-4f79-9768-7a7285a06a10] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:37.104275 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-be41be47-00e2-46bc-aba8-ee7172505ea3 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:37.104755 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-be41be47-00e2-46bc-aba8-ee7172505ea3 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:37.105734 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-be41be47-00e2-46bc-aba8-ee7172505ea3 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:37.106420 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-be41be47-00e2-46bc-aba8-ee7172505ea3 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:37.106870 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-be41be47-00e2-46bc-aba8-ee7172505ea3 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:37.107292 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-be41be47-00e2-46bc-aba8-ee7172505ea3 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:37.136438 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-be41be47-00e2-46bc-aba8-ee7172505ea3 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] [instance: 87b560b8-33af-4f79-9768-7a7285a06a10] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:24:37.522255 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-be41be47-00e2-46bc-aba8-ee7172505ea3 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] 10.222.0.13 "DELETE /compute/v2.1/servers/87b560b8-33af-4f79-9768-7a7285a06a10" status: 204 len: 0 microversion: 2.1 time: 0.432164 Oct 30 01:24:37.523930 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1333/2641] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:24:37 2022] DELETE /compute/v2.1/servers/87b560b8-33af-4f79-9768-7a7285a06a10 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:24:37.534799 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e9e1efe9-0966-4ed7-ba9d-6b38d5a737fa tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:37.535574 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e9e1efe9-0966-4ed7-ba9d-6b38d5a737fa tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: 403e0292-c082-4655-ad08-b5dc3a7f8305] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:37.542294 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9e1efe9-0966-4ed7-ba9d-6b38d5a737fa tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:37.543978 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9e1efe9-0966-4ed7-ba9d-6b38d5a737fa tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:37.544581 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9e1efe9-0966-4ed7-ba9d-6b38d5a737fa tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:37.545454 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9e1efe9-0966-4ed7-ba9d-6b38d5a737fa tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:37.546052 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9e1efe9-0966-4ed7-ba9d-6b38d5a737fa tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:37.546620 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9e1efe9-0966-4ed7-ba9d-6b38d5a737fa tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:38.197839 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e9e1efe9-0966-4ed7-ba9d-6b38d5a737fa tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:38.211148 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e9e1efe9-0966-4ed7-ba9d-6b38d5a737fa tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305" status: 200 len: 1496 microversion: 2.1 time: 0.681507 Oct 30 01:24:38.240403 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1334/2642] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:37 2022] GET /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305 => generated 1496 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:38.247666 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-85db07c9-4a3e-4a9c-9e05-1d73de6d9e4e tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:24:38.348454 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-85db07c9-4a3e-4a9c-9e05-1d73de6d9e4e tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-85db07c9-4a3e-4a9c-9e05-1d73de6d9e4e tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Request method failure captured: Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/servers/9bd44e90-60a5-4f4d-ae27-a7dffcb3503e/action HTTP/1.1 Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 44 Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdIkvQK32ztsDxcYn-yUrHzOz1wf_T9VGlxvk4nwqWdnV76pRk-OA8zN-pznKFXUcdhndGD4RbL17lxTC2Q2LewQsJ61sfedOmJ3hKWxKZTWEATyRzqcietKy_-QJlMYym_dy3A2-cw1_m7OSjVGFG7arQOMCApo5m7M22Zk5TxckzE Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 0e4747ca082b4a9b82bb64c9ea2ec750 Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0e4747ca082b4a9b82bb64c9ea2ec750"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0e4747ca082b4a9b82bb64c9ea2ec750"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0e4747ca082b4a9b82bb64c9ea2ec750"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0e4747ca082b4a9b82bb64c9ea2ec750"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 0e4747ca082b4a9b82bb64c9ea2ec750 Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 9cb216afb20940ce9cc86b2d1faab962 Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: method: Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: exception: Floating IP not found for address 0.0.0.0. Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '9bd44e90-60a5-4f4d-ae27-a7dffcb3503e', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 30 01:24:38.351307 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 30 01:24:38.356448 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 30 01:24:38.356448 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:24:38.356448 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:24:38.356448 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:24:38.356448 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:24:38.356448 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:24:38.356448 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:24:38.356448 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:24:38.356448 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:24:38.356448 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 30 01:24:38.356448 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:24:38.356448 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-85db07c9-4a3e-4a9c-9e05-1d73de6d9e4e tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:24:38.357428 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-85db07c9-4a3e-4a9c-9e05-1d73de6d9e4e tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] 10.222.0.13 "POST /compute/v2.1/servers/9bd44e90-60a5-4f4d-ae27-a7dffcb3503e/action" status: 404 len: 88 microversion: 2.1 time: 0.114907 Oct 30 01:24:38.361591 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1335/2643] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:24:38 2022] POST /compute/v2.1/servers/9bd44e90-60a5-4f4d-ae27-a7dffcb3503e/action => generated 88 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:24:38.367071 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-d5c675a5-6020-4e94-b194-60cccb305c27 req-c2ee0b5e-569a-46ea-abf3-33ba21100ce2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5fe2000-b4bf-4636-92fc-72e50c7a7a96", "name": "network-vif-deleted", "tag": "24794f52-84dd-4fd4-adc1-1cc798873d5c"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:24:38.384096 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-d5c675a5-6020-4e94-b194-60cccb305c27 req-c2ee0b5e-569a-46ea-abf3-33ba21100ce2 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:38.384096 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-d5c675a5-6020-4e94-b194-60cccb305c27 req-c2ee0b5e-569a-46ea-abf3-33ba21100ce2 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:38.384096 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-d5c675a5-6020-4e94-b194-60cccb305c27 req-c2ee0b5e-569a-46ea-abf3-33ba21100ce2 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:38.384491 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7f89fc33-bfe1-460b-8621-509eb1244fdc tempest-FloatingIPDetailsTestJSON-1033028491 tempest-FloatingIPDetailsTestJSON-1033028491-project] 10.222.0.13 "DELETE /compute/v2.1/os-floating-ips/65d008d5-85a4-49c6-b67a-7bbc628592f6" status: 202 len: 0 microversion: 2.1 time: 1.950935 Oct 30 01:24:38.389164 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1309/2644] 10.222.0.13 () {58 vars in 1263 bytes} [Sun Oct 30 01:24:36 2022] DELETE /compute/v2.1/os-floating-ips/65d008d5-85a4-49c6-b67a-7bbc628592f6 => generated 0 bytes in 1954 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:24:38.392462 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-d5c675a5-6020-4e94-b194-60cccb305c27 req-c2ee0b5e-569a-46ea-abf3-33ba21100ce2 service nova] Creating event network-vif-deleted:24794f52-84dd-4fd4-adc1-1cc798873d5c for instance f5fe2000-b4bf-4636-92fc-72e50c7a7a96 on n-h1-master-1 Oct 30 01:24:38.392782 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3c83f59d-f325-428d-b3be-2082bf3a52b5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:38.393444 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3c83f59d-f325-428d-b3be-2082bf3a52b5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 32c70d3f-96cd-4b23-a743-05aed245baf0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:38.399095 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-d5c675a5-6020-4e94-b194-60cccb305c27 req-c2ee0b5e-569a-46ea-abf3-33ba21100ce2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039541 Oct 30 01:24:38.407419 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1336/2645] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:24:38.407836 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3c83f59d-f325-428d-b3be-2082bf3a52b5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:38.407836 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3c83f59d-f325-428d-b3be-2082bf3a52b5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:38.408171 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3c83f59d-f325-428d-b3be-2082bf3a52b5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:38.408919 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3c83f59d-f325-428d-b3be-2082bf3a52b5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:38.409522 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3c83f59d-f325-428d-b3be-2082bf3a52b5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:38.410161 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3c83f59d-f325-428d-b3be-2082bf3a52b5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:38.410413 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-10499ae0-ae9a-46c5-b5b2-ef428f4daa2c tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:38.411218 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-10499ae0-ae9a-46c5-b5b2-ef428f4daa2c tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] [instance: 87b560b8-33af-4f79-9768-7a7285a06a10] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:38.419873 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-10499ae0-ae9a-46c5-b5b2-ef428f4daa2c tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:38.420502 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-10499ae0-ae9a-46c5-b5b2-ef428f4daa2c tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:38.421042 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-10499ae0-ae9a-46c5-b5b2-ef428f4daa2c tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:38.422491 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-10499ae0-ae9a-46c5-b5b2-ef428f4daa2c tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:38.423071 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-10499ae0-ae9a-46c5-b5b2-ef428f4daa2c tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:38.423838 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-10499ae0-ae9a-46c5-b5b2-ef428f4daa2c tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:38.721222 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3c83f59d-f325-428d-b3be-2082bf3a52b5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:38.729628 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3c83f59d-f325-428d-b3be-2082bf3a52b5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0" status: 200 len: 1512 microversion: 2.1 time: 0.342505 Oct 30 01:24:38.730298 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-10499ae0-ae9a-46c5-b5b2-ef428f4daa2c tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8b2c03e5294bbe9ee8cda7468c9d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada31213f567489299af80277ee35f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:38.730810 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1310/2646] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:38 2022] GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0 => generated 1512 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:38.736689 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-240301ee-e4c8-4a2a-9cc0-376959818584 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:38.738243 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-240301ee-e4c8-4a2a-9cc0-376959818584 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] [instance: f5fe2000-b4bf-4636-92fc-72e50c7a7a96] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:38.744538 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-240301ee-e4c8-4a2a-9cc0-376959818584 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:38.745105 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-240301ee-e4c8-4a2a-9cc0-376959818584 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:38.745738 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-240301ee-e4c8-4a2a-9cc0-376959818584 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:38.746653 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-240301ee-e4c8-4a2a-9cc0-376959818584 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:38.747112 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-240301ee-e4c8-4a2a-9cc0-376959818584 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:38.747705 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-240301ee-e4c8-4a2a-9cc0-376959818584 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:38.753937 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-10499ae0-ae9a-46c5-b5b2-ef428f4daa2c tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] 10.222.0.13 "GET /compute/v2.1/servers/87b560b8-33af-4f79-9768-7a7285a06a10" status: 200 len: 1526 microversion: 2.1 time: 0.348373 Oct 30 01:24:38.755757 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1337/2647] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:38 2022] GET /compute/v2.1/servers/87b560b8-33af-4f79-9768-7a7285a06a10 => generated 1526 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:38.763876 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b2483d8b-f982-4cfc-b63f-e94139fc9a27 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:38.764652 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b2483d8b-f982-4cfc-b63f-e94139fc9a27 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] [instance: 9bd44e90-60a5-4f4d-ae27-a7dffcb3503e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:38.773767 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-240301ee-e4c8-4a2a-9cc0-376959818584 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] HTTP exception thrown: Instance f5fe2000-b4bf-4636-92fc-72e50c7a7a96 could not be found. Oct 30 01:24:38.774177 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2483d8b-f982-4cfc-b63f-e94139fc9a27 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:38.774679 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2483d8b-f982-4cfc-b63f-e94139fc9a27 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:38.775175 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2483d8b-f982-4cfc-b63f-e94139fc9a27 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-240301ee-e4c8-4a2a-9cc0-376959818584 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Request method failure captured: Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/f5fe2000-b4bf-4636-92fc-72e50c7a7a96 HTTP/1.1 Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdI0eGGd0MVtCYStc45Sv3jXP1I0Bi4GsrNrjgnah6UUre_RKxm6e2G6Iha-dDJbAoxJKf3afY45cVzDjaunnAo3p1D1468QRdGBh8QNu88X-HIHi0XLQUv8luCIrzLPKATRayChxKLIbSLAfmhLr5iNpm4ILGPTaFY4Wkeem27ZTAU Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: X-Openstack-Nova-Api-Version: 2.21 Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 121fd24a0b6b4eb3aa1cac304dda16a0 Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-InstanceActionsV221TestJSON-611716598 Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/121fd24a0b6b4eb3aa1cac304dda16a0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_121fd24a0b6b4eb3aa1cac304dda16a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/121fd24a0b6b4eb3aa1cac304dda16a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/121fd24a0b6b4eb3aa1cac304dda16a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-InstanceActionsV221TestJSON-611716598 Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 121fd24a0b6b4eb3aa1cac304dda16a0 Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-611716598 Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-InstanceActionsV221TestJSON-611716598-project Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: e533367cf3fc4e06a96c6add0540b897 Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-InstanceActionsV221TestJSON-611716598-project Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: exception: Instance f5fe2000-b4bf-4636-92fc-72e50c7a7a96 could not be found. Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'f5fe2000-b4bf-4636-92fc-72e50c7a7a96'} Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5fe2000-b4bf-4636-92fc-72e50c7a7a96 could not be found. Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5fe2000-b4bf-4636-92fc-72e50c7a7a96 could not be found. Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:24:38.775355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:24:38.779863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:24:38.779863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:24:38.779863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:24:38.779863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:24:38.779863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:24:38.779863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:24:38.779863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5fe2000-b4bf-4636-92fc-72e50c7a7a96 could not be found. Oct 30 01:24:38.779863 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:24:38.780308 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2483d8b-f982-4cfc-b63f-e94139fc9a27 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:38.780385 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-240301ee-e4c8-4a2a-9cc0-376959818584 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Returning 404 to user: Instance f5fe2000-b4bf-4636-92fc-72e50c7a7a96 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:24:38.780455 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2483d8b-f982-4cfc-b63f-e94139fc9a27 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:38.780607 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-240301ee-e4c8-4a2a-9cc0-376959818584 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] 10.222.0.13 "GET /compute/v2.1/servers/f5fe2000-b4bf-4636-92fc-72e50c7a7a96" status: 404 len: 111 microversion: 2.21 time: 0.043827 Oct 30 01:24:38.780695 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2483d8b-f982-4cfc-b63f-e94139fc9a27 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:38.781544 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1311/2648] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:24:38 2022] GET /compute/v2.1/servers/f5fe2000-b4bf-4636-92fc-72e50c7a7a96 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:24:38.786737 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-125b86ad-9eb1-4125-9f13-aa5d86662ffc tempest-FloatingIPDetailsTestJSON-1033028491 tempest-FloatingIPDetailsTestJSON-1033028491-project] Calling method '.version_select at 0x7f44d03f73a0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:38.810298 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b2483d8b-f982-4cfc-b63f-e94139fc9a27 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] [instance: 9bd44e90-60a5-4f4d-ae27-a7dffcb3503e] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:24:39.101557 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b2483d8b-f982-4cfc-b63f-e94139fc9a27 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9bd44e90-60a5-4f4d-ae27-a7dffcb3503e" status: 204 len: 0 microversion: 2.1 time: 0.345380 Oct 30 01:24:39.102280 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1338/2649] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:24:38 2022] DELETE /compute/v2.1/servers/9bd44e90-60a5-4f4d-ae27-a7dffcb3503e => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:24:39.110747 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d53af583-ab98-4b03-b9ec-1ec553c3b4ae tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Calling method '.version_select at 0x7f44c778e1f0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:39.111812 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d53af583-ab98-4b03-b9ec-1ec553c3b4ae tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] [instance: f5fe2000-b4bf-4636-92fc-72e50c7a7a96] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:39.120782 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d53af583-ab98-4b03-b9ec-1ec553c3b4ae tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:39.122926 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d53af583-ab98-4b03-b9ec-1ec553c3b4ae tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:39.123464 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d53af583-ab98-4b03-b9ec-1ec553c3b4ae tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:39.124251 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d53af583-ab98-4b03-b9ec-1ec553c3b4ae tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:39.124774 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d53af583-ab98-4b03-b9ec-1ec553c3b4ae tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:39.125832 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d53af583-ab98-4b03-b9ec-1ec553c3b4ae tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:39.204862 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d53af583-ab98-4b03-b9ec-1ec553c3b4ae tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] 10.222.0.13 "GET /compute/v2.1/servers/f5fe2000-b4bf-4636-92fc-72e50c7a7a96/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.100736 Oct 30 01:24:39.205777 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1339/2650] 10.222.0.13 () {60 vars in 1337 bytes} [Sun Oct 30 01:24:39 2022] GET /compute/v2.1/servers/f5fe2000-b4bf-4636-92fc-72e50c7a7a96/os-instance-actions => generated 611 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:24:39.210925 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c235cd4d-cd24-4257-ac67-f7924fdfbd5d tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:39.212194 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c235cd4d-cd24-4257-ac67-f7924fdfbd5d tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] [instance: 9bd44e90-60a5-4f4d-ae27-a7dffcb3503e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:39.219109 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c235cd4d-cd24-4257-ac67-f7924fdfbd5d tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:39.219996 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c235cd4d-cd24-4257-ac67-f7924fdfbd5d tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:39.220595 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c235cd4d-cd24-4257-ac67-f7924fdfbd5d tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:39.221994 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c235cd4d-cd24-4257-ac67-f7924fdfbd5d tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:39.222601 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c235cd4d-cd24-4257-ac67-f7924fdfbd5d tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:39.223167 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c235cd4d-cd24-4257-ac67-f7924fdfbd5d tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:39.624687 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c235cd4d-cd24-4257-ac67-f7924fdfbd5d tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb216afb20940ce9cc86b2d1faab962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4747ca082b4a9b82bb64c9ea2ec750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:39.636203 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c235cd4d-cd24-4257-ac67-f7924fdfbd5d tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] 10.222.0.13 "GET /compute/v2.1/servers/9bd44e90-60a5-4f4d-ae27-a7dffcb3503e" status: 200 len: 1541 microversion: 2.1 time: 0.428657 Oct 30 01:24:39.638035 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1340/2651] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:39 2022] GET /compute/v2.1/servers/9bd44e90-60a5-4f4d-ae27-a7dffcb3503e => generated 1541 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:39.643360 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-88520b93-ba77-4160-a472-cce99cd2fdd3 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:39.643847 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-88520b93-ba77-4160-a472-cce99cd2fdd3 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] [instance: f5fe2000-b4bf-4636-92fc-72e50c7a7a96] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:39.650398 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-88520b93-ba77-4160-a472-cce99cd2fdd3 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:39.650880 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-88520b93-ba77-4160-a472-cce99cd2fdd3 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:39.651487 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-88520b93-ba77-4160-a472-cce99cd2fdd3 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:39.652701 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-88520b93-ba77-4160-a472-cce99cd2fdd3 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:39.653360 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-88520b93-ba77-4160-a472-cce99cd2fdd3 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:39.653800 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-88520b93-ba77-4160-a472-cce99cd2fdd3 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:39.668716 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-88520b93-ba77-4160-a472-cce99cd2fdd3 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] HTTP exception thrown: Instance f5fe2000-b4bf-4636-92fc-72e50c7a7a96 could not be found. Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-88520b93-ba77-4160-a472-cce99cd2fdd3 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Request method failure captured: Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/servers/f5fe2000-b4bf-4636-92fc-72e50c7a7a96 HTTP/1.1 Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdI0eGGd0MVtCYStc45Sv3jXP1I0Bi4GsrNrjgnah6UUre_RKxm6e2G6Iha-dDJbAoxJKf3afY45cVzDjaunnAo3p1D1468QRdGBh8QNu88X-HIHi0XLQUv8luCIrzLPKATRayChxKLIbSLAfmhLr5iNpm4ILGPTaFY4Wkeem27ZTAU Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: X-Openstack-Nova-Api-Version: 2.21 Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 121fd24a0b6b4eb3aa1cac304dda16a0 Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-InstanceActionsV221TestJSON-611716598 Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/121fd24a0b6b4eb3aa1cac304dda16a0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_121fd24a0b6b4eb3aa1cac304dda16a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/121fd24a0b6b4eb3aa1cac304dda16a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/121fd24a0b6b4eb3aa1cac304dda16a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-InstanceActionsV221TestJSON-611716598 Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 121fd24a0b6b4eb3aa1cac304dda16a0 Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-611716598 Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-InstanceActionsV221TestJSON-611716598-project Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: e533367cf3fc4e06a96c6add0540b897 Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-InstanceActionsV221TestJSON-611716598-project Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: exception: Instance f5fe2000-b4bf-4636-92fc-72e50c7a7a96 could not be found. Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'f5fe2000-b4bf-4636-92fc-72e50c7a7a96'} Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5fe2000-b4bf-4636-92fc-72e50c7a7a96 could not be found. Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:24:39.670500 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:24:39.674402 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5fe2000-b4bf-4636-92fc-72e50c7a7a96 could not be found. Oct 30 01:24:39.674402 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:24:39.674402 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:24:39.674402 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:24:39.674402 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:24:39.674402 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:24:39.674402 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:24:39.674402 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:24:39.674402 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:24:39.674402 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5fe2000-b4bf-4636-92fc-72e50c7a7a96 could not be found. Oct 30 01:24:39.674402 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:24:39.674402 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-88520b93-ba77-4160-a472-cce99cd2fdd3 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Returning 404 to user: Instance f5fe2000-b4bf-4636-92fc-72e50c7a7a96 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:24:39.674402 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-88520b93-ba77-4160-a472-cce99cd2fdd3 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f5fe2000-b4bf-4636-92fc-72e50c7a7a96" status: 404 len: 111 microversion: 2.21 time: 0.032877 Oct 30 01:24:39.674402 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1341/2652] 10.222.0.13 () {60 vars in 1280 bytes} [Sun Oct 30 01:24:39 2022] DELETE /compute/v2.1/servers/f5fe2000-b4bf-4636-92fc-72e50c7a7a96 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:24:39.681310 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b045564f-1127-45c1-8c51-ec2a68830491 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:39.681903 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b045564f-1127-45c1-8c51-ec2a68830491 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: 403e0292-c082-4655-ad08-b5dc3a7f8305] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:39.688859 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b045564f-1127-45c1-8c51-ec2a68830491 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:39.690047 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b045564f-1127-45c1-8c51-ec2a68830491 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:39.690616 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b045564f-1127-45c1-8c51-ec2a68830491 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:39.691932 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b045564f-1127-45c1-8c51-ec2a68830491 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:39.692560 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b045564f-1127-45c1-8c51-ec2a68830491 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:39.693143 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b045564f-1127-45c1-8c51-ec2a68830491 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:39.713174 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:24:39.908326 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b045564f-1127-45c1-8c51-ec2a68830491 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:39.920690 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b045564f-1127-45c1-8c51-ec2a68830491 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305" status: 200 len: 1496 microversion: 2.1 time: 0.246638 Oct 30 01:24:39.921272 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1342/2653] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:39 2022] GET /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305 => generated 1496 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:39.926203 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-9f9b75d8-08d9-4893-9e6e-12b0fc9d15cf req-b5aa0c54-1e25-40c2-b99a-3da856eefef2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87b560b8-33af-4f79-9768-7a7285a06a10", "name": "network-vif-deleted", "tag": "b893cb0a-5a5f-4bec-a667-ff7aea4c5048"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:24:39.932267 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=4,nova_api:DELETE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:24:39.936275 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-9f9b75d8-08d9-4893-9e6e-12b0fc9d15cf req-b5aa0c54-1e25-40c2-b99a-3da856eefef2 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:39.936751 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-9f9b75d8-08d9-4893-9e6e-12b0fc9d15cf req-b5aa0c54-1e25-40c2-b99a-3da856eefef2 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:39.937179 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-9f9b75d8-08d9-4893-9e6e-12b0fc9d15cf req-b5aa0c54-1e25-40c2-b99a-3da856eefef2 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:39.948869 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-9f9b75d8-08d9-4893-9e6e-12b0fc9d15cf req-b5aa0c54-1e25-40c2-b99a-3da856eefef2 service nova] Creating event network-vif-deleted:b893cb0a-5a5f-4bec-a667-ff7aea4c5048 for instance 87b560b8-33af-4f79-9768-7a7285a06a10 on n-h2-master-1 Oct 30 01:24:39.956074 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-9f9b75d8-08d9-4893-9e6e-12b0fc9d15cf req-b5aa0c54-1e25-40c2-b99a-3da856eefef2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032248 Oct 30 01:24:39.956074 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1343/2654] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:24:39.960593 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a4304092-0b3e-4a56-8eca-49ad91fb7de3 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:39.961280 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a4304092-0b3e-4a56-8eca-49ad91fb7de3 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] [instance: f5fe2000-b4bf-4636-92fc-72e50c7a7a96] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:39.968824 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a4304092-0b3e-4a56-8eca-49ad91fb7de3 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:39.969305 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a4304092-0b3e-4a56-8eca-49ad91fb7de3 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:39.969982 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a4304092-0b3e-4a56-8eca-49ad91fb7de3 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:39.970673 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a4304092-0b3e-4a56-8eca-49ad91fb7de3 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:39.971125 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a4304092-0b3e-4a56-8eca-49ad91fb7de3 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:39.971546 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a4304092-0b3e-4a56-8eca-49ad91fb7de3 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:39.985429 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-a4304092-0b3e-4a56-8eca-49ad91fb7de3 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] HTTP exception thrown: Instance f5fe2000-b4bf-4636-92fc-72e50c7a7a96 could not be found. Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a4304092-0b3e-4a56-8eca-49ad91fb7de3 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Request method failure captured: Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/f5fe2000-b4bf-4636-92fc-72e50c7a7a96 HTTP/1.1 Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdI0eGGd0MVtCYStc45Sv3jXP1I0Bi4GsrNrjgnah6UUre_RKxm6e2G6Iha-dDJbAoxJKf3afY45cVzDjaunnAo3p1D1468QRdGBh8QNu88X-HIHi0XLQUv8luCIrzLPKATRayChxKLIbSLAfmhLr5iNpm4ILGPTaFY4Wkeem27ZTAU Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: X-Openstack-Nova-Api-Version: 2.21 Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 121fd24a0b6b4eb3aa1cac304dda16a0 Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-InstanceActionsV221TestJSON-611716598 Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/121fd24a0b6b4eb3aa1cac304dda16a0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_121fd24a0b6b4eb3aa1cac304dda16a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/121fd24a0b6b4eb3aa1cac304dda16a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/121fd24a0b6b4eb3aa1cac304dda16a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-InstanceActionsV221TestJSON-611716598 Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 121fd24a0b6b4eb3aa1cac304dda16a0 Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-611716598 Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-InstanceActionsV221TestJSON-611716598-project Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: e533367cf3fc4e06a96c6add0540b897 Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-InstanceActionsV221TestJSON-611716598-project Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: exception: Instance f5fe2000-b4bf-4636-92fc-72e50c7a7a96 could not be found. Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'f5fe2000-b4bf-4636-92fc-72e50c7a7a96'} Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5fe2000-b4bf-4636-92fc-72e50c7a7a96 could not be found. Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5fe2000-b4bf-4636-92fc-72e50c7a7a96 could not be found. Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:24:39.987130 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:24:39.991527 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:24:39.991527 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:24:39.991527 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:24:39.991527 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:24:39.991527 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:24:39.991527 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:24:39.991527 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5fe2000-b4bf-4636-92fc-72e50c7a7a96 could not be found. Oct 30 01:24:39.991527 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:24:39.991527 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a4304092-0b3e-4a56-8eca-49ad91fb7de3 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] Returning 404 to user: Instance f5fe2000-b4bf-4636-92fc-72e50c7a7a96 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:24:39.991527 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a4304092-0b3e-4a56-8eca-49ad91fb7de3 tempest-InstanceActionsV221TestJSON-611716598 tempest-InstanceActionsV221TestJSON-611716598-project] 10.222.0.13 "GET /compute/v2.1/servers/f5fe2000-b4bf-4636-92fc-72e50c7a7a96" status: 404 len: 111 microversion: 2.21 time: 0.032032 Oct 30 01:24:39.991527 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1344/2655] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:24:39 2022] GET /compute/v2.1/servers/f5fe2000-b4bf-4636-92fc-72e50c7a7a96 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:24:39.994002 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a8414792-a090-4d03-a8ad-2712c6d1ac22 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:39.994645 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a8414792-a090-4d03-a8ad-2712c6d1ac22 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 32c70d3f-96cd-4b23-a743-05aed245baf0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:40.000318 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a8414792-a090-4d03-a8ad-2712c6d1ac22 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:40.000798 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a8414792-a090-4d03-a8ad-2712c6d1ac22 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:40.001272 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a8414792-a090-4d03-a8ad-2712c6d1ac22 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:40.001995 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a8414792-a090-4d03-a8ad-2712c6d1ac22 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:40.002443 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a8414792-a090-4d03-a8ad-2712c6d1ac22 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:40.002859 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a8414792-a090-4d03-a8ad-2712c6d1ac22 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:40.271249 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-125b86ad-9eb1-4125-9f13-aa5d86662ffc tempest-FloatingIPDetailsTestJSON-1033028491 tempest-FloatingIPDetailsTestJSON-1033028491-project] 10.222.0.13 "DELETE /compute/v2.1/os-floating-ips/5b5a228a-ab38-416f-871d-e34153912771" status: 202 len: 0 microversion: 2.1 time: 1.490530 Oct 30 01:24:40.274605 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1312/2656] 10.222.0.13 () {58 vars in 1263 bytes} [Sun Oct 30 01:24:38 2022] DELETE /compute/v2.1/os-floating-ips/5b5a228a-ab38-416f-871d-e34153912771 => generated 0 bytes in 1494 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:24:40.293870 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-645284f5-fcf5-4471-83fc-c466c676b8e9 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:40.295700 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-645284f5-fcf5-4471-83fc-c466c676b8e9 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] [instance: 87b560b8-33af-4f79-9768-7a7285a06a10] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:40.305943 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:24:40.317242 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-645284f5-fcf5-4471-83fc-c466c676b8e9 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:40.318502 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-645284f5-fcf5-4471-83fc-c466c676b8e9 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:40.319127 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-645284f5-fcf5-4471-83fc-c466c676b8e9 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:40.321395 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-645284f5-fcf5-4471-83fc-c466c676b8e9 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:40.322602 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-645284f5-fcf5-4471-83fc-c466c676b8e9 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:40.323200 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-645284f5-fcf5-4471-83fc-c466c676b8e9 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:40.379559 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a8414792-a090-4d03-a8ad-2712c6d1ac22 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:40.396478 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a8414792-a090-4d03-a8ad-2712c6d1ac22 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0" status: 200 len: 1512 microversion: 2.1 time: 0.405746 Oct 30 01:24:40.411924 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1345/2657] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:39 2022] GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0 => generated 1512 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:40.459315 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-645284f5-fcf5-4471-83fc-c466c676b8e9 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8b2c03e5294bbe9ee8cda7468c9d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada31213f567489299af80277ee35f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:40.470194 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-645284f5-fcf5-4471-83fc-c466c676b8e9 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] 10.222.0.13 "GET /compute/v2.1/servers/87b560b8-33af-4f79-9768-7a7285a06a10" status: 200 len: 1484 microversion: 2.1 time: 0.194333 Oct 30 01:24:40.471450 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1313/2658] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:40 2022] GET /compute/v2.1/servers/87b560b8-33af-4f79-9768-7a7285a06a10 => generated 1484 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:40.683849 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-220d201c-82a5-48a8-a25b-e5f86ba91039 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:40.692368 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-220d201c-82a5-48a8-a25b-e5f86ba91039 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] [instance: 9bd44e90-60a5-4f4d-ae27-a7dffcb3503e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:40.714251 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-220d201c-82a5-48a8-a25b-e5f86ba91039 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:40.715553 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-220d201c-82a5-48a8-a25b-e5f86ba91039 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:40.716105 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-220d201c-82a5-48a8-a25b-e5f86ba91039 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:40.716935 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-220d201c-82a5-48a8-a25b-e5f86ba91039 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:40.717535 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-220d201c-82a5-48a8-a25b-e5f86ba91039 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:40.718194 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-220d201c-82a5-48a8-a25b-e5f86ba91039 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:40.945136 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-14c6db8d-9e31-4560-803a-eaca60c052cc tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:40.945782 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-14c6db8d-9e31-4560-803a-eaca60c052cc tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: 403e0292-c082-4655-ad08-b5dc3a7f8305] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:40.956458 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14c6db8d-9e31-4560-803a-eaca60c052cc tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:40.957184 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14c6db8d-9e31-4560-803a-eaca60c052cc tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:40.957809 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14c6db8d-9e31-4560-803a-eaca60c052cc tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:40.958517 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14c6db8d-9e31-4560-803a-eaca60c052cc tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:40.959240 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14c6db8d-9e31-4560-803a-eaca60c052cc tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:40.959672 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14c6db8d-9e31-4560-803a-eaca60c052cc tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:41.024015 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-220d201c-82a5-48a8-a25b-e5f86ba91039 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb216afb20940ce9cc86b2d1faab962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4747ca082b4a9b82bb64c9ea2ec750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:41.035479 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-220d201c-82a5-48a8-a25b-e5f86ba91039 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] 10.222.0.13 "GET /compute/v2.1/servers/9bd44e90-60a5-4f4d-ae27-a7dffcb3503e" status: 200 len: 1541 microversion: 2.1 time: 0.379055 Oct 30 01:24:41.036470 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1346/2659] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:40 2022] GET /compute/v2.1/servers/9bd44e90-60a5-4f4d-ae27-a7dffcb3503e => generated 1541 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:41.424599 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-efc79c88-acff-45a0-a43a-62e375532dc4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:41.425822 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-efc79c88-acff-45a0-a43a-62e375532dc4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 32c70d3f-96cd-4b23-a743-05aed245baf0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:41.439330 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-efc79c88-acff-45a0-a43a-62e375532dc4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:41.440095 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-efc79c88-acff-45a0-a43a-62e375532dc4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:41.440757 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-efc79c88-acff-45a0-a43a-62e375532dc4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:41.442204 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-efc79c88-acff-45a0-a43a-62e375532dc4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:41.443180 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-efc79c88-acff-45a0-a43a-62e375532dc4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:41.443952 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-efc79c88-acff-45a0-a43a-62e375532dc4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:41.791502 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-14c6db8d-9e31-4560-803a-eaca60c052cc tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:41.802913 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-14c6db8d-9e31-4560-803a-eaca60c052cc tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305" status: 200 len: 1496 microversion: 2.1 time: 0.862797 Oct 30 01:24:41.805175 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1314/2660] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:40 2022] GET /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305 => generated 1496 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:41.811634 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cee76506-21ab-43ae-8268-43ff4137cc16 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:41.812857 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-cee76506-21ab-43ae-8268-43ff4137cc16 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] [instance: 87b560b8-33af-4f79-9768-7a7285a06a10] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:41.833305 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cee76506-21ab-43ae-8268-43ff4137cc16 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:41.834297 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cee76506-21ab-43ae-8268-43ff4137cc16 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:41.835037 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cee76506-21ab-43ae-8268-43ff4137cc16 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:41.835873 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cee76506-21ab-43ae-8268-43ff4137cc16 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:41.836447 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cee76506-21ab-43ae-8268-43ff4137cc16 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:41.837056 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cee76506-21ab-43ae-8268-43ff4137cc16 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:41.861666 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-cee76506-21ab-43ae-8268-43ff4137cc16 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] HTTP exception thrown: Instance 87b560b8-33af-4f79-9768-7a7285a06a10 could not be found. Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cee76506-21ab-43ae-8268-43ff4137cc16 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Request method failure captured: Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/87b560b8-33af-4f79-9768-7a7285a06a10 HTTP/1.1 Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdI7hXmuB1XI9FOCgUfxzJI5vCMAF9BU13eyJ1J1MmqCYl7o24KgF4cpHFtnJOecvtKlCxL7mDkf35OgczUAmWERkib7Iw2gr_NqZwZXCas5gkF2eMwYl8otydw7z4f_KCB8bmLznDDS0uWUpHBKNLlCCl_QgpBai_9lfdnE9xs2KEQ Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: ada31213f567489299af80277ee35f65 Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1199645215 Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ada31213f567489299af80277ee35f65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ada31213f567489299af80277ee35f65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ada31213f567489299af80277ee35f65"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ada31213f567489299af80277ee35f65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1199645215 Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: ada31213f567489299af80277ee35f65 Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1199645215 Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServerMetadataNegativeTestJSON-1199645215-project Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 6e8b2c03e5294bbe9ee8cda7468c9d86 Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1199645215-project Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 87b560b8-33af-4f79-9768-7a7285a06a10 could not be found. Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '87b560b8-33af-4f79-9768-7a7285a06a10'} Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87b560b8-33af-4f79-9768-7a7285a06a10 could not be found. Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87b560b8-33af-4f79-9768-7a7285a06a10 could not be found. Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:24:41.863403 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:24:41.867336 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:24:41.867336 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:24:41.867336 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:24:41.867336 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:24:41.867336 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:24:41.867336 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:24:41.867336 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87b560b8-33af-4f79-9768-7a7285a06a10 could not be found. Oct 30 01:24:41.867336 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:24:41.867336 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cee76506-21ab-43ae-8268-43ff4137cc16 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] Returning 404 to user: Instance 87b560b8-33af-4f79-9768-7a7285a06a10 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:24:41.867336 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cee76506-21ab-43ae-8268-43ff4137cc16 tempest-ServerMetadataNegativeTestJSON-1199645215 tempest-ServerMetadataNegativeTestJSON-1199645215-project] 10.222.0.13 "GET /compute/v2.1/servers/87b560b8-33af-4f79-9768-7a7285a06a10" status: 404 len: 111 microversion: 2.1 time: 0.058490 Oct 30 01:24:41.867336 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1315/2661] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:41 2022] GET /compute/v2.1/servers/87b560b8-33af-4f79-9768-7a7285a06a10 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:24:41.945941 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-efc79c88-acff-45a0-a43a-62e375532dc4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:41.955134 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-efc79c88-acff-45a0-a43a-62e375532dc4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0" status: 200 len: 1512 microversion: 2.1 time: 0.538681 Oct 30 01:24:41.956460 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1347/2662] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:41 2022] GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0 => generated 1512 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:41.995401 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-35236daa-9091-4dfe-adaa-7214148d7ce6 req-97f359f9-7d35-4876-b006-9fb0e857cb9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bd44e90-60a5-4f4d-ae27-a7dffcb3503e", "name": "network-vif-deleted", "tag": "d2ed3272-2b5d-4ab4-90e4-02f9832b391e"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:24:42.005647 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-35236daa-9091-4dfe-adaa-7214148d7ce6 req-97f359f9-7d35-4876-b006-9fb0e857cb9b service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:42.006228 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-35236daa-9091-4dfe-adaa-7214148d7ce6 req-97f359f9-7d35-4876-b006-9fb0e857cb9b service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:42.006728 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-35236daa-9091-4dfe-adaa-7214148d7ce6 req-97f359f9-7d35-4876-b006-9fb0e857cb9b service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:42.021744 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-35236daa-9091-4dfe-adaa-7214148d7ce6 req-97f359f9-7d35-4876-b006-9fb0e857cb9b service nova] Creating event network-vif-deleted:d2ed3272-2b5d-4ab4-90e4-02f9832b391e for instance 9bd44e90-60a5-4f4d-ae27-a7dffcb3503e on n-h2-master-1 Oct 30 01:24:42.029803 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-35236daa-9091-4dfe-adaa-7214148d7ce6 req-97f359f9-7d35-4876-b006-9fb0e857cb9b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035023 Oct 30 01:24:42.034602 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1316/2663] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:24:42.065623 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-356c7ce2-5e10-422e-a98e-5ceead3842cb tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:42.067498 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-356c7ce2-5e10-422e-a98e-5ceead3842cb tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] [instance: 9bd44e90-60a5-4f4d-ae27-a7dffcb3503e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:42.077072 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-356c7ce2-5e10-422e-a98e-5ceead3842cb tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:42.077851 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-356c7ce2-5e10-422e-a98e-5ceead3842cb tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:42.078366 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-356c7ce2-5e10-422e-a98e-5ceead3842cb tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:42.079181 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-356c7ce2-5e10-422e-a98e-5ceead3842cb tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:42.079718 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-356c7ce2-5e10-422e-a98e-5ceead3842cb tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:42.080223 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-356c7ce2-5e10-422e-a98e-5ceead3842cb tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:42.204084 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-356c7ce2-5e10-422e-a98e-5ceead3842cb tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb216afb20940ce9cc86b2d1faab962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4747ca082b4a9b82bb64c9ea2ec750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:42.213360 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-356c7ce2-5e10-422e-a98e-5ceead3842cb tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] 10.222.0.13 "GET /compute/v2.1/servers/9bd44e90-60a5-4f4d-ae27-a7dffcb3503e" status: 200 len: 1316 microversion: 2.1 time: 0.156270 Oct 30 01:24:42.214212 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1348/2664] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:42 2022] GET /compute/v2.1/servers/9bd44e90-60a5-4f4d-ae27-a7dffcb3503e => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:42.844176 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-45bb69ab-b374-47b7-9b59-f48bb92a44d5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:42.846784 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-45bb69ab-b374-47b7-9b59-f48bb92a44d5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: 403e0292-c082-4655-ad08-b5dc3a7f8305] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:42.862297 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45bb69ab-b374-47b7-9b59-f48bb92a44d5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:42.863247 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45bb69ab-b374-47b7-9b59-f48bb92a44d5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:42.863859 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45bb69ab-b374-47b7-9b59-f48bb92a44d5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:42.864741 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45bb69ab-b374-47b7-9b59-f48bb92a44d5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:42.865378 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45bb69ab-b374-47b7-9b59-f48bb92a44d5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:42.865959 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45bb69ab-b374-47b7-9b59-f48bb92a44d5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:42.981239 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-38bf56c9-5f1c-43ff-9016-9af72afb7efe tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:42.982321 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-38bf56c9-5f1c-43ff-9016-9af72afb7efe tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 32c70d3f-96cd-4b23-a743-05aed245baf0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:43.003729 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-38bf56c9-5f1c-43ff-9016-9af72afb7efe tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:43.004884 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-38bf56c9-5f1c-43ff-9016-9af72afb7efe tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:43.012589 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-38bf56c9-5f1c-43ff-9016-9af72afb7efe tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:43.012589 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-38bf56c9-5f1c-43ff-9016-9af72afb7efe tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:43.016013 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-38bf56c9-5f1c-43ff-9016-9af72afb7efe tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:43.018515 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-38bf56c9-5f1c-43ff-9016-9af72afb7efe tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:43.645505 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-38bf56c9-5f1c-43ff-9016-9af72afb7efe tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:43.678929 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-38bf56c9-5f1c-43ff-9016-9af72afb7efe tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0" status: 200 len: 1512 microversion: 2.1 time: 0.685407 Oct 30 01:24:43.682353 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1349/2665] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:42 2022] GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0 => generated 1512 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:24:43.697868 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e7aaaba1-7d2f-4c29-9f2e-49106afec45a tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:43.702580 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e7aaaba1-7d2f-4c29-9f2e-49106afec45a tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] [instance: 9bd44e90-60a5-4f4d-ae27-a7dffcb3503e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:43.724421 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e7aaaba1-7d2f-4c29-9f2e-49106afec45a tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:43.724926 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e7aaaba1-7d2f-4c29-9f2e-49106afec45a tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:43.725374 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e7aaaba1-7d2f-4c29-9f2e-49106afec45a tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:43.726091 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e7aaaba1-7d2f-4c29-9f2e-49106afec45a tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:43.726539 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e7aaaba1-7d2f-4c29-9f2e-49106afec45a tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:43.728592 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-45bb69ab-b374-47b7-9b59-f48bb92a44d5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:43.734000 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e7aaaba1-7d2f-4c29-9f2e-49106afec45a tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:43.744987 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-45bb69ab-b374-47b7-9b59-f48bb92a44d5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305" status: 200 len: 1496 microversion: 2.1 time: 0.911907 Oct 30 01:24:43.759289 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1317/2666] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:42 2022] GET /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305 => generated 1496 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:43.794025 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-e7aaaba1-7d2f-4c29-9f2e-49106afec45a tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] HTTP exception thrown: Instance 9bd44e90-60a5-4f4d-ae27-a7dffcb3503e could not be found. Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e7aaaba1-7d2f-4c29-9f2e-49106afec45a tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Request method failure captured: Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/9bd44e90-60a5-4f4d-ae27-a7dffcb3503e HTTP/1.1 Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdIkvQK32ztsDxcYn-yUrHzOz1wf_T9VGlxvk4nwqWdnV76pRk-OA8zN-pznKFXUcdhndGD4RbL17lxTC2Q2LewQsJ61sfedOmJ3hKWxKZTWEATyRzqcietKy_-QJlMYym_dy3A2-cw1_m7OSjVGFG7arQOMCApo5m7M22Zk5TxckzE Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 0e4747ca082b4a9b82bb64c9ea2ec750 Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0e4747ca082b4a9b82bb64c9ea2ec750"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0e4747ca082b4a9b82bb64c9ea2ec750"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0e4747ca082b4a9b82bb64c9ea2ec750"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0e4747ca082b4a9b82bb64c9ea2ec750"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 0e4747ca082b4a9b82bb64c9ea2ec750 Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 9cb216afb20940ce9cc86b2d1faab962 Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 9bd44e90-60a5-4f4d-ae27-a7dffcb3503e could not be found. Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '9bd44e90-60a5-4f4d-ae27-a7dffcb3503e'} Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bd44e90-60a5-4f4d-ae27-a7dffcb3503e could not be found. Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bd44e90-60a5-4f4d-ae27-a7dffcb3503e could not be found. Oct 30 01:24:43.796040 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:24:43.799578 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:24:43.799578 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:24:43.799578 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:24:43.799578 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:24:43.799578 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:24:43.799578 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:24:43.799578 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:24:43.799578 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bd44e90-60a5-4f4d-ae27-a7dffcb3503e could not be found. Oct 30 01:24:43.799578 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:24:43.805901 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e7aaaba1-7d2f-4c29-9f2e-49106afec45a tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] Returning 404 to user: Instance 9bd44e90-60a5-4f4d-ae27-a7dffcb3503e could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:24:43.807646 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e7aaaba1-7d2f-4c29-9f2e-49106afec45a tempest-FloatingIPsAssociationNegativeTestJSON-1414245632 tempest-FloatingIPsAssociationNegativeTestJSON-1414245632-project] 10.222.0.13 "GET /compute/v2.1/servers/9bd44e90-60a5-4f4d-ae27-a7dffcb3503e" status: 404 len: 111 microversion: 2.1 time: 0.124118 Oct 30 01:24:43.817367 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1350/2667] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:43 2022] GET /compute/v2.1/servers/9bd44e90-60a5-4f4d-ae27-a7dffcb3503e => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:24:44.704571 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0bef700b-19a3-478f-933c-d40afdaa6603 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:44.705871 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0bef700b-19a3-478f-933c-d40afdaa6603 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 32c70d3f-96cd-4b23-a743-05aed245baf0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:44.722193 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0bef700b-19a3-478f-933c-d40afdaa6603 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:44.725712 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0bef700b-19a3-478f-933c-d40afdaa6603 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:44.726407 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0bef700b-19a3-478f-933c-d40afdaa6603 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:44.727443 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0bef700b-19a3-478f-933c-d40afdaa6603 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:44.728271 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0bef700b-19a3-478f-933c-d40afdaa6603 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:44.730370 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0bef700b-19a3-478f-933c-d40afdaa6603 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:44.776854 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4197f430-f614-4007-95b2-81840611f91d tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:44.779756 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4197f430-f614-4007-95b2-81840611f91d tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: 403e0292-c082-4655-ad08-b5dc3a7f8305] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:44.789786 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:24:44.802626 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4197f430-f614-4007-95b2-81840611f91d tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:44.805064 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4197f430-f614-4007-95b2-81840611f91d tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:44.805807 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4197f430-f614-4007-95b2-81840611f91d tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:44.809742 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4197f430-f614-4007-95b2-81840611f91d tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:44.812142 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4197f430-f614-4007-95b2-81840611f91d tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:44.812874 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4197f430-f614-4007-95b2-81840611f91d tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:45.263401 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0bef700b-19a3-478f-933c-d40afdaa6603 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:45.271196 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0bef700b-19a3-478f-933c-d40afdaa6603 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0" status: 200 len: 1512 microversion: 2.1 time: 0.573425 Oct 30 01:24:45.271786 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1318/2668] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:44 2022] GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0 => generated 1512 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:45.279478 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4197f430-f614-4007-95b2-81840611f91d tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:45.289948 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4197f430-f614-4007-95b2-81840611f91d tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305" status: 200 len: 1496 microversion: 2.1 time: 0.517068 Oct 30 01:24:45.298128 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1351/2669] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:44 2022] GET /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305 => generated 1496 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:46.297530 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a62b98a2-9b2a-42e9-bd70-add4c7efe571 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:46.298826 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a62b98a2-9b2a-42e9-bd70-add4c7efe571 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 32c70d3f-96cd-4b23-a743-05aed245baf0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:46.322781 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a75385a0-e5f6-4c57-8832-d229b5f72d44 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:46.323434 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a62b98a2-9b2a-42e9-bd70-add4c7efe571 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:46.323641 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a75385a0-e5f6-4c57-8832-d229b5f72d44 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: 403e0292-c082-4655-ad08-b5dc3a7f8305] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:46.325168 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a62b98a2-9b2a-42e9-bd70-add4c7efe571 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:46.325803 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a62b98a2-9b2a-42e9-bd70-add4c7efe571 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:46.326791 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a62b98a2-9b2a-42e9-bd70-add4c7efe571 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:46.329731 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a62b98a2-9b2a-42e9-bd70-add4c7efe571 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:46.330403 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a62b98a2-9b2a-42e9-bd70-add4c7efe571 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:46.339151 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a75385a0-e5f6-4c57-8832-d229b5f72d44 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:46.340035 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a75385a0-e5f6-4c57-8832-d229b5f72d44 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:46.346196 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a75385a0-e5f6-4c57-8832-d229b5f72d44 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:46.347416 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a75385a0-e5f6-4c57-8832-d229b5f72d44 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:46.348304 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a75385a0-e5f6-4c57-8832-d229b5f72d44 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:46.348964 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a75385a0-e5f6-4c57-8832-d229b5f72d44 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:47.246245 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a75385a0-e5f6-4c57-8832-d229b5f72d44 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:47.262307 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a75385a0-e5f6-4c57-8832-d229b5f72d44 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305" status: 200 len: 1496 microversion: 2.1 time: 0.944556 Oct 30 01:24:47.274798 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1352/2670] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:46 2022] GET /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305 => generated 1496 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:47.290648 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a62b98a2-9b2a-42e9-bd70-add4c7efe571 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:47.302422 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a62b98a2-9b2a-42e9-bd70-add4c7efe571 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0" status: 200 len: 1512 microversion: 2.1 time: 1.009697 Oct 30 01:24:47.320189 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1319/2671] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:46 2022] GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0 => generated 1512 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:48.288131 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-77254fc3-ff25-41a7-b418-4f35c2fc16fb tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:48.290674 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-77254fc3-ff25-41a7-b418-4f35c2fc16fb tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: 403e0292-c082-4655-ad08-b5dc3a7f8305] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:48.299437 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-77254fc3-ff25-41a7-b418-4f35c2fc16fb tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:48.300234 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-77254fc3-ff25-41a7-b418-4f35c2fc16fb tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:48.300867 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-77254fc3-ff25-41a7-b418-4f35c2fc16fb tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:48.301857 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-77254fc3-ff25-41a7-b418-4f35c2fc16fb tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:48.303813 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-77254fc3-ff25-41a7-b418-4f35c2fc16fb tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:48.304544 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-77254fc3-ff25-41a7-b418-4f35c2fc16fb tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:48.327783 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-aa007450-67e1-4414-93f9-be3a8222866c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:48.328395 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-aa007450-67e1-4414-93f9-be3a8222866c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 32c70d3f-96cd-4b23-a743-05aed245baf0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:48.337585 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa007450-67e1-4414-93f9-be3a8222866c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:48.341060 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa007450-67e1-4414-93f9-be3a8222866c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:48.343167 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa007450-67e1-4414-93f9-be3a8222866c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:48.344077 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa007450-67e1-4414-93f9-be3a8222866c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:48.344543 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa007450-67e1-4414-93f9-be3a8222866c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:48.344984 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa007450-67e1-4414-93f9-be3a8222866c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:48.723101 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-aa007450-67e1-4414-93f9-be3a8222866c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:48.740585 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-77254fc3-ff25-41a7-b418-4f35c2fc16fb tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:48.751535 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-77254fc3-ff25-41a7-b418-4f35c2fc16fb tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305" status: 200 len: 1496 microversion: 2.1 time: 0.468666 Oct 30 01:24:48.769845 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-aa007450-67e1-4414-93f9-be3a8222866c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0" status: 200 len: 1512 microversion: 2.1 time: 0.442924 Oct 30 01:24:48.769845 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1320/2672] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:48 2022] GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0 => generated 1512 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:24:48.776255 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1353/2673] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:48 2022] GET /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305 => generated 1496 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:49.105708 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f313f69e-adef-46ef-a230-ea1a7d1dfb3c tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b6fc99b3-d6ca-450b-a45c-2050646a338d"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:24:49.108473 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f313f69e-adef-46ef-a230-ea1a7d1dfb3c tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] [instance: dcb34439-de04-4a9c-b81b-7fb2360af99c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:49.114834 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f313f69e-adef-46ef-a230-ea1a7d1dfb3c tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:49.115348 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f313f69e-adef-46ef-a230-ea1a7d1dfb3c tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:49.115777 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f313f69e-adef-46ef-a230-ea1a7d1dfb3c tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:49.116722 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f313f69e-adef-46ef-a230-ea1a7d1dfb3c tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:49.117269 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f313f69e-adef-46ef-a230-ea1a7d1dfb3c tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:49.117934 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f313f69e-adef-46ef-a230-ea1a7d1dfb3c tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:49.778333 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-25fd6526-41b8-457c-a2d5-5de0e2583752 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:49.779571 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-25fd6526-41b8-457c-a2d5-5de0e2583752 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: 403e0292-c082-4655-ad08-b5dc3a7f8305] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:49.788202 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25fd6526-41b8-457c-a2d5-5de0e2583752 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:49.788959 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25fd6526-41b8-457c-a2d5-5de0e2583752 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:49.789612 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25fd6526-41b8-457c-a2d5-5de0e2583752 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:49.790503 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25fd6526-41b8-457c-a2d5-5de0e2583752 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:49.791123 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25fd6526-41b8-457c-a2d5-5de0e2583752 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:49.791711 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25fd6526-41b8-457c-a2d5-5de0e2583752 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:50.147467 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f313f69e-adef-46ef-a230-ea1a7d1dfb3c tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] 10.222.0.13 "POST /compute/v2.1/servers/dcb34439-de04-4a9c-b81b-7fb2360af99c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.044968 Oct 30 01:24:50.165641 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1321/2674] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 30 01:24:49 2022] POST /compute/v2.1/servers/dcb34439-de04-4a9c-b81b-7fb2360af99c/os-volume_attachments => generated 194 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:24:50.178013 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3acef44b-a4ca-4116-b5de-bef544208e2c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:50.180941 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3acef44b-a4ca-4116-b5de-bef544208e2c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 32c70d3f-96cd-4b23-a743-05aed245baf0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:50.194244 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3acef44b-a4ca-4116-b5de-bef544208e2c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:50.194756 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3acef44b-a4ca-4116-b5de-bef544208e2c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:50.196371 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3acef44b-a4ca-4116-b5de-bef544208e2c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:50.200064 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3acef44b-a4ca-4116-b5de-bef544208e2c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:50.203700 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3acef44b-a4ca-4116-b5de-bef544208e2c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:50.204319 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3acef44b-a4ca-4116-b5de-bef544208e2c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:50.680048 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-25fd6526-41b8-457c-a2d5-5de0e2583752 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:50.694822 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-25fd6526-41b8-457c-a2d5-5de0e2583752 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305" status: 200 len: 1496 microversion: 2.1 time: 0.920185 Oct 30 01:24:50.696237 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1354/2675] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:49 2022] GET /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305 => generated 1496 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:51.143481 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3acef44b-a4ca-4116-b5de-bef544208e2c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:51.155674 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3acef44b-a4ca-4116-b5de-bef544208e2c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0" status: 200 len: 1512 microversion: 2.1 time: 0.987975 Oct 30 01:24:51.170458 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1322/2676] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:50 2022] GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0 => generated 1512 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:51.723802 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f94dacb7-68d3-4f2e-8703-d4308f2d6052 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:51.724423 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f94dacb7-68d3-4f2e-8703-d4308f2d6052 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: 403e0292-c082-4655-ad08-b5dc3a7f8305] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:51.743691 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f94dacb7-68d3-4f2e-8703-d4308f2d6052 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:51.744293 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f94dacb7-68d3-4f2e-8703-d4308f2d6052 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:51.744893 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f94dacb7-68d3-4f2e-8703-d4308f2d6052 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:51.749955 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f94dacb7-68d3-4f2e-8703-d4308f2d6052 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:51.750960 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f94dacb7-68d3-4f2e-8703-d4308f2d6052 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:51.751606 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f94dacb7-68d3-4f2e-8703-d4308f2d6052 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:52.183332 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e1c53be5-5731-4dbb-b11b-e1f53cd25a1e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:52.184711 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e1c53be5-5731-4dbb-b11b-e1f53cd25a1e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 32c70d3f-96cd-4b23-a743-05aed245baf0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:52.193672 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e1c53be5-5731-4dbb-b11b-e1f53cd25a1e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:52.194496 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e1c53be5-5731-4dbb-b11b-e1f53cd25a1e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:52.197392 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e1c53be5-5731-4dbb-b11b-e1f53cd25a1e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:52.197392 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e1c53be5-5731-4dbb-b11b-e1f53cd25a1e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:52.197392 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e1c53be5-5731-4dbb-b11b-e1f53cd25a1e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:52.198066 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e1c53be5-5731-4dbb-b11b-e1f53cd25a1e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:52.238897 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f94dacb7-68d3-4f2e-8703-d4308f2d6052 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:52.250659 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f94dacb7-68d3-4f2e-8703-d4308f2d6052 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305" status: 200 len: 1496 microversion: 2.1 time: 0.530016 Oct 30 01:24:52.266162 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1355/2677] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:51 2022] GET /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305 => generated 1496 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:52.885531 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e1c53be5-5731-4dbb-b11b-e1f53cd25a1e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:52.898798 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e1c53be5-5731-4dbb-b11b-e1f53cd25a1e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0" status: 200 len: 1512 microversion: 2.1 time: 0.717558 Oct 30 01:24:52.900439 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1323/2678] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:52 2022] GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0 => generated 1512 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:24:53.278207 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-86a7e657-d879-49cc-9fdc-c7bbb88ed2d2 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:53.278947 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-86a7e657-d879-49cc-9fdc-c7bbb88ed2d2 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: 403e0292-c082-4655-ad08-b5dc3a7f8305] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:53.297942 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86a7e657-d879-49cc-9fdc-c7bbb88ed2d2 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:53.297942 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86a7e657-d879-49cc-9fdc-c7bbb88ed2d2 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:53.297942 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86a7e657-d879-49cc-9fdc-c7bbb88ed2d2 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:53.301713 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86a7e657-d879-49cc-9fdc-c7bbb88ed2d2 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:53.302313 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86a7e657-d879-49cc-9fdc-c7bbb88ed2d2 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:53.302985 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86a7e657-d879-49cc-9fdc-c7bbb88ed2d2 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:53.924898 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-82fdaad4-017b-4786-8a7e-f56628903c18 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:53.926135 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-82fdaad4-017b-4786-8a7e-f56628903c18 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 32c70d3f-96cd-4b23-a743-05aed245baf0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:53.943908 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-82fdaad4-017b-4786-8a7e-f56628903c18 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:53.946131 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-82fdaad4-017b-4786-8a7e-f56628903c18 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:53.946661 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-82fdaad4-017b-4786-8a7e-f56628903c18 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:53.948933 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-82fdaad4-017b-4786-8a7e-f56628903c18 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:53.951562 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-82fdaad4-017b-4786-8a7e-f56628903c18 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:53.952244 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-82fdaad4-017b-4786-8a7e-f56628903c18 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:54.213771 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-86a7e657-d879-49cc-9fdc-c7bbb88ed2d2 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:54.235467 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-86a7e657-d879-49cc-9fdc-c7bbb88ed2d2 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305" status: 200 len: 1496 microversion: 2.1 time: 0.959336 Oct 30 01:24:54.238419 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1356/2679] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:53 2022] GET /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305 => generated 1496 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:54.443412 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-82fdaad4-017b-4786-8a7e-f56628903c18 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:54.453897 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-82fdaad4-017b-4786-8a7e-f56628903c18 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0" status: 200 len: 1512 microversion: 2.1 time: 0.533519 Oct 30 01:24:54.479269 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1324/2680] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:53 2022] GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0 => generated 1512 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:24:54.774811 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7352e5c5-bda4-43cb-a957-d197bb950e10 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1530192889", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:24:54.891550 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-7352e5c5-bda4-43cb-a957-d197bb950e10 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] validate_networks() for None {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:24:55.220874 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-7352e5c5-bda4-43cb-a957-d197bb950e10 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:24:55.221295 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-7352e5c5-bda4-43cb-a957-d197bb950e10 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:24:55.221805 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-7352e5c5-bda4-43cb-a957-d197bb950e10 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:24:55.223003 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-7352e5c5-bda4-43cb-a957-d197bb950e10 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:24:55.223770 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-7352e5c5-bda4-43cb-a957-d197bb950e10 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:24:55.235763 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7352e5c5-bda4-43cb-a957-d197bb950e10 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:55.236321 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7352e5c5-bda4-43cb-a957-d197bb950e10 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:55.236759 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7352e5c5-bda4-43cb-a957-d197bb950e10 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:55.237519 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7352e5c5-bda4-43cb-a957-d197bb950e10 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:55.238869 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7352e5c5-bda4-43cb-a957-d197bb950e10 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:55.239496 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7352e5c5-bda4-43cb-a957-d197bb950e10 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:55.264308 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-05dd2ac6-4c19-4056-a8a9-79718c2abc5f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:55.270754 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-7352e5c5-bda4-43cb-a957-d197bb950e10 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Getting quotas for project 310172f2dfaf4ddcb5eace8a13939cda. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:24:55.271377 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-05dd2ac6-4c19-4056-a8a9-79718c2abc5f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: 403e0292-c082-4655-ad08-b5dc3a7f8305] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:55.272500 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-7352e5c5-bda4-43cb-a957-d197bb950e10 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Getting quotas for user e1e50d6775ec4d2e96ab6e839b4631f1 and project 310172f2dfaf4ddcb5eace8a13939cda. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:24:55.275327 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-05dd2ac6-4c19-4056-a8a9-79718c2abc5f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:55.276012 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-05dd2ac6-4c19-4056-a8a9-79718c2abc5f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:55.278029 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-05dd2ac6-4c19-4056-a8a9-79718c2abc5f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:55.278997 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-05dd2ac6-4c19-4056-a8a9-79718c2abc5f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:55.279622 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-05dd2ac6-4c19-4056-a8a9-79718c2abc5f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:55.280210 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-05dd2ac6-4c19-4056-a8a9-79718c2abc5f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:55.287654 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7352e5c5-bda4-43cb-a957-d197bb950e10 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:24:55.293718 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7352e5c5-bda4-43cb-a957-d197bb950e10 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] [instance: 9c6be996-7886-41c6-9c0c-e0f899836cb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:24:55.426929 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7352e5c5-bda4-43cb-a957-d197bb950e10 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.863101 Oct 30 01:24:55.428763 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1357/2681] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:24:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:24:55.445391 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-794da7f5-6780-460e-8cdd-30d67655bc3f tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:55.446687 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-794da7f5-6780-460e-8cdd-30d67655bc3f tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] [instance: 9c6be996-7886-41c6-9c0c-e0f899836cb0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:55.581044 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-794da7f5-6780-460e-8cdd-30d67655bc3f tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e50d6775ec4d2e96ab6e839b4631f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310172f2dfaf4ddcb5eace8a13939cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:55.593227 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-794da7f5-6780-460e-8cdd-30d67655bc3f tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6be996-7886-41c6-9c0c-e0f899836cb0" status: 200 len: 1217 microversion: 2.1 time: 0.154515 Oct 30 01:24:55.604044 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-05dd2ac6-4c19-4056-a8a9-79718c2abc5f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:55.618647 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1358/2682] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:55 2022] GET /compute/v2.1/servers/9c6be996-7886-41c6-9c0c-e0f899836cb0 => generated 1217 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:55.625106 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5f69a516-a944-4dcf-99ad-8b8d50d9d838 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:55.631641 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-05dd2ac6-4c19-4056-a8a9-79718c2abc5f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305" status: 200 len: 1496 microversion: 2.1 time: 0.367347 Oct 30 01:24:55.632123 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5f69a516-a944-4dcf-99ad-8b8d50d9d838 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 32c70d3f-96cd-4b23-a743-05aed245baf0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:55.632414 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1325/2683] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:55 2022] GET /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305 => generated 1496 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:55.633288 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f69a516-a944-4dcf-99ad-8b8d50d9d838 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:55.633888 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f69a516-a944-4dcf-99ad-8b8d50d9d838 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:55.634395 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f69a516-a944-4dcf-99ad-8b8d50d9d838 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:55.635186 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f69a516-a944-4dcf-99ad-8b8d50d9d838 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:55.635786 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f69a516-a944-4dcf-99ad-8b8d50d9d838 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:55.636231 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f69a516-a944-4dcf-99ad-8b8d50d9d838 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:55.896388 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5f69a516-a944-4dcf-99ad-8b8d50d9d838 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:55.911367 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5f69a516-a944-4dcf-99ad-8b8d50d9d838 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0" status: 200 len: 1489 microversion: 2.1 time: 0.290689 Oct 30 01:24:55.912459 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1359/2684] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:55 2022] GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0 => generated 1489 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:55.950861 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-573f1424-ccae-4125-b91b-b8c918a2f0b8 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:55.951944 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-573f1424-ccae-4125-b91b-b8c918a2f0b8 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 32c70d3f-96cd-4b23-a743-05aed245baf0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:55.957540 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-573f1424-ccae-4125-b91b-b8c918a2f0b8 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:55.958291 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-573f1424-ccae-4125-b91b-b8c918a2f0b8 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:55.958900 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-573f1424-ccae-4125-b91b-b8c918a2f0b8 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:55.959777 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-573f1424-ccae-4125-b91b-b8c918a2f0b8 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:55.960415 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-573f1424-ccae-4125-b91b-b8c918a2f0b8 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:55.960838 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-573f1424-ccae-4125-b91b-b8c918a2f0b8 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:56.011240 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-573f1424-ccae-4125-b91b-b8c918a2f0b8 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 32c70d3f-96cd-4b23-a743-05aed245baf0] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:24:56.448756 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-573f1424-ccae-4125-b91b-b8c918a2f0b8 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "DELETE /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0" status: 204 len: 0 microversion: 2.1 time: 0.501355 Oct 30 01:24:56.453957 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1326/2685] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:24:55 2022] DELETE /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:24:56.463181 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c9d1c51d-f699-4888-b94b-236c4d57e4a8 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:56.463808 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c9d1c51d-f699-4888-b94b-236c4d57e4a8 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 32c70d3f-96cd-4b23-a743-05aed245baf0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:56.472662 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c9d1c51d-f699-4888-b94b-236c4d57e4a8 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:56.476747 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c9d1c51d-f699-4888-b94b-236c4d57e4a8 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:56.477444 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c9d1c51d-f699-4888-b94b-236c4d57e4a8 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:56.478354 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c9d1c51d-f699-4888-b94b-236c4d57e4a8 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:56.480214 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c9d1c51d-f699-4888-b94b-236c4d57e4a8 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:56.480848 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c9d1c51d-f699-4888-b94b-236c4d57e4a8 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:56.617012 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a70ca3a1-3cf8-4d35-b34e-5043427f4e0c tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:56.622237 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a70ca3a1-3cf8-4d35-b34e-5043427f4e0c tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] [instance: 9c6be996-7886-41c6-9c0c-e0f899836cb0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:56.791765 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a70ca3a1-3cf8-4d35-b34e-5043427f4e0c tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e50d6775ec4d2e96ab6e839b4631f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310172f2dfaf4ddcb5eace8a13939cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:56.804383 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a70ca3a1-3cf8-4d35-b34e-5043427f4e0c tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6be996-7886-41c6-9c0c-e0f899836cb0" status: 200 len: 1217 microversion: 2.1 time: 0.191838 Oct 30 01:24:56.807122 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1327/2686] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:56 2022] GET /compute/v2.1/servers/9c6be996-7886-41c6-9c0c-e0f899836cb0 => generated 1217 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:56.835989 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9fc68996-5240-446f-89cb-fcf9f8d448dc tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:56.836983 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9fc68996-5240-446f-89cb-fcf9f8d448dc tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: 403e0292-c082-4655-ad08-b5dc3a7f8305] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:56.854052 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9fc68996-5240-446f-89cb-fcf9f8d448dc tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:56.856292 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9fc68996-5240-446f-89cb-fcf9f8d448dc tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:56.857964 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9fc68996-5240-446f-89cb-fcf9f8d448dc tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:56.862220 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9fc68996-5240-446f-89cb-fcf9f8d448dc tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:56.862220 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9fc68996-5240-446f-89cb-fcf9f8d448dc tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:56.864441 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9fc68996-5240-446f-89cb-fcf9f8d448dc tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:57.178607 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c9d1c51d-f699-4888-b94b-236c4d57e4a8 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:57.187269 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c9d1c51d-f699-4888-b94b-236c4d57e4a8 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0" status: 200 len: 1495 microversion: 2.1 time: 0.729154 Oct 30 01:24:57.197756 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1360/2687] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:56 2022] GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0 => generated 1495 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:57.422668 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9fc68996-5240-446f-89cb-fcf9f8d448dc tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:57.431885 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9fc68996-5240-446f-89cb-fcf9f8d448dc tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305" status: 200 len: 1496 microversion: 2.1 time: 0.623272 Oct 30 01:24:57.436399 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1328/2688] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:56 2022] GET /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305 => generated 1496 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:57.828524 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-437472ee-8ec8-426b-a2de-82199b8b3653 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:57.829465 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-437472ee-8ec8-426b-a2de-82199b8b3653 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] [instance: 9c6be996-7886-41c6-9c0c-e0f899836cb0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:57.840440 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-437472ee-8ec8-426b-a2de-82199b8b3653 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:57.849637 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-437472ee-8ec8-426b-a2de-82199b8b3653 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:57.850526 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-437472ee-8ec8-426b-a2de-82199b8b3653 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:57.851451 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-437472ee-8ec8-426b-a2de-82199b8b3653 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:57.852064 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-437472ee-8ec8-426b-a2de-82199b8b3653 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:57.852655 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-437472ee-8ec8-426b-a2de-82199b8b3653 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:58.158646 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-437472ee-8ec8-426b-a2de-82199b8b3653 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e50d6775ec4d2e96ab6e839b4631f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310172f2dfaf4ddcb5eace8a13939cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:58.169635 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-437472ee-8ec8-426b-a2de-82199b8b3653 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6be996-7886-41c6-9c0c-e0f899836cb0" status: 200 len: 1213 microversion: 2.1 time: 0.344085 Oct 30 01:24:58.176832 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1361/2689] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:57 2022] GET /compute/v2.1/servers/9c6be996-7886-41c6-9c0c-e0f899836cb0 => generated 1213 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:58.212575 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-adb1f40c-d954-4c9a-bc3c-8a2c63b275f7 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:58.213817 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-adb1f40c-d954-4c9a-bc3c-8a2c63b275f7 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 32c70d3f-96cd-4b23-a743-05aed245baf0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:58.233119 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-adb1f40c-d954-4c9a-bc3c-8a2c63b275f7 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:58.234777 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-adb1f40c-d954-4c9a-bc3c-8a2c63b275f7 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:58.235225 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-adb1f40c-d954-4c9a-bc3c-8a2c63b275f7 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:58.235942 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-adb1f40c-d954-4c9a-bc3c-8a2c63b275f7 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:58.236398 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-adb1f40c-d954-4c9a-bc3c-8a2c63b275f7 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:58.236825 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-adb1f40c-d954-4c9a-bc3c-8a2c63b275f7 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:58.467595 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a30d34e2-ae9c-4ded-8326-17d761e90235 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:58.470555 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a30d34e2-ae9c-4ded-8326-17d761e90235 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: 403e0292-c082-4655-ad08-b5dc3a7f8305] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:58.482782 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a30d34e2-ae9c-4ded-8326-17d761e90235 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:58.485633 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a30d34e2-ae9c-4ded-8326-17d761e90235 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:58.486289 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a30d34e2-ae9c-4ded-8326-17d761e90235 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:58.487314 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a30d34e2-ae9c-4ded-8326-17d761e90235 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:58.487984 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a30d34e2-ae9c-4ded-8326-17d761e90235 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:58.488574 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a30d34e2-ae9c-4ded-8326-17d761e90235 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:59.359454 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-adb1f40c-d954-4c9a-bc3c-8a2c63b275f7 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:59.372173 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-adb1f40c-d954-4c9a-bc3c-8a2c63b275f7 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0" status: 200 len: 1495 microversion: 2.1 time: 1.163882 Oct 30 01:24:59.372697 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1329/2690] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:58 2022] GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0 => generated 1495 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:59.382489 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0c4b5770-01b8-4b49-95ee-9417d1063030 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:24:59.386046 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0c4b5770-01b8-4b49-95ee-9417d1063030 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] [instance: 9c6be996-7886-41c6-9c0c-e0f899836cb0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:24:59.398408 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c4b5770-01b8-4b49-95ee-9417d1063030 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:59.400437 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c4b5770-01b8-4b49-95ee-9417d1063030 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:59.401826 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c4b5770-01b8-4b49-95ee-9417d1063030 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:59.407836 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c4b5770-01b8-4b49-95ee-9417d1063030 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:24:59.408509 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c4b5770-01b8-4b49-95ee-9417d1063030 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:24:59.409109 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c4b5770-01b8-4b49-95ee-9417d1063030 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:24:59.713737 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0c4b5770-01b8-4b49-95ee-9417d1063030 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e50d6775ec4d2e96ab6e839b4631f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310172f2dfaf4ddcb5eace8a13939cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:59.718689 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a30d34e2-ae9c-4ded-8326-17d761e90235 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:24:59.731483 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:24:59.733912 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a30d34e2-ae9c-4ded-8326-17d761e90235 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305" status: 200 len: 1496 microversion: 2.1 time: 1.275144 Oct 30 01:24:59.744950 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0c4b5770-01b8-4b49-95ee-9417d1063030 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6be996-7886-41c6-9c0c-e0f899836cb0" status: 200 len: 1287 microversion: 2.1 time: 0.370306 Oct 30 01:24:59.751222 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1330/2691] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:59 2022] GET /compute/v2.1/servers/9c6be996-7886-41c6-9c0c-e0f899836cb0 => generated 1287 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:24:59.751381 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1362/2692] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:24:58 2022] GET /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305 => generated 1496 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:24:59.992826 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9b0a4b16-5aa5-4802-8b46-b238ef7ba49e tempest-ImagesMetadataTestJSON-1858829895 tempest-ImagesMetadataTestJSON-1858829895-project] Calling method '.version_select at 0x7f44d0358a60>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:00.059829 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9b0a4b16-5aa5-4802-8b46-b238ef7ba49e tempest-ImagesMetadataTestJSON-1858829895 tempest-ImagesMetadataTestJSON-1858829895-project] 10.222.0.13 "GET /compute/v2.1/images/a8b53fc6-a294-4a9f-ab09-3daa580be395" status: 200 len: 636 microversion: 2.1 time: 0.070925 Oct 30 01:25:00.060423 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1331/2693] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:24:59 2022] GET /compute/v2.1/images/a8b53fc6-a294-4a9f-ab09-3daa580be395 => generated 636 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:25:00.076002 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d983e875-d1f9-4b0c-af09-94c3a5adb13b tempest-ImagesMetadataTestJSON-1858829895 tempest-ImagesMetadataTestJSON-1858829895-project] Action: 'update_all', calling method: .version_select at 0x7f44d02bb280>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:25:00.175741 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-d983e875-d1f9-4b0c-af09-94c3a5adb13b tempest-ImagesMetadataTestJSON-1858829895 tempest-ImagesMetadataTestJSON-1858829895-project] Getting quotas for project 5fefbf45157c46fba999d938ad42e8d7. Resources: dict_keys(['metadata_items']) {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:25:00.185636 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-d983e875-d1f9-4b0c-af09-94c3a5adb13b tempest-ImagesMetadataTestJSON-1858829895 tempest-ImagesMetadataTestJSON-1858829895-project] Getting quotas for user 26bbc8ffa7c84ae9a9b82cd61e136702 and project 5fefbf45157c46fba999d938ad42e8d7. Resources: dict_keys(['metadata_items']) {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:25:00.300661 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-78b05c32-3d69-4ec4-903c-d6c22f30f37f req-83d911df-07ea-4df7-b074-3d7e8441f6e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32c70d3f-96cd-4b23-a743-05aed245baf0", "name": "network-vif-deleted", "tag": "42309075-0068-4d9c-83fb-f3e5e8e5a63d"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:25:00.326396 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-78b05c32-3d69-4ec4-903c-d6c22f30f37f req-83d911df-07ea-4df7-b074-3d7e8441f6e7 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:00.326887 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-78b05c32-3d69-4ec4-903c-d6c22f30f37f req-83d911df-07ea-4df7-b074-3d7e8441f6e7 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:00.327320 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-78b05c32-3d69-4ec4-903c-d6c22f30f37f req-83d911df-07ea-4df7-b074-3d7e8441f6e7 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:00.370383 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-78b05c32-3d69-4ec4-903c-d6c22f30f37f req-83d911df-07ea-4df7-b074-3d7e8441f6e7 service nova] Creating event network-vif-deleted:42309075-0068-4d9c-83fb-f3e5e8e5a63d for instance 32c70d3f-96cd-4b23-a743-05aed245baf0 on n-h1-master-1 Oct 30 01:25:00.392853 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-78b05c32-3d69-4ec4-903c-d6c22f30f37f req-83d911df-07ea-4df7-b074-3d7e8441f6e7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096540 Oct 30 01:25:00.398041 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1332/2694] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:25:00.414107 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f7ff4437-06fd-404d-8adb-3710283e3de2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:00.414107 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f7ff4437-06fd-404d-8adb-3710283e3de2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 32c70d3f-96cd-4b23-a743-05aed245baf0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:00.427620 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f7ff4437-06fd-404d-8adb-3710283e3de2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:00.428120 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f7ff4437-06fd-404d-8adb-3710283e3de2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:00.428561 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f7ff4437-06fd-404d-8adb-3710283e3de2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:00.429273 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f7ff4437-06fd-404d-8adb-3710283e3de2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:00.437913 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f7ff4437-06fd-404d-8adb-3710283e3de2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:00.438599 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f7ff4437-06fd-404d-8adb-3710283e3de2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:00.619384 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f7ff4437-06fd-404d-8adb-3710283e3de2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:00.641523 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f7ff4437-06fd-404d-8adb-3710283e3de2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0" status: 200 len: 1453 microversion: 2.1 time: 0.229684 Oct 30 01:25:00.643140 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1333/2695] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:00 2022] GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0 => generated 1453 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:00.772605 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9b9a0030-7f2a-48b1-969e-62926b1ac2f5 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:00.773232 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9b9a0030-7f2a-48b1-969e-62926b1ac2f5 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] [instance: 9c6be996-7886-41c6-9c0c-e0f899836cb0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:00.782340 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d983e875-d1f9-4b0c-af09-94c3a5adb13b tempest-ImagesMetadataTestJSON-1858829895 tempest-ImagesMetadataTestJSON-1858829895-project] 10.222.0.13 "PUT /compute/v2.1/images/a8b53fc6-a294-4a9f-ab09-3daa580be395/metadata" status: 200 len: 61 microversion: 2.1 time: 0.711053 Oct 30 01:25:00.783894 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1363/2696] 10.222.0.13 () {60 vars in 1280 bytes} [Sun Oct 30 01:25:00 2022] PUT /compute/v2.1/images/a8b53fc6-a294-4a9f-ab09-3daa580be395/metadata => generated 61 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 30 01:25:00.784649 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9b9a0030-7f2a-48b1-969e-62926b1ac2f5 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:00.789135 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9b9a0030-7f2a-48b1-969e-62926b1ac2f5 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:00.790358 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9b9a0030-7f2a-48b1-969e-62926b1ac2f5 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:00.791516 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e5db7390-8ea6-4bd6-89cb-884cf1b19c52 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:00.792001 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e5db7390-8ea6-4bd6-89cb-884cf1b19c52 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: 403e0292-c082-4655-ad08-b5dc3a7f8305] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:00.792477 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9b9a0030-7f2a-48b1-969e-62926b1ac2f5 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:00.794170 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9b9a0030-7f2a-48b1-969e-62926b1ac2f5 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:00.795137 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9b9a0030-7f2a-48b1-969e-62926b1ac2f5 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:00.803143 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e5db7390-8ea6-4bd6-89cb-884cf1b19c52 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:00.806167 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e5db7390-8ea6-4bd6-89cb-884cf1b19c52 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:00.809079 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e5db7390-8ea6-4bd6-89cb-884cf1b19c52 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:00.811141 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e5db7390-8ea6-4bd6-89cb-884cf1b19c52 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:00.811968 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e5db7390-8ea6-4bd6-89cb-884cf1b19c52 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:00.813450 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e5db7390-8ea6-4bd6-89cb-884cf1b19c52 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:01.023798 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9b9a0030-7f2a-48b1-969e-62926b1ac2f5 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e50d6775ec4d2e96ab6e839b4631f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310172f2dfaf4ddcb5eace8a13939cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:01.029941 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:25:01.048916 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9b9a0030-7f2a-48b1-969e-62926b1ac2f5 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6be996-7886-41c6-9c0c-e0f899836cb0" status: 200 len: 1275 microversion: 2.1 time: 0.279695 Oct 30 01:25:01.067464 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1334/2697] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:00 2022] GET /compute/v2.1/servers/9c6be996-7886-41c6-9c0c-e0f899836cb0 => generated 1275 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:25:01.079576 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d816d31e-77ee-4ddf-871c-54c5e10351f9 tempest-ImagesMetadataTestJSON-1858829895 tempest-ImagesMetadataTestJSON-1858829895-project] Calling method '.version_select at 0x7f44d038a8b0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:01.408293 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e5db7390-8ea6-4bd6-89cb-884cf1b19c52 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:01.416693 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e5db7390-8ea6-4bd6-89cb-884cf1b19c52 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305" status: 200 len: 1473 microversion: 2.1 time: 0.632607 Oct 30 01:25:01.417199 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1364/2698] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:00 2022] GET /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305 => generated 1473 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:01.441948 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a1cf98ca-1495-4b29-9d7d-cd07ce5c91a5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2102979753"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:25:01.456025 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a1cf98ca-1495-4b29-9d7d-cd07ce5c91a5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: 403e0292-c082-4655-ad08-b5dc3a7f8305] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:01.465741 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a1cf98ca-1495-4b29-9d7d-cd07ce5c91a5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:01.466421 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a1cf98ca-1495-4b29-9d7d-cd07ce5c91a5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:01.467034 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a1cf98ca-1495-4b29-9d7d-cd07ce5c91a5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:01.467906 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a1cf98ca-1495-4b29-9d7d-cd07ce5c91a5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:01.468523 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a1cf98ca-1495-4b29-9d7d-cd07ce5c91a5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:01.469104 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a1cf98ca-1495-4b29-9d7d-cd07ce5c91a5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:01.644895 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d816d31e-77ee-4ddf-871c-54c5e10351f9 tempest-ImagesMetadataTestJSON-1858829895 tempest-ImagesMetadataTestJSON-1858829895-project] 10.222.0.13 "DELETE /compute/v2.1/images/a8b53fc6-a294-4a9f-ab09-3daa580be395/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.575907 Oct 30 01:25:01.649289 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1335/2699] 10.222.0.13 () {58 vars in 1296 bytes} [Sun Oct 30 01:25:01 2022] DELETE /compute/v2.1/images/a8b53fc6-a294-4a9f-ab09-3daa580be395/metadata/os_version => generated 0 bytes in 578 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:25:01.656421 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-212f31e4-25ed-42bd-95ca-1126598442ce tempest-ImagesMetadataTestJSON-1858829895 tempest-ImagesMetadataTestJSON-1858829895-project] Calling method '.version_select at 0x7f44d0358430>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:01.747793 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-212f31e4-25ed-42bd-95ca-1126598442ce tempest-ImagesMetadataTestJSON-1858829895 tempest-ImagesMetadataTestJSON-1858829895-project] 10.222.0.13 "GET /compute/v2.1/images/a8b53fc6-a294-4a9f-ab09-3daa580be395/metadata" status: 200 len: 37 microversion: 2.1 time: 0.090616 Oct 30 01:25:01.747793 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1336/2700] 10.222.0.13 () {58 vars in 1260 bytes} [Sun Oct 30 01:25:01 2022] GET /compute/v2.1/images/a8b53fc6-a294-4a9f-ab09-3daa580be395/metadata => generated 37 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:25:01.753942 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9c0be729-043f-4cfd-b1f5-23dc7a1cbcb6 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:01.754670 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9c0be729-043f-4cfd-b1f5-23dc7a1cbcb6 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 32c70d3f-96cd-4b23-a743-05aed245baf0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:01.761266 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9c0be729-043f-4cfd-b1f5-23dc7a1cbcb6 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:01.762189 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9c0be729-043f-4cfd-b1f5-23dc7a1cbcb6 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:01.762812 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9c0be729-043f-4cfd-b1f5-23dc7a1cbcb6 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:01.763674 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9c0be729-043f-4cfd-b1f5-23dc7a1cbcb6 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:01.764270 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9c0be729-043f-4cfd-b1f5-23dc7a1cbcb6 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:01.764835 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9c0be729-043f-4cfd-b1f5-23dc7a1cbcb6 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:01.805531 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9c0be729-043f-4cfd-b1f5-23dc7a1cbcb6 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:01.806307 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9c0be729-043f-4cfd-b1f5-23dc7a1cbcb6 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:01.806892 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9c0be729-043f-4cfd-b1f5-23dc7a1cbcb6 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:01.807502 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-9c0be729-043f-4cfd-b1f5-23dc7a1cbcb6 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lazy-loading 'fault' on Instance uuid 32c70d3f-96cd-4b23-a743-05aed245baf0 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:25:01.889380 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9c0be729-043f-4cfd-b1f5-23dc7a1cbcb6 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:01.911959 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9c0be729-043f-4cfd-b1f5-23dc7a1cbcb6 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0" status: 200 len: 1304 microversion: 2.1 time: 0.168853 Oct 30 01:25:01.926906 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1337/2701] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:01 2022] GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0 => generated 1304 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:01.941105 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ac41e235-ac17-4d88-bb55-2d9ba7451b2c tempest-ImagesMetadataTestJSON-1858829895 tempest-ImagesMetadataTestJSON-1858829895-project] Action: 'update_all', calling method: .version_select at 0x7f44d03da5e0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:25:02.032231 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-ac41e235-ac17-4d88-bb55-2d9ba7451b2c tempest-ImagesMetadataTestJSON-1858829895 tempest-ImagesMetadataTestJSON-1858829895-project] Getting quotas for project 5fefbf45157c46fba999d938ad42e8d7. Resources: dict_keys(['metadata_items']) {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:25:02.053734 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-ac41e235-ac17-4d88-bb55-2d9ba7451b2c tempest-ImagesMetadataTestJSON-1858829895 tempest-ImagesMetadataTestJSON-1858829895-project] Getting quotas for user 26bbc8ffa7c84ae9a9b82cd61e136702 and project 5fefbf45157c46fba999d938ad42e8d7. Resources: dict_keys(['metadata_items']) {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:25:02.217754 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a1cf98ca-1495-4b29-9d7d-cd07ce5c91a5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "POST /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305/action" status: 202 len: 0 microversion: 2.1 time: 0.777202 Oct 30 01:25:02.220384 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1365/2702] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:25:01 2022] POST /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305/action => generated 0 bytes in 783 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 30 01:25:02.226818 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-13f9afc2-bce3-46e3-8c11-559a1367fe5d tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:02.227707 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-13f9afc2-bce3-46e3-8c11-559a1367fe5d tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] [instance: 9c6be996-7886-41c6-9c0c-e0f899836cb0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:02.236407 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-13f9afc2-bce3-46e3-8c11-559a1367fe5d tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:02.238243 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-13f9afc2-bce3-46e3-8c11-559a1367fe5d tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:02.238243 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-13f9afc2-bce3-46e3-8c11-559a1367fe5d tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:02.238771 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-13f9afc2-bce3-46e3-8c11-559a1367fe5d tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:02.239538 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-13f9afc2-bce3-46e3-8c11-559a1367fe5d tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:02.240350 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-13f9afc2-bce3-46e3-8c11-559a1367fe5d tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:02.417826 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-13f9afc2-bce3-46e3-8c11-559a1367fe5d tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e50d6775ec4d2e96ab6e839b4631f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310172f2dfaf4ddcb5eace8a13939cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:02.427363 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-13f9afc2-bce3-46e3-8c11-559a1367fe5d tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6be996-7886-41c6-9c0c-e0f899836cb0" status: 200 len: 1275 microversion: 2.1 time: 0.205479 Oct 30 01:25:02.432165 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1366/2703] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:02 2022] GET /compute/v2.1/servers/9c6be996-7886-41c6-9c0c-e0f899836cb0 => generated 1275 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:02.442411 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5ebce3da-92c9-4ef0-a242-441276e3fdb7 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44cc609a60>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:02.579030 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5ebce3da-92c9-4ef0-a242-441276e3fdb7 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/10d86021-09d0-4f87-a249-2b033b1d6ae5" status: 200 len: 1412 microversion: 2.1 time: 0.145375 Oct 30 01:25:02.582074 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1367/2704] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:25:02 2022] GET /compute/v2.1/images/10d86021-09d0-4f87-a249-2b033b1d6ae5 => generated 1412 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:02.785018 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ac41e235-ac17-4d88-bb55-2d9ba7451b2c tempest-ImagesMetadataTestJSON-1858829895 tempest-ImagesMetadataTestJSON-1858829895-project] 10.222.0.13 "PUT /compute/v2.1/images/a8b53fc6-a294-4a9f-ab09-3daa580be395/metadata" status: 200 len: 61 microversion: 2.1 time: 0.855937 Oct 30 01:25:02.798943 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1338/2705] 10.222.0.13 () {60 vars in 1280 bytes} [Sun Oct 30 01:25:01 2022] PUT /compute/v2.1/images/a8b53fc6-a294-4a9f-ab09-3daa580be395/metadata => generated 61 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:25:02.799086 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-924f4036-0192-498b-82d3-edb4ed205554 tempest-ImagesMetadataTestJSON-1858829895 tempest-ImagesMetadataTestJSON-1858829895-project] Calling method '.version_select at 0x7f44cc068040>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:02.848574 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-924f4036-0192-498b-82d3-edb4ed205554 tempest-ImagesMetadataTestJSON-1858829895 tempest-ImagesMetadataTestJSON-1858829895-project] 10.222.0.13 "GET /compute/v2.1/images/a8b53fc6-a294-4a9f-ab09-3daa580be395/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.056608 Oct 30 01:25:02.849257 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1368/2706] 10.222.0.13 () {58 vars in 1290 bytes} [Sun Oct 30 01:25:02 2022] GET /compute/v2.1/images/a8b53fc6-a294-4a9f-ab09-3daa580be395/metadata/os_distro => generated 33 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:25:02.860435 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ce2260e3-a923-425b-86bd-0c1319248c63 tempest-ImagesMetadataTestJSON-1858829895 tempest-ImagesMetadataTestJSON-1858829895-project] Action: 'update_all', calling method: .version_select at 0x7f44d045c550>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:25:02.943064 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2bac1ade-fbe4-425b-a577-6dd21d66a949 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:02.943930 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2bac1ade-fbe4-425b-a577-6dd21d66a949 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 32c70d3f-96cd-4b23-a743-05aed245baf0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:02.953708 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-ce2260e3-a923-425b-86bd-0c1319248c63 tempest-ImagesMetadataTestJSON-1858829895 tempest-ImagesMetadataTestJSON-1858829895-project] Getting quotas for project 5fefbf45157c46fba999d938ad42e8d7. Resources: dict_keys(['metadata_items']) {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:25:02.964771 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-ce2260e3-a923-425b-86bd-0c1319248c63 tempest-ImagesMetadataTestJSON-1858829895 tempest-ImagesMetadataTestJSON-1858829895-project] Getting quotas for user 26bbc8ffa7c84ae9a9b82cd61e136702 and project 5fefbf45157c46fba999d938ad42e8d7. Resources: dict_keys(['metadata_items']) {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:25:02.967530 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2bac1ade-fbe4-425b-a577-6dd21d66a949 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:02.968282 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2bac1ade-fbe4-425b-a577-6dd21d66a949 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:02.969200 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2bac1ade-fbe4-425b-a577-6dd21d66a949 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:02.970384 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2bac1ade-fbe4-425b-a577-6dd21d66a949 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:02.971400 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2bac1ade-fbe4-425b-a577-6dd21d66a949 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:02.972630 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2bac1ade-fbe4-425b-a577-6dd21d66a949 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:03.006208 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-2bac1ade-fbe4-425b-a577-6dd21d66a949 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] HTTP exception thrown: Instance 32c70d3f-96cd-4b23-a743-05aed245baf0 could not be found. Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2bac1ade-fbe4-425b-a577-6dd21d66a949 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Request method failure captured: Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0 HTTP/1.1 Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdEZHAwNEyYVN8mbZetD1IgknrDb-nJfmTHtgPgtOr9AeQL99EuTYclSviV8aikzXcemJ-XkTVClxHn6U4xG48gAdXZcIs0fYa7Kdvvi7PzFjDxYMfOtgAp7wAvvVW7kd-J_XMzQX3yJBWm7NW5-QhmguztBnHz9UniQWs2CmNftHaI Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 8c95e97cd7e4461682b9028abb568dce Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 8c95e97cd7e4461682b9028abb568dce Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-DeleteServersTestJSON-1379968241-project Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 33691c943ec040ddb04b6648b6e945ab Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-DeleteServersTestJSON-1379968241-project Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 32c70d3f-96cd-4b23-a743-05aed245baf0 could not be found. Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '32c70d3f-96cd-4b23-a743-05aed245baf0'} Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32c70d3f-96cd-4b23-a743-05aed245baf0 could not be found. Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32c70d3f-96cd-4b23-a743-05aed245baf0 could not be found. Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:03.009733 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:03.015386 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:03.015386 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:03.015386 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:03.015386 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:25:03.015386 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:25:03.015386 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32c70d3f-96cd-4b23-a743-05aed245baf0 could not be found. Oct 30 01:25:03.015386 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:03.019122 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2bac1ade-fbe4-425b-a577-6dd21d66a949 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Returning 404 to user: Instance 32c70d3f-96cd-4b23-a743-05aed245baf0 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:25:03.033439 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2bac1ade-fbe4-425b-a577-6dd21d66a949 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0" status: 404 len: 111 microversion: 2.1 time: 0.081137 Oct 30 01:25:03.034356 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1369/2707] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:02 2022] GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:25:03.229741 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-552ce58c-3cba-4ddc-a4bc-b27e9f3a3c74 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-643022231", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "19e0e4e2-b502-4a02-810a-996c246e8c64"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:25:03.320827 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ce2260e3-a923-425b-86bd-0c1319248c63 tempest-ImagesMetadataTestJSON-1858829895 tempest-ImagesMetadataTestJSON-1858829895-project] 10.222.0.13 "PUT /compute/v2.1/images/a8b53fc6-a294-4a9f-ab09-3daa580be395/metadata" status: 200 len: 61 microversion: 2.1 time: 0.464146 Oct 30 01:25:03.321801 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1339/2708] 10.222.0.13 () {60 vars in 1280 bytes} [Sun Oct 30 01:25:02 2022] PUT /compute/v2.1/images/a8b53fc6-a294-4a9f-ab09-3daa580be395/metadata => generated 61 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:25:03.332346 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4f384611-01e8-4f15-9a04-b32c14e7b09c tempest-ImagesMetadataTestJSON-1858829895 tempest-ImagesMetadataTestJSON-1858829895-project] Calling method '.version_select at 0x7f44d03d2e50>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:03.364915 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-552ce58c-3cba-4ddc-a4bc-b27e9f3a3c74 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] validate_networks() for [('19e0e4e2-b502-4a02-810a-996c246e8c64', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:25:03.408351 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4f384611-01e8-4f15-9a04-b32c14e7b09c tempest-ImagesMetadataTestJSON-1858829895 tempest-ImagesMetadataTestJSON-1858829895-project] 10.222.0.13 "GET /compute/v2.1/images/a8b53fc6-a294-4a9f-ab09-3daa580be395/metadata" status: 200 len: 61 microversion: 2.1 time: 0.080935 Oct 30 01:25:03.410017 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1340/2709] 10.222.0.13 () {58 vars in 1260 bytes} [Sun Oct 30 01:25:03 2022] GET /compute/v2.1/images/a8b53fc6-a294-4a9f-ab09-3daa580be395/metadata => generated 61 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 30 01:25:03.428667 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e62c1ac8-5343-4c38-84bd-f733cc9894c5 tempest-ImagesMetadataTestJSON-1858829895 tempest-ImagesMetadataTestJSON-1858829895-project] Action: 'update_all', calling method: .version_select at 0x7f44d03daaf0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:25:03.536569 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-e62c1ac8-5343-4c38-84bd-f733cc9894c5 tempest-ImagesMetadataTestJSON-1858829895 tempest-ImagesMetadataTestJSON-1858829895-project] Getting quotas for project 5fefbf45157c46fba999d938ad42e8d7. Resources: dict_keys(['metadata_items']) {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:25:03.557198 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-e62c1ac8-5343-4c38-84bd-f733cc9894c5 tempest-ImagesMetadataTestJSON-1858829895 tempest-ImagesMetadataTestJSON-1858829895-project] Getting quotas for user 26bbc8ffa7c84ae9a9b82cd61e136702 and project 5fefbf45157c46fba999d938ad42e8d7. Resources: dict_keys(['metadata_items']) {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:25:03.823173 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e62c1ac8-5343-4c38-84bd-f733cc9894c5 tempest-ImagesMetadataTestJSON-1858829895 tempest-ImagesMetadataTestJSON-1858829895-project] 10.222.0.13 "PUT /compute/v2.1/images/a8b53fc6-a294-4a9f-ab09-3daa580be395/metadata" status: 200 len: 61 microversion: 2.1 time: 0.407096 Oct 30 01:25:03.824042 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1341/2710] 10.222.0.13 () {60 vars in 1280 bytes} [Sun Oct 30 01:25:03 2022] PUT /compute/v2.1/images/a8b53fc6-a294-4a9f-ab09-3daa580be395/metadata => generated 61 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:25:03.829588 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d45f7dbe-b474-41f1-910c-777959c3cd21 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:03.832385 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d45f7dbe-b474-41f1-910c-777959c3cd21 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] [instance: 9c6be996-7886-41c6-9c0c-e0f899836cb0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:03.849740 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d45f7dbe-b474-41f1-910c-777959c3cd21 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:03.850243 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d45f7dbe-b474-41f1-910c-777959c3cd21 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:03.850684 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d45f7dbe-b474-41f1-910c-777959c3cd21 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:03.851400 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d45f7dbe-b474-41f1-910c-777959c3cd21 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:03.851852 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d45f7dbe-b474-41f1-910c-777959c3cd21 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:03.852271 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d45f7dbe-b474-41f1-910c-777959c3cd21 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:04.310334 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d45f7dbe-b474-41f1-910c-777959c3cd21 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e50d6775ec4d2e96ab6e839b4631f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310172f2dfaf4ddcb5eace8a13939cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:04.325772 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d45f7dbe-b474-41f1-910c-777959c3cd21 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6be996-7886-41c6-9c0c-e0f899836cb0" status: 200 len: 1317 microversion: 2.1 time: 0.500036 Oct 30 01:25:04.344670 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1342/2711] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:03 2022] GET /compute/v2.1/servers/9c6be996-7886-41c6-9c0c-e0f899836cb0 => generated 1317 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:04.356812 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a7f8bdce-8be7-494e-aed8-59a78bdf3d90 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44c79f0160>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:04.487684 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a7f8bdce-8be7-494e-aed8-59a78bdf3d90 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/10d86021-09d0-4f87-a249-2b033b1d6ae5" status: 200 len: 1412 microversion: 2.1 time: 0.141184 Oct 30 01:25:04.496996 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1343/2712] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:25:04 2022] GET /compute/v2.1/images/10d86021-09d0-4f87-a249-2b033b1d6ae5 => generated 1412 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:04.502540 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-735310b8-21d0-4188-aff4-4131af0c406d tempest-ImagesMetadataTestJSON-1858829895 tempest-ImagesMetadataTestJSON-1858829895-project] Action: 'update_all', calling method: .version_select at 0x7f44d04173a0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:25:04.590636 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-735310b8-21d0-4188-aff4-4131af0c406d tempest-ImagesMetadataTestJSON-1858829895 tempest-ImagesMetadataTestJSON-1858829895-project] Getting quotas for project 5fefbf45157c46fba999d938ad42e8d7. Resources: dict_keys(['metadata_items']) {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:25:04.610733 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-735310b8-21d0-4188-aff4-4131af0c406d tempest-ImagesMetadataTestJSON-1858829895 tempest-ImagesMetadataTestJSON-1858829895-project] Getting quotas for user 26bbc8ffa7c84ae9a9b82cd61e136702 and project 5fefbf45157c46fba999d938ad42e8d7. Resources: dict_keys(['metadata_items']) {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:25:05.252827 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:25:05.425736 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-735310b8-21d0-4188-aff4-4131af0c406d tempest-ImagesMetadataTestJSON-1858829895 tempest-ImagesMetadataTestJSON-1858829895-project] 10.222.0.13 "PUT /compute/v2.1/images/a8b53fc6-a294-4a9f-ab09-3daa580be395/metadata" status: 200 len: 64 microversion: 2.1 time: 0.927348 Oct 30 01:25:05.426374 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1344/2713] 10.222.0.13 () {60 vars in 1280 bytes} [Sun Oct 30 01:25:04 2022] PUT /compute/v2.1/images/a8b53fc6-a294-4a9f-ab09-3daa580be395/metadata => generated 64 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:25:05.431206 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-4c3945f4-7e54-405f-bb46-49ac5d2b8167 req-de8abffa-1ecb-497a-b38d-436046807d63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c6be996-7886-41c6-9c0c-e0f899836cb0", "tag": "aee42464-dca8-4339-bc2b-97369d928349"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:25:05.462880 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-4c3945f4-7e54-405f-bb46-49ac5d2b8167 req-de8abffa-1ecb-497a-b38d-436046807d63 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:05.463290 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-4c3945f4-7e54-405f-bb46-49ac5d2b8167 req-de8abffa-1ecb-497a-b38d-436046807d63 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:05.469626 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-4c3945f4-7e54-405f-bb46-49ac5d2b8167 req-de8abffa-1ecb-497a-b38d-436046807d63 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:05.491079 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-4c3945f4-7e54-405f-bb46-49ac5d2b8167 req-de8abffa-1ecb-497a-b38d-436046807d63 service nova] Creating event network-changed:aee42464-dca8-4339-bc2b-97369d928349 for instance 9c6be996-7886-41c6-9c0c-e0f899836cb0 on n-h2-master-1 Oct 30 01:25:05.506536 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-4c3945f4-7e54-405f-bb46-49ac5d2b8167 req-de8abffa-1ecb-497a-b38d-436046807d63 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078731 Oct 30 01:25:05.507373 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1345/2714] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:25:05.535772 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f5fc74bf-33e2-48f8-a750-92d3218c42fa tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:05.536395 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f5fc74bf-33e2-48f8-a750-92d3218c42fa tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] [instance: 9c6be996-7886-41c6-9c0c-e0f899836cb0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:05.542888 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f5fc74bf-33e2-48f8-a750-92d3218c42fa tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:05.543417 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f5fc74bf-33e2-48f8-a750-92d3218c42fa tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:05.543849 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f5fc74bf-33e2-48f8-a750-92d3218c42fa tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:05.544738 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f5fc74bf-33e2-48f8-a750-92d3218c42fa tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:05.551846 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f5fc74bf-33e2-48f8-a750-92d3218c42fa tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:05.552554 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f5fc74bf-33e2-48f8-a750-92d3218c42fa tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:05.764920 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-552ce58c-3cba-4ddc-a4bc-b27e9f3a3c74 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:25:05.765714 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-552ce58c-3cba-4ddc-a4bc-b27e9f3a3c74 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:25:05.766451 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-552ce58c-3cba-4ddc-a4bc-b27e9f3a3c74 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:25:05.767028 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-552ce58c-3cba-4ddc-a4bc-b27e9f3a3c74 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:25:05.767619 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-552ce58c-3cba-4ddc-a4bc-b27e9f3a3c74 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:25:05.782637 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-552ce58c-3cba-4ddc-a4bc-b27e9f3a3c74 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:05.783426 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-552ce58c-3cba-4ddc-a4bc-b27e9f3a3c74 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:05.786787 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-552ce58c-3cba-4ddc-a4bc-b27e9f3a3c74 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:05.786787 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-552ce58c-3cba-4ddc-a4bc-b27e9f3a3c74 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:05.787609 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-552ce58c-3cba-4ddc-a4bc-b27e9f3a3c74 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:05.792140 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-552ce58c-3cba-4ddc-a4bc-b27e9f3a3c74 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:05.842825 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-552ce58c-3cba-4ddc-a4bc-b27e9f3a3c74 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Getting quotas for project 8c95e97cd7e4461682b9028abb568dce. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:25:05.862074 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-552ce58c-3cba-4ddc-a4bc-b27e9f3a3c74 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Getting quotas for user 33691c943ec040ddb04b6648b6e945ab and project 8c95e97cd7e4461682b9028abb568dce. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:25:05.905696 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-552ce58c-3cba-4ddc-a4bc-b27e9f3a3c74 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:25:05.908668 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-552ce58c-3cba-4ddc-a4bc-b27e9f3a3c74 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7d5101ea-4f7c-45cb-957e-d4abd0b4977d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:25:06.127451 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-552ce58c-3cba-4ddc-a4bc-b27e9f3a3c74 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.901640 Oct 30 01:25:06.132334 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1370/2715] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:25:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2907 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 30 01:25:06.143012 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2e14a8d6-4ac7-4a38-a141-a40fcc3a3cda tempest-ImagesMetadataTestJSON-1858829895 tempest-ImagesMetadataTestJSON-1858829895-project] Calling method '.version_select at 0x7f44c7779550>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:06.196650 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f5fc74bf-33e2-48f8-a750-92d3218c42fa tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e50d6775ec4d2e96ab6e839b4631f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310172f2dfaf4ddcb5eace8a13939cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:06.206482 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f5fc74bf-33e2-48f8-a750-92d3218c42fa tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6be996-7886-41c6-9c0c-e0f899836cb0" status: 200 len: 1317 microversion: 2.1 time: 0.697773 Oct 30 01:25:06.207056 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1346/2716] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:05 2022] GET /compute/v2.1/servers/9c6be996-7886-41c6-9c0c-e0f899836cb0 => generated 1317 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:06.222475 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-35af3962-e815-43c3-86c5-8e47a91c962e tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44d0417820>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:06.222779 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2e14a8d6-4ac7-4a38-a141-a40fcc3a3cda tempest-ImagesMetadataTestJSON-1858829895 tempest-ImagesMetadataTestJSON-1858829895-project] 10.222.0.13 "GET /compute/v2.1/images/a8b53fc6-a294-4a9f-ab09-3daa580be395/metadata" status: 200 len: 64 microversion: 2.1 time: 0.088486 Oct 30 01:25:06.223359 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1371/2717] 10.222.0.13 () {58 vars in 1260 bytes} [Sun Oct 30 01:25:06 2022] GET /compute/v2.1/images/a8b53fc6-a294-4a9f-ab09-3daa580be395/metadata => generated 64 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:25:06.230452 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-03447211-ca15-4435-a88e-c8df39432f4e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:06.231118 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-03447211-ca15-4435-a88e-c8df39432f4e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7d5101ea-4f7c-45cb-957e-d4abd0b4977d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:06.365794 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-35af3962-e815-43c3-86c5-8e47a91c962e tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/10d86021-09d0-4f87-a249-2b033b1d6ae5" status: 200 len: 1412 microversion: 2.1 time: 0.152486 Oct 30 01:25:06.366419 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1347/2718] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:25:06 2022] GET /compute/v2.1/images/10d86021-09d0-4f87-a249-2b033b1d6ae5 => generated 1412 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:06.378954 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e1514c4a-1fe0-4958-9af8-56babe9a2c3e tempest-ImagesMetadataTestJSON-1858829895 tempest-ImagesMetadataTestJSON-1858829895-project] Action: 'update_all', calling method: .version_select at 0x7f44d03a4940>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:25:06.502095 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-e1514c4a-1fe0-4958-9af8-56babe9a2c3e tempest-ImagesMetadataTestJSON-1858829895 tempest-ImagesMetadataTestJSON-1858829895-project] Getting quotas for project 5fefbf45157c46fba999d938ad42e8d7. Resources: dict_keys(['metadata_items']) {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:25:06.517660 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-e1514c4a-1fe0-4958-9af8-56babe9a2c3e tempest-ImagesMetadataTestJSON-1858829895 tempest-ImagesMetadataTestJSON-1858829895-project] Getting quotas for user 26bbc8ffa7c84ae9a9b82cd61e136702 and project 5fefbf45157c46fba999d938ad42e8d7. Resources: dict_keys(['metadata_items']) {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:25:06.629156 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-03447211-ca15-4435-a88e-c8df39432f4e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:06.645551 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-03447211-ca15-4435-a88e-c8df39432f4e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/7d5101ea-4f7c-45cb-957e-d4abd0b4977d" status: 200 len: 1214 microversion: 2.1 time: 0.420908 Oct 30 01:25:06.649609 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1372/2719] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:06 2022] GET /compute/v2.1/servers/7d5101ea-4f7c-45cb-957e-d4abd0b4977d => generated 1214 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:06.668660 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4748488d-4ef2-4ac4-a0e3-c75fd8e495c7 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:06.673176 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4748488d-4ef2-4ac4-a0e3-c75fd8e495c7 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] [instance: dcb34439-de04-4a9c-b81b-7fb2360af99c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:06.693140 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4748488d-4ef2-4ac4-a0e3-c75fd8e495c7 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:06.694008 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4748488d-4ef2-4ac4-a0e3-c75fd8e495c7 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:06.694702 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4748488d-4ef2-4ac4-a0e3-c75fd8e495c7 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:06.697874 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4748488d-4ef2-4ac4-a0e3-c75fd8e495c7 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:06.697874 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4748488d-4ef2-4ac4-a0e3-c75fd8e495c7 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:06.697874 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4748488d-4ef2-4ac4-a0e3-c75fd8e495c7 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:06.826513 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4748488d-4ef2-4ac4-a0e3-c75fd8e495c7 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] 10.222.0.13 "GET /compute/v2.1/servers/dcb34439-de04-4a9c-b81b-7fb2360af99c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.175556 Oct 30 01:25:06.830353 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1373/2720] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 01:25:06 2022] GET /compute/v2.1/servers/dcb34439-de04-4a9c-b81b-7fb2360af99c/os-volume_attachments => generated 197 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:25:06.847440 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2d8fe189-752b-409e-9875-abc504adecbb tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:06.849735 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2d8fe189-752b-409e-9875-abc504adecbb tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] [instance: dcb34439-de04-4a9c-b81b-7fb2360af99c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:06.863121 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2d8fe189-752b-409e-9875-abc504adecbb tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:06.866077 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2d8fe189-752b-409e-9875-abc504adecbb tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:06.868289 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2d8fe189-752b-409e-9875-abc504adecbb tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:06.869289 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2d8fe189-752b-409e-9875-abc504adecbb tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:06.872659 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2d8fe189-752b-409e-9875-abc504adecbb tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:06.873373 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2d8fe189-752b-409e-9875-abc504adecbb tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:07.082431 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-2d8fe189-752b-409e-9875-abc504adecbb tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lazy-loading 'services' on Instance uuid dcb34439-de04-4a9c-b81b-7fb2360af99c {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:25:07.294245 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e1514c4a-1fe0-4958-9af8-56babe9a2c3e tempest-ImagesMetadataTestJSON-1858829895 tempest-ImagesMetadataTestJSON-1858829895-project] 10.222.0.13 "PUT /compute/v2.1/images/a8b53fc6-a294-4a9f-ab09-3daa580be395/metadata" status: 200 len: 61 microversion: 2.1 time: 0.925882 Oct 30 01:25:07.295259 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1348/2721] 10.222.0.13 () {60 vars in 1280 bytes} [Sun Oct 30 01:25:06 2022] PUT /compute/v2.1/images/a8b53fc6-a294-4a9f-ab09-3daa580be395/metadata => generated 61 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:25:07.301425 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8d94390c-6908-49c5-acd3-cfaaff8ebb02 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:07.310233 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8d94390c-6908-49c5-acd3-cfaaff8ebb02 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] [instance: 9c6be996-7886-41c6-9c0c-e0f899836cb0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:07.313748 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:25:07.338762 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8d94390c-6908-49c5-acd3-cfaaff8ebb02 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:07.339603 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8d94390c-6908-49c5-acd3-cfaaff8ebb02 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:07.341059 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8d94390c-6908-49c5-acd3-cfaaff8ebb02 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:07.343516 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8d94390c-6908-49c5-acd3-cfaaff8ebb02 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:07.344300 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8d94390c-6908-49c5-acd3-cfaaff8ebb02 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:07.345760 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8d94390c-6908-49c5-acd3-cfaaff8ebb02 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:07.458099 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2d8fe189-752b-409e-9875-abc504adecbb tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] 10.222.0.13 "DELETE /compute/v2.1/servers/dcb34439-de04-4a9c-b81b-7fb2360af99c/os-volume_attachments/b6fc99b3-d6ca-450b-a45c-2050646a338d" status: 202 len: 0 microversion: 2.1 time: 0.620132 Oct 30 01:25:07.462775 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1374/2722] 10.222.0.13 () {58 vars in 1416 bytes} [Sun Oct 30 01:25:06 2022] DELETE /compute/v2.1/servers/dcb34439-de04-4a9c-b81b-7fb2360af99c/os-volume_attachments/b6fc99b3-d6ca-450b-a45c-2050646a338d => generated 0 bytes in 626 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:25:07.482889 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e64d02ed-c689-40b3-962c-93baeb643b42 tempest-ImagesMetadataTestJSON-1858829895 tempest-ImagesMetadataTestJSON-1858829895-project] Action: 'update', calling method: .version_select at 0x7f44c7ea9430>, body: {"meta": {"os_version": "alt"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:25:07.591464 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-e64d02ed-c689-40b3-962c-93baeb643b42 tempest-ImagesMetadataTestJSON-1858829895 tempest-ImagesMetadataTestJSON-1858829895-project] Getting quotas for project 5fefbf45157c46fba999d938ad42e8d7. Resources: dict_keys(['metadata_items']) {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:25:07.603013 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-e64d02ed-c689-40b3-962c-93baeb643b42 tempest-ImagesMetadataTestJSON-1858829895 tempest-ImagesMetadataTestJSON-1858829895-project] Getting quotas for user 26bbc8ffa7c84ae9a9b82cd61e136702 and project 5fefbf45157c46fba999d938ad42e8d7. Resources: dict_keys(['metadata_items']) {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:25:07.607485 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:25:08.007104 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8d94390c-6908-49c5-acd3-cfaaff8ebb02 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e50d6775ec4d2e96ab6e839b4631f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310172f2dfaf4ddcb5eace8a13939cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:08.019317 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8d94390c-6908-49c5-acd3-cfaaff8ebb02 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6be996-7886-41c6-9c0c-e0f899836cb0" status: 200 len: 1317 microversion: 2.1 time: 0.719853 Oct 30 01:25:08.033469 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1349/2723] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:07 2022] GET /compute/v2.1/servers/9c6be996-7886-41c6-9c0c-e0f899836cb0 => generated 1317 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:08.033469 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-abc33c7e-3b92-43d2-a9be-0d670f82e9d7 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44d038a1f0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:08.478309 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e64d02ed-c689-40b3-962c-93baeb643b42 tempest-ImagesMetadataTestJSON-1858829895 tempest-ImagesMetadataTestJSON-1858829895-project] 10.222.0.13 "PUT /compute/v2.1/images/a8b53fc6-a294-4a9f-ab09-3daa580be395/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 1.013828 Oct 30 01:25:08.480232 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1375/2724] 10.222.0.13 () {60 vars in 1313 bytes} [Sun Oct 30 01:25:07 2022] PUT /compute/v2.1/images/a8b53fc6-a294-4a9f-ab09-3daa580be395/metadata/os_version => generated 31 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:25:08.488752 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a549cde1-435e-4046-8a8e-aff18c277268 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:08.497062 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a549cde1-435e-4046-8a8e-aff18c277268 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7d5101ea-4f7c-45cb-957e-d4abd0b4977d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:08.506093 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-abc33c7e-3b92-43d2-a9be-0d670f82e9d7 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/10d86021-09d0-4f87-a249-2b033b1d6ae5" status: 200 len: 1412 microversion: 2.1 time: 0.480915 Oct 30 01:25:08.506680 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1350/2725] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:25:08 2022] GET /compute/v2.1/images/10d86021-09d0-4f87-a249-2b033b1d6ae5 => generated 1412 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:08.528313 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a549cde1-435e-4046-8a8e-aff18c277268 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:08.528313 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a549cde1-435e-4046-8a8e-aff18c277268 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:08.528313 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a549cde1-435e-4046-8a8e-aff18c277268 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:08.528313 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a549cde1-435e-4046-8a8e-aff18c277268 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:08.528313 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a549cde1-435e-4046-8a8e-aff18c277268 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:08.528313 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a549cde1-435e-4046-8a8e-aff18c277268 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:08.554399 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-876d9db4-f1f0-4d52-9e44-2da623831a3e tempest-ImagesMetadataTestJSON-1858829895 tempest-ImagesMetadataTestJSON-1858829895-project] Calling method '.version_select at 0x7f44d0437a60>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:08.668728 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-876d9db4-f1f0-4d52-9e44-2da623831a3e tempest-ImagesMetadataTestJSON-1858829895 tempest-ImagesMetadataTestJSON-1858829895-project] 10.222.0.13 "GET /compute/v2.1/images/a8b53fc6-a294-4a9f-ab09-3daa580be395/metadata" status: 200 len: 58 microversion: 2.1 time: 0.160483 Oct 30 01:25:08.669306 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1351/2726] 10.222.0.13 () {58 vars in 1260 bytes} [Sun Oct 30 01:25:08 2022] GET /compute/v2.1/images/a8b53fc6-a294-4a9f-ab09-3daa580be395/metadata => generated 58 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:25:08.680071 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c07d04a3-8372-4ee1-bc32-a16cc6bc15f6 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1627759025", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "c34fe605-ad4d-4bbb-af8f-c578bdb541d8"}, {"uuid": "ff7001bb-242f-47c8-a3fc-a2d9169949bf"}, {"uuid": "c34fe605-ad4d-4bbb-af8f-c578bdb541d8"}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:25:08.756074 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a549cde1-435e-4046-8a8e-aff18c277268 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:08.780566 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a549cde1-435e-4046-8a8e-aff18c277268 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/7d5101ea-4f7c-45cb-957e-d4abd0b4977d" status: 200 len: 1210 microversion: 2.1 time: 0.298461 Oct 30 01:25:08.781441 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1376/2727] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:08 2022] GET /compute/v2.1/servers/7d5101ea-4f7c-45cb-957e-d4abd0b4977d => generated 1210 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:08.786297 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c6331e04-7fa2-41f9-9c61-5cc50dcfe3ea tempest-ImagesMetadataTestJSON-1858829895 tempest-ImagesMetadataTestJSON-1858829895-project] Action: 'update_all', calling method: .version_select at 0x7f44c76b9430>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:25:08.926068 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-c07d04a3-8372-4ee1-bc32-a16cc6bc15f6 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] validate_networks() for [('c34fe605-ad4d-4bbb-af8f-c578bdb541d8', None, None, None, None, None), ('ff7001bb-242f-47c8-a3fc-a2d9169949bf', None, None, None, None, None), ('c34fe605-ad4d-4bbb-af8f-c578bdb541d8', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:25:08.974168 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-c6331e04-7fa2-41f9-9c61-5cc50dcfe3ea tempest-ImagesMetadataTestJSON-1858829895 tempest-ImagesMetadataTestJSON-1858829895-project] Getting quotas for project 5fefbf45157c46fba999d938ad42e8d7. Resources: dict_keys(['metadata_items']) {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:25:09.003412 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-c6331e04-7fa2-41f9-9c61-5cc50dcfe3ea tempest-ImagesMetadataTestJSON-1858829895 tempest-ImagesMetadataTestJSON-1858829895-project] Getting quotas for user 26bbc8ffa7c84ae9a9b82cd61e136702 and project 5fefbf45157c46fba999d938ad42e8d7. Resources: dict_keys(['metadata_items']) {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:25:10.329036 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c6331e04-7fa2-41f9-9c61-5cc50dcfe3ea tempest-ImagesMetadataTestJSON-1858829895 tempest-ImagesMetadataTestJSON-1858829895-project] 10.222.0.13 "PUT /compute/v2.1/images/a8b53fc6-a294-4a9f-ab09-3daa580be395/metadata" status: 200 len: 61 microversion: 2.1 time: 1.546263 Oct 30 01:25:10.330418 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1377/2728] 10.222.0.13 () {60 vars in 1280 bytes} [Sun Oct 30 01:25:08 2022] PUT /compute/v2.1/images/a8b53fc6-a294-4a9f-ab09-3daa580be395/metadata => generated 61 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:25:10.345914 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-529cd3d9-073a-4941-9336-224540df10fe tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:10.346903 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-529cd3d9-073a-4941-9336-224540df10fe tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] [instance: 9c6be996-7886-41c6-9c0c-e0f899836cb0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:10.376403 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-529cd3d9-073a-4941-9336-224540df10fe tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:10.382981 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-529cd3d9-073a-4941-9336-224540df10fe tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:10.382981 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-529cd3d9-073a-4941-9336-224540df10fe tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:10.383588 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-529cd3d9-073a-4941-9336-224540df10fe tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:10.384389 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-529cd3d9-073a-4941-9336-224540df10fe tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:10.387272 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-529cd3d9-073a-4941-9336-224540df10fe tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:11.256771 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-529cd3d9-073a-4941-9336-224540df10fe tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e50d6775ec4d2e96ab6e839b4631f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310172f2dfaf4ddcb5eace8a13939cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:11.278682 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-529cd3d9-073a-4941-9336-224540df10fe tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6be996-7886-41c6-9c0c-e0f899836cb0" status: 200 len: 1317 microversion: 2.1 time: 0.945182 Oct 30 01:25:11.302025 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1378/2729] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:10 2022] GET /compute/v2.1/servers/9c6be996-7886-41c6-9c0c-e0f899836cb0 => generated 1317 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:11.315994 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-24b21541-dbea-4b57-97bc-73f16cc2a483 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44d02bb820>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:11.386802 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-24b21541-dbea-4b57-97bc-73f16cc2a483 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/10d86021-09d0-4f87-a249-2b033b1d6ae5" status: 200 len: 1412 microversion: 2.1 time: 0.080984 Oct 30 01:25:11.398052 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1379/2730] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:25:11 2022] GET /compute/v2.1/images/10d86021-09d0-4f87-a249-2b033b1d6ae5 => generated 1412 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:11.404299 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-54cd6d71-6bc0-4441-aa8b-c1b490a94eeb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:11.405914 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-54cd6d71-6bc0-4441-aa8b-c1b490a94eeb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7d5101ea-4f7c-45cb-957e-d4abd0b4977d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:11.415602 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-54cd6d71-6bc0-4441-aa8b-c1b490a94eeb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:11.416481 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-54cd6d71-6bc0-4441-aa8b-c1b490a94eeb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:11.419192 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-54cd6d71-6bc0-4441-aa8b-c1b490a94eeb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:11.420350 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-54cd6d71-6bc0-4441-aa8b-c1b490a94eeb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:11.421114 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-54cd6d71-6bc0-4441-aa8b-c1b490a94eeb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:11.421803 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-54cd6d71-6bc0-4441-aa8b-c1b490a94eeb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:11.857117 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-54cd6d71-6bc0-4441-aa8b-c1b490a94eeb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:11.874106 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-54cd6d71-6bc0-4441-aa8b-c1b490a94eeb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/7d5101ea-4f7c-45cb-957e-d4abd0b4977d" status: 200 len: 1272 microversion: 2.1 time: 0.474331 Oct 30 01:25:11.881541 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1380/2731] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:11 2022] GET /compute/v2.1/servers/7d5101ea-4f7c-45cb-957e-d4abd0b4977d => generated 1272 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:11.889366 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d2d2915c-01f4-4959-8696-b2c0d02955a5 tempest-ImagesMetadataTestJSON-1858829895 tempest-ImagesMetadataTestJSON-1858829895-project] Action: 'create', calling method: .version_select at 0x7f44cc03f280>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:25:11.978401 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-d2d2915c-01f4-4959-8696-b2c0d02955a5 tempest-ImagesMetadataTestJSON-1858829895 tempest-ImagesMetadataTestJSON-1858829895-project] Getting quotas for project 5fefbf45157c46fba999d938ad42e8d7. Resources: dict_keys(['metadata_items']) {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:25:11.986170 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-d2d2915c-01f4-4959-8696-b2c0d02955a5 tempest-ImagesMetadataTestJSON-1858829895 tempest-ImagesMetadataTestJSON-1858829895-project] Getting quotas for user 26bbc8ffa7c84ae9a9b82cd61e136702 and project 5fefbf45157c46fba999d938ad42e8d7. Resources: dict_keys(['metadata_items']) {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:25:12.956735 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d2d2915c-01f4-4959-8696-b2c0d02955a5 tempest-ImagesMetadataTestJSON-1858829895 tempest-ImagesMetadataTestJSON-1858829895-project] 10.222.0.13 "POST /compute/v2.1/images/a8b53fc6-a294-4a9f-ab09-3daa580be395/metadata" status: 200 len: 85 microversion: 2.1 time: 1.078903 Oct 30 01:25:12.958432 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1381/2732] 10.222.0.13 () {60 vars in 1281 bytes} [Sun Oct 30 01:25:11 2022] POST /compute/v2.1/images/a8b53fc6-a294-4a9f-ab09-3daa580be395/metadata => generated 85 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:25:13.185763 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f18fd958-ba03-49a9-9add-1774ab5096f7 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1375704527", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "1c6df84f-4a75-470d-bb65-6e4f05c617dc"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:25:13.287899 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-f18fd958-ba03-49a9-9add-1774ab5096f7 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] validate_networks() for [('1c6df84f-4a75-470d-bb65-6e4f05c617dc', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:25:14.220193 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-f18fd958-ba03-49a9-9add-1774ab5096f7 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:25:14.221883 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-f18fd958-ba03-49a9-9add-1774ab5096f7 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:25:14.222694 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-f18fd958-ba03-49a9-9add-1774ab5096f7 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:25:14.224062 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-f18fd958-ba03-49a9-9add-1774ab5096f7 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:25:14.224692 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-f18fd958-ba03-49a9-9add-1774ab5096f7 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:25:14.290146 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f18fd958-ba03-49a9-9add-1774ab5096f7 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:14.294404 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f18fd958-ba03-49a9-9add-1774ab5096f7 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:14.306517 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f18fd958-ba03-49a9-9add-1774ab5096f7 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:14.311375 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f18fd958-ba03-49a9-9add-1774ab5096f7 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:14.311893 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f18fd958-ba03-49a9-9add-1774ab5096f7 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:14.312344 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f18fd958-ba03-49a9-9add-1774ab5096f7 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:14.361751 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-f18fd958-ba03-49a9-9add-1774ab5096f7 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Getting quotas for project 127b4f4e1e4b43ed856faee3c5d9d88d. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:25:14.367944 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-f18fd958-ba03-49a9-9add-1774ab5096f7 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Getting quotas for user 0dc60a96037f438ebbaaa6d25661bfc5 and project 127b4f4e1e4b43ed856faee3c5d9d88d. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:25:14.384622 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f18fd958-ba03-49a9-9add-1774ab5096f7 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:25:14.388609 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f18fd958-ba03-49a9-9add-1774ab5096f7 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] [instance: 5b5d5fa5-1e07-4145-b6c8-30e31de10165] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:25:14.519812 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f18fd958-ba03-49a9-9add-1774ab5096f7 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.555786 Oct 30 01:25:14.520668 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1382/2733] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:25:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:25:14.531612 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c7db4486-9085-4c6b-abbb-907e40f1920b tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:14.539502 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c7db4486-9085-4c6b-abbb-907e40f1920b tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] [instance: 9c6be996-7886-41c6-9c0c-e0f899836cb0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:14.586270 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c7db4486-9085-4c6b-abbb-907e40f1920b tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:14.587841 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c7db4486-9085-4c6b-abbb-907e40f1920b tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:14.597106 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c7db4486-9085-4c6b-abbb-907e40f1920b tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:14.602908 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c7db4486-9085-4c6b-abbb-907e40f1920b tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:14.603946 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c7db4486-9085-4c6b-abbb-907e40f1920b tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:14.610765 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c7db4486-9085-4c6b-abbb-907e40f1920b tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:15.260254 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-c07d04a3-8372-4ee1-bc32-a16cc6bc15f6 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:25:15.260254 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-c07d04a3-8372-4ee1-bc32-a16cc6bc15f6 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:25:15.260254 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-c07d04a3-8372-4ee1-bc32-a16cc6bc15f6 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:25:15.260254 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-c07d04a3-8372-4ee1-bc32-a16cc6bc15f6 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:25:15.260254 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-c07d04a3-8372-4ee1-bc32-a16cc6bc15f6 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:25:15.388252 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c07d04a3-8372-4ee1-bc32-a16cc6bc15f6 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:15.388252 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c07d04a3-8372-4ee1-bc32-a16cc6bc15f6 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:15.388252 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c07d04a3-8372-4ee1-bc32-a16cc6bc15f6 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:15.388252 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c07d04a3-8372-4ee1-bc32-a16cc6bc15f6 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:15.388252 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c07d04a3-8372-4ee1-bc32-a16cc6bc15f6 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:15.388252 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c07d04a3-8372-4ee1-bc32-a16cc6bc15f6 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:15.389246 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c7db4486-9085-4c6b-abbb-907e40f1920b tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e50d6775ec4d2e96ab6e839b4631f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310172f2dfaf4ddcb5eace8a13939cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:15.389246 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c7db4486-9085-4c6b-abbb-907e40f1920b tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6be996-7886-41c6-9c0c-e0f899836cb0" status: 200 len: 1317 microversion: 2.1 time: 0.860895 Oct 30 01:25:15.389246 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1383/2734] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:14 2022] GET /compute/v2.1/servers/9c6be996-7886-41c6-9c0c-e0f899836cb0 => generated 1317 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:15.407603 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-c07d04a3-8372-4ee1-bc32-a16cc6bc15f6 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Getting quotas for project 2c59bd73c7874a00b52ec7c5c4142039. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:25:15.413256 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1be1cb70-4d55-44e8-a194-8561fd589bad tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44c7ea9c10>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:15.424058 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-c07d04a3-8372-4ee1-bc32-a16cc6bc15f6 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Getting quotas for user a07f2b8c31f54c62aaba73ca2bd2edb8 and project 2c59bd73c7874a00b52ec7c5c4142039. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:25:15.468988 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c07d04a3-8372-4ee1-bc32-a16cc6bc15f6 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:25:15.480070 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c07d04a3-8372-4ee1-bc32-a16cc6bc15f6 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: 64824cfc-200e-4ee1-8698-011b644ae315] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:25:15.497076 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1be1cb70-4d55-44e8-a194-8561fd589bad tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/10d86021-09d0-4f87-a249-2b033b1d6ae5" status: 200 len: 1412 microversion: 2.1 time: 0.111363 Oct 30 01:25:15.500027 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1384/2735] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:25:15 2022] GET /compute/v2.1/images/10d86021-09d0-4f87-a249-2b033b1d6ae5 => generated 1412 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:15.607516 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1c48f756-5d7b-46bf-81fd-2fe24ea6d0ba tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1981049198", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "d699f371-6efe-4460-ad64-161c33aa9aa3"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:25:15.730123 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c07d04a3-8372-4ee1-bc32-a16cc6bc15f6 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.059088 Oct 30 01:25:15.734058 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1352/2736] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:25:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 7064 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:25:15.747425 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f8a77146-db48-4fae-a5bb-7de38e389e10 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:15.749217 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f8a77146-db48-4fae-a5bb-7de38e389e10 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7d5101ea-4f7c-45cb-957e-d4abd0b4977d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:15.758703 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-1c48f756-5d7b-46bf-81fd-2fe24ea6d0ba tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] validate_networks() for [('d699f371-6efe-4460-ad64-161c33aa9aa3', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:25:15.768865 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f8a77146-db48-4fae-a5bb-7de38e389e10 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:15.773138 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f8a77146-db48-4fae-a5bb-7de38e389e10 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:15.782468 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f8a77146-db48-4fae-a5bb-7de38e389e10 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:15.782468 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f8a77146-db48-4fae-a5bb-7de38e389e10 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:15.782468 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f8a77146-db48-4fae-a5bb-7de38e389e10 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:15.782468 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f8a77146-db48-4fae-a5bb-7de38e389e10 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:16.525828 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f8a77146-db48-4fae-a5bb-7de38e389e10 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:16.546833 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f8a77146-db48-4fae-a5bb-7de38e389e10 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/7d5101ea-4f7c-45cb-957e-d4abd0b4977d" status: 200 len: 1314 microversion: 2.1 time: 0.811347 Oct 30 01:25:16.547843 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1353/2737] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:15 2022] GET /compute/v2.1/servers/7d5101ea-4f7c-45cb-957e-d4abd0b4977d => generated 1314 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:16.557288 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a8ecab89-18b6-489a-878e-0b6115b14b93 tempest-ImagesMetadataTestJSON-1858829895 tempest-ImagesMetadataTestJSON-1858829895-project] Calling method '.version_select at 0x7f44d03583a0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:16.635621 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a8ecab89-18b6-489a-878e-0b6115b14b93 tempest-ImagesMetadataTestJSON-1858829895 tempest-ImagesMetadataTestJSON-1858829895-project] 10.222.0.13 "GET /compute/v2.1/images/a8b53fc6-a294-4a9f-ab09-3daa580be395/metadata" status: 200 len: 85 microversion: 2.1 time: 0.086513 Oct 30 01:25:16.636215 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1354/2738] 10.222.0.13 () {58 vars in 1260 bytes} [Sun Oct 30 01:25:16 2022] GET /compute/v2.1/images/a8b53fc6-a294-4a9f-ab09-3daa580be395/metadata => generated 85 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:25:16.640894 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-6db5d0ec-0c92-430b-8f5c-642064d8c4e6 req-4a13cedd-3233-44e3-908e-46705ac90153 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "403e0292-c082-4655-ad08-b5dc3a7f8305", "name": "network-vif-plugged", "status": "completed", "tag": "ef3e2c7d-b1a5-43dc-a664-896af7f0b0ed"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:25:16.691560 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-6db5d0ec-0c92-430b-8f5c-642064d8c4e6 req-4a13cedd-3233-44e3-908e-46705ac90153 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:16.695503 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-6db5d0ec-0c92-430b-8f5c-642064d8c4e6 req-4a13cedd-3233-44e3-908e-46705ac90153 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:16.696093 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-6db5d0ec-0c92-430b-8f5c-642064d8c4e6 req-4a13cedd-3233-44e3-908e-46705ac90153 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:16.781241 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-6db5d0ec-0c92-430b-8f5c-642064d8c4e6 req-4a13cedd-3233-44e3-908e-46705ac90153 service nova] Creating event network-vif-plugged:ef3e2c7d-b1a5-43dc-a664-896af7f0b0ed for instance 403e0292-c082-4655-ad08-b5dc3a7f8305 on n-h2-master-1 Oct 30 01:25:16.795282 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-6db5d0ec-0c92-430b-8f5c-642064d8c4e6 req-4a13cedd-3233-44e3-908e-46705ac90153 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157593 Oct 30 01:25:16.796228 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1355/2739] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:25:16.812028 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4435d216-8c08-43fb-9a9e-34809c821a10 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:16.815636 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4435d216-8c08-43fb-9a9e-34809c821a10 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] [instance: 5b5d5fa5-1e07-4145-b6c8-30e31de10165] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:16.831321 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4435d216-8c08-43fb-9a9e-34809c821a10 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:16.834160 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4435d216-8c08-43fb-9a9e-34809c821a10 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:16.835091 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4435d216-8c08-43fb-9a9e-34809c821a10 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:16.837244 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4435d216-8c08-43fb-9a9e-34809c821a10 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:16.841360 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4435d216-8c08-43fb-9a9e-34809c821a10 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:16.842178 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4435d216-8c08-43fb-9a9e-34809c821a10 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:17.327333 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4435d216-8c08-43fb-9a9e-34809c821a10 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc60a96037f438ebbaaa6d25661bfc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127b4f4e1e4b43ed856faee3c5d9d88d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:17.340579 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4435d216-8c08-43fb-9a9e-34809c821a10 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] 10.222.0.13 "GET /compute/v2.1/servers/5b5d5fa5-1e07-4145-b6c8-30e31de10165" status: 200 len: 1229 microversion: 2.1 time: 0.542409 Oct 30 01:25:17.366632 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1356/2740] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:16 2022] GET /compute/v2.1/servers/5b5d5fa5-1e07-4145-b6c8-30e31de10165 => generated 1229 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:17.381609 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1efd95a6-a3f3-410c-aef4-c64f40e842bf tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:17.388936 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1efd95a6-a3f3-410c-aef4-c64f40e842bf tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: 64824cfc-200e-4ee1-8698-011b644ae315] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:17.693325 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1efd95a6-a3f3-410c-aef4-c64f40e842bf tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07f2b8c31f54c62aaba73ca2bd2edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c59bd73c7874a00b52ec7c5c4142039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:17.703117 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1efd95a6-a3f3-410c-aef4-c64f40e842bf tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] 10.222.0.13 "GET /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315" status: 200 len: 1213 microversion: 2.1 time: 0.341679 Oct 30 01:25:17.703777 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1357/2741] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:17 2022] GET /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315 => generated 1213 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:17.715185 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-831b9572-8a47-41d0-ad91-afdc412f8f7f tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:17.721395 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-831b9572-8a47-41d0-ad91-afdc412f8f7f tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] [instance: 9c6be996-7886-41c6-9c0c-e0f899836cb0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:17.754208 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-831b9572-8a47-41d0-ad91-afdc412f8f7f tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:17.757030 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-831b9572-8a47-41d0-ad91-afdc412f8f7f tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:17.757562 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-831b9572-8a47-41d0-ad91-afdc412f8f7f tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:17.765411 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-831b9572-8a47-41d0-ad91-afdc412f8f7f tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:17.765411 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-831b9572-8a47-41d0-ad91-afdc412f8f7f tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:17.765411 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-831b9572-8a47-41d0-ad91-afdc412f8f7f tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:18.470912 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-1c48f756-5d7b-46bf-81fd-2fe24ea6d0ba tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:25:18.477889 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-1c48f756-5d7b-46bf-81fd-2fe24ea6d0ba tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:25:18.478397 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-1c48f756-5d7b-46bf-81fd-2fe24ea6d0ba tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:25:18.478849 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-1c48f756-5d7b-46bf-81fd-2fe24ea6d0ba tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:25:18.479239 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-1c48f756-5d7b-46bf-81fd-2fe24ea6d0ba tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:25:18.501961 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1c48f756-5d7b-46bf-81fd-2fe24ea6d0ba tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:18.502459 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1c48f756-5d7b-46bf-81fd-2fe24ea6d0ba tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:18.502908 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1c48f756-5d7b-46bf-81fd-2fe24ea6d0ba tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:18.503637 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1c48f756-5d7b-46bf-81fd-2fe24ea6d0ba tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:18.504094 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1c48f756-5d7b-46bf-81fd-2fe24ea6d0ba tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:18.504523 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1c48f756-5d7b-46bf-81fd-2fe24ea6d0ba tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:18.582452 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-1c48f756-5d7b-46bf-81fd-2fe24ea6d0ba tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Getting quotas for project 13238008c06e49c3b088809143308a00. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:25:18.600924 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-1c48f756-5d7b-46bf-81fd-2fe24ea6d0ba tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Getting quotas for user 2ba44010e0ca4892b56886e2b1636f01 and project 13238008c06e49c3b088809143308a00. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:25:18.640910 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1c48f756-5d7b-46bf-81fd-2fe24ea6d0ba tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:25:18.653402 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1c48f756-5d7b-46bf-81fd-2fe24ea6d0ba tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] [instance: 5c4bb439-785f-4ac3-a7fc-b9325b52fa19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:25:18.731120 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-831b9572-8a47-41d0-ad91-afdc412f8f7f tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e50d6775ec4d2e96ab6e839b4631f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310172f2dfaf4ddcb5eace8a13939cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:18.741071 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-831b9572-8a47-41d0-ad91-afdc412f8f7f tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6be996-7886-41c6-9c0c-e0f899836cb0" status: 200 len: 1317 microversion: 2.1 time: 1.035963 Oct 30 01:25:18.741892 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1358/2742] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:17 2022] GET /compute/v2.1/servers/9c6be996-7886-41c6-9c0c-e0f899836cb0 => generated 1317 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:18.752839 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9371ffb2-6127-4a66-9835-781db4e01746 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44d0358ee0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:18.846174 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9371ffb2-6127-4a66-9835-781db4e01746 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/10d86021-09d0-4f87-a249-2b033b1d6ae5" status: 200 len: 1412 microversion: 2.1 time: 0.097523 Oct 30 01:25:18.850717 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1359/2743] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:25:18 2022] GET /compute/v2.1/images/10d86021-09d0-4f87-a249-2b033b1d6ae5 => generated 1412 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:18.856629 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1c48f756-5d7b-46bf-81fd-2fe24ea6d0ba tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 3.355186 Oct 30 01:25:18.860628 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-3dea45c3-ae17-47ef-aff0-62ff60d8b7c5 req-d14772f4-0af9-4302-a065-ffe7cb79f9f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d5101ea-4f7c-45cb-957e-d4abd0b4977d", "tag": "63fa751a-4d60-4d9d-acdf-37f981d1869e"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:25:18.864462 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1385/2744] 10.222.0.13 () {62 vars in 1188 bytes} [Sun Oct 30 01:25:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 3364 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 30 01:25:18.882471 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-333fa03d-3a72-4c08-8be5-8e88aedb6c00 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:18.895200 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-333fa03d-3a72-4c08-8be5-8e88aedb6c00 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7d5101ea-4f7c-45cb-957e-d4abd0b4977d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:18.926531 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-333fa03d-3a72-4c08-8be5-8e88aedb6c00 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:18.927442 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-3dea45c3-ae17-47ef-aff0-62ff60d8b7c5 req-d14772f4-0af9-4302-a065-ffe7cb79f9f2 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:18.929387 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-333fa03d-3a72-4c08-8be5-8e88aedb6c00 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:18.936646 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-3dea45c3-ae17-47ef-aff0-62ff60d8b7c5 req-d14772f4-0af9-4302-a065-ffe7cb79f9f2 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:18.938140 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-333fa03d-3a72-4c08-8be5-8e88aedb6c00 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:18.941651 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-333fa03d-3a72-4c08-8be5-8e88aedb6c00 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:18.942215 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-3dea45c3-ae17-47ef-aff0-62ff60d8b7c5 req-d14772f4-0af9-4302-a065-ffe7cb79f9f2 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:18.944334 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-333fa03d-3a72-4c08-8be5-8e88aedb6c00 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:18.946556 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-333fa03d-3a72-4c08-8be5-8e88aedb6c00 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:19.009362 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-3dea45c3-ae17-47ef-aff0-62ff60d8b7c5 req-d14772f4-0af9-4302-a065-ffe7cb79f9f2 service nova] Creating event network-changed:63fa751a-4d60-4d9d-acdf-37f981d1869e for instance 7d5101ea-4f7c-45cb-957e-d4abd0b4977d on n-h1-master-1 Oct 30 01:25:19.023932 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-3dea45c3-ae17-47ef-aff0-62ff60d8b7c5 req-d14772f4-0af9-4302-a065-ffe7cb79f9f2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169302 Oct 30 01:25:19.030515 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1360/2745] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:25:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:25:19.043849 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8a5effd9-8e16-41c8-8671-1a5525a69d44 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:19.046269 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8a5effd9-8e16-41c8-8671-1a5525a69d44 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] [instance: 5b5d5fa5-1e07-4145-b6c8-30e31de10165] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:19.068600 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8a5effd9-8e16-41c8-8671-1a5525a69d44 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:19.071689 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8a5effd9-8e16-41c8-8671-1a5525a69d44 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:19.072372 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8a5effd9-8e16-41c8-8671-1a5525a69d44 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:19.082045 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8a5effd9-8e16-41c8-8671-1a5525a69d44 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:19.084230 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8a5effd9-8e16-41c8-8671-1a5525a69d44 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:19.084943 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8a5effd9-8e16-41c8-8671-1a5525a69d44 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:19.703503 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8a5effd9-8e16-41c8-8671-1a5525a69d44 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc60a96037f438ebbaaa6d25661bfc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127b4f4e1e4b43ed856faee3c5d9d88d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:19.730387 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8a5effd9-8e16-41c8-8671-1a5525a69d44 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] 10.222.0.13 "GET /compute/v2.1/servers/5b5d5fa5-1e07-4145-b6c8-30e31de10165" status: 200 len: 1285 microversion: 2.1 time: 0.698386 Oct 30 01:25:19.732866 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1361/2746] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:19 2022] GET /compute/v2.1/servers/5b5d5fa5-1e07-4145-b6c8-30e31de10165 => generated 1285 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:19.748675 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cfe466b1-ba37-45ba-bb76-36d0c72ff3b0 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:19.749719 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-cfe466b1-ba37-45ba-bb76-36d0c72ff3b0 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: 64824cfc-200e-4ee1-8698-011b644ae315] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:19.770717 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cfe466b1-ba37-45ba-bb76-36d0c72ff3b0 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:19.775196 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cfe466b1-ba37-45ba-bb76-36d0c72ff3b0 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:19.775854 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cfe466b1-ba37-45ba-bb76-36d0c72ff3b0 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:19.776889 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cfe466b1-ba37-45ba-bb76-36d0c72ff3b0 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:19.779424 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cfe466b1-ba37-45ba-bb76-36d0c72ff3b0 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:19.781151 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cfe466b1-ba37-45ba-bb76-36d0c72ff3b0 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:19.828199 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-333fa03d-3a72-4c08-8be5-8e88aedb6c00 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:19.838506 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-333fa03d-3a72-4c08-8be5-8e88aedb6c00 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/7d5101ea-4f7c-45cb-957e-d4abd0b4977d" status: 200 len: 1314 microversion: 2.1 time: 0.972673 Oct 30 01:25:19.839106 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1386/2747] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:18 2022] GET /compute/v2.1/servers/7d5101ea-4f7c-45cb-957e-d4abd0b4977d => generated 1314 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:19.868789 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-936ab1cd-3a56-4a69-90d5-279c0af89a23 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:19.869445 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-936ab1cd-3a56-4a69-90d5-279c0af89a23 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] [instance: 5c4bb439-785f-4ac3-a7fc-b9325b52fa19] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:19.979322 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-cfe466b1-ba37-45ba-bb76-36d0c72ff3b0 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07f2b8c31f54c62aaba73ca2bd2edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c59bd73c7874a00b52ec7c5c4142039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:19.988985 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cfe466b1-ba37-45ba-bb76-36d0c72ff3b0 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] 10.222.0.13 "GET /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315" status: 200 len: 1265 microversion: 2.1 time: 0.254303 Oct 30 01:25:19.989615 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1362/2748] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:19 2022] GET /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315 => generated 1265 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:20.008617 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-cfbd593b-420f-4bd2-9434-64a8abc8c0b5 req-aa8080a8-6fce-461c-b1b1-c3a9d3d2205b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c6be996-7886-41c6-9c0c-e0f899836cb0", "name": "network-vif-plugged", "status": "completed", "tag": "aee42464-dca8-4339-bc2b-97369d928349"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:25:20.034955 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-cfbd593b-420f-4bd2-9434-64a8abc8c0b5 req-aa8080a8-6fce-461c-b1b1-c3a9d3d2205b service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:20.035447 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-cfbd593b-420f-4bd2-9434-64a8abc8c0b5 req-aa8080a8-6fce-461c-b1b1-c3a9d3d2205b service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:20.035883 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-cfbd593b-420f-4bd2-9434-64a8abc8c0b5 req-aa8080a8-6fce-461c-b1b1-c3a9d3d2205b service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:20.058211 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-cfbd593b-420f-4bd2-9434-64a8abc8c0b5 req-aa8080a8-6fce-461c-b1b1-c3a9d3d2205b service nova] Creating event network-vif-plugged:aee42464-dca8-4339-bc2b-97369d928349 for instance 9c6be996-7886-41c6-9c0c-e0f899836cb0 on n-h2-master-1 Oct 30 01:25:20.073643 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-cfbd593b-420f-4bd2-9434-64a8abc8c0b5 req-aa8080a8-6fce-461c-b1b1-c3a9d3d2205b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082734 Oct 30 01:25:20.079216 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1363/2749] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:25:20.102162 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-06c52bac-5523-470c-872a-7f6fee188777 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:20.115953 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-06c52bac-5523-470c-872a-7f6fee188777 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] [instance: dcb34439-de04-4a9c-b81b-7fb2360af99c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:20.132794 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-936ab1cd-3a56-4a69-90d5-279c0af89a23 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba44010e0ca4892b56886e2b1636f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13238008c06e49c3b088809143308a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:20.136741 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-06c52bac-5523-470c-872a-7f6fee188777 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:20.137532 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-06c52bac-5523-470c-872a-7f6fee188777 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:20.139130 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-06c52bac-5523-470c-872a-7f6fee188777 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:20.141170 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-06c52bac-5523-470c-872a-7f6fee188777 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:20.141308 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-936ab1cd-3a56-4a69-90d5-279c0af89a23 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ba44010e0ca4892b56886e2b1636f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13238008c06e49c3b088809143308a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:20.142006 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-06c52bac-5523-470c-872a-7f6fee188777 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:20.142683 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-06c52bac-5523-470c-872a-7f6fee188777 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:20.157102 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-936ab1cd-3a56-4a69-90d5-279c0af89a23 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ba44010e0ca4892b56886e2b1636f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13238008c06e49c3b088809143308a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:20.161154 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-936ab1cd-3a56-4a69-90d5-279c0af89a23 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] 10.222.0.13 "GET /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19" status: 200 len: 1262 microversion: 2.26 time: 0.321045 Oct 30 01:25:20.161788 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1387/2750] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:25:19 2022] GET /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19 => generated 1262 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:25:20.195907 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-be85b378-98a5-4ec7-afa3-48501628e3b6 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:20.198225 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-be85b378-98a5-4ec7-afa3-48501628e3b6 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] [instance: 9c6be996-7886-41c6-9c0c-e0f899836cb0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:20.220815 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-be85b378-98a5-4ec7-afa3-48501628e3b6 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:20.220815 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-be85b378-98a5-4ec7-afa3-48501628e3b6 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:20.220815 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-be85b378-98a5-4ec7-afa3-48501628e3b6 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:20.220815 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-be85b378-98a5-4ec7-afa3-48501628e3b6 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:20.220815 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-be85b378-98a5-4ec7-afa3-48501628e3b6 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:20.220815 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-be85b378-98a5-4ec7-afa3-48501628e3b6 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:20.237356 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-06c52bac-5523-470c-872a-7f6fee188777 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] 10.222.0.13 "GET /compute/v2.1/servers/dcb34439-de04-4a9c-b81b-7fb2360af99c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.149216 Oct 30 01:25:20.245142 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1364/2751] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 01:25:20 2022] GET /compute/v2.1/servers/dcb34439-de04-4a9c-b81b-7fb2360af99c/os-volume_attachments => generated 25 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:25:20.263536 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fa5e72a5-6f8d-489a-b513-2eadaabb4583 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44d0358d30>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:20.380790 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fa5e72a5-6f8d-489a-b513-2eadaabb4583 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/10d86021-09d0-4f87-a249-2b033b1d6ae5" status: 200 len: 1412 microversion: 2.1 time: 0.133007 Oct 30 01:25:20.381458 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1365/2752] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:25:20 2022] GET /compute/v2.1/images/10d86021-09d0-4f87-a249-2b033b1d6ae5 => generated 1412 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:20.407269 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7d786723-a15d-4225-a30c-bf00ef0ae84d tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:20.421954 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7d786723-a15d-4225-a30c-bf00ef0ae84d tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] [instance: dcb34439-de04-4a9c-b81b-7fb2360af99c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:20.448871 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7d786723-a15d-4225-a30c-bf00ef0ae84d tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:20.449417 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7d786723-a15d-4225-a30c-bf00ef0ae84d tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:20.454502 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7d786723-a15d-4225-a30c-bf00ef0ae84d tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:20.455313 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7d786723-a15d-4225-a30c-bf00ef0ae84d tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:20.455856 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7d786723-a15d-4225-a30c-bf00ef0ae84d tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:20.460835 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7d786723-a15d-4225-a30c-bf00ef0ae84d tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:20.595030 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7d786723-a15d-4225-a30c-bf00ef0ae84d tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] 10.222.0.13 "GET /compute/v2.1/servers/dcb34439-de04-4a9c-b81b-7fb2360af99c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.203109 Oct 30 01:25:20.595627 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1366/2753] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 01:25:20 2022] GET /compute/v2.1/servers/dcb34439-de04-4a9c-b81b-7fb2360af99c/os-volume_attachments => generated 25 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:25:20.731951 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-40ec23d2-6bb5-417c-99b2-52b73378605f tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:20.732485 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-40ec23d2-6bb5-417c-99b2-52b73378605f tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] [instance: dcb34439-de04-4a9c-b81b-7fb2360af99c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:20.758477 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-40ec23d2-6bb5-417c-99b2-52b73378605f tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:20.758992 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-40ec23d2-6bb5-417c-99b2-52b73378605f tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:20.759871 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-40ec23d2-6bb5-417c-99b2-52b73378605f tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:20.760625 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-40ec23d2-6bb5-417c-99b2-52b73378605f tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:20.761097 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-40ec23d2-6bb5-417c-99b2-52b73378605f tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:20.761579 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-40ec23d2-6bb5-417c-99b2-52b73378605f tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:20.805914 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-40ec23d2-6bb5-417c-99b2-52b73378605f tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] [instance: dcb34439-de04-4a9c-b81b-7fb2360af99c] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:25:21.122422 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-be85b378-98a5-4ec7-afa3-48501628e3b6 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e50d6775ec4d2e96ab6e839b4631f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310172f2dfaf4ddcb5eace8a13939cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:21.129456 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-be85b378-98a5-4ec7-afa3-48501628e3b6 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6be996-7886-41c6-9c0c-e0f899836cb0" status: 200 len: 1317 microversion: 2.1 time: 0.962768 Oct 30 01:25:21.137007 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1388/2754] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:20 2022] GET /compute/v2.1/servers/9c6be996-7886-41c6-9c0c-e0f899836cb0 => generated 1317 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:21.166690 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ed4a5ddf-5b19-4216-8cf1-d3ec8adbf04b tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:21.167526 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ed4a5ddf-5b19-4216-8cf1-d3ec8adbf04b tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] [instance: 5b5d5fa5-1e07-4145-b6c8-30e31de10165] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:21.194183 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed4a5ddf-5b19-4216-8cf1-d3ec8adbf04b tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:21.194722 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed4a5ddf-5b19-4216-8cf1-d3ec8adbf04b tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:21.195790 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed4a5ddf-5b19-4216-8cf1-d3ec8adbf04b tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:21.196715 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed4a5ddf-5b19-4216-8cf1-d3ec8adbf04b tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:21.199994 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed4a5ddf-5b19-4216-8cf1-d3ec8adbf04b tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:21.201668 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed4a5ddf-5b19-4216-8cf1-d3ec8adbf04b tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:21.218447 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-40ec23d2-6bb5-417c-99b2-52b73378605f tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] 10.222.0.13 "DELETE /compute/v2.1/servers/dcb34439-de04-4a9c-b81b-7fb2360af99c" status: 204 len: 0 microversion: 2.1 time: 0.491534 Oct 30 01:25:21.220233 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1367/2755] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:25:20 2022] DELETE /compute/v2.1/servers/dcb34439-de04-4a9c-b81b-7fb2360af99c => generated 0 bytes in 494 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 30 01:25:21.233555 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-412b5c8a-e110-45d5-a80c-64215d9f88be tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:21.237019 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-412b5c8a-e110-45d5-a80c-64215d9f88be tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7d5101ea-4f7c-45cb-957e-d4abd0b4977d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:21.252696 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-412b5c8a-e110-45d5-a80c-64215d9f88be tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:21.253947 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-412b5c8a-e110-45d5-a80c-64215d9f88be tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:21.256167 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-412b5c8a-e110-45d5-a80c-64215d9f88be tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:21.258924 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-412b5c8a-e110-45d5-a80c-64215d9f88be tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:21.261058 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-412b5c8a-e110-45d5-a80c-64215d9f88be tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:21.264625 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-412b5c8a-e110-45d5-a80c-64215d9f88be tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:22.138381 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ed4a5ddf-5b19-4216-8cf1-d3ec8adbf04b tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc60a96037f438ebbaaa6d25661bfc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127b4f4e1e4b43ed856faee3c5d9d88d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:22.166298 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ed4a5ddf-5b19-4216-8cf1-d3ec8adbf04b tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] 10.222.0.13 "GET /compute/v2.1/servers/5b5d5fa5-1e07-4145-b6c8-30e31de10165" status: 200 len: 1283 microversion: 2.1 time: 1.026507 Oct 30 01:25:22.166917 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1389/2756] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:21 2022] GET /compute/v2.1/servers/5b5d5fa5-1e07-4145-b6c8-30e31de10165 => generated 1283 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:22.185933 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6026c0a9-4a06-4e11-9c2e-b235467a44ee tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:22.185933 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6026c0a9-4a06-4e11-9c2e-b235467a44ee tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: 64824cfc-200e-4ee1-8698-011b644ae315] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:22.192844 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6026c0a9-4a06-4e11-9c2e-b235467a44ee tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:22.196199 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6026c0a9-4a06-4e11-9c2e-b235467a44ee tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:22.196662 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6026c0a9-4a06-4e11-9c2e-b235467a44ee tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:22.197447 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6026c0a9-4a06-4e11-9c2e-b235467a44ee tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:22.197920 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6026c0a9-4a06-4e11-9c2e-b235467a44ee tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:22.198355 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6026c0a9-4a06-4e11-9c2e-b235467a44ee tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:22.409148 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6026c0a9-4a06-4e11-9c2e-b235467a44ee tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07f2b8c31f54c62aaba73ca2bd2edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c59bd73c7874a00b52ec7c5c4142039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:22.420271 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6026c0a9-4a06-4e11-9c2e-b235467a44ee tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] 10.222.0.13 "GET /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315" status: 200 len: 1271 microversion: 2.1 time: 0.252305 Oct 30 01:25:22.425054 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1390/2757] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:22 2022] GET /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315 => generated 1271 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:22.435375 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a320210d-6d5e-423f-95d8-a21d74f02e40 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:22.436623 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a320210d-6d5e-423f-95d8-a21d74f02e40 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] [instance: 5c4bb439-785f-4ac3-a7fc-b9325b52fa19] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:22.465883 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a320210d-6d5e-423f-95d8-a21d74f02e40 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:22.466692 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a320210d-6d5e-423f-95d8-a21d74f02e40 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:22.467612 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a320210d-6d5e-423f-95d8-a21d74f02e40 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:22.469881 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a320210d-6d5e-423f-95d8-a21d74f02e40 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:22.470985 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a320210d-6d5e-423f-95d8-a21d74f02e40 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:22.472066 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a320210d-6d5e-423f-95d8-a21d74f02e40 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:22.511716 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:25:22.638268 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a320210d-6d5e-423f-95d8-a21d74f02e40 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba44010e0ca4892b56886e2b1636f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13238008c06e49c3b088809143308a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:22.657598 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a320210d-6d5e-423f-95d8-a21d74f02e40 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ba44010e0ca4892b56886e2b1636f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13238008c06e49c3b088809143308a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:22.660262 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a320210d-6d5e-423f-95d8-a21d74f02e40 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ba44010e0ca4892b56886e2b1636f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13238008c06e49c3b088809143308a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:22.662580 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a320210d-6d5e-423f-95d8-a21d74f02e40 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] 10.222.0.13 "GET /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19" status: 200 len: 1314 microversion: 2.26 time: 0.236330 Oct 30 01:25:22.664698 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1391/2758] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:25:22 2022] GET /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:25:22.675877 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-409ce13b-e555-4965-9f72-96c4f025420b tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:22.677650 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-409ce13b-e555-4965-9f72-96c4f025420b tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] [instance: dcb34439-de04-4a9c-b81b-7fb2360af99c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:22.707344 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-409ce13b-e555-4965-9f72-96c4f025420b tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:22.708438 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-409ce13b-e555-4965-9f72-96c4f025420b tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:22.709048 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-409ce13b-e555-4965-9f72-96c4f025420b tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:22.710475 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-409ce13b-e555-4965-9f72-96c4f025420b tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:22.711317 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-409ce13b-e555-4965-9f72-96c4f025420b tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:22.712035 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-409ce13b-e555-4965-9f72-96c4f025420b tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:22.870560 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-412b5c8a-e110-45d5-a80c-64215d9f88be tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:22.886263 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:25:22.908035 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-412b5c8a-e110-45d5-a80c-64215d9f88be tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/7d5101ea-4f7c-45cb-957e-d4abd0b4977d" status: 200 len: 1314 microversion: 2.1 time: 1.685281 Oct 30 01:25:22.930063 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1368/2759] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:21 2022] GET /compute/v2.1/servers/7d5101ea-4f7c-45cb-957e-d4abd0b4977d => generated 1314 bytes in 1702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:22.935332 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-95f6522d-064b-4038-934d-35e6454b6a9b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44d03b4af0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:23.038345 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-95f6522d-064b-4038-934d-35e6454b6a9b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/10d86021-09d0-4f87-a249-2b033b1d6ae5" status: 200 len: 1412 microversion: 2.1 time: 0.111535 Oct 30 01:25:23.051204 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1369/2760] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:25:22 2022] GET /compute/v2.1/images/10d86021-09d0-4f87-a249-2b033b1d6ae5 => generated 1412 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:23.063513 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1218df4b-81db-4620-b3eb-ef1953c52b91 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:23.067042 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1218df4b-81db-4620-b3eb-ef1953c52b91 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] [instance: 9c6be996-7886-41c6-9c0c-e0f899836cb0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:23.088233 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1218df4b-81db-4620-b3eb-ef1953c52b91 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:23.091476 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1218df4b-81db-4620-b3eb-ef1953c52b91 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:23.092361 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1218df4b-81db-4620-b3eb-ef1953c52b91 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:23.095567 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1218df4b-81db-4620-b3eb-ef1953c52b91 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:23.095567 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1218df4b-81db-4620-b3eb-ef1953c52b91 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:23.098460 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1218df4b-81db-4620-b3eb-ef1953c52b91 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:23.616951 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-409ce13b-e555-4965-9f72-96c4f025420b tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94448bbc2f4a4efaa86792f1511ff15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342baf2538340e292e44dfc622b86fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:23.630151 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-409ce13b-e555-4965-9f72-96c4f025420b tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] 10.222.0.13 "GET /compute/v2.1/servers/dcb34439-de04-4a9c-b81b-7fb2360af99c" status: 200 len: 1681 microversion: 2.1 time: 0.963040 Oct 30 01:25:23.646056 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1392/2761] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:22 2022] GET /compute/v2.1/servers/dcb34439-de04-4a9c-b81b-7fb2360af99c => generated 1681 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:23.854500 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-38234da8-e9d8-4e53-a707-ebb0b6fae53b tempest-ImagesMetadataNegativeTestJSON-351812531 tempest-ImagesMetadataNegativeTestJSON-351812531-project] Calling method '.version_select at 0x7f44d02bbdc0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:23.888637 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-38234da8-e9d8-4e53-a707-ebb0b6fae53b tempest-ImagesMetadataNegativeTestJSON-351812531 tempest-ImagesMetadataNegativeTestJSON-351812531-project] HTTP exception thrown: Image not found. Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-38234da8-e9d8-4e53-a707-ebb0b6fae53b tempest-ImagesMetadataNegativeTestJSON-351812531 tempest-ImagesMetadataNegativeTestJSON-351812531-project] Request method failure captured: Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/images/691ed446-c8be-4ebb-ab7d-7ff2b266aa60/metadata/os_distro HTTP/1.1 Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdKCQmH0tUbcuXOBZRAxCQAc8A3_Y2369IWCxwOa8qgHMIBK3DtWtzoPqciLA-v4koT9nDaPco4gdl5ptHp-rhCH8akQb8fqz7L_EASh4dwwK9fLT2_9kofikjX8BQWJQz3ToB0YTRQPK6jlEsZNsZrsZDRn7c3-eXm0nRcAoMskdHE Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 4ac8019c0ff045f1a0a54f2a52479a70 Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-351812531 Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4ac8019c0ff045f1a0a54f2a52479a70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4ac8019c0ff045f1a0a54f2a52479a70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4ac8019c0ff045f1a0a54f2a52479a70"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4ac8019c0ff045f1a0a54f2a52479a70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-351812531 Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 4ac8019c0ff045f1a0a54f2a52479a70 Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-351812531 Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ImagesMetadataNegativeTestJSON-351812531-project Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: f2720b90fc5d42bfbbb9da2f7bc83952 Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-351812531-project Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: method: Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: exception: Image not found. Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: action_args: {'image_id': '691ed446-c8be-4ebb-ab7d-7ff2b266aa60', 'id': 'os_distro'} Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 691ed446-c8be-4ebb-ab7d-7ff2b266aa60 Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 30 01:25:23.899446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 30 01:25:23.904554 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 30 01:25:23.904554 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 30 01:25:23.904554 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 30 01:25:23.904554 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 30 01:25:23.904554 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 30 01:25:23.904554 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 30 01:25:23.904554 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 30 01:25:23.904554 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 30 01:25:23.904554 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 30 01:25:23.904554 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 30 01:25:23.904554 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 30 01:25:23.904554 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 30 01:25:23.904554 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 30 01:25:23.904554 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 30 01:25:23.904554 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 30 01:25:23.904554 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 30 01:25:23.904554 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 30 01:25:23.904554 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 30 01:25:23.904554 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 691ed446-c8be-4ebb-ab7d-7ff2b266aa60 could not be found. Oct 30 01:25:23.904554 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:23.904554 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:23.904554 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:23.904554 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:23.904554 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:23.904554 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:23.904554 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:25:23.904554 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:25:23.904554 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:25:23.904554 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:25:23.904554 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:25:23.904554 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:25:23.904554 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 30 01:25:23.904554 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 30 01:25:23.904554 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 30 01:25:23.904554 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 30 01:25:23.904554 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 30 01:25:23.904554 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:23.904554 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:23.904554 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:23.904554 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:23.904554 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:23.904554 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:23.904554 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:25:23.904554 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:25:23.904554 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 30 01:25:23.904554 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:23.915261 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-38234da8-e9d8-4e53-a707-ebb0b6fae53b tempest-ImagesMetadataNegativeTestJSON-351812531 tempest-ImagesMetadataNegativeTestJSON-351812531-project] Returning 404 to user: Image not found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:25:23.915261 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-38234da8-e9d8-4e53-a707-ebb0b6fae53b tempest-ImagesMetadataNegativeTestJSON-351812531 tempest-ImagesMetadataNegativeTestJSON-351812531-project] 10.222.0.13 "DELETE /compute/v2.1/images/691ed446-c8be-4ebb-ab7d-7ff2b266aa60/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.262934 Oct 30 01:25:23.915261 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1393/2762] 10.222.0.13 () {58 vars in 1293 bytes} [Sun Oct 30 01:25:23 2022] DELETE /compute/v2.1/images/691ed446-c8be-4ebb-ab7d-7ff2b266aa60/metadata/os_distro => generated 62 bytes in 264 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:25:23.925135 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ddabeaa3-dda3-413a-84e1-6576fa7018de tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:23.931050 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ddabeaa3-dda3-413a-84e1-6576fa7018de tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] [instance: 5b5d5fa5-1e07-4145-b6c8-30e31de10165] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:23.944999 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ddabeaa3-dda3-413a-84e1-6576fa7018de tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:23.950792 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ddabeaa3-dda3-413a-84e1-6576fa7018de tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:23.953117 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ddabeaa3-dda3-413a-84e1-6576fa7018de tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:23.957442 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ddabeaa3-dda3-413a-84e1-6576fa7018de tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:23.960821 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ddabeaa3-dda3-413a-84e1-6576fa7018de tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:23.963964 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ddabeaa3-dda3-413a-84e1-6576fa7018de tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:24.548899 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ddabeaa3-dda3-413a-84e1-6576fa7018de tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc60a96037f438ebbaaa6d25661bfc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127b4f4e1e4b43ed856faee3c5d9d88d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:24.563191 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ddabeaa3-dda3-413a-84e1-6576fa7018de tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] 10.222.0.13 "GET /compute/v2.1/servers/5b5d5fa5-1e07-4145-b6c8-30e31de10165" status: 200 len: 1325 microversion: 2.1 time: 0.639012 Oct 30 01:25:24.563852 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1394/2763] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:23 2022] GET /compute/v2.1/servers/5b5d5fa5-1e07-4145-b6c8-30e31de10165 => generated 1325 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:24.570985 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1218df4b-81db-4620-b3eb-ef1953c52b91 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e50d6775ec4d2e96ab6e839b4631f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310172f2dfaf4ddcb5eace8a13939cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:24.580794 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1218df4b-81db-4620-b3eb-ef1953c52b91 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6be996-7886-41c6-9c0c-e0f899836cb0" status: 200 len: 1467 microversion: 2.1 time: 1.528415 Oct 30 01:25:24.600977 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d33dcc70-e960-427f-b8ee-cd29a054469a tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:24.604820 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1370/2764] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:23 2022] GET /compute/v2.1/servers/9c6be996-7886-41c6-9c0c-e0f899836cb0 => generated 1467 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:24.613498 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3f50edf4-cbed-4f6b-b4d5-29f65b6d397f tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:24.615546 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3f50edf4-cbed-4f6b-b4d5-29f65b6d397f tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] [instance: 5c4bb439-785f-4ac3-a7fc-b9325b52fa19] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:24.618535 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d33dcc70-e960-427f-b8ee-cd29a054469a tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: 64824cfc-200e-4ee1-8698-011b644ae315] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:24.643907 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d33dcc70-e960-427f-b8ee-cd29a054469a tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:24.643907 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d33dcc70-e960-427f-b8ee-cd29a054469a tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:24.643907 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d33dcc70-e960-427f-b8ee-cd29a054469a tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:24.643907 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d33dcc70-e960-427f-b8ee-cd29a054469a tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:24.644295 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f50edf4-cbed-4f6b-b4d5-29f65b6d397f tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:24.644412 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d33dcc70-e960-427f-b8ee-cd29a054469a tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:24.644492 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f50edf4-cbed-4f6b-b4d5-29f65b6d397f tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:24.645959 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d33dcc70-e960-427f-b8ee-cd29a054469a tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:24.707136 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f50edf4-cbed-4f6b-b4d5-29f65b6d397f tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:24.726580 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f50edf4-cbed-4f6b-b4d5-29f65b6d397f tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:24.729375 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f50edf4-cbed-4f6b-b4d5-29f65b6d397f tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:24.730437 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f50edf4-cbed-4f6b-b4d5-29f65b6d397f tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:25.083943 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3f50edf4-cbed-4f6b-b4d5-29f65b6d397f tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba44010e0ca4892b56886e2b1636f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13238008c06e49c3b088809143308a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:25.094579 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3f50edf4-cbed-4f6b-b4d5-29f65b6d397f tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ba44010e0ca4892b56886e2b1636f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13238008c06e49c3b088809143308a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:25.096215 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3f50edf4-cbed-4f6b-b4d5-29f65b6d397f tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ba44010e0ca4892b56886e2b1636f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13238008c06e49c3b088809143308a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:25.097721 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3f50edf4-cbed-4f6b-b4d5-29f65b6d397f tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] 10.222.0.13 "GET /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19" status: 200 len: 1320 microversion: 2.26 time: 0.488150 Oct 30 01:25:25.115835 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1371/2765] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:25:24 2022] GET /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19 => generated 1320 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:25:25.123945 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d33dcc70-e960-427f-b8ee-cd29a054469a tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07f2b8c31f54c62aaba73ca2bd2edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c59bd73c7874a00b52ec7c5c4142039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:25.125665 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2ca010d8-2ad7-4e14-b9d6-83d045df80fe tempest-ImagesMetadataNegativeTestJSON-351812531 tempest-ImagesMetadataNegativeTestJSON-351812531-project] Calling method '.version_select at 0x7f44d03f7430>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:25.143241 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d33dcc70-e960-427f-b8ee-cd29a054469a tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] 10.222.0.13 "GET /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315" status: 200 len: 1313 microversion: 2.1 time: 0.578238 Oct 30 01:25:25.144063 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1395/2766] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:24 2022] GET /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315 => generated 1313 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:25.170256 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6841beea-198c-445b-80da-aeb7de5b8e5a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:25.171201 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6841beea-198c-445b-80da-aeb7de5b8e5a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7d5101ea-4f7c-45cb-957e-d4abd0b4977d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:25.181263 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6841beea-198c-445b-80da-aeb7de5b8e5a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:25.181875 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6841beea-198c-445b-80da-aeb7de5b8e5a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:25.182283 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-2ca010d8-2ad7-4e14-b9d6-83d045df80fe tempest-ImagesMetadataNegativeTestJSON-351812531 tempest-ImagesMetadataNegativeTestJSON-351812531-project] HTTP exception thrown: Image not found. Oct 30 01:25:25.182432 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6841beea-198c-445b-80da-aeb7de5b8e5a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:25.183222 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6841beea-198c-445b-80da-aeb7de5b8e5a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:25.183731 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6841beea-198c-445b-80da-aeb7de5b8e5a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:25.184833 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6841beea-198c-445b-80da-aeb7de5b8e5a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2ca010d8-2ad7-4e14-b9d6-83d045df80fe tempest-ImagesMetadataNegativeTestJSON-351812531 tempest-ImagesMetadataNegativeTestJSON-351812531-project] Request method failure captured: Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/images/9ed9c1e6-3c52-45e6-a9b5-6dcf5ac44e2f/metadata/os_version HTTP/1.1 Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdKCQmH0tUbcuXOBZRAxCQAc8A3_Y2369IWCxwOa8qgHMIBK3DtWtzoPqciLA-v4koT9nDaPco4gdl5ptHp-rhCH8akQb8fqz7L_EASh4dwwK9fLT2_9kofikjX8BQWJQz3ToB0YTRQPK6jlEsZNsZrsZDRn7c3-eXm0nRcAoMskdHE Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 4ac8019c0ff045f1a0a54f2a52479a70 Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-351812531 Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4ac8019c0ff045f1a0a54f2a52479a70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4ac8019c0ff045f1a0a54f2a52479a70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4ac8019c0ff045f1a0a54f2a52479a70"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4ac8019c0ff045f1a0a54f2a52479a70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-351812531 Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 4ac8019c0ff045f1a0a54f2a52479a70 Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-351812531 Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ImagesMetadataNegativeTestJSON-351812531-project Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: f2720b90fc5d42bfbbb9da2f7bc83952 Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-351812531-project Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: method: Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: exception: Image not found. Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: action_args: {'image_id': '9ed9c1e6-3c52-45e6-a9b5-6dcf5ac44e2f', 'id': 'os_version'} Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9ed9c1e6-3c52-45e6-a9b5-6dcf5ac44e2f Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 30 01:25:25.185687 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 30 01:25:25.190491 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 30 01:25:25.190491 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 30 01:25:25.190491 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 30 01:25:25.190491 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 30 01:25:25.190491 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 30 01:25:25.190491 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 30 01:25:25.190491 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 30 01:25:25.190491 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 30 01:25:25.190491 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 30 01:25:25.190491 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 30 01:25:25.190491 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 30 01:25:25.190491 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 30 01:25:25.190491 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 30 01:25:25.190491 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 30 01:25:25.190491 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 30 01:25:25.190491 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 30 01:25:25.190491 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 30 01:25:25.190491 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 30 01:25:25.190491 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9ed9c1e6-3c52-45e6-a9b5-6dcf5ac44e2f could not be found. Oct 30 01:25:25.190491 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:25.190491 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:25.190491 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:25.190491 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:25.190491 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:25.190491 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:25.190491 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:25:25.190491 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:25:25.190491 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:25:25.190491 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:25:25.190491 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:25:25.190491 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:25:25.190491 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 30 01:25:25.190491 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 30 01:25:25.190491 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 30 01:25:25.190491 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 30 01:25:25.190491 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 30 01:25:25.190491 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:25.190491 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:25.190491 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:25.190491 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:25.190491 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:25.190491 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:25.190491 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:25:25.190491 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:25:25.190491 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 30 01:25:25.190491 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:25.190491 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2ca010d8-2ad7-4e14-b9d6-83d045df80fe tempest-ImagesMetadataNegativeTestJSON-351812531 tempest-ImagesMetadataNegativeTestJSON-351812531-project] Returning 404 to user: Image not found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:25:25.190491 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2ca010d8-2ad7-4e14-b9d6-83d045df80fe tempest-ImagesMetadataNegativeTestJSON-351812531 tempest-ImagesMetadataNegativeTestJSON-351812531-project] 10.222.0.13 "GET /compute/v2.1/images/9ed9c1e6-3c52-45e6-a9b5-6dcf5ac44e2f/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.071848 Oct 30 01:25:25.190491 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1372/2767] 10.222.0.13 () {58 vars in 1293 bytes} [Sun Oct 30 01:25:25 2022] GET /compute/v2.1/images/9ed9c1e6-3c52-45e6-a9b5-6dcf5ac44e2f/metadata/os_version => generated 62 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:25:25.208814 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8c9c5cf3-8e54-48dd-a233-0c0642d5643a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44d0358550>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:25.277525 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8c9c5cf3-8e54-48dd-a233-0c0642d5643a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/10d86021-09d0-4f87-a249-2b033b1d6ae5" status: 200 len: 1412 microversion: 2.1 time: 0.086521 Oct 30 01:25:25.281728 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1373/2768] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:25:25 2022] GET /compute/v2.1/images/10d86021-09d0-4f87-a249-2b033b1d6ae5 => generated 1412 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:25.288613 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bfe87d26-4570-46b1-a269-6ad69dd779c0 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1049333059", "metadata": {"image_type": "test"}}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:25:25.291305 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-bfe87d26-4570-46b1-a269-6ad69dd779c0 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] [instance: 9c6be996-7886-41c6-9c0c-e0f899836cb0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:25.298389 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bfe87d26-4570-46b1-a269-6ad69dd779c0 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:25.298885 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bfe87d26-4570-46b1-a269-6ad69dd779c0 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:25.299323 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bfe87d26-4570-46b1-a269-6ad69dd779c0 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:25.300039 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bfe87d26-4570-46b1-a269-6ad69dd779c0 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:25.300493 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bfe87d26-4570-46b1-a269-6ad69dd779c0 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:25.300918 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bfe87d26-4570-46b1-a269-6ad69dd779c0 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:25.344332 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-bfe87d26-4570-46b1-a269-6ad69dd779c0 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Getting quotas for project 310172f2dfaf4ddcb5eace8a13939cda. Resources: dict_keys(['metadata_items']) {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:25:25.350450 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-bfe87d26-4570-46b1-a269-6ad69dd779c0 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Getting quotas for user e1e50d6775ec4d2e96ab6e839b4631f1 and project 310172f2dfaf4ddcb5eace8a13939cda. Resources: dict_keys(['metadata_items']) {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:25:25.359416 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:25:25.673007 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6841beea-198c-445b-80da-aeb7de5b8e5a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:25.683020 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6841beea-198c-445b-80da-aeb7de5b8e5a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/7d5101ea-4f7c-45cb-957e-d4abd0b4977d" status: 200 len: 1314 microversion: 2.1 time: 0.520632 Oct 30 01:25:25.687360 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1396/2769] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:25 2022] GET /compute/v2.1/servers/7d5101ea-4f7c-45cb-957e-d4abd0b4977d => generated 1314 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:25.696356 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8a8b4e6e-ddb9-450f-8a0f-e820ff0cb2ef tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:25.707934 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8a8b4e6e-ddb9-450f-8a0f-e820ff0cb2ef tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] [instance: dcb34439-de04-4a9c-b81b-7fb2360af99c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:25.739902 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8a8b4e6e-ddb9-450f-8a0f-e820ff0cb2ef tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:25.742637 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8a8b4e6e-ddb9-450f-8a0f-e820ff0cb2ef tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:25.743326 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8a8b4e6e-ddb9-450f-8a0f-e820ff0cb2ef tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:25.746362 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8a8b4e6e-ddb9-450f-8a0f-e820ff0cb2ef tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:25.747222 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8a8b4e6e-ddb9-450f-8a0f-e820ff0cb2ef tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:25.747873 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8a8b4e6e-ddb9-450f-8a0f-e820ff0cb2ef tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:25.941777 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8a8b4e6e-ddb9-450f-8a0f-e820ff0cb2ef tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94448bbc2f4a4efaa86792f1511ff15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342baf2538340e292e44dfc622b86fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:25.955348 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8a8b4e6e-ddb9-450f-8a0f-e820ff0cb2ef tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] 10.222.0.13 "GET /compute/v2.1/servers/dcb34439-de04-4a9c-b81b-7fb2360af99c" status: 200 len: 1613 microversion: 2.1 time: 0.266508 Oct 30 01:25:25.963064 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1397/2770] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:25 2022] GET /compute/v2.1/servers/dcb34439-de04-4a9c-b81b-7fb2360af99c => generated 1613 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:25.982699 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e007cfb0-90f9-4151-91db-2f60db9116b1 tempest-ImagesMetadataNegativeTestJSON-351812531 tempest-ImagesMetadataNegativeTestJSON-351812531-project] Calling method '.version_select at 0x7f44d02bbdc0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:26.035356 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-e007cfb0-90f9-4151-91db-2f60db9116b1 tempest-ImagesMetadataNegativeTestJSON-351812531 tempest-ImagesMetadataNegativeTestJSON-351812531-project] HTTP exception thrown: Image not found. Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e007cfb0-90f9-4151-91db-2f60db9116b1 tempest-ImagesMetadataNegativeTestJSON-351812531 tempest-ImagesMetadataNegativeTestJSON-351812531-project] Request method failure captured: Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/images/85c136fa-ee46-4ef7-b022-f13b2c1dc17c/metadata HTTP/1.1 Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdKCQmH0tUbcuXOBZRAxCQAc8A3_Y2369IWCxwOa8qgHMIBK3DtWtzoPqciLA-v4koT9nDaPco4gdl5ptHp-rhCH8akQb8fqz7L_EASh4dwwK9fLT2_9kofikjX8BQWJQz3ToB0YTRQPK6jlEsZNsZrsZDRn7c3-eXm0nRcAoMskdHE Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 4ac8019c0ff045f1a0a54f2a52479a70 Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-351812531 Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4ac8019c0ff045f1a0a54f2a52479a70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4ac8019c0ff045f1a0a54f2a52479a70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4ac8019c0ff045f1a0a54f2a52479a70"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4ac8019c0ff045f1a0a54f2a52479a70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-351812531 Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 4ac8019c0ff045f1a0a54f2a52479a70 Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-351812531 Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ImagesMetadataNegativeTestJSON-351812531-project Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: f2720b90fc5d42bfbbb9da2f7bc83952 Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-351812531-project Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: method: Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: exception: Image not found. Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: action_args: {'image_id': '85c136fa-ee46-4ef7-b022-f13b2c1dc17c'} Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 85c136fa-ee46-4ef7-b022-f13b2c1dc17c Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 30 01:25:26.037138 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 30 01:25:26.041558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 30 01:25:26.041558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 30 01:25:26.041558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 30 01:25:26.041558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 30 01:25:26.041558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 30 01:25:26.041558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 30 01:25:26.041558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 30 01:25:26.041558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 30 01:25:26.041558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 30 01:25:26.041558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 30 01:25:26.041558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 30 01:25:26.041558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 30 01:25:26.041558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 30 01:25:26.041558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 30 01:25:26.041558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 30 01:25:26.041558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 30 01:25:26.041558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 30 01:25:26.041558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 30 01:25:26.041558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 85c136fa-ee46-4ef7-b022-f13b2c1dc17c could not be found. Oct 30 01:25:26.041558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:26.041558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:26.041558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:26.041558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:26.041558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:26.041558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:26.041558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:25:26.041558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:25:26.041558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:25:26.041558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:25:26.041558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:25:26.041558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:25:26.041558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 30 01:25:26.041558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 30 01:25:26.041558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 30 01:25:26.041558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 30 01:25:26.041558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 30 01:25:26.041558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:26.041558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:26.041558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:26.041558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:26.041558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:26.041558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:26.041558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:25:26.041558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:25:26.041558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 30 01:25:26.041558 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:26.041558 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e007cfb0-90f9-4151-91db-2f60db9116b1 tempest-ImagesMetadataNegativeTestJSON-351812531 tempest-ImagesMetadataNegativeTestJSON-351812531-project] Returning 404 to user: Image not found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:25:26.041558 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e007cfb0-90f9-4151-91db-2f60db9116b1 tempest-ImagesMetadataNegativeTestJSON-351812531 tempest-ImagesMetadataNegativeTestJSON-351812531-project] 10.222.0.13 "GET /compute/v2.1/images/85c136fa-ee46-4ef7-b022-f13b2c1dc17c/metadata" status: 404 len: 62 microversion: 2.1 time: 0.079688 Oct 30 01:25:26.041558 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1398/2771] 10.222.0.13 () {58 vars in 1260 bytes} [Sun Oct 30 01:25:25 2022] GET /compute/v2.1/images/85c136fa-ee46-4ef7-b022-f13b2c1dc17c/metadata => generated 62 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:25:26.077924 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5fb3d32c-aad4-401c-bb2b-72912a93327c tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:26.080748 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5fb3d32c-aad4-401c-bb2b-72912a93327c tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] [instance: 5b5d5fa5-1e07-4145-b6c8-30e31de10165] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:26.108330 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5fb3d32c-aad4-401c-bb2b-72912a93327c tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:26.108839 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5fb3d32c-aad4-401c-bb2b-72912a93327c tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:26.109281 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5fb3d32c-aad4-401c-bb2b-72912a93327c tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:26.111430 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5fb3d32c-aad4-401c-bb2b-72912a93327c tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:26.120738 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5fb3d32c-aad4-401c-bb2b-72912a93327c tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:26.123253 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5fb3d32c-aad4-401c-bb2b-72912a93327c tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:26.598927 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bfe87d26-4570-46b1-a269-6ad69dd779c0 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "POST /compute/v2.1/servers/9c6be996-7886-41c6-9c0c-e0f899836cb0/action" status: 202 len: 0 microversion: 2.1 time: 1.318578 Oct 30 01:25:26.601286 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1374/2772] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:25:25 2022] POST /compute/v2.1/servers/9c6be996-7886-41c6-9c0c-e0f899836cb0/action => generated 0 bytes in 1322 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 30 01:25:26.611817 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-62a6e463-7a57-4976-805d-6ec1b3f4f19d tempest-ImagesMetadataNegativeTestJSON-351812531 tempest-ImagesMetadataNegativeTestJSON-351812531-project] Action: 'update_all', calling method: .version_select at 0x7f44d04a98b0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:25:26.679609 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-62a6e463-7a57-4976-805d-6ec1b3f4f19d tempest-ImagesMetadataNegativeTestJSON-351812531 tempest-ImagesMetadataNegativeTestJSON-351812531-project] HTTP exception thrown: Image not found. Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-62a6e463-7a57-4976-805d-6ec1b3f4f19d tempest-ImagesMetadataNegativeTestJSON-351812531 tempest-ImagesMetadataNegativeTestJSON-351812531-project] Request method failure captured: Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: request: PUT /compute/v2.1/images/92e18ad8-219a-4d5d-8e07-fd038725d084/metadata HTTP/1.1 Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 57 Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdKCQmH0tUbcuXOBZRAxCQAc8A3_Y2369IWCxwOa8qgHMIBK3DtWtzoPqciLA-v4koT9nDaPco4gdl5ptHp-rhCH8akQb8fqz7L_EASh4dwwK9fLT2_9kofikjX8BQWJQz3ToB0YTRQPK6jlEsZNsZrsZDRn7c3-eXm0nRcAoMskdHE Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 4ac8019c0ff045f1a0a54f2a52479a70 Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-351812531 Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4ac8019c0ff045f1a0a54f2a52479a70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4ac8019c0ff045f1a0a54f2a52479a70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4ac8019c0ff045f1a0a54f2a52479a70"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4ac8019c0ff045f1a0a54f2a52479a70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-351812531 Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 4ac8019c0ff045f1a0a54f2a52479a70 Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-351812531 Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ImagesMetadataNegativeTestJSON-351812531-project Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: f2720b90fc5d42bfbbb9da2f7bc83952 Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-351812531-project Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: method: Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: exception: Image not found. Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: action_args: {'image_id': '92e18ad8-219a-4d5d-8e07-fd038725d084', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 92e18ad8-219a-4d5d-8e07-fd038725d084 Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 30 01:25:26.691895 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 30 01:25:26.696591 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 30 01:25:26.696591 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 30 01:25:26.696591 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 30 01:25:26.696591 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 30 01:25:26.696591 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 30 01:25:26.696591 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 30 01:25:26.696591 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 30 01:25:26.696591 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 30 01:25:26.696591 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 30 01:25:26.696591 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 30 01:25:26.696591 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 30 01:25:26.696591 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 30 01:25:26.696591 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 30 01:25:26.696591 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 30 01:25:26.696591 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 30 01:25:26.696591 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 30 01:25:26.696591 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 30 01:25:26.696591 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 30 01:25:26.696591 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 92e18ad8-219a-4d5d-8e07-fd038725d084 could not be found. Oct 30 01:25:26.696591 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:26.696591 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:26.696591 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:26.696591 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:26.696591 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:26.696591 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:26.696591 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:25:26.696591 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:25:26.696591 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:25:26.696591 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:25:26.696591 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:25:26.696591 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:25:26.696591 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:25:26.696591 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:25:26.696591 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 30 01:25:26.696591 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 30 01:25:26.696591 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 30 01:25:26.696591 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 30 01:25:26.696591 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 30 01:25:26.696591 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:26.696591 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:26.696591 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:26.696591 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:26.696591 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:26.696591 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:26.696591 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:25:26.696591 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:25:26.696591 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 30 01:25:26.696591 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:26.708063 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-62a6e463-7a57-4976-805d-6ec1b3f4f19d tempest-ImagesMetadataNegativeTestJSON-351812531 tempest-ImagesMetadataNegativeTestJSON-351812531-project] Returning 404 to user: Image not found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:25:26.710760 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-62a6e463-7a57-4976-805d-6ec1b3f4f19d tempest-ImagesMetadataNegativeTestJSON-351812531 tempest-ImagesMetadataNegativeTestJSON-351812531-project] 10.222.0.13 "PUT /compute/v2.1/images/92e18ad8-219a-4d5d-8e07-fd038725d084/metadata" status: 404 len: 62 microversion: 2.1 time: 0.106657 Oct 30 01:25:26.714881 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1375/2773] 10.222.0.13 () {60 vars in 1280 bytes} [Sun Oct 30 01:25:26 2022] PUT /compute/v2.1/images/92e18ad8-219a-4d5d-8e07-fd038725d084/metadata => generated 62 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:25:26.763219 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-facd0d4b-8dea-46a0-83d7-b44057927598 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:26.764709 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-facd0d4b-8dea-46a0-83d7-b44057927598 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] [instance: 5c4bb439-785f-4ac3-a7fc-b9325b52fa19] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:26.794790 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-facd0d4b-8dea-46a0-83d7-b44057927598 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:26.796270 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-facd0d4b-8dea-46a0-83d7-b44057927598 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:26.799977 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-facd0d4b-8dea-46a0-83d7-b44057927598 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:26.803968 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-facd0d4b-8dea-46a0-83d7-b44057927598 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:26.808377 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-facd0d4b-8dea-46a0-83d7-b44057927598 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:26.811306 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-facd0d4b-8dea-46a0-83d7-b44057927598 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:27.380842 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5fb3d32c-aad4-401c-bb2b-72912a93327c tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc60a96037f438ebbaaa6d25661bfc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127b4f4e1e4b43ed856faee3c5d9d88d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:27.380842 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5fb3d32c-aad4-401c-bb2b-72912a93327c tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] 10.222.0.13 "GET /compute/v2.1/servers/5b5d5fa5-1e07-4145-b6c8-30e31de10165" status: 200 len: 1325 microversion: 2.1 time: 1.310916 Oct 30 01:25:27.380842 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1399/2774] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:26 2022] GET /compute/v2.1/servers/5b5d5fa5-1e07-4145-b6c8-30e31de10165 => generated 1325 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:27.401067 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-73d39c00-0370-474b-9939-456f93434085 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:27.401723 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-73d39c00-0370-474b-9939-456f93434085 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: 64824cfc-200e-4ee1-8698-011b644ae315] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:27.409002 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-facd0d4b-8dea-46a0-83d7-b44057927598 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba44010e0ca4892b56886e2b1636f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13238008c06e49c3b088809143308a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:27.410526 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-73d39c00-0370-474b-9939-456f93434085 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:27.414865 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-73d39c00-0370-474b-9939-456f93434085 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:27.414865 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-73d39c00-0370-474b-9939-456f93434085 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:27.416994 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-73d39c00-0370-474b-9939-456f93434085 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:27.417832 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-73d39c00-0370-474b-9939-456f93434085 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:27.418513 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-73d39c00-0370-474b-9939-456f93434085 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:27.419107 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-facd0d4b-8dea-46a0-83d7-b44057927598 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ba44010e0ca4892b56886e2b1636f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13238008c06e49c3b088809143308a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:27.420629 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-facd0d4b-8dea-46a0-83d7-b44057927598 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ba44010e0ca4892b56886e2b1636f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13238008c06e49c3b088809143308a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:27.421821 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-facd0d4b-8dea-46a0-83d7-b44057927598 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] 10.222.0.13 "GET /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19" status: 200 len: 1362 microversion: 2.26 time: 0.685175 Oct 30 01:25:27.422376 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1376/2775] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:25:26 2022] GET /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19 => generated 1362 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:25:27.463142 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-89476ccb-7a8f-4040-96f1-be312064a954 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44d0417ca0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:27.541187 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-89476ccb-7a8f-4040-96f1-be312064a954 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/10d86021-09d0-4f87-a249-2b033b1d6ae5" status: 200 len: 1412 microversion: 2.1 time: 0.095515 Oct 30 01:25:27.551037 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1377/2776] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:25:27 2022] GET /compute/v2.1/images/10d86021-09d0-4f87-a249-2b033b1d6ae5 => generated 1412 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:27.555787 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-ff260e4f-97e3-43ec-aad7-1c27dd5a065f req-01d4e0f1-91d1-405d-a554-f5743ea93886 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d5101ea-4f7c-45cb-957e-d4abd0b4977d", "name": "network-vif-plugged", "status": "completed", "tag": "63fa751a-4d60-4d9d-acdf-37f981d1869e"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:25:27.572924 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ff260e4f-97e3-43ec-aad7-1c27dd5a065f req-01d4e0f1-91d1-405d-a554-f5743ea93886 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:27.573196 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ff260e4f-97e3-43ec-aad7-1c27dd5a065f req-01d4e0f1-91d1-405d-a554-f5743ea93886 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:27.581106 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ff260e4f-97e3-43ec-aad7-1c27dd5a065f req-01d4e0f1-91d1-405d-a554-f5743ea93886 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:27.596707 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-ff260e4f-97e3-43ec-aad7-1c27dd5a065f req-01d4e0f1-91d1-405d-a554-f5743ea93886 service nova] Creating event network-vif-plugged:63fa751a-4d60-4d9d-acdf-37f981d1869e for instance 7d5101ea-4f7c-45cb-957e-d4abd0b4977d on n-h1-master-1 Oct 30 01:25:27.611636 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-ff260e4f-97e3-43ec-aad7-1c27dd5a065f req-01d4e0f1-91d1-405d-a554-f5743ea93886 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067964 Oct 30 01:25:27.614101 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1378/2777] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:25:27.629431 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2f7dd660-35ab-4ea3-a200-d278b3dbf8ed tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '.version_select at 0x7f44d045c790>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:27.697842 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=30 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:25:27.769154 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2f7dd660-35ab-4ea3-a200-d278b3dbf8ed tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "GET /compute/v2.1/images/50669d24-ab56-475f-8236-0ff19406f3eb" status: 200 len: 1424 microversion: 2.1 time: 0.153784 Oct 30 01:25:27.769774 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1379/2778] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:25:27 2022] GET /compute/v2.1/images/50669d24-ab56-475f-8236-0ff19406f3eb => generated 1424 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:27.778876 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7c96dbe3-7b79-4f68-aaea-b33c4abd1e11 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:27.789766 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7c96dbe3-7b79-4f68-aaea-b33c4abd1e11 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7d5101ea-4f7c-45cb-957e-d4abd0b4977d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:27.813525 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7c96dbe3-7b79-4f68-aaea-b33c4abd1e11 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:27.816170 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7c96dbe3-7b79-4f68-aaea-b33c4abd1e11 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:27.816819 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7c96dbe3-7b79-4f68-aaea-b33c4abd1e11 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:27.820721 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7c96dbe3-7b79-4f68-aaea-b33c4abd1e11 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:27.823517 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7c96dbe3-7b79-4f68-aaea-b33c4abd1e11 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:27.824200 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7c96dbe3-7b79-4f68-aaea-b33c4abd1e11 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:28.173903 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-73d39c00-0370-474b-9939-456f93434085 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07f2b8c31f54c62aaba73ca2bd2edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c59bd73c7874a00b52ec7c5c4142039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:28.188106 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-73d39c00-0370-474b-9939-456f93434085 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] 10.222.0.13 "GET /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315" status: 200 len: 1313 microversion: 2.1 time: 0.796178 Oct 30 01:25:28.189264 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1400/2779] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:27 2022] GET /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315 => generated 1313 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:28.194994 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-42993963-9845-4c36-be99-23581a3e9bc1 tempest-ImagesMetadataNegativeTestJSON-351812531 tempest-ImagesMetadataNegativeTestJSON-351812531-project] Action: 'update', calling method: .version_select at 0x7f44cc5d5e50>, body: {"meta": {"os_distro": "alt"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:25:28.254724 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-42993963-9845-4c36-be99-23581a3e9bc1 tempest-ImagesMetadataNegativeTestJSON-351812531 tempest-ImagesMetadataNegativeTestJSON-351812531-project] HTTP exception thrown: Image not found. Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-42993963-9845-4c36-be99-23581a3e9bc1 tempest-ImagesMetadataNegativeTestJSON-351812531 tempest-ImagesMetadataNegativeTestJSON-351812531-project] Request method failure captured: Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: request: PUT /compute/v2.1/images/1e159e9a-23a0-4f43-9466-9e89e96963b8/metadata/os_distro HTTP/1.1 Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 30 Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdKCQmH0tUbcuXOBZRAxCQAc8A3_Y2369IWCxwOa8qgHMIBK3DtWtzoPqciLA-v4koT9nDaPco4gdl5ptHp-rhCH8akQb8fqz7L_EASh4dwwK9fLT2_9kofikjX8BQWJQz3ToB0YTRQPK6jlEsZNsZrsZDRn7c3-eXm0nRcAoMskdHE Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 4ac8019c0ff045f1a0a54f2a52479a70 Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-351812531 Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4ac8019c0ff045f1a0a54f2a52479a70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4ac8019c0ff045f1a0a54f2a52479a70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4ac8019c0ff045f1a0a54f2a52479a70"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4ac8019c0ff045f1a0a54f2a52479a70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-351812531 Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 4ac8019c0ff045f1a0a54f2a52479a70 Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-351812531 Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ImagesMetadataNegativeTestJSON-351812531-project Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: f2720b90fc5d42bfbbb9da2f7bc83952 Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-351812531-project Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: {"meta": {"os_distro": "alt"}} Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: method: Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: exception: Image not found. Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: action_args: {'image_id': '1e159e9a-23a0-4f43-9466-9e89e96963b8', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 1e159e9a-23a0-4f43-9466-9e89e96963b8 Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 30 01:25:28.257129 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 30 01:25:28.271351 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 30 01:25:28.271351 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 30 01:25:28.271351 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 30 01:25:28.271351 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 30 01:25:28.271351 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 30 01:25:28.271351 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 30 01:25:28.271351 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 30 01:25:28.271351 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 30 01:25:28.271351 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 30 01:25:28.271351 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 30 01:25:28.271351 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 30 01:25:28.271351 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 30 01:25:28.271351 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 30 01:25:28.271351 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 30 01:25:28.271351 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 30 01:25:28.271351 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 30 01:25:28.271351 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 30 01:25:28.271351 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 30 01:25:28.271351 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1e159e9a-23a0-4f43-9466-9e89e96963b8 could not be found. Oct 30 01:25:28.271351 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:28.271351 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:28.271351 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:28.271351 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:28.271351 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:28.271351 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:28.271351 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:25:28.271351 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:25:28.271351 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:25:28.271351 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:25:28.271351 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:25:28.271351 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:25:28.271351 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:25:28.271351 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:25:28.271351 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 30 01:25:28.271351 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 30 01:25:28.271351 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 30 01:25:28.271351 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 30 01:25:28.271351 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 30 01:25:28.271351 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:28.271351 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:28.271351 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:28.271351 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:28.271351 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:28.271351 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:28.271351 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:25:28.271351 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:25:28.271351 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 30 01:25:28.271351 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:28.271351 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-42993963-9845-4c36-be99-23581a3e9bc1 tempest-ImagesMetadataNegativeTestJSON-351812531 tempest-ImagesMetadataNegativeTestJSON-351812531-project] Returning 404 to user: Image not found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:25:28.271351 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-42993963-9845-4c36-be99-23581a3e9bc1 tempest-ImagesMetadataNegativeTestJSON-351812531 tempest-ImagesMetadataNegativeTestJSON-351812531-project] 10.222.0.13 "PUT /compute/v2.1/images/1e159e9a-23a0-4f43-9466-9e89e96963b8/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.068528 Oct 30 01:25:28.271351 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1401/2780] 10.222.0.13 () {60 vars in 1310 bytes} [Sun Oct 30 01:25:28 2022] PUT /compute/v2.1/images/1e159e9a-23a0-4f43-9466-9e89e96963b8/metadata/os_distro => generated 62 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:25:28.275542 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-51c1cc4b-799b-42f5-b452-ada512012a39 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:28.275542 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-51c1cc4b-799b-42f5-b452-ada512012a39 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] [instance: dcb34439-de04-4a9c-b81b-7fb2360af99c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:28.291224 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51c1cc4b-799b-42f5-b452-ada512012a39 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:28.294079 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51c1cc4b-799b-42f5-b452-ada512012a39 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:28.294558 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51c1cc4b-799b-42f5-b452-ada512012a39 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:28.295307 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51c1cc4b-799b-42f5-b452-ada512012a39 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:28.295775 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51c1cc4b-799b-42f5-b452-ada512012a39 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:28.297465 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51c1cc4b-799b-42f5-b452-ada512012a39 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:28.355266 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51c1cc4b-799b-42f5-b452-ada512012a39 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:28.355896 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51c1cc4b-799b-42f5-b452-ada512012a39 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:28.356348 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51c1cc4b-799b-42f5-b452-ada512012a39 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:28.367218 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-51c1cc4b-799b-42f5-b452-ada512012a39 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lazy-loading 'fault' on Instance uuid dcb34439-de04-4a9c-b81b-7fb2360af99c {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:25:28.535097 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7c96dbe3-7b79-4f68-aaea-b33c4abd1e11 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:28.541296 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=6 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:25:28.555470 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7c96dbe3-7b79-4f68-aaea-b33c4abd1e11 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/7d5101ea-4f7c-45cb-957e-d4abd0b4977d" status: 200 len: 1314 microversion: 2.1 time: 0.784387 Oct 30 01:25:28.576889 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1380/2781] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:27 2022] GET /compute/v2.1/servers/7d5101ea-4f7c-45cb-957e-d4abd0b4977d => generated 1314 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:28.584251 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-4b5d002c-421c-4275-a958-5e1a1cd3c1f5 req-741ea001-c2e4-48d6-93fa-40946fcf5228 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b5d5fa5-1e07-4145-b6c8-30e31de10165", "tag": "3058ff4b-eaf6-419c-a4e9-7aed07c9af1f"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:25:28.601320 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-4b5d002c-421c-4275-a958-5e1a1cd3c1f5 req-741ea001-c2e4-48d6-93fa-40946fcf5228 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:28.601550 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-51c1cc4b-799b-42f5-b452-ada512012a39 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94448bbc2f4a4efaa86792f1511ff15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342baf2538340e292e44dfc622b86fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:28.601872 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-4b5d002c-421c-4275-a958-5e1a1cd3c1f5 req-741ea001-c2e4-48d6-93fa-40946fcf5228 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:28.613397 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-51c1cc4b-799b-42f5-b452-ada512012a39 tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] 10.222.0.13 "GET /compute/v2.1/servers/dcb34439-de04-4a9c-b81b-7fb2360af99c" status: 200 len: 1331 microversion: 2.1 time: 0.349826 Oct 30 01:25:28.613397 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1402/2782] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:28 2022] GET /compute/v2.1/servers/dcb34439-de04-4a9c-b81b-7fb2360af99c => generated 1331 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:28.615073 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-4b5d002c-421c-4275-a958-5e1a1cd3c1f5 req-741ea001-c2e4-48d6-93fa-40946fcf5228 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:28.618625 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-32a6b6ae-2af2-4c26-ae41-538e822e1c47 req-48b46517-4da5-4ce1-ae67-3521b9b8598a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcb34439-de04-4a9c-b81b-7fb2360af99c", "name": "network-vif-deleted", "tag": "aba33ea4-cd46-4a87-a95b-e95a41b80f08"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:25:28.628941 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-32a6b6ae-2af2-4c26-ae41-538e822e1c47 req-48b46517-4da5-4ce1-ae67-3521b9b8598a service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:28.629825 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-32a6b6ae-2af2-4c26-ae41-538e822e1c47 req-48b46517-4da5-4ce1-ae67-3521b9b8598a service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:28.630527 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-32a6b6ae-2af2-4c26-ae41-538e822e1c47 req-48b46517-4da5-4ce1-ae67-3521b9b8598a service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:28.649639 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-4b5d002c-421c-4275-a958-5e1a1cd3c1f5 req-741ea001-c2e4-48d6-93fa-40946fcf5228 service nova] Creating event network-changed:3058ff4b-eaf6-419c-a4e9-7aed07c9af1f for instance 5b5d5fa5-1e07-4145-b6c8-30e31de10165 on n-h1-master-1 Oct 30 01:25:28.653720 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-32a6b6ae-2af2-4c26-ae41-538e822e1c47 req-48b46517-4da5-4ce1-ae67-3521b9b8598a service nova] Creating event network-vif-deleted:aba33ea4-cd46-4a87-a95b-e95a41b80f08 for instance dcb34439-de04-4a9c-b81b-7fb2360af99c on n-h1-master-1 Oct 30 01:25:28.665044 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-4b5d002c-421c-4275-a958-5e1a1cd3c1f5 req-741ea001-c2e4-48d6-93fa-40946fcf5228 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083449 Oct 30 01:25:28.666105 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1381/2783] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:25:28.674661 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-055e313d-9634-4b92-afb1-18078b247fa3 tempest-ImagesMetadataNegativeTestJSON-351812531 tempest-ImagesMetadataNegativeTestJSON-351812531-project] Action: 'create', calling method: .version_select at 0x7f44ccdd0a60>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:25:28.683385 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-32a6b6ae-2af2-4c26-ae41-538e822e1c47 req-48b46517-4da5-4ce1-ae67-3521b9b8598a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069573 Oct 30 01:25:28.685674 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1403/2784] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:25:28.703016 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6f93a20f-51d9-48b7-b1ff-5d7c494cdb2b tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:28.703738 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6f93a20f-51d9-48b7-b1ff-5d7c494cdb2b tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] [instance: 5b5d5fa5-1e07-4145-b6c8-30e31de10165] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:28.717126 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-055e313d-9634-4b92-afb1-18078b247fa3 tempest-ImagesMetadataNegativeTestJSON-351812531 tempest-ImagesMetadataNegativeTestJSON-351812531-project] HTTP exception thrown: Image not found. Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-055e313d-9634-4b92-afb1-18078b247fa3 tempest-ImagesMetadataNegativeTestJSON-351812531 tempest-ImagesMetadataNegativeTestJSON-351812531-project] Request method failure captured: Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: request: POST /compute/v2.1/images/66cacbe9-4e83-415a-a566-69404c6f47d2/metadata HTTP/1.1 Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 57 Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdKCQmH0tUbcuXOBZRAxCQAc8A3_Y2369IWCxwOa8qgHMIBK3DtWtzoPqciLA-v4koT9nDaPco4gdl5ptHp-rhCH8akQb8fqz7L_EASh4dwwK9fLT2_9kofikjX8BQWJQz3ToB0YTRQPK6jlEsZNsZrsZDRn7c3-eXm0nRcAoMskdHE Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 4ac8019c0ff045f1a0a54f2a52479a70 Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-351812531 Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4ac8019c0ff045f1a0a54f2a52479a70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4ac8019c0ff045f1a0a54f2a52479a70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4ac8019c0ff045f1a0a54f2a52479a70"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4ac8019c0ff045f1a0a54f2a52479a70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-351812531 Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 4ac8019c0ff045f1a0a54f2a52479a70 Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-351812531 Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ImagesMetadataNegativeTestJSON-351812531-project Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: f2720b90fc5d42bfbbb9da2f7bc83952 Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-351812531-project Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: method: Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: exception: Image not found. Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: action_args: {'image_id': '66cacbe9-4e83-415a-a566-69404c6f47d2', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 66cacbe9-4e83-415a-a566-69404c6f47d2 Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 30 01:25:28.721203 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 30 01:25:28.731451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 30 01:25:28.731451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 30 01:25:28.731451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 30 01:25:28.731451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 30 01:25:28.731451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 30 01:25:28.731451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 30 01:25:28.731451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 30 01:25:28.731451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 30 01:25:28.731451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 30 01:25:28.731451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 30 01:25:28.731451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 30 01:25:28.731451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 30 01:25:28.731451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 30 01:25:28.731451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 30 01:25:28.731451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 30 01:25:28.731451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 30 01:25:28.731451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 30 01:25:28.731451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 30 01:25:28.731451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 66cacbe9-4e83-415a-a566-69404c6f47d2 could not be found. Oct 30 01:25:28.731451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:28.731451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:28.731451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:28.731451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:28.731451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:28.731451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:28.731451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:25:28.731451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:25:28.731451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:25:28.731451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:25:28.731451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:25:28.731451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:25:28.731451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:25:28.731451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:25:28.731451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 30 01:25:28.731451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 30 01:25:28.731451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 30 01:25:28.731451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 30 01:25:28.731451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 30 01:25:28.731451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:28.731451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:28.731451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:28.731451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:28.731451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:28.731451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:28.731451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:25:28.731451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:25:28.731451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 30 01:25:28.731451 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:28.731451 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-055e313d-9634-4b92-afb1-18078b247fa3 tempest-ImagesMetadataNegativeTestJSON-351812531 tempest-ImagesMetadataNegativeTestJSON-351812531-project] Returning 404 to user: Image not found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:25:28.731451 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-055e313d-9634-4b92-afb1-18078b247fa3 tempest-ImagesMetadataNegativeTestJSON-351812531 tempest-ImagesMetadataNegativeTestJSON-351812531-project] 10.222.0.13 "POST /compute/v2.1/images/66cacbe9-4e83-415a-a566-69404c6f47d2/metadata" status: 404 len: 62 microversion: 2.1 time: 0.055577 Oct 30 01:25:28.731451 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1382/2785] 10.222.0.13 () {60 vars in 1281 bytes} [Sun Oct 30 01:25:28 2022] POST /compute/v2.1/images/66cacbe9-4e83-415a-a566-69404c6f47d2/metadata => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:25:28.741895 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6f93a20f-51d9-48b7-b1ff-5d7c494cdb2b tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:28.747942 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6f93a20f-51d9-48b7-b1ff-5d7c494cdb2b tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:28.749000 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6f93a20f-51d9-48b7-b1ff-5d7c494cdb2b tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:28.750685 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-21408050-d8c3-497e-9587-c5fc1ee99153 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:28.751605 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-21408050-d8c3-497e-9587-c5fc1ee99153 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] [instance: 5c4bb439-785f-4ac3-a7fc-b9325b52fa19] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:28.754758 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6f93a20f-51d9-48b7-b1ff-5d7c494cdb2b tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:28.756060 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6f93a20f-51d9-48b7-b1ff-5d7c494cdb2b tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:28.758120 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6f93a20f-51d9-48b7-b1ff-5d7c494cdb2b tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:28.760186 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21408050-d8c3-497e-9587-c5fc1ee99153 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:28.760938 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21408050-d8c3-497e-9587-c5fc1ee99153 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:28.761622 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21408050-d8c3-497e-9587-c5fc1ee99153 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:28.763134 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21408050-d8c3-497e-9587-c5fc1ee99153 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:28.763813 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21408050-d8c3-497e-9587-c5fc1ee99153 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:28.764460 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21408050-d8c3-497e-9587-c5fc1ee99153 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:29.591670 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-21408050-d8c3-497e-9587-c5fc1ee99153 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba44010e0ca4892b56886e2b1636f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13238008c06e49c3b088809143308a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:29.607827 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-21408050-d8c3-497e-9587-c5fc1ee99153 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ba44010e0ca4892b56886e2b1636f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13238008c06e49c3b088809143308a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:29.610268 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-21408050-d8c3-497e-9587-c5fc1ee99153 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ba44010e0ca4892b56886e2b1636f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13238008c06e49c3b088809143308a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:29.611708 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-21408050-d8c3-497e-9587-c5fc1ee99153 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] 10.222.0.13 "GET /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19" status: 200 len: 1362 microversion: 2.26 time: 0.872106 Oct 30 01:25:29.613530 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1383/2786] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:25:28 2022] GET /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19 => generated 1362 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:25:29.629835 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8b584768-0731-421f-bd58-769d7de905fa tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44d045c310>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:29.641005 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6f93a20f-51d9-48b7-b1ff-5d7c494cdb2b tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc60a96037f438ebbaaa6d25661bfc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127b4f4e1e4b43ed856faee3c5d9d88d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:29.654967 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6f93a20f-51d9-48b7-b1ff-5d7c494cdb2b tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] 10.222.0.13 "GET /compute/v2.1/servers/5b5d5fa5-1e07-4145-b6c8-30e31de10165" status: 200 len: 1325 microversion: 2.1 time: 0.962124 Oct 30 01:25:29.655836 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1404/2787] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:28 2022] GET /compute/v2.1/servers/5b5d5fa5-1e07-4145-b6c8-30e31de10165 => generated 1325 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:29.670850 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cf814b6b-2c97-4029-b461-184159094914 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '.version_select at 0x7f44c773b4c0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:29.793068 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8b584768-0731-421f-bd58-769d7de905fa tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/10d86021-09d0-4f87-a249-2b033b1d6ae5" status: 200 len: 1412 microversion: 2.1 time: 0.177495 Oct 30 01:25:29.804843 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1384/2788] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:25:29 2022] GET /compute/v2.1/images/10d86021-09d0-4f87-a249-2b033b1d6ae5 => generated 1412 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:29.814402 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cf814b6b-2c97-4029-b461-184159094914 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "GET /compute/v2.1/images/50669d24-ab56-475f-8236-0ff19406f3eb" status: 200 len: 1424 microversion: 2.1 time: 0.157091 Oct 30 01:25:29.817350 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1405/2789] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:25:29 2022] GET /compute/v2.1/images/50669d24-ab56-475f-8236-0ff19406f3eb => generated 1424 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:29.833595 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-21b725ad-e982-4de1-b6d0-94c72256c215 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:29.834408 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-21b725ad-e982-4de1-b6d0-94c72256c215 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: 64824cfc-200e-4ee1-8698-011b644ae315] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:29.835127 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d8cb2de0-69cc-46a2-8f09-92110b4d5e7e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:29.835764 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d8cb2de0-69cc-46a2-8f09-92110b4d5e7e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7d5101ea-4f7c-45cb-957e-d4abd0b4977d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:29.847046 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21b725ad-e982-4de1-b6d0-94c72256c215 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:29.855322 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21b725ad-e982-4de1-b6d0-94c72256c215 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:29.855322 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21b725ad-e982-4de1-b6d0-94c72256c215 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:29.855322 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21b725ad-e982-4de1-b6d0-94c72256c215 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:29.855322 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21b725ad-e982-4de1-b6d0-94c72256c215 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:29.855322 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21b725ad-e982-4de1-b6d0-94c72256c215 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:29.856823 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8cb2de0-69cc-46a2-8f09-92110b4d5e7e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:29.857320 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8cb2de0-69cc-46a2-8f09-92110b4d5e7e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:29.857782 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8cb2de0-69cc-46a2-8f09-92110b4d5e7e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:29.862014 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8cb2de0-69cc-46a2-8f09-92110b4d5e7e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:29.862517 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8cb2de0-69cc-46a2-8f09-92110b4d5e7e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:29.862951 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8cb2de0-69cc-46a2-8f09-92110b4d5e7e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:30.139565 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=46 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:25:30.379784 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d8cb2de0-69cc-46a2-8f09-92110b4d5e7e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:30.398395 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-21b725ad-e982-4de1-b6d0-94c72256c215 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07f2b8c31f54c62aaba73ca2bd2edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c59bd73c7874a00b52ec7c5c4142039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:30.410249 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-21b725ad-e982-4de1-b6d0-94c72256c215 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] 10.222.0.13 "GET /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315" status: 200 len: 1334 microversion: 2.1 time: 0.602311 Oct 30 01:25:30.411055 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d8cb2de0-69cc-46a2-8f09-92110b4d5e7e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/7d5101ea-4f7c-45cb-957e-d4abd0b4977d" status: 200 len: 1501 microversion: 2.1 time: 0.591283 Oct 30 01:25:30.411853 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1385/2790] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:29 2022] GET /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315 => generated 1334 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:30.413571 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1406/2791] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:29 2022] GET /compute/v2.1/servers/7d5101ea-4f7c-45cb-957e-d4abd0b4977d => generated 1501 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:30.420272 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-84fc94e5-943d-43dc-86e8-42a535aa478a tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:30.421193 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-84fc94e5-943d-43dc-86e8-42a535aa478a tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] [instance: dcb34439-de04-4a9c-b81b-7fb2360af99c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:30.428967 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-84fc94e5-943d-43dc-86e8-42a535aa478a tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:30.435484 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-84fc94e5-943d-43dc-86e8-42a535aa478a tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:30.435484 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-84fc94e5-943d-43dc-86e8-42a535aa478a tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:30.435484 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-84fc94e5-943d-43dc-86e8-42a535aa478a tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:30.435484 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-84fc94e5-943d-43dc-86e8-42a535aa478a tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:30.435484 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-84fc94e5-943d-43dc-86e8-42a535aa478a tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:30.442584 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-755dd48d-83e1-4579-a85d-3140d9d5566a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:25:30.443389 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-755dd48d-83e1-4579-a85d-3140d9d5566a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7d5101ea-4f7c-45cb-957e-d4abd0b4977d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:30.458254 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-755dd48d-83e1-4579-a85d-3140d9d5566a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:30.464282 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-755dd48d-83e1-4579-a85d-3140d9d5566a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:30.464282 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-755dd48d-83e1-4579-a85d-3140d9d5566a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:30.464282 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-755dd48d-83e1-4579-a85d-3140d9d5566a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:30.464282 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-755dd48d-83e1-4579-a85d-3140d9d5566a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:30.464282 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-755dd48d-83e1-4579-a85d-3140d9d5566a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:30.491435 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-84fc94e5-943d-43dc-86e8-42a535aa478a tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] HTTP exception thrown: Instance dcb34439-de04-4a9c-b81b-7fb2360af99c could not be found. Oct 30 01:25:30.491650 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-755dd48d-83e1-4579-a85d-3140d9d5566a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lazy-loading 'flavor' on Instance uuid 7d5101ea-4f7c-45cb-957e-d4abd0b4977d {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-84fc94e5-943d-43dc-86e8-42a535aa478a tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Request method failure captured: Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/dcb34439-de04-4a9c-b81b-7fb2360af99c HTTP/1.1 Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdHDa0KxdwMIsTBNwbRwD0b4eo-yN2Wj3hgbU0ofPT23gG_ao3TAkGtr7BNKNIO1I6AGnGJakPM-y3Rx7t8O6GAoli4XUa1RgSPXSPvyCEEhghfuro4OzaprzpMJvPZIZhp_IO-y6VrQmultf9b5aBafjyOZadMFvR24b1XkpqUo38w Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: d342baf2538340e292e44dfc622b86fc Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-696144334 Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d342baf2538340e292e44dfc622b86fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d342baf2538340e292e44dfc622b86fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d342baf2538340e292e44dfc622b86fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d342baf2538340e292e44dfc622b86fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-696144334 Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: d342baf2538340e292e44dfc622b86fc Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-696144334 Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-AttachSCSIVolumeTestJSON-696144334-project Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 94448bbc2f4a4efaa86792f1511ff15c Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-696144334-project Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: exception: Instance dcb34439-de04-4a9c-b81b-7fb2360af99c could not be found. Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'dcb34439-de04-4a9c-b81b-7fb2360af99c'} Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcb34439-de04-4a9c-b81b-7fb2360af99c could not be found. Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcb34439-de04-4a9c-b81b-7fb2360af99c could not be found. Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:30.497626 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:30.501757 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:30.501757 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:30.501757 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:30.501757 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:25:30.501757 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:25:30.501757 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcb34439-de04-4a9c-b81b-7fb2360af99c could not be found. Oct 30 01:25:30.501757 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:30.503893 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-84fc94e5-943d-43dc-86e8-42a535aa478a tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Returning 404 to user: Instance dcb34439-de04-4a9c-b81b-7fb2360af99c could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:25:30.504981 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-84fc94e5-943d-43dc-86e8-42a535aa478a tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] 10.222.0.13 "GET /compute/v2.1/servers/dcb34439-de04-4a9c-b81b-7fb2360af99c" status: 404 len: 111 microversion: 2.1 time: 0.091446 Oct 30 01:25:30.507989 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1386/2792] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:30 2022] GET /compute/v2.1/servers/dcb34439-de04-4a9c-b81b-7fb2360af99c => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:25:30.522255 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-31666dfd-d056-4d6d-a895-d959a0a86e5d tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Calling method '.version_select at 0x7f44d03589d0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:30.658698 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-31666dfd-d056-4d6d-a895-d959a0a86e5d tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1477187144" status: 202 len: 0 microversion: 2.1 time: 0.146449 Oct 30 01:25:30.665981 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1387/2793] 10.222.0.13 () {58 vars in 1221 bytes} [Sun Oct 30 01:25:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1477187144 => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:25:30.677654 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fed93a54-01d8-4985-8005-a79f2dadd72b tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:30.680678 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-fed93a54-01d8-4985-8005-a79f2dadd72b tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] [instance: 5c4bb439-785f-4ac3-a7fc-b9325b52fa19] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:30.694204 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fed93a54-01d8-4985-8005-a79f2dadd72b tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:30.697747 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fed93a54-01d8-4985-8005-a79f2dadd72b tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:30.699079 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fed93a54-01d8-4985-8005-a79f2dadd72b tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:30.700106 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fed93a54-01d8-4985-8005-a79f2dadd72b tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:30.701989 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fed93a54-01d8-4985-8005-a79f2dadd72b tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:30.703622 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fed93a54-01d8-4985-8005-a79f2dadd72b tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:30.829041 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-755dd48d-83e1-4579-a85d-3140d9d5566a tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "POST /compute/v2.1/servers/7d5101ea-4f7c-45cb-957e-d4abd0b4977d/action" status: 202 len: 0 microversion: 2.1 time: 0.390561 Oct 30 01:25:30.830644 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1407/2794] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:25:30 2022] POST /compute/v2.1/servers/7d5101ea-4f7c-45cb-957e-d4abd0b4977d/action => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 30 01:25:30.839811 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8f635915-cc2d-4acb-970c-a003459156e4 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:30.851063 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8f635915-cc2d-4acb-970c-a003459156e4 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] [instance: 5b5d5fa5-1e07-4145-b6c8-30e31de10165] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:30.854276 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:25:30.869364 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8f635915-cc2d-4acb-970c-a003459156e4 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:30.870523 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8f635915-cc2d-4acb-970c-a003459156e4 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:30.878532 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8f635915-cc2d-4acb-970c-a003459156e4 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:30.879491 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8f635915-cc2d-4acb-970c-a003459156e4 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:30.882762 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8f635915-cc2d-4acb-970c-a003459156e4 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:30.886044 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8f635915-cc2d-4acb-970c-a003459156e4 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:31.142334 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-fed93a54-01d8-4985-8005-a79f2dadd72b tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba44010e0ca4892b56886e2b1636f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13238008c06e49c3b088809143308a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:31.163119 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-fed93a54-01d8-4985-8005-a79f2dadd72b tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ba44010e0ca4892b56886e2b1636f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13238008c06e49c3b088809143308a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:31.166647 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-fed93a54-01d8-4985-8005-a79f2dadd72b tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ba44010e0ca4892b56886e2b1636f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13238008c06e49c3b088809143308a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:31.169578 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fed93a54-01d8-4985-8005-a79f2dadd72b tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] 10.222.0.13 "GET /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19" status: 200 len: 1362 microversion: 2.26 time: 0.501860 Oct 30 01:25:31.170388 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1388/2795] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:25:30 2022] GET /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19 => generated 1362 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:25:31.187494 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-a2974eff-5c75-4d6d-817c-9ed91f89e5f7 req-83a5f1db-c550-4510-ab91-70e98d4da699 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c4bb439-785f-4ac3-a7fc-b9325b52fa19", "tag": "9007c444-99ef-4bf4-866d-0088c0c5f618"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:25:31.205049 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-a2974eff-5c75-4d6d-817c-9ed91f89e5f7 req-83a5f1db-c550-4510-ab91-70e98d4da699 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:31.205697 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-a2974eff-5c75-4d6d-817c-9ed91f89e5f7 req-83a5f1db-c550-4510-ab91-70e98d4da699 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:31.206186 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-a2974eff-5c75-4d6d-817c-9ed91f89e5f7 req-83a5f1db-c550-4510-ab91-70e98d4da699 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:31.219571 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-a2974eff-5c75-4d6d-817c-9ed91f89e5f7 req-83a5f1db-c550-4510-ab91-70e98d4da699 service nova] Creating event network-changed:9007c444-99ef-4bf4-866d-0088c0c5f618 for instance 5c4bb439-785f-4ac3-a7fc-b9325b52fa19 on n-h2-master-1 Oct 30 01:25:31.230711 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-a2974eff-5c75-4d6d-817c-9ed91f89e5f7 req-83a5f1db-c550-4510-ab91-70e98d4da699 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051466 Oct 30 01:25:31.235933 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1389/2796] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:25:31.237700 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-48879c42-b10f-46a2-b0af-c7d066926eac tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44d0417820>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:31.322367 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-48879c42-b10f-46a2-b0af-c7d066926eac tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/10d86021-09d0-4f87-a249-2b033b1d6ae5" status: 200 len: 1412 microversion: 2.1 time: 0.088306 Oct 30 01:25:31.324408 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1390/2797] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:25:31 2022] GET /compute/v2.1/images/10d86021-09d0-4f87-a249-2b033b1d6ae5 => generated 1412 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:31.339765 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c037b72e-f444-4671-b939-edc911e5cd31 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '.version_select at 0x7f44d0475430>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:31.519519 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c037b72e-f444-4671-b939-edc911e5cd31 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "GET /compute/v2.1/images/50669d24-ab56-475f-8236-0ff19406f3eb" status: 200 len: 1424 microversion: 2.1 time: 0.193156 Oct 30 01:25:31.529954 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1391/2798] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:25:31 2022] GET /compute/v2.1/images/50669d24-ab56-475f-8236-0ff19406f3eb => generated 1424 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:31.536329 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-08bd5d36-9ed5-41eb-9807-557601576929 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:31.536510 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-08bd5d36-9ed5-41eb-9807-557601576929 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7d5101ea-4f7c-45cb-957e-d4abd0b4977d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:31.544853 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08bd5d36-9ed5-41eb-9807-557601576929 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:31.545868 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08bd5d36-9ed5-41eb-9807-557601576929 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:31.546470 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08bd5d36-9ed5-41eb-9807-557601576929 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:31.547395 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08bd5d36-9ed5-41eb-9807-557601576929 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:31.548065 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08bd5d36-9ed5-41eb-9807-557601576929 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:31.549305 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08bd5d36-9ed5-41eb-9807-557601576929 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:31.573112 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8f635915-cc2d-4acb-970c-a003459156e4 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc60a96037f438ebbaaa6d25661bfc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127b4f4e1e4b43ed856faee3c5d9d88d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:31.583892 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8f635915-cc2d-4acb-970c-a003459156e4 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] 10.222.0.13 "GET /compute/v2.1/servers/5b5d5fa5-1e07-4145-b6c8-30e31de10165" status: 200 len: 1325 microversion: 2.1 time: 0.751452 Oct 30 01:25:31.602605 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1408/2799] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:30 2022] GET /compute/v2.1/servers/5b5d5fa5-1e07-4145-b6c8-30e31de10165 => generated 1325 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:31.624792 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-33857b6b-4061-4988-ab8b-da35d86eb884 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:31.626625 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-33857b6b-4061-4988-ab8b-da35d86eb884 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: 64824cfc-200e-4ee1-8698-011b644ae315] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:31.648107 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-33857b6b-4061-4988-ab8b-da35d86eb884 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:31.651408 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-33857b6b-4061-4988-ab8b-da35d86eb884 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:31.657405 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-33857b6b-4061-4988-ab8b-da35d86eb884 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:31.658601 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-33857b6b-4061-4988-ab8b-da35d86eb884 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:31.660401 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-33857b6b-4061-4988-ab8b-da35d86eb884 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:31.662039 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-33857b6b-4061-4988-ab8b-da35d86eb884 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:31.993937 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-08bd5d36-9ed5-41eb-9807-557601576929 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:32.035142 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-08bd5d36-9ed5-41eb-9807-557601576929 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/7d5101ea-4f7c-45cb-957e-d4abd0b4977d" status: 200 len: 1509 microversion: 2.1 time: 0.488313 Oct 30 01:25:32.036861 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1392/2800] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:31 2022] GET /compute/v2.1/servers/7d5101ea-4f7c-45cb-957e-d4abd0b4977d => generated 1509 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:32.046961 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-33857b6b-4061-4988-ab8b-da35d86eb884 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07f2b8c31f54c62aaba73ca2bd2edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c59bd73c7874a00b52ec7c5c4142039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:32.057620 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-33857b6b-4061-4988-ab8b-da35d86eb884 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] 10.222.0.13 "GET /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315" status: 200 len: 1355 microversion: 2.1 time: 0.448208 Oct 30 01:25:32.100541 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1409/2801] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:31 2022] GET /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315 => generated 1355 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:32.203570 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5bd265fe-b49a-4707-951c-941877ea7cc5 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:32.205867 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5bd265fe-b49a-4707-951c-941877ea7cc5 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] [instance: 5c4bb439-785f-4ac3-a7fc-b9325b52fa19] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:32.213880 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5bd265fe-b49a-4707-951c-941877ea7cc5 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:32.215079 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5bd265fe-b49a-4707-951c-941877ea7cc5 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:32.215079 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5bd265fe-b49a-4707-951c-941877ea7cc5 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:32.217653 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5bd265fe-b49a-4707-951c-941877ea7cc5 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:32.217653 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5bd265fe-b49a-4707-951c-941877ea7cc5 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:32.217833 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5bd265fe-b49a-4707-951c-941877ea7cc5 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:32.340122 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-70091248-67ba-49ac-bad6-9202466b2a6b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44ccc85dc0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:32.375069 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5bd265fe-b49a-4707-951c-941877ea7cc5 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba44010e0ca4892b56886e2b1636f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13238008c06e49c3b088809143308a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:32.383579 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5bd265fe-b49a-4707-951c-941877ea7cc5 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ba44010e0ca4892b56886e2b1636f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13238008c06e49c3b088809143308a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:32.385105 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5bd265fe-b49a-4707-951c-941877ea7cc5 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ba44010e0ca4892b56886e2b1636f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13238008c06e49c3b088809143308a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:32.386288 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5bd265fe-b49a-4707-951c-941877ea7cc5 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] 10.222.0.13 "GET /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19" status: 200 len: 1362 microversion: 2.26 time: 0.193131 Oct 30 01:25:32.387074 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1393/2802] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:25:32 2022] GET /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19 => generated 1362 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:25:32.539554 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-935d8217-c5c1-4f8f-88f3-11bfc785afe3 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '.version_select at 0x7f44cc4e25e0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:32.650015 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-70091248-67ba-49ac-bad6-9202466b2a6b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/10d86021-09d0-4f87-a249-2b033b1d6ae5" status: 200 len: 1412 microversion: 2.1 time: 0.313498 Oct 30 01:25:32.665171 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1410/2803] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:25:32 2022] GET /compute/v2.1/images/10d86021-09d0-4f87-a249-2b033b1d6ae5 => generated 1412 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:25:32.667452 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f155909e-d781-4dbc-a30b-c14ff3f86b89 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:32.668400 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f155909e-d781-4dbc-a30b-c14ff3f86b89 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] [instance: 5b5d5fa5-1e07-4145-b6c8-30e31de10165] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:32.676715 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f155909e-d781-4dbc-a30b-c14ff3f86b89 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:32.677506 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f155909e-d781-4dbc-a30b-c14ff3f86b89 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:32.678127 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f155909e-d781-4dbc-a30b-c14ff3f86b89 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:32.679020 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f155909e-d781-4dbc-a30b-c14ff3f86b89 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:32.679793 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f155909e-d781-4dbc-a30b-c14ff3f86b89 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:32.680652 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f155909e-d781-4dbc-a30b-c14ff3f86b89 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:32.706452 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:25:33.187048 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f155909e-d781-4dbc-a30b-c14ff3f86b89 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc60a96037f438ebbaaa6d25661bfc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127b4f4e1e4b43ed856faee3c5d9d88d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:33.199211 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f155909e-d781-4dbc-a30b-c14ff3f86b89 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] 10.222.0.13 "GET /compute/v2.1/servers/5b5d5fa5-1e07-4145-b6c8-30e31de10165" status: 200 len: 1325 microversion: 2.1 time: 0.538986 Oct 30 01:25:33.202538 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1411/2804] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:32 2022] GET /compute/v2.1/servers/5b5d5fa5-1e07-4145-b6c8-30e31de10165 => generated 1325 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:33.222227 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-90dd109e-1515-49cb-ab0f-edaefa0e6f93 req-5206fce5-d161-42ba-9822-009d007ec4f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c6be996-7886-41c6-9c0c-e0f899836cb0", "name": "network-vif-plugged", "status": "completed", "tag": "aee42464-dca8-4339-bc2b-97369d928349"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:25:33.250683 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-90dd109e-1515-49cb-ab0f-edaefa0e6f93 req-5206fce5-d161-42ba-9822-009d007ec4f2 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:33.252026 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-90dd109e-1515-49cb-ab0f-edaefa0e6f93 req-5206fce5-d161-42ba-9822-009d007ec4f2 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:33.252026 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-90dd109e-1515-49cb-ab0f-edaefa0e6f93 req-5206fce5-d161-42ba-9822-009d007ec4f2 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:33.296810 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-90dd109e-1515-49cb-ab0f-edaefa0e6f93 req-5206fce5-d161-42ba-9822-009d007ec4f2 service nova] Creating event network-vif-plugged:aee42464-dca8-4339-bc2b-97369d928349 for instance 9c6be996-7886-41c6-9c0c-e0f899836cb0 on n-h2-master-1 Oct 30 01:25:33.307055 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-90dd109e-1515-49cb-ab0f-edaefa0e6f93 req-5206fce5-d161-42ba-9822-009d007ec4f2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103032 Oct 30 01:25:33.309876 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1412/2805] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:25:33.314720 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-15c81448-d7d4-4225-9e48-2be95f4ae5a7 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:33.315601 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-15c81448-d7d4-4225-9e48-2be95f4ae5a7 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7d5101ea-4f7c-45cb-957e-d4abd0b4977d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:33.325878 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-15c81448-d7d4-4225-9e48-2be95f4ae5a7 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:33.328949 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-15c81448-d7d4-4225-9e48-2be95f4ae5a7 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:33.329644 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-15c81448-d7d4-4225-9e48-2be95f4ae5a7 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:33.330667 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-15c81448-d7d4-4225-9e48-2be95f4ae5a7 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:33.331408 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-15c81448-d7d4-4225-9e48-2be95f4ae5a7 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:33.332086 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-15c81448-d7d4-4225-9e48-2be95f4ae5a7 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:33.599088 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-15c81448-d7d4-4225-9e48-2be95f4ae5a7 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:33.615441 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-15c81448-d7d4-4225-9e48-2be95f4ae5a7 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/7d5101ea-4f7c-45cb-957e-d4abd0b4977d" status: 200 len: 1492 microversion: 2.1 time: 0.306417 Oct 30 01:25:33.621062 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1413/2806] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:33 2022] GET /compute/v2.1/servers/7d5101ea-4f7c-45cb-957e-d4abd0b4977d => generated 1492 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:33.631898 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c52fddbc-518d-49b0-9bf4-b1f92cfa36eb tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:33.632668 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c52fddbc-518d-49b0-9bf4-b1f92cfa36eb tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: 64824cfc-200e-4ee1-8698-011b644ae315] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:33.669924 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c52fddbc-518d-49b0-9bf4-b1f92cfa36eb tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:33.674794 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c52fddbc-518d-49b0-9bf4-b1f92cfa36eb tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:33.674794 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c52fddbc-518d-49b0-9bf4-b1f92cfa36eb tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:33.680559 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c52fddbc-518d-49b0-9bf4-b1f92cfa36eb tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:33.685114 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c52fddbc-518d-49b0-9bf4-b1f92cfa36eb tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:33.685748 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c52fddbc-518d-49b0-9bf4-b1f92cfa36eb tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:34.037450 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c52fddbc-518d-49b0-9bf4-b1f92cfa36eb tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07f2b8c31f54c62aaba73ca2bd2edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c59bd73c7874a00b52ec7c5c4142039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:34.064773 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c52fddbc-518d-49b0-9bf4-b1f92cfa36eb tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] 10.222.0.13 "GET /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315" status: 200 len: 1355 microversion: 2.1 time: 0.442371 Oct 30 01:25:34.069125 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1414/2807] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:33 2022] GET /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315 => generated 1355 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:34.082080 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7f39329a-00e0-40a6-8567-bf17e59bee42 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:34.082949 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7f39329a-00e0-40a6-8567-bf17e59bee42 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] [instance: 5c4bb439-785f-4ac3-a7fc-b9325b52fa19] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:34.093755 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7f39329a-00e0-40a6-8567-bf17e59bee42 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:34.096175 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7f39329a-00e0-40a6-8567-bf17e59bee42 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:34.099669 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7f39329a-00e0-40a6-8567-bf17e59bee42 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:34.102049 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7f39329a-00e0-40a6-8567-bf17e59bee42 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:34.104571 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7f39329a-00e0-40a6-8567-bf17e59bee42 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:34.106632 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7f39329a-00e0-40a6-8567-bf17e59bee42 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:34.311086 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-935d8217-c5c1-4f8f-88f3-11bfc785afe3 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "GET /compute/v2.1/images/50669d24-ab56-475f-8236-0ff19406f3eb" status: 200 len: 1424 microversion: 2.1 time: 1.776669 Oct 30 01:25:34.332584 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1394/2808] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:25:32 2022] GET /compute/v2.1/images/50669d24-ab56-475f-8236-0ff19406f3eb => generated 1424 bytes in 1799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:34.355863 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1951a3a1-67e6-4c4e-809d-d911bc5ec2c2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:34.357415 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1951a3a1-67e6-4c4e-809d-d911bc5ec2c2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7d5101ea-4f7c-45cb-957e-d4abd0b4977d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:34.385652 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1951a3a1-67e6-4c4e-809d-d911bc5ec2c2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:34.403509 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1951a3a1-67e6-4c4e-809d-d911bc5ec2c2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:34.404474 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1951a3a1-67e6-4c4e-809d-d911bc5ec2c2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:34.405683 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1951a3a1-67e6-4c4e-809d-d911bc5ec2c2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:34.408254 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1951a3a1-67e6-4c4e-809d-d911bc5ec2c2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:34.410099 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1951a3a1-67e6-4c4e-809d-d911bc5ec2c2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:34.490894 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1951a3a1-67e6-4c4e-809d-d911bc5ec2c2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7d5101ea-4f7c-45cb-957e-d4abd0b4977d] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:25:34.502114 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7f39329a-00e0-40a6-8567-bf17e59bee42 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba44010e0ca4892b56886e2b1636f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13238008c06e49c3b088809143308a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:34.510612 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7f39329a-00e0-40a6-8567-bf17e59bee42 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ba44010e0ca4892b56886e2b1636f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13238008c06e49c3b088809143308a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:34.512061 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7f39329a-00e0-40a6-8567-bf17e59bee42 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ba44010e0ca4892b56886e2b1636f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13238008c06e49c3b088809143308a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:34.513287 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7f39329a-00e0-40a6-8567-bf17e59bee42 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] 10.222.0.13 "GET /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19" status: 200 len: 1362 microversion: 2.26 time: 0.442803 Oct 30 01:25:34.521571 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1415/2809] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:25:34 2022] GET /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19 => generated 1362 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:25:34.533265 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cd1b291e-5631-4ada-af5a-4405a22a1b0c tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44cca66700>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:34.920879 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1951a3a1-67e6-4c4e-809d-d911bc5ec2c2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7d5101ea-4f7c-45cb-957e-d4abd0b4977d" status: 204 len: 0 microversion: 2.1 time: 0.586539 Oct 30 01:25:34.921725 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1395/2810] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:25:34 2022] DELETE /compute/v2.1/servers/7d5101ea-4f7c-45cb-957e-d4abd0b4977d => generated 0 bytes in 588 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:25:34.929139 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-1c5c9e1a-8562-49c8-84ce-d22ae6aff315 req-de689b2c-6014-4c70-944d-59b9e3d305b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64824cfc-200e-4ee1-8698-011b644ae315", "tag": "ad034ad3-0acf-4013-9d50-4bd36d7d861f"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:25:34.941744 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:25:34.955763 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-1c5c9e1a-8562-49c8-84ce-d22ae6aff315 req-de689b2c-6014-4c70-944d-59b9e3d305b7 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:34.956534 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-1c5c9e1a-8562-49c8-84ce-d22ae6aff315 req-de689b2c-6014-4c70-944d-59b9e3d305b7 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:34.957147 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-1c5c9e1a-8562-49c8-84ce-d22ae6aff315 req-de689b2c-6014-4c70-944d-59b9e3d305b7 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:34.987675 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-1c5c9e1a-8562-49c8-84ce-d22ae6aff315 req-de689b2c-6014-4c70-944d-59b9e3d305b7 service nova] Creating event network-changed:ad034ad3-0acf-4013-9d50-4bd36d7d861f for instance 64824cfc-200e-4ee1-8698-011b644ae315 on n-h1-master-1 Oct 30 01:25:35.005219 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-1c5c9e1a-8562-49c8-84ce-d22ae6aff315 req-de689b2c-6014-4c70-944d-59b9e3d305b7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082244 Oct 30 01:25:35.005850 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1396/2811] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:25:35.011392 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f684eece-ba40-428a-aec0-a615008093c1 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:35.012913 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f684eece-ba40-428a-aec0-a615008093c1 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] [instance: 5b5d5fa5-1e07-4145-b6c8-30e31de10165] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:35.019816 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f684eece-ba40-428a-aec0-a615008093c1 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:35.020816 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f684eece-ba40-428a-aec0-a615008093c1 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:35.021498 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f684eece-ba40-428a-aec0-a615008093c1 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:35.022399 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f684eece-ba40-428a-aec0-a615008093c1 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:35.023126 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f684eece-ba40-428a-aec0-a615008093c1 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:35.023585 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f684eece-ba40-428a-aec0-a615008093c1 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:35.028161 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:25:35.238046 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f684eece-ba40-428a-aec0-a615008093c1 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc60a96037f438ebbaaa6d25661bfc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127b4f4e1e4b43ed856faee3c5d9d88d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:35.246495 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f684eece-ba40-428a-aec0-a615008093c1 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] 10.222.0.13 "GET /compute/v2.1/servers/5b5d5fa5-1e07-4145-b6c8-30e31de10165" status: 200 len: 1325 microversion: 2.1 time: 0.239143 Oct 30 01:25:35.263177 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1397/2812] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:35 2022] GET /compute/v2.1/servers/5b5d5fa5-1e07-4145-b6c8-30e31de10165 => generated 1325 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:35.448529 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5f3cab94-2a1c-48b3-8ceb-2c0ea3f5457a tempest-ImagesDeleteNegativeTestJSON-663913450 tempest-ImagesDeleteNegativeTestJSON-663913450-project] 10.222.0.13 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.183247 Oct 30 01:25:35.449167 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1398/2813] 10.222.0.13 () {58 vars in 1128 bytes} [Sun Oct 30 01:25:35 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 30 01:25:35.465210 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-748099c8-84cd-4886-b92f-2c3462810ac0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:35.466356 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-748099c8-84cd-4886-b92f-2c3462810ac0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7d5101ea-4f7c-45cb-957e-d4abd0b4977d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:35.482801 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-748099c8-84cd-4886-b92f-2c3462810ac0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:35.482801 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-748099c8-84cd-4886-b92f-2c3462810ac0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:35.482801 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-748099c8-84cd-4886-b92f-2c3462810ac0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:35.482801 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-748099c8-84cd-4886-b92f-2c3462810ac0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:35.482801 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-748099c8-84cd-4886-b92f-2c3462810ac0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:35.482801 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-748099c8-84cd-4886-b92f-2c3462810ac0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:35.629381 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-748099c8-84cd-4886-b92f-2c3462810ac0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:35.638056 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-748099c8-84cd-4886-b92f-2c3462810ac0 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/7d5101ea-4f7c-45cb-957e-d4abd0b4977d" status: 200 len: 1498 microversion: 2.1 time: 0.177855 Oct 30 01:25:35.639207 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1399/2814] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:35 2022] GET /compute/v2.1/servers/7d5101ea-4f7c-45cb-957e-d4abd0b4977d => generated 1498 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:35.643969 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-62ac4213-0edf-4ef9-a293-cb289ced4b6a tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:35.644863 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-62ac4213-0edf-4ef9-a293-cb289ced4b6a tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: 64824cfc-200e-4ee1-8698-011b644ae315] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:35.651695 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-62ac4213-0edf-4ef9-a293-cb289ced4b6a tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:35.652448 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-62ac4213-0edf-4ef9-a293-cb289ced4b6a tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:35.653615 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-62ac4213-0edf-4ef9-a293-cb289ced4b6a tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:35.654496 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-62ac4213-0edf-4ef9-a293-cb289ced4b6a tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:35.655129 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-62ac4213-0edf-4ef9-a293-cb289ced4b6a tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:35.655716 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-62ac4213-0edf-4ef9-a293-cb289ced4b6a tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:35.817675 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-62ac4213-0edf-4ef9-a293-cb289ced4b6a tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07f2b8c31f54c62aaba73ca2bd2edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c59bd73c7874a00b52ec7c5c4142039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:35.828035 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-62ac4213-0edf-4ef9-a293-cb289ced4b6a tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] 10.222.0.13 "GET /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315" status: 200 len: 1355 microversion: 2.1 time: 0.187638 Oct 30 01:25:35.828614 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1400/2815] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:35 2022] GET /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315 => generated 1355 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:35.835077 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-a90b43e8-1a5c-4e41-bcf9-377b23afbdd8 req-632d90b6-de09-49f5-ad26-dcb194f8a344 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b5d5fa5-1e07-4145-b6c8-30e31de10165", "name": "network-vif-plugged", "status": "completed", "tag": "3058ff4b-eaf6-419c-a4e9-7aed07c9af1f"}, {"server_uuid": "5c4bb439-785f-4ac3-a7fc-b9325b52fa19", "name": "network-vif-plugged", "status": "completed", "tag": "9007c444-99ef-4bf4-866d-0088c0c5f618"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:25:35.854446 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-a90b43e8-1a5c-4e41-bcf9-377b23afbdd8 req-632d90b6-de09-49f5-ad26-dcb194f8a344 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:35.854934 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-a90b43e8-1a5c-4e41-bcf9-377b23afbdd8 req-632d90b6-de09-49f5-ad26-dcb194f8a344 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:35.855364 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-a90b43e8-1a5c-4e41-bcf9-377b23afbdd8 req-632d90b6-de09-49f5-ad26-dcb194f8a344 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:35.875265 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-a90b43e8-1a5c-4e41-bcf9-377b23afbdd8 req-632d90b6-de09-49f5-ad26-dcb194f8a344 service nova] Creating event network-vif-plugged:3058ff4b-eaf6-419c-a4e9-7aed07c9af1f for instance 5b5d5fa5-1e07-4145-b6c8-30e31de10165 on n-h1-master-1 Oct 30 01:25:35.882498 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-a90b43e8-1a5c-4e41-bcf9-377b23afbdd8 req-632d90b6-de09-49f5-ad26-dcb194f8a344 service nova] Creating event network-vif-plugged:9007c444-99ef-4bf4-866d-0088c0c5f618 for instance 5c4bb439-785f-4ac3-a7fc-b9325b52fa19 on n-h2-master-1 Oct 30 01:25:35.901538 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-a90b43e8-1a5c-4e41-bcf9-377b23afbdd8 req-632d90b6-de09-49f5-ad26-dcb194f8a344 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.070109 Oct 30 01:25:35.902323 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1401/2816] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:25:35 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:25:35.908062 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-56e8d3bb-b8df-4ef0-8267-fdab5b29f375 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '.version_select at 0x7f44d0358040>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:36.509133 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cd1b291e-5631-4ada-af5a-4405a22a1b0c tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/10d86021-09d0-4f87-a249-2b033b1d6ae5" status: 200 len: 1421 microversion: 2.1 time: 1.988025 Oct 30 01:25:36.509761 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1416/2817] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:25:34 2022] GET /compute/v2.1/images/10d86021-09d0-4f87-a249-2b033b1d6ae5 => generated 1421 bytes in 1989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:36.526045 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-56e8d3bb-b8df-4ef0-8267-fdab5b29f375 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "GET /compute/v2.1/images/50669d24-ab56-475f-8236-0ff19406f3eb" status: 200 len: 1424 microversion: 2.1 time: 0.621920 Oct 30 01:25:36.529108 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1402/2818] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:25:35 2022] GET /compute/v2.1/images/50669d24-ab56-475f-8236-0ff19406f3eb => generated 1424 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:36.535043 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1870a3b0-f454-4b04-83a2-afb2cdcd3bf1 tempest-ImagesDeleteNegativeTestJSON-663913450 tempest-ImagesDeleteNegativeTestJSON-663913450-project] Calling method '.version_select at 0x7f44cc6229d0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:36.541007 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7ba5874f-1394-43e3-9677-759c91980009 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:36.544834 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7ba5874f-1394-43e3-9677-759c91980009 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] [instance: 5c4bb439-785f-4ac3-a7fc-b9325b52fa19] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:36.560022 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-1870a3b0-f454-4b04-83a2-afb2cdcd3bf1 tempest-ImagesDeleteNegativeTestJSON-663913450 tempest-ImagesDeleteNegativeTestJSON-663913450-project] HTTP exception thrown: Image not found. Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1870a3b0-f454-4b04-83a2-afb2cdcd3bf1 tempest-ImagesDeleteNegativeTestJSON-663913450 tempest-ImagesDeleteNegativeTestJSON-663913450-project] Request method failure captured: Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdKOsi5hHvUVj2daat7tNOt05C1tTAq-bAIefSuFO19jDioXrdm-QD7N6iJDpfNbe8mrq6PwQzMLP16EWN9sKh4is8eTNGtwACzXjkF8Qf7on0wj4jBXu3jkbTUBGfOuA5_xfPx74hSFt82ru5T6waacIUickPTH7Mvkpw5bnD1jzzg Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: e2f98e4ed02649349d7c9cc7594e0271 Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-663913450 Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e2f98e4ed02649349d7c9cc7594e0271"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e2f98e4ed02649349d7c9cc7594e0271"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e2f98e4ed02649349d7c9cc7594e0271"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e2f98e4ed02649349d7c9cc7594e0271"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-663913450 Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: e2f98e4ed02649349d7c9cc7594e0271 Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-663913450 Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ImagesDeleteNegativeTestJSON-663913450-project Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 9089245594d14035a23f468e21099983 Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-663913450-project Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: method: Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: exception: Image not found. Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '-1'} Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:36.561970 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:36.568114 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:36.568114 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:36.568114 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:25:36.568114 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:25:36.568114 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:25:36.568114 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:25:36.568114 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:25:36.568114 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:25:36.568114 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 30 01:25:36.568114 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 30 01:25:36.568114 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 30 01:25:36.568114 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:36.568114 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:36.568114 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:36.568114 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:36.568114 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:36.568114 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:36.568114 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:25:36.568114 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:25:36.568114 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 30 01:25:36.568114 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:36.568114 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1870a3b0-f454-4b04-83a2-afb2cdcd3bf1 tempest-ImagesDeleteNegativeTestJSON-663913450 tempest-ImagesDeleteNegativeTestJSON-663913450-project] Returning 404 to user: Image not found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:25:36.568114 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1870a3b0-f454-4b04-83a2-afb2cdcd3bf1 tempest-ImagesDeleteNegativeTestJSON-663913450 tempest-ImagesDeleteNegativeTestJSON-663913450-project] 10.222.0.13 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.052704 Oct 30 01:25:36.571810 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1417/2819] 10.222.0.13 () {58 vars in 1134 bytes} [Sun Oct 30 01:25:36 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:25:36.573268 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7ba5874f-1394-43e3-9677-759c91980009 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:36.574154 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7ba5874f-1394-43e3-9677-759c91980009 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:36.578406 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7ba5874f-1394-43e3-9677-759c91980009 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:36.579176 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7ba5874f-1394-43e3-9677-759c91980009 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:36.579655 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7ba5874f-1394-43e3-9677-759c91980009 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:36.580087 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7ba5874f-1394-43e3-9677-759c91980009 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:36.583647 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bdba232c-4769-4457-8ee0-8f42b5d6eae6 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:36.585152 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bdba232c-4769-4457-8ee0-8f42b5d6eae6 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] [instance: 5b5d5fa5-1e07-4145-b6c8-30e31de10165] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:36.595221 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bdba232c-4769-4457-8ee0-8f42b5d6eae6 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:36.596207 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bdba232c-4769-4457-8ee0-8f42b5d6eae6 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:36.596883 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bdba232c-4769-4457-8ee0-8f42b5d6eae6 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:36.597896 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bdba232c-4769-4457-8ee0-8f42b5d6eae6 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:36.598591 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bdba232c-4769-4457-8ee0-8f42b5d6eae6 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:36.599234 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bdba232c-4769-4457-8ee0-8f42b5d6eae6 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:37.212596 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bdba232c-4769-4457-8ee0-8f42b5d6eae6 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc60a96037f438ebbaaa6d25661bfc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127b4f4e1e4b43ed856faee3c5d9d88d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:37.229273 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7ba5874f-1394-43e3-9677-759c91980009 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba44010e0ca4892b56886e2b1636f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13238008c06e49c3b088809143308a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:37.248486 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bdba232c-4769-4457-8ee0-8f42b5d6eae6 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] 10.222.0.13 "GET /compute/v2.1/servers/5b5d5fa5-1e07-4145-b6c8-30e31de10165" status: 200 len: 1325 microversion: 2.1 time: 0.665077 Oct 30 01:25:37.250311 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1418/2820] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:36 2022] GET /compute/v2.1/servers/5b5d5fa5-1e07-4145-b6c8-30e31de10165 => generated 1325 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:37.254338 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7ba5874f-1394-43e3-9677-759c91980009 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ba44010e0ca4892b56886e2b1636f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13238008c06e49c3b088809143308a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:37.256276 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7ba5874f-1394-43e3-9677-759c91980009 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ba44010e0ca4892b56886e2b1636f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13238008c06e49c3b088809143308a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:37.260691 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4825e1bc-4c6c-4eda-935f-914c54c95bd3 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44cc609160>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:37.261205 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7ba5874f-1394-43e3-9677-759c91980009 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] 10.222.0.13 "GET /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19" status: 200 len: 1362 microversion: 2.26 time: 0.728593 Oct 30 01:25:37.263914 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1403/2821] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:25:36 2022] GET /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19 => generated 1362 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:25:37.273357 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-adc4ffea-a4b3-4ded-8443-6c13092ebdf3 tempest-ImagesDeleteNegativeTestJSON-663913450 tempest-ImagesDeleteNegativeTestJSON-663913450-project] Calling method '.version_select at 0x7f44d0417700>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:37.380970 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-adc4ffea-a4b3-4ded-8443-6c13092ebdf3 tempest-ImagesDeleteNegativeTestJSON-663913450 tempest-ImagesDeleteNegativeTestJSON-663913450-project] HTTP exception thrown: Image not found. Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-adc4ffea-a4b3-4ded-8443-6c13092ebdf3 tempest-ImagesDeleteNegativeTestJSON-663913450 tempest-ImagesDeleteNegativeTestJSON-663913450-project] Request method failure captured: Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: request: DELETE /compute/v2.1/images/3c6bd3ef-11e2-4f2e-89c3-db4605b2b2fj HTTP/1.1 Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdKOsi5hHvUVj2daat7tNOt05C1tTAq-bAIefSuFO19jDioXrdm-QD7N6iJDpfNbe8mrq6PwQzMLP16EWN9sKh4is8eTNGtwACzXjkF8Qf7on0wj4jBXu3jkbTUBGfOuA5_xfPx74hSFt82ru5T6waacIUickPTH7Mvkpw5bnD1jzzg Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: e2f98e4ed02649349d7c9cc7594e0271 Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-663913450 Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e2f98e4ed02649349d7c9cc7594e0271"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e2f98e4ed02649349d7c9cc7594e0271"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e2f98e4ed02649349d7c9cc7594e0271"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e2f98e4ed02649349d7c9cc7594e0271"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-663913450 Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: e2f98e4ed02649349d7c9cc7594e0271 Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-663913450 Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ImagesDeleteNegativeTestJSON-663913450-project Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 9089245594d14035a23f468e21099983 Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-663913450-project Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: method: Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: exception: Image not found. Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '3c6bd3ef-11e2-4f2e-89c3-db4605b2b2fj'} Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 3c6bd3ef-11e2-4f2e-89c3-db4605b2b2fj to delete Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3c6bd3ef-11e2-4f2e-89c3-db4605b2b2fj could not be found. Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:37.383207 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:37.387241 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:37.387241 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:37.387241 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:37.387241 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:25:37.387241 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:25:37.387241 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:25:37.387241 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:25:37.387241 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:25:37.387241 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:25:37.387241 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 30 01:25:37.387241 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 30 01:25:37.387241 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 30 01:25:37.387241 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:37.387241 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:37.387241 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:37.387241 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:37.387241 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:37.387241 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:37.387241 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:25:37.387241 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:25:37.387241 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 30 01:25:37.387241 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:37.387241 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-adc4ffea-a4b3-4ded-8443-6c13092ebdf3 tempest-ImagesDeleteNegativeTestJSON-663913450 tempest-ImagesDeleteNegativeTestJSON-663913450-project] Returning 404 to user: Image not found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:25:37.387241 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-adc4ffea-a4b3-4ded-8443-6c13092ebdf3 tempest-ImagesDeleteNegativeTestJSON-663913450 tempest-ImagesDeleteNegativeTestJSON-663913450-project] 10.222.0.13 "DELETE /compute/v2.1/images/3c6bd3ef-11e2-4f2e-89c3-db4605b2b2fj" status: 404 len: 62 microversion: 2.1 time: 0.119507 Oct 30 01:25:37.387241 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1404/2822] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:37 2022] DELETE /compute/v2.1/images/3c6bd3ef-11e2-4f2e-89c3-db4605b2b2fj => generated 62 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:25:37.393913 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-de3958a1-9c86-4a13-b959-d4a4dffc64e5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:37.394548 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-de3958a1-9c86-4a13-b959-d4a4dffc64e5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7d5101ea-4f7c-45cb-957e-d4abd0b4977d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:37.413160 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de3958a1-9c86-4a13-b959-d4a4dffc64e5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:37.413697 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de3958a1-9c86-4a13-b959-d4a4dffc64e5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:37.414173 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de3958a1-9c86-4a13-b959-d4a4dffc64e5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:37.414897 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de3958a1-9c86-4a13-b959-d4a4dffc64e5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:37.415359 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de3958a1-9c86-4a13-b959-d4a4dffc64e5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:37.415827 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de3958a1-9c86-4a13-b959-d4a4dffc64e5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:37.426041 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4825e1bc-4c6c-4eda-935f-914c54c95bd3 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/10d86021-09d0-4f87-a249-2b033b1d6ae5" status: 200 len: 1421 microversion: 2.1 time: 0.171695 Oct 30 01:25:37.426727 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1419/2823] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:25:37 2022] GET /compute/v2.1/images/10d86021-09d0-4f87-a249-2b033b1d6ae5 => generated 1421 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:37.452430 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5af172f8-94a4-4891-acd8-43bf21139167 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:37.457377 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5af172f8-94a4-4891-acd8-43bf21139167 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: 64824cfc-200e-4ee1-8698-011b644ae315] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:37.482533 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5af172f8-94a4-4891-acd8-43bf21139167 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:37.483314 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5af172f8-94a4-4891-acd8-43bf21139167 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:37.483940 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5af172f8-94a4-4891-acd8-43bf21139167 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:37.484830 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5af172f8-94a4-4891-acd8-43bf21139167 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:37.485472 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5af172f8-94a4-4891-acd8-43bf21139167 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:37.486075 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5af172f8-94a4-4891-acd8-43bf21139167 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:38.226615 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-de3958a1-9c86-4a13-b959-d4a4dffc64e5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33691c943ec040ddb04b6648b6e945ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c95e97cd7e4461682b9028abb568dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:38.240200 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-de3958a1-9c86-4a13-b959-d4a4dffc64e5 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/7d5101ea-4f7c-45cb-957e-d4abd0b4977d" status: 200 len: 1498 microversion: 2.1 time: 0.853233 Oct 30 01:25:38.240950 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1405/2824] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:37 2022] GET /compute/v2.1/servers/7d5101ea-4f7c-45cb-957e-d4abd0b4977d => generated 1498 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:38.251914 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-ec73912e-b93e-4df1-ab91-021019110ea3 req-dc9bfb28-3fc9-4f4c-9a69-e128783fe45e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64824cfc-200e-4ee1-8698-011b644ae315", "tag": "66ae55c7-072f-4808-989d-0c0cc7aaf4fb"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:25:38.270787 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ec73912e-b93e-4df1-ab91-021019110ea3 req-dc9bfb28-3fc9-4f4c-9a69-e128783fe45e service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:38.272187 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ec73912e-b93e-4df1-ab91-021019110ea3 req-dc9bfb28-3fc9-4f4c-9a69-e128783fe45e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:38.274769 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ec73912e-b93e-4df1-ab91-021019110ea3 req-dc9bfb28-3fc9-4f4c-9a69-e128783fe45e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:38.280009 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5af172f8-94a4-4891-acd8-43bf21139167 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07f2b8c31f54c62aaba73ca2bd2edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c59bd73c7874a00b52ec7c5c4142039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:38.289091 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-ec73912e-b93e-4df1-ab91-021019110ea3 req-dc9bfb28-3fc9-4f4c-9a69-e128783fe45e service nova] Creating event network-changed:66ae55c7-072f-4808-989d-0c0cc7aaf4fb for instance 64824cfc-200e-4ee1-8698-011b644ae315 on n-h1-master-1 Oct 30 01:25:38.292966 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5af172f8-94a4-4891-acd8-43bf21139167 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] 10.222.0.13 "GET /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315" status: 200 len: 1355 microversion: 2.1 time: 0.862054 Oct 30 01:25:38.295528 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1420/2825] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:37 2022] GET /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315 => generated 1355 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:38.303491 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f14a4261-23ce-43b1-8569-a35fe955cb4f tempest-ImagesDeleteNegativeTestJSON-663913450 tempest-ImagesDeleteNegativeTestJSON-663913450-project] Calling method '.version_select at 0x7f44cc557040>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:38.323227 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-ec73912e-b93e-4df1-ab91-021019110ea3 req-dc9bfb28-3fc9-4f4c-9a69-e128783fe45e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079168 Oct 30 01:25:38.325289 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1406/2826] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:25:38.333176 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cee10fa1-f344-42dd-9b31-3fc34210bde1 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44d0369a60>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:38.333702 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-f14a4261-23ce-43b1-8569-a35fe955cb4f tempest-ImagesDeleteNegativeTestJSON-663913450 tempest-ImagesDeleteNegativeTestJSON-663913450-project] HTTP exception thrown: Image not found. Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f14a4261-23ce-43b1-8569-a35fe955cb4f tempest-ImagesDeleteNegativeTestJSON-663913450 tempest-ImagesDeleteNegativeTestJSON-663913450-project] Request method failure captured: Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/images/7daeb399-3188-4930-9eb6-95e279653fa21 HTTP/1.1 Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdKOsi5hHvUVj2daat7tNOt05C1tTAq-bAIefSuFO19jDioXrdm-QD7N6iJDpfNbe8mrq6PwQzMLP16EWN9sKh4is8eTNGtwACzXjkF8Qf7on0wj4jBXu3jkbTUBGfOuA5_xfPx74hSFt82ru5T6waacIUickPTH7Mvkpw5bnD1jzzg Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: e2f98e4ed02649349d7c9cc7594e0271 Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-663913450 Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e2f98e4ed02649349d7c9cc7594e0271"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e2f98e4ed02649349d7c9cc7594e0271"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e2f98e4ed02649349d7c9cc7594e0271"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e2f98e4ed02649349d7c9cc7594e0271"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-663913450 Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: e2f98e4ed02649349d7c9cc7594e0271 Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-663913450 Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ImagesDeleteNegativeTestJSON-663913450-project Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 9089245594d14035a23f468e21099983 Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-663913450-project Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: method: Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: exception: Image not found. Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '7daeb399-3188-4930-9eb6-95e279653fa21'} Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 7daeb399-3188-4930-9eb6-95e279653fa21 to delete Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7daeb399-3188-4930-9eb6-95e279653fa21 could not be found. Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:38.335528 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:38.342808 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:38.342808 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:38.342808 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:38.342808 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:25:38.342808 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:25:38.342808 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:25:38.342808 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:25:38.342808 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:25:38.342808 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:25:38.342808 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 30 01:25:38.342808 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 30 01:25:38.342808 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 30 01:25:38.342808 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:38.342808 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:38.342808 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:38.342808 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:38.342808 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:38.342808 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:38.342808 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:25:38.342808 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:25:38.342808 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 30 01:25:38.342808 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:38.342808 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f14a4261-23ce-43b1-8569-a35fe955cb4f tempest-ImagesDeleteNegativeTestJSON-663913450 tempest-ImagesDeleteNegativeTestJSON-663913450-project] Returning 404 to user: Image not found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:25:38.342808 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f14a4261-23ce-43b1-8569-a35fe955cb4f tempest-ImagesDeleteNegativeTestJSON-663913450 tempest-ImagesDeleteNegativeTestJSON-663913450-project] 10.222.0.13 "DELETE /compute/v2.1/images/7daeb399-3188-4930-9eb6-95e279653fa21" status: 404 len: 62 microversion: 2.1 time: 0.039601 Oct 30 01:25:38.342808 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1421/2827] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:25:38 2022] DELETE /compute/v2.1/images/7daeb399-3188-4930-9eb6-95e279653fa21 => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:25:38.347562 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5291b506-d3ca-42be-899b-52d9e9a0906e tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '.version_select at 0x7f44c7ea95e0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:39.992021 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cee10fa1-f344-42dd-9b31-3fc34210bde1 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "DELETE /compute/v2.1/images/10d86021-09d0-4f87-a249-2b033b1d6ae5" status: 204 len: 0 microversion: 2.1 time: 1.664888 Oct 30 01:25:39.993546 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1407/2828] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:38 2022] DELETE /compute/v2.1/images/10d86021-09d0-4f87-a249-2b033b1d6ae5 => generated 0 bytes in 1667 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:25:39.998711 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-6b95c47b-de8e-4947-bf5d-b10eca942de2 req-661583bb-eb21-427a-ab3f-aa9ce9753e2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64824cfc-200e-4ee1-8698-011b644ae315", "tag": "ade8fcd2-9810-47b4-a0b0-468ebf236d36"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:25:40.011584 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5291b506-d3ca-42be-899b-52d9e9a0906e tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "GET /compute/v2.1/images/50669d24-ab56-475f-8236-0ff19406f3eb" status: 200 len: 1424 microversion: 2.1 time: 1.672518 Oct 30 01:25:40.013150 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1422/2829] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:25:38 2022] GET /compute/v2.1/images/50669d24-ab56-475f-8236-0ff19406f3eb => generated 1424 bytes in 1675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:40.024069 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8b1fab53-285f-4d75-9beb-67f0ad64b7ea tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:40.024778 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8b1fab53-285f-4d75-9beb-67f0ad64b7ea tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] [instance: 5b5d5fa5-1e07-4145-b6c8-30e31de10165] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:40.038095 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-6b95c47b-de8e-4947-bf5d-b10eca942de2 req-661583bb-eb21-427a-ab3f-aa9ce9753e2d service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:40.038596 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-6b95c47b-de8e-4947-bf5d-b10eca942de2 req-661583bb-eb21-427a-ab3f-aa9ce9753e2d service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:40.050852 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-6b95c47b-de8e-4947-bf5d-b10eca942de2 req-661583bb-eb21-427a-ab3f-aa9ce9753e2d service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:40.054899 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b1fab53-285f-4d75-9beb-67f0ad64b7ea tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:40.058576 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b1fab53-285f-4d75-9beb-67f0ad64b7ea tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:40.062918 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b1fab53-285f-4d75-9beb-67f0ad64b7ea tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:40.062918 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b1fab53-285f-4d75-9beb-67f0ad64b7ea tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:40.062918 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b1fab53-285f-4d75-9beb-67f0ad64b7ea tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:40.068249 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b1fab53-285f-4d75-9beb-67f0ad64b7ea tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:40.102448 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-6b95c47b-de8e-4947-bf5d-b10eca942de2 req-661583bb-eb21-427a-ab3f-aa9ce9753e2d service nova] Creating event network-changed:ade8fcd2-9810-47b4-a0b0-468ebf236d36 for instance 64824cfc-200e-4ee1-8698-011b644ae315 on n-h1-master-1 Oct 30 01:25:40.119059 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-6b95c47b-de8e-4947-bf5d-b10eca942de2 req-661583bb-eb21-427a-ab3f-aa9ce9753e2d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124039 Oct 30 01:25:40.122001 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1408/2830] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:25:40.136053 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6490c1a9-0da5-4af9-9cfb-3b0eb63e378e tempest-ImagesDeleteNegativeTestJSON-663913450 tempest-ImagesDeleteNegativeTestJSON-663913450-project] Calling method '.version_select at 0x7f44d04a98b0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:40.171580 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-6490c1a9-0da5-4af9-9cfb-3b0eb63e378e tempest-ImagesDeleteNegativeTestJSON-663913450 tempest-ImagesDeleteNegativeTestJSON-663913450-project] HTTP exception thrown: Image not found. Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6490c1a9-0da5-4af9-9cfb-3b0eb63e378e tempest-ImagesDeleteNegativeTestJSON-663913450 tempest-ImagesDeleteNegativeTestJSON-663913450-project] Request method failure captured: Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: request: DELETE /compute/v2.1/images/tempest-invalid-1021005605 HTTP/1.1 Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdKOsi5hHvUVj2daat7tNOt05C1tTAq-bAIefSuFO19jDioXrdm-QD7N6iJDpfNbe8mrq6PwQzMLP16EWN9sKh4is8eTNGtwACzXjkF8Qf7on0wj4jBXu3jkbTUBGfOuA5_xfPx74hSFt82ru5T6waacIUickPTH7Mvkpw5bnD1jzzg Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: e2f98e4ed02649349d7c9cc7594e0271 Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-663913450 Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e2f98e4ed02649349d7c9cc7594e0271"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e2f98e4ed02649349d7c9cc7594e0271"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e2f98e4ed02649349d7c9cc7594e0271"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e2f98e4ed02649349d7c9cc7594e0271"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-663913450 Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: e2f98e4ed02649349d7c9cc7594e0271 Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-663913450 Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ImagesDeleteNegativeTestJSON-663913450-project Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 9089245594d14035a23f468e21099983 Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-663913450-project Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: method: Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: exception: Image not found. Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'tempest-invalid-1021005605'} Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1021005605 to delete Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1021005605 could not be found. Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:40.173903 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:40.177705 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:40.177705 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:40.177705 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:25:40.177705 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:25:40.177705 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:25:40.177705 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:25:40.177705 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:25:40.177705 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:25:40.177705 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 30 01:25:40.177705 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 30 01:25:40.177705 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 30 01:25:40.177705 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:40.177705 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:40.177705 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:40.177705 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:40.177705 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:40.177705 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:40.177705 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:25:40.177705 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:25:40.177705 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 30 01:25:40.177705 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:40.177705 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6490c1a9-0da5-4af9-9cfb-3b0eb63e378e tempest-ImagesDeleteNegativeTestJSON-663913450 tempest-ImagesDeleteNegativeTestJSON-663913450-project] Returning 404 to user: Image not found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:25:40.177705 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6490c1a9-0da5-4af9-9cfb-3b0eb63e378e tempest-ImagesDeleteNegativeTestJSON-663913450 tempest-ImagesDeleteNegativeTestJSON-663913450-project] 10.222.0.13 "DELETE /compute/v2.1/images/tempest-invalid-1021005605" status: 404 len: 62 microversion: 2.1 time: 0.052397 Oct 30 01:25:40.177705 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1409/2831] 10.222.0.13 () {58 vars in 1206 bytes} [Sun Oct 30 01:25:40 2022] DELETE /compute/v2.1/images/tempest-invalid-1021005605 => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:25:40.191553 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0cffc84d-b26c-4882-b444-269ed14c05ed tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:40.194737 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0cffc84d-b26c-4882-b444-269ed14c05ed tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] [instance: 5c4bb439-785f-4ac3-a7fc-b9325b52fa19] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:40.220064 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0cffc84d-b26c-4882-b444-269ed14c05ed tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:40.220568 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0cffc84d-b26c-4882-b444-269ed14c05ed tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:40.221010 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0cffc84d-b26c-4882-b444-269ed14c05ed tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:40.221770 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0cffc84d-b26c-4882-b444-269ed14c05ed tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:40.222231 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0cffc84d-b26c-4882-b444-269ed14c05ed tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:40.222669 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0cffc84d-b26c-4882-b444-269ed14c05ed tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:40.396436 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8b1fab53-285f-4d75-9beb-67f0ad64b7ea tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc60a96037f438ebbaaa6d25661bfc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127b4f4e1e4b43ed856faee3c5d9d88d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:40.405813 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8b1fab53-285f-4d75-9beb-67f0ad64b7ea tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] 10.222.0.13 "GET /compute/v2.1/servers/5b5d5fa5-1e07-4145-b6c8-30e31de10165" status: 200 len: 1522 microversion: 2.1 time: 0.390215 Oct 30 01:25:40.422581 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1423/2832] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:40 2022] GET /compute/v2.1/servers/5b5d5fa5-1e07-4145-b6c8-30e31de10165 => generated 1522 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:40.430493 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ff75f2f6-f814-495d-84a2-ebbe5e72d4c4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:40.431350 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ff75f2f6-f814-495d-84a2-ebbe5e72d4c4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7d5101ea-4f7c-45cb-957e-d4abd0b4977d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:40.438299 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ff75f2f6-f814-495d-84a2-ebbe5e72d4c4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:40.439001 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ff75f2f6-f814-495d-84a2-ebbe5e72d4c4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:40.439594 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ff75f2f6-f814-495d-84a2-ebbe5e72d4c4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:40.440503 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ff75f2f6-f814-495d-84a2-ebbe5e72d4c4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:40.441118 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ff75f2f6-f814-495d-84a2-ebbe5e72d4c4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:40.441719 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ff75f2f6-f814-495d-84a2-ebbe5e72d4c4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:40.457911 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-ff75f2f6-f814-495d-84a2-ebbe5e72d4c4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] HTTP exception thrown: Instance 7d5101ea-4f7c-45cb-957e-d4abd0b4977d could not be found. Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ff75f2f6-f814-495d-84a2-ebbe5e72d4c4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Request method failure captured: Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/7d5101ea-4f7c-45cb-957e-d4abd0b4977d HTTP/1.1 Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdEZHAwNEyYVN8mbZetD1IgknrDb-nJfmTHtgPgtOr9AeQL99EuTYclSviV8aikzXcemJ-XkTVClxHn6U4xG48gAdXZcIs0fYa7Kdvvi7PzFjDxYMfOtgAp7wAvvVW7kd-J_XMzQX3yJBWm7NW5-QhmguztBnHz9UniQWs2CmNftHaI Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 8c95e97cd7e4461682b9028abb568dce Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 8c95e97cd7e4461682b9028abb568dce Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-DeleteServersTestJSON-1379968241-project Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 33691c943ec040ddb04b6648b6e945ab Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-DeleteServersTestJSON-1379968241-project Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 7d5101ea-4f7c-45cb-957e-d4abd0b4977d could not be found. Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '7d5101ea-4f7c-45cb-957e-d4abd0b4977d'} Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d5101ea-4f7c-45cb-957e-d4abd0b4977d could not be found. Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d5101ea-4f7c-45cb-957e-d4abd0b4977d could not be found. Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:40.463199 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:40.467479 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:40.467479 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:40.467479 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:40.467479 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:25:40.467479 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:25:40.467479 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d5101ea-4f7c-45cb-957e-d4abd0b4977d could not be found. Oct 30 01:25:40.467479 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:40.469292 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ff75f2f6-f814-495d-84a2-ebbe5e72d4c4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Returning 404 to user: Instance 7d5101ea-4f7c-45cb-957e-d4abd0b4977d could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:25:40.470399 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ff75f2f6-f814-495d-84a2-ebbe5e72d4c4 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/7d5101ea-4f7c-45cb-957e-d4abd0b4977d" status: 404 len: 111 microversion: 2.1 time: 0.046516 Oct 30 01:25:40.473951 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1424/2833] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:40 2022] GET /compute/v2.1/servers/7d5101ea-4f7c-45cb-957e-d4abd0b4977d => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:25:40.483761 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9330d428-2501-4105-bc9f-e6ded1f396df tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:40.487214 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9330d428-2501-4105-bc9f-e6ded1f396df tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: 64824cfc-200e-4ee1-8698-011b644ae315] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:40.492499 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9330d428-2501-4105-bc9f-e6ded1f396df tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:40.493229 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9330d428-2501-4105-bc9f-e6ded1f396df tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:40.493897 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9330d428-2501-4105-bc9f-e6ded1f396df tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:40.495334 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9330d428-2501-4105-bc9f-e6ded1f396df tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:40.496020 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9330d428-2501-4105-bc9f-e6ded1f396df tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:40.497156 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9330d428-2501-4105-bc9f-e6ded1f396df tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:40.504625 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0cffc84d-b26c-4882-b444-269ed14c05ed tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba44010e0ca4892b56886e2b1636f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13238008c06e49c3b088809143308a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:40.521834 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0cffc84d-b26c-4882-b444-269ed14c05ed tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ba44010e0ca4892b56886e2b1636f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13238008c06e49c3b088809143308a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:40.523364 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0cffc84d-b26c-4882-b444-269ed14c05ed tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ba44010e0ca4892b56886e2b1636f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13238008c06e49c3b088809143308a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:40.533528 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0cffc84d-b26c-4882-b444-269ed14c05ed tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] 10.222.0.13 "GET /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19" status: 200 len: 1545 microversion: 2.26 time: 0.342872 Oct 30 01:25:40.533528 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1410/2834] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:25:40 2022] GET /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19 => generated 1545 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:25:40.542160 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e3bc955f-fee7-4311-8a46-40ea3eaa36d1 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:40.545945 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e3bc955f-fee7-4311-8a46-40ea3eaa36d1 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: 403e0292-c082-4655-ad08-b5dc3a7f8305] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:40.560399 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e3bc955f-fee7-4311-8a46-40ea3eaa36d1 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:40.561632 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e3bc955f-fee7-4311-8a46-40ea3eaa36d1 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:40.562300 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e3bc955f-fee7-4311-8a46-40ea3eaa36d1 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:40.577191 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e3bc955f-fee7-4311-8a46-40ea3eaa36d1 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:40.581797 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e3bc955f-fee7-4311-8a46-40ea3eaa36d1 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:40.582278 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e3bc955f-fee7-4311-8a46-40ea3eaa36d1 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:40.644872 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e3bc955f-fee7-4311-8a46-40ea3eaa36d1 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: 403e0292-c082-4655-ad08-b5dc3a7f8305] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:25:40.801154 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9330d428-2501-4105-bc9f-e6ded1f396df tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07f2b8c31f54c62aaba73ca2bd2edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c59bd73c7874a00b52ec7c5c4142039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:40.810937 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9330d428-2501-4105-bc9f-e6ded1f396df tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] 10.222.0.13 "GET /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315" status: 200 len: 1355 microversion: 2.1 time: 0.335621 Oct 30 01:25:40.811523 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1425/2835] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:40 2022] GET /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315 => generated 1355 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:40.816623 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-565c46a5-a7a6-4238-b044-3fb8809750be tempest-ImagesDeleteNegativeTestJSON-663913450 tempest-ImagesDeleteNegativeTestJSON-663913450-project] Calling method '.version_select at 0x7f44d03f54c0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:40.854758 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-565c46a5-a7a6-4238-b044-3fb8809750be tempest-ImagesDeleteNegativeTestJSON-663913450 tempest-ImagesDeleteNegativeTestJSON-663913450-project] HTTP exception thrown: Image not found. Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-565c46a5-a7a6-4238-b044-3fb8809750be tempest-ImagesDeleteNegativeTestJSON-663913450 tempest-ImagesDeleteNegativeTestJSON-663913450-project] Request method failure captured: Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/images/2464022f-f34c-4422-ae9e-73573f22386e HTTP/1.1 Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdKOsi5hHvUVj2daat7tNOt05C1tTAq-bAIefSuFO19jDioXrdm-QD7N6iJDpfNbe8mrq6PwQzMLP16EWN9sKh4is8eTNGtwACzXjkF8Qf7on0wj4jBXu3jkbTUBGfOuA5_xfPx74hSFt82ru5T6waacIUickPTH7Mvkpw5bnD1jzzg Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: e2f98e4ed02649349d7c9cc7594e0271 Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-663913450 Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e2f98e4ed02649349d7c9cc7594e0271"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e2f98e4ed02649349d7c9cc7594e0271"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e2f98e4ed02649349d7c9cc7594e0271"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e2f98e4ed02649349d7c9cc7594e0271"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-663913450 Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: e2f98e4ed02649349d7c9cc7594e0271 Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-663913450 Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ImagesDeleteNegativeTestJSON-663913450-project Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 9089245594d14035a23f468e21099983 Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-663913450-project Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: method: Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: exception: Image not found. Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '2464022f-f34c-4422-ae9e-73573f22386e'} Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 2464022f-f34c-4422-ae9e-73573f22386e to delete Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2464022f-f34c-4422-ae9e-73573f22386e could not be found. Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:40.858230 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:40.862814 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:40.862814 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:40.862814 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:40.862814 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:25:40.862814 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:25:40.862814 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:25:40.862814 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:25:40.862814 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:25:40.862814 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:25:40.862814 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 30 01:25:40.862814 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 30 01:25:40.862814 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 30 01:25:40.862814 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:40.862814 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:40.862814 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:40.862814 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:40.862814 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:40.862814 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:40.862814 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:25:40.862814 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:25:40.862814 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 30 01:25:40.862814 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:40.862814 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-565c46a5-a7a6-4238-b044-3fb8809750be tempest-ImagesDeleteNegativeTestJSON-663913450 tempest-ImagesDeleteNegativeTestJSON-663913450-project] Returning 404 to user: Image not found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:25:40.862814 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-565c46a5-a7a6-4238-b044-3fb8809750be tempest-ImagesDeleteNegativeTestJSON-663913450 tempest-ImagesDeleteNegativeTestJSON-663913450-project] 10.222.0.13 "DELETE /compute/v2.1/images/2464022f-f34c-4422-ae9e-73573f22386e" status: 404 len: 62 microversion: 2.1 time: 0.047707 Oct 30 01:25:40.865264 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1426/2836] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:40 2022] DELETE /compute/v2.1/images/2464022f-f34c-4422-ae9e-73573f22386e => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:25:40.871468 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-67f24ce3-2013-468f-97c5-23e8a3be4edb req-b9bdc6f1-f855-4d6d-80b4-237a1d7d9d3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d5101ea-4f7c-45cb-957e-d4abd0b4977d", "name": "network-vif-deleted", "tag": "63fa751a-4d60-4d9d-acdf-37f981d1869e"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:25:40.902339 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-67f24ce3-2013-468f-97c5-23e8a3be4edb req-b9bdc6f1-f855-4d6d-80b4-237a1d7d9d3a service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:40.902994 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-67f24ce3-2013-468f-97c5-23e8a3be4edb req-b9bdc6f1-f855-4d6d-80b4-237a1d7d9d3a service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:40.903434 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-67f24ce3-2013-468f-97c5-23e8a3be4edb req-b9bdc6f1-f855-4d6d-80b4-237a1d7d9d3a service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:40.935518 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-67f24ce3-2013-468f-97c5-23e8a3be4edb req-b9bdc6f1-f855-4d6d-80b4-237a1d7d9d3a service nova] Creating event network-vif-deleted:63fa751a-4d60-4d9d-acdf-37f981d1869e for instance 7d5101ea-4f7c-45cb-957e-d4abd0b4977d on n-h1-master-1 Oct 30 01:25:40.944844 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-67f24ce3-2013-468f-97c5-23e8a3be4edb req-b9bdc6f1-f855-4d6d-80b4-237a1d7d9d3a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077506 Oct 30 01:25:40.946054 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1427/2837] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:25:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:25:40.953447 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bafb8987-2eb0-4526-a5e2-7a30f77bb1ca tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:40.954758 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bafb8987-2eb0-4526-a5e2-7a30f77bb1ca tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] [instance: 5b5d5fa5-1e07-4145-b6c8-30e31de10165] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:40.961693 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bafb8987-2eb0-4526-a5e2-7a30f77bb1ca tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:40.962409 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bafb8987-2eb0-4526-a5e2-7a30f77bb1ca tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:40.963689 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bafb8987-2eb0-4526-a5e2-7a30f77bb1ca tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:40.964576 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bafb8987-2eb0-4526-a5e2-7a30f77bb1ca tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:40.965027 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bafb8987-2eb0-4526-a5e2-7a30f77bb1ca tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:40.965536 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bafb8987-2eb0-4526-a5e2-7a30f77bb1ca tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:41.003934 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-bafb8987-2eb0-4526-a5e2-7a30f77bb1ca tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] HTTP exception thrown: Action 999 not found Oct 30 01:25:41.007452 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bafb8987-2eb0-4526-a5e2-7a30f77bb1ca tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Request method failure captured: Oct 30 01:25:41.007452 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/5b5d5fa5-1e07-4145-b6c8-30e31de10165/os-instance-actions/999 HTTP/1.1 Oct 30 01:25:41.007452 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:25:41.007452 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:25:41.007452 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:25:41.007452 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:25:41.007452 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:25:41.007452 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:25:41.007452 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:25:41.007452 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:25:41.007452 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdJ3-2Utsm34oAPcluHJ0dLlIv9UKwPcW9gSGc1Fd-fXnXyiUR-E9cDidulu_9iD7ySbhefgzo12vUJji8zK8NQoRv9q77rh1DwnTBZKgZmoZyYvjgr3gVo80JFFjbQ7dCBiF9aZlwtUJBhBlopPCb2e6u4E7eqLq_TkaBnnYQ_uZEc Oct 30 01:25:41.007452 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:25:41.007452 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:25:41.007452 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:25:41.007452 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:25:41.007452 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:25:41.007452 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:25:41.007452 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 127b4f4e1e4b43ed856faee3c5d9d88d Oct 30 01:25:41.007452 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-2114141342 Oct 30 01:25:41.007452 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:25:41.007452 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:25:41.007452 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/127b4f4e1e4b43ed856faee3c5d9d88d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_127b4f4e1e4b43ed856faee3c5d9d88d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/127b4f4e1e4b43ed856faee3c5d9d88d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/127b4f4e1e4b43ed856faee3c5d9d88d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:25:41.007452 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-2114141342 Oct 30 01:25:41.007452 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 127b4f4e1e4b43ed856faee3c5d9d88d Oct 30 01:25:41.007452 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-2114141342 Oct 30 01:25:41.007452 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-InstanceActionsNegativeTestJSON-2114141342-project Oct 30 01:25:41.007452 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:25:41.007452 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:25:41.007452 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 0dc60a96037f438ebbaaa6d25661bfc5 Oct 30 01:25:41.007452 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-2114141342-project Oct 30 01:25:41.007452 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:25:41.007452 n-d-master-1 devstack@n-api.service[121102]: exception: Action 999 not found Oct 30 01:25:41.007452 n-d-master-1 devstack@n-api.service[121102]: action_args: {'server_id': '5b5d5fa5-1e07-4145-b6c8-30e31de10165', 'id': '999'} Oct 30 01:25:41.007452 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:25:41.007452 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:41.007452 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:41.007452 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:41.007452 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:25:41.007452 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:25:41.007452 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:25:41.007452 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:25:41.007452 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 30 01:25:41.007452 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 30 01:25:41.007452 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 30 01:25:41.007452 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:41.007452 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:41.007452 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:41.007452 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:41.007452 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:41.007452 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:41.007452 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:25:41.007452 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:25:41.007452 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 30 01:25:41.007452 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:41.011629 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bafb8987-2eb0-4526-a5e2-7a30f77bb1ca tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Returning 404 to user: Action 999 not found {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:25:41.011629 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bafb8987-2eb0-4526-a5e2-7a30f77bb1ca tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] 10.222.0.13 "GET /compute/v2.1/servers/5b5d5fa5-1e07-4145-b6c8-30e31de10165/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.061610 Oct 30 01:25:41.011629 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1428/2838] 10.222.0.13 () {58 vars in 1308 bytes} [Sun Oct 30 01:25:40 2022] GET /compute/v2.1/servers/5b5d5fa5-1e07-4145-b6c8-30e31de10165/os-instance-actions/999 => generated 66 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:25:41.015200 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6339771b-2cf9-4a62-a64d-700d72f636af tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:41.015725 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6339771b-2cf9-4a62-a64d-700d72f636af tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7d5101ea-4f7c-45cb-957e-d4abd0b4977d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:41.022098 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6339771b-2cf9-4a62-a64d-700d72f636af tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:41.023147 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6339771b-2cf9-4a62-a64d-700d72f636af tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:41.023796 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6339771b-2cf9-4a62-a64d-700d72f636af tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:41.024660 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6339771b-2cf9-4a62-a64d-700d72f636af tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:41.025091 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6339771b-2cf9-4a62-a64d-700d72f636af tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:41.025539 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6339771b-2cf9-4a62-a64d-700d72f636af tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:41.041678 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-6339771b-2cf9-4a62-a64d-700d72f636af tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] HTTP exception thrown: Instance 7d5101ea-4f7c-45cb-957e-d4abd0b4977d could not be found. Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6339771b-2cf9-4a62-a64d-700d72f636af tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Request method failure captured: Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/servers/7d5101ea-4f7c-45cb-957e-d4abd0b4977d HTTP/1.1 Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdEZHAwNEyYVN8mbZetD1IgknrDb-nJfmTHtgPgtOr9AeQL99EuTYclSviV8aikzXcemJ-XkTVClxHn6U4xG48gAdXZcIs0fYa7Kdvvi7PzFjDxYMfOtgAp7wAvvVW7kd-J_XMzQX3yJBWm7NW5-QhmguztBnHz9UniQWs2CmNftHaI Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 8c95e97cd7e4461682b9028abb568dce Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 8c95e97cd7e4461682b9028abb568dce Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-DeleteServersTestJSON-1379968241-project Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 33691c943ec040ddb04b6648b6e945ab Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-DeleteServersTestJSON-1379968241-project Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 7d5101ea-4f7c-45cb-957e-d4abd0b4977d could not be found. Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '7d5101ea-4f7c-45cb-957e-d4abd0b4977d'} Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d5101ea-4f7c-45cb-957e-d4abd0b4977d could not be found. Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:25:41.044033 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:25:41.047736 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d5101ea-4f7c-45cb-957e-d4abd0b4977d could not be found. Oct 30 01:25:41.047736 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:41.047736 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:41.047736 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:41.047736 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:41.047736 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:41.047736 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:41.047736 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:25:41.047736 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:25:41.047736 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d5101ea-4f7c-45cb-957e-d4abd0b4977d could not be found. Oct 30 01:25:41.047736 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:41.047736 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6339771b-2cf9-4a62-a64d-700d72f636af tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Returning 404 to user: Instance 7d5101ea-4f7c-45cb-957e-d4abd0b4977d could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:25:41.047736 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6339771b-2cf9-4a62-a64d-700d72f636af tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7d5101ea-4f7c-45cb-957e-d4abd0b4977d" status: 404 len: 111 microversion: 2.1 time: 0.036389 Oct 30 01:25:41.051127 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1429/2839] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:25:41 2022] DELETE /compute/v2.1/servers/7d5101ea-4f7c-45cb-957e-d4abd0b4977d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:25:41.052653 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e3bc955f-fee7-4311-8a46-40ea3eaa36d1 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "DELETE /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305" status: 204 len: 0 microversion: 2.1 time: 0.511944 Oct 30 01:25:41.054051 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1411/2840] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:25:40 2022] DELETE /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:25:41.067321 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fd8a526a-4730-41d2-9146-95d92ea12565 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Calling method '.version_select at 0x7f44c7fc2f70>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:41.071159 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-a8a3cdef-5b2b-4af0-ae27-022e492da6d6 req-bdbbc8aa-2b67-44fe-883a-4ebbcc3f3c55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "403e0292-c082-4655-ad08-b5dc3a7f8305", "name": "network-vif-unplugged", "status": "completed", "tag": "ef3e2c7d-b1a5-43dc-a664-896af7f0b0ed"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:25:41.082691 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fd8a526a-4730-41d2-9146-95d92ea12565 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:41.082691 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fd8a526a-4730-41d2-9146-95d92ea12565 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:41.082691 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fd8a526a-4730-41d2-9146-95d92ea12565 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:41.082691 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fd8a526a-4730-41d2-9146-95d92ea12565 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] [instance: 5c4bb439-785f-4ac3-a7fc-b9325b52fa19] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:41.086727 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fd8a526a-4730-41d2-9146-95d92ea12565 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:41.087209 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fd8a526a-4730-41d2-9146-95d92ea12565 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:41.087645 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fd8a526a-4730-41d2-9146-95d92ea12565 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:41.088511 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fd8a526a-4730-41d2-9146-95d92ea12565 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:41.088978 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fd8a526a-4730-41d2-9146-95d92ea12565 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:41.089423 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fd8a526a-4730-41d2-9146-95d92ea12565 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:41.100171 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-a8a3cdef-5b2b-4af0-ae27-022e492da6d6 req-bdbbc8aa-2b67-44fe-883a-4ebbcc3f3c55 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:41.100975 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-a8a3cdef-5b2b-4af0-ae27-022e492da6d6 req-bdbbc8aa-2b67-44fe-883a-4ebbcc3f3c55 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:41.101875 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-a8a3cdef-5b2b-4af0-ae27-022e492da6d6 req-bdbbc8aa-2b67-44fe-883a-4ebbcc3f3c55 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:41.119747 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-a8a3cdef-5b2b-4af0-ae27-022e492da6d6 req-bdbbc8aa-2b67-44fe-883a-4ebbcc3f3c55 service nova] Creating event network-vif-unplugged:ef3e2c7d-b1a5-43dc-a664-896af7f0b0ed for instance 403e0292-c082-4655-ad08-b5dc3a7f8305 on n-h2-master-1 Oct 30 01:25:41.123945 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fd8a526a-4730-41d2-9146-95d92ea12565 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:41.124368 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fd8a526a-4730-41d2-9146-95d92ea12565 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:41.124855 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fd8a526a-4730-41d2-9146-95d92ea12565 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:41.127616 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-a8a3cdef-5b2b-4af0-ae27-022e492da6d6 req-bdbbc8aa-2b67-44fe-883a-4ebbcc3f3c55 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068546 Oct 30 01:25:41.140391 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fd8a526a-4730-41d2-9146-95d92ea12565 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:41.140875 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fd8a526a-4730-41d2-9146-95d92ea12565 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:41.141521 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fd8a526a-4730-41d2-9146-95d92ea12565 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:41.147771 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1412/2841] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:25:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:25:41.174714 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-68e91463-132e-475e-a660-aed35e7c6db2 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Calling method '.version_select at 0x7f44d04a9820>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:41.175410 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-68e91463-132e-475e-a660-aed35e7c6db2 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] [instance: e84bd651-3915-4431-bdec-d1ba2e2a93b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:41.189408 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-68e91463-132e-475e-a660-aed35e7c6db2 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] HTTP exception thrown: Instance e84bd651-3915-4431-bdec-d1ba2e2a93b9 could not be found. Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-68e91463-132e-475e-a660-aed35e7c6db2 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Request method failure captured: Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/e84bd651-3915-4431-bdec-d1ba2e2a93b9/os-instance-actions HTTP/1.1 Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdJ3-2Utsm34oAPcluHJ0dLlIv9UKwPcW9gSGc1Fd-fXnXyiUR-E9cDidulu_9iD7ySbhefgzo12vUJji8zK8NQoRv9q77rh1DwnTBZKgZmoZyYvjgr3gVo80JFFjbQ7dCBiF9aZlwtUJBhBlopPCb2e6u4E7eqLq_TkaBnnYQ_uZEc Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 127b4f4e1e4b43ed856faee3c5d9d88d Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-2114141342 Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/127b4f4e1e4b43ed856faee3c5d9d88d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_127b4f4e1e4b43ed856faee3c5d9d88d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/127b4f4e1e4b43ed856faee3c5d9d88d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/127b4f4e1e4b43ed856faee3c5d9d88d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-2114141342 Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 127b4f4e1e4b43ed856faee3c5d9d88d Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-2114141342 Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-InstanceActionsNegativeTestJSON-2114141342-project Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 0dc60a96037f438ebbaaa6d25661bfc5 Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-2114141342-project Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: method: Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: exception: Instance e84bd651-3915-4431-bdec-d1ba2e2a93b9 could not be found. Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: action_args: {'server_id': 'e84bd651-3915-4431-bdec-d1ba2e2a93b9'} Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e84bd651-3915-4431-bdec-d1ba2e2a93b9 could not be found. Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:25:41.192169 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:25:41.195845 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e84bd651-3915-4431-bdec-d1ba2e2a93b9 could not be found. Oct 30 01:25:41.195845 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:41.195845 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:41.195845 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:41.195845 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:41.195845 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:41.195845 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:41.195845 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:25:41.195845 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:25:41.195845 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e84bd651-3915-4431-bdec-d1ba2e2a93b9 could not be found. Oct 30 01:25:41.195845 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:41.195845 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-68e91463-132e-475e-a660-aed35e7c6db2 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Returning 404 to user: Instance e84bd651-3915-4431-bdec-d1ba2e2a93b9 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:25:41.195845 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-68e91463-132e-475e-a660-aed35e7c6db2 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] 10.222.0.13 "GET /compute/v2.1/servers/e84bd651-3915-4431-bdec-d1ba2e2a93b9/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.043003 Oct 30 01:25:41.195845 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1413/2842] 10.222.0.13 () {58 vars in 1296 bytes} [Sun Oct 30 01:25:41 2022] GET /compute/v2.1/servers/e84bd651-3915-4431-bdec-d1ba2e2a93b9/os-instance-actions => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:25:41.201806 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e570ad4a-945b-4d39-be9f-cd85acc99bd9 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '.version_select at 0x7f44d0485d30>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:41.254669 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e570ad4a-945b-4d39-be9f-cd85acc99bd9 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "GET /compute/v2.1/images/50669d24-ab56-475f-8236-0ff19406f3eb" status: 200 len: 1424 microversion: 2.1 time: 0.058927 Oct 30 01:25:41.262706 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1414/2843] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:25:41 2022] GET /compute/v2.1/images/50669d24-ab56-475f-8236-0ff19406f3eb => generated 1424 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:41.262706 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-023e5f11-3ea7-418e-b9ac-d1777789185e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:41.262706 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-023e5f11-3ea7-418e-b9ac-d1777789185e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7d5101ea-4f7c-45cb-957e-d4abd0b4977d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:41.267931 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-023e5f11-3ea7-418e-b9ac-d1777789185e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:41.268433 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-023e5f11-3ea7-418e-b9ac-d1777789185e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:41.268878 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-023e5f11-3ea7-418e-b9ac-d1777789185e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:41.269623 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-023e5f11-3ea7-418e-b9ac-d1777789185e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:41.270280 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-023e5f11-3ea7-418e-b9ac-d1777789185e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:41.270716 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-023e5f11-3ea7-418e-b9ac-d1777789185e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:41.284168 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-fd8a526a-4730-41d2-9146-95d92ea12565 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lazy-loading 'flavor' on Instance uuid 5c4bb439-785f-4ac3-a7fc-b9325b52fa19 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:25:41.285376 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-023e5f11-3ea7-418e-b9ac-d1777789185e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] HTTP exception thrown: Instance 7d5101ea-4f7c-45cb-957e-d4abd0b4977d could not be found. Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-023e5f11-3ea7-418e-b9ac-d1777789185e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Request method failure captured: Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/7d5101ea-4f7c-45cb-957e-d4abd0b4977d HTTP/1.1 Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdEZHAwNEyYVN8mbZetD1IgknrDb-nJfmTHtgPgtOr9AeQL99EuTYclSviV8aikzXcemJ-XkTVClxHn6U4xG48gAdXZcIs0fYa7Kdvvi7PzFjDxYMfOtgAp7wAvvVW7kd-J_XMzQX3yJBWm7NW5-QhmguztBnHz9UniQWs2CmNftHaI Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 8c95e97cd7e4461682b9028abb568dce Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 8c95e97cd7e4461682b9028abb568dce Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-DeleteServersTestJSON-1379968241-project Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 33691c943ec040ddb04b6648b6e945ab Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-DeleteServersTestJSON-1379968241-project Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 7d5101ea-4f7c-45cb-957e-d4abd0b4977d could not be found. Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '7d5101ea-4f7c-45cb-957e-d4abd0b4977d'} Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d5101ea-4f7c-45cb-957e-d4abd0b4977d could not be found. Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d5101ea-4f7c-45cb-957e-d4abd0b4977d could not be found. Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:41.286959 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:41.291308 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:41.291308 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:41.291308 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:41.291308 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:25:41.291308 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:25:41.291308 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d5101ea-4f7c-45cb-957e-d4abd0b4977d could not be found. Oct 30 01:25:41.291308 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:41.291308 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-023e5f11-3ea7-418e-b9ac-d1777789185e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Returning 404 to user: Instance 7d5101ea-4f7c-45cb-957e-d4abd0b4977d could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:25:41.291308 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-023e5f11-3ea7-418e-b9ac-d1777789185e tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/7d5101ea-4f7c-45cb-957e-d4abd0b4977d" status: 404 len: 111 microversion: 2.1 time: 0.031872 Oct 30 01:25:41.291308 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1415/2844] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:41 2022] GET /compute/v2.1/servers/7d5101ea-4f7c-45cb-957e-d4abd0b4977d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:25:41.294282 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d70efcb6-45d2-46d8-a889-0ace4abb6199 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-90800854", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "e006438e-aba1-46be-a97a-88a3153fb746"}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:25:41.304575 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fd8a526a-4730-41d2-9146-95d92ea12565 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] 10.222.0.13 "PUT /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19/tags/tempest-tag-1864867621" status: 201 len: 0 microversion: 2.26 time: 0.251899 Oct 30 01:25:41.311475 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1430/2845] 10.222.0.13 () {62 vars in 1380 bytes} [Sun Oct 30 01:25:41 2022] PUT /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19/tags/tempest-tag-1864867621 => generated 0 bytes in 254 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 30 01:25:41.311475 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c59907a6-8b09-41a7-940e-bb10b4d6f31f tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:41.311696 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c59907a6-8b09-41a7-940e-bb10b4d6f31f tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] [instance: 5b5d5fa5-1e07-4145-b6c8-30e31de10165] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:41.325702 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c59907a6-8b09-41a7-940e-bb10b4d6f31f tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:41.326709 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c59907a6-8b09-41a7-940e-bb10b4d6f31f tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:41.327354 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c59907a6-8b09-41a7-940e-bb10b4d6f31f tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:41.328278 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c59907a6-8b09-41a7-940e-bb10b4d6f31f tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:41.330659 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c59907a6-8b09-41a7-940e-bb10b4d6f31f tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:41.331698 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c59907a6-8b09-41a7-940e-bb10b4d6f31f tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:41.372737 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-d70efcb6-45d2-46d8-a889-0ace4abb6199 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] validate_networks() for [('e006438e-aba1-46be-a97a-88a3153fb746', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:25:41.388678 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c59907a6-8b09-41a7-940e-bb10b4d6f31f tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] [instance: 5b5d5fa5-1e07-4145-b6c8-30e31de10165] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:25:41.720718 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c59907a6-8b09-41a7-940e-bb10b4d6f31f tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5b5d5fa5-1e07-4145-b6c8-30e31de10165" status: 204 len: 0 microversion: 2.1 time: 0.414109 Oct 30 01:25:41.721459 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1431/2846] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:25:41 2022] DELETE /compute/v2.1/servers/5b5d5fa5-1e07-4145-b6c8-30e31de10165 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:25:41.726924 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f1bb99ae-47ba-42b0-ab55-1b3eb559c2bc tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:41.727516 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f1bb99ae-47ba-42b0-ab55-1b3eb559c2bc tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] [instance: dcb34439-de04-4a9c-b81b-7fb2360af99c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:41.740784 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f1bb99ae-47ba-42b0-ab55-1b3eb559c2bc tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:41.741554 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f1bb99ae-47ba-42b0-ab55-1b3eb559c2bc tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:41.742088 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f1bb99ae-47ba-42b0-ab55-1b3eb559c2bc tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:41.746012 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f1bb99ae-47ba-42b0-ab55-1b3eb559c2bc tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:41.746682 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f1bb99ae-47ba-42b0-ab55-1b3eb559c2bc tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:41.751100 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f1bb99ae-47ba-42b0-ab55-1b3eb559c2bc tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:41.773172 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-f1bb99ae-47ba-42b0-ab55-1b3eb559c2bc tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] HTTP exception thrown: Instance dcb34439-de04-4a9c-b81b-7fb2360af99c could not be found. Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f1bb99ae-47ba-42b0-ab55-1b3eb559c2bc tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Request method failure captured: Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/servers/dcb34439-de04-4a9c-b81b-7fb2360af99c HTTP/1.1 Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdHDa0KxdwMIsTBNwbRwD0b4eo-yN2Wj3hgbU0ofPT23gG_ao3TAkGtr7BNKNIO1I6AGnGJakPM-y3Rx7t8O6GAoli4XUa1RgSPXSPvyCEEhghfuro4OzaprzpMJvPZIZhp_IO-y6VrQmultf9b5aBafjyOZadMFvR24b1XkpqUo38w Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: d342baf2538340e292e44dfc622b86fc Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-696144334 Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d342baf2538340e292e44dfc622b86fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d342baf2538340e292e44dfc622b86fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d342baf2538340e292e44dfc622b86fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d342baf2538340e292e44dfc622b86fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-696144334 Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: d342baf2538340e292e44dfc622b86fc Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-696144334 Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-AttachSCSIVolumeTestJSON-696144334-project Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 94448bbc2f4a4efaa86792f1511ff15c Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-696144334-project Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: exception: Instance dcb34439-de04-4a9c-b81b-7fb2360af99c could not be found. Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'dcb34439-de04-4a9c-b81b-7fb2360af99c'} Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcb34439-de04-4a9c-b81b-7fb2360af99c could not be found. Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:25:41.778869 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:25:41.786560 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcb34439-de04-4a9c-b81b-7fb2360af99c could not be found. Oct 30 01:25:41.786560 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:41.786560 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:41.786560 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:41.786560 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:41.786560 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:41.786560 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:41.786560 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:25:41.786560 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:25:41.786560 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcb34439-de04-4a9c-b81b-7fb2360af99c could not be found. Oct 30 01:25:41.786560 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:41.786560 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f1bb99ae-47ba-42b0-ab55-1b3eb559c2bc tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Returning 404 to user: Instance dcb34439-de04-4a9c-b81b-7fb2360af99c could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:25:41.786560 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f1bb99ae-47ba-42b0-ab55-1b3eb559c2bc tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] 10.222.0.13 "DELETE /compute/v2.1/servers/dcb34439-de04-4a9c-b81b-7fb2360af99c" status: 404 len: 111 microversion: 2.1 time: 0.060049 Oct 30 01:25:41.789024 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1432/2847] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:25:41 2022] DELETE /compute/v2.1/servers/dcb34439-de04-4a9c-b81b-7fb2360af99c => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:25:41.801211 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c7f222dd-f7be-4af5-bb1f-282e62e44b9c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:41.801889 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c7f222dd-f7be-4af5-bb1f-282e62e44b9c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 32c70d3f-96cd-4b23-a743-05aed245baf0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:41.814444 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c7f222dd-f7be-4af5-bb1f-282e62e44b9c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:41.815032 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c7f222dd-f7be-4af5-bb1f-282e62e44b9c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:41.815557 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c7f222dd-f7be-4af5-bb1f-282e62e44b9c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:41.817733 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c7f222dd-f7be-4af5-bb1f-282e62e44b9c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:41.818274 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c7f222dd-f7be-4af5-bb1f-282e62e44b9c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:41.821737 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c7f222dd-f7be-4af5-bb1f-282e62e44b9c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:41.839724 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-c7f222dd-f7be-4af5-bb1f-282e62e44b9c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] HTTP exception thrown: Instance 32c70d3f-96cd-4b23-a743-05aed245baf0 could not be found. Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c7f222dd-f7be-4af5-bb1f-282e62e44b9c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Request method failure captured: Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0 HTTP/1.1 Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdEZHAwNEyYVN8mbZetD1IgknrDb-nJfmTHtgPgtOr9AeQL99EuTYclSviV8aikzXcemJ-XkTVClxHn6U4xG48gAdXZcIs0fYa7Kdvvi7PzFjDxYMfOtgAp7wAvvVW7kd-J_XMzQX3yJBWm7NW5-QhmguztBnHz9UniQWs2CmNftHaI Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 8c95e97cd7e4461682b9028abb568dce Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 8c95e97cd7e4461682b9028abb568dce Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-DeleteServersTestJSON-1379968241-project Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 33691c943ec040ddb04b6648b6e945ab Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-DeleteServersTestJSON-1379968241-project Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 32c70d3f-96cd-4b23-a743-05aed245baf0 could not be found. Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '32c70d3f-96cd-4b23-a743-05aed245baf0'} Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32c70d3f-96cd-4b23-a743-05aed245baf0 could not be found. Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:25:41.841353 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:25:41.845092 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32c70d3f-96cd-4b23-a743-05aed245baf0 could not be found. Oct 30 01:25:41.845092 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:41.845092 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:41.845092 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:41.845092 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:41.845092 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:41.845092 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:41.845092 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:25:41.845092 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:25:41.845092 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32c70d3f-96cd-4b23-a743-05aed245baf0 could not be found. Oct 30 01:25:41.845092 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:41.847188 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c7f222dd-f7be-4af5-bb1f-282e62e44b9c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Returning 404 to user: Instance 32c70d3f-96cd-4b23-a743-05aed245baf0 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:25:41.848381 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c7f222dd-f7be-4af5-bb1f-282e62e44b9c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "DELETE /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0" status: 404 len: 111 microversion: 2.1 time: 0.058223 Oct 30 01:25:41.849136 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1433/2848] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:25:41 2022] DELETE /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:25:41.854569 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-94fb787f-352d-49cc-a993-356314019910 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Calling method '.version_select at 0x7f44ccecca60>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:41.878360 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-94fb787f-352d-49cc-a993-356314019910 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:41.889482 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-94fb787f-352d-49cc-a993-356314019910 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:41.890483 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-94fb787f-352d-49cc-a993-356314019910 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:41.919989 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-94fb787f-352d-49cc-a993-356314019910 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] 10.222.0.13 "GET /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19/tags/tempest-tag-1864867621" status: 204 len: 0 microversion: 2.26 time: 0.069289 Oct 30 01:25:41.924238 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1434/2849] 10.222.0.13 () {60 vars in 1361 bytes} [Sun Oct 30 01:25:41 2022] GET /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19/tags/tempest-tag-1864867621 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 30 01:25:41.935866 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-271f746c-2c64-4bee-b0ac-432cdf2a1092 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:41.938779 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-271f746c-2c64-4bee-b0ac-432cdf2a1092 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] [instance: 5b5d5fa5-1e07-4145-b6c8-30e31de10165] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:41.953578 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-271f746c-2c64-4bee-b0ac-432cdf2a1092 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:41.954206 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-271f746c-2c64-4bee-b0ac-432cdf2a1092 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:41.954785 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-271f746c-2c64-4bee-b0ac-432cdf2a1092 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:41.956683 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-271f746c-2c64-4bee-b0ac-432cdf2a1092 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:41.958120 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-271f746c-2c64-4bee-b0ac-432cdf2a1092 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:41.960059 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-271f746c-2c64-4bee-b0ac-432cdf2a1092 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:41.969026 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=2,nova_cell1:RELEASE=1,nova_cell1:UPDATE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:25:41.999291 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-d70efcb6-45d2-46d8-a889-0ace4abb6199 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:25:42.006183 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-d70efcb6-45d2-46d8-a889-0ace4abb6199 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:25:42.006183 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-d70efcb6-45d2-46d8-a889-0ace4abb6199 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:25:42.006183 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-d70efcb6-45d2-46d8-a889-0ace4abb6199 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:25:42.006183 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-d70efcb6-45d2-46d8-a889-0ace4abb6199 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:25:42.016818 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d70efcb6-45d2-46d8-a889-0ace4abb6199 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:42.017582 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d70efcb6-45d2-46d8-a889-0ace4abb6199 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:42.018175 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d70efcb6-45d2-46d8-a889-0ace4abb6199 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:42.019526 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d70efcb6-45d2-46d8-a889-0ace4abb6199 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:42.020801 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d70efcb6-45d2-46d8-a889-0ace4abb6199 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:42.021508 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d70efcb6-45d2-46d8-a889-0ace4abb6199 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:42.084171 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-d70efcb6-45d2-46d8-a889-0ace4abb6199 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Getting quotas for project 4aa9c648b20d41d7b150fbf64cde6fe8. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:25:42.102611 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-d70efcb6-45d2-46d8-a889-0ace4abb6199 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Getting quotas for user f857d6b0826e47c6875a307e7ccfb104 and project 4aa9c648b20d41d7b150fbf64cde6fe8. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:25:42.128982 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d70efcb6-45d2-46d8-a889-0ace4abb6199 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:25:42.131581 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d70efcb6-45d2-46d8-a889-0ace4abb6199 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: 688c35c4-9529-49df-8255-98cd2b56c314] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:25:42.211897 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-271f746c-2c64-4bee-b0ac-432cdf2a1092 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc60a96037f438ebbaaa6d25661bfc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127b4f4e1e4b43ed856faee3c5d9d88d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:42.224277 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-271f746c-2c64-4bee-b0ac-432cdf2a1092 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] 10.222.0.13 "GET /compute/v2.1/servers/5b5d5fa5-1e07-4145-b6c8-30e31de10165" status: 200 len: 1528 microversion: 2.1 time: 0.297033 Oct 30 01:25:42.236829 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1435/2850] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:41 2022] GET /compute/v2.1/servers/5b5d5fa5-1e07-4145-b6c8-30e31de10165 => generated 1528 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:42.250900 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6958d9c2-3af7-42de-84ac-115f726f9a2e tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:42.251914 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6958d9c2-3af7-42de-84ac-115f726f9a2e tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] [instance: dcb34439-de04-4a9c-b81b-7fb2360af99c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:42.261164 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6958d9c2-3af7-42de-84ac-115f726f9a2e tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:42.265211 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6958d9c2-3af7-42de-84ac-115f726f9a2e tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:42.265211 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6958d9c2-3af7-42de-84ac-115f726f9a2e tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:42.265211 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6958d9c2-3af7-42de-84ac-115f726f9a2e tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:42.265211 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6958d9c2-3af7-42de-84ac-115f726f9a2e tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:42.265211 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6958d9c2-3af7-42de-84ac-115f726f9a2e tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:42.279833 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d70efcb6-45d2-46d8-a889-0ace4abb6199 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.988355 Oct 30 01:25:42.280583 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1416/2851] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:25:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 991 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:25:42.284355 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-6958d9c2-3af7-42de-84ac-115f726f9a2e tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] HTTP exception thrown: Instance dcb34439-de04-4a9c-b81b-7fb2360af99c could not be found. Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6958d9c2-3af7-42de-84ac-115f726f9a2e tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Request method failure captured: Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/dcb34439-de04-4a9c-b81b-7fb2360af99c HTTP/1.1 Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdHDa0KxdwMIsTBNwbRwD0b4eo-yN2Wj3hgbU0ofPT23gG_ao3TAkGtr7BNKNIO1I6AGnGJakPM-y3Rx7t8O6GAoli4XUa1RgSPXSPvyCEEhghfuro4OzaprzpMJvPZIZhp_IO-y6VrQmultf9b5aBafjyOZadMFvR24b1XkpqUo38w Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: d342baf2538340e292e44dfc622b86fc Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-696144334 Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d342baf2538340e292e44dfc622b86fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d342baf2538340e292e44dfc622b86fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d342baf2538340e292e44dfc622b86fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d342baf2538340e292e44dfc622b86fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-696144334 Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: d342baf2538340e292e44dfc622b86fc Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-696144334 Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-AttachSCSIVolumeTestJSON-696144334-project Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 94448bbc2f4a4efaa86792f1511ff15c Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-696144334-project Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: exception: Instance dcb34439-de04-4a9c-b81b-7fb2360af99c could not be found. Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'dcb34439-de04-4a9c-b81b-7fb2360af99c'} Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcb34439-de04-4a9c-b81b-7fb2360af99c could not be found. Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcb34439-de04-4a9c-b81b-7fb2360af99c could not be found. Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:42.286275 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:42.297742 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:42.297742 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:42.297742 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:42.297742 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:25:42.297742 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:25:42.297742 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcb34439-de04-4a9c-b81b-7fb2360af99c could not be found. Oct 30 01:25:42.297742 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:42.298213 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bec25439-62a0-42d2-a1a9-a41459dc11b8 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:42.298213 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-bec25439-62a0-42d2-a1a9-a41459dc11b8 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: 64824cfc-200e-4ee1-8698-011b644ae315] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:42.311681 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6958d9c2-3af7-42de-84ac-115f726f9a2e tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] Returning 404 to user: Instance dcb34439-de04-4a9c-b81b-7fb2360af99c could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:25:42.312691 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6958d9c2-3af7-42de-84ac-115f726f9a2e tempest-AttachSCSIVolumeTestJSON-696144334 tempest-AttachSCSIVolumeTestJSON-696144334-project] 10.222.0.13 "GET /compute/v2.1/servers/dcb34439-de04-4a9c-b81b-7fb2360af99c" status: 404 len: 111 microversion: 2.1 time: 0.069543 Oct 30 01:25:42.331278 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bec25439-62a0-42d2-a1a9-a41459dc11b8 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:42.333933 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bec25439-62a0-42d2-a1a9-a41459dc11b8 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:42.334414 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bec25439-62a0-42d2-a1a9-a41459dc11b8 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:42.335159 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bec25439-62a0-42d2-a1a9-a41459dc11b8 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:42.335624 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bec25439-62a0-42d2-a1a9-a41459dc11b8 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:42.337404 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1436/2852] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:42 2022] GET /compute/v2.1/servers/dcb34439-de04-4a9c-b81b-7fb2360af99c => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:25:42.354926 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d2c23399-730a-4604-877a-e913053f9a19 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:42.358678 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bec25439-62a0-42d2-a1a9-a41459dc11b8 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:42.369813 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d2c23399-730a-4604-877a-e913053f9a19 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 32c70d3f-96cd-4b23-a743-05aed245baf0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:42.389512 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2c23399-730a-4604-877a-e913053f9a19 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:42.390966 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2c23399-730a-4604-877a-e913053f9a19 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:42.391711 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2c23399-730a-4604-877a-e913053f9a19 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:42.393091 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2c23399-730a-4604-877a-e913053f9a19 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:42.394245 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2c23399-730a-4604-877a-e913053f9a19 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:42.394855 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2c23399-730a-4604-877a-e913053f9a19 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:42.415126 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-d2c23399-730a-4604-877a-e913053f9a19 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] HTTP exception thrown: Instance 32c70d3f-96cd-4b23-a743-05aed245baf0 could not be found. Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d2c23399-730a-4604-877a-e913053f9a19 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Request method failure captured: Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0 HTTP/1.1 Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdEZHAwNEyYVN8mbZetD1IgknrDb-nJfmTHtgPgtOr9AeQL99EuTYclSviV8aikzXcemJ-XkTVClxHn6U4xG48gAdXZcIs0fYa7Kdvvi7PzFjDxYMfOtgAp7wAvvVW7kd-J_XMzQX3yJBWm7NW5-QhmguztBnHz9UniQWs2CmNftHaI Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 8c95e97cd7e4461682b9028abb568dce Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 8c95e97cd7e4461682b9028abb568dce Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-DeleteServersTestJSON-1379968241-project Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 33691c943ec040ddb04b6648b6e945ab Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-DeleteServersTestJSON-1379968241-project Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 32c70d3f-96cd-4b23-a743-05aed245baf0 could not be found. Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '32c70d3f-96cd-4b23-a743-05aed245baf0'} Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32c70d3f-96cd-4b23-a743-05aed245baf0 could not be found. Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32c70d3f-96cd-4b23-a743-05aed245baf0 could not be found. Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:42.417008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:42.421734 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:42.421734 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:42.421734 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:42.421734 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:25:42.421734 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:25:42.421734 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32c70d3f-96cd-4b23-a743-05aed245baf0 could not be found. Oct 30 01:25:42.421734 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:42.423736 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d2c23399-730a-4604-877a-e913053f9a19 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Returning 404 to user: Instance 32c70d3f-96cd-4b23-a743-05aed245baf0 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:25:42.425150 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d2c23399-730a-4604-877a-e913053f9a19 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0" status: 404 len: 111 microversion: 2.1 time: 0.083739 Oct 30 01:25:42.426378 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1437/2853] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:42 2022] GET /compute/v2.1/servers/32c70d3f-96cd-4b23-a743-05aed245baf0 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:25:42.446274 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-53b16e67-f247-41e8-8116-1325eede89fd tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Calling method '.version_select at 0x7f44cc60cee0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:42.457886 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53b16e67-f247-41e8-8116-1325eede89fd tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:42.459405 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53b16e67-f247-41e8-8116-1325eede89fd tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:42.460079 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53b16e67-f247-41e8-8116-1325eede89fd tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:42.461475 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-53b16e67-f247-41e8-8116-1325eede89fd tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] [instance: 5c4bb439-785f-4ac3-a7fc-b9325b52fa19] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:42.470126 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53b16e67-f247-41e8-8116-1325eede89fd tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:42.471427 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53b16e67-f247-41e8-8116-1325eede89fd tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:42.475036 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53b16e67-f247-41e8-8116-1325eede89fd tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:42.475036 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53b16e67-f247-41e8-8116-1325eede89fd tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:42.475036 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53b16e67-f247-41e8-8116-1325eede89fd tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:42.475700 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53b16e67-f247-41e8-8116-1325eede89fd tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:42.532981 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53b16e67-f247-41e8-8116-1325eede89fd tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:42.533546 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53b16e67-f247-41e8-8116-1325eede89fd tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:42.534080 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53b16e67-f247-41e8-8116-1325eede89fd tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:42.693323 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-53b16e67-f247-41e8-8116-1325eede89fd tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lazy-loading 'flavor' on Instance uuid 5c4bb439-785f-4ac3-a7fc-b9325b52fa19 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:25:42.822319 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-53b16e67-f247-41e8-8116-1325eede89fd tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19/tags" status: 204 len: 0 microversion: 2.26 time: 0.328916 Oct 30 01:25:42.822319 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1438/2854] 10.222.0.13 () {60 vars in 1295 bytes} [Sun Oct 30 01:25:42 2022] DELETE /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19/tags => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 30 01:25:42.822319 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d3421a5b-6d05-4c73-969c-df5d850ce5e5 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '.version_select at 0x7f44cc1a0ca0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:42.841918 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d3421a5b-6d05-4c73-969c-df5d850ce5e5 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "GET /compute/v2.1/images/50669d24-ab56-475f-8236-0ff19406f3eb" status: 200 len: 1424 microversion: 2.1 time: 0.081698 Oct 30 01:25:42.842846 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1439/2855] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:25:42 2022] GET /compute/v2.1/images/50669d24-ab56-475f-8236-0ff19406f3eb => generated 1424 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:42.855828 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1460acac-975b-49b0-b4e2-04f65898568d tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:42.859364 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1460acac-975b-49b0-b4e2-04f65898568d tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: 688c35c4-9529-49df-8255-98cd2b56c314] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:42.949412 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1460acac-975b-49b0-b4e2-04f65898568d tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:42.956527 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-bec25439-62a0-42d2-a1a9-a41459dc11b8 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07f2b8c31f54c62aaba73ca2bd2edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c59bd73c7874a00b52ec7c5c4142039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:42.963699 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1460acac-975b-49b0-b4e2-04f65898568d tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/688c35c4-9529-49df-8255-98cd2b56c314" status: 200 len: 1206 microversion: 2.1 time: 0.116920 Oct 30 01:25:42.964901 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1440/2856] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:42 2022] GET /compute/v2.1/servers/688c35c4-9529-49df-8255-98cd2b56c314 => generated 1206 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:42.975069 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2591e881-34fd-4a6f-87bb-31a9a5e896eb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:42.978226 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2591e881-34fd-4a6f-87bb-31a9a5e896eb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7f629426-c4e6-4c3f-8e54-efd452d14dd7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:42.987366 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bec25439-62a0-42d2-a1a9-a41459dc11b8 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] 10.222.0.13 "GET /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315" status: 200 len: 1355 microversion: 2.1 time: 0.705559 Oct 30 01:25:42.988475 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1417/2857] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:42 2022] GET /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315 => generated 1355 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:42.992279 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2591e881-34fd-4a6f-87bb-31a9a5e896eb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:42.993133 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2591e881-34fd-4a6f-87bb-31a9a5e896eb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:42.993874 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2591e881-34fd-4a6f-87bb-31a9a5e896eb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:42.994847 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-467d7d28-3984-4fbf-859e-79599a5017f6 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Calling method '.version_select at 0x7f44c7aa95e0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:42.995351 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2591e881-34fd-4a6f-87bb-31a9a5e896eb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:42.996143 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2591e881-34fd-4a6f-87bb-31a9a5e896eb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:42.996828 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2591e881-34fd-4a6f-87bb-31a9a5e896eb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:43.003768 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-467d7d28-3984-4fbf-859e-79599a5017f6 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:43.004286 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-467d7d28-3984-4fbf-859e-79599a5017f6 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:43.004722 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-467d7d28-3984-4fbf-859e-79599a5017f6 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:43.023431 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-467d7d28-3984-4fbf-859e-79599a5017f6 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] 10.222.0.13 "GET /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19/tags" status: 200 len: 12 microversion: 2.26 time: 0.033151 Oct 30 01:25:43.028728 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1418/2858] 10.222.0.13 () {60 vars in 1292 bytes} [Sun Oct 30 01:25:42 2022] GET /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19/tags => generated 12 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:43.039154 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e0a37415-c16c-48fe-9636-c6f25f3444aa tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Calling method '.version_select at 0x7f44d0475280>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:43.041958 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-2591e881-34fd-4a6f-87bb-31a9a5e896eb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] HTTP exception thrown: Instance 7f629426-c4e6-4c3f-8e54-efd452d14dd7 could not be found. Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2591e881-34fd-4a6f-87bb-31a9a5e896eb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Request method failure captured: Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7 HTTP/1.1 Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdEZHAwNEyYVN8mbZetD1IgknrDb-nJfmTHtgPgtOr9AeQL99EuTYclSviV8aikzXcemJ-XkTVClxHn6U4xG48gAdXZcIs0fYa7Kdvvi7PzFjDxYMfOtgAp7wAvvVW7kd-J_XMzQX3yJBWm7NW5-QhmguztBnHz9UniQWs2CmNftHaI Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 8c95e97cd7e4461682b9028abb568dce Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 8c95e97cd7e4461682b9028abb568dce Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-DeleteServersTestJSON-1379968241-project Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 33691c943ec040ddb04b6648b6e945ab Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-DeleteServersTestJSON-1379968241-project Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 7f629426-c4e6-4c3f-8e54-efd452d14dd7 could not be found. Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '7f629426-c4e6-4c3f-8e54-efd452d14dd7'} Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f629426-c4e6-4c3f-8e54-efd452d14dd7 could not be found. Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:25:43.043804 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:25:43.049130 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f629426-c4e6-4c3f-8e54-efd452d14dd7 could not be found. Oct 30 01:25:43.049130 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:43.049130 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:43.049130 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:43.049130 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:43.049130 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:43.049130 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:43.049130 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:25:43.049130 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:25:43.049130 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f629426-c4e6-4c3f-8e54-efd452d14dd7 could not be found. Oct 30 01:25:43.049130 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:43.050727 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2591e881-34fd-4a6f-87bb-31a9a5e896eb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Returning 404 to user: Instance 7f629426-c4e6-4c3f-8e54-efd452d14dd7 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:25:43.051768 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2591e881-34fd-4a6f-87bb-31a9a5e896eb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7" status: 404 len: 111 microversion: 2.1 time: 0.084396 Oct 30 01:25:43.055622 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1441/2859] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:25:42 2022] DELETE /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:25:43.056394 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e0a37415-c16c-48fe-9636-c6f25f3444aa tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:43.057714 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e0a37415-c16c-48fe-9636-c6f25f3444aa tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:43.058295 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e0a37415-c16c-48fe-9636-c6f25f3444aa tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:43.059556 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e0a37415-c16c-48fe-9636-c6f25f3444aa tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] [instance: 5c4bb439-785f-4ac3-a7fc-b9325b52fa19] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:43.063176 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e792c420-b938-472f-9e36-8f98a53964a2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:43.074261 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e0a37415-c16c-48fe-9636-c6f25f3444aa tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:43.074261 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e0a37415-c16c-48fe-9636-c6f25f3444aa tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:43.074261 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e0a37415-c16c-48fe-9636-c6f25f3444aa tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:43.074261 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e0a37415-c16c-48fe-9636-c6f25f3444aa tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:43.074261 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e0a37415-c16c-48fe-9636-c6f25f3444aa tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:43.074261 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e0a37415-c16c-48fe-9636-c6f25f3444aa tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:43.075424 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e792c420-b938-472f-9e36-8f98a53964a2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 7f629426-c4e6-4c3f-8e54-efd452d14dd7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:43.080256 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e792c420-b938-472f-9e36-8f98a53964a2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:43.082116 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e792c420-b938-472f-9e36-8f98a53964a2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:43.084749 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e792c420-b938-472f-9e36-8f98a53964a2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:43.085923 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e792c420-b938-472f-9e36-8f98a53964a2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:43.089279 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e792c420-b938-472f-9e36-8f98a53964a2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:43.089983 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e792c420-b938-472f-9e36-8f98a53964a2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:43.104729 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e0a37415-c16c-48fe-9636-c6f25f3444aa tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:43.105431 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e0a37415-c16c-48fe-9636-c6f25f3444aa tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:43.105977 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e0a37415-c16c-48fe-9636-c6f25f3444aa tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:43.118667 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e0a37415-c16c-48fe-9636-c6f25f3444aa tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:43.119467 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e0a37415-c16c-48fe-9636-c6f25f3444aa tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:43.120018 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e0a37415-c16c-48fe-9636-c6f25f3444aa tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:43.122657 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-e792c420-b938-472f-9e36-8f98a53964a2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] HTTP exception thrown: Instance 7f629426-c4e6-4c3f-8e54-efd452d14dd7 could not be found. Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e792c420-b938-472f-9e36-8f98a53964a2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Request method failure captured: Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7 HTTP/1.1 Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdEZHAwNEyYVN8mbZetD1IgknrDb-nJfmTHtgPgtOr9AeQL99EuTYclSviV8aikzXcemJ-XkTVClxHn6U4xG48gAdXZcIs0fYa7Kdvvi7PzFjDxYMfOtgAp7wAvvVW7kd-J_XMzQX3yJBWm7NW5-QhmguztBnHz9UniQWs2CmNftHaI Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 8c95e97cd7e4461682b9028abb568dce Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 8c95e97cd7e4461682b9028abb568dce Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-DeleteServersTestJSON-1379968241-project Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 33691c943ec040ddb04b6648b6e945ab Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-DeleteServersTestJSON-1379968241-project Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 7f629426-c4e6-4c3f-8e54-efd452d14dd7 could not be found. Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '7f629426-c4e6-4c3f-8e54-efd452d14dd7'} Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f629426-c4e6-4c3f-8e54-efd452d14dd7 could not be found. Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f629426-c4e6-4c3f-8e54-efd452d14dd7 could not be found. Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:43.124415 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:43.129113 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:43.129113 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:43.129113 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:43.129113 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:25:43.129113 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:25:43.129113 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f629426-c4e6-4c3f-8e54-efd452d14dd7 could not be found. Oct 30 01:25:43.129113 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:43.129113 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e792c420-b938-472f-9e36-8f98a53964a2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Returning 404 to user: Instance 7f629426-c4e6-4c3f-8e54-efd452d14dd7 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:25:43.129113 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e792c420-b938-472f-9e36-8f98a53964a2 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7" status: 404 len: 111 microversion: 2.1 time: 0.069297 Oct 30 01:25:43.133940 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1442/2860] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:43 2022] GET /compute/v2.1/servers/7f629426-c4e6-4c3f-8e54-efd452d14dd7 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:25:43.150759 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ba0249b5-02d5-4312-b670-f296b9116eef tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:43.151289 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ba0249b5-02d5-4312-b670-f296b9116eef tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 2b103487-3d7a-4186-aede-cb565cd34449] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:43.163511 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ba0249b5-02d5-4312-b670-f296b9116eef tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:43.168845 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ba0249b5-02d5-4312-b670-f296b9116eef tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:43.170839 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ba0249b5-02d5-4312-b670-f296b9116eef tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:43.173101 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ba0249b5-02d5-4312-b670-f296b9116eef tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:43.177588 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ba0249b5-02d5-4312-b670-f296b9116eef tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:43.185011 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ba0249b5-02d5-4312-b670-f296b9116eef tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:43.213279 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-ba0249b5-02d5-4312-b670-f296b9116eef tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] HTTP exception thrown: Instance 2b103487-3d7a-4186-aede-cb565cd34449 could not be found. Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ba0249b5-02d5-4312-b670-f296b9116eef tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Request method failure captured: Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/servers/2b103487-3d7a-4186-aede-cb565cd34449 HTTP/1.1 Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdEZHAwNEyYVN8mbZetD1IgknrDb-nJfmTHtgPgtOr9AeQL99EuTYclSviV8aikzXcemJ-XkTVClxHn6U4xG48gAdXZcIs0fYa7Kdvvi7PzFjDxYMfOtgAp7wAvvVW7kd-J_XMzQX3yJBWm7NW5-QhmguztBnHz9UniQWs2CmNftHaI Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 8c95e97cd7e4461682b9028abb568dce Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 8c95e97cd7e4461682b9028abb568dce Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-DeleteServersTestJSON-1379968241-project Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 33691c943ec040ddb04b6648b6e945ab Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-DeleteServersTestJSON-1379968241-project Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 2b103487-3d7a-4186-aede-cb565cd34449 could not be found. Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '2b103487-3d7a-4186-aede-cb565cd34449'} Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b103487-3d7a-4186-aede-cb565cd34449 could not be found. Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:25:43.215094 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:25:43.219485 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b103487-3d7a-4186-aede-cb565cd34449 could not be found. Oct 30 01:25:43.219485 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:43.219485 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:43.219485 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:43.219485 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:43.219485 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:43.219485 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:43.219485 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:25:43.219485 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:25:43.219485 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b103487-3d7a-4186-aede-cb565cd34449 could not be found. Oct 30 01:25:43.219485 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:43.221566 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ba0249b5-02d5-4312-b670-f296b9116eef tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Returning 404 to user: Instance 2b103487-3d7a-4186-aede-cb565cd34449 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:25:43.226547 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ba0249b5-02d5-4312-b670-f296b9116eef tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2b103487-3d7a-4186-aede-cb565cd34449" status: 404 len: 111 microversion: 2.1 time: 0.087492 Oct 30 01:25:43.226547 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1443/2861] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:25:43 2022] DELETE /compute/v2.1/servers/2b103487-3d7a-4186-aede-cb565cd34449 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:25:43.234343 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-867b1f52-08d2-491a-a72a-8cc8ab62ac54 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:43.237809 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-867b1f52-08d2-491a-a72a-8cc8ab62ac54 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 2b103487-3d7a-4186-aede-cb565cd34449] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:43.244631 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-867b1f52-08d2-491a-a72a-8cc8ab62ac54 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:43.245177 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-867b1f52-08d2-491a-a72a-8cc8ab62ac54 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:43.245721 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-867b1f52-08d2-491a-a72a-8cc8ab62ac54 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:43.251289 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-867b1f52-08d2-491a-a72a-8cc8ab62ac54 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:43.251289 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-867b1f52-08d2-491a-a72a-8cc8ab62ac54 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:43.251289 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-867b1f52-08d2-491a-a72a-8cc8ab62ac54 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:43.263638 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-867b1f52-08d2-491a-a72a-8cc8ab62ac54 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] HTTP exception thrown: Instance 2b103487-3d7a-4186-aede-cb565cd34449 could not be found. Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-867b1f52-08d2-491a-a72a-8cc8ab62ac54 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Request method failure captured: Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/2b103487-3d7a-4186-aede-cb565cd34449 HTTP/1.1 Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdEZHAwNEyYVN8mbZetD1IgknrDb-nJfmTHtgPgtOr9AeQL99EuTYclSviV8aikzXcemJ-XkTVClxHn6U4xG48gAdXZcIs0fYa7Kdvvi7PzFjDxYMfOtgAp7wAvvVW7kd-J_XMzQX3yJBWm7NW5-QhmguztBnHz9UniQWs2CmNftHaI Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 8c95e97cd7e4461682b9028abb568dce Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 8c95e97cd7e4461682b9028abb568dce Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-DeleteServersTestJSON-1379968241-project Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 33691c943ec040ddb04b6648b6e945ab Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-DeleteServersTestJSON-1379968241-project Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 2b103487-3d7a-4186-aede-cb565cd34449 could not be found. Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '2b103487-3d7a-4186-aede-cb565cd34449'} Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b103487-3d7a-4186-aede-cb565cd34449 could not be found. Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b103487-3d7a-4186-aede-cb565cd34449 could not be found. Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:43.265362 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:43.269490 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:43.269490 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:43.269490 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:43.269490 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:25:43.269490 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:25:43.269490 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b103487-3d7a-4186-aede-cb565cd34449 could not be found. Oct 30 01:25:43.269490 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:43.269490 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-867b1f52-08d2-491a-a72a-8cc8ab62ac54 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Returning 404 to user: Instance 2b103487-3d7a-4186-aede-cb565cd34449 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:25:43.269490 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-867b1f52-08d2-491a-a72a-8cc8ab62ac54 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/2b103487-3d7a-4186-aede-cb565cd34449" status: 404 len: 111 microversion: 2.1 time: 0.037612 Oct 30 01:25:43.269490 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1444/2862] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:43 2022] GET /compute/v2.1/servers/2b103487-3d7a-4186-aede-cb565cd34449 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:25:43.272964 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0fb1ded9-5d59-4dce-8a99-4517b6df91c6 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:43.273606 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0fb1ded9-5d59-4dce-8a99-4517b6df91c6 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] [instance: 5b5d5fa5-1e07-4145-b6c8-30e31de10165] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:43.280779 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0fb1ded9-5d59-4dce-8a99-4517b6df91c6 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:43.281277 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0fb1ded9-5d59-4dce-8a99-4517b6df91c6 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:43.281753 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0fb1ded9-5d59-4dce-8a99-4517b6df91c6 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:43.282462 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0fb1ded9-5d59-4dce-8a99-4517b6df91c6 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:43.283017 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0fb1ded9-5d59-4dce-8a99-4517b6df91c6 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:43.283454 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0fb1ded9-5d59-4dce-8a99-4517b6df91c6 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:43.346824 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-e0a37415-c16c-48fe-9636-c6f25f3444aa tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lazy-loading 'flavor' on Instance uuid 5c4bb439-785f-4ac3-a7fc-b9325b52fa19 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:25:43.432583 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e0a37415-c16c-48fe-9636-c6f25f3444aa tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] 10.222.0.13 "PUT /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19/tags/tempest-tag-56410023" status: 201 len: 0 microversion: 2.26 time: 0.396739 Oct 30 01:25:43.440244 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1419/2863] 10.222.0.13 () {62 vars in 1374 bytes} [Sun Oct 30 01:25:43 2022] PUT /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19/tags/tempest-tag-56410023 => generated 0 bytes in 402 msecs (HTTP/1.1 201) 10 headers in 484 bytes (2 switches on core 0) Oct 30 01:25:43.469086 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a13d288a-630f-4106-832a-915c4210d2ca tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:43.469641 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a13d288a-630f-4106-832a-915c4210d2ca tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 24828782-5e5e-402e-9e2b-644b166cf844] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:43.486219 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a13d288a-630f-4106-832a-915c4210d2ca tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:43.486708 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a13d288a-630f-4106-832a-915c4210d2ca tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:43.487156 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a13d288a-630f-4106-832a-915c4210d2ca tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:43.487885 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a13d288a-630f-4106-832a-915c4210d2ca tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:43.488350 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a13d288a-630f-4106-832a-915c4210d2ca tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:43.488786 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a13d288a-630f-4106-832a-915c4210d2ca tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:43.536000 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-a13d288a-630f-4106-832a-915c4210d2ca tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] HTTP exception thrown: Instance 24828782-5e5e-402e-9e2b-644b166cf844 could not be found. Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a13d288a-630f-4106-832a-915c4210d2ca tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Request method failure captured: Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: request: DELETE /compute/v2.1/servers/24828782-5e5e-402e-9e2b-644b166cf844 HTTP/1.1 Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdEZHAwNEyYVN8mbZetD1IgknrDb-nJfmTHtgPgtOr9AeQL99EuTYclSviV8aikzXcemJ-XkTVClxHn6U4xG48gAdXZcIs0fYa7Kdvvi7PzFjDxYMfOtgAp7wAvvVW7kd-J_XMzQX3yJBWm7NW5-QhmguztBnHz9UniQWs2CmNftHaI Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 8c95e97cd7e4461682b9028abb568dce Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 8c95e97cd7e4461682b9028abb568dce Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-DeleteServersTestJSON-1379968241-project Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 33691c943ec040ddb04b6648b6e945ab Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-DeleteServersTestJSON-1379968241-project Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 24828782-5e5e-402e-9e2b-644b166cf844 could not be found. Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '24828782-5e5e-402e-9e2b-644b166cf844'} Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24828782-5e5e-402e-9e2b-644b166cf844 could not be found. Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:25:43.553442 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:25:43.557349 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24828782-5e5e-402e-9e2b-644b166cf844 could not be found. Oct 30 01:25:43.557349 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:43.557349 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:43.557349 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:43.557349 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:43.557349 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:43.557349 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:43.557349 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:25:43.557349 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:25:43.557349 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24828782-5e5e-402e-9e2b-644b166cf844 could not be found. Oct 30 01:25:43.557349 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:43.564233 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a13d288a-630f-4106-832a-915c4210d2ca tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Returning 404 to user: Instance 24828782-5e5e-402e-9e2b-644b166cf844 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:25:43.568352 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a13d288a-630f-4106-832a-915c4210d2ca tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "DELETE /compute/v2.1/servers/24828782-5e5e-402e-9e2b-644b166cf844" status: 404 len: 111 microversion: 2.1 time: 0.132231 Oct 30 01:25:43.574459 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1420/2864] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:25:43 2022] DELETE /compute/v2.1/servers/24828782-5e5e-402e-9e2b-644b166cf844 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:25:43.610977 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6df456c8-81ef-44ee-a6e7-bdf7de9dfed8 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Calling method '.version_select at 0x7f44d0475ee0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:43.654066 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6df456c8-81ef-44ee-a6e7-bdf7de9dfed8 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:43.654656 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6df456c8-81ef-44ee-a6e7-bdf7de9dfed8 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:43.655881 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6df456c8-81ef-44ee-a6e7-bdf7de9dfed8 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:43.680779 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6df456c8-81ef-44ee-a6e7-bdf7de9dfed8 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] 10.222.0.13 "GET /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19/tags" status: 200 len: 34 microversion: 2.26 time: 0.104101 Oct 30 01:25:43.682243 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1421/2865] 10.222.0.13 () {60 vars in 1292 bytes} [Sun Oct 30 01:25:43 2022] GET /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19/tags => generated 34 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:43.691452 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8c70f0cf-b447-42d4-ac83-beb123d17d53 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:43.695236 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8c70f0cf-b447-42d4-ac83-beb123d17d53 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 24828782-5e5e-402e-9e2b-644b166cf844] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:43.714068 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8c70f0cf-b447-42d4-ac83-beb123d17d53 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:43.714575 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8c70f0cf-b447-42d4-ac83-beb123d17d53 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:43.715019 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8c70f0cf-b447-42d4-ac83-beb123d17d53 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:43.715783 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8c70f0cf-b447-42d4-ac83-beb123d17d53 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:43.716250 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8c70f0cf-b447-42d4-ac83-beb123d17d53 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:43.716683 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8c70f0cf-b447-42d4-ac83-beb123d17d53 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:43.759768 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-8c70f0cf-b447-42d4-ac83-beb123d17d53 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] HTTP exception thrown: Instance 24828782-5e5e-402e-9e2b-644b166cf844 could not be found. Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8c70f0cf-b447-42d4-ac83-beb123d17d53 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Request method failure captured: Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/24828782-5e5e-402e-9e2b-644b166cf844 HTTP/1.1 Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdEZHAwNEyYVN8mbZetD1IgknrDb-nJfmTHtgPgtOr9AeQL99EuTYclSviV8aikzXcemJ-XkTVClxHn6U4xG48gAdXZcIs0fYa7Kdvvi7PzFjDxYMfOtgAp7wAvvVW7kd-J_XMzQX3yJBWm7NW5-QhmguztBnHz9UniQWs2CmNftHaI Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 8c95e97cd7e4461682b9028abb568dce Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 8c95e97cd7e4461682b9028abb568dce Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-DeleteServersTestJSON-1379968241-project Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 33691c943ec040ddb04b6648b6e945ab Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-DeleteServersTestJSON-1379968241-project Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 24828782-5e5e-402e-9e2b-644b166cf844 could not be found. Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '24828782-5e5e-402e-9e2b-644b166cf844'} Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24828782-5e5e-402e-9e2b-644b166cf844 could not be found. Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24828782-5e5e-402e-9e2b-644b166cf844 could not be found. Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:43.761361 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:43.769318 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:43.769318 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:43.769318 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:43.769318 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:25:43.769318 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:25:43.769318 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24828782-5e5e-402e-9e2b-644b166cf844 could not be found. Oct 30 01:25:43.769318 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:43.776707 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8c70f0cf-b447-42d4-ac83-beb123d17d53 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Returning 404 to user: Instance 24828782-5e5e-402e-9e2b-644b166cf844 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:25:43.777989 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8c70f0cf-b447-42d4-ac83-beb123d17d53 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/24828782-5e5e-402e-9e2b-644b166cf844" status: 404 len: 111 microversion: 2.1 time: 0.094549 Oct 30 01:25:43.779223 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1422/2866] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:43 2022] GET /compute/v2.1/servers/24828782-5e5e-402e-9e2b-644b166cf844 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:25:43.791185 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a2df6c1d-3f55-4238-886f-47e46c8a0887 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Calling method '.version_select at 0x7f44c7a90d30>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:43.811789 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a2df6c1d-3f55-4238-886f-47e46c8a0887 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:43.813266 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a2df6c1d-3f55-4238-886f-47e46c8a0887 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:43.813898 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a2df6c1d-3f55-4238-886f-47e46c8a0887 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:43.814742 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a2df6c1d-3f55-4238-886f-47e46c8a0887 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] [instance: 5c4bb439-785f-4ac3-a7fc-b9325b52fa19] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:43.825733 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a2df6c1d-3f55-4238-886f-47e46c8a0887 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:43.832998 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a2df6c1d-3f55-4238-886f-47e46c8a0887 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:43.833915 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a2df6c1d-3f55-4238-886f-47e46c8a0887 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:43.834837 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a2df6c1d-3f55-4238-886f-47e46c8a0887 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:43.835476 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a2df6c1d-3f55-4238-886f-47e46c8a0887 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:43.835916 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a2df6c1d-3f55-4238-886f-47e46c8a0887 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:43.891167 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a2df6c1d-3f55-4238-886f-47e46c8a0887 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:43.891667 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a2df6c1d-3f55-4238-886f-47e46c8a0887 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:43.892106 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a2df6c1d-3f55-4238-886f-47e46c8a0887 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:43.895839 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:25:43.979110 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0fb1ded9-5d59-4dce-8a99-4517b6df91c6 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc60a96037f438ebbaaa6d25661bfc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127b4f4e1e4b43ed856faee3c5d9d88d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:43.987769 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0fb1ded9-5d59-4dce-8a99-4517b6df91c6 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] 10.222.0.13 "GET /compute/v2.1/servers/5b5d5fa5-1e07-4145-b6c8-30e31de10165" status: 200 len: 1528 microversion: 2.1 time: 0.718515 Oct 30 01:25:44.009717 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1445/2867] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:43 2022] GET /compute/v2.1/servers/5b5d5fa5-1e07-4145-b6c8-30e31de10165 => generated 1528 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:44.023511 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d01089a9-863b-47ac-89f5-3cb60ed352f2 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '.version_select at 0x7f44cc6095e0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:44.054332 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-a2df6c1d-3f55-4238-886f-47e46c8a0887 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lazy-loading 'flavor' on Instance uuid 5c4bb439-785f-4ac3-a7fc-b9325b52fa19 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:25:44.120202 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d01089a9-863b-47ac-89f5-3cb60ed352f2 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "GET /compute/v2.1/images/50669d24-ab56-475f-8236-0ff19406f3eb" status: 200 len: 1424 microversion: 2.1 time: 0.108894 Oct 30 01:25:44.124628 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a2df6c1d-3f55-4238-886f-47e46c8a0887 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19/tags/tempest-tag-56410023" status: 204 len: 0 microversion: 2.26 time: 0.344023 Oct 30 01:25:44.133983 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1446/2868] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:25:44 2022] GET /compute/v2.1/images/50669d24-ab56-475f-8236-0ff19406f3eb => generated 1424 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:44.140044 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1423/2869] 10.222.0.13 () {60 vars in 1358 bytes} [Sun Oct 30 01:25:43 2022] DELETE /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19/tags/tempest-tag-56410023 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 30 01:25:44.157575 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-287ada63-3569-4431-93ab-1b479e085517 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:44.158348 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-287ada63-3569-4431-93ab-1b479e085517 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: 688c35c4-9529-49df-8255-98cd2b56c314] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:44.164695 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d243e023-1be4-4a1f-b9ec-39a3f7702a67 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:44.165366 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d243e023-1be4-4a1f-b9ec-39a3f7702a67 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: 64824cfc-200e-4ee1-8698-011b644ae315] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:44.189909 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-287ada63-3569-4431-93ab-1b479e085517 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:44.193191 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d243e023-1be4-4a1f-b9ec-39a3f7702a67 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:44.193675 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-287ada63-3569-4431-93ab-1b479e085517 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:44.198373 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-287ada63-3569-4431-93ab-1b479e085517 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:44.199233 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d243e023-1be4-4a1f-b9ec-39a3f7702a67 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:44.201013 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d243e023-1be4-4a1f-b9ec-39a3f7702a67 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:44.203490 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d243e023-1be4-4a1f-b9ec-39a3f7702a67 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:44.203978 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d243e023-1be4-4a1f-b9ec-39a3f7702a67 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:44.204705 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-287ada63-3569-4431-93ab-1b479e085517 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:44.205450 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-287ada63-3569-4431-93ab-1b479e085517 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:44.205876 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-287ada63-3569-4431-93ab-1b479e085517 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:44.206974 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d243e023-1be4-4a1f-b9ec-39a3f7702a67 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:44.549671 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-287ada63-3569-4431-93ab-1b479e085517 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:44.568687 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-287ada63-3569-4431-93ab-1b479e085517 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/688c35c4-9529-49df-8255-98cd2b56c314" status: 200 len: 1210 microversion: 2.1 time: 0.425819 Oct 30 01:25:44.570278 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1447/2870] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:44 2022] GET /compute/v2.1/servers/688c35c4-9529-49df-8255-98cd2b56c314 => generated 1210 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:44.577640 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-120db1cc-532f-4b9c-8d05-502a1a004b20 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Calling method '.version_select at 0x7f44cc1a0790>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:44.586767 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-120db1cc-532f-4b9c-8d05-502a1a004b20 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:44.587732 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-120db1cc-532f-4b9c-8d05-502a1a004b20 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:44.588506 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-120db1cc-532f-4b9c-8d05-502a1a004b20 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:44.600477 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-120db1cc-532f-4b9c-8d05-502a1a004b20 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] 10.222.0.13 "GET /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19/tags" status: 200 len: 12 microversion: 2.26 time: 0.028499 Oct 30 01:25:44.601631 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1448/2871] 10.222.0.13 () {60 vars in 1292 bytes} [Sun Oct 30 01:25:44 2022] GET /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19/tags => generated 12 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:44.608166 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-ebb74526-2503-4b77-83bc-9073b9bd0c36 req-d9ed7bf4-f744-4b6e-a4c1-444a43eee1c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "403e0292-c082-4655-ad08-b5dc3a7f8305", "name": "network-vif-deleted", "tag": "ef3e2c7d-b1a5-43dc-a664-896af7f0b0ed"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:25:44.621266 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ebb74526-2503-4b77-83bc-9073b9bd0c36 req-d9ed7bf4-f744-4b6e-a4c1-444a43eee1c6 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:44.622767 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ebb74526-2503-4b77-83bc-9073b9bd0c36 req-d9ed7bf4-f744-4b6e-a4c1-444a43eee1c6 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:44.628441 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ebb74526-2503-4b77-83bc-9073b9bd0c36 req-d9ed7bf4-f744-4b6e-a4c1-444a43eee1c6 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:44.642985 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-ebb74526-2503-4b77-83bc-9073b9bd0c36 req-d9ed7bf4-f744-4b6e-a4c1-444a43eee1c6 service nova] Creating event network-vif-deleted:ef3e2c7d-b1a5-43dc-a664-896af7f0b0ed for instance 403e0292-c082-4655-ad08-b5dc3a7f8305 on n-h2-master-1 Oct 30 01:25:44.655905 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-ebb74526-2503-4b77-83bc-9073b9bd0c36 req-d9ed7bf4-f744-4b6e-a4c1-444a43eee1c6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052619 Oct 30 01:25:44.656883 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1449/2872] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:25:44.668224 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9911687b-e761-45fc-ad71-f08172c0e11b tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Calling method '.version_select at 0x7f44cc6f3ee0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:44.689499 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9911687b-e761-45fc-ad71-f08172c0e11b tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:44.697620 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9911687b-e761-45fc-ad71-f08172c0e11b tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:44.699662 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9911687b-e761-45fc-ad71-f08172c0e11b tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:44.700964 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9911687b-e761-45fc-ad71-f08172c0e11b tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] [instance: 5c4bb439-785f-4ac3-a7fc-b9325b52fa19] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:44.715507 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9911687b-e761-45fc-ad71-f08172c0e11b tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:44.718027 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9911687b-e761-45fc-ad71-f08172c0e11b tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:44.719814 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9911687b-e761-45fc-ad71-f08172c0e11b tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:44.722978 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9911687b-e761-45fc-ad71-f08172c0e11b tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:44.723736 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9911687b-e761-45fc-ad71-f08172c0e11b tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:44.725085 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9911687b-e761-45fc-ad71-f08172c0e11b tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:44.785348 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9911687b-e761-45fc-ad71-f08172c0e11b tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:44.788295 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9911687b-e761-45fc-ad71-f08172c0e11b tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:44.789809 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9911687b-e761-45fc-ad71-f08172c0e11b tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:44.833700 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-9911687b-e761-45fc-ad71-f08172c0e11b tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lazy-loading 'flavor' on Instance uuid 5c4bb439-785f-4ac3-a7fc-b9325b52fa19 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:25:44.866368 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9911687b-e761-45fc-ad71-f08172c0e11b tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19/tags" status: 204 len: 0 microversion: 2.26 time: 0.202601 Oct 30 01:25:44.868182 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1450/2873] 10.222.0.13 () {60 vars in 1295 bytes} [Sun Oct 30 01:25:44 2022] DELETE /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19/tags => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 30 01:25:45.087086 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d243e023-1be4-4a1f-b9ec-39a3f7702a67 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07f2b8c31f54c62aaba73ca2bd2edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c59bd73c7874a00b52ec7c5c4142039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:45.098535 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d243e023-1be4-4a1f-b9ec-39a3f7702a67 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] 10.222.0.13 "GET /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315" status: 200 len: 1355 microversion: 2.1 time: 0.957318 Oct 30 01:25:45.115789 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1424/2874] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:44 2022] GET /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315 => generated 1355 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:45.130139 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7dc60725-191d-4643-9715-1fb7c038146b tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Calling method '.version_select at 0x7f44c7a90d30>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:45.157291 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7dc60725-191d-4643-9715-1fb7c038146b tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:45.157689 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7dc60725-191d-4643-9715-1fb7c038146b tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:45.162702 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7dc60725-191d-4643-9715-1fb7c038146b tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:45.163749 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7dc60725-191d-4643-9715-1fb7c038146b tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] [instance: 5c4bb439-785f-4ac3-a7fc-b9325b52fa19] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:45.179764 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7dc60725-191d-4643-9715-1fb7c038146b tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:45.180559 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7dc60725-191d-4643-9715-1fb7c038146b tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:45.181183 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7dc60725-191d-4643-9715-1fb7c038146b tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:45.182221 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7dc60725-191d-4643-9715-1fb7c038146b tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:45.183607 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7dc60725-191d-4643-9715-1fb7c038146b tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:45.184284 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7dc60725-191d-4643-9715-1fb7c038146b tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:45.221191 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-790290df-119e-478d-ab43-5d12102f0d70 tempest-KeyPairsV2TestJSON-633999552 tempest-KeyPairsV2TestJSON-633999552-project] Action: 'create', calling method: .version_select at 0x7f44cc41b5e0>, body: {"keypair": {"name": "tempest-keypair-17987409", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFH3TzM0i4iENhBmJVu9Z14hwl7rXxmc+s+H2K7BTHmH+fjGr9vDowSFdHxfXrB2LpFfh6MvYTbucNBgn+TYqojyTxPiLOn5PUYwdewCTvTE8dDUxiycLJLOhtvxD1Ddw=="}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:25:45.267977 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7dc60725-191d-4643-9715-1fb7c038146b tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:45.269092 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7dc60725-191d-4643-9715-1fb7c038146b tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:45.270041 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7dc60725-191d-4643-9715-1fb7c038146b tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:45.271376 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-790290df-119e-478d-ab43-5d12102f0d70 tempest-KeyPairsV2TestJSON-633999552 tempest-KeyPairsV2TestJSON-633999552-project] Getting quotas for project 6ec2daf2c00e4a5da96640aa09f998c4. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:25:45.282019 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-790290df-119e-478d-ab43-5d12102f0d70 tempest-KeyPairsV2TestJSON-633999552 tempest-KeyPairsV2TestJSON-633999552-project] Getting quotas for user 63c9832e3bb94fc0b4be22d4f8130ddb and project 6ec2daf2c00e4a5da96640aa09f998c4. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:25:45.283164 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7dc60725-191d-4643-9715-1fb7c038146b tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:45.283803 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7dc60725-191d-4643-9715-1fb7c038146b tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:45.284451 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7dc60725-191d-4643-9715-1fb7c038146b tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:45.405554 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-790290df-119e-478d-ab43-5d12102f0d70 tempest-KeyPairsV2TestJSON-633999552 tempest-KeyPairsV2TestJSON-633999552-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.533737 Oct 30 01:25:45.412335 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1451/2875] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 30 01:25:44 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:25:45.428019 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-7dc60725-191d-4643-9715-1fb7c038146b tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lazy-loading 'flavor' on Instance uuid 5c4bb439-785f-4ac3-a7fc-b9325b52fa19 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:25:45.428938 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bf57ad7f-04e6-4792-8fa2-e87ff709ddf7 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:45.430669 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bf57ad7f-04e6-4792-8fa2-e87ff709ddf7 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] [instance: 5b5d5fa5-1e07-4145-b6c8-30e31de10165] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:45.465736 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bf57ad7f-04e6-4792-8fa2-e87ff709ddf7 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:45.467403 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bf57ad7f-04e6-4792-8fa2-e87ff709ddf7 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:45.468821 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bf57ad7f-04e6-4792-8fa2-e87ff709ddf7 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:45.469237 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7dc60725-191d-4643-9715-1fb7c038146b tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] 10.222.0.13 "PUT /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19/tags/tempest-tag-1833332483" status: 201 len: 0 microversion: 2.26 time: 0.351959 Oct 30 01:25:45.469945 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1425/2876] 10.222.0.13 () {62 vars in 1380 bytes} [Sun Oct 30 01:25:45 2022] PUT /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19/tags/tempest-tag-1833332483 => generated 0 bytes in 353 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 30 01:25:45.472020 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bf57ad7f-04e6-4792-8fa2-e87ff709ddf7 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:45.475872 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bf57ad7f-04e6-4792-8fa2-e87ff709ddf7 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:45.478469 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bf57ad7f-04e6-4792-8fa2-e87ff709ddf7 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:45.483336 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b04e16ea-57bc-4a87-b1f5-e2824cd784d8 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '.version_select at 0x7f44cc4c7ca0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:45.570333 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b04e16ea-57bc-4a87-b1f5-e2824cd784d8 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "GET /compute/v2.1/images/50669d24-ab56-475f-8236-0ff19406f3eb" status: 200 len: 1424 microversion: 2.1 time: 0.097335 Oct 30 01:25:45.571278 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1426/2877] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:25:45 2022] GET /compute/v2.1/images/50669d24-ab56-475f-8236-0ff19406f3eb => generated 1424 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:45.581586 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5ec078da-f4b0-4940-a581-bc98eff3cb0d tempest-KeyPairsV2TestJSON-633999552 tempest-KeyPairsV2TestJSON-633999552-project] Calling method '.version_select at 0x7f44d0475700>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:45.611161 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5ec078da-f4b0-4940-a581-bc98eff3cb0d tempest-KeyPairsV2TestJSON-633999552 tempest-KeyPairsV2TestJSON-633999552-project] 10.222.0.13 "GET /compute/v2.1/os-keypairs/tempest-keypair-17987409" status: 200 len: 496 microversion: 2.1 time: 0.037934 Oct 30 01:25:45.611161 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1427/2878] 10.222.0.13 () {58 vars in 1212 bytes} [Sun Oct 30 01:25:45 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-17987409 => generated 496 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:25:45.616193 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-39233e27-c3f0-4f7f-b538-f204bae072fa tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Calling method '.version_select at 0x7f44cc354280>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:45.630356 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-39233e27-c3f0-4f7f-b538-f204bae072fa tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:45.646214 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-39233e27-c3f0-4f7f-b538-f204bae072fa tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:45.646920 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-39233e27-c3f0-4f7f-b538-f204bae072fa tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:45.647837 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-39233e27-c3f0-4f7f-b538-f204bae072fa tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] [instance: 5c4bb439-785f-4ac3-a7fc-b9325b52fa19] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:45.660053 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-39233e27-c3f0-4f7f-b538-f204bae072fa tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:45.660929 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-39233e27-c3f0-4f7f-b538-f204bae072fa tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:45.661999 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-39233e27-c3f0-4f7f-b538-f204bae072fa tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:45.664649 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-39233e27-c3f0-4f7f-b538-f204bae072fa tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:45.665315 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-39233e27-c3f0-4f7f-b538-f204bae072fa tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:45.670532 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-39233e27-c3f0-4f7f-b538-f204bae072fa tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:45.739683 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-39233e27-c3f0-4f7f-b538-f204bae072fa tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:45.748022 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-39233e27-c3f0-4f7f-b538-f204bae072fa tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:45.748752 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-39233e27-c3f0-4f7f-b538-f204bae072fa tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:45.775016 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-39233e27-c3f0-4f7f-b538-f204bae072fa tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:45.775524 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-39233e27-c3f0-4f7f-b538-f204bae072fa tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:45.775978 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-39233e27-c3f0-4f7f-b538-f204bae072fa tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:45.896535 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bf57ad7f-04e6-4792-8fa2-e87ff709ddf7 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc60a96037f438ebbaaa6d25661bfc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127b4f4e1e4b43ed856faee3c5d9d88d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:45.900651 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-39233e27-c3f0-4f7f-b538-f204bae072fa tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lazy-loading 'flavor' on Instance uuid 5c4bb439-785f-4ac3-a7fc-b9325b52fa19 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:25:45.910522 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bf57ad7f-04e6-4792-8fa2-e87ff709ddf7 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] 10.222.0.13 "GET /compute/v2.1/servers/5b5d5fa5-1e07-4145-b6c8-30e31de10165" status: 200 len: 1528 microversion: 2.1 time: 0.494612 Oct 30 01:25:45.918306 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1452/2879] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:45 2022] GET /compute/v2.1/servers/5b5d5fa5-1e07-4145-b6c8-30e31de10165 => generated 1528 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:45.924135 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-90454186-d21a-437c-a841-199d70fd4907 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:45.924930 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-90454186-d21a-437c-a841-199d70fd4907 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: 688c35c4-9529-49df-8255-98cd2b56c314] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:45.937812 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-90454186-d21a-437c-a841-199d70fd4907 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:45.942017 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-90454186-d21a-437c-a841-199d70fd4907 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:45.942793 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-90454186-d21a-437c-a841-199d70fd4907 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:45.943742 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-90454186-d21a-437c-a841-199d70fd4907 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:45.944408 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-90454186-d21a-437c-a841-199d70fd4907 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:45.945032 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-90454186-d21a-437c-a841-199d70fd4907 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:45.950510 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-39233e27-c3f0-4f7f-b538-f204bae072fa tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] 10.222.0.13 "PUT /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19/tags/tempest-tag-1045476917" status: 201 len: 0 microversion: 2.26 time: 0.335927 Oct 30 01:25:45.957382 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1428/2880] 10.222.0.13 () {62 vars in 1380 bytes} [Sun Oct 30 01:25:45 2022] PUT /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19/tags/tempest-tag-1045476917 => generated 0 bytes in 346 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 30 01:25:45.965203 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bb1c73b0-2988-47f4-b595-03fc910b18ea tempest-KeyPairsV2TestJSON-633999552 tempest-KeyPairsV2TestJSON-633999552-project] Calling method '.version_select at 0x7f44d0475670>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:46.074362 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bb1c73b0-2988-47f4-b595-03fc910b18ea tempest-KeyPairsV2TestJSON-633999552 tempest-KeyPairsV2TestJSON-633999552-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-17987409" status: 202 len: 0 microversion: 2.1 time: 0.115598 Oct 30 01:25:46.076036 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1429/2881] 10.222.0.13 () {58 vars in 1215 bytes} [Sun Oct 30 01:25:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-17987409 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:25:46.083546 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-90454186-d21a-437c-a841-199d70fd4907 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:46.085890 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-14a275c0-fac1-4b9a-974e-7fb31df3ea0a tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Calling method '.version_select at 0x7f44cc337040>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:46.095589 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-90454186-d21a-437c-a841-199d70fd4907 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/688c35c4-9529-49df-8255-98cd2b56c314" status: 200 len: 1258 microversion: 2.1 time: 0.174859 Oct 30 01:25:46.097674 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1453/2882] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:45 2022] GET /compute/v2.1/servers/688c35c4-9529-49df-8255-98cd2b56c314 => generated 1258 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:46.104270 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14a275c0-fac1-4b9a-974e-7fb31df3ea0a tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:46.110736 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-608f4c74-a5b9-4951-b459-6b605ab048da tempest-KeyPairsV2TestJSON-633999552 tempest-KeyPairsV2TestJSON-633999552-project] Action: 'create', calling method: .version_select at 0x7f44c7ee33a0>, body: {"keypair": {"name": "tempest-keypair-2041832186", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUu3LJg0rrq0soMBWY09JuS42Gr/Gu6CKmnWCNzUEmECRm8aCVlKOEsuqYxoI3wCujUtlgiZafI8aKXl6NDQdTz4MBnzBeKZbw2eRc61hprflrxd2bEItqAQr0uyy0bTQ=="}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:25:46.111504 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14a275c0-fac1-4b9a-974e-7fb31df3ea0a tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:46.114538 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14a275c0-fac1-4b9a-974e-7fb31df3ea0a tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:46.114538 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-14a275c0-fac1-4b9a-974e-7fb31df3ea0a tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] [instance: 5c4bb439-785f-4ac3-a7fc-b9325b52fa19] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:46.129527 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14a275c0-fac1-4b9a-974e-7fb31df3ea0a tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:46.130408 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14a275c0-fac1-4b9a-974e-7fb31df3ea0a tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:46.134164 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14a275c0-fac1-4b9a-974e-7fb31df3ea0a tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:46.136082 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14a275c0-fac1-4b9a-974e-7fb31df3ea0a tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:46.136680 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:25:46.138393 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14a275c0-fac1-4b9a-974e-7fb31df3ea0a tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:46.139099 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14a275c0-fac1-4b9a-974e-7fb31df3ea0a tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:46.151565 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-608f4c74-a5b9-4951-b459-6b605ab048da tempest-KeyPairsV2TestJSON-633999552 tempest-KeyPairsV2TestJSON-633999552-project] Getting quotas for project 6ec2daf2c00e4a5da96640aa09f998c4. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:25:46.163487 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-608f4c74-a5b9-4951-b459-6b605ab048da tempest-KeyPairsV2TestJSON-633999552 tempest-KeyPairsV2TestJSON-633999552-project] Getting quotas for user 63c9832e3bb94fc0b4be22d4f8130ddb and project 6ec2daf2c00e4a5da96640aa09f998c4. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:25:46.207790 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14a275c0-fac1-4b9a-974e-7fb31df3ea0a tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:46.210461 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14a275c0-fac1-4b9a-974e-7fb31df3ea0a tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:46.216608 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14a275c0-fac1-4b9a-974e-7fb31df3ea0a tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:46.309121 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-608f4c74-a5b9-4951-b459-6b605ab048da tempest-KeyPairsV2TestJSON-633999552 tempest-KeyPairsV2TestJSON-633999552-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.210325 Oct 30 01:25:46.310535 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1454/2883] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 30 01:25:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:25:46.315497 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-456e7c81-53fa-4c5a-9bbb-93ef669b127a tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:46.316106 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-456e7c81-53fa-4c5a-9bbb-93ef669b127a tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: 64824cfc-200e-4ee1-8698-011b644ae315] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:46.324616 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-456e7c81-53fa-4c5a-9bbb-93ef669b127a tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:46.324616 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-456e7c81-53fa-4c5a-9bbb-93ef669b127a tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:46.325065 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-456e7c81-53fa-4c5a-9bbb-93ef669b127a tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:46.325815 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-456e7c81-53fa-4c5a-9bbb-93ef669b127a tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:46.326272 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-456e7c81-53fa-4c5a-9bbb-93ef669b127a tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:46.326957 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-456e7c81-53fa-4c5a-9bbb-93ef669b127a tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:46.355715 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-14a275c0-fac1-4b9a-974e-7fb31df3ea0a tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lazy-loading 'flavor' on Instance uuid 5c4bb439-785f-4ac3-a7fc-b9325b52fa19 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:25:46.401271 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-14a275c0-fac1-4b9a-974e-7fb31df3ea0a tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19/tags" status: 204 len: 0 microversion: 2.26 time: 0.322663 Oct 30 01:25:46.402185 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1430/2884] 10.222.0.13 () {60 vars in 1295 bytes} [Sun Oct 30 01:25:46 2022] DELETE /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19/tags => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 30 01:25:46.407656 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-89c8fde3-7e01-4c88-8f8b-eeb254e36944 tempest-KeyPairsV2TestJSON-633999552 tempest-KeyPairsV2TestJSON-633999552-project] Calling method '.version_select at 0x7f44d0484940>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:46.505109 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-89c8fde3-7e01-4c88-8f8b-eeb254e36944 tempest-KeyPairsV2TestJSON-633999552 tempest-KeyPairsV2TestJSON-633999552-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2041832186" status: 202 len: 0 microversion: 2.1 time: 0.101676 Oct 30 01:25:46.512614 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1431/2885] 10.222.0.13 () {58 vars in 1221 bytes} [Sun Oct 30 01:25:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2041832186 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:25:46.516930 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-86de6174-c815-4259-a245-14f050b3ea11 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Calling method '.version_select at 0x7f44cc337310>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:46.543393 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-86de6174-c815-4259-a245-14f050b3ea11 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:46.543965 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-86de6174-c815-4259-a245-14f050b3ea11 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:46.544418 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-86de6174-c815-4259-a245-14f050b3ea11 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:46.563768 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-86de6174-c815-4259-a245-14f050b3ea11 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] 10.222.0.13 "GET /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19/tags" status: 200 len: 12 microversion: 2.26 time: 0.052388 Oct 30 01:25:46.565281 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1432/2886] 10.222.0.13 () {60 vars in 1292 bytes} [Sun Oct 30 01:25:46 2022] GET /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19/tags => generated 12 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:46.578826 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9fc8539c-ec5e-4c84-8e73-425726fa769e tempest-KeyPairsV2TestJSON-633999552 tempest-KeyPairsV2TestJSON-633999552-project] Action: 'create', calling method: .version_select at 0x7f44d0417c10>, body: {"keypair": {"name": "tempest-keypair-390632207", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:25:46.613580 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-9fc8539c-ec5e-4c84-8e73-425726fa769e tempest-KeyPairsV2TestJSON-633999552 tempest-KeyPairsV2TestJSON-633999552-project] Getting quotas for project 6ec2daf2c00e4a5da96640aa09f998c4. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:25:46.639413 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-9fc8539c-ec5e-4c84-8e73-425726fa769e tempest-KeyPairsV2TestJSON-633999552 tempest-KeyPairsV2TestJSON-633999552-project] Getting quotas for user 63c9832e3bb94fc0b4be22d4f8130ddb and project 6ec2daf2c00e4a5da96640aa09f998c4. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:25:46.639628 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:25:46.776785 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9fc8539c-ec5e-4c84-8e73-425726fa769e tempest-KeyPairsV2TestJSON-633999552 tempest-KeyPairsV2TestJSON-633999552-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.210240 Oct 30 01:25:46.780661 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1433/2887] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 30 01:25:46 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:25:46.805552 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8f6c0bfa-ab63-4aa4-a442-35be1b35d450 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Calling method '.version_select at 0x7f44cc354f70>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:46.828703 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f6c0bfa-ab63-4aa4-a442-35be1b35d450 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:46.831507 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f6c0bfa-ab63-4aa4-a442-35be1b35d450 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:46.832760 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f6c0bfa-ab63-4aa4-a442-35be1b35d450 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:46.834917 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8f6c0bfa-ab63-4aa4-a442-35be1b35d450 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] [instance: 5c4bb439-785f-4ac3-a7fc-b9325b52fa19] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:46.855309 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f6c0bfa-ab63-4aa4-a442-35be1b35d450 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:46.855810 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f6c0bfa-ab63-4aa4-a442-35be1b35d450 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:46.860729 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f6c0bfa-ab63-4aa4-a442-35be1b35d450 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:46.864252 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f6c0bfa-ab63-4aa4-a442-35be1b35d450 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:46.865711 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f6c0bfa-ab63-4aa4-a442-35be1b35d450 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:46.866171 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f6c0bfa-ab63-4aa4-a442-35be1b35d450 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:46.975545 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f6c0bfa-ab63-4aa4-a442-35be1b35d450 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:46.976756 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f6c0bfa-ab63-4aa4-a442-35be1b35d450 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:46.977210 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f6c0bfa-ab63-4aa4-a442-35be1b35d450 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:46.992085 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-8f6c0bfa-ab63-4aa4-a442-35be1b35d450 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lazy-loading 'flavor' on Instance uuid 5c4bb439-785f-4ac3-a7fc-b9325b52fa19 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:25:47.010234 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8f6c0bfa-ab63-4aa4-a442-35be1b35d450 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19/tags" status: 204 len: 0 microversion: 2.26 time: 0.228236 Oct 30 01:25:47.016039 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1434/2888] 10.222.0.13 () {60 vars in 1295 bytes} [Sun Oct 30 01:25:46 2022] DELETE /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19/tags => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 30 01:25:47.024321 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-33298068-53bb-4dc6-908f-5b913104362f tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '.version_select at 0x7f44d04a9a60>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:47.122578 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-33298068-53bb-4dc6-908f-5b913104362f tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "GET /compute/v2.1/images/50669d24-ab56-475f-8236-0ff19406f3eb" status: 200 len: 1424 microversion: 2.1 time: 0.104880 Oct 30 01:25:47.129394 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1435/2889] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:25:47 2022] GET /compute/v2.1/images/50669d24-ab56-475f-8236-0ff19406f3eb => generated 1424 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:47.139654 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-99bd8831-35e5-4206-9558-892e35fef62a tempest-KeyPairsV2TestJSON-633999552 tempest-KeyPairsV2TestJSON-633999552-project] Calling method '.version_select at 0x7f44cc34a820>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:47.251954 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-99bd8831-35e5-4206-9558-892e35fef62a tempest-KeyPairsV2TestJSON-633999552 tempest-KeyPairsV2TestJSON-633999552-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-390632207" status: 202 len: 0 microversion: 2.1 time: 0.126899 Oct 30 01:25:47.252912 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1436/2890] 10.222.0.13 () {58 vars in 1218 bytes} [Sun Oct 30 01:25:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-390632207 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:25:47.259366 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e0f96493-1453-4293-b280-68bb32a5cc4f tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:47.261982 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e0f96493-1453-4293-b280-68bb32a5cc4f tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] [instance: 5b5d5fa5-1e07-4145-b6c8-30e31de10165] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:47.292796 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e0f96493-1453-4293-b280-68bb32a5cc4f tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:47.292796 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e0f96493-1453-4293-b280-68bb32a5cc4f tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:47.292796 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e0f96493-1453-4293-b280-68bb32a5cc4f tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:47.292796 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e0f96493-1453-4293-b280-68bb32a5cc4f tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:47.297100 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e0f96493-1453-4293-b280-68bb32a5cc4f tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:47.297623 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e0f96493-1453-4293-b280-68bb32a5cc4f tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:47.324119 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-456e7c81-53fa-4c5a-9bbb-93ef669b127a tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07f2b8c31f54c62aaba73ca2bd2edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c59bd73c7874a00b52ec7c5c4142039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:47.335560 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-456e7c81-53fa-4c5a-9bbb-93ef669b127a tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] 10.222.0.13 "GET /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315" status: 200 len: 1355 microversion: 2.1 time: 1.023564 Oct 30 01:25:47.343448 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1455/2891] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:46 2022] GET /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315 => generated 1355 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:47.349600 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-648895b6-78dc-44e4-ade8-faec5f6c31d1 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Calling method '.version_select at 0x7f44c7ee35e0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:47.363150 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-648895b6-78dc-44e4-ade8-faec5f6c31d1 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:47.366779 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-648895b6-78dc-44e4-ade8-faec5f6c31d1 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:47.367555 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-648895b6-78dc-44e4-ade8-faec5f6c31d1 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:47.368244 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-648895b6-78dc-44e4-ade8-faec5f6c31d1 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] [instance: 5c4bb439-785f-4ac3-a7fc-b9325b52fa19] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:47.377788 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-648895b6-78dc-44e4-ade8-faec5f6c31d1 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:47.379248 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-648895b6-78dc-44e4-ade8-faec5f6c31d1 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:47.380182 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-648895b6-78dc-44e4-ade8-faec5f6c31d1 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:47.382117 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-648895b6-78dc-44e4-ade8-faec5f6c31d1 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:47.384075 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-648895b6-78dc-44e4-ade8-faec5f6c31d1 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:47.384953 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-648895b6-78dc-44e4-ade8-faec5f6c31d1 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:47.431706 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-648895b6-78dc-44e4-ade8-faec5f6c31d1 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:47.432923 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-648895b6-78dc-44e4-ade8-faec5f6c31d1 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:47.433554 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-648895b6-78dc-44e4-ade8-faec5f6c31d1 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:47.460961 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-648895b6-78dc-44e4-ade8-faec5f6c31d1 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:47.464155 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-648895b6-78dc-44e4-ade8-faec5f6c31d1 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:47.464758 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-648895b6-78dc-44e4-ade8-faec5f6c31d1 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:47.522231 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e0f96493-1453-4293-b280-68bb32a5cc4f tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc60a96037f438ebbaaa6d25661bfc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127b4f4e1e4b43ed856faee3c5d9d88d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:47.535652 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e0f96493-1453-4293-b280-68bb32a5cc4f tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] 10.222.0.13 "GET /compute/v2.1/servers/5b5d5fa5-1e07-4145-b6c8-30e31de10165" status: 200 len: 1486 microversion: 2.1 time: 0.279644 Oct 30 01:25:47.539583 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1437/2892] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:47 2022] GET /compute/v2.1/servers/5b5d5fa5-1e07-4145-b6c8-30e31de10165 => generated 1486 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:47.561649 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ba404c5c-f950-4288-b4b3-ffa6547d20ba tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:47.563467 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ba404c5c-f950-4288-b4b3-ffa6547d20ba tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: 688c35c4-9529-49df-8255-98cd2b56c314] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:47.578678 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ba404c5c-f950-4288-b4b3-ffa6547d20ba tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:47.580104 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ba404c5c-f950-4288-b4b3-ffa6547d20ba tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:47.580565 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ba404c5c-f950-4288-b4b3-ffa6547d20ba tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:47.583532 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ba404c5c-f950-4288-b4b3-ffa6547d20ba tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:47.584032 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ba404c5c-f950-4288-b4b3-ffa6547d20ba tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:47.584485 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ba404c5c-f950-4288-b4b3-ffa6547d20ba tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:47.629845 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-648895b6-78dc-44e4-ade8-faec5f6c31d1 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lazy-loading 'flavor' on Instance uuid 5c4bb439-785f-4ac3-a7fc-b9325b52fa19 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:25:47.687077 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-648895b6-78dc-44e4-ade8-faec5f6c31d1 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] 10.222.0.13 "PUT /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19/tags/tempest-tag-1042728505" status: 201 len: 0 microversion: 2.26 time: 0.342151 Oct 30 01:25:47.691728 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1456/2893] 10.222.0.13 () {62 vars in 1380 bytes} [Sun Oct 30 01:25:47 2022] PUT /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19/tags/tempest-tag-1042728505 => generated 0 bytes in 347 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 30 01:25:47.707942 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-0c6b35ff-7e72-4ac6-aec9-643426db4040 req-b869aafa-ff48-4e93-a9ab-a5e9d3a97468 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b5d5fa5-1e07-4145-b6c8-30e31de10165", "name": "network-vif-deleted", "tag": "3058ff4b-eaf6-419c-a4e9-7aed07c9af1f"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:25:47.739460 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ba404c5c-f950-4288-b4b3-ffa6547d20ba tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:47.753433 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ba404c5c-f950-4288-b4b3-ffa6547d20ba tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/688c35c4-9529-49df-8255-98cd2b56c314" status: 200 len: 1264 microversion: 2.1 time: 0.211920 Oct 30 01:25:47.754928 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1438/2894] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:47 2022] GET /compute/v2.1/servers/688c35c4-9529-49df-8255-98cd2b56c314 => generated 1264 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:47.755039 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-0c6b35ff-7e72-4ac6-aec9-643426db4040 req-b869aafa-ff48-4e93-a9ab-a5e9d3a97468 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:47.756109 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-0c6b35ff-7e72-4ac6-aec9-643426db4040 req-b869aafa-ff48-4e93-a9ab-a5e9d3a97468 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:47.756583 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-0c6b35ff-7e72-4ac6-aec9-643426db4040 req-b869aafa-ff48-4e93-a9ab-a5e9d3a97468 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:47.763749 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f7ccbb3a-0707-4323-9026-2813091badcf tempest-KeyPairsV2TestJSON-633999552 tempest-KeyPairsV2TestJSON-633999552-project] Action: 'create', calling method: .version_select at 0x7f44cc135f70>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-2041090449", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHn1fPMi9Ic8++ViV1YehiKF1Yfjqu1YfTc0NjFp/P2xOp6d4uWGAKINVBJV2Rt7odptJ2xnTrhG5jIafG+cL7BMyZ6gytNOe/XMoX96Em2m9OW+mFPa2Ybvt8i46cdN2Q=="}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:25:47.789215 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-0c6b35ff-7e72-4ac6-aec9-643426db4040 req-b869aafa-ff48-4e93-a9ab-a5e9d3a97468 service nova] Creating event network-vif-deleted:3058ff4b-eaf6-419c-a4e9-7aed07c9af1f for instance 5b5d5fa5-1e07-4145-b6c8-30e31de10165 on n-h1-master-1 Oct 30 01:25:47.806273 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-0c6b35ff-7e72-4ac6-aec9-643426db4040 req-b869aafa-ff48-4e93-a9ab-a5e9d3a97468 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112472 Oct 30 01:25:47.808304 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-f7ccbb3a-0707-4323-9026-2813091badcf tempest-KeyPairsV2TestJSON-633999552 tempest-KeyPairsV2TestJSON-633999552-project] Getting quotas for project 6ec2daf2c00e4a5da96640aa09f998c4. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:25:47.812305 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1457/2895] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:25:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:25:47.822157 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-f7ccbb3a-0707-4323-9026-2813091badcf tempest-KeyPairsV2TestJSON-633999552 tempest-KeyPairsV2TestJSON-633999552-project] Getting quotas for user 63c9832e3bb94fc0b4be22d4f8130ddb and project 6ec2daf2c00e4a5da96640aa09f998c4. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:25:47.825014 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6e8b0375-7ce8-4028-b8c2-4fb5fdab8973 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Calling method '.version_select at 0x7f44cc557dc0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:47.886779 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e8b0375-7ce8-4028-b8c2-4fb5fdab8973 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:47.887361 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e8b0375-7ce8-4028-b8c2-4fb5fdab8973 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:47.887813 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e8b0375-7ce8-4028-b8c2-4fb5fdab8973 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:47.890950 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6e8b0375-7ce8-4028-b8c2-4fb5fdab8973 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] [instance: 5c4bb439-785f-4ac3-a7fc-b9325b52fa19] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:47.924117 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e8b0375-7ce8-4028-b8c2-4fb5fdab8973 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:47.924692 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e8b0375-7ce8-4028-b8c2-4fb5fdab8973 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:47.925163 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e8b0375-7ce8-4028-b8c2-4fb5fdab8973 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:47.934067 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f7ccbb3a-0707-4323-9026-2813091badcf tempest-KeyPairsV2TestJSON-633999552 tempest-KeyPairsV2TestJSON-633999552-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.177345 Oct 30 01:25:47.934747 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1439/2896] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 30 01:25:47 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:25:47.940422 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-e0d9a851-08cf-44bc-aeff-305c435bbf7c req-11281e4e-8e31-4440-a07e-dd3df8abc98e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64824cfc-200e-4ee1-8698-011b644ae315", "name": "network-vif-plugged", "status": "completed", "tag": "ade8fcd2-9810-47b4-a0b0-468ebf236d36"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:25:47.940589 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e8b0375-7ce8-4028-b8c2-4fb5fdab8973 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:47.943875 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e8b0375-7ce8-4028-b8c2-4fb5fdab8973 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:47.945110 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e8b0375-7ce8-4028-b8c2-4fb5fdab8973 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:47.961695 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e0d9a851-08cf-44bc-aeff-305c435bbf7c req-11281e4e-8e31-4440-a07e-dd3df8abc98e service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:47.962203 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e0d9a851-08cf-44bc-aeff-305c435bbf7c req-11281e4e-8e31-4440-a07e-dd3df8abc98e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:47.962638 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e0d9a851-08cf-44bc-aeff-305c435bbf7c req-11281e4e-8e31-4440-a07e-dd3df8abc98e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:47.993156 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-e0d9a851-08cf-44bc-aeff-305c435bbf7c req-11281e4e-8e31-4440-a07e-dd3df8abc98e service nova] Creating event network-vif-plugged:ade8fcd2-9810-47b4-a0b0-468ebf236d36 for instance 64824cfc-200e-4ee1-8698-011b644ae315 on n-h1-master-1 Oct 30 01:25:48.007573 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-e0d9a851-08cf-44bc-aeff-305c435bbf7c req-11281e4e-8e31-4440-a07e-dd3df8abc98e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071092 Oct 30 01:25:48.008621 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1440/2897] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:25:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:25:48.019406 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-82828251-1d24-4c80-bdc6-c7da61c63bee tempest-KeyPairsV2TestJSON-633999552 tempest-KeyPairsV2TestJSON-633999552-project] Action: 'create', calling method: .version_select at 0x7f44cc3374c0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1707156602", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjkkeUA6P1eiQgdUtXfvw9sL3eOWddsRKUlTfXjxr1zhDQrxcGvENvxuEwk69Kpc5nGvlmr+jjeEEslFi/8YfbzQKohjqYL6Tz0P/db8fEQEgPoDEMisxia9LQLhjP4Rg=="}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:25:48.058772 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-82828251-1d24-4c80-bdc6-c7da61c63bee tempest-KeyPairsV2TestJSON-633999552 tempest-KeyPairsV2TestJSON-633999552-project] Getting quotas for project 6ec2daf2c00e4a5da96640aa09f998c4. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:25:48.071000 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e8b0375-7ce8-4028-b8c2-4fb5fdab8973 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:48.071647 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e8b0375-7ce8-4028-b8c2-4fb5fdab8973 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:48.072205 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e8b0375-7ce8-4028-b8c2-4fb5fdab8973 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:48.075602 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-82828251-1d24-4c80-bdc6-c7da61c63bee tempest-KeyPairsV2TestJSON-633999552 tempest-KeyPairsV2TestJSON-633999552-project] Getting quotas for user 63c9832e3bb94fc0b4be22d4f8130ddb and project 6ec2daf2c00e4a5da96640aa09f998c4. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:25:48.100802 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e8b0375-7ce8-4028-b8c2-4fb5fdab8973 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:48.102008 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e8b0375-7ce8-4028-b8c2-4fb5fdab8973 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:48.102564 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e8b0375-7ce8-4028-b8c2-4fb5fdab8973 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:48.125235 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=92,nova_cell1:DELETE=2,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:25:48.191998 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-82828251-1d24-4c80-bdc6-c7da61c63bee tempest-KeyPairsV2TestJSON-633999552 tempest-KeyPairsV2TestJSON-633999552-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.182017 Oct 30 01:25:48.192804 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1441/2898] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 30 01:25:48 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:25:48.197934 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-64ace9cc-5691-42aa-b120-d14e53e91644 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '.version_select at 0x7f44cc2f8790>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:48.269594 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-6e8b0375-7ce8-4028-b8c2-4fb5fdab8973 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lazy-loading 'flavor' on Instance uuid 5c4bb439-785f-4ac3-a7fc-b9325b52fa19 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:25:48.272003 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-64ace9cc-5691-42aa-b120-d14e53e91644 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "GET /compute/v2.1/images/50669d24-ab56-475f-8236-0ff19406f3eb" status: 200 len: 1424 microversion: 2.1 time: 0.077772 Oct 30 01:25:48.273852 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1442/2899] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:25:48 2022] GET /compute/v2.1/images/50669d24-ab56-475f-8236-0ff19406f3eb => generated 1424 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:48.282928 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3962b9a0-6571-4446-888f-d2a47169e918 tempest-KeyPairsV2TestJSON-633999552 tempest-KeyPairsV2TestJSON-633999552-project] Action: 'create', calling method: .version_select at 0x7f44cc135ee0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-749950494", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpRw4PWmgKFidN9GV1K5y7sqNYOFKbxYoCd4c8cYDUOsBIjfhYtghjSzNsq34q4RB9KKBQJ8NN37aS2J53gxeHmdp0JXlFq1lqPOBDaqd3yajRLbxezU09nSwIrEVMiqw=="}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:25:48.316430 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-3962b9a0-6571-4446-888f-d2a47169e918 tempest-KeyPairsV2TestJSON-633999552 tempest-KeyPairsV2TestJSON-633999552-project] Getting quotas for project 6ec2daf2c00e4a5da96640aa09f998c4. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:25:48.317659 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6e8b0375-7ce8-4028-b8c2-4fb5fdab8973 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] 10.222.0.13 "PUT /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19/tags/tempest-tag-2021178526" status: 201 len: 0 microversion: 2.26 time: 0.503409 Oct 30 01:25:48.325718 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1458/2900] 10.222.0.13 () {62 vars in 1380 bytes} [Sun Oct 30 01:25:47 2022] PUT /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19/tags/tempest-tag-2021178526 => generated 0 bytes in 511 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 30 01:25:48.335248 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6db76245-5765-4040-ad7c-f459e7b8adfd tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Action: 'update_all', calling method: .version_select at 0x7f44cc501820>, body: {"tags": ["tempest-tag-1132878222", "tempest-tag-1189392606"]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:25:48.342153 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-3962b9a0-6571-4446-888f-d2a47169e918 tempest-KeyPairsV2TestJSON-633999552 tempest-KeyPairsV2TestJSON-633999552-project] Getting quotas for user 63c9832e3bb94fc0b4be22d4f8130ddb and project 6ec2daf2c00e4a5da96640aa09f998c4. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:25:48.357659 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6db76245-5765-4040-ad7c-f459e7b8adfd tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:48.358336 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6db76245-5765-4040-ad7c-f459e7b8adfd tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:48.363294 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6db76245-5765-4040-ad7c-f459e7b8adfd tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:48.363875 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6db76245-5765-4040-ad7c-f459e7b8adfd tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] [instance: 5c4bb439-785f-4ac3-a7fc-b9325b52fa19] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:48.375515 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6db76245-5765-4040-ad7c-f459e7b8adfd tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:48.376002 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6db76245-5765-4040-ad7c-f459e7b8adfd tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:48.376435 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6db76245-5765-4040-ad7c-f459e7b8adfd tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:48.381459 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6db76245-5765-4040-ad7c-f459e7b8adfd tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:48.381944 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6db76245-5765-4040-ad7c-f459e7b8adfd tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:48.382378 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6db76245-5765-4040-ad7c-f459e7b8adfd tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:48.432106 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6db76245-5765-4040-ad7c-f459e7b8adfd tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:48.432565 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6db76245-5765-4040-ad7c-f459e7b8adfd tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:48.437247 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6db76245-5765-4040-ad7c-f459e7b8adfd tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:48.503450 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3962b9a0-6571-4446-888f-d2a47169e918 tempest-KeyPairsV2TestJSON-633999552 tempest-KeyPairsV2TestJSON-633999552-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.227465 Oct 30 01:25:48.504444 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1443/2901] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 30 01:25:48 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:25:48.511051 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-99e3b867-395e-4981-b05e-553a9f6f5e81 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:48.512467 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-99e3b867-395e-4981-b05e-553a9f6f5e81 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: 64824cfc-200e-4ee1-8698-011b644ae315] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:48.537300 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-99e3b867-395e-4981-b05e-553a9f6f5e81 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:48.537300 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-99e3b867-395e-4981-b05e-553a9f6f5e81 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:48.537300 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-99e3b867-395e-4981-b05e-553a9f6f5e81 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:48.537300 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-99e3b867-395e-4981-b05e-553a9f6f5e81 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:48.537300 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-99e3b867-395e-4981-b05e-553a9f6f5e81 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:48.537300 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-99e3b867-395e-4981-b05e-553a9f6f5e81 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:48.595497 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-6db76245-5765-4040-ad7c-f459e7b8adfd tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lazy-loading 'flavor' on Instance uuid 5c4bb439-785f-4ac3-a7fc-b9325b52fa19 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:25:48.646024 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6db76245-5765-4040-ad7c-f459e7b8adfd tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] 10.222.0.13 "PUT /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19/tags" status: 200 len: 62 microversion: 2.26 time: 0.318115 Oct 30 01:25:48.653583 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1459/2902] 10.222.0.13 () {62 vars in 1312 bytes} [Sun Oct 30 01:25:48 2022] PUT /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19/tags => generated 62 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:48.679842 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0d67b4c6-64b6-40a0-960b-b70642c07cfc tempest-KeyPairsV2TestJSON-633999552 tempest-KeyPairsV2TestJSON-633999552-project] Calling method '.version_select at 0x7f44cc60ca60>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:48.689951 n-d-master-1 devstack@n-api.service[121102]: WARNING oslo_db.sqlalchemy.utils [None req-0d67b4c6-64b6-40a0-960b-b70642c07cfc tempest-KeyPairsV2TestJSON-633999552 tempest-KeyPairsV2TestJSON-633999552-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 30 01:25:48.737208 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0d67b4c6-64b6-40a0-960b-b70642c07cfc tempest-KeyPairsV2TestJSON-633999552 tempest-KeyPairsV2TestJSON-633999552-project] 10.222.0.13 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.076720 Oct 30 01:25:48.737500 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1460/2903] 10.222.0.13 () {58 vars in 1137 bytes} [Sun Oct 30 01:25:48 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:48.760558 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3e88b551-7f7e-4ada-8650-a58c8903a065 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:48.761305 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3e88b551-7f7e-4ada-8650-a58c8903a065 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] [instance: 5b5d5fa5-1e07-4145-b6c8-30e31de10165] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:48.779260 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3e88b551-7f7e-4ada-8650-a58c8903a065 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:48.782873 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3e88b551-7f7e-4ada-8650-a58c8903a065 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:48.783346 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3e88b551-7f7e-4ada-8650-a58c8903a065 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:48.784099 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3e88b551-7f7e-4ada-8650-a58c8903a065 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:48.784567 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3e88b551-7f7e-4ada-8650-a58c8903a065 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:48.785000 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3e88b551-7f7e-4ada-8650-a58c8903a065 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:48.888176 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3e88b551-7f7e-4ada-8650-a58c8903a065 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:48.888688 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3e88b551-7f7e-4ada-8650-a58c8903a065 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:48.889131 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3e88b551-7f7e-4ada-8650-a58c8903a065 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:48.889651 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-3e88b551-7f7e-4ada-8650-a58c8903a065 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lazy-loading 'fault' on Instance uuid 5b5d5fa5-1e07-4145-b6c8-30e31de10165 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:25:49.094190 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3e88b551-7f7e-4ada-8650-a58c8903a065 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc60a96037f438ebbaaa6d25661bfc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127b4f4e1e4b43ed856faee3c5d9d88d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:49.111065 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3e88b551-7f7e-4ada-8650-a58c8903a065 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] 10.222.0.13 "GET /compute/v2.1/servers/5b5d5fa5-1e07-4145-b6c8-30e31de10165" status: 200 len: 1315 microversion: 2.1 time: 0.371624 Oct 30 01:25:49.113021 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1461/2904] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:48 2022] GET /compute/v2.1/servers/5b5d5fa5-1e07-4145-b6c8-30e31de10165 => generated 1315 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:49.119144 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6b3375b5-1114-4fb0-9059-caa2ce67a7a9 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Calling method '.version_select at 0x7f44c7ecdb80>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:49.128532 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b3375b5-1114-4fb0-9059-caa2ce67a7a9 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:49.129097 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b3375b5-1114-4fb0-9059-caa2ce67a7a9 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:49.129609 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b3375b5-1114-4fb0-9059-caa2ce67a7a9 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:49.158153 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6b3375b5-1114-4fb0-9059-caa2ce67a7a9 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] 10.222.0.13 "GET /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19/tags" status: 200 len: 62 microversion: 2.26 time: 0.038238 Oct 30 01:25:49.170253 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1462/2905] 10.222.0.13 () {60 vars in 1292 bytes} [Sun Oct 30 01:25:49 2022] GET /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19/tags => generated 62 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:49.190886 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e81f5eb4-0900-46c8-a39e-c3091f3f575c tempest-KeyPairsV2TestJSON-633999552 tempest-KeyPairsV2TestJSON-633999552-project] Calling method '.version_select at 0x7f44c7ecdee0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:49.313444 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e81f5eb4-0900-46c8-a39e-c3091f3f575c tempest-KeyPairsV2TestJSON-633999552 tempest-KeyPairsV2TestJSON-633999552-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-749950494" status: 202 len: 0 microversion: 2.1 time: 0.134725 Oct 30 01:25:49.314426 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1463/2906] 10.222.0.13 () {58 vars in 1275 bytes} [Sun Oct 30 01:25:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-749950494 => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:25:49.319211 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7e55e3d9-940d-4f53-a624-9f734cde35cf tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:49.320242 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7e55e3d9-940d-4f53-a624-9f734cde35cf tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: 688c35c4-9529-49df-8255-98cd2b56c314] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:49.335140 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e55e3d9-940d-4f53-a624-9f734cde35cf tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:49.345998 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e55e3d9-940d-4f53-a624-9f734cde35cf tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:49.346549 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e55e3d9-940d-4f53-a624-9f734cde35cf tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:49.347339 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e55e3d9-940d-4f53-a624-9f734cde35cf tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:49.347875 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e55e3d9-940d-4f53-a624-9f734cde35cf tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:49.348326 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e55e3d9-940d-4f53-a624-9f734cde35cf tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:49.908006 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-99e3b867-395e-4981-b05e-553a9f6f5e81 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07f2b8c31f54c62aaba73ca2bd2edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c59bd73c7874a00b52ec7c5c4142039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:49.922782 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-99e3b867-395e-4981-b05e-553a9f6f5e81 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] 10.222.0.13 "GET /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315" status: 200 len: 1355 microversion: 2.1 time: 1.416657 Oct 30 01:25:49.924952 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1444/2907] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:48 2022] GET /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315 => generated 1355 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:49.938796 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-dc650709-11e0-47fb-a682-66c5fe546ff0 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Calling method '.version_select at 0x7f44cc337550>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:49.955254 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc650709-11e0-47fb-a682-66c5fe546ff0 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:49.960720 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc650709-11e0-47fb-a682-66c5fe546ff0 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:49.961508 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc650709-11e0-47fb-a682-66c5fe546ff0 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:49.962202 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-dc650709-11e0-47fb-a682-66c5fe546ff0 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] [instance: 5c4bb439-785f-4ac3-a7fc-b9325b52fa19] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:49.977886 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc650709-11e0-47fb-a682-66c5fe546ff0 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:49.978386 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc650709-11e0-47fb-a682-66c5fe546ff0 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:49.980726 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc650709-11e0-47fb-a682-66c5fe546ff0 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:49.983485 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc650709-11e0-47fb-a682-66c5fe546ff0 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:49.984148 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc650709-11e0-47fb-a682-66c5fe546ff0 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:49.985821 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc650709-11e0-47fb-a682-66c5fe546ff0 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:50.055912 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc650709-11e0-47fb-a682-66c5fe546ff0 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:50.056450 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc650709-11e0-47fb-a682-66c5fe546ff0 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:50.056982 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc650709-11e0-47fb-a682-66c5fe546ff0 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:50.158017 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-dc650709-11e0-47fb-a682-66c5fe546ff0 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lazy-loading 'flavor' on Instance uuid 5c4bb439-785f-4ac3-a7fc-b9325b52fa19 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:25:50.187908 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-dc650709-11e0-47fb-a682-66c5fe546ff0 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19/tags" status: 204 len: 0 microversion: 2.26 time: 0.261583 Oct 30 01:25:50.191024 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1445/2908] 10.222.0.13 () {60 vars in 1295 bytes} [Sun Oct 30 01:25:49 2022] DELETE /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19/tags => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 30 01:25:50.208320 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ab253a2d-50d2-4d5c-b89d-884e04c0ef82 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '.version_select at 0x7f44d04840d0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:50.300089 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ab253a2d-50d2-4d5c-b89d-884e04c0ef82 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "GET /compute/v2.1/images/50669d24-ab56-475f-8236-0ff19406f3eb" status: 200 len: 1424 microversion: 2.1 time: 0.107754 Oct 30 01:25:50.300922 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1446/2909] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:25:50 2022] GET /compute/v2.1/images/50669d24-ab56-475f-8236-0ff19406f3eb => generated 1424 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:50.305790 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-dba63b48-974f-496b-86cd-1f4a7103c279 tempest-KeyPairsV2TestJSON-633999552 tempest-KeyPairsV2TestJSON-633999552-project] Calling method '.version_select at 0x7f44cc824c10>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:50.413869 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-dba63b48-974f-496b-86cd-1f4a7103c279 tempest-KeyPairsV2TestJSON-633999552 tempest-KeyPairsV2TestJSON-633999552-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1707156602" status: 202 len: 0 microversion: 2.1 time: 0.111647 Oct 30 01:25:50.414865 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1447/2910] 10.222.0.13 () {58 vars in 1278 bytes} [Sun Oct 30 01:25:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1707156602 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:25:50.420320 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-67515afd-a39f-430a-89de-6b3da3f37cee req-2d03bdd8-c9a8-40db-a95f-4c7245998044 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64824cfc-200e-4ee1-8698-011b644ae315", "name": "network-vif-plugged", "status": "completed", "tag": "ad034ad3-0acf-4013-9d50-4bd36d7d861f"}, {"server_uuid": "64824cfc-200e-4ee1-8698-011b644ae315", "name": "network-vif-plugged", "status": "completed", "tag": "66ae55c7-072f-4808-989d-0c0cc7aaf4fb"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:25:50.440081 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-67515afd-a39f-430a-89de-6b3da3f37cee req-2d03bdd8-c9a8-40db-a95f-4c7245998044 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:50.440917 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-67515afd-a39f-430a-89de-6b3da3f37cee req-2d03bdd8-c9a8-40db-a95f-4c7245998044 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:50.442235 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-67515afd-a39f-430a-89de-6b3da3f37cee req-2d03bdd8-c9a8-40db-a95f-4c7245998044 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:50.460594 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-67515afd-a39f-430a-89de-6b3da3f37cee req-2d03bdd8-c9a8-40db-a95f-4c7245998044 service nova] Creating event network-vif-plugged:ad034ad3-0acf-4013-9d50-4bd36d7d861f for instance 64824cfc-200e-4ee1-8698-011b644ae315 on n-h1-master-1 Oct 30 01:25:50.461374 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-67515afd-a39f-430a-89de-6b3da3f37cee req-2d03bdd8-c9a8-40db-a95f-4c7245998044 service nova] Creating event network-vif-plugged:66ae55c7-072f-4808-989d-0c0cc7aaf4fb for instance 64824cfc-200e-4ee1-8698-011b644ae315 on n-h1-master-1 Oct 30 01:25:50.467406 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-67515afd-a39f-430a-89de-6b3da3f37cee req-2d03bdd8-c9a8-40db-a95f-4c7245998044 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.051120 Oct 30 01:25:50.468647 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1448/2911] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:25:50.483493 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-22dd7fe7-2b0b-4e02-afe8-e3d39aec2813 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:50.484220 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-22dd7fe7-2b0b-4e02-afe8-e3d39aec2813 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] [instance: 5b5d5fa5-1e07-4145-b6c8-30e31de10165] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:50.505972 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22dd7fe7-2b0b-4e02-afe8-e3d39aec2813 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:50.507857 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22dd7fe7-2b0b-4e02-afe8-e3d39aec2813 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:50.508506 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22dd7fe7-2b0b-4e02-afe8-e3d39aec2813 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:50.515972 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22dd7fe7-2b0b-4e02-afe8-e3d39aec2813 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:50.516963 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22dd7fe7-2b0b-4e02-afe8-e3d39aec2813 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:50.517619 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22dd7fe7-2b0b-4e02-afe8-e3d39aec2813 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:50.529877 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7e55e3d9-940d-4f53-a624-9f734cde35cf tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:50.545753 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7e55e3d9-940d-4f53-a624-9f734cde35cf tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/688c35c4-9529-49df-8255-98cd2b56c314" status: 200 len: 1306 microversion: 2.1 time: 1.230175 Oct 30 01:25:50.550185 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1464/2912] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:49 2022] GET /compute/v2.1/servers/688c35c4-9529-49df-8255-98cd2b56c314 => generated 1306 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:50.558061 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7be7e8c6-71fe-45ff-a99f-4f8704520831 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:50.559375 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=90,nova_cell1:DELETE=4,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:25:50.561540 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-22dd7fe7-2b0b-4e02-afe8-e3d39aec2813 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] HTTP exception thrown: Instance 5b5d5fa5-1e07-4145-b6c8-30e31de10165 could not be found. Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-22dd7fe7-2b0b-4e02-afe8-e3d39aec2813 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Request method failure captured: Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/5b5d5fa5-1e07-4145-b6c8-30e31de10165 HTTP/1.1 Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdJ3-2Utsm34oAPcluHJ0dLlIv9UKwPcW9gSGc1Fd-fXnXyiUR-E9cDidulu_9iD7ySbhefgzo12vUJji8zK8NQoRv9q77rh1DwnTBZKgZmoZyYvjgr3gVo80JFFjbQ7dCBiF9aZlwtUJBhBlopPCb2e6u4E7eqLq_TkaBnnYQ_uZEc Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 127b4f4e1e4b43ed856faee3c5d9d88d Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-2114141342 Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/127b4f4e1e4b43ed856faee3c5d9d88d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_127b4f4e1e4b43ed856faee3c5d9d88d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/127b4f4e1e4b43ed856faee3c5d9d88d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/127b4f4e1e4b43ed856faee3c5d9d88d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-2114141342 Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 127b4f4e1e4b43ed856faee3c5d9d88d Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-2114141342 Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-InstanceActionsNegativeTestJSON-2114141342-project Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 0dc60a96037f438ebbaaa6d25661bfc5 Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-2114141342-project Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 5b5d5fa5-1e07-4145-b6c8-30e31de10165 could not be found. Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '5b5d5fa5-1e07-4145-b6c8-30e31de10165'} Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b5d5fa5-1e07-4145-b6c8-30e31de10165 could not be found. Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b5d5fa5-1e07-4145-b6c8-30e31de10165 could not be found. Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:50.563213 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:50.572154 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:50.572154 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:50.572154 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:50.572154 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:50.572154 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:25:50.572154 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:25:50.572154 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b5d5fa5-1e07-4145-b6c8-30e31de10165 could not be found. Oct 30 01:25:50.572154 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:50.572154 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-22dd7fe7-2b0b-4e02-afe8-e3d39aec2813 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] Returning 404 to user: Instance 5b5d5fa5-1e07-4145-b6c8-30e31de10165 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:25:50.574672 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7be7e8c6-71fe-45ff-a99f-4f8704520831 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] [instance: 5c4bb439-785f-4ac3-a7fc-b9325b52fa19] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:50.574830 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-22dd7fe7-2b0b-4e02-afe8-e3d39aec2813 tempest-InstanceActionsNegativeTestJSON-2114141342 tempest-InstanceActionsNegativeTestJSON-2114141342-project] 10.222.0.13 "GET /compute/v2.1/servers/5b5d5fa5-1e07-4145-b6c8-30e31de10165" status: 404 len: 111 microversion: 2.1 time: 0.088700 Oct 30 01:25:50.574830 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1449/2913] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:50 2022] GET /compute/v2.1/servers/5b5d5fa5-1e07-4145-b6c8-30e31de10165 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:25:50.579268 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-342797a9-44ff-41ff-93ab-fc800de19f35 req-02fa5600-6775-42f5-9bc3-4501939a7897 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "688c35c4-9529-49df-8255-98cd2b56c314", "tag": "f6c4cc9d-1ae2-485f-8d36-d57599740dfc"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:25:50.586674 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7be7e8c6-71fe-45ff-a99f-4f8704520831 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:50.593428 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7be7e8c6-71fe-45ff-a99f-4f8704520831 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:50.596170 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7be7e8c6-71fe-45ff-a99f-4f8704520831 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:50.597200 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7be7e8c6-71fe-45ff-a99f-4f8704520831 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:50.601819 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7be7e8c6-71fe-45ff-a99f-4f8704520831 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:50.604950 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7be7e8c6-71fe-45ff-a99f-4f8704520831 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:50.614836 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-342797a9-44ff-41ff-93ab-fc800de19f35 req-02fa5600-6775-42f5-9bc3-4501939a7897 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:50.622938 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-342797a9-44ff-41ff-93ab-fc800de19f35 req-02fa5600-6775-42f5-9bc3-4501939a7897 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:50.622938 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-342797a9-44ff-41ff-93ab-fc800de19f35 req-02fa5600-6775-42f5-9bc3-4501939a7897 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:50.641550 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-342797a9-44ff-41ff-93ab-fc800de19f35 req-02fa5600-6775-42f5-9bc3-4501939a7897 service nova] Creating event network-changed:f6c4cc9d-1ae2-485f-8d36-d57599740dfc for instance 688c35c4-9529-49df-8255-98cd2b56c314 on n-h2-master-1 Oct 30 01:25:50.649716 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-342797a9-44ff-41ff-93ab-fc800de19f35 req-02fa5600-6775-42f5-9bc3-4501939a7897 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082751 Oct 30 01:25:50.650324 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1450/2914] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:25:50.656665 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d46267d7-74e0-475d-b469-45dd2a27e11b tempest-KeyPairsV2TestJSON-633999552 tempest-KeyPairsV2TestJSON-633999552-project] Calling method '.version_select at 0x7f44d0484040>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:50.683404 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7be7e8c6-71fe-45ff-a99f-4f8704520831 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] [instance: 5c4bb439-785f-4ac3-a7fc-b9325b52fa19] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:25:50.761112 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d46267d7-74e0-475d-b469-45dd2a27e11b tempest-KeyPairsV2TestJSON-633999552 tempest-KeyPairsV2TestJSON-633999552-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2041090449" status: 202 len: 0 microversion: 2.1 time: 0.108896 Oct 30 01:25:50.762078 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1451/2915] 10.222.0.13 () {58 vars in 1278 bytes} [Sun Oct 30 01:25:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2041090449 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:25:50.950390 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7fa4979d-4617-4fc6-980f-c3b0873a2249 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:50.951439 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7fa4979d-4617-4fc6-980f-c3b0873a2249 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: 64824cfc-200e-4ee1-8698-011b644ae315] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:50.972060 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7fa4979d-4617-4fc6-980f-c3b0873a2249 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:50.975316 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7fa4979d-4617-4fc6-980f-c3b0873a2249 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:50.980503 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7fa4979d-4617-4fc6-980f-c3b0873a2249 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:50.982113 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7fa4979d-4617-4fc6-980f-c3b0873a2249 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:50.987579 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7fa4979d-4617-4fc6-980f-c3b0873a2249 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:50.988432 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7fa4979d-4617-4fc6-980f-c3b0873a2249 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:51.159355 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7be7e8c6-71fe-45ff-a99f-4f8704520831 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19" status: 204 len: 0 microversion: 2.26 time: 0.604167 Oct 30 01:25:51.159711 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1465/2916] 10.222.0.13 () {60 vars in 1280 bytes} [Sun Oct 30 01:25:50 2022] DELETE /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 30 01:25:51.176615 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d8c56eb8-4426-41a1-8cd1-d7899939ca56 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:51.179807 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d8c56eb8-4426-41a1-8cd1-d7899939ca56 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] [instance: 5c4bb439-785f-4ac3-a7fc-b9325b52fa19] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:51.199184 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8c56eb8-4426-41a1-8cd1-d7899939ca56 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:51.200716 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8c56eb8-4426-41a1-8cd1-d7899939ca56 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:51.201385 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8c56eb8-4426-41a1-8cd1-d7899939ca56 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:51.204015 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8c56eb8-4426-41a1-8cd1-d7899939ca56 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:51.206065 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8c56eb8-4426-41a1-8cd1-d7899939ca56 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:51.207106 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8c56eb8-4426-41a1-8cd1-d7899939ca56 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:51.586257 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d8c56eb8-4426-41a1-8cd1-d7899939ca56 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba44010e0ca4892b56886e2b1636f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13238008c06e49c3b088809143308a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:51.590576 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7fa4979d-4617-4fc6-980f-c3b0873a2249 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07f2b8c31f54c62aaba73ca2bd2edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c59bd73c7874a00b52ec7c5c4142039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:51.594766 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d8c56eb8-4426-41a1-8cd1-d7899939ca56 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ba44010e0ca4892b56886e2b1636f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13238008c06e49c3b088809143308a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:51.598482 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d8c56eb8-4426-41a1-8cd1-d7899939ca56 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ba44010e0ca4892b56886e2b1636f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13238008c06e49c3b088809143308a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:51.598482 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d8c56eb8-4426-41a1-8cd1-d7899939ca56 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] 10.222.0.13 "GET /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19" status: 200 len: 1551 microversion: 2.26 time: 0.432806 Oct 30 01:25:51.598482 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1466/2917] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:25:51 2022] GET /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19 => generated 1551 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:25:51.603447 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cda5fbb9-48a1-42c2-a9e8-6f9b85523de3 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '.version_select at 0x7f44cc501940>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:51.612013 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7fa4979d-4617-4fc6-980f-c3b0873a2249 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] 10.222.0.13 "GET /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315" status: 200 len: 1355 microversion: 2.1 time: 0.665667 Oct 30 01:25:51.621027 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1452/2918] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:50 2022] GET /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315 => generated 1355 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:25:51.643714 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b05ef2a0-9846-4c7e-a409-4913adbedc6f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:51.645283 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b05ef2a0-9846-4c7e-a409-4913adbedc6f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: 688c35c4-9529-49df-8255-98cd2b56c314] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:51.659740 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b05ef2a0-9846-4c7e-a409-4913adbedc6f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:51.661715 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b05ef2a0-9846-4c7e-a409-4913adbedc6f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:51.662164 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b05ef2a0-9846-4c7e-a409-4913adbedc6f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:51.663467 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b05ef2a0-9846-4c7e-a409-4913adbedc6f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:51.663972 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b05ef2a0-9846-4c7e-a409-4913adbedc6f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:51.664349 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b05ef2a0-9846-4c7e-a409-4913adbedc6f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:51.678256 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cda5fbb9-48a1-42c2-a9e8-6f9b85523de3 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "GET /compute/v2.1/images/50669d24-ab56-475f-8236-0ff19406f3eb" status: 200 len: 1424 microversion: 2.1 time: 0.079254 Oct 30 01:25:51.680221 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1467/2919] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:25:51 2022] GET /compute/v2.1/images/50669d24-ab56-475f-8236-0ff19406f3eb => generated 1424 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:51.945846 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-55119b76-be21-467a-9a80-1cb0b084d098 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:51.946666 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-55119b76-be21-467a-9a80-1cb0b084d098 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 22fce0cc-6498-4b95-b265-a44519f4fd9a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:51.964210 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-55119b76-be21-467a-9a80-1cb0b084d098 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:51.965007 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-55119b76-be21-467a-9a80-1cb0b084d098 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:51.966908 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-55119b76-be21-467a-9a80-1cb0b084d098 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:51.968677 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-55119b76-be21-467a-9a80-1cb0b084d098 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:51.970120 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-55119b76-be21-467a-9a80-1cb0b084d098 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:51.971487 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-55119b76-be21-467a-9a80-1cb0b084d098 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:52.019588 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-55119b76-be21-467a-9a80-1cb0b084d098 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] HTTP exception thrown: Instance 22fce0cc-6498-4b95-b265-a44519f4fd9a could not be found. Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-55119b76-be21-467a-9a80-1cb0b084d098 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Request method failure captured: Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/servers/22fce0cc-6498-4b95-b265-a44519f4fd9a HTTP/1.1 Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdEZHAwNEyYVN8mbZetD1IgknrDb-nJfmTHtgPgtOr9AeQL99EuTYclSviV8aikzXcemJ-XkTVClxHn6U4xG48gAdXZcIs0fYa7Kdvvi7PzFjDxYMfOtgAp7wAvvVW7kd-J_XMzQX3yJBWm7NW5-QhmguztBnHz9UniQWs2CmNftHaI Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 8c95e97cd7e4461682b9028abb568dce Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 8c95e97cd7e4461682b9028abb568dce Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-DeleteServersTestJSON-1379968241-project Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 33691c943ec040ddb04b6648b6e945ab Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-DeleteServersTestJSON-1379968241-project Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 22fce0cc-6498-4b95-b265-a44519f4fd9a could not be found. Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '22fce0cc-6498-4b95-b265-a44519f4fd9a'} Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22fce0cc-6498-4b95-b265-a44519f4fd9a could not be found. Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:25:52.027402 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:25:52.032739 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22fce0cc-6498-4b95-b265-a44519f4fd9a could not be found. Oct 30 01:25:52.032739 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:52.032739 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:52.032739 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:52.032739 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:52.032739 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:52.032739 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:52.032739 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:25:52.032739 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:25:52.032739 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22fce0cc-6498-4b95-b265-a44519f4fd9a could not be found. Oct 30 01:25:52.032739 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:52.036199 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:25:52.038543 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-55119b76-be21-467a-9a80-1cb0b084d098 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Returning 404 to user: Instance 22fce0cc-6498-4b95-b265-a44519f4fd9a could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:25:52.039698 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-55119b76-be21-467a-9a80-1cb0b084d098 tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "DELETE /compute/v2.1/servers/22fce0cc-6498-4b95-b265-a44519f4fd9a" status: 404 len: 111 microversion: 2.1 time: 0.099087 Oct 30 01:25:52.043859 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1468/2920] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:25:51 2022] DELETE /compute/v2.1/servers/22fce0cc-6498-4b95-b265-a44519f4fd9a => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:25:52.054750 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1b53c798-d2f1-42e9-b0b2-366a392c18bb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:52.061445 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1b53c798-d2f1-42e9-b0b2-366a392c18bb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 22fce0cc-6498-4b95-b265-a44519f4fd9a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:52.080182 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1b53c798-d2f1-42e9-b0b2-366a392c18bb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:52.080824 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1b53c798-d2f1-42e9-b0b2-366a392c18bb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:52.082218 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1b53c798-d2f1-42e9-b0b2-366a392c18bb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:52.086697 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1b53c798-d2f1-42e9-b0b2-366a392c18bb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:52.087483 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1b53c798-d2f1-42e9-b0b2-366a392c18bb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:52.088148 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1b53c798-d2f1-42e9-b0b2-366a392c18bb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:52.117956 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-1b53c798-d2f1-42e9-b0b2-366a392c18bb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] HTTP exception thrown: Instance 22fce0cc-6498-4b95-b265-a44519f4fd9a could not be found. Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1b53c798-d2f1-42e9-b0b2-366a392c18bb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Request method failure captured: Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/22fce0cc-6498-4b95-b265-a44519f4fd9a HTTP/1.1 Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdEZHAwNEyYVN8mbZetD1IgknrDb-nJfmTHtgPgtOr9AeQL99EuTYclSviV8aikzXcemJ-XkTVClxHn6U4xG48gAdXZcIs0fYa7Kdvvi7PzFjDxYMfOtgAp7wAvvVW7kd-J_XMzQX3yJBWm7NW5-QhmguztBnHz9UniQWs2CmNftHaI Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 8c95e97cd7e4461682b9028abb568dce Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 8c95e97cd7e4461682b9028abb568dce Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-DeleteServersTestJSON-1379968241-project Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 33691c943ec040ddb04b6648b6e945ab Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-DeleteServersTestJSON-1379968241-project Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 22fce0cc-6498-4b95-b265-a44519f4fd9a could not be found. Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '22fce0cc-6498-4b95-b265-a44519f4fd9a'} Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22fce0cc-6498-4b95-b265-a44519f4fd9a could not be found. Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22fce0cc-6498-4b95-b265-a44519f4fd9a could not be found. Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:52.128656 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:52.132608 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:52.132608 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:52.132608 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:52.132608 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:25:52.132608 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:25:52.132608 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22fce0cc-6498-4b95-b265-a44519f4fd9a could not be found. Oct 30 01:25:52.132608 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:52.134579 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1b53c798-d2f1-42e9-b0b2-366a392c18bb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Returning 404 to user: Instance 22fce0cc-6498-4b95-b265-a44519f4fd9a could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:25:52.138222 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1b53c798-d2f1-42e9-b0b2-366a392c18bb tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/22fce0cc-6498-4b95-b265-a44519f4fd9a" status: 404 len: 111 microversion: 2.1 time: 0.087563 Oct 30 01:25:52.138222 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1469/2921] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:52 2022] GET /compute/v2.1/servers/22fce0cc-6498-4b95-b265-a44519f4fd9a => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:25:52.145051 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f66def78-9cf9-459d-b199-93d736a97e7c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:52.145942 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f66def78-9cf9-459d-b199-93d736a97e7c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 4e90ab5e-2dd7-4267-a5d2-9fc034e66c48] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:52.159234 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f66def78-9cf9-459d-b199-93d736a97e7c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:52.161774 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f66def78-9cf9-459d-b199-93d736a97e7c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:52.161774 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f66def78-9cf9-459d-b199-93d736a97e7c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:52.161774 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f66def78-9cf9-459d-b199-93d736a97e7c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:52.161774 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f66def78-9cf9-459d-b199-93d736a97e7c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:52.162605 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f66def78-9cf9-459d-b199-93d736a97e7c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:52.165606 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b05ef2a0-9846-4c7e-a409-4913adbedc6f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:52.179301 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b05ef2a0-9846-4c7e-a409-4913adbedc6f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/688c35c4-9529-49df-8255-98cd2b56c314" status: 200 len: 1306 microversion: 2.1 time: 0.559651 Oct 30 01:25:52.181055 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-f66def78-9cf9-459d-b199-93d736a97e7c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] HTTP exception thrown: Instance 4e90ab5e-2dd7-4267-a5d2-9fc034e66c48 could not be found. Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f66def78-9cf9-459d-b199-93d736a97e7c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Request method failure captured: Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/servers/4e90ab5e-2dd7-4267-a5d2-9fc034e66c48 HTTP/1.1 Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdEZHAwNEyYVN8mbZetD1IgknrDb-nJfmTHtgPgtOr9AeQL99EuTYclSviV8aikzXcemJ-XkTVClxHn6U4xG48gAdXZcIs0fYa7Kdvvi7PzFjDxYMfOtgAp7wAvvVW7kd-J_XMzQX3yJBWm7NW5-QhmguztBnHz9UniQWs2CmNftHaI Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 8c95e97cd7e4461682b9028abb568dce Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 8c95e97cd7e4461682b9028abb568dce Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-DeleteServersTestJSON-1379968241-project Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 33691c943ec040ddb04b6648b6e945ab Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-DeleteServersTestJSON-1379968241-project Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 4e90ab5e-2dd7-4267-a5d2-9fc034e66c48 could not be found. Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '4e90ab5e-2dd7-4267-a5d2-9fc034e66c48'} Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e90ab5e-2dd7-4267-a5d2-9fc034e66c48 could not be found. Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:25:52.182982 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:25:52.186809 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e90ab5e-2dd7-4267-a5d2-9fc034e66c48 could not be found. Oct 30 01:25:52.186809 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:52.186809 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:52.186809 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:52.186809 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:52.186809 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:52.186809 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:52.186809 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:25:52.186809 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:25:52.186809 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e90ab5e-2dd7-4267-a5d2-9fc034e66c48 could not be found. Oct 30 01:25:52.186809 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:52.188628 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1453/2922] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:51 2022] GET /compute/v2.1/servers/688c35c4-9529-49df-8255-98cd2b56c314 => generated 1306 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:52.190024 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f66def78-9cf9-459d-b199-93d736a97e7c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Returning 404 to user: Instance 4e90ab5e-2dd7-4267-a5d2-9fc034e66c48 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:25:52.191055 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f66def78-9cf9-459d-b199-93d736a97e7c tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "DELETE /compute/v2.1/servers/4e90ab5e-2dd7-4267-a5d2-9fc034e66c48" status: 404 len: 111 microversion: 2.1 time: 0.050054 Oct 30 01:25:52.194745 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1470/2923] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:25:52 2022] DELETE /compute/v2.1/servers/4e90ab5e-2dd7-4267-a5d2-9fc034e66c48 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 01:25:52.200486 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-61d93964-653c-4859-9e74-401625643e4d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:52.201126 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-61d93964-653c-4859-9e74-401625643e4d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] [instance: 4e90ab5e-2dd7-4267-a5d2-9fc034e66c48] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:52.214298 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-61d93964-653c-4859-9e74-401625643e4d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:52.216411 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-61d93964-653c-4859-9e74-401625643e4d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:52.218489 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-61d93964-653c-4859-9e74-401625643e4d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:52.222453 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-61d93964-653c-4859-9e74-401625643e4d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:52.223104 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-61d93964-653c-4859-9e74-401625643e4d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:52.225854 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-61d93964-653c-4859-9e74-401625643e4d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:52.260640 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-61d93964-653c-4859-9e74-401625643e4d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] HTTP exception thrown: Instance 4e90ab5e-2dd7-4267-a5d2-9fc034e66c48 could not be found. Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-61d93964-653c-4859-9e74-401625643e4d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Request method failure captured: Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/4e90ab5e-2dd7-4267-a5d2-9fc034e66c48 HTTP/1.1 Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdEZHAwNEyYVN8mbZetD1IgknrDb-nJfmTHtgPgtOr9AeQL99EuTYclSviV8aikzXcemJ-XkTVClxHn6U4xG48gAdXZcIs0fYa7Kdvvi7PzFjDxYMfOtgAp7wAvvVW7kd-J_XMzQX3yJBWm7NW5-QhmguztBnHz9UniQWs2CmNftHaI Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 8c95e97cd7e4461682b9028abb568dce Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8c95e97cd7e4461682b9028abb568dce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 8c95e97cd7e4461682b9028abb568dce Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-DeleteServersTestJSON-1379968241 Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-DeleteServersTestJSON-1379968241-project Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 33691c943ec040ddb04b6648b6e945ab Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-DeleteServersTestJSON-1379968241-project Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 4e90ab5e-2dd7-4267-a5d2-9fc034e66c48 could not be found. Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '4e90ab5e-2dd7-4267-a5d2-9fc034e66c48'} Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e90ab5e-2dd7-4267-a5d2-9fc034e66c48 could not be found. Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e90ab5e-2dd7-4267-a5d2-9fc034e66c48 could not be found. Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:52.264579 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:52.268757 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:52.268757 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:52.268757 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:52.268757 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:25:52.268757 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:25:52.268757 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e90ab5e-2dd7-4267-a5d2-9fc034e66c48 could not be found. Oct 30 01:25:52.268757 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:25:52.268757 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-61d93964-653c-4859-9e74-401625643e4d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] Returning 404 to user: Instance 4e90ab5e-2dd7-4267-a5d2-9fc034e66c48 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:25:52.268757 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-61d93964-653c-4859-9e74-401625643e4d tempest-DeleteServersTestJSON-1379968241 tempest-DeleteServersTestJSON-1379968241-project] 10.222.0.13 "GET /compute/v2.1/servers/4e90ab5e-2dd7-4267-a5d2-9fc034e66c48" status: 404 len: 111 microversion: 2.1 time: 0.071658 Oct 30 01:25:52.273490 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1454/2924] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:52 2022] GET /compute/v2.1/servers/4e90ab5e-2dd7-4267-a5d2-9fc034e66c48 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:25:52.627669 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-34312a36-29e1-40a9-8363-3c055c09d5f4 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:52.629247 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-34312a36-29e1-40a9-8363-3c055c09d5f4 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] [instance: 5c4bb439-785f-4ac3-a7fc-b9325b52fa19] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:52.643999 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-34312a36-29e1-40a9-8363-3c055c09d5f4 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:52.644352 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2f7a7ab8-7cd9-4a5b-87af-6ee5cabf4f6f tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:52.644702 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2f7a7ab8-7cd9-4a5b-87af-6ee5cabf4f6f tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: 64824cfc-200e-4ee1-8698-011b644ae315] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:52.649243 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-34312a36-29e1-40a9-8363-3c055c09d5f4 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:52.651655 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-34312a36-29e1-40a9-8363-3c055c09d5f4 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:52.654262 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-34312a36-29e1-40a9-8363-3c055c09d5f4 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:52.657539 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-34312a36-29e1-40a9-8363-3c055c09d5f4 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:52.658973 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-34312a36-29e1-40a9-8363-3c055c09d5f4 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:52.667323 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f7a7ab8-7cd9-4a5b-87af-6ee5cabf4f6f tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:52.669154 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f7a7ab8-7cd9-4a5b-87af-6ee5cabf4f6f tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:52.669803 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f7a7ab8-7cd9-4a5b-87af-6ee5cabf4f6f tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:52.673600 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f7a7ab8-7cd9-4a5b-87af-6ee5cabf4f6f tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:52.673600 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f7a7ab8-7cd9-4a5b-87af-6ee5cabf4f6f tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:52.673600 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f7a7ab8-7cd9-4a5b-87af-6ee5cabf4f6f tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:53.187250 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2f7a7ab8-7cd9-4a5b-87af-6ee5cabf4f6f tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07f2b8c31f54c62aaba73ca2bd2edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c59bd73c7874a00b52ec7c5c4142039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:53.201240 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-34312a36-29e1-40a9-8363-3c055c09d5f4 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba44010e0ca4892b56886e2b1636f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13238008c06e49c3b088809143308a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:53.223660 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-34312a36-29e1-40a9-8363-3c055c09d5f4 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ba44010e0ca4892b56886e2b1636f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13238008c06e49c3b088809143308a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:53.226396 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-34312a36-29e1-40a9-8363-3c055c09d5f4 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ba44010e0ca4892b56886e2b1636f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13238008c06e49c3b088809143308a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:53.228009 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-34312a36-29e1-40a9-8363-3c055c09d5f4 tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] 10.222.0.13 "GET /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19" status: 200 len: 1551 microversion: 2.26 time: 0.604415 Oct 30 01:25:53.230814 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2f7a7ab8-7cd9-4a5b-87af-6ee5cabf4f6f tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] 10.222.0.13 "GET /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315" status: 200 len: 1804 microversion: 2.1 time: 0.590716 Oct 30 01:25:53.232745 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1455/2925] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:52 2022] GET /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315 => generated 1804 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:25:53.239043 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c99ae520-cfd4-41d5-a72d-f173744314b7 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '.version_select at 0x7f44cc8e2790>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:53.245549 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1471/2926] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:25:52 2022] GET /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19 => generated 1551 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:25:53.258327 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-053b9985-9b9a-4c05-8090-e0717c6849b5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:53.259307 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-053b9985-9b9a-4c05-8090-e0717c6849b5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: 688c35c4-9529-49df-8255-98cd2b56c314] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:53.268857 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-053b9985-9b9a-4c05-8090-e0717c6849b5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:53.269755 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-053b9985-9b9a-4c05-8090-e0717c6849b5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:53.273024 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-053b9985-9b9a-4c05-8090-e0717c6849b5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:53.273024 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-053b9985-9b9a-4c05-8090-e0717c6849b5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:53.273024 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-053b9985-9b9a-4c05-8090-e0717c6849b5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:53.273024 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-053b9985-9b9a-4c05-8090-e0717c6849b5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:53.320887 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c99ae520-cfd4-41d5-a72d-f173744314b7 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "GET /compute/v2.1/images/50669d24-ab56-475f-8236-0ff19406f3eb" status: 200 len: 1424 microversion: 2.1 time: 0.085784 Oct 30 01:25:53.321954 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1456/2927] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:25:53 2022] GET /compute/v2.1/images/50669d24-ab56-475f-8236-0ff19406f3eb => generated 1424 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:53.328415 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cec7b310-3aa3-45dd-97ab-ab5ff868f534 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:53.332193 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-cec7b310-3aa3-45dd-97ab-ab5ff868f534 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: 64824cfc-200e-4ee1-8698-011b644ae315] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:53.347337 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cec7b310-3aa3-45dd-97ab-ab5ff868f534 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:53.349769 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cec7b310-3aa3-45dd-97ab-ab5ff868f534 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:53.353862 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cec7b310-3aa3-45dd-97ab-ab5ff868f534 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:53.354733 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cec7b310-3aa3-45dd-97ab-ab5ff868f534 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:53.355323 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cec7b310-3aa3-45dd-97ab-ab5ff868f534 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:53.355766 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cec7b310-3aa3-45dd-97ab-ab5ff868f534 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:53.411994 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cec7b310-3aa3-45dd-97ab-ab5ff868f534 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] 10.222.0.13 "GET /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315/ips" status: 200 len: 217 microversion: 2.1 time: 0.087563 Oct 30 01:25:53.424781 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1457/2928] 10.222.0.13 () {58 vars in 1248 bytes} [Sun Oct 30 01:25:53 2022] GET /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315/ips => generated 217 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:25:53.429977 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-07dd3fcf-4dd4-4f3d-ae5b-2089f8233139 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:53.430483 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-07dd3fcf-4dd4-4f3d-ae5b-2089f8233139 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: 64824cfc-200e-4ee1-8698-011b644ae315] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:53.439970 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-07dd3fcf-4dd4-4f3d-ae5b-2089f8233139 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:53.440724 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-07dd3fcf-4dd4-4f3d-ae5b-2089f8233139 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:53.441662 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-07dd3fcf-4dd4-4f3d-ae5b-2089f8233139 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:53.442621 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-07dd3fcf-4dd4-4f3d-ae5b-2089f8233139 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:53.443251 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-07dd3fcf-4dd4-4f3d-ae5b-2089f8233139 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:53.444915 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-07dd3fcf-4dd4-4f3d-ae5b-2089f8233139 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:53.478898 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-07dd3fcf-4dd4-4f3d-ae5b-2089f8233139 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: 64824cfc-200e-4ee1-8698-011b644ae315] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:25:53.816031 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-053b9985-9b9a-4c05-8090-e0717c6849b5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:53.826319 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-053b9985-9b9a-4c05-8090-e0717c6849b5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/688c35c4-9529-49df-8255-98cd2b56c314" status: 200 len: 1306 microversion: 2.1 time: 0.579487 Oct 30 01:25:53.827444 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1472/2929] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:53 2022] GET /compute/v2.1/servers/688c35c4-9529-49df-8255-98cd2b56c314 => generated 1306 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:53.846457 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-07dd3fcf-4dd4-4f3d-ae5b-2089f8233139 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] 10.222.0.13 "DELETE /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315" status: 204 len: 0 microversion: 2.1 time: 0.420149 Oct 30 01:25:53.847062 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1458/2930] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:25:53 2022] DELETE /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:25:53.856735 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1c672c68-e6da-44c4-b0ca-b417c478915f tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:53.857778 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1c672c68-e6da-44c4-b0ca-b417c478915f tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: 64824cfc-200e-4ee1-8698-011b644ae315] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:53.865801 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1c672c68-e6da-44c4-b0ca-b417c478915f tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:53.866526 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1c672c68-e6da-44c4-b0ca-b417c478915f tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:53.867121 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1c672c68-e6da-44c4-b0ca-b417c478915f tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:53.867985 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1c672c68-e6da-44c4-b0ca-b417c478915f tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:53.869118 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1c672c68-e6da-44c4-b0ca-b417c478915f tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:53.869734 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1c672c68-e6da-44c4-b0ca-b417c478915f tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:54.139808 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1c672c68-e6da-44c4-b0ca-b417c478915f tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07f2b8c31f54c62aaba73ca2bd2edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c59bd73c7874a00b52ec7c5c4142039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:54.154343 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1c672c68-e6da-44c4-b0ca-b417c478915f tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] 10.222.0.13 "GET /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315" status: 200 len: 1810 microversion: 2.1 time: 0.301648 Oct 30 01:25:54.156865 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1473/2931] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:53 2022] GET /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315 => generated 1810 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:54.263569 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-10f4cc4b-5b9e-48a0-8d9a-f4eb2e37b38f tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:54.265011 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-10f4cc4b-5b9e-48a0-8d9a-f4eb2e37b38f tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] [instance: 5c4bb439-785f-4ac3-a7fc-b9325b52fa19] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:54.271347 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-10f4cc4b-5b9e-48a0-8d9a-f4eb2e37b38f tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:54.271832 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-10f4cc4b-5b9e-48a0-8d9a-f4eb2e37b38f tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:54.272276 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-10f4cc4b-5b9e-48a0-8d9a-f4eb2e37b38f tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:54.272964 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-10f4cc4b-5b9e-48a0-8d9a-f4eb2e37b38f tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:54.273439 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-10f4cc4b-5b9e-48a0-8d9a-f4eb2e37b38f tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:54.274058 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-10f4cc4b-5b9e-48a0-8d9a-f4eb2e37b38f tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:54.339421 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2ca617ca-9dfa-47a5-babf-fe11a27da7f7 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '.version_select at 0x7f44d03f55e0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:54.400386 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2ca617ca-9dfa-47a5-babf-fe11a27da7f7 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "GET /compute/v2.1/images/50669d24-ab56-475f-8236-0ff19406f3eb" status: 200 len: 1433 microversion: 2.1 time: 0.066393 Oct 30 01:25:54.410994 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1474/2932] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:25:54 2022] GET /compute/v2.1/images/50669d24-ab56-475f-8236-0ff19406f3eb => generated 1433 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:54.417958 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-27aa8af0-3119-4b45-8ba6-679c2651c2ac tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '.version_select at 0x7f44d04cfb80>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:54.485741 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-27aa8af0-3119-4b45-8ba6-679c2651c2ac tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "GET /compute/v2.1/images/50669d24-ab56-475f-8236-0ff19406f3eb" status: 200 len: 1433 microversion: 2.1 time: 0.073410 Oct 30 01:25:54.486977 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1475/2933] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:25:54 2022] GET /compute/v2.1/images/50669d24-ab56-475f-8236-0ff19406f3eb => generated 1433 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:54.503450 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-db7c7870-f553-4c20-90f3-8d0843daa1e9 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:54.504075 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-db7c7870-f553-4c20-90f3-8d0843daa1e9 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] [instance: 9c6be996-7886-41c6-9c0c-e0f899836cb0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:54.510576 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-db7c7870-f553-4c20-90f3-8d0843daa1e9 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:54.511065 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-db7c7870-f553-4c20-90f3-8d0843daa1e9 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:54.511499 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-db7c7870-f553-4c20-90f3-8d0843daa1e9 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:54.514906 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-db7c7870-f553-4c20-90f3-8d0843daa1e9 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:54.514906 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-db7c7870-f553-4c20-90f3-8d0843daa1e9 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:54.514906 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-db7c7870-f553-4c20-90f3-8d0843daa1e9 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:54.746058 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-10f4cc4b-5b9e-48a0-8d9a-f4eb2e37b38f tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba44010e0ca4892b56886e2b1636f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13238008c06e49c3b088809143308a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:54.757929 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-10f4cc4b-5b9e-48a0-8d9a-f4eb2e37b38f tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ba44010e0ca4892b56886e2b1636f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13238008c06e49c3b088809143308a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:54.760340 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-10f4cc4b-5b9e-48a0-8d9a-f4eb2e37b38f tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ba44010e0ca4892b56886e2b1636f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13238008c06e49c3b088809143308a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:54.761641 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-10f4cc4b-5b9e-48a0-8d9a-f4eb2e37b38f tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] 10.222.0.13 "GET /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19" status: 200 len: 1551 microversion: 2.26 time: 0.502420 Oct 30 01:25:54.762218 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1459/2934] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:25:54 2022] GET /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19 => generated 1551 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:25:54.853534 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-91825289-7fad-4f1d-838f-39288baeb40c tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:54.854317 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-91825289-7fad-4f1d-838f-39288baeb40c tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: 688c35c4-9529-49df-8255-98cd2b56c314] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:54.866195 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91825289-7fad-4f1d-838f-39288baeb40c tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:54.866989 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91825289-7fad-4f1d-838f-39288baeb40c tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:54.867522 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91825289-7fad-4f1d-838f-39288baeb40c tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:54.870892 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91825289-7fad-4f1d-838f-39288baeb40c tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:54.871538 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91825289-7fad-4f1d-838f-39288baeb40c tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:54.872126 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91825289-7fad-4f1d-838f-39288baeb40c tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:54.936277 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-db7c7870-f553-4c20-90f3-8d0843daa1e9 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e50d6775ec4d2e96ab6e839b4631f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310172f2dfaf4ddcb5eace8a13939cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:54.949234 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-db7c7870-f553-4c20-90f3-8d0843daa1e9 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6be996-7886-41c6-9c0c-e0f899836cb0" status: 200 len: 1480 microversion: 2.1 time: 0.449326 Oct 30 01:25:54.951539 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1476/2935] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:54 2022] GET /compute/v2.1/servers/9c6be996-7886-41c6-9c0c-e0f899836cb0 => generated 1480 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:25:55.011988 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-c32ec652-f078-4908-a8cf-68d42b0bb1bc req-5d7a1c81-4315-4028-ae4d-d51f099788d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c4bb439-785f-4ac3-a7fc-b9325b52fa19", "name": "network-vif-deleted", "tag": "9007c444-99ef-4bf4-866d-0088c0c5f618"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:25:55.026153 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-c32ec652-f078-4908-a8cf-68d42b0bb1bc req-5d7a1c81-4315-4028-ae4d-d51f099788d1 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:55.028043 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-c32ec652-f078-4908-a8cf-68d42b0bb1bc req-5d7a1c81-4315-4028-ae4d-d51f099788d1 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:55.028043 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-c32ec652-f078-4908-a8cf-68d42b0bb1bc req-5d7a1c81-4315-4028-ae4d-d51f099788d1 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:55.051553 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-c32ec652-f078-4908-a8cf-68d42b0bb1bc req-5d7a1c81-4315-4028-ae4d-d51f099788d1 service nova] Creating event network-vif-deleted:9007c444-99ef-4bf4-866d-0088c0c5f618 for instance 5c4bb439-785f-4ac3-a7fc-b9325b52fa19 on n-h2-master-1 Oct 30 01:25:55.056670 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-c32ec652-f078-4908-a8cf-68d42b0bb1bc req-5d7a1c81-4315-4028-ae4d-d51f099788d1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048538 Oct 30 01:25:55.057711 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1477/2936] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:25:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:25:55.105059 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-91825289-7fad-4f1d-838f-39288baeb40c tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:55.113083 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-91825289-7fad-4f1d-838f-39288baeb40c tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/688c35c4-9529-49df-8255-98cd2b56c314" status: 200 len: 1306 microversion: 2.1 time: 0.264238 Oct 30 01:25:55.115620 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1460/2937] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:54 2022] GET /compute/v2.1/servers/688c35c4-9529-49df-8255-98cd2b56c314 => generated 1306 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:55.192156 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cd0fb85f-2fc6-4623-9b95-be365484ca83 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:55.194939 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cd0fb85f-2fc6-4623-9b95-be365484ca83 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: 64824cfc-200e-4ee1-8698-011b644ae315] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:55.225849 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cd0fb85f-2fc6-4623-9b95-be365484ca83 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:55.227631 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cd0fb85f-2fc6-4623-9b95-be365484ca83 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:55.228095 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cd0fb85f-2fc6-4623-9b95-be365484ca83 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:55.228811 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cd0fb85f-2fc6-4623-9b95-be365484ca83 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:55.231158 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cd0fb85f-2fc6-4623-9b95-be365484ca83 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:55.234456 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cd0fb85f-2fc6-4623-9b95-be365484ca83 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:55.710043 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-cd0fb85f-2fc6-4623-9b95-be365484ca83 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07f2b8c31f54c62aaba73ca2bd2edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c59bd73c7874a00b52ec7c5c4142039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:55.722311 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cd0fb85f-2fc6-4623-9b95-be365484ca83 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] 10.222.0.13 "GET /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315" status: 200 len: 1810 microversion: 2.1 time: 0.541710 Oct 30 01:25:55.724046 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1478/2938] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:55 2022] GET /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315 => generated 1810 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:55.795543 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-962bd856-1f00-4e62-a8e4-28ac9be1e97a tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:55.801954 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-962bd856-1f00-4e62-a8e4-28ac9be1e97a tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] [instance: 5c4bb439-785f-4ac3-a7fc-b9325b52fa19] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:55.821149 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-962bd856-1f00-4e62-a8e4-28ac9be1e97a tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:55.823959 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-962bd856-1f00-4e62-a8e4-28ac9be1e97a tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:55.824637 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-962bd856-1f00-4e62-a8e4-28ac9be1e97a tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:55.826308 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-962bd856-1f00-4e62-a8e4-28ac9be1e97a tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:55.828242 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-962bd856-1f00-4e62-a8e4-28ac9be1e97a tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:55.829429 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-962bd856-1f00-4e62-a8e4-28ac9be1e97a tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:55.909525 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:25:55.920334 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-962bd856-1f00-4e62-a8e4-28ac9be1e97a tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:55.921768 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-962bd856-1f00-4e62-a8e4-28ac9be1e97a tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:55.921768 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-962bd856-1f00-4e62-a8e4-28ac9be1e97a tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:55.921949 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-962bd856-1f00-4e62-a8e4-28ac9be1e97a tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lazy-loading 'fault' on Instance uuid 5c4bb439-785f-4ac3-a7fc-b9325b52fa19 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:25:55.975911 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-52544268-9bdb-4a64-9618-d5f8be3482d3 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:55.977155 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-52544268-9bdb-4a64-9618-d5f8be3482d3 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] [instance: 9c6be996-7886-41c6-9c0c-e0f899836cb0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:55.984875 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-52544268-9bdb-4a64-9618-d5f8be3482d3 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:55.985387 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-52544268-9bdb-4a64-9618-d5f8be3482d3 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:55.986051 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-52544268-9bdb-4a64-9618-d5f8be3482d3 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:55.986768 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-52544268-9bdb-4a64-9618-d5f8be3482d3 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:55.987220 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-52544268-9bdb-4a64-9618-d5f8be3482d3 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:55.987643 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-52544268-9bdb-4a64-9618-d5f8be3482d3 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:56.225938 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=10 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:25:56.518158 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-962bd856-1f00-4e62-a8e4-28ac9be1e97a tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba44010e0ca4892b56886e2b1636f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13238008c06e49c3b088809143308a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:56.535882 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-962bd856-1f00-4e62-a8e4-28ac9be1e97a tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ba44010e0ca4892b56886e2b1636f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13238008c06e49c3b088809143308a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:56.538792 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-962bd856-1f00-4e62-a8e4-28ac9be1e97a tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ba44010e0ca4892b56886e2b1636f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13238008c06e49c3b088809143308a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:56.542793 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-962bd856-1f00-4e62-a8e4-28ac9be1e97a tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] 10.222.0.13 "GET /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19" status: 200 len: 1352 microversion: 2.26 time: 0.756346 Oct 30 01:25:56.545485 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1461/2939] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:25:55 2022] GET /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19 => generated 1352 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:25:56.565237 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-71e94669-b895-432d-bfb6-c31c109f6d26 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:56.571849 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-71e94669-b895-432d-bfb6-c31c109f6d26 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: 688c35c4-9529-49df-8255-98cd2b56c314] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:56.581088 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-71e94669-b895-432d-bfb6-c31c109f6d26 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:56.582095 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-71e94669-b895-432d-bfb6-c31c109f6d26 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:56.583733 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-71e94669-b895-432d-bfb6-c31c109f6d26 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:56.584666 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-71e94669-b895-432d-bfb6-c31c109f6d26 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:56.585297 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-71e94669-b895-432d-bfb6-c31c109f6d26 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:56.585923 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-71e94669-b895-432d-bfb6-c31c109f6d26 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:57.006996 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-52544268-9bdb-4a64-9618-d5f8be3482d3 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e50d6775ec4d2e96ab6e839b4631f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310172f2dfaf4ddcb5eace8a13939cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:57.018438 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=96,nova_cell1:DELETE=1,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:25:57.022877 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-52544268-9bdb-4a64-9618-d5f8be3482d3 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6be996-7886-41c6-9c0c-e0f899836cb0" status: 200 len: 1467 microversion: 2.1 time: 1.051621 Oct 30 01:25:57.024558 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1479/2940] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:55 2022] GET /compute/v2.1/servers/9c6be996-7886-41c6-9c0c-e0f899836cb0 => generated 1467 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:57.302643 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fb197fed-36ca-410a-81cb-8c6a5c4a402b tempest-AbsoluteLimitsNegativeTestJSON-1296206733 tempest-AbsoluteLimitsNegativeTestJSON-1296206733-project] Calling method '.version_select at 0x7f44c7ecd550>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:57.338683 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb197fed-36ca-410a-81cb-8c6a5c4a402b tempest-AbsoluteLimitsNegativeTestJSON-1296206733 tempest-AbsoluteLimitsNegativeTestJSON-1296206733-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:57.343567 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb197fed-36ca-410a-81cb-8c6a5c4a402b tempest-AbsoluteLimitsNegativeTestJSON-1296206733 tempest-AbsoluteLimitsNegativeTestJSON-1296206733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:57.345754 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb197fed-36ca-410a-81cb-8c6a5c4a402b tempest-AbsoluteLimitsNegativeTestJSON-1296206733 tempest-AbsoluteLimitsNegativeTestJSON-1296206733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:57.348574 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb197fed-36ca-410a-81cb-8c6a5c4a402b tempest-AbsoluteLimitsNegativeTestJSON-1296206733 tempest-AbsoluteLimitsNegativeTestJSON-1296206733-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:57.351187 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb197fed-36ca-410a-81cb-8c6a5c4a402b tempest-AbsoluteLimitsNegativeTestJSON-1296206733 tempest-AbsoluteLimitsNegativeTestJSON-1296206733-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:57.352004 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb197fed-36ca-410a-81cb-8c6a5c4a402b tempest-AbsoluteLimitsNegativeTestJSON-1296206733 tempest-AbsoluteLimitsNegativeTestJSON-1296206733-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:57.398137 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-71e94669-b895-432d-bfb6-c31c109f6d26 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:57.410995 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-71e94669-b895-432d-bfb6-c31c109f6d26 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/688c35c4-9529-49df-8255-98cd2b56c314" status: 200 len: 1306 microversion: 2.1 time: 0.861832 Oct 30 01:25:57.419703 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1462/2941] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:56 2022] GET /compute/v2.1/servers/688c35c4-9529-49df-8255-98cd2b56c314 => generated 1306 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:57.451758 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b4aff68e-e6f4-489e-8307-69cf8bf7cf78 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:57.454761 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b4aff68e-e6f4-489e-8307-69cf8bf7cf78 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: 64824cfc-200e-4ee1-8698-011b644ae315] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:57.460970 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fb197fed-36ca-410a-81cb-8c6a5c4a402b tempest-AbsoluteLimitsNegativeTestJSON-1296206733 tempest-AbsoluteLimitsNegativeTestJSON-1296206733-project] 10.222.0.13 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.430401 Oct 30 01:25:57.464201 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1480/2942] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:25:57 2022] GET /compute/v2.1/limits => generated 511 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:25:57.480141 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8697712b-99e4-4a60-826e-fde8a632a5b7 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '.version_select at 0x7f44cc807d30>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:57.480808 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4aff68e-e6f4-489e-8307-69cf8bf7cf78 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:57.494321 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4aff68e-e6f4-489e-8307-69cf8bf7cf78 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:57.504667 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4aff68e-e6f4-489e-8307-69cf8bf7cf78 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:57.511300 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4aff68e-e6f4-489e-8307-69cf8bf7cf78 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:57.511300 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4aff68e-e6f4-489e-8307-69cf8bf7cf78 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:57.515438 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4aff68e-e6f4-489e-8307-69cf8bf7cf78 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:57.601594 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8697712b-99e4-4a60-826e-fde8a632a5b7 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "GET /compute/v2.1/images/deb14158-45d8-4539-889d-ff9726d046d7" status: 200 len: 784 microversion: 2.1 time: 0.133947 Oct 30 01:25:57.604918 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1481/2943] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:25:57 2022] GET /compute/v2.1/images/deb14158-45d8-4539-889d-ff9726d046d7 => generated 784 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:25:57.612943 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0343e079-051c-4673-8cdb-e8f0f39898dc tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:57.614111 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0343e079-051c-4673-8cdb-e8f0f39898dc tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] [instance: 5c4bb439-785f-4ac3-a7fc-b9325b52fa19] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:57.624950 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0343e079-051c-4673-8cdb-e8f0f39898dc tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:57.625461 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0343e079-051c-4673-8cdb-e8f0f39898dc tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:57.626228 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0343e079-051c-4673-8cdb-e8f0f39898dc tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:57.627097 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0343e079-051c-4673-8cdb-e8f0f39898dc tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:57.627729 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0343e079-051c-4673-8cdb-e8f0f39898dc tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:57.628313 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0343e079-051c-4673-8cdb-e8f0f39898dc tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:57.644513 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-0343e079-051c-4673-8cdb-e8f0f39898dc tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] HTTP exception thrown: Instance 5c4bb439-785f-4ac3-a7fc-b9325b52fa19 could not be found. Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0343e079-051c-4673-8cdb-e8f0f39898dc tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Request method failure captured: Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19 HTTP/1.1 Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdJ4_C6jSwGqqlrKuW7KDYdrFFtbx8XAsh-mMILr4K4RvlsSRz2aBAUIBE8HSHIRErenOzCBzjrYwMnFzA92_qxVvIvamYZxss1QQjVZIZy4O1xPKxKBm83-OMz7dDpbUJpfyqzlxjs5Aos4p_uobvbV1mcMfFBMbFIzCh8HoTr5Lzk Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: X-Openstack-Nova-Api-Version: 2.26 Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 13238008c06e49c3b088809143308a00 Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServerTagsTestJSON-909407033 Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/13238008c06e49c3b088809143308a00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_13238008c06e49c3b088809143308a00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/13238008c06e49c3b088809143308a00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/13238008c06e49c3b088809143308a00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServerTagsTestJSON-909407033 Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 13238008c06e49c3b088809143308a00 Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServerTagsTestJSON-909407033 Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServerTagsTestJSON-909407033-project Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 2ba44010e0ca4892b56886e2b1636f01 Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServerTagsTestJSON-909407033-project Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 5c4bb439-785f-4ac3-a7fc-b9325b52fa19 could not be found. Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '5c4bb439-785f-4ac3-a7fc-b9325b52fa19'} Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c4bb439-785f-4ac3-a7fc-b9325b52fa19 could not be found. Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c4bb439-785f-4ac3-a7fc-b9325b52fa19 could not be found. Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:57.646506 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:57.657860 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:57.657860 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:57.657860 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:57.657860 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:25:57.657860 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:25:57.657860 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c4bb439-785f-4ac3-a7fc-b9325b52fa19 could not be found. Oct 30 01:25:57.657860 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:57.657860 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0343e079-051c-4673-8cdb-e8f0f39898dc tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] Returning 404 to user: Instance 5c4bb439-785f-4ac3-a7fc-b9325b52fa19 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:25:57.657860 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0343e079-051c-4673-8cdb-e8f0f39898dc tempest-ServerTagsTestJSON-909407033 tempest-ServerTagsTestJSON-909407033-project] 10.222.0.13 "GET /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19" status: 404 len: 111 microversion: 2.26 time: 0.042239 Oct 30 01:25:57.657860 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1482/2944] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:25:57 2022] GET /compute/v2.1/servers/5c4bb439-785f-4ac3-a7fc-b9325b52fa19 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:25:57.659543 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7afec4e6-31db-44b9-b1e6-621928daf971 tempest-AbsoluteLimitsNegativeTestJSON-1296206733 tempest-AbsoluteLimitsNegativeTestJSON-1296206733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1136633348", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:25:57.725672 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-7afec4e6-31db-44b9-b1e6-621928daf971 tempest-AbsoluteLimitsNegativeTestJSON-1296206733 tempest-AbsoluteLimitsNegativeTestJSON-1296206733-project] validate_networks() for None {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:25:58.226780 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b4aff68e-e6f4-489e-8307-69cf8bf7cf78 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07f2b8c31f54c62aaba73ca2bd2edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c59bd73c7874a00b52ec7c5c4142039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:58.240474 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b4aff68e-e6f4-489e-8307-69cf8bf7cf78 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] 10.222.0.13 "GET /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315" status: 200 len: 1810 microversion: 2.1 time: 0.806904 Oct 30 01:25:58.241588 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1463/2945] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:57 2022] GET /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315 => generated 1810 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:58.248299 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-10d78803-9453-4a6f-a10f-678dd810b15c tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:58.258616 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-10d78803-9453-4a6f-a10f-678dd810b15c tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014245 Oct 30 01:25:58.260321 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1464/2946] 10.222.0.13 () {58 vars in 1137 bytes} [Sun Oct 30 01:25:58 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:25:58.294418 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8ec59b2f-f603-4b74-823e-5a57525886e9 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '.version_select at 0x7f44cc354820>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:58.357854 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=22 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:25:58.655904 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-7afec4e6-31db-44b9-b1e6-621928daf971 tempest-AbsoluteLimitsNegativeTestJSON-1296206733 tempest-AbsoluteLimitsNegativeTestJSON-1296206733-project] Getting quotas for project 2be9adf4469d4a5ba1206e22c7be136c. Resources: dict_keys(['metadata_items']) {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:25:58.666403 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-7afec4e6-31db-44b9-b1e6-621928daf971 tempest-AbsoluteLimitsNegativeTestJSON-1296206733 tempest-AbsoluteLimitsNegativeTestJSON-1296206733-project] Getting quotas for user 3e404a63b0294c66b288745079aaeaeb and project 2be9adf4469d4a5ba1206e22c7be136c. Resources: dict_keys(['metadata_items']) {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:25:58.696526 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-7afec4e6-31db-44b9-b1e6-621928daf971 tempest-AbsoluteLimitsNegativeTestJSON-1296206733 tempest-AbsoluteLimitsNegativeTestJSON-1296206733-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 30 01:25:58.699665 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7afec4e6-31db-44b9-b1e6-621928daf971 tempest-AbsoluteLimitsNegativeTestJSON-1296206733 tempest-AbsoluteLimitsNegativeTestJSON-1296206733-project] Request method failure captured: Oct 30 01:25:58.699665 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 30 01:25:58.699665 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:25:58.699665 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:25:58.699665 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:25:58.699665 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 1752 Oct 30 01:25:58.699665 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:25:58.699665 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:25:58.699665 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:25:58.699665 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:25:58.699665 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdKkZ-BSMkW38QFhQ5f4ylrKELwU55pGil4FzJoUPVAGoKK43BR2Z3BgqagcE9U3brZQwnWnapU-X0Fyc5Za3cEuctZV3TJ2thAijiKkK60Al9HSRGkAK4-7_KNU8D7MooCJIsAsH9v9jQ7pJD4TSHREvlUico-92mICz5Z7fKFXIpY Oct 30 01:25:58.699665 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:25:58.699665 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:25:58.699665 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:25:58.699665 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:25:58.699665 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:25:58.699665 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:25:58.699665 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 2be9adf4469d4a5ba1206e22c7be136c Oct 30 01:25:58.699665 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1296206733 Oct 30 01:25:58.699665 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:25:58.699665 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:25:58.699665 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2be9adf4469d4a5ba1206e22c7be136c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2be9adf4469d4a5ba1206e22c7be136c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2be9adf4469d4a5ba1206e22c7be136c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2be9adf4469d4a5ba1206e22c7be136c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:25:58.699665 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1296206733 Oct 30 01:25:58.699665 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 2be9adf4469d4a5ba1206e22c7be136c Oct 30 01:25:58.699665 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1296206733 Oct 30 01:25:58.699665 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1296206733-project Oct 30 01:25:58.699665 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:25:58.699665 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:25:58.699665 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 3e404a63b0294c66b288745079aaeaeb Oct 30 01:25:58.699665 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1296206733-project Oct 30 01:25:58.699665 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:25:58.699665 n-d-master-1 devstack@n-api.service[121102]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1136633348", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 30 01:25:58.699665 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:25:58.699665 n-d-master-1 devstack@n-api.service[121102]: exception: Maximum number of metadata items exceeds 128 Oct 30 01:25:58.703377 n-d-master-1 devstack@n-api.service[121102]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1136633348', 'imageRef': 'deb14158-45d8-4539-889d-ff9726d046d7', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 30 01:25:58.703377 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:25:58.703377 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:58.703377 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 30 01:25:58.703377 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 30 01:25:58.703377 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 01:25:58.703377 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 01:25:58.703377 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 30 01:25:58.703377 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 30 01:25:58.703377 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 30 01:25:58.703377 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 30 01:25:58.703377 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 30 01:25:58.703377 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 30 01:25:58.703377 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 30 01:25:58.703377 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:58.703377 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:58.703377 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:58.703377 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:58.703377 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 30 01:25:58.703377 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 30 01:25:58.703377 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 30 01:25:58.703377 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 30 01:25:58.703377 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 30 01:25:58.703377 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 30 01:25:58.703377 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 30 01:25:58.703377 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 30 01:25:58.703377 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 30 01:25:58.703377 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 30 01:25:58.703377 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 30 01:25:58.703377 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:58.703377 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:58.703377 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:58.703377 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:58.703377 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:58.703377 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:58.703377 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:25:58.703377 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:25:58.703377 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:25:58.703377 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:25:58.703377 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:25:58.703377 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:25:58.703377 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:25:58.703377 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:25:58.703377 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:25:58.706610 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:25:58.706610 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 30 01:25:58.706610 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 30 01:25:58.706610 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 30 01:25:58.706610 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 30 01:25:58.706610 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:58.706610 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:25:58.706610 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:58.706610 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:25:58.706610 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:25:58.706610 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:25:58.706610 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:25:58.706610 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:25:58.706610 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 30 01:25:58.706610 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:25:58.709394 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7afec4e6-31db-44b9-b1e6-621928daf971 tempest-AbsoluteLimitsNegativeTestJSON-1296206733 tempest-AbsoluteLimitsNegativeTestJSON-1296206733-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:25:58.710819 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7afec4e6-31db-44b9-b1e6-621928daf971 tempest-AbsoluteLimitsNegativeTestJSON-1296206733 tempest-AbsoluteLimitsNegativeTestJSON-1296206733-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 1.060548 Oct 30 01:25:58.717489 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1483/2947] 10.222.0.13 () {60 vars in 1148 bytes} [Sun Oct 30 01:25:57 2022] POST /compute/v2.1/servers => generated 87 bytes in 1068 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:25:58.727369 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-661dc580-7231-4a6e-a0c7-ed7ff73f1f51 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:58.729062 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-661dc580-7231-4a6e-a0c7-ed7ff73f1f51 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: 688c35c4-9529-49df-8255-98cd2b56c314] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:58.737885 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-661dc580-7231-4a6e-a0c7-ed7ff73f1f51 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:58.739455 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-661dc580-7231-4a6e-a0c7-ed7ff73f1f51 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:58.740089 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-661dc580-7231-4a6e-a0c7-ed7ff73f1f51 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:58.741419 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-661dc580-7231-4a6e-a0c7-ed7ff73f1f51 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:58.742043 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-661dc580-7231-4a6e-a0c7-ed7ff73f1f51 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:58.742653 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-661dc580-7231-4a6e-a0c7-ed7ff73f1f51 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:59.479705 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-661dc580-7231-4a6e-a0c7-ed7ff73f1f51 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:25:59.490049 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-661dc580-7231-4a6e-a0c7-ed7ff73f1f51 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/688c35c4-9529-49df-8255-98cd2b56c314" status: 200 len: 1306 microversion: 2.1 time: 0.770203 Oct 30 01:25:59.490648 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1484/2948] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:58 2022] GET /compute/v2.1/servers/688c35c4-9529-49df-8255-98cd2b56c314 => generated 1306 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:25:59.504951 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-ebf78fbc-4f88-4b0a-92c9-7272dca505e4 req-cadcea7f-0005-426e-85d4-6f93ff29c2d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64824cfc-200e-4ee1-8698-011b644ae315", "name": "network-vif-deleted", "tag": "66ae55c7-072f-4808-989d-0c0cc7aaf4fb"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:25:59.529584 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ebf78fbc-4f88-4b0a-92c9-7272dca505e4 req-cadcea7f-0005-426e-85d4-6f93ff29c2d0 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:59.530077 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ebf78fbc-4f88-4b0a-92c9-7272dca505e4 req-cadcea7f-0005-426e-85d4-6f93ff29c2d0 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:59.530508 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ebf78fbc-4f88-4b0a-92c9-7272dca505e4 req-cadcea7f-0005-426e-85d4-6f93ff29c2d0 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:59.580880 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-ebf78fbc-4f88-4b0a-92c9-7272dca505e4 req-cadcea7f-0005-426e-85d4-6f93ff29c2d0 service nova] Creating event network-vif-deleted:66ae55c7-072f-4808-989d-0c0cc7aaf4fb for instance 64824cfc-200e-4ee1-8698-011b644ae315 on n-h1-master-1 Oct 30 01:25:59.591448 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-ebf78fbc-4f88-4b0a-92c9-7272dca505e4 req-cadcea7f-0005-426e-85d4-6f93ff29c2d0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094878 Oct 30 01:25:59.592152 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1485/2949] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:25:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:25:59.605514 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-110d20b5-e666-4995-9e64-e0f7bf0f2746 req-3065d388-0392-4452-b8ea-28d1bc650d2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64824cfc-200e-4ee1-8698-011b644ae315", "name": "network-vif-unplugged", "status": "completed", "tag": "ad034ad3-0acf-4013-9d50-4bd36d7d861f"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:25:59.629537 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-110d20b5-e666-4995-9e64-e0f7bf0f2746 req-3065d388-0392-4452-b8ea-28d1bc650d2b service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:59.633497 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-110d20b5-e666-4995-9e64-e0f7bf0f2746 req-3065d388-0392-4452-b8ea-28d1bc650d2b service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:59.633991 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-110d20b5-e666-4995-9e64-e0f7bf0f2746 req-3065d388-0392-4452-b8ea-28d1bc650d2b service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:59.661762 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-110d20b5-e666-4995-9e64-e0f7bf0f2746 req-3065d388-0392-4452-b8ea-28d1bc650d2b service nova] Creating event network-vif-unplugged:ad034ad3-0acf-4013-9d50-4bd36d7d861f for instance 64824cfc-200e-4ee1-8698-011b644ae315 on n-h1-master-1 Oct 30 01:25:59.673216 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-110d20b5-e666-4995-9e64-e0f7bf0f2746 req-3065d388-0392-4452-b8ea-28d1bc650d2b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077526 Oct 30 01:25:59.685120 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1486/2950] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:25:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:25:59.685531 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-23972906-b01c-428d-bb39-a92fe642e710 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:25:59.686510 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-23972906-b01c-428d-bb39-a92fe642e710 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: 64824cfc-200e-4ee1-8698-011b644ae315] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:25:59.694232 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-23972906-b01c-428d-bb39-a92fe642e710 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:59.701090 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-23972906-b01c-428d-bb39-a92fe642e710 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:59.701749 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-23972906-b01c-428d-bb39-a92fe642e710 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:59.702933 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-23972906-b01c-428d-bb39-a92fe642e710 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:25:59.703549 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-23972906-b01c-428d-bb39-a92fe642e710 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:25:59.704123 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-23972906-b01c-428d-bb39-a92fe642e710 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:25:59.977952 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8ec59b2f-f603-4b74-823e-5a57525886e9 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "DELETE /compute/v2.1/images/50669d24-ab56-475f-8236-0ff19406f3eb" status: 204 len: 0 microversion: 2.1 time: 1.706638 Oct 30 01:25:59.978608 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1465/2951] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:58 2022] DELETE /compute/v2.1/images/50669d24-ab56-475f-8236-0ff19406f3eb => generated 0 bytes in 1710 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:25:59.987509 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1a2c3261-0880-459d-96e1-20073cc9d0e3 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '.version_select at 0x7f44cc337af0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:00.028256 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-1a2c3261-0880-459d-96e1-20073cc9d0e3 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] HTTP exception thrown: Image not found. Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1a2c3261-0880-459d-96e1-20073cc9d0e3 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Request method failure captured: Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/images/50669d24-ab56-475f-8236-0ff19406f3eb HTTP/1.1 Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdJm3MQlkCb2VHBGOXohP-uIJdzdhji0-kQQ_uMEBkEzH-iKU7kbwbigPRSsXrH9qWPsLwUqbYabIAQ2oRSzX8g-qsu0Xwv5d9nFHxtUFsgJa8O4N6kz8wyNXDinDWG_Fzaf3mA1yILM4EG-7OdjblFzj6JU4plfEiAhh_5BkYAtnM8 Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 310172f2dfaf4ddcb5eace8a13939cda Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ImagesOneServerTestJSON-1108348315 Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/310172f2dfaf4ddcb5eace8a13939cda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_310172f2dfaf4ddcb5eace8a13939cda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/310172f2dfaf4ddcb5eace8a13939cda"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/310172f2dfaf4ddcb5eace8a13939cda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ImagesOneServerTestJSON-1108348315 Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 310172f2dfaf4ddcb5eace8a13939cda Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1108348315 Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ImagesOneServerTestJSON-1108348315-project Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: e1e50d6775ec4d2e96ab6e839b4631f1 Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ImagesOneServerTestJSON-1108348315-project Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: method: Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: exception: Image not found. Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '50669d24-ab56-475f-8236-0ff19406f3eb'} Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 50669d24-ab56-475f-8236-0ff19406f3eb Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 30 01:26:00.030665 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 30 01:26:00.035315 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 30 01:26:00.035315 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 30 01:26:00.035315 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 30 01:26:00.035315 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 30 01:26:00.035315 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 30 01:26:00.035315 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 30 01:26:00.035315 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 30 01:26:00.035315 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 30 01:26:00.035315 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 30 01:26:00.035315 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 30 01:26:00.035315 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 30 01:26:00.035315 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 30 01:26:00.035315 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 30 01:26:00.035315 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 30 01:26:00.035315 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 30 01:26:00.035315 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 30 01:26:00.035315 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 30 01:26:00.035315 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 50669d24-ab56-475f-8236-0ff19406f3eb could not be found. Oct 30 01:26:00.035315 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:26:00.035315 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:26:00.035315 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:26:00.035315 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:26:00.035315 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:26:00.035315 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:26:00.035315 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:26:00.035315 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:26:00.035315 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:26:00.035315 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:26:00.035315 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:26:00.035315 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:26:00.035315 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 30 01:26:00.035315 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 30 01:26:00.035315 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 30 01:26:00.035315 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:26:00.035315 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:26:00.035315 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:26:00.035315 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:26:00.035315 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:26:00.035315 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:26:00.035315 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:26:00.035315 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:26:00.035315 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 30 01:26:00.035315 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:26:00.039875 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1a2c3261-0880-459d-96e1-20073cc9d0e3 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Returning 404 to user: Image not found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:26:00.062166 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1a2c3261-0880-459d-96e1-20073cc9d0e3 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "GET /compute/v2.1/images/50669d24-ab56-475f-8236-0ff19406f3eb" status: 404 len: 62 microversion: 2.1 time: 0.058092 Oct 30 01:26:00.062166 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1466/2952] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:25:59 2022] GET /compute/v2.1/images/50669d24-ab56-475f-8236-0ff19406f3eb => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 30 01:26:00.076173 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-244d4cd2-2cd9-442e-a811-c4a8cd2ea3b4 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-687033904"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:26:00.078361 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-244d4cd2-2cd9-442e-a811-c4a8cd2ea3b4 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] [instance: 9c6be996-7886-41c6-9c0c-e0f899836cb0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:00.094258 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-244d4cd2-2cd9-442e-a811-c4a8cd2ea3b4 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:00.095034 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-244d4cd2-2cd9-442e-a811-c4a8cd2ea3b4 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:00.095801 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-244d4cd2-2cd9-442e-a811-c4a8cd2ea3b4 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:00.096794 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-244d4cd2-2cd9-442e-a811-c4a8cd2ea3b4 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:00.097697 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-244d4cd2-2cd9-442e-a811-c4a8cd2ea3b4 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:00.098436 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-244d4cd2-2cd9-442e-a811-c4a8cd2ea3b4 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:00.770767 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-244d4cd2-2cd9-442e-a811-c4a8cd2ea3b4 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "POST /compute/v2.1/servers/9c6be996-7886-41c6-9c0c-e0f899836cb0/action" status: 202 len: 0 microversion: 2.1 time: 0.711289 Oct 30 01:26:00.776075 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1467/2953] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:26:00 2022] POST /compute/v2.1/servers/9c6be996-7886-41c6-9c0c-e0f899836cb0/action => generated 0 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 30 01:26:00.798412 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2a5d3f7e-dcc4-4008-9307-0242cdf6e92e tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:00.801698 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2a5d3f7e-dcc4-4008-9307-0242cdf6e92e tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: 688c35c4-9529-49df-8255-98cd2b56c314] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:00.817858 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a5d3f7e-dcc4-4008-9307-0242cdf6e92e tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:00.818775 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a5d3f7e-dcc4-4008-9307-0242cdf6e92e tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:00.820605 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a5d3f7e-dcc4-4008-9307-0242cdf6e92e tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:00.822163 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a5d3f7e-dcc4-4008-9307-0242cdf6e92e tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:00.824440 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a5d3f7e-dcc4-4008-9307-0242cdf6e92e tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:00.826185 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a5d3f7e-dcc4-4008-9307-0242cdf6e92e tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:00.861226 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-23972906-b01c-428d-bb39-a92fe642e710 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07f2b8c31f54c62aaba73ca2bd2edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c59bd73c7874a00b52ec7c5c4142039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:00.889075 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-23972906-b01c-428d-bb39-a92fe642e710 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] 10.222.0.13 "GET /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315" status: 200 len: 1631 microversion: 2.1 time: 1.206066 Oct 30 01:26:00.892049 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1487/2954] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:25:59 2022] GET /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315 => generated 1631 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:00.917281 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0044617c-6f95-4cc6-a4ad-82a13612f317 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '.version_select at 0x7f44cc6229d0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:01.008075 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0044617c-6f95-4cc6-a4ad-82a13612f317 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "GET /compute/v2.1/images/b10792ca-7e00-4893-b95b-64813a70d3e3" status: 200 len: 1428 microversion: 2.1 time: 0.113584 Oct 30 01:26:01.009021 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1488/2955] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:26:00 2022] GET /compute/v2.1/images/b10792ca-7e00-4893-b95b-64813a70d3e3 => generated 1428 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:01.459776 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2a5d3f7e-dcc4-4008-9307-0242cdf6e92e tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:01.470805 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2a5d3f7e-dcc4-4008-9307-0242cdf6e92e tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/688c35c4-9529-49df-8255-98cd2b56c314" status: 200 len: 1306 microversion: 2.1 time: 0.691069 Oct 30 01:26:01.482042 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1468/2956] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:00 2022] GET /compute/v2.1/servers/688c35c4-9529-49df-8255-98cd2b56c314 => generated 1306 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:01.733605 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-855e75ae-911a-49ac-ab64-47a4d999286f req-01359bfb-ab06-4c95-bd51-3277207f68f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "688c35c4-9529-49df-8255-98cd2b56c314", "name": "network-vif-plugged", "status": "completed", "tag": "f6c4cc9d-1ae2-485f-8d36-d57599740dfc"}, {"server_uuid": "64824cfc-200e-4ee1-8698-011b644ae315", "name": "network-vif-unplugged", "status": "completed", "tag": "ade8fcd2-9810-47b4-a0b0-468ebf236d36"}, {"server_uuid": "9c6be996-7886-41c6-9c0c-e0f899836cb0", "name": "network-vif-unplugged", "status": "completed", "tag": "aee42464-dca8-4339-bc2b-97369d928349"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:26:01.741008 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-c3a0ec90-739a-4f61-89b3-9e2bea760ee9 req-1f6b7298-fa27-4d02-97ba-81b39e3952cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64824cfc-200e-4ee1-8698-011b644ae315", "name": "network-vif-deleted", "tag": "ade8fcd2-9810-47b4-a0b0-468ebf236d36"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:26:01.770060 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-c3a0ec90-739a-4f61-89b3-9e2bea760ee9 req-1f6b7298-fa27-4d02-97ba-81b39e3952cc service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:01.774579 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-c3a0ec90-739a-4f61-89b3-9e2bea760ee9 req-1f6b7298-fa27-4d02-97ba-81b39e3952cc service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:01.777740 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-c3a0ec90-739a-4f61-89b3-9e2bea760ee9 req-1f6b7298-fa27-4d02-97ba-81b39e3952cc service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:01.798194 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-855e75ae-911a-49ac-ab64-47a4d999286f req-01359bfb-ab06-4c95-bd51-3277207f68f8 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:01.800541 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-855e75ae-911a-49ac-ab64-47a4d999286f req-01359bfb-ab06-4c95-bd51-3277207f68f8 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:01.801160 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-855e75ae-911a-49ac-ab64-47a4d999286f req-01359bfb-ab06-4c95-bd51-3277207f68f8 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:01.861318 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-c3a0ec90-739a-4f61-89b3-9e2bea760ee9 req-1f6b7298-fa27-4d02-97ba-81b39e3952cc service nova] Creating event network-vif-deleted:ade8fcd2-9810-47b4-a0b0-468ebf236d36 for instance 64824cfc-200e-4ee1-8698-011b644ae315 on n-h1-master-1 Oct 30 01:26:01.892323 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-855e75ae-911a-49ac-ab64-47a4d999286f req-01359bfb-ab06-4c95-bd51-3277207f68f8 service nova] Creating event network-vif-plugged:f6c4cc9d-1ae2-485f-8d36-d57599740dfc for instance 688c35c4-9529-49df-8255-98cd2b56c314 on n-h2-master-1 Oct 30 01:26:01.902021 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-c3a0ec90-739a-4f61-89b3-9e2bea760ee9 req-1f6b7298-fa27-4d02-97ba-81b39e3952cc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163958 Oct 30 01:26:01.902679 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-855e75ae-911a-49ac-ab64-47a4d999286f req-01359bfb-ab06-4c95-bd51-3277207f68f8 service nova] Creating event network-vif-unplugged:ade8fcd2-9810-47b4-a0b0-468ebf236d36 for instance 64824cfc-200e-4ee1-8698-011b644ae315 on n-h1-master-1 Oct 30 01:26:01.903581 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-855e75ae-911a-49ac-ab64-47a4d999286f req-01359bfb-ab06-4c95-bd51-3277207f68f8 service nova] Creating event network-vif-unplugged:aee42464-dca8-4339-bc2b-97369d928349 for instance 9c6be996-7886-41c6-9c0c-e0f899836cb0 on n-h2-master-1 Oct 30 01:26:01.907380 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1469/2957] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:26:01.943254 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-242eba0a-eac3-45a1-b275-b31995918915 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:01.950556 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-242eba0a-eac3-45a1-b275-b31995918915 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: 64824cfc-200e-4ee1-8698-011b644ae315] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:01.971233 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-855e75ae-911a-49ac-ab64-47a4d999286f req-01359bfb-ab06-4c95-bd51-3277207f68f8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 529 microversion: 2.1 time: 0.239814 Oct 30 01:26:01.976652 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1489/2958] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 529 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:26:01.983301 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-242eba0a-eac3-45a1-b275-b31995918915 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:01.983813 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-242eba0a-eac3-45a1-b275-b31995918915 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:01.984261 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-242eba0a-eac3-45a1-b275-b31995918915 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:01.984995 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-242eba0a-eac3-45a1-b275-b31995918915 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:01.988369 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-242eba0a-eac3-45a1-b275-b31995918915 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:01.988526 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-242eba0a-eac3-45a1-b275-b31995918915 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:02.028469 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1d6387d7-764f-4a8e-8351-e92fad91e892 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '.version_select at 0x7f44d04cf040>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:02.079133 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:26:02.121329 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1d6387d7-764f-4a8e-8351-e92fad91e892 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "GET /compute/v2.1/images/b10792ca-7e00-4893-b95b-64813a70d3e3" status: 200 len: 1428 microversion: 2.1 time: 0.100563 Oct 30 01:26:02.122020 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1490/2959] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:26:02 2022] GET /compute/v2.1/images/b10792ca-7e00-4893-b95b-64813a70d3e3 => generated 1428 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:26:02.499879 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c1643f56-a897-48f4-82fa-a0311de21514 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:02.500860 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c1643f56-a897-48f4-82fa-a0311de21514 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: 688c35c4-9529-49df-8255-98cd2b56c314] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:02.510311 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c1643f56-a897-48f4-82fa-a0311de21514 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:02.510993 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c1643f56-a897-48f4-82fa-a0311de21514 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:02.511682 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c1643f56-a897-48f4-82fa-a0311de21514 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:02.513456 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c1643f56-a897-48f4-82fa-a0311de21514 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:02.514196 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c1643f56-a897-48f4-82fa-a0311de21514 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:02.514903 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c1643f56-a897-48f4-82fa-a0311de21514 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:02.756518 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-242eba0a-eac3-45a1-b275-b31995918915 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07f2b8c31f54c62aaba73ca2bd2edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c59bd73c7874a00b52ec7c5c4142039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:02.768335 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-242eba0a-eac3-45a1-b275-b31995918915 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] 10.222.0.13 "GET /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315" status: 200 len: 1610 microversion: 2.1 time: 0.855312 Oct 30 01:26:02.789897 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1470/2960] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:01 2022] GET /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315 => generated 1610 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:03.160896 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d2257d95-9f05-4701-9248-b0e96eceeeb9 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '.version_select at 0x7f44cc7dfe50>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:03.240621 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c1643f56-a897-48f4-82fa-a0311de21514 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:03.249858 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c1643f56-a897-48f4-82fa-a0311de21514 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/688c35c4-9529-49df-8255-98cd2b56c314" status: 200 len: 1306 microversion: 2.1 time: 0.741042 Oct 30 01:26:03.250583 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1491/2961] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:02 2022] GET /compute/v2.1/servers/688c35c4-9529-49df-8255-98cd2b56c314 => generated 1306 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:03.269716 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d2257d95-9f05-4701-9248-b0e96eceeeb9 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "GET /compute/v2.1/images/b10792ca-7e00-4893-b95b-64813a70d3e3" status: 200 len: 1428 microversion: 2.1 time: 0.133941 Oct 30 01:26:03.270746 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1471/2962] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:26:03 2022] GET /compute/v2.1/images/b10792ca-7e00-4893-b95b-64813a70d3e3 => generated 1428 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:26:03.800116 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c00b1a36-da32-434b-9cd9-27447e840297 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:03.800922 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c00b1a36-da32-434b-9cd9-27447e840297 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: 64824cfc-200e-4ee1-8698-011b644ae315] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:03.810025 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:26:03.831135 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c00b1a36-da32-434b-9cd9-27447e840297 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:03.831844 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c00b1a36-da32-434b-9cd9-27447e840297 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:03.832449 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c00b1a36-da32-434b-9cd9-27447e840297 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:03.834133 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c00b1a36-da32-434b-9cd9-27447e840297 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:03.834915 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c00b1a36-da32-434b-9cd9-27447e840297 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:03.838965 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c00b1a36-da32-434b-9cd9-27447e840297 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:03.964636 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-3fb8f0cf-38af-4320-9d2e-654fe19e8b2a req-f1c9f863-235c-4479-8614-89666f17a71a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64824cfc-200e-4ee1-8698-011b644ae315", "name": "network-vif-deleted", "tag": "ad034ad3-0acf-4013-9d50-4bd36d7d861f"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:26:03.991193 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-3fb8f0cf-38af-4320-9d2e-654fe19e8b2a req-f1c9f863-235c-4479-8614-89666f17a71a service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:03.993484 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-3fb8f0cf-38af-4320-9d2e-654fe19e8b2a req-f1c9f863-235c-4479-8614-89666f17a71a service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:03.994682 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-3fb8f0cf-38af-4320-9d2e-654fe19e8b2a req-f1c9f863-235c-4479-8614-89666f17a71a service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:04.013226 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-3fb8f0cf-38af-4320-9d2e-654fe19e8b2a req-f1c9f863-235c-4479-8614-89666f17a71a service nova] Creating event network-vif-deleted:ad034ad3-0acf-4013-9d50-4bd36d7d861f for instance 64824cfc-200e-4ee1-8698-011b644ae315 on n-h1-master-1 Oct 30 01:26:04.019871 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-3fb8f0cf-38af-4320-9d2e-654fe19e8b2a req-f1c9f863-235c-4479-8614-89666f17a71a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060923 Oct 30 01:26:04.020909 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1472/2963] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:26:04.023277 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c00b1a36-da32-434b-9cd9-27447e840297 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07f2b8c31f54c62aaba73ca2bd2edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c59bd73c7874a00b52ec7c5c4142039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:04.036586 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c00b1a36-da32-434b-9cd9-27447e840297 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] 10.222.0.13 "GET /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315" status: 200 len: 1453 microversion: 2.1 time: 0.243312 Oct 30 01:26:04.058690 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1492/2964] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:03 2022] GET /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315 => generated 1453 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:04.287734 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cbd41224-c917-4e6a-88f4-76405b222f7c tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '.version_select at 0x7f44d05360d0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:04.294130 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9809eca6-821d-46f9-b7df-f2ef43be2920 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:04.294130 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9809eca6-821d-46f9-b7df-f2ef43be2920 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: 688c35c4-9529-49df-8255-98cd2b56c314] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:04.306223 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9809eca6-821d-46f9-b7df-f2ef43be2920 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:04.307179 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9809eca6-821d-46f9-b7df-f2ef43be2920 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:04.307855 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9809eca6-821d-46f9-b7df-f2ef43be2920 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:04.317780 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9809eca6-821d-46f9-b7df-f2ef43be2920 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:04.319779 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9809eca6-821d-46f9-b7df-f2ef43be2920 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:04.324116 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9809eca6-821d-46f9-b7df-f2ef43be2920 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:04.377888 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cbd41224-c917-4e6a-88f4-76405b222f7c tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "GET /compute/v2.1/images/b10792ca-7e00-4893-b95b-64813a70d3e3" status: 200 len: 1428 microversion: 2.1 time: 0.095608 Oct 30 01:26:04.378700 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1493/2965] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:26:04 2022] GET /compute/v2.1/images/b10792ca-7e00-4893-b95b-64813a70d3e3 => generated 1428 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:04.649081 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9809eca6-821d-46f9-b7df-f2ef43be2920 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:04.664387 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9809eca6-821d-46f9-b7df-f2ef43be2920 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/688c35c4-9529-49df-8255-98cd2b56c314" status: 200 len: 1485 microversion: 2.1 time: 0.395152 Oct 30 01:26:04.677524 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1473/2966] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:04 2022] GET /compute/v2.1/servers/688c35c4-9529-49df-8255-98cd2b56c314 => generated 1485 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:04.695450 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-67ec7909-f5c1-415f-85c9-e791034fcd86 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:26:04.700815 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-67ec7909-f5c1-415f-85c9-e791034fcd86 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: 688c35c4-9529-49df-8255-98cd2b56c314] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:04.724486 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67ec7909-f5c1-415f-85c9-e791034fcd86 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:04.733582 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67ec7909-f5c1-415f-85c9-e791034fcd86 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:04.733582 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67ec7909-f5c1-415f-85c9-e791034fcd86 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:04.733582 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67ec7909-f5c1-415f-85c9-e791034fcd86 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:04.733582 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67ec7909-f5c1-415f-85c9-e791034fcd86 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:04.733582 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67ec7909-f5c1-415f-85c9-e791034fcd86 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:04.793077 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-67ec7909-f5c1-415f-85c9-e791034fcd86 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lazy-loading 'flavor' on Instance uuid 688c35c4-9529-49df-8255-98cd2b56c314 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:26:05.082908 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1308f0a2-1e40-45a1-a780-fa38ac8d1232 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:05.083537 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1308f0a2-1e40-45a1-a780-fa38ac8d1232 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: 64824cfc-200e-4ee1-8698-011b644ae315] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:05.114374 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1308f0a2-1e40-45a1-a780-fa38ac8d1232 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:05.119871 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1308f0a2-1e40-45a1-a780-fa38ac8d1232 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:05.120573 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1308f0a2-1e40-45a1-a780-fa38ac8d1232 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:05.121371 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1308f0a2-1e40-45a1-a780-fa38ac8d1232 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:05.128302 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1308f0a2-1e40-45a1-a780-fa38ac8d1232 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:05.129214 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1308f0a2-1e40-45a1-a780-fa38ac8d1232 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:05.175568 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-67ec7909-f5c1-415f-85c9-e791034fcd86 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "POST /compute/v2.1/servers/688c35c4-9529-49df-8255-98cd2b56c314/action" status: 202 len: 0 microversion: 2.1 time: 0.489902 Oct 30 01:26:05.176279 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1494/2967] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:26:04 2022] POST /compute/v2.1/servers/688c35c4-9529-49df-8255-98cd2b56c314/action => generated 0 bytes in 492 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:26:05.186887 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b605aa7c-a380-4409-9652-80511406bd68 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:05.190442 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b605aa7c-a380-4409-9652-80511406bd68 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: 688c35c4-9529-49df-8255-98cd2b56c314] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:05.206755 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b605aa7c-a380-4409-9652-80511406bd68 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:05.207453 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b605aa7c-a380-4409-9652-80511406bd68 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:05.209005 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b605aa7c-a380-4409-9652-80511406bd68 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:05.210728 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b605aa7c-a380-4409-9652-80511406bd68 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:05.212416 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b605aa7c-a380-4409-9652-80511406bd68 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:05.213008 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b605aa7c-a380-4409-9652-80511406bd68 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:05.224617 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1308f0a2-1e40-45a1-a780-fa38ac8d1232 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:05.225307 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1308f0a2-1e40-45a1-a780-fa38ac8d1232 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:05.225790 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1308f0a2-1e40-45a1-a780-fa38ac8d1232 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:05.228870 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-1308f0a2-1e40-45a1-a780-fa38ac8d1232 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lazy-loading 'fault' on Instance uuid 64824cfc-200e-4ee1-8698-011b644ae315 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:26:05.381905 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1308f0a2-1e40-45a1-a780-fa38ac8d1232 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07f2b8c31f54c62aaba73ca2bd2edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c59bd73c7874a00b52ec7c5c4142039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:05.393661 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1308f0a2-1e40-45a1-a780-fa38ac8d1232 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] 10.222.0.13 "GET /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315" status: 200 len: 1303 microversion: 2.1 time: 0.314737 Oct 30 01:26:05.394356 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1474/2968] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:05 2022] GET /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315 => generated 1303 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:26:05.411147 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-42da8a8d-3848-4a80-b427-857383bcb094 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '.version_select at 0x7f44cc93f430>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:05.467577 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-42da8a8d-3848-4a80-b427-857383bcb094 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "GET /compute/v2.1/images/b10792ca-7e00-4893-b95b-64813a70d3e3" status: 200 len: 1428 microversion: 2.1 time: 0.068557 Oct 30 01:26:05.476454 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1475/2969] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:26:05 2022] GET /compute/v2.1/images/b10792ca-7e00-4893-b95b-64813a70d3e3 => generated 1428 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:05.627235 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b605aa7c-a380-4409-9652-80511406bd68 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:05.639024 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b605aa7c-a380-4409-9652-80511406bd68 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/688c35c4-9529-49df-8255-98cd2b56c314" status: 200 len: 1493 microversion: 2.1 time: 0.456344 Oct 30 01:26:05.644271 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1495/2970] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:05 2022] GET /compute/v2.1/servers/688c35c4-9529-49df-8255-98cd2b56c314 => generated 1493 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:26:06.422179 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1243826c-a12f-4aaa-93a6-434d352ab43b tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:06.422179 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1243826c-a12f-4aaa-93a6-434d352ab43b tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: 64824cfc-200e-4ee1-8698-011b644ae315] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:06.431507 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1243826c-a12f-4aaa-93a6-434d352ab43b tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:06.435595 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1243826c-a12f-4aaa-93a6-434d352ab43b tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:06.437818 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1243826c-a12f-4aaa-93a6-434d352ab43b tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:06.440535 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1243826c-a12f-4aaa-93a6-434d352ab43b tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:06.441294 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1243826c-a12f-4aaa-93a6-434d352ab43b tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:06.444015 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1243826c-a12f-4aaa-93a6-434d352ab43b tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:06.469479 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-1243826c-a12f-4aaa-93a6-434d352ab43b tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] HTTP exception thrown: Instance 64824cfc-200e-4ee1-8698-011b644ae315 could not be found. Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1243826c-a12f-4aaa-93a6-434d352ab43b tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Request method failure captured: Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315 HTTP/1.1 Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdJr-vSoZanPnPVilvoAflboAr3cSFQBUxYWvsa8_cZpjEapRWY2N6m9rWhCI2JtURKxLRhkRvkctLNpIiN4TVHqY_YC3amdNtOfM6wU3MIQLQCfCaT-WA5iUAKugn9ry0pb8FrVeVuzHf2DIElxquUC3dfXuf-g1DEAno4NYR3z5PE Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 2c59bd73c7874a00b52ec7c5c4142039 Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersTestMultiNic-609219501 Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2c59bd73c7874a00b52ec7c5c4142039"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2c59bd73c7874a00b52ec7c5c4142039"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2c59bd73c7874a00b52ec7c5c4142039"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2c59bd73c7874a00b52ec7c5c4142039"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersTestMultiNic-609219501 Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 2c59bd73c7874a00b52ec7c5c4142039 Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersTestMultiNic-609219501 Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersTestMultiNic-609219501-project Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: a07f2b8c31f54c62aaba73ca2bd2edb8 Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersTestMultiNic-609219501-project Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 64824cfc-200e-4ee1-8698-011b644ae315 could not be found. Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '64824cfc-200e-4ee1-8698-011b644ae315'} Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64824cfc-200e-4ee1-8698-011b644ae315 could not be found. Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64824cfc-200e-4ee1-8698-011b644ae315 could not be found. Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:26:06.471221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:26:06.478849 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:26:06.478849 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:26:06.478849 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:26:06.478849 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:26:06.478849 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:26:06.478849 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64824cfc-200e-4ee1-8698-011b644ae315 could not be found. Oct 30 01:26:06.478849 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:26:06.478849 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1243826c-a12f-4aaa-93a6-434d352ab43b tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Returning 404 to user: Instance 64824cfc-200e-4ee1-8698-011b644ae315 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:26:06.478849 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1243826c-a12f-4aaa-93a6-434d352ab43b tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] 10.222.0.13 "GET /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315" status: 404 len: 111 microversion: 2.1 time: 0.057407 Oct 30 01:26:06.481721 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1476/2971] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:06 2022] GET /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:26:06.493144 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-21edb3df-5c08-4849-ac2f-536da8f60863 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '.version_select at 0x7f44cc3d9940>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:06.584808 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-21edb3df-5c08-4849-ac2f-536da8f60863 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "GET /compute/v2.1/images/b10792ca-7e00-4893-b95b-64813a70d3e3" status: 200 len: 1428 microversion: 2.1 time: 0.097074 Oct 30 01:26:06.589839 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1496/2972] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:26:06 2022] GET /compute/v2.1/images/b10792ca-7e00-4893-b95b-64813a70d3e3 => generated 1428 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:06.663529 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bd92caa1-d2d0-4df8-b11b-d4c73d22d05b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:06.664539 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-bd92caa1-d2d0-4df8-b11b-d4c73d22d05b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: 688c35c4-9529-49df-8255-98cd2b56c314] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:06.675690 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd92caa1-d2d0-4df8-b11b-d4c73d22d05b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:06.676499 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd92caa1-d2d0-4df8-b11b-d4c73d22d05b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:06.677531 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd92caa1-d2d0-4df8-b11b-d4c73d22d05b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:06.678949 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd92caa1-d2d0-4df8-b11b-d4c73d22d05b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:06.679598 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd92caa1-d2d0-4df8-b11b-d4c73d22d05b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:06.680365 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd92caa1-d2d0-4df8-b11b-d4c73d22d05b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:06.940328 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-e1f98ad7-dfb2-44e6-91e2-5fced6a948a9 req-d6593f42-317e-45a6-96b4-a522ede42311 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c6be996-7886-41c6-9c0c-e0f899836cb0", "name": "network-vif-plugged", "status": "completed", "tag": "aee42464-dca8-4339-bc2b-97369d928349"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:26:06.974742 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-e1f98ad7-dfb2-44e6-91e2-5fced6a948a9 req-d6593f42-317e-45a6-96b4-a522ede42311 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:06.978431 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-e1f98ad7-dfb2-44e6-91e2-5fced6a948a9 req-d6593f42-317e-45a6-96b4-a522ede42311 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:06.978909 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-e1f98ad7-dfb2-44e6-91e2-5fced6a948a9 req-d6593f42-317e-45a6-96b4-a522ede42311 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:07.001109 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-e1f98ad7-dfb2-44e6-91e2-5fced6a948a9 req-d6593f42-317e-45a6-96b4-a522ede42311 service nova] Creating event network-vif-plugged:aee42464-dca8-4339-bc2b-97369d928349 for instance 9c6be996-7886-41c6-9c0c-e0f899836cb0 on n-h2-master-1 Oct 30 01:26:07.010100 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-e1f98ad7-dfb2-44e6-91e2-5fced6a948a9 req-d6593f42-317e-45a6-96b4-a522ede42311 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075002 Oct 30 01:26:07.011090 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1497/2973] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:26:07.384729 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-bd92caa1-d2d0-4df8-b11b-d4c73d22d05b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:07.396570 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bd92caa1-d2d0-4df8-b11b-d4c73d22d05b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/688c35c4-9529-49df-8255-98cd2b56c314" status: 200 len: 1476 microversion: 2.1 time: 0.737130 Oct 30 01:26:07.400363 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1477/2974] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:06 2022] GET /compute/v2.1/servers/688c35c4-9529-49df-8255-98cd2b56c314 => generated 1476 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:07.421520 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:26:07.426453 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-969eeac3-28b0-44bb-88ff-0a145d9b7964 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-370737637"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:26:07.429158 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-969eeac3-28b0-44bb-88ff-0a145d9b7964 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: 688c35c4-9529-49df-8255-98cd2b56c314] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:07.436307 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-969eeac3-28b0-44bb-88ff-0a145d9b7964 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:07.437084 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-969eeac3-28b0-44bb-88ff-0a145d9b7964 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:07.437799 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-969eeac3-28b0-44bb-88ff-0a145d9b7964 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:07.438731 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-969eeac3-28b0-44bb-88ff-0a145d9b7964 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:07.439463 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-969eeac3-28b0-44bb-88ff-0a145d9b7964 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:07.440098 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-969eeac3-28b0-44bb-88ff-0a145d9b7964 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:07.603440 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4fae25d3-51a7-4a38-966d-71ee99d8c9ed tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '.version_select at 0x7f44cc88adc0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:07.910704 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4fae25d3-51a7-4a38-966d-71ee99d8c9ed tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "GET /compute/v2.1/images/b10792ca-7e00-4893-b95b-64813a70d3e3" status: 200 len: 1428 microversion: 2.1 time: 0.311398 Oct 30 01:26:07.911385 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1478/2975] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:26:07 2022] GET /compute/v2.1/images/b10792ca-7e00-4893-b95b-64813a70d3e3 => generated 1428 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:08.082852 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-969eeac3-28b0-44bb-88ff-0a145d9b7964 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "POST /compute/v2.1/servers/688c35c4-9529-49df-8255-98cd2b56c314/action" status: 202 len: 0 microversion: 2.1 time: 0.660943 Oct 30 01:26:08.084513 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1498/2976] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:26:07 2022] POST /compute/v2.1/servers/688c35c4-9529-49df-8255-98cd2b56c314/action => generated 0 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 30 01:26:08.096277 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4d0f0cc9-5e82-46eb-ba74-62cb6fffda11 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44ccbec310>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:08.246402 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4d0f0cc9-5e82-46eb-ba74-62cb6fffda11 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/21c14abf-0ccd-412a-bbbb-70149bcf547b" status: 200 len: 1437 microversion: 2.1 time: 0.152104 Oct 30 01:26:08.259095 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1479/2977] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:26:08 2022] GET /compute/v2.1/images/21c14abf-0ccd-412a-bbbb-70149bcf547b => generated 1437 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:08.928226 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-96319753-83bd-48b8-8b9b-98a615d57f10 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '.version_select at 0x7f44cce55d30>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:08.940693 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=6 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:26:09.046715 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-96319753-83bd-48b8-8b9b-98a615d57f10 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "GET /compute/v2.1/images/b10792ca-7e00-4893-b95b-64813a70d3e3" status: 200 len: 1428 microversion: 2.1 time: 0.122693 Oct 30 01:26:09.047831 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1499/2978] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:26:08 2022] GET /compute/v2.1/images/b10792ca-7e00-4893-b95b-64813a70d3e3 => generated 1428 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:09.266049 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-57b0ca59-d7e7-4135-a7ef-80124356a0b0 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44cc8db160>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:09.344309 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-57b0ca59-d7e7-4135-a7ef-80124356a0b0 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/21c14abf-0ccd-412a-bbbb-70149bcf547b" status: 200 len: 1437 microversion: 2.1 time: 0.084737 Oct 30 01:26:09.346007 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1480/2979] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:26:09 2022] GET /compute/v2.1/images/21c14abf-0ccd-412a-bbbb-70149bcf547b => generated 1437 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:09.910945 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-24c5f42c-64a3-4d92-afd3-c5505fc017a7 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-2114844477", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": "none"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:26:10.032270 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-24c5f42c-64a3-4d92-afd3-c5505fc017a7 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:26:10.033691 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-24c5f42c-64a3-4d92-afd3-c5505fc017a7 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:26:10.034398 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-24c5f42c-64a3-4d92-afd3-c5505fc017a7 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:26:10.034877 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-24c5f42c-64a3-4d92-afd3-c5505fc017a7 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:26:10.039099 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-24c5f42c-64a3-4d92-afd3-c5505fc017a7 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:26:10.064007 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-abea9478-38a0-4b89-adb5-7c2bbed5dcfa tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '.version_select at 0x7f44cc135040>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:10.077914 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24c5f42c-64a3-4d92-afd3-c5505fc017a7 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:10.080129 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24c5f42c-64a3-4d92-afd3-c5505fc017a7 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:10.081513 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24c5f42c-64a3-4d92-afd3-c5505fc017a7 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:10.083808 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24c5f42c-64a3-4d92-afd3-c5505fc017a7 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:10.087563 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24c5f42c-64a3-4d92-afd3-c5505fc017a7 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:10.088646 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24c5f42c-64a3-4d92-afd3-c5505fc017a7 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:10.145937 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-24c5f42c-64a3-4d92-afd3-c5505fc017a7 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Getting quotas for project 7a746ec83df44fe4bc49cf74dcf246c1. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:26:10.163584 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-abea9478-38a0-4b89-adb5-7c2bbed5dcfa tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "GET /compute/v2.1/images/b10792ca-7e00-4893-b95b-64813a70d3e3" status: 200 len: 1428 microversion: 2.1 time: 0.104701 Oct 30 01:26:10.164240 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1481/2980] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:26:10 2022] GET /compute/v2.1/images/b10792ca-7e00-4893-b95b-64813a70d3e3 => generated 1428 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:10.168293 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-24c5f42c-64a3-4d92-afd3-c5505fc017a7 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Getting quotas for user b0ecc29bc51140d7923506918965ef64 and project 7a746ec83df44fe4bc49cf74dcf246c1. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:26:10.189513 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-24c5f42c-64a3-4d92-afd3-c5505fc017a7 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:26:10.192405 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-24c5f42c-64a3-4d92-afd3-c5505fc017a7 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] [instance: 58e23ab9-995a-4ce5-b923-941fb5c55384] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:26:10.372135 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-dce1f34d-c42a-4b43-a544-cfb0185a0cd4 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44d0417ee0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:10.389620 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-24c5f42c-64a3-4d92-afd3-c5505fc017a7 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.914868 Oct 30 01:26:10.397589 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1500/2981] 10.222.0.13 () {62 vars in 1188 bytes} [Sun Oct 30 01:26:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 923 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 30 01:26:10.413470 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2804d57e-6d91-48d1-b70a-d9edf9f46d0d tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:10.416488 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2804d57e-6d91-48d1-b70a-d9edf9f46d0d tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] [instance: 58e23ab9-995a-4ce5-b923-941fb5c55384] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:10.491651 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-dce1f34d-c42a-4b43-a544-cfb0185a0cd4 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/21c14abf-0ccd-412a-bbbb-70149bcf547b" status: 200 len: 1437 microversion: 2.1 time: 0.133679 Oct 30 01:26:10.495360 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1482/2982] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:26:10 2022] GET /compute/v2.1/images/21c14abf-0ccd-412a-bbbb-70149bcf547b => generated 1437 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:10.602379 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2804d57e-6d91-48d1-b70a-d9edf9f46d0d tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ecc29bc51140d7923506918965ef64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a746ec83df44fe4bc49cf74dcf246c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:10.611523 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2804d57e-6d91-48d1-b70a-d9edf9f46d0d tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0ecc29bc51140d7923506918965ef64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a746ec83df44fe4bc49cf74dcf246c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:10.612970 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2804d57e-6d91-48d1-b70a-d9edf9f46d0d tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0ecc29bc51140d7923506918965ef64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a746ec83df44fe4bc49cf74dcf246c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:10.614156 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2804d57e-6d91-48d1-b70a-d9edf9f46d0d tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] 10.222.0.13 "GET /compute/v2.1/servers/58e23ab9-995a-4ce5-b923-941fb5c55384" status: 200 len: 1281 microversion: 2.47 time: 0.215497 Oct 30 01:26:10.614731 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1501/2983] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:26:10 2022] GET /compute/v2.1/servers/58e23ab9-995a-4ce5-b923-941fb5c55384 => generated 1281 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:26:10.905123 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bf8ddc91-578b-46f2-bfff-3f432c283a65 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1787137688", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": "none"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:26:11.028154 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-bf8ddc91-578b-46f2-bfff-3f432c283a65 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:26:11.029232 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-bf8ddc91-578b-46f2-bfff-3f432c283a65 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:26:11.029822 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-bf8ddc91-578b-46f2-bfff-3f432c283a65 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:26:11.030321 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-bf8ddc91-578b-46f2-bfff-3f432c283a65 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:26:11.030913 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-bf8ddc91-578b-46f2-bfff-3f432c283a65 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:26:11.052951 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bf8ddc91-578b-46f2-bfff-3f432c283a65 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:11.055295 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bf8ddc91-578b-46f2-bfff-3f432c283a65 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:11.056570 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bf8ddc91-578b-46f2-bfff-3f432c283a65 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:11.057945 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bf8ddc91-578b-46f2-bfff-3f432c283a65 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:11.058533 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bf8ddc91-578b-46f2-bfff-3f432c283a65 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:11.058975 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bf8ddc91-578b-46f2-bfff-3f432c283a65 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:11.141539 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-bf8ddc91-578b-46f2-bfff-3f432c283a65 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Getting quotas for project 98c4b4fec5574b8abd29e56df1fdc822. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:26:11.178651 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-bf8ddc91-578b-46f2-bfff-3f432c283a65 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Getting quotas for user fb8201c608b3417dafc84e520603d1c0 and project 98c4b4fec5574b8abd29e56df1fdc822. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:26:11.180618 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-60de6965-5831-4303-97c6-f3b0c93595e5 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '.version_select at 0x7f44d05235e0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:11.253144 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-bf8ddc91-578b-46f2-bfff-3f432c283a65 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:26:11.266641 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-bf8ddc91-578b-46f2-bfff-3f432c283a65 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] [instance: f0a37c74-9ecf-44ee-ad07-72bc8601d2d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:26:11.296871 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-60de6965-5831-4303-97c6-f3b0c93595e5 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "GET /compute/v2.1/images/b10792ca-7e00-4893-b95b-64813a70d3e3" status: 200 len: 1428 microversion: 2.1 time: 0.120731 Oct 30 01:26:11.297712 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1502/2984] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:26:11 2022] GET /compute/v2.1/images/b10792ca-7e00-4893-b95b-64813a70d3e3 => generated 1428 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:26:11.551181 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bf8ddc91-578b-46f2-bfff-3f432c283a65 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.960040 Oct 30 01:26:11.554529 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1483/2985] 10.222.0.13 () {62 vars in 1188 bytes} [Sun Oct 30 01:26:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 964 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 30 01:26:11.572643 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-10559d13-a34f-4122-963a-f5b23b08ff8f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44cc88adc0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:11.646674 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-89fcbf83-bf43-41af-8559-c31cc3a2810e tempest-FlavorsV2TestJSON-817623376 tempest-FlavorsV2TestJSON-817623376-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:11.667729 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-10559d13-a34f-4122-963a-f5b23b08ff8f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/21c14abf-0ccd-412a-bbbb-70149bcf547b" status: 200 len: 1437 microversion: 2.1 time: 0.109751 Oct 30 01:26:11.668335 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1484/2986] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:26:11 2022] GET /compute/v2.1/images/21c14abf-0ccd-412a-bbbb-70149bcf547b => generated 1437 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:11.670201 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-89fcbf83-bf43-41af-8559-c31cc3a2810e tempest-FlavorsV2TestJSON-817623376 tempest-FlavorsV2TestJSON-817623376-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.316033 Oct 30 01:26:11.673715 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1503/2987] 10.222.0.13 () {58 vars in 1137 bytes} [Sun Oct 30 01:26:11 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:26:11.686546 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bd394bfb-d82d-43d5-8550-96dbd5531921 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:11.689267 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bd394bfb-d82d-43d5-8550-96dbd5531921 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] [instance: 58e23ab9-995a-4ce5-b923-941fb5c55384] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:11.693705 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-27afb31e-4c63-4b81-b7d9-ffc7ee0ab8ae tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:11.696104 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-27afb31e-4c63-4b81-b7d9-ffc7ee0ab8ae tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] [instance: f0a37c74-9ecf-44ee-ad07-72bc8601d2d6] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:12.061317 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bd394bfb-d82d-43d5-8550-96dbd5531921 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ecc29bc51140d7923506918965ef64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a746ec83df44fe4bc49cf74dcf246c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:12.079040 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-27afb31e-4c63-4b81-b7d9-ffc7ee0ab8ae tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:12.097234 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bd394bfb-d82d-43d5-8550-96dbd5531921 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0ecc29bc51140d7923506918965ef64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a746ec83df44fe4bc49cf74dcf246c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:12.107943 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-27afb31e-4c63-4b81-b7d9-ffc7ee0ab8ae tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:12.114102 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-27afb31e-4c63-4b81-b7d9-ffc7ee0ab8ae tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:12.119186 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-27afb31e-4c63-4b81-b7d9-ffc7ee0ab8ae tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] 10.222.0.13 "GET /compute/v2.1/servers/f0a37c74-9ecf-44ee-ad07-72bc8601d2d6" status: 200 len: 1278 microversion: 2.47 time: 0.432720 Oct 30 01:26:12.121261 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bd394bfb-d82d-43d5-8550-96dbd5531921 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0ecc29bc51140d7923506918965ef64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a746ec83df44fe4bc49cf74dcf246c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:12.123069 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1485/2988] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:26:11 2022] GET /compute/v2.1/servers/f0a37c74-9ecf-44ee-ad07-72bc8601d2d6 => generated 1278 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:26:12.129456 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-67dde9b3-b13b-4b83-b461-ba0426855dcd tempest-FlavorsV2TestJSON-817623376 tempest-FlavorsV2TestJSON-817623376-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:12.154523 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bd394bfb-d82d-43d5-8550-96dbd5531921 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] 10.222.0.13 "GET /compute/v2.1/servers/58e23ab9-995a-4ce5-b923-941fb5c55384" status: 200 len: 1281 microversion: 2.47 time: 0.479395 Oct 30 01:26:12.161892 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1504/2989] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:26:11 2022] GET /compute/v2.1/servers/58e23ab9-995a-4ce5-b923-941fb5c55384 => generated 1281 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:26:12.184992 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-67dde9b3-b13b-4b83-b461-ba0426855dcd tempest-FlavorsV2TestJSON-817623376 tempest-FlavorsV2TestJSON-817623376-project] 10.222.0.13 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.059191 Oct 30 01:26:12.190733 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1486/2990] 10.222.0.13 () {58 vars in 1125 bytes} [Sun Oct 30 01:26:12 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:12.207652 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f2ce0f6d-6887-4773-b2c3-8c8de5781937 tempest-FlavorsV2TestJSON-817623376 tempest-FlavorsV2TestJSON-817623376-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:12.231729 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f2ce0f6d-6887-4773-b2c3-8c8de5781937 tempest-FlavorsV2TestJSON-817623376 tempest-FlavorsV2TestJSON-817623376-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028323 Oct 30 01:26:12.234028 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1505/2991] 10.222.0.13 () {58 vars in 1137 bytes} [Sun Oct 30 01:26:12 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:26:12.248151 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-254eeaf8-05b1-47fc-9efe-a80062a57657 tempest-FlavorsV2TestJSON-817623376 tempest-FlavorsV2TestJSON-817623376-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:12.263377 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-254eeaf8-05b1-47fc-9efe-a80062a57657 tempest-FlavorsV2TestJSON-817623376 tempest-FlavorsV2TestJSON-817623376-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017971 Oct 30 01:26:12.266204 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1487/2992] 10.222.0.13 () {58 vars in 1137 bytes} [Sun Oct 30 01:26:12 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:26:12.278929 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5f1184c4-7f3d-4527-b682-98464c5ec164 tempest-FlavorsV2TestJSON-817623376 tempest-FlavorsV2TestJSON-817623376-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:12.316013 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f55bbd04-0fc3-486b-b288-2f515584f325 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '.version_select at 0x7f44d0484040>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:12.363280 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5f1184c4-7f3d-4527-b682-98464c5ec164 tempest-FlavorsV2TestJSON-817623376 tempest-FlavorsV2TestJSON-817623376-project] 10.222.0.13 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.089029 Oct 30 01:26:12.363894 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1506/2993] 10.222.0.13 () {58 vars in 1165 bytes} [Sun Oct 30 01:26:12 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:12.371714 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-25e51df8-d36f-4da0-8970-0307f5cd20e4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-248767678", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": "none"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:26:12.761209 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-25e51df8-d36f-4da0-8970-0307f5cd20e4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:26:12.761683 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-25e51df8-d36f-4da0-8970-0307f5cd20e4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:26:12.770297 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-25e51df8-d36f-4da0-8970-0307f5cd20e4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:26:12.770297 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-25e51df8-d36f-4da0-8970-0307f5cd20e4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:26:12.770297 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-25e51df8-d36f-4da0-8970-0307f5cd20e4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:26:12.770753 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f55bbd04-0fc3-486b-b288-2f515584f325 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "GET /compute/v2.1/images/b10792ca-7e00-4893-b95b-64813a70d3e3" status: 200 len: 1428 microversion: 2.1 time: 0.460123 Oct 30 01:26:12.790849 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1488/2994] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:26:12 2022] GET /compute/v2.1/images/b10792ca-7e00-4893-b95b-64813a70d3e3 => generated 1428 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:12.802197 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-18087ce2-8545-42a7-bf05-1963081a96bc tempest-FlavorsV2TestJSON-817623376 tempest-FlavorsV2TestJSON-817623376-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:12.816457 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25e51df8-d36f-4da0-8970-0307f5cd20e4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:12.816960 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25e51df8-d36f-4da0-8970-0307f5cd20e4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:12.817435 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25e51df8-d36f-4da0-8970-0307f5cd20e4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:12.818187 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25e51df8-d36f-4da0-8970-0307f5cd20e4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:12.818650 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25e51df8-d36f-4da0-8970-0307f5cd20e4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:12.819082 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25e51df8-d36f-4da0-8970-0307f5cd20e4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:12.819856 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-18087ce2-8545-42a7-bf05-1963081a96bc tempest-FlavorsV2TestJSON-817623376 tempest-FlavorsV2TestJSON-817623376-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025988 Oct 30 01:26:12.821965 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1489/2995] 10.222.0.13 () {58 vars in 1137 bytes} [Sun Oct 30 01:26:12 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:26:12.829244 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a5487fbd-ea6a-40bf-b5bf-7056ed52ca01 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44cc9f48b0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:12.911824 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-25e51df8-d36f-4da0-8970-0307f5cd20e4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Getting quotas for project 98c4b4fec5574b8abd29e56df1fdc822. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:26:12.920428 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-25e51df8-d36f-4da0-8970-0307f5cd20e4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Getting quotas for user fb8201c608b3417dafc84e520603d1c0 and project 98c4b4fec5574b8abd29e56df1fdc822. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:26:12.941254 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-25e51df8-d36f-4da0-8970-0307f5cd20e4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:26:12.944849 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-25e51df8-d36f-4da0-8970-0307f5cd20e4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] [instance: f08028cf-a9fa-4b2c-9796-0e5a8c172ab5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:26:13.234818 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-25e51df8-d36f-4da0-8970-0307f5cd20e4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.867832 Oct 30 01:26:13.244526 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1507/2996] 10.222.0.13 () {62 vars in 1188 bytes} [Sun Oct 30 01:26:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 878 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 30 01:26:13.271449 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7dd4b55c-efa2-40d6-8424-3fbccf4bc4c6 tempest-FlavorsV2TestJSON-817623376 tempest-FlavorsV2TestJSON-817623376-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:13.349058 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7dd4b55c-efa2-40d6-8424-3fbccf4bc4c6 tempest-FlavorsV2TestJSON-817623376 tempest-FlavorsV2TestJSON-817623376-project] 10.222.0.13 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.094415 Oct 30 01:26:13.349058 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1508/2997] 10.222.0.13 () {58 vars in 1169 bytes} [Sun Oct 30 01:26:13 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:13.356038 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4438e016-cc06-44ae-9912-c0acbe46ece3 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:13.358713 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4438e016-cc06-44ae-9912-c0acbe46ece3 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] [instance: 58e23ab9-995a-4ce5-b923-941fb5c55384] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:13.373903 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4438e016-cc06-44ae-9912-c0acbe46ece3 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:13.375841 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4438e016-cc06-44ae-9912-c0acbe46ece3 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:13.376464 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4438e016-cc06-44ae-9912-c0acbe46ece3 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:13.379871 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4438e016-cc06-44ae-9912-c0acbe46ece3 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:13.380578 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4438e016-cc06-44ae-9912-c0acbe46ece3 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:13.381194 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4438e016-cc06-44ae-9912-c0acbe46ece3 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:13.834343 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4438e016-cc06-44ae-9912-c0acbe46ece3 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ecc29bc51140d7923506918965ef64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a746ec83df44fe4bc49cf74dcf246c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:13.847989 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4438e016-cc06-44ae-9912-c0acbe46ece3 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0ecc29bc51140d7923506918965ef64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a746ec83df44fe4bc49cf74dcf246c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:13.863186 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4438e016-cc06-44ae-9912-c0acbe46ece3 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0ecc29bc51140d7923506918965ef64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a746ec83df44fe4bc49cf74dcf246c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:13.866800 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4438e016-cc06-44ae-9912-c0acbe46ece3 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] 10.222.0.13 "GET /compute/v2.1/servers/58e23ab9-995a-4ce5-b923-941fb5c55384" status: 200 len: 1333 microversion: 2.47 time: 0.521031 Oct 30 01:26:13.867395 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1509/2998] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:26:13 2022] GET /compute/v2.1/servers/58e23ab9-995a-4ce5-b923-941fb5c55384 => generated 1333 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:26:13.885163 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-96ba72e6-8dce-4822-9289-3c01c53c2487 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:26:13.900922 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-96ba72e6-8dce-4822-9289-3c01c53c2487 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] [instance: f08028cf-a9fa-4b2c-9796-0e5a8c172ab5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:14.011648 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-96ba72e6-8dce-4822-9289-3c01c53c2487 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] 10.222.0.13 "PUT /compute/v2.1/servers/f08028cf-a9fa-4b2c-9796-0e5a8c172ab5" status: 200 len: 991 microversion: 2.47 time: 0.136762 Oct 30 01:26:14.014372 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1510/2999] 10.222.0.13 () {62 vars in 1297 bytes} [Sun Oct 30 01:26:13 2022] PUT /compute/v2.1/servers/f08028cf-a9fa-4b2c-9796-0e5a8c172ab5 => generated 991 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:26:14.025892 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-33554c93-e674-4fc7-a113-c1e0a74c0456 tempest-FlavorsV2TestJSON-817623376 tempest-FlavorsV2TestJSON-817623376-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:14.080021 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-33554c93-e674-4fc7-a113-c1e0a74c0456 tempest-FlavorsV2TestJSON-817623376 tempest-FlavorsV2TestJSON-817623376-project] 10.222.0.13 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.063060 Oct 30 01:26:14.080615 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1511/3000] 10.222.0.13 () {58 vars in 1161 bytes} [Sun Oct 30 01:26:14 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:26:14.102441 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9a23bb33-782c-4943-93cb-8c7c3487f6ab tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '.version_select at 0x7f44cc501160>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:21.090934 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:26:21.097095 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=29 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:26:22.091519 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=8 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:26:22.825433 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:26:22.883063 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=4 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:26:22.929991 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=16 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:26:23.842673 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:26:24.046077 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=6 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:26:31.740539 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a5487fbd-ea6a-40bf-b5bf-7056ed52ca01 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/21c14abf-0ccd-412a-bbbb-70149bcf547b" status: 200 len: 1437 microversion: 2.1 time: 18.916956 Oct 30 01:26:31.749774 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1490/3001] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:26:12 2022] GET /compute/v2.1/images/21c14abf-0ccd-412a-bbbb-70149bcf547b => generated 1437 bytes in 18927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:31.758871 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-880ebe4e-87c5-4417-9935-6bb72f0e068d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:31.762329 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-880ebe4e-87c5-4417-9935-6bb72f0e068d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] [instance: f08028cf-a9fa-4b2c-9796-0e5a8c172ab5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:31.777633 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-880ebe4e-87c5-4417-9935-6bb72f0e068d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:31.780417 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-880ebe4e-87c5-4417-9935-6bb72f0e068d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:31.781855 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-880ebe4e-87c5-4417-9935-6bb72f0e068d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:31.782784 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-880ebe4e-87c5-4417-9935-6bb72f0e068d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:31.783023 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9a23bb33-782c-4943-93cb-8c7c3487f6ab tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "GET /compute/v2.1/images/b10792ca-7e00-4893-b95b-64813a70d3e3" status: 200 len: 1437 microversion: 2.1 time: 17.696607 Oct 30 01:26:31.784169 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1512/3002] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:26:14 2022] GET /compute/v2.1/images/b10792ca-7e00-4893-b95b-64813a70d3e3 => generated 1437 bytes in 17703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:31.784852 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-880ebe4e-87c5-4417-9935-6bb72f0e068d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:31.786115 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-880ebe4e-87c5-4417-9935-6bb72f0e068d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:31.817152 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b0ed17d2-f813-49b4-890f-dffdbb81e4ec tempest-FlavorsV2TestJSON-817623376 tempest-FlavorsV2TestJSON-817623376-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:31.846812 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b0ed17d2-f813-49b4-890f-dffdbb81e4ec tempest-FlavorsV2TestJSON-817623376 tempest-FlavorsV2TestJSON-817623376-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.057608 Oct 30 01:26:31.856010 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1513/3003] 10.222.0.13 () {58 vars in 1137 bytes} [Sun Oct 30 01:26:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:26:31.874687 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a90db006-9917-4234-8391-921e44f4894c tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:31.875559 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a90db006-9917-4234-8391-921e44f4894c tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] [instance: 58e23ab9-995a-4ce5-b923-941fb5c55384] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:31.892755 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a90db006-9917-4234-8391-921e44f4894c tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:31.894386 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a90db006-9917-4234-8391-921e44f4894c tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:31.894994 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a90db006-9917-4234-8391-921e44f4894c tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:31.898582 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a90db006-9917-4234-8391-921e44f4894c tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:31.899257 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a90db006-9917-4234-8391-921e44f4894c tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:31.899857 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a90db006-9917-4234-8391-921e44f4894c tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:31.987581 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-880ebe4e-87c5-4417-9935-6bb72f0e068d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:32.002656 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-880ebe4e-87c5-4417-9935-6bb72f0e068d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:32.004744 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-880ebe4e-87c5-4417-9935-6bb72f0e068d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:32.011018 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-880ebe4e-87c5-4417-9935-6bb72f0e068d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] 10.222.0.13 "GET /compute/v2.1/servers/f08028cf-a9fa-4b2c-9796-0e5a8c172ab5" status: 200 len: 1356 microversion: 2.47 time: 0.258549 Oct 30 01:26:32.011922 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1491/3004] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:26:31 2022] GET /compute/v2.1/servers/f08028cf-a9fa-4b2c-9796-0e5a8c172ab5 => generated 1356 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:26:32.021085 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-a1fa86c1-91a9-434c-ace6-8fbabd51f415 req-c5043642-069e-4fa8-bd78-f81a50bcb184 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "688c35c4-9529-49df-8255-98cd2b56c314", "name": "network-vif-plugged", "status": "completed", "tag": "f6c4cc9d-1ae2-485f-8d36-d57599740dfc"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:26:32.053958 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-a1fa86c1-91a9-434c-ace6-8fbabd51f415 req-c5043642-069e-4fa8-bd78-f81a50bcb184 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:32.054918 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-a1fa86c1-91a9-434c-ace6-8fbabd51f415 req-c5043642-069e-4fa8-bd78-f81a50bcb184 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:32.056027 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-a1fa86c1-91a9-434c-ace6-8fbabd51f415 req-c5043642-069e-4fa8-bd78-f81a50bcb184 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:32.090612 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-a1fa86c1-91a9-434c-ace6-8fbabd51f415 req-c5043642-069e-4fa8-bd78-f81a50bcb184 service nova] Creating event network-vif-plugged:f6c4cc9d-1ae2-485f-8d36-d57599740dfc for instance 688c35c4-9529-49df-8255-98cd2b56c314 on n-h2-master-1 Oct 30 01:26:32.091515 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a90db006-9917-4234-8391-921e44f4894c tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ecc29bc51140d7923506918965ef64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a746ec83df44fe4bc49cf74dcf246c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:32.106284 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-a1fa86c1-91a9-434c-ace6-8fbabd51f415 req-c5043642-069e-4fa8-bd78-f81a50bcb184 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089050 Oct 30 01:26:32.106966 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1492/3005] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:26:32.107116 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a90db006-9917-4234-8391-921e44f4894c tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0ecc29bc51140d7923506918965ef64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a746ec83df44fe4bc49cf74dcf246c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:32.109167 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a90db006-9917-4234-8391-921e44f4894c tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0ecc29bc51140d7923506918965ef64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a746ec83df44fe4bc49cf74dcf246c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:32.118664 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a90db006-9917-4234-8391-921e44f4894c tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] 10.222.0.13 "GET /compute/v2.1/servers/58e23ab9-995a-4ce5-b923-941fb5c55384" status: 200 len: 1360 microversion: 2.47 time: 0.246169 Oct 30 01:26:32.119602 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1514/3006] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:26:31 2022] GET /compute/v2.1/servers/58e23ab9-995a-4ce5-b923-941fb5c55384 => generated 1360 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:26:32.127331 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d778059d-3046-4a26-8d0d-4fbeee32d871 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1729093014", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "24214a78-cf22-4ab9-99b5-6435154960d0"}, {"uuid": "e23ee04f-b6cd-402c-8e7a-1afdc83fbc12"}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:26:32.259732 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-d778059d-3046-4a26-8d0d-4fbeee32d871 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] validate_networks() for [('24214a78-cf22-4ab9-99b5-6435154960d0', None, None, None, None, None), ('e23ee04f-b6cd-402c-8e7a-1afdc83fbc12', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:26:32.578820 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-24897620-83f2-4235-b0c0-13d87df0bff5 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-507737764", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "02ae28d2-05c9-4fed-bcaa-b847860f2459"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:26:32.712503 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-24897620-83f2-4235-b0c0-13d87df0bff5 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] validate_networks() for [('02ae28d2-05c9-4fed-bcaa-b847860f2459', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:26:33.695231 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-24897620-83f2-4235-b0c0-13d87df0bff5 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:26:33.695799 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-24897620-83f2-4235-b0c0-13d87df0bff5 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:26:33.696300 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-24897620-83f2-4235-b0c0-13d87df0bff5 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:26:33.696783 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-24897620-83f2-4235-b0c0-13d87df0bff5 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:26:33.697201 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-24897620-83f2-4235-b0c0-13d87df0bff5 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:26:33.707647 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24897620-83f2-4235-b0c0-13d87df0bff5 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:33.708135 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24897620-83f2-4235-b0c0-13d87df0bff5 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:33.708573 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24897620-83f2-4235-b0c0-13d87df0bff5 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:33.709309 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24897620-83f2-4235-b0c0-13d87df0bff5 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:33.709990 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24897620-83f2-4235-b0c0-13d87df0bff5 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:33.710425 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24897620-83f2-4235-b0c0-13d87df0bff5 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:33.751054 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-24897620-83f2-4235-b0c0-13d87df0bff5 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Getting quotas for project bbd28b9d6b7146f2b1c114607be83a48. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:26:33.758316 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-24897620-83f2-4235-b0c0-13d87df0bff5 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Getting quotas for user 927f79f3eab648939a30208fed465eef and project bbd28b9d6b7146f2b1c114607be83a48. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:26:33.779268 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-24897620-83f2-4235-b0c0-13d87df0bff5 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:26:33.781863 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-24897620-83f2-4235-b0c0-13d87df0bff5 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] [instance: 8f8815cb-4215-486d-9d40-fe6ffa145ddc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:26:34.037132 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-d778059d-3046-4a26-8d0d-4fbeee32d871 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:26:34.037715 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-d778059d-3046-4a26-8d0d-4fbeee32d871 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:26:34.038488 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-d778059d-3046-4a26-8d0d-4fbeee32d871 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:26:34.039033 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-d778059d-3046-4a26-8d0d-4fbeee32d871 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:26:34.039675 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-d778059d-3046-4a26-8d0d-4fbeee32d871 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:26:34.064030 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d778059d-3046-4a26-8d0d-4fbeee32d871 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:34.064872 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d778059d-3046-4a26-8d0d-4fbeee32d871 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:34.065942 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d778059d-3046-4a26-8d0d-4fbeee32d871 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:34.066913 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d778059d-3046-4a26-8d0d-4fbeee32d871 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:34.067549 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d778059d-3046-4a26-8d0d-4fbeee32d871 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:34.068156 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d778059d-3046-4a26-8d0d-4fbeee32d871 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:34.079341 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-24897620-83f2-4235-b0c0-13d87df0bff5 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.956948 Oct 30 01:26:34.085837 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1515/3007] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:26:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1965 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:26:34.097813 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-d778059d-3046-4a26-8d0d-4fbeee32d871 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Getting quotas for project 2c59bd73c7874a00b52ec7c5c4142039. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:26:34.104737 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-d778059d-3046-4a26-8d0d-4fbeee32d871 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Getting quotas for user a07f2b8c31f54c62aaba73ca2bd2edb8 and project 2c59bd73c7874a00b52ec7c5c4142039. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:26:34.115959 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-efe8a11e-3eed-4e3b-8604-ea796505b7ad tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '.version_select at 0x7f44d04a9550>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:34.125454 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d778059d-3046-4a26-8d0d-4fbeee32d871 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:26:34.128342 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d778059d-3046-4a26-8d0d-4fbeee32d871 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: edf8f5ea-58fd-4226-b75c-0138fbdd6ae4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:26:34.211055 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-efe8a11e-3eed-4e3b-8604-ea796505b7ad tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "GET /compute/v2.1/images/b10792ca-7e00-4893-b95b-64813a70d3e3" status: 200 len: 1437 microversion: 2.1 time: 0.123425 Oct 30 01:26:34.214098 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1516/3008] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:26:34 2022] GET /compute/v2.1/images/b10792ca-7e00-4893-b95b-64813a70d3e3 => generated 1437 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:34.221477 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7aefc59e-d66a-4c25-95f4-796ab7ce8bd9 tempest-FlavorsV2TestJSON-817623376 tempest-FlavorsV2TestJSON-817623376-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:34.327425 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d778059d-3046-4a26-8d0d-4fbeee32d871 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.214707 Oct 30 01:26:34.330550 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1493/3009] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:26:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2221 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:26:34.336935 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7aefc59e-d66a-4c25-95f4-796ab7ce8bd9 tempest-FlavorsV2TestJSON-817623376 tempest-FlavorsV2TestJSON-817623376-project] 10.222.0.13 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.121562 Oct 30 01:26:34.337891 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1517/3010] 10.222.0.13 () {58 vars in 1167 bytes} [Sun Oct 30 01:26:34 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:34.347696 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6c7cbfae-a0c4-42b1-8c03-1574496fea62 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "deb14158-45d8-4539-889d-ff9726d046d7"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:26:34.349963 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7a1719eb-550a-48ee-916d-e873eac362da tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-342581685"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:26:34.351640 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6c7cbfae-a0c4-42b1-8c03-1574496fea62 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] [instance: f08028cf-a9fa-4b2c-9796-0e5a8c172ab5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:34.352308 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7a1719eb-550a-48ee-916d-e873eac362da tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] [instance: 58e23ab9-995a-4ce5-b923-941fb5c55384] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:34.369728 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7a1719eb-550a-48ee-916d-e873eac362da tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:34.370320 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7a1719eb-550a-48ee-916d-e873eac362da tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:34.370670 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7a1719eb-550a-48ee-916d-e873eac362da tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:34.371381 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7a1719eb-550a-48ee-916d-e873eac362da tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:34.371833 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7a1719eb-550a-48ee-916d-e873eac362da tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:34.372259 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7a1719eb-550a-48ee-916d-e873eac362da tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:34.372589 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c7cbfae-a0c4-42b1-8c03-1574496fea62 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:34.373265 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c7cbfae-a0c4-42b1-8c03-1574496fea62 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:34.375589 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c7cbfae-a0c4-42b1-8c03-1574496fea62 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:34.377957 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c7cbfae-a0c4-42b1-8c03-1574496fea62 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:34.381955 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c7cbfae-a0c4-42b1-8c03-1574496fea62 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:34.381955 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c7cbfae-a0c4-42b1-8c03-1574496fea62 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:34.545254 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-6c7cbfae-a0c4-42b1-8c03-1574496fea62 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:26:34.545698 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-6c7cbfae-a0c4-42b1-8c03-1574496fea62 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:26:34.551980 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-6c7cbfae-a0c4-42b1-8c03-1574496fea62 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:26:34.552618 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-6c7cbfae-a0c4-42b1-8c03-1574496fea62 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:26:34.553221 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-6c7cbfae-a0c4-42b1-8c03-1574496fea62 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:26:34.994281 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6c7cbfae-a0c4-42b1-8c03-1574496fea62 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] [instance: f08028cf-a9fa-4b2c-9796-0e5a8c172ab5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:35.001530 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c7cbfae-a0c4-42b1-8c03-1574496fea62 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:35.002347 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c7cbfae-a0c4-42b1-8c03-1574496fea62 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:35.003410 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c7cbfae-a0c4-42b1-8c03-1574496fea62 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:35.004632 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c7cbfae-a0c4-42b1-8c03-1574496fea62 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:35.005326 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c7cbfae-a0c4-42b1-8c03-1574496fea62 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:35.006051 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c7cbfae-a0c4-42b1-8c03-1574496fea62 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:35.041144 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6c7cbfae-a0c4-42b1-8c03-1574496fea62 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] 10.222.0.13 "POST /compute/v2.1/servers/f08028cf-a9fa-4b2c-9796-0e5a8c172ab5/action" status: 202 len: 1078 microversion: 2.47 time: 0.709280 Oct 30 01:26:35.053547 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1494/3011] 10.222.0.13 () {62 vars in 1319 bytes} [Sun Oct 30 01:26:34 2022] POST /compute/v2.1/servers/f08028cf-a9fa-4b2c-9796-0e5a8c172ab5/action => generated 1078 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 30 01:26:35.053547 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e1f8fbac-5952-4a1a-a960-424f9d400e70 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44cc612ca0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:35.073661 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7a1719eb-550a-48ee-916d-e873eac362da tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] 10.222.0.13 "POST /compute/v2.1/servers/58e23ab9-995a-4ce5-b923-941fb5c55384/action" status: 202 len: 52 microversion: 2.47 time: 0.733751 Oct 30 01:26:35.081024 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1518/3012] 10.222.0.13 () {62 vars in 1319 bytes} [Sun Oct 30 01:26:34 2022] POST /compute/v2.1/servers/58e23ab9-995a-4ce5-b923-941fb5c55384/action => generated 52 bytes in 736 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Oct 30 01:26:35.083432 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d53d0b2c-4913-4b44-afa3-5244d29451d3 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:35.084368 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d53d0b2c-4913-4b44-afa3-5244d29451d3 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] [instance: 8f8815cb-4215-486d-9d40-fe6ffa145ddc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:35.174200 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e1f8fbac-5952-4a1a-a960-424f9d400e70 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/21c14abf-0ccd-412a-bbbb-70149bcf547b" status: 200 len: 1437 microversion: 2.1 time: 0.130973 Oct 30 01:26:35.175072 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1495/3013] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:26:35 2022] GET /compute/v2.1/images/21c14abf-0ccd-412a-bbbb-70149bcf547b => generated 1437 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:35.180111 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c5ff09a4-6686-486a-bfce-0f283091c886 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:35.180768 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c5ff09a4-6686-486a-bfce-0f283091c886 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] [instance: 9c6be996-7886-41c6-9c0c-e0f899836cb0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:35.188557 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c5ff09a4-6686-486a-bfce-0f283091c886 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:35.189039 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c5ff09a4-6686-486a-bfce-0f283091c886 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:35.192837 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c5ff09a4-6686-486a-bfce-0f283091c886 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:35.192837 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c5ff09a4-6686-486a-bfce-0f283091c886 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:35.192837 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c5ff09a4-6686-486a-bfce-0f283091c886 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:35.192837 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c5ff09a4-6686-486a-bfce-0f283091c886 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:35.212910 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d53d0b2c-4913-4b44-afa3-5244d29451d3 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f79f3eab648939a30208fed465eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd28b9d6b7146f2b1c114607be83a48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:35.252247 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d53d0b2c-4913-4b44-afa3-5244d29451d3 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] 10.222.0.13 "GET /compute/v2.1/servers/8f8815cb-4215-486d-9d40-fe6ffa145ddc" status: 200 len: 1216 microversion: 2.1 time: 0.175396 Oct 30 01:26:35.255527 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1519/3014] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:35 2022] GET /compute/v2.1/servers/8f8815cb-4215-486d-9d40-fe6ffa145ddc => generated 1216 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:35.261480 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ac251ada-edac-4a84-9413-2b7ba11d331a tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:35.266751 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ac251ada-edac-4a84-9413-2b7ba11d331a tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: edf8f5ea-58fd-4226-b75c-0138fbdd6ae4] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:35.437939 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ac251ada-edac-4a84-9413-2b7ba11d331a tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07f2b8c31f54c62aaba73ca2bd2edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c59bd73c7874a00b52ec7c5c4142039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:35.447829 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ac251ada-edac-4a84-9413-2b7ba11d331a tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] 10.222.0.13 "GET /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4" status: 200 len: 1213 microversion: 2.1 time: 0.190641 Oct 30 01:26:35.450031 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1520/3015] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:35 2022] GET /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4 => generated 1213 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:35.456731 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e7f5d68a-3bf5-49ee-a89f-962e833a5c7d tempest-FlavorsV2TestJSON-817623376 tempest-FlavorsV2TestJSON-817623376-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:35.466670 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e7f5d68a-3bf5-49ee-a89f-962e833a5c7d tempest-FlavorsV2TestJSON-817623376 tempest-FlavorsV2TestJSON-817623376-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014765 Oct 30 01:26:35.470968 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1521/3016] 10.222.0.13 () {58 vars in 1137 bytes} [Sun Oct 30 01:26:35 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:26:35.483955 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-566a179a-ed4e-4af6-9263-353e11e152f3 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:35.485925 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-566a179a-ed4e-4af6-9263-353e11e152f3 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] [instance: f08028cf-a9fa-4b2c-9796-0e5a8c172ab5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:35.495670 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-566a179a-ed4e-4af6-9263-353e11e152f3 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:35.496105 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-566a179a-ed4e-4af6-9263-353e11e152f3 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:35.496622 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-566a179a-ed4e-4af6-9263-353e11e152f3 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:35.498067 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-566a179a-ed4e-4af6-9263-353e11e152f3 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:35.498742 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-566a179a-ed4e-4af6-9263-353e11e152f3 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:35.499397 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-566a179a-ed4e-4af6-9263-353e11e152f3 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:35.503142 n-d-master-1 devstack@n-api.service[121102]: Exception ignored in: . at 0x7f44d049dca0> Oct 30 01:26:35.503339 n-d-master-1 devstack@n-api.service[121102]: Traceback (most recent call last): Oct 30 01:26:35.503500 n-d-master-1 devstack@n-api.service[121102]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 488, in Oct 30 01:26:35.509753 n-d-master-1 devstack@n-api.service[121102]: and _finalize_fairy(None, rec, pool, ref, echo, True), Oct 30 01:26:35.509935 n-d-master-1 devstack@n-api.service[121102]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 774, in _finalize_fairy Oct 30 01:26:35.529073 n-d-master-1 devstack@n-api.service[121102]: connection_record.checkin() Oct 30 01:26:35.529073 n-d-master-1 devstack@n-api.service[121102]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 521, in checkin Oct 30 01:26:35.530457 n-d-master-1 devstack@n-api.service[121102]: pool.dispatch.checkin(connection, self) Oct 30 01:26:35.530457 n-d-master-1 devstack@n-api.service[121102]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/event/attr.py", line 343, in __call__ Oct 30 01:26:35.537266 n-d-master-1 devstack@n-api.service[121102]: fn(*args, **kw) Oct 30 01:26:35.537266 n-d-master-1 devstack@n-api.service[121102]: File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py", line 52, in _thread_yield Oct 30 01:26:35.543945 n-d-master-1 devstack@n-api.service[121102]: time.sleep(0) Oct 30 01:26:35.544123 n-d-master-1 devstack@n-api.service[121102]: File "/usr/local/lib/python3.8/dist-packages/eventlet/greenthread.py", line 33, in sleep Oct 30 01:26:35.552321 n-d-master-1 devstack@n-api.service[121102]: assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Oct 30 01:26:35.552321 n-d-master-1 devstack@n-api.service[121102]: AssertionError: do not call blocking functions from the mainloop Oct 30 01:26:35.584432 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c5ff09a4-6686-486a-bfce-0f283091c886 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e50d6775ec4d2e96ab6e839b4631f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310172f2dfaf4ddcb5eace8a13939cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:35.596721 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c5ff09a4-6686-486a-bfce-0f283091c886 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6be996-7886-41c6-9c0c-e0f899836cb0" status: 200 len: 1467 microversion: 2.1 time: 0.420320 Oct 30 01:26:35.598402 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1496/3017] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:35 2022] GET /compute/v2.1/servers/9c6be996-7886-41c6-9c0c-e0f899836cb0 => generated 1467 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:35.605397 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0feaa7e7-0100-48d5-a158-f7ad9da8f181 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:35.619414 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0feaa7e7-0100-48d5-a158-f7ad9da8f181 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] [instance: 58e23ab9-995a-4ce5-b923-941fb5c55384] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:35.636414 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0feaa7e7-0100-48d5-a158-f7ad9da8f181 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:35.639899 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0feaa7e7-0100-48d5-a158-f7ad9da8f181 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:35.640429 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0feaa7e7-0100-48d5-a158-f7ad9da8f181 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:35.641303 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0feaa7e7-0100-48d5-a158-f7ad9da8f181 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:35.641909 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0feaa7e7-0100-48d5-a158-f7ad9da8f181 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:35.644467 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0feaa7e7-0100-48d5-a158-f7ad9da8f181 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:35.685965 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-566a179a-ed4e-4af6-9263-353e11e152f3 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:35.696464 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-566a179a-ed4e-4af6-9263-353e11e152f3 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:35.702703 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-566a179a-ed4e-4af6-9263-353e11e152f3 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:35.707739 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-566a179a-ed4e-4af6-9263-353e11e152f3 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] 10.222.0.13 "GET /compute/v2.1/servers/f08028cf-a9fa-4b2c-9796-0e5a8c172ab5" status: 200 len: 1365 microversion: 2.47 time: 0.237143 Oct 30 01:26:35.709032 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1522/3018] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:26:35 2022] GET /compute/v2.1/servers/f08028cf-a9fa-4b2c-9796-0e5a8c172ab5 => generated 1365 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:26:35.713382 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0feaa7e7-0100-48d5-a158-f7ad9da8f181 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] [instance: 58e23ab9-995a-4ce5-b923-941fb5c55384] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:26:35.720232 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-249c8949-7112-4627-956a-f6da911281b5 req-f80c21a3-6817-459b-bbdb-3d0ec63b9829 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c6be996-7886-41c6-9c0c-e0f899836cb0", "name": "network-vif-unplugged", "status": "completed", "tag": "aee42464-dca8-4339-bc2b-97369d928349"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:26:35.738116 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-249c8949-7112-4627-956a-f6da911281b5 req-f80c21a3-6817-459b-bbdb-3d0ec63b9829 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:35.738800 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-249c8949-7112-4627-956a-f6da911281b5 req-f80c21a3-6817-459b-bbdb-3d0ec63b9829 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:35.739551 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-249c8949-7112-4627-956a-f6da911281b5 req-f80c21a3-6817-459b-bbdb-3d0ec63b9829 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:35.758411 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-249c8949-7112-4627-956a-f6da911281b5 req-f80c21a3-6817-459b-bbdb-3d0ec63b9829 service nova] Creating event network-vif-unplugged:aee42464-dca8-4339-bc2b-97369d928349 for instance 9c6be996-7886-41c6-9c0c-e0f899836cb0 on n-h2-master-1 Oct 30 01:26:35.761095 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-249c8949-7112-4627-956a-f6da911281b5 req-f80c21a3-6817-459b-bbdb-3d0ec63b9829 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049625 Oct 30 01:26:35.762118 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1523/3019] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:26:35.767647 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b29d236d-3044-4880-bfcb-85d3c25c3220 tempest-FlavorsV2TestJSON-817623376 tempest-FlavorsV2TestJSON-817623376-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:35.818512 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b29d236d-3044-4880-bfcb-85d3c25c3220 tempest-FlavorsV2TestJSON-817623376 tempest-FlavorsV2TestJSON-817623376-project] 10.222.0.13 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.055092 Oct 30 01:26:35.819429 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1524/3020] 10.222.0.13 () {58 vars in 1144 bytes} [Sun Oct 30 01:26:35 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:35.825962 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-93474efb-e369-41de-a513-994406718570 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '.version_select at 0x7f44d03ff430>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:36.176390 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0feaa7e7-0100-48d5-a158-f7ad9da8f181 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] 10.222.0.13 "DELETE /compute/v2.1/servers/58e23ab9-995a-4ce5-b923-941fb5c55384" status: 204 len: 0 microversion: 2.47 time: 0.575915 Oct 30 01:26:36.178299 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1497/3021] 10.222.0.13 () {60 vars in 1280 bytes} [Sun Oct 30 01:26:35 2022] DELETE /compute/v2.1/servers/58e23ab9-995a-4ce5-b923-941fb5c55384 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 30 01:26:36.186104 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3f3ac26c-ae91-4d1a-a7ff-8b5baec36364 tempest-FlavorsV2TestJSON-817623376 tempest-FlavorsV2TestJSON-817623376-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:36.199712 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3f3ac26c-ae91-4d1a-a7ff-8b5baec36364 tempest-FlavorsV2TestJSON-817623376 tempest-FlavorsV2TestJSON-817623376-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019513 Oct 30 01:26:36.215614 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1498/3022] 10.222.0.13 () {58 vars in 1137 bytes} [Sun Oct 30 01:26:36 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:26:36.236468 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9f1fb370-041c-4430-b410-e09c699fa5a7 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:36.237715 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9f1fb370-041c-4430-b410-e09c699fa5a7 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] [instance: 58e23ab9-995a-4ce5-b923-941fb5c55384] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:36.254622 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9f1fb370-041c-4430-b410-e09c699fa5a7 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:36.255526 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9f1fb370-041c-4430-b410-e09c699fa5a7 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:36.256672 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9f1fb370-041c-4430-b410-e09c699fa5a7 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:36.258266 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9f1fb370-041c-4430-b410-e09c699fa5a7 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:36.259093 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9f1fb370-041c-4430-b410-e09c699fa5a7 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:36.259899 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9f1fb370-041c-4430-b410-e09c699fa5a7 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:36.499307 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9f1fb370-041c-4430-b410-e09c699fa5a7 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ecc29bc51140d7923506918965ef64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a746ec83df44fe4bc49cf74dcf246c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:36.515679 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9f1fb370-041c-4430-b410-e09c699fa5a7 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0ecc29bc51140d7923506918965ef64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a746ec83df44fe4bc49cf74dcf246c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:36.517935 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9f1fb370-041c-4430-b410-e09c699fa5a7 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0ecc29bc51140d7923506918965ef64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a746ec83df44fe4bc49cf74dcf246c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:36.521462 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9f1fb370-041c-4430-b410-e09c699fa5a7 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] 10.222.0.13 "GET /compute/v2.1/servers/58e23ab9-995a-4ce5-b923-941fb5c55384" status: 200 len: 1366 microversion: 2.47 time: 0.308417 Oct 30 01:26:36.523163 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1499/3023] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:26:36 2022] GET /compute/v2.1/servers/58e23ab9-995a-4ce5-b923-941fb5c55384 => generated 1366 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:26:36.529152 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-73b7ad42-4cd4-4f78-ba61-13993c2b5f2f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44cc81f1f0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:36.586293 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-73b7ad42-4cd4-4f78-ba61-13993c2b5f2f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/21c14abf-0ccd-412a-bbbb-70149bcf547b" status: 200 len: 1446 microversion: 2.1 time: 0.061718 Oct 30 01:26:36.587209 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1500/3024] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:26:36 2022] GET /compute/v2.1/images/21c14abf-0ccd-412a-bbbb-70149bcf547b => generated 1446 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:36.593491 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-50f8e54f-7722-415f-95c5-c2427c93dcfb tempest-FlavorsV2TestJSON-817623376 tempest-FlavorsV2TestJSON-817623376-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:36.642150 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-50f8e54f-7722-415f-95c5-c2427c93dcfb tempest-FlavorsV2TestJSON-817623376 tempest-FlavorsV2TestJSON-817623376-project] 10.222.0.13 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.053831 Oct 30 01:26:36.645028 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1501/3025] 10.222.0.13 () {58 vars in 1148 bytes} [Sun Oct 30 01:26:36 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:36.670326 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fabf78f1-ee82-4b30-8ff4-551994af610d tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:36.670326 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-fabf78f1-ee82-4b30-8ff4-551994af610d tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] [instance: 8f8815cb-4215-486d-9d40-fe6ffa145ddc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:36.683296 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fabf78f1-ee82-4b30-8ff4-551994af610d tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:36.685658 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fabf78f1-ee82-4b30-8ff4-551994af610d tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:36.686116 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fabf78f1-ee82-4b30-8ff4-551994af610d tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:36.686874 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fabf78f1-ee82-4b30-8ff4-551994af610d tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:36.687337 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fabf78f1-ee82-4b30-8ff4-551994af610d tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:36.687766 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fabf78f1-ee82-4b30-8ff4-551994af610d tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:36.812266 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-fabf78f1-ee82-4b30-8ff4-551994af610d tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f79f3eab648939a30208fed465eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd28b9d6b7146f2b1c114607be83a48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:36.829400 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fabf78f1-ee82-4b30-8ff4-551994af610d tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] 10.222.0.13 "GET /compute/v2.1/servers/8f8815cb-4215-486d-9d40-fe6ffa145ddc" status: 200 len: 1212 microversion: 2.1 time: 0.177401 Oct 30 01:26:36.842168 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1502/3026] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:36 2022] GET /compute/v2.1/servers/8f8815cb-4215-486d-9d40-fe6ffa145ddc => generated 1212 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:36.899210 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b12b84cb-04b6-4227-93f3-aa2be0b52a08 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:36.899828 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b12b84cb-04b6-4227-93f3-aa2be0b52a08 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: edf8f5ea-58fd-4226-b75c-0138fbdd6ae4] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:36.925283 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b12b84cb-04b6-4227-93f3-aa2be0b52a08 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:36.930795 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b12b84cb-04b6-4227-93f3-aa2be0b52a08 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:36.930795 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b12b84cb-04b6-4227-93f3-aa2be0b52a08 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:36.930795 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b12b84cb-04b6-4227-93f3-aa2be0b52a08 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:36.930795 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b12b84cb-04b6-4227-93f3-aa2be0b52a08 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:36.930795 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b12b84cb-04b6-4227-93f3-aa2be0b52a08 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:37.026077 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b12b84cb-04b6-4227-93f3-aa2be0b52a08 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07f2b8c31f54c62aaba73ca2bd2edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c59bd73c7874a00b52ec7c5c4142039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:37.036368 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b12b84cb-04b6-4227-93f3-aa2be0b52a08 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] 10.222.0.13 "GET /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4" status: 200 len: 1265 microversion: 2.1 time: 0.193180 Oct 30 01:26:37.037377 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1503/3027] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:36 2022] GET /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4 => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:37.049591 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a5f2e8a4-6c16-4a03-89bb-16c9a30b5fe6 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44cc0b7430>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:37.224611 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a5f2e8a4-6c16-4a03-89bb-16c9a30b5fe6 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/21c14abf-0ccd-412a-bbbb-70149bcf547b" status: 200 len: 1446 microversion: 2.1 time: 0.186036 Oct 30 01:26:37.225283 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1504/3028] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:26:37 2022] GET /compute/v2.1/images/21c14abf-0ccd-412a-bbbb-70149bcf547b => generated 1446 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:37.238007 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9cb74dea-180b-4e17-abb9-fd38cc595478 tempest-FlavorsV2TestJSON-817623376 tempest-FlavorsV2TestJSON-817623376-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:37.244928 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9cb74dea-180b-4e17-abb9-fd38cc595478 tempest-FlavorsV2TestJSON-817623376 tempest-FlavorsV2TestJSON-817623376-project] 10.222.0.13 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.018586 Oct 30 01:26:37.246182 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1505/3029] 10.222.0.13 () {58 vars in 1140 bytes} [Sun Oct 30 01:26:37 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:26:37.251380 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-df64cac2-42ec-46b4-b8e6-829822a3c677 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:37.251983 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-df64cac2-42ec-46b4-b8e6-829822a3c677 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] [instance: f08028cf-a9fa-4b2c-9796-0e5a8c172ab5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:37.258445 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df64cac2-42ec-46b4-b8e6-829822a3c677 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:37.259164 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df64cac2-42ec-46b4-b8e6-829822a3c677 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:37.259593 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df64cac2-42ec-46b4-b8e6-829822a3c677 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:37.261202 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df64cac2-42ec-46b4-b8e6-829822a3c677 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:37.261836 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df64cac2-42ec-46b4-b8e6-829822a3c677 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:37.262583 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df64cac2-42ec-46b4-b8e6-829822a3c677 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:37.364034 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-df64cac2-42ec-46b4-b8e6-829822a3c677 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:37.372935 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-df64cac2-42ec-46b4-b8e6-829822a3c677 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:37.374482 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-df64cac2-42ec-46b4-b8e6-829822a3c677 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:37.375773 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-df64cac2-42ec-46b4-b8e6-829822a3c677 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] 10.222.0.13 "GET /compute/v2.1/servers/f08028cf-a9fa-4b2c-9796-0e5a8c172ab5" status: 200 len: 1365 microversion: 2.47 time: 0.128531 Oct 30 01:26:37.376344 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1506/3030] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:26:37 2022] GET /compute/v2.1/servers/f08028cf-a9fa-4b2c-9796-0e5a8c172ab5 => generated 1365 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:26:37.381719 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-323356d5-e0d3-46c5-b3a2-78ab9e14a06f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44cc4f0790>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:37.744650 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-93474efb-e369-41de-a513-994406718570 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "DELETE /compute/v2.1/images/b10792ca-7e00-4893-b95b-64813a70d3e3" status: 204 len: 0 microversion: 2.1 time: 1.911267 Oct 30 01:26:37.744650 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1525/3031] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:35 2022] DELETE /compute/v2.1/images/b10792ca-7e00-4893-b95b-64813a70d3e3 => generated 0 bytes in 1912 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:26:37.744650 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-560a2c3f-893d-46ca-80b6-e97c91b1c695 tempest-FlavorsV2TestJSON-817623376 tempest-FlavorsV2TestJSON-817623376-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:37.758829 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-560a2c3f-893d-46ca-80b6-e97c91b1c695 tempest-FlavorsV2TestJSON-817623376 tempest-FlavorsV2TestJSON-817623376-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025037 Oct 30 01:26:37.759709 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1526/3032] 10.222.0.13 () {58 vars in 1137 bytes} [Sun Oct 30 01:26:37 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:26:37.778265 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-33db9361-a33e-4ccd-ad35-43ce320b421c tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:37.779571 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-33db9361-a33e-4ccd-ad35-43ce320b421c tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] [instance: 58e23ab9-995a-4ce5-b923-941fb5c55384] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:37.798961 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-33db9361-a33e-4ccd-ad35-43ce320b421c tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:37.800802 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-33db9361-a33e-4ccd-ad35-43ce320b421c tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:37.801873 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-33db9361-a33e-4ccd-ad35-43ce320b421c tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:37.802914 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-33db9361-a33e-4ccd-ad35-43ce320b421c tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:37.804790 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-33db9361-a33e-4ccd-ad35-43ce320b421c tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:37.805642 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-33db9361-a33e-4ccd-ad35-43ce320b421c tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:37.936032 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-33db9361-a33e-4ccd-ad35-43ce320b421c tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ecc29bc51140d7923506918965ef64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a746ec83df44fe4bc49cf74dcf246c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:37.954297 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-33db9361-a33e-4ccd-ad35-43ce320b421c tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0ecc29bc51140d7923506918965ef64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a746ec83df44fe4bc49cf74dcf246c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:37.965652 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-33db9361-a33e-4ccd-ad35-43ce320b421c tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0ecc29bc51140d7923506918965ef64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a746ec83df44fe4bc49cf74dcf246c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:37.965652 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-33db9361-a33e-4ccd-ad35-43ce320b421c tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] 10.222.0.13 "GET /compute/v2.1/servers/58e23ab9-995a-4ce5-b923-941fb5c55384" status: 200 len: 1366 microversion: 2.47 time: 0.197856 Oct 30 01:26:37.965652 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1527/3033] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:26:37 2022] GET /compute/v2.1/servers/58e23ab9-995a-4ce5-b923-941fb5c55384 => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:26:37.985812 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0d6e5a8f-8924-4be3-996f-a387bcab9bb4 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '.version_select at 0x7f44d0523940>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:38.040444 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-0d6e5a8f-8924-4be3-996f-a387bcab9bb4 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] HTTP exception thrown: Image not found. Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0d6e5a8f-8924-4be3-996f-a387bcab9bb4 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Request method failure captured: Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/images/50669d24-ab56-475f-8236-0ff19406f3eb HTTP/1.1 Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdJm3MQlkCb2VHBGOXohP-uIJdzdhji0-kQQ_uMEBkEzH-iKU7kbwbigPRSsXrH9qWPsLwUqbYabIAQ2oRSzX8g-qsu0Xwv5d9nFHxtUFsgJa8O4N6kz8wyNXDinDWG_Fzaf3mA1yILM4EG-7OdjblFzj6JU4plfEiAhh_5BkYAtnM8 Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 310172f2dfaf4ddcb5eace8a13939cda Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ImagesOneServerTestJSON-1108348315 Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/310172f2dfaf4ddcb5eace8a13939cda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_310172f2dfaf4ddcb5eace8a13939cda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/310172f2dfaf4ddcb5eace8a13939cda"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/310172f2dfaf4ddcb5eace8a13939cda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ImagesOneServerTestJSON-1108348315 Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 310172f2dfaf4ddcb5eace8a13939cda Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1108348315 Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ImagesOneServerTestJSON-1108348315-project Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: e1e50d6775ec4d2e96ab6e839b4631f1 Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ImagesOneServerTestJSON-1108348315-project Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: method: Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: exception: Image not found. Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '50669d24-ab56-475f-8236-0ff19406f3eb'} Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 50669d24-ab56-475f-8236-0ff19406f3eb to delete Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 50669d24-ab56-475f-8236-0ff19406f3eb could not be found. Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:26:38.043497 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:26:38.048682 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:26:38.048682 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:26:38.048682 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:26:38.048682 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:26:38.048682 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:26:38.048682 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:26:38.048682 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:26:38.048682 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:26:38.048682 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 30 01:26:38.048682 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 30 01:26:38.048682 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 30 01:26:38.048682 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:26:38.048682 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:26:38.048682 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:26:38.048682 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:26:38.048682 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:26:38.048682 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:26:38.048682 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:26:38.048682 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:26:38.048682 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 30 01:26:38.048682 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:26:38.048682 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0d6e5a8f-8924-4be3-996f-a387bcab9bb4 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Returning 404 to user: Image not found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:26:38.048682 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0d6e5a8f-8924-4be3-996f-a387bcab9bb4 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "DELETE /compute/v2.1/images/50669d24-ab56-475f-8236-0ff19406f3eb" status: 404 len: 62 microversion: 2.1 time: 0.084646 Oct 30 01:26:38.048682 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1528/3034] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:37 2022] DELETE /compute/v2.1/images/50669d24-ab56-475f-8236-0ff19406f3eb => generated 62 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:26:38.051022 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c90c6298-f16e-4e09-8f67-1b59425f2b7a tempest-FlavorsV2TestJSON-817623376 tempest-FlavorsV2TestJSON-817623376-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:38.077690 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c90c6298-f16e-4e09-8f67-1b59425f2b7a tempest-FlavorsV2TestJSON-817623376 tempest-FlavorsV2TestJSON-817623376-project] 10.222.0.13 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.030700 Oct 30 01:26:38.079032 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1529/3035] 10.222.0.13 () {58 vars in 1146 bytes} [Sun Oct 30 01:26:38 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:38.083672 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-53187e55-e176-49c6-85b2-ce72f5fb8221 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:38.084278 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-53187e55-e176-49c6-85b2-ce72f5fb8221 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] [instance: 8f8815cb-4215-486d-9d40-fe6ffa145ddc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:38.091149 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53187e55-e176-49c6-85b2-ce72f5fb8221 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:38.093292 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53187e55-e176-49c6-85b2-ce72f5fb8221 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:38.093292 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53187e55-e176-49c6-85b2-ce72f5fb8221 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:38.093292 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53187e55-e176-49c6-85b2-ce72f5fb8221 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:38.093292 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53187e55-e176-49c6-85b2-ce72f5fb8221 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:38.094061 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53187e55-e176-49c6-85b2-ce72f5fb8221 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:38.219051 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-53187e55-e176-49c6-85b2-ce72f5fb8221 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f79f3eab648939a30208fed465eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd28b9d6b7146f2b1c114607be83a48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:38.236635 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-53187e55-e176-49c6-85b2-ce72f5fb8221 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] 10.222.0.13 "GET /compute/v2.1/servers/8f8815cb-4215-486d-9d40-fe6ffa145ddc" status: 200 len: 1268 microversion: 2.1 time: 0.152229 Oct 30 01:26:38.239569 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1530/3036] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:38 2022] GET /compute/v2.1/servers/8f8815cb-4215-486d-9d40-fe6ffa145ddc => generated 1268 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:38.255222 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7ab4325e-5512-4946-8c1c-17cefc9f6dc1 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:38.256623 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7ab4325e-5512-4946-8c1c-17cefc9f6dc1 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] [instance: 9c6be996-7886-41c6-9c0c-e0f899836cb0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:38.265901 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7ab4325e-5512-4946-8c1c-17cefc9f6dc1 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:38.274720 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7ab4325e-5512-4946-8c1c-17cefc9f6dc1 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:38.274720 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7ab4325e-5512-4946-8c1c-17cefc9f6dc1 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:38.274720 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7ab4325e-5512-4946-8c1c-17cefc9f6dc1 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:38.274720 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7ab4325e-5512-4946-8c1c-17cefc9f6dc1 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:38.274720 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7ab4325e-5512-4946-8c1c-17cefc9f6dc1 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:38.302218 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7ab4325e-5512-4946-8c1c-17cefc9f6dc1 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] [instance: 9c6be996-7886-41c6-9c0c-e0f899836cb0] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:26:38.645865 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-323356d5-e0d3-46c5-b3a2-78ab9e14a06f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "DELETE /compute/v2.1/images/21c14abf-0ccd-412a-bbbb-70149bcf547b" status: 204 len: 0 microversion: 2.1 time: 1.266783 Oct 30 01:26:38.645865 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1507/3037] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:37 2022] DELETE /compute/v2.1/images/21c14abf-0ccd-412a-bbbb-70149bcf547b => generated 0 bytes in 1268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:26:38.652216 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a5cffaf3-c721-4ec9-8b10-32e5241145c0 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:38.653048 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a5cffaf3-c721-4ec9-8b10-32e5241145c0 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: edf8f5ea-58fd-4226-b75c-0138fbdd6ae4] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:38.662144 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a5cffaf3-c721-4ec9-8b10-32e5241145c0 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:38.662876 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a5cffaf3-c721-4ec9-8b10-32e5241145c0 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:38.663466 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a5cffaf3-c721-4ec9-8b10-32e5241145c0 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:38.664440 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a5cffaf3-c721-4ec9-8b10-32e5241145c0 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:38.665107 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a5cffaf3-c721-4ec9-8b10-32e5241145c0 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:38.665859 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a5cffaf3-c721-4ec9-8b10-32e5241145c0 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:38.700257 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7ab4325e-5512-4946-8c1c-17cefc9f6dc1 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9c6be996-7886-41c6-9c0c-e0f899836cb0" status: 204 len: 0 microversion: 2.1 time: 0.456405 Oct 30 01:26:38.704908 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1531/3038] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:26:38 2022] DELETE /compute/v2.1/servers/9c6be996-7886-41c6-9c0c-e0f899836cb0 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:26:38.716366 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f2a306ba-4064-4a0a-950a-3a28ade5c852 tempest-FlavorsV2TestJSON-817623376 tempest-FlavorsV2TestJSON-817623376-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:38.752998 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f2a306ba-4064-4a0a-950a-3a28ade5c852 tempest-FlavorsV2TestJSON-817623376 tempest-FlavorsV2TestJSON-817623376-project] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050278 Oct 30 01:26:38.758219 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1532/3039] 10.222.0.13 () {58 vars in 1146 bytes} [Sun Oct 30 01:26:38 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:38.774414 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-65d4a9ee-ee88-47a0-a040-82fe50d6b28e tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:38.779058 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-65d4a9ee-ee88-47a0-a040-82fe50d6b28e tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] [instance: f08028cf-a9fa-4b2c-9796-0e5a8c172ab5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:38.783385 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-65d4a9ee-ee88-47a0-a040-82fe50d6b28e tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:38.784321 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-65d4a9ee-ee88-47a0-a040-82fe50d6b28e tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:38.785866 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-65d4a9ee-ee88-47a0-a040-82fe50d6b28e tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:38.786798 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-65d4a9ee-ee88-47a0-a040-82fe50d6b28e tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:38.787438 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-65d4a9ee-ee88-47a0-a040-82fe50d6b28e tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:38.788098 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-65d4a9ee-ee88-47a0-a040-82fe50d6b28e tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:38.843666 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a5cffaf3-c721-4ec9-8b10-32e5241145c0 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07f2b8c31f54c62aaba73ca2bd2edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c59bd73c7874a00b52ec7c5c4142039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:38.855476 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a5cffaf3-c721-4ec9-8b10-32e5241145c0 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] 10.222.0.13 "GET /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4" status: 200 len: 1313 microversion: 2.1 time: 0.207785 Oct 30 01:26:38.859457 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1508/3040] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:38 2022] GET /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4 => generated 1313 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:38.873507 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6b66f1b2-713a-4442-b34d-7718924ae767 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:38.874481 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6b66f1b2-713a-4442-b34d-7718924ae767 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: 688c35c4-9529-49df-8255-98cd2b56c314] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:38.890183 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6b66f1b2-713a-4442-b34d-7718924ae767 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:38.890183 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6b66f1b2-713a-4442-b34d-7718924ae767 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:38.890183 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6b66f1b2-713a-4442-b34d-7718924ae767 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:38.890183 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6b66f1b2-713a-4442-b34d-7718924ae767 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:38.898786 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6b66f1b2-713a-4442-b34d-7718924ae767 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:38.899700 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6b66f1b2-713a-4442-b34d-7718924ae767 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:38.965248 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-65d4a9ee-ee88-47a0-a040-82fe50d6b28e tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:38.979624 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-65d4a9ee-ee88-47a0-a040-82fe50d6b28e tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:38.982518 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6b66f1b2-713a-4442-b34d-7718924ae767 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: 688c35c4-9529-49df-8255-98cd2b56c314] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:26:38.986010 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-65d4a9ee-ee88-47a0-a040-82fe50d6b28e tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:38.991632 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-65d4a9ee-ee88-47a0-a040-82fe50d6b28e tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] 10.222.0.13 "GET /compute/v2.1/servers/f08028cf-a9fa-4b2c-9796-0e5a8c172ab5" status: 200 len: 1365 microversion: 2.47 time: 0.227841 Oct 30 01:26:39.010745 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1533/3041] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:26:38 2022] GET /compute/v2.1/servers/f08028cf-a9fa-4b2c-9796-0e5a8c172ab5 => generated 1365 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:26:39.029442 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-abe1ff05-83be-4a8e-a9c2-ff42256af65f tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:39.034879 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-abe1ff05-83be-4a8e-a9c2-ff42256af65f tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] [instance: 9c6be996-7886-41c6-9c0c-e0f899836cb0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:39.050156 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-abe1ff05-83be-4a8e-a9c2-ff42256af65f tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:39.052622 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-abe1ff05-83be-4a8e-a9c2-ff42256af65f tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:39.053968 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-abe1ff05-83be-4a8e-a9c2-ff42256af65f tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:39.056604 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-abe1ff05-83be-4a8e-a9c2-ff42256af65f tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:39.057267 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-abe1ff05-83be-4a8e-a9c2-ff42256af65f tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:39.059944 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-abe1ff05-83be-4a8e-a9c2-ff42256af65f tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:39.302102 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-abe1ff05-83be-4a8e-a9c2-ff42256af65f tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e50d6775ec4d2e96ab6e839b4631f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310172f2dfaf4ddcb5eace8a13939cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:39.319044 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-abe1ff05-83be-4a8e-a9c2-ff42256af65f tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6be996-7886-41c6-9c0c-e0f899836cb0" status: 200 len: 1473 microversion: 2.1 time: 0.306970 Oct 30 01:26:39.320137 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1534/3042] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:39 2022] GET /compute/v2.1/servers/9c6be996-7886-41c6-9c0c-e0f899836cb0 => generated 1473 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:39.336974 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-51b9103f-b1f3-4580-8295-09df1edc9fd7 tempest-FlavorsV2TestJSON-817623376 tempest-FlavorsV2TestJSON-817623376-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:39.347723 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-51b9103f-b1f3-4580-8295-09df1edc9fd7 tempest-FlavorsV2TestJSON-817623376 tempest-FlavorsV2TestJSON-817623376-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024296 Oct 30 01:26:39.348335 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1535/3043] 10.222.0.13 () {58 vars in 1137 bytes} [Sun Oct 30 01:26:39 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:26:39.353985 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-07acac63-a614-4118-ae0f-b088d9de2281 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:39.354603 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-07acac63-a614-4118-ae0f-b088d9de2281 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] [instance: 58e23ab9-995a-4ce5-b923-941fb5c55384] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:39.367624 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-07acac63-a614-4118-ae0f-b088d9de2281 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:39.368349 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-07acac63-a614-4118-ae0f-b088d9de2281 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:39.369033 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-07acac63-a614-4118-ae0f-b088d9de2281 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:39.369972 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-07acac63-a614-4118-ae0f-b088d9de2281 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:39.370615 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-07acac63-a614-4118-ae0f-b088d9de2281 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:39.371259 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-07acac63-a614-4118-ae0f-b088d9de2281 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:39.411827 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6b66f1b2-713a-4442-b34d-7718924ae767 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "DELETE /compute/v2.1/servers/688c35c4-9529-49df-8255-98cd2b56c314" status: 204 len: 0 microversion: 2.1 time: 0.547860 Oct 30 01:26:39.414390 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1509/3044] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:26:38 2022] DELETE /compute/v2.1/servers/688c35c4-9529-49df-8255-98cd2b56c314 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:26:39.424629 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-6f494a89-a7ca-40dd-900c-e301872663bb req-55a239a7-f418-4c7b-9e67-1078651d9fed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "688c35c4-9529-49df-8255-98cd2b56c314", "name": "network-vif-unplugged", "status": "completed", "tag": "f6c4cc9d-1ae2-485f-8d36-d57599740dfc"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:26:39.457664 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-6f494a89-a7ca-40dd-900c-e301872663bb req-55a239a7-f418-4c7b-9e67-1078651d9fed service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:39.458150 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-6f494a89-a7ca-40dd-900c-e301872663bb req-55a239a7-f418-4c7b-9e67-1078651d9fed service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:39.459328 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-6f494a89-a7ca-40dd-900c-e301872663bb req-55a239a7-f418-4c7b-9e67-1078651d9fed service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:39.499266 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-6f494a89-a7ca-40dd-900c-e301872663bb req-55a239a7-f418-4c7b-9e67-1078651d9fed service nova] Creating event network-vif-unplugged:f6c4cc9d-1ae2-485f-8d36-d57599740dfc for instance 688c35c4-9529-49df-8255-98cd2b56c314 on n-h2-master-1 Oct 30 01:26:39.541657 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-6f494a89-a7ca-40dd-900c-e301872663bb req-55a239a7-f418-4c7b-9e67-1078651d9fed service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.124329 Oct 30 01:26:39.542310 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1510/3045] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:26:39.554500 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4cc4e51b-b5a5-42e5-8847-22ee69f29536 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:39.555223 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4cc4e51b-b5a5-42e5-8847-22ee69f29536 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] [instance: 8f8815cb-4215-486d-9d40-fe6ffa145ddc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:39.574682 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4cc4e51b-b5a5-42e5-8847-22ee69f29536 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:39.579454 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4cc4e51b-b5a5-42e5-8847-22ee69f29536 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:39.579454 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4cc4e51b-b5a5-42e5-8847-22ee69f29536 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:39.579668 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-07acac63-a614-4118-ae0f-b088d9de2281 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ecc29bc51140d7923506918965ef64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a746ec83df44fe4bc49cf74dcf246c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:39.579786 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4cc4e51b-b5a5-42e5-8847-22ee69f29536 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:39.579786 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4cc4e51b-b5a5-42e5-8847-22ee69f29536 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:39.579786 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4cc4e51b-b5a5-42e5-8847-22ee69f29536 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:39.589413 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:26:39.590055 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-07acac63-a614-4118-ae0f-b088d9de2281 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0ecc29bc51140d7923506918965ef64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a746ec83df44fe4bc49cf74dcf246c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:39.592607 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-07acac63-a614-4118-ae0f-b088d9de2281 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0ecc29bc51140d7923506918965ef64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a746ec83df44fe4bc49cf74dcf246c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:39.594103 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-07acac63-a614-4118-ae0f-b088d9de2281 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] 10.222.0.13 "GET /compute/v2.1/servers/58e23ab9-995a-4ce5-b923-941fb5c55384" status: 200 len: 1366 microversion: 2.47 time: 0.244836 Oct 30 01:26:39.609360 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1536/3046] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:26:39 2022] GET /compute/v2.1/servers/58e23ab9-995a-4ce5-b923-941fb5c55384 => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:26:39.635306 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9f0c56ea-aab2-4d73-9fac-fb21f42fab66 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-888317207", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "e006438e-aba1-46be-a97a-88a3153fb746"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:26:39.685512 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4cc4e51b-b5a5-42e5-8847-22ee69f29536 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f79f3eab648939a30208fed465eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd28b9d6b7146f2b1c114607be83a48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:39.694145 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4cc4e51b-b5a5-42e5-8847-22ee69f29536 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] 10.222.0.13 "GET /compute/v2.1/servers/8f8815cb-4215-486d-9d40-fe6ffa145ddc" status: 200 len: 1276 microversion: 2.1 time: 0.150612 Oct 30 01:26:39.710805 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-9f0c56ea-aab2-4d73-9fac-fb21f42fab66 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] validate_networks() for [('e006438e-aba1-46be-a97a-88a3153fb746', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:26:39.715298 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1511/3047] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:39 2022] GET /compute/v2.1/servers/8f8815cb-4215-486d-9d40-fe6ffa145ddc => generated 1276 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:39.884707 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0c323e8d-78be-40b0-aa2f-96724975ce43 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:39.885711 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0c323e8d-78be-40b0-aa2f-96724975ce43 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: edf8f5ea-58fd-4226-b75c-0138fbdd6ae4] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:39.894215 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c323e8d-78be-40b0-aa2f-96724975ce43 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:39.900787 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c323e8d-78be-40b0-aa2f-96724975ce43 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:39.901683 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c323e8d-78be-40b0-aa2f-96724975ce43 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:39.903179 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c323e8d-78be-40b0-aa2f-96724975ce43 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:39.904691 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c323e8d-78be-40b0-aa2f-96724975ce43 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:39.905416 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c323e8d-78be-40b0-aa2f-96724975ce43 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:40.242856 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0c323e8d-78be-40b0-aa2f-96724975ce43 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07f2b8c31f54c62aaba73ca2bd2edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c59bd73c7874a00b52ec7c5c4142039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:40.253318 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0c323e8d-78be-40b0-aa2f-96724975ce43 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] 10.222.0.13 "GET /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4" status: 200 len: 1313 microversion: 2.1 time: 0.374990 Oct 30 01:26:40.266117 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1512/3048] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:39 2022] GET /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4 => generated 1313 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:26:40.276647 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-feff7f1d-6744-49e8-84e2-f8167510ef7d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:40.277517 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-feff7f1d-6744-49e8-84e2-f8167510ef7d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] [instance: f08028cf-a9fa-4b2c-9796-0e5a8c172ab5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:40.285131 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-feff7f1d-6744-49e8-84e2-f8167510ef7d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:40.285883 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-feff7f1d-6744-49e8-84e2-f8167510ef7d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:40.287001 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-feff7f1d-6744-49e8-84e2-f8167510ef7d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:40.287941 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-feff7f1d-6744-49e8-84e2-f8167510ef7d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:40.288635 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-feff7f1d-6744-49e8-84e2-f8167510ef7d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:40.289281 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-feff7f1d-6744-49e8-84e2-f8167510ef7d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:40.401122 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-feff7f1d-6744-49e8-84e2-f8167510ef7d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:40.405747 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-9f0c56ea-aab2-4d73-9fac-fb21f42fab66 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:26:40.406260 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-9f0c56ea-aab2-4d73-9fac-fb21f42fab66 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:26:40.406646 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-9f0c56ea-aab2-4d73-9fac-fb21f42fab66 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:26:40.407054 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-9f0c56ea-aab2-4d73-9fac-fb21f42fab66 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:26:40.408021 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-9f0c56ea-aab2-4d73-9fac-fb21f42fab66 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:26:40.415976 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-feff7f1d-6744-49e8-84e2-f8167510ef7d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:40.418474 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-feff7f1d-6744-49e8-84e2-f8167510ef7d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:40.425793 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-feff7f1d-6744-49e8-84e2-f8167510ef7d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] 10.222.0.13 "GET /compute/v2.1/servers/f08028cf-a9fa-4b2c-9796-0e5a8c172ab5" status: 200 len: 1365 microversion: 2.47 time: 0.157383 Oct 30 01:26:40.426608 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9f0c56ea-aab2-4d73-9fac-fb21f42fab66 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:40.434901 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1513/3049] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:26:40 2022] GET /compute/v2.1/servers/f08028cf-a9fa-4b2c-9796-0e5a8c172ab5 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:26:40.435578 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9f0c56ea-aab2-4d73-9fac-fb21f42fab66 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:40.435578 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9f0c56ea-aab2-4d73-9fac-fb21f42fab66 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:40.435578 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9f0c56ea-aab2-4d73-9fac-fb21f42fab66 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:40.435578 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9f0c56ea-aab2-4d73-9fac-fb21f42fab66 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:40.436944 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b92cf7d8-ae5f-40a0-a93f-3a9d90e3779d tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:40.440883 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9f0c56ea-aab2-4d73-9fac-fb21f42fab66 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:40.441717 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b92cf7d8-ae5f-40a0-a93f-3a9d90e3779d tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] [instance: 9c6be996-7886-41c6-9c0c-e0f899836cb0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:40.452490 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b92cf7d8-ae5f-40a0-a93f-3a9d90e3779d tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:40.456356 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b92cf7d8-ae5f-40a0-a93f-3a9d90e3779d tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:40.459467 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b92cf7d8-ae5f-40a0-a93f-3a9d90e3779d tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:40.460472 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b92cf7d8-ae5f-40a0-a93f-3a9d90e3779d tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:40.461882 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b92cf7d8-ae5f-40a0-a93f-3a9d90e3779d tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:40.462569 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b92cf7d8-ae5f-40a0-a93f-3a9d90e3779d tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:40.493085 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-9f0c56ea-aab2-4d73-9fac-fb21f42fab66 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Getting quotas for project 4aa9c648b20d41d7b150fbf64cde6fe8. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:26:40.502200 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-9f0c56ea-aab2-4d73-9fac-fb21f42fab66 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Getting quotas for user f857d6b0826e47c6875a307e7ccfb104 and project 4aa9c648b20d41d7b150fbf64cde6fe8. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:26:40.541930 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9f0c56ea-aab2-4d73-9fac-fb21f42fab66 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:26:40.550228 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9f0c56ea-aab2-4d73-9fac-fb21f42fab66 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: b4259dcb-d421-45fb-84e6-7e8a8f7ce20d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:26:40.752499 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b92cf7d8-ae5f-40a0-a93f-3a9d90e3779d tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e50d6775ec4d2e96ab6e839b4631f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310172f2dfaf4ddcb5eace8a13939cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:40.774836 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b92cf7d8-ae5f-40a0-a93f-3a9d90e3779d tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6be996-7886-41c6-9c0c-e0f899836cb0" status: 200 len: 1473 microversion: 2.1 time: 0.345566 Oct 30 01:26:40.781193 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1514/3050] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:40 2022] GET /compute/v2.1/servers/9c6be996-7886-41c6-9c0c-e0f899836cb0 => generated 1473 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:40.798354 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9f0c56ea-aab2-4d73-9fac-fb21f42fab66 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.167678 Oct 30 01:26:40.801153 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1537/3051] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:26:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1172 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:26:40.812816 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-30f759fc-39d0-491b-a311-d73119a33c83 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:40.813885 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-30f759fc-39d0-491b-a311-d73119a33c83 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] [instance: 8f8815cb-4215-486d-9d40-fe6ffa145ddc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:40.820437 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-58e76b46-24a5-4ff5-b0ae-cf6d70f3c724 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:40.822072 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-58e76b46-24a5-4ff5-b0ae-cf6d70f3c724 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] [instance: 58e23ab9-995a-4ce5-b923-941fb5c55384] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:40.835776 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-30f759fc-39d0-491b-a311-d73119a33c83 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:40.836290 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-30f759fc-39d0-491b-a311-d73119a33c83 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:40.836733 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-30f759fc-39d0-491b-a311-d73119a33c83 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:40.837603 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-30f759fc-39d0-491b-a311-d73119a33c83 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:40.838208 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-30f759fc-39d0-491b-a311-d73119a33c83 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:40.838510 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-30f759fc-39d0-491b-a311-d73119a33c83 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:40.866167 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58e76b46-24a5-4ff5-b0ae-cf6d70f3c724 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:40.870922 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58e76b46-24a5-4ff5-b0ae-cf6d70f3c724 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:40.872289 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58e76b46-24a5-4ff5-b0ae-cf6d70f3c724 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:40.874076 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58e76b46-24a5-4ff5-b0ae-cf6d70f3c724 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:40.882636 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58e76b46-24a5-4ff5-b0ae-cf6d70f3c724 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:40.887717 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58e76b46-24a5-4ff5-b0ae-cf6d70f3c724 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:40.927961 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-58e76b46-24a5-4ff5-b0ae-cf6d70f3c724 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] HTTP exception thrown: Instance 58e23ab9-995a-4ce5-b923-941fb5c55384 could not be found. Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-58e76b46-24a5-4ff5-b0ae-cf6d70f3c724 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Request method failure captured: Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/58e23ab9-995a-4ce5-b923-941fb5c55384 HTTP/1.1 Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdKw0MOIBiXvxQ2Y93hI9jFRDOtwpl17T5VA06DWvHJbwfMHJ88jA_wOgBe-pFLQS3xopyqQZkNz8IsOcAK_BOrRNg2GOQvZRF98dKwb4ZJCIS8b2NJ0HrLRHfrtc4P-EtOZhMC-emLmBJZpNn3oAl5Sv6ZcqX2B-uZnVXnJmnLYSdo Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: X-Openstack-Nova-Api-Version: 2.47 Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 7a746ec83df44fe4bc49cf74dcf246c1 Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersAaction247Test-389098096 Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7a746ec83df44fe4bc49cf74dcf246c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7a746ec83df44fe4bc49cf74dcf246c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7a746ec83df44fe4bc49cf74dcf246c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7a746ec83df44fe4bc49cf74dcf246c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersAaction247Test-389098096 Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 7a746ec83df44fe4bc49cf74dcf246c1 Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersAaction247Test-389098096 Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersAaction247Test-389098096-project Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: b0ecc29bc51140d7923506918965ef64 Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersAaction247Test-389098096-project Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 58e23ab9-995a-4ce5-b923-941fb5c55384 could not be found. Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '58e23ab9-995a-4ce5-b923-941fb5c55384'} Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58e23ab9-995a-4ce5-b923-941fb5c55384 could not be found. Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58e23ab9-995a-4ce5-b923-941fb5c55384 could not be found. Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:26:40.936394 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:26:40.942085 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:26:40.942085 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:26:40.942085 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:26:40.942085 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:26:40.942085 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:26:40.942085 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58e23ab9-995a-4ce5-b923-941fb5c55384 could not be found. Oct 30 01:26:40.942085 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:26:40.942085 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-58e76b46-24a5-4ff5-b0ae-cf6d70f3c724 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] Returning 404 to user: Instance 58e23ab9-995a-4ce5-b923-941fb5c55384 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:26:40.942085 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-58e76b46-24a5-4ff5-b0ae-cf6d70f3c724 tempest-ServersAaction247Test-389098096 tempest-ServersAaction247Test-389098096-project] 10.222.0.13 "GET /compute/v2.1/servers/58e23ab9-995a-4ce5-b923-941fb5c55384" status: 404 len: 111 microversion: 2.47 time: 0.157563 Oct 30 01:26:40.942085 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1515/3052] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:26:40 2022] GET /compute/v2.1/servers/58e23ab9-995a-4ce5-b923-941fb5c55384 => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:26:40.961492 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c08fcbba-811a-4a18-91bb-851634ad56fc tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:40.961492 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c08fcbba-811a-4a18-91bb-851634ad56fc tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: b4259dcb-d421-45fb-84e6-7e8a8f7ce20d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:41.033633 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-30f759fc-39d0-491b-a311-d73119a33c83 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f79f3eab648939a30208fed465eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd28b9d6b7146f2b1c114607be83a48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:41.042076 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-30f759fc-39d0-491b-a311-d73119a33c83 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] 10.222.0.13 "GET /compute/v2.1/servers/8f8815cb-4215-486d-9d40-fe6ffa145ddc" status: 200 len: 1286 microversion: 2.1 time: 0.239657 Oct 30 01:26:41.053459 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1538/3053] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:40 2022] GET /compute/v2.1/servers/8f8815cb-4215-486d-9d40-fe6ffa145ddc => generated 1286 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:41.129867 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c08fcbba-811a-4a18-91bb-851634ad56fc tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:41.144844 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c08fcbba-811a-4a18-91bb-851634ad56fc tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/b4259dcb-d421-45fb-84e6-7e8a8f7ce20d" status: 200 len: 1207 microversion: 2.1 time: 0.194755 Oct 30 01:26:41.144844 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1516/3054] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:40 2022] GET /compute/v2.1/servers/b4259dcb-d421-45fb-84e6-7e8a8f7ce20d => generated 1207 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:41.280318 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b041b1e9-88d3-4197-9bed-329705305dae tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:41.280941 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b041b1e9-88d3-4197-9bed-329705305dae tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: edf8f5ea-58fd-4226-b75c-0138fbdd6ae4] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:41.290320 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b041b1e9-88d3-4197-9bed-329705305dae tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:41.291064 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b041b1e9-88d3-4197-9bed-329705305dae tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:41.291905 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b041b1e9-88d3-4197-9bed-329705305dae tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:41.292790 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b041b1e9-88d3-4197-9bed-329705305dae tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:41.293540 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b041b1e9-88d3-4197-9bed-329705305dae tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:41.294190 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b041b1e9-88d3-4197-9bed-329705305dae tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:41.461399 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-85b2ae6c-92be-413a-b045-472db02db498 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:41.462819 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-85b2ae6c-92be-413a-b045-472db02db498 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] [instance: f08028cf-a9fa-4b2c-9796-0e5a8c172ab5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:41.486270 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-85b2ae6c-92be-413a-b045-472db02db498 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:41.489050 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-85b2ae6c-92be-413a-b045-472db02db498 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:41.490035 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-85b2ae6c-92be-413a-b045-472db02db498 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:41.493323 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-85b2ae6c-92be-413a-b045-472db02db498 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:41.499898 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-85b2ae6c-92be-413a-b045-472db02db498 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:41.500692 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-85b2ae6c-92be-413a-b045-472db02db498 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:41.619099 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b041b1e9-88d3-4197-9bed-329705305dae tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07f2b8c31f54c62aaba73ca2bd2edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c59bd73c7874a00b52ec7c5c4142039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:41.627787 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b041b1e9-88d3-4197-9bed-329705305dae tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] 10.222.0.13 "GET /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4" status: 200 len: 1313 microversion: 2.1 time: 0.352399 Oct 30 01:26:41.628377 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1539/3055] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:41 2022] GET /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4 => generated 1313 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:41.697650 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-85b2ae6c-92be-413a-b045-472db02db498 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:41.715508 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-85b2ae6c-92be-413a-b045-472db02db498 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:41.717927 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-85b2ae6c-92be-413a-b045-472db02db498 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:41.719360 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-85b2ae6c-92be-413a-b045-472db02db498 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] 10.222.0.13 "GET /compute/v2.1/servers/f08028cf-a9fa-4b2c-9796-0e5a8c172ab5" status: 200 len: 1365 microversion: 2.47 time: 0.270819 Oct 30 01:26:41.721524 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1517/3056] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:26:41 2022] GET /compute/v2.1/servers/f08028cf-a9fa-4b2c-9796-0e5a8c172ab5 => generated 1365 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:26:41.822355 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b4f02594-60ce-40b2-93fb-26a2094ab9e0 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:41.823117 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b4f02594-60ce-40b2-93fb-26a2094ab9e0 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] [instance: 9c6be996-7886-41c6-9c0c-e0f899836cb0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:41.844821 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b4f02594-60ce-40b2-93fb-26a2094ab9e0 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:41.845322 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b4f02594-60ce-40b2-93fb-26a2094ab9e0 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:41.845808 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b4f02594-60ce-40b2-93fb-26a2094ab9e0 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:41.846975 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b4f02594-60ce-40b2-93fb-26a2094ab9e0 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:41.847689 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b4f02594-60ce-40b2-93fb-26a2094ab9e0 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:41.848306 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b4f02594-60ce-40b2-93fb-26a2094ab9e0 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:42.068480 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e461a201-a1c1-4807-a637-9435d55b7fde tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:42.068940 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e461a201-a1c1-4807-a637-9435d55b7fde tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] [instance: 8f8815cb-4215-486d-9d40-fe6ffa145ddc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:42.083977 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e461a201-a1c1-4807-a637-9435d55b7fde tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:42.086815 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e461a201-a1c1-4807-a637-9435d55b7fde tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:42.087463 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e461a201-a1c1-4807-a637-9435d55b7fde tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:42.089952 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e461a201-a1c1-4807-a637-9435d55b7fde tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:42.090593 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e461a201-a1c1-4807-a637-9435d55b7fde tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:42.091335 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e461a201-a1c1-4807-a637-9435d55b7fde tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:42.409707 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b4f02594-60ce-40b2-93fb-26a2094ab9e0 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e50d6775ec4d2e96ab6e839b4631f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310172f2dfaf4ddcb5eace8a13939cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:42.423052 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b4f02594-60ce-40b2-93fb-26a2094ab9e0 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6be996-7886-41c6-9c0c-e0f899836cb0" status: 200 len: 1473 microversion: 2.1 time: 0.618670 Oct 30 01:26:42.426260 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1540/3057] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:41 2022] GET /compute/v2.1/servers/9c6be996-7886-41c6-9c0c-e0f899836cb0 => generated 1473 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:42.436254 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-501e2258-73b3-471b-a296-e8a32124d99d tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:42.438209 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-501e2258-73b3-471b-a296-e8a32124d99d tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: b4259dcb-d421-45fb-84e6-7e8a8f7ce20d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:42.466133 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-501e2258-73b3-471b-a296-e8a32124d99d tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:42.466661 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-501e2258-73b3-471b-a296-e8a32124d99d tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:42.467105 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-501e2258-73b3-471b-a296-e8a32124d99d tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:42.467809 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-501e2258-73b3-471b-a296-e8a32124d99d tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:42.468262 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-501e2258-73b3-471b-a296-e8a32124d99d tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:42.468828 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-501e2258-73b3-471b-a296-e8a32124d99d tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:42.518871 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:26:42.811069 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-501e2258-73b3-471b-a296-e8a32124d99d tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:42.822415 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-501e2258-73b3-471b-a296-e8a32124d99d tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/b4259dcb-d421-45fb-84e6-7e8a8f7ce20d" status: 200 len: 1211 microversion: 2.1 time: 0.394590 Oct 30 01:26:42.823318 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1541/3058] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:42 2022] GET /compute/v2.1/servers/b4259dcb-d421-45fb-84e6-7e8a8f7ce20d => generated 1211 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:42.849370 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-29fb7744-9dcd-4b05-8fdb-45561cf3f24d tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:42.849370 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-29fb7744-9dcd-4b05-8fdb-45561cf3f24d tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: edf8f5ea-58fd-4226-b75c-0138fbdd6ae4] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:42.864632 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-29fb7744-9dcd-4b05-8fdb-45561cf3f24d tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:42.865239 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-29fb7744-9dcd-4b05-8fdb-45561cf3f24d tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:42.866752 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-29fb7744-9dcd-4b05-8fdb-45561cf3f24d tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:42.868403 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-29fb7744-9dcd-4b05-8fdb-45561cf3f24d tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:42.869085 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-29fb7744-9dcd-4b05-8fdb-45561cf3f24d tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:42.872228 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-29fb7744-9dcd-4b05-8fdb-45561cf3f24d tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:43.083936 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e461a201-a1c1-4807-a637-9435d55b7fde tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f79f3eab648939a30208fed465eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd28b9d6b7146f2b1c114607be83a48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:43.104547 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e461a201-a1c1-4807-a637-9435d55b7fde tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] 10.222.0.13 "GET /compute/v2.1/servers/8f8815cb-4215-486d-9d40-fe6ffa145ddc" status: 200 len: 1328 microversion: 2.1 time: 1.040785 Oct 30 01:26:43.107886 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1518/3059] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:42 2022] GET /compute/v2.1/servers/8f8815cb-4215-486d-9d40-fe6ffa145ddc => generated 1328 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:43.112904 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f0593e7c-8c04-4d0b-a953-bad66ca90673 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:43.119449 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f0593e7c-8c04-4d0b-a953-bad66ca90673 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] [instance: f08028cf-a9fa-4b2c-9796-0e5a8c172ab5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:43.150113 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f0593e7c-8c04-4d0b-a953-bad66ca90673 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:43.154557 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f0593e7c-8c04-4d0b-a953-bad66ca90673 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:43.163457 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f0593e7c-8c04-4d0b-a953-bad66ca90673 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:43.166241 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f0593e7c-8c04-4d0b-a953-bad66ca90673 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:43.170429 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f0593e7c-8c04-4d0b-a953-bad66ca90673 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:43.171474 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f0593e7c-8c04-4d0b-a953-bad66ca90673 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:43.379318 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f0593e7c-8c04-4d0b-a953-bad66ca90673 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:43.393632 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f0593e7c-8c04-4d0b-a953-bad66ca90673 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:43.399452 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f0593e7c-8c04-4d0b-a953-bad66ca90673 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:43.400986 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f0593e7c-8c04-4d0b-a953-bad66ca90673 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] 10.222.0.13 "GET /compute/v2.1/servers/f08028cf-a9fa-4b2c-9796-0e5a8c172ab5" status: 200 len: 1365 microversion: 2.47 time: 0.291991 Oct 30 01:26:43.404239 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1519/3060] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:26:43 2022] GET /compute/v2.1/servers/f08028cf-a9fa-4b2c-9796-0e5a8c172ab5 => generated 1365 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:26:43.451601 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2a623e11-4fd5-44c3-9bd6-f0d8a250b0f3 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:43.452911 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2a623e11-4fd5-44c3-9bd6-f0d8a250b0f3 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] [instance: 9c6be996-7886-41c6-9c0c-e0f899836cb0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:43.471528 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a623e11-4fd5-44c3-9bd6-f0d8a250b0f3 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:43.477418 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a623e11-4fd5-44c3-9bd6-f0d8a250b0f3 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:43.478690 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a623e11-4fd5-44c3-9bd6-f0d8a250b0f3 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:43.479702 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a623e11-4fd5-44c3-9bd6-f0d8a250b0f3 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:43.481444 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a623e11-4fd5-44c3-9bd6-f0d8a250b0f3 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:43.499929 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a623e11-4fd5-44c3-9bd6-f0d8a250b0f3 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:43.666185 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-29fb7744-9dcd-4b05-8fdb-45561cf3f24d tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07f2b8c31f54c62aaba73ca2bd2edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c59bd73c7874a00b52ec7c5c4142039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:43.688426 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-29fb7744-9dcd-4b05-8fdb-45561cf3f24d tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] 10.222.0.13 "GET /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4" status: 200 len: 1334 microversion: 2.1 time: 0.848604 Oct 30 01:26:43.689028 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1542/3061] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:42 2022] GET /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4 => generated 1334 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:43.850197 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-78f4d5a1-275b-4cc2-92ba-b500df69bbdd tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:43.852724 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-78f4d5a1-275b-4cc2-92ba-b500df69bbdd tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: b4259dcb-d421-45fb-84e6-7e8a8f7ce20d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:43.861294 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-78f4d5a1-275b-4cc2-92ba-b500df69bbdd tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:43.862014 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-78f4d5a1-275b-4cc2-92ba-b500df69bbdd tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:43.862634 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-78f4d5a1-275b-4cc2-92ba-b500df69bbdd tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:43.888012 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-78f4d5a1-275b-4cc2-92ba-b500df69bbdd tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:43.892941 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-78f4d5a1-275b-4cc2-92ba-b500df69bbdd tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:43.894131 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-78f4d5a1-275b-4cc2-92ba-b500df69bbdd tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:44.076577 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:26:44.141727 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2a623e11-4fd5-44c3-9bd6-f0d8a250b0f3 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e50d6775ec4d2e96ab6e839b4631f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310172f2dfaf4ddcb5eace8a13939cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:44.158319 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2a623e11-4fd5-44c3-9bd6-f0d8a250b0f3 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6be996-7886-41c6-9c0c-e0f899836cb0" status: 200 len: 1473 microversion: 2.1 time: 0.712443 Oct 30 01:26:44.166396 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1520/3062] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:43 2022] GET /compute/v2.1/servers/9c6be996-7886-41c6-9c0c-e0f899836cb0 => generated 1473 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:44.181509 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a91541f8-922c-42f9-ad3b-16c85a33bb70 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:44.184127 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a91541f8-922c-42f9-ad3b-16c85a33bb70 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] [instance: 8f8815cb-4215-486d-9d40-fe6ffa145ddc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:44.220979 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a91541f8-922c-42f9-ad3b-16c85a33bb70 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:44.224526 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a91541f8-922c-42f9-ad3b-16c85a33bb70 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:44.227715 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a91541f8-922c-42f9-ad3b-16c85a33bb70 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:44.231449 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a91541f8-922c-42f9-ad3b-16c85a33bb70 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:44.231449 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a91541f8-922c-42f9-ad3b-16c85a33bb70 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:44.234001 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a91541f8-922c-42f9-ad3b-16c85a33bb70 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:44.251118 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-78f4d5a1-275b-4cc2-92ba-b500df69bbdd tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:44.260336 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-78f4d5a1-275b-4cc2-92ba-b500df69bbdd tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/b4259dcb-d421-45fb-84e6-7e8a8f7ce20d" status: 200 len: 1259 microversion: 2.1 time: 0.414085 Oct 30 01:26:44.266220 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1543/3063] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:43 2022] GET /compute/v2.1/servers/b4259dcb-d421-45fb-84e6-7e8a8f7ce20d => generated 1259 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:44.429811 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7e6d620f-3e1b-4219-913b-d83b176d4fa6 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:44.430512 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7e6d620f-3e1b-4219-913b-d83b176d4fa6 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] [instance: f08028cf-a9fa-4b2c-9796-0e5a8c172ab5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:44.438730 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e6d620f-3e1b-4219-913b-d83b176d4fa6 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:44.440440 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e6d620f-3e1b-4219-913b-d83b176d4fa6 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:44.440440 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e6d620f-3e1b-4219-913b-d83b176d4fa6 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:44.440969 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e6d620f-3e1b-4219-913b-d83b176d4fa6 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:44.441827 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e6d620f-3e1b-4219-913b-d83b176d4fa6 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:44.442400 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e6d620f-3e1b-4219-913b-d83b176d4fa6 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:44.636618 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7e6d620f-3e1b-4219-913b-d83b176d4fa6 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:44.663797 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7e6d620f-3e1b-4219-913b-d83b176d4fa6 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:44.670409 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7e6d620f-3e1b-4219-913b-d83b176d4fa6 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:44.674609 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7e6d620f-3e1b-4219-913b-d83b176d4fa6 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] 10.222.0.13 "GET /compute/v2.1/servers/f08028cf-a9fa-4b2c-9796-0e5a8c172ab5" status: 200 len: 1365 microversion: 2.47 time: 0.248961 Oct 30 01:26:44.676346 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1544/3064] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:26:44 2022] GET /compute/v2.1/servers/f08028cf-a9fa-4b2c-9796-0e5a8c172ab5 => generated 1365 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:26:44.689099 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a91541f8-922c-42f9-ad3b-16c85a33bb70 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f79f3eab648939a30208fed465eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd28b9d6b7146f2b1c114607be83a48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:44.706761 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a91541f8-922c-42f9-ad3b-16c85a33bb70 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] 10.222.0.13 "GET /compute/v2.1/servers/8f8815cb-4215-486d-9d40-fe6ffa145ddc" status: 200 len: 1316 microversion: 2.1 time: 0.538303 Oct 30 01:26:44.723561 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8fe83268-dc5d-466b-bcc0-58f7a62e6799 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:44.724836 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8fe83268-dc5d-466b-bcc0-58f7a62e6799 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: edf8f5ea-58fd-4226-b75c-0138fbdd6ae4] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:44.726541 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1521/3065] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:44 2022] GET /compute/v2.1/servers/8f8815cb-4215-486d-9d40-fe6ffa145ddc => generated 1316 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:44.728936 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:26:44.738503 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8fe83268-dc5d-466b-bcc0-58f7a62e6799 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:44.739354 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8fe83268-dc5d-466b-bcc0-58f7a62e6799 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:44.740448 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8fe83268-dc5d-466b-bcc0-58f7a62e6799 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:44.743019 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8fe83268-dc5d-466b-bcc0-58f7a62e6799 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:44.744922 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8fe83268-dc5d-466b-bcc0-58f7a62e6799 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:44.745597 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8fe83268-dc5d-466b-bcc0-58f7a62e6799 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:45.082678 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-ae0b419a-3e7c-4755-bdf9-2d2121d156b3 req-fe421f59-0e94-45e8-8dc6-4d2e577dbd7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "688c35c4-9529-49df-8255-98cd2b56c314", "name": "network-vif-deleted", "tag": "f6c4cc9d-1ae2-485f-8d36-d57599740dfc"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:26:45.104006 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ae0b419a-3e7c-4755-bdf9-2d2121d156b3 req-fe421f59-0e94-45e8-8dc6-4d2e577dbd7e service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:45.104511 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ae0b419a-3e7c-4755-bdf9-2d2121d156b3 req-fe421f59-0e94-45e8-8dc6-4d2e577dbd7e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:45.106301 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ae0b419a-3e7c-4755-bdf9-2d2121d156b3 req-fe421f59-0e94-45e8-8dc6-4d2e577dbd7e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:45.141932 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-ae0b419a-3e7c-4755-bdf9-2d2121d156b3 req-fe421f59-0e94-45e8-8dc6-4d2e577dbd7e service nova] Creating event network-vif-deleted:f6c4cc9d-1ae2-485f-8d36-d57599740dfc for instance 688c35c4-9529-49df-8255-98cd2b56c314 on n-h2-master-1 Oct 30 01:26:45.152024 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-ae0b419a-3e7c-4755-bdf9-2d2121d156b3 req-fe421f59-0e94-45e8-8dc6-4d2e577dbd7e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082381 Oct 30 01:26:45.153297 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1522/3066] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:26:45.204943 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a5be753f-a1ce-431a-a3f7-979a24def445 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:45.210267 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a5be753f-a1ce-431a-a3f7-979a24def445 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] [instance: 9c6be996-7886-41c6-9c0c-e0f899836cb0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:45.230285 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a5be753f-a1ce-431a-a3f7-979a24def445 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:45.230285 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a5be753f-a1ce-431a-a3f7-979a24def445 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:45.230564 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a5be753f-a1ce-431a-a3f7-979a24def445 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:45.239675 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a5be753f-a1ce-431a-a3f7-979a24def445 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:45.241205 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a5be753f-a1ce-431a-a3f7-979a24def445 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:45.241643 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8fe83268-dc5d-466b-bcc0-58f7a62e6799 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07f2b8c31f54c62aaba73ca2bd2edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c59bd73c7874a00b52ec7c5c4142039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:45.246793 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a5be753f-a1ce-431a-a3f7-979a24def445 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:45.260276 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8fe83268-dc5d-466b-bcc0-58f7a62e6799 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] 10.222.0.13 "GET /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4" status: 200 len: 1334 microversion: 2.1 time: 0.543845 Oct 30 01:26:45.262196 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1545/3067] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:44 2022] GET /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4 => generated 1334 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:45.287996 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-07a5f200-2d7c-446d-b1ce-4c4f7ac3bece tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:45.289434 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-07a5f200-2d7c-446d-b1ce-4c4f7ac3bece tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: b4259dcb-d421-45fb-84e6-7e8a8f7ce20d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:45.302757 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-07a5f200-2d7c-446d-b1ce-4c4f7ac3bece tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:45.306115 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-07a5f200-2d7c-446d-b1ce-4c4f7ac3bece tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:45.306832 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-07a5f200-2d7c-446d-b1ce-4c4f7ac3bece tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:45.307942 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-07a5f200-2d7c-446d-b1ce-4c4f7ac3bece tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:45.310053 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-07a5f200-2d7c-446d-b1ce-4c4f7ac3bece tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:45.316819 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-07a5f200-2d7c-446d-b1ce-4c4f7ac3bece tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:45.377065 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a5be753f-a1ce-431a-a3f7-979a24def445 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e50d6775ec4d2e96ab6e839b4631f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310172f2dfaf4ddcb5eace8a13939cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:45.429309 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a5be753f-a1ce-431a-a3f7-979a24def445 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6be996-7886-41c6-9c0c-e0f899836cb0" status: 200 len: 1431 microversion: 2.1 time: 0.226796 Oct 30 01:26:45.429309 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1523/3068] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:45 2022] GET /compute/v2.1/servers/9c6be996-7886-41c6-9c0c-e0f899836cb0 => generated 1431 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:45.446062 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-92feaae3-7d15-4fb9-a91e-5055d7c072ad req-1ebf795d-8778-4aff-aefd-8b38329479b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c6be996-7886-41c6-9c0c-e0f899836cb0", "name": "network-vif-deleted", "tag": "aee42464-dca8-4339-bc2b-97369d928349"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:26:45.465994 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-92feaae3-7d15-4fb9-a91e-5055d7c072ad req-1ebf795d-8778-4aff-aefd-8b38329479b5 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:45.466948 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-92feaae3-7d15-4fb9-a91e-5055d7c072ad req-1ebf795d-8778-4aff-aefd-8b38329479b5 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:45.467622 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-92feaae3-7d15-4fb9-a91e-5055d7c072ad req-1ebf795d-8778-4aff-aefd-8b38329479b5 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:45.468291 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-07a5f200-2d7c-446d-b1ce-4c4f7ac3bece tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:45.479431 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-07a5f200-2d7c-446d-b1ce-4c4f7ac3bece tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/b4259dcb-d421-45fb-84e6-7e8a8f7ce20d" status: 200 len: 1265 microversion: 2.1 time: 0.196783 Oct 30 01:26:45.494886 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1546/3069] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:45 2022] GET /compute/v2.1/servers/b4259dcb-d421-45fb-84e6-7e8a8f7ce20d => generated 1265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:45.515586 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-92feaae3-7d15-4fb9-a91e-5055d7c072ad req-1ebf795d-8778-4aff-aefd-8b38329479b5 service nova] Creating event network-vif-deleted:aee42464-dca8-4339-bc2b-97369d928349 for instance 9c6be996-7886-41c6-9c0c-e0f899836cb0 on n-h2-master-1 Oct 30 01:26:45.523045 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-92feaae3-7d15-4fb9-a91e-5055d7c072ad req-1ebf795d-8778-4aff-aefd-8b38329479b5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094807 Oct 30 01:26:45.523698 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1524/3070] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:26:45.704667 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-41e74cea-6cab-4b66-a659-1efaa9f9ef4d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:45.705279 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-41e74cea-6cab-4b66-a659-1efaa9f9ef4d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] [instance: f08028cf-a9fa-4b2c-9796-0e5a8c172ab5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:45.718287 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-41e74cea-6cab-4b66-a659-1efaa9f9ef4d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:45.719105 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-41e74cea-6cab-4b66-a659-1efaa9f9ef4d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:45.719697 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-41e74cea-6cab-4b66-a659-1efaa9f9ef4d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:45.720553 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-41e74cea-6cab-4b66-a659-1efaa9f9ef4d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:45.721159 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-41e74cea-6cab-4b66-a659-1efaa9f9ef4d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:45.721769 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-41e74cea-6cab-4b66-a659-1efaa9f9ef4d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:45.733783 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-51a4ba7c-5e6f-4c90-ab18-c12a8f6d942b tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:45.734746 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-51a4ba7c-5e6f-4c90-ab18-c12a8f6d942b tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] [instance: 8f8815cb-4215-486d-9d40-fe6ffa145ddc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:45.751288 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-51a4ba7c-5e6f-4c90-ab18-c12a8f6d942b tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:45.758528 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-51a4ba7c-5e6f-4c90-ab18-c12a8f6d942b tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:45.759813 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-51a4ba7c-5e6f-4c90-ab18-c12a8f6d942b tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:45.762283 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-51a4ba7c-5e6f-4c90-ab18-c12a8f6d942b tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:45.764809 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-51a4ba7c-5e6f-4c90-ab18-c12a8f6d942b tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:45.769464 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-51a4ba7c-5e6f-4c90-ab18-c12a8f6d942b tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:45.980143 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-41e74cea-6cab-4b66-a659-1efaa9f9ef4d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:45.993765 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-41e74cea-6cab-4b66-a659-1efaa9f9ef4d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:45.996767 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-41e74cea-6cab-4b66-a659-1efaa9f9ef4d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:45.998625 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-41e74cea-6cab-4b66-a659-1efaa9f9ef4d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] 10.222.0.13 "GET /compute/v2.1/servers/f08028cf-a9fa-4b2c-9796-0e5a8c172ab5" status: 200 len: 1365 microversion: 2.47 time: 0.298239 Oct 30 01:26:46.001201 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1547/3071] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:26:45 2022] GET /compute/v2.1/servers/f08028cf-a9fa-4b2c-9796-0e5a8c172ab5 => generated 1365 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:26:46.164079 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-51a4ba7c-5e6f-4c90-ab18-c12a8f6d942b tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f79f3eab648939a30208fed465eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd28b9d6b7146f2b1c114607be83a48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:46.179753 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-51a4ba7c-5e6f-4c90-ab18-c12a8f6d942b tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] 10.222.0.13 "GET /compute/v2.1/servers/8f8815cb-4215-486d-9d40-fe6ffa145ddc" status: 200 len: 1316 microversion: 2.1 time: 0.451248 Oct 30 01:26:46.191383 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1525/3072] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:45 2022] GET /compute/v2.1/servers/8f8815cb-4215-486d-9d40-fe6ffa145ddc => generated 1316 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:46.284789 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bf6a1b16-6240-4aa5-bc4b-6221d3bdc557 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:46.285737 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bf6a1b16-6240-4aa5-bc4b-6221d3bdc557 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: edf8f5ea-58fd-4226-b75c-0138fbdd6ae4] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:46.297069 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bf6a1b16-6240-4aa5-bc4b-6221d3bdc557 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:46.298979 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bf6a1b16-6240-4aa5-bc4b-6221d3bdc557 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:46.299728 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bf6a1b16-6240-4aa5-bc4b-6221d3bdc557 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:46.301236 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bf6a1b16-6240-4aa5-bc4b-6221d3bdc557 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:46.311650 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bf6a1b16-6240-4aa5-bc4b-6221d3bdc557 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:46.312482 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bf6a1b16-6240-4aa5-bc4b-6221d3bdc557 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:46.452611 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b7aac001-1cd8-45c8-a764-81d9ff46bb89 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:46.458417 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b7aac001-1cd8-45c8-a764-81d9ff46bb89 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] [instance: 9c6be996-7886-41c6-9c0c-e0f899836cb0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:46.467352 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b7aac001-1cd8-45c8-a764-81d9ff46bb89 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:46.467981 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b7aac001-1cd8-45c8-a764-81d9ff46bb89 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:46.468669 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b7aac001-1cd8-45c8-a764-81d9ff46bb89 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:46.469677 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b7aac001-1cd8-45c8-a764-81d9ff46bb89 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:46.470557 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b7aac001-1cd8-45c8-a764-81d9ff46bb89 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:46.471212 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b7aac001-1cd8-45c8-a764-81d9ff46bb89 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:46.515269 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b7aac001-1cd8-45c8-a764-81d9ff46bb89 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:46.515269 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b7aac001-1cd8-45c8-a764-81d9ff46bb89 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:46.515269 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b7aac001-1cd8-45c8-a764-81d9ff46bb89 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:46.515269 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-b7aac001-1cd8-45c8-a764-81d9ff46bb89 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lazy-loading 'fault' on Instance uuid 9c6be996-7886-41c6-9c0c-e0f899836cb0 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:26:46.661499 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b7aac001-1cd8-45c8-a764-81d9ff46bb89 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e50d6775ec4d2e96ab6e839b4631f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310172f2dfaf4ddcb5eace8a13939cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:46.678414 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b7aac001-1cd8-45c8-a764-81d9ff46bb89 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6be996-7886-41c6-9c0c-e0f899836cb0" status: 200 len: 1307 microversion: 2.1 time: 0.230193 Oct 30 01:26:46.684395 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1526/3073] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:46 2022] GET /compute/v2.1/servers/9c6be996-7886-41c6-9c0c-e0f899836cb0 => generated 1307 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:26:46.692842 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-86669286-fa3d-4ddc-983d-56d69429f05b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:46.693870 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-86669286-fa3d-4ddc-983d-56d69429f05b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: b4259dcb-d421-45fb-84e6-7e8a8f7ce20d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:46.701579 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:26:46.707575 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-86669286-fa3d-4ddc-983d-56d69429f05b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:46.716229 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-86669286-fa3d-4ddc-983d-56d69429f05b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:46.716973 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-86669286-fa3d-4ddc-983d-56d69429f05b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:46.718774 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-86669286-fa3d-4ddc-983d-56d69429f05b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:46.719605 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-86669286-fa3d-4ddc-983d-56d69429f05b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:46.720236 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-86669286-fa3d-4ddc-983d-56d69429f05b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:46.797053 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bf6a1b16-6240-4aa5-bc4b-6221d3bdc557 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07f2b8c31f54c62aaba73ca2bd2edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c59bd73c7874a00b52ec7c5c4142039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:46.806648 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bf6a1b16-6240-4aa5-bc4b-6221d3bdc557 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] 10.222.0.13 "GET /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4" status: 200 len: 1334 microversion: 2.1 time: 0.526007 Oct 30 01:26:46.807539 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1548/3074] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:46 2022] GET /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4 => generated 1334 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:47.033075 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a0eb911d-b5bd-49a4-904f-6e068a901fe4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:47.034118 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a0eb911d-b5bd-49a4-904f-6e068a901fe4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] [instance: f08028cf-a9fa-4b2c-9796-0e5a8c172ab5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:47.055442 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a0eb911d-b5bd-49a4-904f-6e068a901fe4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:47.057863 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a0eb911d-b5bd-49a4-904f-6e068a901fe4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:47.062127 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a0eb911d-b5bd-49a4-904f-6e068a901fe4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:47.062908 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a0eb911d-b5bd-49a4-904f-6e068a901fe4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:47.063388 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a0eb911d-b5bd-49a4-904f-6e068a901fe4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:47.063820 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a0eb911d-b5bd-49a4-904f-6e068a901fe4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:47.480307 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-86669286-fa3d-4ddc-983d-56d69429f05b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:47.493884 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-86669286-fa3d-4ddc-983d-56d69429f05b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/b4259dcb-d421-45fb-84e6-7e8a8f7ce20d" status: 200 len: 1307 microversion: 2.1 time: 0.813141 Oct 30 01:26:47.497816 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1527/3075] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:46 2022] GET /compute/v2.1/servers/b4259dcb-d421-45fb-84e6-7e8a8f7ce20d => generated 1307 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:47.503658 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6cf24208-ab77-4ecf-8508-b6ddbbb7074a tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:47.504399 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6cf24208-ab77-4ecf-8508-b6ddbbb7074a tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] [instance: 8f8815cb-4215-486d-9d40-fe6ffa145ddc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:47.513693 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6cf24208-ab77-4ecf-8508-b6ddbbb7074a tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:47.514487 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6cf24208-ab77-4ecf-8508-b6ddbbb7074a tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:47.514932 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6cf24208-ab77-4ecf-8508-b6ddbbb7074a tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:47.515897 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6cf24208-ab77-4ecf-8508-b6ddbbb7074a tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:47.517100 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6cf24208-ab77-4ecf-8508-b6ddbbb7074a tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:47.517740 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6cf24208-ab77-4ecf-8508-b6ddbbb7074a tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:47.526336 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a0eb911d-b5bd-49a4-904f-6e068a901fe4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:47.532525 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a0eb911d-b5bd-49a4-904f-6e068a901fe4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:47.534748 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a0eb911d-b5bd-49a4-904f-6e068a901fe4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:47.536318 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a0eb911d-b5bd-49a4-904f-6e068a901fe4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] 10.222.0.13 "GET /compute/v2.1/servers/f08028cf-a9fa-4b2c-9796-0e5a8c172ab5" status: 200 len: 1365 microversion: 2.47 time: 0.511127 Oct 30 01:26:47.538613 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1549/3076] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:26:47 2022] GET /compute/v2.1/servers/f08028cf-a9fa-4b2c-9796-0e5a8c172ab5 => generated 1365 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:26:47.565775 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-4b3cfe68-85b8-470b-a5b2-b18d090de268 req-f874717e-72b7-40cf-b0a5-6f2d83e8d252 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edf8f5ea-58fd-4226-b75c-0138fbdd6ae4", "tag": "c3b52eab-87c2-44f0-b9ce-f134032c1805"}, {"name": "network-changed", "server_uuid": "8f8815cb-4215-486d-9d40-fe6ffa145ddc", "tag": "5dcc8624-9db1-43e0-b44e-fb28989d9e39"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:26:47.581319 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-4b3cfe68-85b8-470b-a5b2-b18d090de268 req-f874717e-72b7-40cf-b0a5-6f2d83e8d252 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:47.583884 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-4b3cfe68-85b8-470b-a5b2-b18d090de268 req-f874717e-72b7-40cf-b0a5-6f2d83e8d252 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:47.583884 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-4b3cfe68-85b8-470b-a5b2-b18d090de268 req-f874717e-72b7-40cf-b0a5-6f2d83e8d252 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:47.609208 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-4b3cfe68-85b8-470b-a5b2-b18d090de268 req-f874717e-72b7-40cf-b0a5-6f2d83e8d252 service nova] Creating event network-changed:c3b52eab-87c2-44f0-b9ce-f134032c1805 for instance edf8f5ea-58fd-4226-b75c-0138fbdd6ae4 on n-h2-master-1 Oct 30 01:26:47.610065 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-4b3cfe68-85b8-470b-a5b2-b18d090de268 req-f874717e-72b7-40cf-b0a5-6f2d83e8d252 service nova] Creating event network-changed:5dcc8624-9db1-43e0-b44e-fb28989d9e39 for instance 8f8815cb-4215-486d-9d40-fe6ffa145ddc on n-h2-master-1 Oct 30 01:26:47.639344 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-4b3cfe68-85b8-470b-a5b2-b18d090de268 req-f874717e-72b7-40cf-b0a5-6f2d83e8d252 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.075724 Oct 30 01:26:47.641447 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1550/3077] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:26:47 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:26:47.705583 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-20a502e9-ff00-4b3b-90de-b273f29eadc4 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:47.707256 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-20a502e9-ff00-4b3b-90de-b273f29eadc4 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] [instance: 9c6be996-7886-41c6-9c0c-e0f899836cb0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:47.723538 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-20a502e9-ff00-4b3b-90de-b273f29eadc4 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:47.724559 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-20a502e9-ff00-4b3b-90de-b273f29eadc4 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:47.725179 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-20a502e9-ff00-4b3b-90de-b273f29eadc4 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:47.729012 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-20a502e9-ff00-4b3b-90de-b273f29eadc4 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:47.736982 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-20a502e9-ff00-4b3b-90de-b273f29eadc4 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:47.738245 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-20a502e9-ff00-4b3b-90de-b273f29eadc4 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:47.809944 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-20a502e9-ff00-4b3b-90de-b273f29eadc4 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:47.813264 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-20a502e9-ff00-4b3b-90de-b273f29eadc4 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:47.817300 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-20a502e9-ff00-4b3b-90de-b273f29eadc4 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:47.818548 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-20a502e9-ff00-4b3b-90de-b273f29eadc4 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lazy-loading 'fault' on Instance uuid 9c6be996-7886-41c6-9c0c-e0f899836cb0 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:26:47.913966 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-20a502e9-ff00-4b3b-90de-b273f29eadc4 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e50d6775ec4d2e96ab6e839b4631f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310172f2dfaf4ddcb5eace8a13939cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:47.922831 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-20a502e9-ff00-4b3b-90de-b273f29eadc4 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6be996-7886-41c6-9c0c-e0f899836cb0" status: 200 len: 1307 microversion: 2.1 time: 0.223462 Oct 30 01:26:47.924320 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1551/3078] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:47 2022] GET /compute/v2.1/servers/9c6be996-7886-41c6-9c0c-e0f899836cb0 => generated 1307 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:26:47.932924 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0884c7bf-4b1a-4ec4-8f97-2a53efa55cc8 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:47.933878 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0884c7bf-4b1a-4ec4-8f97-2a53efa55cc8 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: edf8f5ea-58fd-4226-b75c-0138fbdd6ae4] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:47.954241 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0884c7bf-4b1a-4ec4-8f97-2a53efa55cc8 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:47.955338 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0884c7bf-4b1a-4ec4-8f97-2a53efa55cc8 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:47.956482 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0884c7bf-4b1a-4ec4-8f97-2a53efa55cc8 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:47.957831 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0884c7bf-4b1a-4ec4-8f97-2a53efa55cc8 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:47.959287 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0884c7bf-4b1a-4ec4-8f97-2a53efa55cc8 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:47.959947 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0884c7bf-4b1a-4ec4-8f97-2a53efa55cc8 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:47.983700 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6cf24208-ab77-4ecf-8508-b6ddbbb7074a tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f79f3eab648939a30208fed465eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd28b9d6b7146f2b1c114607be83a48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:47.996590 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6cf24208-ab77-4ecf-8508-b6ddbbb7074a tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] 10.222.0.13 "GET /compute/v2.1/servers/8f8815cb-4215-486d-9d40-fe6ffa145ddc" status: 200 len: 1316 microversion: 2.1 time: 0.499745 Oct 30 01:26:47.997579 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1528/3079] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:47 2022] GET /compute/v2.1/servers/8f8815cb-4215-486d-9d40-fe6ffa145ddc => generated 1316 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:48.413979 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0884c7bf-4b1a-4ec4-8f97-2a53efa55cc8 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07f2b8c31f54c62aaba73ca2bd2edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c59bd73c7874a00b52ec7c5c4142039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:48.423997 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0884c7bf-4b1a-4ec4-8f97-2a53efa55cc8 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] 10.222.0.13 "GET /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4" status: 200 len: 1334 microversion: 2.1 time: 0.497985 Oct 30 01:26:48.440402 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1552/3080] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:47 2022] GET /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4 => generated 1334 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:48.518681 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8db0a51e-a7b1-478e-b40f-3fac00660e45 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:48.519347 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8db0a51e-a7b1-478e-b40f-3fac00660e45 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: b4259dcb-d421-45fb-84e6-7e8a8f7ce20d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:48.527633 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8db0a51e-a7b1-478e-b40f-3fac00660e45 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:48.528138 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8db0a51e-a7b1-478e-b40f-3fac00660e45 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:48.529163 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8db0a51e-a7b1-478e-b40f-3fac00660e45 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:48.529915 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8db0a51e-a7b1-478e-b40f-3fac00660e45 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:48.530379 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8db0a51e-a7b1-478e-b40f-3fac00660e45 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:48.530807 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8db0a51e-a7b1-478e-b40f-3fac00660e45 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:48.565231 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-290db449-fe84-4779-8f96-dd505300d57a tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:48.568153 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-290db449-fe84-4779-8f96-dd505300d57a tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] [instance: f08028cf-a9fa-4b2c-9796-0e5a8c172ab5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:48.575313 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-290db449-fe84-4779-8f96-dd505300d57a tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:48.576007 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-290db449-fe84-4779-8f96-dd505300d57a tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:48.576843 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-290db449-fe84-4779-8f96-dd505300d57a tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:48.577838 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-290db449-fe84-4779-8f96-dd505300d57a tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:48.578643 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-290db449-fe84-4779-8f96-dd505300d57a tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:48.579155 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-290db449-fe84-4779-8f96-dd505300d57a tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:48.770167 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-290db449-fe84-4779-8f96-dd505300d57a tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:48.788439 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-290db449-fe84-4779-8f96-dd505300d57a tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:48.791539 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-290db449-fe84-4779-8f96-dd505300d57a tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:48.796097 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-290db449-fe84-4779-8f96-dd505300d57a tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] 10.222.0.13 "GET /compute/v2.1/servers/f08028cf-a9fa-4b2c-9796-0e5a8c172ab5" status: 200 len: 1365 microversion: 2.47 time: 0.234538 Oct 30 01:26:48.798534 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1553/3081] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:26:48 2022] GET /compute/v2.1/servers/f08028cf-a9fa-4b2c-9796-0e5a8c172ab5 => generated 1365 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:26:48.954410 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4e05d466-bbac-4aaa-925f-bd3a7e0956a6 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:48.956488 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4e05d466-bbac-4aaa-925f-bd3a7e0956a6 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] [instance: 9c6be996-7886-41c6-9c0c-e0f899836cb0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:48.968166 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4e05d466-bbac-4aaa-925f-bd3a7e0956a6 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:48.968894 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4e05d466-bbac-4aaa-925f-bd3a7e0956a6 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:48.969452 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4e05d466-bbac-4aaa-925f-bd3a7e0956a6 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:48.969573 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8db0a51e-a7b1-478e-b40f-3fac00660e45 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:48.970534 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4e05d466-bbac-4aaa-925f-bd3a7e0956a6 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:48.971203 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4e05d466-bbac-4aaa-925f-bd3a7e0956a6 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:48.972007 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4e05d466-bbac-4aaa-925f-bd3a7e0956a6 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:48.982563 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8db0a51e-a7b1-478e-b40f-3fac00660e45 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/b4259dcb-d421-45fb-84e6-7e8a8f7ce20d" status: 200 len: 1307 microversion: 2.1 time: 0.467885 Oct 30 01:26:48.985376 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1529/3082] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:48 2022] GET /compute/v2.1/servers/b4259dcb-d421-45fb-84e6-7e8a8f7ce20d => generated 1307 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:48.995015 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-4e05d466-bbac-4aaa-925f-bd3a7e0956a6 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] HTTP exception thrown: Instance 9c6be996-7886-41c6-9c0c-e0f899836cb0 could not be found. Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4e05d466-bbac-4aaa-925f-bd3a7e0956a6 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Request method failure captured: Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/9c6be996-7886-41c6-9c0c-e0f899836cb0 HTTP/1.1 Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdJm3MQlkCb2VHBGOXohP-uIJdzdhji0-kQQ_uMEBkEzH-iKU7kbwbigPRSsXrH9qWPsLwUqbYabIAQ2oRSzX8g-qsu0Xwv5d9nFHxtUFsgJa8O4N6kz8wyNXDinDWG_Fzaf3mA1yILM4EG-7OdjblFzj6JU4plfEiAhh_5BkYAtnM8 Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 310172f2dfaf4ddcb5eace8a13939cda Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ImagesOneServerTestJSON-1108348315 Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/310172f2dfaf4ddcb5eace8a13939cda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_310172f2dfaf4ddcb5eace8a13939cda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/310172f2dfaf4ddcb5eace8a13939cda"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/310172f2dfaf4ddcb5eace8a13939cda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ImagesOneServerTestJSON-1108348315 Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 310172f2dfaf4ddcb5eace8a13939cda Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1108348315 Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ImagesOneServerTestJSON-1108348315-project Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: e1e50d6775ec4d2e96ab6e839b4631f1 Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ImagesOneServerTestJSON-1108348315-project Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 9c6be996-7886-41c6-9c0c-e0f899836cb0 could not be found. Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '9c6be996-7886-41c6-9c0c-e0f899836cb0'} Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c6be996-7886-41c6-9c0c-e0f899836cb0 could not be found. Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c6be996-7886-41c6-9c0c-e0f899836cb0 could not be found. Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:26:48.997599 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:26:49.005972 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:26:49.005972 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:26:49.005972 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:26:49.005972 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:26:49.005972 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:26:49.005972 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c6be996-7886-41c6-9c0c-e0f899836cb0 could not be found. Oct 30 01:26:49.005972 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:26:49.005972 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4e05d466-bbac-4aaa-925f-bd3a7e0956a6 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] Returning 404 to user: Instance 9c6be996-7886-41c6-9c0c-e0f899836cb0 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:26:49.005972 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4e05d466-bbac-4aaa-925f-bd3a7e0956a6 tempest-ImagesOneServerTestJSON-1108348315 tempest-ImagesOneServerTestJSON-1108348315-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6be996-7886-41c6-9c0c-e0f899836cb0" status: 404 len: 111 microversion: 2.1 time: 0.053189 Oct 30 01:26:49.005972 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1554/3083] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:48 2022] GET /compute/v2.1/servers/9c6be996-7886-41c6-9c0c-e0f899836cb0 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 01:26:49.029974 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9d2652fd-b5f5-4ec7-9275-15298140e501 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:49.029974 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9d2652fd-b5f5-4ec7-9275-15298140e501 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] [instance: 8f8815cb-4215-486d-9d40-fe6ffa145ddc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:49.051574 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9d2652fd-b5f5-4ec7-9275-15298140e501 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:49.052751 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9d2652fd-b5f5-4ec7-9275-15298140e501 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:49.052751 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9d2652fd-b5f5-4ec7-9275-15298140e501 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:49.053326 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9d2652fd-b5f5-4ec7-9275-15298140e501 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:49.053795 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9d2652fd-b5f5-4ec7-9275-15298140e501 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:49.054228 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9d2652fd-b5f5-4ec7-9275-15298140e501 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:49.116267 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=100 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:26:49.448314 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-17aa0ec9-a196-4030-b566-e82fdcb6ebcd tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:49.449026 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-17aa0ec9-a196-4030-b566-e82fdcb6ebcd tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: edf8f5ea-58fd-4226-b75c-0138fbdd6ae4] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:49.459160 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-17aa0ec9-a196-4030-b566-e82fdcb6ebcd tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:49.461897 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-17aa0ec9-a196-4030-b566-e82fdcb6ebcd tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:49.462349 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-17aa0ec9-a196-4030-b566-e82fdcb6ebcd tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:49.463096 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-17aa0ec9-a196-4030-b566-e82fdcb6ebcd tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:49.463550 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-17aa0ec9-a196-4030-b566-e82fdcb6ebcd tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:49.463985 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-17aa0ec9-a196-4030-b566-e82fdcb6ebcd tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:49.648030 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9d2652fd-b5f5-4ec7-9275-15298140e501 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f79f3eab648939a30208fed465eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd28b9d6b7146f2b1c114607be83a48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:49.662960 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9d2652fd-b5f5-4ec7-9275-15298140e501 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] 10.222.0.13 "GET /compute/v2.1/servers/8f8815cb-4215-486d-9d40-fe6ffa145ddc" status: 200 len: 1316 microversion: 2.1 time: 0.640013 Oct 30 01:26:49.664697 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1530/3084] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:49 2022] GET /compute/v2.1/servers/8f8815cb-4215-486d-9d40-fe6ffa145ddc => generated 1316 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:49.752309 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-aceede60-7018-4852-8f04-ea20b9a18cde req-2095ce94-a2ac-415a-975e-af3ae5a7cbbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4259dcb-d421-45fb-84e6-7e8a8f7ce20d", "tag": "f4115819-6c96-4bc9-a7c1-221d92ea37ec"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:26:49.782999 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-aceede60-7018-4852-8f04-ea20b9a18cde req-2095ce94-a2ac-415a-975e-af3ae5a7cbbf service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:49.784052 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-aceede60-7018-4852-8f04-ea20b9a18cde req-2095ce94-a2ac-415a-975e-af3ae5a7cbbf service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:49.784672 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-aceede60-7018-4852-8f04-ea20b9a18cde req-2095ce94-a2ac-415a-975e-af3ae5a7cbbf service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:49.834535 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-aceede60-7018-4852-8f04-ea20b9a18cde req-2095ce94-a2ac-415a-975e-af3ae5a7cbbf service nova] Creating event network-changed:f4115819-6c96-4bc9-a7c1-221d92ea37ec for instance b4259dcb-d421-45fb-84e6-7e8a8f7ce20d on n-h1-master-1 Oct 30 01:26:49.848672 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-aceede60-7018-4852-8f04-ea20b9a18cde req-2095ce94-a2ac-415a-975e-af3ae5a7cbbf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102078 Oct 30 01:26:49.848672 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1531/3085] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:26:49.863943 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-8bd08026-ca14-40ea-8c61-8d82acf56397 req-4034aac7-141d-4b29-b4a8-d4d23278ba2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edf8f5ea-58fd-4226-b75c-0138fbdd6ae4", "tag": "e018e410-e769-4fd0-bbc8-a179d701cfc4"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:26:49.889592 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-8bd08026-ca14-40ea-8c61-8d82acf56397 req-4034aac7-141d-4b29-b4a8-d4d23278ba2d service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:49.890087 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-8bd08026-ca14-40ea-8c61-8d82acf56397 req-4034aac7-141d-4b29-b4a8-d4d23278ba2d service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:49.890527 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-8bd08026-ca14-40ea-8c61-8d82acf56397 req-4034aac7-141d-4b29-b4a8-d4d23278ba2d service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:49.923909 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-8bd08026-ca14-40ea-8c61-8d82acf56397 req-4034aac7-141d-4b29-b4a8-d4d23278ba2d service nova] Creating event network-changed:e018e410-e769-4fd0-bbc8-a179d701cfc4 for instance edf8f5ea-58fd-4226-b75c-0138fbdd6ae4 on n-h2-master-1 Oct 30 01:26:49.929709 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-8bd08026-ca14-40ea-8c61-8d82acf56397 req-4034aac7-141d-4b29-b4a8-d4d23278ba2d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081297 Oct 30 01:26:49.930333 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1532/3086] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:26:49.947522 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2b74790f-5fde-46a6-8160-26ebfdbc11a4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:49.955371 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2b74790f-5fde-46a6-8160-26ebfdbc11a4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] [instance: f08028cf-a9fa-4b2c-9796-0e5a8c172ab5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:49.978440 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2b74790f-5fde-46a6-8160-26ebfdbc11a4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:49.979713 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2b74790f-5fde-46a6-8160-26ebfdbc11a4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:49.982936 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2b74790f-5fde-46a6-8160-26ebfdbc11a4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:49.986095 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2b74790f-5fde-46a6-8160-26ebfdbc11a4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:49.986095 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2b74790f-5fde-46a6-8160-26ebfdbc11a4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:49.986095 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2b74790f-5fde-46a6-8160-26ebfdbc11a4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:50.172061 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-17aa0ec9-a196-4030-b566-e82fdcb6ebcd tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07f2b8c31f54c62aaba73ca2bd2edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c59bd73c7874a00b52ec7c5c4142039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:50.217672 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-17aa0ec9-a196-4030-b566-e82fdcb6ebcd tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] 10.222.0.13 "GET /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4" status: 200 len: 1334 microversion: 2.1 time: 0.753745 Oct 30 01:26:50.217672 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1555/3087] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:49 2022] GET /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4 => generated 1334 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:50.238763 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ea724dca-94bb-4dbf-9ac6-3f6452919c54 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:50.245276 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ea724dca-94bb-4dbf-9ac6-3f6452919c54 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: b4259dcb-d421-45fb-84e6-7e8a8f7ce20d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:50.258363 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea724dca-94bb-4dbf-9ac6-3f6452919c54 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:50.259434 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea724dca-94bb-4dbf-9ac6-3f6452919c54 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:50.260310 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea724dca-94bb-4dbf-9ac6-3f6452919c54 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:50.262671 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea724dca-94bb-4dbf-9ac6-3f6452919c54 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:50.265070 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea724dca-94bb-4dbf-9ac6-3f6452919c54 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:50.268501 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea724dca-94bb-4dbf-9ac6-3f6452919c54 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:50.329166 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2b74790f-5fde-46a6-8160-26ebfdbc11a4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:50.337147 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2b74790f-5fde-46a6-8160-26ebfdbc11a4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:50.352087 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2b74790f-5fde-46a6-8160-26ebfdbc11a4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:50.356821 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2b74790f-5fde-46a6-8160-26ebfdbc11a4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] 10.222.0.13 "GET /compute/v2.1/servers/f08028cf-a9fa-4b2c-9796-0e5a8c172ab5" status: 200 len: 1365 microversion: 2.47 time: 0.417800 Oct 30 01:26:50.360140 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1533/3088] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:26:49 2022] GET /compute/v2.1/servers/f08028cf-a9fa-4b2c-9796-0e5a8c172ab5 => generated 1365 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:26:50.461606 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=4 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:26:50.524590 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=16 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:26:50.686754 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9e4b2ba1-68ff-44ae-adb7-7c8e50a3bff4 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:50.687291 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9e4b2ba1-68ff-44ae-adb7-7c8e50a3bff4 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] [instance: 8f8815cb-4215-486d-9d40-fe6ffa145ddc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:50.708092 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e4b2ba1-68ff-44ae-adb7-7c8e50a3bff4 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:50.708603 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e4b2ba1-68ff-44ae-adb7-7c8e50a3bff4 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:50.709043 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e4b2ba1-68ff-44ae-adb7-7c8e50a3bff4 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:50.709864 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e4b2ba1-68ff-44ae-adb7-7c8e50a3bff4 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:50.710327 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e4b2ba1-68ff-44ae-adb7-7c8e50a3bff4 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:50.710760 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e4b2ba1-68ff-44ae-adb7-7c8e50a3bff4 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:50.900969 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ea724dca-94bb-4dbf-9ac6-3f6452919c54 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:50.909108 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ea724dca-94bb-4dbf-9ac6-3f6452919c54 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/b4259dcb-d421-45fb-84e6-7e8a8f7ce20d" status: 200 len: 1307 microversion: 2.1 time: 0.678873 Oct 30 01:26:50.910348 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1556/3089] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:50 2022] GET /compute/v2.1/servers/b4259dcb-d421-45fb-84e6-7e8a8f7ce20d => generated 1307 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:51.108781 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9e4b2ba1-68ff-44ae-adb7-7c8e50a3bff4 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f79f3eab648939a30208fed465eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd28b9d6b7146f2b1c114607be83a48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:51.121366 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9e4b2ba1-68ff-44ae-adb7-7c8e50a3bff4 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] 10.222.0.13 "GET /compute/v2.1/servers/8f8815cb-4215-486d-9d40-fe6ffa145ddc" status: 200 len: 1316 microversion: 2.1 time: 0.434787 Oct 30 01:26:51.122034 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1534/3090] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:50 2022] GET /compute/v2.1/servers/8f8815cb-4215-486d-9d40-fe6ffa145ddc => generated 1316 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:51.235765 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e138d2d5-3511-4e36-bb76-3d588a36972d tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:51.236386 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e138d2d5-3511-4e36-bb76-3d588a36972d tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: edf8f5ea-58fd-4226-b75c-0138fbdd6ae4] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:51.255440 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e138d2d5-3511-4e36-bb76-3d588a36972d tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:51.256303 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e138d2d5-3511-4e36-bb76-3d588a36972d tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:51.260369 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e138d2d5-3511-4e36-bb76-3d588a36972d tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:51.268145 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e138d2d5-3511-4e36-bb76-3d588a36972d tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:51.269166 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e138d2d5-3511-4e36-bb76-3d588a36972d tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:51.270351 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e138d2d5-3511-4e36-bb76-3d588a36972d tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:51.388406 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cfafe9ed-f2c5-4f0f-a0a9-f911ad4b32cd tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:51.390227 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-cfafe9ed-f2c5-4f0f-a0a9-f911ad4b32cd tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] [instance: f08028cf-a9fa-4b2c-9796-0e5a8c172ab5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:51.395016 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=8 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:26:51.406420 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cfafe9ed-f2c5-4f0f-a0a9-f911ad4b32cd tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:51.414514 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cfafe9ed-f2c5-4f0f-a0a9-f911ad4b32cd tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:51.415253 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cfafe9ed-f2c5-4f0f-a0a9-f911ad4b32cd tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:51.416181 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cfafe9ed-f2c5-4f0f-a0a9-f911ad4b32cd tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:51.416829 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cfafe9ed-f2c5-4f0f-a0a9-f911ad4b32cd tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:51.417446 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cfafe9ed-f2c5-4f0f-a0a9-f911ad4b32cd tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:51.889374 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-cfafe9ed-f2c5-4f0f-a0a9-f911ad4b32cd tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:51.899519 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-cfafe9ed-f2c5-4f0f-a0a9-f911ad4b32cd tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:51.900993 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-cfafe9ed-f2c5-4f0f-a0a9-f911ad4b32cd tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:51.910888 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cfafe9ed-f2c5-4f0f-a0a9-f911ad4b32cd tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] 10.222.0.13 "GET /compute/v2.1/servers/f08028cf-a9fa-4b2c-9796-0e5a8c172ab5" status: 200 len: 1365 microversion: 2.47 time: 0.526499 Oct 30 01:26:51.928834 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1535/3091] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:26:51 2022] GET /compute/v2.1/servers/f08028cf-a9fa-4b2c-9796-0e5a8c172ab5 => generated 1365 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:26:51.937414 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0c1f5b5b-aa73-4ab4-99c5-f27cf9c011b1 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:51.938038 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0c1f5b5b-aa73-4ab4-99c5-f27cf9c011b1 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: b4259dcb-d421-45fb-84e6-7e8a8f7ce20d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:51.960032 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c1f5b5b-aa73-4ab4-99c5-f27cf9c011b1 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:51.960912 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c1f5b5b-aa73-4ab4-99c5-f27cf9c011b1 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:51.961615 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c1f5b5b-aa73-4ab4-99c5-f27cf9c011b1 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:51.965558 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c1f5b5b-aa73-4ab4-99c5-f27cf9c011b1 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:51.966090 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c1f5b5b-aa73-4ab4-99c5-f27cf9c011b1 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:51.967136 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c1f5b5b-aa73-4ab4-99c5-f27cf9c011b1 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:52.133197 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e138d2d5-3511-4e36-bb76-3d588a36972d tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07f2b8c31f54c62aaba73ca2bd2edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c59bd73c7874a00b52ec7c5c4142039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:52.144407 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e138d2d5-3511-4e36-bb76-3d588a36972d tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] 10.222.0.13 "GET /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4" status: 200 len: 1334 microversion: 2.1 time: 0.912853 Oct 30 01:26:52.161411 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1557/3092] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:51 2022] GET /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4 => generated 1334 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:52.166487 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9284a704-27d1-4226-8a5f-5491368b44c1 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:52.172637 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9284a704-27d1-4226-8a5f-5491368b44c1 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] [instance: 8f8815cb-4215-486d-9d40-fe6ffa145ddc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:52.190430 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9284a704-27d1-4226-8a5f-5491368b44c1 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:52.191809 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9284a704-27d1-4226-8a5f-5491368b44c1 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:52.192422 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9284a704-27d1-4226-8a5f-5491368b44c1 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:52.193311 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9284a704-27d1-4226-8a5f-5491368b44c1 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:52.193945 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9284a704-27d1-4226-8a5f-5491368b44c1 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:52.194529 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9284a704-27d1-4226-8a5f-5491368b44c1 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:52.740462 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0c1f5b5b-aa73-4ab4-99c5-f27cf9c011b1 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:52.755502 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0c1f5b5b-aa73-4ab4-99c5-f27cf9c011b1 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/b4259dcb-d421-45fb-84e6-7e8a8f7ce20d" status: 200 len: 1307 microversion: 2.1 time: 0.821923 Oct 30 01:26:52.757282 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1536/3093] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:51 2022] GET /compute/v2.1/servers/b4259dcb-d421-45fb-84e6-7e8a8f7ce20d => generated 1307 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:52.960927 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-911865bb-a189-482c-aa21-b50fcc3be19d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:52.961951 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-911865bb-a189-482c-aa21-b50fcc3be19d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] [instance: f08028cf-a9fa-4b2c-9796-0e5a8c172ab5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:52.971089 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-911865bb-a189-482c-aa21-b50fcc3be19d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:52.975064 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-911865bb-a189-482c-aa21-b50fcc3be19d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:52.979154 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-911865bb-a189-482c-aa21-b50fcc3be19d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:52.980356 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-911865bb-a189-482c-aa21-b50fcc3be19d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:52.980996 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-911865bb-a189-482c-aa21-b50fcc3be19d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:52.982575 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-911865bb-a189-482c-aa21-b50fcc3be19d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:53.439720 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9284a704-27d1-4226-8a5f-5491368b44c1 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f79f3eab648939a30208fed465eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd28b9d6b7146f2b1c114607be83a48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:53.463063 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-911865bb-a189-482c-aa21-b50fcc3be19d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:53.480861 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-911865bb-a189-482c-aa21-b50fcc3be19d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:53.482008 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9284a704-27d1-4226-8a5f-5491368b44c1 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] 10.222.0.13 "GET /compute/v2.1/servers/8f8815cb-4215-486d-9d40-fe6ffa145ddc" status: 200 len: 1316 microversion: 2.1 time: 1.319345 Oct 30 01:26:53.485244 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-911865bb-a189-482c-aa21-b50fcc3be19d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:53.485660 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1558/3094] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:52 2022] GET /compute/v2.1/servers/8f8815cb-4215-486d-9d40-fe6ffa145ddc => generated 1316 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:53.492829 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-911865bb-a189-482c-aa21-b50fcc3be19d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] 10.222.0.13 "GET /compute/v2.1/servers/f08028cf-a9fa-4b2c-9796-0e5a8c172ab5" status: 200 len: 1365 microversion: 2.47 time: 0.539692 Oct 30 01:26:53.495913 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1537/3095] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:26:52 2022] GET /compute/v2.1/servers/f08028cf-a9fa-4b2c-9796-0e5a8c172ab5 => generated 1365 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:26:53.503179 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-102dd518-0dc6-47b8-8e91-ddfbd48ca5ab tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:53.504056 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-102dd518-0dc6-47b8-8e91-ddfbd48ca5ab tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: edf8f5ea-58fd-4226-b75c-0138fbdd6ae4] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:53.515669 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-102dd518-0dc6-47b8-8e91-ddfbd48ca5ab tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:53.517480 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-102dd518-0dc6-47b8-8e91-ddfbd48ca5ab tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:53.518188 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-102dd518-0dc6-47b8-8e91-ddfbd48ca5ab tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:53.520091 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-102dd518-0dc6-47b8-8e91-ddfbd48ca5ab tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:53.520796 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-102dd518-0dc6-47b8-8e91-ddfbd48ca5ab tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:53.521613 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-102dd518-0dc6-47b8-8e91-ddfbd48ca5ab tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:53.528544 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:26:53.783980 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7f2f537f-73a5-4163-9fcd-4c2cb12b541a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:53.784609 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7f2f537f-73a5-4163-9fcd-4c2cb12b541a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: b4259dcb-d421-45fb-84e6-7e8a8f7ce20d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:53.802102 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7f2f537f-73a5-4163-9fcd-4c2cb12b541a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:53.802684 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7f2f537f-73a5-4163-9fcd-4c2cb12b541a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:53.803903 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7f2f537f-73a5-4163-9fcd-4c2cb12b541a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:53.805377 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7f2f537f-73a5-4163-9fcd-4c2cb12b541a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:53.806574 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7f2f537f-73a5-4163-9fcd-4c2cb12b541a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:53.809829 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7f2f537f-73a5-4163-9fcd-4c2cb12b541a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:53.886465 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-102dd518-0dc6-47b8-8e91-ddfbd48ca5ab tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07f2b8c31f54c62aaba73ca2bd2edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c59bd73c7874a00b52ec7c5c4142039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:53.904862 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-102dd518-0dc6-47b8-8e91-ddfbd48ca5ab tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] 10.222.0.13 "GET /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4" status: 200 len: 1334 microversion: 2.1 time: 0.417221 Oct 30 01:26:53.905797 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1559/3096] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:53 2022] GET /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4 => generated 1334 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:54.134564 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7f2f537f-73a5-4163-9fcd-4c2cb12b541a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:54.146257 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7f2f537f-73a5-4163-9fcd-4c2cb12b541a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/b4259dcb-d421-45fb-84e6-7e8a8f7ce20d" status: 200 len: 1307 microversion: 2.1 time: 0.367919 Oct 30 01:26:54.150316 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1538/3097] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:53 2022] GET /compute/v2.1/servers/b4259dcb-d421-45fb-84e6-7e8a8f7ce20d => generated 1307 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:26:54.174797 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-706143d4-40b1-4711-aafc-a236fea8a68c tempest-KeyPairsNegativeTestJSON-1810030293 tempest-KeyPairsNegativeTestJSON-1810030293-project] Action: 'create', calling method: .version_select at 0x7f44d04d0310>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLurmFtn7OIVDNCcFqPSeHE3ED+cbNbjJSZdCMBtBy4g6GexfE00ZHJusr2IoEqKKTUeQBQQc0m06eVmjHGzu5LbjVxTUJMyNCR3gWe4zOOmi+MPcdtEb0qlEVmVrqcMRA=="}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-706143d4-40b1-4711-aafc-a236fea8a68c tempest-KeyPairsNegativeTestJSON-1810030293 tempest-KeyPairsNegativeTestJSON-1810030293-project] Request method failure captured: Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 257 Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdLd1PTDq7b_a57I-EanbLlSAS5BQbtJlSMuPYaIPu7iHD6P_17x8CmoVQyRaVRGupGgAwpg6ykz4iV4gWL-Fjk6Rvk5hbw37WfDkHIYDoEcSyWq94wYs6VkQsz3l2o0ASLdNsgR9kbxGRo58s-1X-xtPl8yONmNvqoSzCwKsYAbDBA Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 2fbfd293526648e7b758875e9465fdfb Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1810030293 Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2fbfd293526648e7b758875e9465fdfb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2fbfd293526648e7b758875e9465fdfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2fbfd293526648e7b758875e9465fdfb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2fbfd293526648e7b758875e9465fdfb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1810030293 Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 2fbfd293526648e7b758875e9465fdfb Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1810030293 Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-KeyPairsNegativeTestJSON-1810030293-project Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: a3bf509a0d7a4c098a31777eaa72b8ef Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1810030293-project Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLurmFtn7OIVDNCcFqPSeHE3ED+cbNbjJSZdCMBtBy4g6GexfE00ZHJusr2IoEqKKTUeQBQQc0m06eVmjHGzu5LbjVxTUJMyNCR3gWe4zOOmi+MPcdtEb0qlEVmVrqcMRA=="}} Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: method: Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLurmFtn7OIVDNCcFqPSeHE3ED+cbNbjJSZdCMBtBy4g6GexfE00ZHJusr2IoEqKKTUeQBQQc0m06eVmjHGzu5LbjVxTUJMyNCR3gWe4zOOmi+MPcdtEb0qlEVmVrqcMRA=='}}} Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise error Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 30 01:26:54.180587 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:26:54.185008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:26:54.185008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:26:54.185008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:26:54.185008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:26:54.185008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:26:54.185008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:26:54.185008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:26:54.185008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:26:54.185008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:26:54.185008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:26:54.185008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:26:54.185008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:26:54.185008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:26:54.185008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 30 01:26:54.185008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 30 01:26:54.185008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 30 01:26:54.185008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 30 01:26:54.185008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 30 01:26:54.185008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 30 01:26:54.185008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 30 01:26:54.185008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:26:54.185008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:26:54.185008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:26:54.185008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:26:54.185008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:26:54.185008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:26:54.185008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 30 01:26:54.185008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 30 01:26:54.185008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 30 01:26:54.185008 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:26:54.190587 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-706143d4-40b1-4711-aafc-a236fea8a68c tempest-KeyPairsNegativeTestJSON-1810030293 tempest-KeyPairsNegativeTestJSON-1810030293-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:26:54.192341 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-706143d4-40b1-4711-aafc-a236fea8a68c tempest-KeyPairsNegativeTestJSON-1810030293 tempest-KeyPairsNegativeTestJSON-1810030293-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.213329 Oct 30 01:26:54.195659 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1560/3098] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 30 01:26:53 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 217 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 30 01:26:54.205794 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0cdc3039-ffb0-4a5d-b88e-629395db1ecd tempest-KeyPairsNegativeTestJSON-1810030293 tempest-KeyPairsNegativeTestJSON-1810030293-project] Action: 'create', calling method: .version_select at 0x7f44cc34ac10>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-978986369", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:26:54.227011 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-0cdc3039-ffb0-4a5d-b88e-629395db1ecd tempest-KeyPairsNegativeTestJSON-1810030293 tempest-KeyPairsNegativeTestJSON-1810030293-project] Getting quotas for project 2fbfd293526648e7b758875e9465fdfb. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:26:54.234020 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-0cdc3039-ffb0-4a5d-b88e-629395db1ecd tempest-KeyPairsNegativeTestJSON-1810030293 tempest-KeyPairsNegativeTestJSON-1810030293-project] Getting quotas for user a3bf509a0d7a4c098a31777eaa72b8ef and project 2fbfd293526648e7b758875e9465fdfb. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:26:54.262917 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-0cdc3039-ffb0-4a5d-b88e-629395db1ecd tempest-KeyPairsNegativeTestJSON-1810030293 tempest-KeyPairsNegativeTestJSON-1810030293-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 30 01:26:54.292001 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0cdc3039-ffb0-4a5d-b88e-629395db1ecd tempest-KeyPairsNegativeTestJSON-1810030293 tempest-KeyPairsNegativeTestJSON-1810030293-project] Request method failure captured: Oct 30 01:26:54.292001 n-d-master-1 devstack@n-api.service[121103]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 30 01:26:54.292001 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:26:54.292001 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:26:54.292001 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:26:54.292001 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 2166 Oct 30 01:26:54.292001 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:26:54.292001 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:26:54.292001 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:26:54.292001 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:26:54.292001 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdLd1PTDq7b_a57I-EanbLlSAS5BQbtJlSMuPYaIPu7iHD6P_17x8CmoVQyRaVRGupGgAwpg6ykz4iV4gWL-Fjk6Rvk5hbw37WfDkHIYDoEcSyWq94wYs6VkQsz3l2o0ASLdNsgR9kbxGRo58s-1X-xtPl8yONmNvqoSzCwKsYAbDBA Oct 30 01:26:54.292001 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:26:54.292001 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:26:54.292001 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:26:54.292001 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:26:54.292001 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:26:54.292001 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:26:54.292001 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 2fbfd293526648e7b758875e9465fdfb Oct 30 01:26:54.292001 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1810030293 Oct 30 01:26:54.292001 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:26:54.292001 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:26:54.292001 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2fbfd293526648e7b758875e9465fdfb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2fbfd293526648e7b758875e9465fdfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2fbfd293526648e7b758875e9465fdfb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2fbfd293526648e7b758875e9465fdfb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:26:54.292001 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1810030293 Oct 30 01:26:54.292001 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 2fbfd293526648e7b758875e9465fdfb Oct 30 01:26:54.292001 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1810030293 Oct 30 01:26:54.292001 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-KeyPairsNegativeTestJSON-1810030293-project Oct 30 01:26:54.292001 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:26:54.292001 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:26:54.292001 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: a3bf509a0d7a4c098a31777eaa72b8ef Oct 30 01:26:54.292001 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1810030293-project Oct 30 01:26:54.292001 n-d-master-1 devstack@n-api.service[121103]: Oct 30 01:26:54.292001 n-d-master-1 devstack@n-api.service[121103]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-978986369", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 30 01:26:54.292001 n-d-master-1 devstack@n-api.service[121103]: method: Oct 30 01:26:54.292001 n-d-master-1 devstack@n-api.service[121103]: exception: Keypair data is invalid: failed to generate fingerprint Oct 30 01:26:54.295256 n-d-master-1 devstack@n-api.service[121103]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-978986369', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 30 01:26:54.295256 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:26:54.295256 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:26:54.295256 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 30 01:26:54.295256 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 30 01:26:54.295256 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 30 01:26:54.295256 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 30 01:26:54.295256 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 30 01:26:54.295256 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:26:54.295256 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:26:54.295256 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:26:54.295256 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:26:54.295256 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 30 01:26:54.295256 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 30 01:26:54.295256 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 30 01:26:54.295256 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 30 01:26:54.295256 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 01:26:54.295256 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 30 01:26:54.295256 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 01:26:54.295256 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise self.value Oct 30 01:26:54.295256 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 30 01:26:54.295256 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 30 01:26:54.295256 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 30 01:26:54.295256 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 30 01:26:54.295256 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 30 01:26:54.295256 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 30 01:26:54.295256 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 30 01:26:54.295256 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 30 01:26:54.295256 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 30 01:26:54.295256 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:26:54.295256 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:26:54.295256 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:26:54.295256 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:26:54.295256 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:26:54.295256 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:26:54.295256 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:26:54.295256 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:26:54.295256 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:26:54.295256 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:26:54.295256 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:26:54.295256 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:26:54.298118 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:26:54.298118 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:26:54.298118 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:26:54.298118 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:26:54.298118 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 30 01:26:54.298118 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 30 01:26:54.298118 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 30 01:26:54.298118 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 30 01:26:54.298118 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 30 01:26:54.298118 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:26:54.298118 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:26:54.298118 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:26:54.298118 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:26:54.298118 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:26:54.298118 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:26:54.298118 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:26:54.298118 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:26:54.298118 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 30 01:26:54.298118 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:26:54.301490 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0cdc3039-ffb0-4a5d-b88e-629395db1ecd tempest-KeyPairsNegativeTestJSON-1810030293 tempest-KeyPairsNegativeTestJSON-1810030293-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:26:54.309272 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0cdc3039-ffb0-4a5d-b88e-629395db1ecd tempest-KeyPairsNegativeTestJSON-1810030293 tempest-KeyPairsNegativeTestJSON-1810030293-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.102185 Oct 30 01:26:54.309272 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1539/3099] 10.222.0.13 () {60 vars in 1160 bytes} [Sun Oct 30 01:26:54 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 30 01:26:54.316326 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-22d2d9f4-7285-4564-82a6-425b4e48b837 tempest-KeyPairsNegativeTestJSON-1810030293 tempest-KeyPairsNegativeTestJSON-1810030293-project] Action: 'create', calling method: .version_select at 0x7f44d03de790>, body: {"keypair": {"name": "tempest-keypair-2011617392", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZN3s1r8UqSGXpu1c0Ielb11VRZ9bchcGBjJOsFlq5rTj21NQ/00gegTufxr3mjhG4yIiROjGVl1Qcinu6UCZ4WfEI/Ez5miJgnUwY+pXRfImWB2SrpKZ8FUwkju3zZvg=="}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:26:54.349402 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-22d2d9f4-7285-4564-82a6-425b4e48b837 tempest-KeyPairsNegativeTestJSON-1810030293 tempest-KeyPairsNegativeTestJSON-1810030293-project] Getting quotas for project 2fbfd293526648e7b758875e9465fdfb. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:26:54.388157 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-22d2d9f4-7285-4564-82a6-425b4e48b837 tempest-KeyPairsNegativeTestJSON-1810030293 tempest-KeyPairsNegativeTestJSON-1810030293-project] Getting quotas for user a3bf509a0d7a4c098a31777eaa72b8ef and project 2fbfd293526648e7b758875e9465fdfb. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:26:54.513484 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-22d2d9f4-7285-4564-82a6-425b4e48b837 tempest-KeyPairsNegativeTestJSON-1810030293 tempest-KeyPairsNegativeTestJSON-1810030293-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.201056 Oct 30 01:26:54.514821 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1561/3100] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 30 01:26:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:26:54.522743 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c35cc71f-15e8-4f2c-a0da-313b656e74d2 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:54.523785 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c35cc71f-15e8-4f2c-a0da-313b656e74d2 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] [instance: f08028cf-a9fa-4b2c-9796-0e5a8c172ab5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:54.525926 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f0105c3f-4bb6-4169-83e0-eaa899a31843 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:54.526755 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f0105c3f-4bb6-4169-83e0-eaa899a31843 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] [instance: 8f8815cb-4215-486d-9d40-fe6ffa145ddc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:54.538802 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f0105c3f-4bb6-4169-83e0-eaa899a31843 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:54.540207 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f0105c3f-4bb6-4169-83e0-eaa899a31843 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:54.541479 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f0105c3f-4bb6-4169-83e0-eaa899a31843 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:54.542457 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c35cc71f-15e8-4f2c-a0da-313b656e74d2 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:54.543024 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c35cc71f-15e8-4f2c-a0da-313b656e74d2 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:54.543677 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c35cc71f-15e8-4f2c-a0da-313b656e74d2 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:54.545119 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c35cc71f-15e8-4f2c-a0da-313b656e74d2 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:54.545825 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c35cc71f-15e8-4f2c-a0da-313b656e74d2 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:54.545943 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f0105c3f-4bb6-4169-83e0-eaa899a31843 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:54.546553 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c35cc71f-15e8-4f2c-a0da-313b656e74d2 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:54.546953 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f0105c3f-4bb6-4169-83e0-eaa899a31843 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:54.548228 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f0105c3f-4bb6-4169-83e0-eaa899a31843 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:54.696273 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c35cc71f-15e8-4f2c-a0da-313b656e74d2 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:54.705651 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c35cc71f-15e8-4f2c-a0da-313b656e74d2 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:54.707561 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c35cc71f-15e8-4f2c-a0da-313b656e74d2 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:54.709038 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c35cc71f-15e8-4f2c-a0da-313b656e74d2 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] 10.222.0.13 "GET /compute/v2.1/servers/f08028cf-a9fa-4b2c-9796-0e5a8c172ab5" status: 200 len: 1365 microversion: 2.47 time: 0.190961 Oct 30 01:26:54.710279 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1562/3101] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:26:54 2022] GET /compute/v2.1/servers/f08028cf-a9fa-4b2c-9796-0e5a8c172ab5 => generated 1365 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:26:54.715293 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-529b2467-3006-4020-9838-e236497c8411 tempest-KeyPairsNegativeTestJSON-1810030293 tempest-KeyPairsNegativeTestJSON-1810030293-project] Action: 'create', calling method: .version_select at 0x7f44cc6d23a0>, body: {"keypair": {"name": "tempest-keypair-2011617392", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRO9+03Orbu29fATj1HUJ+UiPop7pkfoA2sYTlpvEKrUqE4NoHMckdi0r6bWLPQtI2aQZgM9DLtqjMNrMoQFdYFh0YC4FUhM99wvaiXfhcPEOXp3T/4rT7bDRqBDDxtOg=="}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:26:54.731719 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-529b2467-3006-4020-9838-e236497c8411 tempest-KeyPairsNegativeTestJSON-1810030293 tempest-KeyPairsNegativeTestJSON-1810030293-project] Getting quotas for project 2fbfd293526648e7b758875e9465fdfb. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:26:54.738480 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-529b2467-3006-4020-9838-e236497c8411 tempest-KeyPairsNegativeTestJSON-1810030293 tempest-KeyPairsNegativeTestJSON-1810030293-project] Getting quotas for user a3bf509a0d7a4c098a31777eaa72b8ef and project 2fbfd293526648e7b758875e9465fdfb. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:26:54.858533 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f0105c3f-4bb6-4169-83e0-eaa899a31843 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f79f3eab648939a30208fed465eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd28b9d6b7146f2b1c114607be83a48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:54.871472 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f0105c3f-4bb6-4169-83e0-eaa899a31843 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] 10.222.0.13 "GET /compute/v2.1/servers/8f8815cb-4215-486d-9d40-fe6ffa145ddc" status: 200 len: 1316 microversion: 2.1 time: 0.365704 Oct 30 01:26:54.887232 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1540/3102] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:54 2022] GET /compute/v2.1/servers/8f8815cb-4215-486d-9d40-fe6ffa145ddc => generated 1316 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:26:54.928110 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-528c3c69-1c2f-487f-9af1-35227b455540 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:54.929147 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-528c3c69-1c2f-487f-9af1-35227b455540 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: edf8f5ea-58fd-4226-b75c-0138fbdd6ae4] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:54.937785 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-528c3c69-1c2f-487f-9af1-35227b455540 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:54.938683 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-528c3c69-1c2f-487f-9af1-35227b455540 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:54.939331 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-528c3c69-1c2f-487f-9af1-35227b455540 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:54.940260 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-528c3c69-1c2f-487f-9af1-35227b455540 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:54.940941 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-528c3c69-1c2f-487f-9af1-35227b455540 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:54.941599 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-528c3c69-1c2f-487f-9af1-35227b455540 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:55.282164 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-528c3c69-1c2f-487f-9af1-35227b455540 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07f2b8c31f54c62aaba73ca2bd2edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c59bd73c7874a00b52ec7c5c4142039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:55.296610 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-528c3c69-1c2f-487f-9af1-35227b455540 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] 10.222.0.13 "GET /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4" status: 200 len: 1334 microversion: 2.1 time: 0.372313 Oct 30 01:26:55.297288 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1541/3103] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:54 2022] GET /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4 => generated 1334 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:26:55.311178 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1d999db7-4554-48ba-85b7-8866b29faf38 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:55.311949 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1d999db7-4554-48ba-85b7-8866b29faf38 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: b4259dcb-d421-45fb-84e6-7e8a8f7ce20d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:55.324696 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1d999db7-4554-48ba-85b7-8866b29faf38 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:55.325247 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1d999db7-4554-48ba-85b7-8866b29faf38 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:55.325760 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1d999db7-4554-48ba-85b7-8866b29faf38 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:55.327004 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1d999db7-4554-48ba-85b7-8866b29faf38 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:55.327813 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1d999db7-4554-48ba-85b7-8866b29faf38 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:55.327942 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1d999db7-4554-48ba-85b7-8866b29faf38 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:55.394890 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-529b2467-3006-4020-9838-e236497c8411 tempest-KeyPairsNegativeTestJSON-1810030293 tempest-KeyPairsNegativeTestJSON-1810030293-project] HTTP exception thrown: Key pair 'tempest-keypair-2011617392' already exists. Oct 30 01:26:55.406978 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-529b2467-3006-4020-9838-e236497c8411 tempest-KeyPairsNegativeTestJSON-1810030293 tempest-KeyPairsNegativeTestJSON-1810030293-project] Request method failure captured: Oct 30 01:26:55.406978 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 30 01:26:55.406978 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:26:55.406978 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:26:55.406978 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:26:55.406978 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 273 Oct 30 01:26:55.406978 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:26:55.406978 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:26:55.406978 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:26:55.406978 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:26:55.406978 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdLd1PTDq7b_a57I-EanbLlSAS5BQbtJlSMuPYaIPu7iHD6P_17x8CmoVQyRaVRGupGgAwpg6ykz4iV4gWL-Fjk6Rvk5hbw37WfDkHIYDoEcSyWq94wYs6VkQsz3l2o0ASLdNsgR9kbxGRo58s-1X-xtPl8yONmNvqoSzCwKsYAbDBA Oct 30 01:26:55.406978 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:26:55.406978 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:26:55.406978 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:26:55.406978 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:26:55.406978 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:26:55.406978 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:26:55.406978 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 2fbfd293526648e7b758875e9465fdfb Oct 30 01:26:55.406978 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1810030293 Oct 30 01:26:55.406978 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:26:55.406978 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:26:55.406978 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2fbfd293526648e7b758875e9465fdfb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2fbfd293526648e7b758875e9465fdfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2fbfd293526648e7b758875e9465fdfb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2fbfd293526648e7b758875e9465fdfb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:26:55.406978 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1810030293 Oct 30 01:26:55.406978 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 2fbfd293526648e7b758875e9465fdfb Oct 30 01:26:55.406978 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1810030293 Oct 30 01:26:55.406978 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-KeyPairsNegativeTestJSON-1810030293-project Oct 30 01:26:55.406978 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:26:55.406978 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:26:55.406978 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: a3bf509a0d7a4c098a31777eaa72b8ef Oct 30 01:26:55.406978 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1810030293-project Oct 30 01:26:55.406978 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:26:55.406978 n-d-master-1 devstack@n-api.service[121102]: {"keypair": {"name": "tempest-keypair-2011617392", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRO9+03Orbu29fATj1HUJ+UiPop7pkfoA2sYTlpvEKrUqE4NoHMckdi0r6bWLPQtI2aQZgM9DLtqjMNrMoQFdYFh0YC4FUhM99wvaiXfhcPEOXp3T/4rT7bDRqBDDxtOg=="}} Oct 30 01:26:55.406978 n-d-master-1 devstack@n-api.service[121102]: method: Oct 30 01:26:55.406978 n-d-master-1 devstack@n-api.service[121102]: exception: Key pair 'tempest-keypair-2011617392' already exists. Oct 30 01:26:55.406978 n-d-master-1 devstack@n-api.service[121102]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-2011617392', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRO9+03Orbu29fATj1HUJ+UiPop7pkfoA2sYTlpvEKrUqE4NoHMckdi0r6bWLPQtI2aQZgM9DLtqjMNrMoQFdYFh0YC4FUhM99wvaiXfhcPEOXp3T/4rT7bDRqBDDxtOg=='}}} Oct 30 01:26:55.406978 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:26:55.406978 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:26:55.406978 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 30 01:26:55.406978 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 30 01:26:55.406978 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 30 01:26:55.406978 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 30 01:26:55.406978 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 30 01:26:55.406978 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 30 01:26:55.406978 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 30 01:26:55.406978 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 30 01:26:55.406978 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 30 01:26:55.406978 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 30 01:26:55.406978 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 30 01:26:55.406978 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result.read() Oct 30 01:26:55.406978 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 30 01:26:55.406978 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 30 01:26:55.406978 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 30 01:26:55.406978 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 30 01:26:55.406978 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 30 01:26:55.406978 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 30 01:26:55.406978 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 30 01:26:55.406978 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 30 01:26:55.406978 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'a3bf509a0d7a4c098a31777eaa72b8ef-tempest-keypair-2011617392' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 30 01:26:55.406978 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:26:55.411746 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 30 01:26:55.411746 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:26:55.411746 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:26:55.411746 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 30 01:26:55.411746 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 30 01:26:55.411746 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 30 01:26:55.411746 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi session.flush() Oct 30 01:26:55.411746 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 30 01:26:55.411746 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 30 01:26:55.411746 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 30 01:26:55.411746 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 30 01:26:55.411746 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 30 01:26:55.411746 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 30 01:26:55.411746 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 30 01:26:55.411746 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception Oct 30 01:26:55.411746 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 30 01:26:55.411746 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 30 01:26:55.411746 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 30 01:26:55.411746 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 30 01:26:55.411746 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 30 01:26:55.411746 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 30 01:26:55.411746 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 30 01:26:55.411746 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 30 01:26:55.411746 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 30 01:26:55.411746 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 30 01:26:55.411746 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 30 01:26:55.411746 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 30 01:26:55.411746 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 30 01:26:55.411746 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 30 01:26:55.411746 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 30 01:26:55.411746 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 30 01:26:55.411746 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 30 01:26:55.411746 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 30 01:26:55.411746 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 30 01:26:55.411746 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 30 01:26:55.411746 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 30 01:26:55.411746 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception Oct 30 01:26:55.411746 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 30 01:26:55.411746 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 30 01:26:55.411746 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 30 01:26:55.411746 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 30 01:26:55.411746 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 30 01:26:55.411746 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 30 01:26:55.411746 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 30 01:26:55.411746 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 30 01:26:55.411746 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 30 01:26:55.411746 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 30 01:26:55.411746 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 30 01:26:55.411746 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result.read() Oct 30 01:26:55.411746 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 30 01:26:55.411746 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 30 01:26:55.411746 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 30 01:26:55.411746 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 30 01:26:55.411746 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 30 01:26:55.411746 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 30 01:26:55.411746 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 30 01:26:55.426862 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 30 01:26:55.426862 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'a3bf509a0d7a4c098a31777eaa72b8ef-tempest-keypair-2011617392' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 30 01:26:55.426862 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 30 01:26:55.426862 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 30, 1, 26, 54, 765365), 'updated_at': None, 'name': 'tempest-keypair-2011617392', 'user_id': 'a3bf509a0d7a4c098a31777eaa72b8ef', 'fingerprint': 'a7:03:62:ca:c7:ca:96:c2:63:0e:fd:ad:8b:89:76:71', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRO9+03Orbu29fATj1HUJ+UiPop7pkfoA2sYTlpvEKrUqE4NoHMckdi0r6bWLPQtI2aQZgM9DLtqjMNrMoQFdYFh0YC4FUhM99wvaiXfhcPEOXp3T/4rT7bDRqBDDxtOg==', 'type': 'ssh'}] Oct 30 01:26:55.426862 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 30 01:26:55.426862 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:26:55.426862 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:26:55.426862 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:26:55.426862 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:26:55.426862 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 30 01:26:55.426862 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 30 01:26:55.426862 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 30 01:26:55.426862 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 30 01:26:55.426862 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 01:26:55.426862 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 30 01:26:55.426862 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 01:26:55.426862 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise self.value Oct 30 01:26:55.426862 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 30 01:26:55.426862 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 30 01:26:55.426862 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 30 01:26:55.426862 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi keypair.create() Oct 30 01:26:55.426862 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 30 01:26:55.426862 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 30 01:26:55.426862 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 30 01:26:55.426862 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._create() Oct 30 01:26:55.426862 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 30 01:26:55.426862 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 30 01:26:55.426862 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 30 01:26:55.426862 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 30 01:26:55.426862 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 30 01:26:55.426862 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 30 01:26:55.426862 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 30 01:26:55.426862 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 30 01:26:55.426862 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-2011617392' already exists. Oct 30 01:26:55.426862 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:26:55.426862 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:26:55.426862 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:26:55.426862 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:26:55.426862 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:26:55.426862 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:26:55.426862 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:26:55.426862 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:26:55.426862 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:26:55.426862 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:26:55.426862 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:26:55.426862 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:26:55.426862 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:26:55.426862 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:26:55.426862 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:26:55.426862 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:26:55.426862 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 30 01:26:55.426862 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 30 01:26:55.426862 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 30 01:26:55.426862 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 30 01:26:55.426862 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-2011617392' already exists. Oct 30 01:26:55.438356 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:26:55.438356 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:26:55.438356 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:26:55.438356 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:26:55.438356 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:26:55.438356 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:26:55.438356 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:26:55.438356 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:26:55.438356 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-2011617392' already exists. Oct 30 01:26:55.438356 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:26:55.438356 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-529b2467-3006-4020-9838-e236497c8411 tempest-KeyPairsNegativeTestJSON-1810030293 tempest-KeyPairsNegativeTestJSON-1810030293-project] Returning 409 to user: Key pair 'tempest-keypair-2011617392' already exists. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:26:55.438356 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-529b2467-3006-4020-9838-e236497c8411 tempest-KeyPairsNegativeTestJSON-1810030293 tempest-KeyPairsNegativeTestJSON-1810030293-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.697153 Oct 30 01:26:55.438356 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1563/3104] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 30 01:26:54 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 698 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:26:55.438356 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-80b6787b-52f4-49ea-a219-bb0cb3b37745 tempest-KeyPairsNegativeTestJSON-1810030293 tempest-KeyPairsNegativeTestJSON-1810030293-project] Calling method '.version_select at 0x7f44d04a94c0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:55.587272 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-80b6787b-52f4-49ea-a219-bb0cb3b37745 tempest-KeyPairsNegativeTestJSON-1810030293 tempest-KeyPairsNegativeTestJSON-1810030293-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2011617392" status: 202 len: 0 microversion: 2.1 time: 0.165541 Oct 30 01:26:55.595551 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1564/3105] 10.222.0.13 () {58 vars in 1221 bytes} [Sun Oct 30 01:26:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2011617392 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:26:55.602234 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-473792c7-30c5-464f-9288-38ea202baf93 tempest-KeyPairsNegativeTestJSON-1810030293 tempest-KeyPairsNegativeTestJSON-1810030293-project] Action: 'create', calling method: .version_select at 0x7f44cc068310>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJmr7TzRXN0VXj6OlEUmv6FX+fXA+g/WRCD13HllSXNYa9MG4kH8HsDIPWDaiDypKnA8myAasGbMkMZn5v/o2ra0pYxgIGLSjLBI1+KFjqEcU+k8nPM5dK8MRNV0HhYQA=="}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-473792c7-30c5-464f-9288-38ea202baf93 tempest-KeyPairsNegativeTestJSON-1810030293 tempest-KeyPairsNegativeTestJSON-1810030293-project] Request method failure captured: Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 247 Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdLd1PTDq7b_a57I-EanbLlSAS5BQbtJlSMuPYaIPu7iHD6P_17x8CmoVQyRaVRGupGgAwpg6ykz4iV4gWL-Fjk6Rvk5hbw37WfDkHIYDoEcSyWq94wYs6VkQsz3l2o0ASLdNsgR9kbxGRo58s-1X-xtPl8yONmNvqoSzCwKsYAbDBA Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 2fbfd293526648e7b758875e9465fdfb Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1810030293 Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2fbfd293526648e7b758875e9465fdfb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2fbfd293526648e7b758875e9465fdfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2fbfd293526648e7b758875e9465fdfb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2fbfd293526648e7b758875e9465fdfb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1810030293 Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 2fbfd293526648e7b758875e9465fdfb Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1810030293 Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-KeyPairsNegativeTestJSON-1810030293-project Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: a3bf509a0d7a4c098a31777eaa72b8ef Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1810030293-project Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJmr7TzRXN0VXj6OlEUmv6FX+fXA+g/WRCD13HllSXNYa9MG4kH8HsDIPWDaiDypKnA8myAasGbMkMZn5v/o2ra0pYxgIGLSjLBI1+KFjqEcU+k8nPM5dK8MRNV0HhYQA=="}} Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: method: Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJmr7TzRXN0VXj6OlEUmv6FX+fXA+g/WRCD13HllSXNYa9MG4kH8HsDIPWDaiDypKnA8myAasGbMkMZn5v/o2ra0pYxgIGLSjLBI1+KFjqEcU+k8nPM5dK8MRNV0HhYQA=='}}} Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise error Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi '' Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 30 01:26:55.612345 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 30 01:26:55.616556 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 30 01:26:55.616556 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 30 01:26:55.616556 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 30 01:26:55.616556 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 30 01:26:55.616556 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 30 01:26:55.616556 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:26:55.616556 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:26:55.616556 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:26:55.616556 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:26:55.616556 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:26:55.616556 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:26:55.616556 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 30 01:26:55.616556 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 30 01:26:55.616556 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 30 01:26:55.616556 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:26:55.616556 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-473792c7-30c5-464f-9288-38ea202baf93 tempest-KeyPairsNegativeTestJSON-1810030293 tempest-KeyPairsNegativeTestJSON-1810030293-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:26:55.616556 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-473792c7-30c5-464f-9288-38ea202baf93 tempest-KeyPairsNegativeTestJSON-1810030293 tempest-KeyPairsNegativeTestJSON-1810030293-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.016820 Oct 30 01:26:55.616556 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1565/3106] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 30 01:26:55 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:26:55.647541 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1d999db7-4554-48ba-85b7-8866b29faf38 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:55.656539 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-11944647-3f94-458b-844e-db32ef3efabf tempest-KeyPairsNegativeTestJSON-1810030293 tempest-KeyPairsNegativeTestJSON-1810030293-project] Action: 'create', calling method: .version_select at 0x7f44d02cd700>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1733266747", "public_key": " "}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:26:55.660988 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1d999db7-4554-48ba-85b7-8866b29faf38 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/b4259dcb-d421-45fb-84e6-7e8a8f7ce20d" status: 200 len: 1307 microversion: 2.1 time: 0.362530 Oct 30 01:26:55.667125 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1542/3107] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:55 2022] GET /compute/v2.1/servers/b4259dcb-d421-45fb-84e6-7e8a8f7ce20d => generated 1307 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:55.697053 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-11944647-3f94-458b-844e-db32ef3efabf tempest-KeyPairsNegativeTestJSON-1810030293 tempest-KeyPairsNegativeTestJSON-1810030293-project] Getting quotas for project 2fbfd293526648e7b758875e9465fdfb. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:26:55.704303 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-11944647-3f94-458b-844e-db32ef3efabf tempest-KeyPairsNegativeTestJSON-1810030293 tempest-KeyPairsNegativeTestJSON-1810030293-project] Getting quotas for user a3bf509a0d7a4c098a31777eaa72b8ef and project 2fbfd293526648e7b758875e9465fdfb. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:26:55.730769 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-11944647-3f94-458b-844e-db32ef3efabf tempest-KeyPairsNegativeTestJSON-1810030293 tempest-KeyPairsNegativeTestJSON-1810030293-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-11944647-3f94-458b-844e-db32ef3efabf tempest-KeyPairsNegativeTestJSON-1810030293 tempest-KeyPairsNegativeTestJSON-1810030293-project] Request method failure captured: Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 95 Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdLd1PTDq7b_a57I-EanbLlSAS5BQbtJlSMuPYaIPu7iHD6P_17x8CmoVQyRaVRGupGgAwpg6ykz4iV4gWL-Fjk6Rvk5hbw37WfDkHIYDoEcSyWq94wYs6VkQsz3l2o0ASLdNsgR9kbxGRo58s-1X-xtPl8yONmNvqoSzCwKsYAbDBA Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 2fbfd293526648e7b758875e9465fdfb Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1810030293 Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2fbfd293526648e7b758875e9465fdfb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2fbfd293526648e7b758875e9465fdfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2fbfd293526648e7b758875e9465fdfb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2fbfd293526648e7b758875e9465fdfb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1810030293 Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 2fbfd293526648e7b758875e9465fdfb Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1810030293 Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-KeyPairsNegativeTestJSON-1810030293-project Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: a3bf509a0d7a4c098a31777eaa72b8ef Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1810030293-project Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1733266747", "public_key": " "}} Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: method: Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: exception: Keypair data is invalid: failed to generate fingerprint Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1733266747', 'public_key': ' '}}} Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise self.value Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:26:55.735532 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:26:55.743735 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:26:55.743735 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:26:55.743735 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:26:55.743735 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:26:55.743735 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:26:55.743735 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:26:55.743735 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:26:55.743735 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:26:55.743735 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:26:55.743735 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:26:55.743735 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:26:55.743735 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:26:55.743735 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:26:55.743735 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 30 01:26:55.743735 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 30 01:26:55.743735 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 30 01:26:55.743735 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 30 01:26:55.743735 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 30 01:26:55.743735 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:26:55.743735 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:26:55.743735 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:26:55.743735 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:26:55.743735 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:26:55.743735 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:26:55.743735 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:26:55.743735 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:26:55.743735 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 30 01:26:55.743735 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:26:55.749266 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8a2818ec-29b3-4f38-8c02-de12b9937101 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:55.749266 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8a2818ec-29b3-4f38-8c02-de12b9937101 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] [instance: f08028cf-a9fa-4b2c-9796-0e5a8c172ab5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:55.755722 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8a2818ec-29b3-4f38-8c02-de12b9937101 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:55.756244 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8a2818ec-29b3-4f38-8c02-de12b9937101 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:55.756675 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8a2818ec-29b3-4f38-8c02-de12b9937101 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:55.757506 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8a2818ec-29b3-4f38-8c02-de12b9937101 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:55.757885 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8a2818ec-29b3-4f38-8c02-de12b9937101 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:55.758313 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8a2818ec-29b3-4f38-8c02-de12b9937101 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:55.762847 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-11944647-3f94-458b-844e-db32ef3efabf tempest-KeyPairsNegativeTestJSON-1810030293 tempest-KeyPairsNegativeTestJSON-1810030293-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:26:55.763988 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-11944647-3f94-458b-844e-db32ef3efabf tempest-KeyPairsNegativeTestJSON-1810030293 tempest-KeyPairsNegativeTestJSON-1810030293-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.135365 Oct 30 01:26:55.774594 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1566/3108] 10.222.0.13 () {60 vars in 1158 bytes} [Sun Oct 30 01:26:55 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 146 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 30 01:26:55.783632 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e4bebb5e-20ac-4820-b836-2a072aed9c96 tempest-KeyPairsNegativeTestJSON-1810030293 tempest-KeyPairsNegativeTestJSON-1810030293-project] Action: 'create', calling method: .version_select at 0x7f44c7ee3e50>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI7Kr0ptKpeJfOKhknEdYuqydQAiMb8TLxRbR86a2hWuxHHtYv/zEuY6N7qaqMErXNtMmj5iTNrKo8vqkeIOl5bhNnOHJewzAZWFnyH1VHYWUYMwddrMRJA7LIxlqa8paA=="}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:26:55.789084 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e4bebb5e-20ac-4820-b836-2a072aed9c96 tempest-KeyPairsNegativeTestJSON-1810030293 tempest-KeyPairsNegativeTestJSON-1810030293-project] Request method failure captured: Oct 30 01:26:55.789084 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 30 01:26:55.789084 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:26:55.789084 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:26:55.789084 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:26:55.789084 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 507 Oct 30 01:26:55.789084 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:26:55.789084 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:26:55.789084 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:26:55.789084 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:26:55.789084 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdLd1PTDq7b_a57I-EanbLlSAS5BQbtJlSMuPYaIPu7iHD6P_17x8CmoVQyRaVRGupGgAwpg6ykz4iV4gWL-Fjk6Rvk5hbw37WfDkHIYDoEcSyWq94wYs6VkQsz3l2o0ASLdNsgR9kbxGRo58s-1X-xtPl8yONmNvqoSzCwKsYAbDBA Oct 30 01:26:55.789084 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:26:55.789084 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:26:55.789084 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:26:55.789084 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:26:55.789084 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:26:55.789084 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:26:55.789084 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 2fbfd293526648e7b758875e9465fdfb Oct 30 01:26:55.789084 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1810030293 Oct 30 01:26:55.789084 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:26:55.789084 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:26:55.789084 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2fbfd293526648e7b758875e9465fdfb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2fbfd293526648e7b758875e9465fdfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2fbfd293526648e7b758875e9465fdfb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2fbfd293526648e7b758875e9465fdfb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:26:55.789084 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1810030293 Oct 30 01:26:55.789084 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 2fbfd293526648e7b758875e9465fdfb Oct 30 01:26:55.789084 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1810030293 Oct 30 01:26:55.789084 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-KeyPairsNegativeTestJSON-1810030293-project Oct 30 01:26:55.789084 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:26:55.789084 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:26:55.789084 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: a3bf509a0d7a4c098a31777eaa72b8ef Oct 30 01:26:55.789084 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1810030293-project Oct 30 01:26:55.789084 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:26:55.789084 n-d-master-1 devstack@n-api.service[121102]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI7Kr0ptKpeJfOKhknEdYuqydQAiMb8TLxRbR86a2hWuxHHtYv/zEuY6N7qaqMErXNtMmj5iTNrKo8vqkeIOl5bhNnOHJewzAZWFnyH1VHYWUYMwddrMRJA7LIxlqa8paA=="}} Oct 30 01:26:55.789084 n-d-master-1 devstack@n-api.service[121102]: method: Oct 30 01:26:55.789084 n-d-master-1 devstack@n-api.service[121102]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 30 01:26:55.789084 n-d-master-1 devstack@n-api.service[121102]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI7Kr0ptKpeJfOKhknEdYuqydQAiMb8TLxRbR86a2hWuxHHtYv/zEuY6N7qaqMErXNtMmj5iTNrKo8vqkeIOl5bhNnOHJewzAZWFnyH1VHYWUYMwddrMRJA7LIxlqa8paA=='}}} Oct 30 01:26:55.789084 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:26:55.789084 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:26:55.789084 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 30 01:26:55.789084 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 30 01:26:55.789084 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 30 01:26:55.789084 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise error Oct 30 01:26:55.789084 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 30 01:26:55.789084 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:26:55.789084 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 30 01:26:55.789084 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 30 01:26:55.789084 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:26:55.789084 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 30 01:26:55.789084 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 30 01:26:55.794337 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:26:55.794337 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:26:55.794337 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:26:55.794337 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:26:55.794337 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:26:55.794337 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:26:55.794337 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:26:55.794337 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:26:55.794337 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:26:55.794337 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:26:55.794337 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:26:55.794337 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:26:55.794337 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:26:55.794337 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:26:55.794337 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 30 01:26:55.794337 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 30 01:26:55.794337 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 30 01:26:55.794337 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 30 01:26:55.794337 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 30 01:26:55.794337 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 30 01:26:55.794337 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 30 01:26:55.794337 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:26:55.794337 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:26:55.794337 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:26:55.794337 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:26:55.794337 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:26:55.794337 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:26:55.794337 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 30 01:26:55.794337 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 30 01:26:55.794337 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 30 01:26:55.794337 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:26:55.801129 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e4bebb5e-20ac-4820-b836-2a072aed9c96 tempest-KeyPairsNegativeTestJSON-1810030293 tempest-KeyPairsNegativeTestJSON-1810030293-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:26:55.803197 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e4bebb5e-20ac-4820-b836-2a072aed9c96 tempest-KeyPairsNegativeTestJSON-1810030293 tempest-KeyPairsNegativeTestJSON-1810030293-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.027351 Oct 30 01:26:55.810186 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1567/3109] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 30 01:26:55 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:26:55.820397 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f91984d2-3d7b-4508-bf89-0e171a63f41a tempest-KeyPairsNegativeTestJSON-1810030293 tempest-KeyPairsNegativeTestJSON-1810030293-project] Action: 'create', calling method: .version_select at 0x7f44cc6d2820>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1682147290", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:26:55.846212 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-f91984d2-3d7b-4508-bf89-0e171a63f41a tempest-KeyPairsNegativeTestJSON-1810030293 tempest-KeyPairsNegativeTestJSON-1810030293-project] Getting quotas for project 2fbfd293526648e7b758875e9465fdfb. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:26:55.854331 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-f91984d2-3d7b-4508-bf89-0e171a63f41a tempest-KeyPairsNegativeTestJSON-1810030293 tempest-KeyPairsNegativeTestJSON-1810030293-project] Getting quotas for user a3bf509a0d7a4c098a31777eaa72b8ef and project 2fbfd293526648e7b758875e9465fdfb. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:26:55.884865 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-f91984d2-3d7b-4508-bf89-0e171a63f41a tempest-KeyPairsNegativeTestJSON-1810030293 tempest-KeyPairsNegativeTestJSON-1810030293-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f91984d2-3d7b-4508-bf89-0e171a63f41a tempest-KeyPairsNegativeTestJSON-1810030293 tempest-KeyPairsNegativeTestJSON-1810030293-project] Request method failure captured: Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 118 Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdLd1PTDq7b_a57I-EanbLlSAS5BQbtJlSMuPYaIPu7iHD6P_17x8CmoVQyRaVRGupGgAwpg6ykz4iV4gWL-Fjk6Rvk5hbw37WfDkHIYDoEcSyWq94wYs6VkQsz3l2o0ASLdNsgR9kbxGRo58s-1X-xtPl8yONmNvqoSzCwKsYAbDBA Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 2fbfd293526648e7b758875e9465fdfb Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1810030293 Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2fbfd293526648e7b758875e9465fdfb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2fbfd293526648e7b758875e9465fdfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2fbfd293526648e7b758875e9465fdfb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2fbfd293526648e7b758875e9465fdfb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1810030293 Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 2fbfd293526648e7b758875e9465fdfb Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1810030293 Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-KeyPairsNegativeTestJSON-1810030293-project Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: a3bf509a0d7a4c098a31777eaa72b8ef Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1810030293-project Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1682147290", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: method: Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: exception: Keypair data is invalid: failed to generate fingerprint Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1682147290', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise self.value Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 30 01:26:55.887191 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 30 01:26:55.899137 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 30 01:26:55.899137 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 30 01:26:55.899137 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 30 01:26:55.899137 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:26:55.899137 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:26:55.899137 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:26:55.899137 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:26:55.899137 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:26:55.899137 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:26:55.899137 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:26:55.899137 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:26:55.899137 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:26:55.899137 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:26:55.899137 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:26:55.899137 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:26:55.899137 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:26:55.899137 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:26:55.899137 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:26:55.899137 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:26:55.899137 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 30 01:26:55.899137 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 30 01:26:55.899137 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 30 01:26:55.899137 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 30 01:26:55.899137 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 30 01:26:55.899137 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:26:55.899137 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:26:55.899137 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:26:55.899137 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:26:55.899137 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:26:55.899137 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:26:55.899137 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:26:55.899137 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:26:55.899137 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 30 01:26:55.899137 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:26:55.905232 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f91984d2-3d7b-4508-bf89-0e171a63f41a tempest-KeyPairsNegativeTestJSON-1810030293 tempest-KeyPairsNegativeTestJSON-1810030293-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:26:55.906364 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f91984d2-3d7b-4508-bf89-0e171a63f41a tempest-KeyPairsNegativeTestJSON-1810030293 tempest-KeyPairsNegativeTestJSON-1810030293-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.094372 Oct 30 01:26:55.907372 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1568/3110] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 30 01:26:55 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 30 01:26:55.928730 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f9572fea-4224-4a77-adac-403846a7270b tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:55.929634 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f9572fea-4224-4a77-adac-403846a7270b tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] [instance: 8f8815cb-4215-486d-9d40-fe6ffa145ddc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:55.943003 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f9572fea-4224-4a77-adac-403846a7270b tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:55.945969 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f9572fea-4224-4a77-adac-403846a7270b tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:55.947054 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f9572fea-4224-4a77-adac-403846a7270b tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:55.949223 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8a2818ec-29b3-4f38-8c02-de12b9937101 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:55.952506 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f9572fea-4224-4a77-adac-403846a7270b tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:55.955263 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f9572fea-4224-4a77-adac-403846a7270b tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:55.955974 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f9572fea-4224-4a77-adac-403846a7270b tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:55.964671 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8a2818ec-29b3-4f38-8c02-de12b9937101 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:55.966453 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8a2818ec-29b3-4f38-8c02-de12b9937101 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:55.968630 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8a2818ec-29b3-4f38-8c02-de12b9937101 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] 10.222.0.13 "GET /compute/v2.1/servers/f08028cf-a9fa-4b2c-9796-0e5a8c172ab5" status: 200 len: 1365 microversion: 2.47 time: 0.227571 Oct 30 01:26:55.971304 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1543/3111] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:26:55 2022] GET /compute/v2.1/servers/f08028cf-a9fa-4b2c-9796-0e5a8c172ab5 => generated 1365 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:26:55.977607 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6dc79f54-7c33-40a3-8890-9f1ced812776 tempest-KeyPairsNegativeTestJSON-1810030293 tempest-KeyPairsNegativeTestJSON-1810030293-project] Calling method '.version_select at 0x7f44c7a90b80>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:56.003845 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-6dc79f54-7c33-40a3-8890-9f1ced812776 tempest-KeyPairsNegativeTestJSON-1810030293 tempest-KeyPairsNegativeTestJSON-1810030293-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1770895068 not found for user a3bf509a0d7a4c098a31777eaa72b8ef Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6dc79f54-7c33-40a3-8890-9f1ced812776 tempest-KeyPairsNegativeTestJSON-1810030293 tempest-KeyPairsNegativeTestJSON-1810030293-project] Request method failure captured: Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1770895068 HTTP/1.1 Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdLd1PTDq7b_a57I-EanbLlSAS5BQbtJlSMuPYaIPu7iHD6P_17x8CmoVQyRaVRGupGgAwpg6ykz4iV4gWL-Fjk6Rvk5hbw37WfDkHIYDoEcSyWq94wYs6VkQsz3l2o0ASLdNsgR9kbxGRo58s-1X-xtPl8yONmNvqoSzCwKsYAbDBA Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 2fbfd293526648e7b758875e9465fdfb Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1810030293 Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2fbfd293526648e7b758875e9465fdfb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2fbfd293526648e7b758875e9465fdfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2fbfd293526648e7b758875e9465fdfb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2fbfd293526648e7b758875e9465fdfb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1810030293 Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 2fbfd293526648e7b758875e9465fdfb Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1810030293 Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-KeyPairsNegativeTestJSON-1810030293-project Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: a3bf509a0d7a4c098a31777eaa72b8ef Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1810030293-project Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: method: Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: exception: Keypair tempest-keypair-non-existent-1770895068 not found for user a3bf509a0d7a4c098a31777eaa72b8ef Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'tempest-keypair-non-existent-1770895068'} Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise self.value Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1770895068 not found for user a3bf509a0d7a4c098a31777eaa72b8ef Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:26:56.007093 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:26:56.012311 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:26:56.012311 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:26:56.012311 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:26:56.012311 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:26:56.012311 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:26:56.012311 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:26:56.012311 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:26:56.012311 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:26:56.012311 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 30 01:26:56.012311 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:26:56.012311 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:26:56.012311 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:26:56.012311 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 30 01:26:56.012311 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 30 01:26:56.012311 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 30 01:26:56.012311 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 30 01:26:56.012311 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1770895068 not found for user a3bf509a0d7a4c098a31777eaa72b8ef Oct 30 01:26:56.012311 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:26:56.012311 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:26:56.012311 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:26:56.012311 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:26:56.012311 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:26:56.012311 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:26:56.012311 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:26:56.012311 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:26:56.012311 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1770895068 not found for user a3bf509a0d7a4c098a31777eaa72b8ef Oct 30 01:26:56.012311 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:26:56.025291 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6dc79f54-7c33-40a3-8890-9f1ced812776 tempest-KeyPairsNegativeTestJSON-1810030293 tempest-KeyPairsNegativeTestJSON-1810030293-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1770895068 not found for user a3bf509a0d7a4c098a31777eaa72b8ef {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:26:56.028301 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6dc79f54-7c33-40a3-8890-9f1ced812776 tempest-KeyPairsNegativeTestJSON-1810030293 tempest-KeyPairsNegativeTestJSON-1810030293-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1770895068" status: 404 len: 145 microversion: 2.1 time: 0.055820 Oct 30 01:26:56.030382 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1544/3112] 10.222.0.13 () {58 vars in 1260 bytes} [Sun Oct 30 01:26:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1770895068 => generated 145 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:26:56.099665 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-e83cb104-b68f-43d7-ba51-8537a026b97c req-8641b7b6-077f-42c8-a6b5-6b96af28867f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f8815cb-4215-486d-9d40-fe6ffa145ddc", "name": "network-vif-plugged", "status": "completed", "tag": "5dcc8624-9db1-43e0-b44e-fb28989d9e39"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:26:56.140101 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e83cb104-b68f-43d7-ba51-8537a026b97c req-8641b7b6-077f-42c8-a6b5-6b96af28867f service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:56.142081 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e83cb104-b68f-43d7-ba51-8537a026b97c req-8641b7b6-077f-42c8-a6b5-6b96af28867f service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:56.144187 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e83cb104-b68f-43d7-ba51-8537a026b97c req-8641b7b6-077f-42c8-a6b5-6b96af28867f service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:56.195156 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-e83cb104-b68f-43d7-ba51-8537a026b97c req-8641b7b6-077f-42c8-a6b5-6b96af28867f service nova] Creating event network-vif-plugged:5dcc8624-9db1-43e0-b44e-fb28989d9e39 for instance 8f8815cb-4215-486d-9d40-fe6ffa145ddc on n-h2-master-1 Oct 30 01:26:56.209085 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-e83cb104-b68f-43d7-ba51-8537a026b97c req-8641b7b6-077f-42c8-a6b5-6b96af28867f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114149 Oct 30 01:26:56.210090 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1545/3113] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:26:56.320766 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6af9c567-d885-456e-8990-e6e68e93ee0a tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:56.323716 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6af9c567-d885-456e-8990-e6e68e93ee0a tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: edf8f5ea-58fd-4226-b75c-0138fbdd6ae4] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:56.342414 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6af9c567-d885-456e-8990-e6e68e93ee0a tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:56.342837 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6af9c567-d885-456e-8990-e6e68e93ee0a tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:56.344027 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6af9c567-d885-456e-8990-e6e68e93ee0a tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:56.344600 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6af9c567-d885-456e-8990-e6e68e93ee0a tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:56.345054 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6af9c567-d885-456e-8990-e6e68e93ee0a tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:56.345517 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6af9c567-d885-456e-8990-e6e68e93ee0a tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:56.601579 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f9572fea-4224-4a77-adac-403846a7270b tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f79f3eab648939a30208fed465eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd28b9d6b7146f2b1c114607be83a48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:56.617652 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f9572fea-4224-4a77-adac-403846a7270b tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] 10.222.0.13 "GET /compute/v2.1/servers/8f8815cb-4215-486d-9d40-fe6ffa145ddc" status: 200 len: 1316 microversion: 2.1 time: 0.700699 Oct 30 01:26:56.618522 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1569/3114] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:55 2022] GET /compute/v2.1/servers/8f8815cb-4215-486d-9d40-fe6ffa145ddc => generated 1316 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:56.699938 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a163aaa7-df06-4bf3-9e9d-a87c8ccc062b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:56.702481 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a163aaa7-df06-4bf3-9e9d-a87c8ccc062b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: b4259dcb-d421-45fb-84e6-7e8a8f7ce20d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:56.711927 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a163aaa7-df06-4bf3-9e9d-a87c8ccc062b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:56.713060 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a163aaa7-df06-4bf3-9e9d-a87c8ccc062b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:56.713988 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a163aaa7-df06-4bf3-9e9d-a87c8ccc062b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:56.715144 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a163aaa7-df06-4bf3-9e9d-a87c8ccc062b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:56.716177 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a163aaa7-df06-4bf3-9e9d-a87c8ccc062b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:56.718488 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a163aaa7-df06-4bf3-9e9d-a87c8ccc062b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:57.109821 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6af9c567-d885-456e-8990-e6e68e93ee0a tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07f2b8c31f54c62aaba73ca2bd2edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c59bd73c7874a00b52ec7c5c4142039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:57.124900 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6af9c567-d885-456e-8990-e6e68e93ee0a tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] 10.222.0.13 "GET /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4" status: 200 len: 1334 microversion: 2.1 time: 0.808395 Oct 30 01:26:57.131381 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1546/3115] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:56 2022] GET /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4 => generated 1334 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:26:57.171519 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f9767ac6-5b2c-429d-b94c-fd2759957b5a tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:57.176048 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f9767ac6-5b2c-429d-b94c-fd2759957b5a tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] [instance: f08028cf-a9fa-4b2c-9796-0e5a8c172ab5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:57.192153 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f9767ac6-5b2c-429d-b94c-fd2759957b5a tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:57.194494 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f9767ac6-5b2c-429d-b94c-fd2759957b5a tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:57.194494 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f9767ac6-5b2c-429d-b94c-fd2759957b5a tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:57.195752 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f9767ac6-5b2c-429d-b94c-fd2759957b5a tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:57.197572 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f9767ac6-5b2c-429d-b94c-fd2759957b5a tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:57.198210 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f9767ac6-5b2c-429d-b94c-fd2759957b5a tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:57.339624 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a163aaa7-df06-4bf3-9e9d-a87c8ccc062b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:57.356740 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a163aaa7-df06-4bf3-9e9d-a87c8ccc062b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/b4259dcb-d421-45fb-84e6-7e8a8f7ce20d" status: 200 len: 1307 microversion: 2.1 time: 0.662413 Oct 30 01:26:57.358267 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1570/3116] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:56 2022] GET /compute/v2.1/servers/b4259dcb-d421-45fb-84e6-7e8a8f7ce20d => generated 1307 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:57.507228 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f9767ac6-5b2c-429d-b94c-fd2759957b5a tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:57.521961 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f9767ac6-5b2c-429d-b94c-fd2759957b5a tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:57.525126 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f9767ac6-5b2c-429d-b94c-fd2759957b5a tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:57.531363 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f9767ac6-5b2c-429d-b94c-fd2759957b5a tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] 10.222.0.13 "GET /compute/v2.1/servers/f08028cf-a9fa-4b2c-9796-0e5a8c172ab5" status: 200 len: 1365 microversion: 2.47 time: 0.398006 Oct 30 01:26:57.541484 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1547/3117] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:26:57 2022] GET /compute/v2.1/servers/f08028cf-a9fa-4b2c-9796-0e5a8c172ab5 => generated 1365 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:26:57.644019 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-19542fd8-9fbf-4768-9cb3-88202a6aa718 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:57.645535 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-19542fd8-9fbf-4768-9cb3-88202a6aa718 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] [instance: 8f8815cb-4215-486d-9d40-fe6ffa145ddc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:57.658084 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-19542fd8-9fbf-4768-9cb3-88202a6aa718 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:57.658825 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-19542fd8-9fbf-4768-9cb3-88202a6aa718 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:57.661152 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-19542fd8-9fbf-4768-9cb3-88202a6aa718 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:57.662204 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-19542fd8-9fbf-4768-9cb3-88202a6aa718 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:57.667222 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-19542fd8-9fbf-4768-9cb3-88202a6aa718 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:57.667222 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-19542fd8-9fbf-4768-9cb3-88202a6aa718 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:58.160977 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5d637455-3292-49ad-99b8-49d46d191594 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:58.161650 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5d637455-3292-49ad-99b8-49d46d191594 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: edf8f5ea-58fd-4226-b75c-0138fbdd6ae4] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:58.170259 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5d637455-3292-49ad-99b8-49d46d191594 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:58.171054 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5d637455-3292-49ad-99b8-49d46d191594 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:58.174201 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5d637455-3292-49ad-99b8-49d46d191594 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:58.174201 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5d637455-3292-49ad-99b8-49d46d191594 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:58.175075 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5d637455-3292-49ad-99b8-49d46d191594 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:58.175676 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5d637455-3292-49ad-99b8-49d46d191594 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:58.311418 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-19542fd8-9fbf-4768-9cb3-88202a6aa718 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f79f3eab648939a30208fed465eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd28b9d6b7146f2b1c114607be83a48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:58.319684 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-19542fd8-9fbf-4768-9cb3-88202a6aa718 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] 10.222.0.13 "GET /compute/v2.1/servers/8f8815cb-4215-486d-9d40-fe6ffa145ddc" status: 200 len: 1316 microversion: 2.1 time: 0.679649 Oct 30 01:26:58.320266 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1571/3118] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:57 2022] GET /compute/v2.1/servers/8f8815cb-4215-486d-9d40-fe6ffa145ddc => generated 1316 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:58.381121 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fabf4b50-ddd4-440e-a0c4-a039905025e9 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:58.381757 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fabf4b50-ddd4-440e-a0c4-a039905025e9 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: b4259dcb-d421-45fb-84e6-7e8a8f7ce20d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:58.393458 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fabf4b50-ddd4-440e-a0c4-a039905025e9 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:58.393964 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fabf4b50-ddd4-440e-a0c4-a039905025e9 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:58.394403 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fabf4b50-ddd4-440e-a0c4-a039905025e9 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:58.395124 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fabf4b50-ddd4-440e-a0c4-a039905025e9 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:58.395565 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fabf4b50-ddd4-440e-a0c4-a039905025e9 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:58.405265 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fabf4b50-ddd4-440e-a0c4-a039905025e9 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:58.607701 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5d637455-3292-49ad-99b8-49d46d191594 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07f2b8c31f54c62aaba73ca2bd2edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c59bd73c7874a00b52ec7c5c4142039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:58.629992 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5d637455-3292-49ad-99b8-49d46d191594 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] 10.222.0.13 "GET /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4" status: 200 len: 1334 microversion: 2.1 time: 0.470867 Oct 30 01:26:58.651735 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1548/3119] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:58 2022] GET /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4 => generated 1334 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:26:58.669580 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c1b8cba0-eff0-48df-a062-10a6b6683ef0 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:58.669580 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c1b8cba0-eff0-48df-a062-10a6b6683ef0 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] [instance: f08028cf-a9fa-4b2c-9796-0e5a8c172ab5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:58.696785 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c1b8cba0-eff0-48df-a062-10a6b6683ef0 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:58.705789 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c1b8cba0-eff0-48df-a062-10a6b6683ef0 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:58.705789 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c1b8cba0-eff0-48df-a062-10a6b6683ef0 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:58.705789 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c1b8cba0-eff0-48df-a062-10a6b6683ef0 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:58.705789 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c1b8cba0-eff0-48df-a062-10a6b6683ef0 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:58.705789 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c1b8cba0-eff0-48df-a062-10a6b6683ef0 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:59.010004 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c1b8cba0-eff0-48df-a062-10a6b6683ef0 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:59.029107 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c1b8cba0-eff0-48df-a062-10a6b6683ef0 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:59.030923 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c1b8cba0-eff0-48df-a062-10a6b6683ef0 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:59.035057 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-fabf4b50-ddd4-440e-a0c4-a039905025e9 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:59.050678 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c1b8cba0-eff0-48df-a062-10a6b6683ef0 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] 10.222.0.13 "GET /compute/v2.1/servers/f08028cf-a9fa-4b2c-9796-0e5a8c172ab5" status: 200 len: 1371 microversion: 2.47 time: 0.394060 Oct 30 01:26:59.051683 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fabf4b50-ddd4-440e-a0c4-a039905025e9 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/b4259dcb-d421-45fb-84e6-7e8a8f7ce20d" status: 200 len: 1307 microversion: 2.1 time: 0.674522 Oct 30 01:26:59.052502 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1549/3120] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:26:58 2022] GET /compute/v2.1/servers/f08028cf-a9fa-4b2c-9796-0e5a8c172ab5 => generated 1371 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:26:59.069982 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1572/3121] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:58 2022] GET /compute/v2.1/servers/b4259dcb-d421-45fb-84e6-7e8a8f7ce20d => generated 1307 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:26:59.350901 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-38c12a91-d9f1-49a8-9cbf-f8c385d1dac6 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:26:59.351721 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-38c12a91-d9f1-49a8-9cbf-f8c385d1dac6 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] [instance: 8f8815cb-4215-486d-9d40-fe6ffa145ddc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:26:59.381816 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38c12a91-d9f1-49a8-9cbf-f8c385d1dac6 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:59.383872 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38c12a91-d9f1-49a8-9cbf-f8c385d1dac6 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:59.384498 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38c12a91-d9f1-49a8-9cbf-f8c385d1dac6 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:59.385364 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38c12a91-d9f1-49a8-9cbf-f8c385d1dac6 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:26:59.388253 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38c12a91-d9f1-49a8-9cbf-f8c385d1dac6 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:26:59.388859 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38c12a91-d9f1-49a8-9cbf-f8c385d1dac6 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:26:59.843529 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a7859697-b1d2-4b83-ab14-df37ffb48c49 tempest-ServerGroup264TestJSON-836276685 tempest-ServerGroup264TestJSON-836276685-project] Action: 'create', calling method: .version_select at 0x7f44ccb30430>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:26:59.874398 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-38c12a91-d9f1-49a8-9cbf-f8c385d1dac6 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f79f3eab648939a30208fed465eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd28b9d6b7146f2b1c114607be83a48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:26:59.891640 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-38c12a91-d9f1-49a8-9cbf-f8c385d1dac6 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] 10.222.0.13 "GET /compute/v2.1/servers/8f8815cb-4215-486d-9d40-fe6ffa145ddc" status: 200 len: 1504 microversion: 2.1 time: 0.544897 Oct 30 01:26:59.894917 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1550/3122] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:59 2022] GET /compute/v2.1/servers/8f8815cb-4215-486d-9d40-fe6ffa145ddc => generated 1504 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:00.021244 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1bc94e59-9eb6-4f81-ab50-cd5a1cbf59af tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:00.021244 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1bc94e59-9eb6-4f81-ab50-cd5a1cbf59af tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: edf8f5ea-58fd-4226-b75c-0138fbdd6ae4] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:00.021959 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-a7859697-b1d2-4b83-ab14-df37ffb48c49 tempest-ServerGroup264TestJSON-836276685 tempest-ServerGroup264TestJSON-836276685-project] Getting quotas for project 3465d57c005f4189afc9abd0fc0008c7. Resources: {'server_groups'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:27:00.022083 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1bc94e59-9eb6-4f81-ab50-cd5a1cbf59af tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:00.022083 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1bc94e59-9eb6-4f81-ab50-cd5a1cbf59af tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:00.022083 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1bc94e59-9eb6-4f81-ab50-cd5a1cbf59af tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:00.022083 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1bc94e59-9eb6-4f81-ab50-cd5a1cbf59af tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:00.022083 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1bc94e59-9eb6-4f81-ab50-cd5a1cbf59af tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:00.022083 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1bc94e59-9eb6-4f81-ab50-cd5a1cbf59af tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:00.022083 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=100 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:27:00.022600 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-a7859697-b1d2-4b83-ab14-df37ffb48c49 tempest-ServerGroup264TestJSON-836276685 tempest-ServerGroup264TestJSON-836276685-project] Getting quotas for user fb37a82d48064c8f9768ddc2feabacd5 and project 3465d57c005f4189afc9abd0fc0008c7. Resources: {'server_groups'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:27:00.044798 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:27:00.177849 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-a7859697-b1d2-4b83-ab14-df37ffb48c49 tempest-ServerGroup264TestJSON-836276685 tempest-ServerGroup264TestJSON-836276685-project] Getting quotas for project 3465d57c005f4189afc9abd0fc0008c7. Resources: {'server_groups'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:27:00.187595 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-a7859697-b1d2-4b83-ab14-df37ffb48c49 tempest-ServerGroup264TestJSON-836276685 tempest-ServerGroup264TestJSON-836276685-project] Getting quotas for user fb37a82d48064c8f9768ddc2feabacd5 and project 3465d57c005f4189afc9abd0fc0008c7. Resources: {'server_groups'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:27:00.220000 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a7859697-b1d2-4b83-ab14-df37ffb48c49 tempest-ServerGroup264TestJSON-836276685 tempest-ServerGroup264TestJSON-836276685-project] 10.222.0.13 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.689617 Oct 30 01:27:00.220000 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1573/3123] 10.222.0.13 () {62 vars in 1214 bytes} [Sun Oct 30 01:26:59 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 30 01:27:00.230598 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b003ee1c-0880-4754-823c-d33cf5b7b5d7 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:00.231429 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b003ee1c-0880-4754-823c-d33cf5b7b5d7 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] [instance: 8f8815cb-4215-486d-9d40-fe6ffa145ddc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:00.248681 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b003ee1c-0880-4754-823c-d33cf5b7b5d7 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:00.249733 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b003ee1c-0880-4754-823c-d33cf5b7b5d7 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:00.255896 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b003ee1c-0880-4754-823c-d33cf5b7b5d7 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:00.257494 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b003ee1c-0880-4754-823c-d33cf5b7b5d7 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:00.258260 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b003ee1c-0880-4754-823c-d33cf5b7b5d7 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:00.259896 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b003ee1c-0880-4754-823c-d33cf5b7b5d7 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:00.326990 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1bc94e59-9eb6-4f81-ab50-cd5a1cbf59af tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07f2b8c31f54c62aaba73ca2bd2edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c59bd73c7874a00b52ec7c5c4142039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:00.327788 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b003ee1c-0880-4754-823c-d33cf5b7b5d7 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] 10.222.0.13 "GET /compute/v2.1/servers/8f8815cb-4215-486d-9d40-fe6ffa145ddc/ips" status: 200 len: 108 microversion: 2.1 time: 0.106668 Oct 30 01:27:00.329427 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1574/3124] 10.222.0.13 () {58 vars in 1248 bytes} [Sun Oct 30 01:27:00 2022] GET /compute/v2.1/servers/8f8815cb-4215-486d-9d40-fe6ffa145ddc/ips => generated 108 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:27:00.343903 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1bc94e59-9eb6-4f81-ab50-cd5a1cbf59af tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] 10.222.0.13 "GET /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4" status: 200 len: 1334 microversion: 2.1 time: 0.447595 Oct 30 01:27:00.346920 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1551/3125] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:26:59 2022] GET /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4 => generated 1334 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:00.352126 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-260b1d2b-f09f-4f27-bc54-2600338c4b5e tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:00.352956 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-260b1d2b-f09f-4f27-bc54-2600338c4b5e tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] [instance: f08028cf-a9fa-4b2c-9796-0e5a8c172ab5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:00.358263 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-935a6e35-9a8c-434d-b1d0-793414c1ef65 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:00.360514 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-935a6e35-9a8c-434d-b1d0-793414c1ef65 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: b4259dcb-d421-45fb-84e6-7e8a8f7ce20d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:00.361900 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-260b1d2b-f09f-4f27-bc54-2600338c4b5e tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:00.363566 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-260b1d2b-f09f-4f27-bc54-2600338c4b5e tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:00.365940 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-260b1d2b-f09f-4f27-bc54-2600338c4b5e tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:00.376500 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-260b1d2b-f09f-4f27-bc54-2600338c4b5e tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:00.376500 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-260b1d2b-f09f-4f27-bc54-2600338c4b5e tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:00.376500 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-260b1d2b-f09f-4f27-bc54-2600338c4b5e tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:00.380384 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-935a6e35-9a8c-434d-b1d0-793414c1ef65 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:00.386687 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-935a6e35-9a8c-434d-b1d0-793414c1ef65 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:00.387365 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-935a6e35-9a8c-434d-b1d0-793414c1ef65 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:00.389066 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-935a6e35-9a8c-434d-b1d0-793414c1ef65 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:00.389824 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-935a6e35-9a8c-434d-b1d0-793414c1ef65 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:00.391793 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-935a6e35-9a8c-434d-b1d0-793414c1ef65 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:00.520339 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-260b1d2b-f09f-4f27-bc54-2600338c4b5e tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:00.543178 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-260b1d2b-f09f-4f27-bc54-2600338c4b5e tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:00.543178 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-260b1d2b-f09f-4f27-bc54-2600338c4b5e tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:00.543178 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-260b1d2b-f09f-4f27-bc54-2600338c4b5e tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] 10.222.0.13 "GET /compute/v2.1/servers/f08028cf-a9fa-4b2c-9796-0e5a8c172ab5" status: 200 len: 1371 microversion: 2.47 time: 0.211490 Oct 30 01:27:00.547631 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1575/3126] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:27:00 2022] GET /compute/v2.1/servers/f08028cf-a9fa-4b2c-9796-0e5a8c172ab5 => generated 1371 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:27:00.602283 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7ccad593-2a04-4667-958f-1f08c770e1ec tempest-ServerGroup264TestJSON-836276685 tempest-ServerGroup264TestJSON-836276685-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:00.605547 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7ccad593-2a04-4667-958f-1f08c770e1ec tempest-ServerGroup264TestJSON-836276685 tempest-ServerGroup264TestJSON-836276685-project] 10.222.0.13 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.051974 Oct 30 01:27:00.606996 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1576/3127] 10.222.0.13 () {60 vars in 1193 bytes} [Sun Oct 30 01:27:00 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:27:00.613145 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-2f90e827-cfa0-4e2e-8dc9-d726d3116e2f req-a540b7c8-6bb3-451b-867a-af2794a8df85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edf8f5ea-58fd-4226-b75c-0138fbdd6ae4", "name": "network-vif-plugged", "status": "completed", "tag": "c3b52eab-87c2-44f0-b9ce-f134032c1805"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:27:00.623324 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-2f90e827-cfa0-4e2e-8dc9-d726d3116e2f req-a540b7c8-6bb3-451b-867a-af2794a8df85 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:00.624197 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-2f90e827-cfa0-4e2e-8dc9-d726d3116e2f req-a540b7c8-6bb3-451b-867a-af2794a8df85 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:00.624614 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-2f90e827-cfa0-4e2e-8dc9-d726d3116e2f req-a540b7c8-6bb3-451b-867a-af2794a8df85 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:00.646644 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-2f90e827-cfa0-4e2e-8dc9-d726d3116e2f req-a540b7c8-6bb3-451b-867a-af2794a8df85 service nova] Creating event network-vif-plugged:c3b52eab-87c2-44f0-b9ce-f134032c1805 for instance edf8f5ea-58fd-4226-b75c-0138fbdd6ae4 on n-h2-master-1 Oct 30 01:27:00.652255 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-2f90e827-cfa0-4e2e-8dc9-d726d3116e2f req-a540b7c8-6bb3-451b-867a-af2794a8df85 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042918 Oct 30 01:27:00.652949 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1577/3128] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:27:00.660030 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e31659cc-8aaa-4c99-8bdc-d723651452e8 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:00.660913 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e31659cc-8aaa-4c99-8bdc-d723651452e8 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] [instance: 8f8815cb-4215-486d-9d40-fe6ffa145ddc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:00.671644 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e31659cc-8aaa-4c99-8bdc-d723651452e8 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:00.672594 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e31659cc-8aaa-4c99-8bdc-d723651452e8 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:00.673983 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e31659cc-8aaa-4c99-8bdc-d723651452e8 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:00.674986 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e31659cc-8aaa-4c99-8bdc-d723651452e8 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:00.676260 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e31659cc-8aaa-4c99-8bdc-d723651452e8 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:00.676907 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e31659cc-8aaa-4c99-8bdc-d723651452e8 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:00.712402 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-935a6e35-9a8c-434d-b1d0-793414c1ef65 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:00.714813 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e31659cc-8aaa-4c99-8bdc-d723651452e8 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] 10.222.0.13 "GET /compute/v2.1/servers/8f8815cb-4215-486d-9d40-fe6ffa145ddc/ips" status: 200 len: 108 microversion: 2.1 time: 0.060322 Oct 30 01:27:00.716091 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1578/3129] 10.222.0.13 () {58 vars in 1248 bytes} [Sun Oct 30 01:27:00 2022] GET /compute/v2.1/servers/8f8815cb-4215-486d-9d40-fe6ffa145ddc/ips => generated 108 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:27:00.724738 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-935a6e35-9a8c-434d-b1d0-793414c1ef65 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/b4259dcb-d421-45fb-84e6-7e8a8f7ce20d" status: 200 len: 1307 microversion: 2.1 time: 0.375665 Oct 30 01:27:00.725366 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1552/3130] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:27:00 2022] GET /compute/v2.1/servers/b4259dcb-d421-45fb-84e6-7e8a8f7ce20d => generated 1307 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:00.730898 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7e9fc515-f97a-4534-8785-5b4aeed26f14 tempest-ServerGroup264TestJSON-836276685 tempest-ServerGroup264TestJSON-836276685-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:00.756772 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7e9fc515-f97a-4534-8785-5b4aeed26f14 tempest-ServerGroup264TestJSON-836276685 tempest-ServerGroup264TestJSON-836276685-project] 10.222.0.13 "GET /compute/v2.1/os-server-groups/b68707b2-8900-40e0-a87f-551207261555" status: 200 len: 235 microversion: 2.64 time: 0.029648 Oct 30 01:27:00.763269 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1553/3131] 10.222.0.13 () {60 vars in 1304 bytes} [Sun Oct 30 01:27:00 2022] GET /compute/v2.1/os-server-groups/b68707b2-8900-40e0-a87f-551207261555 => generated 235 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:27:00.778459 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ead7b49c-2332-49f6-91fa-225b6089a159 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:00.779484 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ead7b49c-2332-49f6-91fa-225b6089a159 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] [instance: 8f8815cb-4215-486d-9d40-fe6ffa145ddc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:00.804983 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ead7b49c-2332-49f6-91fa-225b6089a159 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:00.807126 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ead7b49c-2332-49f6-91fa-225b6089a159 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:00.807776 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ead7b49c-2332-49f6-91fa-225b6089a159 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:00.810017 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ead7b49c-2332-49f6-91fa-225b6089a159 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:00.815300 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ead7b49c-2332-49f6-91fa-225b6089a159 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:00.820023 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ead7b49c-2332-49f6-91fa-225b6089a159 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:00.847622 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ead7b49c-2332-49f6-91fa-225b6089a159 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] 10.222.0.13 "GET /compute/v2.1/servers/8f8815cb-4215-486d-9d40-fe6ffa145ddc/ips/tempest-ServerAddressesTestJSON-385418940-network" status: 200 len: 93 microversion: 2.1 time: 0.088715 Oct 30 01:27:00.850323 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1554/3132] 10.222.0.13 () {58 vars in 1398 bytes} [Sun Oct 30 01:27:00 2022] GET /compute/v2.1/servers/8f8815cb-4215-486d-9d40-fe6ffa145ddc/ips/tempest-ServerAddressesTestJSON-385418940-network => generated 93 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:27:00.857136 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e59325bc-f6a4-4d8e-b47b-623e4ad22297 tempest-ServerGroup264TestJSON-836276685 tempest-ServerGroup264TestJSON-836276685-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:01.004663 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e59325bc-f6a4-4d8e-b47b-623e4ad22297 tempest-ServerGroup264TestJSON-836276685 tempest-ServerGroup264TestJSON-836276685-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/b68707b2-8900-40e0-a87f-551207261555" status: 204 len: 0 microversion: 2.64 time: 0.154563 Oct 30 01:27:01.005434 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1555/3133] 10.222.0.13 () {60 vars in 1307 bytes} [Sun Oct 30 01:27:00 2022] DELETE /compute/v2.1/os-server-groups/b68707b2-8900-40e0-a87f-551207261555 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 30 01:27:01.019173 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f727d396-2705-44f4-9d8f-fd54b8acd872 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:01.021151 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f727d396-2705-44f4-9d8f-fd54b8acd872 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] [instance: 8f8815cb-4215-486d-9d40-fe6ffa145ddc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:01.030124 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f727d396-2705-44f4-9d8f-fd54b8acd872 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:01.030637 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f727d396-2705-44f4-9d8f-fd54b8acd872 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:01.031489 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f727d396-2705-44f4-9d8f-fd54b8acd872 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:01.032757 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f727d396-2705-44f4-9d8f-fd54b8acd872 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:01.033979 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f727d396-2705-44f4-9d8f-fd54b8acd872 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:01.040133 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f727d396-2705-44f4-9d8f-fd54b8acd872 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:01.111837 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f727d396-2705-44f4-9d8f-fd54b8acd872 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] [instance: 8f8815cb-4215-486d-9d40-fe6ffa145ddc] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:27:01.117371 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fcd0bfbb-463b-4a67-b497-c98007ab1b87 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1031005428", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "82962c81-0b6b-4336-9362-d5b7c066ce8e"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:27:01.217271 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-fcd0bfbb-463b-4a67-b497-c98007ab1b87 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] validate_networks() for [('82962c81-0b6b-4336-9362-d5b7c066ce8e', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:27:01.679418 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-fcd0bfbb-463b-4a67-b497-c98007ab1b87 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:27:01.679921 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-fcd0bfbb-463b-4a67-b497-c98007ab1b87 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:27:01.680452 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-fcd0bfbb-463b-4a67-b497-c98007ab1b87 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:27:01.680939 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-fcd0bfbb-463b-4a67-b497-c98007ab1b87 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:27:01.681413 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-fcd0bfbb-463b-4a67-b497-c98007ab1b87 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:27:01.693885 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fcd0bfbb-463b-4a67-b497-c98007ab1b87 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:01.694749 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fcd0bfbb-463b-4a67-b497-c98007ab1b87 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:01.695650 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fcd0bfbb-463b-4a67-b497-c98007ab1b87 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:01.696762 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fcd0bfbb-463b-4a67-b497-c98007ab1b87 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:01.697752 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fcd0bfbb-463b-4a67-b497-c98007ab1b87 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:01.698388 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fcd0bfbb-463b-4a67-b497-c98007ab1b87 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:01.722129 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-fcd0bfbb-463b-4a67-b497-c98007ab1b87 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Getting quotas for project a3f41f5c65be49aaa04853c29904bba6. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:27:01.728402 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-fcd0bfbb-463b-4a67-b497-c98007ab1b87 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Getting quotas for user 948aaf46e1ac4c129dca02cd2dd903e0 and project a3f41f5c65be49aaa04853c29904bba6. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:27:01.753840 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fcd0bfbb-463b-4a67-b497-c98007ab1b87 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:27:01.757559 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fcd0bfbb-463b-4a67-b497-c98007ab1b87 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] [instance: 5f9e19c8-0739-4341-bc2c-31e9384de9de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:27:01.797558 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f727d396-2705-44f4-9d8f-fd54b8acd872 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8f8815cb-4215-486d-9d40-fe6ffa145ddc" status: 204 len: 0 microversion: 2.1 time: 0.786474 Oct 30 01:27:01.798385 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1556/3134] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:27:01 2022] DELETE /compute/v2.1/servers/8f8815cb-4215-486d-9d40-fe6ffa145ddc => generated 0 bytes in 788 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:27:01.956567 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e92b0a5d-5462-4352-a3b8-6da62c95b561 tempest-AbsoluteLimitsTestJSON-1359480851 tempest-AbsoluteLimitsTestJSON-1359480851-project] Calling method '.version_select at 0x7f44c7a90d30>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:01.962374 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fcd0bfbb-463b-4a67-b497-c98007ab1b87 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.244225 Oct 30 01:27:01.969180 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1579/3135] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:27:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1246 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:27:01.978368 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f567bd07-727e-4dda-b9b5-f1d19a1170ce tempest-ServerGroup264TestJSON-836276685 tempest-ServerGroup264TestJSON-836276685-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:02.000735 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-f567bd07-727e-4dda-b9b5-f1d19a1170ce tempest-ServerGroup264TestJSON-836276685 tempest-ServerGroup264TestJSON-836276685-project] HTTP exception thrown: Instance group b68707b2-8900-40e0-a87f-551207261555 could not be found. Oct 30 01:27:02.003660 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e92b0a5d-5462-4352-a3b8-6da62c95b561 tempest-AbsoluteLimitsTestJSON-1359480851 tempest-AbsoluteLimitsTestJSON-1359480851-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:02.009308 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e92b0a5d-5462-4352-a3b8-6da62c95b561 tempest-AbsoluteLimitsTestJSON-1359480851 tempest-AbsoluteLimitsTestJSON-1359480851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:02.009308 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e92b0a5d-5462-4352-a3b8-6da62c95b561 tempest-AbsoluteLimitsTestJSON-1359480851 tempest-AbsoluteLimitsTestJSON-1359480851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:02.009308 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e92b0a5d-5462-4352-a3b8-6da62c95b561 tempest-AbsoluteLimitsTestJSON-1359480851 tempest-AbsoluteLimitsTestJSON-1359480851-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:02.009308 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e92b0a5d-5462-4352-a3b8-6da62c95b561 tempest-AbsoluteLimitsTestJSON-1359480851 tempest-AbsoluteLimitsTestJSON-1359480851-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:02.009308 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e92b0a5d-5462-4352-a3b8-6da62c95b561 tempest-AbsoluteLimitsTestJSON-1359480851 tempest-AbsoluteLimitsTestJSON-1359480851-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f567bd07-727e-4dda-b9b5-f1d19a1170ce tempest-ServerGroup264TestJSON-836276685 tempest-ServerGroup264TestJSON-836276685-project] Request method failure captured: Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/os-server-groups/b68707b2-8900-40e0-a87f-551207261555 HTTP/1.1 Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdLjz_lJLJv6qNyybpoY6-Nt-gCneto89FW0QSBsMr-v38zJNl8WXNZYt4rKdVfortYJUGg3F3YImqUU4tZpMkU29Ex7I20jA_hOGzeP-BpPYNRST5EiRuPcWIUHg57TMAH9quAmfk0uSVx10gnAIBlcrPsk8jXPcUBUQMBtGu0Jw6E Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: X-Openstack-Nova-Api-Version: 2.64 Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 3465d57c005f4189afc9abd0fc0008c7 Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServerGroup264TestJSON-836276685 Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3465d57c005f4189afc9abd0fc0008c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3465d57c005f4189afc9abd0fc0008c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3465d57c005f4189afc9abd0fc0008c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3465d57c005f4189afc9abd0fc0008c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServerGroup264TestJSON-836276685 Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 3465d57c005f4189afc9abd0fc0008c7 Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServerGroup264TestJSON-836276685 Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServerGroup264TestJSON-836276685-project Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: fb37a82d48064c8f9768ddc2feabacd5 Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServerGroup264TestJSON-836276685-project Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: exception: Instance group b68707b2-8900-40e0-a87f-551207261555 could not be found. Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'b68707b2-8900-40e0-a87f-551207261555'} Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group b68707b2-8900-40e0-a87f-551207261555 could not be found. Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group b68707b2-8900-40e0-a87f-551207261555 could not be found. Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:02.010818 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:27:02.017204 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:27:02.017204 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:27:02.017204 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:27:02.017204 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:27:02.017204 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group b68707b2-8900-40e0-a87f-551207261555 could not be found. Oct 30 01:27:02.017204 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:02.017204 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f567bd07-727e-4dda-b9b5-f1d19a1170ce tempest-ServerGroup264TestJSON-836276685 tempest-ServerGroup264TestJSON-836276685-project] Returning 404 to user: Instance group b68707b2-8900-40e0-a87f-551207261555 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:27:02.017204 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f567bd07-727e-4dda-b9b5-f1d19a1170ce tempest-ServerGroup264TestJSON-836276685 tempest-ServerGroup264TestJSON-836276685-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/b68707b2-8900-40e0-a87f-551207261555" status: 404 len: 117 microversion: 2.64 time: 0.047847 Oct 30 01:27:02.017204 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1580/3136] 10.222.0.13 () {60 vars in 1307 bytes} [Sun Oct 30 01:27:01 2022] DELETE /compute/v2.1/os-server-groups/b68707b2-8900-40e0-a87f-551207261555 => generated 117 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:27:02.035817 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-67fe5abc-c999-4d51-a8a9-eff5f50217d5 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:02.044071 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-67fe5abc-c999-4d51-a8a9-eff5f50217d5 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: edf8f5ea-58fd-4226-b75c-0138fbdd6ae4] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:02.064653 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e92b0a5d-5462-4352-a3b8-6da62c95b561 tempest-AbsoluteLimitsTestJSON-1359480851 tempest-AbsoluteLimitsTestJSON-1359480851-project] 10.222.0.13 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.257840 Oct 30 01:27:02.066324 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1557/3137] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:27:01 2022] GET /compute/v2.1/limits => generated 511 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:27:02.068347 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67fe5abc-c999-4d51-a8a9-eff5f50217d5 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:02.068847 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67fe5abc-c999-4d51-a8a9-eff5f50217d5 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:02.069285 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67fe5abc-c999-4d51-a8a9-eff5f50217d5 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:02.072167 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67fe5abc-c999-4d51-a8a9-eff5f50217d5 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:02.072633 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67fe5abc-c999-4d51-a8a9-eff5f50217d5 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:02.073062 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67fe5abc-c999-4d51-a8a9-eff5f50217d5 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:02.073457 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6c938098-3df5-4600-b8ca-ad346a75d6a4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:02.075114 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6c938098-3df5-4600-b8ca-ad346a75d6a4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] [instance: f08028cf-a9fa-4b2c-9796-0e5a8c172ab5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:02.089519 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c938098-3df5-4600-b8ca-ad346a75d6a4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:02.089519 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c938098-3df5-4600-b8ca-ad346a75d6a4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:02.089519 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c938098-3df5-4600-b8ca-ad346a75d6a4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:02.089519 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c938098-3df5-4600-b8ca-ad346a75d6a4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:02.089519 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c938098-3df5-4600-b8ca-ad346a75d6a4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:02.089519 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c938098-3df5-4600-b8ca-ad346a75d6a4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:02.263881 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6c938098-3df5-4600-b8ca-ad346a75d6a4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:02.281671 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6c938098-3df5-4600-b8ca-ad346a75d6a4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:02.281671 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6c938098-3df5-4600-b8ca-ad346a75d6a4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:02.286322 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6c938098-3df5-4600-b8ca-ad346a75d6a4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] 10.222.0.13 "GET /compute/v2.1/servers/f08028cf-a9fa-4b2c-9796-0e5a8c172ab5" status: 200 len: 1356 microversion: 2.47 time: 0.218462 Oct 30 01:27:02.287859 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1558/3138] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:27:02 2022] GET /compute/v2.1/servers/f08028cf-a9fa-4b2c-9796-0e5a8c172ab5 => generated 1356 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:27:02.307436 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c1d543e4-3640-4840-921b-15670dcb2ce3 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:02.307785 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c1d543e4-3640-4840-921b-15670dcb2ce3 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: b4259dcb-d421-45fb-84e6-7e8a8f7ce20d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:02.321236 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c1d543e4-3640-4840-921b-15670dcb2ce3 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:02.321894 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c1d543e4-3640-4840-921b-15670dcb2ce3 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:02.322651 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c1d543e4-3640-4840-921b-15670dcb2ce3 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:02.324650 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c1d543e4-3640-4840-921b-15670dcb2ce3 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:02.325309 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c1d543e4-3640-4840-921b-15670dcb2ce3 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:02.326078 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c1d543e4-3640-4840-921b-15670dcb2ce3 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:03.115983 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-67fe5abc-c999-4d51-a8a9-eff5f50217d5 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07f2b8c31f54c62aaba73ca2bd2edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c59bd73c7874a00b52ec7c5c4142039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:03.134902 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-67fe5abc-c999-4d51-a8a9-eff5f50217d5 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] 10.222.0.13 "GET /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4" status: 200 len: 1334 microversion: 2.1 time: 1.105090 Oct 30 01:27:03.137381 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1581/3139] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:27:02 2022] GET /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4 => generated 1334 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:03.149635 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bcdc79c5-6d2b-4c5e-8328-dff9dbc4e694 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:03.150922 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bcdc79c5-6d2b-4c5e-8328-dff9dbc4e694 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] [instance: 8f8815cb-4215-486d-9d40-fe6ffa145ddc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:03.168354 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bcdc79c5-6d2b-4c5e-8328-dff9dbc4e694 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:03.169268 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bcdc79c5-6d2b-4c5e-8328-dff9dbc4e694 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:03.170157 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bcdc79c5-6d2b-4c5e-8328-dff9dbc4e694 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:03.171416 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bcdc79c5-6d2b-4c5e-8328-dff9dbc4e694 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:03.173262 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bcdc79c5-6d2b-4c5e-8328-dff9dbc4e694 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:03.175091 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bcdc79c5-6d2b-4c5e-8328-dff9dbc4e694 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:03.183959 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c1d543e4-3640-4840-921b-15670dcb2ce3 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:03.195873 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c1d543e4-3640-4840-921b-15670dcb2ce3 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/b4259dcb-d421-45fb-84e6-7e8a8f7ce20d" status: 200 len: 1307 microversion: 2.1 time: 0.903950 Oct 30 01:27:03.198860 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1559/3140] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:27:02 2022] GET /compute/v2.1/servers/b4259dcb-d421-45fb-84e6-7e8a8f7ce20d => generated 1307 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:03.209266 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9a053f16-02df-4e9c-9e4c-16422d516eb2 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:03.224325 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9a053f16-02df-4e9c-9e4c-16422d516eb2 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] [instance: 5f9e19c8-0739-4341-bc2c-31e9384de9de] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:03.458295 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9a053f16-02df-4e9c-9e4c-16422d516eb2 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948aaf46e1ac4c129dca02cd2dd903e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f41f5c65be49aaa04853c29904bba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:03.468350 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9a053f16-02df-4e9c-9e4c-16422d516eb2 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] 10.222.0.13 "GET /compute/v2.1/servers/5f9e19c8-0739-4341-bc2c-31e9384de9de" status: 200 len: 1216 microversion: 2.1 time: 0.265697 Oct 30 01:27:03.469935 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1560/3141] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:27:03 2022] GET /compute/v2.1/servers/5f9e19c8-0739-4341-bc2c-31e9384de9de => generated 1216 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:03.477523 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bd0278ee-3980-4363-beda-51814708e7a9 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:03.486210 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-bd0278ee-3980-4363-beda-51814708e7a9 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:03.494890 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-bd0278ee-3980-4363-beda-51814708e7a9 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Searching by: {'deleted': False, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822'} {{(pid=121103) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 30 01:27:03.514872 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd0278ee-3980-4363-beda-51814708e7a9 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:03.515983 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd0278ee-3980-4363-beda-51814708e7a9 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:03.518118 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd0278ee-3980-4363-beda-51814708e7a9 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:03.519170 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd0278ee-3980-4363-beda-51814708e7a9 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:03.519816 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd0278ee-3980-4363-beda-51814708e7a9 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:03.525731 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd0278ee-3980-4363-beda-51814708e7a9 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:03.826012 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.multi_cell_list [None req-bd0278ee-3980-4363-beda-51814708e7a9 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=121103) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 30 01:27:03.903433 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bcdc79c5-6d2b-4c5e-8328-dff9dbc4e694 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f79f3eab648939a30208fed465eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd28b9d6b7146f2b1c114607be83a48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:03.923711 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bcdc79c5-6d2b-4c5e-8328-dff9dbc4e694 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] 10.222.0.13 "GET /compute/v2.1/servers/8f8815cb-4215-486d-9d40-fe6ffa145ddc" status: 200 len: 1510 microversion: 2.1 time: 0.774887 Oct 30 01:27:03.924427 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1582/3142] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:27:03 2022] GET /compute/v2.1/servers/8f8815cb-4215-486d-9d40-fe6ffa145ddc => generated 1510 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:03.946826 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-5f15bdd5-091a-4352-a325-72c7c980a4ea req-877ea895-2d74-4918-9ae3-08615ea5ddf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edf8f5ea-58fd-4226-b75c-0138fbdd6ae4", "name": "network-vif-plugged", "status": "completed", "tag": "e018e410-e769-4fd0-bbc8-a179d701cfc4"}, {"server_uuid": "b4259dcb-d421-45fb-84e6-7e8a8f7ce20d", "name": "network-vif-plugged", "status": "completed", "tag": "f4115819-6c96-4bc9-a7c1-221d92ea37ec"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:27:03.975956 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-5f15bdd5-091a-4352-a325-72c7c980a4ea req-877ea895-2d74-4918-9ae3-08615ea5ddf0 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:03.977482 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-5f15bdd5-091a-4352-a325-72c7c980a4ea req-877ea895-2d74-4918-9ae3-08615ea5ddf0 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:03.977952 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-5f15bdd5-091a-4352-a325-72c7c980a4ea req-877ea895-2d74-4918-9ae3-08615ea5ddf0 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:04.034526 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-5f15bdd5-091a-4352-a325-72c7c980a4ea req-877ea895-2d74-4918-9ae3-08615ea5ddf0 service nova] Creating event network-vif-plugged:e018e410-e769-4fd0-bbc8-a179d701cfc4 for instance edf8f5ea-58fd-4226-b75c-0138fbdd6ae4 on n-h2-master-1 Oct 30 01:27:04.035040 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-5f15bdd5-091a-4352-a325-72c7c980a4ea req-877ea895-2d74-4918-9ae3-08615ea5ddf0 service nova] Creating event network-vif-plugged:f4115819-6c96-4bc9-a7c1-221d92ea37ec for instance b4259dcb-d421-45fb-84e6-7e8a8f7ce20d on n-h1-master-1 Oct 30 01:27:04.064790 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-5f15bdd5-091a-4352-a325-72c7c980a4ea req-877ea895-2d74-4918-9ae3-08615ea5ddf0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.126054 Oct 30 01:27:04.069884 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1583/3143] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:27:03 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:27:04.100655 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-bd0278ee-3980-4363-beda-51814708e7a9 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:04.119730 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd0278ee-3980-4363-beda-51814708e7a9 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:04.120460 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd0278ee-3980-4363-beda-51814708e7a9 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:04.122692 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd0278ee-3980-4363-beda-51814708e7a9 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:04.166502 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-bd0278ee-3980-4363-beda-51814708e7a9 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:04.169821 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0f7825e4-e877-461a-a129-2138866cbc90 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:04.172315 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0f7825e4-e877-461a-a129-2138866cbc90 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: edf8f5ea-58fd-4226-b75c-0138fbdd6ae4] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:04.174926 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-bd0278ee-3980-4363-beda-51814708e7a9 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:04.206931 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0f7825e4-e877-461a-a129-2138866cbc90 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:04.208102 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0f7825e4-e877-461a-a129-2138866cbc90 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:04.208713 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0f7825e4-e877-461a-a129-2138866cbc90 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:04.209916 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0f7825e4-e877-461a-a129-2138866cbc90 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:04.211262 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0f7825e4-e877-461a-a129-2138866cbc90 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:04.213188 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0f7825e4-e877-461a-a129-2138866cbc90 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:04.450412 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bd0278ee-3980-4363-beda-51814708e7a9 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] 10.222.0.13 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.979321 Oct 30 01:27:04.458399 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1561/3144] 10.222.0.13 () {60 vars in 1187 bytes} [Sun Oct 30 01:27:03 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:27:04.492511 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-48e27ce2-1264-4fbe-b4b2-5a075857e2a0 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:04.493803 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-48e27ce2-1264-4fbe-b4b2-5a075857e2a0 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: b4259dcb-d421-45fb-84e6-7e8a8f7ce20d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:04.516338 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-48e27ce2-1264-4fbe-b4b2-5a075857e2a0 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:04.517103 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-48e27ce2-1264-4fbe-b4b2-5a075857e2a0 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:04.517825 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-48e27ce2-1264-4fbe-b4b2-5a075857e2a0 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:04.518667 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-48e27ce2-1264-4fbe-b4b2-5a075857e2a0 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:04.519230 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-48e27ce2-1264-4fbe-b4b2-5a075857e2a0 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:04.530207 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-48e27ce2-1264-4fbe-b4b2-5a075857e2a0 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:05.116236 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0f7825e4-e877-461a-a129-2138866cbc90 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07f2b8c31f54c62aaba73ca2bd2edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c59bd73c7874a00b52ec7c5c4142039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:05.138709 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0f7825e4-e877-461a-a129-2138866cbc90 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] 10.222.0.13 "GET /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4" status: 200 len: 1334 microversion: 2.1 time: 0.980834 Oct 30 01:27:05.139314 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1584/3145] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:27:04 2022] GET /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4 => generated 1334 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:05.148523 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5dea4384-9296-4559-ae75-8f87fe04471b tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:05.149137 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5dea4384-9296-4559-ae75-8f87fe04471b tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] [instance: 5f9e19c8-0739-4341-bc2c-31e9384de9de] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:05.171141 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5dea4384-9296-4559-ae75-8f87fe04471b tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:05.171792 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5dea4384-9296-4559-ae75-8f87fe04471b tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:05.172062 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5dea4384-9296-4559-ae75-8f87fe04471b tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:05.172779 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5dea4384-9296-4559-ae75-8f87fe04471b tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:05.173233 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5dea4384-9296-4559-ae75-8f87fe04471b tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:05.173735 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5dea4384-9296-4559-ae75-8f87fe04471b tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:05.257325 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-48e27ce2-1264-4fbe-b4b2-5a075857e2a0 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:05.263306 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-48e27ce2-1264-4fbe-b4b2-5a075857e2a0 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/b4259dcb-d421-45fb-84e6-7e8a8f7ce20d" status: 200 len: 1307 microversion: 2.1 time: 0.784652 Oct 30 01:27:05.265386 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1562/3146] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:27:04 2022] GET /compute/v2.1/servers/b4259dcb-d421-45fb-84e6-7e8a8f7ce20d => generated 1307 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:05.269240 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1d052676-a4ef-47e9-9a73-20e92b5f3717 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:05.272673 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5dea4384-9296-4559-ae75-8f87fe04471b tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948aaf46e1ac4c129dca02cd2dd903e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f41f5c65be49aaa04853c29904bba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:05.277011 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1d052676-a4ef-47e9-9a73-20e92b5f3717 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] [instance: f08028cf-a9fa-4b2c-9796-0e5a8c172ab5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:05.282874 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5dea4384-9296-4559-ae75-8f87fe04471b tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] 10.222.0.13 "GET /compute/v2.1/servers/5f9e19c8-0739-4341-bc2c-31e9384de9de" status: 200 len: 1268 microversion: 2.1 time: 0.141790 Oct 30 01:27:05.285529 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1585/3147] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:27:05 2022] GET /compute/v2.1/servers/5f9e19c8-0739-4341-bc2c-31e9384de9de => generated 1268 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:05.290479 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:27:05.295573 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1d052676-a4ef-47e9-9a73-20e92b5f3717 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:05.296348 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1d052676-a4ef-47e9-9a73-20e92b5f3717 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:05.297074 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1d052676-a4ef-47e9-9a73-20e92b5f3717 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:05.298189 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1d052676-a4ef-47e9-9a73-20e92b5f3717 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:05.300638 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1d052676-a4ef-47e9-9a73-20e92b5f3717 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:05.301636 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1d052676-a4ef-47e9-9a73-20e92b5f3717 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:05.307178 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-7fe8ff7c-aa63-49a9-983f-96bbc8c364b3 req-04bbf2c2-0cbb-4a75-a047-bbf90b4138be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f8815cb-4215-486d-9d40-fe6ffa145ddc", "name": "network-vif-deleted", "tag": "5dcc8624-9db1-43e0-b44e-fb28989d9e39"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:27:05.317863 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-7fe8ff7c-aa63-49a9-983f-96bbc8c364b3 req-04bbf2c2-0cbb-4a75-a047-bbf90b4138be service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:05.318601 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-7fe8ff7c-aa63-49a9-983f-96bbc8c364b3 req-04bbf2c2-0cbb-4a75-a047-bbf90b4138be service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:05.319030 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-7fe8ff7c-aa63-49a9-983f-96bbc8c364b3 req-04bbf2c2-0cbb-4a75-a047-bbf90b4138be service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:05.331582 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-7fe8ff7c-aa63-49a9-983f-96bbc8c364b3 req-04bbf2c2-0cbb-4a75-a047-bbf90b4138be service nova] Creating event network-vif-deleted:5dcc8624-9db1-43e0-b44e-fb28989d9e39 for instance 8f8815cb-4215-486d-9d40-fe6ffa145ddc on n-h2-master-1 Oct 30 01:27:05.337167 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-7fe8ff7c-aa63-49a9-983f-96bbc8c364b3 req-04bbf2c2-0cbb-4a75-a047-bbf90b4138be service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037919 Oct 30 01:27:05.339149 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1d052676-a4ef-47e9-9a73-20e92b5f3717 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] [instance: f08028cf-a9fa-4b2c-9796-0e5a8c172ab5] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:27:05.342347 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1586/3148] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:27:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:27:05.349921 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4b7f29da-470b-4dbe-aff7-c396d530dd9a tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:05.350636 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4b7f29da-470b-4dbe-aff7-c396d530dd9a tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] [instance: 8f8815cb-4215-486d-9d40-fe6ffa145ddc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:05.358134 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b7f29da-470b-4dbe-aff7-c396d530dd9a tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:05.358688 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b7f29da-470b-4dbe-aff7-c396d530dd9a tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:05.359127 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b7f29da-470b-4dbe-aff7-c396d530dd9a tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:05.359899 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b7f29da-470b-4dbe-aff7-c396d530dd9a tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:05.360351 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b7f29da-470b-4dbe-aff7-c396d530dd9a tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:05.360963 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b7f29da-470b-4dbe-aff7-c396d530dd9a tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:05.510248 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4b7f29da-470b-4dbe-aff7-c396d530dd9a tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f79f3eab648939a30208fed465eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd28b9d6b7146f2b1c114607be83a48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:05.525944 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4b7f29da-470b-4dbe-aff7-c396d530dd9a tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] 10.222.0.13 "GET /compute/v2.1/servers/8f8815cb-4215-486d-9d40-fe6ffa145ddc" status: 200 len: 1468 microversion: 2.1 time: 0.177855 Oct 30 01:27:05.525944 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1587/3149] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:27:05 2022] GET /compute/v2.1/servers/8f8815cb-4215-486d-9d40-fe6ffa145ddc => generated 1468 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:05.752596 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1d052676-a4ef-47e9-9a73-20e92b5f3717 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f08028cf-a9fa-4b2c-9796-0e5a8c172ab5" status: 204 len: 0 microversion: 2.47 time: 0.486720 Oct 30 01:27:05.753319 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1563/3150] 10.222.0.13 () {60 vars in 1280 bytes} [Sun Oct 30 01:27:05 2022] DELETE /compute/v2.1/servers/f08028cf-a9fa-4b2c-9796-0e5a8c172ab5 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 30 01:27:05.762726 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-abed3ee2-2277-472e-a068-16444582744d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:05.764101 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-abed3ee2-2277-472e-a068-16444582744d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] [instance: f08028cf-a9fa-4b2c-9796-0e5a8c172ab5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:05.771527 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-abed3ee2-2277-472e-a068-16444582744d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:05.772247 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-abed3ee2-2277-472e-a068-16444582744d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:05.773148 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-abed3ee2-2277-472e-a068-16444582744d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:05.774371 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-abed3ee2-2277-472e-a068-16444582744d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:05.775622 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-abed3ee2-2277-472e-a068-16444582744d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:05.776463 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-abed3ee2-2277-472e-a068-16444582744d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:05.924727 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-abed3ee2-2277-472e-a068-16444582744d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:05.937288 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-abed3ee2-2277-472e-a068-16444582744d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:05.940018 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-abed3ee2-2277-472e-a068-16444582744d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:05.941634 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-abed3ee2-2277-472e-a068-16444582744d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] 10.222.0.13 "GET /compute/v2.1/servers/f08028cf-a9fa-4b2c-9796-0e5a8c172ab5" status: 200 len: 1362 microversion: 2.47 time: 0.182984 Oct 30 01:27:05.942793 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1588/3151] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:27:05 2022] GET /compute/v2.1/servers/f08028cf-a9fa-4b2c-9796-0e5a8c172ab5 => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:27:06.166395 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7dfceae0-923b-4b14-9487-052232c84fec tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:06.167260 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7dfceae0-923b-4b14-9487-052232c84fec tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: edf8f5ea-58fd-4226-b75c-0138fbdd6ae4] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:06.187389 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7dfceae0-923b-4b14-9487-052232c84fec tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:06.192385 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7dfceae0-923b-4b14-9487-052232c84fec tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:06.193219 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7dfceae0-923b-4b14-9487-052232c84fec tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:06.193886 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7dfceae0-923b-4b14-9487-052232c84fec tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:06.194369 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7dfceae0-923b-4b14-9487-052232c84fec tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:06.199084 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7dfceae0-923b-4b14-9487-052232c84fec tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:06.291314 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1fb250c4-7de2-4e48-bd47-42c80b513b4f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:06.292531 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1fb250c4-7de2-4e48-bd47-42c80b513b4f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: b4259dcb-d421-45fb-84e6-7e8a8f7ce20d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:06.300965 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1fb250c4-7de2-4e48-bd47-42c80b513b4f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:06.305719 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1fb250c4-7de2-4e48-bd47-42c80b513b4f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:06.305719 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1fb250c4-7de2-4e48-bd47-42c80b513b4f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:06.305719 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1fb250c4-7de2-4e48-bd47-42c80b513b4f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:06.305719 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1fb250c4-7de2-4e48-bd47-42c80b513b4f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:06.305719 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1fb250c4-7de2-4e48-bd47-42c80b513b4f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:06.996716 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7dfceae0-923b-4b14-9487-052232c84fec tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07f2b8c31f54c62aaba73ca2bd2edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c59bd73c7874a00b52ec7c5c4142039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:07.010316 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7dfceae0-923b-4b14-9487-052232c84fec tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] 10.222.0.13 "GET /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4" status: 200 len: 1670 microversion: 2.1 time: 0.845736 Oct 30 01:27:07.014384 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1564/3152] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:27:06 2022] GET /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4 => generated 1670 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:07.029108 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-179f408a-7481-44ad-956e-913ba49f7919 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:07.031851 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-179f408a-7481-44ad-956e-913ba49f7919 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] [instance: 5f9e19c8-0739-4341-bc2c-31e9384de9de] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:07.064503 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-179f408a-7481-44ad-956e-913ba49f7919 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:07.069013 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-179f408a-7481-44ad-956e-913ba49f7919 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:07.072857 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-179f408a-7481-44ad-956e-913ba49f7919 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:07.073961 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-179f408a-7481-44ad-956e-913ba49f7919 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:07.074438 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-179f408a-7481-44ad-956e-913ba49f7919 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:07.074874 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-179f408a-7481-44ad-956e-913ba49f7919 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:07.082689 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1fb250c4-7de2-4e48-bd47-42c80b513b4f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:07.095790 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1fb250c4-7de2-4e48-bd47-42c80b513b4f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/b4259dcb-d421-45fb-84e6-7e8a8f7ce20d" status: 200 len: 1307 microversion: 2.1 time: 0.808097 Oct 30 01:27:07.113452 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1589/3153] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:27:06 2022] GET /compute/v2.1/servers/b4259dcb-d421-45fb-84e6-7e8a8f7ce20d => generated 1307 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:07.113452 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9d93afa3-b367-4f53-89ea-2406627dbb10 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:07.113452 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9d93afa3-b367-4f53-89ea-2406627dbb10 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] [instance: 8f8815cb-4215-486d-9d40-fe6ffa145ddc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:07.131831 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9d93afa3-b367-4f53-89ea-2406627dbb10 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:07.133660 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9d93afa3-b367-4f53-89ea-2406627dbb10 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:07.134431 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9d93afa3-b367-4f53-89ea-2406627dbb10 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:07.135169 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9d93afa3-b367-4f53-89ea-2406627dbb10 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:07.135621 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9d93afa3-b367-4f53-89ea-2406627dbb10 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:07.138601 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9d93afa3-b367-4f53-89ea-2406627dbb10 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:07.144135 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:27:07.175685 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-9d93afa3-b367-4f53-89ea-2406627dbb10 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] HTTP exception thrown: Instance 8f8815cb-4215-486d-9d40-fe6ffa145ddc could not be found. Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9d93afa3-b367-4f53-89ea-2406627dbb10 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Request method failure captured: Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/8f8815cb-4215-486d-9d40-fe6ffa145ddc HTTP/1.1 Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdK_Gb_iNBKpNw8YP4FjIjERJEtp-oce8_zB94Tl_1ql025GdiSOucAx2bKO4lsnJCYeOtYrjnNLaOuQ-U2eSF5i8kBfbWScmooxmBNg7K0k-gt9LF0JjlGiiIPy9KcEyVN-r-puLvviV1Q76zOeyVAh_-Q4e6eF-LI_0-TbvtR2W44 Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: bbd28b9d6b7146f2b1c114607be83a48 Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServerAddressesTestJSON-1572781991 Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/bbd28b9d6b7146f2b1c114607be83a48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_bbd28b9d6b7146f2b1c114607be83a48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/bbd28b9d6b7146f2b1c114607be83a48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/bbd28b9d6b7146f2b1c114607be83a48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServerAddressesTestJSON-1572781991 Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: bbd28b9d6b7146f2b1c114607be83a48 Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1572781991 Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServerAddressesTestJSON-1572781991-project Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 927f79f3eab648939a30208fed465eef Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServerAddressesTestJSON-1572781991-project Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 8f8815cb-4215-486d-9d40-fe6ffa145ddc could not be found. Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '8f8815cb-4215-486d-9d40-fe6ffa145ddc'} Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f8815cb-4215-486d-9d40-fe6ffa145ddc could not be found. Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f8815cb-4215-486d-9d40-fe6ffa145ddc could not be found. Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:27:07.182135 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:07.190427 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:27:07.190427 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:27:07.190427 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:27:07.190427 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:27:07.190427 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:27:07.190427 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f8815cb-4215-486d-9d40-fe6ffa145ddc could not be found. Oct 30 01:27:07.190427 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:07.190427 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9d93afa3-b367-4f53-89ea-2406627dbb10 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] Returning 404 to user: Instance 8f8815cb-4215-486d-9d40-fe6ffa145ddc could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:27:07.190427 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9d93afa3-b367-4f53-89ea-2406627dbb10 tempest-ServerAddressesTestJSON-1572781991 tempest-ServerAddressesTestJSON-1572781991-project] 10.222.0.13 "GET /compute/v2.1/servers/8f8815cb-4215-486d-9d40-fe6ffa145ddc" status: 404 len: 111 microversion: 2.1 time: 0.079157 Oct 30 01:27:07.194091 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1590/3154] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:27:07 2022] GET /compute/v2.1/servers/8f8815cb-4215-486d-9d40-fe6ffa145ddc => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:27:07.204996 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-396083bd-25eb-4226-b03d-2a660582b3c6 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:07.204996 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-396083bd-25eb-4226-b03d-2a660582b3c6 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] [instance: f08028cf-a9fa-4b2c-9796-0e5a8c172ab5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:07.222869 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-396083bd-25eb-4226-b03d-2a660582b3c6 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:07.223387 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-396083bd-25eb-4226-b03d-2a660582b3c6 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:07.223793 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-396083bd-25eb-4226-b03d-2a660582b3c6 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:07.224494 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-396083bd-25eb-4226-b03d-2a660582b3c6 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:07.224942 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-396083bd-25eb-4226-b03d-2a660582b3c6 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:07.229401 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-396083bd-25eb-4226-b03d-2a660582b3c6 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:07.279408 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-179f408a-7481-44ad-956e-913ba49f7919 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948aaf46e1ac4c129dca02cd2dd903e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f41f5c65be49aaa04853c29904bba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:07.299518 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-179f408a-7481-44ad-956e-913ba49f7919 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] 10.222.0.13 "GET /compute/v2.1/servers/5f9e19c8-0739-4341-bc2c-31e9384de9de" status: 200 len: 1274 microversion: 2.1 time: 0.279702 Oct 30 01:27:07.305010 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1565/3155] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:27:07 2022] GET /compute/v2.1/servers/5f9e19c8-0739-4341-bc2c-31e9384de9de => generated 1274 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:07.319672 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6c389318-165e-4bc3-997a-e1e64b71f40e tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:07.321123 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6c389318-165e-4bc3-997a-e1e64b71f40e tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: edf8f5ea-58fd-4226-b75c-0138fbdd6ae4] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:07.338736 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c389318-165e-4bc3-997a-e1e64b71f40e tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:07.339581 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c389318-165e-4bc3-997a-e1e64b71f40e tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:07.341433 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c389318-165e-4bc3-997a-e1e64b71f40e tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:07.343021 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c389318-165e-4bc3-997a-e1e64b71f40e tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:07.345588 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c389318-165e-4bc3-997a-e1e64b71f40e tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:07.347842 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c389318-165e-4bc3-997a-e1e64b71f40e tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:07.415944 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6c389318-165e-4bc3-997a-e1e64b71f40e tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] 10.222.0.13 "GET /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4/ips" status: 200 len: 180 microversion: 2.1 time: 0.109361 Oct 30 01:27:07.424641 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1566/3156] 10.222.0.13 () {58 vars in 1248 bytes} [Sun Oct 30 01:27:07 2022] GET /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4/ips => generated 180 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:27:07.432985 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9e77772b-ac6a-4764-8f75-72bccd699e5b tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:07.433891 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9e77772b-ac6a-4764-8f75-72bccd699e5b tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: edf8f5ea-58fd-4226-b75c-0138fbdd6ae4] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:07.441756 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e77772b-ac6a-4764-8f75-72bccd699e5b tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:07.442523 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e77772b-ac6a-4764-8f75-72bccd699e5b tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:07.443220 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e77772b-ac6a-4764-8f75-72bccd699e5b tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:07.444810 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e77772b-ac6a-4764-8f75-72bccd699e5b tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:07.445604 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e77772b-ac6a-4764-8f75-72bccd699e5b tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:07.446333 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e77772b-ac6a-4764-8f75-72bccd699e5b tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:07.468512 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-396083bd-25eb-4226-b03d-2a660582b3c6 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:07.488794 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-396083bd-25eb-4226-b03d-2a660582b3c6 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:07.493265 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-396083bd-25eb-4226-b03d-2a660582b3c6 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:07.496911 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-396083bd-25eb-4226-b03d-2a660582b3c6 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] 10.222.0.13 "GET /compute/v2.1/servers/f08028cf-a9fa-4b2c-9796-0e5a8c172ab5" status: 200 len: 1362 microversion: 2.47 time: 0.300505 Oct 30 01:27:07.513451 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1591/3157] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:27:07 2022] GET /compute/v2.1/servers/f08028cf-a9fa-4b2c-9796-0e5a8c172ab5 => generated 1362 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:27:07.519644 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9e77772b-ac6a-4764-8f75-72bccd699e5b tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: edf8f5ea-58fd-4226-b75c-0138fbdd6ae4] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:27:07.603719 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:27:07.909149 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9e77772b-ac6a-4764-8f75-72bccd699e5b tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] 10.222.0.13 "DELETE /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4" status: 204 len: 0 microversion: 2.1 time: 0.481844 Oct 30 01:27:07.914219 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1567/3158] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:27:07 2022] DELETE /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:27:07.924810 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-255d5474-890a-47c5-8c3d-88f0a28104bc tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:07.925852 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-255d5474-890a-47c5-8c3d-88f0a28104bc tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: edf8f5ea-58fd-4226-b75c-0138fbdd6ae4] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:07.935222 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-255d5474-890a-47c5-8c3d-88f0a28104bc tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:07.937925 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-255d5474-890a-47c5-8c3d-88f0a28104bc tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:07.942560 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-255d5474-890a-47c5-8c3d-88f0a28104bc tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:07.944368 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-255d5474-890a-47c5-8c3d-88f0a28104bc tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:07.944368 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-255d5474-890a-47c5-8c3d-88f0a28104bc tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:07.944368 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-255d5474-890a-47c5-8c3d-88f0a28104bc tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:08.125755 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-770cf582-0fab-4b9a-bfb6-436314207305 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:08.127095 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-770cf582-0fab-4b9a-bfb6-436314207305 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: b4259dcb-d421-45fb-84e6-7e8a8f7ce20d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:08.142025 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-770cf582-0fab-4b9a-bfb6-436314207305 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:08.142893 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-770cf582-0fab-4b9a-bfb6-436314207305 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:08.145826 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-770cf582-0fab-4b9a-bfb6-436314207305 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:08.146866 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-770cf582-0fab-4b9a-bfb6-436314207305 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:08.149123 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-770cf582-0fab-4b9a-bfb6-436314207305 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:08.151422 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-770cf582-0fab-4b9a-bfb6-436314207305 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:08.888700 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-255d5474-890a-47c5-8c3d-88f0a28104bc tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07f2b8c31f54c62aaba73ca2bd2edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c59bd73c7874a00b52ec7c5c4142039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:08.918197 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-255d5474-890a-47c5-8c3d-88f0a28104bc tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] 10.222.0.13 "GET /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4" status: 200 len: 1676 microversion: 2.1 time: 0.999759 Oct 30 01:27:08.919430 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1592/3159] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:27:07 2022] GET /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4 => generated 1676 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:08.949735 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-62ba6a11-88df-4a0a-8060-fa9a6536efab tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:08.950375 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-62ba6a11-88df-4a0a-8060-fa9a6536efab tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] [instance: 5f9e19c8-0739-4341-bc2c-31e9384de9de] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:08.971672 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-62ba6a11-88df-4a0a-8060-fa9a6536efab tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:08.977219 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-62ba6a11-88df-4a0a-8060-fa9a6536efab tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:08.990156 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-62ba6a11-88df-4a0a-8060-fa9a6536efab tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:08.991089 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-770cf582-0fab-4b9a-bfb6-436314207305 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:08.993165 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-62ba6a11-88df-4a0a-8060-fa9a6536efab tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:08.996493 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-62ba6a11-88df-4a0a-8060-fa9a6536efab tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:08.997491 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-62ba6a11-88df-4a0a-8060-fa9a6536efab tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:09.007777 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-770cf582-0fab-4b9a-bfb6-436314207305 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/b4259dcb-d421-45fb-84e6-7e8a8f7ce20d" status: 200 len: 1486 microversion: 2.1 time: 0.887310 Oct 30 01:27:09.025622 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1568/3160] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:27:08 2022] GET /compute/v2.1/servers/b4259dcb-d421-45fb-84e6-7e8a8f7ce20d => generated 1486 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:27:09.044349 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d9f0bacf-ba84-4e30-9b50-a57c697599c4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:09.045606 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d9f0bacf-ba84-4e30-9b50-a57c697599c4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] [instance: f08028cf-a9fa-4b2c-9796-0e5a8c172ab5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:09.060527 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d9f0bacf-ba84-4e30-9b50-a57c697599c4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:09.066466 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d9f0bacf-ba84-4e30-9b50-a57c697599c4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:09.067121 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d9f0bacf-ba84-4e30-9b50-a57c697599c4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:09.068021 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d9f0bacf-ba84-4e30-9b50-a57c697599c4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:09.070416 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d9f0bacf-ba84-4e30-9b50-a57c697599c4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:09.070858 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d9f0bacf-ba84-4e30-9b50-a57c697599c4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:09.112878 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d9f0bacf-ba84-4e30-9b50-a57c697599c4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:09.113326 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d9f0bacf-ba84-4e30-9b50-a57c697599c4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:09.113776 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d9f0bacf-ba84-4e30-9b50-a57c697599c4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:09.114397 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-d9f0bacf-ba84-4e30-9b50-a57c697599c4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lazy-loading 'fault' on Instance uuid f08028cf-a9fa-4b2c-9796-0e5a8c172ab5 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:27:09.250502 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-62ba6a11-88df-4a0a-8060-fa9a6536efab tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948aaf46e1ac4c129dca02cd2dd903e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f41f5c65be49aaa04853c29904bba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:09.258460 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-62ba6a11-88df-4a0a-8060-fa9a6536efab tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] 10.222.0.13 "GET /compute/v2.1/servers/5f9e19c8-0739-4341-bc2c-31e9384de9de" status: 200 len: 1274 microversion: 2.1 time: 0.337163 Oct 30 01:27:09.259040 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1593/3161] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:27:08 2022] GET /compute/v2.1/servers/5f9e19c8-0739-4341-bc2c-31e9384de9de => generated 1274 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:09.272526 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-415a0cd3-d6f9-4470-a1dd-c604b84b5756 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1326097464"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:27:09.275278 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d9f0bacf-ba84-4e30-9b50-a57c697599c4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:09.291990 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-415a0cd3-d6f9-4470-a1dd-c604b84b5756 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: b4259dcb-d421-45fb-84e6-7e8a8f7ce20d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:09.294337 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d9f0bacf-ba84-4e30-9b50-a57c697599c4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:09.303052 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d9f0bacf-ba84-4e30-9b50-a57c697599c4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:09.310630 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d9f0bacf-ba84-4e30-9b50-a57c697599c4 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] 10.222.0.13 "GET /compute/v2.1/servers/f08028cf-a9fa-4b2c-9796-0e5a8c172ab5" status: 200 len: 1367 microversion: 2.47 time: 0.281736 Oct 30 01:27:09.311247 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1569/3162] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:27:09 2022] GET /compute/v2.1/servers/f08028cf-a9fa-4b2c-9796-0e5a8c172ab5 => generated 1367 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:27:09.315417 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-415a0cd3-d6f9-4470-a1dd-c604b84b5756 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:09.326826 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-415a0cd3-d6f9-4470-a1dd-c604b84b5756 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:09.329907 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-415a0cd3-d6f9-4470-a1dd-c604b84b5756 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:09.330874 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-415a0cd3-d6f9-4470-a1dd-c604b84b5756 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:09.331538 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-415a0cd3-d6f9-4470-a1dd-c604b84b5756 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:09.334703 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-415a0cd3-d6f9-4470-a1dd-c604b84b5756 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:09.946146 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0d8ae234-64e6-4b52-bb98-88cc76a4ded6 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:09.946952 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0d8ae234-64e6-4b52-bb98-88cc76a4ded6 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: edf8f5ea-58fd-4226-b75c-0138fbdd6ae4] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:09.956171 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d8ae234-64e6-4b52-bb98-88cc76a4ded6 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:09.956810 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d8ae234-64e6-4b52-bb98-88cc76a4ded6 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:09.957431 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d8ae234-64e6-4b52-bb98-88cc76a4ded6 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:09.958545 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d8ae234-64e6-4b52-bb98-88cc76a4ded6 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:09.959260 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d8ae234-64e6-4b52-bb98-88cc76a4ded6 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:09.959781 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d8ae234-64e6-4b52-bb98-88cc76a4ded6 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:10.086157 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-415a0cd3-d6f9-4470-a1dd-c604b84b5756 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "POST /compute/v2.1/servers/b4259dcb-d421-45fb-84e6-7e8a8f7ce20d/action" status: 202 len: 0 microversion: 2.1 time: 0.817883 Oct 30 01:27:10.098270 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1594/3163] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:27:09 2022] POST /compute/v2.1/servers/b4259dcb-d421-45fb-84e6-7e8a8f7ce20d/action => generated 0 bytes in 832 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 30 01:27:10.113673 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bbeef537-0511-48d4-afa8-e841283e7140 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44d02d6670>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:10.180831 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bbeef537-0511-48d4-afa8-e841283e7140 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/dca8deb4-b525-42b4-860c-8ee77a764df8" status: 200 len: 1412 microversion: 2.1 time: 0.072236 Oct 30 01:27:10.182137 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1595/3164] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:27:10 2022] GET /compute/v2.1/images/dca8deb4-b525-42b4-860c-8ee77a764df8 => generated 1412 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:10.286410 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e077e055-3b0f-4f33-a28e-4fa4f43966bf tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:10.287356 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e077e055-3b0f-4f33-a28e-4fa4f43966bf tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] [instance: 5f9e19c8-0739-4341-bc2c-31e9384de9de] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:10.301112 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e077e055-3b0f-4f33-a28e-4fa4f43966bf tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:10.301668 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e077e055-3b0f-4f33-a28e-4fa4f43966bf tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:10.302119 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e077e055-3b0f-4f33-a28e-4fa4f43966bf tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:10.302857 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e077e055-3b0f-4f33-a28e-4fa4f43966bf tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:10.303316 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e077e055-3b0f-4f33-a28e-4fa4f43966bf tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:10.303747 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e077e055-3b0f-4f33-a28e-4fa4f43966bf tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:10.387794 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0d8ae234-64e6-4b52-bb98-88cc76a4ded6 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07f2b8c31f54c62aaba73ca2bd2edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c59bd73c7874a00b52ec7c5c4142039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:10.398009 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0d8ae234-64e6-4b52-bb98-88cc76a4ded6 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] 10.222.0.13 "GET /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4" status: 200 len: 1676 microversion: 2.1 time: 0.456251 Oct 30 01:27:10.414220 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1570/3165] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:27:09 2022] GET /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4 => generated 1676 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:10.421185 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6cda381f-33dd-48a4-b35b-18188b445daf tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:10.422201 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6cda381f-33dd-48a4-b35b-18188b445daf tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] [instance: f08028cf-a9fa-4b2c-9796-0e5a8c172ab5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:10.428669 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6cda381f-33dd-48a4-b35b-18188b445daf tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:10.429498 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6cda381f-33dd-48a4-b35b-18188b445daf tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:10.430087 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6cda381f-33dd-48a4-b35b-18188b445daf tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:10.438783 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6cda381f-33dd-48a4-b35b-18188b445daf tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:10.438783 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6cda381f-33dd-48a4-b35b-18188b445daf tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:10.439334 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e077e055-3b0f-4f33-a28e-4fa4f43966bf tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948aaf46e1ac4c129dca02cd2dd903e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f41f5c65be49aaa04853c29904bba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:10.439458 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6cda381f-33dd-48a4-b35b-18188b445daf tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:10.446900 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e077e055-3b0f-4f33-a28e-4fa4f43966bf tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] 10.222.0.13 "GET /compute/v2.1/servers/5f9e19c8-0739-4341-bc2c-31e9384de9de" status: 200 len: 1274 microversion: 2.1 time: 0.164595 Oct 30 01:27:10.448185 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1596/3166] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:27:10 2022] GET /compute/v2.1/servers/5f9e19c8-0739-4341-bc2c-31e9384de9de => generated 1274 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:27:10.469977 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-6cda381f-33dd-48a4-b35b-18188b445daf tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] HTTP exception thrown: Instance f08028cf-a9fa-4b2c-9796-0e5a8c172ab5 could not be found. Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6cda381f-33dd-48a4-b35b-18188b445daf tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Request method failure captured: Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/f08028cf-a9fa-4b2c-9796-0e5a8c172ab5 HTTP/1.1 Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdKywIzrIVrMuZgLaEVIQ-xh4WYdeToymClO-BN5F4ILwrnjdRkmUUDjBCjtQoYgHQX66DWQ2Qt3A5wHxcJMQ342mAtmCG7Z8Pv4cji2bI2BohAtoRr5VJiAQw35NxKY64MoHL29EFVDQHhb6jMsNt7KFgR6L0WMQdlstw8F9H61LFE Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: X-Openstack-Nova-Api-Version: 2.47 Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 98c4b4fec5574b8abd29e56df1fdc822 Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServerShowV247Test-921818043 Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/98c4b4fec5574b8abd29e56df1fdc822"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_98c4b4fec5574b8abd29e56df1fdc822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/98c4b4fec5574b8abd29e56df1fdc822"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/98c4b4fec5574b8abd29e56df1fdc822"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServerShowV247Test-921818043 Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 98c4b4fec5574b8abd29e56df1fdc822 Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServerShowV247Test-921818043 Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServerShowV247Test-921818043-project Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: fb8201c608b3417dafc84e520603d1c0 Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServerShowV247Test-921818043-project Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: exception: Instance f08028cf-a9fa-4b2c-9796-0e5a8c172ab5 could not be found. Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'f08028cf-a9fa-4b2c-9796-0e5a8c172ab5'} Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f08028cf-a9fa-4b2c-9796-0e5a8c172ab5 could not be found. Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f08028cf-a9fa-4b2c-9796-0e5a8c172ab5 could not be found. Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:27:10.471912 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:27:10.476470 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:27:10.476470 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:27:10.476470 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:27:10.476470 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:27:10.476470 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:27:10.476470 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f08028cf-a9fa-4b2c-9796-0e5a8c172ab5 could not be found. Oct 30 01:27:10.476470 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:27:10.476470 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6cda381f-33dd-48a4-b35b-18188b445daf tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Returning 404 to user: Instance f08028cf-a9fa-4b2c-9796-0e5a8c172ab5 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:27:10.476470 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6cda381f-33dd-48a4-b35b-18188b445daf tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] 10.222.0.13 "GET /compute/v2.1/servers/f08028cf-a9fa-4b2c-9796-0e5a8c172ab5" status: 404 len: 111 microversion: 2.47 time: 0.057622 Oct 30 01:27:10.476470 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1571/3167] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:27:10 2022] GET /compute/v2.1/servers/f08028cf-a9fa-4b2c-9796-0e5a8c172ab5 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:27:10.485999 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9b02d094-122a-4a0f-8c23-4b121ae82ed0 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:10.485999 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9b02d094-122a-4a0f-8c23-4b121ae82ed0 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] [instance: f0a37c74-9ecf-44ee-ad07-72bc8601d2d6] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:10.491449 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b02d094-122a-4a0f-8c23-4b121ae82ed0 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:10.492413 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b02d094-122a-4a0f-8c23-4b121ae82ed0 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:10.493030 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b02d094-122a-4a0f-8c23-4b121ae82ed0 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:10.493957 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b02d094-122a-4a0f-8c23-4b121ae82ed0 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:10.494410 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b02d094-122a-4a0f-8c23-4b121ae82ed0 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:10.494830 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b02d094-122a-4a0f-8c23-4b121ae82ed0 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:10.522579 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9b02d094-122a-4a0f-8c23-4b121ae82ed0 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] [instance: f0a37c74-9ecf-44ee-ad07-72bc8601d2d6] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:27:11.126653 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-6b5ed07d-43e4-4657-9ddb-a1175114bf17 req-59800c3e-17d4-4695-b305-67b2c80b0681 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edf8f5ea-58fd-4226-b75c-0138fbdd6ae4", "name": "network-vif-deleted", "tag": "c3b52eab-87c2-44f0-b9ce-f134032c1805"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:27:11.146916 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-6b5ed07d-43e4-4657-9ddb-a1175114bf17 req-59800c3e-17d4-4695-b305-67b2c80b0681 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:11.147170 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9b02d094-122a-4a0f-8c23-4b121ae82ed0 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f0a37c74-9ecf-44ee-ad07-72bc8601d2d6" status: 204 len: 0 microversion: 2.47 time: 0.668020 Oct 30 01:27:11.147659 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-6b5ed07d-43e4-4657-9ddb-a1175114bf17 req-59800c3e-17d4-4695-b305-67b2c80b0681 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:11.147824 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-6b5ed07d-43e4-4657-9ddb-a1175114bf17 req-59800c3e-17d4-4695-b305-67b2c80b0681 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:11.152100 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1597/3168] 10.222.0.13 () {60 vars in 1280 bytes} [Sun Oct 30 01:27:10 2022] DELETE /compute/v2.1/servers/f0a37c74-9ecf-44ee-ad07-72bc8601d2d6 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 30 01:27:11.161899 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-223ee9b8-53d7-4842-8d77-1ce4ec12fbdb tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:11.174532 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-223ee9b8-53d7-4842-8d77-1ce4ec12fbdb tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] [instance: f0a37c74-9ecf-44ee-ad07-72bc8601d2d6] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:11.180209 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-6b5ed07d-43e4-4657-9ddb-a1175114bf17 req-59800c3e-17d4-4695-b305-67b2c80b0681 service nova] Creating event network-vif-deleted:c3b52eab-87c2-44f0-b9ce-f134032c1805 for instance edf8f5ea-58fd-4226-b75c-0138fbdd6ae4 on n-h2-master-1 Oct 30 01:27:11.181526 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-223ee9b8-53d7-4842-8d77-1ce4ec12fbdb tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:11.184881 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-223ee9b8-53d7-4842-8d77-1ce4ec12fbdb tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:11.187933 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-223ee9b8-53d7-4842-8d77-1ce4ec12fbdb tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:11.188690 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-223ee9b8-53d7-4842-8d77-1ce4ec12fbdb tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:11.189093 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-6b5ed07d-43e4-4657-9ddb-a1175114bf17 req-59800c3e-17d4-4695-b305-67b2c80b0681 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068873 Oct 30 01:27:11.189223 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-223ee9b8-53d7-4842-8d77-1ce4ec12fbdb tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:11.192947 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1572/3169] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:27:11.195989 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-223ee9b8-53d7-4842-8d77-1ce4ec12fbdb tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:11.206496 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-063d27bf-3199-4064-8d2f-b643bce07c9e tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44cc2f8430>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:11.327829 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-063d27bf-3199-4064-8d2f-b643bce07c9e tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/dca8deb4-b525-42b4-860c-8ee77a764df8" status: 200 len: 1412 microversion: 2.1 time: 0.124250 Oct 30 01:27:11.328521 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1573/3170] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:27:11 2022] GET /compute/v2.1/images/dca8deb4-b525-42b4-860c-8ee77a764df8 => generated 1412 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:11.369193 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-223ee9b8-53d7-4842-8d77-1ce4ec12fbdb tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:11.398977 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-223ee9b8-53d7-4842-8d77-1ce4ec12fbdb tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:11.404997 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-223ee9b8-53d7-4842-8d77-1ce4ec12fbdb tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:11.409544 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-223ee9b8-53d7-4842-8d77-1ce4ec12fbdb tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] 10.222.0.13 "GET /compute/v2.1/servers/f0a37c74-9ecf-44ee-ad07-72bc8601d2d6" status: 200 len: 1363 microversion: 2.47 time: 0.252421 Oct 30 01:27:11.419825 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1598/3171] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:27:11 2022] GET /compute/v2.1/servers/f0a37c74-9ecf-44ee-ad07-72bc8601d2d6 => generated 1363 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:27:11.437239 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3fef5814-fd5f-4ba8-a444-42ad06e2543e tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:11.438768 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3fef5814-fd5f-4ba8-a444-42ad06e2543e tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: edf8f5ea-58fd-4226-b75c-0138fbdd6ae4] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:11.452967 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3fef5814-fd5f-4ba8-a444-42ad06e2543e tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:11.453512 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3fef5814-fd5f-4ba8-a444-42ad06e2543e tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:11.453956 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3fef5814-fd5f-4ba8-a444-42ad06e2543e tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:11.455024 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3fef5814-fd5f-4ba8-a444-42ad06e2543e tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:11.455478 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3fef5814-fd5f-4ba8-a444-42ad06e2543e tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:11.455905 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3fef5814-fd5f-4ba8-a444-42ad06e2543e tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:11.474476 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-dfd3b213-135b-4e0e-9906-4cea30c08b3d tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:11.475104 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-dfd3b213-135b-4e0e-9906-4cea30c08b3d tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] [instance: 5f9e19c8-0739-4341-bc2c-31e9384de9de] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:11.481457 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dfd3b213-135b-4e0e-9906-4cea30c08b3d tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:11.484177 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dfd3b213-135b-4e0e-9906-4cea30c08b3d tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:11.484839 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dfd3b213-135b-4e0e-9906-4cea30c08b3d tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:11.485665 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dfd3b213-135b-4e0e-9906-4cea30c08b3d tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:11.486142 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dfd3b213-135b-4e0e-9906-4cea30c08b3d tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:11.486601 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dfd3b213-135b-4e0e-9906-4cea30c08b3d tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:11.712547 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:27:11.740632 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=30 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:27:12.455792 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-dfd3b213-135b-4e0e-9906-4cea30c08b3d tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948aaf46e1ac4c129dca02cd2dd903e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f41f5c65be49aaa04853c29904bba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:12.464340 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-dfd3b213-135b-4e0e-9906-4cea30c08b3d tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] 10.222.0.13 "GET /compute/v2.1/servers/5f9e19c8-0739-4341-bc2c-31e9384de9de" status: 200 len: 1316 microversion: 2.1 time: 0.993835 Oct 30 01:27:12.477979 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1599/3172] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:27:11 2022] GET /compute/v2.1/servers/5f9e19c8-0739-4341-bc2c-31e9384de9de => generated 1316 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:27:12.487288 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2d92266f-50e2-452e-a0b2-67d2b7072f7d tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44c77d1d30>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:12.535047 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2d92266f-50e2-452e-a0b2-67d2b7072f7d tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/dca8deb4-b525-42b4-860c-8ee77a764df8" status: 200 len: 1412 microversion: 2.1 time: 0.055719 Oct 30 01:27:12.543601 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1600/3173] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:27:12 2022] GET /compute/v2.1/images/dca8deb4-b525-42b4-860c-8ee77a764df8 => generated 1412 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:12.548805 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-07755e4e-b101-4bcb-8976-512349390e8d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:12.549465 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-07755e4e-b101-4bcb-8976-512349390e8d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] [instance: f0a37c74-9ecf-44ee-ad07-72bc8601d2d6] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:12.553300 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3fef5814-fd5f-4ba8-a444-42ad06e2543e tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07f2b8c31f54c62aaba73ca2bd2edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c59bd73c7874a00b52ec7c5c4142039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:12.556994 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-07755e4e-b101-4bcb-8976-512349390e8d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:12.557458 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-07755e4e-b101-4bcb-8976-512349390e8d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:12.557889 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-07755e4e-b101-4bcb-8976-512349390e8d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:12.558581 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-07755e4e-b101-4bcb-8976-512349390e8d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:12.559283 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-07755e4e-b101-4bcb-8976-512349390e8d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:12.559921 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-07755e4e-b101-4bcb-8976-512349390e8d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:12.565743 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3fef5814-fd5f-4ba8-a444-42ad06e2543e tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] 10.222.0.13 "GET /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4" status: 200 len: 1497 microversion: 2.1 time: 1.137477 Oct 30 01:27:12.567281 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1574/3174] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:27:11 2022] GET /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4 => generated 1497 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:12.634284 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-07755e4e-b101-4bcb-8976-512349390e8d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:12.645303 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-07755e4e-b101-4bcb-8976-512349390e8d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:12.647099 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-07755e4e-b101-4bcb-8976-512349390e8d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:12.648630 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-07755e4e-b101-4bcb-8976-512349390e8d tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] 10.222.0.13 "GET /compute/v2.1/servers/f0a37c74-9ecf-44ee-ad07-72bc8601d2d6" status: 200 len: 1363 microversion: 2.47 time: 0.111316 Oct 30 01:27:12.649686 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1601/3175] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:27:12 2022] GET /compute/v2.1/servers/f0a37c74-9ecf-44ee-ad07-72bc8601d2d6 => generated 1363 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:27:13.432237 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-40a45c46-3522-47b5-a08c-808c25312ce8 req-f73b3359-10b7-43fc-be39-b9fdef91b4a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edf8f5ea-58fd-4226-b75c-0138fbdd6ae4", "name": "network-vif-deleted", "tag": "e018e410-e769-4fd0-bbc8-a179d701cfc4"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:27:13.456511 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-40a45c46-3522-47b5-a08c-808c25312ce8 req-f73b3359-10b7-43fc-be39-b9fdef91b4a0 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:13.458253 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-40a45c46-3522-47b5-a08c-808c25312ce8 req-f73b3359-10b7-43fc-be39-b9fdef91b4a0 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:13.459476 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-40a45c46-3522-47b5-a08c-808c25312ce8 req-f73b3359-10b7-43fc-be39-b9fdef91b4a0 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:13.479953 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-40a45c46-3522-47b5-a08c-808c25312ce8 req-f73b3359-10b7-43fc-be39-b9fdef91b4a0 service nova] Creating event network-vif-deleted:e018e410-e769-4fd0-bbc8-a179d701cfc4 for instance edf8f5ea-58fd-4226-b75c-0138fbdd6ae4 on n-h2-master-1 Oct 30 01:27:13.489789 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9f024685-b301-4931-8d06-9909c6e89dc9 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:13.490786 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-40a45c46-3522-47b5-a08c-808c25312ce8 req-f73b3359-10b7-43fc-be39-b9fdef91b4a0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063328 Oct 30 01:27:13.491348 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9f024685-b301-4931-8d06-9909c6e89dc9 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] [instance: 5f9e19c8-0739-4341-bc2c-31e9384de9de] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:13.493660 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1575/3176] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:27:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:27:13.501086 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9f024685-b301-4931-8d06-9909c6e89dc9 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:13.501684 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9f024685-b301-4931-8d06-9909c6e89dc9 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:13.502338 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9f024685-b301-4931-8d06-9909c6e89dc9 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:13.503273 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9f024685-b301-4931-8d06-9909c6e89dc9 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:13.504155 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9f024685-b301-4931-8d06-9909c6e89dc9 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:13.504611 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9f024685-b301-4931-8d06-9909c6e89dc9 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:13.553635 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3f90750f-61b2-4a36-b427-8492b83350ac tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44c7e7edc0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:13.610556 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=4 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:27:13.625181 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3f90750f-61b2-4a36-b427-8492b83350ac tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/dca8deb4-b525-42b4-860c-8ee77a764df8" status: 200 len: 1412 microversion: 2.1 time: 0.076871 Oct 30 01:27:13.626096 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1576/3177] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:27:13 2022] GET /compute/v2.1/images/dca8deb4-b525-42b4-860c-8ee77a764df8 => generated 1412 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:13.637979 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-e754409e-8e03-4179-8615-33f6de6284e5 req-4989f340-00dc-41da-afaf-9390db03a638 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f9e19c8-0739-4341-bc2c-31e9384de9de", "tag": "ab261b34-5348-4002-b4f3-a452f16ce1ef"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:27:13.652803 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e754409e-8e03-4179-8615-33f6de6284e5 req-4989f340-00dc-41da-afaf-9390db03a638 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:13.655244 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e754409e-8e03-4179-8615-33f6de6284e5 req-4989f340-00dc-41da-afaf-9390db03a638 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:13.655244 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e754409e-8e03-4179-8615-33f6de6284e5 req-4989f340-00dc-41da-afaf-9390db03a638 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:13.665822 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-e754409e-8e03-4179-8615-33f6de6284e5 req-4989f340-00dc-41da-afaf-9390db03a638 service nova] Creating event network-changed:ab261b34-5348-4002-b4f3-a452f16ce1ef for instance 5f9e19c8-0739-4341-bc2c-31e9384de9de on n-h1-master-1 Oct 30 01:27:13.672389 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-e754409e-8e03-4179-8615-33f6de6284e5 req-4989f340-00dc-41da-afaf-9390db03a638 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044557 Oct 30 01:27:13.673588 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1577/3178] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:27:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:27:13.685976 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ba02c264-9987-4edd-866c-6de6bf719999 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:13.685976 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ba02c264-9987-4edd-866c-6de6bf719999 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: edf8f5ea-58fd-4226-b75c-0138fbdd6ae4] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:13.689719 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ba02c264-9987-4edd-866c-6de6bf719999 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:13.690218 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ba02c264-9987-4edd-866c-6de6bf719999 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:13.690977 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ba02c264-9987-4edd-866c-6de6bf719999 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:13.691855 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ba02c264-9987-4edd-866c-6de6bf719999 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:13.692455 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ba02c264-9987-4edd-866c-6de6bf719999 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:13.693045 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ba02c264-9987-4edd-866c-6de6bf719999 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:13.819964 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ba02c264-9987-4edd-866c-6de6bf719999 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07f2b8c31f54c62aaba73ca2bd2edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c59bd73c7874a00b52ec7c5c4142039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:13.829826 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ba02c264-9987-4edd-866c-6de6bf719999 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] 10.222.0.13 "GET /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4" status: 200 len: 1298 microversion: 2.1 time: 0.152549 Oct 30 01:27:13.838828 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1578/3179] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:27:13 2022] GET /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4 => generated 1298 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:13.845883 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-07bc1dd6-dbe0-4011-a121-249953fe61ab tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:13.847183 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-07bc1dd6-dbe0-4011-a121-249953fe61ab tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] [instance: f0a37c74-9ecf-44ee-ad07-72bc8601d2d6] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:13.856930 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-07bc1dd6-dbe0-4011-a121-249953fe61ab tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:13.858981 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-07bc1dd6-dbe0-4011-a121-249953fe61ab tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:13.860635 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-07bc1dd6-dbe0-4011-a121-249953fe61ab tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:13.861888 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-07bc1dd6-dbe0-4011-a121-249953fe61ab tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:13.862514 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-07bc1dd6-dbe0-4011-a121-249953fe61ab tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:13.863037 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-07bc1dd6-dbe0-4011-a121-249953fe61ab tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:13.922082 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9f024685-b301-4931-8d06-9909c6e89dc9 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948aaf46e1ac4c129dca02cd2dd903e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f41f5c65be49aaa04853c29904bba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:13.941555 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9f024685-b301-4931-8d06-9909c6e89dc9 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] 10.222.0.13 "GET /compute/v2.1/servers/5f9e19c8-0739-4341-bc2c-31e9384de9de" status: 200 len: 1316 microversion: 2.1 time: 0.451883 Oct 30 01:27:13.943454 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1602/3180] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:27:13 2022] GET /compute/v2.1/servers/5f9e19c8-0739-4341-bc2c-31e9384de9de => generated 1316 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:27:14.093363 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=10 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:27:14.139258 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-07bc1dd6-dbe0-4011-a121-249953fe61ab tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:14.154905 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-07bc1dd6-dbe0-4011-a121-249953fe61ab tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:14.156411 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-07bc1dd6-dbe0-4011-a121-249953fe61ab tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:14.157661 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-07bc1dd6-dbe0-4011-a121-249953fe61ab tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] 10.222.0.13 "GET /compute/v2.1/servers/f0a37c74-9ecf-44ee-ad07-72bc8601d2d6" status: 200 len: 1363 microversion: 2.47 time: 0.317226 Oct 30 01:27:14.158231 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1579/3181] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:27:13 2022] GET /compute/v2.1/servers/f0a37c74-9ecf-44ee-ad07-72bc8601d2d6 => generated 1363 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:27:14.658364 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-76b6e2dc-7704-4df8-b958-0ddf4b0b935a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44d0453af0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:14.745315 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-76b6e2dc-7704-4df8-b958-0ddf4b0b935a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/dca8deb4-b525-42b4-860c-8ee77a764df8" status: 200 len: 1412 microversion: 2.1 time: 0.108591 Oct 30 01:27:14.755943 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1603/3182] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:27:14 2022] GET /compute/v2.1/images/dca8deb4-b525-42b4-860c-8ee77a764df8 => generated 1412 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:14.870452 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-902bc98e-e3a0-4db4-817e-87daed2b5315 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:14.871480 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-902bc98e-e3a0-4db4-817e-87daed2b5315 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: edf8f5ea-58fd-4226-b75c-0138fbdd6ae4] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:14.912559 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-902bc98e-e3a0-4db4-817e-87daed2b5315 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:14.913284 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-902bc98e-e3a0-4db4-817e-87daed2b5315 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:14.913905 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-902bc98e-e3a0-4db4-817e-87daed2b5315 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:14.915846 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-902bc98e-e3a0-4db4-817e-87daed2b5315 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:14.916492 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-902bc98e-e3a0-4db4-817e-87daed2b5315 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:14.917446 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-902bc98e-e3a0-4db4-817e-87daed2b5315 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:14.974757 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-96f7cb7d-fc37-428e-a698-073ca3c72410 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:14.976553 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-96f7cb7d-fc37-428e-a698-073ca3c72410 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] [instance: 5f9e19c8-0739-4341-bc2c-31e9384de9de] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:14.992909 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96f7cb7d-fc37-428e-a698-073ca3c72410 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:14.997841 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96f7cb7d-fc37-428e-a698-073ca3c72410 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:14.999439 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96f7cb7d-fc37-428e-a698-073ca3c72410 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:15.003386 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96f7cb7d-fc37-428e-a698-073ca3c72410 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:15.004084 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96f7cb7d-fc37-428e-a698-073ca3c72410 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:15.005252 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96f7cb7d-fc37-428e-a698-073ca3c72410 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:15.037413 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-902bc98e-e3a0-4db4-817e-87daed2b5315 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:15.038216 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-902bc98e-e3a0-4db4-817e-87daed2b5315 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:15.039695 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-902bc98e-e3a0-4db4-817e-87daed2b5315 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:15.039695 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-902bc98e-e3a0-4db4-817e-87daed2b5315 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lazy-loading 'fault' on Instance uuid edf8f5ea-58fd-4226-b75c-0138fbdd6ae4 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:27:15.282261 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-902bc98e-e3a0-4db4-817e-87daed2b5315 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07f2b8c31f54c62aaba73ca2bd2edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c59bd73c7874a00b52ec7c5c4142039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:15.300605 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-902bc98e-e3a0-4db4-817e-87daed2b5315 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] 10.222.0.13 "GET /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4" status: 200 len: 1303 microversion: 2.1 time: 0.440684 Oct 30 01:27:15.301792 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1580/3183] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:27:14 2022] GET /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4 => generated 1303 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:15.307121 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c7207eb2-c4d4-45d7-a5a9-e01a6923b81f tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:15.307749 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c7207eb2-c4d4-45d7-a5a9-e01a6923b81f tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] [instance: f0a37c74-9ecf-44ee-ad07-72bc8601d2d6] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:15.339585 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c7207eb2-c4d4-45d7-a5a9-e01a6923b81f tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:15.339585 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c7207eb2-c4d4-45d7-a5a9-e01a6923b81f tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:15.339585 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c7207eb2-c4d4-45d7-a5a9-e01a6923b81f tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:15.339823 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c7207eb2-c4d4-45d7-a5a9-e01a6923b81f tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:15.340183 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c7207eb2-c4d4-45d7-a5a9-e01a6923b81f tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:15.344513 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c7207eb2-c4d4-45d7-a5a9-e01a6923b81f tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:15.449281 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c7207eb2-c4d4-45d7-a5a9-e01a6923b81f tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:15.449804 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c7207eb2-c4d4-45d7-a5a9-e01a6923b81f tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:15.450347 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c7207eb2-c4d4-45d7-a5a9-e01a6923b81f tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:15.451060 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-c7207eb2-c4d4-45d7-a5a9-e01a6923b81f tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lazy-loading 'fault' on Instance uuid f0a37c74-9ecf-44ee-ad07-72bc8601d2d6 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:27:15.683964 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c7207eb2-c4d4-45d7-a5a9-e01a6923b81f tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:15.699102 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c7207eb2-c4d4-45d7-a5a9-e01a6923b81f tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:15.704868 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c7207eb2-c4d4-45d7-a5a9-e01a6923b81f tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8201c608b3417dafc84e520603d1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4b4fec5574b8abd29e56df1fdc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:15.706691 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c7207eb2-c4d4-45d7-a5a9-e01a6923b81f tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] 10.222.0.13 "GET /compute/v2.1/servers/f0a37c74-9ecf-44ee-ad07-72bc8601d2d6" status: 200 len: 1368 microversion: 2.47 time: 0.403765 Oct 30 01:27:15.709473 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1581/3184] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:27:15 2022] GET /compute/v2.1/servers/f0a37c74-9ecf-44ee-ad07-72bc8601d2d6 => generated 1368 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:27:15.712075 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-96f7cb7d-fc37-428e-a698-073ca3c72410 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948aaf46e1ac4c129dca02cd2dd903e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f41f5c65be49aaa04853c29904bba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:15.742380 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-96f7cb7d-fc37-428e-a698-073ca3c72410 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] 10.222.0.13 "GET /compute/v2.1/servers/5f9e19c8-0739-4341-bc2c-31e9384de9de" status: 200 len: 1316 microversion: 2.1 time: 0.773877 Oct 30 01:27:15.754462 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1604/3185] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:27:14 2022] GET /compute/v2.1/servers/5f9e19c8-0739-4341-bc2c-31e9384de9de => generated 1316 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:27:15.765947 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5f8f9173-d7d4-460a-ac4f-56ae7c814e51 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44c7ebb1f0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:15.835089 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5f8f9173-d7d4-460a-ac4f-56ae7c814e51 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/dca8deb4-b525-42b4-860c-8ee77a764df8" status: 200 len: 1412 microversion: 2.1 time: 0.072361 Oct 30 01:27:15.837527 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1582/3186] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:27:15 2022] GET /compute/v2.1/images/dca8deb4-b525-42b4-860c-8ee77a764df8 => generated 1412 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:16.107466 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-246cef8d-50e8-4100-8515-cc6915eaa5c2 req-f8ee2c35-2c06-4b51-85b3-ba7b5e8bdda7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4259dcb-d421-45fb-84e6-7e8a8f7ce20d", "name": "network-vif-plugged", "status": "completed", "tag": "f4115819-6c96-4bc9-a7c1-221d92ea37ec"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:27:16.126567 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-246cef8d-50e8-4100-8515-cc6915eaa5c2 req-f8ee2c35-2c06-4b51-85b3-ba7b5e8bdda7 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:16.128355 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-246cef8d-50e8-4100-8515-cc6915eaa5c2 req-f8ee2c35-2c06-4b51-85b3-ba7b5e8bdda7 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:16.128994 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-246cef8d-50e8-4100-8515-cc6915eaa5c2 req-f8ee2c35-2c06-4b51-85b3-ba7b5e8bdda7 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:16.166439 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-246cef8d-50e8-4100-8515-cc6915eaa5c2 req-f8ee2c35-2c06-4b51-85b3-ba7b5e8bdda7 service nova] Creating event network-vif-plugged:f4115819-6c96-4bc9-a7c1-221d92ea37ec for instance b4259dcb-d421-45fb-84e6-7e8a8f7ce20d on n-h1-master-1 Oct 30 01:27:16.172698 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-246cef8d-50e8-4100-8515-cc6915eaa5c2 req-f8ee2c35-2c06-4b51-85b3-ba7b5e8bdda7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069140 Oct 30 01:27:16.173948 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1605/3187] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:27:16.329741 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0051c938-109e-4f7e-9db6-8dc6f86d5a7a tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:16.331483 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0051c938-109e-4f7e-9db6-8dc6f86d5a7a tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: edf8f5ea-58fd-4226-b75c-0138fbdd6ae4] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:16.359584 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0051c938-109e-4f7e-9db6-8dc6f86d5a7a tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:16.361197 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0051c938-109e-4f7e-9db6-8dc6f86d5a7a tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:16.362543 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0051c938-109e-4f7e-9db6-8dc6f86d5a7a tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:16.365861 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0051c938-109e-4f7e-9db6-8dc6f86d5a7a tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:16.366717 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0051c938-109e-4f7e-9db6-8dc6f86d5a7a tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:16.368622 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0051c938-109e-4f7e-9db6-8dc6f86d5a7a tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:16.401729 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-0051c938-109e-4f7e-9db6-8dc6f86d5a7a tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] HTTP exception thrown: Instance edf8f5ea-58fd-4226-b75c-0138fbdd6ae4 could not be found. Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0051c938-109e-4f7e-9db6-8dc6f86d5a7a tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Request method failure captured: Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4 HTTP/1.1 Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdJr-vSoZanPnPVilvoAflboAr3cSFQBUxYWvsa8_cZpjEapRWY2N6m9rWhCI2JtURKxLRhkRvkctLNpIiN4TVHqY_YC3amdNtOfM6wU3MIQLQCfCaT-WA5iUAKugn9ry0pb8FrVeVuzHf2DIElxquUC3dfXuf-g1DEAno4NYR3z5PE Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 2c59bd73c7874a00b52ec7c5c4142039 Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersTestMultiNic-609219501 Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2c59bd73c7874a00b52ec7c5c4142039"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2c59bd73c7874a00b52ec7c5c4142039"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2c59bd73c7874a00b52ec7c5c4142039"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2c59bd73c7874a00b52ec7c5c4142039"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersTestMultiNic-609219501 Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 2c59bd73c7874a00b52ec7c5c4142039 Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersTestMultiNic-609219501 Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersTestMultiNic-609219501-project Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: a07f2b8c31f54c62aaba73ca2bd2edb8 Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersTestMultiNic-609219501-project Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: exception: Instance edf8f5ea-58fd-4226-b75c-0138fbdd6ae4 could not be found. Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'edf8f5ea-58fd-4226-b75c-0138fbdd6ae4'} Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edf8f5ea-58fd-4226-b75c-0138fbdd6ae4 could not be found. Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edf8f5ea-58fd-4226-b75c-0138fbdd6ae4 could not be found. Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:27:16.405467 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:27:16.411010 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:27:16.411010 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:27:16.411010 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:27:16.411010 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:27:16.411010 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:27:16.411010 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edf8f5ea-58fd-4226-b75c-0138fbdd6ae4 could not be found. Oct 30 01:27:16.411010 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:27:16.413489 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0051c938-109e-4f7e-9db6-8dc6f86d5a7a tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Returning 404 to user: Instance edf8f5ea-58fd-4226-b75c-0138fbdd6ae4 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:27:16.414668 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0051c938-109e-4f7e-9db6-8dc6f86d5a7a tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] 10.222.0.13 "GET /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4" status: 404 len: 111 microversion: 2.1 time: 0.092149 Oct 30 01:27:16.427904 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1583/3188] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:27:16 2022] GET /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:27:16.747739 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c8d79727-31dd-4175-8ebb-cc10ce22f522 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:16.748480 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c8d79727-31dd-4175-8ebb-cc10ce22f522 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] [instance: f0a37c74-9ecf-44ee-ad07-72bc8601d2d6] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:16.760634 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c8d79727-31dd-4175-8ebb-cc10ce22f522 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:16.761425 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c8d79727-31dd-4175-8ebb-cc10ce22f522 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:16.771256 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c8d79727-31dd-4175-8ebb-cc10ce22f522 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:16.771256 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c8d79727-31dd-4175-8ebb-cc10ce22f522 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:16.775401 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7bb38d47-7a50-4b0f-a75e-6def792a9f32 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:16.777156 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7bb38d47-7a50-4b0f-a75e-6def792a9f32 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] [instance: 5f9e19c8-0739-4341-bc2c-31e9384de9de] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:16.783743 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c8d79727-31dd-4175-8ebb-cc10ce22f522 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:16.784491 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c8d79727-31dd-4175-8ebb-cc10ce22f522 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:16.819064 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7bb38d47-7a50-4b0f-a75e-6def792a9f32 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:16.838284 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7bb38d47-7a50-4b0f-a75e-6def792a9f32 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:16.838942 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7bb38d47-7a50-4b0f-a75e-6def792a9f32 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:16.839715 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7bb38d47-7a50-4b0f-a75e-6def792a9f32 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:16.846866 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7bb38d47-7a50-4b0f-a75e-6def792a9f32 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:16.850776 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7bb38d47-7a50-4b0f-a75e-6def792a9f32 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:16.899085 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-c8d79727-31dd-4175-8ebb-cc10ce22f522 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] HTTP exception thrown: Instance f0a37c74-9ecf-44ee-ad07-72bc8601d2d6 could not be found. Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c8d79727-31dd-4175-8ebb-cc10ce22f522 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Request method failure captured: Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/f0a37c74-9ecf-44ee-ad07-72bc8601d2d6 HTTP/1.1 Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdKywIzrIVrMuZgLaEVIQ-xh4WYdeToymClO-BN5F4ILwrnjdRkmUUDjBCjtQoYgHQX66DWQ2Qt3A5wHxcJMQ342mAtmCG7Z8Pv4cji2bI2BohAtoRr5VJiAQw35NxKY64MoHL29EFVDQHhb6jMsNt7KFgR6L0WMQdlstw8F9H61LFE Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: X-Openstack-Nova-Api-Version: 2.47 Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 98c4b4fec5574b8abd29e56df1fdc822 Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServerShowV247Test-921818043 Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/98c4b4fec5574b8abd29e56df1fdc822"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_98c4b4fec5574b8abd29e56df1fdc822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/98c4b4fec5574b8abd29e56df1fdc822"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/98c4b4fec5574b8abd29e56df1fdc822"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServerShowV247Test-921818043 Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 98c4b4fec5574b8abd29e56df1fdc822 Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServerShowV247Test-921818043 Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServerShowV247Test-921818043-project Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: fb8201c608b3417dafc84e520603d1c0 Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServerShowV247Test-921818043-project Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: exception: Instance f0a37c74-9ecf-44ee-ad07-72bc8601d2d6 could not be found. Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'f0a37c74-9ecf-44ee-ad07-72bc8601d2d6'} Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0a37c74-9ecf-44ee-ad07-72bc8601d2d6 could not be found. Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0a37c74-9ecf-44ee-ad07-72bc8601d2d6 could not be found. Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:27:16.931576 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:16.936514 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:27:16.936514 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:27:16.936514 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:27:16.936514 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:27:16.936514 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:27:16.936514 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0a37c74-9ecf-44ee-ad07-72bc8601d2d6 could not be found. Oct 30 01:27:16.936514 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:16.936514 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c8d79727-31dd-4175-8ebb-cc10ce22f522 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] Returning 404 to user: Instance f0a37c74-9ecf-44ee-ad07-72bc8601d2d6 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:27:16.937137 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c8d79727-31dd-4175-8ebb-cc10ce22f522 tempest-ServerShowV247Test-921818043 tempest-ServerShowV247Test-921818043-project] 10.222.0.13 "GET /compute/v2.1/servers/f0a37c74-9ecf-44ee-ad07-72bc8601d2d6" status: 404 len: 111 microversion: 2.47 time: 0.194950 Oct 30 01:27:16.937597 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1606/3189] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:27:16 2022] GET /compute/v2.1/servers/f0a37c74-9ecf-44ee-ad07-72bc8601d2d6 => generated 111 bytes in 197 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:27:16.967695 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7b99b368-531f-47c2-a700-3c486bd9a796 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44d049d820>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:17.062181 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7b99b368-531f-47c2-a700-3c486bd9a796 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/dca8deb4-b525-42b4-860c-8ee77a764df8" status: 200 len: 1412 microversion: 2.1 time: 0.115918 Oct 30 01:27:17.065233 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1607/3190] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:27:16 2022] GET /compute/v2.1/images/dca8deb4-b525-42b4-860c-8ee77a764df8 => generated 1412 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:17.720397 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7bb38d47-7a50-4b0f-a75e-6def792a9f32 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948aaf46e1ac4c129dca02cd2dd903e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f41f5c65be49aaa04853c29904bba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:17.751481 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7bb38d47-7a50-4b0f-a75e-6def792a9f32 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] 10.222.0.13 "GET /compute/v2.1/servers/5f9e19c8-0739-4341-bc2c-31e9384de9de" status: 200 len: 1316 microversion: 2.1 time: 0.983726 Oct 30 01:27:17.754112 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1584/3191] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:27:16 2022] GET /compute/v2.1/servers/5f9e19c8-0739-4341-bc2c-31e9384de9de => generated 1316 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:27:18.082436 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3f6564a3-39b1-4ee7-83ca-52221d658fa6 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44d03deee0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:18.173718 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3f6564a3-39b1-4ee7-83ca-52221d658fa6 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/dca8deb4-b525-42b4-860c-8ee77a764df8" status: 200 len: 1412 microversion: 2.1 time: 0.097086 Oct 30 01:27:18.182783 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1608/3192] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:27:18 2022] GET /compute/v2.1/images/dca8deb4-b525-42b4-860c-8ee77a764df8 => generated 1412 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:18.784056 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-204a2d7a-7887-4ec5-a51c-802bb8776a0e tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:18.784056 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-204a2d7a-7887-4ec5-a51c-802bb8776a0e tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] [instance: 5f9e19c8-0739-4341-bc2c-31e9384de9de] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:18.792259 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-204a2d7a-7887-4ec5-a51c-802bb8776a0e tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:18.799961 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-204a2d7a-7887-4ec5-a51c-802bb8776a0e tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:18.799961 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-204a2d7a-7887-4ec5-a51c-802bb8776a0e tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:18.799961 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-204a2d7a-7887-4ec5-a51c-802bb8776a0e tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:18.799961 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-204a2d7a-7887-4ec5-a51c-802bb8776a0e tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:18.799961 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-204a2d7a-7887-4ec5-a51c-802bb8776a0e tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:19.125207 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-204a2d7a-7887-4ec5-a51c-802bb8776a0e tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948aaf46e1ac4c129dca02cd2dd903e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f41f5c65be49aaa04853c29904bba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:19.186596 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-204a2d7a-7887-4ec5-a51c-802bb8776a0e tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] 10.222.0.13 "GET /compute/v2.1/servers/5f9e19c8-0739-4341-bc2c-31e9384de9de" status: 200 len: 1316 microversion: 2.1 time: 0.407598 Oct 30 01:27:19.197416 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7fe09541-6341-4093-bb1e-277540c86f6b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44d03de1f0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:19.197945 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1585/3193] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:27:18 2022] GET /compute/v2.1/servers/5f9e19c8-0739-4341-bc2c-31e9384de9de => generated 1316 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:19.298911 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7fe09541-6341-4093-bb1e-277540c86f6b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/dca8deb4-b525-42b4-860c-8ee77a764df8" status: 200 len: 1412 microversion: 2.1 time: 0.113593 Oct 30 01:27:19.312775 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1609/3194] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:27:19 2022] GET /compute/v2.1/images/dca8deb4-b525-42b4-860c-8ee77a764df8 => generated 1412 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:20.220606 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7e46440f-b90d-4715-8212-1282d56ffc3f tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:20.220606 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7e46440f-b90d-4715-8212-1282d56ffc3f tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] [instance: 5f9e19c8-0739-4341-bc2c-31e9384de9de] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:20.235665 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7e46440f-b90d-4715-8212-1282d56ffc3f tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:20.236166 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7e46440f-b90d-4715-8212-1282d56ffc3f tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:20.236601 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7e46440f-b90d-4715-8212-1282d56ffc3f tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:20.252950 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7e46440f-b90d-4715-8212-1282d56ffc3f tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:20.258614 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7e46440f-b90d-4715-8212-1282d56ffc3f tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:20.259352 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7e46440f-b90d-4715-8212-1282d56ffc3f tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:20.316272 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-64b8ec49-234e-4e3e-a93e-272617ec0fcc tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44d02d6c10>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:20.449056 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-64b8ec49-234e-4e3e-a93e-272617ec0fcc tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/dca8deb4-b525-42b4-860c-8ee77a764df8" status: 200 len: 1412 microversion: 2.1 time: 0.136547 Oct 30 01:27:20.453745 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1610/3195] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:27:20 2022] GET /compute/v2.1/images/dca8deb4-b525-42b4-860c-8ee77a764df8 => generated 1412 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:20.673536 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7e46440f-b90d-4715-8212-1282d56ffc3f tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948aaf46e1ac4c129dca02cd2dd903e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f41f5c65be49aaa04853c29904bba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:20.684063 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7e46440f-b90d-4715-8212-1282d56ffc3f tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] 10.222.0.13 "GET /compute/v2.1/servers/5f9e19c8-0739-4341-bc2c-31e9384de9de" status: 200 len: 1316 microversion: 2.1 time: 0.469710 Oct 30 01:27:20.684940 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1586/3196] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:27:20 2022] GET /compute/v2.1/servers/5f9e19c8-0739-4341-bc2c-31e9384de9de => generated 1316 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:21.466218 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-22046c74-2d62-405c-b73f-ed8ce4814183 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44d03dee50>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:21.556860 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-22046c74-2d62-405c-b73f-ed8ce4814183 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/dca8deb4-b525-42b4-860c-8ee77a764df8" status: 200 len: 1412 microversion: 2.1 time: 0.094782 Oct 30 01:27:21.557466 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1611/3197] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:27:21 2022] GET /compute/v2.1/images/dca8deb4-b525-42b4-860c-8ee77a764df8 => generated 1412 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:21.711497 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8d7e9889-00d4-4d36-bd6d-77a1a97412aa tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:21.714053 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8d7e9889-00d4-4d36-bd6d-77a1a97412aa tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] [instance: 5f9e19c8-0739-4341-bc2c-31e9384de9de] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:21.722751 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8d7e9889-00d4-4d36-bd6d-77a1a97412aa tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:21.723248 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8d7e9889-00d4-4d36-bd6d-77a1a97412aa tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:21.723693 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8d7e9889-00d4-4d36-bd6d-77a1a97412aa tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:21.724409 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8d7e9889-00d4-4d36-bd6d-77a1a97412aa tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:21.724866 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8d7e9889-00d4-4d36-bd6d-77a1a97412aa tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:21.725294 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8d7e9889-00d4-4d36-bd6d-77a1a97412aa tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:22.543932 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-37b51526-7d9a-4a3f-a7a6-075d48260d10 req-0a55a450-0130-467a-8ba5-945511a36844 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f9e19c8-0739-4341-bc2c-31e9384de9de", "name": "network-vif-plugged", "status": "completed", "tag": "ab261b34-5348-4002-b4f3-a452f16ce1ef"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:27:22.576813 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-37b51526-7d9a-4a3f-a7a6-075d48260d10 req-0a55a450-0130-467a-8ba5-945511a36844 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:22.577723 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-37b51526-7d9a-4a3f-a7a6-075d48260d10 req-0a55a450-0130-467a-8ba5-945511a36844 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:22.578349 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-37b51526-7d9a-4a3f-a7a6-075d48260d10 req-0a55a450-0130-467a-8ba5-945511a36844 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:22.619401 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-37b51526-7d9a-4a3f-a7a6-075d48260d10 req-0a55a450-0130-467a-8ba5-945511a36844 service nova] Creating event network-vif-plugged:ab261b34-5348-4002-b4f3-a452f16ce1ef for instance 5f9e19c8-0739-4341-bc2c-31e9384de9de on n-h1-master-1 Oct 30 01:27:22.635677 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8d7e9889-00d4-4d36-bd6d-77a1a97412aa tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948aaf46e1ac4c129dca02cd2dd903e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f41f5c65be49aaa04853c29904bba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:22.644894 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-37b51526-7d9a-4a3f-a7a6-075d48260d10 req-0a55a450-0130-467a-8ba5-945511a36844 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104069 Oct 30 01:27:22.646082 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1612/3198] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:27:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:27:22.650416 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8d7e9889-00d4-4d36-bd6d-77a1a97412aa tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] 10.222.0.13 "GET /compute/v2.1/servers/5f9e19c8-0739-4341-bc2c-31e9384de9de" status: 200 len: 1316 microversion: 2.1 time: 0.943499 Oct 30 01:27:22.651761 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1587/3199] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:27:21 2022] GET /compute/v2.1/servers/5f9e19c8-0739-4341-bc2c-31e9384de9de => generated 1316 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:22.678477 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-181cc734-2b9f-41ff-9048-c5e4805350b1 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44d04d0670>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:22.768668 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-181cc734-2b9f-41ff-9048-c5e4805350b1 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/dca8deb4-b525-42b4-860c-8ee77a764df8" status: 200 len: 1412 microversion: 2.1 time: 0.119221 Oct 30 01:27:22.771560 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1613/3200] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:27:22 2022] GET /compute/v2.1/images/dca8deb4-b525-42b4-860c-8ee77a764df8 => generated 1412 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:22.935386 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-87db42a1-5912-4eef-b261-d6e42a61ff8c tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1280011931", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": "none"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:27:23.022942 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-87db42a1-5912-4eef-b261-d6e42a61ff8c tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:27:23.024073 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-87db42a1-5912-4eef-b261-d6e42a61ff8c tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:27:23.025368 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-87db42a1-5912-4eef-b261-d6e42a61ff8c tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:27:23.026016 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-87db42a1-5912-4eef-b261-d6e42a61ff8c tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:27:23.027125 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-87db42a1-5912-4eef-b261-d6e42a61ff8c tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:27:23.038829 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-87db42a1-5912-4eef-b261-d6e42a61ff8c tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:23.039632 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-87db42a1-5912-4eef-b261-d6e42a61ff8c tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:23.040292 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-87db42a1-5912-4eef-b261-d6e42a61ff8c tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:23.041285 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-87db42a1-5912-4eef-b261-d6e42a61ff8c tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:23.042538 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-87db42a1-5912-4eef-b261-d6e42a61ff8c tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:23.043983 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-87db42a1-5912-4eef-b261-d6e42a61ff8c tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:23.065947 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-87db42a1-5912-4eef-b261-d6e42a61ff8c tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Getting quotas for project 34952fd2cb6b407f9ccf8dded67139dd. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:27:23.072541 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-87db42a1-5912-4eef-b261-d6e42a61ff8c tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Getting quotas for user abb5b433d3f9405d84e9df692a310b1c and project 34952fd2cb6b407f9ccf8dded67139dd. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:27:23.092987 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-87db42a1-5912-4eef-b261-d6e42a61ff8c tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:27:23.095865 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-87db42a1-5912-4eef-b261-d6e42a61ff8c tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] [instance: 4428fb95-41d0-4a38-95d6-7b2e798068f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:27:23.320171 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-87db42a1-5912-4eef-b261-d6e42a61ff8c tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.666296 Oct 30 01:27:23.328548 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1588/3201] 10.222.0.13 () {62 vars in 1188 bytes} [Sun Oct 30 01:27:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 30 01:27:23.335165 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7aacc2a0-cbf2-47b9-88d1-c3aaaa2a8a00 tempest-SecurityGroupRulesTestJSON-1160426309 tempest-SecurityGroupRulesTestJSON-1160426309-project] Action: 'create', calling method: .version_select at 0x7f44cc6229d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2037820594", "description": "tempest-description-1802062717"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:27:23.365217 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ace39bf6-c991-4708-a158-dc063a6312cd tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:23.365985 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ace39bf6-c991-4708-a158-dc063a6312cd tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] [instance: 4428fb95-41d0-4a38-95d6-7b2e798068f0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:23.563884 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ace39bf6-c991-4708-a158-dc063a6312cd tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:23.574774 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ace39bf6-c991-4708-a158-dc063a6312cd tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:23.583378 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ace39bf6-c991-4708-a158-dc063a6312cd tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:23.618731 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ace39bf6-c991-4708-a158-dc063a6312cd tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] 10.222.0.13 "GET /compute/v2.1/servers/4428fb95-41d0-4a38-95d6-7b2e798068f0" status: 200 len: 1278 microversion: 2.57 time: 0.282541 Oct 30 01:27:23.633945 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1589/3202] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:27:23 2022] GET /compute/v2.1/servers/4428fb95-41d0-4a38-95d6-7b2e798068f0 => generated 1278 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:27:23.678502 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e7a7d26b-c76d-416d-829b-1551ff1f8938 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:23.679387 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e7a7d26b-c76d-416d-829b-1551ff1f8938 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] [instance: 5f9e19c8-0739-4341-bc2c-31e9384de9de] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:23.689028 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7a7d26b-c76d-416d-829b-1551ff1f8938 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:23.692494 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7a7d26b-c76d-416d-829b-1551ff1f8938 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:23.693969 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7a7d26b-c76d-416d-829b-1551ff1f8938 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:23.694885 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7a7d26b-c76d-416d-829b-1551ff1f8938 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:23.696740 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7a7d26b-c76d-416d-829b-1551ff1f8938 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:23.697904 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7a7d26b-c76d-416d-829b-1551ff1f8938 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:23.709026 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:27:24.463969 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e7a7d26b-c76d-416d-829b-1551ff1f8938 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948aaf46e1ac4c129dca02cd2dd903e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f41f5c65be49aaa04853c29904bba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:24.498968 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e7a7d26b-c76d-416d-829b-1551ff1f8938 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] 10.222.0.13 "GET /compute/v2.1/servers/5f9e19c8-0739-4341-bc2c-31e9384de9de" status: 200 len: 1316 microversion: 2.1 time: 0.824417 Oct 30 01:27:24.509191 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1590/3203] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:27:23 2022] GET /compute/v2.1/servers/5f9e19c8-0739-4341-bc2c-31e9384de9de => generated 1316 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:27:24.575985 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-106c06a5-3486-40c2-8f19-0d27df1b70aa tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44ccbec940>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:24.795559 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-106c06a5-3486-40c2-8f19-0d27df1b70aa tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/dca8deb4-b525-42b4-860c-8ee77a764df8" status: 200 len: 1412 microversion: 2.1 time: 0.279834 Oct 30 01:27:24.796901 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1591/3204] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:27:24 2022] GET /compute/v2.1/images/dca8deb4-b525-42b4-860c-8ee77a764df8 => generated 1412 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:24.838319 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3d861667-eb0b-4ca1-aa93-d581ee1ee95e tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:24.841245 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3d861667-eb0b-4ca1-aa93-d581ee1ee95e tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] [instance: 4428fb95-41d0-4a38-95d6-7b2e798068f0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:24.943539 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3d861667-eb0b-4ca1-aa93-d581ee1ee95e tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:24.958175 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3d861667-eb0b-4ca1-aa93-d581ee1ee95e tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:24.959648 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3d861667-eb0b-4ca1-aa93-d581ee1ee95e tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:24.960841 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3d861667-eb0b-4ca1-aa93-d581ee1ee95e tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] 10.222.0.13 "GET /compute/v2.1/servers/4428fb95-41d0-4a38-95d6-7b2e798068f0" status: 200 len: 1278 microversion: 2.57 time: 0.158636 Oct 30 01:27:24.977369 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1592/3205] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:27:24 2022] GET /compute/v2.1/servers/4428fb95-41d0-4a38-95d6-7b2e798068f0 => generated 1278 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:27:25.094214 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7aacc2a0-cbf2-47b9-88d1-c3aaaa2a8a00 tempest-SecurityGroupRulesTestJSON-1160426309 tempest-SecurityGroupRulesTestJSON-1160426309-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.901220 Oct 30 01:27:25.099671 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1614/3206] 10.222.0.13 () {60 vars in 1180 bytes} [Sun Oct 30 01:27:23 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1913 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:27:25.133591 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-84e8edd4-ec46-430a-9c20-291be10c6326 tempest-SecurityGroupRulesTestJSON-1160426309 tempest-SecurityGroupRulesTestJSON-1160426309-project] Action: 'create', calling method: .version_select at 0x7f44c7d721f0>, body: {"security_group_rule": {"parent_group_id": "78e3c9b1-553d-46bc-a4bc-294efd4232fe", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:27:25.545551 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f3d3d960-d320-4731-92a5-d54628bc2f26 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:25.546698 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f3d3d960-d320-4731-92a5-d54628bc2f26 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] [instance: 5f9e19c8-0739-4341-bc2c-31e9384de9de] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:25.566886 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3d3d960-d320-4731-92a5-d54628bc2f26 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:25.567516 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3d3d960-d320-4731-92a5-d54628bc2f26 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:25.569287 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3d3d960-d320-4731-92a5-d54628bc2f26 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:25.571138 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3d3d960-d320-4731-92a5-d54628bc2f26 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:25.573720 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3d3d960-d320-4731-92a5-d54628bc2f26 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:25.575330 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3d3d960-d320-4731-92a5-d54628bc2f26 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:26.114526 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f3d3d960-d320-4731-92a5-d54628bc2f26 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948aaf46e1ac4c129dca02cd2dd903e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f41f5c65be49aaa04853c29904bba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:26.182567 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f3d3d960-d320-4731-92a5-d54628bc2f26 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] 10.222.0.13 "GET /compute/v2.1/servers/5f9e19c8-0739-4341-bc2c-31e9384de9de" status: 200 len: 1503 microversion: 2.1 time: 0.638911 Oct 30 01:27:26.186446 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1615/3207] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:27:25 2022] GET /compute/v2.1/servers/5f9e19c8-0739-4341-bc2c-31e9384de9de => generated 1503 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:27:26.188531 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d6e8348f-e17f-4e49-a3ff-1e176704ade0 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44c76a2940>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:26.252453 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d6e8348f-e17f-4e49-a3ff-1e176704ade0 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/dca8deb4-b525-42b4-860c-8ee77a764df8" status: 200 len: 1412 microversion: 2.1 time: 0.067686 Oct 30 01:27:26.253255 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1616/3208] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:27:26 2022] GET /compute/v2.1/images/dca8deb4-b525-42b4-860c-8ee77a764df8 => generated 1412 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:26.270207 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cb0e65fd-470b-47d7-8647-6cf424c551b3 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:26.274799 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cb0e65fd-470b-47d7-8647-6cf424c551b3 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] [instance: 4428fb95-41d0-4a38-95d6-7b2e798068f0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:26.284423 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=94,nova_api:UPDATE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:27:26.286248 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cb0e65fd-470b-47d7-8647-6cf424c551b3 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:26.286921 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cb0e65fd-470b-47d7-8647-6cf424c551b3 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:26.287506 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cb0e65fd-470b-47d7-8647-6cf424c551b3 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:26.288384 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cb0e65fd-470b-47d7-8647-6cf424c551b3 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:26.288997 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cb0e65fd-470b-47d7-8647-6cf424c551b3 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:26.289593 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cb0e65fd-470b-47d7-8647-6cf424c551b3 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:26.351776 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:27:26.520439 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-84e8edd4-ec46-430a-9c20-291be10c6326 tempest-SecurityGroupRulesTestJSON-1160426309 tempest-SecurityGroupRulesTestJSON-1160426309-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.407394 Oct 30 01:27:26.525912 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1593/3209] 10.222.0.13 () {60 vars in 1195 bytes} [Sun Oct 30 01:27:25 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:27:26.539463 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cc51f328-b530-4f59-a820-41d985e0384e tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:26.541327 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-cc51f328-b530-4f59-a820-41d985e0384e tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: edf8f5ea-58fd-4226-b75c-0138fbdd6ae4] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:26.557849 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cc51f328-b530-4f59-a820-41d985e0384e tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:26.558013 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-cb0e65fd-470b-47d7-8647-6cf424c551b3 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:26.559186 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cc51f328-b530-4f59-a820-41d985e0384e tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:26.560882 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cc51f328-b530-4f59-a820-41d985e0384e tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:26.562355 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cc51f328-b530-4f59-a820-41d985e0384e tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:26.563179 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cc51f328-b530-4f59-a820-41d985e0384e tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:26.565119 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cc51f328-b530-4f59-a820-41d985e0384e tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:26.569935 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-cb0e65fd-470b-47d7-8647-6cf424c551b3 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:26.571611 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-cb0e65fd-470b-47d7-8647-6cf424c551b3 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:26.573003 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cb0e65fd-470b-47d7-8647-6cf424c551b3 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] 10.222.0.13 "GET /compute/v2.1/servers/4428fb95-41d0-4a38-95d6-7b2e798068f0" status: 200 len: 1330 microversion: 2.57 time: 0.310853 Oct 30 01:27:26.573751 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1617/3210] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:27:26 2022] GET /compute/v2.1/servers/4428fb95-41d0-4a38-95d6-7b2e798068f0 => generated 1330 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:27:26.585309 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6e20eb1f-dbbf-4af1-b9bf-30339b042d8d tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:26.590401 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6e20eb1f-dbbf-4af1-b9bf-30339b042d8d tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] [instance: 5f9e19c8-0739-4341-bc2c-31e9384de9de] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:26.609209 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-cc51f328-b530-4f59-a820-41d985e0384e tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] HTTP exception thrown: Instance edf8f5ea-58fd-4226-b75c-0138fbdd6ae4 could not be found. Oct 30 01:27:26.610907 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e20eb1f-dbbf-4af1-b9bf-30339b042d8d tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:26.611416 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e20eb1f-dbbf-4af1-b9bf-30339b042d8d tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:26.611851 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e20eb1f-dbbf-4af1-b9bf-30339b042d8d tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:26.614252 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e20eb1f-dbbf-4af1-b9bf-30339b042d8d tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:26.614970 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e20eb1f-dbbf-4af1-b9bf-30339b042d8d tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:26.615670 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e20eb1f-dbbf-4af1-b9bf-30339b042d8d tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cc51f328-b530-4f59-a820-41d985e0384e tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Request method failure captured: Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: request: DELETE /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4 HTTP/1.1 Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdJr-vSoZanPnPVilvoAflboAr3cSFQBUxYWvsa8_cZpjEapRWY2N6m9rWhCI2JtURKxLRhkRvkctLNpIiN4TVHqY_YC3amdNtOfM6wU3MIQLQCfCaT-WA5iUAKugn9ry0pb8FrVeVuzHf2DIElxquUC3dfXuf-g1DEAno4NYR3z5PE Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 2c59bd73c7874a00b52ec7c5c4142039 Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersTestMultiNic-609219501 Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2c59bd73c7874a00b52ec7c5c4142039"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2c59bd73c7874a00b52ec7c5c4142039"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2c59bd73c7874a00b52ec7c5c4142039"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2c59bd73c7874a00b52ec7c5c4142039"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersTestMultiNic-609219501 Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 2c59bd73c7874a00b52ec7c5c4142039 Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersTestMultiNic-609219501 Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersTestMultiNic-609219501-project Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: a07f2b8c31f54c62aaba73ca2bd2edb8 Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersTestMultiNic-609219501-project Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: exception: Instance edf8f5ea-58fd-4226-b75c-0138fbdd6ae4 could not be found. Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'edf8f5ea-58fd-4226-b75c-0138fbdd6ae4'} Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edf8f5ea-58fd-4226-b75c-0138fbdd6ae4 could not be found. Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:27:26.620122 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:27:26.625895 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edf8f5ea-58fd-4226-b75c-0138fbdd6ae4 could not be found. Oct 30 01:27:26.625895 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:27:26.625895 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:27:26.625895 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:27:26.625895 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:27:26.625895 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:27:26.625895 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:27:26.625895 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:27:26.625895 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:27:26.625895 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edf8f5ea-58fd-4226-b75c-0138fbdd6ae4 could not be found. Oct 30 01:27:26.625895 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:27:26.630904 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cc51f328-b530-4f59-a820-41d985e0384e tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Returning 404 to user: Instance edf8f5ea-58fd-4226-b75c-0138fbdd6ae4 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:27:26.632152 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cc51f328-b530-4f59-a820-41d985e0384e tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] 10.222.0.13 "DELETE /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4" status: 404 len: 111 microversion: 2.1 time: 0.104206 Oct 30 01:27:26.634775 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1594/3211] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:27:26 2022] DELETE /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:27:26.644919 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9d5434e3-8af1-4f45-ab97-d737f2716f30 tempest-SecurityGroupRulesTestJSON-1160426309 tempest-SecurityGroupRulesTestJSON-1160426309-project] Action: 'create', calling method: .version_select at 0x7f44c7d728b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-666522367", "description": "tempest-description-2108081799"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:27:26.685775 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6e20eb1f-dbbf-4af1-b9bf-30339b042d8d tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] [instance: 5f9e19c8-0739-4341-bc2c-31e9384de9de] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:27:27.124344 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6e20eb1f-dbbf-4af1-b9bf-30339b042d8d tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5f9e19c8-0739-4341-bc2c-31e9384de9de" status: 204 len: 0 microversion: 2.1 time: 0.549129 Oct 30 01:27:27.125321 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1618/3212] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:27:26 2022] DELETE /compute/v2.1/servers/5f9e19c8-0739-4341-bc2c-31e9384de9de => generated 0 bytes in 551 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:27:27.133972 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ab4bea49-50c7-4478-b131-cd59188589e5 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:27.137259 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ab4bea49-50c7-4478-b131-cd59188589e5 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: edf8f5ea-58fd-4226-b75c-0138fbdd6ae4] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:27.147914 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ab4bea49-50c7-4478-b131-cd59188589e5 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:27.148426 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ab4bea49-50c7-4478-b131-cd59188589e5 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:27.149235 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ab4bea49-50c7-4478-b131-cd59188589e5 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:27.150046 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ab4bea49-50c7-4478-b131-cd59188589e5 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:27.150510 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ab4bea49-50c7-4478-b131-cd59188589e5 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:27.150991 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ab4bea49-50c7-4478-b131-cd59188589e5 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:27.187189 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-ab4bea49-50c7-4478-b131-cd59188589e5 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] HTTP exception thrown: Instance edf8f5ea-58fd-4226-b75c-0138fbdd6ae4 could not be found. Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ab4bea49-50c7-4478-b131-cd59188589e5 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Request method failure captured: Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4 HTTP/1.1 Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdJr-vSoZanPnPVilvoAflboAr3cSFQBUxYWvsa8_cZpjEapRWY2N6m9rWhCI2JtURKxLRhkRvkctLNpIiN4TVHqY_YC3amdNtOfM6wU3MIQLQCfCaT-WA5iUAKugn9ry0pb8FrVeVuzHf2DIElxquUC3dfXuf-g1DEAno4NYR3z5PE Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 2c59bd73c7874a00b52ec7c5c4142039 Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServersTestMultiNic-609219501 Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2c59bd73c7874a00b52ec7c5c4142039"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2c59bd73c7874a00b52ec7c5c4142039"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2c59bd73c7874a00b52ec7c5c4142039"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2c59bd73c7874a00b52ec7c5c4142039"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServersTestMultiNic-609219501 Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 2c59bd73c7874a00b52ec7c5c4142039 Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServersTestMultiNic-609219501 Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServersTestMultiNic-609219501-project Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: a07f2b8c31f54c62aaba73ca2bd2edb8 Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServersTestMultiNic-609219501-project Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: exception: Instance edf8f5ea-58fd-4226-b75c-0138fbdd6ae4 could not be found. Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'edf8f5ea-58fd-4226-b75c-0138fbdd6ae4'} Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edf8f5ea-58fd-4226-b75c-0138fbdd6ae4 could not be found. Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edf8f5ea-58fd-4226-b75c-0138fbdd6ae4 could not be found. Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:27:27.191777 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:27.195956 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:27:27.195956 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:27:27.195956 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:27:27.195956 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:27:27.195956 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:27:27.195956 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edf8f5ea-58fd-4226-b75c-0138fbdd6ae4 could not be found. Oct 30 01:27:27.195956 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:27.195956 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ab4bea49-50c7-4478-b131-cd59188589e5 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Returning 404 to user: Instance edf8f5ea-58fd-4226-b75c-0138fbdd6ae4 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:27:27.196600 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ab4bea49-50c7-4478-b131-cd59188589e5 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] 10.222.0.13 "GET /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4" status: 404 len: 111 microversion: 2.1 time: 0.068693 Oct 30 01:27:27.199055 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1619/3213] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:27:27 2022] GET /compute/v2.1/servers/edf8f5ea-58fd-4226-b75c-0138fbdd6ae4 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:27:27.211663 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-14586484-27a5-40c2-89db-2d367bf749b7 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:27.212559 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-14586484-27a5-40c2-89db-2d367bf749b7 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] [instance: 5f9e19c8-0739-4341-bc2c-31e9384de9de] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:27.260555 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-14586484-27a5-40c2-89db-2d367bf749b7 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:27.261251 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-14586484-27a5-40c2-89db-2d367bf749b7 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:27.261970 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-14586484-27a5-40c2-89db-2d367bf749b7 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:27.263893 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-14586484-27a5-40c2-89db-2d367bf749b7 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:27.264536 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-14586484-27a5-40c2-89db-2d367bf749b7 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:27.265643 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-14586484-27a5-40c2-89db-2d367bf749b7 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:27.845156 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9d5434e3-8af1-4f45-ab97-d737f2716f30 tempest-SecurityGroupRulesTestJSON-1160426309 tempest-SecurityGroupRulesTestJSON-1160426309-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.208773 Oct 30 01:27:27.846537 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1595/3214] 10.222.0.13 () {60 vars in 1180 bytes} [Sun Oct 30 01:27:26 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:27:27.859494 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1dafbd37-e178-420f-b2df-46128d86294c tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:27.860187 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1dafbd37-e178-420f-b2df-46128d86294c tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: 64824cfc-200e-4ee1-8698-011b644ae315] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:27.924925 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1dafbd37-e178-420f-b2df-46128d86294c tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:27.927080 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1dafbd37-e178-420f-b2df-46128d86294c tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:27.930445 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1dafbd37-e178-420f-b2df-46128d86294c tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:27.931458 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1dafbd37-e178-420f-b2df-46128d86294c tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:27.937367 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1dafbd37-e178-420f-b2df-46128d86294c tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:27.940329 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1dafbd37-e178-420f-b2df-46128d86294c tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:28.001355 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-1dafbd37-e178-420f-b2df-46128d86294c tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] HTTP exception thrown: Instance 64824cfc-200e-4ee1-8698-011b644ae315 could not be found. Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1dafbd37-e178-420f-b2df-46128d86294c tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Request method failure captured: Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: request: DELETE /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315 HTTP/1.1 Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdJr-vSoZanPnPVilvoAflboAr3cSFQBUxYWvsa8_cZpjEapRWY2N6m9rWhCI2JtURKxLRhkRvkctLNpIiN4TVHqY_YC3amdNtOfM6wU3MIQLQCfCaT-WA5iUAKugn9ry0pb8FrVeVuzHf2DIElxquUC3dfXuf-g1DEAno4NYR3z5PE Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 2c59bd73c7874a00b52ec7c5c4142039 Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersTestMultiNic-609219501 Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2c59bd73c7874a00b52ec7c5c4142039"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2c59bd73c7874a00b52ec7c5c4142039"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2c59bd73c7874a00b52ec7c5c4142039"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2c59bd73c7874a00b52ec7c5c4142039"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersTestMultiNic-609219501 Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 2c59bd73c7874a00b52ec7c5c4142039 Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersTestMultiNic-609219501 Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersTestMultiNic-609219501-project Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: a07f2b8c31f54c62aaba73ca2bd2edb8 Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersTestMultiNic-609219501-project Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 64824cfc-200e-4ee1-8698-011b644ae315 could not be found. Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '64824cfc-200e-4ee1-8698-011b644ae315'} Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64824cfc-200e-4ee1-8698-011b644ae315 could not be found. Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:27:28.016793 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:27:28.020939 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64824cfc-200e-4ee1-8698-011b644ae315 could not be found. Oct 30 01:27:28.020939 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:27:28.020939 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:27:28.020939 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:27:28.020939 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:27:28.020939 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:27:28.020939 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:27:28.020939 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:27:28.020939 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:27:28.020939 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64824cfc-200e-4ee1-8698-011b644ae315 could not be found. Oct 30 01:27:28.020939 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:27:28.038507 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1dafbd37-e178-420f-b2df-46128d86294c tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Returning 404 to user: Instance 64824cfc-200e-4ee1-8698-011b644ae315 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:27:28.039740 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1dafbd37-e178-420f-b2df-46128d86294c tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] 10.222.0.13 "DELETE /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315" status: 404 len: 111 microversion: 2.1 time: 0.191603 Oct 30 01:27:28.040897 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1596/3215] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:27:27 2022] DELETE /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315 => generated 111 bytes in 193 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:27:28.058637 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7da977c0-d4a2-4ee4-8867-ccf65f73ead7 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44c7b8c670>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:28.200318 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7da977c0-d4a2-4ee4-8867-ccf65f73ead7 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/dca8deb4-b525-42b4-860c-8ee77a764df8" status: 200 len: 1412 microversion: 2.1 time: 0.158041 Oct 30 01:27:28.202362 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1597/3216] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:27:28 2022] GET /compute/v2.1/images/dca8deb4-b525-42b4-860c-8ee77a764df8 => generated 1412 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:28.215553 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-63b14a03-3a35-4e96-ad16-855bebe02d46 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:28.221633 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-63b14a03-3a35-4e96-ad16-855bebe02d46 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] [instance: 4428fb95-41d0-4a38-95d6-7b2e798068f0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:28.250438 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-63b14a03-3a35-4e96-ad16-855bebe02d46 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:28.251417 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-63b14a03-3a35-4e96-ad16-855bebe02d46 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:28.252116 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-63b14a03-3a35-4e96-ad16-855bebe02d46 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:28.259485 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-63b14a03-3a35-4e96-ad16-855bebe02d46 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:28.260295 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-63b14a03-3a35-4e96-ad16-855bebe02d46 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:28.261073 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-63b14a03-3a35-4e96-ad16-855bebe02d46 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:28.366064 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-14586484-27a5-40c2-89db-2d367bf749b7 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948aaf46e1ac4c129dca02cd2dd903e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f41f5c65be49aaa04853c29904bba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:28.378919 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-14586484-27a5-40c2-89db-2d367bf749b7 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] 10.222.0.13 "GET /compute/v2.1/servers/5f9e19c8-0739-4341-bc2c-31e9384de9de" status: 200 len: 1509 microversion: 2.1 time: 1.177610 Oct 30 01:27:28.381017 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1620/3217] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:27:27 2022] GET /compute/v2.1/servers/5f9e19c8-0739-4341-bc2c-31e9384de9de => generated 1509 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:28.391311 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-851f89aa-d0a3-4c60-9a11-27ed8657717e tempest-SecurityGroupRulesTestJSON-1160426309 tempest-SecurityGroupRulesTestJSON-1160426309-project] Action: 'create', calling method: .version_select at 0x7f44c7475ee0>, body: {"security_group_rule": {"parent_group_id": "21ef2cb8-dbf2-4bdd-a4fc-fb0bcb65bf0b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:27:28.595966 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-63b14a03-3a35-4e96-ad16-855bebe02d46 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:28.615446 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-63b14a03-3a35-4e96-ad16-855bebe02d46 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:28.640011 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-63b14a03-3a35-4e96-ad16-855bebe02d46 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:28.640011 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-63b14a03-3a35-4e96-ad16-855bebe02d46 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] 10.222.0.13 "GET /compute/v2.1/servers/4428fb95-41d0-4a38-95d6-7b2e798068f0" status: 200 len: 1336 microversion: 2.57 time: 0.420518 Oct 30 01:27:28.640011 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1598/3218] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:27:28 2022] GET /compute/v2.1/servers/4428fb95-41d0-4a38-95d6-7b2e798068f0 => generated 1336 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:27:28.650934 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fb49dd30-4cc6-4e37-b1cf-ddea01751575 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:28.650934 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-fb49dd30-4cc6-4e37-b1cf-ddea01751575 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] [instance: 64824cfc-200e-4ee1-8698-011b644ae315] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:28.662196 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fb49dd30-4cc6-4e37-b1cf-ddea01751575 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:28.662946 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fb49dd30-4cc6-4e37-b1cf-ddea01751575 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:28.664546 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fb49dd30-4cc6-4e37-b1cf-ddea01751575 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:28.669366 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fb49dd30-4cc6-4e37-b1cf-ddea01751575 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:28.670162 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fb49dd30-4cc6-4e37-b1cf-ddea01751575 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:28.670729 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fb49dd30-4cc6-4e37-b1cf-ddea01751575 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:28.765868 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-fb49dd30-4cc6-4e37-b1cf-ddea01751575 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] HTTP exception thrown: Instance 64824cfc-200e-4ee1-8698-011b644ae315 could not be found. Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fb49dd30-4cc6-4e37-b1cf-ddea01751575 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Request method failure captured: Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315 HTTP/1.1 Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdJr-vSoZanPnPVilvoAflboAr3cSFQBUxYWvsa8_cZpjEapRWY2N6m9rWhCI2JtURKxLRhkRvkctLNpIiN4TVHqY_YC3amdNtOfM6wU3MIQLQCfCaT-WA5iUAKugn9ry0pb8FrVeVuzHf2DIElxquUC3dfXuf-g1DEAno4NYR3z5PE Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 2c59bd73c7874a00b52ec7c5c4142039 Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersTestMultiNic-609219501 Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2c59bd73c7874a00b52ec7c5c4142039"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2c59bd73c7874a00b52ec7c5c4142039"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2c59bd73c7874a00b52ec7c5c4142039"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2c59bd73c7874a00b52ec7c5c4142039"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersTestMultiNic-609219501 Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 2c59bd73c7874a00b52ec7c5c4142039 Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersTestMultiNic-609219501 Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersTestMultiNic-609219501-project Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: a07f2b8c31f54c62aaba73ca2bd2edb8 Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersTestMultiNic-609219501-project Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 64824cfc-200e-4ee1-8698-011b644ae315 could not be found. Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '64824cfc-200e-4ee1-8698-011b644ae315'} Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64824cfc-200e-4ee1-8698-011b644ae315 could not be found. Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64824cfc-200e-4ee1-8698-011b644ae315 could not be found. Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:27:28.768970 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:27:28.776702 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:27:28.776702 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:27:28.776702 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:27:28.776702 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:27:28.776702 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:27:28.776702 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64824cfc-200e-4ee1-8698-011b644ae315 could not be found. Oct 30 01:27:28.776702 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:27:28.780857 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fb49dd30-4cc6-4e37-b1cf-ddea01751575 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] Returning 404 to user: Instance 64824cfc-200e-4ee1-8698-011b644ae315 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:27:28.783976 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fb49dd30-4cc6-4e37-b1cf-ddea01751575 tempest-ServersTestMultiNic-609219501 tempest-ServersTestMultiNic-609219501-project] 10.222.0.13 "GET /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315" status: 404 len: 111 microversion: 2.1 time: 0.149854 Oct 30 01:27:28.785644 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1599/3219] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:27:28 2022] GET /compute/v2.1/servers/64824cfc-200e-4ee1-8698-011b644ae315 => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:27:29.218237 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7a2d14c9-1758-43e3-8fd8-369fab30e977 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44c7e5bca0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:29.326561 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7a2d14c9-1758-43e3-8fd8-369fab30e977 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/dca8deb4-b525-42b4-860c-8ee77a764df8" status: 200 len: 1412 microversion: 2.1 time: 0.113784 Oct 30 01:27:29.327275 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1600/3220] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:27:29 2022] GET /compute/v2.1/images/dca8deb4-b525-42b4-860c-8ee77a764df8 => generated 1412 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:27:29.406333 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-782f0034-acd6-4675-b00c-721da0af86ae tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:29.407158 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-782f0034-acd6-4675-b00c-721da0af86ae tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] [instance: 5f9e19c8-0739-4341-bc2c-31e9384de9de] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:29.419136 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-782f0034-acd6-4675-b00c-721da0af86ae tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:29.424826 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-782f0034-acd6-4675-b00c-721da0af86ae tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:29.425992 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-782f0034-acd6-4675-b00c-721da0af86ae tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:29.427107 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-782f0034-acd6-4675-b00c-721da0af86ae tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:29.428487 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-782f0034-acd6-4675-b00c-721da0af86ae tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:29.432224 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-782f0034-acd6-4675-b00c-721da0af86ae tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:30.834133 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-782f0034-acd6-4675-b00c-721da0af86ae tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948aaf46e1ac4c129dca02cd2dd903e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f41f5c65be49aaa04853c29904bba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:30.850630 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-782f0034-acd6-4675-b00c-721da0af86ae tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] 10.222.0.13 "GET /compute/v2.1/servers/5f9e19c8-0739-4341-bc2c-31e9384de9de" status: 200 len: 1509 microversion: 2.1 time: 1.447247 Oct 30 01:27:30.851712 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1601/3221] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:27:29 2022] GET /compute/v2.1/servers/5f9e19c8-0739-4341-bc2c-31e9384de9de => generated 1509 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:30.864757 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-58a3db39-043c-40aa-9772-48b560571494 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:30.872321 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-58a3db39-043c-40aa-9772-48b560571494 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] [instance: 4428fb95-41d0-4a38-95d6-7b2e798068f0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:30.915114 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58a3db39-043c-40aa-9772-48b560571494 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:30.915114 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58a3db39-043c-40aa-9772-48b560571494 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:30.915114 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58a3db39-043c-40aa-9772-48b560571494 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:30.915114 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58a3db39-043c-40aa-9772-48b560571494 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:30.915114 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58a3db39-043c-40aa-9772-48b560571494 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:30.915114 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58a3db39-043c-40aa-9772-48b560571494 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:31.170805 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-851f89aa-d0a3-4c60-9a11-27ed8657717e tempest-SecurityGroupRulesTestJSON-1160426309 tempest-SecurityGroupRulesTestJSON-1160426309-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 2.785044 Oct 30 01:27:31.171947 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1621/3222] 10.222.0.13 () {60 vars in 1195 bytes} [Sun Oct 30 01:27:28 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 2787 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:27:31.193878 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9821e03c-2048-4be8-9f2b-521dbb669e3e tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44d02d60d0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:31.265845 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-58a3db39-043c-40aa-9772-48b560571494 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:31.274909 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-58a3db39-043c-40aa-9772-48b560571494 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:31.289577 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9821e03c-2048-4be8-9f2b-521dbb669e3e tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/dca8deb4-b525-42b4-860c-8ee77a764df8" status: 200 len: 1412 microversion: 2.1 time: 0.102458 Oct 30 01:27:31.290297 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1622/3223] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:27:31 2022] GET /compute/v2.1/images/dca8deb4-b525-42b4-860c-8ee77a764df8 => generated 1412 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:31.304573 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-58a3db39-043c-40aa-9772-48b560571494 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:31.305904 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-58a3db39-043c-40aa-9772-48b560571494 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] 10.222.0.13 "GET /compute/v2.1/servers/4428fb95-41d0-4a38-95d6-7b2e798068f0" status: 200 len: 1357 microversion: 2.57 time: 0.452518 Oct 30 01:27:31.312967 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-86992831-8a38-4b63-81f2-a7377db8f412 tempest-SecurityGroupRulesTestJSON-1160426309 tempest-SecurityGroupRulesTestJSON-1160426309-project] Action: 'create', calling method: .version_select at 0x7f44c7624f70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-407008267", "description": "tempest-description-1997374301"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:27:31.313403 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1602/3224] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:27:30 2022] GET /compute/v2.1/servers/4428fb95-41d0-4a38-95d6-7b2e798068f0 => generated 1357 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:27:31.364865 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2bde773a-5eac-464d-b16b-9c6b425f2da3 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:27:31.367895 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2bde773a-5eac-464d-b16b-9c6b425f2da3 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] [instance: 4428fb95-41d0-4a38-95d6-7b2e798068f0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:31.391228 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:27:31.403711 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2bde773a-5eac-464d-b16b-9c6b425f2da3 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:31.404799 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2bde773a-5eac-464d-b16b-9c6b425f2da3 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:31.405431 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2bde773a-5eac-464d-b16b-9c6b425f2da3 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:31.406412 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2bde773a-5eac-464d-b16b-9c6b425f2da3 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:31.406985 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2bde773a-5eac-464d-b16b-9c6b425f2da3 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:31.407823 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2bde773a-5eac-464d-b16b-9c6b425f2da3 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:31.560412 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-2bde773a-5eac-464d-b16b-9c6b425f2da3 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:27:31.575608 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-2bde773a-5eac-464d-b16b-9c6b425f2da3 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:27:31.577678 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-2bde773a-5eac-464d-b16b-9c6b425f2da3 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:27:31.578651 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-2bde773a-5eac-464d-b16b-9c6b425f2da3 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:27:31.580802 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-2bde773a-5eac-464d-b16b-9c6b425f2da3 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:27:31.876790 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2bde773a-5eac-464d-b16b-9c6b425f2da3 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] [instance: 4428fb95-41d0-4a38-95d6-7b2e798068f0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:31.890164 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-86992831-8a38-4b63-81f2-a7377db8f412 tempest-SecurityGroupRulesTestJSON-1160426309 tempest-SecurityGroupRulesTestJSON-1160426309-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.598084 Oct 30 01:27:31.892258 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1623/3225] 10.222.0.13 () {60 vars in 1180 bytes} [Sun Oct 30 01:27:31 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:27:31.896092 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2bde773a-5eac-464d-b16b-9c6b425f2da3 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:31.905358 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7e4a3c96-8f04-4149-a68d-2ea1f8bf2c98 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:31.906496 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7e4a3c96-8f04-4149-a68d-2ea1f8bf2c98 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] [instance: 5f9e19c8-0739-4341-bc2c-31e9384de9de] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:31.909930 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2bde773a-5eac-464d-b16b-9c6b425f2da3 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:31.910645 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2bde773a-5eac-464d-b16b-9c6b425f2da3 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:31.912806 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2bde773a-5eac-464d-b16b-9c6b425f2da3 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:31.916547 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2bde773a-5eac-464d-b16b-9c6b425f2da3 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:31.922314 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2bde773a-5eac-464d-b16b-9c6b425f2da3 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:31.928659 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e4a3c96-8f04-4149-a68d-2ea1f8bf2c98 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:31.934149 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e4a3c96-8f04-4149-a68d-2ea1f8bf2c98 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:31.936096 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e4a3c96-8f04-4149-a68d-2ea1f8bf2c98 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:31.937274 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e4a3c96-8f04-4149-a68d-2ea1f8bf2c98 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:31.942019 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e4a3c96-8f04-4149-a68d-2ea1f8bf2c98 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:31.942800 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e4a3c96-8f04-4149-a68d-2ea1f8bf2c98 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:32.033313 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2bde773a-5eac-464d-b16b-9c6b425f2da3 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] 10.222.0.13 "POST /compute/v2.1/servers/4428fb95-41d0-4a38-95d6-7b2e798068f0/action" status: 202 len: 1138 microversion: 2.57 time: 0.677242 Oct 30 01:27:32.039780 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1603/3226] 10.222.0.13 () {62 vars in 1320 bytes} [Sun Oct 30 01:27:31 2022] POST /compute/v2.1/servers/4428fb95-41d0-4a38-95d6-7b2e798068f0/action => generated 1138 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 30 01:27:32.066129 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2ae7b7c5-58bb-417e-abb7-d9a5bc7c7a3c tempest-SecurityGroupRulesTestJSON-1160426309 tempest-SecurityGroupRulesTestJSON-1160426309-project] Action: 'create', calling method: .version_select at 0x7f44c7d72c10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2056468104", "description": "tempest-description-943009251"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:27:32.205060 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7e4a3c96-8f04-4149-a68d-2ea1f8bf2c98 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948aaf46e1ac4c129dca02cd2dd903e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f41f5c65be49aaa04853c29904bba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:32.236913 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7e4a3c96-8f04-4149-a68d-2ea1f8bf2c98 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] 10.222.0.13 "GET /compute/v2.1/servers/5f9e19c8-0739-4341-bc2c-31e9384de9de" status: 200 len: 1467 microversion: 2.1 time: 0.343220 Oct 30 01:27:32.242983 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1624/3227] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:27:31 2022] GET /compute/v2.1/servers/5f9e19c8-0739-4341-bc2c-31e9384de9de => generated 1467 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:32.252879 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1640dcec-7de7-4adc-b51b-aac9c998844e tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:32.254148 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1640dcec-7de7-4adc-b51b-aac9c998844e tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] [instance: 4428fb95-41d0-4a38-95d6-7b2e798068f0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:32.280001 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1640dcec-7de7-4adc-b51b-aac9c998844e tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:32.281681 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1640dcec-7de7-4adc-b51b-aac9c998844e tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:32.291670 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1640dcec-7de7-4adc-b51b-aac9c998844e tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:32.292633 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1640dcec-7de7-4adc-b51b-aac9c998844e tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:32.309562 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1640dcec-7de7-4adc-b51b-aac9c998844e tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:32.310495 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1640dcec-7de7-4adc-b51b-aac9c998844e tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:32.623402 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1640dcec-7de7-4adc-b51b-aac9c998844e tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:32.642463 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1640dcec-7de7-4adc-b51b-aac9c998844e tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:32.644594 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1640dcec-7de7-4adc-b51b-aac9c998844e tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:32.646140 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1640dcec-7de7-4adc-b51b-aac9c998844e tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] 10.222.0.13 "GET /compute/v2.1/servers/4428fb95-41d0-4a38-95d6-7b2e798068f0" status: 200 len: 1366 microversion: 2.57 time: 0.401693 Oct 30 01:27:32.647217 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1625/3228] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:27:32 2022] GET /compute/v2.1/servers/4428fb95-41d0-4a38-95d6-7b2e798068f0 => generated 1366 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:27:32.671338 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-51820528-93a1-4e3d-8205-18d2d37d0863 req-d2ff3bad-7e31-437f-9094-7acc17b5ceca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f9e19c8-0739-4341-bc2c-31e9384de9de", "name": "network-vif-deleted", "tag": "ab261b34-5348-4002-b4f3-a452f16ce1ef"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:27:32.710184 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-51820528-93a1-4e3d-8205-18d2d37d0863 req-d2ff3bad-7e31-437f-9094-7acc17b5ceca service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:32.711190 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-51820528-93a1-4e3d-8205-18d2d37d0863 req-d2ff3bad-7e31-437f-9094-7acc17b5ceca service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:32.712433 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-51820528-93a1-4e3d-8205-18d2d37d0863 req-d2ff3bad-7e31-437f-9094-7acc17b5ceca service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:32.734469 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-51820528-93a1-4e3d-8205-18d2d37d0863 req-d2ff3bad-7e31-437f-9094-7acc17b5ceca service nova] Creating event network-vif-deleted:ab261b34-5348-4002-b4f3-a452f16ce1ef for instance 5f9e19c8-0739-4341-bc2c-31e9384de9de on n-h1-master-1 Oct 30 01:27:32.744585 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-51820528-93a1-4e3d-8205-18d2d37d0863 req-d2ff3bad-7e31-437f-9094-7acc17b5ceca service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095044 Oct 30 01:27:32.745968 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1626/3229] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:27:32.755013 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-dcfd617a-f8cb-40f6-a556-871994128495 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44c740e670>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:32.848740 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-dcfd617a-f8cb-40f6-a556-871994128495 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/dca8deb4-b525-42b4-860c-8ee77a764df8" status: 200 len: 1412 microversion: 2.1 time: 0.101230 Oct 30 01:27:32.867926 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1627/3230] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:27:32 2022] GET /compute/v2.1/images/dca8deb4-b525-42b4-860c-8ee77a764df8 => generated 1412 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:32.939637 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2ae7b7c5-58bb-417e-abb7-d9a5bc7c7a3c tempest-SecurityGroupRulesTestJSON-1160426309 tempest-SecurityGroupRulesTestJSON-1160426309-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.898418 Oct 30 01:27:32.940454 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1604/3231] 10.222.0.13 () {60 vars in 1180 bytes} [Sun Oct 30 01:27:32 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:27:32.954692 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a5d4824f-7b40-4047-9594-3bedb096d874 tempest-SecurityGroupRulesTestJSON-1160426309 tempest-SecurityGroupRulesTestJSON-1160426309-project] Action: 'create', calling method: .version_select at 0x7f44c74753a0>, body: {"security_group_rule": {"parent_group_id": "b5a2dcf7-063e-4063-9658-39431e0dc25a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "799a077d-d80f-4628-8f05-f24d57735310"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:27:33.266982 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:27:33.272100 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-78e348ec-b19a-46b1-b783-1c5d393a581c tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:33.272953 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-78e348ec-b19a-46b1-b783-1c5d393a581c tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] [instance: 5f9e19c8-0739-4341-bc2c-31e9384de9de] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:33.299779 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-78e348ec-b19a-46b1-b783-1c5d393a581c tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:33.304734 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-78e348ec-b19a-46b1-b783-1c5d393a581c tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:33.305401 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-78e348ec-b19a-46b1-b783-1c5d393a581c tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:33.307434 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-78e348ec-b19a-46b1-b783-1c5d393a581c tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:33.310094 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-78e348ec-b19a-46b1-b783-1c5d393a581c tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:33.310720 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-78e348ec-b19a-46b1-b783-1c5d393a581c tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:33.434943 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-78e348ec-b19a-46b1-b783-1c5d393a581c tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:33.435767 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-78e348ec-b19a-46b1-b783-1c5d393a581c tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:33.436383 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-78e348ec-b19a-46b1-b783-1c5d393a581c tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:33.439480 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-78e348ec-b19a-46b1-b783-1c5d393a581c tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lazy-loading 'fault' on Instance uuid 5f9e19c8-0739-4341-bc2c-31e9384de9de {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:27:33.657948 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-78e348ec-b19a-46b1-b783-1c5d393a581c tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948aaf46e1ac4c129dca02cd2dd903e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f41f5c65be49aaa04853c29904bba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:33.669157 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-78e348ec-b19a-46b1-b783-1c5d393a581c tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] 10.222.0.13 "GET /compute/v2.1/servers/5f9e19c8-0739-4341-bc2c-31e9384de9de" status: 200 len: 1306 microversion: 2.1 time: 0.402837 Oct 30 01:27:33.681734 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1605/3232] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:27:33 2022] GET /compute/v2.1/servers/5f9e19c8-0739-4341-bc2c-31e9384de9de => generated 1306 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:33.689869 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5689fc63-4c36-451c-b6cf-2cde6fab6ae1 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:33.690774 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5689fc63-4c36-451c-b6cf-2cde6fab6ae1 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] [instance: 4428fb95-41d0-4a38-95d6-7b2e798068f0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:33.699471 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5689fc63-4c36-451c-b6cf-2cde6fab6ae1 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:33.700989 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5689fc63-4c36-451c-b6cf-2cde6fab6ae1 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:33.703491 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5689fc63-4c36-451c-b6cf-2cde6fab6ae1 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:33.704370 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5689fc63-4c36-451c-b6cf-2cde6fab6ae1 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:33.705625 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5689fc63-4c36-451c-b6cf-2cde6fab6ae1 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:33.710083 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5689fc63-4c36-451c-b6cf-2cde6fab6ae1 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:33.863075 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5689fc63-4c36-451c-b6cf-2cde6fab6ae1 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:33.877957 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5689fc63-4c36-451c-b6cf-2cde6fab6ae1 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:33.879901 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5689fc63-4c36-451c-b6cf-2cde6fab6ae1 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:33.881442 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5689fc63-4c36-451c-b6cf-2cde6fab6ae1 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] 10.222.0.13 "GET /compute/v2.1/servers/4428fb95-41d0-4a38-95d6-7b2e798068f0" status: 200 len: 1366 microversion: 2.57 time: 0.198361 Oct 30 01:27:33.886359 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1606/3233] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:27:33 2022] GET /compute/v2.1/servers/4428fb95-41d0-4a38-95d6-7b2e798068f0 => generated 1366 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:27:33.898350 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-73c51f83-d583-4a0b-b3e7-d738542257b4 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44c7c00280>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:33.965477 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-73c51f83-d583-4a0b-b3e7-d738542257b4 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/dca8deb4-b525-42b4-860c-8ee77a764df8" status: 200 len: 1412 microversion: 2.1 time: 0.076333 Oct 30 01:27:33.967161 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1607/3234] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:27:33 2022] GET /compute/v2.1/images/dca8deb4-b525-42b4-860c-8ee77a764df8 => generated 1412 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:34.147238 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a5d4824f-7b40-4047-9594-3bedb096d874 tempest-SecurityGroupRulesTestJSON-1160426309 tempest-SecurityGroupRulesTestJSON-1160426309-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.196825 Oct 30 01:27:34.148465 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1628/3235] 10.222.0.13 () {60 vars in 1195 bytes} [Sun Oct 30 01:27:32 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:27:34.170517 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2657ad2c-42d0-492a-a56f-d54e73885fdc tempest-SecurityGroupRulesTestJSON-1160426309 tempest-SecurityGroupRulesTestJSON-1160426309-project] Action: 'create', calling method: .version_select at 0x7f44ccacc550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1917112732", "description": "tempest-description-1558504117"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:27:34.698324 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-32b932e4-8edb-48f8-b197-972a9adb4597 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:34.700363 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-32b932e4-8edb-48f8-b197-972a9adb4597 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] [instance: 5f9e19c8-0739-4341-bc2c-31e9384de9de] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:34.713034 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-32b932e4-8edb-48f8-b197-972a9adb4597 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:34.715220 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-32b932e4-8edb-48f8-b197-972a9adb4597 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:34.715858 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-32b932e4-8edb-48f8-b197-972a9adb4597 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:34.717943 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-32b932e4-8edb-48f8-b197-972a9adb4597 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:34.722742 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-32b932e4-8edb-48f8-b197-972a9adb4597 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:34.722742 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-32b932e4-8edb-48f8-b197-972a9adb4597 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:34.775683 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-32b932e4-8edb-48f8-b197-972a9adb4597 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] HTTP exception thrown: Instance 5f9e19c8-0739-4341-bc2c-31e9384de9de could not be found. Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-32b932e4-8edb-48f8-b197-972a9adb4597 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Request method failure captured: Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/5f9e19c8-0739-4341-bc2c-31e9384de9de HTTP/1.1 Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdLk7gYaPvYuyCSVZXkiBxug_lzwGqj8VIZpEDVwVFLODOegx1UDuJxk0dHe-ph5lUa2SPnLNhh4zI1YkgSLK8HM8V1mKu4x43kA-TUR4kvp1EkX3biqs2Bu7FTnRFBRKx22B7xZnNtWrvIhx7Sp14lHwHuYsOYxqllBZ9eaU3SF7Xg Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: a3f41f5c65be49aaa04853c29904bba6 Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ImagesNegativeTestJSON-434380946 Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a3f41f5c65be49aaa04853c29904bba6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a3f41f5c65be49aaa04853c29904bba6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a3f41f5c65be49aaa04853c29904bba6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a3f41f5c65be49aaa04853c29904bba6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ImagesNegativeTestJSON-434380946 Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: a3f41f5c65be49aaa04853c29904bba6 Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-434380946 Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ImagesNegativeTestJSON-434380946-project Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 948aaf46e1ac4c129dca02cd2dd903e0 Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ImagesNegativeTestJSON-434380946-project Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 5f9e19c8-0739-4341-bc2c-31e9384de9de could not be found. Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '5f9e19c8-0739-4341-bc2c-31e9384de9de'} Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f9e19c8-0739-4341-bc2c-31e9384de9de could not be found. Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f9e19c8-0739-4341-bc2c-31e9384de9de could not be found. Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:27:34.778973 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:34.784005 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:27:34.784005 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:27:34.784005 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:27:34.784005 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:27:34.784005 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:27:34.784005 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f9e19c8-0739-4341-bc2c-31e9384de9de could not be found. Oct 30 01:27:34.784005 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:34.787670 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-32b932e4-8edb-48f8-b197-972a9adb4597 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Returning 404 to user: Instance 5f9e19c8-0739-4341-bc2c-31e9384de9de could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:27:34.788787 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-32b932e4-8edb-48f8-b197-972a9adb4597 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] 10.222.0.13 "GET /compute/v2.1/servers/5f9e19c8-0739-4341-bc2c-31e9384de9de" status: 404 len: 111 microversion: 2.1 time: 0.096553 Oct 30 01:27:34.797502 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1629/3236] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:27:34 2022] GET /compute/v2.1/servers/5f9e19c8-0739-4341-bc2c-31e9384de9de => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:27:34.809940 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7ba76fa3-852c-4711-911c-942e5ad0689a tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1367569834", "metadata": {"image_type": "test"}}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:27:34.815848 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7ba76fa3-852c-4711-911c-942e5ad0689a tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] [instance: 5f9e19c8-0739-4341-bc2c-31e9384de9de] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:34.835325 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7ba76fa3-852c-4711-911c-942e5ad0689a tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:34.842807 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7ba76fa3-852c-4711-911c-942e5ad0689a tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:34.851139 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7ba76fa3-852c-4711-911c-942e5ad0689a tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:34.853836 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7ba76fa3-852c-4711-911c-942e5ad0689a tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:34.854567 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7ba76fa3-852c-4711-911c-942e5ad0689a tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:34.855265 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7ba76fa3-852c-4711-911c-942e5ad0689a tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:34.891653 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-7ba76fa3-852c-4711-911c-942e5ad0689a tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] HTTP exception thrown: Instance 5f9e19c8-0739-4341-bc2c-31e9384de9de could not be found. Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7ba76fa3-852c-4711-911c-942e5ad0689a tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Request method failure captured: Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/servers/5f9e19c8-0739-4341-bc2c-31e9384de9de/action HTTP/1.1 Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 112 Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdLk7gYaPvYuyCSVZXkiBxug_lzwGqj8VIZpEDVwVFLODOegx1UDuJxk0dHe-ph5lUa2SPnLNhh4zI1YkgSLK8HM8V1mKu4x43kA-TUR4kvp1EkX3biqs2Bu7FTnRFBRKx22B7xZnNtWrvIhx7Sp14lHwHuYsOYxqllBZ9eaU3SF7Xg Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: a3f41f5c65be49aaa04853c29904bba6 Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ImagesNegativeTestJSON-434380946 Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a3f41f5c65be49aaa04853c29904bba6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a3f41f5c65be49aaa04853c29904bba6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a3f41f5c65be49aaa04853c29904bba6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a3f41f5c65be49aaa04853c29904bba6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ImagesNegativeTestJSON-434380946 Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: a3f41f5c65be49aaa04853c29904bba6 Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-434380946 Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ImagesNegativeTestJSON-434380946-project Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 948aaf46e1ac4c129dca02cd2dd903e0 Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ImagesNegativeTestJSON-434380946-project Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1367569834", "metadata": {"image_type": "test"}}} Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 5f9e19c8-0739-4341-bc2c-31e9384de9de could not be found. Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '5f9e19c8-0739-4341-bc2c-31e9384de9de', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1367569834', 'metadata': {'image_type': 'test'}}}} Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f9e19c8-0739-4341-bc2c-31e9384de9de could not be found. Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 30 01:27:34.893711 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:27:34.898909 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:27:34.898909 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:27:34.898909 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:27:34.898909 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f9e19c8-0739-4341-bc2c-31e9384de9de could not be found. Oct 30 01:27:34.898909 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:34.898909 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:27:34.898909 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:34.898909 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:27:34.898909 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:27:34.898909 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:27:34.898909 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:27:34.898909 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:27:34.898909 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f9e19c8-0739-4341-bc2c-31e9384de9de could not be found. Oct 30 01:27:34.898909 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:34.902090 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7ba76fa3-852c-4711-911c-942e5ad0689a tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Returning 404 to user: Instance 5f9e19c8-0739-4341-bc2c-31e9384de9de could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:27:34.903225 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7ba76fa3-852c-4711-911c-942e5ad0689a tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] 10.222.0.13 "POST /compute/v2.1/servers/5f9e19c8-0739-4341-bc2c-31e9384de9de/action" status: 404 len: 111 microversion: 2.1 time: 0.103525 Oct 30 01:27:34.904271 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1630/3237] 10.222.0.13 () {60 vars in 1279 bytes} [Sun Oct 30 01:27:34 2022] POST /compute/v2.1/servers/5f9e19c8-0739-4341-bc2c-31e9384de9de/action => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:27:34.926042 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d2cd8251-7c5c-460e-b431-885d136b162d tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-93832064", "metadata": {"image_type": "test"}}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:27:34.929586 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d2cd8251-7c5c-460e-b431-885d136b162d tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Failed to fetch instance by id tempest-invalid-1517414375 {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 30 01:27:34.931068 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-d2cd8251-7c5c-460e-b431-885d136b162d tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] HTTP exception thrown: Instance tempest-invalid-1517414375 could not be found. Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d2cd8251-7c5c-460e-b431-885d136b162d tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Request method failure captured: Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/servers/tempest-invalid-1517414375/action HTTP/1.1 Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 110 Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdLk7gYaPvYuyCSVZXkiBxug_lzwGqj8VIZpEDVwVFLODOegx1UDuJxk0dHe-ph5lUa2SPnLNhh4zI1YkgSLK8HM8V1mKu4x43kA-TUR4kvp1EkX3biqs2Bu7FTnRFBRKx22B7xZnNtWrvIhx7Sp14lHwHuYsOYxqllBZ9eaU3SF7Xg Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: a3f41f5c65be49aaa04853c29904bba6 Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ImagesNegativeTestJSON-434380946 Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a3f41f5c65be49aaa04853c29904bba6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a3f41f5c65be49aaa04853c29904bba6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a3f41f5c65be49aaa04853c29904bba6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a3f41f5c65be49aaa04853c29904bba6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ImagesNegativeTestJSON-434380946 Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: a3f41f5c65be49aaa04853c29904bba6 Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-434380946 Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ImagesNegativeTestJSON-434380946-project Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 948aaf46e1ac4c129dca02cd2dd903e0 Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ImagesNegativeTestJSON-434380946-project Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-93832064", "metadata": {"image_type": "test"}}} Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: exception: Instance tempest-invalid-1517414375 could not be found. Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'tempest-invalid-1517414375', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-93832064', 'metadata': {'image_type': 'test'}}}} Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1517414375 could not be found. Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:27:34.937612 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1517414375 could not be found. Oct 30 01:27:34.943003 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:34.943003 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:27:34.943003 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:34.943003 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:27:34.943003 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:27:34.943003 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:27:34.943003 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:27:34.943003 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:27:34.943003 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1517414375 could not be found. Oct 30 01:27:34.943003 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:34.944039 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d2cd8251-7c5c-460e-b431-885d136b162d tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Returning 404 to user: Instance tempest-invalid-1517414375 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:27:34.946996 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d2cd8251-7c5c-460e-b431-885d136b162d tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] 10.222.0.13 "POST /compute/v2.1/servers/tempest-invalid-1517414375/action" status: 404 len: 101 microversion: 2.1 time: 0.032836 Oct 30 01:27:34.955036 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=10 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:27:34.955663 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1631/3238] 10.222.0.13 () {60 vars in 1249 bytes} [Sun Oct 30 01:27:34 2022] POST /compute/v2.1/servers/tempest-invalid-1517414375/action => generated 101 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:27:34.963134 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-713a17a7-d060-48cb-8445-f75464fb6a2b tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:34.968935 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-713a17a7-d060-48cb-8445-f75464fb6a2b tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] [instance: 4428fb95-41d0-4a38-95d6-7b2e798068f0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:34.990723 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-713a17a7-d060-48cb-8445-f75464fb6a2b tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:34.991230 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-713a17a7-d060-48cb-8445-f75464fb6a2b tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:34.992244 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-713a17a7-d060-48cb-8445-f75464fb6a2b tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:34.993583 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-713a17a7-d060-48cb-8445-f75464fb6a2b tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:34.995525 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-713a17a7-d060-48cb-8445-f75464fb6a2b tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:34.996183 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-713a17a7-d060-48cb-8445-f75464fb6a2b tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:35.157276 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-713a17a7-d060-48cb-8445-f75464fb6a2b tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:35.179819 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-713a17a7-d060-48cb-8445-f75464fb6a2b tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:35.188324 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-713a17a7-d060-48cb-8445-f75464fb6a2b tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:35.189645 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-713a17a7-d060-48cb-8445-f75464fb6a2b tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] 10.222.0.13 "GET /compute/v2.1/servers/4428fb95-41d0-4a38-95d6-7b2e798068f0" status: 200 len: 1366 microversion: 2.57 time: 0.232925 Oct 30 01:27:35.196950 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1632/3239] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:27:34 2022] GET /compute/v2.1/servers/4428fb95-41d0-4a38-95d6-7b2e798068f0 => generated 1366 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:27:35.218596 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-da535e22-0387-46cb-bba6-bff2d9cfded1 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-818868432"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:27:35.229267 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-da535e22-0387-46cb-bba6-bff2d9cfded1 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 30 01:27:35.231053 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-da535e22-0387-46cb-bba6-bff2d9cfded1 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-da535e22-0387-46cb-bba6-bff2d9cfded1 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Request method failure captured: Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 56 Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdLk7gYaPvYuyCSVZXkiBxug_lzwGqj8VIZpEDVwVFLODOegx1UDuJxk0dHe-ph5lUa2SPnLNhh4zI1YkgSLK8HM8V1mKu4x43kA-TUR4kvp1EkX3biqs2Bu7FTnRFBRKx22B7xZnNtWrvIhx7Sp14lHwHuYsOYxqllBZ9eaU3SF7Xg Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: a3f41f5c65be49aaa04853c29904bba6 Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ImagesNegativeTestJSON-434380946 Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a3f41f5c65be49aaa04853c29904bba6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a3f41f5c65be49aaa04853c29904bba6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a3f41f5c65be49aaa04853c29904bba6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a3f41f5c65be49aaa04853c29904bba6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ImagesNegativeTestJSON-434380946 Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: a3f41f5c65be49aaa04853c29904bba6 Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-434380946 Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ImagesNegativeTestJSON-434380946-project Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 948aaf46e1ac4c129dca02cd2dd903e0 Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ImagesNegativeTestJSON-434380946-project Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: {"createImage": {"name": "tempest-test-snap-818868432"}} Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-818868432'}}} Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 30 01:27:35.246798 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:35.251622 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:27:35.251622 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:35.251622 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:27:35.251622 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:27:35.251622 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:27:35.251622 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:27:35.251622 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:27:35.251622 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 30 01:27:35.251622 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:35.253173 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-da535e22-0387-46cb-bba6-bff2d9cfded1 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:27:35.257383 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-da535e22-0387-46cb-bba6-bff2d9cfded1 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] 10.222.0.13 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.059158 Oct 30 01:27:35.258200 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1633/3240] 10.222.0.13 () {60 vars in 1275 bytes} [Sun Oct 30 01:27:35 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:27:35.288129 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bdefe042-2efc-41e9-b04e-32871a85fd48 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44c7624f70>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:35.380801 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bdefe042-2efc-41e9-b04e-32871a85fd48 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/dca8deb4-b525-42b4-860c-8ee77a764df8" status: 200 len: 1412 microversion: 2.1 time: 0.117994 Oct 30 01:27:35.392227 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1634/3241] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:27:35 2022] GET /compute/v2.1/images/dca8deb4-b525-42b4-860c-8ee77a764df8 => generated 1412 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:35.406808 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d04db37e-ed46-49e5-9083-55ec5f64f9f9 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1428435745"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:27:35.415010 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d04db37e-ed46-49e5-9083-55ec5f64f9f9 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 30 01:27:35.415549 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-d04db37e-ed46-49e5-9083-55ec5f64f9f9 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d04db37e-ed46-49e5-9083-55ec5f64f9f9 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Request method failure captured: Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 57 Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdLk7gYaPvYuyCSVZXkiBxug_lzwGqj8VIZpEDVwVFLODOegx1UDuJxk0dHe-ph5lUa2SPnLNhh4zI1YkgSLK8HM8V1mKu4x43kA-TUR4kvp1EkX3biqs2Bu7FTnRFBRKx22B7xZnNtWrvIhx7Sp14lHwHuYsOYxqllBZ9eaU3SF7Xg Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: a3f41f5c65be49aaa04853c29904bba6 Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ImagesNegativeTestJSON-434380946 Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a3f41f5c65be49aaa04853c29904bba6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a3f41f5c65be49aaa04853c29904bba6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a3f41f5c65be49aaa04853c29904bba6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a3f41f5c65be49aaa04853c29904bba6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ImagesNegativeTestJSON-434380946 Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: a3f41f5c65be49aaa04853c29904bba6 Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-434380946 Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ImagesNegativeTestJSON-434380946-project Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 948aaf46e1ac4c129dca02cd2dd903e0 Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ImagesNegativeTestJSON-434380946-project Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: {"createImage": {"name": "tempest-test-snap-1428435745"}} Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1428435745'}}} Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 30 01:27:35.418837 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:35.425086 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:27:35.425086 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:35.425086 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:27:35.425086 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:27:35.425086 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:27:35.425086 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:27:35.425086 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:27:35.425086 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 30 01:27:35.425086 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:35.427508 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d04db37e-ed46-49e5-9083-55ec5f64f9f9 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:27:35.430402 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d04db37e-ed46-49e5-9083-55ec5f64f9f9 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] 10.222.0.13 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.035066 Oct 30 01:27:35.431583 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1635/3242] 10.222.0.13 () {60 vars in 1281 bytes} [Sun Oct 30 01:27:35 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:27:35.442508 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-be9bdc76-a4e7-4688-83ce-98a09f7471d8 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:35.447609 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-be9bdc76-a4e7-4688-83ce-98a09f7471d8 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] [instance: 5f9e19c8-0739-4341-bc2c-31e9384de9de] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:35.472473 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-be9bdc76-a4e7-4688-83ce-98a09f7471d8 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:35.473196 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-be9bdc76-a4e7-4688-83ce-98a09f7471d8 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:35.473845 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-be9bdc76-a4e7-4688-83ce-98a09f7471d8 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:35.474738 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-be9bdc76-a4e7-4688-83ce-98a09f7471d8 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:35.477952 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-be9bdc76-a4e7-4688-83ce-98a09f7471d8 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:35.478720 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-be9bdc76-a4e7-4688-83ce-98a09f7471d8 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:35.514041 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-be9bdc76-a4e7-4688-83ce-98a09f7471d8 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] HTTP exception thrown: Instance 5f9e19c8-0739-4341-bc2c-31e9384de9de could not be found. Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-be9bdc76-a4e7-4688-83ce-98a09f7471d8 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Request method failure captured: Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/servers/5f9e19c8-0739-4341-bc2c-31e9384de9de HTTP/1.1 Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdLk7gYaPvYuyCSVZXkiBxug_lzwGqj8VIZpEDVwVFLODOegx1UDuJxk0dHe-ph5lUa2SPnLNhh4zI1YkgSLK8HM8V1mKu4x43kA-TUR4kvp1EkX3biqs2Bu7FTnRFBRKx22B7xZnNtWrvIhx7Sp14lHwHuYsOYxqllBZ9eaU3SF7Xg Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: a3f41f5c65be49aaa04853c29904bba6 Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ImagesNegativeTestJSON-434380946 Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a3f41f5c65be49aaa04853c29904bba6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a3f41f5c65be49aaa04853c29904bba6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a3f41f5c65be49aaa04853c29904bba6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a3f41f5c65be49aaa04853c29904bba6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ImagesNegativeTestJSON-434380946 Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: a3f41f5c65be49aaa04853c29904bba6 Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-434380946 Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ImagesNegativeTestJSON-434380946-project Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 948aaf46e1ac4c129dca02cd2dd903e0 Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ImagesNegativeTestJSON-434380946-project Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 5f9e19c8-0739-4341-bc2c-31e9384de9de could not be found. Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '5f9e19c8-0739-4341-bc2c-31e9384de9de'} Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f9e19c8-0739-4341-bc2c-31e9384de9de could not be found. Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:27:35.517249 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:27:35.522428 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f9e19c8-0739-4341-bc2c-31e9384de9de could not be found. Oct 30 01:27:35.522428 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:35.522428 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:27:35.522428 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:35.522428 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:27:35.522428 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:27:35.522428 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:27:35.522428 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:27:35.522428 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:27:35.522428 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f9e19c8-0739-4341-bc2c-31e9384de9de could not be found. Oct 30 01:27:35.522428 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:35.525652 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-be9bdc76-a4e7-4688-83ce-98a09f7471d8 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Returning 404 to user: Instance 5f9e19c8-0739-4341-bc2c-31e9384de9de could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:27:35.528118 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-be9bdc76-a4e7-4688-83ce-98a09f7471d8 tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5f9e19c8-0739-4341-bc2c-31e9384de9de" status: 404 len: 111 microversion: 2.1 time: 0.091578 Oct 30 01:27:35.530766 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1636/3243] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:27:35 2022] DELETE /compute/v2.1/servers/5f9e19c8-0739-4341-bc2c-31e9384de9de => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:27:35.544384 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-42e38943-a49d-45ee-acec-72ae5035976f tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:35.546028 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-42e38943-a49d-45ee-acec-72ae5035976f tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] [instance: 5f9e19c8-0739-4341-bc2c-31e9384de9de] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:35.574530 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-42e38943-a49d-45ee-acec-72ae5035976f tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:35.576190 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-42e38943-a49d-45ee-acec-72ae5035976f tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:35.579451 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-42e38943-a49d-45ee-acec-72ae5035976f tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:35.580771 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-42e38943-a49d-45ee-acec-72ae5035976f tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:35.581448 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-42e38943-a49d-45ee-acec-72ae5035976f tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:35.582180 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2657ad2c-42d0-492a-a56f-d54e73885fdc tempest-SecurityGroupRulesTestJSON-1160426309 tempest-SecurityGroupRulesTestJSON-1160426309-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.419482 Oct 30 01:27:35.582677 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-42e38943-a49d-45ee-acec-72ae5035976f tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:35.591647 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1608/3244] 10.222.0.13 () {60 vars in 1180 bytes} [Sun Oct 30 01:27:34 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:27:35.598189 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-97b607a2-fe0c-402a-ae14-cc9d04459297 tempest-SecurityGroupRulesTestJSON-1160426309 tempest-SecurityGroupRulesTestJSON-1160426309-project] Action: 'create', calling method: .version_select at 0x7f44c7b8ca60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-647720943", "description": "tempest-description-306021484"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:27:35.628927 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-42e38943-a49d-45ee-acec-72ae5035976f tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] HTTP exception thrown: Instance 5f9e19c8-0739-4341-bc2c-31e9384de9de could not be found. Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-42e38943-a49d-45ee-acec-72ae5035976f tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Request method failure captured: Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/5f9e19c8-0739-4341-bc2c-31e9384de9de HTTP/1.1 Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdLk7gYaPvYuyCSVZXkiBxug_lzwGqj8VIZpEDVwVFLODOegx1UDuJxk0dHe-ph5lUa2SPnLNhh4zI1YkgSLK8HM8V1mKu4x43kA-TUR4kvp1EkX3biqs2Bu7FTnRFBRKx22B7xZnNtWrvIhx7Sp14lHwHuYsOYxqllBZ9eaU3SF7Xg Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: a3f41f5c65be49aaa04853c29904bba6 Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ImagesNegativeTestJSON-434380946 Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a3f41f5c65be49aaa04853c29904bba6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a3f41f5c65be49aaa04853c29904bba6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a3f41f5c65be49aaa04853c29904bba6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a3f41f5c65be49aaa04853c29904bba6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ImagesNegativeTestJSON-434380946 Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: a3f41f5c65be49aaa04853c29904bba6 Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-434380946 Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ImagesNegativeTestJSON-434380946-project Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 948aaf46e1ac4c129dca02cd2dd903e0 Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ImagesNegativeTestJSON-434380946-project Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 5f9e19c8-0739-4341-bc2c-31e9384de9de could not be found. Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '5f9e19c8-0739-4341-bc2c-31e9384de9de'} Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f9e19c8-0739-4341-bc2c-31e9384de9de could not be found. Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f9e19c8-0739-4341-bc2c-31e9384de9de could not be found. Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:27:35.630939 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:35.636614 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:27:35.636614 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:27:35.636614 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:27:35.636614 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:27:35.636614 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:27:35.636614 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f9e19c8-0739-4341-bc2c-31e9384de9de could not be found. Oct 30 01:27:35.636614 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:35.639283 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-42e38943-a49d-45ee-acec-72ae5035976f tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] Returning 404 to user: Instance 5f9e19c8-0739-4341-bc2c-31e9384de9de could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:27:35.640813 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-42e38943-a49d-45ee-acec-72ae5035976f tempest-ImagesNegativeTestJSON-434380946 tempest-ImagesNegativeTestJSON-434380946-project] 10.222.0.13 "GET /compute/v2.1/servers/5f9e19c8-0739-4341-bc2c-31e9384de9de" status: 404 len: 111 microversion: 2.1 time: 0.105473 Oct 30 01:27:35.643045 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1637/3245] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:27:35 2022] GET /compute/v2.1/servers/5f9e19c8-0739-4341-bc2c-31e9384de9de => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:27:36.233451 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ad1a67a0-a32a-4428-bbe4-6ccf6af4a2c0 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:36.234232 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ad1a67a0-a32a-4428-bbe4-6ccf6af4a2c0 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] [instance: 4428fb95-41d0-4a38-95d6-7b2e798068f0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:36.260922 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ad1a67a0-a32a-4428-bbe4-6ccf6af4a2c0 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:36.273545 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ad1a67a0-a32a-4428-bbe4-6ccf6af4a2c0 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:36.273545 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ad1a67a0-a32a-4428-bbe4-6ccf6af4a2c0 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:36.273545 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ad1a67a0-a32a-4428-bbe4-6ccf6af4a2c0 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:36.273545 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ad1a67a0-a32a-4428-bbe4-6ccf6af4a2c0 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:36.273545 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ad1a67a0-a32a-4428-bbe4-6ccf6af4a2c0 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:36.449010 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-97b607a2-fe0c-402a-ae14-cc9d04459297 tempest-SecurityGroupRulesTestJSON-1160426309 tempest-SecurityGroupRulesTestJSON-1160426309-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.855825 Oct 30 01:27:36.450027 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1609/3246] 10.222.0.13 () {60 vars in 1180 bytes} [Sun Oct 30 01:27:35 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:27:36.456220 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5fa5f624-2be7-4761-a87e-79b9c8400dc5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44c7d36f70>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:36.555175 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5fa5f624-2be7-4761-a87e-79b9c8400dc5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/dca8deb4-b525-42b4-860c-8ee77a764df8" status: 200 len: 1412 microversion: 2.1 time: 0.103772 Oct 30 01:27:36.556500 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1610/3247] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:27:36 2022] GET /compute/v2.1/images/dca8deb4-b525-42b4-860c-8ee77a764df8 => generated 1412 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:36.581101 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d5092549-0883-4bec-88e8-4e6815a4c719 tempest-SecurityGroupRulesTestJSON-1160426309 tempest-SecurityGroupRulesTestJSON-1160426309-project] Action: 'create', calling method: .version_select at 0x7f44c7d72550>, body: {"security_group_rule": {"parent_group_id": "6f6d3c60-feda-414c-ad0b-ad082104eb66", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "c776d93a-2d49-4c1e-9c20-2c4723eab751"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:27:36.590865 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ad1a67a0-a32a-4428-bbe4-6ccf6af4a2c0 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:36.606068 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ad1a67a0-a32a-4428-bbe4-6ccf6af4a2c0 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:36.616351 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ad1a67a0-a32a-4428-bbe4-6ccf6af4a2c0 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:36.616351 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ad1a67a0-a32a-4428-bbe4-6ccf6af4a2c0 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] 10.222.0.13 "GET /compute/v2.1/servers/4428fb95-41d0-4a38-95d6-7b2e798068f0" status: 200 len: 1366 microversion: 2.57 time: 0.389819 Oct 30 01:27:36.617769 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1638/3248] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:27:36 2022] GET /compute/v2.1/servers/4428fb95-41d0-4a38-95d6-7b2e798068f0 => generated 1366 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:27:37.575185 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-53f0c279-5fbb-4e41-bded-421c999af5b3 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44c740e280>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:37.641867 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-53f0c279-5fbb-4e41-bded-421c999af5b3 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/dca8deb4-b525-42b4-860c-8ee77a764df8" status: 200 len: 1412 microversion: 2.1 time: 0.071333 Oct 30 01:27:37.643100 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1639/3249] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:27:37 2022] GET /compute/v2.1/images/dca8deb4-b525-42b4-860c-8ee77a764df8 => generated 1412 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:37.660933 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cad5c70c-15e5-428e-8e32-c4efaf87b383 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:37.661690 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cad5c70c-15e5-428e-8e32-c4efaf87b383 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] [instance: 4428fb95-41d0-4a38-95d6-7b2e798068f0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:37.679241 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cad5c70c-15e5-428e-8e32-c4efaf87b383 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:37.681177 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cad5c70c-15e5-428e-8e32-c4efaf87b383 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:37.682249 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cad5c70c-15e5-428e-8e32-c4efaf87b383 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:37.683886 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cad5c70c-15e5-428e-8e32-c4efaf87b383 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:37.685165 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cad5c70c-15e5-428e-8e32-c4efaf87b383 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:37.686220 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cad5c70c-15e5-428e-8e32-c4efaf87b383 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:38.230604 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-cad5c70c-15e5-428e-8e32-c4efaf87b383 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:38.246655 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-cad5c70c-15e5-428e-8e32-c4efaf87b383 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:38.248584 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-cad5c70c-15e5-428e-8e32-c4efaf87b383 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:38.255378 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cad5c70c-15e5-428e-8e32-c4efaf87b383 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] 10.222.0.13 "GET /compute/v2.1/servers/4428fb95-41d0-4a38-95d6-7b2e798068f0" status: 200 len: 1366 microversion: 2.57 time: 0.599483 Oct 30 01:27:38.275021 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1640/3250] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:27:37 2022] GET /compute/v2.1/servers/4428fb95-41d0-4a38-95d6-7b2e798068f0 => generated 1366 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:27:38.521096 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d5092549-0883-4bec-88e8-4e6815a4c719 tempest-SecurityGroupRulesTestJSON-1160426309 tempest-SecurityGroupRulesTestJSON-1160426309-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 1.963221 Oct 30 01:27:38.534133 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1611/3251] 10.222.0.13 () {60 vars in 1195 bytes} [Sun Oct 30 01:27:36 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 1976 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:27:38.536835 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4ad3e2e6-1030-457c-83b5-4f3373d7d64a tempest-SecurityGroupRulesTestJSON-1160426309 tempest-SecurityGroupRulesTestJSON-1160426309-project] Calling method '.version_select at 0x7f44c740ee50>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:38.817986 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b2d82f93-9770-4acd-9012-91bc7b6a034a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44c7be8dc0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:38.928512 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b2d82f93-9770-4acd-9012-91bc7b6a034a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/dca8deb4-b525-42b4-860c-8ee77a764df8" status: 200 len: 1412 microversion: 2.1 time: 0.273339 Oct 30 01:27:38.934421 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1612/3252] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:27:38 2022] GET /compute/v2.1/images/dca8deb4-b525-42b4-860c-8ee77a764df8 => generated 1412 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:27:39.297693 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7ea7ba16-c437-46f1-8738-a0448e7bf347 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:39.298860 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7ea7ba16-c437-46f1-8738-a0448e7bf347 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] [instance: 4428fb95-41d0-4a38-95d6-7b2e798068f0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:39.315584 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7ea7ba16-c437-46f1-8738-a0448e7bf347 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:39.318711 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7ea7ba16-c437-46f1-8738-a0448e7bf347 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:39.323695 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7ea7ba16-c437-46f1-8738-a0448e7bf347 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:39.328186 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7ea7ba16-c437-46f1-8738-a0448e7bf347 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:39.331799 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7ea7ba16-c437-46f1-8738-a0448e7bf347 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:39.334802 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7ea7ba16-c437-46f1-8738-a0448e7bf347 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:39.487557 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7ea7ba16-c437-46f1-8738-a0448e7bf347 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:39.508329 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7ea7ba16-c437-46f1-8738-a0448e7bf347 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:39.510012 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7ea7ba16-c437-46f1-8738-a0448e7bf347 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:39.511673 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7ea7ba16-c437-46f1-8738-a0448e7bf347 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] 10.222.0.13 "GET /compute/v2.1/servers/4428fb95-41d0-4a38-95d6-7b2e798068f0" status: 200 len: 1366 microversion: 2.57 time: 0.221693 Oct 30 01:27:39.541438 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1613/3253] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:27:39 2022] GET /compute/v2.1/servers/4428fb95-41d0-4a38-95d6-7b2e798068f0 => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:27:39.545013 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4ad3e2e6-1030-457c-83b5-4f3373d7d64a tempest-SecurityGroupRulesTestJSON-1160426309 tempest-SecurityGroupRulesTestJSON-1160426309-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/c776d93a-2d49-4c1e-9c20-2c4723eab751" status: 202 len: 0 microversion: 2.1 time: 1.014771 Oct 30 01:27:39.546967 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1641/3254] 10.222.0.13 () {58 vars in 1272 bytes} [Sun Oct 30 01:27:38 2022] DELETE /compute/v2.1/os-security-groups/c776d93a-2d49-4c1e-9c20-2c4723eab751 => generated 0 bytes in 1017 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 30 01:27:39.557494 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9a144b9c-c535-49dd-b48e-c7f4db5c9406 tempest-SecurityGroupRulesTestJSON-1160426309 tempest-SecurityGroupRulesTestJSON-1160426309-project] Calling method '.version_select at 0x7f44c7a770d0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:39.810799 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9a144b9c-c535-49dd-b48e-c7f4db5c9406 tempest-SecurityGroupRulesTestJSON-1160426309 tempest-SecurityGroupRulesTestJSON-1160426309-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups/6f6d3c60-feda-414c-ad0b-ad082104eb66" status: 200 len: 248 microversion: 2.1 time: 0.260654 Oct 30 01:27:39.811521 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1614/3255] 10.222.0.13 () {58 vars in 1269 bytes} [Sun Oct 30 01:27:39 2022] GET /compute/v2.1/os-security-groups/6f6d3c60-feda-414c-ad0b-ad082104eb66 => generated 248 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:27:39.829694 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8c0c6b48-60f0-48a3-9431-feafc17db369 tempest-SecurityGroupRulesTestJSON-1160426309 tempest-SecurityGroupRulesTestJSON-1160426309-project] Action: 'create', calling method: .version_select at 0x7f44d04009d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1454100903", "description": "tempest-description-1264062617"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:27:39.948690 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-06c15228-e0f3-40c9-bf4f-8fa256f083f9 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44c7c004c0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:40.050141 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-06c15228-e0f3-40c9-bf4f-8fa256f083f9 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/dca8deb4-b525-42b4-860c-8ee77a764df8" status: 200 len: 1412 microversion: 2.1 time: 0.107585 Oct 30 01:27:40.061731 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1615/3256] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:27:39 2022] GET /compute/v2.1/images/dca8deb4-b525-42b4-860c-8ee77a764df8 => generated 1412 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:40.549931 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b3743126-4206-4f28-82a2-60bf301bbcb1 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:40.550645 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b3743126-4206-4f28-82a2-60bf301bbcb1 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] [instance: 4428fb95-41d0-4a38-95d6-7b2e798068f0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:40.565592 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3743126-4206-4f28-82a2-60bf301bbcb1 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:40.571983 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3743126-4206-4f28-82a2-60bf301bbcb1 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:40.572605 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3743126-4206-4f28-82a2-60bf301bbcb1 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:40.573563 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3743126-4206-4f28-82a2-60bf301bbcb1 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:40.574119 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3743126-4206-4f28-82a2-60bf301bbcb1 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:40.574628 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3743126-4206-4f28-82a2-60bf301bbcb1 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:40.982278 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b3743126-4206-4f28-82a2-60bf301bbcb1 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:41.009440 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b3743126-4206-4f28-82a2-60bf301bbcb1 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:41.013548 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b3743126-4206-4f28-82a2-60bf301bbcb1 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:41.013548 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b3743126-4206-4f28-82a2-60bf301bbcb1 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] 10.222.0.13 "GET /compute/v2.1/servers/4428fb95-41d0-4a38-95d6-7b2e798068f0" status: 200 len: 1366 microversion: 2.57 time: 0.469847 Oct 30 01:27:41.019587 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1616/3257] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:27:40 2022] GET /compute/v2.1/servers/4428fb95-41d0-4a38-95d6-7b2e798068f0 => generated 1366 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:27:41.178358 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-21502ba9-a4f2-4df7-aba8-bad9b3db0f6e tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1479846073", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "4b425c00-074d-44af-aef3-feb4d9102ce3"}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:27:41.293611 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-21502ba9-a4f2-4df7-aba8-bad9b3db0f6e tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] validate_networks() for [('4b425c00-074d-44af-aef3-feb4d9102ce3', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:27:41.419389 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8c0c6b48-60f0-48a3-9431-feafc17db369 tempest-SecurityGroupRulesTestJSON-1160426309 tempest-SecurityGroupRulesTestJSON-1160426309-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.594605 Oct 30 01:27:41.420567 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1642/3258] 10.222.0.13 () {60 vars in 1180 bytes} [Sun Oct 30 01:27:39 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1597 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:27:41.428019 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-345f6c74-246d-46a6-8132-92a29fbac841 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44cc578ee0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:41.550252 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-345f6c74-246d-46a6-8132-92a29fbac841 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/dca8deb4-b525-42b4-860c-8ee77a764df8" status: 200 len: 1412 microversion: 2.1 time: 0.128399 Oct 30 01:27:41.551726 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1643/3259] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:27:41 2022] GET /compute/v2.1/images/dca8deb4-b525-42b4-860c-8ee77a764df8 => generated 1412 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:41.723993 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-eec2c3e3-0442-410a-bd30-48fffb940347 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-2138969591", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:27:41.868844 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-eec2c3e3-0442-410a-bd30-48fffb940347 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] validate_networks() for [('962141bf-6c4a-46ef-9422-1942c62b4795', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:27:44.058466 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-21502ba9-a4f2-4df7-aba8-bad9b3db0f6e tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:27:44.058998 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-21502ba9-a4f2-4df7-aba8-bad9b3db0f6e tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:27:44.059394 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-21502ba9-a4f2-4df7-aba8-bad9b3db0f6e tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:27:44.059815 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-21502ba9-a4f2-4df7-aba8-bad9b3db0f6e tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:27:44.061826 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-21502ba9-a4f2-4df7-aba8-bad9b3db0f6e tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:27:44.104174 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21502ba9-a4f2-4df7-aba8-bad9b3db0f6e tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:44.104876 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21502ba9-a4f2-4df7-aba8-bad9b3db0f6e tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:44.114102 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21502ba9-a4f2-4df7-aba8-bad9b3db0f6e tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:44.120987 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21502ba9-a4f2-4df7-aba8-bad9b3db0f6e tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:44.146707 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21502ba9-a4f2-4df7-aba8-bad9b3db0f6e tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:44.147344 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21502ba9-a4f2-4df7-aba8-bad9b3db0f6e tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:44.275882 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-21502ba9-a4f2-4df7-aba8-bad9b3db0f6e tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Getting quotas for project 87c92264dc354f548697879f5db3c70c. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:27:44.295253 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-21502ba9-a4f2-4df7-aba8-bad9b3db0f6e tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Getting quotas for user 3478222ab7f24587a53f4deb83753957 and project 87c92264dc354f548697879f5db3c70c. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:27:44.364300 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-21502ba9-a4f2-4df7-aba8-bad9b3db0f6e tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:27:44.378725 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-21502ba9-a4f2-4df7-aba8-bad9b3db0f6e tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] [instance: 58c01b8d-2408-44eb-98f9-4aa48acc9481] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:27:44.594452 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-eec2c3e3-0442-410a-bd30-48fffb940347 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:27:44.594937 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-eec2c3e3-0442-410a-bd30-48fffb940347 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:27:44.595335 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-eec2c3e3-0442-410a-bd30-48fffb940347 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:27:44.595745 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-eec2c3e3-0442-410a-bd30-48fffb940347 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:27:44.596159 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-eec2c3e3-0442-410a-bd30-48fffb940347 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:27:44.621863 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eec2c3e3-0442-410a-bd30-48fffb940347 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:44.622425 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eec2c3e3-0442-410a-bd30-48fffb940347 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:44.622850 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eec2c3e3-0442-410a-bd30-48fffb940347 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:44.623590 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eec2c3e3-0442-410a-bd30-48fffb940347 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:44.624048 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eec2c3e3-0442-410a-bd30-48fffb940347 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:44.624480 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eec2c3e3-0442-410a-bd30-48fffb940347 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:44.673177 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-21502ba9-a4f2-4df7-aba8-bad9b3db0f6e tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.652053 Oct 30 01:27:44.674593 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1617/3260] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:27:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 3654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:27:44.694308 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9e8884f3-587a-41a4-903b-6540f8f17bb6 tempest-SecurityGroupRulesTestJSON-1160426309 tempest-SecurityGroupRulesTestJSON-1160426309-project] Action: 'create', calling method: .version_select at 0x7f44c7b8c0d0>, body: {"security_group_rule": {"parent_group_id": "0ede9bac-cf8f-453e-b4d1-ea0e84cf6839", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:27:44.694583 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-eec2c3e3-0442-410a-bd30-48fffb940347 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Getting quotas for project fdedb3257fe94513bd5c51de0ae1d737. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:27:44.698908 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-eec2c3e3-0442-410a-bd30-48fffb940347 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Getting quotas for user a4fff27847f74c39b425dba724cf847f and project fdedb3257fe94513bd5c51de0ae1d737. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:27:44.743627 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-eec2c3e3-0442-410a-bd30-48fffb940347 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:27:44.746465 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-eec2c3e3-0442-410a-bd30-48fffb940347 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d01c1c62-c352-4a98-b95b-51ff385a415e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:27:45.021507 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-eec2c3e3-0442-410a-bd30-48fffb940347 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.466369 Oct 30 01:27:45.026392 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1644/3261] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:27:41 2022] POST /compute/v2.1/servers => generated 383 bytes in 3474 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:27:45.038421 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c69bcc92-3768-4f09-a331-9dbcf587e4e2 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:45.039054 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c69bcc92-3768-4f09-a331-9dbcf587e4e2 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] [instance: 4428fb95-41d0-4a38-95d6-7b2e798068f0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:45.060971 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c69bcc92-3768-4f09-a331-9dbcf587e4e2 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:45.082514 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c69bcc92-3768-4f09-a331-9dbcf587e4e2 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:45.083085 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c69bcc92-3768-4f09-a331-9dbcf587e4e2 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:45.089392 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c69bcc92-3768-4f09-a331-9dbcf587e4e2 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:45.089898 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c69bcc92-3768-4f09-a331-9dbcf587e4e2 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:45.093323 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c69bcc92-3768-4f09-a331-9dbcf587e4e2 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:45.571768 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c69bcc92-3768-4f09-a331-9dbcf587e4e2 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:45.592148 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c69bcc92-3768-4f09-a331-9dbcf587e4e2 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:45.596529 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c69bcc92-3768-4f09-a331-9dbcf587e4e2 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:45.611142 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c69bcc92-3768-4f09-a331-9dbcf587e4e2 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] 10.222.0.13 "GET /compute/v2.1/servers/4428fb95-41d0-4a38-95d6-7b2e798068f0" status: 200 len: 1366 microversion: 2.57 time: 0.583361 Oct 30 01:27:45.612509 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1645/3262] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:27:45 2022] GET /compute/v2.1/servers/4428fb95-41d0-4a38-95d6-7b2e798068f0 => generated 1366 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:27:45.633081 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-71a4c514-a10a-4a7c-86ff-3f70858bcda5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44d02d6550>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:45.743586 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9e8884f3-587a-41a4-903b-6540f8f17bb6 tempest-SecurityGroupRulesTestJSON-1160426309 tempest-SecurityGroupRulesTestJSON-1160426309-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.066956 Oct 30 01:27:45.751481 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1618/3263] 10.222.0.13 () {60 vars in 1195 bytes} [Sun Oct 30 01:27:44 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:27:45.758214 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-89f36308-e63f-4bf8-b1e0-5156fadc89c4 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:45.759008 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-89f36308-e63f-4bf8-b1e0-5156fadc89c4 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] [instance: 58c01b8d-2408-44eb-98f9-4aa48acc9481] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:45.801941 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-71a4c514-a10a-4a7c-86ff-3f70858bcda5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/dca8deb4-b525-42b4-860c-8ee77a764df8" status: 200 len: 1421 microversion: 2.1 time: 0.184577 Oct 30 01:27:45.805634 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1646/3264] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:27:45 2022] GET /compute/v2.1/images/dca8deb4-b525-42b4-860c-8ee77a764df8 => generated 1421 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:45.814196 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a75e0303-a065-46a7-91b5-42a80b83c8cc tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:45.831468 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a75e0303-a065-46a7-91b5-42a80b83c8cc tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d01c1c62-c352-4a98-b95b-51ff385a415e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:45.885275 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-89f36308-e63f-4bf8-b1e0-5156fadc89c4 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3478222ab7f24587a53f4deb83753957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c92264dc354f548697879f5db3c70c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:45.893846 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-89f36308-e63f-4bf8-b1e0-5156fadc89c4 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] 10.222.0.13 "GET /compute/v2.1/servers/58c01b8d-2408-44eb-98f9-4aa48acc9481" status: 200 len: 1216 microversion: 2.1 time: 0.140101 Oct 30 01:27:45.895707 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1619/3265] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:27:45 2022] GET /compute/v2.1/servers/58c01b8d-2408-44eb-98f9-4aa48acc9481 => generated 1216 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:45.902524 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-56870644-374c-4b64-b39c-ee0bb0ddc739 tempest-SecurityGroupRulesTestJSON-1160426309 tempest-SecurityGroupRulesTestJSON-1160426309-project] Action: 'create', calling method: .version_select at 0x7f44c7c001f0>, body: {"security_group_rule": {"parent_group_id": "0ede9bac-cf8f-453e-b4d1-ea0e84cf6839", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:27:46.082743 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a75e0303-a065-46a7-91b5-42a80b83c8cc tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:46.093771 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a75e0303-a065-46a7-91b5-42a80b83c8cc tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e" status: 200 len: 1214 microversion: 2.1 time: 0.283173 Oct 30 01:27:46.094827 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1647/3266] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:27:45 2022] GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e => generated 1214 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:46.110712 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-49e7219b-25f8-4408-9162-5164ea0266d6 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44c7624940>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:46.180425 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-49e7219b-25f8-4408-9162-5164ea0266d6 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/dca8deb4-b525-42b4-860c-8ee77a764df8" status: 200 len: 1421 microversion: 2.1 time: 0.084267 Oct 30 01:27:46.181100 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1648/3267] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:27:46 2022] GET /compute/v2.1/images/dca8deb4-b525-42b4-860c-8ee77a764df8 => generated 1421 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:46.413566 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f6d51787-a96c-41a3-8d11-9b5089ad032a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-264163065", "imageRef": "dca8deb4-b525-42b4-860c-8ee77a764df8", "flavorRef": "452", "networks": [{"uuid": "e006438e-aba1-46be-a97a-88a3153fb746"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:27:46.501977 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-f6d51787-a96c-41a3-8d11-9b5089ad032a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] validate_networks() for [('e006438e-aba1-46be-a97a-88a3153fb746', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:27:47.293054 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-56870644-374c-4b64-b39c-ee0bb0ddc739 tempest-SecurityGroupRulesTestJSON-1160426309 tempest-SecurityGroupRulesTestJSON-1160426309-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 1.394634 Oct 30 01:27:47.294449 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1620/3268] 10.222.0.13 () {60 vars in 1195 bytes} [Sun Oct 30 01:27:45 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:27:47.307297 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-df37fcef-c245-427f-ae92-0cc2cdeb8585 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:47.308185 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-df37fcef-c245-427f-ae92-0cc2cdeb8585 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] [instance: 4428fb95-41d0-4a38-95d6-7b2e798068f0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:47.318919 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df37fcef-c245-427f-ae92-0cc2cdeb8585 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:47.319647 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df37fcef-c245-427f-ae92-0cc2cdeb8585 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:47.322193 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df37fcef-c245-427f-ae92-0cc2cdeb8585 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:47.330102 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df37fcef-c245-427f-ae92-0cc2cdeb8585 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:47.330862 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df37fcef-c245-427f-ae92-0cc2cdeb8585 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:47.331622 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df37fcef-c245-427f-ae92-0cc2cdeb8585 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:47.511211 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-df37fcef-c245-427f-ae92-0cc2cdeb8585 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:47.526763 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-df37fcef-c245-427f-ae92-0cc2cdeb8585 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:47.535123 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-df37fcef-c245-427f-ae92-0cc2cdeb8585 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:47.536492 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-df37fcef-c245-427f-ae92-0cc2cdeb8585 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] 10.222.0.13 "GET /compute/v2.1/servers/4428fb95-41d0-4a38-95d6-7b2e798068f0" status: 200 len: 1366 microversion: 2.57 time: 0.233234 Oct 30 01:27:47.540968 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1621/3269] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:27:47 2022] GET /compute/v2.1/servers/4428fb95-41d0-4a38-95d6-7b2e798068f0 => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:27:47.546479 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-43c3de61-b974-445d-b4f5-ee0ae421a3f3 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:47.549667 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-43c3de61-b974-445d-b4f5-ee0ae421a3f3 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] [instance: 58c01b8d-2408-44eb-98f9-4aa48acc9481] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:47.566099 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-43c3de61-b974-445d-b4f5-ee0ae421a3f3 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:47.566783 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-43c3de61-b974-445d-b4f5-ee0ae421a3f3 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:47.567631 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-43c3de61-b974-445d-b4f5-ee0ae421a3f3 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:47.573910 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-43c3de61-b974-445d-b4f5-ee0ae421a3f3 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:47.573910 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-43c3de61-b974-445d-b4f5-ee0ae421a3f3 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:47.573910 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-43c3de61-b974-445d-b4f5-ee0ae421a3f3 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:48.314278 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-43c3de61-b974-445d-b4f5-ee0ae421a3f3 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3478222ab7f24587a53f4deb83753957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c92264dc354f548697879f5db3c70c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:48.323607 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-43c3de61-b974-445d-b4f5-ee0ae421a3f3 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] 10.222.0.13 "GET /compute/v2.1/servers/58c01b8d-2408-44eb-98f9-4aa48acc9481" status: 200 len: 1268 microversion: 2.1 time: 0.780964 Oct 30 01:27:48.326393 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1622/3270] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:27:47 2022] GET /compute/v2.1/servers/58c01b8d-2408-44eb-98f9-4aa48acc9481 => generated 1268 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:48.332700 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-f6d51787-a96c-41a3-8d11-9b5089ad032a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:27:48.333885 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-f6d51787-a96c-41a3-8d11-9b5089ad032a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:27:48.338270 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-f6d51787-a96c-41a3-8d11-9b5089ad032a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:27:48.338270 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-f6d51787-a96c-41a3-8d11-9b5089ad032a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:27:48.338270 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-f6d51787-a96c-41a3-8d11-9b5089ad032a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:27:48.338606 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bf4c63b1-18cf-4b56-afb7-bd07b0832639 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:48.338790 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-bf4c63b1-18cf-4b56-afb7-bd07b0832639 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d01c1c62-c352-4a98-b95b-51ff385a415e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:48.354498 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f6d51787-a96c-41a3-8d11-9b5089ad032a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:48.356700 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bf4c63b1-18cf-4b56-afb7-bd07b0832639 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:48.357490 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bf4c63b1-18cf-4b56-afb7-bd07b0832639 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:48.359155 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bf4c63b1-18cf-4b56-afb7-bd07b0832639 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:48.361424 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f6d51787-a96c-41a3-8d11-9b5089ad032a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:48.363319 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f6d51787-a96c-41a3-8d11-9b5089ad032a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:48.365227 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bf4c63b1-18cf-4b56-afb7-bd07b0832639 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:48.366452 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bf4c63b1-18cf-4b56-afb7-bd07b0832639 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:48.367610 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bf4c63b1-18cf-4b56-afb7-bd07b0832639 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:48.376768 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f6d51787-a96c-41a3-8d11-9b5089ad032a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:48.387271 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f6d51787-a96c-41a3-8d11-9b5089ad032a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:48.388252 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f6d51787-a96c-41a3-8d11-9b5089ad032a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:48.462441 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-f6d51787-a96c-41a3-8d11-9b5089ad032a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Getting quotas for project 4aa9c648b20d41d7b150fbf64cde6fe8. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:27:48.462441 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-f6d51787-a96c-41a3-8d11-9b5089ad032a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Getting quotas for user f857d6b0826e47c6875a307e7ccfb104 and project 4aa9c648b20d41d7b150fbf64cde6fe8. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:27:48.475065 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f6d51787-a96c-41a3-8d11-9b5089ad032a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:27:48.480241 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f6d51787-a96c-41a3-8d11-9b5089ad032a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: c1d74af2-1793-4369-8c7e-a9e5047df775] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dca8deb4-b525-42b4-860c-8ee77a764df8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:27:48.577486 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-bf4c63b1-18cf-4b56-afb7-bd07b0832639 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:48.587400 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bf4c63b1-18cf-4b56-afb7-bd07b0832639 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e" status: 200 len: 1266 microversion: 2.1 time: 0.253190 Oct 30 01:27:48.588166 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1623/3271] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:27:48 2022] GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e => generated 1266 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:48.604016 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-be07dc9d-5c59-45ea-980b-9a8933654de7 tempest-SecurityGroupRulesTestJSON-1160426309 tempest-SecurityGroupRulesTestJSON-1160426309-project] Calling method '.version_select at 0x7f44c7c175e0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:48.686475 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-be07dc9d-5c59-45ea-980b-9a8933654de7 tempest-SecurityGroupRulesTestJSON-1160426309 tempest-SecurityGroupRulesTestJSON-1160426309-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups/0ede9bac-cf8f-453e-b4d1-ea0e84cf6839" status: 200 len: 665 microversion: 2.1 time: 0.096990 Oct 30 01:27:48.687421 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1624/3272] 10.222.0.13 () {58 vars in 1269 bytes} [Sun Oct 30 01:27:48 2022] GET /compute/v2.1/os-security-groups/0ede9bac-cf8f-453e-b4d1-ea0e84cf6839 => generated 665 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:27:48.693059 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0f704a3b-cec1-4f41-9f6f-27c6de66b3bf tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Action: 'create', calling method: .version_select at 0x7f44c7c17790>, body: {"keypair": {"name": "tempest-keypair-970496102", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPtDmsqFUWf2Bmck5kq8biDuFkEOtyXSjA1yT5vnIrqcjIwkBKXKqdICzMeL4pkDos2lV5UDwBb9/pqmuNL2piLYh/kGayCoFtYsvDTXPDg/pBoowRohuz4Ov5LZ5b3Yow=="}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:27:48.709910 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-0f704a3b-cec1-4f41-9f6f-27c6de66b3bf tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Getting quotas for project 51b75ee1fcc142dd9eb8cb4e3ea631b8. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:27:48.727258 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-0f704a3b-cec1-4f41-9f6f-27c6de66b3bf tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Getting quotas for user 55d02fb5fddb48e49fb66428db0f0424 and project 51b75ee1fcc142dd9eb8cb4e3ea631b8. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:27:48.823778 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f6d51787-a96c-41a3-8d11-9b5089ad032a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.415945 Oct 30 01:27:48.832125 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1649/3273] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:27:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2425 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:27:48.849433 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d9c23bde-fc55-47c0-9d37-fc4cd2824359 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:48.850375 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d9c23bde-fc55-47c0-9d37-fc4cd2824359 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] [instance: 4428fb95-41d0-4a38-95d6-7b2e798068f0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:48.866894 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9c23bde-fc55-47c0-9d37-fc4cd2824359 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:48.867412 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9c23bde-fc55-47c0-9d37-fc4cd2824359 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:48.869822 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9c23bde-fc55-47c0-9d37-fc4cd2824359 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:48.871825 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9c23bde-fc55-47c0-9d37-fc4cd2824359 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:48.873714 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9c23bde-fc55-47c0-9d37-fc4cd2824359 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:48.874319 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9c23bde-fc55-47c0-9d37-fc4cd2824359 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:48.909447 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0f704a3b-cec1-4f41-9f6f-27c6de66b3bf tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.220861 Oct 30 01:27:48.910235 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1625/3274] 10.222.0.13 () {62 vars in 1200 bytes} [Sun Oct 30 01:27:48 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 222 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 30 01:27:48.919423 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f8e7660f-c8d3-42c4-8cb0-cdd3d4b31171 tempest-SecurityGroupRulesTestJSON-1160426309 tempest-SecurityGroupRulesTestJSON-1160426309-project] Calling method '.version_select at 0x7f44ccacc550>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:49.061746 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d9c23bde-fc55-47c0-9d37-fc4cd2824359 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:49.084023 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d9c23bde-fc55-47c0-9d37-fc4cd2824359 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:49.089944 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d9c23bde-fc55-47c0-9d37-fc4cd2824359 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:49.091202 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d9c23bde-fc55-47c0-9d37-fc4cd2824359 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] 10.222.0.13 "GET /compute/v2.1/servers/4428fb95-41d0-4a38-95d6-7b2e798068f0" status: 200 len: 1366 microversion: 2.57 time: 0.257619 Oct 30 01:27:49.091794 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1650/3275] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:27:48 2022] GET /compute/v2.1/servers/4428fb95-41d0-4a38-95d6-7b2e798068f0 => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:27:49.110209 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-68a7d999-b79d-40b2-b777-020ae249f127 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:49.110847 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-68a7d999-b79d-40b2-b777-020ae249f127 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: c1d74af2-1793-4369-8c7e-a9e5047df775] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:49.208323 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-68a7d999-b79d-40b2-b777-020ae249f127 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:49.218359 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-68a7d999-b79d-40b2-b777-020ae249f127 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/c1d74af2-1793-4369-8c7e-a9e5047df775" status: 200 len: 1207 microversion: 2.1 time: 0.125215 Oct 30 01:27:49.225446 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1651/3276] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:27:49 2022] GET /compute/v2.1/servers/c1d74af2-1793-4369-8c7e-a9e5047df775 => generated 1207 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:49.359377 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-caa177ea-516e-450b-89d2-5d5d59d6a095 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:49.361267 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-caa177ea-516e-450b-89d2-5d5d59d6a095 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] [instance: 58c01b8d-2408-44eb-98f9-4aa48acc9481] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:49.375917 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-caa177ea-516e-450b-89d2-5d5d59d6a095 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:49.377217 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-caa177ea-516e-450b-89d2-5d5d59d6a095 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:49.377681 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-caa177ea-516e-450b-89d2-5d5d59d6a095 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:49.378391 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-caa177ea-516e-450b-89d2-5d5d59d6a095 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:49.378838 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-caa177ea-516e-450b-89d2-5d5d59d6a095 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:49.379253 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-caa177ea-516e-450b-89d2-5d5d59d6a095 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:49.460513 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-caa177ea-516e-450b-89d2-5d5d59d6a095 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3478222ab7f24587a53f4deb83753957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c92264dc354f548697879f5db3c70c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:49.472470 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-caa177ea-516e-450b-89d2-5d5d59d6a095 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] 10.222.0.13 "GET /compute/v2.1/servers/58c01b8d-2408-44eb-98f9-4aa48acc9481" status: 200 len: 1274 microversion: 2.1 time: 0.124086 Oct 30 01:27:49.472937 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1652/3277] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:27:49 2022] GET /compute/v2.1/servers/58c01b8d-2408-44eb-98f9-4aa48acc9481 => generated 1274 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:49.511256 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f8e7660f-c8d3-42c4-8cb0-cdd3d4b31171 tempest-SecurityGroupRulesTestJSON-1160426309 tempest-SecurityGroupRulesTestJSON-1160426309-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-group-rules/c350ff49-b183-47fe-bff7-0dce5e119bdd" status: 202 len: 0 microversion: 2.1 time: 0.599760 Oct 30 01:27:49.528771 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1626/3278] 10.222.0.13 () {58 vars in 1287 bytes} [Sun Oct 30 01:27:48 2022] DELETE /compute/v2.1/os-security-group-rules/c350ff49-b183-47fe-bff7-0dce5e119bdd => generated 0 bytes in 616 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:27:49.534591 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2aadce13-9e5b-49f3-bedc-60dfb8f1a406 tempest-SecurityGroupRulesTestJSON-1160426309 tempest-SecurityGroupRulesTestJSON-1160426309-project] Calling method '.version_select at 0x7f44d04e5550>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:49.629187 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5533e174-2b44-4d7c-b351-c120fc28672a tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:49.634638 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5533e174-2b44-4d7c-b351-c120fc28672a tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d01c1c62-c352-4a98-b95b-51ff385a415e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:49.676574 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5533e174-2b44-4d7c-b351-c120fc28672a tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:49.683197 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5533e174-2b44-4d7c-b351-c120fc28672a tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:49.685772 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5533e174-2b44-4d7c-b351-c120fc28672a tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:49.693817 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5533e174-2b44-4d7c-b351-c120fc28672a tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:49.701089 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5533e174-2b44-4d7c-b351-c120fc28672a tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:49.703076 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5533e174-2b44-4d7c-b351-c120fc28672a tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:49.900906 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5533e174-2b44-4d7c-b351-c120fc28672a tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:49.914266 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5533e174-2b44-4d7c-b351-c120fc28672a tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e" status: 200 len: 1284 microversion: 2.1 time: 0.299027 Oct 30 01:27:49.916445 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1627/3279] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:27:49 2022] GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e => generated 1284 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:49.921879 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-d2225cc7-2c99-42e2-aff1-775e2c8ae800 req-01da9e40-4974-477d-98f4-77a503d15664 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4259dcb-d421-45fb-84e6-7e8a8f7ce20d", "name": "network-vif-unplugged", "status": "completed", "tag": "f4115819-6c96-4bc9-a7c1-221d92ea37ec"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:27:49.966986 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d2225cc7-2c99-42e2-aff1-775e2c8ae800 req-01da9e40-4974-477d-98f4-77a503d15664 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:49.966986 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d2225cc7-2c99-42e2-aff1-775e2c8ae800 req-01da9e40-4974-477d-98f4-77a503d15664 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:49.966986 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d2225cc7-2c99-42e2-aff1-775e2c8ae800 req-01da9e40-4974-477d-98f4-77a503d15664 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:49.976352 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:27:49.992377 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-d2225cc7-2c99-42e2-aff1-775e2c8ae800 req-01da9e40-4974-477d-98f4-77a503d15664 service nova] Creating event network-vif-unplugged:f4115819-6c96-4bc9-a7c1-221d92ea37ec for instance b4259dcb-d421-45fb-84e6-7e8a8f7ce20d on n-h1-master-1 Oct 30 01:27:50.007688 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-d2225cc7-2c99-42e2-aff1-775e2c8ae800 req-01da9e40-4974-477d-98f4-77a503d15664 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089778 Oct 30 01:27:50.009230 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1628/3280] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:27:50.123508 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b75cc7b9-3d5c-4b54-80f1-eed475d43235 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:50.124636 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b75cc7b9-3d5c-4b54-80f1-eed475d43235 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] [instance: 4428fb95-41d0-4a38-95d6-7b2e798068f0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:50.132640 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b75cc7b9-3d5c-4b54-80f1-eed475d43235 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:50.132640 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b75cc7b9-3d5c-4b54-80f1-eed475d43235 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:50.133252 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b75cc7b9-3d5c-4b54-80f1-eed475d43235 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:50.134131 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b75cc7b9-3d5c-4b54-80f1-eed475d43235 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:50.134753 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b75cc7b9-3d5c-4b54-80f1-eed475d43235 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:50.135350 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b75cc7b9-3d5c-4b54-80f1-eed475d43235 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:50.243128 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b75cc7b9-3d5c-4b54-80f1-eed475d43235 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:50.257156 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b75cc7b9-3d5c-4b54-80f1-eed475d43235 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:50.261922 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b75cc7b9-3d5c-4b54-80f1-eed475d43235 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:50.263201 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b75cc7b9-3d5c-4b54-80f1-eed475d43235 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] 10.222.0.13 "GET /compute/v2.1/servers/4428fb95-41d0-4a38-95d6-7b2e798068f0" status: 200 len: 1366 microversion: 2.57 time: 0.144887 Oct 30 01:27:50.285464 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1629/3281] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:27:50 2022] GET /compute/v2.1/servers/4428fb95-41d0-4a38-95d6-7b2e798068f0 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:27:50.300452 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5dbb2135-bc01-4697-b87b-28f1f681c536 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:50.302141 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5dbb2135-bc01-4697-b87b-28f1f681c536 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: c1d74af2-1793-4369-8c7e-a9e5047df775] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:50.311645 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2aadce13-9e5b-49f3-bedc-60dfb8f1a406 tempest-SecurityGroupRulesTestJSON-1160426309 tempest-SecurityGroupRulesTestJSON-1160426309-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/0ede9bac-cf8f-453e-b4d1-ea0e84cf6839" status: 202 len: 0 microversion: 2.1 time: 0.787391 Oct 30 01:27:50.313738 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1653/3282] 10.222.0.13 () {58 vars in 1272 bytes} [Sun Oct 30 01:27:49 2022] DELETE /compute/v2.1/os-security-groups/0ede9bac-cf8f-453e-b4d1-ea0e84cf6839 => generated 0 bytes in 790 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:27:50.321180 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-523362a1-b6ae-4c6e-8c61-946c4b4c1426 tempest-SecurityGroupRulesTestJSON-1160426309 tempest-SecurityGroupRulesTestJSON-1160426309-project] Calling method '.version_select at 0x7f44c740eb80>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:50.398048 n-d-master-1 devstack@n-api.service[121102]: DEBUG neutronclient.v2_0.client [None req-523362a1-b6ae-4c6e-8c61-946c4b4c1426 tempest-SecurityGroupRulesTestJSON-1160426309 tempest-SecurityGroupRulesTestJSON-1160426309-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c776d93a-2d49-4c1e-9c20-2c4723eab751 does not exist", "detail": ""}} {{(pid=121102) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 30 01:27:50.399314 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.security_group_api [None req-523362a1-b6ae-4c6e-8c61-946c4b4c1426 tempest-SecurityGroupRulesTestJSON-1160426309 tempest-SecurityGroupRulesTestJSON-1160426309-project] Neutron security group c776d93a-2d49-4c1e-9c20-2c4723eab751 not found {{(pid=121102) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 30 01:27:50.399848 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-523362a1-b6ae-4c6e-8c61-946c4b4c1426 tempest-SecurityGroupRulesTestJSON-1160426309 tempest-SecurityGroupRulesTestJSON-1160426309-project] HTTP exception thrown: Security group c776d93a-2d49-4c1e-9c20-2c4723eab751 does not exist Oct 30 01:27:50.399848 n-d-master-1 devstack@n-api.service[121102]: Neutron server returns request_ids: ['req-3dc5992e-fb1b-4f36-bee1-6f7a75eef86d'] Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-523362a1-b6ae-4c6e-8c61-946c4b4c1426 tempest-SecurityGroupRulesTestJSON-1160426309 tempest-SecurityGroupRulesTestJSON-1160426309-project] Request method failure captured: Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/os-security-groups/c776d93a-2d49-4c1e-9c20-2c4723eab751 HTTP/1.1 Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdL6-l6ilXbgtqshkiKs8Npj9_3dcDrB-OQmVzWBf0EroDs8JuZ25fmY1HXL65Eh8lKCBqpu-wfgbVEvjtWHhHEdSsueI52eVuPdOq3YoHaK9mEPcAKzDstKFsKoZVwTpmb0zhQnkxjNeGdewR5ZCy0Y7NSXRuOiOzS2iYCYBC6ldZk Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: e712a6f1f1de4d4a99ccdb924693cd03 Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1160426309 Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e712a6f1f1de4d4a99ccdb924693cd03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e712a6f1f1de4d4a99ccdb924693cd03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e712a6f1f1de4d4a99ccdb924693cd03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e712a6f1f1de4d4a99ccdb924693cd03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1160426309 Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: e712a6f1f1de4d4a99ccdb924693cd03 Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1160426309 Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-SecurityGroupRulesTestJSON-1160426309-project Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: b26f4a23e4674cc3b24ec6e67f1c860d Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1160426309-project Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: method: Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: exception: Security group c776d93a-2d49-4c1e-9c20-2c4723eab751 does not exist Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: Neutron server returns request_ids: ['req-3dc5992e-fb1b-4f36-bee1-6f7a75eef86d'] Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'c776d93a-2d49-4c1e-9c20-2c4723eab751'} Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 30 01:27:50.402262 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c776d93a-2d49-4c1e-9c20-2c4723eab751 does not exist Oct 30 01:27:50.407463 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3dc5992e-fb1b-4f36-bee1-6f7a75eef86d'] Oct 30 01:27:50.407463 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:50.407463 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:27:50.407463 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:50.407463 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:27:50.407463 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 30 01:27:50.407463 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 30 01:27:50.407463 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 30 01:27:50.407463 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 30 01:27:50.407463 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c776d93a-2d49-4c1e-9c20-2c4723eab751 does not exist Oct 30 01:27:50.407463 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3dc5992e-fb1b-4f36-bee1-6f7a75eef86d'] Oct 30 01:27:50.407463 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:50.407463 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:27:50.407463 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:50.407463 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:27:50.407463 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:27:50.407463 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:27:50.407463 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:27:50.407463 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:27:50.407463 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:27:50.407463 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:27:50.407463 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:27:50.407463 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:27:50.407463 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 30 01:27:50.407463 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 30 01:27:50.407463 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c776d93a-2d49-4c1e-9c20-2c4723eab751 does not exist Oct 30 01:27:50.407463 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3dc5992e-fb1b-4f36-bee1-6f7a75eef86d'] Oct 30 01:27:50.407463 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:50.407463 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:27:50.407463 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:50.407463 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:27:50.407463 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:27:50.407463 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:27:50.407463 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:27:50.407463 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:27:50.407463 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c776d93a-2d49-4c1e-9c20-2c4723eab751 does not exist Oct 30 01:27:50.407463 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3dc5992e-fb1b-4f36-bee1-6f7a75eef86d'] Oct 30 01:27:50.407463 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:27:50.412970 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-523362a1-b6ae-4c6e-8c61-946c4b4c1426 tempest-SecurityGroupRulesTestJSON-1160426309 tempest-SecurityGroupRulesTestJSON-1160426309-project] Returning 404 to user: Security group c776d93a-2d49-4c1e-9c20-2c4723eab751 does not exist Oct 30 01:27:50.412970 n-d-master-1 devstack@n-api.service[121102]: Neutron server returns request_ids: ['req-3dc5992e-fb1b-4f36-bee1-6f7a75eef86d'] {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:27:50.412970 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-523362a1-b6ae-4c6e-8c61-946c4b4c1426 tempest-SecurityGroupRulesTestJSON-1160426309 tempest-SecurityGroupRulesTestJSON-1160426309-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/c776d93a-2d49-4c1e-9c20-2c4723eab751" status: 404 len: 194 microversion: 2.1 time: 0.095766 Oct 30 01:27:50.419477 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1654/3283] 10.222.0.13 () {58 vars in 1272 bytes} [Sun Oct 30 01:27:50 2022] DELETE /compute/v2.1/os-security-groups/c776d93a-2d49-4c1e-9c20-2c4723eab751 => generated 194 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 01:27:50.429153 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-29683c52-209e-4391-ae27-0de61ab14cbe tempest-SecurityGroupRulesTestJSON-1160426309 tempest-SecurityGroupRulesTestJSON-1160426309-project] Calling method '.version_select at 0x7f44cce55d30>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:50.663753 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5dbb2135-bc01-4697-b87b-28f1f681c536 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:50.676568 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5dbb2135-bc01-4697-b87b-28f1f681c536 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/c1d74af2-1793-4369-8c7e-a9e5047df775" status: 200 len: 1207 microversion: 2.1 time: 0.385701 Oct 30 01:27:50.679057 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1630/3284] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:27:50 2022] GET /compute/v2.1/servers/c1d74af2-1793-4369-8c7e-a9e5047df775 => generated 1207 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:50.693311 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9cc427c3-89d1-493c-af62-83f639c527c1 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:50.694264 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9cc427c3-89d1-493c-af62-83f639c527c1 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] [instance: 58c01b8d-2408-44eb-98f9-4aa48acc9481] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:50.714144 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9cc427c3-89d1-493c-af62-83f639c527c1 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:50.714584 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9cc427c3-89d1-493c-af62-83f639c527c1 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:50.715019 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9cc427c3-89d1-493c-af62-83f639c527c1 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:50.715743 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9cc427c3-89d1-493c-af62-83f639c527c1 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:50.716196 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9cc427c3-89d1-493c-af62-83f639c527c1 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:50.716617 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9cc427c3-89d1-493c-af62-83f639c527c1 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:51.581319 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9cc427c3-89d1-493c-af62-83f639c527c1 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3478222ab7f24587a53f4deb83753957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c92264dc354f548697879f5db3c70c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:51.589635 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9cc427c3-89d1-493c-af62-83f639c527c1 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] 10.222.0.13 "GET /compute/v2.1/servers/58c01b8d-2408-44eb-98f9-4aa48acc9481" status: 200 len: 1316 microversion: 2.1 time: 0.907516 Oct 30 01:27:51.593962 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1631/3285] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:27:50 2022] GET /compute/v2.1/servers/58c01b8d-2408-44eb-98f9-4aa48acc9481 => generated 1316 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:51.607212 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3f4bb135-f216-49ee-85ea-da3113c3b676 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:51.607841 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3f4bb135-f216-49ee-85ea-da3113c3b676 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d01c1c62-c352-4a98-b95b-51ff385a415e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:51.623467 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f4bb135-f216-49ee-85ea-da3113c3b676 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:51.623961 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f4bb135-f216-49ee-85ea-da3113c3b676 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:51.624428 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f4bb135-f216-49ee-85ea-da3113c3b676 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:51.625154 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f4bb135-f216-49ee-85ea-da3113c3b676 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:51.625623 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f4bb135-f216-49ee-85ea-da3113c3b676 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:51.626048 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f4bb135-f216-49ee-85ea-da3113c3b676 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:52.113184 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-29683c52-209e-4391-ae27-0de61ab14cbe tempest-SecurityGroupRulesTestJSON-1160426309 tempest-SecurityGroupRulesTestJSON-1160426309-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/6f6d3c60-feda-414c-ad0b-ad082104eb66" status: 202 len: 0 microversion: 2.1 time: 1.689102 Oct 30 01:27:52.116785 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1655/3286] 10.222.0.13 () {58 vars in 1272 bytes} [Sun Oct 30 01:27:50 2022] DELETE /compute/v2.1/os-security-groups/6f6d3c60-feda-414c-ad0b-ad082104eb66 => generated 0 bytes in 1693 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 30 01:27:52.121633 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c5b6212c-2bdf-4ebb-98de-0ba5f59953f7 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:52.122679 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c5b6212c-2bdf-4ebb-98de-0ba5f59953f7 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] [instance: 4428fb95-41d0-4a38-95d6-7b2e798068f0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:52.129812 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c5b6212c-2bdf-4ebb-98de-0ba5f59953f7 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:52.130510 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c5b6212c-2bdf-4ebb-98de-0ba5f59953f7 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:52.133192 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c5b6212c-2bdf-4ebb-98de-0ba5f59953f7 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:52.133192 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c5b6212c-2bdf-4ebb-98de-0ba5f59953f7 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:52.133192 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c5b6212c-2bdf-4ebb-98de-0ba5f59953f7 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:52.133192 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c5b6212c-2bdf-4ebb-98de-0ba5f59953f7 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:52.145563 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3f4bb135-f216-49ee-85ea-da3113c3b676 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:52.154342 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3f4bb135-f216-49ee-85ea-da3113c3b676 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e" status: 200 len: 1314 microversion: 2.1 time: 0.558716 Oct 30 01:27:52.172279 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1632/3287] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:27:51 2022] GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e => generated 1314 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:52.177533 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-97cfb6af-d65e-43ba-9898-1539c637eb6b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:52.178433 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-97cfb6af-d65e-43ba-9898-1539c637eb6b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: c1d74af2-1793-4369-8c7e-a9e5047df775] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:52.184731 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-97cfb6af-d65e-43ba-9898-1539c637eb6b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:52.185513 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-97cfb6af-d65e-43ba-9898-1539c637eb6b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:52.186104 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-97cfb6af-d65e-43ba-9898-1539c637eb6b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:52.187538 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-97cfb6af-d65e-43ba-9898-1539c637eb6b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:52.188146 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-97cfb6af-d65e-43ba-9898-1539c637eb6b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:52.188734 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-97cfb6af-d65e-43ba-9898-1539c637eb6b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:52.289651 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c5b6212c-2bdf-4ebb-98de-0ba5f59953f7 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:52.309935 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c5b6212c-2bdf-4ebb-98de-0ba5f59953f7 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:52.313314 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c5b6212c-2bdf-4ebb-98de-0ba5f59953f7 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:52.315634 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c5b6212c-2bdf-4ebb-98de-0ba5f59953f7 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] 10.222.0.13 "GET /compute/v2.1/servers/4428fb95-41d0-4a38-95d6-7b2e798068f0" status: 200 len: 1366 microversion: 2.57 time: 0.197482 Oct 30 01:27:52.316965 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1656/3288] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:27:52 2022] GET /compute/v2.1/servers/4428fb95-41d0-4a38-95d6-7b2e798068f0 => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:27:52.328456 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-97cfb6af-d65e-43ba-9898-1539c637eb6b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:52.328693 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-35538285-2b68-47df-962b-8244fe094b55 tempest-SecurityGroupRulesTestJSON-1160426309 tempest-SecurityGroupRulesTestJSON-1160426309-project] Calling method '.version_select at 0x7f44c73bf430>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:52.339043 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-97cfb6af-d65e-43ba-9898-1539c637eb6b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/c1d74af2-1793-4369-8c7e-a9e5047df775" status: 200 len: 1259 microversion: 2.1 time: 0.165356 Oct 30 01:27:52.339631 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1633/3289] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:27:52 2022] GET /compute/v2.1/servers/c1d74af2-1793-4369-8c7e-a9e5047df775 => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:52.615238 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9f791a6a-90a9-4869-991e-efb379137b83 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:52.616321 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9f791a6a-90a9-4869-991e-efb379137b83 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] [instance: 58c01b8d-2408-44eb-98f9-4aa48acc9481] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:52.625768 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9f791a6a-90a9-4869-991e-efb379137b83 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:52.626580 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9f791a6a-90a9-4869-991e-efb379137b83 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:52.627314 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9f791a6a-90a9-4869-991e-efb379137b83 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:52.628360 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9f791a6a-90a9-4869-991e-efb379137b83 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:52.629195 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9f791a6a-90a9-4869-991e-efb379137b83 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:52.629934 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9f791a6a-90a9-4869-991e-efb379137b83 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:53.231084 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9f791a6a-90a9-4869-991e-efb379137b83 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3478222ab7f24587a53f4deb83753957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c92264dc354f548697879f5db3c70c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:53.243319 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9f791a6a-90a9-4869-991e-efb379137b83 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] 10.222.0.13 "GET /compute/v2.1/servers/58c01b8d-2408-44eb-98f9-4aa48acc9481" status: 200 len: 1316 microversion: 2.1 time: 0.633129 Oct 30 01:27:53.244784 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1634/3290] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:27:52 2022] GET /compute/v2.1/servers/58c01b8d-2408-44eb-98f9-4aa48acc9481 => generated 1316 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:53.265197 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d59dc9ae-227d-4453-b49e-e5db1e001a2b tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:53.267165 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d59dc9ae-227d-4453-b49e-e5db1e001a2b tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d01c1c62-c352-4a98-b95b-51ff385a415e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:53.278944 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d59dc9ae-227d-4453-b49e-e5db1e001a2b tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:53.280471 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d59dc9ae-227d-4453-b49e-e5db1e001a2b tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:53.281283 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d59dc9ae-227d-4453-b49e-e5db1e001a2b tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:53.283354 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d59dc9ae-227d-4453-b49e-e5db1e001a2b tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:53.284759 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d59dc9ae-227d-4453-b49e-e5db1e001a2b tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:53.285554 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d59dc9ae-227d-4453-b49e-e5db1e001a2b tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:53.838840 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-35538285-2b68-47df-962b-8244fe094b55 tempest-SecurityGroupRulesTestJSON-1160426309 tempest-SecurityGroupRulesTestJSON-1160426309-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/799a077d-d80f-4628-8f05-f24d57735310" status: 202 len: 0 microversion: 2.1 time: 1.520525 Oct 30 01:27:53.839423 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1657/3291] 10.222.0.13 () {58 vars in 1272 bytes} [Sun Oct 30 01:27:52 2022] DELETE /compute/v2.1/os-security-groups/799a077d-d80f-4628-8f05-f24d57735310 => generated 0 bytes in 1522 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:27:53.846794 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-ca6c306f-df3d-471d-acd0-7d26a47b78f4 req-3691aafe-9389-4e86-834d-7058c515cf2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d01c1c62-c352-4a98-b95b-51ff385a415e", "tag": "d99123ae-318c-41aa-bb60-152a6d295ad2"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:27:53.871362 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ca6c306f-df3d-471d-acd0-7d26a47b78f4 req-3691aafe-9389-4e86-834d-7058c515cf2d service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:53.872131 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ca6c306f-df3d-471d-acd0-7d26a47b78f4 req-3691aafe-9389-4e86-834d-7058c515cf2d service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:53.872917 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ca6c306f-df3d-471d-acd0-7d26a47b78f4 req-3691aafe-9389-4e86-834d-7058c515cf2d service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:53.926172 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-ca6c306f-df3d-471d-acd0-7d26a47b78f4 req-3691aafe-9389-4e86-834d-7058c515cf2d service nova] Creating event network-changed:d99123ae-318c-41aa-bb60-152a6d295ad2 for instance d01c1c62-c352-4a98-b95b-51ff385a415e on n-h1-master-1 Oct 30 01:27:53.935257 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-ca6c306f-df3d-471d-acd0-7d26a47b78f4 req-3691aafe-9389-4e86-834d-7058c515cf2d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094368 Oct 30 01:27:53.935930 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1658/3292] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:27:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:27:53.941582 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1747d9a6-1b65-4e04-863a-0b95c1ff825f tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:53.942315 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1747d9a6-1b65-4e04-863a-0b95c1ff825f tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] [instance: 4428fb95-41d0-4a38-95d6-7b2e798068f0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:53.964280 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1747d9a6-1b65-4e04-863a-0b95c1ff825f tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:53.964280 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1747d9a6-1b65-4e04-863a-0b95c1ff825f tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:53.964280 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1747d9a6-1b65-4e04-863a-0b95c1ff825f tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:53.964280 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1747d9a6-1b65-4e04-863a-0b95c1ff825f tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:53.964280 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1747d9a6-1b65-4e04-863a-0b95c1ff825f tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:53.964280 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1747d9a6-1b65-4e04-863a-0b95c1ff825f tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:54.028623 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:27:54.196205 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d59dc9ae-227d-4453-b49e-e5db1e001a2b tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:54.197834 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1747d9a6-1b65-4e04-863a-0b95c1ff825f tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:54.213802 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1747d9a6-1b65-4e04-863a-0b95c1ff825f tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:54.218844 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:27:54.222046 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d59dc9ae-227d-4453-b49e-e5db1e001a2b tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e" status: 200 len: 1314 microversion: 2.1 time: 0.975993 Oct 30 01:27:54.226231 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1635/3293] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:27:53 2022] GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e => generated 1314 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:54.230565 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1747d9a6-1b65-4e04-863a-0b95c1ff825f tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:54.232026 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1747d9a6-1b65-4e04-863a-0b95c1ff825f tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] 10.222.0.13 "GET /compute/v2.1/servers/4428fb95-41d0-4a38-95d6-7b2e798068f0" status: 200 len: 1366 microversion: 2.57 time: 0.294924 Oct 30 01:27:54.239622 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1659/3294] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:27:53 2022] GET /compute/v2.1/servers/4428fb95-41d0-4a38-95d6-7b2e798068f0 => generated 1366 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:27:54.242968 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9e9b7c36-52cc-4cc6-bb37-78fb9734ecb1 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:54.249837 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9e9b7c36-52cc-4cc6-bb37-78fb9734ecb1 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: c1d74af2-1793-4369-8c7e-a9e5047df775] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:54.253791 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8da1ed9d-4b93-4208-b746-2614ef83dac1 tempest-SecurityGroupRulesTestJSON-1160426309 tempest-SecurityGroupRulesTestJSON-1160426309-project] Calling method '.version_select at 0x7f44c76a2430>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:54.262026 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e9b7c36-52cc-4cc6-bb37-78fb9734ecb1 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:54.268047 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e9b7c36-52cc-4cc6-bb37-78fb9734ecb1 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:54.268788 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e9b7c36-52cc-4cc6-bb37-78fb9734ecb1 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:54.272969 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e9b7c36-52cc-4cc6-bb37-78fb9734ecb1 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:54.273826 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e9b7c36-52cc-4cc6-bb37-78fb9734ecb1 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:54.274362 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e9b7c36-52cc-4cc6-bb37-78fb9734ecb1 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:54.720368 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9e9b7c36-52cc-4cc6-bb37-78fb9734ecb1 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:54.729322 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9e9b7c36-52cc-4cc6-bb37-78fb9734ecb1 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/c1d74af2-1793-4369-8c7e-a9e5047df775" status: 200 len: 1265 microversion: 2.1 time: 0.501362 Oct 30 01:27:54.746312 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1636/3295] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:27:54 2022] GET /compute/v2.1/servers/c1d74af2-1793-4369-8c7e-a9e5047df775 => generated 1265 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:54.751818 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-e17aa3b1-a43d-4a14-b4bd-4632ed8fee32 req-74439813-2a98-4c9e-8a8b-c52645472a68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58c01b8d-2408-44eb-98f9-4aa48acc9481", "tag": "f77283d2-a434-4c14-894d-036be5b7842b"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:27:54.781430 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e17aa3b1-a43d-4a14-b4bd-4632ed8fee32 req-74439813-2a98-4c9e-8a8b-c52645472a68 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:54.786531 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e17aa3b1-a43d-4a14-b4bd-4632ed8fee32 req-74439813-2a98-4c9e-8a8b-c52645472a68 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:54.786531 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e17aa3b1-a43d-4a14-b4bd-4632ed8fee32 req-74439813-2a98-4c9e-8a8b-c52645472a68 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:54.801009 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-e17aa3b1-a43d-4a14-b4bd-4632ed8fee32 req-74439813-2a98-4c9e-8a8b-c52645472a68 service nova] Creating event network-changed:f77283d2-a434-4c14-894d-036be5b7842b for instance 58c01b8d-2408-44eb-98f9-4aa48acc9481 on n-h1-master-1 Oct 30 01:27:54.811282 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-e17aa3b1-a43d-4a14-b4bd-4632ed8fee32 req-74439813-2a98-4c9e-8a8b-c52645472a68 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063553 Oct 30 01:27:54.816537 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1637/3296] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:27:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:27:54.822257 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b31907e0-67a0-4f4b-b9d0-6eba82fd4757 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:54.823365 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b31907e0-67a0-4f4b-b9d0-6eba82fd4757 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] [instance: 58c01b8d-2408-44eb-98f9-4aa48acc9481] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:54.831263 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b31907e0-67a0-4f4b-b9d0-6eba82fd4757 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:54.832042 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b31907e0-67a0-4f4b-b9d0-6eba82fd4757 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:54.832645 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b31907e0-67a0-4f4b-b9d0-6eba82fd4757 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:54.833620 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b31907e0-67a0-4f4b-b9d0-6eba82fd4757 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:54.834244 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b31907e0-67a0-4f4b-b9d0-6eba82fd4757 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:54.834825 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b31907e0-67a0-4f4b-b9d0-6eba82fd4757 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:55.806714 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b31907e0-67a0-4f4b-b9d0-6eba82fd4757 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3478222ab7f24587a53f4deb83753957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c92264dc354f548697879f5db3c70c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:55.818182 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b31907e0-67a0-4f4b-b9d0-6eba82fd4757 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] 10.222.0.13 "GET /compute/v2.1/servers/58c01b8d-2408-44eb-98f9-4aa48acc9481" status: 200 len: 1316 microversion: 2.1 time: 0.997276 Oct 30 01:27:55.831213 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1638/3297] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:27:54 2022] GET /compute/v2.1/servers/58c01b8d-2408-44eb-98f9-4aa48acc9481 => generated 1316 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:55.836559 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-510275a7-8d48-40fc-ac5c-4b2636258aaf tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:55.837652 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-510275a7-8d48-40fc-ac5c-4b2636258aaf tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d01c1c62-c352-4a98-b95b-51ff385a415e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:55.845184 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-510275a7-8d48-40fc-ac5c-4b2636258aaf tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:55.846830 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-510275a7-8d48-40fc-ac5c-4b2636258aaf tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:55.846830 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-510275a7-8d48-40fc-ac5c-4b2636258aaf tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:55.847358 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-510275a7-8d48-40fc-ac5c-4b2636258aaf tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:55.847956 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-510275a7-8d48-40fc-ac5c-4b2636258aaf tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:55.848540 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-510275a7-8d48-40fc-ac5c-4b2636258aaf tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:56.144812 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8da1ed9d-4b93-4208-b746-2614ef83dac1 tempest-SecurityGroupRulesTestJSON-1160426309 tempest-SecurityGroupRulesTestJSON-1160426309-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/b5a2dcf7-063e-4063-9658-39431e0dc25a" status: 202 len: 0 microversion: 2.1 time: 1.899842 Oct 30 01:27:56.145774 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1660/3298] 10.222.0.13 () {58 vars in 1272 bytes} [Sun Oct 30 01:27:54 2022] DELETE /compute/v2.1/os-security-groups/b5a2dcf7-063e-4063-9658-39431e0dc25a => generated 0 bytes in 1906 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:27:56.158715 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4d4135f2-61e9-43c7-899e-f393c1915518 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:56.160557 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4d4135f2-61e9-43c7-899e-f393c1915518 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] [instance: 4428fb95-41d0-4a38-95d6-7b2e798068f0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:56.179839 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d4135f2-61e9-43c7-899e-f393c1915518 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:56.187662 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d4135f2-61e9-43c7-899e-f393c1915518 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:56.189297 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d4135f2-61e9-43c7-899e-f393c1915518 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:56.189568 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d4135f2-61e9-43c7-899e-f393c1915518 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:56.190842 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d4135f2-61e9-43c7-899e-f393c1915518 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:56.191627 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d4135f2-61e9-43c7-899e-f393c1915518 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:56.335080 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4d4135f2-61e9-43c7-899e-f393c1915518 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:56.372710 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4d4135f2-61e9-43c7-899e-f393c1915518 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:56.380562 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4d4135f2-61e9-43c7-899e-f393c1915518 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:56.384005 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4d4135f2-61e9-43c7-899e-f393c1915518 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] 10.222.0.13 "GET /compute/v2.1/servers/4428fb95-41d0-4a38-95d6-7b2e798068f0" status: 200 len: 1366 microversion: 2.57 time: 0.232773 Oct 30 01:27:56.384603 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1661/3299] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:27:56 2022] GET /compute/v2.1/servers/4428fb95-41d0-4a38-95d6-7b2e798068f0 => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:27:56.401739 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-89aded57-318f-482d-abc7-3cbbd9832147 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:56.404020 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-89aded57-318f-482d-abc7-3cbbd9832147 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: c1d74af2-1793-4369-8c7e-a9e5047df775] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:56.418470 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-89aded57-318f-482d-abc7-3cbbd9832147 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:56.421658 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-89aded57-318f-482d-abc7-3cbbd9832147 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:56.424056 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-89aded57-318f-482d-abc7-3cbbd9832147 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:56.426425 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-89aded57-318f-482d-abc7-3cbbd9832147 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:56.428558 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-89aded57-318f-482d-abc7-3cbbd9832147 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:56.429207 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-89aded57-318f-482d-abc7-3cbbd9832147 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:56.447013 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-510275a7-8d48-40fc-ac5c-4b2636258aaf tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:56.460475 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-510275a7-8d48-40fc-ac5c-4b2636258aaf tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e" status: 200 len: 1314 microversion: 2.1 time: 0.627875 Oct 30 01:27:56.461915 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1639/3300] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:27:55 2022] GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e => generated 1314 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:56.467063 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0c5b5cb6-bfe4-41cd-95df-45cce38a9612 tempest-SecurityGroupRulesTestJSON-1160426309 tempest-SecurityGroupRulesTestJSON-1160426309-project] Calling method '.version_select at 0x7f44c7b3b160>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:56.744545 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-89aded57-318f-482d-abc7-3cbbd9832147 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:56.759411 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-89aded57-318f-482d-abc7-3cbbd9832147 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/c1d74af2-1793-4369-8c7e-a9e5047df775" status: 200 len: 1307 microversion: 2.1 time: 0.369740 Oct 30 01:27:56.761866 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1662/3301] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:27:56 2022] GET /compute/v2.1/servers/c1d74af2-1793-4369-8c7e-a9e5047df775 => generated 1307 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:56.850136 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bdd87526-b82a-4685-a35b-55c53d13f569 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:56.869140 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bdd87526-b82a-4685-a35b-55c53d13f569 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] [instance: 58c01b8d-2408-44eb-98f9-4aa48acc9481] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:56.880896 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bdd87526-b82a-4685-a35b-55c53d13f569 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:56.881923 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bdd87526-b82a-4685-a35b-55c53d13f569 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:56.884066 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bdd87526-b82a-4685-a35b-55c53d13f569 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:56.884066 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bdd87526-b82a-4685-a35b-55c53d13f569 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:56.884536 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bdd87526-b82a-4685-a35b-55c53d13f569 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:56.886568 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bdd87526-b82a-4685-a35b-55c53d13f569 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:57.854676 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bdd87526-b82a-4685-a35b-55c53d13f569 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3478222ab7f24587a53f4deb83753957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c92264dc354f548697879f5db3c70c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:57.866400 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bdd87526-b82a-4685-a35b-55c53d13f569 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] 10.222.0.13 "GET /compute/v2.1/servers/58c01b8d-2408-44eb-98f9-4aa48acc9481" status: 200 len: 1316 microversion: 2.1 time: 1.030918 Oct 30 01:27:57.870941 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1663/3302] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:27:56 2022] GET /compute/v2.1/servers/58c01b8d-2408-44eb-98f9-4aa48acc9481 => generated 1316 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:57.895822 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f0483a69-cc59-47aa-ae3e-95c3803101da tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:57.895822 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f0483a69-cc59-47aa-ae3e-95c3803101da tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] [instance: 4428fb95-41d0-4a38-95d6-7b2e798068f0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:57.922235 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f0483a69-cc59-47aa-ae3e-95c3803101da tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:57.925026 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f0483a69-cc59-47aa-ae3e-95c3803101da tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:57.925765 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f0483a69-cc59-47aa-ae3e-95c3803101da tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:57.926739 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f0483a69-cc59-47aa-ae3e-95c3803101da tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:57.929932 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f0483a69-cc59-47aa-ae3e-95c3803101da tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:57.930626 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f0483a69-cc59-47aa-ae3e-95c3803101da tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:58.180267 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f0483a69-cc59-47aa-ae3e-95c3803101da tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:58.196115 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f0483a69-cc59-47aa-ae3e-95c3803101da tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:58.200849 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f0483a69-cc59-47aa-ae3e-95c3803101da tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:58.209109 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f0483a69-cc59-47aa-ae3e-95c3803101da tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] 10.222.0.13 "GET /compute/v2.1/servers/4428fb95-41d0-4a38-95d6-7b2e798068f0" status: 200 len: 1366 microversion: 2.57 time: 0.334721 Oct 30 01:27:58.210378 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1664/3303] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:27:57 2022] GET /compute/v2.1/servers/4428fb95-41d0-4a38-95d6-7b2e798068f0 => generated 1366 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:27:58.226998 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-31cafd6c-0daf-4964-990b-f4aa11c9e57d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:58.228418 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-31cafd6c-0daf-4964-990b-f4aa11c9e57d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d01c1c62-c352-4a98-b95b-51ff385a415e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:58.242587 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-31cafd6c-0daf-4964-990b-f4aa11c9e57d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:58.245545 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-31cafd6c-0daf-4964-990b-f4aa11c9e57d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:58.246304 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-31cafd6c-0daf-4964-990b-f4aa11c9e57d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:58.247279 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-31cafd6c-0daf-4964-990b-f4aa11c9e57d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:58.249471 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-31cafd6c-0daf-4964-990b-f4aa11c9e57d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:58.250119 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-31cafd6c-0daf-4964-990b-f4aa11c9e57d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:58.418992 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=4 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:27:58.426028 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0c5b5cb6-bfe4-41cd-95df-45cce38a9612 tempest-SecurityGroupRulesTestJSON-1160426309 tempest-SecurityGroupRulesTestJSON-1160426309-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/21ef2cb8-dbf2-4bdd-a4fc-fb0bcb65bf0b" status: 202 len: 0 microversion: 2.1 time: 1.962791 Oct 30 01:27:58.426911 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1640/3304] 10.222.0.13 () {58 vars in 1272 bytes} [Sun Oct 30 01:27:56 2022] DELETE /compute/v2.1/os-security-groups/21ef2cb8-dbf2-4bdd-a4fc-fb0bcb65bf0b => generated 0 bytes in 1964 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:27:58.433375 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3f84d4bf-fe3a-4e41-844d-2eddca83fed6 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:58.434652 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3f84d4bf-fe3a-4e41-844d-2eddca83fed6 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: c1d74af2-1793-4369-8c7e-a9e5047df775] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:27:58.445570 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f84d4bf-fe3a-4e41-844d-2eddca83fed6 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:58.446166 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f84d4bf-fe3a-4e41-844d-2eddca83fed6 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:58.446866 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f84d4bf-fe3a-4e41-844d-2eddca83fed6 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:58.447659 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f84d4bf-fe3a-4e41-844d-2eddca83fed6 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:58.448194 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f84d4bf-fe3a-4e41-844d-2eddca83fed6 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:58.448697 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f84d4bf-fe3a-4e41-844d-2eddca83fed6 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:58.588292 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-31cafd6c-0daf-4964-990b-f4aa11c9e57d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:58.598980 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-31cafd6c-0daf-4964-990b-f4aa11c9e57d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e" status: 200 len: 1314 microversion: 2.1 time: 0.385933 Oct 30 01:27:58.606598 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1665/3305] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:27:58 2022] GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e => generated 1314 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:58.619209 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0197aa78-aa3a-4ef9-bf03-4d6ea04e8188 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-945213636", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "9950aa06-cffd-4cb9-a959-e64d6a4a55d3"}, {"port": "66e47ab9-7e05-48f9-9e49-e60474216b03", "tag": "port-1"}, {"port": "89620a1f-327c-4185-81a0-292dbf3e67b4", "tag": "port-2"}, {"uuid": "78e4412f-2c00-4e24-b046-8d55b8c23f94", "tag": "net-1"}, {"uuid": "78e4412f-2c00-4e24-b046-8d55b8c23f94"}, {"uuid": "49238275-20e4-4e7f-9d91-d7447cf8f6af", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "49238275-20e4-4e7f-9d91-d7447cf8f6af", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "bc593802-c60e-42bf-8591-5bedf2d1fcac", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "efc72ce0-9d83-4035-b0e1-0eaf9ae68fc3", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "7f8ab86e-c4e7-4041-80af-931be766b979", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--689334441"}], "key_name": "tempest-keypair-970496102", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:27:58.654411 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:27:58.819374 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3f84d4bf-fe3a-4e41-844d-2eddca83fed6 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:27:58.838558 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3f84d4bf-fe3a-4e41-844d-2eddca83fed6 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/c1d74af2-1793-4369-8c7e-a9e5047df775" status: 200 len: 1307 microversion: 2.1 time: 0.406311 Oct 30 01:27:58.841729 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1641/3306] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:27:58 2022] GET /compute/v2.1/servers/c1d74af2-1793-4369-8c7e-a9e5047df775 => generated 1307 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:27:58.847139 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-6ba9fdd3-5eee-46af-b426-b06f9035d4b6 req-e3041d31-bd40-4a87-bff7-47480476659f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1d74af2-1793-4369-8c7e-a9e5047df775", "tag": "538e6ae2-9c60-4975-bc4b-9e32ce420d86"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:27:58.857206 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-6ba9fdd3-5eee-46af-b426-b06f9035d4b6 req-e3041d31-bd40-4a87-bff7-47480476659f service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:27:58.857744 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-6ba9fdd3-5eee-46af-b426-b06f9035d4b6 req-e3041d31-bd40-4a87-bff7-47480476659f service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:27:58.858184 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-6ba9fdd3-5eee-46af-b426-b06f9035d4b6 req-e3041d31-bd40-4a87-bff7-47480476659f service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:27:58.869922 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-6ba9fdd3-5eee-46af-b426-b06f9035d4b6 req-e3041d31-bd40-4a87-bff7-47480476659f service nova] Creating event network-changed:538e6ae2-9c60-4975-bc4b-9e32ce420d86 for instance c1d74af2-1793-4369-8c7e-a9e5047df775 on n-h2-master-1 Oct 30 01:27:58.876568 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-6ba9fdd3-5eee-46af-b426-b06f9035d4b6 req-e3041d31-bd40-4a87-bff7-47480476659f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033318 Oct 30 01:27:58.877211 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1642/3307] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:27:58.882492 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-55c00d24-def2-46f5-9b5b-af8248444b37 tempest-SecurityGroupRulesTestJSON-1160426309 tempest-SecurityGroupRulesTestJSON-1160426309-project] Calling method '.version_select at 0x7f44c7c78670>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:27:59.081418 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-0197aa78-aa3a-4ef9-bf03-4d6ea04e8188 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] validate_networks() for [('9950aa06-cffd-4cb9-a959-e64d6a4a55d3', None, None, None, None, None), (None, None, '66e47ab9-7e05-48f9-9e49-e60474216b03', None, None, None), (None, None, '89620a1f-327c-4185-81a0-292dbf3e67b4', None, None, None), ('78e4412f-2c00-4e24-b046-8d55b8c23f94', None, None, None, None, None), ('78e4412f-2c00-4e24-b046-8d55b8c23f94', None, None, None, None, None), ('49238275-20e4-4e7f-9d91-d7447cf8f6af', '10.2.2.100', None, None, None, None), ('49238275-20e4-4e7f-9d91-d7447cf8f6af', '10.2.2.200', None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:27:59.216506 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=16 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:00.498542 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-55c00d24-def2-46f5-9b5b-af8248444b37 tempest-SecurityGroupRulesTestJSON-1160426309 tempest-SecurityGroupRulesTestJSON-1160426309-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/78e3c9b1-553d-46bc-a4bc-294efd4232fe" status: 202 len: 0 microversion: 2.1 time: 1.619907 Oct 30 01:28:00.509750 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1643/3308] 10.222.0.13 () {58 vars in 1272 bytes} [Sun Oct 30 01:27:58 2022] DELETE /compute/v2.1/os-security-groups/78e3c9b1-553d-46bc-a4bc-294efd4232fe => generated 0 bytes in 1632 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:28:00.519904 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a603dd2f-5de3-4bd1-ac4a-f96af9768afe tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:00.521614 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a603dd2f-5de3-4bd1-ac4a-f96af9768afe tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] [instance: 58c01b8d-2408-44eb-98f9-4aa48acc9481] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:00.531651 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a603dd2f-5de3-4bd1-ac4a-f96af9768afe tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:00.532571 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a603dd2f-5de3-4bd1-ac4a-f96af9768afe tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:00.534766 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a603dd2f-5de3-4bd1-ac4a-f96af9768afe tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:00.534766 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a603dd2f-5de3-4bd1-ac4a-f96af9768afe tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:00.535466 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a603dd2f-5de3-4bd1-ac4a-f96af9768afe tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:00.536136 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a603dd2f-5de3-4bd1-ac4a-f96af9768afe tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:00.675773 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=14 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:01.201864 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a603dd2f-5de3-4bd1-ac4a-f96af9768afe tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3478222ab7f24587a53f4deb83753957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c92264dc354f548697879f5db3c70c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:01.216774 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a603dd2f-5de3-4bd1-ac4a-f96af9768afe tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] 10.222.0.13 "GET /compute/v2.1/servers/58c01b8d-2408-44eb-98f9-4aa48acc9481" status: 200 len: 1316 microversion: 2.1 time: 0.705079 Oct 30 01:28:01.237319 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1644/3309] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:00 2022] GET /compute/v2.1/servers/58c01b8d-2408-44eb-98f9-4aa48acc9481 => generated 1316 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:01.248730 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fca34bf9-56fe-4c7e-8655-79a92c686d36 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:01.249682 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-fca34bf9-56fe-4c7e-8655-79a92c686d36 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] [instance: 4428fb95-41d0-4a38-95d6-7b2e798068f0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:01.259779 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fca34bf9-56fe-4c7e-8655-79a92c686d36 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:01.261114 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fca34bf9-56fe-4c7e-8655-79a92c686d36 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:01.261743 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fca34bf9-56fe-4c7e-8655-79a92c686d36 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:01.262679 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fca34bf9-56fe-4c7e-8655-79a92c686d36 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:01.263317 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fca34bf9-56fe-4c7e-8655-79a92c686d36 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:01.263948 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fca34bf9-56fe-4c7e-8655-79a92c686d36 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:01.695933 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-fca34bf9-56fe-4c7e-8655-79a92c686d36 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:01.712711 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-fca34bf9-56fe-4c7e-8655-79a92c686d36 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:01.718941 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-fca34bf9-56fe-4c7e-8655-79a92c686d36 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:01.723270 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fca34bf9-56fe-4c7e-8655-79a92c686d36 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] 10.222.0.13 "GET /compute/v2.1/servers/4428fb95-41d0-4a38-95d6-7b2e798068f0" status: 200 len: 1372 microversion: 2.57 time: 0.482733 Oct 30 01:28:01.730120 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1645/3310] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:28:01 2022] GET /compute/v2.1/servers/4428fb95-41d0-4a38-95d6-7b2e798068f0 => generated 1372 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:28:01.746097 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1112bbab-c2ee-4b94-943e-c6c13938989d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:01.747844 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1112bbab-c2ee-4b94-943e-c6c13938989d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d01c1c62-c352-4a98-b95b-51ff385a415e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:01.756593 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1112bbab-c2ee-4b94-943e-c6c13938989d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:01.758897 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1112bbab-c2ee-4b94-943e-c6c13938989d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:01.759595 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1112bbab-c2ee-4b94-943e-c6c13938989d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:01.761532 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1112bbab-c2ee-4b94-943e-c6c13938989d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:01.765070 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1112bbab-c2ee-4b94-943e-c6c13938989d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:01.765855 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1112bbab-c2ee-4b94-943e-c6c13938989d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:02.345961 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1112bbab-c2ee-4b94-943e-c6c13938989d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:02.354860 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1112bbab-c2ee-4b94-943e-c6c13938989d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e" status: 200 len: 1314 microversion: 2.1 time: 0.629277 Oct 30 01:28:02.355454 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1646/3311] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:01 2022] GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e => generated 1314 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:02.379660 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9d8a01ad-95a9-4915-b53d-91dd9111e196 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:02.380309 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9d8a01ad-95a9-4915-b53d-91dd9111e196 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: c1d74af2-1793-4369-8c7e-a9e5047df775] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:02.392095 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=4 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:02.412987 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9d8a01ad-95a9-4915-b53d-91dd9111e196 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:02.413595 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9d8a01ad-95a9-4915-b53d-91dd9111e196 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:02.414093 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9d8a01ad-95a9-4915-b53d-91dd9111e196 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:02.414814 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9d8a01ad-95a9-4915-b53d-91dd9111e196 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:02.415271 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9d8a01ad-95a9-4915-b53d-91dd9111e196 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:02.415700 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9d8a01ad-95a9-4915-b53d-91dd9111e196 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:02.997864 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9d8a01ad-95a9-4915-b53d-91dd9111e196 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:03.017051 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9d8a01ad-95a9-4915-b53d-91dd9111e196 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/c1d74af2-1793-4369-8c7e-a9e5047df775" status: 200 len: 1307 microversion: 2.1 time: 0.660439 Oct 30 01:28:03.017963 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1647/3312] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:02 2022] GET /compute/v2.1/servers/c1d74af2-1793-4369-8c7e-a9e5047df775 => generated 1307 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:03.023911 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-b8256a7d-13d0-4a23-84eb-fe5546aa44ee req-a1a4dfe0-b76d-498b-9d23-a5aca4376338 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d01c1c62-c352-4a98-b95b-51ff385a415e", "name": "network-vif-plugged", "status": "completed", "tag": "d99123ae-318c-41aa-bb60-152a6d295ad2"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:28:03.046305 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-b8256a7d-13d0-4a23-84eb-fe5546aa44ee req-a1a4dfe0-b76d-498b-9d23-a5aca4376338 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:03.046466 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-b8256a7d-13d0-4a23-84eb-fe5546aa44ee req-a1a4dfe0-b76d-498b-9d23-a5aca4376338 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:03.046790 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-b8256a7d-13d0-4a23-84eb-fe5546aa44ee req-a1a4dfe0-b76d-498b-9d23-a5aca4376338 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:03.108612 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-b8256a7d-13d0-4a23-84eb-fe5546aa44ee req-a1a4dfe0-b76d-498b-9d23-a5aca4376338 service nova] Creating event network-vif-plugged:d99123ae-318c-41aa-bb60-152a6d295ad2 for instance d01c1c62-c352-4a98-b95b-51ff385a415e on n-h1-master-1 Oct 30 01:28:03.114462 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-b8256a7d-13d0-4a23-84eb-fe5546aa44ee req-a1a4dfe0-b76d-498b-9d23-a5aca4376338 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095085 Oct 30 01:28:03.115115 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1648/3313] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:28:03.141562 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-dc4157d4-1a6f-4ddd-8434-a0cb15170fd0 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:03.142286 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-dc4157d4-1a6f-4ddd-8434-a0cb15170fd0 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] [instance: 58c01b8d-2408-44eb-98f9-4aa48acc9481] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:03.155674 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc4157d4-1a6f-4ddd-8434-a0cb15170fd0 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:03.156563 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc4157d4-1a6f-4ddd-8434-a0cb15170fd0 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:03.157242 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc4157d4-1a6f-4ddd-8434-a0cb15170fd0 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:03.159134 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc4157d4-1a6f-4ddd-8434-a0cb15170fd0 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:03.160448 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc4157d4-1a6f-4ddd-8434-a0cb15170fd0 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:03.161157 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc4157d4-1a6f-4ddd-8434-a0cb15170fd0 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:04.984837 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-dc4157d4-1a6f-4ddd-8434-a0cb15170fd0 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3478222ab7f24587a53f4deb83753957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c92264dc354f548697879f5db3c70c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:05.005225 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-dc4157d4-1a6f-4ddd-8434-a0cb15170fd0 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] 10.222.0.13 "GET /compute/v2.1/servers/58c01b8d-2408-44eb-98f9-4aa48acc9481" status: 200 len: 1316 microversion: 2.1 time: 1.888614 Oct 30 01:28:05.006016 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1649/3314] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:03 2022] GET /compute/v2.1/servers/58c01b8d-2408-44eb-98f9-4aa48acc9481 => generated 1316 bytes in 1890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:05.018034 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-12d2e320-460f-462b-ae63-dd225b370d04 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:05.018659 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-12d2e320-460f-462b-ae63-dd225b370d04 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] [instance: 4428fb95-41d0-4a38-95d6-7b2e798068f0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:05.027686 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-12d2e320-460f-462b-ae63-dd225b370d04 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:05.028382 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-12d2e320-460f-462b-ae63-dd225b370d04 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:05.028826 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-12d2e320-460f-462b-ae63-dd225b370d04 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:05.031251 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-12d2e320-460f-462b-ae63-dd225b370d04 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:05.032179 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-12d2e320-460f-462b-ae63-dd225b370d04 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:05.037612 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-12d2e320-460f-462b-ae63-dd225b370d04 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:05.065589 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=100 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:05.191142 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-12d2e320-460f-462b-ae63-dd225b370d04 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:05.209092 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-12d2e320-460f-462b-ae63-dd225b370d04 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:05.210847 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-12d2e320-460f-462b-ae63-dd225b370d04 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:05.212642 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-12d2e320-460f-462b-ae63-dd225b370d04 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] 10.222.0.13 "GET /compute/v2.1/servers/4428fb95-41d0-4a38-95d6-7b2e798068f0" status: 200 len: 1357 microversion: 2.57 time: 0.204542 Oct 30 01:28:05.229424 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1650/3315] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:28:05 2022] GET /compute/v2.1/servers/4428fb95-41d0-4a38-95d6-7b2e798068f0 => generated 1357 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:28:05.229424 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-32d3a755-bd52-437b-a4ee-a73bf08c4d2c tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:05.229424 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-32d3a755-bd52-437b-a4ee-a73bf08c4d2c tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d01c1c62-c352-4a98-b95b-51ff385a415e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:05.241714 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-32d3a755-bd52-437b-a4ee-a73bf08c4d2c tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:05.245010 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-32d3a755-bd52-437b-a4ee-a73bf08c4d2c tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:05.246728 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-32d3a755-bd52-437b-a4ee-a73bf08c4d2c tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:05.263419 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-32d3a755-bd52-437b-a4ee-a73bf08c4d2c tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:05.268728 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-32d3a755-bd52-437b-a4ee-a73bf08c4d2c tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:05.270325 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-32d3a755-bd52-437b-a4ee-a73bf08c4d2c tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:06.225368 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-32d3a755-bd52-437b-a4ee-a73bf08c4d2c tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:06.237072 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-32d3a755-bd52-437b-a4ee-a73bf08c4d2c tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e" status: 200 len: 1314 microversion: 2.1 time: 1.018596 Oct 30 01:28:06.274939 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1651/3316] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:05 2022] GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e => generated 1314 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:06.309732 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3f4c2b80-686e-43df-a15f-bf19d6425a66 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:06.315727 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3f4c2b80-686e-43df-a15f-bf19d6425a66 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: c1d74af2-1793-4369-8c7e-a9e5047df775] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:06.344657 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f4c2b80-686e-43df-a15f-bf19d6425a66 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:06.345164 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f4c2b80-686e-43df-a15f-bf19d6425a66 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:06.345683 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f4c2b80-686e-43df-a15f-bf19d6425a66 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:06.349191 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f4c2b80-686e-43df-a15f-bf19d6425a66 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:06.349690 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f4c2b80-686e-43df-a15f-bf19d6425a66 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:06.350126 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f4c2b80-686e-43df-a15f-bf19d6425a66 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:06.913996 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3f4c2b80-686e-43df-a15f-bf19d6425a66 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:06.924853 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3f4c2b80-686e-43df-a15f-bf19d6425a66 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/c1d74af2-1793-4369-8c7e-a9e5047df775" status: 200 len: 1307 microversion: 2.1 time: 0.644217 Oct 30 01:28:06.941368 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1652/3317] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:06 2022] GET /compute/v2.1/servers/c1d74af2-1793-4369-8c7e-a9e5047df775 => generated 1307 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:06.970647 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-195bcd0a-aac1-4e2a-88d1-e651313bd0cb tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:06.971322 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-195bcd0a-aac1-4e2a-88d1-e651313bd0cb tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] [instance: 4428fb95-41d0-4a38-95d6-7b2e798068f0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:07.027308 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-195bcd0a-aac1-4e2a-88d1-e651313bd0cb tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:07.029528 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-195bcd0a-aac1-4e2a-88d1-e651313bd0cb tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:07.063888 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-195bcd0a-aac1-4e2a-88d1-e651313bd0cb tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:07.066156 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-195bcd0a-aac1-4e2a-88d1-e651313bd0cb tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:07.067366 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-195bcd0a-aac1-4e2a-88d1-e651313bd0cb tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:07.074374 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-195bcd0a-aac1-4e2a-88d1-e651313bd0cb tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:07.187952 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-195bcd0a-aac1-4e2a-88d1-e651313bd0cb tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] [instance: 4428fb95-41d0-4a38-95d6-7b2e798068f0] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:28:07.871635 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-195bcd0a-aac1-4e2a-88d1-e651313bd0cb tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] 10.222.0.13 "DELETE /compute/v2.1/servers/4428fb95-41d0-4a38-95d6-7b2e798068f0" status: 204 len: 0 microversion: 2.57 time: 0.940001 Oct 30 01:28:07.876453 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1653/3318] 10.222.0.13 () {60 vars in 1280 bytes} [Sun Oct 30 01:28:06 2022] DELETE /compute/v2.1/servers/4428fb95-41d0-4a38-95d6-7b2e798068f0 => generated 0 bytes in 946 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 30 01:28:07.884317 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-8a36b8d6-97b1-43e4-9254-2dfbdb89b55c req-bf4ace36-1097-40e7-bfa1-29727e26bef0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58c01b8d-2408-44eb-98f9-4aa48acc9481", "name": "network-vif-plugged", "status": "completed", "tag": "f77283d2-a434-4c14-894d-036be5b7842b"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:28:07.911163 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-8a36b8d6-97b1-43e4-9254-2dfbdb89b55c req-bf4ace36-1097-40e7-bfa1-29727e26bef0 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:07.912021 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-8a36b8d6-97b1-43e4-9254-2dfbdb89b55c req-bf4ace36-1097-40e7-bfa1-29727e26bef0 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:07.912759 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-8a36b8d6-97b1-43e4-9254-2dfbdb89b55c req-bf4ace36-1097-40e7-bfa1-29727e26bef0 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:07.926906 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-8a36b8d6-97b1-43e4-9254-2dfbdb89b55c req-bf4ace36-1097-40e7-bfa1-29727e26bef0 service nova] Creating event network-vif-plugged:f77283d2-a434-4c14-894d-036be5b7842b for instance 58c01b8d-2408-44eb-98f9-4aa48acc9481 on n-h1-master-1 Oct 30 01:28:07.952462 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-8a36b8d6-97b1-43e4-9254-2dfbdb89b55c req-bf4ace36-1097-40e7-bfa1-29727e26bef0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073986 Oct 30 01:28:07.954855 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1654/3319] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:28:07.974587 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-53edb121-c84d-4779-ad7d-e6d86dbd0664 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:07.979300 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-53edb121-c84d-4779-ad7d-e6d86dbd0664 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] [instance: 58c01b8d-2408-44eb-98f9-4aa48acc9481] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:08.002874 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-53edb121-c84d-4779-ad7d-e6d86dbd0664 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:08.004064 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-53edb121-c84d-4779-ad7d-e6d86dbd0664 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:08.005476 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-53edb121-c84d-4779-ad7d-e6d86dbd0664 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:08.006394 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-53edb121-c84d-4779-ad7d-e6d86dbd0664 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:08.007003 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-53edb121-c84d-4779-ad7d-e6d86dbd0664 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:08.007831 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-53edb121-c84d-4779-ad7d-e6d86dbd0664 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:08.323887 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-0197aa78-aa3a-4ef9-bf03-4d6ea04e8188 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:28:08.328305 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-0197aa78-aa3a-4ef9-bf03-4d6ea04e8188 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:28:08.328305 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-0197aa78-aa3a-4ef9-bf03-4d6ea04e8188 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:28:08.328305 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-0197aa78-aa3a-4ef9-bf03-4d6ea04e8188 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:28:08.328305 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-0197aa78-aa3a-4ef9-bf03-4d6ea04e8188 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:28:08.352387 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0197aa78-aa3a-4ef9-bf03-4d6ea04e8188 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:08.357124 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0197aa78-aa3a-4ef9-bf03-4d6ea04e8188 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:08.357124 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0197aa78-aa3a-4ef9-bf03-4d6ea04e8188 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:08.357124 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0197aa78-aa3a-4ef9-bf03-4d6ea04e8188 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:08.357124 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0197aa78-aa3a-4ef9-bf03-4d6ea04e8188 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:08.357124 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0197aa78-aa3a-4ef9-bf03-4d6ea04e8188 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:08.383696 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-0197aa78-aa3a-4ef9-bf03-4d6ea04e8188 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Getting quotas for project 51b75ee1fcc142dd9eb8cb4e3ea631b8. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:28:08.392469 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-0197aa78-aa3a-4ef9-bf03-4d6ea04e8188 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Getting quotas for user 55d02fb5fddb48e49fb66428db0f0424 and project 51b75ee1fcc142dd9eb8cb4e3ea631b8. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:28:08.427661 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-53edb121-c84d-4779-ad7d-e6d86dbd0664 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3478222ab7f24587a53f4deb83753957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c92264dc354f548697879f5db3c70c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:08.441731 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-53edb121-c84d-4779-ad7d-e6d86dbd0664 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] 10.222.0.13 "GET /compute/v2.1/servers/58c01b8d-2408-44eb-98f9-4aa48acc9481" status: 200 len: 1316 microversion: 2.1 time: 0.485519 Oct 30 01:28:08.453444 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1655/3320] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:07 2022] GET /compute/v2.1/servers/58c01b8d-2408-44eb-98f9-4aa48acc9481 => generated 1316 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:08.454217 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cb2221fa-e132-403e-a2bb-9315f90a2efc tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:08.455258 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-cb2221fa-e132-403e-a2bb-9315f90a2efc tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d01c1c62-c352-4a98-b95b-51ff385a415e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:08.470424 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cb2221fa-e132-403e-a2bb-9315f90a2efc tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:08.478005 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cb2221fa-e132-403e-a2bb-9315f90a2efc tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:08.478801 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cb2221fa-e132-403e-a2bb-9315f90a2efc tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:08.480666 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cb2221fa-e132-403e-a2bb-9315f90a2efc tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:08.481722 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cb2221fa-e132-403e-a2bb-9315f90a2efc tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:08.483786 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cb2221fa-e132-403e-a2bb-9315f90a2efc tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:08.687169 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0197aa78-aa3a-4ef9-bf03-4d6ea04e8188 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:28:08.691672 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0197aa78-aa3a-4ef9-bf03-4d6ea04e8188 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='bc593802-c60e-42bf-8591-5bedf2d1fcac',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='efc72ce0-9d83-4035-b0e1-0eaf9ae68fc3',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7f8ab86e-c4e7-4041-80af-931be766b979',volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:28:08.974773 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-cb2221fa-e132-403e-a2bb-9315f90a2efc tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:08.984297 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cb2221fa-e132-403e-a2bb-9315f90a2efc tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e" status: 200 len: 1499 microversion: 2.1 time: 0.536053 Oct 30 01:28:08.984932 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1656/3321] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:08 2022] GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e => generated 1499 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:09.001659 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-30214b78-a6fa-481b-8493-2085e761709d tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:09.002272 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-30214b78-a6fa-481b-8493-2085e761709d tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] [instance: 4428fb95-41d0-4a38-95d6-7b2e798068f0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:09.015231 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-30214b78-a6fa-481b-8493-2085e761709d tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:09.017377 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-30214b78-a6fa-481b-8493-2085e761709d tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:09.018010 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-30214b78-a6fa-481b-8493-2085e761709d tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:09.018749 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-30214b78-a6fa-481b-8493-2085e761709d tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:09.019204 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-30214b78-a6fa-481b-8493-2085e761709d tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:09.019696 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-30214b78-a6fa-481b-8493-2085e761709d tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:09.162133 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-30214b78-a6fa-481b-8493-2085e761709d tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:09.195703 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-30214b78-a6fa-481b-8493-2085e761709d tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:09.198938 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-30214b78-a6fa-481b-8493-2085e761709d tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:09.204324 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-30214b78-a6fa-481b-8493-2085e761709d tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] 10.222.0.13 "GET /compute/v2.1/servers/4428fb95-41d0-4a38-95d6-7b2e798068f0" status: 200 len: 1363 microversion: 2.57 time: 0.213197 Oct 30 01:28:09.219126 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1657/3322] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:28:08 2022] GET /compute/v2.1/servers/4428fb95-41d0-4a38-95d6-7b2e798068f0 => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:28:09.232745 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9ea65272-9534-4065-9778-4f4e195930e4 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:09.233702 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9ea65272-9534-4065-9778-4f4e195930e4 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: c1d74af2-1793-4369-8c7e-a9e5047df775] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:09.240934 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9ea65272-9534-4065-9778-4f4e195930e4 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:09.241749 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9ea65272-9534-4065-9778-4f4e195930e4 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:09.242367 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9ea65272-9534-4065-9778-4f4e195930e4 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:09.243257 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9ea65272-9534-4065-9778-4f4e195930e4 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:09.243895 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9ea65272-9534-4065-9778-4f4e195930e4 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:09.244490 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9ea65272-9534-4065-9778-4f4e195930e4 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:09.465308 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9ea65272-9534-4065-9778-4f4e195930e4 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:09.502875 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9ea65272-9534-4065-9778-4f4e195930e4 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/c1d74af2-1793-4369-8c7e-a9e5047df775" status: 200 len: 1307 microversion: 2.1 time: 0.278384 Oct 30 01:28:09.507480 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1658/3323] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:09 2022] GET /compute/v2.1/servers/c1d74af2-1793-4369-8c7e-a9e5047df775 => generated 1307 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:09.765999 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e82a134c-375d-41d2-b167-2d1883708b6e tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Action: 'create', calling method: .version_select at 0x7f44c7c00280>, body: {"keypair": {"name": "tempest-keypair-382050845", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfGmquCu8CFR2sUDZudzP86ReLtfPfXd787BQg1/dnskPtbgpuiqN8uc297sE3r9ZlJ+txVL0Gwx9ixtUx1gM6m6a1Bk1Ey9NNtfOmUJeq2XBdAoXRoh0RNGW4sMr16LA=="}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:28:09.801562 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-e82a134c-375d-41d2-b167-2d1883708b6e tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Getting quotas for project 0eba4d14f2004498850092bff100b757. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:28:09.812111 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-e82a134c-375d-41d2-b167-2d1883708b6e tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Getting quotas for user 2fd2e319840c4a8aab90b495374aa1d2 and project 0eba4d14f2004498850092bff100b757. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:28:09.981533 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e82a134c-375d-41d2-b167-2d1883708b6e tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.471933 Oct 30 01:28:09.983579 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1659/3324] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 30 01:28:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:28:09.992385 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e65a4418-6516-4ce4-8460-2fe67f5e124f tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:28:09.995984 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e65a4418-6516-4ce4-8460-2fe67f5e124f tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d01c1c62-c352-4a98-b95b-51ff385a415e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:10.002319 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0197aa78-aa3a-4ef9-bf03-4d6ea04e8188 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 11.394375 Oct 30 01:28:10.004823 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1666/3325] 10.222.0.13 () {62 vars in 1189 bytes} [Sun Oct 30 01:27:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 11397 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 30 01:28:10.011541 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4273f284-8591-41bc-9407-55b37f41328e tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:10.012688 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4273f284-8591-41bc-9407-55b37f41328e tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] [instance: 58c01b8d-2408-44eb-98f9-4aa48acc9481] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:10.022005 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4273f284-8591-41bc-9407-55b37f41328e tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:10.023121 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e65a4418-6516-4ce4-8460-2fe67f5e124f tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:10.023431 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4273f284-8591-41bc-9407-55b37f41328e tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:10.023826 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e65a4418-6516-4ce4-8460-2fe67f5e124f tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:10.024252 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4273f284-8591-41bc-9407-55b37f41328e tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:10.024547 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e65a4418-6516-4ce4-8460-2fe67f5e124f tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:10.025759 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4273f284-8591-41bc-9407-55b37f41328e tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:10.026418 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4273f284-8591-41bc-9407-55b37f41328e tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:10.026817 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e65a4418-6516-4ce4-8460-2fe67f5e124f tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:10.027544 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e65a4418-6516-4ce4-8460-2fe67f5e124f tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:10.027666 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4273f284-8591-41bc-9407-55b37f41328e tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:10.029910 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e65a4418-6516-4ce4-8460-2fe67f5e124f tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:10.063997 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-e65a4418-6516-4ce4-8460-2fe67f5e124f tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lazy-loading 'flavor' on Instance uuid d01c1c62-c352-4a98-b95b-51ff385a415e {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:28:10.337095 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4273f284-8591-41bc-9407-55b37f41328e tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3478222ab7f24587a53f4deb83753957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c92264dc354f548697879f5db3c70c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:10.345635 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4273f284-8591-41bc-9407-55b37f41328e tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] 10.222.0.13 "GET /compute/v2.1/servers/58c01b8d-2408-44eb-98f9-4aa48acc9481" status: 200 len: 1505 microversion: 2.1 time: 0.339347 Oct 30 01:28:10.346236 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1667/3326] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:10 2022] GET /compute/v2.1/servers/58c01b8d-2408-44eb-98f9-4aa48acc9481 => generated 1505 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:10.366934 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e65a4418-6516-4ce4-8460-2fe67f5e124f tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "POST /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e/action" status: 200 len: 32 microversion: 2.1 time: 0.380051 Oct 30 01:28:10.369514 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1660/3327] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:28:09 2022] POST /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e/action => generated 32 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:28:10.379602 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-997b008e-d061-4e1c-8fc5-7aa60d2c78b5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:10.381762 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-997b008e-d061-4e1c-8fc5-7aa60d2c78b5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:10.540980 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d026edc4-e9af-4ba4-98d1-a74f68a22bfb tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1281179265", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:28:10.571006 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-997b008e-d061-4e1c-8fc5-7aa60d2c78b5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:10.583308 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-997b008e-d061-4e1c-8fc5-7aa60d2c78b5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:10.584804 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-997b008e-d061-4e1c-8fc5-7aa60d2c78b5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:10.586624 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-997b008e-d061-4e1c-8fc5-7aa60d2c78b5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1284 microversion: 2.32 time: 0.213627 Oct 30 01:28:10.600584 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1661/3328] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:28:10 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1284 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:28:10.612988 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8e0e492a-8679-4f0c-af9c-a7259fdfacdd tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:10.616490 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8e0e492a-8679-4f0c-af9c-a7259fdfacdd tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] [instance: 4428fb95-41d0-4a38-95d6-7b2e798068f0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:10.661087 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-d026edc4-e9af-4ba4-98d1-a74f68a22bfb tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] validate_networks() for [('2f1dbd29-9e2f-4ba6-b3e0-2e3fe317445a', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:28:10.671990 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8e0e492a-8679-4f0c-af9c-a7259fdfacdd tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:10.679163 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8e0e492a-8679-4f0c-af9c-a7259fdfacdd tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:10.680353 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8e0e492a-8679-4f0c-af9c-a7259fdfacdd tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:10.681486 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8e0e492a-8679-4f0c-af9c-a7259fdfacdd tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:10.701948 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8e0e492a-8679-4f0c-af9c-a7259fdfacdd tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:10.704729 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8e0e492a-8679-4f0c-af9c-a7259fdfacdd tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:10.854977 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8e0e492a-8679-4f0c-af9c-a7259fdfacdd tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:10.867019 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8e0e492a-8679-4f0c-af9c-a7259fdfacdd tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:10.868968 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8e0e492a-8679-4f0c-af9c-a7259fdfacdd tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abb5b433d3f9405d84e9df692a310b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34952fd2cb6b407f9ccf8dded67139dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:10.871451 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8e0e492a-8679-4f0c-af9c-a7259fdfacdd tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] 10.222.0.13 "GET /compute/v2.1/servers/4428fb95-41d0-4a38-95d6-7b2e798068f0" status: 200 len: 1363 microversion: 2.57 time: 0.277495 Oct 30 01:28:10.895911 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1662/3329] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:28:10 2022] GET /compute/v2.1/servers/4428fb95-41d0-4a38-95d6-7b2e798068f0 => generated 1363 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:28:10.942071 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5d63bdd2-d42d-443a-b90e-62c2b9b3611c tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:10.942606 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5d63bdd2-d42d-443a-b90e-62c2b9b3611c tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] [instance: 58c01b8d-2408-44eb-98f9-4aa48acc9481] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:10.974102 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5d63bdd2-d42d-443a-b90e-62c2b9b3611c tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:10.978359 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5d63bdd2-d42d-443a-b90e-62c2b9b3611c tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:10.982041 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5d63bdd2-d42d-443a-b90e-62c2b9b3611c tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:10.983586 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5d63bdd2-d42d-443a-b90e-62c2b9b3611c tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:10.984069 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5d63bdd2-d42d-443a-b90e-62c2b9b3611c tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:10.984503 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5d63bdd2-d42d-443a-b90e-62c2b9b3611c tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:11.204648 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5d63bdd2-d42d-443a-b90e-62c2b9b3611c tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] 10.222.0.13 "DELETE /compute/v2.1/servers/58c01b8d-2408-44eb-98f9-4aa48acc9481/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.305603 Oct 30 01:28:11.205289 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1663/3330] 10.222.0.13 () {58 vars in 1296 bytes} [Sun Oct 30 01:28:10 2022] DELETE /compute/v2.1/servers/58c01b8d-2408-44eb-98f9-4aa48acc9481/os-server-password => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:28:11.212614 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6ac43785-e16c-401a-bac6-9acbc5856947 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:11.213555 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6ac43785-e16c-401a-bac6-9acbc5856947 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d01c1c62-c352-4a98-b95b-51ff385a415e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:11.228599 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ac43785-e16c-401a-bac6-9acbc5856947 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:11.229113 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ac43785-e16c-401a-bac6-9acbc5856947 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:11.229604 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ac43785-e16c-401a-bac6-9acbc5856947 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:11.230339 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ac43785-e16c-401a-bac6-9acbc5856947 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:11.230830 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ac43785-e16c-401a-bac6-9acbc5856947 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:11.233970 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ac43785-e16c-401a-bac6-9acbc5856947 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:11.800581 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6ac43785-e16c-401a-bac6-9acbc5856947 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:11.804868 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=4,nova_cell1:INSERT=6 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:11.816022 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6ac43785-e16c-401a-bac6-9acbc5856947 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e" status: 200 len: 1505 microversion: 2.1 time: 0.609101 Oct 30 01:28:11.817422 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1664/3331] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:11 2022] GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e => generated 1505 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:11.822541 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-35195a3a-c71d-4635-bc58-d68640702fba tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:11.829760 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-35195a3a-c71d-4635-bc58-d68640702fba tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: c1d74af2-1793-4369-8c7e-a9e5047df775] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:11.856527 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-35195a3a-c71d-4635-bc58-d68640702fba tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:11.863885 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-35195a3a-c71d-4635-bc58-d68640702fba tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:11.864549 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-35195a3a-c71d-4635-bc58-d68640702fba tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:11.866236 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-35195a3a-c71d-4635-bc58-d68640702fba tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:11.866868 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-35195a3a-c71d-4635-bc58-d68640702fba tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:11.867551 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-35195a3a-c71d-4635-bc58-d68640702fba tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:11.975960 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-d026edc4-e9af-4ba4-98d1-a74f68a22bfb tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:28:11.976889 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-d026edc4-e9af-4ba4-98d1-a74f68a22bfb tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:28:11.977652 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-d026edc4-e9af-4ba4-98d1-a74f68a22bfb tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:28:11.978081 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-d026edc4-e9af-4ba4-98d1-a74f68a22bfb tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:28:11.978878 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-d026edc4-e9af-4ba4-98d1-a74f68a22bfb tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:28:12.022378 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d026edc4-e9af-4ba4-98d1-a74f68a22bfb tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:12.024302 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d026edc4-e9af-4ba4-98d1-a74f68a22bfb tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:12.025877 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d026edc4-e9af-4ba4-98d1-a74f68a22bfb tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:12.030975 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d026edc4-e9af-4ba4-98d1-a74f68a22bfb tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:12.033426 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d026edc4-e9af-4ba4-98d1-a74f68a22bfb tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:12.035071 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d026edc4-e9af-4ba4-98d1-a74f68a22bfb tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:12.108837 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-d026edc4-e9af-4ba4-98d1-a74f68a22bfb tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Getting quotas for project 470e235fb35840828d9a86028b72f5de. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:28:12.126957 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-d026edc4-e9af-4ba4-98d1-a74f68a22bfb tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Getting quotas for user 6134c05549f14bc19962acea9c913f53 and project 470e235fb35840828d9a86028b72f5de. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:28:12.144165 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d026edc4-e9af-4ba4-98d1-a74f68a22bfb tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:28:12.172835 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d026edc4-e9af-4ba4-98d1-a74f68a22bfb tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 28af596f-f044-4281-8106-4585fbde9a4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:28:12.234700 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-35195a3a-c71d-4635-bc58-d68640702fba tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:12.245722 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-35195a3a-c71d-4635-bc58-d68640702fba tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/c1d74af2-1793-4369-8c7e-a9e5047df775" status: 200 len: 1307 microversion: 2.1 time: 0.426825 Oct 30 01:28:12.246917 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1665/3332] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:11 2022] GET /compute/v2.1/servers/c1d74af2-1793-4369-8c7e-a9e5047df775 => generated 1307 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:12.253779 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0d03105a-7dcc-4ce1-9046-acd812bb2641 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:12.253779 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0d03105a-7dcc-4ce1-9046-acd812bb2641 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] [instance: 58c01b8d-2408-44eb-98f9-4aa48acc9481] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:12.267299 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d03105a-7dcc-4ce1-9046-acd812bb2641 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:12.267923 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d03105a-7dcc-4ce1-9046-acd812bb2641 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:12.268495 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d03105a-7dcc-4ce1-9046-acd812bb2641 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:12.269324 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d03105a-7dcc-4ce1-9046-acd812bb2641 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:12.269914 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d03105a-7dcc-4ce1-9046-acd812bb2641 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:12.270800 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d03105a-7dcc-4ce1-9046-acd812bb2641 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:12.299791 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0d03105a-7dcc-4ce1-9046-acd812bb2641 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] 10.222.0.13 "GET /compute/v2.1/servers/58c01b8d-2408-44eb-98f9-4aa48acc9481/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.051673 Oct 30 01:28:12.300879 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1666/3333] 10.222.0.13 () {58 vars in 1293 bytes} [Sun Oct 30 01:28:12 2022] GET /compute/v2.1/servers/58c01b8d-2408-44eb-98f9-4aa48acc9481/os-server-password => generated 16 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:28:12.307218 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-794332a6-f535-4102-b892-44090679634f tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:12.308067 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-794332a6-f535-4102-b892-44090679634f tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:12.399433 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d026edc4-e9af-4ba4-98d1-a74f68a22bfb tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.044476 Oct 30 01:28:12.400533 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1668/3334] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:28:10 2022] POST /compute/v2.1/servers => generated 383 bytes in 2054 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:28:12.404670 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-794332a6-f535-4102-b892-44090679634f tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:12.406099 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5949b700-d0fc-4079-b8b7-e3b99c6a2238 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:12.406886 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5949b700-d0fc-4079-b8b7-e3b99c6a2238 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] [instance: 4428fb95-41d0-4a38-95d6-7b2e798068f0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:12.414215 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5949b700-d0fc-4079-b8b7-e3b99c6a2238 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:12.415004 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5949b700-d0fc-4079-b8b7-e3b99c6a2238 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:12.415614 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5949b700-d0fc-4079-b8b7-e3b99c6a2238 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:12.416509 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5949b700-d0fc-4079-b8b7-e3b99c6a2238 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:12.417131 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5949b700-d0fc-4079-b8b7-e3b99c6a2238 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:12.417258 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-794332a6-f535-4102-b892-44090679634f tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:12.417897 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5949b700-d0fc-4079-b8b7-e3b99c6a2238 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:12.419055 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-794332a6-f535-4102-b892-44090679634f tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:12.420350 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-794332a6-f535-4102-b892-44090679634f tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1284 microversion: 2.32 time: 0.118131 Oct 30 01:28:12.421043 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1667/3335] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:28:12 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1284 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:28:12.434619 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-5949b700-d0fc-4079-b8b7-e3b99c6a2238 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] HTTP exception thrown: Instance 4428fb95-41d0-4a38-95d6-7b2e798068f0 could not be found. Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5949b700-d0fc-4079-b8b7-e3b99c6a2238 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Request method failure captured: Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/4428fb95-41d0-4a38-95d6-7b2e798068f0 HTTP/1.1 Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdL68alLR9HoMEJ5BpLqX0PjhGvectw8OUxNAwjyPpLNXUTL3EjYwJucTRNPNU9-EmLFNRbeLikImwWZ5dfyAYXqq6iws8gWkYrRs0p6ly7zb9-l708kFM5z19nAJUvLLt-MjBgyK4mg9CjfzKNI0Ehoj26oXHBjNbD3tdnyMyQhVMk Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: X-Openstack-Nova-Api-Version: 2.57 Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 34952fd2cb6b407f9ccf8dded67139dd Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServerShowV257Test-1040724197 Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/34952fd2cb6b407f9ccf8dded67139dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_34952fd2cb6b407f9ccf8dded67139dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/34952fd2cb6b407f9ccf8dded67139dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/34952fd2cb6b407f9ccf8dded67139dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServerShowV257Test-1040724197 Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 34952fd2cb6b407f9ccf8dded67139dd Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServerShowV257Test-1040724197 Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServerShowV257Test-1040724197-project Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: abb5b433d3f9405d84e9df692a310b1c Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServerShowV257Test-1040724197-project Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 4428fb95-41d0-4a38-95d6-7b2e798068f0 could not be found. Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '4428fb95-41d0-4a38-95d6-7b2e798068f0'} Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4428fb95-41d0-4a38-95d6-7b2e798068f0 could not be found. Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4428fb95-41d0-4a38-95d6-7b2e798068f0 could not be found. Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:28:12.437224 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:28:12.441935 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:28:12.441935 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:28:12.441935 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:28:12.441935 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:28:12.441935 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:28:12.441935 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4428fb95-41d0-4a38-95d6-7b2e798068f0 could not be found. Oct 30 01:28:12.441935 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:28:12.443518 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5949b700-d0fc-4079-b8b7-e3b99c6a2238 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] Returning 404 to user: Instance 4428fb95-41d0-4a38-95d6-7b2e798068f0 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:28:12.444559 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5949b700-d0fc-4079-b8b7-e3b99c6a2238 tempest-ServerShowV257Test-1040724197 tempest-ServerShowV257Test-1040724197-project] 10.222.0.13 "GET /compute/v2.1/servers/4428fb95-41d0-4a38-95d6-7b2e798068f0" status: 404 len: 111 microversion: 2.57 time: 0.042776 Oct 30 01:28:12.446230 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1669/3336] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:28:12 2022] GET /compute/v2.1/servers/4428fb95-41d0-4a38-95d6-7b2e798068f0 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:28:12.448105 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-88dd54b0-4d77-4807-bdfe-595dc2aabe4d tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:12.449084 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-88dd54b0-4d77-4807-bdfe-595dc2aabe4d tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] [instance: 58c01b8d-2408-44eb-98f9-4aa48acc9481] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:12.462276 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-88dd54b0-4d77-4807-bdfe-595dc2aabe4d tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:12.462982 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-88dd54b0-4d77-4807-bdfe-595dc2aabe4d tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:12.463659 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-88dd54b0-4d77-4807-bdfe-595dc2aabe4d tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:12.464410 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-88dd54b0-4d77-4807-bdfe-595dc2aabe4d tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:12.464879 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-88dd54b0-4d77-4807-bdfe-595dc2aabe4d tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:12.467727 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-88dd54b0-4d77-4807-bdfe-595dc2aabe4d tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:12.488475 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-545f0b1d-6686-459d-87b1-d744b366454c tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:12.488475 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-545f0b1d-6686-459d-87b1-d744b366454c tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 28af596f-f044-4281-8106-4585fbde9a4a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:12.512944 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-88dd54b0-4d77-4807-bdfe-595dc2aabe4d tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] [instance: 58c01b8d-2408-44eb-98f9-4aa48acc9481] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:28:12.607166 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-545f0b1d-6686-459d-87b1-d744b366454c tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:12.625838 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-545f0b1d-6686-459d-87b1-d744b366454c tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a" status: 200 len: 1222 microversion: 2.1 time: 0.173601 Oct 30 01:28:12.639661 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1670/3337] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:12 2022] GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a => generated 1222 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:12.843965 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9b8a6f87-c1cd-46fa-9f23-60f0b84c3a3c tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:12.844580 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9b8a6f87-c1cd-46fa-9f23-60f0b84c3a3c tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d01c1c62-c352-4a98-b95b-51ff385a415e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:12.852068 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b8a6f87-c1cd-46fa-9f23-60f0b84c3a3c tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:12.852596 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b8a6f87-c1cd-46fa-9f23-60f0b84c3a3c tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:12.853030 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b8a6f87-c1cd-46fa-9f23-60f0b84c3a3c tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:12.854040 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b8a6f87-c1cd-46fa-9f23-60f0b84c3a3c tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:12.854486 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b8a6f87-c1cd-46fa-9f23-60f0b84c3a3c tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:12.854907 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b8a6f87-c1cd-46fa-9f23-60f0b84c3a3c tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:13.046840 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9b8a6f87-c1cd-46fa-9f23-60f0b84c3a3c tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:13.056869 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9b8a6f87-c1cd-46fa-9f23-60f0b84c3a3c tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e" status: 200 len: 1505 microversion: 2.1 time: 0.216742 Oct 30 01:28:13.057723 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1671/3338] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:12 2022] GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e => generated 1505 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:28:13.268268 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6679c001-83b3-4d67-9458-6b815325e9bc tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:13.268806 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6679c001-83b3-4d67-9458-6b815325e9bc tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: c1d74af2-1793-4369-8c7e-a9e5047df775] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:13.276455 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6679c001-83b3-4d67-9458-6b815325e9bc tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:13.277167 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6679c001-83b3-4d67-9458-6b815325e9bc tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:13.278172 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6679c001-83b3-4d67-9458-6b815325e9bc tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:13.280561 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6679c001-83b3-4d67-9458-6b815325e9bc tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:13.280561 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6679c001-83b3-4d67-9458-6b815325e9bc tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:13.280561 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6679c001-83b3-4d67-9458-6b815325e9bc tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:13.510733 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6679c001-83b3-4d67-9458-6b815325e9bc tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:13.519690 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6679c001-83b3-4d67-9458-6b815325e9bc tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/c1d74af2-1793-4369-8c7e-a9e5047df775" status: 200 len: 1307 microversion: 2.1 time: 0.255389 Oct 30 01:28:13.521117 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1672/3339] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:13 2022] GET /compute/v2.1/servers/c1d74af2-1793-4369-8c7e-a9e5047df775 => generated 1307 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:28:13.527191 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b74b145a-1697-49a8-8528-ee1b4dd75475 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1851612145", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:28:13.584832 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-88dd54b0-4d77-4807-bdfe-595dc2aabe4d tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] 10.222.0.13 "DELETE /compute/v2.1/servers/58c01b8d-2408-44eb-98f9-4aa48acc9481" status: 204 len: 0 microversion: 2.1 time: 1.159159 Oct 30 01:28:13.587731 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1668/3340] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:28:12 2022] DELETE /compute/v2.1/servers/58c01b8d-2408-44eb-98f9-4aa48acc9481 => generated 0 bytes in 1166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:28:13.591997 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-b74b145a-1697-49a8-8528-ee1b4dd75475 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] validate_networks() for [('2f1dbd29-9e2f-4ba6-b3e0-2e3fe317445a', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:28:13.594815 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-467f120a-8aec-4cd7-8652-92fdf3eb6678 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:13.595782 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-467f120a-8aec-4cd7-8652-92fdf3eb6678 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:13.607844 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-467f120a-8aec-4cd7-8652-92fdf3eb6678 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:13.607844 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-467f120a-8aec-4cd7-8652-92fdf3eb6678 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:13.607844 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-467f120a-8aec-4cd7-8652-92fdf3eb6678 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:13.607844 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-467f120a-8aec-4cd7-8652-92fdf3eb6678 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:13.607844 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-467f120a-8aec-4cd7-8652-92fdf3eb6678 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:13.609206 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-467f120a-8aec-4cd7-8652-92fdf3eb6678 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:13.980602 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-467f120a-8aec-4cd7-8652-92fdf3eb6678 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:13.998525 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-467f120a-8aec-4cd7-8652-92fdf3eb6678 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:14.001048 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-467f120a-8aec-4cd7-8652-92fdf3eb6678 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:14.007180 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-467f120a-8aec-4cd7-8652-92fdf3eb6678 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1526 microversion: 2.32 time: 0.415931 Oct 30 01:28:14.009768 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1669/3341] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:28:13 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1526 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:28:14.068566 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b1639964-f01a-4249-8e1f-522f4473ad81 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:14.069536 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b1639964-f01a-4249-8e1f-522f4473ad81 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] [instance: 58c01b8d-2408-44eb-98f9-4aa48acc9481] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:14.099299 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1639964-f01a-4249-8e1f-522f4473ad81 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:14.099893 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1639964-f01a-4249-8e1f-522f4473ad81 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:14.100440 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1639964-f01a-4249-8e1f-522f4473ad81 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:14.103463 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1639964-f01a-4249-8e1f-522f4473ad81 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:14.104054 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1639964-f01a-4249-8e1f-522f4473ad81 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:14.104555 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1639964-f01a-4249-8e1f-522f4473ad81 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:14.734002 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b1639964-f01a-4249-8e1f-522f4473ad81 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3478222ab7f24587a53f4deb83753957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c92264dc354f548697879f5db3c70c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:14.765157 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b1639964-f01a-4249-8e1f-522f4473ad81 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] 10.222.0.13 "GET /compute/v2.1/servers/58c01b8d-2408-44eb-98f9-4aa48acc9481" status: 200 len: 1511 microversion: 2.1 time: 0.729416 Oct 30 01:28:14.777473 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1670/3342] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:14 2022] GET /compute/v2.1/servers/58c01b8d-2408-44eb-98f9-4aa48acc9481 => generated 1511 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:14.788839 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b7b23e1b-5318-43cd-a9dc-4c8f0afea8bf tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:14.789711 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b7b23e1b-5318-43cd-a9dc-4c8f0afea8bf tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d01c1c62-c352-4a98-b95b-51ff385a415e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:14.796877 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b7b23e1b-5318-43cd-a9dc-4c8f0afea8bf tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:14.800104 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b7b23e1b-5318-43cd-a9dc-4c8f0afea8bf tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:14.800104 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b7b23e1b-5318-43cd-a9dc-4c8f0afea8bf tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:14.800104 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b7b23e1b-5318-43cd-a9dc-4c8f0afea8bf tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:14.800104 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b7b23e1b-5318-43cd-a9dc-4c8f0afea8bf tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:14.801018 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b7b23e1b-5318-43cd-a9dc-4c8f0afea8bf tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:15.161253 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-b74b145a-1697-49a8-8528-ee1b4dd75475 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:28:15.162596 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-b74b145a-1697-49a8-8528-ee1b4dd75475 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:28:15.163518 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-b74b145a-1697-49a8-8528-ee1b4dd75475 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:28:15.164459 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-b74b145a-1697-49a8-8528-ee1b4dd75475 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:28:15.165175 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-b74b145a-1697-49a8-8528-ee1b4dd75475 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:28:15.181883 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b74b145a-1697-49a8-8528-ee1b4dd75475 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:15.183186 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b74b145a-1697-49a8-8528-ee1b4dd75475 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:15.183825 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b74b145a-1697-49a8-8528-ee1b4dd75475 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:15.185076 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b74b145a-1697-49a8-8528-ee1b4dd75475 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:15.187655 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b74b145a-1697-49a8-8528-ee1b4dd75475 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:15.189073 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b74b145a-1697-49a8-8528-ee1b4dd75475 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:15.230939 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-b74b145a-1697-49a8-8528-ee1b4dd75475 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Getting quotas for project 470e235fb35840828d9a86028b72f5de. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:28:15.237640 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-b74b145a-1697-49a8-8528-ee1b4dd75475 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Getting quotas for user 6134c05549f14bc19962acea9c913f53 and project 470e235fb35840828d9a86028b72f5de. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:28:15.258170 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b7b23e1b-5318-43cd-a9dc-4c8f0afea8bf tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:15.258502 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b74b145a-1697-49a8-8528-ee1b4dd75475 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:28:15.261150 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b74b145a-1697-49a8-8528-ee1b4dd75475 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 2873be88-5d85-49c6-833f-19b7df1fcf5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:28:15.268695 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b7b23e1b-5318-43cd-a9dc-4c8f0afea8bf tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e" status: 200 len: 1505 microversion: 2.1 time: 0.488744 Oct 30 01:28:15.287802 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1671/3343] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:14 2022] GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e => generated 1505 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:15.293811 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-32eb96da-5da8-4f20-bc89-05150cb6e86a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:15.294663 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-32eb96da-5da8-4f20-bc89-05150cb6e86a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: c1d74af2-1793-4369-8c7e-a9e5047df775] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:15.301015 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-32eb96da-5da8-4f20-bc89-05150cb6e86a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:15.304448 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-32eb96da-5da8-4f20-bc89-05150cb6e86a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:15.304448 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-32eb96da-5da8-4f20-bc89-05150cb6e86a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:15.304448 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-32eb96da-5da8-4f20-bc89-05150cb6e86a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:15.304448 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-32eb96da-5da8-4f20-bc89-05150cb6e86a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:15.305380 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-32eb96da-5da8-4f20-bc89-05150cb6e86a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:15.471641 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b74b145a-1697-49a8-8528-ee1b4dd75475 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.948894 Oct 30 01:28:15.472808 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1673/3344] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:28:13 2022] POST /compute/v2.1/servers => generated 383 bytes in 1951 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:28:15.498351 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-68c4b760-7137-42f2-b472-1b3b3bf2befb tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:15.499268 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-68c4b760-7137-42f2-b472-1b3b3bf2befb tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:15.510675 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-68c4b760-7137-42f2-b472-1b3b3bf2befb tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:15.511432 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-68c4b760-7137-42f2-b472-1b3b3bf2befb tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:15.512061 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-68c4b760-7137-42f2-b472-1b3b3bf2befb tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:15.514820 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-68c4b760-7137-42f2-b472-1b3b3bf2befb tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:15.515483 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-68c4b760-7137-42f2-b472-1b3b3bf2befb tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:15.516210 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-68c4b760-7137-42f2-b472-1b3b3bf2befb tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:15.826562 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-68c4b760-7137-42f2-b472-1b3b3bf2befb tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:15.870673 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-68c4b760-7137-42f2-b472-1b3b3bf2befb tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:15.881627 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-68c4b760-7137-42f2-b472-1b3b3bf2befb tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:15.885708 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-68c4b760-7137-42f2-b472-1b3b3bf2befb tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1592 microversion: 2.32 time: 0.410998 Oct 30 01:28:15.909227 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1674/3345] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:28:15 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1592 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:28:15.918584 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e03af722-4723-4dab-81e4-00070ff9a2af tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:15.919218 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e03af722-4723-4dab-81e4-00070ff9a2af tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 2873be88-5d85-49c6-833f-19b7df1fcf5f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:16.049974 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-32eb96da-5da8-4f20-bc89-05150cb6e86a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:16.063391 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-32eb96da-5da8-4f20-bc89-05150cb6e86a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/c1d74af2-1793-4369-8c7e-a9e5047df775" status: 200 len: 1307 microversion: 2.1 time: 0.773450 Oct 30 01:28:16.064301 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1672/3346] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:15 2022] GET /compute/v2.1/servers/c1d74af2-1793-4369-8c7e-a9e5047df775 => generated 1307 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:16.092060 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-db39d850-3e78-486d-97e0-e169758dff0e tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:16.094595 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-db39d850-3e78-486d-97e0-e169758dff0e tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] [instance: 58c01b8d-2408-44eb-98f9-4aa48acc9481] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:16.105896 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-db39d850-3e78-486d-97e0-e169758dff0e tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:16.109597 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-db39d850-3e78-486d-97e0-e169758dff0e tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:16.110524 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-db39d850-3e78-486d-97e0-e169758dff0e tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:16.114396 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-db39d850-3e78-486d-97e0-e169758dff0e tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:16.115073 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-db39d850-3e78-486d-97e0-e169758dff0e tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:16.116678 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-db39d850-3e78-486d-97e0-e169758dff0e tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:16.152722 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e03af722-4723-4dab-81e4-00070ff9a2af tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:16.161297 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e03af722-4723-4dab-81e4-00070ff9a2af tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f" status: 200 len: 1222 microversion: 2.1 time: 0.250829 Oct 30 01:28:16.164666 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1675/3347] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:15 2022] GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f => generated 1222 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:16.294174 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e04768e0-33c5-4a1c-97d1-3eeae2bd2d33 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:16.295948 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e04768e0-33c5-4a1c-97d1-3eeae2bd2d33 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d01c1c62-c352-4a98-b95b-51ff385a415e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:16.307698 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e04768e0-33c5-4a1c-97d1-3eeae2bd2d33 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:16.308132 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e04768e0-33c5-4a1c-97d1-3eeae2bd2d33 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:16.311390 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e04768e0-33c5-4a1c-97d1-3eeae2bd2d33 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:16.314533 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e04768e0-33c5-4a1c-97d1-3eeae2bd2d33 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:16.315259 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e04768e0-33c5-4a1c-97d1-3eeae2bd2d33 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:16.316609 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e04768e0-33c5-4a1c-97d1-3eeae2bd2d33 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:16.862427 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-db39d850-3e78-486d-97e0-e169758dff0e tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3478222ab7f24587a53f4deb83753957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c92264dc354f548697879f5db3c70c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:16.875050 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-db39d850-3e78-486d-97e0-e169758dff0e tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] 10.222.0.13 "GET /compute/v2.1/servers/58c01b8d-2408-44eb-98f9-4aa48acc9481" status: 200 len: 1511 microversion: 2.1 time: 0.795635 Oct 30 01:28:16.878503 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1673/3348] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:16 2022] GET /compute/v2.1/servers/58c01b8d-2408-44eb-98f9-4aa48acc9481 => generated 1511 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:16.893723 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-416dc01e-d807-4532-882d-072e101f129e req-97f87c3b-f7e8-4150-80ce-3c3ad7ad76a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1d74af2-1793-4369-8c7e-a9e5047df775", "name": "network-vif-plugged", "status": "completed", "tag": "538e6ae2-9c60-4975-bc4b-9e32ce420d86"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:28:16.922440 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-416dc01e-d807-4532-882d-072e101f129e req-97f87c3b-f7e8-4150-80ce-3c3ad7ad76a3 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:16.927176 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-416dc01e-d807-4532-882d-072e101f129e req-97f87c3b-f7e8-4150-80ce-3c3ad7ad76a3 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:16.927893 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-416dc01e-d807-4532-882d-072e101f129e req-97f87c3b-f7e8-4150-80ce-3c3ad7ad76a3 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:16.954201 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-416dc01e-d807-4532-882d-072e101f129e req-97f87c3b-f7e8-4150-80ce-3c3ad7ad76a3 service nova] Creating event network-vif-plugged:538e6ae2-9c60-4975-bc4b-9e32ce420d86 for instance c1d74af2-1793-4369-8c7e-a9e5047df775 on n-h2-master-1 Oct 30 01:28:16.963011 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-416dc01e-d807-4532-882d-072e101f129e req-97f87c3b-f7e8-4150-80ce-3c3ad7ad76a3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082897 Oct 30 01:28:16.963924 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1674/3349] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:28:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:28:16.969606 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f6241cdc-4323-4868-9d00-0b66166debb5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:16.970607 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f6241cdc-4323-4868-9d00-0b66166debb5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:16.978480 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f6241cdc-4323-4868-9d00-0b66166debb5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:16.979902 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f6241cdc-4323-4868-9d00-0b66166debb5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:16.984382 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e04768e0-33c5-4a1c-97d1-3eeae2bd2d33 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:16.989231 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f6241cdc-4323-4868-9d00-0b66166debb5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:17.001919 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f6241cdc-4323-4868-9d00-0b66166debb5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:17.003178 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f6241cdc-4323-4868-9d00-0b66166debb5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:17.003178 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f6241cdc-4323-4868-9d00-0b66166debb5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:17.011487 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e04768e0-33c5-4a1c-97d1-3eeae2bd2d33 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e" status: 200 len: 1505 microversion: 2.1 time: 0.721600 Oct 30 01:28:17.012411 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1676/3350] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:16 2022] GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e => generated 1505 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:17.095693 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c4e87242-0662-4026-9a76-418b880c48b4 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:17.097420 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c4e87242-0662-4026-9a76-418b880c48b4 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: c1d74af2-1793-4369-8c7e-a9e5047df775] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:17.114538 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4e87242-0662-4026-9a76-418b880c48b4 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:17.116347 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4e87242-0662-4026-9a76-418b880c48b4 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:17.117044 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4e87242-0662-4026-9a76-418b880c48b4 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:17.117990 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4e87242-0662-4026-9a76-418b880c48b4 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:17.118446 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4e87242-0662-4026-9a76-418b880c48b4 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:17.119071 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4e87242-0662-4026-9a76-418b880c48b4 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:17.119428 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f6241cdc-4323-4868-9d00-0b66166debb5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:17.150551 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f6241cdc-4323-4868-9d00-0b66166debb5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:17.152135 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f6241cdc-4323-4868-9d00-0b66166debb5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:17.157474 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f6241cdc-4323-4868-9d00-0b66166debb5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1592 microversion: 2.32 time: 0.188179 Oct 30 01:28:17.158353 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1675/3351] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:28:16 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1592 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:28:17.196112 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c8d3a0f7-79a3-4d03-a6c6-71c375e4ac90 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:17.196877 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c8d3a0f7-79a3-4d03-a6c6-71c375e4ac90 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 2873be88-5d85-49c6-833f-19b7df1fcf5f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:17.205883 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c8d3a0f7-79a3-4d03-a6c6-71c375e4ac90 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:17.207113 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c8d3a0f7-79a3-4d03-a6c6-71c375e4ac90 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:17.207738 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c8d3a0f7-79a3-4d03-a6c6-71c375e4ac90 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:17.208666 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c8d3a0f7-79a3-4d03-a6c6-71c375e4ac90 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:17.209225 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c8d3a0f7-79a3-4d03-a6c6-71c375e4ac90 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:17.209862 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c8d3a0f7-79a3-4d03-a6c6-71c375e4ac90 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:17.311710 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c8d3a0f7-79a3-4d03-a6c6-71c375e4ac90 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:17.327713 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c8d3a0f7-79a3-4d03-a6c6-71c375e4ac90 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f" status: 200 len: 1226 microversion: 2.1 time: 0.137042 Oct 30 01:28:17.328919 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1676/3352] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:17 2022] GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f => generated 1226 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:28:17.456682 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c4e87242-0662-4026-9a76-418b880c48b4 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:17.471200 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c4e87242-0662-4026-9a76-418b880c48b4 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/c1d74af2-1793-4369-8c7e-a9e5047df775" status: 200 len: 1307 microversion: 2.1 time: 0.376947 Oct 30 01:28:17.472263 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1677/3353] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:17 2022] GET /compute/v2.1/servers/c1d74af2-1793-4369-8c7e-a9e5047df775 => generated 1307 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:28:17.486050 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-3a6a5f8f-3312-4bfa-84fc-f8b26f52aa45 req-761e57af-d4e8-444c-a3fe-7c30bdbd2c23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58c01b8d-2408-44eb-98f9-4aa48acc9481", "name": "network-vif-deleted", "tag": "f77283d2-a434-4c14-894d-036be5b7842b"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:28:17.497548 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-3a6a5f8f-3312-4bfa-84fc-f8b26f52aa45 req-761e57af-d4e8-444c-a3fe-7c30bdbd2c23 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:17.498040 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-3a6a5f8f-3312-4bfa-84fc-f8b26f52aa45 req-761e57af-d4e8-444c-a3fe-7c30bdbd2c23 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:17.498480 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-3a6a5f8f-3312-4bfa-84fc-f8b26f52aa45 req-761e57af-d4e8-444c-a3fe-7c30bdbd2c23 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:17.517761 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-3a6a5f8f-3312-4bfa-84fc-f8b26f52aa45 req-761e57af-d4e8-444c-a3fe-7c30bdbd2c23 service nova] Creating event network-vif-deleted:f77283d2-a434-4c14-894d-036be5b7842b for instance 58c01b8d-2408-44eb-98f9-4aa48acc9481 on n-h1-master-1 Oct 30 01:28:17.543825 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-3a6a5f8f-3312-4bfa-84fc-f8b26f52aa45 req-761e57af-d4e8-444c-a3fe-7c30bdbd2c23 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041576 Oct 30 01:28:17.543825 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1677/3354] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:28:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:28:17.906124 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a8e4d12a-5541-42f7-aa8e-4f6ff5471d69 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:17.906756 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a8e4d12a-5541-42f7-aa8e-4f6ff5471d69 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] [instance: 58c01b8d-2408-44eb-98f9-4aa48acc9481] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:17.913962 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a8e4d12a-5541-42f7-aa8e-4f6ff5471d69 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:17.914462 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a8e4d12a-5541-42f7-aa8e-4f6ff5471d69 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:17.914900 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a8e4d12a-5541-42f7-aa8e-4f6ff5471d69 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:17.915602 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a8e4d12a-5541-42f7-aa8e-4f6ff5471d69 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:17.916069 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a8e4d12a-5541-42f7-aa8e-4f6ff5471d69 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:17.916529 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a8e4d12a-5541-42f7-aa8e-4f6ff5471d69 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:17.981189 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a8e4d12a-5541-42f7-aa8e-4f6ff5471d69 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:17.982868 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a8e4d12a-5541-42f7-aa8e-4f6ff5471d69 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:17.983526 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a8e4d12a-5541-42f7-aa8e-4f6ff5471d69 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:17.984198 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-a8e4d12a-5541-42f7-aa8e-4f6ff5471d69 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lazy-loading 'fault' on Instance uuid 58c01b8d-2408-44eb-98f9-4aa48acc9481 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:28:18.040673 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a8e4d12a-5541-42f7-aa8e-4f6ff5471d69 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3478222ab7f24587a53f4deb83753957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c92264dc354f548697879f5db3c70c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:18.044359 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c0afcf79-c3b0-4c83-98bd-48a3d4c3b906 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:18.052442 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c0afcf79-c3b0-4c83-98bd-48a3d4c3b906 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d01c1c62-c352-4a98-b95b-51ff385a415e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:18.069622 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a8e4d12a-5541-42f7-aa8e-4f6ff5471d69 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] 10.222.0.13 "GET /compute/v2.1/servers/58c01b8d-2408-44eb-98f9-4aa48acc9481" status: 200 len: 1306 microversion: 2.1 time: 0.170726 Oct 30 01:28:18.074119 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1678/3355] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:17 2022] GET /compute/v2.1/servers/58c01b8d-2408-44eb-98f9-4aa48acc9481 => generated 1306 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:18.076273 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0afcf79-c3b0-4c83-98bd-48a3d4c3b906 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:18.077000 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0afcf79-c3b0-4c83-98bd-48a3d4c3b906 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:18.077642 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0afcf79-c3b0-4c83-98bd-48a3d4c3b906 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:18.078716 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0afcf79-c3b0-4c83-98bd-48a3d4c3b906 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:18.087169 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0afcf79-c3b0-4c83-98bd-48a3d4c3b906 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:18.087169 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0afcf79-c3b0-4c83-98bd-48a3d4c3b906 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:18.191606 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b430e4a0-ed16-4860-912e-9181d44c2b5a tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:18.192238 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b430e4a0-ed16-4860-912e-9181d44c2b5a tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:18.232822 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b430e4a0-ed16-4860-912e-9181d44c2b5a tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:18.237884 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b430e4a0-ed16-4860-912e-9181d44c2b5a tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:18.238754 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b430e4a0-ed16-4860-912e-9181d44c2b5a tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:18.239113 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b430e4a0-ed16-4860-912e-9181d44c2b5a tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:18.241595 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b430e4a0-ed16-4860-912e-9181d44c2b5a tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:18.242041 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b430e4a0-ed16-4860-912e-9181d44c2b5a tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:18.381284 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c0afcf79-c3b0-4c83-98bd-48a3d4c3b906 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:18.399559 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c0afcf79-c3b0-4c83-98bd-48a3d4c3b906 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e" status: 200 len: 1505 microversion: 2.1 time: 0.363142 Oct 30 01:28:18.403667 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1678/3356] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:18 2022] GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e => generated 1505 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:18.419004 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6217bd7e-121b-4479-800a-cb95c4b730be tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:18.419835 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6217bd7e-121b-4479-800a-cb95c4b730be tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 2873be88-5d85-49c6-833f-19b7df1fcf5f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:18.450586 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6217bd7e-121b-4479-800a-cb95c4b730be tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:18.454555 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6217bd7e-121b-4479-800a-cb95c4b730be tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:18.454555 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6217bd7e-121b-4479-800a-cb95c4b730be tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:18.456842 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6217bd7e-121b-4479-800a-cb95c4b730be tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:18.460043 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6217bd7e-121b-4479-800a-cb95c4b730be tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:18.460487 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6217bd7e-121b-4479-800a-cb95c4b730be tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:18.649514 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6217bd7e-121b-4479-800a-cb95c4b730be tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:18.658741 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6217bd7e-121b-4479-800a-cb95c4b730be tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f" status: 200 len: 1274 microversion: 2.1 time: 0.253660 Oct 30 01:28:18.678121 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1679/3357] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:18 2022] GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f => generated 1274 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:18.685728 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1a9f86eb-01dd-454d-ade4-4e81432afd85 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:18.686635 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1a9f86eb-01dd-454d-ade4-4e81432afd85 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: c1d74af2-1793-4369-8c7e-a9e5047df775] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:18.693658 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a9f86eb-01dd-454d-ade4-4e81432afd85 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:18.694467 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a9f86eb-01dd-454d-ade4-4e81432afd85 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:18.695133 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a9f86eb-01dd-454d-ade4-4e81432afd85 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:18.696101 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a9f86eb-01dd-454d-ade4-4e81432afd85 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:18.696775 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a9f86eb-01dd-454d-ade4-4e81432afd85 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:18.697417 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a9f86eb-01dd-454d-ade4-4e81432afd85 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:18.704101 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b430e4a0-ed16-4860-912e-9181d44c2b5a tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:18.721888 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b430e4a0-ed16-4860-912e-9181d44c2b5a tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:18.737584 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b430e4a0-ed16-4860-912e-9181d44c2b5a tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:18.756136 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b430e4a0-ed16-4860-912e-9181d44c2b5a tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1659 microversion: 2.32 time: 0.569007 Oct 30 01:28:18.761309 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1679/3358] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:28:18 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1659 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:28:18.969793 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1a9f86eb-01dd-454d-ade4-4e81432afd85 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:18.979249 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1a9f86eb-01dd-454d-ade4-4e81432afd85 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/c1d74af2-1793-4369-8c7e-a9e5047df775" status: 200 len: 1307 microversion: 2.1 time: 0.299382 Oct 30 01:28:18.980640 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1680/3359] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:18 2022] GET /compute/v2.1/servers/c1d74af2-1793-4369-8c7e-a9e5047df775 => generated 1307 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:19.096257 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-13fa4a78-50bf-479e-8837-36bd626c9852 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:19.097413 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-13fa4a78-50bf-479e-8837-36bd626c9852 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] [instance: 58c01b8d-2408-44eb-98f9-4aa48acc9481] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:19.137048 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-13fa4a78-50bf-479e-8837-36bd626c9852 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:19.138833 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-13fa4a78-50bf-479e-8837-36bd626c9852 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:19.139415 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-13fa4a78-50bf-479e-8837-36bd626c9852 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:19.141273 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-13fa4a78-50bf-479e-8837-36bd626c9852 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:19.144196 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-13fa4a78-50bf-479e-8837-36bd626c9852 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:19.144749 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-13fa4a78-50bf-479e-8837-36bd626c9852 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:19.239532 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-13fa4a78-50bf-479e-8837-36bd626c9852 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:19.241926 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-13fa4a78-50bf-479e-8837-36bd626c9852 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:19.243353 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-13fa4a78-50bf-479e-8837-36bd626c9852 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:19.246331 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-13fa4a78-50bf-479e-8837-36bd626c9852 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lazy-loading 'fault' on Instance uuid 58c01b8d-2408-44eb-98f9-4aa48acc9481 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:28:19.399220 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-13fa4a78-50bf-479e-8837-36bd626c9852 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3478222ab7f24587a53f4deb83753957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c92264dc354f548697879f5db3c70c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:19.411201 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-13fa4a78-50bf-479e-8837-36bd626c9852 tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] 10.222.0.13 "GET /compute/v2.1/servers/58c01b8d-2408-44eb-98f9-4aa48acc9481" status: 200 len: 1306 microversion: 2.1 time: 0.318620 Oct 30 01:28:19.416527 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1680/3360] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:19 2022] GET /compute/v2.1/servers/58c01b8d-2408-44eb-98f9-4aa48acc9481 => generated 1306 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:19.431255 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-05d41423-9981-4162-acbc-5a4cd6eb4504 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:19.432519 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-05d41423-9981-4162-acbc-5a4cd6eb4504 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d01c1c62-c352-4a98-b95b-51ff385a415e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:19.442890 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-05d41423-9981-4162-acbc-5a4cd6eb4504 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:19.443601 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-05d41423-9981-4162-acbc-5a4cd6eb4504 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:19.448298 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-05d41423-9981-4162-acbc-5a4cd6eb4504 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:19.449232 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-05d41423-9981-4162-acbc-5a4cd6eb4504 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:19.449961 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-05d41423-9981-4162-acbc-5a4cd6eb4504 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:19.456917 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-05d41423-9981-4162-acbc-5a4cd6eb4504 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:19.692853 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-747e5e50-92ed-40f8-a1be-86905fc24a30 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:19.699269 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-747e5e50-92ed-40f8-a1be-86905fc24a30 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 2873be88-5d85-49c6-833f-19b7df1fcf5f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:19.711352 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-747e5e50-92ed-40f8-a1be-86905fc24a30 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:19.712031 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-747e5e50-92ed-40f8-a1be-86905fc24a30 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:19.716820 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-747e5e50-92ed-40f8-a1be-86905fc24a30 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:19.717853 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-747e5e50-92ed-40f8-a1be-86905fc24a30 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:19.722889 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-747e5e50-92ed-40f8-a1be-86905fc24a30 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:19.723761 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-747e5e50-92ed-40f8-a1be-86905fc24a30 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:19.811978 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:20.115839 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-747e5e50-92ed-40f8-a1be-86905fc24a30 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:20.130696 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-747e5e50-92ed-40f8-a1be-86905fc24a30 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f" status: 200 len: 1282 microversion: 2.1 time: 0.441471 Oct 30 01:28:20.133768 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1681/3361] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:19 2022] GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f => generated 1282 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:20.148287 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c2945c96-f5b8-4898-aff5-968947ad8eea tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:20.151834 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c2945c96-f5b8-4898-aff5-968947ad8eea tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:20.180939 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c2945c96-f5b8-4898-aff5-968947ad8eea tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:20.188320 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c2945c96-f5b8-4898-aff5-968947ad8eea tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:20.188780 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c2945c96-f5b8-4898-aff5-968947ad8eea tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:20.190097 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c2945c96-f5b8-4898-aff5-968947ad8eea tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:20.190559 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c2945c96-f5b8-4898-aff5-968947ad8eea tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:20.190986 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c2945c96-f5b8-4898-aff5-968947ad8eea tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:20.296220 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-05d41423-9981-4162-acbc-5a4cd6eb4504 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:20.308815 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-05d41423-9981-4162-acbc-5a4cd6eb4504 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e" status: 200 len: 1505 microversion: 2.1 time: 0.881540 Oct 30 01:28:20.310206 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1681/3362] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:19 2022] GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e => generated 1505 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:20.321972 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f320ad50-4a7c-4358-9524-4cb46588f9bf tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:20.322929 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f320ad50-4a7c-4358-9524-4cb46588f9bf tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: c1d74af2-1793-4369-8c7e-a9e5047df775] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:20.344989 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f320ad50-4a7c-4358-9524-4cb46588f9bf tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:20.345993 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f320ad50-4a7c-4358-9524-4cb46588f9bf tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:20.347402 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f320ad50-4a7c-4358-9524-4cb46588f9bf tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:20.348366 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f320ad50-4a7c-4358-9524-4cb46588f9bf tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:20.349282 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f320ad50-4a7c-4358-9524-4cb46588f9bf tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:20.353387 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f320ad50-4a7c-4358-9524-4cb46588f9bf tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:20.397161 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:20.802135 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f320ad50-4a7c-4358-9524-4cb46588f9bf tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:20.815326 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f320ad50-4a7c-4358-9524-4cb46588f9bf tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/c1d74af2-1793-4369-8c7e-a9e5047df775" status: 200 len: 1486 microversion: 2.1 time: 0.503628 Oct 30 01:28:20.818881 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1682/3363] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:20 2022] GET /compute/v2.1/servers/c1d74af2-1793-4369-8c7e-a9e5047df775 => generated 1486 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:20.834659 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-39fe33ee-e50d-4c2d-b283-a7968b38091e tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:20.835523 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-39fe33ee-e50d-4c2d-b283-a7968b38091e tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] [instance: 58c01b8d-2408-44eb-98f9-4aa48acc9481] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:20.867195 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-39fe33ee-e50d-4c2d-b283-a7968b38091e tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:20.873009 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-39fe33ee-e50d-4c2d-b283-a7968b38091e tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:20.875339 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-39fe33ee-e50d-4c2d-b283-a7968b38091e tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:20.877065 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-39fe33ee-e50d-4c2d-b283-a7968b38091e tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:20.878859 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-39fe33ee-e50d-4c2d-b283-a7968b38091e tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:20.880239 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-39fe33ee-e50d-4c2d-b283-a7968b38091e tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-39fe33ee-e50d-4c2d-b283-a7968b38091e tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] HTTP exception thrown: Instance 58c01b8d-2408-44eb-98f9-4aa48acc9481 could not be found. Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-39fe33ee-e50d-4c2d-b283-a7968b38091e tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Request method failure captured: Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/58c01b8d-2408-44eb-98f9-4aa48acc9481 HTTP/1.1 Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdMMH5FQDJTK9ssaNqKSDm6JnsMESocE0657oxOrlbuJJyJ7E74PAHCDF06GiMD0Shi4nQswnzLKhGbu1xHoBi11MFMw8xj9GG8Uk2EK9cryrQ08l5MDgeI5MI0FzryKaI1FNoS8eTz9xAgjkpE67buZQXGkOw_YFpbpprYxVuMhIWE Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 87c92264dc354f548697879f5db3c70c Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServerPasswordTestJSON-1525605709 Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/87c92264dc354f548697879f5db3c70c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_87c92264dc354f548697879f5db3c70c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/87c92264dc354f548697879f5db3c70c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/87c92264dc354f548697879f5db3c70c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServerPasswordTestJSON-1525605709 Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 87c92264dc354f548697879f5db3c70c Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1525605709 Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServerPasswordTestJSON-1525605709-project Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 3478222ab7f24587a53f4deb83753957 Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServerPasswordTestJSON-1525605709-project Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 58c01b8d-2408-44eb-98f9-4aa48acc9481 could not be found. Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '58c01b8d-2408-44eb-98f9-4aa48acc9481'} Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58c01b8d-2408-44eb-98f9-4aa48acc9481 could not be found. Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:28:21.123144 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:28:21.129076 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58c01b8d-2408-44eb-98f9-4aa48acc9481 could not be found. Oct 30 01:28:21.129076 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:28:21.129076 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:28:21.129076 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:28:21.129076 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:28:21.129076 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:28:21.129076 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:28:21.129076 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:28:21.129076 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:28:21.129076 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58c01b8d-2408-44eb-98f9-4aa48acc9481 could not be found. Oct 30 01:28:21.129076 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:28:21.129076 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-39fe33ee-e50d-4c2d-b283-a7968b38091e tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] Returning 404 to user: Instance 58c01b8d-2408-44eb-98f9-4aa48acc9481 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:28:21.129076 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-39fe33ee-e50d-4c2d-b283-a7968b38091e tempest-ServerPasswordTestJSON-1525605709 tempest-ServerPasswordTestJSON-1525605709-project] 10.222.0.13 "GET /compute/v2.1/servers/58c01b8d-2408-44eb-98f9-4aa48acc9481" status: 404 len: 111 microversion: 2.1 time: 0.105339 Oct 30 01:28:21.129076 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1683/3364] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:20 2022] GET /compute/v2.1/servers/58c01b8d-2408-44eb-98f9-4aa48acc9481 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:28:21.129076 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f3bd97d5-6385-42c7-977d-687669214a17 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:21.129076 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f3bd97d5-6385-42c7-977d-687669214a17 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: c1d74af2-1793-4369-8c7e-a9e5047df775] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:21.129076 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:21.129076 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f3bd97d5-6385-42c7-977d-687669214a17 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:21.129076 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f3bd97d5-6385-42c7-977d-687669214a17 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:21.129076 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f3bd97d5-6385-42c7-977d-687669214a17 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:21.129076 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f3bd97d5-6385-42c7-977d-687669214a17 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:21.129076 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f3bd97d5-6385-42c7-977d-687669214a17 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:21.129076 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f3bd97d5-6385-42c7-977d-687669214a17 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:21.134791 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f3bd97d5-6385-42c7-977d-687669214a17 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: c1d74af2-1793-4369-8c7e-a9e5047df775] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:28:21.135357 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c2945c96-f5b8-4898-aff5-968947ad8eea tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:21.135357 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c2945c96-f5b8-4898-aff5-968947ad8eea tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:21.135357 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c2945c96-f5b8-4898-aff5-968947ad8eea tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:21.135357 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c2945c96-f5b8-4898-aff5-968947ad8eea tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1659 microversion: 2.32 time: 0.967445 Oct 30 01:28:21.135357 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1682/3365] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:28:20 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1659 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:28:21.162544 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-24573613-ff71-45e3-bdb8-a6566ef161a3 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:21.163334 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-24573613-ff71-45e3-bdb8-a6566ef161a3 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 2873be88-5d85-49c6-833f-19b7df1fcf5f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:21.180808 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24573613-ff71-45e3-bdb8-a6566ef161a3 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:21.182443 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24573613-ff71-45e3-bdb8-a6566ef161a3 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:21.185889 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24573613-ff71-45e3-bdb8-a6566ef161a3 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:21.186995 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24573613-ff71-45e3-bdb8-a6566ef161a3 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:21.187724 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24573613-ff71-45e3-bdb8-a6566ef161a3 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:21.192255 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24573613-ff71-45e3-bdb8-a6566ef161a3 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:21.841824 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-24573613-ff71-45e3-bdb8-a6566ef161a3 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:21.859916 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-24573613-ff71-45e3-bdb8-a6566ef161a3 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f" status: 200 len: 1280 microversion: 2.1 time: 0.703588 Oct 30 01:28:21.860514 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1683/3366] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:21 2022] GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f => generated 1280 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:28:21.874095 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-56fbc526-3714-4f0d-ad42-abe7cb91365b tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:21.875039 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-56fbc526-3714-4f0d-ad42-abe7cb91365b tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d01c1c62-c352-4a98-b95b-51ff385a415e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:21.888908 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-56fbc526-3714-4f0d-ad42-abe7cb91365b tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:21.889684 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-56fbc526-3714-4f0d-ad42-abe7cb91365b tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:21.890300 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-56fbc526-3714-4f0d-ad42-abe7cb91365b tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:21.891198 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-56fbc526-3714-4f0d-ad42-abe7cb91365b tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:21.891819 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-56fbc526-3714-4f0d-ad42-abe7cb91365b tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:21.892535 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-56fbc526-3714-4f0d-ad42-abe7cb91365b tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:21.984589 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f3bd97d5-6385-42c7-977d-687669214a17 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c1d74af2-1793-4369-8c7e-a9e5047df775" status: 204 len: 0 microversion: 2.1 time: 1.056493 Oct 30 01:28:21.986082 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1684/3367] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:28:20 2022] DELETE /compute/v2.1/servers/c1d74af2-1793-4369-8c7e-a9e5047df775 => generated 0 bytes in 1059 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:28:22.010220 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fb244d72-9006-4ae9-877a-5edeb874efad tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:22.013073 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-fb244d72-9006-4ae9-877a-5edeb874efad tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: c1d74af2-1793-4369-8c7e-a9e5047df775] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:22.035463 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fb244d72-9006-4ae9-877a-5edeb874efad tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:22.035969 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fb244d72-9006-4ae9-877a-5edeb874efad tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:22.036414 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fb244d72-9006-4ae9-877a-5edeb874efad tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:22.037138 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fb244d72-9006-4ae9-877a-5edeb874efad tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:22.043284 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fb244d72-9006-4ae9-877a-5edeb874efad tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:22.044794 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fb244d72-9006-4ae9-877a-5edeb874efad tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:22.413249 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=8 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:22.502958 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-56fbc526-3714-4f0d-ad42-abe7cb91365b tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:22.512986 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-fb244d72-9006-4ae9-877a-5edeb874efad tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:22.531672 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fb244d72-9006-4ae9-877a-5edeb874efad tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/c1d74af2-1793-4369-8c7e-a9e5047df775" status: 200 len: 1492 microversion: 2.1 time: 0.539931 Oct 30 01:28:22.533298 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1685/3368] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:21 2022] GET /compute/v2.1/servers/c1d74af2-1793-4369-8c7e-a9e5047df775 => generated 1492 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:22.538340 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-31a700b4-1b45-4671-9ef4-a650c4301684 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:22.542193 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-31a700b4-1b45-4671-9ef4-a650c4301684 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:22.545507 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-56fbc526-3714-4f0d-ad42-abe7cb91365b tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e" status: 200 len: 1505 microversion: 2.1 time: 0.669512 Oct 30 01:28:22.555874 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-31a700b4-1b45-4671-9ef4-a650c4301684 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:22.556610 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-31a700b4-1b45-4671-9ef4-a650c4301684 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:22.557236 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-31a700b4-1b45-4671-9ef4-a650c4301684 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:22.558201 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-31a700b4-1b45-4671-9ef4-a650c4301684 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:22.558828 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-31a700b4-1b45-4671-9ef4-a650c4301684 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:22.566087 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-31a700b4-1b45-4671-9ef4-a650c4301684 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:22.570661 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1684/3369] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:21 2022] GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e => generated 1505 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:22.891466 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5c15900a-2a94-4103-8ea1-174a42bdf593 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:22.892881 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5c15900a-2a94-4103-8ea1-174a42bdf593 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 2873be88-5d85-49c6-833f-19b7df1fcf5f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:22.905159 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c15900a-2a94-4103-8ea1-174a42bdf593 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:22.907041 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c15900a-2a94-4103-8ea1-174a42bdf593 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:22.908050 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c15900a-2a94-4103-8ea1-174a42bdf593 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:22.908801 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c15900a-2a94-4103-8ea1-174a42bdf593 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:22.909257 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c15900a-2a94-4103-8ea1-174a42bdf593 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:22.909710 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c15900a-2a94-4103-8ea1-174a42bdf593 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:23.377900 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-31a700b4-1b45-4671-9ef4-a650c4301684 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:23.391163 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-31a700b4-1b45-4671-9ef4-a650c4301684 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:23.412803 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-31a700b4-1b45-4671-9ef4-a650c4301684 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:23.417989 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-31a700b4-1b45-4671-9ef4-a650c4301684 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1705 microversion: 2.32 time: 0.883396 Oct 30 01:28:23.419426 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1686/3370] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:28:22 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1705 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:28:23.559589 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d205f65c-410c-418d-afd9-9a1efe1fb6c7 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:23.560721 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d205f65c-410c-418d-afd9-9a1efe1fb6c7 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: c1d74af2-1793-4369-8c7e-a9e5047df775] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:23.572747 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d205f65c-410c-418d-afd9-9a1efe1fb6c7 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:23.576803 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d205f65c-410c-418d-afd9-9a1efe1fb6c7 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:23.579662 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d205f65c-410c-418d-afd9-9a1efe1fb6c7 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:23.581151 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d205f65c-410c-418d-afd9-9a1efe1fb6c7 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:23.581868 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d205f65c-410c-418d-afd9-9a1efe1fb6c7 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:23.582628 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d205f65c-410c-418d-afd9-9a1efe1fb6c7 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:23.627682 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5c15900a-2a94-4103-8ea1-174a42bdf593 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:23.638047 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5c15900a-2a94-4103-8ea1-174a42bdf593 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f" status: 200 len: 1322 microversion: 2.1 time: 0.750738 Oct 30 01:28:23.656014 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1685/3371] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:22 2022] GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f => generated 1322 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:28:23.666237 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-142866fc-ef76-4cf0-a7f1-061daafeafa4 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:23.667888 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-142866fc-ef76-4cf0-a7f1-061daafeafa4 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d01c1c62-c352-4a98-b95b-51ff385a415e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:23.675331 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-142866fc-ef76-4cf0-a7f1-061daafeafa4 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:23.676989 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-142866fc-ef76-4cf0-a7f1-061daafeafa4 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:23.677730 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-142866fc-ef76-4cf0-a7f1-061daafeafa4 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:23.684678 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-142866fc-ef76-4cf0-a7f1-061daafeafa4 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:23.684678 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-142866fc-ef76-4cf0-a7f1-061daafeafa4 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:23.684678 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-142866fc-ef76-4cf0-a7f1-061daafeafa4 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:24.750778 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d205f65c-410c-418d-afd9-9a1efe1fb6c7 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:24.762040 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d205f65c-410c-418d-afd9-9a1efe1fb6c7 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/c1d74af2-1793-4369-8c7e-a9e5047df775" status: 200 len: 1492 microversion: 2.1 time: 1.206572 Oct 30 01:28:24.762638 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1687/3372] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:23 2022] GET /compute/v2.1/servers/c1d74af2-1793-4369-8c7e-a9e5047df775 => generated 1492 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:24.796586 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cfdfc116-bc63-47c7-8cac-83c34f7a1782 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:24.801311 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-cfdfc116-bc63-47c7-8cac-83c34f7a1782 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:24.829272 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cfdfc116-bc63-47c7-8cac-83c34f7a1782 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:24.830096 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cfdfc116-bc63-47c7-8cac-83c34f7a1782 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:24.830832 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cfdfc116-bc63-47c7-8cac-83c34f7a1782 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:24.832937 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cfdfc116-bc63-47c7-8cac-83c34f7a1782 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:24.834108 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cfdfc116-bc63-47c7-8cac-83c34f7a1782 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:24.834494 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cfdfc116-bc63-47c7-8cac-83c34f7a1782 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:24.862436 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-142866fc-ef76-4cf0-a7f1-061daafeafa4 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:24.910056 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-142866fc-ef76-4cf0-a7f1-061daafeafa4 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e" status: 200 len: 1505 microversion: 2.1 time: 1.248276 Oct 30 01:28:24.911273 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1686/3373] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:23 2022] GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e => generated 1505 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:24.943440 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-93b376ee-d115-42bd-ba80-63f51b58d61c tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:24.943440 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-93b376ee-d115-42bd-ba80-63f51b58d61c tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 2873be88-5d85-49c6-833f-19b7df1fcf5f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:24.967915 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-93b376ee-d115-42bd-ba80-63f51b58d61c tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:24.969549 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-93b376ee-d115-42bd-ba80-63f51b58d61c tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:24.971602 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-93b376ee-d115-42bd-ba80-63f51b58d61c tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:24.972923 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-93b376ee-d115-42bd-ba80-63f51b58d61c tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:24.973502 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-93b376ee-d115-42bd-ba80-63f51b58d61c tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:24.980688 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-93b376ee-d115-42bd-ba80-63f51b58d61c tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:25.223203 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=6 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:25.486779 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-cfdfc116-bc63-47c7-8cac-83c34f7a1782 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:25.512262 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-cfdfc116-bc63-47c7-8cac-83c34f7a1782 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:25.517656 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-cfdfc116-bc63-47c7-8cac-83c34f7a1782 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:25.525964 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cfdfc116-bc63-47c7-8cac-83c34f7a1782 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1705 microversion: 2.32 time: 0.759013 Oct 30 01:28:25.537560 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1688/3374] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:28:24 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1705 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:28:25.539301 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-93b376ee-d115-42bd-ba80-63f51b58d61c tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:25.556322 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-93b376ee-d115-42bd-ba80-63f51b58d61c tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f" status: 200 len: 1322 microversion: 2.1 time: 0.641423 Oct 30 01:28:25.563580 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1687/3375] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:24 2022] GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f => generated 1322 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:25.786657 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c6091f24-a029-4bf7-8785-93551e47f4c2 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:25.787581 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c6091f24-a029-4bf7-8785-93551e47f4c2 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: c1d74af2-1793-4369-8c7e-a9e5047df775] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:25.799508 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6091f24-a029-4bf7-8785-93551e47f4c2 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:25.800006 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6091f24-a029-4bf7-8785-93551e47f4c2 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:25.800444 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6091f24-a029-4bf7-8785-93551e47f4c2 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:25.801473 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6091f24-a029-4bf7-8785-93551e47f4c2 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:25.801933 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6091f24-a029-4bf7-8785-93551e47f4c2 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:25.802381 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6091f24-a029-4bf7-8785-93551e47f4c2 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:25.939030 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7e8bde67-4bf3-463b-bbc0-b2249b90d600 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:25.940855 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7e8bde67-4bf3-463b-bbc0-b2249b90d600 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d01c1c62-c352-4a98-b95b-51ff385a415e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:25.951348 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e8bde67-4bf3-463b-bbc0-b2249b90d600 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:25.955245 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e8bde67-4bf3-463b-bbc0-b2249b90d600 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:25.956148 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e8bde67-4bf3-463b-bbc0-b2249b90d600 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:25.994937 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e8bde67-4bf3-463b-bbc0-b2249b90d600 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:25.997305 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e8bde67-4bf3-463b-bbc0-b2249b90d600 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:25.998658 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e8bde67-4bf3-463b-bbc0-b2249b90d600 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:26.160826 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=22 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:26.358092 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c6091f24-a029-4bf7-8785-93551e47f4c2 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:26.367580 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c6091f24-a029-4bf7-8785-93551e47f4c2 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/c1d74af2-1793-4369-8c7e-a9e5047df775" status: 200 len: 1450 microversion: 2.1 time: 0.584665 Oct 30 01:28:26.377715 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1689/3376] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:25 2022] GET /compute/v2.1/servers/c1d74af2-1793-4369-8c7e-a9e5047df775 => generated 1450 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:26.391276 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-c283209d-b2aa-4076-b55d-ed18e45359e4 req-0e0759eb-2916-4f45-b78a-4587c72ea754 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1d74af2-1793-4369-8c7e-a9e5047df775", "name": "network-vif-deleted", "tag": "538e6ae2-9c60-4975-bc4b-9e32ce420d86"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:28:26.438407 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-c283209d-b2aa-4076-b55d-ed18e45359e4 req-0e0759eb-2916-4f45-b78a-4587c72ea754 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:26.439215 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-c283209d-b2aa-4076-b55d-ed18e45359e4 req-0e0759eb-2916-4f45-b78a-4587c72ea754 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:26.440781 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-c283209d-b2aa-4076-b55d-ed18e45359e4 req-0e0759eb-2916-4f45-b78a-4587c72ea754 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:26.491028 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-c283209d-b2aa-4076-b55d-ed18e45359e4 req-0e0759eb-2916-4f45-b78a-4587c72ea754 service nova] Creating event network-vif-deleted:538e6ae2-9c60-4975-bc4b-9e32ce420d86 for instance c1d74af2-1793-4369-8c7e-a9e5047df775 on n-h2-master-1 Oct 30 01:28:26.527469 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-c283209d-b2aa-4076-b55d-ed18e45359e4 req-0e0759eb-2916-4f45-b78a-4587c72ea754 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143859 Oct 30 01:28:26.531604 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1690/3377] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:28:26.567293 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f669683a-c5c9-4406-a714-95306060ea1d tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:26.568687 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f669683a-c5c9-4406-a714-95306060ea1d tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:26.598122 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f669683a-c5c9-4406-a714-95306060ea1d tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:26.600257 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f669683a-c5c9-4406-a714-95306060ea1d tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:26.601684 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f669683a-c5c9-4406-a714-95306060ea1d tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:26.603602 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f669683a-c5c9-4406-a714-95306060ea1d tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:26.604506 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f669683a-c5c9-4406-a714-95306060ea1d tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:26.606816 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f669683a-c5c9-4406-a714-95306060ea1d tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:26.840616 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7e8bde67-4bf3-463b-bbc0-b2249b90d600 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:26.850616 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7e8bde67-4bf3-463b-bbc0-b2249b90d600 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e" status: 200 len: 1505 microversion: 2.1 time: 0.916730 Oct 30 01:28:26.868081 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1688/3378] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:25 2022] GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e => generated 1505 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:28:26.883103 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-390a5180-b371-46fc-bb40-d94aa48200b0 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:26.885722 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-390a5180-b371-46fc-bb40-d94aa48200b0 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 2873be88-5d85-49c6-833f-19b7df1fcf5f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:26.899526 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-390a5180-b371-46fc-bb40-d94aa48200b0 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:26.900207 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-390a5180-b371-46fc-bb40-d94aa48200b0 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:26.902596 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-390a5180-b371-46fc-bb40-d94aa48200b0 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:26.903652 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-390a5180-b371-46fc-bb40-d94aa48200b0 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:26.904283 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-390a5180-b371-46fc-bb40-d94aa48200b0 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:26.910508 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-390a5180-b371-46fc-bb40-d94aa48200b0 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:27.647478 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f669683a-c5c9-4406-a714-95306060ea1d tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:27.666512 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f669683a-c5c9-4406-a714-95306060ea1d tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:27.677505 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f669683a-c5c9-4406-a714-95306060ea1d tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:27.680318 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f669683a-c5c9-4406-a714-95306060ea1d tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1751 microversion: 2.32 time: 1.119180 Oct 30 01:28:27.680893 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1691/3379] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:28:26 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1751 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:28:27.733226 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-650afc0c-dde0-4ceb-83bb-88cfd9f37353 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:27.736807 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-650afc0c-dde0-4ceb-83bb-88cfd9f37353 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: c1d74af2-1793-4369-8c7e-a9e5047df775] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:27.758783 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-650afc0c-dde0-4ceb-83bb-88cfd9f37353 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:27.759473 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-650afc0c-dde0-4ceb-83bb-88cfd9f37353 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:27.762610 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-650afc0c-dde0-4ceb-83bb-88cfd9f37353 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:27.762610 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-650afc0c-dde0-4ceb-83bb-88cfd9f37353 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:27.762610 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-650afc0c-dde0-4ceb-83bb-88cfd9f37353 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:27.767984 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-650afc0c-dde0-4ceb-83bb-88cfd9f37353 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:27.851639 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-650afc0c-dde0-4ceb-83bb-88cfd9f37353 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] HTTP exception thrown: Instance c1d74af2-1793-4369-8c7e-a9e5047df775 could not be found. Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-650afc0c-dde0-4ceb-83bb-88cfd9f37353 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Request method failure captured: Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/c1d74af2-1793-4369-8c7e-a9e5047df775 HTTP/1.1 Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdHeyUy7YRlBOjEIMB2SM5IZKoEM9E4CcgE_HPOqloJp1NZnn6dha472SrZ31y2exANSVhQ3YMhYfN1WKKWmY5LYeNp42aJgNRzc0qxtfn3HVOOFRHdXQayAjQiB3EhVLJEEiK3-p5hlGh_9_wOga5iGlHo5mVxXdGv2Ye2RftSaR1s Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 4aa9c648b20d41d7b150fbf64cde6fe8 Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ImagesTestJSON-298836005 Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ImagesTestJSON-298836005 Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 4aa9c648b20d41d7b150fbf64cde6fe8 Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ImagesTestJSON-298836005 Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ImagesTestJSON-298836005-project Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: f857d6b0826e47c6875a307e7ccfb104 Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ImagesTestJSON-298836005-project Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: exception: Instance c1d74af2-1793-4369-8c7e-a9e5047df775 could not be found. Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'c1d74af2-1793-4369-8c7e-a9e5047df775'} Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1d74af2-1793-4369-8c7e-a9e5047df775 could not be found. Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1d74af2-1793-4369-8c7e-a9e5047df775 could not be found. Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:28:27.864985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:28:27.871437 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:28:27.871437 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:28:27.871437 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:28:27.871437 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:28:27.871437 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1d74af2-1793-4369-8c7e-a9e5047df775 could not be found. Oct 30 01:28:27.871437 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:28:27.871437 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-650afc0c-dde0-4ceb-83bb-88cfd9f37353 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Returning 404 to user: Instance c1d74af2-1793-4369-8c7e-a9e5047df775 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:28:27.874048 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-650afc0c-dde0-4ceb-83bb-88cfd9f37353 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/c1d74af2-1793-4369-8c7e-a9e5047df775" status: 404 len: 111 microversion: 2.1 time: 0.160710 Oct 30 01:28:27.878796 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1692/3380] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:27 2022] GET /compute/v2.1/servers/c1d74af2-1793-4369-8c7e-a9e5047df775 => generated 111 bytes in 197 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:28:27.901386 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-133c941f-a2c2-434b-8a53-76bfe5504d0d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:27.908463 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-133c941f-a2c2-434b-8a53-76bfe5504d0d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d01c1c62-c352-4a98-b95b-51ff385a415e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:27.928875 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-133c941f-a2c2-434b-8a53-76bfe5504d0d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:27.932017 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-133c941f-a2c2-434b-8a53-76bfe5504d0d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:27.933985 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-133c941f-a2c2-434b-8a53-76bfe5504d0d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:27.937612 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-133c941f-a2c2-434b-8a53-76bfe5504d0d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:27.939219 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-133c941f-a2c2-434b-8a53-76bfe5504d0d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:27.942002 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-133c941f-a2c2-434b-8a53-76bfe5504d0d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:28.123541 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-390a5180-b371-46fc-bb40-d94aa48200b0 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:28.133839 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-390a5180-b371-46fc-bb40-d94aa48200b0 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f" status: 200 len: 1322 microversion: 2.1 time: 1.263404 Oct 30 01:28:28.146364 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1689/3381] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:26 2022] GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f => generated 1322 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:28.176784 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b622f6f6-9722-421c-9c1a-8c1f6d53d637 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44c73ff820>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:28.772539 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-133c941f-a2c2-434b-8a53-76bfe5504d0d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:28.785066 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-133c941f-a2c2-434b-8a53-76bfe5504d0d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e" status: 200 len: 1505 microversion: 2.1 time: 0.900583 Oct 30 01:28:28.797464 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1693/3382] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:27 2022] GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e => generated 1505 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:28.816688 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-648d0446-e733-422f-bcf6-b8def04aceb9 req-b3c07295-1264-4fa1-8cf2-988b98abab6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28af596f-f044-4281-8106-4585fbde9a4a", "tag": "549f19a7-85dc-4d6e-b940-48f4f45b7e9a"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:28:28.861733 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-648d0446-e733-422f-bcf6-b8def04aceb9 req-b3c07295-1264-4fa1-8cf2-988b98abab6d service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:28.862336 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-648d0446-e733-422f-bcf6-b8def04aceb9 req-b3c07295-1264-4fa1-8cf2-988b98abab6d service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:28.864127 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-648d0446-e733-422f-bcf6-b8def04aceb9 req-b3c07295-1264-4fa1-8cf2-988b98abab6d service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:28.930869 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-648d0446-e733-422f-bcf6-b8def04aceb9 req-b3c07295-1264-4fa1-8cf2-988b98abab6d service nova] Creating event network-changed:549f19a7-85dc-4d6e-b940-48f4f45b7e9a for instance 28af596f-f044-4281-8106-4585fbde9a4a on n-h2-master-1 Oct 30 01:28:28.953057 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-648d0446-e733-422f-bcf6-b8def04aceb9 req-b3c07295-1264-4fa1-8cf2-988b98abab6d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153358 Oct 30 01:28:28.955858 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1694/3383] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:28:28.971545 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-e235b920-4c3d-4a06-a0b8-427415163e37 req-d93d5ece-4995-4622-88cb-037324996188 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2873be88-5d85-49c6-833f-19b7df1fcf5f", "tag": "f71f2c8b-6275-46ae-8dfd-8ce7b99e2529"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:28:29.022207 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e235b920-4c3d-4a06-a0b8-427415163e37 req-d93d5ece-4995-4622-88cb-037324996188 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:29.022207 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e235b920-4c3d-4a06-a0b8-427415163e37 req-d93d5ece-4995-4622-88cb-037324996188 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:29.022207 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e235b920-4c3d-4a06-a0b8-427415163e37 req-d93d5ece-4995-4622-88cb-037324996188 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:29.070383 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-e235b920-4c3d-4a06-a0b8-427415163e37 req-d93d5ece-4995-4622-88cb-037324996188 service nova] Creating event network-changed:f71f2c8b-6275-46ae-8dfd-8ce7b99e2529 for instance 2873be88-5d85-49c6-833f-19b7df1fcf5f on n-h1-master-1 Oct 30 01:28:29.082909 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-e235b920-4c3d-4a06-a0b8-427415163e37 req-d93d5ece-4995-4622-88cb-037324996188 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125601 Oct 30 01:28:29.087403 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1695/3384] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:28:29.099291 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-702fbc5c-756e-4ff5-b101-97b146a5a95c tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:29.101324 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-702fbc5c-756e-4ff5-b101-97b146a5a95c tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:29.119581 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-702fbc5c-756e-4ff5-b101-97b146a5a95c tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:29.125716 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-702fbc5c-756e-4ff5-b101-97b146a5a95c tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:29.126403 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-702fbc5c-756e-4ff5-b101-97b146a5a95c tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:29.127395 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-702fbc5c-756e-4ff5-b101-97b146a5a95c tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:29.127964 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-702fbc5c-756e-4ff5-b101-97b146a5a95c tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:29.128499 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-702fbc5c-756e-4ff5-b101-97b146a5a95c tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:29.713677 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-702fbc5c-756e-4ff5-b101-97b146a5a95c tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:29.727110 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-702fbc5c-756e-4ff5-b101-97b146a5a95c tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:29.730543 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-702fbc5c-756e-4ff5-b101-97b146a5a95c tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:29.738984 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-702fbc5c-756e-4ff5-b101-97b146a5a95c tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1751 microversion: 2.32 time: 0.649552 Oct 30 01:28:29.753361 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1696/3385] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:28:29 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1751 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:28:29.753361 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6265bfb4-e070-4bd8-a565-6e580f7f25ff tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:29.753361 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6265bfb4-e070-4bd8-a565-6e580f7f25ff tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 2873be88-5d85-49c6-833f-19b7df1fcf5f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:29.782783 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6265bfb4-e070-4bd8-a565-6e580f7f25ff tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:29.784751 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6265bfb4-e070-4bd8-a565-6e580f7f25ff tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:29.786682 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6265bfb4-e070-4bd8-a565-6e580f7f25ff tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:29.788487 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6265bfb4-e070-4bd8-a565-6e580f7f25ff tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:29.791035 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6265bfb4-e070-4bd8-a565-6e580f7f25ff tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:29.792013 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6265bfb4-e070-4bd8-a565-6e580f7f25ff tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:30.559769 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6265bfb4-e070-4bd8-a565-6e580f7f25ff tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:30.575208 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6265bfb4-e070-4bd8-a565-6e580f7f25ff tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f" status: 200 len: 1322 microversion: 2.1 time: 0.833997 Oct 30 01:28:30.581652 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b622f6f6-9722-421c-9c1a-8c1f6d53d637 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "DELETE /compute/v2.1/images/dca8deb4-b525-42b4-860c-8ee77a764df8" status: 204 len: 0 microversion: 2.1 time: 2.433847 Oct 30 01:28:30.583619 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1690/3387] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:28 2022] DELETE /compute/v2.1/images/dca8deb4-b525-42b4-860c-8ee77a764df8 => generated 0 bytes in 2437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:28:30.588846 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5cfc2bca-44d9-4bdd-a43e-fdf82e759326 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:30.589875 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5cfc2bca-44d9-4bdd-a43e-fdf82e759326 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d01c1c62-c352-4a98-b95b-51ff385a415e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:30.591457 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1697/3387] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:29 2022] GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f => generated 1322 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:30.610120 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:30.612348 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5cfc2bca-44d9-4bdd-a43e-fdf82e759326 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:30.613038 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7b3cb979-bbf7-4e93-88bb-34abc0cf1e9b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:30.614159 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7b3cb979-bbf7-4e93-88bb-34abc0cf1e9b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: b4259dcb-d421-45fb-84e6-7e8a8f7ce20d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:30.616923 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5cfc2bca-44d9-4bdd-a43e-fdf82e759326 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:30.618913 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5cfc2bca-44d9-4bdd-a43e-fdf82e759326 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:30.619559 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5cfc2bca-44d9-4bdd-a43e-fdf82e759326 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:30.620534 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5cfc2bca-44d9-4bdd-a43e-fdf82e759326 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:30.622172 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5cfc2bca-44d9-4bdd-a43e-fdf82e759326 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:30.639511 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b3cb979-bbf7-4e93-88bb-34abc0cf1e9b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:30.642171 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b3cb979-bbf7-4e93-88bb-34abc0cf1e9b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:30.643847 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b3cb979-bbf7-4e93-88bb-34abc0cf1e9b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:30.651298 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b3cb979-bbf7-4e93-88bb-34abc0cf1e9b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:30.652156 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b3cb979-bbf7-4e93-88bb-34abc0cf1e9b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:30.655068 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b3cb979-bbf7-4e93-88bb-34abc0cf1e9b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:30.767366 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7b3cb979-bbf7-4e93-88bb-34abc0cf1e9b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: b4259dcb-d421-45fb-84e6-7e8a8f7ce20d] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:28:31.174525 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5cfc2bca-44d9-4bdd-a43e-fdf82e759326 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:31.190495 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5cfc2bca-44d9-4bdd-a43e-fdf82e759326 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e" status: 200 len: 1505 microversion: 2.1 time: 0.605370 Oct 30 01:28:31.191275 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1691/3388] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:30 2022] GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e => generated 1505 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:31.223325 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7b3cb979-bbf7-4e93-88bb-34abc0cf1e9b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b4259dcb-d421-45fb-84e6-7e8a8f7ce20d" status: 204 len: 0 microversion: 2.1 time: 0.629357 Oct 30 01:28:31.226414 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1698/3389] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:28:30 2022] DELETE /compute/v2.1/servers/b4259dcb-d421-45fb-84e6-7e8a8f7ce20d => generated 0 bytes in 632 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:28:31.237898 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-61189d49-c5c2-4a18-8702-91caa85014d8 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:31.239873 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-61189d49-c5c2-4a18-8702-91caa85014d8 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:31.270166 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-61189d49-c5c2-4a18-8702-91caa85014d8 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:31.276904 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-61189d49-c5c2-4a18-8702-91caa85014d8 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:31.278518 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-61189d49-c5c2-4a18-8702-91caa85014d8 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:31.282546 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-61189d49-c5c2-4a18-8702-91caa85014d8 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:31.283203 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-61189d49-c5c2-4a18-8702-91caa85014d8 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:31.284812 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-61189d49-c5c2-4a18-8702-91caa85014d8 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:31.599956 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3420b6e0-fff3-4351-95a4-16c13bc9daba tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1556204089", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "e006438e-aba1-46be-a97a-88a3153fb746"}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:28:31.743528 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-3420b6e0-fff3-4351-95a4-16c13bc9daba tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] validate_networks() for [('e006438e-aba1-46be-a97a-88a3153fb746', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:28:32.508647 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-61189d49-c5c2-4a18-8702-91caa85014d8 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:32.529051 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-61189d49-c5c2-4a18-8702-91caa85014d8 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:32.531040 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-61189d49-c5c2-4a18-8702-91caa85014d8 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:32.553509 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-61189d49-c5c2-4a18-8702-91caa85014d8 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1751 microversion: 2.32 time: 1.322003 Oct 30 01:28:32.553509 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1692/3390] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:28:31 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1751 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:28:32.553509 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c26322ca-3384-406f-a45c-7d78856cdd25 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:32.565381 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c26322ca-3384-406f-a45c-7d78856cdd25 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 2873be88-5d85-49c6-833f-19b7df1fcf5f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:32.605552 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c26322ca-3384-406f-a45c-7d78856cdd25 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:32.608475 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c26322ca-3384-406f-a45c-7d78856cdd25 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:32.610125 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c26322ca-3384-406f-a45c-7d78856cdd25 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:32.612056 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c26322ca-3384-406f-a45c-7d78856cdd25 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:32.629786 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c26322ca-3384-406f-a45c-7d78856cdd25 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:32.630376 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c26322ca-3384-406f-a45c-7d78856cdd25 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:33.501893 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c26322ca-3384-406f-a45c-7d78856cdd25 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:33.521295 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c26322ca-3384-406f-a45c-7d78856cdd25 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f" status: 200 len: 1322 microversion: 2.1 time: 0.981902 Oct 30 01:28:33.526073 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1693/3391] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:32 2022] GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f => generated 1322 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:33.531526 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f242897d-ff28-4fc2-91c6-77958b29de72 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:33.542733 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f242897d-ff28-4fc2-91c6-77958b29de72 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d01c1c62-c352-4a98-b95b-51ff385a415e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:33.554217 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f242897d-ff28-4fc2-91c6-77958b29de72 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:33.554729 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f242897d-ff28-4fc2-91c6-77958b29de72 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:33.555169 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f242897d-ff28-4fc2-91c6-77958b29de72 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:33.555887 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f242897d-ff28-4fc2-91c6-77958b29de72 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:33.556340 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f242897d-ff28-4fc2-91c6-77958b29de72 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:33.560489 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f242897d-ff28-4fc2-91c6-77958b29de72 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:34.088343 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-3420b6e0-fff3-4351-95a4-16c13bc9daba tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:28:34.089769 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-3420b6e0-fff3-4351-95a4-16c13bc9daba tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:28:34.090460 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-3420b6e0-fff3-4351-95a4-16c13bc9daba tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:28:34.096815 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-3420b6e0-fff3-4351-95a4-16c13bc9daba tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:28:34.098036 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-3420b6e0-fff3-4351-95a4-16c13bc9daba tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:28:34.116403 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3420b6e0-fff3-4351-95a4-16c13bc9daba tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:34.117183 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3420b6e0-fff3-4351-95a4-16c13bc9daba tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:34.117958 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3420b6e0-fff3-4351-95a4-16c13bc9daba tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:34.119609 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3420b6e0-fff3-4351-95a4-16c13bc9daba tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:34.120269 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3420b6e0-fff3-4351-95a4-16c13bc9daba tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:34.120865 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3420b6e0-fff3-4351-95a4-16c13bc9daba tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:34.137291 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:34.158403 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-3420b6e0-fff3-4351-95a4-16c13bc9daba tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Getting quotas for project 4aa9c648b20d41d7b150fbf64cde6fe8. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:28:34.167286 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-3420b6e0-fff3-4351-95a4-16c13bc9daba tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Getting quotas for user f857d6b0826e47c6875a307e7ccfb104 and project 4aa9c648b20d41d7b150fbf64cde6fe8. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:28:34.202305 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3420b6e0-fff3-4351-95a4-16c13bc9daba tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:28:34.206184 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3420b6e0-fff3-4351-95a4-16c13bc9daba tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: fbbfb1ca-5624-4baf-b498-1f9b75c194cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:28:34.353786 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3420b6e0-fff3-4351-95a4-16c13bc9daba tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.758296 Oct 30 01:28:34.366658 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1699/3392] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:28:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 30 01:28:34.377049 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-89fa3b66-0b2a-4a9d-8669-b64f1f1d4f0e tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:34.377741 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-89fa3b66-0b2a-4a9d-8669-b64f1f1d4f0e tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:34.384702 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-89fa3b66-0b2a-4a9d-8669-b64f1f1d4f0e tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:34.388735 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-89fa3b66-0b2a-4a9d-8669-b64f1f1d4f0e tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:34.388735 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-89fa3b66-0b2a-4a9d-8669-b64f1f1d4f0e tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:34.388735 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-89fa3b66-0b2a-4a9d-8669-b64f1f1d4f0e tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:34.388987 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-89fa3b66-0b2a-4a9d-8669-b64f1f1d4f0e tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:34.389403 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-89fa3b66-0b2a-4a9d-8669-b64f1f1d4f0e tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:34.632487 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f242897d-ff28-4fc2-91c6-77958b29de72 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:34.676006 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f242897d-ff28-4fc2-91c6-77958b29de72 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e" status: 200 len: 1505 microversion: 2.1 time: 1.148582 Oct 30 01:28:34.681590 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1694/3393] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:33 2022] GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e => generated 1505 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:34.695287 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-17e2af6c-1492-4a4f-a597-52c4973d1257 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:34.696556 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-17e2af6c-1492-4a4f-a597-52c4973d1257 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: fbbfb1ca-5624-4baf-b498-1f9b75c194cb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:34.833572 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-17e2af6c-1492-4a4f-a597-52c4973d1257 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:34.846383 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-17e2af6c-1492-4a4f-a597-52c4973d1257 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/fbbfb1ca-5624-4baf-b498-1f9b75c194cb" status: 200 len: 1208 microversion: 2.1 time: 0.158781 Oct 30 01:28:34.870007 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1695/3394] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:34 2022] GET /compute/v2.1/servers/fbbfb1ca-5624-4baf-b498-1f9b75c194cb => generated 1208 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:34.880461 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e1f1380c-4c12-4b55-bc0d-52a65c2b07b8 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:34.881323 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e1f1380c-4c12-4b55-bc0d-52a65c2b07b8 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 2873be88-5d85-49c6-833f-19b7df1fcf5f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:34.926718 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e1f1380c-4c12-4b55-bc0d-52a65c2b07b8 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:34.927414 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e1f1380c-4c12-4b55-bc0d-52a65c2b07b8 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:34.928903 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e1f1380c-4c12-4b55-bc0d-52a65c2b07b8 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:34.936898 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e1f1380c-4c12-4b55-bc0d-52a65c2b07b8 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:34.939617 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e1f1380c-4c12-4b55-bc0d-52a65c2b07b8 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:34.940080 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e1f1380c-4c12-4b55-bc0d-52a65c2b07b8 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:35.263666 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-89fa3b66-0b2a-4a9d-8669-b64f1f1d4f0e tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:35.278514 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-89fa3b66-0b2a-4a9d-8669-b64f1f1d4f0e tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:35.284778 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-89fa3b66-0b2a-4a9d-8669-b64f1f1d4f0e tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:35.291651 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-89fa3b66-0b2a-4a9d-8669-b64f1f1d4f0e tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1797 microversion: 2.32 time: 0.921689 Oct 30 01:28:35.292542 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1700/3395] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:28:34 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1797 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:28:35.301634 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-898df92b-1ef3-4414-b021-777431d52927 req-97d5a699-b69f-4b47-98e2-a838690685c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28af596f-f044-4281-8106-4585fbde9a4a", "name": "network-vif-plugged", "status": "completed", "tag": "549f19a7-85dc-4d6e-b940-48f4f45b7e9a"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:28:35.325006 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-898df92b-1ef3-4414-b021-777431d52927 req-97d5a699-b69f-4b47-98e2-a838690685c5 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:35.325794 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-898df92b-1ef3-4414-b021-777431d52927 req-97d5a699-b69f-4b47-98e2-a838690685c5 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:35.330090 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-898df92b-1ef3-4414-b021-777431d52927 req-97d5a699-b69f-4b47-98e2-a838690685c5 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:35.351433 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-898df92b-1ef3-4414-b021-777431d52927 req-97d5a699-b69f-4b47-98e2-a838690685c5 service nova] Creating event network-vif-plugged:549f19a7-85dc-4d6e-b940-48f4f45b7e9a for instance 28af596f-f044-4281-8106-4585fbde9a4a on n-h2-master-1 Oct 30 01:28:35.372226 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-898df92b-1ef3-4414-b021-777431d52927 req-97d5a699-b69f-4b47-98e2-a838690685c5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077661 Oct 30 01:28:35.372827 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1701/3396] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:28:35.415877 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e1f1380c-4c12-4b55-bc0d-52a65c2b07b8 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:35.428641 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e1f1380c-4c12-4b55-bc0d-52a65c2b07b8 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f" status: 200 len: 1322 microversion: 2.1 time: 0.552644 Oct 30 01:28:35.434441 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1696/3397] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:34 2022] GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f => generated 1322 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:35.703795 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-481d551b-a122-43d8-b369-bc81a5665d11 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:35.704521 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-481d551b-a122-43d8-b369-bc81a5665d11 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d01c1c62-c352-4a98-b95b-51ff385a415e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:35.718434 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-481d551b-a122-43d8-b369-bc81a5665d11 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:35.719360 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-481d551b-a122-43d8-b369-bc81a5665d11 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:35.719984 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-481d551b-a122-43d8-b369-bc81a5665d11 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:35.720880 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-481d551b-a122-43d8-b369-bc81a5665d11 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:35.721523 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-481d551b-a122-43d8-b369-bc81a5665d11 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:35.722100 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-481d551b-a122-43d8-b369-bc81a5665d11 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:35.877302 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cc3a98ec-5f72-42d6-a196-5b2f456f6a8b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:35.877828 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cc3a98ec-5f72-42d6-a196-5b2f456f6a8b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: fbbfb1ca-5624-4baf-b498-1f9b75c194cb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:35.904893 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cc3a98ec-5f72-42d6-a196-5b2f456f6a8b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:35.905673 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cc3a98ec-5f72-42d6-a196-5b2f456f6a8b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:35.909079 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cc3a98ec-5f72-42d6-a196-5b2f456f6a8b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:35.910100 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cc3a98ec-5f72-42d6-a196-5b2f456f6a8b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:35.910777 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cc3a98ec-5f72-42d6-a196-5b2f456f6a8b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:35.911483 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cc3a98ec-5f72-42d6-a196-5b2f456f6a8b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:36.147806 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-cc3a98ec-5f72-42d6-a196-5b2f456f6a8b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:36.170652 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cc3a98ec-5f72-42d6-a196-5b2f456f6a8b tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/fbbfb1ca-5624-4baf-b498-1f9b75c194cb" status: 200 len: 1212 microversion: 2.1 time: 0.298359 Oct 30 01:28:36.179240 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1697/3398] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:35 2022] GET /compute/v2.1/servers/fbbfb1ca-5624-4baf-b498-1f9b75c194cb => generated 1212 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:36.210079 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-b68e934c-ca4a-4179-b112-d1e9fe7c6ddd req-e3580b57-4190-4708-933f-5ba7ff9e26d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4259dcb-d421-45fb-84e6-7e8a8f7ce20d", "name": "network-vif-deleted", "tag": "f4115819-6c96-4bc9-a7c1-221d92ea37ec"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:28:36.247154 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-481d551b-a122-43d8-b369-bc81a5665d11 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:36.269068 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-b68e934c-ca4a-4179-b112-d1e9fe7c6ddd req-e3580b57-4190-4708-933f-5ba7ff9e26d7 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:36.269068 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-b68e934c-ca4a-4179-b112-d1e9fe7c6ddd req-e3580b57-4190-4708-933f-5ba7ff9e26d7 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:36.269068 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-b68e934c-ca4a-4179-b112-d1e9fe7c6ddd req-e3580b57-4190-4708-933f-5ba7ff9e26d7 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:36.269411 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-481d551b-a122-43d8-b369-bc81a5665d11 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e" status: 200 len: 1505 microversion: 2.1 time: 0.570533 Oct 30 01:28:36.269913 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1702/3399] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:35 2022] GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e => generated 1505 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:36.301880 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-b68e934c-ca4a-4179-b112-d1e9fe7c6ddd req-e3580b57-4190-4708-933f-5ba7ff9e26d7 service nova] Creating event network-vif-deleted:f4115819-6c96-4bc9-a7c1-221d92ea37ec for instance b4259dcb-d421-45fb-84e6-7e8a8f7ce20d on n-h1-master-1 Oct 30 01:28:36.322884 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-b68e934c-ca4a-4179-b112-d1e9fe7c6ddd req-e3580b57-4190-4708-933f-5ba7ff9e26d7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117942 Oct 30 01:28:36.323622 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e41c5a0e-ea23-4b8a-a365-47fb4b97c78b tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:36.327399 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1698/3400] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:28:36.336126 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e41c5a0e-ea23-4b8a-a365-47fb4b97c78b tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:36.360073 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e41c5a0e-ea23-4b8a-a365-47fb4b97c78b tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:36.362854 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e41c5a0e-ea23-4b8a-a365-47fb4b97c78b tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:36.370865 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e41c5a0e-ea23-4b8a-a365-47fb4b97c78b tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:36.371994 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e41c5a0e-ea23-4b8a-a365-47fb4b97c78b tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:36.374128 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e41c5a0e-ea23-4b8a-a365-47fb4b97c78b tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:36.374784 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e41c5a0e-ea23-4b8a-a365-47fb4b97c78b tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:36.455517 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-29f33170-cecd-40c6-9df4-8e5cfa6fd8cf tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:36.457796 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-29f33170-cecd-40c6-9df4-8e5cfa6fd8cf tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 2873be88-5d85-49c6-833f-19b7df1fcf5f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:36.475723 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-29f33170-cecd-40c6-9df4-8e5cfa6fd8cf tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:36.477160 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-29f33170-cecd-40c6-9df4-8e5cfa6fd8cf tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:36.480497 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-29f33170-cecd-40c6-9df4-8e5cfa6fd8cf tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:36.487120 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-29f33170-cecd-40c6-9df4-8e5cfa6fd8cf tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:36.487880 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-29f33170-cecd-40c6-9df4-8e5cfa6fd8cf tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:36.494178 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-29f33170-cecd-40c6-9df4-8e5cfa6fd8cf tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:36.752324 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e41c5a0e-ea23-4b8a-a365-47fb4b97c78b tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:36.762762 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e41c5a0e-ea23-4b8a-a365-47fb4b97c78b tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:36.764420 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e41c5a0e-ea23-4b8a-a365-47fb4b97c78b tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:36.769832 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e41c5a0e-ea23-4b8a-a365-47fb4b97c78b tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1797 microversion: 2.32 time: 0.452054 Oct 30 01:28:36.770990 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1703/3401] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:28:36 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1797 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:28:37.199210 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d786e7ce-82df-4cbe-b386-29339dc64e62 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:37.200671 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d786e7ce-82df-4cbe-b386-29339dc64e62 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: fbbfb1ca-5624-4baf-b498-1f9b75c194cb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:37.210893 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d786e7ce-82df-4cbe-b386-29339dc64e62 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:37.211745 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d786e7ce-82df-4cbe-b386-29339dc64e62 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:37.223569 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d786e7ce-82df-4cbe-b386-29339dc64e62 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:37.226544 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d786e7ce-82df-4cbe-b386-29339dc64e62 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:37.226544 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d786e7ce-82df-4cbe-b386-29339dc64e62 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:37.232286 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d786e7ce-82df-4cbe-b386-29339dc64e62 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:37.584116 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-29f33170-cecd-40c6-9df4-8e5cfa6fd8cf tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:37.590161 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-29f33170-cecd-40c6-9df4-8e5cfa6fd8cf tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f" status: 200 len: 1322 microversion: 2.1 time: 1.136349 Oct 30 01:28:37.591784 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1699/3402] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:36 2022] GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f => generated 1322 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:28:37.612037 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e152103a-4d51-496a-8057-611188b83b2d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:37.615446 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e152103a-4d51-496a-8057-611188b83b2d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d01c1c62-c352-4a98-b95b-51ff385a415e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:37.632891 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e152103a-4d51-496a-8057-611188b83b2d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:37.636927 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e152103a-4d51-496a-8057-611188b83b2d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:37.638263 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e152103a-4d51-496a-8057-611188b83b2d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:37.639047 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e152103a-4d51-496a-8057-611188b83b2d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:37.639727 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e152103a-4d51-496a-8057-611188b83b2d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:37.645922 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e152103a-4d51-496a-8057-611188b83b2d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:37.679457 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d786e7ce-82df-4cbe-b386-29339dc64e62 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:37.691412 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d786e7ce-82df-4cbe-b386-29339dc64e62 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/fbbfb1ca-5624-4baf-b498-1f9b75c194cb" status: 200 len: 1260 microversion: 2.1 time: 0.498598 Oct 30 01:28:37.694848 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:37.702779 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1704/3403] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:37 2022] GET /compute/v2.1/servers/fbbfb1ca-5624-4baf-b498-1f9b75c194cb => generated 1260 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:28:38.167905 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-541c5932-51b7-4fe5-b33b-17ce9c010754 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Action: 'create', calling method: .version_select at 0x7f44c7bac4c0>, body: {"keypair": {"name": "tempest-keypair-2021072280", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA04RlOsaZKTsyeU3eMmBPlx4EpD1ChCTy0/lv1MvexTvs749pVZTjwv6TRsC9mUzgUhxSHLaTLZCMEx42oSfDY5SveMSjkFrIHospfdom26aHdiuV4+FN0uumSHsPftqw=="}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:28:38.174905 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e152103a-4d51-496a-8057-611188b83b2d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:38.186703 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e152103a-4d51-496a-8057-611188b83b2d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e" status: 200 len: 1505 microversion: 2.1 time: 0.593817 Oct 30 01:28:38.194024 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1700/3404] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:37 2022] GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e => generated 1505 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:38.206627 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b32d2bb5-3101-4494-a8fb-e67ffc2a76d2 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:38.207745 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b32d2bb5-3101-4494-a8fb-e67ffc2a76d2 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:38.215426 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-541c5932-51b7-4fe5-b33b-17ce9c010754 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Getting quotas for project 9d1e9b74043548e48a5bb8fb4d054803. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:28:38.221556 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b32d2bb5-3101-4494-a8fb-e67ffc2a76d2 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:38.222067 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b32d2bb5-3101-4494-a8fb-e67ffc2a76d2 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:38.222503 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b32d2bb5-3101-4494-a8fb-e67ffc2a76d2 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:38.224169 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-541c5932-51b7-4fe5-b33b-17ce9c010754 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Getting quotas for user 6b3394f28c4f444f8cd8bda6bacc9fc8 and project 9d1e9b74043548e48a5bb8fb4d054803. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:28:38.226320 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b32d2bb5-3101-4494-a8fb-e67ffc2a76d2 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:38.226811 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b32d2bb5-3101-4494-a8fb-e67ffc2a76d2 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:38.227296 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b32d2bb5-3101-4494-a8fb-e67ffc2a76d2 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:38.355164 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-541c5932-51b7-4fe5-b33b-17ce9c010754 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.645621 Oct 30 01:28:38.356808 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1705/3405] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 30 01:28:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:28:38.386565 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-8a799beb-ec50-46ec-a24f-5e885ee5fff1 req-a2a42ba1-0680-473e-abd1-a8cdfd139492 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2873be88-5d85-49c6-833f-19b7df1fcf5f", "name": "network-vif-plugged", "status": "completed", "tag": "f71f2c8b-6275-46ae-8dfd-8ce7b99e2529"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:28:38.403815 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-8a799beb-ec50-46ec-a24f-5e885ee5fff1 req-a2a42ba1-0680-473e-abd1-a8cdfd139492 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:38.404181 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-8a799beb-ec50-46ec-a24f-5e885ee5fff1 req-a2a42ba1-0680-473e-abd1-a8cdfd139492 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:38.409678 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-8a799beb-ec50-46ec-a24f-5e885ee5fff1 req-a2a42ba1-0680-473e-abd1-a8cdfd139492 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:38.440307 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-8a799beb-ec50-46ec-a24f-5e885ee5fff1 req-a2a42ba1-0680-473e-abd1-a8cdfd139492 service nova] Creating event network-vif-plugged:f71f2c8b-6275-46ae-8dfd-8ce7b99e2529 for instance 2873be88-5d85-49c6-833f-19b7df1fcf5f on n-h1-master-1 Oct 30 01:28:38.452380 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-8a799beb-ec50-46ec-a24f-5e885ee5fff1 req-a2a42ba1-0680-473e-abd1-a8cdfd139492 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069344 Oct 30 01:28:38.453253 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1706/3406] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:28:38.618648 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8f7bcb42-82bd-48ac-8b32-58e2bb3e75de tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:38.619607 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8f7bcb42-82bd-48ac-8b32-58e2bb3e75de tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 2873be88-5d85-49c6-833f-19b7df1fcf5f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:38.636905 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f7bcb42-82bd-48ac-8b32-58e2bb3e75de tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:38.642626 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f7bcb42-82bd-48ac-8b32-58e2bb3e75de tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:38.642626 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f7bcb42-82bd-48ac-8b32-58e2bb3e75de tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:38.642626 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f7bcb42-82bd-48ac-8b32-58e2bb3e75de tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:38.645276 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f7bcb42-82bd-48ac-8b32-58e2bb3e75de tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:38.647091 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f7bcb42-82bd-48ac-8b32-58e2bb3e75de tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:39.359286 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b32d2bb5-3101-4494-a8fb-e67ffc2a76d2 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:39.387577 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b32d2bb5-3101-4494-a8fb-e67ffc2a76d2 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:39.397912 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b32d2bb5-3101-4494-a8fb-e67ffc2a76d2 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:39.400557 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b32d2bb5-3101-4494-a8fb-e67ffc2a76d2 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1843 microversion: 2.32 time: 1.203310 Oct 30 01:28:39.404784 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1701/3407] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:28:38 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1843 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:28:39.423509 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-66c85ec8-d647-4ebc-a1c5-d507a1bf98fc tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:39.423509 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-66c85ec8-d647-4ebc-a1c5-d507a1bf98fc tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: fbbfb1ca-5624-4baf-b498-1f9b75c194cb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:39.441048 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-66c85ec8-d647-4ebc-a1c5-d507a1bf98fc tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:39.446492 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-66c85ec8-d647-4ebc-a1c5-d507a1bf98fc tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:39.447651 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-66c85ec8-d647-4ebc-a1c5-d507a1bf98fc tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:39.451714 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-66c85ec8-d647-4ebc-a1c5-d507a1bf98fc tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:39.453608 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-66c85ec8-d647-4ebc-a1c5-d507a1bf98fc tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:39.455069 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-66c85ec8-d647-4ebc-a1c5-d507a1bf98fc tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:39.513355 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8f7bcb42-82bd-48ac-8b32-58e2bb3e75de tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:39.525681 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8f7bcb42-82bd-48ac-8b32-58e2bb3e75de tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f" status: 200 len: 1322 microversion: 2.1 time: 0.910683 Oct 30 01:28:39.527699 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1707/3408] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:38 2022] GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f => generated 1322 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:28:39.540557 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-59f32d71-ef55-4968-b9c1-3b1987371c4b tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:39.545482 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-59f32d71-ef55-4968-b9c1-3b1987371c4b tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d01c1c62-c352-4a98-b95b-51ff385a415e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:39.553801 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-59f32d71-ef55-4968-b9c1-3b1987371c4b tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:39.555020 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-59f32d71-ef55-4968-b9c1-3b1987371c4b tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:39.555687 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-59f32d71-ef55-4968-b9c1-3b1987371c4b tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:39.565025 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-59f32d71-ef55-4968-b9c1-3b1987371c4b tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:39.565714 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-59f32d71-ef55-4968-b9c1-3b1987371c4b tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:39.566386 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-59f32d71-ef55-4968-b9c1-3b1987371c4b tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:39.707642 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-66c85ec8-d647-4ebc-a1c5-d507a1bf98fc tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:39.730789 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-66c85ec8-d647-4ebc-a1c5-d507a1bf98fc tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/fbbfb1ca-5624-4baf-b498-1f9b75c194cb" status: 200 len: 1266 microversion: 2.1 time: 0.321437 Oct 30 01:28:39.731389 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1702/3409] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:39 2022] GET /compute/v2.1/servers/fbbfb1ca-5624-4baf-b498-1f9b75c194cb => generated 1266 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:40.075152 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-59f32d71-ef55-4968-b9c1-3b1987371c4b tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:40.086528 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-59f32d71-ef55-4968-b9c1-3b1987371c4b tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e" status: 200 len: 1505 microversion: 2.1 time: 0.556962 Oct 30 01:28:40.087295 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1708/3410] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:39 2022] GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e => generated 1505 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:40.434693 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-41ffde0c-a643-46df-bf95-8c89be4036d1 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:40.436010 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-41ffde0c-a643-46df-bf95-8c89be4036d1 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:40.456534 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-41ffde0c-a643-46df-bf95-8c89be4036d1 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:40.474347 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-41ffde0c-a643-46df-bf95-8c89be4036d1 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:40.474347 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-41ffde0c-a643-46df-bf95-8c89be4036d1 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:40.474347 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-41ffde0c-a643-46df-bf95-8c89be4036d1 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:40.474347 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-41ffde0c-a643-46df-bf95-8c89be4036d1 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:40.474347 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-41ffde0c-a643-46df-bf95-8c89be4036d1 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:40.475884 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-99ddf210-715e-4d18-900b-c647d75f1a3e req-930901c8-b627-4008-b179-3bdc42c04f86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71a745a1-eaaf-4b96-8ed1-05e574cf4018", "tag": "0768b27f-1e71-4099-8b05-caf0bb6c7954"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:28:40.496879 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-99ddf210-715e-4d18-900b-c647d75f1a3e req-930901c8-b627-4008-b179-3bdc42c04f86 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:40.501047 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-99ddf210-715e-4d18-900b-c647d75f1a3e req-930901c8-b627-4008-b179-3bdc42c04f86 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:40.501938 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-99ddf210-715e-4d18-900b-c647d75f1a3e req-930901c8-b627-4008-b179-3bdc42c04f86 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:40.539130 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-99ddf210-715e-4d18-900b-c647d75f1a3e req-930901c8-b627-4008-b179-3bdc42c04f86 service nova] Creating event network-changed:0768b27f-1e71-4099-8b05-caf0bb6c7954 for instance 71a745a1-eaaf-4b96-8ed1-05e574cf4018 on n-h2-master-1 Oct 30 01:28:40.596436 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-99ddf210-715e-4d18-900b-c647d75f1a3e req-930901c8-b627-4008-b179-3bdc42c04f86 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133384 Oct 30 01:28:40.598262 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1709/3411] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:28:40.605868 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-520d3745-b09f-4785-bf05-80d709709fdd tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:40.606978 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-520d3745-b09f-4785-bf05-80d709709fdd tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 2873be88-5d85-49c6-833f-19b7df1fcf5f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:40.617747 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-520d3745-b09f-4785-bf05-80d709709fdd tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:40.618577 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-520d3745-b09f-4785-bf05-80d709709fdd tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:40.619354 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-520d3745-b09f-4785-bf05-80d709709fdd tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:40.620361 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-520d3745-b09f-4785-bf05-80d709709fdd tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:40.621057 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-520d3745-b09f-4785-bf05-80d709709fdd tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:40.628570 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-520d3745-b09f-4785-bf05-80d709709fdd tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:41.030266 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-41ffde0c-a643-46df-bf95-8c89be4036d1 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:41.044378 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-41ffde0c-a643-46df-bf95-8c89be4036d1 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:41.049364 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-520d3745-b09f-4785-bf05-80d709709fdd tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:41.061806 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-41ffde0c-a643-46df-bf95-8c89be4036d1 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:41.065090 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-41ffde0c-a643-46df-bf95-8c89be4036d1 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1843 microversion: 2.32 time: 0.634416 Oct 30 01:28:41.065764 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-520d3745-b09f-4785-bf05-80d709709fdd tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f" status: 200 len: 1322 microversion: 2.1 time: 0.461399 Oct 30 01:28:41.066848 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1710/3412] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:40 2022] GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f => generated 1322 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:41.071566 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1703/3413] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:28:40 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1843 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:28:41.083537 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3b30cd65-a03f-492e-b97a-881a93eabde6 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:41.084670 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3b30cd65-a03f-492e-b97a-881a93eabde6 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: fbbfb1ca-5624-4baf-b498-1f9b75c194cb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:41.099463 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b30cd65-a03f-492e-b97a-881a93eabde6 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:41.102227 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b30cd65-a03f-492e-b97a-881a93eabde6 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:41.103737 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b30cd65-a03f-492e-b97a-881a93eabde6 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:41.109758 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-40958591-f1c7-413a-8177-f05174140966 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:41.111190 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-40958591-f1c7-413a-8177-f05174140966 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d01c1c62-c352-4a98-b95b-51ff385a415e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:41.122642 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b30cd65-a03f-492e-b97a-881a93eabde6 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:41.123874 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b30cd65-a03f-492e-b97a-881a93eabde6 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:41.130322 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b30cd65-a03f-492e-b97a-881a93eabde6 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:41.130432 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-40958591-f1c7-413a-8177-f05174140966 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:41.130432 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-40958591-f1c7-413a-8177-f05174140966 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:41.130432 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-40958591-f1c7-413a-8177-f05174140966 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:41.137939 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-40958591-f1c7-413a-8177-f05174140966 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:41.141681 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-40958591-f1c7-413a-8177-f05174140966 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:41.142786 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-40958591-f1c7-413a-8177-f05174140966 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:41.792533 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3b30cd65-a03f-492e-b97a-881a93eabde6 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:41.815354 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3b30cd65-a03f-492e-b97a-881a93eabde6 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/fbbfb1ca-5624-4baf-b498-1f9b75c194cb" status: 200 len: 1308 microversion: 2.1 time: 0.745730 Oct 30 01:28:41.820723 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1711/3414] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:41 2022] GET /compute/v2.1/servers/fbbfb1ca-5624-4baf-b498-1f9b75c194cb => generated 1308 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:41.827223 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-40958591-f1c7-413a-8177-f05174140966 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:41.847712 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-40958591-f1c7-413a-8177-f05174140966 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e" status: 200 len: 1505 microversion: 2.1 time: 0.741732 Oct 30 01:28:41.848340 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1704/3415] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:41 2022] GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e => generated 1505 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:28:42.095150 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-796256a4-c540-4132-beb7-7bcc714aa65c tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:42.095881 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-796256a4-c540-4132-beb7-7bcc714aa65c tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 2873be88-5d85-49c6-833f-19b7df1fcf5f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:42.102890 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f6758766-f45f-47bd-a3e0-18686099dfd6 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:42.104669 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f6758766-f45f-47bd-a3e0-18686099dfd6 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:42.121281 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-796256a4-c540-4132-beb7-7bcc714aa65c tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:42.123668 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-796256a4-c540-4132-beb7-7bcc714aa65c tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:42.124153 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-796256a4-c540-4132-beb7-7bcc714aa65c tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:42.128112 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f6758766-f45f-47bd-a3e0-18686099dfd6 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:42.129123 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-796256a4-c540-4132-beb7-7bcc714aa65c tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:42.131351 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f6758766-f45f-47bd-a3e0-18686099dfd6 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:42.131832 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-796256a4-c540-4132-beb7-7bcc714aa65c tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:42.134801 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f6758766-f45f-47bd-a3e0-18686099dfd6 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:42.140974 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-796256a4-c540-4132-beb7-7bcc714aa65c tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:42.141212 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f6758766-f45f-47bd-a3e0-18686099dfd6 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:42.141212 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f6758766-f45f-47bd-a3e0-18686099dfd6 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:42.141212 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f6758766-f45f-47bd-a3e0-18686099dfd6 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:42.796098 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-796256a4-c540-4132-beb7-7bcc714aa65c tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:42.806681 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-796256a4-c540-4132-beb7-7bcc714aa65c tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f" status: 200 len: 1517 microversion: 2.1 time: 0.716521 Oct 30 01:28:42.813194 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1712/3416] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:42 2022] GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f => generated 1517 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:42.837833 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a68b2cfd-c679-4ba6-9529-7f71723fd2e9 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:28:42.840179 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a68b2cfd-c679-4ba6-9529-7f71723fd2e9 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 2873be88-5d85-49c6-833f-19b7df1fcf5f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:42.871912 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a68b2cfd-c679-4ba6-9529-7f71723fd2e9 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:42.871912 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a68b2cfd-c679-4ba6-9529-7f71723fd2e9 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:42.871912 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a68b2cfd-c679-4ba6-9529-7f71723fd2e9 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:42.871912 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a68b2cfd-c679-4ba6-9529-7f71723fd2e9 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:42.871912 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a68b2cfd-c679-4ba6-9529-7f71723fd2e9 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:42.871912 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a68b2cfd-c679-4ba6-9529-7f71723fd2e9 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:42.957706 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-a68b2cfd-c679-4ba6-9529-7f71723fd2e9 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lazy-loading 'flavor' on Instance uuid 2873be88-5d85-49c6-833f-19b7df1fcf5f {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:28:43.015163 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f6758766-f45f-47bd-a3e0-18686099dfd6 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:43.042730 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f6758766-f45f-47bd-a3e0-18686099dfd6 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:43.045802 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f6758766-f45f-47bd-a3e0-18686099dfd6 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:43.051171 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f6758766-f45f-47bd-a3e0-18686099dfd6 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1864 microversion: 2.32 time: 0.953528 Oct 30 01:28:43.053642 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1705/3417] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:28:42 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1864 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:28:43.079695 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-62de2473-48ff-4f80-b9b7-0e258550ba09 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:43.080620 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-62de2473-48ff-4f80-b9b7-0e258550ba09 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: fbbfb1ca-5624-4baf-b498-1f9b75c194cb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:43.097234 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-62de2473-48ff-4f80-b9b7-0e258550ba09 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:43.098017 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-62de2473-48ff-4f80-b9b7-0e258550ba09 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:43.098462 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-62de2473-48ff-4f80-b9b7-0e258550ba09 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:43.099175 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-62de2473-48ff-4f80-b9b7-0e258550ba09 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:43.099630 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-62de2473-48ff-4f80-b9b7-0e258550ba09 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:43.100045 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-62de2473-48ff-4f80-b9b7-0e258550ba09 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:43.316797 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-62de2473-48ff-4f80-b9b7-0e258550ba09 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:43.326031 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-62de2473-48ff-4f80-b9b7-0e258550ba09 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/fbbfb1ca-5624-4baf-b498-1f9b75c194cb" status: 200 len: 1308 microversion: 2.1 time: 0.271104 Oct 30 01:28:43.338692 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1706/3418] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:43 2022] GET /compute/v2.1/servers/fbbfb1ca-5624-4baf-b498-1f9b75c194cb => generated 1308 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:43.349832 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-82706dd8-69df-4aa4-8e7c-b40946fd5ad8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:43.350738 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-82706dd8-69df-4aa4-8e7c-b40946fd5ad8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d01c1c62-c352-4a98-b95b-51ff385a415e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:43.357851 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-82706dd8-69df-4aa4-8e7c-b40946fd5ad8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:43.359340 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-82706dd8-69df-4aa4-8e7c-b40946fd5ad8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:43.364209 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-82706dd8-69df-4aa4-8e7c-b40946fd5ad8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:43.364209 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-82706dd8-69df-4aa4-8e7c-b40946fd5ad8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:43.364209 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-82706dd8-69df-4aa4-8e7c-b40946fd5ad8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:43.364209 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-82706dd8-69df-4aa4-8e7c-b40946fd5ad8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:43.626385 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a68b2cfd-c679-4ba6-9529-7f71723fd2e9 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "POST /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f/action" status: 200 len: 32 microversion: 2.1 time: 0.792725 Oct 30 01:28:43.627368 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1713/3419] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:28:42 2022] POST /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f/action => generated 32 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 30 01:28:43.637807 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-50d3127b-d4fe-44d8-93d8-fe4c32d0af3a req-11110df1-7525-4118-97c4-9ecd6d52d2df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71a745a1-eaaf-4b96-8ed1-05e574cf4018", "tag": "66e47ab9-7e05-48f9-9e49-e60474216b03"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:28:43.668633 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-50d3127b-d4fe-44d8-93d8-fe4c32d0af3a req-11110df1-7525-4118-97c4-9ecd6d52d2df service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:43.678083 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-50d3127b-d4fe-44d8-93d8-fe4c32d0af3a req-11110df1-7525-4118-97c4-9ecd6d52d2df service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:43.683475 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-50d3127b-d4fe-44d8-93d8-fe4c32d0af3a req-11110df1-7525-4118-97c4-9ecd6d52d2df service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:43.710207 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-82706dd8-69df-4aa4-8e7c-b40946fd5ad8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:43.716365 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-50d3127b-d4fe-44d8-93d8-fe4c32d0af3a req-11110df1-7525-4118-97c4-9ecd6d52d2df service nova] Creating event network-changed:66e47ab9-7e05-48f9-9e49-e60474216b03 for instance 71a745a1-eaaf-4b96-8ed1-05e574cf4018 on n-h2-master-1 Oct 30 01:28:43.731889 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-50d3127b-d4fe-44d8-93d8-fe4c32d0af3a req-11110df1-7525-4118-97c4-9ecd6d52d2df service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102186 Oct 30 01:28:43.731889 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1714/3420] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:28:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:28:43.737565 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ac038411-114b-49f4-8e0b-63661a131b7e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:43.739735 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-82706dd8-69df-4aa4-8e7c-b40946fd5ad8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e" status: 200 len: 1505 microversion: 2.1 time: 0.399456 Oct 30 01:28:43.740329 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1707/3421] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:43 2022] GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e => generated 1505 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:43.742364 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ac038411-114b-49f4-8e0b-63661a131b7e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 2873be88-5d85-49c6-833f-19b7df1fcf5f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:43.765514 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ac038411-114b-49f4-8e0b-63661a131b7e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:43.767689 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ac038411-114b-49f4-8e0b-63661a131b7e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:43.768727 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ac038411-114b-49f4-8e0b-63661a131b7e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:43.772290 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ac038411-114b-49f4-8e0b-63661a131b7e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:43.772863 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ac038411-114b-49f4-8e0b-63661a131b7e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:43.775228 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ac038411-114b-49f4-8e0b-63661a131b7e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:44.081186 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3f69c743-3b6c-4117-bc70-da118aef0f2a tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:44.083104 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3f69c743-3b6c-4117-bc70-da118aef0f2a tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:44.095166 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f69c743-3b6c-4117-bc70-da118aef0f2a tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:44.095989 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f69c743-3b6c-4117-bc70-da118aef0f2a tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:44.107382 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f69c743-3b6c-4117-bc70-da118aef0f2a tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:44.108657 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f69c743-3b6c-4117-bc70-da118aef0f2a tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:44.110044 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f69c743-3b6c-4117-bc70-da118aef0f2a tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:44.110725 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f69c743-3b6c-4117-bc70-da118aef0f2a tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:44.137717 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:44.225670 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ac038411-114b-49f4-8e0b-63661a131b7e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:44.237530 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ac038411-114b-49f4-8e0b-63661a131b7e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f" status: 200 len: 1523 microversion: 2.1 time: 0.503859 Oct 30 01:28:44.239263 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1715/3422] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:43 2022] GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f => generated 1523 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:44.353765 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a0a5a2d3-14ec-4b2d-b3ac-dfa1f476eee1 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:44.354590 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a0a5a2d3-14ec-4b2d-b3ac-dfa1f476eee1 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: fbbfb1ca-5624-4baf-b498-1f9b75c194cb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:44.367591 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:44.367591 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a0a5a2d3-14ec-4b2d-b3ac-dfa1f476eee1 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:44.367591 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a0a5a2d3-14ec-4b2d-b3ac-dfa1f476eee1 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:44.367591 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a0a5a2d3-14ec-4b2d-b3ac-dfa1f476eee1 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:44.369104 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a0a5a2d3-14ec-4b2d-b3ac-dfa1f476eee1 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:44.369808 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a0a5a2d3-14ec-4b2d-b3ac-dfa1f476eee1 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:44.371065 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a0a5a2d3-14ec-4b2d-b3ac-dfa1f476eee1 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:44.650706 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3f69c743-3b6c-4117-bc70-da118aef0f2a tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:44.662285 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3f69c743-3b6c-4117-bc70-da118aef0f2a tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:44.663722 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3f69c743-3b6c-4117-bc70-da118aef0f2a tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:44.665549 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3f69c743-3b6c-4117-bc70-da118aef0f2a tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1864 microversion: 2.32 time: 0.588197 Oct 30 01:28:44.673858 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1708/3423] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:28:44 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1864 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:28:44.691200 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a0a5a2d3-14ec-4b2d-b3ac-dfa1f476eee1 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:44.710591 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a0a5a2d3-14ec-4b2d-b3ac-dfa1f476eee1 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/fbbfb1ca-5624-4baf-b498-1f9b75c194cb" status: 200 len: 1308 microversion: 2.1 time: 0.361904 Oct 30 01:28:44.713170 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1716/3424] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:44 2022] GET /compute/v2.1/servers/fbbfb1ca-5624-4baf-b498-1f9b75c194cb => generated 1308 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:28:44.765879 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d478bc26-80ad-4304-afde-1e531c433028 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:44.770165 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d478bc26-80ad-4304-afde-1e531c433028 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d01c1c62-c352-4a98-b95b-51ff385a415e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:44.778492 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d478bc26-80ad-4304-afde-1e531c433028 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:44.779284 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d478bc26-80ad-4304-afde-1e531c433028 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:44.780973 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d478bc26-80ad-4304-afde-1e531c433028 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:44.784378 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d478bc26-80ad-4304-afde-1e531c433028 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:44.785048 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d478bc26-80ad-4304-afde-1e531c433028 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:44.785716 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d478bc26-80ad-4304-afde-1e531c433028 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:44.840167 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:45.262740 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b187d425-86d7-40dd-b4ab-51400870db1f tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:45.263361 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b187d425-86d7-40dd-b4ab-51400870db1f tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 2873be88-5d85-49c6-833f-19b7df1fcf5f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:45.276495 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b187d425-86d7-40dd-b4ab-51400870db1f tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:45.281290 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b187d425-86d7-40dd-b4ab-51400870db1f tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:45.281290 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b187d425-86d7-40dd-b4ab-51400870db1f tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:45.282342 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b187d425-86d7-40dd-b4ab-51400870db1f tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:45.283617 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b187d425-86d7-40dd-b4ab-51400870db1f tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:45.285844 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b187d425-86d7-40dd-b4ab-51400870db1f tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:45.550200 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d478bc26-80ad-4304-afde-1e531c433028 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:45.563977 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d478bc26-80ad-4304-afde-1e531c433028 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e" status: 200 len: 1505 microversion: 2.1 time: 0.798194 Oct 30 01:28:45.565797 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1709/3425] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:44 2022] GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e => generated 1505 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:45.651584 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-e57b984a-f2aa-4f66-b206-72482e5b220e req-68b6b5d6-b3b6-42e5-ace5-7c509efa8128 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbbfb1ca-5624-4baf-b498-1f9b75c194cb", "tag": "d7ec7460-259d-41ae-87e0-75972e297800"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:28:45.679660 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-e57b984a-f2aa-4f66-b206-72482e5b220e req-68b6b5d6-b3b6-42e5-ace5-7c509efa8128 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:45.680677 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-e57b984a-f2aa-4f66-b206-72482e5b220e req-68b6b5d6-b3b6-42e5-ace5-7c509efa8128 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:45.684286 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-e57b984a-f2aa-4f66-b206-72482e5b220e req-68b6b5d6-b3b6-42e5-ace5-7c509efa8128 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:45.715881 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-e57b984a-f2aa-4f66-b206-72482e5b220e req-68b6b5d6-b3b6-42e5-ace5-7c509efa8128 service nova] Creating event network-changed:d7ec7460-259d-41ae-87e0-75972e297800 for instance fbbfb1ca-5624-4baf-b498-1f9b75c194cb on n-h2-master-1 Oct 30 01:28:45.730566 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-e57b984a-f2aa-4f66-b206-72482e5b220e req-68b6b5d6-b3b6-42e5-ace5-7c509efa8128 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082857 Oct 30 01:28:45.734905 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1710/3426] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:28:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:28:45.746744 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6b252588-4592-4622-a5f1-1d55cdf3d76a tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:45.747820 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6b252588-4592-4622-a5f1-1d55cdf3d76a tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:45.771689 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b252588-4592-4622-a5f1-1d55cdf3d76a tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:45.775925 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b252588-4592-4622-a5f1-1d55cdf3d76a tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:45.775925 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b252588-4592-4622-a5f1-1d55cdf3d76a tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:45.775925 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b252588-4592-4622-a5f1-1d55cdf3d76a tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:45.777576 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b252588-4592-4622-a5f1-1d55cdf3d76a tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:45.778942 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b252588-4592-4622-a5f1-1d55cdf3d76a tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:46.002062 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b187d425-86d7-40dd-b4ab-51400870db1f tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:46.060196 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b187d425-86d7-40dd-b4ab-51400870db1f tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f" status: 200 len: 1523 microversion: 2.1 time: 0.794832 Oct 30 01:28:46.061434 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1717/3427] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:45 2022] GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f => generated 1523 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:28:46.077701 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a2e50b5b-142d-4633-9849-f64cc0134c6c tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:46.079980 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a2e50b5b-142d-4633-9849-f64cc0134c6c tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: fbbfb1ca-5624-4baf-b498-1f9b75c194cb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:46.103074 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a2e50b5b-142d-4633-9849-f64cc0134c6c tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:46.104212 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a2e50b5b-142d-4633-9849-f64cc0134c6c tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:46.105937 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a2e50b5b-142d-4633-9849-f64cc0134c6c tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:46.108382 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a2e50b5b-142d-4633-9849-f64cc0134c6c tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:46.110075 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a2e50b5b-142d-4633-9849-f64cc0134c6c tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:46.112353 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a2e50b5b-142d-4633-9849-f64cc0134c6c tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:46.125798 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:46.538143 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6b252588-4592-4622-a5f1-1d55cdf3d76a tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:46.564455 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6b252588-4592-4622-a5f1-1d55cdf3d76a tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:46.566193 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6b252588-4592-4622-a5f1-1d55cdf3d76a tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:46.567405 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6b252588-4592-4622-a5f1-1d55cdf3d76a tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1885 microversion: 2.32 time: 0.827822 Oct 30 01:28:46.569576 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1711/3428] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:28:45 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1885 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:28:46.595344 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-f02de26b-6b05-4d99-9721-b1df4437a746 req-8f9be68a-0943-4929-aef2-c7f1d9461ecf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71a745a1-eaaf-4b96-8ed1-05e574cf4018", "tag": "89620a1f-327c-4185-81a0-292dbf3e67b4"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:28:46.612879 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-f02de26b-6b05-4d99-9721-b1df4437a746 req-8f9be68a-0943-4929-aef2-c7f1d9461ecf service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:46.613818 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-f02de26b-6b05-4d99-9721-b1df4437a746 req-8f9be68a-0943-4929-aef2-c7f1d9461ecf service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:46.614687 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-f02de26b-6b05-4d99-9721-b1df4437a746 req-8f9be68a-0943-4929-aef2-c7f1d9461ecf service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:46.635569 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-f02de26b-6b05-4d99-9721-b1df4437a746 req-8f9be68a-0943-4929-aef2-c7f1d9461ecf service nova] Creating event network-changed:89620a1f-327c-4185-81a0-292dbf3e67b4 for instance 71a745a1-eaaf-4b96-8ed1-05e574cf4018 on n-h2-master-1 Oct 30 01:28:46.655664 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-f02de26b-6b05-4d99-9721-b1df4437a746 req-8f9be68a-0943-4929-aef2-c7f1d9461ecf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077153 Oct 30 01:28:46.655664 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1712/3429] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:28:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:28:46.658788 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ec7d7bd9-1d07-4ecb-a29e-8adfdbe45df8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:46.659693 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ec7d7bd9-1d07-4ecb-a29e-8adfdbe45df8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d01c1c62-c352-4a98-b95b-51ff385a415e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:46.672768 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ec7d7bd9-1d07-4ecb-a29e-8adfdbe45df8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:46.673605 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ec7d7bd9-1d07-4ecb-a29e-8adfdbe45df8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:46.674419 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ec7d7bd9-1d07-4ecb-a29e-8adfdbe45df8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:46.675361 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ec7d7bd9-1d07-4ecb-a29e-8adfdbe45df8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:46.676127 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ec7d7bd9-1d07-4ecb-a29e-8adfdbe45df8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:46.676769 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ec7d7bd9-1d07-4ecb-a29e-8adfdbe45df8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:47.106401 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a2e50b5b-142d-4633-9849-f64cc0134c6c tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:47.127850 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a2e50b5b-142d-4633-9849-f64cc0134c6c tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/fbbfb1ca-5624-4baf-b498-1f9b75c194cb" status: 200 len: 1308 microversion: 2.1 time: 1.063390 Oct 30 01:28:47.130066 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1718/3430] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:46 2022] GET /compute/v2.1/servers/fbbfb1ca-5624-4baf-b498-1f9b75c194cb => generated 1308 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:47.147119 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-03394bc2-17ea-4e63-9288-1ffacedc6f86 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-979321247", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "ce60b63c-8e94-414e-adf1-0d89c66f3a57"}], "security_groups": [{"name": "tempest-securitygroup--1255431055"}], "key_name": "tempest-keypair-2021072280", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:28:47.276533 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ec7d7bd9-1d07-4ecb-a29e-8adfdbe45df8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:47.295517 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ec7d7bd9-1d07-4ecb-a29e-8adfdbe45df8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e" status: 200 len: 1485 microversion: 2.1 time: 0.640040 Oct 30 01:28:47.296150 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1713/3431] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:46 2022] GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e => generated 1485 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:47.306262 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-df9051e9-3177-4670-8f77-61d37a9d45cc tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:47.307334 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-df9051e9-3177-4670-8f77-61d37a9d45cc tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 2873be88-5d85-49c6-833f-19b7df1fcf5f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:47.329892 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df9051e9-3177-4670-8f77-61d37a9d45cc tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:47.330966 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df9051e9-3177-4670-8f77-61d37a9d45cc tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:47.333103 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df9051e9-3177-4670-8f77-61d37a9d45cc tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:47.334908 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df9051e9-3177-4670-8f77-61d37a9d45cc tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:47.338537 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df9051e9-3177-4670-8f77-61d37a9d45cc tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:47.339169 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df9051e9-3177-4670-8f77-61d37a9d45cc tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:47.617320 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-03394bc2-17ea-4e63-9288-1ffacedc6f86 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] validate_networks() for [('ce60b63c-8e94-414e-adf1-0d89c66f3a57', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:28:47.862462 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-df9051e9-3177-4670-8f77-61d37a9d45cc tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:47.874087 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-df9051e9-3177-4670-8f77-61d37a9d45cc tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f" status: 200 len: 1523 microversion: 2.1 time: 0.576592 Oct 30 01:28:47.874683 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1714/3432] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:47 2022] GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f => generated 1523 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:47.889908 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-78e54e96-ac02-48d6-993e-b4f1b6e12f6a tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1352177584", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:28:47.993636 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-78e54e96-ac02-48d6-993e-b4f1b6e12f6a tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] validate_networks() for [('962141bf-6c4a-46ef-9422-1942c62b4795', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:28:48.236420 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=10 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:49.053433 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-03394bc2-17ea-4e63-9288-1ffacedc6f86 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Getting quotas for project 9d1e9b74043548e48a5bb8fb4d054803. Resources: dict_keys(['metadata_items']) {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:28:49.062818 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-03394bc2-17ea-4e63-9288-1ffacedc6f86 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Getting quotas for user 6b3394f28c4f444f8cd8bda6bacc9fc8 and project 9d1e9b74043548e48a5bb8fb4d054803. Resources: dict_keys(['metadata_items']) {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:28:49.082336 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-03394bc2-17ea-4e63-9288-1ffacedc6f86 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:28:49.082974 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-03394bc2-17ea-4e63-9288-1ffacedc6f86 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:28:49.083688 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-03394bc2-17ea-4e63-9288-1ffacedc6f86 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:28:49.084256 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-03394bc2-17ea-4e63-9288-1ffacedc6f86 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:28:49.084878 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-03394bc2-17ea-4e63-9288-1ffacedc6f86 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:28:49.095706 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-03394bc2-17ea-4e63-9288-1ffacedc6f86 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:49.096516 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-03394bc2-17ea-4e63-9288-1ffacedc6f86 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:49.098103 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-03394bc2-17ea-4e63-9288-1ffacedc6f86 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:49.099109 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-03394bc2-17ea-4e63-9288-1ffacedc6f86 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:49.099734 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-03394bc2-17ea-4e63-9288-1ffacedc6f86 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:49.100378 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-03394bc2-17ea-4e63-9288-1ffacedc6f86 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:49.130413 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-03394bc2-17ea-4e63-9288-1ffacedc6f86 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Getting quotas for project 9d1e9b74043548e48a5bb8fb4d054803. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:28:49.136701 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-03394bc2-17ea-4e63-9288-1ffacedc6f86 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Getting quotas for user 6b3394f28c4f444f8cd8bda6bacc9fc8 and project 9d1e9b74043548e48a5bb8fb4d054803. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:28:49.153193 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-03394bc2-17ea-4e63-9288-1ffacedc6f86 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:28:49.156588 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-03394bc2-17ea-4e63-9288-1ffacedc6f86 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] [instance: 0bddfccb-0dc7-430f-88b6-41e25e23d934] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:28:49.206552 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-78e54e96-ac02-48d6-993e-b4f1b6e12f6a tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:28:49.207637 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-78e54e96-ac02-48d6-993e-b4f1b6e12f6a tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:28:49.208497 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-78e54e96-ac02-48d6-993e-b4f1b6e12f6a tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:28:49.209087 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-78e54e96-ac02-48d6-993e-b4f1b6e12f6a tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:28:49.209780 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-78e54e96-ac02-48d6-993e-b4f1b6e12f6a tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:28:49.225603 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-78e54e96-ac02-48d6-993e-b4f1b6e12f6a tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:49.226649 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-78e54e96-ac02-48d6-993e-b4f1b6e12f6a tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:49.227130 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-78e54e96-ac02-48d6-993e-b4f1b6e12f6a tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:49.227912 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-78e54e96-ac02-48d6-993e-b4f1b6e12f6a tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:49.234363 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-78e54e96-ac02-48d6-993e-b4f1b6e12f6a tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:49.235093 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-78e54e96-ac02-48d6-993e-b4f1b6e12f6a tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:49.256246 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-78e54e96-ac02-48d6-993e-b4f1b6e12f6a tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Getting quotas for project fdedb3257fe94513bd5c51de0ae1d737. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:28:49.263248 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-78e54e96-ac02-48d6-993e-b4f1b6e12f6a tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Getting quotas for user a4fff27847f74c39b425dba724cf847f and project fdedb3257fe94513bd5c51de0ae1d737. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:28:49.279781 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-78e54e96-ac02-48d6-993e-b4f1b6e12f6a tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:28:49.286795 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-78e54e96-ac02-48d6-993e-b4f1b6e12f6a tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d7cd54fb-1c64-4fb8-a97b-4d5c81a48009] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:28:49.332340 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-03394bc2-17ea-4e63-9288-1ffacedc6f86 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.199724 Oct 30 01:28:49.341788 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1719/3433] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:28:47 2022] POST /compute/v2.1/servers => generated 407 bytes in 2211 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:28:49.351864 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-54a71ad3-26c2-4323-9aa2-81b1dca70cdb tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:49.357702 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-54a71ad3-26c2-4323-9aa2-81b1dca70cdb tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:49.359908 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-54a71ad3-26c2-4323-9aa2-81b1dca70cdb tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:49.360650 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-54a71ad3-26c2-4323-9aa2-81b1dca70cdb tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:49.361254 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-54a71ad3-26c2-4323-9aa2-81b1dca70cdb tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:49.362683 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-54a71ad3-26c2-4323-9aa2-81b1dca70cdb tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:49.363343 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-54a71ad3-26c2-4323-9aa2-81b1dca70cdb tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:49.364048 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-54a71ad3-26c2-4323-9aa2-81b1dca70cdb tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:49.451860 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-78e54e96-ac02-48d6-993e-b4f1b6e12f6a tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.575380 Oct 30 01:28:49.454583 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1715/3434] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:28:47 2022] POST /compute/v2.1/servers => generated 383 bytes in 1579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:28:49.466190 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-df49cef3-32c1-4347-90c2-e43b0b280c20 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:49.468713 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-df49cef3-32c1-4347-90c2-e43b0b280c20 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: fbbfb1ca-5624-4baf-b498-1f9b75c194cb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:49.491835 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df49cef3-32c1-4347-90c2-e43b0b280c20 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:49.491835 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df49cef3-32c1-4347-90c2-e43b0b280c20 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:49.491835 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df49cef3-32c1-4347-90c2-e43b0b280c20 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:49.492459 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df49cef3-32c1-4347-90c2-e43b0b280c20 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:49.492562 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df49cef3-32c1-4347-90c2-e43b0b280c20 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:49.493071 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df49cef3-32c1-4347-90c2-e43b0b280c20 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:50.077882 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-df49cef3-32c1-4347-90c2-e43b0b280c20 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:50.089154 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-df49cef3-32c1-4347-90c2-e43b0b280c20 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/fbbfb1ca-5624-4baf-b498-1f9b75c194cb" status: 200 len: 1308 microversion: 2.1 time: 0.632117 Oct 30 01:28:50.090770 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1716/3435] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:49 2022] GET /compute/v2.1/servers/fbbfb1ca-5624-4baf-b498-1f9b75c194cb => generated 1308 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:50.109204 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ba75179b-8106-40c0-9954-a72c43cd0d99 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:50.110101 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ba75179b-8106-40c0-9954-a72c43cd0d99 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 2873be88-5d85-49c6-833f-19b7df1fcf5f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:50.118142 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ba75179b-8106-40c0-9954-a72c43cd0d99 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:50.130863 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ba75179b-8106-40c0-9954-a72c43cd0d99 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:50.131610 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ba75179b-8106-40c0-9954-a72c43cd0d99 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:50.134452 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ba75179b-8106-40c0-9954-a72c43cd0d99 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:50.135170 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ba75179b-8106-40c0-9954-a72c43cd0d99 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:50.135965 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ba75179b-8106-40c0-9954-a72c43cd0d99 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:50.325451 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-54a71ad3-26c2-4323-9aa2-81b1dca70cdb tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:50.352706 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-54a71ad3-26c2-4323-9aa2-81b1dca70cdb tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:50.361650 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-54a71ad3-26c2-4323-9aa2-81b1dca70cdb tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:50.367571 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-54a71ad3-26c2-4323-9aa2-81b1dca70cdb tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1885 microversion: 2.32 time: 1.021003 Oct 30 01:28:50.368588 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1720/3436] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:28:49 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1885 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:28:50.377474 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-29f7a661-1311-4fff-a8e6-dbd4ad6d906f req-d18aeada-63e5-46b2-a571-c6f7efdfd231 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71a745a1-eaaf-4b96-8ed1-05e574cf4018", "tag": "d3003a3b-48ae-4930-aff4-2c14db9a20f6"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:28:50.388316 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-29f7a661-1311-4fff-a8e6-dbd4ad6d906f req-d18aeada-63e5-46b2-a571-c6f7efdfd231 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:50.388945 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-29f7a661-1311-4fff-a8e6-dbd4ad6d906f req-d18aeada-63e5-46b2-a571-c6f7efdfd231 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:50.390904 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-29f7a661-1311-4fff-a8e6-dbd4ad6d906f req-d18aeada-63e5-46b2-a571-c6f7efdfd231 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:50.436153 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-29f7a661-1311-4fff-a8e6-dbd4ad6d906f req-d18aeada-63e5-46b2-a571-c6f7efdfd231 service nova] Creating event network-changed:d3003a3b-48ae-4930-aff4-2c14db9a20f6 for instance 71a745a1-eaaf-4b96-8ed1-05e574cf4018 on n-h2-master-1 Oct 30 01:28:50.449719 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-29f7a661-1311-4fff-a8e6-dbd4ad6d906f req-d18aeada-63e5-46b2-a571-c6f7efdfd231 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078284 Oct 30 01:28:50.456636 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1721/3437] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:28:50.459564 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ba75179b-8106-40c0-9954-a72c43cd0d99 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:50.466581 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5ff91fc8-b8df-4c55-8312-c2df8c23e11c tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:50.467299 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5ff91fc8-b8df-4c55-8312-c2df8c23e11c tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] [instance: 0bddfccb-0dc7-430f-88b6-41e25e23d934] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:50.468132 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ba75179b-8106-40c0-9954-a72c43cd0d99 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f" status: 200 len: 1523 microversion: 2.1 time: 0.374824 Oct 30 01:28:50.474554 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1717/3438] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:50 2022] GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f => generated 1523 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:50.491899 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-11be6e97-8e6e-42b4-83de-93f369e43b50 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:50.496708 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-11be6e97-8e6e-42b4-83de-93f369e43b50 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d7cd54fb-1c64-4fb8-a97b-4d5c81a48009] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:50.669890 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-11be6e97-8e6e-42b4-83de-93f369e43b50 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:50.684826 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-11be6e97-8e6e-42b4-83de-93f369e43b50 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009" status: 200 len: 1214 microversion: 2.1 time: 0.206233 Oct 30 01:28:50.690336 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1718/3439] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:50 2022] GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 => generated 1214 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:50.733726 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5ff91fc8-b8df-4c55-8312-c2df8c23e11c tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b3394f28c4f444f8cd8bda6bacc9fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1e9b74043548e48a5bb8fb4d054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:50.744957 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5ff91fc8-b8df-4c55-8312-c2df8c23e11c tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] 10.222.0.13 "GET /compute/v2.1/servers/0bddfccb-0dc7-430f-88b6-41e25e23d934" status: 200 len: 1269 microversion: 2.1 time: 0.287963 Oct 30 01:28:50.748100 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1722/3440] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:50 2022] GET /compute/v2.1/servers/0bddfccb-0dc7-430f-88b6-41e25e23d934 => generated 1269 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:51.118077 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-58081012-a442-4fd4-a2b2-f5d7cf655b80 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:51.118738 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-58081012-a442-4fd4-a2b2-f5d7cf655b80 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: fbbfb1ca-5624-4baf-b498-1f9b75c194cb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:51.131309 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-58081012-a442-4fd4-a2b2-f5d7cf655b80 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:51.131921 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-58081012-a442-4fd4-a2b2-f5d7cf655b80 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:51.132442 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-58081012-a442-4fd4-a2b2-f5d7cf655b80 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:51.133294 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-58081012-a442-4fd4-a2b2-f5d7cf655b80 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:51.134120 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-58081012-a442-4fd4-a2b2-f5d7cf655b80 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:51.134655 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-58081012-a442-4fd4-a2b2-f5d7cf655b80 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:51.396601 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ab52bc2c-ca0c-408d-b556-d8231293d3d5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:51.397791 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ab52bc2c-ca0c-408d-b556-d8231293d3d5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:51.407805 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ab52bc2c-ca0c-408d-b556-d8231293d3d5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:51.408610 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ab52bc2c-ca0c-408d-b556-d8231293d3d5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:51.409285 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ab52bc2c-ca0c-408d-b556-d8231293d3d5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:51.410234 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ab52bc2c-ca0c-408d-b556-d8231293d3d5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:51.410871 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ab52bc2c-ca0c-408d-b556-d8231293d3d5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:51.411488 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ab52bc2c-ca0c-408d-b556-d8231293d3d5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:51.672061 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-58081012-a442-4fd4-a2b2-f5d7cf655b80 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:51.683019 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-58081012-a442-4fd4-a2b2-f5d7cf655b80 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/fbbfb1ca-5624-4baf-b498-1f9b75c194cb" status: 200 len: 1308 microversion: 2.1 time: 0.568968 Oct 30 01:28:51.700705 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1719/3441] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:51 2022] GET /compute/v2.1/servers/fbbfb1ca-5624-4baf-b498-1f9b75c194cb => generated 1308 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:51.706295 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bd169584-8256-4474-84c5-6ce222776989 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:51.707130 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bd169584-8256-4474-84c5-6ce222776989 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 2873be88-5d85-49c6-833f-19b7df1fcf5f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:51.713981 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bd169584-8256-4474-84c5-6ce222776989 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:51.714723 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bd169584-8256-4474-84c5-6ce222776989 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:51.715666 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bd169584-8256-4474-84c5-6ce222776989 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:51.716224 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ab52bc2c-ca0c-408d-b556-d8231293d3d5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:51.716469 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bd169584-8256-4474-84c5-6ce222776989 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:51.716926 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bd169584-8256-4474-84c5-6ce222776989 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:51.717361 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bd169584-8256-4474-84c5-6ce222776989 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:51.722019 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:51.728350 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ab52bc2c-ca0c-408d-b556-d8231293d3d5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:51.730132 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ab52bc2c-ca0c-408d-b556-d8231293d3d5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:51.731711 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ab52bc2c-ca0c-408d-b556-d8231293d3d5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1873 microversion: 2.32 time: 0.339124 Oct 30 01:28:51.732495 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1723/3442] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:28:51 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1873 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:28:51.745744 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-517349d8-81fd-4bd6-b897-f5453f5021e8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:51.745744 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-517349d8-81fd-4bd6-b897-f5453f5021e8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d7cd54fb-1c64-4fb8-a97b-4d5c81a48009] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:51.768892 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-517349d8-81fd-4bd6-b897-f5453f5021e8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:51.770751 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-517349d8-81fd-4bd6-b897-f5453f5021e8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:51.774124 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-517349d8-81fd-4bd6-b897-f5453f5021e8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:51.774950 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-517349d8-81fd-4bd6-b897-f5453f5021e8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:51.775607 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-517349d8-81fd-4bd6-b897-f5453f5021e8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:51.776065 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-517349d8-81fd-4bd6-b897-f5453f5021e8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:51.871420 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-517349d8-81fd-4bd6-b897-f5453f5021e8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:51.895753 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-517349d8-81fd-4bd6-b897-f5453f5021e8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009" status: 200 len: 1218 microversion: 2.1 time: 0.162189 Oct 30 01:28:51.910010 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1724/3443] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:51 2022] GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 => generated 1218 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:51.910010 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a4c8467b-3f59-4823-88b2-04805aafa25d tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:51.910010 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a4c8467b-3f59-4823-88b2-04805aafa25d tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] [instance: 0bddfccb-0dc7-430f-88b6-41e25e23d934] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:51.919675 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a4c8467b-3f59-4823-88b2-04805aafa25d tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:51.920181 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a4c8467b-3f59-4823-88b2-04805aafa25d tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:51.920606 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a4c8467b-3f59-4823-88b2-04805aafa25d tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:51.925788 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bd169584-8256-4474-84c5-6ce222776989 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:51.928105 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a4c8467b-3f59-4823-88b2-04805aafa25d tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:51.932720 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a4c8467b-3f59-4823-88b2-04805aafa25d tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:51.933179 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a4c8467b-3f59-4823-88b2-04805aafa25d tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:51.936450 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bd169584-8256-4474-84c5-6ce222776989 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f" status: 200 len: 1523 microversion: 2.1 time: 0.234052 Oct 30 01:28:51.937703 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1720/3444] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:51 2022] GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f => generated 1523 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:52.030463 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a4c8467b-3f59-4823-88b2-04805aafa25d tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b3394f28c4f444f8cd8bda6bacc9fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1e9b74043548e48a5bb8fb4d054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:52.039956 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a4c8467b-3f59-4823-88b2-04805aafa25d tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] 10.222.0.13 "GET /compute/v2.1/servers/0bddfccb-0dc7-430f-88b6-41e25e23d934" status: 200 len: 1273 microversion: 2.1 time: 0.141968 Oct 30 01:28:52.046032 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1725/3445] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:51 2022] GET /compute/v2.1/servers/0bddfccb-0dc7-430f-88b6-41e25e23d934 => generated 1273 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:52.527849 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-51bc77c1-5093-453b-a9d1-67bc0adf81c1 req-c3e756c6-029f-4e8f-93ea-de92b5a53be2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71a745a1-eaaf-4b96-8ed1-05e574cf4018", "tag": "f28e0cc4-3563-4fc3-9871-48fe723f125c"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:28:52.539558 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-51bc77c1-5093-453b-a9d1-67bc0adf81c1 req-c3e756c6-029f-4e8f-93ea-de92b5a53be2 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:52.540159 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-51bc77c1-5093-453b-a9d1-67bc0adf81c1 req-c3e756c6-029f-4e8f-93ea-de92b5a53be2 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:52.540658 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-51bc77c1-5093-453b-a9d1-67bc0adf81c1 req-c3e756c6-029f-4e8f-93ea-de92b5a53be2 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:52.552030 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-51bc77c1-5093-453b-a9d1-67bc0adf81c1 req-c3e756c6-029f-4e8f-93ea-de92b5a53be2 service nova] Creating event network-changed:f28e0cc4-3563-4fc3-9871-48fe723f125c for instance 71a745a1-eaaf-4b96-8ed1-05e574cf4018 on n-h2-master-1 Oct 30 01:28:52.556973 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-51bc77c1-5093-453b-a9d1-67bc0adf81c1 req-c3e756c6-029f-4e8f-93ea-de92b5a53be2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032836 Oct 30 01:28:52.557689 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1721/3446] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:28:52.708490 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-95fe54cc-a38e-4d05-9fcf-f794381eda36 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:52.710810 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-95fe54cc-a38e-4d05-9fcf-f794381eda36 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: fbbfb1ca-5624-4baf-b498-1f9b75c194cb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:52.719132 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-95fe54cc-a38e-4d05-9fcf-f794381eda36 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:52.720562 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-95fe54cc-a38e-4d05-9fcf-f794381eda36 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:52.721256 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-95fe54cc-a38e-4d05-9fcf-f794381eda36 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:52.722657 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-95fe54cc-a38e-4d05-9fcf-f794381eda36 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:52.723299 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-95fe54cc-a38e-4d05-9fcf-f794381eda36 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:52.723897 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-95fe54cc-a38e-4d05-9fcf-f794381eda36 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:52.770196 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d3979f13-bdb4-4c5d-bcf5-8a639d74173e tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:52.773908 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d3979f13-bdb4-4c5d-bcf5-8a639d74173e tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:52.806851 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3979f13-bdb4-4c5d-bcf5-8a639d74173e tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:52.807361 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3979f13-bdb4-4c5d-bcf5-8a639d74173e tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:52.807796 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3979f13-bdb4-4c5d-bcf5-8a639d74173e tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:52.808517 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3979f13-bdb4-4c5d-bcf5-8a639d74173e tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:52.808996 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3979f13-bdb4-4c5d-bcf5-8a639d74173e tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:52.811301 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3979f13-bdb4-4c5d-bcf5-8a639d74173e tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:53.278221 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-95fe54cc-a38e-4d05-9fcf-f794381eda36 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:53.290050 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-95fe54cc-a38e-4d05-9fcf-f794381eda36 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/fbbfb1ca-5624-4baf-b498-1f9b75c194cb" status: 200 len: 1308 microversion: 2.1 time: 0.586547 Oct 30 01:28:53.305966 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1726/3447] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:52 2022] GET /compute/v2.1/servers/fbbfb1ca-5624-4baf-b498-1f9b75c194cb => generated 1308 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:53.310896 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-203b0dd8-7f93-40b1-88a1-eeb7d8d42a27 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:53.313948 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-203b0dd8-7f93-40b1-88a1-eeb7d8d42a27 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d7cd54fb-1c64-4fb8-a97b-4d5c81a48009] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:53.338898 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-203b0dd8-7f93-40b1-88a1-eeb7d8d42a27 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:53.347256 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-203b0dd8-7f93-40b1-88a1-eeb7d8d42a27 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:53.347977 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-203b0dd8-7f93-40b1-88a1-eeb7d8d42a27 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:53.349074 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-203b0dd8-7f93-40b1-88a1-eeb7d8d42a27 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:53.350756 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-203b0dd8-7f93-40b1-88a1-eeb7d8d42a27 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:53.352064 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-203b0dd8-7f93-40b1-88a1-eeb7d8d42a27 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:53.440492 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d3979f13-bdb4-4c5d-bcf5-8a639d74173e tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:53.453843 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d3979f13-bdb4-4c5d-bcf5-8a639d74173e tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:53.455636 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d3979f13-bdb4-4c5d-bcf5-8a639d74173e tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:53.458654 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d3979f13-bdb4-4c5d-bcf5-8a639d74173e tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1873 microversion: 2.32 time: 0.701534 Oct 30 01:28:53.466002 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1722/3448] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:28:52 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1873 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:28:53.472125 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e0601eb2-a12f-4422-bf35-d49324c86506 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:53.474866 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e0601eb2-a12f-4422-bf35-d49324c86506 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 2873be88-5d85-49c6-833f-19b7df1fcf5f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:53.483504 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e0601eb2-a12f-4422-bf35-d49324c86506 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:53.484259 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e0601eb2-a12f-4422-bf35-d49324c86506 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:53.487793 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e0601eb2-a12f-4422-bf35-d49324c86506 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:53.493006 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e0601eb2-a12f-4422-bf35-d49324c86506 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:53.494566 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e0601eb2-a12f-4422-bf35-d49324c86506 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:53.496378 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e0601eb2-a12f-4422-bf35-d49324c86506 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:53.558135 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-203b0dd8-7f93-40b1-88a1-eeb7d8d42a27 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:53.576622 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-203b0dd8-7f93-40b1-88a1-eeb7d8d42a27 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009" status: 200 len: 1274 microversion: 2.1 time: 0.265117 Oct 30 01:28:53.576622 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1727/3449] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:53 2022] GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 => generated 1274 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:53.589914 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-98a7f086-17ca-4689-ace0-9346e6b3d918 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:53.590564 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-98a7f086-17ca-4689-ace0-9346e6b3d918 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] [instance: 0bddfccb-0dc7-430f-88b6-41e25e23d934] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:53.601895 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-98a7f086-17ca-4689-ace0-9346e6b3d918 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:53.602391 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-98a7f086-17ca-4689-ace0-9346e6b3d918 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:53.602822 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-98a7f086-17ca-4689-ace0-9346e6b3d918 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:53.603530 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-98a7f086-17ca-4689-ace0-9346e6b3d918 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:53.603982 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-98a7f086-17ca-4689-ace0-9346e6b3d918 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:53.604404 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-98a7f086-17ca-4689-ace0-9346e6b3d918 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:53.695190 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-98a7f086-17ca-4689-ace0-9346e6b3d918 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b3394f28c4f444f8cd8bda6bacc9fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1e9b74043548e48a5bb8fb4d054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:53.706742 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-98a7f086-17ca-4689-ace0-9346e6b3d918 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] 10.222.0.13 "GET /compute/v2.1/servers/0bddfccb-0dc7-430f-88b6-41e25e23d934" status: 200 len: 1321 microversion: 2.1 time: 0.130857 Oct 30 01:28:53.709880 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1728/3450] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:53 2022] GET /compute/v2.1/servers/0bddfccb-0dc7-430f-88b6-41e25e23d934 => generated 1321 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:53.868577 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e0601eb2-a12f-4422-bf35-d49324c86506 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:53.877399 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e0601eb2-a12f-4422-bf35-d49324c86506 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f" status: 200 len: 1523 microversion: 2.1 time: 0.409831 Oct 30 01:28:53.878302 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1723/3451] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:53 2022] GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f => generated 1523 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:54.313259 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0a3612e1-de16-4901-9481-ae2be97dd745 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:54.313899 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0a3612e1-de16-4901-9481-ae2be97dd745 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: fbbfb1ca-5624-4baf-b498-1f9b75c194cb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:54.324266 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0a3612e1-de16-4901-9481-ae2be97dd745 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:54.324772 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0a3612e1-de16-4901-9481-ae2be97dd745 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:54.325209 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0a3612e1-de16-4901-9481-ae2be97dd745 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:54.325963 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0a3612e1-de16-4901-9481-ae2be97dd745 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:54.326430 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0a3612e1-de16-4901-9481-ae2be97dd745 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:54.326901 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0a3612e1-de16-4901-9481-ae2be97dd745 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:54.338961 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-b70cbf8d-a346-42d7-b822-9a825ec23d68 req-6382c8fd-b3de-441c-8deb-2166dd90b0fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbbfb1ca-5624-4baf-b498-1f9b75c194cb", "name": "network-vif-plugged", "status": "completed", "tag": "d7ec7460-259d-41ae-87e0-75972e297800"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:28:54.351444 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-b70cbf8d-a346-42d7-b822-9a825ec23d68 req-6382c8fd-b3de-441c-8deb-2166dd90b0fb service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:54.352353 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-b70cbf8d-a346-42d7-b822-9a825ec23d68 req-6382c8fd-b3de-441c-8deb-2166dd90b0fb service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:54.353957 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-b70cbf8d-a346-42d7-b822-9a825ec23d68 req-6382c8fd-b3de-441c-8deb-2166dd90b0fb service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:54.371026 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-b70cbf8d-a346-42d7-b822-9a825ec23d68 req-6382c8fd-b3de-441c-8deb-2166dd90b0fb service nova] Creating event network-vif-plugged:d7ec7460-259d-41ae-87e0-75972e297800 for instance fbbfb1ca-5624-4baf-b498-1f9b75c194cb on n-h2-master-1 Oct 30 01:28:54.392651 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-b70cbf8d-a346-42d7-b822-9a825ec23d68 req-6382c8fd-b3de-441c-8deb-2166dd90b0fb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057302 Oct 30 01:28:54.393304 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1724/3452] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:28:54.492805 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-107f1e40-7d0f-43a7-a044-00acffb49917 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:54.493585 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-107f1e40-7d0f-43a7-a044-00acffb49917 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:54.504070 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-107f1e40-7d0f-43a7-a044-00acffb49917 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:54.504571 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-107f1e40-7d0f-43a7-a044-00acffb49917 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:54.505009 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-107f1e40-7d0f-43a7-a044-00acffb49917 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:54.510207 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0a3612e1-de16-4901-9481-ae2be97dd745 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:54.510409 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-107f1e40-7d0f-43a7-a044-00acffb49917 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:54.510798 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-107f1e40-7d0f-43a7-a044-00acffb49917 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:54.514918 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-107f1e40-7d0f-43a7-a044-00acffb49917 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:54.526307 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0a3612e1-de16-4901-9481-ae2be97dd745 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/fbbfb1ca-5624-4baf-b498-1f9b75c194cb" status: 200 len: 1308 microversion: 2.1 time: 0.216813 Oct 30 01:28:54.526920 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1729/3453] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:54 2022] GET /compute/v2.1/servers/fbbfb1ca-5624-4baf-b498-1f9b75c194cb => generated 1308 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:54.608433 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4a12e63b-8ac3-4569-8794-0e6e35625498 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:54.609130 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4a12e63b-8ac3-4569-8794-0e6e35625498 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d7cd54fb-1c64-4fb8-a97b-4d5c81a48009] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:54.621778 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4a12e63b-8ac3-4569-8794-0e6e35625498 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:54.622552 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4a12e63b-8ac3-4569-8794-0e6e35625498 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:54.624906 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4a12e63b-8ac3-4569-8794-0e6e35625498 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:54.625826 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4a12e63b-8ac3-4569-8794-0e6e35625498 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:54.627515 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4a12e63b-8ac3-4569-8794-0e6e35625498 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:54.629714 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4a12e63b-8ac3-4569-8794-0e6e35625498 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:55.113202 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-107f1e40-7d0f-43a7-a044-00acffb49917 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:55.125131 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-107f1e40-7d0f-43a7-a044-00acffb49917 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:55.127519 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-107f1e40-7d0f-43a7-a044-00acffb49917 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:55.128401 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4a12e63b-8ac3-4569-8794-0e6e35625498 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:55.130120 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-107f1e40-7d0f-43a7-a044-00acffb49917 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1873 microversion: 2.32 time: 0.641175 Oct 30 01:28:55.131450 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1725/3454] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:28:54 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1873 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:28:55.136843 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-f7ea561c-c71b-49fc-8506-3ae42f2a6b6c req-2d225844-af05-4f16-b7c3-1375ecf12aa9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71a745a1-eaaf-4b96-8ed1-05e574cf4018", "tag": "b1d21fa1-296a-49e9-8eb4-9815567f00c1"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:28:55.140750 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4a12e63b-8ac3-4569-8794-0e6e35625498 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009" status: 200 len: 1314 microversion: 2.1 time: 0.535371 Oct 30 01:28:55.140750 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1730/3455] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:54 2022] GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 => generated 1314 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:55.144288 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-48e4fdff-a220-47e5-a181-aeadb4dd0658 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:55.145475 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-48e4fdff-a220-47e5-a181-aeadb4dd0658 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] [instance: 0bddfccb-0dc7-430f-88b6-41e25e23d934] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:55.148561 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-f7ea561c-c71b-49fc-8506-3ae42f2a6b6c req-2d225844-af05-4f16-b7c3-1375ecf12aa9 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:55.149287 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-f7ea561c-c71b-49fc-8506-3ae42f2a6b6c req-2d225844-af05-4f16-b7c3-1375ecf12aa9 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:55.149982 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-f7ea561c-c71b-49fc-8506-3ae42f2a6b6c req-2d225844-af05-4f16-b7c3-1375ecf12aa9 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:55.151851 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-48e4fdff-a220-47e5-a181-aeadb4dd0658 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:55.152460 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-48e4fdff-a220-47e5-a181-aeadb4dd0658 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:55.153141 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-48e4fdff-a220-47e5-a181-aeadb4dd0658 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:55.154433 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-48e4fdff-a220-47e5-a181-aeadb4dd0658 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:55.155184 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-48e4fdff-a220-47e5-a181-aeadb4dd0658 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:55.157404 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-48e4fdff-a220-47e5-a181-aeadb4dd0658 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:55.166601 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-f7ea561c-c71b-49fc-8506-3ae42f2a6b6c req-2d225844-af05-4f16-b7c3-1375ecf12aa9 service nova] Creating event network-changed:b1d21fa1-296a-49e9-8eb4-9815567f00c1 for instance 71a745a1-eaaf-4b96-8ed1-05e574cf4018 on n-h2-master-1 Oct 30 01:28:55.177953 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-f7ea561c-c71b-49fc-8506-3ae42f2a6b6c req-2d225844-af05-4f16-b7c3-1375ecf12aa9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044328 Oct 30 01:28:55.179223 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1726/3456] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:28:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:28:55.190408 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-114afc43-41e3-4881-8325-64009e08c01a tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:55.194225 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-114afc43-41e3-4881-8325-64009e08c01a tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 2873be88-5d85-49c6-833f-19b7df1fcf5f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:55.204814 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-114afc43-41e3-4881-8325-64009e08c01a tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:55.205657 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-114afc43-41e3-4881-8325-64009e08c01a tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:55.206213 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-114afc43-41e3-4881-8325-64009e08c01a tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:55.207221 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-114afc43-41e3-4881-8325-64009e08c01a tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:55.207785 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-114afc43-41e3-4881-8325-64009e08c01a tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:55.208369 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-114afc43-41e3-4881-8325-64009e08c01a tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:55.273694 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-48e4fdff-a220-47e5-a181-aeadb4dd0658 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b3394f28c4f444f8cd8bda6bacc9fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1e9b74043548e48a5bb8fb4d054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:55.284738 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-48e4fdff-a220-47e5-a181-aeadb4dd0658 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] 10.222.0.13 "GET /compute/v2.1/servers/0bddfccb-0dc7-430f-88b6-41e25e23d934" status: 200 len: 1327 microversion: 2.1 time: 0.143922 Oct 30 01:28:55.287709 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1731/3457] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:55 2022] GET /compute/v2.1/servers/0bddfccb-0dc7-430f-88b6-41e25e23d934 => generated 1327 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:55.555054 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6b14f644-a16d-40e0-ba5e-b67268254b2d tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:55.556089 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6b14f644-a16d-40e0-ba5e-b67268254b2d tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: fbbfb1ca-5624-4baf-b498-1f9b75c194cb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:55.582972 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6b14f644-a16d-40e0-ba5e-b67268254b2d tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:55.583508 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6b14f644-a16d-40e0-ba5e-b67268254b2d tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:55.583950 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6b14f644-a16d-40e0-ba5e-b67268254b2d tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:55.584677 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6b14f644-a16d-40e0-ba5e-b67268254b2d tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:55.585132 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6b14f644-a16d-40e0-ba5e-b67268254b2d tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:55.585601 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6b14f644-a16d-40e0-ba5e-b67268254b2d tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:55.880330 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6b14f644-a16d-40e0-ba5e-b67268254b2d tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:55.892371 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6b14f644-a16d-40e0-ba5e-b67268254b2d tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/fbbfb1ca-5624-4baf-b498-1f9b75c194cb" status: 200 len: 1308 microversion: 2.1 time: 0.342726 Oct 30 01:28:55.896199 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1732/3458] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:55 2022] GET /compute/v2.1/servers/fbbfb1ca-5624-4baf-b498-1f9b75c194cb => generated 1308 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:28:55.899629 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-114afc43-41e3-4881-8325-64009e08c01a tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:55.925582 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-114afc43-41e3-4881-8325-64009e08c01a tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f" status: 200 len: 1523 microversion: 2.1 time: 0.741104 Oct 30 01:28:55.931850 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1727/3459] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:55 2022] GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f => generated 1523 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:56.161124 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e7f22332-7a12-484e-87f5-8b82964c39e3 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:56.163439 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e7f22332-7a12-484e-87f5-8b82964c39e3 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:56.166349 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9b08c3f0-6d31-44f6-b939-2bd56bfe9de2 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:56.167047 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9b08c3f0-6d31-44f6-b939-2bd56bfe9de2 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d7cd54fb-1c64-4fb8-a97b-4d5c81a48009] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:56.176535 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7f22332-7a12-484e-87f5-8b82964c39e3 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:56.177976 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7f22332-7a12-484e-87f5-8b82964c39e3 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:56.178666 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7f22332-7a12-484e-87f5-8b82964c39e3 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:56.179543 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b08c3f0-6d31-44f6-b939-2bd56bfe9de2 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:56.179938 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7f22332-7a12-484e-87f5-8b82964c39e3 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:56.180513 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b08c3f0-6d31-44f6-b939-2bd56bfe9de2 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:56.180839 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7f22332-7a12-484e-87f5-8b82964c39e3 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:56.181681 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7f22332-7a12-484e-87f5-8b82964c39e3 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:56.185428 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b08c3f0-6d31-44f6-b939-2bd56bfe9de2 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:56.186630 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b08c3f0-6d31-44f6-b939-2bd56bfe9de2 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:56.187198 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b08c3f0-6d31-44f6-b939-2bd56bfe9de2 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:56.187716 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b08c3f0-6d31-44f6-b939-2bd56bfe9de2 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:56.931028 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9b08c3f0-6d31-44f6-b939-2bd56bfe9de2 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:56.946314 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9b08c3f0-6d31-44f6-b939-2bd56bfe9de2 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009" status: 200 len: 1314 microversion: 2.1 time: 0.784653 Oct 30 01:28:56.946921 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1728/3460] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:56 2022] GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 => generated 1314 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:28:56.975281 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-51ed415e-df1e-44eb-8d54-cfb8629803c5 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:56.975987 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-51ed415e-df1e-44eb-8d54-cfb8629803c5 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] [instance: 0bddfccb-0dc7-430f-88b6-41e25e23d934] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:56.992045 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51ed415e-df1e-44eb-8d54-cfb8629803c5 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:57.003593 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51ed415e-df1e-44eb-8d54-cfb8629803c5 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:57.007531 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51ed415e-df1e-44eb-8d54-cfb8629803c5 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:57.009962 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51ed415e-df1e-44eb-8d54-cfb8629803c5 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:57.009962 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51ed415e-df1e-44eb-8d54-cfb8629803c5 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:57.009962 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51ed415e-df1e-44eb-8d54-cfb8629803c5 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:57.024103 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e7f22332-7a12-484e-87f5-8b82964c39e3 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:57.050720 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e7f22332-7a12-484e-87f5-8b82964c39e3 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:57.055593 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e7f22332-7a12-484e-87f5-8b82964c39e3 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:57.057060 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e7f22332-7a12-484e-87f5-8b82964c39e3 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1873 microversion: 2.32 time: 0.900584 Oct 30 01:28:57.057682 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1733/3461] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:28:56 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1873 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:28:57.062737 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-83f98d65-ce8b-4d40-b4f7-300b4abe77dd tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:57.063536 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-83f98d65-ce8b-4d40-b4f7-300b4abe77dd tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: fbbfb1ca-5624-4baf-b498-1f9b75c194cb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:57.070543 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-83f98d65-ce8b-4d40-b4f7-300b4abe77dd tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:57.073151 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-83f98d65-ce8b-4d40-b4f7-300b4abe77dd tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:57.073151 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-83f98d65-ce8b-4d40-b4f7-300b4abe77dd tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:57.073151 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-83f98d65-ce8b-4d40-b4f7-300b4abe77dd tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:57.073151 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-83f98d65-ce8b-4d40-b4f7-300b4abe77dd tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:57.073151 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-83f98d65-ce8b-4d40-b4f7-300b4abe77dd tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:57.604938 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-51ed415e-df1e-44eb-8d54-cfb8629803c5 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b3394f28c4f444f8cd8bda6bacc9fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1e9b74043548e48a5bb8fb4d054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:57.619342 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-51ed415e-df1e-44eb-8d54-cfb8629803c5 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] 10.222.0.13 "GET /compute/v2.1/servers/0bddfccb-0dc7-430f-88b6-41e25e23d934" status: 200 len: 1395 microversion: 2.1 time: 0.651940 Oct 30 01:28:57.628292 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1729/3462] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:56 2022] GET /compute/v2.1/servers/0bddfccb-0dc7-430f-88b6-41e25e23d934 => generated 1395 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:57.644915 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-70a9bbb5-2f41-40b2-a4b4-7ec98c3a41dc tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:57.646281 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-83f98d65-ce8b-4d40-b4f7-300b4abe77dd tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:57.649918 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-70a9bbb5-2f41-40b2-a4b4-7ec98c3a41dc tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 2873be88-5d85-49c6-833f-19b7df1fcf5f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:57.656346 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-83f98d65-ce8b-4d40-b4f7-300b4abe77dd tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/fbbfb1ca-5624-4baf-b498-1f9b75c194cb" status: 200 len: 1487 microversion: 2.1 time: 0.597594 Oct 30 01:28:57.657580 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1734/3463] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:57 2022] GET /compute/v2.1/servers/fbbfb1ca-5624-4baf-b498-1f9b75c194cb => generated 1487 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:57.663000 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-70a9bbb5-2f41-40b2-a4b4-7ec98c3a41dc tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:57.664260 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-70a9bbb5-2f41-40b2-a4b4-7ec98c3a41dc tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:57.665935 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-70a9bbb5-2f41-40b2-a4b4-7ec98c3a41dc tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:57.667264 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-70a9bbb5-2f41-40b2-a4b4-7ec98c3a41dc tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:57.670072 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-70a9bbb5-2f41-40b2-a4b4-7ec98c3a41dc tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:57.671514 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-70a9bbb5-2f41-40b2-a4b4-7ec98c3a41dc tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:57.685786 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-769a85f7-00ae-422f-a2fc-9a0c6964a7e5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-593785698"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:28:57.688904 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-769a85f7-00ae-422f-a2fc-9a0c6964a7e5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: fbbfb1ca-5624-4baf-b498-1f9b75c194cb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:57.699340 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-769a85f7-00ae-422f-a2fc-9a0c6964a7e5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:57.700602 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-769a85f7-00ae-422f-a2fc-9a0c6964a7e5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:57.714571 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-769a85f7-00ae-422f-a2fc-9a0c6964a7e5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:57.714571 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-769a85f7-00ae-422f-a2fc-9a0c6964a7e5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:57.714571 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-769a85f7-00ae-422f-a2fc-9a0c6964a7e5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:57.714571 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-769a85f7-00ae-422f-a2fc-9a0c6964a7e5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:58.032248 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-70a9bbb5-2f41-40b2-a4b4-7ec98c3a41dc tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:58.045483 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-70a9bbb5-2f41-40b2-a4b4-7ec98c3a41dc tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f" status: 200 len: 1523 microversion: 2.1 time: 0.414953 Oct 30 01:28:58.046442 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1730/3464] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:57 2022] GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f => generated 1523 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:58.209641 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-251bcc60-e54e-44f1-8e8d-4af0724a8256 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1904404436", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "936faadb-2266-486c-9624-31976f3a3668"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:28:58.245836 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:58.291314 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-251bcc60-e54e-44f1-8e8d-4af0724a8256 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] validate_networks() for [('936faadb-2266-486c-9624-31976f3a3668', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:28:58.381709 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-769a85f7-00ae-422f-a2fc-9a0c6964a7e5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "POST /compute/v2.1/servers/fbbfb1ca-5624-4baf-b498-1f9b75c194cb/action" status: 202 len: 0 microversion: 2.1 time: 0.701812 Oct 30 01:28:58.383166 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1735/3465] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:28:57 2022] POST /compute/v2.1/servers/fbbfb1ca-5624-4baf-b498-1f9b75c194cb/action => generated 0 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 30 01:28:58.397172 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8a5aa61c-14d9-4170-8f09-1883af666d6b tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:58.398377 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8a5aa61c-14d9-4170-8f09-1883af666d6b tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d7cd54fb-1c64-4fb8-a97b-4d5c81a48009] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:58.420774 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8a5aa61c-14d9-4170-8f09-1883af666d6b tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:58.422455 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8a5aa61c-14d9-4170-8f09-1883af666d6b tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:58.423125 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8a5aa61c-14d9-4170-8f09-1883af666d6b tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:58.424045 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8a5aa61c-14d9-4170-8f09-1883af666d6b tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:58.424494 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8a5aa61c-14d9-4170-8f09-1883af666d6b tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:58.424916 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8a5aa61c-14d9-4170-8f09-1883af666d6b tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:58.987440 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8a5aa61c-14d9-4170-8f09-1883af666d6b tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:59.001355 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8a5aa61c-14d9-4170-8f09-1883af666d6b tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009" status: 200 len: 1314 microversion: 2.1 time: 0.616708 Oct 30 01:28:59.004491 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1736/3466] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:58 2022] GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 => generated 1314 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:59.014424 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a59ca62a-e3e4-438c-a147-ca83ae0cc343 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:59.015055 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a59ca62a-e3e4-438c-a147-ca83ae0cc343 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:59.021877 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a59ca62a-e3e4-438c-a147-ca83ae0cc343 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:59.022532 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a59ca62a-e3e4-438c-a147-ca83ae0cc343 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:59.022971 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a59ca62a-e3e4-438c-a147-ca83ae0cc343 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:59.023860 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a59ca62a-e3e4-438c-a147-ca83ae0cc343 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:59.024318 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a59ca62a-e3e4-438c-a147-ca83ae0cc343 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:59.024743 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a59ca62a-e3e4-438c-a147-ca83ae0cc343 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:59.120297 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:59.245449 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:59.462981 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-251bcc60-e54e-44f1-8e8d-4af0724a8256 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:28:59.463662 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-251bcc60-e54e-44f1-8e8d-4af0724a8256 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:28:59.464135 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-251bcc60-e54e-44f1-8e8d-4af0724a8256 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:28:59.464542 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-251bcc60-e54e-44f1-8e8d-4af0724a8256 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:28:59.464956 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-251bcc60-e54e-44f1-8e8d-4af0724a8256 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:28:59.468993 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:59.481970 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-251bcc60-e54e-44f1-8e8d-4af0724a8256 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:59.482471 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-251bcc60-e54e-44f1-8e8d-4af0724a8256 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:59.482915 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-251bcc60-e54e-44f1-8e8d-4af0724a8256 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:59.483671 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-251bcc60-e54e-44f1-8e8d-4af0724a8256 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:59.484112 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-251bcc60-e54e-44f1-8e8d-4af0724a8256 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:59.484540 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-251bcc60-e54e-44f1-8e8d-4af0724a8256 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:59.525645 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-251bcc60-e54e-44f1-8e8d-4af0724a8256 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Getting quotas for project 45fe1c50eaee40249b6c20cc91e52586. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:28:59.536122 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-251bcc60-e54e-44f1-8e8d-4af0724a8256 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Getting quotas for user ef5f8a3e6fef4d6393603575479b16a2 and project 45fe1c50eaee40249b6c20cc91e52586. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:28:59.547561 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a59ca62a-e3e4-438c-a147-ca83ae0cc343 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:59.556056 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-251bcc60-e54e-44f1-8e8d-4af0724a8256 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:28:59.558483 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-251bcc60-e54e-44f1-8e8d-4af0724a8256 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 2864065f-4af8-4134-b3f6-af254b7ab474] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:28:59.564598 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a59ca62a-e3e4-438c-a147-ca83ae0cc343 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:59.566327 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a59ca62a-e3e4-438c-a147-ca83ae0cc343 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:28:59.569780 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a59ca62a-e3e4-438c-a147-ca83ae0cc343 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1873 microversion: 2.32 time: 0.563165 Oct 30 01:28:59.591100 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1737/3467] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:28:59 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1873 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:28:59.779967 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-ba2c867a-a746-499a-a22c-3cd815b37981 req-d2c8c596-c657-4306-bdf1-ce56f81a3fd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71a745a1-eaaf-4b96-8ed1-05e574cf4018", "tag": "e93d2997-a301-4093-af8d-49bdcb2c57e1"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:28:59.791583 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ba2c867a-a746-499a-a22c-3cd815b37981 req-d2c8c596-c657-4306-bdf1-ce56f81a3fd1 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:59.792316 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ba2c867a-a746-499a-a22c-3cd815b37981 req-d2c8c596-c657-4306-bdf1-ce56f81a3fd1 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:59.792931 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ba2c867a-a746-499a-a22c-3cd815b37981 req-d2c8c596-c657-4306-bdf1-ce56f81a3fd1 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:59.811876 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-ba2c867a-a746-499a-a22c-3cd815b37981 req-d2c8c596-c657-4306-bdf1-ce56f81a3fd1 service nova] Creating event network-changed:e93d2997-a301-4093-af8d-49bdcb2c57e1 for instance 71a745a1-eaaf-4b96-8ed1-05e574cf4018 on n-h2-master-1 Oct 30 01:28:59.815843 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-ba2c867a-a746-499a-a22c-3cd815b37981 req-d2c8c596-c657-4306-bdf1-ce56f81a3fd1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.231676 Oct 30 01:28:59.816642 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1738/3468] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:28:59.823922 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0ab4c797-064c-4f59-b739-3107b880c0e3 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44d03b4d30>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:59.874806 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-251bcc60-e54e-44f1-8e8d-4af0724a8256 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.827043 Oct 30 01:28:59.893745 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1731/3469] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:28:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1846 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:28:59.896124 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0ab4c797-064c-4f59-b739-3107b880c0e3 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/5a6b77af-38ff-4cde-8d04-bfb80a15f829" status: 200 len: 1411 microversion: 2.1 time: 0.078008 Oct 30 01:28:59.901024 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-8be9180c-f886-4cdf-82c0-066f63f24711 req-62d42e09-acb3-4f75-9911-a5ddde437ed6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bddfccb-0dc7-430f-88b6-41e25e23d934", "tag": "de69109c-8655-473d-928d-a038a1218ac8"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:28:59.901510 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1739/3470] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:28:59 2022] GET /compute/v2.1/images/5a6b77af-38ff-4cde-8d04-bfb80a15f829 => generated 1411 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:28:59.918727 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-8be9180c-f886-4cdf-82c0-066f63f24711 req-62d42e09-acb3-4f75-9911-a5ddde437ed6 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:59.919419 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-8be9180c-f886-4cdf-82c0-066f63f24711 req-62d42e09-acb3-4f75-9911-a5ddde437ed6 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:59.919842 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-8be9180c-f886-4cdf-82c0-066f63f24711 req-62d42e09-acb3-4f75-9911-a5ddde437ed6 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:59.939698 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-8be9180c-f886-4cdf-82c0-066f63f24711 req-62d42e09-acb3-4f75-9911-a5ddde437ed6 service nova] Creating event network-changed:de69109c-8655-473d-928d-a038a1218ac8 for instance 0bddfccb-0dc7-430f-88b6-41e25e23d934 on n-h1-master-1 Oct 30 01:28:59.939892 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a1b5d1cf-f8c1-4768-9f3b-40f7a505c098 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:59.939892 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a1b5d1cf-f8c1-4768-9f3b-40f7a505c098 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] [instance: 0bddfccb-0dc7-430f-88b6-41e25e23d934] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:59.940394 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-8be9180c-f886-4cdf-82c0-066f63f24711 req-62d42e09-acb3-4f75-9911-a5ddde437ed6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044382 Oct 30 01:28:59.941411 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1732/3471] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:28:59.946849 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a1b5d1cf-f8c1-4768-9f3b-40f7a505c098 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:59.947465 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a1b5d1cf-f8c1-4768-9f3b-40f7a505c098 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:59.947997 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a1b5d1cf-f8c1-4768-9f3b-40f7a505c098 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:59.948800 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a1b5d1cf-f8c1-4768-9f3b-40f7a505c098 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:59.949002 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7532b40c-0350-4dc0-bdd6-05d1a5ad8de2 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:28:59.949484 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a1b5d1cf-f8c1-4768-9f3b-40f7a505c098 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:59.950112 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7532b40c-0350-4dc0-bdd6-05d1a5ad8de2 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 2873be88-5d85-49c6-833f-19b7df1fcf5f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:28:59.950699 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a1b5d1cf-f8c1-4768-9f3b-40f7a505c098 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:59.958561 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7532b40c-0350-4dc0-bdd6-05d1a5ad8de2 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:59.960341 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7532b40c-0350-4dc0-bdd6-05d1a5ad8de2 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:59.963259 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7532b40c-0350-4dc0-bdd6-05d1a5ad8de2 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:28:59.964275 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7532b40c-0350-4dc0-bdd6-05d1a5ad8de2 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:28:59.971690 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7532b40c-0350-4dc0-bdd6-05d1a5ad8de2 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:28:59.972321 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7532b40c-0350-4dc0-bdd6-05d1a5ad8de2 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:00.652069 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a1b5d1cf-f8c1-4768-9f3b-40f7a505c098 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b3394f28c4f444f8cd8bda6bacc9fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1e9b74043548e48a5bb8fb4d054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:00.660288 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7532b40c-0350-4dc0-bdd6-05d1a5ad8de2 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:00.667612 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a1b5d1cf-f8c1-4768-9f3b-40f7a505c098 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] 10.222.0.13 "GET /compute/v2.1/servers/0bddfccb-0dc7-430f-88b6-41e25e23d934" status: 200 len: 1395 microversion: 2.1 time: 0.764911 Oct 30 01:29:00.669366 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1740/3472] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:59 2022] GET /compute/v2.1/servers/0bddfccb-0dc7-430f-88b6-41e25e23d934 => generated 1395 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:00.675063 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-53cc5153-e10d-42ab-b132-3c3fc28b0d09 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:00.676549 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-53cc5153-e10d-42ab-b132-3c3fc28b0d09 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 2864065f-4af8-4134-b3f6-af254b7ab474] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:00.703013 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7532b40c-0350-4dc0-bdd6-05d1a5ad8de2 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f" status: 200 len: 1523 microversion: 2.1 time: 0.759908 Oct 30 01:29:00.708521 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1733/3473] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:28:59 2022] GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f => generated 1523 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:00.722941 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d2a8cc6d-53d6-49ec-9b93-be245f211aa9 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44c73a8790>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:00.738775 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=12 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:00.796825 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d2a8cc6d-53d6-49ec-9b93-be245f211aa9 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/5a6b77af-38ff-4cde-8d04-bfb80a15f829" status: 200 len: 1411 microversion: 2.1 time: 0.084929 Oct 30 01:29:00.798895 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1734/3474] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:29:00 2022] GET /compute/v2.1/images/5a6b77af-38ff-4cde-8d04-bfb80a15f829 => generated 1411 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:00.805350 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ee2fccf1-3990-4357-ae92-fce48b0bc51f tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:00.806240 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ee2fccf1-3990-4357-ae92-fce48b0bc51f tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d7cd54fb-1c64-4fb8-a97b-4d5c81a48009] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:00.821670 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-53cc5153-e10d-42ab-b132-3c3fc28b0d09 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:00.821939 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee2fccf1-3990-4357-ae92-fce48b0bc51f tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:00.822567 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee2fccf1-3990-4357-ae92-fce48b0bc51f tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:00.823723 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee2fccf1-3990-4357-ae92-fce48b0bc51f tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:00.825220 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee2fccf1-3990-4357-ae92-fce48b0bc51f tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:00.825877 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee2fccf1-3990-4357-ae92-fce48b0bc51f tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:00.826490 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee2fccf1-3990-4357-ae92-fce48b0bc51f tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:00.835729 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-53cc5153-e10d-42ab-b132-3c3fc28b0d09 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/2864065f-4af8-4134-b3f6-af254b7ab474" status: 200 len: 1193 microversion: 2.1 time: 0.164387 Oct 30 01:29:00.838431 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1741/3475] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:00 2022] GET /compute/v2.1/servers/2864065f-4af8-4134-b3f6-af254b7ab474 => generated 1193 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:00.859475 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3868f35f-9ff1-464b-8dd2-1477baa063b9 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:00.861518 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3868f35f-9ff1-464b-8dd2-1477baa063b9 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:00.870393 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3868f35f-9ff1-464b-8dd2-1477baa063b9 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:00.875810 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3868f35f-9ff1-464b-8dd2-1477baa063b9 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:00.875810 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3868f35f-9ff1-464b-8dd2-1477baa063b9 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:00.875810 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3868f35f-9ff1-464b-8dd2-1477baa063b9 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:00.875810 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3868f35f-9ff1-464b-8dd2-1477baa063b9 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:00.877557 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3868f35f-9ff1-464b-8dd2-1477baa063b9 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:01.241218 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ee2fccf1-3990-4357-ae92-fce48b0bc51f tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:01.249970 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ee2fccf1-3990-4357-ae92-fce48b0bc51f tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009" status: 200 len: 1314 microversion: 2.1 time: 0.449732 Oct 30 01:29:01.250646 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1735/3476] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:00 2022] GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 => generated 1314 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:01.255806 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b5241ba5-6586-4ae3-9978-3b133b2dc59e tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44c74753a0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:01.311127 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3868f35f-9ff1-464b-8dd2-1477baa063b9 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:01.321225 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3868f35f-9ff1-464b-8dd2-1477baa063b9 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:01.324098 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3868f35f-9ff1-464b-8dd2-1477baa063b9 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:01.325901 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3868f35f-9ff1-464b-8dd2-1477baa063b9 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1873 microversion: 2.32 time: 0.486090 Oct 30 01:29:01.326507 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1742/3477] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:29:00 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1873 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:29:01.558719 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b5241ba5-6586-4ae3-9978-3b133b2dc59e tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "DELETE /compute/v2.1/images/5a6b77af-38ff-4cde-8d04-bfb80a15f829" status: 204 len: 0 microversion: 2.1 time: 0.306841 Oct 30 01:29:01.559491 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1736/3478] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:01 2022] DELETE /compute/v2.1/images/5a6b77af-38ff-4cde-8d04-bfb80a15f829 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:29:01.569557 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-19739a08-8e02-4ba9-be42-743de62111d9 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44c7b34790>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:01.602037 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-19739a08-8e02-4ba9-be42-743de62111d9 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] HTTP exception thrown: Image not found. Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-19739a08-8e02-4ba9-be42-743de62111d9 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Request method failure captured: Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/images/5a6b77af-38ff-4cde-8d04-bfb80a15f829 HTTP/1.1 Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdHeyUy7YRlBOjEIMB2SM5IZKoEM9E4CcgE_HPOqloJp1NZnn6dha472SrZ31y2exANSVhQ3YMhYfN1WKKWmY5LYeNp42aJgNRzc0qxtfn3HVOOFRHdXQayAjQiB3EhVLJEEiK3-p5hlGh_9_wOga5iGlHo5mVxXdGv2Ye2RftSaR1s Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 4aa9c648b20d41d7b150fbf64cde6fe8 Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ImagesTestJSON-298836005 Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ImagesTestJSON-298836005 Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 4aa9c648b20d41d7b150fbf64cde6fe8 Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ImagesTestJSON-298836005 Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ImagesTestJSON-298836005-project Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: f857d6b0826e47c6875a307e7ccfb104 Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ImagesTestJSON-298836005-project Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: method: Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: exception: Image not found. Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '5a6b77af-38ff-4cde-8d04-bfb80a15f829'} Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5a6b77af-38ff-4cde-8d04-bfb80a15f829 Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 30 01:29:01.604221 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 30 01:29:01.610477 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 30 01:29:01.610477 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 30 01:29:01.610477 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 30 01:29:01.610477 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 30 01:29:01.610477 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 30 01:29:01.610477 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 30 01:29:01.610477 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 30 01:29:01.610477 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 30 01:29:01.610477 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 30 01:29:01.610477 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 30 01:29:01.610477 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 30 01:29:01.610477 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 30 01:29:01.610477 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 30 01:29:01.610477 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 30 01:29:01.610477 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 30 01:29:01.610477 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 30 01:29:01.610477 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5a6b77af-38ff-4cde-8d04-bfb80a15f829 could not be found. Oct 30 01:29:01.610477 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:29:01.610477 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:29:01.610477 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:29:01.610477 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:01.610477 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:29:01.610477 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:29:01.610477 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:29:01.610477 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:29:01.610477 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:29:01.610477 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:29:01.610477 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:29:01.610477 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:29:01.610477 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 30 01:29:01.610477 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 30 01:29:01.610477 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 30 01:29:01.610477 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:29:01.610477 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:29:01.610477 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:29:01.610477 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:01.610477 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:29:01.610477 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:29:01.610477 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:29:01.610477 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:29:01.610477 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 30 01:29:01.610477 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:29:01.610477 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-19739a08-8e02-4ba9-be42-743de62111d9 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Returning 404 to user: Image not found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:29:01.610477 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-19739a08-8e02-4ba9-be42-743de62111d9 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/images/5a6b77af-38ff-4cde-8d04-bfb80a15f829" status: 404 len: 62 microversion: 2.1 time: 0.042165 Oct 30 01:29:01.610477 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1743/3479] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:29:01 2022] GET /compute/v2.1/images/5a6b77af-38ff-4cde-8d04-bfb80a15f829 => generated 62 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:29:01.620165 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3ee820c9-6b96-4013-ad76-94681bdec3c4 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:01.620954 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3ee820c9-6b96-4013-ad76-94681bdec3c4 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: fbbfb1ca-5624-4baf-b498-1f9b75c194cb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:01.629064 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3ee820c9-6b96-4013-ad76-94681bdec3c4 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:01.632369 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3ee820c9-6b96-4013-ad76-94681bdec3c4 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:01.633839 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3ee820c9-6b96-4013-ad76-94681bdec3c4 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:01.641945 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3ee820c9-6b96-4013-ad76-94681bdec3c4 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:01.641945 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3ee820c9-6b96-4013-ad76-94681bdec3c4 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:01.641945 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3ee820c9-6b96-4013-ad76-94681bdec3c4 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:01.693062 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c99ae927-46ee-4ee3-8cca-63daa76ecee5 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:01.694465 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c99ae927-46ee-4ee3-8cca-63daa76ecee5 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] [instance: 0bddfccb-0dc7-430f-88b6-41e25e23d934] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:01.702428 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c99ae927-46ee-4ee3-8cca-63daa76ecee5 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:01.703254 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c99ae927-46ee-4ee3-8cca-63daa76ecee5 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:01.703935 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c99ae927-46ee-4ee3-8cca-63daa76ecee5 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:01.705020 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c99ae927-46ee-4ee3-8cca-63daa76ecee5 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:01.705723 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c99ae927-46ee-4ee3-8cca-63daa76ecee5 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:01.706480 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c99ae927-46ee-4ee3-8cca-63daa76ecee5 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:02.022755 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3ee820c9-6b96-4013-ad76-94681bdec3c4 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:02.031559 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3ee820c9-6b96-4013-ad76-94681bdec3c4 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/fbbfb1ca-5624-4baf-b498-1f9b75c194cb" status: 200 len: 1505 microversion: 2.1 time: 0.416240 Oct 30 01:29:02.031687 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1737/3480] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:01 2022] GET /compute/v2.1/servers/fbbfb1ca-5624-4baf-b498-1f9b75c194cb => generated 1505 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:02.036853 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8a1c06aa-7f37-464c-8ba5-da8e54e1e749 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:02.037523 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8a1c06aa-7f37-464c-8ba5-da8e54e1e749 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 2873be88-5d85-49c6-833f-19b7df1fcf5f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:02.046603 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8a1c06aa-7f37-464c-8ba5-da8e54e1e749 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:02.046992 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8a1c06aa-7f37-464c-8ba5-da8e54e1e749 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:02.049775 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8a1c06aa-7f37-464c-8ba5-da8e54e1e749 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:02.052661 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8a1c06aa-7f37-464c-8ba5-da8e54e1e749 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:02.053521 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8a1c06aa-7f37-464c-8ba5-da8e54e1e749 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:02.059664 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8a1c06aa-7f37-464c-8ba5-da8e54e1e749 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:02.060923 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c99ae927-46ee-4ee3-8cca-63daa76ecee5 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b3394f28c4f444f8cd8bda6bacc9fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1e9b74043548e48a5bb8fb4d054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:02.073735 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c99ae927-46ee-4ee3-8cca-63daa76ecee5 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] 10.222.0.13 "GET /compute/v2.1/servers/0bddfccb-0dc7-430f-88b6-41e25e23d934" status: 200 len: 1395 microversion: 2.1 time: 0.385046 Oct 30 01:29:02.074789 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1744/3481] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:01 2022] GET /compute/v2.1/servers/0bddfccb-0dc7-430f-88b6-41e25e23d934 => generated 1395 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:29:02.082132 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-51e9ad1f-ea85-4d4e-9f68-a5a534f2379f req-365ccdb1-66a7-431c-912a-728b94dceba1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7cd54fb-1c64-4fb8-a97b-4d5c81a48009", "tag": "34dca13c-1065-4ac2-b6d6-9e07c5bf363e"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:29:02.098116 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-51e9ad1f-ea85-4d4e-9f68-a5a534f2379f req-365ccdb1-66a7-431c-912a-728b94dceba1 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:02.100029 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-51e9ad1f-ea85-4d4e-9f68-a5a534f2379f req-365ccdb1-66a7-431c-912a-728b94dceba1 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:02.100931 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-51e9ad1f-ea85-4d4e-9f68-a5a534f2379f req-365ccdb1-66a7-431c-912a-728b94dceba1 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:02.114951 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-51e9ad1f-ea85-4d4e-9f68-a5a534f2379f req-365ccdb1-66a7-431c-912a-728b94dceba1 service nova] Creating event network-changed:34dca13c-1065-4ac2-b6d6-9e07c5bf363e for instance d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 on n-h1-master-1 Oct 30 01:29:02.121050 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-51e9ad1f-ea85-4d4e-9f68-a5a534f2379f req-365ccdb1-66a7-431c-912a-728b94dceba1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044615 Oct 30 01:29:02.121933 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1745/3482] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:29:02.127126 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3403eaa9-f548-49c8-805b-d927e81af232 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:02.128073 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3403eaa9-f548-49c8-805b-d927e81af232 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 2864065f-4af8-4134-b3f6-af254b7ab474] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:02.135182 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3403eaa9-f548-49c8-805b-d927e81af232 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:02.136338 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3403eaa9-f548-49c8-805b-d927e81af232 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:02.136974 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3403eaa9-f548-49c8-805b-d927e81af232 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:02.137928 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3403eaa9-f548-49c8-805b-d927e81af232 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:02.138998 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3403eaa9-f548-49c8-805b-d927e81af232 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:02.139593 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3403eaa9-f548-49c8-805b-d927e81af232 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:02.260315 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3403eaa9-f548-49c8-805b-d927e81af232 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:02.270594 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3403eaa9-f548-49c8-805b-d927e81af232 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/2864065f-4af8-4134-b3f6-af254b7ab474" status: 200 len: 1197 microversion: 2.1 time: 0.147277 Oct 30 01:29:02.271192 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1746/3483] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:02 2022] GET /compute/v2.1/servers/2864065f-4af8-4134-b3f6-af254b7ab474 => generated 1197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:02.307094 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ff3de2ba-f5ff-4a1d-b7b3-e2894900f51a tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:02.310535 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ff3de2ba-f5ff-4a1d-b7b3-e2894900f51a tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d7cd54fb-1c64-4fb8-a97b-4d5c81a48009] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:02.332569 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ff3de2ba-f5ff-4a1d-b7b3-e2894900f51a tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:02.333258 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ff3de2ba-f5ff-4a1d-b7b3-e2894900f51a tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:02.345961 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ff3de2ba-f5ff-4a1d-b7b3-e2894900f51a tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:02.347302 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ff3de2ba-f5ff-4a1d-b7b3-e2894900f51a tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:02.347862 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ff3de2ba-f5ff-4a1d-b7b3-e2894900f51a tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:02.348303 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ff3de2ba-f5ff-4a1d-b7b3-e2894900f51a tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:02.570705 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8a1c06aa-7f37-464c-8ba5-da8e54e1e749 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:02.585430 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8a1c06aa-7f37-464c-8ba5-da8e54e1e749 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f" status: 200 len: 1523 microversion: 2.1 time: 0.552648 Oct 30 01:29:02.587447 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1738/3484] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:02 2022] GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f => generated 1523 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:02.594876 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0f49f0cc-864d-4a1e-8c03-45c8bf729fc5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:02.596297 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0f49f0cc-864d-4a1e-8c03-45c8bf729fc5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:02.609115 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0f49f0cc-864d-4a1e-8c03-45c8bf729fc5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:02.610548 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0f49f0cc-864d-4a1e-8c03-45c8bf729fc5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:02.611176 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0f49f0cc-864d-4a1e-8c03-45c8bf729fc5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:02.630757 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0f49f0cc-864d-4a1e-8c03-45c8bf729fc5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:02.631263 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0f49f0cc-864d-4a1e-8c03-45c8bf729fc5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:02.631723 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0f49f0cc-864d-4a1e-8c03-45c8bf729fc5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:02.742513 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ff3de2ba-f5ff-4a1d-b7b3-e2894900f51a tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:02.750725 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ff3de2ba-f5ff-4a1d-b7b3-e2894900f51a tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009" status: 200 len: 1314 microversion: 2.1 time: 0.452208 Oct 30 01:29:02.757864 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1747/3485] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:02 2022] GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 => generated 1314 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:03.023318 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0f49f0cc-864d-4a1e-8c03-45c8bf729fc5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:03.035053 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0f49f0cc-864d-4a1e-8c03-45c8bf729fc5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:03.036779 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0f49f0cc-864d-4a1e-8c03-45c8bf729fc5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:03.038514 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0f49f0cc-864d-4a1e-8c03-45c8bf729fc5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1873 microversion: 2.32 time: 0.449878 Oct 30 01:29:03.039803 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1739/3486] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:29:02 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1873 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:29:03.067083 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bfb82ef3-7a38-43a8-aac9-0418a7076e37 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:03.067083 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-bfb82ef3-7a38-43a8-aac9-0418a7076e37 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: fbbfb1ca-5624-4baf-b498-1f9b75c194cb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:03.067083 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bfb82ef3-7a38-43a8-aac9-0418a7076e37 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:03.067083 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bfb82ef3-7a38-43a8-aac9-0418a7076e37 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:03.067083 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bfb82ef3-7a38-43a8-aac9-0418a7076e37 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:03.067708 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bfb82ef3-7a38-43a8-aac9-0418a7076e37 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:03.068174 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bfb82ef3-7a38-43a8-aac9-0418a7076e37 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:03.068830 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bfb82ef3-7a38-43a8-aac9-0418a7076e37 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:03.103321 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4ae2375e-a5cf-4a71-a195-4b782b75a1ce tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:03.104142 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4ae2375e-a5cf-4a71-a195-4b782b75a1ce tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] [instance: 0bddfccb-0dc7-430f-88b6-41e25e23d934] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:03.113379 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4ae2375e-a5cf-4a71-a195-4b782b75a1ce tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:03.114100 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4ae2375e-a5cf-4a71-a195-4b782b75a1ce tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:03.121964 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4ae2375e-a5cf-4a71-a195-4b782b75a1ce tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:03.122932 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4ae2375e-a5cf-4a71-a195-4b782b75a1ce tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:03.123642 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4ae2375e-a5cf-4a71-a195-4b782b75a1ce tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:03.124243 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4ae2375e-a5cf-4a71-a195-4b782b75a1ce tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:03.467342 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-bfb82ef3-7a38-43a8-aac9-0418a7076e37 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:03.476063 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4ae2375e-a5cf-4a71-a195-4b782b75a1ce tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b3394f28c4f444f8cd8bda6bacc9fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1e9b74043548e48a5bb8fb4d054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:03.479110 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4ae2375e-a5cf-4a71-a195-4b782b75a1ce tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] 10.222.0.13 "GET /compute/v2.1/servers/0bddfccb-0dc7-430f-88b6-41e25e23d934" status: 200 len: 1395 microversion: 2.1 time: 0.379686 Oct 30 01:29:03.479690 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1740/3487] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:03 2022] GET /compute/v2.1/servers/0bddfccb-0dc7-430f-88b6-41e25e23d934 => generated 1395 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:29:03.485008 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ca161692-e1a8-492a-91b5-d751819ded90 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:03.485833 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ca161692-e1a8-492a-91b5-d751819ded90 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 2864065f-4af8-4134-b3f6-af254b7ab474] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:03.494670 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ca161692-e1a8-492a-91b5-d751819ded90 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:03.495449 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ca161692-e1a8-492a-91b5-d751819ded90 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:03.496073 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ca161692-e1a8-492a-91b5-d751819ded90 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:03.497071 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ca161692-e1a8-492a-91b5-d751819ded90 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:03.497738 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ca161692-e1a8-492a-91b5-d751819ded90 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:03.498079 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bfb82ef3-7a38-43a8-aac9-0418a7076e37 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/fbbfb1ca-5624-4baf-b498-1f9b75c194cb" status: 200 len: 1487 microversion: 2.1 time: 0.443755 Oct 30 01:29:03.498213 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ca161692-e1a8-492a-91b5-d751819ded90 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:03.498797 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1748/3488] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:03 2022] GET /compute/v2.1/servers/fbbfb1ca-5624-4baf-b498-1f9b75c194cb => generated 1487 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:03.530852 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2078979d-1425-4ed7-962c-bf0fab9bb565 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:03.531515 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2078979d-1425-4ed7-962c-bf0fab9bb565 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: fbbfb1ca-5624-4baf-b498-1f9b75c194cb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:03.539030 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2078979d-1425-4ed7-962c-bf0fab9bb565 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:03.539519 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2078979d-1425-4ed7-962c-bf0fab9bb565 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:03.540172 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2078979d-1425-4ed7-962c-bf0fab9bb565 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:03.540884 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2078979d-1425-4ed7-962c-bf0fab9bb565 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:03.541378 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2078979d-1425-4ed7-962c-bf0fab9bb565 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:03.541771 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2078979d-1425-4ed7-962c-bf0fab9bb565 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:03.570533 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2078979d-1425-4ed7-962c-bf0fab9bb565 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: fbbfb1ca-5624-4baf-b498-1f9b75c194cb] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:29:03.580304 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ca161692-e1a8-492a-91b5-d751819ded90 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:03.589164 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ca161692-e1a8-492a-91b5-d751819ded90 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/2864065f-4af8-4134-b3f6-af254b7ab474" status: 200 len: 1245 microversion: 2.1 time: 0.107921 Oct 30 01:29:03.589814 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1741/3489] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:03 2022] GET /compute/v2.1/servers/2864065f-4af8-4134-b3f6-af254b7ab474 => generated 1245 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:03.615518 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a5da57a7-50b0-4e23-b6c0-34d50a20072f tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:03.616140 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a5da57a7-50b0-4e23-b6c0-34d50a20072f tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 2873be88-5d85-49c6-833f-19b7df1fcf5f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:03.622770 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a5da57a7-50b0-4e23-b6c0-34d50a20072f tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:03.630640 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a5da57a7-50b0-4e23-b6c0-34d50a20072f tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:03.630640 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a5da57a7-50b0-4e23-b6c0-34d50a20072f tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:03.630640 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a5da57a7-50b0-4e23-b6c0-34d50a20072f tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:03.630640 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a5da57a7-50b0-4e23-b6c0-34d50a20072f tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:03.630640 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a5da57a7-50b0-4e23-b6c0-34d50a20072f tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:03.630640 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:03.867073 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a5da57a7-50b0-4e23-b6c0-34d50a20072f tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:03.878802 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a5da57a7-50b0-4e23-b6c0-34d50a20072f tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f" status: 200 len: 1523 microversion: 2.1 time: 0.266638 Oct 30 01:29:03.885463 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1742/3490] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:03 2022] GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f => generated 1523 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:29:03.887823 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6c8c46cf-5b07-4814-8128-eeb4e33efbc8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:03.888865 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6c8c46cf-5b07-4814-8128-eeb4e33efbc8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d7cd54fb-1c64-4fb8-a97b-4d5c81a48009] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:03.909738 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c8c46cf-5b07-4814-8128-eeb4e33efbc8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:03.910294 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c8c46cf-5b07-4814-8128-eeb4e33efbc8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:03.910742 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c8c46cf-5b07-4814-8128-eeb4e33efbc8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:03.911458 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c8c46cf-5b07-4814-8128-eeb4e33efbc8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:03.911915 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c8c46cf-5b07-4814-8128-eeb4e33efbc8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:03.912396 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c8c46cf-5b07-4814-8128-eeb4e33efbc8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:03.961248 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2078979d-1425-4ed7-962c-bf0fab9bb565 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "DELETE /compute/v2.1/servers/fbbfb1ca-5624-4baf-b498-1f9b75c194cb" status: 204 len: 0 microversion: 2.1 time: 0.434367 Oct 30 01:29:03.961959 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1749/3491] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:29:03 2022] DELETE /compute/v2.1/servers/fbbfb1ca-5624-4baf-b498-1f9b75c194cb => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 30 01:29:03.981139 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-20eb8bd7-9251-4c0a-8777-0717bddf842e tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44cc0d4d30>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:04.018650 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-20eb8bd7-9251-4c0a-8777-0717bddf842e tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] HTTP exception thrown: Image not found. Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-20eb8bd7-9251-4c0a-8777-0717bddf842e tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Request method failure captured: Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: request: DELETE /compute/v2.1/images/5a6b77af-38ff-4cde-8d04-bfb80a15f829 HTTP/1.1 Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdHeyUy7YRlBOjEIMB2SM5IZKoEM9E4CcgE_HPOqloJp1NZnn6dha472SrZ31y2exANSVhQ3YMhYfN1WKKWmY5LYeNp42aJgNRzc0qxtfn3HVOOFRHdXQayAjQiB3EhVLJEEiK3-p5hlGh_9_wOga5iGlHo5mVxXdGv2Ye2RftSaR1s Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 4aa9c648b20d41d7b150fbf64cde6fe8 Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ImagesTestJSON-298836005 Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ImagesTestJSON-298836005 Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 4aa9c648b20d41d7b150fbf64cde6fe8 Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ImagesTestJSON-298836005 Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ImagesTestJSON-298836005-project Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: f857d6b0826e47c6875a307e7ccfb104 Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ImagesTestJSON-298836005-project Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: method: Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: exception: Image not found. Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '5a6b77af-38ff-4cde-8d04-bfb80a15f829'} Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 5a6b77af-38ff-4cde-8d04-bfb80a15f829 to delete Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5a6b77af-38ff-4cde-8d04-bfb80a15f829 could not be found. Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:29:04.023044 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:04.031133 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:29:04.031133 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:29:04.031133 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:29:04.031133 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:29:04.031133 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:29:04.031133 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:29:04.031133 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:29:04.031133 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:29:04.031133 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 30 01:29:04.031133 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 30 01:29:04.031133 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 30 01:29:04.031133 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:29:04.031133 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:29:04.031133 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:29:04.031133 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:04.031133 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:29:04.031133 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:29:04.031133 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:29:04.031133 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:29:04.031133 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 30 01:29:04.031133 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:29:04.031133 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-20eb8bd7-9251-4c0a-8777-0717bddf842e tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Returning 404 to user: Image not found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:29:04.034186 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-20eb8bd7-9251-4c0a-8777-0717bddf842e tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "DELETE /compute/v2.1/images/5a6b77af-38ff-4cde-8d04-bfb80a15f829" status: 404 len: 62 microversion: 2.1 time: 0.057277 Oct 30 01:29:04.034758 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1750/3492] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:03 2022] DELETE /compute/v2.1/images/5a6b77af-38ff-4cde-8d04-bfb80a15f829 => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 30 01:29:04.043859 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-64f2ec72-eede-4af0-92af-7ae4e36131bd tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:04.048939 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-64f2ec72-eede-4af0-92af-7ae4e36131bd tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: fbbfb1ca-5624-4baf-b498-1f9b75c194cb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:04.062493 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-64f2ec72-eede-4af0-92af-7ae4e36131bd tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:04.065611 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-64f2ec72-eede-4af0-92af-7ae4e36131bd tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:04.069372 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-64f2ec72-eede-4af0-92af-7ae4e36131bd tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:04.069372 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-64f2ec72-eede-4af0-92af-7ae4e36131bd tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:04.069372 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-64f2ec72-eede-4af0-92af-7ae4e36131bd tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:04.069372 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-64f2ec72-eede-4af0-92af-7ae4e36131bd tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:04.098793 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-64f2ec72-eede-4af0-92af-7ae4e36131bd tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: fbbfb1ca-5624-4baf-b498-1f9b75c194cb] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:29:04.152593 n-d-master-1 devstack@n-api.service[121103]: INFO nova.compute.api [None req-64f2ec72-eede-4af0-92af-7ae4e36131bd tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: fbbfb1ca-5624-4baf-b498-1f9b75c194cb] Instance is already in deleting state, ignoring this request Oct 30 01:29:04.153579 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-64f2ec72-eede-4af0-92af-7ae4e36131bd tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "DELETE /compute/v2.1/servers/fbbfb1ca-5624-4baf-b498-1f9b75c194cb" status: 204 len: 0 microversion: 2.1 time: 0.113805 Oct 30 01:29:04.154542 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1751/3493] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:29:04 2022] DELETE /compute/v2.1/servers/fbbfb1ca-5624-4baf-b498-1f9b75c194cb => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:29:04.160229 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f75b4b18-8349-4612-89e1-b9b0c17cc2de tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:04.161114 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f75b4b18-8349-4612-89e1-b9b0c17cc2de tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:04.167585 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:04.169551 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f75b4b18-8349-4612-89e1-b9b0c17cc2de tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:04.170279 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f75b4b18-8349-4612-89e1-b9b0c17cc2de tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:04.170925 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f75b4b18-8349-4612-89e1-b9b0c17cc2de tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:04.172022 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f75b4b18-8349-4612-89e1-b9b0c17cc2de tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:04.172700 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f75b4b18-8349-4612-89e1-b9b0c17cc2de tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:04.179056 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f75b4b18-8349-4612-89e1-b9b0c17cc2de tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:04.493254 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6c8c46cf-5b07-4814-8128-eeb4e33efbc8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:04.501001 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6c8c46cf-5b07-4814-8128-eeb4e33efbc8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009" status: 200 len: 1314 microversion: 2.1 time: 0.620221 Oct 30 01:29:04.513913 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1743/3494] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:03 2022] GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 => generated 1314 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:04.534293 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2d85fb13-f30c-42af-b33e-eacde4f1eba5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:04.536634 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2d85fb13-f30c-42af-b33e-eacde4f1eba5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: fbbfb1ca-5624-4baf-b498-1f9b75c194cb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:04.550088 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2d85fb13-f30c-42af-b33e-eacde4f1eba5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:04.550893 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2d85fb13-f30c-42af-b33e-eacde4f1eba5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:04.552446 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2d85fb13-f30c-42af-b33e-eacde4f1eba5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:04.554019 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2d85fb13-f30c-42af-b33e-eacde4f1eba5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:04.555834 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2d85fb13-f30c-42af-b33e-eacde4f1eba5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:04.556632 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2d85fb13-f30c-42af-b33e-eacde4f1eba5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:04.574144 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f75b4b18-8349-4612-89e1-b9b0c17cc2de tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:04.585660 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f75b4b18-8349-4612-89e1-b9b0c17cc2de tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:04.587188 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f75b4b18-8349-4612-89e1-b9b0c17cc2de tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:04.588347 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f75b4b18-8349-4612-89e1-b9b0c17cc2de tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1873 microversion: 2.32 time: 0.432626 Oct 30 01:29:04.598776 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1752/3495] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:29:04 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1873 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:29:04.598776 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-3d8adafc-c75a-48ec-b43b-3aa7be923a3c req-e91f44bd-c6df-485c-bc1c-114f40fc9e32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bddfccb-0dc7-430f-88b6-41e25e23d934", "name": "network-vif-plugged", "status": "completed", "tag": "de69109c-8655-473d-928d-a038a1218ac8"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:29:04.603560 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-3d8adafc-c75a-48ec-b43b-3aa7be923a3c req-e91f44bd-c6df-485c-bc1c-114f40fc9e32 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:04.604039 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-3d8adafc-c75a-48ec-b43b-3aa7be923a3c req-e91f44bd-c6df-485c-bc1c-114f40fc9e32 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:04.604464 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-3d8adafc-c75a-48ec-b43b-3aa7be923a3c req-e91f44bd-c6df-485c-bc1c-114f40fc9e32 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:04.617815 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-3d8adafc-c75a-48ec-b43b-3aa7be923a3c req-e91f44bd-c6df-485c-bc1c-114f40fc9e32 service nova] Creating event network-vif-plugged:de69109c-8655-473d-928d-a038a1218ac8 for instance 0bddfccb-0dc7-430f-88b6-41e25e23d934 on n-h1-master-1 Oct 30 01:29:04.622903 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-3d8adafc-c75a-48ec-b43b-3aa7be923a3c req-e91f44bd-c6df-485c-bc1c-114f40fc9e32 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032801 Oct 30 01:29:04.623679 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1753/3496] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:29:04.629361 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7a9c2679-07f2-4f1d-8fb1-82391c450b37 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-550221714", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "1fbfd118-0471-427e-a225-1004b609fe77"}], "security_groups": [{"name": "tempest-securitygroup--47322909"}], "key_name": "tempest-keypair-382050845", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "82bd3825-c17a-48fd-ae71-7f149f4a43f6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:29:04.794898 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2d85fb13-f30c-42af-b33e-eacde4f1eba5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:04.804257 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2d85fb13-f30c-42af-b33e-eacde4f1eba5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/fbbfb1ca-5624-4baf-b498-1f9b75c194cb" status: 200 len: 1493 microversion: 2.1 time: 0.288355 Oct 30 01:29:04.804847 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1744/3497] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:04 2022] GET /compute/v2.1/servers/fbbfb1ca-5624-4baf-b498-1f9b75c194cb => generated 1493 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:04.809493 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f134cfb2-3e52-4a14-bdae-8351e97bddc6 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:04.812301 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f134cfb2-3e52-4a14-bdae-8351e97bddc6 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] [instance: 0bddfccb-0dc7-430f-88b6-41e25e23d934] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:04.818545 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f134cfb2-3e52-4a14-bdae-8351e97bddc6 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:04.819259 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f134cfb2-3e52-4a14-bdae-8351e97bddc6 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:04.819897 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f134cfb2-3e52-4a14-bdae-8351e97bddc6 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:04.820878 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f134cfb2-3e52-4a14-bdae-8351e97bddc6 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:04.821559 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f134cfb2-3e52-4a14-bdae-8351e97bddc6 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:04.822273 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f134cfb2-3e52-4a14-bdae-8351e97bddc6 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:04.831194 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-7a9c2679-07f2-4f1d-8fb1-82391c450b37 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] validate_networks() for [('1fbfd118-0471-427e-a225-1004b609fe77', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:29:05.089687 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f134cfb2-3e52-4a14-bdae-8351e97bddc6 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b3394f28c4f444f8cd8bda6bacc9fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1e9b74043548e48a5bb8fb4d054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:05.098435 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f134cfb2-3e52-4a14-bdae-8351e97bddc6 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] 10.222.0.13 "GET /compute/v2.1/servers/0bddfccb-0dc7-430f-88b6-41e25e23d934" status: 200 len: 1395 microversion: 2.1 time: 0.292470 Oct 30 01:29:05.099027 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1745/3498] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:04 2022] GET /compute/v2.1/servers/0bddfccb-0dc7-430f-88b6-41e25e23d934 => generated 1395 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:05.106873 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-df0bb05e-25b4-469b-bd2c-79475ceea11b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:05.107725 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-df0bb05e-25b4-469b-bd2c-79475ceea11b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 2864065f-4af8-4134-b3f6-af254b7ab474] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:05.114654 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df0bb05e-25b4-469b-bd2c-79475ceea11b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:05.115142 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df0bb05e-25b4-469b-bd2c-79475ceea11b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:05.115577 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df0bb05e-25b4-469b-bd2c-79475ceea11b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:05.116281 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df0bb05e-25b4-469b-bd2c-79475ceea11b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:05.116733 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df0bb05e-25b4-469b-bd2c-79475ceea11b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:05.117499 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df0bb05e-25b4-469b-bd2c-79475ceea11b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:05.200665 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-df0bb05e-25b4-469b-bd2c-79475ceea11b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:05.209096 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-df0bb05e-25b4-469b-bd2c-79475ceea11b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/2864065f-4af8-4134-b3f6-af254b7ab474" status: 200 len: 1253 microversion: 2.1 time: 0.108851 Oct 30 01:29:05.221875 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1746/3499] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:05 2022] GET /compute/v2.1/servers/2864065f-4af8-4134-b3f6-af254b7ab474 => generated 1253 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:05.230128 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1bfd794c-5e56-425a-9c9e-693dae72ea71 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:05.230810 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1bfd794c-5e56-425a-9c9e-693dae72ea71 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 2873be88-5d85-49c6-833f-19b7df1fcf5f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:05.240455 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1bfd794c-5e56-425a-9c9e-693dae72ea71 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:05.240973 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1bfd794c-5e56-425a-9c9e-693dae72ea71 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:05.241785 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1bfd794c-5e56-425a-9c9e-693dae72ea71 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:05.242145 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1bfd794c-5e56-425a-9c9e-693dae72ea71 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:05.242604 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1bfd794c-5e56-425a-9c9e-693dae72ea71 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:05.243745 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1bfd794c-5e56-425a-9c9e-693dae72ea71 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:05.514330 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1bfd794c-5e56-425a-9c9e-693dae72ea71 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:05.516183 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-7a9c2679-07f2-4f1d-8fb1-82391c450b37 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Getting quotas for project 0eba4d14f2004498850092bff100b757. Resources: dict_keys(['metadata_items']) {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:29:05.523555 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-7a9c2679-07f2-4f1d-8fb1-82391c450b37 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Getting quotas for user 2fd2e319840c4a8aab90b495374aa1d2 and project 0eba4d14f2004498850092bff100b757. Resources: dict_keys(['metadata_items']) {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:29:05.525975 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1bfd794c-5e56-425a-9c9e-693dae72ea71 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f" status: 200 len: 1523 microversion: 2.1 time: 0.302977 Oct 30 01:29:05.526759 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1747/3500] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:05 2022] GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f => generated 1523 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:05.537280 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d9b84dbb-843a-4758-9fea-d4e2966289d1 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:05.538486 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d9b84dbb-843a-4758-9fea-d4e2966289d1 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d7cd54fb-1c64-4fb8-a97b-4d5c81a48009] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:05.542471 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-7a9c2679-07f2-4f1d-8fb1-82391c450b37 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:29:05.543208 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-7a9c2679-07f2-4f1d-8fb1-82391c450b37 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:29:05.544059 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-7a9c2679-07f2-4f1d-8fb1-82391c450b37 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:29:05.544781 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-7a9c2679-07f2-4f1d-8fb1-82391c450b37 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:29:05.553799 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-7a9c2679-07f2-4f1d-8fb1-82391c450b37 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:29:05.556313 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9b84dbb-843a-4758-9fea-d4e2966289d1 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:05.556813 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9b84dbb-843a-4758-9fea-d4e2966289d1 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:05.557262 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9b84dbb-843a-4758-9fea-d4e2966289d1 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:05.558033 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9b84dbb-843a-4758-9fea-d4e2966289d1 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:05.558491 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9b84dbb-843a-4758-9fea-d4e2966289d1 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:05.558920 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9b84dbb-843a-4758-9fea-d4e2966289d1 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:05.565570 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7a9c2679-07f2-4f1d-8fb1-82391c450b37 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:05.566061 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7a9c2679-07f2-4f1d-8fb1-82391c450b37 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:05.566526 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7a9c2679-07f2-4f1d-8fb1-82391c450b37 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:05.567265 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7a9c2679-07f2-4f1d-8fb1-82391c450b37 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:05.567727 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7a9c2679-07f2-4f1d-8fb1-82391c450b37 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:05.568161 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7a9c2679-07f2-4f1d-8fb1-82391c450b37 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:05.587560 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-7a9c2679-07f2-4f1d-8fb1-82391c450b37 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Getting quotas for project 0eba4d14f2004498850092bff100b757. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:29:05.593237 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-7a9c2679-07f2-4f1d-8fb1-82391c450b37 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Getting quotas for user 2fd2e319840c4a8aab90b495374aa1d2 and project 0eba4d14f2004498850092bff100b757. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:29:05.670924 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7a9c2679-07f2-4f1d-8fb1-82391c450b37 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:29:05.674265 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7a9c2679-07f2-4f1d-8fb1-82391c450b37 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] [instance: 78081c7e-04f6-468e-9a0d-3c74c1092c6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='82bd3825-c17a-48fd-ae71-7f149f4a43f6',volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:29:05.810411 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d9b84dbb-843a-4758-9fea-d4e2966289d1 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:05.819332 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d9b84dbb-843a-4758-9fea-d4e2966289d1 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009" status: 200 len: 1314 microversion: 2.1 time: 0.287698 Oct 30 01:29:05.832302 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1748/3501] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:05 2022] GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:05.832302 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-231770ce-371f-401c-8920-8e8c4d13cb86 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:05.832302 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-231770ce-371f-401c-8920-8e8c4d13cb86 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:05.853851 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-231770ce-371f-401c-8920-8e8c4d13cb86 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:05.854357 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-231770ce-371f-401c-8920-8e8c4d13cb86 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:05.856003 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-231770ce-371f-401c-8920-8e8c4d13cb86 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:05.857442 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-231770ce-371f-401c-8920-8e8c4d13cb86 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:05.857442 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-231770ce-371f-401c-8920-8e8c4d13cb86 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:05.859652 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-231770ce-371f-401c-8920-8e8c4d13cb86 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:06.243235 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-231770ce-371f-401c-8920-8e8c4d13cb86 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:06.254978 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-231770ce-371f-401c-8920-8e8c4d13cb86 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:06.260632 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-231770ce-371f-401c-8920-8e8c4d13cb86 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:06.267131 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-231770ce-371f-401c-8920-8e8c4d13cb86 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1873 microversion: 2.32 time: 0.440192 Oct 30 01:29:06.268975 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1749/3502] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:29:05 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1873 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:29:06.274421 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f89a4518-853f-4563-a665-30ae50060516 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:06.275271 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f89a4518-853f-4563-a665-30ae50060516 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: fbbfb1ca-5624-4baf-b498-1f9b75c194cb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:06.281721 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f89a4518-853f-4563-a665-30ae50060516 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:06.282474 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f89a4518-853f-4563-a665-30ae50060516 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:06.283017 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f89a4518-853f-4563-a665-30ae50060516 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:06.284000 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f89a4518-853f-4563-a665-30ae50060516 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:06.284777 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f89a4518-853f-4563-a665-30ae50060516 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:06.285441 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f89a4518-853f-4563-a665-30ae50060516 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:06.355166 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7a9c2679-07f2-4f1d-8fb1-82391c450b37 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.730421 Oct 30 01:29:06.356201 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1754/3503] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:29:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 1732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:29:06.361000 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-78ec9bb3-b2be-4442-bf00-8c77f708380a tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:06.361992 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-78ec9bb3-b2be-4442-bf00-8c77f708380a tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] [instance: 0bddfccb-0dc7-430f-88b6-41e25e23d934] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:06.372631 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-78ec9bb3-b2be-4442-bf00-8c77f708380a tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:06.373501 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-78ec9bb3-b2be-4442-bf00-8c77f708380a tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:06.377260 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-78ec9bb3-b2be-4442-bf00-8c77f708380a tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:06.377260 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-78ec9bb3-b2be-4442-bf00-8c77f708380a tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:06.377260 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-78ec9bb3-b2be-4442-bf00-8c77f708380a tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:06.377260 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-78ec9bb3-b2be-4442-bf00-8c77f708380a tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:06.572380 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f89a4518-853f-4563-a665-30ae50060516 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:06.583957 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f89a4518-853f-4563-a665-30ae50060516 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/fbbfb1ca-5624-4baf-b498-1f9b75c194cb" status: 200 len: 1493 microversion: 2.1 time: 0.313467 Oct 30 01:29:06.586124 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1750/3504] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:06 2022] GET /compute/v2.1/servers/fbbfb1ca-5624-4baf-b498-1f9b75c194cb => generated 1493 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:06.593683 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bb520546-1bce-475a-aaa2-85c9d7534cc9 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:06.594649 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bb520546-1bce-475a-aaa2-85c9d7534cc9 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 2864065f-4af8-4134-b3f6-af254b7ab474] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:06.607088 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb520546-1bce-475a-aaa2-85c9d7534cc9 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:06.607088 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb520546-1bce-475a-aaa2-85c9d7534cc9 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:06.607088 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb520546-1bce-475a-aaa2-85c9d7534cc9 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:06.607088 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb520546-1bce-475a-aaa2-85c9d7534cc9 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:06.607088 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb520546-1bce-475a-aaa2-85c9d7534cc9 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:06.607088 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb520546-1bce-475a-aaa2-85c9d7534cc9 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:06.615828 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-78ec9bb3-b2be-4442-bf00-8c77f708380a tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b3394f28c4f444f8cd8bda6bacc9fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1e9b74043548e48a5bb8fb4d054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:06.625844 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-78ec9bb3-b2be-4442-bf00-8c77f708380a tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] 10.222.0.13 "GET /compute/v2.1/servers/0bddfccb-0dc7-430f-88b6-41e25e23d934" status: 200 len: 1395 microversion: 2.1 time: 0.268356 Oct 30 01:29:06.626435 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1755/3505] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:06 2022] GET /compute/v2.1/servers/0bddfccb-0dc7-430f-88b6-41e25e23d934 => generated 1395 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:06.649317 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-65f8b095-c456-441a-bdac-98ae5e2784de tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:06.649973 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-65f8b095-c456-441a-bdac-98ae5e2784de tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] [instance: 78081c7e-04f6-468e-9a0d-3c74c1092c6d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:06.704040 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bb520546-1bce-475a-aaa2-85c9d7534cc9 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:06.712490 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bb520546-1bce-475a-aaa2-85c9d7534cc9 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/2864065f-4af8-4134-b3f6-af254b7ab474" status: 200 len: 1251 microversion: 2.1 time: 0.124619 Oct 30 01:29:06.728634 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1751/3506] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:06 2022] GET /compute/v2.1/servers/2864065f-4af8-4134-b3f6-af254b7ab474 => generated 1251 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:06.728634 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1265d9da-9908-43b3-a71f-3cbe7c405e00 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:06.728634 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1265d9da-9908-43b3-a71f-3cbe7c405e00 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 2873be88-5d85-49c6-833f-19b7df1fcf5f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:06.728634 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1265d9da-9908-43b3-a71f-3cbe7c405e00 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:06.728634 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1265d9da-9908-43b3-a71f-3cbe7c405e00 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:06.728634 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1265d9da-9908-43b3-a71f-3cbe7c405e00 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:06.728634 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1265d9da-9908-43b3-a71f-3cbe7c405e00 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:06.728634 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1265d9da-9908-43b3-a71f-3cbe7c405e00 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:06.728634 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1265d9da-9908-43b3-a71f-3cbe7c405e00 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:06.749552 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-65f8b095-c456-441a-bdac-98ae5e2784de tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd2e319840c4a8aab90b495374aa1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eba4d14f2004498850092bff100b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:06.757002 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-65f8b095-c456-441a-bdac-98ae5e2784de tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] 10.222.0.13 "GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d" status: 200 len: 1120 microversion: 2.1 time: 0.128988 Oct 30 01:29:06.760752 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1756/3507] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:06 2022] GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d => generated 1120 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:06.774924 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-01643a50-72a6-446c-a3e7-ab8b56c0c2b3 req-cc9c73e3-32e1-497c-b9a4-8ff3983cdb19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7cd54fb-1c64-4fb8-a97b-4d5c81a48009", "name": "network-vif-plugged", "status": "completed", "tag": "34dca13c-1065-4ac2-b6d6-9e07c5bf363e"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:29:06.786061 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-01643a50-72a6-446c-a3e7-ab8b56c0c2b3 req-cc9c73e3-32e1-497c-b9a4-8ff3983cdb19 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:06.786604 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-01643a50-72a6-446c-a3e7-ab8b56c0c2b3 req-cc9c73e3-32e1-497c-b9a4-8ff3983cdb19 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:06.787025 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-01643a50-72a6-446c-a3e7-ab8b56c0c2b3 req-cc9c73e3-32e1-497c-b9a4-8ff3983cdb19 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:06.791307 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:06.797934 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-01643a50-72a6-446c-a3e7-ab8b56c0c2b3 req-cc9c73e3-32e1-497c-b9a4-8ff3983cdb19 service nova] Creating event network-vif-plugged:34dca13c-1065-4ac2-b6d6-9e07c5bf363e for instance d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 on n-h1-master-1 Oct 30 01:29:06.803179 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-01643a50-72a6-446c-a3e7-ab8b56c0c2b3 req-cc9c73e3-32e1-497c-b9a4-8ff3983cdb19 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043057 Oct 30 01:29:06.804139 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1757/3508] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:29:06.844197 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b5a44991-817f-46dc-b080-671adf16fc3b tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:06.844869 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b5a44991-817f-46dc-b080-671adf16fc3b tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d7cd54fb-1c64-4fb8-a97b-4d5c81a48009] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:06.857741 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b5a44991-817f-46dc-b080-671adf16fc3b tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:06.858455 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b5a44991-817f-46dc-b080-671adf16fc3b tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:06.859120 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b5a44991-817f-46dc-b080-671adf16fc3b tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:06.859843 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b5a44991-817f-46dc-b080-671adf16fc3b tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:06.863273 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b5a44991-817f-46dc-b080-671adf16fc3b tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:06.864254 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b5a44991-817f-46dc-b080-671adf16fc3b tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:06.879607 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1265d9da-9908-43b3-a71f-3cbe7c405e00 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:06.889372 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1265d9da-9908-43b3-a71f-3cbe7c405e00 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f" status: 200 len: 1523 microversion: 2.1 time: 0.175195 Oct 30 01:29:06.897802 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1752/3509] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:06 2022] GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:07.084945 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b5a44991-817f-46dc-b080-671adf16fc3b tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:07.098493 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b5a44991-817f-46dc-b080-671adf16fc3b tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009" status: 200 len: 1314 microversion: 2.1 time: 0.258850 Oct 30 01:29:07.099112 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1758/3510] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:06 2022] GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:07.217002 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-7e1e4d42-b5ff-4bb9-ae95-0b2f64d55890 req-df116cb1-ae20-4e1d-ae43-ab55ebf9733e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbbfb1ca-5624-4baf-b498-1f9b75c194cb", "name": "network-vif-deleted", "tag": "d7ec7460-259d-41ae-87e0-75972e297800"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:29:07.244224 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-7e1e4d42-b5ff-4bb9-ae95-0b2f64d55890 req-df116cb1-ae20-4e1d-ae43-ab55ebf9733e service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:07.245777 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-7e1e4d42-b5ff-4bb9-ae95-0b2f64d55890 req-df116cb1-ae20-4e1d-ae43-ab55ebf9733e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:07.247163 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-7e1e4d42-b5ff-4bb9-ae95-0b2f64d55890 req-df116cb1-ae20-4e1d-ae43-ab55ebf9733e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:07.289075 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-7e1e4d42-b5ff-4bb9-ae95-0b2f64d55890 req-df116cb1-ae20-4e1d-ae43-ab55ebf9733e service nova] Creating event network-vif-deleted:d7ec7460-259d-41ae-87e0-75972e297800 for instance fbbfb1ca-5624-4baf-b498-1f9b75c194cb on n-h2-master-1 Oct 30 01:29:07.300331 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-837d55b4-eee0-4b7f-b95e-8a5f257b0054 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:07.302422 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-837d55b4-eee0-4b7f-b95e-8a5f257b0054 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:07.304142 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-7e1e4d42-b5ff-4bb9-ae95-0b2f64d55890 req-df116cb1-ae20-4e1d-ae43-ab55ebf9733e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089473 Oct 30 01:29:07.305922 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1753/3511] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:29:07.314504 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-837d55b4-eee0-4b7f-b95e-8a5f257b0054 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:07.315296 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-837d55b4-eee0-4b7f-b95e-8a5f257b0054 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:07.315774 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-837d55b4-eee0-4b7f-b95e-8a5f257b0054 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:07.316559 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-837d55b4-eee0-4b7f-b95e-8a5f257b0054 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:07.317014 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-837d55b4-eee0-4b7f-b95e-8a5f257b0054 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:07.317476 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-837d55b4-eee0-4b7f-b95e-8a5f257b0054 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:07.610221 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-febebcf1-3a47-4ea4-8b6c-21392071aae5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:07.611075 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-febebcf1-3a47-4ea4-8b6c-21392071aae5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: fbbfb1ca-5624-4baf-b498-1f9b75c194cb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:07.622897 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-febebcf1-3a47-4ea4-8b6c-21392071aae5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:07.623747 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-febebcf1-3a47-4ea4-8b6c-21392071aae5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:07.624798 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-febebcf1-3a47-4ea4-8b6c-21392071aae5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:07.626090 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-febebcf1-3a47-4ea4-8b6c-21392071aae5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:07.627116 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-febebcf1-3a47-4ea4-8b6c-21392071aae5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:07.627748 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-febebcf1-3a47-4ea4-8b6c-21392071aae5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:07.672123 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-febebcf1-3a47-4ea4-8b6c-21392071aae5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:07.673125 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-febebcf1-3a47-4ea4-8b6c-21392071aae5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:07.673888 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-febebcf1-3a47-4ea4-8b6c-21392071aae5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:07.674643 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-febebcf1-3a47-4ea4-8b6c-21392071aae5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lazy-loading 'fault' on Instance uuid fbbfb1ca-5624-4baf-b498-1f9b75c194cb {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:29:07.770500 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-837d55b4-eee0-4b7f-b95e-8a5f257b0054 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:07.775367 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-febebcf1-3a47-4ea4-8b6c-21392071aae5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f857d6b0826e47c6875a307e7ccfb104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa9c648b20d41d7b150fbf64cde6fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:07.786195 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-febebcf1-3a47-4ea4-8b6c-21392071aae5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/fbbfb1ca-5624-4baf-b498-1f9b75c194cb" status: 200 len: 1298 microversion: 2.1 time: 0.181748 Oct 30 01:29:07.787757 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1754/3512] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:07 2022] GET /compute/v2.1/servers/fbbfb1ca-5624-4baf-b498-1f9b75c194cb => generated 1298 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:07.793835 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1ce446c4-ccaa-4be9-a217-ba4307ba5e48 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:07.794763 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1ce446c4-ccaa-4be9-a217-ba4307ba5e48 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] [instance: 0bddfccb-0dc7-430f-88b6-41e25e23d934] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:07.801758 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ce446c4-ccaa-4be9-a217-ba4307ba5e48 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:07.802957 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ce446c4-ccaa-4be9-a217-ba4307ba5e48 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:07.803641 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ce446c4-ccaa-4be9-a217-ba4307ba5e48 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:07.804876 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ce446c4-ccaa-4be9-a217-ba4307ba5e48 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:07.805600 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ce446c4-ccaa-4be9-a217-ba4307ba5e48 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:07.807218 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ce446c4-ccaa-4be9-a217-ba4307ba5e48 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:07.810641 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-837d55b4-eee0-4b7f-b95e-8a5f257b0054 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:07.812517 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-837d55b4-eee0-4b7f-b95e-8a5f257b0054 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:07.814541 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-837d55b4-eee0-4b7f-b95e-8a5f257b0054 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1873 microversion: 2.32 time: 0.518311 Oct 30 01:29:07.830626 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1759/3513] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:29:07 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1873 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:29:07.836619 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f6211639-f95b-4043-9193-5818403465bc tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:07.837240 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f6211639-f95b-4043-9193-5818403465bc tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 2864065f-4af8-4134-b3f6-af254b7ab474] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:07.844825 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f6211639-f95b-4043-9193-5818403465bc tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:07.845906 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f6211639-f95b-4043-9193-5818403465bc tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:07.846342 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f6211639-f95b-4043-9193-5818403465bc tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:07.847069 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f6211639-f95b-4043-9193-5818403465bc tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:07.847521 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f6211639-f95b-4043-9193-5818403465bc tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:07.847944 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f6211639-f95b-4043-9193-5818403465bc tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:08.084304 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1ce446c4-ccaa-4be9-a217-ba4307ba5e48 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b3394f28c4f444f8cd8bda6bacc9fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1e9b74043548e48a5bb8fb4d054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:08.094102 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1ce446c4-ccaa-4be9-a217-ba4307ba5e48 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] 10.222.0.13 "GET /compute/v2.1/servers/0bddfccb-0dc7-430f-88b6-41e25e23d934" status: 200 len: 1574 microversion: 2.1 time: 0.305113 Oct 30 01:29:08.094823 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1755/3514] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:07 2022] GET /compute/v2.1/servers/0bddfccb-0dc7-430f-88b6-41e25e23d934 => generated 1574 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:08.101710 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f6211639-f95b-4043-9193-5818403465bc tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:08.102519 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8b580a66-e906-446e-ba52-2ce25e495026 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:08.102519 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8b580a66-e906-446e-ba52-2ce25e495026 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] [instance: 78081c7e-04f6-468e-9a0d-3c74c1092c6d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:08.106076 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b580a66-e906-446e-ba52-2ce25e495026 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:08.106640 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b580a66-e906-446e-ba52-2ce25e495026 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:08.107143 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b580a66-e906-446e-ba52-2ce25e495026 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:08.107903 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b580a66-e906-446e-ba52-2ce25e495026 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:08.108421 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b580a66-e906-446e-ba52-2ce25e495026 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:08.108908 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b580a66-e906-446e-ba52-2ce25e495026 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:08.122182 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f6211639-f95b-4043-9193-5818403465bc tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/2864065f-4af8-4134-b3f6-af254b7ab474" status: 200 len: 1293 microversion: 2.1 time: 0.290324 Oct 30 01:29:08.123669 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1760/3515] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:07 2022] GET /compute/v2.1/servers/2864065f-4af8-4134-b3f6-af254b7ab474 => generated 1293 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:08.131007 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ea4f4372-a079-4636-92b1-90ba8837bb81 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:08.132174 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ea4f4372-a079-4636-92b1-90ba8837bb81 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 2873be88-5d85-49c6-833f-19b7df1fcf5f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:08.140343 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ea4f4372-a079-4636-92b1-90ba8837bb81 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:08.143021 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ea4f4372-a079-4636-92b1-90ba8837bb81 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:08.143021 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ea4f4372-a079-4636-92b1-90ba8837bb81 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:08.143021 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ea4f4372-a079-4636-92b1-90ba8837bb81 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:08.143021 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ea4f4372-a079-4636-92b1-90ba8837bb81 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:08.143398 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ea4f4372-a079-4636-92b1-90ba8837bb81 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:08.210003 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8b580a66-e906-446e-ba52-2ce25e495026 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd2e319840c4a8aab90b495374aa1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eba4d14f2004498850092bff100b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:08.224499 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8b580a66-e906-446e-ba52-2ce25e495026 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] 10.222.0.13 "GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d" status: 200 len: 1170 microversion: 2.1 time: 0.127429 Oct 30 01:29:08.225359 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1756/3516] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:08 2022] GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d => generated 1170 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:08.232679 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-23ca02ab-b5ef-40fa-8e21-70295701b695 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:08.233814 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-23ca02ab-b5ef-40fa-8e21-70295701b695 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d7cd54fb-1c64-4fb8-a97b-4d5c81a48009] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:08.251774 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-23ca02ab-b5ef-40fa-8e21-70295701b695 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:08.251774 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-23ca02ab-b5ef-40fa-8e21-70295701b695 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:08.251774 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-23ca02ab-b5ef-40fa-8e21-70295701b695 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:08.251774 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-23ca02ab-b5ef-40fa-8e21-70295701b695 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:08.251774 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-23ca02ab-b5ef-40fa-8e21-70295701b695 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:08.251774 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-23ca02ab-b5ef-40fa-8e21-70295701b695 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:08.444804 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ea4f4372-a079-4636-92b1-90ba8837bb81 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:08.452624 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ea4f4372-a079-4636-92b1-90ba8837bb81 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f" status: 200 len: 1523 microversion: 2.1 time: 0.327549 Oct 30 01:29:08.453204 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1761/3517] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:08 2022] GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f => generated 1523 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:08.458368 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-38aa4c96-d305-47be-b58a-83dde91515c8 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:08.459107 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-38aa4c96-d305-47be-b58a-83dde91515c8 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] [instance: 0bddfccb-0dc7-430f-88b6-41e25e23d934] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:08.465549 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38aa4c96-d305-47be-b58a-83dde91515c8 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:08.466283 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38aa4c96-d305-47be-b58a-83dde91515c8 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:08.466950 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38aa4c96-d305-47be-b58a-83dde91515c8 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:08.467832 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38aa4c96-d305-47be-b58a-83dde91515c8 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:08.468385 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38aa4c96-d305-47be-b58a-83dde91515c8 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:08.468902 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38aa4c96-d305-47be-b58a-83dde91515c8 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:08.503151 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-23ca02ab-b5ef-40fa-8e21-70295701b695 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:08.513410 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-23ca02ab-b5ef-40fa-8e21-70295701b695 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009" status: 200 len: 1314 microversion: 2.1 time: 0.285971 Oct 30 01:29:08.514202 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1757/3518] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:08 2022] GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:08.575916 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-38aa4c96-d305-47be-b58a-83dde91515c8 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] 10.222.0.13 "GET /compute/v2.1/servers/0bddfccb-0dc7-430f-88b6-41e25e23d934/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.121030 Oct 30 01:29:08.581139 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1762/3519] 10.222.0.13 () {58 vars in 1275 bytes} [Sun Oct 30 01:29:08 2022] GET /compute/v2.1/servers/0bddfccb-0dc7-430f-88b6-41e25e23d934/os-interface => generated 284 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:29:08.817747 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-184c3f3f-796c-4760-8f1f-dced06d7743c tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:08.818469 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-184c3f3f-796c-4760-8f1f-dced06d7743c tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: fbbfb1ca-5624-4baf-b498-1f9b75c194cb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:08.832767 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-184c3f3f-796c-4760-8f1f-dced06d7743c tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:08.833278 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-184c3f3f-796c-4760-8f1f-dced06d7743c tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:08.833748 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-184c3f3f-796c-4760-8f1f-dced06d7743c tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:08.834463 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-184c3f3f-796c-4760-8f1f-dced06d7743c tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:08.834914 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-184c3f3f-796c-4760-8f1f-dced06d7743c tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:08.838022 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-184c3f3f-796c-4760-8f1f-dced06d7743c tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:08.842406 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-44bb590b-e69a-4755-a8f3-88f50f1d5308 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:08.843720 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-44bb590b-e69a-4755-a8f3-88f50f1d5308 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:08.851546 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-44bb590b-e69a-4755-a8f3-88f50f1d5308 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:08.852493 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-44bb590b-e69a-4755-a8f3-88f50f1d5308 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:08.852928 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-44bb590b-e69a-4755-a8f3-88f50f1d5308 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:08.853311 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-184c3f3f-796c-4760-8f1f-dced06d7743c tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] HTTP exception thrown: Instance fbbfb1ca-5624-4baf-b498-1f9b75c194cb could not be found. Oct 30 01:29:08.859188 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-44bb590b-e69a-4755-a8f3-88f50f1d5308 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:08.859188 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-44bb590b-e69a-4755-a8f3-88f50f1d5308 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:08.859188 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-44bb590b-e69a-4755-a8f3-88f50f1d5308 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-184c3f3f-796c-4760-8f1f-dced06d7743c tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Request method failure captured: Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/fbbfb1ca-5624-4baf-b498-1f9b75c194cb HTTP/1.1 Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdHeyUy7YRlBOjEIMB2SM5IZKoEM9E4CcgE_HPOqloJp1NZnn6dha472SrZ31y2exANSVhQ3YMhYfN1WKKWmY5LYeNp42aJgNRzc0qxtfn3HVOOFRHdXQayAjQiB3EhVLJEEiK3-p5hlGh_9_wOga5iGlHo5mVxXdGv2Ye2RftSaR1s Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 4aa9c648b20d41d7b150fbf64cde6fe8 Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ImagesTestJSON-298836005 Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ImagesTestJSON-298836005 Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 4aa9c648b20d41d7b150fbf64cde6fe8 Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ImagesTestJSON-298836005 Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ImagesTestJSON-298836005-project Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: f857d6b0826e47c6875a307e7ccfb104 Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ImagesTestJSON-298836005-project Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: exception: Instance fbbfb1ca-5624-4baf-b498-1f9b75c194cb could not be found. Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'fbbfb1ca-5624-4baf-b498-1f9b75c194cb'} Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbbfb1ca-5624-4baf-b498-1f9b75c194cb could not be found. Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbbfb1ca-5624-4baf-b498-1f9b75c194cb could not be found. Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:08.859480 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:08.864910 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:29:08.864910 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:29:08.864910 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:29:08.864910 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:29:08.864910 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbbfb1ca-5624-4baf-b498-1f9b75c194cb could not be found. Oct 30 01:29:08.864910 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:08.864910 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-184c3f3f-796c-4760-8f1f-dced06d7743c tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Returning 404 to user: Instance fbbfb1ca-5624-4baf-b498-1f9b75c194cb could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:29:08.864910 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-184c3f3f-796c-4760-8f1f-dced06d7743c tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/fbbfb1ca-5624-4baf-b498-1f9b75c194cb" status: 404 len: 111 microversion: 2.1 time: 0.044517 Oct 30 01:29:08.864910 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1758/3520] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:08 2022] GET /compute/v2.1/servers/fbbfb1ca-5624-4baf-b498-1f9b75c194cb => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:29:08.866139 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-891c683e-db02-4907-9f80-6f9b4168c4a5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:08.867001 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-891c683e-db02-4907-9f80-6f9b4168c4a5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: c1d74af2-1793-4369-8c7e-a9e5047df775] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:08.873261 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-891c683e-db02-4907-9f80-6f9b4168c4a5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:08.874192 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-891c683e-db02-4907-9f80-6f9b4168c4a5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:08.874810 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-891c683e-db02-4907-9f80-6f9b4168c4a5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:08.875673 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-891c683e-db02-4907-9f80-6f9b4168c4a5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:08.877087 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-891c683e-db02-4907-9f80-6f9b4168c4a5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:08.877707 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-891c683e-db02-4907-9f80-6f9b4168c4a5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:08.893193 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-891c683e-db02-4907-9f80-6f9b4168c4a5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] HTTP exception thrown: Instance c1d74af2-1793-4369-8c7e-a9e5047df775 could not be found. Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-891c683e-db02-4907-9f80-6f9b4168c4a5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Request method failure captured: Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/servers/c1d74af2-1793-4369-8c7e-a9e5047df775 HTTP/1.1 Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdHeyUy7YRlBOjEIMB2SM5IZKoEM9E4CcgE_HPOqloJp1NZnn6dha472SrZ31y2exANSVhQ3YMhYfN1WKKWmY5LYeNp42aJgNRzc0qxtfn3HVOOFRHdXQayAjQiB3EhVLJEEiK3-p5hlGh_9_wOga5iGlHo5mVxXdGv2Ye2RftSaR1s Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 4aa9c648b20d41d7b150fbf64cde6fe8 Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ImagesTestJSON-298836005 Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ImagesTestJSON-298836005 Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 4aa9c648b20d41d7b150fbf64cde6fe8 Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ImagesTestJSON-298836005 Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ImagesTestJSON-298836005-project Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: f857d6b0826e47c6875a307e7ccfb104 Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ImagesTestJSON-298836005-project Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: exception: Instance c1d74af2-1793-4369-8c7e-a9e5047df775 could not be found. Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'c1d74af2-1793-4369-8c7e-a9e5047df775'} Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1d74af2-1793-4369-8c7e-a9e5047df775 could not be found. Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:29:08.895303 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1d74af2-1793-4369-8c7e-a9e5047df775 could not be found. Oct 30 01:29:08.900476 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:08.900476 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:29:08.900476 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:08.900476 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:08.900476 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:29:08.900476 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:29:08.900476 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:29:08.900476 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:29:08.900476 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1d74af2-1793-4369-8c7e-a9e5047df775 could not be found. Oct 30 01:29:08.900476 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:08.902254 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-891c683e-db02-4907-9f80-6f9b4168c4a5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Returning 404 to user: Instance c1d74af2-1793-4369-8c7e-a9e5047df775 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:29:08.902997 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-891c683e-db02-4907-9f80-6f9b4168c4a5 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c1d74af2-1793-4369-8c7e-a9e5047df775" status: 404 len: 111 microversion: 2.1 time: 0.040803 Oct 30 01:29:08.903516 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1759/3521] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:29:08 2022] DELETE /compute/v2.1/servers/c1d74af2-1793-4369-8c7e-a9e5047df775 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 01:29:08.916744 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0c61cd04-2ce5-48f2-a349-dd0384866cb3 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:08.917918 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0c61cd04-2ce5-48f2-a349-dd0384866cb3 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: c1d74af2-1793-4369-8c7e-a9e5047df775] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:08.927836 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0c61cd04-2ce5-48f2-a349-dd0384866cb3 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:08.928421 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0c61cd04-2ce5-48f2-a349-dd0384866cb3 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:08.928884 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0c61cd04-2ce5-48f2-a349-dd0384866cb3 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:08.929767 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0c61cd04-2ce5-48f2-a349-dd0384866cb3 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:08.930228 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0c61cd04-2ce5-48f2-a349-dd0384866cb3 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:08.930980 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0c61cd04-2ce5-48f2-a349-dd0384866cb3 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:08.963336 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-0c61cd04-2ce5-48f2-a349-dd0384866cb3 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] HTTP exception thrown: Instance c1d74af2-1793-4369-8c7e-a9e5047df775 could not be found. Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0c61cd04-2ce5-48f2-a349-dd0384866cb3 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Request method failure captured: Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/c1d74af2-1793-4369-8c7e-a9e5047df775 HTTP/1.1 Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdHeyUy7YRlBOjEIMB2SM5IZKoEM9E4CcgE_HPOqloJp1NZnn6dha472SrZ31y2exANSVhQ3YMhYfN1WKKWmY5LYeNp42aJgNRzc0qxtfn3HVOOFRHdXQayAjQiB3EhVLJEEiK3-p5hlGh_9_wOga5iGlHo5mVxXdGv2Ye2RftSaR1s Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 4aa9c648b20d41d7b150fbf64cde6fe8 Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ImagesTestJSON-298836005 Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ImagesTestJSON-298836005 Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 4aa9c648b20d41d7b150fbf64cde6fe8 Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ImagesTestJSON-298836005 Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ImagesTestJSON-298836005-project Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: f857d6b0826e47c6875a307e7ccfb104 Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ImagesTestJSON-298836005-project Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: exception: Instance c1d74af2-1793-4369-8c7e-a9e5047df775 could not be found. Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'c1d74af2-1793-4369-8c7e-a9e5047df775'} Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1d74af2-1793-4369-8c7e-a9e5047df775 could not be found. Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1d74af2-1793-4369-8c7e-a9e5047df775 could not be found. Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:08.965535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:08.971772 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:29:08.971772 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:29:08.971772 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:29:08.971772 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:29:08.971772 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1d74af2-1793-4369-8c7e-a9e5047df775 could not be found. Oct 30 01:29:08.971772 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:08.973557 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0c61cd04-2ce5-48f2-a349-dd0384866cb3 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Returning 404 to user: Instance c1d74af2-1793-4369-8c7e-a9e5047df775 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:29:08.974708 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0c61cd04-2ce5-48f2-a349-dd0384866cb3 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/c1d74af2-1793-4369-8c7e-a9e5047df775" status: 404 len: 111 microversion: 2.1 time: 0.065682 Oct 30 01:29:08.975722 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1760/3522] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:08 2022] GET /compute/v2.1/servers/c1d74af2-1793-4369-8c7e-a9e5047df775 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 01:29:08.986034 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9bfba506-c41e-4dd2-bc2b-1955467221d0 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44c73578b0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:09.029639 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-9bfba506-c41e-4dd2-bc2b-1955467221d0 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] HTTP exception thrown: Image not found. Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9bfba506-c41e-4dd2-bc2b-1955467221d0 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Request method failure captured: Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/images/dca8deb4-b525-42b4-860c-8ee77a764df8 HTTP/1.1 Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdHeyUy7YRlBOjEIMB2SM5IZKoEM9E4CcgE_HPOqloJp1NZnn6dha472SrZ31y2exANSVhQ3YMhYfN1WKKWmY5LYeNp42aJgNRzc0qxtfn3HVOOFRHdXQayAjQiB3EhVLJEEiK3-p5hlGh_9_wOga5iGlHo5mVxXdGv2Ye2RftSaR1s Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 4aa9c648b20d41d7b150fbf64cde6fe8 Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ImagesTestJSON-298836005 Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ImagesTestJSON-298836005 Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 4aa9c648b20d41d7b150fbf64cde6fe8 Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ImagesTestJSON-298836005 Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ImagesTestJSON-298836005-project Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: f857d6b0826e47c6875a307e7ccfb104 Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ImagesTestJSON-298836005-project Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: method: Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: exception: Image not found. Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'dca8deb4-b525-42b4-860c-8ee77a764df8'} Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image dca8deb4-b525-42b4-860c-8ee77a764df8 to delete Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image dca8deb4-b525-42b4-860c-8ee77a764df8 could not be found. Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:09.033462 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:09.044189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:29:09.044189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:29:09.044189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:29:09.044189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:29:09.044189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:29:09.044189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:29:09.044189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:29:09.044189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:29:09.044189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 30 01:29:09.044189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 30 01:29:09.044189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 30 01:29:09.044189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:09.044189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:29:09.044189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:09.044189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:09.044189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:29:09.044189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:29:09.044189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:29:09.044189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:29:09.044189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 30 01:29:09.044189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:09.044189 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9bfba506-c41e-4dd2-bc2b-1955467221d0 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Returning 404 to user: Image not found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:29:09.044189 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9bfba506-c41e-4dd2-bc2b-1955467221d0 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "DELETE /compute/v2.1/images/dca8deb4-b525-42b4-860c-8ee77a764df8" status: 404 len: 62 microversion: 2.1 time: 0.056006 Oct 30 01:29:09.044189 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1761/3523] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:08 2022] DELETE /compute/v2.1/images/dca8deb4-b525-42b4-860c-8ee77a764df8 => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 30 01:29:09.048013 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-97e9eb51-2aa4-4038-8508-e47235915e57 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:09.048537 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-97e9eb51-2aa4-4038-8508-e47235915e57 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: b4259dcb-d421-45fb-84e6-7e8a8f7ce20d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:09.058204 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-97e9eb51-2aa4-4038-8508-e47235915e57 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:09.058706 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-97e9eb51-2aa4-4038-8508-e47235915e57 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:09.059141 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-97e9eb51-2aa4-4038-8508-e47235915e57 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:09.060392 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-97e9eb51-2aa4-4038-8508-e47235915e57 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:09.060904 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-97e9eb51-2aa4-4038-8508-e47235915e57 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:09.061391 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-97e9eb51-2aa4-4038-8508-e47235915e57 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:09.068708 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:09.079858 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-97e9eb51-2aa4-4038-8508-e47235915e57 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] HTTP exception thrown: Instance b4259dcb-d421-45fb-84e6-7e8a8f7ce20d could not be found. Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-97e9eb51-2aa4-4038-8508-e47235915e57 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Request method failure captured: Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/servers/b4259dcb-d421-45fb-84e6-7e8a8f7ce20d HTTP/1.1 Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdHeyUy7YRlBOjEIMB2SM5IZKoEM9E4CcgE_HPOqloJp1NZnn6dha472SrZ31y2exANSVhQ3YMhYfN1WKKWmY5LYeNp42aJgNRzc0qxtfn3HVOOFRHdXQayAjQiB3EhVLJEEiK3-p5hlGh_9_wOga5iGlHo5mVxXdGv2Ye2RftSaR1s Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 4aa9c648b20d41d7b150fbf64cde6fe8 Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ImagesTestJSON-298836005 Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ImagesTestJSON-298836005 Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 4aa9c648b20d41d7b150fbf64cde6fe8 Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ImagesTestJSON-298836005 Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ImagesTestJSON-298836005-project Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: f857d6b0826e47c6875a307e7ccfb104 Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ImagesTestJSON-298836005-project Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: exception: Instance b4259dcb-d421-45fb-84e6-7e8a8f7ce20d could not be found. Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'b4259dcb-d421-45fb-84e6-7e8a8f7ce20d'} Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4259dcb-d421-45fb-84e6-7e8a8f7ce20d could not be found. Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:29:09.081715 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4259dcb-d421-45fb-84e6-7e8a8f7ce20d could not be found. Oct 30 01:29:09.087443 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:09.087443 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:29:09.087443 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:09.087443 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:09.087443 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:29:09.087443 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:29:09.087443 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:29:09.087443 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:29:09.087443 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4259dcb-d421-45fb-84e6-7e8a8f7ce20d could not be found. Oct 30 01:29:09.087443 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:09.087443 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-97e9eb51-2aa4-4038-8508-e47235915e57 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Returning 404 to user: Instance b4259dcb-d421-45fb-84e6-7e8a8f7ce20d could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:29:09.087443 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-97e9eb51-2aa4-4038-8508-e47235915e57 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b4259dcb-d421-45fb-84e6-7e8a8f7ce20d" status: 404 len: 111 microversion: 2.1 time: 0.042553 Oct 30 01:29:09.087443 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1762/3524] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:29:09 2022] DELETE /compute/v2.1/servers/b4259dcb-d421-45fb-84e6-7e8a8f7ce20d => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 01:29:09.093212 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2a14a24d-5f4a-409e-ba4a-3ae6c0af91fe tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:09.094394 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2a14a24d-5f4a-409e-ba4a-3ae6c0af91fe tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: b4259dcb-d421-45fb-84e6-7e8a8f7ce20d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:09.102522 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a14a24d-5f4a-409e-ba4a-3ae6c0af91fe tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:09.103098 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a14a24d-5f4a-409e-ba4a-3ae6c0af91fe tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:09.103588 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a14a24d-5f4a-409e-ba4a-3ae6c0af91fe tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:09.104389 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a14a24d-5f4a-409e-ba4a-3ae6c0af91fe tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:09.104901 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a14a24d-5f4a-409e-ba4a-3ae6c0af91fe tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:09.108438 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a14a24d-5f4a-409e-ba4a-3ae6c0af91fe tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:09.122436 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-2a14a24d-5f4a-409e-ba4a-3ae6c0af91fe tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] HTTP exception thrown: Instance b4259dcb-d421-45fb-84e6-7e8a8f7ce20d could not be found. Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2a14a24d-5f4a-409e-ba4a-3ae6c0af91fe tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Request method failure captured: Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/b4259dcb-d421-45fb-84e6-7e8a8f7ce20d HTTP/1.1 Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdHeyUy7YRlBOjEIMB2SM5IZKoEM9E4CcgE_HPOqloJp1NZnn6dha472SrZ31y2exANSVhQ3YMhYfN1WKKWmY5LYeNp42aJgNRzc0qxtfn3HVOOFRHdXQayAjQiB3EhVLJEEiK3-p5hlGh_9_wOga5iGlHo5mVxXdGv2Ye2RftSaR1s Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 4aa9c648b20d41d7b150fbf64cde6fe8 Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ImagesTestJSON-298836005 Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ImagesTestJSON-298836005 Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 4aa9c648b20d41d7b150fbf64cde6fe8 Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ImagesTestJSON-298836005 Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ImagesTestJSON-298836005-project Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: f857d6b0826e47c6875a307e7ccfb104 Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ImagesTestJSON-298836005-project Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: exception: Instance b4259dcb-d421-45fb-84e6-7e8a8f7ce20d could not be found. Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'b4259dcb-d421-45fb-84e6-7e8a8f7ce20d'} Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4259dcb-d421-45fb-84e6-7e8a8f7ce20d could not be found. Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4259dcb-d421-45fb-84e6-7e8a8f7ce20d could not be found. Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:09.124331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:09.129779 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:29:09.129779 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:29:09.129779 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:29:09.129779 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:29:09.129779 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4259dcb-d421-45fb-84e6-7e8a8f7ce20d could not be found. Oct 30 01:29:09.129779 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:09.129779 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2a14a24d-5f4a-409e-ba4a-3ae6c0af91fe tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Returning 404 to user: Instance b4259dcb-d421-45fb-84e6-7e8a8f7ce20d could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:29:09.129779 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2a14a24d-5f4a-409e-ba4a-3ae6c0af91fe tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/b4259dcb-d421-45fb-84e6-7e8a8f7ce20d" status: 404 len: 111 microversion: 2.1 time: 0.038213 Oct 30 01:29:09.130604 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1763/3525] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:09 2022] GET /compute/v2.1/servers/b4259dcb-d421-45fb-84e6-7e8a8f7ce20d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:29:09.144682 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0a412ca8-2cba-45b9-aca4-e264b311bf1f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44c7344ca0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:09.169043 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-0a412ca8-2cba-45b9-aca4-e264b311bf1f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] HTTP exception thrown: Image not found. Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0a412ca8-2cba-45b9-aca4-e264b311bf1f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Request method failure captured: Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/images/21c14abf-0ccd-412a-bbbb-70149bcf547b HTTP/1.1 Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdHeyUy7YRlBOjEIMB2SM5IZKoEM9E4CcgE_HPOqloJp1NZnn6dha472SrZ31y2exANSVhQ3YMhYfN1WKKWmY5LYeNp42aJgNRzc0qxtfn3HVOOFRHdXQayAjQiB3EhVLJEEiK3-p5hlGh_9_wOga5iGlHo5mVxXdGv2Ye2RftSaR1s Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 4aa9c648b20d41d7b150fbf64cde6fe8 Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ImagesTestJSON-298836005 Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ImagesTestJSON-298836005 Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 4aa9c648b20d41d7b150fbf64cde6fe8 Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ImagesTestJSON-298836005 Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ImagesTestJSON-298836005-project Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: f857d6b0826e47c6875a307e7ccfb104 Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ImagesTestJSON-298836005-project Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: method: Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: exception: Image not found. Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '21c14abf-0ccd-412a-bbbb-70149bcf547b'} Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 21c14abf-0ccd-412a-bbbb-70149bcf547b to delete Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 21c14abf-0ccd-412a-bbbb-70149bcf547b could not be found. Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:09.171140 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:09.183331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:29:09.183331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:29:09.183331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:29:09.183331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:29:09.183331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:29:09.183331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:29:09.183331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:29:09.183331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:29:09.183331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 30 01:29:09.183331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 30 01:29:09.183331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 30 01:29:09.183331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:09.183331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:29:09.183331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:09.183331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:09.183331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:29:09.183331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:29:09.183331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:29:09.183331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:29:09.183331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 30 01:29:09.183331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:09.183331 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0a412ca8-2cba-45b9-aca4-e264b311bf1f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Returning 404 to user: Image not found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:29:09.183331 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0a412ca8-2cba-45b9-aca4-e264b311bf1f tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "DELETE /compute/v2.1/images/21c14abf-0ccd-412a-bbbb-70149bcf547b" status: 404 len: 62 microversion: 2.1 time: 0.037668 Oct 30 01:29:09.183331 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1764/3526] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:09 2022] DELETE /compute/v2.1/images/21c14abf-0ccd-412a-bbbb-70149bcf547b => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:29:09.186820 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-251cacea-1a53-422a-ab1e-bdd89a82193a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:09.187543 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-251cacea-1a53-422a-ab1e-bdd89a82193a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 2864065f-4af8-4134-b3f6-af254b7ab474] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:09.203813 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-251cacea-1a53-422a-ab1e-bdd89a82193a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:09.205576 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-251cacea-1a53-422a-ab1e-bdd89a82193a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:09.206047 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-251cacea-1a53-422a-ab1e-bdd89a82193a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:09.206784 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-251cacea-1a53-422a-ab1e-bdd89a82193a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:09.207274 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-251cacea-1a53-422a-ab1e-bdd89a82193a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:09.207809 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-251cacea-1a53-422a-ab1e-bdd89a82193a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:09.548179 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=14 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:09.622922 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-44bb590b-e69a-4755-a8f3-88f50f1d5308 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:09.635109 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-44bb590b-e69a-4755-a8f3-88f50f1d5308 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:09.636607 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-44bb590b-e69a-4755-a8f3-88f50f1d5308 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:09.637896 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-44bb590b-e69a-4755-a8f3-88f50f1d5308 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1873 microversion: 2.32 time: 0.800483 Oct 30 01:29:09.638452 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1763/3527] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:29:08 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1873 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:29:09.643182 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1f4d010b-51fe-47a0-a4f9-2f55ba8c3898 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:09.643664 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1f4d010b-51fe-47a0-a4f9-2f55ba8c3898 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: 688c35c4-9529-49df-8255-98cd2b56c314] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:09.651690 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1f4d010b-51fe-47a0-a4f9-2f55ba8c3898 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:09.651884 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1f4d010b-51fe-47a0-a4f9-2f55ba8c3898 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:09.652419 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1f4d010b-51fe-47a0-a4f9-2f55ba8c3898 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:09.653180 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1f4d010b-51fe-47a0-a4f9-2f55ba8c3898 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:09.653657 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1f4d010b-51fe-47a0-a4f9-2f55ba8c3898 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:09.654083 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1f4d010b-51fe-47a0-a4f9-2f55ba8c3898 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:09.668567 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-1f4d010b-51fe-47a0-a4f9-2f55ba8c3898 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] HTTP exception thrown: Instance 688c35c4-9529-49df-8255-98cd2b56c314 could not be found. Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1f4d010b-51fe-47a0-a4f9-2f55ba8c3898 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Request method failure captured: Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: request: DELETE /compute/v2.1/servers/688c35c4-9529-49df-8255-98cd2b56c314 HTTP/1.1 Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdHeyUy7YRlBOjEIMB2SM5IZKoEM9E4CcgE_HPOqloJp1NZnn6dha472SrZ31y2exANSVhQ3YMhYfN1WKKWmY5LYeNp42aJgNRzc0qxtfn3HVOOFRHdXQayAjQiB3EhVLJEEiK3-p5hlGh_9_wOga5iGlHo5mVxXdGv2Ye2RftSaR1s Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 4aa9c648b20d41d7b150fbf64cde6fe8 Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ImagesTestJSON-298836005 Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ImagesTestJSON-298836005 Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 4aa9c648b20d41d7b150fbf64cde6fe8 Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ImagesTestJSON-298836005 Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ImagesTestJSON-298836005-project Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: f857d6b0826e47c6875a307e7ccfb104 Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ImagesTestJSON-298836005-project Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 688c35c4-9529-49df-8255-98cd2b56c314 could not be found. Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '688c35c4-9529-49df-8255-98cd2b56c314'} Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 688c35c4-9529-49df-8255-98cd2b56c314 could not be found. Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:29:09.670621 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 688c35c4-9529-49df-8255-98cd2b56c314 could not be found. Oct 30 01:29:09.691080 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:29:09.691080 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:29:09.691080 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:29:09.691080 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:09.691080 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:29:09.691080 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:29:09.691080 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:29:09.691080 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:29:09.691080 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 688c35c4-9529-49df-8255-98cd2b56c314 could not be found. Oct 30 01:29:09.691080 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:29:09.691080 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1f4d010b-51fe-47a0-a4f9-2f55ba8c3898 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Returning 404 to user: Instance 688c35c4-9529-49df-8255-98cd2b56c314 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:29:09.691080 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1f4d010b-51fe-47a0-a4f9-2f55ba8c3898 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "DELETE /compute/v2.1/servers/688c35c4-9529-49df-8255-98cd2b56c314" status: 404 len: 111 microversion: 2.1 time: 0.032348 Oct 30 01:29:09.691080 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1764/3528] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:29:09 2022] DELETE /compute/v2.1/servers/688c35c4-9529-49df-8255-98cd2b56c314 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:29:09.696719 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8aefeb1e-1495-4bf5-aa10-ab0b1a9692c3 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:09.697392 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8aefeb1e-1495-4bf5-aa10-ab0b1a9692c3 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] [instance: 78081c7e-04f6-468e-9a0d-3c74c1092c6d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:09.705254 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8aefeb1e-1495-4bf5-aa10-ab0b1a9692c3 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:09.713650 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8aefeb1e-1495-4bf5-aa10-ab0b1a9692c3 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:09.713650 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8aefeb1e-1495-4bf5-aa10-ab0b1a9692c3 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:09.713650 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8aefeb1e-1495-4bf5-aa10-ab0b1a9692c3 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:09.713650 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8aefeb1e-1495-4bf5-aa10-ab0b1a9692c3 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:09.713650 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8aefeb1e-1495-4bf5-aa10-ab0b1a9692c3 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:09.825507 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8aefeb1e-1495-4bf5-aa10-ab0b1a9692c3 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd2e319840c4a8aab90b495374aa1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eba4d14f2004498850092bff100b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:09.834330 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8aefeb1e-1495-4bf5-aa10-ab0b1a9692c3 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] 10.222.0.13 "GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d" status: 200 len: 1218 microversion: 2.1 time: 0.160162 Oct 30 01:29:09.837806 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-251cacea-1a53-422a-ab1e-bdd89a82193a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:09.839932 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1765/3529] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:09 2022] GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d => generated 1218 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:09.846011 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-e050b3b7-4c4f-44c9-b09c-141168fdcd7f req-5027b4e5-958a-479a-8c93-f5a25ed69b02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2864065f-4af8-4134-b3f6-af254b7ab474", "tag": "fd936916-f520-4593-848c-8120c98ac691"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:29:09.853814 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-251cacea-1a53-422a-ab1e-bdd89a82193a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/2864065f-4af8-4134-b3f6-af254b7ab474" status: 200 len: 1293 microversion: 2.1 time: 0.676116 Oct 30 01:29:09.854373 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1765/3530] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:09 2022] GET /compute/v2.1/servers/2864065f-4af8-4134-b3f6-af254b7ab474 => generated 1293 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:09.861809 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-438f1490-cdf8-495f-9097-81aff78c2e82 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:09.862405 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-438f1490-cdf8-495f-9097-81aff78c2e82 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 2873be88-5d85-49c6-833f-19b7df1fcf5f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:09.868954 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e050b3b7-4c4f-44c9-b09c-141168fdcd7f req-5027b4e5-958a-479a-8c93-f5a25ed69b02 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:09.869476 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e050b3b7-4c4f-44c9-b09c-141168fdcd7f req-5027b4e5-958a-479a-8c93-f5a25ed69b02 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:09.869890 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e050b3b7-4c4f-44c9-b09c-141168fdcd7f req-5027b4e5-958a-479a-8c93-f5a25ed69b02 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:09.884784 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-438f1490-cdf8-495f-9097-81aff78c2e82 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:09.885936 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-438f1490-cdf8-495f-9097-81aff78c2e82 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:09.886540 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-438f1490-cdf8-495f-9097-81aff78c2e82 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:09.887932 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-438f1490-cdf8-495f-9097-81aff78c2e82 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:09.890711 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-438f1490-cdf8-495f-9097-81aff78c2e82 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:09.891172 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-438f1490-cdf8-495f-9097-81aff78c2e82 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:09.902011 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-e050b3b7-4c4f-44c9-b09c-141168fdcd7f req-5027b4e5-958a-479a-8c93-f5a25ed69b02 service nova] Creating event network-changed:fd936916-f520-4593-848c-8120c98ac691 for instance 2864065f-4af8-4134-b3f6-af254b7ab474 on n-h2-master-1 Oct 30 01:29:09.908089 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-e050b3b7-4c4f-44c9-b09c-141168fdcd7f req-5027b4e5-958a-479a-8c93-f5a25ed69b02 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066828 Oct 30 01:29:09.909108 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1766/3531] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:29:09.915330 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1057b55d-0fb4-4877-9a76-c6c1ae0e23df tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:09.916236 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1057b55d-0fb4-4877-9a76-c6c1ae0e23df tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d7cd54fb-1c64-4fb8-a97b-4d5c81a48009] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:09.925875 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1057b55d-0fb4-4877-9a76-c6c1ae0e23df tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:09.926434 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1057b55d-0fb4-4877-9a76-c6c1ae0e23df tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:09.927157 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1057b55d-0fb4-4877-9a76-c6c1ae0e23df tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:09.928112 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1057b55d-0fb4-4877-9a76-c6c1ae0e23df tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:09.928765 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1057b55d-0fb4-4877-9a76-c6c1ae0e23df tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:09.929558 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1057b55d-0fb4-4877-9a76-c6c1ae0e23df tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:10.194493 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-438f1490-cdf8-495f-9097-81aff78c2e82 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:10.202152 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-438f1490-cdf8-495f-9097-81aff78c2e82 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f" status: 200 len: 1523 microversion: 2.1 time: 0.346575 Oct 30 01:29:10.202714 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1766/3532] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:09 2022] GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f => generated 1523 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:10.207163 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5c317da4-8ba3-402b-90ea-f98fec5a95f0 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:10.210870 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5c317da4-8ba3-402b-90ea-f98fec5a95f0 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: 688c35c4-9529-49df-8255-98cd2b56c314] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:10.224676 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c317da4-8ba3-402b-90ea-f98fec5a95f0 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:10.225158 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c317da4-8ba3-402b-90ea-f98fec5a95f0 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:10.225611 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c317da4-8ba3-402b-90ea-f98fec5a95f0 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:10.226482 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c317da4-8ba3-402b-90ea-f98fec5a95f0 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:10.226928 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c317da4-8ba3-402b-90ea-f98fec5a95f0 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:10.227551 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c317da4-8ba3-402b-90ea-f98fec5a95f0 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:10.233210 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1057b55d-0fb4-4877-9a76-c6c1ae0e23df tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:10.242650 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-5c317da4-8ba3-402b-90ea-f98fec5a95f0 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] HTTP exception thrown: Instance 688c35c4-9529-49df-8255-98cd2b56c314 could not be found. Oct 30 01:29:10.243799 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1057b55d-0fb4-4877-9a76-c6c1ae0e23df tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009" status: 200 len: 1499 microversion: 2.1 time: 0.333219 Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5c317da4-8ba3-402b-90ea-f98fec5a95f0 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Request method failure captured: Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/688c35c4-9529-49df-8255-98cd2b56c314 HTTP/1.1 Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdHeyUy7YRlBOjEIMB2SM5IZKoEM9E4CcgE_HPOqloJp1NZnn6dha472SrZ31y2exANSVhQ3YMhYfN1WKKWmY5LYeNp42aJgNRzc0qxtfn3HVOOFRHdXQayAjQiB3EhVLJEEiK3-p5hlGh_9_wOga5iGlHo5mVxXdGv2Ye2RftSaR1s Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 4aa9c648b20d41d7b150fbf64cde6fe8 Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ImagesTestJSON-298836005 Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ImagesTestJSON-298836005 Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 4aa9c648b20d41d7b150fbf64cde6fe8 Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ImagesTestJSON-298836005 Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ImagesTestJSON-298836005-project Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: f857d6b0826e47c6875a307e7ccfb104 Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ImagesTestJSON-298836005-project Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 688c35c4-9529-49df-8255-98cd2b56c314 could not be found. Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '688c35c4-9529-49df-8255-98cd2b56c314'} Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 688c35c4-9529-49df-8255-98cd2b56c314 could not be found. Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 688c35c4-9529-49df-8255-98cd2b56c314 could not be found. Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:10.244189 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:10.249179 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:29:10.249179 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:29:10.249179 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:29:10.249179 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:29:10.249179 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 688c35c4-9529-49df-8255-98cd2b56c314 could not be found. Oct 30 01:29:10.249179 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:10.250065 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1767/3533] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:09 2022] GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 => generated 1499 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:10.256670 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5c317da4-8ba3-402b-90ea-f98fec5a95f0 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Returning 404 to user: Instance 688c35c4-9529-49df-8255-98cd2b56c314 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:29:10.258146 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5c317da4-8ba3-402b-90ea-f98fec5a95f0 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/688c35c4-9529-49df-8255-98cd2b56c314" status: 404 len: 111 microversion: 2.1 time: 0.053954 Oct 30 01:29:10.258817 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1767/3534] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:10 2022] GET /compute/v2.1/servers/688c35c4-9529-49df-8255-98cd2b56c314 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:29:10.268040 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0fb23e53-578e-47c0-b77c-c780e406c841 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:29:10.268247 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8c5b952d-b2df-4466-9bb6-ccddbb377651 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44c7348700>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:10.270674 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0fb23e53-578e-47c0-b77c-c780e406c841 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d7cd54fb-1c64-4fb8-a97b-4d5c81a48009] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:10.278395 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0fb23e53-578e-47c0-b77c-c780e406c841 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:10.278892 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0fb23e53-578e-47c0-b77c-c780e406c841 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:10.279868 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0fb23e53-578e-47c0-b77c-c780e406c841 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:10.280574 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0fb23e53-578e-47c0-b77c-c780e406c841 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:10.281029 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0fb23e53-578e-47c0-b77c-c780e406c841 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:10.281477 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0fb23e53-578e-47c0-b77c-c780e406c841 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:10.293417 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-8c5b952d-b2df-4466-9bb6-ccddbb377651 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] HTTP exception thrown: Image not found. Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8c5b952d-b2df-4466-9bb6-ccddbb377651 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Request method failure captured: Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/images/10d86021-09d0-4f87-a249-2b033b1d6ae5 HTTP/1.1 Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdHeyUy7YRlBOjEIMB2SM5IZKoEM9E4CcgE_HPOqloJp1NZnn6dha472SrZ31y2exANSVhQ3YMhYfN1WKKWmY5LYeNp42aJgNRzc0qxtfn3HVOOFRHdXQayAjQiB3EhVLJEEiK3-p5hlGh_9_wOga5iGlHo5mVxXdGv2Ye2RftSaR1s Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 4aa9c648b20d41d7b150fbf64cde6fe8 Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ImagesTestJSON-298836005 Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ImagesTestJSON-298836005 Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 4aa9c648b20d41d7b150fbf64cde6fe8 Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ImagesTestJSON-298836005 Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ImagesTestJSON-298836005-project Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: f857d6b0826e47c6875a307e7ccfb104 Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ImagesTestJSON-298836005-project Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: method: Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: exception: Image not found. Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '10d86021-09d0-4f87-a249-2b033b1d6ae5'} Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 10d86021-09d0-4f87-a249-2b033b1d6ae5 to delete Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 10d86021-09d0-4f87-a249-2b033b1d6ae5 could not be found. Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:10.295851 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:10.308308 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:29:10.308308 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:29:10.308308 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:29:10.308308 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:29:10.308308 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:29:10.308308 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:29:10.308308 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:29:10.308308 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:29:10.308308 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 30 01:29:10.308308 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 30 01:29:10.308308 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 30 01:29:10.308308 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:10.308308 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:29:10.308308 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:10.308308 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:10.308308 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:29:10.308308 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:29:10.308308 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:29:10.308308 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:29:10.308308 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 30 01:29:10.308308 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:10.308308 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8c5b952d-b2df-4466-9bb6-ccddbb377651 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Returning 404 to user: Image not found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:29:10.308308 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8c5b952d-b2df-4466-9bb6-ccddbb377651 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "DELETE /compute/v2.1/images/10d86021-09d0-4f87-a249-2b033b1d6ae5" status: 404 len: 62 microversion: 2.1 time: 0.034622 Oct 30 01:29:10.308308 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1768/3535] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:10 2022] DELETE /compute/v2.1/images/10d86021-09d0-4f87-a249-2b033b1d6ae5 => generated 62 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:29:10.311324 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-0fb23e53-578e-47c0-b77c-c780e406c841 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lazy-loading 'flavor' on Instance uuid d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:29:10.317151 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-453af0b7-555d-4a5f-be6b-9b68017974ef tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:10.318619 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-453af0b7-555d-4a5f-be6b-9b68017974ef tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: 403e0292-c082-4655-ad08-b5dc3a7f8305] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:10.324680 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-453af0b7-555d-4a5f-be6b-9b68017974ef tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:10.325174 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-453af0b7-555d-4a5f-be6b-9b68017974ef tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:10.325633 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-453af0b7-555d-4a5f-be6b-9b68017974ef tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:10.326328 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-453af0b7-555d-4a5f-be6b-9b68017974ef tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:10.326781 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-453af0b7-555d-4a5f-be6b-9b68017974ef tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:10.327199 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-453af0b7-555d-4a5f-be6b-9b68017974ef tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:10.349626 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-453af0b7-555d-4a5f-be6b-9b68017974ef tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] HTTP exception thrown: Instance 403e0292-c082-4655-ad08-b5dc3a7f8305 could not be found. Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-453af0b7-555d-4a5f-be6b-9b68017974ef tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Request method failure captured: Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305 HTTP/1.1 Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdHeyUy7YRlBOjEIMB2SM5IZKoEM9E4CcgE_HPOqloJp1NZnn6dha472SrZ31y2exANSVhQ3YMhYfN1WKKWmY5LYeNp42aJgNRzc0qxtfn3HVOOFRHdXQayAjQiB3EhVLJEEiK3-p5hlGh_9_wOga5iGlHo5mVxXdGv2Ye2RftSaR1s Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 4aa9c648b20d41d7b150fbf64cde6fe8 Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ImagesTestJSON-298836005 Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ImagesTestJSON-298836005 Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 4aa9c648b20d41d7b150fbf64cde6fe8 Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ImagesTestJSON-298836005 Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ImagesTestJSON-298836005-project Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: f857d6b0826e47c6875a307e7ccfb104 Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ImagesTestJSON-298836005-project Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 403e0292-c082-4655-ad08-b5dc3a7f8305 could not be found. Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '403e0292-c082-4655-ad08-b5dc3a7f8305'} Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 403e0292-c082-4655-ad08-b5dc3a7f8305 could not be found. Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:29:10.351163 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 403e0292-c082-4655-ad08-b5dc3a7f8305 could not be found. Oct 30 01:29:10.356912 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:10.356912 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:29:10.356912 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:10.356912 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:10.356912 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:29:10.356912 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:29:10.356912 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:29:10.356912 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:29:10.356912 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 403e0292-c082-4655-ad08-b5dc3a7f8305 could not be found. Oct 30 01:29:10.356912 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:10.356912 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-453af0b7-555d-4a5f-be6b-9b68017974ef tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Returning 404 to user: Instance 403e0292-c082-4655-ad08-b5dc3a7f8305 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:29:10.356912 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-453af0b7-555d-4a5f-be6b-9b68017974ef tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "DELETE /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305" status: 404 len: 111 microversion: 2.1 time: 0.047779 Oct 30 01:29:10.356912 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1769/3536] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:29:10 2022] DELETE /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 01:29:10.361739 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0a1d81cb-9aea-4229-b557-72f895b05d3d tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:10.362352 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0a1d81cb-9aea-4229-b557-72f895b05d3d tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: 403e0292-c082-4655-ad08-b5dc3a7f8305] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:10.368494 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0a1d81cb-9aea-4229-b557-72f895b05d3d tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:10.368982 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0a1d81cb-9aea-4229-b557-72f895b05d3d tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:10.369446 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0a1d81cb-9aea-4229-b557-72f895b05d3d tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:10.370142 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0a1d81cb-9aea-4229-b557-72f895b05d3d tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:10.370600 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0a1d81cb-9aea-4229-b557-72f895b05d3d tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:10.371023 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0a1d81cb-9aea-4229-b557-72f895b05d3d tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:10.385554 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-0a1d81cb-9aea-4229-b557-72f895b05d3d tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] HTTP exception thrown: Instance 403e0292-c082-4655-ad08-b5dc3a7f8305 could not be found. Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0a1d81cb-9aea-4229-b557-72f895b05d3d tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Request method failure captured: Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305 HTTP/1.1 Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdHeyUy7YRlBOjEIMB2SM5IZKoEM9E4CcgE_HPOqloJp1NZnn6dha472SrZ31y2exANSVhQ3YMhYfN1WKKWmY5LYeNp42aJgNRzc0qxtfn3HVOOFRHdXQayAjQiB3EhVLJEEiK3-p5hlGh_9_wOga5iGlHo5mVxXdGv2Ye2RftSaR1s Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 4aa9c648b20d41d7b150fbf64cde6fe8 Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ImagesTestJSON-298836005 Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ImagesTestJSON-298836005 Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 4aa9c648b20d41d7b150fbf64cde6fe8 Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ImagesTestJSON-298836005 Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ImagesTestJSON-298836005-project Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: f857d6b0826e47c6875a307e7ccfb104 Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ImagesTestJSON-298836005-project Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 403e0292-c082-4655-ad08-b5dc3a7f8305 could not be found. Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '403e0292-c082-4655-ad08-b5dc3a7f8305'} Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 403e0292-c082-4655-ad08-b5dc3a7f8305 could not be found. Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 403e0292-c082-4655-ad08-b5dc3a7f8305 could not be found. Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:10.387268 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:10.394671 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:29:10.394671 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:29:10.394671 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:29:10.394671 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:29:10.394671 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 403e0292-c082-4655-ad08-b5dc3a7f8305 could not be found. Oct 30 01:29:10.394671 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:10.394671 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0a1d81cb-9aea-4229-b557-72f895b05d3d tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Returning 404 to user: Instance 403e0292-c082-4655-ad08-b5dc3a7f8305 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:29:10.394671 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0a1d81cb-9aea-4229-b557-72f895b05d3d tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305" status: 404 len: 111 microversion: 2.1 time: 0.031308 Oct 30 01:29:10.394671 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1770/3537] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:10 2022] GET /compute/v2.1/servers/403e0292-c082-4655-ad08-b5dc3a7f8305 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 01:29:10.397568 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-29127183-dca7-4dff-8c16-f54e0b2c1c03 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '.version_select at 0x7f44c7475f70>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:10.402967 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:10.420669 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-29127183-dca7-4dff-8c16-f54e0b2c1c03 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] HTTP exception thrown: Image not found. Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-29127183-dca7-4dff-8c16-f54e0b2c1c03 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Request method failure captured: Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/images/82fe897f-65b0-4444-8047-364cc9b70689 HTTP/1.1 Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdHeyUy7YRlBOjEIMB2SM5IZKoEM9E4CcgE_HPOqloJp1NZnn6dha472SrZ31y2exANSVhQ3YMhYfN1WKKWmY5LYeNp42aJgNRzc0qxtfn3HVOOFRHdXQayAjQiB3EhVLJEEiK3-p5hlGh_9_wOga5iGlHo5mVxXdGv2Ye2RftSaR1s Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 4aa9c648b20d41d7b150fbf64cde6fe8 Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ImagesTestJSON-298836005 Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ImagesTestJSON-298836005 Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 4aa9c648b20d41d7b150fbf64cde6fe8 Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ImagesTestJSON-298836005 Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ImagesTestJSON-298836005-project Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: f857d6b0826e47c6875a307e7ccfb104 Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ImagesTestJSON-298836005-project Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: method: Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: exception: Image not found. Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '82fe897f-65b0-4444-8047-364cc9b70689'} Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 82fe897f-65b0-4444-8047-364cc9b70689 to delete Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 82fe897f-65b0-4444-8047-364cc9b70689 could not be found. Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:10.422690 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:10.428280 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:29:10.428280 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:29:10.428280 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:29:10.428280 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:29:10.428280 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:29:10.428280 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:29:10.428280 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:29:10.428280 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:29:10.428280 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 30 01:29:10.428280 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 30 01:29:10.428280 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 30 01:29:10.428280 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:10.428280 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:29:10.428280 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:10.428280 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:10.428280 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:29:10.428280 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:29:10.428280 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:29:10.428280 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:29:10.428280 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 30 01:29:10.428280 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:10.428280 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-29127183-dca7-4dff-8c16-f54e0b2c1c03 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Returning 404 to user: Image not found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:29:10.428280 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-29127183-dca7-4dff-8c16-f54e0b2c1c03 tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "DELETE /compute/v2.1/images/82fe897f-65b0-4444-8047-364cc9b70689" status: 404 len: 62 microversion: 2.1 time: 0.030773 Oct 30 01:29:10.428280 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1771/3538] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:10 2022] DELETE /compute/v2.1/images/82fe897f-65b0-4444-8047-364cc9b70689 => generated 62 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:29:10.432923 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b1e82420-f4c4-4454-9b44-63695f66a0ce tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:10.433446 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b1e82420-f4c4-4454-9b44-63695f66a0ce tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: e3faeee3-0724-417b-8575-ac8e59663103] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:10.440961 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b1e82420-f4c4-4454-9b44-63695f66a0ce tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:10.441495 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b1e82420-f4c4-4454-9b44-63695f66a0ce tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:10.441924 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b1e82420-f4c4-4454-9b44-63695f66a0ce tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:10.445441 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b1e82420-f4c4-4454-9b44-63695f66a0ce tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:10.445441 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b1e82420-f4c4-4454-9b44-63695f66a0ce tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:10.445441 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b1e82420-f4c4-4454-9b44-63695f66a0ce tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:10.458579 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-b1e82420-f4c4-4454-9b44-63695f66a0ce tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] HTTP exception thrown: Instance e3faeee3-0724-417b-8575-ac8e59663103 could not be found. Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b1e82420-f4c4-4454-9b44-63695f66a0ce tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Request method failure captured: Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/servers/e3faeee3-0724-417b-8575-ac8e59663103 HTTP/1.1 Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdHeyUy7YRlBOjEIMB2SM5IZKoEM9E4CcgE_HPOqloJp1NZnn6dha472SrZ31y2exANSVhQ3YMhYfN1WKKWmY5LYeNp42aJgNRzc0qxtfn3HVOOFRHdXQayAjQiB3EhVLJEEiK3-p5hlGh_9_wOga5iGlHo5mVxXdGv2Ye2RftSaR1s Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 4aa9c648b20d41d7b150fbf64cde6fe8 Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ImagesTestJSON-298836005 Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ImagesTestJSON-298836005 Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 4aa9c648b20d41d7b150fbf64cde6fe8 Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ImagesTestJSON-298836005 Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ImagesTestJSON-298836005-project Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: f857d6b0826e47c6875a307e7ccfb104 Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ImagesTestJSON-298836005-project Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: exception: Instance e3faeee3-0724-417b-8575-ac8e59663103 could not be found. Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'e3faeee3-0724-417b-8575-ac8e59663103'} Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3faeee3-0724-417b-8575-ac8e59663103 could not be found. Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:29:10.460138 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3faeee3-0724-417b-8575-ac8e59663103 could not be found. Oct 30 01:29:10.464924 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:10.464924 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:29:10.464924 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:10.464924 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:10.464924 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:29:10.464924 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:29:10.464924 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:29:10.464924 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:29:10.464924 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3faeee3-0724-417b-8575-ac8e59663103 could not be found. Oct 30 01:29:10.464924 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:10.464924 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b1e82420-f4c4-4454-9b44-63695f66a0ce tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Returning 404 to user: Instance e3faeee3-0724-417b-8575-ac8e59663103 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:29:10.464924 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b1e82420-f4c4-4454-9b44-63695f66a0ce tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e3faeee3-0724-417b-8575-ac8e59663103" status: 404 len: 111 microversion: 2.1 time: 0.032290 Oct 30 01:29:10.464924 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1772/3539] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:29:10 2022] DELETE /compute/v2.1/servers/e3faeee3-0724-417b-8575-ac8e59663103 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:29:10.471014 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0aa6fcfa-abe9-4e83-8f8c-52d5889dac5a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:10.471861 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0aa6fcfa-abe9-4e83-8f8c-52d5889dac5a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] [instance: e3faeee3-0724-417b-8575-ac8e59663103] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:10.478263 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0aa6fcfa-abe9-4e83-8f8c-52d5889dac5a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:10.479241 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0aa6fcfa-abe9-4e83-8f8c-52d5889dac5a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:10.479675 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0aa6fcfa-abe9-4e83-8f8c-52d5889dac5a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:10.480444 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0aa6fcfa-abe9-4e83-8f8c-52d5889dac5a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:10.480890 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0aa6fcfa-abe9-4e83-8f8c-52d5889dac5a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:10.481309 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0aa6fcfa-abe9-4e83-8f8c-52d5889dac5a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:10.495330 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-0aa6fcfa-abe9-4e83-8f8c-52d5889dac5a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] HTTP exception thrown: Instance e3faeee3-0724-417b-8575-ac8e59663103 could not be found. Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0aa6fcfa-abe9-4e83-8f8c-52d5889dac5a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Request method failure captured: Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/e3faeee3-0724-417b-8575-ac8e59663103 HTTP/1.1 Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdHeyUy7YRlBOjEIMB2SM5IZKoEM9E4CcgE_HPOqloJp1NZnn6dha472SrZ31y2exANSVhQ3YMhYfN1WKKWmY5LYeNp42aJgNRzc0qxtfn3HVOOFRHdXQayAjQiB3EhVLJEEiK3-p5hlGh_9_wOga5iGlHo5mVxXdGv2Ye2RftSaR1s Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 4aa9c648b20d41d7b150fbf64cde6fe8 Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ImagesTestJSON-298836005 Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4aa9c648b20d41d7b150fbf64cde6fe8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ImagesTestJSON-298836005 Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 4aa9c648b20d41d7b150fbf64cde6fe8 Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ImagesTestJSON-298836005 Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ImagesTestJSON-298836005-project Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: f857d6b0826e47c6875a307e7ccfb104 Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ImagesTestJSON-298836005-project Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: exception: Instance e3faeee3-0724-417b-8575-ac8e59663103 could not be found. Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'e3faeee3-0724-417b-8575-ac8e59663103'} Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3faeee3-0724-417b-8575-ac8e59663103 could not be found. Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3faeee3-0724-417b-8575-ac8e59663103 could not be found. Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:10.496836 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:10.505932 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:29:10.505932 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:29:10.505932 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:29:10.505932 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:29:10.505932 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3faeee3-0724-417b-8575-ac8e59663103 could not be found. Oct 30 01:29:10.505932 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:10.505932 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0aa6fcfa-abe9-4e83-8f8c-52d5889dac5a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] Returning 404 to user: Instance e3faeee3-0724-417b-8575-ac8e59663103 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:29:10.505932 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0aa6fcfa-abe9-4e83-8f8c-52d5889dac5a tempest-ImagesTestJSON-298836005 tempest-ImagesTestJSON-298836005-project] 10.222.0.13 "GET /compute/v2.1/servers/e3faeee3-0724-417b-8575-ac8e59663103" status: 404 len: 111 microversion: 2.1 time: 0.032056 Oct 30 01:29:10.505932 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1773/3540] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:10 2022] GET /compute/v2.1/servers/e3faeee3-0724-417b-8575-ac8e59663103 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 01:29:10.667937 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b0602204-2274-4fd2-a453-561f44b2cdf2 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:10.668964 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b0602204-2274-4fd2-a453-561f44b2cdf2 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:10.672760 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0fb23e53-578e-47c0-b77c-c780e406c841 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "POST /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009/action" status: 200 len: 32 microversion: 2.1 time: 0.395617 Oct 30 01:29:10.675727 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1768/3541] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:29:10 2022] POST /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009/action => generated 32 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:29:10.690170 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0602204-2274-4fd2-a453-561f44b2cdf2 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:10.692620 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0602204-2274-4fd2-a453-561f44b2cdf2 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:10.693080 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6aa49fd1-03ce-4b97-aa61-17a4b0547a8d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:10.694299 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6aa49fd1-03ce-4b97-aa61-17a4b0547a8d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d7cd54fb-1c64-4fb8-a97b-4d5c81a48009] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:10.695402 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0602204-2274-4fd2-a453-561f44b2cdf2 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:10.696559 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0602204-2274-4fd2-a453-561f44b2cdf2 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:10.699297 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0602204-2274-4fd2-a453-561f44b2cdf2 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:10.701504 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0602204-2274-4fd2-a453-561f44b2cdf2 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:10.739859 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6aa49fd1-03ce-4b97-aa61-17a4b0547a8d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:10.740374 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6aa49fd1-03ce-4b97-aa61-17a4b0547a8d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:10.740821 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6aa49fd1-03ce-4b97-aa61-17a4b0547a8d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:10.742699 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6aa49fd1-03ce-4b97-aa61-17a4b0547a8d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:10.743722 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6aa49fd1-03ce-4b97-aa61-17a4b0547a8d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:10.744168 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6aa49fd1-03ce-4b97-aa61-17a4b0547a8d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:11.162796 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b0602204-2274-4fd2-a453-561f44b2cdf2 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:11.173360 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b0602204-2274-4fd2-a453-561f44b2cdf2 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:11.186560 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b0602204-2274-4fd2-a453-561f44b2cdf2 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:11.189982 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b0602204-2274-4fd2-a453-561f44b2cdf2 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1873 microversion: 2.32 time: 0.528449 Oct 30 01:29:11.191212 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1774/3542] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:29:10 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1873 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:29:11.202242 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2bd7e066-9a1f-4dab-a93a-307ee8bba05f tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:11.206656 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2bd7e066-9a1f-4dab-a93a-307ee8bba05f tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] [instance: 0bddfccb-0dc7-430f-88b6-41e25e23d934] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:11.221444 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2bd7e066-9a1f-4dab-a93a-307ee8bba05f tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:11.222463 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2bd7e066-9a1f-4dab-a93a-307ee8bba05f tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:11.225582 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2bd7e066-9a1f-4dab-a93a-307ee8bba05f tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:11.226771 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2bd7e066-9a1f-4dab-a93a-307ee8bba05f tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:11.228422 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2bd7e066-9a1f-4dab-a93a-307ee8bba05f tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:11.229466 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2bd7e066-9a1f-4dab-a93a-307ee8bba05f tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:11.634970 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6aa49fd1-03ce-4b97-aa61-17a4b0547a8d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:11.649079 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6aa49fd1-03ce-4b97-aa61-17a4b0547a8d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009" status: 200 len: 1505 microversion: 2.1 time: 0.962984 Oct 30 01:29:11.650947 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1769/3543] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:10 2022] GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 => generated 1505 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:11.663855 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-4b0162a3-ce70-42c7-8977-19911224d156 req-5a936c6e-87e1-4e56-bd62-eb2ffb79cf57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bddfccb-0dc7-430f-88b6-41e25e23d934", "tag": "de69109c-8655-473d-928d-a038a1218ac8"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:29:11.689660 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-4b0162a3-ce70-42c7-8977-19911224d156 req-5a936c6e-87e1-4e56-bd62-eb2ffb79cf57 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:11.692577 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-4b0162a3-ce70-42c7-8977-19911224d156 req-5a936c6e-87e1-4e56-bd62-eb2ffb79cf57 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:11.694084 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-4b0162a3-ce70-42c7-8977-19911224d156 req-5a936c6e-87e1-4e56-bd62-eb2ffb79cf57 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:11.724455 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-4b0162a3-ce70-42c7-8977-19911224d156 req-5a936c6e-87e1-4e56-bd62-eb2ffb79cf57 service nova] Creating event network-changed:de69109c-8655-473d-928d-a038a1218ac8 for instance 0bddfccb-0dc7-430f-88b6-41e25e23d934 on n-h1-master-1 Oct 30 01:29:11.741943 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-4b0162a3-ce70-42c7-8977-19911224d156 req-5a936c6e-87e1-4e56-bd62-eb2ffb79cf57 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084525 Oct 30 01:29:11.743261 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1770/3544] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:29:11.753708 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cc9665b5-c0f1-4741-9ce4-e1e385883538 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:11.758145 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-cc9665b5-c0f1-4741-9ce4-e1e385883538 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] [instance: 78081c7e-04f6-468e-9a0d-3c74c1092c6d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:11.795371 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cc9665b5-c0f1-4741-9ce4-e1e385883538 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:11.796596 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cc9665b5-c0f1-4741-9ce4-e1e385883538 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:11.799632 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cc9665b5-c0f1-4741-9ce4-e1e385883538 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:11.803996 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cc9665b5-c0f1-4741-9ce4-e1e385883538 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:11.804945 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cc9665b5-c0f1-4741-9ce4-e1e385883538 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:11.807609 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cc9665b5-c0f1-4741-9ce4-e1e385883538 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:12.705489 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2bd7e066-9a1f-4dab-a93a-307ee8bba05f tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b3394f28c4f444f8cd8bda6bacc9fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1e9b74043548e48a5bb8fb4d054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:12.716673 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2bd7e066-9a1f-4dab-a93a-307ee8bba05f tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] 10.222.0.13 "GET /compute/v2.1/servers/0bddfccb-0dc7-430f-88b6-41e25e23d934" status: 200 len: 1574 microversion: 2.1 time: 1.522930 Oct 30 01:29:12.730461 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1775/3545] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:11 2022] GET /compute/v2.1/servers/0bddfccb-0dc7-430f-88b6-41e25e23d934 => generated 1574 bytes in 1537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:12.747594 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-37451631-2197-408b-91e8-d7553cf10d84 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:12.748488 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-37451631-2197-408b-91e8-d7553cf10d84 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 2864065f-4af8-4134-b3f6-af254b7ab474] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:12.766238 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-37451631-2197-408b-91e8-d7553cf10d84 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:12.766238 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-37451631-2197-408b-91e8-d7553cf10d84 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:12.766238 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-37451631-2197-408b-91e8-d7553cf10d84 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:12.766238 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-37451631-2197-408b-91e8-d7553cf10d84 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:12.766748 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-37451631-2197-408b-91e8-d7553cf10d84 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:12.766748 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-37451631-2197-408b-91e8-d7553cf10d84 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:12.859903 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-cc9665b5-c0f1-4741-9ce4-e1e385883538 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd2e319840c4a8aab90b495374aa1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eba4d14f2004498850092bff100b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:12.869059 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cc9665b5-c0f1-4741-9ce4-e1e385883538 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] 10.222.0.13 "GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d" status: 200 len: 1302 microversion: 2.1 time: 1.124307 Oct 30 01:29:12.869800 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1771/3546] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:11 2022] GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d => generated 1302 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:12.892432 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a5b6d003-50e5-4b50-959e-2d010a4996ca tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:12.893262 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a5b6d003-50e5-4b50-959e-2d010a4996ca tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 2873be88-5d85-49c6-833f-19b7df1fcf5f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:12.899754 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a5b6d003-50e5-4b50-959e-2d010a4996ca tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:12.900716 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a5b6d003-50e5-4b50-959e-2d010a4996ca tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:12.901450 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a5b6d003-50e5-4b50-959e-2d010a4996ca tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:12.902781 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a5b6d003-50e5-4b50-959e-2d010a4996ca tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:12.903477 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a5b6d003-50e5-4b50-959e-2d010a4996ca tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:12.904391 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a5b6d003-50e5-4b50-959e-2d010a4996ca tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:13.536863 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-37451631-2197-408b-91e8-d7553cf10d84 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:13.544704 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a5b6d003-50e5-4b50-959e-2d010a4996ca tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:13.545370 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-37451631-2197-408b-91e8-d7553cf10d84 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/2864065f-4af8-4134-b3f6-af254b7ab474" status: 200 len: 1293 microversion: 2.1 time: 0.813546 Oct 30 01:29:13.547178 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1776/3547] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:12 2022] GET /compute/v2.1/servers/2864065f-4af8-4134-b3f6-af254b7ab474 => generated 1293 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:13.559280 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a5b6d003-50e5-4b50-959e-2d010a4996ca tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f" status: 200 len: 1523 microversion: 2.1 time: 0.670821 Oct 30 01:29:13.570118 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-19e7f925-6247-4150-af96-865c5b4b08be tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:13.570634 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1772/3548] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:12 2022] GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f => generated 1523 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:13.573167 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-19e7f925-6247-4150-af96-865c5b4b08be tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:13.585765 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-19e7f925-6247-4150-af96-865c5b4b08be tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:13.586665 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-19e7f925-6247-4150-af96-865c5b4b08be tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:13.587335 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-19e7f925-6247-4150-af96-865c5b4b08be tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:13.588387 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-19e7f925-6247-4150-af96-865c5b4b08be tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:13.589044 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-19e7f925-6247-4150-af96-865c5b4b08be tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:13.589882 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-19e7f925-6247-4150-af96-865c5b4b08be tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:13.591701 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-94f74bf5-f787-4fc9-a301-8ccf9277ec38 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:13.597150 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-94f74bf5-f787-4fc9-a301-8ccf9277ec38 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d7cd54fb-1c64-4fb8-a97b-4d5c81a48009] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:13.617576 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94f74bf5-f787-4fc9-a301-8ccf9277ec38 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:13.617576 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94f74bf5-f787-4fc9-a301-8ccf9277ec38 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:13.617576 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94f74bf5-f787-4fc9-a301-8ccf9277ec38 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:13.618682 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94f74bf5-f787-4fc9-a301-8ccf9277ec38 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:13.620649 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94f74bf5-f787-4fc9-a301-8ccf9277ec38 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:13.621139 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94f74bf5-f787-4fc9-a301-8ccf9277ec38 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:14.143848 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-94f74bf5-f787-4fc9-a301-8ccf9277ec38 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:14.158735 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-94f74bf5-f787-4fc9-a301-8ccf9277ec38 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009" status: 200 len: 1505 microversion: 2.1 time: 0.586723 Oct 30 01:29:14.159333 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1773/3549] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:13 2022] GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 => generated 1505 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:14.164211 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-ca4ca870-39e2-4fab-bf9e-c65c959ff4bd req-3204711f-1b96-4cfe-9454-8fd2c7d5fd01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78081c7e-04f6-468e-9a0d-3c74c1092c6d", "tag": "b74af5e9-2f4a-4f37-abb4-131b49622ba4"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:29:14.183648 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ca4ca870-39e2-4fab-bf9e-c65c959ff4bd req-3204711f-1b96-4cfe-9454-8fd2c7d5fd01 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:14.184141 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ca4ca870-39e2-4fab-bf9e-c65c959ff4bd req-3204711f-1b96-4cfe-9454-8fd2c7d5fd01 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:14.189705 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ca4ca870-39e2-4fab-bf9e-c65c959ff4bd req-3204711f-1b96-4cfe-9454-8fd2c7d5fd01 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:14.202098 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-19e7f925-6247-4150-af96-865c5b4b08be tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:14.220363 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-ca4ca870-39e2-4fab-bf9e-c65c959ff4bd req-3204711f-1b96-4cfe-9454-8fd2c7d5fd01 service nova] Creating event network-changed:b74af5e9-2f4a-4f37-abb4-131b49622ba4 for instance 78081c7e-04f6-468e-9a0d-3c74c1092c6d on n-h2-master-1 Oct 30 01:29:14.225605 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-19e7f925-6247-4150-af96-865c5b4b08be tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:14.232602 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-19e7f925-6247-4150-af96-865c5b4b08be tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:14.235050 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-19e7f925-6247-4150-af96-865c5b4b08be tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1873 microversion: 2.32 time: 0.686530 Oct 30 01:29:14.235457 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1777/3550] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:29:13 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1873 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:29:14.246540 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-ca4ca870-39e2-4fab-bf9e-c65c959ff4bd req-3204711f-1b96-4cfe-9454-8fd2c7d5fd01 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085960 Oct 30 01:29:14.247079 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c626181a-126c-492b-aa97-1035aea7d2f9 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:14.247282 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1774/3551] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:29:14.248187 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c626181a-126c-492b-aa97-1035aea7d2f9 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] [instance: 78081c7e-04f6-468e-9a0d-3c74c1092c6d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:14.272875 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c626181a-126c-492b-aa97-1035aea7d2f9 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:14.273693 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c626181a-126c-492b-aa97-1035aea7d2f9 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:14.275172 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c626181a-126c-492b-aa97-1035aea7d2f9 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:14.276064 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c626181a-126c-492b-aa97-1035aea7d2f9 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:14.276863 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c626181a-126c-492b-aa97-1035aea7d2f9 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:14.278085 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c626181a-126c-492b-aa97-1035aea7d2f9 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:14.341007 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-91cbf224-f7c1-43f6-bb9b-d6c9eff8ae78 req-4a7a36fc-9233-481e-856b-3b7e1c348c2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2864065f-4af8-4134-b3f6-af254b7ab474", "name": "network-vif-plugged", "status": "completed", "tag": "fd936916-f520-4593-848c-8120c98ac691"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:29:14.358312 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-91cbf224-f7c1-43f6-bb9b-d6c9eff8ae78 req-4a7a36fc-9233-481e-856b-3b7e1c348c2c service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:14.359691 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-91cbf224-f7c1-43f6-bb9b-d6c9eff8ae78 req-4a7a36fc-9233-481e-856b-3b7e1c348c2c service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:14.360721 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-91cbf224-f7c1-43f6-bb9b-d6c9eff8ae78 req-4a7a36fc-9233-481e-856b-3b7e1c348c2c service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:14.379694 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-91cbf224-f7c1-43f6-bb9b-d6c9eff8ae78 req-4a7a36fc-9233-481e-856b-3b7e1c348c2c service nova] Creating event network-vif-plugged:fd936916-f520-4593-848c-8120c98ac691 for instance 2864065f-4af8-4134-b3f6-af254b7ab474 on n-h2-master-1 Oct 30 01:29:14.399353 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-91cbf224-f7c1-43f6-bb9b-d6c9eff8ae78 req-4a7a36fc-9233-481e-856b-3b7e1c348c2c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061095 Oct 30 01:29:14.400192 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1775/3552] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:29:14.570347 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-06a6a717-0e52-4fd2-9a73-c18b421dccae tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:14.571496 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-06a6a717-0e52-4fd2-9a73-c18b421dccae tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 2864065f-4af8-4134-b3f6-af254b7ab474] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:14.583306 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-06a6a717-0e52-4fd2-9a73-c18b421dccae tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:14.583822 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-06a6a717-0e52-4fd2-9a73-c18b421dccae tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:14.584271 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-06a6a717-0e52-4fd2-9a73-c18b421dccae tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:14.585003 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-06a6a717-0e52-4fd2-9a73-c18b421dccae tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:14.585498 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-06a6a717-0e52-4fd2-9a73-c18b421dccae tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:14.585930 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-06a6a717-0e52-4fd2-9a73-c18b421dccae tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:14.597242 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:14.664630 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c626181a-126c-492b-aa97-1035aea7d2f9 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd2e319840c4a8aab90b495374aa1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eba4d14f2004498850092bff100b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:14.675345 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c626181a-126c-492b-aa97-1035aea7d2f9 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] 10.222.0.13 "GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d" status: 200 len: 1302 microversion: 2.1 time: 0.434947 Oct 30 01:29:14.676159 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1778/3553] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:14 2022] GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d => generated 1302 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:14.698037 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0b1556a8-f65c-4a39-84b5-4a5863980a8b tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:14.699014 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0b1556a8-f65c-4a39-84b5-4a5863980a8b tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 2873be88-5d85-49c6-833f-19b7df1fcf5f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:14.705989 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b1556a8-f65c-4a39-84b5-4a5863980a8b tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:14.706484 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b1556a8-f65c-4a39-84b5-4a5863980a8b tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:14.706982 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b1556a8-f65c-4a39-84b5-4a5863980a8b tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:14.707882 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b1556a8-f65c-4a39-84b5-4a5863980a8b tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:14.708510 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b1556a8-f65c-4a39-84b5-4a5863980a8b tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:14.709175 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b1556a8-f65c-4a39-84b5-4a5863980a8b tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:14.947424 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-06a6a717-0e52-4fd2-9a73-c18b421dccae tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:14.956090 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-06a6a717-0e52-4fd2-9a73-c18b421dccae tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/2864065f-4af8-4134-b3f6-af254b7ab474" status: 200 len: 1293 microversion: 2.1 time: 0.390296 Oct 30 01:29:14.956865 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1776/3554] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:14 2022] GET /compute/v2.1/servers/2864065f-4af8-4134-b3f6-af254b7ab474 => generated 1293 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:14.983210 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0b1556a8-f65c-4a39-84b5-4a5863980a8b tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:14.993800 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0b1556a8-f65c-4a39-84b5-4a5863980a8b tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f" status: 200 len: 1523 microversion: 2.1 time: 0.316336 Oct 30 01:29:14.994522 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1779/3555] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:14 2022] GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f => generated 1523 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:15.184522 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-92c31b2a-e5c6-4206-b922-961607d83f3a tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:15.185808 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-92c31b2a-e5c6-4206-b922-961607d83f3a tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d7cd54fb-1c64-4fb8-a97b-4d5c81a48009] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:15.223981 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-92c31b2a-e5c6-4206-b922-961607d83f3a tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:15.225874 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-92c31b2a-e5c6-4206-b922-961607d83f3a tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:15.226717 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-92c31b2a-e5c6-4206-b922-961607d83f3a tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:15.232482 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-92c31b2a-e5c6-4206-b922-961607d83f3a tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:15.232482 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-92c31b2a-e5c6-4206-b922-961607d83f3a tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:15.232482 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-92c31b2a-e5c6-4206-b922-961607d83f3a tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:15.264615 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a509df44-5223-4143-abdd-012cde79f061 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:15.265842 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a509df44-5223-4143-abdd-012cde79f061 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:15.267789 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:15.285024 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a509df44-5223-4143-abdd-012cde79f061 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:15.285815 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a509df44-5223-4143-abdd-012cde79f061 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:15.286639 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a509df44-5223-4143-abdd-012cde79f061 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:15.288887 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a509df44-5223-4143-abdd-012cde79f061 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:15.289422 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a509df44-5223-4143-abdd-012cde79f061 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:15.289898 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a509df44-5223-4143-abdd-012cde79f061 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:15.577695 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:15.642865 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-92c31b2a-e5c6-4206-b922-961607d83f3a tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:15.653877 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-92c31b2a-e5c6-4206-b922-961607d83f3a tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009" status: 200 len: 1505 microversion: 2.1 time: 0.473644 Oct 30 01:29:15.685366 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1777/3556] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:15 2022] GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 => generated 1505 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:15.698739 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a509df44-5223-4143-abdd-012cde79f061 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:15.702481 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ec3da2fb-33a2-4059-a821-f8599fc91667 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:15.702620 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ec3da2fb-33a2-4059-a821-f8599fc91667 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] [instance: 78081c7e-04f6-468e-9a0d-3c74c1092c6d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:15.711083 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ec3da2fb-33a2-4059-a821-f8599fc91667 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:15.711577 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ec3da2fb-33a2-4059-a821-f8599fc91667 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:15.712247 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ec3da2fb-33a2-4059-a821-f8599fc91667 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:15.713358 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ec3da2fb-33a2-4059-a821-f8599fc91667 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:15.714073 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ec3da2fb-33a2-4059-a821-f8599fc91667 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:15.714667 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ec3da2fb-33a2-4059-a821-f8599fc91667 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:15.719223 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a509df44-5223-4143-abdd-012cde79f061 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:15.725578 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a509df44-5223-4143-abdd-012cde79f061 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:15.729754 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a509df44-5223-4143-abdd-012cde79f061 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1873 microversion: 2.32 time: 0.467235 Oct 30 01:29:15.740543 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1780/3557] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:29:15 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1873 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:29:15.980895 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ec3da2fb-33a2-4059-a821-f8599fc91667 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd2e319840c4a8aab90b495374aa1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eba4d14f2004498850092bff100b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:15.981288 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-704087eb-3b0f-43a4-835d-2d1e8e707be5 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:15.982828 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-704087eb-3b0f-43a4-835d-2d1e8e707be5 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 2864065f-4af8-4134-b3f6-af254b7ab474] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:15.986716 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ec3da2fb-33a2-4059-a821-f8599fc91667 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] 10.222.0.13 "GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d" status: 200 len: 1302 microversion: 2.1 time: 0.289344 Oct 30 01:29:15.987311 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1778/3558] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:15 2022] GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d => generated 1302 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:16.005896 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-704087eb-3b0f-43a4-835d-2d1e8e707be5 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:16.006256 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-704087eb-3b0f-43a4-835d-2d1e8e707be5 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:16.011104 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-704087eb-3b0f-43a4-835d-2d1e8e707be5 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:16.015414 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-704087eb-3b0f-43a4-835d-2d1e8e707be5 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:16.015414 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-704087eb-3b0f-43a4-835d-2d1e8e707be5 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:16.019762 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-704087eb-3b0f-43a4-835d-2d1e8e707be5 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:16.021708 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8244b29f-883f-4c0d-b38f-4aa7a3ab1c7a tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:16.022529 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8244b29f-883f-4c0d-b38f-4aa7a3ab1c7a tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 2873be88-5d85-49c6-833f-19b7df1fcf5f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:16.029177 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8244b29f-883f-4c0d-b38f-4aa7a3ab1c7a tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:16.032568 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8244b29f-883f-4c0d-b38f-4aa7a3ab1c7a tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:16.033212 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8244b29f-883f-4c0d-b38f-4aa7a3ab1c7a tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:16.034276 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8244b29f-883f-4c0d-b38f-4aa7a3ab1c7a tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:16.043119 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8244b29f-883f-4c0d-b38f-4aa7a3ab1c7a tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:16.045299 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8244b29f-883f-4c0d-b38f-4aa7a3ab1c7a tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:16.540087 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8244b29f-883f-4c0d-b38f-4aa7a3ab1c7a tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:16.543979 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-704087eb-3b0f-43a4-835d-2d1e8e707be5 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:16.558964 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-704087eb-3b0f-43a4-835d-2d1e8e707be5 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/2864065f-4af8-4134-b3f6-af254b7ab474" status: 200 len: 1293 microversion: 2.1 time: 0.582721 Oct 30 01:29:16.560152 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1781/3559] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:15 2022] GET /compute/v2.1/servers/2864065f-4af8-4134-b3f6-af254b7ab474 => generated 1293 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:16.575122 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8244b29f-883f-4c0d-b38f-4aa7a3ab1c7a tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f" status: 200 len: 1523 microversion: 2.1 time: 0.541694 Oct 30 01:29:16.575885 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1779/3560] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:16 2022] GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f => generated 1523 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:16.696948 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f36f5f93-0d65-43a1-aa70-a19573df62ec tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:16.697582 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f36f5f93-0d65-43a1-aa70-a19573df62ec tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d7cd54fb-1c64-4fb8-a97b-4d5c81a48009] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:16.715443 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f36f5f93-0d65-43a1-aa70-a19573df62ec tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:16.716457 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f36f5f93-0d65-43a1-aa70-a19573df62ec tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:16.716739 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f36f5f93-0d65-43a1-aa70-a19573df62ec tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:16.718010 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f36f5f93-0d65-43a1-aa70-a19573df62ec tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:16.718467 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f36f5f93-0d65-43a1-aa70-a19573df62ec tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:16.718894 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f36f5f93-0d65-43a1-aa70-a19573df62ec tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:16.763990 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5955561a-780a-41e7-96a0-73563d987635 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:16.766378 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5955561a-780a-41e7-96a0-73563d987635 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:16.776900 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=14 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:16.778540 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5955561a-780a-41e7-96a0-73563d987635 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:16.779034 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5955561a-780a-41e7-96a0-73563d987635 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:16.779507 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5955561a-780a-41e7-96a0-73563d987635 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:16.780748 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5955561a-780a-41e7-96a0-73563d987635 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:16.781195 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5955561a-780a-41e7-96a0-73563d987635 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:16.794067 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5955561a-780a-41e7-96a0-73563d987635 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:17.119477 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f36f5f93-0d65-43a1-aa70-a19573df62ec tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:17.128269 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f36f5f93-0d65-43a1-aa70-a19573df62ec tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009" status: 200 len: 1505 microversion: 2.1 time: 0.435251 Oct 30 01:29:17.132651 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1782/3561] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:16 2022] GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 => generated 1505 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:17.149487 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-24914d54-35e1-454c-8be5-90dfc65b2e51 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:17.150558 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-24914d54-35e1-454c-8be5-90dfc65b2e51 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] [instance: 78081c7e-04f6-468e-9a0d-3c74c1092c6d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:17.158059 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24914d54-35e1-454c-8be5-90dfc65b2e51 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:17.158829 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24914d54-35e1-454c-8be5-90dfc65b2e51 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:17.159473 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24914d54-35e1-454c-8be5-90dfc65b2e51 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:17.161530 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24914d54-35e1-454c-8be5-90dfc65b2e51 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:17.162169 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24914d54-35e1-454c-8be5-90dfc65b2e51 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:17.162753 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24914d54-35e1-454c-8be5-90dfc65b2e51 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:17.223763 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5955561a-780a-41e7-96a0-73563d987635 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:17.244568 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5955561a-780a-41e7-96a0-73563d987635 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:17.246057 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5955561a-780a-41e7-96a0-73563d987635 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:17.248124 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5955561a-780a-41e7-96a0-73563d987635 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1873 microversion: 2.32 time: 0.487704 Oct 30 01:29:17.261796 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1780/3562] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:29:16 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1873 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:29:17.395744 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-24914d54-35e1-454c-8be5-90dfc65b2e51 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd2e319840c4a8aab90b495374aa1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eba4d14f2004498850092bff100b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:17.396013 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-24914d54-35e1-454c-8be5-90dfc65b2e51 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] 10.222.0.13 "GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d" status: 200 len: 1302 microversion: 2.1 time: 0.261140 Oct 30 01:29:17.396786 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1783/3563] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:17 2022] GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d => generated 1302 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:17.603827 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-018ebff8-bdc4-4437-ac1b-052c165b4441 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:17.605033 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-018ebff8-bdc4-4437-ac1b-052c165b4441 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 2873be88-5d85-49c6-833f-19b7df1fcf5f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:17.608651 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1c872f52-09fd-46dc-94b2-5b74b3bb669d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:17.609104 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1c872f52-09fd-46dc-94b2-5b74b3bb669d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 2864065f-4af8-4134-b3f6-af254b7ab474] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:17.612994 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-018ebff8-bdc4-4437-ac1b-052c165b4441 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:17.613747 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-018ebff8-bdc4-4437-ac1b-052c165b4441 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:17.614403 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-018ebff8-bdc4-4437-ac1b-052c165b4441 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:17.615293 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-018ebff8-bdc4-4437-ac1b-052c165b4441 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:17.615911 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-018ebff8-bdc4-4437-ac1b-052c165b4441 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:17.616537 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-018ebff8-bdc4-4437-ac1b-052c165b4441 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:17.619221 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1c872f52-09fd-46dc-94b2-5b74b3bb669d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:17.619821 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1c872f52-09fd-46dc-94b2-5b74b3bb669d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:17.620335 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1c872f52-09fd-46dc-94b2-5b74b3bb669d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:17.621458 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1c872f52-09fd-46dc-94b2-5b74b3bb669d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:17.622065 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1c872f52-09fd-46dc-94b2-5b74b3bb669d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:17.622859 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1c872f52-09fd-46dc-94b2-5b74b3bb669d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:17.845857 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-018ebff8-bdc4-4437-ac1b-052c165b4441 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:17.849581 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1c872f52-09fd-46dc-94b2-5b74b3bb669d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:17.859132 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1c872f52-09fd-46dc-94b2-5b74b3bb669d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/2864065f-4af8-4134-b3f6-af254b7ab474" status: 200 len: 1475 microversion: 2.1 time: 0.256986 Oct 30 01:29:17.859742 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1784/3564] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:17 2022] GET /compute/v2.1/servers/2864065f-4af8-4134-b3f6-af254b7ab474 => generated 1475 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:17.861289 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-018ebff8-bdc4-4437-ac1b-052c165b4441 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f" status: 200 len: 1523 microversion: 2.1 time: 0.254692 Oct 30 01:29:17.861953 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1781/3565] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:17 2022] GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f => generated 1523 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:17.992321 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-133b3c11-b4f7-44b0-9f42-7617494991dc tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1523751023", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:29:18.068309 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-133b3c11-b4f7-44b0-9f42-7617494991dc tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] validate_networks() for [('936faadb-2266-486c-9624-31976f3a3668', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:29:18.158165 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b37972c2-0785-4db2-8f3d-3c09a895dec9 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:18.160070 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b37972c2-0785-4db2-8f3d-3c09a895dec9 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d7cd54fb-1c64-4fb8-a97b-4d5c81a48009] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:18.168731 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b37972c2-0785-4db2-8f3d-3c09a895dec9 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:18.169377 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b37972c2-0785-4db2-8f3d-3c09a895dec9 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:18.171209 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b37972c2-0785-4db2-8f3d-3c09a895dec9 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:18.172358 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b37972c2-0785-4db2-8f3d-3c09a895dec9 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:18.173583 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b37972c2-0785-4db2-8f3d-3c09a895dec9 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:18.173583 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b37972c2-0785-4db2-8f3d-3c09a895dec9 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:18.463017 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b37972c2-0785-4db2-8f3d-3c09a895dec9 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:18.478225 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b37972c2-0785-4db2-8f3d-3c09a895dec9 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009" status: 200 len: 1505 microversion: 2.1 time: 0.325911 Oct 30 01:29:18.480262 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1782/3566] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:18 2022] GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 => generated 1505 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:18.505403 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-28c2ee1e-94e1-4e93-8a32-a39e9889ebd2 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:18.506023 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-28c2ee1e-94e1-4e93-8a32-a39e9889ebd2 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:18.521421 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-28c2ee1e-94e1-4e93-8a32-a39e9889ebd2 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:18.521914 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-28c2ee1e-94e1-4e93-8a32-a39e9889ebd2 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:18.523175 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-28c2ee1e-94e1-4e93-8a32-a39e9889ebd2 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:18.523175 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-28c2ee1e-94e1-4e93-8a32-a39e9889ebd2 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:18.523479 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-28c2ee1e-94e1-4e93-8a32-a39e9889ebd2 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:18.523900 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-28c2ee1e-94e1-4e93-8a32-a39e9889ebd2 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:18.701954 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-133b3c11-b4f7-44b0-9f42-7617494991dc tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:29:18.702497 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-133b3c11-b4f7-44b0-9f42-7617494991dc tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:29:18.702876 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-133b3c11-b4f7-44b0-9f42-7617494991dc tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:29:18.703380 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-133b3c11-b4f7-44b0-9f42-7617494991dc tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:29:18.703793 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-133b3c11-b4f7-44b0-9f42-7617494991dc tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:29:18.723592 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-133b3c11-b4f7-44b0-9f42-7617494991dc tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:18.724420 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-133b3c11-b4f7-44b0-9f42-7617494991dc tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:18.725030 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-133b3c11-b4f7-44b0-9f42-7617494991dc tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:18.725976 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-133b3c11-b4f7-44b0-9f42-7617494991dc tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:18.726599 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-133b3c11-b4f7-44b0-9f42-7617494991dc tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:18.727295 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-133b3c11-b4f7-44b0-9f42-7617494991dc tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:18.764750 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-28c2ee1e-94e1-4e93-8a32-a39e9889ebd2 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:18.767710 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-133b3c11-b4f7-44b0-9f42-7617494991dc tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Getting quotas for project 45fe1c50eaee40249b6c20cc91e52586. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:29:18.775437 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-28c2ee1e-94e1-4e93-8a32-a39e9889ebd2 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:18.777629 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-28c2ee1e-94e1-4e93-8a32-a39e9889ebd2 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:18.777792 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-133b3c11-b4f7-44b0-9f42-7617494991dc tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Getting quotas for user ef5f8a3e6fef4d6393603575479b16a2 and project 45fe1c50eaee40249b6c20cc91e52586. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:29:18.780048 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-28c2ee1e-94e1-4e93-8a32-a39e9889ebd2 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1873 microversion: 2.32 time: 0.296738 Oct 30 01:29:18.781254 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1783/3567] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:29:18 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1873 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:29:18.796068 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-133b3c11-b4f7-44b0-9f42-7617494991dc tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:29:18.804293 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-30a316f4-62e9-401c-a51c-a4a1199b1482 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:18.804862 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-30a316f4-62e9-401c-a51c-a4a1199b1482 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] [instance: 78081c7e-04f6-468e-9a0d-3c74c1092c6d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:18.807471 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-133b3c11-b4f7-44b0-9f42-7617494991dc tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 0071471f-7af1-489c-8df1-e679bbd6d07a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:29:18.815941 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-30a316f4-62e9-401c-a51c-a4a1199b1482 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:18.819020 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-30a316f4-62e9-401c-a51c-a4a1199b1482 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:18.819531 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-30a316f4-62e9-401c-a51c-a4a1199b1482 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:18.821646 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-30a316f4-62e9-401c-a51c-a4a1199b1482 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:18.822132 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-30a316f4-62e9-401c-a51c-a4a1199b1482 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:18.822575 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-30a316f4-62e9-401c-a51c-a4a1199b1482 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:18.986306 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-133b3c11-b4f7-44b0-9f42-7617494991dc tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.998405 Oct 30 01:29:18.987279 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1785/3568] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:29:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1000 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:29:18.996241 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5ce79225-c0c3-4d72-b752-96d6c978d879 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:19.000190 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5ce79225-c0c3-4d72-b752-96d6c978d879 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 2873be88-5d85-49c6-833f-19b7df1fcf5f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:19.017711 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5ce79225-c0c3-4d72-b752-96d6c978d879 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:19.019500 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5ce79225-c0c3-4d72-b752-96d6c978d879 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:19.020169 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5ce79225-c0c3-4d72-b752-96d6c978d879 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:19.021208 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5ce79225-c0c3-4d72-b752-96d6c978d879 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:19.023443 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5ce79225-c0c3-4d72-b752-96d6c978d879 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:19.024121 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5ce79225-c0c3-4d72-b752-96d6c978d879 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:19.071771 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-30a316f4-62e9-401c-a51c-a4a1199b1482 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd2e319840c4a8aab90b495374aa1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eba4d14f2004498850092bff100b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:19.080812 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-30a316f4-62e9-401c-a51c-a4a1199b1482 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] 10.222.0.13 "GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d" status: 200 len: 1290 microversion: 2.1 time: 0.298234 Oct 30 01:29:19.081418 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1784/3569] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:18 2022] GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d => generated 1290 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:19.111361 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9c3eb5bb-338b-41ba-9df8-957c0b96372d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:19.112211 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9c3eb5bb-338b-41ba-9df8-957c0b96372d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 0071471f-7af1-489c-8df1-e679bbd6d07a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:19.150102 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9c3eb5bb-338b-41ba-9df8-957c0b96372d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 0071471f-7af1-489c-8df1-e679bbd6d07a] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:29:19.251980 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:19.294437 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5ce79225-c0c3-4d72-b752-96d6c978d879 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:19.324454 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5ce79225-c0c3-4d72-b752-96d6c978d879 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f" status: 200 len: 1523 microversion: 2.1 time: 0.335957 Oct 30 01:29:19.335892 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1786/3570] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:18 2022] GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f => generated 1523 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:19.511977 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-44512053-b2ca-437a-ac96-677a082ee124 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:19.511977 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-44512053-b2ca-437a-ac96-677a082ee124 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d7cd54fb-1c64-4fb8-a97b-4d5c81a48009] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:19.527535 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44512053-b2ca-437a-ac96-677a082ee124 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:19.534684 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44512053-b2ca-437a-ac96-677a082ee124 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:19.539796 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44512053-b2ca-437a-ac96-677a082ee124 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:19.541406 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44512053-b2ca-437a-ac96-677a082ee124 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:19.542423 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44512053-b2ca-437a-ac96-677a082ee124 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:19.544219 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44512053-b2ca-437a-ac96-677a082ee124 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:19.561585 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:19.770321 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-44512053-b2ca-437a-ac96-677a082ee124 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:19.778867 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-44512053-b2ca-437a-ac96-677a082ee124 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009" status: 200 len: 1505 microversion: 2.1 time: 0.277686 Oct 30 01:29:19.780616 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1787/3571] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:19 2022] GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 => generated 1505 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:19.797199 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9c3eb5bb-338b-41ba-9df8-957c0b96372d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0071471f-7af1-489c-8df1-e679bbd6d07a" status: 204 len: 0 microversion: 2.1 time: 0.689730 Oct 30 01:29:19.805402 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1785/3572] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:29:19 2022] DELETE /compute/v2.1/servers/0071471f-7af1-489c-8df1-e679bbd6d07a => generated 0 bytes in 716 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:29:19.810715 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-55017304-50b0-4e59-bbc6-bfe5e2ef5519 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:19.811376 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-55017304-50b0-4e59-bbc6-bfe5e2ef5519 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:19.815264 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1cc36981-ccfe-42b8-88db-faf81f5446ae tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:19.815887 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1cc36981-ccfe-42b8-88db-faf81f5446ae tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 0071471f-7af1-489c-8df1-e679bbd6d07a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:19.825396 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-55017304-50b0-4e59-bbc6-bfe5e2ef5519 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:19.825980 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-55017304-50b0-4e59-bbc6-bfe5e2ef5519 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:19.826420 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-55017304-50b0-4e59-bbc6-bfe5e2ef5519 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:19.827138 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-55017304-50b0-4e59-bbc6-bfe5e2ef5519 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:19.827648 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-55017304-50b0-4e59-bbc6-bfe5e2ef5519 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:19.828082 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-55017304-50b0-4e59-bbc6-bfe5e2ef5519 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:19.847193 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-1cc36981-ccfe-42b8-88db-faf81f5446ae tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] HTTP exception thrown: Instance 0071471f-7af1-489c-8df1-e679bbd6d07a could not be found. Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1cc36981-ccfe-42b8-88db-faf81f5446ae tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Request method failure captured: Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/0071471f-7af1-489c-8df1-e679bbd6d07a HTTP/1.1 Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdNZbeUR7skwu5ylmljymLwmsn3OMAB7HFdlDZsip3dgOK-vaOPPSwUYmWT_o9z2OqWc9cL2Rd22cHSa-BN8vqcvBTHGvFnuVH3dT1kVAQG6ODQVt2oxoFKeXYoNTjg1JUCF1B7Vzk2gVPeSesCiSDD37BDZ3_Wp6AgzZI4w4KMCOXw Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 45fe1c50eaee40249b6c20cc91e52586 Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServersTestJSON-1478392549 Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServersTestJSON-1478392549 Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 45fe1c50eaee40249b6c20cc91e52586 Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServersTestJSON-1478392549 Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServersTestJSON-1478392549-project Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: ef5f8a3e6fef4d6393603575479b16a2 Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServersTestJSON-1478392549-project Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 0071471f-7af1-489c-8df1-e679bbd6d07a could not be found. Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '0071471f-7af1-489c-8df1-e679bbd6d07a'} Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2932, in _get_instance Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance 0071471f-7af1-489c-8df1-e679bbd6d07a Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0071471f-7af1-489c-8df1-e679bbd6d07a could not be found. Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:29:19.860531 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:29:19.868850 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:29:19.868850 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:29:19.868850 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:29:19.868850 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:29:19.868850 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:29:19.868850 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:29:19.868850 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:29:19.868850 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:29:19.868850 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:29:19.868850 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:29:19.868850 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0071471f-7af1-489c-8df1-e679bbd6d07a could not be found. Oct 30 01:29:19.868850 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:19.868850 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:29:19.868850 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:19.868850 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:19.868850 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:29:19.868850 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:29:19.868850 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:29:19.868850 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:29:19.868850 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0071471f-7af1-489c-8df1-e679bbd6d07a could not be found. Oct 30 01:29:19.868850 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:19.868850 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1cc36981-ccfe-42b8-88db-faf81f5446ae tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Returning 404 to user: Instance 0071471f-7af1-489c-8df1-e679bbd6d07a could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:29:19.868850 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1cc36981-ccfe-42b8-88db-faf81f5446ae tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/0071471f-7af1-489c-8df1-e679bbd6d07a" status: 404 len: 111 microversion: 2.1 time: 0.059886 Oct 30 01:29:19.873435 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1788/3573] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:19 2022] GET /compute/v2.1/servers/0071471f-7af1-489c-8df1-e679bbd6d07a => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:29:20.005989 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a738b4d8-7f14-4bd5-8d5d-1f0513041b1b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-445989032", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "936faadb-2266-486c-9624-31976f3a3668"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:29:20.073048 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-a738b4d8-7f14-4bd5-8d5d-1f0513041b1b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] validate_networks() for [('936faadb-2266-486c-9624-31976f3a3668', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:29:20.095517 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-55017304-50b0-4e59-bbc6-bfe5e2ef5519 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:20.107751 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-55017304-50b0-4e59-bbc6-bfe5e2ef5519 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:20.109564 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-55017304-50b0-4e59-bbc6-bfe5e2ef5519 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:20.110923 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-55017304-50b0-4e59-bbc6-bfe5e2ef5519 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1873 microversion: 2.32 time: 0.304269 Oct 30 01:29:20.121660 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1786/3574] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:29:19 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1873 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:29:20.121660 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a7391ab0-9002-4403-85c9-5ea85512631f tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:20.121660 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a7391ab0-9002-4403-85c9-5ea85512631f tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] [instance: 78081c7e-04f6-468e-9a0d-3c74c1092c6d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:20.125884 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a7391ab0-9002-4403-85c9-5ea85512631f tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:20.126637 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a7391ab0-9002-4403-85c9-5ea85512631f tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:20.127284 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a7391ab0-9002-4403-85c9-5ea85512631f tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:20.128161 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a7391ab0-9002-4403-85c9-5ea85512631f tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:20.128786 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a7391ab0-9002-4403-85c9-5ea85512631f tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:20.129406 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a7391ab0-9002-4403-85c9-5ea85512631f tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:20.370734 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a7391ab0-9002-4403-85c9-5ea85512631f tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd2e319840c4a8aab90b495374aa1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eba4d14f2004498850092bff100b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:20.379308 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a7391ab0-9002-4403-85c9-5ea85512631f tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] 10.222.0.13 "GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d" status: 200 len: 1290 microversion: 2.1 time: 0.266191 Oct 30 01:29:20.380088 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1787/3575] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:20 2022] GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d => generated 1290 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:20.385254 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-61a76331-418b-4fc1-a418-81715312d703 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:20.386011 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-61a76331-418b-4fc1-a418-81715312d703 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 2873be88-5d85-49c6-833f-19b7df1fcf5f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:20.392535 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-61a76331-418b-4fc1-a418-81715312d703 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:20.393147 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-61a76331-418b-4fc1-a418-81715312d703 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:20.398346 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-61a76331-418b-4fc1-a418-81715312d703 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:20.401537 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-61a76331-418b-4fc1-a418-81715312d703 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:20.407391 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-61a76331-418b-4fc1-a418-81715312d703 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:20.407969 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-61a76331-418b-4fc1-a418-81715312d703 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:20.663259 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-61a76331-418b-4fc1-a418-81715312d703 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:20.672218 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-61a76331-418b-4fc1-a418-81715312d703 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f" status: 200 len: 1523 microversion: 2.1 time: 0.290882 Oct 30 01:29:20.672813 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1788/3576] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:20 2022] GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f => generated 1523 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:20.727803 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-a738b4d8-7f14-4bd5-8d5d-1f0513041b1b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:29:20.728230 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-a738b4d8-7f14-4bd5-8d5d-1f0513041b1b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:29:20.728704 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-a738b4d8-7f14-4bd5-8d5d-1f0513041b1b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:29:20.729136 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-a738b4d8-7f14-4bd5-8d5d-1f0513041b1b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:29:20.729590 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-a738b4d8-7f14-4bd5-8d5d-1f0513041b1b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:29:20.738418 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a738b4d8-7f14-4bd5-8d5d-1f0513041b1b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:20.742096 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a738b4d8-7f14-4bd5-8d5d-1f0513041b1b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:20.742096 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a738b4d8-7f14-4bd5-8d5d-1f0513041b1b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:20.742096 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a738b4d8-7f14-4bd5-8d5d-1f0513041b1b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:20.742096 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a738b4d8-7f14-4bd5-8d5d-1f0513041b1b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:20.742096 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a738b4d8-7f14-4bd5-8d5d-1f0513041b1b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:20.758581 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-a738b4d8-7f14-4bd5-8d5d-1f0513041b1b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Getting quotas for project 45fe1c50eaee40249b6c20cc91e52586. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:29:20.764365 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-a738b4d8-7f14-4bd5-8d5d-1f0513041b1b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Getting quotas for user ef5f8a3e6fef4d6393603575479b16a2 and project 45fe1c50eaee40249b6c20cc91e52586. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:29:20.776747 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a738b4d8-7f14-4bd5-8d5d-1f0513041b1b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:29:20.779059 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a738b4d8-7f14-4bd5-8d5d-1f0513041b1b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: ea637c0e-df6b-4c7f-a3ee-1b76fec47311] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:29:20.803636 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e19f4a32-928f-40f3-aa40-0c5291597b60 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:20.804286 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e19f4a32-928f-40f3-aa40-0c5291597b60 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d7cd54fb-1c64-4fb8-a97b-4d5c81a48009] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:20.812111 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e19f4a32-928f-40f3-aa40-0c5291597b60 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:20.816879 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e19f4a32-928f-40f3-aa40-0c5291597b60 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:20.816879 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e19f4a32-928f-40f3-aa40-0c5291597b60 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:20.816879 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e19f4a32-928f-40f3-aa40-0c5291597b60 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:20.816879 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e19f4a32-928f-40f3-aa40-0c5291597b60 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:20.816879 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e19f4a32-928f-40f3-aa40-0c5291597b60 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:20.966617 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a738b4d8-7f14-4bd5-8d5d-1f0513041b1b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.965763 Oct 30 01:29:20.967533 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1789/3577] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:29:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 968 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 30 01:29:20.977596 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e19f4a32-928f-40f3-aa40-0c5291597b60 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:20.978934 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a46f64f2-3c00-40da-8322-e7f176257e6e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:20.979737 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a46f64f2-3c00-40da-8322-e7f176257e6e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: ea637c0e-df6b-4c7f-a3ee-1b76fec47311] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:20.985931 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e19f4a32-928f-40f3-aa40-0c5291597b60 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009" status: 200 len: 1505 microversion: 2.1 time: 0.186153 Oct 30 01:29:20.986769 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1789/3578] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:20 2022] GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 => generated 1505 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:29:21.048506 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a46f64f2-3c00-40da-8322-e7f176257e6e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:21.055989 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a46f64f2-3c00-40da-8322-e7f176257e6e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311" status: 200 len: 1220 microversion: 2.1 time: 0.081234 Oct 30 01:29:21.056558 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1790/3579] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:20 2022] GET /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:21.137746 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4d28ffac-41b8-4c5d-9e7e-ff7e76e0f827 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:21.138441 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4d28ffac-41b8-4c5d-9e7e-ff7e76e0f827 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:21.144807 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4d28ffac-41b8-4c5d-9e7e-ff7e76e0f827 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:21.145521 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4d28ffac-41b8-4c5d-9e7e-ff7e76e0f827 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:21.145962 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4d28ffac-41b8-4c5d-9e7e-ff7e76e0f827 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:21.146658 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4d28ffac-41b8-4c5d-9e7e-ff7e76e0f827 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:21.147284 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4d28ffac-41b8-4c5d-9e7e-ff7e76e0f827 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:21.147766 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4d28ffac-41b8-4c5d-9e7e-ff7e76e0f827 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:21.347522 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4d28ffac-41b8-4c5d-9e7e-ff7e76e0f827 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:21.360075 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4d28ffac-41b8-4c5d-9e7e-ff7e76e0f827 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:21.362220 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4d28ffac-41b8-4c5d-9e7e-ff7e76e0f827 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:21.363386 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4d28ffac-41b8-4c5d-9e7e-ff7e76e0f827 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1873 microversion: 2.32 time: 0.229818 Oct 30 01:29:21.364025 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1790/3580] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:29:21 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1873 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:29:21.410708 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-45e19091-9b91-4c80-a40b-351c19514c11 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:21.412083 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-45e19091-9b91-4c80-a40b-351c19514c11 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] [instance: 78081c7e-04f6-468e-9a0d-3c74c1092c6d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:21.418775 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-45e19091-9b91-4c80-a40b-351c19514c11 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:21.420203 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-45e19091-9b91-4c80-a40b-351c19514c11 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:21.420942 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-45e19091-9b91-4c80-a40b-351c19514c11 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:21.422270 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-45e19091-9b91-4c80-a40b-351c19514c11 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:21.423558 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-45e19091-9b91-4c80-a40b-351c19514c11 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:21.424256 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-45e19091-9b91-4c80-a40b-351c19514c11 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:21.591689 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-45e19091-9b91-4c80-a40b-351c19514c11 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd2e319840c4a8aab90b495374aa1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eba4d14f2004498850092bff100b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:21.599458 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-45e19091-9b91-4c80-a40b-351c19514c11 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] 10.222.0.13 "GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d" status: 200 len: 1290 microversion: 2.1 time: 0.196838 Oct 30 01:29:21.600035 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1791/3581] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:21 2022] GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d => generated 1290 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:21.698835 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-44035ff0-d330-4f9b-94d9-a94fab994eb7 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:21.699447 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-44035ff0-d330-4f9b-94d9-a94fab994eb7 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 2873be88-5d85-49c6-833f-19b7df1fcf5f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:21.707120 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-44035ff0-d330-4f9b-94d9-a94fab994eb7 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:21.707804 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-44035ff0-d330-4f9b-94d9-a94fab994eb7 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:21.708236 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-44035ff0-d330-4f9b-94d9-a94fab994eb7 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:21.708932 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-44035ff0-d330-4f9b-94d9-a94fab994eb7 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:21.709400 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-44035ff0-d330-4f9b-94d9-a94fab994eb7 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:21.709823 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-44035ff0-d330-4f9b-94d9-a94fab994eb7 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:21.848707 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-44035ff0-d330-4f9b-94d9-a94fab994eb7 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:21.856799 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-44035ff0-d330-4f9b-94d9-a94fab994eb7 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f" status: 200 len: 1503 microversion: 2.1 time: 0.162794 Oct 30 01:29:21.857415 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1791/3582] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:21 2022] GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f => generated 1503 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:21.879123 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8d77abd8-1436-41f3-b8a8-2acea5f075e0 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:21.885576 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8d77abd8-1436-41f3-b8a8-2acea5f075e0 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 28af596f-f044-4281-8106-4585fbde9a4a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:21.887215 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d77abd8-1436-41f3-b8a8-2acea5f075e0 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:21.888389 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d77abd8-1436-41f3-b8a8-2acea5f075e0 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:21.889236 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d77abd8-1436-41f3-b8a8-2acea5f075e0 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:21.890360 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d77abd8-1436-41f3-b8a8-2acea5f075e0 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:21.891301 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d77abd8-1436-41f3-b8a8-2acea5f075e0 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:21.891999 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d77abd8-1436-41f3-b8a8-2acea5f075e0 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:22.009655 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ef40e1ea-a38f-4194-a63c-07b3a7ab609e tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:22.010327 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ef40e1ea-a38f-4194-a63c-07b3a7ab609e tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d7cd54fb-1c64-4fb8-a97b-4d5c81a48009] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:22.019811 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ef40e1ea-a38f-4194-a63c-07b3a7ab609e tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:22.020707 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ef40e1ea-a38f-4194-a63c-07b3a7ab609e tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:22.021405 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ef40e1ea-a38f-4194-a63c-07b3a7ab609e tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:22.022510 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ef40e1ea-a38f-4194-a63c-07b3a7ab609e tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:22.023179 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ef40e1ea-a38f-4194-a63c-07b3a7ab609e tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:22.023818 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ef40e1ea-a38f-4194-a63c-07b3a7ab609e tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:22.057721 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8d77abd8-1436-41f3-b8a8-2acea5f075e0 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:22.066440 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8d77abd8-1436-41f3-b8a8-2acea5f075e0 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a" status: 200 len: 1516 microversion: 2.1 time: 0.191042 Oct 30 01:29:22.067250 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1792/3583] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:21 2022] GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a => generated 1516 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:22.082539 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4db4578c-574d-427a-b536-e77740a04add tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:22.084292 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4db4578c-574d-427a-b536-e77740a04add tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: ea637c0e-df6b-4c7f-a3ee-1b76fec47311] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:22.092231 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4db4578c-574d-427a-b536-e77740a04add tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:22.092848 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4db4578c-574d-427a-b536-e77740a04add tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:22.093178 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4db4578c-574d-427a-b536-e77740a04add tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:22.094465 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4db4578c-574d-427a-b536-e77740a04add tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:22.094943 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4db4578c-574d-427a-b536-e77740a04add tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:22.095741 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4db4578c-574d-427a-b536-e77740a04add tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:22.176377 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4db4578c-574d-427a-b536-e77740a04add tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:22.184469 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4db4578c-574d-427a-b536-e77740a04add tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311" status: 200 len: 1224 microversion: 2.1 time: 0.107643 Oct 30 01:29:22.189960 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1793/3584] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:22 2022] GET /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311 => generated 1224 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:22.192168 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-088df339-fe18-4aab-a80e-a67a633c10f4 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:29:22.194771 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-088df339-fe18-4aab-a80e-a67a633c10f4 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 0a8062e0-1b1d-4b4e-aa18-9ffa3f7d3976] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:22.202062 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-088df339-fe18-4aab-a80e-a67a633c10f4 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] HTTP exception thrown: Instance 0a8062e0-1b1d-4b4e-aa18-9ffa3f7d3976 could not be found. Oct 30 01:29:22.202479 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ef40e1ea-a38f-4194-a63c-07b3a7ab609e tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:22.210633 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ef40e1ea-a38f-4194-a63c-07b3a7ab609e tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009" status: 200 len: 1505 microversion: 2.1 time: 0.204910 Oct 30 01:29:22.211215 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1792/3585] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:22 2022] GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 => generated 1505 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-088df339-fe18-4aab-a80e-a67a633c10f4 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Request method failure captured: Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/servers/0a8062e0-1b1d-4b4e-aa18-9ffa3f7d3976/action HTTP/1.1 Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 14 Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdMpBfA6mq8oavinMeTyaurexihmj6JmnnP2ZZndb1MXJnyLYJP1lh9IAGUFmytWgjEkCc6rHAh1wpEFldWPgYBauossNbR0UQldGfx9XACde0J5etDs6i2phO_G-HCGpqKWqFyqD3FJkTb44yZ7CHZV6U0ZtcSE1Hf7lvcXbJ_Lvp0 Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 470e235fb35840828d9a86028b72f5de Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-909936776 Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/470e235fb35840828d9a86028b72f5de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_470e235fb35840828d9a86028b72f5de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/470e235fb35840828d9a86028b72f5de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/470e235fb35840828d9a86028b72f5de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServerRescueNegativeTestJSON-909936776 Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 470e235fb35840828d9a86028b72f5de Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-909936776 Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServerRescueNegativeTestJSON-909936776-project Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 6134c05549f14bc19962acea9c913f53 Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServerRescueNegativeTestJSON-909936776-project Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: {"rescue": {}} Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 0a8062e0-1b1d-4b4e-aa18-9ffa3f7d3976 could not be found. Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '0a8062e0-1b1d-4b4e-aa18-9ffa3f7d3976', 'body': {'rescue': {}}} Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a8062e0-1b1d-4b4e-aa18-9ffa3f7d3976 could not be found. Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a8062e0-1b1d-4b4e-aa18-9ffa3f7d3976 could not be found. Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:22.218640 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:22.224717 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:29:22.224717 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:29:22.224717 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:29:22.224717 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:29:22.224717 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a8062e0-1b1d-4b4e-aa18-9ffa3f7d3976 could not be found. Oct 30 01:29:22.224717 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:29:22.224717 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-088df339-fe18-4aab-a80e-a67a633c10f4 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Returning 404 to user: Instance 0a8062e0-1b1d-4b4e-aa18-9ffa3f7d3976 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:29:22.224717 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-088df339-fe18-4aab-a80e-a67a633c10f4 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "POST /compute/v2.1/servers/0a8062e0-1b1d-4b4e-aa18-9ffa3f7d3976/action" status: 404 len: 111 microversion: 2.1 time: 0.033131 Oct 30 01:29:22.224717 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1794/3586] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:29:22 2022] POST /compute/v2.1/servers/0a8062e0-1b1d-4b4e-aa18-9ffa3f7d3976/action => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:29:22.238125 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-101c5cc4-5c14-4341-a25a-8ba1037398e3 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:29:22.238893 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-101c5cc4-5c14-4341-a25a-8ba1037398e3 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 28af596f-f044-4281-8106-4585fbde9a4a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:22.245077 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-101c5cc4-5c14-4341-a25a-8ba1037398e3 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:22.245680 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-101c5cc4-5c14-4341-a25a-8ba1037398e3 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:22.246184 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-101c5cc4-5c14-4341-a25a-8ba1037398e3 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:22.246950 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-101c5cc4-5c14-4341-a25a-8ba1037398e3 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:22.248000 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-101c5cc4-5c14-4341-a25a-8ba1037398e3 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:22.248481 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-101c5cc4-5c14-4341-a25a-8ba1037398e3 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:22.281591 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=100 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:22.392615 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7c49535a-1488-4299-91fc-22b2f53fd575 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:22.394028 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7c49535a-1488-4299-91fc-22b2f53fd575 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:22.401550 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7c49535a-1488-4299-91fc-22b2f53fd575 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:22.402074 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7c49535a-1488-4299-91fc-22b2f53fd575 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:22.403656 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7c49535a-1488-4299-91fc-22b2f53fd575 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:22.403656 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7c49535a-1488-4299-91fc-22b2f53fd575 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:22.404299 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7c49535a-1488-4299-91fc-22b2f53fd575 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:22.404733 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7c49535a-1488-4299-91fc-22b2f53fd575 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:22.511407 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-101c5cc4-5c14-4341-a25a-8ba1037398e3 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "POST /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a/action" status: 202 len: 0 microversion: 2.1 time: 0.283625 Oct 30 01:29:22.515254 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1793/3587] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:29:22 2022] POST /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:29:22.521164 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-18bd8515-8f7b-434b-8071-833393e6a074 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:22.522189 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-18bd8515-8f7b-434b-8071-833393e6a074 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 28af596f-f044-4281-8106-4585fbde9a4a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:22.530530 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-18bd8515-8f7b-434b-8071-833393e6a074 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:22.531302 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-18bd8515-8f7b-434b-8071-833393e6a074 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:22.531923 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-18bd8515-8f7b-434b-8071-833393e6a074 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:22.532833 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-18bd8515-8f7b-434b-8071-833393e6a074 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:22.545022 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-18bd8515-8f7b-434b-8071-833393e6a074 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:22.545526 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-18bd8515-8f7b-434b-8071-833393e6a074 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:22.914461 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7c49535a-1488-4299-91fc-22b2f53fd575 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:22.924407 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7c49535a-1488-4299-91fc-22b2f53fd575 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:22.925883 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7c49535a-1488-4299-91fc-22b2f53fd575 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:22.927050 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7c49535a-1488-4299-91fc-22b2f53fd575 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1873 microversion: 2.32 time: 0.540589 Oct 30 01:29:22.927913 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1795/3588] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:29:22 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1873 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:29:22.932301 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ab94d416-fcd2-4225-b77b-61420361ccd4 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:22.932897 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ab94d416-fcd2-4225-b77b-61420361ccd4 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] [instance: 78081c7e-04f6-468e-9a0d-3c74c1092c6d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:22.937499 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-18bd8515-8f7b-434b-8071-833393e6a074 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:22.939303 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ab94d416-fcd2-4225-b77b-61420361ccd4 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:22.939789 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ab94d416-fcd2-4225-b77b-61420361ccd4 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:22.940354 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ab94d416-fcd2-4225-b77b-61420361ccd4 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:22.941254 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ab94d416-fcd2-4225-b77b-61420361ccd4 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:22.941917 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ab94d416-fcd2-4225-b77b-61420361ccd4 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:22.942337 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ab94d416-fcd2-4225-b77b-61420361ccd4 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:22.946944 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-18bd8515-8f7b-434b-8071-833393e6a074 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a" status: 200 len: 1521 microversion: 2.1 time: 0.430027 Oct 30 01:29:22.947524 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1794/3589] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:22 2022] GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a => generated 1521 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:29:23.079469 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ab94d416-fcd2-4225-b77b-61420361ccd4 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd2e319840c4a8aab90b495374aa1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eba4d14f2004498850092bff100b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:23.089049 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ab94d416-fcd2-4225-b77b-61420361ccd4 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] 10.222.0.13 "GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d" status: 200 len: 1290 microversion: 2.1 time: 0.160172 Oct 30 01:29:23.089664 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1796/3590] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:22 2022] GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d => generated 1290 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:23.211954 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ea77037e-699f-4eb7-9df3-2a373d05f423 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:23.213998 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ea77037e-699f-4eb7-9df3-2a373d05f423 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: ea637c0e-df6b-4c7f-a3ee-1b76fec47311] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:23.219049 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ea77037e-699f-4eb7-9df3-2a373d05f423 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:23.219532 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ea77037e-699f-4eb7-9df3-2a373d05f423 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:23.219964 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ea77037e-699f-4eb7-9df3-2a373d05f423 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:23.220646 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ea77037e-699f-4eb7-9df3-2a373d05f423 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:23.221101 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ea77037e-699f-4eb7-9df3-2a373d05f423 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:23.221561 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ea77037e-699f-4eb7-9df3-2a373d05f423 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:23.235482 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-94f0a379-6f6f-4fb8-9658-8f4b40fe9d7b tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:23.237502 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-94f0a379-6f6f-4fb8-9658-8f4b40fe9d7b tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d7cd54fb-1c64-4fb8-a97b-4d5c81a48009] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:23.242204 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-94f0a379-6f6f-4fb8-9658-8f4b40fe9d7b tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:23.242690 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-94f0a379-6f6f-4fb8-9658-8f4b40fe9d7b tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:23.243123 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-94f0a379-6f6f-4fb8-9658-8f4b40fe9d7b tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:23.243815 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-94f0a379-6f6f-4fb8-9658-8f4b40fe9d7b tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:23.244317 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-94f0a379-6f6f-4fb8-9658-8f4b40fe9d7b tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:23.244734 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-94f0a379-6f6f-4fb8-9658-8f4b40fe9d7b tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:23.288015 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ea77037e-699f-4eb7-9df3-2a373d05f423 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:23.296099 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ea77037e-699f-4eb7-9df3-2a373d05f423 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311" status: 200 len: 1272 microversion: 2.1 time: 0.087905 Oct 30 01:29:23.296695 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1795/3591] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:23 2022] GET /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311 => generated 1272 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:23.386083 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-94f0a379-6f6f-4fb8-9658-8f4b40fe9d7b tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:23.394641 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-94f0a379-6f6f-4fb8-9658-8f4b40fe9d7b tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009" status: 200 len: 1505 microversion: 2.1 time: 0.163080 Oct 30 01:29:23.399752 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1797/3592] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:23 2022] GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 => generated 1505 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:29:23.953800 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-70de22be-9ff6-4f22-91f4-0b2a9b6bbc34 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:23.954681 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-70de22be-9ff6-4f22-91f4-0b2a9b6bbc34 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:23.962338 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-70de22be-9ff6-4f22-91f4-0b2a9b6bbc34 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:23.963126 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-70de22be-9ff6-4f22-91f4-0b2a9b6bbc34 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:23.963708 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-70de22be-9ff6-4f22-91f4-0b2a9b6bbc34 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:23.964525 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-70de22be-9ff6-4f22-91f4-0b2a9b6bbc34 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:23.965086 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-70de22be-9ff6-4f22-91f4-0b2a9b6bbc34 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:23.965645 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-70de22be-9ff6-4f22-91f4-0b2a9b6bbc34 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:23.973852 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f8e0043e-121b-4270-b62a-368a35843f99 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:23.975318 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f8e0043e-121b-4270-b62a-368a35843f99 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 28af596f-f044-4281-8106-4585fbde9a4a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:23.983849 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f8e0043e-121b-4270-b62a-368a35843f99 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:23.989508 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f8e0043e-121b-4270-b62a-368a35843f99 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:23.989508 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f8e0043e-121b-4270-b62a-368a35843f99 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:23.989508 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f8e0043e-121b-4270-b62a-368a35843f99 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:23.989508 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f8e0043e-121b-4270-b62a-368a35843f99 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:23.989508 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f8e0043e-121b-4270-b62a-368a35843f99 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:24.301320 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f8e0043e-121b-4270-b62a-368a35843f99 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:24.309599 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f8e0043e-121b-4270-b62a-368a35843f99 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a" status: 200 len: 1501 microversion: 2.1 time: 0.341478 Oct 30 01:29:24.310491 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1798/3593] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:23 2022] GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a => generated 1501 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:24.315043 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0bbfc490-2676-4714-832c-caa50741f4ed tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:24.317411 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0bbfc490-2676-4714-832c-caa50741f4ed tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] [instance: 78081c7e-04f6-468e-9a0d-3c74c1092c6d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:24.320175 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-70de22be-9ff6-4f22-91f4-0b2a9b6bbc34 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:24.322972 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0bbfc490-2676-4714-832c-caa50741f4ed tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:24.323576 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0bbfc490-2676-4714-832c-caa50741f4ed tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:24.324005 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0bbfc490-2676-4714-832c-caa50741f4ed tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:24.324930 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0bbfc490-2676-4714-832c-caa50741f4ed tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:24.325400 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0bbfc490-2676-4714-832c-caa50741f4ed tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:24.325822 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0bbfc490-2676-4714-832c-caa50741f4ed tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:24.330795 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-70de22be-9ff6-4f22-91f4-0b2a9b6bbc34 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:24.332278 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-70de22be-9ff6-4f22-91f4-0b2a9b6bbc34 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:24.333908 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-70de22be-9ff6-4f22-91f4-0b2a9b6bbc34 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1873 microversion: 2.32 time: 0.384896 Oct 30 01:29:24.334487 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1796/3594] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:29:23 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1873 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:29:24.339226 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ed4ea604-bf9c-47b8-84e6-d8ebb742cf58 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44c73f2160>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:24.383136 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ed4ea604-bf9c-47b8-84e6-d8ebb742cf58 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/234948a7-5415-40b5-a397-9bf3004e532a" status: 200 len: 662 microversion: 2.1 time: 0.047393 Oct 30 01:29:24.383731 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1797/3595] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:29:24 2022] GET /compute/v2.1/images/234948a7-5415-40b5-a397-9bf3004e532a => generated 662 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:29:24.392627 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-00d23681-1510-41f8-b06c-530711771942 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:24.392627 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-00d23681-1510-41f8-b06c-530711771942 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: ea637c0e-df6b-4c7f-a3ee-1b76fec47311] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:24.395652 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-00d23681-1510-41f8-b06c-530711771942 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:24.396456 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-00d23681-1510-41f8-b06c-530711771942 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:24.396907 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-00d23681-1510-41f8-b06c-530711771942 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:24.397689 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-00d23681-1510-41f8-b06c-530711771942 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:24.398130 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-00d23681-1510-41f8-b06c-530711771942 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:24.398555 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-00d23681-1510-41f8-b06c-530711771942 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:24.488222 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-00d23681-1510-41f8-b06c-530711771942 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:24.497459 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-00d23681-1510-41f8-b06c-530711771942 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311" status: 200 len: 1272 microversion: 2.1 time: 0.112653 Oct 30 01:29:24.498137 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1798/3596] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:24 2022] GET /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311 => generated 1272 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:24.503275 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-311a5253-8d57-462b-afdf-c320be12c775 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:29:24.505917 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-311a5253-8d57-462b-afdf-c320be12c775 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 28af596f-f044-4281-8106-4585fbde9a4a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:24.511485 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0bbfc490-2676-4714-832c-caa50741f4ed tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd2e319840c4a8aab90b495374aa1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eba4d14f2004498850092bff100b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:24.512988 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-311a5253-8d57-462b-afdf-c320be12c775 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:24.513742 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-311a5253-8d57-462b-afdf-c320be12c775 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:24.514953 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-311a5253-8d57-462b-afdf-c320be12c775 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:24.515897 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-311a5253-8d57-462b-afdf-c320be12c775 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:24.516834 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-311a5253-8d57-462b-afdf-c320be12c775 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:24.517514 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-311a5253-8d57-462b-afdf-c320be12c775 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:24.518858 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0bbfc490-2676-4714-832c-caa50741f4ed tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] 10.222.0.13 "GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d" status: 200 len: 1290 microversion: 2.1 time: 0.207288 Oct 30 01:29:24.519439 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1799/3597] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:24 2022] GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d => generated 1290 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:24.526696 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-260c6776-ecf7-4a71-9710-846b5464c106 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44c7357820>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:24.543661 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-311a5253-8d57-462b-afdf-c320be12c775 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lazy-loading 'flavor' on Instance uuid 28af596f-f044-4281-8106-4585fbde9a4a {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:29:24.557198 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-311a5253-8d57-462b-afdf-c320be12c775 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] HTTP exception thrown: Cannot 'rescue' instance 28af596f-f044-4281-8106-4585fbde9a4a while it is in vm_state paused Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-311a5253-8d57-462b-afdf-c320be12c775 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Request method failure captured: Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: request: POST /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a/action HTTP/1.1 Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 14 Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdMpBfA6mq8oavinMeTyaurexihmj6JmnnP2ZZndb1MXJnyLYJP1lh9IAGUFmytWgjEkCc6rHAh1wpEFldWPgYBauossNbR0UQldGfx9XACde0J5etDs6i2phO_G-HCGpqKWqFyqD3FJkTb44yZ7CHZV6U0ZtcSE1Hf7lvcXbJ_Lvp0 Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 470e235fb35840828d9a86028b72f5de Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-909936776 Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/470e235fb35840828d9a86028b72f5de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_470e235fb35840828d9a86028b72f5de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/470e235fb35840828d9a86028b72f5de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/470e235fb35840828d9a86028b72f5de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServerRescueNegativeTestJSON-909936776 Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 470e235fb35840828d9a86028b72f5de Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-909936776 Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServerRescueNegativeTestJSON-909936776-project Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 6134c05549f14bc19962acea9c913f53 Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServerRescueNegativeTestJSON-909936776-project Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: {"rescue": {}} Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: exception: Cannot 'rescue' instance 28af596f-f044-4281-8106-4585fbde9a4a while it is in vm_state paused Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '28af596f-f044-4281-8106-4585fbde9a4a', 'body': {'rescue': {}}} Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 28af596f-f044-4281-8106-4585fbde9a4a in vm_state paused. Cannot rescue while the instance is in this state. Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 28af596f-f044-4281-8106-4585fbde9a4a while it is in vm_state paused Oct 30 01:29:24.559429 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:29:24.572162 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:29:24.572162 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:29:24.572162 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:24.572162 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:29:24.572162 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:29:24.572162 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:29:24.572162 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:29:24.572162 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 28af596f-f044-4281-8106-4585fbde9a4a while it is in vm_state paused Oct 30 01:29:24.572162 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:29:24.572162 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-311a5253-8d57-462b-afdf-c320be12c775 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Returning 409 to user: Cannot 'rescue' instance 28af596f-f044-4281-8106-4585fbde9a4a while it is in vm_state paused {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:29:24.572162 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-311a5253-8d57-462b-afdf-c320be12c775 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "POST /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a/action" status: 409 len: 144 microversion: 2.1 time: 0.063962 Oct 30 01:29:24.572162 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1799/3598] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:29:24 2022] POST /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a/action => generated 144 bytes in 65 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:29:24.572162 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-623dcc5c-7a12-4e2c-8a5a-69e87bc0ffd6 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:24.572162 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-623dcc5c-7a12-4e2c-8a5a-69e87bc0ffd6 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d7cd54fb-1c64-4fb8-a97b-4d5c81a48009] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:24.574296 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-260c6776-ecf7-4a71-9710-846b5464c106 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/234948a7-5415-40b5-a397-9bf3004e532a" status: 200 len: 662 microversion: 2.1 time: 0.052604 Oct 30 01:29:24.575769 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1800/3599] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:29:24 2022] GET /compute/v2.1/images/234948a7-5415-40b5-a397-9bf3004e532a => generated 662 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:29:24.578879 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-623dcc5c-7a12-4e2c-8a5a-69e87bc0ffd6 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:24.579380 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-623dcc5c-7a12-4e2c-8a5a-69e87bc0ffd6 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:24.579811 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-623dcc5c-7a12-4e2c-8a5a-69e87bc0ffd6 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:24.580506 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-623dcc5c-7a12-4e2c-8a5a-69e87bc0ffd6 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:24.580829 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cc788946-2918-49fa-8d98-892c840b5f60 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:29:24.580952 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-623dcc5c-7a12-4e2c-8a5a-69e87bc0ffd6 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:24.581376 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cc788946-2918-49fa-8d98-892c840b5f60 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 28af596f-f044-4281-8106-4585fbde9a4a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:24.581538 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-623dcc5c-7a12-4e2c-8a5a-69e87bc0ffd6 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:24.594969 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cc788946-2918-49fa-8d98-892c840b5f60 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:24.595605 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cc788946-2918-49fa-8d98-892c840b5f60 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:24.596637 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cc788946-2918-49fa-8d98-892c840b5f60 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:24.598201 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cc788946-2918-49fa-8d98-892c840b5f60 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:24.599066 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cc788946-2918-49fa-8d98-892c840b5f60 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:24.599718 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cc788946-2918-49fa-8d98-892c840b5f60 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:24.740789 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-623dcc5c-7a12-4e2c-8a5a-69e87bc0ffd6 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:24.748940 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-623dcc5c-7a12-4e2c-8a5a-69e87bc0ffd6 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009" status: 200 len: 1505 microversion: 2.1 time: 0.183998 Oct 30 01:29:24.749550 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1800/3600] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:24 2022] GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 => generated 1505 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:24.826746 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cc788946-2918-49fa-8d98-892c840b5f60 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "POST /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a/action" status: 202 len: 0 microversion: 2.1 time: 0.249241 Oct 30 01:29:24.830873 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1801/3601] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:29:24 2022] POST /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:29:24.836681 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f58bfdff-6905-45fd-b7ef-b7a892a8e344 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:24.837607 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f58bfdff-6905-45fd-b7ef-b7a892a8e344 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 28af596f-f044-4281-8106-4585fbde9a4a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:24.844678 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f58bfdff-6905-45fd-b7ef-b7a892a8e344 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:24.845178 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f58bfdff-6905-45fd-b7ef-b7a892a8e344 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:24.845646 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f58bfdff-6905-45fd-b7ef-b7a892a8e344 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:24.846541 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f58bfdff-6905-45fd-b7ef-b7a892a8e344 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:24.847020 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f58bfdff-6905-45fd-b7ef-b7a892a8e344 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:24.847627 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f58bfdff-6905-45fd-b7ef-b7a892a8e344 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:24.991566 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f58bfdff-6905-45fd-b7ef-b7a892a8e344 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:25.000000 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f58bfdff-6905-45fd-b7ef-b7a892a8e344 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a" status: 200 len: 1508 microversion: 2.1 time: 0.167504 Oct 30 01:29:25.000565 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1801/3602] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:24 2022] GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a => generated 1508 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:25.361176 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5c18e932-c5ac-4685-ae3a-17e528420e1b tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:25.362600 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5c18e932-c5ac-4685-ae3a-17e528420e1b tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:25.378809 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c18e932-c5ac-4685-ae3a-17e528420e1b tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:25.383714 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c18e932-c5ac-4685-ae3a-17e528420e1b tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:25.383714 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c18e932-c5ac-4685-ae3a-17e528420e1b tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:25.383714 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c18e932-c5ac-4685-ae3a-17e528420e1b tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:25.383714 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c18e932-c5ac-4685-ae3a-17e528420e1b tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:25.383714 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c18e932-c5ac-4685-ae3a-17e528420e1b tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:25.522961 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9c75fa05-38a9-492e-8997-51077a3da91b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:25.524156 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9c75fa05-38a9-492e-8997-51077a3da91b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: ea637c0e-df6b-4c7f-a3ee-1b76fec47311] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:25.532516 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9c75fa05-38a9-492e-8997-51077a3da91b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:25.533510 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9c75fa05-38a9-492e-8997-51077a3da91b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:25.534442 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9c75fa05-38a9-492e-8997-51077a3da91b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:25.535514 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9c75fa05-38a9-492e-8997-51077a3da91b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:25.536140 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9c75fa05-38a9-492e-8997-51077a3da91b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:25.536703 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9c75fa05-38a9-492e-8997-51077a3da91b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:25.655448 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5c18e932-c5ac-4685-ae3a-17e528420e1b tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:25.680088 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5c18e932-c5ac-4685-ae3a-17e528420e1b tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:25.681785 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5c18e932-c5ac-4685-ae3a-17e528420e1b tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:25.683099 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5c18e932-c5ac-4685-ae3a-17e528420e1b tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1873 microversion: 2.32 time: 0.326384 Oct 30 01:29:25.684859 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1802/3603] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:29:25 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1873 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:29:25.689770 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5f94863f-11ad-4536-9645-6e2db7dcf45a tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:25.690734 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5f94863f-11ad-4536-9645-6e2db7dcf45a tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] [instance: 78081c7e-04f6-468e-9a0d-3c74c1092c6d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:25.697975 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f94863f-11ad-4536-9645-6e2db7dcf45a tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:25.701088 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f94863f-11ad-4536-9645-6e2db7dcf45a tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:25.701088 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f94863f-11ad-4536-9645-6e2db7dcf45a tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:25.701088 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f94863f-11ad-4536-9645-6e2db7dcf45a tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:25.701088 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f94863f-11ad-4536-9645-6e2db7dcf45a tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:25.701537 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f94863f-11ad-4536-9645-6e2db7dcf45a tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:25.704776 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9c75fa05-38a9-492e-8997-51077a3da91b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:25.713164 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9c75fa05-38a9-492e-8997-51077a3da91b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311" status: 200 len: 1280 microversion: 2.1 time: 0.196408 Oct 30 01:29:25.730973 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1802/3604] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:25 2022] GET /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311 => generated 1280 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:29:25.781659 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-abb81a1d-f4ae-431f-ae59-2a19341ad575 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:25.781659 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-abb81a1d-f4ae-431f-ae59-2a19341ad575 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d7cd54fb-1c64-4fb8-a97b-4d5c81a48009] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:25.795458 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-abb81a1d-f4ae-431f-ae59-2a19341ad575 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:25.795857 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-abb81a1d-f4ae-431f-ae59-2a19341ad575 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:25.796298 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-abb81a1d-f4ae-431f-ae59-2a19341ad575 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:25.797023 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-abb81a1d-f4ae-431f-ae59-2a19341ad575 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:25.797614 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-abb81a1d-f4ae-431f-ae59-2a19341ad575 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:25.806332 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-abb81a1d-f4ae-431f-ae59-2a19341ad575 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:25.904105 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5f94863f-11ad-4536-9645-6e2db7dcf45a tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd2e319840c4a8aab90b495374aa1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eba4d14f2004498850092bff100b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:25.912888 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5f94863f-11ad-4536-9645-6e2db7dcf45a tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] 10.222.0.13 "GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d" status: 200 len: 1290 microversion: 2.1 time: 0.226717 Oct 30 01:29:25.922381 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1803/3605] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:25 2022] GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d => generated 1290 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:25.985009 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-abb81a1d-f4ae-431f-ae59-2a19341ad575 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:25.996570 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-abb81a1d-f4ae-431f-ae59-2a19341ad575 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009" status: 200 len: 1505 microversion: 2.1 time: 0.221622 Oct 30 01:29:25.998991 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1803/3606] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:25 2022] GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 => generated 1505 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:26.024295 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-67b2695e-176b-4366-9f08-f1c52039ad26 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:26.024909 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-67b2695e-176b-4366-9f08-f1c52039ad26 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 28af596f-f044-4281-8106-4585fbde9a4a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:26.030963 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67b2695e-176b-4366-9f08-f1c52039ad26 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:26.031855 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67b2695e-176b-4366-9f08-f1c52039ad26 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:26.031855 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67b2695e-176b-4366-9f08-f1c52039ad26 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:26.032811 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67b2695e-176b-4366-9f08-f1c52039ad26 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:26.033269 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67b2695e-176b-4366-9f08-f1c52039ad26 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:26.033793 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67b2695e-176b-4366-9f08-f1c52039ad26 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:26.210809 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-67b2695e-176b-4366-9f08-f1c52039ad26 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:26.225877 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-67b2695e-176b-4366-9f08-f1c52039ad26 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a" status: 200 len: 1516 microversion: 2.1 time: 0.205026 Oct 30 01:29:26.241694 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1804/3607] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:26 2022] GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a => generated 1516 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:26.568376 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a3fc8e1a-2b36-4aa4-9efd-b0b9a8c3683d tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44c7307280>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:26.620675 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a3fc8e1a-2b36-4aa4-9efd-b0b9a8c3683d tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/64e7fa8f-dcd0-4b25-a2dc-f68729d10224" status: 200 len: 662 microversion: 2.1 time: 0.055921 Oct 30 01:29:26.629734 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1804/3608] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:29:26 2022] GET /compute/v2.1/images/64e7fa8f-dcd0-4b25-a2dc-f68729d10224 => generated 662 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:29:26.634943 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-dbf86ab9-5694-4eb8-96c5-08b0468a0d67 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44c731d940>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:26.682632 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-dbf86ab9-5694-4eb8-96c5-08b0468a0d67 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/64e7fa8f-dcd0-4b25-a2dc-f68729d10224" status: 200 len: 662 microversion: 2.1 time: 0.051202 Oct 30 01:29:26.691655 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1805/3609] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:29:26 2022] GET /compute/v2.1/images/64e7fa8f-dcd0-4b25-a2dc-f68729d10224 => generated 662 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:29:26.710666 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2f982da9-9b52-43bb-b709-4766128b3767 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:26.711288 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2f982da9-9b52-43bb-b709-4766128b3767 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:26.718249 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f982da9-9b52-43bb-b709-4766128b3767 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:26.718998 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f982da9-9b52-43bb-b709-4766128b3767 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:26.719643 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f982da9-9b52-43bb-b709-4766128b3767 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:26.720567 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f982da9-9b52-43bb-b709-4766128b3767 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:26.721217 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f982da9-9b52-43bb-b709-4766128b3767 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:26.721843 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f982da9-9b52-43bb-b709-4766128b3767 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:26.744354 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0b47cd72-405f-482c-8c01-ca8fa86db791 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:26.744985 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0b47cd72-405f-482c-8c01-ca8fa86db791 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: ea637c0e-df6b-4c7f-a3ee-1b76fec47311] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:26.760765 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b47cd72-405f-482c-8c01-ca8fa86db791 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:26.761274 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b47cd72-405f-482c-8c01-ca8fa86db791 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:26.762269 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b47cd72-405f-482c-8c01-ca8fa86db791 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:26.763013 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b47cd72-405f-482c-8c01-ca8fa86db791 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:26.763473 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b47cd72-405f-482c-8c01-ca8fa86db791 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:26.763903 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b47cd72-405f-482c-8c01-ca8fa86db791 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:27.035567 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2f982da9-9b52-43bb-b709-4766128b3767 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:27.049491 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0b47cd72-405f-482c-8c01-ca8fa86db791 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:27.058054 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0b47cd72-405f-482c-8c01-ca8fa86db791 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311" status: 200 len: 1320 microversion: 2.1 time: 0.317630 Oct 30 01:29:27.063056 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2f982da9-9b52-43bb-b709-4766128b3767 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:27.063510 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1806/3610] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:26 2022] GET /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311 => generated 1320 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:29:27.067078 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2f982da9-9b52-43bb-b709-4766128b3767 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:27.068773 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2f982da9-9b52-43bb-b709-4766128b3767 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1873 microversion: 2.32 time: 0.362301 Oct 30 01:29:27.094644 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1805/3611] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:29:26 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1873 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:29:27.094789 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2571a365-529d-4c20-9e14-ddb695900ac2 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:27.094789 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2571a365-529d-4c20-9e14-ddb695900ac2 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] [instance: 78081c7e-04f6-468e-9a0d-3c74c1092c6d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:27.098678 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9b47afb5-4fe5-481c-b217-252d28242aa7 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:27.101978 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9b47afb5-4fe5-481c-b217-252d28242aa7 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d7cd54fb-1c64-4fb8-a97b-4d5c81a48009] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:27.106499 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2571a365-529d-4c20-9e14-ddb695900ac2 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:27.111451 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2571a365-529d-4c20-9e14-ddb695900ac2 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:27.112040 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2571a365-529d-4c20-9e14-ddb695900ac2 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:27.112896 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2571a365-529d-4c20-9e14-ddb695900ac2 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:27.115115 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2571a365-529d-4c20-9e14-ddb695900ac2 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:27.115658 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2571a365-529d-4c20-9e14-ddb695900ac2 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:27.116190 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9b47afb5-4fe5-481c-b217-252d28242aa7 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:27.117888 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9b47afb5-4fe5-481c-b217-252d28242aa7 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:27.118387 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9b47afb5-4fe5-481c-b217-252d28242aa7 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:27.123328 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9b47afb5-4fe5-481c-b217-252d28242aa7 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:27.124526 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9b47afb5-4fe5-481c-b217-252d28242aa7 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:27.125187 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9b47afb5-4fe5-481c-b217-252d28242aa7 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:27.409100 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2571a365-529d-4c20-9e14-ddb695900ac2 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd2e319840c4a8aab90b495374aa1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eba4d14f2004498850092bff100b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:27.419948 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2571a365-529d-4c20-9e14-ddb695900ac2 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] 10.222.0.13 "GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d" status: 200 len: 1290 microversion: 2.1 time: 0.355276 Oct 30 01:29:27.422015 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1807/3612] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:27 2022] GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d => generated 1290 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:27.433877 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9b47afb5-4fe5-481c-b217-252d28242aa7 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:27.443747 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9b47afb5-4fe5-481c-b217-252d28242aa7 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009" status: 200 len: 1505 microversion: 2.1 time: 0.351168 Oct 30 01:29:27.453432 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1806/3613] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:27 2022] GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 => generated 1505 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:28.085181 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-eea3b64c-3e9a-4257-8788-d3e5bd61d27e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:28.086991 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-eea3b64c-3e9a-4257-8788-d3e5bd61d27e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: ea637c0e-df6b-4c7f-a3ee-1b76fec47311] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:28.100477 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eea3b64c-3e9a-4257-8788-d3e5bd61d27e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:28.101543 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eea3b64c-3e9a-4257-8788-d3e5bd61d27e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:28.102262 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eea3b64c-3e9a-4257-8788-d3e5bd61d27e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:28.103198 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eea3b64c-3e9a-4257-8788-d3e5bd61d27e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:28.103434 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ad6b8c89-f5ea-473a-8878-36d7c28a9e18 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:28.104080 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ad6b8c89-f5ea-473a-8878-36d7c28a9e18 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:28.104922 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eea3b64c-3e9a-4257-8788-d3e5bd61d27e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:28.106421 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eea3b64c-3e9a-4257-8788-d3e5bd61d27e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:28.119123 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ad6b8c89-f5ea-473a-8878-36d7c28a9e18 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:28.119636 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ad6b8c89-f5ea-473a-8878-36d7c28a9e18 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:28.120086 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ad6b8c89-f5ea-473a-8878-36d7c28a9e18 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:28.122900 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ad6b8c89-f5ea-473a-8878-36d7c28a9e18 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:28.123411 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ad6b8c89-f5ea-473a-8878-36d7c28a9e18 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:28.125426 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ad6b8c89-f5ea-473a-8878-36d7c28a9e18 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:28.133848 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:28.420088 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-eea3b64c-3e9a-4257-8788-d3e5bd61d27e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:28.428098 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-eea3b64c-3e9a-4257-8788-d3e5bd61d27e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311" status: 200 len: 1320 microversion: 2.1 time: 0.347427 Oct 30 01:29:28.428954 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1808/3614] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:28 2022] GET /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311 => generated 1320 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:28.461645 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bf12b9d4-405e-4ba9-a3ed-34b387524e70 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:28.462716 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bf12b9d4-405e-4ba9-a3ed-34b387524e70 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] [instance: 78081c7e-04f6-468e-9a0d-3c74c1092c6d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:28.470725 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ad6b8c89-f5ea-473a-8878-36d7c28a9e18 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:28.473569 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bf12b9d4-405e-4ba9-a3ed-34b387524e70 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:28.474342 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bf12b9d4-405e-4ba9-a3ed-34b387524e70 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:28.475040 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bf12b9d4-405e-4ba9-a3ed-34b387524e70 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:28.476136 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bf12b9d4-405e-4ba9-a3ed-34b387524e70 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:28.476811 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bf12b9d4-405e-4ba9-a3ed-34b387524e70 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:28.477665 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bf12b9d4-405e-4ba9-a3ed-34b387524e70 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:28.483224 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ad6b8c89-f5ea-473a-8878-36d7c28a9e18 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:28.484695 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ad6b8c89-f5ea-473a-8878-36d7c28a9e18 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:28.485940 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ad6b8c89-f5ea-473a-8878-36d7c28a9e18 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1873 microversion: 2.32 time: 0.391200 Oct 30 01:29:28.504584 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1807/3615] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:29:28 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1873 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:29:28.521382 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-41a7b05e-b8ea-402c-b375-8ef4dc139034 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:28.525155 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-41a7b05e-b8ea-402c-b375-8ef4dc139034 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d7cd54fb-1c64-4fb8-a97b-4d5c81a48009] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:28.542496 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-41a7b05e-b8ea-402c-b375-8ef4dc139034 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:28.542496 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-41a7b05e-b8ea-402c-b375-8ef4dc139034 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:28.542496 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-41a7b05e-b8ea-402c-b375-8ef4dc139034 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:28.542496 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-41a7b05e-b8ea-402c-b375-8ef4dc139034 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:28.542496 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-41a7b05e-b8ea-402c-b375-8ef4dc139034 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:28.543044 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-41a7b05e-b8ea-402c-b375-8ef4dc139034 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:28.794213 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bf12b9d4-405e-4ba9-a3ed-34b387524e70 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd2e319840c4a8aab90b495374aa1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eba4d14f2004498850092bff100b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:28.802117 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bf12b9d4-405e-4ba9-a3ed-34b387524e70 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] 10.222.0.13 "GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d" status: 200 len: 1290 microversion: 2.1 time: 0.358497 Oct 30 01:29:28.803026 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1809/3616] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:28 2022] GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d => generated 1290 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:29:28.807599 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b52df1b3-a187-486a-9f29-a31b233a1918 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44c72cde50>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:28.847009 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-41a7b05e-b8ea-402c-b375-8ef4dc139034 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:28.859559 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-41a7b05e-b8ea-402c-b375-8ef4dc139034 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009" status: 200 len: 1505 microversion: 2.1 time: 0.353305 Oct 30 01:29:28.861550 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1808/3617] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:28 2022] GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 => generated 1505 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:28.923131 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b52df1b3-a187-486a-9f29-a31b233a1918 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/8bc93c69-a84f-4e09-ae04-7dc6be567aa6" status: 200 len: 662 microversion: 2.1 time: 0.118774 Oct 30 01:29:28.923978 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1810/3618] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:29:28 2022] GET /compute/v2.1/images/8bc93c69-a84f-4e09-ae04-7dc6be567aa6 => generated 662 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:29:28.941044 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-060f9fc5-5ee7-4c5b-a3ba-fe451ba17eb6 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44c7319280>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:28.990837 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-060f9fc5-5ee7-4c5b-a3ba-fe451ba17eb6 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/8bc93c69-a84f-4e09-ae04-7dc6be567aa6" status: 200 len: 662 microversion: 2.1 time: 0.054351 Oct 30 01:29:28.991463 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1809/3619] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:29:28 2022] GET /compute/v2.1/images/8bc93c69-a84f-4e09-ae04-7dc6be567aa6 => generated 662 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:29:29.064590 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cd9c8a78-ae44-4a44-a999-50851754c8d8 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-386959598", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:29:29.135149 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-cd9c8a78-ae44-4a44-a999-50851754c8d8 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] validate_networks() for None {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:29:29.346492 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:29.351196 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a5308d60-0abe-4dc1-b12a-a26156a58cb2 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:29:29.353990 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a5308d60-0abe-4dc1-b12a-a26156a58cb2 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 28af596f-f044-4281-8106-4585fbde9a4a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:29.361944 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a5308d60-0abe-4dc1-b12a-a26156a58cb2 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:29.362734 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a5308d60-0abe-4dc1-b12a-a26156a58cb2 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:29.363520 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a5308d60-0abe-4dc1-b12a-a26156a58cb2 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:29.364448 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a5308d60-0abe-4dc1-b12a-a26156a58cb2 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:29.365117 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a5308d60-0abe-4dc1-b12a-a26156a58cb2 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:29.365810 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a5308d60-0abe-4dc1-b12a-a26156a58cb2 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:29.393933 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-a5308d60-0abe-4dc1-b12a-a26156a58cb2 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lazy-loading 'flavor' on Instance uuid 28af596f-f044-4281-8106-4585fbde9a4a {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:29:29.514533 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-cd9c8a78-ae44-4a44-a999-50851754c8d8 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:29:29.515042 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-cd9c8a78-ae44-4a44-a999-50851754c8d8 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:29:29.515604 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-cd9c8a78-ae44-4a44-a999-50851754c8d8 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:29:29.516087 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-cd9c8a78-ae44-4a44-a999-50851754c8d8 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:29:29.517013 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-cd9c8a78-ae44-4a44-a999-50851754c8d8 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:29:29.528965 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cd9c8a78-ae44-4a44-a999-50851754c8d8 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:29.529586 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cd9c8a78-ae44-4a44-a999-50851754c8d8 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:29.535415 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cd9c8a78-ae44-4a44-a999-50851754c8d8 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:29.535415 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cd9c8a78-ae44-4a44-a999-50851754c8d8 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:29.535415 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cd9c8a78-ae44-4a44-a999-50851754c8d8 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:29.535415 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cd9c8a78-ae44-4a44-a999-50851754c8d8 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:29.559621 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-cd9c8a78-ae44-4a44-a999-50851754c8d8 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Getting quotas for project d1fcce1fadf54d089ec4fd751a3cf6ae. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:29:29.565834 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:29.576438 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-cd9c8a78-ae44-4a44-a999-50851754c8d8 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Getting quotas for user fea8a24166674250a98268ae52604f12 and project d1fcce1fadf54d089ec4fd751a3cf6ae. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:29:29.586826 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:29.591700 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cd9c8a78-ae44-4a44-a999-50851754c8d8 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:29:29.594872 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cd9c8a78-ae44-4a44-a999-50851754c8d8 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] [instance: e9368bd4-9715-46b3-91bb-cb436f7120f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:29:29.767982 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cd9c8a78-ae44-4a44-a999-50851754c8d8 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.707262 Oct 30 01:29:29.768992 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1811/3620] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:29:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:29:29.786986 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-3ec5363c-50da-4cd2-89fa-6c51f9575740 req-38c725fc-ef50-43cd-bc54-0a8278856167 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea637c0e-df6b-4c7f-a3ee-1b76fec47311", "tag": "71e2929f-b3fa-4fe5-92a5-faa55fb3fe8e"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:29:29.803662 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a5308d60-0abe-4dc1-b12a-a26156a58cb2 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "POST /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a/action" status: 200 len: 32 microversion: 2.1 time: 0.457013 Oct 30 01:29:29.806248 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1810/3621] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:29:29 2022] POST /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a/action => generated 32 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 30 01:29:29.822653 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-3ec5363c-50da-4cd2-89fa-6c51f9575740 req-38c725fc-ef50-43cd-bc54-0a8278856167 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:29.824107 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-3ec5363c-50da-4cd2-89fa-6c51f9575740 req-38c725fc-ef50-43cd-bc54-0a8278856167 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:29.824415 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-02217151-ae90-428c-beca-260ecbb40035 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:29.825754 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-02217151-ae90-428c-beca-260ecbb40035 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: ea637c0e-df6b-4c7f-a3ee-1b76fec47311] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:29.827226 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-3ec5363c-50da-4cd2-89fa-6c51f9575740 req-38c725fc-ef50-43cd-bc54-0a8278856167 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:29.838518 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-02217151-ae90-428c-beca-260ecbb40035 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:29.840159 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-02217151-ae90-428c-beca-260ecbb40035 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:29.840953 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-02217151-ae90-428c-beca-260ecbb40035 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:29.842016 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-02217151-ae90-428c-beca-260ecbb40035 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:29.842667 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-02217151-ae90-428c-beca-260ecbb40035 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:29.843656 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-02217151-ae90-428c-beca-260ecbb40035 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:29.855601 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-3ec5363c-50da-4cd2-89fa-6c51f9575740 req-38c725fc-ef50-43cd-bc54-0a8278856167 service nova] Creating event network-changed:71e2929f-b3fa-4fe5-92a5-faa55fb3fe8e for instance ea637c0e-df6b-4c7f-a3ee-1b76fec47311 on n-h2-master-1 Oct 30 01:29:29.861107 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-3ec5363c-50da-4cd2-89fa-6c51f9575740 req-38c725fc-ef50-43cd-bc54-0a8278856167 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090599 Oct 30 01:29:29.862113 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1812/3622] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:29:29.867737 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-21f98bd8-7cc1-4a2f-9b15-fef0802441a7 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:29.868439 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-21f98bd8-7cc1-4a2f-9b15-fef0802441a7 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:29.876038 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-21f98bd8-7cc1-4a2f-9b15-fef0802441a7 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:29.877365 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-21f98bd8-7cc1-4a2f-9b15-fef0802441a7 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:29.883456 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-21f98bd8-7cc1-4a2f-9b15-fef0802441a7 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:29.883456 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-21f98bd8-7cc1-4a2f-9b15-fef0802441a7 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:29.883456 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-21f98bd8-7cc1-4a2f-9b15-fef0802441a7 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:29.883456 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-21f98bd8-7cc1-4a2f-9b15-fef0802441a7 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:30.228598 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-02217151-ae90-428c-beca-260ecbb40035 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:30.247075 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-02217151-ae90-428c-beca-260ecbb40035 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311" status: 200 len: 1320 microversion: 2.1 time: 0.439273 Oct 30 01:29:30.248168 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1811/3623] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:29 2022] GET /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311 => generated 1320 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:30.254020 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4e0dc06b-b7cb-4a8d-82b5-1303826f0a94 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:30.255123 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4e0dc06b-b7cb-4a8d-82b5-1303826f0a94 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 28af596f-f044-4281-8106-4585fbde9a4a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:30.263029 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-21f98bd8-7cc1-4a2f-9b15-fef0802441a7 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:30.277820 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4e0dc06b-b7cb-4a8d-82b5-1303826f0a94 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:30.278745 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4e0dc06b-b7cb-4a8d-82b5-1303826f0a94 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:30.279533 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4e0dc06b-b7cb-4a8d-82b5-1303826f0a94 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:30.280638 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-21f98bd8-7cc1-4a2f-9b15-fef0802441a7 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:30.282203 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4e0dc06b-b7cb-4a8d-82b5-1303826f0a94 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:30.284577 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4e0dc06b-b7cb-4a8d-82b5-1303826f0a94 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:30.285305 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4e0dc06b-b7cb-4a8d-82b5-1303826f0a94 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:30.286766 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-21f98bd8-7cc1-4a2f-9b15-fef0802441a7 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:30.291862 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-21f98bd8-7cc1-4a2f-9b15-fef0802441a7 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1873 microversion: 2.32 time: 0.427973 Oct 30 01:29:30.292920 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1813/3624] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:29:29 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1873 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:29:30.301773 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2b068b7c-d7d1-40aa-898c-7bb74478484e tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:30.324084 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2b068b7c-d7d1-40aa-898c-7bb74478484e tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] [instance: 78081c7e-04f6-468e-9a0d-3c74c1092c6d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:30.334248 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2b068b7c-d7d1-40aa-898c-7bb74478484e tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:30.336443 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2b068b7c-d7d1-40aa-898c-7bb74478484e tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:30.338373 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2b068b7c-d7d1-40aa-898c-7bb74478484e tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:30.339864 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2b068b7c-d7d1-40aa-898c-7bb74478484e tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:30.340568 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2b068b7c-d7d1-40aa-898c-7bb74478484e tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:30.341479 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2b068b7c-d7d1-40aa-898c-7bb74478484e tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:30.530197 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4e0dc06b-b7cb-4a8d-82b5-1303826f0a94 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:30.540005 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4e0dc06b-b7cb-4a8d-82b5-1303826f0a94 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a" status: 200 len: 1522 microversion: 2.1 time: 0.290339 Oct 30 01:29:30.540974 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1812/3625] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:30 2022] GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:30.546714 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6feef7d1-2a20-457c-9cf4-23589e3990a1 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1284749440", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:29:30.567679 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2b068b7c-d7d1-40aa-898c-7bb74478484e tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd2e319840c4a8aab90b495374aa1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eba4d14f2004498850092bff100b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:30.579435 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2b068b7c-d7d1-40aa-898c-7bb74478484e tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] 10.222.0.13 "GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d" status: 200 len: 1290 microversion: 2.1 time: 0.284333 Oct 30 01:29:30.589444 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1814/3626] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:30 2022] GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d => generated 1290 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:30.589444 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-246f3785-2e6e-4ac0-ba9f-7fb63e6dbb24 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:30.589444 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-246f3785-2e6e-4ac0-ba9f-7fb63e6dbb24 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d7cd54fb-1c64-4fb8-a97b-4d5c81a48009] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:30.592688 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-246f3785-2e6e-4ac0-ba9f-7fb63e6dbb24 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:30.593405 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-246f3785-2e6e-4ac0-ba9f-7fb63e6dbb24 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:30.593941 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-246f3785-2e6e-4ac0-ba9f-7fb63e6dbb24 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:30.594651 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-246f3785-2e6e-4ac0-ba9f-7fb63e6dbb24 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:30.595108 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-246f3785-2e6e-4ac0-ba9f-7fb63e6dbb24 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:30.595560 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-246f3785-2e6e-4ac0-ba9f-7fb63e6dbb24 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:30.610903 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-6feef7d1-2a20-457c-9cf4-23589e3990a1 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] validate_networks() for None {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:29:30.849140 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-246f3785-2e6e-4ac0-ba9f-7fb63e6dbb24 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:30.859377 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-246f3785-2e6e-4ac0-ba9f-7fb63e6dbb24 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009" status: 200 len: 1505 microversion: 2.1 time: 0.277820 Oct 30 01:29:30.860216 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1815/3627] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:30 2022] GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 => generated 1505 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:30.913267 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-6feef7d1-2a20-457c-9cf4-23589e3990a1 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:29:30.913729 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-6feef7d1-2a20-457c-9cf4-23589e3990a1 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:29:30.914228 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-6feef7d1-2a20-457c-9cf4-23589e3990a1 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:29:30.914642 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-6feef7d1-2a20-457c-9cf4-23589e3990a1 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:29:30.915062 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-6feef7d1-2a20-457c-9cf4-23589e3990a1 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:29:30.926323 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6feef7d1-2a20-457c-9cf4-23589e3990a1 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:30.931357 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6feef7d1-2a20-457c-9cf4-23589e3990a1 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:30.931357 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6feef7d1-2a20-457c-9cf4-23589e3990a1 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:30.931357 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6feef7d1-2a20-457c-9cf4-23589e3990a1 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:30.931357 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6feef7d1-2a20-457c-9cf4-23589e3990a1 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:30.931357 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6feef7d1-2a20-457c-9cf4-23589e3990a1 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:30.946279 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-6feef7d1-2a20-457c-9cf4-23589e3990a1 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Getting quotas for project d1fcce1fadf54d089ec4fd751a3cf6ae. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:29:30.951718 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-6feef7d1-2a20-457c-9cf4-23589e3990a1 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Getting quotas for user fea8a24166674250a98268ae52604f12 and project d1fcce1fadf54d089ec4fd751a3cf6ae. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:29:30.965058 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6feef7d1-2a20-457c-9cf4-23589e3990a1 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:29:30.967405 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6feef7d1-2a20-457c-9cf4-23589e3990a1 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] [instance: 99db82dd-3238-4af1-9f90-1dd69cdd836a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:29:31.147165 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6feef7d1-2a20-457c-9cf4-23589e3990a1 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.604879 Oct 30 01:29:31.147926 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1813/3628] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:29:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:29:31.159478 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-31eea7f9-9f84-4820-abd9-f02ce2a94b82 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:31.160090 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-31eea7f9-9f84-4820-abd9-f02ce2a94b82 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] [instance: 99db82dd-3238-4af1-9f90-1dd69cdd836a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:31.224548 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-31eea7f9-9f84-4820-abd9-f02ce2a94b82 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea8a24166674250a98268ae52604f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcce1fadf54d089ec4fd751a3cf6ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:31.233593 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-31eea7f9-9f84-4820-abd9-f02ce2a94b82 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/servers/99db82dd-3238-4af1-9f90-1dd69cdd836a" status: 200 len: 1218 microversion: 2.1 time: 0.077450 Oct 30 01:29:31.234482 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1816/3629] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:31 2022] GET /compute/v2.1/servers/99db82dd-3238-4af1-9f90-1dd69cdd836a => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:31.280155 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-01b3eb1f-b3a6-4566-a186-89539cd7028c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:31.280155 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-01b3eb1f-b3a6-4566-a186-89539cd7028c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: ea637c0e-df6b-4c7f-a3ee-1b76fec47311] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:31.281628 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-01b3eb1f-b3a6-4566-a186-89539cd7028c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:31.282138 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-01b3eb1f-b3a6-4566-a186-89539cd7028c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:31.282579 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-01b3eb1f-b3a6-4566-a186-89539cd7028c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:31.283293 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-01b3eb1f-b3a6-4566-a186-89539cd7028c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:31.283780 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-01b3eb1f-b3a6-4566-a186-89539cd7028c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:31.284598 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-01b3eb1f-b3a6-4566-a186-89539cd7028c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:31.319790 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ea445ed9-e3ee-467a-8287-28a13acb7c74 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:31.320924 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ea445ed9-e3ee-467a-8287-28a13acb7c74 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:31.331918 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea445ed9-e3ee-467a-8287-28a13acb7c74 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:31.332358 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea445ed9-e3ee-467a-8287-28a13acb7c74 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:31.332795 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea445ed9-e3ee-467a-8287-28a13acb7c74 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:31.333680 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea445ed9-e3ee-467a-8287-28a13acb7c74 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:31.334088 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea445ed9-e3ee-467a-8287-28a13acb7c74 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:31.340306 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea445ed9-e3ee-467a-8287-28a13acb7c74 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:31.632128 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-01b3eb1f-b3a6-4566-a186-89539cd7028c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:31.655074 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-01b3eb1f-b3a6-4566-a186-89539cd7028c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311" status: 200 len: 1320 microversion: 2.1 time: 0.386518 Oct 30 01:29:31.669531 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1814/3630] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:31 2022] GET /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311 => generated 1320 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:31.671565 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b46da6ba-806f-4624-bb58-bb15ce8ec9a0 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:31.672201 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b46da6ba-806f-4624-bb58-bb15ce8ec9a0 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 28af596f-f044-4281-8106-4585fbde9a4a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:31.686338 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b46da6ba-806f-4624-bb58-bb15ce8ec9a0 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:31.686825 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b46da6ba-806f-4624-bb58-bb15ce8ec9a0 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:31.687260 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b46da6ba-806f-4624-bb58-bb15ce8ec9a0 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:31.688336 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b46da6ba-806f-4624-bb58-bb15ce8ec9a0 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:31.688814 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b46da6ba-806f-4624-bb58-bb15ce8ec9a0 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:31.689298 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b46da6ba-806f-4624-bb58-bb15ce8ec9a0 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:31.746892 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ea445ed9-e3ee-467a-8287-28a13acb7c74 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:31.775931 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ea445ed9-e3ee-467a-8287-28a13acb7c74 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:31.777893 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ea445ed9-e3ee-467a-8287-28a13acb7c74 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:31.784368 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ea445ed9-e3ee-467a-8287-28a13acb7c74 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1873 microversion: 2.32 time: 0.468367 Oct 30 01:29:31.786187 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1817/3631] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:29:31 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1873 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:29:31.804529 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-12a00637-0e77-4742-b74b-1c9bda5d366a tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:31.808482 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-12a00637-0e77-4742-b74b-1c9bda5d366a tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] [instance: 78081c7e-04f6-468e-9a0d-3c74c1092c6d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:31.822377 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-12a00637-0e77-4742-b74b-1c9bda5d366a tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:31.824000 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-12a00637-0e77-4742-b74b-1c9bda5d366a tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:31.824646 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-12a00637-0e77-4742-b74b-1c9bda5d366a tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:31.825751 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-12a00637-0e77-4742-b74b-1c9bda5d366a tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:31.826377 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-12a00637-0e77-4742-b74b-1c9bda5d366a tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:31.827286 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-12a00637-0e77-4742-b74b-1c9bda5d366a tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:32.114065 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b46da6ba-806f-4624-bb58-bb15ce8ec9a0 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:32.127883 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b46da6ba-806f-4624-bb58-bb15ce8ec9a0 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a" status: 200 len: 1522 microversion: 2.1 time: 0.469125 Oct 30 01:29:32.141430 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1815/3632] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:31 2022] GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a => generated 1522 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:32.141430 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-925e8569-db02-43c7-b089-c0062ec57dd4 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:32.141430 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-925e8569-db02-43c7-b089-c0062ec57dd4 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d7cd54fb-1c64-4fb8-a97b-4d5c81a48009] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:32.149509 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-925e8569-db02-43c7-b089-c0062ec57dd4 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:32.150634 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-925e8569-db02-43c7-b089-c0062ec57dd4 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:32.151111 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-925e8569-db02-43c7-b089-c0062ec57dd4 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:32.151860 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-925e8569-db02-43c7-b089-c0062ec57dd4 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:32.152363 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-925e8569-db02-43c7-b089-c0062ec57dd4 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:32.152790 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-925e8569-db02-43c7-b089-c0062ec57dd4 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:32.332353 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-12a00637-0e77-4742-b74b-1c9bda5d366a tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd2e319840c4a8aab90b495374aa1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eba4d14f2004498850092bff100b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:32.348192 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-12a00637-0e77-4742-b74b-1c9bda5d366a tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] 10.222.0.13 "GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d" status: 200 len: 1290 microversion: 2.1 time: 0.558215 Oct 30 01:29:32.350694 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1818/3633] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:31 2022] GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d => generated 1290 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:32.358491 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5d3a05e7-5680-4212-96f0-5488baf9c4f8 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:32.359645 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5d3a05e7-5680-4212-96f0-5488baf9c4f8 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] [instance: 99db82dd-3238-4af1-9f90-1dd69cdd836a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:32.447416 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-925e8569-db02-43c7-b089-c0062ec57dd4 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:32.459150 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-925e8569-db02-43c7-b089-c0062ec57dd4 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009" status: 200 len: 1505 microversion: 2.1 time: 0.326213 Oct 30 01:29:32.460047 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1816/3634] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:32 2022] GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 => generated 1505 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:32.484135 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5d3a05e7-5680-4212-96f0-5488baf9c4f8 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea8a24166674250a98268ae52604f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcce1fadf54d089ec4fd751a3cf6ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:32.502612 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5d3a05e7-5680-4212-96f0-5488baf9c4f8 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/servers/99db82dd-3238-4af1-9f90-1dd69cdd836a" status: 200 len: 1218 microversion: 2.1 time: 0.150289 Oct 30 01:29:32.509431 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1819/3635] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:32 2022] GET /compute/v2.1/servers/99db82dd-3238-4af1-9f90-1dd69cdd836a => generated 1218 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:32.680598 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a16967f2-3190-4196-ab4a-8a843543c1b3 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:32.681220 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a16967f2-3190-4196-ab4a-8a843543c1b3 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: ea637c0e-df6b-4c7f-a3ee-1b76fec47311] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:32.687514 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a16967f2-3190-4196-ab4a-8a843543c1b3 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:32.688336 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a16967f2-3190-4196-ab4a-8a843543c1b3 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:32.689019 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a16967f2-3190-4196-ab4a-8a843543c1b3 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:32.689987 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a16967f2-3190-4196-ab4a-8a843543c1b3 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:32.690674 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a16967f2-3190-4196-ab4a-8a843543c1b3 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:32.691331 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a16967f2-3190-4196-ab4a-8a843543c1b3 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:32.812409 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-08cbb156-0283-41d9-a119-e6003e1f3079 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:32.813483 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-08cbb156-0283-41d9-a119-e6003e1f3079 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:32.819969 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08cbb156-0283-41d9-a119-e6003e1f3079 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:32.820864 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08cbb156-0283-41d9-a119-e6003e1f3079 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:32.821621 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08cbb156-0283-41d9-a119-e6003e1f3079 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:32.823153 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08cbb156-0283-41d9-a119-e6003e1f3079 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:32.823887 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08cbb156-0283-41d9-a119-e6003e1f3079 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:32.824553 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08cbb156-0283-41d9-a119-e6003e1f3079 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:33.387762 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a16967f2-3190-4196-ab4a-8a843543c1b3 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:33.402128 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a16967f2-3190-4196-ab4a-8a843543c1b3 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311" status: 200 len: 1320 microversion: 2.1 time: 0.725127 Oct 30 01:29:33.402790 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1817/3636] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:32 2022] GET /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311 => generated 1320 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:33.414807 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9cc169b5-3c8c-4b5a-bffe-c5a878fe9a29 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:33.416375 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9cc169b5-3c8c-4b5a-bffe-c5a878fe9a29 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 28af596f-f044-4281-8106-4585fbde9a4a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:33.430166 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9cc169b5-3c8c-4b5a-bffe-c5a878fe9a29 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:33.431095 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9cc169b5-3c8c-4b5a-bffe-c5a878fe9a29 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:33.432166 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9cc169b5-3c8c-4b5a-bffe-c5a878fe9a29 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:33.433158 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9cc169b5-3c8c-4b5a-bffe-c5a878fe9a29 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:33.433845 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9cc169b5-3c8c-4b5a-bffe-c5a878fe9a29 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:33.434680 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9cc169b5-3c8c-4b5a-bffe-c5a878fe9a29 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:33.519562 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-08cbb156-0283-41d9-a119-e6003e1f3079 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:33.547002 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-08cbb156-0283-41d9-a119-e6003e1f3079 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:33.549008 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-08cbb156-0283-41d9-a119-e6003e1f3079 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:33.550534 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-08cbb156-0283-41d9-a119-e6003e1f3079 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1873 microversion: 2.32 time: 0.742244 Oct 30 01:29:33.551340 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1820/3637] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:29:32 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1873 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:29:33.556397 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0d6e37e9-e6e2-441b-9d34-8f1d514450e1 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:33.557843 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0d6e37e9-e6e2-441b-9d34-8f1d514450e1 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] [instance: 78081c7e-04f6-468e-9a0d-3c74c1092c6d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:33.564800 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0d6e37e9-e6e2-441b-9d34-8f1d514450e1 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:33.565887 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0d6e37e9-e6e2-441b-9d34-8f1d514450e1 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:33.566636 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0d6e37e9-e6e2-441b-9d34-8f1d514450e1 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:33.567838 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0d6e37e9-e6e2-441b-9d34-8f1d514450e1 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:33.568551 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0d6e37e9-e6e2-441b-9d34-8f1d514450e1 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:33.569358 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0d6e37e9-e6e2-441b-9d34-8f1d514450e1 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:33.747214 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9cc169b5-3c8c-4b5a-bffe-c5a878fe9a29 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:33.768645 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9cc169b5-3c8c-4b5a-bffe-c5a878fe9a29 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a" status: 200 len: 1522 microversion: 2.1 time: 0.364768 Oct 30 01:29:33.769765 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1818/3638] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:33 2022] GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a => generated 1522 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:33.776138 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8ff72ec9-0c0f-405d-ab6d-e6d1aa6b6a33 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:33.777360 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8ff72ec9-0c0f-405d-ab6d-e6d1aa6b6a33 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d7cd54fb-1c64-4fb8-a97b-4d5c81a48009] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:33.786768 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ff72ec9-0c0f-405d-ab6d-e6d1aa6b6a33 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:33.787619 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ff72ec9-0c0f-405d-ab6d-e6d1aa6b6a33 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:33.788351 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ff72ec9-0c0f-405d-ab6d-e6d1aa6b6a33 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:33.791784 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ff72ec9-0c0f-405d-ab6d-e6d1aa6b6a33 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:33.792544 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ff72ec9-0c0f-405d-ab6d-e6d1aa6b6a33 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:33.792978 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ff72ec9-0c0f-405d-ab6d-e6d1aa6b6a33 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:33.815504 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0d6e37e9-e6e2-441b-9d34-8f1d514450e1 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd2e319840c4a8aab90b495374aa1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eba4d14f2004498850092bff100b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:33.824278 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0d6e37e9-e6e2-441b-9d34-8f1d514450e1 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] 10.222.0.13 "GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d" status: 200 len: 1290 microversion: 2.1 time: 0.271539 Oct 30 01:29:33.836610 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1821/3639] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:33 2022] GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d => generated 1290 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:33.841717 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-211f2668-34c2-4b94-9213-159bc807e317 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:33.842319 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-211f2668-34c2-4b94-9213-159bc807e317 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] [instance: 99db82dd-3238-4af1-9f90-1dd69cdd836a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:33.852873 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-211f2668-34c2-4b94-9213-159bc807e317 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:33.854139 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-211f2668-34c2-4b94-9213-159bc807e317 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:33.855698 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-211f2668-34c2-4b94-9213-159bc807e317 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:33.856667 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-211f2668-34c2-4b94-9213-159bc807e317 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:33.862148 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-211f2668-34c2-4b94-9213-159bc807e317 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:33.863066 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-211f2668-34c2-4b94-9213-159bc807e317 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:33.984915 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8ff72ec9-0c0f-405d-ab6d-e6d1aa6b6a33 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:33.997978 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8ff72ec9-0c0f-405d-ab6d-e6d1aa6b6a33 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009" status: 200 len: 1505 microversion: 2.1 time: 0.225362 Oct 30 01:29:33.999115 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1819/3640] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:33 2022] GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 => generated 1505 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:34.218452 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-211f2668-34c2-4b94-9213-159bc807e317 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea8a24166674250a98268ae52604f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcce1fadf54d089ec4fd751a3cf6ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:34.226293 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-211f2668-34c2-4b94-9213-159bc807e317 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/servers/99db82dd-3238-4af1-9f90-1dd69cdd836a" status: 200 len: 1270 microversion: 2.1 time: 0.388601 Oct 30 01:29:34.226858 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1822/3641] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:33 2022] GET /compute/v2.1/servers/99db82dd-3238-4af1-9f90-1dd69cdd836a => generated 1270 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:34.431846 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4abf8c61-721f-4c32-8f70-351930c4d0bd tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:34.432471 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4abf8c61-721f-4c32-8f70-351930c4d0bd tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: ea637c0e-df6b-4c7f-a3ee-1b76fec47311] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:34.441259 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4abf8c61-721f-4c32-8f70-351930c4d0bd tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:34.441788 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4abf8c61-721f-4c32-8f70-351930c4d0bd tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:34.442229 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4abf8c61-721f-4c32-8f70-351930c4d0bd tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:34.442939 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4abf8c61-721f-4c32-8f70-351930c4d0bd tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:34.443397 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4abf8c61-721f-4c32-8f70-351930c4d0bd tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:34.443815 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4abf8c61-721f-4c32-8f70-351930c4d0bd tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:34.579360 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5dda6b81-85fc-4e00-8332-d413840e0f46 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:34.579986 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5dda6b81-85fc-4e00-8332-d413840e0f46 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:34.586159 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5dda6b81-85fc-4e00-8332-d413840e0f46 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:34.586651 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5dda6b81-85fc-4e00-8332-d413840e0f46 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:34.587138 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5dda6b81-85fc-4e00-8332-d413840e0f46 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:34.588399 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5dda6b81-85fc-4e00-8332-d413840e0f46 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:34.588857 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5dda6b81-85fc-4e00-8332-d413840e0f46 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:34.589283 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5dda6b81-85fc-4e00-8332-d413840e0f46 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:34.594985 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4abf8c61-721f-4c32-8f70-351930c4d0bd tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:34.606376 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4abf8c61-721f-4c32-8f70-351930c4d0bd tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311" status: 200 len: 1320 microversion: 2.1 time: 0.178825 Oct 30 01:29:34.609452 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1820/3642] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:34 2022] GET /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311 => generated 1320 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:34.798829 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0743c0b2-a7c4-49ae-8d6e-c2b1141539ba tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:34.799533 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0743c0b2-a7c4-49ae-8d6e-c2b1141539ba tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 28af596f-f044-4281-8106-4585fbde9a4a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:34.807507 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0743c0b2-a7c4-49ae-8d6e-c2b1141539ba tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:34.808582 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0743c0b2-a7c4-49ae-8d6e-c2b1141539ba tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:34.809231 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0743c0b2-a7c4-49ae-8d6e-c2b1141539ba tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:34.810267 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0743c0b2-a7c4-49ae-8d6e-c2b1141539ba tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:34.812536 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0743c0b2-a7c4-49ae-8d6e-c2b1141539ba tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:34.813241 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0743c0b2-a7c4-49ae-8d6e-c2b1141539ba tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:34.873188 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5dda6b81-85fc-4e00-8332-d413840e0f46 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:34.892549 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5dda6b81-85fc-4e00-8332-d413840e0f46 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:34.894248 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5dda6b81-85fc-4e00-8332-d413840e0f46 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:34.895853 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5dda6b81-85fc-4e00-8332-d413840e0f46 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1873 microversion: 2.32 time: 0.320444 Oct 30 01:29:34.902153 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1823/3643] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:29:34 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1873 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:29:34.908408 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-76e58c20-1224-4b74-9a10-6f98e7ee3d96 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:34.909266 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-76e58c20-1224-4b74-9a10-6f98e7ee3d96 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] [instance: 78081c7e-04f6-468e-9a0d-3c74c1092c6d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:34.916276 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-76e58c20-1224-4b74-9a10-6f98e7ee3d96 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:34.917158 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-76e58c20-1224-4b74-9a10-6f98e7ee3d96 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:34.922508 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-76e58c20-1224-4b74-9a10-6f98e7ee3d96 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:34.922508 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-76e58c20-1224-4b74-9a10-6f98e7ee3d96 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:34.922508 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-76e58c20-1224-4b74-9a10-6f98e7ee3d96 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:34.922508 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-76e58c20-1224-4b74-9a10-6f98e7ee3d96 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:35.197365 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0743c0b2-a7c4-49ae-8d6e-c2b1141539ba tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:35.212516 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0743c0b2-a7c4-49ae-8d6e-c2b1141539ba tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a" status: 200 len: 1522 microversion: 2.1 time: 0.419892 Oct 30 01:29:35.214186 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1821/3644] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:34 2022] GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a => generated 1522 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:35.214459 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-76e58c20-1224-4b74-9a10-6f98e7ee3d96 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd2e319840c4a8aab90b495374aa1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eba4d14f2004498850092bff100b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:35.220470 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-df158bef-9f3b-4168-9cc0-668012aedaeb tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:35.221670 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-df158bef-9f3b-4168-9cc0-668012aedaeb tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d7cd54fb-1c64-4fb8-a97b-4d5c81a48009] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:35.229698 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-76e58c20-1224-4b74-9a10-6f98e7ee3d96 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] 10.222.0.13 "GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d" status: 200 len: 1290 microversion: 2.1 time: 0.325955 Oct 30 01:29:35.249557 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1824/3645] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:34 2022] GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d => generated 1290 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:35.249746 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df158bef-9f3b-4168-9cc0-668012aedaeb tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:35.249746 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df158bef-9f3b-4168-9cc0-668012aedaeb tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:35.249746 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df158bef-9f3b-4168-9cc0-668012aedaeb tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:35.249746 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df158bef-9f3b-4168-9cc0-668012aedaeb tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:35.249746 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df158bef-9f3b-4168-9cc0-668012aedaeb tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:35.250761 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d81c460f-ec88-4a94-8ec8-fe82525f513a tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:35.251625 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d81c460f-ec88-4a94-8ec8-fe82525f513a tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] [instance: 99db82dd-3238-4af1-9f90-1dd69cdd836a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:35.254084 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df158bef-9f3b-4168-9cc0-668012aedaeb tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:35.270377 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d81c460f-ec88-4a94-8ec8-fe82525f513a tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:35.273874 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d81c460f-ec88-4a94-8ec8-fe82525f513a tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:35.274611 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d81c460f-ec88-4a94-8ec8-fe82525f513a tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:35.275596 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d81c460f-ec88-4a94-8ec8-fe82525f513a tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:35.278433 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d81c460f-ec88-4a94-8ec8-fe82525f513a tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:35.281246 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d81c460f-ec88-4a94-8ec8-fe82525f513a tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:35.386314 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d81c460f-ec88-4a94-8ec8-fe82525f513a tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea8a24166674250a98268ae52604f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcce1fadf54d089ec4fd751a3cf6ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:35.396419 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d81c460f-ec88-4a94-8ec8-fe82525f513a tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/servers/99db82dd-3238-4af1-9f90-1dd69cdd836a" status: 200 len: 1276 microversion: 2.1 time: 0.149774 Oct 30 01:29:35.397318 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1825/3646] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:35 2022] GET /compute/v2.1/servers/99db82dd-3238-4af1-9f90-1dd69cdd836a => generated 1276 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:35.508372 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-df158bef-9f3b-4168-9cc0-668012aedaeb tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:35.525385 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-df158bef-9f3b-4168-9cc0-668012aedaeb tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009" status: 200 len: 1505 microversion: 2.1 time: 0.308899 Oct 30 01:29:35.526080 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1822/3647] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:35 2022] GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 => generated 1505 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:35.631431 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4c4e8c5c-953b-4922-842a-2d217f57bbe6 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:35.632934 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4c4e8c5c-953b-4922-842a-2d217f57bbe6 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: ea637c0e-df6b-4c7f-a3ee-1b76fec47311] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:35.642982 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4c4e8c5c-953b-4922-842a-2d217f57bbe6 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:35.645027 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4c4e8c5c-953b-4922-842a-2d217f57bbe6 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:35.645766 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4c4e8c5c-953b-4922-842a-2d217f57bbe6 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:35.646509 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4c4e8c5c-953b-4922-842a-2d217f57bbe6 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:35.647074 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4c4e8c5c-953b-4922-842a-2d217f57bbe6 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:35.647505 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4c4e8c5c-953b-4922-842a-2d217f57bbe6 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:35.878120 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4c4e8c5c-953b-4922-842a-2d217f57bbe6 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:35.895739 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4c4e8c5c-953b-4922-842a-2d217f57bbe6 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311" status: 200 len: 1320 microversion: 2.1 time: 0.269228 Oct 30 01:29:35.910176 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1826/3648] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:35 2022] GET /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311 => generated 1320 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:35.933096 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-01756d89-fd27-42e2-90a3-f87d57dff635 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:35.937827 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-01756d89-fd27-42e2-90a3-f87d57dff635 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:35.944886 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-01756d89-fd27-42e2-90a3-f87d57dff635 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:35.945517 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-01756d89-fd27-42e2-90a3-f87d57dff635 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:35.946047 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-01756d89-fd27-42e2-90a3-f87d57dff635 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:35.946905 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-01756d89-fd27-42e2-90a3-f87d57dff635 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:35.947424 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-01756d89-fd27-42e2-90a3-f87d57dff635 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:35.948243 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-01756d89-fd27-42e2-90a3-f87d57dff635 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:36.265136 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-16c81134-ae79-466a-8756-ba8acbc1f4ef tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:36.270864 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-16c81134-ae79-466a-8756-ba8acbc1f4ef tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] [instance: 78081c7e-04f6-468e-9a0d-3c74c1092c6d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:36.277556 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-16c81134-ae79-466a-8756-ba8acbc1f4ef tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:36.281093 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-16c81134-ae79-466a-8756-ba8acbc1f4ef tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:36.281971 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-16c81134-ae79-466a-8756-ba8acbc1f4ef tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:36.283395 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-16c81134-ae79-466a-8756-ba8acbc1f4ef tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:36.284883 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-16c81134-ae79-466a-8756-ba8acbc1f4ef tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:36.285612 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-16c81134-ae79-466a-8756-ba8acbc1f4ef tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:36.286459 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-01756d89-fd27-42e2-90a3-f87d57dff635 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:36.296923 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-01756d89-fd27-42e2-90a3-f87d57dff635 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:36.299460 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-01756d89-fd27-42e2-90a3-f87d57dff635 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:36.300671 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-01756d89-fd27-42e2-90a3-f87d57dff635 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1873 microversion: 2.32 time: 0.376566 Oct 30 01:29:36.315923 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1823/3649] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:29:35 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1873 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:29:36.337786 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-81a50c00-ad15-4a2a-8f21-ff8d10554084 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:36.337786 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-81a50c00-ad15-4a2a-8f21-ff8d10554084 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 28af596f-f044-4281-8106-4585fbde9a4a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:36.343603 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-81a50c00-ad15-4a2a-8f21-ff8d10554084 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:36.344340 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-81a50c00-ad15-4a2a-8f21-ff8d10554084 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:36.344965 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-81a50c00-ad15-4a2a-8f21-ff8d10554084 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:36.345911 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-81a50c00-ad15-4a2a-8f21-ff8d10554084 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:36.346556 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-81a50c00-ad15-4a2a-8f21-ff8d10554084 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:36.347012 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-81a50c00-ad15-4a2a-8f21-ff8d10554084 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:36.613612 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-16c81134-ae79-466a-8756-ba8acbc1f4ef tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd2e319840c4a8aab90b495374aa1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eba4d14f2004498850092bff100b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:36.622130 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-16c81134-ae79-466a-8756-ba8acbc1f4ef tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] 10.222.0.13 "GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d" status: 200 len: 1290 microversion: 2.1 time: 0.361871 Oct 30 01:29:36.622631 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1827/3650] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:36 2022] GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d => generated 1290 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:29:36.628209 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cefaddac-39d1-48c5-bb12-649611d60ed7 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:36.634491 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cefaddac-39d1-48c5-bb12-649611d60ed7 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] [instance: 99db82dd-3238-4af1-9f90-1dd69cdd836a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:36.636427 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cefaddac-39d1-48c5-bb12-649611d60ed7 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:36.637011 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cefaddac-39d1-48c5-bb12-649611d60ed7 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:36.637767 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cefaddac-39d1-48c5-bb12-649611d60ed7 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:36.638794 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cefaddac-39d1-48c5-bb12-649611d60ed7 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:36.639318 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cefaddac-39d1-48c5-bb12-649611d60ed7 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:36.639817 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cefaddac-39d1-48c5-bb12-649611d60ed7 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:36.654556 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-81a50c00-ad15-4a2a-8f21-ff8d10554084 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:36.668492 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-81a50c00-ad15-4a2a-8f21-ff8d10554084 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a" status: 200 len: 1522 microversion: 2.1 time: 0.337439 Oct 30 01:29:36.669933 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1824/3651] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:36 2022] GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a => generated 1522 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:36.685521 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c50adacb-8d6f-4289-b3ed-1dddcc1dea8c tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:36.686235 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c50adacb-8d6f-4289-b3ed-1dddcc1dea8c tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d7cd54fb-1c64-4fb8-a97b-4d5c81a48009] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:36.692812 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c50adacb-8d6f-4289-b3ed-1dddcc1dea8c tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:36.693492 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c50adacb-8d6f-4289-b3ed-1dddcc1dea8c tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:36.694031 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c50adacb-8d6f-4289-b3ed-1dddcc1dea8c tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:36.694871 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c50adacb-8d6f-4289-b3ed-1dddcc1dea8c tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:36.695426 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c50adacb-8d6f-4289-b3ed-1dddcc1dea8c tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:36.695951 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c50adacb-8d6f-4289-b3ed-1dddcc1dea8c tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:36.972579 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c50adacb-8d6f-4289-b3ed-1dddcc1dea8c tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:36.975281 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-cefaddac-39d1-48c5-bb12-649611d60ed7 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea8a24166674250a98268ae52604f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcce1fadf54d089ec4fd751a3cf6ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:36.984503 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cefaddac-39d1-48c5-bb12-649611d60ed7 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/servers/99db82dd-3238-4af1-9f90-1dd69cdd836a" status: 200 len: 1318 microversion: 2.1 time: 0.360420 Oct 30 01:29:36.985063 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c50adacb-8d6f-4289-b3ed-1dddcc1dea8c tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009" status: 200 len: 1505 microversion: 2.1 time: 0.313105 Oct 30 01:29:36.985772 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1828/3652] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:36 2022] GET /compute/v2.1/servers/99db82dd-3238-4af1-9f90-1dd69cdd836a => generated 1318 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:36.996155 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-400c31a1-ea2f-4dcf-8edc-a45a563de246 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:36.999920 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-400c31a1-ea2f-4dcf-8edc-a45a563de246 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: ea637c0e-df6b-4c7f-a3ee-1b76fec47311] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:37.001471 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1825/3653] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:36 2022] GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 => generated 1505 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:37.003655 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-400c31a1-ea2f-4dcf-8edc-a45a563de246 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:37.004249 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-400c31a1-ea2f-4dcf-8edc-a45a563de246 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:37.005138 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-400c31a1-ea2f-4dcf-8edc-a45a563de246 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:37.005761 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-400c31a1-ea2f-4dcf-8edc-a45a563de246 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:37.006389 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-400c31a1-ea2f-4dcf-8edc-a45a563de246 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:37.006921 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-400c31a1-ea2f-4dcf-8edc-a45a563de246 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:37.027991 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:37.186115 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-400c31a1-ea2f-4dcf-8edc-a45a563de246 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:37.195091 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-400c31a1-ea2f-4dcf-8edc-a45a563de246 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311" status: 200 len: 1320 microversion: 2.1 time: 0.207901 Oct 30 01:29:37.196008 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1829/3654] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:36 2022] GET /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311 => generated 1320 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:37.328207 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e76e7101-48fd-429a-9429-63aa0c9eeec9 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:37.329148 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e76e7101-48fd-429a-9429-63aa0c9eeec9 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:37.335904 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e76e7101-48fd-429a-9429-63aa0c9eeec9 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:37.336584 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e76e7101-48fd-429a-9429-63aa0c9eeec9 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:37.337017 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e76e7101-48fd-429a-9429-63aa0c9eeec9 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:37.337744 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e76e7101-48fd-429a-9429-63aa0c9eeec9 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:37.338375 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e76e7101-48fd-429a-9429-63aa0c9eeec9 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:37.338797 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e76e7101-48fd-429a-9429-63aa0c9eeec9 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:37.590347 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-950a6601-8695-4d6a-b081-467a996d3720 req-e0500301-894a-4dbe-b68f-7662ae972596 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9368bd4-9715-46b3-91bb-cb436f7120f3", "tag": "2115d9c7-78b5-463e-b9d2-39310d4c1aa2"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:29:37.602305 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-950a6601-8695-4d6a-b081-467a996d3720 req-e0500301-894a-4dbe-b68f-7662ae972596 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:37.603349 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-950a6601-8695-4d6a-b081-467a996d3720 req-e0500301-894a-4dbe-b68f-7662ae972596 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:37.603780 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-950a6601-8695-4d6a-b081-467a996d3720 req-e0500301-894a-4dbe-b68f-7662ae972596 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:37.616446 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-950a6601-8695-4d6a-b081-467a996d3720 req-e0500301-894a-4dbe-b68f-7662ae972596 service nova] Creating event network-changed:2115d9c7-78b5-463e-b9d2-39310d4c1aa2 for instance e9368bd4-9715-46b3-91bb-cb436f7120f3 on n-h1-master-1 Oct 30 01:29:37.623041 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-950a6601-8695-4d6a-b081-467a996d3720 req-e0500301-894a-4dbe-b68f-7662ae972596 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.193916 Oct 30 01:29:37.623913 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1830/3655] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:29:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:29:37.647300 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c08061c1-b910-4545-badc-5836bb6bdd1e tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:37.648135 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c08061c1-b910-4545-badc-5836bb6bdd1e tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] [instance: 78081c7e-04f6-468e-9a0d-3c74c1092c6d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:37.655421 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c08061c1-b910-4545-badc-5836bb6bdd1e tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:37.656041 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c08061c1-b910-4545-badc-5836bb6bdd1e tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:37.656566 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c08061c1-b910-4545-badc-5836bb6bdd1e tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:37.657395 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c08061c1-b910-4545-badc-5836bb6bdd1e tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:37.657950 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c08061c1-b910-4545-badc-5836bb6bdd1e tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:37.658411 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c08061c1-b910-4545-badc-5836bb6bdd1e tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:37.763768 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e76e7101-48fd-429a-9429-63aa0c9eeec9 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:37.773939 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e76e7101-48fd-429a-9429-63aa0c9eeec9 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:37.775946 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e76e7101-48fd-429a-9429-63aa0c9eeec9 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:37.777207 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e76e7101-48fd-429a-9429-63aa0c9eeec9 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1873 microversion: 2.32 time: 0.453096 Oct 30 01:29:37.777802 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1826/3656] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:29:37 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1873 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:29:37.782731 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-73bbdfb3-9f20-44a2-bc3f-d225ac10632e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:37.783563 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-73bbdfb3-9f20-44a2-bc3f-d225ac10632e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 28af596f-f044-4281-8106-4585fbde9a4a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:37.789799 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-73bbdfb3-9f20-44a2-bc3f-d225ac10632e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:37.791130 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-73bbdfb3-9f20-44a2-bc3f-d225ac10632e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:37.791721 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-73bbdfb3-9f20-44a2-bc3f-d225ac10632e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:37.792612 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-73bbdfb3-9f20-44a2-bc3f-d225ac10632e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:37.793228 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-73bbdfb3-9f20-44a2-bc3f-d225ac10632e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:37.793840 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-73bbdfb3-9f20-44a2-bc3f-d225ac10632e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:38.319571 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c08061c1-b910-4545-badc-5836bb6bdd1e tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd2e319840c4a8aab90b495374aa1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eba4d14f2004498850092bff100b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:38.328096 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c08061c1-b910-4545-badc-5836bb6bdd1e tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] 10.222.0.13 "GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d" status: 200 len: 1290 microversion: 2.1 time: 0.685492 Oct 30 01:29:38.328668 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1831/3657] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:37 2022] GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d => generated 1290 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:29:38.333377 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1b7a94e9-0f41-4f44-b1cb-f48f82965f34 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:38.334157 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1b7a94e9-0f41-4f44-b1cb-f48f82965f34 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] [instance: 99db82dd-3238-4af1-9f90-1dd69cdd836a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:38.341110 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1b7a94e9-0f41-4f44-b1cb-f48f82965f34 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:38.341623 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1b7a94e9-0f41-4f44-b1cb-f48f82965f34 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:38.342056 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1b7a94e9-0f41-4f44-b1cb-f48f82965f34 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:38.342807 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1b7a94e9-0f41-4f44-b1cb-f48f82965f34 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:38.343213 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1b7a94e9-0f41-4f44-b1cb-f48f82965f34 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:38.343643 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1b7a94e9-0f41-4f44-b1cb-f48f82965f34 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:38.404468 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-73bbdfb3-9f20-44a2-bc3f-d225ac10632e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:38.408707 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:38.413562 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-73bbdfb3-9f20-44a2-bc3f-d225ac10632e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a" status: 200 len: 1522 microversion: 2.1 time: 0.634488 Oct 30 01:29:38.414132 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1827/3658] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:37 2022] GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a => generated 1522 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:38.427680 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b62fc9ee-805f-4cbd-9492-d7124903de83 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:38.427680 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b62fc9ee-805f-4cbd-9492-d7124903de83 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d7cd54fb-1c64-4fb8-a97b-4d5c81a48009] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:38.427680 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:38.427680 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b62fc9ee-805f-4cbd-9492-d7124903de83 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:38.427680 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b62fc9ee-805f-4cbd-9492-d7124903de83 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:38.427680 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b62fc9ee-805f-4cbd-9492-d7124903de83 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:38.427680 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b62fc9ee-805f-4cbd-9492-d7124903de83 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:38.428800 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b62fc9ee-805f-4cbd-9492-d7124903de83 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:38.429446 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b62fc9ee-805f-4cbd-9492-d7124903de83 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:38.638237 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1b7a94e9-0f41-4f44-b1cb-f48f82965f34 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea8a24166674250a98268ae52604f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcce1fadf54d089ec4fd751a3cf6ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:38.646237 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1b7a94e9-0f41-4f44-b1cb-f48f82965f34 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/servers/99db82dd-3238-4af1-9f90-1dd69cdd836a" status: 200 len: 1318 microversion: 2.1 time: 0.316515 Oct 30 01:29:38.646825 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1832/3659] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:38 2022] GET /compute/v2.1/servers/99db82dd-3238-4af1-9f90-1dd69cdd836a => generated 1318 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:38.666339 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-27d58695-bafa-4508-947e-91aeba091734 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:38.666962 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-27d58695-bafa-4508-947e-91aeba091734 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: ea637c0e-df6b-4c7f-a3ee-1b76fec47311] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:38.673120 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27d58695-bafa-4508-947e-91aeba091734 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:38.673729 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27d58695-bafa-4508-947e-91aeba091734 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:38.674235 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27d58695-bafa-4508-947e-91aeba091734 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:38.675154 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27d58695-bafa-4508-947e-91aeba091734 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:38.675686 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27d58695-bafa-4508-947e-91aeba091734 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:38.676188 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27d58695-bafa-4508-947e-91aeba091734 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:38.694897 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b62fc9ee-805f-4cbd-9492-d7124903de83 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:38.731882 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b62fc9ee-805f-4cbd-9492-d7124903de83 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009" status: 200 len: 1505 microversion: 2.1 time: 0.306497 Oct 30 01:29:38.731882 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1828/3660] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:38 2022] GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 => generated 1505 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:38.737237 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-eee584f9-a79e-43db-904f-7a6355f973f6 req-289bfd9c-5d61-4775-aa2c-17cae05451aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99db82dd-3238-4af1-9f90-1dd69cdd836a", "tag": "49372d17-c87d-4e36-af57-5d05c8cba1e2"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:29:38.747308 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-eee584f9-a79e-43db-904f-7a6355f973f6 req-289bfd9c-5d61-4775-aa2c-17cae05451aa service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:38.749092 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-eee584f9-a79e-43db-904f-7a6355f973f6 req-289bfd9c-5d61-4775-aa2c-17cae05451aa service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:38.749092 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-eee584f9-a79e-43db-904f-7a6355f973f6 req-289bfd9c-5d61-4775-aa2c-17cae05451aa service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:38.759869 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-eee584f9-a79e-43db-904f-7a6355f973f6 req-289bfd9c-5d61-4775-aa2c-17cae05451aa service nova] Creating event network-changed:49372d17-c87d-4e36-af57-5d05c8cba1e2 for instance 99db82dd-3238-4af1-9f90-1dd69cdd836a on n-h1-master-1 Oct 30 01:29:38.764784 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-eee584f9-a79e-43db-904f-7a6355f973f6 req-289bfd9c-5d61-4775-aa2c-17cae05451aa service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031434 Oct 30 01:29:38.765538 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1829/3661] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:29:38.804843 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-010002e0-e4ff-436d-9354-821bea441f2e tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:38.806376 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-010002e0-e4ff-436d-9354-821bea441f2e tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:38.814702 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-010002e0-e4ff-436d-9354-821bea441f2e tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:38.815198 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-010002e0-e4ff-436d-9354-821bea441f2e tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:38.815631 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-010002e0-e4ff-436d-9354-821bea441f2e tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:38.816328 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-010002e0-e4ff-436d-9354-821bea441f2e tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:38.816805 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-010002e0-e4ff-436d-9354-821bea441f2e tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:38.817222 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-010002e0-e4ff-436d-9354-821bea441f2e tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:39.011218 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-27d58695-bafa-4508-947e-91aeba091734 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:39.019173 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-27d58695-bafa-4508-947e-91aeba091734 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311" status: 200 len: 1320 microversion: 2.1 time: 0.356670 Oct 30 01:29:39.020068 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1833/3662] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:38 2022] GET /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311 => generated 1320 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:39.122310 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-010002e0-e4ff-436d-9354-821bea441f2e tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:39.131785 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-010002e0-e4ff-436d-9354-821bea441f2e tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:39.133289 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-010002e0-e4ff-436d-9354-821bea441f2e tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:39.137841 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-010002e0-e4ff-436d-9354-821bea441f2e tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1873 microversion: 2.32 time: 0.334171 Oct 30 01:29:39.137841 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1830/3663] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:29:38 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1873 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:29:39.313028 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-15c12822-26e0-43fa-82a7-ea99f04610d9 req-9b422a59-0da5-4d48-9c76-bf074fd1bd32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71a745a1-eaaf-4b96-8ed1-05e574cf4018", "name": "network-vif-plugged", "status": "completed", "tag": "89620a1f-327c-4185-81a0-292dbf3e67b4"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:29:39.325402 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-15c12822-26e0-43fa-82a7-ea99f04610d9 req-9b422a59-0da5-4d48-9c76-bf074fd1bd32 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:39.325984 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-15c12822-26e0-43fa-82a7-ea99f04610d9 req-9b422a59-0da5-4d48-9c76-bf074fd1bd32 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:39.326638 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-15c12822-26e0-43fa-82a7-ea99f04610d9 req-9b422a59-0da5-4d48-9c76-bf074fd1bd32 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:39.339021 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-15c12822-26e0-43fa-82a7-ea99f04610d9 req-9b422a59-0da5-4d48-9c76-bf074fd1bd32 service nova] Creating event network-vif-plugged:89620a1f-327c-4185-81a0-292dbf3e67b4 for instance 71a745a1-eaaf-4b96-8ed1-05e574cf4018 on n-h2-master-1 Oct 30 01:29:39.346165 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-15c12822-26e0-43fa-82a7-ea99f04610d9 req-9b422a59-0da5-4d48-9c76-bf074fd1bd32 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110077 Oct 30 01:29:39.350592 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1834/3664] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:29:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:29:39.362459 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-186aa974-ec63-4bb3-99a0-512c67024aeb tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:39.363337 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-186aa974-ec63-4bb3-99a0-512c67024aeb tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] [instance: 78081c7e-04f6-468e-9a0d-3c74c1092c6d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:39.376103 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-186aa974-ec63-4bb3-99a0-512c67024aeb tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:39.379492 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-186aa974-ec63-4bb3-99a0-512c67024aeb tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:39.390826 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-186aa974-ec63-4bb3-99a0-512c67024aeb tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:39.390826 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-186aa974-ec63-4bb3-99a0-512c67024aeb tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:39.390826 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-186aa974-ec63-4bb3-99a0-512c67024aeb tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:39.390826 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-186aa974-ec63-4bb3-99a0-512c67024aeb tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:39.439300 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-556e7f64-2add-4109-b768-7169eb474712 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:39.440003 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-556e7f64-2add-4109-b768-7169eb474712 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 28af596f-f044-4281-8106-4585fbde9a4a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:39.452330 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-556e7f64-2add-4109-b768-7169eb474712 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:39.453107 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-556e7f64-2add-4109-b768-7169eb474712 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:39.455212 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-556e7f64-2add-4109-b768-7169eb474712 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:39.456434 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-556e7f64-2add-4109-b768-7169eb474712 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:39.457062 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-556e7f64-2add-4109-b768-7169eb474712 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:39.457944 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-556e7f64-2add-4109-b768-7169eb474712 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:39.543068 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=6 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:39.752484 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-186aa974-ec63-4bb3-99a0-512c67024aeb tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd2e319840c4a8aab90b495374aa1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eba4d14f2004498850092bff100b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:39.763005 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-186aa974-ec63-4bb3-99a0-512c67024aeb tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] 10.222.0.13 "GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d" status: 200 len: 1290 microversion: 2.1 time: 0.414735 Oct 30 01:29:39.766992 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1831/3665] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:39 2022] GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d => generated 1290 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:39.776017 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-92840ceb-c2c6-4b43-b12a-8a8e4c50242f tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:39.776829 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-92840ceb-c2c6-4b43-b12a-8a8e4c50242f tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] [instance: 99db82dd-3238-4af1-9f90-1dd69cdd836a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:39.783768 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-92840ceb-c2c6-4b43-b12a-8a8e4c50242f tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:39.784587 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-92840ceb-c2c6-4b43-b12a-8a8e4c50242f tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:39.784950 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-556e7f64-2add-4109-b768-7169eb474712 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:39.785944 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-92840ceb-c2c6-4b43-b12a-8a8e4c50242f tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:39.786908 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-92840ceb-c2c6-4b43-b12a-8a8e4c50242f tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:39.787590 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-92840ceb-c2c6-4b43-b12a-8a8e4c50242f tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:39.788259 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-92840ceb-c2c6-4b43-b12a-8a8e4c50242f tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:39.796208 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-556e7f64-2add-4109-b768-7169eb474712 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a" status: 200 len: 1522 microversion: 2.1 time: 0.362355 Oct 30 01:29:39.797286 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1835/3666] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:39 2022] GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a => generated 1522 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:29:39.806336 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b9b8d9e5-fdae-4692-a6cd-9fb8b79e7bda tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:39.811242 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b9b8d9e5-fdae-4692-a6cd-9fb8b79e7bda tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d7cd54fb-1c64-4fb8-a97b-4d5c81a48009] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:39.826676 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b9b8d9e5-fdae-4692-a6cd-9fb8b79e7bda tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:39.832660 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b9b8d9e5-fdae-4692-a6cd-9fb8b79e7bda tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:39.833276 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b9b8d9e5-fdae-4692-a6cd-9fb8b79e7bda tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:39.836212 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b9b8d9e5-fdae-4692-a6cd-9fb8b79e7bda tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:39.837540 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b9b8d9e5-fdae-4692-a6cd-9fb8b79e7bda tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:39.840454 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b9b8d9e5-fdae-4692-a6cd-9fb8b79e7bda tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:40.189978 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b9b8d9e5-fdae-4692-a6cd-9fb8b79e7bda tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:40.201427 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b9b8d9e5-fdae-4692-a6cd-9fb8b79e7bda tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009" status: 200 len: 1505 microversion: 2.1 time: 0.401466 Oct 30 01:29:40.202328 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1836/3667] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:39 2022] GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 => generated 1505 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:40.221895 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-92840ceb-c2c6-4b43-b12a-8a8e4c50242f tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea8a24166674250a98268ae52604f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcce1fadf54d089ec4fd751a3cf6ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:40.228129 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-61f29c2a-c75d-4d27-a494-56139892ab2f tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:40.228655 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-61f29c2a-c75d-4d27-a494-56139892ab2f tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: ea637c0e-df6b-4c7f-a3ee-1b76fec47311] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:40.234278 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-92840ceb-c2c6-4b43-b12a-8a8e4c50242f tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/servers/99db82dd-3238-4af1-9f90-1dd69cdd836a" status: 200 len: 1318 microversion: 2.1 time: 0.465950 Oct 30 01:29:40.235815 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-61f29c2a-c75d-4d27-a494-56139892ab2f tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:40.236531 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-61f29c2a-c75d-4d27-a494-56139892ab2f tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:40.237279 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-61f29c2a-c75d-4d27-a494-56139892ab2f tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:40.238906 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-61f29c2a-c75d-4d27-a494-56139892ab2f tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:40.239710 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-61f29c2a-c75d-4d27-a494-56139892ab2f tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:40.240307 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-61f29c2a-c75d-4d27-a494-56139892ab2f tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:40.251695 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1832/3668] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:39 2022] GET /compute/v2.1/servers/99db82dd-3238-4af1-9f90-1dd69cdd836a => generated 1318 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:40.259216 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1785378f-a59d-4357-9f22-8127c2ccf718 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:40.259848 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1785378f-a59d-4357-9f22-8127c2ccf718 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:40.274917 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1785378f-a59d-4357-9f22-8127c2ccf718 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:40.275425 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1785378f-a59d-4357-9f22-8127c2ccf718 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:40.275968 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1785378f-a59d-4357-9f22-8127c2ccf718 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:40.276694 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1785378f-a59d-4357-9f22-8127c2ccf718 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:40.277156 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1785378f-a59d-4357-9f22-8127c2ccf718 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:40.277695 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1785378f-a59d-4357-9f22-8127c2ccf718 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:40.443478 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-61f29c2a-c75d-4d27-a494-56139892ab2f tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:40.452331 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-61f29c2a-c75d-4d27-a494-56139892ab2f tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311" status: 200 len: 1320 microversion: 2.1 time: 0.248684 Oct 30 01:29:40.455404 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1837/3669] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:40 2022] GET /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311 => generated 1320 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:40.795567 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1785378f-a59d-4357-9f22-8127c2ccf718 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:40.802068 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-49fef5f0-a968-42ae-ab47-280042e37b5c tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:40.806645 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-49fef5f0-a968-42ae-ab47-280042e37b5c tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] [instance: 78081c7e-04f6-468e-9a0d-3c74c1092c6d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:40.807117 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1785378f-a59d-4357-9f22-8127c2ccf718 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:40.808585 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1785378f-a59d-4357-9f22-8127c2ccf718 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:40.812546 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1785378f-a59d-4357-9f22-8127c2ccf718 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1873 microversion: 2.32 time: 0.556991 Oct 30 01:29:40.812546 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1833/3670] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:29:40 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1873 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:29:40.816879 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-49fef5f0-a968-42ae-ab47-280042e37b5c tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:40.817633 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-49fef5f0-a968-42ae-ab47-280042e37b5c tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:40.818265 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-49fef5f0-a968-42ae-ab47-280042e37b5c tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:40.819147 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-49fef5f0-a968-42ae-ab47-280042e37b5c tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:40.819676 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bbfde0a1-13c9-416d-b24a-48b9a4132366 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:40.820241 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-49fef5f0-a968-42ae-ab47-280042e37b5c tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:40.820620 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-bbfde0a1-13c9-416d-b24a-48b9a4132366 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 28af596f-f044-4281-8106-4585fbde9a4a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:40.822676 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-49fef5f0-a968-42ae-ab47-280042e37b5c tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:40.828067 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bbfde0a1-13c9-416d-b24a-48b9a4132366 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:40.828649 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bbfde0a1-13c9-416d-b24a-48b9a4132366 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:40.830682 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bbfde0a1-13c9-416d-b24a-48b9a4132366 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:40.831719 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bbfde0a1-13c9-416d-b24a-48b9a4132366 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:40.832352 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bbfde0a1-13c9-416d-b24a-48b9a4132366 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:40.832866 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bbfde0a1-13c9-416d-b24a-48b9a4132366 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:40.937396 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:40.959725 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=6 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:41.053759 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-49fef5f0-a968-42ae-ab47-280042e37b5c tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd2e319840c4a8aab90b495374aa1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eba4d14f2004498850092bff100b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:41.061589 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-49fef5f0-a968-42ae-ab47-280042e37b5c tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] 10.222.0.13 "GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d" status: 200 len: 1290 microversion: 2.1 time: 0.273386 Oct 30 01:29:41.062556 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1838/3671] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:40 2022] GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d => generated 1290 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:41.065584 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-bbfde0a1-13c9-416d-b24a-48b9a4132366 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:41.084446 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bbfde0a1-13c9-416d-b24a-48b9a4132366 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a" status: 200 len: 1522 microversion: 2.1 time: 0.268502 Oct 30 01:29:41.084765 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1834/3672] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:40 2022] GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:41.228877 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9183ca1f-12a7-441d-8d3b-df8bd87723c3 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:41.229713 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9183ca1f-12a7-441d-8d3b-df8bd87723c3 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d7cd54fb-1c64-4fb8-a97b-4d5c81a48009] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:41.235865 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9183ca1f-12a7-441d-8d3b-df8bd87723c3 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:41.237071 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9183ca1f-12a7-441d-8d3b-df8bd87723c3 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:41.237721 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9183ca1f-12a7-441d-8d3b-df8bd87723c3 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:41.238538 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9183ca1f-12a7-441d-8d3b-df8bd87723c3 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:41.239098 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9183ca1f-12a7-441d-8d3b-df8bd87723c3 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:41.239628 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9183ca1f-12a7-441d-8d3b-df8bd87723c3 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:41.262753 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-75d825b0-a9d5-49b0-aebc-3d25fa7e76de tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:41.262753 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-75d825b0-a9d5-49b0-aebc-3d25fa7e76de tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] [instance: 99db82dd-3238-4af1-9f90-1dd69cdd836a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:41.268870 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-75d825b0-a9d5-49b0-aebc-3d25fa7e76de tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:41.269379 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-75d825b0-a9d5-49b0-aebc-3d25fa7e76de tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:41.269818 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-75d825b0-a9d5-49b0-aebc-3d25fa7e76de tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:41.270543 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-75d825b0-a9d5-49b0-aebc-3d25fa7e76de tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:41.270993 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-75d825b0-a9d5-49b0-aebc-3d25fa7e76de tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:41.271413 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-75d825b0-a9d5-49b0-aebc-3d25fa7e76de tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:41.439385 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9183ca1f-12a7-441d-8d3b-df8bd87723c3 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:41.448313 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9183ca1f-12a7-441d-8d3b-df8bd87723c3 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009" status: 200 len: 1505 microversion: 2.1 time: 0.224007 Oct 30 01:29:41.449368 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1839/3673] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:41 2022] GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 => generated 1505 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:41.455153 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-4986f6e9-e809-42e3-b87b-2eb082c20a2e req-bfd48cd9-3580-4e9b-b62b-20346aabb8cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71a745a1-eaaf-4b96-8ed1-05e574cf4018", "name": "network-vif-plugged", "status": "completed", "tag": "0768b27f-1e71-4099-8b05-caf0bb6c7954"}, {"server_uuid": "78081c7e-04f6-468e-9a0d-3c74c1092c6d", "name": "network-vif-plugged", "status": "completed", "tag": "b74af5e9-2f4a-4f37-abb4-131b49622ba4"}, {"server_uuid": "71a745a1-eaaf-4b96-8ed1-05e574cf4018", "name": "network-vif-plugged", "status": "completed", "tag": "b1d21fa1-296a-49e9-8eb4-9815567f00c1"}, {"server_uuid": "71a745a1-eaaf-4b96-8ed1-05e574cf4018", "name": "network-vif-plugged", "status": "completed", "tag": "d3003a3b-48ae-4930-aff4-2c14db9a20f6"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:29:41.476284 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-4986f6e9-e809-42e3-b87b-2eb082c20a2e req-bfd48cd9-3580-4e9b-b62b-20346aabb8cf service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:41.477619 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-4986f6e9-e809-42e3-b87b-2eb082c20a2e req-bfd48cd9-3580-4e9b-b62b-20346aabb8cf service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:41.478248 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-4986f6e9-e809-42e3-b87b-2eb082c20a2e req-bfd48cd9-3580-4e9b-b62b-20346aabb8cf service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:41.495854 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-75d825b0-a9d5-49b0-aebc-3d25fa7e76de tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea8a24166674250a98268ae52604f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcce1fadf54d089ec4fd751a3cf6ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:41.502919 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-4986f6e9-e809-42e3-b87b-2eb082c20a2e req-bfd48cd9-3580-4e9b-b62b-20346aabb8cf service nova] Creating event network-vif-plugged:0768b27f-1e71-4099-8b05-caf0bb6c7954 for instance 71a745a1-eaaf-4b96-8ed1-05e574cf4018 on n-h2-master-1 Oct 30 01:29:41.503609 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-4986f6e9-e809-42e3-b87b-2eb082c20a2e req-bfd48cd9-3580-4e9b-b62b-20346aabb8cf service nova] Creating event network-vif-plugged:b74af5e9-2f4a-4f37-abb4-131b49622ba4 for instance 78081c7e-04f6-468e-9a0d-3c74c1092c6d on n-h2-master-1 Oct 30 01:29:41.505158 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-4986f6e9-e809-42e3-b87b-2eb082c20a2e req-bfd48cd9-3580-4e9b-b62b-20346aabb8cf service nova] Creating event network-vif-plugged:b1d21fa1-296a-49e9-8eb4-9815567f00c1 for instance 71a745a1-eaaf-4b96-8ed1-05e574cf4018 on n-h2-master-1 Oct 30 01:29:41.505665 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-4986f6e9-e809-42e3-b87b-2eb082c20a2e req-bfd48cd9-3580-4e9b-b62b-20346aabb8cf service nova] Creating event network-vif-plugged:d3003a3b-48ae-4930-aff4-2c14db9a20f6 for instance 71a745a1-eaaf-4b96-8ed1-05e574cf4018 on n-h2-master-1 Oct 30 01:29:41.511730 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-75d825b0-a9d5-49b0-aebc-3d25fa7e76de tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/servers/99db82dd-3238-4af1-9f90-1dd69cdd836a" status: 200 len: 1318 microversion: 2.1 time: 0.253999 Oct 30 01:29:41.512576 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1835/3674] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:41 2022] GET /compute/v2.1/servers/99db82dd-3238-4af1-9f90-1dd69cdd836a => generated 1318 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:29:41.518994 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2aec7f2c-3ba3-49b6-a44e-f357287428ad tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:41.519629 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2aec7f2c-3ba3-49b6-a44e-f357287428ad tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: ea637c0e-df6b-4c7f-a3ee-1b76fec47311] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:41.528797 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-4986f6e9-e809-42e3-b87b-2eb082c20a2e req-bfd48cd9-3580-4e9b-b62b-20346aabb8cf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.077872 Oct 30 01:29:41.529950 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1840/3675] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:29:41 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:29:41.540698 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2aec7f2c-3ba3-49b6-a44e-f357287428ad tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:41.540698 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2aec7f2c-3ba3-49b6-a44e-f357287428ad tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:41.540698 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2aec7f2c-3ba3-49b6-a44e-f357287428ad tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:41.540698 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2aec7f2c-3ba3-49b6-a44e-f357287428ad tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:41.540698 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2aec7f2c-3ba3-49b6-a44e-f357287428ad tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:41.540698 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2aec7f2c-3ba3-49b6-a44e-f357287428ad tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:41.694601 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2aec7f2c-3ba3-49b6-a44e-f357287428ad tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:41.702706 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2aec7f2c-3ba3-49b6-a44e-f357287428ad tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311" status: 200 len: 1320 microversion: 2.1 time: 0.188936 Oct 30 01:29:41.703361 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1836/3676] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:41 2022] GET /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311 => generated 1320 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:41.837769 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4ca16c33-1a62-462e-9c88-76ebc8c67c7d tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:41.838387 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4ca16c33-1a62-462e-9c88-76ebc8c67c7d tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:41.848210 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4ca16c33-1a62-462e-9c88-76ebc8c67c7d tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:41.849037 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4ca16c33-1a62-462e-9c88-76ebc8c67c7d tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:41.849845 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4ca16c33-1a62-462e-9c88-76ebc8c67c7d tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:41.851017 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4ca16c33-1a62-462e-9c88-76ebc8c67c7d tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:41.851531 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4ca16c33-1a62-462e-9c88-76ebc8c67c7d tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:41.851961 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4ca16c33-1a62-462e-9c88-76ebc8c67c7d tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:42.085136 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fe8e097e-b404-4e60-b66e-55c26f22bb58 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:42.085908 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-fe8e097e-b404-4e60-b66e-55c26f22bb58 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] [instance: 78081c7e-04f6-468e-9a0d-3c74c1092c6d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:42.093161 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe8e097e-b404-4e60-b66e-55c26f22bb58 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:42.093451 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe8e097e-b404-4e60-b66e-55c26f22bb58 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:42.094242 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe8e097e-b404-4e60-b66e-55c26f22bb58 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:42.095395 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe8e097e-b404-4e60-b66e-55c26f22bb58 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:42.095936 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe8e097e-b404-4e60-b66e-55c26f22bb58 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:42.096377 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe8e097e-b404-4e60-b66e-55c26f22bb58 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:42.130957 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4ca16c33-1a62-462e-9c88-76ebc8c67c7d tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:42.141008 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4ca16c33-1a62-462e-9c88-76ebc8c67c7d tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:42.142881 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4ca16c33-1a62-462e-9c88-76ebc8c67c7d tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:42.144358 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4ca16c33-1a62-462e-9c88-76ebc8c67c7d tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1873 microversion: 2.32 time: 0.311713 Oct 30 01:29:42.149739 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1841/3677] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:29:41 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1873 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:29:42.162407 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-900f0ed7-abab-4ae2-9a0e-d9d72e268118 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:42.163596 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-900f0ed7-abab-4ae2-9a0e-d9d72e268118 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 28af596f-f044-4281-8106-4585fbde9a4a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:42.180731 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-900f0ed7-abab-4ae2-9a0e-d9d72e268118 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:42.181256 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-900f0ed7-abab-4ae2-9a0e-d9d72e268118 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:42.181867 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-900f0ed7-abab-4ae2-9a0e-d9d72e268118 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:42.182474 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-900f0ed7-abab-4ae2-9a0e-d9d72e268118 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:42.182937 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-900f0ed7-abab-4ae2-9a0e-d9d72e268118 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:42.183368 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-900f0ed7-abab-4ae2-9a0e-d9d72e268118 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:42.388544 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-fe8e097e-b404-4e60-b66e-55c26f22bb58 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd2e319840c4a8aab90b495374aa1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eba4d14f2004498850092bff100b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:42.388544 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fe8e097e-b404-4e60-b66e-55c26f22bb58 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] 10.222.0.13 "GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d" status: 200 len: 1290 microversion: 2.1 time: 0.291289 Oct 30 01:29:42.388544 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1837/3678] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:42 2022] GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d => generated 1290 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:42.411048 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-900f0ed7-abab-4ae2-9a0e-d9d72e268118 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:42.421937 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-900f0ed7-abab-4ae2-9a0e-d9d72e268118 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a" status: 200 len: 1522 microversion: 2.1 time: 0.270048 Oct 30 01:29:42.422605 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1842/3679] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:42 2022] GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:42.484631 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-30b743ee-4e45-4349-9b2a-7e010724254c tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:42.485584 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-30b743ee-4e45-4349-9b2a-7e010724254c tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d7cd54fb-1c64-4fb8-a97b-4d5c81a48009] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:42.495450 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-30b743ee-4e45-4349-9b2a-7e010724254c tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:42.496016 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-30b743ee-4e45-4349-9b2a-7e010724254c tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:42.496493 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-30b743ee-4e45-4349-9b2a-7e010724254c tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:42.497262 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-30b743ee-4e45-4349-9b2a-7e010724254c tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:42.497798 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-30b743ee-4e45-4349-9b2a-7e010724254c tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:42.498285 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-30b743ee-4e45-4349-9b2a-7e010724254c tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:42.535782 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2906aca8-2d33-46a6-9ea2-58ff458a8da0 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:42.536401 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2906aca8-2d33-46a6-9ea2-58ff458a8da0 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] [instance: 99db82dd-3238-4af1-9f90-1dd69cdd836a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:42.539680 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=24 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:42.544702 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2906aca8-2d33-46a6-9ea2-58ff458a8da0 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:42.545227 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2906aca8-2d33-46a6-9ea2-58ff458a8da0 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:42.545709 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2906aca8-2d33-46a6-9ea2-58ff458a8da0 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:42.546412 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2906aca8-2d33-46a6-9ea2-58ff458a8da0 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:42.546867 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2906aca8-2d33-46a6-9ea2-58ff458a8da0 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:42.547293 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2906aca8-2d33-46a6-9ea2-58ff458a8da0 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:42.726162 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-30b743ee-4e45-4349-9b2a-7e010724254c tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:42.735625 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-30b743ee-4e45-4349-9b2a-7e010724254c tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009" status: 200 len: 1505 microversion: 2.1 time: 0.256545 Oct 30 01:29:42.752489 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1838/3680] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:42 2022] GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 => generated 1505 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:42.757835 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3125e5c9-b50a-4542-8b05-8f1ea46265fd tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:42.763369 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3125e5c9-b50a-4542-8b05-8f1ea46265fd tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: ea637c0e-df6b-4c7f-a3ee-1b76fec47311] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:42.764645 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3125e5c9-b50a-4542-8b05-8f1ea46265fd tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:42.765139 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3125e5c9-b50a-4542-8b05-8f1ea46265fd tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:42.765640 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3125e5c9-b50a-4542-8b05-8f1ea46265fd tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:42.766346 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3125e5c9-b50a-4542-8b05-8f1ea46265fd tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:42.766799 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3125e5c9-b50a-4542-8b05-8f1ea46265fd tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:42.767216 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3125e5c9-b50a-4542-8b05-8f1ea46265fd tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:42.800169 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2906aca8-2d33-46a6-9ea2-58ff458a8da0 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea8a24166674250a98268ae52604f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcce1fadf54d089ec4fd751a3cf6ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:42.810450 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2906aca8-2d33-46a6-9ea2-58ff458a8da0 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/servers/99db82dd-3238-4af1-9f90-1dd69cdd836a" status: 200 len: 1318 microversion: 2.1 time: 0.278507 Oct 30 01:29:42.811160 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1843/3681] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:42 2022] GET /compute/v2.1/servers/99db82dd-3238-4af1-9f90-1dd69cdd836a => generated 1318 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:29:42.946355 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3125e5c9-b50a-4542-8b05-8f1ea46265fd tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:42.954172 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3125e5c9-b50a-4542-8b05-8f1ea46265fd tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311" status: 200 len: 1320 microversion: 2.1 time: 0.200349 Oct 30 01:29:42.954733 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1839/3682] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:42 2022] GET /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311 => generated 1320 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:43.171296 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-17c614fa-ab56-4766-98f3-579d3d7d4573 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:43.177710 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-17c614fa-ab56-4766-98f3-579d3d7d4573 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:43.178023 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-17c614fa-ab56-4766-98f3-579d3d7d4573 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:43.178519 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-17c614fa-ab56-4766-98f3-579d3d7d4573 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:43.178959 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-17c614fa-ab56-4766-98f3-579d3d7d4573 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:43.179903 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-17c614fa-ab56-4766-98f3-579d3d7d4573 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:43.180366 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-17c614fa-ab56-4766-98f3-579d3d7d4573 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:43.180795 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-17c614fa-ab56-4766-98f3-579d3d7d4573 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:43.396649 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-08c04f16-0b49-43fd-b3f7-6654d08fd2f9 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:43.397131 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-08c04f16-0b49-43fd-b3f7-6654d08fd2f9 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] [instance: 78081c7e-04f6-468e-9a0d-3c74c1092c6d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:43.405184 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08c04f16-0b49-43fd-b3f7-6654d08fd2f9 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:43.407248 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08c04f16-0b49-43fd-b3f7-6654d08fd2f9 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:43.407557 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08c04f16-0b49-43fd-b3f7-6654d08fd2f9 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:43.408111 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08c04f16-0b49-43fd-b3f7-6654d08fd2f9 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:43.408587 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08c04f16-0b49-43fd-b3f7-6654d08fd2f9 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:43.409004 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08c04f16-0b49-43fd-b3f7-6654d08fd2f9 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:43.742456 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-17c614fa-ab56-4766-98f3-579d3d7d4573 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:43.752247 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-17c614fa-ab56-4766-98f3-579d3d7d4573 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:43.754082 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-17c614fa-ab56-4766-98f3-579d3d7d4573 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:43.770485 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-17c614fa-ab56-4766-98f3-579d3d7d4573 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1873 microversion: 2.32 time: 0.588037 Oct 30 01:29:43.770485 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1844/3683] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:29:43 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1873 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:29:43.776775 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a5f34d77-d581-4a0d-9d25-833caf858db4 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:43.777542 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a5f34d77-d581-4a0d-9d25-833caf858db4 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 28af596f-f044-4281-8106-4585fbde9a4a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:43.785115 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a5f34d77-d581-4a0d-9d25-833caf858db4 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:43.792177 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a5f34d77-d581-4a0d-9d25-833caf858db4 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:43.792177 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a5f34d77-d581-4a0d-9d25-833caf858db4 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:43.792177 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a5f34d77-d581-4a0d-9d25-833caf858db4 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:43.792177 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a5f34d77-d581-4a0d-9d25-833caf858db4 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:43.792177 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a5f34d77-d581-4a0d-9d25-833caf858db4 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:43.813728 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-08c04f16-0b49-43fd-b3f7-6654d08fd2f9 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd2e319840c4a8aab90b495374aa1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eba4d14f2004498850092bff100b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:43.822392 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-08c04f16-0b49-43fd-b3f7-6654d08fd2f9 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] 10.222.0.13 "GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d" status: 200 len: 1482 microversion: 2.1 time: 0.430104 Oct 30 01:29:43.823547 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1840/3684] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:43 2022] GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d => generated 1482 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:43.828533 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-1ff0e875-0e54-477d-886d-da5e6376526f req-6126c41f-0f37-432c-aed7-565f87f96dc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71a745a1-eaaf-4b96-8ed1-05e574cf4018", "name": "network-vif-plugged", "status": "completed", "tag": "f28e0cc4-3563-4fc3-9871-48fe723f125c"}, {"server_uuid": "e9368bd4-9715-46b3-91bb-cb436f7120f3", "name": "network-vif-plugged", "status": "completed", "tag": "2115d9c7-78b5-463e-b9d2-39310d4c1aa2"}, {"server_uuid": "71a745a1-eaaf-4b96-8ed1-05e574cf4018", "name": "network-vif-plugged", "status": "completed", "tag": "66e47ab9-7e05-48f9-9e49-e60474216b03"}, {"server_uuid": "71a745a1-eaaf-4b96-8ed1-05e574cf4018", "name": "network-vif-plugged", "status": "completed", "tag": "e93d2997-a301-4093-af8d-49bdcb2c57e1"}, {"server_uuid": "ea637c0e-df6b-4c7f-a3ee-1b76fec47311", "name": "network-vif-plugged", "status": "completed", "tag": "71e2929f-b3fa-4fe5-92a5-faa55fb3fe8e"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:29:43.840407 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-1ff0e875-0e54-477d-886d-da5e6376526f req-6126c41f-0f37-432c-aed7-565f87f96dc0 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:43.840889 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-1ff0e875-0e54-477d-886d-da5e6376526f req-6126c41f-0f37-432c-aed7-565f87f96dc0 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:43.841321 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-1ff0e875-0e54-477d-886d-da5e6376526f req-6126c41f-0f37-432c-aed7-565f87f96dc0 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:43.863142 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-1ff0e875-0e54-477d-886d-da5e6376526f req-6126c41f-0f37-432c-aed7-565f87f96dc0 service nova] Creating event network-vif-plugged:f28e0cc4-3563-4fc3-9871-48fe723f125c for instance 71a745a1-eaaf-4b96-8ed1-05e574cf4018 on n-h2-master-1 Oct 30 01:29:43.863926 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-1ff0e875-0e54-477d-886d-da5e6376526f req-6126c41f-0f37-432c-aed7-565f87f96dc0 service nova] Creating event network-vif-plugged:2115d9c7-78b5-463e-b9d2-39310d4c1aa2 for instance e9368bd4-9715-46b3-91bb-cb436f7120f3 on n-h1-master-1 Oct 30 01:29:43.864772 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-1ff0e875-0e54-477d-886d-da5e6376526f req-6126c41f-0f37-432c-aed7-565f87f96dc0 service nova] Creating event network-vif-plugged:66e47ab9-7e05-48f9-9e49-e60474216b03 for instance 71a745a1-eaaf-4b96-8ed1-05e574cf4018 on n-h2-master-1 Oct 30 01:29:43.865480 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-1ff0e875-0e54-477d-886d-da5e6376526f req-6126c41f-0f37-432c-aed7-565f87f96dc0 service nova] Creating event network-vif-plugged:e93d2997-a301-4093-af8d-49bdcb2c57e1 for instance 71a745a1-eaaf-4b96-8ed1-05e574cf4018 on n-h2-master-1 Oct 30 01:29:43.866159 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-1ff0e875-0e54-477d-886d-da5e6376526f req-6126c41f-0f37-432c-aed7-565f87f96dc0 service nova] Creating event network-vif-plugged:71e2929f-b3fa-4fe5-92a5-faa55fb3fe8e for instance ea637c0e-df6b-4c7f-a3ee-1b76fec47311 on n-h2-master-1 Oct 30 01:29:43.885793 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-1ff0e875-0e54-477d-886d-da5e6376526f req-6126c41f-0f37-432c-aed7-565f87f96dc0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.060731 Oct 30 01:29:43.886668 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1841/3685] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:29:43 2022] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:29:43.895822 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8f645f39-69b9-4a39-b084-cb07f3e21b2d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:43.898780 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8f645f39-69b9-4a39-b084-cb07f3e21b2d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d7cd54fb-1c64-4fb8-a97b-4d5c81a48009] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:43.905818 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f645f39-69b9-4a39-b084-cb07f3e21b2d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:43.909222 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f645f39-69b9-4a39-b084-cb07f3e21b2d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:43.909222 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f645f39-69b9-4a39-b084-cb07f3e21b2d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:43.909222 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f645f39-69b9-4a39-b084-cb07f3e21b2d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:43.909222 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f645f39-69b9-4a39-b084-cb07f3e21b2d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:43.909222 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f645f39-69b9-4a39-b084-cb07f3e21b2d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:44.007837 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a5f34d77-d581-4a0d-9d25-833caf858db4 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:44.044767 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a5f34d77-d581-4a0d-9d25-833caf858db4 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a" status: 200 len: 1522 microversion: 2.1 time: 0.287686 Oct 30 01:29:44.054746 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1845/3686] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:43 2022] GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a => generated 1522 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:44.071870 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2db63ac6-4140-40a4-b2c1-09c70e958ac7 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:44.075733 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2db63ac6-4140-40a4-b2c1-09c70e958ac7 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] [instance: 99db82dd-3238-4af1-9f90-1dd69cdd836a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:44.091797 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2db63ac6-4140-40a4-b2c1-09c70e958ac7 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:44.094442 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2db63ac6-4140-40a4-b2c1-09c70e958ac7 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:44.094442 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2db63ac6-4140-40a4-b2c1-09c70e958ac7 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:44.094442 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2db63ac6-4140-40a4-b2c1-09c70e958ac7 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:44.094442 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2db63ac6-4140-40a4-b2c1-09c70e958ac7 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:44.094442 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2db63ac6-4140-40a4-b2c1-09c70e958ac7 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:44.110857 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8f645f39-69b9-4a39-b084-cb07f3e21b2d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:44.128078 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8f645f39-69b9-4a39-b084-cb07f3e21b2d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009" status: 200 len: 1505 microversion: 2.1 time: 0.239878 Oct 30 01:29:44.142735 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1842/3687] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:43 2022] GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 => generated 1505 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:44.142735 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4bb8add2-59fc-4a92-b43f-3bd283973327 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:44.142735 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4bb8add2-59fc-4a92-b43f-3bd283973327 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] [instance: 78081c7e-04f6-468e-9a0d-3c74c1092c6d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:44.142735 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4bb8add2-59fc-4a92-b43f-3bd283973327 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:44.142735 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4bb8add2-59fc-4a92-b43f-3bd283973327 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:44.143534 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4bb8add2-59fc-4a92-b43f-3bd283973327 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:44.146248 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4bb8add2-59fc-4a92-b43f-3bd283973327 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:44.146807 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4bb8add2-59fc-4a92-b43f-3bd283973327 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:44.147689 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4bb8add2-59fc-4a92-b43f-3bd283973327 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:44.308437 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4bb8add2-59fc-4a92-b43f-3bd283973327 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] 10.222.0.13 "GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.177884 Oct 30 01:29:44.316213 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1843/3688] 10.222.0.13 () {58 vars in 1275 bytes} [Sun Oct 30 01:29:44 2022] GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d/os-interface => generated 285 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:29:44.316213 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4fa09dd2-b343-4de2-9386-c219d7883a6c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:44.316649 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4fa09dd2-b343-4de2-9386-c219d7883a6c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: ea637c0e-df6b-4c7f-a3ee-1b76fec47311] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:44.322653 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4fa09dd2-b343-4de2-9386-c219d7883a6c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:44.326073 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4fa09dd2-b343-4de2-9386-c219d7883a6c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:44.326073 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4fa09dd2-b343-4de2-9386-c219d7883a6c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:44.326073 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4fa09dd2-b343-4de2-9386-c219d7883a6c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:44.326073 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4fa09dd2-b343-4de2-9386-c219d7883a6c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:44.326073 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4fa09dd2-b343-4de2-9386-c219d7883a6c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:44.510698 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2db63ac6-4140-40a4-b2c1-09c70e958ac7 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea8a24166674250a98268ae52604f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcce1fadf54d089ec4fd751a3cf6ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:44.523407 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2db63ac6-4140-40a4-b2c1-09c70e958ac7 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/servers/99db82dd-3238-4af1-9f90-1dd69cdd836a" status: 200 len: 1318 microversion: 2.1 time: 0.466243 Oct 30 01:29:44.541524 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1846/3689] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:44 2022] GET /compute/v2.1/servers/99db82dd-3238-4af1-9f90-1dd69cdd836a => generated 1318 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:44.687890 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4fa09dd2-b343-4de2-9386-c219d7883a6c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:44.705805 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4fa09dd2-b343-4de2-9386-c219d7883a6c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311" status: 200 len: 1320 microversion: 2.1 time: 0.394940 Oct 30 01:29:44.706473 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1844/3690] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:44 2022] GET /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311 => generated 1320 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:44.784703 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-871445e6-fbe9-4dde-b9bb-3db7f096a7ec tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:44.785325 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-871445e6-fbe9-4dde-b9bb-3db7f096a7ec tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:44.791980 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-871445e6-fbe9-4dde-b9bb-3db7f096a7ec tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:44.793322 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-871445e6-fbe9-4dde-b9bb-3db7f096a7ec tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:44.793322 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-871445e6-fbe9-4dde-b9bb-3db7f096a7ec tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:44.794082 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-871445e6-fbe9-4dde-b9bb-3db7f096a7ec tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:44.794544 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-871445e6-fbe9-4dde-b9bb-3db7f096a7ec tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:44.794977 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-871445e6-fbe9-4dde-b9bb-3db7f096a7ec tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:45.075398 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ef07c4c0-43a8-43fb-892e-732f69a3de2b tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:45.076018 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ef07c4c0-43a8-43fb-892e-732f69a3de2b tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 28af596f-f044-4281-8106-4585fbde9a4a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:45.082782 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ef07c4c0-43a8-43fb-892e-732f69a3de2b tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:45.083280 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ef07c4c0-43a8-43fb-892e-732f69a3de2b tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:45.083716 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ef07c4c0-43a8-43fb-892e-732f69a3de2b tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:45.084592 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ef07c4c0-43a8-43fb-892e-732f69a3de2b tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:45.085132 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ef07c4c0-43a8-43fb-892e-732f69a3de2b tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:45.085543 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ef07c4c0-43a8-43fb-892e-732f69a3de2b tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:45.086897 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-871445e6-fbe9-4dde-b9bb-3db7f096a7ec tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:45.096239 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-871445e6-fbe9-4dde-b9bb-3db7f096a7ec tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:45.098022 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-871445e6-fbe9-4dde-b9bb-3db7f096a7ec tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:45.099473 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-871445e6-fbe9-4dde-b9bb-3db7f096a7ec tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1873 microversion: 2.32 time: 0.318848 Oct 30 01:29:45.101185 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1847/3691] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:29:44 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1873 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:29:45.155006 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-60cd71b6-c67c-49b2-aa73-69e3e3378aab tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:45.155717 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-60cd71b6-c67c-49b2-aa73-69e3e3378aab tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d7cd54fb-1c64-4fb8-a97b-4d5c81a48009] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:45.161878 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-60cd71b6-c67c-49b2-aa73-69e3e3378aab tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:45.162444 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-60cd71b6-c67c-49b2-aa73-69e3e3378aab tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:45.162969 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-60cd71b6-c67c-49b2-aa73-69e3e3378aab tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:45.164368 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-60cd71b6-c67c-49b2-aa73-69e3e3378aab tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:45.164879 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-60cd71b6-c67c-49b2-aa73-69e3e3378aab tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:45.165643 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-60cd71b6-c67c-49b2-aa73-69e3e3378aab tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:45.170102 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:45.341136 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ef07c4c0-43a8-43fb-892e-732f69a3de2b tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:45.350616 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ef07c4c0-43a8-43fb-892e-732f69a3de2b tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a" status: 200 len: 1522 microversion: 2.1 time: 0.279350 Oct 30 01:29:45.352038 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1845/3692] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:45 2022] GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:45.425153 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-60cd71b6-c67c-49b2-aa73-69e3e3378aab tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:45.433700 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-60cd71b6-c67c-49b2-aa73-69e3e3378aab tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009" status: 200 len: 1505 microversion: 2.1 time: 0.282686 Oct 30 01:29:45.439178 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1848/3693] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:45 2022] GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 => generated 1505 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:29:45.549280 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-eaee1dcc-b97c-42df-9af0-973ff10c8358 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:45.550059 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-eaee1dcc-b97c-42df-9af0-973ff10c8358 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] [instance: 99db82dd-3238-4af1-9f90-1dd69cdd836a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:45.556236 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eaee1dcc-b97c-42df-9af0-973ff10c8358 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:45.556724 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eaee1dcc-b97c-42df-9af0-973ff10c8358 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:45.557161 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eaee1dcc-b97c-42df-9af0-973ff10c8358 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:45.557930 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eaee1dcc-b97c-42df-9af0-973ff10c8358 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:45.558382 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eaee1dcc-b97c-42df-9af0-973ff10c8358 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:45.559058 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eaee1dcc-b97c-42df-9af0-973ff10c8358 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:45.563371 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=100 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:45.730386 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-31e82405-9dbb-492c-8dfa-2db703461973 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:45.731263 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-31e82405-9dbb-492c-8dfa-2db703461973 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: ea637c0e-df6b-4c7f-a3ee-1b76fec47311] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:45.738234 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-31e82405-9dbb-492c-8dfa-2db703461973 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:45.739411 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-31e82405-9dbb-492c-8dfa-2db703461973 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:45.739411 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-31e82405-9dbb-492c-8dfa-2db703461973 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:45.739933 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-31e82405-9dbb-492c-8dfa-2db703461973 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:45.740382 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-31e82405-9dbb-492c-8dfa-2db703461973 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:45.740937 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-31e82405-9dbb-492c-8dfa-2db703461973 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:45.786086 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-eaee1dcc-b97c-42df-9af0-973ff10c8358 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea8a24166674250a98268ae52604f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcce1fadf54d089ec4fd751a3cf6ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:45.794303 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-eaee1dcc-b97c-42df-9af0-973ff10c8358 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/servers/99db82dd-3238-4af1-9f90-1dd69cdd836a" status: 200 len: 1318 microversion: 2.1 time: 0.248910 Oct 30 01:29:45.805988 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1846/3694] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:45 2022] GET /compute/v2.1/servers/99db82dd-3238-4af1-9f90-1dd69cdd836a => generated 1318 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:45.962707 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3c0af46e-6b1a-4684-96d1-828367d541b8 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:45.963343 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3c0af46e-6b1a-4684-96d1-828367d541b8 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] [instance: 78081c7e-04f6-468e-9a0d-3c74c1092c6d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:45.977595 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3c0af46e-6b1a-4684-96d1-828367d541b8 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:45.983525 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3c0af46e-6b1a-4684-96d1-828367d541b8 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:45.983525 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3c0af46e-6b1a-4684-96d1-828367d541b8 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:45.983525 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3c0af46e-6b1a-4684-96d1-828367d541b8 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:45.983525 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3c0af46e-6b1a-4684-96d1-828367d541b8 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:45.983525 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3c0af46e-6b1a-4684-96d1-828367d541b8 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:45.994922 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-31e82405-9dbb-492c-8dfa-2db703461973 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:46.003238 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-31e82405-9dbb-492c-8dfa-2db703461973 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311" status: 200 len: 1320 microversion: 2.1 time: 0.276756 Oct 30 01:29:46.004704 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1849/3695] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:45 2022] GET /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311 => generated 1320 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:29:46.018792 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-75ffa773-a27f-469e-adc1-b0cc20f92974 req-1d31f2e0-2e32-4947-85e7-b56c4233dbcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78081c7e-04f6-468e-9a0d-3c74c1092c6d", "tag": "b74af5e9-2f4a-4f37-abb4-131b49622ba4"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:29:46.028383 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-75ffa773-a27f-469e-adc1-b0cc20f92974 req-1d31f2e0-2e32-4947-85e7-b56c4233dbcd service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:46.028994 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-75ffa773-a27f-469e-adc1-b0cc20f92974 req-1d31f2e0-2e32-4947-85e7-b56c4233dbcd service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:46.031720 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-75ffa773-a27f-469e-adc1-b0cc20f92974 req-1d31f2e0-2e32-4947-85e7-b56c4233dbcd service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:46.066604 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-75ffa773-a27f-469e-adc1-b0cc20f92974 req-1d31f2e0-2e32-4947-85e7-b56c4233dbcd service nova] Creating event network-changed:b74af5e9-2f4a-4f37-abb4-131b49622ba4 for instance 78081c7e-04f6-468e-9a0d-3c74c1092c6d on n-h2-master-1 Oct 30 01:29:46.074620 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-75ffa773-a27f-469e-adc1-b0cc20f92974 req-1d31f2e0-2e32-4947-85e7-b56c4233dbcd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067515 Oct 30 01:29:46.075409 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1850/3696] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:29:46.128628 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6b44750f-d4a8-43bb-b5b0-2aacddcade82 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:46.129488 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6b44750f-d4a8-43bb-b5b0-2aacddcade82 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:46.138639 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b44750f-d4a8-43bb-b5b0-2aacddcade82 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:46.139149 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b44750f-d4a8-43bb-b5b0-2aacddcade82 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:46.145877 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b44750f-d4a8-43bb-b5b0-2aacddcade82 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:46.146758 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b44750f-d4a8-43bb-b5b0-2aacddcade82 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:46.147248 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b44750f-d4a8-43bb-b5b0-2aacddcade82 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:46.148235 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b44750f-d4a8-43bb-b5b0-2aacddcade82 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:46.518506 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3c0af46e-6b1a-4684-96d1-828367d541b8 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd2e319840c4a8aab90b495374aa1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eba4d14f2004498850092bff100b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:46.530060 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3c0af46e-6b1a-4684-96d1-828367d541b8 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] 10.222.0.13 "GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d" status: 200 len: 1482 microversion: 2.1 time: 0.573330 Oct 30 01:29:46.530763 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1847/3697] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:45 2022] GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d => generated 1482 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:46.553738 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-013ef026-6917-4f77-a361-53b48c298274 req-798401b1-0648-4319-be32-7538f761b9ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99db82dd-3238-4af1-9f90-1dd69cdd836a", "name": "network-vif-plugged", "status": "completed", "tag": "49372d17-c87d-4e36-af57-5d05c8cba1e2"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:29:46.558540 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6b44750f-d4a8-43bb-b5b0-2aacddcade82 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:46.573608 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6b44750f-d4a8-43bb-b5b0-2aacddcade82 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:46.578859 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6b44750f-d4a8-43bb-b5b0-2aacddcade82 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:46.582219 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6b44750f-d4a8-43bb-b5b0-2aacddcade82 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1873 microversion: 2.32 time: 0.457960 Oct 30 01:29:46.584548 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-013ef026-6917-4f77-a361-53b48c298274 req-798401b1-0648-4319-be32-7538f761b9ff service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:46.585640 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-013ef026-6917-4f77-a361-53b48c298274 req-798401b1-0648-4319-be32-7538f761b9ff service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:46.586080 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-013ef026-6917-4f77-a361-53b48c298274 req-798401b1-0648-4319-be32-7538f761b9ff service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:46.589766 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1851/3698] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:29:46 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1873 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:29:46.595173 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0acc24d9-0861-4a90-9d88-5b085f023a1b tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:46.595798 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0acc24d9-0861-4a90-9d88-5b085f023a1b tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 28af596f-f044-4281-8106-4585fbde9a4a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:46.605695 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0acc24d9-0861-4a90-9d88-5b085f023a1b tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:46.613637 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-013ef026-6917-4f77-a361-53b48c298274 req-798401b1-0648-4319-be32-7538f761b9ff service nova] Creating event network-vif-plugged:49372d17-c87d-4e36-af57-5d05c8cba1e2 for instance 99db82dd-3238-4af1-9f90-1dd69cdd836a on n-h1-master-1 Oct 30 01:29:46.614344 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0acc24d9-0861-4a90-9d88-5b085f023a1b tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:46.614782 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0acc24d9-0861-4a90-9d88-5b085f023a1b tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:46.615718 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0acc24d9-0861-4a90-9d88-5b085f023a1b tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:46.616389 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0acc24d9-0861-4a90-9d88-5b085f023a1b tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:46.616991 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0acc24d9-0861-4a90-9d88-5b085f023a1b tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:46.634840 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-013ef026-6917-4f77-a361-53b48c298274 req-798401b1-0648-4319-be32-7538f761b9ff service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087772 Oct 30 01:29:46.635824 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1848/3699] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:29:46.642385 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3dc56b88-610d-4dc9-b058-0563f67002bd tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:46.643104 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3dc56b88-610d-4dc9-b058-0563f67002bd tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d7cd54fb-1c64-4fb8-a97b-4d5c81a48009] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:46.656856 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3dc56b88-610d-4dc9-b058-0563f67002bd tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:46.659503 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3dc56b88-610d-4dc9-b058-0563f67002bd tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:46.661700 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3dc56b88-610d-4dc9-b058-0563f67002bd tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:46.661700 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3dc56b88-610d-4dc9-b058-0563f67002bd tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:46.661700 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3dc56b88-610d-4dc9-b058-0563f67002bd tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:46.673763 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3dc56b88-610d-4dc9-b058-0563f67002bd tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:46.989903 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0acc24d9-0861-4a90-9d88-5b085f023a1b tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:47.002155 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0acc24d9-0861-4a90-9d88-5b085f023a1b tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a" status: 200 len: 1522 microversion: 2.1 time: 0.411222 Oct 30 01:29:47.004247 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1852/3700] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:46 2022] GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a => generated 1522 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:47.005906 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3dc56b88-610d-4dc9-b058-0563f67002bd tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:47.011454 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a3bbc66f-e5f8-445a-aed5-a8d08a0643e9 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:47.012431 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a3bbc66f-e5f8-445a-aed5-a8d08a0643e9 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] [instance: 99db82dd-3238-4af1-9f90-1dd69cdd836a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:47.017759 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3dc56b88-610d-4dc9-b058-0563f67002bd tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009" status: 200 len: 1485 microversion: 2.1 time: 0.378467 Oct 30 01:29:47.020976 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1849/3701] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:46 2022] GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 => generated 1485 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:47.027996 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a3bbc66f-e5f8-445a-aed5-a8d08a0643e9 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:47.028908 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a3bbc66f-e5f8-445a-aed5-a8d08a0643e9 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:47.032351 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a3bbc66f-e5f8-445a-aed5-a8d08a0643e9 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:47.032351 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a3bbc66f-e5f8-445a-aed5-a8d08a0643e9 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:47.032351 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a3bbc66f-e5f8-445a-aed5-a8d08a0643e9 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:47.032351 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a3bbc66f-e5f8-445a-aed5-a8d08a0643e9 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:47.032744 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-78ee1389-6ff4-498a-8cf7-ffe8912eeb45 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:47.032744 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-78ee1389-6ff4-498a-8cf7-ffe8912eeb45 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: ea637c0e-df6b-4c7f-a3ee-1b76fec47311] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:47.057484 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-78ee1389-6ff4-498a-8cf7-ffe8912eeb45 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:47.061107 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-78ee1389-6ff4-498a-8cf7-ffe8912eeb45 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:47.061107 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-78ee1389-6ff4-498a-8cf7-ffe8912eeb45 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:47.061107 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-78ee1389-6ff4-498a-8cf7-ffe8912eeb45 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:47.061107 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-78ee1389-6ff4-498a-8cf7-ffe8912eeb45 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:47.061107 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-78ee1389-6ff4-498a-8cf7-ffe8912eeb45 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:47.633829 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-78ee1389-6ff4-498a-8cf7-ffe8912eeb45 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:47.644963 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-78ee1389-6ff4-498a-8cf7-ffe8912eeb45 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311" status: 200 len: 1502 microversion: 2.1 time: 0.619878 Oct 30 01:29:47.646497 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1850/3702] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:47 2022] GET /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311 => generated 1502 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:29:47.649777 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a3bbc66f-e5f8-445a-aed5-a8d08a0643e9 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea8a24166674250a98268ae52604f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcce1fadf54d089ec4fd751a3cf6ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:47.653964 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-288a115c-05c6-43ea-b400-650525393256 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:29:47.654927 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-288a115c-05c6-43ea-b400-650525393256 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d7cd54fb-1c64-4fb8-a97b-4d5c81a48009] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:47.665720 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a3bbc66f-e5f8-445a-aed5-a8d08a0643e9 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/servers/99db82dd-3238-4af1-9f90-1dd69cdd836a" status: 200 len: 1318 microversion: 2.1 time: 0.656306 Oct 30 01:29:47.665720 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1853/3703] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:47 2022] GET /compute/v2.1/servers/99db82dd-3238-4af1-9f90-1dd69cdd836a => generated 1318 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:47.665974 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-288a115c-05c6-43ea-b400-650525393256 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:47.665974 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-288a115c-05c6-43ea-b400-650525393256 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:47.665974 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-288a115c-05c6-43ea-b400-650525393256 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:47.666643 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-288a115c-05c6-43ea-b400-650525393256 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:47.667583 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-288a115c-05c6-43ea-b400-650525393256 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:47.668338 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-288a115c-05c6-43ea-b400-650525393256 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:47.676815 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-aa036478-b728-4b08-bfa7-54a56d537688 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:47.677458 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-aa036478-b728-4b08-bfa7-54a56d537688 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:47.690566 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aa036478-b728-4b08-bfa7-54a56d537688 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:47.692508 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aa036478-b728-4b08-bfa7-54a56d537688 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:47.693394 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aa036478-b728-4b08-bfa7-54a56d537688 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:47.695492 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aa036478-b728-4b08-bfa7-54a56d537688 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:47.696355 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aa036478-b728-4b08-bfa7-54a56d537688 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:47.697030 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aa036478-b728-4b08-bfa7-54a56d537688 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:47.939103 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-aa036478-b728-4b08-bfa7-54a56d537688 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:47.951195 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-288a115c-05c6-43ea-b400-650525393256 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "POST /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009/action" status: 202 len: 0 microversion: 2.1 time: 0.302218 Oct 30 01:29:47.952443 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1851/3704] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:29:47 2022] POST /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009/action => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:29:47.954990 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-aa036478-b728-4b08-bfa7-54a56d537688 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:47.959130 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b5a3c6cf-6e4b-4ffe-aebb-f3ff6b34350c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:47.960550 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b5a3c6cf-6e4b-4ffe-aebb-f3ff6b34350c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: ea637c0e-df6b-4c7f-a3ee-1b76fec47311] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:47.968905 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b5a3c6cf-6e4b-4ffe-aebb-f3ff6b34350c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:47.969548 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b5a3c6cf-6e4b-4ffe-aebb-f3ff6b34350c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:47.970087 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b5a3c6cf-6e4b-4ffe-aebb-f3ff6b34350c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:47.970873 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-aa036478-b728-4b08-bfa7-54a56d537688 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:47.971042 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b5a3c6cf-6e4b-4ffe-aebb-f3ff6b34350c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:47.971742 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b5a3c6cf-6e4b-4ffe-aebb-f3ff6b34350c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:47.972648 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-aa036478-b728-4b08-bfa7-54a56d537688 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 2825 microversion: 2.32 time: 0.309976 Oct 30 01:29:47.973006 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b5a3c6cf-6e4b-4ffe-aebb-f3ff6b34350c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:47.974801 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1854/3705] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:29:47 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 2825 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:29:47.980241 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8b6e0ccc-a8c2-49da-9d3d-307c733008a1 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:47.981148 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8b6e0ccc-a8c2-49da-9d3d-307c733008a1 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d7cd54fb-1c64-4fb8-a97b-4d5c81a48009] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:47.990719 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b6e0ccc-a8c2-49da-9d3d-307c733008a1 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:47.991406 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b6e0ccc-a8c2-49da-9d3d-307c733008a1 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:47.991653 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b6e0ccc-a8c2-49da-9d3d-307c733008a1 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:47.992433 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b6e0ccc-a8c2-49da-9d3d-307c733008a1 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:47.992893 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b6e0ccc-a8c2-49da-9d3d-307c733008a1 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:47.993319 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b6e0ccc-a8c2-49da-9d3d-307c733008a1 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:48.208055 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b5a3c6cf-6e4b-4ffe-aebb-f3ff6b34350c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:48.218046 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b5a3c6cf-6e4b-4ffe-aebb-f3ff6b34350c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311" status: 200 len: 1502 microversion: 2.1 time: 0.263558 Oct 30 01:29:48.225620 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1852/3706] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:47 2022] GET /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311 => generated 1502 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:48.225778 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8b6e0ccc-a8c2-49da-9d3d-307c733008a1 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:48.225911 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ec86eca1-9ed6-4f4c-9441-8b58b8852935 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:48.226584 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ec86eca1-9ed6-4f4c-9441-8b58b8852935 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:48.233594 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ec86eca1-9ed6-4f4c-9441-8b58b8852935 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:48.234090 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ec86eca1-9ed6-4f4c-9441-8b58b8852935 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:48.234525 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ec86eca1-9ed6-4f4c-9441-8b58b8852935 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:48.235223 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8b6e0ccc-a8c2-49da-9d3d-307c733008a1 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009" status: 200 len: 1493 microversion: 2.1 time: 0.258637 Oct 30 01:29:48.235545 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ec86eca1-9ed6-4f4c-9441-8b58b8852935 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:48.236004 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ec86eca1-9ed6-4f4c-9441-8b58b8852935 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:48.236451 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ec86eca1-9ed6-4f4c-9441-8b58b8852935 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:48.236928 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1855/3707] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:47 2022] GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 => generated 1493 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:48.264701 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3b2c456a-37ad-4b3f-ad16-00e071ae1d5d tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:48.265661 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3b2c456a-37ad-4b3f-ad16-00e071ae1d5d tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 28af596f-f044-4281-8106-4585fbde9a4a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:48.280270 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3b2c456a-37ad-4b3f-ad16-00e071ae1d5d tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:48.280772 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3b2c456a-37ad-4b3f-ad16-00e071ae1d5d tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:48.281212 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3b2c456a-37ad-4b3f-ad16-00e071ae1d5d tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:48.281954 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3b2c456a-37ad-4b3f-ad16-00e071ae1d5d tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:48.282406 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3b2c456a-37ad-4b3f-ad16-00e071ae1d5d tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:48.282826 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3b2c456a-37ad-4b3f-ad16-00e071ae1d5d tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:48.464518 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ec86eca1-9ed6-4f4c-9441-8b58b8852935 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.244083 Oct 30 01:29:48.465950 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1853/3708] 10.222.0.13 () {60 vars in 1316 bytes} [Sun Oct 30 01:29:48 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018/os-interface => generated 1832 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:29:48.471691 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2f67f5ae-5fc6-4d73-a91e-f767ebe73a96 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:48.472325 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2f67f5ae-5fc6-4d73-a91e-f767ebe73a96 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: ea637c0e-df6b-4c7f-a3ee-1b76fec47311] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:48.481258 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f67f5ae-5fc6-4d73-a91e-f767ebe73a96 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:48.481658 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f67f5ae-5fc6-4d73-a91e-f767ebe73a96 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:48.482825 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f67f5ae-5fc6-4d73-a91e-f767ebe73a96 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:48.483693 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f67f5ae-5fc6-4d73-a91e-f767ebe73a96 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:48.484236 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f67f5ae-5fc6-4d73-a91e-f767ebe73a96 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:48.484743 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f67f5ae-5fc6-4d73-a91e-f767ebe73a96 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:48.520147 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2f67f5ae-5fc6-4d73-a91e-f767ebe73a96 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: ea637c0e-df6b-4c7f-a3ee-1b76fec47311] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:29:48.683324 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3b2c456a-37ad-4b3f-ad16-00e071ae1d5d tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:48.692281 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3b2c456a-37ad-4b3f-ad16-00e071ae1d5d tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a" status: 200 len: 1522 microversion: 2.1 time: 0.454086 Oct 30 01:29:48.705814 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1856/3709] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:48 2022] GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a => generated 1522 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:48.713720 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c21420e8-351d-4518-9c8e-bbc51f0193ed tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:48.719263 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c21420e8-351d-4518-9c8e-bbc51f0193ed tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6b3394f28c4f444f8cd8bda6bacc9fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1e9b74043548e48a5bb8fb4d054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:48.720295 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c21420e8-351d-4518-9c8e-bbc51f0193ed tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Searching by: {'deleted': False, 'project_id': '9d1e9b74043548e48a5bb8fb4d054803'} {{(pid=121102) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 30 01:29:48.725686 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:48.727854 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c21420e8-351d-4518-9c8e-bbc51f0193ed tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:48.728523 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c21420e8-351d-4518-9c8e-bbc51f0193ed tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:48.729135 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c21420e8-351d-4518-9c8e-bbc51f0193ed tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:48.730073 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c21420e8-351d-4518-9c8e-bbc51f0193ed tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:48.734461 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c21420e8-351d-4518-9c8e-bbc51f0193ed tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:48.734461 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c21420e8-351d-4518-9c8e-bbc51f0193ed tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:48.775080 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.multi_cell_list [None req-c21420e8-351d-4518-9c8e-bbc51f0193ed tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121102) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 30 01:29:48.819522 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c21420e8-351d-4518-9c8e-bbc51f0193ed tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.111457 Oct 30 01:29:48.820231 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1857/3710] 10.222.0.13 () {58 vars in 1125 bytes} [Sun Oct 30 01:29:48 2022] GET /compute/v2.1/servers => generated 333 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:29:48.828182 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ccd518f0-5ffc-4bb9-8134-6b8788757a0c tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:48.829160 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ccd518f0-5ffc-4bb9-8134-6b8788757a0c tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] [instance: 99db82dd-3238-4af1-9f90-1dd69cdd836a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:48.835803 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ccd518f0-5ffc-4bb9-8134-6b8788757a0c tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:48.836590 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ccd518f0-5ffc-4bb9-8134-6b8788757a0c tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:48.839670 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ccd518f0-5ffc-4bb9-8134-6b8788757a0c tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:48.842736 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ccd518f0-5ffc-4bb9-8134-6b8788757a0c tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:48.842736 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ccd518f0-5ffc-4bb9-8134-6b8788757a0c tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:48.842736 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ccd518f0-5ffc-4bb9-8134-6b8788757a0c tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:48.921834 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2f67f5ae-5fc6-4d73-a91e-f767ebe73a96 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311" status: 204 len: 0 microversion: 2.1 time: 0.453447 Oct 30 01:29:48.922600 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1854/3711] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:29:48 2022] DELETE /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:29:48.928957 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-38683f48-647b-4a30-89de-bdad3caaced7 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:48.943336 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-38683f48-647b-4a30-89de-bdad3caaced7 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6b3394f28c4f444f8cd8bda6bacc9fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1e9b74043548e48a5bb8fb4d054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:48.944374 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-38683f48-647b-4a30-89de-bdad3caaced7 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Searching by: {'deleted': False, 'project_id': '9d1e9b74043548e48a5bb8fb4d054803'} {{(pid=121103) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 30 01:29:48.957711 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38683f48-647b-4a30-89de-bdad3caaced7 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:48.958634 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38683f48-647b-4a30-89de-bdad3caaced7 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:48.960802 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38683f48-647b-4a30-89de-bdad3caaced7 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:48.961852 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38683f48-647b-4a30-89de-bdad3caaced7 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:48.964022 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38683f48-647b-4a30-89de-bdad3caaced7 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:48.964022 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38683f48-647b-4a30-89de-bdad3caaced7 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:49.002367 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.multi_cell_list [None req-38683f48-647b-4a30-89de-bdad3caaced7 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121103) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 30 01:29:49.096385 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-38683f48-647b-4a30-89de-bdad3caaced7 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b3394f28c4f444f8cd8bda6bacc9fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1e9b74043548e48a5bb8fb4d054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:49.104735 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38683f48-647b-4a30-89de-bdad3caaced7 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:49.105271 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38683f48-647b-4a30-89de-bdad3caaced7 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:49.105736 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38683f48-647b-4a30-89de-bdad3caaced7 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:49.180412 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ccd518f0-5ffc-4bb9-8134-6b8788757a0c tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea8a24166674250a98268ae52604f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcce1fadf54d089ec4fd751a3cf6ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:49.190890 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ccd518f0-5ffc-4bb9-8134-6b8788757a0c tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/servers/99db82dd-3238-4af1-9f90-1dd69cdd836a" status: 200 len: 1467 microversion: 2.1 time: 0.369152 Oct 30 01:29:49.215614 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1858/3712] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:48 2022] GET /compute/v2.1/servers/99db82dd-3238-4af1-9f90-1dd69cdd836a => generated 1467 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:49.224179 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-464a3a2a-5465-4006-953b-668f4bf73c27 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:49.226421 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-464a3a2a-5465-4006-953b-668f4bf73c27 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: ea637c0e-df6b-4c7f-a3ee-1b76fec47311] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:49.236649 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-464a3a2a-5465-4006-953b-668f4bf73c27 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:49.237808 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-464a3a2a-5465-4006-953b-668f4bf73c27 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:49.244540 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-464a3a2a-5465-4006-953b-668f4bf73c27 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:49.244540 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-464a3a2a-5465-4006-953b-668f4bf73c27 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:49.244540 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-464a3a2a-5465-4006-953b-668f4bf73c27 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:49.244540 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-464a3a2a-5465-4006-953b-668f4bf73c27 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:49.401794 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-38683f48-647b-4a30-89de-bdad3caaced7 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] 10.222.0.13 "GET /compute/v2.1/servers/detail" status: 200 len: 1696 microversion: 2.1 time: 0.477354 Oct 30 01:29:49.403308 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1855/3713] 10.222.0.13 () {58 vars in 1146 bytes} [Sun Oct 30 01:29:48 2022] GET /compute/v2.1/servers/detail => generated 1696 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:49.409194 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-366d1954-5c11-4878-bc52-eb3db48d1e33 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:49.410181 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-366d1954-5c11-4878-bc52-eb3db48d1e33 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] [instance: e9368bd4-9715-46b3-91bb-cb436f7120f3] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:49.423500 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-366d1954-5c11-4878-bc52-eb3db48d1e33 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:49.427538 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-366d1954-5c11-4878-bc52-eb3db48d1e33 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:49.427538 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-366d1954-5c11-4878-bc52-eb3db48d1e33 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:49.427751 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-366d1954-5c11-4878-bc52-eb3db48d1e33 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:49.428886 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-366d1954-5c11-4878-bc52-eb3db48d1e33 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:49.429327 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-366d1954-5c11-4878-bc52-eb3db48d1e33 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:49.485830 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-464a3a2a-5465-4006-953b-668f4bf73c27 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:49.494678 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-464a3a2a-5465-4006-953b-668f4bf73c27 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311" status: 200 len: 1508 microversion: 2.1 time: 0.276791 Oct 30 01:29:49.495390 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1859/3714] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:49 2022] GET /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311 => generated 1508 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:49.499757 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0010fcb2-7996-4e72-b86c-9dc305b5fae5 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:49.500367 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0010fcb2-7996-4e72-b86c-9dc305b5fae5 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d7cd54fb-1c64-4fb8-a97b-4d5c81a48009] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:49.507072 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0010fcb2-7996-4e72-b86c-9dc305b5fae5 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:49.507627 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0010fcb2-7996-4e72-b86c-9dc305b5fae5 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:49.508074 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0010fcb2-7996-4e72-b86c-9dc305b5fae5 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:49.508837 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0010fcb2-7996-4e72-b86c-9dc305b5fae5 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:49.509293 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0010fcb2-7996-4e72-b86c-9dc305b5fae5 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:49.510277 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0010fcb2-7996-4e72-b86c-9dc305b5fae5 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:49.775507 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-366d1954-5c11-4878-bc52-eb3db48d1e33 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea8a24166674250a98268ae52604f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcce1fadf54d089ec4fd751a3cf6ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:49.784910 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-366d1954-5c11-4878-bc52-eb3db48d1e33 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/servers/e9368bd4-9715-46b3-91bb-cb436f7120f3" status: 200 len: 1467 microversion: 2.1 time: 0.379744 Oct 30 01:29:49.785526 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1856/3715] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:49 2022] GET /compute/v2.1/servers/e9368bd4-9715-46b3-91bb-cb436f7120f3 => generated 1467 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:49.790952 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b111962e-8c86-4883-9dba-347f5f100f39 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:49.799144 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b111962e-8c86-4883-9dba-347f5f100f39 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012321 Oct 30 01:29:49.800243 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1857/3716] 10.222.0.13 () {58 vars in 1137 bytes} [Sun Oct 30 01:29:49 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:29:49.806872 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ceffd46e-c2ea-41b3-8b63-91e692cb990e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:49.806872 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ceffd46e-c2ea-41b3-8b63-91e692cb990e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 28af596f-f044-4281-8106-4585fbde9a4a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:49.815524 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ceffd46e-c2ea-41b3-8b63-91e692cb990e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:49.816269 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ceffd46e-c2ea-41b3-8b63-91e692cb990e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:49.816908 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ceffd46e-c2ea-41b3-8b63-91e692cb990e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:49.817645 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ceffd46e-c2ea-41b3-8b63-91e692cb990e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:49.818104 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ceffd46e-c2ea-41b3-8b63-91e692cb990e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:49.818832 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ceffd46e-c2ea-41b3-8b63-91e692cb990e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:49.841013 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0010fcb2-7996-4e72-b86c-9dc305b5fae5 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:49.849142 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0010fcb2-7996-4e72-b86c-9dc305b5fae5 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009" status: 200 len: 1493 microversion: 2.1 time: 0.352862 Oct 30 01:29:49.850751 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1860/3717] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:49 2022] GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 => generated 1493 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:49.866166 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a081ce7e-edbb-43a6-b469-1c2ad0c25ee0 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-920890287"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:29:49.868669 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a081ce7e-edbb-43a6-b469-1c2ad0c25ee0 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] [instance: e9368bd4-9715-46b3-91bb-cb436f7120f3] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:49.874829 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a081ce7e-edbb-43a6-b469-1c2ad0c25ee0 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:49.875849 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a081ce7e-edbb-43a6-b469-1c2ad0c25ee0 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:49.876181 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a081ce7e-edbb-43a6-b469-1c2ad0c25ee0 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:49.876895 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a081ce7e-edbb-43a6-b469-1c2ad0c25ee0 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:49.878890 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a081ce7e-edbb-43a6-b469-1c2ad0c25ee0 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:49.878890 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a081ce7e-edbb-43a6-b469-1c2ad0c25ee0 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:50.041923 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ceffd46e-c2ea-41b3-8b63-91e692cb990e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:50.050232 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ceffd46e-c2ea-41b3-8b63-91e692cb990e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a" status: 200 len: 1522 microversion: 2.1 time: 0.248843 Oct 30 01:29:50.051129 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1858/3718] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:49 2022] GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:50.174799 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-45a3b92f-bd6d-4d66-a052-1ddb3a37508e tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:50.175047 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-45a3b92f-bd6d-4d66-a052-1ddb3a37508e tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] [instance: 0bddfccb-0dc7-430f-88b6-41e25e23d934] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:50.182180 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45a3b92f-bd6d-4d66-a052-1ddb3a37508e tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:50.182756 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45a3b92f-bd6d-4d66-a052-1ddb3a37508e tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:50.183274 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45a3b92f-bd6d-4d66-a052-1ddb3a37508e tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:50.184326 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45a3b92f-bd6d-4d66-a052-1ddb3a37508e tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:50.184864 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45a3b92f-bd6d-4d66-a052-1ddb3a37508e tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:50.185448 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45a3b92f-bd6d-4d66-a052-1ddb3a37508e tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:50.216454 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-45a3b92f-bd6d-4d66-a052-1ddb3a37508e tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] [instance: 0bddfccb-0dc7-430f-88b6-41e25e23d934] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:29:50.372011 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a081ce7e-edbb-43a6-b469-1c2ad0c25ee0 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "POST /compute/v2.1/servers/e9368bd4-9715-46b3-91bb-cb436f7120f3/action" status: 202 len: 0 microversion: 2.1 time: 0.508437 Oct 30 01:29:50.373558 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1861/3719] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:29:49 2022] POST /compute/v2.1/servers/e9368bd4-9715-46b3-91bb-cb436f7120f3/action => generated 0 bytes in 523 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 30 01:29:50.379863 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:50.382600 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-c1d17dee-baae-4035-95ad-06b3158880d9 req-e0528ea0-689f-4094-a583-64e6f78d9b61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71a745a1-eaaf-4b96-8ed1-05e574cf4018", "tag": "0768b27f-1e71-4099-8b05-caf0bb6c7954"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:29:50.394468 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-c1d17dee-baae-4035-95ad-06b3158880d9 req-e0528ea0-689f-4094-a583-64e6f78d9b61 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:50.398657 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-c1d17dee-baae-4035-95ad-06b3158880d9 req-e0528ea0-689f-4094-a583-64e6f78d9b61 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:50.398657 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-c1d17dee-baae-4035-95ad-06b3158880d9 req-e0528ea0-689f-4094-a583-64e6f78d9b61 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:50.408537 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-c1d17dee-baae-4035-95ad-06b3158880d9 req-e0528ea0-689f-4094-a583-64e6f78d9b61 service nova] Creating event network-changed:0768b27f-1e71-4099-8b05-caf0bb6c7954 for instance 71a745a1-eaaf-4b96-8ed1-05e574cf4018 on n-h2-master-1 Oct 30 01:29:50.415204 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-c1d17dee-baae-4035-95ad-06b3158880d9 req-e0528ea0-689f-4094-a583-64e6f78d9b61 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038959 Oct 30 01:29:50.416109 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1862/3720] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:29:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:29:50.422540 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-397f1b41-0dbe-41b5-81c4-ca6e9c8a877f tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44c73481f0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:50.486089 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-397f1b41-0dbe-41b5-81c4-ca6e9c8a877f tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/89bf1d5a-9053-4405-a355-19a4ae907b0a" status: 200 len: 1452 microversion: 2.1 time: 0.068415 Oct 30 01:29:50.487010 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1863/3721] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:29:50 2022] GET /compute/v2.1/images/89bf1d5a-9053-4405-a355-19a4ae907b0a => generated 1452 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:50.520201 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-139ef5aa-92df-42ce-8d42-422499c38b44 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:50.521175 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-139ef5aa-92df-42ce-8d42-422499c38b44 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: ea637c0e-df6b-4c7f-a3ee-1b76fec47311] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:50.532269 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-139ef5aa-92df-42ce-8d42-422499c38b44 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:50.533203 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-139ef5aa-92df-42ce-8d42-422499c38b44 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:50.533680 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-139ef5aa-92df-42ce-8d42-422499c38b44 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:50.534421 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-139ef5aa-92df-42ce-8d42-422499c38b44 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:50.535073 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-139ef5aa-92df-42ce-8d42-422499c38b44 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:50.535527 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-139ef5aa-92df-42ce-8d42-422499c38b44 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:50.566311 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-45a3b92f-bd6d-4d66-a052-1ddb3a37508e tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0bddfccb-0dc7-430f-88b6-41e25e23d934" status: 204 len: 0 microversion: 2.1 time: 0.395262 Oct 30 01:29:50.566933 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1859/3722] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:29:50 2022] DELETE /compute/v2.1/servers/0bddfccb-0dc7-430f-88b6-41e25e23d934 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:29:50.575690 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2aeda70d-0fce-4672-8068-1d10cb8451ee tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:50.576404 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2aeda70d-0fce-4672-8068-1d10cb8451ee tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] [instance: 0bddfccb-0dc7-430f-88b6-41e25e23d934] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:50.583541 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2aeda70d-0fce-4672-8068-1d10cb8451ee tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:50.586565 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2aeda70d-0fce-4672-8068-1d10cb8451ee tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:50.586565 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2aeda70d-0fce-4672-8068-1d10cb8451ee tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:50.586565 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2aeda70d-0fce-4672-8068-1d10cb8451ee tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:50.586565 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2aeda70d-0fce-4672-8068-1d10cb8451ee tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:50.586971 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2aeda70d-0fce-4672-8068-1d10cb8451ee tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:50.872996 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-139ef5aa-92df-42ce-8d42-422499c38b44 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:50.878456 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2aeda70d-0fce-4672-8068-1d10cb8451ee tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b3394f28c4f444f8cd8bda6bacc9fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1e9b74043548e48a5bb8fb4d054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:50.893270 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2aeda70d-0fce-4672-8068-1d10cb8451ee tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] 10.222.0.13 "GET /compute/v2.1/servers/0bddfccb-0dc7-430f-88b6-41e25e23d934" status: 200 len: 1699 microversion: 2.1 time: 0.321684 Oct 30 01:29:50.894046 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1860/3723] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:50 2022] GET /compute/v2.1/servers/0bddfccb-0dc7-430f-88b6-41e25e23d934 => generated 1699 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:50.905619 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-139ef5aa-92df-42ce-8d42-422499c38b44 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311" status: 200 len: 1508 microversion: 2.1 time: 0.383886 Oct 30 01:29:50.905619 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1864/3724] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:50 2022] GET /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311 => generated 1508 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:29:50.913669 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b20fef34-367c-4471-afd1-7d6bcc15dc86 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:50.914593 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b20fef34-367c-4471-afd1-7d6bcc15dc86 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d7cd54fb-1c64-4fb8-a97b-4d5c81a48009] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:50.921404 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b20fef34-367c-4471-afd1-7d6bcc15dc86 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:50.921927 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b20fef34-367c-4471-afd1-7d6bcc15dc86 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:50.922365 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b20fef34-367c-4471-afd1-7d6bcc15dc86 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:50.923071 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b20fef34-367c-4471-afd1-7d6bcc15dc86 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:50.923633 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b20fef34-367c-4471-afd1-7d6bcc15dc86 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:50.924220 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b20fef34-367c-4471-afd1-7d6bcc15dc86 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:50.952462 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:51.075438 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b0886342-a7d2-422f-95c1-076a38b39533 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:51.076463 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b0886342-a7d2-422f-95c1-076a38b39533 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 28af596f-f044-4281-8106-4585fbde9a4a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:51.088323 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b0886342-a7d2-422f-95c1-076a38b39533 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:51.092081 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b0886342-a7d2-422f-95c1-076a38b39533 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:51.092626 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b0886342-a7d2-422f-95c1-076a38b39533 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:51.093520 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b0886342-a7d2-422f-95c1-076a38b39533 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:51.096360 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b0886342-a7d2-422f-95c1-076a38b39533 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:51.097041 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b0886342-a7d2-422f-95c1-076a38b39533 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:51.278247 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b20fef34-367c-4471-afd1-7d6bcc15dc86 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:51.287933 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b20fef34-367c-4471-afd1-7d6bcc15dc86 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009" status: 200 len: 1493 microversion: 2.1 time: 0.387723 Oct 30 01:29:51.289029 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1865/3725] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:50 2022] GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 => generated 1493 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:51.356608 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b0886342-a7d2-422f-95c1-076a38b39533 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:51.375069 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b0886342-a7d2-422f-95c1-076a38b39533 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a" status: 200 len: 1522 microversion: 2.1 time: 0.304510 Oct 30 01:29:51.382429 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1861/3726] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:51 2022] GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a => generated 1522 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:29:51.502279 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ffddce93-3b54-4ab0-a32d-c48149f3d6fa tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44d02d63a0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:51.577471 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ffddce93-3b54-4ab0-a32d-c48149f3d6fa tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/89bf1d5a-9053-4405-a355-19a4ae907b0a" status: 200 len: 1452 microversion: 2.1 time: 0.079609 Oct 30 01:29:51.578706 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1866/3727] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:29:51 2022] GET /compute/v2.1/images/89bf1d5a-9053-4405-a355-19a4ae907b0a => generated 1452 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:51.918874 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c66b34f6-11ed-4039-98e1-223fff2b5972 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:51.920191 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c66b34f6-11ed-4039-98e1-223fff2b5972 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] [instance: 0bddfccb-0dc7-430f-88b6-41e25e23d934] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:51.927532 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ac607e34-718a-40d4-b5ae-e3bd9fc7ae0e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:51.928797 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ac607e34-718a-40d4-b5ae-e3bd9fc7ae0e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: ea637c0e-df6b-4c7f-a3ee-1b76fec47311] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:51.945814 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c66b34f6-11ed-4039-98e1-223fff2b5972 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:51.946259 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ac607e34-718a-40d4-b5ae-e3bd9fc7ae0e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:51.947477 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ac607e34-718a-40d4-b5ae-e3bd9fc7ae0e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:51.948243 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c66b34f6-11ed-4039-98e1-223fff2b5972 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:51.949687 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ac607e34-718a-40d4-b5ae-e3bd9fc7ae0e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:51.950364 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c66b34f6-11ed-4039-98e1-223fff2b5972 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:51.952306 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c66b34f6-11ed-4039-98e1-223fff2b5972 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:51.952745 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ac607e34-718a-40d4-b5ae-e3bd9fc7ae0e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:51.953492 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ac607e34-718a-40d4-b5ae-e3bd9fc7ae0e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:51.954989 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ac607e34-718a-40d4-b5ae-e3bd9fc7ae0e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:51.955247 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c66b34f6-11ed-4039-98e1-223fff2b5972 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:51.956293 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c66b34f6-11ed-4039-98e1-223fff2b5972 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:52.549272 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c66b34f6-11ed-4039-98e1-223fff2b5972 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b3394f28c4f444f8cd8bda6bacc9fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1e9b74043548e48a5bb8fb4d054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:52.560407 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c66b34f6-11ed-4039-98e1-223fff2b5972 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] 10.222.0.13 "GET /compute/v2.1/servers/0bddfccb-0dc7-430f-88b6-41e25e23d934" status: 200 len: 1699 microversion: 2.1 time: 0.643101 Oct 30 01:29:52.561571 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1862/3728] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:51 2022] GET /compute/v2.1/servers/0bddfccb-0dc7-430f-88b6-41e25e23d934 => generated 1699 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:52.575925 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8b48cb8b-7080-47b6-b7d9-ba132e69b17d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:52.579158 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8b48cb8b-7080-47b6-b7d9-ba132e69b17d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d7cd54fb-1c64-4fb8-a97b-4d5c81a48009] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:52.593133 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8b48cb8b-7080-47b6-b7d9-ba132e69b17d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:52.597836 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8b48cb8b-7080-47b6-b7d9-ba132e69b17d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:52.598361 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8b48cb8b-7080-47b6-b7d9-ba132e69b17d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:52.599283 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8b48cb8b-7080-47b6-b7d9-ba132e69b17d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:52.599774 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8b48cb8b-7080-47b6-b7d9-ba132e69b17d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:52.600218 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8b48cb8b-7080-47b6-b7d9-ba132e69b17d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:52.663234 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ac607e34-718a-40d4-b5ae-e3bd9fc7ae0e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:52.676574 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ac607e34-718a-40d4-b5ae-e3bd9fc7ae0e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311" status: 200 len: 1508 microversion: 2.1 time: 0.750799 Oct 30 01:29:52.681909 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1867/3729] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:51 2022] GET /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311 => generated 1508 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:29:52.698772 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a25cc69a-4b19-4d04-8b50-aae838176f51 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:52.699923 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a25cc69a-4b19-4d04-8b50-aae838176f51 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 28af596f-f044-4281-8106-4585fbde9a4a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:52.707502 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a25cc69a-4b19-4d04-8b50-aae838176f51 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:52.708158 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a25cc69a-4b19-4d04-8b50-aae838176f51 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:52.708757 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a25cc69a-4b19-4d04-8b50-aae838176f51 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:52.709619 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a25cc69a-4b19-4d04-8b50-aae838176f51 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:52.710401 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a25cc69a-4b19-4d04-8b50-aae838176f51 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:52.710904 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a25cc69a-4b19-4d04-8b50-aae838176f51 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:52.900190 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8b48cb8b-7080-47b6-b7d9-ba132e69b17d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:52.914762 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8b48cb8b-7080-47b6-b7d9-ba132e69b17d tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009" status: 200 len: 1493 microversion: 2.1 time: 0.351639 Oct 30 01:29:52.915354 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1863/3730] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:52 2022] GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 => generated 1493 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:52.920121 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e40833bb-f234-411d-b9ff-3395aa787252 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44c738d820>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:52.945297 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a25cc69a-4b19-4d04-8b50-aae838176f51 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:52.954843 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a25cc69a-4b19-4d04-8b50-aae838176f51 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a" status: 200 len: 1502 microversion: 2.1 time: 0.271250 Oct 30 01:29:52.955430 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1868/3731] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:52 2022] GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a => generated 1502 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:52.963174 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-28069c0a-6177-4957-bf76-a85e14ab0be2 req-d2d771b9-47a3-4664-b587-ee49c6555dc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea637c0e-df6b-4c7f-a3ee-1b76fec47311", "name": "network-vif-deleted", "tag": "71e2929f-b3fa-4fe5-92a5-faa55fb3fe8e"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:29:52.982978 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-28069c0a-6177-4957-bf76-a85e14ab0be2 req-d2d771b9-47a3-4664-b587-ee49c6555dc9 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:52.983713 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-28069c0a-6177-4957-bf76-a85e14ab0be2 req-d2d771b9-47a3-4664-b587-ee49c6555dc9 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:52.984259 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-28069c0a-6177-4957-bf76-a85e14ab0be2 req-d2d771b9-47a3-4664-b587-ee49c6555dc9 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:52.994483 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e40833bb-f234-411d-b9ff-3395aa787252 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/89bf1d5a-9053-4405-a355-19a4ae907b0a" status: 200 len: 1452 microversion: 2.1 time: 0.077880 Oct 30 01:29:52.995069 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1864/3732] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:29:52 2022] GET /compute/v2.1/images/89bf1d5a-9053-4405-a355-19a4ae907b0a => generated 1452 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:53.000463 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1d3a0b91-a754-46fd-9181-e9fe8c3e94d2 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "adf598b7-d9e5-4227-baef-be8f63d52572"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:29:53.002914 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1d3a0b91-a754-46fd-9181-e9fe8c3e94d2 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 28af596f-f044-4281-8106-4585fbde9a4a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:53.004811 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-28069c0a-6177-4957-bf76-a85e14ab0be2 req-d2d771b9-47a3-4664-b587-ee49c6555dc9 service nova] Creating event network-vif-deleted:71e2929f-b3fa-4fe5-92a5-faa55fb3fe8e for instance ea637c0e-df6b-4c7f-a3ee-1b76fec47311 on n-h2-master-1 Oct 30 01:29:53.011520 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1d3a0b91-a754-46fd-9181-e9fe8c3e94d2 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:53.012364 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-28069c0a-6177-4957-bf76-a85e14ab0be2 req-d2d771b9-47a3-4664-b587-ee49c6555dc9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054560 Oct 30 01:29:53.012519 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1d3a0b91-a754-46fd-9181-e9fe8c3e94d2 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:53.012806 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1d3a0b91-a754-46fd-9181-e9fe8c3e94d2 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:53.013305 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1869/3733] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:29:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:29:53.013647 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1d3a0b91-a754-46fd-9181-e9fe8c3e94d2 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:53.014110 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1d3a0b91-a754-46fd-9181-e9fe8c3e94d2 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:53.014582 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1d3a0b91-a754-46fd-9181-e9fe8c3e94d2 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:53.044189 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-1d3a0b91-a754-46fd-9181-e9fe8c3e94d2 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] HTTP exception thrown: Cannot 'attach_volume' instance 28af596f-f044-4281-8106-4585fbde9a4a while it is in vm_state rescued Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1d3a0b91-a754-46fd-9181-e9fe8c3e94d2 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Request method failure captured: Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: request: POST /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a/os-volume_attachments HTTP/1.1 Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 74 Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdMpBfA6mq8oavinMeTyaurexihmj6JmnnP2ZZndb1MXJnyLYJP1lh9IAGUFmytWgjEkCc6rHAh1wpEFldWPgYBauossNbR0UQldGfx9XACde0J5etDs6i2phO_G-HCGpqKWqFyqD3FJkTb44yZ7CHZV6U0ZtcSE1Hf7lvcXbJ_Lvp0 Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 470e235fb35840828d9a86028b72f5de Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-909936776 Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/470e235fb35840828d9a86028b72f5de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_470e235fb35840828d9a86028b72f5de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/470e235fb35840828d9a86028b72f5de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/470e235fb35840828d9a86028b72f5de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServerRescueNegativeTestJSON-909936776 Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 470e235fb35840828d9a86028b72f5de Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-909936776 Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServerRescueNegativeTestJSON-909936776-project Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 6134c05549f14bc19962acea9c913f53 Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServerRescueNegativeTestJSON-909936776-project Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: {"volumeAttachment": {"volumeId": "adf598b7-d9e5-4227-baef-be8f63d52572"}} Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: exception: Cannot 'attach_volume' instance 28af596f-f044-4281-8106-4585fbde9a4a while it is in vm_state rescued Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: action_args: {'server_id': '28af596f-f044-4281-8106-4585fbde9a4a', 'body': {'volumeAttachment': {'volumeId': 'adf598b7-d9e5-4227-baef-be8f63d52572'}}} Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 28af596f-f044-4281-8106-4585fbde9a4a in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 30 01:29:53.048398 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 30 01:29:53.054781 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 30 01:29:53.054781 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 30 01:29:53.054781 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 28af596f-f044-4281-8106-4585fbde9a4a while it is in vm_state rescued Oct 30 01:29:53.054781 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:29:53.054781 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:29:53.054781 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:29:53.054781 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:53.054781 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:29:53.054781 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:29:53.054781 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:29:53.054781 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:29:53.054781 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 28af596f-f044-4281-8106-4585fbde9a4a while it is in vm_state rescued Oct 30 01:29:53.054781 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:29:53.054781 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1d3a0b91-a754-46fd-9181-e9fe8c3e94d2 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Returning 409 to user: Cannot 'attach_volume' instance 28af596f-f044-4281-8106-4585fbde9a4a while it is in vm_state rescued {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:29:53.054781 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1d3a0b91-a754-46fd-9181-e9fe8c3e94d2 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "POST /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.051442 Oct 30 01:29:53.054781 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1865/3734] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 30 01:29:52 2022] POST /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a/os-volume_attachments => generated 152 bytes in 52 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:29:53.058976 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1400e460-ba13-4da7-9bc6-c50438daf85f tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:29:53.059612 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1400e460-ba13-4da7-9bc6-c50438daf85f tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 28af596f-f044-4281-8106-4585fbde9a4a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:53.066597 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1400e460-ba13-4da7-9bc6-c50438daf85f tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:53.067088 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1400e460-ba13-4da7-9bc6-c50438daf85f tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:53.067519 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1400e460-ba13-4da7-9bc6-c50438daf85f tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:53.068919 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1400e460-ba13-4da7-9bc6-c50438daf85f tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:53.069396 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1400e460-ba13-4da7-9bc6-c50438daf85f tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:53.069819 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1400e460-ba13-4da7-9bc6-c50438daf85f tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:53.278268 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1400e460-ba13-4da7-9bc6-c50438daf85f tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "POST /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a/action" status: 202 len: 0 microversion: 2.1 time: 0.224064 Oct 30 01:29:53.279661 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1870/3735] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:29:53 2022] POST /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:29:53.292031 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9fdcbec4-76a3-4000-b314-cf23093b6e1e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:53.292654 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9fdcbec4-76a3-4000-b314-cf23093b6e1e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 28af596f-f044-4281-8106-4585fbde9a4a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:53.300073 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9fdcbec4-76a3-4000-b314-cf23093b6e1e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:53.300829 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9fdcbec4-76a3-4000-b314-cf23093b6e1e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:53.301271 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9fdcbec4-76a3-4000-b314-cf23093b6e1e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:53.302071 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9fdcbec4-76a3-4000-b314-cf23093b6e1e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:53.302531 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9fdcbec4-76a3-4000-b314-cf23093b6e1e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:53.302963 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9fdcbec4-76a3-4000-b314-cf23093b6e1e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:53.480043 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9fdcbec4-76a3-4000-b314-cf23093b6e1e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:53.490857 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9fdcbec4-76a3-4000-b314-cf23093b6e1e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a" status: 200 len: 1510 microversion: 2.1 time: 0.202699 Oct 30 01:29:53.506340 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1866/3736] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:53 2022] GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a => generated 1510 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:53.585740 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e8de54fd-4493-4eb0-ac0a-6131264fa7be tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:53.586806 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e8de54fd-4493-4eb0-ac0a-6131264fa7be tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] [instance: 0bddfccb-0dc7-430f-88b6-41e25e23d934] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:53.593928 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e8de54fd-4493-4eb0-ac0a-6131264fa7be tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:53.594499 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e8de54fd-4493-4eb0-ac0a-6131264fa7be tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:53.595821 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e8de54fd-4493-4eb0-ac0a-6131264fa7be tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:53.596784 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e8de54fd-4493-4eb0-ac0a-6131264fa7be tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:53.597312 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e8de54fd-4493-4eb0-ac0a-6131264fa7be tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:53.597835 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e8de54fd-4493-4eb0-ac0a-6131264fa7be tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:53.701273 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-30db7311-1a84-42bf-9024-b07e1ac61dc0 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:53.701918 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-30db7311-1a84-42bf-9024-b07e1ac61dc0 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: ea637c0e-df6b-4c7f-a3ee-1b76fec47311] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:53.708335 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-30db7311-1a84-42bf-9024-b07e1ac61dc0 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:53.709043 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-30db7311-1a84-42bf-9024-b07e1ac61dc0 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:53.709511 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-30db7311-1a84-42bf-9024-b07e1ac61dc0 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:53.710621 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-30db7311-1a84-42bf-9024-b07e1ac61dc0 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:53.711234 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-30db7311-1a84-42bf-9024-b07e1ac61dc0 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:53.711987 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-30db7311-1a84-42bf-9024-b07e1ac61dc0 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:53.751031 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e8de54fd-4493-4eb0-ac0a-6131264fa7be tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b3394f28c4f444f8cd8bda6bacc9fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1e9b74043548e48a5bb8fb4d054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:53.754785 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-30db7311-1a84-42bf-9024-b07e1ac61dc0 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:53.756341 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-30db7311-1a84-42bf-9024-b07e1ac61dc0 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:53.756952 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-30db7311-1a84-42bf-9024-b07e1ac61dc0 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:53.757748 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-30db7311-1a84-42bf-9024-b07e1ac61dc0 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lazy-loading 'fault' on Instance uuid ea637c0e-df6b-4c7f-a3ee-1b76fec47311 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:29:53.760353 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e8de54fd-4493-4eb0-ac0a-6131264fa7be tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] 10.222.0.13 "GET /compute/v2.1/servers/0bddfccb-0dc7-430f-88b6-41e25e23d934" status: 200 len: 1699 microversion: 2.1 time: 0.179257 Oct 30 01:29:53.761066 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1871/3737] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:53 2022] GET /compute/v2.1/servers/0bddfccb-0dc7-430f-88b6-41e25e23d934 => generated 1699 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:53.811925 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-30db7311-1a84-42bf-9024-b07e1ac61dc0 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:53.819883 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-30db7311-1a84-42bf-9024-b07e1ac61dc0 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311" status: 200 len: 1310 microversion: 2.1 time: 0.122456 Oct 30 01:29:53.820500 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1867/3738] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:53 2022] GET /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311 => generated 1310 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:29:53.939786 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9857ba11-5a2d-4eb7-acd7-b5f795d74928 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:53.940411 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9857ba11-5a2d-4eb7-acd7-b5f795d74928 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d7cd54fb-1c64-4fb8-a97b-4d5c81a48009] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:53.947667 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9857ba11-5a2d-4eb7-acd7-b5f795d74928 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:53.948167 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9857ba11-5a2d-4eb7-acd7-b5f795d74928 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:53.949004 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9857ba11-5a2d-4eb7-acd7-b5f795d74928 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:53.950059 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9857ba11-5a2d-4eb7-acd7-b5f795d74928 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:53.950751 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9857ba11-5a2d-4eb7-acd7-b5f795d74928 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:53.951350 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9857ba11-5a2d-4eb7-acd7-b5f795d74928 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:54.010993 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a6f1b16b-b06f-4377-9524-4e862ebc3ed0 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44c7bac040>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:54.070114 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a6f1b16b-b06f-4377-9524-4e862ebc3ed0 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/89bf1d5a-9053-4405-a355-19a4ae907b0a" status: 200 len: 1452 microversion: 2.1 time: 0.063171 Oct 30 01:29:54.076053 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1868/3739] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:29:54 2022] GET /compute/v2.1/images/89bf1d5a-9053-4405-a355-19a4ae907b0a => generated 1452 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:54.215700 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9857ba11-5a2d-4eb7-acd7-b5f795d74928 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:54.225412 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9857ba11-5a2d-4eb7-acd7-b5f795d74928 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009" status: 200 len: 1499 microversion: 2.1 time: 0.289652 Oct 30 01:29:54.225993 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1872/3740] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:53 2022] GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 => generated 1499 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:54.255457 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d54858d5-f197-4294-a6fc-8313e7223251 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:54.256114 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d54858d5-f197-4294-a6fc-8313e7223251 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d7cd54fb-1c64-4fb8-a97b-4d5c81a48009] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:54.263684 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d54858d5-f197-4294-a6fc-8313e7223251 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:54.264255 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d54858d5-f197-4294-a6fc-8313e7223251 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:54.264757 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d54858d5-f197-4294-a6fc-8313e7223251 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:54.265568 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d54858d5-f197-4294-a6fc-8313e7223251 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:54.266100 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d54858d5-f197-4294-a6fc-8313e7223251 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:54.266591 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d54858d5-f197-4294-a6fc-8313e7223251 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:54.295244 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d54858d5-f197-4294-a6fc-8313e7223251 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d7cd54fb-1c64-4fb8-a97b-4d5c81a48009] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:29:54.502581 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:54.516177 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ccada06c-7cf3-453f-a60a-fd2951605a85 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:54.516793 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ccada06c-7cf3-453f-a60a-fd2951605a85 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 28af596f-f044-4281-8106-4585fbde9a4a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:54.525435 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ccada06c-7cf3-453f-a60a-fd2951605a85 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:54.526049 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ccada06c-7cf3-453f-a60a-fd2951605a85 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:54.526747 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ccada06c-7cf3-453f-a60a-fd2951605a85 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:54.527470 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ccada06c-7cf3-453f-a60a-fd2951605a85 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:54.527925 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ccada06c-7cf3-453f-a60a-fd2951605a85 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:54.528538 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ccada06c-7cf3-453f-a60a-fd2951605a85 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:54.588123 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d54858d5-f197-4294-a6fc-8313e7223251 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009" status: 204 len: 0 microversion: 2.1 time: 0.336848 Oct 30 01:29:54.589224 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1869/3741] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:29:54 2022] DELETE /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:29:54.599320 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ceb8ecaa-292f-4eb5-928a-6399d1ad5890 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:54.606870 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ceb8ecaa-292f-4eb5-928a-6399d1ad5890 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d7cd54fb-1c64-4fb8-a97b-4d5c81a48009] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:54.614579 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ceb8ecaa-292f-4eb5-928a-6399d1ad5890 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:54.615387 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ceb8ecaa-292f-4eb5-928a-6399d1ad5890 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:54.616058 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ceb8ecaa-292f-4eb5-928a-6399d1ad5890 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:54.617647 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ceb8ecaa-292f-4eb5-928a-6399d1ad5890 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:54.618344 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ceb8ecaa-292f-4eb5-928a-6399d1ad5890 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:54.619094 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ceb8ecaa-292f-4eb5-928a-6399d1ad5890 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:54.755930 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ccada06c-7cf3-453f-a60a-fd2951605a85 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:54.771585 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ccada06c-7cf3-453f-a60a-fd2951605a85 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a" status: 200 len: 1510 microversion: 2.1 time: 0.259256 Oct 30 01:29:54.786511 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1873/3742] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:54 2022] GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a => generated 1510 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:54.794454 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-3a6e9dde-12a5-4e93-9cf6-a20b454dc443 req-b28926bc-67c9-4cf5-9675-264d57398768 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bddfccb-0dc7-430f-88b6-41e25e23d934", "name": "network-vif-deleted", "tag": "de69109c-8655-473d-928d-a038a1218ac8"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:29:54.805475 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-3a6e9dde-12a5-4e93-9cf6-a20b454dc443 req-b28926bc-67c9-4cf5-9675-264d57398768 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:54.806334 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-3a6e9dde-12a5-4e93-9cf6-a20b454dc443 req-b28926bc-67c9-4cf5-9675-264d57398768 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:54.806970 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-3a6e9dde-12a5-4e93-9cf6-a20b454dc443 req-b28926bc-67c9-4cf5-9675-264d57398768 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:54.821049 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-3a6e9dde-12a5-4e93-9cf6-a20b454dc443 req-b28926bc-67c9-4cf5-9675-264d57398768 service nova] Creating event network-vif-deleted:de69109c-8655-473d-928d-a038a1218ac8 for instance 0bddfccb-0dc7-430f-88b6-41e25e23d934 on n-h1-master-1 Oct 30 01:29:54.827813 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-3a6e9dde-12a5-4e93-9cf6-a20b454dc443 req-b28926bc-67c9-4cf5-9675-264d57398768 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039443 Oct 30 01:29:54.828998 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1874/3743] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:29:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:29:54.838602 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c9344f7c-9b59-4305-850e-3f1080932ff5 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:54.839699 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c9344f7c-9b59-4305-850e-3f1080932ff5 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] [instance: 0bddfccb-0dc7-430f-88b6-41e25e23d934] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:54.847469 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c9344f7c-9b59-4305-850e-3f1080932ff5 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:54.847961 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c9344f7c-9b59-4305-850e-3f1080932ff5 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:54.848589 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c9344f7c-9b59-4305-850e-3f1080932ff5 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:54.849579 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c9344f7c-9b59-4305-850e-3f1080932ff5 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:54.850038 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c9344f7c-9b59-4305-850e-3f1080932ff5 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:54.853317 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ceb8ecaa-292f-4eb5-928a-6399d1ad5890 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:54.856808 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c9344f7c-9b59-4305-850e-3f1080932ff5 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:54.861178 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ceb8ecaa-292f-4eb5-928a-6399d1ad5890 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009" status: 200 len: 1505 microversion: 2.1 time: 0.266047 Oct 30 01:29:54.866684 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1870/3744] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:54 2022] GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 => generated 1505 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:54.873246 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bef2bca0-e92e-4e95-bcc9-96e8e6724c3a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:54.878356 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-bef2bca0-e92e-4e95-bcc9-96e8e6724c3a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: ea637c0e-df6b-4c7f-a3ee-1b76fec47311] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:54.894122 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bef2bca0-e92e-4e95-bcc9-96e8e6724c3a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:54.896195 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bef2bca0-e92e-4e95-bcc9-96e8e6724c3a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:54.896812 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bef2bca0-e92e-4e95-bcc9-96e8e6724c3a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:54.897795 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bef2bca0-e92e-4e95-bcc9-96e8e6724c3a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:54.899744 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bef2bca0-e92e-4e95-bcc9-96e8e6724c3a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:54.900381 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bef2bca0-e92e-4e95-bcc9-96e8e6724c3a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:54.927763 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-bef2bca0-e92e-4e95-bcc9-96e8e6724c3a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] HTTP exception thrown: Instance ea637c0e-df6b-4c7f-a3ee-1b76fec47311 could not be found. Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bef2bca0-e92e-4e95-bcc9-96e8e6724c3a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Request method failure captured: Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311 HTTP/1.1 Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdNZbeUR7skwu5ylmljymLwmsn3OMAB7HFdlDZsip3dgOK-vaOPPSwUYmWT_o9z2OqWc9cL2Rd22cHSa-BN8vqcvBTHGvFnuVH3dT1kVAQG6ODQVt2oxoFKeXYoNTjg1JUCF1B7Vzk2gVPeSesCiSDD37BDZ3_Wp6AgzZI4w4KMCOXw Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 45fe1c50eaee40249b6c20cc91e52586 Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersTestJSON-1478392549 Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersTestJSON-1478392549 Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 45fe1c50eaee40249b6c20cc91e52586 Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersTestJSON-1478392549 Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersTestJSON-1478392549-project Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: ef5f8a3e6fef4d6393603575479b16a2 Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersTestJSON-1478392549-project Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: exception: Instance ea637c0e-df6b-4c7f-a3ee-1b76fec47311 could not be found. Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'ea637c0e-df6b-4c7f-a3ee-1b76fec47311'} Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea637c0e-df6b-4c7f-a3ee-1b76fec47311 could not be found. Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea637c0e-df6b-4c7f-a3ee-1b76fec47311 could not be found. Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:29:54.929679 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:29:54.937939 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:29:54.937939 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:29:54.937939 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:29:54.937939 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:29:54.937939 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:29:54.937939 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea637c0e-df6b-4c7f-a3ee-1b76fec47311 could not be found. Oct 30 01:29:54.937939 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:29:54.937939 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bef2bca0-e92e-4e95-bcc9-96e8e6724c3a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Returning 404 to user: Instance ea637c0e-df6b-4c7f-a3ee-1b76fec47311 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:29:54.937939 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bef2bca0-e92e-4e95-bcc9-96e8e6724c3a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311" status: 404 len: 111 microversion: 2.1 time: 0.063430 Oct 30 01:29:54.937939 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1871/3745] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:54 2022] GET /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:29:54.953162 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ba999e38-d637-4ef5-8825-90c3b5ca358b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Action: 'create', calling method: .version_select at 0x7f44d03b4940>, body: {"keypair": {"name": "tempest-key-977573330", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4AP6QVBOXtFCPbhwKDMPLXBvLXzagSYR6IBduZscP0+z2W4ScG2At7gAUHJpakxvAN4ySKrxtqx4lqKozdCx9mSLmRUiiZ4zhKw8icY/sf/nCkNjaiCVJBIYVddCak0w=="}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:29:54.976854 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c9344f7c-9b59-4305-850e-3f1080932ff5 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b3394f28c4f444f8cd8bda6bacc9fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1e9b74043548e48a5bb8fb4d054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:54.977612 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-ba999e38-d637-4ef5-8825-90c3b5ca358b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Getting quotas for project 45fe1c50eaee40249b6c20cc91e52586. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:29:54.984499 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-ba999e38-d637-4ef5-8825-90c3b5ca358b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Getting quotas for user ef5f8a3e6fef4d6393603575479b16a2 and project 45fe1c50eaee40249b6c20cc91e52586. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:29:54.985609 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c9344f7c-9b59-4305-850e-3f1080932ff5 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] 10.222.0.13 "GET /compute/v2.1/servers/0bddfccb-0dc7-430f-88b6-41e25e23d934" status: 200 len: 1631 microversion: 2.1 time: 0.155073 Oct 30 01:29:55.004054 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1875/3746] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:54 2022] GET /compute/v2.1/servers/0bddfccb-0dc7-430f-88b6-41e25e23d934 => generated 1631 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:55.074978 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ba999e38-d637-4ef5-8825-90c3b5ca358b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.128534 Oct 30 01:29:55.075593 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1872/3747] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 30 01:29:54 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:29:55.086138 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3f21c8ef-d0d9-47d2-8fa4-c5b37a863461 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44c738f9d0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:55.086348 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b50cdf1c-0e5f-477a-87a6-044ed5c38f46 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '.version_select at 0x7f44d03de940>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:55.090459 n-d-master-1 devstack@n-api.service[121102]: WARNING oslo_db.sqlalchemy.utils [None req-b50cdf1c-0e5f-477a-87a6-044ed5c38f46 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 30 01:29:55.096245 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b50cdf1c-0e5f-477a-87a6-044ed5c38f46 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.013743 Oct 30 01:29:55.096816 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1876/3748] 10.222.0.13 () {58 vars in 1137 bytes} [Sun Oct 30 01:29:55 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:29:55.136242 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3f21c8ef-d0d9-47d2-8fa4-c5b37a863461 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/89bf1d5a-9053-4405-a355-19a4ae907b0a" status: 200 len: 1452 microversion: 2.1 time: 0.053984 Oct 30 01:29:55.136828 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1873/3749] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:29:55 2022] GET /compute/v2.1/images/89bf1d5a-9053-4405-a355-19a4ae907b0a => generated 1452 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:55.213541 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fa6c0eeb-8c6b-4339-a9c3-93f86864d8ac tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-489765784", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "key_name": "tempest-key-977573330", "networks": [{"uuid": "936faadb-2266-486c-9624-31976f3a3668"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:29:55.272156 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-fa6c0eeb-8c6b-4339-a9c3-93f86864d8ac tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] validate_networks() for [('936faadb-2266-486c-9624-31976f3a3668', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:29:55.699885 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-fa6c0eeb-8c6b-4339-a9c3-93f86864d8ac tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:29:55.700308 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-fa6c0eeb-8c6b-4339-a9c3-93f86864d8ac tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:29:55.700782 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-fa6c0eeb-8c6b-4339-a9c3-93f86864d8ac tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:29:55.701192 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-fa6c0eeb-8c6b-4339-a9c3-93f86864d8ac tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:29:55.701920 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-fa6c0eeb-8c6b-4339-a9c3-93f86864d8ac tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:29:55.711825 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fa6c0eeb-8c6b-4339-a9c3-93f86864d8ac tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:55.714485 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fa6c0eeb-8c6b-4339-a9c3-93f86864d8ac tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:55.714485 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fa6c0eeb-8c6b-4339-a9c3-93f86864d8ac tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:55.714485 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fa6c0eeb-8c6b-4339-a9c3-93f86864d8ac tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:55.714485 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fa6c0eeb-8c6b-4339-a9c3-93f86864d8ac tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:55.714485 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fa6c0eeb-8c6b-4339-a9c3-93f86864d8ac tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:55.734795 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-fa6c0eeb-8c6b-4339-a9c3-93f86864d8ac tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Getting quotas for project 45fe1c50eaee40249b6c20cc91e52586. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:29:55.741549 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-fa6c0eeb-8c6b-4339-a9c3-93f86864d8ac tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Getting quotas for user ef5f8a3e6fef4d6393603575479b16a2 and project 45fe1c50eaee40249b6c20cc91e52586. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:29:55.754156 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fa6c0eeb-8c6b-4339-a9c3-93f86864d8ac tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:29:55.756597 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fa6c0eeb-8c6b-4339-a9c3-93f86864d8ac tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 06199cbd-cf2c-426d-a842-4dedd8359945] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:29:55.800597 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0f8f3c92-12dd-4907-983a-078a0011a209 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:55.801135 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0f8f3c92-12dd-4907-983a-078a0011a209 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 28af596f-f044-4281-8106-4585fbde9a4a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:55.808342 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0f8f3c92-12dd-4907-983a-078a0011a209 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:55.810908 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0f8f3c92-12dd-4907-983a-078a0011a209 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:55.810908 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0f8f3c92-12dd-4907-983a-078a0011a209 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:55.810908 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0f8f3c92-12dd-4907-983a-078a0011a209 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:55.810908 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0f8f3c92-12dd-4907-983a-078a0011a209 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:55.811734 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0f8f3c92-12dd-4907-983a-078a0011a209 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:55.888876 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fa6c0eeb-8c6b-4339-a9c3-93f86864d8ac tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.679356 Oct 30 01:29:55.890177 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1877/3750] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:29:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:29:55.897490 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1476dbc9-9fbd-439d-bd93-d3700b284db5 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:55.898115 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1476dbc9-9fbd-439d-bd93-d3700b284db5 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d7cd54fb-1c64-4fb8-a97b-4d5c81a48009] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:55.906914 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1476dbc9-9fbd-439d-bd93-d3700b284db5 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:55.907657 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1476dbc9-9fbd-439d-bd93-d3700b284db5 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:55.908274 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1476dbc9-9fbd-439d-bd93-d3700b284db5 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:55.908990 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1476dbc9-9fbd-439d-bd93-d3700b284db5 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:55.909476 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1476dbc9-9fbd-439d-bd93-d3700b284db5 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:55.910022 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1476dbc9-9fbd-439d-bd93-d3700b284db5 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:55.995183 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0f8f3c92-12dd-4907-983a-078a0011a209 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:56.011687 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0f8f3c92-12dd-4907-983a-078a0011a209 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a" status: 200 len: 1510 microversion: 2.1 time: 0.215952 Oct 30 01:29:56.014897 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1874/3751] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:55 2022] GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a => generated 1510 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:29:56.021277 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d246ba50-3945-4790-8942-86167be05420 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:56.028145 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d246ba50-3945-4790-8942-86167be05420 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 06199cbd-cf2c-426d-a842-4dedd8359945] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:56.114959 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d246ba50-3945-4790-8942-86167be05420 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:56.131427 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d246ba50-3945-4790-8942-86167be05420 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/06199cbd-cf2c-426d-a842-4dedd8359945" status: 200 len: 1227 microversion: 2.1 time: 0.109395 Oct 30 01:29:56.131427 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1875/3752] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:56 2022] GET /compute/v2.1/servers/06199cbd-cf2c-426d-a842-4dedd8359945 => generated 1227 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:56.139467 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-71c0f93c-e868-4c7e-bf7c-682fa4e78314 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:56.139992 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-71c0f93c-e868-4c7e-bf7c-682fa4e78314 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] [instance: 0bddfccb-0dc7-430f-88b6-41e25e23d934] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:56.150800 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-71c0f93c-e868-4c7e-bf7c-682fa4e78314 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:56.151572 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-71c0f93c-e868-4c7e-bf7c-682fa4e78314 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:56.152047 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-71c0f93c-e868-4c7e-bf7c-682fa4e78314 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:56.152909 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-71c0f93c-e868-4c7e-bf7c-682fa4e78314 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:56.153418 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-71c0f93c-e868-4c7e-bf7c-682fa4e78314 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:56.153853 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-71c0f93c-e868-4c7e-bf7c-682fa4e78314 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:56.216500 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1476dbc9-9fbd-439d-bd93-d3700b284db5 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:56.225624 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1476dbc9-9fbd-439d-bd93-d3700b284db5 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009" status: 200 len: 1505 microversion: 2.1 time: 0.334211 Oct 30 01:29:56.226245 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1878/3753] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:55 2022] GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 => generated 1505 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:56.230703 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-df1f5bb3-09b7-45a1-bec8-aeb85a33f62f tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44d02cd430>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:56.237258 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-71c0f93c-e868-4c7e-bf7c-682fa4e78314 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b3394f28c4f444f8cd8bda6bacc9fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1e9b74043548e48a5bb8fb4d054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:56.248805 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-71c0f93c-e868-4c7e-bf7c-682fa4e78314 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] 10.222.0.13 "GET /compute/v2.1/servers/0bddfccb-0dc7-430f-88b6-41e25e23d934" status: 200 len: 1631 microversion: 2.1 time: 0.120100 Oct 30 01:29:56.249849 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1876/3754] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:56 2022] GET /compute/v2.1/servers/0bddfccb-0dc7-430f-88b6-41e25e23d934 => generated 1631 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:56.287694 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-df1f5bb3-09b7-45a1-bec8-aeb85a33f62f tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/89bf1d5a-9053-4405-a355-19a4ae907b0a" status: 200 len: 1452 microversion: 2.1 time: 0.060412 Oct 30 01:29:56.288366 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1879/3755] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:29:56 2022] GET /compute/v2.1/images/89bf1d5a-9053-4405-a355-19a4ae907b0a => generated 1452 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:57.040274 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-568590a7-9025-4445-b345-2f5a46b10f9c tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:57.044257 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-568590a7-9025-4445-b345-2f5a46b10f9c tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 28af596f-f044-4281-8106-4585fbde9a4a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:57.056883 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-568590a7-9025-4445-b345-2f5a46b10f9c tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:57.058205 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-568590a7-9025-4445-b345-2f5a46b10f9c tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:57.059238 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-568590a7-9025-4445-b345-2f5a46b10f9c tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:57.060063 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-568590a7-9025-4445-b345-2f5a46b10f9c tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:57.060519 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-568590a7-9025-4445-b345-2f5a46b10f9c tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:57.061004 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-568590a7-9025-4445-b345-2f5a46b10f9c tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:57.151349 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c5372adf-a2fb-4310-bcb2-f158966625c4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:57.152093 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c5372adf-a2fb-4310-bcb2-f158966625c4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 06199cbd-cf2c-426d-a842-4dedd8359945] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:57.158528 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c5372adf-a2fb-4310-bcb2-f158966625c4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:57.159019 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c5372adf-a2fb-4310-bcb2-f158966625c4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:57.159603 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c5372adf-a2fb-4310-bcb2-f158966625c4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:57.160335 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c5372adf-a2fb-4310-bcb2-f158966625c4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:57.160807 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c5372adf-a2fb-4310-bcb2-f158966625c4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:57.161436 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c5372adf-a2fb-4310-bcb2-f158966625c4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:57.222553 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-568590a7-9025-4445-b345-2f5a46b10f9c tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:57.232516 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-568590a7-9025-4445-b345-2f5a46b10f9c tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a" status: 200 len: 1516 microversion: 2.1 time: 0.197016 Oct 30 01:29:57.233667 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1877/3756] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:57 2022] GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a => generated 1516 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:57.247820 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c5372adf-a2fb-4310-bcb2-f158966625c4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:57.258789 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bb81040c-a67b-4e4d-92bd-889631f43b5c tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:57.259586 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c5372adf-a2fb-4310-bcb2-f158966625c4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/06199cbd-cf2c-426d-a842-4dedd8359945" status: 200 len: 1231 microversion: 2.1 time: 0.113029 Oct 30 01:29:57.260175 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1880/3757] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:57 2022] GET /compute/v2.1/servers/06199cbd-cf2c-426d-a842-4dedd8359945 => generated 1231 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:29:57.262936 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-bb81040c-a67b-4e4d-92bd-889631f43b5c tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d7cd54fb-1c64-4fb8-a97b-4d5c81a48009] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:57.273939 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb81040c-a67b-4e4d-92bd-889631f43b5c tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:57.276260 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb81040c-a67b-4e4d-92bd-889631f43b5c tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:57.277233 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb81040c-a67b-4e4d-92bd-889631f43b5c tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:57.278331 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb81040c-a67b-4e4d-92bd-889631f43b5c tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:57.278996 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb81040c-a67b-4e4d-92bd-889631f43b5c tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:57.279784 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb81040c-a67b-4e4d-92bd-889631f43b5c tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:57.281959 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e08b0d13-96d6-4839-be0d-b7e4a556c5a4 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:57.291018 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e08b0d13-96d6-4839-be0d-b7e4a556c5a4 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] [instance: 0bddfccb-0dc7-430f-88b6-41e25e23d934] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:57.297468 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e08b0d13-96d6-4839-be0d-b7e4a556c5a4 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:57.298885 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e08b0d13-96d6-4839-be0d-b7e4a556c5a4 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:57.299973 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e08b0d13-96d6-4839-be0d-b7e4a556c5a4 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:57.300666 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e08b0d13-96d6-4839-be0d-b7e4a556c5a4 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:57.301657 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e08b0d13-96d6-4839-be0d-b7e4a556c5a4 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:57.306293 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e08b0d13-96d6-4839-be0d-b7e4a556c5a4 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:57.397524 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e08b0d13-96d6-4839-be0d-b7e4a556c5a4 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b3394f28c4f444f8cd8bda6bacc9fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1e9b74043548e48a5bb8fb4d054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:57.410152 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e08b0d13-96d6-4839-be0d-b7e4a556c5a4 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] 10.222.0.13 "GET /compute/v2.1/servers/0bddfccb-0dc7-430f-88b6-41e25e23d934" status: 200 len: 1631 microversion: 2.1 time: 0.134066 Oct 30 01:29:57.410896 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1881/3758] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:57 2022] GET /compute/v2.1/servers/0bddfccb-0dc7-430f-88b6-41e25e23d934 => generated 1631 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:57.416195 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5043f758-d7ba-4798-8ac7-8a93af274123 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44d03de940>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:57.464066 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5043f758-d7ba-4798-8ac7-8a93af274123 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/89bf1d5a-9053-4405-a355-19a4ae907b0a" status: 200 len: 1452 microversion: 2.1 time: 0.051866 Oct 30 01:29:57.468661 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1882/3759] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:29:57 2022] GET /compute/v2.1/images/89bf1d5a-9053-4405-a355-19a4ae907b0a => generated 1452 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:57.488862 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-bb81040c-a67b-4e4d-92bd-889631f43b5c tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:57.498974 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bb81040c-a67b-4e4d-92bd-889631f43b5c tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009" status: 200 len: 1505 microversion: 2.1 time: 0.252468 Oct 30 01:29:57.500070 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1878/3760] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:57 2022] GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 => generated 1505 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:29:58.082854 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-770e030c-0da8-43c8-9a8a-b4e5061fadb7 req-ac19562d-cdd7-42b5-bd01-5cf2781b596d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9368bd4-9715-46b3-91bb-cb436f7120f3", "name": "network-vif-plugged", "status": "completed", "tag": "2115d9c7-78b5-463e-b9d2-39310d4c1aa2"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:29:58.095821 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-770e030c-0da8-43c8-9a8a-b4e5061fadb7 req-ac19562d-cdd7-42b5-bd01-5cf2781b596d service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:58.096400 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-770e030c-0da8-43c8-9a8a-b4e5061fadb7 req-ac19562d-cdd7-42b5-bd01-5cf2781b596d service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:58.096899 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-770e030c-0da8-43c8-9a8a-b4e5061fadb7 req-ac19562d-cdd7-42b5-bd01-5cf2781b596d service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:58.114639 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-770e030c-0da8-43c8-9a8a-b4e5061fadb7 req-ac19562d-cdd7-42b5-bd01-5cf2781b596d service nova] Creating event network-vif-plugged:2115d9c7-78b5-463e-b9d2-39310d4c1aa2 for instance e9368bd4-9715-46b3-91bb-cb436f7120f3 on n-h1-master-1 Oct 30 01:29:58.116947 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-770e030c-0da8-43c8-9a8a-b4e5061fadb7 req-ac19562d-cdd7-42b5-bd01-5cf2781b596d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038378 Oct 30 01:29:58.117593 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1883/3761] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:29:58.284156 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a63ff607-cc47-4899-aa2e-d6cf757b30d4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:58.285779 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a63ff607-cc47-4899-aa2e-d6cf757b30d4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 06199cbd-cf2c-426d-a842-4dedd8359945] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:58.292402 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a63ff607-cc47-4899-aa2e-d6cf757b30d4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:58.292981 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a63ff607-cc47-4899-aa2e-d6cf757b30d4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:58.293537 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a63ff607-cc47-4899-aa2e-d6cf757b30d4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:58.294957 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a63ff607-cc47-4899-aa2e-d6cf757b30d4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:58.295499 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a63ff607-cc47-4899-aa2e-d6cf757b30d4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:58.295921 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a63ff607-cc47-4899-aa2e-d6cf757b30d4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:58.364940 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a63ff607-cc47-4899-aa2e-d6cf757b30d4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:58.374127 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a63ff607-cc47-4899-aa2e-d6cf757b30d4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/06199cbd-cf2c-426d-a842-4dedd8359945" status: 200 len: 1279 microversion: 2.1 time: 0.093000 Oct 30 01:29:58.374127 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1879/3762] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:58 2022] GET /compute/v2.1/servers/06199cbd-cf2c-426d-a842-4dedd8359945 => generated 1279 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:58.439921 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3baa9be8-3f28-49ed-970d-c6869bd00fe9 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:58.440620 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3baa9be8-3f28-49ed-970d-c6869bd00fe9 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] [instance: 0bddfccb-0dc7-430f-88b6-41e25e23d934] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:58.448381 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3baa9be8-3f28-49ed-970d-c6869bd00fe9 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:58.448884 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3baa9be8-3f28-49ed-970d-c6869bd00fe9 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:58.449363 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3baa9be8-3f28-49ed-970d-c6869bd00fe9 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:58.450078 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3baa9be8-3f28-49ed-970d-c6869bd00fe9 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:58.450538 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3baa9be8-3f28-49ed-970d-c6869bd00fe9 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:58.450967 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3baa9be8-3f28-49ed-970d-c6869bd00fe9 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:58.482735 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-de5982fa-4b13-41fc-a288-bf1dedef7438 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44d03f7b80>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:58.558309 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3baa9be8-3f28-49ed-970d-c6869bd00fe9 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b3394f28c4f444f8cd8bda6bacc9fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1e9b74043548e48a5bb8fb4d054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:58.563812 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-de5982fa-4b13-41fc-a288-bf1dedef7438 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/89bf1d5a-9053-4405-a355-19a4ae907b0a" status: 200 len: 1452 microversion: 2.1 time: 0.083424 Oct 30 01:29:58.564997 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1880/3763] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:29:58 2022] GET /compute/v2.1/images/89bf1d5a-9053-4405-a355-19a4ae907b0a => generated 1452 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:58.577290 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-24f752ba-977a-40d6-915c-09dde22969a9 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:58.577564 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3baa9be8-3f28-49ed-970d-c6869bd00fe9 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] 10.222.0.13 "GET /compute/v2.1/servers/0bddfccb-0dc7-430f-88b6-41e25e23d934" status: 200 len: 1354 microversion: 2.1 time: 0.139769 Oct 30 01:29:58.579581 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1884/3764] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:58 2022] GET /compute/v2.1/servers/0bddfccb-0dc7-430f-88b6-41e25e23d934 => generated 1354 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:58.581623 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-24f752ba-977a-40d6-915c-09dde22969a9 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d7cd54fb-1c64-4fb8-a97b-4d5c81a48009] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:58.588914 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-24f752ba-977a-40d6-915c-09dde22969a9 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:58.589702 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-24f752ba-977a-40d6-915c-09dde22969a9 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:58.590148 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-24f752ba-977a-40d6-915c-09dde22969a9 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:58.590899 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-24f752ba-977a-40d6-915c-09dde22969a9 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:58.595692 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-24f752ba-977a-40d6-915c-09dde22969a9 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:58.599890 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-24f752ba-977a-40d6-915c-09dde22969a9 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:58.630999 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:58.982554 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:59.012663 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-24f752ba-977a-40d6-915c-09dde22969a9 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:59.024401 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-24f752ba-977a-40d6-915c-09dde22969a9 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009" status: 200 len: 1505 microversion: 2.1 time: 0.454477 Oct 30 01:29:59.033694 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1881/3765] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:58 2022] GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 => generated 1505 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:59.404914 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f1895f8d-02a2-4f6a-8d57-f7d68d982286 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:59.406531 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f1895f8d-02a2-4f6a-8d57-f7d68d982286 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 06199cbd-cf2c-426d-a842-4dedd8359945] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:59.422195 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f1895f8d-02a2-4f6a-8d57-f7d68d982286 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:59.422823 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-ed978d49-2b3b-4521-98c4-ad942aff41b2 req-6eddba8b-e7f4-42d8-8d23-443f9d48a3a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7cd54fb-1c64-4fb8-a97b-4d5c81a48009", "name": "network-vif-deleted", "tag": "34dca13c-1065-4ac2-b6d6-9e07c5bf363e"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:29:59.424469 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f1895f8d-02a2-4f6a-8d57-f7d68d982286 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:59.424970 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f1895f8d-02a2-4f6a-8d57-f7d68d982286 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:59.428518 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f1895f8d-02a2-4f6a-8d57-f7d68d982286 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:59.429018 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f1895f8d-02a2-4f6a-8d57-f7d68d982286 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:59.429542 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f1895f8d-02a2-4f6a-8d57-f7d68d982286 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:59.436257 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ed978d49-2b3b-4521-98c4-ad942aff41b2 req-6eddba8b-e7f4-42d8-8d23-443f9d48a3a1 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:59.437058 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ed978d49-2b3b-4521-98c4-ad942aff41b2 req-6eddba8b-e7f4-42d8-8d23-443f9d48a3a1 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:59.437732 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ed978d49-2b3b-4521-98c4-ad942aff41b2 req-6eddba8b-e7f4-42d8-8d23-443f9d48a3a1 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:59.450944 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-ed978d49-2b3b-4521-98c4-ad942aff41b2 req-6eddba8b-e7f4-42d8-8d23-443f9d48a3a1 service nova] Creating event network-vif-deleted:34dca13c-1065-4ac2-b6d6-9e07c5bf363e for instance d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 on n-h1-master-1 Oct 30 01:29:59.456505 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-ed978d49-2b3b-4521-98c4-ad942aff41b2 req-6eddba8b-e7f4-42d8-8d23-443f9d48a3a1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037307 Oct 30 01:29:59.457776 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1882/3766] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:29:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:29:59.519961 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f1895f8d-02a2-4f6a-8d57-f7d68d982286 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:59.528087 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f1895f8d-02a2-4f6a-8d57-f7d68d982286 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/06199cbd-cf2c-426d-a842-4dedd8359945" status: 200 len: 1285 microversion: 2.1 time: 0.136274 Oct 30 01:29:59.528663 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1885/3767] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:59 2022] GET /compute/v2.1/servers/06199cbd-cf2c-426d-a842-4dedd8359945 => generated 1285 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:59.581914 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2234d6fb-b148-4179-9cce-5ae8e603b7c1 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44c7307160>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:59.606953 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2958a911-e8b1-4714-83fe-a392ce53daaa tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:29:59.607097 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2958a911-e8b1-4714-83fe-a392ce53daaa tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] [instance: 0bddfccb-0dc7-430f-88b6-41e25e23d934] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:29:59.614957 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2958a911-e8b1-4714-83fe-a392ce53daaa tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:59.615447 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2958a911-e8b1-4714-83fe-a392ce53daaa tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:59.616075 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2958a911-e8b1-4714-83fe-a392ce53daaa tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:59.616976 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2958a911-e8b1-4714-83fe-a392ce53daaa tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:59.617651 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2958a911-e8b1-4714-83fe-a392ce53daaa tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:59.618610 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2958a911-e8b1-4714-83fe-a392ce53daaa tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:59.667263 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2958a911-e8b1-4714-83fe-a392ce53daaa tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:29:59.667748 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2958a911-e8b1-4714-83fe-a392ce53daaa tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:29:59.668352 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2958a911-e8b1-4714-83fe-a392ce53daaa tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:29:59.668481 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2234d6fb-b148-4179-9cce-5ae8e603b7c1 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/89bf1d5a-9053-4405-a355-19a4ae907b0a" status: 200 len: 1452 microversion: 2.1 time: 0.091722 Oct 30 01:29:59.670148 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-2958a911-e8b1-4714-83fe-a392ce53daaa tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lazy-loading 'fault' on Instance uuid 0bddfccb-0dc7-430f-88b6-41e25e23d934 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:29:59.670280 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1883/3768] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:29:59 2022] GET /compute/v2.1/images/89bf1d5a-9053-4405-a355-19a4ae907b0a => generated 1452 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:29:59.746118 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2958a911-e8b1-4714-83fe-a392ce53daaa tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b3394f28c4f444f8cd8bda6bacc9fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1e9b74043548e48a5bb8fb4d054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:29:59.756639 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2958a911-e8b1-4714-83fe-a392ce53daaa tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] 10.222.0.13 "GET /compute/v2.1/servers/0bddfccb-0dc7-430f-88b6-41e25e23d934" status: 200 len: 1359 microversion: 2.1 time: 0.156805 Oct 30 01:29:59.757240 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1886/3769] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:29:59 2022] GET /compute/v2.1/servers/0bddfccb-0dc7-430f-88b6-41e25e23d934 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:30:00.054349 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7950586c-5063-42bf-ae67-29efaad29818 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:00.054349 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7950586c-5063-42bf-ae67-29efaad29818 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d7cd54fb-1c64-4fb8-a97b-4d5c81a48009] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:00.071769 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7950586c-5063-42bf-ae67-29efaad29818 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:00.072516 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-989e313f-92d4-467e-850f-703b0ab5b572 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Action: 'create', calling method: .version_select at 0x7f44d0523550>, body: {"keypair": {"name": "tempest-keypair-1368801132", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFRt+P1ty3Hev1lCfpCKIupTQjyGkXW8Rsk+LHmAXkDhge5NwwW3B9irJiKjwPgXbQIjVLGBuX6ylHaqGrOScjzpyNwyAsAsehzEIV7eqO9y8uEV3VA8Y1ddmRUcDVBh8w=="}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:30:00.072700 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7950586c-5063-42bf-ae67-29efaad29818 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:00.072987 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7950586c-5063-42bf-ae67-29efaad29818 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:00.073929 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7950586c-5063-42bf-ae67-29efaad29818 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:00.074396 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7950586c-5063-42bf-ae67-29efaad29818 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:00.074853 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7950586c-5063-42bf-ae67-29efaad29818 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:00.098477 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-989e313f-92d4-467e-850f-703b0ab5b572 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Getting quotas for project 470e235fb35840828d9a86028b72f5de. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:30:00.104152 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-989e313f-92d4-467e-850f-703b0ab5b572 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Getting quotas for user 6134c05549f14bc19962acea9c913f53 and project 470e235fb35840828d9a86028b72f5de. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:30:00.119359 n-d-master-1 devstack@n-api.service[121102]: ERROR oslo.messaging._drivers.impl_rabbit [None req-989e313f-92d4-467e-850f-703b0ab5b572 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [7c68d36c-f27f-45ed-8619-05e3e9a53b91] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 30 01:30:00.125129 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7950586c-5063-42bf-ae67-29efaad29818 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:00.125129 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7950586c-5063-42bf-ae67-29efaad29818 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:00.125129 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7950586c-5063-42bf-ae67-29efaad29818 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:00.125129 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-7950586c-5063-42bf-ae67-29efaad29818 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lazy-loading 'fault' on Instance uuid d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:30:00.264094 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7950586c-5063-42bf-ae67-29efaad29818 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:00.278402 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7950586c-5063-42bf-ae67-29efaad29818 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009" status: 200 len: 1304 microversion: 2.1 time: 0.234459 Oct 30 01:30:00.297445 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1884/3770] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:00 2022] GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 => generated 1304 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:00.554336 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7d0ab6fd-6a0a-4f44-86fa-cd82f467a28d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:00.555329 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7d0ab6fd-6a0a-4f44-86fa-cd82f467a28d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 06199cbd-cf2c-426d-a842-4dedd8359945] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:00.578170 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7d0ab6fd-6a0a-4f44-86fa-cd82f467a28d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:00.578995 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7d0ab6fd-6a0a-4f44-86fa-cd82f467a28d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:00.580008 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7d0ab6fd-6a0a-4f44-86fa-cd82f467a28d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:00.583183 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7d0ab6fd-6a0a-4f44-86fa-cd82f467a28d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:00.584327 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7d0ab6fd-6a0a-4f44-86fa-cd82f467a28d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:00.587460 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7d0ab6fd-6a0a-4f44-86fa-cd82f467a28d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:00.944602 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7d0ab6fd-6a0a-4f44-86fa-cd82f467a28d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:00.953775 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7d0ab6fd-6a0a-4f44-86fa-cd82f467a28d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/06199cbd-cf2c-426d-a842-4dedd8359945" status: 200 len: 1327 microversion: 2.1 time: 0.404815 Oct 30 01:30:00.957115 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1885/3771] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:00 2022] GET /compute/v2.1/servers/06199cbd-cf2c-426d-a842-4dedd8359945 => generated 1327 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:00.964955 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ad70cab5-b882-49e0-8aa2-b95220eede97 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44cc687280>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:01.029280 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ad70cab5-b882-49e0-8aa2-b95220eede97 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/89bf1d5a-9053-4405-a355-19a4ae907b0a" status: 200 len: 1452 microversion: 2.1 time: 0.070296 Oct 30 01:30:01.030201 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1886/3772] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:30:00 2022] GET /compute/v2.1/images/89bf1d5a-9053-4405-a355-19a4ae907b0a => generated 1452 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:01.046492 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-11dfb29e-8c3f-450d-b50c-311c0ba58644 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:01.054727 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-11dfb29e-8c3f-450d-b50c-311c0ba58644 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] [instance: 0bddfccb-0dc7-430f-88b6-41e25e23d934] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:01.064985 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-11dfb29e-8c3f-450d-b50c-311c0ba58644 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:01.082141 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-11dfb29e-8c3f-450d-b50c-311c0ba58644 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:01.082141 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-11dfb29e-8c3f-450d-b50c-311c0ba58644 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:01.082141 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-11dfb29e-8c3f-450d-b50c-311c0ba58644 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:01.082141 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-11dfb29e-8c3f-450d-b50c-311c0ba58644 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:01.082141 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-11dfb29e-8c3f-450d-b50c-311c0ba58644 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:01.105727 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-11dfb29e-8c3f-450d-b50c-311c0ba58644 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] HTTP exception thrown: Instance 0bddfccb-0dc7-430f-88b6-41e25e23d934 could not be found. Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-11dfb29e-8c3f-450d-b50c-311c0ba58644 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Request method failure captured: Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/0bddfccb-0dc7-430f-88b6-41e25e23d934 HTTP/1.1 Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdNFIKo-NFZQIyo7ZHOfbskAWRS_cGnemCAlgx03tYzknIWq8ghnunjFWQVM6JKsqNOpLEBnkRonmKrdW7l67b1GEEVJh5apdaKycneE-GIXW2Y5A2p-zKzPX7Z6CQG-VAMQJUjpSzOER8EmzxvawnNUHaIs8l4DL3S_h8-PPlMwbJk Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 9d1e9b74043548e48a5bb8fb4d054803 Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersTestJSON-183076292 Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9d1e9b74043548e48a5bb8fb4d054803"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9d1e9b74043548e48a5bb8fb4d054803"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9d1e9b74043548e48a5bb8fb4d054803"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9d1e9b74043548e48a5bb8fb4d054803"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersTestJSON-183076292 Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 9d1e9b74043548e48a5bb8fb4d054803 Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersTestJSON-183076292 Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersTestJSON-183076292-project Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 6b3394f28c4f444f8cd8bda6bacc9fc8 Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersTestJSON-183076292-project Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 0bddfccb-0dc7-430f-88b6-41e25e23d934 could not be found. Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '0bddfccb-0dc7-430f-88b6-41e25e23d934'} Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bddfccb-0dc7-430f-88b6-41e25e23d934 could not be found. Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bddfccb-0dc7-430f-88b6-41e25e23d934 could not be found. Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:30:01.108120 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:30:01.119566 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:30:01.119566 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:30:01.119566 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:30:01.119566 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:30:01.119566 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bddfccb-0dc7-430f-88b6-41e25e23d934 could not be found. Oct 30 01:30:01.119566 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:30:01.119566 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-11dfb29e-8c3f-450d-b50c-311c0ba58644 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Returning 404 to user: Instance 0bddfccb-0dc7-430f-88b6-41e25e23d934 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:30:01.119566 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-11dfb29e-8c3f-450d-b50c-311c0ba58644 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] 10.222.0.13 "GET /compute/v2.1/servers/0bddfccb-0dc7-430f-88b6-41e25e23d934" status: 404 len: 111 microversion: 2.1 time: 0.067253 Oct 30 01:30:01.119566 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1887/3773] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:01 2022] GET /compute/v2.1/servers/0bddfccb-0dc7-430f-88b6-41e25e23d934 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:30:01.119566 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f6d7d2f0-89bd-4169-8508-3ed0b0f7cdc7 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] Calling method '.version_select at 0x7f44c7bac700>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:01.129815 n-d-master-1 devstack@n-api.service[121102]: INFO oslo.messaging._drivers.impl_rabbit [None req-989e313f-92d4-467e-850f-703b0ab5b572 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [7c68d36c-f27f-45ed-8619-05e3e9a53b91] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 38754. Oct 30 01:30:01.212814 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-989e313f-92d4-467e-850f-703b0ab5b572 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.144927 Oct 30 01:30:01.218019 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1887/3774] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 30 01:30:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:30:01.246920 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f6d7d2f0-89bd-4169-8508-3ed0b0f7cdc7 tempest-ServersTestJSON-183076292 tempest-ServersTestJSON-183076292-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2021072280" status: 202 len: 0 microversion: 2.1 time: 0.131403 Oct 30 01:30:01.248568 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1888/3775] 10.222.0.13 () {58 vars in 1221 bytes} [Sun Oct 30 01:30:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2021072280 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:30:01.307921 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b4400c09-fbcd-4c5c-a287-85547cc95e30 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:01.308374 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b4400c09-fbcd-4c5c-a287-85547cc95e30 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d7cd54fb-1c64-4fb8-a97b-4d5c81a48009] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:01.332471 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b4400c09-fbcd-4c5c-a287-85547cc95e30 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:01.332972 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b4400c09-fbcd-4c5c-a287-85547cc95e30 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:01.333716 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b4400c09-fbcd-4c5c-a287-85547cc95e30 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:01.334786 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b4400c09-fbcd-4c5c-a287-85547cc95e30 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:01.335430 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b4400c09-fbcd-4c5c-a287-85547cc95e30 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:01.341288 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b4400c09-fbcd-4c5c-a287-85547cc95e30 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:01.353185 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-b4400c09-fbcd-4c5c-a287-85547cc95e30 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] HTTP exception thrown: Instance d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 could not be found. Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b4400c09-fbcd-4c5c-a287-85547cc95e30 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Request method failure captured: Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 HTTP/1.1 Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdMMWFyyUxAoaESDELtE-V_UowuEFaMAStnAKDd_oGTPyzdk4CJerWgZwlpHMRAfZp4W1HA7ps5vIDduTLFNEG_EYa21IevkA1tO43oRZUZl9q8I_RKBcXX4o5SggCKhmE0KIlBQfeAcmElecAJmCsV4OK6pVQ4iyBWATev8MUtB8PI Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: fdedb3257fe94513bd5c51de0ae1d737 Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServerRescueTestJSON-1222025265 Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fdedb3257fe94513bd5c51de0ae1d737"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_fdedb3257fe94513bd5c51de0ae1d737"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/fdedb3257fe94513bd5c51de0ae1d737"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fdedb3257fe94513bd5c51de0ae1d737"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServerRescueTestJSON-1222025265 Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: fdedb3257fe94513bd5c51de0ae1d737 Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServerRescueTestJSON-1222025265 Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServerRescueTestJSON-1222025265-project Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: a4fff27847f74c39b425dba724cf847f Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServerRescueTestJSON-1222025265-project Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: exception: Instance d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 could not be found. Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'd7cd54fb-1c64-4fb8-a97b-4d5c81a48009'} Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 could not be found. Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 could not be found. Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:30:01.355270 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:30:01.360427 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:30:01.360427 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:30:01.360427 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:30:01.360427 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:30:01.360427 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:30:01.360427 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 could not be found. Oct 30 01:30:01.360427 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:30:01.361493 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b4400c09-fbcd-4c5c-a287-85547cc95e30 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Returning 404 to user: Instance d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:30:01.362408 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b4400c09-fbcd-4c5c-a287-85547cc95e30 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009" status: 404 len: 111 microversion: 2.1 time: 0.059291 Oct 30 01:30:01.363243 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1888/3776] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:01 2022] GET /compute/v2.1/servers/d7cd54fb-1c64-4fb8-a97b-4d5c81a48009 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:30:01.373646 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5db87883-70a4-4abe-91b6-3f0c23e4e9a2 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:01.374157 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5db87883-70a4-4abe-91b6-3f0c23e4e9a2 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d01c1c62-c352-4a98-b95b-51ff385a415e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:01.386707 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5db87883-70a4-4abe-91b6-3f0c23e4e9a2 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:01.387211 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5db87883-70a4-4abe-91b6-3f0c23e4e9a2 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:01.387648 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5db87883-70a4-4abe-91b6-3f0c23e4e9a2 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:01.394483 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5db87883-70a4-4abe-91b6-3f0c23e4e9a2 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:01.395052 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5db87883-70a4-4abe-91b6-3f0c23e4e9a2 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:01.396626 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5db87883-70a4-4abe-91b6-3f0c23e4e9a2 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:01.449383 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5db87883-70a4-4abe-91b6-3f0c23e4e9a2 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d01c1c62-c352-4a98-b95b-51ff385a415e] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:30:01.911082 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5db87883-70a4-4abe-91b6-3f0c23e4e9a2 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e" status: 204 len: 0 microversion: 2.1 time: 0.540500 Oct 30 01:30:01.914973 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1889/3777] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:30:01 2022] DELETE /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e => generated 0 bytes in 547 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:30:01.923225 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b7bcb905-99c4-4592-bd76-ecb4a57b0fcb tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:01.923880 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b7bcb905-99c4-4592-bd76-ecb4a57b0fcb tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d01c1c62-c352-4a98-b95b-51ff385a415e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:01.936701 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b7bcb905-99c4-4592-bd76-ecb4a57b0fcb tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:01.938804 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b7bcb905-99c4-4592-bd76-ecb4a57b0fcb tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:01.940417 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b7bcb905-99c4-4592-bd76-ecb4a57b0fcb tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:01.946136 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b7bcb905-99c4-4592-bd76-ecb4a57b0fcb tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:01.950878 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b7bcb905-99c4-4592-bd76-ecb4a57b0fcb tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:01.959742 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b7bcb905-99c4-4592-bd76-ecb4a57b0fcb tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:01.966211 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:30:01.989024 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0d0605a8-c442-4e99-a635-ae1ef9470811 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:01.990090 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0d0605a8-c442-4e99-a635-ae1ef9470811 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 06199cbd-cf2c-426d-a842-4dedd8359945] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:02.015801 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d0605a8-c442-4e99-a635-ae1ef9470811 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:02.016326 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d0605a8-c442-4e99-a635-ae1ef9470811 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:02.016775 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d0605a8-c442-4e99-a635-ae1ef9470811 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:02.028646 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d0605a8-c442-4e99-a635-ae1ef9470811 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:02.030268 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d0605a8-c442-4e99-a635-ae1ef9470811 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:02.031033 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d0605a8-c442-4e99-a635-ae1ef9470811 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:02.780898 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0d0605a8-c442-4e99-a635-ae1ef9470811 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:02.792508 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0d0605a8-c442-4e99-a635-ae1ef9470811 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/06199cbd-cf2c-426d-a842-4dedd8359945" status: 200 len: 1327 microversion: 2.1 time: 0.812833 Oct 30 01:30:02.793720 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1890/3778] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:01 2022] GET /compute/v2.1/servers/06199cbd-cf2c-426d-a842-4dedd8359945 => generated 1327 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:02.803790 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8623a4df-a163-44c6-907f-834086a6bc07 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44c7b60b80>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:02.833440 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b7bcb905-99c4-4592-bd76-ecb4a57b0fcb tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:02.861286 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b7bcb905-99c4-4592-bd76-ecb4a57b0fcb tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e" status: 200 len: 1491 microversion: 2.1 time: 0.923394 Oct 30 01:30:02.861286 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1889/3779] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:01 2022] GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e => generated 1491 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:02.888421 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8623a4df-a163-44c6-907f-834086a6bc07 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/89bf1d5a-9053-4405-a355-19a4ae907b0a" status: 200 len: 1452 microversion: 2.1 time: 0.093250 Oct 30 01:30:02.896333 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1891/3780] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:30:02 2022] GET /compute/v2.1/images/89bf1d5a-9053-4405-a355-19a4ae907b0a => generated 1452 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:02.931160 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-bfe3b247-19f3-4360-8246-1b04c72fc62c req-807d8f4a-5765-4f08-a179-1f586100977c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06199cbd-cf2c-426d-a842-4dedd8359945", "tag": "3ac9c01a-5607-4d65-aad3-0c30849ebdda"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:30:02.947073 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-bfe3b247-19f3-4360-8246-1b04c72fc62c req-807d8f4a-5765-4f08-a179-1f586100977c service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:02.947842 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-bfe3b247-19f3-4360-8246-1b04c72fc62c req-807d8f4a-5765-4f08-a179-1f586100977c service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:02.948435 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-bfe3b247-19f3-4360-8246-1b04c72fc62c req-807d8f4a-5765-4f08-a179-1f586100977c service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:02.961414 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-bfe3b247-19f3-4360-8246-1b04c72fc62c req-807d8f4a-5765-4f08-a179-1f586100977c service nova] Creating event network-changed:3ac9c01a-5607-4d65-aad3-0c30849ebdda for instance 06199cbd-cf2c-426d-a842-4dedd8359945 on n-h2-master-1 Oct 30 01:30:02.967870 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-bfe3b247-19f3-4360-8246-1b04c72fc62c req-807d8f4a-5765-4f08-a179-1f586100977c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040353 Oct 30 01:30:02.969070 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1890/3781] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:30:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:30:03.816616 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-78c0ebc6-3dc0-4f31-b824-a702f37cc19e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:03.817711 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-78c0ebc6-3dc0-4f31-b824-a702f37cc19e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 06199cbd-cf2c-426d-a842-4dedd8359945] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:03.828356 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-78c0ebc6-3dc0-4f31-b824-a702f37cc19e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:03.830328 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-78c0ebc6-3dc0-4f31-b824-a702f37cc19e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:03.830784 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-78c0ebc6-3dc0-4f31-b824-a702f37cc19e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:03.831546 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-78c0ebc6-3dc0-4f31-b824-a702f37cc19e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:03.832579 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-78c0ebc6-3dc0-4f31-b824-a702f37cc19e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:03.833182 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-78c0ebc6-3dc0-4f31-b824-a702f37cc19e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:03.870679 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ca153708-3f8c-4162-a5f1-0129c376cea1 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:03.871995 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ca153708-3f8c-4162-a5f1-0129c376cea1 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d01c1c62-c352-4a98-b95b-51ff385a415e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:03.896625 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ca153708-3f8c-4162-a5f1-0129c376cea1 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:03.897086 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ca153708-3f8c-4162-a5f1-0129c376cea1 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:03.897581 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ca153708-3f8c-4162-a5f1-0129c376cea1 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:03.898362 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ca153708-3f8c-4162-a5f1-0129c376cea1 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:03.901775 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ca153708-3f8c-4162-a5f1-0129c376cea1 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:03.902562 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ca153708-3f8c-4162-a5f1-0129c376cea1 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:04.301497 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ca153708-3f8c-4162-a5f1-0129c376cea1 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:04.327779 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-78c0ebc6-3dc0-4f31-b824-a702f37cc19e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:04.332505 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ca153708-3f8c-4162-a5f1-0129c376cea1 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e" status: 200 len: 1491 microversion: 2.1 time: 0.465314 Oct 30 01:30:04.351833 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1891/3782] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:03 2022] GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e => generated 1491 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:30:04.355129 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-78c0ebc6-3dc0-4f31-b824-a702f37cc19e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/06199cbd-cf2c-426d-a842-4dedd8359945" status: 200 len: 1327 microversion: 2.1 time: 0.541074 Oct 30 01:30:04.356267 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1892/3783] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:03 2022] GET /compute/v2.1/servers/06199cbd-cf2c-426d-a842-4dedd8359945 => generated 1327 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:04.372866 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a4df60ca-1f3f-460e-baaa-83df5b9ad169 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44d0523040>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:04.424566 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a4df60ca-1f3f-460e-baaa-83df5b9ad169 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/89bf1d5a-9053-4405-a355-19a4ae907b0a" status: 200 len: 1452 microversion: 2.1 time: 0.071118 Oct 30 01:30:04.425457 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1892/3784] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:30:04 2022] GET /compute/v2.1/images/89bf1d5a-9053-4405-a355-19a4ae907b0a => generated 1452 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:05.359788 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-58cb1153-8d0b-41cc-96ab-37c608f3d5d6 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:05.360590 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-58cb1153-8d0b-41cc-96ab-37c608f3d5d6 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d01c1c62-c352-4a98-b95b-51ff385a415e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:05.368738 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58cb1153-8d0b-41cc-96ab-37c608f3d5d6 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:05.375220 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58cb1153-8d0b-41cc-96ab-37c608f3d5d6 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:05.375220 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58cb1153-8d0b-41cc-96ab-37c608f3d5d6 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:05.375220 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58cb1153-8d0b-41cc-96ab-37c608f3d5d6 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:05.375220 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58cb1153-8d0b-41cc-96ab-37c608f3d5d6 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:05.375220 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58cb1153-8d0b-41cc-96ab-37c608f3d5d6 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:05.381505 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-eeb9263d-e96e-4eef-b553-1adde64a25c8 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:05.382051 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-eeb9263d-e96e-4eef-b553-1adde64a25c8 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 06199cbd-cf2c-426d-a842-4dedd8359945] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:05.388920 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eeb9263d-e96e-4eef-b553-1adde64a25c8 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:05.389735 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eeb9263d-e96e-4eef-b553-1adde64a25c8 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:05.390183 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eeb9263d-e96e-4eef-b553-1adde64a25c8 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:05.390899 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eeb9263d-e96e-4eef-b553-1adde64a25c8 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:05.391355 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eeb9263d-e96e-4eef-b553-1adde64a25c8 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:05.391994 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eeb9263d-e96e-4eef-b553-1adde64a25c8 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:05.648715 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-58cb1153-8d0b-41cc-96ab-37c608f3d5d6 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:05.665176 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-58cb1153-8d0b-41cc-96ab-37c608f3d5d6 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e" status: 200 len: 1491 microversion: 2.1 time: 0.309062 Oct 30 01:30:05.668475 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1893/3785] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:05 2022] GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e => generated 1491 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:05.681134 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-71d9f9da-2006-4c75-8568-bc05237101e3 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44d03a48b0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:05.723414 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=4 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:30:05.755873 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-eeb9263d-e96e-4eef-b553-1adde64a25c8 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:05.767507 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-71d9f9da-2006-4c75-8568-bc05237101e3 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/89bf1d5a-9053-4405-a355-19a4ae907b0a" status: 200 len: 1452 microversion: 2.1 time: 0.097577 Oct 30 01:30:05.768324 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1894/3786] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:30:05 2022] GET /compute/v2.1/images/89bf1d5a-9053-4405-a355-19a4ae907b0a => generated 1452 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:05.774437 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2013ee8b-0b40-4b53-8ebe-d733279e626a tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1247061427", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2f1dbd29-9e2f-4ba6-b3e0-2e3fe317445a"}], "security_groups": [{"name": "tempest-securitygroup--1198982412"}], "key_name": "tempest-keypair-1368801132", "user_data": "}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:30:05.780398 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-eeb9263d-e96e-4eef-b553-1adde64a25c8 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/06199cbd-cf2c-426d-a842-4dedd8359945" status: 200 len: 1327 microversion: 2.1 time: 0.401060 Oct 30 01:30:05.781279 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1893/3787] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:05 2022] GET /compute/v2.1/servers/06199cbd-cf2c-426d-a842-4dedd8359945 => generated 1327 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:05.969312 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-2013ee8b-0b40-4b53-8ebe-d733279e626a tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] validate_networks() for [('2f1dbd29-9e2f-4ba6-b3e0-2e3fe317445a', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:30:06.124719 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=8 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:30:06.467346 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-a6e5802a-3586-4a65-bbb3-85a94b114053 req-31304a4b-5d48-4105-94f8-2a5b665eaeb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d01c1c62-c352-4a98-b95b-51ff385a415e", "name": "network-vif-deleted", "tag": "d99123ae-318c-41aa-bb60-152a6d295ad2"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:30:06.489592 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-a6e5802a-3586-4a65-bbb3-85a94b114053 req-31304a4b-5d48-4105-94f8-2a5b665eaeb3 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:06.490080 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-a6e5802a-3586-4a65-bbb3-85a94b114053 req-31304a4b-5d48-4105-94f8-2a5b665eaeb3 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:06.490513 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-a6e5802a-3586-4a65-bbb3-85a94b114053 req-31304a4b-5d48-4105-94f8-2a5b665eaeb3 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:06.517669 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-a6e5802a-3586-4a65-bbb3-85a94b114053 req-31304a4b-5d48-4105-94f8-2a5b665eaeb3 service nova] Creating event network-vif-deleted:d99123ae-318c-41aa-bb60-152a6d295ad2 for instance d01c1c62-c352-4a98-b95b-51ff385a415e on n-h1-master-1 Oct 30 01:30:06.528044 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-a6e5802a-3586-4a65-bbb3-85a94b114053 req-31304a4b-5d48-4105-94f8-2a5b665eaeb3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064376 Oct 30 01:30:06.529284 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1894/3788] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:30:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:30:06.694055 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-2013ee8b-0b40-4b53-8ebe-d733279e626a tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:30:06.695285 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-2013ee8b-0b40-4b53-8ebe-d733279e626a tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:30:06.696120 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d6989971-468a-4552-8180-4c72671a98d8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:06.696446 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-2013ee8b-0b40-4b53-8ebe-d733279e626a tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:30:06.697148 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-2013ee8b-0b40-4b53-8ebe-d733279e626a tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:30:06.697274 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d6989971-468a-4552-8180-4c72671a98d8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d01c1c62-c352-4a98-b95b-51ff385a415e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:06.698064 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-2013ee8b-0b40-4b53-8ebe-d733279e626a tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:30:06.711144 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d6989971-468a-4552-8180-4c72671a98d8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:06.711948 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d6989971-468a-4552-8180-4c72671a98d8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:06.712409 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d6989971-468a-4552-8180-4c72671a98d8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:06.713426 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d6989971-468a-4552-8180-4c72671a98d8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:06.714089 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d6989971-468a-4552-8180-4c72671a98d8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:06.719694 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2013ee8b-0b40-4b53-8ebe-d733279e626a tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:06.719854 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d6989971-468a-4552-8180-4c72671a98d8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:06.719953 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2013ee8b-0b40-4b53-8ebe-d733279e626a tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:06.719953 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2013ee8b-0b40-4b53-8ebe-d733279e626a tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:06.719953 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2013ee8b-0b40-4b53-8ebe-d733279e626a tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:06.719953 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2013ee8b-0b40-4b53-8ebe-d733279e626a tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:06.719953 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2013ee8b-0b40-4b53-8ebe-d733279e626a tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:06.743114 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-2013ee8b-0b40-4b53-8ebe-d733279e626a tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Getting quotas for project 470e235fb35840828d9a86028b72f5de. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:30:06.756596 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-2013ee8b-0b40-4b53-8ebe-d733279e626a tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Getting quotas for user 6134c05549f14bc19962acea9c913f53 and project 470e235fb35840828d9a86028b72f5de. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:30:06.785775 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2013ee8b-0b40-4b53-8ebe-d733279e626a tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:30:06.808077 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2013ee8b-0b40-4b53-8ebe-d733279e626a tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:30:06.864893 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d6989971-468a-4552-8180-4c72671a98d8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:06.875256 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d6989971-468a-4552-8180-4c72671a98d8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e" status: 200 len: 1285 microversion: 2.1 time: 0.184380 Oct 30 01:30:06.901903 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1895/3789] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:06 2022] GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e => generated 1285 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:06.912958 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-19aa702e-9669-4a18-8ad4-f207b772d960 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44d0464700>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:07.001838 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-19aa702e-9669-4a18-8ad4-f207b772d960 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/89bf1d5a-9053-4405-a355-19a4ae907b0a" status: 200 len: 1452 microversion: 2.1 time: 0.098718 Oct 30 01:30:07.003058 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1896/3790] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:30:06 2022] GET /compute/v2.1/images/89bf1d5a-9053-4405-a355-19a4ae907b0a => generated 1452 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:07.009034 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c9d18ed1-4b56-43b3-a5bf-febf5feb4536 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:07.010280 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c9d18ed1-4b56-43b3-a5bf-febf5feb4536 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 06199cbd-cf2c-426d-a842-4dedd8359945] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:07.013732 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2013ee8b-0b40-4b53-8ebe-d733279e626a tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.243888 Oct 30 01:30:07.014482 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1895/3791] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:30:05 2022] POST /compute/v2.1/servers => generated 409 bytes in 1246 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:30:07.034821 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c9d18ed1-4b56-43b3-a5bf-febf5feb4536 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:07.036113 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c9d18ed1-4b56-43b3-a5bf-febf5feb4536 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:07.036839 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c9d18ed1-4b56-43b3-a5bf-febf5feb4536 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:07.038537 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c9d18ed1-4b56-43b3-a5bf-febf5feb4536 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:07.040260 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c9d18ed1-4b56-43b3-a5bf-febf5feb4536 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:07.040825 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c9d18ed1-4b56-43b3-a5bf-febf5feb4536 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:07.047758 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fdac9c7f-f468-4d39-b318-433b1c5baa5e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:07.048409 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-fdac9c7f-f468-4d39-b318-433b1c5baa5e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:07.178720 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-fdac9c7f-f468-4d39-b318-433b1c5baa5e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:07.190064 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fdac9c7f-f468-4d39-b318-433b1c5baa5e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0" status: 200 len: 1246 microversion: 2.1 time: 0.158323 Oct 30 01:30:07.210633 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1896/3792] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:07 2022] GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0 => generated 1246 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:07.426435 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c9d18ed1-4b56-43b3-a5bf-febf5feb4536 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:07.439679 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c9d18ed1-4b56-43b3-a5bf-febf5feb4536 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/06199cbd-cf2c-426d-a842-4dedd8359945" status: 200 len: 1327 microversion: 2.1 time: 0.435126 Oct 30 01:30:07.442448 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1897/3793] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:07 2022] GET /compute/v2.1/servers/06199cbd-cf2c-426d-a842-4dedd8359945 => generated 1327 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:07.906601 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e85b5867-58eb-4f6e-9f89-102fd3a1a8e8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:07.908709 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e85b5867-58eb-4f6e-9f89-102fd3a1a8e8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d01c1c62-c352-4a98-b95b-51ff385a415e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:07.931285 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e85b5867-58eb-4f6e-9f89-102fd3a1a8e8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:07.932258 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e85b5867-58eb-4f6e-9f89-102fd3a1a8e8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:07.932943 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e85b5867-58eb-4f6e-9f89-102fd3a1a8e8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:07.934913 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e85b5867-58eb-4f6e-9f89-102fd3a1a8e8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:07.936816 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e85b5867-58eb-4f6e-9f89-102fd3a1a8e8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:07.937617 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e85b5867-58eb-4f6e-9f89-102fd3a1a8e8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:08.019739 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-64886026-af06-44b5-941d-316ee8e600e2 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44d0464ca0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:08.076006 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e85b5867-58eb-4f6e-9f89-102fd3a1a8e8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:08.077827 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e85b5867-58eb-4f6e-9f89-102fd3a1a8e8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:08.079985 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e85b5867-58eb-4f6e-9f89-102fd3a1a8e8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:08.080886 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-e85b5867-58eb-4f6e-9f89-102fd3a1a8e8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lazy-loading 'fault' on Instance uuid d01c1c62-c352-4a98-b95b-51ff385a415e {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:30:08.186701 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-64886026-af06-44b5-941d-316ee8e600e2 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/89bf1d5a-9053-4405-a355-19a4ae907b0a" status: 200 len: 1452 microversion: 2.1 time: 0.168955 Oct 30 01:30:08.191325 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1898/3794] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:30:08 2022] GET /compute/v2.1/images/89bf1d5a-9053-4405-a355-19a4ae907b0a => generated 1452 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:30:08.224357 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9caf8890-dc83-492f-898e-6a2c6a8ed03b tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:08.226366 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9caf8890-dc83-492f-898e-6a2c6a8ed03b tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:08.244942 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:30:08.251385 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e85b5867-58eb-4f6e-9f89-102fd3a1a8e8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4fff27847f74c39b425dba724cf847f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdedb3257fe94513bd5c51de0ae1d737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:08.266553 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e85b5867-58eb-4f6e-9f89-102fd3a1a8e8 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e" status: 200 len: 1304 microversion: 2.1 time: 0.369779 Oct 30 01:30:08.267134 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1897/3795] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:07 2022] GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e => generated 1304 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:08.323187 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9caf8890-dc83-492f-898e-6a2c6a8ed03b tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:08.330750 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9caf8890-dc83-492f-898e-6a2c6a8ed03b tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0" status: 200 len: 1246 microversion: 2.1 time: 0.116519 Oct 30 01:30:08.333195 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1899/3796] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:08 2022] GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0 => generated 1246 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:08.465958 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-76f15916-7528-43d3-91f6-e66291519cdb tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:08.466963 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-76f15916-7528-43d3-91f6-e66291519cdb tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 06199cbd-cf2c-426d-a842-4dedd8359945] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:08.483426 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-76f15916-7528-43d3-91f6-e66291519cdb tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:08.484424 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-76f15916-7528-43d3-91f6-e66291519cdb tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:08.485099 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-76f15916-7528-43d3-91f6-e66291519cdb tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:08.486156 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-76f15916-7528-43d3-91f6-e66291519cdb tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:08.487027 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-76f15916-7528-43d3-91f6-e66291519cdb tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:08.487558 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-76f15916-7528-43d3-91f6-e66291519cdb tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:08.923112 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-76f15916-7528-43d3-91f6-e66291519cdb tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:08.937932 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-76f15916-7528-43d3-91f6-e66291519cdb tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/06199cbd-cf2c-426d-a842-4dedd8359945" status: 200 len: 1327 microversion: 2.1 time: 0.477780 Oct 30 01:30:08.953356 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1898/3797] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:08 2022] GET /compute/v2.1/servers/06199cbd-cf2c-426d-a842-4dedd8359945 => generated 1327 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:09.210893 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-08853ecb-7224-427a-ab3a-20fb1c0f68d9 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44d0464310>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:09.301987 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a83f272e-de90-4a64-a7b4-f08c2ce67c51 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:09.306084 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a83f272e-de90-4a64-a7b4-f08c2ce67c51 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] [instance: d01c1c62-c352-4a98-b95b-51ff385a415e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:09.313899 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-08853ecb-7224-427a-ab3a-20fb1c0f68d9 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/89bf1d5a-9053-4405-a355-19a4ae907b0a" status: 200 len: 1452 microversion: 2.1 time: 0.108382 Oct 30 01:30:09.318220 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1900/3798] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:30:09 2022] GET /compute/v2.1/images/89bf1d5a-9053-4405-a355-19a4ae907b0a => generated 1452 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:09.329113 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a83f272e-de90-4a64-a7b4-f08c2ce67c51 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:09.331734 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a83f272e-de90-4a64-a7b4-f08c2ce67c51 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:09.334158 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a83f272e-de90-4a64-a7b4-f08c2ce67c51 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:09.336223 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a83f272e-de90-4a64-a7b4-f08c2ce67c51 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:09.338984 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a83f272e-de90-4a64-a7b4-f08c2ce67c51 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:09.339805 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a83f272e-de90-4a64-a7b4-f08c2ce67c51 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:09.360850 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5308a66d-156a-4a54-bc62-f59dceae9e23 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:09.362055 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5308a66d-156a-4a54-bc62-f59dceae9e23 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:09.369810 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-a83f272e-de90-4a64-a7b4-f08c2ce67c51 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] HTTP exception thrown: Instance d01c1c62-c352-4a98-b95b-51ff385a415e could not be found. Oct 30 01:30:09.381889 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5308a66d-156a-4a54-bc62-f59dceae9e23 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:09.382569 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5308a66d-156a-4a54-bc62-f59dceae9e23 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:09.383229 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5308a66d-156a-4a54-bc62-f59dceae9e23 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:09.384181 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5308a66d-156a-4a54-bc62-f59dceae9e23 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:09.384840 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5308a66d-156a-4a54-bc62-f59dceae9e23 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:09.387273 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5308a66d-156a-4a54-bc62-f59dceae9e23 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a83f272e-de90-4a64-a7b4-f08c2ce67c51 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Request method failure captured: Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e HTTP/1.1 Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdMMWFyyUxAoaESDELtE-V_UowuEFaMAStnAKDd_oGTPyzdk4CJerWgZwlpHMRAfZp4W1HA7ps5vIDduTLFNEG_EYa21IevkA1tO43oRZUZl9q8I_RKBcXX4o5SggCKhmE0KIlBQfeAcmElecAJmCsV4OK6pVQ4iyBWATev8MUtB8PI Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: fdedb3257fe94513bd5c51de0ae1d737 Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServerRescueTestJSON-1222025265 Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fdedb3257fe94513bd5c51de0ae1d737"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_fdedb3257fe94513bd5c51de0ae1d737"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/fdedb3257fe94513bd5c51de0ae1d737"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fdedb3257fe94513bd5c51de0ae1d737"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServerRescueTestJSON-1222025265 Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: fdedb3257fe94513bd5c51de0ae1d737 Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServerRescueTestJSON-1222025265 Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServerRescueTestJSON-1222025265-project Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: a4fff27847f74c39b425dba724cf847f Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServerRescueTestJSON-1222025265-project Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: exception: Instance d01c1c62-c352-4a98-b95b-51ff385a415e could not be found. Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'd01c1c62-c352-4a98-b95b-51ff385a415e'} Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d01c1c62-c352-4a98-b95b-51ff385a415e could not be found. Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d01c1c62-c352-4a98-b95b-51ff385a415e could not be found. Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:30:09.390361 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:30:09.396232 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:30:09.396232 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:30:09.396232 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:30:09.396232 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:30:09.396232 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:30:09.396232 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d01c1c62-c352-4a98-b95b-51ff385a415e could not be found. Oct 30 01:30:09.396232 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:30:09.397131 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a83f272e-de90-4a64-a7b4-f08c2ce67c51 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] Returning 404 to user: Instance d01c1c62-c352-4a98-b95b-51ff385a415e could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:30:09.401871 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a83f272e-de90-4a64-a7b4-f08c2ce67c51 tempest-ServerRescueTestJSON-1222025265 tempest-ServerRescueTestJSON-1222025265-project] 10.222.0.13 "GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e" status: 404 len: 111 microversion: 2.1 time: 0.102190 Oct 30 01:30:09.406227 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1899/3799] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:09 2022] GET /compute/v2.1/servers/d01c1c62-c352-4a98-b95b-51ff385a415e => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:30:09.632161 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5308a66d-156a-4a54-bc62-f59dceae9e23 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:09.656294 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5308a66d-156a-4a54-bc62-f59dceae9e23 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0" status: 200 len: 1298 microversion: 2.1 time: 0.300529 Oct 30 01:30:09.674128 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1901/3800] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:09 2022] GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0 => generated 1298 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:30:09.983150 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-877359d6-f3b4-4330-be43-c5a69317f578 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:09.987843 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-877359d6-f3b4-4330-be43-c5a69317f578 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 06199cbd-cf2c-426d-a842-4dedd8359945] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:10.015481 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-877359d6-f3b4-4330-be43-c5a69317f578 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:10.019253 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-877359d6-f3b4-4330-be43-c5a69317f578 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:10.020789 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-877359d6-f3b4-4330-be43-c5a69317f578 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:10.029310 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-877359d6-f3b4-4330-be43-c5a69317f578 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:10.030432 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-877359d6-f3b4-4330-be43-c5a69317f578 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:10.031541 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-877359d6-f3b4-4330-be43-c5a69317f578 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:10.333311 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-856844d0-5627-4327-82f3-fd44ecee8345 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44d0464280>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:10.409863 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-856844d0-5627-4327-82f3-fd44ecee8345 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/89bf1d5a-9053-4405-a355-19a4ae907b0a" status: 200 len: 1452 microversion: 2.1 time: 0.080544 Oct 30 01:30:10.410446 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1902/3801] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:30:10 2022] GET /compute/v2.1/images/89bf1d5a-9053-4405-a355-19a4ae907b0a => generated 1452 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:10.684535 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9a82b6be-b5a0-4f3d-a943-3428bbfe7681 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:10.685468 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9a82b6be-b5a0-4f3d-a943-3428bbfe7681 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:10.699216 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9a82b6be-b5a0-4f3d-a943-3428bbfe7681 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:10.701387 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9a82b6be-b5a0-4f3d-a943-3428bbfe7681 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:10.714110 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9a82b6be-b5a0-4f3d-a943-3428bbfe7681 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:10.715291 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9a82b6be-b5a0-4f3d-a943-3428bbfe7681 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:10.716077 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9a82b6be-b5a0-4f3d-a943-3428bbfe7681 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:10.716683 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9a82b6be-b5a0-4f3d-a943-3428bbfe7681 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:10.994290 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9a82b6be-b5a0-4f3d-a943-3428bbfe7681 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:11.008505 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9a82b6be-b5a0-4f3d-a943-3428bbfe7681 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0" status: 200 len: 1316 microversion: 2.1 time: 0.328160 Oct 30 01:30:11.023273 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1903/3802] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:10 2022] GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0 => generated 1316 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:11.244062 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-877359d6-f3b4-4330-be43-c5a69317f578 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:11.277205 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-877359d6-f3b4-4330-be43-c5a69317f578 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/06199cbd-cf2c-426d-a842-4dedd8359945" status: 200 len: 1327 microversion: 2.1 time: 1.312391 Oct 30 01:30:11.290447 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1900/3803] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:09 2022] GET /compute/v2.1/servers/06199cbd-cf2c-426d-a842-4dedd8359945 => generated 1327 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:11.426662 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e04a4ccc-3d61-4d63-a9fd-4c4e2eb49bed tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44d03ff820>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:11.470723 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e04a4ccc-3d61-4d63-a9fd-4c4e2eb49bed tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/89bf1d5a-9053-4405-a355-19a4ae907b0a" status: 200 len: 1452 microversion: 2.1 time: 0.048418 Oct 30 01:30:11.471500 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1904/3804] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:30:11 2022] GET /compute/v2.1/images/89bf1d5a-9053-4405-a355-19a4ae907b0a => generated 1452 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:30:12.041351 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-700e43f3-1d67-42a9-a21b-49408129f2ae tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:12.042064 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-700e43f3-1d67-42a9-a21b-49408129f2ae tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:12.071266 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-700e43f3-1d67-42a9-a21b-49408129f2ae tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:12.077576 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-700e43f3-1d67-42a9-a21b-49408129f2ae tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:12.078338 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-700e43f3-1d67-42a9-a21b-49408129f2ae tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:12.081579 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-700e43f3-1d67-42a9-a21b-49408129f2ae tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:12.082255 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-700e43f3-1d67-42a9-a21b-49408129f2ae tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:12.084079 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-700e43f3-1d67-42a9-a21b-49408129f2ae tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:12.303944 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-68e49041-7d35-4f3e-9983-2207cba1247f tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:12.304572 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-68e49041-7d35-4f3e-9983-2207cba1247f tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 06199cbd-cf2c-426d-a842-4dedd8359945] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:12.319559 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-68e49041-7d35-4f3e-9983-2207cba1247f tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:12.340285 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-68e49041-7d35-4f3e-9983-2207cba1247f tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:12.340840 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-68e49041-7d35-4f3e-9983-2207cba1247f tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:12.341645 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-68e49041-7d35-4f3e-9983-2207cba1247f tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:12.342121 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-68e49041-7d35-4f3e-9983-2207cba1247f tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:12.342547 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-68e49041-7d35-4f3e-9983-2207cba1247f tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:13.247479 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-700e43f3-1d67-42a9-a21b-49408129f2ae tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:13.248912 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-68e49041-7d35-4f3e-9983-2207cba1247f tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:13.267726 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-700e43f3-1d67-42a9-a21b-49408129f2ae tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0" status: 200 len: 1372 microversion: 2.1 time: 1.235422 Oct 30 01:30:13.274083 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1901/3805] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:12 2022] GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0 => generated 1372 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:30:13.275641 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-68e49041-7d35-4f3e-9983-2207cba1247f tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/06199cbd-cf2c-426d-a842-4dedd8359945" status: 200 len: 1327 microversion: 2.1 time: 0.972256 Oct 30 01:30:13.280525 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1905/3806] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:12 2022] GET /compute/v2.1/servers/06199cbd-cf2c-426d-a842-4dedd8359945 => generated 1327 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:13.287664 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8e0b4c96-c919-49ea-8467-b2f6a3dcf661 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44d03f7ee0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:13.414840 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8e0b4c96-c919-49ea-8467-b2f6a3dcf661 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/89bf1d5a-9053-4405-a355-19a4ae907b0a" status: 200 len: 1452 microversion: 2.1 time: 0.139295 Oct 30 01:30:13.428758 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1902/3807] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:30:13 2022] GET /compute/v2.1/images/89bf1d5a-9053-4405-a355-19a4ae907b0a => generated 1452 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:14.167459 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-0bc81ced-b84d-4101-acfc-c3f4def82557 req-9592551d-7e15-4aec-8a19-c0b154573594 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06199cbd-cf2c-426d-a842-4dedd8359945", "name": "network-vif-plugged", "status": "completed", "tag": "3ac9c01a-5607-4d65-aad3-0c30849ebdda"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:30:14.198950 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-0bc81ced-b84d-4101-acfc-c3f4def82557 req-9592551d-7e15-4aec-8a19-c0b154573594 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:14.201819 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-0bc81ced-b84d-4101-acfc-c3f4def82557 req-9592551d-7e15-4aec-8a19-c0b154573594 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:14.202928 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-0bc81ced-b84d-4101-acfc-c3f4def82557 req-9592551d-7e15-4aec-8a19-c0b154573594 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:14.241023 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-0bc81ced-b84d-4101-acfc-c3f4def82557 req-9592551d-7e15-4aec-8a19-c0b154573594 service nova] Creating event network-vif-plugged:3ac9c01a-5607-4d65-aad3-0c30849ebdda for instance 06199cbd-cf2c-426d-a842-4dedd8359945 on n-h2-master-1 Oct 30 01:30:14.256036 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-0bc81ced-b84d-4101-acfc-c3f4def82557 req-9592551d-7e15-4aec-8a19-c0b154573594 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088438 Oct 30 01:30:14.260662 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1906/3808] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:30:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:30:14.330011 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1ef11a20-5329-4e6d-9144-b380d764228b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:14.335563 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1ef11a20-5329-4e6d-9144-b380d764228b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 06199cbd-cf2c-426d-a842-4dedd8359945] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:14.335738 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ea63819b-de59-4ab8-8177-c7043c8ce924 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:14.353577 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ea63819b-de59-4ab8-8177-c7043c8ce924 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:14.416449 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea63819b-de59-4ab8-8177-c7043c8ce924 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:14.418077 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1ef11a20-5329-4e6d-9144-b380d764228b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:14.421014 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1ef11a20-5329-4e6d-9144-b380d764228b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:14.425219 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea63819b-de59-4ab8-8177-c7043c8ce924 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:14.425674 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1ef11a20-5329-4e6d-9144-b380d764228b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:14.426377 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea63819b-de59-4ab8-8177-c7043c8ce924 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:14.436330 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1ef11a20-5329-4e6d-9144-b380d764228b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:14.439631 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1ef11a20-5329-4e6d-9144-b380d764228b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:14.444102 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea63819b-de59-4ab8-8177-c7043c8ce924 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:14.444965 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1ef11a20-5329-4e6d-9144-b380d764228b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:14.448483 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea63819b-de59-4ab8-8177-c7043c8ce924 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:14.453360 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea63819b-de59-4ab8-8177-c7043c8ce924 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:15.100749 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1ef11a20-5329-4e6d-9144-b380d764228b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:15.110037 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1ef11a20-5329-4e6d-9144-b380d764228b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/06199cbd-cf2c-426d-a842-4dedd8359945" status: 200 len: 1327 microversion: 2.1 time: 0.811227 Oct 30 01:30:15.113628 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1903/3809] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:14 2022] GET /compute/v2.1/servers/06199cbd-cf2c-426d-a842-4dedd8359945 => generated 1327 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:15.120023 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ac70eba5-e612-46d9-84cf-c54b16e4f3a5 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44c79f0040>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:15.190000 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ea63819b-de59-4ab8-8177-c7043c8ce924 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:15.207504 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ea63819b-de59-4ab8-8177-c7043c8ce924 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0" status: 200 len: 1372 microversion: 2.1 time: 0.890085 Oct 30 01:30:15.217288 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ac70eba5-e612-46d9-84cf-c54b16e4f3a5 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/89bf1d5a-9053-4405-a355-19a4ae907b0a" status: 200 len: 1452 microversion: 2.1 time: 0.102464 Oct 30 01:30:15.218643 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1904/3810] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:30:15 2022] GET /compute/v2.1/images/89bf1d5a-9053-4405-a355-19a4ae907b0a => generated 1452 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:15.222274 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1907/3811] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:14 2022] GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0 => generated 1372 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:30:15.224267 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-1e45b633-aa32-4ac8-b515-67d007b81bc4 req-c6fb2cd2-2c3a-48bb-8746-6bf8fea275b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0", "tag": "b06d8a65-6a4c-4fc9-9c2f-932d1a6b84ab"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:30:15.236950 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-1e45b633-aa32-4ac8-b515-67d007b81bc4 req-c6fb2cd2-2c3a-48bb-8746-6bf8fea275b8 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:15.237786 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-1e45b633-aa32-4ac8-b515-67d007b81bc4 req-c6fb2cd2-2c3a-48bb-8746-6bf8fea275b8 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:15.238471 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-1e45b633-aa32-4ac8-b515-67d007b81bc4 req-c6fb2cd2-2c3a-48bb-8746-6bf8fea275b8 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:15.252449 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-1e45b633-aa32-4ac8-b515-67d007b81bc4 req-c6fb2cd2-2c3a-48bb-8746-6bf8fea275b8 service nova] Creating event network-changed:b06d8a65-6a4c-4fc9-9c2f-932d1a6b84ab for instance 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0 on n-h1-master-1 Oct 30 01:30:15.263433 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-1e45b633-aa32-4ac8-b515-67d007b81bc4 req-c6fb2cd2-2c3a-48bb-8746-6bf8fea275b8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040994 Oct 30 01:30:15.263433 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1905/3812] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:30:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:30:16.136772 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-aca38286-f77f-4ba6-9081-d5f0d852d433 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:16.137567 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-aca38286-f77f-4ba6-9081-d5f0d852d433 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 06199cbd-cf2c-426d-a842-4dedd8359945] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:16.155415 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aca38286-f77f-4ba6-9081-d5f0d852d433 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:16.156283 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aca38286-f77f-4ba6-9081-d5f0d852d433 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:16.158094 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aca38286-f77f-4ba6-9081-d5f0d852d433 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:16.159290 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aca38286-f77f-4ba6-9081-d5f0d852d433 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:16.163365 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aca38286-f77f-4ba6-9081-d5f0d852d433 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:16.164376 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aca38286-f77f-4ba6-9081-d5f0d852d433 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:16.234182 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-75589312-84a2-46dd-a41b-d1df890ffcdb tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:16.236411 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-75589312-84a2-46dd-a41b-d1df890ffcdb tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:16.256000 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:30:16.259447 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-75589312-84a2-46dd-a41b-d1df890ffcdb tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:16.259958 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-75589312-84a2-46dd-a41b-d1df890ffcdb tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:16.262934 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-75589312-84a2-46dd-a41b-d1df890ffcdb tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:16.263978 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-75589312-84a2-46dd-a41b-d1df890ffcdb tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:16.264481 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-75589312-84a2-46dd-a41b-d1df890ffcdb tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:16.265800 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-75589312-84a2-46dd-a41b-d1df890ffcdb tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:16.646429 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-aca38286-f77f-4ba6-9081-d5f0d852d433 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:16.662163 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-aca38286-f77f-4ba6-9081-d5f0d852d433 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/06199cbd-cf2c-426d-a842-4dedd8359945" status: 200 len: 1327 microversion: 2.1 time: 0.530600 Oct 30 01:30:16.663172 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1908/3813] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:16 2022] GET /compute/v2.1/servers/06199cbd-cf2c-426d-a842-4dedd8359945 => generated 1327 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:16.673595 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4d08aae4-01fb-4c3d-8c78-9dc873504a44 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44d03de430>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:16.733587 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:30:16.751079 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4d08aae4-01fb-4c3d-8c78-9dc873504a44 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/89bf1d5a-9053-4405-a355-19a4ae907b0a" status: 200 len: 1452 microversion: 2.1 time: 0.086662 Oct 30 01:30:16.751681 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1909/3814] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:30:16 2022] GET /compute/v2.1/images/89bf1d5a-9053-4405-a355-19a4ae907b0a => generated 1452 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:16.837751 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-75589312-84a2-46dd-a41b-d1df890ffcdb tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:16.852031 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-75589312-84a2-46dd-a41b-d1df890ffcdb tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0" status: 200 len: 1372 microversion: 2.1 time: 0.624413 Oct 30 01:30:16.853545 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1906/3815] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:16 2022] GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0 => generated 1372 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:17.688114 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-15d4427c-b4a8-4480-b109-a583ae017a12 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:17.696505 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-15d4427c-b4a8-4480-b109-a583ae017a12 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 06199cbd-cf2c-426d-a842-4dedd8359945] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:17.712805 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-15d4427c-b4a8-4480-b109-a583ae017a12 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:17.713326 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-15d4427c-b4a8-4480-b109-a583ae017a12 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:17.713784 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-15d4427c-b4a8-4480-b109-a583ae017a12 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:17.714501 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-15d4427c-b4a8-4480-b109-a583ae017a12 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:17.722005 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-15d4427c-b4a8-4480-b109-a583ae017a12 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:17.722452 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-15d4427c-b4a8-4480-b109-a583ae017a12 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:17.767198 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-875f0a5a-b1bc-410a-87c1-c976f135c849 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44c7c78790>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:17.801838 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=8 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:30:17.902948 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-875f0a5a-b1bc-410a-87c1-c976f135c849 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/89bf1d5a-9053-4405-a355-19a4ae907b0a" status: 200 len: 1452 microversion: 2.1 time: 0.140074 Oct 30 01:30:17.915071 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1907/3816] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:30:17 2022] GET /compute/v2.1/images/89bf1d5a-9053-4405-a355-19a4ae907b0a => generated 1452 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:30:17.915071 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9aae48aa-7d74-4850-9ab3-8a2c575204c5 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:17.915071 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9aae48aa-7d74-4850-9ab3-8a2c575204c5 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:17.922564 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9aae48aa-7d74-4850-9ab3-8a2c575204c5 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:17.923079 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9aae48aa-7d74-4850-9ab3-8a2c575204c5 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:17.923533 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9aae48aa-7d74-4850-9ab3-8a2c575204c5 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:17.924334 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9aae48aa-7d74-4850-9ab3-8a2c575204c5 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:17.924860 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9aae48aa-7d74-4850-9ab3-8a2c575204c5 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:17.925303 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9aae48aa-7d74-4850-9ab3-8a2c575204c5 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:17.932127 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:30:18.330545 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=12 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:30:18.469244 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9aae48aa-7d74-4850-9ab3-8a2c575204c5 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:18.481301 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-15d4427c-b4a8-4480-b109-a583ae017a12 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:18.488095 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9aae48aa-7d74-4850-9ab3-8a2c575204c5 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0" status: 200 len: 1372 microversion: 2.1 time: 0.570400 Oct 30 01:30:18.491617 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1908/3817] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:17 2022] GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0 => generated 1372 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:18.495096 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-15d4427c-b4a8-4480-b109-a583ae017a12 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/06199cbd-cf2c-426d-a842-4dedd8359945" status: 200 len: 1508 microversion: 2.1 time: 0.813238 Oct 30 01:30:18.507864 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1910/3818] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:17 2022] GET /compute/v2.1/servers/06199cbd-cf2c-426d-a842-4dedd8359945 => generated 1508 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:18.523485 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-87f721ae-1f4b-43c4-a86a-a2c4b020e361 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:18.524582 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-87f721ae-1f4b-43c4-a86a-a2c4b020e361 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 06199cbd-cf2c-426d-a842-4dedd8359945] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:18.537755 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-87f721ae-1f4b-43c4-a86a-a2c4b020e361 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:18.539109 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-87f721ae-1f4b-43c4-a86a-a2c4b020e361 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:18.539736 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-87f721ae-1f4b-43c4-a86a-a2c4b020e361 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:18.540453 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-87f721ae-1f4b-43c4-a86a-a2c4b020e361 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:18.541094 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-87f721ae-1f4b-43c4-a86a-a2c4b020e361 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:18.541559 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-87f721ae-1f4b-43c4-a86a-a2c4b020e361 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:18.710103 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-87f721ae-1f4b-43c4-a86a-a2c4b020e361 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:18.717992 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-87f721ae-1f4b-43c4-a86a-a2c4b020e361 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/06199cbd-cf2c-426d-a842-4dedd8359945" status: 200 len: 1508 microversion: 2.1 time: 0.201090 Oct 30 01:30:18.718588 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1909/3819] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:18 2022] GET /compute/v2.1/servers/06199cbd-cf2c-426d-a842-4dedd8359945 => generated 1508 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:30:18.740823 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ebcfd226-71f7-4dc7-8f38-045517adb1d8 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:18.741473 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ebcfd226-71f7-4dc7-8f38-045517adb1d8 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 06199cbd-cf2c-426d-a842-4dedd8359945] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:18.748252 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ebcfd226-71f7-4dc7-8f38-045517adb1d8 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:18.748736 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ebcfd226-71f7-4dc7-8f38-045517adb1d8 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:18.749172 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ebcfd226-71f7-4dc7-8f38-045517adb1d8 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:18.750444 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ebcfd226-71f7-4dc7-8f38-045517adb1d8 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:18.750937 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ebcfd226-71f7-4dc7-8f38-045517adb1d8 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:18.751367 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ebcfd226-71f7-4dc7-8f38-045517adb1d8 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:18.781379 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ebcfd226-71f7-4dc7-8f38-045517adb1d8 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 06199cbd-cf2c-426d-a842-4dedd8359945] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:30:18.920102 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1bde5ee3-11ab-42d0-8dce-175acdcec581 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44c7c17e50>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:18.966835 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1bde5ee3-11ab-42d0-8dce-175acdcec581 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/89bf1d5a-9053-4405-a355-19a4ae907b0a" status: 200 len: 1452 microversion: 2.1 time: 0.050534 Oct 30 01:30:18.967498 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1910/3820] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:30:18 2022] GET /compute/v2.1/images/89bf1d5a-9053-4405-a355-19a4ae907b0a => generated 1452 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:30:19.438819 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ebcfd226-71f7-4dc7-8f38-045517adb1d8 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "DELETE /compute/v2.1/servers/06199cbd-cf2c-426d-a842-4dedd8359945" status: 204 len: 0 microversion: 2.1 time: 0.699256 Oct 30 01:30:19.444041 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1911/3821] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:30:18 2022] DELETE /compute/v2.1/servers/06199cbd-cf2c-426d-a842-4dedd8359945 => generated 0 bytes in 705 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:30:19.452525 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6721ad88-47f2-4c0a-bf51-6dc18c0a96fe tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:19.453543 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6721ad88-47f2-4c0a-bf51-6dc18c0a96fe tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 06199cbd-cf2c-426d-a842-4dedd8359945] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:19.478216 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6721ad88-47f2-4c0a-bf51-6dc18c0a96fe tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:19.479845 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6721ad88-47f2-4c0a-bf51-6dc18c0a96fe tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:19.481546 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6721ad88-47f2-4c0a-bf51-6dc18c0a96fe tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:19.486233 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6721ad88-47f2-4c0a-bf51-6dc18c0a96fe tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:19.490733 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6721ad88-47f2-4c0a-bf51-6dc18c0a96fe tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:19.492824 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6721ad88-47f2-4c0a-bf51-6dc18c0a96fe tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:19.519337 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f56c3fec-6b3c-43f7-a316-66facc8bfcd2 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:19.520318 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f56c3fec-6b3c-43f7-a316-66facc8bfcd2 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:19.528704 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f56c3fec-6b3c-43f7-a316-66facc8bfcd2 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:19.534114 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f56c3fec-6b3c-43f7-a316-66facc8bfcd2 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:19.535142 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f56c3fec-6b3c-43f7-a316-66facc8bfcd2 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:19.536195 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f56c3fec-6b3c-43f7-a316-66facc8bfcd2 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:19.539388 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f56c3fec-6b3c-43f7-a316-66facc8bfcd2 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:19.540223 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f56c3fec-6b3c-43f7-a316-66facc8bfcd2 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:19.823516 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6721ad88-47f2-4c0a-bf51-6dc18c0a96fe tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:19.834980 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6721ad88-47f2-4c0a-bf51-6dc18c0a96fe tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/06199cbd-cf2c-426d-a842-4dedd8359945" status: 200 len: 1514 microversion: 2.1 time: 0.389482 Oct 30 01:30:19.849084 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1911/3822] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:19 2022] GET /compute/v2.1/servers/06199cbd-cf2c-426d-a842-4dedd8359945 => generated 1514 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:19.944497 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f56c3fec-6b3c-43f7-a316-66facc8bfcd2 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:19.944497 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f56c3fec-6b3c-43f7-a316-66facc8bfcd2 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0" status: 200 len: 1372 microversion: 2.1 time: 0.413647 Oct 30 01:30:19.944497 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1912/3823] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:19 2022] GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0 => generated 1372 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:30:19.985058 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c863b440-26b2-4596-b76a-031018b86cc8 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44c7c17820>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:20.038529 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c863b440-26b2-4596-b76a-031018b86cc8 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/89bf1d5a-9053-4405-a355-19a4ae907b0a" status: 200 len: 1452 microversion: 2.1 time: 0.059288 Oct 30 01:30:20.039210 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1912/3824] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:30:19 2022] GET /compute/v2.1/images/89bf1d5a-9053-4405-a355-19a4ae907b0a => generated 1452 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:30:20.798004 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-08e626e4-68e3-49f5-b15f-8147abdce7f9 req-81e04540-0031-47d9-968b-a8e40041bafd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0", "name": "network-vif-plugged", "status": "completed", "tag": "b06d8a65-6a4c-4fc9-9c2f-932d1a6b84ab"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:30:20.825668 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-08e626e4-68e3-49f5-b15f-8147abdce7f9 req-81e04540-0031-47d9-968b-a8e40041bafd service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:20.834684 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-08e626e4-68e3-49f5-b15f-8147abdce7f9 req-81e04540-0031-47d9-968b-a8e40041bafd service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:20.834684 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-08e626e4-68e3-49f5-b15f-8147abdce7f9 req-81e04540-0031-47d9-968b-a8e40041bafd service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:20.849001 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-08e626e4-68e3-49f5-b15f-8147abdce7f9 req-81e04540-0031-47d9-968b-a8e40041bafd service nova] Creating event network-vif-plugged:b06d8a65-6a4c-4fc9-9c2f-932d1a6b84ab for instance 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0 on n-h1-master-1 Oct 30 01:30:20.859407 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-08e626e4-68e3-49f5-b15f-8147abdce7f9 req-81e04540-0031-47d9-968b-a8e40041bafd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070631 Oct 30 01:30:20.860267 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1913/3825] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:30:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:30:20.864444 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-db26f1d2-f002-4a2f-85bc-8b52307c7db6 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:20.864885 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-db26f1d2-f002-4a2f-85bc-8b52307c7db6 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 06199cbd-cf2c-426d-a842-4dedd8359945] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:20.872683 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-db26f1d2-f002-4a2f-85bc-8b52307c7db6 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:20.873182 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-db26f1d2-f002-4a2f-85bc-8b52307c7db6 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:20.873687 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-db26f1d2-f002-4a2f-85bc-8b52307c7db6 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:20.874904 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-db26f1d2-f002-4a2f-85bc-8b52307c7db6 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:20.875954 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-db26f1d2-f002-4a2f-85bc-8b52307c7db6 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:20.876438 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-db26f1d2-f002-4a2f-85bc-8b52307c7db6 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:20.954747 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ea3cc8fa-27fc-4006-818f-6fb32ee02fa2 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:20.956065 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ea3cc8fa-27fc-4006-818f-6fb32ee02fa2 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:20.972491 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea3cc8fa-27fc-4006-818f-6fb32ee02fa2 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:20.975280 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea3cc8fa-27fc-4006-818f-6fb32ee02fa2 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:20.976953 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea3cc8fa-27fc-4006-818f-6fb32ee02fa2 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:20.978029 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea3cc8fa-27fc-4006-818f-6fb32ee02fa2 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:20.978505 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea3cc8fa-27fc-4006-818f-6fb32ee02fa2 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:20.978973 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea3cc8fa-27fc-4006-818f-6fb32ee02fa2 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:21.168187 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-db26f1d2-f002-4a2f-85bc-8b52307c7db6 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:21.179592 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-db26f1d2-f002-4a2f-85bc-8b52307c7db6 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/06199cbd-cf2c-426d-a842-4dedd8359945" status: 200 len: 1514 microversion: 2.1 time: 0.323419 Oct 30 01:30:21.199250 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1913/3826] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:20 2022] GET /compute/v2.1/servers/06199cbd-cf2c-426d-a842-4dedd8359945 => generated 1514 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:21.214533 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e5d46789-7d91-4877-8fd6-2ce2a44e9411 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44d03f5430>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:21.284400 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e5d46789-7d91-4877-8fd6-2ce2a44e9411 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/89bf1d5a-9053-4405-a355-19a4ae907b0a" status: 200 len: 1461 microversion: 2.1 time: 0.081309 Oct 30 01:30:21.285457 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1914/3827] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:30:21 2022] GET /compute/v2.1/images/89bf1d5a-9053-4405-a355-19a4ae907b0a => generated 1461 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:21.304649 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-93389b4c-8be0-4687-81e5-89e75542bbde tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44c7b3bc10>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:21.359443 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-93389b4c-8be0-4687-81e5-89e75542bbde tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/89bf1d5a-9053-4405-a355-19a4ae907b0a" status: 200 len: 1461 microversion: 2.1 time: 0.060376 Oct 30 01:30:21.360223 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1915/3828] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:30:21 2022] GET /compute/v2.1/images/89bf1d5a-9053-4405-a355-19a4ae907b0a => generated 1461 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:21.375522 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e3ff2e9d-749f-4c06-b1e3-7026eeda1b6f tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:21.376149 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e3ff2e9d-749f-4c06-b1e3-7026eeda1b6f tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] [instance: e9368bd4-9715-46b3-91bb-cb436f7120f3] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:21.382593 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e3ff2e9d-749f-4c06-b1e3-7026eeda1b6f tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:21.385092 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e3ff2e9d-749f-4c06-b1e3-7026eeda1b6f tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:21.385092 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e3ff2e9d-749f-4c06-b1e3-7026eeda1b6f tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:21.385092 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e3ff2e9d-749f-4c06-b1e3-7026eeda1b6f tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:21.385092 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e3ff2e9d-749f-4c06-b1e3-7026eeda1b6f tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:21.385631 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e3ff2e9d-749f-4c06-b1e3-7026eeda1b6f tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:21.392854 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ea3cc8fa-27fc-4006-818f-6fb32ee02fa2 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:21.395858 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:30:21.400777 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ea3cc8fa-27fc-4006-818f-6fb32ee02fa2 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0" status: 200 len: 1372 microversion: 2.1 time: 0.452306 Oct 30 01:30:21.419569 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1914/3829] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:20 2022] GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0 => generated 1372 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:30:21.667679 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e3ff2e9d-749f-4c06-b1e3-7026eeda1b6f tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea8a24166674250a98268ae52604f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcce1fadf54d089ec4fd751a3cf6ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:21.677596 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e3ff2e9d-749f-4c06-b1e3-7026eeda1b6f tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/servers/e9368bd4-9715-46b3-91bb-cb436f7120f3" status: 200 len: 1467 microversion: 2.1 time: 0.306561 Oct 30 01:30:21.678600 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1916/3830] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:21 2022] GET /compute/v2.1/servers/e9368bd4-9715-46b3-91bb-cb436f7120f3 => generated 1467 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:21.701966 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9b5c6765-54fc-40d2-9a9e-bfc8342b10f4 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-52435017"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:30:21.706718 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9b5c6765-54fc-40d2-9a9e-bfc8342b10f4 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] [instance: 99db82dd-3238-4af1-9f90-1dd69cdd836a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:21.714837 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b5c6765-54fc-40d2-9a9e-bfc8342b10f4 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:21.715670 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b5c6765-54fc-40d2-9a9e-bfc8342b10f4 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:21.716399 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b5c6765-54fc-40d2-9a9e-bfc8342b10f4 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:21.717363 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b5c6765-54fc-40d2-9a9e-bfc8342b10f4 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:21.718774 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b5c6765-54fc-40d2-9a9e-bfc8342b10f4 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:21.719510 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b5c6765-54fc-40d2-9a9e-bfc8342b10f4 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:22.020077 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-c91b8544-1f88-40f6-987c-2f13e08f9836 req-f13392a3-d994-424e-a4c5-230170073df0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06199cbd-cf2c-426d-a842-4dedd8359945", "name": "network-vif-deleted", "tag": "3ac9c01a-5607-4d65-aad3-0c30849ebdda"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:30:22.039835 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-c91b8544-1f88-40f6-987c-2f13e08f9836 req-f13392a3-d994-424e-a4c5-230170073df0 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:22.041218 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-c91b8544-1f88-40f6-987c-2f13e08f9836 req-f13392a3-d994-424e-a4c5-230170073df0 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:22.041873 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-c91b8544-1f88-40f6-987c-2f13e08f9836 req-f13392a3-d994-424e-a4c5-230170073df0 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:22.070452 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-c91b8544-1f88-40f6-987c-2f13e08f9836 req-f13392a3-d994-424e-a4c5-230170073df0 service nova] Creating event network-vif-deleted:3ac9c01a-5607-4d65-aad3-0c30849ebdda for instance 06199cbd-cf2c-426d-a842-4dedd8359945 on n-h2-master-1 Oct 30 01:30:22.076492 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-c91b8544-1f88-40f6-987c-2f13e08f9836 req-f13392a3-d994-424e-a4c5-230170073df0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059858 Oct 30 01:30:22.081032 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1917/3831] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:30:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:30:22.208389 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-86b32953-a93a-4014-9630-5bc9957868b0 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:22.210023 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-86b32953-a93a-4014-9630-5bc9957868b0 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 06199cbd-cf2c-426d-a842-4dedd8359945] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:22.216467 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-86b32953-a93a-4014-9630-5bc9957868b0 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:22.216968 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-86b32953-a93a-4014-9630-5bc9957868b0 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:22.217475 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-86b32953-a93a-4014-9630-5bc9957868b0 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:22.218933 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-86b32953-a93a-4014-9630-5bc9957868b0 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:22.219521 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-86b32953-a93a-4014-9630-5bc9957868b0 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:22.219962 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-86b32953-a93a-4014-9630-5bc9957868b0 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:22.317856 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-86b32953-a93a-4014-9630-5bc9957868b0 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:22.329654 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-86b32953-a93a-4014-9630-5bc9957868b0 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/06199cbd-cf2c-426d-a842-4dedd8359945" status: 200 len: 1472 microversion: 2.1 time: 0.125302 Oct 30 01:30:22.330586 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1918/3832] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:22 2022] GET /compute/v2.1/servers/06199cbd-cf2c-426d-a842-4dedd8359945 => generated 1472 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:30:22.405775 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9b5c6765-54fc-40d2-9a9e-bfc8342b10f4 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "POST /compute/v2.1/servers/99db82dd-3238-4af1-9f90-1dd69cdd836a/action" status: 202 len: 0 microversion: 2.1 time: 0.708251 Oct 30 01:30:22.407067 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1915/3833] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:30:21 2022] POST /compute/v2.1/servers/99db82dd-3238-4af1-9f90-1dd69cdd836a/action => generated 0 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 30 01:30:22.419836 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-dcce28a2-c397-4dbf-b994-c8533c238d77 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44c7c789d0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:22.430267 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ac3ef163-e29b-4439-bdbd-6f589e06d833 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:22.431666 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ac3ef163-e29b-4439-bdbd-6f589e06d833 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:22.442991 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ac3ef163-e29b-4439-bdbd-6f589e06d833 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:22.442991 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ac3ef163-e29b-4439-bdbd-6f589e06d833 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:22.442991 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ac3ef163-e29b-4439-bdbd-6f589e06d833 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:22.443980 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ac3ef163-e29b-4439-bdbd-6f589e06d833 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:22.445153 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ac3ef163-e29b-4439-bdbd-6f589e06d833 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:22.445974 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ac3ef163-e29b-4439-bdbd-6f589e06d833 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:22.483139 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-dcce28a2-c397-4dbf-b994-c8533c238d77 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/4a8ff4c8-f218-485b-92fe-96a06e70b7b0" status: 200 len: 1451 microversion: 2.1 time: 0.067077 Oct 30 01:30:22.483756 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1919/3834] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:30:22 2022] GET /compute/v2.1/images/4a8ff4c8-f218-485b-92fe-96a06e70b7b0 => generated 1451 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:22.763139 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ac3ef163-e29b-4439-bdbd-6f589e06d833 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:22.776988 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ac3ef163-e29b-4439-bdbd-6f589e06d833 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0" status: 200 len: 1372 microversion: 2.1 time: 0.351041 Oct 30 01:30:22.779143 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1916/3835] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:22 2022] GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0 => generated 1372 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:30:23.358069 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5ea71694-c594-4c17-99c1-dfbaee1fab05 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:23.359280 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5ea71694-c594-4c17-99c1-dfbaee1fab05 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 06199cbd-cf2c-426d-a842-4dedd8359945] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:23.394273 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ea71694-c594-4c17-99c1-dfbaee1fab05 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:23.395633 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ea71694-c594-4c17-99c1-dfbaee1fab05 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:23.398223 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ea71694-c594-4c17-99c1-dfbaee1fab05 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:23.399270 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ea71694-c594-4c17-99c1-dfbaee1fab05 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:23.399764 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ea71694-c594-4c17-99c1-dfbaee1fab05 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:23.400504 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ea71694-c594-4c17-99c1-dfbaee1fab05 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:23.441964 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ea71694-c594-4c17-99c1-dfbaee1fab05 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:23.442460 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ea71694-c594-4c17-99c1-dfbaee1fab05 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:23.442911 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ea71694-c594-4c17-99c1-dfbaee1fab05 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:23.443372 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-5ea71694-c594-4c17-99c1-dfbaee1fab05 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lazy-loading 'fault' on Instance uuid 06199cbd-cf2c-426d-a842-4dedd8359945 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:30:23.500145 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b337f825-56aa-40f3-950f-c5c9e9586057 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44c7348550>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:23.526922 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5ea71694-c594-4c17-99c1-dfbaee1fab05 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:23.553715 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5ea71694-c594-4c17-99c1-dfbaee1fab05 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/06199cbd-cf2c-426d-a842-4dedd8359945" status: 200 len: 1317 microversion: 2.1 time: 0.203490 Oct 30 01:30:23.554755 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1920/3836] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:23 2022] GET /compute/v2.1/servers/06199cbd-cf2c-426d-a842-4dedd8359945 => generated 1317 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:23.634821 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b337f825-56aa-40f3-950f-c5c9e9586057 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/4a8ff4c8-f218-485b-92fe-96a06e70b7b0" status: 200 len: 1451 microversion: 2.1 time: 0.139829 Oct 30 01:30:23.635750 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1917/3837] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:30:23 2022] GET /compute/v2.1/images/4a8ff4c8-f218-485b-92fe-96a06e70b7b0 => generated 1451 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:30:23.802008 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9b85ba6b-a0b9-4bb8-89d2-78902314c338 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:23.802959 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9b85ba6b-a0b9-4bb8-89d2-78902314c338 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:23.833660 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9b85ba6b-a0b9-4bb8-89d2-78902314c338 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:23.839284 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9b85ba6b-a0b9-4bb8-89d2-78902314c338 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:23.839846 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9b85ba6b-a0b9-4bb8-89d2-78902314c338 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:23.840681 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9b85ba6b-a0b9-4bb8-89d2-78902314c338 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:23.841161 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9b85ba6b-a0b9-4bb8-89d2-78902314c338 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:23.841632 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9b85ba6b-a0b9-4bb8-89d2-78902314c338 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:24.068308 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9b85ba6b-a0b9-4bb8-89d2-78902314c338 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:24.078082 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9b85ba6b-a0b9-4bb8-89d2-78902314c338 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0" status: 200 len: 1567 microversion: 2.1 time: 0.281017 Oct 30 01:30:24.096001 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1921/3838] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:23 2022] GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0 => generated 1567 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:24.102583 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e94e113d-5ff2-485b-be06-56763b1d7251 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:24.103295 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e94e113d-5ff2-485b-be06-56763b1d7251 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:24.110943 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e94e113d-5ff2-485b-be06-56763b1d7251 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:24.111748 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e94e113d-5ff2-485b-be06-56763b1d7251 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:24.112497 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e94e113d-5ff2-485b-be06-56763b1d7251 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:24.113463 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e94e113d-5ff2-485b-be06-56763b1d7251 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:24.114151 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e94e113d-5ff2-485b-be06-56763b1d7251 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:24.115007 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e94e113d-5ff2-485b-be06-56763b1d7251 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:24.255723 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e94e113d-5ff2-485b-be06-56763b1d7251 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.156499 Oct 30 01:30:24.257581 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1918/3839] 10.222.0.13 () {58 vars in 1275 bytes} [Sun Oct 30 01:30:24 2022] GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0/os-interface => generated 285 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:30:24.588053 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-614cc8f2-aa12-48d6-8f7d-4bb8adc875ce tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:24.589872 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-614cc8f2-aa12-48d6-8f7d-4bb8adc875ce tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 06199cbd-cf2c-426d-a842-4dedd8359945] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:24.601971 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-614cc8f2-aa12-48d6-8f7d-4bb8adc875ce tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:24.602766 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-614cc8f2-aa12-48d6-8f7d-4bb8adc875ce tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:24.603668 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-614cc8f2-aa12-48d6-8f7d-4bb8adc875ce tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:24.604636 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-614cc8f2-aa12-48d6-8f7d-4bb8adc875ce tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:24.605320 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-614cc8f2-aa12-48d6-8f7d-4bb8adc875ce tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:24.605943 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-614cc8f2-aa12-48d6-8f7d-4bb8adc875ce tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:24.623149 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-614cc8f2-aa12-48d6-8f7d-4bb8adc875ce tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] HTTP exception thrown: Instance 06199cbd-cf2c-426d-a842-4dedd8359945 could not be found. Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-614cc8f2-aa12-48d6-8f7d-4bb8adc875ce tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Request method failure captured: Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/06199cbd-cf2c-426d-a842-4dedd8359945 HTTP/1.1 Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdNZbeUR7skwu5ylmljymLwmsn3OMAB7HFdlDZsip3dgOK-vaOPPSwUYmWT_o9z2OqWc9cL2Rd22cHSa-BN8vqcvBTHGvFnuVH3dT1kVAQG6ODQVt2oxoFKeXYoNTjg1JUCF1B7Vzk2gVPeSesCiSDD37BDZ3_Wp6AgzZI4w4KMCOXw Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 45fe1c50eaee40249b6c20cc91e52586 Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersTestJSON-1478392549 Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersTestJSON-1478392549 Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 45fe1c50eaee40249b6c20cc91e52586 Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersTestJSON-1478392549 Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersTestJSON-1478392549-project Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: ef5f8a3e6fef4d6393603575479b16a2 Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersTestJSON-1478392549-project Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 06199cbd-cf2c-426d-a842-4dedd8359945 could not be found. Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '06199cbd-cf2c-426d-a842-4dedd8359945'} Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06199cbd-cf2c-426d-a842-4dedd8359945 could not be found. Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06199cbd-cf2c-426d-a842-4dedd8359945 could not be found. Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:30:24.625613 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:30:24.632233 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:30:24.632233 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:30:24.632233 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:30:24.632233 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:30:24.632233 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:30:24.632233 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06199cbd-cf2c-426d-a842-4dedd8359945 could not be found. Oct 30 01:30:24.632233 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:30:24.635695 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-614cc8f2-aa12-48d6-8f7d-4bb8adc875ce tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Returning 404 to user: Instance 06199cbd-cf2c-426d-a842-4dedd8359945 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:30:24.637309 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-614cc8f2-aa12-48d6-8f7d-4bb8adc875ce tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/06199cbd-cf2c-426d-a842-4dedd8359945" status: 404 len: 111 microversion: 2.1 time: 0.059714 Oct 30 01:30:24.638504 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1922/3840] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:24 2022] GET /compute/v2.1/servers/06199cbd-cf2c-426d-a842-4dedd8359945 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:30:24.653942 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6a10e862-358d-4d9f-a0e8-6c3effaadd9e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '.version_select at 0x7f44d0453670>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:24.668962 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-87684305-3471-4953-a015-3f713975354c tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44c7c1b0d0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:24.732837 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-87684305-3471-4953-a015-3f713975354c tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/4a8ff4c8-f218-485b-92fe-96a06e70b7b0" status: 200 len: 1451 microversion: 2.1 time: 0.075993 Oct 30 01:30:24.742169 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1923/3841] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:30:24 2022] GET /compute/v2.1/images/4a8ff4c8-f218-485b-92fe-96a06e70b7b0 => generated 1451 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:24.748790 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-1fbb9dc6-33f1-47a2-b2db-fcd1a873c2c8 req-eb4862ce-fe4b-4c05-86c3-07924eb4e396 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9368bd4-9715-46b3-91bb-cb436f7120f3", "name": "network-vif-unplugged", "status": "completed", "tag": "2115d9c7-78b5-463e-b9d2-39310d4c1aa2"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:30:24.762068 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-1fbb9dc6-33f1-47a2-b2db-fcd1a873c2c8 req-eb4862ce-fe4b-4c05-86c3-07924eb4e396 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:24.762716 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-1fbb9dc6-33f1-47a2-b2db-fcd1a873c2c8 req-eb4862ce-fe4b-4c05-86c3-07924eb4e396 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:24.763661 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-1fbb9dc6-33f1-47a2-b2db-fcd1a873c2c8 req-eb4862ce-fe4b-4c05-86c3-07924eb4e396 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:24.769538 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6a10e862-358d-4d9f-a0e8-6c3effaadd9e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-key-977573330" status: 202 len: 0 microversion: 2.1 time: 0.126578 Oct 30 01:30:24.770405 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1919/3842] 10.222.0.13 () {58 vars in 1206 bytes} [Sun Oct 30 01:30:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-977573330 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:30:24.778923 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-1fbb9dc6-33f1-47a2-b2db-fcd1a873c2c8 req-eb4862ce-fe4b-4c05-86c3-07924eb4e396 service nova] Creating event network-vif-unplugged:2115d9c7-78b5-463e-b9d2-39310d4c1aa2 for instance e9368bd4-9715-46b3-91bb-cb436f7120f3 on n-h1-master-1 Oct 30 01:30:24.786450 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-1fbb9dc6-33f1-47a2-b2db-fcd1a873c2c8 req-eb4862ce-fe4b-4c05-86c3-07924eb4e396 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042314 Oct 30 01:30:24.787992 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1924/3843] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:30:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:30:24.915893 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3510f432-a173-4488-9e71-3008f294d7d1 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-957685865", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "936faadb-2266-486c-9624-31976f3a3668"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:30:24.984205 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-3510f432-a173-4488-9e71-3008f294d7d1 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] validate_networks() for [('936faadb-2266-486c-9624-31976f3a3668', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:30:25.751200 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cf4ae7d4-e9c2-4062-95a9-aedbb52560dd tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44c7c78280>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:25.805701 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cf4ae7d4-e9c2-4062-95a9-aedbb52560dd tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/4a8ff4c8-f218-485b-92fe-96a06e70b7b0" status: 200 len: 1451 microversion: 2.1 time: 0.059277 Oct 30 01:30:25.806872 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1925/3844] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:30:25 2022] GET /compute/v2.1/images/4a8ff4c8-f218-485b-92fe-96a06e70b7b0 => generated 1451 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:26.024511 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-3510f432-a173-4488-9e71-3008f294d7d1 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:30:26.025069 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-3510f432-a173-4488-9e71-3008f294d7d1 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:30:26.025816 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-3510f432-a173-4488-9e71-3008f294d7d1 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:30:26.026480 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-3510f432-a173-4488-9e71-3008f294d7d1 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:30:26.027169 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-3510f432-a173-4488-9e71-3008f294d7d1 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:30:26.038360 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3510f432-a173-4488-9e71-3008f294d7d1 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:26.039294 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3510f432-a173-4488-9e71-3008f294d7d1 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:26.039955 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3510f432-a173-4488-9e71-3008f294d7d1 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:26.040955 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3510f432-a173-4488-9e71-3008f294d7d1 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:26.042275 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3510f432-a173-4488-9e71-3008f294d7d1 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:26.043029 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3510f432-a173-4488-9e71-3008f294d7d1 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:26.070480 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-3510f432-a173-4488-9e71-3008f294d7d1 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Getting quotas for project 45fe1c50eaee40249b6c20cc91e52586. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:30:26.078350 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-3510f432-a173-4488-9e71-3008f294d7d1 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Getting quotas for user ef5f8a3e6fef4d6393603575479b16a2 and project 45fe1c50eaee40249b6c20cc91e52586. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:30:26.094635 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3510f432-a173-4488-9e71-3008f294d7d1 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:30:26.098372 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3510f432-a173-4488-9e71-3008f294d7d1 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 98262d96-9a63-4531-9001-3fd0efd22014] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:30:26.276536 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3510f432-a173-4488-9e71-3008f294d7d1 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.371353 Oct 30 01:30:26.287651 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1920/3845] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:30:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1389 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:30:26.294770 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1f78203f-b8f3-452b-8933-a316313dd096 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:26.303387 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1f78203f-b8f3-452b-8933-a316313dd096 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 98262d96-9a63-4531-9001-3fd0efd22014] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:26.417518 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1f78203f-b8f3-452b-8933-a316313dd096 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:26.428263 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1f78203f-b8f3-452b-8933-a316313dd096 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/98262d96-9a63-4531-9001-3fd0efd22014" status: 200 len: 1208 microversion: 2.1 time: 0.141042 Oct 30 01:30:26.429521 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1926/3846] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:26 2022] GET /compute/v2.1/servers/98262d96-9a63-4531-9001-3fd0efd22014 => generated 1208 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:26.828170 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-884b13db-949e-41d4-a708-a6f16e40fcc6 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44d0523310>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:26.962286 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-884b13db-949e-41d4-a708-a6f16e40fcc6 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/4a8ff4c8-f218-485b-92fe-96a06e70b7b0" status: 200 len: 1451 microversion: 2.1 time: 0.132409 Oct 30 01:30:26.962286 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1921/3847] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:30:26 2022] GET /compute/v2.1/images/4a8ff4c8-f218-485b-92fe-96a06e70b7b0 => generated 1451 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:27.056134 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-df5259fa-ea53-4141-a62f-4b3e15a55ae6 req-63f07512-2520-437a-9f9f-4b43033fc73c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0", "tag": "b06d8a65-6a4c-4fc9-9c2f-932d1a6b84ab"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:30:27.081417 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-df5259fa-ea53-4141-a62f-4b3e15a55ae6 req-63f07512-2520-437a-9f9f-4b43033fc73c service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:27.082426 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-df5259fa-ea53-4141-a62f-4b3e15a55ae6 req-63f07512-2520-437a-9f9f-4b43033fc73c service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:27.084474 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-df5259fa-ea53-4141-a62f-4b3e15a55ae6 req-63f07512-2520-437a-9f9f-4b43033fc73c service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:27.110434 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-df5259fa-ea53-4141-a62f-4b3e15a55ae6 req-63f07512-2520-437a-9f9f-4b43033fc73c service nova] Creating event network-changed:b06d8a65-6a4c-4fc9-9c2f-932d1a6b84ab for instance 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0 on n-h1-master-1 Oct 30 01:30:27.122217 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-df5259fa-ea53-4141-a62f-4b3e15a55ae6 req-63f07512-2520-437a-9f9f-4b43033fc73c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070558 Oct 30 01:30:27.125422 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1927/3848] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:30:27.457261 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f876dd5c-8cee-425b-82b2-6df60f748b72 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:27.458629 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f876dd5c-8cee-425b-82b2-6df60f748b72 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 98262d96-9a63-4531-9001-3fd0efd22014] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:27.579836 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f876dd5c-8cee-425b-82b2-6df60f748b72 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:27.590548 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f876dd5c-8cee-425b-82b2-6df60f748b72 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/98262d96-9a63-4531-9001-3fd0efd22014" status: 200 len: 1208 microversion: 2.1 time: 0.139392 Oct 30 01:30:27.591326 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1922/3849] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:27 2022] GET /compute/v2.1/servers/98262d96-9a63-4531-9001-3fd0efd22014 => generated 1208 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:27.973132 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-79cf2a66-f3ea-42da-b94d-19f05254293b tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44c7d38ca0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:28.065749 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-79cf2a66-f3ea-42da-b94d-19f05254293b tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/4a8ff4c8-f218-485b-92fe-96a06e70b7b0" status: 200 len: 1451 microversion: 2.1 time: 0.099019 Oct 30 01:30:28.067081 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1928/3850] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:30:27 2022] GET /compute/v2.1/images/4a8ff4c8-f218-485b-92fe-96a06e70b7b0 => generated 1451 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:28.632823 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-446bf0fc-10b0-4d7a-9c09-0d87ea8c4116 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:28.633552 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-446bf0fc-10b0-4d7a-9c09-0d87ea8c4116 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 98262d96-9a63-4531-9001-3fd0efd22014] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:28.660715 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-446bf0fc-10b0-4d7a-9c09-0d87ea8c4116 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:28.665727 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-446bf0fc-10b0-4d7a-9c09-0d87ea8c4116 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:28.666274 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-446bf0fc-10b0-4d7a-9c09-0d87ea8c4116 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:28.667037 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-446bf0fc-10b0-4d7a-9c09-0d87ea8c4116 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:28.667499 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-446bf0fc-10b0-4d7a-9c09-0d87ea8c4116 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:28.668188 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-446bf0fc-10b0-4d7a-9c09-0d87ea8c4116 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:28.806682 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-446bf0fc-10b0-4d7a-9c09-0d87ea8c4116 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:28.815636 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-446bf0fc-10b0-4d7a-9c09-0d87ea8c4116 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/98262d96-9a63-4531-9001-3fd0efd22014" status: 200 len: 1260 microversion: 2.1 time: 0.199136 Oct 30 01:30:28.836962 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1923/3851] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:28 2022] GET /compute/v2.1/servers/98262d96-9a63-4531-9001-3fd0efd22014 => generated 1260 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:29.084536 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5bfa66ab-e93b-4700-a0c8-f851e1ac70e3 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44c7be88b0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:29.253936 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5bfa66ab-e93b-4700-a0c8-f851e1ac70e3 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/4a8ff4c8-f218-485b-92fe-96a06e70b7b0" status: 200 len: 1451 microversion: 2.1 time: 0.174893 Oct 30 01:30:29.254751 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1929/3852] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:30:29 2022] GET /compute/v2.1/images/4a8ff4c8-f218-485b-92fe-96a06e70b7b0 => generated 1451 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:29.859580 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3fab79a0-b96d-4a2f-bd85-f0d82c95d93d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:29.876873 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3fab79a0-b96d-4a2f-bd85-f0d82c95d93d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 98262d96-9a63-4531-9001-3fd0efd22014] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:29.915782 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3fab79a0-b96d-4a2f-bd85-f0d82c95d93d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:29.919104 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3fab79a0-b96d-4a2f-bd85-f0d82c95d93d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:29.920856 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3fab79a0-b96d-4a2f-bd85-f0d82c95d93d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:29.922037 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3fab79a0-b96d-4a2f-bd85-f0d82c95d93d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:29.922502 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3fab79a0-b96d-4a2f-bd85-f0d82c95d93d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:29.922929 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3fab79a0-b96d-4a2f-bd85-f0d82c95d93d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:30.225956 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3fab79a0-b96d-4a2f-bd85-f0d82c95d93d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:30.242311 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3fab79a0-b96d-4a2f-bd85-f0d82c95d93d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/98262d96-9a63-4531-9001-3fd0efd22014" status: 200 len: 1268 microversion: 2.1 time: 0.386708 Oct 30 01:30:30.243450 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1924/3853] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:29 2022] GET /compute/v2.1/servers/98262d96-9a63-4531-9001-3fd0efd22014 => generated 1268 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:30.280500 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-637f5dac-e9eb-4add-9b26-0434e8f946f2 req-e0262059-b038-4344-bb19-16d96eca0825 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99db82dd-3238-4af1-9f90-1dd69cdd836a", "name": "network-vif-plugged", "status": "completed", "tag": "49372d17-c87d-4e36-af57-5d05c8cba1e2"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:30:30.286470 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bf909ed9-0f0e-431b-9483-873ad456425b tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44c7bacd30>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:30.312404 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-637f5dac-e9eb-4add-9b26-0434e8f946f2 req-e0262059-b038-4344-bb19-16d96eca0825 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:30.313540 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-637f5dac-e9eb-4add-9b26-0434e8f946f2 req-e0262059-b038-4344-bb19-16d96eca0825 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:30.316508 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-637f5dac-e9eb-4add-9b26-0434e8f946f2 req-e0262059-b038-4344-bb19-16d96eca0825 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:30.355467 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-637f5dac-e9eb-4add-9b26-0434e8f946f2 req-e0262059-b038-4344-bb19-16d96eca0825 service nova] Creating event network-vif-plugged:49372d17-c87d-4e36-af57-5d05c8cba1e2 for instance 99db82dd-3238-4af1-9f90-1dd69cdd836a on n-h1-master-1 Oct 30 01:30:30.379492 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-637f5dac-e9eb-4add-9b26-0434e8f946f2 req-e0262059-b038-4344-bb19-16d96eca0825 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105677 Oct 30 01:30:30.380753 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1925/3854] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:30:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:30:30.398633 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bf909ed9-0f0e-431b-9483-873ad456425b tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/4a8ff4c8-f218-485b-92fe-96a06e70b7b0" status: 200 len: 1451 microversion: 2.1 time: 0.132310 Oct 30 01:30:30.401056 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1930/3855] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:30:30 2022] GET /compute/v2.1/images/4a8ff4c8-f218-485b-92fe-96a06e70b7b0 => generated 1451 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:31.277442 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-05ee95f7-4988-421a-9bf9-b75fdf921497 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:31.281836 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-05ee95f7-4988-421a-9bf9-b75fdf921497 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 98262d96-9a63-4531-9001-3fd0efd22014] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:31.308627 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-05ee95f7-4988-421a-9bf9-b75fdf921497 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:31.309877 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-05ee95f7-4988-421a-9bf9-b75fdf921497 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:31.310765 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-05ee95f7-4988-421a-9bf9-b75fdf921497 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:31.311735 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-05ee95f7-4988-421a-9bf9-b75fdf921497 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:31.312938 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-05ee95f7-4988-421a-9bf9-b75fdf921497 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:31.313750 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-05ee95f7-4988-421a-9bf9-b75fdf921497 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:31.416903 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0abbafdb-3919-4535-a82b-8218e00a1115 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44c7c17c10>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:31.497751 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0abbafdb-3919-4535-a82b-8218e00a1115 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/4a8ff4c8-f218-485b-92fe-96a06e70b7b0" status: 200 len: 1451 microversion: 2.1 time: 0.078707 Oct 30 01:30:31.499046 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1931/3856] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:30:31 2022] GET /compute/v2.1/images/4a8ff4c8-f218-485b-92fe-96a06e70b7b0 => generated 1451 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:31.536065 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-05ee95f7-4988-421a-9bf9-b75fdf921497 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:31.551431 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-05ee95f7-4988-421a-9bf9-b75fdf921497 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/98262d96-9a63-4531-9001-3fd0efd22014" status: 200 len: 1266 microversion: 2.1 time: 0.281857 Oct 30 01:30:31.553021 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1926/3857] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:31 2022] GET /compute/v2.1/servers/98262d96-9a63-4531-9001-3fd0efd22014 => generated 1266 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:32.514014 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1059d078-a091-4925-9562-8260c662b448 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44c7bac700>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:32.579878 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-63699e2a-dcb7-4eb3-a8de-14f7a870d1a8 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:32.580474 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-63699e2a-dcb7-4eb3-a8de-14f7a870d1a8 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 98262d96-9a63-4531-9001-3fd0efd22014] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:32.609256 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-63699e2a-dcb7-4eb3-a8de-14f7a870d1a8 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:32.615154 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-63699e2a-dcb7-4eb3-a8de-14f7a870d1a8 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:32.616126 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-63699e2a-dcb7-4eb3-a8de-14f7a870d1a8 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:32.627022 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-63699e2a-dcb7-4eb3-a8de-14f7a870d1a8 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:32.634551 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-63699e2a-dcb7-4eb3-a8de-14f7a870d1a8 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:32.638507 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-63699e2a-dcb7-4eb3-a8de-14f7a870d1a8 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:32.655776 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1059d078-a091-4925-9562-8260c662b448 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/4a8ff4c8-f218-485b-92fe-96a06e70b7b0" status: 200 len: 1451 microversion: 2.1 time: 0.145809 Oct 30 01:30:32.656385 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1932/3858] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:30:32 2022] GET /compute/v2.1/images/4a8ff4c8-f218-485b-92fe-96a06e70b7b0 => generated 1451 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:32.964188 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-63699e2a-dcb7-4eb3-a8de-14f7a870d1a8 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:32.975643 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-63699e2a-dcb7-4eb3-a8de-14f7a870d1a8 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/98262d96-9a63-4531-9001-3fd0efd22014" status: 200 len: 1266 microversion: 2.1 time: 0.402028 Oct 30 01:30:32.982462 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1927/3859] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:32 2022] GET /compute/v2.1/servers/98262d96-9a63-4531-9001-3fd0efd22014 => generated 1266 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:30:33.672065 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5d7354b9-2a85-4f48-8238-b0a17e2a4907 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44c7be8790>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:33.789194 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5d7354b9-2a85-4f48-8238-b0a17e2a4907 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/4a8ff4c8-f218-485b-92fe-96a06e70b7b0" status: 200 len: 1451 microversion: 2.1 time: 0.114796 Oct 30 01:30:33.789964 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1933/3860] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:30:33 2022] GET /compute/v2.1/images/4a8ff4c8-f218-485b-92fe-96a06e70b7b0 => generated 1451 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:34.007731 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-60f57e22-b364-4aa8-b4e3-f88f3880e7b1 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:34.007731 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-60f57e22-b364-4aa8-b4e3-f88f3880e7b1 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 98262d96-9a63-4531-9001-3fd0efd22014] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:34.017007 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-60f57e22-b364-4aa8-b4e3-f88f3880e7b1 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:34.030913 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-60f57e22-b364-4aa8-b4e3-f88f3880e7b1 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:34.030913 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-60f57e22-b364-4aa8-b4e3-f88f3880e7b1 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:34.030913 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-60f57e22-b364-4aa8-b4e3-f88f3880e7b1 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:34.030913 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-60f57e22-b364-4aa8-b4e3-f88f3880e7b1 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:34.030913 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-60f57e22-b364-4aa8-b4e3-f88f3880e7b1 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:34.101309 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2ae694b4-7c7f-4b4d-9650-98238da766e1 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-345911575", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "99711051-b48f-4cd5-a07e-8a94784614eb"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:30:34.233741 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-2ae694b4-7c7f-4b4d-9650-98238da766e1 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] validate_networks() for [('99711051-b48f-4cd5-a07e-8a94784614eb', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:30:34.962203 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-60f57e22-b364-4aa8-b4e3-f88f3880e7b1 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:34.985945 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-60f57e22-b364-4aa8-b4e3-f88f3880e7b1 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/98262d96-9a63-4531-9001-3fd0efd22014" status: 200 len: 1308 microversion: 2.1 time: 0.986143 Oct 30 01:30:35.006647 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1934/3861] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:33 2022] GET /compute/v2.1/servers/98262d96-9a63-4531-9001-3fd0efd22014 => generated 1308 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:35.017236 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2b62d1c9-ef04-4cec-aa21-968210fe5be3 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44c7a77940>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:35.113689 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2b62d1c9-ef04-4cec-aa21-968210fe5be3 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/4a8ff4c8-f218-485b-92fe-96a06e70b7b0" status: 200 len: 1451 microversion: 2.1 time: 0.105667 Oct 30 01:30:35.116410 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1935/3862] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:30:35 2022] GET /compute/v2.1/images/4a8ff4c8-f218-485b-92fe-96a06e70b7b0 => generated 1451 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:36.017690 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f59eb1f1-8eea-4345-be1b-ceee0b12bfe4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:36.017690 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f59eb1f1-8eea-4345-be1b-ceee0b12bfe4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 98262d96-9a63-4531-9001-3fd0efd22014] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:36.026952 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f59eb1f1-8eea-4345-be1b-ceee0b12bfe4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:36.027938 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f59eb1f1-8eea-4345-be1b-ceee0b12bfe4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:36.028651 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f59eb1f1-8eea-4345-be1b-ceee0b12bfe4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:36.030856 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f59eb1f1-8eea-4345-be1b-ceee0b12bfe4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:36.031855 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f59eb1f1-8eea-4345-be1b-ceee0b12bfe4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:36.032523 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f59eb1f1-8eea-4345-be1b-ceee0b12bfe4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:36.061755 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:30:36.423996 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:30:37.268080 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-2ae694b4-7c7f-4b4d-9650-98238da766e1 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:30:37.269782 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-2ae694b4-7c7f-4b4d-9650-98238da766e1 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:30:37.270494 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-2ae694b4-7c7f-4b4d-9650-98238da766e1 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:30:37.271109 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-2ae694b4-7c7f-4b4d-9650-98238da766e1 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:30:37.271736 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-2ae694b4-7c7f-4b4d-9650-98238da766e1 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:30:37.317863 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ae694b4-7c7f-4b4d-9650-98238da766e1 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:37.323482 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ae694b4-7c7f-4b4d-9650-98238da766e1 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:37.327356 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ae694b4-7c7f-4b4d-9650-98238da766e1 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:37.327356 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ae694b4-7c7f-4b4d-9650-98238da766e1 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:37.329408 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ae694b4-7c7f-4b4d-9650-98238da766e1 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:37.330192 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ae694b4-7c7f-4b4d-9650-98238da766e1 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:37.447930 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-2ae694b4-7c7f-4b4d-9650-98238da766e1 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Getting quotas for project 93c145959fe44ed1bec7c4c964be8d2e. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:30:37.472984 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-2ae694b4-7c7f-4b4d-9650-98238da766e1 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Getting quotas for user 11293effe45345aeac9fd7dd672b738b and project 93c145959fe44ed1bec7c4c964be8d2e. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:30:37.547600 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2ae694b4-7c7f-4b4d-9650-98238da766e1 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:30:37.553935 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2ae694b4-7c7f-4b4d-9650-98238da766e1 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] [instance: 0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:30:37.758477 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f59eb1f1-8eea-4345-be1b-ceee0b12bfe4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:37.772322 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2ae694b4-7c7f-4b4d-9650-98238da766e1 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.944938 Oct 30 01:30:37.776856 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f59eb1f1-8eea-4345-be1b-ceee0b12bfe4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/98262d96-9a63-4531-9001-3fd0efd22014" status: 200 len: 1308 microversion: 2.1 time: 1.760440 Oct 30 01:30:37.778864 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1936/3864] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:36 2022] GET /compute/v2.1/servers/98262d96-9a63-4531-9001-3fd0efd22014 => generated 1308 bytes in 1771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:37.779047 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1928/3864] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:30:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 3951 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:30:37.794933 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-55c4b3bb-da82-4689-a88f-05265c73f9aa tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44d03ff9d0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:37.973781 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-55c4b3bb-da82-4689-a88f-05265c73f9aa tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/4a8ff4c8-f218-485b-92fe-96a06e70b7b0" status: 200 len: 1451 microversion: 2.1 time: 0.193368 Oct 30 01:30:37.993303 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1929/3865] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:30:37 2022] GET /compute/v2.1/images/4a8ff4c8-f218-485b-92fe-96a06e70b7b0 => generated 1451 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:38.030352 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0ff215b0-491d-4fd1-9150-60eb0869a2e4 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:38.035841 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0ff215b0-491d-4fd1-9150-60eb0869a2e4 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] [instance: 0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:38.100882 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-aeb62f72-2913-49ae-a51b-6c0ac445bb78 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-134784967", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:30:38.235077 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-aeb62f72-2913-49ae-a51b-6c0ac445bb78 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] validate_networks() for [('ec3baca8-963c-473d-9622-8e40c5206964', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:30:38.330223 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0ff215b0-491d-4fd1-9150-60eb0869a2e4 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11293effe45345aeac9fd7dd672b738b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c145959fe44ed1bec7c4c964be8d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:38.338902 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0ff215b0-491d-4fd1-9150-60eb0869a2e4 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] 10.222.0.13 "GET /compute/v2.1/servers/0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0" status: 200 len: 1224 microversion: 2.1 time: 0.346176 Oct 30 01:30:38.354917 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1930/3866] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:37 2022] GET /compute/v2.1/servers/0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0 => generated 1224 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:38.810361 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3216ec27-7b61-4853-8ea4-fe32723a3bf4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:38.815471 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3216ec27-7b61-4853-8ea4-fe32723a3bf4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 98262d96-9a63-4531-9001-3fd0efd22014] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:38.826030 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3216ec27-7b61-4853-8ea4-fe32723a3bf4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:38.827194 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3216ec27-7b61-4853-8ea4-fe32723a3bf4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:38.827992 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3216ec27-7b61-4853-8ea4-fe32723a3bf4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:38.829608 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3216ec27-7b61-4853-8ea4-fe32723a3bf4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:38.830638 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3216ec27-7b61-4853-8ea4-fe32723a3bf4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:38.831390 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3216ec27-7b61-4853-8ea4-fe32723a3bf4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:39.847021 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-aeb62f72-2913-49ae-a51b-6c0ac445bb78 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:30:39.847531 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-aeb62f72-2913-49ae-a51b-6c0ac445bb78 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:30:39.848016 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-aeb62f72-2913-49ae-a51b-6c0ac445bb78 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:30:39.848496 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-aeb62f72-2913-49ae-a51b-6c0ac445bb78 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:30:39.848964 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-aeb62f72-2913-49ae-a51b-6c0ac445bb78 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:30:39.888263 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aeb62f72-2913-49ae-a51b-6c0ac445bb78 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:39.890538 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aeb62f72-2913-49ae-a51b-6c0ac445bb78 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:39.890538 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aeb62f72-2913-49ae-a51b-6c0ac445bb78 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:39.891445 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aeb62f72-2913-49ae-a51b-6c0ac445bb78 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:39.892537 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aeb62f72-2913-49ae-a51b-6c0ac445bb78 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:39.894298 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aeb62f72-2913-49ae-a51b-6c0ac445bb78 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:39.957028 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-aeb62f72-2913-49ae-a51b-6c0ac445bb78 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Getting quotas for project edc4c8f707304cd98a5f2e13cb1d5a5b. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:30:39.961837 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-aeb62f72-2913-49ae-a51b-6c0ac445bb78 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Getting quotas for user f9ec278d8d7b4a5a96af042ba613bafa and project edc4c8f707304cd98a5f2e13cb1d5a5b. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:30:39.999244 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-aeb62f72-2913-49ae-a51b-6c0ac445bb78 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:30:40.003737 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-aeb62f72-2913-49ae-a51b-6c0ac445bb78 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] [instance: 1f9c8547-e0cb-4094-a15e-d21166bda1d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:30:40.239433 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3216ec27-7b61-4853-8ea4-fe32723a3bf4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:40.252259 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3216ec27-7b61-4853-8ea4-fe32723a3bf4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/98262d96-9a63-4531-9001-3fd0efd22014" status: 200 len: 1308 microversion: 2.1 time: 1.447575 Oct 30 01:30:40.269976 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1931/3867] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:38 2022] GET /compute/v2.1/servers/98262d96-9a63-4531-9001-3fd0efd22014 => generated 1308 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:40.278614 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-aeb62f72-2913-49ae-a51b-6c0ac445bb78 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.494923 Oct 30 01:30:40.281011 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1937/3868] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:30:37 2022] POST /compute/v2.1/servers => generated 383 bytes in 2499 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:30:40.291145 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4c2f7e37-62ab-405b-9ed4-f2657774113d tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44c7d729d0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:40.310936 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-5115ca0e-dcc3-46dd-b5ad-710d9dc9bc03 req-e97896aa-eab0-4924-9c9f-282369a47934 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98262d96-9a63-4531-9001-3fd0efd22014", "tag": "716e550e-c87a-4177-bf1f-22fa02af88f1"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:30:40.330691 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:30:40.348264 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-5115ca0e-dcc3-46dd-b5ad-710d9dc9bc03 req-e97896aa-eab0-4924-9c9f-282369a47934 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:40.348996 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-5115ca0e-dcc3-46dd-b5ad-710d9dc9bc03 req-e97896aa-eab0-4924-9c9f-282369a47934 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:40.349780 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-5115ca0e-dcc3-46dd-b5ad-710d9dc9bc03 req-e97896aa-eab0-4924-9c9f-282369a47934 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:40.380491 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-5115ca0e-dcc3-46dd-b5ad-710d9dc9bc03 req-e97896aa-eab0-4924-9c9f-282369a47934 service nova] Creating event network-changed:716e550e-c87a-4177-bf1f-22fa02af88f1 for instance 98262d96-9a63-4531-9001-3fd0efd22014 on n-h2-master-1 Oct 30 01:30:40.399066 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-5115ca0e-dcc3-46dd-b5ad-710d9dc9bc03 req-e97896aa-eab0-4924-9c9f-282369a47934 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109933 Oct 30 01:30:40.401362 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1932/3869] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:30:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:30:40.418875 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-af9613d8-f4da-49cf-9782-902b2f201783 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:40.429787 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-af9613d8-f4da-49cf-9782-902b2f201783 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] [instance: 0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:40.430723 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4c2f7e37-62ab-405b-9ed4-f2657774113d tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/4a8ff4c8-f218-485b-92fe-96a06e70b7b0" status: 200 len: 1451 microversion: 2.1 time: 0.147446 Oct 30 01:30:40.431716 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1938/3870] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:30:40 2022] GET /compute/v2.1/images/4a8ff4c8-f218-485b-92fe-96a06e70b7b0 => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:40.444350 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c7ed6b04-1204-4934-b15f-ca321cf62e63 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:40.452541 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c7ed6b04-1204-4934-b15f-ca321cf62e63 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] [instance: 1f9c8547-e0cb-4094-a15e-d21166bda1d2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:40.454690 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af9613d8-f4da-49cf-9782-902b2f201783 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:40.455445 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af9613d8-f4da-49cf-9782-902b2f201783 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:40.457589 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af9613d8-f4da-49cf-9782-902b2f201783 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:40.458815 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af9613d8-f4da-49cf-9782-902b2f201783 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:40.459560 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af9613d8-f4da-49cf-9782-902b2f201783 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:40.464243 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af9613d8-f4da-49cf-9782-902b2f201783 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:40.800315 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c7ed6b04-1204-4934-b15f-ca321cf62e63 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec278d8d7b4a5a96af042ba613bafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc4c8f707304cd98a5f2e13cb1d5a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:40.809447 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c7ed6b04-1204-4934-b15f-ca321cf62e63 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] 10.222.0.13 "GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2" status: 200 len: 1222 microversion: 2.1 time: 0.376236 Oct 30 01:30:40.826278 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1939/3871] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:40 2022] GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2 => generated 1222 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:40.912816 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-af9613d8-f4da-49cf-9782-902b2f201783 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11293effe45345aeac9fd7dd672b738b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c145959fe44ed1bec7c4c964be8d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:40.936675 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-af9613d8-f4da-49cf-9782-902b2f201783 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] 10.222.0.13 "GET /compute/v2.1/servers/0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0" status: 200 len: 1220 microversion: 2.1 time: 0.530909 Oct 30 01:30:40.967823 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1933/3872] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:40 2022] GET /compute/v2.1/servers/0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0 => generated 1220 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:41.283442 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3b2f083c-2d5d-4001-9ad7-6dd06a412275 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:41.284629 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3b2f083c-2d5d-4001-9ad7-6dd06a412275 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 98262d96-9a63-4531-9001-3fd0efd22014] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:41.316688 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b2f083c-2d5d-4001-9ad7-6dd06a412275 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:41.323265 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b2f083c-2d5d-4001-9ad7-6dd06a412275 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:41.325242 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b2f083c-2d5d-4001-9ad7-6dd06a412275 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:41.325242 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b2f083c-2d5d-4001-9ad7-6dd06a412275 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:41.325242 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b2f083c-2d5d-4001-9ad7-6dd06a412275 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:41.325242 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b2f083c-2d5d-4001-9ad7-6dd06a412275 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:41.449907 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7bca4690-423e-4aff-a620-2ca7b5e0c595 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44d02cd430>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:41.582235 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7bca4690-423e-4aff-a620-2ca7b5e0c595 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/4a8ff4c8-f218-485b-92fe-96a06e70b7b0" status: 200 len: 1451 microversion: 2.1 time: 0.139032 Oct 30 01:30:41.583437 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1934/3873] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:30:41 2022] GET /compute/v2.1/images/4a8ff4c8-f218-485b-92fe-96a06e70b7b0 => generated 1451 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:30:41.844701 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1861fc59-1f4c-4590-912c-ced6df6a60a7 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:41.847927 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1861fc59-1f4c-4590-912c-ced6df6a60a7 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] [instance: 1f9c8547-e0cb-4094-a15e-d21166bda1d2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:42.354731 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1861fc59-1f4c-4590-912c-ced6df6a60a7 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec278d8d7b4a5a96af042ba613bafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc4c8f707304cd98a5f2e13cb1d5a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:42.381458 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1861fc59-1f4c-4590-912c-ced6df6a60a7 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] 10.222.0.13 "GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2" status: 200 len: 1222 microversion: 2.1 time: 0.529915 Oct 30 01:30:42.402714 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1935/3874] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:41 2022] GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2 => generated 1222 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:30:42.445101 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-acffb999-9e27-42eb-8623-3e00393a0601 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:42.447976 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-acffb999-9e27-42eb-8623-3e00393a0601 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] [instance: 0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:42.476095 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-acffb999-9e27-42eb-8623-3e00393a0601 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:42.482154 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-acffb999-9e27-42eb-8623-3e00393a0601 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:42.485657 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-acffb999-9e27-42eb-8623-3e00393a0601 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:42.496724 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-acffb999-9e27-42eb-8623-3e00393a0601 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:42.499067 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-acffb999-9e27-42eb-8623-3e00393a0601 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:42.500675 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-acffb999-9e27-42eb-8623-3e00393a0601 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:42.840407 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-acffb999-9e27-42eb-8623-3e00393a0601 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11293effe45345aeac9fd7dd672b738b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c145959fe44ed1bec7c4c964be8d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:42.840586 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3b2f083c-2d5d-4001-9ad7-6dd06a412275 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:42.857398 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3b2f083c-2d5d-4001-9ad7-6dd06a412275 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/98262d96-9a63-4531-9001-3fd0efd22014" status: 200 len: 1308 microversion: 2.1 time: 1.576279 Oct 30 01:30:42.865533 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-acffb999-9e27-42eb-8623-3e00393a0601 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] 10.222.0.13 "GET /compute/v2.1/servers/0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0" status: 200 len: 1284 microversion: 2.1 time: 0.458668 Oct 30 01:30:42.869204 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1936/3875] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:42 2022] GET /compute/v2.1/servers/0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0 => generated 1284 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:42.880801 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1940/3876] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:41 2022] GET /compute/v2.1/servers/98262d96-9a63-4531-9001-3fd0efd22014 => generated 1308 bytes in 1603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:42.944977 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1bec7d52-5559-4292-ada9-02baec37c629 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44d02cd310>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:43.047953 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1bec7d52-5559-4292-ada9-02baec37c629 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/4a8ff4c8-f218-485b-92fe-96a06e70b7b0" status: 200 len: 1451 microversion: 2.1 time: 0.153375 Oct 30 01:30:43.048954 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1937/3877] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:30:42 2022] GET /compute/v2.1/images/4a8ff4c8-f218-485b-92fe-96a06e70b7b0 => generated 1451 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:43.426221 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-45746241-76cd-4480-80e9-9007cd1e0e2d tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:43.427264 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-45746241-76cd-4480-80e9-9007cd1e0e2d tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] [instance: 1f9c8547-e0cb-4094-a15e-d21166bda1d2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:43.510824 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45746241-76cd-4480-80e9-9007cd1e0e2d tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:43.511653 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45746241-76cd-4480-80e9-9007cd1e0e2d tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:43.518755 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45746241-76cd-4480-80e9-9007cd1e0e2d tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:43.522383 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45746241-76cd-4480-80e9-9007cd1e0e2d tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:43.525904 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45746241-76cd-4480-80e9-9007cd1e0e2d tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:43.529670 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45746241-76cd-4480-80e9-9007cd1e0e2d tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:43.883417 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-320f8b1f-6559-4f1c-8190-64085c6e23b4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:43.884726 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-320f8b1f-6559-4f1c-8190-64085c6e23b4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 98262d96-9a63-4531-9001-3fd0efd22014] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:43.912472 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-320f8b1f-6559-4f1c-8190-64085c6e23b4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:43.916581 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-320f8b1f-6559-4f1c-8190-64085c6e23b4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:43.917510 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-320f8b1f-6559-4f1c-8190-64085c6e23b4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:43.919228 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-320f8b1f-6559-4f1c-8190-64085c6e23b4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:43.926075 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-320f8b1f-6559-4f1c-8190-64085c6e23b4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:43.926803 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-320f8b1f-6559-4f1c-8190-64085c6e23b4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:44.612546 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-45746241-76cd-4480-80e9-9007cd1e0e2d tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec278d8d7b4a5a96af042ba613bafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc4c8f707304cd98a5f2e13cb1d5a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:44.635477 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-45746241-76cd-4480-80e9-9007cd1e0e2d tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] 10.222.0.13 "GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2" status: 200 len: 1218 microversion: 2.1 time: 1.230820 Oct 30 01:30:44.644219 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1941/3878] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:43 2022] GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2 => generated 1218 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:44.664415 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-320f8b1f-6559-4f1c-8190-64085c6e23b4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:44.664952 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6015e871-d3c3-4af0-9908-710210af7ae9 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:44.668854 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6015e871-d3c3-4af0-9908-710210af7ae9 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] [instance: 0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:44.675466 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-320f8b1f-6559-4f1c-8190-64085c6e23b4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/98262d96-9a63-4531-9001-3fd0efd22014" status: 200 len: 1308 microversion: 2.1 time: 0.796391 Oct 30 01:30:44.680881 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1938/3879] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:43 2022] GET /compute/v2.1/servers/98262d96-9a63-4531-9001-3fd0efd22014 => generated 1308 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:44.694160 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ec66075d-cbf0-435f-a0cd-e77feffaff67 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44d02cd430>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:44.718071 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6015e871-d3c3-4af0-9908-710210af7ae9 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:44.719849 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6015e871-d3c3-4af0-9908-710210af7ae9 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:44.720605 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6015e871-d3c3-4af0-9908-710210af7ae9 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:44.722186 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6015e871-d3c3-4af0-9908-710210af7ae9 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:44.722960 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6015e871-d3c3-4af0-9908-710210af7ae9 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:44.723800 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6015e871-d3c3-4af0-9908-710210af7ae9 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:44.770356 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ec66075d-cbf0-435f-a0cd-e77feffaff67 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/4a8ff4c8-f218-485b-92fe-96a06e70b7b0" status: 200 len: 1451 microversion: 2.1 time: 0.087881 Oct 30 01:30:44.771713 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1939/3880] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:30:44 2022] GET /compute/v2.1/images/4a8ff4c8-f218-485b-92fe-96a06e70b7b0 => generated 1451 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:45.208371 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6015e871-d3c3-4af0-9908-710210af7ae9 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11293effe45345aeac9fd7dd672b738b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c145959fe44ed1bec7c4c964be8d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:45.235254 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6015e871-d3c3-4af0-9908-710210af7ae9 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] 10.222.0.13 "GET /compute/v2.1/servers/0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0" status: 200 len: 1324 microversion: 2.1 time: 0.589749 Oct 30 01:30:45.235787 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1942/3881] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:44 2022] GET /compute/v2.1/servers/0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0 => generated 1324 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:45.734840 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-dc59ad7c-b1ce-46cd-92e0-46d4c9344f87 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:45.734840 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-dc59ad7c-b1ce-46cd-92e0-46d4c9344f87 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] [instance: 1f9c8547-e0cb-4094-a15e-d21166bda1d2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:45.734840 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dc59ad7c-b1ce-46cd-92e0-46d4c9344f87 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:45.734840 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dc59ad7c-b1ce-46cd-92e0-46d4c9344f87 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:45.734840 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dc59ad7c-b1ce-46cd-92e0-46d4c9344f87 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:45.734840 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dc59ad7c-b1ce-46cd-92e0-46d4c9344f87 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:45.734840 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dc59ad7c-b1ce-46cd-92e0-46d4c9344f87 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:45.734840 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dc59ad7c-b1ce-46cd-92e0-46d4c9344f87 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:45.736414 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a80ac281-0215-45e7-99d0-10b940f896e7 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:45.736414 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a80ac281-0215-45e7-99d0-10b940f896e7 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 98262d96-9a63-4531-9001-3fd0efd22014] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:45.736414 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a80ac281-0215-45e7-99d0-10b940f896e7 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:45.736414 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a80ac281-0215-45e7-99d0-10b940f896e7 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:45.736414 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a80ac281-0215-45e7-99d0-10b940f896e7 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:45.736414 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a80ac281-0215-45e7-99d0-10b940f896e7 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:45.736414 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a80ac281-0215-45e7-99d0-10b940f896e7 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:45.745660 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a80ac281-0215-45e7-99d0-10b940f896e7 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:45.866204 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-dc59ad7c-b1ce-46cd-92e0-46d4c9344f87 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec278d8d7b4a5a96af042ba613bafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc4c8f707304cd98a5f2e13cb1d5a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:45.880668 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-dc59ad7c-b1ce-46cd-92e0-46d4c9344f87 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] 10.222.0.13 "GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2" status: 200 len: 1292 microversion: 2.1 time: 0.217065 Oct 30 01:30:45.894586 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1940/3882] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:45 2022] GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2 => generated 1292 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:30:45.894586 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6d9845f6-27f1-4543-a850-9a7fee260fe9 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44d02cda60>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:45.992417 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6d9845f6-27f1-4543-a850-9a7fee260fe9 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/4a8ff4c8-f218-485b-92fe-96a06e70b7b0" status: 200 len: 1451 microversion: 2.1 time: 0.109845 Oct 30 01:30:45.993316 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1941/3883] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:30:45 2022] GET /compute/v2.1/images/4a8ff4c8-f218-485b-92fe-96a06e70b7b0 => generated 1451 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:46.146779 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a80ac281-0215-45e7-99d0-10b940f896e7 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:46.156210 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a80ac281-0215-45e7-99d0-10b940f896e7 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/98262d96-9a63-4531-9001-3fd0efd22014" status: 200 len: 1308 microversion: 2.1 time: 0.451911 Oct 30 01:30:46.160540 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1943/3884] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:45 2022] GET /compute/v2.1/servers/98262d96-9a63-4531-9001-3fd0efd22014 => generated 1308 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:30:46.266623 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-df75b101-4725-4bc2-8350-8829cdecec51 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:46.267796 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-df75b101-4725-4bc2-8350-8829cdecec51 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] [instance: 0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:46.285211 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df75b101-4725-4bc2-8350-8829cdecec51 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:46.286842 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df75b101-4725-4bc2-8350-8829cdecec51 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:46.287517 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df75b101-4725-4bc2-8350-8829cdecec51 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:46.292725 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df75b101-4725-4bc2-8350-8829cdecec51 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:46.293547 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df75b101-4725-4bc2-8350-8829cdecec51 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:46.296519 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df75b101-4725-4bc2-8350-8829cdecec51 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:46.633731 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-df75b101-4725-4bc2-8350-8829cdecec51 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11293effe45345aeac9fd7dd672b738b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c145959fe44ed1bec7c4c964be8d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:46.659229 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-df75b101-4725-4bc2-8350-8829cdecec51 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] 10.222.0.13 "GET /compute/v2.1/servers/0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0" status: 200 len: 1324 microversion: 2.1 time: 0.386918 Oct 30 01:30:46.659914 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1942/3885] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:46 2022] GET /compute/v2.1/servers/0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0 => generated 1324 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:46.915265 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ebb6962c-4924-4020-9219-bc565cc8da57 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:46.919684 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ebb6962c-4924-4020-9219-bc565cc8da57 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] [instance: 1f9c8547-e0cb-4094-a15e-d21166bda1d2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:46.920778 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:30:46.935086 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ebb6962c-4924-4020-9219-bc565cc8da57 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:46.935658 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ebb6962c-4924-4020-9219-bc565cc8da57 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:46.936039 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ebb6962c-4924-4020-9219-bc565cc8da57 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:46.936932 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ebb6962c-4924-4020-9219-bc565cc8da57 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:46.937251 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ebb6962c-4924-4020-9219-bc565cc8da57 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:46.941917 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ebb6962c-4924-4020-9219-bc565cc8da57 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:46.966928 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-b5354b42-12b1-44a2-a8a1-186733e6f622 req-f150d5a6-20c8-439c-b763-3e5d9ae430c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0", "tag": "8ec21be8-7bf5-49f0-aa4e-be1ae9feb015"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:30:46.994365 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-b5354b42-12b1-44a2-a8a1-186733e6f622 req-f150d5a6-20c8-439c-b763-3e5d9ae430c7 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:46.995865 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-b5354b42-12b1-44a2-a8a1-186733e6f622 req-f150d5a6-20c8-439c-b763-3e5d9ae430c7 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:46.996419 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-b5354b42-12b1-44a2-a8a1-186733e6f622 req-f150d5a6-20c8-439c-b763-3e5d9ae430c7 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:47.011484 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-b5354b42-12b1-44a2-a8a1-186733e6f622 req-f150d5a6-20c8-439c-b763-3e5d9ae430c7 service nova] Creating event network-changed:8ec21be8-7bf5-49f0-aa4e-be1ae9feb015 for instance 0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0 on n-h1-master-1 Oct 30 01:30:47.020294 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-b5354b42-12b1-44a2-a8a1-186733e6f622 req-f150d5a6-20c8-439c-b763-3e5d9ae430c7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061358 Oct 30 01:30:47.021865 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1943/3886] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:30:47.031540 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-71ca742e-7d68-4d03-bd42-a8b59178924c tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44d02cdaf0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:47.129879 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ebb6962c-4924-4020-9219-bc565cc8da57 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec278d8d7b4a5a96af042ba613bafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc4c8f707304cd98a5f2e13cb1d5a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:47.133644 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=100 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:30:47.140016 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ebb6962c-4924-4020-9219-bc565cc8da57 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] 10.222.0.13 "GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2" status: 200 len: 1280 microversion: 2.1 time: 0.230434 Oct 30 01:30:47.140877 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1944/3887] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:46 2022] GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2 => generated 1280 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:47.165592 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-71ca742e-7d68-4d03-bd42-a8b59178924c tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/4a8ff4c8-f218-485b-92fe-96a06e70b7b0" status: 200 len: 1451 microversion: 2.1 time: 0.140565 Oct 30 01:30:47.176095 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1944/3888] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:30:47 2022] GET /compute/v2.1/images/4a8ff4c8-f218-485b-92fe-96a06e70b7b0 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:47.181837 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b963086a-907c-4fda-b2e2-bf629efa8450 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:47.182868 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b963086a-907c-4fda-b2e2-bf629efa8450 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 98262d96-9a63-4531-9001-3fd0efd22014] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:47.190171 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b963086a-907c-4fda-b2e2-bf629efa8450 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:47.190773 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b963086a-907c-4fda-b2e2-bf629efa8450 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:47.191219 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b963086a-907c-4fda-b2e2-bf629efa8450 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:47.192042 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b963086a-907c-4fda-b2e2-bf629efa8450 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:47.192506 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b963086a-907c-4fda-b2e2-bf629efa8450 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:47.192989 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b963086a-907c-4fda-b2e2-bf629efa8450 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:47.488419 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b963086a-907c-4fda-b2e2-bf629efa8450 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:47.502244 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b963086a-907c-4fda-b2e2-bf629efa8450 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/98262d96-9a63-4531-9001-3fd0efd22014" status: 200 len: 1308 microversion: 2.1 time: 0.324641 Oct 30 01:30:47.507709 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1945/3889] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:47 2022] GET /compute/v2.1/servers/98262d96-9a63-4531-9001-3fd0efd22014 => generated 1308 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:47.683344 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:30:47.688817 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-86cc394a-0380-4f64-a8df-e8cffc76aa37 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:47.689806 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-86cc394a-0380-4f64-a8df-e8cffc76aa37 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] [instance: 0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:47.702497 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86cc394a-0380-4f64-a8df-e8cffc76aa37 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:47.711280 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86cc394a-0380-4f64-a8df-e8cffc76aa37 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:47.711280 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86cc394a-0380-4f64-a8df-e8cffc76aa37 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:47.711280 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86cc394a-0380-4f64-a8df-e8cffc76aa37 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:47.711280 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86cc394a-0380-4f64-a8df-e8cffc76aa37 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:47.711280 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86cc394a-0380-4f64-a8df-e8cffc76aa37 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:48.030502 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-86cc394a-0380-4f64-a8df-e8cffc76aa37 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11293effe45345aeac9fd7dd672b738b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c145959fe44ed1bec7c4c964be8d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:48.035307 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:30:48.040602 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-86cc394a-0380-4f64-a8df-e8cffc76aa37 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] 10.222.0.13 "GET /compute/v2.1/servers/0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0" status: 200 len: 1324 microversion: 2.1 time: 0.358092 Oct 30 01:30:48.059107 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1945/3890] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:47 2022] GET /compute/v2.1/servers/0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0 => generated 1324 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:48.165320 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4f7ca8e8-f6f8-4ace-a8d7-2150ec442413 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:48.166101 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4f7ca8e8-f6f8-4ace-a8d7-2150ec442413 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] [instance: 1f9c8547-e0cb-4094-a15e-d21166bda1d2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:48.182316 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4f7ca8e8-f6f8-4ace-a8d7-2150ec442413 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:48.182836 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4f7ca8e8-f6f8-4ace-a8d7-2150ec442413 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:48.183318 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4f7ca8e8-f6f8-4ace-a8d7-2150ec442413 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:48.184055 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d97cbe7b-2c73-4b4f-8aec-d53d73d3042b tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44d04a9ee0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:48.193310 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4f7ca8e8-f6f8-4ace-a8d7-2150ec442413 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:48.196033 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4f7ca8e8-f6f8-4ace-a8d7-2150ec442413 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:48.196033 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4f7ca8e8-f6f8-4ace-a8d7-2150ec442413 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:48.258154 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d97cbe7b-2c73-4b4f-8aec-d53d73d3042b tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/4a8ff4c8-f218-485b-92fe-96a06e70b7b0" status: 200 len: 1451 microversion: 2.1 time: 0.079857 Oct 30 01:30:48.259022 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1946/3891] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:30:48 2022] GET /compute/v2.1/images/4a8ff4c8-f218-485b-92fe-96a06e70b7b0 => generated 1451 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:48.264878 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-f2dbca0b-3e4a-497f-86ef-da20e3537a3f req-a5bf9228-2262-461c-941b-77334da23904 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98262d96-9a63-4531-9001-3fd0efd22014", "name": "network-vif-plugged", "status": "completed", "tag": "716e550e-c87a-4177-bf1f-22fa02af88f1"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:30:48.277668 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-f2dbca0b-3e4a-497f-86ef-da20e3537a3f req-a5bf9228-2262-461c-941b-77334da23904 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:48.278453 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-f2dbca0b-3e4a-497f-86ef-da20e3537a3f req-a5bf9228-2262-461c-941b-77334da23904 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:48.279178 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-f2dbca0b-3e4a-497f-86ef-da20e3537a3f req-a5bf9228-2262-461c-941b-77334da23904 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:48.291885 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-f2dbca0b-3e4a-497f-86ef-da20e3537a3f req-a5bf9228-2262-461c-941b-77334da23904 service nova] Creating event network-vif-plugged:716e550e-c87a-4177-bf1f-22fa02af88f1 for instance 98262d96-9a63-4531-9001-3fd0efd22014 on n-h2-master-1 Oct 30 01:30:48.298166 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-f2dbca0b-3e4a-497f-86ef-da20e3537a3f req-a5bf9228-2262-461c-941b-77334da23904 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037668 Oct 30 01:30:48.303023 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1947/3892] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:30:48.532101 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6790f292-8247-41c7-895b-458b5a688e04 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:48.544682 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6790f292-8247-41c7-895b-458b5a688e04 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 98262d96-9a63-4531-9001-3fd0efd22014] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:48.561983 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6790f292-8247-41c7-895b-458b5a688e04 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:48.563409 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6790f292-8247-41c7-895b-458b5a688e04 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:48.564119 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6790f292-8247-41c7-895b-458b5a688e04 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:48.565085 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6790f292-8247-41c7-895b-458b5a688e04 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:48.565987 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6790f292-8247-41c7-895b-458b5a688e04 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:48.566701 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6790f292-8247-41c7-895b-458b5a688e04 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:48.729686 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4f7ca8e8-f6f8-4ace-a8d7-2150ec442413 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec278d8d7b4a5a96af042ba613bafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc4c8f707304cd98a5f2e13cb1d5a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:48.786168 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4f7ca8e8-f6f8-4ace-a8d7-2150ec442413 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] 10.222.0.13 "GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2" status: 200 len: 1322 microversion: 2.1 time: 0.625736 Oct 30 01:30:48.792526 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1946/3893] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:48 2022] GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2 => generated 1322 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:48.890044 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6790f292-8247-41c7-895b-458b5a688e04 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:48.908378 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6790f292-8247-41c7-895b-458b5a688e04 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/98262d96-9a63-4531-9001-3fd0efd22014" status: 200 len: 1308 microversion: 2.1 time: 0.379420 Oct 30 01:30:48.910761 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1948/3894] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:48 2022] GET /compute/v2.1/servers/98262d96-9a63-4531-9001-3fd0efd22014 => generated 1308 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:30:49.072059 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-981c33f9-2fa7-4c4f-9920-9daaa1e5376b tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:49.072617 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-981c33f9-2fa7-4c4f-9920-9daaa1e5376b tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] [instance: 0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:49.080986 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-981c33f9-2fa7-4c4f-9920-9daaa1e5376b tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:49.081525 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-981c33f9-2fa7-4c4f-9920-9daaa1e5376b tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:49.083742 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-981c33f9-2fa7-4c4f-9920-9daaa1e5376b tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:49.084717 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-981c33f9-2fa7-4c4f-9920-9daaa1e5376b tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:49.085391 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-981c33f9-2fa7-4c4f-9920-9daaa1e5376b tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:49.085979 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-981c33f9-2fa7-4c4f-9920-9daaa1e5376b tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:49.289664 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c80c40f6-d336-4b0f-b520-f92ea80d44f8 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44c7ee3e50>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:49.339932 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-981c33f9-2fa7-4c4f-9920-9daaa1e5376b tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11293effe45345aeac9fd7dd672b738b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c145959fe44ed1bec7c4c964be8d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:49.344117 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c80c40f6-d336-4b0f-b520-f92ea80d44f8 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/4a8ff4c8-f218-485b-92fe-96a06e70b7b0" status: 200 len: 1451 microversion: 2.1 time: 0.073480 Oct 30 01:30:49.345213 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1949/3895] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:30:49 2022] GET /compute/v2.1/images/4a8ff4c8-f218-485b-92fe-96a06e70b7b0 => generated 1451 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:30:49.351005 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-97c15346-5ee0-4e6b-afbd-d33ab77b60ab req-659b7630-6008-441c-a2c2-1bd1a09fc469 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f9c8547-e0cb-4094-a15e-d21166bda1d2", "tag": "bb118f0b-7010-4f9e-8bc1-93d4fa2233ad"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:30:49.360823 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-981c33f9-2fa7-4c4f-9920-9daaa1e5376b tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] 10.222.0.13 "GET /compute/v2.1/servers/0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0" status: 200 len: 1324 microversion: 2.1 time: 0.292802 Oct 30 01:30:49.363471 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1947/3896] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:49 2022] GET /compute/v2.1/servers/0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0 => generated 1324 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:49.380248 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-97c15346-5ee0-4e6b-afbd-d33ab77b60ab req-659b7630-6008-441c-a2c2-1bd1a09fc469 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:49.381525 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-97c15346-5ee0-4e6b-afbd-d33ab77b60ab req-659b7630-6008-441c-a2c2-1bd1a09fc469 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:49.381884 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-97c15346-5ee0-4e6b-afbd-d33ab77b60ab req-659b7630-6008-441c-a2c2-1bd1a09fc469 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:49.399159 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-97c15346-5ee0-4e6b-afbd-d33ab77b60ab req-659b7630-6008-441c-a2c2-1bd1a09fc469 service nova] Creating event network-changed:bb118f0b-7010-4f9e-8bc1-93d4fa2233ad for instance 1f9c8547-e0cb-4094-a15e-d21166bda1d2 on n-h1-master-1 Oct 30 01:30:49.405594 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-97c15346-5ee0-4e6b-afbd-d33ab77b60ab req-659b7630-6008-441c-a2c2-1bd1a09fc469 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058655 Oct 30 01:30:49.410856 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1950/3897] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:30:49.818567 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9d5d0918-aee8-4d05-8c35-2d9e1f21bfcb tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:49.826809 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9d5d0918-aee8-4d05-8c35-2d9e1f21bfcb tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] [instance: 1f9c8547-e0cb-4094-a15e-d21166bda1d2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:49.858167 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9d5d0918-aee8-4d05-8c35-2d9e1f21bfcb tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:49.860049 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9d5d0918-aee8-4d05-8c35-2d9e1f21bfcb tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:49.860049 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9d5d0918-aee8-4d05-8c35-2d9e1f21bfcb tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:49.865483 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9d5d0918-aee8-4d05-8c35-2d9e1f21bfcb tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:49.867767 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9d5d0918-aee8-4d05-8c35-2d9e1f21bfcb tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:49.869050 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9d5d0918-aee8-4d05-8c35-2d9e1f21bfcb tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:49.935291 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:30:49.941185 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fe437c23-0831-4ade-b88a-a89920b0c72a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:49.941185 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fe437c23-0831-4ade-b88a-a89920b0c72a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 98262d96-9a63-4531-9001-3fd0efd22014] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:49.950840 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fe437c23-0831-4ade-b88a-a89920b0c72a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:49.961182 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fe437c23-0831-4ade-b88a-a89920b0c72a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:49.961672 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fe437c23-0831-4ade-b88a-a89920b0c72a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:49.962437 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fe437c23-0831-4ade-b88a-a89920b0c72a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:49.962903 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fe437c23-0831-4ade-b88a-a89920b0c72a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:49.963577 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fe437c23-0831-4ade-b88a-a89920b0c72a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:50.211893 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9d5d0918-aee8-4d05-8c35-2d9e1f21bfcb tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec278d8d7b4a5a96af042ba613bafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc4c8f707304cd98a5f2e13cb1d5a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:50.222585 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9d5d0918-aee8-4d05-8c35-2d9e1f21bfcb tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] 10.222.0.13 "GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2" status: 200 len: 1322 microversion: 2.1 time: 0.410254 Oct 30 01:30:50.223181 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1948/3898] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:49 2022] GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2 => generated 1322 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:50.359830 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-fe437c23-0831-4ade-b88a-a89920b0c72a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:50.369211 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-75fedc02-3197-4c2e-baa6-63919e57db35 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44c7c17820>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:50.389551 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fe437c23-0831-4ade-b88a-a89920b0c72a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/98262d96-9a63-4531-9001-3fd0efd22014" status: 200 len: 1308 microversion: 2.1 time: 0.452678 Oct 30 01:30:50.390740 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1951/3899] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:49 2022] GET /compute/v2.1/servers/98262d96-9a63-4531-9001-3fd0efd22014 => generated 1308 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:30:50.397055 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f5592569-0175-41b0-a088-9eb29535f046 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:50.397704 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f5592569-0175-41b0-a088-9eb29535f046 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] [instance: 0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:50.406456 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5592569-0175-41b0-a088-9eb29535f046 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:50.407264 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5592569-0175-41b0-a088-9eb29535f046 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:50.407908 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5592569-0175-41b0-a088-9eb29535f046 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:50.408903 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5592569-0175-41b0-a088-9eb29535f046 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:50.409606 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5592569-0175-41b0-a088-9eb29535f046 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:50.410422 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5592569-0175-41b0-a088-9eb29535f046 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:50.471366 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-75fedc02-3197-4c2e-baa6-63919e57db35 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/4a8ff4c8-f218-485b-92fe-96a06e70b7b0" status: 200 len: 1451 microversion: 2.1 time: 0.113865 Oct 30 01:30:50.477922 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1949/3900] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:30:50 2022] GET /compute/v2.1/images/4a8ff4c8-f218-485b-92fe-96a06e70b7b0 => generated 1451 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:50.948846 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f5592569-0175-41b0-a088-9eb29535f046 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11293effe45345aeac9fd7dd672b738b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c145959fe44ed1bec7c4c964be8d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:50.958378 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f5592569-0175-41b0-a088-9eb29535f046 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] 10.222.0.13 "GET /compute/v2.1/servers/0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0" status: 200 len: 1324 microversion: 2.1 time: 0.565982 Oct 30 01:30:50.959146 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1952/3901] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:50 2022] GET /compute/v2.1/servers/0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0 => generated 1324 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:51.248741 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-45e95134-dc31-4c34-bbb9-4c44402f0fac tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:51.250658 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-45e95134-dc31-4c34-bbb9-4c44402f0fac tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] [instance: 1f9c8547-e0cb-4094-a15e-d21166bda1d2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:51.257506 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=8 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:30:51.260330 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45e95134-dc31-4c34-bbb9-4c44402f0fac tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:51.261146 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45e95134-dc31-4c34-bbb9-4c44402f0fac tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:51.261640 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45e95134-dc31-4c34-bbb9-4c44402f0fac tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:51.262346 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45e95134-dc31-4c34-bbb9-4c44402f0fac tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:51.262797 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45e95134-dc31-4c34-bbb9-4c44402f0fac tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:51.263217 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45e95134-dc31-4c34-bbb9-4c44402f0fac tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:51.417892 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c931e350-41f0-4d31-adcf-87354d5c3c7d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:51.418615 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c931e350-41f0-4d31-adcf-87354d5c3c7d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 98262d96-9a63-4531-9001-3fd0efd22014] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:51.426616 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c931e350-41f0-4d31-adcf-87354d5c3c7d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:51.427161 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c931e350-41f0-4d31-adcf-87354d5c3c7d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:51.427693 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c931e350-41f0-4d31-adcf-87354d5c3c7d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:51.428522 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c931e350-41f0-4d31-adcf-87354d5c3c7d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:51.429076 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c931e350-41f0-4d31-adcf-87354d5c3c7d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:51.429621 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c931e350-41f0-4d31-adcf-87354d5c3c7d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:51.451143 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-45e95134-dc31-4c34-bbb9-4c44402f0fac tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec278d8d7b4a5a96af042ba613bafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc4c8f707304cd98a5f2e13cb1d5a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:51.460314 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-45e95134-dc31-4c34-bbb9-4c44402f0fac tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] 10.222.0.13 "GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2" status: 200 len: 1322 microversion: 2.1 time: 0.216385 Oct 30 01:30:51.461645 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1950/3902] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:51 2022] GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2 => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:51.489912 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b8957f37-0279-4c2e-91a8-428416476d47 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44c738fca0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:51.551769 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b8957f37-0279-4c2e-91a8-428416476d47 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/4a8ff4c8-f218-485b-92fe-96a06e70b7b0" status: 200 len: 1451 microversion: 2.1 time: 0.061420 Oct 30 01:30:51.555360 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1951/3903] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:30:51 2022] GET /compute/v2.1/images/4a8ff4c8-f218-485b-92fe-96a06e70b7b0 => generated 1451 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:51.605886 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c931e350-41f0-4d31-adcf-87354d5c3c7d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:51.614155 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c931e350-41f0-4d31-adcf-87354d5c3c7d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/98262d96-9a63-4531-9001-3fd0efd22014" status: 200 len: 1490 microversion: 2.1 time: 0.201284 Oct 30 01:30:51.614729 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1953/3904] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:51 2022] GET /compute/v2.1/servers/98262d96-9a63-4531-9001-3fd0efd22014 => generated 1490 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:51.704853 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2fab6af9-d94b-4cb3-a309-0ebd44ab252c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-957685865", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "936faadb-2266-486c-9624-31976f3a3668"}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:30:51.771441 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-2fab6af9-d94b-4cb3-a309-0ebd44ab252c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] validate_networks() for [('936faadb-2266-486c-9624-31976f3a3668', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:30:51.985911 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9658b6fb-94c0-449d-b745-0e84c4ec48b4 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:51.987550 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9658b6fb-94c0-449d-b745-0e84c4ec48b4 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] [instance: 0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:52.000191 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9658b6fb-94c0-449d-b745-0e84c4ec48b4 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:52.001658 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9658b6fb-94c0-449d-b745-0e84c4ec48b4 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:52.002696 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9658b6fb-94c0-449d-b745-0e84c4ec48b4 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:52.004358 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9658b6fb-94c0-449d-b745-0e84c4ec48b4 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:52.005445 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9658b6fb-94c0-449d-b745-0e84c4ec48b4 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:52.006407 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9658b6fb-94c0-449d-b745-0e84c4ec48b4 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:52.317818 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9658b6fb-94c0-449d-b745-0e84c4ec48b4 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11293effe45345aeac9fd7dd672b738b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c145959fe44ed1bec7c4c964be8d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:52.326876 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9658b6fb-94c0-449d-b745-0e84c4ec48b4 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] 10.222.0.13 "GET /compute/v2.1/servers/0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0" status: 200 len: 1324 microversion: 2.1 time: 0.348123 Oct 30 01:30:52.327732 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1954/3905] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:51 2022] GET /compute/v2.1/servers/0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0 => generated 1324 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:52.358738 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-2fab6af9-d94b-4cb3-a309-0ebd44ab252c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:30:52.359162 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-2fab6af9-d94b-4cb3-a309-0ebd44ab252c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:30:52.359669 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-2fab6af9-d94b-4cb3-a309-0ebd44ab252c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:30:52.360077 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-2fab6af9-d94b-4cb3-a309-0ebd44ab252c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:30:52.360488 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-2fab6af9-d94b-4cb3-a309-0ebd44ab252c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:30:52.369490 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2fab6af9-d94b-4cb3-a309-0ebd44ab252c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:52.369910 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2fab6af9-d94b-4cb3-a309-0ebd44ab252c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:52.370371 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2fab6af9-d94b-4cb3-a309-0ebd44ab252c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:52.371104 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2fab6af9-d94b-4cb3-a309-0ebd44ab252c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:52.371759 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2fab6af9-d94b-4cb3-a309-0ebd44ab252c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:52.372189 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2fab6af9-d94b-4cb3-a309-0ebd44ab252c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:52.389893 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-2fab6af9-d94b-4cb3-a309-0ebd44ab252c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Getting quotas for project 45fe1c50eaee40249b6c20cc91e52586. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:30:52.395356 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-2fab6af9-d94b-4cb3-a309-0ebd44ab252c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Getting quotas for user ef5f8a3e6fef4d6393603575479b16a2 and project 45fe1c50eaee40249b6c20cc91e52586. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:30:52.408888 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2fab6af9-d94b-4cb3-a309-0ebd44ab252c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:30:52.411109 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2fab6af9-d94b-4cb3-a309-0ebd44ab252c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 8046842c-80bc-4713-81cf-7fecbe58a130] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:30:52.484730 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-67cf485b-0840-467f-8171-cbb3ed6f3f90 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:52.485360 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-67cf485b-0840-467f-8171-cbb3ed6f3f90 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] [instance: 1f9c8547-e0cb-4094-a15e-d21166bda1d2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:52.487349 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=18 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:30:52.494345 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67cf485b-0840-467f-8171-cbb3ed6f3f90 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:52.494345 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67cf485b-0840-467f-8171-cbb3ed6f3f90 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:52.494658 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67cf485b-0840-467f-8171-cbb3ed6f3f90 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:52.495449 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67cf485b-0840-467f-8171-cbb3ed6f3f90 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:52.495560 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67cf485b-0840-467f-8171-cbb3ed6f3f90 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:52.495988 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67cf485b-0840-467f-8171-cbb3ed6f3f90 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:52.586017 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2fab6af9-d94b-4cb3-a309-0ebd44ab252c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.886297 Oct 30 01:30:52.586687 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1952/3906] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:30:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 888 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:30:52.597838 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-36b20e44-9d01-47c6-8adc-b52ae5c345b4 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44c7c170d0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:52.667267 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-36b20e44-9d01-47c6-8adc-b52ae5c345b4 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/4a8ff4c8-f218-485b-92fe-96a06e70b7b0" status: 200 len: 1451 microversion: 2.1 time: 0.074810 Oct 30 01:30:52.668411 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1953/3907] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:30:52 2022] GET /compute/v2.1/images/4a8ff4c8-f218-485b-92fe-96a06e70b7b0 => generated 1451 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:52.683585 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-dacb1e0e-b6d0-4aeb-9bac-f9bdfc3e5111 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:52.685894 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-dacb1e0e-b6d0-4aeb-9bac-f9bdfc3e5111 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 8046842c-80bc-4713-81cf-7fecbe58a130] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:52.705015 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-67cf485b-0840-467f-8171-cbb3ed6f3f90 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec278d8d7b4a5a96af042ba613bafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc4c8f707304cd98a5f2e13cb1d5a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:52.717410 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-67cf485b-0840-467f-8171-cbb3ed6f3f90 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] 10.222.0.13 "GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2" status: 200 len: 1322 microversion: 2.1 time: 0.233433 Oct 30 01:30:52.718721 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1955/3908] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:52 2022] GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2 => generated 1322 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:30:52.763290 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-dacb1e0e-b6d0-4aeb-9bac-f9bdfc3e5111 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:52.772880 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-dacb1e0e-b6d0-4aeb-9bac-f9bdfc3e5111 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/8046842c-80bc-4713-81cf-7fecbe58a130" status: 200 len: 1208 microversion: 2.1 time: 0.102707 Oct 30 01:30:52.773048 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1954/3909] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:52 2022] GET /compute/v2.1/servers/8046842c-80bc-4713-81cf-7fecbe58a130 => generated 1208 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:53.350703 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c73984c6-d5fd-434d-94ff-304874a249c3 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:53.351314 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c73984c6-d5fd-434d-94ff-304874a249c3 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] [instance: 0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:53.359375 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c73984c6-d5fd-434d-94ff-304874a249c3 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:53.360172 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c73984c6-d5fd-434d-94ff-304874a249c3 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:53.360847 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c73984c6-d5fd-434d-94ff-304874a249c3 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:53.361856 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c73984c6-d5fd-434d-94ff-304874a249c3 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:53.362390 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c73984c6-d5fd-434d-94ff-304874a249c3 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:53.362826 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c73984c6-d5fd-434d-94ff-304874a249c3 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:53.518561 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c73984c6-d5fd-434d-94ff-304874a249c3 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11293effe45345aeac9fd7dd672b738b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c145959fe44ed1bec7c4c964be8d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:53.528476 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c73984c6-d5fd-434d-94ff-304874a249c3 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] 10.222.0.13 "GET /compute/v2.1/servers/0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0" status: 200 len: 1324 microversion: 2.1 time: 0.181779 Oct 30 01:30:53.535124 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1956/3910] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:53 2022] GET /compute/v2.1/servers/0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0 => generated 1324 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:53.683503 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e4e7ae34-3116-47e4-8dea-061ccebf6899 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44c7be89d0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:53.729570 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e4e7ae34-3116-47e4-8dea-061ccebf6899 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/4a8ff4c8-f218-485b-92fe-96a06e70b7b0" status: 200 len: 1460 microversion: 2.1 time: 0.050400 Oct 30 01:30:53.730160 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1955/3911] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:30:53 2022] GET /compute/v2.1/images/4a8ff4c8-f218-485b-92fe-96a06e70b7b0 => generated 1460 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:53.742516 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-baf7b85e-a3fe-4b1e-928c-73f34ec6ca8e tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:53.743136 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-baf7b85e-a3fe-4b1e-928c-73f34ec6ca8e tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] [instance: 1f9c8547-e0cb-4094-a15e-d21166bda1d2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:53.751261 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-baf7b85e-a3fe-4b1e-928c-73f34ec6ca8e tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:53.751852 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-baf7b85e-a3fe-4b1e-928c-73f34ec6ca8e tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:53.752270 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-552ceb6e-f723-42bd-b1a3-dc12cf271a94 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44c7e3f5e0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:53.753010 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-baf7b85e-a3fe-4b1e-928c-73f34ec6ca8e tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:53.754032 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-baf7b85e-a3fe-4b1e-928c-73f34ec6ca8e tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:53.754904 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-baf7b85e-a3fe-4b1e-928c-73f34ec6ca8e tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:53.755647 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-baf7b85e-a3fe-4b1e-928c-73f34ec6ca8e tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:53.802462 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-552ceb6e-f723-42bd-b1a3-dc12cf271a94 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/4a8ff4c8-f218-485b-92fe-96a06e70b7b0" status: 200 len: 1460 microversion: 2.1 time: 0.054390 Oct 30 01:30:53.812146 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1956/3912] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:30:53 2022] GET /compute/v2.1/images/4a8ff4c8-f218-485b-92fe-96a06e70b7b0 => generated 1460 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:53.812146 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5fa85e28-84e6-4598-95b4-559d5bc022f2 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:53.812146 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5fa85e28-84e6-4598-95b4-559d5bc022f2 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 8046842c-80bc-4713-81cf-7fecbe58a130] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:53.815459 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5fa85e28-84e6-4598-95b4-559d5bc022f2 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:53.820683 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5fa85e28-84e6-4598-95b4-559d5bc022f2 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:53.820683 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5fa85e28-84e6-4598-95b4-559d5bc022f2 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:53.820683 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5fa85e28-84e6-4598-95b4-559d5bc022f2 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:53.820683 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5fa85e28-84e6-4598-95b4-559d5bc022f2 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:53.820683 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5fa85e28-84e6-4598-95b4-559d5bc022f2 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:53.924813 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5fa85e28-84e6-4598-95b4-559d5bc022f2 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:53.932864 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5fa85e28-84e6-4598-95b4-559d5bc022f2 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/8046842c-80bc-4713-81cf-7fecbe58a130" status: 200 len: 1212 microversion: 2.1 time: 0.128505 Oct 30 01:30:53.933545 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1957/3913] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:53 2022] GET /compute/v2.1/servers/8046842c-80bc-4713-81cf-7fecbe58a130 => generated 1212 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:53.943758 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f0044f95-00f9-4a32-8c72-a1ac1554e34c tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:53.944519 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f0044f95-00f9-4a32-8c72-a1ac1554e34c tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] [instance: 99db82dd-3238-4af1-9f90-1dd69cdd836a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:53.952507 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f0044f95-00f9-4a32-8c72-a1ac1554e34c tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:53.953004 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f0044f95-00f9-4a32-8c72-a1ac1554e34c tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:53.953487 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f0044f95-00f9-4a32-8c72-a1ac1554e34c tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:53.954196 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f0044f95-00f9-4a32-8c72-a1ac1554e34c tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:53.954660 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f0044f95-00f9-4a32-8c72-a1ac1554e34c tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:53.955117 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f0044f95-00f9-4a32-8c72-a1ac1554e34c tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:54.086159 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-baf7b85e-a3fe-4b1e-928c-73f34ec6ca8e tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec278d8d7b4a5a96af042ba613bafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc4c8f707304cd98a5f2e13cb1d5a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:54.097707 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-baf7b85e-a3fe-4b1e-928c-73f34ec6ca8e tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] 10.222.0.13 "GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2" status: 200 len: 1322 microversion: 2.1 time: 0.358955 Oct 30 01:30:54.098331 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1957/3914] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:53 2022] GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2 => generated 1322 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:54.132940 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f0044f95-00f9-4a32-8c72-a1ac1554e34c tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea8a24166674250a98268ae52604f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcce1fadf54d089ec4fd751a3cf6ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:54.141611 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f0044f95-00f9-4a32-8c72-a1ac1554e34c tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/servers/99db82dd-3238-4af1-9f90-1dd69cdd836a" status: 200 len: 1467 microversion: 2.1 time: 0.203813 Oct 30 01:30:54.142202 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1958/3915] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:53 2022] GET /compute/v2.1/servers/99db82dd-3238-4af1-9f90-1dd69cdd836a => generated 1467 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:54.164375 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-87edc2de-1f01-4c03-aff1-8f4ec94839db tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-895836310"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:30:54.167675 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-87edc2de-1f01-4c03-aff1-8f4ec94839db tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] [instance: e9368bd4-9715-46b3-91bb-cb436f7120f3] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:54.175386 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-87edc2de-1f01-4c03-aff1-8f4ec94839db tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:54.175873 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-87edc2de-1f01-4c03-aff1-8f4ec94839db tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:54.176307 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-87edc2de-1f01-4c03-aff1-8f4ec94839db tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:54.177069 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-87edc2de-1f01-4c03-aff1-8f4ec94839db tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:54.177608 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-87edc2de-1f01-4c03-aff1-8f4ec94839db tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:54.178039 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-87edc2de-1f01-4c03-aff1-8f4ec94839db tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:54.553115 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7123a2ec-5d3b-4656-b461-021f85877338 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:54.553936 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7123a2ec-5d3b-4656-b461-021f85877338 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] [instance: 0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:54.560737 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7123a2ec-5d3b-4656-b461-021f85877338 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:54.561237 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7123a2ec-5d3b-4656-b461-021f85877338 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:54.561772 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7123a2ec-5d3b-4656-b461-021f85877338 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:54.562495 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7123a2ec-5d3b-4656-b461-021f85877338 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:54.562953 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7123a2ec-5d3b-4656-b461-021f85877338 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:54.563584 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7123a2ec-5d3b-4656-b461-021f85877338 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:54.736201 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-87edc2de-1f01-4c03-aff1-8f4ec94839db tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "POST /compute/v2.1/servers/e9368bd4-9715-46b3-91bb-cb436f7120f3/action" status: 202 len: 0 microversion: 2.1 time: 0.574649 Oct 30 01:30:54.744865 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1958/3916] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:30:54 2022] POST /compute/v2.1/servers/e9368bd4-9715-46b3-91bb-cb436f7120f3/action => generated 0 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 30 01:30:54.753124 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-66da831c-cd95-4fe5-91d5-383cb668fc13 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44c7eae160>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:54.793816 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7123a2ec-5d3b-4656-b461-021f85877338 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11293effe45345aeac9fd7dd672b738b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c145959fe44ed1bec7c4c964be8d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:54.804446 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7123a2ec-5d3b-4656-b461-021f85877338 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] 10.222.0.13 "GET /compute/v2.1/servers/0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0" status: 200 len: 1324 microversion: 2.1 time: 0.255610 Oct 30 01:30:54.805495 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1959/3917] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:54 2022] GET /compute/v2.1/servers/0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0 => generated 1324 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:30:54.823171 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-66da831c-cd95-4fe5-91d5-383cb668fc13 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/0771e672-b021-4747-b3e1-a12f87a748f5" status: 200 len: 1452 microversion: 2.1 time: 0.076623 Oct 30 01:30:54.823953 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1959/3918] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:30:54 2022] GET /compute/v2.1/images/0771e672-b021-4747-b3e1-a12f87a748f5 => generated 1452 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:54.958163 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-08781a79-50db-4c01-9952-8c40a058615c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:54.959032 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-08781a79-50db-4c01-9952-8c40a058615c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 8046842c-80bc-4713-81cf-7fecbe58a130] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:54.966294 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08781a79-50db-4c01-9952-8c40a058615c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:54.966787 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08781a79-50db-4c01-9952-8c40a058615c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:54.967238 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08781a79-50db-4c01-9952-8c40a058615c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:54.967928 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08781a79-50db-4c01-9952-8c40a058615c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:54.968562 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08781a79-50db-4c01-9952-8c40a058615c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:54.968981 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08781a79-50db-4c01-9952-8c40a058615c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:54.981244 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-e676d82d-378f-46cf-8366-65b40ad57428 req-51eaedbb-8f95-40ab-98b1-e58357b6be6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0", "name": "network-vif-plugged", "status": "completed", "tag": "8ec21be8-7bf5-49f0-aa4e-be1ae9feb015"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:30:54.993258 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-e676d82d-378f-46cf-8366-65b40ad57428 req-51eaedbb-8f95-40ab-98b1-e58357b6be6b service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:54.996412 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-e676d82d-378f-46cf-8366-65b40ad57428 req-51eaedbb-8f95-40ab-98b1-e58357b6be6b service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:54.996412 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-e676d82d-378f-46cf-8366-65b40ad57428 req-51eaedbb-8f95-40ab-98b1-e58357b6be6b service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:55.005492 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-e676d82d-378f-46cf-8366-65b40ad57428 req-51eaedbb-8f95-40ab-98b1-e58357b6be6b service nova] Creating event network-vif-plugged:8ec21be8-7bf5-49f0-aa4e-be1ae9feb015 for instance 0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0 on n-h1-master-1 Oct 30 01:30:55.010763 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-e676d82d-378f-46cf-8366-65b40ad57428 req-51eaedbb-8f95-40ab-98b1-e58357b6be6b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034354 Oct 30 01:30:55.011369 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1960/3919] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:30:55.038088 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-08781a79-50db-4c01-9952-8c40a058615c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:55.044879 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-08781a79-50db-4c01-9952-8c40a058615c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/8046842c-80bc-4713-81cf-7fecbe58a130" status: 200 len: 1260 microversion: 2.1 time: 0.092005 Oct 30 01:30:55.045485 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1960/3920] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:54 2022] GET /compute/v2.1/servers/8046842c-80bc-4713-81cf-7fecbe58a130 => generated 1260 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:30:55.122028 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-aef791d0-6b2e-4274-9cdd-e0e9225302af tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:55.123167 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-aef791d0-6b2e-4274-9cdd-e0e9225302af tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] [instance: 1f9c8547-e0cb-4094-a15e-d21166bda1d2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:55.138695 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aef791d0-6b2e-4274-9cdd-e0e9225302af tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:55.139793 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aef791d0-6b2e-4274-9cdd-e0e9225302af tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:55.140480 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aef791d0-6b2e-4274-9cdd-e0e9225302af tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:55.141725 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aef791d0-6b2e-4274-9cdd-e0e9225302af tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:55.142411 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aef791d0-6b2e-4274-9cdd-e0e9225302af tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:55.143065 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aef791d0-6b2e-4274-9cdd-e0e9225302af tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:55.512179 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-aef791d0-6b2e-4274-9cdd-e0e9225302af tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec278d8d7b4a5a96af042ba613bafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc4c8f707304cd98a5f2e13cb1d5a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:55.523129 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-aef791d0-6b2e-4274-9cdd-e0e9225302af tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] 10.222.0.13 "GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2" status: 200 len: 1322 microversion: 2.1 time: 0.405968 Oct 30 01:30:55.528979 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1961/3921] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:55 2022] GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2 => generated 1322 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:55.828900 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-33c28b0a-5329-43c4-8782-5a8246b7e5ff tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:55.829580 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-33c28b0a-5329-43c4-8782-5a8246b7e5ff tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] [instance: 0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:55.839305 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1ba99dc9-f06f-4089-a45a-a3452289a3b0 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44d03de550>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:55.852434 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-33c28b0a-5329-43c4-8782-5a8246b7e5ff tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:55.852935 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-33c28b0a-5329-43c4-8782-5a8246b7e5ff tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:55.853833 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-33c28b0a-5329-43c4-8782-5a8246b7e5ff tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:55.854799 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-33c28b0a-5329-43c4-8782-5a8246b7e5ff tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:55.855541 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-33c28b0a-5329-43c4-8782-5a8246b7e5ff tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:55.856140 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-33c28b0a-5329-43c4-8782-5a8246b7e5ff tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:55.900226 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1ba99dc9-f06f-4089-a45a-a3452289a3b0 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/0771e672-b021-4747-b3e1-a12f87a748f5" status: 200 len: 1452 microversion: 2.1 time: 0.064718 Oct 30 01:30:55.900914 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1962/3922] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:30:55 2022] GET /compute/v2.1/images/0771e672-b021-4747-b3e1-a12f87a748f5 => generated 1452 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:56.065443 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-33c28b0a-5329-43c4-8782-5a8246b7e5ff tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11293effe45345aeac9fd7dd672b738b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c145959fe44ed1bec7c4c964be8d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:56.070707 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7e0282f2-fd15-4744-95c5-e137f7a26ab3 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:56.071354 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7e0282f2-fd15-4744-95c5-e137f7a26ab3 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 8046842c-80bc-4713-81cf-7fecbe58a130] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:56.079466 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e0282f2-fd15-4744-95c5-e137f7a26ab3 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:56.080174 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e0282f2-fd15-4744-95c5-e137f7a26ab3 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:56.080613 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e0282f2-fd15-4744-95c5-e137f7a26ab3 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:56.081188 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-33c28b0a-5329-43c4-8782-5a8246b7e5ff tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] 10.222.0.13 "GET /compute/v2.1/servers/0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0" status: 200 len: 1324 microversion: 2.1 time: 0.256264 Oct 30 01:30:56.081361 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e0282f2-fd15-4744-95c5-e137f7a26ab3 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:56.081793 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e0282f2-fd15-4744-95c5-e137f7a26ab3 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:56.081949 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1961/3923] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:55 2022] GET /compute/v2.1/servers/0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0 => generated 1324 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:56.082536 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e0282f2-fd15-4744-95c5-e137f7a26ab3 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:56.155373 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7e0282f2-fd15-4744-95c5-e137f7a26ab3 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:56.163099 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7e0282f2-fd15-4744-95c5-e137f7a26ab3 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/8046842c-80bc-4713-81cf-7fecbe58a130" status: 200 len: 1266 microversion: 2.1 time: 0.096400 Oct 30 01:30:56.163723 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1963/3924] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:56 2022] GET /compute/v2.1/servers/8046842c-80bc-4713-81cf-7fecbe58a130 => generated 1266 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:30:56.548131 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c713afe2-7aa6-43ae-b22f-6b555d2ba072 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:56.548748 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c713afe2-7aa6-43ae-b22f-6b555d2ba072 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] [instance: 1f9c8547-e0cb-4094-a15e-d21166bda1d2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:56.557555 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c713afe2-7aa6-43ae-b22f-6b555d2ba072 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:56.558056 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c713afe2-7aa6-43ae-b22f-6b555d2ba072 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:56.558534 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c713afe2-7aa6-43ae-b22f-6b555d2ba072 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:56.559459 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c713afe2-7aa6-43ae-b22f-6b555d2ba072 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:56.560091 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c713afe2-7aa6-43ae-b22f-6b555d2ba072 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:56.560525 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c713afe2-7aa6-43ae-b22f-6b555d2ba072 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:56.809067 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c713afe2-7aa6-43ae-b22f-6b555d2ba072 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec278d8d7b4a5a96af042ba613bafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc4c8f707304cd98a5f2e13cb1d5a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:56.823769 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c713afe2-7aa6-43ae-b22f-6b555d2ba072 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] 10.222.0.13 "GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2" status: 200 len: 1322 microversion: 2.1 time: 0.278775 Oct 30 01:30:56.825442 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1962/3925] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:56 2022] GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2 => generated 1322 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:56.919178 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-48427d3b-4ef7-41a1-a04a-a969ee089072 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44d04cf1f0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:56.975509 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-48427d3b-4ef7-41a1-a04a-a969ee089072 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/0771e672-b021-4747-b3e1-a12f87a748f5" status: 200 len: 1452 microversion: 2.1 time: 0.062860 Oct 30 01:30:56.976156 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1964/3926] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:30:56 2022] GET /compute/v2.1/images/0771e672-b021-4747-b3e1-a12f87a748f5 => generated 1452 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:57.029976 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-40efbdb9-a4ed-4af1-8ea4-4230bb8f22e7 req-7d64b161-6885-4c40-8bf3-9c03cb975155 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f9c8547-e0cb-4094-a15e-d21166bda1d2", "name": "network-vif-plugged", "status": "completed", "tag": "bb118f0b-7010-4f9e-8bc1-93d4fa2233ad"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:30:57.046431 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-40efbdb9-a4ed-4af1-8ea4-4230bb8f22e7 req-7d64b161-6885-4c40-8bf3-9c03cb975155 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:57.047369 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-40efbdb9-a4ed-4af1-8ea4-4230bb8f22e7 req-7d64b161-6885-4c40-8bf3-9c03cb975155 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:57.048011 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-40efbdb9-a4ed-4af1-8ea4-4230bb8f22e7 req-7d64b161-6885-4c40-8bf3-9c03cb975155 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:57.061375 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-40efbdb9-a4ed-4af1-8ea4-4230bb8f22e7 req-7d64b161-6885-4c40-8bf3-9c03cb975155 service nova] Creating event network-vif-plugged:bb118f0b-7010-4f9e-8bc1-93d4fa2233ad for instance 1f9c8547-e0cb-4094-a15e-d21166bda1d2 on n-h1-master-1 Oct 30 01:30:57.067000 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-40efbdb9-a4ed-4af1-8ea4-4230bb8f22e7 req-7d64b161-6885-4c40-8bf3-9c03cb975155 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040828 Oct 30 01:30:57.070377 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1963/3927] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:30:57.108808 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-072eb022-7a0b-49e1-8ed6-31fbfe40fddb tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:57.109455 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-072eb022-7a0b-49e1-8ed6-31fbfe40fddb tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] [instance: 0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:57.117037 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-072eb022-7a0b-49e1-8ed6-31fbfe40fddb tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:57.117956 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-072eb022-7a0b-49e1-8ed6-31fbfe40fddb tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:57.121977 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-072eb022-7a0b-49e1-8ed6-31fbfe40fddb tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:57.121977 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-072eb022-7a0b-49e1-8ed6-31fbfe40fddb tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:57.121977 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-072eb022-7a0b-49e1-8ed6-31fbfe40fddb tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:57.121977 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-072eb022-7a0b-49e1-8ed6-31fbfe40fddb tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:57.190806 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-810983ed-d384-42ac-9c00-0f0f0d2e802e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:57.192589 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-810983ed-d384-42ac-9c00-0f0f0d2e802e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 8046842c-80bc-4713-81cf-7fecbe58a130] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:57.200841 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-810983ed-d384-42ac-9c00-0f0f0d2e802e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:57.201384 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-810983ed-d384-42ac-9c00-0f0f0d2e802e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:57.206012 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-810983ed-d384-42ac-9c00-0f0f0d2e802e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:57.206824 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-810983ed-d384-42ac-9c00-0f0f0d2e802e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:57.207286 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-810983ed-d384-42ac-9c00-0f0f0d2e802e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:57.207702 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-810983ed-d384-42ac-9c00-0f0f0d2e802e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:57.508242 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-072eb022-7a0b-49e1-8ed6-31fbfe40fddb tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11293effe45345aeac9fd7dd672b738b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c145959fe44ed1bec7c4c964be8d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:57.517472 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-072eb022-7a0b-49e1-8ed6-31fbfe40fddb tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] 10.222.0.13 "GET /compute/v2.1/servers/0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0" status: 200 len: 1324 microversion: 2.1 time: 0.412668 Oct 30 01:30:57.518059 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1965/3928] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:57 2022] GET /compute/v2.1/servers/0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0 => generated 1324 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:57.550786 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-810983ed-d384-42ac-9c00-0f0f0d2e802e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:57.559554 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-810983ed-d384-42ac-9c00-0f0f0d2e802e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/8046842c-80bc-4713-81cf-7fecbe58a130" status: 200 len: 1308 microversion: 2.1 time: 0.373066 Oct 30 01:30:57.560142 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1964/3929] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:57 2022] GET /compute/v2.1/servers/8046842c-80bc-4713-81cf-7fecbe58a130 => generated 1308 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:30:57.848460 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d4da99de-ffd4-49e8-b126-e1208fa712ff tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:57.849130 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d4da99de-ffd4-49e8-b126-e1208fa712ff tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] [instance: 1f9c8547-e0cb-4094-a15e-d21166bda1d2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:57.862191 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4da99de-ffd4-49e8-b126-e1208fa712ff tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:57.862983 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4da99de-ffd4-49e8-b126-e1208fa712ff tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:57.864422 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4da99de-ffd4-49e8-b126-e1208fa712ff tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:57.865414 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4da99de-ffd4-49e8-b126-e1208fa712ff tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:57.866264 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4da99de-ffd4-49e8-b126-e1208fa712ff tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:57.866812 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4da99de-ffd4-49e8-b126-e1208fa712ff tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:57.991289 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bb228c29-cb52-4601-a4a5-210dabe2688e tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44c7c17550>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:58.044084 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bb228c29-cb52-4601-a4a5-210dabe2688e tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/0771e672-b021-4747-b3e1-a12f87a748f5" status: 200 len: 1452 microversion: 2.1 time: 0.056376 Oct 30 01:30:58.053517 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1965/3930] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:30:57 2022] GET /compute/v2.1/images/0771e672-b021-4747-b3e1-a12f87a748f5 => generated 1452 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:58.083473 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d4da99de-ffd4-49e8-b126-e1208fa712ff tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec278d8d7b4a5a96af042ba613bafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc4c8f707304cd98a5f2e13cb1d5a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:58.091698 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d4da99de-ffd4-49e8-b126-e1208fa712ff tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] 10.222.0.13 "GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2" status: 200 len: 1322 microversion: 2.1 time: 0.247322 Oct 30 01:30:58.092300 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1966/3931] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:57 2022] GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2 => generated 1322 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:58.171614 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-9f477f42-cde4-4310-9595-2b4710374e15 req-31dfd515-3c3b-451b-b67c-0629a00cc8aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8046842c-80bc-4713-81cf-7fecbe58a130", "tag": "05f0777c-9301-4b65-a625-b42d9248035f"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:30:58.183862 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-9f477f42-cde4-4310-9595-2b4710374e15 req-31dfd515-3c3b-451b-b67c-0629a00cc8aa service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:58.184608 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-9f477f42-cde4-4310-9595-2b4710374e15 req-31dfd515-3c3b-451b-b67c-0629a00cc8aa service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:58.185038 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-9f477f42-cde4-4310-9595-2b4710374e15 req-31dfd515-3c3b-451b-b67c-0629a00cc8aa service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:58.196293 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-9f477f42-cde4-4310-9595-2b4710374e15 req-31dfd515-3c3b-451b-b67c-0629a00cc8aa service nova] Creating event network-changed:05f0777c-9301-4b65-a625-b42d9248035f for instance 8046842c-80bc-4713-81cf-7fecbe58a130 on n-h2-master-1 Oct 30 01:30:58.201105 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-9f477f42-cde4-4310-9595-2b4710374e15 req-31dfd515-3c3b-451b-b67c-0629a00cc8aa service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034342 Oct 30 01:30:58.201892 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1966/3932] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:30:58.541684 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-280620c0-e683-4585-98d5-015b3c6933d1 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:58.542223 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-280620c0-e683-4585-98d5-015b3c6933d1 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] [instance: 0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:58.549281 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-280620c0-e683-4585-98d5-015b3c6933d1 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:58.550135 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-280620c0-e683-4585-98d5-015b3c6933d1 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:58.550581 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-280620c0-e683-4585-98d5-015b3c6933d1 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:58.551474 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-280620c0-e683-4585-98d5-015b3c6933d1 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:58.551937 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-280620c0-e683-4585-98d5-015b3c6933d1 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:58.552355 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-280620c0-e683-4585-98d5-015b3c6933d1 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:58.584991 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-63728e97-a442-400a-afb6-109d44fc584b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:58.585809 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-63728e97-a442-400a-afb6-109d44fc584b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 8046842c-80bc-4713-81cf-7fecbe58a130] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:58.593351 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-63728e97-a442-400a-afb6-109d44fc584b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:58.593935 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-63728e97-a442-400a-afb6-109d44fc584b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:58.594445 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-63728e97-a442-400a-afb6-109d44fc584b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:58.595254 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-63728e97-a442-400a-afb6-109d44fc584b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:58.595783 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-63728e97-a442-400a-afb6-109d44fc584b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:58.596282 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-63728e97-a442-400a-afb6-109d44fc584b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:58.868631 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-280620c0-e683-4585-98d5-015b3c6933d1 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11293effe45345aeac9fd7dd672b738b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c145959fe44ed1bec7c4c964be8d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:58.877369 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-280620c0-e683-4585-98d5-015b3c6933d1 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] 10.222.0.13 "GET /compute/v2.1/servers/0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0" status: 200 len: 1521 microversion: 2.1 time: 0.340643 Oct 30 01:30:58.894370 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1967/3933] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:58 2022] GET /compute/v2.1/servers/0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0 => generated 1521 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:58.911524 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0f66b53f-c19d-406f-b67d-3bbd8548da50 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:58.912031 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0f66b53f-c19d-406f-b67d-3bbd8548da50 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] [instance: 0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:58.918061 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-63728e97-a442-400a-afb6-109d44fc584b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:58.933558 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-63728e97-a442-400a-afb6-109d44fc584b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/8046842c-80bc-4713-81cf-7fecbe58a130" status: 200 len: 1308 microversion: 2.1 time: 0.353043 Oct 30 01:30:58.952940 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1967/3934] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:58 2022] GET /compute/v2.1/servers/8046842c-80bc-4713-81cf-7fecbe58a130 => generated 1308 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:58.953305 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0f66b53f-c19d-406f-b67d-3bbd8548da50 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:58.954229 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0f66b53f-c19d-406f-b67d-3bbd8548da50 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:58.954960 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0f66b53f-c19d-406f-b67d-3bbd8548da50 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:58.956204 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0f66b53f-c19d-406f-b67d-3bbd8548da50 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:58.956859 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0f66b53f-c19d-406f-b67d-3bbd8548da50 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:58.957324 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0f66b53f-c19d-406f-b67d-3bbd8548da50 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:58.962618 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:30:58.987243 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-0f66b53f-c19d-406f-b67d-3bbd8548da50 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] HTTP exception thrown: Instance is not a member of specified network Oct 30 01:30:58.995022 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0f66b53f-c19d-406f-b67d-3bbd8548da50 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Request method failure captured: Oct 30 01:30:58.995022 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0/ips/invalid HTTP/1.1 Oct 30 01:30:58.995022 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:30:58.995022 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:30:58.995022 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:30:58.995022 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:30:58.995022 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:30:58.995022 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:30:58.995022 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:30:58.995022 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:30:58.995022 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdO5LO39nVKA_j4PiywrrfPtuGsPwZuQs_RO_d1dhCuyFcYpibcySMJxFXjmH7GlyZoXYXgMFl_DNz4Yy9uEUOSF3jsOdVayIzFto7t4wNwhcV4lOL5zuhUIXQP3aRAJMcOMzdeZWXTs_ZzukVyT19XpHWwybPQUSnf49uEHu8TnX5s Oct 30 01:30:58.995022 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:30:58.995022 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:30:58.995022 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:30:58.995022 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:30:58.995022 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:30:58.995022 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:30:58.995022 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 93c145959fe44ed1bec7c4c964be8d2e Oct 30 01:30:58.995022 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-713194133 Oct 30 01:30:58.995022 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:30:58.995022 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:30:58.995022 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/93c145959fe44ed1bec7c4c964be8d2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_93c145959fe44ed1bec7c4c964be8d2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/93c145959fe44ed1bec7c4c964be8d2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/93c145959fe44ed1bec7c4c964be8d2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:30:58.995022 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-713194133 Oct 30 01:30:58.995022 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 93c145959fe44ed1bec7c4c964be8d2e Oct 30 01:30:58.995022 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-713194133 Oct 30 01:30:58.995022 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServerAddressesNegativeTestJSON-713194133-project Oct 30 01:30:58.995022 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:30:58.995022 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:30:58.995022 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 11293effe45345aeac9fd7dd672b738b Oct 30 01:30:58.995022 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-713194133-project Oct 30 01:30:58.995022 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:30:58.995022 n-d-master-1 devstack@n-api.service[121102]: exception: Instance is not a member of specified network Oct 30 01:30:58.995022 n-d-master-1 devstack@n-api.service[121102]: action_args: {'server_id': '0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0', 'id': 'invalid'} Oct 30 01:30:58.995022 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:30:58.995022 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:30:58.995022 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:30:58.995022 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:30:58.995022 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:30:58.995022 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:30:58.995022 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:30:58.995022 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:30:58.995022 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 30 01:30:58.995022 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 30 01:30:58.995022 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 30 01:30:58.995022 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:30:58.995022 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:30:58.995022 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:30:58.995022 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:30:58.995022 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:30:58.995022 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:30:58.995022 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:30:58.995022 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:30:58.995022 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 30 01:30:58.995022 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:30:59.007977 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0f66b53f-c19d-406f-b67d-3bbd8548da50 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Returning 404 to user: Instance is not a member of specified network {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:30:59.007977 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0f66b53f-c19d-406f-b67d-3bbd8548da50 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] 10.222.0.13 "GET /compute/v2.1/servers/0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.089910 Oct 30 01:30:59.007977 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1968/3935] 10.222.0.13 () {58 vars in 1272 bytes} [Sun Oct 30 01:30:58 2022] GET /compute/v2.1/servers/0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0/ips/invalid => generated 91 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:30:59.014080 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1835f1b0-828d-46bb-9ac7-867973578950 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:59.014833 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1835f1b0-828d-46bb-9ac7-867973578950 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Failed to fetch instance by id 999 {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 30 01:30:59.015773 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-1835f1b0-828d-46bb-9ac7-867973578950 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] HTTP exception thrown: Instance 999 could not be found. Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1835f1b0-828d-46bb-9ac7-867973578950 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Request method failure captured: Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdO5LO39nVKA_j4PiywrrfPtuGsPwZuQs_RO_d1dhCuyFcYpibcySMJxFXjmH7GlyZoXYXgMFl_DNz4Yy9uEUOSF3jsOdVayIzFto7t4wNwhcV4lOL5zuhUIXQP3aRAJMcOMzdeZWXTs_ZzukVyT19XpHWwybPQUSnf49uEHu8TnX5s Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 93c145959fe44ed1bec7c4c964be8d2e Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-713194133 Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/93c145959fe44ed1bec7c4c964be8d2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_93c145959fe44ed1bec7c4c964be8d2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/93c145959fe44ed1bec7c4c964be8d2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/93c145959fe44ed1bec7c4c964be8d2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-713194133 Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 93c145959fe44ed1bec7c4c964be8d2e Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-713194133 Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServerAddressesNegativeTestJSON-713194133-project Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 11293effe45345aeac9fd7dd672b738b Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-713194133-project Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 999 could not be found. Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: action_args: {'server_id': '999'} Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 30 01:30:59.017784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:30:59.030161 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1835f1b0-828d-46bb-9ac7-867973578950 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Returning 404 to user: Instance 999 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:30:59.030161 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1835f1b0-828d-46bb-9ac7-867973578950 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] 10.222.0.13 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.013310 Oct 30 01:30:59.030161 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1968/3936] 10.222.0.13 () {58 vars in 1149 bytes} [Sun Oct 30 01:30:59 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:30:59.034486 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2869e46a-07f5-40ab-b053-4c678cdbac73 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:59.034976 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2869e46a-07f5-40ab-b053-4c678cdbac73 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] [instance: 0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:59.043731 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2869e46a-07f5-40ab-b053-4c678cdbac73 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:59.044380 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2869e46a-07f5-40ab-b053-4c678cdbac73 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:59.044828 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2869e46a-07f5-40ab-b053-4c678cdbac73 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:59.046050 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2869e46a-07f5-40ab-b053-4c678cdbac73 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:59.046721 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2869e46a-07f5-40ab-b053-4c678cdbac73 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:59.047835 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2869e46a-07f5-40ab-b053-4c678cdbac73 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:59.066037 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8e79ed5d-fe29-42ec-a1ed-fa3d6210d546 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44d044f310>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:59.092670 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2869e46a-07f5-40ab-b053-4c678cdbac73 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] [instance: 0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:30:59.137595 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8e79ed5d-fe29-42ec-a1ed-fa3d6210d546 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/0771e672-b021-4747-b3e1-a12f87a748f5" status: 200 len: 1452 microversion: 2.1 time: 0.078581 Oct 30 01:30:59.138729 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1969/3937] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:30:59 2022] GET /compute/v2.1/images/0771e672-b021-4747-b3e1-a12f87a748f5 => generated 1452 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:59.144209 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-1087f711-91f2-4dfe-bbf3-aaba6a1a3d7e req-228d4578-8e93-43fb-9753-921743f08abd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99db82dd-3238-4af1-9f90-1dd69cdd836a", "name": "network-vif-unplugged", "status": "completed", "tag": "49372d17-c87d-4e36-af57-5d05c8cba1e2"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:30:59.155363 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-1087f711-91f2-4dfe-bbf3-aaba6a1a3d7e req-228d4578-8e93-43fb-9753-921743f08abd service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:59.155850 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-1087f711-91f2-4dfe-bbf3-aaba6a1a3d7e req-228d4578-8e93-43fb-9753-921743f08abd service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:59.156281 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-1087f711-91f2-4dfe-bbf3-aaba6a1a3d7e req-228d4578-8e93-43fb-9753-921743f08abd service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:59.172372 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-1087f711-91f2-4dfe-bbf3-aaba6a1a3d7e req-228d4578-8e93-43fb-9753-921743f08abd service nova] Creating event network-vif-unplugged:49372d17-c87d-4e36-af57-5d05c8cba1e2 for instance 99db82dd-3238-4af1-9f90-1dd69cdd836a on n-h1-master-1 Oct 30 01:30:59.177691 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-1087f711-91f2-4dfe-bbf3-aaba6a1a3d7e req-228d4578-8e93-43fb-9753-921743f08abd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037592 Oct 30 01:30:59.178757 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1970/3938] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:30:59.184154 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0cc94579-6f6d-4cfc-a556-e40213915e66 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:59.185134 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0cc94579-6f6d-4cfc-a556-e40213915e66 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] [instance: 1f9c8547-e0cb-4094-a15e-d21166bda1d2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:59.192500 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0cc94579-6f6d-4cfc-a556-e40213915e66 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:59.193075 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0cc94579-6f6d-4cfc-a556-e40213915e66 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:59.193612 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0cc94579-6f6d-4cfc-a556-e40213915e66 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:59.194332 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0cc94579-6f6d-4cfc-a556-e40213915e66 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:59.194789 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0cc94579-6f6d-4cfc-a556-e40213915e66 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:59.195219 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0cc94579-6f6d-4cfc-a556-e40213915e66 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:59.345999 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0cc94579-6f6d-4cfc-a556-e40213915e66 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec278d8d7b4a5a96af042ba613bafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc4c8f707304cd98a5f2e13cb1d5a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:59.354667 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0cc94579-6f6d-4cfc-a556-e40213915e66 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] 10.222.0.13 "GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2" status: 200 len: 1516 microversion: 2.1 time: 0.174716 Oct 30 01:30:59.355352 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1971/3939] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:59 2022] GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2 => generated 1516 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:59.378132 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-88c7f774-db65-456c-9145-b4da9705a9b2 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:30:59.380571 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-88c7f774-db65-456c-9145-b4da9705a9b2 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] [instance: 1f9c8547-e0cb-4094-a15e-d21166bda1d2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:59.387077 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-88c7f774-db65-456c-9145-b4da9705a9b2 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:59.387555 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-88c7f774-db65-456c-9145-b4da9705a9b2 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:59.392330 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-88c7f774-db65-456c-9145-b4da9705a9b2 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:59.392330 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-88c7f774-db65-456c-9145-b4da9705a9b2 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:59.392330 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-88c7f774-db65-456c-9145-b4da9705a9b2 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:59.392330 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-88c7f774-db65-456c-9145-b4da9705a9b2 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:59.414533 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-88c7f774-db65-456c-9145-b4da9705a9b2 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lazy-loading 'flavor' on Instance uuid 1f9c8547-e0cb-4094-a15e-d21166bda1d2 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:30:59.428674 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=100 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:30:59.462358 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2869e46a-07f5-40ab-b053-4c678cdbac73 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0" status: 204 len: 0 microversion: 2.1 time: 0.432029 Oct 30 01:30:59.466145 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1969/3940] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:30:59 2022] DELETE /compute/v2.1/servers/0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:30:59.471605 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f368a96c-4186-40b5-9c8c-6321fcbddc08 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:59.472312 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f368a96c-4186-40b5-9c8c-6321fcbddc08 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] [instance: 0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:59.478349 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f368a96c-4186-40b5-9c8c-6321fcbddc08 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:59.478838 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f368a96c-4186-40b5-9c8c-6321fcbddc08 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:59.479274 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f368a96c-4186-40b5-9c8c-6321fcbddc08 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:59.480008 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f368a96c-4186-40b5-9c8c-6321fcbddc08 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:59.480493 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f368a96c-4186-40b5-9c8c-6321fcbddc08 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:59.480922 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f368a96c-4186-40b5-9c8c-6321fcbddc08 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:59.614254 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f368a96c-4186-40b5-9c8c-6321fcbddc08 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11293effe45345aeac9fd7dd672b738b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c145959fe44ed1bec7c4c964be8d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:59.622090 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f368a96c-4186-40b5-9c8c-6321fcbddc08 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] 10.222.0.13 "GET /compute/v2.1/servers/0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0" status: 200 len: 1527 microversion: 2.1 time: 0.154853 Oct 30 01:30:59.622670 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1970/3941] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:59 2022] GET /compute/v2.1/servers/0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0 => generated 1527 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:30:59.741018 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-88c7f774-db65-456c-9145-b4da9705a9b2 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] 10.222.0.13 "POST /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2/action" status: 200 len: 32 microversion: 2.1 time: 0.367031 Oct 30 01:30:59.741665 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1972/3942] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:30:59 2022] POST /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2/action => generated 32 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 30 01:30:59.751288 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-679c922e-40c4-495c-bf7d-7495c6d3d3e4 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:59.751925 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-679c922e-40c4-495c-bf7d-7495c6d3d3e4 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] [instance: 1f9c8547-e0cb-4094-a15e-d21166bda1d2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:59.757762 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-679c922e-40c4-495c-bf7d-7495c6d3d3e4 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:59.758247 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-679c922e-40c4-495c-bf7d-7495c6d3d3e4 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:59.762889 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-679c922e-40c4-495c-bf7d-7495c6d3d3e4 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:59.762889 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-679c922e-40c4-495c-bf7d-7495c6d3d3e4 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:59.762889 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-679c922e-40c4-495c-bf7d-7495c6d3d3e4 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:59.762889 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-679c922e-40c4-495c-bf7d-7495c6d3d3e4 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:59.908373 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-679c922e-40c4-495c-bf7d-7495c6d3d3e4 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec278d8d7b4a5a96af042ba613bafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc4c8f707304cd98a5f2e13cb1d5a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:30:59.916970 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-679c922e-40c4-495c-bf7d-7495c6d3d3e4 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] 10.222.0.13 "GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2" status: 200 len: 1522 microversion: 2.1 time: 0.169399 Oct 30 01:30:59.917689 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1971/3943] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:59 2022] GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:30:59.961223 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-922a42b8-0615-4fe8-88bd-c359d43663ca tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:30:59.962106 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-922a42b8-0615-4fe8-88bd-c359d43663ca tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 8046842c-80bc-4713-81cf-7fecbe58a130] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:30:59.968843 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-922a42b8-0615-4fe8-88bd-c359d43663ca tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:59.969437 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-922a42b8-0615-4fe8-88bd-c359d43663ca tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:59.970044 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-922a42b8-0615-4fe8-88bd-c359d43663ca tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:30:59.970669 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-922a42b8-0615-4fe8-88bd-c359d43663ca tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:30:59.971129 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-922a42b8-0615-4fe8-88bd-c359d43663ca tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:30:59.971544 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-922a42b8-0615-4fe8-88bd-c359d43663ca tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:00.112490 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-922a42b8-0615-4fe8-88bd-c359d43663ca tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:00.120504 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-922a42b8-0615-4fe8-88bd-c359d43663ca tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/8046842c-80bc-4713-81cf-7fecbe58a130" status: 200 len: 1308 microversion: 2.1 time: 0.163928 Oct 30 01:31:00.121075 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1973/3944] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:30:59 2022] GET /compute/v2.1/servers/8046842c-80bc-4713-81cf-7fecbe58a130 => generated 1308 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:31:00.154569 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1ca799d9-45b5-4eda-b622-f8560c234b4b tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44c7edd8b0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:00.199621 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1ca799d9-45b5-4eda-b622-f8560c234b4b tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/0771e672-b021-4747-b3e1-a12f87a748f5" status: 200 len: 1452 microversion: 2.1 time: 0.049161 Oct 30 01:31:00.200206 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1972/3945] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:31:00 2022] GET /compute/v2.1/images/0771e672-b021-4747-b3e1-a12f87a748f5 => generated 1452 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:00.645838 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4c4bcc37-7f99-44ca-b815-035c17373249 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:00.646490 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4c4bcc37-7f99-44ca-b815-035c17373249 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] [instance: 0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:00.654682 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4c4bcc37-7f99-44ca-b815-035c17373249 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:00.657753 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4c4bcc37-7f99-44ca-b815-035c17373249 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:00.657753 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4c4bcc37-7f99-44ca-b815-035c17373249 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:00.657753 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4c4bcc37-7f99-44ca-b815-035c17373249 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:00.657753 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4c4bcc37-7f99-44ca-b815-035c17373249 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:00.657753 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4c4bcc37-7f99-44ca-b815-035c17373249 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:00.813205 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4c4bcc37-7f99-44ca-b815-035c17373249 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11293effe45345aeac9fd7dd672b738b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c145959fe44ed1bec7c4c964be8d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:00.824279 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4c4bcc37-7f99-44ca-b815-035c17373249 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] 10.222.0.13 "GET /compute/v2.1/servers/0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0" status: 200 len: 1527 microversion: 2.1 time: 0.182380 Oct 30 01:31:00.825113 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1974/3946] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:00 2022] GET /compute/v2.1/servers/0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0 => generated 1527 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:00.941300 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6a4c0b82-b0e9-4c32-abd1-c6237e1e6367 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:00.941966 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6a4c0b82-b0e9-4c32-abd1-c6237e1e6367 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] [instance: 1f9c8547-e0cb-4094-a15e-d21166bda1d2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:00.948603 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a4c0b82-b0e9-4c32-abd1-c6237e1e6367 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:00.949034 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a4c0b82-b0e9-4c32-abd1-c6237e1e6367 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:00.949519 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a4c0b82-b0e9-4c32-abd1-c6237e1e6367 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:00.950562 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a4c0b82-b0e9-4c32-abd1-c6237e1e6367 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:00.951209 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a4c0b82-b0e9-4c32-abd1-c6237e1e6367 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:00.951643 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a4c0b82-b0e9-4c32-abd1-c6237e1e6367 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:01.131301 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6a4c0b82-b0e9-4c32-abd1-c6237e1e6367 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec278d8d7b4a5a96af042ba613bafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc4c8f707304cd98a5f2e13cb1d5a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:01.143261 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-54ac5eea-94a8-4fb9-80d2-4f81a26e1ce9 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:01.143945 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-54ac5eea-94a8-4fb9-80d2-4f81a26e1ce9 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 8046842c-80bc-4713-81cf-7fecbe58a130] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:01.148823 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6a4c0b82-b0e9-4c32-abd1-c6237e1e6367 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] 10.222.0.13 "GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2" status: 200 len: 1522 microversion: 2.1 time: 0.211870 Oct 30 01:31:01.149431 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1973/3947] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:00 2022] GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:01.150674 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-54ac5eea-94a8-4fb9-80d2-4f81a26e1ce9 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:01.151765 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-54ac5eea-94a8-4fb9-80d2-4f81a26e1ce9 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:01.152213 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-54ac5eea-94a8-4fb9-80d2-4f81a26e1ce9 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:01.152921 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-54ac5eea-94a8-4fb9-80d2-4f81a26e1ce9 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:01.153413 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-54ac5eea-94a8-4fb9-80d2-4f81a26e1ce9 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:01.153845 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-54ac5eea-94a8-4fb9-80d2-4f81a26e1ce9 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:01.201275 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-d5378e8f-3d78-4a2f-9a30-575ce8574c7f req-8344d62c-3e70-4b87-8ae0-81708979af1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9368bd4-9715-46b3-91bb-cb436f7120f3", "name": "network-vif-plugged", "status": "completed", "tag": "2115d9c7-78b5-463e-b9d2-39310d4c1aa2"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:31:01.213458 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-d5378e8f-3d78-4a2f-9a30-575ce8574c7f req-8344d62c-3e70-4b87-8ae0-81708979af1e service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:01.214263 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-d5378e8f-3d78-4a2f-9a30-575ce8574c7f req-8344d62c-3e70-4b87-8ae0-81708979af1e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:01.214931 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-d5378e8f-3d78-4a2f-9a30-575ce8574c7f req-8344d62c-3e70-4b87-8ae0-81708979af1e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:01.231539 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-d5378e8f-3d78-4a2f-9a30-575ce8574c7f req-8344d62c-3e70-4b87-8ae0-81708979af1e service nova] Creating event network-vif-plugged:2115d9c7-78b5-463e-b9d2-39310d4c1aa2 for instance e9368bd4-9715-46b3-91bb-cb436f7120f3 on n-h1-master-1 Oct 30 01:31:01.238682 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-d5378e8f-3d78-4a2f-9a30-575ce8574c7f req-8344d62c-3e70-4b87-8ae0-81708979af1e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041278 Oct 30 01:31:01.240150 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1974/3948] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:31:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:31:01.248005 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7314584a-5110-4cab-9aa8-1f525953df3f tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44d04a9af0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:01.304946 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7314584a-5110-4cab-9aa8-1f525953df3f tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/0771e672-b021-4747-b3e1-a12f87a748f5" status: 200 len: 1452 microversion: 2.1 time: 0.055001 Oct 30 01:31:01.304946 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1975/3949] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:31:01 2022] GET /compute/v2.1/images/0771e672-b021-4747-b3e1-a12f87a748f5 => generated 1452 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:01.416195 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-54ac5eea-94a8-4fb9-80d2-4f81a26e1ce9 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:01.427600 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-54ac5eea-94a8-4fb9-80d2-4f81a26e1ce9 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/8046842c-80bc-4713-81cf-7fecbe58a130" status: 200 len: 1308 microversion: 2.1 time: 0.288358 Oct 30 01:31:01.429602 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1975/3950] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:01 2022] GET /compute/v2.1/servers/8046842c-80bc-4713-81cf-7fecbe58a130 => generated 1308 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:31:01.849742 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7bb97f13-df38-4228-b9be-fb32b7a199fa tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:01.850496 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7bb97f13-df38-4228-b9be-fb32b7a199fa tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] [instance: 0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:01.856953 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7bb97f13-df38-4228-b9be-fb32b7a199fa tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:01.857471 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7bb97f13-df38-4228-b9be-fb32b7a199fa tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:01.857907 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7bb97f13-df38-4228-b9be-fb32b7a199fa tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:01.858611 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7bb97f13-df38-4228-b9be-fb32b7a199fa tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:01.859665 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7bb97f13-df38-4228-b9be-fb32b7a199fa tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:01.860351 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7bb97f13-df38-4228-b9be-fb32b7a199fa tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:02.070330 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7bb97f13-df38-4228-b9be-fb32b7a199fa tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11293effe45345aeac9fd7dd672b738b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c145959fe44ed1bec7c4c964be8d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:02.079968 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7bb97f13-df38-4228-b9be-fb32b7a199fa tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] 10.222.0.13 "GET /compute/v2.1/servers/0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0" status: 200 len: 1527 microversion: 2.1 time: 0.236186 Oct 30 01:31:02.080657 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1976/3951] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:01 2022] GET /compute/v2.1/servers/0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0 => generated 1527 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:31:02.173729 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-58099f56-543b-4330-9e95-3672ab8d8921 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:02.174137 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-58099f56-543b-4330-9e95-3672ab8d8921 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] [instance: 1f9c8547-e0cb-4094-a15e-d21166bda1d2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:02.191417 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58099f56-543b-4330-9e95-3672ab8d8921 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:02.202497 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58099f56-543b-4330-9e95-3672ab8d8921 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:02.203137 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58099f56-543b-4330-9e95-3672ab8d8921 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:02.203888 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58099f56-543b-4330-9e95-3672ab8d8921 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:02.204357 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58099f56-543b-4330-9e95-3672ab8d8921 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:02.205010 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58099f56-543b-4330-9e95-3672ab8d8921 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:02.300296 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-1a772153-82a2-479f-bf8b-ef8e5e6da34a req-7471661a-1173-40c0-acdc-142fe67d0c54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0", "name": "network-vif-deleted", "tag": "8ec21be8-7bf5-49f0-aa4e-be1ae9feb015"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:31:02.329326 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-1a772153-82a2-479f-bf8b-ef8e5e6da34a req-7471661a-1173-40c0-acdc-142fe67d0c54 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:02.329855 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-1a772153-82a2-479f-bf8b-ef8e5e6da34a req-7471661a-1173-40c0-acdc-142fe67d0c54 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:02.335932 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-1a772153-82a2-479f-bf8b-ef8e5e6da34a req-7471661a-1173-40c0-acdc-142fe67d0c54 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:02.374168 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-1a772153-82a2-479f-bf8b-ef8e5e6da34a req-7471661a-1173-40c0-acdc-142fe67d0c54 service nova] Creating event network-vif-deleted:8ec21be8-7bf5-49f0-aa4e-be1ae9feb015 for instance 0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0 on n-h1-master-1 Oct 30 01:31:02.379812 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:31:02.385569 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-1a772153-82a2-479f-bf8b-ef8e5e6da34a req-7471661a-1173-40c0-acdc-142fe67d0c54 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090292 Oct 30 01:31:02.387193 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1977/3952] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:31:02.392948 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-db06170a-d640-4d24-ad18-5c93e73e1509 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44d04cf940>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:02.465773 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-db06170a-d640-4d24-ad18-5c93e73e1509 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/0771e672-b021-4747-b3e1-a12f87a748f5" status: 200 len: 1452 microversion: 2.1 time: 0.077227 Oct 30 01:31:02.466663 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1978/3953] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:31:02 2022] GET /compute/v2.1/images/0771e672-b021-4747-b3e1-a12f87a748f5 => generated 1452 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:02.473513 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-58099f56-543b-4330-9e95-3672ab8d8921 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec278d8d7b4a5a96af042ba613bafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc4c8f707304cd98a5f2e13cb1d5a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:02.479087 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6e514d0a-4c24-484e-b1cd-c0c0fdf78316 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:02.479390 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6e514d0a-4c24-484e-b1cd-c0c0fdf78316 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 8046842c-80bc-4713-81cf-7fecbe58a130] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:02.485543 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-58099f56-543b-4330-9e95-3672ab8d8921 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] 10.222.0.13 "GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2" status: 200 len: 1522 microversion: 2.1 time: 0.316613 Oct 30 01:31:02.486620 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1976/3954] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:02 2022] GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2 => generated 1522 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:02.490006 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e514d0a-4c24-484e-b1cd-c0c0fdf78316 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:02.490495 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e514d0a-4c24-484e-b1cd-c0c0fdf78316 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:02.490933 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e514d0a-4c24-484e-b1cd-c0c0fdf78316 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:02.491717 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e514d0a-4c24-484e-b1cd-c0c0fdf78316 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:02.492106 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e514d0a-4c24-484e-b1cd-c0c0fdf78316 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:02.493232 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e514d0a-4c24-484e-b1cd-c0c0fdf78316 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:02.840395 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6e514d0a-4c24-484e-b1cd-c0c0fdf78316 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:02.848747 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6e514d0a-4c24-484e-b1cd-c0c0fdf78316 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/8046842c-80bc-4713-81cf-7fecbe58a130" status: 200 len: 1308 microversion: 2.1 time: 0.381057 Oct 30 01:31:02.884851 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1979/3955] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:02 2022] GET /compute/v2.1/servers/8046842c-80bc-4713-81cf-7fecbe58a130 => generated 1308 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:03.107869 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-959887d1-88ee-4a24-a861-ca42c0be33c8 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:03.108539 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-959887d1-88ee-4a24-a861-ca42c0be33c8 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] [instance: 0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:03.115707 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=8 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:31:03.118015 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-959887d1-88ee-4a24-a861-ca42c0be33c8 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:03.119148 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-959887d1-88ee-4a24-a861-ca42c0be33c8 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:03.119589 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-959887d1-88ee-4a24-a861-ca42c0be33c8 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:03.120976 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-959887d1-88ee-4a24-a861-ca42c0be33c8 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:03.122291 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-959887d1-88ee-4a24-a861-ca42c0be33c8 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:03.123493 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-959887d1-88ee-4a24-a861-ca42c0be33c8 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:03.162746 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-959887d1-88ee-4a24-a861-ca42c0be33c8 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:03.163520 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-959887d1-88ee-4a24-a861-ca42c0be33c8 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:03.164850 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-959887d1-88ee-4a24-a861-ca42c0be33c8 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:03.165603 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-959887d1-88ee-4a24-a861-ca42c0be33c8 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lazy-loading 'fault' on Instance uuid 0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:31:03.221457 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-959887d1-88ee-4a24-a861-ca42c0be33c8 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11293effe45345aeac9fd7dd672b738b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c145959fe44ed1bec7c4c964be8d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:03.234687 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-959887d1-88ee-4a24-a861-ca42c0be33c8 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] 10.222.0.13 "GET /compute/v2.1/servers/0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0" status: 200 len: 1314 microversion: 2.1 time: 0.132293 Oct 30 01:31:03.255128 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1977/3956] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:03 2022] GET /compute/v2.1/servers/0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:03.483487 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bee690fb-9844-43c3-88e2-fe83dfcde65d tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44c7eae040>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:03.514592 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bd9e277c-cc82-46f7-9f0e-13eb5ead7a6f tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:03.516118 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-bd9e277c-cc82-46f7-9f0e-13eb5ead7a6f tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] [instance: 1f9c8547-e0cb-4094-a15e-d21166bda1d2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:03.536965 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd9e277c-cc82-46f7-9f0e-13eb5ead7a6f tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:03.539867 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd9e277c-cc82-46f7-9f0e-13eb5ead7a6f tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:03.542294 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd9e277c-cc82-46f7-9f0e-13eb5ead7a6f tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:03.543256 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd9e277c-cc82-46f7-9f0e-13eb5ead7a6f tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:03.543898 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd9e277c-cc82-46f7-9f0e-13eb5ead7a6f tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:03.545144 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd9e277c-cc82-46f7-9f0e-13eb5ead7a6f tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:03.570786 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bee690fb-9844-43c3-88e2-fe83dfcde65d tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/0771e672-b021-4747-b3e1-a12f87a748f5" status: 200 len: 1452 microversion: 2.1 time: 0.092881 Oct 30 01:31:03.571727 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1980/3957] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:31:03 2022] GET /compute/v2.1/images/0771e672-b021-4747-b3e1-a12f87a748f5 => generated 1452 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:03.788056 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d0f63c47-51ec-49c0-b4c0-34b4cc3dfcc0 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f877f8e1-3943-46b6-9fb6-ac5f4e95cf67"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:31:03.794398 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d0f63c47-51ec-49c0-b4c0-34b4cc3dfcc0 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:03.809795 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d0f63c47-51ec-49c0-b4c0-34b4cc3dfcc0 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:03.810888 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d0f63c47-51ec-49c0-b4c0-34b4cc3dfcc0 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:03.829435 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d0f63c47-51ec-49c0-b4c0-34b4cc3dfcc0 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:03.831248 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d0f63c47-51ec-49c0-b4c0-34b4cc3dfcc0 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:03.834911 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d0f63c47-51ec-49c0-b4c0-34b4cc3dfcc0 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:03.837053 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d0f63c47-51ec-49c0-b4c0-34b4cc3dfcc0 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:03.844124 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-bd9e277c-cc82-46f7-9f0e-13eb5ead7a6f tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec278d8d7b4a5a96af042ba613bafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc4c8f707304cd98a5f2e13cb1d5a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:03.885521 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bd9e277c-cc82-46f7-9f0e-13eb5ead7a6f tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] 10.222.0.13 "GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2" status: 200 len: 1522 microversion: 2.1 time: 0.376841 Oct 30 01:31:03.892205 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1978/3958] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:03 2022] GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2 => generated 1522 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:31:03.906721 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ce7cf79a-dc2a-438f-99ab-e40513816d6f tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:03.908351 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ce7cf79a-dc2a-438f-99ab-e40513816d6f tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 8046842c-80bc-4713-81cf-7fecbe58a130] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:03.922229 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ce7cf79a-dc2a-438f-99ab-e40513816d6f tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:03.922727 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ce7cf79a-dc2a-438f-99ab-e40513816d6f tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:03.923196 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ce7cf79a-dc2a-438f-99ab-e40513816d6f tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:03.923942 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ce7cf79a-dc2a-438f-99ab-e40513816d6f tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:03.924398 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ce7cf79a-dc2a-438f-99ab-e40513816d6f tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:03.924886 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ce7cf79a-dc2a-438f-99ab-e40513816d6f tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:04.206739 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ce7cf79a-dc2a-438f-99ab-e40513816d6f tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:04.217294 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ce7cf79a-dc2a-438f-99ab-e40513816d6f tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/8046842c-80bc-4713-81cf-7fecbe58a130" status: 200 len: 1308 microversion: 2.1 time: 0.323222 Oct 30 01:31:04.218277 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1979/3959] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:03 2022] GET /compute/v2.1/servers/8046842c-80bc-4713-81cf-7fecbe58a130 => generated 1308 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:04.268162 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-47fbbd62-09b8-44b3-810b-09fbf277f8d8 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:04.270753 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-47fbbd62-09b8-44b3-810b-09fbf277f8d8 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] [instance: 0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:04.282052 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-47fbbd62-09b8-44b3-810b-09fbf277f8d8 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:04.283437 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-47fbbd62-09b8-44b3-810b-09fbf277f8d8 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:04.284262 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-47fbbd62-09b8-44b3-810b-09fbf277f8d8 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:04.286107 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-47fbbd62-09b8-44b3-810b-09fbf277f8d8 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:04.286874 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-47fbbd62-09b8-44b3-810b-09fbf277f8d8 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:04.290136 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-47fbbd62-09b8-44b3-810b-09fbf277f8d8 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:04.314923 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-47fbbd62-09b8-44b3-810b-09fbf277f8d8 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] HTTP exception thrown: Instance 0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0 could not be found. Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-47fbbd62-09b8-44b3-810b-09fbf277f8d8 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Request method failure captured: Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0 HTTP/1.1 Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdO5LO39nVKA_j4PiywrrfPtuGsPwZuQs_RO_d1dhCuyFcYpibcySMJxFXjmH7GlyZoXYXgMFl_DNz4Yy9uEUOSF3jsOdVayIzFto7t4wNwhcV4lOL5zuhUIXQP3aRAJMcOMzdeZWXTs_ZzukVyT19XpHWwybPQUSnf49uEHu8TnX5s Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 93c145959fe44ed1bec7c4c964be8d2e Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-713194133 Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/93c145959fe44ed1bec7c4c964be8d2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_93c145959fe44ed1bec7c4c964be8d2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/93c145959fe44ed1bec7c4c964be8d2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/93c145959fe44ed1bec7c4c964be8d2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-713194133 Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 93c145959fe44ed1bec7c4c964be8d2e Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-713194133 Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServerAddressesNegativeTestJSON-713194133-project Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 11293effe45345aeac9fd7dd672b738b Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-713194133-project Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0 could not be found. Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0'} Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0 could not be found. Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0 could not be found. Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:31:04.319861 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:31:04.324690 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:31:04.324690 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:31:04.324690 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:31:04.324690 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:31:04.324690 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:31:04.324690 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:31:04.324690 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0 could not be found. Oct 30 01:31:04.324690 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:31:04.327329 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-47fbbd62-09b8-44b3-810b-09fbf277f8d8 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] Returning 404 to user: Instance 0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:31:04.328220 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-47fbbd62-09b8-44b3-810b-09fbf277f8d8 tempest-ServerAddressesNegativeTestJSON-713194133 tempest-ServerAddressesNegativeTestJSON-713194133-project] 10.222.0.13 "GET /compute/v2.1/servers/0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0" status: 404 len: 111 microversion: 2.1 time: 0.069163 Oct 30 01:31:04.328804 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1980/3960] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:04 2022] GET /compute/v2.1/servers/0c4bd5f1-a5c8-4418-bdea-6c2b4f981db0 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:31:04.589832 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4b21a8e2-5a2d-4624-8137-da588829a128 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44c7d38af0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:04.652044 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4b21a8e2-5a2d-4624-8137-da588829a128 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/0771e672-b021-4747-b3e1-a12f87a748f5" status: 200 len: 1452 microversion: 2.1 time: 0.067771 Oct 30 01:31:04.653294 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1981/3961] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:31:04 2022] GET /compute/v2.1/images/0771e672-b021-4747-b3e1-a12f87a748f5 => generated 1452 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:31:04.912303 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-255d01e9-6f15-406a-aede-fb6d720add76 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:04.912903 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d0f63c47-51ec-49c0-b4c0-34b4cc3dfcc0 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "POST /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.133606 Oct 30 01:31:04.913469 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-255d01e9-6f15-406a-aede-fb6d720add76 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] [instance: 1f9c8547-e0cb-4094-a15e-d21166bda1d2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:04.932575 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1981/3962] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 30 01:31:03 2022] POST /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0/os-volume_attachments => generated 194 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:31:04.941908 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-255d01e9-6f15-406a-aede-fb6d720add76 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:04.942432 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-255d01e9-6f15-406a-aede-fb6d720add76 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:04.945691 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-255d01e9-6f15-406a-aede-fb6d720add76 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:04.954111 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-255d01e9-6f15-406a-aede-fb6d720add76 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:04.954615 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-255d01e9-6f15-406a-aede-fb6d720add76 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:04.955063 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-255d01e9-6f15-406a-aede-fb6d720add76 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:05.116351 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-255d01e9-6f15-406a-aede-fb6d720add76 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec278d8d7b4a5a96af042ba613bafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc4c8f707304cd98a5f2e13cb1d5a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:05.129305 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-255d01e9-6f15-406a-aede-fb6d720add76 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] 10.222.0.13 "GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2" status: 200 len: 1522 microversion: 2.1 time: 0.220940 Oct 30 01:31:05.129921 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1982/3963] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:04 2022] GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2 => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:31:05.257894 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e3b829bf-6e37-49d0-b831-2b8bf00afaaa tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:05.268132 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e3b829bf-6e37-49d0-b831-2b8bf00afaaa tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 8046842c-80bc-4713-81cf-7fecbe58a130] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:05.287637 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e3b829bf-6e37-49d0-b831-2b8bf00afaaa tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:05.288145 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e3b829bf-6e37-49d0-b831-2b8bf00afaaa tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:05.288652 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e3b829bf-6e37-49d0-b831-2b8bf00afaaa tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:05.290261 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e3b829bf-6e37-49d0-b831-2b8bf00afaaa tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:05.290918 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e3b829bf-6e37-49d0-b831-2b8bf00afaaa tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:05.291362 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e3b829bf-6e37-49d0-b831-2b8bf00afaaa tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:05.766008 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e3b829bf-6e37-49d0-b831-2b8bf00afaaa tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:05.766008 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e3b829bf-6e37-49d0-b831-2b8bf00afaaa tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/8046842c-80bc-4713-81cf-7fecbe58a130" status: 200 len: 1308 microversion: 2.1 time: 0.353540 Oct 30 01:31:05.766008 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1982/3964] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:05 2022] GET /compute/v2.1/servers/8046842c-80bc-4713-81cf-7fecbe58a130 => generated 1308 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:05.767912 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5d9b91c4-3347-47aa-a625-ce981b540521 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44c7c78af0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:05.767912 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5d9b91c4-3347-47aa-a625-ce981b540521 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/0771e672-b021-4747-b3e1-a12f87a748f5" status: 200 len: 1452 microversion: 2.1 time: 0.054187 Oct 30 01:31:05.767912 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1983/3965] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:31:05 2022] GET /compute/v2.1/images/0771e672-b021-4747-b3e1-a12f87a748f5 => generated 1452 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:06.154951 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2da54751-0cfc-4f63-8180-2e45310834eb tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:06.155579 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2da54751-0cfc-4f63-8180-2e45310834eb tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] [instance: 1f9c8547-e0cb-4094-a15e-d21166bda1d2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:06.162654 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2da54751-0cfc-4f63-8180-2e45310834eb tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:06.163250 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2da54751-0cfc-4f63-8180-2e45310834eb tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:06.163577 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2da54751-0cfc-4f63-8180-2e45310834eb tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:06.164791 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2da54751-0cfc-4f63-8180-2e45310834eb tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:06.165270 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2da54751-0cfc-4f63-8180-2e45310834eb tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:06.165731 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2da54751-0cfc-4f63-8180-2e45310834eb tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:06.454136 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-d3a1c855-2fcd-4a1b-8784-fae2ad6d7cd9 req-d38e07cb-563e-4d1e-921f-2aa27c67e34e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8046842c-80bc-4713-81cf-7fecbe58a130", "name": "network-vif-plugged", "status": "completed", "tag": "05f0777c-9301-4b65-a625-b42d9248035f"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:31:06.490590 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d3a1c855-2fcd-4a1b-8784-fae2ad6d7cd9 req-d38e07cb-563e-4d1e-921f-2aa27c67e34e service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:06.493175 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d3a1c855-2fcd-4a1b-8784-fae2ad6d7cd9 req-d38e07cb-563e-4d1e-921f-2aa27c67e34e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:06.494217 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d3a1c855-2fcd-4a1b-8784-fae2ad6d7cd9 req-d38e07cb-563e-4d1e-921f-2aa27c67e34e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:06.522381 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-d3a1c855-2fcd-4a1b-8784-fae2ad6d7cd9 req-d38e07cb-563e-4d1e-921f-2aa27c67e34e service nova] Creating event network-vif-plugged:05f0777c-9301-4b65-a625-b42d9248035f for instance 8046842c-80bc-4713-81cf-7fecbe58a130 on n-h2-master-1 Oct 30 01:31:06.545823 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-d3a1c855-2fcd-4a1b-8784-fae2ad6d7cd9 req-d38e07cb-563e-4d1e-921f-2aa27c67e34e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088990 Oct 30 01:31:06.552419 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1984/3966] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:31:06.621783 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b5af7a13-8144-4c27-b2d6-f177f4d2b16a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:06.625638 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b5af7a13-8144-4c27-b2d6-f177f4d2b16a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 8046842c-80bc-4713-81cf-7fecbe58a130] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:06.655148 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b5af7a13-8144-4c27-b2d6-f177f4d2b16a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:06.662609 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b5af7a13-8144-4c27-b2d6-f177f4d2b16a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:06.663063 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b5af7a13-8144-4c27-b2d6-f177f4d2b16a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:06.664534 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b5af7a13-8144-4c27-b2d6-f177f4d2b16a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:06.664996 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b5af7a13-8144-4c27-b2d6-f177f4d2b16a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:06.669576 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b5af7a13-8144-4c27-b2d6-f177f4d2b16a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:07.130553 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2da54751-0cfc-4f63-8180-2e45310834eb tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec278d8d7b4a5a96af042ba613bafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc4c8f707304cd98a5f2e13cb1d5a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:07.164371 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2da54751-0cfc-4f63-8180-2e45310834eb tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] 10.222.0.13 "GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2" status: 200 len: 1522 microversion: 2.1 time: 1.013792 Oct 30 01:31:07.167365 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1983/3967] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:06 2022] GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2 => generated 1522 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:07.184372 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0e91d2a1-11cb-4425-921f-4bec096ef80e tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44ccaa8f70>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:07.277479 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0e91d2a1-11cb-4425-921f-4bec096ef80e tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/0771e672-b021-4747-b3e1-a12f87a748f5" status: 200 len: 1452 microversion: 2.1 time: 0.105751 Oct 30 01:31:07.278222 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1984/3968] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:31:07 2022] GET /compute/v2.1/images/0771e672-b021-4747-b3e1-a12f87a748f5 => generated 1452 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:07.638295 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b5af7a13-8144-4c27-b2d6-f177f4d2b16a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:07.656192 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b5af7a13-8144-4c27-b2d6-f177f4d2b16a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/8046842c-80bc-4713-81cf-7fecbe58a130" status: 200 len: 1308 microversion: 2.1 time: 1.042152 Oct 30 01:31:07.658664 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1985/3969] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:06 2022] GET /compute/v2.1/servers/8046842c-80bc-4713-81cf-7fecbe58a130 => generated 1308 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:08.195996 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7b6c0732-83c8-4350-ab74-11c245511d7f tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:08.197263 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7b6c0732-83c8-4350-ab74-11c245511d7f tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] [instance: 1f9c8547-e0cb-4094-a15e-d21166bda1d2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:08.222343 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b6c0732-83c8-4350-ab74-11c245511d7f tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:08.224921 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b6c0732-83c8-4350-ab74-11c245511d7f tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:08.227561 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b6c0732-83c8-4350-ab74-11c245511d7f tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:08.228611 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b6c0732-83c8-4350-ab74-11c245511d7f tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:08.231872 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b6c0732-83c8-4350-ab74-11c245511d7f tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:08.236271 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b6c0732-83c8-4350-ab74-11c245511d7f tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:08.293604 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f1900c87-2a1d-468f-aa0e-583d45cd23cf tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44c7be8ee0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:08.423220 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f1900c87-2a1d-468f-aa0e-583d45cd23cf tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/0771e672-b021-4747-b3e1-a12f87a748f5" status: 200 len: 1452 microversion: 2.1 time: 0.133660 Oct 30 01:31:08.425321 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1986/3970] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:31:08 2022] GET /compute/v2.1/images/0771e672-b021-4747-b3e1-a12f87a748f5 => generated 1452 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:08.685757 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-be3de762-b693-45f1-acc5-26a83cad694d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:08.686486 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-be3de762-b693-45f1-acc5-26a83cad694d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 8046842c-80bc-4713-81cf-7fecbe58a130] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:08.711556 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-be3de762-b693-45f1-acc5-26a83cad694d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:08.713502 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-be3de762-b693-45f1-acc5-26a83cad694d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:08.714001 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-be3de762-b693-45f1-acc5-26a83cad694d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:08.719183 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-be3de762-b693-45f1-acc5-26a83cad694d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:08.719698 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-be3de762-b693-45f1-acc5-26a83cad694d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:08.720153 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-be3de762-b693-45f1-acc5-26a83cad694d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:08.888836 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7b6c0732-83c8-4350-ab74-11c245511d7f tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec278d8d7b4a5a96af042ba613bafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc4c8f707304cd98a5f2e13cb1d5a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:08.903863 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7b6c0732-83c8-4350-ab74-11c245511d7f tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] 10.222.0.13 "GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2" status: 200 len: 1522 microversion: 2.1 time: 0.713426 Oct 30 01:31:08.906401 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1985/3971] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:08 2022] GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2 => generated 1522 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:09.142203 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-be3de762-b693-45f1-acc5-26a83cad694d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:09.157600 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-be3de762-b693-45f1-acc5-26a83cad694d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/8046842c-80bc-4713-81cf-7fecbe58a130" status: 200 len: 1308 microversion: 2.1 time: 0.476439 Oct 30 01:31:09.173383 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1987/3972] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:08 2022] GET /compute/v2.1/servers/8046842c-80bc-4713-81cf-7fecbe58a130 => generated 1308 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:09.440034 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6cafbf44-72c5-4cd2-8348-8bbf7620beec tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44cc578c10>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:09.506569 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6cafbf44-72c5-4cd2-8348-8bbf7620beec tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/0771e672-b021-4747-b3e1-a12f87a748f5" status: 200 len: 1452 microversion: 2.1 time: 0.070297 Oct 30 01:31:09.508410 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1986/3973] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:31:09 2022] GET /compute/v2.1/images/0771e672-b021-4747-b3e1-a12f87a748f5 => generated 1452 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:09.933075 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9bd5de90-cc23-49f1-8698-150c354cc3d9 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:09.938556 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9bd5de90-cc23-49f1-8698-150c354cc3d9 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] [instance: 1f9c8547-e0cb-4094-a15e-d21166bda1d2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:09.961927 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9bd5de90-cc23-49f1-8698-150c354cc3d9 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:09.965317 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9bd5de90-cc23-49f1-8698-150c354cc3d9 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:09.966909 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9bd5de90-cc23-49f1-8698-150c354cc3d9 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:09.968675 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9bd5de90-cc23-49f1-8698-150c354cc3d9 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:09.970813 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9bd5de90-cc23-49f1-8698-150c354cc3d9 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:09.971526 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9bd5de90-cc23-49f1-8698-150c354cc3d9 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:10.180898 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-43af84eb-caa5-4394-a698-e6393a4a5346 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:10.181540 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-43af84eb-caa5-4394-a698-e6393a4a5346 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 8046842c-80bc-4713-81cf-7fecbe58a130] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:10.195953 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-43af84eb-caa5-4394-a698-e6393a4a5346 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:10.195953 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-43af84eb-caa5-4394-a698-e6393a4a5346 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:10.195953 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-43af84eb-caa5-4394-a698-e6393a4a5346 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:10.195953 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-43af84eb-caa5-4394-a698-e6393a4a5346 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:10.196523 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-43af84eb-caa5-4394-a698-e6393a4a5346 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:10.196523 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-43af84eb-caa5-4394-a698-e6393a4a5346 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:10.507599 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9bd5de90-cc23-49f1-8698-150c354cc3d9 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec278d8d7b4a5a96af042ba613bafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc4c8f707304cd98a5f2e13cb1d5a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:10.521059 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9bd5de90-cc23-49f1-8698-150c354cc3d9 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] 10.222.0.13 "GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2" status: 200 len: 1522 microversion: 2.1 time: 0.589103 Oct 30 01:31:10.523454 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1988/3974] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:09 2022] GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2 => generated 1522 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:10.529969 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-462ac9fa-54d0-4aee-a21a-e71aeb89ffdd tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44c7c1bca0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:10.592604 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-462ac9fa-54d0-4aee-a21a-e71aeb89ffdd tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/0771e672-b021-4747-b3e1-a12f87a748f5" status: 200 len: 1452 microversion: 2.1 time: 0.067255 Oct 30 01:31:10.602617 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1989/3975] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:31:10 2022] GET /compute/v2.1/images/0771e672-b021-4747-b3e1-a12f87a748f5 => generated 1452 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:10.931921 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-43af84eb-caa5-4394-a698-e6393a4a5346 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:10.941401 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-43af84eb-caa5-4394-a698-e6393a4a5346 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/8046842c-80bc-4713-81cf-7fecbe58a130" status: 200 len: 1489 microversion: 2.1 time: 0.765080 Oct 30 01:31:10.946498 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1987/3976] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:10 2022] GET /compute/v2.1/servers/8046842c-80bc-4713-81cf-7fecbe58a130 => generated 1489 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:10.972335 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c1d51347-e065-4506-b3fc-43401d7f2e68 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:10.973665 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c1d51347-e065-4506-b3fc-43401d7f2e68 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 98262d96-9a63-4531-9001-3fd0efd22014] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:10.982546 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c1d51347-e065-4506-b3fc-43401d7f2e68 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:10.983236 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c1d51347-e065-4506-b3fc-43401d7f2e68 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:10.983897 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c1d51347-e065-4506-b3fc-43401d7f2e68 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:10.984807 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c1d51347-e065-4506-b3fc-43401d7f2e68 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:10.985691 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c1d51347-e065-4506-b3fc-43401d7f2e68 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:10.987288 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c1d51347-e065-4506-b3fc-43401d7f2e68 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:11.477138 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c1d51347-e065-4506-b3fc-43401d7f2e68 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:11.488625 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c1d51347-e065-4506-b3fc-43401d7f2e68 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/98262d96-9a63-4531-9001-3fd0efd22014" status: 200 len: 1490 microversion: 2.1 time: 0.523385 Oct 30 01:31:11.502533 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1990/3977] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:10 2022] GET /compute/v2.1/servers/98262d96-9a63-4531-9001-3fd0efd22014 => generated 1490 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:31:11.513905 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d6877dda-812e-4ad6-bc9f-4765f9cd8a41 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:11.514901 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d6877dda-812e-4ad6-bc9f-4765f9cd8a41 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 8046842c-80bc-4713-81cf-7fecbe58a130] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:11.519296 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:31:11.527234 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d6877dda-812e-4ad6-bc9f-4765f9cd8a41 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:11.527234 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d6877dda-812e-4ad6-bc9f-4765f9cd8a41 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:11.527234 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d6877dda-812e-4ad6-bc9f-4765f9cd8a41 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:11.527234 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d6877dda-812e-4ad6-bc9f-4765f9cd8a41 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:11.527634 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d6877dda-812e-4ad6-bc9f-4765f9cd8a41 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:11.528171 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d6877dda-812e-4ad6-bc9f-4765f9cd8a41 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:11.554783 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-004eec27-3968-42b6-a12c-74929f7d4d65 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:11.555560 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-004eec27-3968-42b6-a12c-74929f7d4d65 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] [instance: 1f9c8547-e0cb-4094-a15e-d21166bda1d2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:11.564488 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-004eec27-3968-42b6-a12c-74929f7d4d65 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:11.567896 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-004eec27-3968-42b6-a12c-74929f7d4d65 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:11.568460 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-004eec27-3968-42b6-a12c-74929f7d4d65 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:11.572437 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-004eec27-3968-42b6-a12c-74929f7d4d65 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:11.573093 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-004eec27-3968-42b6-a12c-74929f7d4d65 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:11.573671 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-004eec27-3968-42b6-a12c-74929f7d4d65 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:11.855855 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d6877dda-812e-4ad6-bc9f-4765f9cd8a41 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:11.870109 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-004eec27-3968-42b6-a12c-74929f7d4d65 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec278d8d7b4a5a96af042ba613bafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc4c8f707304cd98a5f2e13cb1d5a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:11.875878 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d6877dda-812e-4ad6-bc9f-4765f9cd8a41 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/8046842c-80bc-4713-81cf-7fecbe58a130" status: 200 len: 1489 microversion: 2.1 time: 0.362067 Oct 30 01:31:11.877434 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1988/3978] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:11 2022] GET /compute/v2.1/servers/8046842c-80bc-4713-81cf-7fecbe58a130 => generated 1489 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:11.893630 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-58ca80f9-5d22-4d19-96a5-8060e0d6405b tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44cc6f3dc0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:11.927508 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-004eec27-3968-42b6-a12c-74929f7d4d65 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] 10.222.0.13 "GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2" status: 200 len: 1522 microversion: 2.1 time: 0.376964 Oct 30 01:31:11.941253 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1991/3979] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:11 2022] GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2 => generated 1522 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:11.950758 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-beac27ea-8e7a-44a3-aea4-2f2b32f99d20 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:11.951403 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-beac27ea-8e7a-44a3-aea4-2f2b32f99d20 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 8046842c-80bc-4713-81cf-7fecbe58a130] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:11.968995 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-beac27ea-8e7a-44a3-aea4-2f2b32f99d20 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:11.969532 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-beac27ea-8e7a-44a3-aea4-2f2b32f99d20 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:11.969972 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-beac27ea-8e7a-44a3-aea4-2f2b32f99d20 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:11.970686 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-beac27ea-8e7a-44a3-aea4-2f2b32f99d20 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:11.972262 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-beac27ea-8e7a-44a3-aea4-2f2b32f99d20 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:11.975547 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-beac27ea-8e7a-44a3-aea4-2f2b32f99d20 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:12.022214 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-beac27ea-8e7a-44a3-aea4-2f2b32f99d20 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 8046842c-80bc-4713-81cf-7fecbe58a130] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:31:12.025838 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:31:12.026902 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-58ca80f9-5d22-4d19-96a5-8060e0d6405b tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/0771e672-b021-4747-b3e1-a12f87a748f5" status: 200 len: 1452 microversion: 2.1 time: 0.148041 Oct 30 01:31:12.027718 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1989/3980] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:31:11 2022] GET /compute/v2.1/images/0771e672-b021-4747-b3e1-a12f87a748f5 => generated 1452 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:12.434952 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-beac27ea-8e7a-44a3-aea4-2f2b32f99d20 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8046842c-80bc-4713-81cf-7fecbe58a130" status: 204 len: 0 microversion: 2.1 time: 0.492376 Oct 30 01:31:12.436570 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1992/3981] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:31:11 2022] DELETE /compute/v2.1/servers/8046842c-80bc-4713-81cf-7fecbe58a130 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:31:12.444944 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f2261841-7cd5-4d68-8857-4023285f3fb2 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:12.446166 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f2261841-7cd5-4d68-8857-4023285f3fb2 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 8046842c-80bc-4713-81cf-7fecbe58a130] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:12.453575 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f2261841-7cd5-4d68-8857-4023285f3fb2 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:12.454349 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f2261841-7cd5-4d68-8857-4023285f3fb2 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:12.454993 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f2261841-7cd5-4d68-8857-4023285f3fb2 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:12.455943 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f2261841-7cd5-4d68-8857-4023285f3fb2 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:12.456634 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f2261841-7cd5-4d68-8857-4023285f3fb2 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:12.457310 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f2261841-7cd5-4d68-8857-4023285f3fb2 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:12.479109 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:31:12.827621 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f2261841-7cd5-4d68-8857-4023285f3fb2 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:12.841828 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f2261841-7cd5-4d68-8857-4023285f3fb2 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/8046842c-80bc-4713-81cf-7fecbe58a130" status: 200 len: 1495 microversion: 2.1 time: 0.401215 Oct 30 01:31:12.843278 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1990/3982] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:12 2022] GET /compute/v2.1/servers/8046842c-80bc-4713-81cf-7fecbe58a130 => generated 1495 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:12.955511 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-03b89109-f120-4277-8d77-b6fa1a2fbf57 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:12.955797 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-03b89109-f120-4277-8d77-b6fa1a2fbf57 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] [instance: 1f9c8547-e0cb-4094-a15e-d21166bda1d2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:12.968663 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-03b89109-f120-4277-8d77-b6fa1a2fbf57 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:12.970742 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-03b89109-f120-4277-8d77-b6fa1a2fbf57 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:12.971911 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-03b89109-f120-4277-8d77-b6fa1a2fbf57 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:12.975236 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-03b89109-f120-4277-8d77-b6fa1a2fbf57 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:12.978040 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-03b89109-f120-4277-8d77-b6fa1a2fbf57 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:12.978647 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-03b89109-f120-4277-8d77-b6fa1a2fbf57 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:13.042917 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fb18afde-4410-4ebe-8397-9efb15eb98f9 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44cc6f3e50>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:13.160730 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fb18afde-4410-4ebe-8397-9efb15eb98f9 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/0771e672-b021-4747-b3e1-a12f87a748f5" status: 200 len: 1452 microversion: 2.1 time: 0.121686 Oct 30 01:31:13.171983 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1991/3983] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:31:13 2022] GET /compute/v2.1/images/0771e672-b021-4747-b3e1-a12f87a748f5 => generated 1452 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:13.360744 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-03b89109-f120-4277-8d77-b6fa1a2fbf57 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec278d8d7b4a5a96af042ba613bafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc4c8f707304cd98a5f2e13cb1d5a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:13.369044 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-03b89109-f120-4277-8d77-b6fa1a2fbf57 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] 10.222.0.13 "GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2" status: 200 len: 1522 microversion: 2.1 time: 0.418182 Oct 30 01:31:13.369659 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1993/3984] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:12 2022] GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2 => generated 1522 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:13.871081 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a0cc6ea3-493e-4a2c-b984-3c7db3a5e093 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:13.872090 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a0cc6ea3-493e-4a2c-b984-3c7db3a5e093 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 8046842c-80bc-4713-81cf-7fecbe58a130] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:13.889323 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a0cc6ea3-493e-4a2c-b984-3c7db3a5e093 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:13.890290 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a0cc6ea3-493e-4a2c-b984-3c7db3a5e093 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:13.901211 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a0cc6ea3-493e-4a2c-b984-3c7db3a5e093 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:13.903783 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a0cc6ea3-493e-4a2c-b984-3c7db3a5e093 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:13.904477 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a0cc6ea3-493e-4a2c-b984-3c7db3a5e093 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:13.905124 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a0cc6ea3-493e-4a2c-b984-3c7db3a5e093 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:14.182069 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4449f9b7-047f-4585-bc49-12aa2f16af23 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44d03a4b80>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:14.278279 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4449f9b7-047f-4585-bc49-12aa2f16af23 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/0771e672-b021-4747-b3e1-a12f87a748f5" status: 200 len: 1452 microversion: 2.1 time: 0.103523 Oct 30 01:31:14.279496 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1994/3985] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:31:14 2022] GET /compute/v2.1/images/0771e672-b021-4747-b3e1-a12f87a748f5 => generated 1452 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:14.394330 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-61bb4e79-9a13-45e9-a680-5181d9053418 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:14.396012 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-61bb4e79-9a13-45e9-a680-5181d9053418 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] [instance: 1f9c8547-e0cb-4094-a15e-d21166bda1d2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:14.400836 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:31:14.412369 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-61bb4e79-9a13-45e9-a680-5181d9053418 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:14.414651 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-61bb4e79-9a13-45e9-a680-5181d9053418 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:14.417178 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-61bb4e79-9a13-45e9-a680-5181d9053418 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:14.418120 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-61bb4e79-9a13-45e9-a680-5181d9053418 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:14.418599 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-61bb4e79-9a13-45e9-a680-5181d9053418 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:14.419491 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-61bb4e79-9a13-45e9-a680-5181d9053418 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:14.488401 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a0cc6ea3-493e-4a2c-b984-3c7db3a5e093 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:14.500284 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a0cc6ea3-493e-4a2c-b984-3c7db3a5e093 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/8046842c-80bc-4713-81cf-7fecbe58a130" status: 200 len: 1495 microversion: 2.1 time: 0.635741 Oct 30 01:31:14.501142 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1992/3986] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:13 2022] GET /compute/v2.1/servers/8046842c-80bc-4713-81cf-7fecbe58a130 => generated 1495 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:14.771148 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-61bb4e79-9a13-45e9-a680-5181d9053418 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec278d8d7b4a5a96af042ba613bafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc4c8f707304cd98a5f2e13cb1d5a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:14.781811 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-61bb4e79-9a13-45e9-a680-5181d9053418 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] 10.222.0.13 "GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2" status: 200 len: 1522 microversion: 2.1 time: 0.391745 Oct 30 01:31:14.792040 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1995/3987] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:14 2022] GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2 => generated 1522 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:31:15.294917 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-661199d0-4a07-4671-a8f3-ab5381a8fa13 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44d0523820>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:15.355498 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-661199d0-4a07-4671-a8f3-ab5381a8fa13 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/0771e672-b021-4747-b3e1-a12f87a748f5" status: 200 len: 1452 microversion: 2.1 time: 0.064328 Oct 30 01:31:15.356755 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1993/3988] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:31:15 2022] GET /compute/v2.1/images/0771e672-b021-4747-b3e1-a12f87a748f5 => generated 1452 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:15.525675 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-92696359-6819-4b08-92df-2b5c53efc202 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:15.527014 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-92696359-6819-4b08-92df-2b5c53efc202 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 8046842c-80bc-4713-81cf-7fecbe58a130] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:15.534930 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-92696359-6819-4b08-92df-2b5c53efc202 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:15.535630 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-92696359-6819-4b08-92df-2b5c53efc202 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:15.536249 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-92696359-6819-4b08-92df-2b5c53efc202 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:15.537006 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-92696359-6819-4b08-92df-2b5c53efc202 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:15.538019 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-92696359-6819-4b08-92df-2b5c53efc202 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:15.538606 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-92696359-6819-4b08-92df-2b5c53efc202 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:15.805992 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3d4be903-0bfb-4029-a89b-e2994418c39a tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:15.811252 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3d4be903-0bfb-4029-a89b-e2994418c39a tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] [instance: 1f9c8547-e0cb-4094-a15e-d21166bda1d2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:15.824959 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d4be903-0bfb-4029-a89b-e2994418c39a tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:15.825711 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d4be903-0bfb-4029-a89b-e2994418c39a tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:15.826342 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d4be903-0bfb-4029-a89b-e2994418c39a tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:15.827247 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d4be903-0bfb-4029-a89b-e2994418c39a tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:15.827862 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d4be903-0bfb-4029-a89b-e2994418c39a tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:15.828625 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d4be903-0bfb-4029-a89b-e2994418c39a tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:15.859752 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-92696359-6819-4b08-92df-2b5c53efc202 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:15.871375 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-92696359-6819-4b08-92df-2b5c53efc202 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/8046842c-80bc-4713-81cf-7fecbe58a130" status: 200 len: 1495 microversion: 2.1 time: 0.350305 Oct 30 01:31:15.875732 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1996/3989] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:15 2022] GET /compute/v2.1/servers/8046842c-80bc-4713-81cf-7fecbe58a130 => generated 1495 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:15.887474 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-6acb394d-5a8f-4041-b1e8-8ff523a95873 req-ba6514a7-d53e-4511-a071-413b6e6d1625 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8046842c-80bc-4713-81cf-7fecbe58a130", "name": "network-vif-deleted", "tag": "05f0777c-9301-4b65-a625-b42d9248035f"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:31:15.923860 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-6acb394d-5a8f-4041-b1e8-8ff523a95873 req-ba6514a7-d53e-4511-a071-413b6e6d1625 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:15.924444 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-6acb394d-5a8f-4041-b1e8-8ff523a95873 req-ba6514a7-d53e-4511-a071-413b6e6d1625 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:15.924945 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-6acb394d-5a8f-4041-b1e8-8ff523a95873 req-ba6514a7-d53e-4511-a071-413b6e6d1625 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:15.949105 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-6acb394d-5a8f-4041-b1e8-8ff523a95873 req-ba6514a7-d53e-4511-a071-413b6e6d1625 service nova] Creating event network-vif-deleted:05f0777c-9301-4b65-a625-b42d9248035f for instance 8046842c-80bc-4713-81cf-7fecbe58a130 on n-h2-master-1 Oct 30 01:31:15.964754 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-6acb394d-5a8f-4041-b1e8-8ff523a95873 req-ba6514a7-d53e-4511-a071-413b6e6d1625 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086071 Oct 30 01:31:15.982293 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1997/3990] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:31:16.174685 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3d4be903-0bfb-4029-a89b-e2994418c39a tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec278d8d7b4a5a96af042ba613bafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc4c8f707304cd98a5f2e13cb1d5a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:16.192885 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3d4be903-0bfb-4029-a89b-e2994418c39a tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] 10.222.0.13 "GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2" status: 200 len: 1522 microversion: 2.1 time: 0.388894 Oct 30 01:31:16.194200 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1994/3991] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:15 2022] GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2 => generated 1522 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:16.398551 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fd1c4bdc-fe2f-4344-ba61-3188b57e3958 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44c7be8040>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:16.496562 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fd1c4bdc-fe2f-4344-ba61-3188b57e3958 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/0771e672-b021-4747-b3e1-a12f87a748f5" status: 200 len: 1452 microversion: 2.1 time: 0.127525 Oct 30 01:31:16.499685 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1998/3992] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:31:16 2022] GET /compute/v2.1/images/0771e672-b021-4747-b3e1-a12f87a748f5 => generated 1452 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:16.906487 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1be84cab-79d6-4740-b284-48325d8a3bc6 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:16.917062 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1be84cab-79d6-4740-b284-48325d8a3bc6 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 8046842c-80bc-4713-81cf-7fecbe58a130] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:16.917062 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1be84cab-79d6-4740-b284-48325d8a3bc6 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:16.917718 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1be84cab-79d6-4740-b284-48325d8a3bc6 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:16.918577 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1be84cab-79d6-4740-b284-48325d8a3bc6 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:16.919527 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1be84cab-79d6-4740-b284-48325d8a3bc6 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:16.920248 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1be84cab-79d6-4740-b284-48325d8a3bc6 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:16.920845 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1be84cab-79d6-4740-b284-48325d8a3bc6 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:16.976297 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1be84cab-79d6-4740-b284-48325d8a3bc6 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:16.977033 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1be84cab-79d6-4740-b284-48325d8a3bc6 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:16.977510 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1be84cab-79d6-4740-b284-48325d8a3bc6 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:16.977991 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-1be84cab-79d6-4740-b284-48325d8a3bc6 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lazy-loading 'fault' on Instance uuid 8046842c-80bc-4713-81cf-7fecbe58a130 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:31:17.088627 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1be84cab-79d6-4740-b284-48325d8a3bc6 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:17.098739 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1be84cab-79d6-4740-b284-48325d8a3bc6 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/8046842c-80bc-4713-81cf-7fecbe58a130" status: 200 len: 1298 microversion: 2.1 time: 0.198414 Oct 30 01:31:17.100303 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1995/3993] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:16 2022] GET /compute/v2.1/servers/8046842c-80bc-4713-81cf-7fecbe58a130 => generated 1298 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:17.227952 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b532a18e-9e60-4e6f-b43d-134cc7470e31 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:17.229353 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b532a18e-9e60-4e6f-b43d-134cc7470e31 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] [instance: 1f9c8547-e0cb-4094-a15e-d21166bda1d2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:17.238956 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b532a18e-9e60-4e6f-b43d-134cc7470e31 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:17.239897 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b532a18e-9e60-4e6f-b43d-134cc7470e31 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:17.241149 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b532a18e-9e60-4e6f-b43d-134cc7470e31 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:17.242100 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b532a18e-9e60-4e6f-b43d-134cc7470e31 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:17.242765 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b532a18e-9e60-4e6f-b43d-134cc7470e31 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:17.243511 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b532a18e-9e60-4e6f-b43d-134cc7470e31 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:17.515752 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-80f12d2b-7042-407e-91d3-29a13a857366 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44c7ecda60>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:17.573683 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b532a18e-9e60-4e6f-b43d-134cc7470e31 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec278d8d7b4a5a96af042ba613bafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc4c8f707304cd98a5f2e13cb1d5a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:17.595267 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-80f12d2b-7042-407e-91d3-29a13a857366 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/0771e672-b021-4747-b3e1-a12f87a748f5" status: 200 len: 1452 microversion: 2.1 time: 0.084323 Oct 30 01:31:17.597527 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1996/3994] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:31:17 2022] GET /compute/v2.1/images/0771e672-b021-4747-b3e1-a12f87a748f5 => generated 1452 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:17.597941 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b532a18e-9e60-4e6f-b43d-134cc7470e31 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] 10.222.0.13 "GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2" status: 200 len: 1522 microversion: 2.1 time: 0.360984 Oct 30 01:31:17.601423 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1999/3995] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:17 2022] GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2 => generated 1522 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:18.127231 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3a8eea5d-a460-430c-97bd-48a6269362ab tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:18.127874 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3a8eea5d-a460-430c-97bd-48a6269362ab tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 8046842c-80bc-4713-81cf-7fecbe58a130] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:18.140276 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a8eea5d-a460-430c-97bd-48a6269362ab tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:18.141211 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a8eea5d-a460-430c-97bd-48a6269362ab tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:18.142416 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a8eea5d-a460-430c-97bd-48a6269362ab tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:18.143347 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a8eea5d-a460-430c-97bd-48a6269362ab tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:18.144190 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a8eea5d-a460-430c-97bd-48a6269362ab tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:18.145053 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a8eea5d-a460-430c-97bd-48a6269362ab tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:18.163687 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-3a8eea5d-a460-430c-97bd-48a6269362ab tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] HTTP exception thrown: Instance 8046842c-80bc-4713-81cf-7fecbe58a130 could not be found. Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3a8eea5d-a460-430c-97bd-48a6269362ab tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Request method failure captured: Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/8046842c-80bc-4713-81cf-7fecbe58a130 HTTP/1.1 Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdNZbeUR7skwu5ylmljymLwmsn3OMAB7HFdlDZsip3dgOK-vaOPPSwUYmWT_o9z2OqWc9cL2Rd22cHSa-BN8vqcvBTHGvFnuVH3dT1kVAQG6ODQVt2oxoFKeXYoNTjg1JUCF1B7Vzk2gVPeSesCiSDD37BDZ3_Wp6AgzZI4w4KMCOXw Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 45fe1c50eaee40249b6c20cc91e52586 Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServersTestJSON-1478392549 Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServersTestJSON-1478392549 Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 45fe1c50eaee40249b6c20cc91e52586 Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServersTestJSON-1478392549 Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServersTestJSON-1478392549-project Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: ef5f8a3e6fef4d6393603575479b16a2 Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServersTestJSON-1478392549-project Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 8046842c-80bc-4713-81cf-7fecbe58a130 could not be found. Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '8046842c-80bc-4713-81cf-7fecbe58a130'} Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8046842c-80bc-4713-81cf-7fecbe58a130 could not be found. Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8046842c-80bc-4713-81cf-7fecbe58a130 could not be found. Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:31:18.165742 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:31:18.170966 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:31:18.170966 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:31:18.170966 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:31:18.170966 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:31:18.170966 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:31:18.170966 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8046842c-80bc-4713-81cf-7fecbe58a130 could not be found. Oct 30 01:31:18.170966 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:31:18.174636 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3a8eea5d-a460-430c-97bd-48a6269362ab tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Returning 404 to user: Instance 8046842c-80bc-4713-81cf-7fecbe58a130 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:31:18.175859 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3a8eea5d-a460-430c-97bd-48a6269362ab tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/8046842c-80bc-4713-81cf-7fecbe58a130" status: 404 len: 111 microversion: 2.1 time: 0.054238 Oct 30 01:31:18.176675 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1997/3996] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:18 2022] GET /compute/v2.1/servers/8046842c-80bc-4713-81cf-7fecbe58a130 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:31:18.187092 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-51b7d2d2-e68c-4b51-a1f0-fdd84c5f7d54 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:18.188046 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-51b7d2d2-e68c-4b51-a1f0-fdd84c5f7d54 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 98262d96-9a63-4531-9001-3fd0efd22014] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:18.199922 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-51b7d2d2-e68c-4b51-a1f0-fdd84c5f7d54 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:18.199922 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-51b7d2d2-e68c-4b51-a1f0-fdd84c5f7d54 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:18.199922 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-51b7d2d2-e68c-4b51-a1f0-fdd84c5f7d54 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:18.200190 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-51b7d2d2-e68c-4b51-a1f0-fdd84c5f7d54 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:18.200593 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-51b7d2d2-e68c-4b51-a1f0-fdd84c5f7d54 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:18.201034 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-51b7d2d2-e68c-4b51-a1f0-fdd84c5f7d54 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:18.236434 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-51b7d2d2-e68c-4b51-a1f0-fdd84c5f7d54 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 98262d96-9a63-4531-9001-3fd0efd22014] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:31:18.616764 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a627cd9d-017e-419f-a913-89eda833ff87 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44cc0a0820>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:18.687080 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-51b7d2d2-e68c-4b51-a1f0-fdd84c5f7d54 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "DELETE /compute/v2.1/servers/98262d96-9a63-4531-9001-3fd0efd22014" status: 204 len: 0 microversion: 2.1 time: 0.504754 Oct 30 01:31:18.691757 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2000/3997] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:31:18 2022] DELETE /compute/v2.1/servers/98262d96-9a63-4531-9001-3fd0efd22014 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 30 01:31:18.717934 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8885a819-eeb0-4215-a8df-abc41351b37c tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:18.720270 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8885a819-eeb0-4215-a8df-abc41351b37c tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] [instance: 1f9c8547-e0cb-4094-a15e-d21166bda1d2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:18.727441 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a627cd9d-017e-419f-a913-89eda833ff87 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/0771e672-b021-4747-b3e1-a12f87a748f5" status: 200 len: 1452 microversion: 2.1 time: 0.115389 Oct 30 01:31:18.745530 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1998/3998] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:31:18 2022] GET /compute/v2.1/images/0771e672-b021-4747-b3e1-a12f87a748f5 => generated 1452 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:18.752653 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8885a819-eeb0-4215-a8df-abc41351b37c tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:18.755027 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2a9570ce-c418-47b1-a95b-7ee588503c2b tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:18.758463 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8885a819-eeb0-4215-a8df-abc41351b37c tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:18.760869 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8885a819-eeb0-4215-a8df-abc41351b37c tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:18.762612 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8885a819-eeb0-4215-a8df-abc41351b37c tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:18.764970 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8885a819-eeb0-4215-a8df-abc41351b37c tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:18.765682 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8885a819-eeb0-4215-a8df-abc41351b37c tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:18.771065 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2a9570ce-c418-47b1-a95b-7ee588503c2b tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2fd2e319840c4a8aab90b495374aa1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eba4d14f2004498850092bff100b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:18.775323 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2a9570ce-c418-47b1-a95b-7ee588503c2b tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Searching by: {'deleted': False, 'project_id': '0eba4d14f2004498850092bff100b757'} {{(pid=121102) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 30 01:31:18.791380 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a9570ce-c418-47b1-a95b-7ee588503c2b tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:18.793267 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a9570ce-c418-47b1-a95b-7ee588503c2b tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:18.795235 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a9570ce-c418-47b1-a95b-7ee588503c2b tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:18.796703 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a9570ce-c418-47b1-a95b-7ee588503c2b tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:18.797134 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a9570ce-c418-47b1-a95b-7ee588503c2b tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:18.799261 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a9570ce-c418-47b1-a95b-7ee588503c2b tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:18.860584 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.multi_cell_list [None req-2a9570ce-c418-47b1-a95b-7ee588503c2b tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121102) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 30 01:31:18.901990 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2a9570ce-c418-47b1-a95b-7ee588503c2b tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.152791 Oct 30 01:31:18.909429 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1999/3999] 10.222.0.13 () {58 vars in 1125 bytes} [Sun Oct 30 01:31:18 2022] GET /compute/v2.1/servers => generated 343 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:31:18.909662 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3a0a6d33-5311-4477-95a3-933e9a8554b8 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:18.910441 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3a0a6d33-5311-4477-95a3-933e9a8554b8 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 98262d96-9a63-4531-9001-3fd0efd22014] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:18.917183 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a0a6d33-5311-4477-95a3-933e9a8554b8 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:18.917869 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a0a6d33-5311-4477-95a3-933e9a8554b8 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:18.918600 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a0a6d33-5311-4477-95a3-933e9a8554b8 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:18.919379 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a0a6d33-5311-4477-95a3-933e9a8554b8 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:18.919836 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a0a6d33-5311-4477-95a3-933e9a8554b8 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:18.920266 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a0a6d33-5311-4477-95a3-933e9a8554b8 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:19.335478 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8885a819-eeb0-4215-a8df-abc41351b37c tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec278d8d7b4a5a96af042ba613bafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc4c8f707304cd98a5f2e13cb1d5a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:19.345278 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8885a819-eeb0-4215-a8df-abc41351b37c tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] 10.222.0.13 "GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2" status: 200 len: 1522 microversion: 2.1 time: 0.650911 Oct 30 01:31:19.351106 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2001/4000] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:18 2022] GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2 => generated 1522 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:19.356100 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-145455ee-a040-4f25-b880-865c2b1c61bb tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:19.375520 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-145455ee-a040-4f25-b880-865c2b1c61bb tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2fd2e319840c4a8aab90b495374aa1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eba4d14f2004498850092bff100b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:19.376708 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-145455ee-a040-4f25-b880-865c2b1c61bb tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Searching by: {'deleted': False, 'project_id': '0eba4d14f2004498850092bff100b757'} {{(pid=121103) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 30 01:31:19.386955 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-145455ee-a040-4f25-b880-865c2b1c61bb tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:19.388522 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-145455ee-a040-4f25-b880-865c2b1c61bb tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:19.388522 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-145455ee-a040-4f25-b880-865c2b1c61bb tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:19.389537 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-145455ee-a040-4f25-b880-865c2b1c61bb tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:19.390175 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-145455ee-a040-4f25-b880-865c2b1c61bb tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:19.397952 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-145455ee-a040-4f25-b880-865c2b1c61bb tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:19.450178 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.multi_cell_list [None req-145455ee-a040-4f25-b880-865c2b1c61bb tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121103) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 30 01:31:19.558308 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-145455ee-a040-4f25-b880-865c2b1c61bb tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd2e319840c4a8aab90b495374aa1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eba4d14f2004498850092bff100b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:19.580624 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-145455ee-a040-4f25-b880-865c2b1c61bb tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:19.585657 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-145455ee-a040-4f25-b880-865c2b1c61bb tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:19.587009 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-145455ee-a040-4f25-b880-865c2b1c61bb tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:20.251589 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3a0a6d33-5311-4477-95a3-933e9a8554b8 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:20.268376 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3a0a6d33-5311-4477-95a3-933e9a8554b8 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/98262d96-9a63-4531-9001-3fd0efd22014" status: 200 len: 1496 microversion: 2.1 time: 1.363097 Oct 30 01:31:20.286466 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2000/4001] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:18 2022] GET /compute/v2.1/servers/98262d96-9a63-4531-9001-3fd0efd22014 => generated 1496 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:20.295184 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a27f41c3-ba52-4a74-ab89-256ef137717d tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44d04cfb80>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:20.398179 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a27f41c3-ba52-4a74-ab89-256ef137717d tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/0771e672-b021-4747-b3e1-a12f87a748f5" status: 200 len: 1452 microversion: 2.1 time: 0.114193 Oct 30 01:31:20.400757 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2001/4002] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:31:20 2022] GET /compute/v2.1/images/0771e672-b021-4747-b3e1-a12f87a748f5 => generated 1452 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:20.413801 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-08b7e8d9-57e5-4c26-9707-2e5af9789e74 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:20.414435 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-08b7e8d9-57e5-4c26-9707-2e5af9789e74 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] [instance: 1f9c8547-e0cb-4094-a15e-d21166bda1d2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:20.440682 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08b7e8d9-57e5-4c26-9707-2e5af9789e74 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:20.446069 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08b7e8d9-57e5-4c26-9707-2e5af9789e74 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:20.447796 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08b7e8d9-57e5-4c26-9707-2e5af9789e74 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:20.449755 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08b7e8d9-57e5-4c26-9707-2e5af9789e74 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:20.450295 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08b7e8d9-57e5-4c26-9707-2e5af9789e74 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:20.452080 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08b7e8d9-57e5-4c26-9707-2e5af9789e74 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:20.493131 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-145455ee-a040-4f25-b880-865c2b1c61bb tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] 10.222.0.13 "GET /compute/v2.1/servers/detail" status: 200 len: 1604 microversion: 2.1 time: 1.140395 Oct 30 01:31:20.494774 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2002/4003] 10.222.0.13 () {58 vars in 1146 bytes} [Sun Oct 30 01:31:19 2022] GET /compute/v2.1/servers/detail => generated 1604 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:20.526925 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ff0b21de-aace-4c3a-86e4-fa2d90977381 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:20.542907 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ff0b21de-aace-4c3a-86e4-fa2d90977381 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014560 Oct 30 01:31:20.544973 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2003/4004] 10.222.0.13 () {58 vars in 1137 bytes} [Sun Oct 30 01:31:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:31:20.612816 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f9a51f3a-3a9a-4064-841e-af502b89e755 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:31:20.615518 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f9a51f3a-3a9a-4064-841e-af502b89e755 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:20.655609 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f9a51f3a-3a9a-4064-841e-af502b89e755 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:20.655609 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f9a51f3a-3a9a-4064-841e-af502b89e755 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:20.655609 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f9a51f3a-3a9a-4064-841e-af502b89e755 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:20.655609 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f9a51f3a-3a9a-4064-841e-af502b89e755 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:20.655609 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f9a51f3a-3a9a-4064-841e-af502b89e755 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:20.655609 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f9a51f3a-3a9a-4064-841e-af502b89e755 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:20.691368 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-f9a51f3a-3a9a-4064-841e-af502b89e755 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lazy-loading 'flavor' on Instance uuid 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:31:20.884336 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-08b7e8d9-57e5-4c26-9707-2e5af9789e74 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec278d8d7b4a5a96af042ba613bafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc4c8f707304cd98a5f2e13cb1d5a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:20.896930 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-08b7e8d9-57e5-4c26-9707-2e5af9789e74 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] 10.222.0.13 "GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2" status: 200 len: 1522 microversion: 2.1 time: 0.492979 Oct 30 01:31:20.899402 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2002/4005] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:20 2022] GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2 => generated 1522 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:20.908821 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b46aecfe-e051-4265-9ba7-3578600e710c tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:20.911425 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b46aecfe-e051-4265-9ba7-3578600e710c tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] [instance: 78081c7e-04f6-468e-9a0d-3c74c1092c6d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:20.931093 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b46aecfe-e051-4265-9ba7-3578600e710c tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:20.931600 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b46aecfe-e051-4265-9ba7-3578600e710c tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:20.932046 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b46aecfe-e051-4265-9ba7-3578600e710c tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:20.935018 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b46aecfe-e051-4265-9ba7-3578600e710c tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:20.935516 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b46aecfe-e051-4265-9ba7-3578600e710c tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:20.938435 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b46aecfe-e051-4265-9ba7-3578600e710c tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:20.980175 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b46aecfe-e051-4265-9ba7-3578600e710c tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] [instance: 78081c7e-04f6-468e-9a0d-3c74c1092c6d] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:31:21.140075 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f9a51f3a-3a9a-4064-841e-af502b89e755 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "POST /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0/action" status: 200 len: 32 microversion: 2.1 time: 0.531504 Oct 30 01:31:21.141290 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2004/4006] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:31:20 2022] POST /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0/action => generated 32 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:31:21.152142 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-938485b2-a52e-42ac-abe9-2748f72ebaea tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:21.153163 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-938485b2-a52e-42ac-abe9-2748f72ebaea tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:21.160390 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-938485b2-a52e-42ac-abe9-2748f72ebaea tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:21.161188 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-938485b2-a52e-42ac-abe9-2748f72ebaea tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:21.161891 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-938485b2-a52e-42ac-abe9-2748f72ebaea tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:21.162837 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-938485b2-a52e-42ac-abe9-2748f72ebaea tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:21.163461 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-938485b2-a52e-42ac-abe9-2748f72ebaea tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:21.164733 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-938485b2-a52e-42ac-abe9-2748f72ebaea tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:21.341447 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b46aecfe-e051-4265-9ba7-3578600e710c tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] 10.222.0.13 "DELETE /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d" status: 204 len: 0 microversion: 2.1 time: 0.440328 Oct 30 01:31:21.347238 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2003/4007] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:31:20 2022] DELETE /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d => generated 0 bytes in 442 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:31:21.348925 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-00413621-db83-4e8b-95d3-70dcea442a1b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:21.349958 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-00413621-db83-4e8b-95d3-70dcea442a1b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 98262d96-9a63-4531-9001-3fd0efd22014] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:21.356906 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00413621-db83-4e8b-95d3-70dcea442a1b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:21.357743 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00413621-db83-4e8b-95d3-70dcea442a1b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:21.358401 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00413621-db83-4e8b-95d3-70dcea442a1b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:21.359332 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00413621-db83-4e8b-95d3-70dcea442a1b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:21.360064 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00413621-db83-4e8b-95d3-70dcea442a1b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:21.360898 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00413621-db83-4e8b-95d3-70dcea442a1b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:21.568774 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-938485b2-a52e-42ac-abe9-2748f72ebaea tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:21.583604 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-938485b2-a52e-42ac-abe9-2748f72ebaea tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0" status: 200 len: 1738 microversion: 2.1 time: 0.435296 Oct 30 01:31:21.587813 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2005/4008] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:21 2022] GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0 => generated 1738 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:21.594277 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-dbaff66a-c885-44b6-9ea9-b13df8402225 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:21.595761 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-dbaff66a-c885-44b6-9ea9-b13df8402225 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] [instance: 78081c7e-04f6-468e-9a0d-3c74c1092c6d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:21.604637 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dbaff66a-c885-44b6-9ea9-b13df8402225 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:21.605548 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dbaff66a-c885-44b6-9ea9-b13df8402225 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:21.606604 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dbaff66a-c885-44b6-9ea9-b13df8402225 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:21.607566 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dbaff66a-c885-44b6-9ea9-b13df8402225 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:21.608208 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dbaff66a-c885-44b6-9ea9-b13df8402225 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:21.608834 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dbaff66a-c885-44b6-9ea9-b13df8402225 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:21.708622 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-00413621-db83-4e8b-95d3-70dcea442a1b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:21.719162 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-00413621-db83-4e8b-95d3-70dcea442a1b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/98262d96-9a63-4531-9001-3fd0efd22014" status: 200 len: 1496 microversion: 2.1 time: 0.375217 Oct 30 01:31:21.735060 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2004/4009] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:21 2022] GET /compute/v2.1/servers/98262d96-9a63-4531-9001-3fd0efd22014 => generated 1496 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:21.738428 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-16633f55-aa2c-4d90-900b-331111456a49 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44d02cd1f0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:21.812426 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-16633f55-aa2c-4d90-900b-331111456a49 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/0771e672-b021-4747-b3e1-a12f87a748f5" status: 200 len: 1461 microversion: 2.1 time: 0.081790 Oct 30 01:31:21.813017 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2005/4010] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:31:21 2022] GET /compute/v2.1/images/0771e672-b021-4747-b3e1-a12f87a748f5 => generated 1461 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:21.821921 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-1a8f7894-c2b3-4517-ab57-888f3c1b8bdc req-7761b2f2-ffef-4918-997f-33e1fdfac8e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98262d96-9a63-4531-9001-3fd0efd22014", "name": "network-vif-deleted", "tag": "716e550e-c87a-4177-bf1f-22fa02af88f1"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:31:21.828479 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-1a8f7894-c2b3-4517-ab57-888f3c1b8bdc req-7761b2f2-ffef-4918-997f-33e1fdfac8e2 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:21.828966 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-1a8f7894-c2b3-4517-ab57-888f3c1b8bdc req-7761b2f2-ffef-4918-997f-33e1fdfac8e2 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:21.829484 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-1a8f7894-c2b3-4517-ab57-888f3c1b8bdc req-7761b2f2-ffef-4918-997f-33e1fdfac8e2 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:21.847027 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-1a8f7894-c2b3-4517-ab57-888f3c1b8bdc req-7761b2f2-ffef-4918-997f-33e1fdfac8e2 service nova] Creating event network-vif-deleted:716e550e-c87a-4177-bf1f-22fa02af88f1 for instance 98262d96-9a63-4531-9001-3fd0efd22014 on n-h2-master-1 Oct 30 01:31:21.853249 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-1a8f7894-c2b3-4517-ab57-888f3c1b8bdc req-7761b2f2-ffef-4918-997f-33e1fdfac8e2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039036 Oct 30 01:31:21.854220 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2006/4011] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:31:21.859580 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-118bab01-646e-42aa-a0e7-b14421a996c1 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44cc6f34c0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:21.862551 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-dbaff66a-c885-44b6-9ea9-b13df8402225 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd2e319840c4a8aab90b495374aa1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eba4d14f2004498850092bff100b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:21.878812 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-dbaff66a-c885-44b6-9ea9-b13df8402225 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] 10.222.0.13 "GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d" status: 200 len: 1607 microversion: 2.1 time: 0.290923 Oct 30 01:31:21.879925 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2006/4012] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:21 2022] GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d => generated 1607 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:21.936291 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6f5ed294-d214-4ac2-a457-841c4a956f16 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:21.937516 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6f5ed294-d214-4ac2-a457-841c4a956f16 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] [instance: 1f9c8547-e0cb-4094-a15e-d21166bda1d2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:21.938344 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-118bab01-646e-42aa-a0e7-b14421a996c1 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/0771e672-b021-4747-b3e1-a12f87a748f5" status: 200 len: 1461 microversion: 2.1 time: 0.082912 Oct 30 01:31:21.939276 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2007/4013] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:31:21 2022] GET /compute/v2.1/images/0771e672-b021-4747-b3e1-a12f87a748f5 => generated 1461 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:21.946555 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f5ed294-d214-4ac2-a457-841c4a956f16 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:21.947564 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f5ed294-d214-4ac2-a457-841c4a956f16 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:21.952366 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f5ed294-d214-4ac2-a457-841c4a956f16 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:21.952366 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f5ed294-d214-4ac2-a457-841c4a956f16 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:21.952366 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f5ed294-d214-4ac2-a457-841c4a956f16 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:21.952366 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f5ed294-d214-4ac2-a457-841c4a956f16 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:21.953619 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f611a57f-e866-4a79-9199-9a2a74c9df14 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:21.954429 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f611a57f-e866-4a79-9199-9a2a74c9df14 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] [instance: e9368bd4-9715-46b3-91bb-cb436f7120f3] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:21.967954 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f611a57f-e866-4a79-9199-9a2a74c9df14 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:21.968457 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f611a57f-e866-4a79-9199-9a2a74c9df14 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:21.968900 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f611a57f-e866-4a79-9199-9a2a74c9df14 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:21.969701 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f611a57f-e866-4a79-9199-9a2a74c9df14 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:21.970162 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f611a57f-e866-4a79-9199-9a2a74c9df14 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:21.970590 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f611a57f-e866-4a79-9199-9a2a74c9df14 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:21.977218 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:31:22.176587 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6f5ed294-d214-4ac2-a457-841c4a956f16 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec278d8d7b4a5a96af042ba613bafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc4c8f707304cd98a5f2e13cb1d5a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:22.186146 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6f5ed294-d214-4ac2-a457-841c4a956f16 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] 10.222.0.13 "GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2" status: 200 len: 1522 microversion: 2.1 time: 0.254848 Oct 30 01:31:22.187899 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2007/4014] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:21 2022] GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2 => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:22.267847 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f611a57f-e866-4a79-9199-9a2a74c9df14 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea8a24166674250a98268ae52604f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcce1fadf54d089ec4fd751a3cf6ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:22.278385 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f611a57f-e866-4a79-9199-9a2a74c9df14 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/servers/e9368bd4-9715-46b3-91bb-cb436f7120f3" status: 200 len: 1467 microversion: 2.1 time: 0.328447 Oct 30 01:31:22.279699 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2008/4015] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:21 2022] GET /compute/v2.1/servers/e9368bd4-9715-46b3-91bb-cb436f7120f3 => generated 1467 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:22.305517 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8ae2d738-770b-43e5-aac8-44358ba93386 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44d044fe50>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:22.483264 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8ae2d738-770b-43e5-aac8-44358ba93386 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images?changes-since=2022-10-30T01%3A29%3A27Z" status: 200 len: 1900 microversion: 2.1 time: 0.182726 Oct 30 01:31:22.488145 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2008/4016] 10.222.0.13 () {58 vars in 1199 bytes} [Sun Oct 30 01:31:22 2022] GET /compute/v2.1/images?changes-since=2022-10-30T01%3A29%3A27Z => generated 1900 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:22.503583 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7d4d45a7-05da-4d80-83a0-ec030890e8ae tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44c7693e50>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:22.621472 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b9844512-a66d-4f68-bd99-d1e4d85df089 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:22.621472 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b9844512-a66d-4f68-bd99-d1e4d85df089 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:22.633274 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b9844512-a66d-4f68-bd99-d1e4d85df089 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:22.633801 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b9844512-a66d-4f68-bd99-d1e4d85df089 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:22.634237 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b9844512-a66d-4f68-bd99-d1e4d85df089 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:22.635276 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b9844512-a66d-4f68-bd99-d1e4d85df089 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:22.635739 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b9844512-a66d-4f68-bd99-d1e4d85df089 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:22.636333 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b9844512-a66d-4f68-bd99-d1e4d85df089 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:22.645950 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7d4d45a7-05da-4d80-83a0-ec030890e8ae tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1230912475" status: 200 len: 485 microversion: 2.1 time: 0.143821 Oct 30 01:31:22.645950 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2009/4017] 10.222.0.13 () {58 vars in 1231 bytes} [Sun Oct 30 01:31:22 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1230912475 => generated 485 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:31:22.658438 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fc6f5df9-3b5c-4c20-b006-c1d026bdfc0c tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44cc6f3dc0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:22.809015 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fc6f5df9-3b5c-4c20-b006-c1d026bdfc0c tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images?server=e9368bd4-9715-46b3-91bb-cb436f7120f3" status: 200 len: 956 microversion: 2.1 time: 0.154354 Oct 30 01:31:22.810094 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2010/4018] 10.222.0.13 () {58 vars in 1209 bytes} [Sun Oct 30 01:31:22 2022] GET /compute/v2.1/images?server=e9368bd4-9715-46b3-91bb-cb436f7120f3 => generated 956 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:31:22.824345 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ee0acfed-25d6-44a2-93e3-bb3ae8ba5f44 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:22.827368 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ee0acfed-25d6-44a2-93e3-bb3ae8ba5f44 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 98262d96-9a63-4531-9001-3fd0efd22014] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:22.838991 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee0acfed-25d6-44a2-93e3-bb3ae8ba5f44 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:22.844783 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee0acfed-25d6-44a2-93e3-bb3ae8ba5f44 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:22.845698 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee0acfed-25d6-44a2-93e3-bb3ae8ba5f44 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:22.846659 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee0acfed-25d6-44a2-93e3-bb3ae8ba5f44 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:22.847115 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee0acfed-25d6-44a2-93e3-bb3ae8ba5f44 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:22.850115 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee0acfed-25d6-44a2-93e3-bb3ae8ba5f44 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:22.879955 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b9844512-a66d-4f68-bd99-d1e4d85df089 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:22.890867 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b9844512-a66d-4f68-bd99-d1e4d85df089 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0" status: 200 len: 1738 microversion: 2.1 time: 0.279560 Oct 30 01:31:22.891728 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2009/4019] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:22 2022] GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0 => generated 1738 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:31:22.897702 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c4efc82f-5266-4d63-a7a0-e8912e813a68 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44d03f5c10>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:22.970070 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ee0acfed-25d6-44a2-93e3-bb3ae8ba5f44 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:23.003557 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ee0acfed-25d6-44a2-93e3-bb3ae8ba5f44 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/98262d96-9a63-4531-9001-3fd0efd22014" status: 200 len: 1293 microversion: 2.1 time: 0.192099 Oct 30 01:31:23.006758 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c4efc82f-5266-4d63-a7a0-e8912e813a68 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.13%2Fcompute%2Fv2.1%2Fservers%2F99db82dd-3238-4af1-9f90-1dd69cdd836a" status: 200 len: 483 microversion: 2.1 time: 0.112395 Oct 30 01:31:23.006758 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2010/4020] 10.222.0.13 () {58 vars in 1317 bytes} [Sun Oct 30 01:31:22 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.13%2Fcompute%2Fv2.1%2Fservers%2F99db82dd-3238-4af1-9f90-1dd69cdd836a => generated 483 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:31:23.018089 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2011/4021] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:22 2022] GET /compute/v2.1/servers/98262d96-9a63-4531-9001-3fd0efd22014 => generated 1293 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:23.018325 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-33092dcc-9c62-4c28-8357-9a2a2d3416bb tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:23.019656 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-412fe6f0-b1aa-4402-bd93-4104b8dcc8df tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44cc573d30>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:23.021854 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-33092dcc-9c62-4c28-8357-9a2a2d3416bb tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] [instance: 78081c7e-04f6-468e-9a0d-3c74c1092c6d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:23.045276 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-33092dcc-9c62-4c28-8357-9a2a2d3416bb tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:23.046098 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-33092dcc-9c62-4c28-8357-9a2a2d3416bb tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:23.046734 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-33092dcc-9c62-4c28-8357-9a2a2d3416bb tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:23.047704 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-33092dcc-9c62-4c28-8357-9a2a2d3416bb tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:23.048332 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-33092dcc-9c62-4c28-8357-9a2a2d3416bb tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:23.048934 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-33092dcc-9c62-4c28-8357-9a2a2d3416bb tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:23.115676 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-412fe6f0-b1aa-4402-bd93-4104b8dcc8df tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.13%2Fcompute%2Fservers%2F99db82dd-3238-4af1-9f90-1dd69cdd836a" status: 200 len: 483 microversion: 2.1 time: 0.100034 Oct 30 01:31:23.116642 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2012/4022] 10.222.0.13 () {58 vars in 1303 bytes} [Sun Oct 30 01:31:23 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.13%2Fcompute%2Fservers%2F99db82dd-3238-4af1-9f90-1dd69cdd836a => generated 483 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:31:23.136697 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d7e2354a-e4c1-4629-8dd8-de9fe5ec888f tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44cc8d6820>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:23.312319 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d7e2354a-e4c1-4629-8dd8-de9fe5ec888f tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3279 microversion: 2.1 time: 0.186603 Oct 30 01:31:23.314456 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2013/4023] 10.222.0.13 () {58 vars in 1149 bytes} [Sun Oct 30 01:31:23 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3279 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:23.326681 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-68f94212-9d0b-480b-a5d6-43f38ab82483 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:23.327817 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-68f94212-9d0b-480b-a5d6-43f38ab82483 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] [instance: 1f9c8547-e0cb-4094-a15e-d21166bda1d2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:23.336901 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-68f94212-9d0b-480b-a5d6-43f38ab82483 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:23.337860 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-68f94212-9d0b-480b-a5d6-43f38ab82483 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:23.338599 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-68f94212-9d0b-480b-a5d6-43f38ab82483 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:23.339332 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-68f94212-9d0b-480b-a5d6-43f38ab82483 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:23.339973 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-68f94212-9d0b-480b-a5d6-43f38ab82483 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:23.341137 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-68f94212-9d0b-480b-a5d6-43f38ab82483 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:23.407093 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-33092dcc-9c62-4c28-8357-9a2a2d3416bb tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd2e319840c4a8aab90b495374aa1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eba4d14f2004498850092bff100b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:23.421564 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-33092dcc-9c62-4c28-8357-9a2a2d3416bb tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] 10.222.0.13 "GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d" status: 200 len: 1607 microversion: 2.1 time: 0.413724 Oct 30 01:31:23.422162 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2011/4024] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:23 2022] GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d => generated 1607 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:23.441927 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-17d7593f-c477-45a2-9a06-aa39de610138 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44c7a77dc0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:23.536746 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-17d7593f-c477-45a2-9a06-aa39de610138 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1427 microversion: 2.1 time: 0.112641 Oct 30 01:31:23.537420 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2012/4025] 10.222.0.13 () {58 vars in 1149 bytes} [Sun Oct 30 01:31:23 2022] GET /compute/v2.1/images?type=snapshot => generated 1427 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:23.551135 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c4891a94-806e-4bdd-b037-15984d8b479b tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44c7be8670>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:23.623400 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c4891a94-806e-4bdd-b037-15984d8b479b tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.075946 Oct 30 01:31:23.623903 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2013/4026] 10.222.0.13 () {58 vars in 1137 bytes} [Sun Oct 30 01:31:23 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:31:23.640123 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-eade7348-f099-4cd5-9973-805b92d2872b tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44c7e3fa60>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:23.760563 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-eade7348-f099-4cd5-9973-805b92d2872b tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/detail?changes-since=2022-10-30T01%3A29%3A22Z" status: 200 len: 6326 microversion: 2.1 time: 0.124692 Oct 30 01:31:23.773969 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2014/4027] 10.222.0.13 () {58 vars in 1220 bytes} [Sun Oct 30 01:31:23 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-30T01%3A29%3A22Z => generated 6326 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:23.792100 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-68f94212-9d0b-480b-a5d6-43f38ab82483 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec278d8d7b4a5a96af042ba613bafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc4c8f707304cd98a5f2e13cb1d5a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:23.795575 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2bf14448-7a67-417a-8fe3-c3f4f2798a7b tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44c7ac9670>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:23.799935 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-68f94212-9d0b-480b-a5d6-43f38ab82483 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] 10.222.0.13 "GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2" status: 200 len: 1522 microversion: 2.1 time: 0.483645 Oct 30 01:31:23.803962 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2014/4028] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:23 2022] GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2 => generated 1522 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:23.868032 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2bf14448-7a67-417a-8fe3-c3f4f2798a7b tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1230912475" status: 200 len: 665 microversion: 2.1 time: 0.087134 Oct 30 01:31:23.885489 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2015/4029] 10.222.0.13 () {58 vars in 1252 bytes} [Sun Oct 30 01:31:23 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1230912475 => generated 665 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:31:23.893598 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8b234fff-1c1d-44f4-87eb-7657275b4976 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44d0523c10>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:23.923812 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6d987895-bd54-4a3b-bebe-69facbfd3ccc tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:23.924621 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6d987895-bd54-4a3b-bebe-69facbfd3ccc tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:23.948233 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6d987895-bd54-4a3b-bebe-69facbfd3ccc tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:23.948233 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6d987895-bd54-4a3b-bebe-69facbfd3ccc tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:23.948233 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6d987895-bd54-4a3b-bebe-69facbfd3ccc tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:23.949807 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6d987895-bd54-4a3b-bebe-69facbfd3ccc tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:23.950569 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6d987895-bd54-4a3b-bebe-69facbfd3ccc tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:23.951222 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6d987895-bd54-4a3b-bebe-69facbfd3ccc tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:23.977040 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8b234fff-1c1d-44f4-87eb-7657275b4976 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.13%2Fcompute%2Fv2.1%2Fservers%2F99db82dd-3238-4af1-9f90-1dd69cdd836a" status: 200 len: 1463 microversion: 2.1 time: 0.089846 Oct 30 01:31:23.992666 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2015/4030] 10.222.0.13 () {58 vars in 1338 bytes} [Sun Oct 30 01:31:23 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.13%2Fcompute%2Fv2.1%2Fservers%2F99db82dd-3238-4af1-9f90-1dd69cdd836a => generated 1463 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:24.001021 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c3bd94f7-a875-45b6-862c-2f39cb94b5c7 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44c7693160>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:24.143471 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c3bd94f7-a875-45b6-862c-2f39cb94b5c7 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.13%2Fcompute%2Fservers%2F99db82dd-3238-4af1-9f90-1dd69cdd836a" status: 200 len: 1463 microversion: 2.1 time: 0.149301 Oct 30 01:31:24.148072 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2016/4031] 10.222.0.13 () {58 vars in 1324 bytes} [Sun Oct 30 01:31:23 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.13%2Fcompute%2Fservers%2F99db82dd-3238-4af1-9f90-1dd69cdd836a => generated 1463 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:24.157986 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1ffb75b1-7340-4476-a8ea-9170ac764b38 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:24.163610 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1ffb75b1-7340-4476-a8ea-9170ac764b38 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 98262d96-9a63-4531-9001-3fd0efd22014] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:24.171167 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ffb75b1-7340-4476-a8ea-9170ac764b38 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:24.171670 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ffb75b1-7340-4476-a8ea-9170ac764b38 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:24.172117 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ffb75b1-7340-4476-a8ea-9170ac764b38 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:24.183802 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ffb75b1-7340-4476-a8ea-9170ac764b38 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:24.184494 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ffb75b1-7340-4476-a8ea-9170ac764b38 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:24.184950 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ffb75b1-7340-4476-a8ea-9170ac764b38 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:24.241212 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ffb75b1-7340-4476-a8ea-9170ac764b38 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:24.242545 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ffb75b1-7340-4476-a8ea-9170ac764b38 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:24.242991 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ffb75b1-7340-4476-a8ea-9170ac764b38 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:24.243451 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-1ffb75b1-7340-4476-a8ea-9170ac764b38 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lazy-loading 'fault' on Instance uuid 98262d96-9a63-4531-9001-3fd0efd22014 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:31:24.350666 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1ffb75b1-7340-4476-a8ea-9170ac764b38 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:24.362657 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1ffb75b1-7340-4476-a8ea-9170ac764b38 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/98262d96-9a63-4531-9001-3fd0efd22014" status: 200 len: 1298 microversion: 2.1 time: 0.213387 Oct 30 01:31:24.363700 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6d987895-bd54-4a3b-bebe-69facbfd3ccc tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:24.364218 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2017/4032] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:24 2022] GET /compute/v2.1/servers/98262d96-9a63-4531-9001-3fd0efd22014 => generated 1298 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:24.372298 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-769d0570-1a3c-4029-aacb-a7a83c3b2c8c tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44d049d550>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:24.373089 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6d987895-bd54-4a3b-bebe-69facbfd3ccc tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0" status: 200 len: 1738 microversion: 2.1 time: 0.453583 Oct 30 01:31:24.384683 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2016/4033] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:23 2022] GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0 => generated 1738 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:24.518893 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-769d0570-1a3c-4029-aacb-a7a83c3b2c8c tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7101 microversion: 2.1 time: 0.151630 Oct 30 01:31:24.519807 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2018/4034] 10.222.0.13 () {58 vars in 1170 bytes} [Sun Oct 30 01:31:24 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7101 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:24.539583 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e43632fa-c23a-4f47-846c-0ca09861c44d tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:24.540449 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e43632fa-c23a-4f47-846c-0ca09861c44d tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] [instance: 78081c7e-04f6-468e-9a0d-3c74c1092c6d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:24.547961 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e43632fa-c23a-4f47-846c-0ca09861c44d tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:24.548453 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e43632fa-c23a-4f47-846c-0ca09861c44d tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:24.549089 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e43632fa-c23a-4f47-846c-0ca09861c44d tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:24.550158 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e43632fa-c23a-4f47-846c-0ca09861c44d tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:24.550906 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e43632fa-c23a-4f47-846c-0ca09861c44d tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:24.551342 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e43632fa-c23a-4f47-846c-0ca09861c44d tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:24.594973 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ebf1e7fc-3b09-4e5f-ae66-eff812137903 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-65371527", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "2bdbb622-9eb5-4b19-93d6-10bf71c70ecc"}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:31:24.663072 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-ebf1e7fc-3b09-4e5f-ae66-eff812137903 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] validate_networks() for [('2bdbb622-9eb5-4b19-93d6-10bf71c70ecc', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:31:24.768334 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e43632fa-c23a-4f47-846c-0ca09861c44d tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd2e319840c4a8aab90b495374aa1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eba4d14f2004498850092bff100b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:24.772951 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:31:24.781086 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e43632fa-c23a-4f47-846c-0ca09861c44d tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] 10.222.0.13 "GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d" status: 200 len: 1607 microversion: 2.1 time: 0.245706 Oct 30 01:31:24.784979 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2019/4035] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:24 2022] GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d => generated 1607 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:24.794326 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e5f5a289-13ed-49a9-b660-9025581500bf tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44cc41baf0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:24.890399 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e5f5a289-13ed-49a9-b660-9025581500bf tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4367 microversion: 2.1 time: 0.105375 Oct 30 01:31:24.891000 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2020/4036] 10.222.0.13 () {58 vars in 1170 bytes} [Sun Oct 30 01:31:24 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4367 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:24.905925 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d5c6e048-e8f8-4b9b-b069-f7245dc87029 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:24.906760 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d5c6e048-e8f8-4b9b-b069-f7245dc87029 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] [instance: 1f9c8547-e0cb-4094-a15e-d21166bda1d2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:24.913783 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5c6e048-e8f8-4b9b-b069-f7245dc87029 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:24.914271 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5c6e048-e8f8-4b9b-b069-f7245dc87029 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:24.914708 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5c6e048-e8f8-4b9b-b069-f7245dc87029 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:24.915415 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5c6e048-e8f8-4b9b-b069-f7245dc87029 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:24.916013 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5c6e048-e8f8-4b9b-b069-f7245dc87029 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:24.917160 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5c6e048-e8f8-4b9b-b069-f7245dc87029 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:25.573660 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d5c6e048-e8f8-4b9b-b069-f7245dc87029 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec278d8d7b4a5a96af042ba613bafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc4c8f707304cd98a5f2e13cb1d5a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:25.582500 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d5c6e048-e8f8-4b9b-b069-f7245dc87029 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] 10.222.0.13 "GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2" status: 200 len: 1522 microversion: 2.1 time: 0.690428 Oct 30 01:31:25.583909 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2021/4037] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:24 2022] GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2 => generated 1522 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:25.588779 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-7552cc83-44f0-4d4a-a062-6b83cc6fff2f req-c81b1cb5-c561-4f74-8bc7-c464e0eddc5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9368bd4-9715-46b3-91bb-cb436f7120f3", "name": "network-vif-unplugged", "status": "completed", "tag": "2115d9c7-78b5-463e-b9d2-39310d4c1aa2"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:31:25.599792 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-7552cc83-44f0-4d4a-a062-6b83cc6fff2f req-c81b1cb5-c561-4f74-8bc7-c464e0eddc5d service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:25.600277 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-7552cc83-44f0-4d4a-a062-6b83cc6fff2f req-c81b1cb5-c561-4f74-8bc7-c464e0eddc5d service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:25.600891 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-7552cc83-44f0-4d4a-a062-6b83cc6fff2f req-c81b1cb5-c561-4f74-8bc7-c464e0eddc5d service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:25.615053 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-7552cc83-44f0-4d4a-a062-6b83cc6fff2f req-c81b1cb5-c561-4f74-8bc7-c464e0eddc5d service nova] Creating event network-vif-unplugged:2115d9c7-78b5-463e-b9d2-39310d4c1aa2 for instance e9368bd4-9715-46b3-91bb-cb436f7120f3 on n-h1-master-1 Oct 30 01:31:25.622538 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-7552cc83-44f0-4d4a-a062-6b83cc6fff2f req-c81b1cb5-c561-4f74-8bc7-c464e0eddc5d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036400 Oct 30 01:31:25.623507 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2022/4038] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:31:25.629245 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1b9849a1-a4b8-432a-9d96-aec4f09c8db0 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44c73481f0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:25.707097 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1b9849a1-a4b8-432a-9d96-aec4f09c8db0 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/deb14158-45d8-4539-889d-ff9726d046d7" status: 200 len: 784 microversion: 2.1 time: 0.082231 Oct 30 01:31:25.720248 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2023/4039] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:31:25 2022] GET /compute/v2.1/images/deb14158-45d8-4539-889d-ff9726d046d7 => generated 784 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:31:25.727305 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ea7b57c6-826d-44d6-9613-65d6dac98581 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:25.727305 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ea7b57c6-826d-44d6-9613-65d6dac98581 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 98262d96-9a63-4531-9001-3fd0efd22014] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:25.743457 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea7b57c6-826d-44d6-9613-65d6dac98581 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:25.749080 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea7b57c6-826d-44d6-9613-65d6dac98581 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:25.749080 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea7b57c6-826d-44d6-9613-65d6dac98581 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:25.749080 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea7b57c6-826d-44d6-9613-65d6dac98581 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:25.749080 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea7b57c6-826d-44d6-9613-65d6dac98581 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:25.749080 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea7b57c6-826d-44d6-9613-65d6dac98581 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:25.763219 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-ea7b57c6-826d-44d6-9613-65d6dac98581 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] HTTP exception thrown: Instance 98262d96-9a63-4531-9001-3fd0efd22014 could not be found. Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ea7b57c6-826d-44d6-9613-65d6dac98581 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Request method failure captured: Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/98262d96-9a63-4531-9001-3fd0efd22014 HTTP/1.1 Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdNZbeUR7skwu5ylmljymLwmsn3OMAB7HFdlDZsip3dgOK-vaOPPSwUYmWT_o9z2OqWc9cL2Rd22cHSa-BN8vqcvBTHGvFnuVH3dT1kVAQG6ODQVt2oxoFKeXYoNTjg1JUCF1B7Vzk2gVPeSesCiSDD37BDZ3_Wp6AgzZI4w4KMCOXw Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 45fe1c50eaee40249b6c20cc91e52586 Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServersTestJSON-1478392549 Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServersTestJSON-1478392549 Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 45fe1c50eaee40249b6c20cc91e52586 Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServersTestJSON-1478392549 Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServersTestJSON-1478392549-project Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: ef5f8a3e6fef4d6393603575479b16a2 Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServersTestJSON-1478392549-project Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 98262d96-9a63-4531-9001-3fd0efd22014 could not be found. Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '98262d96-9a63-4531-9001-3fd0efd22014'} Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98262d96-9a63-4531-9001-3fd0efd22014 could not be found. Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98262d96-9a63-4531-9001-3fd0efd22014 could not be found. Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:31:25.765378 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:31:25.771288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:31:25.771288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:31:25.771288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:31:25.771288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:31:25.771288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:31:25.771288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98262d96-9a63-4531-9001-3fd0efd22014 could not be found. Oct 30 01:31:25.771288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:31:25.772875 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ea7b57c6-826d-44d6-9613-65d6dac98581 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Returning 404 to user: Instance 98262d96-9a63-4531-9001-3fd0efd22014 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:31:25.773932 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ea7b57c6-826d-44d6-9613-65d6dac98581 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/98262d96-9a63-4531-9001-3fd0efd22014" status: 404 len: 111 microversion: 2.1 time: 0.052353 Oct 30 01:31:25.778533 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2024/4040] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:25 2022] GET /compute/v2.1/servers/98262d96-9a63-4531-9001-3fd0efd22014 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:31:25.793102 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5a2f11f7-6111-48a7-a053-46bd73da2474 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:25.793686 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5a2f11f7-6111-48a7-a053-46bd73da2474 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:25.801041 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a2f11f7-6111-48a7-a053-46bd73da2474 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:25.802659 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a2f11f7-6111-48a7-a053-46bd73da2474 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:25.803441 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a2f11f7-6111-48a7-a053-46bd73da2474 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:25.804368 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a2f11f7-6111-48a7-a053-46bd73da2474 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:25.805022 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a2f11f7-6111-48a7-a053-46bd73da2474 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:25.805692 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a2f11f7-6111-48a7-a053-46bd73da2474 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:25.825364 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-ebf1e7fc-3b09-4e5f-ae66-eff812137903 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:31:25.827643 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-ebf1e7fc-3b09-4e5f-ae66-eff812137903 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:31:25.828352 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-ebf1e7fc-3b09-4e5f-ae66-eff812137903 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:31:25.828964 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-ebf1e7fc-3b09-4e5f-ae66-eff812137903 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:31:25.829709 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-ebf1e7fc-3b09-4e5f-ae66-eff812137903 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:31:25.876210 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ebf1e7fc-3b09-4e5f-ae66-eff812137903 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:25.883666 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ebf1e7fc-3b09-4e5f-ae66-eff812137903 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:25.885172 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ebf1e7fc-3b09-4e5f-ae66-eff812137903 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:25.886468 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ebf1e7fc-3b09-4e5f-ae66-eff812137903 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:25.888761 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ebf1e7fc-3b09-4e5f-ae66-eff812137903 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:25.890238 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ebf1e7fc-3b09-4e5f-ae66-eff812137903 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:25.948466 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-ebf1e7fc-3b09-4e5f-ae66-eff812137903 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Getting quotas for project 3efbfd76a9a74c03907d7d9be25f42d4. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:31:25.960649 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-ebf1e7fc-3b09-4e5f-ae66-eff812137903 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Getting quotas for user 0bce487302c24def8a8473b0725904f2 and project 3efbfd76a9a74c03907d7d9be25f42d4. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:31:25.980464 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ebf1e7fc-3b09-4e5f-ae66-eff812137903 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:31:25.980464 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ebf1e7fc-3b09-4e5f-ae66-eff812137903 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:31:26.082935 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5a2f11f7-6111-48a7-a053-46bd73da2474 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:26.088743 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5a2f11f7-6111-48a7-a053-46bd73da2474 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0" status: 200 len: 1738 microversion: 2.1 time: 0.299619 Oct 30 01:31:26.089527 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2025/4041] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:25 2022] GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0 => generated 1738 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:26.110772 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8f69444a-4cf7-4ebb-92ef-3c55f77e981d tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44cc6f3ee0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:26.167980 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8f69444a-4cf7-4ebb-92ef-3c55f77e981d tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1608 microversion: 2.1 time: 0.063222 Oct 30 01:31:26.168952 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2026/4042] 10.222.0.13 () {58 vars in 1158 bytes} [Sun Oct 30 01:31:26 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1608 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:26.174737 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-5007a489-c98f-4479-ac1e-795acf7ff97d req-52d1f6aa-b481-4f4f-b01b-82b515587c75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78081c7e-04f6-468e-9a0d-3c74c1092c6d", "name": "network-vif-deleted", "tag": "b74af5e9-2f4a-4f37-abb4-131b49622ba4"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:31:26.187732 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-5007a489-c98f-4479-ac1e-795acf7ff97d req-52d1f6aa-b481-4f4f-b01b-82b515587c75 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:26.188210 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-5007a489-c98f-4479-ac1e-795acf7ff97d req-52d1f6aa-b481-4f4f-b01b-82b515587c75 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:26.188880 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-5007a489-c98f-4479-ac1e-795acf7ff97d req-52d1f6aa-b481-4f4f-b01b-82b515587c75 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:26.201640 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-5007a489-c98f-4479-ac1e-795acf7ff97d req-52d1f6aa-b481-4f4f-b01b-82b515587c75 service nova] Creating event network-vif-deleted:b74af5e9-2f4a-4f37-abb4-131b49622ba4 for instance 78081c7e-04f6-468e-9a0d-3c74c1092c6d on n-h2-master-1 Oct 30 01:31:26.229796 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-5007a489-c98f-4479-ac1e-795acf7ff97d req-52d1f6aa-b481-4f4f-b01b-82b515587c75 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057502 Oct 30 01:31:26.240895 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2027/4043] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:31:26.245383 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ebf1e7fc-3b09-4e5f-ae66-eff812137903 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.858011 Oct 30 01:31:26.255908 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2017/4044] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:31:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1871 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:31:26.258123 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-29ba8659-d15f-4a61-accb-7d8703ad867a tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:26.259598 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-29ba8659-d15f-4a61-accb-7d8703ad867a tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] [instance: 78081c7e-04f6-468e-9a0d-3c74c1092c6d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:26.269975 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-29ba8659-d15f-4a61-accb-7d8703ad867a tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:26.270846 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-29ba8659-d15f-4a61-accb-7d8703ad867a tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:26.271386 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-81c29c8d-d150-45b4-ba2d-540b0462d350 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1186818956", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "936faadb-2266-486c-9624-31976f3a3668"}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:31:26.271699 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-29ba8659-d15f-4a61-accb-7d8703ad867a tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:26.273094 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-29ba8659-d15f-4a61-accb-7d8703ad867a tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:26.273799 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-29ba8659-d15f-4a61-accb-7d8703ad867a tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:26.274463 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-29ba8659-d15f-4a61-accb-7d8703ad867a tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:26.403087 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-81c29c8d-d150-45b4-ba2d-540b0462d350 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] validate_networks() for [('936faadb-2266-486c-9624-31976f3a3668', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:31:26.417042 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-29ba8659-d15f-4a61-accb-7d8703ad867a tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd2e319840c4a8aab90b495374aa1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eba4d14f2004498850092bff100b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:26.429592 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-29ba8659-d15f-4a61-accb-7d8703ad867a tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] 10.222.0.13 "GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d" status: 200 len: 1251 microversion: 2.1 time: 0.188742 Oct 30 01:31:26.430861 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2028/4045] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:26 2022] GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d => generated 1251 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:26.441915 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-00e24c44-cfc1-4a04-b50c-a251f30b35b5 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44cc578820>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:27.131245 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-81c29c8d-d150-45b4-ba2d-540b0462d350 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:31:27.132517 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-81c29c8d-d150-45b4-ba2d-540b0462d350 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:31:27.133425 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-81c29c8d-d150-45b4-ba2d-540b0462d350 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:31:27.134135 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-81c29c8d-d150-45b4-ba2d-540b0462d350 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:31:27.134925 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-81c29c8d-d150-45b4-ba2d-540b0462d350 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:31:27.148926 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-81c29c8d-d150-45b4-ba2d-540b0462d350 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:27.154634 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-81c29c8d-d150-45b4-ba2d-540b0462d350 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:27.155290 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-81c29c8d-d150-45b4-ba2d-540b0462d350 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:27.156270 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-81c29c8d-d150-45b4-ba2d-540b0462d350 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:27.157017 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-81c29c8d-d150-45b4-ba2d-540b0462d350 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:27.157894 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-81c29c8d-d150-45b4-ba2d-540b0462d350 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:27.181027 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-81c29c8d-d150-45b4-ba2d-540b0462d350 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Getting quotas for project 45fe1c50eaee40249b6c20cc91e52586. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:31:27.192008 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-81c29c8d-d150-45b4-ba2d-540b0462d350 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Getting quotas for user ef5f8a3e6fef4d6393603575479b16a2 and project 45fe1c50eaee40249b6c20cc91e52586. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:31:27.210286 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-81c29c8d-d150-45b4-ba2d-540b0462d350 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:31:27.212892 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-81c29c8d-d150-45b4-ba2d-540b0462d350 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 1ed9a8e0-aee6-4785-86b8-3d5113a6c838] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:31:27.374640 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-81c29c8d-d150-45b4-ba2d-540b0462d350 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.115584 Oct 30 01:31:27.378074 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2018/4046] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:31:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1121 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:31:27.390623 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-05cd472e-2fc6-4876-899a-b328b6a82c27 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:27.393744 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-05cd472e-2fc6-4876-899a-b328b6a82c27 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:27.519879 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-05cd472e-2fc6-4876-899a-b328b6a82c27 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:27.546252 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-05cd472e-2fc6-4876-899a-b328b6a82c27 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1215 microversion: 2.1 time: 0.153483 Oct 30 01:31:27.548681 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2019/4047] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:27 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1215 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:27.562970 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8486f7be-ba60-4748-8500-6da25a5428a1 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:27.564663 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8486f7be-ba60-4748-8500-6da25a5428a1 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] [instance: 1f9c8547-e0cb-4094-a15e-d21166bda1d2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:27.586614 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8486f7be-ba60-4748-8500-6da25a5428a1 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:27.587125 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8486f7be-ba60-4748-8500-6da25a5428a1 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:27.587726 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8486f7be-ba60-4748-8500-6da25a5428a1 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:27.588573 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8486f7be-ba60-4748-8500-6da25a5428a1 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:27.589266 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8486f7be-ba60-4748-8500-6da25a5428a1 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:27.589929 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8486f7be-ba60-4748-8500-6da25a5428a1 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:27.952158 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8486f7be-ba60-4748-8500-6da25a5428a1 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec278d8d7b4a5a96af042ba613bafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc4c8f707304cd98a5f2e13cb1d5a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:27.966619 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8486f7be-ba60-4748-8500-6da25a5428a1 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] 10.222.0.13 "GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2" status: 200 len: 1522 microversion: 2.1 time: 0.415523 Oct 30 01:31:27.967762 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2020/4048] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:27 2022] GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2 => generated 1522 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:27.973438 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8589fe84-8d72-474a-9d32-29e3c7f72166 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:27.974382 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8589fe84-8d72-474a-9d32-29e3c7f72166 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:28.009231 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8589fe84-8d72-474a-9d32-29e3c7f72166 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:28.010066 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8589fe84-8d72-474a-9d32-29e3c7f72166 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:28.010707 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8589fe84-8d72-474a-9d32-29e3c7f72166 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:28.012677 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8589fe84-8d72-474a-9d32-29e3c7f72166 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:28.013188 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8589fe84-8d72-474a-9d32-29e3c7f72166 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:28.014999 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8589fe84-8d72-474a-9d32-29e3c7f72166 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:28.348587 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8589fe84-8d72-474a-9d32-29e3c7f72166 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:28.374345 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8589fe84-8d72-474a-9d32-29e3c7f72166 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0" status: 200 len: 1738 microversion: 2.1 time: 0.405218 Oct 30 01:31:28.377011 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2021/4049] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:27 2022] GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0 => generated 1738 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:28.401406 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cd9fa096-d75a-4437-aa71-9cd911dc4a7e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:28.402419 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-cd9fa096-d75a-4437-aa71-9cd911dc4a7e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 1ed9a8e0-aee6-4785-86b8-3d5113a6c838] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:28.447570 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-00e24c44-cfc1-4a04-b50c-a251f30b35b5 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "DELETE /compute/v2.1/images/0771e672-b021-4747-b3e1-a12f87a748f5" status: 204 len: 0 microversion: 2.1 time: 2.015365 Oct 30 01:31:28.448144 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2029/4050] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:26 2022] DELETE /compute/v2.1/images/0771e672-b021-4747-b3e1-a12f87a748f5 => generated 0 bytes in 2017 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:31:28.453301 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7748d487-72d4-4333-be46-cd01f491a3b9 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:28.453939 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7748d487-72d4-4333-be46-cd01f491a3b9 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] [instance: 78081c7e-04f6-468e-9a0d-3c74c1092c6d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:28.467885 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7748d487-72d4-4333-be46-cd01f491a3b9 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:28.468684 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7748d487-72d4-4333-be46-cd01f491a3b9 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:28.469475 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7748d487-72d4-4333-be46-cd01f491a3b9 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:28.470413 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7748d487-72d4-4333-be46-cd01f491a3b9 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:28.471038 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7748d487-72d4-4333-be46-cd01f491a3b9 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:28.471632 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7748d487-72d4-4333-be46-cd01f491a3b9 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:28.510033 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-cd9fa096-d75a-4437-aa71-9cd911dc4a7e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:28.525504 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cd9fa096-d75a-4437-aa71-9cd911dc4a7e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/1ed9a8e0-aee6-4785-86b8-3d5113a6c838" status: 200 len: 1209 microversion: 2.1 time: 0.145583 Oct 30 01:31:28.526247 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2022/4051] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:28 2022] GET /compute/v2.1/servers/1ed9a8e0-aee6-4785-86b8-3d5113a6c838 => generated 1209 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:28.545798 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3b4427bf-6b09-42dc-969d-ce8774ea7d44 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44c7e32160>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:28.582598 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7748d487-72d4-4333-be46-cd01f491a3b9 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd2e319840c4a8aab90b495374aa1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eba4d14f2004498850092bff100b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:28.601239 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7748d487-72d4-4333-be46-cd01f491a3b9 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] 10.222.0.13 "GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d" status: 200 len: 1251 microversion: 2.1 time: 0.151700 Oct 30 01:31:28.614485 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2030/4052] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:28 2022] GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d => generated 1251 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:28.623581 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-448c155e-1422-4349-b95e-69a9552475e1 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:28.624456 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-448c155e-1422-4349-b95e-69a9552475e1 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:28.631384 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-448c155e-1422-4349-b95e-69a9552475e1 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:28.631877 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-448c155e-1422-4349-b95e-69a9552475e1 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:28.632314 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-448c155e-1422-4349-b95e-69a9552475e1 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:28.633074 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-448c155e-1422-4349-b95e-69a9552475e1 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:28.633601 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-448c155e-1422-4349-b95e-69a9552475e1 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:28.634177 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-448c155e-1422-4349-b95e-69a9552475e1 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:28.810154 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-448c155e-1422-4349-b95e-69a9552475e1 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:28.836119 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:31:28.852131 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-448c155e-1422-4349-b95e-69a9552475e1 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1211 microversion: 2.1 time: 0.235241 Oct 30 01:31:28.855039 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2031/4053] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:28 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1211 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:28.991091 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c98eaf1a-2a96-4e0e-8bea-ad78b11e288c tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:28.991870 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c98eaf1a-2a96-4e0e-8bea-ad78b11e288c tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] [instance: 1f9c8547-e0cb-4094-a15e-d21166bda1d2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:29.005157 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c98eaf1a-2a96-4e0e-8bea-ad78b11e288c tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:29.013685 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c98eaf1a-2a96-4e0e-8bea-ad78b11e288c tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:29.013685 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c98eaf1a-2a96-4e0e-8bea-ad78b11e288c tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:29.013685 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c98eaf1a-2a96-4e0e-8bea-ad78b11e288c tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:29.013685 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c98eaf1a-2a96-4e0e-8bea-ad78b11e288c tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:29.013685 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c98eaf1a-2a96-4e0e-8bea-ad78b11e288c tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:29.270463 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c98eaf1a-2a96-4e0e-8bea-ad78b11e288c tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec278d8d7b4a5a96af042ba613bafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc4c8f707304cd98a5f2e13cb1d5a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:29.282137 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c98eaf1a-2a96-4e0e-8bea-ad78b11e288c tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] 10.222.0.13 "GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2" status: 200 len: 1522 microversion: 2.1 time: 0.296041 Oct 30 01:31:29.283186 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2032/4054] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:28 2022] GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2 => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:31:29.403440 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0b7af906-96ca-4bf7-aaa0-03a6b7079be0 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:29.404050 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0b7af906-96ca-4bf7-aaa0-03a6b7079be0 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:29.415544 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b7af906-96ca-4bf7-aaa0-03a6b7079be0 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:29.419493 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b7af906-96ca-4bf7-aaa0-03a6b7079be0 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:29.420053 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b7af906-96ca-4bf7-aaa0-03a6b7079be0 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:29.423119 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b7af906-96ca-4bf7-aaa0-03a6b7079be0 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:29.423613 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b7af906-96ca-4bf7-aaa0-03a6b7079be0 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:29.433515 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b7af906-96ca-4bf7-aaa0-03a6b7079be0 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:29.611741 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0b7af906-96ca-4bf7-aaa0-03a6b7079be0 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:29.621010 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0b7af906-96ca-4bf7-aaa0-03a6b7079be0 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0" status: 200 len: 1738 microversion: 2.1 time: 0.222013 Oct 30 01:31:29.633837 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2033/4055] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:29 2022] GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0 => generated 1738 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:31:29.647865 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-430a7189-2e38-46b4-8200-3075aef8abd5 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:29.648503 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-430a7189-2e38-46b4-8200-3075aef8abd5 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 1ed9a8e0-aee6-4785-86b8-3d5113a6c838] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:29.655603 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-430a7189-2e38-46b4-8200-3075aef8abd5 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:29.656572 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-430a7189-2e38-46b4-8200-3075aef8abd5 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:29.657205 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-430a7189-2e38-46b4-8200-3075aef8abd5 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:29.658294 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-430a7189-2e38-46b4-8200-3075aef8abd5 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:29.665422 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-430a7189-2e38-46b4-8200-3075aef8abd5 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:29.665422 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-430a7189-2e38-46b4-8200-3075aef8abd5 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:29.779182 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-430a7189-2e38-46b4-8200-3075aef8abd5 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:29.790401 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-430a7189-2e38-46b4-8200-3075aef8abd5 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/1ed9a8e0-aee6-4785-86b8-3d5113a6c838" status: 200 len: 1205 microversion: 2.1 time: 0.148749 Oct 30 01:31:29.792233 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2034/4056] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:29 2022] GET /compute/v2.1/servers/1ed9a8e0-aee6-4785-86b8-3d5113a6c838 => generated 1205 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:29.803919 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3b5e3da0-534d-45f4-8e5d-67361301db17 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:29.808235 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3b5e3da0-534d-45f4-8e5d-67361301db17 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] [instance: 78081c7e-04f6-468e-9a0d-3c74c1092c6d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:29.818245 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3b5e3da0-534d-45f4-8e5d-67361301db17 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:29.818731 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3b5e3da0-534d-45f4-8e5d-67361301db17 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:29.819162 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3b5e3da0-534d-45f4-8e5d-67361301db17 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:29.819893 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3b5e3da0-534d-45f4-8e5d-67361301db17 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:29.820341 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3b5e3da0-534d-45f4-8e5d-67361301db17 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:29.820758 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3b5e3da0-534d-45f4-8e5d-67361301db17 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:29.904280 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3b5e3da0-534d-45f4-8e5d-67361301db17 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd2e319840c4a8aab90b495374aa1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eba4d14f2004498850092bff100b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:29.914579 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3b5e3da0-534d-45f4-8e5d-67361301db17 tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] 10.222.0.13 "GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d" status: 200 len: 1251 microversion: 2.1 time: 0.119918 Oct 30 01:31:29.915528 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2035/4057] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:29 2022] GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d => generated 1251 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:29.937781 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a19c7984-ca01-41eb-a4ee-07b017bf36bb tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:29.939957 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a19c7984-ca01-41eb-a4ee-07b017bf36bb tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:29.948503 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a19c7984-ca01-41eb-a4ee-07b017bf36bb tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:29.950258 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a19c7984-ca01-41eb-a4ee-07b017bf36bb tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:29.950258 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a19c7984-ca01-41eb-a4ee-07b017bf36bb tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:29.950486 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a19c7984-ca01-41eb-a4ee-07b017bf36bb tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:29.951209 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a19c7984-ca01-41eb-a4ee-07b017bf36bb tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:29.951719 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a19c7984-ca01-41eb-a4ee-07b017bf36bb tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:30.187646 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a19c7984-ca01-41eb-a4ee-07b017bf36bb tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:30.198244 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a19c7984-ca01-41eb-a4ee-07b017bf36bb tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1267 microversion: 2.1 time: 0.266266 Oct 30 01:31:30.199648 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2036/4058] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:29 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1267 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:30.309526 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-00dea307-2fdd-434f-a9d6-7b1816a37180 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:30.310436 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-00dea307-2fdd-434f-a9d6-7b1816a37180 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] [instance: 1f9c8547-e0cb-4094-a15e-d21166bda1d2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:30.324172 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00dea307-2fdd-434f-a9d6-7b1816a37180 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:30.325382 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00dea307-2fdd-434f-a9d6-7b1816a37180 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:30.326099 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00dea307-2fdd-434f-a9d6-7b1816a37180 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:30.327318 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00dea307-2fdd-434f-a9d6-7b1816a37180 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:30.327972 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00dea307-2fdd-434f-a9d6-7b1816a37180 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:30.328279 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00dea307-2fdd-434f-a9d6-7b1816a37180 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:30.341760 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3b4427bf-6b09-42dc-969d-ce8774ea7d44 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "DELETE /compute/v2.1/images/4a8ff4c8-f218-485b-92fe-96a06e70b7b0" status: 204 len: 0 microversion: 2.1 time: 1.812735 Oct 30 01:31:30.346062 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2023/4059] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:28 2022] DELETE /compute/v2.1/images/4a8ff4c8-f218-485b-92fe-96a06e70b7b0 => generated 0 bytes in 1816 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:31:30.357945 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6752f153-67e2-4d42-a643-88b656faa0f6 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44c7cf0f70>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:30.615920 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-00dea307-2fdd-434f-a9d6-7b1816a37180 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec278d8d7b4a5a96af042ba613bafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc4c8f707304cd98a5f2e13cb1d5a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:30.625579 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-00dea307-2fdd-434f-a9d6-7b1816a37180 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] 10.222.0.13 "GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2" status: 200 len: 1502 microversion: 2.1 time: 0.321724 Oct 30 01:31:30.626358 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2037/4060] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:30 2022] GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2 => generated 1502 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:30.648800 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-dd578ef9-596c-4cbe-8896-bb5f14ad3457 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:30.651595 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-dd578ef9-596c-4cbe-8896-bb5f14ad3457 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:30.667009 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dd578ef9-596c-4cbe-8896-bb5f14ad3457 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:30.679836 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dd578ef9-596c-4cbe-8896-bb5f14ad3457 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:30.689549 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dd578ef9-596c-4cbe-8896-bb5f14ad3457 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:30.692727 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dd578ef9-596c-4cbe-8896-bb5f14ad3457 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:30.693656 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dd578ef9-596c-4cbe-8896-bb5f14ad3457 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:30.694279 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dd578ef9-596c-4cbe-8896-bb5f14ad3457 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:30.974222 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-dd578ef9-596c-4cbe-8896-bb5f14ad3457 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:30.984131 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-dd578ef9-596c-4cbe-8896-bb5f14ad3457 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0" status: 200 len: 1738 microversion: 2.1 time: 0.339428 Oct 30 01:31:31.010353 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2038/4061] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:30 2022] GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0 => generated 1738 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:31:31.017290 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-809fd78d-92bb-4e9f-91a6-8a7b75a7ef62 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Action: 'create', calling method: .version_select at 0x7f44d0523940>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1072790943", "description": "tempest-description-330845087"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:31:31.557646 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-809fd78d-92bb-4e9f-91a6-8a7b75a7ef62 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.545983 Oct 30 01:31:31.558690 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2039/4062] 10.222.0.13 () {60 vars in 1180 bytes} [Sun Oct 30 01:31:31 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:31:31.564214 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7b9ca171-1cb5-4fa3-a365-37076ecf06c0 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:31.565141 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7b9ca171-1cb5-4fa3-a365-37076ecf06c0 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 1ed9a8e0-aee6-4785-86b8-3d5113a6c838] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:31.579943 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b9ca171-1cb5-4fa3-a365-37076ecf06c0 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:31.581855 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b9ca171-1cb5-4fa3-a365-37076ecf06c0 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:31.583209 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b9ca171-1cb5-4fa3-a365-37076ecf06c0 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:31.584844 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b9ca171-1cb5-4fa3-a365-37076ecf06c0 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:31.586730 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b9ca171-1cb5-4fa3-a365-37076ecf06c0 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:31.587426 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b9ca171-1cb5-4fa3-a365-37076ecf06c0 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:31.701743 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7b9ca171-1cb5-4fa3-a365-37076ecf06c0 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:31.706855 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7b9ca171-1cb5-4fa3-a365-37076ecf06c0 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/1ed9a8e0-aee6-4785-86b8-3d5113a6c838" status: 200 len: 1279 microversion: 2.1 time: 0.146647 Oct 30 01:31:31.708265 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2040/4063] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:31 2022] GET /compute/v2.1/servers/1ed9a8e0-aee6-4785-86b8-3d5113a6c838 => generated 1279 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:31.713646 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ec07ae6c-193a-4c78-89ba-ebcd3ef91ddd tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:31.714647 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ec07ae6c-193a-4c78-89ba-ebcd3ef91ddd tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] [instance: 78081c7e-04f6-468e-9a0d-3c74c1092c6d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:31.722076 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ec07ae6c-193a-4c78-89ba-ebcd3ef91ddd tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:31.722902 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ec07ae6c-193a-4c78-89ba-ebcd3ef91ddd tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:31.723572 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ec07ae6c-193a-4c78-89ba-ebcd3ef91ddd tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:31.736185 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ec07ae6c-193a-4c78-89ba-ebcd3ef91ddd tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:31.736185 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ec07ae6c-193a-4c78-89ba-ebcd3ef91ddd tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:31.736185 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ec07ae6c-193a-4c78-89ba-ebcd3ef91ddd tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:31.820963 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ec07ae6c-193a-4c78-89ba-ebcd3ef91ddd tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd2e319840c4a8aab90b495374aa1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eba4d14f2004498850092bff100b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:31.829603 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ec07ae6c-193a-4c78-89ba-ebcd3ef91ddd tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] 10.222.0.13 "GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d" status: 200 len: 1251 microversion: 2.1 time: 0.119978 Oct 30 01:31:31.830766 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2041/4064] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:31 2022] GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d => generated 1251 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:31.836950 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b99989a9-c4fb-401f-829b-72b205a6c494 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:31.842888 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6752f153-67e2-4d42-a643-88b656faa0f6 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "DELETE /compute/v2.1/images/89bf1d5a-9053-4405-a355-19a4ae907b0a" status: 204 len: 0 microversion: 2.1 time: 1.491951 Oct 30 01:31:31.842888 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2024/4065] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:30 2022] DELETE /compute/v2.1/images/89bf1d5a-9053-4405-a355-19a4ae907b0a => generated 0 bytes in 1494 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:31:31.849404 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1850c363-e061-4272-9fd4-bbc15dbc1248 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1072790943"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:31:31.850451 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1850c363-e061-4272-9fd4-bbc15dbc1248 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] [instance: 1f9c8547-e0cb-4094-a15e-d21166bda1d2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:31.853188 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b99989a9-c4fb-401f-829b-72b205a6c494 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:31.863906 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1850c363-e061-4272-9fd4-bbc15dbc1248 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:31.865686 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1850c363-e061-4272-9fd4-bbc15dbc1248 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:31.866967 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1850c363-e061-4272-9fd4-bbc15dbc1248 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:31.868309 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1850c363-e061-4272-9fd4-bbc15dbc1248 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:31.868775 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b99989a9-c4fb-401f-829b-72b205a6c494 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:31.869555 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b99989a9-c4fb-401f-829b-72b205a6c494 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:31.870309 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1850c363-e061-4272-9fd4-bbc15dbc1248 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:31.871047 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b99989a9-c4fb-401f-829b-72b205a6c494 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:31.871796 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1850c363-e061-4272-9fd4-bbc15dbc1248 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:31.872822 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b99989a9-c4fb-401f-829b-72b205a6c494 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:31.874935 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b99989a9-c4fb-401f-829b-72b205a6c494 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:31.875754 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b99989a9-c4fb-401f-829b-72b205a6c494 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:32.205637 n-d-master-1 devstack@n-api.service[121103]: INFO nova.network.security_group_api [None req-1850c363-e061-4272-9fd4-bbc15dbc1248 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Adding security group 6692fdf2-d7fc-46ce-a911-97670349d390 to port bb118f0b-7010-4f9e-8bc1-93d4fa2233ad Oct 30 01:31:32.306561 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b99989a9-c4fb-401f-829b-72b205a6c494 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:32.326391 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b99989a9-c4fb-401f-829b-72b205a6c494 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1315 microversion: 2.1 time: 0.493992 Oct 30 01:31:32.327444 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2042/4066] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:31 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1315 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:32.335507 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c1e9b432-7489-4443-82f7-136f2dfaf1cc tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:32.338117 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c1e9b432-7489-4443-82f7-136f2dfaf1cc tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] [instance: 99db82dd-3238-4af1-9f90-1dd69cdd836a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:32.348934 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c1e9b432-7489-4443-82f7-136f2dfaf1cc tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:32.349786 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c1e9b432-7489-4443-82f7-136f2dfaf1cc tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:32.350552 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c1e9b432-7489-4443-82f7-136f2dfaf1cc tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:32.352190 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c1e9b432-7489-4443-82f7-136f2dfaf1cc tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:32.352873 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c1e9b432-7489-4443-82f7-136f2dfaf1cc tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:32.353985 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c1e9b432-7489-4443-82f7-136f2dfaf1cc tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:32.398307 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:31:32.408604 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c1e9b432-7489-4443-82f7-136f2dfaf1cc tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] [instance: 99db82dd-3238-4af1-9f90-1dd69cdd836a] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:31:32.827828 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c1e9b432-7489-4443-82f7-136f2dfaf1cc tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "DELETE /compute/v2.1/servers/99db82dd-3238-4af1-9f90-1dd69cdd836a" status: 204 len: 0 microversion: 2.1 time: 0.494973 Oct 30 01:31:32.827828 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2043/4067] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:31:32 2022] DELETE /compute/v2.1/servers/99db82dd-3238-4af1-9f90-1dd69cdd836a => generated 0 bytes in 496 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:31:32.832437 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4d7086bb-0f35-43ed-87b3-1952a2714bbd tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:32.833172 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4d7086bb-0f35-43ed-87b3-1952a2714bbd tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:32.843378 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d7086bb-0f35-43ed-87b3-1952a2714bbd tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:32.843883 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d7086bb-0f35-43ed-87b3-1952a2714bbd tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:32.844328 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d7086bb-0f35-43ed-87b3-1952a2714bbd tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:32.845074 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d7086bb-0f35-43ed-87b3-1952a2714bbd tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:32.855113 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d7086bb-0f35-43ed-87b3-1952a2714bbd tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:32.855718 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d7086bb-0f35-43ed-87b3-1952a2714bbd tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:32.984463 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1850c363-e061-4272-9fd4-bbc15dbc1248 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] 10.222.0.13 "POST /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2/action" status: 202 len: 0 microversion: 2.1 time: 1.131230 Oct 30 01:31:32.984463 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2025/4068] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:31:31 2022] POST /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2/action => generated 0 bytes in 1139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:31:32.994551 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-60ccae59-977f-44db-af23-7237f8194ace tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:32.995520 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-60ccae59-977f-44db-af23-7237f8194ace tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 1ed9a8e0-aee6-4785-86b8-3d5113a6c838] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:33.002607 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-60ccae59-977f-44db-af23-7237f8194ace tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:33.003449 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-60ccae59-977f-44db-af23-7237f8194ace tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:33.007066 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-60ccae59-977f-44db-af23-7237f8194ace tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:33.009598 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-60ccae59-977f-44db-af23-7237f8194ace tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:33.024277 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-60ccae59-977f-44db-af23-7237f8194ace tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:33.025857 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-60ccae59-977f-44db-af23-7237f8194ace tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:33.326388 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4d7086bb-0f35-43ed-87b3-1952a2714bbd tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:33.342958 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4d7086bb-0f35-43ed-87b3-1952a2714bbd tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0" status: 200 len: 1738 microversion: 2.1 time: 0.515530 Oct 30 01:31:33.343856 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2044/4069] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:32 2022] GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0 => generated 1738 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:33.350946 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-af254c50-3901-49c2-8e34-10d99fa6120d tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:33.354455 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-af254c50-3901-49c2-8e34-10d99fa6120d tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] [instance: 99db82dd-3238-4af1-9f90-1dd69cdd836a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:33.368638 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af254c50-3901-49c2-8e34-10d99fa6120d tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:33.374628 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af254c50-3901-49c2-8e34-10d99fa6120d tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:33.375340 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af254c50-3901-49c2-8e34-10d99fa6120d tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:33.376306 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af254c50-3901-49c2-8e34-10d99fa6120d tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:33.376931 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af254c50-3901-49c2-8e34-10d99fa6120d tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:33.377569 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af254c50-3901-49c2-8e34-10d99fa6120d tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:33.533070 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-60ccae59-977f-44db-af23-7237f8194ace tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:33.547572 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-60ccae59-977f-44db-af23-7237f8194ace tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/1ed9a8e0-aee6-4785-86b8-3d5113a6c838" status: 200 len: 1309 microversion: 2.1 time: 0.563289 Oct 30 01:31:33.548640 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2026/4070] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:32 2022] GET /compute/v2.1/servers/1ed9a8e0-aee6-4785-86b8-3d5113a6c838 => generated 1309 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:33.566368 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-207d75ac-905d-4e26-992c-7016b06e159c tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:33.567388 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-207d75ac-905d-4e26-992c-7016b06e159c tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] [instance: 78081c7e-04f6-468e-9a0d-3c74c1092c6d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:33.584427 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-207d75ac-905d-4e26-992c-7016b06e159c tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:33.585137 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-207d75ac-905d-4e26-992c-7016b06e159c tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:33.585809 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-207d75ac-905d-4e26-992c-7016b06e159c tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:33.589190 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-207d75ac-905d-4e26-992c-7016b06e159c tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:33.589884 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-207d75ac-905d-4e26-992c-7016b06e159c tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:33.590509 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-207d75ac-905d-4e26-992c-7016b06e159c tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:33.671362 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-207d75ac-905d-4e26-992c-7016b06e159c tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:33.671888 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-207d75ac-905d-4e26-992c-7016b06e159c tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:33.672301 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-207d75ac-905d-4e26-992c-7016b06e159c tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:33.675079 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-207d75ac-905d-4e26-992c-7016b06e159c tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lazy-loading 'fault' on Instance uuid 78081c7e-04f6-468e-9a0d-3c74c1092c6d {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:31:33.763473 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-207d75ac-905d-4e26-992c-7016b06e159c tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd2e319840c4a8aab90b495374aa1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eba4d14f2004498850092bff100b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:33.774750 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-207d75ac-905d-4e26-992c-7016b06e159c tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] 10.222.0.13 "GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d" status: 200 len: 1256 microversion: 2.1 time: 0.223491 Oct 30 01:31:33.775355 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2027/4071] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:33 2022] GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d => generated 1256 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:33.781972 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8599c7db-e57c-4117-99e0-a657a1d40bff tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1072790943"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:31:33.782812 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8599c7db-e57c-4117-99e0-a657a1d40bff tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] [instance: 1f9c8547-e0cb-4094-a15e-d21166bda1d2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:33.800783 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8599c7db-e57c-4117-99e0-a657a1d40bff tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:33.801966 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-af254c50-3901-49c2-8e34-10d99fa6120d tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea8a24166674250a98268ae52604f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcce1fadf54d089ec4fd751a3cf6ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:33.802779 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8599c7db-e57c-4117-99e0-a657a1d40bff tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:33.803618 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8599c7db-e57c-4117-99e0-a657a1d40bff tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:33.804813 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8599c7db-e57c-4117-99e0-a657a1d40bff tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:33.806383 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8599c7db-e57c-4117-99e0-a657a1d40bff tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:33.807045 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8599c7db-e57c-4117-99e0-a657a1d40bff tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:33.812871 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-af254c50-3901-49c2-8e34-10d99fa6120d tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/servers/99db82dd-3238-4af1-9f90-1dd69cdd836a" status: 200 len: 1473 microversion: 2.1 time: 0.466399 Oct 30 01:31:33.813896 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2045/4072] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:33 2022] GET /compute/v2.1/servers/99db82dd-3238-4af1-9f90-1dd69cdd836a => generated 1473 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:33.818775 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-dcc26f61-853f-4cd4-af24-a5fab1631c9f req-e64f8a06-2874-4663-8095-5b3f498aaac1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f9c8547-e0cb-4094-a15e-d21166bda1d2", "tag": "bb118f0b-7010-4f9e-8bc1-93d4fa2233ad"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:31:33.842778 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-dcc26f61-853f-4cd4-af24-a5fab1631c9f req-e64f8a06-2874-4663-8095-5b3f498aaac1 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:33.843368 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-dcc26f61-853f-4cd4-af24-a5fab1631c9f req-e64f8a06-2874-4663-8095-5b3f498aaac1 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:33.846981 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-dcc26f61-853f-4cd4-af24-a5fab1631c9f req-e64f8a06-2874-4663-8095-5b3f498aaac1 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:33.860734 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-dcc26f61-853f-4cd4-af24-a5fab1631c9f req-e64f8a06-2874-4663-8095-5b3f498aaac1 service nova] Creating event network-changed:bb118f0b-7010-4f9e-8bc1-93d4fa2233ad for instance 1f9c8547-e0cb-4094-a15e-d21166bda1d2 on n-h1-master-1 Oct 30 01:31:33.867240 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-dcc26f61-853f-4cd4-af24-a5fab1631c9f req-e64f8a06-2874-4663-8095-5b3f498aaac1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051882 Oct 30 01:31:33.872520 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2046/4073] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:31:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:31:33.887950 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4a147828-d02f-4f14-9e6f-2bf582f16956 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:33.888672 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4a147828-d02f-4f14-9e6f-2bf582f16956 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:33.904958 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a147828-d02f-4f14-9e6f-2bf582f16956 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:33.905573 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a147828-d02f-4f14-9e6f-2bf582f16956 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:33.905990 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a147828-d02f-4f14-9e6f-2bf582f16956 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:33.906721 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a147828-d02f-4f14-9e6f-2bf582f16956 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:33.911237 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a147828-d02f-4f14-9e6f-2bf582f16956 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:33.912250 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a147828-d02f-4f14-9e6f-2bf582f16956 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:34.074108 n-d-master-1 devstack@n-api.service[121103]: INFO nova.network.security_group_api [None req-8599c7db-e57c-4117-99e0-a657a1d40bff tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Removing security group 6692fdf2-d7fc-46ce-a911-97670349d390 from port bb118f0b-7010-4f9e-8bc1-93d4fa2233ad Oct 30 01:31:34.426694 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4a147828-d02f-4f14-9e6f-2bf582f16956 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:34.450857 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4a147828-d02f-4f14-9e6f-2bf582f16956 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1315 microversion: 2.1 time: 0.576018 Oct 30 01:31:34.456373 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2047/4074] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:33 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1315 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:34.467984 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8c77b70e-66ba-4e8e-8044-1f45756a057a tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:34.468909 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8c77b70e-66ba-4e8e-8044-1f45756a057a tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:34.499917 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8c77b70e-66ba-4e8e-8044-1f45756a057a tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:34.500768 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8c77b70e-66ba-4e8e-8044-1f45756a057a tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:34.503861 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8c77b70e-66ba-4e8e-8044-1f45756a057a tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:34.505246 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8c77b70e-66ba-4e8e-8044-1f45756a057a tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:34.506142 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8c77b70e-66ba-4e8e-8044-1f45756a057a tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:34.507654 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8c77b70e-66ba-4e8e-8044-1f45756a057a tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:35.352337 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8c77b70e-66ba-4e8e-8044-1f45756a057a tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:35.367385 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8c77b70e-66ba-4e8e-8044-1f45756a057a tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0" status: 200 len: 1738 microversion: 2.1 time: 0.904364 Oct 30 01:31:35.369188 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2048/4075] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:34 2022] GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0 => generated 1738 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:35.375324 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a7a1002c-4b46-4121-8e87-6c8f1798ce68 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:35.376250 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a7a1002c-4b46-4121-8e87-6c8f1798ce68 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 1ed9a8e0-aee6-4785-86b8-3d5113a6c838] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:35.386776 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7a1002c-4b46-4121-8e87-6c8f1798ce68 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:35.387807 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7a1002c-4b46-4121-8e87-6c8f1798ce68 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:35.388464 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7a1002c-4b46-4121-8e87-6c8f1798ce68 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:35.389549 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7a1002c-4b46-4121-8e87-6c8f1798ce68 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:35.390243 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7a1002c-4b46-4121-8e87-6c8f1798ce68 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:35.391157 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7a1002c-4b46-4121-8e87-6c8f1798ce68 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:35.693347 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8599c7db-e57c-4117-99e0-a657a1d40bff tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] 10.222.0.13 "POST /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2/action" status: 202 len: 0 microversion: 2.1 time: 1.915804 Oct 30 01:31:35.696548 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2028/4076] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:31:33 2022] POST /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2/action => generated 0 bytes in 1920 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:31:35.711424 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e34b1d97-ec96-4f4b-842e-e97297c4031e tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:35.712770 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e34b1d97-ec96-4f4b-842e-e97297c4031e tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] [instance: 78081c7e-04f6-468e-9a0d-3c74c1092c6d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:35.728651 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e34b1d97-ec96-4f4b-842e-e97297c4031e tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:35.729570 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e34b1d97-ec96-4f4b-842e-e97297c4031e tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:35.730340 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e34b1d97-ec96-4f4b-842e-e97297c4031e tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:35.732168 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e34b1d97-ec96-4f4b-842e-e97297c4031e tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:35.733604 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e34b1d97-ec96-4f4b-842e-e97297c4031e tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:35.734902 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e34b1d97-ec96-4f4b-842e-e97297c4031e tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:35.760120 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-e34b1d97-ec96-4f4b-842e-e97297c4031e tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] HTTP exception thrown: Instance 78081c7e-04f6-468e-9a0d-3c74c1092c6d could not be found. Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e34b1d97-ec96-4f4b-842e-e97297c4031e tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Request method failure captured: Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d HTTP/1.1 Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdMo41jLKSHJPxwlHX_QJCagIyd-QRcQ7QqBHHtWTNVtyHHAchU3ex31EQ--E1HsaIy79m4lEOVdudUBCnyKZnLj0BQE07baUNZ0G2TaNv_bry0gC_bCR-TNKCPPdMxBBDiAgs4m1XPMF1bSUa5y0Nerb1lo3c7ZKnCYkNBw0xQ5iuc Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 0eba4d14f2004498850092bff100b757 Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersTestBootFromVolume-2092750802 Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0eba4d14f2004498850092bff100b757"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0eba4d14f2004498850092bff100b757"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0eba4d14f2004498850092bff100b757"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0eba4d14f2004498850092bff100b757"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersTestBootFromVolume-2092750802 Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 0eba4d14f2004498850092bff100b757 Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersTestBootFromVolume-2092750802 Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersTestBootFromVolume-2092750802-project Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 2fd2e319840c4a8aab90b495374aa1d2 Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersTestBootFromVolume-2092750802-project Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 78081c7e-04f6-468e-9a0d-3c74c1092c6d could not be found. Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '78081c7e-04f6-468e-9a0d-3c74c1092c6d'} Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78081c7e-04f6-468e-9a0d-3c74c1092c6d could not be found. Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78081c7e-04f6-468e-9a0d-3c74c1092c6d could not be found. Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:31:35.764028 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:31:35.770090 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:31:35.770090 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:31:35.770090 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:31:35.770090 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:31:35.770090 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:31:35.770090 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78081c7e-04f6-468e-9a0d-3c74c1092c6d could not be found. Oct 30 01:31:35.770090 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:31:35.770090 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e34b1d97-ec96-4f4b-842e-e97297c4031e tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Returning 404 to user: Instance 78081c7e-04f6-468e-9a0d-3c74c1092c6d could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:31:35.771458 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e34b1d97-ec96-4f4b-842e-e97297c4031e tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] 10.222.0.13 "GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d" status: 404 len: 111 microversion: 2.1 time: 0.073358 Oct 30 01:31:35.772558 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2029/4077] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:35 2022] GET /compute/v2.1/servers/78081c7e-04f6-468e-9a0d-3c74c1092c6d => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:31:35.780049 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-df1df09d-54a4-4ca0-80c2-3a67ff8e9ba5 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:35.780808 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-df1df09d-54a4-4ca0-80c2-3a67ff8e9ba5 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] [instance: 99db82dd-3238-4af1-9f90-1dd69cdd836a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:35.791774 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df1df09d-54a4-4ca0-80c2-3a67ff8e9ba5 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:35.792659 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df1df09d-54a4-4ca0-80c2-3a67ff8e9ba5 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:35.794673 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df1df09d-54a4-4ca0-80c2-3a67ff8e9ba5 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:35.796031 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df1df09d-54a4-4ca0-80c2-3a67ff8e9ba5 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:35.797040 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df1df09d-54a4-4ca0-80c2-3a67ff8e9ba5 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:35.798891 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df1df09d-54a4-4ca0-80c2-3a67ff8e9ba5 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:36.146803 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a7a1002c-4b46-4121-8e87-6c8f1798ce68 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:36.154998 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a7a1002c-4b46-4121-8e87-6c8f1798ce68 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/1ed9a8e0-aee6-4785-86b8-3d5113a6c838" status: 200 len: 1309 microversion: 2.1 time: 0.783719 Oct 30 01:31:36.169759 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2049/4078] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:35 2022] GET /compute/v2.1/servers/1ed9a8e0-aee6-4785-86b8-3d5113a6c838 => generated 1309 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:36.169759 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-b8e9b807-5d8f-4432-8025-43563b2198d3 req-5a2d8a85-c647-4036-b1a4-d076a3a79aab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ed9a8e0-aee6-4785-86b8-3d5113a6c838", "tag": "73950017-fffa-4c2f-ad1f-d656bc765f11"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:31:36.172925 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:31:36.183837 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-b8e9b807-5d8f-4432-8025-43563b2198d3 req-5a2d8a85-c647-4036-b1a4-d076a3a79aab service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:36.184567 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-b8e9b807-5d8f-4432-8025-43563b2198d3 req-5a2d8a85-c647-4036-b1a4-d076a3a79aab service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:36.185514 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-b8e9b807-5d8f-4432-8025-43563b2198d3 req-5a2d8a85-c647-4036-b1a4-d076a3a79aab service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:36.200428 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-b8e9b807-5d8f-4432-8025-43563b2198d3 req-5a2d8a85-c647-4036-b1a4-d076a3a79aab service nova] Creating event network-changed:73950017-fffa-4c2f-ad1f-d656bc765f11 for instance 1ed9a8e0-aee6-4785-86b8-3d5113a6c838 on n-h2-master-1 Oct 30 01:31:36.208262 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-b8e9b807-5d8f-4432-8025-43563b2198d3 req-5a2d8a85-c647-4036-b1a4-d076a3a79aab service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044294 Oct 30 01:31:36.209106 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2050/4079] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:31:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:31:36.215939 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-017e59d5-4d03-46a2-9d0a-24ba7f3c1966 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:36.220400 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-017e59d5-4d03-46a2-9d0a-24ba7f3c1966 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:36.229770 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-017e59d5-4d03-46a2-9d0a-24ba7f3c1966 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:36.230292 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-017e59d5-4d03-46a2-9d0a-24ba7f3c1966 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:36.230704 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-017e59d5-4d03-46a2-9d0a-24ba7f3c1966 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:36.232125 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-017e59d5-4d03-46a2-9d0a-24ba7f3c1966 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:36.233245 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-017e59d5-4d03-46a2-9d0a-24ba7f3c1966 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:36.233898 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-017e59d5-4d03-46a2-9d0a-24ba7f3c1966 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:36.531386 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-df1df09d-54a4-4ca0-80c2-3a67ff8e9ba5 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea8a24166674250a98268ae52604f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcce1fadf54d089ec4fd751a3cf6ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:36.540840 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-df1df09d-54a4-4ca0-80c2-3a67ff8e9ba5 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/servers/99db82dd-3238-4af1-9f90-1dd69cdd836a" status: 200 len: 1473 microversion: 2.1 time: 0.766385 Oct 30 01:31:36.541497 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2030/4080] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:35 2022] GET /compute/v2.1/servers/99db82dd-3238-4af1-9f90-1dd69cdd836a => generated 1473 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:36.546775 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b2e1bcfa-ab91-4f64-afdd-217105f28fd7 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Action: 'create', calling method: .version_select at 0x7f44cc704dc0>, body: {"pool": null} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:31:37.169994 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=6 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:31:37.199510 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-017e59d5-4d03-46a2-9d0a-24ba7f3c1966 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:37.211251 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-017e59d5-4d03-46a2-9d0a-24ba7f3c1966 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1315 microversion: 2.1 time: 1.000696 Oct 30 01:31:37.212748 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2051/4081] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:36 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1315 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:37.218573 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-50761a58-8b02-42da-809f-33a10e71c39f tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] Calling method '.version_select at 0x7f44cc60cc10>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:37.328452 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-50761a58-8b02-42da-809f-33a10e71c39f tempest-ServersTestBootFromVolume-2092750802 tempest-ServersTestBootFromVolume-2092750802-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-382050845" status: 202 len: 0 microversion: 2.1 time: 0.113818 Oct 30 01:31:37.333172 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2052/4082] 10.222.0.13 () {58 vars in 1218 bytes} [Sun Oct 30 01:31:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-382050845 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:31:37.339248 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-0651665e-2612-4430-b978-d336a72506f3 req-b3c2c310-18f6-40eb-8186-a092de2f6aaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0c51345-2948-4ff1-828f-8c70b2b979f2", "tag": "25297f9d-e65e-44db-bc94-b8ade234295f"}, {"name": "network-changed", "server_uuid": "1f9c8547-e0cb-4094-a15e-d21166bda1d2", "tag": "bb118f0b-7010-4f9e-8bc1-93d4fa2233ad"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:31:37.355814 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-0651665e-2612-4430-b978-d336a72506f3 req-b3c2c310-18f6-40eb-8186-a092de2f6aaf service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:37.356460 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-0651665e-2612-4430-b978-d336a72506f3 req-b3c2c310-18f6-40eb-8186-a092de2f6aaf service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:37.357351 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-0651665e-2612-4430-b978-d336a72506f3 req-b3c2c310-18f6-40eb-8186-a092de2f6aaf service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:37.377880 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-0651665e-2612-4430-b978-d336a72506f3 req-b3c2c310-18f6-40eb-8186-a092de2f6aaf service nova] Creating event network-changed:25297f9d-e65e-44db-bc94-b8ade234295f for instance b0c51345-2948-4ff1-828f-8c70b2b979f2 on n-h2-master-1 Oct 30 01:31:37.378867 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-0651665e-2612-4430-b978-d336a72506f3 req-b3c2c310-18f6-40eb-8186-a092de2f6aaf service nova] Creating event network-changed:bb118f0b-7010-4f9e-8bc1-93d4fa2233ad for instance 1f9c8547-e0cb-4094-a15e-d21166bda1d2 on n-h1-master-1 Oct 30 01:31:37.391074 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-0651665e-2612-4430-b978-d336a72506f3 req-b3c2c310-18f6-40eb-8186-a092de2f6aaf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.055910 Oct 30 01:31:37.392020 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2053/4083] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:31:37 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:31:37.399385 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-eac48ca5-07ac-4278-be61-fbddc50630bf tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:37.400365 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-eac48ca5-07ac-4278-be61-fbddc50630bf tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:37.408505 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eac48ca5-07ac-4278-be61-fbddc50630bf tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:37.409208 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eac48ca5-07ac-4278-be61-fbddc50630bf tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:37.410562 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eac48ca5-07ac-4278-be61-fbddc50630bf tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:37.411474 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eac48ca5-07ac-4278-be61-fbddc50630bf tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:37.412127 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eac48ca5-07ac-4278-be61-fbddc50630bf tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:37.412723 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eac48ca5-07ac-4278-be61-fbddc50630bf tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:37.862580 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-eac48ca5-07ac-4278-be61-fbddc50630bf tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:37.872863 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-eac48ca5-07ac-4278-be61-fbddc50630bf tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0" status: 200 len: 1738 microversion: 2.1 time: 0.479493 Oct 30 01:31:37.901899 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2054/4084] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:37 2022] GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0 => generated 1738 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:37.908828 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e7fff4aa-5e4a-40d3-8502-9a70c3e89e87 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:37.909513 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e7fff4aa-5e4a-40d3-8502-9a70c3e89e87 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 1ed9a8e0-aee6-4785-86b8-3d5113a6c838] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:37.921627 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e7fff4aa-5e4a-40d3-8502-9a70c3e89e87 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:37.922254 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e7fff4aa-5e4a-40d3-8502-9a70c3e89e87 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:37.922751 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e7fff4aa-5e4a-40d3-8502-9a70c3e89e87 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:37.923581 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e7fff4aa-5e4a-40d3-8502-9a70c3e89e87 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:37.924551 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e7fff4aa-5e4a-40d3-8502-9a70c3e89e87 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:37.925116 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e7fff4aa-5e4a-40d3-8502-9a70c3e89e87 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:38.516050 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=18 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:31:38.582801 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e7fff4aa-5e4a-40d3-8502-9a70c3e89e87 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:38.590842 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e7fff4aa-5e4a-40d3-8502-9a70c3e89e87 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/1ed9a8e0-aee6-4785-86b8-3d5113a6c838" status: 200 len: 1309 microversion: 2.1 time: 0.687753 Oct 30 01:31:38.606540 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2055/4085] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:37 2022] GET /compute/v2.1/servers/1ed9a8e0-aee6-4785-86b8-3d5113a6c838 => generated 1309 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:38.613810 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0034a785-cd69-4646-b6d5-31409433b326 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:38.614715 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0034a785-cd69-4646-b6d5-31409433b326 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] [instance: 99db82dd-3238-4af1-9f90-1dd69cdd836a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:38.621437 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0034a785-cd69-4646-b6d5-31409433b326 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:38.622182 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0034a785-cd69-4646-b6d5-31409433b326 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:38.622813 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0034a785-cd69-4646-b6d5-31409433b326 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:38.623756 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0034a785-cd69-4646-b6d5-31409433b326 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:38.624378 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0034a785-cd69-4646-b6d5-31409433b326 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:38.625029 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0034a785-cd69-4646-b6d5-31409433b326 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:38.792171 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0034a785-cd69-4646-b6d5-31409433b326 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea8a24166674250a98268ae52604f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcce1fadf54d089ec4fd751a3cf6ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:38.802329 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0034a785-cd69-4646-b6d5-31409433b326 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/servers/99db82dd-3238-4af1-9f90-1dd69cdd836a" status: 200 len: 1431 microversion: 2.1 time: 0.194305 Oct 30 01:31:38.832986 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2056/4086] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:38 2022] GET /compute/v2.1/servers/99db82dd-3238-4af1-9f90-1dd69cdd836a => generated 1431 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:38.843593 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1e2f63bf-cfe4-43fa-a7a0-f6302da56b68 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:38.845007 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1e2f63bf-cfe4-43fa-a7a0-f6302da56b68 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:38.863821 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1e2f63bf-cfe4-43fa-a7a0-f6302da56b68 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:38.864852 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1e2f63bf-cfe4-43fa-a7a0-f6302da56b68 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:38.865603 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1e2f63bf-cfe4-43fa-a7a0-f6302da56b68 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:38.866707 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1e2f63bf-cfe4-43fa-a7a0-f6302da56b68 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:38.867284 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1e2f63bf-cfe4-43fa-a7a0-f6302da56b68 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:38.867967 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1e2f63bf-cfe4-43fa-a7a0-f6302da56b68 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:39.721498 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1e2f63bf-cfe4-43fa-a7a0-f6302da56b68 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:39.738795 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1e2f63bf-cfe4-43fa-a7a0-f6302da56b68 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1315 microversion: 2.1 time: 0.904529 Oct 30 01:31:39.742290 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2057/4087] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:38 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1315 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:39.755154 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5e255796-91ad-4dc0-a2a4-6131615ec5ab tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:39.757396 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5e255796-91ad-4dc0-a2a4-6131615ec5ab tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:39.765838 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5e255796-91ad-4dc0-a2a4-6131615ec5ab tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:39.766586 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5e255796-91ad-4dc0-a2a4-6131615ec5ab tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:39.769199 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5e255796-91ad-4dc0-a2a4-6131615ec5ab tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:39.769199 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5e255796-91ad-4dc0-a2a4-6131615ec5ab tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:39.770451 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5e255796-91ad-4dc0-a2a4-6131615ec5ab tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:39.771887 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5e255796-91ad-4dc0-a2a4-6131615ec5ab tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:40.357690 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5e255796-91ad-4dc0-a2a4-6131615ec5ab tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:40.387835 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5e255796-91ad-4dc0-a2a4-6131615ec5ab tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0" status: 200 len: 1718 microversion: 2.1 time: 0.641180 Oct 30 01:31:40.388506 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2058/4088] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:39 2022] GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0 => generated 1718 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:40.400158 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-adb3f323-1943-4134-9047-5e1f9434d5e4 req-c7d29b7f-fe0e-4efe-b6a2-574ec076c8fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99db82dd-3238-4af1-9f90-1dd69cdd836a", "name": "network-vif-deleted", "tag": "49372d17-c87d-4e36-af57-5d05c8cba1e2"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:31:40.441959 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-adb3f323-1943-4134-9047-5e1f9434d5e4 req-c7d29b7f-fe0e-4efe-b6a2-574ec076c8fc service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:40.443423 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-adb3f323-1943-4134-9047-5e1f9434d5e4 req-c7d29b7f-fe0e-4efe-b6a2-574ec076c8fc service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:40.444756 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-adb3f323-1943-4134-9047-5e1f9434d5e4 req-c7d29b7f-fe0e-4efe-b6a2-574ec076c8fc service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:40.463576 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-adb3f323-1943-4134-9047-5e1f9434d5e4 req-c7d29b7f-fe0e-4efe-b6a2-574ec076c8fc service nova] Creating event network-vif-deleted:49372d17-c87d-4e36-af57-5d05c8cba1e2 for instance 99db82dd-3238-4af1-9f90-1dd69cdd836a on n-h1-master-1 Oct 30 01:31:40.474800 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-adb3f323-1943-4134-9047-5e1f9434d5e4 req-c7d29b7f-fe0e-4efe-b6a2-574ec076c8fc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081377 Oct 30 01:31:40.474800 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2059/4089] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:31:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:31:40.479258 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f63d3903-9255-4b99-b03a-0442a8fbb1ec tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:40.479965 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f63d3903-9255-4b99-b03a-0442a8fbb1ec tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 1ed9a8e0-aee6-4785-86b8-3d5113a6c838] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:40.489721 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f63d3903-9255-4b99-b03a-0442a8fbb1ec tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:40.491988 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f63d3903-9255-4b99-b03a-0442a8fbb1ec tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:40.492587 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f63d3903-9255-4b99-b03a-0442a8fbb1ec tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:40.493465 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f63d3903-9255-4b99-b03a-0442a8fbb1ec tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:40.493985 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f63d3903-9255-4b99-b03a-0442a8fbb1ec tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:40.497609 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f63d3903-9255-4b99-b03a-0442a8fbb1ec tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:40.896354 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f63d3903-9255-4b99-b03a-0442a8fbb1ec tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:40.911032 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f63d3903-9255-4b99-b03a-0442a8fbb1ec tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/1ed9a8e0-aee6-4785-86b8-3d5113a6c838" status: 200 len: 1309 microversion: 2.1 time: 0.437454 Oct 30 01:31:40.911660 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2060/4090] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:40 2022] GET /compute/v2.1/servers/1ed9a8e0-aee6-4785-86b8-3d5113a6c838 => generated 1309 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:40.922662 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-83227b2c-3bef-4a64-a296-f78a5b8d86a2 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:40.926697 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-83227b2c-3bef-4a64-a296-f78a5b8d86a2 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] [instance: 99db82dd-3238-4af1-9f90-1dd69cdd836a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:40.951147 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-83227b2c-3bef-4a64-a296-f78a5b8d86a2 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:40.951657 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-83227b2c-3bef-4a64-a296-f78a5b8d86a2 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:40.952102 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-83227b2c-3bef-4a64-a296-f78a5b8d86a2 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:40.952832 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-83227b2c-3bef-4a64-a296-f78a5b8d86a2 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:40.953295 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-83227b2c-3bef-4a64-a296-f78a5b8d86a2 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:40.963506 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-83227b2c-3bef-4a64-a296-f78a5b8d86a2 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:40.990372 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-83227b2c-3bef-4a64-a296-f78a5b8d86a2 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] HTTP exception thrown: Instance 99db82dd-3238-4af1-9f90-1dd69cdd836a could not be found. Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-83227b2c-3bef-4a64-a296-f78a5b8d86a2 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Request method failure captured: Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/99db82dd-3238-4af1-9f90-1dd69cdd836a HTTP/1.1 Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdNyhLkWBdFh4oid5j2dAg5X3viKoOL4kL-qnShxZ3knlcGNC0DE1UluGE_M-B4oUC-eiqCZ4tZLj1-hcyjIe2dfO4XTnNqVvEB5dtnuZvNlVzz5j99yUzKwp7Pd6VFCDUYUjm0CxBxIMmtwbqkxyGr6PBhLj_LIBhpI39ktyOygfec Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: d1fcce1fadf54d089ec4fd751a3cf6ae Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ListImageFiltersTestJSON-651227105 Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d1fcce1fadf54d089ec4fd751a3cf6ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d1fcce1fadf54d089ec4fd751a3cf6ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d1fcce1fadf54d089ec4fd751a3cf6ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d1fcce1fadf54d089ec4fd751a3cf6ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ListImageFiltersTestJSON-651227105 Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: d1fcce1fadf54d089ec4fd751a3cf6ae Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-651227105 Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ListImageFiltersTestJSON-651227105-project Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: fea8a24166674250a98268ae52604f12 Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ListImageFiltersTestJSON-651227105-project Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 99db82dd-3238-4af1-9f90-1dd69cdd836a could not be found. Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '99db82dd-3238-4af1-9f90-1dd69cdd836a'} Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99db82dd-3238-4af1-9f90-1dd69cdd836a could not be found. Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99db82dd-3238-4af1-9f90-1dd69cdd836a could not be found. Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:31:40.992158 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:31:40.998216 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:31:40.998216 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:31:40.998216 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:31:40.998216 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:31:40.998216 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:31:40.998216 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99db82dd-3238-4af1-9f90-1dd69cdd836a could not be found. Oct 30 01:31:40.998216 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:31:41.003603 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-83227b2c-3bef-4a64-a296-f78a5b8d86a2 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Returning 404 to user: Instance 99db82dd-3238-4af1-9f90-1dd69cdd836a could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:31:41.004944 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-83227b2c-3bef-4a64-a296-f78a5b8d86a2 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/servers/99db82dd-3238-4af1-9f90-1dd69cdd836a" status: 404 len: 111 microversion: 2.1 time: 0.091919 Oct 30 01:31:41.008608 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2061/4091] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:40 2022] GET /compute/v2.1/servers/99db82dd-3238-4af1-9f90-1dd69cdd836a => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:31:41.016348 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1368889c-2691-4628-b30f-4e52ebfd4ffc tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:41.020143 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1368889c-2691-4628-b30f-4e52ebfd4ffc tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:41.034650 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1368889c-2691-4628-b30f-4e52ebfd4ffc tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:41.037001 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1368889c-2691-4628-b30f-4e52ebfd4ffc tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:41.039009 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1368889c-2691-4628-b30f-4e52ebfd4ffc tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:41.042103 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1368889c-2691-4628-b30f-4e52ebfd4ffc tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:41.043632 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1368889c-2691-4628-b30f-4e52ebfd4ffc tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:41.046407 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1368889c-2691-4628-b30f-4e52ebfd4ffc tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:41.221771 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:31:41.224195 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-1368889c-2691-4628-b30f-4e52ebfd4ffc tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] HTTP exception thrown: Cannot 'detach_volume' instance 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0 while it is in vm_state rescued Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1368889c-2691-4628-b30f-4e52ebfd4ffc tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Request method failure captured: Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0/os-volume_attachments/f877f8e1-3943-46b6-9fb6-ac5f4e95cf67 HTTP/1.1 Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdMpBfA6mq8oavinMeTyaurexihmj6JmnnP2ZZndb1MXJnyLYJP1lh9IAGUFmytWgjEkCc6rHAh1wpEFldWPgYBauossNbR0UQldGfx9XACde0J5etDs6i2phO_G-HCGpqKWqFyqD3FJkTb44yZ7CHZV6U0ZtcSE1Hf7lvcXbJ_Lvp0 Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 470e235fb35840828d9a86028b72f5de Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-909936776 Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/470e235fb35840828d9a86028b72f5de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_470e235fb35840828d9a86028b72f5de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/470e235fb35840828d9a86028b72f5de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/470e235fb35840828d9a86028b72f5de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServerRescueNegativeTestJSON-909936776 Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 470e235fb35840828d9a86028b72f5de Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-909936776 Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServerRescueNegativeTestJSON-909936776-project Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 6134c05549f14bc19962acea9c913f53 Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServerRescueNegativeTestJSON-909936776-project Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: exception: Cannot 'detach_volume' instance 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0 while it is in vm_state rescued Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: action_args: {'server_id': '9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0', 'id': 'f877f8e1-3943-46b6-9fb6-ac5f4e95cf67'} Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0 while it is in vm_state rescued Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:31:41.228467 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:31:41.233676 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:31:41.233676 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:31:41.233676 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:31:41.233676 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:31:41.233676 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0 while it is in vm_state rescued Oct 30 01:31:41.233676 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:31:41.233676 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1368889c-2691-4628-b30f-4e52ebfd4ffc tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Returning 409 to user: Cannot 'detach_volume' instance 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0 while it is in vm_state rescued {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:31:41.233676 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1368889c-2691-4628-b30f-4e52ebfd4ffc tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0/os-volume_attachments/f877f8e1-3943-46b6-9fb6-ac5f4e95cf67" status: 409 len: 152 microversion: 2.1 time: 0.222465 Oct 30 01:31:41.236826 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2062/4092] 10.222.0.13 () {58 vars in 1416 bytes} [Sun Oct 30 01:31:41 2022] DELETE /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0/os-volume_attachments/f877f8e1-3943-46b6-9fb6-ac5f4e95cf67 => generated 152 bytes in 227 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:31:41.245674 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-02b846e6-aa56-44cd-b018-2f276b7affc4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:41.246580 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-02b846e6-aa56-44cd-b018-2f276b7affc4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:41.261665 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-02b846e6-aa56-44cd-b018-2f276b7affc4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:41.262025 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-02b846e6-aa56-44cd-b018-2f276b7affc4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:41.267460 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-02b846e6-aa56-44cd-b018-2f276b7affc4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:41.268510 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-02b846e6-aa56-44cd-b018-2f276b7affc4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:41.268989 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-02b846e6-aa56-44cd-b018-2f276b7affc4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:41.269675 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-02b846e6-aa56-44cd-b018-2f276b7affc4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:41.750620 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-02b846e6-aa56-44cd-b018-2f276b7affc4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:41.760719 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-02b846e6-aa56-44cd-b018-2f276b7affc4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1315 microversion: 2.1 time: 0.522055 Oct 30 01:31:41.776801 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2063/4093] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:41 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1315 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:41.783515 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-232bef9f-e9d6-4d60-af27-c92ef0922358 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:41.786448 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-232bef9f-e9d6-4d60-af27-c92ef0922358 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] [instance: e9368bd4-9715-46b3-91bb-cb436f7120f3] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:41.793274 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-232bef9f-e9d6-4d60-af27-c92ef0922358 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:41.793815 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-232bef9f-e9d6-4d60-af27-c92ef0922358 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:41.794255 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-232bef9f-e9d6-4d60-af27-c92ef0922358 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:41.795492 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-232bef9f-e9d6-4d60-af27-c92ef0922358 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:41.796136 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-232bef9f-e9d6-4d60-af27-c92ef0922358 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:41.796738 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-232bef9f-e9d6-4d60-af27-c92ef0922358 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:41.824652 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-232bef9f-e9d6-4d60-af27-c92ef0922358 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] [instance: e9368bd4-9715-46b3-91bb-cb436f7120f3] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:31:41.994966 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b2e1bcfa-ab91-4f64-afdd-217105f28fd7 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] 10.222.0.13 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.452311 Oct 30 01:31:41.995858 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2031/4094] 10.222.0.13 () {60 vars in 1170 bytes} [Sun Oct 30 01:31:36 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:31:42.000767 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7bd8e89e-2b19-48c7-9ff9-9482ba605b60 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:31:42.001629 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7bd8e89e-2b19-48c7-9ff9-9482ba605b60 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:42.024480 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7bd8e89e-2b19-48c7-9ff9-9482ba605b60 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:42.025187 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7bd8e89e-2b19-48c7-9ff9-9482ba605b60 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:42.025994 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7bd8e89e-2b19-48c7-9ff9-9482ba605b60 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:42.026891 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7bd8e89e-2b19-48c7-9ff9-9482ba605b60 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:42.027528 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7bd8e89e-2b19-48c7-9ff9-9482ba605b60 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:42.028134 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7bd8e89e-2b19-48c7-9ff9-9482ba605b60 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:42.264094 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-232bef9f-e9d6-4d60-af27-c92ef0922358 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e9368bd4-9715-46b3-91bb-cb436f7120f3" status: 204 len: 0 microversion: 2.1 time: 0.485563 Oct 30 01:31:42.269845 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2064/4095] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:31:41 2022] DELETE /compute/v2.1/servers/e9368bd4-9715-46b3-91bb-cb436f7120f3 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:31:42.277720 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3eb9dde3-026b-4e04-a281-36c02f513a04 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:42.278379 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3eb9dde3-026b-4e04-a281-36c02f513a04 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 1ed9a8e0-aee6-4785-86b8-3d5113a6c838] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:42.286331 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3eb9dde3-026b-4e04-a281-36c02f513a04 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:42.286826 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3eb9dde3-026b-4e04-a281-36c02f513a04 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:42.287260 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3eb9dde3-026b-4e04-a281-36c02f513a04 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:42.287957 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3eb9dde3-026b-4e04-a281-36c02f513a04 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:42.288600 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3eb9dde3-026b-4e04-a281-36c02f513a04 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:42.296953 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7bd8e89e-2b19-48c7-9ff9-9482ba605b60 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "POST /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0/action" status: 202 len: 0 microversion: 2.1 time: 0.299442 Oct 30 01:31:42.297876 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2032/4096] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:31:41 2022] POST /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:31:42.303827 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-aa1b6329-73d7-4d04-8b90-b51b5317aaec tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.5.192"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:31:42.304364 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3eb9dde3-026b-4e04-a281-36c02f513a04 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:42.311467 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-aa1b6329-73d7-4d04-8b90-b51b5317aaec tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] [instance: 1f9c8547-e0cb-4094-a15e-d21166bda1d2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:42.330938 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa1b6329-73d7-4d04-8b90-b51b5317aaec tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:42.331744 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa1b6329-73d7-4d04-8b90-b51b5317aaec tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:42.332370 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa1b6329-73d7-4d04-8b90-b51b5317aaec tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:42.333268 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa1b6329-73d7-4d04-8b90-b51b5317aaec tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:42.334122 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa1b6329-73d7-4d04-8b90-b51b5317aaec tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:42.334728 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa1b6329-73d7-4d04-8b90-b51b5317aaec tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:42.388316 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa1b6329-73d7-4d04-8b90-b51b5317aaec tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "refresh_cache-1f9c8547-e0cb-4094-a15e-d21166bda1d2" {{(pid=121103) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 30 01:31:42.388907 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa1b6329-73d7-4d04-8b90-b51b5317aaec tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquired lock "refresh_cache-1f9c8547-e0cb-4094-a15e-d21166bda1d2" {{(pid=121103) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 30 01:31:43.012704 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3eb9dde3-026b-4e04-a281-36c02f513a04 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:43.023691 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3eb9dde3-026b-4e04-a281-36c02f513a04 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/1ed9a8e0-aee6-4785-86b8-3d5113a6c838" status: 200 len: 1309 microversion: 2.1 time: 0.756129 Oct 30 01:31:43.036592 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2065/4097] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:42 2022] GET /compute/v2.1/servers/1ed9a8e0-aee6-4785-86b8-3d5113a6c838 => generated 1309 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:43.042197 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-18084ddb-2111-476d-86f2-b94cf89a4ecc tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:43.042919 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-18084ddb-2111-476d-86f2-b94cf89a4ecc tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] [instance: e9368bd4-9715-46b3-91bb-cb436f7120f3] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:43.054935 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-18084ddb-2111-476d-86f2-b94cf89a4ecc tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:43.055635 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-18084ddb-2111-476d-86f2-b94cf89a4ecc tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:43.056189 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-18084ddb-2111-476d-86f2-b94cf89a4ecc tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:43.056988 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-18084ddb-2111-476d-86f2-b94cf89a4ecc tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:43.057597 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-18084ddb-2111-476d-86f2-b94cf89a4ecc tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:43.058164 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-18084ddb-2111-476d-86f2-b94cf89a4ecc tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:43.461446 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-18084ddb-2111-476d-86f2-b94cf89a4ecc tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea8a24166674250a98268ae52604f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcce1fadf54d089ec4fd751a3cf6ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:43.469544 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-18084ddb-2111-476d-86f2-b94cf89a4ecc tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/servers/e9368bd4-9715-46b3-91bb-cb436f7120f3" status: 200 len: 1473 microversion: 2.1 time: 0.431465 Oct 30 01:31:43.470273 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2066/4098] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:43 2022] GET /compute/v2.1/servers/e9368bd4-9715-46b3-91bb-cb436f7120f3 => generated 1473 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:43.476661 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a0dcbc77-ce80-41fb-8549-f2ebf1d9bf29 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:43.477622 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a0dcbc77-ce80-41fb-8549-f2ebf1d9bf29 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:43.483930 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a0dcbc77-ce80-41fb-8549-f2ebf1d9bf29 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:43.484734 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a0dcbc77-ce80-41fb-8549-f2ebf1d9bf29 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:43.485499 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a0dcbc77-ce80-41fb-8549-f2ebf1d9bf29 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:43.486468 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a0dcbc77-ce80-41fb-8549-f2ebf1d9bf29 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:43.487681 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a0dcbc77-ce80-41fb-8549-f2ebf1d9bf29 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:43.488246 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a0dcbc77-ce80-41fb-8549-f2ebf1d9bf29 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:43.936891 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a0dcbc77-ce80-41fb-8549-f2ebf1d9bf29 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:43.959646 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a0dcbc77-ce80-41fb-8549-f2ebf1d9bf29 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0" status: 200 len: 1726 microversion: 2.1 time: 0.486667 Oct 30 01:31:43.960472 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2067/4099] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:43 2022] GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0 => generated 1726 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:43.972351 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8d87d2bb-bf42-41c6-9600-d960a86d41de tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:43.973486 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8d87d2bb-bf42-41c6-9600-d960a86d41de tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:43.981593 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d87d2bb-bf42-41c6-9600-d960a86d41de tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:43.982241 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d87d2bb-bf42-41c6-9600-d960a86d41de tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:43.982683 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d87d2bb-bf42-41c6-9600-d960a86d41de tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:43.983430 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d87d2bb-bf42-41c6-9600-d960a86d41de tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:43.983910 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d87d2bb-bf42-41c6-9600-d960a86d41de tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:43.984331 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d87d2bb-bf42-41c6-9600-d960a86d41de tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:44.438653 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8d87d2bb-bf42-41c6-9600-d960a86d41de tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:44.451499 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8d87d2bb-bf42-41c6-9600-d960a86d41de tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1315 microversion: 2.1 time: 0.488702 Oct 30 01:31:44.452469 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2068/4100] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:43 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1315 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:44.460332 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-027ded07-3358-47a4-b798-7940f917b6ea tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:44.461470 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-027ded07-3358-47a4-b798-7940f917b6ea tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 1ed9a8e0-aee6-4785-86b8-3d5113a6c838] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:44.473778 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-027ded07-3358-47a4-b798-7940f917b6ea tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:44.475253 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-027ded07-3358-47a4-b798-7940f917b6ea tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:44.476030 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-027ded07-3358-47a4-b798-7940f917b6ea tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:44.477382 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-027ded07-3358-47a4-b798-7940f917b6ea tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:44.478808 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-027ded07-3358-47a4-b798-7940f917b6ea tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:44.479668 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-027ded07-3358-47a4-b798-7940f917b6ea tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:45.447611 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-027ded07-3358-47a4-b798-7940f917b6ea tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:45.460241 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-027ded07-3358-47a4-b798-7940f917b6ea tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/1ed9a8e0-aee6-4785-86b8-3d5113a6c838" status: 200 len: 1309 microversion: 2.1 time: 1.006491 Oct 30 01:31:45.462141 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2069/4101] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:44 2022] GET /compute/v2.1/servers/1ed9a8e0-aee6-4785-86b8-3d5113a6c838 => generated 1309 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:45.482671 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-ae35452b-e2c7-4394-aa5f-85c85baff430 req-dca0b23a-94cc-4f64-b867-7aa07aa7ca22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c51345-2948-4ff1-828f-8c70b2b979f2", "name": "network-vif-plugged", "status": "completed", "tag": "25297f9d-e65e-44db-bc94-b8ade234295f"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:31:45.497697 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ae35452b-e2c7-4394-aa5f-85c85baff430 req-dca0b23a-94cc-4f64-b867-7aa07aa7ca22 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:45.498265 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ae35452b-e2c7-4394-aa5f-85c85baff430 req-dca0b23a-94cc-4f64-b867-7aa07aa7ca22 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:45.498776 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ae35452b-e2c7-4394-aa5f-85c85baff430 req-dca0b23a-94cc-4f64-b867-7aa07aa7ca22 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:45.511520 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-ae35452b-e2c7-4394-aa5f-85c85baff430 req-dca0b23a-94cc-4f64-b867-7aa07aa7ca22 service nova] Creating event network-vif-plugged:25297f9d-e65e-44db-bc94-b8ade234295f for instance b0c51345-2948-4ff1-828f-8c70b2b979f2 on n-h2-master-1 Oct 30 01:31:45.525671 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-ae35452b-e2c7-4394-aa5f-85c85baff430 req-dca0b23a-94cc-4f64-b867-7aa07aa7ca22 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052969 Oct 30 01:31:45.525671 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2070/4102] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:31:45.527096 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-949e1931-0181-43be-868c-23252facd6eb tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:45.527803 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-949e1931-0181-43be-868c-23252facd6eb tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] [instance: e9368bd4-9715-46b3-91bb-cb436f7120f3] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:45.534853 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-949e1931-0181-43be-868c-23252facd6eb tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:45.535339 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-949e1931-0181-43be-868c-23252facd6eb tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:45.535774 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-949e1931-0181-43be-868c-23252facd6eb tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:45.536471 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-949e1931-0181-43be-868c-23252facd6eb tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:45.537057 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-949e1931-0181-43be-868c-23252facd6eb tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:45.537502 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-949e1931-0181-43be-868c-23252facd6eb tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:46.036481 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-949e1931-0181-43be-868c-23252facd6eb tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea8a24166674250a98268ae52604f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcce1fadf54d089ec4fd751a3cf6ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:46.043683 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-949e1931-0181-43be-868c-23252facd6eb tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/servers/e9368bd4-9715-46b3-91bb-cb436f7120f3" status: 200 len: 1473 microversion: 2.1 time: 0.520553 Oct 30 01:31:46.054222 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2071/4103] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:45 2022] GET /compute/v2.1/servers/e9368bd4-9715-46b3-91bb-cb436f7120f3 => generated 1473 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:46.059104 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-acb4c8cc-8f32-4f89-889d-f2a71e39fcd5 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:46.063871 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-acb4c8cc-8f32-4f89-889d-f2a71e39fcd5 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:46.067736 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-acb4c8cc-8f32-4f89-889d-f2a71e39fcd5 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:46.068423 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-acb4c8cc-8f32-4f89-889d-f2a71e39fcd5 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:46.068863 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-acb4c8cc-8f32-4f89-889d-f2a71e39fcd5 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:46.069584 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-acb4c8cc-8f32-4f89-889d-f2a71e39fcd5 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:46.070232 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-acb4c8cc-8f32-4f89-889d-f2a71e39fcd5 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:46.070659 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-acb4c8cc-8f32-4f89-889d-f2a71e39fcd5 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:46.535867 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-aa1b6329-73d7-4d04-8b90-b51b5317aaec tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] [instance: 1f9c8547-e0cb-4094-a15e-d21166bda1d2] Building network info cache for instance {{(pid=121103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 30 01:31:46.537550 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-acb4c8cc-8f32-4f89-889d-f2a71e39fcd5 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:46.552611 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-acb4c8cc-8f32-4f89-889d-f2a71e39fcd5 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0" status: 200 len: 1726 microversion: 2.1 time: 0.497301 Oct 30 01:31:46.555093 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2072/4104] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:46 2022] GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0 => generated 1726 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:46.560711 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-327ba2de-09f1-40ff-9caa-739b2fcf0494 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:46.561472 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-327ba2de-09f1-40ff-9caa-739b2fcf0494 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:46.568535 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-327ba2de-09f1-40ff-9caa-739b2fcf0494 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:46.569624 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-327ba2de-09f1-40ff-9caa-739b2fcf0494 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:46.570315 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-327ba2de-09f1-40ff-9caa-739b2fcf0494 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:46.571447 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-327ba2de-09f1-40ff-9caa-739b2fcf0494 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:46.572303 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-327ba2de-09f1-40ff-9caa-739b2fcf0494 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:46.572950 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-327ba2de-09f1-40ff-9caa-739b2fcf0494 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:46.983922 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-327ba2de-09f1-40ff-9caa-739b2fcf0494 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:46.993921 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-327ba2de-09f1-40ff-9caa-739b2fcf0494 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1315 microversion: 2.1 time: 0.437439 Oct 30 01:31:47.002950 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2073/4105] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:46 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1315 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:47.012005 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-86327f1d-e85a-4809-8091-c067bc657e13 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:47.012964 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-86327f1d-e85a-4809-8091-c067bc657e13 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 1ed9a8e0-aee6-4785-86b8-3d5113a6c838] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:47.021894 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86327f1d-e85a-4809-8091-c067bc657e13 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:47.022386 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86327f1d-e85a-4809-8091-c067bc657e13 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:47.023674 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86327f1d-e85a-4809-8091-c067bc657e13 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:47.025458 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86327f1d-e85a-4809-8091-c067bc657e13 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:47.026128 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86327f1d-e85a-4809-8091-c067bc657e13 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:47.026863 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86327f1d-e85a-4809-8091-c067bc657e13 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:47.506294 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-86327f1d-e85a-4809-8091-c067bc657e13 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:47.521306 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-86327f1d-e85a-4809-8091-c067bc657e13 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/1ed9a8e0-aee6-4785-86b8-3d5113a6c838" status: 200 len: 1309 microversion: 2.1 time: 0.514709 Oct 30 01:31:47.522030 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2074/4106] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:47 2022] GET /compute/v2.1/servers/1ed9a8e0-aee6-4785-86b8-3d5113a6c838 => generated 1309 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:47.533163 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-ee8bee44-2ca1-4e3b-afe5-4fc2e10423ec req-343895e6-adaf-458a-b005-a613f31222a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f9c8547-e0cb-4094-a15e-d21166bda1d2", "tag": "bb118f0b-7010-4f9e-8bc1-93d4fa2233ad"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:31:47.555870 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ee8bee44-2ca1-4e3b-afe5-4fc2e10423ec req-343895e6-adaf-458a-b005-a613f31222a7 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:47.556483 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ee8bee44-2ca1-4e3b-afe5-4fc2e10423ec req-343895e6-adaf-458a-b005-a613f31222a7 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:47.564179 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ee8bee44-2ca1-4e3b-afe5-4fc2e10423ec req-343895e6-adaf-458a-b005-a613f31222a7 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:47.580802 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-ee8bee44-2ca1-4e3b-afe5-4fc2e10423ec req-343895e6-adaf-458a-b005-a613f31222a7 service nova] Creating event network-changed:bb118f0b-7010-4f9e-8bc1-93d4fa2233ad for instance 1f9c8547-e0cb-4094-a15e-d21166bda1d2 on n-h1-master-1 Oct 30 01:31:47.597102 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-ee8bee44-2ca1-4e3b-afe5-4fc2e10423ec req-343895e6-adaf-458a-b005-a613f31222a7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073709 Oct 30 01:31:47.602735 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2075/4107] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:31:47.615359 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-61efe3bd-1937-435b-b80e-8ccea2e4e55d tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:47.633632 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-61efe3bd-1937-435b-b80e-8ccea2e4e55d tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] [instance: e9368bd4-9715-46b3-91bb-cb436f7120f3] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:47.633632 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-61efe3bd-1937-435b-b80e-8ccea2e4e55d tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:47.633632 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-61efe3bd-1937-435b-b80e-8ccea2e4e55d tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:47.633632 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-61efe3bd-1937-435b-b80e-8ccea2e4e55d tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:47.633632 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-61efe3bd-1937-435b-b80e-8ccea2e4e55d tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:47.639062 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-61efe3bd-1937-435b-b80e-8ccea2e4e55d tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:47.640727 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-61efe3bd-1937-435b-b80e-8ccea2e4e55d tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:48.119246 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-61efe3bd-1937-435b-b80e-8ccea2e4e55d tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea8a24166674250a98268ae52604f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcce1fadf54d089ec4fd751a3cf6ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:48.132157 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-61efe3bd-1937-435b-b80e-8ccea2e4e55d tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/servers/e9368bd4-9715-46b3-91bb-cb436f7120f3" status: 200 len: 1431 microversion: 2.1 time: 0.528068 Oct 30 01:31:48.152156 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2076/4108] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:47 2022] GET /compute/v2.1/servers/e9368bd4-9715-46b3-91bb-cb436f7120f3 => generated 1431 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:48.160901 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-69566b35-8625-4219-99ef-5e20bbd73f08 req-8f0b0e46-859b-4cea-9cca-97cda7cc0b4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ed9a8e0-aee6-4785-86b8-3d5113a6c838", "name": "network-vif-plugged", "status": "completed", "tag": "73950017-fffa-4c2f-ad1f-d656bc765f11"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:31:48.179626 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-69566b35-8625-4219-99ef-5e20bbd73f08 req-8f0b0e46-859b-4cea-9cca-97cda7cc0b4a service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:48.180185 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-69566b35-8625-4219-99ef-5e20bbd73f08 req-8f0b0e46-859b-4cea-9cca-97cda7cc0b4a service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:48.182952 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-69566b35-8625-4219-99ef-5e20bbd73f08 req-8f0b0e46-859b-4cea-9cca-97cda7cc0b4a service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:48.203528 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-69566b35-8625-4219-99ef-5e20bbd73f08 req-8f0b0e46-859b-4cea-9cca-97cda7cc0b4a service nova] Creating event network-vif-plugged:73950017-fffa-4c2f-ad1f-d656bc765f11 for instance 1ed9a8e0-aee6-4785-86b8-3d5113a6c838 on n-h2-master-1 Oct 30 01:31:48.216338 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-69566b35-8625-4219-99ef-5e20bbd73f08 req-8f0b0e46-859b-4cea-9cca-97cda7cc0b4a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057088 Oct 30 01:31:48.217985 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2077/4109] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:31:48.239298 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-960d5533-12dd-48b6-9306-2d8851519b28 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:48.240876 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-960d5533-12dd-48b6-9306-2d8851519b28 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:48.257294 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-960d5533-12dd-48b6-9306-2d8851519b28 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:48.258129 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-960d5533-12dd-48b6-9306-2d8851519b28 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:48.258901 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-960d5533-12dd-48b6-9306-2d8851519b28 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:48.260160 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-960d5533-12dd-48b6-9306-2d8851519b28 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:48.260936 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-960d5533-12dd-48b6-9306-2d8851519b28 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:48.261769 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-960d5533-12dd-48b6-9306-2d8851519b28 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:48.347357 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-aa1b6329-73d7-4d04-8b90-b51b5317aaec tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] [instance: 1f9c8547-e0cb-4094-a15e-d21166bda1d2] Updating instance_info_cache with network_info: [{"id": "bb118f0b-7010-4f9e-8bc1-93d4fa2233ad", "address": "fa:16:3e:ab:19:5e", "network": {"id": "ec3baca8-963c-473d-9622-8e40c5206964", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-978503035-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.5.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "edc4c8f707304cd98a5f2e13cb1d5a5b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapbb118f0b-70", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 30 01:31:48.454044 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa1b6329-73d7-4d04-8b90-b51b5317aaec tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Releasing lock "refresh_cache-1f9c8547-e0cb-4094-a15e-d21166bda1d2" {{(pid=121103) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 30 01:31:48.454044 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-aa1b6329-73d7-4d04-8b90-b51b5317aaec tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] 10.222.0.13 "POST /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2/action" status: 202 len: 0 microversion: 2.1 time: 6.152419 Oct 30 01:31:48.454044 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2033/4110] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:31:42 2022] POST /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2/action => generated 0 bytes in 6154 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 30 01:31:48.646829 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-960d5533-12dd-48b6-9306-2d8851519b28 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:48.661634 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-960d5533-12dd-48b6-9306-2d8851519b28 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0" status: 200 len: 1726 microversion: 2.1 time: 0.436177 Oct 30 01:31:48.661817 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1262d445-b397-4a05-9dc7-d9d27a76dbd8 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1249049654", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "ff033ec2-bde6-4701-9778-1e571334592d"}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:31:48.661944 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2078/4111] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:48 2022] GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0 => generated 1726 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:48.673817 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-642e2616-831b-4cfc-9844-6179ca1bfa85 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:48.674887 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-642e2616-831b-4cfc-9844-6179ca1bfa85 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:48.681398 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-642e2616-831b-4cfc-9844-6179ca1bfa85 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:48.684565 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-642e2616-831b-4cfc-9844-6179ca1bfa85 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:48.684565 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-642e2616-831b-4cfc-9844-6179ca1bfa85 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:48.684565 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-642e2616-831b-4cfc-9844-6179ca1bfa85 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:48.684565 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-642e2616-831b-4cfc-9844-6179ca1bfa85 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:48.684565 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-642e2616-831b-4cfc-9844-6179ca1bfa85 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:48.717679 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:31:48.790360 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-1262d445-b397-4a05-9dc7-d9d27a76dbd8 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] validate_networks() for [('ff033ec2-bde6-4701-9778-1e571334592d', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:31:49.066386 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-642e2616-831b-4cfc-9844-6179ca1bfa85 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:49.078703 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:31:49.081772 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-642e2616-831b-4cfc-9844-6179ca1bfa85 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.417072 Oct 30 01:31:49.082482 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2079/4112] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:48 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:49.088301 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6774272f-0cd5-4a8d-81cc-8113dd0f0934 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.5.192"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:31:49.559010 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6774272f-0cd5-4a8d-81cc-8113dd0f0934 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] [instance: 1f9c8547-e0cb-4094-a15e-d21166bda1d2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:49.568591 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6774272f-0cd5-4a8d-81cc-8113dd0f0934 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:49.569633 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6774272f-0cd5-4a8d-81cc-8113dd0f0934 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:49.570473 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6774272f-0cd5-4a8d-81cc-8113dd0f0934 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:49.571611 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6774272f-0cd5-4a8d-81cc-8113dd0f0934 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:49.572515 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6774272f-0cd5-4a8d-81cc-8113dd0f0934 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:49.573475 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6774272f-0cd5-4a8d-81cc-8113dd0f0934 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:50.148894 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-1262d445-b397-4a05-9dc7-d9d27a76dbd8 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:31:50.151221 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-1262d445-b397-4a05-9dc7-d9d27a76dbd8 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:31:50.151981 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-1262d445-b397-4a05-9dc7-d9d27a76dbd8 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:31:50.152639 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-1262d445-b397-4a05-9dc7-d9d27a76dbd8 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:31:50.153285 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-1262d445-b397-4a05-9dc7-d9d27a76dbd8 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:31:50.169382 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1262d445-b397-4a05-9dc7-d9d27a76dbd8 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:50.170274 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1262d445-b397-4a05-9dc7-d9d27a76dbd8 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:50.171278 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1262d445-b397-4a05-9dc7-d9d27a76dbd8 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:50.172366 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1262d445-b397-4a05-9dc7-d9d27a76dbd8 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:50.173076 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1262d445-b397-4a05-9dc7-d9d27a76dbd8 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:50.173799 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1262d445-b397-4a05-9dc7-d9d27a76dbd8 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:50.198771 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-1262d445-b397-4a05-9dc7-d9d27a76dbd8 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Getting quotas for project 8b25b290c8004e1f8f89e17b448f242a. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:31:50.205516 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-1262d445-b397-4a05-9dc7-d9d27a76dbd8 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Getting quotas for user b0d4603acbc846dcb2f523091cd78ae4 and project 8b25b290c8004e1f8f89e17b448f242a. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:31:50.225104 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1262d445-b397-4a05-9dc7-d9d27a76dbd8 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:31:50.229940 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1262d445-b397-4a05-9dc7-d9d27a76dbd8 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: b36a2df7-45c9-4a51-88f1-e1a1b9c0969d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:31:50.291503 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6774272f-0cd5-4a8d-81cc-8113dd0f0934 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "refresh_cache-1f9c8547-e0cb-4094-a15e-d21166bda1d2" {{(pid=121102) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 30 01:31:50.291503 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6774272f-0cd5-4a8d-81cc-8113dd0f0934 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquired lock "refresh_cache-1f9c8547-e0cb-4094-a15e-d21166bda1d2" {{(pid=121102) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 30 01:31:50.381559 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1262d445-b397-4a05-9dc7-d9d27a76dbd8 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.927336 Oct 30 01:31:50.382902 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2034/4113] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:31:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1929 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:31:50.389108 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7fef4754-4bfd-414c-95ae-b121e9652408 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:50.390234 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7fef4754-4bfd-414c-95ae-b121e9652408 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 1ed9a8e0-aee6-4785-86b8-3d5113a6c838] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:50.411730 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7fef4754-4bfd-414c-95ae-b121e9652408 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:50.412522 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7fef4754-4bfd-414c-95ae-b121e9652408 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:50.418141 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7fef4754-4bfd-414c-95ae-b121e9652408 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:50.419249 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7fef4754-4bfd-414c-95ae-b121e9652408 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:50.421554 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7fef4754-4bfd-414c-95ae-b121e9652408 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:50.422196 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7fef4754-4bfd-414c-95ae-b121e9652408 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:51.280701 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7fef4754-4bfd-414c-95ae-b121e9652408 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:51.298002 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7fef4754-4bfd-414c-95ae-b121e9652408 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/1ed9a8e0-aee6-4785-86b8-3d5113a6c838" status: 200 len: 1490 microversion: 2.1 time: 0.904930 Oct 30 01:31:51.298859 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2035/4114] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:50 2022] GET /compute/v2.1/servers/1ed9a8e0-aee6-4785-86b8-3d5113a6c838 => generated 1490 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:51.323978 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-efc20694-7e57-457c-b93b-633b456c854f tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:51.324650 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-efc20694-7e57-457c-b93b-633b456c854f tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] [instance: e9368bd4-9715-46b3-91bb-cb436f7120f3] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:51.331939 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-efc20694-7e57-457c-b93b-633b456c854f tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:51.332528 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-efc20694-7e57-457c-b93b-633b456c854f tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:51.332956 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-efc20694-7e57-457c-b93b-633b456c854f tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:51.333912 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-efc20694-7e57-457c-b93b-633b456c854f tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:51.334493 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-efc20694-7e57-457c-b93b-633b456c854f tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:51.335115 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-efc20694-7e57-457c-b93b-633b456c854f tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:51.351300 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:31:51.352883 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-efc20694-7e57-457c-b93b-633b456c854f tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] HTTP exception thrown: Instance e9368bd4-9715-46b3-91bb-cb436f7120f3 could not be found. Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-efc20694-7e57-457c-b93b-633b456c854f tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Request method failure captured: Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/e9368bd4-9715-46b3-91bb-cb436f7120f3 HTTP/1.1 Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdNyhLkWBdFh4oid5j2dAg5X3viKoOL4kL-qnShxZ3knlcGNC0DE1UluGE_M-B4oUC-eiqCZ4tZLj1-hcyjIe2dfO4XTnNqVvEB5dtnuZvNlVzz5j99yUzKwp7Pd6VFCDUYUjm0CxBxIMmtwbqkxyGr6PBhLj_LIBhpI39ktyOygfec Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: d1fcce1fadf54d089ec4fd751a3cf6ae Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ListImageFiltersTestJSON-651227105 Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d1fcce1fadf54d089ec4fd751a3cf6ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d1fcce1fadf54d089ec4fd751a3cf6ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d1fcce1fadf54d089ec4fd751a3cf6ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d1fcce1fadf54d089ec4fd751a3cf6ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ListImageFiltersTestJSON-651227105 Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: d1fcce1fadf54d089ec4fd751a3cf6ae Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-651227105 Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ListImageFiltersTestJSON-651227105-project Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: fea8a24166674250a98268ae52604f12 Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ListImageFiltersTestJSON-651227105-project Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: exception: Instance e9368bd4-9715-46b3-91bb-cb436f7120f3 could not be found. Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'e9368bd4-9715-46b3-91bb-cb436f7120f3'} Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9368bd4-9715-46b3-91bb-cb436f7120f3 could not be found. Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9368bd4-9715-46b3-91bb-cb436f7120f3 could not be found. Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:31:51.373606 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:31:51.378154 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:31:51.378154 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:31:51.378154 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:31:51.378154 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:31:51.378154 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:31:51.378154 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9368bd4-9715-46b3-91bb-cb436f7120f3 could not be found. Oct 30 01:31:51.378154 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:31:51.379798 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-efc20694-7e57-457c-b93b-633b456c854f tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Returning 404 to user: Instance e9368bd4-9715-46b3-91bb-cb436f7120f3 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:31:51.381365 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-efc20694-7e57-457c-b93b-633b456c854f tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "GET /compute/v2.1/servers/e9368bd4-9715-46b3-91bb-cb436f7120f3" status: 404 len: 111 microversion: 2.1 time: 0.061614 Oct 30 01:31:51.382104 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2036/4115] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:51 2022] GET /compute/v2.1/servers/e9368bd4-9715-46b3-91bb-cb436f7120f3 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:31:51.395361 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3c17cd70-e583-4b4e-a830-4ce4fd9d49e2 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1638260824", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "2bdbb622-9eb5-4b19-93d6-10bf71c70ecc"}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:31:51.460017 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-3c17cd70-e583-4b4e-a830-4ce4fd9d49e2 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] validate_networks() for [('2bdbb622-9eb5-4b19-93d6-10bf71c70ecc', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:31:52.465220 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-3c17cd70-e583-4b4e-a830-4ce4fd9d49e2 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:31:52.466497 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-3c17cd70-e583-4b4e-a830-4ce4fd9d49e2 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:31:52.467065 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-3c17cd70-e583-4b4e-a830-4ce4fd9d49e2 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:31:52.467673 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-3c17cd70-e583-4b4e-a830-4ce4fd9d49e2 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:31:52.468208 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-3c17cd70-e583-4b4e-a830-4ce4fd9d49e2 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:31:52.476234 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-6774272f-0cd5-4a8d-81cc-8113dd0f0934 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] [instance: 1f9c8547-e0cb-4094-a15e-d21166bda1d2] Building network info cache for instance {{(pid=121102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 30 01:31:52.485595 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3c17cd70-e583-4b4e-a830-4ce4fd9d49e2 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:52.487244 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3c17cd70-e583-4b4e-a830-4ce4fd9d49e2 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:52.487905 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3c17cd70-e583-4b4e-a830-4ce4fd9d49e2 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:52.489124 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3c17cd70-e583-4b4e-a830-4ce4fd9d49e2 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:52.489811 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3c17cd70-e583-4b4e-a830-4ce4fd9d49e2 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:52.490439 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3c17cd70-e583-4b4e-a830-4ce4fd9d49e2 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:52.536287 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-3c17cd70-e583-4b4e-a830-4ce4fd9d49e2 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Getting quotas for project 3efbfd76a9a74c03907d7d9be25f42d4. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:31:52.549961 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-3c17cd70-e583-4b4e-a830-4ce4fd9d49e2 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Getting quotas for user 0bce487302c24def8a8473b0725904f2 and project 3efbfd76a9a74c03907d7d9be25f42d4. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:31:52.570964 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3c17cd70-e583-4b4e-a830-4ce4fd9d49e2 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:31:52.573863 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3c17cd70-e583-4b4e-a830-4ce4fd9d49e2 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: 03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:31:52.734066 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3c17cd70-e583-4b4e-a830-4ce4fd9d49e2 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.350614 Oct 30 01:31:52.741170 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2037/4116] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:31:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1358 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:31:52.746525 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-1e71665d-a719-4a57-a622-c256225fb037 req-634d22af-cfe8-42a4-b101-3cf535c8fa58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9368bd4-9715-46b3-91bb-cb436f7120f3", "name": "network-vif-deleted", "tag": "2115d9c7-78b5-463e-b9d2-39310d4c1aa2"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:31:52.759627 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-1e71665d-a719-4a57-a622-c256225fb037 req-634d22af-cfe8-42a4-b101-3cf535c8fa58 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:52.760373 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-1e71665d-a719-4a57-a622-c256225fb037 req-634d22af-cfe8-42a4-b101-3cf535c8fa58 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:52.760968 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-1e71665d-a719-4a57-a622-c256225fb037 req-634d22af-cfe8-42a4-b101-3cf535c8fa58 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:52.810049 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-1e71665d-a719-4a57-a622-c256225fb037 req-634d22af-cfe8-42a4-b101-3cf535c8fa58 service nova] Creating event network-vif-deleted:2115d9c7-78b5-463e-b9d2-39310d4c1aa2 for instance e9368bd4-9715-46b3-91bb-cb436f7120f3 on n-h1-master-1 Oct 30 01:31:52.823163 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-1e71665d-a719-4a57-a622-c256225fb037 req-634d22af-cfe8-42a4-b101-3cf535c8fa58 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078550 Oct 30 01:31:52.826836 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2038/4117] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:31:52.839347 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-18551d74-a91a-41e0-b977-21150b2a1d7e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:52.843993 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-18551d74-a91a-41e0-b977-21150b2a1d7e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:52.855197 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-18551d74-a91a-41e0-b977-21150b2a1d7e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:52.857849 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-18551d74-a91a-41e0-b977-21150b2a1d7e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:52.858388 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-18551d74-a91a-41e0-b977-21150b2a1d7e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:52.862365 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-18551d74-a91a-41e0-b977-21150b2a1d7e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:52.862659 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-18551d74-a91a-41e0-b977-21150b2a1d7e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:52.863170 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-18551d74-a91a-41e0-b977-21150b2a1d7e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:53.295615 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-18551d74-a91a-41e0-b977-21150b2a1d7e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:53.306177 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-18551d74-a91a-41e0-b977-21150b2a1d7e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0" status: 200 len: 1732 microversion: 2.1 time: 0.477684 Oct 30 01:31:53.324790 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2039/4118] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:52 2022] GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0 => generated 1732 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:53.334712 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-df5b4f89-90d9-4a76-8a3b-6157f9ab7df1 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1971341619", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "ff033ec2-bde6-4701-9778-1e571334592d"}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:31:53.413031 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-6774272f-0cd5-4a8d-81cc-8113dd0f0934 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] [instance: 1f9c8547-e0cb-4094-a15e-d21166bda1d2] Updating instance_info_cache with network_info: [{"id": "bb118f0b-7010-4f9e-8bc1-93d4fa2233ad", "address": "fa:16:3e:ab:19:5e", "network": {"id": "ec3baca8-963c-473d-9622-8e40c5206964", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-978503035-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "edc4c8f707304cd98a5f2e13cb1d5a5b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapbb118f0b-70", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 30 01:31:53.440133 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-df5b4f89-90d9-4a76-8a3b-6157f9ab7df1 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] validate_networks() for [('ff033ec2-bde6-4701-9778-1e571334592d', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:31:53.546514 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6774272f-0cd5-4a8d-81cc-8113dd0f0934 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Releasing lock "refresh_cache-1f9c8547-e0cb-4094-a15e-d21166bda1d2" {{(pid=121102) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 30 01:31:53.549296 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6774272f-0cd5-4a8d-81cc-8113dd0f0934 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] 10.222.0.13 "POST /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2/action" status: 202 len: 0 microversion: 2.1 time: 4.464288 Oct 30 01:31:53.550797 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2080/4119] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:31:49 2022] POST /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2/action => generated 0 bytes in 4467 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 30 01:31:53.826423 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-787ac51c-17f7-43fd-a45d-cc5560daca31 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:53.827054 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-787ac51c-17f7-43fd-a45d-cc5560daca31 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:53.841061 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-787ac51c-17f7-43fd-a45d-cc5560daca31 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:53.842184 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-787ac51c-17f7-43fd-a45d-cc5560daca31 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:53.842935 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-787ac51c-17f7-43fd-a45d-cc5560daca31 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:53.844127 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-787ac51c-17f7-43fd-a45d-cc5560daca31 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:53.845594 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-787ac51c-17f7-43fd-a45d-cc5560daca31 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:53.846224 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-787ac51c-17f7-43fd-a45d-cc5560daca31 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:53.949857 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-df5b4f89-90d9-4a76-8a3b-6157f9ab7df1 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:31:53.953286 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-df5b4f89-90d9-4a76-8a3b-6157f9ab7df1 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:31:53.954721 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-df5b4f89-90d9-4a76-8a3b-6157f9ab7df1 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:31:53.955981 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-df5b4f89-90d9-4a76-8a3b-6157f9ab7df1 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:31:53.957160 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-df5b4f89-90d9-4a76-8a3b-6157f9ab7df1 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:31:53.975626 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df5b4f89-90d9-4a76-8a3b-6157f9ab7df1 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:53.979636 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df5b4f89-90d9-4a76-8a3b-6157f9ab7df1 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:53.979636 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df5b4f89-90d9-4a76-8a3b-6157f9ab7df1 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:53.981950 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df5b4f89-90d9-4a76-8a3b-6157f9ab7df1 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:53.983055 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df5b4f89-90d9-4a76-8a3b-6157f9ab7df1 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:53.983822 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df5b4f89-90d9-4a76-8a3b-6157f9ab7df1 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:54.013103 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-df5b4f89-90d9-4a76-8a3b-6157f9ab7df1 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Getting quotas for project 8b25b290c8004e1f8f89e17b448f242a. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:31:54.020679 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-df5b4f89-90d9-4a76-8a3b-6157f9ab7df1 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Getting quotas for user b0d4603acbc846dcb2f523091cd78ae4 and project 8b25b290c8004e1f8f89e17b448f242a. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:31:54.038283 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-df5b4f89-90d9-4a76-8a3b-6157f9ab7df1 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:31:54.041841 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-df5b4f89-90d9-4a76-8a3b-6157f9ab7df1 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: 6573b259-e50d-4954-9d64-3c914df97308] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:31:54.152939 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-787ac51c-17f7-43fd-a45d-cc5560daca31 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:54.162837 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-787ac51c-17f7-43fd-a45d-cc5560daca31 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:54.164307 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-787ac51c-17f7-43fd-a45d-cc5560daca31 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:54.165767 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-787ac51c-17f7-43fd-a45d-cc5560daca31 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 2943 microversion: 2.32 time: 0.613663 Oct 30 01:31:54.166333 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2081/4120] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:31:53 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 2943 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:31:54.171243 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-eefff6db-f082-456c-b28d-937cb4b5d4ae tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:31:54.173997 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-eefff6db-f082-456c-b28d-937cb4b5d4ae tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 1ed9a8e0-aee6-4785-86b8-3d5113a6c838] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:54.180451 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eefff6db-f082-456c-b28d-937cb4b5d4ae tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:54.180818 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eefff6db-f082-456c-b28d-937cb4b5d4ae tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:54.181285 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eefff6db-f082-456c-b28d-937cb4b5d4ae tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:54.184985 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eefff6db-f082-456c-b28d-937cb4b5d4ae tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:54.190748 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eefff6db-f082-456c-b28d-937cb4b5d4ae tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:54.190748 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eefff6db-f082-456c-b28d-937cb4b5d4ae tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:54.276277 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-df5b4f89-90d9-4a76-8a3b-6157f9ab7df1 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.949585 Oct 30 01:31:54.277581 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2040/4121] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:31:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 952 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:31:54.283692 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b923e662-6bfe-49d3-acc0-27d6bf4a0dca tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44c7bac430>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:54.457453 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-eefff6db-f082-456c-b28d-937cb4b5d4ae tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "PUT /compute/v2.1/servers/1ed9a8e0-aee6-4785-86b8-3d5113a6c838" status: 200 len: 1085 microversion: 2.1 time: 0.289838 Oct 30 01:31:54.469403 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2082/4122] 10.222.0.13 () {60 vars in 1256 bytes} [Sun Oct 30 01:31:54 2022] PUT /compute/v2.1/servers/1ed9a8e0-aee6-4785-86b8-3d5113a6c838 => generated 1085 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:54.469403 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c05460f6-25fd-4279-8b3d-a296caf51e5b tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:54.470046 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c05460f6-25fd-4279-8b3d-a296caf51e5b tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: 03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:54.477596 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c05460f6-25fd-4279-8b3d-a296caf51e5b tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:54.477596 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c05460f6-25fd-4279-8b3d-a296caf51e5b tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:54.477865 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c05460f6-25fd-4279-8b3d-a296caf51e5b tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:54.478483 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c05460f6-25fd-4279-8b3d-a296caf51e5b tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:54.478936 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c05460f6-25fd-4279-8b3d-a296caf51e5b tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:54.479428 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c05460f6-25fd-4279-8b3d-a296caf51e5b tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:54.587533 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c05460f6-25fd-4279-8b3d-a296caf51e5b tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:54.610213 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c05460f6-25fd-4279-8b3d-a296caf51e5b tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5" status: 200 len: 1221 microversion: 2.1 time: 0.150879 Oct 30 01:31:54.614540 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2083/4123] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:54 2022] GET /compute/v2.1/servers/03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5 => generated 1221 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:54.625824 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b7e7d016-ac64-4e4a-80ca-fd7fb862427d tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:54.629626 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b7e7d016-ac64-4e4a-80ca-fd7fb862427d tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:54.643617 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b7e7d016-ac64-4e4a-80ca-fd7fb862427d tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:54.645387 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b7e7d016-ac64-4e4a-80ca-fd7fb862427d tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:54.646821 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b7e7d016-ac64-4e4a-80ca-fd7fb862427d tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:54.649293 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b7e7d016-ac64-4e4a-80ca-fd7fb862427d tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:54.650010 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b7e7d016-ac64-4e4a-80ca-fd7fb862427d tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:54.651610 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b7e7d016-ac64-4e4a-80ca-fd7fb862427d tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:55.092473 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b7e7d016-ac64-4e4a-80ca-fd7fb862427d tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.475776 Oct 30 01:31:55.095691 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2084/4124] 10.222.0.13 () {58 vars in 1275 bytes} [Sun Oct 30 01:31:54 2022] GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0/os-interface => generated 285 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:31:55.103043 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-132a9971-f220-4040-b6f0-9f13719d8c26 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Calling method '.version_select at 0x7f44cc068040>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:55.333174 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b923e662-6bfe-49d3-acc0-27d6bf4a0dca tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "DELETE /compute/v2.1/images/8bc93c69-a84f-4e09-ae04-7dc6be567aa6" status: 204 len: 0 microversion: 2.1 time: 1.053114 Oct 30 01:31:55.335989 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2041/4125] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:54 2022] DELETE /compute/v2.1/images/8bc93c69-a84f-4e09-ae04-7dc6be567aa6 => generated 0 bytes in 1057 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:31:55.344495 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f8ddf681-2452-40f3-95af-6399ffc5712b tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:55.346687 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f8ddf681-2452-40f3-95af-6399ffc5712b tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:55.357429 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f8ddf681-2452-40f3-95af-6399ffc5712b tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:55.358254 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f8ddf681-2452-40f3-95af-6399ffc5712b tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:55.359095 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f8ddf681-2452-40f3-95af-6399ffc5712b tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:55.360086 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f8ddf681-2452-40f3-95af-6399ffc5712b tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:55.361289 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f8ddf681-2452-40f3-95af-6399ffc5712b tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:55.361965 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f8ddf681-2452-40f3-95af-6399ffc5712b tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:55.641604 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f8ddf681-2452-40f3-95af-6399ffc5712b tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.303475 Oct 30 01:31:55.643137 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2042/4126] 10.222.0.13 () {60 vars in 1316 bytes} [Sun Oct 30 01:31:55 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018/os-interface => generated 1832 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:31:55.649722 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-41acde66-5b94-453e-a0dc-51caa0524010 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-822204836", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "451", "networks": [{"uuid": "ff033ec2-bde6-4701-9778-1e571334592d"}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:31:55.726436 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-41acde66-5b94-453e-a0dc-51caa0524010 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] validate_networks() for [('ff033ec2-bde6-4701-9778-1e571334592d', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:31:56.725719 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-41acde66-5b94-453e-a0dc-51caa0524010 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:31:56.726836 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-41acde66-5b94-453e-a0dc-51caa0524010 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:31:56.727510 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-41acde66-5b94-453e-a0dc-51caa0524010 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:31:56.728073 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-41acde66-5b94-453e-a0dc-51caa0524010 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:31:56.728844 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-41acde66-5b94-453e-a0dc-51caa0524010 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:31:56.750053 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-41acde66-5b94-453e-a0dc-51caa0524010 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:56.750874 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-41acde66-5b94-453e-a0dc-51caa0524010 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:56.754330 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-41acde66-5b94-453e-a0dc-51caa0524010 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:56.755428 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-41acde66-5b94-453e-a0dc-51caa0524010 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:56.756444 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-41acde66-5b94-453e-a0dc-51caa0524010 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:56.758730 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-41acde66-5b94-453e-a0dc-51caa0524010 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:56.810423 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-41acde66-5b94-453e-a0dc-51caa0524010 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Getting quotas for project 8b25b290c8004e1f8f89e17b448f242a. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:31:56.819025 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-41acde66-5b94-453e-a0dc-51caa0524010 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Getting quotas for user b0d4603acbc846dcb2f523091cd78ae4 and project 8b25b290c8004e1f8f89e17b448f242a. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:31:56.855891 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-41acde66-5b94-453e-a0dc-51caa0524010 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:31:56.859151 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-41acde66-5b94-453e-a0dc-51caa0524010 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: 86461b51-bd22-446e-a37e-985c21f7ccd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:31:56.978000 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-132a9971-f220-4040-b6f0-9f13719d8c26 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] 10.222.0.13 "DELETE /compute/v2.1/os-floating-ips/7163af4f-a1e3-4acc-ae0e-946cbeeef488" status: 202 len: 0 microversion: 2.1 time: 1.880279 Oct 30 01:31:56.981840 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2085/4127] 10.222.0.13 () {58 vars in 1263 bytes} [Sun Oct 30 01:31:55 2022] DELETE /compute/v2.1/os-floating-ips/7163af4f-a1e3-4acc-ae0e-946cbeeef488 => generated 0 bytes in 1885 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:31:56.988431 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-36631e94-b96d-43d7-936c-ea1a77e6b3a8 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:56.989255 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-36631e94-b96d-43d7-936c-ea1a77e6b3a8 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 1ed9a8e0-aee6-4785-86b8-3d5113a6c838] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:57.004538 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-36631e94-b96d-43d7-936c-ea1a77e6b3a8 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:57.005241 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-36631e94-b96d-43d7-936c-ea1a77e6b3a8 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:57.005887 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-36631e94-b96d-43d7-936c-ea1a77e6b3a8 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:57.006735 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-36631e94-b96d-43d7-936c-ea1a77e6b3a8 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:57.007327 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-36631e94-b96d-43d7-936c-ea1a77e6b3a8 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:57.008021 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-36631e94-b96d-43d7-936c-ea1a77e6b3a8 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:57.055842 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-41acde66-5b94-453e-a0dc-51caa0524010 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.409661 Oct 30 01:31:57.057057 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2043/4128] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:31:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1413 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:31:57.062315 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-71834f7d-8c89-440a-9cab-3a7d1d8341c6 req-e14c01d9-6e78-4056-9d62-fd53915386bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f9c8547-e0cb-4094-a15e-d21166bda1d2", "tag": "bb118f0b-7010-4f9e-8bc1-93d4fa2233ad"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:31:57.075994 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-71834f7d-8c89-440a-9cab-3a7d1d8341c6 req-e14c01d9-6e78-4056-9d62-fd53915386bf service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:57.076900 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-71834f7d-8c89-440a-9cab-3a7d1d8341c6 req-e14c01d9-6e78-4056-9d62-fd53915386bf service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:57.077661 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-71834f7d-8c89-440a-9cab-3a7d1d8341c6 req-e14c01d9-6e78-4056-9d62-fd53915386bf service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:57.092569 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-71834f7d-8c89-440a-9cab-3a7d1d8341c6 req-e14c01d9-6e78-4056-9d62-fd53915386bf service nova] Creating event network-changed:bb118f0b-7010-4f9e-8bc1-93d4fa2233ad for instance 1f9c8547-e0cb-4094-a15e-d21166bda1d2 on n-h1-master-1 Oct 30 01:31:57.116841 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-71834f7d-8c89-440a-9cab-3a7d1d8341c6 req-e14c01d9-6e78-4056-9d62-fd53915386bf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057443 Oct 30 01:31:57.121773 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2044/4129] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:31:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:31:57.134887 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c61c4ab6-e4a7-4863-adf9-0466b2ad0f00 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44cc8db8b0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:57.735773 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-36631e94-b96d-43d7-936c-ea1a77e6b3a8 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:57.744517 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-36631e94-b96d-43d7-936c-ea1a77e6b3a8 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/1ed9a8e0-aee6-4785-86b8-3d5113a6c838" status: 200 len: 1511 microversion: 2.1 time: 0.761035 Oct 30 01:31:57.745985 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2086/4130] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:56 2022] GET /compute/v2.1/servers/1ed9a8e0-aee6-4785-86b8-3d5113a6c838 => generated 1511 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:57.752540 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1c3e808a-b026-4348-b40d-bb9e422bee93 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:57.753354 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1c3e808a-b026-4348-b40d-bb9e422bee93 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: 03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:57.762669 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1c3e808a-b026-4348-b40d-bb9e422bee93 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:57.763322 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1c3e808a-b026-4348-b40d-bb9e422bee93 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:57.764770 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1c3e808a-b026-4348-b40d-bb9e422bee93 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:57.765740 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1c3e808a-b026-4348-b40d-bb9e422bee93 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:57.766447 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1c3e808a-b026-4348-b40d-bb9e422bee93 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:57.767017 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1c3e808a-b026-4348-b40d-bb9e422bee93 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:57.907959 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1c3e808a-b026-4348-b40d-bb9e422bee93 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:57.917555 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1c3e808a-b026-4348-b40d-bb9e422bee93 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5" status: 200 len: 1275 microversion: 2.1 time: 0.169597 Oct 30 01:31:57.927440 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2087/4131] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:57 2022] GET /compute/v2.1/servers/03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5 => generated 1275 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:57.934488 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1baf2689-345d-44fa-9b87-c44c06adcb79 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Calling method '.version_select at 0x7f44d03ff040>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:57.936033 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c61c4ab6-e4a7-4863-adf9-0466b2ad0f00 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "DELETE /compute/v2.1/images/64e7fa8f-dcd0-4b25-a2dc-f68729d10224" status: 204 len: 0 microversion: 2.1 time: 0.812329 Oct 30 01:31:57.936609 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2045/4132] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:57 2022] DELETE /compute/v2.1/images/64e7fa8f-dcd0-4b25-a2dc-f68729d10224 => generated 0 bytes in 814 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:31:57.942266 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-79db0bca-49f2-4095-948a-518fc08d5d80 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:57.943207 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-79db0bca-49f2-4095-948a-518fc08d5d80 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: 86461b51-bd22-446e-a37e-985c21f7ccd5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:58.215048 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-79db0bca-49f2-4095-948a-518fc08d5d80 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:58.229547 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-79db0bca-49f2-4095-948a-518fc08d5d80 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers/86461b51-bd22-446e-a37e-985c21f7ccd5" status: 200 len: 1220 microversion: 2.1 time: 0.291595 Oct 30 01:31:58.231301 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2046/4133] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:57 2022] GET /compute/v2.1/servers/86461b51-bd22-446e-a37e-985c21f7ccd5 => generated 1220 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:58.244153 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-3ed1e5ed-097f-4857-946d-871aabb8297a req-d176cd51-2e84-4479-9366-111a2f3e6cad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0", "tag": "b06d8a65-6a4c-4fc9-9c2f-932d1a6b84ab"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:31:58.256334 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-3ed1e5ed-097f-4857-946d-871aabb8297a req-d176cd51-2e84-4479-9366-111a2f3e6cad service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:58.257238 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-3ed1e5ed-097f-4857-946d-871aabb8297a req-d176cd51-2e84-4479-9366-111a2f3e6cad service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:58.257868 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-3ed1e5ed-097f-4857-946d-871aabb8297a req-d176cd51-2e84-4479-9366-111a2f3e6cad service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:58.274004 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-3ed1e5ed-097f-4857-946d-871aabb8297a req-d176cd51-2e84-4479-9366-111a2f3e6cad service nova] Creating event network-changed:b06d8a65-6a4c-4fc9-9c2f-932d1a6b84ab for instance 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0 on n-h1-master-1 Oct 30 01:31:58.279668 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-3ed1e5ed-097f-4857-946d-871aabb8297a req-d176cd51-2e84-4479-9366-111a2f3e6cad service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044957 Oct 30 01:31:58.280856 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2047/4134] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:31:58.288150 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7fe03740-cbaf-4402-b616-337f55454c01 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:58.289230 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7fe03740-cbaf-4402-b616-337f55454c01 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 1ed9a8e0-aee6-4785-86b8-3d5113a6c838] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:58.299280 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7fe03740-cbaf-4402-b616-337f55454c01 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:58.301648 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7fe03740-cbaf-4402-b616-337f55454c01 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:58.302432 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7fe03740-cbaf-4402-b616-337f55454c01 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:58.305213 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7fe03740-cbaf-4402-b616-337f55454c01 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:58.305908 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7fe03740-cbaf-4402-b616-337f55454c01 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:58.306518 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7fe03740-cbaf-4402-b616-337f55454c01 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:59.150033 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7fe03740-cbaf-4402-b616-337f55454c01 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:31:59.164055 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7fe03740-cbaf-4402-b616-337f55454c01 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/1ed9a8e0-aee6-4785-86b8-3d5113a6c838" status: 200 len: 1511 microversion: 2.1 time: 0.880215 Oct 30 01:31:59.166252 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2048/4135] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:58 2022] GET /compute/v2.1/servers/1ed9a8e0-aee6-4785-86b8-3d5113a6c838 => generated 1511 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:31:59.175063 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-87689dba-4df6-4688-bb0b-60d9ee7b1152 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] Calling method '.version_select at 0x7f44cc8db8b0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:59.497914 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1baf2689-345d-44fa-9b87-c44c06adcb79 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/6692fdf2-d7fc-46ce-a911-97670349d390" status: 202 len: 0 microversion: 2.1 time: 1.567404 Oct 30 01:31:59.503185 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2088/4136] 10.222.0.13 () {58 vars in 1272 bytes} [Sun Oct 30 01:31:57 2022] DELETE /compute/v2.1/os-security-groups/6692fdf2-d7fc-46ce-a911-97670349d390 => generated 0 bytes in 1575 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:31:59.518928 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0db778da-48a6-4972-bfb6-3e196fd83828 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:59.521218 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0db778da-48a6-4972-bfb6-3e196fd83828 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: 03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:59.571458 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0db778da-48a6-4972-bfb6-3e196fd83828 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:59.573070 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0db778da-48a6-4972-bfb6-3e196fd83828 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:59.573817 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0db778da-48a6-4972-bfb6-3e196fd83828 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:59.574631 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0db778da-48a6-4972-bfb6-3e196fd83828 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:59.575588 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0db778da-48a6-4972-bfb6-3e196fd83828 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:59.577307 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0db778da-48a6-4972-bfb6-3e196fd83828 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:59.812109 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-87689dba-4df6-4688-bb0b-60d9ee7b1152 tempest-ListImageFiltersTestJSON-651227105 tempest-ListImageFiltersTestJSON-651227105-project] 10.222.0.13 "DELETE /compute/v2.1/images/234948a7-5415-40b5-a397-9bf3004e532a" status: 204 len: 0 microversion: 2.1 time: 0.644033 Oct 30 01:31:59.812941 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2049/4137] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:59 2022] DELETE /compute/v2.1/images/234948a7-5415-40b5-a397-9bf3004e532a => generated 0 bytes in 646 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:31:59.821364 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b0757ce0-42e0-4aff-b6c6-02ada9aea75d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:31:59.822162 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b0757ce0-42e0-4aff-b6c6-02ada9aea75d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 1ed9a8e0-aee6-4785-86b8-3d5113a6c838] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:31:59.838400 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b0757ce0-42e0-4aff-b6c6-02ada9aea75d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:59.839332 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b0757ce0-42e0-4aff-b6c6-02ada9aea75d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:59.839942 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b0757ce0-42e0-4aff-b6c6-02ada9aea75d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:31:59.840930 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b0757ce0-42e0-4aff-b6c6-02ada9aea75d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:31:59.841762 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b0757ce0-42e0-4aff-b6c6-02ada9aea75d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:31:59.842330 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b0757ce0-42e0-4aff-b6c6-02ada9aea75d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:00.054105 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b0757ce0-42e0-4aff-b6c6-02ada9aea75d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 1ed9a8e0-aee6-4785-86b8-3d5113a6c838] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:32:00.054770 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0db778da-48a6-4972-bfb6-3e196fd83828 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:00.060091 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0db778da-48a6-4972-bfb6-3e196fd83828 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5" status: 200 len: 1317 microversion: 2.1 time: 0.554034 Oct 30 01:32:00.077208 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2089/4138] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:31:59 2022] GET /compute/v2.1/servers/03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5 => generated 1317 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:00.083940 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8030860d-2b51-4892-8f84-acac5f43dbbe tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:00.084559 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8030860d-2b51-4892-8f84-acac5f43dbbe tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: 86461b51-bd22-446e-a37e-985c21f7ccd5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:00.092597 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8030860d-2b51-4892-8f84-acac5f43dbbe tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:00.093787 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8030860d-2b51-4892-8f84-acac5f43dbbe tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:00.095189 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8030860d-2b51-4892-8f84-acac5f43dbbe tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:00.096074 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8030860d-2b51-4892-8f84-acac5f43dbbe tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:00.097513 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8030860d-2b51-4892-8f84-acac5f43dbbe tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:00.098131 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8030860d-2b51-4892-8f84-acac5f43dbbe tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:00.189757 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8030860d-2b51-4892-8f84-acac5f43dbbe tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:00.199919 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8030860d-2b51-4892-8f84-acac5f43dbbe tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers/86461b51-bd22-446e-a37e-985c21f7ccd5" status: 200 len: 1272 microversion: 2.1 time: 0.119260 Oct 30 01:32:00.201053 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2090/4139] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:00 2022] GET /compute/v2.1/servers/86461b51-bd22-446e-a37e-985c21f7ccd5 => generated 1272 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:00.227597 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7c933ab6-9532-435b-a20f-6567e7d5c4b3 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:00.233266 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7c933ab6-9532-435b-a20f-6567e7d5c4b3 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] [instance: 1f9c8547-e0cb-4094-a15e-d21166bda1d2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:00.265503 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7c933ab6-9532-435b-a20f-6567e7d5c4b3 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:00.266923 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7c933ab6-9532-435b-a20f-6567e7d5c4b3 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:00.267473 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7c933ab6-9532-435b-a20f-6567e7d5c4b3 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:00.268313 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7c933ab6-9532-435b-a20f-6567e7d5c4b3 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:00.268878 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7c933ab6-9532-435b-a20f-6567e7d5c4b3 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:00.269438 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7c933ab6-9532-435b-a20f-6567e7d5c4b3 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:00.333639 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7c933ab6-9532-435b-a20f-6567e7d5c4b3 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] [instance: 1f9c8547-e0cb-4094-a15e-d21166bda1d2] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:32:00.382600 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b0757ce0-42e0-4aff-b6c6-02ada9aea75d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "DELETE /compute/v2.1/servers/1ed9a8e0-aee6-4785-86b8-3d5113a6c838" status: 204 len: 0 microversion: 2.1 time: 0.568343 Oct 30 01:32:00.390536 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2050/4140] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:31:59 2022] DELETE /compute/v2.1/servers/1ed9a8e0-aee6-4785-86b8-3d5113a6c838 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:32:00.392807 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-912ba81a-4544-4faf-b7ce-04e9e2645a28 req-2503e455-cd62-4b54-ac5c-1952ca602629 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b36a2df7-45c9-4a51-88f1-e1a1b9c0969d", "tag": "2d246f01-5e64-4b29-8a36-b25ca8039340"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:32:00.402290 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-912ba81a-4544-4faf-b7ce-04e9e2645a28 req-2503e455-cd62-4b54-ac5c-1952ca602629 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:00.402768 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-912ba81a-4544-4faf-b7ce-04e9e2645a28 req-2503e455-cd62-4b54-ac5c-1952ca602629 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:00.403370 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-912ba81a-4544-4faf-b7ce-04e9e2645a28 req-2503e455-cd62-4b54-ac5c-1952ca602629 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:00.415258 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-912ba81a-4544-4faf-b7ce-04e9e2645a28 req-2503e455-cd62-4b54-ac5c-1952ca602629 service nova] Creating event network-changed:2d246f01-5e64-4b29-8a36-b25ca8039340 for instance b36a2df7-45c9-4a51-88f1-e1a1b9c0969d on n-h1-master-1 Oct 30 01:32:00.427677 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-912ba81a-4544-4faf-b7ce-04e9e2645a28 req-2503e455-cd62-4b54-ac5c-1952ca602629 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034095 Oct 30 01:32:00.427677 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2051/4141] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:32:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:32:00.427677 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-a61149be-67ae-4a4d-932a-1d514d364121 req-9cda0ca1-e599-40bb-9744-9822f6a2263c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0", "tag": "b06d8a65-6a4c-4fc9-9c2f-932d1a6b84ab"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:32:00.439137 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-a61149be-67ae-4a4d-932a-1d514d364121 req-9cda0ca1-e599-40bb-9744-9822f6a2263c service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:00.439616 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-a61149be-67ae-4a4d-932a-1d514d364121 req-9cda0ca1-e599-40bb-9744-9822f6a2263c service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:00.440041 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-a61149be-67ae-4a4d-932a-1d514d364121 req-9cda0ca1-e599-40bb-9744-9822f6a2263c service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:00.451617 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-a61149be-67ae-4a4d-932a-1d514d364121 req-9cda0ca1-e599-40bb-9744-9822f6a2263c service nova] Creating event network-changed:b06d8a65-6a4c-4fc9-9c2f-932d1a6b84ab for instance 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0 on n-h1-master-1 Oct 30 01:32:00.457302 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-a61149be-67ae-4a4d-932a-1d514d364121 req-9cda0ca1-e599-40bb-9744-9822f6a2263c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034149 Oct 30 01:32:00.459736 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2052/4142] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:32:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:32:00.463527 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-578a0ffd-1f9d-4650-bf2f-8c481740de30 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:00.464220 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-578a0ffd-1f9d-4650-bf2f-8c481740de30 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 1ed9a8e0-aee6-4785-86b8-3d5113a6c838] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:00.470779 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-578a0ffd-1f9d-4650-bf2f-8c481740de30 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:00.471698 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-578a0ffd-1f9d-4650-bf2f-8c481740de30 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:00.471698 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-578a0ffd-1f9d-4650-bf2f-8c481740de30 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:00.472365 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-578a0ffd-1f9d-4650-bf2f-8c481740de30 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:00.472816 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-578a0ffd-1f9d-4650-bf2f-8c481740de30 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:00.473234 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-578a0ffd-1f9d-4650-bf2f-8c481740de30 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:00.763872 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7c933ab6-9532-435b-a20f-6567e7d5c4b3 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] 10.222.0.13 "DELETE /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2" status: 204 len: 0 microversion: 2.1 time: 0.561199 Oct 30 01:32:00.769186 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2091/4143] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:32:00 2022] DELETE /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:32:00.775977 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-abbe9ee6-4721-4352-8e28-1ef3ec29b8c2 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:00.776692 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-abbe9ee6-4721-4352-8e28-1ef3ec29b8c2 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] [instance: 1f9c8547-e0cb-4094-a15e-d21166bda1d2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:00.783822 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-abbe9ee6-4721-4352-8e28-1ef3ec29b8c2 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:00.784572 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-abbe9ee6-4721-4352-8e28-1ef3ec29b8c2 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:00.785220 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-abbe9ee6-4721-4352-8e28-1ef3ec29b8c2 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:00.786151 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-abbe9ee6-4721-4352-8e28-1ef3ec29b8c2 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:00.786760 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-abbe9ee6-4721-4352-8e28-1ef3ec29b8c2 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:00.787395 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-abbe9ee6-4721-4352-8e28-1ef3ec29b8c2 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:00.808938 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-578a0ffd-1f9d-4650-bf2f-8c481740de30 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:00.819415 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-578a0ffd-1f9d-4650-bf2f-8c481740de30 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/1ed9a8e0-aee6-4785-86b8-3d5113a6c838" status: 200 len: 1517 microversion: 2.1 time: 0.360116 Oct 30 01:32:00.837369 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2053/4144] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:00 2022] GET /compute/v2.1/servers/1ed9a8e0-aee6-4785-86b8-3d5113a6c838 => generated 1517 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:01.067841 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-abbe9ee6-4721-4352-8e28-1ef3ec29b8c2 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec278d8d7b4a5a96af042ba613bafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc4c8f707304cd98a5f2e13cb1d5a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:01.087093 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-abbe9ee6-4721-4352-8e28-1ef3ec29b8c2 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] 10.222.0.13 "GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2" status: 200 len: 1508 microversion: 2.1 time: 0.305780 Oct 30 01:32:01.087093 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2092/4145] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:00 2022] GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2 => generated 1508 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:01.087323 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-98bccb0f-34fb-4b76-a0fd-dd32a15b7ab1 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:01.087323 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-98bccb0f-34fb-4b76-a0fd-dd32a15b7ab1 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: 03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:01.090226 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-98bccb0f-34fb-4b76-a0fd-dd32a15b7ab1 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:01.090892 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-98bccb0f-34fb-4b76-a0fd-dd32a15b7ab1 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:01.091523 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-98bccb0f-34fb-4b76-a0fd-dd32a15b7ab1 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:01.092446 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-98bccb0f-34fb-4b76-a0fd-dd32a15b7ab1 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:01.093841 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-98bccb0f-34fb-4b76-a0fd-dd32a15b7ab1 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:01.095051 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-98bccb0f-34fb-4b76-a0fd-dd32a15b7ab1 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:01.238677 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9b0df14b-ce93-4417-96c1-a853d6a6e9c8 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:01.240032 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9b0df14b-ce93-4417-96c1-a853d6a6e9c8 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: 86461b51-bd22-446e-a37e-985c21f7ccd5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:01.249674 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b0df14b-ce93-4417-96c1-a853d6a6e9c8 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:01.250261 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b0df14b-ce93-4417-96c1-a853d6a6e9c8 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:01.250768 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b0df14b-ce93-4417-96c1-a853d6a6e9c8 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:01.251709 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b0df14b-ce93-4417-96c1-a853d6a6e9c8 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:01.252237 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b0df14b-ce93-4417-96c1-a853d6a6e9c8 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:01.252762 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b0df14b-ce93-4417-96c1-a853d6a6e9c8 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:01.338197 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-98bccb0f-34fb-4b76-a0fd-dd32a15b7ab1 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:01.349120 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-98bccb0f-34fb-4b76-a0fd-dd32a15b7ab1 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5" status: 200 len: 1317 microversion: 2.1 time: 0.269570 Oct 30 01:32:01.355576 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2054/4146] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:01 2022] GET /compute/v2.1/servers/03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5 => generated 1317 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:01.356977 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9b0df14b-ce93-4417-96c1-a853d6a6e9c8 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:01.365733 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9b0df14b-ce93-4417-96c1-a853d6a6e9c8 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers/86461b51-bd22-446e-a37e-985c21f7ccd5" status: 200 len: 1272 microversion: 2.1 time: 0.131632 Oct 30 01:32:01.366317 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2093/4147] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:01 2022] GET /compute/v2.1/servers/86461b51-bd22-446e-a37e-985c21f7ccd5 => generated 1272 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:32:01.844361 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7b82f357-1f06-4468-a7d4-e96f109b63c6 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:01.844986 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7b82f357-1f06-4468-a7d4-e96f109b63c6 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 1ed9a8e0-aee6-4785-86b8-3d5113a6c838] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:01.847871 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=12,nova_api:UPDATE=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:01.857450 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b82f357-1f06-4468-a7d4-e96f109b63c6 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:01.858666 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b82f357-1f06-4468-a7d4-e96f109b63c6 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:01.859908 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b82f357-1f06-4468-a7d4-e96f109b63c6 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:01.860794 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b82f357-1f06-4468-a7d4-e96f109b63c6 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:01.861433 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b82f357-1f06-4468-a7d4-e96f109b63c6 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:01.862227 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b82f357-1f06-4468-a7d4-e96f109b63c6 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:02.043265 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7b82f357-1f06-4468-a7d4-e96f109b63c6 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:02.063298 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7b82f357-1f06-4468-a7d4-e96f109b63c6 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/1ed9a8e0-aee6-4785-86b8-3d5113a6c838" status: 200 len: 1517 microversion: 2.1 time: 0.222234 Oct 30 01:32:02.079162 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2055/4148] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:01 2022] GET /compute/v2.1/servers/1ed9a8e0-aee6-4785-86b8-3d5113a6c838 => generated 1517 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:02.102157 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5b155a83-0b6b-46e4-aca9-108df26043e5 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:02.102801 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5b155a83-0b6b-46e4-aca9-108df26043e5 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] [instance: 1f9c8547-e0cb-4094-a15e-d21166bda1d2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:02.114366 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5b155a83-0b6b-46e4-aca9-108df26043e5 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:02.114854 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5b155a83-0b6b-46e4-aca9-108df26043e5 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:02.116959 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5b155a83-0b6b-46e4-aca9-108df26043e5 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:02.116959 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5b155a83-0b6b-46e4-aca9-108df26043e5 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:02.116959 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5b155a83-0b6b-46e4-aca9-108df26043e5 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:02.117719 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5b155a83-0b6b-46e4-aca9-108df26043e5 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:02.325694 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5b155a83-0b6b-46e4-aca9-108df26043e5 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec278d8d7b4a5a96af042ba613bafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc4c8f707304cd98a5f2e13cb1d5a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:02.335992 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5b155a83-0b6b-46e4-aca9-108df26043e5 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] 10.222.0.13 "GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2" status: 200 len: 1508 microversion: 2.1 time: 0.238027 Oct 30 01:32:02.356089 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2094/4149] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:02 2022] GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2 => generated 1508 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:02.385505 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4d574340-8a75-4106-b9d0-0c80fbbf04c6 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:02.386538 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4d574340-8a75-4106-b9d0-0c80fbbf04c6 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: 03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:02.402298 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4d574340-8a75-4106-b9d0-0c80fbbf04c6 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:02.404796 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4d574340-8a75-4106-b9d0-0c80fbbf04c6 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:02.406153 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4d574340-8a75-4106-b9d0-0c80fbbf04c6 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:02.407780 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-47aac22a-1a6d-4fb5-a4c0-3381abd950ff tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:02.407780 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-47aac22a-1a6d-4fb5-a4c0-3381abd950ff tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: 86461b51-bd22-446e-a37e-985c21f7ccd5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:02.409120 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4d574340-8a75-4106-b9d0-0c80fbbf04c6 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:02.412686 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4d574340-8a75-4106-b9d0-0c80fbbf04c6 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:02.414589 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4d574340-8a75-4106-b9d0-0c80fbbf04c6 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:02.418393 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:02.433996 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-47aac22a-1a6d-4fb5-a4c0-3381abd950ff tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:02.436437 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-47aac22a-1a6d-4fb5-a4c0-3381abd950ff tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:02.436437 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-47aac22a-1a6d-4fb5-a4c0-3381abd950ff tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:02.438385 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-47aac22a-1a6d-4fb5-a4c0-3381abd950ff tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:02.438868 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-47aac22a-1a6d-4fb5-a4c0-3381abd950ff tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:02.440469 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-47aac22a-1a6d-4fb5-a4c0-3381abd950ff tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:02.539708 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-47aac22a-1a6d-4fb5-a4c0-3381abd950ff tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:02.542009 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:02.551253 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-47aac22a-1a6d-4fb5-a4c0-3381abd950ff tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers/86461b51-bd22-446e-a37e-985c21f7ccd5" status: 200 len: 1290 microversion: 2.1 time: 0.158235 Oct 30 01:32:02.551253 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2095/4150] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:02 2022] GET /compute/v2.1/servers/86461b51-bd22-446e-a37e-985c21f7ccd5 => generated 1290 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:02.555712 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-878e835e-d559-4d99-8c19-56c1141d6ae1 req-99d0fc73-daa4-48f2-9dc2-5da3cdbbedc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5", "tag": "25e46010-3b1a-4be2-b2f0-3b3def5c4df9"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:32:02.566242 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-878e835e-d559-4d99-8c19-56c1141d6ae1 req-99d0fc73-daa4-48f2-9dc2-5da3cdbbedc4 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:02.567318 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-878e835e-d559-4d99-8c19-56c1141d6ae1 req-99d0fc73-daa4-48f2-9dc2-5da3cdbbedc4 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:02.568186 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-878e835e-d559-4d99-8c19-56c1141d6ae1 req-99d0fc73-daa4-48f2-9dc2-5da3cdbbedc4 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:02.582228 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-878e835e-d559-4d99-8c19-56c1141d6ae1 req-99d0fc73-daa4-48f2-9dc2-5da3cdbbedc4 service nova] Creating event network-changed:25e46010-3b1a-4be2-b2f0-3b3def5c4df9 for instance 03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5 on n-h1-master-1 Oct 30 01:32:02.586724 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-878e835e-d559-4d99-8c19-56c1141d6ae1 req-99d0fc73-daa4-48f2-9dc2-5da3cdbbedc4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035303 Oct 30 01:32:02.587657 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2096/4151] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:32:02.695790 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4d574340-8a75-4106-b9d0-0c80fbbf04c6 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:02.705435 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4d574340-8a75-4106-b9d0-0c80fbbf04c6 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5" status: 200 len: 1317 microversion: 2.1 time: 0.332348 Oct 30 01:32:02.706570 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2056/4152] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:02 2022] GET /compute/v2.1/servers/03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5 => generated 1317 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:03.088457 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d3c03a27-6640-4258-977e-091479fdb923 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:03.091844 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d3c03a27-6640-4258-977e-091479fdb923 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 1ed9a8e0-aee6-4785-86b8-3d5113a6c838] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:03.097298 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3c03a27-6640-4258-977e-091479fdb923 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:03.097811 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3c03a27-6640-4258-977e-091479fdb923 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:03.106220 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3c03a27-6640-4258-977e-091479fdb923 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:03.107524 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3c03a27-6640-4258-977e-091479fdb923 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:03.108053 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3c03a27-6640-4258-977e-091479fdb923 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:03.110974 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3c03a27-6640-4258-977e-091479fdb923 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:03.243747 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d3c03a27-6640-4258-977e-091479fdb923 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:03.254663 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d3c03a27-6640-4258-977e-091479fdb923 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/1ed9a8e0-aee6-4785-86b8-3d5113a6c838" status: 200 len: 1475 microversion: 2.1 time: 0.170284 Oct 30 01:32:03.255231 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2097/4153] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:03 2022] GET /compute/v2.1/servers/1ed9a8e0-aee6-4785-86b8-3d5113a6c838 => generated 1475 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:03.367376 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2f97ab78-8c05-4ab5-9017-6524fb2861a0 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:03.367376 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2f97ab78-8c05-4ab5-9017-6524fb2861a0 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] [instance: 1f9c8547-e0cb-4094-a15e-d21166bda1d2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:03.379355 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f97ab78-8c05-4ab5-9017-6524fb2861a0 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:03.380210 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f97ab78-8c05-4ab5-9017-6524fb2861a0 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:03.381427 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f97ab78-8c05-4ab5-9017-6524fb2861a0 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:03.385415 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f97ab78-8c05-4ab5-9017-6524fb2861a0 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:03.386270 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f97ab78-8c05-4ab5-9017-6524fb2861a0 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:03.391266 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f97ab78-8c05-4ab5-9017-6524fb2861a0 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:03.576280 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0361fa01-5ccc-43de-bafc-faa688f0d321 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:03.576950 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0361fa01-5ccc-43de-bafc-faa688f0d321 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: 86461b51-bd22-446e-a37e-985c21f7ccd5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:03.584634 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0361fa01-5ccc-43de-bafc-faa688f0d321 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:03.585285 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0361fa01-5ccc-43de-bafc-faa688f0d321 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:03.586037 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0361fa01-5ccc-43de-bafc-faa688f0d321 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:03.586841 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0361fa01-5ccc-43de-bafc-faa688f0d321 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:03.587369 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0361fa01-5ccc-43de-bafc-faa688f0d321 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:03.587917 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0361fa01-5ccc-43de-bafc-faa688f0d321 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:04.150245 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2f97ab78-8c05-4ab5-9017-6524fb2861a0 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec278d8d7b4a5a96af042ba613bafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc4c8f707304cd98a5f2e13cb1d5a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:04.187398 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2f97ab78-8c05-4ab5-9017-6524fb2861a0 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] 10.222.0.13 "GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2" status: 200 len: 1508 microversion: 2.1 time: 0.830592 Oct 30 01:32:04.188933 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2057/4154] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:03 2022] GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2 => generated 1508 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:04.197366 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-74bacb8f-cb17-4c51-b902-dea57bd21b66 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:04.202062 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-74bacb8f-cb17-4c51-b902-dea57bd21b66 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: 03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:04.202176 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0361fa01-5ccc-43de-bafc-faa688f0d321 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:04.208184 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-74bacb8f-cb17-4c51-b902-dea57bd21b66 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:04.208968 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-74bacb8f-cb17-4c51-b902-dea57bd21b66 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:04.210580 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-74bacb8f-cb17-4c51-b902-dea57bd21b66 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:04.212540 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-74bacb8f-cb17-4c51-b902-dea57bd21b66 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:04.213399 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-74bacb8f-cb17-4c51-b902-dea57bd21b66 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:04.214027 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0361fa01-5ccc-43de-bafc-faa688f0d321 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers/86461b51-bd22-446e-a37e-985c21f7ccd5" status: 200 len: 1320 microversion: 2.1 time: 0.641957 Oct 30 01:32:04.214513 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-74bacb8f-cb17-4c51-b902-dea57bd21b66 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:04.216495 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2098/4155] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:03 2022] GET /compute/v2.1/servers/86461b51-bd22-446e-a37e-985c21f7ccd5 => generated 1320 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:32:04.226662 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-c66f24dd-bd68-40b0-a4a5-fdcb1817c87f req-b570bcd3-4b34-4f1b-9fea-b7ff0bed6925 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ed9a8e0-aee6-4785-86b8-3d5113a6c838", "name": "network-vif-deleted", "tag": "73950017-fffa-4c2f-ad1f-d656bc765f11"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:32:04.244739 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-c66f24dd-bd68-40b0-a4a5-fdcb1817c87f req-b570bcd3-4b34-4f1b-9fea-b7ff0bed6925 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:04.245231 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-c66f24dd-bd68-40b0-a4a5-fdcb1817c87f req-b570bcd3-4b34-4f1b-9fea-b7ff0bed6925 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:04.245697 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-c66f24dd-bd68-40b0-a4a5-fdcb1817c87f req-b570bcd3-4b34-4f1b-9fea-b7ff0bed6925 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:04.260561 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-c66f24dd-bd68-40b0-a4a5-fdcb1817c87f req-b570bcd3-4b34-4f1b-9fea-b7ff0bed6925 service nova] Creating event network-vif-deleted:73950017-fffa-4c2f-ad1f-d656bc765f11 for instance 1ed9a8e0-aee6-4785-86b8-3d5113a6c838 on n-h2-master-1 Oct 30 01:32:04.266125 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-c66f24dd-bd68-40b0-a4a5-fdcb1817c87f req-b570bcd3-4b34-4f1b-9fea-b7ff0bed6925 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047923 Oct 30 01:32:04.266736 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2099/4156] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:32:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:32:04.280119 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3549a490-82f0-4563-98e2-102489e51276 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:04.281306 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3549a490-82f0-4563-98e2-102489e51276 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 1ed9a8e0-aee6-4785-86b8-3d5113a6c838] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:04.288316 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3549a490-82f0-4563-98e2-102489e51276 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:04.297477 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3549a490-82f0-4563-98e2-102489e51276 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:04.297477 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3549a490-82f0-4563-98e2-102489e51276 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:04.297477 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3549a490-82f0-4563-98e2-102489e51276 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:04.297477 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3549a490-82f0-4563-98e2-102489e51276 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:04.297477 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3549a490-82f0-4563-98e2-102489e51276 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:04.351415 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3549a490-82f0-4563-98e2-102489e51276 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:04.351415 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3549a490-82f0-4563-98e2-102489e51276 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:04.351415 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3549a490-82f0-4563-98e2-102489e51276 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:04.351415 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-3549a490-82f0-4563-98e2-102489e51276 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lazy-loading 'fault' on Instance uuid 1ed9a8e0-aee6-4785-86b8-3d5113a6c838 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:32:04.464112 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3549a490-82f0-4563-98e2-102489e51276 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:04.472480 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3549a490-82f0-4563-98e2-102489e51276 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/1ed9a8e0-aee6-4785-86b8-3d5113a6c838" status: 200 len: 1320 microversion: 2.1 time: 0.196702 Oct 30 01:32:04.473297 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2100/4157] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:04 2022] GET /compute/v2.1/servers/1ed9a8e0-aee6-4785-86b8-3d5113a6c838 => generated 1320 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:32:04.732270 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-74bacb8f-cb17-4c51-b902-dea57bd21b66 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:04.743598 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-74bacb8f-cb17-4c51-b902-dea57bd21b66 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5" status: 200 len: 1317 microversion: 2.1 time: 0.552152 Oct 30 01:32:04.744516 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2058/4158] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:04 2022] GET /compute/v2.1/servers/03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5 => generated 1317 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:05.211728 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b19a82c8-2587-4a88-90aa-aad8ee5b8ed1 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:05.212339 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b19a82c8-2587-4a88-90aa-aad8ee5b8ed1 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] [instance: 1f9c8547-e0cb-4094-a15e-d21166bda1d2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:05.221370 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b19a82c8-2587-4a88-90aa-aad8ee5b8ed1 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:05.221855 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b19a82c8-2587-4a88-90aa-aad8ee5b8ed1 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:05.229541 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b19a82c8-2587-4a88-90aa-aad8ee5b8ed1 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:05.230552 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b19a82c8-2587-4a88-90aa-aad8ee5b8ed1 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:05.231183 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b19a82c8-2587-4a88-90aa-aad8ee5b8ed1 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:05.231747 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b19a82c8-2587-4a88-90aa-aad8ee5b8ed1 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:05.253972 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8b57c8dc-3702-4e82-bd48-fef81825be77 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:05.254609 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8b57c8dc-3702-4e82-bd48-fef81825be77 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: 86461b51-bd22-446e-a37e-985c21f7ccd5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:05.267720 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8b57c8dc-3702-4e82-bd48-fef81825be77 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:05.268280 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8b57c8dc-3702-4e82-bd48-fef81825be77 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:05.269958 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8b57c8dc-3702-4e82-bd48-fef81825be77 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:05.270985 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8b57c8dc-3702-4e82-bd48-fef81825be77 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:05.273096 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8b57c8dc-3702-4e82-bd48-fef81825be77 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:05.273952 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8b57c8dc-3702-4e82-bd48-fef81825be77 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:05.925142 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b19a82c8-2587-4a88-90aa-aad8ee5b8ed1 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec278d8d7b4a5a96af042ba613bafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc4c8f707304cd98a5f2e13cb1d5a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:05.947944 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8b57c8dc-3702-4e82-bd48-fef81825be77 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:05.966791 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b19a82c8-2587-4a88-90aa-aad8ee5b8ed1 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] 10.222.0.13 "GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2" status: 200 len: 1508 microversion: 2.1 time: 0.758869 Oct 30 01:32:05.967605 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8b57c8dc-3702-4e82-bd48-fef81825be77 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers/86461b51-bd22-446e-a37e-985c21f7ccd5" status: 200 len: 1320 microversion: 2.1 time: 0.722920 Oct 30 01:32:05.969910 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2101/4159] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:05 2022] GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2 => generated 1508 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:05.979623 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2059/4160] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:05 2022] GET /compute/v2.1/servers/86461b51-bd22-446e-a37e-985c21f7ccd5 => generated 1320 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:05.982969 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c6f2fefd-1000-4390-ad41-25cf6e6c0e5a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:05.983885 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c6f2fefd-1000-4390-ad41-25cf6e6c0e5a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 1ed9a8e0-aee6-4785-86b8-3d5113a6c838] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:05.992032 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c6f2fefd-1000-4390-ad41-25cf6e6c0e5a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:05.993229 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c6f2fefd-1000-4390-ad41-25cf6e6c0e5a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:05.999207 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c6f2fefd-1000-4390-ad41-25cf6e6c0e5a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:05.999207 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c6f2fefd-1000-4390-ad41-25cf6e6c0e5a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:05.999207 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c6f2fefd-1000-4390-ad41-25cf6e6c0e5a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:05.999207 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c6f2fefd-1000-4390-ad41-25cf6e6c0e5a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:05.999652 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5a798dc3-9ae3-4c3a-b1ec-9f085d6ff808 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:05.999652 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5a798dc3-9ae3-4c3a-b1ec-9f085d6ff808 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: 03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:06.011432 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5a798dc3-9ae3-4c3a-b1ec-9f085d6ff808 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:06.012759 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5a798dc3-9ae3-4c3a-b1ec-9f085d6ff808 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:06.013401 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5a798dc3-9ae3-4c3a-b1ec-9f085d6ff808 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:06.014298 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5a798dc3-9ae3-4c3a-b1ec-9f085d6ff808 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:06.014956 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5a798dc3-9ae3-4c3a-b1ec-9f085d6ff808 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:06.016102 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5a798dc3-9ae3-4c3a-b1ec-9f085d6ff808 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:06.019834 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-c6f2fefd-1000-4390-ad41-25cf6e6c0e5a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] HTTP exception thrown: Instance 1ed9a8e0-aee6-4785-86b8-3d5113a6c838 could not be found. Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c6f2fefd-1000-4390-ad41-25cf6e6c0e5a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Request method failure captured: Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/1ed9a8e0-aee6-4785-86b8-3d5113a6c838 HTTP/1.1 Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdNZbeUR7skwu5ylmljymLwmsn3OMAB7HFdlDZsip3dgOK-vaOPPSwUYmWT_o9z2OqWc9cL2Rd22cHSa-BN8vqcvBTHGvFnuVH3dT1kVAQG6ODQVt2oxoFKeXYoNTjg1JUCF1B7Vzk2gVPeSesCiSDD37BDZ3_Wp6AgzZI4w4KMCOXw Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 45fe1c50eaee40249b6c20cc91e52586 Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServersTestJSON-1478392549 Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServersTestJSON-1478392549 Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 45fe1c50eaee40249b6c20cc91e52586 Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServersTestJSON-1478392549 Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServersTestJSON-1478392549-project Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: ef5f8a3e6fef4d6393603575479b16a2 Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServersTestJSON-1478392549-project Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 1ed9a8e0-aee6-4785-86b8-3d5113a6c838 could not be found. Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '1ed9a8e0-aee6-4785-86b8-3d5113a6c838'} Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ed9a8e0-aee6-4785-86b8-3d5113a6c838 could not be found. Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ed9a8e0-aee6-4785-86b8-3d5113a6c838 could not be found. Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:06.026618 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:06.036352 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:06.036352 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:32:06.036352 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:32:06.036352 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:32:06.036352 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:32:06.036352 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ed9a8e0-aee6-4785-86b8-3d5113a6c838 could not be found. Oct 30 01:32:06.036352 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:06.036352 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c6f2fefd-1000-4390-ad41-25cf6e6c0e5a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Returning 404 to user: Instance 1ed9a8e0-aee6-4785-86b8-3d5113a6c838 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:32:06.036352 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c6f2fefd-1000-4390-ad41-25cf6e6c0e5a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/1ed9a8e0-aee6-4785-86b8-3d5113a6c838" status: 404 len: 111 microversion: 2.1 time: 0.057507 Oct 30 01:32:06.043788 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2102/4161] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:05 2022] GET /compute/v2.1/servers/1ed9a8e0-aee6-4785-86b8-3d5113a6c838 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:32:06.169660 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c33e23a6-746a-4cff-be40-6c6f7d1da75a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-591779130", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "936faadb-2266-486c-9624-31976f3a3668"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:32:06.260633 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-c33e23a6-746a-4cff-be40-6c6f7d1da75a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] validate_networks() for [('936faadb-2266-486c-9624-31976f3a3668', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:32:06.782805 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=8 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:06.954171 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5a798dc3-9ae3-4c3a-b1ec-9f085d6ff808 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:06.966292 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5a798dc3-9ae3-4c3a-b1ec-9f085d6ff808 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5" status: 200 len: 1317 microversion: 2.1 time: 0.977249 Oct 30 01:32:06.981909 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2060/4162] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:05 2022] GET /compute/v2.1/servers/03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5 => generated 1317 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:06.988636 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-c6406752-fa17-421e-bc1b-da302f910dac req-2771412a-67b2-46f2-8f1f-018794806940 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6573b259-e50d-4954-9d64-3c914df97308", "tag": "2bc566ed-0070-49d3-b86b-b0e32bb3d07a"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:32:07.000828 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-c6406752-fa17-421e-bc1b-da302f910dac req-2771412a-67b2-46f2-8f1f-018794806940 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:07.001847 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-c6406752-fa17-421e-bc1b-da302f910dac req-2771412a-67b2-46f2-8f1f-018794806940 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:07.002510 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-c6406752-fa17-421e-bc1b-da302f910dac req-2771412a-67b2-46f2-8f1f-018794806940 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:07.015662 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-c6406752-fa17-421e-bc1b-da302f910dac req-2771412a-67b2-46f2-8f1f-018794806940 service nova] Creating event network-changed:2bc566ed-0070-49d3-b86b-b0e32bb3d07a for instance 6573b259-e50d-4954-9d64-3c914df97308 on n-h1-master-1 Oct 30 01:32:07.022140 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-c6406752-fa17-421e-bc1b-da302f910dac req-2771412a-67b2-46f2-8f1f-018794806940 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038489 Oct 30 01:32:07.023386 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2061/4163] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:32:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:32:07.029466 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4b31a037-c2b8-48f8-b71d-5df874ffcef8 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:07.030473 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4b31a037-c2b8-48f8-b71d-5df874ffcef8 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] [instance: 1f9c8547-e0cb-4094-a15e-d21166bda1d2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:07.039901 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4b31a037-c2b8-48f8-b71d-5df874ffcef8 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:07.044026 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4b31a037-c2b8-48f8-b71d-5df874ffcef8 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:07.044026 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4b31a037-c2b8-48f8-b71d-5df874ffcef8 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:07.044026 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4b31a037-c2b8-48f8-b71d-5df874ffcef8 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:07.044026 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4b31a037-c2b8-48f8-b71d-5df874ffcef8 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:07.044026 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4b31a037-c2b8-48f8-b71d-5df874ffcef8 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:07.049239 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:07.141745 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4b31a037-c2b8-48f8-b71d-5df874ffcef8 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec278d8d7b4a5a96af042ba613bafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc4c8f707304cd98a5f2e13cb1d5a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:07.151756 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4b31a037-c2b8-48f8-b71d-5df874ffcef8 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] 10.222.0.13 "GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2" status: 200 len: 1466 microversion: 2.1 time: 0.126714 Oct 30 01:32:07.152702 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2062/4164] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:07 2022] GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2 => generated 1466 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:07.159308 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d09150f8-2954-4042-8b6a-3972c6901b64 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:07.169382 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d09150f8-2954-4042-8b6a-3972c6901b64 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: 86461b51-bd22-446e-a37e-985c21f7ccd5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:07.169382 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d09150f8-2954-4042-8b6a-3972c6901b64 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:07.169382 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d09150f8-2954-4042-8b6a-3972c6901b64 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:07.169382 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d09150f8-2954-4042-8b6a-3972c6901b64 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:07.169382 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d09150f8-2954-4042-8b6a-3972c6901b64 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:07.170233 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d09150f8-2954-4042-8b6a-3972c6901b64 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:07.170929 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d09150f8-2954-4042-8b6a-3972c6901b64 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:07.675889 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-c33e23a6-746a-4cff-be40-6c6f7d1da75a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:32:07.678489 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-c33e23a6-746a-4cff-be40-6c6f7d1da75a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:32:07.679251 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-c33e23a6-746a-4cff-be40-6c6f7d1da75a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:32:07.679839 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-c33e23a6-746a-4cff-be40-6c6f7d1da75a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:32:07.680488 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-c33e23a6-746a-4cff-be40-6c6f7d1da75a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:32:07.696239 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c33e23a6-746a-4cff-be40-6c6f7d1da75a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:07.697897 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c33e23a6-746a-4cff-be40-6c6f7d1da75a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:07.699152 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c33e23a6-746a-4cff-be40-6c6f7d1da75a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:07.700942 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c33e23a6-746a-4cff-be40-6c6f7d1da75a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:07.701739 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c33e23a6-746a-4cff-be40-6c6f7d1da75a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:07.702365 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c33e23a6-746a-4cff-be40-6c6f7d1da75a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:07.705210 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d09150f8-2954-4042-8b6a-3972c6901b64 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:07.713502 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d09150f8-2954-4042-8b6a-3972c6901b64 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers/86461b51-bd22-446e-a37e-985c21f7ccd5" status: 200 len: 1320 microversion: 2.1 time: 0.559265 Oct 30 01:32:07.714097 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2063/4165] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:07 2022] GET /compute/v2.1/servers/86461b51-bd22-446e-a37e-985c21f7ccd5 => generated 1320 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:07.723926 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-c54aad04-517d-4a10-afa2-0a695d91894d req-6f00b4c3-dc87-48ae-a3c0-c1e9df344d4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f9c8547-e0cb-4094-a15e-d21166bda1d2", "name": "network-vif-deleted", "tag": "bb118f0b-7010-4f9e-8bc1-93d4fa2233ad"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:32:07.728233 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-c33e23a6-746a-4cff-be40-6c6f7d1da75a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Getting quotas for project 45fe1c50eaee40249b6c20cc91e52586. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:32:07.737517 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-c33e23a6-746a-4cff-be40-6c6f7d1da75a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Getting quotas for user ef5f8a3e6fef4d6393603575479b16a2 and project 45fe1c50eaee40249b6c20cc91e52586. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:32:07.755157 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-c54aad04-517d-4a10-afa2-0a695d91894d req-6f00b4c3-dc87-48ae-a3c0-c1e9df344d4f service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:07.755662 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-c54aad04-517d-4a10-afa2-0a695d91894d req-6f00b4c3-dc87-48ae-a3c0-c1e9df344d4f service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:07.756102 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-c54aad04-517d-4a10-afa2-0a695d91894d req-6f00b4c3-dc87-48ae-a3c0-c1e9df344d4f service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:07.757208 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c33e23a6-746a-4cff-be40-6c6f7d1da75a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:32:07.761558 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c33e23a6-746a-4cff-be40-6c6f7d1da75a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:32:07.780094 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-c54aad04-517d-4a10-afa2-0a695d91894d req-6f00b4c3-dc87-48ae-a3c0-c1e9df344d4f service nova] Creating event network-vif-deleted:bb118f0b-7010-4f9e-8bc1-93d4fa2233ad for instance 1f9c8547-e0cb-4094-a15e-d21166bda1d2 on n-h1-master-1 Oct 30 01:32:07.786464 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-c54aad04-517d-4a10-afa2-0a695d91894d req-6f00b4c3-dc87-48ae-a3c0-c1e9df344d4f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071060 Oct 30 01:32:07.787543 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2064/4166] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:32:07.797109 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-042f2a16-8c3d-449b-8e61-d148c3bdabac req-19441b1f-10ea-436d-87e4-e8296af4b8e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b36a2df7-45c9-4a51-88f1-e1a1b9c0969d", "name": "network-vif-plugged", "status": "completed", "tag": "2d246f01-5e64-4b29-8a36-b25ca8039340"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:32:07.812410 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-042f2a16-8c3d-449b-8e61-d148c3bdabac req-19441b1f-10ea-436d-87e4-e8296af4b8e5 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:07.812902 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-042f2a16-8c3d-449b-8e61-d148c3bdabac req-19441b1f-10ea-436d-87e4-e8296af4b8e5 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:07.813380 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-042f2a16-8c3d-449b-8e61-d148c3bdabac req-19441b1f-10ea-436d-87e4-e8296af4b8e5 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:07.825261 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-042f2a16-8c3d-449b-8e61-d148c3bdabac req-19441b1f-10ea-436d-87e4-e8296af4b8e5 service nova] Creating event network-vif-plugged:2d246f01-5e64-4b29-8a36-b25ca8039340 for instance b36a2df7-45c9-4a51-88f1-e1a1b9c0969d on n-h1-master-1 Oct 30 01:32:07.830591 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-042f2a16-8c3d-449b-8e61-d148c3bdabac req-19441b1f-10ea-436d-87e4-e8296af4b8e5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041048 Oct 30 01:32:07.831173 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2065/4167] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:32:07.962221 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c33e23a6-746a-4cff-be40-6c6f7d1da75a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.796082 Oct 30 01:32:07.967272 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2103/4168] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:32:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:32:07.979850 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a8e32f55-6c9e-421b-8499-fd4ce16d6049 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:07.981377 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a8e32f55-6c9e-421b-8499-fd4ce16d6049 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:07.997475 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4d88dec9-8c16-4fe7-9962-7a248f31e7ac tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:07.998823 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4d88dec9-8c16-4fe7-9962-7a248f31e7ac tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: 03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:08.009372 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d88dec9-8c16-4fe7-9962-7a248f31e7ac tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:08.010143 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d88dec9-8c16-4fe7-9962-7a248f31e7ac tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:08.011083 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d88dec9-8c16-4fe7-9962-7a248f31e7ac tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:08.012568 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d88dec9-8c16-4fe7-9962-7a248f31e7ac tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:08.013405 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d88dec9-8c16-4fe7-9962-7a248f31e7ac tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:08.014104 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d88dec9-8c16-4fe7-9962-7a248f31e7ac tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:08.166989 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a8e32f55-6c9e-421b-8499-fd4ce16d6049 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:08.181973 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a8e32f55-6c9e-421b-8499-fd4ce16d6049 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e" status: 200 len: 1208 microversion: 2.1 time: 0.203920 Oct 30 01:32:08.184472 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2066/4169] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:07 2022] GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e => generated 1208 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:08.193066 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-aafabed6-1f53-45e8-830f-9680545f909f tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:08.198889 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-aafabed6-1f53-45e8-830f-9680545f909f tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] [instance: 1f9c8547-e0cb-4094-a15e-d21166bda1d2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:08.214570 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aafabed6-1f53-45e8-830f-9680545f909f tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:08.221190 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aafabed6-1f53-45e8-830f-9680545f909f tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:08.222008 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aafabed6-1f53-45e8-830f-9680545f909f tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:08.223505 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aafabed6-1f53-45e8-830f-9680545f909f tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:08.224184 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aafabed6-1f53-45e8-830f-9680545f909f tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:08.224821 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aafabed6-1f53-45e8-830f-9680545f909f tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:08.373525 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-aafabed6-1f53-45e8-830f-9680545f909f tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec278d8d7b4a5a96af042ba613bafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc4c8f707304cd98a5f2e13cb1d5a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:08.388400 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-aafabed6-1f53-45e8-830f-9680545f909f tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] 10.222.0.13 "GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2" status: 200 len: 1293 microversion: 2.1 time: 0.199835 Oct 30 01:32:08.388400 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2067/4170] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:08 2022] GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2 => generated 1293 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:08.400660 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4d88dec9-8c16-4fe7-9962-7a248f31e7ac tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:08.414876 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4d88dec9-8c16-4fe7-9962-7a248f31e7ac tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5" status: 200 len: 1317 microversion: 2.1 time: 0.424796 Oct 30 01:32:08.415679 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2104/4171] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:07 2022] GET /compute/v2.1/servers/03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5 => generated 1317 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:32:08.740661 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e2c152d0-049e-463e-8db5-c29289996b31 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:08.741280 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e2c152d0-049e-463e-8db5-c29289996b31 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: 86461b51-bd22-446e-a37e-985c21f7ccd5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:08.748633 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2c152d0-049e-463e-8db5-c29289996b31 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:08.766193 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2c152d0-049e-463e-8db5-c29289996b31 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:08.766649 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2c152d0-049e-463e-8db5-c29289996b31 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:08.767575 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2c152d0-049e-463e-8db5-c29289996b31 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:08.768371 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2c152d0-049e-463e-8db5-c29289996b31 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:08.768937 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2c152d0-049e-463e-8db5-c29289996b31 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:09.207435 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-77f5462a-9f75-4ea4-9715-743521a45c82 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:09.208827 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-77f5462a-9f75-4ea4-9715-743521a45c82 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:09.224028 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-77f5462a-9f75-4ea4-9715-743521a45c82 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:09.231658 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-77f5462a-9f75-4ea4-9715-743521a45c82 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:09.231738 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e2c152d0-049e-463e-8db5-c29289996b31 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:09.232553 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-77f5462a-9f75-4ea4-9715-743521a45c82 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:09.233115 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-77f5462a-9f75-4ea4-9715-743521a45c82 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:09.235521 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-77f5462a-9f75-4ea4-9715-743521a45c82 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:09.236560 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-77f5462a-9f75-4ea4-9715-743521a45c82 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:09.239972 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e2c152d0-049e-463e-8db5-c29289996b31 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers/86461b51-bd22-446e-a37e-985c21f7ccd5" status: 200 len: 1320 microversion: 2.1 time: 0.503172 Oct 30 01:32:09.240611 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2068/4172] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:08 2022] GET /compute/v2.1/servers/86461b51-bd22-446e-a37e-985c21f7ccd5 => generated 1320 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:09.310842 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-77f5462a-9f75-4ea4-9715-743521a45c82 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:09.318620 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-77f5462a-9f75-4ea4-9715-743521a45c82 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e" status: 200 len: 1212 microversion: 2.1 time: 0.116970 Oct 30 01:32:09.319191 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2105/4173] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:09 2022] GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e => generated 1212 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:32:09.413071 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5b3d7d79-c67a-4e0d-b24d-0b48cefe66a9 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:09.413808 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5b3d7d79-c67a-4e0d-b24d-0b48cefe66a9 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] [instance: 1f9c8547-e0cb-4094-a15e-d21166bda1d2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:09.420930 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5b3d7d79-c67a-4e0d-b24d-0b48cefe66a9 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:09.422260 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5b3d7d79-c67a-4e0d-b24d-0b48cefe66a9 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:09.422958 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5b3d7d79-c67a-4e0d-b24d-0b48cefe66a9 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:09.423996 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5b3d7d79-c67a-4e0d-b24d-0b48cefe66a9 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:09.424680 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5b3d7d79-c67a-4e0d-b24d-0b48cefe66a9 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:09.425117 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5b3d7d79-c67a-4e0d-b24d-0b48cefe66a9 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:09.442302 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ca609097-8059-496d-a54a-3dd78783c7e2 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:09.443355 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ca609097-8059-496d-a54a-3dd78783c7e2 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: 03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:09.456972 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ca609097-8059-496d-a54a-3dd78783c7e2 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:09.457776 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ca609097-8059-496d-a54a-3dd78783c7e2 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:09.459612 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ca609097-8059-496d-a54a-3dd78783c7e2 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:09.461377 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ca609097-8059-496d-a54a-3dd78783c7e2 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:09.462094 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ca609097-8059-496d-a54a-3dd78783c7e2 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:09.463665 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ca609097-8059-496d-a54a-3dd78783c7e2 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:09.473535 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5b3d7d79-c67a-4e0d-b24d-0b48cefe66a9 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:09.474416 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5b3d7d79-c67a-4e0d-b24d-0b48cefe66a9 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:09.475283 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5b3d7d79-c67a-4e0d-b24d-0b48cefe66a9 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:09.475915 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-5b3d7d79-c67a-4e0d-b24d-0b48cefe66a9 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lazy-loading 'fault' on Instance uuid 1f9c8547-e0cb-4094-a15e-d21166bda1d2 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:32:09.568640 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5b3d7d79-c67a-4e0d-b24d-0b48cefe66a9 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec278d8d7b4a5a96af042ba613bafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc4c8f707304cd98a5f2e13cb1d5a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:09.578972 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5b3d7d79-c67a-4e0d-b24d-0b48cefe66a9 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] 10.222.0.13 "GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2" status: 200 len: 1312 microversion: 2.1 time: 0.170183 Oct 30 01:32:09.598096 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2069/4174] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:09 2022] GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2 => generated 1312 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:09.688165 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ca609097-8059-496d-a54a-3dd78783c7e2 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:09.695968 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ca609097-8059-496d-a54a-3dd78783c7e2 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5" status: 200 len: 1317 microversion: 2.1 time: 0.259539 Oct 30 01:32:09.696654 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2106/4175] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:09 2022] GET /compute/v2.1/servers/03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5 => generated 1317 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:09.803160 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-614fc42b-b03b-4ca2-946c-40aa80f0f490 req-0754fc61-6153-4af6-9977-aa5b621df626 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86461b51-bd22-446e-a37e-985c21f7ccd5", "tag": "3ba507d6-8a48-4fde-8971-0dc59fbc5a1d"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:32:09.815068 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-614fc42b-b03b-4ca2-946c-40aa80f0f490 req-0754fc61-6153-4af6-9977-aa5b621df626 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:09.815563 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-614fc42b-b03b-4ca2-946c-40aa80f0f490 req-0754fc61-6153-4af6-9977-aa5b621df626 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:09.816005 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-614fc42b-b03b-4ca2-946c-40aa80f0f490 req-0754fc61-6153-4af6-9977-aa5b621df626 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:09.828800 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-614fc42b-b03b-4ca2-946c-40aa80f0f490 req-0754fc61-6153-4af6-9977-aa5b621df626 service nova] Creating event network-changed:3ba507d6-8a48-4fde-8971-0dc59fbc5a1d for instance 86461b51-bd22-446e-a37e-985c21f7ccd5 on n-h2-master-1 Oct 30 01:32:09.834746 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-614fc42b-b03b-4ca2-946c-40aa80f0f490 req-0754fc61-6153-4af6-9977-aa5b621df626 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035834 Oct 30 01:32:09.836347 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2070/4176] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:32:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:32:10.268016 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-933edd4e-4c58-4aae-85ff-6db44087bf1e tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:10.268693 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-933edd4e-4c58-4aae-85ff-6db44087bf1e tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: 86461b51-bd22-446e-a37e-985c21f7ccd5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:10.275679 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-933edd4e-4c58-4aae-85ff-6db44087bf1e tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:10.276238 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-933edd4e-4c58-4aae-85ff-6db44087bf1e tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:10.276770 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-933edd4e-4c58-4aae-85ff-6db44087bf1e tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:10.277568 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-933edd4e-4c58-4aae-85ff-6db44087bf1e tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:10.278092 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-933edd4e-4c58-4aae-85ff-6db44087bf1e tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:10.278722 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-933edd4e-4c58-4aae-85ff-6db44087bf1e tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:10.345071 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-aa1a5fd7-0461-4cbb-832e-0ef308bb6749 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:10.346492 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-aa1a5fd7-0461-4cbb-832e-0ef308bb6749 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:10.353483 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa1a5fd7-0461-4cbb-832e-0ef308bb6749 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:10.354261 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa1a5fd7-0461-4cbb-832e-0ef308bb6749 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:10.355127 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa1a5fd7-0461-4cbb-832e-0ef308bb6749 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:10.355946 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa1a5fd7-0461-4cbb-832e-0ef308bb6749 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:10.356527 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa1a5fd7-0461-4cbb-832e-0ef308bb6749 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:10.357057 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa1a5fd7-0461-4cbb-832e-0ef308bb6749 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:10.453107 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-aa1a5fd7-0461-4cbb-832e-0ef308bb6749 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:10.461415 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-aa1a5fd7-0461-4cbb-832e-0ef308bb6749 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e" status: 200 len: 1260 microversion: 2.1 time: 0.121934 Oct 30 01:32:10.462762 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2071/4177] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:10 2022] GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e => generated 1260 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:10.545304 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-933edd4e-4c58-4aae-85ff-6db44087bf1e tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:10.553224 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-933edd4e-4c58-4aae-85ff-6db44087bf1e tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers/86461b51-bd22-446e-a37e-985c21f7ccd5" status: 200 len: 1320 microversion: 2.1 time: 0.291722 Oct 30 01:32:10.566638 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2107/4178] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:10 2022] GET /compute/v2.1/servers/86461b51-bd22-446e-a37e-985c21f7ccd5 => generated 1320 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:10.605009 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-31139eb3-e8ec-4f51-9b5d-cbdac2b2366d tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:10.605665 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-31139eb3-e8ec-4f51-9b5d-cbdac2b2366d tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] [instance: 1f9c8547-e0cb-4094-a15e-d21166bda1d2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:10.612785 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-31139eb3-e8ec-4f51-9b5d-cbdac2b2366d tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:10.613837 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-31139eb3-e8ec-4f51-9b5d-cbdac2b2366d tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:10.614697 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-31139eb3-e8ec-4f51-9b5d-cbdac2b2366d tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:10.615764 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-31139eb3-e8ec-4f51-9b5d-cbdac2b2366d tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:10.616385 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-31139eb3-e8ec-4f51-9b5d-cbdac2b2366d tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:10.620850 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-31139eb3-e8ec-4f51-9b5d-cbdac2b2366d tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:10.656628 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-31139eb3-e8ec-4f51-9b5d-cbdac2b2366d tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:10.657221 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-31139eb3-e8ec-4f51-9b5d-cbdac2b2366d tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:10.657873 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-31139eb3-e8ec-4f51-9b5d-cbdac2b2366d tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:10.658399 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-31139eb3-e8ec-4f51-9b5d-cbdac2b2366d tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lazy-loading 'fault' on Instance uuid 1f9c8547-e0cb-4094-a15e-d21166bda1d2 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:32:10.712542 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-31139eb3-e8ec-4f51-9b5d-cbdac2b2366d tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec278d8d7b4a5a96af042ba613bafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc4c8f707304cd98a5f2e13cb1d5a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:10.720510 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-44400c11-02f1-4223-bdb9-006ba4e2230e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:10.721683 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-44400c11-02f1-4223-bdb9-006ba4e2230e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: 03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:10.721959 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-31139eb3-e8ec-4f51-9b5d-cbdac2b2366d tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] 10.222.0.13 "GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2" status: 200 len: 1312 microversion: 2.1 time: 0.122119 Oct 30 01:32:10.722550 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2072/4179] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:10 2022] GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2 => generated 1312 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:10.734884 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44400c11-02f1-4223-bdb9-006ba4e2230e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:10.735492 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44400c11-02f1-4223-bdb9-006ba4e2230e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:10.736028 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44400c11-02f1-4223-bdb9-006ba4e2230e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:10.736832 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44400c11-02f1-4223-bdb9-006ba4e2230e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:10.738470 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44400c11-02f1-4223-bdb9-006ba4e2230e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:10.740436 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44400c11-02f1-4223-bdb9-006ba4e2230e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:10.884885 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-44400c11-02f1-4223-bdb9-006ba4e2230e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:10.900155 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-44400c11-02f1-4223-bdb9-006ba4e2230e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5" status: 200 len: 1317 microversion: 2.1 time: 0.184813 Oct 30 01:32:10.900943 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2108/4180] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:10 2022] GET /compute/v2.1/servers/03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5 => generated 1317 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:11.490145 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ad6039f8-30cd-4552-aad4-8ac6d97fa057 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:11.491527 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ad6039f8-30cd-4552-aad4-8ac6d97fa057 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:11.519354 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ad6039f8-30cd-4552-aad4-8ac6d97fa057 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:11.520457 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ad6039f8-30cd-4552-aad4-8ac6d97fa057 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:11.521078 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ad6039f8-30cd-4552-aad4-8ac6d97fa057 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:11.525426 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ad6039f8-30cd-4552-aad4-8ac6d97fa057 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:11.526121 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ad6039f8-30cd-4552-aad4-8ac6d97fa057 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:11.527299 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ad6039f8-30cd-4552-aad4-8ac6d97fa057 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:11.579364 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cab0a061-5746-4730-9e45-3e3ea756e202 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:11.580188 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cab0a061-5746-4730-9e45-3e3ea756e202 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: 86461b51-bd22-446e-a37e-985c21f7ccd5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:11.587361 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cab0a061-5746-4730-9e45-3e3ea756e202 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:11.588171 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cab0a061-5746-4730-9e45-3e3ea756e202 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:11.588755 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cab0a061-5746-4730-9e45-3e3ea756e202 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:11.589697 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cab0a061-5746-4730-9e45-3e3ea756e202 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:11.590494 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cab0a061-5746-4730-9e45-3e3ea756e202 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:11.591062 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cab0a061-5746-4730-9e45-3e3ea756e202 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:11.765369 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ad6039f8-30cd-4552-aad4-8ac6d97fa057 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:11.777896 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ad6039f8-30cd-4552-aad4-8ac6d97fa057 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e" status: 200 len: 1268 microversion: 2.1 time: 0.296999 Oct 30 01:32:11.779242 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2073/4181] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:11 2022] GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e => generated 1268 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:11.797949 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f7937769-35ce-48de-82cc-9a9080e70f57 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:11.798907 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f7937769-35ce-48de-82cc-9a9080e70f57 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] [instance: 1f9c8547-e0cb-4094-a15e-d21166bda1d2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:11.809398 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f7937769-35ce-48de-82cc-9a9080e70f57 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:11.816908 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f7937769-35ce-48de-82cc-9a9080e70f57 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:11.817535 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f7937769-35ce-48de-82cc-9a9080e70f57 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:11.818564 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f7937769-35ce-48de-82cc-9a9080e70f57 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:11.819252 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f7937769-35ce-48de-82cc-9a9080e70f57 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:11.820173 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f7937769-35ce-48de-82cc-9a9080e70f57 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:11.837769 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-f7937769-35ce-48de-82cc-9a9080e70f57 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] HTTP exception thrown: Instance 1f9c8547-e0cb-4094-a15e-d21166bda1d2 could not be found. Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f7937769-35ce-48de-82cc-9a9080e70f57 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Request method failure captured: Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2 HTTP/1.1 Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdO9T3pUt0COxac2ERBLXo7qnf6IfP-v1is9Sw_8UlPY_i1WBkG1bHkheNZuKLBuPpVLrDmSTkEANas-BsG69062W3h1EvENI53ashklm1HFtNe0UHhabL9CxNocRUDpllVpXhkrlfu5VxDBYvIzmXCuzlbxIIguiPnH-MorjTymkLQ Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: edc4c8f707304cd98a5f2e13cb1d5a5b Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-175003961 Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/edc4c8f707304cd98a5f2e13cb1d5a5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_edc4c8f707304cd98a5f2e13cb1d5a5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/edc4c8f707304cd98a5f2e13cb1d5a5b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/edc4c8f707304cd98a5f2e13cb1d5a5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-175003961 Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: edc4c8f707304cd98a5f2e13cb1d5a5b Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-175003961 Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServerRescueTestJSONUnderV235-175003961-project Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: f9ec278d8d7b4a5a96af042ba613bafa Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-175003961-project Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 1f9c8547-e0cb-4094-a15e-d21166bda1d2 could not be found. Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '1f9c8547-e0cb-4094-a15e-d21166bda1d2'} Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f9c8547-e0cb-4094-a15e-d21166bda1d2 could not be found. Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f9c8547-e0cb-4094-a15e-d21166bda1d2 could not be found. Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:11.839672 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:11.845463 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:11.845463 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:11.845463 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:32:11.845463 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:32:11.845463 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:32:11.845463 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:32:11.845463 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f9c8547-e0cb-4094-a15e-d21166bda1d2 could not be found. Oct 30 01:32:11.845463 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:11.845463 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f7937769-35ce-48de-82cc-9a9080e70f57 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] Returning 404 to user: Instance 1f9c8547-e0cb-4094-a15e-d21166bda1d2 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:32:11.845463 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f7937769-35ce-48de-82cc-9a9080e70f57 tempest-ServerRescueTestJSONUnderV235-175003961 tempest-ServerRescueTestJSONUnderV235-175003961-project] 10.222.0.13 "GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2" status: 404 len: 111 microversion: 2.1 time: 0.058362 Oct 30 01:32:11.851412 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2074/4182] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:11 2022] GET /compute/v2.1/servers/1f9c8547-e0cb-4094-a15e-d21166bda1d2 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:32:11.891229 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-23e6448d-804c-41a1-bd2a-46db458315c9 req-e87377af-91b5-4410-89e0-6d19b2a28b11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6573b259-e50d-4954-9d64-3c914df97308", "name": "network-vif-plugged", "status": "completed", "tag": "2bc566ed-0070-49d3-b86b-b0e32bb3d07a"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:32:11.901731 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-23e6448d-804c-41a1-bd2a-46db458315c9 req-e87377af-91b5-4410-89e0-6d19b2a28b11 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:11.904516 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-23e6448d-804c-41a1-bd2a-46db458315c9 req-e87377af-91b5-4410-89e0-6d19b2a28b11 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:11.904516 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-23e6448d-804c-41a1-bd2a-46db458315c9 req-e87377af-91b5-4410-89e0-6d19b2a28b11 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:11.915998 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-23e6448d-804c-41a1-bd2a-46db458315c9 req-e87377af-91b5-4410-89e0-6d19b2a28b11 service nova] Creating event network-vif-plugged:2bc566ed-0070-49d3-b86b-b0e32bb3d07a for instance 6573b259-e50d-4954-9d64-3c914df97308 on n-h1-master-1 Oct 30 01:32:11.923309 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-23e6448d-804c-41a1-bd2a-46db458315c9 req-e87377af-91b5-4410-89e0-6d19b2a28b11 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037428 Oct 30 01:32:11.924263 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2075/4183] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:32:11.930682 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0b2ef229-e72f-48f5-8525-3f673413b48c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:11.932750 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0b2ef229-e72f-48f5-8525-3f673413b48c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: 03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:11.940419 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b2ef229-e72f-48f5-8525-3f673413b48c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:11.941635 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b2ef229-e72f-48f5-8525-3f673413b48c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:11.942294 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b2ef229-e72f-48f5-8525-3f673413b48c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:11.943800 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b2ef229-e72f-48f5-8525-3f673413b48c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:11.944528 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b2ef229-e72f-48f5-8525-3f673413b48c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:11.945172 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b2ef229-e72f-48f5-8525-3f673413b48c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:12.154655 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-cab0a061-5746-4730-9e45-3e3ea756e202 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:12.165439 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cab0a061-5746-4730-9e45-3e3ea756e202 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers/86461b51-bd22-446e-a37e-985c21f7ccd5" status: 200 len: 1320 microversion: 2.1 time: 0.590421 Oct 30 01:32:12.167942 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2109/4184] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:11 2022] GET /compute/v2.1/servers/86461b51-bd22-446e-a37e-985c21f7ccd5 => generated 1320 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:12.419066 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0b2ef229-e72f-48f5-8525-3f673413b48c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:12.439348 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0b2ef229-e72f-48f5-8525-3f673413b48c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5" status: 200 len: 1317 microversion: 2.1 time: 0.504188 Oct 30 01:32:12.440055 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2076/4185] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:11 2022] GET /compute/v2.1/servers/03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5 => generated 1317 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:12.808710 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3555e8e5-1549-4c75-92de-69188883886e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:12.810094 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3555e8e5-1549-4c75-92de-69188883886e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:12.824452 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3555e8e5-1549-4c75-92de-69188883886e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:12.827937 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3555e8e5-1549-4c75-92de-69188883886e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:12.828524 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3555e8e5-1549-4c75-92de-69188883886e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:12.830558 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3555e8e5-1549-4c75-92de-69188883886e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:12.831721 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3555e8e5-1549-4c75-92de-69188883886e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:12.832260 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3555e8e5-1549-4c75-92de-69188883886e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:13.191421 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-78e41984-6f16-4e16-b97f-51075b5d63fd tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:13.193657 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-78e41984-6f16-4e16-b97f-51075b5d63fd tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: 86461b51-bd22-446e-a37e-985c21f7ccd5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:13.212022 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-78e41984-6f16-4e16-b97f-51075b5d63fd tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:13.218608 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-78e41984-6f16-4e16-b97f-51075b5d63fd tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:13.219524 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-78e41984-6f16-4e16-b97f-51075b5d63fd tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:13.223262 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-78e41984-6f16-4e16-b97f-51075b5d63fd tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:13.224297 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-78e41984-6f16-4e16-b97f-51075b5d63fd tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:13.228887 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-78e41984-6f16-4e16-b97f-51075b5d63fd tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:13.605126 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3555e8e5-1549-4c75-92de-69188883886e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:13.620140 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3555e8e5-1549-4c75-92de-69188883886e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e" status: 200 len: 1308 microversion: 2.1 time: 0.818003 Oct 30 01:32:13.621764 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2110/4186] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:12 2022] GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e => generated 1308 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:13.631138 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9ccee2ab-33ac-441c-9ad2-a545e84b5b73 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:13.632473 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9ccee2ab-33ac-441c-9ad2-a545e84b5b73 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: 03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:13.639107 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-78e41984-6f16-4e16-b97f-51075b5d63fd tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:13.652225 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-78e41984-6f16-4e16-b97f-51075b5d63fd tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers/86461b51-bd22-446e-a37e-985c21f7ccd5" status: 200 len: 1320 microversion: 2.1 time: 0.467465 Oct 30 01:32:13.654730 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2077/4187] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:13 2022] GET /compute/v2.1/servers/86461b51-bd22-446e-a37e-985c21f7ccd5 => generated 1320 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:13.658303 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9ccee2ab-33ac-441c-9ad2-a545e84b5b73 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:13.660299 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9ccee2ab-33ac-441c-9ad2-a545e84b5b73 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:13.661136 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9ccee2ab-33ac-441c-9ad2-a545e84b5b73 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:13.662319 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9ccee2ab-33ac-441c-9ad2-a545e84b5b73 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:13.662980 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9ccee2ab-33ac-441c-9ad2-a545e84b5b73 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:13.663677 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9ccee2ab-33ac-441c-9ad2-a545e84b5b73 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:14.002624 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9ccee2ab-33ac-441c-9ad2-a545e84b5b73 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:14.011764 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9ccee2ab-33ac-441c-9ad2-a545e84b5b73 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5" status: 200 len: 1317 microversion: 2.1 time: 0.388530 Oct 30 01:32:14.026120 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2111/4188] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:13 2022] GET /compute/v2.1/servers/03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5 => generated 1317 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:14.176411 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-59e26107-a210-4c4a-8ba0-f5ad8230ccf5 req-27460ae3-41e6-4b64-ab1c-707bbfd7b8cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5", "name": "network-vif-plugged", "status": "completed", "tag": "25e46010-3b1a-4be2-b2f0-3b3def5c4df9"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:32:14.214051 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-59e26107-a210-4c4a-8ba0-f5ad8230ccf5 req-27460ae3-41e6-4b64-ab1c-707bbfd7b8cd service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:14.219265 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-59e26107-a210-4c4a-8ba0-f5ad8230ccf5 req-27460ae3-41e6-4b64-ab1c-707bbfd7b8cd service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:14.220255 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-59e26107-a210-4c4a-8ba0-f5ad8230ccf5 req-27460ae3-41e6-4b64-ab1c-707bbfd7b8cd service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:14.246305 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-59e26107-a210-4c4a-8ba0-f5ad8230ccf5 req-27460ae3-41e6-4b64-ab1c-707bbfd7b8cd service nova] Creating event network-vif-plugged:25e46010-3b1a-4be2-b2f0-3b3def5c4df9 for instance 03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5 on n-h1-master-1 Oct 30 01:32:14.251885 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-59e26107-a210-4c4a-8ba0-f5ad8230ccf5 req-27460ae3-41e6-4b64-ab1c-707bbfd7b8cd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081179 Oct 30 01:32:14.253063 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2078/4189] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:32:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:32:14.657638 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-411346d6-d91a-41e4-a7cd-ef76d5a1c4ce tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:14.657638 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-411346d6-d91a-41e4-a7cd-ef76d5a1c4ce tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:14.663680 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-411346d6-d91a-41e4-a7cd-ef76d5a1c4ce tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:14.664356 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-411346d6-d91a-41e4-a7cd-ef76d5a1c4ce tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:14.665097 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-411346d6-d91a-41e4-a7cd-ef76d5a1c4ce tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:14.665989 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-411346d6-d91a-41e4-a7cd-ef76d5a1c4ce tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:14.666597 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-411346d6-d91a-41e4-a7cd-ef76d5a1c4ce tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:14.667177 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-411346d6-d91a-41e4-a7cd-ef76d5a1c4ce tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:14.829813 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ae9e5c7e-6158-42a9-bd3e-56e9627fecd8 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Action: 'create', calling method: .version_select at 0x7f44cc4f0790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-106222850", "description": "tempest-description-1723263598"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:32:14.963396 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-411346d6-d91a-41e4-a7cd-ef76d5a1c4ce tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:14.966152 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-411346d6-d91a-41e4-a7cd-ef76d5a1c4ce tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e" status: 200 len: 1308 microversion: 2.1 time: 0.319320 Oct 30 01:32:14.966242 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2112/4190] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:14 2022] GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e => generated 1308 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:14.987615 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b2234740-785d-46d9-910a-9c9abadfe51c tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:14.988472 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b2234740-785d-46d9-910a-9c9abadfe51c tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: 86461b51-bd22-446e-a37e-985c21f7ccd5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:14.995437 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2234740-785d-46d9-910a-9c9abadfe51c tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:14.996142 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2234740-785d-46d9-910a-9c9abadfe51c tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:14.996924 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2234740-785d-46d9-910a-9c9abadfe51c tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:14.997915 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2234740-785d-46d9-910a-9c9abadfe51c tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:14.998517 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2234740-785d-46d9-910a-9c9abadfe51c tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:14.999661 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2234740-785d-46d9-910a-9c9abadfe51c tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:15.266015 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b2234740-785d-46d9-910a-9c9abadfe51c tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:15.276054 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b2234740-785d-46d9-910a-9c9abadfe51c tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers/86461b51-bd22-446e-a37e-985c21f7ccd5" status: 200 len: 1320 microversion: 2.1 time: 0.293082 Oct 30 01:32:15.276727 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2113/4191] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:14 2022] GET /compute/v2.1/servers/86461b51-bd22-446e-a37e-985c21f7ccd5 => generated 1320 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:15.283631 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3eaab466-ddcc-468a-88c7-aa23ca81ceaa tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:15.284575 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3eaab466-ddcc-468a-88c7-aa23ca81ceaa tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: 03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:15.299997 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3eaab466-ddcc-468a-88c7-aa23ca81ceaa tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:15.301050 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3eaab466-ddcc-468a-88c7-aa23ca81ceaa tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:15.302030 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3eaab466-ddcc-468a-88c7-aa23ca81ceaa tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:15.303235 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3eaab466-ddcc-468a-88c7-aa23ca81ceaa tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:15.304111 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3eaab466-ddcc-468a-88c7-aa23ca81ceaa tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:15.304779 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3eaab466-ddcc-468a-88c7-aa23ca81ceaa tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:15.540020 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ae9e5c7e-6158-42a9-bd3e-56e9627fecd8 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.885832 Oct 30 01:32:15.540983 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2079/4192] 10.222.0.13 () {60 vars in 1180 bytes} [Sun Oct 30 01:32:14 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:32:15.545990 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-3f5a440a-4f48-4a65-a213-77ec6afc15f5 req-93d2746e-8afa-4fe5-aa9a-8c6949806e21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e", "tag": "e6aa1f7f-1ffc-497f-bd6e-91828753a483"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:32:15.566994 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-3f5a440a-4f48-4a65-a213-77ec6afc15f5 req-93d2746e-8afa-4fe5-aa9a-8c6949806e21 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:15.569810 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-3f5a440a-4f48-4a65-a213-77ec6afc15f5 req-93d2746e-8afa-4fe5-aa9a-8c6949806e21 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:15.572081 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-3f5a440a-4f48-4a65-a213-77ec6afc15f5 req-93d2746e-8afa-4fe5-aa9a-8c6949806e21 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:15.590136 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-3f5a440a-4f48-4a65-a213-77ec6afc15f5 req-93d2746e-8afa-4fe5-aa9a-8c6949806e21 service nova] Creating event network-changed:e6aa1f7f-1ffc-497f-bd6e-91828753a483 for instance 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e on n-h2-master-1 Oct 30 01:32:15.606428 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-3f5a440a-4f48-4a65-a213-77ec6afc15f5 req-93d2746e-8afa-4fe5-aa9a-8c6949806e21 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063924 Oct 30 01:32:15.607590 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2080/4193] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:32:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:32:15.622192 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fe7af0d6-0f5d-4a62-bf5f-737c78cb1c0f tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Action: 'create', calling method: .version_select at 0x7f44c7b3be50>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-619098834", "description": "tempest-description-1895980786"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:32:15.686330 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3eaab466-ddcc-468a-88c7-aa23ca81ceaa tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:15.686330 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:15.696185 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3eaab466-ddcc-468a-88c7-aa23ca81ceaa tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5" status: 200 len: 1317 microversion: 2.1 time: 0.418031 Oct 30 01:32:15.697572 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2114/4194] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:15 2022] GET /compute/v2.1/servers/03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5 => generated 1317 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:15.993541 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-eed2d3a2-37f2-44f3-b0f9-b11e8858cbe9 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:15.994293 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-eed2d3a2-37f2-44f3-b0f9-b11e8858cbe9 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:16.004947 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eed2d3a2-37f2-44f3-b0f9-b11e8858cbe9 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:16.008868 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eed2d3a2-37f2-44f3-b0f9-b11e8858cbe9 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:16.009561 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eed2d3a2-37f2-44f3-b0f9-b11e8858cbe9 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:16.013726 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eed2d3a2-37f2-44f3-b0f9-b11e8858cbe9 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:16.015142 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eed2d3a2-37f2-44f3-b0f9-b11e8858cbe9 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:16.016339 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eed2d3a2-37f2-44f3-b0f9-b11e8858cbe9 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:16.410673 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fe7af0d6-0f5d-4a62-bf5f-737c78cb1c0f tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.800593 Oct 30 01:32:16.411759 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2081/4195] 10.222.0.13 () {60 vars in 1180 bytes} [Sun Oct 30 01:32:15 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:32:16.441520 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-25f1d9e5-e8cc-4870-820d-69f139db9b81 req-06d8891d-3eba-4f0f-a358-b14e03c28936 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86461b51-bd22-446e-a37e-985c21f7ccd5", "name": "network-vif-plugged", "status": "completed", "tag": "3ba507d6-8a48-4fde-8971-0dc59fbc5a1d"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:32:16.452193 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-eed2d3a2-37f2-44f3-b0f9-b11e8858cbe9 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:16.464759 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-eed2d3a2-37f2-44f3-b0f9-b11e8858cbe9 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e" status: 200 len: 1308 microversion: 2.1 time: 0.480407 Oct 30 01:32:16.467170 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2115/4196] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:15 2022] GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e => generated 1308 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:32:16.476191 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-25f1d9e5-e8cc-4870-820d-69f139db9b81 req-06d8891d-3eba-4f0f-a358-b14e03c28936 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:16.476682 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-25f1d9e5-e8cc-4870-820d-69f139db9b81 req-06d8891d-3eba-4f0f-a358-b14e03c28936 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:16.477122 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-25f1d9e5-e8cc-4870-820d-69f139db9b81 req-06d8891d-3eba-4f0f-a358-b14e03c28936 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:16.483316 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-040aa119-41ce-4b8c-a8f9-5fc5ae68583e tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:16.483938 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-040aa119-41ce-4b8c-a8f9-5fc5ae68583e tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: 86461b51-bd22-446e-a37e-985c21f7ccd5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:16.490898 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-040aa119-41ce-4b8c-a8f9-5fc5ae68583e tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:16.492525 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-040aa119-41ce-4b8c-a8f9-5fc5ae68583e tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:16.492970 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-040aa119-41ce-4b8c-a8f9-5fc5ae68583e tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:16.493732 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-040aa119-41ce-4b8c-a8f9-5fc5ae68583e tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:16.494195 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-040aa119-41ce-4b8c-a8f9-5fc5ae68583e tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:16.494687 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-040aa119-41ce-4b8c-a8f9-5fc5ae68583e tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:16.500013 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-25f1d9e5-e8cc-4870-820d-69f139db9b81 req-06d8891d-3eba-4f0f-a358-b14e03c28936 service nova] Creating event network-vif-plugged:3ba507d6-8a48-4fde-8971-0dc59fbc5a1d for instance 86461b51-bd22-446e-a37e-985c21f7ccd5 on n-h2-master-1 Oct 30 01:32:16.506094 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-25f1d9e5-e8cc-4870-820d-69f139db9b81 req-06d8891d-3eba-4f0f-a358-b14e03c28936 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090420 Oct 30 01:32:16.507501 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2082/4197] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:32:16.513522 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e093a58f-25e6-4203-aa4e-e082c0e04d99 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1142777147", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "1d83094d-6a79-404b-851b-d6ff42d15fb0"}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:32:16.597293 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-e093a58f-25e6-4203-aa4e-e082c0e04d99 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] validate_networks() for [('1d83094d-6a79-404b-851b-d6ff42d15fb0', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:32:16.818932 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-040aa119-41ce-4b8c-a8f9-5fc5ae68583e tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:16.831854 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-040aa119-41ce-4b8c-a8f9-5fc5ae68583e tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers/86461b51-bd22-446e-a37e-985c21f7ccd5" status: 200 len: 1320 microversion: 2.1 time: 0.362587 Oct 30 01:32:16.835887 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2116/4198] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:16 2022] GET /compute/v2.1/servers/86461b51-bd22-446e-a37e-985c21f7ccd5 => generated 1320 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:16.840594 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5e549b26-07ae-415a-bc4e-4cc5f212e398 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:16.841208 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5e549b26-07ae-415a-bc4e-4cc5f212e398 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: 03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:16.867823 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5e549b26-07ae-415a-bc4e-4cc5f212e398 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:16.868331 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5e549b26-07ae-415a-bc4e-4cc5f212e398 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:16.876328 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5e549b26-07ae-415a-bc4e-4cc5f212e398 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:16.877169 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5e549b26-07ae-415a-bc4e-4cc5f212e398 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:16.877793 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5e549b26-07ae-415a-bc4e-4cc5f212e398 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:16.878307 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5e549b26-07ae-415a-bc4e-4cc5f212e398 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:17.250314 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5e549b26-07ae-415a-bc4e-4cc5f212e398 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:17.258701 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5e549b26-07ae-415a-bc4e-4cc5f212e398 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5" status: 200 len: 1505 microversion: 2.1 time: 0.421777 Oct 30 01:32:17.263811 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2117/4199] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:16 2022] GET /compute/v2.1/servers/03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5 => generated 1505 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:17.288266 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0591ad3d-2711-4e76-a9ec-75b51a072f77 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:17.288772 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0591ad3d-2711-4e76-a9ec-75b51a072f77 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: 03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:17.302317 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0591ad3d-2711-4e76-a9ec-75b51a072f77 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:17.302819 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0591ad3d-2711-4e76-a9ec-75b51a072f77 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:17.303255 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0591ad3d-2711-4e76-a9ec-75b51a072f77 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:17.303969 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0591ad3d-2711-4e76-a9ec-75b51a072f77 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:17.304425 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0591ad3d-2711-4e76-a9ec-75b51a072f77 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:17.304851 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0591ad3d-2711-4e76-a9ec-75b51a072f77 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:17.336277 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0591ad3d-2711-4e76-a9ec-75b51a072f77 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: 03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:32:17.527934 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-e093a58f-25e6-4203-aa4e-e082c0e04d99 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:32:17.528613 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-e093a58f-25e6-4203-aa4e-e082c0e04d99 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:32:17.534243 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-e093a58f-25e6-4203-aa4e-e082c0e04d99 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:32:17.534243 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-e093a58f-25e6-4203-aa4e-e082c0e04d99 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:32:17.534243 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-e093a58f-25e6-4203-aa4e-e082c0e04d99 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:32:17.554365 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e093a58f-25e6-4203-aa4e-e082c0e04d99 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:17.554963 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e093a58f-25e6-4203-aa4e-e082c0e04d99 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:17.555289 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e093a58f-25e6-4203-aa4e-e082c0e04d99 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:17.556022 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e093a58f-25e6-4203-aa4e-e082c0e04d99 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:17.557202 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e093a58f-25e6-4203-aa4e-e082c0e04d99 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:17.557202 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e093a58f-25e6-4203-aa4e-e082c0e04d99 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:17.588568 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-e093a58f-25e6-4203-aa4e-e082c0e04d99 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Getting quotas for project 09d179276dbf4e4d9cb780b18e7a22c7. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:32:17.596679 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-e093a58f-25e6-4203-aa4e-e082c0e04d99 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Getting quotas for user 88ac5422c8f048148aac2c9b62e0482e and project 09d179276dbf4e4d9cb780b18e7a22c7. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:32:17.627726 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e093a58f-25e6-4203-aa4e-e082c0e04d99 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:32:17.631049 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e093a58f-25e6-4203-aa4e-e082c0e04d99 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] [instance: 9d85310b-581e-4748-b962-ab53210e15b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:32:17.719294 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:17.750098 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=6 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:17.787902 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e093a58f-25e6-4203-aa4e-e082c0e04d99 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.278739 Oct 30 01:32:17.795977 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2083/4200] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:32:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1286 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:32:17.800619 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0591ad3d-2711-4e76-a9ec-75b51a072f77 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "DELETE /compute/v2.1/servers/03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5" status: 204 len: 0 microversion: 2.1 time: 0.516574 Oct 30 01:32:17.804841 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2118/4201] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:32:17 2022] DELETE /compute/v2.1/servers/03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:32:17.808765 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-334f983f-8370-4403-8a3d-6d075fdc7d28 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:17.810496 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-334f983f-8370-4403-8a3d-6d075fdc7d28 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:17.812601 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6c137c86-73a6-47c9-861c-61a34b9880d1 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:17.813573 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6c137c86-73a6-47c9-861c-61a34b9880d1 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] [instance: 9d85310b-581e-4748-b962-ab53210e15b5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:17.829350 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-334f983f-8370-4403-8a3d-6d075fdc7d28 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:17.831833 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-334f983f-8370-4403-8a3d-6d075fdc7d28 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:17.832497 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-334f983f-8370-4403-8a3d-6d075fdc7d28 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:17.835461 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-334f983f-8370-4403-8a3d-6d075fdc7d28 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:17.837962 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-334f983f-8370-4403-8a3d-6d075fdc7d28 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:17.838529 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-334f983f-8370-4403-8a3d-6d075fdc7d28 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:18.122163 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6c137c86-73a6-47c9-861c-61a34b9880d1 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ac5422c8f048148aac2c9b62e0482e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d179276dbf4e4d9cb780b18e7a22c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:18.131733 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6c137c86-73a6-47c9-861c-61a34b9880d1 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "GET /compute/v2.1/servers/9d85310b-581e-4748-b962-ab53210e15b5" status: 200 len: 1216 microversion: 2.1 time: 0.324954 Oct 30 01:32:18.153647 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2119/4202] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:17 2022] GET /compute/v2.1/servers/9d85310b-581e-4748-b962-ab53210e15b5 => generated 1216 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:18.165779 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-700e1831-f82d-4243-979c-1412883105ad tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:18.169661 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-700e1831-f82d-4243-979c-1412883105ad tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: 03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:18.186359 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-700e1831-f82d-4243-979c-1412883105ad tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:18.187091 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-700e1831-f82d-4243-979c-1412883105ad tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:18.197571 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-700e1831-f82d-4243-979c-1412883105ad tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:18.197571 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-700e1831-f82d-4243-979c-1412883105ad tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:18.197571 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-700e1831-f82d-4243-979c-1412883105ad tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:18.197571 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-700e1831-f82d-4243-979c-1412883105ad tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:18.982899 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-700e1831-f82d-4243-979c-1412883105ad tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:18.991945 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-700e1831-f82d-4243-979c-1412883105ad tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5" status: 200 len: 1511 microversion: 2.1 time: 0.836286 Oct 30 01:32:19.019568 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2120/4203] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:18 2022] GET /compute/v2.1/servers/03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5 => generated 1511 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:19.038531 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0ed9c4bc-62fc-4bb6-98a3-e73097a27508 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:19.044225 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0ed9c4bc-62fc-4bb6-98a3-e73097a27508 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: 86461b51-bd22-446e-a37e-985c21f7ccd5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:19.067822 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0ed9c4bc-62fc-4bb6-98a3-e73097a27508 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:19.072137 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0ed9c4bc-62fc-4bb6-98a3-e73097a27508 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:19.072820 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0ed9c4bc-62fc-4bb6-98a3-e73097a27508 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:19.074294 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0ed9c4bc-62fc-4bb6-98a3-e73097a27508 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:19.074294 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0ed9c4bc-62fc-4bb6-98a3-e73097a27508 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:19.083774 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0ed9c4bc-62fc-4bb6-98a3-e73097a27508 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:19.159706 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-334f983f-8370-4403-8a3d-6d075fdc7d28 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:19.185527 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-334f983f-8370-4403-8a3d-6d075fdc7d28 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e" status: 200 len: 1308 microversion: 2.1 time: 1.372599 Oct 30 01:32:19.189288 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2084/4204] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:17 2022] GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e => generated 1308 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:19.207662 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-09db3713-2344-458b-bcff-7d683f87f6ea tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:19.208364 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-09db3713-2344-458b-bcff-7d683f87f6ea tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] [instance: 9d85310b-581e-4748-b962-ab53210e15b5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:19.381759 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-09db3713-2344-458b-bcff-7d683f87f6ea tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ac5422c8f048148aac2c9b62e0482e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d179276dbf4e4d9cb780b18e7a22c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:19.384944 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=35 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:19.399712 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-09db3713-2344-458b-bcff-7d683f87f6ea tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "GET /compute/v2.1/servers/9d85310b-581e-4748-b962-ab53210e15b5" status: 200 len: 1216 microversion: 2.1 time: 0.206672 Oct 30 01:32:19.400846 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2085/4205] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:19 2022] GET /compute/v2.1/servers/9d85310b-581e-4748-b962-ab53210e15b5 => generated 1216 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:19.740603 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0ed9c4bc-62fc-4bb6-98a3-e73097a27508 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:19.752398 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0ed9c4bc-62fc-4bb6-98a3-e73097a27508 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers/86461b51-bd22-446e-a37e-985c21f7ccd5" status: 200 len: 1320 microversion: 2.1 time: 0.730943 Oct 30 01:32:19.753916 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2121/4206] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:19 2022] GET /compute/v2.1/servers/86461b51-bd22-446e-a37e-985c21f7ccd5 => generated 1320 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:20.025910 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e385094a-2a39-4515-bf52-84f49b639c1a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:20.028035 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e385094a-2a39-4515-bf52-84f49b639c1a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: 03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:20.045482 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e385094a-2a39-4515-bf52-84f49b639c1a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:20.046187 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e385094a-2a39-4515-bf52-84f49b639c1a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:20.046638 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e385094a-2a39-4515-bf52-84f49b639c1a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:20.047392 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e385094a-2a39-4515-bf52-84f49b639c1a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:20.048081 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e385094a-2a39-4515-bf52-84f49b639c1a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:20.048463 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e385094a-2a39-4515-bf52-84f49b639c1a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:20.211948 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e4950b14-c871-4b31-a320-6a59b38f5048 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:20.213277 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e4950b14-c871-4b31-a320-6a59b38f5048 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:20.232214 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e4950b14-c871-4b31-a320-6a59b38f5048 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:20.233852 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e4950b14-c871-4b31-a320-6a59b38f5048 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:20.235568 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e4950b14-c871-4b31-a320-6a59b38f5048 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:20.236526 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e4950b14-c871-4b31-a320-6a59b38f5048 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:20.240157 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e4950b14-c871-4b31-a320-6a59b38f5048 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:20.240865 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e4950b14-c871-4b31-a320-6a59b38f5048 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:21.186528 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e4950b14-c871-4b31-a320-6a59b38f5048 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:21.195373 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e4950b14-c871-4b31-a320-6a59b38f5048 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e" status: 200 len: 1308 microversion: 2.1 time: 0.987394 Oct 30 01:32:21.216087 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e385094a-2a39-4515-bf52-84f49b639c1a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:21.220899 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2122/4207] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:20 2022] GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e => generated 1308 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:21.225924 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e385094a-2a39-4515-bf52-84f49b639c1a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5" status: 200 len: 1511 microversion: 2.1 time: 1.203960 Oct 30 01:32:21.226507 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2086/4208] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:20 2022] GET /compute/v2.1/servers/03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5 => generated 1511 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:32:21.231866 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0a37d8b7-9e90-4a18-a20b-36ef3616af3e tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:21.233308 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0a37d8b7-9e90-4a18-a20b-36ef3616af3e tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: 86461b51-bd22-446e-a37e-985c21f7ccd5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:21.237136 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-427383a7-417f-42ea-9160-0f02b466c112 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:21.239080 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-427383a7-417f-42ea-9160-0f02b466c112 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] [instance: 9d85310b-581e-4748-b962-ab53210e15b5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:21.248164 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-427383a7-417f-42ea-9160-0f02b466c112 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:21.249136 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-427383a7-417f-42ea-9160-0f02b466c112 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:21.249791 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-427383a7-417f-42ea-9160-0f02b466c112 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:21.250133 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0a37d8b7-9e90-4a18-a20b-36ef3616af3e tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:21.251414 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-427383a7-417f-42ea-9160-0f02b466c112 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:21.251784 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0a37d8b7-9e90-4a18-a20b-36ef3616af3e tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:21.252632 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-427383a7-417f-42ea-9160-0f02b466c112 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:21.253208 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-427383a7-417f-42ea-9160-0f02b466c112 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:21.253426 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0a37d8b7-9e90-4a18-a20b-36ef3616af3e tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:21.257739 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0a37d8b7-9e90-4a18-a20b-36ef3616af3e tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:21.258389 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0a37d8b7-9e90-4a18-a20b-36ef3616af3e tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:21.258989 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0a37d8b7-9e90-4a18-a20b-36ef3616af3e tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:21.485710 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-427383a7-417f-42ea-9160-0f02b466c112 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ac5422c8f048148aac2c9b62e0482e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d179276dbf4e4d9cb780b18e7a22c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:21.498947 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-427383a7-417f-42ea-9160-0f02b466c112 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "GET /compute/v2.1/servers/9d85310b-581e-4748-b962-ab53210e15b5" status: 200 len: 1286 microversion: 2.1 time: 0.267105 Oct 30 01:32:21.499596 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2123/4209] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:21 2022] GET /compute/v2.1/servers/9d85310b-581e-4748-b962-ab53210e15b5 => generated 1286 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:21.507773 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-a9f7fa4e-eb7c-40b5-b2c1-a660e80a1c52 req-c8fda869-fd49-40ab-9741-af10e4f9f0ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5", "name": "network-vif-deleted", "tag": "25e46010-3b1a-4be2-b2f0-3b3def5c4df9"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:32:21.523470 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-a9f7fa4e-eb7c-40b5-b2c1-a660e80a1c52 req-c8fda869-fd49-40ab-9741-af10e4f9f0ec service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:21.523953 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-a9f7fa4e-eb7c-40b5-b2c1-a660e80a1c52 req-c8fda869-fd49-40ab-9741-af10e4f9f0ec service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:21.524380 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-a9f7fa4e-eb7c-40b5-b2c1-a660e80a1c52 req-c8fda869-fd49-40ab-9741-af10e4f9f0ec service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:21.538467 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-a9f7fa4e-eb7c-40b5-b2c1-a660e80a1c52 req-c8fda869-fd49-40ab-9741-af10e4f9f0ec service nova] Creating event network-vif-deleted:25e46010-3b1a-4be2-b2f0-3b3def5c4df9 for instance 03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5 on n-h1-master-1 Oct 30 01:32:21.543645 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-a9f7fa4e-eb7c-40b5-b2c1-a660e80a1c52 req-c8fda869-fd49-40ab-9741-af10e4f9f0ec service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042804 Oct 30 01:32:21.544698 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2124/4210] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:32:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:32:21.715630 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0a37d8b7-9e90-4a18-a20b-36ef3616af3e tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:21.738169 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0a37d8b7-9e90-4a18-a20b-36ef3616af3e tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers/86461b51-bd22-446e-a37e-985c21f7ccd5" status: 200 len: 1512 microversion: 2.1 time: 0.510396 Oct 30 01:32:21.738783 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2087/4211] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:21 2022] GET /compute/v2.1/servers/86461b51-bd22-446e-a37e-985c21f7ccd5 => generated 1512 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:21.761369 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-346dbe6d-a665-4193-8db4-143df3a5d379 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:21.762384 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-346dbe6d-a665-4193-8db4-143df3a5d379 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: b36a2df7-45c9-4a51-88f1-e1a1b9c0969d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:21.769930 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-346dbe6d-a665-4193-8db4-143df3a5d379 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:21.770633 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-346dbe6d-a665-4193-8db4-143df3a5d379 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:21.771593 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-346dbe6d-a665-4193-8db4-143df3a5d379 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:21.772653 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-346dbe6d-a665-4193-8db4-143df3a5d379 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:21.773246 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-346dbe6d-a665-4193-8db4-143df3a5d379 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:21.774012 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-346dbe6d-a665-4193-8db4-143df3a5d379 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:21.898656 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-2c945175-bdc4-4a98-82a6-431c54a13083 req-fbce10a6-a6be-4eca-aebb-3bfa5b1b827d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e", "name": "network-vif-plugged", "status": "completed", "tag": "e6aa1f7f-1ffc-497f-bd6e-91828753a483"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:32:21.921423 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-2c945175-bdc4-4a98-82a6-431c54a13083 req-fbce10a6-a6be-4eca-aebb-3bfa5b1b827d service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:21.921852 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-2c945175-bdc4-4a98-82a6-431c54a13083 req-fbce10a6-a6be-4eca-aebb-3bfa5b1b827d service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:21.922319 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-2c945175-bdc4-4a98-82a6-431c54a13083 req-fbce10a6-a6be-4eca-aebb-3bfa5b1b827d service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:21.926334 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=100 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:21.934106 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-2c945175-bdc4-4a98-82a6-431c54a13083 req-fbce10a6-a6be-4eca-aebb-3bfa5b1b827d service nova] Creating event network-vif-plugged:e6aa1f7f-1ffc-497f-bd6e-91828753a483 for instance 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e on n-h2-master-1 Oct 30 01:32:21.940496 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-2c945175-bdc4-4a98-82a6-431c54a13083 req-fbce10a6-a6be-4eca-aebb-3bfa5b1b827d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045448 Oct 30 01:32:21.941444 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2088/4212] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:32:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:32:22.110342 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-346dbe6d-a665-4193-8db4-143df3a5d379 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:22.120313 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-346dbe6d-a665-4193-8db4-143df3a5d379 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers/b36a2df7-45c9-4a51-88f1-e1a1b9c0969d" status: 200 len: 1512 microversion: 2.1 time: 0.363296 Oct 30 01:32:22.121952 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2125/4213] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:21 2022] GET /compute/v2.1/servers/b36a2df7-45c9-4a51-88f1-e1a1b9c0969d => generated 1512 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:22.156029 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e7b4d117-fd2a-47eb-a759-bcaf7c24cc1c tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:22.160679 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e7b4d117-fd2a-47eb-a759-bcaf7c24cc1c tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: 6573b259-e50d-4954-9d64-3c914df97308] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:22.172685 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7b4d117-fd2a-47eb-a759-bcaf7c24cc1c tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:22.174206 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7b4d117-fd2a-47eb-a759-bcaf7c24cc1c tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:22.176578 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7b4d117-fd2a-47eb-a759-bcaf7c24cc1c tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:22.178042 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7b4d117-fd2a-47eb-a759-bcaf7c24cc1c tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:22.179175 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7b4d117-fd2a-47eb-a759-bcaf7c24cc1c tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:22.180052 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7b4d117-fd2a-47eb-a759-bcaf7c24cc1c tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:22.223715 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1b4a34b2-1d5f-4b6f-a483-2a502ebcf88a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:22.224995 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1b4a34b2-1d5f-4b6f-a483-2a502ebcf88a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:22.233240 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1b4a34b2-1d5f-4b6f-a483-2a502ebcf88a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:22.234055 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1b4a34b2-1d5f-4b6f-a483-2a502ebcf88a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:22.234701 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1b4a34b2-1d5f-4b6f-a483-2a502ebcf88a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:22.235414 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1b4a34b2-1d5f-4b6f-a483-2a502ebcf88a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:22.236019 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1b4a34b2-1d5f-4b6f-a483-2a502ebcf88a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:22.236444 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1b4a34b2-1d5f-4b6f-a483-2a502ebcf88a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:22.594038 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e7b4d117-fd2a-47eb-a759-bcaf7c24cc1c tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:22.604067 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e7b4d117-fd2a-47eb-a759-bcaf7c24cc1c tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers/6573b259-e50d-4954-9d64-3c914df97308" status: 200 len: 1513 microversion: 2.1 time: 0.460150 Oct 30 01:32:22.617678 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1b4a34b2-1d5f-4b6f-a483-2a502ebcf88a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:22.618006 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2089/4214] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:22 2022] GET /compute/v2.1/servers/6573b259-e50d-4954-9d64-3c914df97308 => generated 1513 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:22.618006 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2ac4aab4-a16e-4b34-96e2-83f9b8c6f3fd tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:22.618006 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2ac4aab4-a16e-4b34-96e2-83f9b8c6f3fd tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: 03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:22.618219 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1b4a34b2-1d5f-4b6f-a483-2a502ebcf88a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e" status: 200 len: 1308 microversion: 2.1 time: 0.393536 Oct 30 01:32:22.618219 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2126/4215] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:22 2022] GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e => generated 1308 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:32:22.619718 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2ac4aab4-a16e-4b34-96e2-83f9b8c6f3fd tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:22.620391 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2ac4aab4-a16e-4b34-96e2-83f9b8c6f3fd tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:22.620989 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2ac4aab4-a16e-4b34-96e2-83f9b8c6f3fd tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:22.621879 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2ac4aab4-a16e-4b34-96e2-83f9b8c6f3fd tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:22.622787 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2ac4aab4-a16e-4b34-96e2-83f9b8c6f3fd tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:22.624004 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2ac4aab4-a16e-4b34-96e2-83f9b8c6f3fd tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:22.635388 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ea1d06a7-4ec6-4ff9-b863-79ee3119cf4a tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:22.636020 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ea1d06a7-4ec6-4ff9-b863-79ee3119cf4a tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] [instance: 9d85310b-581e-4748-b962-ab53210e15b5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:22.640932 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-2ac4aab4-a16e-4b34-96e2-83f9b8c6f3fd tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] HTTP exception thrown: Instance 03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5 could not be found. Oct 30 01:32:22.642435 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea1d06a7-4ec6-4ff9-b863-79ee3119cf4a tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2ac4aab4-a16e-4b34-96e2-83f9b8c6f3fd tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Request method failure captured: Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5 HTTP/1.1 Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdPsZZXjRvWKe2zWP-5VH1VYAsWsLLjUmpyob2uINkfAXNLt0qGMmCTWjYn2WpZ3XOOdsuaM4lwk-qZrOIX3mOHzuCJPZ3r-9M-w153XBWLoTow-eSMj1bsAWDNo3KKhMzjHqic8AJ-DcXpdsBh93g0dRB_UMWMRrGyY1cbSRdHJrvg Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 0bce487302c24def8a8473b0725904f2 Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5 could not be found. Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5'} Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5 could not be found. Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5 could not be found. Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:22.642646 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:22.652307 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:22.652307 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:32:22.652307 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:32:22.652307 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:32:22.652307 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:32:22.652307 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5 could not be found. Oct 30 01:32:22.652307 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:22.652701 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea1d06a7-4ec6-4ff9-b863-79ee3119cf4a tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:22.652807 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2ac4aab4-a16e-4b34-96e2-83f9b8c6f3fd tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Returning 404 to user: Instance 03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:32:22.652895 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea1d06a7-4ec6-4ff9-b863-79ee3119cf4a tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:22.652975 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2ac4aab4-a16e-4b34-96e2-83f9b8c6f3fd tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5" status: 404 len: 111 microversion: 2.1 time: 0.037938 Oct 30 01:32:22.653041 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea1d06a7-4ec6-4ff9-b863-79ee3119cf4a tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:22.653107 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2090/4216] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:22 2022] GET /compute/v2.1/servers/03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:32:22.653176 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea1d06a7-4ec6-4ff9-b863-79ee3119cf4a tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:22.653176 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea1d06a7-4ec6-4ff9-b863-79ee3119cf4a tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:22.653366 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6a4ac6ba-4cc7-44ee-bdbf-68f3cf765222 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:22.656801 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6a4ac6ba-4cc7-44ee-bdbf-68f3cf765222 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:22.657645 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6a4ac6ba-4cc7-44ee-bdbf-68f3cf765222 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '8b25b290c8004e1f8f89e17b448f242a'} {{(pid=121103) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 30 01:32:22.670426 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a4ac6ba-4cc7-44ee-bdbf-68f3cf765222 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:22.674661 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a4ac6ba-4cc7-44ee-bdbf-68f3cf765222 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:22.674661 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a4ac6ba-4cc7-44ee-bdbf-68f3cf765222 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:22.674661 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a4ac6ba-4cc7-44ee-bdbf-68f3cf765222 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:22.675285 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a4ac6ba-4cc7-44ee-bdbf-68f3cf765222 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:22.675913 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a4ac6ba-4cc7-44ee-bdbf-68f3cf765222 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:22.727643 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ea1d06a7-4ec6-4ff9-b863-79ee3119cf4a tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ac5422c8f048148aac2c9b62e0482e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d179276dbf4e4d9cb780b18e7a22c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:22.736687 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ea1d06a7-4ec6-4ff9-b863-79ee3119cf4a tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "GET /compute/v2.1/servers/9d85310b-581e-4748-b962-ab53210e15b5" status: 200 len: 1274 microversion: 2.1 time: 0.106219 Oct 30 01:32:22.737416 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2127/4217] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:22 2022] GET /compute/v2.1/servers/9d85310b-581e-4748-b962-ab53210e15b5 => generated 1274 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:22.758180 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b25f5aa1-c495-4a45-bd3c-abdcf5b17aeb tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:22.759024 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b25f5aa1-c495-4a45-bd3c-abdcf5b17aeb tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:22.776340 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b25f5aa1-c495-4a45-bd3c-abdcf5b17aeb tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:22.777498 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b25f5aa1-c495-4a45-bd3c-abdcf5b17aeb tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:22.777943 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b25f5aa1-c495-4a45-bd3c-abdcf5b17aeb tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:22.778491 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.multi_cell_list [None req-6a4ac6ba-4cc7-44ee-bdbf-68f3cf765222 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121103) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 30 01:32:22.778668 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b25f5aa1-c495-4a45-bd3c-abdcf5b17aeb tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:22.779655 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b25f5aa1-c495-4a45-bd3c-abdcf5b17aeb tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:22.780057 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b25f5aa1-c495-4a45-bd3c-abdcf5b17aeb tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:22.858355 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6a4ac6ba-4cc7-44ee-bdbf-68f3cf765222 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:22.865003 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a4ac6ba-4cc7-44ee-bdbf-68f3cf765222 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:22.865524 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a4ac6ba-4cc7-44ee-bdbf-68f3cf765222 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:22.866134 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a4ac6ba-4cc7-44ee-bdbf-68f3cf765222 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:23.562679 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b25f5aa1-c495-4a45-bd3c-abdcf5b17aeb tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:23.563458 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6a4ac6ba-4cc7-44ee-bdbf-68f3cf765222 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 0.916793 Oct 30 01:32:23.564327 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2091/4218] 10.222.0.13 () {58 vars in 1167 bytes} [Sun Oct 30 01:32:22 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:23.571849 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b25f5aa1-c495-4a45-bd3c-abdcf5b17aeb tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.833138 Oct 30 01:32:23.578403 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2128/4219] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:22 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:23.589761 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f49f2ba6-13de-4463-8c76-0c62809ba5cf tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:23.595720 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f49f2ba6-13de-4463-8c76-0c62809ba5cf tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:23.597186 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f49f2ba6-13de-4463-8c76-0c62809ba5cf tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1249049654', 'deleted': False, 'project_id': '8b25b290c8004e1f8f89e17b448f242a'} {{(pid=121103) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 30 01:32:23.604785 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f49f2ba6-13de-4463-8c76-0c62809ba5cf tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:23.606445 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f49f2ba6-13de-4463-8c76-0c62809ba5cf tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:23.614768 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f49f2ba6-13de-4463-8c76-0c62809ba5cf tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:23.614768 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f49f2ba6-13de-4463-8c76-0c62809ba5cf tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:23.614768 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f49f2ba6-13de-4463-8c76-0c62809ba5cf tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:23.614768 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f49f2ba6-13de-4463-8c76-0c62809ba5cf tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:23.639314 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7900767d-7163-457c-bfa7-fae9ead98851 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:23.640018 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7900767d-7163-457c-bfa7-fae9ead98851 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:23.652736 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7900767d-7163-457c-bfa7-fae9ead98851 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:23.653248 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7900767d-7163-457c-bfa7-fae9ead98851 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:23.655477 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7900767d-7163-457c-bfa7-fae9ead98851 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:23.656783 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7900767d-7163-457c-bfa7-fae9ead98851 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:23.658821 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7900767d-7163-457c-bfa7-fae9ead98851 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:23.660370 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7900767d-7163-457c-bfa7-fae9ead98851 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:23.781426 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.multi_cell_list [None req-f49f2ba6-13de-4463-8c76-0c62809ba5cf tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121103) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 30 01:32:23.857589 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f49f2ba6-13de-4463-8c76-0c62809ba5cf tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:23.863884 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f49f2ba6-13de-4463-8c76-0c62809ba5cf tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:23.864593 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f49f2ba6-13de-4463-8c76-0c62809ba5cf tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:23.865227 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f49f2ba6-13de-4463-8c76-0c62809ba5cf tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:24.050689 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7900767d-7163-457c-bfa7-fae9ead98851 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:24.062181 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7900767d-7163-457c-bfa7-fae9ead98851 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e" status: 200 len: 1308 microversion: 2.1 time: 0.429559 Oct 30 01:32:24.063415 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2129/4220] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:23 2022] GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e => generated 1308 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:24.071753 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-68b6e03d-5079-4084-b040-5139c98ef003 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "2bdbb622-9eb5-4b19-93d6-10bf71c70ecc"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-68b6e03d-5079-4084-b040-5139c98ef003 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Request method failure captured: Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 163 Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdPsZZXjRvWKe2zWP-5VH1VYAsWsLLjUmpyob2uINkfAXNLt0qGMmCTWjYn2WpZ3XOOdsuaM4lwk-qZrOIX3mOHzuCJPZ3r-9M-w153XBWLoTow-eSMj1bsAWDNo3KKhMzjHqic8AJ-DcXpdsBh93g0dRB_UMWMRrGyY1cbSRdHJrvg Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 0bce487302c24def8a8473b0725904f2 Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: {"server": {"name": 12345, "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "2bdbb622-9eb5-4b19-93d6-10bf71c70ecc"}]}} Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'deb14158-45d8-4539-889d-ff9726d046d7', 'flavorRef': '452', 'networks': [{'uuid': '2bdbb622-9eb5-4b19-93d6-10bf71c70ecc'}]}}} Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise error Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi 12345 Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 30 01:32:24.080108 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 30 01:32:24.084537 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 30 01:32:24.084537 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 30 01:32:24.084537 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:24.084537 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:24.084537 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:24.084537 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:24.084537 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:32:24.084537 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:32:24.084537 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 30 01:32:24.084537 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 30 01:32:24.084537 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 30 01:32:24.084537 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:24.084537 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-68b6e03d-5079-4084-b040-5139c98ef003 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:32:24.084537 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-68b6e03d-5079-4084-b040-5139c98ef003 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.017679 Oct 30 01:32:24.084537 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2130/4221] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:32:24 2022] POST /compute/v2.1/servers => generated 127 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:32:24.092528 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1be07a1f-000b-4f08-9623-9f48131c86da tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:24.093541 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1be07a1f-000b-4f08-9623-9f48131c86da tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] [instance: 9d85310b-581e-4748-b962-ab53210e15b5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:24.101529 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1be07a1f-000b-4f08-9623-9f48131c86da tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:24.102017 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1be07a1f-000b-4f08-9623-9f48131c86da tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:24.102500 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1be07a1f-000b-4f08-9623-9f48131c86da tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:24.103200 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1be07a1f-000b-4f08-9623-9f48131c86da tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:24.103645 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1be07a1f-000b-4f08-9623-9f48131c86da tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:24.104086 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1be07a1f-000b-4f08-9623-9f48131c86da tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:24.267835 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f49f2ba6-13de-4463-8c76-0c62809ba5cf tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1249049654" status: 200 len: 1515 microversion: 2.1 time: 0.681875 Oct 30 01:32:24.268639 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2092/4222] 10.222.0.13 () {58 vars in 1263 bytes} [Sun Oct 30 01:32:23 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1249049654 => generated 1515 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:24.274559 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0548a81d-f8e8-40b6-94aa-ab8512e314a8 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:24.275508 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0548a81d-f8e8-40b6-94aa-ab8512e314a8 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:24.283024 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:24.290130 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0548a81d-f8e8-40b6-94aa-ab8512e314a8 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:24.290130 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0548a81d-f8e8-40b6-94aa-ab8512e314a8 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:24.290130 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0548a81d-f8e8-40b6-94aa-ab8512e314a8 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:24.290130 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0548a81d-f8e8-40b6-94aa-ab8512e314a8 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:24.290130 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0548a81d-f8e8-40b6-94aa-ab8512e314a8 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:24.294485 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0548a81d-f8e8-40b6-94aa-ab8512e314a8 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:24.471308 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1be07a1f-000b-4f08-9623-9f48131c86da tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ac5422c8f048148aac2c9b62e0482e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d179276dbf4e4d9cb780b18e7a22c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:24.479213 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1be07a1f-000b-4f08-9623-9f48131c86da tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "GET /compute/v2.1/servers/9d85310b-581e-4748-b962-ab53210e15b5" status: 200 len: 1316 microversion: 2.1 time: 0.393880 Oct 30 01:32:24.493813 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2131/4223] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:24 2022] GET /compute/v2.1/servers/9d85310b-581e-4748-b962-ab53210e15b5 => generated 1316 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:24.498902 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2845da23-1566-4334-9442-b2798ad178e1 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:24.504119 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2845da23-1566-4334-9442-b2798ad178e1 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:24.505051 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2845da23-1566-4334-9442-b2798ad178e1 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '8b25b290c8004e1f8f89e17b448f242a'} {{(pid=121102) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 30 01:32:24.511217 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2845da23-1566-4334-9442-b2798ad178e1 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:24.511920 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2845da23-1566-4334-9442-b2798ad178e1 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:24.512362 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2845da23-1566-4334-9442-b2798ad178e1 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:24.513102 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2845da23-1566-4334-9442-b2798ad178e1 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:24.514139 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2845da23-1566-4334-9442-b2798ad178e1 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:24.519677 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2845da23-1566-4334-9442-b2798ad178e1 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:24.614215 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:24.621450 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.multi_cell_list [None req-2845da23-1566-4334-9442-b2798ad178e1 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121102) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 30 01:32:24.628486 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0548a81d-f8e8-40b6-94aa-ab8512e314a8 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:24.637303 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0548a81d-f8e8-40b6-94aa-ab8512e314a8 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.367502 Oct 30 01:32:24.638199 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2093/4224] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:24 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:24.660998 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e240c5e8-380f-47c0-a1dd-0a3f4596edf6 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:24.661642 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e240c5e8-380f-47c0-a1dd-0a3f4596edf6 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:24.668207 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e240c5e8-380f-47c0-a1dd-0a3f4596edf6 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:24.668972 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e240c5e8-380f-47c0-a1dd-0a3f4596edf6 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:24.669537 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e240c5e8-380f-47c0-a1dd-0a3f4596edf6 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:24.670497 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e240c5e8-380f-47c0-a1dd-0a3f4596edf6 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:24.671068 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e240c5e8-380f-47c0-a1dd-0a3f4596edf6 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:24.671679 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e240c5e8-380f-47c0-a1dd-0a3f4596edf6 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:24.692329 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2845da23-1566-4334-9442-b2798ad178e1 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:24.699418 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2845da23-1566-4334-9442-b2798ad178e1 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:24.699908 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2845da23-1566-4334-9442-b2798ad178e1 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:24.700318 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2845da23-1566-4334-9442-b2798ad178e1 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:25.111075 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e240c5e8-380f-47c0-a1dd-0a3f4596edf6 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:25.117316 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e240c5e8-380f-47c0-a1dd-0a3f4596edf6 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.460198 Oct 30 01:32:25.117915 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2094/4225] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:24 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:32:25.133501 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a3bcbcf1-62c4-471a-8456-af95495dfa1f tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:25.134114 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a3bcbcf1-62c4-471a-8456-af95495dfa1f tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:25.143385 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a3bcbcf1-62c4-471a-8456-af95495dfa1f tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:25.144048 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a3bcbcf1-62c4-471a-8456-af95495dfa1f tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:25.144707 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a3bcbcf1-62c4-471a-8456-af95495dfa1f tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:25.146207 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a3bcbcf1-62c4-471a-8456-af95495dfa1f tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:25.146863 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a3bcbcf1-62c4-471a-8456-af95495dfa1f tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:25.147437 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a3bcbcf1-62c4-471a-8456-af95495dfa1f tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:25.151827 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2845da23-1566-4334-9442-b2798ad178e1 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4520 microversion: 2.1 time: 0.656990 Oct 30 01:32:25.152768 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2132/4226] 10.222.0.13 () {58 vars in 1173 bytes} [Sun Oct 30 01:32:24 2022] GET /compute/v2.1/servers/detail?status=active => generated 4520 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:25.183912 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-229f6d6b-ae22-477b-afa6-822bd733fad0 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:25.189864 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-229f6d6b-ae22-477b-afa6-822bd733fad0 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:25.190525 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.compute.servers [None req-229f6d6b-ae22-477b-afa6-822bd733fad0 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Removing options 'limit' from query {{(pid=121102) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 30 01:32:25.191513 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-229f6d6b-ae22-477b-afa6-822bd733fad0 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Searching by: {'deleted': False, 'project_id': '8b25b290c8004e1f8f89e17b448f242a'} {{(pid=121102) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 30 01:32:25.193551 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:25.198261 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-229f6d6b-ae22-477b-afa6-822bd733fad0 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:25.199219 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-229f6d6b-ae22-477b-afa6-822bd733fad0 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:25.199966 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-229f6d6b-ae22-477b-afa6-822bd733fad0 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:25.201470 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-229f6d6b-ae22-477b-afa6-822bd733fad0 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:25.202071 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-229f6d6b-ae22-477b-afa6-822bd733fad0 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:25.203031 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-229f6d6b-ae22-477b-afa6-822bd733fad0 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:25.243489 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-229f6d6b-ae22-477b-afa6-822bd733fad0 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:25.251383 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-229f6d6b-ae22-477b-afa6-822bd733fad0 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:25.252373 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-229f6d6b-ae22-477b-afa6-822bd733fad0 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:25.252807 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-229f6d6b-ae22-477b-afa6-822bd733fad0 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:25.538707 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-229f6d6b-ae22-477b-afa6-822bd733fad0 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 0.359996 Oct 30 01:32:25.539641 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2133/4227] 10.222.0.13 () {58 vars in 1161 bytes} [Sun Oct 30 01:32:25 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:25.544869 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-15f32d66-7ded-4189-b40c-3406d051a6b7 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:25.545710 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-15f32d66-7ded-4189-b40c-3406d051a6b7 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] [instance: 9d85310b-581e-4748-b962-ab53210e15b5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:25.552058 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-15f32d66-7ded-4189-b40c-3406d051a6b7 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:25.553363 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-15f32d66-7ded-4189-b40c-3406d051a6b7 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:25.553981 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-15f32d66-7ded-4189-b40c-3406d051a6b7 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:25.554880 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-15f32d66-7ded-4189-b40c-3406d051a6b7 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:25.555562 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-15f32d66-7ded-4189-b40c-3406d051a6b7 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:25.556546 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-15f32d66-7ded-4189-b40c-3406d051a6b7 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:25.646342 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a3bcbcf1-62c4-471a-8456-af95495dfa1f tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:25.657495 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a3bcbcf1-62c4-471a-8456-af95495dfa1f tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e" status: 200 len: 1489 microversion: 2.1 time: 0.538473 Oct 30 01:32:25.665808 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2095/4228] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:25 2022] GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e => generated 1489 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:25.665808 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-169a2570-9681-4d41-b03c-3ae008a28c63 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:25.672166 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-169a2570-9681-4d41-b03c-3ae008a28c63 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:25.673493 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-169a2570-9681-4d41-b03c-3ae008a28c63 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '8b25b290c8004e1f8f89e17b448f242a'} {{(pid=121103) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 30 01:32:25.680624 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-169a2570-9681-4d41-b03c-3ae008a28c63 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:25.681435 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-169a2570-9681-4d41-b03c-3ae008a28c63 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:25.682030 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-169a2570-9681-4d41-b03c-3ae008a28c63 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:25.682916 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-169a2570-9681-4d41-b03c-3ae008a28c63 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:25.683521 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-169a2570-9681-4d41-b03c-3ae008a28c63 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:25.684458 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-169a2570-9681-4d41-b03c-3ae008a28c63 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:25.713053 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.multi_cell_list [None req-169a2570-9681-4d41-b03c-3ae008a28c63 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121103) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 30 01:32:25.744375 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-169a2570-9681-4d41-b03c-3ae008a28c63 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.085002 Oct 30 01:32:25.745097 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2096/4229] 10.222.0.13 () {58 vars in 1152 bytes} [Sun Oct 30 01:32:25 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:25.750100 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6a7d4307-a8c6-4b69-97a4-f7f3a3f7fa2b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1100929977"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:32:25.752575 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6a7d4307-a8c6-4b69-97a4-f7f3a3f7fa2b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:25.758913 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a7d4307-a8c6-4b69-97a4-f7f3a3f7fa2b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:25.759408 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a7d4307-a8c6-4b69-97a4-f7f3a3f7fa2b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:25.759845 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a7d4307-a8c6-4b69-97a4-f7f3a3f7fa2b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:25.760549 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a7d4307-a8c6-4b69-97a4-f7f3a3f7fa2b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:25.761167 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a7d4307-a8c6-4b69-97a4-f7f3a3f7fa2b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:25.761625 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a7d4307-a8c6-4b69-97a4-f7f3a3f7fa2b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:25.863970 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-15f32d66-7ded-4189-b40c-3406d051a6b7 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ac5422c8f048148aac2c9b62e0482e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d179276dbf4e4d9cb780b18e7a22c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:25.873662 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-15f32d66-7ded-4189-b40c-3406d051a6b7 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "GET /compute/v2.1/servers/9d85310b-581e-4748-b962-ab53210e15b5" status: 200 len: 1316 microversion: 2.1 time: 0.332935 Oct 30 01:32:25.885920 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2134/4230] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:25 2022] GET /compute/v2.1/servers/9d85310b-581e-4748-b962-ab53210e15b5 => generated 1316 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:25.895105 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-02e5e87a-570f-4256-b467-0f2127b3c920 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:25.902480 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-02e5e87a-570f-4256-b467-0f2127b3c920 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:25.903145 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.compute.servers [None req-02e5e87a-570f-4256-b467-0f2127b3c920 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Removing options 'limit' from query {{(pid=121102) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 30 01:32:25.904503 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-02e5e87a-570f-4256-b467-0f2127b3c920 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Searching by: {'deleted': False, 'project_id': '8b25b290c8004e1f8f89e17b448f242a'} {{(pid=121102) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 30 01:32:25.911651 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-02e5e87a-570f-4256-b467-0f2127b3c920 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:25.912357 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-02e5e87a-570f-4256-b467-0f2127b3c920 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:25.913040 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-02e5e87a-570f-4256-b467-0f2127b3c920 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:25.914088 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-02e5e87a-570f-4256-b467-0f2127b3c920 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:25.915217 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-02e5e87a-570f-4256-b467-0f2127b3c920 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:25.915371 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6a7d4307-a8c6-4b69-97a4-f7f3a3f7fa2b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "PUT /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e" status: 200 len: 1075 microversion: 2.1 time: 0.169142 Oct 30 01:32:25.929431 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2097/4231] 10.222.0.13 () {60 vars in 1256 bytes} [Sun Oct 30 01:32:25 2022] PUT /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e => generated 1075 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:25.932549 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-02e5e87a-570f-4256-b467-0f2127b3c920 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:25.935679 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-f4f65b13-b5d8-40e9-a039-da63b4299913 req-9eaa9341-75a1-4af4-8150-ed8347a327f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d85310b-581e-4748-b962-ab53210e15b5", "tag": "f8b486d2-42f6-477d-98fa-03d17214f6f4"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:32:25.953814 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-f4f65b13-b5d8-40e9-a039-da63b4299913 req-9eaa9341-75a1-4af4-8150-ed8347a327f9 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:25.954231 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-f4f65b13-b5d8-40e9-a039-da63b4299913 req-9eaa9341-75a1-4af4-8150-ed8347a327f9 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:25.957404 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-f4f65b13-b5d8-40e9-a039-da63b4299913 req-9eaa9341-75a1-4af4-8150-ed8347a327f9 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:25.986435 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-f4f65b13-b5d8-40e9-a039-da63b4299913 req-9eaa9341-75a1-4af4-8150-ed8347a327f9 service nova] Creating event network-changed:f8b486d2-42f6-477d-98fa-03d17214f6f4 for instance 9d85310b-581e-4748-b962-ab53210e15b5 on n-h1-master-1 Oct 30 01:32:25.988259 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.multi_cell_list [None req-02e5e87a-570f-4256-b467-0f2127b3c920 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121102) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 30 01:32:25.997361 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-f4f65b13-b5d8-40e9-a039-da63b4299913 req-9eaa9341-75a1-4af4-8150-ed8347a327f9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067027 Oct 30 01:32:25.998353 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2098/4232] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:32:26.003701 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-aaf33c0a-7b6f-4267-9c48-c4a4edd5c068 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:26.004408 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-aaf33c0a-7b6f-4267-9c48-c4a4edd5c068 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:26.011573 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aaf33c0a-7b6f-4267-9c48-c4a4edd5c068 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:26.012120 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aaf33c0a-7b6f-4267-9c48-c4a4edd5c068 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:26.012653 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aaf33c0a-7b6f-4267-9c48-c4a4edd5c068 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:26.025225 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aaf33c0a-7b6f-4267-9c48-c4a4edd5c068 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:26.025931 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aaf33c0a-7b6f-4267-9c48-c4a4edd5c068 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:26.026430 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aaf33c0a-7b6f-4267-9c48-c4a4edd5c068 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:26.034028 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-02e5e87a-570f-4256-b467-0f2127b3c920 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.146865 Oct 30 01:32:26.034916 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2135/4233] 10.222.0.13 () {58 vars in 1150 bytes} [Sun Oct 30 01:32:25 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:26.052388 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7d4ba250-5b0d-426f-a392-c8320d7f4ed9 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:26.059427 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7d4ba250-5b0d-426f-a392-c8320d7f4ed9 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:26.061014 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7d4ba250-5b0d-426f-a392-c8320d7f4ed9 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Searching by: {'deleted': False, 'project_id': '8b25b290c8004e1f8f89e17b448f242a'} {{(pid=121102) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 30 01:32:26.071062 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7d4ba250-5b0d-426f-a392-c8320d7f4ed9 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:26.071544 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7d4ba250-5b0d-426f-a392-c8320d7f4ed9 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:26.071979 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7d4ba250-5b0d-426f-a392-c8320d7f4ed9 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:26.072705 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7d4ba250-5b0d-426f-a392-c8320d7f4ed9 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:26.073597 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7d4ba250-5b0d-426f-a392-c8320d7f4ed9 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:26.073597 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7d4ba250-5b0d-426f-a392-c8320d7f4ed9 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:26.131843 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.multi_cell_list [None req-7d4ba250-5b0d-426f-a392-c8320d7f4ed9 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121102) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 30 01:32:26.173755 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7d4ba250-5b0d-426f-a392-c8320d7f4ed9 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.125097 Oct 30 01:32:26.174789 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2136/4234] 10.222.0.13 () {58 vars in 1125 bytes} [Sun Oct 30 01:32:26 2022] GET /compute/v2.1/servers => generated 1011 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:26.188064 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fb1168f4-9bfa-4dc4-8ecf-824bc559d602 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:26.194242 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-fb1168f4-9bfa-4dc4-8ecf-824bc559d602 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:26.194927 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fb1168f4-9bfa-4dc4-8ecf-824bc559d602 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '8b25b290c8004e1f8f89e17b448f242a'} {{(pid=121102) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 30 01:32:26.209155 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb1168f4-9bfa-4dc4-8ecf-824bc559d602 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:26.209663 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb1168f4-9bfa-4dc4-8ecf-824bc559d602 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:26.210271 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb1168f4-9bfa-4dc4-8ecf-824bc559d602 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:26.211060 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb1168f4-9bfa-4dc4-8ecf-824bc559d602 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:26.211507 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb1168f4-9bfa-4dc4-8ecf-824bc559d602 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:26.211976 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb1168f4-9bfa-4dc4-8ecf-824bc559d602 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:26.313267 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.multi_cell_list [None req-fb1168f4-9bfa-4dc4-8ecf-824bc559d602 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121102) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 30 01:32:26.398912 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fb1168f4-9bfa-4dc4-8ecf-824bc559d602 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.215345 Oct 30 01:32:26.400221 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2137/4235] 10.222.0.13 () {58 vars in 1146 bytes} [Sun Oct 30 01:32:26 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:32:26.417946 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b2742aef-91d5-4662-8d29-bafd891153cb tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:26.423725 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b2742aef-91d5-4662-8d29-bafd891153cb tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:26.424186 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.compute.servers [None req-b2742aef-91d5-4662-8d29-bafd891153cb tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Removing options 'limit' from query {{(pid=121102) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 30 01:32:26.424848 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b2742aef-91d5-4662-8d29-bafd891153cb tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Searching by: {'deleted': False, 'project_id': '8b25b290c8004e1f8f89e17b448f242a'} {{(pid=121102) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 30 01:32:26.427238 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-aaf33c0a-7b6f-4267-9c48-c4a4edd5c068 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:26.430946 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2742aef-91d5-4662-8d29-bafd891153cb tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:26.431468 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2742aef-91d5-4662-8d29-bafd891153cb tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:26.431908 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2742aef-91d5-4662-8d29-bafd891153cb tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:26.432636 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2742aef-91d5-4662-8d29-bafd891153cb tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:26.433146 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2742aef-91d5-4662-8d29-bafd891153cb tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:26.433745 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2742aef-91d5-4662-8d29-bafd891153cb tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:26.437269 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-aaf33c0a-7b6f-4267-9c48-c4a4edd5c068 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e" status: 200 len: 1501 microversion: 2.1 time: 0.437805 Oct 30 01:32:26.455144 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2099/4236] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:25 2022] GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e => generated 1501 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:26.460578 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-24a8ef00-3224-449a-9ae9-31af992f1cfc tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:26.461585 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-24a8ef00-3224-449a-9ae9-31af992f1cfc tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:26.463531 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b2742aef-91d5-4662-8d29-bafd891153cb tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.052409 Oct 30 01:32:26.465479 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2138/4237] 10.222.0.13 () {58 vars in 1140 bytes} [Sun Oct 30 01:32:26 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:32:26.473104 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-24a8ef00-3224-449a-9ae9-31af992f1cfc tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:26.473104 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-24a8ef00-3224-449a-9ae9-31af992f1cfc tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:26.473583 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-24a8ef00-3224-449a-9ae9-31af992f1cfc tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:26.474323 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-24a8ef00-3224-449a-9ae9-31af992f1cfc tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:26.474955 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-24a8ef00-3224-449a-9ae9-31af992f1cfc tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:26.475390 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-24a8ef00-3224-449a-9ae9-31af992f1cfc tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:26.478241 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1aa9223a-8ab4-4f77-98ca-5db9464d49e0 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:26.484167 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1aa9223a-8ab4-4f77-98ca-5db9464d49e0 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:26.484853 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1aa9223a-8ab4-4f77-98ca-5db9464d49e0 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1249049654', 'deleted': False, 'project_id': '8b25b290c8004e1f8f89e17b448f242a'} {{(pid=121102) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 30 01:32:26.490685 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1aa9223a-8ab4-4f77-98ca-5db9464d49e0 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:26.491349 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1aa9223a-8ab4-4f77-98ca-5db9464d49e0 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:26.491779 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1aa9223a-8ab4-4f77-98ca-5db9464d49e0 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:26.492563 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1aa9223a-8ab4-4f77-98ca-5db9464d49e0 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:26.493018 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1aa9223a-8ab4-4f77-98ca-5db9464d49e0 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:26.493654 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1aa9223a-8ab4-4f77-98ca-5db9464d49e0 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:26.600635 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.multi_cell_list [None req-1aa9223a-8ab4-4f77-98ca-5db9464d49e0 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121102) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 30 01:32:26.674573 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1aa9223a-8ab4-4f77-98ca-5db9464d49e0 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1249049654" status: 200 len: 346 microversion: 2.1 time: 0.199842 Oct 30 01:32:26.675401 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2139/4238] 10.222.0.13 () {58 vars in 1242 bytes} [Sun Oct 30 01:32:26 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1249049654 => generated 346 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:32:26.691057 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f29baae9-30a6-4a9b-be8e-eb3e7639fbf2 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:32:26.698276 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f29baae9-30a6-4a9b-be8e-eb3e7639fbf2 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:26.699340 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f29baae9-30a6-4a9b-be8e-eb3e7639fbf2 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:26.702069 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f29baae9-30a6-4a9b-be8e-eb3e7639fbf2 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:26.730380 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f29baae9-30a6-4a9b-be8e-eb3e7639fbf2 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: b36a2df7-45c9-4a51-88f1-e1a1b9c0969d] Going to try to stop instance {{(pid=121102) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 30 01:32:26.949664 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f29baae9-30a6-4a9b-be8e-eb3e7639fbf2 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "POST /compute/v2.1/servers/b36a2df7-45c9-4a51-88f1-e1a1b9c0969d/action" status: 202 len: 0 microversion: 2.1 time: 0.263782 Oct 30 01:32:26.952261 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2140/4239] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:32:26 2022] POST /compute/v2.1/servers/b36a2df7-45c9-4a51-88f1-e1a1b9c0969d/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:32:26.961226 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9596f18f-4376-4ba3-a259-f9cc40639591 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:26.962437 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9596f18f-4376-4ba3-a259-f9cc40639591 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] [instance: 9d85310b-581e-4748-b962-ab53210e15b5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:26.981464 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9596f18f-4376-4ba3-a259-f9cc40639591 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:26.985845 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9596f18f-4376-4ba3-a259-f9cc40639591 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:26.988824 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9596f18f-4376-4ba3-a259-f9cc40639591 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:26.990413 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9596f18f-4376-4ba3-a259-f9cc40639591 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:26.991891 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9596f18f-4376-4ba3-a259-f9cc40639591 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:26.993300 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9596f18f-4376-4ba3-a259-f9cc40639591 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:27.284473 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-24a8ef00-3224-449a-9ae9-31af992f1cfc tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:27.298521 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-24a8ef00-3224-449a-9ae9-31af992f1cfc tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e" status: 200 len: 1501 microversion: 2.1 time: 0.841583 Oct 30 01:32:27.300145 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2100/4240] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:26 2022] GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e => generated 1501 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:32:27.308676 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fd78fef5-9896-404e-b1dc-982d90efb2b8 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:27.311225 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-fd78fef5-9896-404e-b1dc-982d90efb2b8 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: b36a2df7-45c9-4a51-88f1-e1a1b9c0969d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:27.326961 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fd78fef5-9896-404e-b1dc-982d90efb2b8 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:27.330291 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fd78fef5-9896-404e-b1dc-982d90efb2b8 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:27.330744 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fd78fef5-9896-404e-b1dc-982d90efb2b8 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:27.332360 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fd78fef5-9896-404e-b1dc-982d90efb2b8 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:27.332360 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fd78fef5-9896-404e-b1dc-982d90efb2b8 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:27.333922 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fd78fef5-9896-404e-b1dc-982d90efb2b8 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:27.350607 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9596f18f-4376-4ba3-a259-f9cc40639591 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ac5422c8f048148aac2c9b62e0482e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d179276dbf4e4d9cb780b18e7a22c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:27.367662 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9596f18f-4376-4ba3-a259-f9cc40639591 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "GET /compute/v2.1/servers/9d85310b-581e-4748-b962-ab53210e15b5" status: 200 len: 1316 microversion: 2.1 time: 0.413817 Oct 30 01:32:27.373581 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2141/4241] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:26 2022] GET /compute/v2.1/servers/9d85310b-581e-4748-b962-ab53210e15b5 => generated 1316 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:27.386868 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-70b0e76d-0659-4fc0-bd3e-57503240cb57 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:32:27.394097 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-70b0e76d-0659-4fc0-bd3e-57503240cb57 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:27.394682 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-70b0e76d-0659-4fc0-bd3e-57503240cb57 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:27.395119 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-70b0e76d-0659-4fc0-bd3e-57503240cb57 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:27.430975 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-70b0e76d-0659-4fc0-bd3e-57503240cb57 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e] Going to try to stop instance {{(pid=121102) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 30 01:32:27.529219 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-fd78fef5-9896-404e-b1dc-982d90efb2b8 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:27.537188 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fd78fef5-9896-404e-b1dc-982d90efb2b8 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers/b36a2df7-45c9-4a51-88f1-e1a1b9c0969d" status: 200 len: 1522 microversion: 2.1 time: 0.235342 Oct 30 01:32:27.537804 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2101/4242] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:27 2022] GET /compute/v2.1/servers/b36a2df7-45c9-4a51-88f1-e1a1b9c0969d => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:27.649808 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-70b0e76d-0659-4fc0-bd3e-57503240cb57 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "POST /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e/action" status: 202 len: 0 microversion: 2.1 time: 0.278741 Oct 30 01:32:27.652046 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2142/4243] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:32:27 2022] POST /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:32:27.659219 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1a91bc79-a604-4daf-a266-94baf4ac078d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:27.659834 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1a91bc79-a604-4daf-a266-94baf4ac078d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:27.665951 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a91bc79-a604-4daf-a266-94baf4ac078d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:27.666457 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a91bc79-a604-4daf-a266-94baf4ac078d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:27.666947 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a91bc79-a604-4daf-a266-94baf4ac078d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:27.667643 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a91bc79-a604-4daf-a266-94baf4ac078d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:27.668103 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a91bc79-a604-4daf-a266-94baf4ac078d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:27.668535 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a91bc79-a604-4daf-a266-94baf4ac078d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:27.812478 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1a91bc79-a604-4daf-a266-94baf4ac078d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:27.820384 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1a91bc79-a604-4daf-a266-94baf4ac078d tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e" status: 200 len: 1511 microversion: 2.1 time: 0.165070 Oct 30 01:32:27.820982 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2102/4244] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:27 2022] GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e => generated 1511 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:28.391855 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9f2d5b32-855c-4234-9c96-e5fc4e7ee65a tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:28.392771 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9f2d5b32-855c-4234-9c96-e5fc4e7ee65a tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] [instance: 9d85310b-581e-4748-b962-ab53210e15b5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:28.402148 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9f2d5b32-855c-4234-9c96-e5fc4e7ee65a tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:28.402653 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9f2d5b32-855c-4234-9c96-e5fc4e7ee65a tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:28.403082 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9f2d5b32-855c-4234-9c96-e5fc4e7ee65a tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:28.405060 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9f2d5b32-855c-4234-9c96-e5fc4e7ee65a tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:28.405060 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9f2d5b32-855c-4234-9c96-e5fc4e7ee65a tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:28.405060 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9f2d5b32-855c-4234-9c96-e5fc4e7ee65a tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:28.418765 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3d9f4d3f-10a9-4ae4-8fa6-29763e1e7045 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-550753079", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "1a762580-ace9-4f9b-b9a4-42173233062d", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "2bdbb622-9eb5-4b19-93d6-10bf71c70ecc"}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:32:28.513648 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-3d9f4d3f-10a9-4ae4-8fa6-29763e1e7045 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] HTTP exception thrown: Block Device 1a762580-ace9-4f9b-b9a4-42173233062d is not bootable. Oct 30 01:32:28.522883 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3d9f4d3f-10a9-4ae4-8fa6-29763e1e7045 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Request method failure captured: Oct 30 01:32:28.522883 n-d-master-1 devstack@n-api.service[121103]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 30 01:32:28.522883 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:32:28.522883 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:32:28.522883 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:32:28.522883 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 357 Oct 30 01:32:28.522883 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:32:28.522883 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:32:28.522883 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:32:28.522883 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:32:28.522883 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdPsZZXjRvWKe2zWP-5VH1VYAsWsLLjUmpyob2uINkfAXNLt0qGMmCTWjYn2WpZ3XOOdsuaM4lwk-qZrOIX3mOHzuCJPZ3r-9M-w153XBWLoTow-eSMj1bsAWDNo3KKhMzjHqic8AJ-DcXpdsBh93g0dRB_UMWMRrGyY1cbSRdHJrvg Oct 30 01:32:28.522883 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:32:28.522883 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:32:28.522883 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:32:28.522883 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:32:28.522883 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:32:28.522883 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:32:28.522883 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:32:28.522883 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:32:28.522883 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:32:28.522883 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:32:28.522883 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:32:28.522883 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:32:28.522883 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:32:28.522883 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:32:28.522883 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:32:28.522883 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:32:28.522883 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:32:28.522883 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 0bce487302c24def8a8473b0725904f2 Oct 30 01:32:28.522883 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:32:28.522883 n-d-master-1 devstack@n-api.service[121103]: Oct 30 01:32:28.522883 n-d-master-1 devstack@n-api.service[121103]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-550753079", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "1a762580-ace9-4f9b-b9a4-42173233062d", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "2bdbb622-9eb5-4b19-93d6-10bf71c70ecc"}]}} Oct 30 01:32:28.522883 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:32:28.522883 n-d-master-1 devstack@n-api.service[121103]: exception: Block Device 1a762580-ace9-4f9b-b9a4-42173233062d is not bootable. Oct 30 01:32:28.522883 n-d-master-1 devstack@n-api.service[121103]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-550753079', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '1a762580-ace9-4f9b-b9a4-42173233062d'}], 'networks': [{'uuid': '2bdbb622-9eb5-4b19-93d6-10bf71c70ecc'}]}}} Oct 30 01:32:28.522883 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:32:28.522883 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:28.522883 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 30 01:32:28.522883 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 30 01:32:28.522883 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 30 01:32:28.522883 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 30 01:32:28.522883 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 30 01:32:28.522883 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 30 01:32:28.522883 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 30 01:32:28.522883 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 30 01:32:28.522883 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 1a762580-ace9-4f9b-b9a4-42173233062d is not bootable. Oct 30 01:32:28.522883 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:28.522883 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:28.522883 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:28.522883 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:28.522883 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:32:28.522883 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:32:28.522883 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:32:28.522883 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:32:28.522883 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:32:28.522883 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:32:28.522883 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:32:28.522883 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:32:28.522883 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:32:28.531443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:32:28.531443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:32:28.531443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:32:28.531443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 30 01:32:28.531443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 30 01:32:28.531443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 30 01:32:28.531443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 1a762580-ace9-4f9b-b9a4-42173233062d is not bootable. Oct 30 01:32:28.531443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:28.531443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:28.531443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:28.531443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:28.531443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:32:28.531443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:32:28.531443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:32:28.531443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:32:28.531443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 1a762580-ace9-4f9b-b9a4-42173233062d is not bootable. Oct 30 01:32:28.531443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:28.531443 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3d9f4d3f-10a9-4ae4-8fa6-29763e1e7045 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Returning 400 to user: Block Device 1a762580-ace9-4f9b-b9a4-42173233062d is not bootable. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:32:28.531443 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3d9f4d3f-10a9-4ae4-8fa6-29763e1e7045 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.110852 Oct 30 01:32:28.531443 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2103/4245] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:32:28 2022] POST /compute/v2.1/servers => generated 110 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 30 01:32:28.534281 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5958f644-490d-409d-a589-9feb02f2ca85 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:28.535085 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5958f644-490d-409d-a589-9feb02f2ca85 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:28.542914 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5958f644-490d-409d-a589-9feb02f2ca85 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:28.543668 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5958f644-490d-409d-a589-9feb02f2ca85 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:28.544786 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5958f644-490d-409d-a589-9feb02f2ca85 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:28.545682 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5958f644-490d-409d-a589-9feb02f2ca85 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:28.546276 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5958f644-490d-409d-a589-9feb02f2ca85 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:28.546899 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5958f644-490d-409d-a589-9feb02f2ca85 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:28.628914 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9f2d5b32-855c-4234-9c96-e5fc4e7ee65a tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ac5422c8f048148aac2c9b62e0482e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d179276dbf4e4d9cb780b18e7a22c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:28.638112 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9f2d5b32-855c-4234-9c96-e5fc4e7ee65a tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "GET /compute/v2.1/servers/9d85310b-581e-4748-b962-ab53210e15b5" status: 200 len: 1316 microversion: 2.1 time: 0.251194 Oct 30 01:32:28.642076 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2143/4246] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:28 2022] GET /compute/v2.1/servers/9d85310b-581e-4748-b962-ab53210e15b5 => generated 1316 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:28.650568 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-76291370-62f0-462a-9904-ee2efe69f92c tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:28.651627 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-76291370-62f0-462a-9904-ee2efe69f92c tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: b36a2df7-45c9-4a51-88f1-e1a1b9c0969d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:28.660394 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-76291370-62f0-462a-9904-ee2efe69f92c tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:28.661115 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-76291370-62f0-462a-9904-ee2efe69f92c tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:28.661803 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-76291370-62f0-462a-9904-ee2efe69f92c tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:28.662727 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-76291370-62f0-462a-9904-ee2efe69f92c tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:28.663346 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-76291370-62f0-462a-9904-ee2efe69f92c tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:28.663935 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-76291370-62f0-462a-9904-ee2efe69f92c tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:28.869670 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5958f644-490d-409d-a589-9feb02f2ca85 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:28.912518 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5958f644-490d-409d-a589-9feb02f2ca85 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.381914 Oct 30 01:32:28.914485 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2104/4247] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:28 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:32:28.927355 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6426a97b-46c2-42b1-a6a1-d03848ec36b7 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:28.930931 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6426a97b-46c2-42b1-a6a1-d03848ec36b7 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:28.949769 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6426a97b-46c2-42b1-a6a1-d03848ec36b7 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:28.950691 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6426a97b-46c2-42b1-a6a1-d03848ec36b7 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:28.956531 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6426a97b-46c2-42b1-a6a1-d03848ec36b7 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:28.956531 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6426a97b-46c2-42b1-a6a1-d03848ec36b7 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:28.956531 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6426a97b-46c2-42b1-a6a1-d03848ec36b7 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:28.956531 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6426a97b-46c2-42b1-a6a1-d03848ec36b7 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:28.973725 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:29.098220 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-76291370-62f0-462a-9904-ee2efe69f92c tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:29.125686 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-76291370-62f0-462a-9904-ee2efe69f92c tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers/b36a2df7-45c9-4a51-88f1-e1a1b9c0969d" status: 200 len: 1522 microversion: 2.1 time: 0.470064 Oct 30 01:32:29.126139 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2144/4248] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:28 2022] GET /compute/v2.1/servers/b36a2df7-45c9-4a51-88f1-e1a1b9c0969d => generated 1522 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:29.140678 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d0d80eb9-79e4-4169-804b-8a5ea3fa00c0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:29.141721 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d0d80eb9-79e4-4169-804b-8a5ea3fa00c0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:29.155744 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d0d80eb9-79e4-4169-804b-8a5ea3fa00c0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:29.156505 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d0d80eb9-79e4-4169-804b-8a5ea3fa00c0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:29.157147 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d0d80eb9-79e4-4169-804b-8a5ea3fa00c0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:29.158129 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d0d80eb9-79e4-4169-804b-8a5ea3fa00c0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:29.158812 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d0d80eb9-79e4-4169-804b-8a5ea3fa00c0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:29.159428 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d0d80eb9-79e4-4169-804b-8a5ea3fa00c0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:29.398295 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6426a97b-46c2-42b1-a6a1-d03848ec36b7 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:29.410365 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6426a97b-46c2-42b1-a6a1-d03848ec36b7 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e" status: 200 len: 1511 microversion: 2.1 time: 0.493096 Oct 30 01:32:29.410989 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2105/4249] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:28 2022] GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e => generated 1511 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:29.418083 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c130e066-7808-4025-ad50-a471247b9313 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:29.418858 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c130e066-7808-4025-ad50-a471247b9313 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:29.431322 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c130e066-7808-4025-ad50-a471247b9313 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:29.431322 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c130e066-7808-4025-ad50-a471247b9313 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:29.431592 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c130e066-7808-4025-ad50-a471247b9313 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:29.432199 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c130e066-7808-4025-ad50-a471247b9313 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:29.432660 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c130e066-7808-4025-ad50-a471247b9313 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:29.433082 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c130e066-7808-4025-ad50-a471247b9313 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:29.445615 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d0d80eb9-79e4-4169-804b-8a5ea3fa00c0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:29.455337 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:29.466024 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d0d80eb9-79e4-4169-804b-8a5ea3fa00c0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.331082 Oct 30 01:32:29.466840 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2145/4250] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:29 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:29.562414 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-c130e066-7808-4025-ad50-a471247b9313 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lazy-loading 'services' on Instance uuid 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:32:29.668093 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6c2382d0-bbc9-403c-a03e-9816861fa0a8 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:29.668777 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6c2382d0-bbc9-403c-a03e-9816861fa0a8 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] [instance: 9d85310b-581e-4748-b962-ab53210e15b5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:29.676511 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c2382d0-bbc9-403c-a03e-9816861fa0a8 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:29.678068 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c2382d0-bbc9-403c-a03e-9816861fa0a8 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:29.685482 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c2382d0-bbc9-403c-a03e-9816861fa0a8 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:29.686166 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c2382d0-bbc9-403c-a03e-9816861fa0a8 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:29.686629 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c2382d0-bbc9-403c-a03e-9816861fa0a8 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:29.688133 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c2382d0-bbc9-403c-a03e-9816861fa0a8 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:29.865744 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c130e066-7808-4025-ad50-a471247b9313 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0/os-volume_attachments/f877f8e1-3943-46b6-9fb6-ac5f4e95cf67" status: 202 len: 0 microversion: 2.1 time: 0.451266 Oct 30 01:32:29.904391 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2106/4251] 10.222.0.13 () {58 vars in 1416 bytes} [Sun Oct 30 01:32:29 2022] DELETE /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0/os-volume_attachments/f877f8e1-3943-46b6-9fb6-ac5f4e95cf67 => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:32:29.919453 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8f414868-f1e9-4902-a8b8-70e6b44f924d tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:29.925788 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8f414868-f1e9-4902-a8b8-70e6b44f924d tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:29.948413 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f414868-f1e9-4902-a8b8-70e6b44f924d tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:29.959620 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f414868-f1e9-4902-a8b8-70e6b44f924d tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:29.960197 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f414868-f1e9-4902-a8b8-70e6b44f924d tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:29.965196 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f414868-f1e9-4902-a8b8-70e6b44f924d tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:29.966614 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f414868-f1e9-4902-a8b8-70e6b44f924d tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:29.969542 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f414868-f1e9-4902-a8b8-70e6b44f924d tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:29.988698 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6c2382d0-bbc9-403c-a03e-9816861fa0a8 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ac5422c8f048148aac2c9b62e0482e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d179276dbf4e4d9cb780b18e7a22c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:29.996903 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6c2382d0-bbc9-403c-a03e-9816861fa0a8 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "GET /compute/v2.1/servers/9d85310b-581e-4748-b962-ab53210e15b5" status: 200 len: 1316 microversion: 2.1 time: 0.332642 Oct 30 01:32:29.999577 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2146/4252] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:29 2022] GET /compute/v2.1/servers/9d85310b-581e-4748-b962-ab53210e15b5 => generated 1316 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:32:30.035960 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8f414868-f1e9-4902-a8b8-70e6b44f924d tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123777 Oct 30 01:32:30.036939 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2107/4253] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 01:32:29 2022] GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:32:30.148098 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-525d284c-424c-4ddb-8aa3-f24955b85a54 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:30.149564 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-525d284c-424c-4ddb-8aa3-f24955b85a54 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: b36a2df7-45c9-4a51-88f1-e1a1b9c0969d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:30.188752 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-525d284c-424c-4ddb-8aa3-f24955b85a54 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:30.189256 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-525d284c-424c-4ddb-8aa3-f24955b85a54 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:30.189833 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-525d284c-424c-4ddb-8aa3-f24955b85a54 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:30.206380 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-525d284c-424c-4ddb-8aa3-f24955b85a54 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:30.206876 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-525d284c-424c-4ddb-8aa3-f24955b85a54 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:30.207322 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-525d284c-424c-4ddb-8aa3-f24955b85a54 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:30.435218 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2c52722c-1bb9-4607-a652-7a730eaedd40 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:30.435847 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2c52722c-1bb9-4607-a652-7a730eaedd40 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:30.446255 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-525d284c-424c-4ddb-8aa3-f24955b85a54 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:30.468561 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2c52722c-1bb9-4607-a652-7a730eaedd40 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:30.470633 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-525d284c-424c-4ddb-8aa3-f24955b85a54 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers/b36a2df7-45c9-4a51-88f1-e1a1b9c0969d" status: 200 len: 1522 microversion: 2.1 time: 0.328133 Oct 30 01:32:30.473162 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2c52722c-1bb9-4607-a652-7a730eaedd40 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:30.475346 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2c52722c-1bb9-4607-a652-7a730eaedd40 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:30.476198 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2c52722c-1bb9-4607-a652-7a730eaedd40 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:30.478862 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2c52722c-1bb9-4607-a652-7a730eaedd40 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:30.480199 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2c52722c-1bb9-4607-a652-7a730eaedd40 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:30.512231 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2147/4254] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:30 2022] GET /compute/v2.1/servers/b36a2df7-45c9-4a51-88f1-e1a1b9c0969d => generated 1522 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:30.902527 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2c52722c-1bb9-4607-a652-7a730eaedd40 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:30.916669 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2c52722c-1bb9-4607-a652-7a730eaedd40 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e" status: 200 len: 1511 microversion: 2.1 time: 0.486085 Oct 30 01:32:30.918640 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2108/4255] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:30 2022] GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e => generated 1511 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:31.022501 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6e146caa-e60e-4e9b-8b0e-25ddaea7f7f1 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:31.023296 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6e146caa-e60e-4e9b-8b0e-25ddaea7f7f1 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] [instance: 9d85310b-581e-4748-b962-ab53210e15b5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:31.039858 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e146caa-e60e-4e9b-8b0e-25ddaea7f7f1 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:31.041265 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e146caa-e60e-4e9b-8b0e-25ddaea7f7f1 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:31.048340 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ded78165-ec66-40d3-a9b7-cd58ff10b7d1 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:31.048474 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e146caa-e60e-4e9b-8b0e-25ddaea7f7f1 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:31.050340 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e146caa-e60e-4e9b-8b0e-25ddaea7f7f1 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:31.050340 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e146caa-e60e-4e9b-8b0e-25ddaea7f7f1 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:31.051001 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ded78165-ec66-40d3-a9b7-cd58ff10b7d1 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:31.054197 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e146caa-e60e-4e9b-8b0e-25ddaea7f7f1 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:31.058218 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ded78165-ec66-40d3-a9b7-cd58ff10b7d1 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:31.058717 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ded78165-ec66-40d3-a9b7-cd58ff10b7d1 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:31.060253 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ded78165-ec66-40d3-a9b7-cd58ff10b7d1 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:31.060986 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ded78165-ec66-40d3-a9b7-cd58ff10b7d1 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:31.061525 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ded78165-ec66-40d3-a9b7-cd58ff10b7d1 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:31.061950 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ded78165-ec66-40d3-a9b7-cd58ff10b7d1 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:31.143745 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ded78165-ec66-40d3-a9b7-cd58ff10b7d1 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097033 Oct 30 01:32:31.145666 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2109/4256] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 01:32:31 2022] GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:32:31.427212 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6e146caa-e60e-4e9b-8b0e-25ddaea7f7f1 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ac5422c8f048148aac2c9b62e0482e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d179276dbf4e4d9cb780b18e7a22c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:31.439445 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6e146caa-e60e-4e9b-8b0e-25ddaea7f7f1 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "GET /compute/v2.1/servers/9d85310b-581e-4748-b962-ab53210e15b5" status: 200 len: 1316 microversion: 2.1 time: 0.421510 Oct 30 01:32:31.459469 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2148/4257] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:31 2022] GET /compute/v2.1/servers/9d85310b-581e-4748-b962-ab53210e15b5 => generated 1316 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:31.520842 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0b9955e2-ed78-4ae7-b9ae-2660506c3377 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:31.521758 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0b9955e2-ed78-4ae7-b9ae-2660506c3377 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: b36a2df7-45c9-4a51-88f1-e1a1b9c0969d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:31.534312 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b9955e2-ed78-4ae7-b9ae-2660506c3377 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:31.535094 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b9955e2-ed78-4ae7-b9ae-2660506c3377 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:31.536581 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b9955e2-ed78-4ae7-b9ae-2660506c3377 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:31.539203 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b9955e2-ed78-4ae7-b9ae-2660506c3377 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:31.540337 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b9955e2-ed78-4ae7-b9ae-2660506c3377 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:31.541841 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b9955e2-ed78-4ae7-b9ae-2660506c3377 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:31.849086 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0b9955e2-ed78-4ae7-b9ae-2660506c3377 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:31.863265 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0b9955e2-ed78-4ae7-b9ae-2660506c3377 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers/b36a2df7-45c9-4a51-88f1-e1a1b9c0969d" status: 200 len: 1522 microversion: 2.1 time: 0.347366 Oct 30 01:32:31.864463 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2110/4258] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:31 2022] GET /compute/v2.1/servers/b36a2df7-45c9-4a51-88f1-e1a1b9c0969d => generated 1522 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:31.942184 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-dfd50896-9bdd-47cc-900d-108a6ece86c6 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:31.943247 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-dfd50896-9bdd-47cc-900d-108a6ece86c6 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:31.952308 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dfd50896-9bdd-47cc-900d-108a6ece86c6 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:31.957282 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dfd50896-9bdd-47cc-900d-108a6ece86c6 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:31.960082 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dfd50896-9bdd-47cc-900d-108a6ece86c6 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:31.961300 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dfd50896-9bdd-47cc-900d-108a6ece86c6 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:31.962055 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dfd50896-9bdd-47cc-900d-108a6ece86c6 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:31.963702 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dfd50896-9bdd-47cc-900d-108a6ece86c6 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:32.157502 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7a255434-9a70-4c68-852e-3161c146fc84 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:32.159899 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7a255434-9a70-4c68-852e-3161c146fc84 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:32.172511 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7a255434-9a70-4c68-852e-3161c146fc84 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:32.174737 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7a255434-9a70-4c68-852e-3161c146fc84 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:32.175185 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7a255434-9a70-4c68-852e-3161c146fc84 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:32.177010 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7a255434-9a70-4c68-852e-3161c146fc84 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:32.177997 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7a255434-9a70-4c68-852e-3161c146fc84 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:32.180796 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7a255434-9a70-4c68-852e-3161c146fc84 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:32.229412 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7a255434-9a70-4c68-852e-3161c146fc84 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075868 Oct 30 01:32:32.235379 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2111/4259] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 01:32:32 2022] GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:32:32.240960 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-268e59b5-f139-43a7-aab4-b78ac62591a9 req-0abf127c-9c0e-41f7-8439-6d3cb25a07bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d85310b-581e-4748-b962-ab53210e15b5", "name": "network-vif-plugged", "status": "completed", "tag": "f8b486d2-42f6-477d-98fa-03d17214f6f4"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:32:32.253781 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-268e59b5-f139-43a7-aab4-b78ac62591a9 req-0abf127c-9c0e-41f7-8439-6d3cb25a07bb service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:32.254407 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-268e59b5-f139-43a7-aab4-b78ac62591a9 req-0abf127c-9c0e-41f7-8439-6d3cb25a07bb service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:32.255015 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-268e59b5-f139-43a7-aab4-b78ac62591a9 req-0abf127c-9c0e-41f7-8439-6d3cb25a07bb service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:32.267646 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-268e59b5-f139-43a7-aab4-b78ac62591a9 req-0abf127c-9c0e-41f7-8439-6d3cb25a07bb service nova] Creating event network-vif-plugged:f8b486d2-42f6-477d-98fa-03d17214f6f4 for instance 9d85310b-581e-4748-b962-ab53210e15b5 on n-h1-master-1 Oct 30 01:32:32.273152 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-268e59b5-f139-43a7-aab4-b78ac62591a9 req-0abf127c-9c0e-41f7-8439-6d3cb25a07bb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036169 Oct 30 01:32:32.274475 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2112/4260] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:32:32.469368 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d5a75bab-10ed-45b4-aae4-29192a605b50 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:32.471049 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d5a75bab-10ed-45b4-aae4-29192a605b50 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] [instance: 9d85310b-581e-4748-b962-ab53210e15b5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:32.480562 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d5a75bab-10ed-45b4-aae4-29192a605b50 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:32.483144 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d5a75bab-10ed-45b4-aae4-29192a605b50 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:32.483791 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d5a75bab-10ed-45b4-aae4-29192a605b50 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:32.485688 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d5a75bab-10ed-45b4-aae4-29192a605b50 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:32.486451 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d5a75bab-10ed-45b4-aae4-29192a605b50 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:32.487064 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d5a75bab-10ed-45b4-aae4-29192a605b50 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:32.615121 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-dfd50896-9bdd-47cc-900d-108a6ece86c6 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:32.624512 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-dfd50896-9bdd-47cc-900d-108a6ece86c6 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e" status: 200 len: 1511 microversion: 2.1 time: 0.686559 Oct 30 01:32:32.625103 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2149/4261] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:31 2022] GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e => generated 1511 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:32.631106 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f96fc88a-fefb-4d6f-8fa0-18ab989dd49a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1858786746", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "deb14158-45d8-4539-889d-ff9726d046d7", "destination_type": "local"}, {"source_type": "volume", "uuid": "43c3e308-ee0e-48e1-a2bc-a64538c6646e", "destination_type": "invalid"}], "networks": [{"uuid": "2bdbb622-9eb5-4b19-93d6-10bf71c70ecc"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:32:32.636944 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f96fc88a-fefb-4d6f-8fa0-18ab989dd49a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Request method failure captured: Oct 30 01:32:32.636944 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 30 01:32:32.636944 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:32:32.636944 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:32:32.636944 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:32:32.636944 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 495 Oct 30 01:32:32.636944 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:32:32.636944 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:32:32.636944 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:32:32.636944 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:32:32.636944 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdPsZZXjRvWKe2zWP-5VH1VYAsWsLLjUmpyob2uINkfAXNLt0qGMmCTWjYn2WpZ3XOOdsuaM4lwk-qZrOIX3mOHzuCJPZ3r-9M-w153XBWLoTow-eSMj1bsAWDNo3KKhMzjHqic8AJ-DcXpdsBh93g0dRB_UMWMRrGyY1cbSRdHJrvg Oct 30 01:32:32.636944 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:32:32.636944 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:32:32.636944 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:32:32.636944 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:32:32.636944 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:32:32.636944 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:32:32.636944 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:32:32.636944 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:32:32.636944 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:32:32.636944 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:32:32.636944 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:32:32.636944 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:32:32.636944 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:32:32.636944 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:32:32.636944 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:32:32.636944 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:32:32.636944 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:32:32.636944 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 0bce487302c24def8a8473b0725904f2 Oct 30 01:32:32.636944 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:32:32.636944 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:32:32.636944 n-d-master-1 devstack@n-api.service[121102]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1858786746", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "deb14158-45d8-4539-889d-ff9726d046d7", "destination_type": "local"}, {"source_type": "volume", "uuid": "43c3e308-ee0e-48e1-a2bc-a64538c6646e", "destination_type": "invalid"}], "networks": [{"uuid": "2bdbb622-9eb5-4b19-93d6-10bf71c70ecc"}]}} Oct 30 01:32:32.636944 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:32:32.636944 n-d-master-1 devstack@n-api.service[121102]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 30 01:32:32.636944 n-d-master-1 devstack@n-api.service[121102]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1858786746', 'imageRef': 'deb14158-45d8-4539-889d-ff9726d046d7', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'deb14158-45d8-4539-889d-ff9726d046d7', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '43c3e308-ee0e-48e1-a2bc-a64538c6646e', 'destination_type': 'invalid'}], 'networks': [{'uuid': '2bdbb622-9eb5-4b19-93d6-10bf71c70ecc'}]}}} Oct 30 01:32:32.636944 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:32:32.636944 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:32.636944 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 30 01:32:32.636944 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 30 01:32:32.636944 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 30 01:32:32.636944 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise error Oct 30 01:32:32.636944 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 30 01:32:32.636944 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:32.636944 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 30 01:32:32.636944 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 30 01:32:32.636944 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:32.636944 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 30 01:32:32.636944 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi 'invalid' Oct 30 01:32:32.636944 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:32.636944 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:32.636944 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:32.636944 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:32.636944 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:32:32.636944 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:32:32.636944 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:32:32.636944 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:32:32.636944 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:32:32.636944 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:32:32.640921 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:32:32.640921 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:32:32.640921 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 30 01:32:32.640921 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 30 01:32:32.640921 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 30 01:32:32.640921 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 30 01:32:32.640921 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 30 01:32:32.640921 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 30 01:32:32.640921 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 30 01:32:32.640921 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:32.640921 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:32.640921 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:32.640921 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:32.640921 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:32:32.640921 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:32:32.640921 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 30 01:32:32.640921 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 30 01:32:32.640921 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 30 01:32:32.640921 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:32.643152 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f96fc88a-fefb-4d6f-8fa0-18ab989dd49a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:32:32.645147 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f96fc88a-fefb-4d6f-8fa0-18ab989dd49a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.018880 Oct 30 01:32:32.645772 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2150/4262] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:32:32 2022] POST /compute/v2.1/servers => generated 155 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:32:32.655543 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0662a527-b8cb-4aeb-ac3e-a5882f25b45d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:32.656400 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0662a527-b8cb-4aeb-ac3e-a5882f25b45d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:32.664965 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0662a527-b8cb-4aeb-ac3e-a5882f25b45d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:32.665514 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0662a527-b8cb-4aeb-ac3e-a5882f25b45d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:32.666122 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0662a527-b8cb-4aeb-ac3e-a5882f25b45d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:32.666991 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0662a527-b8cb-4aeb-ac3e-a5882f25b45d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:32.667624 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0662a527-b8cb-4aeb-ac3e-a5882f25b45d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:32.668234 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0662a527-b8cb-4aeb-ac3e-a5882f25b45d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:32.801753 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d5a75bab-10ed-45b4-aae4-29192a605b50 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ac5422c8f048148aac2c9b62e0482e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d179276dbf4e4d9cb780b18e7a22c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:32.816076 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d5a75bab-10ed-45b4-aae4-29192a605b50 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "GET /compute/v2.1/servers/9d85310b-581e-4748-b962-ab53210e15b5" status: 200 len: 1316 microversion: 2.1 time: 0.355319 Oct 30 01:32:32.817195 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2113/4263] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:32 2022] GET /compute/v2.1/servers/9d85310b-581e-4748-b962-ab53210e15b5 => generated 1316 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:32.892067 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f6fa433a-0a13-4446-8905-713c83edb7f1 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:32.892756 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f6fa433a-0a13-4446-8905-713c83edb7f1 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: b36a2df7-45c9-4a51-88f1-e1a1b9c0969d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:32.900961 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f6fa433a-0a13-4446-8905-713c83edb7f1 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:32.901544 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f6fa433a-0a13-4446-8905-713c83edb7f1 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:32.902129 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f6fa433a-0a13-4446-8905-713c83edb7f1 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:32.903876 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f6fa433a-0a13-4446-8905-713c83edb7f1 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:32.904478 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f6fa433a-0a13-4446-8905-713c83edb7f1 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:32.905046 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f6fa433a-0a13-4446-8905-713c83edb7f1 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:32.981408 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0662a527-b8cb-4aeb-ac3e-a5882f25b45d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:32.990990 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0662a527-b8cb-4aeb-ac3e-a5882f25b45d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.340308 Oct 30 01:32:32.991629 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2151/4264] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:32 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:32:33.021424 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-42c51289-f2a5-4c14-ab89-cbc4e18901aa tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:33.022373 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-42c51289-f2a5-4c14-ab89-cbc4e18901aa tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:33.035543 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-42c51289-f2a5-4c14-ab89-cbc4e18901aa tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:33.036505 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-42c51289-f2a5-4c14-ab89-cbc4e18901aa tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:33.037287 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-42c51289-f2a5-4c14-ab89-cbc4e18901aa tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:33.038387 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-42c51289-f2a5-4c14-ab89-cbc4e18901aa tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:33.039119 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-42c51289-f2a5-4c14-ab89-cbc4e18901aa tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:33.039556 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-42c51289-f2a5-4c14-ab89-cbc4e18901aa tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:33.178618 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f6fa433a-0a13-4446-8905-713c83edb7f1 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:33.187768 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f6fa433a-0a13-4446-8905-713c83edb7f1 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers/b36a2df7-45c9-4a51-88f1-e1a1b9c0969d" status: 200 len: 1522 microversion: 2.1 time: 0.301494 Oct 30 01:32:33.188493 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2114/4265] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:32 2022] GET /compute/v2.1/servers/b36a2df7-45c9-4a51-88f1-e1a1b9c0969d => generated 1522 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:33.229440 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-42c51289-f2a5-4c14-ab89-cbc4e18901aa tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:33.240441 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-42c51289-f2a5-4c14-ab89-cbc4e18901aa tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.228042 Oct 30 01:32:33.241158 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2152/4266] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:33 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:33.243330 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3d66e9b0-5f33-4adc-b97d-65267a93751e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:33.245772 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3d66e9b0-5f33-4adc-b97d-65267a93751e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:33.252296 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3d66e9b0-5f33-4adc-b97d-65267a93751e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:33.252798 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3d66e9b0-5f33-4adc-b97d-65267a93751e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:33.253237 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3d66e9b0-5f33-4adc-b97d-65267a93751e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:33.253981 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3d66e9b0-5f33-4adc-b97d-65267a93751e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:33.254484 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3d66e9b0-5f33-4adc-b97d-65267a93751e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:33.255475 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3d66e9b0-5f33-4adc-b97d-65267a93751e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:33.323820 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3d66e9b0-5f33-4adc-b97d-65267a93751e tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084980 Oct 30 01:32:33.325691 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2115/4267] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 01:32:33 2022] GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:32:33.427483 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8b92dba0-5c1c-4049-b189-b7be38601d1e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-430467131", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "2bdbb622-9eb5-4b19-93d6-10bf71c70ecc"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:32:33.438578 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8b92dba0-5c1c-4049-b189-b7be38601d1e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Request method failure captured: Oct 30 01:32:33.438578 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 30 01:32:33.438578 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:32:33.438578 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:32:33.438578 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:32:33.438578 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 491 Oct 30 01:32:33.438578 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:32:33.438578 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:32:33.438578 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:32:33.438578 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:32:33.438578 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdPsZZXjRvWKe2zWP-5VH1VYAsWsLLjUmpyob2uINkfAXNLt0qGMmCTWjYn2WpZ3XOOdsuaM4lwk-qZrOIX3mOHzuCJPZ3r-9M-w153XBWLoTow-eSMj1bsAWDNo3KKhMzjHqic8AJ-DcXpdsBh93g0dRB_UMWMRrGyY1cbSRdHJrvg Oct 30 01:32:33.438578 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:32:33.438578 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:32:33.438578 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:32:33.438578 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:32:33.438578 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:32:33.438578 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:32:33.438578 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:32:33.438578 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:32:33.438578 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:32:33.438578 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:32:33.438578 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:32:33.438578 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:32:33.438578 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:32:33.438578 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:32:33.438578 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:32:33.438578 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:32:33.438578 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:32:33.438578 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 0bce487302c24def8a8473b0725904f2 Oct 30 01:32:33.438578 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:32:33.438578 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:32:33.438578 n-d-master-1 devstack@n-api.service[121102]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-430467131", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "2bdbb622-9eb5-4b19-93d6-10bf71c70ecc"}]}} Oct 30 01:32:33.438578 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:32:33.438578 n-d-master-1 devstack@n-api.service[121102]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 30 01:32:33.438578 n-d-master-1 devstack@n-api.service[121102]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-430467131', 'imageRef': 'deb14158-45d8-4539-889d-ff9726d046d7', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '2bdbb622-9eb5-4b19-93d6-10bf71c70ecc'}]}}} Oct 30 01:32:33.438578 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:32:33.438578 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:33.438578 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 30 01:32:33.438578 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 30 01:32:33.438578 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 30 01:32:33.438578 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise error Oct 30 01:32:33.438578 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 30 01:32:33.438578 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:33.438578 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 30 01:32:33.438578 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 30 01:32:33.438578 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:33.438578 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 30 01:32:33.441833 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 30 01:32:33.441833 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:33.441833 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:33.441833 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:33.441833 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:33.441833 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:32:33.441833 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:32:33.441833 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:32:33.441833 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:32:33.441833 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:32:33.441833 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:32:33.441833 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:32:33.441833 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:32:33.441833 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 30 01:32:33.441833 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 30 01:32:33.441833 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 30 01:32:33.441833 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 30 01:32:33.441833 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 30 01:32:33.441833 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 30 01:32:33.441833 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 30 01:32:33.441833 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:33.441833 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:33.441833 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:33.441833 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:33.441833 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:32:33.441833 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:32:33.441833 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 30 01:32:33.441833 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 30 01:32:33.441833 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 30 01:32:33.441833 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:33.445925 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8b92dba0-5c1c-4049-b189-b7be38601d1e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:32:33.448461 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8b92dba0-5c1c-4049-b189-b7be38601d1e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.025696 Oct 30 01:32:33.451852 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2153/4268] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:32:33 2022] POST /compute/v2.1/servers => generated 624 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:32:33.467581 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6b811ec7-086b-491f-a097-4ac5604aca71 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:33.468546 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6b811ec7-086b-491f-a097-4ac5604aca71 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:33.475088 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6b811ec7-086b-491f-a097-4ac5604aca71 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:33.476052 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6b811ec7-086b-491f-a097-4ac5604aca71 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:33.476866 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6b811ec7-086b-491f-a097-4ac5604aca71 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:33.477813 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6b811ec7-086b-491f-a097-4ac5604aca71 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:33.478500 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6b811ec7-086b-491f-a097-4ac5604aca71 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:33.479255 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6b811ec7-086b-491f-a097-4ac5604aca71 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:33.647431 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8d56493d-0b86-4702-ae6c-65bd7ed2f97a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:33.648609 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8d56493d-0b86-4702-ae6c-65bd7ed2f97a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:33.657271 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d56493d-0b86-4702-ae6c-65bd7ed2f97a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:33.658018 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d56493d-0b86-4702-ae6c-65bd7ed2f97a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:33.658602 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d56493d-0b86-4702-ae6c-65bd7ed2f97a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:33.659460 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d56493d-0b86-4702-ae6c-65bd7ed2f97a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:33.660052 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d56493d-0b86-4702-ae6c-65bd7ed2f97a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:33.661896 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d56493d-0b86-4702-ae6c-65bd7ed2f97a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:33.687266 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6b811ec7-086b-491f-a097-4ac5604aca71 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:33.695515 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6b811ec7-086b-491f-a097-4ac5604aca71 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.233091 Oct 30 01:32:33.702143 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2116/4269] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:33 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:33.728943 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9b541d8a-acc6-4e5b-bee1-fc97f0464413 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:33.730001 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9b541d8a-acc6-4e5b-bee1-fc97f0464413 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:33.753383 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9b541d8a-acc6-4e5b-bee1-fc97f0464413 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:33.753888 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9b541d8a-acc6-4e5b-bee1-fc97f0464413 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:33.754338 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9b541d8a-acc6-4e5b-bee1-fc97f0464413 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:33.755324 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9b541d8a-acc6-4e5b-bee1-fc97f0464413 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:33.760259 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9b541d8a-acc6-4e5b-bee1-fc97f0464413 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:33.760769 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9b541d8a-acc6-4e5b-bee1-fc97f0464413 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:33.860027 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=5 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:34.021774 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8d56493d-0b86-4702-ae6c-65bd7ed2f97a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:34.039470 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8d56493d-0b86-4702-ae6c-65bd7ed2f97a tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e" status: 200 len: 1511 microversion: 2.1 time: 0.393131 Oct 30 01:32:34.040369 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2154/4270] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:33 2022] GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e => generated 1511 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:34.068109 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ae7a8a4d-28e4-4253-9431-21136372e5cf tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:34.068109 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ae7a8a4d-28e4-4253-9431-21136372e5cf tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] [instance: 9d85310b-581e-4748-b962-ab53210e15b5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:34.070905 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae7a8a4d-28e4-4253-9431-21136372e5cf tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:34.071398 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae7a8a4d-28e4-4253-9431-21136372e5cf tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:34.071880 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae7a8a4d-28e4-4253-9431-21136372e5cf tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:34.072584 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae7a8a4d-28e4-4253-9431-21136372e5cf tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:34.073452 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae7a8a4d-28e4-4253-9431-21136372e5cf tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:34.073887 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae7a8a4d-28e4-4253-9431-21136372e5cf tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:34.103621 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9b541d8a-acc6-4e5b-bee1-fc97f0464413 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:34.114386 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9b541d8a-acc6-4e5b-bee1-fc97f0464413 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.389205 Oct 30 01:32:34.133952 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2117/4271] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:33 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:34.213605 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ebfd8604-605b-4fdf-b38f-42eda3da6e59 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:34.217099 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ebfd8604-605b-4fdf-b38f-42eda3da6e59 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: b36a2df7-45c9-4a51-88f1-e1a1b9c0969d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:34.227851 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ebfd8604-605b-4fdf-b38f-42eda3da6e59 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:34.229901 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ebfd8604-605b-4fdf-b38f-42eda3da6e59 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:34.230540 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ebfd8604-605b-4fdf-b38f-42eda3da6e59 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:34.233253 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ebfd8604-605b-4fdf-b38f-42eda3da6e59 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:34.233993 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ebfd8604-605b-4fdf-b38f-42eda3da6e59 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:34.235092 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ebfd8604-605b-4fdf-b38f-42eda3da6e59 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:34.428107 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ae7a8a4d-28e4-4253-9431-21136372e5cf tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ac5422c8f048148aac2c9b62e0482e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d179276dbf4e4d9cb780b18e7a22c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:34.436334 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ae7a8a4d-28e4-4253-9431-21136372e5cf tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "GET /compute/v2.1/servers/9d85310b-581e-4748-b962-ab53210e15b5" status: 200 len: 1316 microversion: 2.1 time: 0.377445 Oct 30 01:32:34.436978 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2155/4272] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:34 2022] GET /compute/v2.1/servers/9d85310b-581e-4748-b962-ab53210e15b5 => generated 1316 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:34.442050 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-70b77211-c554-456b-adf6-1ca1506de73d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "2bdbb622-9eb5-4b19-93d6-10bf71c70ecc"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:32:34.447517 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-70b77211-c554-456b-adf6-1ca1506de73d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Request method failure captured: Oct 30 01:32:34.447517 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 30 01:32:34.447517 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:32:34.447517 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:32:34.447517 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:32:34.447517 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 416 Oct 30 01:32:34.447517 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:32:34.447517 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:32:34.447517 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:32:34.447517 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:32:34.447517 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdPsZZXjRvWKe2zWP-5VH1VYAsWsLLjUmpyob2uINkfAXNLt0qGMmCTWjYn2WpZ3XOOdsuaM4lwk-qZrOIX3mOHzuCJPZ3r-9M-w153XBWLoTow-eSMj1bsAWDNo3KKhMzjHqic8AJ-DcXpdsBh93g0dRB_UMWMRrGyY1cbSRdHJrvg Oct 30 01:32:34.447517 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:32:34.447517 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:32:34.447517 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:32:34.447517 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:32:34.447517 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:32:34.447517 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:32:34.447517 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:32:34.447517 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:32:34.447517 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:32:34.447517 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:32:34.447517 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:32:34.447517 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:32:34.447517 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:32:34.447517 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:32:34.447517 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:32:34.447517 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:32:34.447517 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:32:34.447517 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 0bce487302c24def8a8473b0725904f2 Oct 30 01:32:34.447517 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:32:34.447517 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:32:34.447517 n-d-master-1 devstack@n-api.service[121102]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "2bdbb622-9eb5-4b19-93d6-10bf71c70ecc"}]}} Oct 30 01:32:34.447517 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:32:34.447517 n-d-master-1 devstack@n-api.service[121102]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 30 01:32:34.447517 n-d-master-1 devstack@n-api.service[121102]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'deb14158-45d8-4539-889d-ff9726d046d7', 'flavorRef': '452', 'networks': [{'uuid': '2bdbb622-9eb5-4b19-93d6-10bf71c70ecc'}]}}} Oct 30 01:32:34.447517 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:32:34.447517 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:34.447517 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 30 01:32:34.447517 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 30 01:32:34.447517 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 30 01:32:34.447517 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise error Oct 30 01:32:34.447517 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 30 01:32:34.447517 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:34.447517 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 30 01:32:34.447517 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 30 01:32:34.447517 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:34.447517 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 30 01:32:34.447517 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 30 01:32:34.447517 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:34.447517 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:34.451541 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:34.451541 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:34.451541 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:32:34.451541 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:32:34.451541 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:32:34.451541 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:32:34.451541 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:32:34.451541 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:32:34.451541 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:32:34.451541 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:32:34.451541 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 30 01:32:34.451541 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 30 01:32:34.451541 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 30 01:32:34.451541 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 30 01:32:34.451541 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 30 01:32:34.451541 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 30 01:32:34.451541 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 30 01:32:34.451541 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:34.451541 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:34.451541 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:34.451541 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:34.451541 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:32:34.451541 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:32:34.451541 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 30 01:32:34.451541 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 30 01:32:34.451541 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 30 01:32:34.451541 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:34.451541 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-70b77211-c554-456b-adf6-1ca1506de73d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:32:34.451541 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-70b77211-c554-456b-adf6-1ca1506de73d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.012527 Oct 30 01:32:34.454476 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2156/4273] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:32:34 2022] POST /compute/v2.1/servers => generated 619 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:32:34.479454 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-afa33d98-82cf-4c01-8ce4-011012e5ea2d tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:34.484209 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-afa33d98-82cf-4c01-8ce4-011012e5ea2d tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:34.525801 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-afa33d98-82cf-4c01-8ce4-011012e5ea2d tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:34.526585 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-afa33d98-82cf-4c01-8ce4-011012e5ea2d tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:34.527143 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-afa33d98-82cf-4c01-8ce4-011012e5ea2d tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:34.528597 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-afa33d98-82cf-4c01-8ce4-011012e5ea2d tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:34.530595 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-afa33d98-82cf-4c01-8ce4-011012e5ea2d tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:34.534027 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-afa33d98-82cf-4c01-8ce4-011012e5ea2d tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:34.592278 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-afa33d98-82cf-4c01-8ce4-011012e5ea2d tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120837 Oct 30 01:32:34.596792 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2157/4274] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 01:32:34 2022] GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:32:34.602226 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f08ae5a6-41a5-4e09-91f3-3ad8f0e4424c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:34.602853 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f08ae5a6-41a5-4e09-91f3-3ad8f0e4424c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:34.617057 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f08ae5a6-41a5-4e09-91f3-3ad8f0e4424c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:34.618203 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f08ae5a6-41a5-4e09-91f3-3ad8f0e4424c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:34.618203 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f08ae5a6-41a5-4e09-91f3-3ad8f0e4424c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:34.618716 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f08ae5a6-41a5-4e09-91f3-3ad8f0e4424c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:34.619176 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f08ae5a6-41a5-4e09-91f3-3ad8f0e4424c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:34.619601 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f08ae5a6-41a5-4e09-91f3-3ad8f0e4424c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:34.976154 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ebfd8604-605b-4fdf-b38f-42eda3da6e59 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:34.991349 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ebfd8604-605b-4fdf-b38f-42eda3da6e59 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers/b36a2df7-45c9-4a51-88f1-e1a1b9c0969d" status: 200 len: 1522 microversion: 2.1 time: 0.782800 Oct 30 01:32:34.992666 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2118/4275] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:34 2022] GET /compute/v2.1/servers/b36a2df7-45c9-4a51-88f1-e1a1b9c0969d => generated 1522 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:35.067797 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-02d50bfa-6664-41d6-8b01-0342daab6372 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:35.068743 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-02d50bfa-6664-41d6-8b01-0342daab6372 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:35.086245 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-02d50bfa-6664-41d6-8b01-0342daab6372 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:35.087228 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-02d50bfa-6664-41d6-8b01-0342daab6372 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:35.087893 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-02d50bfa-6664-41d6-8b01-0342daab6372 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:35.088830 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-02d50bfa-6664-41d6-8b01-0342daab6372 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:35.089523 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-02d50bfa-6664-41d6-8b01-0342daab6372 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:35.090350 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-02d50bfa-6664-41d6-8b01-0342daab6372 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:35.224466 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f08ae5a6-41a5-4e09-91f3-3ad8f0e4424c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:35.241954 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f08ae5a6-41a5-4e09-91f3-3ad8f0e4424c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.640929 Oct 30 01:32:35.243989 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2158/4276] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:34 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:35.271911 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-79b0c6bc-68a2-4d0a-baf0-7ccf42a6ef5a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:35.272718 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-79b0c6bc-68a2-4d0a-baf0-7ccf42a6ef5a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:35.278933 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=6 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:35.280891 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-79b0c6bc-68a2-4d0a-baf0-7ccf42a6ef5a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:35.281734 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-79b0c6bc-68a2-4d0a-baf0-7ccf42a6ef5a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:35.282362 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-79b0c6bc-68a2-4d0a-baf0-7ccf42a6ef5a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:35.283485 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-79b0c6bc-68a2-4d0a-baf0-7ccf42a6ef5a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:35.284079 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-79b0c6bc-68a2-4d0a-baf0-7ccf42a6ef5a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:35.284799 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-79b0c6bc-68a2-4d0a-baf0-7ccf42a6ef5a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:35.525161 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-02d50bfa-6664-41d6-8b01-0342daab6372 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:35.535944 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-02d50bfa-6664-41d6-8b01-0342daab6372 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e" status: 200 len: 1511 microversion: 2.1 time: 0.472383 Oct 30 01:32:35.544189 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2119/4277] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:35 2022] GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e => generated 1511 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:35.559078 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-60baa8e4-1375-446d-9971-b6b9161760a0 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:35.560485 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-60baa8e4-1375-446d-9971-b6b9161760a0 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] [instance: 9d85310b-581e-4748-b962-ab53210e15b5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:35.569057 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-60baa8e4-1375-446d-9971-b6b9161760a0 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:35.569737 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-60baa8e4-1375-446d-9971-b6b9161760a0 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:35.572716 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-60baa8e4-1375-446d-9971-b6b9161760a0 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:35.573706 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-60baa8e4-1375-446d-9971-b6b9161760a0 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:35.574323 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-60baa8e4-1375-446d-9971-b6b9161760a0 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:35.574792 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-60baa8e4-1375-446d-9971-b6b9161760a0 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:35.690585 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=8 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:35.760179 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-79b0c6bc-68a2-4d0a-baf0-7ccf42a6ef5a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:35.768371 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-79b0c6bc-68a2-4d0a-baf0-7ccf42a6ef5a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.501414 Oct 30 01:32:35.769205 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2159/4278] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:35 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:32:35.774071 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d5422ec8-09ab-49a1-9383-b9f350ebfc8f tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:35.776374 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d5422ec8-09ab-49a1-9383-b9f350ebfc8f tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:35.783087 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5422ec8-09ab-49a1-9383-b9f350ebfc8f tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:35.783850 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5422ec8-09ab-49a1-9383-b9f350ebfc8f tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:35.784496 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5422ec8-09ab-49a1-9383-b9f350ebfc8f tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:35.785430 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5422ec8-09ab-49a1-9383-b9f350ebfc8f tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:35.786080 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5422ec8-09ab-49a1-9383-b9f350ebfc8f tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:35.786723 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5422ec8-09ab-49a1-9383-b9f350ebfc8f tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:35.821269 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d5422ec8-09ab-49a1-9383-b9f350ebfc8f tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050680 Oct 30 01:32:35.827620 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2160/4279] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 01:32:35 2022] GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:32:35.921553 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-83d59d81-83b4-41f2-b19b-410e503453d5 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1931125175", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": -1, "networks": [{"uuid": "2bdbb622-9eb5-4b19-93d6-10bf71c70ecc"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:32:35.934599 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-83d59d81-83b4-41f2-b19b-410e503453d5 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] HTTP exception thrown: Flavor -1 could not be found. Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-83d59d81-83b4-41f2-b19b-410e503453d5 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Request method failure captured: Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 206 Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdPsZZXjRvWKe2zWP-5VH1VYAsWsLLjUmpyob2uINkfAXNLt0qGMmCTWjYn2WpZ3XOOdsuaM4lwk-qZrOIX3mOHzuCJPZ3r-9M-w153XBWLoTow-eSMj1bsAWDNo3KKhMzjHqic8AJ-DcXpdsBh93g0dRB_UMWMRrGyY1cbSRdHJrvg Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 0bce487302c24def8a8473b0725904f2 Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1931125175", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": -1, "networks": [{"uuid": "2bdbb622-9eb5-4b19-93d6-10bf71c70ecc"}]}} Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: exception: Flavor -1 could not be found. Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1931125175', 'imageRef': 'deb14158-45d8-4539-889d-ff9726d046d7', 'flavorRef': -1, 'networks': [{'uuid': '2bdbb622-9eb5-4b19-93d6-10bf71c70ecc'}]}}} Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:32:35.936729 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:32:35.941062 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:32:35.941062 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:32:35.941062 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:32:35.941062 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:32:35.941062 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 30 01:32:35.941062 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 30 01:32:35.941062 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 30 01:32:35.941062 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 30 01:32:35.941062 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:35.941062 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:35.941062 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:35.941062 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:35.941062 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:32:35.941062 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:32:35.941062 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:32:35.941062 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:32:35.941062 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 30 01:32:35.941062 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:35.941062 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-83d59d81-83b4-41f2-b19b-410e503453d5 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:32:35.941062 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-83d59d81-83b4-41f2-b19b-410e503453d5 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.022357 Oct 30 01:32:35.941062 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2161/4280] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:32:35 2022] POST /compute/v2.1/servers => generated 73 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 30 01:32:35.948747 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5a900a12-1a81-4aa7-bab6-ca3831af04b6 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:35.951981 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5a900a12-1a81-4aa7-bab6-ca3831af04b6 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:35.959023 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a900a12-1a81-4aa7-bab6-ca3831af04b6 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:35.959696 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a900a12-1a81-4aa7-bab6-ca3831af04b6 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:35.962769 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a900a12-1a81-4aa7-bab6-ca3831af04b6 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:35.962769 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a900a12-1a81-4aa7-bab6-ca3831af04b6 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:35.962769 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a900a12-1a81-4aa7-bab6-ca3831af04b6 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:35.962769 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a900a12-1a81-4aa7-bab6-ca3831af04b6 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:36.029045 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-60baa8e4-1375-446d-9971-b6b9161760a0 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ac5422c8f048148aac2c9b62e0482e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d179276dbf4e4d9cb780b18e7a22c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:36.052795 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-60baa8e4-1375-446d-9971-b6b9161760a0 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "GET /compute/v2.1/servers/9d85310b-581e-4748-b962-ab53210e15b5" status: 200 len: 1504 microversion: 2.1 time: 0.513608 Oct 30 01:32:36.054324 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2120/4281] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:35 2022] GET /compute/v2.1/servers/9d85310b-581e-4748-b962-ab53210e15b5 => generated 1504 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:36.073197 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-90abdf51-741b-478f-a93d-1d16ddee3e3a tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:36.077654 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-90abdf51-741b-478f-a93d-1d16ddee3e3a tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: b36a2df7-45c9-4a51-88f1-e1a1b9c0969d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:36.127259 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-90abdf51-741b-478f-a93d-1d16ddee3e3a tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:36.127905 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-90abdf51-741b-478f-a93d-1d16ddee3e3a tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:36.128356 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-90abdf51-741b-478f-a93d-1d16ddee3e3a tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:36.131623 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-90abdf51-741b-478f-a93d-1d16ddee3e3a tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:36.132142 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-90abdf51-741b-478f-a93d-1d16ddee3e3a tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:36.132583 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-90abdf51-741b-478f-a93d-1d16ddee3e3a tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:36.165941 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5a900a12-1a81-4aa7-bab6-ca3831af04b6 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:36.181913 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5a900a12-1a81-4aa7-bab6-ca3831af04b6 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.238088 Oct 30 01:32:36.185087 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2162/4282] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:35 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:32:36.190069 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cd579af8-35c9-4c5e-af68-97ceb93c8f50 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-106222850"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:32:36.190610 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cd579af8-35c9-4c5e-af68-97ceb93c8f50 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] [instance: 9d85310b-581e-4748-b962-ab53210e15b5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:36.199354 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cd579af8-35c9-4c5e-af68-97ceb93c8f50 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:36.202851 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cd579af8-35c9-4c5e-af68-97ceb93c8f50 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:36.202851 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cd579af8-35c9-4c5e-af68-97ceb93c8f50 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:36.202851 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cd579af8-35c9-4c5e-af68-97ceb93c8f50 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:36.202851 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cd579af8-35c9-4c5e-af68-97ceb93c8f50 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:36.203265 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cd579af8-35c9-4c5e-af68-97ceb93c8f50 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:36.399517 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-90abdf51-741b-478f-a93d-1d16ddee3e3a tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:36.409074 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-90abdf51-741b-478f-a93d-1d16ddee3e3a tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers/b36a2df7-45c9-4a51-88f1-e1a1b9c0969d" status: 200 len: 1522 microversion: 2.1 time: 0.352189 Oct 30 01:32:36.410539 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2121/4283] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:36 2022] GET /compute/v2.1/servers/b36a2df7-45c9-4a51-88f1-e1a1b9c0969d => generated 1522 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:36.413212 n-d-master-1 devstack@n-api.service[121102]: INFO nova.network.security_group_api [None req-cd579af8-35c9-4c5e-af68-97ceb93c8f50 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Adding security group bac9266f-d5d4-4753-8caa-9974065dc424 to port f8b486d2-42f6-477d-98fa-03d17214f6f4 Oct 30 01:32:36.427800 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-484f877d-2a1e-467e-b0a7-9eadbbdbe99f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:36.428680 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-484f877d-2a1e-467e-b0a7-9eadbbdbe99f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:36.436708 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-484f877d-2a1e-467e-b0a7-9eadbbdbe99f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:36.437090 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-484f877d-2a1e-467e-b0a7-9eadbbdbe99f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:36.437572 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-484f877d-2a1e-467e-b0a7-9eadbbdbe99f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:36.438517 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-484f877d-2a1e-467e-b0a7-9eadbbdbe99f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:36.439186 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-484f877d-2a1e-467e-b0a7-9eadbbdbe99f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:36.439616 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-484f877d-2a1e-467e-b0a7-9eadbbdbe99f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:36.446010 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:36.526479 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=14 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:36.714466 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-484f877d-2a1e-467e-b0a7-9eadbbdbe99f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:36.722662 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-484f877d-2a1e-467e-b0a7-9eadbbdbe99f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.299608 Oct 30 01:32:36.738488 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2122/4284] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:36 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:36.752318 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4b6a5842-1067-48e7-8c8a-05e3f6cda4b2 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:36.753180 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4b6a5842-1067-48e7-8c8a-05e3f6cda4b2 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:36.759585 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4b6a5842-1067-48e7-8c8a-05e3f6cda4b2 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:36.760301 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4b6a5842-1067-48e7-8c8a-05e3f6cda4b2 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:36.760943 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4b6a5842-1067-48e7-8c8a-05e3f6cda4b2 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:36.761847 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4b6a5842-1067-48e7-8c8a-05e3f6cda4b2 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:36.762639 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4b6a5842-1067-48e7-8c8a-05e3f6cda4b2 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:36.763239 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4b6a5842-1067-48e7-8c8a-05e3f6cda4b2 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:36.983463 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4b6a5842-1067-48e7-8c8a-05e3f6cda4b2 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:36.995768 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4b6a5842-1067-48e7-8c8a-05e3f6cda4b2 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e" status: 200 len: 1511 microversion: 2.1 time: 0.256097 Oct 30 01:32:37.009362 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2123/4285] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:36 2022] GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e => generated 1511 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:37.018831 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-077e02e9-630e-49c5-91b1-1a4e112c3fa4 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:37.024389 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-077e02e9-630e-49c5-91b1-1a4e112c3fa4 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:37.047490 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-077e02e9-630e-49c5-91b1-1a4e112c3fa4 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:37.048117 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-077e02e9-630e-49c5-91b1-1a4e112c3fa4 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:37.048789 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-077e02e9-630e-49c5-91b1-1a4e112c3fa4 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:37.049398 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-077e02e9-630e-49c5-91b1-1a4e112c3fa4 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:37.050300 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-077e02e9-630e-49c5-91b1-1a4e112c3fa4 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:37.050988 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-077e02e9-630e-49c5-91b1-1a4e112c3fa4 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:37.054847 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cd579af8-35c9-4c5e-af68-97ceb93c8f50 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "POST /compute/v2.1/servers/9d85310b-581e-4748-b962-ab53210e15b5/action" status: 202 len: 0 microversion: 2.1 time: 0.868463 Oct 30 01:32:37.055705 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2163/4286] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:32:36 2022] POST /compute/v2.1/servers/9d85310b-581e-4748-b962-ab53210e15b5/action => generated 0 bytes in 870 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:32:37.069177 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2a028573-5515-4a81-9bf4-7df96b475f6c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-750070933", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "2bdbb622-9eb5-4b19-93d6-10bf71c70ecc"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2a028573-5515-4a81-9bf4-7df96b475f6c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Request method failure captured: Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 172 Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdPsZZXjRvWKe2zWP-5VH1VYAsWsLLjUmpyob2uINkfAXNLt0qGMmCTWjYn2WpZ3XOOdsuaM4lwk-qZrOIX3mOHzuCJPZ3r-9M-w153XBWLoTow-eSMj1bsAWDNo3KKhMzjHqic8AJ-DcXpdsBh93g0dRB_UMWMRrGyY1cbSRdHJrvg Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 0bce487302c24def8a8473b0725904f2 Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-750070933", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "2bdbb622-9eb5-4b19-93d6-10bf71c70ecc"}]}} Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-750070933', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '2bdbb622-9eb5-4b19-93d6-10bf71c70ecc'}]}}} Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise error Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi -1 Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 30 01:32:37.082501 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 30 01:32:37.093472 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 30 01:32:37.093472 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 30 01:32:37.093472 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 30 01:32:37.093472 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:37.093472 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:37.093472 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:37.093472 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:37.093472 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:32:37.093472 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:32:37.093472 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 30 01:32:37.093472 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 30 01:32:37.093472 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 30 01:32:37.093472 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:37.093472 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2a028573-5515-4a81-9bf4-7df96b475f6c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:32:37.093472 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2a028573-5515-4a81-9bf4-7df96b475f6c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.027461 Oct 30 01:32:37.093472 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2164/4287] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:32:37 2022] POST /compute/v2.1/servers => generated 145 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:32:37.095684 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ed228872-3747-47ea-8abc-2294af3a08e3 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-619098834"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:32:37.096327 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ed228872-3747-47ea-8abc-2294af3a08e3 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] [instance: 9d85310b-581e-4748-b962-ab53210e15b5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:37.105279 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed228872-3747-47ea-8abc-2294af3a08e3 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:37.106602 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed228872-3747-47ea-8abc-2294af3a08e3 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:37.107382 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed228872-3747-47ea-8abc-2294af3a08e3 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:37.108843 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed228872-3747-47ea-8abc-2294af3a08e3 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:37.109525 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed228872-3747-47ea-8abc-2294af3a08e3 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:37.110096 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed228872-3747-47ea-8abc-2294af3a08e3 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:37.122465 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-077e02e9-630e-49c5-91b1-1a4e112c3fa4 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.123523 Oct 30 01:32:37.127402 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2124/4288] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 01:32:36 2022] GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0/os-volume_attachments => generated 25 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:32:37.138952 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-12b02972-efa3-4ec0-a9d1-ff04f2a2d20b tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:37.144495 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-12b02972-efa3-4ec0-a9d1-ff04f2a2d20b tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:37.156387 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-12b02972-efa3-4ec0-a9d1-ff04f2a2d20b tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:37.156894 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-12b02972-efa3-4ec0-a9d1-ff04f2a2d20b tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:37.157368 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-12b02972-efa3-4ec0-a9d1-ff04f2a2d20b tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:37.158334 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-12b02972-efa3-4ec0-a9d1-ff04f2a2d20b tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:37.158790 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-12b02972-efa3-4ec0-a9d1-ff04f2a2d20b tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:37.159215 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-12b02972-efa3-4ec0-a9d1-ff04f2a2d20b tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:37.418060 n-d-master-1 devstack@n-api.service[121102]: INFO nova.network.security_group_api [None req-ed228872-3747-47ea-8abc-2294af3a08e3 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Adding security group 7cd2ff5d-c3d0-4cee-adc4-b57dda15d063 to port f8b486d2-42f6-477d-98fa-03d17214f6f4 Oct 30 01:32:37.499235 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-12b02972-efa3-4ec0-a9d1-ff04f2a2d20b tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:37.515466 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-12b02972-efa3-4ec0-a9d1-ff04f2a2d20b tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.386654 Oct 30 01:32:37.516055 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2125/4289] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:37 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:37.541262 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-8d1dec83-a602-4b5c-83ab-38b12d176c7d req-db4d1d2b-a724-4563-bf20-760d29f2b00b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d85310b-581e-4748-b962-ab53210e15b5", "tag": "f8b486d2-42f6-477d-98fa-03d17214f6f4"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:32:37.551755 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-8d1dec83-a602-4b5c-83ab-38b12d176c7d req-db4d1d2b-a724-4563-bf20-760d29f2b00b service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:37.552242 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-8d1dec83-a602-4b5c-83ab-38b12d176c7d req-db4d1d2b-a724-4563-bf20-760d29f2b00b service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:37.552668 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-8d1dec83-a602-4b5c-83ab-38b12d176c7d req-db4d1d2b-a724-4563-bf20-760d29f2b00b service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:37.669466 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-8d1dec83-a602-4b5c-83ab-38b12d176c7d req-db4d1d2b-a724-4563-bf20-760d29f2b00b service nova] Creating event network-changed:f8b486d2-42f6-477d-98fa-03d17214f6f4 for instance 9d85310b-581e-4748-b962-ab53210e15b5 on n-h1-master-1 Oct 30 01:32:37.677659 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-8d1dec83-a602-4b5c-83ab-38b12d176c7d req-db4d1d2b-a724-4563-bf20-760d29f2b00b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146528 Oct 30 01:32:37.681374 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2126/4290] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:32:37.692725 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-af851f49-65c8-494f-a6f6-6f1a4d0dc4a7 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:32:37.695070 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-af851f49-65c8-494f-a6f6-6f1a4d0dc4a7 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 2873be88-5d85-49c6-833f-19b7df1fcf5f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:37.702999 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af851f49-65c8-494f-a6f6-6f1a4d0dc4a7 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:37.703658 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af851f49-65c8-494f-a6f6-6f1a4d0dc4a7 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:37.704442 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af851f49-65c8-494f-a6f6-6f1a4d0dc4a7 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:37.705361 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af851f49-65c8-494f-a6f6-6f1a4d0dc4a7 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:37.706534 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af851f49-65c8-494f-a6f6-6f1a4d0dc4a7 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:37.707115 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af851f49-65c8-494f-a6f6-6f1a4d0dc4a7 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:37.735163 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-af851f49-65c8-494f-a6f6-6f1a4d0dc4a7 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] HTTP exception thrown: Cannot 'reboot' instance 2873be88-5d85-49c6-833f-19b7df1fcf5f while it is in vm_state rescued Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-af851f49-65c8-494f-a6f6-6f1a4d0dc4a7 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Request method failure captured: Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: request: POST /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f/action HTTP/1.1 Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 28 Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdMpBfA6mq8oavinMeTyaurexihmj6JmnnP2ZZndb1MXJnyLYJP1lh9IAGUFmytWgjEkCc6rHAh1wpEFldWPgYBauossNbR0UQldGfx9XACde0J5etDs6i2phO_G-HCGpqKWqFyqD3FJkTb44yZ7CHZV6U0ZtcSE1Hf7lvcXbJ_Lvp0 Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 470e235fb35840828d9a86028b72f5de Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-909936776 Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/470e235fb35840828d9a86028b72f5de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_470e235fb35840828d9a86028b72f5de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/470e235fb35840828d9a86028b72f5de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/470e235fb35840828d9a86028b72f5de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServerRescueNegativeTestJSON-909936776 Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 470e235fb35840828d9a86028b72f5de Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-909936776 Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServerRescueNegativeTestJSON-909936776-project Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 6134c05549f14bc19962acea9c913f53 Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServerRescueNegativeTestJSON-909936776-project Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: {"reboot": {"type": "HARD"}} Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: exception: Cannot 'reboot' instance 2873be88-5d85-49c6-833f-19b7df1fcf5f while it is in vm_state rescued Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '2873be88-5d85-49c6-833f-19b7df1fcf5f', 'body': {'reboot': {'type': 'HARD'}}} Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2873be88-5d85-49c6-833f-19b7df1fcf5f in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 30 01:32:37.737303 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 30 01:32:37.741562 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 2873be88-5d85-49c6-833f-19b7df1fcf5f while it is in vm_state rescued Oct 30 01:32:37.741562 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:37.741562 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:37.741562 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:37.741562 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:37.741562 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:32:37.741562 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:32:37.741562 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:32:37.741562 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:32:37.741562 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 2873be88-5d85-49c6-833f-19b7df1fcf5f while it is in vm_state rescued Oct 30 01:32:37.741562 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:37.752545 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-af851f49-65c8-494f-a6f6-6f1a4d0dc4a7 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Returning 409 to user: Cannot 'reboot' instance 2873be88-5d85-49c6-833f-19b7df1fcf5f while it is in vm_state rescued {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:32:37.752545 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-af851f49-65c8-494f-a6f6-6f1a4d0dc4a7 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "POST /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f/action" status: 409 len: 145 microversion: 2.1 time: 0.061450 Oct 30 01:32:37.752545 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2127/4291] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:32:37 2022] POST /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f/action => generated 145 bytes in 63 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:32:37.757066 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-da73fb25-9ac6-4672-bf3c-c19ee7482a3d tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:37.758103 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-da73fb25-9ac6-4672-bf3c-c19ee7482a3d tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: b36a2df7-45c9-4a51-88f1-e1a1b9c0969d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:37.766270 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da73fb25-9ac6-4672-bf3c-c19ee7482a3d tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:37.766975 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da73fb25-9ac6-4672-bf3c-c19ee7482a3d tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:37.767611 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da73fb25-9ac6-4672-bf3c-c19ee7482a3d tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:37.768616 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da73fb25-9ac6-4672-bf3c-c19ee7482a3d tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:37.769313 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da73fb25-9ac6-4672-bf3c-c19ee7482a3d tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:37.770359 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da73fb25-9ac6-4672-bf3c-c19ee7482a3d tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:38.075597 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-da73fb25-9ac6-4672-bf3c-c19ee7482a3d tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:38.083120 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-da73fb25-9ac6-4672-bf3c-c19ee7482a3d tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers/b36a2df7-45c9-4a51-88f1-e1a1b9c0969d" status: 200 len: 1522 microversion: 2.1 time: 0.331378 Oct 30 01:32:38.101788 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2128/4292] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:37 2022] GET /compute/v2.1/servers/b36a2df7-45c9-4a51-88f1-e1a1b9c0969d => generated 1522 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:38.105523 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-23ba20a0-c330-45b7-bc4e-9a53651e180c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:38.106960 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-23ba20a0-c330-45b7-bc4e-9a53651e180c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:38.113319 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-23ba20a0-c330-45b7-bc4e-9a53651e180c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:38.114124 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-23ba20a0-c330-45b7-bc4e-9a53651e180c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:38.114817 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-23ba20a0-c330-45b7-bc4e-9a53651e180c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:38.115734 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-23ba20a0-c330-45b7-bc4e-9a53651e180c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:38.116394 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-23ba20a0-c330-45b7-bc4e-9a53651e180c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:38.117022 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-23ba20a0-c330-45b7-bc4e-9a53651e180c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:38.138775 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ed228872-3747-47ea-8abc-2294af3a08e3 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "POST /compute/v2.1/servers/9d85310b-581e-4748-b962-ab53210e15b5/action" status: 202 len: 0 microversion: 2.1 time: 1.047512 Oct 30 01:32:38.139389 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2165/4293] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:32:37 2022] POST /compute/v2.1/servers/9d85310b-581e-4748-b962-ab53210e15b5/action => generated 0 bytes in 1050 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:32:38.147149 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2ade7f84-85bf-4add-b367-04b85e34c3b8 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "deb14158-45d8-4539-889d-ff9726d046d7"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:32:38.152881 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2ade7f84-85bf-4add-b367-04b85e34c3b8 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 2873be88-5d85-49c6-833f-19b7df1fcf5f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:38.172545 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ade7f84-85bf-4add-b367-04b85e34c3b8 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:38.173483 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ade7f84-85bf-4add-b367-04b85e34c3b8 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:38.175644 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ade7f84-85bf-4add-b367-04b85e34c3b8 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:38.176911 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ade7f84-85bf-4add-b367-04b85e34c3b8 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:38.178735 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ade7f84-85bf-4add-b367-04b85e34c3b8 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:38.184485 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ade7f84-85bf-4add-b367-04b85e34c3b8 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:38.216890 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-2ade7f84-85bf-4add-b367-04b85e34c3b8 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] HTTP exception thrown: Cannot 'rebuild' instance 2873be88-5d85-49c6-833f-19b7df1fcf5f while it is in vm_state rescued Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2ade7f84-85bf-4add-b367-04b85e34c3b8 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Request method failure captured: Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f/action HTTP/1.1 Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 65 Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdMpBfA6mq8oavinMeTyaurexihmj6JmnnP2ZZndb1MXJnyLYJP1lh9IAGUFmytWgjEkCc6rHAh1wpEFldWPgYBauossNbR0UQldGfx9XACde0J5etDs6i2phO_G-HCGpqKWqFyqD3FJkTb44yZ7CHZV6U0ZtcSE1Hf7lvcXbJ_Lvp0 Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 470e235fb35840828d9a86028b72f5de Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-909936776 Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/470e235fb35840828d9a86028b72f5de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_470e235fb35840828d9a86028b72f5de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/470e235fb35840828d9a86028b72f5de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/470e235fb35840828d9a86028b72f5de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServerRescueNegativeTestJSON-909936776 Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 470e235fb35840828d9a86028b72f5de Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-909936776 Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServerRescueNegativeTestJSON-909936776-project Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 6134c05549f14bc19962acea9c913f53 Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServerRescueNegativeTestJSON-909936776-project Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: {"rebuild": {"imageRef": "deb14158-45d8-4539-889d-ff9726d046d7"}} Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: exception: Cannot 'rebuild' instance 2873be88-5d85-49c6-833f-19b7df1fcf5f while it is in vm_state rescued Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '2873be88-5d85-49c6-833f-19b7df1fcf5f', 'body': {'rebuild': {'imageRef': 'deb14158-45d8-4539-889d-ff9726d046d7'}}} Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2873be88-5d85-49c6-833f-19b7df1fcf5f in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:32:38.218975 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:32:38.223153 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:32:38.223153 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 30 01:32:38.223153 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 30 01:32:38.223153 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 30 01:32:38.223153 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 30 01:32:38.223153 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 30 01:32:38.223153 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 2873be88-5d85-49c6-833f-19b7df1fcf5f while it is in vm_state rescued Oct 30 01:32:38.223153 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:38.223153 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:38.223153 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:38.223153 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:38.223153 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:32:38.223153 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:32:38.223153 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:32:38.223153 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:32:38.223153 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 2873be88-5d85-49c6-833f-19b7df1fcf5f while it is in vm_state rescued Oct 30 01:32:38.223153 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:38.228306 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2ade7f84-85bf-4add-b367-04b85e34c3b8 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Returning 409 to user: Cannot 'rebuild' instance 2873be88-5d85-49c6-833f-19b7df1fcf5f while it is in vm_state rescued {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:32:38.247101 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2ade7f84-85bf-4add-b367-04b85e34c3b8 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "POST /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f/action" status: 409 len: 146 microversion: 2.1 time: 0.089067 Oct 30 01:32:38.247101 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2166/4294] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:32:38 2022] POST /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f/action => generated 146 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:32:38.247101 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a6de3fb7-bf39-47b5-8751-a9ac4e8c57b4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:38.248412 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a6de3fb7-bf39-47b5-8751-a9ac4e8c57b4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:38.255637 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a6de3fb7-bf39-47b5-8751-a9ac4e8c57b4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:38.256270 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a6de3fb7-bf39-47b5-8751-a9ac4e8c57b4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:38.256706 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a6de3fb7-bf39-47b5-8751-a9ac4e8c57b4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:38.257421 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a6de3fb7-bf39-47b5-8751-a9ac4e8c57b4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:38.258305 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a6de3fb7-bf39-47b5-8751-a9ac4e8c57b4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:38.258733 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a6de3fb7-bf39-47b5-8751-a9ac4e8c57b4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:38.497988 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-23ba20a0-c330-45b7-bc4e-9a53651e180c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:38.513407 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-23ba20a0-c330-45b7-bc4e-9a53651e180c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.413626 Oct 30 01:32:38.514427 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2129/4295] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:38 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:38.534088 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-26d07d3a-ba8c-41f7-92c5-3e69709c311b tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:38.534892 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-26d07d3a-ba8c-41f7-92c5-3e69709c311b tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] [instance: 9d85310b-581e-4748-b962-ab53210e15b5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:38.546302 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-26d07d3a-ba8c-41f7-92c5-3e69709c311b tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:38.546302 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-26d07d3a-ba8c-41f7-92c5-3e69709c311b tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:38.546302 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-26d07d3a-ba8c-41f7-92c5-3e69709c311b tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:38.546302 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-26d07d3a-ba8c-41f7-92c5-3e69709c311b tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:38.546302 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-26d07d3a-ba8c-41f7-92c5-3e69709c311b tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:38.546302 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-26d07d3a-ba8c-41f7-92c5-3e69709c311b tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:38.718978 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a6de3fb7-bf39-47b5-8751-a9ac4e8c57b4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:38.731223 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a6de3fb7-bf39-47b5-8751-a9ac4e8c57b4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e" status: 200 len: 1511 microversion: 2.1 time: 0.488479 Oct 30 01:32:38.746248 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2167/4296] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:38 2022] GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e => generated 1511 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:38.753630 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1ef0d52b-4341-4166-93a4-17ce6c41d640 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:38.754401 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1ef0d52b-4341-4166-93a4-17ce6c41d640 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:38.768183 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ef0d52b-4341-4166-93a4-17ce6c41d640 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:38.769052 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ef0d52b-4341-4166-93a4-17ce6c41d640 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:38.769646 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ef0d52b-4341-4166-93a4-17ce6c41d640 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:38.770608 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ef0d52b-4341-4166-93a4-17ce6c41d640 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:38.771072 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ef0d52b-4341-4166-93a4-17ce6c41d640 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:38.771502 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ef0d52b-4341-4166-93a4-17ce6c41d640 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:38.792244 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:38.808866 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1ef0d52b-4341-4166-93a4-17ce6c41d640 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:32:38.916505 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-26d07d3a-ba8c-41f7-92c5-3e69709c311b tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "GET /compute/v2.1/servers/9d85310b-581e-4748-b962-ab53210e15b5/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.400806 Oct 30 01:32:38.917120 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2130/4297] 10.222.0.13 () {58 vars in 1293 bytes} [Sun Oct 30 01:32:38 2022] GET /compute/v2.1/servers/9d85310b-581e-4748-b962-ab53210e15b5/os-security-groups => generated 1157 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:38.929189 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fcd685c3-621d-4796-b07d-6552b8dc3597 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-685455813", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:32:38.938057 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-fcd685c3-621d-4796-b07d-6552b8dc3597 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fcd685c3-621d-4796-b07d-6552b8dc3597 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Request method failure captured: Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 215 Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdPsZZXjRvWKe2zWP-5VH1VYAsWsLLjUmpyob2uINkfAXNLt0qGMmCTWjYn2WpZ3XOOdsuaM4lwk-qZrOIX3mOHzuCJPZ3r-9M-w153XBWLoTow-eSMj1bsAWDNo3KKhMzjHqic8AJ-DcXpdsBh93g0dRB_UMWMRrGyY1cbSRdHJrvg Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 0bce487302c24def8a8473b0725904f2 Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-685455813", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-685455813', 'imageRef': 'deb14158-45d8-4539-889d-ff9726d046d7', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:38.940348 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:38.944322 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:38.944322 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:32:38.944322 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:32:38.944322 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:32:38.944322 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:32:38.944322 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 30 01:32:38.944322 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:38.946882 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fcd685c3-621d-4796-b07d-6552b8dc3597 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:32:38.947869 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fcd685c3-621d-4796-b07d-6552b8dc3597 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.028217 Oct 30 01:32:38.950021 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2131/4298] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:32:38 2022] POST /compute/v2.1/servers => generated 123 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:32:38.955042 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-440530e3-840c-404c-9e1c-8df31f987c8f tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Action: 'create', calling method: .version_select at 0x7f44d0417dc0>, body: {"security_group": {"name": " tempest-securitygroup -933432515 ", "description": "tempest-description-54859185"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:32:39.137736 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1ef0d52b-4341-4166-93a4-17ce6c41d640 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0" status: 204 len: 0 microversion: 2.1 time: 0.389306 Oct 30 01:32:39.138571 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2168/4299] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:32:38 2022] DELETE /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:32:39.145567 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f00854da-5952-4f0f-bf41-a7888aaa1079 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:39.146824 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f00854da-5952-4f0f-bf41-a7888aaa1079 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:39.156516 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f00854da-5952-4f0f-bf41-a7888aaa1079 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:39.158201 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f00854da-5952-4f0f-bf41-a7888aaa1079 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:39.159331 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f00854da-5952-4f0f-bf41-a7888aaa1079 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:39.160385 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f00854da-5952-4f0f-bf41-a7888aaa1079 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:39.161192 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f00854da-5952-4f0f-bf41-a7888aaa1079 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:39.161843 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f00854da-5952-4f0f-bf41-a7888aaa1079 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:39.355293 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f00854da-5952-4f0f-bf41-a7888aaa1079 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:39.369748 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f00854da-5952-4f0f-bf41-a7888aaa1079 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.229515 Oct 30 01:32:39.371883 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2169/4300] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:39 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:39.375594 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-440530e3-840c-404c-9e1c-8df31f987c8f tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.424211 Oct 30 01:32:39.376205 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2132/4301] 10.222.0.13 () {60 vars in 1180 bytes} [Sun Oct 30 01:32:38 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:32:39.378334 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f6a1d139-5575-4f48-a147-08fda51c8d3d tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:39.379132 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f6a1d139-5575-4f48-a147-08fda51c8d3d tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: b36a2df7-45c9-4a51-88f1-e1a1b9c0969d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:39.380921 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-075ba5c4-eed8-4434-b9f1-41b7439ae5be tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:39.389811 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f6a1d139-5575-4f48-a147-08fda51c8d3d tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:39.390848 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-075ba5c4-eed8-4434-b9f1-41b7439ae5be tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:39.391111 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f6a1d139-5575-4f48-a147-08fda51c8d3d tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:39.391724 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f6a1d139-5575-4f48-a147-08fda51c8d3d tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:39.392738 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f6a1d139-5575-4f48-a147-08fda51c8d3d tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:39.393640 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f6a1d139-5575-4f48-a147-08fda51c8d3d tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:39.394289 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f6a1d139-5575-4f48-a147-08fda51c8d3d tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:39.399223 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-075ba5c4-eed8-4434-b9f1-41b7439ae5be tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:39.399748 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-075ba5c4-eed8-4434-b9f1-41b7439ae5be tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:39.400202 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-075ba5c4-eed8-4434-b9f1-41b7439ae5be tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:39.400875 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-075ba5c4-eed8-4434-b9f1-41b7439ae5be tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:39.401941 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-075ba5c4-eed8-4434-b9f1-41b7439ae5be tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:39.405598 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-075ba5c4-eed8-4434-b9f1-41b7439ae5be tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:39.608154 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f6a1d139-5575-4f48-a147-08fda51c8d3d tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:39.620669 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-075ba5c4-eed8-4434-b9f1-41b7439ae5be tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:39.620867 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f6a1d139-5575-4f48-a147-08fda51c8d3d tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers/b36a2df7-45c9-4a51-88f1-e1a1b9c0969d" status: 200 len: 1522 microversion: 2.1 time: 0.247439 Oct 30 01:32:39.638353 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2170/4302] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:39 2022] GET /compute/v2.1/servers/b36a2df7-45c9-4a51-88f1-e1a1b9c0969d => generated 1522 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:39.644236 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-075ba5c4-eed8-4434-b9f1-41b7439ae5be tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0" status: 200 len: 1692 microversion: 2.1 time: 0.266988 Oct 30 01:32:39.644640 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-045b0e5f-bdc4-48af-9382-3a280fd74af8 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '.version_select at 0x7f44c768bf70>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:39.645510 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2133/4303] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:39 2022] GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0 => generated 1692 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:39.650263 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a36e3e12-f180-42f3-9948-7dedf4f72534 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:39.651044 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a36e3e12-f180-42f3-9948-7dedf4f72534 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:39.657365 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a36e3e12-f180-42f3-9948-7dedf4f72534 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:39.658042 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a36e3e12-f180-42f3-9948-7dedf4f72534 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:39.658693 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a36e3e12-f180-42f3-9948-7dedf4f72534 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:39.659605 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a36e3e12-f180-42f3-9948-7dedf4f72534 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:39.660266 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a36e3e12-f180-42f3-9948-7dedf4f72534 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:39.660938 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a36e3e12-f180-42f3-9948-7dedf4f72534 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:39.713524 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-045b0e5f-bdc4-48af-9382-3a280fd74af8 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups/0e046a09-3cb7-4ad7-9628-9ac631a315c4" status: 200 len: 221 microversion: 2.1 time: 0.073093 Oct 30 01:32:39.714121 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2171/4304] 10.222.0.13 () {58 vars in 1269 bytes} [Sun Oct 30 01:32:39 2022] GET /compute/v2.1/os-security-groups/0e046a09-3cb7-4ad7-9628-9ac631a315c4 => generated 221 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:32:39.718811 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-1a7b8943-812e-41dd-92e1-fa7db5290e93 req-e39ede9c-fff4-4530-b256-bb94bf1911e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d85310b-581e-4748-b962-ab53210e15b5", "tag": "f8b486d2-42f6-477d-98fa-03d17214f6f4"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:32:39.729095 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-1a7b8943-812e-41dd-92e1-fa7db5290e93 req-e39ede9c-fff4-4530-b256-bb94bf1911e9 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:39.729817 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-1a7b8943-812e-41dd-92e1-fa7db5290e93 req-e39ede9c-fff4-4530-b256-bb94bf1911e9 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:39.731057 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-1a7b8943-812e-41dd-92e1-fa7db5290e93 req-e39ede9c-fff4-4530-b256-bb94bf1911e9 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:39.742988 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-1a7b8943-812e-41dd-92e1-fa7db5290e93 req-e39ede9c-fff4-4530-b256-bb94bf1911e9 service nova] Creating event network-changed:f8b486d2-42f6-477d-98fa-03d17214f6f4 for instance 9d85310b-581e-4748-b962-ab53210e15b5 on n-h1-master-1 Oct 30 01:32:39.748634 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-1a7b8943-812e-41dd-92e1-fa7db5290e93 req-e39ede9c-fff4-4530-b256-bb94bf1911e9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033328 Oct 30 01:32:39.749306 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2172/4305] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:32:39.757167 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cb2ae0af-5796-4b23-9d06-ea2805cb28ea tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '.version_select at 0x7f44c73f8940>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:39.852861 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a36e3e12-f180-42f3-9948-7dedf4f72534 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:39.862185 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a36e3e12-f180-42f3-9948-7dedf4f72534 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.215629 Oct 30 01:32:39.863087 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2134/4306] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:39 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:39.867854 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bad5fcb8-0e01-498f-a14a-0f4acfd3b896 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:39.868375 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-bad5fcb8-0e01-498f-a14a-0f4acfd3b896 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:39.878874 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bad5fcb8-0e01-498f-a14a-0f4acfd3b896 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:39.879389 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bad5fcb8-0e01-498f-a14a-0f4acfd3b896 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:39.880087 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bad5fcb8-0e01-498f-a14a-0f4acfd3b896 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:39.881561 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bad5fcb8-0e01-498f-a14a-0f4acfd3b896 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:39.882031 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bad5fcb8-0e01-498f-a14a-0f4acfd3b896 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:39.882464 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bad5fcb8-0e01-498f-a14a-0f4acfd3b896 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:40.143664 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-bad5fcb8-0e01-498f-a14a-0f4acfd3b896 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:40.160871 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bad5fcb8-0e01-498f-a14a-0f4acfd3b896 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e" status: 200 len: 1511 microversion: 2.1 time: 0.296710 Oct 30 01:32:40.161827 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2135/4307] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:39 2022] GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e => generated 1511 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:40.167832 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6645aded-3c03-4d09-a02b-d37e4294e4f6 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-105108512", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "key_name": "tempest-key-636021133", "networks": [{"uuid": "2bdbb622-9eb5-4b19-93d6-10bf71c70ecc"}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:32:40.250126 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-6645aded-3c03-4d09-a02b-d37e4294e4f6 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] validate_networks() for [('2bdbb622-9eb5-4b19-93d6-10bf71c70ecc', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:32:40.316246 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cb2ae0af-5796-4b23-9d06-ea2805cb28ea tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/0e046a09-3cb7-4ad7-9628-9ac631a315c4" status: 202 len: 0 microversion: 2.1 time: 0.563738 Oct 30 01:32:40.316955 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2173/4308] 10.222.0.13 () {58 vars in 1272 bytes} [Sun Oct 30 01:32:39 2022] DELETE /compute/v2.1/os-security-groups/0e046a09-3cb7-4ad7-9628-9ac631a315c4 => generated 0 bytes in 565 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:32:40.325784 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ac95576c-923d-475e-8655-8f24685bb986 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '.version_select at 0x7f44c768b820>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:40.715159 n-d-master-1 devstack@n-api.service[121102]: DEBUG neutronclient.v2_0.client [None req-ac95576c-923d-475e-8655-8f24685bb986 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0e046a09-3cb7-4ad7-9628-9ac631a315c4 does not exist", "detail": ""}} {{(pid=121102) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 30 01:32:40.716450 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.security_group_api [None req-ac95576c-923d-475e-8655-8f24685bb986 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Neutron security group 0e046a09-3cb7-4ad7-9628-9ac631a315c4 not found {{(pid=121102) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 30 01:32:40.717019 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-ac95576c-923d-475e-8655-8f24685bb986 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] HTTP exception thrown: Security group 0e046a09-3cb7-4ad7-9628-9ac631a315c4 does not exist Oct 30 01:32:40.717019 n-d-master-1 devstack@n-api.service[121102]: Neutron server returns request_ids: ['req-99a1b218-6c37-417e-8cf9-7f6b43299cfa'] Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ac95576c-923d-475e-8655-8f24685bb986 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Request method failure captured: Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/os-security-groups/0e046a09-3cb7-4ad7-9628-9ac631a315c4 HTTP/1.1 Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdQeB_St8oVZOGIJlshgL7-LKQgW_hEcgkwBL7Ks3Cs3DIyiB0pghA7n_e8cKany7LxH4x-CEsUJ-uItmueA0KgQDZXCqg5MHQPsBAlpzbn8cQVEq-NvT-3VnV52LMp-twxBeBnfcoXgkz5UUTyaCNLN3Bidx2JUEEuK5lVXSh3eLx8 Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 09d179276dbf4e4d9cb780b18e7a22c7 Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-SecurityGroupsTestJSON-78265462 Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-SecurityGroupsTestJSON-78265462 Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 09d179276dbf4e4d9cb780b18e7a22c7 Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-78265462 Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-SecurityGroupsTestJSON-78265462-project Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 88ac5422c8f048148aac2c9b62e0482e Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-SecurityGroupsTestJSON-78265462-project Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: method: Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: exception: Security group 0e046a09-3cb7-4ad7-9628-9ac631a315c4 does not exist Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: Neutron server returns request_ids: ['req-99a1b218-6c37-417e-8cf9-7f6b43299cfa'] Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '0e046a09-3cb7-4ad7-9628-9ac631a315c4'} Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 30 01:32:40.719700 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0e046a09-3cb7-4ad7-9628-9ac631a315c4 does not exist Oct 30 01:32:40.723288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-99a1b218-6c37-417e-8cf9-7f6b43299cfa'] Oct 30 01:32:40.723288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:40.723288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:40.723288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:40.723288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:40.723288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 30 01:32:40.723288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 30 01:32:40.723288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 30 01:32:40.723288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 30 01:32:40.723288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0e046a09-3cb7-4ad7-9628-9ac631a315c4 does not exist Oct 30 01:32:40.723288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-99a1b218-6c37-417e-8cf9-7f6b43299cfa'] Oct 30 01:32:40.723288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:40.723288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:40.723288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:40.723288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:40.723288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:32:40.723288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:32:40.723288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:32:40.723288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:32:40.723288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:32:40.723288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:32:40.723288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:32:40.723288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:32:40.723288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 30 01:32:40.723288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 30 01:32:40.723288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0e046a09-3cb7-4ad7-9628-9ac631a315c4 does not exist Oct 30 01:32:40.723288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-99a1b218-6c37-417e-8cf9-7f6b43299cfa'] Oct 30 01:32:40.723288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:40.723288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:40.723288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:40.723288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:40.723288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:32:40.723288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:32:40.723288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:32:40.723288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:32:40.723288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0e046a09-3cb7-4ad7-9628-9ac631a315c4 does not exist Oct 30 01:32:40.723288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-99a1b218-6c37-417e-8cf9-7f6b43299cfa'] Oct 30 01:32:40.723288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:40.723288 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ac95576c-923d-475e-8655-8f24685bb986 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Returning 404 to user: Security group 0e046a09-3cb7-4ad7-9628-9ac631a315c4 does not exist Oct 30 01:32:40.723288 n-d-master-1 devstack@n-api.service[121102]: Neutron server returns request_ids: ['req-99a1b218-6c37-417e-8cf9-7f6b43299cfa'] {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:32:40.723288 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ac95576c-923d-475e-8655-8f24685bb986 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups/0e046a09-3cb7-4ad7-9628-9ac631a315c4" status: 404 len: 194 microversion: 2.1 time: 0.400589 Oct 30 01:32:40.723288 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2174/4309] 10.222.0.13 () {58 vars in 1269 bytes} [Sun Oct 30 01:32:40 2022] GET /compute/v2.1/os-security-groups/0e046a09-3cb7-4ad7-9628-9ac631a315c4 => generated 194 bytes in 402 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 01:32:40.732432 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-25ea611c-7c77-4836-944d-48e437486570 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:40.733184 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-25ea611c-7c77-4836-944d-48e437486570 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: b36a2df7-45c9-4a51-88f1-e1a1b9c0969d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:40.742657 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25ea611c-7c77-4836-944d-48e437486570 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:40.742657 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25ea611c-7c77-4836-944d-48e437486570 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:40.742657 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25ea611c-7c77-4836-944d-48e437486570 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:40.742657 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25ea611c-7c77-4836-944d-48e437486570 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:40.742657 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25ea611c-7c77-4836-944d-48e437486570 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:40.742657 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25ea611c-7c77-4836-944d-48e437486570 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:41.031739 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-6645aded-3c03-4d09-a02b-d37e4294e4f6 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] HTTP exception thrown: Invalid key_name provided. Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6645aded-3c03-4d09-a02b-d37e4294e4f6 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Request method failure captured: Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 245 Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdPsZZXjRvWKe2zWP-5VH1VYAsWsLLjUmpyob2uINkfAXNLt0qGMmCTWjYn2WpZ3XOOdsuaM4lwk-qZrOIX3mOHzuCJPZ3r-9M-w153XBWLoTow-eSMj1bsAWDNo3KKhMzjHqic8AJ-DcXpdsBh93g0dRB_UMWMRrGyY1cbSRdHJrvg Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 0bce487302c24def8a8473b0725904f2 Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-105108512", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "key_name": "tempest-key-636021133", "networks": [{"uuid": "2bdbb622-9eb5-4b19-93d6-10bf71c70ecc"}]}} Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: exception: Invalid key_name provided. Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-105108512', 'imageRef': 'deb14158-45d8-4539-889d-ff9726d046d7', 'flavorRef': '452', 'key_name': 'tempest-key-636021133', 'networks': [{'uuid': '2bdbb622-9eb5-4b19-93d6-10bf71c70ecc'}]}}} Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-636021133 not found for user 0bce487302c24def8a8473b0725904f2 Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:41.033599 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:32:41.036955 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:32:41.036955 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:32:41.036955 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:32:41.036955 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:32:41.036955 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:32:41.036955 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:32:41.036955 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:32:41.036955 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:32:41.036955 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:32:41.036955 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:32:41.036955 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:32:41.036955 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 30 01:32:41.036955 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 30 01:32:41.036955 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 30 01:32:41.036955 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 30 01:32:41.036955 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:41.036955 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:41.036955 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:41.036955 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:41.036955 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:32:41.036955 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:32:41.036955 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:32:41.036955 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:32:41.036955 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 30 01:32:41.036955 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:41.038276 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-25ea611c-7c77-4836-944d-48e437486570 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:41.040095 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6645aded-3c03-4d09-a02b-d37e4294e4f6 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Returning 400 to user: Invalid key_name provided. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:32:41.041159 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6645aded-3c03-4d09-a02b-d37e4294e4f6 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.877925 Oct 30 01:32:41.042156 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2136/4310] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:32:40 2022] POST /compute/v2.1/servers => generated 70 bytes in 879 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 30 01:32:41.043477 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-25ea611c-7c77-4836-944d-48e437486570 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers/b36a2df7-45c9-4a51-88f1-e1a1b9c0969d" status: 200 len: 1522 microversion: 2.1 time: 0.318258 Oct 30 01:32:41.044208 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2175/4311] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:40 2022] GET /compute/v2.1/servers/b36a2df7-45c9-4a51-88f1-e1a1b9c0969d => generated 1522 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:41.047787 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fbfe7b3a-0923-46a4-a4b1-db8f22b98055 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:41.048408 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-fbfe7b3a-0923-46a4-a4b1-db8f22b98055 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:41.049716 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-36690219-6e76-4d49-b054-7867eeea1886 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Action: 'create', calling method: .version_select at 0x7f44c76bb280>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1748830951", "description": "tempest-description-1160699908"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:32:41.054602 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fbfe7b3a-0923-46a4-a4b1-db8f22b98055 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:41.055271 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fbfe7b3a-0923-46a4-a4b1-db8f22b98055 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:41.055705 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fbfe7b3a-0923-46a4-a4b1-db8f22b98055 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:41.056844 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fbfe7b3a-0923-46a4-a4b1-db8f22b98055 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:41.056844 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fbfe7b3a-0923-46a4-a4b1-db8f22b98055 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:41.057304 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fbfe7b3a-0923-46a4-a4b1-db8f22b98055 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:41.290746 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-fbfe7b3a-0923-46a4-a4b1-db8f22b98055 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:41.301757 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fbfe7b3a-0923-46a4-a4b1-db8f22b98055 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0" status: 200 len: 1692 microversion: 2.1 time: 0.257757 Oct 30 01:32:41.302557 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2137/4312] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:41 2022] GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0 => generated 1692 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:41.324254 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e07c420a-85c1-40f4-8dc6-262d329d4dd6 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:41.325023 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e07c420a-85c1-40f4-8dc6-262d329d4dd6 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:41.331110 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e07c420a-85c1-40f4-8dc6-262d329d4dd6 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:41.331833 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e07c420a-85c1-40f4-8dc6-262d329d4dd6 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:41.332322 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e07c420a-85c1-40f4-8dc6-262d329d4dd6 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:41.333030 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e07c420a-85c1-40f4-8dc6-262d329d4dd6 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:41.333794 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e07c420a-85c1-40f4-8dc6-262d329d4dd6 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:41.333977 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e07c420a-85c1-40f4-8dc6-262d329d4dd6 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:41.627644 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e07c420a-85c1-40f4-8dc6-262d329d4dd6 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:41.638173 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e07c420a-85c1-40f4-8dc6-262d329d4dd6 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.322404 Oct 30 01:32:41.639682 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2138/4313] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:41 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:41.644414 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0fbd24c5-9c46-4802-9604-6389a1a004df tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:41.645196 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0fbd24c5-9c46-4802-9604-6389a1a004df tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:41.651664 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0fbd24c5-9c46-4802-9604-6389a1a004df tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:41.652688 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0fbd24c5-9c46-4802-9604-6389a1a004df tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:41.653933 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0fbd24c5-9c46-4802-9604-6389a1a004df tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:41.661418 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0fbd24c5-9c46-4802-9604-6389a1a004df tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:41.661937 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0fbd24c5-9c46-4802-9604-6389a1a004df tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:41.662817 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0fbd24c5-9c46-4802-9604-6389a1a004df tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:41.695252 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-36690219-6e76-4d49-b054-7867eeea1886 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.648806 Oct 30 01:32:41.707121 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2176/4314] 10.222.0.13 () {60 vars in 1180 bytes} [Sun Oct 30 01:32:41 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:32:41.707121 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ce218a5c-77dd-4d8d-a974-38ccb6b15d4e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:41.707121 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ce218a5c-77dd-4d8d-a974-38ccb6b15d4e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:41.712614 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce218a5c-77dd-4d8d-a974-38ccb6b15d4e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:41.713290 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce218a5c-77dd-4d8d-a974-38ccb6b15d4e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:41.714168 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce218a5c-77dd-4d8d-a974-38ccb6b15d4e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:41.715600 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce218a5c-77dd-4d8d-a974-38ccb6b15d4e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:41.716058 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce218a5c-77dd-4d8d-a974-38ccb6b15d4e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:41.716535 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce218a5c-77dd-4d8d-a974-38ccb6b15d4e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:41.956899 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0fbd24c5-9c46-4802-9604-6389a1a004df tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:41.972505 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0fbd24c5-9c46-4802-9604-6389a1a004df tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e" status: 200 len: 1511 microversion: 2.1 time: 0.331949 Oct 30 01:32:41.973308 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2139/4315] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:41 2022] GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e => generated 1511 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:41.978447 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ce218a5c-77dd-4d8d-a974-38ccb6b15d4e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:41.986687 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ce218a5c-77dd-4d8d-a974-38ccb6b15d4e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.288398 Oct 30 01:32:41.988102 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2177/4316] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:41 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:41.989683 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-27934f2e-9a7b-40d5-a0f0-e30ee35dd806 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Action: 'create', calling method: .version_select at 0x7f44cc0d4040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-186112348", "description": "tempest-description-702187883"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:32:42.069472 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-12fc79fb-75f7-426d-bacc-4bfd47ba9fd0 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:42.070429 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-12fc79fb-75f7-426d-bacc-4bfd47ba9fd0 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: b36a2df7-45c9-4a51-88f1-e1a1b9c0969d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:42.077238 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-12fc79fb-75f7-426d-bacc-4bfd47ba9fd0 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:42.078070 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-12fc79fb-75f7-426d-bacc-4bfd47ba9fd0 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:42.078654 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-12fc79fb-75f7-426d-bacc-4bfd47ba9fd0 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:42.079355 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-12fc79fb-75f7-426d-bacc-4bfd47ba9fd0 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:42.079804 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-12fc79fb-75f7-426d-bacc-4bfd47ba9fd0 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:42.080219 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-12fc79fb-75f7-426d-bacc-4bfd47ba9fd0 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:42.319339 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-12fc79fb-75f7-426d-bacc-4bfd47ba9fd0 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:42.331115 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-12fc79fb-75f7-426d-bacc-4bfd47ba9fd0 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers/b36a2df7-45c9-4a51-88f1-e1a1b9c0969d" status: 200 len: 1522 microversion: 2.1 time: 0.265565 Oct 30 01:32:42.345933 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2178/4317] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:42 2022] GET /compute/v2.1/servers/b36a2df7-45c9-4a51-88f1-e1a1b9c0969d => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:42.345933 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c2fa7127-1fa8-4209-8bbe-716cae74cc42 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1016716456", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "2bdbb622-9eb5-4b19-93d6-10bf71c70ecc"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:32:42.513316 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.security_group_api [None req-c2fa7127-1fa8-4209-8bbe-716cae74cc42 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Neutron security group does_not_exist not found {{(pid=121102) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 30 01:32:42.513921 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-c2fa7127-1fa8-4209-8bbe-716cae74cc42 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c2fa7127-1fa8-4209-8bbe-716cae74cc42 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Request method failure captured: Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 258 Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdPsZZXjRvWKe2zWP-5VH1VYAsWsLLjUmpyob2uINkfAXNLt0qGMmCTWjYn2WpZ3XOOdsuaM4lwk-qZrOIX3mOHzuCJPZ3r-9M-w153XBWLoTow-eSMj1bsAWDNo3KKhMzjHqic8AJ-DcXpdsBh93g0dRB_UMWMRrGyY1cbSRdHJrvg Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 0bce487302c24def8a8473b0725904f2 Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1016716456", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "2bdbb622-9eb5-4b19-93d6-10bf71c70ecc"}]}} Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1016716456', 'imageRef': 'deb14158-45d8-4539-889d-ff9726d046d7', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '2bdbb622-9eb5-4b19-93d6-10bf71c70ecc'}]}}} Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 30 01:32:42.526034 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 30 01:32:42.540723 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 30 01:32:42.540723 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 30 01:32:42.540723 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 30 01:32:42.540723 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 30 01:32:42.540723 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:32:42.540723 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:32:42.540723 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 30 01:32:42.540723 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 30 01:32:42.540723 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 30 01:32:42.540723 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:42.540723 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:42.540723 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:42.540723 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:42.540723 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 30 01:32:42.540723 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 30 01:32:42.540723 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 30 01:32:42.540723 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 30 01:32:42.540723 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 30 01:32:42.540723 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 30 01:32:42.540723 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 30 01:32:42.540723 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 30 01:32:42.540723 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 30 01:32:42.540723 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 30 01:32:42.540723 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 30 01:32:42.540723 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 30 01:32:42.540723 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 30 01:32:42.540723 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:42.540723 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:42.540723 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:42.540723 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:42.540723 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:32:42.540723 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:32:42.540723 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:32:42.540723 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:32:42.540723 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:32:42.540723 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:32:42.540723 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:32:42.540723 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:32:42.540723 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:32:42.540723 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:32:42.540723 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:32:42.540723 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:32:42.540723 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 30 01:32:42.540723 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 30 01:32:42.540723 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 30 01:32:42.540723 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 30 01:32:42.540723 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:42.540723 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:42.540723 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:42.540723 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:42.540723 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:32:42.540723 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:32:42.540723 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:32:42.540723 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:32:42.540723 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 30 01:32:42.540723 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:42.540723 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c2fa7127-1fa8-4209-8bbe-716cae74cc42 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:32:42.545311 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c2fa7127-1fa8-4209-8bbe-716cae74cc42 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.198808 Oct 30 01:32:42.545311 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2179/4318] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:32:42 2022] POST /compute/v2.1/servers => generated 106 bytes in 200 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:32:42.545311 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-eaa96513-b206-4635-bd49-f15a8f683bfd tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:42.545311 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-eaa96513-b206-4635-bd49-f15a8f683bfd tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:42.554477 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eaa96513-b206-4635-bd49-f15a8f683bfd tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:42.555052 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eaa96513-b206-4635-bd49-f15a8f683bfd tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:42.555575 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eaa96513-b206-4635-bd49-f15a8f683bfd tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:42.556455 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eaa96513-b206-4635-bd49-f15a8f683bfd tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:42.556907 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eaa96513-b206-4635-bd49-f15a8f683bfd tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:42.557324 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eaa96513-b206-4635-bd49-f15a8f683bfd tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:42.590538 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-27934f2e-9a7b-40d5-a0f0-e30ee35dd806 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.616018 Oct 30 01:32:42.591683 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2140/4319] 10.222.0.13 () {60 vars in 1180 bytes} [Sun Oct 30 01:32:41 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:32:42.596655 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-33020853-a63b-4501-9600-f79ced852b61 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:42.597642 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-33020853-a63b-4501-9600-f79ced852b61 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:42.612758 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-33020853-a63b-4501-9600-f79ced852b61 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:42.613726 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-33020853-a63b-4501-9600-f79ced852b61 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:42.615653 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-33020853-a63b-4501-9600-f79ced852b61 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:42.616983 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-33020853-a63b-4501-9600-f79ced852b61 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:42.617775 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-33020853-a63b-4501-9600-f79ced852b61 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:42.621579 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-33020853-a63b-4501-9600-f79ced852b61 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:42.867831 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-eaa96513-b206-4635-bd49-f15a8f683bfd tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:42.880335 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-eaa96513-b206-4635-bd49-f15a8f683bfd tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0" status: 200 len: 1692 microversion: 2.1 time: 0.345988 Oct 30 01:32:42.881516 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2180/4320] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:42 2022] GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0 => generated 1692 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:42.892489 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-323f0792-a762-4b73-bca7-5c707360e415 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Action: 'create', calling method: .version_select at 0x7f44c7660c10>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1192430235", "description": "tempest-description-650410021"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:32:42.972281 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-33020853-a63b-4501-9600-f79ced852b61 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:42.983299 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-33020853-a63b-4501-9600-f79ced852b61 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.390222 Oct 30 01:32:42.984243 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2141/4321] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:42 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:43.008528 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3ea4eca2-7ae5-47ef-8215-d33a3736fe2e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:43.009647 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3ea4eca2-7ae5-47ef-8215-d33a3736fe2e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:43.015970 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3ea4eca2-7ae5-47ef-8215-d33a3736fe2e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:43.016632 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3ea4eca2-7ae5-47ef-8215-d33a3736fe2e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:43.017143 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3ea4eca2-7ae5-47ef-8215-d33a3736fe2e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:43.017880 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3ea4eca2-7ae5-47ef-8215-d33a3736fe2e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:43.018336 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3ea4eca2-7ae5-47ef-8215-d33a3736fe2e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:43.019051 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3ea4eca2-7ae5-47ef-8215-d33a3736fe2e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:43.300117 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3ea4eca2-7ae5-47ef-8215-d33a3736fe2e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:43.320891 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3ea4eca2-7ae5-47ef-8215-d33a3736fe2e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e" status: 200 len: 1511 microversion: 2.1 time: 0.317011 Oct 30 01:32:43.322099 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2142/4322] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:43 2022] GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e => generated 1511 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:43.330334 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8734a967-01c9-4a7d-a9b4-b29feff6b2e3 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:43.331237 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8734a967-01c9-4a7d-a9b4-b29feff6b2e3 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:43.338207 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8734a967-01c9-4a7d-a9b4-b29feff6b2e3 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:43.338901 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8734a967-01c9-4a7d-a9b4-b29feff6b2e3 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:43.340273 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8734a967-01c9-4a7d-a9b4-b29feff6b2e3 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:43.341364 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8734a967-01c9-4a7d-a9b4-b29feff6b2e3 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:43.342851 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8734a967-01c9-4a7d-a9b4-b29feff6b2e3 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:43.344065 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8734a967-01c9-4a7d-a9b4-b29feff6b2e3 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:43.674421 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-323f0792-a762-4b73-bca7-5c707360e415 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.786029 Oct 30 01:32:43.675025 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2181/4323] 10.222.0.13 () {60 vars in 1180 bytes} [Sun Oct 30 01:32:42 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:32:43.680413 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-08dc712c-6787-4aa3-96ba-a984eec0255c tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:43.681028 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-08dc712c-6787-4aa3-96ba-a984eec0255c tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: b36a2df7-45c9-4a51-88f1-e1a1b9c0969d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:43.693323 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08dc712c-6787-4aa3-96ba-a984eec0255c tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:43.695748 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08dc712c-6787-4aa3-96ba-a984eec0255c tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:43.696944 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08dc712c-6787-4aa3-96ba-a984eec0255c tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:43.699413 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08dc712c-6787-4aa3-96ba-a984eec0255c tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:43.705019 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08dc712c-6787-4aa3-96ba-a984eec0255c tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:43.705822 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08dc712c-6787-4aa3-96ba-a984eec0255c tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:44.277667 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8734a967-01c9-4a7d-a9b4-b29feff6b2e3 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:44.303192 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8734a967-01c9-4a7d-a9b4-b29feff6b2e3 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.979701 Oct 30 01:32:44.307768 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2143/4324] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:43 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:44.317069 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f14d1307-9343-44d9-a34b-de6c096fb4cf tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '.version_select at 0x7f44c7a90af0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:44.510125 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-08dc712c-6787-4aa3-96ba-a984eec0255c tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:44.520001 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-08dc712c-6787-4aa3-96ba-a984eec0255c tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers/b36a2df7-45c9-4a51-88f1-e1a1b9c0969d" status: 200 len: 1499 microversion: 2.1 time: 0.843667 Oct 30 01:32:44.521204 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2182/4325] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:43 2022] GET /compute/v2.1/servers/b36a2df7-45c9-4a51-88f1-e1a1b9c0969d => generated 1499 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:44.526582 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2ae587ed-95c8-4631-b95b-1cbee1716764 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:44.528469 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2ae587ed-95c8-4631-b95b-1cbee1716764 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:44.537185 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ae587ed-95c8-4631-b95b-1cbee1716764 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:44.538494 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ae587ed-95c8-4631-b95b-1cbee1716764 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:44.548911 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ae587ed-95c8-4631-b95b-1cbee1716764 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:44.548911 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ae587ed-95c8-4631-b95b-1cbee1716764 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:44.548911 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ae587ed-95c8-4631-b95b-1cbee1716764 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:44.548911 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ae587ed-95c8-4631-b95b-1cbee1716764 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:45.044042 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2ae587ed-95c8-4631-b95b-1cbee1716764 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:45.052927 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2ae587ed-95c8-4631-b95b-1cbee1716764 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0" status: 200 len: 1692 microversion: 2.1 time: 0.530421 Oct 30 01:32:45.054106 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2183/4326] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:44 2022] GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0 => generated 1692 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:45.058815 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c138448c-8942-49b3-974f-19748b257a83 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:45.059314 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c138448c-8942-49b3-974f-19748b257a83 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b51b792f-8d59-4f16-88e7-a060afd8f279] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:45.066366 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-c138448c-8942-49b3-974f-19748b257a83 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] HTTP exception thrown: Instance b51b792f-8d59-4f16-88e7-a060afd8f279 could not be found. Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c138448c-8942-49b3-974f-19748b257a83 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Request method failure captured: Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/servers/b51b792f-8d59-4f16-88e7-a060afd8f279 HTTP/1.1 Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdPsZZXjRvWKe2zWP-5VH1VYAsWsLLjUmpyob2uINkfAXNLt0qGMmCTWjYn2WpZ3XOOdsuaM4lwk-qZrOIX3mOHzuCJPZ3r-9M-w153XBWLoTow-eSMj1bsAWDNo3KKhMzjHqic8AJ-DcXpdsBh93g0dRB_UMWMRrGyY1cbSRdHJrvg Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 0bce487302c24def8a8473b0725904f2 Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: exception: Instance b51b792f-8d59-4f16-88e7-a060afd8f279 could not be found. Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'b51b792f-8d59-4f16-88e7-a060afd8f279'} Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b51b792f-8d59-4f16-88e7-a060afd8f279 could not be found. Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b51b792f-8d59-4f16-88e7-a060afd8f279 could not be found. Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:45.068311 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:45.071717 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:45.071717 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:45.071717 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:32:45.071717 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:32:45.071717 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:32:45.071717 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:32:45.071717 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b51b792f-8d59-4f16-88e7-a060afd8f279 could not be found. Oct 30 01:32:45.071717 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:45.071717 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c138448c-8942-49b3-974f-19748b257a83 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Returning 404 to user: Instance b51b792f-8d59-4f16-88e7-a060afd8f279 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:32:45.071717 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c138448c-8942-49b3-974f-19748b257a83 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b51b792f-8d59-4f16-88e7-a060afd8f279" status: 404 len: 111 microversion: 2.1 time: 0.016552 Oct 30 01:32:45.072476 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2184/4327] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:32:45 2022] DELETE /compute/v2.1/servers/b51b792f-8d59-4f16-88e7-a060afd8f279 => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:32:45.087184 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b523fd8c-6fa5-4d8b-b061-1b3315cd8232 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:45.090174 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b523fd8c-6fa5-4d8b-b061-1b3315cd8232 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:45.102004 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b523fd8c-6fa5-4d8b-b061-1b3315cd8232 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:45.103106 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b523fd8c-6fa5-4d8b-b061-1b3315cd8232 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:45.104325 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b523fd8c-6fa5-4d8b-b061-1b3315cd8232 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:45.105881 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b523fd8c-6fa5-4d8b-b061-1b3315cd8232 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:45.106627 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b523fd8c-6fa5-4d8b-b061-1b3315cd8232 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:45.107534 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b523fd8c-6fa5-4d8b-b061-1b3315cd8232 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:45.163335 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f14d1307-9343-44d9-a34b-de6c096fb4cf tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups" status: 200 len: 1832 microversion: 2.1 time: 0.853476 Oct 30 01:32:45.164287 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2144/4328] 10.222.0.13 () {58 vars in 1158 bytes} [Sun Oct 30 01:32:44 2022] GET /compute/v2.1/os-security-groups => generated 1832 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:45.177027 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-627ebf87-9eb2-4d0e-b1d9-8e121a93ae63 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:45.182712 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-627ebf87-9eb2-4d0e-b1d9-8e121a93ae63 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:45.185864 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-627ebf87-9eb2-4d0e-b1d9-8e121a93ae63 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '8b25b290c8004e1f8f89e17b448f242a'} {{(pid=121103) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 30 01:32:45.191978 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-627ebf87-9eb2-4d0e-b1d9-8e121a93ae63 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:45.192578 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-627ebf87-9eb2-4d0e-b1d9-8e121a93ae63 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:45.193112 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-627ebf87-9eb2-4d0e-b1d9-8e121a93ae63 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:45.194536 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-627ebf87-9eb2-4d0e-b1d9-8e121a93ae63 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:45.195207 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-627ebf87-9eb2-4d0e-b1d9-8e121a93ae63 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:45.195864 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-627ebf87-9eb2-4d0e-b1d9-8e121a93ae63 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:45.252714 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=100 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:45.257823 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.multi_cell_list [None req-627ebf87-9eb2-4d0e-b1d9-8e121a93ae63 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121103) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 30 01:32:45.291420 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-627ebf87-9eb2-4d0e-b1d9-8e121a93ae63 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.125947 Oct 30 01:32:45.292102 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2145/4329] 10.222.0.13 () {58 vars in 1154 bytes} [Sun Oct 30 01:32:45 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:32:45.296561 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-33f69920-35fa-40e2-8d25-fea0324f39a0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:45.297170 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-33f69920-35fa-40e2-8d25-fea0324f39a0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:45.299264 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=100 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:45.303965 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-33f69920-35fa-40e2-8d25-fea0324f39a0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:45.304462 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-33f69920-35fa-40e2-8d25-fea0324f39a0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:45.307065 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-33f69920-35fa-40e2-8d25-fea0324f39a0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:45.307065 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-33f69920-35fa-40e2-8d25-fea0324f39a0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:45.307065 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-33f69920-35fa-40e2-8d25-fea0324f39a0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:45.307065 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-33f69920-35fa-40e2-8d25-fea0324f39a0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:45.383090 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b523fd8c-6fa5-4d8b-b061-1b3315cd8232 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:45.391478 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b523fd8c-6fa5-4d8b-b061-1b3315cd8232 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e" status: 200 len: 1511 microversion: 2.1 time: 0.318228 Oct 30 01:32:45.392039 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2185/4330] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:45 2022] GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e => generated 1511 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:45.409973 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ef8a417c-66dc-4a36-b71f-9b5b5dffa35b tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '.version_select at 0x7f44d04e5310>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:45.692097 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-33f69920-35fa-40e2-8d25-fea0324f39a0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:45.702570 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-33f69920-35fa-40e2-8d25-fea0324f39a0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.409333 Oct 30 01:32:45.704663 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2146/4331] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:45 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:45.711424 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-343175cb-1acf-4602-bd36-6e5c64081788 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:32:45.719685 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-343175cb-1acf-4602-bd36-6e5c64081788 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:45.720367 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-343175cb-1acf-4602-bd36-6e5c64081788 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:45.721096 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-343175cb-1acf-4602-bd36-6e5c64081788 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:45.751958 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-343175cb-1acf-4602-bd36-6e5c64081788 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: b36a2df7-45c9-4a51-88f1-e1a1b9c0969d] Going to try to start instance {{(pid=121103) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 30 01:32:45.992880 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-343175cb-1acf-4602-bd36-6e5c64081788 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "POST /compute/v2.1/servers/b36a2df7-45c9-4a51-88f1-e1a1b9c0969d/action" status: 202 len: 0 microversion: 2.1 time: 0.286151 Oct 30 01:32:45.994028 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2147/4332] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:32:45 2022] POST /compute/v2.1/servers/b36a2df7-45c9-4a51-88f1-e1a1b9c0969d/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:32:46.007752 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8f0e60dc-beaf-4ff4-9dbc-13726d0781b1 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:46.010988 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8f0e60dc-beaf-4ff4-9dbc-13726d0781b1 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:46.021441 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f0e60dc-beaf-4ff4-9dbc-13726d0781b1 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:46.023240 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f0e60dc-beaf-4ff4-9dbc-13726d0781b1 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:46.023240 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f0e60dc-beaf-4ff4-9dbc-13726d0781b1 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:46.023978 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f0e60dc-beaf-4ff4-9dbc-13726d0781b1 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:46.025195 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f0e60dc-beaf-4ff4-9dbc-13726d0781b1 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:46.025825 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f0e60dc-beaf-4ff4-9dbc-13726d0781b1 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:46.350574 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ef8a417c-66dc-4a36-b71f-9b5b5dffa35b tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/d515fd92-e8d3-4b09-9be9-dc80d5cb0613" status: 202 len: 0 microversion: 2.1 time: 0.957298 Oct 30 01:32:46.351990 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2186/4333] 10.222.0.13 () {58 vars in 1272 bytes} [Sun Oct 30 01:32:45 2022] DELETE /compute/v2.1/os-security-groups/d515fd92-e8d3-4b09-9be9-dc80d5cb0613 => generated 0 bytes in 959 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:32:46.365164 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8f0e60dc-beaf-4ff4-9dbc-13726d0781b1 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:46.377492 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-87763f30-1872-4fed-bb78-58504d8d16f0 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:46.380203 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-87763f30-1872-4fed-bb78-58504d8d16f0 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: b36a2df7-45c9-4a51-88f1-e1a1b9c0969d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:46.384288 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8f0e60dc-beaf-4ff4-9dbc-13726d0781b1 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.388696 Oct 30 01:32:46.389139 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2148/4334] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:45 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:46.395383 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-87763f30-1872-4fed-bb78-58504d8d16f0 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:46.396361 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-87763f30-1872-4fed-bb78-58504d8d16f0 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:46.397586 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-87763f30-1872-4fed-bb78-58504d8d16f0 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:46.398485 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-87763f30-1872-4fed-bb78-58504d8d16f0 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:46.399517 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-87763f30-1872-4fed-bb78-58504d8d16f0 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:46.403957 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6267d590-a0c8-43bb-bc8f-c0ce399b6f77 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:46.404971 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6267d590-a0c8-43bb-bc8f-c0ce399b6f77 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:46.406931 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-87763f30-1872-4fed-bb78-58504d8d16f0 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:46.426740 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6267d590-a0c8-43bb-bc8f-c0ce399b6f77 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:46.429792 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6267d590-a0c8-43bb-bc8f-c0ce399b6f77 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:46.432122 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6267d590-a0c8-43bb-bc8f-c0ce399b6f77 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:46.433613 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6267d590-a0c8-43bb-bc8f-c0ce399b6f77 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:46.434876 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6267d590-a0c8-43bb-bc8f-c0ce399b6f77 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:46.437905 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6267d590-a0c8-43bb-bc8f-c0ce399b6f77 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:46.629473 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6267d590-a0c8-43bb-bc8f-c0ce399b6f77 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:46.639886 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6267d590-a0c8-43bb-bc8f-c0ce399b6f77 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0" status: 200 len: 1624 microversion: 2.1 time: 0.248181 Oct 30 01:32:46.640490 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2149/4335] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:46 2022] GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0 => generated 1624 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:46.647524 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6332a99b-44dd-4c7c-abbe-4bc5779c9f47 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '.version_select at 0x7f44cc34ac10>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:46.803013 n-d-master-1 devstack@n-api.service[121103]: DEBUG neutronclient.v2_0.client [None req-6332a99b-44dd-4c7c-abbe-4bc5779c9f47 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d515fd92-e8d3-4b09-9be9-dc80d5cb0613 does not exist", "detail": ""}} {{(pid=121103) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 30 01:32:46.803853 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.security_group_api [None req-6332a99b-44dd-4c7c-abbe-4bc5779c9f47 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Neutron security group d515fd92-e8d3-4b09-9be9-dc80d5cb0613 not found {{(pid=121103) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 30 01:32:46.804544 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-6332a99b-44dd-4c7c-abbe-4bc5779c9f47 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] HTTP exception thrown: Security group d515fd92-e8d3-4b09-9be9-dc80d5cb0613 does not exist Oct 30 01:32:46.804544 n-d-master-1 devstack@n-api.service[121103]: Neutron server returns request_ids: ['req-4c9517bb-2308-44b2-a7a4-a04bba005bb8'] Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6332a99b-44dd-4c7c-abbe-4bc5779c9f47 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Request method failure captured: Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/os-security-groups/d515fd92-e8d3-4b09-9be9-dc80d5cb0613 HTTP/1.1 Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdQeB_St8oVZOGIJlshgL7-LKQgW_hEcgkwBL7Ks3Cs3DIyiB0pghA7n_e8cKany7LxH4x-CEsUJ-uItmueA0KgQDZXCqg5MHQPsBAlpzbn8cQVEq-NvT-3VnV52LMp-twxBeBnfcoXgkz5UUTyaCNLN3Bidx2JUEEuK5lVXSh3eLx8 Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 09d179276dbf4e4d9cb780b18e7a22c7 Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-SecurityGroupsTestJSON-78265462 Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-SecurityGroupsTestJSON-78265462 Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 09d179276dbf4e4d9cb780b18e7a22c7 Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-78265462 Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-SecurityGroupsTestJSON-78265462-project Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 88ac5422c8f048148aac2c9b62e0482e Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-SecurityGroupsTestJSON-78265462-project Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: method: Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: exception: Security group d515fd92-e8d3-4b09-9be9-dc80d5cb0613 does not exist Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: Neutron server returns request_ids: ['req-4c9517bb-2308-44b2-a7a4-a04bba005bb8'] Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'd515fd92-e8d3-4b09-9be9-dc80d5cb0613'} Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 30 01:32:46.806569 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d515fd92-e8d3-4b09-9be9-dc80d5cb0613 does not exist Oct 30 01:32:46.815066 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4c9517bb-2308-44b2-a7a4-a04bba005bb8'] Oct 30 01:32:46.815066 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:46.815066 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:46.815066 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:46.815066 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:46.815066 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 30 01:32:46.815066 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 30 01:32:46.815066 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 30 01:32:46.815066 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 30 01:32:46.815066 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d515fd92-e8d3-4b09-9be9-dc80d5cb0613 does not exist Oct 30 01:32:46.815066 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4c9517bb-2308-44b2-a7a4-a04bba005bb8'] Oct 30 01:32:46.815066 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:46.815066 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:46.815066 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:46.815066 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:46.815066 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:32:46.815066 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:32:46.815066 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:32:46.815066 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:32:46.815066 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:32:46.815066 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:32:46.815066 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:32:46.815066 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:32:46.815066 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 30 01:32:46.815066 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 30 01:32:46.815066 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d515fd92-e8d3-4b09-9be9-dc80d5cb0613 does not exist Oct 30 01:32:46.815066 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4c9517bb-2308-44b2-a7a4-a04bba005bb8'] Oct 30 01:32:46.815066 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:46.815066 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:46.815066 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:46.815066 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:46.815066 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:32:46.815066 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:32:46.815066 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:32:46.815066 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:32:46.815066 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d515fd92-e8d3-4b09-9be9-dc80d5cb0613 does not exist Oct 30 01:32:46.815066 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4c9517bb-2308-44b2-a7a4-a04bba005bb8'] Oct 30 01:32:46.815066 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:46.815066 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6332a99b-44dd-4c7c-abbe-4bc5779c9f47 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Returning 404 to user: Security group d515fd92-e8d3-4b09-9be9-dc80d5cb0613 does not exist Oct 30 01:32:46.815066 n-d-master-1 devstack@n-api.service[121103]: Neutron server returns request_ids: ['req-4c9517bb-2308-44b2-a7a4-a04bba005bb8'] {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:32:46.815066 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6332a99b-44dd-4c7c-abbe-4bc5779c9f47 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups/d515fd92-e8d3-4b09-9be9-dc80d5cb0613" status: 404 len: 194 microversion: 2.1 time: 0.168556 Oct 30 01:32:46.815066 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2150/4336] 10.222.0.13 () {58 vars in 1269 bytes} [Sun Oct 30 01:32:46 2022] GET /compute/v2.1/os-security-groups/d515fd92-e8d3-4b09-9be9-dc80d5cb0613 => generated 194 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:32:46.824438 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-04f5de9b-7e50-480b-a44c-98e86122a77a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:46.825129 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-04f5de9b-7e50-480b-a44c-98e86122a77a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Failed to fetch instance by id 9223372036854775808 {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 30 01:32:46.825986 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-04f5de9b-7e50-480b-a44c-98e86122a77a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-04f5de9b-7e50-480b-a44c-98e86122a77a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Request method failure captured: Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdPsZZXjRvWKe2zWP-5VH1VYAsWsLLjUmpyob2uINkfAXNLt0qGMmCTWjYn2WpZ3XOOdsuaM4lwk-qZrOIX3mOHzuCJPZ3r-9M-w153XBWLoTow-eSMj1bsAWDNo3KKhMzjHqic8AJ-DcXpdsBh93g0dRB_UMWMRrGyY1cbSRdHJrvg Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 0bce487302c24def8a8473b0725904f2 Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 9223372036854775808 could not be found. Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '9223372036854775808'} Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:46.827443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:32:46.833015 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:32:46.833015 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:32:46.833015 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:32:46.833015 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 30 01:32:46.833015 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:46.833015 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-04f5de9b-7e50-480b-a44c-98e86122a77a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:32:46.833015 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-04f5de9b-7e50-480b-a44c-98e86122a77a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.015900 Oct 30 01:32:46.833837 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2151/4337] 10.222.0.13 () {58 vars in 1188 bytes} [Sun Oct 30 01:32:46 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:32:46.843538 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ec0e1673-4cda-4509-bf8f-5449ff5318e9 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:46.851229 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ec0e1673-4cda-4509-bf8f-5449ff5318e9 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:46.869116 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ec0e1673-4cda-4509-bf8f-5449ff5318e9 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:46.871579 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ec0e1673-4cda-4509-bf8f-5449ff5318e9 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:46.871579 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ec0e1673-4cda-4509-bf8f-5449ff5318e9 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:46.872362 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ec0e1673-4cda-4509-bf8f-5449ff5318e9 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:46.873442 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ec0e1673-4cda-4509-bf8f-5449ff5318e9 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:46.874143 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ec0e1673-4cda-4509-bf8f-5449ff5318e9 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:47.045866 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-87763f30-1872-4fed-bb78-58504d8d16f0 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:47.055114 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-87763f30-1872-4fed-bb78-58504d8d16f0 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers/b36a2df7-45c9-4a51-88f1-e1a1b9c0969d" status: 200 len: 1508 microversion: 2.1 time: 0.701124 Oct 30 01:32:47.063557 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2187/4338] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:46 2022] GET /compute/v2.1/servers/b36a2df7-45c9-4a51-88f1-e1a1b9c0969d => generated 1508 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:47.073369 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d23584a4-ca5c-40ca-b389-80e1c564efff tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '.version_select at 0x7f44c773b040>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:47.276210 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ec0e1673-4cda-4509-bf8f-5449ff5318e9 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:47.287498 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ec0e1673-4cda-4509-bf8f-5449ff5318e9 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e" status: 200 len: 1511 microversion: 2.1 time: 0.449816 Oct 30 01:32:47.289091 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2152/4339] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:46 2022] GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e => generated 1511 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:47.294218 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ff07e77e-6cec-473c-ac13-a4471a3ca60c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:47.294938 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ff07e77e-6cec-473c-ac13-a4471a3ca60c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:47.303871 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ff07e77e-6cec-473c-ac13-a4471a3ca60c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:47.304711 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ff07e77e-6cec-473c-ac13-a4471a3ca60c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:47.305657 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ff07e77e-6cec-473c-ac13-a4471a3ca60c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:47.327395 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ff07e77e-6cec-473c-ac13-a4471a3ca60c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:47.328080 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ff07e77e-6cec-473c-ac13-a4471a3ca60c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:47.328980 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ff07e77e-6cec-473c-ac13-a4471a3ca60c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:47.654920 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ff07e77e-6cec-473c-ac13-a4471a3ca60c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:47.667439 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d23584a4-ca5c-40ca-b389-80e1c564efff tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/e8dc83ef-db9d-4922-b398-521e1595fef6" status: 202 len: 0 microversion: 2.1 time: 0.607635 Oct 30 01:32:47.670406 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ff07e77e-6cec-473c-ac13-a4471a3ca60c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.379786 Oct 30 01:32:47.676990 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2188/4340] 10.222.0.13 () {58 vars in 1272 bytes} [Sun Oct 30 01:32:47 2022] DELETE /compute/v2.1/os-security-groups/e8dc83ef-db9d-4922-b398-521e1595fef6 => generated 0 bytes in 618 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:32:47.686400 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2153/4341] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:47 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:47.691026 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-61810b73-b38a-4d19-8884-6bf57b02d34d req-a3888d1f-a4c8-4280-9aa5-4e723d3e09ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0", "name": "network-vif-deleted", "tag": "b06d8a65-6a4c-4fc9-9c2f-932d1a6b84ab"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:32:47.696886 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e74095d8-81e3-4211-9247-f20ecd4807f9 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:47.697856 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e74095d8-81e3-4211-9247-f20ecd4807f9 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:47.705901 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e74095d8-81e3-4211-9247-f20ecd4807f9 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:47.707434 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e74095d8-81e3-4211-9247-f20ecd4807f9 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:47.708087 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e74095d8-81e3-4211-9247-f20ecd4807f9 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:47.709011 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e74095d8-81e3-4211-9247-f20ecd4807f9 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:47.709670 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e74095d8-81e3-4211-9247-f20ecd4807f9 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:47.710385 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e74095d8-81e3-4211-9247-f20ecd4807f9 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:47.720721 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:47.728154 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-61810b73-b38a-4d19-8884-6bf57b02d34d req-a3888d1f-a4c8-4280-9aa5-4e723d3e09ee service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:47.728645 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-61810b73-b38a-4d19-8884-6bf57b02d34d req-a3888d1f-a4c8-4280-9aa5-4e723d3e09ee service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:47.729067 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-61810b73-b38a-4d19-8884-6bf57b02d34d req-a3888d1f-a4c8-4280-9aa5-4e723d3e09ee service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:47.752935 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-61810b73-b38a-4d19-8884-6bf57b02d34d req-a3888d1f-a4c8-4280-9aa5-4e723d3e09ee service nova] Creating event network-vif-deleted:b06d8a65-6a4c-4fc9-9c2f-932d1a6b84ab for instance 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0 on n-h1-master-1 Oct 30 01:32:47.759274 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-61810b73-b38a-4d19-8884-6bf57b02d34d req-a3888d1f-a4c8-4280-9aa5-4e723d3e09ee service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080662 Oct 30 01:32:47.759887 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2189/4342] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:32:47.772128 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7ddd2d2f-7bee-4829-a217-b0e69b0f5f73 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '.version_select at 0x7f44d04e5d30>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:47.784650 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e74095d8-81e3-4211-9247-f20ecd4807f9 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:47.785143 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e74095d8-81e3-4211-9247-f20ecd4807f9 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:47.785614 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e74095d8-81e3-4211-9247-f20ecd4807f9 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:47.786074 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-e74095d8-81e3-4211-9247-f20ecd4807f9 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lazy-loading 'fault' on Instance uuid 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:32:47.816685 n-d-master-1 devstack@n-api.service[121102]: DEBUG neutronclient.v2_0.client [None req-7ddd2d2f-7bee-4829-a217-b0e69b0f5f73 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e8dc83ef-db9d-4922-b398-521e1595fef6 does not exist", "detail": ""}} {{(pid=121102) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 30 01:32:47.817283 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.security_group_api [None req-7ddd2d2f-7bee-4829-a217-b0e69b0f5f73 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Neutron security group e8dc83ef-db9d-4922-b398-521e1595fef6 not found {{(pid=121102) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 30 01:32:47.817831 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-7ddd2d2f-7bee-4829-a217-b0e69b0f5f73 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] HTTP exception thrown: Security group e8dc83ef-db9d-4922-b398-521e1595fef6 does not exist Oct 30 01:32:47.817831 n-d-master-1 devstack@n-api.service[121102]: Neutron server returns request_ids: ['req-86aa8c81-e784-4954-b09c-317dcd3586bc'] Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7ddd2d2f-7bee-4829-a217-b0e69b0f5f73 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Request method failure captured: Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/os-security-groups/e8dc83ef-db9d-4922-b398-521e1595fef6 HTTP/1.1 Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdQeB_St8oVZOGIJlshgL7-LKQgW_hEcgkwBL7Ks3Cs3DIyiB0pghA7n_e8cKany7LxH4x-CEsUJ-uItmueA0KgQDZXCqg5MHQPsBAlpzbn8cQVEq-NvT-3VnV52LMp-twxBeBnfcoXgkz5UUTyaCNLN3Bidx2JUEEuK5lVXSh3eLx8 Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 09d179276dbf4e4d9cb780b18e7a22c7 Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-SecurityGroupsTestJSON-78265462 Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-SecurityGroupsTestJSON-78265462 Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 09d179276dbf4e4d9cb780b18e7a22c7 Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-78265462 Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-SecurityGroupsTestJSON-78265462-project Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 88ac5422c8f048148aac2c9b62e0482e Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-SecurityGroupsTestJSON-78265462-project Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: method: Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: exception: Security group e8dc83ef-db9d-4922-b398-521e1595fef6 does not exist Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: Neutron server returns request_ids: ['req-86aa8c81-e784-4954-b09c-317dcd3586bc'] Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'e8dc83ef-db9d-4922-b398-521e1595fef6'} Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 30 01:32:47.819791 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e8dc83ef-db9d-4922-b398-521e1595fef6 does not exist Oct 30 01:32:47.823860 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-86aa8c81-e784-4954-b09c-317dcd3586bc'] Oct 30 01:32:47.823860 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:47.823860 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:47.823860 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:47.823860 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:47.823860 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 30 01:32:47.823860 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 30 01:32:47.823860 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 30 01:32:47.823860 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 30 01:32:47.823860 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e8dc83ef-db9d-4922-b398-521e1595fef6 does not exist Oct 30 01:32:47.823860 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-86aa8c81-e784-4954-b09c-317dcd3586bc'] Oct 30 01:32:47.823860 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:47.823860 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:47.823860 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:47.823860 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:47.823860 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:32:47.823860 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:32:47.823860 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:32:47.823860 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:32:47.823860 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:32:47.823860 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:32:47.823860 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:32:47.823860 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:32:47.823860 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 30 01:32:47.823860 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 30 01:32:47.823860 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e8dc83ef-db9d-4922-b398-521e1595fef6 does not exist Oct 30 01:32:47.823860 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-86aa8c81-e784-4954-b09c-317dcd3586bc'] Oct 30 01:32:47.823860 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:47.823860 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:47.823860 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:47.823860 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:47.823860 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:32:47.823860 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:32:47.823860 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:32:47.823860 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:32:47.823860 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e8dc83ef-db9d-4922-b398-521e1595fef6 does not exist Oct 30 01:32:47.823860 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-86aa8c81-e784-4954-b09c-317dcd3586bc'] Oct 30 01:32:47.823860 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:47.826830 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7ddd2d2f-7bee-4829-a217-b0e69b0f5f73 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Returning 404 to user: Security group e8dc83ef-db9d-4922-b398-521e1595fef6 does not exist Oct 30 01:32:47.826830 n-d-master-1 devstack@n-api.service[121102]: Neutron server returns request_ids: ['req-86aa8c81-e784-4954-b09c-317dcd3586bc'] {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:32:47.827899 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7ddd2d2f-7bee-4829-a217-b0e69b0f5f73 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups/e8dc83ef-db9d-4922-b398-521e1595fef6" status: 404 len: 194 microversion: 2.1 time: 0.060787 Oct 30 01:32:47.827899 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2190/4343] 10.222.0.13 () {58 vars in 1269 bytes} [Sun Oct 30 01:32:47 2022] GET /compute/v2.1/os-security-groups/e8dc83ef-db9d-4922-b398-521e1595fef6 => generated 194 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:32:47.835096 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-85a08c28-d7a2-462f-967e-fd63bbd17e2e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:47.835096 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-85a08c28-d7a2-462f-967e-fd63bbd17e2e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:47.840676 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-85a08c28-d7a2-462f-967e-fd63bbd17e2e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:47.841165 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-85a08c28-d7a2-462f-967e-fd63bbd17e2e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:47.841631 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-85a08c28-d7a2-462f-967e-fd63bbd17e2e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:47.842337 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-85a08c28-d7a2-462f-967e-fd63bbd17e2e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:47.842790 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-85a08c28-d7a2-462f-967e-fd63bbd17e2e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:47.843210 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-85a08c28-d7a2-462f-967e-fd63bbd17e2e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:47.863942 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e74095d8-81e3-4211-9247-f20ecd4807f9 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:47.873272 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e74095d8-81e3-4211-9247-f20ecd4807f9 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0" status: 200 len: 1336 microversion: 2.1 time: 0.185269 Oct 30 01:32:47.874261 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2154/4344] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:47 2022] GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0 => generated 1336 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:47.879331 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-673ab0ae-89a2-43cc-9673-fa94d6e65035 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '.version_select at 0x7f44cc4f08b0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:48.405717 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-85a08c28-d7a2-462f-967e-fd63bbd17e2e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:48.416663 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-85a08c28-d7a2-462f-967e-fd63bbd17e2e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.587665 Oct 30 01:32:48.418268 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2191/4345] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:47 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:48.431869 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c334f9b1-0811-4859-8efb-ee0e9b3125c0 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:48.432708 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c334f9b1-0811-4859-8efb-ee0e9b3125c0 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: b36a2df7-45c9-4a51-88f1-e1a1b9c0969d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:48.442359 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c334f9b1-0811-4859-8efb-ee0e9b3125c0 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:48.443062 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c334f9b1-0811-4859-8efb-ee0e9b3125c0 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:48.443643 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c334f9b1-0811-4859-8efb-ee0e9b3125c0 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:48.444496 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c334f9b1-0811-4859-8efb-ee0e9b3125c0 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:48.445259 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c334f9b1-0811-4859-8efb-ee0e9b3125c0 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:48.446405 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c334f9b1-0811-4859-8efb-ee0e9b3125c0 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:48.729768 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c334f9b1-0811-4859-8efb-ee0e9b3125c0 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:48.738732 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c334f9b1-0811-4859-8efb-ee0e9b3125c0 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers/b36a2df7-45c9-4a51-88f1-e1a1b9c0969d" status: 200 len: 1508 microversion: 2.1 time: 0.317844 Oct 30 01:32:48.749974 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2192/4346] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:48 2022] GET /compute/v2.1/servers/b36a2df7-45c9-4a51-88f1-e1a1b9c0969d => generated 1508 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:48.761830 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-053819c8-3808-45a4-a2ea-b9ee2987fe69 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:48.763165 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-053819c8-3808-45a4-a2ea-b9ee2987fe69 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:48.769562 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-053819c8-3808-45a4-a2ea-b9ee2987fe69 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:48.770222 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-053819c8-3808-45a4-a2ea-b9ee2987fe69 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:48.770659 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-053819c8-3808-45a4-a2ea-b9ee2987fe69 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:48.771360 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-053819c8-3808-45a4-a2ea-b9ee2987fe69 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:48.771820 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-053819c8-3808-45a4-a2ea-b9ee2987fe69 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:48.772238 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-053819c8-3808-45a4-a2ea-b9ee2987fe69 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:48.842308 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-673ab0ae-89a2-43cc-9673-fa94d6e65035 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/a126733b-c415-4ab2-ab30-f4e2165e898a" status: 202 len: 0 microversion: 2.1 time: 0.966928 Oct 30 01:32:48.846192 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2155/4347] 10.222.0.13 () {58 vars in 1272 bytes} [Sun Oct 30 01:32:47 2022] DELETE /compute/v2.1/os-security-groups/a126733b-c415-4ab2-ab30-f4e2165e898a => generated 0 bytes in 971 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:32:48.851254 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-48c4ce14-7d69-453c-9163-cc305c2d00d0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:48.852019 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-48c4ce14-7d69-453c-9163-cc305c2d00d0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Failed to fetch instance by id -1 {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 30 01:32:48.852683 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-48c4ce14-7d69-453c-9163-cc305c2d00d0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] HTTP exception thrown: Instance -1 could not be found. Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-48c4ce14-7d69-453c-9163-cc305c2d00d0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Request method failure captured: Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdPsZZXjRvWKe2zWP-5VH1VYAsWsLLjUmpyob2uINkfAXNLt0qGMmCTWjYn2WpZ3XOOdsuaM4lwk-qZrOIX3mOHzuCJPZ3r-9M-w153XBWLoTow-eSMj1bsAWDNo3KKhMzjHqic8AJ-DcXpdsBh93g0dRB_UMWMRrGyY1cbSRdHJrvg Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 0bce487302c24def8a8473b0725904f2 Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: exception: Instance -1 could not be found. Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '-1'} Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:32:48.854340 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:32:48.858762 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:32:48.858762 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:32:48.858762 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 30 01:32:48.858762 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:48.863570 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-48c4ce14-7d69-453c-9163-cc305c2d00d0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Returning 404 to user: Instance -1 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:32:48.865008 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-48c4ce14-7d69-453c-9163-cc305c2d00d0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.017476 Oct 30 01:32:48.866436 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2156/4348] 10.222.0.13 () {58 vars in 1137 bytes} [Sun Oct 30 01:32:48 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:32:48.873119 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5bfe8e97-4d16-429a-bc24-d175e813b427 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '.version_select at 0x7f44cc354f70>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:48.926138 n-d-master-1 devstack@n-api.service[121103]: DEBUG neutronclient.v2_0.client [None req-5bfe8e97-4d16-429a-bc24-d175e813b427 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a126733b-c415-4ab2-ab30-f4e2165e898a does not exist", "detail": ""}} {{(pid=121103) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 30 01:32:48.927034 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.security_group_api [None req-5bfe8e97-4d16-429a-bc24-d175e813b427 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Neutron security group a126733b-c415-4ab2-ab30-f4e2165e898a not found {{(pid=121103) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 30 01:32:48.927571 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-5bfe8e97-4d16-429a-bc24-d175e813b427 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] HTTP exception thrown: Security group a126733b-c415-4ab2-ab30-f4e2165e898a does not exist Oct 30 01:32:48.927571 n-d-master-1 devstack@n-api.service[121103]: Neutron server returns request_ids: ['req-2de6e167-a149-47f0-975a-f9c4c6363a53'] Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5bfe8e97-4d16-429a-bc24-d175e813b427 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Request method failure captured: Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/os-security-groups/a126733b-c415-4ab2-ab30-f4e2165e898a HTTP/1.1 Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdQeB_St8oVZOGIJlshgL7-LKQgW_hEcgkwBL7Ks3Cs3DIyiB0pghA7n_e8cKany7LxH4x-CEsUJ-uItmueA0KgQDZXCqg5MHQPsBAlpzbn8cQVEq-NvT-3VnV52LMp-twxBeBnfcoXgkz5UUTyaCNLN3Bidx2JUEEuK5lVXSh3eLx8 Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 09d179276dbf4e4d9cb780b18e7a22c7 Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-SecurityGroupsTestJSON-78265462 Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-SecurityGroupsTestJSON-78265462 Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 09d179276dbf4e4d9cb780b18e7a22c7 Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-78265462 Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-SecurityGroupsTestJSON-78265462-project Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 88ac5422c8f048148aac2c9b62e0482e Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-SecurityGroupsTestJSON-78265462-project Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: method: Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: exception: Security group a126733b-c415-4ab2-ab30-f4e2165e898a does not exist Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: Neutron server returns request_ids: ['req-2de6e167-a149-47f0-975a-f9c4c6363a53'] Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'a126733b-c415-4ab2-ab30-f4e2165e898a'} Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 30 01:32:48.929499 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a126733b-c415-4ab2-ab30-f4e2165e898a does not exist Oct 30 01:32:48.933327 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2de6e167-a149-47f0-975a-f9c4c6363a53'] Oct 30 01:32:48.933327 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:48.933327 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:48.933327 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:48.933327 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:48.933327 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 30 01:32:48.933327 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 30 01:32:48.933327 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 30 01:32:48.933327 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 30 01:32:48.933327 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a126733b-c415-4ab2-ab30-f4e2165e898a does not exist Oct 30 01:32:48.933327 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2de6e167-a149-47f0-975a-f9c4c6363a53'] Oct 30 01:32:48.933327 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:48.933327 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:48.933327 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:48.933327 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:48.933327 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:32:48.933327 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:32:48.933327 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:32:48.933327 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:32:48.933327 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:32:48.933327 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:32:48.933327 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:32:48.933327 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:32:48.933327 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 30 01:32:48.933327 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 30 01:32:48.933327 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a126733b-c415-4ab2-ab30-f4e2165e898a does not exist Oct 30 01:32:48.933327 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2de6e167-a149-47f0-975a-f9c4c6363a53'] Oct 30 01:32:48.933327 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:48.933327 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:48.933327 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:48.933327 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:48.933327 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:32:48.933327 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:32:48.933327 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:32:48.933327 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:32:48.933327 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a126733b-c415-4ab2-ab30-f4e2165e898a does not exist Oct 30 01:32:48.933327 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2de6e167-a149-47f0-975a-f9c4c6363a53'] Oct 30 01:32:48.933327 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:48.933327 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5bfe8e97-4d16-429a-bc24-d175e813b427 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Returning 404 to user: Security group a126733b-c415-4ab2-ab30-f4e2165e898a does not exist Oct 30 01:32:48.933327 n-d-master-1 devstack@n-api.service[121103]: Neutron server returns request_ids: ['req-2de6e167-a149-47f0-975a-f9c4c6363a53'] {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:32:48.933327 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5bfe8e97-4d16-429a-bc24-d175e813b427 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups/a126733b-c415-4ab2-ab30-f4e2165e898a" status: 404 len: 194 microversion: 2.1 time: 0.063289 Oct 30 01:32:48.933327 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2157/4349] 10.222.0.13 () {58 vars in 1269 bytes} [Sun Oct 30 01:32:48 2022] GET /compute/v2.1/os-security-groups/a126733b-c415-4ab2-ab30-f4e2165e898a => generated 194 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:32:48.940455 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9e6a13c5-794e-4af1-9a52-72220fe0ffbc tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:48.940455 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9e6a13c5-794e-4af1-9a52-72220fe0ffbc tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:48.946326 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e6a13c5-794e-4af1-9a52-72220fe0ffbc tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:48.946822 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e6a13c5-794e-4af1-9a52-72220fe0ffbc tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:48.947264 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e6a13c5-794e-4af1-9a52-72220fe0ffbc tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:48.947975 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e6a13c5-794e-4af1-9a52-72220fe0ffbc tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:48.948986 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e6a13c5-794e-4af1-9a52-72220fe0ffbc tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:48.949442 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e6a13c5-794e-4af1-9a52-72220fe0ffbc tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:49.072749 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-053819c8-3808-45a4-a2ea-b9ee2987fe69 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:49.081189 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-053819c8-3808-45a4-a2ea-b9ee2987fe69 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e" status: 200 len: 1511 microversion: 2.1 time: 0.329798 Oct 30 01:32:49.082060 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2193/4350] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:48 2022] GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e => generated 1511 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:49.086371 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-25233a86-f39b-448d-8870-ee552e11dc22 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:49.086975 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-25233a86-f39b-448d-8870-ee552e11dc22 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:49.092844 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25233a86-f39b-448d-8870-ee552e11dc22 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:49.093387 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25233a86-f39b-448d-8870-ee552e11dc22 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:49.094262 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25233a86-f39b-448d-8870-ee552e11dc22 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:49.094950 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25233a86-f39b-448d-8870-ee552e11dc22 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:49.095461 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25233a86-f39b-448d-8870-ee552e11dc22 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:49.096060 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25233a86-f39b-448d-8870-ee552e11dc22 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:49.110567 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-25233a86-f39b-448d-8870-ee552e11dc22 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] HTTP exception thrown: Instance 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0 could not be found. Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-25233a86-f39b-448d-8870-ee552e11dc22 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Request method failure captured: Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0 HTTP/1.1 Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdMpBfA6mq8oavinMeTyaurexihmj6JmnnP2ZZndb1MXJnyLYJP1lh9IAGUFmytWgjEkCc6rHAh1wpEFldWPgYBauossNbR0UQldGfx9XACde0J5etDs6i2phO_G-HCGpqKWqFyqD3FJkTb44yZ7CHZV6U0ZtcSE1Hf7lvcXbJ_Lvp0 Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 470e235fb35840828d9a86028b72f5de Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-909936776 Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/470e235fb35840828d9a86028b72f5de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_470e235fb35840828d9a86028b72f5de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/470e235fb35840828d9a86028b72f5de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/470e235fb35840828d9a86028b72f5de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServerRescueNegativeTestJSON-909936776 Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 470e235fb35840828d9a86028b72f5de Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-909936776 Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServerRescueNegativeTestJSON-909936776-project Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 6134c05549f14bc19962acea9c913f53 Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServerRescueNegativeTestJSON-909936776-project Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0 could not be found. Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0'} Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0 could not be found. Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0 could not be found. Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:49.112278 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:49.119137 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:49.119137 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:49.119137 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:32:49.119137 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:32:49.119137 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:32:49.119137 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:32:49.119137 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0 could not be found. Oct 30 01:32:49.119137 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:32:49.119137 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-25233a86-f39b-448d-8870-ee552e11dc22 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Returning 404 to user: Instance 9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:32:49.119137 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-25233a86-f39b-448d-8870-ee552e11dc22 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0" status: 404 len: 111 microversion: 2.1 time: 0.031852 Oct 30 01:32:49.119137 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2194/4351] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:49 2022] GET /compute/v2.1/servers/9fbcdadd-cc1e-401c-a7aa-dbf03ca2c4d0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:32:49.121073 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8ac8b0a9-8ef3-4fb5-beec-352d2d699869 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '.version_select at 0x7f44c7624ca0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:49.132678 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9e6a13c5-794e-4af1-9a52-72220fe0ffbc tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:49.142360 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9e6a13c5-794e-4af1-9a52-72220fe0ffbc tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.206846 Oct 30 01:32:49.143305 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2158/4352] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:48 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:49.150592 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-419a7f4e-570f-43bc-8716-2a8ef7c97df1 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '.version_select at 0x7f44cc354040>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:49.241902 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-419a7f4e-570f-43bc-8716-2a8ef7c97df1 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1368801132" status: 202 len: 0 microversion: 2.1 time: 0.097027 Oct 30 01:32:49.246656 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2159/4353] 10.222.0.13 () {58 vars in 1221 bytes} [Sun Oct 30 01:32:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1368801132 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:32:49.252911 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-15d63ece-f809-4086-9ee3-0328d51bfcb2 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:49.254227 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-15d63ece-f809-4086-9ee3-0328d51bfcb2 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:49.260914 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-15d63ece-f809-4086-9ee3-0328d51bfcb2 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:49.261535 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-15d63ece-f809-4086-9ee3-0328d51bfcb2 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:49.262065 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-15d63ece-f809-4086-9ee3-0328d51bfcb2 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:49.262842 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-15d63ece-f809-4086-9ee3-0328d51bfcb2 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:49.263369 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-15d63ece-f809-4086-9ee3-0328d51bfcb2 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:49.264491 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-15d63ece-f809-4086-9ee3-0328d51bfcb2 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:49.473532 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8ac8b0a9-8ef3-4fb5-beec-352d2d699869 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.357010 Oct 30 01:32:49.474132 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2195/4354] 10.222.0.13 () {58 vars in 1158 bytes} [Sun Oct 30 01:32:49 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:49.477485 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-15d63ece-f809-4086-9ee3-0328d51bfcb2 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:49.486719 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-15d63ece-f809-4086-9ee3-0328d51bfcb2 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.238536 Oct 30 01:32:49.487479 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2160/4355] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:49 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:49.491572 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-289a3422-29ae-426d-9441-5f03afccf76f tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Action: 'create', calling method: .version_select at 0x7f44c73f8ca0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-366630624", "description": "tempest-description-1236080537"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:32:49.511691 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c7dd89f1-8164-42de-871b-833d9641325a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:32:49.520581 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c7dd89f1-8164-42de-871b-833d9641325a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: 5fd7c6e9-dbaa-4942-884b-f3dd2c3c3ed5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:49.520581 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-c7dd89f1-8164-42de-871b-833d9641325a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] HTTP exception thrown: Instance 5fd7c6e9-dbaa-4942-884b-f3dd2c3c3ed5 could not be found. Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c7dd89f1-8164-42de-871b-833d9641325a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Request method failure captured: Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: request: POST /compute/v2.1/servers/5fd7c6e9-dbaa-4942-884b-f3dd2c3c3ed5/action HTTP/1.1 Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 19 Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdPsZZXjRvWKe2zWP-5VH1VYAsWsLLjUmpyob2uINkfAXNLt0qGMmCTWjYn2WpZ3XOOdsuaM4lwk-qZrOIX3mOHzuCJPZ3r-9M-w153XBWLoTow-eSMj1bsAWDNo3KKhMzjHqic8AJ-DcXpdsBh93g0dRB_UMWMRrGyY1cbSRdHJrvg Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 0bce487302c24def8a8473b0725904f2 Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: {"forceDelete": {}} Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 5fd7c6e9-dbaa-4942-884b-f3dd2c3c3ed5 could not be found. Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '5fd7c6e9-dbaa-4942-884b-f3dd2c3c3ed5', 'body': {'forceDelete': {}}} Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fd7c6e9-dbaa-4942-884b-f3dd2c3c3ed5 could not be found. Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fd7c6e9-dbaa-4942-884b-f3dd2c3c3ed5 could not be found. Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:32:49.526380 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:32:49.529928 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:32:49.529928 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:32:49.529928 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fd7c6e9-dbaa-4942-884b-f3dd2c3c3ed5 could not be found. Oct 30 01:32:49.529928 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:49.533574 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c7dd89f1-8164-42de-871b-833d9641325a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Returning 404 to user: Instance 5fd7c6e9-dbaa-4942-884b-f3dd2c3c3ed5 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:32:49.534706 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c7dd89f1-8164-42de-871b-833d9641325a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "POST /compute/v2.1/servers/5fd7c6e9-dbaa-4942-884b-f3dd2c3c3ed5/action" status: 404 len: 111 microversion: 2.1 time: 0.027299 Oct 30 01:32:49.535472 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2161/4356] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:32:49 2022] POST /compute/v2.1/servers/5fd7c6e9-dbaa-4942-884b-f3dd2c3c3ed5/action => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 01:32:49.545139 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6cc97ee6-a156-48c8-8b2e-df3ffb802ca0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:49.546028 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6cc97ee6-a156-48c8-8b2e-df3ffb802ca0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:49.554697 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6cc97ee6-a156-48c8-8b2e-df3ffb802ca0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:49.555219 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6cc97ee6-a156-48c8-8b2e-df3ffb802ca0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:49.555643 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6cc97ee6-a156-48c8-8b2e-df3ffb802ca0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:49.556375 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6cc97ee6-a156-48c8-8b2e-df3ffb802ca0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:49.556867 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6cc97ee6-a156-48c8-8b2e-df3ffb802ca0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:49.557296 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6cc97ee6-a156-48c8-8b2e-df3ffb802ca0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:49.943124 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6cc97ee6-a156-48c8-8b2e-df3ffb802ca0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:49.952921 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6cc97ee6-a156-48c8-8b2e-df3ffb802ca0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.412897 Oct 30 01:32:49.953642 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2162/4357] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:49 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:49.959175 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4f315884-2a36-49ce-b337-e3a30ec99daa tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:49.959859 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4f315884-2a36-49ce-b337-e3a30ec99daa tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: b36a2df7-45c9-4a51-88f1-e1a1b9c0969d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:49.966374 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4f315884-2a36-49ce-b337-e3a30ec99daa tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:49.967191 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4f315884-2a36-49ce-b337-e3a30ec99daa tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:49.968925 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4f315884-2a36-49ce-b337-e3a30ec99daa tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:49.968925 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4f315884-2a36-49ce-b337-e3a30ec99daa tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:49.969403 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4f315884-2a36-49ce-b337-e3a30ec99daa tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:49.970206 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4f315884-2a36-49ce-b337-e3a30ec99daa tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:50.185044 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-289a3422-29ae-426d-9441-5f03afccf76f tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.697871 Oct 30 01:32:50.194388 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2196/4358] 10.222.0.13 () {60 vars in 1180 bytes} [Sun Oct 30 01:32:49 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:32:50.200402 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-657773c2-3a85-4a3d-b096-4eb3d471840a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:50.201036 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-657773c2-3a85-4a3d-b096-4eb3d471840a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:50.208783 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-657773c2-3a85-4a3d-b096-4eb3d471840a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:50.209645 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-657773c2-3a85-4a3d-b096-4eb3d471840a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:50.210399 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-657773c2-3a85-4a3d-b096-4eb3d471840a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:50.211376 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-657773c2-3a85-4a3d-b096-4eb3d471840a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:50.211952 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-657773c2-3a85-4a3d-b096-4eb3d471840a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:50.212452 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-657773c2-3a85-4a3d-b096-4eb3d471840a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:50.229302 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:50.270212 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4f315884-2a36-49ce-b337-e3a30ec99daa tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:50.280386 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4f315884-2a36-49ce-b337-e3a30ec99daa tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers/b36a2df7-45c9-4a51-88f1-e1a1b9c0969d" status: 200 len: 1512 microversion: 2.1 time: 0.325217 Oct 30 01:32:50.282038 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2163/4359] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:49 2022] GET /compute/v2.1/servers/b36a2df7-45c9-4a51-88f1-e1a1b9c0969d => generated 1512 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:50.287143 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-410cb723-c311-4d31-abc9-7bda31f28a44 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:50.288207 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-410cb723-c311-4d31-abc9-7bda31f28a44 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:50.295221 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-410cb723-c311-4d31-abc9-7bda31f28a44 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:50.297031 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-410cb723-c311-4d31-abc9-7bda31f28a44 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:50.297746 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-410cb723-c311-4d31-abc9-7bda31f28a44 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:50.298783 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-410cb723-c311-4d31-abc9-7bda31f28a44 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:50.299443 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-410cb723-c311-4d31-abc9-7bda31f28a44 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:50.300132 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-410cb723-c311-4d31-abc9-7bda31f28a44 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:50.457898 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-657773c2-3a85-4a3d-b096-4eb3d471840a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:50.466404 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-657773c2-3a85-4a3d-b096-4eb3d471840a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.270829 Oct 30 01:32:50.467390 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2197/4360] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:50 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:50.472369 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7efa8974-7752-4b28-82f3-77e8dde6fad5 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Action: 'create', calling method: .version_select at 0x7f44c768ba60>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1124040104", "description": "tempest-description-1989056379"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:32:50.498185 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-410cb723-c311-4d31-abc9-7bda31f28a44 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:50.507812 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-410cb723-c311-4d31-abc9-7bda31f28a44 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e" status: 200 len: 1511 microversion: 2.1 time: 0.224537 Oct 30 01:32:50.508396 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2164/4361] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:50 2022] GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e => generated 1511 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:50.514493 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-06923824-c6b5-4c18-b287-e91ac3ba04ea tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:50.520933 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-06923824-c6b5-4c18-b287-e91ac3ba04ea tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:50.521637 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.compute.servers [None req-06923824-c6b5-4c18-b287-e91ac3ba04ea tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Removing options 'limit' from query {{(pid=121103) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 30 01:32:50.522702 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-06923824-c6b5-4c18-b287-e91ac3ba04ea tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Searching by: {'deleted': False, 'project_id': '8b25b290c8004e1f8f89e17b448f242a'} {{(pid=121103) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 30 01:32:50.524071 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-06923824-c6b5-4c18-b287-e91ac3ba04ea tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:50.524920 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-06923824-c6b5-4c18-b287-e91ac3ba04ea tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:50.525621 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-06923824-c6b5-4c18-b287-e91ac3ba04ea tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:50.526466 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-06923824-c6b5-4c18-b287-e91ac3ba04ea tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:50.527001 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-06923824-c6b5-4c18-b287-e91ac3ba04ea tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:50.527491 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-06923824-c6b5-4c18-b287-e91ac3ba04ea tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:50.529488 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-06923824-c6b5-4c18-b287-e91ac3ba04ea tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.019628 Oct 30 01:32:50.530159 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2165/4362] 10.222.0.13 () {58 vars in 1140 bytes} [Sun Oct 30 01:32:50 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:32:50.535118 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3d7de264-f19a-42ac-903e-575bcd925584 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:32:50.537599 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3d7de264-f19a-42ac-903e-575bcd925584 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: 4664c2ed-979c-4fb4-afd6-11fcc03add4c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:50.544101 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-3d7de264-f19a-42ac-903e-575bcd925584 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] HTTP exception thrown: Instance 4664c2ed-979c-4fb4-afd6-11fcc03add4c could not be found. Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3d7de264-f19a-42ac-903e-575bcd925584 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Request method failure captured: Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: request: POST /compute/v2.1/servers/4664c2ed-979c-4fb4-afd6-11fcc03add4c/action HTTP/1.1 Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 39 Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdPsZZXjRvWKe2zWP-5VH1VYAsWsLLjUmpyob2uINkfAXNLt0qGMmCTWjYn2WpZ3XOOdsuaM4lwk-qZrOIX3mOHzuCJPZ3r-9M-w153XBWLoTow-eSMj1bsAWDNo3KKhMzjHqic8AJ-DcXpdsBh93g0dRB_UMWMRrGyY1cbSRdHJrvg Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 0bce487302c24def8a8473b0725904f2 Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: {"os-getConsoleOutput": {"length": 10}} Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 4664c2ed-979c-4fb4-afd6-11fcc03add4c could not be found. Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '4664c2ed-979c-4fb4-afd6-11fcc03add4c', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4664c2ed-979c-4fb4-afd6-11fcc03add4c could not be found. Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4664c2ed-979c-4fb4-afd6-11fcc03add4c could not be found. Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:50.554544 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:50.558676 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:32:50.558676 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:32:50.558676 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:32:50.558676 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:32:50.558676 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4664c2ed-979c-4fb4-afd6-11fcc03add4c could not be found. Oct 30 01:32:50.558676 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:50.558676 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3d7de264-f19a-42ac-903e-575bcd925584 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Returning 404 to user: Instance 4664c2ed-979c-4fb4-afd6-11fcc03add4c could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:32:50.558676 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3d7de264-f19a-42ac-903e-575bcd925584 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "POST /compute/v2.1/servers/4664c2ed-979c-4fb4-afd6-11fcc03add4c/action" status: 404 len: 111 microversion: 2.1 time: 0.024790 Oct 30 01:32:50.558676 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2166/4363] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:32:50 2022] POST /compute/v2.1/servers/4664c2ed-979c-4fb4-afd6-11fcc03add4c/action => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:32:50.564236 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f84e60ce-2f12-4d66-a284-cb8e7f9fa7dc tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:50.564927 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f84e60ce-2f12-4d66-a284-cb8e7f9fa7dc tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: b36a2df7-45c9-4a51-88f1-e1a1b9c0969d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:50.571042 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f84e60ce-2f12-4d66-a284-cb8e7f9fa7dc tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:50.576606 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f84e60ce-2f12-4d66-a284-cb8e7f9fa7dc tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:50.576606 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f84e60ce-2f12-4d66-a284-cb8e7f9fa7dc tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:50.576606 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f84e60ce-2f12-4d66-a284-cb8e7f9fa7dc tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:50.576606 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f84e60ce-2f12-4d66-a284-cb8e7f9fa7dc tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:50.576606 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f84e60ce-2f12-4d66-a284-cb8e7f9fa7dc tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:50.791678 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f84e60ce-2f12-4d66-a284-cb8e7f9fa7dc tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:50.800428 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f84e60ce-2f12-4d66-a284-cb8e7f9fa7dc tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers/b36a2df7-45c9-4a51-88f1-e1a1b9c0969d" status: 200 len: 1512 microversion: 2.1 time: 0.242802 Oct 30 01:32:50.800997 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2167/4364] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:50 2022] GET /compute/v2.1/servers/b36a2df7-45c9-4a51-88f1-e1a1b9c0969d => generated 1512 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:50.806005 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9631b5e3-27d4-4e1e-abb8-bc2f61c5d468 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:50.806610 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9631b5e3-27d4-4e1e-abb8-bc2f61c5d468 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:50.813226 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9631b5e3-27d4-4e1e-abb8-bc2f61c5d468 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:50.813740 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9631b5e3-27d4-4e1e-abb8-bc2f61c5d468 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:50.814467 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9631b5e3-27d4-4e1e-abb8-bc2f61c5d468 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:50.815242 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9631b5e3-27d4-4e1e-abb8-bc2f61c5d468 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:50.815780 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9631b5e3-27d4-4e1e-abb8-bc2f61c5d468 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:50.816261 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9631b5e3-27d4-4e1e-abb8-bc2f61c5d468 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:51.008678 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9631b5e3-27d4-4e1e-abb8-bc2f61c5d468 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:51.016315 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9631b5e3-27d4-4e1e-abb8-bc2f61c5d468 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.214314 Oct 30 01:32:51.016967 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2168/4365] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:50 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:51.025553 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-21fa8627-3275-4714-aeaa-c6faefc04e10 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:51.026350 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-21fa8627-3275-4714-aeaa-c6faefc04e10 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: 6573b259-e50d-4954-9d64-3c914df97308] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:51.032748 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21fa8627-3275-4714-aeaa-c6faefc04e10 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:51.033473 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21fa8627-3275-4714-aeaa-c6faefc04e10 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:51.033967 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21fa8627-3275-4714-aeaa-c6faefc04e10 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:51.034880 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21fa8627-3275-4714-aeaa-c6faefc04e10 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:51.035518 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21fa8627-3275-4714-aeaa-c6faefc04e10 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:51.036141 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21fa8627-3275-4714-aeaa-c6faefc04e10 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:51.041387 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:51.047379 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7efa8974-7752-4b28-82f3-77e8dde6fad5 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.576900 Oct 30 01:32:51.062358 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2198/4366] 10.222.0.13 () {60 vars in 1180 bytes} [Sun Oct 30 01:32:50 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:32:51.070070 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-773c2dfa-507a-4595-be33-c77ca5e58180 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:51.071234 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-773c2dfa-507a-4595-be33-c77ca5e58180 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:51.078930 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-773c2dfa-507a-4595-be33-c77ca5e58180 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:51.079725 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-773c2dfa-507a-4595-be33-c77ca5e58180 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:51.080339 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-773c2dfa-507a-4595-be33-c77ca5e58180 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:51.081372 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-773c2dfa-507a-4595-be33-c77ca5e58180 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:51.082285 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-773c2dfa-507a-4595-be33-c77ca5e58180 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:51.082918 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-773c2dfa-507a-4595-be33-c77ca5e58180 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:51.355871 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-21fa8627-3275-4714-aeaa-c6faefc04e10 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:51.361598 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-773c2dfa-507a-4595-be33-c77ca5e58180 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:51.386456 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-773c2dfa-507a-4595-be33-c77ca5e58180 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.322360 Oct 30 01:32:51.387637 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-21fa8627-3275-4714-aeaa-c6faefc04e10 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers/6573b259-e50d-4954-9d64-3c914df97308" status: 200 len: 1513 microversion: 2.1 time: 0.369405 Oct 30 01:32:51.389467 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2169/4367] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:51 2022] GET /compute/v2.1/servers/6573b259-e50d-4954-9d64-3c914df97308 => generated 1513 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:51.393561 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2199/4368] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:51 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:51.407658 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-279e5292-85ee-42a0-aeea-0abe1000348f tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1356834859", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "1d83094d-6a79-404b-851b-d6ff42d15fb0"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:32:51.415118 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-77e8426e-c1cd-4dda-ae9d-a118b677a4f5 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:51.416191 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-77e8426e-c1cd-4dda-ae9d-a118b677a4f5 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: 86461b51-bd22-446e-a37e-985c21f7ccd5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:51.438817 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-77e8426e-c1cd-4dda-ae9d-a118b677a4f5 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:51.441911 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-77e8426e-c1cd-4dda-ae9d-a118b677a4f5 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:51.442522 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-77e8426e-c1cd-4dda-ae9d-a118b677a4f5 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:51.444522 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-77e8426e-c1cd-4dda-ae9d-a118b677a4f5 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:51.446509 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-77e8426e-c1cd-4dda-ae9d-a118b677a4f5 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:51.448188 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-77e8426e-c1cd-4dda-ae9d-a118b677a4f5 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:51.507034 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-279e5292-85ee-42a0-aeea-0abe1000348f tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] validate_networks() for [('1d83094d-6a79-404b-851b-d6ff42d15fb0', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:32:51.748876 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-77e8426e-c1cd-4dda-ae9d-a118b677a4f5 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:51.762353 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-77e8426e-c1cd-4dda-ae9d-a118b677a4f5 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers/86461b51-bd22-446e-a37e-985c21f7ccd5" status: 200 len: 1512 microversion: 2.1 time: 0.355664 Oct 30 01:32:51.763590 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2170/4369] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:51 2022] GET /compute/v2.1/servers/86461b51-bd22-446e-a37e-985c21f7ccd5 => generated 1512 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:32:51.769102 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e8734790-20fb-464b-89f2-2937c80220ed tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:51.770104 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e8734790-20fb-464b-89f2-2937c80220ed tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: 2742e239-47dd-4a5e-a15e-39ba2e215e49] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:51.775958 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-e8734790-20fb-464b-89f2-2937c80220ed tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] HTTP exception thrown: Instance 2742e239-47dd-4a5e-a15e-39ba2e215e49 could not be found. Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e8734790-20fb-464b-89f2-2937c80220ed tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Request method failure captured: Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/2742e239-47dd-4a5e-a15e-39ba2e215e49 HTTP/1.1 Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdPsZZXjRvWKe2zWP-5VH1VYAsWsLLjUmpyob2uINkfAXNLt0qGMmCTWjYn2WpZ3XOOdsuaM4lwk-qZrOIX3mOHzuCJPZ3r-9M-w153XBWLoTow-eSMj1bsAWDNo3KKhMzjHqic8AJ-DcXpdsBh93g0dRB_UMWMRrGyY1cbSRdHJrvg Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 0bce487302c24def8a8473b0725904f2 Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 2742e239-47dd-4a5e-a15e-39ba2e215e49 could not be found. Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '2742e239-47dd-4a5e-a15e-39ba2e215e49'} Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2742e239-47dd-4a5e-a15e-39ba2e215e49 could not be found. Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2742e239-47dd-4a5e-a15e-39ba2e215e49 could not be found. Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:51.779098 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:32:51.782613 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:32:51.782613 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:32:51.782613 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:32:51.782613 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2742e239-47dd-4a5e-a15e-39ba2e215e49 could not be found. Oct 30 01:32:51.782613 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:51.784385 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e8734790-20fb-464b-89f2-2937c80220ed tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Returning 404 to user: Instance 2742e239-47dd-4a5e-a15e-39ba2e215e49 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:32:51.785516 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e8734790-20fb-464b-89f2-2937c80220ed tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/2742e239-47dd-4a5e-a15e-39ba2e215e49" status: 404 len: 111 microversion: 2.1 time: 0.020733 Oct 30 01:32:51.786304 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2171/4370] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:51 2022] GET /compute/v2.1/servers/2742e239-47dd-4a5e-a15e-39ba2e215e49 => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:32:51.792961 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-62b66b37-ea43-41c7-8acf-cac1dee1aa71 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:51.793866 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-62b66b37-ea43-41c7-8acf-cac1dee1aa71 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:51.802702 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-62b66b37-ea43-41c7-8acf-cac1dee1aa71 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:51.803542 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-62b66b37-ea43-41c7-8acf-cac1dee1aa71 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:51.804214 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-62b66b37-ea43-41c7-8acf-cac1dee1aa71 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:51.805230 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-62b66b37-ea43-41c7-8acf-cac1dee1aa71 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:51.805952 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-62b66b37-ea43-41c7-8acf-cac1dee1aa71 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:51.806570 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-62b66b37-ea43-41c7-8acf-cac1dee1aa71 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:52.105543 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-62b66b37-ea43-41c7-8acf-cac1dee1aa71 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:52.121292 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-62b66b37-ea43-41c7-8acf-cac1dee1aa71 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e" status: 200 len: 1511 microversion: 2.1 time: 0.332071 Oct 30 01:32:52.135078 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2172/4371] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:51 2022] GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e => generated 1511 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:52.145374 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-279e5292-85ee-42a0-aeea-0abe1000348f tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:32:52.146154 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-279e5292-85ee-42a0-aeea-0abe1000348f tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:32:52.146734 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-279e5292-85ee-42a0-aeea-0abe1000348f tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:32:52.147217 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-279e5292-85ee-42a0-aeea-0abe1000348f tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:32:52.148213 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-279e5292-85ee-42a0-aeea-0abe1000348f tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:32:52.148348 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-55a322bf-70ee-4f7a-8709-5e0fa4f8d484 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:52.159931 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-279e5292-85ee-42a0-aeea-0abe1000348f tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:52.160460 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-55a322bf-70ee-4f7a-8709-5e0fa4f8d484 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:52.160599 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-279e5292-85ee-42a0-aeea-0abe1000348f tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:52.164384 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-279e5292-85ee-42a0-aeea-0abe1000348f tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:52.164501 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-55a322bf-70ee-4f7a-8709-5e0fa4f8d484 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Searching by: {'ip': '172.20.0.13', 'deleted': False, 'project_id': '8b25b290c8004e1f8f89e17b448f242a'} {{(pid=121103) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 30 01:32:52.164588 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-279e5292-85ee-42a0-aeea-0abe1000348f tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:52.164588 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-279e5292-85ee-42a0-aeea-0abe1000348f tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:52.164588 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-279e5292-85ee-42a0-aeea-0abe1000348f tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:52.187339 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-279e5292-85ee-42a0-aeea-0abe1000348f tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Getting quotas for project 09d179276dbf4e4d9cb780b18e7a22c7. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:32:52.193683 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-279e5292-85ee-42a0-aeea-0abe1000348f tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Getting quotas for user 88ac5422c8f048148aac2c9b62e0482e and project 09d179276dbf4e4d9cb780b18e7a22c7. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:32:52.210360 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-279e5292-85ee-42a0-aeea-0abe1000348f tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:32:52.213307 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-279e5292-85ee-42a0-aeea-0abe1000348f tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] [instance: 76d6b110-febc-4f28-8367-a0c9ef077177] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:32:52.289821 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-55a322bf-70ee-4f7a-8709-5e0fa4f8d484 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:52.290315 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-55a322bf-70ee-4f7a-8709-5e0fa4f8d484 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:52.290872 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-55a322bf-70ee-4f7a-8709-5e0fa4f8d484 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:52.291615 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-55a322bf-70ee-4f7a-8709-5e0fa4f8d484 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:52.292607 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-55a322bf-70ee-4f7a-8709-5e0fa4f8d484 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:52.293032 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-55a322bf-70ee-4f7a-8709-5e0fa4f8d484 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:52.397588 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.multi_cell_list [None req-55a322bf-70ee-4f7a-8709-5e0fa4f8d484 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121103) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 30 01:32:52.404879 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-279e5292-85ee-42a0-aeea-0abe1000348f tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.010446 Oct 30 01:32:52.414190 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2200/4372] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:32:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1020 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:32:52.421763 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f1154135-03c4-43ca-8e11-5fd2a04802dd tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:52.422577 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f1154135-03c4-43ca-8e11-5fd2a04802dd tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:52.447338 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f1154135-03c4-43ca-8e11-5fd2a04802dd tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:52.448696 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f1154135-03c4-43ca-8e11-5fd2a04802dd tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:52.450725 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f1154135-03c4-43ca-8e11-5fd2a04802dd tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:52.451666 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f1154135-03c4-43ca-8e11-5fd2a04802dd tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:52.453216 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f1154135-03c4-43ca-8e11-5fd2a04802dd tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:52.455732 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f1154135-03c4-43ca-8e11-5fd2a04802dd tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:52.529527 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-55a322bf-70ee-4f7a-8709-5e0fa4f8d484 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers?ip=172.20.0.13" status: 200 len: 345 microversion: 2.1 time: 0.391103 Oct 30 01:32:52.531161 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2173/4373] 10.222.0.13 () {58 vars in 1154 bytes} [Sun Oct 30 01:32:52 2022] GET /compute/v2.1/servers?ip=172.20.0.13 => generated 345 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:32:52.546831 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-279cbbfc-c72d-4a68-89da-8fd52ef06966 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:52.547855 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-279cbbfc-c72d-4a68-89da-8fd52ef06966 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] [instance: 76d6b110-febc-4f28-8367-a0c9ef077177] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:52.627350 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-279cbbfc-c72d-4a68-89da-8fd52ef06966 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ac5422c8f048148aac2c9b62e0482e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d179276dbf4e4d9cb780b18e7a22c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:52.637876 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-279cbbfc-c72d-4a68-89da-8fd52ef06966 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "GET /compute/v2.1/servers/76d6b110-febc-4f28-8367-a0c9ef077177" status: 200 len: 1216 microversion: 2.1 time: 0.095753 Oct 30 01:32:52.638675 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2174/4374] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:52 2022] GET /compute/v2.1/servers/76d6b110-febc-4f28-8367-a0c9ef077177 => generated 1216 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:52.664304 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f1154135-03c4-43ca-8e11-5fd2a04802dd tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:52.666951 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-76f21d35-1ec3-414d-8769-ba76a8061603 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:52.667905 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-76f21d35-1ec3-414d-8769-ba76a8061603 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: b36a2df7-45c9-4a51-88f1-e1a1b9c0969d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:52.678256 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f1154135-03c4-43ca-8e11-5fd2a04802dd tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.262641 Oct 30 01:32:52.679042 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2201/4375] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:52 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:52.696368 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-76f21d35-1ec3-414d-8769-ba76a8061603 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:52.699071 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-76f21d35-1ec3-414d-8769-ba76a8061603 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:52.700238 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-76f21d35-1ec3-414d-8769-ba76a8061603 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:52.701469 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-76f21d35-1ec3-414d-8769-ba76a8061603 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:52.707634 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1683c1c4-3363-4ff9-ab08-271bd9b984ab tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:52.708810 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1683c1c4-3363-4ff9-ab08-271bd9b984ab tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:52.713822 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-76f21d35-1ec3-414d-8769-ba76a8061603 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:52.715609 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-76f21d35-1ec3-414d-8769-ba76a8061603 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:52.730772 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1683c1c4-3363-4ff9-ab08-271bd9b984ab tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:52.730772 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1683c1c4-3363-4ff9-ab08-271bd9b984ab tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:52.730772 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1683c1c4-3363-4ff9-ab08-271bd9b984ab tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:52.730772 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1683c1c4-3363-4ff9-ab08-271bd9b984ab tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:52.730772 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1683c1c4-3363-4ff9-ab08-271bd9b984ab tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:52.748232 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1683c1c4-3363-4ff9-ab08-271bd9b984ab tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:52.955069 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-76f21d35-1ec3-414d-8769-ba76a8061603 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:52.965191 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-76f21d35-1ec3-414d-8769-ba76a8061603 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers/b36a2df7-45c9-4a51-88f1-e1a1b9c0969d" status: 200 len: 1512 microversion: 2.1 time: 0.325584 Oct 30 01:32:52.968524 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2175/4376] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:52 2022] GET /compute/v2.1/servers/b36a2df7-45c9-4a51-88f1-e1a1b9c0969d => generated 1512 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:52.971971 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1683c1c4-3363-4ff9-ab08-271bd9b984ab tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:52.981024 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1683c1c4-3363-4ff9-ab08-271bd9b984ab tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.277960 Oct 30 01:32:52.982353 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2202/4377] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:52 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:32:52.989461 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2432e416-d1ef-4766-98ed-be820b5fe10e tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:52.989461 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2432e416-d1ef-4766-98ed-be820b5fe10e tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: 6573b259-e50d-4954-9d64-3c914df97308] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:53.016711 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2432e416-d1ef-4766-98ed-be820b5fe10e tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:53.019434 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2432e416-d1ef-4766-98ed-be820b5fe10e tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:53.019961 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2432e416-d1ef-4766-98ed-be820b5fe10e tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:53.020755 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2432e416-d1ef-4766-98ed-be820b5fe10e tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:53.027525 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2432e416-d1ef-4766-98ed-be820b5fe10e tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:53.028078 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2432e416-d1ef-4766-98ed-be820b5fe10e tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:53.145903 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d674576a-f818-4932-b52b-618a6284c081 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:53.146836 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d674576a-f818-4932-b52b-618a6284c081 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:53.159369 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d674576a-f818-4932-b52b-618a6284c081 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:53.159872 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d674576a-f818-4932-b52b-618a6284c081 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:53.160309 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d674576a-f818-4932-b52b-618a6284c081 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:53.161026 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d674576a-f818-4932-b52b-618a6284c081 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:53.161513 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d674576a-f818-4932-b52b-618a6284c081 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:53.161942 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d674576a-f818-4932-b52b-618a6284c081 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:53.273163 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2432e416-d1ef-4766-98ed-be820b5fe10e tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:53.309293 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2432e416-d1ef-4766-98ed-be820b5fe10e tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers/6573b259-e50d-4954-9d64-3c914df97308" status: 200 len: 1513 microversion: 2.1 time: 0.321377 Oct 30 01:32:53.310919 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2176/4378] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:52 2022] GET /compute/v2.1/servers/6573b259-e50d-4954-9d64-3c914df97308 => generated 1513 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:53.325752 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ab1daa1c-8dac-4947-9b59-ce040046f12c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1129335260", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "2bdbb622-9eb5-4b19-93d6-10bf71c70ecc"}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ab1daa1c-8dac-4947-9b59-ce040046f12c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Request method failure captured: Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 238 Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdPsZZXjRvWKe2zWP-5VH1VYAsWsLLjUmpyob2uINkfAXNLt0qGMmCTWjYn2WpZ3XOOdsuaM4lwk-qZrOIX3mOHzuCJPZ3r-9M-w153XBWLoTow-eSMj1bsAWDNo3KKhMzjHqic8AJ-DcXpdsBh93g0dRB_UMWMRrGyY1cbSRdHJrvg Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 0bce487302c24def8a8473b0725904f2 Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1129335260", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "2bdbb622-9eb5-4b19-93d6-10bf71c70ecc"}]}} Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1129335260', 'imageRef': 'deb14158-45d8-4539-889d-ff9726d046d7', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '2bdbb622-9eb5-4b19-93d6-10bf71c70ecc'}]}}} Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise error Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:53.345746 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:53.350736 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:32:53.350736 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:32:53.350736 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:32:53.350736 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:32:53.350736 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:32:53.350736 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:32:53.350736 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:32:53.350736 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:32:53.350736 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 30 01:32:53.350736 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 30 01:32:53.350736 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 30 01:32:53.350736 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 30 01:32:53.350736 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 30 01:32:53.350736 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 30 01:32:53.350736 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 30 01:32:53.350736 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:53.350736 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:53.350736 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:53.350736 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:53.350736 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:32:53.350736 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:32:53.350736 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 30 01:32:53.350736 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 30 01:32:53.350736 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 30 01:32:53.350736 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:53.350736 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ab1daa1c-8dac-4947-9b59-ce040046f12c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:32:53.350736 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ab1daa1c-8dac-4947-9b59-ce040046f12c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.036552 Oct 30 01:32:53.350736 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2177/4379] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:32:53 2022] POST /compute/v2.1/servers => generated 139 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:32:53.360221 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4ee9a45c-a28f-46d9-9c64-9328610e4a9a tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:53.360297 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4ee9a45c-a28f-46d9-9c64-9328610e4a9a tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: 86461b51-bd22-446e-a37e-985c21f7ccd5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:53.375845 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4ee9a45c-a28f-46d9-9c64-9328610e4a9a tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:53.381470 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4ee9a45c-a28f-46d9-9c64-9328610e4a9a tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:53.382023 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4ee9a45c-a28f-46d9-9c64-9328610e4a9a tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:53.382943 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4ee9a45c-a28f-46d9-9c64-9328610e4a9a tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:53.383503 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4ee9a45c-a28f-46d9-9c64-9328610e4a9a tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:53.384313 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4ee9a45c-a28f-46d9-9c64-9328610e4a9a tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:53.502430 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d674576a-f818-4932-b52b-618a6284c081 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:53.517601 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d674576a-f818-4932-b52b-618a6284c081 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e" status: 200 len: 1511 microversion: 2.1 time: 0.375442 Oct 30 01:32:53.533699 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2203/4380] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:53 2022] GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e => generated 1511 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:32:53.544335 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f206dda3-30d7-40c4-abfc-b1d817fc6da4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:53.552394 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f206dda3-30d7-40c4-abfc-b1d817fc6da4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:53.570561 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f206dda3-30d7-40c4-abfc-b1d817fc6da4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:53.571170 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f206dda3-30d7-40c4-abfc-b1d817fc6da4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:53.571786 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f206dda3-30d7-40c4-abfc-b1d817fc6da4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:53.572948 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f206dda3-30d7-40c4-abfc-b1d817fc6da4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:53.573471 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f206dda3-30d7-40c4-abfc-b1d817fc6da4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:53.573903 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f206dda3-30d7-40c4-abfc-b1d817fc6da4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:53.597261 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4ee9a45c-a28f-46d9-9c64-9328610e4a9a tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:53.612994 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4ee9a45c-a28f-46d9-9c64-9328610e4a9a tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers/86461b51-bd22-446e-a37e-985c21f7ccd5" status: 200 len: 1512 microversion: 2.1 time: 0.262558 Oct 30 01:32:53.614928 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2178/4381] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:53 2022] GET /compute/v2.1/servers/86461b51-bd22-446e-a37e-985c21f7ccd5 => generated 1512 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:53.639680 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ed1b9cbd-65c0-4ddf-af84-0f4696b99097 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:53.644537 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ed1b9cbd-65c0-4ddf-af84-0f4696b99097 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:53.646095 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ed1b9cbd-65c0-4ddf-af84-0f4696b99097 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Searching by: {'deleted': False, 'project_id': '8b25b290c8004e1f8f89e17b448f242a'} {{(pid=121103) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 30 01:32:53.652154 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ed1b9cbd-65c0-4ddf-af84-0f4696b99097 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:53.654312 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ed1b9cbd-65c0-4ddf-af84-0f4696b99097 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:53.654312 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ed1b9cbd-65c0-4ddf-af84-0f4696b99097 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:53.655059 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ed1b9cbd-65c0-4ddf-af84-0f4696b99097 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:53.655670 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ed1b9cbd-65c0-4ddf-af84-0f4696b99097 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:53.656246 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ed1b9cbd-65c0-4ddf-af84-0f4696b99097 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:53.709036 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.multi_cell_list [None req-ed1b9cbd-65c0-4ddf-af84-0f4696b99097 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121103) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 30 01:32:53.777985 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ed1b9cbd-65c0-4ddf-af84-0f4696b99097 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:53.792428 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ed1b9cbd-65c0-4ddf-af84-0f4696b99097 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:53.794108 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ed1b9cbd-65c0-4ddf-af84-0f4696b99097 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:53.794108 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ed1b9cbd-65c0-4ddf-af84-0f4696b99097 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:53.796309 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f206dda3-30d7-40c4-abfc-b1d817fc6da4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:53.807900 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f206dda3-30d7-40c4-abfc-b1d817fc6da4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.273355 Oct 30 01:32:53.809136 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2204/4382] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:53 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:53.816440 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b9f5fcd6-8386-49df-a042-6ea70a63ecf3 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:53.817462 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b9f5fcd6-8386-49df-a042-6ea70a63ecf3 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] [instance: 76d6b110-febc-4f28-8367-a0c9ef077177] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:53.828066 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b9f5fcd6-8386-49df-a042-6ea70a63ecf3 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:53.828745 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b9f5fcd6-8386-49df-a042-6ea70a63ecf3 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:53.829535 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b9f5fcd6-8386-49df-a042-6ea70a63ecf3 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:53.830545 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b9f5fcd6-8386-49df-a042-6ea70a63ecf3 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:53.831219 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b9f5fcd6-8386-49df-a042-6ea70a63ecf3 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:53.833325 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b9f5fcd6-8386-49df-a042-6ea70a63ecf3 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:53.938030 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b9f5fcd6-8386-49df-a042-6ea70a63ecf3 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ac5422c8f048148aac2c9b62e0482e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d179276dbf4e4d9cb780b18e7a22c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:53.952276 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b9f5fcd6-8386-49df-a042-6ea70a63ecf3 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "GET /compute/v2.1/servers/76d6b110-febc-4f28-8367-a0c9ef077177" status: 200 len: 1220 microversion: 2.1 time: 0.141520 Oct 30 01:32:53.953981 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2205/4383] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:53 2022] GET /compute/v2.1/servers/76d6b110-febc-4f28-8367-a0c9ef077177 => generated 1220 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:53.973177 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9468f92c-47c7-488e-bc77-e426f5ff639c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:53.974182 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9468f92c-47c7-488e-bc77-e426f5ff639c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:53.983350 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9468f92c-47c7-488e-bc77-e426f5ff639c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:53.983985 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9468f92c-47c7-488e-bc77-e426f5ff639c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:53.984951 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9468f92c-47c7-488e-bc77-e426f5ff639c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:53.985938 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9468f92c-47c7-488e-bc77-e426f5ff639c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:53.986400 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9468f92c-47c7-488e-bc77-e426f5ff639c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:53.986890 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9468f92c-47c7-488e-bc77-e426f5ff639c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:54.099529 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ed1b9cbd-65c0-4ddf-af84-0f4696b99097 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers/detail" status: 200 len: 4520 microversion: 2.1 time: 0.464247 Oct 30 01:32:54.100454 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2179/4384] 10.222.0.13 () {58 vars in 1146 bytes} [Sun Oct 30 01:32:53 2022] GET /compute/v2.1/servers/detail => generated 4520 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:32:54.127262 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4fcd9cc6-5222-4fd5-9287-3f8d7ac4e706 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:54.139291 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4fcd9cc6-5222-4fd5-9287-3f8d7ac4e706 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:54.144443 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4fcd9cc6-5222-4fd5-9287-3f8d7ac4e706 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '8b25b290c8004e1f8f89e17b448f242a'} {{(pid=121103) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 30 01:32:54.213309 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9468f92c-47c7-488e-bc77-e426f5ff639c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:54.220006 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9468f92c-47c7-488e-bc77-e426f5ff639c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.261833 Oct 30 01:32:54.221025 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2206/4385] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:53 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:54.289659 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4fcd9cc6-5222-4fd5-9287-3f8d7ac4e706 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:54.290214 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4fcd9cc6-5222-4fd5-9287-3f8d7ac4e706 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:54.290673 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4fcd9cc6-5222-4fd5-9287-3f8d7ac4e706 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:54.291363 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4fcd9cc6-5222-4fd5-9287-3f8d7ac4e706 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:54.291874 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4fcd9cc6-5222-4fd5-9287-3f8d7ac4e706 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:54.292299 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4fcd9cc6-5222-4fd5-9287-3f8d7ac4e706 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:54.357370 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.multi_cell_list [None req-4fcd9cc6-5222-4fd5-9287-3f8d7ac4e706 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121103) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 30 01:32:54.398911 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4fcd9cc6-5222-4fd5-9287-3f8d7ac4e706 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.276297 Oct 30 01:32:54.399621 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2180/4386] 10.222.0.13 () {58 vars in 1150 bytes} [Sun Oct 30 01:32:54 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:54.415524 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8d649855-42cb-4684-b3f2-44f85adbfbb4 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:54.420173 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8d649855-42cb-4684-b3f2-44f85adbfbb4 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:54.420794 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b893f419-02f9-4c7a-a374-6d2a7e0db0b0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-551591496", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "2bdbb622-9eb5-4b19-93d6-10bf71c70ecc"}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:32:54.420967 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8d649855-42cb-4684-b3f2-44f85adbfbb4 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '8b25b290c8004e1f8f89e17b448f242a'} {{(pid=121102) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b893f419-02f9-4c7a-a374-6d2a7e0db0b0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Request method failure captured: Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 234 Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdPsZZXjRvWKe2zWP-5VH1VYAsWsLLjUmpyob2uINkfAXNLt0qGMmCTWjYn2WpZ3XOOdsuaM4lwk-qZrOIX3mOHzuCJPZ3r-9M-w153XBWLoTow-eSMj1bsAWDNo3KKhMzjHqic8AJ-DcXpdsBh93g0dRB_UMWMRrGyY1cbSRdHJrvg Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 0bce487302c24def8a8473b0725904f2 Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-551591496", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "2bdbb622-9eb5-4b19-93d6-10bf71c70ecc"}]}} Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-551591496', 'imageRef': 'deb14158-45d8-4539-889d-ff9726d046d7', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '2bdbb622-9eb5-4b19-93d6-10bf71c70ecc'}]}}} Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise error Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:54.425746 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:54.433702 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:32:54.433702 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:32:54.433702 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:32:54.433702 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:32:54.433702 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:32:54.433702 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:32:54.433702 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:32:54.433702 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:32:54.433702 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 30 01:32:54.433702 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 30 01:32:54.433702 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 30 01:32:54.433702 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 30 01:32:54.433702 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 30 01:32:54.433702 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 30 01:32:54.433702 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 30 01:32:54.433702 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:54.433702 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:54.433702 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:54.433702 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:54.433702 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:32:54.433702 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:32:54.433702 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 30 01:32:54.433702 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 30 01:32:54.433702 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 30 01:32:54.433702 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:54.433702 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b893f419-02f9-4c7a-a374-6d2a7e0db0b0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:32:54.433702 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b893f419-02f9-4c7a-a374-6d2a7e0db0b0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.011879 Oct 30 01:32:54.435397 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d649855-42cb-4684-b3f2-44f85adbfbb4 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:54.435500 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2181/4387] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:32:54 2022] POST /compute/v2.1/servers => generated 133 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:32:54.435579 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d649855-42cb-4684-b3f2-44f85adbfbb4 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:54.435579 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d649855-42cb-4684-b3f2-44f85adbfbb4 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:54.435579 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d649855-42cb-4684-b3f2-44f85adbfbb4 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:54.435579 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d649855-42cb-4684-b3f2-44f85adbfbb4 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:54.435579 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d649855-42cb-4684-b3f2-44f85adbfbb4 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:54.440405 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-47f38b04-52eb-4ff8-a7af-7a73e04cd18c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:54.441191 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-47f38b04-52eb-4ff8-a7af-7a73e04cd18c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:54.451018 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-47f38b04-52eb-4ff8-a7af-7a73e04cd18c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:54.451687 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-47f38b04-52eb-4ff8-a7af-7a73e04cd18c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:54.452280 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-47f38b04-52eb-4ff8-a7af-7a73e04cd18c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:54.452904 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-47f38b04-52eb-4ff8-a7af-7a73e04cd18c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:54.453792 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-47f38b04-52eb-4ff8-a7af-7a73e04cd18c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:54.454362 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-47f38b04-52eb-4ff8-a7af-7a73e04cd18c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:54.563128 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.multi_cell_list [None req-8d649855-42cb-4684-b3f2-44f85adbfbb4 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121102) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 30 01:32:54.654691 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8d649855-42cb-4684-b3f2-44f85adbfbb4 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.244637 Oct 30 01:32:54.655607 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2207/4388] 10.222.0.13 () {58 vars in 1212 bytes} [Sun Oct 30 01:32:54 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:54.658757 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-47f38b04-52eb-4ff8-a7af-7a73e04cd18c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:54.666373 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-265aedeb-feb9-4b24-ad65-9df40866996f tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:54.667919 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-265aedeb-feb9-4b24-ad65-9df40866996f tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:54.671920 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-47f38b04-52eb-4ff8-a7af-7a73e04cd18c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.236761 Oct 30 01:32:54.672668 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2182/4389] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:54 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:54.675610 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-265aedeb-feb9-4b24-ad65-9df40866996f tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:54.676115 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-265aedeb-feb9-4b24-ad65-9df40866996f tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:54.676554 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-265aedeb-feb9-4b24-ad65-9df40866996f tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:54.678333 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-265aedeb-feb9-4b24-ad65-9df40866996f tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:54.678792 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-265aedeb-feb9-4b24-ad65-9df40866996f tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:54.679219 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-265aedeb-feb9-4b24-ad65-9df40866996f tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:54.679929 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d43265b5-6f2e-421f-83bf-b09e9c95c4a4 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:54.686296 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d43265b5-6f2e-421f-83bf-b09e9c95c4a4 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:54.687895 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d43265b5-6f2e-421f-83bf-b09e9c95c4a4 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '8b25b290c8004e1f8f89e17b448f242a'} {{(pid=121103) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 30 01:32:54.694536 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d43265b5-6f2e-421f-83bf-b09e9c95c4a4 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:54.695319 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d43265b5-6f2e-421f-83bf-b09e9c95c4a4 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:54.695967 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d43265b5-6f2e-421f-83bf-b09e9c95c4a4 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:54.697040 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d43265b5-6f2e-421f-83bf-b09e9c95c4a4 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:54.697776 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d43265b5-6f2e-421f-83bf-b09e9c95c4a4 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:54.698530 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d43265b5-6f2e-421f-83bf-b09e9c95c4a4 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:54.820302 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.multi_cell_list [None req-d43265b5-6f2e-421f-83bf-b09e9c95c4a4 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121103) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 30 01:32:54.868434 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-265aedeb-feb9-4b24-ad65-9df40866996f tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:54.879269 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-265aedeb-feb9-4b24-ad65-9df40866996f tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e" status: 200 len: 1488 microversion: 2.1 time: 0.222544 Oct 30 01:32:54.886368 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2208/4390] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:54 2022] GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e => generated 1488 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:54.886368 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4c1249b4-29f5-4bf8-b8ef-97be87110b89 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:54.886368 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4c1249b4-29f5-4bf8-b8ef-97be87110b89 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:54.891624 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4c1249b4-29f5-4bf8-b8ef-97be87110b89 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:54.892317 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4c1249b4-29f5-4bf8-b8ef-97be87110b89 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:54.892940 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4c1249b4-29f5-4bf8-b8ef-97be87110b89 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:54.893865 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4c1249b4-29f5-4bf8-b8ef-97be87110b89 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:54.894495 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4c1249b4-29f5-4bf8-b8ef-97be87110b89 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:54.895094 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4c1249b4-29f5-4bf8-b8ef-97be87110b89 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:54.900643 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d43265b5-6f2e-421f-83bf-b09e9c95c4a4 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.226527 Oct 30 01:32:54.902326 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2183/4391] 10.222.0.13 () {58 vars in 1196 bytes} [Sun Oct 30 01:32:54 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:54.908799 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1e85d7cb-8b4f-41af-ab20-89510aeb2d1e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1543521132"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:32:54.912130 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1e85d7cb-8b4f-41af-ab20-89510aeb2d1e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:54.919233 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1e85d7cb-8b4f-41af-ab20-89510aeb2d1e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:54.919915 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1e85d7cb-8b4f-41af-ab20-89510aeb2d1e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:54.920349 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1e85d7cb-8b4f-41af-ab20-89510aeb2d1e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:54.921051 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1e85d7cb-8b4f-41af-ab20-89510aeb2d1e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:54.921531 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1e85d7cb-8b4f-41af-ab20-89510aeb2d1e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:54.922162 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1e85d7cb-8b4f-41af-ab20-89510aeb2d1e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:55.055226 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4c1249b4-29f5-4bf8-b8ef-97be87110b89 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:55.065031 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4c1249b4-29f5-4bf8-b8ef-97be87110b89 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.183936 Oct 30 01:32:55.066397 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2209/4392] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:54 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:55.071518 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e696cab1-df31-4180-b1b5-b1ea5207e946 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:55.077048 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e696cab1-df31-4180-b1b5-b1ea5207e946 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:55.081919 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e696cab1-df31-4180-b1b5-b1ea5207e946 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Searching by: {'name': '1249049654', 'deleted': False, 'project_id': '8b25b290c8004e1f8f89e17b448f242a'} {{(pid=121102) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 30 01:32:55.082839 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e696cab1-df31-4180-b1b5-b1ea5207e946 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:55.083532 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e696cab1-df31-4180-b1b5-b1ea5207e946 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:55.084165 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e696cab1-df31-4180-b1b5-b1ea5207e946 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:55.085305 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e696cab1-df31-4180-b1b5-b1ea5207e946 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:55.086042 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e696cab1-df31-4180-b1b5-b1ea5207e946 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:55.086782 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e696cab1-df31-4180-b1b5-b1ea5207e946 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:55.127336 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1e85d7cb-8b4f-41af-ab20-89510aeb2d1e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "PUT /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e" status: 200 len: 1061 microversion: 2.1 time: 0.206574 Oct 30 01:32:55.127336 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2184/4393] 10.222.0.13 () {60 vars in 1256 bytes} [Sun Oct 30 01:32:54 2022] PUT /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e => generated 1061 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:55.127336 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-955b11b3-c197-407e-aee2-16ca9c757991 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:55.127336 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-955b11b3-c197-407e-aee2-16ca9c757991 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] [instance: 76d6b110-febc-4f28-8367-a0c9ef077177] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:55.127336 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-955b11b3-c197-407e-aee2-16ca9c757991 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:55.127336 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-955b11b3-c197-407e-aee2-16ca9c757991 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:55.127336 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-955b11b3-c197-407e-aee2-16ca9c757991 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:55.127336 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-955b11b3-c197-407e-aee2-16ca9c757991 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:55.127336 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-955b11b3-c197-407e-aee2-16ca9c757991 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:55.127336 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-955b11b3-c197-407e-aee2-16ca9c757991 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:55.196936 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-955b11b3-c197-407e-aee2-16ca9c757991 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ac5422c8f048148aac2c9b62e0482e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d179276dbf4e4d9cb780b18e7a22c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:55.204820 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.multi_cell_list [None req-e696cab1-df31-4180-b1b5-b1ea5207e946 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121102) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 30 01:32:55.205823 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-955b11b3-c197-407e-aee2-16ca9c757991 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "GET /compute/v2.1/servers/76d6b110-febc-4f28-8367-a0c9ef077177" status: 200 len: 1268 microversion: 2.1 time: 0.093150 Oct 30 01:32:55.210474 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2185/4394] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:55 2022] GET /compute/v2.1/servers/76d6b110-febc-4f28-8367-a0c9ef077177 => generated 1268 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:55.226597 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-326e6d50-ab56-472a-a74f-0cd6425017ff tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:32:55.226597 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-326e6d50-ab56-472a-a74f-0cd6425017ff tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: 4a175698-5463-4ea5-85c9-6e9e6b9ba047] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:55.230069 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-326e6d50-ab56-472a-a74f-0cd6425017ff tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] HTTP exception thrown: Instance 4a175698-5463-4ea5-85c9-6e9e6b9ba047 could not be found. Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-326e6d50-ab56-472a-a74f-0cd6425017ff tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Request method failure captured: Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: request: POST /compute/v2.1/servers/4a175698-5463-4ea5-85c9-6e9e6b9ba047/action HTTP/1.1 Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 13 Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdPsZZXjRvWKe2zWP-5VH1VYAsWsLLjUmpyob2uINkfAXNLt0qGMmCTWjYn2WpZ3XOOdsuaM4lwk-qZrOIX3mOHzuCJPZ3r-9M-w153XBWLoTow-eSMj1bsAWDNo3KKhMzjHqic8AJ-DcXpdsBh93g0dRB_UMWMRrGyY1cbSRdHJrvg Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 0bce487302c24def8a8473b0725904f2 Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: {"pause": {}} Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 4a175698-5463-4ea5-85c9-6e9e6b9ba047 could not be found. Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '4a175698-5463-4ea5-85c9-6e9e6b9ba047', 'body': {'pause': {}}} Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a175698-5463-4ea5-85c9-6e9e6b9ba047 could not be found. Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a175698-5463-4ea5-85c9-6e9e6b9ba047 could not be found. Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:32:55.239766 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:32:55.243415 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:32:55.243415 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:32:55.243415 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a175698-5463-4ea5-85c9-6e9e6b9ba047 could not be found. Oct 30 01:32:55.243415 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:32:55.243415 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-326e6d50-ab56-472a-a74f-0cd6425017ff tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Returning 404 to user: Instance 4a175698-5463-4ea5-85c9-6e9e6b9ba047 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:32:55.243415 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-326e6d50-ab56-472a-a74f-0cd6425017ff tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "POST /compute/v2.1/servers/4a175698-5463-4ea5-85c9-6e9e6b9ba047/action" status: 404 len: 111 microversion: 2.1 time: 0.029970 Oct 30 01:32:55.243415 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2186/4395] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:32:55 2022] POST /compute/v2.1/servers/4a175698-5463-4ea5-85c9-6e9e6b9ba047/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:32:55.249833 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9151fc15-0ab0-4a4f-89b3-458602af2fd5 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:55.250614 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9151fc15-0ab0-4a4f-89b3-458602af2fd5 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:55.259764 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9151fc15-0ab0-4a4f-89b3-458602af2fd5 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:55.260963 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9151fc15-0ab0-4a4f-89b3-458602af2fd5 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:55.261411 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9151fc15-0ab0-4a4f-89b3-458602af2fd5 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:55.262123 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9151fc15-0ab0-4a4f-89b3-458602af2fd5 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:55.262573 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9151fc15-0ab0-4a4f-89b3-458602af2fd5 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:55.262995 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9151fc15-0ab0-4a4f-89b3-458602af2fd5 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:55.296456 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e696cab1-df31-4180-b1b5-b1ea5207e946 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers?name=1249049654" status: 200 len: 346 microversion: 2.1 time: 0.227885 Oct 30 01:32:55.297699 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2210/4396] 10.222.0.13 () {58 vars in 1156 bytes} [Sun Oct 30 01:32:55 2022] GET /compute/v2.1/servers?name=1249049654 => generated 346 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:32:55.314684 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-25b91e75-a847-4792-ae54-fa2f72e0cfba tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:55.315172 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-25b91e75-a847-4792-ae54-fa2f72e0cfba tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:55.323889 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25b91e75-a847-4792-ae54-fa2f72e0cfba tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:55.324383 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25b91e75-a847-4792-ae54-fa2f72e0cfba tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:55.324820 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25b91e75-a847-4792-ae54-fa2f72e0cfba tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:55.325875 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25b91e75-a847-4792-ae54-fa2f72e0cfba tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:55.326611 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25b91e75-a847-4792-ae54-fa2f72e0cfba tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:55.327118 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25b91e75-a847-4792-ae54-fa2f72e0cfba tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:55.499365 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9151fc15-0ab0-4a4f-89b3-458602af2fd5 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:55.514517 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9151fc15-0ab0-4a4f-89b3-458602af2fd5 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e" status: 200 len: 1488 microversion: 2.1 time: 0.271155 Oct 30 01:32:55.516103 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2187/4397] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:55 2022] GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e => generated 1488 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:55.520845 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-04286a45-1336-4e1a-a5c8-36e21cfd4301 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:55.527564 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-04286a45-1336-4e1a-a5c8-36e21cfd4301 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:55.528414 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-04286a45-1336-4e1a-a5c8-36e21cfd4301 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '8b25b290c8004e1f8f89e17b448f242a'} {{(pid=121103) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 30 01:32:55.536280 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-04286a45-1336-4e1a-a5c8-36e21cfd4301 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:55.536280 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-04286a45-1336-4e1a-a5c8-36e21cfd4301 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:55.536626 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-04286a45-1336-4e1a-a5c8-36e21cfd4301 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:55.537415 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-04286a45-1336-4e1a-a5c8-36e21cfd4301 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:55.537893 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-04286a45-1336-4e1a-a5c8-36e21cfd4301 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:55.538313 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-04286a45-1336-4e1a-a5c8-36e21cfd4301 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:55.645829 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-25b91e75-a847-4792-ae54-fa2f72e0cfba tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:55.648404 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:55.659901 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-25b91e75-a847-4792-ae54-fa2f72e0cfba tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.356645 Oct 30 01:32:55.661070 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2211/4398] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:55 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:55.662917 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.multi_cell_list [None req-04286a45-1336-4e1a-a5c8-36e21cfd4301 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121103) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 30 01:32:55.668897 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5f202050-b44f-463c-84ed-5b2d10912586 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:55.671008 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5f202050-b44f-463c-84ed-5b2d10912586 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:55.677274 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f202050-b44f-463c-84ed-5b2d10912586 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:55.678081 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f202050-b44f-463c-84ed-5b2d10912586 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:55.678745 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f202050-b44f-463c-84ed-5b2d10912586 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:55.679680 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f202050-b44f-463c-84ed-5b2d10912586 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:55.680339 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f202050-b44f-463c-84ed-5b2d10912586 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:55.680969 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f202050-b44f-463c-84ed-5b2d10912586 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:55.781065 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-04286a45-1336-4e1a-a5c8-36e21cfd4301 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.263375 Oct 30 01:32:55.796514 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2188/4399] 10.222.0.13 () {58 vars in 1154 bytes} [Sun Oct 30 01:32:55 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:55.817605 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fc1b6f42-b8ce-4d8a-b3a2-027ac8e02ea1 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:55.835696 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-fc1b6f42-b8ce-4d8a-b3a2-027ac8e02ea1 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:55.850141 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fc1b6f42-b8ce-4d8a-b3a2-027ac8e02ea1 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:55.850659 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fc1b6f42-b8ce-4d8a-b3a2-027ac8e02ea1 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:55.851104 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fc1b6f42-b8ce-4d8a-b3a2-027ac8e02ea1 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:55.851813 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fc1b6f42-b8ce-4d8a-b3a2-027ac8e02ea1 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:55.852272 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fc1b6f42-b8ce-4d8a-b3a2-027ac8e02ea1 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:55.852698 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fc1b6f42-b8ce-4d8a-b3a2-027ac8e02ea1 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:56.038476 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5f202050-b44f-463c-84ed-5b2d10912586 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:56.047411 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5f202050-b44f-463c-84ed-5b2d10912586 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e" status: 200 len: 1488 microversion: 2.1 time: 0.383915 Oct 30 01:32:56.053886 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2212/4400] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:55 2022] GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e => generated 1488 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:56.063066 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f2d98aa9-9f8b-4520-9264-e62f0a87399c tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:56.079128 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f2d98aa9-9f8b-4520-9264-e62f0a87399c tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:56.079914 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f2d98aa9-9f8b-4520-9264-e62f0a87399c tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-124904965', 'deleted': False, 'project_id': '8b25b290c8004e1f8f89e17b448f242a'} {{(pid=121102) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 30 01:32:56.092180 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f2d98aa9-9f8b-4520-9264-e62f0a87399c tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:56.092589 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f2d98aa9-9f8b-4520-9264-e62f0a87399c tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:56.093025 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f2d98aa9-9f8b-4520-9264-e62f0a87399c tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:56.093965 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f2d98aa9-9f8b-4520-9264-e62f0a87399c tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:56.095690 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f2d98aa9-9f8b-4520-9264-e62f0a87399c tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:56.096592 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f2d98aa9-9f8b-4520-9264-e62f0a87399c tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:56.175992 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-fc1b6f42-b8ce-4d8a-b3a2-027ac8e02ea1 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:56.185104 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fc1b6f42-b8ce-4d8a-b3a2-027ac8e02ea1 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.379514 Oct 30 01:32:56.185706 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2189/4401] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:55 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:56.199214 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bf68d8fa-7789-4a36-acc5-c1d8b6a44a2e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:56.199214 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-bf68d8fa-7789-4a36-acc5-c1d8b6a44a2e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:56.200936 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bf68d8fa-7789-4a36-acc5-c1d8b6a44a2e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:56.201508 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bf68d8fa-7789-4a36-acc5-c1d8b6a44a2e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:56.201937 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bf68d8fa-7789-4a36-acc5-c1d8b6a44a2e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:56.202633 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bf68d8fa-7789-4a36-acc5-c1d8b6a44a2e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:56.203084 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bf68d8fa-7789-4a36-acc5-c1d8b6a44a2e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:56.203502 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bf68d8fa-7789-4a36-acc5-c1d8b6a44a2e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:56.259138 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-bf68d8fa-7789-4a36-acc5-c1d8b6a44a2e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:32:56.286690 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.multi_cell_list [None req-f2d98aa9-9f8b-4520-9264-e62f0a87399c tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121102) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 30 01:32:56.390414 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f2d98aa9-9f8b-4520-9264-e62f0a87399c tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-124904965" status: 200 len: 346 microversion: 2.1 time: 0.334985 Oct 30 01:32:56.400417 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2213/4402] 10.222.0.13 () {58 vars in 1228 bytes} [Sun Oct 30 01:32:56 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-124904965 => generated 346 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:32:56.400417 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e71e12cc-55c4-4035-97ca-339192916e79 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:32:56.400417 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e71e12cc-55c4-4035-97ca-339192916e79 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:56.403218 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e71e12cc-55c4-4035-97ca-339192916e79 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:56.403708 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e71e12cc-55c4-4035-97ca-339192916e79 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:56.404144 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e71e12cc-55c4-4035-97ca-339192916e79 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:56.404851 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e71e12cc-55c4-4035-97ca-339192916e79 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:56.405302 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e71e12cc-55c4-4035-97ca-339192916e79 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:56.405832 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e71e12cc-55c4-4035-97ca-339192916e79 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:56.440485 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:56.646637 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bf68d8fa-7789-4a36-acc5-c1d8b6a44a2e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "DELETE /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e" status: 204 len: 0 microversion: 2.1 time: 0.459619 Oct 30 01:32:56.649360 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2190/4403] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:32:56 2022] DELETE /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e => generated 0 bytes in 461 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:32:56.664285 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e71e12cc-55c4-4035-97ca-339192916e79 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "POST /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2/action" status: 202 len: 0 microversion: 2.1 time: 0.260983 Oct 30 01:32:56.664859 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-96246fc0-bb2a-49f9-8edf-fbf0d810e6cf tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:56.664938 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2214/4404] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:32:56 2022] POST /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:32:56.665056 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-96246fc0-bb2a-49f9-8edf-fbf0d810e6cf tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] [instance: 76d6b110-febc-4f28-8367-a0c9ef077177] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:56.670611 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2a0eab9a-6dfb-4ff5-bf0c-69137f404b74 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:56.672123 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2a0eab9a-6dfb-4ff5-bf0c-69137f404b74 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: 86461b51-bd22-446e-a37e-985c21f7ccd5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:56.675197 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-96246fc0-bb2a-49f9-8edf-fbf0d810e6cf tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:56.675697 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-96246fc0-bb2a-49f9-8edf-fbf0d810e6cf tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:56.676399 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-96246fc0-bb2a-49f9-8edf-fbf0d810e6cf tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:56.677314 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-96246fc0-bb2a-49f9-8edf-fbf0d810e6cf tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:56.678711 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-96246fc0-bb2a-49f9-8edf-fbf0d810e6cf tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:56.679351 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-96246fc0-bb2a-49f9-8edf-fbf0d810e6cf tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:56.681355 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a0eab9a-6dfb-4ff5-bf0c-69137f404b74 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:56.681843 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a0eab9a-6dfb-4ff5-bf0c-69137f404b74 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:56.682384 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a0eab9a-6dfb-4ff5-bf0c-69137f404b74 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:56.683310 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a0eab9a-6dfb-4ff5-bf0c-69137f404b74 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:56.683960 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a0eab9a-6dfb-4ff5-bf0c-69137f404b74 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:56.684573 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a0eab9a-6dfb-4ff5-bf0c-69137f404b74 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:56.717587 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2a0eab9a-6dfb-4ff5-bf0c-69137f404b74 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: 86461b51-bd22-446e-a37e-985c21f7ccd5] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:32:57.068376 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2a0eab9a-6dfb-4ff5-bf0c-69137f404b74 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "DELETE /compute/v2.1/servers/86461b51-bd22-446e-a37e-985c21f7ccd5" status: 204 len: 0 microversion: 2.1 time: 0.411478 Oct 30 01:32:57.069977 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-96246fc0-bb2a-49f9-8edf-fbf0d810e6cf tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ac5422c8f048148aac2c9b62e0482e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d179276dbf4e4d9cb780b18e7a22c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:57.070263 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2215/4405] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:32:56 2022] DELETE /compute/v2.1/servers/86461b51-bd22-446e-a37e-985c21f7ccd5 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:32:57.080613 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-241a2dab-ba9b-4efe-8617-167386132384 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:57.081734 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-241a2dab-ba9b-4efe-8617-167386132384 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:57.081918 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-96246fc0-bb2a-49f9-8edf-fbf0d810e6cf tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "GET /compute/v2.1/servers/76d6b110-febc-4f28-8367-a0c9ef077177" status: 200 len: 1274 microversion: 2.1 time: 0.432765 Oct 30 01:32:57.097923 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2191/4406] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:56 2022] GET /compute/v2.1/servers/76d6b110-febc-4f28-8367-a0c9ef077177 => generated 1274 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:57.098684 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-241a2dab-ba9b-4efe-8617-167386132384 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:57.099629 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-241a2dab-ba9b-4efe-8617-167386132384 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:57.100651 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-241a2dab-ba9b-4efe-8617-167386132384 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:57.105603 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-241a2dab-ba9b-4efe-8617-167386132384 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:57.105603 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-241a2dab-ba9b-4efe-8617-167386132384 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:57.105603 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-241a2dab-ba9b-4efe-8617-167386132384 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:57.105864 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b9646fe4-1bb2-4bca-8ebf-61b1627bd301 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:57.105864 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b9646fe4-1bb2-4bca-8ebf-61b1627bd301 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:57.132860 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b9646fe4-1bb2-4bca-8ebf-61b1627bd301 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:57.133362 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b9646fe4-1bb2-4bca-8ebf-61b1627bd301 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:57.136417 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b9646fe4-1bb2-4bca-8ebf-61b1627bd301 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:57.136417 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b9646fe4-1bb2-4bca-8ebf-61b1627bd301 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:57.136417 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b9646fe4-1bb2-4bca-8ebf-61b1627bd301 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:57.136417 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b9646fe4-1bb2-4bca-8ebf-61b1627bd301 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:57.487513 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b9646fe4-1bb2-4bca-8ebf-61b1627bd301 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:57.495585 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-241a2dab-ba9b-4efe-8617-167386132384 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:57.496580 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b9646fe4-1bb2-4bca-8ebf-61b1627bd301 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1508 microversion: 2.1 time: 0.396675 Oct 30 01:32:57.497616 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2192/4407] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:57 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1508 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:57.504936 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-613c14f8-9ad0-4229-b040-cd465c5ff123 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:57.505843 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-613c14f8-9ad0-4229-b040-cd465c5ff123 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: 86461b51-bd22-446e-a37e-985c21f7ccd5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:57.509420 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-241a2dab-ba9b-4efe-8617-167386132384 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e" status: 200 len: 1494 microversion: 2.1 time: 0.437620 Oct 30 01:32:57.513040 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2216/4408] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:57 2022] GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e => generated 1494 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:57.513501 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-613c14f8-9ad0-4229-b040-cd465c5ff123 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:57.516798 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-613c14f8-9ad0-4229-b040-cd465c5ff123 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:57.516798 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-613c14f8-9ad0-4229-b040-cd465c5ff123 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:57.516798 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-613c14f8-9ad0-4229-b040-cd465c5ff123 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:57.516798 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-613c14f8-9ad0-4229-b040-cd465c5ff123 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:57.516798 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-613c14f8-9ad0-4229-b040-cd465c5ff123 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:57.731814 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-613c14f8-9ad0-4229-b040-cd465c5ff123 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:57.761318 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-613c14f8-9ad0-4229-b040-cd465c5ff123 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers/86461b51-bd22-446e-a37e-985c21f7ccd5" status: 200 len: 1518 microversion: 2.1 time: 0.262484 Oct 30 01:32:57.777702 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2193/4409] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:57 2022] GET /compute/v2.1/servers/86461b51-bd22-446e-a37e-985c21f7ccd5 => generated 1518 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:58.109726 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1225358a-d1ab-42dd-a091-fb5ebe8c3133 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:58.112139 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1225358a-d1ab-42dd-a091-fb5ebe8c3133 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] [instance: 76d6b110-febc-4f28-8367-a0c9ef077177] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:58.126032 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1225358a-d1ab-42dd-a091-fb5ebe8c3133 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:58.128343 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1225358a-d1ab-42dd-a091-fb5ebe8c3133 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:58.129154 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1225358a-d1ab-42dd-a091-fb5ebe8c3133 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:58.130480 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1225358a-d1ab-42dd-a091-fb5ebe8c3133 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:58.132332 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1225358a-d1ab-42dd-a091-fb5ebe8c3133 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:58.133403 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1225358a-d1ab-42dd-a091-fb5ebe8c3133 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:58.375591 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1225358a-d1ab-42dd-a091-fb5ebe8c3133 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ac5422c8f048148aac2c9b62e0482e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d179276dbf4e4d9cb780b18e7a22c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:58.386108 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1225358a-d1ab-42dd-a091-fb5ebe8c3133 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "GET /compute/v2.1/servers/76d6b110-febc-4f28-8367-a0c9ef077177" status: 200 len: 1316 microversion: 2.1 time: 0.284494 Oct 30 01:32:58.396239 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2217/4410] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:58 2022] GET /compute/v2.1/servers/76d6b110-febc-4f28-8367-a0c9ef077177 => generated 1316 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:58.540291 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-700fd626-1923-452c-ba13-22285579cf51 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:58.541763 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6b3b383d-94b1-4428-b368-674d66be04e6 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:58.542347 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-700fd626-1923-452c-ba13-22285579cf51 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:58.542652 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6b3b383d-94b1-4428-b368-674d66be04e6 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:58.549473 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-700fd626-1923-452c-ba13-22285579cf51 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:58.550112 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-700fd626-1923-452c-ba13-22285579cf51 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:58.555281 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6b3b383d-94b1-4428-b368-674d66be04e6 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:58.555949 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-700fd626-1923-452c-ba13-22285579cf51 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:58.556767 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6b3b383d-94b1-4428-b368-674d66be04e6 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:58.557837 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6b3b383d-94b1-4428-b368-674d66be04e6 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:58.559270 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6b3b383d-94b1-4428-b368-674d66be04e6 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:58.559393 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-700fd626-1923-452c-ba13-22285579cf51 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:58.560029 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6b3b383d-94b1-4428-b368-674d66be04e6 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:58.560270 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-700fd626-1923-452c-ba13-22285579cf51 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:58.561392 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-700fd626-1923-452c-ba13-22285579cf51 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:58.561741 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6b3b383d-94b1-4428-b368-674d66be04e6 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:58.930982 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6b3b383d-94b1-4428-b368-674d66be04e6 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:58.942534 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6b3b383d-94b1-4428-b368-674d66be04e6 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1508 microversion: 2.1 time: 0.406756 Oct 30 01:32:58.943393 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2194/4411] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:58 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1508 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:58.948212 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a345602d-5aa1-49d5-892b-e1d4b3fcaddc tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:58.948858 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a345602d-5aa1-49d5-892b-e1d4b3fcaddc tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: 86461b51-bd22-446e-a37e-985c21f7ccd5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:58.953903 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-700fd626-1923-452c-ba13-22285579cf51 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:58.965404 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a345602d-5aa1-49d5-892b-e1d4b3fcaddc tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:58.965595 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-700fd626-1923-452c-ba13-22285579cf51 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e" status: 200 len: 1494 microversion: 2.1 time: 0.429581 Oct 30 01:32:58.965911 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a345602d-5aa1-49d5-892b-e1d4b3fcaddc tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:58.969887 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2218/4412] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:58 2022] GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e => generated 1494 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:32:58.970593 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a345602d-5aa1-49d5-892b-e1d4b3fcaddc tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:58.971519 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a345602d-5aa1-49d5-892b-e1d4b3fcaddc tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:58.972156 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a345602d-5aa1-49d5-892b-e1d4b3fcaddc tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:58.974644 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a345602d-5aa1-49d5-892b-e1d4b3fcaddc tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:58.978336 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-89d716ce-e708-4385-9789-8b351ed76f24 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:58.985002 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-89d716ce-e708-4385-9789-8b351ed76f24 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 2873be88-5d85-49c6-833f-19b7df1fcf5f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:58.995792 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-89d716ce-e708-4385-9789-8b351ed76f24 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:58.996615 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-89d716ce-e708-4385-9789-8b351ed76f24 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:58.997222 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-89d716ce-e708-4385-9789-8b351ed76f24 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:58.998286 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-89d716ce-e708-4385-9789-8b351ed76f24 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:58.998902 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-89d716ce-e708-4385-9789-8b351ed76f24 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:58.999484 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-89d716ce-e708-4385-9789-8b351ed76f24 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:59.037217 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-89d716ce-e708-4385-9789-8b351ed76f24 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 2873be88-5d85-49c6-833f-19b7df1fcf5f] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:32:59.190707 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a345602d-5aa1-49d5-892b-e1d4b3fcaddc tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:59.205733 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a345602d-5aa1-49d5-892b-e1d4b3fcaddc tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers/86461b51-bd22-446e-a37e-985c21f7ccd5" status: 200 len: 1518 microversion: 2.1 time: 0.258620 Oct 30 01:32:59.209450 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2195/4413] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:58 2022] GET /compute/v2.1/servers/86461b51-bd22-446e-a37e-985c21f7ccd5 => generated 1518 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:59.371285 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-653ed08c-3849-446a-bcf6-4c9cec541368 req-3d741d73-16ca-49b4-ad40-f2242a80e22c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76d6b110-febc-4f28-8367-a0c9ef077177", "tag": "4e68cc61-1f92-4323-863f-24fb89d25061"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:32:59.382762 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-653ed08c-3849-446a-bcf6-4c9cec541368 req-3d741d73-16ca-49b4-ad40-f2242a80e22c service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:59.383475 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-653ed08c-3849-446a-bcf6-4c9cec541368 req-3d741d73-16ca-49b4-ad40-f2242a80e22c service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:59.384200 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-653ed08c-3849-446a-bcf6-4c9cec541368 req-3d741d73-16ca-49b4-ad40-f2242a80e22c service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:59.396872 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-653ed08c-3849-446a-bcf6-4c9cec541368 req-3d741d73-16ca-49b4-ad40-f2242a80e22c service nova] Creating event network-changed:4e68cc61-1f92-4323-863f-24fb89d25061 for instance 76d6b110-febc-4f28-8367-a0c9ef077177 on n-h1-master-1 Oct 30 01:32:59.405711 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-653ed08c-3849-446a-bcf6-4c9cec541368 req-3d741d73-16ca-49b4-ad40-f2242a80e22c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041000 Oct 30 01:32:59.407504 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2196/4414] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:32:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:32:59.413607 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3daee16e-a84b-4bb9-b120-d2f57aae1447 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:59.414701 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3daee16e-a84b-4bb9-b120-d2f57aae1447 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] [instance: 76d6b110-febc-4f28-8367-a0c9ef077177] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:59.422006 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3daee16e-a84b-4bb9-b120-d2f57aae1447 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:59.422712 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3daee16e-a84b-4bb9-b120-d2f57aae1447 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:59.423302 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3daee16e-a84b-4bb9-b120-d2f57aae1447 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:59.424166 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3daee16e-a84b-4bb9-b120-d2f57aae1447 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:59.424808 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3daee16e-a84b-4bb9-b120-d2f57aae1447 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:59.425419 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3daee16e-a84b-4bb9-b120-d2f57aae1447 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:59.539190 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-89d716ce-e708-4385-9789-8b351ed76f24 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f" status: 204 len: 0 microversion: 2.1 time: 0.566721 Oct 30 01:32:59.540169 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2219/4415] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:32:58 2022] DELETE /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f => generated 0 bytes in 569 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:32:59.549468 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b515ece4-c775-453a-b62b-bdeb9fda1992 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:59.550373 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b515ece4-c775-453a-b62b-bdeb9fda1992 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 2873be88-5d85-49c6-833f-19b7df1fcf5f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:59.561049 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b515ece4-c775-453a-b62b-bdeb9fda1992 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:59.561049 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b515ece4-c775-453a-b62b-bdeb9fda1992 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:59.561049 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b515ece4-c775-453a-b62b-bdeb9fda1992 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:59.561049 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b515ece4-c775-453a-b62b-bdeb9fda1992 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:59.561708 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b515ece4-c775-453a-b62b-bdeb9fda1992 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:59.562321 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b515ece4-c775-453a-b62b-bdeb9fda1992 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:59.904612 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3daee16e-a84b-4bb9-b120-d2f57aae1447 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ac5422c8f048148aac2c9b62e0482e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d179276dbf4e4d9cb780b18e7a22c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:32:59.920165 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3daee16e-a84b-4bb9-b120-d2f57aae1447 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "GET /compute/v2.1/servers/76d6b110-febc-4f28-8367-a0c9ef077177" status: 200 len: 1316 microversion: 2.1 time: 0.508953 Oct 30 01:32:59.923230 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2197/4416] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:59 2022] GET /compute/v2.1/servers/76d6b110-febc-4f28-8367-a0c9ef077177 => generated 1316 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:32:59.971491 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-afdb01b0-0fd0-4460-b40f-af73b5bc9e3f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:32:59.973218 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-afdb01b0-0fd0-4460-b40f-af73b5bc9e3f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:32:59.989390 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-afdb01b0-0fd0-4460-b40f-af73b5bc9e3f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:59.990290 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-afdb01b0-0fd0-4460-b40f-af73b5bc9e3f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:59.990873 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-afdb01b0-0fd0-4460-b40f-af73b5bc9e3f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:32:59.991957 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-afdb01b0-0fd0-4460-b40f-af73b5bc9e3f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:32:59.992555 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-afdb01b0-0fd0-4460-b40f-af73b5bc9e3f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:32:59.993161 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-afdb01b0-0fd0-4460-b40f-af73b5bc9e3f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:00.055619 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b515ece4-c775-453a-b62b-bdeb9fda1992 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:00.070409 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b515ece4-c775-453a-b62b-bdeb9fda1992 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f" status: 200 len: 1509 microversion: 2.1 time: 0.525086 Oct 30 01:33:00.086527 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2220/4417] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:59 2022] GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f => generated 1509 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:33:00.098629 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2e9d70ca-ca14-4f05-b518-cf3824384427 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:00.100049 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2e9d70ca-ca14-4f05-b518-cf3824384427 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:00.117708 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2e9d70ca-ca14-4f05-b518-cf3824384427 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:00.118473 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2e9d70ca-ca14-4f05-b518-cf3824384427 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:00.120460 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2e9d70ca-ca14-4f05-b518-cf3824384427 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:00.121539 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2e9d70ca-ca14-4f05-b518-cf3824384427 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:00.122183 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2e9d70ca-ca14-4f05-b518-cf3824384427 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:00.124729 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2e9d70ca-ca14-4f05-b518-cf3824384427 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:00.399641 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2e9d70ca-ca14-4f05-b518-cf3824384427 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:00.419760 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2e9d70ca-ca14-4f05-b518-cf3824384427 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e" status: 200 len: 1494 microversion: 2.1 time: 0.330297 Oct 30 01:33:00.419760 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2221/4418] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:00 2022] GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e => generated 1494 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:00.430042 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-dfbaaba4-ba31-463d-bbc2-9b4ee64e0b8d tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:00.430681 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-afdb01b0-0fd0-4460-b40f-af73b5bc9e3f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:00.434103 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-dfbaaba4-ba31-463d-bbc2-9b4ee64e0b8d tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: 86461b51-bd22-446e-a37e-985c21f7ccd5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:00.441968 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-afdb01b0-0fd0-4460-b40f-af73b5bc9e3f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1488 microversion: 2.1 time: 0.479210 Oct 30 01:33:00.448271 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2198/4419] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:32:59 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1488 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:33:00.450412 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dfbaaba4-ba31-463d-bbc2-9b4ee64e0b8d tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:00.451420 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dfbaaba4-ba31-463d-bbc2-9b4ee64e0b8d tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:00.454076 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dfbaaba4-ba31-463d-bbc2-9b4ee64e0b8d tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:00.458712 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dfbaaba4-ba31-463d-bbc2-9b4ee64e0b8d tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:00.459474 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dfbaaba4-ba31-463d-bbc2-9b4ee64e0b8d tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:00.460152 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dfbaaba4-ba31-463d-bbc2-9b4ee64e0b8d tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:00.471367 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-733006f4-4dc1-430a-b304-5d360ebad155 req-46846688-f178-4b24-8045-a9e9ce1efa01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86461b51-bd22-446e-a37e-985c21f7ccd5", "name": "network-vif-deleted", "tag": "3ba507d6-8a48-4fde-8971-0dc59fbc5a1d"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:33:00.479527 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:00.498456 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-733006f4-4dc1-430a-b304-5d360ebad155 req-46846688-f178-4b24-8045-a9e9ce1efa01 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:00.498941 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-733006f4-4dc1-430a-b304-5d360ebad155 req-46846688-f178-4b24-8045-a9e9ce1efa01 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:00.501474 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-733006f4-4dc1-430a-b304-5d360ebad155 req-46846688-f178-4b24-8045-a9e9ce1efa01 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:00.527013 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-733006f4-4dc1-430a-b304-5d360ebad155 req-46846688-f178-4b24-8045-a9e9ce1efa01 service nova] Creating event network-vif-deleted:3ba507d6-8a48-4fde-8971-0dc59fbc5a1d for instance 86461b51-bd22-446e-a37e-985c21f7ccd5 on n-h2-master-1 Oct 30 01:33:00.534587 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-733006f4-4dc1-430a-b304-5d360ebad155 req-46846688-f178-4b24-8045-a9e9ce1efa01 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072923 Oct 30 01:33:00.535137 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2199/4420] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:33:00.541817 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0b835f05-ddc5-4499-95ce-bcf7a9886533 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:33:00.542521 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0b835f05-ddc5-4499-95ce-bcf7a9886533 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:00.549832 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b835f05-ddc5-4499-95ce-bcf7a9886533 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:00.550569 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b835f05-ddc5-4499-95ce-bcf7a9886533 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:00.551183 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b835f05-ddc5-4499-95ce-bcf7a9886533 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:00.551915 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b835f05-ddc5-4499-95ce-bcf7a9886533 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:00.552369 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b835f05-ddc5-4499-95ce-bcf7a9886533 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:00.552805 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b835f05-ddc5-4499-95ce-bcf7a9886533 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:00.583036 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-0b835f05-ddc5-4499-95ce-bcf7a9886533 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] HTTP exception thrown: Cannot 'pause' instance b0c51345-2948-4ff1-828f-8c70b2b979f2 while it is in vm_state paused Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0b835f05-ddc5-4499-95ce-bcf7a9886533 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Request method failure captured: Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: request: POST /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2/action HTTP/1.1 Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 13 Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdPsZZXjRvWKe2zWP-5VH1VYAsWsLLjUmpyob2uINkfAXNLt0qGMmCTWjYn2WpZ3XOOdsuaM4lwk-qZrOIX3mOHzuCJPZ3r-9M-w153XBWLoTow-eSMj1bsAWDNo3KKhMzjHqic8AJ-DcXpdsBh93g0dRB_UMWMRrGyY1cbSRdHJrvg Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 0bce487302c24def8a8473b0725904f2 Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: {"pause": {}} Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: exception: Cannot 'pause' instance b0c51345-2948-4ff1-828f-8c70b2b979f2 while it is in vm_state paused Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'b0c51345-2948-4ff1-828f-8c70b2b979f2', 'body': {'pause': {}}} Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b0c51345-2948-4ff1-828f-8c70b2b979f2 in vm_state paused. Cannot pause while the instance is in this state. Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance b0c51345-2948-4ff1-828f-8c70b2b979f2 while it is in vm_state paused Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:00.584889 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:00.588750 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:00.588750 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:33:00.588750 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:33:00.588750 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance b0c51345-2948-4ff1-828f-8c70b2b979f2 while it is in vm_state paused Oct 30 01:33:00.588750 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:00.588750 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0b835f05-ddc5-4499-95ce-bcf7a9886533 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Returning 409 to user: Cannot 'pause' instance b0c51345-2948-4ff1-828f-8c70b2b979f2 while it is in vm_state paused {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:33:00.588750 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0b835f05-ddc5-4499-95ce-bcf7a9886533 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "POST /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2/action" status: 409 len: 143 microversion: 2.1 time: 0.049973 Oct 30 01:33:00.594731 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2200/4421] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:33:00 2022] POST /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2/action => generated 143 bytes in 55 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:33:00.596379 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e05336c2-6d88-4199-8095-0534cff0bbca tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:33:00.596937 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e05336c2-6d88-4199-8095-0534cff0bbca tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:00.604765 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e05336c2-6d88-4199-8095-0534cff0bbca tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:00.605513 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e05336c2-6d88-4199-8095-0534cff0bbca tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:00.606107 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e05336c2-6d88-4199-8095-0534cff0bbca tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:00.607046 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e05336c2-6d88-4199-8095-0534cff0bbca tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:00.607828 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e05336c2-6d88-4199-8095-0534cff0bbca tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:00.608412 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e05336c2-6d88-4199-8095-0534cff0bbca tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:00.657494 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-dfbaaba4-ba31-463d-bbc2-9b4ee64e0b8d tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:00.674675 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-dfbaaba4-ba31-463d-bbc2-9b4ee64e0b8d tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers/86461b51-bd22-446e-a37e-985c21f7ccd5" status: 200 len: 1476 microversion: 2.1 time: 0.254612 Oct 30 01:33:00.693002 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2222/4422] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:00 2022] GET /compute/v2.1/servers/86461b51-bd22-446e-a37e-985c21f7ccd5 => generated 1476 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:00.891542 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e05336c2-6d88-4199-8095-0534cff0bbca tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "POST /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2/action" status: 202 len: 0 microversion: 2.1 time: 0.298929 Oct 30 01:33:00.906410 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c6f68030-eb62-4048-bd21-229a7683e182 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:00.906410 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c6f68030-eb62-4048-bd21-229a7683e182 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:00.906590 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2201/4423] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:33:00 2022] POST /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 30 01:33:00.923428 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c6f68030-eb62-4048-bd21-229a7683e182 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:00.924238 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c6f68030-eb62-4048-bd21-229a7683e182 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:00.924835 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c6f68030-eb62-4048-bd21-229a7683e182 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:00.927157 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c6f68030-eb62-4048-bd21-229a7683e182 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:00.928044 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c6f68030-eb62-4048-bd21-229a7683e182 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:00.928647 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c6f68030-eb62-4048-bd21-229a7683e182 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:00.948816 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fe918049-012d-476f-9083-db7e5f036622 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:00.949790 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-fe918049-012d-476f-9083-db7e5f036622 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] [instance: 76d6b110-febc-4f28-8367-a0c9ef077177] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:00.959509 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe918049-012d-476f-9083-db7e5f036622 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:00.960208 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe918049-012d-476f-9083-db7e5f036622 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:00.960913 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe918049-012d-476f-9083-db7e5f036622 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:00.962501 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe918049-012d-476f-9083-db7e5f036622 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:00.964313 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe918049-012d-476f-9083-db7e5f036622 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:00.964939 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe918049-012d-476f-9083-db7e5f036622 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:01.210464 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c6f68030-eb62-4048-bd21-229a7683e182 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:01.232582 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c6f68030-eb62-4048-bd21-229a7683e182 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1495 microversion: 2.1 time: 0.323605 Oct 30 01:33:01.232582 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2223/4424] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:00 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1495 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:33:01.232582 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b669768a-8496-495d-bf3a-735169d768d3 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:01.247006 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b669768a-8496-495d-bf3a-735169d768d3 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 2873be88-5d85-49c6-833f-19b7df1fcf5f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:01.249653 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-fe918049-012d-476f-9083-db7e5f036622 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ac5422c8f048148aac2c9b62e0482e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d179276dbf4e4d9cb780b18e7a22c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:01.254858 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b669768a-8496-495d-bf3a-735169d768d3 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:01.258415 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b669768a-8496-495d-bf3a-735169d768d3 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:01.258415 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b669768a-8496-495d-bf3a-735169d768d3 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:01.258415 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b669768a-8496-495d-bf3a-735169d768d3 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:01.258415 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b669768a-8496-495d-bf3a-735169d768d3 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:01.258415 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b669768a-8496-495d-bf3a-735169d768d3 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:01.262944 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fe918049-012d-476f-9083-db7e5f036622 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "GET /compute/v2.1/servers/76d6b110-febc-4f28-8367-a0c9ef077177" status: 200 len: 1316 microversion: 2.1 time: 0.318949 Oct 30 01:33:01.265497 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2202/4425] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:00 2022] GET /compute/v2.1/servers/76d6b110-febc-4f28-8367-a0c9ef077177 => generated 1316 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:33:01.442468 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0e4c6260-ad0e-40ed-becc-ff7e4248ffb0 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:01.451457 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0e4c6260-ad0e-40ed-becc-ff7e4248ffb0 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:01.465942 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0e4c6260-ad0e-40ed-becc-ff7e4248ffb0 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:01.469126 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0e4c6260-ad0e-40ed-becc-ff7e4248ffb0 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:01.470192 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0e4c6260-ad0e-40ed-becc-ff7e4248ffb0 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:01.472797 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0e4c6260-ad0e-40ed-becc-ff7e4248ffb0 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:01.474190 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0e4c6260-ad0e-40ed-becc-ff7e4248ffb0 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:01.477498 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0e4c6260-ad0e-40ed-becc-ff7e4248ffb0 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:01.515714 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0e4c6260-ad0e-40ed-becc-ff7e4248ffb0 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:01.516212 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0e4c6260-ad0e-40ed-becc-ff7e4248ffb0 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:01.516912 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0e4c6260-ad0e-40ed-becc-ff7e4248ffb0 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:01.517856 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-0e4c6260-ad0e-40ed-becc-ff7e4248ffb0 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lazy-loading 'fault' on Instance uuid 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:33:01.525600 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:01.597972 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0e4c6260-ad0e-40ed-becc-ff7e4248ffb0 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:01.609174 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0e4c6260-ad0e-40ed-becc-ff7e4248ffb0 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e" status: 200 len: 1310 microversion: 2.1 time: 0.171018 Oct 30 01:33:01.610118 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2203/4426] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:01 2022] GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e => generated 1310 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:01.615341 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-c9e97f21-ac98-4f99-9825-e072e1cccc00 req-bb9624c9-f608-48e5-874f-ed90b9db8ef6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e", "name": "network-vif-deleted", "tag": "e6aa1f7f-1ffc-497f-bd6e-91828753a483"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:33:01.626135 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-c9e97f21-ac98-4f99-9825-e072e1cccc00 req-bb9624c9-f608-48e5-874f-ed90b9db8ef6 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:01.629735 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-c9e97f21-ac98-4f99-9825-e072e1cccc00 req-bb9624c9-f608-48e5-874f-ed90b9db8ef6 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:01.629735 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-c9e97f21-ac98-4f99-9825-e072e1cccc00 req-bb9624c9-f608-48e5-874f-ed90b9db8ef6 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:01.639038 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-c9e97f21-ac98-4f99-9825-e072e1cccc00 req-bb9624c9-f608-48e5-874f-ed90b9db8ef6 service nova] Creating event network-vif-deleted:e6aa1f7f-1ffc-497f-bd6e-91828753a483 for instance 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e on n-h2-master-1 Oct 30 01:33:01.643921 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-c9e97f21-ac98-4f99-9825-e072e1cccc00 req-bb9624c9-f608-48e5-874f-ed90b9db8ef6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032543 Oct 30 01:33:01.644525 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2204/4427] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:33:01.667316 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b669768a-8496-495d-bf3a-735169d768d3 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:01.675158 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b669768a-8496-495d-bf3a-735169d768d3 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f" status: 200 len: 1509 microversion: 2.1 time: 0.450294 Oct 30 01:33:01.675737 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2224/4428] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:01 2022] GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f => generated 1509 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:01.700588 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6dfa2307-6153-4978-8492-40518e22dbfb tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:01.701296 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6dfa2307-6153-4978-8492-40518e22dbfb tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: 86461b51-bd22-446e-a37e-985c21f7ccd5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:01.707289 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6dfa2307-6153-4978-8492-40518e22dbfb tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:01.707772 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6dfa2307-6153-4978-8492-40518e22dbfb tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:01.708205 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6dfa2307-6153-4978-8492-40518e22dbfb tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:01.708892 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6dfa2307-6153-4978-8492-40518e22dbfb tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:01.709357 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6dfa2307-6153-4978-8492-40518e22dbfb tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:01.709854 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6dfa2307-6153-4978-8492-40518e22dbfb tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:01.743302 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6dfa2307-6153-4978-8492-40518e22dbfb tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:01.744530 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6dfa2307-6153-4978-8492-40518e22dbfb tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:01.745106 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6dfa2307-6153-4978-8492-40518e22dbfb tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:01.745728 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-6dfa2307-6153-4978-8492-40518e22dbfb tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lazy-loading 'fault' on Instance uuid 86461b51-bd22-446e-a37e-985c21f7ccd5 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:33:01.850722 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6dfa2307-6153-4978-8492-40518e22dbfb tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:01.860222 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6dfa2307-6153-4978-8492-40518e22dbfb tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers/86461b51-bd22-446e-a37e-985c21f7ccd5" status: 200 len: 1310 microversion: 2.1 time: 0.163755 Oct 30 01:33:01.862177 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2205/4429] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:01 2022] GET /compute/v2.1/servers/86461b51-bd22-446e-a37e-985c21f7ccd5 => generated 1310 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:02.257445 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7b6d475f-5851-4efc-8e5d-05032000262e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:02.258069 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7b6d475f-5851-4efc-8e5d-05032000262e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:02.261688 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=6 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:02.266525 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b6d475f-5851-4efc-8e5d-05032000262e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:02.267011 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b6d475f-5851-4efc-8e5d-05032000262e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:02.267442 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b6d475f-5851-4efc-8e5d-05032000262e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:02.268139 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b6d475f-5851-4efc-8e5d-05032000262e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:02.268588 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b6d475f-5851-4efc-8e5d-05032000262e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:02.269013 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b6d475f-5851-4efc-8e5d-05032000262e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:02.286392 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3a34d102-951c-4921-8a21-b95a9bf917c3 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:02.287005 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3a34d102-951c-4921-8a21-b95a9bf917c3 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] [instance: 76d6b110-febc-4f28-8367-a0c9ef077177] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:02.294069 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3a34d102-951c-4921-8a21-b95a9bf917c3 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:02.294795 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3a34d102-951c-4921-8a21-b95a9bf917c3 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:02.298799 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3a34d102-951c-4921-8a21-b95a9bf917c3 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:02.298799 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3a34d102-951c-4921-8a21-b95a9bf917c3 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:02.298799 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3a34d102-951c-4921-8a21-b95a9bf917c3 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:02.298799 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3a34d102-951c-4921-8a21-b95a9bf917c3 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:03.013142 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7b6d475f-5851-4efc-8e5d-05032000262e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:03.022374 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7b6d475f-5851-4efc-8e5d-05032000262e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.768827 Oct 30 01:33:03.023280 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2225/4430] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:02 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:03.029063 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-87ba7fc8-417c-46a3-828b-721cc01f8b55 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:03.030068 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-87ba7fc8-417c-46a3-828b-721cc01f8b55 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:03.039623 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3a34d102-951c-4921-8a21-b95a9bf917c3 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ac5422c8f048148aac2c9b62e0482e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d179276dbf4e4d9cb780b18e7a22c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:03.046216 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-87ba7fc8-417c-46a3-828b-721cc01f8b55 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:03.051608 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-87ba7fc8-417c-46a3-828b-721cc01f8b55 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:03.051608 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-87ba7fc8-417c-46a3-828b-721cc01f8b55 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:03.051608 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-87ba7fc8-417c-46a3-828b-721cc01f8b55 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:03.051608 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-87ba7fc8-417c-46a3-828b-721cc01f8b55 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:03.051608 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-87ba7fc8-417c-46a3-828b-721cc01f8b55 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:03.052358 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3a34d102-951c-4921-8a21-b95a9bf917c3 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "GET /compute/v2.1/servers/76d6b110-febc-4f28-8367-a0c9ef077177" status: 200 len: 1316 microversion: 2.1 time: 0.769667 Oct 30 01:33:03.053287 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2206/4431] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:02 2022] GET /compute/v2.1/servers/76d6b110-febc-4f28-8367-a0c9ef077177 => generated 1316 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:03.062673 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e7fb8eb1-bcc6-43ca-9e45-6b1cfe0c3913 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:03.063515 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e7fb8eb1-bcc6-43ca-9e45-6b1cfe0c3913 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 2873be88-5d85-49c6-833f-19b7df1fcf5f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:03.078558 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7fb8eb1-bcc6-43ca-9e45-6b1cfe0c3913 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:03.082675 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7fb8eb1-bcc6-43ca-9e45-6b1cfe0c3913 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:03.083182 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7fb8eb1-bcc6-43ca-9e45-6b1cfe0c3913 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:03.083933 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7fb8eb1-bcc6-43ca-9e45-6b1cfe0c3913 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:03.084402 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7fb8eb1-bcc6-43ca-9e45-6b1cfe0c3913 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:03.084831 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7fb8eb1-bcc6-43ca-9e45-6b1cfe0c3913 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:03.091838 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-87ba7fc8-417c-46a3-828b-721cc01f8b55 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] HTTP exception thrown: Instance 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e could not be found. Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-87ba7fc8-417c-46a3-828b-721cc01f8b55 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Request method failure captured: Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e HTTP/1.1 Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdNZbeUR7skwu5ylmljymLwmsn3OMAB7HFdlDZsip3dgOK-vaOPPSwUYmWT_o9z2OqWc9cL2Rd22cHSa-BN8vqcvBTHGvFnuVH3dT1kVAQG6ODQVt2oxoFKeXYoNTjg1JUCF1B7Vzk2gVPeSesCiSDD37BDZ3_Wp6AgzZI4w4KMCOXw Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 45fe1c50eaee40249b6c20cc91e52586 Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServersTestJSON-1478392549 Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServersTestJSON-1478392549 Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 45fe1c50eaee40249b6c20cc91e52586 Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServersTestJSON-1478392549 Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServersTestJSON-1478392549-project Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: ef5f8a3e6fef4d6393603575479b16a2 Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServersTestJSON-1478392549-project Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e could not be found. Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e'} Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e could not be found. Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e could not be found. Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:03.093557 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:03.097098 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:03.097098 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:03.097098 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:03.097098 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:33:03.097098 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:33:03.097098 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e could not be found. Oct 30 01:33:03.097098 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:03.097098 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-87ba7fc8-417c-46a3-828b-721cc01f8b55 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Returning 404 to user: Instance 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:33:03.097098 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-87ba7fc8-417c-46a3-828b-721cc01f8b55 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e" status: 404 len: 111 microversion: 2.1 time: 0.070560 Oct 30 01:33:03.097098 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2226/4432] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:03 2022] GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:33:03.116791 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3a0f8cae-cf7f-4a60-bf22-f26ddff342d3 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:03.117435 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3a0f8cae-cf7f-4a60-bf22-f26ddff342d3 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: 86461b51-bd22-446e-a37e-985c21f7ccd5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:03.131432 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a0f8cae-cf7f-4a60-bf22-f26ddff342d3 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:03.131936 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a0f8cae-cf7f-4a60-bf22-f26ddff342d3 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:03.132371 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a0f8cae-cf7f-4a60-bf22-f26ddff342d3 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:03.133080 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a0f8cae-cf7f-4a60-bf22-f26ddff342d3 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:03.133565 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a0f8cae-cf7f-4a60-bf22-f26ddff342d3 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:03.133992 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a0f8cae-cf7f-4a60-bf22-f26ddff342d3 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:03.149211 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-3a0f8cae-cf7f-4a60-bf22-f26ddff342d3 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] HTTP exception thrown: Instance 86461b51-bd22-446e-a37e-985c21f7ccd5 could not be found. Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3a0f8cae-cf7f-4a60-bf22-f26ddff342d3 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Request method failure captured: Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/86461b51-bd22-446e-a37e-985c21f7ccd5 HTTP/1.1 Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdQDYci6teSCD8FW03WnqGGSAYCFc3LwP63Rw8Z0U3xVdCko3fGaoma0FdHMlHYZHY323ocvivJeSjvJElJAt33CZMiA61iE55fdR-I2KewZoQUxzJABDW30I3YnxeC3KFzcn39azj6Ca-ZFZp-_EtsqYWNeIpBYa4VulNkXEM1b8xY Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 8b25b290c8004e1f8f89e17b448f242a Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ListServerFiltersTestJSON-1179388771 Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8b25b290c8004e1f8f89e17b448f242a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8b25b290c8004e1f8f89e17b448f242a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8b25b290c8004e1f8f89e17b448f242a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8b25b290c8004e1f8f89e17b448f242a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ListServerFiltersTestJSON-1179388771 Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 8b25b290c8004e1f8f89e17b448f242a Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1179388771 Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ListServerFiltersTestJSON-1179388771-project Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: b0d4603acbc846dcb2f523091cd78ae4 Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ListServerFiltersTestJSON-1179388771-project Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 86461b51-bd22-446e-a37e-985c21f7ccd5 could not be found. Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '86461b51-bd22-446e-a37e-985c21f7ccd5'} Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86461b51-bd22-446e-a37e-985c21f7ccd5 could not be found. Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86461b51-bd22-446e-a37e-985c21f7ccd5 could not be found. Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:03.150712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:03.154789 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:03.154789 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:03.154789 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:03.154789 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:33:03.154789 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:33:03.154789 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86461b51-bd22-446e-a37e-985c21f7ccd5 could not be found. Oct 30 01:33:03.154789 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:03.154789 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3a0f8cae-cf7f-4a60-bf22-f26ddff342d3 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Returning 404 to user: Instance 86461b51-bd22-446e-a37e-985c21f7ccd5 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:33:03.154789 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3a0f8cae-cf7f-4a60-bf22-f26ddff342d3 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers/86461b51-bd22-446e-a37e-985c21f7ccd5" status: 404 len: 111 microversion: 2.1 time: 0.054294 Oct 30 01:33:03.154789 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2227/4433] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:03 2022] GET /compute/v2.1/servers/86461b51-bd22-446e-a37e-985c21f7ccd5 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:33:03.160305 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-019e1ab9-f8ee-42b1-b2f8-c732d05aaaad tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:03.160911 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-019e1ab9-f8ee-42b1-b2f8-c732d05aaaad tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:03.167469 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-019e1ab9-f8ee-42b1-b2f8-c732d05aaaad tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:03.167959 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-019e1ab9-f8ee-42b1-b2f8-c732d05aaaad tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:03.168689 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-019e1ab9-f8ee-42b1-b2f8-c732d05aaaad tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:03.169265 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-019e1ab9-f8ee-42b1-b2f8-c732d05aaaad tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:03.169784 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-019e1ab9-f8ee-42b1-b2f8-c732d05aaaad tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:03.170211 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-019e1ab9-f8ee-42b1-b2f8-c732d05aaaad tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:03.187449 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:03.536250 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e7fb8eb1-bcc6-43ca-9e45-6b1cfe0c3913 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:03.557467 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e7fb8eb1-bcc6-43ca-9e45-6b1cfe0c3913 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f" status: 200 len: 1509 microversion: 2.1 time: 0.501428 Oct 30 01:33:03.560941 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2207/4434] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:03 2022] GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f => generated 1509 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:03.570038 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-61c2f60b-32b3-490e-83aa-cc81524c2024 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:03.571266 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-61c2f60b-32b3-490e-83aa-cc81524c2024 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:03.580302 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-019e1ab9-f8ee-42b1-b2f8-c732d05aaaad tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:03.585437 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-61c2f60b-32b3-490e-83aa-cc81524c2024 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:03.585437 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-61c2f60b-32b3-490e-83aa-cc81524c2024 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:03.585437 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-61c2f60b-32b3-490e-83aa-cc81524c2024 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:03.585437 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-61c2f60b-32b3-490e-83aa-cc81524c2024 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:03.585437 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-61c2f60b-32b3-490e-83aa-cc81524c2024 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:03.585437 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-61c2f60b-32b3-490e-83aa-cc81524c2024 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:03.589529 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-019e1ab9-f8ee-42b1-b2f8-c732d05aaaad tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.432767 Oct 30 01:33:03.605636 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-61c2f60b-32b3-490e-83aa-cc81524c2024 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] HTTP exception thrown: Instance 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e could not be found. Oct 30 01:33:03.606513 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2228/4435] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:03 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-61c2f60b-32b3-490e-83aa-cc81524c2024 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Request method failure captured: Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: request: DELETE /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e HTTP/1.1 Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdNZbeUR7skwu5ylmljymLwmsn3OMAB7HFdlDZsip3dgOK-vaOPPSwUYmWT_o9z2OqWc9cL2Rd22cHSa-BN8vqcvBTHGvFnuVH3dT1kVAQG6ODQVt2oxoFKeXYoNTjg1JUCF1B7Vzk2gVPeSesCiSDD37BDZ3_Wp6AgzZI4w4KMCOXw Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 45fe1c50eaee40249b6c20cc91e52586 Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersTestJSON-1478392549 Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersTestJSON-1478392549 Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 45fe1c50eaee40249b6c20cc91e52586 Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersTestJSON-1478392549 Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersTestJSON-1478392549-project Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: ef5f8a3e6fef4d6393603575479b16a2 Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersTestJSON-1478392549-project Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e could not be found. Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e'} Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e could not be found. Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:33:03.606627 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e could not be found. Oct 30 01:33:03.614598 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:03.614598 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:03.614598 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:03.614598 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:03.614598 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:03.614598 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:03.614598 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:33:03.614598 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:33:03.614598 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e could not be found. Oct 30 01:33:03.614598 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:03.614598 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-61c2f60b-32b3-490e-83aa-cc81524c2024 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Returning 404 to user: Instance 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:33:03.614598 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-61c2f60b-32b3-490e-83aa-cc81524c2024 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "DELETE /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e" status: 404 len: 111 microversion: 2.1 time: 0.046511 Oct 30 01:33:03.614598 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2208/4436] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:33:03 2022] DELETE /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:33:03.616593 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b39fdf68-f2c2-476b-8b8e-3fe1ffaffede tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:03.617119 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b39fdf68-f2c2-476b-8b8e-3fe1ffaffede tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: 6573b259-e50d-4954-9d64-3c914df97308] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:03.622080 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-281c62c9-f4b3-4eee-a183-bd205e1d44ce tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:33:03.623856 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b39fdf68-f2c2-476b-8b8e-3fe1ffaffede tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:03.624352 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b39fdf68-f2c2-476b-8b8e-3fe1ffaffede tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:03.625397 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b39fdf68-f2c2-476b-8b8e-3fe1ffaffede tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:03.625517 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b39fdf68-f2c2-476b-8b8e-3fe1ffaffede tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:03.625966 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b39fdf68-f2c2-476b-8b8e-3fe1ffaffede tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:03.626391 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b39fdf68-f2c2-476b-8b8e-3fe1ffaffede tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:03.628180 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-281c62c9-f4b3-4eee-a183-bd205e1d44ce tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: 03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:03.637483 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-281c62c9-f4b3-4eee-a183-bd205e1d44ce tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:03.637483 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-281c62c9-f4b3-4eee-a183-bd205e1d44ce tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:03.638702 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-281c62c9-f4b3-4eee-a183-bd205e1d44ce tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:03.639568 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-281c62c9-f4b3-4eee-a183-bd205e1d44ce tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:03.640173 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-281c62c9-f4b3-4eee-a183-bd205e1d44ce tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:03.640811 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-281c62c9-f4b3-4eee-a183-bd205e1d44ce tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:03.653581 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b39fdf68-f2c2-476b-8b8e-3fe1ffaffede tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: 6573b259-e50d-4954-9d64-3c914df97308] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:33:03.657249 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-281c62c9-f4b3-4eee-a183-bd205e1d44ce tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] HTTP exception thrown: Instance 03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5 could not be found. Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-281c62c9-f4b3-4eee-a183-bd205e1d44ce tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Request method failure captured: Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: request: POST /compute/v2.1/servers/03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5/action HTTP/1.1 Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 28 Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdPsZZXjRvWKe2zWP-5VH1VYAsWsLLjUmpyob2uINkfAXNLt0qGMmCTWjYn2WpZ3XOOdsuaM4lwk-qZrOIX3mOHzuCJPZ3r-9M-w153XBWLoTow-eSMj1bsAWDNo3KKhMzjHqic8AJ-DcXpdsBh93g0dRB_UMWMRrGyY1cbSRdHJrvg Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 0bce487302c24def8a8473b0725904f2 Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: {"reboot": {"type": "SOFT"}} Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5 could not be found. Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5', 'body': {'reboot': {'type': 'SOFT'}}} Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5 could not be found. Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:33:03.659114 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:33:03.665475 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5 could not be found. Oct 30 01:33:03.665475 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:03.665475 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:03.665475 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:03.665475 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:03.665475 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:03.665475 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:03.665475 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:33:03.665475 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:33:03.665475 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5 could not be found. Oct 30 01:33:03.665475 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:03.665475 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-281c62c9-f4b3-4eee-a183-bd205e1d44ce tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Returning 404 to user: Instance 03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:33:03.665475 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-281c62c9-f4b3-4eee-a183-bd205e1d44ce tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "POST /compute/v2.1/servers/03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5/action" status: 404 len: 111 microversion: 2.1 time: 0.043771 Oct 30 01:33:03.665475 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2209/4437] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:33:03 2022] POST /compute/v2.1/servers/03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5/action => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:33:03.669079 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-12b358af-2e62-42dd-b1bc-bad9bfbc1f27 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:03.669079 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-12b358af-2e62-42dd-b1bc-bad9bfbc1f27 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:03.675140 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-12b358af-2e62-42dd-b1bc-bad9bfbc1f27 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:03.675630 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-12b358af-2e62-42dd-b1bc-bad9bfbc1f27 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:03.676514 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-12b358af-2e62-42dd-b1bc-bad9bfbc1f27 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:03.677425 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-12b358af-2e62-42dd-b1bc-bad9bfbc1f27 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:03.677881 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-12b358af-2e62-42dd-b1bc-bad9bfbc1f27 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:03.678302 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-12b358af-2e62-42dd-b1bc-bad9bfbc1f27 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:03.696267 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-12b358af-2e62-42dd-b1bc-bad9bfbc1f27 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] HTTP exception thrown: Instance 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e could not be found. Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-12b358af-2e62-42dd-b1bc-bad9bfbc1f27 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Request method failure captured: Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e HTTP/1.1 Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdNZbeUR7skwu5ylmljymLwmsn3OMAB7HFdlDZsip3dgOK-vaOPPSwUYmWT_o9z2OqWc9cL2Rd22cHSa-BN8vqcvBTHGvFnuVH3dT1kVAQG6ODQVt2oxoFKeXYoNTjg1JUCF1B7Vzk2gVPeSesCiSDD37BDZ3_Wp6AgzZI4w4KMCOXw Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 45fe1c50eaee40249b6c20cc91e52586 Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersTestJSON-1478392549 Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersTestJSON-1478392549 Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 45fe1c50eaee40249b6c20cc91e52586 Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersTestJSON-1478392549 Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersTestJSON-1478392549-project Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: ef5f8a3e6fef4d6393603575479b16a2 Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersTestJSON-1478392549-project Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e could not be found. Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e'} Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e could not be found. Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e could not be found. Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:03.697857 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:03.702725 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:03.702725 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:03.702725 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:03.702725 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:33:03.702725 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:33:03.702725 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e could not be found. Oct 30 01:33:03.702725 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:03.702725 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-12b358af-2e62-42dd-b1bc-bad9bfbc1f27 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Returning 404 to user: Instance 93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:33:03.702725 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-12b358af-2e62-42dd-b1bc-bad9bfbc1f27 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e" status: 404 len: 111 microversion: 2.1 time: 0.036424 Oct 30 01:33:03.702725 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2210/4438] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:03 2022] GET /compute/v2.1/servers/93e2ac8a-9ba1-40a7-82ad-c42dfa525e2e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:33:03.709485 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-478941f4-22d2-46fd-9cd3-968816ee351f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:03.710489 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-478941f4-22d2-46fd-9cd3-968816ee351f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:03.716482 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-478941f4-22d2-46fd-9cd3-968816ee351f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:03.717181 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-478941f4-22d2-46fd-9cd3-968816ee351f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:03.717645 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-478941f4-22d2-46fd-9cd3-968816ee351f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:03.718448 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-478941f4-22d2-46fd-9cd3-968816ee351f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:03.718975 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-478941f4-22d2-46fd-9cd3-968816ee351f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:03.719475 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-478941f4-22d2-46fd-9cd3-968816ee351f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:03.780192 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=4 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:03.855643 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:03.924317 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b39fdf68-f2c2-476b-8b8e-3fe1ffaffede tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6573b259-e50d-4954-9d64-3c914df97308" status: 204 len: 0 microversion: 2.1 time: 0.312868 Oct 30 01:33:03.927638 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2229/4439] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:33:03 2022] DELETE /compute/v2.1/servers/6573b259-e50d-4954-9d64-3c914df97308 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:33:03.940019 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0e07bc25-aafd-4217-b05d-c1885d4564b7 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:03.941458 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0e07bc25-aafd-4217-b05d-c1885d4564b7 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 1ed9a8e0-aee6-4785-86b8-3d5113a6c838] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:03.956246 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e07bc25-aafd-4217-b05d-c1885d4564b7 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:03.959014 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e07bc25-aafd-4217-b05d-c1885d4564b7 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:03.959014 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e07bc25-aafd-4217-b05d-c1885d4564b7 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:03.959795 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e07bc25-aafd-4217-b05d-c1885d4564b7 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:03.960462 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e07bc25-aafd-4217-b05d-c1885d4564b7 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:03.961116 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e07bc25-aafd-4217-b05d-c1885d4564b7 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:03.984908 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-0e07bc25-aafd-4217-b05d-c1885d4564b7 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] HTTP exception thrown: Instance 1ed9a8e0-aee6-4785-86b8-3d5113a6c838 could not be found. Oct 30 01:33:03.985890 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-478941f4-22d2-46fd-9cd3-968816ee351f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0e07bc25-aafd-4217-b05d-c1885d4564b7 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Request method failure captured: Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/servers/1ed9a8e0-aee6-4785-86b8-3d5113a6c838 HTTP/1.1 Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdNZbeUR7skwu5ylmljymLwmsn3OMAB7HFdlDZsip3dgOK-vaOPPSwUYmWT_o9z2OqWc9cL2Rd22cHSa-BN8vqcvBTHGvFnuVH3dT1kVAQG6ODQVt2oxoFKeXYoNTjg1JUCF1B7Vzk2gVPeSesCiSDD37BDZ3_Wp6AgzZI4w4KMCOXw Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 45fe1c50eaee40249b6c20cc91e52586 Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServersTestJSON-1478392549 Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServersTestJSON-1478392549 Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 45fe1c50eaee40249b6c20cc91e52586 Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServersTestJSON-1478392549 Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServersTestJSON-1478392549-project Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: ef5f8a3e6fef4d6393603575479b16a2 Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServersTestJSON-1478392549-project Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 1ed9a8e0-aee6-4785-86b8-3d5113a6c838 could not be found. Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '1ed9a8e0-aee6-4785-86b8-3d5113a6c838'} Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ed9a8e0-aee6-4785-86b8-3d5113a6c838 could not be found. Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:33:03.986786 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ed9a8e0-aee6-4785-86b8-3d5113a6c838 could not be found. Oct 30 01:33:03.990526 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:03.990526 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:03.990526 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:03.990526 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:03.990526 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:03.990526 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:03.990526 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:33:03.990526 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:33:03.990526 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ed9a8e0-aee6-4785-86b8-3d5113a6c838 could not be found. Oct 30 01:33:03.990526 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:03.990526 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0e07bc25-aafd-4217-b05d-c1885d4564b7 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Returning 404 to user: Instance 1ed9a8e0-aee6-4785-86b8-3d5113a6c838 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:33:03.991405 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0e07bc25-aafd-4217-b05d-c1885d4564b7 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "DELETE /compute/v2.1/servers/1ed9a8e0-aee6-4785-86b8-3d5113a6c838" status: 404 len: 111 microversion: 2.1 time: 0.062093 Oct 30 01:33:03.992486 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2230/4440] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:33:03 2022] DELETE /compute/v2.1/servers/1ed9a8e0-aee6-4785-86b8-3d5113a6c838 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:33:03.996582 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-478941f4-22d2-46fd-9cd3-968816ee351f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.295797 Oct 30 01:33:03.997156 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2211/4441] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:03 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:03.999604 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-c7c96a2b-ac74-4a6f-a8d8-f3c3b2c5b09b req-dc6c96ef-a5ff-443d-bbcf-ad9bb7d938ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2873be88-5d85-49c6-833f-19b7df1fcf5f", "name": "network-vif-deleted", "tag": "f71f2c8b-6275-46ae-8dfd-8ce7b99e2529"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:33:04.009045 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a0c72395-a3f8-4a63-b852-14514ede3213 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:04.010119 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a0c72395-a3f8-4a63-b852-14514ede3213 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: 6573b259-e50d-4954-9d64-3c914df97308] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:04.017885 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a0c72395-a3f8-4a63-b852-14514ede3213 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:04.018506 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a0c72395-a3f8-4a63-b852-14514ede3213 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:04.019225 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a0c72395-a3f8-4a63-b852-14514ede3213 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:04.020037 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a0c72395-a3f8-4a63-b852-14514ede3213 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:04.021179 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a0c72395-a3f8-4a63-b852-14514ede3213 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:04.021293 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-c7c96a2b-ac74-4a6f-a8d8-f3c3b2c5b09b req-dc6c96ef-a5ff-443d-bbcf-ad9bb7d938ed service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:04.021748 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-c7c96a2b-ac74-4a6f-a8d8-f3c3b2c5b09b req-dc6c96ef-a5ff-443d-bbcf-ad9bb7d938ed service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:04.022138 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-c7c96a2b-ac74-4a6f-a8d8-f3c3b2c5b09b req-dc6c96ef-a5ff-443d-bbcf-ad9bb7d938ed service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:04.022234 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a0c72395-a3f8-4a63-b852-14514ede3213 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:04.052350 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-c7c96a2b-ac74-4a6f-a8d8-f3c3b2c5b09b req-dc6c96ef-a5ff-443d-bbcf-ad9bb7d938ed service nova] Creating event network-vif-deleted:f71f2c8b-6275-46ae-8dfd-8ce7b99e2529 for instance 2873be88-5d85-49c6-833f-19b7df1fcf5f on n-h1-master-1 Oct 30 01:33:04.058870 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-c7c96a2b-ac74-4a6f-a8d8-f3c3b2c5b09b req-dc6c96ef-a5ff-443d-bbcf-ad9bb7d938ed service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064280 Oct 30 01:33:04.059640 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2231/4442] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:33:04.064896 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-436363b5-16cd-4ca2-a882-9b1cb2f93edc tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:04.065726 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-436363b5-16cd-4ca2-a882-9b1cb2f93edc tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 1ed9a8e0-aee6-4785-86b8-3d5113a6c838] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:04.073719 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-436363b5-16cd-4ca2-a882-9b1cb2f93edc tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:04.074211 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-436363b5-16cd-4ca2-a882-9b1cb2f93edc tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:04.074653 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-436363b5-16cd-4ca2-a882-9b1cb2f93edc tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:04.075360 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-436363b5-16cd-4ca2-a882-9b1cb2f93edc tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:04.075813 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-436363b5-16cd-4ca2-a882-9b1cb2f93edc tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:04.076401 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-436363b5-16cd-4ca2-a882-9b1cb2f93edc tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:04.093738 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-436363b5-16cd-4ca2-a882-9b1cb2f93edc tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] HTTP exception thrown: Instance 1ed9a8e0-aee6-4785-86b8-3d5113a6c838 could not be found. Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-436363b5-16cd-4ca2-a882-9b1cb2f93edc tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Request method failure captured: Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/1ed9a8e0-aee6-4785-86b8-3d5113a6c838 HTTP/1.1 Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdNZbeUR7skwu5ylmljymLwmsn3OMAB7HFdlDZsip3dgOK-vaOPPSwUYmWT_o9z2OqWc9cL2Rd22cHSa-BN8vqcvBTHGvFnuVH3dT1kVAQG6ODQVt2oxoFKeXYoNTjg1JUCF1B7Vzk2gVPeSesCiSDD37BDZ3_Wp6AgzZI4w4KMCOXw Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 45fe1c50eaee40249b6c20cc91e52586 Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServersTestJSON-1478392549 Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServersTestJSON-1478392549 Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 45fe1c50eaee40249b6c20cc91e52586 Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServersTestJSON-1478392549 Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServersTestJSON-1478392549-project Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: ef5f8a3e6fef4d6393603575479b16a2 Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServersTestJSON-1478392549-project Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 1ed9a8e0-aee6-4785-86b8-3d5113a6c838 could not be found. Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '1ed9a8e0-aee6-4785-86b8-3d5113a6c838'} Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ed9a8e0-aee6-4785-86b8-3d5113a6c838 could not be found. Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ed9a8e0-aee6-4785-86b8-3d5113a6c838 could not be found. Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:04.097294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:04.101768 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:04.101768 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:04.101768 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:04.101768 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:33:04.101768 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:33:04.101768 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ed9a8e0-aee6-4785-86b8-3d5113a6c838 could not be found. Oct 30 01:33:04.101768 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:04.102458 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-436363b5-16cd-4ca2-a882-9b1cb2f93edc tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Returning 404 to user: Instance 1ed9a8e0-aee6-4785-86b8-3d5113a6c838 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:33:04.102974 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-436363b5-16cd-4ca2-a882-9b1cb2f93edc tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/1ed9a8e0-aee6-4785-86b8-3d5113a6c838" status: 404 len: 111 microversion: 2.1 time: 0.042263 Oct 30 01:33:04.104521 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2232/4443] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:04 2022] GET /compute/v2.1/servers/1ed9a8e0-aee6-4785-86b8-3d5113a6c838 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:33:04.114017 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cf060d2f-bba8-4fd4-9c20-2798d87cbf45 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:04.114751 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cf060d2f-bba8-4fd4-9c20-2798d87cbf45 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:04.122067 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cf060d2f-bba8-4fd4-9c20-2798d87cbf45 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:04.124113 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cf060d2f-bba8-4fd4-9c20-2798d87cbf45 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:04.124642 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cf060d2f-bba8-4fd4-9c20-2798d87cbf45 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:04.125530 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cf060d2f-bba8-4fd4-9c20-2798d87cbf45 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:04.126051 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cf060d2f-bba8-4fd4-9c20-2798d87cbf45 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:04.126546 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cf060d2f-bba8-4fd4-9c20-2798d87cbf45 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:04.351097 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a0c72395-a3f8-4a63-b852-14514ede3213 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:04.362139 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a0c72395-a3f8-4a63-b852-14514ede3213 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers/6573b259-e50d-4954-9d64-3c914df97308" status: 200 len: 1519 microversion: 2.1 time: 0.363269 Oct 30 01:33:04.366002 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2212/4444] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:03 2022] GET /compute/v2.1/servers/6573b259-e50d-4954-9d64-3c914df97308 => generated 1519 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:04.372561 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-198bfc42-2b24-43a1-b5ae-7e7512a2aa1f tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:04.376823 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-198bfc42-2b24-43a1-b5ae-7e7512a2aa1f tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] [instance: 76d6b110-febc-4f28-8367-a0c9ef077177] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:04.383777 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-198bfc42-2b24-43a1-b5ae-7e7512a2aa1f tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:04.384975 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-198bfc42-2b24-43a1-b5ae-7e7512a2aa1f tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:04.385695 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-198bfc42-2b24-43a1-b5ae-7e7512a2aa1f tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:04.386520 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-198bfc42-2b24-43a1-b5ae-7e7512a2aa1f tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:04.386998 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-198bfc42-2b24-43a1-b5ae-7e7512a2aa1f tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:04.387413 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-198bfc42-2b24-43a1-b5ae-7e7512a2aa1f tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:04.435108 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-cf060d2f-bba8-4fd4-9c20-2798d87cbf45 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:04.443216 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cf060d2f-bba8-4fd4-9c20-2798d87cbf45 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.337683 Oct 30 01:33:04.444016 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2233/4445] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:04 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:04.449348 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a5a16b4f-6ea5-4487-a136-a966e0a5cf87 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:04.450010 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a5a16b4f-6ea5-4487-a136-a966e0a5cf87 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 8046842c-80bc-4713-81cf-7fecbe58a130] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:04.456138 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a5a16b4f-6ea5-4487-a136-a966e0a5cf87 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:04.456818 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a5a16b4f-6ea5-4487-a136-a966e0a5cf87 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:04.457451 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a5a16b4f-6ea5-4487-a136-a966e0a5cf87 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:04.458319 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a5a16b4f-6ea5-4487-a136-a966e0a5cf87 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:04.459067 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a5a16b4f-6ea5-4487-a136-a966e0a5cf87 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:04.459657 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a5a16b4f-6ea5-4487-a136-a966e0a5cf87 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:04.474170 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-a5a16b4f-6ea5-4487-a136-a966e0a5cf87 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] HTTP exception thrown: Instance 8046842c-80bc-4713-81cf-7fecbe58a130 could not be found. Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a5a16b4f-6ea5-4487-a136-a966e0a5cf87 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Request method failure captured: Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/servers/8046842c-80bc-4713-81cf-7fecbe58a130 HTTP/1.1 Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdNZbeUR7skwu5ylmljymLwmsn3OMAB7HFdlDZsip3dgOK-vaOPPSwUYmWT_o9z2OqWc9cL2Rd22cHSa-BN8vqcvBTHGvFnuVH3dT1kVAQG6ODQVt2oxoFKeXYoNTjg1JUCF1B7Vzk2gVPeSesCiSDD37BDZ3_Wp6AgzZI4w4KMCOXw Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 45fe1c50eaee40249b6c20cc91e52586 Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServersTestJSON-1478392549 Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServersTestJSON-1478392549 Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 45fe1c50eaee40249b6c20cc91e52586 Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServersTestJSON-1478392549 Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServersTestJSON-1478392549-project Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: ef5f8a3e6fef4d6393603575479b16a2 Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServersTestJSON-1478392549-project Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 8046842c-80bc-4713-81cf-7fecbe58a130 could not be found. Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '8046842c-80bc-4713-81cf-7fecbe58a130'} Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8046842c-80bc-4713-81cf-7fecbe58a130 could not be found. Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:33:04.475985 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8046842c-80bc-4713-81cf-7fecbe58a130 could not be found. Oct 30 01:33:04.480459 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:04.480459 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:04.480459 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:04.480459 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:04.480459 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:04.480459 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:04.480459 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:33:04.480459 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:33:04.480459 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8046842c-80bc-4713-81cf-7fecbe58a130 could not be found. Oct 30 01:33:04.480459 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:04.480459 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a5a16b4f-6ea5-4487-a136-a966e0a5cf87 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Returning 404 to user: Instance 8046842c-80bc-4713-81cf-7fecbe58a130 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:33:04.480459 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a5a16b4f-6ea5-4487-a136-a966e0a5cf87 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8046842c-80bc-4713-81cf-7fecbe58a130" status: 404 len: 111 microversion: 2.1 time: 0.032291 Oct 30 01:33:04.480459 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2234/4446] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:33:04 2022] DELETE /compute/v2.1/servers/8046842c-80bc-4713-81cf-7fecbe58a130 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:33:04.482889 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-970e2039-1bc5-4415-b17c-e0a4b95d1882 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:33:04.485047 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-970e2039-1bc5-4415-b17c-e0a4b95d1882 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: 3f2728ee-3223-4f6f-af71-74701b319d53] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:04.490416 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-970e2039-1bc5-4415-b17c-e0a4b95d1882 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] HTTP exception thrown: Instance 3f2728ee-3223-4f6f-af71-74701b319d53 could not be found. Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-970e2039-1bc5-4415-b17c-e0a4b95d1882 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Request method failure captured: Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/servers/3f2728ee-3223-4f6f-af71-74701b319d53/action HTTP/1.1 Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 28 Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdPsZZXjRvWKe2zWP-5VH1VYAsWsLLjUmpyob2uINkfAXNLt0qGMmCTWjYn2WpZ3XOOdsuaM4lwk-qZrOIX3mOHzuCJPZ3r-9M-w153XBWLoTow-eSMj1bsAWDNo3KKhMzjHqic8AJ-DcXpdsBh93g0dRB_UMWMRrGyY1cbSRdHJrvg Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 0bce487302c24def8a8473b0725904f2 Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: {"reboot": {"type": "SOFT"}} Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 3f2728ee-3223-4f6f-af71-74701b319d53 could not be found. Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '3f2728ee-3223-4f6f-af71-74701b319d53', 'body': {'reboot': {'type': 'SOFT'}}} Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f2728ee-3223-4f6f-af71-74701b319d53 could not be found. Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f2728ee-3223-4f6f-af71-74701b319d53 could not be found. Oct 30 01:33:04.491936 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:04.501321 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:04.501321 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:04.501321 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:04.501321 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:04.501321 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:04.501321 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:33:04.501321 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:33:04.501321 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f2728ee-3223-4f6f-af71-74701b319d53 could not be found. Oct 30 01:33:04.501321 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:04.501321 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-970e2039-1bc5-4415-b17c-e0a4b95d1882 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Returning 404 to user: Instance 3f2728ee-3223-4f6f-af71-74701b319d53 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:33:04.501321 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-970e2039-1bc5-4415-b17c-e0a4b95d1882 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "POST /compute/v2.1/servers/3f2728ee-3223-4f6f-af71-74701b319d53/action" status: 404 len: 111 microversion: 2.1 time: 0.014059 Oct 30 01:33:04.501321 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2235/4447] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:33:04 2022] POST /compute/v2.1/servers/3f2728ee-3223-4f6f-af71-74701b319d53/action => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:33:04.501321 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9b1564af-272d-4d76-971e-e367a7d787b4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:04.501321 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9b1564af-272d-4d76-971e-e367a7d787b4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 8046842c-80bc-4713-81cf-7fecbe58a130] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:04.507548 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b1564af-272d-4d76-971e-e367a7d787b4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:04.507967 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b1564af-272d-4d76-971e-e367a7d787b4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:04.508454 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b1564af-272d-4d76-971e-e367a7d787b4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:04.509100 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b1564af-272d-4d76-971e-e367a7d787b4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:04.510112 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b1564af-272d-4d76-971e-e367a7d787b4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:04.510544 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b1564af-272d-4d76-971e-e367a7d787b4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:04.524071 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-9b1564af-272d-4d76-971e-e367a7d787b4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] HTTP exception thrown: Instance 8046842c-80bc-4713-81cf-7fecbe58a130 could not be found. Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9b1564af-272d-4d76-971e-e367a7d787b4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Request method failure captured: Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/8046842c-80bc-4713-81cf-7fecbe58a130 HTTP/1.1 Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdNZbeUR7skwu5ylmljymLwmsn3OMAB7HFdlDZsip3dgOK-vaOPPSwUYmWT_o9z2OqWc9cL2Rd22cHSa-BN8vqcvBTHGvFnuVH3dT1kVAQG6ODQVt2oxoFKeXYoNTjg1JUCF1B7Vzk2gVPeSesCiSDD37BDZ3_Wp6AgzZI4w4KMCOXw Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 45fe1c50eaee40249b6c20cc91e52586 Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServersTestJSON-1478392549 Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServersTestJSON-1478392549 Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 45fe1c50eaee40249b6c20cc91e52586 Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServersTestJSON-1478392549 Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServersTestJSON-1478392549-project Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: ef5f8a3e6fef4d6393603575479b16a2 Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServersTestJSON-1478392549-project Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 8046842c-80bc-4713-81cf-7fecbe58a130 could not be found. Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '8046842c-80bc-4713-81cf-7fecbe58a130'} Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8046842c-80bc-4713-81cf-7fecbe58a130 could not be found. Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8046842c-80bc-4713-81cf-7fecbe58a130 could not be found. Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:04.526294 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:04.530801 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:04.530801 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:04.530801 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:04.530801 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:33:04.530801 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:33:04.530801 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8046842c-80bc-4713-81cf-7fecbe58a130 could not be found. Oct 30 01:33:04.530801 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:04.530801 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9b1564af-272d-4d76-971e-e367a7d787b4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Returning 404 to user: Instance 8046842c-80bc-4713-81cf-7fecbe58a130 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:33:04.530801 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9b1564af-272d-4d76-971e-e367a7d787b4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/8046842c-80bc-4713-81cf-7fecbe58a130" status: 404 len: 111 microversion: 2.1 time: 0.032711 Oct 30 01:33:04.530801 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2236/4448] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:04 2022] GET /compute/v2.1/servers/8046842c-80bc-4713-81cf-7fecbe58a130 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:33:04.534995 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-06188294-44a3-463c-86ab-4cc82158e965 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:04.534995 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-06188294-44a3-463c-86ab-4cc82158e965 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:04.540251 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-06188294-44a3-463c-86ab-4cc82158e965 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:04.545177 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-06188294-44a3-463c-86ab-4cc82158e965 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:04.545177 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-06188294-44a3-463c-86ab-4cc82158e965 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:04.545440 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-198bfc42-2b24-43a1-b5ae-7e7512a2aa1f tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ac5422c8f048148aac2c9b62e0482e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d179276dbf4e4d9cb780b18e7a22c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:04.545874 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-06188294-44a3-463c-86ab-4cc82158e965 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:04.545874 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-06188294-44a3-463c-86ab-4cc82158e965 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:04.545874 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-06188294-44a3-463c-86ab-4cc82158e965 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:04.555799 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-198bfc42-2b24-43a1-b5ae-7e7512a2aa1f tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "GET /compute/v2.1/servers/76d6b110-febc-4f28-8367-a0c9ef077177" status: 200 len: 1316 microversion: 2.1 time: 0.188626 Oct 30 01:33:04.564295 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2213/4449] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:04 2022] GET /compute/v2.1/servers/76d6b110-febc-4f28-8367-a0c9ef077177 => generated 1316 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:04.578652 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5f678637-4535-4f50-a267-b6fffe754f94 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:04.578652 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5f678637-4535-4f50-a267-b6fffe754f94 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 98262d96-9a63-4531-9001-3fd0efd22014] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:04.586270 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f678637-4535-4f50-a267-b6fffe754f94 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:04.586820 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f678637-4535-4f50-a267-b6fffe754f94 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:04.588106 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f678637-4535-4f50-a267-b6fffe754f94 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:04.588632 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f678637-4535-4f50-a267-b6fffe754f94 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:04.589087 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f678637-4535-4f50-a267-b6fffe754f94 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:04.589892 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f678637-4535-4f50-a267-b6fffe754f94 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:04.604204 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-5f678637-4535-4f50-a267-b6fffe754f94 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] HTTP exception thrown: Instance 98262d96-9a63-4531-9001-3fd0efd22014 could not be found. Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5f678637-4535-4f50-a267-b6fffe754f94 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Request method failure captured: Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: request: DELETE /compute/v2.1/servers/98262d96-9a63-4531-9001-3fd0efd22014 HTTP/1.1 Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdNZbeUR7skwu5ylmljymLwmsn3OMAB7HFdlDZsip3dgOK-vaOPPSwUYmWT_o9z2OqWc9cL2Rd22cHSa-BN8vqcvBTHGvFnuVH3dT1kVAQG6ODQVt2oxoFKeXYoNTjg1JUCF1B7Vzk2gVPeSesCiSDD37BDZ3_Wp6AgzZI4w4KMCOXw Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 45fe1c50eaee40249b6c20cc91e52586 Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersTestJSON-1478392549 Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersTestJSON-1478392549 Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 45fe1c50eaee40249b6c20cc91e52586 Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersTestJSON-1478392549 Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersTestJSON-1478392549-project Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: ef5f8a3e6fef4d6393603575479b16a2 Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersTestJSON-1478392549-project Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 98262d96-9a63-4531-9001-3fd0efd22014 could not be found. Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '98262d96-9a63-4531-9001-3fd0efd22014'} Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98262d96-9a63-4531-9001-3fd0efd22014 could not be found. Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:33:04.605801 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98262d96-9a63-4531-9001-3fd0efd22014 could not be found. Oct 30 01:33:04.611222 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:04.611222 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:04.611222 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:04.611222 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:04.611222 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:04.611222 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:04.611222 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:33:04.611222 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:33:04.611222 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98262d96-9a63-4531-9001-3fd0efd22014 could not be found. Oct 30 01:33:04.611222 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:04.611222 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5f678637-4535-4f50-a267-b6fffe754f94 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Returning 404 to user: Instance 98262d96-9a63-4531-9001-3fd0efd22014 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:33:04.611222 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5f678637-4535-4f50-a267-b6fffe754f94 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "DELETE /compute/v2.1/servers/98262d96-9a63-4531-9001-3fd0efd22014" status: 404 len: 111 microversion: 2.1 time: 0.042086 Oct 30 01:33:04.611222 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2214/4450] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:33:04 2022] DELETE /compute/v2.1/servers/98262d96-9a63-4531-9001-3fd0efd22014 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:33:04.613500 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-51e6744e-110c-4ff5-9fe2-f22381ce2637 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:04.614110 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-51e6744e-110c-4ff5-9fe2-f22381ce2637 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 2873be88-5d85-49c6-833f-19b7df1fcf5f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:04.621043 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-51e6744e-110c-4ff5-9fe2-f22381ce2637 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:04.621567 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-51e6744e-110c-4ff5-9fe2-f22381ce2637 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:04.622003 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-51e6744e-110c-4ff5-9fe2-f22381ce2637 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:04.622701 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-51e6744e-110c-4ff5-9fe2-f22381ce2637 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:04.623154 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-51e6744e-110c-4ff5-9fe2-f22381ce2637 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:04.623587 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-51e6744e-110c-4ff5-9fe2-f22381ce2637 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:04.711846 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-51e6744e-110c-4ff5-9fe2-f22381ce2637 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:04.721972 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-51e6744e-110c-4ff5-9fe2-f22381ce2637 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f" status: 200 len: 1467 microversion: 2.1 time: 0.112642 Oct 30 01:33:04.723343 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2215/4451] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:04 2022] GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f => generated 1467 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:04.728853 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f4da4ad0-1fe3-4088-b929-52a89c978414 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:04.729753 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f4da4ad0-1fe3-4088-b929-52a89c978414 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 98262d96-9a63-4531-9001-3fd0efd22014] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:04.737131 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f4da4ad0-1fe3-4088-b929-52a89c978414 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:04.737950 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f4da4ad0-1fe3-4088-b929-52a89c978414 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:04.738576 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f4da4ad0-1fe3-4088-b929-52a89c978414 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:04.739577 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f4da4ad0-1fe3-4088-b929-52a89c978414 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:04.740034 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f4da4ad0-1fe3-4088-b929-52a89c978414 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:04.740457 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f4da4ad0-1fe3-4088-b929-52a89c978414 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:04.755914 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-f4da4ad0-1fe3-4088-b929-52a89c978414 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] HTTP exception thrown: Instance 98262d96-9a63-4531-9001-3fd0efd22014 could not be found. Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f4da4ad0-1fe3-4088-b929-52a89c978414 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Request method failure captured: Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/98262d96-9a63-4531-9001-3fd0efd22014 HTTP/1.1 Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdNZbeUR7skwu5ylmljymLwmsn3OMAB7HFdlDZsip3dgOK-vaOPPSwUYmWT_o9z2OqWc9cL2Rd22cHSa-BN8vqcvBTHGvFnuVH3dT1kVAQG6ODQVt2oxoFKeXYoNTjg1JUCF1B7Vzk2gVPeSesCiSDD37BDZ3_Wp6AgzZI4w4KMCOXw Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 45fe1c50eaee40249b6c20cc91e52586 Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersTestJSON-1478392549 Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersTestJSON-1478392549 Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 45fe1c50eaee40249b6c20cc91e52586 Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersTestJSON-1478392549 Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersTestJSON-1478392549-project Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: ef5f8a3e6fef4d6393603575479b16a2 Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersTestJSON-1478392549-project Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 98262d96-9a63-4531-9001-3fd0efd22014 could not be found. Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '98262d96-9a63-4531-9001-3fd0efd22014'} Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98262d96-9a63-4531-9001-3fd0efd22014 could not be found. Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98262d96-9a63-4531-9001-3fd0efd22014 could not be found. Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:04.757815 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:04.762730 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:04.762730 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:04.762730 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:04.762730 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:33:04.762730 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:33:04.762730 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98262d96-9a63-4531-9001-3fd0efd22014 could not be found. Oct 30 01:33:04.762730 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:04.764560 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f4da4ad0-1fe3-4088-b929-52a89c978414 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Returning 404 to user: Instance 98262d96-9a63-4531-9001-3fd0efd22014 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:33:04.765466 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f4da4ad0-1fe3-4088-b929-52a89c978414 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/98262d96-9a63-4531-9001-3fd0efd22014" status: 404 len: 111 microversion: 2.1 time: 0.041017 Oct 30 01:33:04.766201 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2216/4452] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:04 2022] GET /compute/v2.1/servers/98262d96-9a63-4531-9001-3fd0efd22014 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:33:04.779583 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ea1ce300-6dde-428a-bc39-17e68c6b375c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:04.784512 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ea1ce300-6dde-428a-bc39-17e68c6b375c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 06199cbd-cf2c-426d-a842-4dedd8359945] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:04.786365 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ea1ce300-6dde-428a-bc39-17e68c6b375c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:04.786865 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ea1ce300-6dde-428a-bc39-17e68c6b375c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:04.787299 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ea1ce300-6dde-428a-bc39-17e68c6b375c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:04.788008 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ea1ce300-6dde-428a-bc39-17e68c6b375c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:04.788463 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ea1ce300-6dde-428a-bc39-17e68c6b375c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:04.788888 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ea1ce300-6dde-428a-bc39-17e68c6b375c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:04.796194 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-06188294-44a3-463c-86ab-4cc82158e965 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:04.809693 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-ea1ce300-6dde-428a-bc39-17e68c6b375c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] HTTP exception thrown: Instance 06199cbd-cf2c-426d-a842-4dedd8359945 could not be found. Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ea1ce300-6dde-428a-bc39-17e68c6b375c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Request method failure captured: Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: request: DELETE /compute/v2.1/servers/06199cbd-cf2c-426d-a842-4dedd8359945 HTTP/1.1 Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdNZbeUR7skwu5ylmljymLwmsn3OMAB7HFdlDZsip3dgOK-vaOPPSwUYmWT_o9z2OqWc9cL2Rd22cHSa-BN8vqcvBTHGvFnuVH3dT1kVAQG6ODQVt2oxoFKeXYoNTjg1JUCF1B7Vzk2gVPeSesCiSDD37BDZ3_Wp6AgzZI4w4KMCOXw Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 45fe1c50eaee40249b6c20cc91e52586 Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersTestJSON-1478392549 Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersTestJSON-1478392549 Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 45fe1c50eaee40249b6c20cc91e52586 Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersTestJSON-1478392549 Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersTestJSON-1478392549-project Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: ef5f8a3e6fef4d6393603575479b16a2 Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersTestJSON-1478392549-project Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 06199cbd-cf2c-426d-a842-4dedd8359945 could not be found. Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '06199cbd-cf2c-426d-a842-4dedd8359945'} Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06199cbd-cf2c-426d-a842-4dedd8359945 could not be found. Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:33:04.811577 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06199cbd-cf2c-426d-a842-4dedd8359945 could not be found. Oct 30 01:33:04.815729 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:04.815729 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:04.815729 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:04.815729 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:04.815729 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:04.815729 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:04.815729 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:33:04.815729 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:33:04.815729 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06199cbd-cf2c-426d-a842-4dedd8359945 could not be found. Oct 30 01:33:04.815729 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:04.816484 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-06188294-44a3-463c-86ab-4cc82158e965 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.282714 Oct 30 01:33:04.817300 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ea1ce300-6dde-428a-bc39-17e68c6b375c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Returning 404 to user: Instance 06199cbd-cf2c-426d-a842-4dedd8359945 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:33:04.818209 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ea1ce300-6dde-428a-bc39-17e68c6b375c tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "DELETE /compute/v2.1/servers/06199cbd-cf2c-426d-a842-4dedd8359945" status: 404 len: 111 microversion: 2.1 time: 0.047358 Oct 30 01:33:04.818754 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2217/4453] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:33:04 2022] DELETE /compute/v2.1/servers/06199cbd-cf2c-426d-a842-4dedd8359945 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:33:04.822684 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2237/4454] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:04 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:04.835091 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1c8a86ad-17bd-4bcd-a96e-5412d5d91c5e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:04.835729 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1c8a86ad-17bd-4bcd-a96e-5412d5d91c5e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 06199cbd-cf2c-426d-a842-4dedd8359945] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:04.839649 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c1d07e99-5fbb-45bc-b89d-04bda1417556 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:04.842383 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c1d07e99-5fbb-45bc-b89d-04bda1417556 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:04.846985 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1c8a86ad-17bd-4bcd-a96e-5412d5d91c5e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:04.847678 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1c8a86ad-17bd-4bcd-a96e-5412d5d91c5e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:04.848116 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1c8a86ad-17bd-4bcd-a96e-5412d5d91c5e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:04.848978 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1c8a86ad-17bd-4bcd-a96e-5412d5d91c5e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:04.849463 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1c8a86ad-17bd-4bcd-a96e-5412d5d91c5e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:04.853319 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1c8a86ad-17bd-4bcd-a96e-5412d5d91c5e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:04.853601 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c1d07e99-5fbb-45bc-b89d-04bda1417556 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:04.853601 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c1d07e99-5fbb-45bc-b89d-04bda1417556 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:04.853601 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c1d07e99-5fbb-45bc-b89d-04bda1417556 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:04.854085 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c1d07e99-5fbb-45bc-b89d-04bda1417556 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:04.854603 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c1d07e99-5fbb-45bc-b89d-04bda1417556 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:04.855060 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c1d07e99-5fbb-45bc-b89d-04bda1417556 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:04.865598 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-1c8a86ad-17bd-4bcd-a96e-5412d5d91c5e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] HTTP exception thrown: Instance 06199cbd-cf2c-426d-a842-4dedd8359945 could not be found. Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1c8a86ad-17bd-4bcd-a96e-5412d5d91c5e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Request method failure captured: Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/06199cbd-cf2c-426d-a842-4dedd8359945 HTTP/1.1 Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdNZbeUR7skwu5ylmljymLwmsn3OMAB7HFdlDZsip3dgOK-vaOPPSwUYmWT_o9z2OqWc9cL2Rd22cHSa-BN8vqcvBTHGvFnuVH3dT1kVAQG6ODQVt2oxoFKeXYoNTjg1JUCF1B7Vzk2gVPeSesCiSDD37BDZ3_Wp6AgzZI4w4KMCOXw Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 45fe1c50eaee40249b6c20cc91e52586 Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersTestJSON-1478392549 Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersTestJSON-1478392549 Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 45fe1c50eaee40249b6c20cc91e52586 Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersTestJSON-1478392549 Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersTestJSON-1478392549-project Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: ef5f8a3e6fef4d6393603575479b16a2 Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersTestJSON-1478392549-project Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 06199cbd-cf2c-426d-a842-4dedd8359945 could not be found. Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '06199cbd-cf2c-426d-a842-4dedd8359945'} Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06199cbd-cf2c-426d-a842-4dedd8359945 could not be found. Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06199cbd-cf2c-426d-a842-4dedd8359945 could not be found. Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:04.867378 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:04.871769 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:04.871769 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:04.871769 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:04.871769 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:33:04.871769 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:33:04.871769 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06199cbd-cf2c-426d-a842-4dedd8359945 could not be found. Oct 30 01:33:04.871769 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:04.871769 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1c8a86ad-17bd-4bcd-a96e-5412d5d91c5e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Returning 404 to user: Instance 06199cbd-cf2c-426d-a842-4dedd8359945 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:33:04.871769 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1c8a86ad-17bd-4bcd-a96e-5412d5d91c5e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/06199cbd-cf2c-426d-a842-4dedd8359945" status: 404 len: 111 microversion: 2.1 time: 0.043663 Oct 30 01:33:04.871769 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2218/4455] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:04 2022] GET /compute/v2.1/servers/06199cbd-cf2c-426d-a842-4dedd8359945 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:33:04.878445 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-198bfc41-90b6-4d92-94ca-f8f9eb257ff5 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:04.878945 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-198bfc41-90b6-4d92-94ca-f8f9eb257ff5 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: ea637c0e-df6b-4c7f-a3ee-1b76fec47311] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:04.887517 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-198bfc41-90b6-4d92-94ca-f8f9eb257ff5 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:04.888020 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-198bfc41-90b6-4d92-94ca-f8f9eb257ff5 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:04.888472 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-198bfc41-90b6-4d92-94ca-f8f9eb257ff5 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:04.889883 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-198bfc41-90b6-4d92-94ca-f8f9eb257ff5 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:04.890627 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-198bfc41-90b6-4d92-94ca-f8f9eb257ff5 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:04.891221 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-198bfc41-90b6-4d92-94ca-f8f9eb257ff5 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:04.906853 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-198bfc41-90b6-4d92-94ca-f8f9eb257ff5 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] HTTP exception thrown: Instance ea637c0e-df6b-4c7f-a3ee-1b76fec47311 could not be found. Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-198bfc41-90b6-4d92-94ca-f8f9eb257ff5 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Request method failure captured: Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: request: DELETE /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311 HTTP/1.1 Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdNZbeUR7skwu5ylmljymLwmsn3OMAB7HFdlDZsip3dgOK-vaOPPSwUYmWT_o9z2OqWc9cL2Rd22cHSa-BN8vqcvBTHGvFnuVH3dT1kVAQG6ODQVt2oxoFKeXYoNTjg1JUCF1B7Vzk2gVPeSesCiSDD37BDZ3_Wp6AgzZI4w4KMCOXw Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 45fe1c50eaee40249b6c20cc91e52586 Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersTestJSON-1478392549 Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersTestJSON-1478392549 Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 45fe1c50eaee40249b6c20cc91e52586 Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersTestJSON-1478392549 Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersTestJSON-1478392549-project Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: ef5f8a3e6fef4d6393603575479b16a2 Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersTestJSON-1478392549-project Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: exception: Instance ea637c0e-df6b-4c7f-a3ee-1b76fec47311 could not be found. Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'ea637c0e-df6b-4c7f-a3ee-1b76fec47311'} Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea637c0e-df6b-4c7f-a3ee-1b76fec47311 could not be found. Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:33:04.908425 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea637c0e-df6b-4c7f-a3ee-1b76fec47311 could not be found. Oct 30 01:33:04.912920 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:04.912920 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:04.912920 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:04.912920 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:04.912920 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:04.912920 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:04.912920 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:33:04.912920 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:33:04.912920 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea637c0e-df6b-4c7f-a3ee-1b76fec47311 could not be found. Oct 30 01:33:04.912920 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:04.912920 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-198bfc41-90b6-4d92-94ca-f8f9eb257ff5 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Returning 404 to user: Instance ea637c0e-df6b-4c7f-a3ee-1b76fec47311 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:33:04.912920 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-198bfc41-90b6-4d92-94ca-f8f9eb257ff5 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311" status: 404 len: 111 microversion: 2.1 time: 0.035738 Oct 30 01:33:04.912920 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2219/4456] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:33:04 2022] DELETE /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:33:04.919174 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d69cc9a1-85cb-4136-9dcf-e97f6f42b726 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:04.919907 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d69cc9a1-85cb-4136-9dcf-e97f6f42b726 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: ea637c0e-df6b-4c7f-a3ee-1b76fec47311] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:04.929383 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d69cc9a1-85cb-4136-9dcf-e97f6f42b726 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:04.929985 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d69cc9a1-85cb-4136-9dcf-e97f6f42b726 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:04.930717 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d69cc9a1-85cb-4136-9dcf-e97f6f42b726 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:04.932793 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d69cc9a1-85cb-4136-9dcf-e97f6f42b726 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:04.933491 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d69cc9a1-85cb-4136-9dcf-e97f6f42b726 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:04.933997 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d69cc9a1-85cb-4136-9dcf-e97f6f42b726 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:04.956136 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-d69cc9a1-85cb-4136-9dcf-e97f6f42b726 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] HTTP exception thrown: Instance ea637c0e-df6b-4c7f-a3ee-1b76fec47311 could not be found. Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d69cc9a1-85cb-4136-9dcf-e97f6f42b726 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Request method failure captured: Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311 HTTP/1.1 Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdNZbeUR7skwu5ylmljymLwmsn3OMAB7HFdlDZsip3dgOK-vaOPPSwUYmWT_o9z2OqWc9cL2Rd22cHSa-BN8vqcvBTHGvFnuVH3dT1kVAQG6ODQVt2oxoFKeXYoNTjg1JUCF1B7Vzk2gVPeSesCiSDD37BDZ3_Wp6AgzZI4w4KMCOXw Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 45fe1c50eaee40249b6c20cc91e52586 Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersTestJSON-1478392549 Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersTestJSON-1478392549 Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 45fe1c50eaee40249b6c20cc91e52586 Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersTestJSON-1478392549 Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersTestJSON-1478392549-project Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: ef5f8a3e6fef4d6393603575479b16a2 Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersTestJSON-1478392549-project Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: exception: Instance ea637c0e-df6b-4c7f-a3ee-1b76fec47311 could not be found. Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'ea637c0e-df6b-4c7f-a3ee-1b76fec47311'} Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea637c0e-df6b-4c7f-a3ee-1b76fec47311 could not be found. Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea637c0e-df6b-4c7f-a3ee-1b76fec47311 could not be found. Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:04.957813 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:04.961830 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:04.961830 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:04.961830 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:04.961830 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:33:04.961830 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:33:04.961830 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea637c0e-df6b-4c7f-a3ee-1b76fec47311 could not be found. Oct 30 01:33:04.961830 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:04.961830 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d69cc9a1-85cb-4136-9dcf-e97f6f42b726 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Returning 404 to user: Instance ea637c0e-df6b-4c7f-a3ee-1b76fec47311 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:33:04.961830 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d69cc9a1-85cb-4136-9dcf-e97f6f42b726 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311" status: 404 len: 111 microversion: 2.1 time: 0.044244 Oct 30 01:33:04.961830 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2220/4457] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:04 2022] GET /compute/v2.1/servers/ea637c0e-df6b-4c7f-a3ee-1b76fec47311 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 01:33:04.968693 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-07704be7-4009-4e43-8ba4-35e92d6f56d1 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:04.969424 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-07704be7-4009-4e43-8ba4-35e92d6f56d1 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 0071471f-7af1-489c-8df1-e679bbd6d07a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:04.976397 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-07704be7-4009-4e43-8ba4-35e92d6f56d1 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] HTTP exception thrown: Instance 0071471f-7af1-489c-8df1-e679bbd6d07a could not be found. Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-07704be7-4009-4e43-8ba4-35e92d6f56d1 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Request method failure captured: Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: request: DELETE /compute/v2.1/servers/0071471f-7af1-489c-8df1-e679bbd6d07a HTTP/1.1 Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdNZbeUR7skwu5ylmljymLwmsn3OMAB7HFdlDZsip3dgOK-vaOPPSwUYmWT_o9z2OqWc9cL2Rd22cHSa-BN8vqcvBTHGvFnuVH3dT1kVAQG6ODQVt2oxoFKeXYoNTjg1JUCF1B7Vzk2gVPeSesCiSDD37BDZ3_Wp6AgzZI4w4KMCOXw Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 45fe1c50eaee40249b6c20cc91e52586 Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersTestJSON-1478392549 Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersTestJSON-1478392549 Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 45fe1c50eaee40249b6c20cc91e52586 Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersTestJSON-1478392549 Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersTestJSON-1478392549-project Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: ef5f8a3e6fef4d6393603575479b16a2 Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersTestJSON-1478392549-project Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 0071471f-7af1-489c-8df1-e679bbd6d07a could not be found. Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '0071471f-7af1-489c-8df1-e679bbd6d07a'} Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0071471f-7af1-489c-8df1-e679bbd6d07a could not be found. Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0071471f-7af1-489c-8df1-e679bbd6d07a could not be found. Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:04.978775 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:04.984714 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:04.984714 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:04.984714 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:04.984714 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:33:04.984714 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:33:04.984714 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0071471f-7af1-489c-8df1-e679bbd6d07a could not be found. Oct 30 01:33:04.984714 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:04.984714 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-07704be7-4009-4e43-8ba4-35e92d6f56d1 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Returning 404 to user: Instance 0071471f-7af1-489c-8df1-e679bbd6d07a could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:33:04.985559 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-07704be7-4009-4e43-8ba4-35e92d6f56d1 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0071471f-7af1-489c-8df1-e679bbd6d07a" status: 404 len: 111 microversion: 2.1 time: 0.018700 Oct 30 01:33:04.986678 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2221/4458] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:33:04 2022] DELETE /compute/v2.1/servers/0071471f-7af1-489c-8df1-e679bbd6d07a => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:33:04.995201 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9fe439ed-c6e3-45ad-9160-2df425b92e6b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:04.996162 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9fe439ed-c6e3-45ad-9160-2df425b92e6b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 0071471f-7af1-489c-8df1-e679bbd6d07a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:05.003030 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-9fe439ed-c6e3-45ad-9160-2df425b92e6b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] HTTP exception thrown: Instance 0071471f-7af1-489c-8df1-e679bbd6d07a could not be found. Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9fe439ed-c6e3-45ad-9160-2df425b92e6b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Request method failure captured: Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/0071471f-7af1-489c-8df1-e679bbd6d07a HTTP/1.1 Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdNZbeUR7skwu5ylmljymLwmsn3OMAB7HFdlDZsip3dgOK-vaOPPSwUYmWT_o9z2OqWc9cL2Rd22cHSa-BN8vqcvBTHGvFnuVH3dT1kVAQG6ODQVt2oxoFKeXYoNTjg1JUCF1B7Vzk2gVPeSesCiSDD37BDZ3_Wp6AgzZI4w4KMCOXw Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 45fe1c50eaee40249b6c20cc91e52586 Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersTestJSON-1478392549 Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersTestJSON-1478392549 Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 45fe1c50eaee40249b6c20cc91e52586 Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersTestJSON-1478392549 Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersTestJSON-1478392549-project Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: ef5f8a3e6fef4d6393603575479b16a2 Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersTestJSON-1478392549-project Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 0071471f-7af1-489c-8df1-e679bbd6d07a could not be found. Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '0071471f-7af1-489c-8df1-e679bbd6d07a'} Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0071471f-7af1-489c-8df1-e679bbd6d07a could not be found. Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0071471f-7af1-489c-8df1-e679bbd6d07a could not be found. Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:05.004539 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:05.009784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:05.009784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:33:05.009784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:33:05.009784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0071471f-7af1-489c-8df1-e679bbd6d07a could not be found. Oct 30 01:33:05.009784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:05.009784 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9fe439ed-c6e3-45ad-9160-2df425b92e6b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Returning 404 to user: Instance 0071471f-7af1-489c-8df1-e679bbd6d07a could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:33:05.009784 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9fe439ed-c6e3-45ad-9160-2df425b92e6b tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/0071471f-7af1-489c-8df1-e679bbd6d07a" status: 404 len: 111 microversion: 2.1 time: 0.015373 Oct 30 01:33:05.009784 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2222/4459] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:04 2022] GET /compute/v2.1/servers/0071471f-7af1-489c-8df1-e679bbd6d07a => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:33:05.015553 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9c3af6b0-b669-4b28-a4a9-12fbfdb1f9aa tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:05.016049 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9c3af6b0-b669-4b28-a4a9-12fbfdb1f9aa tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 2864065f-4af8-4134-b3f6-af254b7ab474] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:05.022103 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9c3af6b0-b669-4b28-a4a9-12fbfdb1f9aa tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:05.022585 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9c3af6b0-b669-4b28-a4a9-12fbfdb1f9aa tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:05.023012 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9c3af6b0-b669-4b28-a4a9-12fbfdb1f9aa tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:05.023704 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9c3af6b0-b669-4b28-a4a9-12fbfdb1f9aa tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:05.024157 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9c3af6b0-b669-4b28-a4a9-12fbfdb1f9aa tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:05.024584 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9c3af6b0-b669-4b28-a4a9-12fbfdb1f9aa tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:05.032360 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c1d07e99-5fbb-45bc-b89d-04bda1417556 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:05.040041 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c1d07e99-5fbb-45bc-b89d-04bda1417556 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.205039 Oct 30 01:33:05.041154 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2238/4460] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:04 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:05.051427 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9c3af6b0-b669-4b28-a4a9-12fbfdb1f9aa tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 2864065f-4af8-4134-b3f6-af254b7ab474] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:33:05.063119 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-96b337eb-0a85-4641-bfc7-736887dbeaf7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "deb14158-45d8-4539-889d-ff9726d046d7"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:33:05.065789 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-96b337eb-0a85-4641-bfc7-736887dbeaf7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: 03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:05.071480 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96b337eb-0a85-4641-bfc7-736887dbeaf7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:05.072012 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96b337eb-0a85-4641-bfc7-736887dbeaf7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:05.072447 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96b337eb-0a85-4641-bfc7-736887dbeaf7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:05.073130 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96b337eb-0a85-4641-bfc7-736887dbeaf7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:05.073602 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96b337eb-0a85-4641-bfc7-736887dbeaf7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:05.074019 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96b337eb-0a85-4641-bfc7-736887dbeaf7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:05.087476 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-96b337eb-0a85-4641-bfc7-736887dbeaf7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] HTTP exception thrown: Instance 03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5 could not be found. Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-96b337eb-0a85-4641-bfc7-736887dbeaf7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Request method failure captured: Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/servers/03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5/action HTTP/1.1 Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 65 Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdPsZZXjRvWKe2zWP-5VH1VYAsWsLLjUmpyob2uINkfAXNLt0qGMmCTWjYn2WpZ3XOOdsuaM4lwk-qZrOIX3mOHzuCJPZ3r-9M-w153XBWLoTow-eSMj1bsAWDNo3KKhMzjHqic8AJ-DcXpdsBh93g0dRB_UMWMRrGyY1cbSRdHJrvg Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 0bce487302c24def8a8473b0725904f2 Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: {"rebuild": {"imageRef": "deb14158-45d8-4539-889d-ff9726d046d7"}} Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5 could not be found. Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5', 'body': {'rebuild': {'imageRef': 'deb14158-45d8-4539-889d-ff9726d046d7'}}} Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5 could not be found. Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 30 01:33:05.089121 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 30 01:33:05.093368 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 30 01:33:05.093368 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:33:05.093368 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:33:05.093368 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:33:05.093368 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:33:05.093368 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5 could not be found. Oct 30 01:33:05.093368 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:05.093368 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:05.093368 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:05.093368 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:05.093368 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:05.093368 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:05.093368 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:33:05.093368 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:33:05.093368 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5 could not be found. Oct 30 01:33:05.093368 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:05.093368 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-96b337eb-0a85-4641-bfc7-736887dbeaf7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Returning 404 to user: Instance 03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:33:05.093368 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-96b337eb-0a85-4641-bfc7-736887dbeaf7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "POST /compute/v2.1/servers/03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5/action" status: 404 len: 111 microversion: 2.1 time: 0.031369 Oct 30 01:33:05.093368 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2239/4461] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:33:05 2022] POST /compute/v2.1/servers/03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 01:33:05.098993 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3740b42c-05be-428c-8b7c-ff926be56d25 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:05.103992 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3740b42c-05be-428c-8b7c-ff926be56d25 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:05.105808 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3740b42c-05be-428c-8b7c-ff926be56d25 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:05.106285 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3740b42c-05be-428c-8b7c-ff926be56d25 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:05.106715 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3740b42c-05be-428c-8b7c-ff926be56d25 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:05.107402 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3740b42c-05be-428c-8b7c-ff926be56d25 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:05.107843 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3740b42c-05be-428c-8b7c-ff926be56d25 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:05.108257 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3740b42c-05be-428c-8b7c-ff926be56d25 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:05.245282 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3740b42c-05be-428c-8b7c-ff926be56d25 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:05.253955 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3740b42c-05be-428c-8b7c-ff926be56d25 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.158402 Oct 30 01:33:05.254671 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2240/4462] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:05 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:33:05.276838 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-451af173-b847-43f6-9987-8d282d6208f0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:05.277545 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-451af173-b847-43f6-9987-8d282d6208f0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:05.284565 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-451af173-b847-43f6-9987-8d282d6208f0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:05.285055 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-451af173-b847-43f6-9987-8d282d6208f0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:05.285526 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-451af173-b847-43f6-9987-8d282d6208f0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:05.286341 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-451af173-b847-43f6-9987-8d282d6208f0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:05.286798 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-451af173-b847-43f6-9987-8d282d6208f0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:05.287282 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-451af173-b847-43f6-9987-8d282d6208f0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:05.347498 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9c3af6b0-b669-4b28-a4a9-12fbfdb1f9aa tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2864065f-4af8-4134-b3f6-af254b7ab474" status: 204 len: 0 microversion: 2.1 time: 0.335484 Oct 30 01:33:05.348097 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2223/4463] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:33:05 2022] DELETE /compute/v2.1/servers/2864065f-4af8-4134-b3f6-af254b7ab474 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 30 01:33:05.360960 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0656b16d-de7d-4e3f-8a36-54c9454f81c4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:05.361716 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0656b16d-de7d-4e3f-8a36-54c9454f81c4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 2864065f-4af8-4134-b3f6-af254b7ab474] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:05.373752 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0656b16d-de7d-4e3f-8a36-54c9454f81c4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:05.374254 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0656b16d-de7d-4e3f-8a36-54c9454f81c4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:05.374687 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0656b16d-de7d-4e3f-8a36-54c9454f81c4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:05.375398 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0656b16d-de7d-4e3f-8a36-54c9454f81c4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:05.376217 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0656b16d-de7d-4e3f-8a36-54c9454f81c4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:05.376324 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0656b16d-de7d-4e3f-8a36-54c9454f81c4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:05.463819 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-451af173-b847-43f6-9987-8d282d6208f0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:05.471625 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-451af173-b847-43f6-9987-8d282d6208f0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.198802 Oct 30 01:33:05.472436 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2241/4464] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:05 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:33:05.494847 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-192e6180-0e84-4c0e-b938-c5cd5a69c9ab tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:05.495470 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-192e6180-0e84-4c0e-b938-c5cd5a69c9ab tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: 6573b259-e50d-4954-9d64-3c914df97308] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:05.501550 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-192e6180-0e84-4c0e-b938-c5cd5a69c9ab tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:05.502051 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-192e6180-0e84-4c0e-b938-c5cd5a69c9ab tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:05.502735 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-192e6180-0e84-4c0e-b938-c5cd5a69c9ab tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:05.505593 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-192e6180-0e84-4c0e-b938-c5cd5a69c9ab tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:05.505593 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-192e6180-0e84-4c0e-b938-c5cd5a69c9ab tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:05.505593 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-192e6180-0e84-4c0e-b938-c5cd5a69c9ab tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:05.545249 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0656b16d-de7d-4e3f-8a36-54c9454f81c4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:05.553785 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0656b16d-de7d-4e3f-8a36-54c9454f81c4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/2864065f-4af8-4134-b3f6-af254b7ab474" status: 200 len: 1481 microversion: 2.1 time: 0.201055 Oct 30 01:33:05.554439 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2224/4465] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:05 2022] GET /compute/v2.1/servers/2864065f-4af8-4134-b3f6-af254b7ab474 => generated 1481 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:33:05.559202 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9ba89602-4d8a-4f1a-8247-b708c5ac4584 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "deb14158-45d8-4539-889d-ff9726d046d7"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:33:05.562405 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9ba89602-4d8a-4f1a-8247-b708c5ac4584 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: f452c89b-8bce-42bd-9716-c87f593d4a78] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:05.567192 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=12 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:05.568772 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-9ba89602-4d8a-4f1a-8247-b708c5ac4584 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] HTTP exception thrown: Instance f452c89b-8bce-42bd-9716-c87f593d4a78 could not be found. Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9ba89602-4d8a-4f1a-8247-b708c5ac4584 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Request method failure captured: Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: request: POST /compute/v2.1/servers/f452c89b-8bce-42bd-9716-c87f593d4a78/action HTTP/1.1 Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 65 Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdPsZZXjRvWKe2zWP-5VH1VYAsWsLLjUmpyob2uINkfAXNLt0qGMmCTWjYn2WpZ3XOOdsuaM4lwk-qZrOIX3mOHzuCJPZ3r-9M-w153XBWLoTow-eSMj1bsAWDNo3KKhMzjHqic8AJ-DcXpdsBh93g0dRB_UMWMRrGyY1cbSRdHJrvg Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 0bce487302c24def8a8473b0725904f2 Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: {"rebuild": {"imageRef": "deb14158-45d8-4539-889d-ff9726d046d7"}} Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: exception: Instance f452c89b-8bce-42bd-9716-c87f593d4a78 could not be found. Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'f452c89b-8bce-42bd-9716-c87f593d4a78', 'body': {'rebuild': {'imageRef': 'deb14158-45d8-4539-889d-ff9726d046d7'}}} Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f452c89b-8bce-42bd-9716-c87f593d4a78 could not be found. Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 30 01:33:05.570606 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:33:05.579844 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:33:05.579844 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:33:05.579844 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:33:05.579844 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f452c89b-8bce-42bd-9716-c87f593d4a78 could not be found. Oct 30 01:33:05.579844 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:05.579844 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:05.579844 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:05.579844 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:05.579844 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:05.579844 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:05.579844 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:33:05.579844 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:33:05.579844 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f452c89b-8bce-42bd-9716-c87f593d4a78 could not be found. Oct 30 01:33:05.579844 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:05.579844 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9ba89602-4d8a-4f1a-8247-b708c5ac4584 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Returning 404 to user: Instance f452c89b-8bce-42bd-9716-c87f593d4a78 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:33:05.579844 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9ba89602-4d8a-4f1a-8247-b708c5ac4584 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "POST /compute/v2.1/servers/f452c89b-8bce-42bd-9716-c87f593d4a78/action" status: 404 len: 111 microversion: 2.1 time: 0.016550 Oct 30 01:33:05.579844 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2225/4466] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:33:05 2022] POST /compute/v2.1/servers/f452c89b-8bce-42bd-9716-c87f593d4a78/action => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:33:05.579844 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8949b097-b28a-4711-bfea-d86ef92c8390 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:05.579844 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8949b097-b28a-4711-bfea-d86ef92c8390 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] [instance: 76d6b110-febc-4f28-8367-a0c9ef077177] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:05.586662 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8949b097-b28a-4711-bfea-d86ef92c8390 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:05.587147 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8949b097-b28a-4711-bfea-d86ef92c8390 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:05.588098 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8949b097-b28a-4711-bfea-d86ef92c8390 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:05.588798 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8949b097-b28a-4711-bfea-d86ef92c8390 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:05.589276 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8949b097-b28a-4711-bfea-d86ef92c8390 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:05.590427 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8949b097-b28a-4711-bfea-d86ef92c8390 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:05.709097 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-192e6180-0e84-4c0e-b938-c5cd5a69c9ab tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:05.724254 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-192e6180-0e84-4c0e-b938-c5cd5a69c9ab tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers/6573b259-e50d-4954-9d64-3c914df97308" status: 200 len: 1519 microversion: 2.1 time: 0.237236 Oct 30 01:33:05.737806 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2242/4467] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:05 2022] GET /compute/v2.1/servers/6573b259-e50d-4954-9d64-3c914df97308 => generated 1519 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:05.737806 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6a750291-8bf2-4a73-92a4-03e8d112d692 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:05.737806 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6a750291-8bf2-4a73-92a4-03e8d112d692 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:05.746807 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a750291-8bf2-4a73-92a4-03e8d112d692 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:05.747299 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a750291-8bf2-4a73-92a4-03e8d112d692 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:05.748104 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a750291-8bf2-4a73-92a4-03e8d112d692 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:05.749952 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a750291-8bf2-4a73-92a4-03e8d112d692 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:05.751410 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a750291-8bf2-4a73-92a4-03e8d112d692 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:05.752198 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a750291-8bf2-4a73-92a4-03e8d112d692 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:05.796105 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8949b097-b28a-4711-bfea-d86ef92c8390 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ac5422c8f048148aac2c9b62e0482e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d179276dbf4e4d9cb780b18e7a22c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:05.801115 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8949b097-b28a-4711-bfea-d86ef92c8390 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "GET /compute/v2.1/servers/76d6b110-febc-4f28-8367-a0c9ef077177" status: 200 len: 1316 microversion: 2.1 time: 0.226470 Oct 30 01:33:05.802435 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2226/4468] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:05 2022] GET /compute/v2.1/servers/76d6b110-febc-4f28-8367-a0c9ef077177 => generated 1316 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:05.811812 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d08b86c1-8d80-4c43-a5af-6a76bb10c24b tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:05.813195 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d08b86c1-8d80-4c43-a5af-6a76bb10c24b tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 2873be88-5d85-49c6-833f-19b7df1fcf5f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:05.820482 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d08b86c1-8d80-4c43-a5af-6a76bb10c24b tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:05.820973 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d08b86c1-8d80-4c43-a5af-6a76bb10c24b tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:05.821440 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d08b86c1-8d80-4c43-a5af-6a76bb10c24b tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:05.822868 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d08b86c1-8d80-4c43-a5af-6a76bb10c24b tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:05.823328 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d08b86c1-8d80-4c43-a5af-6a76bb10c24b tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:05.824058 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d08b86c1-8d80-4c43-a5af-6a76bb10c24b tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:05.903794 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d08b86c1-8d80-4c43-a5af-6a76bb10c24b tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:05.906421 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:05.913945 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d08b86c1-8d80-4c43-a5af-6a76bb10c24b tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f" status: 200 len: 1293 microversion: 2.1 time: 0.110020 Oct 30 01:33:05.915711 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2227/4469] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:05 2022] GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f => generated 1293 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:05.952167 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6a750291-8bf2-4a73-92a4-03e8d112d692 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:05.960263 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6a750291-8bf2-4a73-92a4-03e8d112d692 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.233583 Oct 30 01:33:05.960983 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2243/4470] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:05 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:05.983751 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2a2d6588-972b-48bb-9005-5564fdbf6fea tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:05.984507 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2a2d6588-972b-48bb-9005-5564fdbf6fea tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:05.990794 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a2d6588-972b-48bb-9005-5564fdbf6fea tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:05.991292 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a2d6588-972b-48bb-9005-5564fdbf6fea tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:05.996293 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a2d6588-972b-48bb-9005-5564fdbf6fea tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:05.996293 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a2d6588-972b-48bb-9005-5564fdbf6fea tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:05.996293 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a2d6588-972b-48bb-9005-5564fdbf6fea tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:05.996293 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a2d6588-972b-48bb-9005-5564fdbf6fea tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:06.156632 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2a2d6588-972b-48bb-9005-5564fdbf6fea tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:06.165408 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2a2d6588-972b-48bb-9005-5564fdbf6fea tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.185232 Oct 30 01:33:06.165971 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2228/4471] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:05 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:06.189680 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2a93fa6d-57a8-4630-9d4b-2d5ffe460380 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:33:06.190826 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2a93fa6d-57a8-4630-9d4b-2d5ffe460380 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: af77e265-61c6-4c35-8d96-0fe25ce045b3] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:06.194471 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=8 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:06.198241 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-2a93fa6d-57a8-4630-9d4b-2d5ffe460380 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] HTTP exception thrown: Instance af77e265-61c6-4c35-8d96-0fe25ce045b3 could not be found. Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2a93fa6d-57a8-4630-9d4b-2d5ffe460380 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Request method failure captured: Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/servers/af77e265-61c6-4c35-8d96-0fe25ce045b3/action HTTP/1.1 Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 15 Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdPsZZXjRvWKe2zWP-5VH1VYAsWsLLjUmpyob2uINkfAXNLt0qGMmCTWjYn2WpZ3XOOdsuaM4lwk-qZrOIX3mOHzuCJPZ3r-9M-w153XBWLoTow-eSMj1bsAWDNo3KKhMzjHqic8AJ-DcXpdsBh93g0dRB_UMWMRrGyY1cbSRdHJrvg Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 0bce487302c24def8a8473b0725904f2 Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: {"restore": {}} Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: exception: Instance af77e265-61c6-4c35-8d96-0fe25ce045b3 could not be found. Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'af77e265-61c6-4c35-8d96-0fe25ce045b3', 'body': {'restore': {}}} Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af77e265-61c6-4c35-8d96-0fe25ce045b3 could not be found. Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af77e265-61c6-4c35-8d96-0fe25ce045b3 could not be found. Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:06.199949 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:06.204316 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:33:06.204316 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:33:06.204316 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af77e265-61c6-4c35-8d96-0fe25ce045b3 could not be found. Oct 30 01:33:06.204316 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:06.205683 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2a93fa6d-57a8-4630-9d4b-2d5ffe460380 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Returning 404 to user: Instance af77e265-61c6-4c35-8d96-0fe25ce045b3 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:33:06.206527 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2a93fa6d-57a8-4630-9d4b-2d5ffe460380 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "POST /compute/v2.1/servers/af77e265-61c6-4c35-8d96-0fe25ce045b3/action" status: 404 len: 111 microversion: 2.1 time: 0.020916 Oct 30 01:33:06.207095 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2244/4472] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:33:06 2022] POST /compute/v2.1/servers/af77e265-61c6-4c35-8d96-0fe25ce045b3/action => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:33:06.215574 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-da580c75-83e9-47d3-87e5-4ae35306f5c3 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:06.216190 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-da580c75-83e9-47d3-87e5-4ae35306f5c3 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:06.222543 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da580c75-83e9-47d3-87e5-4ae35306f5c3 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:06.226319 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da580c75-83e9-47d3-87e5-4ae35306f5c3 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:06.226319 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da580c75-83e9-47d3-87e5-4ae35306f5c3 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:06.226319 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da580c75-83e9-47d3-87e5-4ae35306f5c3 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:06.226319 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da580c75-83e9-47d3-87e5-4ae35306f5c3 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:06.226319 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da580c75-83e9-47d3-87e5-4ae35306f5c3 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:06.389980 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-da580c75-83e9-47d3-87e5-4ae35306f5c3 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:06.398451 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-da580c75-83e9-47d3-87e5-4ae35306f5c3 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.186994 Oct 30 01:33:06.399033 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2229/4473] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:06 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:33:06.421529 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6d7b80bd-43ba-4fd3-a966-d6b1dcd57045 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:06.422152 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6d7b80bd-43ba-4fd3-a966-d6b1dcd57045 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:06.433629 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d7b80bd-43ba-4fd3-a966-d6b1dcd57045 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:06.437772 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d7b80bd-43ba-4fd3-a966-d6b1dcd57045 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:06.437772 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d7b80bd-43ba-4fd3-a966-d6b1dcd57045 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:06.437772 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d7b80bd-43ba-4fd3-a966-d6b1dcd57045 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:06.437772 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d7b80bd-43ba-4fd3-a966-d6b1dcd57045 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:06.437772 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d7b80bd-43ba-4fd3-a966-d6b1dcd57045 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:06.578335 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ad2cbbd6-bf05-40e2-a4cf-bd0409c9d4f3 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:06.579458 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ad2cbbd6-bf05-40e2-a4cf-bd0409c9d4f3 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 2864065f-4af8-4134-b3f6-af254b7ab474] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:06.594745 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ad2cbbd6-bf05-40e2-a4cf-bd0409c9d4f3 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:06.595657 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ad2cbbd6-bf05-40e2-a4cf-bd0409c9d4f3 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:06.596388 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ad2cbbd6-bf05-40e2-a4cf-bd0409c9d4f3 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:06.600875 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ad2cbbd6-bf05-40e2-a4cf-bd0409c9d4f3 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:06.600875 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ad2cbbd6-bf05-40e2-a4cf-bd0409c9d4f3 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:06.600875 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ad2cbbd6-bf05-40e2-a4cf-bd0409c9d4f3 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:07.059424 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ad2cbbd6-bf05-40e2-a4cf-bd0409c9d4f3 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:07.068120 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ad2cbbd6-bf05-40e2-a4cf-bd0409c9d4f3 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/2864065f-4af8-4134-b3f6-af254b7ab474" status: 200 len: 1481 microversion: 2.1 time: 0.494973 Oct 30 01:33:07.069132 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2230/4474] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:06 2022] GET /compute/v2.1/servers/2864065f-4af8-4134-b3f6-af254b7ab474 => generated 1481 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:07.074780 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b2820a88-4583-4a3c-9d63-05719be10565 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:07.075674 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b2820a88-4583-4a3c-9d63-05719be10565 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: 6573b259-e50d-4954-9d64-3c914df97308] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:07.082479 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b2820a88-4583-4a3c-9d63-05719be10565 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:07.083223 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b2820a88-4583-4a3c-9d63-05719be10565 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:07.083909 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b2820a88-4583-4a3c-9d63-05719be10565 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:07.087329 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b2820a88-4583-4a3c-9d63-05719be10565 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:07.087329 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b2820a88-4583-4a3c-9d63-05719be10565 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:07.087329 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b2820a88-4583-4a3c-9d63-05719be10565 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:07.245013 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6d7b80bd-43ba-4fd3-a966-d6b1dcd57045 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:07.266975 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6d7b80bd-43ba-4fd3-a966-d6b1dcd57045 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.849314 Oct 30 01:33:07.268162 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2245/4475] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:06 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:07.275205 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b67ef124-50c6-4d7c-be04-288360fa0f33 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:07.276093 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b67ef124-50c6-4d7c-be04-288360fa0f33 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] [instance: 76d6b110-febc-4f28-8367-a0c9ef077177] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:07.283711 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b67ef124-50c6-4d7c-be04-288360fa0f33 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:07.284723 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b67ef124-50c6-4d7c-be04-288360fa0f33 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:07.285369 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b67ef124-50c6-4d7c-be04-288360fa0f33 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:07.286418 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b67ef124-50c6-4d7c-be04-288360fa0f33 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:07.288247 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b67ef124-50c6-4d7c-be04-288360fa0f33 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:07.288948 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b67ef124-50c6-4d7c-be04-288360fa0f33 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:07.478627 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b2820a88-4583-4a3c-9d63-05719be10565 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:07.491181 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b2820a88-4583-4a3c-9d63-05719be10565 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers/6573b259-e50d-4954-9d64-3c914df97308" status: 200 len: 1519 microversion: 2.1 time: 0.420701 Oct 30 01:33:07.491977 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2231/4476] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:07 2022] GET /compute/v2.1/servers/6573b259-e50d-4954-9d64-3c914df97308 => generated 1519 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:07.518387 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b0fcae87-18fa-40d3-a7c2-c1e783841b56 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:07.520215 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b0fcae87-18fa-40d3-a7c2-c1e783841b56 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 2873be88-5d85-49c6-833f-19b7df1fcf5f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:07.535195 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b0fcae87-18fa-40d3-a7c2-c1e783841b56 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:07.535707 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b0fcae87-18fa-40d3-a7c2-c1e783841b56 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:07.536438 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b0fcae87-18fa-40d3-a7c2-c1e783841b56 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:07.537835 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b0fcae87-18fa-40d3-a7c2-c1e783841b56 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:07.538309 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b0fcae87-18fa-40d3-a7c2-c1e783841b56 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:07.538920 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b0fcae87-18fa-40d3-a7c2-c1e783841b56 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:07.557085 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-b0fcae87-18fa-40d3-a7c2-c1e783841b56 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] HTTP exception thrown: Instance 2873be88-5d85-49c6-833f-19b7df1fcf5f could not be found. Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b0fcae87-18fa-40d3-a7c2-c1e783841b56 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Request method failure captured: Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f HTTP/1.1 Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdMpBfA6mq8oavinMeTyaurexihmj6JmnnP2ZZndb1MXJnyLYJP1lh9IAGUFmytWgjEkCc6rHAh1wpEFldWPgYBauossNbR0UQldGfx9XACde0J5etDs6i2phO_G-HCGpqKWqFyqD3FJkTb44yZ7CHZV6U0ZtcSE1Hf7lvcXbJ_Lvp0 Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 470e235fb35840828d9a86028b72f5de Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-909936776 Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/470e235fb35840828d9a86028b72f5de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_470e235fb35840828d9a86028b72f5de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/470e235fb35840828d9a86028b72f5de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/470e235fb35840828d9a86028b72f5de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServerRescueNegativeTestJSON-909936776 Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 470e235fb35840828d9a86028b72f5de Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-909936776 Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServerRescueNegativeTestJSON-909936776-project Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 6134c05549f14bc19962acea9c913f53 Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServerRescueNegativeTestJSON-909936776-project Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 2873be88-5d85-49c6-833f-19b7df1fcf5f could not be found. Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '2873be88-5d85-49c6-833f-19b7df1fcf5f'} Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2873be88-5d85-49c6-833f-19b7df1fcf5f could not be found. Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2873be88-5d85-49c6-833f-19b7df1fcf5f could not be found. Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:07.559036 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:07.563582 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:07.563582 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:07.563582 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:07.563582 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:07.563582 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:33:07.563582 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:33:07.563582 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2873be88-5d85-49c6-833f-19b7df1fcf5f could not be found. Oct 30 01:33:07.563582 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:07.565217 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b0fcae87-18fa-40d3-a7c2-c1e783841b56 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Returning 404 to user: Instance 2873be88-5d85-49c6-833f-19b7df1fcf5f could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:33:07.566449 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b0fcae87-18fa-40d3-a7c2-c1e783841b56 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f" status: 404 len: 111 microversion: 2.1 time: 0.073049 Oct 30 01:33:07.567701 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2232/4477] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:07 2022] GET /compute/v2.1/servers/2873be88-5d85-49c6-833f-19b7df1fcf5f => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:33:07.572733 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c9e44d31-4c85-48d2-8fcf-a68fa7eae654 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:33:07.573534 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c9e44d31-4c85-48d2-8fcf-a68fa7eae654 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:07.580771 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c9e44d31-4c85-48d2-8fcf-a68fa7eae654 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:07.581954 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c9e44d31-4c85-48d2-8fcf-a68fa7eae654 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:07.582572 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c9e44d31-4c85-48d2-8fcf-a68fa7eae654 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:07.583448 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c9e44d31-4c85-48d2-8fcf-a68fa7eae654 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:07.584048 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c9e44d31-4c85-48d2-8fcf-a68fa7eae654 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:07.584747 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c9e44d31-4c85-48d2-8fcf-a68fa7eae654 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:07.612820 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-c9e44d31-4c85-48d2-8fcf-a68fa7eae654 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] HTTP exception thrown: Cannot 'restore' instance b0c51345-2948-4ff1-828f-8c70b2b979f2 while it is in vm_state active Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c9e44d31-4c85-48d2-8fcf-a68fa7eae654 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Request method failure captured: Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: request: POST /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2/action HTTP/1.1 Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 15 Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdPsZZXjRvWKe2zWP-5VH1VYAsWsLLjUmpyob2uINkfAXNLt0qGMmCTWjYn2WpZ3XOOdsuaM4lwk-qZrOIX3mOHzuCJPZ3r-9M-w153XBWLoTow-eSMj1bsAWDNo3KKhMzjHqic8AJ-DcXpdsBh93g0dRB_UMWMRrGyY1cbSRdHJrvg Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 0bce487302c24def8a8473b0725904f2 Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: {"restore": {}} Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: exception: Cannot 'restore' instance b0c51345-2948-4ff1-828f-8c70b2b979f2 while it is in vm_state active Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'b0c51345-2948-4ff1-828f-8c70b2b979f2', 'body': {'restore': {}}} Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b0c51345-2948-4ff1-828f-8c70b2b979f2 in vm_state active. Cannot restore while the instance is in this state. Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance b0c51345-2948-4ff1-828f-8c70b2b979f2 while it is in vm_state active Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:07.614733 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:07.620503 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:07.620503 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:33:07.620503 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:33:07.620503 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance b0c51345-2948-4ff1-828f-8c70b2b979f2 while it is in vm_state active Oct 30 01:33:07.620503 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:07.620503 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c9e44d31-4c85-48d2-8fcf-a68fa7eae654 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Returning 409 to user: Cannot 'restore' instance b0c51345-2948-4ff1-828f-8c70b2b979f2 while it is in vm_state active {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:33:07.620503 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c9e44d31-4c85-48d2-8fcf-a68fa7eae654 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "POST /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2/action" status: 409 len: 145 microversion: 2.1 time: 0.047345 Oct 30 01:33:07.621274 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2233/4478] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:33:07 2022] POST /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2/action => generated 145 bytes in 52 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:33:07.625776 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-dcb71e17-31a2-4166-bc2a-5f18d47b6c57 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:07.626279 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-dcb71e17-31a2-4166-bc2a-5f18d47b6c57 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 28af596f-f044-4281-8106-4585fbde9a4a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:07.635456 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dcb71e17-31a2-4166-bc2a-5f18d47b6c57 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:07.636225 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dcb71e17-31a2-4166-bc2a-5f18d47b6c57 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:07.636740 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b67ef124-50c6-4d7c-be04-288360fa0f33 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ac5422c8f048148aac2c9b62e0482e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d179276dbf4e4d9cb780b18e7a22c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:07.637168 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dcb71e17-31a2-4166-bc2a-5f18d47b6c57 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:07.638157 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dcb71e17-31a2-4166-bc2a-5f18d47b6c57 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:07.638826 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dcb71e17-31a2-4166-bc2a-5f18d47b6c57 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:07.639901 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dcb71e17-31a2-4166-bc2a-5f18d47b6c57 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:07.649375 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b67ef124-50c6-4d7c-be04-288360fa0f33 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "GET /compute/v2.1/servers/76d6b110-febc-4f28-8367-a0c9ef077177" status: 200 len: 1316 microversion: 2.1 time: 0.375815 Oct 30 01:33:07.649576 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2246/4479] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:07 2022] GET /compute/v2.1/servers/76d6b110-febc-4f28-8367-a0c9ef077177 => generated 1316 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:07.672325 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8e1742ef-5406-4c85-b4b6-2dfe6cb85e49 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:07.674404 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8e1742ef-5406-4c85-b4b6-2dfe6cb85e49 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:07.684892 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8e1742ef-5406-4c85-b4b6-2dfe6cb85e49 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:07.685712 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8e1742ef-5406-4c85-b4b6-2dfe6cb85e49 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:07.686347 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8e1742ef-5406-4c85-b4b6-2dfe6cb85e49 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:07.688184 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8e1742ef-5406-4c85-b4b6-2dfe6cb85e49 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:07.688694 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-dcb71e17-31a2-4166-bc2a-5f18d47b6c57 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 28af596f-f044-4281-8106-4585fbde9a4a] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:33:07.689057 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8e1742ef-5406-4c85-b4b6-2dfe6cb85e49 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:07.689741 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8e1742ef-5406-4c85-b4b6-2dfe6cb85e49 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:07.992383 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8e1742ef-5406-4c85-b4b6-2dfe6cb85e49 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:08.005616 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8e1742ef-5406-4c85-b4b6-2dfe6cb85e49 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.339749 Oct 30 01:33:08.006533 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2247/4480] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:07 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:08.012094 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-dd80fba5-40f3-425f-9f4a-d8fbc5e2bf23 req-220e2af8-a2a2-4148-a90a-ce8c97c84375 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6573b259-e50d-4954-9d64-3c914df97308", "name": "network-vif-deleted", "tag": "2bc566ed-0070-49d3-b86b-b0e32bb3d07a"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:33:08.022199 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-dd80fba5-40f3-425f-9f4a-d8fbc5e2bf23 req-220e2af8-a2a2-4148-a90a-ce8c97c84375 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:08.022873 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-dd80fba5-40f3-425f-9f4a-d8fbc5e2bf23 req-220e2af8-a2a2-4148-a90a-ce8c97c84375 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:08.023434 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-dd80fba5-40f3-425f-9f4a-d8fbc5e2bf23 req-220e2af8-a2a2-4148-a90a-ce8c97c84375 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:08.036641 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-dd80fba5-40f3-425f-9f4a-d8fbc5e2bf23 req-220e2af8-a2a2-4148-a90a-ce8c97c84375 service nova] Creating event network-vif-deleted:2bc566ed-0070-49d3-b86b-b0e32bb3d07a for instance 6573b259-e50d-4954-9d64-3c914df97308 on n-h1-master-1 Oct 30 01:33:08.043141 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-dd80fba5-40f3-425f-9f4a-d8fbc5e2bf23 req-220e2af8-a2a2-4148-a90a-ce8c97c84375 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035040 Oct 30 01:33:08.044078 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2248/4481] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:33:08.051649 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1be896cc-dd42-4632-9324-3b8c150b2689 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:08.052359 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1be896cc-dd42-4632-9324-3b8c150b2689 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:08.060833 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1be896cc-dd42-4632-9324-3b8c150b2689 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:08.061359 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1be896cc-dd42-4632-9324-3b8c150b2689 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:08.061802 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1be896cc-dd42-4632-9324-3b8c150b2689 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:08.062499 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1be896cc-dd42-4632-9324-3b8c150b2689 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:08.062948 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1be896cc-dd42-4632-9324-3b8c150b2689 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:08.065499 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1be896cc-dd42-4632-9324-3b8c150b2689 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:08.079497 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-dcb71e17-31a2-4166-bc2a-5f18d47b6c57 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "DELETE /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a" status: 204 len: 0 microversion: 2.1 time: 0.450891 Oct 30 01:33:08.096910 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2234/4482] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:33:07 2022] DELETE /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a => generated 0 bytes in 464 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:33:08.104670 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a732244c-78f0-4570-bfb9-6b718eb4b5f4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:08.105558 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a732244c-78f0-4570-bfb9-6b718eb4b5f4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 2864065f-4af8-4134-b3f6-af254b7ab474] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:08.129794 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a732244c-78f0-4570-bfb9-6b718eb4b5f4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:08.133175 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a732244c-78f0-4570-bfb9-6b718eb4b5f4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:08.134685 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a732244c-78f0-4570-bfb9-6b718eb4b5f4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:08.136284 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a732244c-78f0-4570-bfb9-6b718eb4b5f4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:08.137005 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a732244c-78f0-4570-bfb9-6b718eb4b5f4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:08.137660 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a732244c-78f0-4570-bfb9-6b718eb4b5f4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:08.310716 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a732244c-78f0-4570-bfb9-6b718eb4b5f4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:08.327731 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a732244c-78f0-4570-bfb9-6b718eb4b5f4 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/2864065f-4af8-4134-b3f6-af254b7ab474" status: 200 len: 1439 microversion: 2.1 time: 0.238217 Oct 30 01:33:08.329629 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2235/4483] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:08 2022] GET /compute/v2.1/servers/2864065f-4af8-4134-b3f6-af254b7ab474 => generated 1439 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:08.334513 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-edd4e319-69ec-4a45-a7f6-a1ea320db28d tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:08.335268 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-edd4e319-69ec-4a45-a7f6-a1ea320db28d tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 28af596f-f044-4281-8106-4585fbde9a4a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:08.348799 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-edd4e319-69ec-4a45-a7f6-a1ea320db28d tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:08.350432 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-edd4e319-69ec-4a45-a7f6-a1ea320db28d tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:08.356468 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-edd4e319-69ec-4a45-a7f6-a1ea320db28d tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:08.356468 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-edd4e319-69ec-4a45-a7f6-a1ea320db28d tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:08.356468 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-edd4e319-69ec-4a45-a7f6-a1ea320db28d tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:08.356468 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-edd4e319-69ec-4a45-a7f6-a1ea320db28d tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:08.441924 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1be896cc-dd42-4632-9324-3b8c150b2689 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:08.453536 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1be896cc-dd42-4632-9324-3b8c150b2689 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.408170 Oct 30 01:33:08.454326 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2249/4484] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:08 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:08.475670 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b43528d8-0cd7-4927-a45d-8b2ca2efd516 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:33:08.476223 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b43528d8-0cd7-4927-a45d-8b2ca2efd516 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: 575a127e-d77f-4add-847e-8fe7e5a6bb6e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:08.483454 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-b43528d8-0cd7-4927-a45d-8b2ca2efd516 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] HTTP exception thrown: Instance 575a127e-d77f-4add-847e-8fe7e5a6bb6e could not be found. Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b43528d8-0cd7-4927-a45d-8b2ca2efd516 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Request method failure captured: Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/servers/575a127e-d77f-4add-847e-8fe7e5a6bb6e/action HTTP/1.1 Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 14 Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdPsZZXjRvWKe2zWP-5VH1VYAsWsLLjUmpyob2uINkfAXNLt0qGMmCTWjYn2WpZ3XOOdsuaM4lwk-qZrOIX3mOHzuCJPZ3r-9M-w153XBWLoTow-eSMj1bsAWDNo3KKhMzjHqic8AJ-DcXpdsBh93g0dRB_UMWMRrGyY1cbSRdHJrvg Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 0bce487302c24def8a8473b0725904f2 Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: {"resume": {}} Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 575a127e-d77f-4add-847e-8fe7e5a6bb6e could not be found. Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '575a127e-d77f-4add-847e-8fe7e5a6bb6e', 'body': {'resume': {}}} Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 575a127e-d77f-4add-847e-8fe7e5a6bb6e could not be found. Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 575a127e-d77f-4add-847e-8fe7e5a6bb6e could not be found. Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:08.488620 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:08.492556 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:33:08.492556 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:33:08.492556 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 575a127e-d77f-4add-847e-8fe7e5a6bb6e could not be found. Oct 30 01:33:08.492556 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:08.495171 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b43528d8-0cd7-4927-a45d-8b2ca2efd516 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Returning 404 to user: Instance 575a127e-d77f-4add-847e-8fe7e5a6bb6e could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:33:08.496539 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b43528d8-0cd7-4927-a45d-8b2ca2efd516 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "POST /compute/v2.1/servers/575a127e-d77f-4add-847e-8fe7e5a6bb6e/action" status: 404 len: 111 microversion: 2.1 time: 0.024598 Oct 30 01:33:08.500492 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2250/4485] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:33:08 2022] POST /compute/v2.1/servers/575a127e-d77f-4add-847e-8fe7e5a6bb6e/action => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 01:33:08.510242 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d8366245-0021-4127-ba93-095ce7bdfa5e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:08.511202 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d8366245-0021-4127-ba93-095ce7bdfa5e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:08.520548 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8366245-0021-4127-ba93-095ce7bdfa5e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:08.521664 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8366245-0021-4127-ba93-095ce7bdfa5e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:08.522344 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8366245-0021-4127-ba93-095ce7bdfa5e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:08.523283 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8366245-0021-4127-ba93-095ce7bdfa5e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:08.524394 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8366245-0021-4127-ba93-095ce7bdfa5e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:08.526456 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8366245-0021-4127-ba93-095ce7bdfa5e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:08.531475 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:08.602131 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-edd4e319-69ec-4a45-a7f6-a1ea320db28d tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:08.614628 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-edd4e319-69ec-4a45-a7f6-a1ea320db28d tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a" status: 200 len: 1522 microversion: 2.1 time: 0.284893 Oct 30 01:33:08.618016 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2236/4486] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:08 2022] GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a => generated 1522 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:08.632919 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-177af0a4-6bf1-4c84-8269-5ec745092345 req-74bc7215-fb30-44af-a85f-5963f35dcd98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76d6b110-febc-4f28-8367-a0c9ef077177", "name": "network-vif-plugged", "status": "completed", "tag": "4e68cc61-1f92-4323-863f-24fb89d25061"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:33:08.657115 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-177af0a4-6bf1-4c84-8269-5ec745092345 req-74bc7215-fb30-44af-a85f-5963f35dcd98 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:08.657642 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-177af0a4-6bf1-4c84-8269-5ec745092345 req-74bc7215-fb30-44af-a85f-5963f35dcd98 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:08.658111 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-177af0a4-6bf1-4c84-8269-5ec745092345 req-74bc7215-fb30-44af-a85f-5963f35dcd98 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:08.672571 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-177af0a4-6bf1-4c84-8269-5ec745092345 req-74bc7215-fb30-44af-a85f-5963f35dcd98 service nova] Creating event network-vif-plugged:4e68cc61-1f92-4323-863f-24fb89d25061 for instance 76d6b110-febc-4f28-8367-a0c9ef077177 on n-h1-master-1 Oct 30 01:33:08.679032 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-177af0a4-6bf1-4c84-8269-5ec745092345 req-74bc7215-fb30-44af-a85f-5963f35dcd98 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058755 Oct 30 01:33:08.680620 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2237/4487] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:33:08.703516 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6de955b4-3489-4b06-87b1-c76cab70fce6 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:08.708001 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6de955b4-3489-4b06-87b1-c76cab70fce6 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: 6573b259-e50d-4954-9d64-3c914df97308] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:08.717102 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6de955b4-3489-4b06-87b1-c76cab70fce6 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:08.717834 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6de955b4-3489-4b06-87b1-c76cab70fce6 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:08.718282 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6de955b4-3489-4b06-87b1-c76cab70fce6 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:08.718999 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6de955b4-3489-4b06-87b1-c76cab70fce6 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:08.722030 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6de955b4-3489-4b06-87b1-c76cab70fce6 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:08.723003 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6de955b4-3489-4b06-87b1-c76cab70fce6 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:08.809239 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d8366245-0021-4127-ba93-095ce7bdfa5e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:08.823346 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d8366245-0021-4127-ba93-095ce7bdfa5e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.320894 Oct 30 01:33:08.825782 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2251/4488] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:08 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:08.831282 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6de955b4-3489-4b06-87b1-c76cab70fce6 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:08.834437 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6de955b4-3489-4b06-87b1-c76cab70fce6 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:08.835200 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6de955b4-3489-4b06-87b1-c76cab70fce6 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:08.836462 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-6de955b4-3489-4b06-87b1-c76cab70fce6 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lazy-loading 'fault' on Instance uuid 6573b259-e50d-4954-9d64-3c914df97308 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:33:08.840800 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-89a9aede-cc82-4fe1-9399-ac26ac633e52 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:08.845614 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-89a9aede-cc82-4fe1-9399-ac26ac633e52 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] [instance: 76d6b110-febc-4f28-8367-a0c9ef077177] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:08.866241 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-89a9aede-cc82-4fe1-9399-ac26ac633e52 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:08.867177 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-89a9aede-cc82-4fe1-9399-ac26ac633e52 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:08.869077 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-89a9aede-cc82-4fe1-9399-ac26ac633e52 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:08.882097 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-89a9aede-cc82-4fe1-9399-ac26ac633e52 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:08.882097 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-89a9aede-cc82-4fe1-9399-ac26ac633e52 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:08.882097 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-89a9aede-cc82-4fe1-9399-ac26ac633e52 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:08.984134 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6de955b4-3489-4b06-87b1-c76cab70fce6 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:08.995957 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6de955b4-3489-4b06-87b1-c76cab70fce6 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers/6573b259-e50d-4954-9d64-3c914df97308" status: 200 len: 1311 microversion: 2.1 time: 0.307087 Oct 30 01:33:08.997160 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2238/4489] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:08 2022] GET /compute/v2.1/servers/6573b259-e50d-4954-9d64-3c914df97308 => generated 1311 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:09.026479 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1a507296-192a-4c4d-9900-c68fe666e3e3 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:09.027647 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1a507296-192a-4c4d-9900-c68fe666e3e3 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:09.035544 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a507296-192a-4c4d-9900-c68fe666e3e3 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:09.036359 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a507296-192a-4c4d-9900-c68fe666e3e3 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:09.037040 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a507296-192a-4c4d-9900-c68fe666e3e3 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:09.040104 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a507296-192a-4c4d-9900-c68fe666e3e3 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:09.040919 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a507296-192a-4c4d-9900-c68fe666e3e3 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:09.041672 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a507296-192a-4c4d-9900-c68fe666e3e3 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:09.117418 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-89a9aede-cc82-4fe1-9399-ac26ac633e52 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ac5422c8f048148aac2c9b62e0482e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d179276dbf4e4d9cb780b18e7a22c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:09.127063 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-89a9aede-cc82-4fe1-9399-ac26ac633e52 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "GET /compute/v2.1/servers/76d6b110-febc-4f28-8367-a0c9ef077177" status: 200 len: 1316 microversion: 2.1 time: 0.293259 Oct 30 01:33:09.128704 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2252/4490] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:08 2022] GET /compute/v2.1/servers/76d6b110-febc-4f28-8367-a0c9ef077177 => generated 1316 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:09.224704 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1a507296-192a-4c4d-9900-c68fe666e3e3 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:09.234830 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1a507296-192a-4c4d-9900-c68fe666e3e3 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.221844 Oct 30 01:33:09.235983 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2239/4491] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:09 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:09.258547 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-beaf8cd4-1aa1-40db-a2b7-8427227355ec tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:33:09.260027 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-beaf8cd4-1aa1-40db-a2b7-8427227355ec tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:09.266874 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-beaf8cd4-1aa1-40db-a2b7-8427227355ec tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:09.269221 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-beaf8cd4-1aa1-40db-a2b7-8427227355ec tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:09.269221 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-beaf8cd4-1aa1-40db-a2b7-8427227355ec tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:09.269221 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-beaf8cd4-1aa1-40db-a2b7-8427227355ec tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:09.269487 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-beaf8cd4-1aa1-40db-a2b7-8427227355ec tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:09.269835 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-beaf8cd4-1aa1-40db-a2b7-8427227355ec tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:09.296558 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-beaf8cd4-1aa1-40db-a2b7-8427227355ec tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] HTTP exception thrown: Cannot 'resume' instance b0c51345-2948-4ff1-828f-8c70b2b979f2 while it is in vm_state active Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-beaf8cd4-1aa1-40db-a2b7-8427227355ec tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Request method failure captured: Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2/action HTTP/1.1 Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 14 Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdPsZZXjRvWKe2zWP-5VH1VYAsWsLLjUmpyob2uINkfAXNLt0qGMmCTWjYn2WpZ3XOOdsuaM4lwk-qZrOIX3mOHzuCJPZ3r-9M-w153XBWLoTow-eSMj1bsAWDNo3KKhMzjHqic8AJ-DcXpdsBh93g0dRB_UMWMRrGyY1cbSRdHJrvg Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 0bce487302c24def8a8473b0725904f2 Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: {"resume": {}} Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: exception: Cannot 'resume' instance b0c51345-2948-4ff1-828f-8c70b2b979f2 while it is in vm_state active Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'b0c51345-2948-4ff1-828f-8c70b2b979f2', 'body': {'resume': {}}} Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b0c51345-2948-4ff1-828f-8c70b2b979f2 in vm_state active. Cannot resume while the instance is in this state. Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance b0c51345-2948-4ff1-828f-8c70b2b979f2 while it is in vm_state active Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:09.298545 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:09.302246 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:09.302246 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:09.302246 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:09.302246 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:33:09.302246 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:33:09.302246 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance b0c51345-2948-4ff1-828f-8c70b2b979f2 while it is in vm_state active Oct 30 01:33:09.302246 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:09.303932 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-beaf8cd4-1aa1-40db-a2b7-8427227355ec tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Returning 409 to user: Cannot 'resume' instance b0c51345-2948-4ff1-828f-8c70b2b979f2 while it is in vm_state active {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:33:09.304821 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-beaf8cd4-1aa1-40db-a2b7-8427227355ec tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "POST /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2/action" status: 409 len: 144 microversion: 2.1 time: 0.050704 Oct 30 01:33:09.305447 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2253/4492] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:33:09 2022] POST /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2/action => generated 144 bytes in 52 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:33:09.315669 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-016f5976-0f9c-4452-b244-459eba09799c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:09.316617 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-016f5976-0f9c-4452-b244-459eba09799c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:09.319740 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:09.323812 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-016f5976-0f9c-4452-b244-459eba09799c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:09.324298 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-016f5976-0f9c-4452-b244-459eba09799c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:09.324728 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-016f5976-0f9c-4452-b244-459eba09799c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:09.325593 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-016f5976-0f9c-4452-b244-459eba09799c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:09.326075 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-016f5976-0f9c-4452-b244-459eba09799c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:09.326513 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-016f5976-0f9c-4452-b244-459eba09799c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:09.354928 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6e5634d1-4cf4-4050-b5a7-c058ed3f745e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:09.358726 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6e5634d1-4cf4-4050-b5a7-c058ed3f745e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 2864065f-4af8-4134-b3f6-af254b7ab474] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:09.368060 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e5634d1-4cf4-4050-b5a7-c058ed3f745e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:09.369070 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e5634d1-4cf4-4050-b5a7-c058ed3f745e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:09.369542 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e5634d1-4cf4-4050-b5a7-c058ed3f745e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:09.370248 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e5634d1-4cf4-4050-b5a7-c058ed3f745e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:09.370915 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e5634d1-4cf4-4050-b5a7-c058ed3f745e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:09.371371 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e5634d1-4cf4-4050-b5a7-c058ed3f745e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:09.465613 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6e5634d1-4cf4-4050-b5a7-c058ed3f745e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:09.479901 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6e5634d1-4cf4-4050-b5a7-c058ed3f745e tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/2864065f-4af8-4134-b3f6-af254b7ab474" status: 200 len: 1439 microversion: 2.1 time: 0.127584 Oct 30 01:33:09.481222 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2254/4493] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:09 2022] GET /compute/v2.1/servers/2864065f-4af8-4134-b3f6-af254b7ab474 => generated 1439 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:09.545752 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-016f5976-0f9c-4452-b244-459eba09799c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:09.556517 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-016f5976-0f9c-4452-b244-459eba09799c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.245262 Oct 30 01:33:09.558127 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2240/4494] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:09 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:33:09.583672 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-733ca79c-0755-424c-b536-6bd1d02aeffb tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:09.584744 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-733ca79c-0755-424c-b536-6bd1d02aeffb tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:09.594353 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-733ca79c-0755-424c-b536-6bd1d02aeffb tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:09.595119 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-733ca79c-0755-424c-b536-6bd1d02aeffb tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:09.596059 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-733ca79c-0755-424c-b536-6bd1d02aeffb tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:09.597610 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-733ca79c-0755-424c-b536-6bd1d02aeffb tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:09.598416 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-733ca79c-0755-424c-b536-6bd1d02aeffb tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:09.599062 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-733ca79c-0755-424c-b536-6bd1d02aeffb tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:09.894375 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-733ca79c-0755-424c-b536-6bd1d02aeffb tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:09.903114 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-733ca79c-0755-424c-b536-6bd1d02aeffb tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.323432 Oct 30 01:33:09.903682 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2255/4495] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:09 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:09.903824 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-53eda65e-47e1-474f-b3ce-eff2012fa323 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:09.904311 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-53eda65e-47e1-474f-b3ce-eff2012fa323 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 28af596f-f044-4281-8106-4585fbde9a4a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:09.910663 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-53eda65e-47e1-474f-b3ce-eff2012fa323 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:09.911190 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-53eda65e-47e1-474f-b3ce-eff2012fa323 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:09.911598 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-53eda65e-47e1-474f-b3ce-eff2012fa323 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:09.912294 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-53eda65e-47e1-474f-b3ce-eff2012fa323 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:09.912951 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-53eda65e-47e1-474f-b3ce-eff2012fa323 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:09.913170 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-53eda65e-47e1-474f-b3ce-eff2012fa323 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:10.026546 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3097beb9-984b-47e6-89d9-7d5d7d33f63f tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:10.027585 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3097beb9-984b-47e6-89d9-7d5d7d33f63f tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: 6573b259-e50d-4954-9d64-3c914df97308] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:10.034215 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3097beb9-984b-47e6-89d9-7d5d7d33f63f tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:10.035165 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3097beb9-984b-47e6-89d9-7d5d7d33f63f tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:10.036430 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3097beb9-984b-47e6-89d9-7d5d7d33f63f tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:10.037382 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3097beb9-984b-47e6-89d9-7d5d7d33f63f tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:10.038081 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3097beb9-984b-47e6-89d9-7d5d7d33f63f tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:10.038713 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3097beb9-984b-47e6-89d9-7d5d7d33f63f tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:10.058303 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-3097beb9-984b-47e6-89d9-7d5d7d33f63f tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] HTTP exception thrown: Instance 6573b259-e50d-4954-9d64-3c914df97308 could not be found. Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3097beb9-984b-47e6-89d9-7d5d7d33f63f tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Request method failure captured: Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/6573b259-e50d-4954-9d64-3c914df97308 HTTP/1.1 Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdQDYci6teSCD8FW03WnqGGSAYCFc3LwP63Rw8Z0U3xVdCko3fGaoma0FdHMlHYZHY323ocvivJeSjvJElJAt33CZMiA61iE55fdR-I2KewZoQUxzJABDW30I3YnxeC3KFzcn39azj6Ca-ZFZp-_EtsqYWNeIpBYa4VulNkXEM1b8xY Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 8b25b290c8004e1f8f89e17b448f242a Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ListServerFiltersTestJSON-1179388771 Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8b25b290c8004e1f8f89e17b448f242a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8b25b290c8004e1f8f89e17b448f242a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8b25b290c8004e1f8f89e17b448f242a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8b25b290c8004e1f8f89e17b448f242a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ListServerFiltersTestJSON-1179388771 Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 8b25b290c8004e1f8f89e17b448f242a Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1179388771 Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ListServerFiltersTestJSON-1179388771-project Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: b0d4603acbc846dcb2f523091cd78ae4 Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ListServerFiltersTestJSON-1179388771-project Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 6573b259-e50d-4954-9d64-3c914df97308 could not be found. Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '6573b259-e50d-4954-9d64-3c914df97308'} Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6573b259-e50d-4954-9d64-3c914df97308 could not be found. Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6573b259-e50d-4954-9d64-3c914df97308 could not be found. Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:10.060654 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:10.070373 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:10.070373 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:10.070373 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:10.070373 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:33:10.070373 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:33:10.070373 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6573b259-e50d-4954-9d64-3c914df97308 could not be found. Oct 30 01:33:10.070373 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:10.070373 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3097beb9-984b-47e6-89d9-7d5d7d33f63f tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Returning 404 to user: Instance 6573b259-e50d-4954-9d64-3c914df97308 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:33:10.070373 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3097beb9-984b-47e6-89d9-7d5d7d33f63f tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers/6573b259-e50d-4954-9d64-3c914df97308" status: 404 len: 111 microversion: 2.1 time: 0.040879 Oct 30 01:33:10.070373 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2256/4496] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:10 2022] GET /compute/v2.1/servers/6573b259-e50d-4954-9d64-3c914df97308 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:33:10.072408 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9d45e860-faf7-4b59-858e-29229e80be55 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "2bdbb622-9eb5-4b19-93d6-10bf71c70ecc"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9d45e860-faf7-4b59-858e-29229e80be55 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Request method failure captured: Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 160 Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdPsZZXjRvWKe2zWP-5VH1VYAsWsLLjUmpyob2uINkfAXNLt0qGMmCTWjYn2WpZ3XOOdsuaM4lwk-qZrOIX3mOHzuCJPZ3r-9M-w153XBWLoTow-eSMj1bsAWDNo3KKhMzjHqic8AJ-DcXpdsBh93g0dRB_UMWMRrGyY1cbSRdHJrvg Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 0bce487302c24def8a8473b0725904f2 Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: {"server": {"name": "", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "2bdbb622-9eb5-4b19-93d6-10bf71c70ecc"}]}} Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: action_args: {'body': {'server': {'name': '', 'imageRef': 'deb14158-45d8-4539-889d-ff9726d046d7', 'flavorRef': '452', 'networks': [{'uuid': '2bdbb622-9eb5-4b19-93d6-10bf71c70ecc'}]}}} Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise error Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi '' Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 30 01:33:10.076610 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 30 01:33:10.088333 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 30 01:33:10.088333 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 30 01:33:10.088333 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:10.088333 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:10.088333 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:10.088333 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:10.088333 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:10.088333 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:10.088333 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 30 01:33:10.088333 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 30 01:33:10.088333 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 30 01:33:10.088333 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:10.088333 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9d45e860-faf7-4b59-858e-29229e80be55 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:33:10.088333 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9d45e860-faf7-4b59-858e-29229e80be55 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.012985 Oct 30 01:33:10.088333 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2257/4497] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:33:10 2022] POST /compute/v2.1/servers => generated 108 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:33:10.088333 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b5f0e6af-d346-4b90-bbf2-555eb2c8f8ca tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:10.088333 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b5f0e6af-d346-4b90-bbf2-555eb2c8f8ca tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: b36a2df7-45c9-4a51-88f1-e1a1b9c0969d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:10.093543 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b5f0e6af-d346-4b90-bbf2-555eb2c8f8ca tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:10.094040 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b5f0e6af-d346-4b90-bbf2-555eb2c8f8ca tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:10.094475 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b5f0e6af-d346-4b90-bbf2-555eb2c8f8ca tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:10.095318 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b5f0e6af-d346-4b90-bbf2-555eb2c8f8ca tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:10.095619 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b5f0e6af-d346-4b90-bbf2-555eb2c8f8ca tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:10.096041 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b5f0e6af-d346-4b90-bbf2-555eb2c8f8ca tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:10.129031 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b5f0e6af-d346-4b90-bbf2-555eb2c8f8ca tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: b36a2df7-45c9-4a51-88f1-e1a1b9c0969d] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:33:10.326860 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-53eda65e-47e1-474f-b3ce-eff2012fa323 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:10.358243 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-53eda65e-47e1-474f-b3ce-eff2012fa323 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a" status: 200 len: 1522 microversion: 2.1 time: 0.720587 Oct 30 01:33:10.359123 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2241/4498] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:09 2022] GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a => generated 1522 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:10.388992 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-7bfb010f-b42d-4fd5-9d6a-08a4c1094338 req-978ac22c-5689-43ab-a95e-9dafc9aa0a15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2864065f-4af8-4134-b3f6-af254b7ab474", "name": "network-vif-deleted", "tag": "fd936916-f520-4593-848c-8120c98ac691"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:33:10.413631 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-7bfb010f-b42d-4fd5-9d6a-08a4c1094338 req-978ac22c-5689-43ab-a95e-9dafc9aa0a15 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:10.414159 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-7bfb010f-b42d-4fd5-9d6a-08a4c1094338 req-978ac22c-5689-43ab-a95e-9dafc9aa0a15 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:10.414600 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-7bfb010f-b42d-4fd5-9d6a-08a4c1094338 req-978ac22c-5689-43ab-a95e-9dafc9aa0a15 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:10.426288 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-7bfb010f-b42d-4fd5-9d6a-08a4c1094338 req-978ac22c-5689-43ab-a95e-9dafc9aa0a15 service nova] Creating event network-vif-deleted:fd936916-f520-4593-848c-8120c98ac691 for instance 2864065f-4af8-4134-b3f6-af254b7ab474 on n-h2-master-1 Oct 30 01:33:10.451811 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-7bfb010f-b42d-4fd5-9d6a-08a4c1094338 req-978ac22c-5689-43ab-a95e-9dafc9aa0a15 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082279 Oct 30 01:33:10.454620 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2242/4499] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:33:10.490127 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1fc6d382-e62c-4b4e-b4fc-52f21407e190 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:10.491130 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1fc6d382-e62c-4b4e-b4fc-52f21407e190 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:10.498072 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b5f0e6af-d346-4b90-bbf2-555eb2c8f8ca tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b36a2df7-45c9-4a51-88f1-e1a1b9c0969d" status: 204 len: 0 microversion: 2.1 time: 0.416164 Oct 30 01:33:10.498072 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2258/4500] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:33:10 2022] DELETE /compute/v2.1/servers/b36a2df7-45c9-4a51-88f1-e1a1b9c0969d => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:33:10.512137 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1fc6d382-e62c-4b4e-b4fc-52f21407e190 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:10.512832 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1fc6d382-e62c-4b4e-b4fc-52f21407e190 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:10.512955 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3185f0da-e50b-44c2-8846-cada177b5309 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:10.513681 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1fc6d382-e62c-4b4e-b4fc-52f21407e190 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:10.514255 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3185f0da-e50b-44c2-8846-cada177b5309 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] [instance: 76d6b110-febc-4f28-8367-a0c9ef077177] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:10.515195 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1fc6d382-e62c-4b4e-b4fc-52f21407e190 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:10.516152 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1fc6d382-e62c-4b4e-b4fc-52f21407e190 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:10.516909 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1fc6d382-e62c-4b4e-b4fc-52f21407e190 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:10.520658 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3185f0da-e50b-44c2-8846-cada177b5309 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:10.521163 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3185f0da-e50b-44c2-8846-cada177b5309 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:10.522487 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3185f0da-e50b-44c2-8846-cada177b5309 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:10.522487 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3185f0da-e50b-44c2-8846-cada177b5309 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:10.522868 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3185f0da-e50b-44c2-8846-cada177b5309 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:10.523279 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3185f0da-e50b-44c2-8846-cada177b5309 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:11.302398 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1fc6d382-e62c-4b4e-b4fc-52f21407e190 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:11.313658 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1fc6d382-e62c-4b4e-b4fc-52f21407e190 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.857286 Oct 30 01:33:11.314297 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2243/4501] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:10 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:11.339223 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5a67d992-9121-4503-a3d2-fd0364215916 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:11.339857 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5a67d992-9121-4503-a3d2-fd0364215916 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 2864065f-4af8-4134-b3f6-af254b7ab474] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:11.355135 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5a67d992-9121-4503-a3d2-fd0364215916 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:11.355651 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5a67d992-9121-4503-a3d2-fd0364215916 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:11.356099 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5a67d992-9121-4503-a3d2-fd0364215916 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:11.356821 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5a67d992-9121-4503-a3d2-fd0364215916 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:11.357279 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5a67d992-9121-4503-a3d2-fd0364215916 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:11.357736 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5a67d992-9121-4503-a3d2-fd0364215916 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:11.376505 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3185f0da-e50b-44c2-8846-cada177b5309 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ac5422c8f048148aac2c9b62e0482e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d179276dbf4e4d9cb780b18e7a22c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:11.385143 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3185f0da-e50b-44c2-8846-cada177b5309 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "GET /compute/v2.1/servers/76d6b110-febc-4f28-8367-a0c9ef077177" status: 200 len: 1316 microversion: 2.1 time: 0.886549 Oct 30 01:33:11.394909 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2259/4502] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:10 2022] GET /compute/v2.1/servers/76d6b110-febc-4f28-8367-a0c9ef077177 => generated 1316 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:11.400693 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ca6b504f-9ee5-4b79-9d39-c7c412cc985e tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:11.405475 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ca6b504f-9ee5-4b79-9d39-c7c412cc985e tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: b36a2df7-45c9-4a51-88f1-e1a1b9c0969d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:11.414615 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ca6b504f-9ee5-4b79-9d39-c7c412cc985e tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:11.417899 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ca6b504f-9ee5-4b79-9d39-c7c412cc985e tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:11.418588 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ca6b504f-9ee5-4b79-9d39-c7c412cc985e tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:11.419329 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ca6b504f-9ee5-4b79-9d39-c7c412cc985e tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:11.419795 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ca6b504f-9ee5-4b79-9d39-c7c412cc985e tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:11.420228 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ca6b504f-9ee5-4b79-9d39-c7c412cc985e tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:11.522088 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5a67d992-9121-4503-a3d2-fd0364215916 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f8a3e6fef4d6393603575479b16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe1c50eaee40249b6c20cc91e52586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:11.524993 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:11.548765 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5a67d992-9121-4503-a3d2-fd0364215916 tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/2864065f-4af8-4134-b3f6-af254b7ab474" status: 200 len: 1278 microversion: 2.1 time: 0.218148 Oct 30 01:33:11.553159 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2244/4503] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:11 2022] GET /compute/v2.1/servers/2864065f-4af8-4134-b3f6-af254b7ab474 => generated 1278 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:11.559569 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d0528c69-08a8-48fb-ad90-ef65a5c9182d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:11.560537 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d0528c69-08a8-48fb-ad90-ef65a5c9182d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:11.567994 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d0528c69-08a8-48fb-ad90-ef65a5c9182d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:11.568831 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d0528c69-08a8-48fb-ad90-ef65a5c9182d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:11.569585 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d0528c69-08a8-48fb-ad90-ef65a5c9182d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:11.570549 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d0528c69-08a8-48fb-ad90-ef65a5c9182d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:11.571298 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d0528c69-08a8-48fb-ad90-ef65a5c9182d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:11.572466 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d0528c69-08a8-48fb-ad90-ef65a5c9182d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:11.857733 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ca6b504f-9ee5-4b79-9d39-c7c412cc985e tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:11.896739 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ca6b504f-9ee5-4b79-9d39-c7c412cc985e tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers/b36a2df7-45c9-4a51-88f1-e1a1b9c0969d" status: 200 len: 1518 microversion: 2.1 time: 0.477852 Oct 30 01:33:11.896739 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2260/4504] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:11 2022] GET /compute/v2.1/servers/b36a2df7-45c9-4a51-88f1-e1a1b9c0969d => generated 1518 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:11.896739 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f5df3a71-e8b6-4a58-bc09-f4b6d9bca210 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:11.896739 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f5df3a71-e8b6-4a58-bc09-f4b6d9bca210 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 28af596f-f044-4281-8106-4585fbde9a4a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:11.896739 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5df3a71-e8b6-4a58-bc09-f4b6d9bca210 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:11.896739 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5df3a71-e8b6-4a58-bc09-f4b6d9bca210 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:11.896739 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5df3a71-e8b6-4a58-bc09-f4b6d9bca210 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:11.897211 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5df3a71-e8b6-4a58-bc09-f4b6d9bca210 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:11.897681 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5df3a71-e8b6-4a58-bc09-f4b6d9bca210 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:11.904481 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5df3a71-e8b6-4a58-bc09-f4b6d9bca210 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:11.971309 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d0528c69-08a8-48fb-ad90-ef65a5c9182d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:12.001417 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d0528c69-08a8-48fb-ad90-ef65a5c9182d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.445468 Oct 30 01:33:12.002845 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2245/4505] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:11 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:12.027926 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b633bcf9-d219-4b11-a7fe-f95f880e232f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:33:12.028479 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b633bcf9-d219-4b11-a7fe-f95f880e232f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: e9eb7ba3-e0d3-4622-82ed-59bcfbaf11d6] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:12.035547 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-b633bcf9-d219-4b11-a7fe-f95f880e232f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] HTTP exception thrown: Instance e9eb7ba3-e0d3-4622-82ed-59bcfbaf11d6 could not be found. Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b633bcf9-d219-4b11-a7fe-f95f880e232f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Request method failure captured: Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: request: POST /compute/v2.1/servers/e9eb7ba3-e0d3-4622-82ed-59bcfbaf11d6/action HTTP/1.1 Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 14 Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdPsZZXjRvWKe2zWP-5VH1VYAsWsLLjUmpyob2uINkfAXNLt0qGMmCTWjYn2WpZ3XOOdsuaM4lwk-qZrOIX3mOHzuCJPZ3r-9M-w153XBWLoTow-eSMj1bsAWDNo3KKhMzjHqic8AJ-DcXpdsBh93g0dRB_UMWMRrGyY1cbSRdHJrvg Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 0bce487302c24def8a8473b0725904f2 Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: {"shelve": {}} Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: exception: Instance e9eb7ba3-e0d3-4622-82ed-59bcfbaf11d6 could not be found. Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'e9eb7ba3-e0d3-4622-82ed-59bcfbaf11d6', 'body': {'shelve': {}}} Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9eb7ba3-e0d3-4622-82ed-59bcfbaf11d6 could not be found. Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9eb7ba3-e0d3-4622-82ed-59bcfbaf11d6 could not be found. Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:12.038119 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:12.047118 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:33:12.047118 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:33:12.047118 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9eb7ba3-e0d3-4622-82ed-59bcfbaf11d6 could not be found. Oct 30 01:33:12.047118 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:12.047118 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b633bcf9-d219-4b11-a7fe-f95f880e232f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Returning 404 to user: Instance e9eb7ba3-e0d3-4622-82ed-59bcfbaf11d6 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:33:12.047118 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b633bcf9-d219-4b11-a7fe-f95f880e232f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "POST /compute/v2.1/servers/e9eb7ba3-e0d3-4622-82ed-59bcfbaf11d6/action" status: 404 len: 111 microversion: 2.1 time: 0.021938 Oct 30 01:33:12.047118 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2246/4506] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:33:12 2022] POST /compute/v2.1/servers/e9eb7ba3-e0d3-4622-82ed-59bcfbaf11d6/action => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 01:33:12.051930 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9821a6d2-1570-48ed-904e-90a54f1e7515 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:12.052760 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9821a6d2-1570-48ed-904e-90a54f1e7515 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:12.060597 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9821a6d2-1570-48ed-904e-90a54f1e7515 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:12.061460 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9821a6d2-1570-48ed-904e-90a54f1e7515 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:12.062123 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9821a6d2-1570-48ed-904e-90a54f1e7515 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:12.063126 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9821a6d2-1570-48ed-904e-90a54f1e7515 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:12.063810 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9821a6d2-1570-48ed-904e-90a54f1e7515 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:12.064486 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9821a6d2-1570-48ed-904e-90a54f1e7515 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:12.352045 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f5df3a71-e8b6-4a58-bc09-f4b6d9bca210 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:12.363453 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f5df3a71-e8b6-4a58-bc09-f4b6d9bca210 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a" status: 200 len: 1522 microversion: 2.1 time: 0.487263 Oct 30 01:33:12.364062 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2261/4507] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:11 2022] GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a => generated 1522 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:12.412407 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9821a6d2-1570-48ed-904e-90a54f1e7515 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:12.420694 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-27716509-501c-4e5d-bcf6-e5b3fa7bf392 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:12.421674 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-27716509-501c-4e5d-bcf6-e5b3fa7bf392 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] [instance: 76d6b110-febc-4f28-8367-a0c9ef077177] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:12.424236 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9821a6d2-1570-48ed-904e-90a54f1e7515 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.376964 Oct 30 01:33:12.424999 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2247/4508] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:12 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:12.430495 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27716509-501c-4e5d-bcf6-e5b3fa7bf392 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:12.430997 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27716509-501c-4e5d-bcf6-e5b3fa7bf392 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:12.431438 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27716509-501c-4e5d-bcf6-e5b3fa7bf392 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:12.432152 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27716509-501c-4e5d-bcf6-e5b3fa7bf392 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:12.432638 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27716509-501c-4e5d-bcf6-e5b3fa7bf392 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:12.433072 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27716509-501c-4e5d-bcf6-e5b3fa7bf392 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:12.448795 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-dded83de-1b4a-43db-aa04-4bef58f16893 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:12.449873 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-dded83de-1b4a-43db-aa04-4bef58f16893 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:12.458203 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dded83de-1b4a-43db-aa04-4bef58f16893 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:12.459593 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dded83de-1b4a-43db-aa04-4bef58f16893 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:12.460248 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dded83de-1b4a-43db-aa04-4bef58f16893 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:12.461181 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dded83de-1b4a-43db-aa04-4bef58f16893 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:12.462423 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dded83de-1b4a-43db-aa04-4bef58f16893 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:12.463061 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dded83de-1b4a-43db-aa04-4bef58f16893 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:12.865554 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-27716509-501c-4e5d-bcf6-e5b3fa7bf392 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ac5422c8f048148aac2c9b62e0482e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d179276dbf4e4d9cb780b18e7a22c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:12.882264 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-27716509-501c-4e5d-bcf6-e5b3fa7bf392 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "GET /compute/v2.1/servers/76d6b110-febc-4f28-8367-a0c9ef077177" status: 200 len: 1505 microversion: 2.1 time: 0.461161 Oct 30 01:33:12.882264 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2262/4509] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:12 2022] GET /compute/v2.1/servers/76d6b110-febc-4f28-8367-a0c9ef077177 => generated 1505 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:33:12.890725 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-dded83de-1b4a-43db-aa04-4bef58f16893 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:12.893744 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c127f134-6d80-4032-996b-3064322277bf tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:12.894527 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c127f134-6d80-4032-996b-3064322277bf tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] [instance: 2864065f-4af8-4134-b3f6-af254b7ab474] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:12.907200 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-dded83de-1b4a-43db-aa04-4bef58f16893 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.463040 Oct 30 01:33:12.908413 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2248/4510] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:12 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:12.919299 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c31a5228-75b3-485b-8eed-6e8f0bb645d5 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:12.921898 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c31a5228-75b3-485b-8eed-6e8f0bb645d5 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: b36a2df7-45c9-4a51-88f1-e1a1b9c0969d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:12.922134 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c127f134-6d80-4032-996b-3064322277bf tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:12.922727 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c127f134-6d80-4032-996b-3064322277bf tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:12.923293 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c127f134-6d80-4032-996b-3064322277bf tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:12.924032 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c127f134-6d80-4032-996b-3064322277bf tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:12.924487 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c127f134-6d80-4032-996b-3064322277bf tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:12.924912 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c127f134-6d80-4032-996b-3064322277bf tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:12.954875 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-c127f134-6d80-4032-996b-3064322277bf tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] HTTP exception thrown: Instance 2864065f-4af8-4134-b3f6-af254b7ab474 could not be found. Oct 30 01:33:12.956663 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c31a5228-75b3-485b-8eed-6e8f0bb645d5 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c127f134-6d80-4032-996b-3064322277bf tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Request method failure captured: Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/2864065f-4af8-4134-b3f6-af254b7ab474 HTTP/1.1 Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdNZbeUR7skwu5ylmljymLwmsn3OMAB7HFdlDZsip3dgOK-vaOPPSwUYmWT_o9z2OqWc9cL2Rd22cHSa-BN8vqcvBTHGvFnuVH3dT1kVAQG6ODQVt2oxoFKeXYoNTjg1JUCF1B7Vzk2gVPeSesCiSDD37BDZ3_Wp6AgzZI4w4KMCOXw Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 45fe1c50eaee40249b6c20cc91e52586 Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServersTestJSON-1478392549 Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45fe1c50eaee40249b6c20cc91e52586"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServersTestJSON-1478392549 Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 45fe1c50eaee40249b6c20cc91e52586 Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServersTestJSON-1478392549 Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServersTestJSON-1478392549-project Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: ef5f8a3e6fef4d6393603575479b16a2 Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServersTestJSON-1478392549-project Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 2864065f-4af8-4134-b3f6-af254b7ab474 could not be found. Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '2864065f-4af8-4134-b3f6-af254b7ab474'} Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2864065f-4af8-4134-b3f6-af254b7ab474 could not be found. Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2864065f-4af8-4134-b3f6-af254b7ab474 could not be found. Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:12.958768 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:12.962503 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:12.962503 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:12.962503 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:12.962503 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:33:12.962503 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:33:12.962503 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2864065f-4af8-4134-b3f6-af254b7ab474 could not be found. Oct 30 01:33:12.962503 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:12.962503 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c127f134-6d80-4032-996b-3064322277bf tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] Returning 404 to user: Instance 2864065f-4af8-4134-b3f6-af254b7ab474 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:33:12.962969 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c31a5228-75b3-485b-8eed-6e8f0bb645d5 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:12.962969 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c31a5228-75b3-485b-8eed-6e8f0bb645d5 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:12.963098 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c127f134-6d80-4032-996b-3064322277bf tempest-ServersTestJSON-1478392549 tempest-ServersTestJSON-1478392549-project] 10.222.0.13 "GET /compute/v2.1/servers/2864065f-4af8-4134-b3f6-af254b7ab474" status: 404 len: 111 microversion: 2.1 time: 0.076199 Oct 30 01:33:12.963183 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c31a5228-75b3-485b-8eed-6e8f0bb645d5 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:12.963183 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c31a5228-75b3-485b-8eed-6e8f0bb645d5 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:12.963183 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c31a5228-75b3-485b-8eed-6e8f0bb645d5 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:12.964842 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2263/4511] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:12 2022] GET /compute/v2.1/servers/2864065f-4af8-4134-b3f6-af254b7ab474 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:33:12.970247 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-49f58362-19f5-4df6-86e7-c0ce0b58f6a0 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-366630624"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:33:12.971363 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-49f58362-19f5-4df6-86e7-c0ce0b58f6a0 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] [instance: 76d6b110-febc-4f28-8367-a0c9ef077177] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:12.978173 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-49f58362-19f5-4df6-86e7-c0ce0b58f6a0 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:12.978987 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-49f58362-19f5-4df6-86e7-c0ce0b58f6a0 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:12.979655 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-49f58362-19f5-4df6-86e7-c0ce0b58f6a0 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:12.980574 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-49f58362-19f5-4df6-86e7-c0ce0b58f6a0 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:12.981195 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-49f58362-19f5-4df6-86e7-c0ce0b58f6a0 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:12.981945 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-49f58362-19f5-4df6-86e7-c0ce0b58f6a0 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:13.307315 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c31a5228-75b3-485b-8eed-6e8f0bb645d5 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:13.310353 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c31a5228-75b3-485b-8eed-6e8f0bb645d5 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers/b36a2df7-45c9-4a51-88f1-e1a1b9c0969d" status: 200 len: 1518 microversion: 2.1 time: 0.400328 Oct 30 01:33:13.310794 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2249/4512] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:12 2022] GET /compute/v2.1/servers/b36a2df7-45c9-4a51-88f1-e1a1b9c0969d => generated 1518 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:13.313140 n-d-master-1 devstack@n-api.service[121102]: INFO nova.network.security_group_api [None req-49f58362-19f5-4df6-86e7-c0ce0b58f6a0 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Adding security group b0678fcc-2ce2-40ed-a488-ecee6ba65afe to port 4e68cc61-1f92-4323-863f-24fb89d25061 Oct 30 01:33:13.316249 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e6b297c0-43f6-4b1b-a962-d603d981a147 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:33:13.317066 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e6b297c0-43f6-4b1b-a962-d603d981a147 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:13.324185 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e6b297c0-43f6-4b1b-a962-d603d981a147 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:13.325027 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e6b297c0-43f6-4b1b-a962-d603d981a147 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:13.325979 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e6b297c0-43f6-4b1b-a962-d603d981a147 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:13.326986 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e6b297c0-43f6-4b1b-a962-d603d981a147 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:13.327645 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e6b297c0-43f6-4b1b-a962-d603d981a147 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:13.328275 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e6b297c0-43f6-4b1b-a962-d603d981a147 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:13.359961 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-e6b297c0-43f6-4b1b-a962-d603d981a147 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lazy-loading 'flavor' on Instance uuid b0c51345-2948-4ff1-828f-8c70b2b979f2 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:33:14.175920 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e6b297c0-43f6-4b1b-a962-d603d981a147 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "POST /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2/action" status: 202 len: 0 microversion: 2.1 time: 0.863651 Oct 30 01:33:14.177207 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2250/4513] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:33:13 2022] POST /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2/action => generated 0 bytes in 866 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:33:14.182974 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-d4ecb202-f9fc-4f0a-b332-bb89c6f4c1e4 req-8d46a18b-0814-4dbf-945f-4429f0ab2d4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28af596f-f044-4281-8106-4585fbde9a4a", "name": "network-vif-deleted", "tag": "549f19a7-85dc-4d6e-b940-48f4f45b7e9a"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:33:14.194396 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d4ecb202-f9fc-4f0a-b332-bb89c6f4c1e4 req-8d46a18b-0814-4dbf-945f-4429f0ab2d4d service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:14.195598 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d4ecb202-f9fc-4f0a-b332-bb89c6f4c1e4 req-8d46a18b-0814-4dbf-945f-4429f0ab2d4d service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:14.199210 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d4ecb202-f9fc-4f0a-b332-bb89c6f4c1e4 req-8d46a18b-0814-4dbf-945f-4429f0ab2d4d service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:14.208059 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-d4ecb202-f9fc-4f0a-b332-bb89c6f4c1e4 req-8d46a18b-0814-4dbf-945f-4429f0ab2d4d service nova] Creating event network-vif-deleted:549f19a7-85dc-4d6e-b940-48f4f45b7e9a for instance 28af596f-f044-4281-8106-4585fbde9a4a on n-h2-master-1 Oct 30 01:33:14.214362 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-d4ecb202-f9fc-4f0a-b332-bb89c6f4c1e4 req-8d46a18b-0814-4dbf-945f-4429f0ab2d4d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035535 Oct 30 01:33:14.215530 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2251/4514] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:33:14.221451 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-83a7f275-a255-499f-84a9-49781b575d58 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:14.222438 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-83a7f275-a255-499f-84a9-49781b575d58 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 28af596f-f044-4281-8106-4585fbde9a4a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:14.229846 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-83a7f275-a255-499f-84a9-49781b575d58 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:14.230728 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-83a7f275-a255-499f-84a9-49781b575d58 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:14.231369 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-83a7f275-a255-499f-84a9-49781b575d58 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:14.232309 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-83a7f275-a255-499f-84a9-49781b575d58 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:14.232959 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-83a7f275-a255-499f-84a9-49781b575d58 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:14.234764 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-83a7f275-a255-499f-84a9-49781b575d58 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:14.273220 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-83a7f275-a255-499f-84a9-49781b575d58 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:14.273836 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-83a7f275-a255-499f-84a9-49781b575d58 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:14.275078 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-83a7f275-a255-499f-84a9-49781b575d58 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:14.275643 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-83a7f275-a255-499f-84a9-49781b575d58 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lazy-loading 'fault' on Instance uuid 28af596f-f044-4281-8106-4585fbde9a4a {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:33:14.289320 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-49f58362-19f5-4df6-86e7-c0ce0b58f6a0 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "POST /compute/v2.1/servers/76d6b110-febc-4f28-8367-a0c9ef077177/action" status: 202 len: 0 microversion: 2.1 time: 1.323142 Oct 30 01:33:14.291335 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2264/4515] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:33:12 2022] POST /compute/v2.1/servers/76d6b110-febc-4f28-8367-a0c9ef077177/action => generated 0 bytes in 1326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:33:14.296141 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-649b64ff-6a4a-489f-87b9-77eb82cd1461 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:14.298087 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-649b64ff-6a4a-489f-87b9-77eb82cd1461 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:14.312095 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-649b64ff-6a4a-489f-87b9-77eb82cd1461 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:14.314642 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-649b64ff-6a4a-489f-87b9-77eb82cd1461 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:14.315330 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-649b64ff-6a4a-489f-87b9-77eb82cd1461 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:14.317530 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-649b64ff-6a4a-489f-87b9-77eb82cd1461 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:14.328669 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-649b64ff-6a4a-489f-87b9-77eb82cd1461 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:14.329727 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-649b64ff-6a4a-489f-87b9-77eb82cd1461 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:14.422934 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-83a7f275-a255-499f-84a9-49781b575d58 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134c05549f14bc19962acea9c913f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470e235fb35840828d9a86028b72f5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:14.437387 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-83a7f275-a255-499f-84a9-49781b575d58 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a" status: 200 len: 1312 microversion: 2.1 time: 0.219965 Oct 30 01:33:14.438292 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2252/4516] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:14 2022] GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a => generated 1312 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:14.444915 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a1e8be8f-ff8e-4e5a-a8e7-1d7319657faa tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '.version_select at 0x7f44c6fb0dc0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:14.816200 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-649b64ff-6a4a-489f-87b9-77eb82cd1461 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:14.833440 n-d-master-1 devstack@n-api.service[121103]: DEBUG neutronclient.v2_0.client [None req-a1e8be8f-ff8e-4e5a-a8e7-1d7319657faa tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group b0678fcc-2ce2-40ed-a488-ecee6ba65afe in use.", "detail": ""}} {{(pid=121103) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 30 01:33:14.833575 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-649b64ff-6a4a-489f-87b9-77eb82cd1461 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1509 microversion: 2.1 time: 0.539844 Oct 30 01:33:14.834197 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2265/4517] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:14 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1509 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:14.835269 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-a1e8be8f-ff8e-4e5a-a8e7-1d7319657faa tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] HTTP exception thrown: Security Group b0678fcc-2ce2-40ed-a488-ecee6ba65afe in use. Oct 30 01:33:14.835269 n-d-master-1 devstack@n-api.service[121103]: Neutron server returns request_ids: ['req-1123f49e-e0d3-4ad6-8a80-f023fae3cefc'] Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a1e8be8f-ff8e-4e5a-a8e7-1d7319657faa tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Request method failure captured: Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: request: DELETE /compute/v2.1/os-security-groups/b0678fcc-2ce2-40ed-a488-ecee6ba65afe HTTP/1.1 Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdQeB_St8oVZOGIJlshgL7-LKQgW_hEcgkwBL7Ks3Cs3DIyiB0pghA7n_e8cKany7LxH4x-CEsUJ-uItmueA0KgQDZXCqg5MHQPsBAlpzbn8cQVEq-NvT-3VnV52LMp-twxBeBnfcoXgkz5UUTyaCNLN3Bidx2JUEEuK5lVXSh3eLx8 Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 09d179276dbf4e4d9cb780b18e7a22c7 Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-SecurityGroupsTestJSON-78265462 Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-SecurityGroupsTestJSON-78265462 Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 09d179276dbf4e4d9cb780b18e7a22c7 Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-78265462 Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-SecurityGroupsTestJSON-78265462-project Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 88ac5422c8f048148aac2c9b62e0482e Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-SecurityGroupsTestJSON-78265462-project Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: method: Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: exception: Security Group b0678fcc-2ce2-40ed-a488-ecee6ba65afe in use. Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: Neutron server returns request_ids: ['req-1123f49e-e0d3-4ad6-8a80-f023fae3cefc'] Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'b0678fcc-2ce2-40ed-a488-ecee6ba65afe'} Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 30 01:33:14.839548 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group b0678fcc-2ce2-40ed-a488-ecee6ba65afe in use. Oct 30 01:33:14.843065 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1123f49e-e0d3-4ad6-8a80-f023fae3cefc'] Oct 30 01:33:14.843065 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:14.843065 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:14.843065 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:14.843065 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:14.843065 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 30 01:33:14.843065 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 30 01:33:14.843065 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 30 01:33:14.843065 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 30 01:33:14.843065 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group b0678fcc-2ce2-40ed-a488-ecee6ba65afe in use. Oct 30 01:33:14.843065 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1123f49e-e0d3-4ad6-8a80-f023fae3cefc'] Oct 30 01:33:14.843065 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:14.843065 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:14.843065 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:14.843065 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:14.843065 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:14.843065 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:14.843065 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:33:14.843065 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:33:14.843065 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:33:14.843065 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:33:14.843065 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:33:14.843065 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:33:14.843065 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 30 01:33:14.843065 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 30 01:33:14.843065 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group b0678fcc-2ce2-40ed-a488-ecee6ba65afe in use. Oct 30 01:33:14.843065 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1123f49e-e0d3-4ad6-8a80-f023fae3cefc'] Oct 30 01:33:14.843065 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:14.843065 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:14.843065 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:14.843065 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:14.843065 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:14.843065 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:14.843065 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:33:14.843065 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:33:14.843065 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group b0678fcc-2ce2-40ed-a488-ecee6ba65afe in use. Oct 30 01:33:14.843065 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1123f49e-e0d3-4ad6-8a80-f023fae3cefc'] Oct 30 01:33:14.843065 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:14.850802 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0263d408-274e-426a-a798-5085a582203f tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:14.850802 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0263d408-274e-426a-a798-5085a582203f tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: b36a2df7-45c9-4a51-88f1-e1a1b9c0969d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:14.859806 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0263d408-274e-426a-a798-5085a582203f tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:14.860130 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0263d408-274e-426a-a798-5085a582203f tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:14.860569 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0263d408-274e-426a-a798-5085a582203f tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:14.861283 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0263d408-274e-426a-a798-5085a582203f tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:14.861765 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0263d408-274e-426a-a798-5085a582203f tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:14.862194 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0263d408-274e-426a-a798-5085a582203f tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:14.864640 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a1e8be8f-ff8e-4e5a-a8e7-1d7319657faa tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Returning 400 to user: Security Group b0678fcc-2ce2-40ed-a488-ecee6ba65afe in use. Oct 30 01:33:14.864640 n-d-master-1 devstack@n-api.service[121103]: Neutron server returns request_ids: ['req-1123f49e-e0d3-4ad6-8a80-f023fae3cefc'] {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:33:14.866128 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a1e8be8f-ff8e-4e5a-a8e7-1d7319657faa tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/b0678fcc-2ce2-40ed-a488-ecee6ba65afe" status: 400 len: 185 microversion: 2.1 time: 0.426417 Oct 30 01:33:14.877150 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2253/4518] 10.222.0.13 () {58 vars in 1272 bytes} [Sun Oct 30 01:33:14 2022] DELETE /compute/v2.1/os-security-groups/b0678fcc-2ce2-40ed-a488-ecee6ba65afe => generated 185 bytes in 438 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:33:14.895698 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c667cf19-d532-4be3-b795-31e4b2d2561e tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:33:14.918187 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c667cf19-d532-4be3-b795-31e4b2d2561e tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] [instance: 76d6b110-febc-4f28-8367-a0c9ef077177] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:14.942763 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c667cf19-d532-4be3-b795-31e4b2d2561e tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:14.943663 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c667cf19-d532-4be3-b795-31e4b2d2561e tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:14.944324 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c667cf19-d532-4be3-b795-31e4b2d2561e tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:14.945271 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c667cf19-d532-4be3-b795-31e4b2d2561e tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:14.946096 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c667cf19-d532-4be3-b795-31e4b2d2561e tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:14.946771 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c667cf19-d532-4be3-b795-31e4b2d2561e tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:14.966258 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0263d408-274e-426a-a798-5085a582203f tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:14.966768 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0263d408-274e-426a-a798-5085a582203f tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:14.967202 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0263d408-274e-426a-a798-5085a582203f tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:14.967658 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-0263d408-274e-426a-a798-5085a582203f tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lazy-loading 'fault' on Instance uuid b36a2df7-45c9-4a51-88f1-e1a1b9c0969d {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:33:15.059886 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0263d408-274e-426a-a798-5085a582203f tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4603acbc846dcb2f523091cd78ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25b290c8004e1f8f89e17b448f242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:15.070514 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0263d408-274e-426a-a798-5085a582203f tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers/b36a2df7-45c9-4a51-88f1-e1a1b9c0969d" status: 200 len: 1311 microversion: 2.1 time: 0.231760 Oct 30 01:33:15.071143 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2266/4519] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:14 2022] GET /compute/v2.1/servers/b36a2df7-45c9-4a51-88f1-e1a1b9c0969d => generated 1311 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:15.196799 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c667cf19-d532-4be3-b795-31e4b2d2561e tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "POST /compute/v2.1/servers/76d6b110-febc-4f28-8367-a0c9ef077177/action" status: 202 len: 0 microversion: 2.1 time: 0.313937 Oct 30 01:33:15.198135 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2254/4520] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:33:14 2022] POST /compute/v2.1/servers/76d6b110-febc-4f28-8367-a0c9ef077177/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:33:15.206568 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-dce3955b-e6ef-4a4f-9709-baced3ef41cf tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:15.207188 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-dce3955b-e6ef-4a4f-9709-baced3ef41cf tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] [instance: 76d6b110-febc-4f28-8367-a0c9ef077177] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:15.220599 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dce3955b-e6ef-4a4f-9709-baced3ef41cf tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:15.221488 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dce3955b-e6ef-4a4f-9709-baced3ef41cf tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:15.222702 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dce3955b-e6ef-4a4f-9709-baced3ef41cf tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:15.223985 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dce3955b-e6ef-4a4f-9709-baced3ef41cf tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:15.224718 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dce3955b-e6ef-4a4f-9709-baced3ef41cf tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:15.225630 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dce3955b-e6ef-4a4f-9709-baced3ef41cf tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:15.446234 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-dce3955b-e6ef-4a4f-9709-baced3ef41cf tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ac5422c8f048148aac2c9b62e0482e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d179276dbf4e4d9cb780b18e7a22c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:15.464428 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-dce3955b-e6ef-4a4f-9709-baced3ef41cf tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "GET /compute/v2.1/servers/76d6b110-febc-4f28-8367-a0c9ef077177" status: 200 len: 1575 microversion: 2.1 time: 0.258134 Oct 30 01:33:15.465478 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5f68db37-1f22-4e18-8a52-88e226d6bd25 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:15.465728 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2267/4521] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:15 2022] GET /compute/v2.1/servers/76d6b110-febc-4f28-8367-a0c9ef077177 => generated 1575 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:15.466595 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5f68db37-1f22-4e18-8a52-88e226d6bd25 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] [instance: 28af596f-f044-4281-8106-4585fbde9a4a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:15.473790 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f68db37-1f22-4e18-8a52-88e226d6bd25 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:15.474639 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f68db37-1f22-4e18-8a52-88e226d6bd25 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:15.475324 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f68db37-1f22-4e18-8a52-88e226d6bd25 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:15.476254 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f68db37-1f22-4e18-8a52-88e226d6bd25 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:15.476919 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f68db37-1f22-4e18-8a52-88e226d6bd25 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:15.478126 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f68db37-1f22-4e18-8a52-88e226d6bd25 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:15.495936 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-5f68db37-1f22-4e18-8a52-88e226d6bd25 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] HTTP exception thrown: Instance 28af596f-f044-4281-8106-4585fbde9a4a could not be found. Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5f68db37-1f22-4e18-8a52-88e226d6bd25 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Request method failure captured: Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a HTTP/1.1 Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdMpBfA6mq8oavinMeTyaurexihmj6JmnnP2ZZndb1MXJnyLYJP1lh9IAGUFmytWgjEkCc6rHAh1wpEFldWPgYBauossNbR0UQldGfx9XACde0J5etDs6i2phO_G-HCGpqKWqFyqD3FJkTb44yZ7CHZV6U0ZtcSE1Hf7lvcXbJ_Lvp0 Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 470e235fb35840828d9a86028b72f5de Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-909936776 Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/470e235fb35840828d9a86028b72f5de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_470e235fb35840828d9a86028b72f5de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/470e235fb35840828d9a86028b72f5de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/470e235fb35840828d9a86028b72f5de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServerRescueNegativeTestJSON-909936776 Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 470e235fb35840828d9a86028b72f5de Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-909936776 Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServerRescueNegativeTestJSON-909936776-project Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 6134c05549f14bc19962acea9c913f53 Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServerRescueNegativeTestJSON-909936776-project Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 28af596f-f044-4281-8106-4585fbde9a4a could not be found. Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '28af596f-f044-4281-8106-4585fbde9a4a'} Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28af596f-f044-4281-8106-4585fbde9a4a could not be found. Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28af596f-f044-4281-8106-4585fbde9a4a could not be found. Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:15.498073 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:15.507879 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:15.507879 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:15.507879 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:15.507879 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:15.507879 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:33:15.507879 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:33:15.507879 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28af596f-f044-4281-8106-4585fbde9a4a could not be found. Oct 30 01:33:15.507879 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:15.507879 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5f68db37-1f22-4e18-8a52-88e226d6bd25 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] Returning 404 to user: Instance 28af596f-f044-4281-8106-4585fbde9a4a could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:33:15.507879 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5f68db37-1f22-4e18-8a52-88e226d6bd25 tempest-ServerRescueNegativeTestJSON-909936776 tempest-ServerRescueNegativeTestJSON-909936776-project] 10.222.0.13 "GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a" status: 404 len: 111 microversion: 2.1 time: 0.041133 Oct 30 01:33:15.510775 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2255/4522] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:15 2022] GET /compute/v2.1/servers/28af596f-f044-4281-8106-4585fbde9a4a => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:33:15.859382 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5499f958-a385-4595-86e6-26d85fe12f83 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:15.860164 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5499f958-a385-4595-86e6-26d85fe12f83 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:15.871100 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5499f958-a385-4595-86e6-26d85fe12f83 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:15.871601 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5499f958-a385-4595-86e6-26d85fe12f83 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:15.873263 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5499f958-a385-4595-86e6-26d85fe12f83 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:15.876546 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5499f958-a385-4595-86e6-26d85fe12f83 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:15.877381 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5499f958-a385-4595-86e6-26d85fe12f83 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:15.877803 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5499f958-a385-4595-86e6-26d85fe12f83 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:16.095674 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-32566c6b-9f66-4979-8116-159867b9f173 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:16.096990 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-32566c6b-9f66-4979-8116-159867b9f173 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] [instance: b36a2df7-45c9-4a51-88f1-e1a1b9c0969d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:16.105662 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-32566c6b-9f66-4979-8116-159867b9f173 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:16.106736 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-32566c6b-9f66-4979-8116-159867b9f173 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:16.107544 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-32566c6b-9f66-4979-8116-159867b9f173 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:16.108848 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-32566c6b-9f66-4979-8116-159867b9f173 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:16.109570 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-32566c6b-9f66-4979-8116-159867b9f173 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:16.110880 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-32566c6b-9f66-4979-8116-159867b9f173 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:16.134775 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-32566c6b-9f66-4979-8116-159867b9f173 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] HTTP exception thrown: Instance b36a2df7-45c9-4a51-88f1-e1a1b9c0969d could not be found. Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-32566c6b-9f66-4979-8116-159867b9f173 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Request method failure captured: Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/b36a2df7-45c9-4a51-88f1-e1a1b9c0969d HTTP/1.1 Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdQDYci6teSCD8FW03WnqGGSAYCFc3LwP63Rw8Z0U3xVdCko3fGaoma0FdHMlHYZHY323ocvivJeSjvJElJAt33CZMiA61iE55fdR-I2KewZoQUxzJABDW30I3YnxeC3KFzcn39azj6Ca-ZFZp-_EtsqYWNeIpBYa4VulNkXEM1b8xY Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 8b25b290c8004e1f8f89e17b448f242a Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ListServerFiltersTestJSON-1179388771 Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8b25b290c8004e1f8f89e17b448f242a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8b25b290c8004e1f8f89e17b448f242a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8b25b290c8004e1f8f89e17b448f242a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8b25b290c8004e1f8f89e17b448f242a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ListServerFiltersTestJSON-1179388771 Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 8b25b290c8004e1f8f89e17b448f242a Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1179388771 Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ListServerFiltersTestJSON-1179388771-project Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: b0d4603acbc846dcb2f523091cd78ae4 Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ListServerFiltersTestJSON-1179388771-project Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: exception: Instance b36a2df7-45c9-4a51-88f1-e1a1b9c0969d could not be found. Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'b36a2df7-45c9-4a51-88f1-e1a1b9c0969d'} Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b36a2df7-45c9-4a51-88f1-e1a1b9c0969d could not be found. Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b36a2df7-45c9-4a51-88f1-e1a1b9c0969d could not be found. Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:16.136979 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:16.141171 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:16.141171 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:16.141171 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:16.141171 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:33:16.141171 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:33:16.141171 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b36a2df7-45c9-4a51-88f1-e1a1b9c0969d could not be found. Oct 30 01:33:16.141171 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:16.144528 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-32566c6b-9f66-4979-8116-159867b9f173 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] Returning 404 to user: Instance b36a2df7-45c9-4a51-88f1-e1a1b9c0969d could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:33:16.146082 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-32566c6b-9f66-4979-8116-159867b9f173 tempest-ListServerFiltersTestJSON-1179388771 tempest-ListServerFiltersTestJSON-1179388771-project] 10.222.0.13 "GET /compute/v2.1/servers/b36a2df7-45c9-4a51-88f1-e1a1b9c0969d" status: 404 len: 111 microversion: 2.1 time: 0.054681 Oct 30 01:33:16.151624 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2256/4523] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:16 2022] GET /compute/v2.1/servers/b36a2df7-45c9-4a51-88f1-e1a1b9c0969d => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:33:16.290299 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-6beaba4d-c85c-4514-bd08-3284d50a8b81 req-08fa74a0-b858-4654-87dc-9f8168a2a834 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b36a2df7-45c9-4a51-88f1-e1a1b9c0969d", "name": "network-vif-deleted", "tag": "2d246f01-5e64-4b29-8a36-b25ca8039340"}, {"name": "network-changed", "server_uuid": "76d6b110-febc-4f28-8367-a0c9ef077177", "tag": "4e68cc61-1f92-4323-863f-24fb89d25061"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:33:16.317560 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-6beaba4d-c85c-4514-bd08-3284d50a8b81 req-08fa74a0-b858-4654-87dc-9f8168a2a834 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:16.318461 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-6beaba4d-c85c-4514-bd08-3284d50a8b81 req-08fa74a0-b858-4654-87dc-9f8168a2a834 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:16.321248 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-6beaba4d-c85c-4514-bd08-3284d50a8b81 req-08fa74a0-b858-4654-87dc-9f8168a2a834 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:16.363120 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-6beaba4d-c85c-4514-bd08-3284d50a8b81 req-08fa74a0-b858-4654-87dc-9f8168a2a834 service nova] Creating event network-vif-deleted:2d246f01-5e64-4b29-8a36-b25ca8039340 for instance b36a2df7-45c9-4a51-88f1-e1a1b9c0969d on n-h1-master-1 Oct 30 01:33:16.363120 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-6beaba4d-c85c-4514-bd08-3284d50a8b81 req-08fa74a0-b858-4654-87dc-9f8168a2a834 service nova] Creating event network-changed:4e68cc61-1f92-4323-863f-24fb89d25061 for instance 76d6b110-febc-4f28-8367-a0c9ef077177 on n-h1-master-1 Oct 30 01:33:16.367023 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5499f958-a385-4595-86e6-26d85fe12f83 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:16.374443 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-6beaba4d-c85c-4514-bd08-3284d50a8b81 req-08fa74a0-b858-4654-87dc-9f8168a2a834 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.089145 Oct 30 01:33:16.375249 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:16.375649 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2257/4524] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:33:16.381363 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5499f958-a385-4595-86e6-26d85fe12f83 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1509 microversion: 2.1 time: 0.526786 Oct 30 01:33:16.382576 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2268/4525] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:15 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1509 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:16.491494 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-284e096f-b1d2-406e-8656-31c502514353 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:16.492565 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-284e096f-b1d2-406e-8656-31c502514353 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] [instance: 76d6b110-febc-4f28-8367-a0c9ef077177] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:16.504392 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-284e096f-b1d2-406e-8656-31c502514353 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:16.506564 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-284e096f-b1d2-406e-8656-31c502514353 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:16.507220 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-284e096f-b1d2-406e-8656-31c502514353 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:16.508469 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-284e096f-b1d2-406e-8656-31c502514353 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:16.509165 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-284e096f-b1d2-406e-8656-31c502514353 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:16.509969 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-284e096f-b1d2-406e-8656-31c502514353 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:17.207203 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-284e096f-b1d2-406e-8656-31c502514353 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ac5422c8f048148aac2c9b62e0482e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d179276dbf4e4d9cb780b18e7a22c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:17.227365 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-284e096f-b1d2-406e-8656-31c502514353 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "GET /compute/v2.1/servers/76d6b110-febc-4f28-8367-a0c9ef077177" status: 200 len: 1575 microversion: 2.1 time: 0.740552 Oct 30 01:33:17.228798 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2258/4526] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:16 2022] GET /compute/v2.1/servers/76d6b110-febc-4f28-8367-a0c9ef077177 => generated 1575 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:17.408335 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f127a29b-84ad-470a-8c5a-8e8a9510e898 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:17.409912 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f127a29b-84ad-470a-8c5a-8e8a9510e898 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:17.425640 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f127a29b-84ad-470a-8c5a-8e8a9510e898 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:17.428294 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f127a29b-84ad-470a-8c5a-8e8a9510e898 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:17.448963 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f127a29b-84ad-470a-8c5a-8e8a9510e898 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:17.450431 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f127a29b-84ad-470a-8c5a-8e8a9510e898 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:17.456872 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f127a29b-84ad-470a-8c5a-8e8a9510e898 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:17.458869 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f127a29b-84ad-470a-8c5a-8e8a9510e898 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:17.886599 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f127a29b-84ad-470a-8c5a-8e8a9510e898 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:17.908606 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f127a29b-84ad-470a-8c5a-8e8a9510e898 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1509 microversion: 2.1 time: 0.501802 Oct 30 01:33:17.909213 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2269/4527] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:17 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1509 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:18.250356 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4e4ff463-51b6-4cfc-9be2-55d6cd66b491 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:18.250970 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4e4ff463-51b6-4cfc-9be2-55d6cd66b491 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] [instance: 76d6b110-febc-4f28-8367-a0c9ef077177] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:18.260626 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4e4ff463-51b6-4cfc-9be2-55d6cd66b491 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:18.261506 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4e4ff463-51b6-4cfc-9be2-55d6cd66b491 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:18.266913 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4e4ff463-51b6-4cfc-9be2-55d6cd66b491 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:18.267524 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4e4ff463-51b6-4cfc-9be2-55d6cd66b491 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:18.268206 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4e4ff463-51b6-4cfc-9be2-55d6cd66b491 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:18.268845 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4e4ff463-51b6-4cfc-9be2-55d6cd66b491 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:18.689630 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4e4ff463-51b6-4cfc-9be2-55d6cd66b491 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ac5422c8f048148aac2c9b62e0482e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d179276dbf4e4d9cb780b18e7a22c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:18.718718 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4e4ff463-51b6-4cfc-9be2-55d6cd66b491 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "GET /compute/v2.1/servers/76d6b110-febc-4f28-8367-a0c9ef077177" status: 200 len: 1573 microversion: 2.1 time: 0.472465 Oct 30 01:33:18.752682 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d3ff15ca-47d4-408c-ae67-94762a57a1e2 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1124040104"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:33:18.754017 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d3ff15ca-47d4-408c-ae67-94762a57a1e2 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] [instance: 76d6b110-febc-4f28-8367-a0c9ef077177] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:18.761606 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2259/4528] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:18 2022] GET /compute/v2.1/servers/76d6b110-febc-4f28-8367-a0c9ef077177 => generated 1573 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:18.771031 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3ff15ca-47d4-408c-ae67-94762a57a1e2 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:18.773531 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3ff15ca-47d4-408c-ae67-94762a57a1e2 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:18.775321 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3ff15ca-47d4-408c-ae67-94762a57a1e2 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:18.776509 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3ff15ca-47d4-408c-ae67-94762a57a1e2 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:18.778112 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3ff15ca-47d4-408c-ae67-94762a57a1e2 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:18.778606 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3ff15ca-47d4-408c-ae67-94762a57a1e2 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:18.939396 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-35d5bd31-c6ce-45dc-8147-3c4d0137e5f2 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:18.940031 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-35d5bd31-c6ce-45dc-8147-3c4d0137e5f2 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:18.950947 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-35d5bd31-c6ce-45dc-8147-3c4d0137e5f2 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:18.957943 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-35d5bd31-c6ce-45dc-8147-3c4d0137e5f2 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:18.959683 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-35d5bd31-c6ce-45dc-8147-3c4d0137e5f2 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:18.960640 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-35d5bd31-c6ce-45dc-8147-3c4d0137e5f2 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:18.969767 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-35d5bd31-c6ce-45dc-8147-3c4d0137e5f2 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:18.970260 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-35d5bd31-c6ce-45dc-8147-3c4d0137e5f2 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:19.310675 n-d-master-1 devstack@n-api.service[121102]: INFO nova.network.security_group_api [None req-d3ff15ca-47d4-408c-ae67-94762a57a1e2 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Adding security group 02a0a013-3324-4119-b6ba-fc4d0543e64a to port 4e68cc61-1f92-4323-863f-24fb89d25061 Oct 30 01:33:19.855177 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-35d5bd31-c6ce-45dc-8147-3c4d0137e5f2 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:19.872104 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-35d5bd31-c6ce-45dc-8147-3c4d0137e5f2 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1509 microversion: 2.1 time: 0.940391 Oct 30 01:33:19.875956 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2260/4529] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:18 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1509 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:33:20.313542 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d3ff15ca-47d4-408c-ae67-94762a57a1e2 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "POST /compute/v2.1/servers/76d6b110-febc-4f28-8367-a0c9ef077177/action" status: 202 len: 0 microversion: 2.1 time: 1.566709 Oct 30 01:33:20.314446 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2270/4530] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:33:18 2022] POST /compute/v2.1/servers/76d6b110-febc-4f28-8367-a0c9ef077177/action => generated 0 bytes in 1568 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 30 01:33:20.323353 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-32467e2b-6717-45c8-a5ec-d005078f55ac tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '.version_select at 0x7f44cc3549d0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:20.328733 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-b799a287-fc66-47ab-8734-37de36b750ec req-a4c1ba66-a50e-4f15-8ae0-b4a54b3a6bbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76d6b110-febc-4f28-8367-a0c9ef077177", "tag": "4e68cc61-1f92-4323-863f-24fb89d25061"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:33:20.377138 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-b799a287-fc66-47ab-8734-37de36b750ec req-a4c1ba66-a50e-4f15-8ae0-b4a54b3a6bbc service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:20.377803 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-b799a287-fc66-47ab-8734-37de36b750ec req-a4c1ba66-a50e-4f15-8ae0-b4a54b3a6bbc service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:20.380558 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-b799a287-fc66-47ab-8734-37de36b750ec req-a4c1ba66-a50e-4f15-8ae0-b4a54b3a6bbc service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:20.429289 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-b799a287-fc66-47ab-8734-37de36b750ec req-a4c1ba66-a50e-4f15-8ae0-b4a54b3a6bbc service nova] Creating event network-changed:4e68cc61-1f92-4323-863f-24fb89d25061 for instance 76d6b110-febc-4f28-8367-a0c9ef077177 on n-h1-master-1 Oct 30 01:33:20.443762 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-b799a287-fc66-47ab-8734-37de36b750ec req-a4c1ba66-a50e-4f15-8ae0-b4a54b3a6bbc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120490 Oct 30 01:33:20.450969 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2271/4531] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:33:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:33:20.725594 n-d-master-1 devstack@n-api.service[121103]: DEBUG neutronclient.v2_0.client [None req-32467e2b-6717-45c8-a5ec-d005078f55ac tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 02a0a013-3324-4119-b6ba-fc4d0543e64a in use.", "detail": ""}} {{(pid=121103) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 30 01:33:20.726569 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-32467e2b-6717-45c8-a5ec-d005078f55ac tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] HTTP exception thrown: Security Group 02a0a013-3324-4119-b6ba-fc4d0543e64a in use. Oct 30 01:33:20.726569 n-d-master-1 devstack@n-api.service[121103]: Neutron server returns request_ids: ['req-48e1faba-d569-49c1-9eab-ba82409aa2cb'] Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-32467e2b-6717-45c8-a5ec-d005078f55ac tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Request method failure captured: Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: request: DELETE /compute/v2.1/os-security-groups/02a0a013-3324-4119-b6ba-fc4d0543e64a HTTP/1.1 Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdQeB_St8oVZOGIJlshgL7-LKQgW_hEcgkwBL7Ks3Cs3DIyiB0pghA7n_e8cKany7LxH4x-CEsUJ-uItmueA0KgQDZXCqg5MHQPsBAlpzbn8cQVEq-NvT-3VnV52LMp-twxBeBnfcoXgkz5UUTyaCNLN3Bidx2JUEEuK5lVXSh3eLx8 Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 09d179276dbf4e4d9cb780b18e7a22c7 Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-SecurityGroupsTestJSON-78265462 Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-SecurityGroupsTestJSON-78265462 Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 09d179276dbf4e4d9cb780b18e7a22c7 Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-78265462 Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-SecurityGroupsTestJSON-78265462-project Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 88ac5422c8f048148aac2c9b62e0482e Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-SecurityGroupsTestJSON-78265462-project Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: method: Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: exception: Security Group 02a0a013-3324-4119-b6ba-fc4d0543e64a in use. Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: Neutron server returns request_ids: ['req-48e1faba-d569-49c1-9eab-ba82409aa2cb'] Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '02a0a013-3324-4119-b6ba-fc4d0543e64a'} Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 30 01:33:20.730481 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 02a0a013-3324-4119-b6ba-fc4d0543e64a in use. Oct 30 01:33:20.734014 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-48e1faba-d569-49c1-9eab-ba82409aa2cb'] Oct 30 01:33:20.734014 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:20.734014 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:20.734014 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:20.734014 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:20.734014 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 30 01:33:20.734014 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 30 01:33:20.734014 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 30 01:33:20.734014 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 30 01:33:20.734014 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 02a0a013-3324-4119-b6ba-fc4d0543e64a in use. Oct 30 01:33:20.734014 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-48e1faba-d569-49c1-9eab-ba82409aa2cb'] Oct 30 01:33:20.734014 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:20.734014 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:20.734014 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:20.734014 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:20.734014 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:20.734014 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:20.734014 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:33:20.734014 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:33:20.734014 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:33:20.734014 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:33:20.734014 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:33:20.734014 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:33:20.734014 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 30 01:33:20.734014 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 30 01:33:20.734014 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 02a0a013-3324-4119-b6ba-fc4d0543e64a in use. Oct 30 01:33:20.734014 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-48e1faba-d569-49c1-9eab-ba82409aa2cb'] Oct 30 01:33:20.734014 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:20.734014 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:20.734014 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:20.734014 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:20.734014 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:20.734014 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:20.734014 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:33:20.734014 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:33:20.734014 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 02a0a013-3324-4119-b6ba-fc4d0543e64a in use. Oct 30 01:33:20.734014 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-48e1faba-d569-49c1-9eab-ba82409aa2cb'] Oct 30 01:33:20.734014 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:20.739921 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-32467e2b-6717-45c8-a5ec-d005078f55ac tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Returning 400 to user: Security Group 02a0a013-3324-4119-b6ba-fc4d0543e64a in use. Oct 30 01:33:20.739921 n-d-master-1 devstack@n-api.service[121103]: Neutron server returns request_ids: ['req-48e1faba-d569-49c1-9eab-ba82409aa2cb'] {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:33:20.741610 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-32467e2b-6717-45c8-a5ec-d005078f55ac tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/02a0a013-3324-4119-b6ba-fc4d0543e64a" status: 400 len: 185 microversion: 2.1 time: 0.422990 Oct 30 01:33:20.742736 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2261/4532] 10.222.0.13 () {58 vars in 1272 bytes} [Sun Oct 30 01:33:20 2022] DELETE /compute/v2.1/os-security-groups/02a0a013-3324-4119-b6ba-fc4d0543e64a => generated 185 bytes in 425 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:33:20.752256 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b7f19497-6a35-4fd1-b416-4da8978ebb81 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:20.752915 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b7f19497-6a35-4fd1-b416-4da8978ebb81 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] [instance: 76d6b110-febc-4f28-8367-a0c9ef077177] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:20.779807 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b7f19497-6a35-4fd1-b416-4da8978ebb81 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:20.781818 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b7f19497-6a35-4fd1-b416-4da8978ebb81 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:20.783774 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b7f19497-6a35-4fd1-b416-4da8978ebb81 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:20.785868 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b7f19497-6a35-4fd1-b416-4da8978ebb81 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:20.786603 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b7f19497-6a35-4fd1-b416-4da8978ebb81 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:20.788244 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b7f19497-6a35-4fd1-b416-4da8978ebb81 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:20.884410 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b7f19497-6a35-4fd1-b416-4da8978ebb81 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] [instance: 76d6b110-febc-4f28-8367-a0c9ef077177] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:33:20.900567 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0cd5c486-d85d-423e-b9fa-b07f6d362583 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:20.901736 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0cd5c486-d85d-423e-b9fa-b07f6d362583 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:20.926340 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0cd5c486-d85d-423e-b9fa-b07f6d362583 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:20.929063 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0cd5c486-d85d-423e-b9fa-b07f6d362583 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:20.929770 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0cd5c486-d85d-423e-b9fa-b07f6d362583 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:20.931191 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0cd5c486-d85d-423e-b9fa-b07f6d362583 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:20.932868 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0cd5c486-d85d-423e-b9fa-b07f6d362583 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:20.939832 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0cd5c486-d85d-423e-b9fa-b07f6d362583 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:21.261291 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:21.319336 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b7f19497-6a35-4fd1-b416-4da8978ebb81 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "DELETE /compute/v2.1/servers/76d6b110-febc-4f28-8367-a0c9ef077177" status: 204 len: 0 microversion: 2.1 time: 0.571568 Oct 30 01:33:21.321219 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2272/4533] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:33:20 2022] DELETE /compute/v2.1/servers/76d6b110-febc-4f28-8367-a0c9ef077177 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:33:21.331746 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f05b0656-0d49-4bc9-ad16-292a97b751ec tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:21.333008 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f05b0656-0d49-4bc9-ad16-292a97b751ec tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] [instance: 76d6b110-febc-4f28-8367-a0c9ef077177] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:21.352876 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f05b0656-0d49-4bc9-ad16-292a97b751ec tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:21.356972 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f05b0656-0d49-4bc9-ad16-292a97b751ec tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:21.360045 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f05b0656-0d49-4bc9-ad16-292a97b751ec tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:21.362813 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f05b0656-0d49-4bc9-ad16-292a97b751ec tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:21.364143 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f05b0656-0d49-4bc9-ad16-292a97b751ec tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:21.366823 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f05b0656-0d49-4bc9-ad16-292a97b751ec tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:21.436710 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0cd5c486-d85d-423e-b9fa-b07f6d362583 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:21.447455 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0cd5c486-d85d-423e-b9fa-b07f6d362583 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1509 microversion: 2.1 time: 0.551154 Oct 30 01:33:21.450291 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2262/4534] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:20 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1509 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:21.824320 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f05b0656-0d49-4bc9-ad16-292a97b751ec tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ac5422c8f048148aac2c9b62e0482e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d179276dbf4e4d9cb780b18e7a22c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:21.838796 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f05b0656-0d49-4bc9-ad16-292a97b751ec tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "GET /compute/v2.1/servers/76d6b110-febc-4f28-8367-a0c9ef077177" status: 200 len: 1648 microversion: 2.1 time: 0.512943 Oct 30 01:33:21.840197 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2273/4535] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:21 2022] GET /compute/v2.1/servers/76d6b110-febc-4f28-8367-a0c9ef077177 => generated 1648 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:33:22.479247 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-50a5e6cd-a61d-4a57-84c7-0a49d166b23d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:22.480811 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-50a5e6cd-a61d-4a57-84c7-0a49d166b23d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:22.506703 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-50a5e6cd-a61d-4a57-84c7-0a49d166b23d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:22.510115 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-50a5e6cd-a61d-4a57-84c7-0a49d166b23d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:22.510823 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-50a5e6cd-a61d-4a57-84c7-0a49d166b23d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:22.513959 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-50a5e6cd-a61d-4a57-84c7-0a49d166b23d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:22.515424 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-50a5e6cd-a61d-4a57-84c7-0a49d166b23d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:22.517898 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-50a5e6cd-a61d-4a57-84c7-0a49d166b23d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:22.872328 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-88c06467-ca62-41b5-a6bb-4075b95f03c9 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:22.873104 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-88c06467-ca62-41b5-a6bb-4075b95f03c9 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] [instance: 76d6b110-febc-4f28-8367-a0c9ef077177] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:22.887126 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-88c06467-ca62-41b5-a6bb-4075b95f03c9 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:22.887705 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-88c06467-ca62-41b5-a6bb-4075b95f03c9 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:22.888149 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-88c06467-ca62-41b5-a6bb-4075b95f03c9 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:22.888855 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-88c06467-ca62-41b5-a6bb-4075b95f03c9 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:22.889307 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-88c06467-ca62-41b5-a6bb-4075b95f03c9 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:22.895162 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-88c06467-ca62-41b5-a6bb-4075b95f03c9 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:22.955854 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-50a5e6cd-a61d-4a57-84c7-0a49d166b23d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:22.962071 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:22.970996 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-50a5e6cd-a61d-4a57-84c7-0a49d166b23d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1509 microversion: 2.1 time: 0.497862 Oct 30 01:33:22.972157 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2263/4536] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:22 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1509 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:23.512934 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-88c06467-ca62-41b5-a6bb-4075b95f03c9 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ac5422c8f048148aac2c9b62e0482e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d179276dbf4e4d9cb780b18e7a22c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:23.522742 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-88c06467-ca62-41b5-a6bb-4075b95f03c9 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "GET /compute/v2.1/servers/76d6b110-febc-4f28-8367-a0c9ef077177" status: 200 len: 1648 microversion: 2.1 time: 0.654902 Oct 30 01:33:23.533702 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2274/4537] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:22 2022] GET /compute/v2.1/servers/76d6b110-febc-4f28-8367-a0c9ef077177 => generated 1648 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:33:23.728103 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6ec81bb8-0557-4acd-b529-65606c480f19 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1543490556", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": "none"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:33:23.800083 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-6ec81bb8-0557-4acd-b529-65606c480f19 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:33:23.800849 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-6ec81bb8-0557-4acd-b529-65606c480f19 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:33:23.801638 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-6ec81bb8-0557-4acd-b529-65606c480f19 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:33:23.802419 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-6ec81bb8-0557-4acd-b529-65606c480f19 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:33:23.802938 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-6ec81bb8-0557-4acd-b529-65606c480f19 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:33:23.814562 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ec81bb8-0557-4acd-b529-65606c480f19 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:23.815162 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ec81bb8-0557-4acd-b529-65606c480f19 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:23.815864 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ec81bb8-0557-4acd-b529-65606c480f19 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:23.816952 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ec81bb8-0557-4acd-b529-65606c480f19 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:23.817741 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ec81bb8-0557-4acd-b529-65606c480f19 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:23.818347 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ec81bb8-0557-4acd-b529-65606c480f19 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:23.839745 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-6ec81bb8-0557-4acd-b529-65606c480f19 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Getting quotas for project 3f6da0fbf0024950b2c07a6db43ff3a3. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:33:23.847491 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-6ec81bb8-0557-4acd-b529-65606c480f19 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Getting quotas for user 94cab57fc5184fc6be1cfde72e9bab26 and project 3f6da0fbf0024950b2c07a6db43ff3a3. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:33:23.865711 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6ec81bb8-0557-4acd-b529-65606c480f19 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:33:23.869801 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6ec81bb8-0557-4acd-b529-65606c480f19 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] [instance: 193565f7-ccc8-4f1d-a9b3-d949e09970e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:33:24.019420 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-48235911-a200-48e5-82c0-2a64ace0b27c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:24.020423 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-48235911-a200-48e5-82c0-2a64ace0b27c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:24.038300 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-48235911-a200-48e5-82c0-2a64ace0b27c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:24.057483 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-48235911-a200-48e5-82c0-2a64ace0b27c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:24.065858 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-48235911-a200-48e5-82c0-2a64ace0b27c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:24.072905 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-48235911-a200-48e5-82c0-2a64ace0b27c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:24.073930 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-48235911-a200-48e5-82c0-2a64ace0b27c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:24.075014 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-48235911-a200-48e5-82c0-2a64ace0b27c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:24.148853 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6ec81bb8-0557-4acd-b529-65606c480f19 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.589666 Oct 30 01:33:24.157063 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2264/4538] 10.222.0.13 () {62 vars in 1188 bytes} [Sun Oct 30 01:33:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 30 01:33:24.171576 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-43acdeae-d779-41f5-a016-0bafaff9273f req-2f2ad147-e43f-47e4-a493-088275eef19e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76d6b110-febc-4f28-8367-a0c9ef077177", "name": "network-vif-deleted", "tag": "4e68cc61-1f92-4323-863f-24fb89d25061"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:33:24.197930 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-43acdeae-d779-41f5-a016-0bafaff9273f req-2f2ad147-e43f-47e4-a493-088275eef19e service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:24.198888 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-43acdeae-d779-41f5-a016-0bafaff9273f req-2f2ad147-e43f-47e4-a493-088275eef19e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:24.200218 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-43acdeae-d779-41f5-a016-0bafaff9273f req-2f2ad147-e43f-47e4-a493-088275eef19e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:24.215786 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-43acdeae-d779-41f5-a016-0bafaff9273f req-2f2ad147-e43f-47e4-a493-088275eef19e service nova] Creating event network-vif-deleted:4e68cc61-1f92-4323-863f-24fb89d25061 for instance 76d6b110-febc-4f28-8367-a0c9ef077177 on n-h1-master-1 Oct 30 01:33:24.224482 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-43acdeae-d779-41f5-a016-0bafaff9273f req-2f2ad147-e43f-47e4-a493-088275eef19e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065586 Oct 30 01:33:24.227182 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2265/4539] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:33:24.235672 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0bd82e62-e654-4eee-84f8-3380cef1c966 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:24.236830 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0bd82e62-e654-4eee-84f8-3380cef1c966 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] [instance: 193565f7-ccc8-4f1d-a9b3-d949e09970e8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:25.027695 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0bd82e62-e654-4eee-84f8-3380cef1c966 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:25.041429 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0bd82e62-e654-4eee-84f8-3380cef1c966 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:25.046726 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0bd82e62-e654-4eee-84f8-3380cef1c966 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:25.054041 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0bd82e62-e654-4eee-84f8-3380cef1c966 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] 10.222.0.13 "GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8" status: 200 len: 1278 microversion: 2.54 time: 0.822194 Oct 30 01:33:25.060012 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2266/4540] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:33:24 2022] GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8 => generated 1278 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:33:25.085617 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2a2968d7-1bd9-450d-84ab-3e914b8ad297 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:25.087599 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2a2968d7-1bd9-450d-84ab-3e914b8ad297 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] [instance: 76d6b110-febc-4f28-8367-a0c9ef077177] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:25.111374 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a2968d7-1bd9-450d-84ab-3e914b8ad297 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:25.113307 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a2968d7-1bd9-450d-84ab-3e914b8ad297 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:25.116106 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a2968d7-1bd9-450d-84ab-3e914b8ad297 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:25.116106 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a2968d7-1bd9-450d-84ab-3e914b8ad297 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:25.118029 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a2968d7-1bd9-450d-84ab-3e914b8ad297 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:25.118813 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a2968d7-1bd9-450d-84ab-3e914b8ad297 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:25.174377 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a2968d7-1bd9-450d-84ab-3e914b8ad297 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:25.175220 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a2968d7-1bd9-450d-84ab-3e914b8ad297 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:25.175905 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a2968d7-1bd9-450d-84ab-3e914b8ad297 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:25.177567 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-2a2968d7-1bd9-450d-84ab-3e914b8ad297 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lazy-loading 'fault' on Instance uuid 76d6b110-febc-4f28-8367-a0c9ef077177 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:33:25.311018 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2a2968d7-1bd9-450d-84ab-3e914b8ad297 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ac5422c8f048148aac2c9b62e0482e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d179276dbf4e4d9cb780b18e7a22c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:25.320862 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2a2968d7-1bd9-450d-84ab-3e914b8ad297 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "GET /compute/v2.1/servers/76d6b110-febc-4f28-8367-a0c9ef077177" status: 200 len: 1306 microversion: 2.1 time: 0.259652 Oct 30 01:33:25.334436 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2267/4541] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:25 2022] GET /compute/v2.1/servers/76d6b110-febc-4f28-8367-a0c9ef077177 => generated 1306 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:25.510049 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-48235911-a200-48e5-82c0-2a64ace0b27c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:25.527909 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-48235911-a200-48e5-82c0-2a64ace0b27c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1509 microversion: 2.1 time: 1.521021 Oct 30 01:33:25.529147 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2275/4542] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:24 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1509 bytes in 1523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:26.093481 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bc88b28f-889b-49bb-8660-4e9ed1b0cf3e tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:26.094226 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-bc88b28f-889b-49bb-8660-4e9ed1b0cf3e tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] [instance: 193565f7-ccc8-4f1d-a9b3-d949e09970e8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:26.105413 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bc88b28f-889b-49bb-8660-4e9ed1b0cf3e tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:26.106206 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bc88b28f-889b-49bb-8660-4e9ed1b0cf3e tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:26.106890 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bc88b28f-889b-49bb-8660-4e9ed1b0cf3e tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:26.107765 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bc88b28f-889b-49bb-8660-4e9ed1b0cf3e tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:26.108451 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bc88b28f-889b-49bb-8660-4e9ed1b0cf3e tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:26.109150 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bc88b28f-889b-49bb-8660-4e9ed1b0cf3e tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:26.182399 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-bc88b28f-889b-49bb-8660-4e9ed1b0cf3e tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:26.195642 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-bc88b28f-889b-49bb-8660-4e9ed1b0cf3e tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:26.198681 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-bc88b28f-889b-49bb-8660-4e9ed1b0cf3e tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:26.199953 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bc88b28f-889b-49bb-8660-4e9ed1b0cf3e tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] 10.222.0.13 "GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8" status: 200 len: 1282 microversion: 2.54 time: 0.110826 Oct 30 01:33:26.200624 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2268/4543] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:33:26 2022] GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8 => generated 1282 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:33:26.365031 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-14abfcde-fcc3-4e8e-9ec4-823f6d1576c2 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:26.366047 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-14abfcde-fcc3-4e8e-9ec4-823f6d1576c2 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] [instance: 76d6b110-febc-4f28-8367-a0c9ef077177] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:26.375669 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-14abfcde-fcc3-4e8e-9ec4-823f6d1576c2 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:26.376560 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-14abfcde-fcc3-4e8e-9ec4-823f6d1576c2 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:26.377173 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-14abfcde-fcc3-4e8e-9ec4-823f6d1576c2 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:26.378136 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-14abfcde-fcc3-4e8e-9ec4-823f6d1576c2 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:26.378817 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-14abfcde-fcc3-4e8e-9ec4-823f6d1576c2 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:26.379348 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-14abfcde-fcc3-4e8e-9ec4-823f6d1576c2 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:26.394881 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-14abfcde-fcc3-4e8e-9ec4-823f6d1576c2 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] HTTP exception thrown: Instance 76d6b110-febc-4f28-8367-a0c9ef077177 could not be found. Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-14abfcde-fcc3-4e8e-9ec4-823f6d1576c2 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Request method failure captured: Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/76d6b110-febc-4f28-8367-a0c9ef077177 HTTP/1.1 Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdQeB_St8oVZOGIJlshgL7-LKQgW_hEcgkwBL7Ks3Cs3DIyiB0pghA7n_e8cKany7LxH4x-CEsUJ-uItmueA0KgQDZXCqg5MHQPsBAlpzbn8cQVEq-NvT-3VnV52LMp-twxBeBnfcoXgkz5UUTyaCNLN3Bidx2JUEEuK5lVXSh3eLx8 Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 09d179276dbf4e4d9cb780b18e7a22c7 Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-SecurityGroupsTestJSON-78265462 Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-SecurityGroupsTestJSON-78265462 Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 09d179276dbf4e4d9cb780b18e7a22c7 Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-78265462 Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-SecurityGroupsTestJSON-78265462-project Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 88ac5422c8f048148aac2c9b62e0482e Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-SecurityGroupsTestJSON-78265462-project Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 76d6b110-febc-4f28-8367-a0c9ef077177 could not be found. Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '76d6b110-febc-4f28-8367-a0c9ef077177'} Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76d6b110-febc-4f28-8367-a0c9ef077177 could not be found. Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76d6b110-febc-4f28-8367-a0c9ef077177 could not be found. Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:26.397102 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:26.401774 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:26.401774 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:26.401774 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:26.401774 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:33:26.401774 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:33:26.401774 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76d6b110-febc-4f28-8367-a0c9ef077177 could not be found. Oct 30 01:33:26.401774 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:26.403071 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-14abfcde-fcc3-4e8e-9ec4-823f6d1576c2 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Returning 404 to user: Instance 76d6b110-febc-4f28-8367-a0c9ef077177 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:33:26.404007 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-14abfcde-fcc3-4e8e-9ec4-823f6d1576c2 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "GET /compute/v2.1/servers/76d6b110-febc-4f28-8367-a0c9ef077177" status: 404 len: 111 microversion: 2.1 time: 0.047163 Oct 30 01:33:26.404775 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2276/4544] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:26 2022] GET /compute/v2.1/servers/76d6b110-febc-4f28-8367-a0c9ef077177 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:33:26.414278 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-40b34767-7b61-4291-bdc0-4148f96da4f1 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '.version_select at 0x7f44d0328af0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:26.556086 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a77b532a-4cf8-4508-9fde-e7ac4ff82e12 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:26.556859 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a77b532a-4cf8-4508-9fde-e7ac4ff82e12 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:26.568014 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a77b532a-4cf8-4508-9fde-e7ac4ff82e12 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:26.568633 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a77b532a-4cf8-4508-9fde-e7ac4ff82e12 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:26.569135 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a77b532a-4cf8-4508-9fde-e7ac4ff82e12 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:26.570859 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a77b532a-4cf8-4508-9fde-e7ac4ff82e12 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:26.572017 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a77b532a-4cf8-4508-9fde-e7ac4ff82e12 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:26.572652 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a77b532a-4cf8-4508-9fde-e7ac4ff82e12 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:27.002517 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a77b532a-4cf8-4508-9fde-e7ac4ff82e12 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:27.015382 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a77b532a-4cf8-4508-9fde-e7ac4ff82e12 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1509 microversion: 2.1 time: 0.461871 Oct 30 01:33:27.016089 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2277/4545] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:26 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1509 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:33:27.227376 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f0711f99-0f06-46fb-9bf3-f2141de1d3f4 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:27.228355 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f0711f99-0f06-46fb-9bf3-f2141de1d3f4 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] [instance: 193565f7-ccc8-4f1d-a9b3-d949e09970e8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:27.240511 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f0711f99-0f06-46fb-9bf3-f2141de1d3f4 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:27.241943 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f0711f99-0f06-46fb-9bf3-f2141de1d3f4 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:27.244278 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f0711f99-0f06-46fb-9bf3-f2141de1d3f4 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:27.245323 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f0711f99-0f06-46fb-9bf3-f2141de1d3f4 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:27.246040 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f0711f99-0f06-46fb-9bf3-f2141de1d3f4 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:27.252735 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f0711f99-0f06-46fb-9bf3-f2141de1d3f4 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:27.343342 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-40b34767-7b61-4291-bdc0-4148f96da4f1 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/b0678fcc-2ce2-40ed-a488-ecee6ba65afe" status: 202 len: 0 microversion: 2.1 time: 0.934093 Oct 30 01:33:27.344621 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2269/4546] 10.222.0.13 () {58 vars in 1272 bytes} [Sun Oct 30 01:33:26 2022] DELETE /compute/v2.1/os-security-groups/b0678fcc-2ce2-40ed-a488-ecee6ba65afe => generated 0 bytes in 936 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 30 01:33:27.353106 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f2183621-396e-4226-9731-5a03b2053d9b tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '.version_select at 0x7f44c72e2040>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:27.372318 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f0711f99-0f06-46fb-9bf3-f2141de1d3f4 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:27.405036 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f0711f99-0f06-46fb-9bf3-f2141de1d3f4 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:27.414565 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f0711f99-0f06-46fb-9bf3-f2141de1d3f4 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:27.417897 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f0711f99-0f06-46fb-9bf3-f2141de1d3f4 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] 10.222.0.13 "GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8" status: 200 len: 1330 microversion: 2.54 time: 0.192989 Oct 30 01:33:27.424038 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2278/4547] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:33:27 2022] GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8 => generated 1330 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:33:28.045738 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-20eda324-ba25-4683-8002-35d5046163e7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:28.049279 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-20eda324-ba25-4683-8002-35d5046163e7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:28.061213 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-20eda324-ba25-4683-8002-35d5046163e7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:28.062475 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-20eda324-ba25-4683-8002-35d5046163e7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:28.063695 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-20eda324-ba25-4683-8002-35d5046163e7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:28.066274 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-20eda324-ba25-4683-8002-35d5046163e7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:28.066992 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-20eda324-ba25-4683-8002-35d5046163e7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:28.070499 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-20eda324-ba25-4683-8002-35d5046163e7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:28.436255 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-20eda324-ba25-4683-8002-35d5046163e7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:28.450157 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-20eda324-ba25-4683-8002-35d5046163e7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1509 microversion: 2.1 time: 0.414565 Oct 30 01:33:28.450752 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2279/4548] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:28 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1509 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:28.455738 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-289162bc-bcf8-4dd1-a182-7fe939ace2fa tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:28.466320 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-289162bc-bcf8-4dd1-a182-7fe939ace2fa tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] [instance: 193565f7-ccc8-4f1d-a9b3-d949e09970e8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:28.473862 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-289162bc-bcf8-4dd1-a182-7fe939ace2fa tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:28.476522 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-289162bc-bcf8-4dd1-a182-7fe939ace2fa tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:28.478036 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-289162bc-bcf8-4dd1-a182-7fe939ace2fa tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:28.478910 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-289162bc-bcf8-4dd1-a182-7fe939ace2fa tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:28.480599 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-289162bc-bcf8-4dd1-a182-7fe939ace2fa tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:28.484156 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-289162bc-bcf8-4dd1-a182-7fe939ace2fa tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:28.735897 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-289162bc-bcf8-4dd1-a182-7fe939ace2fa tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:28.740026 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f2183621-396e-4226-9731-5a03b2053d9b tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/02a0a013-3324-4119-b6ba-fc4d0543e64a" status: 202 len: 0 microversion: 2.1 time: 1.389874 Oct 30 01:33:28.741766 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2270/4549] 10.222.0.13 () {58 vars in 1272 bytes} [Sun Oct 30 01:33:27 2022] DELETE /compute/v2.1/os-security-groups/02a0a013-3324-4119-b6ba-fc4d0543e64a => generated 0 bytes in 1393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:33:28.745440 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-289162bc-bcf8-4dd1-a182-7fe939ace2fa tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:28.751781 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-289162bc-bcf8-4dd1-a182-7fe939ace2fa tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:28.770077 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-289162bc-bcf8-4dd1-a182-7fe939ace2fa tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] 10.222.0.13 "GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8" status: 200 len: 1336 microversion: 2.54 time: 0.318002 Oct 30 01:33:28.771505 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2280/4550] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:33:28 2022] GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8 => generated 1336 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:33:28.777808 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fe4374f0-40e5-432a-ba55-302aa3b7d657 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Action: 'create', calling method: .version_select at 0x7f44c76bbdc0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1664227225", "description": "tempest-description-137849896"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:33:28.943478 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a0ac0bf4-5472-46f5-aebb-8a4e6586107e tempest-VolumesGetTestJSON-1342158773 tempest-VolumesGetTestJSON-1342158773-project] Action: 'create', calling method: .version_select at 0x7f44c7c00820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1266118799", "metadata": {"Type": "work"}}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:33:29.526657 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fe4374f0-40e5-432a-ba55-302aa3b7d657 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.753850 Oct 30 01:33:29.528513 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2281/4551] 10.222.0.13 () {60 vars in 1180 bytes} [Sun Oct 30 01:33:28 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:33:29.542502 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1ec9996a-f560-47da-ae94-58b99ba344ac tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:29.543705 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1ec9996a-f560-47da-ae94-58b99ba344ac tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:29.551404 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ec9996a-f560-47da-ae94-58b99ba344ac tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:29.554782 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ec9996a-f560-47da-ae94-58b99ba344ac tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:29.554782 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ec9996a-f560-47da-ae94-58b99ba344ac tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:29.554782 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ec9996a-f560-47da-ae94-58b99ba344ac tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:29.554782 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ec9996a-f560-47da-ae94-58b99ba344ac tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:29.555444 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ec9996a-f560-47da-ae94-58b99ba344ac tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:29.673903 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a0ac0bf4-5472-46f5-aebb-8a4e6586107e tempest-VolumesGetTestJSON-1342158773 tempest-VolumesGetTestJSON-1342158773-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.930707 Oct 30 01:33:29.675482 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2271/4552] 10.222.0.13 () {60 vars in 1156 bytes} [Sun Oct 30 01:33:28 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 933 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 30 01:33:29.682688 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-da9046e5-a459-433f-a690-4a019e9ae9c2 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Action: 'update', calling method: .version_select at 0x7f44c6fb0820>, body: {"security_group": {"name": "tempest-sg-hth-554361566", "description": "tempest-description-hth-130344282"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:33:30.352249 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1ec9996a-f560-47da-ae94-58b99ba344ac tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:30.367852 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1ec9996a-f560-47da-ae94-58b99ba344ac tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1509 microversion: 2.1 time: 0.837037 Oct 30 01:33:30.381585 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2282/4553] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:29 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1509 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:30.411086 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-88e1a50f-cd99-44c7-b97e-3d662fe50c81 tempest-VolumesGetTestJSON-1342158773 tempest-VolumesGetTestJSON-1342158773-project] Calling method '.version_select at 0x7f44c768a8b0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:30.497240 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-88e1a50f-cd99-44c7-b97e-3d662fe50c81 tempest-VolumesGetTestJSON-1342158773 tempest-VolumesGetTestJSON-1342158773-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/57d2a730-d794-45ba-99b1-b630639e7ff4" status: 200 len: 353 microversion: 2.1 time: 0.112932 Oct 30 01:33:30.498028 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2283/4554] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 30 01:33:30 2022] GET /compute/v2.1/os-volumes/57d2a730-d794-45ba-99b1-b630639e7ff4 => generated 353 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:33:30.510532 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-af193dce-7734-42fe-a02e-39738033aae6 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:30.511240 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-af193dce-7734-42fe-a02e-39738033aae6 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] [instance: 193565f7-ccc8-4f1d-a9b3-d949e09970e8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:30.520065 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af193dce-7734-42fe-a02e-39738033aae6 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:30.521428 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af193dce-7734-42fe-a02e-39738033aae6 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:30.522197 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af193dce-7734-42fe-a02e-39738033aae6 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:30.525271 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af193dce-7734-42fe-a02e-39738033aae6 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:30.525985 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af193dce-7734-42fe-a02e-39738033aae6 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:30.526726 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af193dce-7734-42fe-a02e-39738033aae6 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:30.628514 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-da9046e5-a459-433f-a690-4a019e9ae9c2 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "PUT /compute/v2.1/os-security-groups/e1aebc0b-c914-4326-b32d-3601be25b0bf" status: 200 len: 216 microversion: 2.1 time: 0.951604 Oct 30 01:33:30.629457 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2272/4555] 10.222.0.13 () {60 vars in 1290 bytes} [Sun Oct 30 01:33:29 2022] PUT /compute/v2.1/os-security-groups/e1aebc0b-c914-4326-b32d-3601be25b0bf => generated 216 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:33:30.642306 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e177bb02-ae73-480e-8bb5-2c1a8ff05b94 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '.version_select at 0x7f44c6fa9310>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:30.672573 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-af193dce-7734-42fe-a02e-39738033aae6 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:30.684420 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-af193dce-7734-42fe-a02e-39738033aae6 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:30.687148 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-af193dce-7734-42fe-a02e-39738033aae6 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:30.701167 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-af193dce-7734-42fe-a02e-39738033aae6 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] 10.222.0.13 "GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8" status: 200 len: 1336 microversion: 2.54 time: 0.201850 Oct 30 01:33:30.704264 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2284/4556] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:33:30 2022] GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8 => generated 1336 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:33:30.775248 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e177bb02-ae73-480e-8bb5-2c1a8ff05b94 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups/e1aebc0b-c914-4326-b32d-3601be25b0bf" status: 200 len: 216 microversion: 2.1 time: 0.136946 Oct 30 01:33:30.776888 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2273/4557] 10.222.0.13 () {58 vars in 1269 bytes} [Sun Oct 30 01:33:30 2022] GET /compute/v2.1/os-security-groups/e1aebc0b-c914-4326-b32d-3601be25b0bf => generated 216 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:33:30.791788 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-37721ca9-20ca-46d7-961f-6fea01935f75 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '.version_select at 0x7f44ccb24e50>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:31.398811 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b6e47dd6-d760-47a2-ba2d-f8db290392ac tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:31.400198 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b6e47dd6-d760-47a2-ba2d-f8db290392ac tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:31.418222 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b6e47dd6-d760-47a2-ba2d-f8db290392ac tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:31.419365 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b6e47dd6-d760-47a2-ba2d-f8db290392ac tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:31.420365 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b6e47dd6-d760-47a2-ba2d-f8db290392ac tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:31.421966 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b6e47dd6-d760-47a2-ba2d-f8db290392ac tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:31.423998 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b6e47dd6-d760-47a2-ba2d-f8db290392ac tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:31.424699 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b6e47dd6-d760-47a2-ba2d-f8db290392ac tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:31.593760 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-37721ca9-20ca-46d7-961f-6fea01935f75 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/e1aebc0b-c914-4326-b32d-3601be25b0bf" status: 202 len: 0 microversion: 2.1 time: 0.806292 Oct 30 01:33:31.597904 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2285/4558] 10.222.0.13 () {58 vars in 1272 bytes} [Sun Oct 30 01:33:30 2022] DELETE /compute/v2.1/os-security-groups/e1aebc0b-c914-4326-b32d-3601be25b0bf => generated 0 bytes in 811 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:33:31.604129 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1998f0a0-aff4-4760-b42b-b42d90763aa1 tempest-VolumesGetTestJSON-1342158773 tempest-VolumesGetTestJSON-1342158773-project] Calling method '.version_select at 0x7f44cc6229d0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:31.684892 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1998f0a0-aff4-4760-b42b-b42d90763aa1 tempest-VolumesGetTestJSON-1342158773 tempest-VolumesGetTestJSON-1342158773-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/57d2a730-d794-45ba-99b1-b630639e7ff4" status: 200 len: 354 microversion: 2.1 time: 0.085582 Oct 30 01:33:31.685674 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2286/4559] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 30 01:33:31 2022] GET /compute/v2.1/os-volumes/57d2a730-d794-45ba-99b1-b630639e7ff4 => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:33:31.691670 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-761cffad-2b4e-445f-8700-ad4dc4765485 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:31.725808 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-761cffad-2b4e-445f-8700-ad4dc4765485 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] [instance: 76d6b110-febc-4f28-8367-a0c9ef077177] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:31.725808 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-761cffad-2b4e-445f-8700-ad4dc4765485 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:31.725808 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-761cffad-2b4e-445f-8700-ad4dc4765485 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:31.725808 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-761cffad-2b4e-445f-8700-ad4dc4765485 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:31.725808 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-761cffad-2b4e-445f-8700-ad4dc4765485 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:31.725808 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-761cffad-2b4e-445f-8700-ad4dc4765485 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:31.725808 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-761cffad-2b4e-445f-8700-ad4dc4765485 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:31.725808 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-761cffad-2b4e-445f-8700-ad4dc4765485 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] HTTP exception thrown: Instance 76d6b110-febc-4f28-8367-a0c9ef077177 could not be found. Oct 30 01:33:31.725808 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-761cffad-2b4e-445f-8700-ad4dc4765485 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Request method failure captured: Oct 30 01:33:31.725808 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/servers/76d6b110-febc-4f28-8367-a0c9ef077177 HTTP/1.1 Oct 30 01:33:31.725808 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:33:31.725808 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:33:31.725808 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:33:31.725808 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:33:31.725808 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:33:31.725808 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:33:31.725808 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:33:31.725808 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:33:31.725808 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdQeB_St8oVZOGIJlshgL7-LKQgW_hEcgkwBL7Ks3Cs3DIyiB0pghA7n_e8cKany7LxH4x-CEsUJ-uItmueA0KgQDZXCqg5MHQPsBAlpzbn8cQVEq-NvT-3VnV52LMp-twxBeBnfcoXgkz5UUTyaCNLN3Bidx2JUEEuK5lVXSh3eLx8 Oct 30 01:33:31.725808 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:33:31.725808 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:33:31.725808 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:33:31.725808 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:33:31.725808 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:33:31.725808 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:33:31.725808 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 09d179276dbf4e4d9cb780b18e7a22c7 Oct 30 01:33:31.725808 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-SecurityGroupsTestJSON-78265462 Oct 30 01:33:31.725808 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:33:31.725808 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:33:31.725808 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:33:31.725808 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-SecurityGroupsTestJSON-78265462 Oct 30 01:33:31.725808 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 09d179276dbf4e4d9cb780b18e7a22c7 Oct 30 01:33:31.725808 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-78265462 Oct 30 01:33:31.734394 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-SecurityGroupsTestJSON-78265462-project Oct 30 01:33:31.734394 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:33:31.734394 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:33:31.734394 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 88ac5422c8f048148aac2c9b62e0482e Oct 30 01:33:31.734394 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-SecurityGroupsTestJSON-78265462-project Oct 30 01:33:31.734394 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:33:31.734394 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 76d6b110-febc-4f28-8367-a0c9ef077177 could not be found. Oct 30 01:33:31.734394 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '76d6b110-febc-4f28-8367-a0c9ef077177'} Oct 30 01:33:31.734394 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:33:31.734394 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:31.734394 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:33:31.734394 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:33:31.734394 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:33:31.734394 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:33:31.734394 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:33:31.734394 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:33:31.734394 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:33:31.734394 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:33:31.734394 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76d6b110-febc-4f28-8367-a0c9ef077177 could not be found. Oct 30 01:33:31.734394 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:31.734394 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:31.734394 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:31.734394 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:31.734394 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:31.734394 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:31.734394 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:33:31.734394 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:33:31.734394 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:33:31.734394 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:33:31.734394 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:33:31.734394 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:33:31.734394 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:33:31.734394 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:33:31.734394 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:33:31.734394 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:33:31.734394 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:33:31.734394 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:33:31.734394 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76d6b110-febc-4f28-8367-a0c9ef077177 could not be found. Oct 30 01:33:31.734394 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:31.734394 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:31.734394 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:31.734394 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:31.734394 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:31.734394 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:31.734394 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:33:31.734394 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:33:31.734394 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76d6b110-febc-4f28-8367-a0c9ef077177 could not be found. Oct 30 01:33:31.734394 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:31.734394 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-761cffad-2b4e-445f-8700-ad4dc4765485 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Returning 404 to user: Instance 76d6b110-febc-4f28-8367-a0c9ef077177 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:33:31.734394 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-761cffad-2b4e-445f-8700-ad4dc4765485 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "DELETE /compute/v2.1/servers/76d6b110-febc-4f28-8367-a0c9ef077177" status: 404 len: 111 microversion: 2.1 time: 0.038372 Oct 30 01:33:31.734394 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2287/4560] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:33:31 2022] DELETE /compute/v2.1/servers/76d6b110-febc-4f28-8367-a0c9ef077177 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:33:31.748300 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-367f2a64-63ce-48c9-a283-a45d879b090a tempest-VolumesGetTestJSON-1342158773 tempest-VolumesGetTestJSON-1342158773-project] Calling method '.version_select at 0x7f44c768ad30>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:31.813388 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b6e47dd6-d760-47a2-ba2d-f8db290392ac tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:31.830582 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b6e47dd6-d760-47a2-ba2d-f8db290392ac tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1509 microversion: 2.1 time: 0.431996 Oct 30 01:33:31.831515 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2274/4561] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:31 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1509 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:31.847185 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f8a11873-71f0-4beb-8056-d33727ae8186 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:31.848474 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f8a11873-71f0-4beb-8056-d33727ae8186 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] [instance: 193565f7-ccc8-4f1d-a9b3-d949e09970e8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:31.853027 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-367f2a64-63ce-48c9-a283-a45d879b090a tempest-VolumesGetTestJSON-1342158773 tempest-VolumesGetTestJSON-1342158773-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/57d2a730-d794-45ba-99b1-b630639e7ff4" status: 200 len: 354 microversion: 2.1 time: 0.120899 Oct 30 01:33:31.854167 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2288/4562] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 30 01:33:31 2022] GET /compute/v2.1/os-volumes/57d2a730-d794-45ba-99b1-b630639e7ff4 => generated 354 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:33:31.859561 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-dd7c5dff-e051-4142-9a02-c10f42907fbb tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:31.860281 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-dd7c5dff-e051-4142-9a02-c10f42907fbb tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] [instance: 76d6b110-febc-4f28-8367-a0c9ef077177] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:31.886975 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f8a11873-71f0-4beb-8056-d33727ae8186 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:31.887393 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dd7c5dff-e051-4142-9a02-c10f42907fbb tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:31.888614 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dd7c5dff-e051-4142-9a02-c10f42907fbb tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:31.896771 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f8a11873-71f0-4beb-8056-d33727ae8186 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:31.896771 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f8a11873-71f0-4beb-8056-d33727ae8186 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:31.897119 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dd7c5dff-e051-4142-9a02-c10f42907fbb tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:31.897119 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dd7c5dff-e051-4142-9a02-c10f42907fbb tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:31.897318 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f8a11873-71f0-4beb-8056-d33727ae8186 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:31.897318 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f8a11873-71f0-4beb-8056-d33727ae8186 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:31.898065 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dd7c5dff-e051-4142-9a02-c10f42907fbb tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:31.898157 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f8a11873-71f0-4beb-8056-d33727ae8186 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:31.898258 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dd7c5dff-e051-4142-9a02-c10f42907fbb tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:31.926105 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-dd7c5dff-e051-4142-9a02-c10f42907fbb tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] HTTP exception thrown: Instance 76d6b110-febc-4f28-8367-a0c9ef077177 could not be found. Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-dd7c5dff-e051-4142-9a02-c10f42907fbb tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Request method failure captured: Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/76d6b110-febc-4f28-8367-a0c9ef077177 HTTP/1.1 Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdQeB_St8oVZOGIJlshgL7-LKQgW_hEcgkwBL7Ks3Cs3DIyiB0pghA7n_e8cKany7LxH4x-CEsUJ-uItmueA0KgQDZXCqg5MHQPsBAlpzbn8cQVEq-NvT-3VnV52LMp-twxBeBnfcoXgkz5UUTyaCNLN3Bidx2JUEEuK5lVXSh3eLx8 Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 09d179276dbf4e4d9cb780b18e7a22c7 Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-SecurityGroupsTestJSON-78265462 Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-SecurityGroupsTestJSON-78265462 Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 09d179276dbf4e4d9cb780b18e7a22c7 Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-78265462 Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-SecurityGroupsTestJSON-78265462-project Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 88ac5422c8f048148aac2c9b62e0482e Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-SecurityGroupsTestJSON-78265462-project Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 76d6b110-febc-4f28-8367-a0c9ef077177 could not be found. Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '76d6b110-febc-4f28-8367-a0c9ef077177'} Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76d6b110-febc-4f28-8367-a0c9ef077177 could not be found. Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76d6b110-febc-4f28-8367-a0c9ef077177 could not be found. Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:31.927625 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:31.932131 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:31.932131 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:31.932131 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:31.932131 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:33:31.932131 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:33:31.932131 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76d6b110-febc-4f28-8367-a0c9ef077177 could not be found. Oct 30 01:33:31.932131 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:31.932131 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-dd7c5dff-e051-4142-9a02-c10f42907fbb tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Returning 404 to user: Instance 76d6b110-febc-4f28-8367-a0c9ef077177 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:33:31.932131 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-dd7c5dff-e051-4142-9a02-c10f42907fbb tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "GET /compute/v2.1/servers/76d6b110-febc-4f28-8367-a0c9ef077177" status: 404 len: 111 microversion: 2.1 time: 0.073717 Oct 30 01:33:31.932131 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2289/4563] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:31 2022] GET /compute/v2.1/servers/76d6b110-febc-4f28-8367-a0c9ef077177 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:33:31.948334 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fa9e7113-aec0-4f6d-b519-84c145d1f185 tempest-VolumesGetTestJSON-1342158773 tempest-VolumesGetTestJSON-1342158773-project] Calling method '.version_select at 0x7f44c768a8b0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:32.044979 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f8a11873-71f0-4beb-8056-d33727ae8186 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:32.054429 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f8a11873-71f0-4beb-8056-d33727ae8186 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:32.056740 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f8a11873-71f0-4beb-8056-d33727ae8186 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:32.058676 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f8a11873-71f0-4beb-8056-d33727ae8186 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] 10.222.0.13 "GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8" status: 200 len: 1357 microversion: 2.54 time: 0.223269 Oct 30 01:33:32.074261 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2275/4564] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:33:31 2022] GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8 => generated 1357 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:33:32.093260 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-312c1394-fa26-43f2-89b4-d8961cc18a20 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '.version_select at 0x7f44c6fa9550>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:32.154021 n-d-master-1 devstack@n-api.service[121103]: DEBUG neutronclient.v2_0.client [None req-312c1394-fa26-43f2-89b4-d8961cc18a20 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 02a0a013-3324-4119-b6ba-fc4d0543e64a does not exist", "detail": ""}} {{(pid=121103) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 30 01:33:32.159427 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.security_group_api [None req-312c1394-fa26-43f2-89b4-d8961cc18a20 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Neutron security group 02a0a013-3324-4119-b6ba-fc4d0543e64a not found {{(pid=121103) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 30 01:33:32.159427 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-312c1394-fa26-43f2-89b4-d8961cc18a20 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] HTTP exception thrown: Security group 02a0a013-3324-4119-b6ba-fc4d0543e64a does not exist Oct 30 01:33:32.159427 n-d-master-1 devstack@n-api.service[121103]: Neutron server returns request_ids: ['req-950fbc76-f956-45aa-8f10-383f579dd419'] Oct 30 01:33:32.159427 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-312c1394-fa26-43f2-89b4-d8961cc18a20 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Request method failure captured: Oct 30 01:33:32.159427 n-d-master-1 devstack@n-api.service[121103]: request: DELETE /compute/v2.1/os-security-groups/02a0a013-3324-4119-b6ba-fc4d0543e64a HTTP/1.1 Oct 30 01:33:32.159427 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:33:32.159427 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:33:32.159427 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:33:32.159427 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:33:32.159427 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:33:32.159427 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:33:32.159427 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:33:32.159427 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:33:32.159427 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdQeB_St8oVZOGIJlshgL7-LKQgW_hEcgkwBL7Ks3Cs3DIyiB0pghA7n_e8cKany7LxH4x-CEsUJ-uItmueA0KgQDZXCqg5MHQPsBAlpzbn8cQVEq-NvT-3VnV52LMp-twxBeBnfcoXgkz5UUTyaCNLN3Bidx2JUEEuK5lVXSh3eLx8 Oct 30 01:33:32.159427 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:33:32.159427 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:33:32.159427 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:33:32.159427 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:33:32.159427 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:33:32.159427 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:33:32.159427 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 09d179276dbf4e4d9cb780b18e7a22c7 Oct 30 01:33:32.159427 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-SecurityGroupsTestJSON-78265462 Oct 30 01:33:32.159427 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:33:32.159427 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:33:32.159427 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:33:32.159427 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-SecurityGroupsTestJSON-78265462 Oct 30 01:33:32.159427 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 09d179276dbf4e4d9cb780b18e7a22c7 Oct 30 01:33:32.159427 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-78265462 Oct 30 01:33:32.159427 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-SecurityGroupsTestJSON-78265462-project Oct 30 01:33:32.159427 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:33:32.159427 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:33:32.159427 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 88ac5422c8f048148aac2c9b62e0482e Oct 30 01:33:32.159427 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-SecurityGroupsTestJSON-78265462-project Oct 30 01:33:32.159427 n-d-master-1 devstack@n-api.service[121103]: method: Oct 30 01:33:32.159427 n-d-master-1 devstack@n-api.service[121103]: exception: Security group 02a0a013-3324-4119-b6ba-fc4d0543e64a does not exist Oct 30 01:33:32.159427 n-d-master-1 devstack@n-api.service[121103]: Neutron server returns request_ids: ['req-950fbc76-f956-45aa-8f10-383f579dd419'] Oct 30 01:33:32.159427 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '02a0a013-3324-4119-b6ba-fc4d0543e64a'} Oct 30 01:33:32.159427 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:33:32.159427 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:32.159427 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 30 01:33:32.159427 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 30 01:33:32.159427 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:33:32.159427 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:33:32.159427 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 30 01:33:32.159427 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 30 01:33:32.159427 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:33:32.159427 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:33:32.159427 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 30 01:33:32.159427 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 30 01:33:32.159427 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:33:32.159427 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:33:32.159427 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 30 01:33:32.159427 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 30 01:33:32.159427 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:33:32.159427 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:33:32.159427 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 30 01:33:32.159427 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 30 01:33:32.159427 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:33:32.162822 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:33:32.162822 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 30 01:33:32.162822 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 30 01:33:32.162822 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 30 01:33:32.162822 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 30 01:33:32.162822 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 02a0a013-3324-4119-b6ba-fc4d0543e64a does not exist Oct 30 01:33:32.162822 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-950fbc76-f956-45aa-8f10-383f579dd419'] Oct 30 01:33:32.162822 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:32.162822 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:32.162822 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:32.162822 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:32.162822 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 30 01:33:32.162822 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 30 01:33:32.162822 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 30 01:33:32.162822 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 30 01:33:32.162822 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 02a0a013-3324-4119-b6ba-fc4d0543e64a does not exist Oct 30 01:33:32.162822 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-950fbc76-f956-45aa-8f10-383f579dd419'] Oct 30 01:33:32.162822 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:32.162822 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:32.162822 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:32.162822 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:32.162822 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:32.162822 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:32.162822 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:33:32.162822 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:33:32.162822 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:33:32.162822 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:33:32.162822 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:33:32.162822 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:33:32.162822 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 30 01:33:32.162822 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 30 01:33:32.162822 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 02a0a013-3324-4119-b6ba-fc4d0543e64a does not exist Oct 30 01:33:32.162822 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-950fbc76-f956-45aa-8f10-383f579dd419'] Oct 30 01:33:32.162822 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:32.162822 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:32.162822 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:32.162822 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:32.162822 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:32.162822 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:32.162822 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:33:32.162822 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:33:32.162822 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 02a0a013-3324-4119-b6ba-fc4d0543e64a does not exist Oct 30 01:33:32.162822 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-950fbc76-f956-45aa-8f10-383f579dd419'] Oct 30 01:33:32.162822 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:32.162822 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-312c1394-fa26-43f2-89b4-d8961cc18a20 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Returning 404 to user: Security group 02a0a013-3324-4119-b6ba-fc4d0543e64a does not exist Oct 30 01:33:32.162822 n-d-master-1 devstack@n-api.service[121103]: Neutron server returns request_ids: ['req-950fbc76-f956-45aa-8f10-383f579dd419'] {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:33:32.174607 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-312c1394-fa26-43f2-89b4-d8961cc18a20 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/02a0a013-3324-4119-b6ba-fc4d0543e64a" status: 404 len: 194 microversion: 2.1 time: 0.098728 Oct 30 01:33:32.176480 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2276/4565] 10.222.0.13 () {58 vars in 1272 bytes} [Sun Oct 30 01:33:32 2022] DELETE /compute/v2.1/os-security-groups/02a0a013-3324-4119-b6ba-fc4d0543e64a => generated 194 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:33:32.188517 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fa9e7113-aec0-4f6d-b519-84c145d1f185 tempest-VolumesGetTestJSON-1342158773 tempest-VolumesGetTestJSON-1342158773-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/57d2a730-d794-45ba-99b1-b630639e7ff4" status: 202 len: 0 microversion: 2.1 time: 0.254681 Oct 30 01:33:32.188517 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2290/4566] 10.222.0.13 () {58 vars in 1248 bytes} [Sun Oct 30 01:33:31 2022] DELETE /compute/v2.1/os-volumes/57d2a730-d794-45ba-99b1-b630639e7ff4 => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:33:32.193610 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d8118f1d-25c8-49e5-b5fb-3a8d2e24e1e0 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '.version_select at 0x7f44cc13baf0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:32.195834 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5f9bcfe1-08c7-4f91-937a-62a5e8f222e5 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Action: 'create', calling method: .version_select at 0x7f44c6fbed30>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-872016320", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCwDBsHaBQCk9sN/zimS0e23DRXHABQLoIvh2t9FlycRdlNiRWDv6Tpt6cDfTaw8jxwviBHq9bIuge90VQrudrj/yskIeHMrzRarOKrX1ZzSm5ipVISxq77lytF3oQA0AA=="}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:33:32.230393 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-5f9bcfe1-08c7-4f91-937a-62a5e8f222e5 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Getting quotas for project 3f6da0fbf0024950b2c07a6db43ff3a3. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:33:32.243804 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-5f9bcfe1-08c7-4f91-937a-62a5e8f222e5 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Getting quotas for user 94cab57fc5184fc6be1cfde72e9bab26 and project 3f6da0fbf0024950b2c07a6db43ff3a3. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:33:32.275377 n-d-master-1 devstack@n-api.service[121102]: DEBUG neutronclient.v2_0.client [None req-d8118f1d-25c8-49e5-b5fb-3a8d2e24e1e0 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b0678fcc-2ce2-40ed-a488-ecee6ba65afe does not exist", "detail": ""}} {{(pid=121102) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 30 01:33:32.276613 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.security_group_api [None req-d8118f1d-25c8-49e5-b5fb-3a8d2e24e1e0 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Neutron security group b0678fcc-2ce2-40ed-a488-ecee6ba65afe not found {{(pid=121102) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 30 01:33:32.277595 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-d8118f1d-25c8-49e5-b5fb-3a8d2e24e1e0 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] HTTP exception thrown: Security group b0678fcc-2ce2-40ed-a488-ecee6ba65afe does not exist Oct 30 01:33:32.277595 n-d-master-1 devstack@n-api.service[121102]: Neutron server returns request_ids: ['req-4def14ad-4746-4bcb-89d4-8cde34c0e462'] Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d8118f1d-25c8-49e5-b5fb-3a8d2e24e1e0 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Request method failure captured: Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/os-security-groups/b0678fcc-2ce2-40ed-a488-ecee6ba65afe HTTP/1.1 Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdQeB_St8oVZOGIJlshgL7-LKQgW_hEcgkwBL7Ks3Cs3DIyiB0pghA7n_e8cKany7LxH4x-CEsUJ-uItmueA0KgQDZXCqg5MHQPsBAlpzbn8cQVEq-NvT-3VnV52LMp-twxBeBnfcoXgkz5UUTyaCNLN3Bidx2JUEEuK5lVXSh3eLx8 Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 09d179276dbf4e4d9cb780b18e7a22c7 Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-SecurityGroupsTestJSON-78265462 Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-SecurityGroupsTestJSON-78265462 Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 09d179276dbf4e4d9cb780b18e7a22c7 Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-78265462 Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-SecurityGroupsTestJSON-78265462-project Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 88ac5422c8f048148aac2c9b62e0482e Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-SecurityGroupsTestJSON-78265462-project Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: method: Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: exception: Security group b0678fcc-2ce2-40ed-a488-ecee6ba65afe does not exist Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: Neutron server returns request_ids: ['req-4def14ad-4746-4bcb-89d4-8cde34c0e462'] Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'b0678fcc-2ce2-40ed-a488-ecee6ba65afe'} Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 30 01:33:32.279459 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b0678fcc-2ce2-40ed-a488-ecee6ba65afe does not exist Oct 30 01:33:32.283712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4def14ad-4746-4bcb-89d4-8cde34c0e462'] Oct 30 01:33:32.283712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:32.283712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:32.283712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:32.283712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:32.283712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 30 01:33:32.283712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 30 01:33:32.283712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 30 01:33:32.283712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 30 01:33:32.283712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b0678fcc-2ce2-40ed-a488-ecee6ba65afe does not exist Oct 30 01:33:32.283712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4def14ad-4746-4bcb-89d4-8cde34c0e462'] Oct 30 01:33:32.283712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:32.283712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:32.283712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:32.283712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:32.283712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:32.283712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:32.283712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:33:32.283712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:33:32.283712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:33:32.283712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:33:32.283712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:33:32.283712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:33:32.283712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 30 01:33:32.283712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 30 01:33:32.283712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b0678fcc-2ce2-40ed-a488-ecee6ba65afe does not exist Oct 30 01:33:32.283712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4def14ad-4746-4bcb-89d4-8cde34c0e462'] Oct 30 01:33:32.283712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:32.283712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:32.283712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:32.283712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:32.283712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:32.283712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:32.283712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:33:32.283712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:33:32.283712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b0678fcc-2ce2-40ed-a488-ecee6ba65afe does not exist Oct 30 01:33:32.283712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4def14ad-4746-4bcb-89d4-8cde34c0e462'] Oct 30 01:33:32.283712 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:32.287959 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d8118f1d-25c8-49e5-b5fb-3a8d2e24e1e0 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Returning 404 to user: Security group b0678fcc-2ce2-40ed-a488-ecee6ba65afe does not exist Oct 30 01:33:32.287959 n-d-master-1 devstack@n-api.service[121102]: Neutron server returns request_ids: ['req-4def14ad-4746-4bcb-89d4-8cde34c0e462'] {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:33:32.289384 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d8118f1d-25c8-49e5-b5fb-3a8d2e24e1e0 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/b0678fcc-2ce2-40ed-a488-ecee6ba65afe" status: 404 len: 194 microversion: 2.1 time: 0.102170 Oct 30 01:33:32.290272 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2291/4567] 10.222.0.13 () {58 vars in 1272 bytes} [Sun Oct 30 01:33:32 2022] DELETE /compute/v2.1/os-security-groups/b0678fcc-2ce2-40ed-a488-ecee6ba65afe => generated 194 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:33:32.296044 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-10fd7b0e-4e65-4d5e-a5aa-2770083dabc9 tempest-VolumesGetTestJSON-1342158773 tempest-VolumesGetTestJSON-1342158773-project] Calling method '.version_select at 0x7f44c768ad30>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:32.313492 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5f9bcfe1-08c7-4f91-937a-62a5e8f222e5 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.135255 Oct 30 01:33:32.314237 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2277/4568] 10.222.0.13 () {62 vars in 1200 bytes} [Sun Oct 30 01:33:32 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 137 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 30 01:33:32.320018 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8e0ca0cc-4a59-4eef-986f-24b736e4e2a2 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '.version_select at 0x7f44c6fbe9d0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:32.374991 n-d-master-1 devstack@n-api.service[121103]: DEBUG neutronclient.v2_0.client [None req-8e0ca0cc-4a59-4eef-986f-24b736e4e2a2 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a126733b-c415-4ab2-ab30-f4e2165e898a does not exist", "detail": ""}} {{(pid=121103) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 30 01:33:32.374991 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.security_group_api [None req-8e0ca0cc-4a59-4eef-986f-24b736e4e2a2 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Neutron security group a126733b-c415-4ab2-ab30-f4e2165e898a not found {{(pid=121103) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 30 01:33:32.374991 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-8e0ca0cc-4a59-4eef-986f-24b736e4e2a2 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] HTTP exception thrown: Security group a126733b-c415-4ab2-ab30-f4e2165e898a does not exist Oct 30 01:33:32.374991 n-d-master-1 devstack@n-api.service[121103]: Neutron server returns request_ids: ['req-9cf2c14c-c73a-4a4c-8d36-19154e11338a'] Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8e0ca0cc-4a59-4eef-986f-24b736e4e2a2 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Request method failure captured: Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: request: DELETE /compute/v2.1/os-security-groups/a126733b-c415-4ab2-ab30-f4e2165e898a HTTP/1.1 Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdQeB_St8oVZOGIJlshgL7-LKQgW_hEcgkwBL7Ks3Cs3DIyiB0pghA7n_e8cKany7LxH4x-CEsUJ-uItmueA0KgQDZXCqg5MHQPsBAlpzbn8cQVEq-NvT-3VnV52LMp-twxBeBnfcoXgkz5UUTyaCNLN3Bidx2JUEEuK5lVXSh3eLx8 Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 09d179276dbf4e4d9cb780b18e7a22c7 Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-SecurityGroupsTestJSON-78265462 Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-SecurityGroupsTestJSON-78265462 Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 09d179276dbf4e4d9cb780b18e7a22c7 Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-78265462 Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-SecurityGroupsTestJSON-78265462-project Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 88ac5422c8f048148aac2c9b62e0482e Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-SecurityGroupsTestJSON-78265462-project Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: method: Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: exception: Security group a126733b-c415-4ab2-ab30-f4e2165e898a does not exist Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: Neutron server returns request_ids: ['req-9cf2c14c-c73a-4a4c-8d36-19154e11338a'] Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'a126733b-c415-4ab2-ab30-f4e2165e898a'} Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 30 01:33:32.377262 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a126733b-c415-4ab2-ab30-f4e2165e898a does not exist Oct 30 01:33:32.381309 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9cf2c14c-c73a-4a4c-8d36-19154e11338a'] Oct 30 01:33:32.381309 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:32.381309 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:32.381309 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:32.381309 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:32.381309 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 30 01:33:32.381309 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 30 01:33:32.381309 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 30 01:33:32.381309 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 30 01:33:32.381309 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a126733b-c415-4ab2-ab30-f4e2165e898a does not exist Oct 30 01:33:32.381309 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9cf2c14c-c73a-4a4c-8d36-19154e11338a'] Oct 30 01:33:32.381309 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:32.381309 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:32.381309 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:32.381309 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:32.381309 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:32.381309 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:32.381309 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:33:32.381309 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:33:32.381309 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:33:32.381309 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:33:32.381309 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:33:32.381309 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:33:32.381309 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 30 01:33:32.381309 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 30 01:33:32.381309 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a126733b-c415-4ab2-ab30-f4e2165e898a does not exist Oct 30 01:33:32.381309 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9cf2c14c-c73a-4a4c-8d36-19154e11338a'] Oct 30 01:33:32.381309 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:32.381309 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:32.381309 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:32.381309 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:32.381309 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:32.381309 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:32.381309 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:33:32.381309 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:33:32.381309 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a126733b-c415-4ab2-ab30-f4e2165e898a does not exist Oct 30 01:33:32.381309 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9cf2c14c-c73a-4a4c-8d36-19154e11338a'] Oct 30 01:33:32.381309 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:32.383877 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8e0ca0cc-4a59-4eef-986f-24b736e4e2a2 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Returning 404 to user: Security group a126733b-c415-4ab2-ab30-f4e2165e898a does not exist Oct 30 01:33:32.383877 n-d-master-1 devstack@n-api.service[121103]: Neutron server returns request_ids: ['req-9cf2c14c-c73a-4a4c-8d36-19154e11338a'] {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:33:32.384938 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8e0ca0cc-4a59-4eef-986f-24b736e4e2a2 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/a126733b-c415-4ab2-ab30-f4e2165e898a" status: 404 len: 194 microversion: 2.1 time: 0.069416 Oct 30 01:33:32.385639 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2278/4569] 10.222.0.13 () {58 vars in 1272 bytes} [Sun Oct 30 01:33:32 2022] DELETE /compute/v2.1/os-security-groups/a126733b-c415-4ab2-ab30-f4e2165e898a => generated 194 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:33:32.396088 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-01576601-e353-4081-a463-9e2a24c10b24 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-872016320", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:33:32.399223 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-10fd7b0e-4e65-4d5e-a5aa-2770083dabc9 tempest-VolumesGetTestJSON-1342158773 tempest-VolumesGetTestJSON-1342158773-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/57d2a730-d794-45ba-99b1-b630639e7ff4" status: 200 len: 353 microversion: 2.1 time: 0.106829 Oct 30 01:33:32.404134 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2292/4570] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 30 01:33:32 2022] GET /compute/v2.1/os-volumes/57d2a730-d794-45ba-99b1-b630639e7ff4 => generated 353 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:33:32.406249 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-01576601-e353-4081-a463-9e2a24c10b24 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] [instance: 193565f7-ccc8-4f1d-a9b3-d949e09970e8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:32.407157 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cb22ce0c-808d-46cd-8aa5-63fcc809ad67 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '.version_select at 0x7f44cc945550>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:32.421972 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-01576601-e353-4081-a463-9e2a24c10b24 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:32.422549 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-01576601-e353-4081-a463-9e2a24c10b24 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:32.423218 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-01576601-e353-4081-a463-9e2a24c10b24 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:32.424002 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-01576601-e353-4081-a463-9e2a24c10b24 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:32.424666 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-01576601-e353-4081-a463-9e2a24c10b24 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:32.425286 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-01576601-e353-4081-a463-9e2a24c10b24 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:32.466507 n-d-master-1 devstack@n-api.service[121102]: DEBUG neutronclient.v2_0.client [None req-cb22ce0c-808d-46cd-8aa5-63fcc809ad67 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e8dc83ef-db9d-4922-b398-521e1595fef6 does not exist", "detail": ""}} {{(pid=121102) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 30 01:33:32.467393 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.security_group_api [None req-cb22ce0c-808d-46cd-8aa5-63fcc809ad67 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Neutron security group e8dc83ef-db9d-4922-b398-521e1595fef6 not found {{(pid=121102) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 30 01:33:32.468132 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-cb22ce0c-808d-46cd-8aa5-63fcc809ad67 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] HTTP exception thrown: Security group e8dc83ef-db9d-4922-b398-521e1595fef6 does not exist Oct 30 01:33:32.468132 n-d-master-1 devstack@n-api.service[121102]: Neutron server returns request_ids: ['req-24436ec3-23bd-42f0-a901-91dc14ee2971'] Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cb22ce0c-808d-46cd-8aa5-63fcc809ad67 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Request method failure captured: Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/os-security-groups/e8dc83ef-db9d-4922-b398-521e1595fef6 HTTP/1.1 Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdQeB_St8oVZOGIJlshgL7-LKQgW_hEcgkwBL7Ks3Cs3DIyiB0pghA7n_e8cKany7LxH4x-CEsUJ-uItmueA0KgQDZXCqg5MHQPsBAlpzbn8cQVEq-NvT-3VnV52LMp-twxBeBnfcoXgkz5UUTyaCNLN3Bidx2JUEEuK5lVXSh3eLx8 Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 09d179276dbf4e4d9cb780b18e7a22c7 Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-SecurityGroupsTestJSON-78265462 Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-SecurityGroupsTestJSON-78265462 Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 09d179276dbf4e4d9cb780b18e7a22c7 Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-78265462 Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-SecurityGroupsTestJSON-78265462-project Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 88ac5422c8f048148aac2c9b62e0482e Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-SecurityGroupsTestJSON-78265462-project Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: method: Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: exception: Security group e8dc83ef-db9d-4922-b398-521e1595fef6 does not exist Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: Neutron server returns request_ids: ['req-24436ec3-23bd-42f0-a901-91dc14ee2971'] Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'e8dc83ef-db9d-4922-b398-521e1595fef6'} Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 30 01:33:32.470308 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e8dc83ef-db9d-4922-b398-521e1595fef6 does not exist Oct 30 01:33:32.474849 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-24436ec3-23bd-42f0-a901-91dc14ee2971'] Oct 30 01:33:32.474849 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:32.474849 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:32.474849 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:32.474849 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:32.474849 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 30 01:33:32.474849 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 30 01:33:32.474849 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 30 01:33:32.474849 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 30 01:33:32.474849 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e8dc83ef-db9d-4922-b398-521e1595fef6 does not exist Oct 30 01:33:32.474849 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-24436ec3-23bd-42f0-a901-91dc14ee2971'] Oct 30 01:33:32.474849 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:32.474849 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:32.474849 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:32.474849 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:32.474849 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:32.474849 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:32.474849 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:33:32.474849 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:33:32.474849 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:33:32.474849 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:33:32.474849 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:33:32.474849 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:33:32.474849 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 30 01:33:32.474849 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 30 01:33:32.474849 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e8dc83ef-db9d-4922-b398-521e1595fef6 does not exist Oct 30 01:33:32.474849 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-24436ec3-23bd-42f0-a901-91dc14ee2971'] Oct 30 01:33:32.474849 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:32.474849 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:32.474849 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:32.474849 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:32.474849 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:32.474849 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:32.474849 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:33:32.474849 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:33:32.474849 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e8dc83ef-db9d-4922-b398-521e1595fef6 does not exist Oct 30 01:33:32.474849 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-24436ec3-23bd-42f0-a901-91dc14ee2971'] Oct 30 01:33:32.474849 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:32.480176 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cb22ce0c-808d-46cd-8aa5-63fcc809ad67 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Returning 404 to user: Security group e8dc83ef-db9d-4922-b398-521e1595fef6 does not exist Oct 30 01:33:32.480176 n-d-master-1 devstack@n-api.service[121102]: Neutron server returns request_ids: ['req-24436ec3-23bd-42f0-a901-91dc14ee2971'] {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:33:32.481389 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cb22ce0c-808d-46cd-8aa5-63fcc809ad67 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/e8dc83ef-db9d-4922-b398-521e1595fef6" status: 404 len: 194 microversion: 2.1 time: 0.080192 Oct 30 01:33:32.482113 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2293/4571] 10.222.0.13 () {58 vars in 1272 bytes} [Sun Oct 30 01:33:32 2022] DELETE /compute/v2.1/os-security-groups/e8dc83ef-db9d-4922-b398-521e1595fef6 => generated 194 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:33:32.493097 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5ab6743d-92b3-4fe0-b6e0-d0df1817ccff tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '.version_select at 0x7f44c761f040>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:32.575284 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-01576601-e353-4081-a463-9e2a24c10b24 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:33:32.575722 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-01576601-e353-4081-a463-9e2a24c10b24 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:33:32.576203 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-01576601-e353-4081-a463-9e2a24c10b24 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:33:32.576653 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-01576601-e353-4081-a463-9e2a24c10b24 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:33:32.577072 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-01576601-e353-4081-a463-9e2a24c10b24 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:33:32.692987 n-d-master-1 devstack@n-api.service[121102]: DEBUG neutronclient.v2_0.client [None req-5ab6743d-92b3-4fe0-b6e0-d0df1817ccff tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d515fd92-e8d3-4b09-9be9-dc80d5cb0613 does not exist", "detail": ""}} {{(pid=121102) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 30 01:33:32.692987 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.security_group_api [None req-5ab6743d-92b3-4fe0-b6e0-d0df1817ccff tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Neutron security group d515fd92-e8d3-4b09-9be9-dc80d5cb0613 not found {{(pid=121102) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 30 01:33:32.693738 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-5ab6743d-92b3-4fe0-b6e0-d0df1817ccff tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] HTTP exception thrown: Security group d515fd92-e8d3-4b09-9be9-dc80d5cb0613 does not exist Oct 30 01:33:32.693738 n-d-master-1 devstack@n-api.service[121102]: Neutron server returns request_ids: ['req-c75d12cc-4b45-4568-a8b4-bc2418d54c36'] Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5ab6743d-92b3-4fe0-b6e0-d0df1817ccff tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Request method failure captured: Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/os-security-groups/d515fd92-e8d3-4b09-9be9-dc80d5cb0613 HTTP/1.1 Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdQeB_St8oVZOGIJlshgL7-LKQgW_hEcgkwBL7Ks3Cs3DIyiB0pghA7n_e8cKany7LxH4x-CEsUJ-uItmueA0KgQDZXCqg5MHQPsBAlpzbn8cQVEq-NvT-3VnV52LMp-twxBeBnfcoXgkz5UUTyaCNLN3Bidx2JUEEuK5lVXSh3eLx8 Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 09d179276dbf4e4d9cb780b18e7a22c7 Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-SecurityGroupsTestJSON-78265462 Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-SecurityGroupsTestJSON-78265462 Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 09d179276dbf4e4d9cb780b18e7a22c7 Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-78265462 Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-SecurityGroupsTestJSON-78265462-project Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 88ac5422c8f048148aac2c9b62e0482e Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-SecurityGroupsTestJSON-78265462-project Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: method: Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: exception: Security group d515fd92-e8d3-4b09-9be9-dc80d5cb0613 does not exist Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: Neutron server returns request_ids: ['req-c75d12cc-4b45-4568-a8b4-bc2418d54c36'] Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'd515fd92-e8d3-4b09-9be9-dc80d5cb0613'} Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 30 01:33:32.695132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d515fd92-e8d3-4b09-9be9-dc80d5cb0613 does not exist Oct 30 01:33:32.698604 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c75d12cc-4b45-4568-a8b4-bc2418d54c36'] Oct 30 01:33:32.698604 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:32.698604 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:32.698604 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:32.698604 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:32.698604 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 30 01:33:32.698604 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 30 01:33:32.698604 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 30 01:33:32.698604 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 30 01:33:32.698604 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d515fd92-e8d3-4b09-9be9-dc80d5cb0613 does not exist Oct 30 01:33:32.698604 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c75d12cc-4b45-4568-a8b4-bc2418d54c36'] Oct 30 01:33:32.698604 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:32.698604 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:32.698604 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:32.698604 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:32.698604 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:32.698604 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:32.698604 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:33:32.698604 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:33:32.698604 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:33:32.698604 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:33:32.698604 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:33:32.698604 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:33:32.698604 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 30 01:33:32.698604 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 30 01:33:32.698604 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d515fd92-e8d3-4b09-9be9-dc80d5cb0613 does not exist Oct 30 01:33:32.698604 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c75d12cc-4b45-4568-a8b4-bc2418d54c36'] Oct 30 01:33:32.698604 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:32.698604 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:32.698604 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:32.698604 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:32.698604 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:32.698604 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:32.698604 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:33:32.698604 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:33:32.698604 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d515fd92-e8d3-4b09-9be9-dc80d5cb0613 does not exist Oct 30 01:33:32.698604 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c75d12cc-4b45-4568-a8b4-bc2418d54c36'] Oct 30 01:33:32.698604 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:32.698604 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5ab6743d-92b3-4fe0-b6e0-d0df1817ccff tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Returning 404 to user: Security group d515fd92-e8d3-4b09-9be9-dc80d5cb0613 does not exist Oct 30 01:33:32.698604 n-d-master-1 devstack@n-api.service[121102]: Neutron server returns request_ids: ['req-c75d12cc-4b45-4568-a8b4-bc2418d54c36'] {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:33:32.698604 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5ab6743d-92b3-4fe0-b6e0-d0df1817ccff tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/d515fd92-e8d3-4b09-9be9-dc80d5cb0613" status: 404 len: 194 microversion: 2.1 time: 0.210538 Oct 30 01:33:32.704345 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2294/4572] 10.222.0.13 () {58 vars in 1272 bytes} [Sun Oct 30 01:33:32 2022] DELETE /compute/v2.1/os-security-groups/d515fd92-e8d3-4b09-9be9-dc80d5cb0613 => generated 194 bytes in 215 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 01:33:32.708825 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e452da05-8a1d-46b2-92cc-75d9b30e79cc tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '.version_select at 0x7f44c71ad040>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:32.780217 n-d-master-1 devstack@n-api.service[121102]: DEBUG neutronclient.v2_0.client [None req-e452da05-8a1d-46b2-92cc-75d9b30e79cc tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0e046a09-3cb7-4ad7-9628-9ac631a315c4 does not exist", "detail": ""}} {{(pid=121102) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 30 01:33:32.783269 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.security_group_api [None req-e452da05-8a1d-46b2-92cc-75d9b30e79cc tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Neutron security group 0e046a09-3cb7-4ad7-9628-9ac631a315c4 not found {{(pid=121102) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 30 01:33:32.783269 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-e452da05-8a1d-46b2-92cc-75d9b30e79cc tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] HTTP exception thrown: Security group 0e046a09-3cb7-4ad7-9628-9ac631a315c4 does not exist Oct 30 01:33:32.783269 n-d-master-1 devstack@n-api.service[121102]: Neutron server returns request_ids: ['req-48815143-4836-4c1b-812a-483056a5d323'] Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e452da05-8a1d-46b2-92cc-75d9b30e79cc tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Request method failure captured: Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/os-security-groups/0e046a09-3cb7-4ad7-9628-9ac631a315c4 HTTP/1.1 Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdQeB_St8oVZOGIJlshgL7-LKQgW_hEcgkwBL7Ks3Cs3DIyiB0pghA7n_e8cKany7LxH4x-CEsUJ-uItmueA0KgQDZXCqg5MHQPsBAlpzbn8cQVEq-NvT-3VnV52LMp-twxBeBnfcoXgkz5UUTyaCNLN3Bidx2JUEEuK5lVXSh3eLx8 Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 09d179276dbf4e4d9cb780b18e7a22c7 Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-SecurityGroupsTestJSON-78265462 Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-SecurityGroupsTestJSON-78265462 Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 09d179276dbf4e4d9cb780b18e7a22c7 Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-78265462 Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-SecurityGroupsTestJSON-78265462-project Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 88ac5422c8f048148aac2c9b62e0482e Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-SecurityGroupsTestJSON-78265462-project Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: method: Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: exception: Security group 0e046a09-3cb7-4ad7-9628-9ac631a315c4 does not exist Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: Neutron server returns request_ids: ['req-48815143-4836-4c1b-812a-483056a5d323'] Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '0e046a09-3cb7-4ad7-9628-9ac631a315c4'} Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 30 01:33:32.783983 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0e046a09-3cb7-4ad7-9628-9ac631a315c4 does not exist Oct 30 01:33:32.788132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-48815143-4836-4c1b-812a-483056a5d323'] Oct 30 01:33:32.788132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:32.788132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:32.788132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:32.788132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:32.788132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 30 01:33:32.788132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 30 01:33:32.788132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 30 01:33:32.788132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 30 01:33:32.788132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0e046a09-3cb7-4ad7-9628-9ac631a315c4 does not exist Oct 30 01:33:32.788132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-48815143-4836-4c1b-812a-483056a5d323'] Oct 30 01:33:32.788132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:32.788132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:32.788132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:32.788132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:32.788132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:32.788132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:32.788132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:33:32.788132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:33:32.788132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:33:32.788132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:33:32.788132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:33:32.788132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:33:32.788132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 30 01:33:32.788132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 30 01:33:32.788132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0e046a09-3cb7-4ad7-9628-9ac631a315c4 does not exist Oct 30 01:33:32.788132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-48815143-4836-4c1b-812a-483056a5d323'] Oct 30 01:33:32.788132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:32.788132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:32.788132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:32.788132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:32.788132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:32.788132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:32.788132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:33:32.788132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:33:32.788132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0e046a09-3cb7-4ad7-9628-9ac631a315c4 does not exist Oct 30 01:33:32.788132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-48815143-4836-4c1b-812a-483056a5d323'] Oct 30 01:33:32.788132 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:32.791939 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e452da05-8a1d-46b2-92cc-75d9b30e79cc tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Returning 404 to user: Security group 0e046a09-3cb7-4ad7-9628-9ac631a315c4 does not exist Oct 30 01:33:32.791939 n-d-master-1 devstack@n-api.service[121102]: Neutron server returns request_ids: ['req-48815143-4836-4c1b-812a-483056a5d323'] {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:33:32.793037 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e452da05-8a1d-46b2-92cc-75d9b30e79cc tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/0e046a09-3cb7-4ad7-9628-9ac631a315c4" status: 404 len: 194 microversion: 2.1 time: 0.091445 Oct 30 01:33:32.797271 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2295/4573] 10.222.0.13 () {58 vars in 1272 bytes} [Sun Oct 30 01:33:32 2022] DELETE /compute/v2.1/os-security-groups/0e046a09-3cb7-4ad7-9628-9ac631a315c4 => generated 194 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:33:32.802923 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-599e477d-064f-42b7-91bb-3a9633203e97 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:32.803498 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-599e477d-064f-42b7-91bb-3a9633203e97 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] [instance: 9d85310b-581e-4748-b962-ab53210e15b5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:32.811481 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-599e477d-064f-42b7-91bb-3a9633203e97 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:32.812342 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-599e477d-064f-42b7-91bb-3a9633203e97 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:32.812930 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-599e477d-064f-42b7-91bb-3a9633203e97 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:32.814028 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-599e477d-064f-42b7-91bb-3a9633203e97 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:32.814773 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-599e477d-064f-42b7-91bb-3a9633203e97 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:32.815349 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-599e477d-064f-42b7-91bb-3a9633203e97 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:32.867541 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-599e477d-064f-42b7-91bb-3a9633203e97 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] [instance: 9d85310b-581e-4748-b962-ab53210e15b5] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:33:32.960825 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:33.077715 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-01576601-e353-4081-a463-9e2a24c10b24 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] [instance: 193565f7-ccc8-4f1d-a9b3-d949e09970e8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:33.091610 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-01576601-e353-4081-a463-9e2a24c10b24 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:33.092184 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-01576601-e353-4081-a463-9e2a24c10b24 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:33.092690 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-01576601-e353-4081-a463-9e2a24c10b24 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:33.093603 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-01576601-e353-4081-a463-9e2a24c10b24 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:33.094325 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-01576601-e353-4081-a463-9e2a24c10b24 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:33.094929 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-01576601-e353-4081-a463-9e2a24c10b24 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:33.141076 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-01576601-e353-4081-a463-9e2a24c10b24 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] 10.222.0.13 "POST /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8/action" status: 202 len: 1139 microversion: 2.54 time: 0.754227 Oct 30 01:33:33.142225 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2279/4574] 10.222.0.13 () {62 vars in 1320 bytes} [Sun Oct 30 01:33:32 2022] POST /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8/action => generated 1139 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 30 01:33:33.166354 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4d71c9a8-032b-4da4-ada9-34b5a58fb912 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:33.169512 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4d71c9a8-032b-4da4-ada9-34b5a58fb912 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:33.187167 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4d71c9a8-032b-4da4-ada9-34b5a58fb912 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:33.188079 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4d71c9a8-032b-4da4-ada9-34b5a58fb912 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:33.189017 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4d71c9a8-032b-4da4-ada9-34b5a58fb912 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:33.189858 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4d71c9a8-032b-4da4-ada9-34b5a58fb912 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:33.190232 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4d71c9a8-032b-4da4-ada9-34b5a58fb912 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:33.190831 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4d71c9a8-032b-4da4-ada9-34b5a58fb912 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:33.248608 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-599e477d-064f-42b7-91bb-3a9633203e97 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9d85310b-581e-4748-b962-ab53210e15b5" status: 204 len: 0 microversion: 2.1 time: 0.449681 Oct 30 01:33:33.249553 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2296/4575] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:33:32 2022] DELETE /compute/v2.1/servers/9d85310b-581e-4748-b962-ab53210e15b5 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:33:33.257994 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4514bcd9-9468-4307-9d9f-6dd5420355d5 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:33.258961 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4514bcd9-9468-4307-9d9f-6dd5420355d5 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] [instance: 193565f7-ccc8-4f1d-a9b3-d949e09970e8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:33.279777 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4514bcd9-9468-4307-9d9f-6dd5420355d5 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:33.281035 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4514bcd9-9468-4307-9d9f-6dd5420355d5 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:33.285773 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4514bcd9-9468-4307-9d9f-6dd5420355d5 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:33.286775 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4514bcd9-9468-4307-9d9f-6dd5420355d5 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:33.287275 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4514bcd9-9468-4307-9d9f-6dd5420355d5 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:33.287734 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4514bcd9-9468-4307-9d9f-6dd5420355d5 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:33.476108 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4514bcd9-9468-4307-9d9f-6dd5420355d5 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:33.493963 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4514bcd9-9468-4307-9d9f-6dd5420355d5 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:33.496564 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4514bcd9-9468-4307-9d9f-6dd5420355d5 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:33.501162 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4514bcd9-9468-4307-9d9f-6dd5420355d5 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] 10.222.0.13 "GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8" status: 200 len: 1408 microversion: 2.54 time: 0.249895 Oct 30 01:33:33.502882 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2297/4576] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:33:33 2022] GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8 => generated 1408 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:33:33.527690 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-dd796307-c1de-410c-9ef0-f8c2f90e56db tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:33.530258 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-dd796307-c1de-410c-9ef0-f8c2f90e56db tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] [instance: 9d85310b-581e-4748-b962-ab53210e15b5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:33.568538 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dd796307-c1de-410c-9ef0-f8c2f90e56db tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:33.580253 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dd796307-c1de-410c-9ef0-f8c2f90e56db tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:33.580864 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dd796307-c1de-410c-9ef0-f8c2f90e56db tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:33.588429 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dd796307-c1de-410c-9ef0-f8c2f90e56db tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:33.588429 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dd796307-c1de-410c-9ef0-f8c2f90e56db tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:33.588429 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dd796307-c1de-410c-9ef0-f8c2f90e56db tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:33.842227 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:34.312972 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-dd796307-c1de-410c-9ef0-f8c2f90e56db tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ac5422c8f048148aac2c9b62e0482e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d179276dbf4e4d9cb780b18e7a22c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:34.325067 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4d71c9a8-032b-4da4-ada9-34b5a58fb912 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:34.329895 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-dd796307-c1de-410c-9ef0-f8c2f90e56db tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "GET /compute/v2.1/servers/9d85310b-581e-4748-b962-ab53210e15b5" status: 200 len: 1646 microversion: 2.1 time: 0.825642 Oct 30 01:33:34.330611 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2298/4577] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:33 2022] GET /compute/v2.1/servers/9d85310b-581e-4748-b962-ab53210e15b5 => generated 1646 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:34.341278 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2ab697d1-39a2-437e-aee0-79a28211466c tempest-VolumesGetTestJSON-1342158773 tempest-VolumesGetTestJSON-1342158773-project] Calling method '.version_select at 0x7f44c6fde040>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:34.344463 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4d71c9a8-032b-4da4-ada9-34b5a58fb912 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1509 microversion: 2.1 time: 1.193118 Oct 30 01:33:34.347087 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2280/4578] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:33 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1509 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:34.447230 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2ab697d1-39a2-437e-aee0-79a28211466c tempest-VolumesGetTestJSON-1342158773 tempest-VolumesGetTestJSON-1342158773-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/57d2a730-d794-45ba-99b1-b630639e7ff4" status: 200 len: 353 microversion: 2.1 time: 0.115014 Oct 30 01:33:34.448540 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2299/4579] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 30 01:33:34 2022] GET /compute/v2.1/os-volumes/57d2a730-d794-45ba-99b1-b630639e7ff4 => generated 353 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:33:34.556453 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0c788f30-3307-48a7-81f4-0b6517ff899c tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:34.558769 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0c788f30-3307-48a7-81f4-0b6517ff899c tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] [instance: 193565f7-ccc8-4f1d-a9b3-d949e09970e8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:34.566534 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:34.596737 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c788f30-3307-48a7-81f4-0b6517ff899c tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:34.598677 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c788f30-3307-48a7-81f4-0b6517ff899c tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:34.600085 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c788f30-3307-48a7-81f4-0b6517ff899c tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:34.606401 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c788f30-3307-48a7-81f4-0b6517ff899c tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:34.606401 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c788f30-3307-48a7-81f4-0b6517ff899c tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:34.606401 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c788f30-3307-48a7-81f4-0b6517ff899c tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:34.926728 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0c788f30-3307-48a7-81f4-0b6517ff899c tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:34.937801 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0c788f30-3307-48a7-81f4-0b6517ff899c tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:34.948171 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0c788f30-3307-48a7-81f4-0b6517ff899c tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:34.952009 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0c788f30-3307-48a7-81f4-0b6517ff899c tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] 10.222.0.13 "GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8" status: 200 len: 1408 microversion: 2.54 time: 0.426048 Oct 30 01:33:34.953105 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2281/4580] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:33:34 2022] GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8 => generated 1408 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:33:35.358484 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-eda6f117-0ccf-436b-812b-48c683b06d53 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:35.359825 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-eda6f117-0ccf-436b-812b-48c683b06d53 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] [instance: 9d85310b-581e-4748-b962-ab53210e15b5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:35.391274 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eda6f117-0ccf-436b-812b-48c683b06d53 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:35.391781 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eda6f117-0ccf-436b-812b-48c683b06d53 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:35.392229 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eda6f117-0ccf-436b-812b-48c683b06d53 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:35.392962 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eda6f117-0ccf-436b-812b-48c683b06d53 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:35.393489 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eda6f117-0ccf-436b-812b-48c683b06d53 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:35.393930 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eda6f117-0ccf-436b-812b-48c683b06d53 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:35.580714 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-85e1f313-5518-4cdd-97a2-db69b73d0f40 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1862267960", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "3640763f-f4c2-44a7-a718-e3c5cb52ad11"}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:33:35.674740 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-85e1f313-5518-4cdd-97a2-db69b73d0f40 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] validate_networks() for [('3640763f-f4c2-44a7-a718-e3c5cb52ad11', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:33:36.087236 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-eda6f117-0ccf-436b-812b-48c683b06d53 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ac5422c8f048148aac2c9b62e0482e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d179276dbf4e4d9cb780b18e7a22c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:36.101535 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-eda6f117-0ccf-436b-812b-48c683b06d53 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "GET /compute/v2.1/servers/9d85310b-581e-4748-b962-ab53210e15b5" status: 200 len: 1646 microversion: 2.1 time: 0.750700 Oct 30 01:33:36.102225 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2300/4581] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:35 2022] GET /compute/v2.1/servers/9d85310b-581e-4748-b962-ab53210e15b5 => generated 1646 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:36.119037 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f3057f95-1f1b-419c-ae27-e8008a6b02e7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:36.125032 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f3057f95-1f1b-419c-ae27-e8008a6b02e7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:36.152720 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3057f95-1f1b-419c-ae27-e8008a6b02e7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:36.153236 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3057f95-1f1b-419c-ae27-e8008a6b02e7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:36.153751 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3057f95-1f1b-419c-ae27-e8008a6b02e7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:36.154490 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3057f95-1f1b-419c-ae27-e8008a6b02e7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:36.159900 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3057f95-1f1b-419c-ae27-e8008a6b02e7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:36.160562 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3057f95-1f1b-419c-ae27-e8008a6b02e7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:36.912634 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f3057f95-1f1b-419c-ae27-e8008a6b02e7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:36.923157 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f3057f95-1f1b-419c-ae27-e8008a6b02e7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1530 microversion: 2.1 time: 0.819784 Oct 30 01:33:36.924671 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2301/4582] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:36 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1530 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:36.931702 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-824f0653-e405-453f-8841-1e89fd0611ea tempest-VolumesGetTestJSON-1342158773 tempest-VolumesGetTestJSON-1342158773-project] Calling method '.version_select at 0x7f44c6fde040>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:36.994220 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-824f0653-e405-453f-8841-1e89fd0611ea tempest-VolumesGetTestJSON-1342158773 tempest-VolumesGetTestJSON-1342158773-project] HTTP exception thrown: Volume 57d2a730-d794-45ba-99b1-b630639e7ff4 could not be found. Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-824f0653-e405-453f-8841-1e89fd0611ea tempest-VolumesGetTestJSON-1342158773 tempest-VolumesGetTestJSON-1342158773-project] Request method failure captured: Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/os-volumes/57d2a730-d794-45ba-99b1-b630639e7ff4 HTTP/1.1 Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdRowz3u0_JqymmZZkGhnq-7lIgRvEHyXE7sr4Op1_jUsttx3U41or_ARr_sijffUuGfN56IO_pzM4-cJ8RAiy4VsfIz6K_M2T6o5zeVtv8I-3zxR4486SAL9Rl5aDgbgUpZIXOeYfHGHW1dhP3v6glFochqqxbEigjqzJ9eE-44HJs Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 6be552db3d5c4bb08a857af240021b26 Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-VolumesGetTestJSON-1342158773 Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6be552db3d5c4bb08a857af240021b26"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6be552db3d5c4bb08a857af240021b26"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6be552db3d5c4bb08a857af240021b26"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6be552db3d5c4bb08a857af240021b26"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-VolumesGetTestJSON-1342158773 Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 6be552db3d5c4bb08a857af240021b26 Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-VolumesGetTestJSON-1342158773 Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-VolumesGetTestJSON-1342158773-project Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: de2601cd7465432284416c218b427db5 Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-VolumesGetTestJSON-1342158773-project Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: method: Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: exception: Volume 57d2a730-d794-45ba-99b1-b630639e7ff4 could not be found. Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '57d2a730-d794-45ba-99b1-b630639e7ff4'} Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 57d2a730-d794-45ba-99b1-b630639e7ff4 could not be found. (HTTP 404) (Request-ID: req-732d5de6-cdbd-4980-ba8c-e3f258922036) Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 30 01:33:37.020391 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 30 01:33:37.025259 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 30 01:33:37.025259 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 30 01:33:37.025259 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 30 01:33:37.025259 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 30 01:33:37.025259 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 30 01:33:37.025259 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 30 01:33:37.025259 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 30 01:33:37.025259 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 30 01:33:37.025259 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 30 01:33:37.025259 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 30 01:33:37.025259 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 30 01:33:37.025259 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 30 01:33:37.025259 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 30 01:33:37.025259 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 57d2a730-d794-45ba-99b1-b630639e7ff4 could not be found. Oct 30 01:33:37.025259 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:37.025259 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:37.025259 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:37.025259 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:37.025259 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:37.025259 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:37.025259 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:33:37.025259 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:33:37.025259 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:33:37.025259 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:33:37.025259 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:33:37.025259 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:33:37.025259 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 30 01:33:37.025259 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:33:37.025259 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 57d2a730-d794-45ba-99b1-b630639e7ff4 could not be found. Oct 30 01:33:37.025259 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:37.025259 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:37.025259 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:37.025259 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:37.025259 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:37.025259 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:37.025259 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:33:37.025259 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:33:37.025259 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 57d2a730-d794-45ba-99b1-b630639e7ff4 could not be found. Oct 30 01:33:37.025259 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:33:37.037082 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-824f0653-e405-453f-8841-1e89fd0611ea tempest-VolumesGetTestJSON-1342158773 tempest-VolumesGetTestJSON-1342158773-project] Returning 404 to user: Volume 57d2a730-d794-45ba-99b1-b630639e7ff4 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:33:37.042832 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-824f0653-e405-453f-8841-1e89fd0611ea tempest-VolumesGetTestJSON-1342158773 tempest-VolumesGetTestJSON-1342158773-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/57d2a730-d794-45ba-99b1-b630639e7ff4" status: 404 len: 109 microversion: 2.1 time: 0.112831 Oct 30 01:33:37.043478 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2302/4583] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 30 01:33:36 2022] GET /compute/v2.1/os-volumes/57d2a730-d794-45ba-99b1-b630639e7ff4 => generated 109 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:33:37.050661 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e403a2b8-ca40-424a-8564-e63bfec0112d tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:37.052067 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e403a2b8-ca40-424a-8564-e63bfec0112d tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] [instance: 193565f7-ccc8-4f1d-a9b3-d949e09970e8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:37.062813 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e403a2b8-ca40-424a-8564-e63bfec0112d tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:37.063840 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e403a2b8-ca40-424a-8564-e63bfec0112d tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:37.065533 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e403a2b8-ca40-424a-8564-e63bfec0112d tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:37.067443 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e403a2b8-ca40-424a-8564-e63bfec0112d tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:37.068124 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e403a2b8-ca40-424a-8564-e63bfec0112d tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:37.069857 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e403a2b8-ca40-424a-8564-e63bfec0112d tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:37.295976 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e403a2b8-ca40-424a-8564-e63bfec0112d tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:37.316778 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e403a2b8-ca40-424a-8564-e63bfec0112d tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:37.324431 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e403a2b8-ca40-424a-8564-e63bfec0112d tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:37.326854 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e403a2b8-ca40-424a-8564-e63bfec0112d tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] 10.222.0.13 "GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8" status: 200 len: 1408 microversion: 2.54 time: 0.281531 Oct 30 01:33:37.328880 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2303/4584] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:33:37 2022] GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8 => generated 1408 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:33:37.346444 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-85e1f313-5518-4cdd-97a2-db69b73d0f40 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:33:37.350723 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-85e1f313-5518-4cdd-97a2-db69b73d0f40 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:33:37.350723 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-85e1f313-5518-4cdd-97a2-db69b73d0f40 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:33:37.364575 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-85e1f313-5518-4cdd-97a2-db69b73d0f40 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:33:37.367853 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-85e1f313-5518-4cdd-97a2-db69b73d0f40 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:33:37.370940 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-23c31b69-246c-4607-b304-ea56f25c90cd req-69c700ca-418c-4e6c-8d5a-756b61122cce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d85310b-581e-4748-b962-ab53210e15b5", "name": "network-vif-deleted", "tag": "f8b486d2-42f6-477d-98fa-03d17214f6f4"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:33:37.405680 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-85e1f313-5518-4cdd-97a2-db69b73d0f40 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:37.406200 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-85e1f313-5518-4cdd-97a2-db69b73d0f40 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:37.412363 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-85e1f313-5518-4cdd-97a2-db69b73d0f40 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:37.418402 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-85e1f313-5518-4cdd-97a2-db69b73d0f40 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:37.418920 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-85e1f313-5518-4cdd-97a2-db69b73d0f40 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:37.423286 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-85e1f313-5518-4cdd-97a2-db69b73d0f40 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:37.423843 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-23c31b69-246c-4607-b304-ea56f25c90cd req-69c700ca-418c-4e6c-8d5a-756b61122cce service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:37.423843 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-23c31b69-246c-4607-b304-ea56f25c90cd req-69c700ca-418c-4e6c-8d5a-756b61122cce service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:37.427243 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-23c31b69-246c-4607-b304-ea56f25c90cd req-69c700ca-418c-4e6c-8d5a-756b61122cce service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:37.495642 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-23c31b69-246c-4607-b304-ea56f25c90cd req-69c700ca-418c-4e6c-8d5a-756b61122cce service nova] Creating event network-vif-deleted:f8b486d2-42f6-477d-98fa-03d17214f6f4 for instance 9d85310b-581e-4748-b962-ab53210e15b5 on n-h1-master-1 Oct 30 01:33:37.536774 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-23c31b69-246c-4607-b304-ea56f25c90cd req-69c700ca-418c-4e6c-8d5a-756b61122cce service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.196746 Oct 30 01:33:37.542797 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2304/4585] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:33:37.553871 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-85e1f313-5518-4cdd-97a2-db69b73d0f40 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Getting quotas for project 2b509d1b9c324201942dfeb350611a44. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:33:37.574199 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-876d5b2f-dcc8-4802-aa55-fc00e8a9bdc6 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:37.582112 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-85e1f313-5518-4cdd-97a2-db69b73d0f40 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Getting quotas for user 6f7675c0fa214588b71c04ca120557fc and project 2b509d1b9c324201942dfeb350611a44. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:33:37.582876 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-876d5b2f-dcc8-4802-aa55-fc00e8a9bdc6 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] [instance: 9d85310b-581e-4748-b962-ab53210e15b5] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:37.622432 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-876d5b2f-dcc8-4802-aa55-fc00e8a9bdc6 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:37.622951 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-876d5b2f-dcc8-4802-aa55-fc00e8a9bdc6 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:37.623399 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-876d5b2f-dcc8-4802-aa55-fc00e8a9bdc6 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:37.633952 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-876d5b2f-dcc8-4802-aa55-fc00e8a9bdc6 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:37.633952 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-876d5b2f-dcc8-4802-aa55-fc00e8a9bdc6 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:37.637083 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-876d5b2f-dcc8-4802-aa55-fc00e8a9bdc6 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:37.658340 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-85e1f313-5518-4cdd-97a2-db69b73d0f40 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Going to run 2 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:33:37.675240 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-85e1f313-5518-4cdd-97a2-db69b73d0f40 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] [instance: 0d16a8ce-36ce-488a-8782-856e088c6bc3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:33:37.755652 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-876d5b2f-dcc8-4802-aa55-fc00e8a9bdc6 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:37.758436 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-876d5b2f-dcc8-4802-aa55-fc00e8a9bdc6 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:37.759068 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-876d5b2f-dcc8-4802-aa55-fc00e8a9bdc6 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:37.760196 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-876d5b2f-dcc8-4802-aa55-fc00e8a9bdc6 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lazy-loading 'fault' on Instance uuid 9d85310b-581e-4748-b962-ab53210e15b5 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:33:37.877611 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-85e1f313-5518-4cdd-97a2-db69b73d0f40 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] [instance: 30c573b5-586e-4d4d-ad6e-d826f25374eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=0d16a8ce-36ce-488a-8782-856e088c6bc3,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:33:37.999389 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-876d5b2f-dcc8-4802-aa55-fc00e8a9bdc6 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ac5422c8f048148aac2c9b62e0482e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d179276dbf4e4d9cb780b18e7a22c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:38.011825 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-876d5b2f-dcc8-4802-aa55-fc00e8a9bdc6 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "GET /compute/v2.1/servers/9d85310b-581e-4748-b962-ab53210e15b5" status: 200 len: 1306 microversion: 2.1 time: 0.455833 Oct 30 01:33:38.018067 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2305/4586] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:37 2022] GET /compute/v2.1/servers/9d85310b-581e-4748-b962-ab53210e15b5 => generated 1306 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:38.034580 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f25da77b-acfc-45bc-ab05-92477726d71f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:38.039630 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f25da77b-acfc-45bc-ab05-92477726d71f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:38.055138 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f25da77b-acfc-45bc-ab05-92477726d71f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:38.055917 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f25da77b-acfc-45bc-ab05-92477726d71f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:38.057190 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f25da77b-acfc-45bc-ab05-92477726d71f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:38.058321 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f25da77b-acfc-45bc-ab05-92477726d71f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:38.059315 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f25da77b-acfc-45bc-ab05-92477726d71f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:38.062898 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f25da77b-acfc-45bc-ab05-92477726d71f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:38.182036 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-85e1f313-5518-4cdd-97a2-db69b73d0f40 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.818463 Oct 30 01:33:38.185963 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2282/4587] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:33:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:33:38.198354 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e702ac2e-0a8b-4e59-9424-8533730f6e0a tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:38.219601 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e702ac2e-0a8b-4e59-9424-8533730f6e0a tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6f7675c0fa214588b71c04ca120557fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b509d1b9c324201942dfeb350611a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:38.220449 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e702ac2e-0a8b-4e59-9424-8533730f6e0a tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Searching by: {'deleted': False, 'project_id': '2b509d1b9c324201942dfeb350611a44'} {{(pid=121103) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 30 01:33:38.293662 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e702ac2e-0a8b-4e59-9424-8533730f6e0a tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:38.304388 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e702ac2e-0a8b-4e59-9424-8533730f6e0a tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:38.305747 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e702ac2e-0a8b-4e59-9424-8533730f6e0a tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:38.308446 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e702ac2e-0a8b-4e59-9424-8533730f6e0a tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:38.309100 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e702ac2e-0a8b-4e59-9424-8533730f6e0a tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:38.315136 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e702ac2e-0a8b-4e59-9424-8533730f6e0a tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:38.376438 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e702ac2e-0a8b-4e59-9424-8533730f6e0a tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.183058 Oct 30 01:33:38.384888 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2283/4588] 10.222.0.13 () {58 vars in 1125 bytes} [Sun Oct 30 01:33:38 2022] GET /compute/v2.1/servers => generated 677 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:33:38.403981 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8f8f0730-9045-4ab2-af2f-ed860b711aa5 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:38.403981 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8f8f0730-9045-4ab2-af2f-ed860b711aa5 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] [instance: 193565f7-ccc8-4f1d-a9b3-d949e09970e8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:38.411177 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f8f0730-9045-4ab2-af2f-ed860b711aa5 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:38.412297 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f8f0730-9045-4ab2-af2f-ed860b711aa5 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:38.413637 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f8f0730-9045-4ab2-af2f-ed860b711aa5 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:38.414822 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f8f0730-9045-4ab2-af2f-ed860b711aa5 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:38.415509 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f8f0730-9045-4ab2-af2f-ed860b711aa5 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:38.416174 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f8f0730-9045-4ab2-af2f-ed860b711aa5 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:38.442276 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f25da77b-acfc-45bc-ab05-92477726d71f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:38.457223 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f25da77b-acfc-45bc-ab05-92477726d71f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1525 microversion: 2.1 time: 0.437508 Oct 30 01:33:38.464141 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2306/4589] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:38 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1525 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:38.477263 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ce491ae3-993a-405c-8ed3-82c48a34b075 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:38.479214 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ce491ae3-993a-405c-8ed3-82c48a34b075 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] [instance: 30c573b5-586e-4d4d-ad6e-d826f25374eb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:38.501807 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8f8f0730-9045-4ab2-af2f-ed860b711aa5 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:38.518227 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8f8f0730-9045-4ab2-af2f-ed860b711aa5 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:38.519937 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8f8f0730-9045-4ab2-af2f-ed860b711aa5 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:38.521250 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8f8f0730-9045-4ab2-af2f-ed860b711aa5 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] 10.222.0.13 "GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8" status: 200 len: 1408 microversion: 2.54 time: 0.135053 Oct 30 01:33:38.524513 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2284/4590] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:33:38 2022] GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8 => generated 1408 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:33:38.648965 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ce491ae3-993a-405c-8ed3-82c48a34b075 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7675c0fa214588b71c04ca120557fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b509d1b9c324201942dfeb350611a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:38.660928 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ce491ae3-993a-405c-8ed3-82c48a34b075 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] 10.222.0.13 "GET /compute/v2.1/servers/30c573b5-586e-4d4d-ad6e-d826f25374eb" status: 200 len: 1220 microversion: 2.1 time: 0.201969 Oct 30 01:33:38.675268 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2307/4591] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:38 2022] GET /compute/v2.1/servers/30c573b5-586e-4d4d-ad6e-d826f25374eb => generated 1220 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:39.040974 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-52ce322b-5ba1-475a-b043-93c2b9d08f75 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:39.042023 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-52ce322b-5ba1-475a-b043-93c2b9d08f75 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] [instance: 9d85310b-581e-4748-b962-ab53210e15b5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:39.050451 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52ce322b-5ba1-475a-b043-93c2b9d08f75 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:39.051187 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52ce322b-5ba1-475a-b043-93c2b9d08f75 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:39.051945 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52ce322b-5ba1-475a-b043-93c2b9d08f75 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:39.052835 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52ce322b-5ba1-475a-b043-93c2b9d08f75 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:39.054133 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52ce322b-5ba1-475a-b043-93c2b9d08f75 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:39.054731 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52ce322b-5ba1-475a-b043-93c2b9d08f75 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:39.070410 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-52ce322b-5ba1-475a-b043-93c2b9d08f75 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] HTTP exception thrown: Instance 9d85310b-581e-4748-b962-ab53210e15b5 could not be found. Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-52ce322b-5ba1-475a-b043-93c2b9d08f75 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Request method failure captured: Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/9d85310b-581e-4748-b962-ab53210e15b5 HTTP/1.1 Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdQeB_St8oVZOGIJlshgL7-LKQgW_hEcgkwBL7Ks3Cs3DIyiB0pghA7n_e8cKany7LxH4x-CEsUJ-uItmueA0KgQDZXCqg5MHQPsBAlpzbn8cQVEq-NvT-3VnV52LMp-twxBeBnfcoXgkz5UUTyaCNLN3Bidx2JUEEuK5lVXSh3eLx8 Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 09d179276dbf4e4d9cb780b18e7a22c7 Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-SecurityGroupsTestJSON-78265462 Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/09d179276dbf4e4d9cb780b18e7a22c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-SecurityGroupsTestJSON-78265462 Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 09d179276dbf4e4d9cb780b18e7a22c7 Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-78265462 Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-SecurityGroupsTestJSON-78265462-project Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 88ac5422c8f048148aac2c9b62e0482e Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-SecurityGroupsTestJSON-78265462-project Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 9d85310b-581e-4748-b962-ab53210e15b5 could not be found. Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '9d85310b-581e-4748-b962-ab53210e15b5'} Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d85310b-581e-4748-b962-ab53210e15b5 could not be found. Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d85310b-581e-4748-b962-ab53210e15b5 could not be found. Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:33:39.072611 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:39.077158 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:33:39.077158 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:33:39.077158 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:33:39.077158 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:33:39.077158 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:33:39.077158 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d85310b-581e-4748-b962-ab53210e15b5 could not be found. Oct 30 01:33:39.077158 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:33:39.078532 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-52ce322b-5ba1-475a-b043-93c2b9d08f75 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Returning 404 to user: Instance 9d85310b-581e-4748-b962-ab53210e15b5 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:33:39.079575 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-52ce322b-5ba1-475a-b043-93c2b9d08f75 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "GET /compute/v2.1/servers/9d85310b-581e-4748-b962-ab53210e15b5" status: 404 len: 111 microversion: 2.1 time: 0.043197 Oct 30 01:33:39.080650 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2285/4592] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:39 2022] GET /compute/v2.1/servers/9d85310b-581e-4748-b962-ab53210e15b5 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:33:39.089636 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-188e5ef6-8549-4608-a9e6-e39224ac2454 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '.version_select at 0x7f44cc5afaf0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:39.483959 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-14b68857-afc2-4e75-9541-669aea401d81 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:39.485665 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-14b68857-afc2-4e75-9541-669aea401d81 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:39.495879 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14b68857-afc2-4e75-9541-669aea401d81 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:39.497449 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14b68857-afc2-4e75-9541-669aea401d81 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:39.498527 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14b68857-afc2-4e75-9541-669aea401d81 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:39.499513 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14b68857-afc2-4e75-9541-669aea401d81 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:39.500570 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14b68857-afc2-4e75-9541-669aea401d81 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:39.501219 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14b68857-afc2-4e75-9541-669aea401d81 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:40.134948 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-14b68857-afc2-4e75-9541-669aea401d81 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:40.150130 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-14b68857-afc2-4e75-9541-669aea401d81 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1525 microversion: 2.1 time: 0.670166 Oct 30 01:33:40.184230 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2286/4593] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:39 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1525 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:40.209943 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-172ec79a-3aaa-4d1e-a9e4-239b3dfaee1b tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:40.213427 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-172ec79a-3aaa-4d1e-a9e4-239b3dfaee1b tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] [instance: 193565f7-ccc8-4f1d-a9b3-d949e09970e8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:40.230731 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-172ec79a-3aaa-4d1e-a9e4-239b3dfaee1b tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:40.233672 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-172ec79a-3aaa-4d1e-a9e4-239b3dfaee1b tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:40.234281 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-172ec79a-3aaa-4d1e-a9e4-239b3dfaee1b tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:40.236554 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-172ec79a-3aaa-4d1e-a9e4-239b3dfaee1b tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:40.237949 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-172ec79a-3aaa-4d1e-a9e4-239b3dfaee1b tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:40.239998 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-172ec79a-3aaa-4d1e-a9e4-239b3dfaee1b tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:40.244553 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-188e5ef6-8549-4608-a9e6-e39224ac2454 tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/7cd2ff5d-c3d0-4cee-adc4-b57dda15d063" status: 202 len: 0 microversion: 2.1 time: 1.160032 Oct 30 01:33:40.249618 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2308/4594] 10.222.0.13 () {58 vars in 1272 bytes} [Sun Oct 30 01:33:39 2022] DELETE /compute/v2.1/os-security-groups/7cd2ff5d-c3d0-4cee-adc4-b57dda15d063 => generated 0 bytes in 1166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:33:40.256357 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-20acc712-a643-446b-99e1-0ad88cdbf272 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:40.256978 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-20acc712-a643-446b-99e1-0ad88cdbf272 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] [instance: 30c573b5-586e-4d4d-ad6e-d826f25374eb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:40.580184 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-172ec79a-3aaa-4d1e-a9e4-239b3dfaee1b tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:40.580724 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-20acc712-a643-446b-99e1-0ad88cdbf272 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7675c0fa214588b71c04ca120557fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b509d1b9c324201942dfeb350611a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:40.589270 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-172ec79a-3aaa-4d1e-a9e4-239b3dfaee1b tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:40.590781 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-172ec79a-3aaa-4d1e-a9e4-239b3dfaee1b tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:40.591464 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-20acc712-a643-446b-99e1-0ad88cdbf272 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] 10.222.0.13 "GET /compute/v2.1/servers/30c573b5-586e-4d4d-ad6e-d826f25374eb" status: 200 len: 1220 microversion: 2.1 time: 0.339724 Oct 30 01:33:40.591983 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-172ec79a-3aaa-4d1e-a9e4-239b3dfaee1b tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] 10.222.0.13 "GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8" status: 200 len: 1408 microversion: 2.54 time: 0.406651 Oct 30 01:33:40.592862 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2309/4595] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:40 2022] GET /compute/v2.1/servers/30c573b5-586e-4d4d-ad6e-d826f25374eb => generated 1220 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:40.600978 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-68e8a851-1dcd-4e29-b18c-2118598f5a90 req-963689e2-2994-43ff-afa1-d9eda8c4847b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c51345-2948-4ff1-828f-8c70b2b979f2", "name": "network-vif-plugged", "status": "completed", "tag": "25297f9d-e65e-44db-bc94-b8ade234295f"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:33:40.604899 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2287/4596] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:33:40 2022] GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8 => generated 1408 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:33:40.618111 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-68e8a851-1dcd-4e29-b18c-2118598f5a90 req-963689e2-2994-43ff-afa1-d9eda8c4847b service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:40.619135 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-68e8a851-1dcd-4e29-b18c-2118598f5a90 req-963689e2-2994-43ff-afa1-d9eda8c4847b service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:40.619861 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-68e8a851-1dcd-4e29-b18c-2118598f5a90 req-963689e2-2994-43ff-afa1-d9eda8c4847b service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:40.632245 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2c97af2c-6a2d-42aa-b0f9-39588511cddc tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] Calling method '.version_select at 0x7f44c6fa95e0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:40.639470 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-68e8a851-1dcd-4e29-b18c-2118598f5a90 req-963689e2-2994-43ff-afa1-d9eda8c4847b service nova] Creating event network-vif-plugged:25297f9d-e65e-44db-bc94-b8ade234295f for instance b0c51345-2948-4ff1-828f-8c70b2b979f2 on n-h2-master-1 Oct 30 01:33:40.647581 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-68e8a851-1dcd-4e29-b18c-2118598f5a90 req-963689e2-2994-43ff-afa1-d9eda8c4847b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051342 Oct 30 01:33:40.649242 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2310/4597] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:33:41.167692 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2c97af2c-6a2d-42aa-b0f9-39588511cddc tempest-SecurityGroupsTestJSON-78265462 tempest-SecurityGroupsTestJSON-78265462-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/bac9266f-d5d4-4753-8caa-9974065dc424" status: 202 len: 0 microversion: 2.1 time: 0.540537 Oct 30 01:33:41.168349 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2288/4598] 10.222.0.13 () {58 vars in 1272 bytes} [Sun Oct 30 01:33:40 2022] DELETE /compute/v2.1/os-security-groups/bac9266f-d5d4-4753-8caa-9974065dc424 => generated 0 bytes in 563 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:33:41.182298 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-22f7415c-5d7f-4fae-af94-b6c99ded6ae5 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:41.185824 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-22f7415c-5d7f-4fae-af94-b6c99ded6ae5 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:41.198480 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-22f7415c-5d7f-4fae-af94-b6c99ded6ae5 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:41.202259 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-22f7415c-5d7f-4fae-af94-b6c99ded6ae5 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:41.205024 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-22f7415c-5d7f-4fae-af94-b6c99ded6ae5 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:41.205945 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-22f7415c-5d7f-4fae-af94-b6c99ded6ae5 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:41.208628 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-22f7415c-5d7f-4fae-af94-b6c99ded6ae5 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:41.209565 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-22f7415c-5d7f-4fae-af94-b6c99ded6ae5 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:41.624514 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-94c02385-f6b3-4edb-b664-dd0d293b682d tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:41.641195 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-94c02385-f6b3-4edb-b664-dd0d293b682d tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] [instance: 193565f7-ccc8-4f1d-a9b3-d949e09970e8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:41.654119 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94c02385-f6b3-4edb-b664-dd0d293b682d tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:41.666065 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94c02385-f6b3-4edb-b664-dd0d293b682d tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:41.666591 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94c02385-f6b3-4edb-b664-dd0d293b682d tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:41.667419 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94c02385-f6b3-4edb-b664-dd0d293b682d tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:41.667858 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94c02385-f6b3-4edb-b664-dd0d293b682d tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:41.668291 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94c02385-f6b3-4edb-b664-dd0d293b682d tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:42.351215 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-94c02385-f6b3-4edb-b664-dd0d293b682d tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:42.410806 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-94c02385-f6b3-4edb-b664-dd0d293b682d tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:42.421472 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-94c02385-f6b3-4edb-b664-dd0d293b682d tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:42.428740 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-94c02385-f6b3-4edb-b664-dd0d293b682d tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] 10.222.0.13 "GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8" status: 200 len: 1408 microversion: 2.54 time: 0.810599 Oct 30 01:33:42.441584 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2289/4599] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:33:41 2022] GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8 => generated 1408 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:33:42.458577 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e2a6ec39-7a4b-4a83-98e3-8762f964df20 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:42.459749 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e2a6ec39-7a4b-4a83-98e3-8762f964df20 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] [instance: 30c573b5-586e-4d4d-ad6e-d826f25374eb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:42.490466 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2a6ec39-7a4b-4a83-98e3-8762f964df20 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:42.491345 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2a6ec39-7a4b-4a83-98e3-8762f964df20 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:42.493239 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2a6ec39-7a4b-4a83-98e3-8762f964df20 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:42.498102 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2a6ec39-7a4b-4a83-98e3-8762f964df20 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:42.498612 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2a6ec39-7a4b-4a83-98e3-8762f964df20 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:42.499059 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2a6ec39-7a4b-4a83-98e3-8762f964df20 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:42.791275 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e2a6ec39-7a4b-4a83-98e3-8762f964df20 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7675c0fa214588b71c04ca120557fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b509d1b9c324201942dfeb350611a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:42.805810 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e2a6ec39-7a4b-4a83-98e3-8762f964df20 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] 10.222.0.13 "GET /compute/v2.1/servers/30c573b5-586e-4d4d-ad6e-d826f25374eb" status: 200 len: 1272 microversion: 2.1 time: 0.368225 Oct 30 01:33:42.808375 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2290/4600] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:42 2022] GET /compute/v2.1/servers/30c573b5-586e-4d4d-ad6e-d826f25374eb => generated 1272 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:42.956630 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-22f7415c-5d7f-4fae-af94-b6c99ded6ae5 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:42.979911 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-22f7415c-5d7f-4fae-af94-b6c99ded6ae5 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1525 microversion: 2.1 time: 1.803292 Oct 30 01:33:42.984065 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2311/4601] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:41 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1525 bytes in 1808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:43.458312 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-827cb8a7-1c7c-475c-955a-2d43ada84632 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:43.460237 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-827cb8a7-1c7c-475c-955a-2d43ada84632 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] [instance: 193565f7-ccc8-4f1d-a9b3-d949e09970e8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:43.485555 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-827cb8a7-1c7c-475c-955a-2d43ada84632 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:43.494932 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-827cb8a7-1c7c-475c-955a-2d43ada84632 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:43.495780 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-827cb8a7-1c7c-475c-955a-2d43ada84632 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:43.496905 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-827cb8a7-1c7c-475c-955a-2d43ada84632 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:43.504899 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-827cb8a7-1c7c-475c-955a-2d43ada84632 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:43.508136 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-827cb8a7-1c7c-475c-955a-2d43ada84632 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:43.523581 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:43.833944 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c74718ff-7037-42a3-b605-a0b6505219ec tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:43.838446 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c74718ff-7037-42a3-b605-a0b6505219ec tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] [instance: 30c573b5-586e-4d4d-ad6e-d826f25374eb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:43.850859 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c74718ff-7037-42a3-b605-a0b6505219ec tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:43.853476 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c74718ff-7037-42a3-b605-a0b6505219ec tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:43.858229 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c74718ff-7037-42a3-b605-a0b6505219ec tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:43.860726 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c74718ff-7037-42a3-b605-a0b6505219ec tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:43.861469 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c74718ff-7037-42a3-b605-a0b6505219ec tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:43.864035 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c74718ff-7037-42a3-b605-a0b6505219ec tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:44.298313 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-827cb8a7-1c7c-475c-955a-2d43ada84632 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:44.299675 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c74718ff-7037-42a3-b605-a0b6505219ec tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7675c0fa214588b71c04ca120557fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b509d1b9c324201942dfeb350611a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:44.309027 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-827cb8a7-1c7c-475c-955a-2d43ada84632 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:44.311675 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c74718ff-7037-42a3-b605-a0b6505219ec tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] 10.222.0.13 "GET /compute/v2.1/servers/30c573b5-586e-4d4d-ad6e-d826f25374eb" status: 200 len: 1290 microversion: 2.1 time: 0.483241 Oct 30 01:33:44.312164 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2312/4602] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:43 2022] GET /compute/v2.1/servers/30c573b5-586e-4d4d-ad6e-d826f25374eb => generated 1290 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:33:44.313111 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-827cb8a7-1c7c-475c-955a-2d43ada84632 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:44.314419 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-827cb8a7-1c7c-475c-955a-2d43ada84632 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] 10.222.0.13 "GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8" status: 200 len: 1408 microversion: 2.54 time: 0.860393 Oct 30 01:33:44.324030 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b5dd0719-28bb-474b-8569-f63f35d442ac tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:44.324676 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b5dd0719-28bb-474b-8569-f63f35d442ac tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:44.337035 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2291/4603] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:33:43 2022] GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8 => generated 1408 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:33:44.343819 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b5dd0719-28bb-474b-8569-f63f35d442ac tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:44.344316 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b5dd0719-28bb-474b-8569-f63f35d442ac tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:44.344840 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b5dd0719-28bb-474b-8569-f63f35d442ac tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:44.347194 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b5dd0719-28bb-474b-8569-f63f35d442ac tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:44.347670 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b5dd0719-28bb-474b-8569-f63f35d442ac tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:44.349254 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b5dd0719-28bb-474b-8569-f63f35d442ac tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:44.859081 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b5dd0719-28bb-474b-8569-f63f35d442ac tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:44.872031 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b5dd0719-28bb-474b-8569-f63f35d442ac tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1525 microversion: 2.1 time: 0.558768 Oct 30 01:33:44.906638 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2313/4604] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:44 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1525 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:45.335734 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-77bb88f7-ca36-4ce3-99ee-1645a1912c0f tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:45.336374 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-77bb88f7-ca36-4ce3-99ee-1645a1912c0f tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] [instance: 30c573b5-586e-4d4d-ad6e-d826f25374eb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:45.347558 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c863401c-8923-436a-9bc6-34827a8195d6 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:45.348978 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c863401c-8923-436a-9bc6-34827a8195d6 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] [instance: 193565f7-ccc8-4f1d-a9b3-d949e09970e8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:45.364879 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-77bb88f7-ca36-4ce3-99ee-1645a1912c0f tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:45.365130 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c863401c-8923-436a-9bc6-34827a8195d6 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:45.366654 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c863401c-8923-436a-9bc6-34827a8195d6 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:45.369405 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c863401c-8923-436a-9bc6-34827a8195d6 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:45.370413 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c863401c-8923-436a-9bc6-34827a8195d6 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:45.371241 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c863401c-8923-436a-9bc6-34827a8195d6 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:45.371901 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c863401c-8923-436a-9bc6-34827a8195d6 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:45.372096 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-77bb88f7-ca36-4ce3-99ee-1645a1912c0f tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:45.372560 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-77bb88f7-ca36-4ce3-99ee-1645a1912c0f tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:45.373316 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-77bb88f7-ca36-4ce3-99ee-1645a1912c0f tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:45.373803 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-77bb88f7-ca36-4ce3-99ee-1645a1912c0f tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:45.378245 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-77bb88f7-ca36-4ce3-99ee-1645a1912c0f tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:45.625516 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c863401c-8923-436a-9bc6-34827a8195d6 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:45.663046 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c863401c-8923-436a-9bc6-34827a8195d6 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:45.664691 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c863401c-8923-436a-9bc6-34827a8195d6 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:45.678744 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c863401c-8923-436a-9bc6-34827a8195d6 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] 10.222.0.13 "GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8" status: 200 len: 1408 microversion: 2.54 time: 0.337351 Oct 30 01:33:45.697041 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2314/4605] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:33:45 2022] GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8 => generated 1408 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:33:45.760551 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-77bb88f7-ca36-4ce3-99ee-1645a1912c0f tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7675c0fa214588b71c04ca120557fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b509d1b9c324201942dfeb350611a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:45.790016 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-77bb88f7-ca36-4ce3-99ee-1645a1912c0f tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] 10.222.0.13 "GET /compute/v2.1/servers/30c573b5-586e-4d4d-ad6e-d826f25374eb" status: 200 len: 1278 microversion: 2.1 time: 0.458563 Oct 30 01:33:45.790639 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2292/4606] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:45 2022] GET /compute/v2.1/servers/30c573b5-586e-4d4d-ad6e-d826f25374eb => generated 1278 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:45.899078 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fbe21486-8684-4436-9d4d-ddec4610097d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:45.899880 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fbe21486-8684-4436-9d4d-ddec4610097d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:45.916079 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fbe21486-8684-4436-9d4d-ddec4610097d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:45.916795 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fbe21486-8684-4436-9d4d-ddec4610097d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:45.917477 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fbe21486-8684-4436-9d4d-ddec4610097d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:45.918811 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fbe21486-8684-4436-9d4d-ddec4610097d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:45.919508 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fbe21486-8684-4436-9d4d-ddec4610097d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:45.920156 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fbe21486-8684-4436-9d4d-ddec4610097d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:46.347105 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-fbe21486-8684-4436-9d4d-ddec4610097d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:46.363281 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fbe21486-8684-4436-9d4d-ddec4610097d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1525 microversion: 2.1 time: 0.470679 Oct 30 01:33:46.375387 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2315/4607] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:45 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1525 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:33:46.707528 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-161c744a-080a-45f8-b96b-2af1b4c84be5 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:46.709302 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-161c744a-080a-45f8-b96b-2af1b4c84be5 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] [instance: 193565f7-ccc8-4f1d-a9b3-d949e09970e8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:46.731863 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-161c744a-080a-45f8-b96b-2af1b4c84be5 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:46.742112 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-161c744a-080a-45f8-b96b-2af1b4c84be5 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:46.745757 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-161c744a-080a-45f8-b96b-2af1b4c84be5 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:46.748547 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-161c744a-080a-45f8-b96b-2af1b4c84be5 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:46.751432 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-161c744a-080a-45f8-b96b-2af1b4c84be5 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:46.753532 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-161c744a-080a-45f8-b96b-2af1b4c84be5 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:46.819426 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0cf7b1a5-c8d9-4bc7-ad0f-e9ae78ed4ce1 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:46.820106 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0cf7b1a5-c8d9-4bc7-ad0f-e9ae78ed4ce1 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] [instance: 30c573b5-586e-4d4d-ad6e-d826f25374eb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:46.846463 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0cf7b1a5-c8d9-4bc7-ad0f-e9ae78ed4ce1 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:46.848786 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0cf7b1a5-c8d9-4bc7-ad0f-e9ae78ed4ce1 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:46.849508 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0cf7b1a5-c8d9-4bc7-ad0f-e9ae78ed4ce1 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:46.851779 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0cf7b1a5-c8d9-4bc7-ad0f-e9ae78ed4ce1 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:46.852904 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0cf7b1a5-c8d9-4bc7-ad0f-e9ae78ed4ce1 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:46.855353 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0cf7b1a5-c8d9-4bc7-ad0f-e9ae78ed4ce1 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:47.213513 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-161c744a-080a-45f8-b96b-2af1b4c84be5 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:47.223923 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-161c744a-080a-45f8-b96b-2af1b4c84be5 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:47.227896 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-161c744a-080a-45f8-b96b-2af1b4c84be5 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:47.235492 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-161c744a-080a-45f8-b96b-2af1b4c84be5 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] 10.222.0.13 "GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8" status: 200 len: 1408 microversion: 2.54 time: 0.535063 Oct 30 01:33:47.236610 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2293/4608] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:33:46 2022] GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8 => generated 1408 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:33:47.388123 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7bdeba7d-0867-4d2c-9566-ae6edb561e94 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:47.388938 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7bdeba7d-0867-4d2c-9566-ae6edb561e94 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:47.396855 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7bdeba7d-0867-4d2c-9566-ae6edb561e94 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:47.406123 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7bdeba7d-0867-4d2c-9566-ae6edb561e94 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:47.406819 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7bdeba7d-0867-4d2c-9566-ae6edb561e94 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:47.407738 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7bdeba7d-0867-4d2c-9566-ae6edb561e94 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:47.408364 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7bdeba7d-0867-4d2c-9566-ae6edb561e94 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:47.408948 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7bdeba7d-0867-4d2c-9566-ae6edb561e94 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:47.513153 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0cf7b1a5-c8d9-4bc7-ad0f-e9ae78ed4ce1 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7675c0fa214588b71c04ca120557fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b509d1b9c324201942dfeb350611a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:47.525002 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0cf7b1a5-c8d9-4bc7-ad0f-e9ae78ed4ce1 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] 10.222.0.13 "GET /compute/v2.1/servers/30c573b5-586e-4d4d-ad6e-d826f25374eb" status: 200 len: 1320 microversion: 2.1 time: 0.706913 Oct 30 01:33:47.526006 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2316/4609] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:46 2022] GET /compute/v2.1/servers/30c573b5-586e-4d4d-ad6e-d826f25374eb => generated 1320 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:33:47.629562 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=18 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:47.762659 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7bdeba7d-0867-4d2c-9566-ae6edb561e94 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:47.775512 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7bdeba7d-0867-4d2c-9566-ae6edb561e94 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1525 microversion: 2.1 time: 0.391437 Oct 30 01:33:47.776094 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2294/4610] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:47 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1525 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:33:48.268395 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c02b1be3-6cee-4f85-b658-81cfb085e440 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:48.268395 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c02b1be3-6cee-4f85-b658-81cfb085e440 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] [instance: 193565f7-ccc8-4f1d-a9b3-d949e09970e8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:48.277365 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c02b1be3-6cee-4f85-b658-81cfb085e440 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:48.278743 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c02b1be3-6cee-4f85-b658-81cfb085e440 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:48.279946 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c02b1be3-6cee-4f85-b658-81cfb085e440 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:48.282316 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c02b1be3-6cee-4f85-b658-81cfb085e440 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:48.284892 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c02b1be3-6cee-4f85-b658-81cfb085e440 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:48.287163 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c02b1be3-6cee-4f85-b658-81cfb085e440 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:48.551592 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2baa482f-1dd3-4589-bd8f-4d2685696360 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:48.553130 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2baa482f-1dd3-4589-bd8f-4d2685696360 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] [instance: 30c573b5-586e-4d4d-ad6e-d826f25374eb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:48.564926 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=4 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:48.578571 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2baa482f-1dd3-4589-bd8f-4d2685696360 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:48.579457 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2baa482f-1dd3-4589-bd8f-4d2685696360 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:48.580691 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2baa482f-1dd3-4589-bd8f-4d2685696360 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:48.581664 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2baa482f-1dd3-4589-bd8f-4d2685696360 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:48.584403 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2baa482f-1dd3-4589-bd8f-4d2685696360 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:48.585158 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2baa482f-1dd3-4589-bd8f-4d2685696360 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:49.070199 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c02b1be3-6cee-4f85-b658-81cfb085e440 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:49.089786 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c02b1be3-6cee-4f85-b658-81cfb085e440 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:49.094606 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c02b1be3-6cee-4f85-b658-81cfb085e440 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:49.100221 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c02b1be3-6cee-4f85-b658-81cfb085e440 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] 10.222.0.13 "GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8" status: 200 len: 1408 microversion: 2.54 time: 0.839380 Oct 30 01:33:49.115053 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2317/4611] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:33:48 2022] GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8 => generated 1408 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:33:49.121797 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b53f3518-346e-4e94-8755-1ad0a5b68e22 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:49.124804 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b53f3518-346e-4e94-8755-1ad0a5b68e22 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:49.147242 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b53f3518-346e-4e94-8755-1ad0a5b68e22 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:49.150754 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b53f3518-346e-4e94-8755-1ad0a5b68e22 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:49.151381 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b53f3518-346e-4e94-8755-1ad0a5b68e22 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:49.152253 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b53f3518-346e-4e94-8755-1ad0a5b68e22 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:49.153592 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b53f3518-346e-4e94-8755-1ad0a5b68e22 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:49.155621 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b53f3518-346e-4e94-8755-1ad0a5b68e22 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:49.605122 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2baa482f-1dd3-4589-bd8f-4d2685696360 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7675c0fa214588b71c04ca120557fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b509d1b9c324201942dfeb350611a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:49.620258 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2baa482f-1dd3-4589-bd8f-4d2685696360 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] 10.222.0.13 "GET /compute/v2.1/servers/30c573b5-586e-4d4d-ad6e-d826f25374eb" status: 200 len: 1320 microversion: 2.1 time: 1.075404 Oct 30 01:33:49.628359 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2295/4612] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:48 2022] GET /compute/v2.1/servers/30c573b5-586e-4d4d-ad6e-d826f25374eb => generated 1320 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:33:49.706658 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b53f3518-346e-4e94-8755-1ad0a5b68e22 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:49.710299 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:49.726429 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b53f3518-346e-4e94-8755-1ad0a5b68e22 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1525 microversion: 2.1 time: 0.611940 Oct 30 01:33:49.731036 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2318/4613] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:49 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1525 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:50.142580 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2ea10570-d651-46cc-95bb-350a06721219 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:50.143207 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2ea10570-d651-46cc-95bb-350a06721219 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] [instance: 193565f7-ccc8-4f1d-a9b3-d949e09970e8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:50.159675 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2ea10570-d651-46cc-95bb-350a06721219 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:50.161595 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2ea10570-d651-46cc-95bb-350a06721219 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:50.164939 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2ea10570-d651-46cc-95bb-350a06721219 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:50.165939 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2ea10570-d651-46cc-95bb-350a06721219 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:50.167195 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2ea10570-d651-46cc-95bb-350a06721219 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:50.168499 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2ea10570-d651-46cc-95bb-350a06721219 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:50.659830 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8fe21f79-70ea-4e5f-a118-433e64cfffcc tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:50.659830 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8fe21f79-70ea-4e5f-a118-433e64cfffcc tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] [instance: 30c573b5-586e-4d4d-ad6e-d826f25374eb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:50.659830 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=4 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:50.677424 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8fe21f79-70ea-4e5f-a118-433e64cfffcc tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:50.680759 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8fe21f79-70ea-4e5f-a118-433e64cfffcc tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:50.682487 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8fe21f79-70ea-4e5f-a118-433e64cfffcc tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:50.685000 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8fe21f79-70ea-4e5f-a118-433e64cfffcc tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:50.686262 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8fe21f79-70ea-4e5f-a118-433e64cfffcc tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:50.687783 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8fe21f79-70ea-4e5f-a118-433e64cfffcc tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:51.102535 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2ea10570-d651-46cc-95bb-350a06721219 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:51.114227 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2ea10570-d651-46cc-95bb-350a06721219 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:51.126785 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2ea10570-d651-46cc-95bb-350a06721219 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:51.128432 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2ea10570-d651-46cc-95bb-350a06721219 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] 10.222.0.13 "GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8" status: 200 len: 1408 microversion: 2.54 time: 0.990116 Oct 30 01:33:51.131979 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2296/4614] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:33:50 2022] GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8 => generated 1408 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:33:51.148154 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e03c1985-e239-49e9-b580-993c3a5e32fc tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:51.150328 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e03c1985-e239-49e9-b580-993c3a5e32fc tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:51.186152 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e03c1985-e239-49e9-b580-993c3a5e32fc tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:51.188581 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e03c1985-e239-49e9-b580-993c3a5e32fc tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:51.189554 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e03c1985-e239-49e9-b580-993c3a5e32fc tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:51.204767 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e03c1985-e239-49e9-b580-993c3a5e32fc tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:51.206759 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e03c1985-e239-49e9-b580-993c3a5e32fc tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:51.219874 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e03c1985-e239-49e9-b580-993c3a5e32fc tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:51.484320 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8fe21f79-70ea-4e5f-a118-433e64cfffcc tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7675c0fa214588b71c04ca120557fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b509d1b9c324201942dfeb350611a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:51.495575 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8fe21f79-70ea-4e5f-a118-433e64cfffcc tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] 10.222.0.13 "GET /compute/v2.1/servers/30c573b5-586e-4d4d-ad6e-d826f25374eb" status: 200 len: 1320 microversion: 2.1 time: 0.847270 Oct 30 01:33:51.500340 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2319/4615] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:50 2022] GET /compute/v2.1/servers/30c573b5-586e-4d4d-ad6e-d826f25374eb => generated 1320 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:51.669679 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e03c1985-e239-49e9-b580-993c3a5e32fc tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:51.679193 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e03c1985-e239-49e9-b580-993c3a5e32fc tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1525 microversion: 2.1 time: 0.545928 Oct 30 01:33:51.680094 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2297/4616] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:51 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1525 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:51.856011 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-a1161b46-fe61-42b5-8ba4-384a7eeee2f4 req-39097206-0388-4eb1-9f1b-5a39c46fc9f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30c573b5-586e-4d4d-ad6e-d826f25374eb", "tag": "38cbaa97-b07f-4c77-86ad-8e026e45fd37"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:33:51.913012 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-a1161b46-fe61-42b5-8ba4-384a7eeee2f4 req-39097206-0388-4eb1-9f1b-5a39c46fc9f2 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:51.913625 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-a1161b46-fe61-42b5-8ba4-384a7eeee2f4 req-39097206-0388-4eb1-9f1b-5a39c46fc9f2 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:51.917168 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-a1161b46-fe61-42b5-8ba4-384a7eeee2f4 req-39097206-0388-4eb1-9f1b-5a39c46fc9f2 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:51.940218 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-a1161b46-fe61-42b5-8ba4-384a7eeee2f4 req-39097206-0388-4eb1-9f1b-5a39c46fc9f2 service nova] Creating event network-changed:38cbaa97-b07f-4c77-86ad-8e026e45fd37 for instance 30c573b5-586e-4d4d-ad6e-d826f25374eb on n-h1-master-1 Oct 30 01:33:51.965157 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-a1161b46-fe61-42b5-8ba4-384a7eeee2f4 req-39097206-0388-4eb1-9f1b-5a39c46fc9f2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113250 Oct 30 01:33:51.968489 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2320/4617] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:33:52.157753 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f54ae82f-b931-4bed-a8a1-be14ca1a4be3 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:52.158360 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f54ae82f-b931-4bed-a8a1-be14ca1a4be3 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] [instance: 193565f7-ccc8-4f1d-a9b3-d949e09970e8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:52.172454 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f54ae82f-b931-4bed-a8a1-be14ca1a4be3 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:52.174110 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f54ae82f-b931-4bed-a8a1-be14ca1a4be3 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:52.175203 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f54ae82f-b931-4bed-a8a1-be14ca1a4be3 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:52.181501 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f54ae82f-b931-4bed-a8a1-be14ca1a4be3 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:52.182441 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f54ae82f-b931-4bed-a8a1-be14ca1a4be3 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:52.183567 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f54ae82f-b931-4bed-a8a1-be14ca1a4be3 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:52.521568 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6cb7a11b-704c-4062-8d18-dc27868f5ae6 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:52.522734 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6cb7a11b-704c-4062-8d18-dc27868f5ae6 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] [instance: 30c573b5-586e-4d4d-ad6e-d826f25374eb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:52.540901 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6cb7a11b-704c-4062-8d18-dc27868f5ae6 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:52.541453 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6cb7a11b-704c-4062-8d18-dc27868f5ae6 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:52.550385 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6cb7a11b-704c-4062-8d18-dc27868f5ae6 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:52.556491 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6cb7a11b-704c-4062-8d18-dc27868f5ae6 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:52.557324 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6cb7a11b-704c-4062-8d18-dc27868f5ae6 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:52.557672 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6cb7a11b-704c-4062-8d18-dc27868f5ae6 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:52.641656 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f54ae82f-b931-4bed-a8a1-be14ca1a4be3 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:52.672644 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f54ae82f-b931-4bed-a8a1-be14ca1a4be3 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:52.677012 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f54ae82f-b931-4bed-a8a1-be14ca1a4be3 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:52.688937 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f54ae82f-b931-4bed-a8a1-be14ca1a4be3 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] 10.222.0.13 "GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8" status: 200 len: 1408 microversion: 2.54 time: 0.531661 Oct 30 01:33:52.691729 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2298/4618] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:33:52 2022] GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8 => generated 1408 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:33:52.709564 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-10d58616-ac46-464a-964a-91a667b15ad3 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:52.712379 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-10d58616-ac46-464a-964a-91a667b15ad3 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:52.748889 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-10d58616-ac46-464a-964a-91a667b15ad3 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:52.756306 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-10d58616-ac46-464a-964a-91a667b15ad3 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:52.756864 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-10d58616-ac46-464a-964a-91a667b15ad3 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:52.758279 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-10d58616-ac46-464a-964a-91a667b15ad3 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:52.758766 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-10d58616-ac46-464a-964a-91a667b15ad3 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:52.759197 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-10d58616-ac46-464a-964a-91a667b15ad3 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:53.325783 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6cb7a11b-704c-4062-8d18-dc27868f5ae6 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7675c0fa214588b71c04ca120557fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b509d1b9c324201942dfeb350611a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:53.332146 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6cb7a11b-704c-4062-8d18-dc27868f5ae6 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] 10.222.0.13 "GET /compute/v2.1/servers/30c573b5-586e-4d4d-ad6e-d826f25374eb" status: 200 len: 1320 microversion: 2.1 time: 0.815285 Oct 30 01:33:53.338061 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2321/4619] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:52 2022] GET /compute/v2.1/servers/30c573b5-586e-4d4d-ad6e-d826f25374eb => generated 1320 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:53.576196 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-10d58616-ac46-464a-964a-91a667b15ad3 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:53.582300 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-10d58616-ac46-464a-964a-91a667b15ad3 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1525 microversion: 2.1 time: 0.882363 Oct 30 01:33:53.598053 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2299/4620] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:52 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1525 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:33:53.723043 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d80946eb-fd0d-4499-988f-345e19e40426 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:53.731245 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d80946eb-fd0d-4499-988f-345e19e40426 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] [instance: 193565f7-ccc8-4f1d-a9b3-d949e09970e8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:53.759764 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:53.761326 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d80946eb-fd0d-4499-988f-345e19e40426 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:53.764542 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d80946eb-fd0d-4499-988f-345e19e40426 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:53.765541 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d80946eb-fd0d-4499-988f-345e19e40426 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:53.767578 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d80946eb-fd0d-4499-988f-345e19e40426 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:53.768698 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d80946eb-fd0d-4499-988f-345e19e40426 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:53.769770 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d80946eb-fd0d-4499-988f-345e19e40426 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:54.032819 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d80946eb-fd0d-4499-988f-345e19e40426 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:54.186596 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d80946eb-fd0d-4499-988f-345e19e40426 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:54.186596 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d80946eb-fd0d-4499-988f-345e19e40426 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:54.186596 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d80946eb-fd0d-4499-988f-345e19e40426 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] 10.222.0.13 "GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8" status: 200 len: 1408 microversion: 2.54 time: 0.332495 Oct 30 01:33:54.186596 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2322/4621] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:33:53 2022] GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8 => generated 1408 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:33:54.355315 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1210bcb7-653d-49e3-9a16-46f2c34f61ad tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:54.355932 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1210bcb7-653d-49e3-9a16-46f2c34f61ad tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] [instance: 30c573b5-586e-4d4d-ad6e-d826f25374eb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:54.362989 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1210bcb7-653d-49e3-9a16-46f2c34f61ad tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:54.363481 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1210bcb7-653d-49e3-9a16-46f2c34f61ad tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:54.363915 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1210bcb7-653d-49e3-9a16-46f2c34f61ad tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:54.365180 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1210bcb7-653d-49e3-9a16-46f2c34f61ad tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:54.365643 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1210bcb7-653d-49e3-9a16-46f2c34f61ad tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:54.366072 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1210bcb7-653d-49e3-9a16-46f2c34f61ad tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:54.387071 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-9c46a9f1-b2c5-45ef-83f0-5eb1b98f61d8 req-f0b22365-8e78-4038-94d4-b5f33e9401da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d16a8ce-36ce-488a-8782-856e088c6bc3", "tag": "12eb42af-7e14-4d06-bfa6-e68587427952"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:33:54.406166 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-9c46a9f1-b2c5-45ef-83f0-5eb1b98f61d8 req-f0b22365-8e78-4038-94d4-b5f33e9401da service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:54.407051 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-9c46a9f1-b2c5-45ef-83f0-5eb1b98f61d8 req-f0b22365-8e78-4038-94d4-b5f33e9401da service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:54.407830 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-9c46a9f1-b2c5-45ef-83f0-5eb1b98f61d8 req-f0b22365-8e78-4038-94d4-b5f33e9401da service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:54.434378 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-9c46a9f1-b2c5-45ef-83f0-5eb1b98f61d8 req-f0b22365-8e78-4038-94d4-b5f33e9401da service nova] Creating event network-changed:12eb42af-7e14-4d06-bfa6-e68587427952 for instance 0d16a8ce-36ce-488a-8782-856e088c6bc3 on n-h1-master-1 Oct 30 01:33:54.442261 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-9c46a9f1-b2c5-45ef-83f0-5eb1b98f61d8 req-f0b22365-8e78-4038-94d4-b5f33e9401da service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059793 Oct 30 01:33:54.443620 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2323/4622] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:33:54.919345 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-182bdfa4-ff89-4aaa-97b2-d278965d52a1 tempest-PortsAdminExtendedAttrsTestJSON-1349295598 tempest-PortsAdminExtendedAttrsTestJSON-1349295598-project-admin] Calling method '.version_select at 0x7f44d02bbe50>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:54.925284 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-182bdfa4-ff89-4aaa-97b2-d278965d52a1 tempest-PortsAdminExtendedAttrsTestJSON-1349295598 tempest-PortsAdminExtendedAttrsTestJSON-1349295598-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:54.927145 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-182bdfa4-ff89-4aaa-97b2-d278965d52a1 tempest-PortsAdminExtendedAttrsTestJSON-1349295598 tempest-PortsAdminExtendedAttrsTestJSON-1349295598-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:54.930879 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-182bdfa4-ff89-4aaa-97b2-d278965d52a1 tempest-PortsAdminExtendedAttrsTestJSON-1349295598 tempest-PortsAdminExtendedAttrsTestJSON-1349295598-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:54.939749 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1210bcb7-653d-49e3-9a16-46f2c34f61ad tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7675c0fa214588b71c04ca120557fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b509d1b9c324201942dfeb350611a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:54.950637 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1210bcb7-653d-49e3-9a16-46f2c34f61ad tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] 10.222.0.13 "GET /compute/v2.1/servers/30c573b5-586e-4d4d-ad6e-d826f25374eb" status: 200 len: 1320 microversion: 2.1 time: 0.599258 Oct 30 01:33:54.952576 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2300/4623] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:54 2022] GET /compute/v2.1/servers/30c573b5-586e-4d4d-ad6e-d826f25374eb => generated 1320 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:54.966081 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f2c42a39-8c83-4562-9975-17b00c20f55e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:54.966655 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f2c42a39-8c83-4562-9975-17b00c20f55e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:54.970292 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-182bdfa4-ff89-4aaa-97b2-d278965d52a1 tempest-PortsAdminExtendedAttrsTestJSON-1349295598 tempest-PortsAdminExtendedAttrsTestJSON-1349295598-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:54.972327 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-182bdfa4-ff89-4aaa-97b2-d278965d52a1 tempest-PortsAdminExtendedAttrsTestJSON-1349295598 tempest-PortsAdminExtendedAttrsTestJSON-1349295598-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:54.975795 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-182bdfa4-ff89-4aaa-97b2-d278965d52a1 tempest-PortsAdminExtendedAttrsTestJSON-1349295598 tempest-PortsAdminExtendedAttrsTestJSON-1349295598-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:54.976065 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f2c42a39-8c83-4562-9975-17b00c20f55e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:54.976762 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f2c42a39-8c83-4562-9975-17b00c20f55e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:54.977396 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f2c42a39-8c83-4562-9975-17b00c20f55e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:54.978976 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f2c42a39-8c83-4562-9975-17b00c20f55e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:54.979648 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f2c42a39-8c83-4562-9975-17b00c20f55e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:54.980301 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f2c42a39-8c83-4562-9975-17b00c20f55e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:55.004129 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-182bdfa4-ff89-4aaa-97b2-d278965d52a1 tempest-PortsAdminExtendedAttrsTestJSON-1349295598 tempest-PortsAdminExtendedAttrsTestJSON-1349295598-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:55.005706 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-182bdfa4-ff89-4aaa-97b2-d278965d52a1 tempest-PortsAdminExtendedAttrsTestJSON-1349295598 tempest-PortsAdminExtendedAttrsTestJSON-1349295598-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:55.006535 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-182bdfa4-ff89-4aaa-97b2-d278965d52a1 tempest-PortsAdminExtendedAttrsTestJSON-1349295598 tempest-PortsAdminExtendedAttrsTestJSON-1349295598-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:55.027673 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-182bdfa4-ff89-4aaa-97b2-d278965d52a1 tempest-PortsAdminExtendedAttrsTestJSON-1349295598 tempest-PortsAdminExtendedAttrsTestJSON-1349295598-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.557585 Oct 30 01:33:55.038793 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2324/4624] 10.222.0.13 () {58 vars in 1146 bytes} [Sun Oct 30 01:33:54 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:33:55.223226 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-47c1ba43-4e7f-42be-8637-284e48724216 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:55.234769 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-47c1ba43-4e7f-42be-8637-284e48724216 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] [instance: 193565f7-ccc8-4f1d-a9b3-d949e09970e8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:55.259511 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-47c1ba43-4e7f-42be-8637-284e48724216 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:55.268733 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-47c1ba43-4e7f-42be-8637-284e48724216 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:55.269196 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-47c1ba43-4e7f-42be-8637-284e48724216 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:55.269987 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-47c1ba43-4e7f-42be-8637-284e48724216 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:55.272479 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-47c1ba43-4e7f-42be-8637-284e48724216 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:55.274334 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-47c1ba43-4e7f-42be-8637-284e48724216 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:55.574995 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-47c1ba43-4e7f-42be-8637-284e48724216 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:55.591750 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-47c1ba43-4e7f-42be-8637-284e48724216 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:55.595534 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-47c1ba43-4e7f-42be-8637-284e48724216 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:55.597041 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-47c1ba43-4e7f-42be-8637-284e48724216 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] 10.222.0.13 "GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8" status: 200 len: 1408 microversion: 2.54 time: 0.390651 Oct 30 01:33:55.600431 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2325/4625] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:33:55 2022] GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8 => generated 1408 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:33:55.690668 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f2c42a39-8c83-4562-9975-17b00c20f55e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:55.703289 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f2c42a39-8c83-4562-9975-17b00c20f55e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1525 microversion: 2.1 time: 0.749627 Oct 30 01:33:55.704593 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2301/4626] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:54 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1525 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:55.977815 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4917edf2-f62f-4f13-9a5c-5d0181292a20 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:55.978443 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4917edf2-f62f-4f13-9a5c-5d0181292a20 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] [instance: 30c573b5-586e-4d4d-ad6e-d826f25374eb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:55.986546 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4917edf2-f62f-4f13-9a5c-5d0181292a20 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:55.986995 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4917edf2-f62f-4f13-9a5c-5d0181292a20 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:55.999857 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4917edf2-f62f-4f13-9a5c-5d0181292a20 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:56.000815 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4917edf2-f62f-4f13-9a5c-5d0181292a20 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:56.005762 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4917edf2-f62f-4f13-9a5c-5d0181292a20 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:56.006508 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4917edf2-f62f-4f13-9a5c-5d0181292a20 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:56.627790 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-34bd5308-f978-4367-b1af-f963e7d022cd tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:56.628422 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-34bd5308-f978-4367-b1af-f963e7d022cd tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] [instance: 193565f7-ccc8-4f1d-a9b3-d949e09970e8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:56.660113 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-34bd5308-f978-4367-b1af-f963e7d022cd tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:56.660631 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-34bd5308-f978-4367-b1af-f963e7d022cd tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:56.661169 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-34bd5308-f978-4367-b1af-f963e7d022cd tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:56.661922 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-34bd5308-f978-4367-b1af-f963e7d022cd tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:56.662616 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-34bd5308-f978-4367-b1af-f963e7d022cd tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:56.663202 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-34bd5308-f978-4367-b1af-f963e7d022cd tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:56.744652 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4917edf2-f62f-4f13-9a5c-5d0181292a20 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7675c0fa214588b71c04ca120557fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b509d1b9c324201942dfeb350611a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:56.759201 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4917edf2-f62f-4f13-9a5c-5d0181292a20 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] 10.222.0.13 "GET /compute/v2.1/servers/30c573b5-586e-4d4d-ad6e-d826f25374eb" status: 200 len: 1320 microversion: 2.1 time: 0.786683 Oct 30 01:33:56.762887 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2326/4627] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:55 2022] GET /compute/v2.1/servers/30c573b5-586e-4d4d-ad6e-d826f25374eb => generated 1320 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:56.775796 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-398ba403-ab96-440d-a7c8-2b97404c1fe4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:56.778152 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-398ba403-ab96-440d-a7c8-2b97404c1fe4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:56.822475 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-398ba403-ab96-440d-a7c8-2b97404c1fe4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:56.830390 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-398ba403-ab96-440d-a7c8-2b97404c1fe4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:56.830390 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-398ba403-ab96-440d-a7c8-2b97404c1fe4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:56.830390 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-398ba403-ab96-440d-a7c8-2b97404c1fe4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:56.830390 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-398ba403-ab96-440d-a7c8-2b97404c1fe4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:56.830390 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-398ba403-ab96-440d-a7c8-2b97404c1fe4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:56.843131 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-34bd5308-f978-4367-b1af-f963e7d022cd tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:56.854562 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-34bd5308-f978-4367-b1af-f963e7d022cd tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:56.856817 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-34bd5308-f978-4367-b1af-f963e7d022cd tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:56.863978 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-34bd5308-f978-4367-b1af-f963e7d022cd tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] 10.222.0.13 "GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8" status: 200 len: 1408 microversion: 2.54 time: 0.239282 Oct 30 01:33:56.881579 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2302/4628] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:33:56 2022] GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8 => generated 1408 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:33:57.415752 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-398ba403-ab96-440d-a7c8-2b97404c1fe4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:57.426431 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-398ba403-ab96-440d-a7c8-2b97404c1fe4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1525 microversion: 2.1 time: 0.661994 Oct 30 01:33:57.427715 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2327/4629] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:56 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1525 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:57.789160 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7b62296c-5ed4-4b3e-8042-495460ed6673 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:57.790451 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7b62296c-5ed4-4b3e-8042-495460ed6673 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] [instance: 30c573b5-586e-4d4d-ad6e-d826f25374eb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:57.813461 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b62296c-5ed4-4b3e-8042-495460ed6673 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:57.813461 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b62296c-5ed4-4b3e-8042-495460ed6673 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:57.813461 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b62296c-5ed4-4b3e-8042-495460ed6673 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:57.813461 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b62296c-5ed4-4b3e-8042-495460ed6673 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:57.813461 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b62296c-5ed4-4b3e-8042-495460ed6673 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:57.815372 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b62296c-5ed4-4b3e-8042-495460ed6673 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:57.902854 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-02c13b5a-fd6b-494d-915f-474b2cfcc320 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:57.904981 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-02c13b5a-fd6b-494d-915f-474b2cfcc320 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] [instance: 193565f7-ccc8-4f1d-a9b3-d949e09970e8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:57.944433 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-02c13b5a-fd6b-494d-915f-474b2cfcc320 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:57.946411 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-02c13b5a-fd6b-494d-915f-474b2cfcc320 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:57.950678 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-02c13b5a-fd6b-494d-915f-474b2cfcc320 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:57.957204 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-02c13b5a-fd6b-494d-915f-474b2cfcc320 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:57.961514 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-02c13b5a-fd6b-494d-915f-474b2cfcc320 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:57.963133 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-02c13b5a-fd6b-494d-915f-474b2cfcc320 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:58.565159 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7b62296c-5ed4-4b3e-8042-495460ed6673 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7675c0fa214588b71c04ca120557fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b509d1b9c324201942dfeb350611a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:58.590524 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7b62296c-5ed4-4b3e-8042-495460ed6673 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] 10.222.0.13 "GET /compute/v2.1/servers/30c573b5-586e-4d4d-ad6e-d826f25374eb" status: 200 len: 1320 microversion: 2.1 time: 0.805553 Oct 30 01:33:58.594001 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2303/4630] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:57 2022] GET /compute/v2.1/servers/30c573b5-586e-4d4d-ad6e-d826f25374eb => generated 1320 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:58.617042 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-489c2e92-bd75-432e-81d1-fd77e44259ee tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:58.618223 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-489c2e92-bd75-432e-81d1-fd77e44259ee tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:58.642983 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-489c2e92-bd75-432e-81d1-fd77e44259ee tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:58.643496 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-489c2e92-bd75-432e-81d1-fd77e44259ee tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:58.643944 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-489c2e92-bd75-432e-81d1-fd77e44259ee tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:58.647667 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-02c13b5a-fd6b-494d-915f-474b2cfcc320 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:58.650491 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-489c2e92-bd75-432e-81d1-fd77e44259ee tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:58.652000 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-489c2e92-bd75-432e-81d1-fd77e44259ee tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:58.652393 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-489c2e92-bd75-432e-81d1-fd77e44259ee tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:58.664899 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-02c13b5a-fd6b-494d-915f-474b2cfcc320 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:58.671994 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-02c13b5a-fd6b-494d-915f-474b2cfcc320 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:58.678048 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-02c13b5a-fd6b-494d-915f-474b2cfcc320 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] 10.222.0.13 "GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8" status: 200 len: 1408 microversion: 2.54 time: 0.783189 Oct 30 01:33:58.703625 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2328/4631] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:33:57 2022] GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8 => generated 1408 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:33:59.487689 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-489c2e92-bd75-432e-81d1-fd77e44259ee tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:33:59.499998 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-489c2e92-bd75-432e-81d1-fd77e44259ee tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1525 microversion: 2.1 time: 0.903679 Oct 30 01:33:59.500596 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2304/4632] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:58 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1525 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:33:59.619507 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ea6b7895-b0c4-4624-aea1-1a92adf4075e tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:59.620314 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ea6b7895-b0c4-4624-aea1-1a92adf4075e tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] [instance: 30c573b5-586e-4d4d-ad6e-d826f25374eb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:59.631850 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ea6b7895-b0c4-4624-aea1-1a92adf4075e tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:59.636251 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ea6b7895-b0c4-4624-aea1-1a92adf4075e tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:59.636251 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ea6b7895-b0c4-4624-aea1-1a92adf4075e tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:59.636251 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ea6b7895-b0c4-4624-aea1-1a92adf4075e tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:59.639701 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d214e224-a098-40ba-aa55-9f629009fee6 tempest-AZV2TestJSON-1951747696 tempest-AZV2TestJSON-1951747696-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:59.642513 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d214e224-a098-40ba-aa55-9f629009fee6 tempest-AZV2TestJSON-1951747696 tempest-AZV2TestJSON-1951747696-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:59.643199 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d214e224-a098-40ba-aa55-9f629009fee6 tempest-AZV2TestJSON-1951747696 tempest-AZV2TestJSON-1951747696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:59.645300 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d214e224-a098-40ba-aa55-9f629009fee6 tempest-AZV2TestJSON-1951747696 tempest-AZV2TestJSON-1951747696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:59.646843 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d214e224-a098-40ba-aa55-9f629009fee6 tempest-AZV2TestJSON-1951747696 tempest-AZV2TestJSON-1951747696-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:59.647538 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d214e224-a098-40ba-aa55-9f629009fee6 tempest-AZV2TestJSON-1951747696 tempest-AZV2TestJSON-1951747696-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:59.648146 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d214e224-a098-40ba-aa55-9f629009fee6 tempest-AZV2TestJSON-1951747696 tempest-AZV2TestJSON-1951747696-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:59.650725 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ea6b7895-b0c4-4624-aea1-1a92adf4075e tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:59.651193 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ea6b7895-b0c4-4624-aea1-1a92adf4075e tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:59.750932 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d214e224-a098-40ba-aa55-9f629009fee6 tempest-AZV2TestJSON-1951747696 tempest-AZV2TestJSON-1951747696-project] 10.222.0.13 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.335885 Oct 30 01:33:59.754809 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2329/4633] 10.222.0.13 () {58 vars in 1164 bytes} [Sun Oct 30 01:33:59 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 30 01:33:59.764190 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-be1987c0-201c-45ca-97ca-d72a9e06830d tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:33:59.764769 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-be1987c0-201c-45ca-97ca-d72a9e06830d tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] [instance: 193565f7-ccc8-4f1d-a9b3-d949e09970e8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:33:59.785293 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-be1987c0-201c-45ca-97ca-d72a9e06830d tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:59.785858 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-be1987c0-201c-45ca-97ca-d72a9e06830d tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:59.787207 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-be1987c0-201c-45ca-97ca-d72a9e06830d tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:33:59.787648 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-be1987c0-201c-45ca-97ca-d72a9e06830d tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:33:59.788285 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-be1987c0-201c-45ca-97ca-d72a9e06830d tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:33:59.789301 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-be1987c0-201c-45ca-97ca-d72a9e06830d tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:00.034095 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-be1987c0-201c-45ca-97ca-d72a9e06830d tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:00.053903 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-be1987c0-201c-45ca-97ca-d72a9e06830d tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:00.056341 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-be1987c0-201c-45ca-97ca-d72a9e06830d tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:00.059811 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-be1987c0-201c-45ca-97ca-d72a9e06830d tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] 10.222.0.13 "GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8" status: 200 len: 1408 microversion: 2.54 time: 0.303432 Oct 30 01:34:00.060785 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2330/4634] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:33:59 2022] GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8 => generated 1408 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:34:00.068208 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-d12f55d6-8010-4ce3-a57a-8e70baa4139c req-db606b47-b260-40cd-97fb-99c7719b2d8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30c573b5-586e-4d4d-ad6e-d826f25374eb", "name": "network-vif-plugged", "status": "completed", "tag": "38cbaa97-b07f-4c77-86ad-8e026e45fd37"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:34:00.097840 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-d12f55d6-8010-4ce3-a57a-8e70baa4139c req-db606b47-b260-40cd-97fb-99c7719b2d8e service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:00.097840 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-d12f55d6-8010-4ce3-a57a-8e70baa4139c req-db606b47-b260-40cd-97fb-99c7719b2d8e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:00.097840 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-d12f55d6-8010-4ce3-a57a-8e70baa4139c req-db606b47-b260-40cd-97fb-99c7719b2d8e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:00.123339 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ea6b7895-b0c4-4624-aea1-1a92adf4075e tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7675c0fa214588b71c04ca120557fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b509d1b9c324201942dfeb350611a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:00.140709 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ea6b7895-b0c4-4624-aea1-1a92adf4075e tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] 10.222.0.13 "GET /compute/v2.1/servers/30c573b5-586e-4d4d-ad6e-d826f25374eb" status: 200 len: 1320 microversion: 2.1 time: 0.522160 Oct 30 01:34:00.143597 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-d12f55d6-8010-4ce3-a57a-8e70baa4139c req-db606b47-b260-40cd-97fb-99c7719b2d8e service nova] Creating event network-vif-plugged:38cbaa97-b07f-4c77-86ad-8e026e45fd37 for instance 30c573b5-586e-4d4d-ad6e-d826f25374eb on n-h1-master-1 Oct 30 01:34:00.145010 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2305/4635] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:59 2022] GET /compute/v2.1/servers/30c573b5-586e-4d4d-ad6e-d826f25374eb => generated 1320 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:34:00.160377 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-d12f55d6-8010-4ce3-a57a-8e70baa4139c req-db606b47-b260-40cd-97fb-99c7719b2d8e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097442 Oct 30 01:34:00.164686 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2331/4636] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:34:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:34:00.527857 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-dc10b325-e398-4dab-96bd-1451e9a6a265 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:00.528475 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-dc10b325-e398-4dab-96bd-1451e9a6a265 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:00.545511 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc10b325-e398-4dab-96bd-1451e9a6a265 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:00.547148 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc10b325-e398-4dab-96bd-1451e9a6a265 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:00.547781 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc10b325-e398-4dab-96bd-1451e9a6a265 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:00.548681 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc10b325-e398-4dab-96bd-1451e9a6a265 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:00.550966 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc10b325-e398-4dab-96bd-1451e9a6a265 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:00.552870 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc10b325-e398-4dab-96bd-1451e9a6a265 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:00.779875 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5c77db28-3336-4b53-827c-1d5ecea78ad9 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:00.780473 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5c77db28-3336-4b53-827c-1d5ecea78ad9 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:00.797417 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c77db28-3336-4b53-827c-1d5ecea78ad9 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:00.798232 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c77db28-3336-4b53-827c-1d5ecea78ad9 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:00.801658 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c77db28-3336-4b53-827c-1d5ecea78ad9 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:00.806015 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c77db28-3336-4b53-827c-1d5ecea78ad9 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:00.806015 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c77db28-3336-4b53-827c-1d5ecea78ad9 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:00.806015 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c77db28-3336-4b53-827c-1d5ecea78ad9 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:00.920807 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5c77db28-3336-4b53-827c-1d5ecea78ad9 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:34:01.043824 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-dc10b325-e398-4dab-96bd-1451e9a6a265 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:01.056830 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-dc10b325-e398-4dab-96bd-1451e9a6a265 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1525 microversion: 2.1 time: 0.533993 Oct 30 01:34:01.059899 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2306/4637] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:00 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1525 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:34:01.090376 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-aeacf25c-657f-4e9c-bf33-d64c8b0f1918 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:01.091409 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-aeacf25c-657f-4e9c-bf33-d64c8b0f1918 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] [instance: 193565f7-ccc8-4f1d-a9b3-d949e09970e8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:01.107374 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aeacf25c-657f-4e9c-bf33-d64c8b0f1918 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:01.109063 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aeacf25c-657f-4e9c-bf33-d64c8b0f1918 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:01.109568 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aeacf25c-657f-4e9c-bf33-d64c8b0f1918 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:01.114719 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aeacf25c-657f-4e9c-bf33-d64c8b0f1918 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:01.117785 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aeacf25c-657f-4e9c-bf33-d64c8b0f1918 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:01.119793 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aeacf25c-657f-4e9c-bf33-d64c8b0f1918 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:01.338868 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-aeacf25c-657f-4e9c-bf33-d64c8b0f1918 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:01.341471 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=100 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:34:01.354761 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-aeacf25c-657f-4e9c-bf33-d64c8b0f1918 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:01.356216 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-aeacf25c-657f-4e9c-bf33-d64c8b0f1918 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:01.357438 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-aeacf25c-657f-4e9c-bf33-d64c8b0f1918 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] 10.222.0.13 "GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8" status: 200 len: 1414 microversion: 2.54 time: 0.273246 Oct 30 01:34:01.365839 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2307/4638] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:34:01 2022] GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8 => generated 1414 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:34:01.375284 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9443d318-f55f-4339-bcc5-185ac98a0271 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:01.376096 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9443d318-f55f-4339-bcc5-185ac98a0271 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] [instance: 30c573b5-586e-4d4d-ad6e-d826f25374eb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:01.388582 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9443d318-f55f-4339-bcc5-185ac98a0271 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:01.388582 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9443d318-f55f-4339-bcc5-185ac98a0271 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:01.388582 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9443d318-f55f-4339-bcc5-185ac98a0271 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:01.388817 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9443d318-f55f-4339-bcc5-185ac98a0271 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:01.389175 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9443d318-f55f-4339-bcc5-185ac98a0271 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:01.397901 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9443d318-f55f-4339-bcc5-185ac98a0271 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:01.481451 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5c77db28-3336-4b53-827c-1d5ecea78ad9 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "DELETE /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 204 len: 0 microversion: 2.32 time: 0.706876 Oct 30 01:34:01.482287 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2332/4639] 10.222.0.13 () {60 vars in 1280 bytes} [Sun Oct 30 01:34:00 2022] DELETE /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 0 bytes in 709 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 30 01:34:01.492341 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-22336f43-6645-4f63-9961-9bed290ae3e4 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:01.500850 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-22336f43-6645-4f63-9961-9bed290ae3e4 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:01.534513 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-22336f43-6645-4f63-9961-9bed290ae3e4 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:01.535429 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-22336f43-6645-4f63-9961-9bed290ae3e4 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:01.536642 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-22336f43-6645-4f63-9961-9bed290ae3e4 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:01.538457 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-22336f43-6645-4f63-9961-9bed290ae3e4 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:01.541397 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-22336f43-6645-4f63-9961-9bed290ae3e4 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:01.548488 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-22336f43-6645-4f63-9961-9bed290ae3e4 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:02.062167 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9443d318-f55f-4339-bcc5-185ac98a0271 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7675c0fa214588b71c04ca120557fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b509d1b9c324201942dfeb350611a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:02.078828 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9443d318-f55f-4339-bcc5-185ac98a0271 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] 10.222.0.13 "GET /compute/v2.1/servers/30c573b5-586e-4d4d-ad6e-d826f25374eb" status: 200 len: 1320 microversion: 2.1 time: 0.711206 Oct 30 01:34:02.079705 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2308/4640] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:01 2022] GET /compute/v2.1/servers/30c573b5-586e-4d4d-ad6e-d826f25374eb => generated 1320 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:34:02.102298 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1a0e056d-e39e-4bc3-82b9-934d5b245ea4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:02.105775 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1a0e056d-e39e-4bc3-82b9-934d5b245ea4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:02.128359 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a0e056d-e39e-4bc3-82b9-934d5b245ea4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:02.130486 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-22336f43-6645-4f63-9961-9bed290ae3e4 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:02.133895 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a0e056d-e39e-4bc3-82b9-934d5b245ea4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:02.140666 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a0e056d-e39e-4bc3-82b9-934d5b245ea4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:02.140666 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a0e056d-e39e-4bc3-82b9-934d5b245ea4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:02.140666 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a0e056d-e39e-4bc3-82b9-934d5b245ea4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:02.140666 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a0e056d-e39e-4bc3-82b9-934d5b245ea4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:02.144593 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-22336f43-6645-4f63-9961-9bed290ae3e4 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:02.148383 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-22336f43-6645-4f63-9961-9bed290ae3e4 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:02.149997 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-22336f43-6645-4f63-9961-9bed290ae3e4 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 2949 microversion: 2.32 time: 0.662592 Oct 30 01:34:02.151181 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2333/4641] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:34:01 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 2949 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:34:02.396533 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b798801d-0842-4128-b77e-8c816f3c5085 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:02.397154 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b798801d-0842-4128-b77e-8c816f3c5085 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] [instance: 193565f7-ccc8-4f1d-a9b3-d949e09970e8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:02.413125 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b798801d-0842-4128-b77e-8c816f3c5085 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:02.413647 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b798801d-0842-4128-b77e-8c816f3c5085 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:02.419299 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b798801d-0842-4128-b77e-8c816f3c5085 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:02.420237 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b798801d-0842-4128-b77e-8c816f3c5085 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:02.423530 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b798801d-0842-4128-b77e-8c816f3c5085 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:02.424008 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b798801d-0842-4128-b77e-8c816f3c5085 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:02.647294 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b798801d-0842-4128-b77e-8c816f3c5085 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:02.657353 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1a0e056d-e39e-4bc3-82b9-934d5b245ea4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:02.659691 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b798801d-0842-4128-b77e-8c816f3c5085 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:02.669959 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b798801d-0842-4128-b77e-8c816f3c5085 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:02.670133 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1a0e056d-e39e-4bc3-82b9-934d5b245ea4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1525 microversion: 2.1 time: 0.579604 Oct 30 01:34:02.670254 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b798801d-0842-4128-b77e-8c816f3c5085 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] 10.222.0.13 "GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8" status: 200 len: 1414 microversion: 2.54 time: 0.275373 Oct 30 01:34:02.670254 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2334/4642] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:34:02 2022] GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8 => generated 1414 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:34:02.673941 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2309/4643] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:02 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1525 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:34:03.104609 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3d832683-252c-4238-8c23-4d8ebb500f79 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:03.105634 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3d832683-252c-4238-8c23-4d8ebb500f79 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] [instance: 30c573b5-586e-4d4d-ad6e-d826f25374eb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:03.122187 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d832683-252c-4238-8c23-4d8ebb500f79 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:03.122694 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d832683-252c-4238-8c23-4d8ebb500f79 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:03.123129 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d832683-252c-4238-8c23-4d8ebb500f79 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:03.130296 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d832683-252c-4238-8c23-4d8ebb500f79 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:03.130722 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d832683-252c-4238-8c23-4d8ebb500f79 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:03.131275 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d832683-252c-4238-8c23-4d8ebb500f79 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:03.182594 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5ae0fdc7-cc2f-40bf-a0c2-a4296d9082fb tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:03.184333 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5ae0fdc7-cc2f-40bf-a0c2-a4296d9082fb tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:03.194366 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ae0fdc7-cc2f-40bf-a0c2-a4296d9082fb tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:03.195345 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ae0fdc7-cc2f-40bf-a0c2-a4296d9082fb tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:03.196870 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ae0fdc7-cc2f-40bf-a0c2-a4296d9082fb tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:03.196870 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ae0fdc7-cc2f-40bf-a0c2-a4296d9082fb tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:03.197540 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ae0fdc7-cc2f-40bf-a0c2-a4296d9082fb tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:03.197979 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ae0fdc7-cc2f-40bf-a0c2-a4296d9082fb tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:03.585371 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3d832683-252c-4238-8c23-4d8ebb500f79 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7675c0fa214588b71c04ca120557fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b509d1b9c324201942dfeb350611a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:03.597856 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3d832683-252c-4238-8c23-4d8ebb500f79 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] 10.222.0.13 "GET /compute/v2.1/servers/30c573b5-586e-4d4d-ad6e-d826f25374eb" status: 200 len: 1507 microversion: 2.1 time: 0.497440 Oct 30 01:34:03.606962 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2335/4644] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:03 2022] GET /compute/v2.1/servers/30c573b5-586e-4d4d-ad6e-d826f25374eb => generated 1507 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:34:03.633156 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ccaaad35-1846-4763-9e2a-51c99e569d82 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:03.634412 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ccaaad35-1846-4763-9e2a-51c99e569d82 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] [instance: 0d16a8ce-36ce-488a-8782-856e088c6bc3] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:03.642146 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ccaaad35-1846-4763-9e2a-51c99e569d82 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:03.654010 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ccaaad35-1846-4763-9e2a-51c99e569d82 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:03.654486 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ccaaad35-1846-4763-9e2a-51c99e569d82 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:03.659668 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ccaaad35-1846-4763-9e2a-51c99e569d82 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:03.660136 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ccaaad35-1846-4763-9e2a-51c99e569d82 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:03.664079 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ccaaad35-1846-4763-9e2a-51c99e569d82 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:03.722724 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:34:04.003349 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5ae0fdc7-cc2f-40bf-a0c2-a4296d9082fb tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:04.017859 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5ae0fdc7-cc2f-40bf-a0c2-a4296d9082fb tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:04.019367 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5ae0fdc7-cc2f-40bf-a0c2-a4296d9082fb tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:04.020799 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5ae0fdc7-cc2f-40bf-a0c2-a4296d9082fb tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 2949 microversion: 2.32 time: 0.844470 Oct 30 01:34:04.034202 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2310/4645] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:34:03 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 2949 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:34:04.039547 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8a64d794-93d2-4eb1-ba18-4d50c939ed1e tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:04.040490 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8a64d794-93d2-4eb1-ba18-4d50c939ed1e tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] [instance: 193565f7-ccc8-4f1d-a9b3-d949e09970e8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:04.048415 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8a64d794-93d2-4eb1-ba18-4d50c939ed1e tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:04.049307 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8a64d794-93d2-4eb1-ba18-4d50c939ed1e tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:04.050017 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8a64d794-93d2-4eb1-ba18-4d50c939ed1e tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:04.051001 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8a64d794-93d2-4eb1-ba18-4d50c939ed1e tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:04.053383 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8a64d794-93d2-4eb1-ba18-4d50c939ed1e tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:04.054380 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8a64d794-93d2-4eb1-ba18-4d50c939ed1e tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:04.169184 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8a64d794-93d2-4eb1-ba18-4d50c939ed1e tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:04.182057 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8a64d794-93d2-4eb1-ba18-4d50c939ed1e tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:04.184331 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8a64d794-93d2-4eb1-ba18-4d50c939ed1e tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:04.186733 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8a64d794-93d2-4eb1-ba18-4d50c939ed1e tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] 10.222.0.13 "GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8" status: 200 len: 1414 microversion: 2.54 time: 0.151402 Oct 30 01:34:04.187637 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2311/4646] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:34:04 2022] GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8 => generated 1414 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:34:04.199914 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ccaaad35-1846-4763-9e2a-51c99e569d82 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7675c0fa214588b71c04ca120557fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b509d1b9c324201942dfeb350611a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:04.206771 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a6242acc-03c1-4f61-9c90-c765660a8600 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:04.207452 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a6242acc-03c1-4f61-9c90-c765660a8600 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:04.210799 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ccaaad35-1846-4763-9e2a-51c99e569d82 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] 10.222.0.13 "GET /compute/v2.1/servers/0d16a8ce-36ce-488a-8782-856e088c6bc3" status: 200 len: 1320 microversion: 2.1 time: 0.582793 Oct 30 01:34:04.212082 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2336/4647] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:03 2022] GET /compute/v2.1/servers/0d16a8ce-36ce-488a-8782-856e088c6bc3 => generated 1320 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:34:04.215158 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a6242acc-03c1-4f61-9c90-c765660a8600 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:04.215591 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a6242acc-03c1-4f61-9c90-c765660a8600 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:04.216072 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a6242acc-03c1-4f61-9c90-c765660a8600 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:04.224323 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a6242acc-03c1-4f61-9c90-c765660a8600 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:04.225111 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a6242acc-03c1-4f61-9c90-c765660a8600 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:04.226920 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a6242acc-03c1-4f61-9c90-c765660a8600 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:04.576892 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a6242acc-03c1-4f61-9c90-c765660a8600 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:04.585655 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a6242acc-03c1-4f61-9c90-c765660a8600 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1525 microversion: 2.1 time: 0.396939 Oct 30 01:34:04.594098 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2312/4648] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:04 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1525 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:34:04.790172 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-bf7a5949-a8f1-4d0e-bed6-b0bfb985cf58 req-2c150017-d837-4c1c-ab86-43f541ffa3ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d16a8ce-36ce-488a-8782-856e088c6bc3", "name": "network-vif-plugged", "status": "completed", "tag": "12eb42af-7e14-4d06-bfa6-e68587427952"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:34:04.803411 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-bf7a5949-a8f1-4d0e-bed6-b0bfb985cf58 req-2c150017-d837-4c1c-ab86-43f541ffa3ab service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:04.804414 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-bf7a5949-a8f1-4d0e-bed6-b0bfb985cf58 req-2c150017-d837-4c1c-ab86-43f541ffa3ab service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:04.804773 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-bf7a5949-a8f1-4d0e-bed6-b0bfb985cf58 req-2c150017-d837-4c1c-ab86-43f541ffa3ab service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:04.817966 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-bf7a5949-a8f1-4d0e-bed6-b0bfb985cf58 req-2c150017-d837-4c1c-ab86-43f541ffa3ab service nova] Creating event network-vif-plugged:12eb42af-7e14-4d06-bfa6-e68587427952 for instance 0d16a8ce-36ce-488a-8782-856e088c6bc3 on n-h1-master-1 Oct 30 01:34:04.824686 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-bf7a5949-a8f1-4d0e-bed6-b0bfb985cf58 req-2c150017-d837-4c1c-ab86-43f541ffa3ab service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041603 Oct 30 01:34:04.825687 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2337/4649] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:34:05.057523 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-54477eb1-6512-4b19-8142-e9058258fd80 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:05.058451 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-54477eb1-6512-4b19-8142-e9058258fd80 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:05.069182 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-54477eb1-6512-4b19-8142-e9058258fd80 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:05.070015 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-54477eb1-6512-4b19-8142-e9058258fd80 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:05.071645 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-54477eb1-6512-4b19-8142-e9058258fd80 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:05.073182 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-54477eb1-6512-4b19-8142-e9058258fd80 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:05.074410 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-54477eb1-6512-4b19-8142-e9058258fd80 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:05.075300 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-54477eb1-6512-4b19-8142-e9058258fd80 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:05.218843 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e7f3a497-fdc7-4cd0-8806-fdc56624fe23 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:05.220530 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e7f3a497-fdc7-4cd0-8806-fdc56624fe23 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] [instance: 193565f7-ccc8-4f1d-a9b3-d949e09970e8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:05.229266 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e7f3a497-fdc7-4cd0-8806-fdc56624fe23 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:05.229904 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e7f3a497-fdc7-4cd0-8806-fdc56624fe23 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:05.230414 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e7f3a497-fdc7-4cd0-8806-fdc56624fe23 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:05.231191 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e7f3a497-fdc7-4cd0-8806-fdc56624fe23 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:05.231899 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e7f3a497-fdc7-4cd0-8806-fdc56624fe23 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:05.232542 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e7f3a497-fdc7-4cd0-8806-fdc56624fe23 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:05.435308 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e7f3a497-fdc7-4cd0-8806-fdc56624fe23 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:05.446608 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e7f3a497-fdc7-4cd0-8806-fdc56624fe23 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:05.448575 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e7f3a497-fdc7-4cd0-8806-fdc56624fe23 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:05.450175 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e7f3a497-fdc7-4cd0-8806-fdc56624fe23 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] 10.222.0.13 "GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8" status: 200 len: 1414 microversion: 2.54 time: 0.239821 Oct 30 01:34:05.466320 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2338/4650] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:34:05 2022] GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8 => generated 1414 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:34:05.475523 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cf7c4d6b-bcf2-409a-a5b8-3f390ec4c5ff tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:05.476650 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cf7c4d6b-bcf2-409a-a5b8-3f390ec4c5ff tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] [instance: 0d16a8ce-36ce-488a-8782-856e088c6bc3] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:05.483481 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cf7c4d6b-bcf2-409a-a5b8-3f390ec4c5ff tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:05.484049 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cf7c4d6b-bcf2-409a-a5b8-3f390ec4c5ff tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:05.484683 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cf7c4d6b-bcf2-409a-a5b8-3f390ec4c5ff tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:05.487508 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cf7c4d6b-bcf2-409a-a5b8-3f390ec4c5ff tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:05.489188 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cf7c4d6b-bcf2-409a-a5b8-3f390ec4c5ff tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:05.490371 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cf7c4d6b-bcf2-409a-a5b8-3f390ec4c5ff tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:05.730595 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-54477eb1-6512-4b19-8142-e9058258fd80 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:05.744159 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-54477eb1-6512-4b19-8142-e9058258fd80 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:05.746027 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-54477eb1-6512-4b19-8142-e9058258fd80 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:05.747556 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-54477eb1-6512-4b19-8142-e9058258fd80 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 2949 microversion: 2.32 time: 0.700165 Oct 30 01:34:05.764516 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2313/4651] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:34:05 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 2949 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:34:05.776949 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-08a67f00-9a8c-408b-a63d-96b6d9b00e71 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:05.777942 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-08a67f00-9a8c-408b-a63d-96b6d9b00e71 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:05.793839 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08a67f00-9a8c-408b-a63d-96b6d9b00e71 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:05.794854 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08a67f00-9a8c-408b-a63d-96b6d9b00e71 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:05.795670 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08a67f00-9a8c-408b-a63d-96b6d9b00e71 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:05.796639 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08a67f00-9a8c-408b-a63d-96b6d9b00e71 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:05.797480 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08a67f00-9a8c-408b-a63d-96b6d9b00e71 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:05.798900 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08a67f00-9a8c-408b-a63d-96b6d9b00e71 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:06.113319 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-cf7c4d6b-bcf2-409a-a5b8-3f390ec4c5ff tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7675c0fa214588b71c04ca120557fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b509d1b9c324201942dfeb350611a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:06.127963 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cf7c4d6b-bcf2-409a-a5b8-3f390ec4c5ff tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] 10.222.0.13 "GET /compute/v2.1/servers/0d16a8ce-36ce-488a-8782-856e088c6bc3" status: 200 len: 1320 microversion: 2.1 time: 0.659987 Oct 30 01:34:06.128934 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2339/4652] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:05 2022] GET /compute/v2.1/servers/0d16a8ce-36ce-488a-8782-856e088c6bc3 => generated 1320 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:34:06.256654 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-08a67f00-9a8c-408b-a63d-96b6d9b00e71 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:06.267192 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-08a67f00-9a8c-408b-a63d-96b6d9b00e71 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1525 microversion: 2.1 time: 0.499477 Oct 30 01:34:06.269027 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2314/4653] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:05 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1525 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:34:06.480339 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2fe6c253-f9a8-4cc2-ab65-9cf3034ba798 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:06.480951 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2fe6c253-f9a8-4cc2-ab65-9cf3034ba798 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] [instance: 193565f7-ccc8-4f1d-a9b3-d949e09970e8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:06.497036 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2fe6c253-f9a8-4cc2-ab65-9cf3034ba798 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:06.498777 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2fe6c253-f9a8-4cc2-ab65-9cf3034ba798 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:06.498777 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2fe6c253-f9a8-4cc2-ab65-9cf3034ba798 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:06.499133 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2fe6c253-f9a8-4cc2-ab65-9cf3034ba798 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:06.499591 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2fe6c253-f9a8-4cc2-ab65-9cf3034ba798 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:06.500020 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2fe6c253-f9a8-4cc2-ab65-9cf3034ba798 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:06.785636 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-69dbb549-b81b-496c-95a6-811ca58fe1f5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:06.786802 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-69dbb549-b81b-496c-95a6-811ca58fe1f5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:06.791149 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2fe6c253-f9a8-4cc2-ab65-9cf3034ba798 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:06.793320 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:34:06.795621 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-69dbb549-b81b-496c-95a6-811ca58fe1f5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:06.797076 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-69dbb549-b81b-496c-95a6-811ca58fe1f5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:06.798709 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-69dbb549-b81b-496c-95a6-811ca58fe1f5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:06.799952 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-69dbb549-b81b-496c-95a6-811ca58fe1f5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:06.801184 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-69dbb549-b81b-496c-95a6-811ca58fe1f5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:06.801857 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-69dbb549-b81b-496c-95a6-811ca58fe1f5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:06.803665 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2fe6c253-f9a8-4cc2-ab65-9cf3034ba798 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:06.805516 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2fe6c253-f9a8-4cc2-ab65-9cf3034ba798 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:06.807118 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2fe6c253-f9a8-4cc2-ab65-9cf3034ba798 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] 10.222.0.13 "GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8" status: 200 len: 1399 microversion: 2.54 time: 0.330587 Oct 30 01:34:06.808073 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2340/4654] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:34:06 2022] GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8 => generated 1399 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:34:06.841972 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-57f8079a-ac37-49e7-b23d-3dc00fb936f5 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Calling method '.version_select at 0x7f44cc5d5820>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:06.963880 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-57f8079a-ac37-49e7-b23d-3dc00fb936f5 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-872016320" status: 204 len: 0 microversion: 2.54 time: 0.127099 Oct 30 01:34:06.972924 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2341/4655] 10.222.0.13 () {60 vars in 1316 bytes} [Sun Oct 30 01:34:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-872016320 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 30 01:34:06.979196 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a0ad87c2-cc4c-429d-91b7-a17f2baa4bf6 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:06.980044 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a0ad87c2-cc4c-429d-91b7-a17f2baa4bf6 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] [instance: 193565f7-ccc8-4f1d-a9b3-d949e09970e8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:06.993237 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a0ad87c2-cc4c-429d-91b7-a17f2baa4bf6 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:06.993842 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a0ad87c2-cc4c-429d-91b7-a17f2baa4bf6 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:06.994284 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a0ad87c2-cc4c-429d-91b7-a17f2baa4bf6 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:06.995003 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a0ad87c2-cc4c-429d-91b7-a17f2baa4bf6 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:06.995675 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a0ad87c2-cc4c-429d-91b7-a17f2baa4bf6 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:06.996283 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a0ad87c2-cc4c-429d-91b7-a17f2baa4bf6 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:07.041144 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a0ad87c2-cc4c-429d-91b7-a17f2baa4bf6 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] [instance: 193565f7-ccc8-4f1d-a9b3-d949e09970e8] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:34:07.267266 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-69dbb549-b81b-496c-95a6-811ca58fe1f5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:07.278247 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-69dbb549-b81b-496c-95a6-811ca58fe1f5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:07.287673 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-69dbb549-b81b-496c-95a6-811ca58fe1f5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:07.287673 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-69dbb549-b81b-496c-95a6-811ca58fe1f5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 2949 microversion: 2.32 time: 0.501351 Oct 30 01:34:07.287673 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2315/4656] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:34:06 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 2949 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:34:07.298725 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-08062a75-310c-4735-89e4-b1213ec1ff7e tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:07.299945 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-08062a75-310c-4735-89e4-b1213ec1ff7e tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] [instance: 0d16a8ce-36ce-488a-8782-856e088c6bc3] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:07.308808 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08062a75-310c-4735-89e4-b1213ec1ff7e tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:07.310499 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08062a75-310c-4735-89e4-b1213ec1ff7e tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:07.311527 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08062a75-310c-4735-89e4-b1213ec1ff7e tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:07.313475 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08062a75-310c-4735-89e4-b1213ec1ff7e tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:07.314874 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08062a75-310c-4735-89e4-b1213ec1ff7e tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:07.315848 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08062a75-310c-4735-89e4-b1213ec1ff7e tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:07.447710 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a0ad87c2-cc4c-429d-91b7-a17f2baa4bf6 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] 10.222.0.13 "DELETE /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8" status: 204 len: 0 microversion: 2.54 time: 0.472665 Oct 30 01:34:07.464889 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2342/4657] 10.222.0.13 () {60 vars in 1280 bytes} [Sun Oct 30 01:34:06 2022] DELETE /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 30 01:34:07.491689 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7ccddc78-e4b7-4673-9d2e-84bb07432a8a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:07.492384 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7ccddc78-e4b7-4673-9d2e-84bb07432a8a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:07.502777 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7ccddc78-e4b7-4673-9d2e-84bb07432a8a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:07.503580 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7ccddc78-e4b7-4673-9d2e-84bb07432a8a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:07.504761 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7ccddc78-e4b7-4673-9d2e-84bb07432a8a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:07.506766 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7ccddc78-e4b7-4673-9d2e-84bb07432a8a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:07.506766 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7ccddc78-e4b7-4673-9d2e-84bb07432a8a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:07.507081 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7ccddc78-e4b7-4673-9d2e-84bb07432a8a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:07.727443 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-08062a75-310c-4735-89e4-b1213ec1ff7e tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7675c0fa214588b71c04ca120557fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b509d1b9c324201942dfeb350611a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:07.735543 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-08062a75-310c-4735-89e4-b1213ec1ff7e tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] 10.222.0.13 "GET /compute/v2.1/servers/0d16a8ce-36ce-488a-8782-856e088c6bc3" status: 200 len: 1507 microversion: 2.1 time: 0.452480 Oct 30 01:34:07.736459 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2316/4658] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:07 2022] GET /compute/v2.1/servers/0d16a8ce-36ce-488a-8782-856e088c6bc3 => generated 1507 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:34:07.741594 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e5c2202e-b575-4229-853f-e1ddfd155680 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:07.742465 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e5c2202e-b575-4229-853f-e1ddfd155680 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] [instance: 193565f7-ccc8-4f1d-a9b3-d949e09970e8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:07.748889 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e5c2202e-b575-4229-853f-e1ddfd155680 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:07.749710 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e5c2202e-b575-4229-853f-e1ddfd155680 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:07.750389 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e5c2202e-b575-4229-853f-e1ddfd155680 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:07.751338 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e5c2202e-b575-4229-853f-e1ddfd155680 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:07.752011 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e5c2202e-b575-4229-853f-e1ddfd155680 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:07.752673 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e5c2202e-b575-4229-853f-e1ddfd155680 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:08.222129 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e5c2202e-b575-4229-853f-e1ddfd155680 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:08.260630 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e5c2202e-b575-4229-853f-e1ddfd155680 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:08.262391 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e5c2202e-b575-4229-853f-e1ddfd155680 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:08.263791 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e5c2202e-b575-4229-853f-e1ddfd155680 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] 10.222.0.13 "GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8" status: 200 len: 1405 microversion: 2.54 time: 0.526155 Oct 30 01:34:08.264468 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2317/4659] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:34:07 2022] GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8 => generated 1405 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:34:08.270481 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-76e65be4-c37e-4aa7-859a-00aa0e7ce0a8 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:08.271240 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-76e65be4-c37e-4aa7-859a-00aa0e7ce0a8 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] [instance: 0d16a8ce-36ce-488a-8782-856e088c6bc3] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:08.283017 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-76e65be4-c37e-4aa7-859a-00aa0e7ce0a8 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:08.283846 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-76e65be4-c37e-4aa7-859a-00aa0e7ce0a8 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:08.284568 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-76e65be4-c37e-4aa7-859a-00aa0e7ce0a8 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:08.286377 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-76e65be4-c37e-4aa7-859a-00aa0e7ce0a8 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:08.286377 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-76e65be4-c37e-4aa7-859a-00aa0e7ce0a8 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:08.287101 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-76e65be4-c37e-4aa7-859a-00aa0e7ce0a8 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:08.324712 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7ccddc78-e4b7-4673-9d2e-84bb07432a8a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:08.341399 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7ccddc78-e4b7-4673-9d2e-84bb07432a8a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1507 microversion: 2.1 time: 0.870562 Oct 30 01:34:08.341399 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2343/4660] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:07 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1507 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:34:08.345986 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-76e65be4-c37e-4aa7-859a-00aa0e7ce0a8 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] [instance: 0d16a8ce-36ce-488a-8782-856e088c6bc3] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:34:08.347685 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c4ff2f66-23e5-4ca5-8d35-1882660a7110 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:08.348551 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c4ff2f66-23e5-4ca5-8d35-1882660a7110 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:08.355927 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4ff2f66-23e5-4ca5-8d35-1882660a7110 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:08.357048 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4ff2f66-23e5-4ca5-8d35-1882660a7110 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:08.357967 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4ff2f66-23e5-4ca5-8d35-1882660a7110 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:08.359006 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4ff2f66-23e5-4ca5-8d35-1882660a7110 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:08.360450 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4ff2f66-23e5-4ca5-8d35-1882660a7110 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:08.362344 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4ff2f66-23e5-4ca5-8d35-1882660a7110 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:08.732287 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-76e65be4-c37e-4aa7-859a-00aa0e7ce0a8 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0d16a8ce-36ce-488a-8782-856e088c6bc3" status: 204 len: 0 microversion: 2.1 time: 0.465774 Oct 30 01:34:08.732887 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2318/4661] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:34:08 2022] DELETE /compute/v2.1/servers/0d16a8ce-36ce-488a-8782-856e088c6bc3 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:34:08.754239 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d5390476-cd9c-4b72-99a6-50e04c05db0b tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:08.754963 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d5390476-cd9c-4b72-99a6-50e04c05db0b tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] [instance: 30c573b5-586e-4d4d-ad6e-d826f25374eb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:08.775626 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d5390476-cd9c-4b72-99a6-50e04c05db0b tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:08.776045 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d5390476-cd9c-4b72-99a6-50e04c05db0b tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:08.776668 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d5390476-cd9c-4b72-99a6-50e04c05db0b tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:08.777707 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d5390476-cd9c-4b72-99a6-50e04c05db0b tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:08.778326 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d5390476-cd9c-4b72-99a6-50e04c05db0b tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:08.779376 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d5390476-cd9c-4b72-99a6-50e04c05db0b tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:08.834994 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d5390476-cd9c-4b72-99a6-50e04c05db0b tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] [instance: 30c573b5-586e-4d4d-ad6e-d826f25374eb] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:34:08.941451 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c4ff2f66-23e5-4ca5-8d35-1882660a7110 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:08.951045 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c4ff2f66-23e5-4ca5-8d35-1882660a7110 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:08.952715 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c4ff2f66-23e5-4ca5-8d35-1882660a7110 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:08.954285 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c4ff2f66-23e5-4ca5-8d35-1882660a7110 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 2928 microversion: 2.32 time: 0.614443 Oct 30 01:34:08.955079 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2344/4662] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:34:08 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 2928 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:34:09.216426 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d5390476-cd9c-4b72-99a6-50e04c05db0b tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] 10.222.0.13 "DELETE /compute/v2.1/servers/30c573b5-586e-4d4d-ad6e-d826f25374eb" status: 204 len: 0 microversion: 2.1 time: 0.472941 Oct 30 01:34:09.221501 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2319/4663] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:34:08 2022] DELETE /compute/v2.1/servers/30c573b5-586e-4d4d-ad6e-d826f25374eb => generated 0 bytes in 478 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 30 01:34:09.292296 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bc501bb6-7523-4394-bd74-760ae1cf259f tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:09.292948 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bc501bb6-7523-4394-bd74-760ae1cf259f tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] [instance: 193565f7-ccc8-4f1d-a9b3-d949e09970e8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:09.308320 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bc501bb6-7523-4394-bd74-760ae1cf259f tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:09.309909 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bc501bb6-7523-4394-bd74-760ae1cf259f tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:09.312932 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bc501bb6-7523-4394-bd74-760ae1cf259f tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:09.316326 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bc501bb6-7523-4394-bd74-760ae1cf259f tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:09.318649 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bc501bb6-7523-4394-bd74-760ae1cf259f tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:09.320678 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bc501bb6-7523-4394-bd74-760ae1cf259f tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:09.369242 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e1b9b062-2803-454f-9e0e-ebf51fb6b049 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:09.370176 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e1b9b062-2803-454f-9e0e-ebf51fb6b049 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:09.377959 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e1b9b062-2803-454f-9e0e-ebf51fb6b049 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:09.383619 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e1b9b062-2803-454f-9e0e-ebf51fb6b049 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:09.384232 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e1b9b062-2803-454f-9e0e-ebf51fb6b049 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:09.385110 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e1b9b062-2803-454f-9e0e-ebf51fb6b049 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:09.387740 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e1b9b062-2803-454f-9e0e-ebf51fb6b049 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:09.388313 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e1b9b062-2803-454f-9e0e-ebf51fb6b049 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:09.488013 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bc501bb6-7523-4394-bd74-760ae1cf259f tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:09.500823 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bc501bb6-7523-4394-bd74-760ae1cf259f tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:09.502826 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bc501bb6-7523-4394-bd74-760ae1cf259f tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:09.504646 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bc501bb6-7523-4394-bd74-760ae1cf259f tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] 10.222.0.13 "GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8" status: 200 len: 1405 microversion: 2.54 time: 0.216100 Oct 30 01:34:09.505211 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2345/4664] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:34:09 2022] GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8 => generated 1405 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:34:09.510582 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-506aaf23-b611-4213-b577-97d56ef12920 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1451612411", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "3640763f-f4c2-44a7-a718-e3c5cb52ad11"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:34:09.586805 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-506aaf23-b611-4213-b577-97d56ef12920 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] validate_networks() for [('3640763f-f4c2-44a7-a718-e3c5cb52ad11', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:34:09.659005 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:34:10.099162 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e1b9b062-2803-454f-9e0e-ebf51fb6b049 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:10.108332 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e1b9b062-2803-454f-9e0e-ebf51fb6b049 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1507 microversion: 2.1 time: 0.745968 Oct 30 01:34:10.109160 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2320/4665] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:09 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1507 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:34:10.115248 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a98c1ee8-456c-44fb-b22c-d8c50449c06a tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:10.115870 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a98c1ee8-456c-44fb-b22c-d8c50449c06a tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:10.122171 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a98c1ee8-456c-44fb-b22c-d8c50449c06a tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:10.122958 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a98c1ee8-456c-44fb-b22c-d8c50449c06a tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:10.123819 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a98c1ee8-456c-44fb-b22c-d8c50449c06a tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:10.124839 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a98c1ee8-456c-44fb-b22c-d8c50449c06a tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:10.125486 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a98c1ee8-456c-44fb-b22c-d8c50449c06a tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:10.126070 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a98c1ee8-456c-44fb-b22c-d8c50449c06a tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:10.129877 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:34:10.899163 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a98c1ee8-456c-44fb-b22c-d8c50449c06a tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:10.916277 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a98c1ee8-456c-44fb-b22c-d8c50449c06a tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:10.920411 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a98c1ee8-456c-44fb-b22c-d8c50449c06a tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:10.920411 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a98c1ee8-456c-44fb-b22c-d8c50449c06a tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 2928 microversion: 2.32 time: 0.809240 Oct 30 01:34:10.921126 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2321/4666] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:34:10 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 2928 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:34:10.927369 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9fab91c6-fbd7-412f-95f8-bc914f7dc6e4 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:10.928241 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9fab91c6-fbd7-412f-95f8-bc914f7dc6e4 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] [instance: 193565f7-ccc8-4f1d-a9b3-d949e09970e8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:10.935813 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9fab91c6-fbd7-412f-95f8-bc914f7dc6e4 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:10.936951 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9fab91c6-fbd7-412f-95f8-bc914f7dc6e4 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:10.937775 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9fab91c6-fbd7-412f-95f8-bc914f7dc6e4 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:10.938407 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9fab91c6-fbd7-412f-95f8-bc914f7dc6e4 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:10.938982 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9fab91c6-fbd7-412f-95f8-bc914f7dc6e4 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:10.939415 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9fab91c6-fbd7-412f-95f8-bc914f7dc6e4 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:11.202141 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9fab91c6-fbd7-412f-95f8-bc914f7dc6e4 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:11.228032 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9fab91c6-fbd7-412f-95f8-bc914f7dc6e4 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:11.232262 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9fab91c6-fbd7-412f-95f8-bc914f7dc6e4 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94cab57fc5184fc6be1cfde72e9bab26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f6da0fbf0024950b2c07a6db43ff3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:11.236482 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9fab91c6-fbd7-412f-95f8-bc914f7dc6e4 tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] 10.222.0.13 "GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8" status: 200 len: 1405 microversion: 2.54 time: 0.312455 Oct 30 01:34:11.237772 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2322/4667] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:34:10 2022] GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8 => generated 1405 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:34:11.249890 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-5fab01dc-2c0e-4881-baaa-5750454a68c0 req-9ec9c2d2-3182-484c-85c3-d8c4b759ec6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71a745a1-eaaf-4b96-8ed1-05e574cf4018", "name": "network-vif-unplugged", "status": "completed", "tag": "0768b27f-1e71-4099-8b05-caf0bb6c7954"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:34:11.269067 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-5fab01dc-2c0e-4881-baaa-5750454a68c0 req-9ec9c2d2-3182-484c-85c3-d8c4b759ec6e service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:11.270639 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-5fab01dc-2c0e-4881-baaa-5750454a68c0 req-9ec9c2d2-3182-484c-85c3-d8c4b759ec6e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:11.271349 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-5fab01dc-2c0e-4881-baaa-5750454a68c0 req-9ec9c2d2-3182-484c-85c3-d8c4b759ec6e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:11.296183 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-5fab01dc-2c0e-4881-baaa-5750454a68c0 req-9ec9c2d2-3182-484c-85c3-d8c4b759ec6e service nova] Creating event network-vif-unplugged:0768b27f-1e71-4099-8b05-caf0bb6c7954 for instance 71a745a1-eaaf-4b96-8ed1-05e574cf4018 on n-h2-master-1 Oct 30 01:34:11.308574 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-5fab01dc-2c0e-4881-baaa-5750454a68c0 req-9ec9c2d2-3182-484c-85c3-d8c4b759ec6e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063863 Oct 30 01:34:11.310727 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2323/4668] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:34:11.328677 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6529afbb-9f8a-4ad5-aeb5-cea0de42f3af tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:11.330871 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6529afbb-9f8a-4ad5-aeb5-cea0de42f3af tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:11.340084 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6529afbb-9f8a-4ad5-aeb5-cea0de42f3af tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:11.340830 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6529afbb-9f8a-4ad5-aeb5-cea0de42f3af tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:11.341858 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6529afbb-9f8a-4ad5-aeb5-cea0de42f3af tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:11.343180 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6529afbb-9f8a-4ad5-aeb5-cea0de42f3af tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:11.343794 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6529afbb-9f8a-4ad5-aeb5-cea0de42f3af tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:11.344537 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6529afbb-9f8a-4ad5-aeb5-cea0de42f3af tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:11.574533 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-506aaf23-b611-4213-b577-97d56ef12920 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:34:11.575554 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-506aaf23-b611-4213-b577-97d56ef12920 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:34:11.576260 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-506aaf23-b611-4213-b577-97d56ef12920 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:34:11.576890 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-506aaf23-b611-4213-b577-97d56ef12920 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:34:11.577376 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-506aaf23-b611-4213-b577-97d56ef12920 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:34:11.596038 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-506aaf23-b611-4213-b577-97d56ef12920 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:11.597205 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-506aaf23-b611-4213-b577-97d56ef12920 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:11.598191 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-506aaf23-b611-4213-b577-97d56ef12920 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:11.601409 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-506aaf23-b611-4213-b577-97d56ef12920 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:11.603192 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-506aaf23-b611-4213-b577-97d56ef12920 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:11.604411 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-506aaf23-b611-4213-b577-97d56ef12920 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:11.648840 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-506aaf23-b611-4213-b577-97d56ef12920 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Getting quotas for project 2b509d1b9c324201942dfeb350611a44. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:34:11.655271 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-506aaf23-b611-4213-b577-97d56ef12920 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Getting quotas for user 6f7675c0fa214588b71c04ca120557fc and project 2b509d1b9c324201942dfeb350611a44. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:34:11.669973 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-506aaf23-b611-4213-b577-97d56ef12920 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Going to run 2 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:34:11.673392 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-506aaf23-b611-4213-b577-97d56ef12920 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] [instance: 8d9a73e6-e331-4c3d-8891-d636c150c1eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:34:11.867124 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-506aaf23-b611-4213-b577-97d56ef12920 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] [instance: 949acdca-96a2-4077-b747-af87796dae5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=8d9a73e6-e331-4c3d-8891-d636c150c1eb,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:34:12.029864 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-506aaf23-b611-4213-b577-97d56ef12920 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.523345 Oct 30 01:34:12.031052 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2346/4669] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:34:09 2022] POST /compute/v2.1/servers => generated 32 bytes in 2525 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 30 01:34:12.042133 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b0954722-3812-4354-815f-959f1607456f tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:12.043951 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b0954722-3812-4354-815f-959f1607456f tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:12.051759 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0954722-3812-4354-815f-959f1607456f tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:12.061247 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0954722-3812-4354-815f-959f1607456f tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:12.061247 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0954722-3812-4354-815f-959f1607456f tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:12.061247 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0954722-3812-4354-815f-959f1607456f tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:12.061247 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0954722-3812-4354-815f-959f1607456f tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:12.061247 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0954722-3812-4354-815f-959f1607456f tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:12.596107 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6529afbb-9f8a-4ad5-aeb5-cea0de42f3af tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:12.610375 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6529afbb-9f8a-4ad5-aeb5-cea0de42f3af tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1450 microversion: 2.1 time: 1.294085 Oct 30 01:34:12.630682 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2324/4670] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:11 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1450 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:34:12.636539 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-945c5965-225c-4c12-b39a-f708923cdc91 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:12.641567 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-945c5965-225c-4c12-b39a-f708923cdc91 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6f7675c0fa214588b71c04ca120557fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b509d1b9c324201942dfeb350611a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:12.642736 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-945c5965-225c-4c12-b39a-f708923cdc91 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Searching by: {'deleted': False, 'project_id': '2b509d1b9c324201942dfeb350611a44'} {{(pid=121103) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 30 01:34:12.663052 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-945c5965-225c-4c12-b39a-f708923cdc91 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:12.664247 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-945c5965-225c-4c12-b39a-f708923cdc91 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:12.664856 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-945c5965-225c-4c12-b39a-f708923cdc91 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:12.665900 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-945c5965-225c-4c12-b39a-f708923cdc91 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:12.666740 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-945c5965-225c-4c12-b39a-f708923cdc91 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:12.667683 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-945c5965-225c-4c12-b39a-f708923cdc91 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:12.703399 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.multi_cell_list [None req-945c5965-225c-4c12-b39a-f708923cdc91 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=121103) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 30 01:34:12.747455 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-945c5965-225c-4c12-b39a-f708923cdc91 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 1337 microversion: 2.1 time: 0.116533 Oct 30 01:34:12.748984 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2325/4671] 10.222.0.13 () {58 vars in 1125 bytes} [Sun Oct 30 01:34:12 2022] GET /compute/v2.1/servers => generated 1337 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:34:12.756186 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-94838f4c-d216-40b4-81f6-ae98b7d6396f tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:12.756186 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-94838f4c-d216-40b4-81f6-ae98b7d6396f tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] [instance: 193565f7-ccc8-4f1d-a9b3-d949e09970e8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:12.764640 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94838f4c-d216-40b4-81f6-ae98b7d6396f tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:12.765497 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94838f4c-d216-40b4-81f6-ae98b7d6396f tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:12.766053 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94838f4c-d216-40b4-81f6-ae98b7d6396f tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:12.767423 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94838f4c-d216-40b4-81f6-ae98b7d6396f tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:12.768010 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94838f4c-d216-40b4-81f6-ae98b7d6396f tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:12.768723 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94838f4c-d216-40b4-81f6-ae98b7d6396f tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:12.789271 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-94838f4c-d216-40b4-81f6-ae98b7d6396f tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] HTTP exception thrown: Instance 193565f7-ccc8-4f1d-a9b3-d949e09970e8 could not be found. Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-94838f4c-d216-40b4-81f6-ae98b7d6396f tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Request method failure captured: Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8 HTTP/1.1 Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdRjuREpK1pNBd6ykwcllRnYjVkIpZp2X2NjZ6ooUHMXKp4NVGSLA8qvGeVr4Y8YWh4jZ_H5-gVw1cwX0SQ_fUOJzfijX19zXDFXZ9bVapAGhLeuTy5MMbvl4xHBHpqcN-AsFCwhuK2ZsErPcJwM5oYCY-E6T1pA-yY-Piq8rvatf0o Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: X-Openstack-Nova-Api-Version: 2.54 Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 3f6da0fbf0024950b2c07a6db43ff3a3 Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServerShowV254Test-1628517289 Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3f6da0fbf0024950b2c07a6db43ff3a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3f6da0fbf0024950b2c07a6db43ff3a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3f6da0fbf0024950b2c07a6db43ff3a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3f6da0fbf0024950b2c07a6db43ff3a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServerShowV254Test-1628517289 Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 3f6da0fbf0024950b2c07a6db43ff3a3 Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServerShowV254Test-1628517289 Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServerShowV254Test-1628517289-project Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 94cab57fc5184fc6be1cfde72e9bab26 Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServerShowV254Test-1628517289-project Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 193565f7-ccc8-4f1d-a9b3-d949e09970e8 could not be found. Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '193565f7-ccc8-4f1d-a9b3-d949e09970e8'} Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 193565f7-ccc8-4f1d-a9b3-d949e09970e8 could not be found. Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 193565f7-ccc8-4f1d-a9b3-d949e09970e8 could not be found. Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:34:12.791469 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:34:12.795646 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:34:12.795646 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:34:12.795646 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:34:12.795646 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:34:12.795646 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:34:12.795646 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 193565f7-ccc8-4f1d-a9b3-d949e09970e8 could not be found. Oct 30 01:34:12.795646 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:34:12.797432 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-94838f4c-d216-40b4-81f6-ae98b7d6396f tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] Returning 404 to user: Instance 193565f7-ccc8-4f1d-a9b3-d949e09970e8 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:34:12.799148 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-94838f4c-d216-40b4-81f6-ae98b7d6396f tempest-ServerShowV254Test-1628517289 tempest-ServerShowV254Test-1628517289-project] 10.222.0.13 "GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8" status: 404 len: 111 microversion: 2.54 time: 0.048232 Oct 30 01:34:12.805279 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2326/4672] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:34:12 2022] GET /compute/v2.1/servers/193565f7-ccc8-4f1d-a9b3-d949e09970e8 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:34:12.806228 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-019279c9-2985-4f1d-83da-5e267be82d9c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:12.807107 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-019279c9-2985-4f1d-83da-5e267be82d9c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:12.815791 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-019279c9-2985-4f1d-83da-5e267be82d9c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:12.817094 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-019279c9-2985-4f1d-83da-5e267be82d9c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:12.817934 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-019279c9-2985-4f1d-83da-5e267be82d9c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:12.818919 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-019279c9-2985-4f1d-83da-5e267be82d9c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:12.820021 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-019279c9-2985-4f1d-83da-5e267be82d9c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:12.821406 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-019279c9-2985-4f1d-83da-5e267be82d9c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:13.204592 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b0954722-3812-4354-815f-959f1607456f tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:13.220199 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b0954722-3812-4354-815f-959f1607456f tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:13.223999 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b0954722-3812-4354-815f-959f1607456f tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:13.225586 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b0954722-3812-4354-815f-959f1607456f tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 2907 microversion: 2.32 time: 1.193378 Oct 30 01:34:13.226696 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2347/4673] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:34:12 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 2907 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:34:13.267693 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8cd915fa-906f-4e41-b94f-e9fb8d164b95 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:13.268316 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8cd915fa-906f-4e41-b94f-e9fb8d164b95 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] [instance: 949acdca-96a2-4077-b747-af87796dae5c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:13.465315 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8cd915fa-906f-4e41-b94f-e9fb8d164b95 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7675c0fa214588b71c04ca120557fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b509d1b9c324201942dfeb350611a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:13.477410 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8cd915fa-906f-4e41-b94f-e9fb8d164b95 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] 10.222.0.13 "GET /compute/v2.1/servers/949acdca-96a2-4077-b747-af87796dae5c" status: 200 len: 1218 microversion: 2.1 time: 0.236737 Oct 30 01:34:13.478294 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2348/4674] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:13 2022] GET /compute/v2.1/servers/949acdca-96a2-4077-b747-af87796dae5c => generated 1218 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:34:13.502279 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-927f8806-7d05-43cf-a857-fcc78dc8386e req-b2239cfd-b64e-4784-b952-3d996639572b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71a745a1-eaaf-4b96-8ed1-05e574cf4018", "name": "network-vif-unplugged", "status": "completed", "tag": "d3003a3b-48ae-4930-aff4-2c14db9a20f6"}, {"server_uuid": "71a745a1-eaaf-4b96-8ed1-05e574cf4018", "name": "network-vif-unplugged", "status": "completed", "tag": "f28e0cc4-3563-4fc3-9871-48fe723f125c"}, {"server_uuid": "71a745a1-eaaf-4b96-8ed1-05e574cf4018", "name": "network-vif-unplugged", "status": "completed", "tag": "b1d21fa1-296a-49e9-8eb4-9815567f00c1"}, {"server_uuid": "b0c51345-2948-4ff1-828f-8c70b2b979f2", "name": "network-vif-unplugged", "status": "completed", "tag": "25297f9d-e65e-44db-bc94-b8ade234295f"}, {"server_uuid": "71a745a1-eaaf-4b96-8ed1-05e574cf4018", "name": "network-vif-unplugged", "status": "completed", "tag": "e93d2997-a301-4093-af8d-49bdcb2c57e1"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:34:13.520972 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-927f8806-7d05-43cf-a857-fcc78dc8386e req-b2239cfd-b64e-4784-b952-3d996639572b service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:13.521699 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-927f8806-7d05-43cf-a857-fcc78dc8386e req-b2239cfd-b64e-4784-b952-3d996639572b service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:13.522028 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-927f8806-7d05-43cf-a857-fcc78dc8386e req-b2239cfd-b64e-4784-b952-3d996639572b service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:13.537186 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-927f8806-7d05-43cf-a857-fcc78dc8386e req-b2239cfd-b64e-4784-b952-3d996639572b service nova] Creating event network-vif-unplugged:d3003a3b-48ae-4930-aff4-2c14db9a20f6 for instance 71a745a1-eaaf-4b96-8ed1-05e574cf4018 on n-h2-master-1 Oct 30 01:34:13.537781 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-927f8806-7d05-43cf-a857-fcc78dc8386e req-b2239cfd-b64e-4784-b952-3d996639572b service nova] Creating event network-vif-unplugged:f28e0cc4-3563-4fc3-9871-48fe723f125c for instance 71a745a1-eaaf-4b96-8ed1-05e574cf4018 on n-h2-master-1 Oct 30 01:34:13.547276 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-927f8806-7d05-43cf-a857-fcc78dc8386e req-b2239cfd-b64e-4784-b952-3d996639572b service nova] Creating event network-vif-unplugged:b1d21fa1-296a-49e9-8eb4-9815567f00c1 for instance 71a745a1-eaaf-4b96-8ed1-05e574cf4018 on n-h2-master-1 Oct 30 01:34:13.547276 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.compute.server_external_events [req-927f8806-7d05-43cf-a857-fcc78dc8386e req-b2239cfd-b64e-4784-b952-3d996639572b service nova] Unable to find a host for instance b0c51345-2948-4ff1-828f-8c70b2b979f2. Dropping event network-vif-unplugged {{(pid=121102) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 30 01:34:13.547276 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-927f8806-7d05-43cf-a857-fcc78dc8386e req-b2239cfd-b64e-4784-b952-3d996639572b service nova] Creating event network-vif-unplugged:e93d2997-a301-4093-af8d-49bdcb2c57e1 for instance 71a745a1-eaaf-4b96-8ed1-05e574cf4018 on n-h2-master-1 Oct 30 01:34:13.547276 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-927f8806-7d05-43cf-a857-fcc78dc8386e req-b2239cfd-b64e-4784-b952-3d996639572b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 874 microversion: 2.1 time: 0.056545 Oct 30 01:34:13.547666 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2349/4675] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 874 bytes in 69 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 30 01:34:13.609737 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-019279c9-2985-4f1d-83da-5e267be82d9c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:13.621638 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-019279c9-2985-4f1d-83da-5e267be82d9c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1450 microversion: 2.1 time: 0.820130 Oct 30 01:34:13.629246 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2327/4676] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:12 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1450 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:34:13.795787 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-64784667-c319-4479-b9e8-3f1bff3660ce tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:34:13.796342 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-64784667-c319-4479-b9e8-3f1bff3660ce tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:13.807916 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-64784667-c319-4479-b9e8-3f1bff3660ce tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:13.812167 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-64784667-c319-4479-b9e8-3f1bff3660ce tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:13.812873 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-64784667-c319-4479-b9e8-3f1bff3660ce tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:13.813864 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-64784667-c319-4479-b9e8-3f1bff3660ce tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:13.817053 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-64784667-c319-4479-b9e8-3f1bff3660ce tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:13.817751 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-64784667-c319-4479-b9e8-3f1bff3660ce tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:13.869715 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-64784667-c319-4479-b9e8-3f1bff3660ce tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lazy-loading 'flavor' on Instance uuid b0c51345-2948-4ff1-828f-8c70b2b979f2 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:34:13.897655 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-64784667-c319-4479-b9e8-3f1bff3660ce tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] HTTP exception thrown: Cannot 'shelve' instance b0c51345-2948-4ff1-828f-8c70b2b979f2 while it is in vm_state shelved_offloaded Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-64784667-c319-4479-b9e8-3f1bff3660ce tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Request method failure captured: Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2/action HTTP/1.1 Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 14 Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdPsZZXjRvWKe2zWP-5VH1VYAsWsLLjUmpyob2uINkfAXNLt0qGMmCTWjYn2WpZ3XOOdsuaM4lwk-qZrOIX3mOHzuCJPZ3r-9M-w153XBWLoTow-eSMj1bsAWDNo3KKhMzjHqic8AJ-DcXpdsBh93g0dRB_UMWMRrGyY1cbSRdHJrvg Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 0bce487302c24def8a8473b0725904f2 Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: {"shelve": {}} Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: exception: Cannot 'shelve' instance b0c51345-2948-4ff1-828f-8c70b2b979f2 while it is in vm_state shelved_offloaded Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'b0c51345-2948-4ff1-828f-8c70b2b979f2', 'body': {'shelve': {}}} Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b0c51345-2948-4ff1-828f-8c70b2b979f2 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 30 01:34:13.904418 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 30 01:34:13.908676 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance b0c51345-2948-4ff1-828f-8c70b2b979f2 while it is in vm_state shelved_offloaded Oct 30 01:34:13.908676 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:34:13.908676 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:34:13.908676 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:34:13.908676 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:34:13.908676 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:34:13.908676 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:34:13.908676 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:34:13.908676 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:34:13.908676 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance b0c51345-2948-4ff1-828f-8c70b2b979f2 while it is in vm_state shelved_offloaded Oct 30 01:34:13.908676 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:34:13.912581 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-64784667-c319-4479-b9e8-3f1bff3660ce tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Returning 409 to user: Cannot 'shelve' instance b0c51345-2948-4ff1-828f-8c70b2b979f2 while it is in vm_state shelved_offloaded {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:34:13.914402 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-64784667-c319-4479-b9e8-3f1bff3660ce tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "POST /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2/action" status: 409 len: 155 microversion: 2.1 time: 0.123326 Oct 30 01:34:13.918240 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2350/4677] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:34:13 2022] POST /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2/action => generated 155 bytes in 125 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:34:13.923899 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-169046a0-daa1-4554-80c1-5f6b588a1257 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:34:13.924776 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-169046a0-daa1-4554-80c1-5f6b588a1257 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:13.935049 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-169046a0-daa1-4554-80c1-5f6b588a1257 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:13.935567 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-169046a0-daa1-4554-80c1-5f6b588a1257 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:13.936047 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-169046a0-daa1-4554-80c1-5f6b588a1257 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:13.936758 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-169046a0-daa1-4554-80c1-5f6b588a1257 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:13.941439 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-169046a0-daa1-4554-80c1-5f6b588a1257 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:13.941439 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-169046a0-daa1-4554-80c1-5f6b588a1257 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:14.011802 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-169046a0-daa1-4554-80c1-5f6b588a1257 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121103) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 30 01:34:14.276971 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-900e4297-0d4d-48da-8b82-0d888a5bbe35 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:14.280219 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-900e4297-0d4d-48da-8b82-0d888a5bbe35 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:14.316546 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-900e4297-0d4d-48da-8b82-0d888a5bbe35 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:14.327375 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-900e4297-0d4d-48da-8b82-0d888a5bbe35 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:14.328349 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-900e4297-0d4d-48da-8b82-0d888a5bbe35 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:14.332680 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-900e4297-0d4d-48da-8b82-0d888a5bbe35 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:14.333795 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-900e4297-0d4d-48da-8b82-0d888a5bbe35 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:14.336688 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-900e4297-0d4d-48da-8b82-0d888a5bbe35 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:14.427668 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-169046a0-daa1-4554-80c1-5f6b588a1257 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "POST /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2/action" status: 202 len: 0 microversion: 2.1 time: 0.507664 Oct 30 01:34:14.442819 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2328/4678] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:34:13 2022] POST /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2/action => generated 0 bytes in 523 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:34:14.447839 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8a626a29-f29b-4df2-9540-fecac845b7a7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:14.448320 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8a626a29-f29b-4df2-9540-fecac845b7a7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:14.479636 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8a626a29-f29b-4df2-9540-fecac845b7a7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:14.485618 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8a626a29-f29b-4df2-9540-fecac845b7a7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:14.486216 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8a626a29-f29b-4df2-9540-fecac845b7a7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:14.487039 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8a626a29-f29b-4df2-9540-fecac845b7a7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:14.493094 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8a626a29-f29b-4df2-9540-fecac845b7a7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:14.493840 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8a626a29-f29b-4df2-9540-fecac845b7a7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:15.450588 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-900e4297-0d4d-48da-8b82-0d888a5bbe35 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:15.464841 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-900e4297-0d4d-48da-8b82-0d888a5bbe35 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:15.473286 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-900e4297-0d4d-48da-8b82-0d888a5bbe35 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:15.474845 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-900e4297-0d4d-48da-8b82-0d888a5bbe35 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 2861 microversion: 2.32 time: 1.216489 Oct 30 01:34:15.478853 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2351/4679] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:34:14 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 2861 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:34:15.490629 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2218961d-cba1-4d15-8963-3362581c53c1 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:15.491652 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2218961d-cba1-4d15-8963-3362581c53c1 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] [instance: 949acdca-96a2-4077-b747-af87796dae5c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:15.514326 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2218961d-cba1-4d15-8963-3362581c53c1 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:15.530986 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2218961d-cba1-4d15-8963-3362581c53c1 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:15.536785 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2218961d-cba1-4d15-8963-3362581c53c1 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:15.537906 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2218961d-cba1-4d15-8963-3362581c53c1 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:15.538632 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2218961d-cba1-4d15-8963-3362581c53c1 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:15.539251 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2218961d-cba1-4d15-8963-3362581c53c1 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:15.616149 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8a626a29-f29b-4df2-9540-fecac845b7a7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:15.626414 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8a626a29-f29b-4df2-9540-fecac845b7a7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1458 microversion: 2.1 time: 1.182521 Oct 30 01:34:15.627012 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2329/4680] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:14 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1458 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:34:15.700793 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2218961d-cba1-4d15-8963-3362581c53c1 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7675c0fa214588b71c04ca120557fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b509d1b9c324201942dfeb350611a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:15.750153 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-7b208b55-4aed-40d5-96e4-c5adf2b18473 req-d5642a9a-2158-4ac1-bd25-86018d03a2ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d16a8ce-36ce-488a-8782-856e088c6bc3", "name": "network-vif-deleted", "tag": "12eb42af-7e14-4d06-bfa6-e68587427952"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:34:15.750905 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2218961d-cba1-4d15-8963-3362581c53c1 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] 10.222.0.13 "GET /compute/v2.1/servers/949acdca-96a2-4077-b747-af87796dae5c" status: 200 len: 1214 microversion: 2.1 time: 0.255631 Oct 30 01:34:15.756006 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2352/4681] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:15 2022] GET /compute/v2.1/servers/949acdca-96a2-4077-b747-af87796dae5c => generated 1214 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:34:15.761162 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-7b208b55-4aed-40d5-96e4-c5adf2b18473 req-d5642a9a-2158-4ac1-bd25-86018d03a2ef service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:15.761680 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-7b208b55-4aed-40d5-96e4-c5adf2b18473 req-d5642a9a-2158-4ac1-bd25-86018d03a2ef service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:15.762251 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-7b208b55-4aed-40d5-96e4-c5adf2b18473 req-d5642a9a-2158-4ac1-bd25-86018d03a2ef service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:15.779596 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-7b208b55-4aed-40d5-96e4-c5adf2b18473 req-d5642a9a-2158-4ac1-bd25-86018d03a2ef service nova] Creating event network-vif-deleted:12eb42af-7e14-4d06-bfa6-e68587427952 for instance 0d16a8ce-36ce-488a-8782-856e088c6bc3 on n-h1-master-1 Oct 30 01:34:15.795079 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-7b208b55-4aed-40d5-96e4-c5adf2b18473 req-d5642a9a-2158-4ac1-bd25-86018d03a2ef service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160299 Oct 30 01:34:15.796274 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2330/4682] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:34:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:34:16.518573 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b71769b0-222c-48f5-bf79-8b7efd6109ee tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:16.519639 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b71769b0-222c-48f5-bf79-8b7efd6109ee tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:16.522129 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:34:16.555148 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b71769b0-222c-48f5-bf79-8b7efd6109ee tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:16.558277 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b71769b0-222c-48f5-bf79-8b7efd6109ee tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:16.562890 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b71769b0-222c-48f5-bf79-8b7efd6109ee tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:16.570789 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b71769b0-222c-48f5-bf79-8b7efd6109ee tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:16.570789 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b71769b0-222c-48f5-bf79-8b7efd6109ee tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:16.570789 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b71769b0-222c-48f5-bf79-8b7efd6109ee tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:16.651019 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-be6777ea-983c-485f-9e08-85680d9b5163 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:16.653098 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-be6777ea-983c-485f-9e08-85680d9b5163 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:16.671552 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-be6777ea-983c-485f-9e08-85680d9b5163 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:16.672369 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-be6777ea-983c-485f-9e08-85680d9b5163 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:16.673929 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-be6777ea-983c-485f-9e08-85680d9b5163 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:16.675942 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-be6777ea-983c-485f-9e08-85680d9b5163 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:16.678447 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-be6777ea-983c-485f-9e08-85680d9b5163 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:16.682404 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-be6777ea-983c-485f-9e08-85680d9b5163 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:17.370997 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b71769b0-222c-48f5-bf79-8b7efd6109ee tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:17.392022 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b71769b0-222c-48f5-bf79-8b7efd6109ee tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:17.396101 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b71769b0-222c-48f5-bf79-8b7efd6109ee tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:17.399380 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b71769b0-222c-48f5-bf79-8b7efd6109ee tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 2861 microversion: 2.32 time: 0.887183 Oct 30 01:34:17.401489 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2353/4683] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:34:16 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 2861 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:34:17.415036 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-db923a4f-2034-47c0-9bf4-e6f60e3c93eb tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:17.415675 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-db923a4f-2034-47c0-9bf4-e6f60e3c93eb tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] [instance: 949acdca-96a2-4077-b747-af87796dae5c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:17.433530 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-db923a4f-2034-47c0-9bf4-e6f60e3c93eb tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:17.440551 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-db923a4f-2034-47c0-9bf4-e6f60e3c93eb tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:17.440551 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-db923a4f-2034-47c0-9bf4-e6f60e3c93eb tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:17.440551 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-db923a4f-2034-47c0-9bf4-e6f60e3c93eb tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:17.440551 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-db923a4f-2034-47c0-9bf4-e6f60e3c93eb tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:17.440551 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-db923a4f-2034-47c0-9bf4-e6f60e3c93eb tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:17.570811 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-be6777ea-983c-485f-9e08-85680d9b5163 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:17.584157 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-be6777ea-983c-485f-9e08-85680d9b5163 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1458 microversion: 2.1 time: 0.937383 Oct 30 01:34:17.586390 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2331/4684] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:16 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1458 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:34:17.657305 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-db923a4f-2034-47c0-9bf4-e6f60e3c93eb tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7675c0fa214588b71c04ca120557fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b509d1b9c324201942dfeb350611a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:17.667152 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-db923a4f-2034-47c0-9bf4-e6f60e3c93eb tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] 10.222.0.13 "GET /compute/v2.1/servers/949acdca-96a2-4077-b747-af87796dae5c" status: 200 len: 1270 microversion: 2.1 time: 0.263345 Oct 30 01:34:17.667757 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2354/4685] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:17 2022] GET /compute/v2.1/servers/949acdca-96a2-4077-b747-af87796dae5c => generated 1270 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:34:17.855541 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-818be8a0-7703-4424-baed-2cf66dae4979 req-140e005b-da03-48b7-af5b-3c0a4878004d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30c573b5-586e-4d4d-ad6e-d826f25374eb", "name": "network-vif-deleted", "tag": "38cbaa97-b07f-4c77-86ad-8e026e45fd37"}, {"server_uuid": "71a745a1-eaaf-4b96-8ed1-05e574cf4018", "name": "network-vif-deleted", "tag": "f28e0cc4-3563-4fc3-9871-48fe723f125c"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:34:17.926999 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-818be8a0-7703-4424-baed-2cf66dae4979 req-140e005b-da03-48b7-af5b-3c0a4878004d service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:17.927751 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-818be8a0-7703-4424-baed-2cf66dae4979 req-140e005b-da03-48b7-af5b-3c0a4878004d service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:17.928511 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-818be8a0-7703-4424-baed-2cf66dae4979 req-140e005b-da03-48b7-af5b-3c0a4878004d service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:17.963034 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-818be8a0-7703-4424-baed-2cf66dae4979 req-140e005b-da03-48b7-af5b-3c0a4878004d service nova] Creating event network-vif-deleted:38cbaa97-b07f-4c77-86ad-8e026e45fd37 for instance 30c573b5-586e-4d4d-ad6e-d826f25374eb on n-h1-master-1 Oct 30 01:34:17.966056 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-818be8a0-7703-4424-baed-2cf66dae4979 req-140e005b-da03-48b7-af5b-3c0a4878004d service nova] Creating event network-vif-deleted:f28e0cc4-3563-4fc3-9871-48fe723f125c for instance 71a745a1-eaaf-4b96-8ed1-05e574cf4018 on n-h2-master-1 Oct 30 01:34:17.987751 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-818be8a0-7703-4424-baed-2cf66dae4979 req-140e005b-da03-48b7-af5b-3c0a4878004d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.144621 Oct 30 01:34:17.991834 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2332/4686] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:34:18.431921 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e565647b-4352-4cc6-be01-d737a6695e91 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:18.434597 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e565647b-4352-4cc6-be01-d737a6695e91 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:18.446778 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e565647b-4352-4cc6-be01-d737a6695e91 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:18.448923 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e565647b-4352-4cc6-be01-d737a6695e91 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:18.449723 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e565647b-4352-4cc6-be01-d737a6695e91 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:18.451139 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e565647b-4352-4cc6-be01-d737a6695e91 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:18.451940 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e565647b-4352-4cc6-be01-d737a6695e91 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:18.452608 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e565647b-4352-4cc6-be01-d737a6695e91 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:18.489457 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:34:18.608551 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-df21bf22-a60d-4de9-b226-f13ba41317a4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:18.609264 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-df21bf22-a60d-4de9-b226-f13ba41317a4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:18.622366 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df21bf22-a60d-4de9-b226-f13ba41317a4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:18.623935 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df21bf22-a60d-4de9-b226-f13ba41317a4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:18.624548 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df21bf22-a60d-4de9-b226-f13ba41317a4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:18.627506 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df21bf22-a60d-4de9-b226-f13ba41317a4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:18.628248 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df21bf22-a60d-4de9-b226-f13ba41317a4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:18.628847 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df21bf22-a60d-4de9-b226-f13ba41317a4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:19.495517 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e565647b-4352-4cc6-be01-d737a6695e91 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:19.531960 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e565647b-4352-4cc6-be01-d737a6695e91 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:19.536904 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e565647b-4352-4cc6-be01-d737a6695e91 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:19.544791 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e565647b-4352-4cc6-be01-d737a6695e91 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 2702 microversion: 2.32 time: 1.120287 Oct 30 01:34:19.576557 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2355/4687] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:34:18 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 2702 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:34:19.592934 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7500890e-1b77-4be5-9f59-8dfff845a3f1 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:19.596888 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7500890e-1b77-4be5-9f59-8dfff845a3f1 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] [instance: 949acdca-96a2-4077-b747-af87796dae5c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:19.629566 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7500890e-1b77-4be5-9f59-8dfff845a3f1 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:19.630274 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7500890e-1b77-4be5-9f59-8dfff845a3f1 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:19.630514 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7500890e-1b77-4be5-9f59-8dfff845a3f1 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:19.635028 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7500890e-1b77-4be5-9f59-8dfff845a3f1 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:19.635479 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7500890e-1b77-4be5-9f59-8dfff845a3f1 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:19.635940 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7500890e-1b77-4be5-9f59-8dfff845a3f1 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:19.913506 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-df21bf22-a60d-4de9-b226-f13ba41317a4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:19.928881 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-df21bf22-a60d-4de9-b226-f13ba41317a4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1516 microversion: 2.1 time: 1.325338 Oct 30 01:34:19.929538 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2333/4688] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:18 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1516 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:34:19.964551 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7500890e-1b77-4be5-9f59-8dfff845a3f1 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7675c0fa214588b71c04ca120557fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b509d1b9c324201942dfeb350611a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:19.980263 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7500890e-1b77-4be5-9f59-8dfff845a3f1 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] 10.222.0.13 "GET /compute/v2.1/servers/949acdca-96a2-4077-b747-af87796dae5c" status: 200 len: 1276 microversion: 2.1 time: 0.399956 Oct 30 01:34:19.983141 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2356/4689] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:19 2022] GET /compute/v2.1/servers/949acdca-96a2-4077-b747-af87796dae5c => generated 1276 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:34:20.088901 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-ed852713-e942-43bd-ae8d-f1c9d7a6542d req-ee2648a3-2a1e-4447-8872-654b77074e37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71a745a1-eaaf-4b96-8ed1-05e574cf4018", "name": "network-vif-deleted", "tag": "d3003a3b-48ae-4930-aff4-2c14db9a20f6"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:34:20.100169 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ed852713-e942-43bd-ae8d-f1c9d7a6542d req-ee2648a3-2a1e-4447-8872-654b77074e37 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:20.100853 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ed852713-e942-43bd-ae8d-f1c9d7a6542d req-ee2648a3-2a1e-4447-8872-654b77074e37 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:20.101474 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ed852713-e942-43bd-ae8d-f1c9d7a6542d req-ee2648a3-2a1e-4447-8872-654b77074e37 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:20.131024 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-ed852713-e942-43bd-ae8d-f1c9d7a6542d req-ee2648a3-2a1e-4447-8872-654b77074e37 service nova] Creating event network-vif-deleted:d3003a3b-48ae-4930-aff4-2c14db9a20f6 for instance 71a745a1-eaaf-4b96-8ed1-05e574cf4018 on n-h2-master-1 Oct 30 01:34:20.149642 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-ed852713-e942-43bd-ae8d-f1c9d7a6542d req-ee2648a3-2a1e-4447-8872-654b77074e37 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064982 Oct 30 01:34:20.151213 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2334/4690] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:34:20.578631 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f79b6df7-90f9-4f9e-ba9d-3186df0bb5a3 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:20.579947 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f79b6df7-90f9-4f9e-ba9d-3186df0bb5a3 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:20.593216 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f79b6df7-90f9-4f9e-ba9d-3186df0bb5a3 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:20.594096 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f79b6df7-90f9-4f9e-ba9d-3186df0bb5a3 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:20.594692 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f79b6df7-90f9-4f9e-ba9d-3186df0bb5a3 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:20.595568 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f79b6df7-90f9-4f9e-ba9d-3186df0bb5a3 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:20.600690 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f79b6df7-90f9-4f9e-ba9d-3186df0bb5a3 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:20.602622 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f79b6df7-90f9-4f9e-ba9d-3186df0bb5a3 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:20.968176 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-71db66d1-79be-49e4-b5b4-d23b886fd815 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:20.968974 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-71db66d1-79be-49e4-b5b4-d23b886fd815 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:20.998697 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-71db66d1-79be-49e4-b5b4-d23b886fd815 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:21.001168 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-71db66d1-79be-49e4-b5b4-d23b886fd815 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:21.001878 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-71db66d1-79be-49e4-b5b4-d23b886fd815 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:21.009063 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-71db66d1-79be-49e4-b5b4-d23b886fd815 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:21.011165 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-71db66d1-79be-49e4-b5b4-d23b886fd815 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:21.011888 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-71db66d1-79be-49e4-b5b4-d23b886fd815 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:21.448968 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f79b6df7-90f9-4f9e-ba9d-3186df0bb5a3 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:21.479966 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f79b6df7-90f9-4f9e-ba9d-3186df0bb5a3 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:21.481983 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f79b6df7-90f9-4f9e-ba9d-3186df0bb5a3 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:21.484081 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f79b6df7-90f9-4f9e-ba9d-3186df0bb5a3 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 2588 microversion: 2.32 time: 0.911841 Oct 30 01:34:21.486210 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2357/4691] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:34:20 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 2588 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:34:21.494607 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d02249e7-7c85-4d13-99dd-89ddbbc7822e tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:21.496088 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d02249e7-7c85-4d13-99dd-89ddbbc7822e tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] [instance: 949acdca-96a2-4077-b747-af87796dae5c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:21.507732 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d02249e7-7c85-4d13-99dd-89ddbbc7822e tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:21.508704 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d02249e7-7c85-4d13-99dd-89ddbbc7822e tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:21.509854 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d02249e7-7c85-4d13-99dd-89ddbbc7822e tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:21.511778 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d02249e7-7c85-4d13-99dd-89ddbbc7822e tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:21.512486 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d02249e7-7c85-4d13-99dd-89ddbbc7822e tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:21.517758 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d02249e7-7c85-4d13-99dd-89ddbbc7822e tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:21.627608 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:34:22.330648 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-71db66d1-79be-49e4-b5b4-d23b886fd815 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:22.357355 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-71db66d1-79be-49e4-b5b4-d23b886fd815 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1516 microversion: 2.1 time: 1.402296 Oct 30 01:34:22.359637 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2335/4692] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:20 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1516 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:34:22.520654 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f71ac939-81b9-42d4-9cf8-ecafbe68068e tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:22.521308 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f71ac939-81b9-42d4-9cf8-ecafbe68068e tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:22.531087 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f71ac939-81b9-42d4-9cf8-ecafbe68068e tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:22.531802 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f71ac939-81b9-42d4-9cf8-ecafbe68068e tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:22.532630 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f71ac939-81b9-42d4-9cf8-ecafbe68068e tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:22.534182 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f71ac939-81b9-42d4-9cf8-ecafbe68068e tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:22.535142 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f71ac939-81b9-42d4-9cf8-ecafbe68068e tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:22.535783 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f71ac939-81b9-42d4-9cf8-ecafbe68068e tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:22.676841 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:34:22.771103 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d02249e7-7c85-4d13-99dd-89ddbbc7822e tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7675c0fa214588b71c04ca120557fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b509d1b9c324201942dfeb350611a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:22.780913 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d02249e7-7c85-4d13-99dd-89ddbbc7822e tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] 10.222.0.13 "GET /compute/v2.1/servers/949acdca-96a2-4077-b747-af87796dae5c" status: 200 len: 1318 microversion: 2.1 time: 1.293293 Oct 30 01:34:22.781720 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2358/4693] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:21 2022] GET /compute/v2.1/servers/949acdca-96a2-4077-b747-af87796dae5c => generated 1318 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:34:22.989894 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-deb303df-0e90-4f0d-bd6d-02d8b129dfc2 req-c72f4491-0839-4906-bfee-4b6eb1ce80d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0c51345-2948-4ff1-828f-8c70b2b979f2", "tag": "25297f9d-e65e-44db-bc94-b8ade234295f"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:34:23.002439 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-deb303df-0e90-4f0d-bd6d-02d8b129dfc2 req-c72f4491-0839-4906-bfee-4b6eb1ce80d6 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:23.012793 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-deb303df-0e90-4f0d-bd6d-02d8b129dfc2 req-c72f4491-0839-4906-bfee-4b6eb1ce80d6 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:23.012793 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-deb303df-0e90-4f0d-bd6d-02d8b129dfc2 req-c72f4491-0839-4906-bfee-4b6eb1ce80d6 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:23.022954 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-deb303df-0e90-4f0d-bd6d-02d8b129dfc2 req-c72f4491-0839-4906-bfee-4b6eb1ce80d6 service nova] Creating event network-changed:25297f9d-e65e-44db-bc94-b8ade234295f for instance b0c51345-2948-4ff1-828f-8c70b2b979f2 on n-h1-master-1 Oct 30 01:34:23.028861 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-deb303df-0e90-4f0d-bd6d-02d8b129dfc2 req-c72f4491-0839-4906-bfee-4b6eb1ce80d6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046459 Oct 30 01:34:23.029612 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2359/4694] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:34:23.063773 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f71ac939-81b9-42d4-9cf8-ecafbe68068e tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:23.077407 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f71ac939-81b9-42d4-9cf8-ecafbe68068e tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:23.079239 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f71ac939-81b9-42d4-9cf8-ecafbe68068e tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:23.080643 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f71ac939-81b9-42d4-9cf8-ecafbe68068e tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 2542 microversion: 2.32 time: 0.566319 Oct 30 01:34:23.081701 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2336/4695] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:34:22 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 2542 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:34:23.384665 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4888b902-53fd-4e64-a388-dc5bcf7a8a11 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:23.385560 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4888b902-53fd-4e64-a388-dc5bcf7a8a11 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:23.400458 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4888b902-53fd-4e64-a388-dc5bcf7a8a11 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:23.404478 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4888b902-53fd-4e64-a388-dc5bcf7a8a11 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:23.405232 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4888b902-53fd-4e64-a388-dc5bcf7a8a11 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:23.406290 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4888b902-53fd-4e64-a388-dc5bcf7a8a11 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:23.407431 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4888b902-53fd-4e64-a388-dc5bcf7a8a11 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:23.407431 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4888b902-53fd-4e64-a388-dc5bcf7a8a11 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:23.473916 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=8 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:34:23.807209 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5ac82cf5-6789-44f3-bb84-201b28173568 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:23.808805 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5ac82cf5-6789-44f3-bb84-201b28173568 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] [instance: 949acdca-96a2-4077-b747-af87796dae5c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:23.825768 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ac82cf5-6789-44f3-bb84-201b28173568 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:23.831781 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ac82cf5-6789-44f3-bb84-201b28173568 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:23.831781 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ac82cf5-6789-44f3-bb84-201b28173568 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:23.831781 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ac82cf5-6789-44f3-bb84-201b28173568 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:23.831781 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ac82cf5-6789-44f3-bb84-201b28173568 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:23.831781 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ac82cf5-6789-44f3-bb84-201b28173568 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:24.158282 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4888b902-53fd-4e64-a388-dc5bcf7a8a11 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:24.192708 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4888b902-53fd-4e64-a388-dc5bcf7a8a11 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1516 microversion: 2.1 time: 0.805548 Oct 30 01:34:24.208542 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2360/4696] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:23 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1516 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:34:24.229724 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2d8c4cc7-c3ce-4404-85e8-501eda72caa5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:24.231711 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2d8c4cc7-c3ce-4404-85e8-501eda72caa5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:24.250753 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2d8c4cc7-c3ce-4404-85e8-501eda72caa5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:24.264326 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5ac82cf5-6789-44f3-bb84-201b28173568 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7675c0fa214588b71c04ca120557fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b509d1b9c324201942dfeb350611a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:24.275171 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2d8c4cc7-c3ce-4404-85e8-501eda72caa5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:24.276653 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2d8c4cc7-c3ce-4404-85e8-501eda72caa5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:24.277392 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5ac82cf5-6789-44f3-bb84-201b28173568 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] 10.222.0.13 "GET /compute/v2.1/servers/949acdca-96a2-4077-b747-af87796dae5c" status: 200 len: 1318 microversion: 2.1 time: 0.473822 Oct 30 01:34:24.277712 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2d8c4cc7-c3ce-4404-85e8-501eda72caa5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:24.278203 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2d8c4cc7-c3ce-4404-85e8-501eda72caa5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:24.279283 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2337/4697] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:23 2022] GET /compute/v2.1/servers/949acdca-96a2-4077-b747-af87796dae5c => generated 1318 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:34:24.279863 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2d8c4cc7-c3ce-4404-85e8-501eda72caa5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:24.284243 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-0a47580f-e09d-46b3-93dc-6f65887a1ebf req-8d182510-7d3a-4118-a643-129c6a3bad69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d9a73e6-e331-4c3d-8891-d636c150c1eb", "tag": "edfbdcb1-3f28-46df-aaa9-604761f06264"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:34:24.295274 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-0a47580f-e09d-46b3-93dc-6f65887a1ebf req-8d182510-7d3a-4118-a643-129c6a3bad69 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:24.297623 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-0a47580f-e09d-46b3-93dc-6f65887a1ebf req-8d182510-7d3a-4118-a643-129c6a3bad69 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:24.297623 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-0a47580f-e09d-46b3-93dc-6f65887a1ebf req-8d182510-7d3a-4118-a643-129c6a3bad69 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:24.321099 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-0a47580f-e09d-46b3-93dc-6f65887a1ebf req-8d182510-7d3a-4118-a643-129c6a3bad69 service nova] Creating event network-changed:edfbdcb1-3f28-46df-aaa9-604761f06264 for instance 8d9a73e6-e331-4c3d-8891-d636c150c1eb on n-h2-master-1 Oct 30 01:34:24.332741 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-0a47580f-e09d-46b3-93dc-6f65887a1ebf req-8d182510-7d3a-4118-a643-129c6a3bad69 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051274 Oct 30 01:34:24.333704 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2338/4698] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:34:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:34:24.752905 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2d8c4cc7-c3ce-4404-85e8-501eda72caa5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:24.770823 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2d8c4cc7-c3ce-4404-85e8-501eda72caa5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:24.774449 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2d8c4cc7-c3ce-4404-85e8-501eda72caa5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:24.789534 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2d8c4cc7-c3ce-4404-85e8-501eda72caa5 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 2542 microversion: 2.32 time: 0.568259 Oct 30 01:34:24.789534 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2361/4699] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:34:24 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 2542 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:34:25.220754 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d964a1e8-062f-4a43-8278-391e794e2809 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:25.222708 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d964a1e8-062f-4a43-8278-391e794e2809 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:25.238557 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d964a1e8-062f-4a43-8278-391e794e2809 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:25.239465 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d964a1e8-062f-4a43-8278-391e794e2809 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:25.241815 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d964a1e8-062f-4a43-8278-391e794e2809 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:25.242973 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d964a1e8-062f-4a43-8278-391e794e2809 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:25.243902 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d964a1e8-062f-4a43-8278-391e794e2809 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:25.245870 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d964a1e8-062f-4a43-8278-391e794e2809 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:25.305765 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bff0a0c8-cb15-4227-8816-ecf54649013b tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:25.306382 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bff0a0c8-cb15-4227-8816-ecf54649013b tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] [instance: 949acdca-96a2-4077-b747-af87796dae5c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:25.339336 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bff0a0c8-cb15-4227-8816-ecf54649013b tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:25.339336 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bff0a0c8-cb15-4227-8816-ecf54649013b tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:25.339336 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bff0a0c8-cb15-4227-8816-ecf54649013b tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:25.339336 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bff0a0c8-cb15-4227-8816-ecf54649013b tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:25.339336 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bff0a0c8-cb15-4227-8816-ecf54649013b tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:25.339336 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bff0a0c8-cb15-4227-8816-ecf54649013b tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:26.131056 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d964a1e8-062f-4a43-8278-391e794e2809 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:26.142351 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d964a1e8-062f-4a43-8278-391e794e2809 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1516 microversion: 2.1 time: 0.925855 Oct 30 01:34:26.151486 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2339/4700] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:25 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1516 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:34:26.158153 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-efc06b1d-2946-4c06-b862-339ec84a56e7 req-803148e0-f98c-4dfc-b5e1-d853c506195c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71a745a1-eaaf-4b96-8ed1-05e574cf4018", "name": "network-vif-deleted", "tag": "0768b27f-1e71-4099-8b05-caf0bb6c7954"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:34:26.185256 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-efc06b1d-2946-4c06-b862-339ec84a56e7 req-803148e0-f98c-4dfc-b5e1-d853c506195c service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:26.188044 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-efc06b1d-2946-4c06-b862-339ec84a56e7 req-803148e0-f98c-4dfc-b5e1-d853c506195c service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:26.188965 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-efc06b1d-2946-4c06-b862-339ec84a56e7 req-803148e0-f98c-4dfc-b5e1-d853c506195c service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:26.220203 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-efc06b1d-2946-4c06-b862-339ec84a56e7 req-803148e0-f98c-4dfc-b5e1-d853c506195c service nova] Creating event network-vif-deleted:0768b27f-1e71-4099-8b05-caf0bb6c7954 for instance 71a745a1-eaaf-4b96-8ed1-05e574cf4018 on n-h2-master-1 Oct 30 01:34:26.239129 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-efc06b1d-2946-4c06-b862-339ec84a56e7 req-803148e0-f98c-4dfc-b5e1-d853c506195c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088868 Oct 30 01:34:26.240633 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2340/4701] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:34:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:34:26.256196 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1d260321-8d17-45b9-9b4f-e5bd7319c962 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:26.259125 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1d260321-8d17-45b9-9b4f-e5bd7319c962 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:26.282291 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1d260321-8d17-45b9-9b4f-e5bd7319c962 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:26.282807 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1d260321-8d17-45b9-9b4f-e5bd7319c962 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:26.283253 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1d260321-8d17-45b9-9b4f-e5bd7319c962 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:26.286157 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1d260321-8d17-45b9-9b4f-e5bd7319c962 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:26.286645 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1d260321-8d17-45b9-9b4f-e5bd7319c962 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:26.287090 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1d260321-8d17-45b9-9b4f-e5bd7319c962 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:26.311616 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:34:26.599159 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bff0a0c8-cb15-4227-8816-ecf54649013b tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7675c0fa214588b71c04ca120557fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b509d1b9c324201942dfeb350611a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:26.633204 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bff0a0c8-cb15-4227-8816-ecf54649013b tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] 10.222.0.13 "GET /compute/v2.1/servers/949acdca-96a2-4077-b747-af87796dae5c" status: 200 len: 1318 microversion: 2.1 time: 1.313895 Oct 30 01:34:26.648907 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2362/4702] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:25 2022] GET /compute/v2.1/servers/949acdca-96a2-4077-b747-af87796dae5c => generated 1318 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:34:26.658206 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-0aa38172-65b4-4535-92d5-0a58d4c65550 req-316a2733-08ec-4fbd-80bb-b77a2f2a38e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "949acdca-96a2-4077-b747-af87796dae5c", "tag": "f1e1ccbf-5715-40ca-97c2-f678ba59dc24"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:34:26.668769 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-0aa38172-65b4-4535-92d5-0a58d4c65550 req-316a2733-08ec-4fbd-80bb-b77a2f2a38e5 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:26.669753 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-0aa38172-65b4-4535-92d5-0a58d4c65550 req-316a2733-08ec-4fbd-80bb-b77a2f2a38e5 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:26.670395 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-0aa38172-65b4-4535-92d5-0a58d4c65550 req-316a2733-08ec-4fbd-80bb-b77a2f2a38e5 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:26.685662 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-0aa38172-65b4-4535-92d5-0a58d4c65550 req-316a2733-08ec-4fbd-80bb-b77a2f2a38e5 service nova] Creating event network-changed:f1e1ccbf-5715-40ca-97c2-f678ba59dc24 for instance 949acdca-96a2-4077-b747-af87796dae5c on n-h2-master-1 Oct 30 01:34:26.699556 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-0aa38172-65b4-4535-92d5-0a58d4c65550 req-316a2733-08ec-4fbd-80bb-b77a2f2a38e5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049980 Oct 30 01:34:26.706676 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2363/4703] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:34:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:34:27.002925 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1d260321-8d17-45b9-9b4f-e5bd7319c962 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:27.038376 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1d260321-8d17-45b9-9b4f-e5bd7319c962 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:27.047448 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1d260321-8d17-45b9-9b4f-e5bd7319c962 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:27.057807 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1d260321-8d17-45b9-9b4f-e5bd7319c962 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 2496 microversion: 2.32 time: 0.804098 Oct 30 01:34:27.063102 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2341/4704] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:34:26 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 2496 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:34:27.178774 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-54b75c85-75c9-48b8-93c2-583f23ebe86d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:27.180363 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-54b75c85-75c9-48b8-93c2-583f23ebe86d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:27.193231 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-54b75c85-75c9-48b8-93c2-583f23ebe86d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:27.194065 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-54b75c85-75c9-48b8-93c2-583f23ebe86d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:27.194727 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-54b75c85-75c9-48b8-93c2-583f23ebe86d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:27.195666 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-54b75c85-75c9-48b8-93c2-583f23ebe86d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:27.197163 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-54b75c85-75c9-48b8-93c2-583f23ebe86d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:27.198049 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-54b75c85-75c9-48b8-93c2-583f23ebe86d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:27.644727 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a15480ec-ea1b-4ee4-a999-453d01fbff83 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:27.645301 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a15480ec-ea1b-4ee4-a999-453d01fbff83 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] [instance: 949acdca-96a2-4077-b747-af87796dae5c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:27.666388 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a15480ec-ea1b-4ee4-a999-453d01fbff83 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:27.666886 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a15480ec-ea1b-4ee4-a999-453d01fbff83 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:27.667325 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a15480ec-ea1b-4ee4-a999-453d01fbff83 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:27.668042 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a15480ec-ea1b-4ee4-a999-453d01fbff83 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:27.668501 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a15480ec-ea1b-4ee4-a999-453d01fbff83 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:27.671346 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a15480ec-ea1b-4ee4-a999-453d01fbff83 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:28.343161 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-54b75c85-75c9-48b8-93c2-583f23ebe86d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:28.358537 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-54b75c85-75c9-48b8-93c2-583f23ebe86d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1516 microversion: 2.1 time: 1.193029 Oct 30 01:34:28.363580 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2364/4705] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:27 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1516 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:34:28.368645 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5892ae14-4c3c-48ae-968b-e82e0898a551 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:28.374968 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5892ae14-4c3c-48ae-968b-e82e0898a551 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:28.397212 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5892ae14-4c3c-48ae-968b-e82e0898a551 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:28.403389 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5892ae14-4c3c-48ae-968b-e82e0898a551 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:28.405362 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5892ae14-4c3c-48ae-968b-e82e0898a551 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:28.406492 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5892ae14-4c3c-48ae-968b-e82e0898a551 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:28.409502 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5892ae14-4c3c-48ae-968b-e82e0898a551 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:28.410840 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5892ae14-4c3c-48ae-968b-e82e0898a551 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:28.411360 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a15480ec-ea1b-4ee4-a999-453d01fbff83 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7675c0fa214588b71c04ca120557fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b509d1b9c324201942dfeb350611a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:28.475295 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a15480ec-ea1b-4ee4-a999-453d01fbff83 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] 10.222.0.13 "GET /compute/v2.1/servers/949acdca-96a2-4077-b747-af87796dae5c" status: 200 len: 1318 microversion: 2.1 time: 0.836949 Oct 30 01:34:28.484260 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2342/4706] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:27 2022] GET /compute/v2.1/servers/949acdca-96a2-4077-b747-af87796dae5c => generated 1318 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:34:28.672216 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5892ae14-4c3c-48ae-968b-e82e0898a551 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:28.714867 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5892ae14-4c3c-48ae-968b-e82e0898a551 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:28.718587 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5892ae14-4c3c-48ae-968b-e82e0898a551 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:28.723767 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5892ae14-4c3c-48ae-968b-e82e0898a551 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 2143 microversion: 2.32 time: 0.358877 Oct 30 01:34:28.729010 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2365/4707] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:34:28 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 2143 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:34:28.747640 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-b8916579-1b0c-4d61-89b4-be4dc676ff02 req-668be492-0c08-43b9-883b-bcdae3cd1c28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71a745a1-eaaf-4b96-8ed1-05e574cf4018", "name": "network-vif-deleted", "tag": "b1d21fa1-296a-49e9-8eb4-9815567f00c1"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:34:28.835480 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-b8916579-1b0c-4d61-89b4-be4dc676ff02 req-668be492-0c08-43b9-883b-bcdae3cd1c28 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:28.841493 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-b8916579-1b0c-4d61-89b4-be4dc676ff02 req-668be492-0c08-43b9-883b-bcdae3cd1c28 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:28.842382 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-b8916579-1b0c-4d61-89b4-be4dc676ff02 req-668be492-0c08-43b9-883b-bcdae3cd1c28 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:28.871525 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-b8916579-1b0c-4d61-89b4-be4dc676ff02 req-668be492-0c08-43b9-883b-bcdae3cd1c28 service nova] Creating event network-vif-deleted:b1d21fa1-296a-49e9-8eb4-9815567f00c1 for instance 71a745a1-eaaf-4b96-8ed1-05e574cf4018 on n-h2-master-1 Oct 30 01:34:28.924949 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-b8916579-1b0c-4d61-89b4-be4dc676ff02 req-668be492-0c08-43b9-883b-bcdae3cd1c28 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.195293 Oct 30 01:34:28.928280 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2343/4708] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:34:29.388718 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3b9e15e8-e226-4d98-a77f-23df24cf051f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:29.389467 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3b9e15e8-e226-4d98-a77f-23df24cf051f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:29.411070 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3b9e15e8-e226-4d98-a77f-23df24cf051f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:29.419460 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3b9e15e8-e226-4d98-a77f-23df24cf051f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:29.420052 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3b9e15e8-e226-4d98-a77f-23df24cf051f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:29.420841 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3b9e15e8-e226-4d98-a77f-23df24cf051f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:29.421532 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3b9e15e8-e226-4d98-a77f-23df24cf051f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:29.421918 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3b9e15e8-e226-4d98-a77f-23df24cf051f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:29.512619 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-22550c3a-062d-48d2-bba8-4442809f327c tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:29.517786 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-22550c3a-062d-48d2-bba8-4442809f327c tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] [instance: 949acdca-96a2-4077-b747-af87796dae5c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:29.545784 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22550c3a-062d-48d2-bba8-4442809f327c tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:29.546622 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22550c3a-062d-48d2-bba8-4442809f327c tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:29.548024 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22550c3a-062d-48d2-bba8-4442809f327c tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:29.550863 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22550c3a-062d-48d2-bba8-4442809f327c tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:29.552380 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22550c3a-062d-48d2-bba8-4442809f327c tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:29.553991 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22550c3a-062d-48d2-bba8-4442809f327c tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:30.053297 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3b9e15e8-e226-4d98-a77f-23df24cf051f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:30.066068 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3b9e15e8-e226-4d98-a77f-23df24cf051f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1516 microversion: 2.1 time: 0.678106 Oct 30 01:34:30.067894 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2366/4709] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:29 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1516 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:34:30.082774 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5a3d0272-f3ad-4cb9-a4a5-1559dbf1fcc7 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:30.082774 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5a3d0272-f3ad-4cb9-a4a5-1559dbf1fcc7 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:30.112813 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a3d0272-f3ad-4cb9-a4a5-1559dbf1fcc7 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:30.113321 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a3d0272-f3ad-4cb9-a4a5-1559dbf1fcc7 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:30.120898 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a3d0272-f3ad-4cb9-a4a5-1559dbf1fcc7 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:30.121768 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a3d0272-f3ad-4cb9-a4a5-1559dbf1fcc7 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:30.122511 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a3d0272-f3ad-4cb9-a4a5-1559dbf1fcc7 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:30.122956 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a3d0272-f3ad-4cb9-a4a5-1559dbf1fcc7 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:30.267247 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-22550c3a-062d-48d2-bba8-4442809f327c tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7675c0fa214588b71c04ca120557fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b509d1b9c324201942dfeb350611a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:30.272319 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5a3d0272-f3ad-4cb9-a4a5-1559dbf1fcc7 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:30.289249 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-22550c3a-062d-48d2-bba8-4442809f327c tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] 10.222.0.13 "GET /compute/v2.1/servers/949acdca-96a2-4077-b747-af87796dae5c" status: 200 len: 1318 microversion: 2.1 time: 0.785485 Oct 30 01:34:30.289812 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2344/4710] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:29 2022] GET /compute/v2.1/servers/949acdca-96a2-4077-b747-af87796dae5c => generated 1318 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:34:30.297029 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5a3d0272-f3ad-4cb9-a4a5-1559dbf1fcc7 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:30.298751 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5a3d0272-f3ad-4cb9-a4a5-1559dbf1fcc7 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:30.303643 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5a3d0272-f3ad-4cb9-a4a5-1559dbf1fcc7 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1603 microversion: 2.32 time: 0.234526 Oct 30 01:34:30.306132 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2367/4711] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:34:30 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1603 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:34:31.093864 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-090e5386-4ac2-4dba-8c70-0889b4225f23 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:31.094644 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-090e5386-4ac2-4dba-8c70-0889b4225f23 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:31.103624 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-090e5386-4ac2-4dba-8c70-0889b4225f23 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:31.108785 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-090e5386-4ac2-4dba-8c70-0889b4225f23 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:31.109514 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-090e5386-4ac2-4dba-8c70-0889b4225f23 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:31.112419 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-090e5386-4ac2-4dba-8c70-0889b4225f23 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:31.114615 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-090e5386-4ac2-4dba-8c70-0889b4225f23 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:31.115343 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-090e5386-4ac2-4dba-8c70-0889b4225f23 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:31.251068 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-4bf09ddb-ce99-4701-9013-c41306201b0d req-c7f8fd8d-17fe-448e-b667-d883ae83e089 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71a745a1-eaaf-4b96-8ed1-05e574cf4018", "name": "network-vif-deleted", "tag": "e93d2997-a301-4093-af8d-49bdcb2c57e1"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:34:31.273486 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-4bf09ddb-ce99-4701-9013-c41306201b0d req-c7f8fd8d-17fe-448e-b667-d883ae83e089 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:31.275296 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-4bf09ddb-ce99-4701-9013-c41306201b0d req-c7f8fd8d-17fe-448e-b667-d883ae83e089 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:31.275296 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-4bf09ddb-ce99-4701-9013-c41306201b0d req-c7f8fd8d-17fe-448e-b667-d883ae83e089 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:31.301578 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-4bf09ddb-ce99-4701-9013-c41306201b0d req-c7f8fd8d-17fe-448e-b667-d883ae83e089 service nova] Creating event network-vif-deleted:e93d2997-a301-4093-af8d-49bdcb2c57e1 for instance 71a745a1-eaaf-4b96-8ed1-05e574cf4018 on n-h2-master-1 Oct 30 01:34:31.318576 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-4bf09ddb-ce99-4701-9013-c41306201b0d req-c7f8fd8d-17fe-448e-b667-d883ae83e089 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071817 Oct 30 01:34:31.319725 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2368/4712] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:34:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:34:31.333900 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3c32a7ce-2da9-41ef-a1bf-faf25b139b1c tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:31.335007 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3c32a7ce-2da9-41ef-a1bf-faf25b139b1c tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] [instance: 949acdca-96a2-4077-b747-af87796dae5c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:31.356187 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3c32a7ce-2da9-41ef-a1bf-faf25b139b1c tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:31.357297 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3c32a7ce-2da9-41ef-a1bf-faf25b139b1c tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:31.358060 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3c32a7ce-2da9-41ef-a1bf-faf25b139b1c tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:31.359037 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3c32a7ce-2da9-41ef-a1bf-faf25b139b1c tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:31.362689 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3c32a7ce-2da9-41ef-a1bf-faf25b139b1c tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:31.363672 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3c32a7ce-2da9-41ef-a1bf-faf25b139b1c tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:31.475801 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-090e5386-4ac2-4dba-8c70-0889b4225f23 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:31.485777 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-090e5386-4ac2-4dba-8c70-0889b4225f23 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1516 microversion: 2.1 time: 0.395658 Oct 30 01:34:31.505269 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2345/4713] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:31 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1516 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:34:31.516047 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-43724203-ca8c-40e0-afc3-ba266e1927f3 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:31.516789 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-43724203-ca8c-40e0-afc3-ba266e1927f3 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:31.539286 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-43724203-ca8c-40e0-afc3-ba266e1927f3 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:31.539805 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-43724203-ca8c-40e0-afc3-ba266e1927f3 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:31.540253 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-43724203-ca8c-40e0-afc3-ba266e1927f3 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:31.540987 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-43724203-ca8c-40e0-afc3-ba266e1927f3 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:31.545587 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-43724203-ca8c-40e0-afc3-ba266e1927f3 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:31.546347 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-43724203-ca8c-40e0-afc3-ba266e1927f3 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:31.794647 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-43724203-ca8c-40e0-afc3-ba266e1927f3 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:31.810083 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-43724203-ca8c-40e0-afc3-ba266e1927f3 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:31.813962 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-43724203-ca8c-40e0-afc3-ba266e1927f3 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:31.826679 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-43724203-ca8c-40e0-afc3-ba266e1927f3 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1603 microversion: 2.32 time: 0.325236 Oct 30 01:34:31.844863 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2346/4714] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:34:31 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1603 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:34:32.434220 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3c32a7ce-2da9-41ef-a1bf-faf25b139b1c tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7675c0fa214588b71c04ca120557fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b509d1b9c324201942dfeb350611a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:32.450147 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3c32a7ce-2da9-41ef-a1bf-faf25b139b1c tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] 10.222.0.13 "GET /compute/v2.1/servers/949acdca-96a2-4077-b747-af87796dae5c" status: 200 len: 1318 microversion: 2.1 time: 1.127487 Oct 30 01:34:32.452668 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2369/4715] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:31 2022] GET /compute/v2.1/servers/949acdca-96a2-4077-b747-af87796dae5c => generated 1318 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:34:32.527194 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-61227a86-3219-47c9-b2e6-302fcda3e50b tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:32.528491 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-61227a86-3219-47c9-b2e6-302fcda3e50b tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:32.547185 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-61227a86-3219-47c9-b2e6-302fcda3e50b tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:32.548127 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-61227a86-3219-47c9-b2e6-302fcda3e50b tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:32.549615 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-61227a86-3219-47c9-b2e6-302fcda3e50b tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:32.551116 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-61227a86-3219-47c9-b2e6-302fcda3e50b tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:32.557139 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-61227a86-3219-47c9-b2e6-302fcda3e50b tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:32.558070 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-61227a86-3219-47c9-b2e6-302fcda3e50b tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:32.857254 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-90429517-a944-4d95-bf46-5ba08902eec3 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:32.858239 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-90429517-a944-4d95-bf46-5ba08902eec3 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:32.884780 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-90429517-a944-4d95-bf46-5ba08902eec3 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:32.890463 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-90429517-a944-4d95-bf46-5ba08902eec3 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:32.891732 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-90429517-a944-4d95-bf46-5ba08902eec3 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:32.901386 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-90429517-a944-4d95-bf46-5ba08902eec3 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:32.909599 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-90429517-a944-4d95-bf46-5ba08902eec3 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:32.911444 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-90429517-a944-4d95-bf46-5ba08902eec3 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:33.104209 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-61227a86-3219-47c9-b2e6-302fcda3e50b tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:33.114364 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-61227a86-3219-47c9-b2e6-302fcda3e50b tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1516 microversion: 2.1 time: 0.592903 Oct 30 01:34:33.120609 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2347/4716] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:32 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1516 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:34:33.163412 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-90429517-a944-4d95-bf46-5ba08902eec3 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:33.180034 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-90429517-a944-4d95-bf46-5ba08902eec3 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:33.181938 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-90429517-a944-4d95-bf46-5ba08902eec3 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:33.186671 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-90429517-a944-4d95-bf46-5ba08902eec3 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1603 microversion: 2.32 time: 0.333660 Oct 30 01:34:33.191990 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2370/4717] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:34:32 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1603 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:34:33.483042 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-73b71c59-5988-46c8-b8e5-680621be025e tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:33.483719 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-73b71c59-5988-46c8-b8e5-680621be025e tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] [instance: 949acdca-96a2-4077-b747-af87796dae5c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:33.504969 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-73b71c59-5988-46c8-b8e5-680621be025e tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:33.506526 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-73b71c59-5988-46c8-b8e5-680621be025e tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:33.507498 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-73b71c59-5988-46c8-b8e5-680621be025e tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:33.508453 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-73b71c59-5988-46c8-b8e5-680621be025e tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:33.510604 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-73b71c59-5988-46c8-b8e5-680621be025e tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:33.511260 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-73b71c59-5988-46c8-b8e5-680621be025e tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:34.139737 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1f5fecd7-d2b1-4375-ae99-c445513a857f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:34.140677 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1f5fecd7-d2b1-4375-ae99-c445513a857f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:34.181739 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1f5fecd7-d2b1-4375-ae99-c445513a857f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:34.185323 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1f5fecd7-d2b1-4375-ae99-c445513a857f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:34.192217 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1f5fecd7-d2b1-4375-ae99-c445513a857f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:34.197667 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1f5fecd7-d2b1-4375-ae99-c445513a857f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:34.201693 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1f5fecd7-d2b1-4375-ae99-c445513a857f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:34.203746 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1f5fecd7-d2b1-4375-ae99-c445513a857f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:34.465782 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-73b71c59-5988-46c8-b8e5-680621be025e tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7675c0fa214588b71c04ca120557fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b509d1b9c324201942dfeb350611a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:34.476332 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-73b71c59-5988-46c8-b8e5-680621be025e tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] 10.222.0.13 "GET /compute/v2.1/servers/949acdca-96a2-4077-b747-af87796dae5c" status: 200 len: 1318 microversion: 2.1 time: 0.998463 Oct 30 01:34:34.479602 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2348/4718] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:33 2022] GET /compute/v2.1/servers/949acdca-96a2-4077-b747-af87796dae5c => generated 1318 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:34:34.501673 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bc3eaa64-c986-40ca-857e-7fff2b2ae785 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:34.503082 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-bc3eaa64-c986-40ca-857e-7fff2b2ae785 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:34.527420 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bc3eaa64-c986-40ca-857e-7fff2b2ae785 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:34.529879 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bc3eaa64-c986-40ca-857e-7fff2b2ae785 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:34.531075 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bc3eaa64-c986-40ca-857e-7fff2b2ae785 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:34.534389 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bc3eaa64-c986-40ca-857e-7fff2b2ae785 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:34.536390 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bc3eaa64-c986-40ca-857e-7fff2b2ae785 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:34.536872 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bc3eaa64-c986-40ca-857e-7fff2b2ae785 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:34.685382 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1f5fecd7-d2b1-4375-ae99-c445513a857f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:34.695979 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1f5fecd7-d2b1-4375-ae99-c445513a857f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1516 microversion: 2.1 time: 0.560266 Oct 30 01:34:34.701951 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2371/4719] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:34 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1516 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:34:34.713567 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-bc3eaa64-c986-40ca-857e-7fff2b2ae785 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:34.754667 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-bc3eaa64-c986-40ca-857e-7fff2b2ae785 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:34.756404 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-bc3eaa64-c986-40ca-857e-7fff2b2ae785 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:34.758015 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bc3eaa64-c986-40ca-857e-7fff2b2ae785 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1603 microversion: 2.32 time: 0.274379 Oct 30 01:34:34.759342 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2349/4720] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:34:34 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1603 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:34:35.504591 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6a6b912a-1c81-4e16-b358-5e0cb69da8f4 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:35.505272 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6a6b912a-1c81-4e16-b358-5e0cb69da8f4 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] [instance: 949acdca-96a2-4077-b747-af87796dae5c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:35.527153 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a6b912a-1c81-4e16-b358-5e0cb69da8f4 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:35.527925 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a6b912a-1c81-4e16-b358-5e0cb69da8f4 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:35.528532 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a6b912a-1c81-4e16-b358-5e0cb69da8f4 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:35.529501 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a6b912a-1c81-4e16-b358-5e0cb69da8f4 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:35.530118 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a6b912a-1c81-4e16-b358-5e0cb69da8f4 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:35.536230 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a6b912a-1c81-4e16-b358-5e0cb69da8f4 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:35.737659 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-97d0d9f3-1118-448f-bb2d-4f9d81027f52 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:35.738294 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-97d0d9f3-1118-448f-bb2d-4f9d81027f52 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:35.755641 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-97d0d9f3-1118-448f-bb2d-4f9d81027f52 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:35.756198 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-97d0d9f3-1118-448f-bb2d-4f9d81027f52 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:35.756649 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-97d0d9f3-1118-448f-bb2d-4f9d81027f52 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:35.762542 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-97d0d9f3-1118-448f-bb2d-4f9d81027f52 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:35.769874 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-97d0d9f3-1118-448f-bb2d-4f9d81027f52 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:35.772718 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-97d0d9f3-1118-448f-bb2d-4f9d81027f52 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:35.956130 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6a6b912a-1c81-4e16-b358-5e0cb69da8f4 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7675c0fa214588b71c04ca120557fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b509d1b9c324201942dfeb350611a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:35.967654 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6a6b912a-1c81-4e16-b358-5e0cb69da8f4 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] 10.222.0.13 "GET /compute/v2.1/servers/949acdca-96a2-4077-b747-af87796dae5c" status: 200 len: 1318 microversion: 2.1 time: 0.467276 Oct 30 01:34:35.978557 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2372/4721] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:35 2022] GET /compute/v2.1/servers/949acdca-96a2-4077-b747-af87796dae5c => generated 1318 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:34:36.003013 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-93ddcb0c-fb08-4d1c-9162-cec3cb6e4ebe tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:36.007140 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-93ddcb0c-fb08-4d1c-9162-cec3cb6e4ebe tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:36.030088 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-93ddcb0c-fb08-4d1c-9162-cec3cb6e4ebe tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:36.033749 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-93ddcb0c-fb08-4d1c-9162-cec3cb6e4ebe tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:36.034352 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-93ddcb0c-fb08-4d1c-9162-cec3cb6e4ebe tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:36.041391 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-93ddcb0c-fb08-4d1c-9162-cec3cb6e4ebe tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:36.041988 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-93ddcb0c-fb08-4d1c-9162-cec3cb6e4ebe tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:36.043257 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-93ddcb0c-fb08-4d1c-9162-cec3cb6e4ebe tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:36.384328 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-93ddcb0c-fb08-4d1c-9162-cec3cb6e4ebe tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:36.397023 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-93ddcb0c-fb08-4d1c-9162-cec3cb6e4ebe tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:36.411459 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-93ddcb0c-fb08-4d1c-9162-cec3cb6e4ebe tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:36.413370 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-93ddcb0c-fb08-4d1c-9162-cec3cb6e4ebe tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1603 microversion: 2.32 time: 0.433389 Oct 30 01:34:36.414508 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2373/4722] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:34:35 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1603 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:34:36.667105 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-97d0d9f3-1118-448f-bb2d-4f9d81027f52 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:36.680631 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-97d0d9f3-1118-448f-bb2d-4f9d81027f52 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1516 microversion: 2.1 time: 0.947367 Oct 30 01:34:36.684282 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2350/4723] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:35 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1516 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:34:37.006613 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-31e9f652-7011-4bd1-b90e-0ae10451be18 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:37.008138 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-31e9f652-7011-4bd1-b90e-0ae10451be18 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] [instance: 949acdca-96a2-4077-b747-af87796dae5c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:37.016996 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-31e9f652-7011-4bd1-b90e-0ae10451be18 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:37.022010 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-31e9f652-7011-4bd1-b90e-0ae10451be18 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:37.023101 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-31e9f652-7011-4bd1-b90e-0ae10451be18 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:37.026332 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-31e9f652-7011-4bd1-b90e-0ae10451be18 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:37.033817 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-31e9f652-7011-4bd1-b90e-0ae10451be18 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:37.034628 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-31e9f652-7011-4bd1-b90e-0ae10451be18 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:37.042539 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:34:37.449151 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5c5c4b5e-6bf5-4c9a-962e-f76a48f511d8 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:37.450549 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5c5c4b5e-6bf5-4c9a-962e-f76a48f511d8 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:37.454337 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:34:37.474504 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5c5c4b5e-6bf5-4c9a-962e-f76a48f511d8 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:37.478004 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5c5c4b5e-6bf5-4c9a-962e-f76a48f511d8 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:37.478707 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5c5c4b5e-6bf5-4c9a-962e-f76a48f511d8 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:37.483149 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5c5c4b5e-6bf5-4c9a-962e-f76a48f511d8 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:37.483893 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5c5c4b5e-6bf5-4c9a-962e-f76a48f511d8 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:37.485110 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5c5c4b5e-6bf5-4c9a-962e-f76a48f511d8 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:38.312053 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5c5c4b5e-6bf5-4c9a-962e-f76a48f511d8 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:38.324321 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5c5c4b5e-6bf5-4c9a-962e-f76a48f511d8 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:38.335552 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5c5c4b5e-6bf5-4c9a-962e-f76a48f511d8 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:38.341212 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5c5c4b5e-6bf5-4c9a-962e-f76a48f511d8 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1603 microversion: 2.32 time: 0.894982 Oct 30 01:34:38.350087 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2351/4724] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:34:37 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1603 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:34:38.355373 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-dc66d63f-4df6-45ae-8b95-86eecc426f0e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:38.356585 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-dc66d63f-4df6-45ae-8b95-86eecc426f0e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:38.372762 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc66d63f-4df6-45ae-8b95-86eecc426f0e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:38.373981 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc66d63f-4df6-45ae-8b95-86eecc426f0e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:38.375093 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc66d63f-4df6-45ae-8b95-86eecc426f0e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:38.380016 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc66d63f-4df6-45ae-8b95-86eecc426f0e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:38.380796 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc66d63f-4df6-45ae-8b95-86eecc426f0e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:38.381537 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc66d63f-4df6-45ae-8b95-86eecc426f0e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:39.944990 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-dc66d63f-4df6-45ae-8b95-86eecc426f0e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:39.953529 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-dc66d63f-4df6-45ae-8b95-86eecc426f0e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1516 microversion: 2.1 time: 1.601881 Oct 30 01:34:39.954135 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2352/4725] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:38 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1516 bytes in 1603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:34:39.981983 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-21b799f5-a909-4e70-95a5-668f28bfb539 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:39.982794 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-21b799f5-a909-4e70-95a5-668f28bfb539 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:39.983225 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-31e9f652-7011-4bd1-b90e-0ae10451be18 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7675c0fa214588b71c04ca120557fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b509d1b9c324201942dfeb350611a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:40.003727 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-31e9f652-7011-4bd1-b90e-0ae10451be18 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] 10.222.0.13 "GET /compute/v2.1/servers/949acdca-96a2-4077-b747-af87796dae5c" status: 200 len: 1318 microversion: 2.1 time: 3.007486 Oct 30 01:34:40.008870 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21b799f5-a909-4e70-95a5-668f28bfb539 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:40.009625 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21b799f5-a909-4e70-95a5-668f28bfb539 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:40.010209 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2374/4726] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:36 2022] GET /compute/v2.1/servers/949acdca-96a2-4077-b747-af87796dae5c => generated 1318 bytes in 3014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:34:40.010349 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21b799f5-a909-4e70-95a5-668f28bfb539 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:40.011021 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21b799f5-a909-4e70-95a5-668f28bfb539 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:40.013549 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21b799f5-a909-4e70-95a5-668f28bfb539 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:40.018494 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21b799f5-a909-4e70-95a5-668f28bfb539 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:40.317732 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-21b799f5-a909-4e70-95a5-668f28bfb539 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:40.336506 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-21b799f5-a909-4e70-95a5-668f28bfb539 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:40.342151 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-21b799f5-a909-4e70-95a5-668f28bfb539 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:40.346322 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-21b799f5-a909-4e70-95a5-668f28bfb539 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1603 microversion: 2.32 time: 0.383571 Oct 30 01:34:40.366051 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2353/4727] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:34:39 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1603 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:34:40.387081 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-561d503a-00c1-478b-8ee0-118f50f9b702 req-d416241e-02d2-40de-a477-e7d63b1b4169 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d9a73e6-e331-4c3d-8891-d636c150c1eb", "name": "network-vif-plugged", "status": "completed", "tag": "edfbdcb1-3f28-46df-aaa9-604761f06264"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:34:40.449868 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-561d503a-00c1-478b-8ee0-118f50f9b702 req-d416241e-02d2-40de-a477-e7d63b1b4169 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:40.451742 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-561d503a-00c1-478b-8ee0-118f50f9b702 req-d416241e-02d2-40de-a477-e7d63b1b4169 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:40.452206 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-561d503a-00c1-478b-8ee0-118f50f9b702 req-d416241e-02d2-40de-a477-e7d63b1b4169 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:40.486879 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-561d503a-00c1-478b-8ee0-118f50f9b702 req-d416241e-02d2-40de-a477-e7d63b1b4169 service nova] Creating event network-vif-plugged:edfbdcb1-3f28-46df-aaa9-604761f06264 for instance 8d9a73e6-e331-4c3d-8891-d636c150c1eb on n-h2-master-1 Oct 30 01:34:40.498420 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-561d503a-00c1-478b-8ee0-118f50f9b702 req-d416241e-02d2-40de-a477-e7d63b1b4169 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.484164 Oct 30 01:34:40.503761 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2375/4728] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:34:40.989604 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f0d1d37b-15f4-4b5e-b385-5fe82b15d905 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:40.991639 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f0d1d37b-15f4-4b5e-b385-5fe82b15d905 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:41.030753 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1752ce5d-325b-43f4-b65f-b093404d4412 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:41.032556 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1752ce5d-325b-43f4-b65f-b093404d4412 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] [instance: 949acdca-96a2-4077-b747-af87796dae5c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:41.034080 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f0d1d37b-15f4-4b5e-b385-5fe82b15d905 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:41.034596 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f0d1d37b-15f4-4b5e-b385-5fe82b15d905 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:41.037954 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f0d1d37b-15f4-4b5e-b385-5fe82b15d905 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:41.042484 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f0d1d37b-15f4-4b5e-b385-5fe82b15d905 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:41.046698 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f0d1d37b-15f4-4b5e-b385-5fe82b15d905 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:41.047254 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f0d1d37b-15f4-4b5e-b385-5fe82b15d905 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:41.072811 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1752ce5d-325b-43f4-b65f-b093404d4412 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:41.072811 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1752ce5d-325b-43f4-b65f-b093404d4412 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:41.072811 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1752ce5d-325b-43f4-b65f-b093404d4412 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:41.073713 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1752ce5d-325b-43f4-b65f-b093404d4412 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:41.074781 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1752ce5d-325b-43f4-b65f-b093404d4412 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:41.078252 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1752ce5d-325b-43f4-b65f-b093404d4412 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:42.096241 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1752ce5d-325b-43f4-b65f-b093404d4412 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7675c0fa214588b71c04ca120557fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b509d1b9c324201942dfeb350611a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:42.105125 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1752ce5d-325b-43f4-b65f-b093404d4412 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] 10.222.0.13 "GET /compute/v2.1/servers/949acdca-96a2-4077-b747-af87796dae5c" status: 200 len: 1318 microversion: 2.1 time: 1.080243 Oct 30 01:34:42.137723 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2376/4729] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:41 2022] GET /compute/v2.1/servers/949acdca-96a2-4077-b747-af87796dae5c => generated 1318 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:34:42.144783 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-82517208-1859-4ea6-8efe-d1668f818657 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:42.144939 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-82517208-1859-4ea6-8efe-d1668f818657 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:42.184613 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-82517208-1859-4ea6-8efe-d1668f818657 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:42.185371 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-82517208-1859-4ea6-8efe-d1668f818657 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:42.188658 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-82517208-1859-4ea6-8efe-d1668f818657 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:42.190191 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-82517208-1859-4ea6-8efe-d1668f818657 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:42.197042 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-82517208-1859-4ea6-8efe-d1668f818657 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:42.197764 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-82517208-1859-4ea6-8efe-d1668f818657 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:42.346413 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f0d1d37b-15f4-4b5e-b385-5fe82b15d905 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:42.369218 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f0d1d37b-15f4-4b5e-b385-5fe82b15d905 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1516 microversion: 2.1 time: 1.389629 Oct 30 01:34:42.370782 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2354/4730] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:40 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1516 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:34:42.471161 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-82517208-1859-4ea6-8efe-d1668f818657 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:42.524912 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-82517208-1859-4ea6-8efe-d1668f818657 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:42.526692 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-82517208-1859-4ea6-8efe-d1668f818657 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:42.539140 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-82517208-1859-4ea6-8efe-d1668f818657 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1603 microversion: 2.32 time: 0.395986 Oct 30 01:34:42.547913 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2377/4731] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:34:42 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1603 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:34:42.834596 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-efdd103f-5dc6-4d3b-a08d-bb67c4498af8 req-495d8ecf-f1da-4596-abb5-8ed1cef51edb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "949acdca-96a2-4077-b747-af87796dae5c", "name": "network-vif-plugged", "status": "completed", "tag": "f1e1ccbf-5715-40ca-97c2-f678ba59dc24"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:34:42.906638 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-efdd103f-5dc6-4d3b-a08d-bb67c4498af8 req-495d8ecf-f1da-4596-abb5-8ed1cef51edb service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:42.907253 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-efdd103f-5dc6-4d3b-a08d-bb67c4498af8 req-495d8ecf-f1da-4596-abb5-8ed1cef51edb service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.039s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:42.911301 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-efdd103f-5dc6-4d3b-a08d-bb67c4498af8 req-495d8ecf-f1da-4596-abb5-8ed1cef51edb service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:42.967283 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-efdd103f-5dc6-4d3b-a08d-bb67c4498af8 req-495d8ecf-f1da-4596-abb5-8ed1cef51edb service nova] Creating event network-vif-plugged:f1e1ccbf-5715-40ca-97c2-f678ba59dc24 for instance 949acdca-96a2-4077-b747-af87796dae5c on n-h2-master-1 Oct 30 01:34:42.981285 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-efdd103f-5dc6-4d3b-a08d-bb67c4498af8 req-495d8ecf-f1da-4596-abb5-8ed1cef51edb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150988 Oct 30 01:34:42.986638 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2355/4732] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:34:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:34:43.150906 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-49a35b89-92bb-410c-a5ec-0be3faa4498e tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:43.151625 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-49a35b89-92bb-410c-a5ec-0be3faa4498e tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] [instance: 949acdca-96a2-4077-b747-af87796dae5c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:43.186096 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-49a35b89-92bb-410c-a5ec-0be3faa4498e tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:43.187244 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-49a35b89-92bb-410c-a5ec-0be3faa4498e tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:43.195631 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-49a35b89-92bb-410c-a5ec-0be3faa4498e tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:43.204306 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-49a35b89-92bb-410c-a5ec-0be3faa4498e tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:43.204306 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-49a35b89-92bb-410c-a5ec-0be3faa4498e tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:43.204306 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-49a35b89-92bb-410c-a5ec-0be3faa4498e tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:43.408897 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-22e5c9a9-1760-492a-85fe-f047d2aa1e2c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:43.413937 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-22e5c9a9-1760-492a-85fe-f047d2aa1e2c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:43.442169 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22e5c9a9-1760-492a-85fe-f047d2aa1e2c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:43.446816 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22e5c9a9-1760-492a-85fe-f047d2aa1e2c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:43.448870 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22e5c9a9-1760-492a-85fe-f047d2aa1e2c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:43.449841 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22e5c9a9-1760-492a-85fe-f047d2aa1e2c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:43.455545 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22e5c9a9-1760-492a-85fe-f047d2aa1e2c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:43.457445 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22e5c9a9-1760-492a-85fe-f047d2aa1e2c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:44.323449 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-49a35b89-92bb-410c-a5ec-0be3faa4498e tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7675c0fa214588b71c04ca120557fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b509d1b9c324201942dfeb350611a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:44.332886 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-49a35b89-92bb-410c-a5ec-0be3faa4498e tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] 10.222.0.13 "GET /compute/v2.1/servers/949acdca-96a2-4077-b747-af87796dae5c" status: 200 len: 1318 microversion: 2.1 time: 1.186446 Oct 30 01:34:44.353708 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2378/4733] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:43 2022] GET /compute/v2.1/servers/949acdca-96a2-4077-b747-af87796dae5c => generated 1318 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:34:44.362068 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1cd5d9e6-6ca6-4267-b744-7e3a37137322 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:44.362068 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1cd5d9e6-6ca6-4267-b744-7e3a37137322 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:44.375280 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1cd5d9e6-6ca6-4267-b744-7e3a37137322 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:44.377301 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-22e5c9a9-1760-492a-85fe-f047d2aa1e2c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:44.389614 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-22e5c9a9-1760-492a-85fe-f047d2aa1e2c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1516 microversion: 2.1 time: 0.989438 Oct 30 01:34:44.390928 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2356/4734] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:43 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1516 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:34:44.391156 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1cd5d9e6-6ca6-4267-b744-7e3a37137322 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:44.391787 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1cd5d9e6-6ca6-4267-b744-7e3a37137322 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:44.393169 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1cd5d9e6-6ca6-4267-b744-7e3a37137322 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:44.393918 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1cd5d9e6-6ca6-4267-b744-7e3a37137322 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:44.396643 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1cd5d9e6-6ca6-4267-b744-7e3a37137322 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:44.911062 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1cd5d9e6-6ca6-4267-b744-7e3a37137322 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:44.944478 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1cd5d9e6-6ca6-4267-b744-7e3a37137322 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:44.962697 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1cd5d9e6-6ca6-4267-b744-7e3a37137322 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:44.967077 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1cd5d9e6-6ca6-4267-b744-7e3a37137322 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1603 microversion: 2.32 time: 0.619972 Oct 30 01:34:44.968012 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2379/4735] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:34:44 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1603 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:34:45.373955 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3b9f5e22-60d8-4e59-833c-581b3bd68593 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:45.374766 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3b9f5e22-60d8-4e59-833c-581b3bd68593 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] [instance: 949acdca-96a2-4077-b747-af87796dae5c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:45.388030 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b9f5e22-60d8-4e59-833c-581b3bd68593 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:45.394154 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b9f5e22-60d8-4e59-833c-581b3bd68593 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:45.395925 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b9f5e22-60d8-4e59-833c-581b3bd68593 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:45.396839 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b9f5e22-60d8-4e59-833c-581b3bd68593 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:45.398274 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b9f5e22-60d8-4e59-833c-581b3bd68593 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:45.401850 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b9f5e22-60d8-4e59-833c-581b3bd68593 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:45.421286 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-76ee1967-2d96-4090-b86c-a3373b0cd2a8 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:45.422809 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-76ee1967-2d96-4090-b86c-a3373b0cd2a8 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:45.446371 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-76ee1967-2d96-4090-b86c-a3373b0cd2a8 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:45.446371 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-76ee1967-2d96-4090-b86c-a3373b0cd2a8 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:45.448361 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-76ee1967-2d96-4090-b86c-a3373b0cd2a8 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:45.449278 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-76ee1967-2d96-4090-b86c-a3373b0cd2a8 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:45.452276 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-76ee1967-2d96-4090-b86c-a3373b0cd2a8 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:45.453020 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-76ee1967-2d96-4090-b86c-a3373b0cd2a8 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:45.986907 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3b9f5e22-60d8-4e59-833c-581b3bd68593 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7675c0fa214588b71c04ca120557fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b509d1b9c324201942dfeb350611a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:46.002770 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3b9f5e22-60d8-4e59-833c-581b3bd68593 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] 10.222.0.13 "GET /compute/v2.1/servers/949acdca-96a2-4077-b747-af87796dae5c" status: 200 len: 1506 microversion: 2.1 time: 0.636254 Oct 30 01:34:46.012720 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2357/4736] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:45 2022] GET /compute/v2.1/servers/949acdca-96a2-4077-b747-af87796dae5c => generated 1506 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:34:46.012720 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-22ac924b-fa80-4be3-9706-a66fdb51aa44 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:46.012720 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-22ac924b-fa80-4be3-9706-a66fdb51aa44 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:46.033580 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22ac924b-fa80-4be3-9706-a66fdb51aa44 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:46.034166 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22ac924b-fa80-4be3-9706-a66fdb51aa44 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:46.038231 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22ac924b-fa80-4be3-9706-a66fdb51aa44 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:46.038231 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22ac924b-fa80-4be3-9706-a66fdb51aa44 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:46.038231 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22ac924b-fa80-4be3-9706-a66fdb51aa44 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:46.038231 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22ac924b-fa80-4be3-9706-a66fdb51aa44 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:46.228956 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-76ee1967-2d96-4090-b86c-a3373b0cd2a8 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:46.264222 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-76ee1967-2d96-4090-b86c-a3373b0cd2a8 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1516 microversion: 2.1 time: 0.848275 Oct 30 01:34:46.264865 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2380/4737] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:45 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1516 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:34:46.283657 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d334f7e2-3cdb-4128-8aca-c21e43f5f81a tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:46.284688 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d334f7e2-3cdb-4128-8aca-c21e43f5f81a tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] [instance: 8d9a73e6-e331-4c3d-8891-d636c150c1eb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:46.294858 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d334f7e2-3cdb-4128-8aca-c21e43f5f81a tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:46.295620 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d334f7e2-3cdb-4128-8aca-c21e43f5f81a tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:46.296210 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d334f7e2-3cdb-4128-8aca-c21e43f5f81a tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:46.297081 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d334f7e2-3cdb-4128-8aca-c21e43f5f81a tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:46.297760 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d334f7e2-3cdb-4128-8aca-c21e43f5f81a tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:46.298396 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d334f7e2-3cdb-4128-8aca-c21e43f5f81a tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:46.417552 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-22ac924b-fa80-4be3-9706-a66fdb51aa44 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:46.435279 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-22ac924b-fa80-4be3-9706-a66fdb51aa44 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:46.437070 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-22ac924b-fa80-4be3-9706-a66fdb51aa44 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:46.438648 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-22ac924b-fa80-4be3-9706-a66fdb51aa44 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1603 microversion: 2.32 time: 0.433743 Oct 30 01:34:46.442307 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2358/4738] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:34:46 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1603 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:34:46.781241 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d334f7e2-3cdb-4128-8aca-c21e43f5f81a tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7675c0fa214588b71c04ca120557fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b509d1b9c324201942dfeb350611a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:46.800395 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d334f7e2-3cdb-4128-8aca-c21e43f5f81a tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] 10.222.0.13 "GET /compute/v2.1/servers/8d9a73e6-e331-4c3d-8891-d636c150c1eb" status: 200 len: 1505 microversion: 2.1 time: 0.530248 Oct 30 01:34:46.805188 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2381/4739] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:46 2022] GET /compute/v2.1/servers/8d9a73e6-e331-4c3d-8891-d636c150c1eb => generated 1505 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:34:46.837164 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ece8323e-d7e3-4f3e-b269-c0b1ec4f3c06 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:46.837728 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ece8323e-d7e3-4f3e-b269-c0b1ec4f3c06 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] [instance: 8d9a73e6-e331-4c3d-8891-d636c150c1eb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:46.854163 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ece8323e-d7e3-4f3e-b269-c0b1ec4f3c06 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:46.854698 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ece8323e-d7e3-4f3e-b269-c0b1ec4f3c06 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:46.855149 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ece8323e-d7e3-4f3e-b269-c0b1ec4f3c06 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:46.858147 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ece8323e-d7e3-4f3e-b269-c0b1ec4f3c06 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:46.859879 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ece8323e-d7e3-4f3e-b269-c0b1ec4f3c06 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:46.860347 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ece8323e-d7e3-4f3e-b269-c0b1ec4f3c06 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:46.886322 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=100 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:34:46.975601 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ece8323e-d7e3-4f3e-b269-c0b1ec4f3c06 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] [instance: 8d9a73e6-e331-4c3d-8891-d636c150c1eb] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:34:47.290299 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7802b5a2-90b2-40ee-9c42-e71b044478f7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:47.291113 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7802b5a2-90b2-40ee-9c42-e71b044478f7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:47.301490 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7802b5a2-90b2-40ee-9c42-e71b044478f7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:47.302137 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7802b5a2-90b2-40ee-9c42-e71b044478f7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:47.303019 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7802b5a2-90b2-40ee-9c42-e71b044478f7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:47.305494 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7802b5a2-90b2-40ee-9c42-e71b044478f7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:47.306625 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7802b5a2-90b2-40ee-9c42-e71b044478f7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:47.307536 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7802b5a2-90b2-40ee-9c42-e71b044478f7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:47.369672 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ece8323e-d7e3-4f3e-b269-c0b1ec4f3c06 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8d9a73e6-e331-4c3d-8891-d636c150c1eb" status: 204 len: 0 microversion: 2.1 time: 0.535718 Oct 30 01:34:47.370549 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2359/4740] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:34:46 2022] DELETE /compute/v2.1/servers/8d9a73e6-e331-4c3d-8891-d636c150c1eb => generated 0 bytes in 538 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:34:47.380879 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d3a1223e-af65-4b04-a970-e773cdc97d83 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:47.381931 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d3a1223e-af65-4b04-a970-e773cdc97d83 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] [instance: 949acdca-96a2-4077-b747-af87796dae5c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:47.398876 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d3a1223e-af65-4b04-a970-e773cdc97d83 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:47.400420 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d3a1223e-af65-4b04-a970-e773cdc97d83 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:47.404497 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d3a1223e-af65-4b04-a970-e773cdc97d83 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:47.406264 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d3a1223e-af65-4b04-a970-e773cdc97d83 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:47.409040 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d3a1223e-af65-4b04-a970-e773cdc97d83 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:47.413355 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d3a1223e-af65-4b04-a970-e773cdc97d83 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:47.470347 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d3a1223e-af65-4b04-a970-e773cdc97d83 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] [instance: 949acdca-96a2-4077-b747-af87796dae5c] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:34:47.788578 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d3a1223e-af65-4b04-a970-e773cdc97d83 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] 10.222.0.13 "DELETE /compute/v2.1/servers/949acdca-96a2-4077-b747-af87796dae5c" status: 204 len: 0 microversion: 2.1 time: 0.412553 Oct 30 01:34:47.789776 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2360/4741] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:34:47 2022] DELETE /compute/v2.1/servers/949acdca-96a2-4077-b747-af87796dae5c => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:34:47.796673 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4c4deee0-439c-46fc-8c4a-8de831b8ff85 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:47.801862 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4c4deee0-439c-46fc-8c4a-8de831b8ff85 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:47.819067 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4c4deee0-439c-46fc-8c4a-8de831b8ff85 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:47.823258 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4c4deee0-439c-46fc-8c4a-8de831b8ff85 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:47.823258 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4c4deee0-439c-46fc-8c4a-8de831b8ff85 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:47.824725 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4c4deee0-439c-46fc-8c4a-8de831b8ff85 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:47.827515 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4c4deee0-439c-46fc-8c4a-8de831b8ff85 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:47.828803 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4c4deee0-439c-46fc-8c4a-8de831b8ff85 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:48.179216 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4c4deee0-439c-46fc-8c4a-8de831b8ff85 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:48.194680 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4c4deee0-439c-46fc-8c4a-8de831b8ff85 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:48.196395 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4c4deee0-439c-46fc-8c4a-8de831b8ff85 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:48.198069 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4c4deee0-439c-46fc-8c4a-8de831b8ff85 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1603 microversion: 2.32 time: 0.407059 Oct 30 01:34:48.213452 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2361/4742] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:34:47 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1603 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:34:48.234245 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ce4af058-bcef-481b-b607-f4c3f6687f26 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:48.235903 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ce4af058-bcef-481b-b607-f4c3f6687f26 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] [instance: 8d9a73e6-e331-4c3d-8891-d636c150c1eb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:48.251501 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ce4af058-bcef-481b-b607-f4c3f6687f26 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:48.253281 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ce4af058-bcef-481b-b607-f4c3f6687f26 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:48.253849 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ce4af058-bcef-481b-b607-f4c3f6687f26 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:48.254690 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ce4af058-bcef-481b-b607-f4c3f6687f26 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:48.255258 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ce4af058-bcef-481b-b607-f4c3f6687f26 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:48.255790 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ce4af058-bcef-481b-b607-f4c3f6687f26 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:48.627024 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7802b5a2-90b2-40ee-9c42-e71b044478f7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:48.649289 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7802b5a2-90b2-40ee-9c42-e71b044478f7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1516 microversion: 2.1 time: 1.359836 Oct 30 01:34:48.652271 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2382/4743] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:47 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1516 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:34:48.695970 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ce4af058-bcef-481b-b607-f4c3f6687f26 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7675c0fa214588b71c04ca120557fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b509d1b9c324201942dfeb350611a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:48.705190 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ce4af058-bcef-481b-b607-f4c3f6687f26 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] 10.222.0.13 "GET /compute/v2.1/servers/8d9a73e6-e331-4c3d-8891-d636c150c1eb" status: 200 len: 1511 microversion: 2.1 time: 0.480092 Oct 30 01:34:48.710657 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2362/4744] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:48 2022] GET /compute/v2.1/servers/8d9a73e6-e331-4c3d-8891-d636c150c1eb => generated 1511 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:34:49.179828 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f5be3a15-86d7-46bd-986d-4becec12a520 tempest-PortsAdminExtendedAttrsIpV6TestJSON-882318965 tempest-PortsAdminExtendedAttrsIpV6TestJSON-882318965-project-admin] Calling method '.version_select at 0x7f44d05235e0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:49.185525 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5be3a15-86d7-46bd-986d-4becec12a520 tempest-PortsAdminExtendedAttrsIpV6TestJSON-882318965 tempest-PortsAdminExtendedAttrsIpV6TestJSON-882318965-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:49.186960 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5be3a15-86d7-46bd-986d-4becec12a520 tempest-PortsAdminExtendedAttrsIpV6TestJSON-882318965 tempest-PortsAdminExtendedAttrsIpV6TestJSON-882318965-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:49.187422 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5be3a15-86d7-46bd-986d-4becec12a520 tempest-PortsAdminExtendedAttrsIpV6TestJSON-882318965 tempest-PortsAdminExtendedAttrsIpV6TestJSON-882318965-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:49.223547 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5be3a15-86d7-46bd-986d-4becec12a520 tempest-PortsAdminExtendedAttrsIpV6TestJSON-882318965 tempest-PortsAdminExtendedAttrsIpV6TestJSON-882318965-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:49.227548 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5be3a15-86d7-46bd-986d-4becec12a520 tempest-PortsAdminExtendedAttrsIpV6TestJSON-882318965 tempest-PortsAdminExtendedAttrsIpV6TestJSON-882318965-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:49.228403 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5be3a15-86d7-46bd-986d-4becec12a520 tempest-PortsAdminExtendedAttrsIpV6TestJSON-882318965 tempest-PortsAdminExtendedAttrsIpV6TestJSON-882318965-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:49.234083 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f1a9c151-b0b0-4dcc-8855-20f498144dfa tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:49.235193 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f1a9c151-b0b0-4dcc-8855-20f498144dfa tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:49.251219 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f1a9c151-b0b0-4dcc-8855-20f498144dfa tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:49.251836 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f1a9c151-b0b0-4dcc-8855-20f498144dfa tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:49.256664 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f1a9c151-b0b0-4dcc-8855-20f498144dfa tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:49.256980 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f1a9c151-b0b0-4dcc-8855-20f498144dfa tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:49.257711 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f1a9c151-b0b0-4dcc-8855-20f498144dfa tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:49.259235 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f1a9c151-b0b0-4dcc-8855-20f498144dfa tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:49.263045 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5be3a15-86d7-46bd-986d-4becec12a520 tempest-PortsAdminExtendedAttrsIpV6TestJSON-882318965 tempest-PortsAdminExtendedAttrsIpV6TestJSON-882318965-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:49.264151 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5be3a15-86d7-46bd-986d-4becec12a520 tempest-PortsAdminExtendedAttrsIpV6TestJSON-882318965 tempest-PortsAdminExtendedAttrsIpV6TestJSON-882318965-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:49.264913 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5be3a15-86d7-46bd-986d-4becec12a520 tempest-PortsAdminExtendedAttrsIpV6TestJSON-882318965 tempest-PortsAdminExtendedAttrsIpV6TestJSON-882318965-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:49.276026 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f5be3a15-86d7-46bd-986d-4becec12a520 tempest-PortsAdminExtendedAttrsIpV6TestJSON-882318965 tempest-PortsAdminExtendedAttrsIpV6TestJSON-882318965-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.622272 Oct 30 01:34:49.281393 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2383/4745] 10.222.0.13 () {58 vars in 1146 bytes} [Sun Oct 30 01:34:48 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:34:49.456435 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f1a9c151-b0b0-4dcc-8855-20f498144dfa tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:49.467176 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f1a9c151-b0b0-4dcc-8855-20f498144dfa tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:49.468676 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f1a9c151-b0b0-4dcc-8855-20f498144dfa tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:49.472192 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f1a9c151-b0b0-4dcc-8855-20f498144dfa tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1603 microversion: 2.32 time: 0.243596 Oct 30 01:34:49.473570 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2363/4746] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:34:49 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1603 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:34:49.673240 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-25c9deef-efc4-490c-8eaa-c14f5598faae tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:49.674260 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-25c9deef-efc4-490c-8eaa-c14f5598faae tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:49.688082 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25c9deef-efc4-490c-8eaa-c14f5598faae tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:49.688969 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25c9deef-efc4-490c-8eaa-c14f5598faae tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:49.691160 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25c9deef-efc4-490c-8eaa-c14f5598faae tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:49.698924 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25c9deef-efc4-490c-8eaa-c14f5598faae tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:49.698924 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25c9deef-efc4-490c-8eaa-c14f5598faae tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:49.698924 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25c9deef-efc4-490c-8eaa-c14f5598faae tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:49.736982 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f4f51e8e-5281-4245-8896-0127386cdad2 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:49.743117 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f4f51e8e-5281-4245-8896-0127386cdad2 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] [instance: 8d9a73e6-e331-4c3d-8891-d636c150c1eb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:49.756089 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f4f51e8e-5281-4245-8896-0127386cdad2 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:49.757433 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f4f51e8e-5281-4245-8896-0127386cdad2 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:49.759630 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f4f51e8e-5281-4245-8896-0127386cdad2 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:49.761546 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f4f51e8e-5281-4245-8896-0127386cdad2 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:49.763242 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f4f51e8e-5281-4245-8896-0127386cdad2 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:49.765106 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f4f51e8e-5281-4245-8896-0127386cdad2 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:50.697158 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f4f51e8e-5281-4245-8896-0127386cdad2 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7675c0fa214588b71c04ca120557fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b509d1b9c324201942dfeb350611a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:50.712661 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f4f51e8e-5281-4245-8896-0127386cdad2 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] 10.222.0.13 "GET /compute/v2.1/servers/8d9a73e6-e331-4c3d-8891-d636c150c1eb" status: 200 len: 1511 microversion: 2.1 time: 0.980059 Oct 30 01:34:50.731661 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2364/4747] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:49 2022] GET /compute/v2.1/servers/8d9a73e6-e331-4c3d-8891-d636c150c1eb => generated 1511 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:34:50.747824 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6ae61661-e868-4fe6-9ce1-d500d0a95269 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:50.748541 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6ae61661-e868-4fe6-9ce1-d500d0a95269 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:50.779515 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ae61661-e868-4fe6-9ce1-d500d0a95269 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:50.783615 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ae61661-e868-4fe6-9ce1-d500d0a95269 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:50.784038 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ae61661-e868-4fe6-9ce1-d500d0a95269 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:50.784831 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ae61661-e868-4fe6-9ce1-d500d0a95269 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:50.785315 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ae61661-e868-4fe6-9ce1-d500d0a95269 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:50.785811 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ae61661-e868-4fe6-9ce1-d500d0a95269 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:51.251412 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-25c9deef-efc4-490c-8eaa-c14f5598faae tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:51.263683 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-25c9deef-efc4-490c-8eaa-c14f5598faae tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1516 microversion: 2.1 time: 1.591144 Oct 30 01:34:51.264713 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2384/4748] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:49 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1516 bytes in 1596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:34:51.278451 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-0726dd88-b3cf-40ea-a440-843dc4815e20 req-bb13b621-e858-4a92-b0c4-01130a73e16b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c51345-2948-4ff1-828f-8c70b2b979f2", "name": "network-vif-plugged", "status": "completed", "tag": "25297f9d-e65e-44db-bc94-b8ade234295f"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:34:51.292653 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=66 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:34:51.318615 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-0726dd88-b3cf-40ea-a440-843dc4815e20 req-bb13b621-e858-4a92-b0c4-01130a73e16b service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:51.319109 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-0726dd88-b3cf-40ea-a440-843dc4815e20 req-bb13b621-e858-4a92-b0c4-01130a73e16b service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:51.323216 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-0726dd88-b3cf-40ea-a440-843dc4815e20 req-bb13b621-e858-4a92-b0c4-01130a73e16b service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:51.348855 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-0726dd88-b3cf-40ea-a440-843dc4815e20 req-bb13b621-e858-4a92-b0c4-01130a73e16b service nova] Creating event network-vif-plugged:25297f9d-e65e-44db-bc94-b8ade234295f for instance b0c51345-2948-4ff1-828f-8c70b2b979f2 on n-h1-master-1 Oct 30 01:34:51.352992 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6ae61661-e868-4fe6-9ce1-d500d0a95269 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:51.362394 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-0726dd88-b3cf-40ea-a440-843dc4815e20 req-bb13b621-e858-4a92-b0c4-01130a73e16b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096241 Oct 30 01:34:51.362852 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6ae61661-e868-4fe6-9ce1-d500d0a95269 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:51.363912 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2385/4749] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:34:51.377919 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6ae61661-e868-4fe6-9ce1-d500d0a95269 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:51.379347 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6ae61661-e868-4fe6-9ce1-d500d0a95269 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1603 microversion: 2.32 time: 0.645022 Oct 30 01:34:51.394055 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2365/4750] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:34:50 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1603 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:34:51.738288 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-432afded-06e2-48d5-b261-e886c094c6f3 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:51.740339 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-432afded-06e2-48d5-b261-e886c094c6f3 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] [instance: 8d9a73e6-e331-4c3d-8891-d636c150c1eb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:51.756191 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-432afded-06e2-48d5-b261-e886c094c6f3 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:51.757096 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-432afded-06e2-48d5-b261-e886c094c6f3 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:51.757752 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-432afded-06e2-48d5-b261-e886c094c6f3 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:51.761026 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-432afded-06e2-48d5-b261-e886c094c6f3 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:51.761863 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-432afded-06e2-48d5-b261-e886c094c6f3 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:51.762492 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-432afded-06e2-48d5-b261-e886c094c6f3 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:52.289913 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d1793cae-c684-45d7-827b-0a1428290771 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:52.291302 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d1793cae-c684-45d7-827b-0a1428290771 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:52.310251 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d1793cae-c684-45d7-827b-0a1428290771 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:52.311067 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d1793cae-c684-45d7-827b-0a1428290771 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:52.311861 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d1793cae-c684-45d7-827b-0a1428290771 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:52.312918 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d1793cae-c684-45d7-827b-0a1428290771 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:52.313592 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d1793cae-c684-45d7-827b-0a1428290771 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:52.314172 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d1793cae-c684-45d7-827b-0a1428290771 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:52.522044 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-432afded-06e2-48d5-b261-e886c094c6f3 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7675c0fa214588b71c04ca120557fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b509d1b9c324201942dfeb350611a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:52.551450 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-432afded-06e2-48d5-b261-e886c094c6f3 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] 10.222.0.13 "GET /compute/v2.1/servers/8d9a73e6-e331-4c3d-8891-d636c150c1eb" status: 200 len: 1511 microversion: 2.1 time: 0.816417 Oct 30 01:34:52.577418 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2386/4751] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:51 2022] GET /compute/v2.1/servers/8d9a73e6-e331-4c3d-8891-d636c150c1eb => generated 1511 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:34:52.601089 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-df2f876c-b43d-4791-9ce5-d64caa755d2f tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:52.601886 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-df2f876c-b43d-4791-9ce5-d64caa755d2f tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:52.612464 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df2f876c-b43d-4791-9ce5-d64caa755d2f tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:52.613592 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df2f876c-b43d-4791-9ce5-d64caa755d2f tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:52.625059 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df2f876c-b43d-4791-9ce5-d64caa755d2f tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:52.625059 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df2f876c-b43d-4791-9ce5-d64caa755d2f tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:52.625059 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df2f876c-b43d-4791-9ce5-d64caa755d2f tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:52.627140 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df2f876c-b43d-4791-9ce5-d64caa755d2f tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:52.876564 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-df2f876c-b43d-4791-9ce5-d64caa755d2f tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:52.905761 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-df2f876c-b43d-4791-9ce5-d64caa755d2f tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:52.910962 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-df2f876c-b43d-4791-9ce5-d64caa755d2f tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:52.918712 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-df2f876c-b43d-4791-9ce5-d64caa755d2f tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1603 microversion: 2.32 time: 0.333346 Oct 30 01:34:52.918712 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2387/4752] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:34:52 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1603 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:34:53.171548 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-f7a71652-5d47-4ba6-aee9-1cfe8fbf1d32 req-bc8dcae3-68af-42b7-8644-ccd7d08099e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "949acdca-96a2-4077-b747-af87796dae5c", "name": "network-vif-deleted", "tag": "f1e1ccbf-5715-40ca-97c2-f678ba59dc24"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:34:53.219040 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d1793cae-c684-45d7-827b-0a1428290771 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:53.247026 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-f7a71652-5d47-4ba6-aee9-1cfe8fbf1d32 req-bc8dcae3-68af-42b7-8644-ccd7d08099e0 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:53.247436 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-f7a71652-5d47-4ba6-aee9-1cfe8fbf1d32 req-bc8dcae3-68af-42b7-8644-ccd7d08099e0 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:53.273437 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d1793cae-c684-45d7-827b-0a1428290771 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1516 microversion: 2.1 time: 0.959804 Oct 30 01:34:53.273712 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-f7a71652-5d47-4ba6-aee9-1cfe8fbf1d32 req-bc8dcae3-68af-42b7-8644-ccd7d08099e0 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:53.273820 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2366/4753] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:52 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1516 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:34:53.295465 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-d2f83282-00d8-4b20-b705-6b1926686634 req-7c67da5d-1ff1-465b-847b-974e72236e62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d9a73e6-e331-4c3d-8891-d636c150c1eb", "name": "network-vif-deleted", "tag": "edfbdcb1-3f28-46df-aaa9-604761f06264"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:34:53.309309 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-f7a71652-5d47-4ba6-aee9-1cfe8fbf1d32 req-bc8dcae3-68af-42b7-8644-ccd7d08099e0 service nova] Creating event network-vif-deleted:f1e1ccbf-5715-40ca-97c2-f678ba59dc24 for instance 949acdca-96a2-4077-b747-af87796dae5c on n-h2-master-1 Oct 30 01:34:53.322608 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-f7a71652-5d47-4ba6-aee9-1cfe8fbf1d32 req-bc8dcae3-68af-42b7-8644-ccd7d08099e0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.294806 Oct 30 01:34:53.324443 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d2f83282-00d8-4b20-b705-6b1926686634 req-7c67da5d-1ff1-465b-847b-974e72236e62 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:53.324596 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2388/4754] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:34:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:34:53.326679 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d2f83282-00d8-4b20-b705-6b1926686634 req-7c67da5d-1ff1-465b-847b-974e72236e62 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:53.334515 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d2f83282-00d8-4b20-b705-6b1926686634 req-7c67da5d-1ff1-465b-847b-974e72236e62 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:53.370163 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-d2f83282-00d8-4b20-b705-6b1926686634 req-7c67da5d-1ff1-465b-847b-974e72236e62 service nova] Creating event network-vif-deleted:edfbdcb1-3f28-46df-aaa9-604761f06264 for instance 8d9a73e6-e331-4c3d-8891-d636c150c1eb on n-h2-master-1 Oct 30 01:34:53.385322 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-d2f83282-00d8-4b20-b705-6b1926686634 req-7c67da5d-1ff1-465b-847b-974e72236e62 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092053 Oct 30 01:34:53.387640 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2367/4755] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:34:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:34:53.591980 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3e1e691e-c49e-45a2-a783-65906c653254 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:53.593572 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3e1e691e-c49e-45a2-a783-65906c653254 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] [instance: 8d9a73e6-e331-4c3d-8891-d636c150c1eb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:53.609836 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3e1e691e-c49e-45a2-a783-65906c653254 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:53.611078 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3e1e691e-c49e-45a2-a783-65906c653254 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:53.615661 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3e1e691e-c49e-45a2-a783-65906c653254 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:53.618708 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3e1e691e-c49e-45a2-a783-65906c653254 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:53.619431 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3e1e691e-c49e-45a2-a783-65906c653254 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:53.621293 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3e1e691e-c49e-45a2-a783-65906c653254 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:53.842986 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3e1e691e-c49e-45a2-a783-65906c653254 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7675c0fa214588b71c04ca120557fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b509d1b9c324201942dfeb350611a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:53.855435 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3e1e691e-c49e-45a2-a783-65906c653254 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] 10.222.0.13 "GET /compute/v2.1/servers/8d9a73e6-e331-4c3d-8891-d636c150c1eb" status: 200 len: 1303 microversion: 2.1 time: 0.268997 Oct 30 01:34:53.856024 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2389/4756] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:53 2022] GET /compute/v2.1/servers/8d9a73e6-e331-4c3d-8891-d636c150c1eb => generated 1303 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:34:53.950171 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7db6706e-9b6e-4c1a-9e63-18268a25de6c tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:53.950888 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7db6706e-9b6e-4c1a-9e63-18268a25de6c tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:53.960604 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7db6706e-9b6e-4c1a-9e63-18268a25de6c tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:53.961115 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7db6706e-9b6e-4c1a-9e63-18268a25de6c tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:53.961590 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7db6706e-9b6e-4c1a-9e63-18268a25de6c tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:53.962307 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7db6706e-9b6e-4c1a-9e63-18268a25de6c tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:53.962762 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7db6706e-9b6e-4c1a-9e63-18268a25de6c tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:53.963256 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7db6706e-9b6e-4c1a-9e63-18268a25de6c tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:54.260673 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7db6706e-9b6e-4c1a-9e63-18268a25de6c tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:54.280450 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7b1aca0e-9932-46c8-9bce-1b6f17618fa7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:54.281260 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7b1aca0e-9932-46c8-9bce-1b6f17618fa7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:54.292836 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b1aca0e-9932-46c8-9bce-1b6f17618fa7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:54.294338 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b1aca0e-9932-46c8-9bce-1b6f17618fa7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:54.295078 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b1aca0e-9932-46c8-9bce-1b6f17618fa7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:54.298593 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b1aca0e-9932-46c8-9bce-1b6f17618fa7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:54.300515 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b1aca0e-9932-46c8-9bce-1b6f17618fa7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:54.301809 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b1aca0e-9932-46c8-9bce-1b6f17618fa7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:54.303325 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7db6706e-9b6e-4c1a-9e63-18268a25de6c tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:54.309730 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7db6706e-9b6e-4c1a-9e63-18268a25de6c tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:54.315951 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7db6706e-9b6e-4c1a-9e63-18268a25de6c tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1603 microversion: 2.32 time: 0.369107 Oct 30 01:34:54.319006 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2368/4757] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:34:53 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1603 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:34:54.880144 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cea41a7d-b90f-4c99-8dd1-35d2a2de4bc5 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:54.880775 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-cea41a7d-b90f-4c99-8dd1-35d2a2de4bc5 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] [instance: 8d9a73e6-e331-4c3d-8891-d636c150c1eb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:54.893312 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cea41a7d-b90f-4c99-8dd1-35d2a2de4bc5 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:54.901488 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cea41a7d-b90f-4c99-8dd1-35d2a2de4bc5 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:54.901488 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cea41a7d-b90f-4c99-8dd1-35d2a2de4bc5 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:54.901488 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cea41a7d-b90f-4c99-8dd1-35d2a2de4bc5 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:54.901488 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cea41a7d-b90f-4c99-8dd1-35d2a2de4bc5 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:54.901488 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cea41a7d-b90f-4c99-8dd1-35d2a2de4bc5 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:55.025072 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cea41a7d-b90f-4c99-8dd1-35d2a2de4bc5 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:55.025747 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cea41a7d-b90f-4c99-8dd1-35d2a2de4bc5 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:55.026207 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cea41a7d-b90f-4c99-8dd1-35d2a2de4bc5 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:55.026684 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-cea41a7d-b90f-4c99-8dd1-35d2a2de4bc5 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lazy-loading 'fault' on Instance uuid 8d9a73e6-e331-4c3d-8891-d636c150c1eb {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:34:55.123640 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-cea41a7d-b90f-4c99-8dd1-35d2a2de4bc5 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7675c0fa214588b71c04ca120557fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b509d1b9c324201942dfeb350611a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:55.143779 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cea41a7d-b90f-4c99-8dd1-35d2a2de4bc5 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] 10.222.0.13 "GET /compute/v2.1/servers/8d9a73e6-e331-4c3d-8891-d636c150c1eb" status: 200 len: 1308 microversion: 2.1 time: 0.268617 Oct 30 01:34:55.146547 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2369/4758] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:54 2022] GET /compute/v2.1/servers/8d9a73e6-e331-4c3d-8891-d636c150c1eb => generated 1308 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:34:55.347857 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-552c3564-7f9b-4fcb-b9df-8ee3c330c087 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:55.354513 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-552c3564-7f9b-4fcb-b9df-8ee3c330c087 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:55.363492 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-552c3564-7f9b-4fcb-b9df-8ee3c330c087 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:55.364443 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-552c3564-7f9b-4fcb-b9df-8ee3c330c087 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:55.364906 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-552c3564-7f9b-4fcb-b9df-8ee3c330c087 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:55.365692 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-552c3564-7f9b-4fcb-b9df-8ee3c330c087 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:55.366474 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-552c3564-7f9b-4fcb-b9df-8ee3c330c087 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:55.367092 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-552c3564-7f9b-4fcb-b9df-8ee3c330c087 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:55.440396 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7b1aca0e-9932-46c8-9bce-1b6f17618fa7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:55.469185 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7b1aca0e-9932-46c8-9bce-1b6f17618fa7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1516 microversion: 2.1 time: 1.189913 Oct 30 01:34:55.469185 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2390/4759] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:54 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1516 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:34:55.495213 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-552c3564-7f9b-4fcb-b9df-8ee3c330c087 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:55.505639 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-552c3564-7f9b-4fcb-b9df-8ee3c330c087 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:55.507511 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-552c3564-7f9b-4fcb-b9df-8ee3c330c087 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:55.509070 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-552c3564-7f9b-4fcb-b9df-8ee3c330c087 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1603 microversion: 2.32 time: 0.166805 Oct 30 01:34:55.510381 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2370/4760] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:34:55 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1603 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:34:56.182238 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-78bff94e-fc6d-4a56-8f73-2cd62868ff95 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:56.185925 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-78bff94e-fc6d-4a56-8f73-2cd62868ff95 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] [instance: 8d9a73e6-e331-4c3d-8891-d636c150c1eb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:56.205729 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-78bff94e-fc6d-4a56-8f73-2cd62868ff95 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:56.206740 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-78bff94e-fc6d-4a56-8f73-2cd62868ff95 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:56.207405 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-78bff94e-fc6d-4a56-8f73-2cd62868ff95 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:56.208406 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-78bff94e-fc6d-4a56-8f73-2cd62868ff95 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:56.210167 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-78bff94e-fc6d-4a56-8f73-2cd62868ff95 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:56.212028 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-78bff94e-fc6d-4a56-8f73-2cd62868ff95 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:56.255370 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-78bff94e-fc6d-4a56-8f73-2cd62868ff95 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] HTTP exception thrown: Instance 8d9a73e6-e331-4c3d-8891-d636c150c1eb could not be found. Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-78bff94e-fc6d-4a56-8f73-2cd62868ff95 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Request method failure captured: Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/8d9a73e6-e331-4c3d-8891-d636c150c1eb HTTP/1.1 Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdRviIogWUqUuZ7mbYloymn5EXW-LS9cVmUI460B-0oXiZc-bo9jV-ToUbPUtF4Bsvknpg_uTOYrBKrJHsZXOZCW2_pPuzkAzecctnQPts1t6xPsFnXnkfHfOLng80cfaQR_fM2Pz19Qa-zU82f7wf-8aBaF9zcCtC1D08qVQTvBhMM Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 2b509d1b9c324201942dfeb350611a44 Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-MultipleCreateTestJSON-340965759 Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2b509d1b9c324201942dfeb350611a44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2b509d1b9c324201942dfeb350611a44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2b509d1b9c324201942dfeb350611a44"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2b509d1b9c324201942dfeb350611a44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-MultipleCreateTestJSON-340965759 Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 2b509d1b9c324201942dfeb350611a44 Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-MultipleCreateTestJSON-340965759 Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-MultipleCreateTestJSON-340965759-project Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 6f7675c0fa214588b71c04ca120557fc Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-MultipleCreateTestJSON-340965759-project Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 8d9a73e6-e331-4c3d-8891-d636c150c1eb could not be found. Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '8d9a73e6-e331-4c3d-8891-d636c150c1eb'} Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d9a73e6-e331-4c3d-8891-d636c150c1eb could not be found. Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d9a73e6-e331-4c3d-8891-d636c150c1eb could not be found. Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:34:56.257167 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:34:56.273060 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:34:56.273060 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:34:56.273060 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:34:56.273060 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:34:56.273060 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:34:56.273060 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d9a73e6-e331-4c3d-8891-d636c150c1eb could not be found. Oct 30 01:34:56.273060 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:34:56.273060 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-78bff94e-fc6d-4a56-8f73-2cd62868ff95 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Returning 404 to user: Instance 8d9a73e6-e331-4c3d-8891-d636c150c1eb could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:34:56.273060 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-78bff94e-fc6d-4a56-8f73-2cd62868ff95 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] 10.222.0.13 "GET /compute/v2.1/servers/8d9a73e6-e331-4c3d-8891-d636c150c1eb" status: 404 len: 111 microversion: 2.1 time: 0.096421 Oct 30 01:34:56.273060 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2391/4761] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:56 2022] GET /compute/v2.1/servers/8d9a73e6-e331-4c3d-8891-d636c150c1eb => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:34:56.275071 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3eb00bef-2ee9-45d7-907a-ccf9dc98fd42 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:56.275071 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3eb00bef-2ee9-45d7-907a-ccf9dc98fd42 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] [instance: 949acdca-96a2-4077-b747-af87796dae5c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:56.290094 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3eb00bef-2ee9-45d7-907a-ccf9dc98fd42 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:56.292369 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3eb00bef-2ee9-45d7-907a-ccf9dc98fd42 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:56.292985 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3eb00bef-2ee9-45d7-907a-ccf9dc98fd42 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:56.296291 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3eb00bef-2ee9-45d7-907a-ccf9dc98fd42 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:56.296965 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3eb00bef-2ee9-45d7-907a-ccf9dc98fd42 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:56.298261 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3eb00bef-2ee9-45d7-907a-ccf9dc98fd42 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:56.320335 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-3eb00bef-2ee9-45d7-907a-ccf9dc98fd42 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] HTTP exception thrown: Instance 949acdca-96a2-4077-b747-af87796dae5c could not be found. Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3eb00bef-2ee9-45d7-907a-ccf9dc98fd42 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Request method failure captured: Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/949acdca-96a2-4077-b747-af87796dae5c HTTP/1.1 Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdRviIogWUqUuZ7mbYloymn5EXW-LS9cVmUI460B-0oXiZc-bo9jV-ToUbPUtF4Bsvknpg_uTOYrBKrJHsZXOZCW2_pPuzkAzecctnQPts1t6xPsFnXnkfHfOLng80cfaQR_fM2Pz19Qa-zU82f7wf-8aBaF9zcCtC1D08qVQTvBhMM Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 2b509d1b9c324201942dfeb350611a44 Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-MultipleCreateTestJSON-340965759 Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2b509d1b9c324201942dfeb350611a44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2b509d1b9c324201942dfeb350611a44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2b509d1b9c324201942dfeb350611a44"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2b509d1b9c324201942dfeb350611a44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-MultipleCreateTestJSON-340965759 Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 2b509d1b9c324201942dfeb350611a44 Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-MultipleCreateTestJSON-340965759 Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-MultipleCreateTestJSON-340965759-project Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 6f7675c0fa214588b71c04ca120557fc Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-MultipleCreateTestJSON-340965759-project Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 949acdca-96a2-4077-b747-af87796dae5c could not be found. Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '949acdca-96a2-4077-b747-af87796dae5c'} Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 949acdca-96a2-4077-b747-af87796dae5c could not be found. Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 949acdca-96a2-4077-b747-af87796dae5c could not be found. Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:34:56.323420 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:34:56.331539 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:34:56.331539 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:34:56.331539 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:34:56.331539 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:34:56.331539 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:34:56.331539 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 949acdca-96a2-4077-b747-af87796dae5c could not be found. Oct 30 01:34:56.331539 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:34:56.331539 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3eb00bef-2ee9-45d7-907a-ccf9dc98fd42 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] Returning 404 to user: Instance 949acdca-96a2-4077-b747-af87796dae5c could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:34:56.355342 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3eb00bef-2ee9-45d7-907a-ccf9dc98fd42 tempest-MultipleCreateTestJSON-340965759 tempest-MultipleCreateTestJSON-340965759-project] 10.222.0.13 "GET /compute/v2.1/servers/949acdca-96a2-4077-b747-af87796dae5c" status: 404 len: 111 microversion: 2.1 time: 0.087115 Oct 30 01:34:56.362581 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2371/4762] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:56 2022] GET /compute/v2.1/servers/949acdca-96a2-4077-b747-af87796dae5c => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:34:56.496780 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0ed33787-a9a1-468a-8e70-7ea1b68c40bf tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:56.497449 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0ed33787-a9a1-468a-8e70-7ea1b68c40bf tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:56.506376 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0ed33787-a9a1-468a-8e70-7ea1b68c40bf tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:56.508957 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0ed33787-a9a1-468a-8e70-7ea1b68c40bf tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:56.513076 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0ed33787-a9a1-468a-8e70-7ea1b68c40bf tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:56.513076 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0ed33787-a9a1-468a-8e70-7ea1b68c40bf tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:56.513076 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0ed33787-a9a1-468a-8e70-7ea1b68c40bf tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:56.513076 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0ed33787-a9a1-468a-8e70-7ea1b68c40bf tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:56.539719 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d8d91b13-ba10-4b49-ac16-0d3776133fd9 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:56.540584 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d8d91b13-ba10-4b49-ac16-0d3776133fd9 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:56.564758 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d8d91b13-ba10-4b49-ac16-0d3776133fd9 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:56.570650 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d8d91b13-ba10-4b49-ac16-0d3776133fd9 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:56.571556 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d8d91b13-ba10-4b49-ac16-0d3776133fd9 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:56.574786 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d8d91b13-ba10-4b49-ac16-0d3776133fd9 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:56.576720 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d8d91b13-ba10-4b49-ac16-0d3776133fd9 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:56.579454 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d8d91b13-ba10-4b49-ac16-0d3776133fd9 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:56.910572 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d8d91b13-ba10-4b49-ac16-0d3776133fd9 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:56.929199 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d8d91b13-ba10-4b49-ac16-0d3776133fd9 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:56.931079 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d8d91b13-ba10-4b49-ac16-0d3776133fd9 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:56.932850 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d8d91b13-ba10-4b49-ac16-0d3776133fd9 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1603 microversion: 2.32 time: 0.397672 Oct 30 01:34:56.936298 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2372/4763] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:34:56 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1603 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:34:57.486770 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0ed33787-a9a1-468a-8e70-7ea1b68c40bf tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:57.495914 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0ed33787-a9a1-468a-8e70-7ea1b68c40bf tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 1.004446 Oct 30 01:34:57.520988 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2392/4764] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:56 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:34:57.525526 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6542b7f7-ca07-4a48-a6e5-b5dc5dbef3bf tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:57.528443 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6542b7f7-ca07-4a48-a6e5-b5dc5dbef3bf tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:57.546607 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6542b7f7-ca07-4a48-a6e5-b5dc5dbef3bf tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:57.548515 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6542b7f7-ca07-4a48-a6e5-b5dc5dbef3bf tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:57.550588 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6542b7f7-ca07-4a48-a6e5-b5dc5dbef3bf tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:57.552757 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6542b7f7-ca07-4a48-a6e5-b5dc5dbef3bf tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:57.556843 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6542b7f7-ca07-4a48-a6e5-b5dc5dbef3bf tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:57.558277 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6542b7f7-ca07-4a48-a6e5-b5dc5dbef3bf tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:57.606818 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:34:57.964528 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-827f3954-53dc-4558-95a0-f462e3938be1 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:57.965487 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-827f3954-53dc-4558-95a0-f462e3938be1 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:57.974868 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-827f3954-53dc-4558-95a0-f462e3938be1 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:57.979020 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-827f3954-53dc-4558-95a0-f462e3938be1 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:57.979666 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-827f3954-53dc-4558-95a0-f462e3938be1 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:57.980563 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-827f3954-53dc-4558-95a0-f462e3938be1 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:57.981492 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-827f3954-53dc-4558-95a0-f462e3938be1 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:57.982324 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-827f3954-53dc-4558-95a0-f462e3938be1 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:58.022807 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:34:58.206350 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6542b7f7-ca07-4a48-a6e5-b5dc5dbef3bf tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:58.223104 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6542b7f7-ca07-4a48-a6e5-b5dc5dbef3bf tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.701828 Oct 30 01:34:58.224598 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2373/4765] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:57 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:34:58.260932 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6f21baa9-43e0-41ba-aa3a-a6d7301c5c23 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:58.261543 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6f21baa9-43e0-41ba-aa3a-a6d7301c5c23 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:58.276990 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f21baa9-43e0-41ba-aa3a-a6d7301c5c23 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:58.278085 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f21baa9-43e0-41ba-aa3a-a6d7301c5c23 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:58.278085 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f21baa9-43e0-41ba-aa3a-a6d7301c5c23 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:58.278646 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f21baa9-43e0-41ba-aa3a-a6d7301c5c23 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:58.279278 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f21baa9-43e0-41ba-aa3a-a6d7301c5c23 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:58.279865 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f21baa9-43e0-41ba-aa3a-a6d7301c5c23 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:58.294664 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-827f3954-53dc-4558-95a0-f462e3938be1 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:58.309361 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-827f3954-53dc-4558-95a0-f462e3938be1 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:58.321226 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-827f3954-53dc-4558-95a0-f462e3938be1 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:58.322700 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-827f3954-53dc-4558-95a0-f462e3938be1 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1603 microversion: 2.32 time: 0.362491 Oct 30 01:34:58.337978 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2393/4766] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:34:57 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1603 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:34:59.111262 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6f21baa9-43e0-41ba-aa3a-a6d7301c5c23 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:59.128118 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6f21baa9-43e0-41ba-aa3a-a6d7301c5c23 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.873943 Oct 30 01:34:59.149696 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2374/4767] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:58 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:34:59.158148 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cd545b98-16ad-4bd1-af80-56ed9e91b45b tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:34:59.164823 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-cd545b98-16ad-4bd1-af80-56ed9e91b45b tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] HTTP exception thrown: Instance 3d7a8cd1-246c-403b-8d3e-16bbe5a0846d has no mapping to a cell. Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cd545b98-16ad-4bd1-af80-56ed9e91b45b tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Request method failure captured: Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/servers/3d7a8cd1-246c-403b-8d3e-16bbe5a0846d/action HTTP/1.1 Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 15 Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdPsZZXjRvWKe2zWP-5VH1VYAsWsLLjUmpyob2uINkfAXNLt0qGMmCTWjYn2WpZ3XOOdsuaM4lwk-qZrOIX3mOHzuCJPZ3r-9M-w153XBWLoTow-eSMj1bsAWDNo3KKhMzjHqic8AJ-DcXpdsBh93g0dRB_UMWMRrGyY1cbSRdHJrvg Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 0bce487302c24def8a8473b0725904f2 Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: {"os-stop": {}} Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 3d7a8cd1-246c-403b-8d3e-16bbe5a0846d has no mapping to a cell. Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '3d7a8cd1-246c-403b-8d3e-16bbe5a0846d', 'body': {'os-stop': {}}} Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 3d7a8cd1-246c-403b-8d3e-16bbe5a0846d has no mapping to a cell. Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:34:59.174106 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d7a8cd1-246c-403b-8d3e-16bbe5a0846d has no mapping to a cell. Oct 30 01:34:59.178919 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:34:59.178919 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:34:59.178919 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:34:59.178919 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:34:59.178919 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:34:59.178919 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:34:59.178919 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:34:59.178919 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:34:59.178919 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d7a8cd1-246c-403b-8d3e-16bbe5a0846d has no mapping to a cell. Oct 30 01:34:59.178919 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:34:59.178919 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cd545b98-16ad-4bd1-af80-56ed9e91b45b tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Returning 404 to user: Instance 3d7a8cd1-246c-403b-8d3e-16bbe5a0846d has no mapping to a cell. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:34:59.178919 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cd545b98-16ad-4bd1-af80-56ed9e91b45b tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "POST /compute/v2.1/servers/3d7a8cd1-246c-403b-8d3e-16bbe5a0846d/action" status: 404 len: 117 microversion: 2.1 time: 0.022467 Oct 30 01:34:59.185626 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2e853695-ed42-4e54-900f-fffa910a12ec tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:59.186332 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2e853695-ed42-4e54-900f-fffa910a12ec tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:59.191520 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2394/4768] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:34:59 2022] POST /compute/v2.1/servers/3d7a8cd1-246c-403b-8d3e-16bbe5a0846d/action => generated 117 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 01:34:59.196894 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2e853695-ed42-4e54-900f-fffa910a12ec tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:59.198071 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2e853695-ed42-4e54-900f-fffa910a12ec tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:59.202353 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2e853695-ed42-4e54-900f-fffa910a12ec tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:59.203127 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2e853695-ed42-4e54-900f-fffa910a12ec tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:59.204244 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2e853695-ed42-4e54-900f-fffa910a12ec tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:59.204681 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2e853695-ed42-4e54-900f-fffa910a12ec tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:59.354832 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-146459d3-84e9-4f59-b523-ae0f997feeee tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:34:59.355446 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-146459d3-84e9-4f59-b523-ae0f997feeee tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:34:59.373301 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-146459d3-84e9-4f59-b523-ae0f997feeee tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:59.374200 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-146459d3-84e9-4f59-b523-ae0f997feeee tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:59.376479 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-146459d3-84e9-4f59-b523-ae0f997feeee tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:59.378775 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-146459d3-84e9-4f59-b523-ae0f997feeee tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:34:59.379420 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-146459d3-84e9-4f59-b523-ae0f997feeee tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:34:59.380543 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-146459d3-84e9-4f59-b523-ae0f997feeee tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:34:59.867765 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-146459d3-84e9-4f59-b523-ae0f997feeee tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:59.905304 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-146459d3-84e9-4f59-b523-ae0f997feeee tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:59.911119 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-146459d3-84e9-4f59-b523-ae0f997feeee tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:34:59.913997 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-146459d3-84e9-4f59-b523-ae0f997feeee tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1603 microversion: 2.32 time: 0.561709 Oct 30 01:34:59.916460 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2395/4769] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:34:59 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1603 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:35:00.151537 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2e853695-ed42-4e54-900f-fffa910a12ec tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:35:00.164138 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2e853695-ed42-4e54-900f-fffa910a12ec tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.982576 Oct 30 01:35:00.169630 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2375/4770] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:34:59 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:35:00.189538 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-28af488b-a4c2-417c-81ac-95f8c835a111 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:00.190173 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-28af488b-a4c2-417c-81ac-95f8c835a111 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:00.202780 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-28af488b-a4c2-417c-81ac-95f8c835a111 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:00.205756 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-28af488b-a4c2-417c-81ac-95f8c835a111 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:00.206401 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-28af488b-a4c2-417c-81ac-95f8c835a111 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:00.207182 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-28af488b-a4c2-417c-81ac-95f8c835a111 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:00.210128 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-28af488b-a4c2-417c-81ac-95f8c835a111 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:00.210674 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-28af488b-a4c2-417c-81ac-95f8c835a111 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:00.945491 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d9686d86-6f82-4e2b-8b95-119351fb8998 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:00.948210 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d9686d86-6f82-4e2b-8b95-119351fb8998 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:00.958816 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d9686d86-6f82-4e2b-8b95-119351fb8998 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:00.961311 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d9686d86-6f82-4e2b-8b95-119351fb8998 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:00.964024 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d9686d86-6f82-4e2b-8b95-119351fb8998 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:00.965038 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d9686d86-6f82-4e2b-8b95-119351fb8998 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:00.967089 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d9686d86-6f82-4e2b-8b95-119351fb8998 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:00.968700 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d9686d86-6f82-4e2b-8b95-119351fb8998 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:01.042281 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d9686d86-6f82-4e2b-8b95-119351fb8998 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:01.044313 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d9686d86-6f82-4e2b-8b95-119351fb8998 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:01.044945 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d9686d86-6f82-4e2b-8b95-119351fb8998 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:01.045638 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-d9686d86-6f82-4e2b-8b95-119351fb8998 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lazy-loading 'fault' on Instance uuid 71a745a1-eaaf-4b96-8ed1-05e574cf4018 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:35:01.195093 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-28af488b-a4c2-417c-81ac-95f8c835a111 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:35:01.202532 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d9686d86-6f82-4e2b-8b95-119351fb8998 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:35:01.208033 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-28af488b-a4c2-417c-81ac-95f8c835a111 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 1.023300 Oct 30 01:35:01.209606 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2396/4771] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:35:00 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:35:01.226608 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d9686d86-6f82-4e2b-8b95-119351fb8998 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:35:01.229543 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d9686d86-6f82-4e2b-8b95-119351fb8998 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55d02fb5fddb48e49fb66428db0f0424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:35:01.231389 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d9686d86-6f82-4e2b-8b95-119351fb8998 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 200 len: 1608 microversion: 2.32 time: 0.290429 Oct 30 01:35:01.232116 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2376/4772] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:35:00 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 1608 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:35:01.246846 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6a0be781-24ec-4271-845b-236dd739bbb8 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:35:01.247588 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6a0be781-24ec-4271-845b-236dd739bbb8 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: 3a3e8adb-0ab1-4c53-893b-8aec05208c06] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:01.260800 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-6a0be781-24ec-4271-845b-236dd739bbb8 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] HTTP exception thrown: Instance 3a3e8adb-0ab1-4c53-893b-8aec05208c06 could not be found. Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6a0be781-24ec-4271-845b-236dd739bbb8 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Request method failure captured: Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/servers/3a3e8adb-0ab1-4c53-893b-8aec05208c06/action HTTP/1.1 Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 15 Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdPsZZXjRvWKe2zWP-5VH1VYAsWsLLjUmpyob2uINkfAXNLt0qGMmCTWjYn2WpZ3XOOdsuaM4lwk-qZrOIX3mOHzuCJPZ3r-9M-w153XBWLoTow-eSMj1bsAWDNo3KKhMzjHqic8AJ-DcXpdsBh93g0dRB_UMWMRrGyY1cbSRdHJrvg Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 0bce487302c24def8a8473b0725904f2 Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: {"suspend": {}} Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 3a3e8adb-0ab1-4c53-893b-8aec05208c06 could not be found. Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '3a3e8adb-0ab1-4c53-893b-8aec05208c06', 'body': {'suspend': {}}} Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a3e8adb-0ab1-4c53-893b-8aec05208c06 could not be found. Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a3e8adb-0ab1-4c53-893b-8aec05208c06 could not be found. Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:35:01.262523 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:35:01.266925 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:35:01.266925 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:35:01.266925 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a3e8adb-0ab1-4c53-893b-8aec05208c06 could not be found. Oct 30 01:35:01.266925 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:35:01.267765 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6a0be781-24ec-4271-845b-236dd739bbb8 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Returning 404 to user: Instance 3a3e8adb-0ab1-4c53-893b-8aec05208c06 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:35:01.268905 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6a0be781-24ec-4271-845b-236dd739bbb8 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "POST /compute/v2.1/servers/3a3e8adb-0ab1-4c53-893b-8aec05208c06/action" status: 404 len: 111 microversion: 2.1 time: 0.040335 Oct 30 01:35:01.273550 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2397/4773] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:35:01 2022] POST /compute/v2.1/servers/3a3e8adb-0ab1-4c53-893b-8aec05208c06/action => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:35:01.279581 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7b09c1ff-87d0-49e0-8b56-bd18305b7ea9 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:01.282082 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7b09c1ff-87d0-49e0-8b56-bd18305b7ea9 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:01.288141 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b09c1ff-87d0-49e0-8b56-bd18305b7ea9 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:01.298449 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b09c1ff-87d0-49e0-8b56-bd18305b7ea9 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:01.298945 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b09c1ff-87d0-49e0-8b56-bd18305b7ea9 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:01.299733 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b09c1ff-87d0-49e0-8b56-bd18305b7ea9 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:01.300169 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b09c1ff-87d0-49e0-8b56-bd18305b7ea9 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:01.300595 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b09c1ff-87d0-49e0-8b56-bd18305b7ea9 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:01.773950 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7b09c1ff-87d0-49e0-8b56-bd18305b7ea9 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:35:01.784971 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7b09c1ff-87d0-49e0-8b56-bd18305b7ea9 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.509853 Oct 30 01:35:01.786479 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2377/4774] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:35:01 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:35:01.809380 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-12ef97e5-b0e3-4ab5-a5f5-72e208e060dc tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:01.810938 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-12ef97e5-b0e3-4ab5-a5f5-72e208e060dc tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:01.824276 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-12ef97e5-b0e3-4ab5-a5f5-72e208e060dc tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:01.824957 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-12ef97e5-b0e3-4ab5-a5f5-72e208e060dc tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:01.825593 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-12ef97e5-b0e3-4ab5-a5f5-72e208e060dc tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:01.826689 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-12ef97e5-b0e3-4ab5-a5f5-72e208e060dc tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:01.827313 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-12ef97e5-b0e3-4ab5-a5f5-72e208e060dc tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:01.827739 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-12ef97e5-b0e3-4ab5-a5f5-72e208e060dc tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:02.263776 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a74a0ac1-5c06-4908-9730-a339246c5ce8 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:02.265152 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a74a0ac1-5c06-4908-9730-a339246c5ce8 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:02.288309 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a74a0ac1-5c06-4908-9730-a339246c5ce8 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:02.289144 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a74a0ac1-5c06-4908-9730-a339246c5ce8 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:02.292744 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a74a0ac1-5c06-4908-9730-a339246c5ce8 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:02.293792 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a74a0ac1-5c06-4908-9730-a339246c5ce8 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:02.295568 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a74a0ac1-5c06-4908-9730-a339246c5ce8 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:02.297937 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a74a0ac1-5c06-4908-9730-a339246c5ce8 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:02.321705 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-a74a0ac1-5c06-4908-9730-a339246c5ce8 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] HTTP exception thrown: Instance 71a745a1-eaaf-4b96-8ed1-05e574cf4018 could not be found. Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a74a0ac1-5c06-4908-9730-a339246c5ce8 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Request method failure captured: Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 HTTP/1.1 Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdK-PMouFS8tOrWg0Ac_b-EvsF-32RtGT4CmG_nngybp9Rpi9IaHZraycIScbzQiEe4aArHiyE9lP1PWqr-MN1vCYzcImtfdVbrKiyJ0iAI2Noeqf7ovf5FCCGR0mXfX5IL886GPMPY5kkDEUvgL54ElM34J-GIdnL-NocRErBEkPBM Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: X-Openstack-Nova-Api-Version: 2.32 Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 51b75ee1fcc142dd9eb8cb4e3ea631b8 Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-TaggedBootDevicesTest-814140194 Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/51b75ee1fcc142dd9eb8cb4e3ea631b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_51b75ee1fcc142dd9eb8cb4e3ea631b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/51b75ee1fcc142dd9eb8cb4e3ea631b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/51b75ee1fcc142dd9eb8cb4e3ea631b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-TaggedBootDevicesTest-814140194 Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 51b75ee1fcc142dd9eb8cb4e3ea631b8 Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-TaggedBootDevicesTest-814140194 Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-TaggedBootDevicesTest-814140194-project Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 55d02fb5fddb48e49fb66428db0f0424 Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-TaggedBootDevicesTest-814140194-project Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 71a745a1-eaaf-4b96-8ed1-05e574cf4018 could not be found. Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '71a745a1-eaaf-4b96-8ed1-05e574cf4018'} Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71a745a1-eaaf-4b96-8ed1-05e574cf4018 could not be found. Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71a745a1-eaaf-4b96-8ed1-05e574cf4018 could not be found. Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:35:02.324205 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:02.330178 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:35:02.330178 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:35:02.330178 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:35:02.330178 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:35:02.330178 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:35:02.330178 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71a745a1-eaaf-4b96-8ed1-05e574cf4018 could not be found. Oct 30 01:35:02.330178 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:02.331846 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a74a0ac1-5c06-4908-9730-a339246c5ce8 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Returning 404 to user: Instance 71a745a1-eaaf-4b96-8ed1-05e574cf4018 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:35:02.333546 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a74a0ac1-5c06-4908-9730-a339246c5ce8 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 404 len: 111 microversion: 2.32 time: 0.074807 Oct 30 01:35:02.334720 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2378/4775] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:35:02 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:35:02.359295 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-68597266-3d00-4bbd-81cd-f8a88e5ba7ca tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '.version_select at 0x7f44c7e15f70>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:02.496921 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-68597266-3d00-4bbd-81cd-f8a88e5ba7ca tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-970496102" status: 204 len: 0 microversion: 2.32 time: 0.156338 Oct 30 01:35:02.498288 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2379/4776] 10.222.0.13 () {60 vars in 1259 bytes} [Sun Oct 30 01:35:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-970496102 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 30 01:35:02.632681 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-12ef97e5-b0e3-4ab5-a5f5-72e208e060dc tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:35:02.640999 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-12ef97e5-b0e3-4ab5-a5f5-72e208e060dc tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.835456 Oct 30 01:35:02.656523 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2398/4777] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:35:01 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:35:02.680865 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e7b9bd57-3467-4817-95ce-6d7ca99b0c01 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:35:02.685365 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e7b9bd57-3467-4817-95ce-6d7ca99b0c01 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:02.698994 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7b9bd57-3467-4817-95ce-6d7ca99b0c01 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:02.700449 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7b9bd57-3467-4817-95ce-6d7ca99b0c01 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:02.701831 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7b9bd57-3467-4817-95ce-6d7ca99b0c01 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:02.703144 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7b9bd57-3467-4817-95ce-6d7ca99b0c01 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:02.706356 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7b9bd57-3467-4817-95ce-6d7ca99b0c01 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:02.707110 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7b9bd57-3467-4817-95ce-6d7ca99b0c01 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:02.748115 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-e7b9bd57-3467-4817-95ce-6d7ca99b0c01 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lazy-loading 'flavor' on Instance uuid b0c51345-2948-4ff1-828f-8c70b2b979f2 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:35:03.104394 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e7b9bd57-3467-4817-95ce-6d7ca99b0c01 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "POST /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2/action" status: 202 len: 0 microversion: 2.1 time: 0.441330 Oct 30 01:35:03.107918 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2380/4778] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:35:02 2022] POST /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2/action => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:35:03.126462 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9ce83d4e-bf2c-4c8d-96bb-084df505daea tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:03.128637 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9ce83d4e-bf2c-4c8d-96bb-084df505daea tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:03.142390 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9ce83d4e-bf2c-4c8d-96bb-084df505daea tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:03.143169 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9ce83d4e-bf2c-4c8d-96bb-084df505daea tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:03.145989 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9ce83d4e-bf2c-4c8d-96bb-084df505daea tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:03.147437 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9ce83d4e-bf2c-4c8d-96bb-084df505daea tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:03.148112 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9ce83d4e-bf2c-4c8d-96bb-084df505daea tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:03.149069 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9ce83d4e-bf2c-4c8d-96bb-084df505daea tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:03.471058 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9ce83d4e-bf2c-4c8d-96bb-084df505daea tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:35:03.488884 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9ce83d4e-bf2c-4c8d-96bb-084df505daea tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1511 microversion: 2.1 time: 0.378764 Oct 30 01:35:03.503328 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2399/4779] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:35:03 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1511 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:35:04.516406 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0022b259-2d1f-4d2f-8270-d89895ca9987 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:04.517118 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0022b259-2d1f-4d2f-8270-d89895ca9987 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:04.540316 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0022b259-2d1f-4d2f-8270-d89895ca9987 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:04.540316 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0022b259-2d1f-4d2f-8270-d89895ca9987 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:04.540316 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0022b259-2d1f-4d2f-8270-d89895ca9987 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:04.540316 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0022b259-2d1f-4d2f-8270-d89895ca9987 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:04.549243 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0022b259-2d1f-4d2f-8270-d89895ca9987 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:04.549726 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0022b259-2d1f-4d2f-8270-d89895ca9987 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:05.052542 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0022b259-2d1f-4d2f-8270-d89895ca9987 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:35:05.075238 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0022b259-2d1f-4d2f-8270-d89895ca9987 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1494 microversion: 2.1 time: 0.562668 Oct 30 01:35:05.076749 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2381/4780] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:35:04 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1494 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:35:05.105602 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ba069068-ce35-4e3e-990f-0444195db92a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:35:05.106927 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ba069068-ce35-4e3e-990f-0444195db92a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:05.132203 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ba069068-ce35-4e3e-990f-0444195db92a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:05.132702 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ba069068-ce35-4e3e-990f-0444195db92a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:05.134223 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ba069068-ce35-4e3e-990f-0444195db92a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:05.135196 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ba069068-ce35-4e3e-990f-0444195db92a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:05.139743 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ba069068-ce35-4e3e-990f-0444195db92a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:05.144780 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ba069068-ce35-4e3e-990f-0444195db92a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:05.243267 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-ba069068-ce35-4e3e-990f-0444195db92a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lazy-loading 'flavor' on Instance uuid b0c51345-2948-4ff1-828f-8c70b2b979f2 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:35:05.288608 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-ba069068-ce35-4e3e-990f-0444195db92a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] HTTP exception thrown: Cannot 'suspend' instance b0c51345-2948-4ff1-828f-8c70b2b979f2 while it is in vm_state suspended Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ba069068-ce35-4e3e-990f-0444195db92a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Request method failure captured: Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2/action HTTP/1.1 Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 15 Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdPsZZXjRvWKe2zWP-5VH1VYAsWsLLjUmpyob2uINkfAXNLt0qGMmCTWjYn2WpZ3XOOdsuaM4lwk-qZrOIX3mOHzuCJPZ3r-9M-w153XBWLoTow-eSMj1bsAWDNo3KKhMzjHqic8AJ-DcXpdsBh93g0dRB_UMWMRrGyY1cbSRdHJrvg Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 0bce487302c24def8a8473b0725904f2 Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: {"suspend": {}} Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: exception: Cannot 'suspend' instance b0c51345-2948-4ff1-828f-8c70b2b979f2 while it is in vm_state suspended Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'b0c51345-2948-4ff1-828f-8c70b2b979f2', 'body': {'suspend': {}}} Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b0c51345-2948-4ff1-828f-8c70b2b979f2 in vm_state suspended. Cannot suspend while the instance is in this state. Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 30 01:35:05.290320 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 30 01:35:05.301852 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 30 01:35:05.301852 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 30 01:35:05.301852 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance b0c51345-2948-4ff1-828f-8c70b2b979f2 while it is in vm_state suspended Oct 30 01:35:05.301852 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:35:05.301852 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:35:05.301852 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:35:05.301852 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:35:05.301852 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:35:05.301852 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:35:05.301852 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:35:05.301852 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:35:05.301852 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance b0c51345-2948-4ff1-828f-8c70b2b979f2 while it is in vm_state suspended Oct 30 01:35:05.301852 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:35:05.301852 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ba069068-ce35-4e3e-990f-0444195db92a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Returning 409 to user: Cannot 'suspend' instance b0c51345-2948-4ff1-828f-8c70b2b979f2 while it is in vm_state suspended {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:35:05.301852 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ba069068-ce35-4e3e-990f-0444195db92a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "POST /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2/action" status: 409 len: 148 microversion: 2.1 time: 0.191150 Oct 30 01:35:05.301852 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2400/4781] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:35:05 2022] POST /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2/action => generated 148 bytes in 193 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:35:05.304105 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6227d148-a812-4707-879f-2c27736e07de tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:35:05.304105 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6227d148-a812-4707-879f-2c27736e07de tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:05.312859 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6227d148-a812-4707-879f-2c27736e07de tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:05.313373 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6227d148-a812-4707-879f-2c27736e07de tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:05.325805 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6227d148-a812-4707-879f-2c27736e07de tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:05.326588 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6227d148-a812-4707-879f-2c27736e07de tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:05.327085 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6227d148-a812-4707-879f-2c27736e07de tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:05.327532 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6227d148-a812-4707-879f-2c27736e07de tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:05.656064 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6227d148-a812-4707-879f-2c27736e07de tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "POST /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2/action" status: 202 len: 0 microversion: 2.1 time: 0.355488 Oct 30 01:35:05.663285 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2382/4782] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:35:05 2022] POST /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2/action => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:35:05.667809 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-efcdecf3-e07a-4ad6-ba5f-a50321c2a258 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:05.667809 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-efcdecf3-e07a-4ad6-ba5f-a50321c2a258 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:05.675538 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-efcdecf3-e07a-4ad6-ba5f-a50321c2a258 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:05.676045 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-efcdecf3-e07a-4ad6-ba5f-a50321c2a258 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:05.676487 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-efcdecf3-e07a-4ad6-ba5f-a50321c2a258 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:05.677206 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-efcdecf3-e07a-4ad6-ba5f-a50321c2a258 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:05.677683 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-efcdecf3-e07a-4ad6-ba5f-a50321c2a258 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:05.678234 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-efcdecf3-e07a-4ad6-ba5f-a50321c2a258 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:06.480196 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-efcdecf3-e07a-4ad6-ba5f-a50321c2a258 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:35:06.488705 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-efcdecf3-e07a-4ad6-ba5f-a50321c2a258 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1500 microversion: 2.1 time: 0.826179 Oct 30 01:35:06.490950 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2401/4783] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:35:05 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1500 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:35:07.516030 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6db12d03-7de0-4c2c-b356-13cde2c1415e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:07.516794 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6db12d03-7de0-4c2c-b356-13cde2c1415e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:07.529575 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6db12d03-7de0-4c2c-b356-13cde2c1415e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:07.534956 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6db12d03-7de0-4c2c-b356-13cde2c1415e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:07.534956 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6db12d03-7de0-4c2c-b356-13cde2c1415e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:07.534956 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6db12d03-7de0-4c2c-b356-13cde2c1415e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:07.534956 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6db12d03-7de0-4c2c-b356-13cde2c1415e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:07.534956 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6db12d03-7de0-4c2c-b356-13cde2c1415e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:07.915971 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6db12d03-7de0-4c2c-b356-13cde2c1415e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:35:07.928744 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6db12d03-7de0-4c2c-b356-13cde2c1415e tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1500 microversion: 2.1 time: 0.418930 Oct 30 01:35:07.930520 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2383/4784] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:35:07 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1500 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:35:08.953127 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b0476b2f-f4b3-4ae8-945f-43ae2f52d8b8 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:08.953873 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b0476b2f-f4b3-4ae8-945f-43ae2f52d8b8 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:08.966520 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0476b2f-f4b3-4ae8-945f-43ae2f52d8b8 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:08.971673 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0476b2f-f4b3-4ae8-945f-43ae2f52d8b8 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:08.972305 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0476b2f-f4b3-4ae8-945f-43ae2f52d8b8 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:08.973252 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0476b2f-f4b3-4ae8-945f-43ae2f52d8b8 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:08.973902 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0476b2f-f4b3-4ae8-945f-43ae2f52d8b8 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:08.974534 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0476b2f-f4b3-4ae8-945f-43ae2f52d8b8 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:09.415442 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b0476b2f-f4b3-4ae8-945f-43ae2f52d8b8 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:35:09.427837 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b0476b2f-f4b3-4ae8-945f-43ae2f52d8b8 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.479012 Oct 30 01:35:09.428435 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2402/4785] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:35:08 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:35:09.453913 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9468bc19-25a1-4cb8-a1cc-200ecb627bc9 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:09.455172 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9468bc19-25a1-4cb8-a1cc-200ecb627bc9 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:09.458985 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:35:09.464666 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9468bc19-25a1-4cb8-a1cc-200ecb627bc9 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:09.465412 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9468bc19-25a1-4cb8-a1cc-200ecb627bc9 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:09.466016 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9468bc19-25a1-4cb8-a1cc-200ecb627bc9 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:09.466916 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9468bc19-25a1-4cb8-a1cc-200ecb627bc9 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:09.467545 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9468bc19-25a1-4cb8-a1cc-200ecb627bc9 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:09.468151 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9468bc19-25a1-4cb8-a1cc-200ecb627bc9 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:09.917684 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9468bc19-25a1-4cb8-a1cc-200ecb627bc9 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:35:09.928980 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9468bc19-25a1-4cb8-a1cc-200ecb627bc9 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.479770 Oct 30 01:35:09.932117 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2384/4786] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:35:09 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:35:09.955209 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e9e00129-0e06-4a15-8ad5-eb57df912763 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:35:09.956394 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e9e00129-0e06-4a15-8ad5-eb57df912763 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: 1a59347b-d030-4204-8e24-642c8c8bfb1b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:09.966567 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-e9e00129-0e06-4a15-8ad5-eb57df912763 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] HTTP exception thrown: Instance 1a59347b-d030-4204-8e24-642c8c8bfb1b could not be found. Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e9e00129-0e06-4a15-8ad5-eb57df912763 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Request method failure captured: Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/servers/1a59347b-d030-4204-8e24-642c8c8bfb1b/action HTTP/1.1 Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 15 Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdPsZZXjRvWKe2zWP-5VH1VYAsWsLLjUmpyob2uINkfAXNLt0qGMmCTWjYn2WpZ3XOOdsuaM4lwk-qZrOIX3mOHzuCJPZ3r-9M-w153XBWLoTow-eSMj1bsAWDNo3KKhMzjHqic8AJ-DcXpdsBh93g0dRB_UMWMRrGyY1cbSRdHJrvg Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 0bce487302c24def8a8473b0725904f2 Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: {"unpause": {}} Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 1a59347b-d030-4204-8e24-642c8c8bfb1b could not be found. Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '1a59347b-d030-4204-8e24-642c8c8bfb1b', 'body': {'unpause': {}}} Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a59347b-d030-4204-8e24-642c8c8bfb1b could not be found. Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a59347b-d030-4204-8e24-642c8c8bfb1b could not be found. Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:35:09.971561 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:35:09.976512 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:35:09.976512 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:35:09.976512 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a59347b-d030-4204-8e24-642c8c8bfb1b could not be found. Oct 30 01:35:09.976512 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:35:09.980284 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e9e00129-0e06-4a15-8ad5-eb57df912763 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Returning 404 to user: Instance 1a59347b-d030-4204-8e24-642c8c8bfb1b could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:35:09.981859 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e9e00129-0e06-4a15-8ad5-eb57df912763 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "POST /compute/v2.1/servers/1a59347b-d030-4204-8e24-642c8c8bfb1b/action" status: 404 len: 111 microversion: 2.1 time: 0.031779 Oct 30 01:35:09.986025 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2403/4787] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:35:09 2022] POST /compute/v2.1/servers/1a59347b-d030-4204-8e24-642c8c8bfb1b/action => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:35:09.992263 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8193061c-8a38-4456-a99f-9ad6997cbef7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:09.993327 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8193061c-8a38-4456-a99f-9ad6997cbef7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:10.007998 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8193061c-8a38-4456-a99f-9ad6997cbef7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:10.010717 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8193061c-8a38-4456-a99f-9ad6997cbef7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:10.011524 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8193061c-8a38-4456-a99f-9ad6997cbef7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:10.016659 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8193061c-8a38-4456-a99f-9ad6997cbef7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:10.017518 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8193061c-8a38-4456-a99f-9ad6997cbef7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:10.018138 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8193061c-8a38-4456-a99f-9ad6997cbef7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:10.436110 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8193061c-8a38-4456-a99f-9ad6997cbef7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:35:10.449597 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8193061c-8a38-4456-a99f-9ad6997cbef7 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.459389 Oct 30 01:35:10.452705 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2385/4788] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:35:09 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:35:10.476828 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-65404b9c-bf6a-46d1-8fe4-9002b52abbe9 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:10.478441 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-65404b9c-bf6a-46d1-8fe4-9002b52abbe9 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:10.487054 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-65404b9c-bf6a-46d1-8fe4-9002b52abbe9 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:10.487567 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-65404b9c-bf6a-46d1-8fe4-9002b52abbe9 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:10.488013 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-65404b9c-bf6a-46d1-8fe4-9002b52abbe9 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:10.488997 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-65404b9c-bf6a-46d1-8fe4-9002b52abbe9 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:10.489496 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-65404b9c-bf6a-46d1-8fe4-9002b52abbe9 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:10.499754 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-65404b9c-bf6a-46d1-8fe4-9002b52abbe9 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:10.792662 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-65404b9c-bf6a-46d1-8fe4-9002b52abbe9 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:35:10.803155 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-65404b9c-bf6a-46d1-8fe4-9002b52abbe9 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.330618 Oct 30 01:35:10.814670 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2386/4789] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:35:10 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:35:10.837571 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-93601c4e-5f9f-4076-9f43-0c972eaaf619 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:35:10.837571 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-93601c4e-5f9f-4076-9f43-0c972eaaf619 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:10.863342 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-93601c4e-5f9f-4076-9f43-0c972eaaf619 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:10.865531 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-93601c4e-5f9f-4076-9f43-0c972eaaf619 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:10.867022 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-36e0efa2-e439-4aa7-b9c4-0ce47feaefcf tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1121309032", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "cc59195e-10d2-4c97-a1d0-947365ceabf3"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:35:10.867404 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-93601c4e-5f9f-4076-9f43-0c972eaaf619 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:10.868311 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-93601c4e-5f9f-4076-9f43-0c972eaaf619 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:10.871547 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-93601c4e-5f9f-4076-9f43-0c972eaaf619 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:10.875563 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-93601c4e-5f9f-4076-9f43-0c972eaaf619 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:11.037906 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-93601c4e-5f9f-4076-9f43-0c972eaaf619 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] HTTP exception thrown: Cannot 'unpause' instance b0c51345-2948-4ff1-828f-8c70b2b979f2 while it is in vm_state active Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-93601c4e-5f9f-4076-9f43-0c972eaaf619 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Request method failure captured: Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: request: POST /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2/action HTTP/1.1 Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 15 Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdPsZZXjRvWKe2zWP-5VH1VYAsWsLLjUmpyob2uINkfAXNLt0qGMmCTWjYn2WpZ3XOOdsuaM4lwk-qZrOIX3mOHzuCJPZ3r-9M-w153XBWLoTow-eSMj1bsAWDNo3KKhMzjHqic8AJ-DcXpdsBh93g0dRB_UMWMRrGyY1cbSRdHJrvg Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 0bce487302c24def8a8473b0725904f2 Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: {"unpause": {}} Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: exception: Cannot 'unpause' instance b0c51345-2948-4ff1-828f-8c70b2b979f2 while it is in vm_state active Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'b0c51345-2948-4ff1-828f-8c70b2b979f2', 'body': {'unpause': {}}} Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b0c51345-2948-4ff1-828f-8c70b2b979f2 in vm_state active. Cannot unpause while the instance is in this state. Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance b0c51345-2948-4ff1-828f-8c70b2b979f2 while it is in vm_state active Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:35:11.040831 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:35:11.045487 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:35:11.045487 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:35:11.045487 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:35:11.045487 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance b0c51345-2948-4ff1-828f-8c70b2b979f2 while it is in vm_state active Oct 30 01:35:11.045487 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:11.045487 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-93601c4e-5f9f-4076-9f43-0c972eaaf619 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Returning 409 to user: Cannot 'unpause' instance b0c51345-2948-4ff1-828f-8c70b2b979f2 while it is in vm_state active {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:35:11.045967 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-36e0efa2-e439-4aa7-b9c4-0ce47feaefcf tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] validate_networks() for [('cc59195e-10d2-4c97-a1d0-947365ceabf3', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:35:11.053446 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-93601c4e-5f9f-4076-9f43-0c972eaaf619 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "POST /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2/action" status: 409 len: 145 microversion: 2.1 time: 0.228526 Oct 30 01:35:11.057954 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2387/4790] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:35:10 2022] POST /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2/action => generated 145 bytes in 234 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:35:11.071461 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-35ca0339-329c-4f47-a826-b7555506e540 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:11.072407 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-35ca0339-329c-4f47-a826-b7555506e540 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:11.089694 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-35ca0339-329c-4f47-a826-b7555506e540 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:11.091455 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-35ca0339-329c-4f47-a826-b7555506e540 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:11.092645 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-35ca0339-329c-4f47-a826-b7555506e540 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:11.093660 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-35ca0339-329c-4f47-a826-b7555506e540 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:11.097318 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-35ca0339-329c-4f47-a826-b7555506e540 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:11.098128 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-35ca0339-329c-4f47-a826-b7555506e540 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:11.402877 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-35ca0339-329c-4f47-a826-b7555506e540 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:35:11.413680 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-35ca0339-329c-4f47-a826-b7555506e540 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.351332 Oct 30 01:35:11.436067 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2388/4791] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:35:11 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:35:11.442385 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6befae1a-9abd-49e4-9895-8ecddf151f87 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:11.443340 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6befae1a-9abd-49e4-9895-8ecddf151f87 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:11.450753 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6befae1a-9abd-49e4-9895-8ecddf151f87 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:11.451603 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6befae1a-9abd-49e4-9895-8ecddf151f87 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:11.452317 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6befae1a-9abd-49e4-9895-8ecddf151f87 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:11.453328 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6befae1a-9abd-49e4-9895-8ecddf151f87 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:11.454310 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6befae1a-9abd-49e4-9895-8ecddf151f87 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:11.455211 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6befae1a-9abd-49e4-9895-8ecddf151f87 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:11.481095 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:35:11.847248 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6befae1a-9abd-49e4-9895-8ecddf151f87 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:35:11.857970 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6befae1a-9abd-49e4-9895-8ecddf151f87 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.417790 Oct 30 01:35:11.862962 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2389/4792] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:35:11 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:35:11.887175 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fe0823ed-9e0f-4229-b687-0e782cec5911 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:35:11.888057 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-fe0823ed-9e0f-4229-b687-0e782cec5911 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: c40fc0fb-e45a-4a69-bea7-e581d7acc3ce] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:11.916796 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-fe0823ed-9e0f-4229-b687-0e782cec5911 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] HTTP exception thrown: Instance c40fc0fb-e45a-4a69-bea7-e581d7acc3ce could not be found. Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fe0823ed-9e0f-4229-b687-0e782cec5911 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Request method failure captured: Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: request: POST /compute/v2.1/servers/c40fc0fb-e45a-4a69-bea7-e581d7acc3ce/action HTTP/1.1 Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 18 Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdPsZZXjRvWKe2zWP-5VH1VYAsWsLLjUmpyob2uINkfAXNLt0qGMmCTWjYn2WpZ3XOOdsuaM4lwk-qZrOIX3mOHzuCJPZ3r-9M-w153XBWLoTow-eSMj1bsAWDNo3KKhMzjHqic8AJ-DcXpdsBh93g0dRB_UMWMRrGyY1cbSRdHJrvg Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 0bce487302c24def8a8473b0725904f2 Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: {"unshelve": null} Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: exception: Instance c40fc0fb-e45a-4a69-bea7-e581d7acc3ce could not be found. Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'c40fc0fb-e45a-4a69-bea7-e581d7acc3ce', 'body': {'unshelve': None}} Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c40fc0fb-e45a-4a69-bea7-e581d7acc3ce could not be found. Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c40fc0fb-e45a-4a69-bea7-e581d7acc3ce could not be found. Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:11.922548 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:35:11.927408 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:11.927408 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:35:11.927408 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:35:11.927408 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:35:11.927408 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:35:11.927408 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:35:11.927408 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c40fc0fb-e45a-4a69-bea7-e581d7acc3ce could not be found. Oct 30 01:35:11.927408 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:11.928938 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fe0823ed-9e0f-4229-b687-0e782cec5911 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Returning 404 to user: Instance c40fc0fb-e45a-4a69-bea7-e581d7acc3ce could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:35:11.935422 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fe0823ed-9e0f-4229-b687-0e782cec5911 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "POST /compute/v2.1/servers/c40fc0fb-e45a-4a69-bea7-e581d7acc3ce/action" status: 404 len: 111 microversion: 2.1 time: 0.052936 Oct 30 01:35:11.937711 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2390/4793] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:35:11 2022] POST /compute/v2.1/servers/c40fc0fb-e45a-4a69-bea7-e581d7acc3ce/action => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 01:35:11.952349 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5386a11b-7507-4577-bc26-d6ac68ee855a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:11.954738 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5386a11b-7507-4577-bc26-d6ac68ee855a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:11.990299 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5386a11b-7507-4577-bc26-d6ac68ee855a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:11.990908 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5386a11b-7507-4577-bc26-d6ac68ee855a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:11.991367 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5386a11b-7507-4577-bc26-d6ac68ee855a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:11.999306 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5386a11b-7507-4577-bc26-d6ac68ee855a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:11.999880 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5386a11b-7507-4577-bc26-d6ac68ee855a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:12.000715 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5386a11b-7507-4577-bc26-d6ac68ee855a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:12.644680 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-36e0efa2-e439-4aa7-b9c4-0ce47feaefcf tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:35:12.645189 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-36e0efa2-e439-4aa7-b9c4-0ce47feaefcf tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:35:12.645611 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-36e0efa2-e439-4aa7-b9c4-0ce47feaefcf tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:35:12.646027 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-36e0efa2-e439-4aa7-b9c4-0ce47feaefcf tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:35:12.646450 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-36e0efa2-e439-4aa7-b9c4-0ce47feaefcf tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:35:12.664215 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-36e0efa2-e439-4aa7-b9c4-0ce47feaefcf tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:12.667742 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-36e0efa2-e439-4aa7-b9c4-0ce47feaefcf tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:12.667742 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-36e0efa2-e439-4aa7-b9c4-0ce47feaefcf tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:12.667742 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-36e0efa2-e439-4aa7-b9c4-0ce47feaefcf tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:12.667742 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-36e0efa2-e439-4aa7-b9c4-0ce47feaefcf tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:12.667742 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-36e0efa2-e439-4aa7-b9c4-0ce47feaefcf tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:12.704773 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-36e0efa2-e439-4aa7-b9c4-0ce47feaefcf tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Getting quotas for project 109772076b1d4aed99db960f295ac4e0. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:35:12.707913 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-36e0efa2-e439-4aa7-b9c4-0ce47feaefcf tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Getting quotas for user dcdd7b99e5a94490b604d2e10545a658 and project 109772076b1d4aed99db960f295ac4e0. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:35:12.741223 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-36e0efa2-e439-4aa7-b9c4-0ce47feaefcf tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:35:12.743910 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-36e0efa2-e439-4aa7-b9c4-0ce47feaefcf tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] [instance: e4798f38-03e6-404c-8955-102832491c88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:35:12.930090 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5386a11b-7507-4577-bc26-d6ac68ee855a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:35:12.959508 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-36e0efa2-e439-4aa7-b9c4-0ce47feaefcf tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.912457 Oct 30 01:35:12.960126 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5386a11b-7507-4577-bc26-d6ac68ee855a tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 1.015381 Oct 30 01:35:12.960912 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2391/4794] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:35:11 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:35:12.964575 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2404/4795] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:35:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2920 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:35:12.983500 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-150f61e1-bacd-45e3-ad3f-99192a2f8237 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:12.984168 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-150f61e1-bacd-45e3-ad3f-99192a2f8237 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:12.993700 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f40ed71f-32a1-45ff-8af9-2d5554b35031 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:12.993700 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f40ed71f-32a1-45ff-8af9-2d5554b35031 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] [instance: e4798f38-03e6-404c-8955-102832491c88] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:12.997487 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-150f61e1-bacd-45e3-ad3f-99192a2f8237 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:12.998015 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-150f61e1-bacd-45e3-ad3f-99192a2f8237 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:12.998470 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-150f61e1-bacd-45e3-ad3f-99192a2f8237 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:13.003900 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-150f61e1-bacd-45e3-ad3f-99192a2f8237 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:13.004658 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-150f61e1-bacd-45e3-ad3f-99192a2f8237 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:13.005132 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-150f61e1-bacd-45e3-ad3f-99192a2f8237 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:13.395252 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f40ed71f-32a1-45ff-8af9-2d5554b35031 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdd7b99e5a94490b604d2e10545a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109772076b1d4aed99db960f295ac4e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:35:13.399100 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f40ed71f-32a1-45ff-8af9-2d5554b35031 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] 10.222.0.13 "GET /compute/v2.1/servers/e4798f38-03e6-404c-8955-102832491c88" status: 200 len: 1228 microversion: 2.1 time: 0.433219 Oct 30 01:35:13.418292 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2392/4796] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:35:12 2022] GET /compute/v2.1/servers/e4798f38-03e6-404c-8955-102832491c88 => generated 1228 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:35:13.418292 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f40ed71f-32a1-45ff-8af9-2d5554b35031 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:13.418292 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f40ed71f-32a1-45ff-8af9-2d5554b35031 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] 10.222.0.13 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002560 Oct 30 01:35:13.426538 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2393/4797] 10.222.0.13 () {56 vars in 886 bytes} [Sun Oct 30 01:35:13 2022] GET /compute/ => generated 377 bytes in 13 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 30 01:35:13.571066 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-150f61e1-bacd-45e3-ad3f-99192a2f8237 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:35:13.580913 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-150f61e1-bacd-45e3-ad3f-99192a2f8237 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.601786 Oct 30 01:35:13.592340 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2405/4798] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:35:12 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:35:13.625150 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e530541c-40e8-4e88-ae60-138774360a3b tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:35:13.627154 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e530541c-40e8-4e88-ae60-138774360a3b tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:13.653472 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e530541c-40e8-4e88-ae60-138774360a3b tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:13.655060 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e530541c-40e8-4e88-ae60-138774360a3b tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:13.656601 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e530541c-40e8-4e88-ae60-138774360a3b tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:13.657610 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e530541c-40e8-4e88-ae60-138774360a3b tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:13.658234 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e530541c-40e8-4e88-ae60-138774360a3b tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:13.658863 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e530541c-40e8-4e88-ae60-138774360a3b tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:13.741283 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-e530541c-40e8-4e88-ae60-138774360a3b tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] HTTP exception thrown: Cannot 'unshelve' instance b0c51345-2948-4ff1-828f-8c70b2b979f2 while it is in vm_state active Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e530541c-40e8-4e88-ae60-138774360a3b tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Request method failure captured: Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: request: POST /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2/action HTTP/1.1 Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 18 Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdPsZZXjRvWKe2zWP-5VH1VYAsWsLLjUmpyob2uINkfAXNLt0qGMmCTWjYn2WpZ3XOOdsuaM4lwk-qZrOIX3mOHzuCJPZ3r-9M-w153XBWLoTow-eSMj1bsAWDNo3KKhMzjHqic8AJ-DcXpdsBh93g0dRB_UMWMRrGyY1cbSRdHJrvg Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 0bce487302c24def8a8473b0725904f2 Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: {"unshelve": null} Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: exception: Cannot 'unshelve' instance b0c51345-2948-4ff1-828f-8c70b2b979f2 while it is in vm_state active Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'b0c51345-2948-4ff1-828f-8c70b2b979f2', 'body': {'unshelve': None}} Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b0c51345-2948-4ff1-828f-8c70b2b979f2 in vm_state active. Cannot unshelve while the instance is in this state. Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 30 01:35:13.747448 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 30 01:35:13.754515 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance b0c51345-2948-4ff1-828f-8c70b2b979f2 while it is in vm_state active Oct 30 01:35:13.754515 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:13.754515 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:35:13.754515 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:13.754515 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:35:13.754515 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:35:13.754515 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:35:13.754515 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:35:13.754515 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:35:13.754515 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance b0c51345-2948-4ff1-828f-8c70b2b979f2 while it is in vm_state active Oct 30 01:35:13.754515 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:13.758341 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e530541c-40e8-4e88-ae60-138774360a3b tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Returning 409 to user: Cannot 'unshelve' instance b0c51345-2948-4ff1-828f-8c70b2b979f2 while it is in vm_state active {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:35:13.767761 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e530541c-40e8-4e88-ae60-138774360a3b tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "POST /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2/action" status: 409 len: 146 microversion: 2.1 time: 0.145359 Oct 30 01:35:13.769759 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2394/4799] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:35:13 2022] POST /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2/action => generated 146 bytes in 159 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:35:13.778122 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b7b39159-31f6-41c3-8980-f43213a1466f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:13.783578 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b7b39159-31f6-41c3-8980-f43213a1466f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:13.800096 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b7b39159-31f6-41c3-8980-f43213a1466f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:13.800960 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b7b39159-31f6-41c3-8980-f43213a1466f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:13.801758 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b7b39159-31f6-41c3-8980-f43213a1466f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:13.803013 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b7b39159-31f6-41c3-8980-f43213a1466f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:13.803856 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b7b39159-31f6-41c3-8980-f43213a1466f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:13.804493 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b7b39159-31f6-41c3-8980-f43213a1466f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:14.436059 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2d647245-800f-47ca-9846-bbf8c50c26c5 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:14.438549 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2d647245-800f-47ca-9846-bbf8c50c26c5 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] [instance: e4798f38-03e6-404c-8955-102832491c88] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:14.485381 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b7b39159-31f6-41c3-8980-f43213a1466f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:35:14.498786 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b7b39159-31f6-41c3-8980-f43213a1466f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.724543 Oct 30 01:35:14.503028 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2406/4800] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:35:13 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:35:14.541088 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-45970318-381c-4f74-9b96-039bf4ec2064 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:14.541995 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-45970318-381c-4f74-9b96-039bf4ec2064 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:14.574860 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-45970318-381c-4f74-9b96-039bf4ec2064 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:14.577940 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-45970318-381c-4f74-9b96-039bf4ec2064 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:14.581457 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-45970318-381c-4f74-9b96-039bf4ec2064 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:14.581457 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-45970318-381c-4f74-9b96-039bf4ec2064 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:14.581457 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-45970318-381c-4f74-9b96-039bf4ec2064 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:14.581457 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-45970318-381c-4f74-9b96-039bf4ec2064 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:14.606121 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2d647245-800f-47ca-9846-bbf8c50c26c5 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdd7b99e5a94490b604d2e10545a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109772076b1d4aed99db960f295ac4e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:35:14.614647 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2d647245-800f-47ca-9846-bbf8c50c26c5 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] 10.222.0.13 "GET /compute/v2.1/servers/e4798f38-03e6-404c-8955-102832491c88" status: 200 len: 1228 microversion: 2.1 time: 0.187325 Oct 30 01:35:14.616858 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2395/4801] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:35:14 2022] GET /compute/v2.1/servers/e4798f38-03e6-404c-8955-102832491c88 => generated 1228 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:35:14.954431 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-45970318-381c-4f74-9b96-039bf4ec2064 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:35:14.974393 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-45970318-381c-4f74-9b96-039bf4ec2064 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.451169 Oct 30 01:35:14.976564 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2407/4802] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:35:14 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:35:15.016058 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d289cc1a-f327-480e-8057-56b13e137e1d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-821719176_updated"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:35:15.022413 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d289cc1a-f327-480e-8057-56b13e137e1d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: 46a3b44a-53b0-476a-9d8d-162b20b65ec0] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:15.031665 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-d289cc1a-f327-480e-8057-56b13e137e1d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] HTTP exception thrown: Instance 46a3b44a-53b0-476a-9d8d-162b20b65ec0 could not be found. Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d289cc1a-f327-480e-8057-56b13e137e1d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Request method failure captured: Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: request: PUT /compute/v2.1/servers/46a3b44a-53b0-476a-9d8d-162b20b65ec0 HTTP/1.1 Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 80 Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdPsZZXjRvWKe2zWP-5VH1VYAsWsLLjUmpyob2uINkfAXNLt0qGMmCTWjYn2WpZ3XOOdsuaM4lwk-qZrOIX3mOHzuCJPZ3r-9M-w153XBWLoTow-eSMj1bsAWDNo3KKhMzjHqic8AJ-DcXpdsBh93g0dRB_UMWMRrGyY1cbSRdHJrvg Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 0bce487302c24def8a8473b0725904f2 Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-821719176_updated"}} Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 46a3b44a-53b0-476a-9d8d-162b20b65ec0 could not be found. Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '46a3b44a-53b0-476a-9d8d-162b20b65ec0', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-821719176_updated'}}} Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46a3b44a-53b0-476a-9d8d-162b20b65ec0 could not be found. Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 30 01:35:15.033615 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:35:15.038553 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:35:15.038553 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:35:15.038553 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:35:15.038553 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46a3b44a-53b0-476a-9d8d-162b20b65ec0 could not be found. Oct 30 01:35:15.038553 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:15.038553 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:35:15.038553 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:15.038553 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:35:15.038553 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:35:15.038553 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:35:15.038553 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:35:15.038553 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:35:15.038553 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46a3b44a-53b0-476a-9d8d-162b20b65ec0 could not be found. Oct 30 01:35:15.038553 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:15.043834 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d289cc1a-f327-480e-8057-56b13e137e1d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Returning 404 to user: Instance 46a3b44a-53b0-476a-9d8d-162b20b65ec0 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:35:15.045750 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d289cc1a-f327-480e-8057-56b13e137e1d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "PUT /compute/v2.1/servers/46a3b44a-53b0-476a-9d8d-162b20b65ec0" status: 404 len: 111 microversion: 2.1 time: 0.046984 Oct 30 01:35:15.050689 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2396/4803] 10.222.0.13 () {60 vars in 1256 bytes} [Sun Oct 30 01:35:14 2022] PUT /compute/v2.1/servers/46a3b44a-53b0-476a-9d8d-162b20b65ec0 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:35:15.062222 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b37abd6d-4281-44d9-a71e-68b77d410364 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:15.062886 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b37abd6d-4281-44d9-a71e-68b77d410364 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:15.074379 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b37abd6d-4281-44d9-a71e-68b77d410364 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:15.074884 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b37abd6d-4281-44d9-a71e-68b77d410364 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:15.079355 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b37abd6d-4281-44d9-a71e-68b77d410364 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:15.079355 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b37abd6d-4281-44d9-a71e-68b77d410364 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:15.079355 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b37abd6d-4281-44d9-a71e-68b77d410364 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:15.079355 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b37abd6d-4281-44d9-a71e-68b77d410364 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:15.356218 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3ba9bb5f-17d2-48a4-9b04-244c05ede5e8 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:15.356742 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3ba9bb5f-17d2-48a4-9b04-244c05ede5e8 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:15.376319 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3ba9bb5f-17d2-48a4-9b04-244c05ede5e8 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:15.376868 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3ba9bb5f-17d2-48a4-9b04-244c05ede5e8 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:15.377319 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3ba9bb5f-17d2-48a4-9b04-244c05ede5e8 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:15.383920 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3ba9bb5f-17d2-48a4-9b04-244c05ede5e8 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:15.384563 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3ba9bb5f-17d2-48a4-9b04-244c05ede5e8 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:15.386326 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3ba9bb5f-17d2-48a4-9b04-244c05ede5e8 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:15.410309 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-3ba9bb5f-17d2-48a4-9b04-244c05ede5e8 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] HTTP exception thrown: Instance 71a745a1-eaaf-4b96-8ed1-05e574cf4018 could not be found. Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3ba9bb5f-17d2-48a4-9b04-244c05ede5e8 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Request method failure captured: Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: request: DELETE /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 HTTP/1.1 Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdK-PMouFS8tOrWg0Ac_b-EvsF-32RtGT4CmG_nngybp9Rpi9IaHZraycIScbzQiEe4aArHiyE9lP1PWqr-MN1vCYzcImtfdVbrKiyJ0iAI2Noeqf7ovf5FCCGR0mXfX5IL886GPMPY5kkDEUvgL54ElM34J-GIdnL-NocRErBEkPBM Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: X-Openstack-Nova-Api-Version: 2.32 Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 51b75ee1fcc142dd9eb8cb4e3ea631b8 Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-TaggedBootDevicesTest-814140194 Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/51b75ee1fcc142dd9eb8cb4e3ea631b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_51b75ee1fcc142dd9eb8cb4e3ea631b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/51b75ee1fcc142dd9eb8cb4e3ea631b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/51b75ee1fcc142dd9eb8cb4e3ea631b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-TaggedBootDevicesTest-814140194 Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 51b75ee1fcc142dd9eb8cb4e3ea631b8 Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-TaggedBootDevicesTest-814140194 Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-TaggedBootDevicesTest-814140194-project Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 55d02fb5fddb48e49fb66428db0f0424 Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-TaggedBootDevicesTest-814140194-project Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 71a745a1-eaaf-4b96-8ed1-05e574cf4018 could not be found. Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '71a745a1-eaaf-4b96-8ed1-05e574cf4018'} Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71a745a1-eaaf-4b96-8ed1-05e574cf4018 could not be found. Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:35:15.412192 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:35:15.416578 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71a745a1-eaaf-4b96-8ed1-05e574cf4018 could not be found. Oct 30 01:35:15.416578 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:15.416578 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:35:15.416578 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:15.416578 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:35:15.416578 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:35:15.416578 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:35:15.416578 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:35:15.416578 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:35:15.416578 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71a745a1-eaaf-4b96-8ed1-05e574cf4018 could not be found. Oct 30 01:35:15.416578 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:15.416578 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3ba9bb5f-17d2-48a4-9b04-244c05ede5e8 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Returning 404 to user: Instance 71a745a1-eaaf-4b96-8ed1-05e574cf4018 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:35:15.416578 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3ba9bb5f-17d2-48a4-9b04-244c05ede5e8 tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "DELETE /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 404 len: 111 microversion: 2.32 time: 0.061745 Oct 30 01:35:15.416578 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2397/4804] 10.222.0.13 () {60 vars in 1280 bytes} [Sun Oct 30 01:35:15 2022] DELETE /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:35:15.427555 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-45d1482c-031d-4355-8ac1-df2d190b2a7f tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:15.427555 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-45d1482c-031d-4355-8ac1-df2d190b2a7f tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] [instance: 71a745a1-eaaf-4b96-8ed1-05e574cf4018] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:15.431349 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45d1482c-031d-4355-8ac1-df2d190b2a7f tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:15.432067 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45d1482c-031d-4355-8ac1-df2d190b2a7f tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:15.432510 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45d1482c-031d-4355-8ac1-df2d190b2a7f tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:15.433301 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45d1482c-031d-4355-8ac1-df2d190b2a7f tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:15.433790 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45d1482c-031d-4355-8ac1-df2d190b2a7f tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:15.434446 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45d1482c-031d-4355-8ac1-df2d190b2a7f tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:15.460270 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-45d1482c-031d-4355-8ac1-df2d190b2a7f tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] HTTP exception thrown: Instance 71a745a1-eaaf-4b96-8ed1-05e574cf4018 could not be found. Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-45d1482c-031d-4355-8ac1-df2d190b2a7f tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Request method failure captured: Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 HTTP/1.1 Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdK-PMouFS8tOrWg0Ac_b-EvsF-32RtGT4CmG_nngybp9Rpi9IaHZraycIScbzQiEe4aArHiyE9lP1PWqr-MN1vCYzcImtfdVbrKiyJ0iAI2Noeqf7ovf5FCCGR0mXfX5IL886GPMPY5kkDEUvgL54ElM34J-GIdnL-NocRErBEkPBM Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: X-Openstack-Nova-Api-Version: 2.32 Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 51b75ee1fcc142dd9eb8cb4e3ea631b8 Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-TaggedBootDevicesTest-814140194 Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/51b75ee1fcc142dd9eb8cb4e3ea631b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_51b75ee1fcc142dd9eb8cb4e3ea631b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/51b75ee1fcc142dd9eb8cb4e3ea631b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/51b75ee1fcc142dd9eb8cb4e3ea631b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-TaggedBootDevicesTest-814140194 Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 51b75ee1fcc142dd9eb8cb4e3ea631b8 Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-TaggedBootDevicesTest-814140194 Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-TaggedBootDevicesTest-814140194-project Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 55d02fb5fddb48e49fb66428db0f0424 Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-TaggedBootDevicesTest-814140194-project Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 71a745a1-eaaf-4b96-8ed1-05e574cf4018 could not be found. Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '71a745a1-eaaf-4b96-8ed1-05e574cf4018'} Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71a745a1-eaaf-4b96-8ed1-05e574cf4018 could not be found. Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71a745a1-eaaf-4b96-8ed1-05e574cf4018 could not be found. Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:35:15.466493 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:15.471960 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:35:15.471960 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:35:15.471960 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:35:15.471960 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:35:15.471960 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:35:15.471960 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71a745a1-eaaf-4b96-8ed1-05e574cf4018 could not be found. Oct 30 01:35:15.471960 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:15.471960 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-45d1482c-031d-4355-8ac1-df2d190b2a7f tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] Returning 404 to user: Instance 71a745a1-eaaf-4b96-8ed1-05e574cf4018 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:35:15.471960 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-45d1482c-031d-4355-8ac1-df2d190b2a7f tempest-TaggedBootDevicesTest-814140194 tempest-TaggedBootDevicesTest-814140194-project] 10.222.0.13 "GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018" status: 404 len: 111 microversion: 2.32 time: 0.046589 Oct 30 01:35:15.471960 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2398/4805] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:35:15 2022] GET /compute/v2.1/servers/71a745a1-eaaf-4b96-8ed1-05e574cf4018 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 30 01:35:15.555373 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b37abd6d-4281-44d9-a71e-68b77d410364 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:35:15.568068 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b37abd6d-4281-44d9-a71e-68b77d410364 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.511209 Oct 30 01:35:15.570393 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2408/4806] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:35:15 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:35:15.599304 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-30e70bd4-075f-4562-a32e-7a1596eb760f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:15.605874 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-30e70bd4-075f-4562-a32e-7a1596eb760f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:15.606286 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-30e70bd4-075f-4562-a32e-7a1596eb760f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:15.606853 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-30e70bd4-075f-4562-a32e-7a1596eb760f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:15.607364 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-30e70bd4-075f-4562-a32e-7a1596eb760f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:15.608570 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-30e70bd4-075f-4562-a32e-7a1596eb760f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:15.609943 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-30e70bd4-075f-4562-a32e-7a1596eb760f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:15.610450 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-30e70bd4-075f-4562-a32e-7a1596eb760f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:15.639474 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c6c75a72-b61e-43e2-bf73-02e3373fccfb tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:15.640307 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c6c75a72-b61e-43e2-bf73-02e3373fccfb tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] [instance: e4798f38-03e6-404c-8955-102832491c88] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:15.649384 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c6c75a72-b61e-43e2-bf73-02e3373fccfb tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:15.654350 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c6c75a72-b61e-43e2-bf73-02e3373fccfb tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:15.654921 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c6c75a72-b61e-43e2-bf73-02e3373fccfb tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:15.656737 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c6c75a72-b61e-43e2-bf73-02e3373fccfb tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:15.657710 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c6c75a72-b61e-43e2-bf73-02e3373fccfb tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:15.658609 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c6c75a72-b61e-43e2-bf73-02e3373fccfb tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:15.826286 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c6c75a72-b61e-43e2-bf73-02e3373fccfb tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdd7b99e5a94490b604d2e10545a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109772076b1d4aed99db960f295ac4e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:35:15.836454 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c6c75a72-b61e-43e2-bf73-02e3373fccfb tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] 10.222.0.13 "GET /compute/v2.1/servers/e4798f38-03e6-404c-8955-102832491c88" status: 200 len: 1280 microversion: 2.1 time: 0.201039 Oct 30 01:35:15.850537 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2409/4807] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:35:15 2022] GET /compute/v2.1/servers/e4798f38-03e6-404c-8955-102832491c88 => generated 1280 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:35:15.987933 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-30e70bd4-075f-4562-a32e-7a1596eb760f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:35:15.999322 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-30e70bd4-075f-4562-a32e-7a1596eb760f tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.404027 Oct 30 01:35:16.001541 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2399/4808] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:35:15 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:35:16.025500 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-beda98d4-f3a5-4165-9e8e-df66614f61d5 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:35:16.029921 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-beda98d4-f3a5-4165-9e8e-df66614f61d5 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Request method failure captured: Oct 30 01:35:16.029921 n-d-master-1 devstack@n-api.service[121102]: request: PUT /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 HTTP/1.1 Oct 30 01:35:16.029921 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:35:16.029921 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:35:16.029921 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:35:16.029921 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 280 Oct 30 01:35:16.029921 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:35:16.029921 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:35:16.029921 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:35:16.029921 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:35:16.029921 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdPsZZXjRvWKe2zWP-5VH1VYAsWsLLjUmpyob2uINkfAXNLt0qGMmCTWjYn2WpZ3XOOdsuaM4lwk-qZrOIX3mOHzuCJPZ3r-9M-w153XBWLoTow-eSMj1bsAWDNo3KKhMzjHqic8AJ-DcXpdsBh93g0dRB_UMWMRrGyY1cbSRdHJrvg Oct 30 01:35:16.029921 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:35:16.029921 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:35:16.029921 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:35:16.029921 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:35:16.029921 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:35:16.029921 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:35:16.029921 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:35:16.029921 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:35:16.029921 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:35:16.029921 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:35:16.029921 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:35:16.029921 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:35:16.029921 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:35:16.029921 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:35:16.029921 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:35:16.029921 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:35:16.029921 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:35:16.029921 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 0bce487302c24def8a8473b0725904f2 Oct 30 01:35:16.029921 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:35:16.029921 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:35:16.029921 n-d-master-1 devstack@n-api.service[121102]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 30 01:35:16.029921 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:35:16.029921 n-d-master-1 devstack@n-api.service[121102]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 30 01:35:16.029921 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'b0c51345-2948-4ff1-828f-8c70b2b979f2', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 30 01:35:16.029921 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:35:16.029921 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:35:16.029921 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 30 01:35:16.029921 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 30 01:35:16.029921 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 30 01:35:16.029921 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise error Oct 30 01:35:16.029921 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 30 01:35:16.029921 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:35:16.029921 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 30 01:35:16.029921 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 30 01:35:16.029921 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:35:16.029921 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 30 01:35:16.029921 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 30 01:35:16.029921 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:35:16.029921 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:35:16.029921 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:35:16.029921 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:35:16.034531 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:35:16.034531 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:35:16.034531 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:35:16.034531 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:35:16.034531 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:35:16.034531 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:35:16.034531 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:35:16.034531 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:35:16.034531 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 30 01:35:16.034531 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 30 01:35:16.034531 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 30 01:35:16.034531 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 30 01:35:16.034531 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 30 01:35:16.034531 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 30 01:35:16.034531 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 30 01:35:16.034531 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:35:16.034531 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:35:16.034531 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:35:16.034531 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:35:16.034531 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:35:16.034531 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:35:16.034531 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 30 01:35:16.034531 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 30 01:35:16.034531 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 30 01:35:16.034531 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:35:16.034531 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-beda98d4-f3a5-4165-9e8e-df66614f61d5 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:35:16.034531 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-beda98d4-f3a5-4165-9e8e-df66614f61d5 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "PUT /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 400 len: 619 microversion: 2.1 time: 0.011986 Oct 30 01:35:16.044426 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-007008a3-13b1-463d-a6b1-7375e4926d2c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:16.045070 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-007008a3-13b1-463d-a6b1-7375e4926d2c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:16.055197 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2410/4809] 10.222.0.13 () {60 vars in 1257 bytes} [Sun Oct 30 01:35:16 2022] PUT /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 619 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:35:16.062867 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-007008a3-13b1-463d-a6b1-7375e4926d2c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:16.064581 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-007008a3-13b1-463d-a6b1-7375e4926d2c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:16.067606 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-007008a3-13b1-463d-a6b1-7375e4926d2c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:16.068792 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-007008a3-13b1-463d-a6b1-7375e4926d2c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:16.069934 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-007008a3-13b1-463d-a6b1-7375e4926d2c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:16.071314 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-007008a3-13b1-463d-a6b1-7375e4926d2c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:16.334278 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-007008a3-13b1-463d-a6b1-7375e4926d2c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:35:16.344591 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-007008a3-13b1-463d-a6b1-7375e4926d2c tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.305650 Oct 30 01:35:16.345798 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2400/4810] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:35:16 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:35:16.375958 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5a044bb3-6ca0-4927-be54-5bb529213421 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:16.376987 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5a044bb3-6ca0-4927-be54-5bb529213421 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:16.390376 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a044bb3-6ca0-4927-be54-5bb529213421 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:16.393138 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a044bb3-6ca0-4927-be54-5bb529213421 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:16.393138 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a044bb3-6ca0-4927-be54-5bb529213421 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:16.393138 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a044bb3-6ca0-4927-be54-5bb529213421 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:16.393138 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a044bb3-6ca0-4927-be54-5bb529213421 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:16.393532 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a044bb3-6ca0-4927-be54-5bb529213421 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:16.840617 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5a044bb3-6ca0-4927-be54-5bb529213421 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:35:16.866643 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-11f6b62b-0cde-4c56-9c28-78aae1a1d1bc tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:16.868371 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-11f6b62b-0cde-4c56-9c28-78aae1a1d1bc tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] [instance: e4798f38-03e6-404c-8955-102832491c88] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:16.884076 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-11f6b62b-0cde-4c56-9c28-78aae1a1d1bc tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:16.887699 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-11f6b62b-0cde-4c56-9c28-78aae1a1d1bc tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:16.888856 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-11f6b62b-0cde-4c56-9c28-78aae1a1d1bc tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:16.890538 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-11f6b62b-0cde-4c56-9c28-78aae1a1d1bc tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:16.891780 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-11f6b62b-0cde-4c56-9c28-78aae1a1d1bc tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:16.894122 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-11f6b62b-0cde-4c56-9c28-78aae1a1d1bc tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:17.062959 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-11f6b62b-0cde-4c56-9c28-78aae1a1d1bc tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdd7b99e5a94490b604d2e10545a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109772076b1d4aed99db960f295ac4e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:35:17.385443 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-11f6b62b-0cde-4c56-9c28-78aae1a1d1bc tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] 10.222.0.13 "GET /compute/v2.1/servers/e4798f38-03e6-404c-8955-102832491c88" status: 200 len: 1288 microversion: 2.1 time: 0.503583 Oct 30 01:35:17.385443 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2401/4811] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:35:16 2022] GET /compute/v2.1/servers/e4798f38-03e6-404c-8955-102832491c88 => generated 1288 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:35:17.385740 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5a044bb3-6ca0-4927-be54-5bb529213421 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 1.004306 Oct 30 01:35:17.385740 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2411/4812] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:35:16 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:35:17.407270 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3a7f1a9a-66a7-4372-940a-7fe1e6e7b9e4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3a7f1a9a-66a7-4372-940a-7fe1e6e7b9e4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Request method failure captured: Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: request: PUT /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 HTTP/1.1 Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 24 Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdPsZZXjRvWKe2zWP-5VH1VYAsWsLLjUmpyob2uINkfAXNLt0qGMmCTWjYn2WpZ3XOOdsuaM4lwk-qZrOIX3mOHzuCJPZ3r-9M-w153XBWLoTow-eSMj1bsAWDNo3KKhMzjHqic8AJ-DcXpdsBh93g0dRB_UMWMRrGyY1cbSRdHJrvg Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 0bce487302c24def8a8473b0725904f2 Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: {"server": {"name": ""}} Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'b0c51345-2948-4ff1-828f-8c70b2b979f2', 'body': {'server': {'name': ''}}} Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise error Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi '' Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 30 01:35:17.411064 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 30 01:35:17.415580 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:17.415580 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:35:17.415580 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:17.415580 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:35:17.415580 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:35:17.415580 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:35:17.415580 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 30 01:35:17.415580 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 30 01:35:17.415580 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 30 01:35:17.415580 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:17.415580 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3a7f1a9a-66a7-4372-940a-7fe1e6e7b9e4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:35:17.415580 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3a7f1a9a-66a7-4372-940a-7fe1e6e7b9e4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "PUT /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 400 len: 108 microversion: 2.1 time: 0.009941 Oct 30 01:35:17.415580 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2402/4813] 10.222.0.13 () {60 vars in 1256 bytes} [Sun Oct 30 01:35:17 2022] PUT /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 108 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 30 01:35:17.422260 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6fdc5d30-9b65-4d95-8a67-4233efb2cc63 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:17.449568 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6fdc5d30-9b65-4d95-8a67-4233efb2cc63 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:17.449568 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6fdc5d30-9b65-4d95-8a67-4233efb2cc63 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:17.449568 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6fdc5d30-9b65-4d95-8a67-4233efb2cc63 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:17.449568 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6fdc5d30-9b65-4d95-8a67-4233efb2cc63 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:17.449568 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6fdc5d30-9b65-4d95-8a67-4233efb2cc63 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:17.449568 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6fdc5d30-9b65-4d95-8a67-4233efb2cc63 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:17.449568 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6fdc5d30-9b65-4d95-8a67-4233efb2cc63 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:17.606184 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6fdc5d30-9b65-4d95-8a67-4233efb2cc63 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:35:17.628860 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6fdc5d30-9b65-4d95-8a67-4233efb2cc63 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1503 microversion: 2.1 time: 0.207280 Oct 30 01:35:17.629815 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2412/4814] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:35:17 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1503 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:35:18.406567 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-20d8799d-4f0e-4dd5-b093-1e264c8c122a tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:18.407200 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-20d8799d-4f0e-4dd5-b093-1e264c8c122a tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] [instance: e4798f38-03e6-404c-8955-102832491c88] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:18.427497 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-20d8799d-4f0e-4dd5-b093-1e264c8c122a tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:18.428520 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-20d8799d-4f0e-4dd5-b093-1e264c8c122a tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:18.429878 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-20d8799d-4f0e-4dd5-b093-1e264c8c122a tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:18.432333 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-20d8799d-4f0e-4dd5-b093-1e264c8c122a tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:18.438848 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-20d8799d-4f0e-4dd5-b093-1e264c8c122a tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:18.439310 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-20d8799d-4f0e-4dd5-b093-1e264c8c122a tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:18.555622 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-20d8799d-4f0e-4dd5-b093-1e264c8c122a tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdd7b99e5a94490b604d2e10545a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109772076b1d4aed99db960f295ac4e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:35:18.567950 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-20d8799d-4f0e-4dd5-b093-1e264c8c122a tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] 10.222.0.13 "GET /compute/v2.1/servers/e4798f38-03e6-404c-8955-102832491c88" status: 200 len: 1286 microversion: 2.1 time: 0.164773 Oct 30 01:35:18.569425 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2403/4815] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:35:18 2022] GET /compute/v2.1/servers/e4798f38-03e6-404c-8955-102832491c88 => generated 1286 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:35:19.591611 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-37b9ff6a-2672-45c3-9304-4085d7f8a0f4 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:19.592704 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-37b9ff6a-2672-45c3-9304-4085d7f8a0f4 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] [instance: e4798f38-03e6-404c-8955-102832491c88] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:19.602695 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-37b9ff6a-2672-45c3-9304-4085d7f8a0f4 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:19.605946 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-37b9ff6a-2672-45c3-9304-4085d7f8a0f4 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:19.606751 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-37b9ff6a-2672-45c3-9304-4085d7f8a0f4 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:19.607649 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-37b9ff6a-2672-45c3-9304-4085d7f8a0f4 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:19.608255 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-37b9ff6a-2672-45c3-9304-4085d7f8a0f4 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:19.614007 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-37b9ff6a-2672-45c3-9304-4085d7f8a0f4 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:20.821599 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-37b9ff6a-2672-45c3-9304-4085d7f8a0f4 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdd7b99e5a94490b604d2e10545a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109772076b1d4aed99db960f295ac4e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:35:20.834354 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-37b9ff6a-2672-45c3-9304-4085d7f8a0f4 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] 10.222.0.13 "GET /compute/v2.1/servers/e4798f38-03e6-404c-8955-102832491c88" status: 200 len: 1328 microversion: 2.1 time: 1.246665 Oct 30 01:35:20.845366 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2413/4816] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:35:19 2022] GET /compute/v2.1/servers/e4798f38-03e6-404c-8955-102832491c88 => generated 1328 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:35:21.861644 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5acab4ab-7349-4dd3-8b8d-106f37df0da6 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:21.862500 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5acab4ab-7349-4dd3-8b8d-106f37df0da6 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] [instance: e4798f38-03e6-404c-8955-102832491c88] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:21.888119 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5acab4ab-7349-4dd3-8b8d-106f37df0da6 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:21.888794 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5acab4ab-7349-4dd3-8b8d-106f37df0da6 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:21.889880 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5acab4ab-7349-4dd3-8b8d-106f37df0da6 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:21.892211 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5acab4ab-7349-4dd3-8b8d-106f37df0da6 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:21.893264 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5acab4ab-7349-4dd3-8b8d-106f37df0da6 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:21.893968 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5acab4ab-7349-4dd3-8b8d-106f37df0da6 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:22.592058 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5acab4ab-7349-4dd3-8b8d-106f37df0da6 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdd7b99e5a94490b604d2e10545a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109772076b1d4aed99db960f295ac4e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:35:22.600728 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5acab4ab-7349-4dd3-8b8d-106f37df0da6 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] 10.222.0.13 "GET /compute/v2.1/servers/e4798f38-03e6-404c-8955-102832491c88" status: 200 len: 1328 microversion: 2.1 time: 0.746332 Oct 30 01:35:22.617960 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2404/4817] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:35:21 2022] GET /compute/v2.1/servers/e4798f38-03e6-404c-8955-102832491c88 => generated 1328 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:35:23.323584 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-ed613872-cfa6-4c33-b825-40d70aaba8df req-afcb2c46-82cd-4798-b8b5-5d78cd2a72af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4798f38-03e6-404c-8955-102832491c88", "tag": "962253c6-a3bc-40c8-b090-d16434365286"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:35:23.339907 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:35:23.340631 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=6 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:35:23.341304 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:35:23.346361 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ed613872-cfa6-4c33-b825-40d70aaba8df req-afcb2c46-82cd-4798-b8b5-5d78cd2a72af service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:23.346853 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ed613872-cfa6-4c33-b825-40d70aaba8df req-afcb2c46-82cd-4798-b8b5-5d78cd2a72af service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:23.347293 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ed613872-cfa6-4c33-b825-40d70aaba8df req-afcb2c46-82cd-4798-b8b5-5d78cd2a72af service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:23.383738 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-ed613872-cfa6-4c33-b825-40d70aaba8df req-afcb2c46-82cd-4798-b8b5-5d78cd2a72af service nova] Creating event network-changed:962253c6-a3bc-40c8-b090-d16434365286 for instance e4798f38-03e6-404c-8955-102832491c88 on n-h1-master-1 Oct 30 01:35:23.388991 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-ed613872-cfa6-4c33-b825-40d70aaba8df req-afcb2c46-82cd-4798-b8b5-5d78cd2a72af service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069245 Oct 30 01:35:23.389892 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2414/4818] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:35:23.632727 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0ec3fe8d-bbac-4b1d-b5fb-3fb93091feda tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:23.635009 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0ec3fe8d-bbac-4b1d-b5fb-3fb93091feda tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] [instance: e4798f38-03e6-404c-8955-102832491c88] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:23.648013 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0ec3fe8d-bbac-4b1d-b5fb-3fb93091feda tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:23.650979 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0ec3fe8d-bbac-4b1d-b5fb-3fb93091feda tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:23.653025 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0ec3fe8d-bbac-4b1d-b5fb-3fb93091feda tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:23.654072 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0ec3fe8d-bbac-4b1d-b5fb-3fb93091feda tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:23.656092 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0ec3fe8d-bbac-4b1d-b5fb-3fb93091feda tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:23.660199 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0ec3fe8d-bbac-4b1d-b5fb-3fb93091feda tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:24.611442 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=4 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:35:24.640699 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0ec3fe8d-bbac-4b1d-b5fb-3fb93091feda tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdd7b99e5a94490b604d2e10545a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109772076b1d4aed99db960f295ac4e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:35:24.661155 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0ec3fe8d-bbac-4b1d-b5fb-3fb93091feda tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] 10.222.0.13 "GET /compute/v2.1/servers/e4798f38-03e6-404c-8955-102832491c88" status: 200 len: 1328 microversion: 2.1 time: 1.033261 Oct 30 01:35:24.661796 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2405/4819] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:35:23 2022] GET /compute/v2.1/servers/e4798f38-03e6-404c-8955-102832491c88 => generated 1328 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:35:25.688411 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-34c8e625-479f-4e86-bebd-507c0854cb4e tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:25.689893 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-34c8e625-479f-4e86-bebd-507c0854cb4e tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] [instance: e4798f38-03e6-404c-8955-102832491c88] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:25.703374 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-34c8e625-479f-4e86-bebd-507c0854cb4e tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:25.705278 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-34c8e625-479f-4e86-bebd-507c0854cb4e tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:25.706033 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-34c8e625-479f-4e86-bebd-507c0854cb4e tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:25.710357 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-34c8e625-479f-4e86-bebd-507c0854cb4e tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:25.711899 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-34c8e625-479f-4e86-bebd-507c0854cb4e tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:25.712438 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-34c8e625-479f-4e86-bebd-507c0854cb4e tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:25.772020 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:35:26.650411 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-34c8e625-479f-4e86-bebd-507c0854cb4e tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdd7b99e5a94490b604d2e10545a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109772076b1d4aed99db960f295ac4e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:35:26.663118 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-34c8e625-479f-4e86-bebd-507c0854cb4e tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] 10.222.0.13 "GET /compute/v2.1/servers/e4798f38-03e6-404c-8955-102832491c88" status: 200 len: 1328 microversion: 2.1 time: 0.979342 Oct 30 01:35:26.687060 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2415/4820] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:35:25 2022] GET /compute/v2.1/servers/e4798f38-03e6-404c-8955-102832491c88 => generated 1328 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:35:27.693772 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fa8900d2-3625-400c-be91-299c75f5c28d tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:27.698568 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-fa8900d2-3625-400c-be91-299c75f5c28d tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] [instance: e4798f38-03e6-404c-8955-102832491c88] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:27.756212 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fa8900d2-3625-400c-be91-299c75f5c28d tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:27.757220 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fa8900d2-3625-400c-be91-299c75f5c28d tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:27.758093 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fa8900d2-3625-400c-be91-299c75f5c28d tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:27.761230 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fa8900d2-3625-400c-be91-299c75f5c28d tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:27.762067 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fa8900d2-3625-400c-be91-299c75f5c28d tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:27.762860 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fa8900d2-3625-400c-be91-299c75f5c28d tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:28.160336 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-fa8900d2-3625-400c-be91-299c75f5c28d tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdd7b99e5a94490b604d2e10545a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109772076b1d4aed99db960f295ac4e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:35:28.169220 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fa8900d2-3625-400c-be91-299c75f5c28d tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] 10.222.0.13 "GET /compute/v2.1/servers/e4798f38-03e6-404c-8955-102832491c88" status: 200 len: 1328 microversion: 2.1 time: 0.483688 Oct 30 01:35:28.172872 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2406/4821] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:35:27 2022] GET /compute/v2.1/servers/e4798f38-03e6-404c-8955-102832491c88 => generated 1328 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:35:29.196115 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-33658b6a-ee74-4709-910c-dd956be3163d tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:29.196730 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-33658b6a-ee74-4709-910c-dd956be3163d tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] [instance: e4798f38-03e6-404c-8955-102832491c88] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:29.215739 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-33658b6a-ee74-4709-910c-dd956be3163d tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:29.216919 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-33658b6a-ee74-4709-910c-dd956be3163d tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:29.225005 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-33658b6a-ee74-4709-910c-dd956be3163d tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:29.226809 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-33658b6a-ee74-4709-910c-dd956be3163d tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:29.228254 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-33658b6a-ee74-4709-910c-dd956be3163d tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:29.229163 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-33658b6a-ee74-4709-910c-dd956be3163d tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:29.859354 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-42877ebc-dd2b-4c3b-8af6-93cebbc0ada1 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:29.859879 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-42877ebc-dd2b-4c3b-8af6-93cebbc0ada1 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: 03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:29.867142 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42877ebc-dd2b-4c3b-8af6-93cebbc0ada1 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:29.867900 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42877ebc-dd2b-4c3b-8af6-93cebbc0ada1 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:29.868502 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42877ebc-dd2b-4c3b-8af6-93cebbc0ada1 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:29.869715 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42877ebc-dd2b-4c3b-8af6-93cebbc0ada1 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:29.870337 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42877ebc-dd2b-4c3b-8af6-93cebbc0ada1 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:29.870989 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42877ebc-dd2b-4c3b-8af6-93cebbc0ada1 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:29.907408 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-42877ebc-dd2b-4c3b-8af6-93cebbc0ada1 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] HTTP exception thrown: Instance 03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5 could not be found. Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-42877ebc-dd2b-4c3b-8af6-93cebbc0ada1 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Request method failure captured: Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: request: DELETE /compute/v2.1/servers/03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5 HTTP/1.1 Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdPsZZXjRvWKe2zWP-5VH1VYAsWsLLjUmpyob2uINkfAXNLt0qGMmCTWjYn2WpZ3XOOdsuaM4lwk-qZrOIX3mOHzuCJPZ3r-9M-w153XBWLoTow-eSMj1bsAWDNo3KKhMzjHqic8AJ-DcXpdsBh93g0dRB_UMWMRrGyY1cbSRdHJrvg Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 0bce487302c24def8a8473b0725904f2 Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5 could not be found. Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5'} Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5 could not be found. Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:35:29.909286 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:35:29.915102 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5 could not be found. Oct 30 01:35:29.915102 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:29.915102 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:35:29.915102 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:29.915102 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:35:29.915102 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:35:29.915102 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:35:29.915102 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:35:29.915102 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:35:29.915102 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5 could not be found. Oct 30 01:35:29.915102 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:29.918380 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-42877ebc-dd2b-4c3b-8af6-93cebbc0ada1 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Returning 404 to user: Instance 03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:35:29.920740 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-42877ebc-dd2b-4c3b-8af6-93cebbc0ada1 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "DELETE /compute/v2.1/servers/03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5" status: 404 len: 111 microversion: 2.1 time: 0.065152 Oct 30 01:35:29.926982 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2407/4822] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:35:29 2022] DELETE /compute/v2.1/servers/03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 01:35:29.932384 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f1e84400-558e-48e6-9022-b082e3a61ef0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:29.933706 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f1e84400-558e-48e6-9022-b082e3a61ef0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: 03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:29.960730 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f1e84400-558e-48e6-9022-b082e3a61ef0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:29.963583 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f1e84400-558e-48e6-9022-b082e3a61ef0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:29.964604 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f1e84400-558e-48e6-9022-b082e3a61ef0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:29.972133 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f1e84400-558e-48e6-9022-b082e3a61ef0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:29.973959 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f1e84400-558e-48e6-9022-b082e3a61ef0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:29.974957 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f1e84400-558e-48e6-9022-b082e3a61ef0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:30.023627 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-33658b6a-ee74-4709-910c-dd956be3163d tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdd7b99e5a94490b604d2e10545a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109772076b1d4aed99db960f295ac4e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:35:30.041419 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-33658b6a-ee74-4709-910c-dd956be3163d tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] 10.222.0.13 "GET /compute/v2.1/servers/e4798f38-03e6-404c-8955-102832491c88" status: 200 len: 1328 microversion: 2.1 time: 0.840923 Oct 30 01:35:30.053725 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2416/4823] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:35:29 2022] GET /compute/v2.1/servers/e4798f38-03e6-404c-8955-102832491c88 => generated 1328 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:35:30.063041 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-f1e84400-558e-48e6-9022-b082e3a61ef0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] HTTP exception thrown: Instance 03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5 could not be found. Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f1e84400-558e-48e6-9022-b082e3a61ef0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Request method failure captured: Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5 HTTP/1.1 Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdPsZZXjRvWKe2zWP-5VH1VYAsWsLLjUmpyob2uINkfAXNLt0qGMmCTWjYn2WpZ3XOOdsuaM4lwk-qZrOIX3mOHzuCJPZ3r-9M-w153XBWLoTow-eSMj1bsAWDNo3KKhMzjHqic8AJ-DcXpdsBh93g0dRB_UMWMRrGyY1cbSRdHJrvg Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 0bce487302c24def8a8473b0725904f2 Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5 could not be found. Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5'} Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5 could not be found. Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5 could not be found. Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:35:30.073946 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:30.084314 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:35:30.084314 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:35:30.084314 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:35:30.084314 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:35:30.084314 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:35:30.084314 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5 could not be found. Oct 30 01:35:30.084314 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:30.084314 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f1e84400-558e-48e6-9022-b082e3a61ef0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Returning 404 to user: Instance 03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:35:30.084314 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f1e84400-558e-48e6-9022-b082e3a61ef0 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5" status: 404 len: 111 microversion: 2.1 time: 0.147372 Oct 30 01:35:30.085261 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2408/4824] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:35:29 2022] GET /compute/v2.1/servers/03cc45e3-1f77-4f8e-a96f-9f52f3ec7db5 => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:35:30.091739 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c8a61227-4d12-41f1-b9d8-cc57e79f28e4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:30.093013 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c8a61227-4d12-41f1-b9d8-cc57e79f28e4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:30.103159 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c8a61227-4d12-41f1-b9d8-cc57e79f28e4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:30.103668 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c8a61227-4d12-41f1-b9d8-cc57e79f28e4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:30.104114 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c8a61227-4d12-41f1-b9d8-cc57e79f28e4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:30.104829 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c8a61227-4d12-41f1-b9d8-cc57e79f28e4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:30.105283 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c8a61227-4d12-41f1-b9d8-cc57e79f28e4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:30.114119 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c8a61227-4d12-41f1-b9d8-cc57e79f28e4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:30.208468 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c8a61227-4d12-41f1-b9d8-cc57e79f28e4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:35:30.747411 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c8a61227-4d12-41f1-b9d8-cc57e79f28e4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 204 len: 0 microversion: 2.1 time: 0.659958 Oct 30 01:35:30.748043 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2417/4825] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:35:30 2022] DELETE /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 30 01:35:30.757572 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-be303828-8227-4d7e-a635-916c7238778d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:30.758217 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-be303828-8227-4d7e-a635-916c7238778d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:30.767442 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-be303828-8227-4d7e-a635-916c7238778d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:30.774083 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-be303828-8227-4d7e-a635-916c7238778d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:30.774551 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-be303828-8227-4d7e-a635-916c7238778d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:30.776245 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-be303828-8227-4d7e-a635-916c7238778d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:30.778852 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-be303828-8227-4d7e-a635-916c7238778d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:30.779381 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-be303828-8227-4d7e-a635-916c7238778d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:31.069220 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a3852234-8203-44e1-b7f2-64e25311247d tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:31.069833 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a3852234-8203-44e1-b7f2-64e25311247d tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] [instance: e4798f38-03e6-404c-8955-102832491c88] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:31.093760 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a3852234-8203-44e1-b7f2-64e25311247d tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:31.094783 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a3852234-8203-44e1-b7f2-64e25311247d tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:31.095235 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a3852234-8203-44e1-b7f2-64e25311247d tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:31.099222 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a3852234-8203-44e1-b7f2-64e25311247d tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:31.099718 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a3852234-8203-44e1-b7f2-64e25311247d tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:31.100164 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a3852234-8203-44e1-b7f2-64e25311247d tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:31.166457 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-be303828-8227-4d7e-a635-916c7238778d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:35:31.179315 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-be303828-8227-4d7e-a635-916c7238778d tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1509 microversion: 2.1 time: 0.426383 Oct 30 01:35:31.180696 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2409/4826] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:35:30 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1509 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:35:31.649877 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a3852234-8203-44e1-b7f2-64e25311247d tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdd7b99e5a94490b604d2e10545a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109772076b1d4aed99db960f295ac4e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:35:31.659065 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a3852234-8203-44e1-b7f2-64e25311247d tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] 10.222.0.13 "GET /compute/v2.1/servers/e4798f38-03e6-404c-8955-102832491c88" status: 200 len: 1328 microversion: 2.1 time: 0.594943 Oct 30 01:35:31.674727 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2418/4827] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:35:31 2022] GET /compute/v2.1/servers/e4798f38-03e6-404c-8955-102832491c88 => generated 1328 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:35:32.228997 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9349492a-daca-4ef8-b52b-00515195ceae tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:32.241197 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9349492a-daca-4ef8-b52b-00515195ceae tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:32.288983 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9349492a-daca-4ef8-b52b-00515195ceae tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:32.293577 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9349492a-daca-4ef8-b52b-00515195ceae tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:32.294513 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9349492a-daca-4ef8-b52b-00515195ceae tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:32.296205 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9349492a-daca-4ef8-b52b-00515195ceae tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:32.297245 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9349492a-daca-4ef8-b52b-00515195ceae tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:32.297927 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9349492a-daca-4ef8-b52b-00515195ceae tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:32.709075 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a48445ad-d9bd-40c5-b5d7-34da5eced0f1 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:32.709075 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a48445ad-d9bd-40c5-b5d7-34da5eced0f1 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] [instance: e4798f38-03e6-404c-8955-102832491c88] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:32.716231 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a48445ad-d9bd-40c5-b5d7-34da5eced0f1 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:32.717813 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a48445ad-d9bd-40c5-b5d7-34da5eced0f1 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:32.718988 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a48445ad-d9bd-40c5-b5d7-34da5eced0f1 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:32.722044 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a48445ad-d9bd-40c5-b5d7-34da5eced0f1 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:32.722496 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a48445ad-d9bd-40c5-b5d7-34da5eced0f1 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:32.722925 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a48445ad-d9bd-40c5-b5d7-34da5eced0f1 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:33.549751 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a48445ad-d9bd-40c5-b5d7-34da5eced0f1 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdd7b99e5a94490b604d2e10545a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109772076b1d4aed99db960f295ac4e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:35:33.557804 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a48445ad-d9bd-40c5-b5d7-34da5eced0f1 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] 10.222.0.13 "GET /compute/v2.1/servers/e4798f38-03e6-404c-8955-102832491c88" status: 200 len: 1328 microversion: 2.1 time: 0.860273 Oct 30 01:35:33.559419 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2419/4828] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:35:32 2022] GET /compute/v2.1/servers/e4798f38-03e6-404c-8955-102832491c88 => generated 1328 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:35:33.648996 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9349492a-daca-4ef8-b52b-00515195ceae tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:35:33.662275 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9349492a-daca-4ef8-b52b-00515195ceae tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1509 microversion: 2.1 time: 1.454509 Oct 30 01:35:33.664713 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2410/4829] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:35:32 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1509 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:35:33.868575 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-19f19057-3962-4aff-b9ae-4c328296d93b req-d6d2ced2-40ec-4821-a4f9-6801ff2c2fd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4798f38-03e6-404c-8955-102832491c88", "name": "network-vif-plugged", "status": "completed", "tag": "962253c6-a3bc-40c8-b090-d16434365286"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:35:33.900273 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-19f19057-3962-4aff-b9ae-4c328296d93b req-d6d2ced2-40ec-4821-a4f9-6801ff2c2fd0 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:33.900762 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-19f19057-3962-4aff-b9ae-4c328296d93b req-d6d2ced2-40ec-4821-a4f9-6801ff2c2fd0 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:33.905159 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-19f19057-3962-4aff-b9ae-4c328296d93b req-d6d2ced2-40ec-4821-a4f9-6801ff2c2fd0 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:33.918976 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-19f19057-3962-4aff-b9ae-4c328296d93b req-d6d2ced2-40ec-4821-a4f9-6801ff2c2fd0 service nova] Creating event network-vif-plugged:962253c6-a3bc-40c8-b090-d16434365286 for instance e4798f38-03e6-404c-8955-102832491c88 on n-h1-master-1 Oct 30 01:35:33.926141 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-19f19057-3962-4aff-b9ae-4c328296d93b req-d6d2ced2-40ec-4821-a4f9-6801ff2c2fd0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061789 Oct 30 01:35:33.927242 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2420/4830] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:35:34.601231 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-65a5a289-25bf-4787-90b0-3e11d3c7b348 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:34.602721 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-65a5a289-25bf-4787-90b0-3e11d3c7b348 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] [instance: e4798f38-03e6-404c-8955-102832491c88] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:34.616040 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-65a5a289-25bf-4787-90b0-3e11d3c7b348 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:34.616040 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-65a5a289-25bf-4787-90b0-3e11d3c7b348 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:34.616040 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-65a5a289-25bf-4787-90b0-3e11d3c7b348 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:34.616361 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-65a5a289-25bf-4787-90b0-3e11d3c7b348 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:34.616915 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-65a5a289-25bf-4787-90b0-3e11d3c7b348 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:34.617674 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-65a5a289-25bf-4787-90b0-3e11d3c7b348 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:34.689074 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2b1244f2-63a6-4d04-98b1-1e9d6408a2af tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:34.692230 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2b1244f2-63a6-4d04-98b1-1e9d6408a2af tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:34.706423 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2b1244f2-63a6-4d04-98b1-1e9d6408a2af tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:34.708749 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2b1244f2-63a6-4d04-98b1-1e9d6408a2af tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:34.711379 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2b1244f2-63a6-4d04-98b1-1e9d6408a2af tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:34.712837 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2b1244f2-63a6-4d04-98b1-1e9d6408a2af tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:34.718533 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2b1244f2-63a6-4d04-98b1-1e9d6408a2af tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:34.726739 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2b1244f2-63a6-4d04-98b1-1e9d6408a2af tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:35.265505 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-65a5a289-25bf-4787-90b0-3e11d3c7b348 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdd7b99e5a94490b604d2e10545a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109772076b1d4aed99db960f295ac4e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:35:35.302514 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-65a5a289-25bf-4787-90b0-3e11d3c7b348 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] 10.222.0.13 "GET /compute/v2.1/servers/e4798f38-03e6-404c-8955-102832491c88" status: 200 len: 1328 microversion: 2.1 time: 0.706668 Oct 30 01:35:35.307072 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2411/4831] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:35:34 2022] GET /compute/v2.1/servers/e4798f38-03e6-404c-8955-102832491c88 => generated 1328 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:35:35.399490 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2b1244f2-63a6-4d04-98b1-1e9d6408a2af tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:35:35.417879 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2b1244f2-63a6-4d04-98b1-1e9d6408a2af tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1509 microversion: 2.1 time: 0.733079 Oct 30 01:35:35.420695 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2421/4832] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:35:34 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1509 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:35:35.617471 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-0d37737e-aa1a-4eec-bbe9-908ca308b00c req-40bc8608-3978-467d-b74d-893682903586 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c51345-2948-4ff1-828f-8c70b2b979f2", "name": "network-vif-deleted", "tag": "25297f9d-e65e-44db-bc94-b8ade234295f"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:35:35.642798 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-0d37737e-aa1a-4eec-bbe9-908ca308b00c req-40bc8608-3978-467d-b74d-893682903586 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:35.643300 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-0d37737e-aa1a-4eec-bbe9-908ca308b00c req-40bc8608-3978-467d-b74d-893682903586 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:35.643919 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-0d37737e-aa1a-4eec-bbe9-908ca308b00c req-40bc8608-3978-467d-b74d-893682903586 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:35.692397 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-0d37737e-aa1a-4eec-bbe9-908ca308b00c req-40bc8608-3978-467d-b74d-893682903586 service nova] Creating event network-vif-deleted:25297f9d-e65e-44db-bc94-b8ade234295f for instance b0c51345-2948-4ff1-828f-8c70b2b979f2 on n-h1-master-1 Oct 30 01:35:35.698684 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-0d37737e-aa1a-4eec-bbe9-908ca308b00c req-40bc8608-3978-467d-b74d-893682903586 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085169 Oct 30 01:35:35.699320 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2412/4833] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:35:36.332059 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-286c39eb-6e31-4daf-96bb-c7997d76a4ac tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:36.333816 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-286c39eb-6e31-4daf-96bb-c7997d76a4ac tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] [instance: e4798f38-03e6-404c-8955-102832491c88] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:36.350097 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-286c39eb-6e31-4daf-96bb-c7997d76a4ac tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:36.351144 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-286c39eb-6e31-4daf-96bb-c7997d76a4ac tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:36.352398 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-286c39eb-6e31-4daf-96bb-c7997d76a4ac tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:36.354467 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-286c39eb-6e31-4daf-96bb-c7997d76a4ac tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:36.355172 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-286c39eb-6e31-4daf-96bb-c7997d76a4ac tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:36.355834 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-286c39eb-6e31-4daf-96bb-c7997d76a4ac tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:36.448265 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4d05d2c6-6632-41c6-acbb-3da8aeb53ea4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:36.450376 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4d05d2c6-6632-41c6-acbb-3da8aeb53ea4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:36.460934 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4d05d2c6-6632-41c6-acbb-3da8aeb53ea4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:36.461756 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4d05d2c6-6632-41c6-acbb-3da8aeb53ea4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:36.463117 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4d05d2c6-6632-41c6-acbb-3da8aeb53ea4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:36.464492 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4d05d2c6-6632-41c6-acbb-3da8aeb53ea4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:36.465428 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4d05d2c6-6632-41c6-acbb-3da8aeb53ea4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:36.467595 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4d05d2c6-6632-41c6-acbb-3da8aeb53ea4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:36.516174 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4d05d2c6-6632-41c6-acbb-3da8aeb53ea4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:36.516889 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4d05d2c6-6632-41c6-acbb-3da8aeb53ea4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:36.517887 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4d05d2c6-6632-41c6-acbb-3da8aeb53ea4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:36.518722 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-4d05d2c6-6632-41c6-acbb-3da8aeb53ea4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lazy-loading 'fault' on Instance uuid b0c51345-2948-4ff1-828f-8c70b2b979f2 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:35:36.731797 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4d05d2c6-6632-41c6-acbb-3da8aeb53ea4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bce487302c24def8a8473b0725904f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efbfd76a9a74c03907d7d9be25f42d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:35:36.746516 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4d05d2c6-6632-41c6-acbb-3da8aeb53ea4 tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 200 len: 1305 microversion: 2.1 time: 0.305761 Oct 30 01:35:36.747607 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2413/4834] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:35:36 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 1305 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:35:36.880866 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-286c39eb-6e31-4daf-96bb-c7997d76a4ac tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdd7b99e5a94490b604d2e10545a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109772076b1d4aed99db960f295ac4e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:35:36.890953 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-286c39eb-6e31-4daf-96bb-c7997d76a4ac tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] 10.222.0.13 "GET /compute/v2.1/servers/e4798f38-03e6-404c-8955-102832491c88" status: 200 len: 1328 microversion: 2.1 time: 0.569283 Oct 30 01:35:36.909690 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2422/4835] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:35:36 2022] GET /compute/v2.1/servers/e4798f38-03e6-404c-8955-102832491c88 => generated 1328 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:35:37.779704 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5598600b-ddde-4c8c-9905-5b16002ca6ae tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:37.780670 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5598600b-ddde-4c8c-9905-5b16002ca6ae tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] [instance: b0c51345-2948-4ff1-828f-8c70b2b979f2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:37.806562 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5598600b-ddde-4c8c-9905-5b16002ca6ae tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:37.806985 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5598600b-ddde-4c8c-9905-5b16002ca6ae tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:37.807429 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5598600b-ddde-4c8c-9905-5b16002ca6ae tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:37.808161 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5598600b-ddde-4c8c-9905-5b16002ca6ae tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:37.808621 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5598600b-ddde-4c8c-9905-5b16002ca6ae tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:37.809054 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5598600b-ddde-4c8c-9905-5b16002ca6ae tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:37.872110 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-5598600b-ddde-4c8c-9905-5b16002ca6ae tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] HTTP exception thrown: Instance b0c51345-2948-4ff1-828f-8c70b2b979f2 could not be found. Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5598600b-ddde-4c8c-9905-5b16002ca6ae tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Request method failure captured: Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 HTTP/1.1 Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdPsZZXjRvWKe2zWP-5VH1VYAsWsLLjUmpyob2uINkfAXNLt0qGMmCTWjYn2WpZ3XOOdsuaM4lwk-qZrOIX3mOHzuCJPZ3r-9M-w153XBWLoTow-eSMj1bsAWDNo3KKhMzjHqic8AJ-DcXpdsBh93g0dRB_UMWMRrGyY1cbSRdHJrvg Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3efbfd76a9a74c03907d7d9be25f42d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 3efbfd76a9a74c03907d7d9be25f42d4 Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersNegativeTestJSON-610255542 Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 0bce487302c24def8a8473b0725904f2 Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersNegativeTestJSON-610255542-project Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: exception: Instance b0c51345-2948-4ff1-828f-8c70b2b979f2 could not be found. Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'b0c51345-2948-4ff1-828f-8c70b2b979f2'} Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0c51345-2948-4ff1-828f-8c70b2b979f2 could not be found. Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0c51345-2948-4ff1-828f-8c70b2b979f2 could not be found. Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:35:37.873932 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:37.878915 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:35:37.878915 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:35:37.878915 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:35:37.878915 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:35:37.878915 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:35:37.878915 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0c51345-2948-4ff1-828f-8c70b2b979f2 could not be found. Oct 30 01:35:37.878915 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:37.914321 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5598600b-ddde-4c8c-9905-5b16002ca6ae tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] Returning 404 to user: Instance b0c51345-2948-4ff1-828f-8c70b2b979f2 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:35:37.919759 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5598600b-ddde-4c8c-9905-5b16002ca6ae tempest-ServersNegativeTestJSON-610255542 tempest-ServersNegativeTestJSON-610255542-project] 10.222.0.13 "GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2" status: 404 len: 111 microversion: 2.1 time: 0.141475 Oct 30 01:35:37.919759 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2414/4836] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:35:37 2022] GET /compute/v2.1/servers/b0c51345-2948-4ff1-828f-8c70b2b979f2 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:35:37.926674 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4508a089-fc4c-4d82-86bc-15144975eda8 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:37.930587 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4508a089-fc4c-4d82-86bc-15144975eda8 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] [instance: e4798f38-03e6-404c-8955-102832491c88] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:37.960011 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4508a089-fc4c-4d82-86bc-15144975eda8 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:37.960903 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4508a089-fc4c-4d82-86bc-15144975eda8 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:37.961598 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4508a089-fc4c-4d82-86bc-15144975eda8 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:37.962554 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4508a089-fc4c-4d82-86bc-15144975eda8 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:37.963225 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4508a089-fc4c-4d82-86bc-15144975eda8 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:37.964642 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4508a089-fc4c-4d82-86bc-15144975eda8 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:38.633276 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4508a089-fc4c-4d82-86bc-15144975eda8 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdd7b99e5a94490b604d2e10545a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109772076b1d4aed99db960f295ac4e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:35:38.649567 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4508a089-fc4c-4d82-86bc-15144975eda8 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] 10.222.0.13 "GET /compute/v2.1/servers/e4798f38-03e6-404c-8955-102832491c88" status: 200 len: 1528 microversion: 2.1 time: 0.722462 Oct 30 01:35:38.653533 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2423/4837] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:35:37 2022] GET /compute/v2.1/servers/e4798f38-03e6-404c-8955-102832491c88 => generated 1528 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:35:38.681504 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ac0876ee-42c3-4787-9bb9-b78a50b39cb8 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:38.682237 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ac0876ee-42c3-4787-9bb9-b78a50b39cb8 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] [instance: e4798f38-03e6-404c-8955-102832491c88] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:38.693456 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ac0876ee-42c3-4787-9bb9-b78a50b39cb8 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:38.694046 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ac0876ee-42c3-4787-9bb9-b78a50b39cb8 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:38.696661 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ac0876ee-42c3-4787-9bb9-b78a50b39cb8 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:38.699198 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ac0876ee-42c3-4787-9bb9-b78a50b39cb8 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:38.700018 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ac0876ee-42c3-4787-9bb9-b78a50b39cb8 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:38.700710 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ac0876ee-42c3-4787-9bb9-b78a50b39cb8 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:39.101659 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ac0876ee-42c3-4787-9bb9-b78a50b39cb8 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdd7b99e5a94490b604d2e10545a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109772076b1d4aed99db960f295ac4e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:35:39.111815 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=100 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:35:39.117693 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ac0876ee-42c3-4787-9bb9-b78a50b39cb8 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] 10.222.0.13 "GET /compute/v2.1/servers/e4798f38-03e6-404c-8955-102832491c88" status: 200 len: 1528 microversion: 2.1 time: 0.440183 Oct 30 01:35:39.122019 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a2857b8f-9771-4256-b4cf-fb033bbec0e8 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Action: 'create', calling method: .version_select at 0x7f44c6f47310>, body: {"keypair": {"name": "tempest-keypair-1015127789", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgIhIQBwqNENuprrqac9IBQ3JbEEOy5ycCB3pv+vf/eE28DZuWeaIkEpOnZ48k3/msZLO2HJegu/87HBcsb6bXAuRbo7CNJWGFB0yudeQTYhnT41DCfroFMb/kWDIIrnw=="}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:35:39.122519 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2415/4838] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:35:38 2022] GET /compute/v2.1/servers/e4798f38-03e6-404c-8955-102832491c88 => generated 1528 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:35:39.175562 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-a2857b8f-9771-4256-b4cf-fb033bbec0e8 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Getting quotas for project 7c1e4ce82aba40a2a013f2d107877b72. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:35:39.217313 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-a2857b8f-9771-4256-b4cf-fb033bbec0e8 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Getting quotas for user aba3c4de99ec4a5aae6fb006ab89fdb9 and project 7c1e4ce82aba40a2a013f2d107877b72. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:35:39.359612 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a2857b8f-9771-4256-b4cf-fb033bbec0e8 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.481617 Oct 30 01:35:39.366522 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2424/4839] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 30 01:35:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:35:39.420423 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cd07dcab-5c75-4fb4-a3aa-2cfb3de51b23 tempest-ServersNegativeTestMultiTenantJSON-1615724673 tempest-ServersNegativeTestMultiTenantJSON-1615724673-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:39.420991 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-cd07dcab-5c75-4fb4-a3aa-2cfb3de51b23 tempest-ServersNegativeTestMultiTenantJSON-1615724673 tempest-ServersNegativeTestMultiTenantJSON-1615724673-project] [instance: e4798f38-03e6-404c-8955-102832491c88] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:39.435410 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd07dcab-5c75-4fb4-a3aa-2cfb3de51b23 tempest-ServersNegativeTestMultiTenantJSON-1615724673 tempest-ServersNegativeTestMultiTenantJSON-1615724673-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:39.436354 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd07dcab-5c75-4fb4-a3aa-2cfb3de51b23 tempest-ServersNegativeTestMultiTenantJSON-1615724673 tempest-ServersNegativeTestMultiTenantJSON-1615724673-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:39.439935 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd07dcab-5c75-4fb4-a3aa-2cfb3de51b23 tempest-ServersNegativeTestMultiTenantJSON-1615724673 tempest-ServersNegativeTestMultiTenantJSON-1615724673-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:39.446129 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd07dcab-5c75-4fb4-a3aa-2cfb3de51b23 tempest-ServersNegativeTestMultiTenantJSON-1615724673 tempest-ServersNegativeTestMultiTenantJSON-1615724673-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:39.446129 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd07dcab-5c75-4fb4-a3aa-2cfb3de51b23 tempest-ServersNegativeTestMultiTenantJSON-1615724673 tempest-ServersNegativeTestMultiTenantJSON-1615724673-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:39.446129 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd07dcab-5c75-4fb4-a3aa-2cfb3de51b23 tempest-ServersNegativeTestMultiTenantJSON-1615724673 tempest-ServersNegativeTestMultiTenantJSON-1615724673-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:39.506572 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-cd07dcab-5c75-4fb4-a3aa-2cfb3de51b23 tempest-ServersNegativeTestMultiTenantJSON-1615724673 tempest-ServersNegativeTestMultiTenantJSON-1615724673-project] HTTP exception thrown: Instance e4798f38-03e6-404c-8955-102832491c88 could not be found. Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cd07dcab-5c75-4fb4-a3aa-2cfb3de51b23 tempest-ServersNegativeTestMultiTenantJSON-1615724673 tempest-ServersNegativeTestMultiTenantJSON-1615724673-project] Request method failure captured: Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: request: DELETE /compute/v2.1/servers/e4798f38-03e6-404c-8955-102832491c88 HTTP/1.1 Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdTN15Nb2oOTGBNv8fk_xhYv2b-topJXLtgvoNg5CWTdPlkPQePRgAK8y55cKcvXHW4V4ORPmsY_gfnCR9hC23CYssVWiET3Ynt0GxGG-aljcyzLFmTdYqv-1YV2RLC-m_gWnmkffEw5oaHZsV6Sag-8ukByxbHGg32qqpt6tRGyUjI Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 7f95b6c505774d48a442b9b2ce22de13 Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1615724673 Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7f95b6c505774d48a442b9b2ce22de13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7f95b6c505774d48a442b9b2ce22de13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7f95b6c505774d48a442b9b2ce22de13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7f95b6c505774d48a442b9b2ce22de13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1615724673 Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 7f95b6c505774d48a442b9b2ce22de13 Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1615724673 Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1615724673-project Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 7f9d7169927f4bc2b7ff51ba20cc70a7 Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1615724673-project Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: exception: Instance e4798f38-03e6-404c-8955-102832491c88 could not be found. Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'e4798f38-03e6-404c-8955-102832491c88'} Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4798f38-03e6-404c-8955-102832491c88 could not be found. Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:35:39.514943 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:35:39.520590 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4798f38-03e6-404c-8955-102832491c88 could not be found. Oct 30 01:35:39.520590 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:39.520590 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:35:39.520590 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:39.520590 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:35:39.520590 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:35:39.520590 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:35:39.520590 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:35:39.520590 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:35:39.520590 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4798f38-03e6-404c-8955-102832491c88 could not be found. Oct 30 01:35:39.520590 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:39.524203 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cd07dcab-5c75-4fb4-a3aa-2cfb3de51b23 tempest-ServersNegativeTestMultiTenantJSON-1615724673 tempest-ServersNegativeTestMultiTenantJSON-1615724673-project] Returning 404 to user: Instance e4798f38-03e6-404c-8955-102832491c88 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:35:39.528405 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cd07dcab-5c75-4fb4-a3aa-2cfb3de51b23 tempest-ServersNegativeTestMultiTenantJSON-1615724673 tempest-ServersNegativeTestMultiTenantJSON-1615724673-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e4798f38-03e6-404c-8955-102832491c88" status: 404 len: 111 microversion: 2.1 time: 0.381371 Oct 30 01:35:39.536304 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2416/4840] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:35:39 2022] DELETE /compute/v2.1/servers/e4798f38-03e6-404c-8955-102832491c88 => generated 111 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 01:35:39.540904 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1af6bbe0-00d1-4fb9-aa3b-b838b0a4e87b tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:39.541646 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1af6bbe0-00d1-4fb9-aa3b-b838b0a4e87b tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] [instance: e4798f38-03e6-404c-8955-102832491c88] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:39.556046 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1af6bbe0-00d1-4fb9-aa3b-b838b0a4e87b tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:39.560880 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1af6bbe0-00d1-4fb9-aa3b-b838b0a4e87b tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:39.561379 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1af6bbe0-00d1-4fb9-aa3b-b838b0a4e87b tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:39.565795 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1af6bbe0-00d1-4fb9-aa3b-b838b0a4e87b tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:39.565795 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1af6bbe0-00d1-4fb9-aa3b-b838b0a4e87b tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:39.567087 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1af6bbe0-00d1-4fb9-aa3b-b838b0a4e87b tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:40.789310 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1af6bbe0-00d1-4fb9-aa3b-b838b0a4e87b tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdd7b99e5a94490b604d2e10545a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109772076b1d4aed99db960f295ac4e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:35:40.800622 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1af6bbe0-00d1-4fb9-aa3b-b838b0a4e87b tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] 10.222.0.13 "GET /compute/v2.1/servers/e4798f38-03e6-404c-8955-102832491c88" status: 200 len: 1528 microversion: 2.1 time: 1.264557 Oct 30 01:35:40.801230 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2425/4841] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:35:39 2022] GET /compute/v2.1/servers/e4798f38-03e6-404c-8955-102832491c88 => generated 1528 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:35:40.829792 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-341d0406-2cd1-4e0d-a193-16736f13cb27 tempest-ServersNegativeTestMultiTenantJSON-1615724673 tempest-ServersNegativeTestMultiTenantJSON-1615724673-project] Action: 'update', calling method: >, body: {"server": {"name": "e4798f38-03e6-404c-8955-102832491c88_new"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:35:40.834531 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-341d0406-2cd1-4e0d-a193-16736f13cb27 tempest-ServersNegativeTestMultiTenantJSON-1615724673 tempest-ServersNegativeTestMultiTenantJSON-1615724673-project] [instance: e4798f38-03e6-404c-8955-102832491c88] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:40.842634 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=68 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:35:40.844371 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-341d0406-2cd1-4e0d-a193-16736f13cb27 tempest-ServersNegativeTestMultiTenantJSON-1615724673 tempest-ServersNegativeTestMultiTenantJSON-1615724673-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:40.845143 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-341d0406-2cd1-4e0d-a193-16736f13cb27 tempest-ServersNegativeTestMultiTenantJSON-1615724673 tempest-ServersNegativeTestMultiTenantJSON-1615724673-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:40.845846 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-341d0406-2cd1-4e0d-a193-16736f13cb27 tempest-ServersNegativeTestMultiTenantJSON-1615724673 tempest-ServersNegativeTestMultiTenantJSON-1615724673-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:40.846979 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-341d0406-2cd1-4e0d-a193-16736f13cb27 tempest-ServersNegativeTestMultiTenantJSON-1615724673 tempest-ServersNegativeTestMultiTenantJSON-1615724673-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:40.847689 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-341d0406-2cd1-4e0d-a193-16736f13cb27 tempest-ServersNegativeTestMultiTenantJSON-1615724673 tempest-ServersNegativeTestMultiTenantJSON-1615724673-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:40.848337 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-341d0406-2cd1-4e0d-a193-16736f13cb27 tempest-ServersNegativeTestMultiTenantJSON-1615724673 tempest-ServersNegativeTestMultiTenantJSON-1615724673-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:40.866717 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-341d0406-2cd1-4e0d-a193-16736f13cb27 tempest-ServersNegativeTestMultiTenantJSON-1615724673 tempest-ServersNegativeTestMultiTenantJSON-1615724673-project] HTTP exception thrown: Instance e4798f38-03e6-404c-8955-102832491c88 could not be found. Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-341d0406-2cd1-4e0d-a193-16736f13cb27 tempest-ServersNegativeTestMultiTenantJSON-1615724673 tempest-ServersNegativeTestMultiTenantJSON-1615724673-project] Request method failure captured: Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: request: PUT /compute/v2.1/servers/e4798f38-03e6-404c-8955-102832491c88 HTTP/1.1 Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 64 Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdTN15Nb2oOTGBNv8fk_xhYv2b-topJXLtgvoNg5CWTdPlkPQePRgAK8y55cKcvXHW4V4ORPmsY_gfnCR9hC23CYssVWiET3Ynt0GxGG-aljcyzLFmTdYqv-1YV2RLC-m_gWnmkffEw5oaHZsV6Sag-8ukByxbHGg32qqpt6tRGyUjI Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 7f95b6c505774d48a442b9b2ce22de13 Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1615724673 Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7f95b6c505774d48a442b9b2ce22de13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7f95b6c505774d48a442b9b2ce22de13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7f95b6c505774d48a442b9b2ce22de13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7f95b6c505774d48a442b9b2ce22de13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1615724673 Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 7f95b6c505774d48a442b9b2ce22de13 Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1615724673 Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1615724673-project Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 7f9d7169927f4bc2b7ff51ba20cc70a7 Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1615724673-project Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: {"server": {"name": "e4798f38-03e6-404c-8955-102832491c88_new"}} Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: exception: Instance e4798f38-03e6-404c-8955-102832491c88 could not be found. Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'e4798f38-03e6-404c-8955-102832491c88', 'body': {'server': {'name': 'e4798f38-03e6-404c-8955-102832491c88_new'}}} Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4798f38-03e6-404c-8955-102832491c88 could not be found. Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:35:40.869110 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 30 01:35:40.877077 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 30 01:35:40.877077 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 30 01:35:40.877077 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:35:40.877077 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:35:40.877077 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:35:40.877077 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:35:40.877077 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4798f38-03e6-404c-8955-102832491c88 could not be found. Oct 30 01:35:40.877077 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:40.877077 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:35:40.877077 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:40.877077 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:35:40.877077 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:35:40.877077 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:35:40.877077 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:35:40.877077 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:35:40.877077 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4798f38-03e6-404c-8955-102832491c88 could not be found. Oct 30 01:35:40.877077 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:40.877077 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-341d0406-2cd1-4e0d-a193-16736f13cb27 tempest-ServersNegativeTestMultiTenantJSON-1615724673 tempest-ServersNegativeTestMultiTenantJSON-1615724673-project] Returning 404 to user: Instance e4798f38-03e6-404c-8955-102832491c88 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:35:40.877077 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-341d0406-2cd1-4e0d-a193-16736f13cb27 tempest-ServersNegativeTestMultiTenantJSON-1615724673 tempest-ServersNegativeTestMultiTenantJSON-1615724673-project] 10.222.0.13 "PUT /compute/v2.1/servers/e4798f38-03e6-404c-8955-102832491c88" status: 404 len: 111 microversion: 2.1 time: 0.052498 Oct 30 01:35:40.883909 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2417/4842] 10.222.0.13 () {60 vars in 1256 bytes} [Sun Oct 30 01:35:40 2022] PUT /compute/v2.1/servers/e4798f38-03e6-404c-8955-102832491c88 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:35:40.892090 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-aa70dde4-0b3a-4058-b748-c6dbb0552746 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:40.892689 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-aa70dde4-0b3a-4058-b748-c6dbb0552746 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] [instance: e4798f38-03e6-404c-8955-102832491c88] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:40.907289 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aa70dde4-0b3a-4058-b748-c6dbb0552746 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:40.908147 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aa70dde4-0b3a-4058-b748-c6dbb0552746 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:40.909352 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aa70dde4-0b3a-4058-b748-c6dbb0552746 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:40.910738 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aa70dde4-0b3a-4058-b748-c6dbb0552746 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:40.913119 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aa70dde4-0b3a-4058-b748-c6dbb0552746 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:40.914485 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aa70dde4-0b3a-4058-b748-c6dbb0552746 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:40.992083 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-aa70dde4-0b3a-4058-b748-c6dbb0552746 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] [instance: e4798f38-03e6-404c-8955-102832491c88] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:35:41.424185 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-aa70dde4-0b3a-4058-b748-c6dbb0552746 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e4798f38-03e6-404c-8955-102832491c88" status: 204 len: 0 microversion: 2.1 time: 0.536932 Oct 30 01:35:41.424789 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2426/4843] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:35:40 2022] DELETE /compute/v2.1/servers/e4798f38-03e6-404c-8955-102832491c88 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:35:41.433674 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-efd1bf9f-e280-47f7-b5ce-0071e209afc0 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:41.435892 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-efd1bf9f-e280-47f7-b5ce-0071e209afc0 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] [instance: e4798f38-03e6-404c-8955-102832491c88] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:41.450053 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-efd1bf9f-e280-47f7-b5ce-0071e209afc0 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:41.450801 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-efd1bf9f-e280-47f7-b5ce-0071e209afc0 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:41.452572 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-efd1bf9f-e280-47f7-b5ce-0071e209afc0 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:41.453619 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-efd1bf9f-e280-47f7-b5ce-0071e209afc0 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:41.455759 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-efd1bf9f-e280-47f7-b5ce-0071e209afc0 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:41.457832 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-efd1bf9f-e280-47f7-b5ce-0071e209afc0 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:41.835464 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-efd1bf9f-e280-47f7-b5ce-0071e209afc0 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdd7b99e5a94490b604d2e10545a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109772076b1d4aed99db960f295ac4e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:35:41.854427 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-efd1bf9f-e280-47f7-b5ce-0071e209afc0 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] 10.222.0.13 "GET /compute/v2.1/servers/e4798f38-03e6-404c-8955-102832491c88" status: 200 len: 1534 microversion: 2.1 time: 0.425152 Oct 30 01:35:41.855344 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2418/4844] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:35:41 2022] GET /compute/v2.1/servers/e4798f38-03e6-404c-8955-102832491c88 => generated 1534 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:35:42.892442 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c2d98ccd-8dfd-4059-880d-9ef9ed794d4a tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:42.894381 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c2d98ccd-8dfd-4059-880d-9ef9ed794d4a tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] [instance: e4798f38-03e6-404c-8955-102832491c88] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:42.915884 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c2d98ccd-8dfd-4059-880d-9ef9ed794d4a tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:42.916461 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c2d98ccd-8dfd-4059-880d-9ef9ed794d4a tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:42.916974 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c2d98ccd-8dfd-4059-880d-9ef9ed794d4a tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:42.918945 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c2d98ccd-8dfd-4059-880d-9ef9ed794d4a tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:42.920234 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c2d98ccd-8dfd-4059-880d-9ef9ed794d4a tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:42.920735 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c2d98ccd-8dfd-4059-880d-9ef9ed794d4a tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:43.828083 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c2d98ccd-8dfd-4059-880d-9ef9ed794d4a tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdd7b99e5a94490b604d2e10545a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109772076b1d4aed99db960f295ac4e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:35:43.836989 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c2d98ccd-8dfd-4059-880d-9ef9ed794d4a tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] 10.222.0.13 "GET /compute/v2.1/servers/e4798f38-03e6-404c-8955-102832491c88" status: 200 len: 1534 microversion: 2.1 time: 0.957752 Oct 30 01:35:43.838219 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2427/4845] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:35:42 2022] GET /compute/v2.1/servers/e4798f38-03e6-404c-8955-102832491c88 => generated 1534 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:35:44.860988 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2145f200-bfee-4322-99ab-370f12d5d05b tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:44.861699 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2145f200-bfee-4322-99ab-370f12d5d05b tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] [instance: e4798f38-03e6-404c-8955-102832491c88] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:44.870824 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2145f200-bfee-4322-99ab-370f12d5d05b tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:44.874135 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2145f200-bfee-4322-99ab-370f12d5d05b tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:44.874677 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2145f200-bfee-4322-99ab-370f12d5d05b tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:44.875689 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2145f200-bfee-4322-99ab-370f12d5d05b tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:44.876272 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2145f200-bfee-4322-99ab-370f12d5d05b tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:44.876814 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2145f200-bfee-4322-99ab-370f12d5d05b tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:45.618520 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2145f200-bfee-4322-99ab-370f12d5d05b tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdd7b99e5a94490b604d2e10545a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109772076b1d4aed99db960f295ac4e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:35:45.636027 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2145f200-bfee-4322-99ab-370f12d5d05b tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] 10.222.0.13 "GET /compute/v2.1/servers/e4798f38-03e6-404c-8955-102832491c88" status: 200 len: 1534 microversion: 2.1 time: 0.772901 Oct 30 01:35:45.636958 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2419/4846] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:35:44 2022] GET /compute/v2.1/servers/e4798f38-03e6-404c-8955-102832491c88 => generated 1534 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:35:46.663701 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bf51e486-3282-44b5-9577-28921eb7fd9f tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:46.664333 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bf51e486-3282-44b5-9577-28921eb7fd9f tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] [instance: e4798f38-03e6-404c-8955-102832491c88] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:46.675039 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bf51e486-3282-44b5-9577-28921eb7fd9f tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:46.680138 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bf51e486-3282-44b5-9577-28921eb7fd9f tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:46.680852 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bf51e486-3282-44b5-9577-28921eb7fd9f tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:46.681811 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bf51e486-3282-44b5-9577-28921eb7fd9f tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:46.682431 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bf51e486-3282-44b5-9577-28921eb7fd9f tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:46.683040 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bf51e486-3282-44b5-9577-28921eb7fd9f tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:46.850518 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-b11c1e19-5913-4440-98ac-82e23432fbb3 req-4beb0bc1-bacd-4d8a-8387-89c9e946ee21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4798f38-03e6-404c-8955-102832491c88", "name": "network-vif-deleted", "tag": "962253c6-a3bc-40c8-b090-d16434365286"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:35:46.864198 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-b11c1e19-5913-4440-98ac-82e23432fbb3 req-4beb0bc1-bacd-4d8a-8387-89c9e946ee21 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:46.864680 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-b11c1e19-5913-4440-98ac-82e23432fbb3 req-4beb0bc1-bacd-4d8a-8387-89c9e946ee21 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:46.865272 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-b11c1e19-5913-4440-98ac-82e23432fbb3 req-4beb0bc1-bacd-4d8a-8387-89c9e946ee21 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:46.877763 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bf51e486-3282-44b5-9577-28921eb7fd9f tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdd7b99e5a94490b604d2e10545a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109772076b1d4aed99db960f295ac4e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:35:46.889540 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-b11c1e19-5913-4440-98ac-82e23432fbb3 req-4beb0bc1-bacd-4d8a-8387-89c9e946ee21 service nova] Creating event network-vif-deleted:962253c6-a3bc-40c8-b090-d16434365286 for instance e4798f38-03e6-404c-8955-102832491c88 on n-h1-master-1 Oct 30 01:35:46.896907 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-b11c1e19-5913-4440-98ac-82e23432fbb3 req-4beb0bc1-bacd-4d8a-8387-89c9e946ee21 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056130 Oct 30 01:35:46.898068 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2420/4847] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:35:46.901554 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bf51e486-3282-44b5-9577-28921eb7fd9f tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] 10.222.0.13 "GET /compute/v2.1/servers/e4798f38-03e6-404c-8955-102832491c88" status: 200 len: 1492 microversion: 2.1 time: 0.229429 Oct 30 01:35:46.920610 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2428/4848] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:35:46 2022] GET /compute/v2.1/servers/e4798f38-03e6-404c-8955-102832491c88 => generated 1492 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:35:47.930092 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8af310ff-4a32-4815-b19c-1462915a985b tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:47.931573 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8af310ff-4a32-4815-b19c-1462915a985b tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] [instance: e4798f38-03e6-404c-8955-102832491c88] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:47.964133 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8af310ff-4a32-4815-b19c-1462915a985b tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:47.964643 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8af310ff-4a32-4815-b19c-1462915a985b tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:47.966795 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8af310ff-4a32-4815-b19c-1462915a985b tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:47.970523 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8af310ff-4a32-4815-b19c-1462915a985b tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:47.971264 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8af310ff-4a32-4815-b19c-1462915a985b tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:47.972668 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8af310ff-4a32-4815-b19c-1462915a985b tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:48.024910 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fc54f9d1-de72-4153-bcfc-fad44d2dd689 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-986000574", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eb5ed0de-6fb8-4008-ab8c-7a6d8633669b"}], "security_groups": [{"name": "tempest-securitygroup--1387037445"}], "key_name": "tempest-keypair-1015127789", "user_data": "}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:35:48.049676 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8af310ff-4a32-4815-b19c-1462915a985b tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:48.051366 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8af310ff-4a32-4815-b19c-1462915a985b tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:48.051792 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8af310ff-4a32-4815-b19c-1462915a985b tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:48.052675 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-8af310ff-4a32-4815-b19c-1462915a985b tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lazy-loading 'fault' on Instance uuid e4798f38-03e6-404c-8955-102832491c88 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:35:48.225771 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8af310ff-4a32-4815-b19c-1462915a985b tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcdd7b99e5a94490b604d2e10545a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109772076b1d4aed99db960f295ac4e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:35:48.235861 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8af310ff-4a32-4815-b19c-1462915a985b tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] 10.222.0.13 "GET /compute/v2.1/servers/e4798f38-03e6-404c-8955-102832491c88" status: 200 len: 1318 microversion: 2.1 time: 0.312684 Oct 30 01:35:48.252286 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2421/4849] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:35:47 2022] GET /compute/v2.1/servers/e4798f38-03e6-404c-8955-102832491c88 => generated 1318 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:35:48.427379 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-fc54f9d1-de72-4153-bcfc-fad44d2dd689 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] validate_networks() for [('eb5ed0de-6fb8-4008-ab8c-7a6d8633669b', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:35:49.246049 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=4 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:35:49.261551 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3b027cce-89fa-4e67-a032-8d3c12babc17 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:49.264150 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3b027cce-89fa-4e67-a032-8d3c12babc17 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] [instance: e4798f38-03e6-404c-8955-102832491c88] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:49.278910 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b027cce-89fa-4e67-a032-8d3c12babc17 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:49.283971 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b027cce-89fa-4e67-a032-8d3c12babc17 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:49.283971 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b027cce-89fa-4e67-a032-8d3c12babc17 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:49.283971 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b027cce-89fa-4e67-a032-8d3c12babc17 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:49.283971 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b027cce-89fa-4e67-a032-8d3c12babc17 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:49.283971 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b027cce-89fa-4e67-a032-8d3c12babc17 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:49.311857 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-3b027cce-89fa-4e67-a032-8d3c12babc17 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] HTTP exception thrown: Instance e4798f38-03e6-404c-8955-102832491c88 could not be found. Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3b027cce-89fa-4e67-a032-8d3c12babc17 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Request method failure captured: Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/e4798f38-03e6-404c-8955-102832491c88 HTTP/1.1 Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdS3ZCZzQrQbK5naSYk3lt9E_CEJyink0SE7tSYqSu6TCKfNqTaoCeR69zjjCJ-Et4qspoEkHLPv-L2dtNbiTfU9GJNVvEpgiTuFcZcUXwuAxgexY6oDMvPrh5-n8Eh88DH_7Wh7NyPTdL2m1jTCRe0jiuwdy-P-1hPCizNTiESIMd8 Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 109772076b1d4aed99db960f295ac4e0 Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1395153248 Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/109772076b1d4aed99db960f295ac4e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_109772076b1d4aed99db960f295ac4e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/109772076b1d4aed99db960f295ac4e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/109772076b1d4aed99db960f295ac4e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1395153248 Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 109772076b1d4aed99db960f295ac4e0 Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1395153248 Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1395153248-project Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: dcdd7b99e5a94490b604d2e10545a658 Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1395153248-project Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: exception: Instance e4798f38-03e6-404c-8955-102832491c88 could not be found. Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'e4798f38-03e6-404c-8955-102832491c88'} Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4798f38-03e6-404c-8955-102832491c88 could not be found. Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4798f38-03e6-404c-8955-102832491c88 could not be found. Oct 30 01:35:49.314840 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:49.320876 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:35:49.320876 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:49.320876 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:35:49.320876 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:35:49.320876 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:35:49.320876 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:35:49.320876 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:35:49.320876 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4798f38-03e6-404c-8955-102832491c88 could not be found. Oct 30 01:35:49.320876 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:35:49.320876 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3b027cce-89fa-4e67-a032-8d3c12babc17 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] Returning 404 to user: Instance e4798f38-03e6-404c-8955-102832491c88 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:35:49.320876 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3b027cce-89fa-4e67-a032-8d3c12babc17 tempest-ServersNegativeTestMultiTenantJSON-1395153248 tempest-ServersNegativeTestMultiTenantJSON-1395153248-project] 10.222.0.13 "GET /compute/v2.1/servers/e4798f38-03e6-404c-8955-102832491c88" status: 404 len: 111 microversion: 2.1 time: 0.064267 Oct 30 01:35:49.327160 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2422/4850] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:35:49 2022] GET /compute/v2.1/servers/e4798f38-03e6-404c-8955-102832491c88 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:35:51.152611 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-fc54f9d1-de72-4153-bcfc-fad44d2dd689 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:35:51.153131 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-fc54f9d1-de72-4153-bcfc-fad44d2dd689 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:35:51.153683 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-fc54f9d1-de72-4153-bcfc-fad44d2dd689 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:35:51.154113 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-fc54f9d1-de72-4153-bcfc-fad44d2dd689 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:35:51.154535 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-fc54f9d1-de72-4153-bcfc-fad44d2dd689 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:35:51.178458 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fc54f9d1-de72-4153-bcfc-fad44d2dd689 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:51.178458 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fc54f9d1-de72-4153-bcfc-fad44d2dd689 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:51.178458 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fc54f9d1-de72-4153-bcfc-fad44d2dd689 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:51.179296 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fc54f9d1-de72-4153-bcfc-fad44d2dd689 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:51.179831 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fc54f9d1-de72-4153-bcfc-fad44d2dd689 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:51.180280 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fc54f9d1-de72-4153-bcfc-fad44d2dd689 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:51.209603 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-fc54f9d1-de72-4153-bcfc-fad44d2dd689 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Getting quotas for project 7c1e4ce82aba40a2a013f2d107877b72. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:35:51.219906 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-fc54f9d1-de72-4153-bcfc-fad44d2dd689 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Getting quotas for user aba3c4de99ec4a5aae6fb006ab89fdb9 and project 7c1e4ce82aba40a2a013f2d107877b72. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:35:51.244058 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fc54f9d1-de72-4153-bcfc-fad44d2dd689 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:35:51.249894 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fc54f9d1-de72-4153-bcfc-fad44d2dd689 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:35:51.392629 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fc54f9d1-de72-4153-bcfc-fad44d2dd689 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.372738 Oct 30 01:35:51.394283 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2429/4851] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:35:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 3375 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 30 01:35:51.406500 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f4c00885-066b-4dca-922b-ee660d708b51 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:51.407393 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f4c00885-066b-4dca-922b-ee660d708b51 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:51.844535 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f4c00885-066b-4dca-922b-ee660d708b51 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:35:51.858594 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f4c00885-066b-4dca-922b-ee660d708b51 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b" status: 200 len: 1237 microversion: 2.1 time: 0.454706 Oct 30 01:35:51.859328 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2423/4852] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:35:51 2022] GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b => generated 1237 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:35:52.885431 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-920e765e-d24d-4695-9d89-cf61b476aad6 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:52.889627 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-920e765e-d24d-4695-9d89-cf61b476aad6 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:52.908667 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-920e765e-d24d-4695-9d89-cf61b476aad6 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:52.910333 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-920e765e-d24d-4695-9d89-cf61b476aad6 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:52.911072 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-920e765e-d24d-4695-9d89-cf61b476aad6 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:52.913610 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-920e765e-d24d-4695-9d89-cf61b476aad6 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:52.914686 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-920e765e-d24d-4695-9d89-cf61b476aad6 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:52.916171 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-920e765e-d24d-4695-9d89-cf61b476aad6 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:53.355727 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-920e765e-d24d-4695-9d89-cf61b476aad6 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:35:53.376685 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-920e765e-d24d-4695-9d89-cf61b476aad6 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b" status: 200 len: 1241 microversion: 2.1 time: 0.498394 Oct 30 01:35:53.386247 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2430/4853] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:35:52 2022] GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b => generated 1241 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:35:54.400177 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-dc8d94d8-b536-4283-a125-861de8910a48 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:54.401016 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-dc8d94d8-b536-4283-a125-861de8910a48 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:54.408884 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc8d94d8-b536-4283-a125-861de8910a48 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:54.409436 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc8d94d8-b536-4283-a125-861de8910a48 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:54.409856 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc8d94d8-b536-4283-a125-861de8910a48 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:54.417157 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc8d94d8-b536-4283-a125-861de8910a48 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:54.419426 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc8d94d8-b536-4283-a125-861de8910a48 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:54.419916 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc8d94d8-b536-4283-a125-861de8910a48 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:54.657298 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-dc8d94d8-b536-4283-a125-861de8910a48 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:35:54.669994 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-dc8d94d8-b536-4283-a125-861de8910a48 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b" status: 200 len: 1297 microversion: 2.1 time: 0.273078 Oct 30 01:35:54.673133 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2424/4854] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:35:54 2022] GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b => generated 1297 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:35:55.698008 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9e89344f-2200-4191-b6ea-1bf3c7540b0b tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:55.699544 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9e89344f-2200-4191-b6ea-1bf3c7540b0b tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:55.708744 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9e89344f-2200-4191-b6ea-1bf3c7540b0b tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:55.709488 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9e89344f-2200-4191-b6ea-1bf3c7540b0b tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:55.710274 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9e89344f-2200-4191-b6ea-1bf3c7540b0b tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:55.711160 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9e89344f-2200-4191-b6ea-1bf3c7540b0b tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:55.711810 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9e89344f-2200-4191-b6ea-1bf3c7540b0b tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:55.713490 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9e89344f-2200-4191-b6ea-1bf3c7540b0b tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:55.721987 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:35:55.848001 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9e89344f-2200-4191-b6ea-1bf3c7540b0b tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:35:55.870696 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9e89344f-2200-4191-b6ea-1bf3c7540b0b tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b" status: 200 len: 1295 microversion: 2.1 time: 0.172975 Oct 30 01:35:55.874187 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2431/4855] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:35:55 2022] GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b => generated 1295 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:35:56.907078 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7e152386-1cef-43a0-bbe0-6e75da9f6c6e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:56.908585 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7e152386-1cef-43a0-bbe0-6e75da9f6c6e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:56.917005 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7e152386-1cef-43a0-bbe0-6e75da9f6c6e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:56.917869 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7e152386-1cef-43a0-bbe0-6e75da9f6c6e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:56.919225 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7e152386-1cef-43a0-bbe0-6e75da9f6c6e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:56.920317 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7e152386-1cef-43a0-bbe0-6e75da9f6c6e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:56.921104 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7e152386-1cef-43a0-bbe0-6e75da9f6c6e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:56.921782 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7e152386-1cef-43a0-bbe0-6e75da9f6c6e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:57.531048 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7e152386-1cef-43a0-bbe0-6e75da9f6c6e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:35:57.561746 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7e152386-1cef-43a0-bbe0-6e75da9f6c6e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b" status: 200 len: 1363 microversion: 2.1 time: 0.659682 Oct 30 01:35:57.563367 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2425/4856] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:35:56 2022] GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b => generated 1363 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:35:58.587679 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f1fda2dd-7067-406e-92a8-3da01019b5c6 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:35:58.588307 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f1fda2dd-7067-406e-92a8-3da01019b5c6 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:35:58.617461 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:35:58.618691 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f1fda2dd-7067-406e-92a8-3da01019b5c6 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:58.619189 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f1fda2dd-7067-406e-92a8-3da01019b5c6 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:58.619625 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f1fda2dd-7067-406e-92a8-3da01019b5c6 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:58.620372 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f1fda2dd-7067-406e-92a8-3da01019b5c6 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:35:58.620832 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f1fda2dd-7067-406e-92a8-3da01019b5c6 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:35:58.621262 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f1fda2dd-7067-406e-92a8-3da01019b5c6 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:35:59.344763 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f1fda2dd-7067-406e-92a8-3da01019b5c6 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:35:59.362014 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f1fda2dd-7067-406e-92a8-3da01019b5c6 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b" status: 200 len: 1363 microversion: 2.1 time: 0.778198 Oct 30 01:35:59.364777 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2432/4857] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:35:58 2022] GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b => generated 1363 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:35:59.865093 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5e19dbdc-868c-40eb-bc3c-9b51574bb0f5 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Action: 'create', calling method: .version_select at 0x7f44c7e329d0>, body: {"keypair": {"name": "tempest-keypair-2089258761", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBK6Chcev1ezVbrcWvy8ZGjWfwwS7OzI7BTlY7cC+ypSbnvawUTs2FU3SM2X7A5ykAVVzVqQ++m7rh5YnJKKCSYcrqeUa/2QKTyJdgODsfnOnH1ZtT50Mlt3DJGpIv8cyw=="}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:35:59.924426 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-5e19dbdc-868c-40eb-bc3c-9b51574bb0f5 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Getting quotas for project 01acf8e8ee774c008833d5aff937b676. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:35:59.952619 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-5e19dbdc-868c-40eb-bc3c-9b51574bb0f5 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Getting quotas for user 02d9c8a493ab4fc1bdac4ab6494bec15 and project 01acf8e8ee774c008833d5aff937b676. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:36:00.086456 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5e19dbdc-868c-40eb-bc3c-9b51574bb0f5 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.226063 Oct 30 01:36:00.087218 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2426/4858] 10.222.0.13 () {62 vars in 1200 bytes} [Sun Oct 30 01:35:59 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 231 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 30 01:36:00.390014 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-373ddad8-e2e4-4008-a55f-34df307c9ec8 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:36:00.391230 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-373ddad8-e2e4-4008-a55f-34df307c9ec8 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:36:00.404981 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-373ddad8-e2e4-4008-a55f-34df307c9ec8 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:00.406224 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-373ddad8-e2e4-4008-a55f-34df307c9ec8 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:00.412287 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-373ddad8-e2e4-4008-a55f-34df307c9ec8 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:00.413306 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-373ddad8-e2e4-4008-a55f-34df307c9ec8 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:00.413934 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-373ddad8-e2e4-4008-a55f-34df307c9ec8 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:00.414432 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-373ddad8-e2e4-4008-a55f-34df307c9ec8 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:00.948038 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-373ddad8-e2e4-4008-a55f-34df307c9ec8 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:00.971806 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-373ddad8-e2e4-4008-a55f-34df307c9ec8 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b" status: 200 len: 1363 microversion: 2.1 time: 0.585714 Oct 30 01:36:00.987564 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2433/4859] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:36:00 2022] GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b => generated 1363 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:36:01.272435 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-2f486d0a-9a2f-496c-8736-cfcba195ce2a req-3dd25d1d-b8f6-4bce-a9ba-f56c0bb0b87a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97f81ee8-7551-4e9b-9ff6-7f542c5dab1b", "tag": "9fdf215f-6694-408c-ac71-7cabfd8535ae"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:36:01.295356 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-2f486d0a-9a2f-496c-8736-cfcba195ce2a req-3dd25d1d-b8f6-4bce-a9ba-f56c0bb0b87a service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:01.295914 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-2f486d0a-9a2f-496c-8736-cfcba195ce2a req-3dd25d1d-b8f6-4bce-a9ba-f56c0bb0b87a service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:01.296294 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-2f486d0a-9a2f-496c-8736-cfcba195ce2a req-3dd25d1d-b8f6-4bce-a9ba-f56c0bb0b87a service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:01.325264 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-2f486d0a-9a2f-496c-8736-cfcba195ce2a req-3dd25d1d-b8f6-4bce-a9ba-f56c0bb0b87a service nova] Creating event network-changed:9fdf215f-6694-408c-ac71-7cabfd8535ae for instance 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b on n-h1-master-1 Oct 30 01:36:01.332043 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-2f486d0a-9a2f-496c-8736-cfcba195ce2a req-3dd25d1d-b8f6-4bce-a9ba-f56c0bb0b87a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063571 Oct 30 01:36:01.334333 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2427/4860] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:36:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:36:02.018392 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e38b7f38-351d-40ee-a28c-0bde546e340d tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:36:02.020956 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e38b7f38-351d-40ee-a28c-0bde546e340d tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:36:02.029469 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:02.030508 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=6 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:02.059453 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e38b7f38-351d-40ee-a28c-0bde546e340d tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:02.060259 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e38b7f38-351d-40ee-a28c-0bde546e340d tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:02.062483 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e38b7f38-351d-40ee-a28c-0bde546e340d tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:02.063463 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e38b7f38-351d-40ee-a28c-0bde546e340d tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:02.064145 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e38b7f38-351d-40ee-a28c-0bde546e340d tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:02.065316 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e38b7f38-351d-40ee-a28c-0bde546e340d tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:02.928012 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e38b7f38-351d-40ee-a28c-0bde546e340d tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:02.938222 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e38b7f38-351d-40ee-a28c-0bde546e340d tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b" status: 200 len: 1363 microversion: 2.1 time: 0.938156 Oct 30 01:36:02.939153 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2434/4861] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:36:01 2022] GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b => generated 1363 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:36:03.970764 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-21952521-96b7-45d6-b5a4-3d934c5cb358 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:36:03.972319 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-21952521-96b7-45d6-b5a4-3d934c5cb358 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:36:03.985281 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21952521-96b7-45d6-b5a4-3d934c5cb358 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:03.991669 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21952521-96b7-45d6-b5a4-3d934c5cb358 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:03.993107 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21952521-96b7-45d6-b5a4-3d934c5cb358 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:03.995759 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21952521-96b7-45d6-b5a4-3d934c5cb358 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:03.995759 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21952521-96b7-45d6-b5a4-3d934c5cb358 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:03.995759 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21952521-96b7-45d6-b5a4-3d934c5cb358 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:04.589974 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-21952521-96b7-45d6-b5a4-3d934c5cb358 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:04.602942 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-21952521-96b7-45d6-b5a4-3d934c5cb358 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b" status: 200 len: 1363 microversion: 2.1 time: 0.641572 Oct 30 01:36:04.606365 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2428/4862] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:36:03 2022] GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b => generated 1363 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:36:05.629443 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-aab8572a-80b2-4f80-8ecf-82fa968cdc47 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:36:05.630068 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-aab8572a-80b2-4f80-8ecf-82fa968cdc47 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:36:05.641768 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aab8572a-80b2-4f80-8ecf-82fa968cdc47 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:05.642499 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aab8572a-80b2-4f80-8ecf-82fa968cdc47 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:05.645353 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aab8572a-80b2-4f80-8ecf-82fa968cdc47 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:05.646101 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aab8572a-80b2-4f80-8ecf-82fa968cdc47 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:05.646571 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aab8572a-80b2-4f80-8ecf-82fa968cdc47 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:05.649398 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aab8572a-80b2-4f80-8ecf-82fa968cdc47 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:06.347061 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-aab8572a-80b2-4f80-8ecf-82fa968cdc47 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:06.354988 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-aab8572a-80b2-4f80-8ecf-82fa968cdc47 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b" status: 200 len: 1363 microversion: 2.1 time: 0.729955 Oct 30 01:36:06.360029 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2435/4863] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:36:05 2022] GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b => generated 1363 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:36:07.382172 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-889e915e-174e-4944-ace0-87dd37e79659 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:36:07.382798 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-889e915e-174e-4944-ace0-87dd37e79659 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:36:07.390551 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-889e915e-174e-4944-ace0-87dd37e79659 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:07.391400 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-889e915e-174e-4944-ace0-87dd37e79659 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:07.392117 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-889e915e-174e-4944-ace0-87dd37e79659 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:07.393083 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-889e915e-174e-4944-ace0-87dd37e79659 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:07.393817 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-889e915e-174e-4944-ace0-87dd37e79659 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:07.394474 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-889e915e-174e-4944-ace0-87dd37e79659 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:07.919017 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-889e915e-174e-4944-ace0-87dd37e79659 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:07.932616 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-889e915e-174e-4944-ace0-87dd37e79659 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b" status: 200 len: 1363 microversion: 2.1 time: 0.554965 Oct 30 01:36:07.936403 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2429/4864] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:36:07 2022] GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b => generated 1363 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:36:08.279147 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-785d870e-05a3-4dd2-b379-4781690d1d6a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1281887786", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "0cf69096-3051-46f0-b9fd-fe1200a3502b"}, {"port": "1b93efb1-1d66-4cce-94fd-03ec5abdbd99", "tag": "port-1"}, {"port": "dd203276-bfbe-4e13-92c1-6e267ef12915", "tag": "port-2"}, {"uuid": "7c516482-e993-40f3-ad52-4d234879621c", "tag": "net-1"}, {"uuid": "7c516482-e993-40f3-ad52-4d234879621c"}, {"uuid": "ab5530e1-5510-4c1d-9b0b-7b9c6288c1fe", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "ab5530e1-5510-4c1d-9b0b-7b9c6288c1fe", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "e88735f4-49c9-457d-b0c5-d7d4a0e70a4f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "2dd62fe7-fdbc-4e5e-921f-b68d8dbcac8f", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "d51fc3c1-b195-4983-8745-5331b3e80d83", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1506215537"}], "key_name": "tempest-keypair-2089258761", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:36:08.502057 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-785d870e-05a3-4dd2-b379-4781690d1d6a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] validate_networks() for [('0cf69096-3051-46f0-b9fd-fe1200a3502b', None, None, None, None, None), (None, None, '1b93efb1-1d66-4cce-94fd-03ec5abdbd99', None, None, None), (None, None, 'dd203276-bfbe-4e13-92c1-6e267ef12915', None, None, None), ('7c516482-e993-40f3-ad52-4d234879621c', None, None, None, None, None), ('7c516482-e993-40f3-ad52-4d234879621c', None, None, None, None, None), ('ab5530e1-5510-4c1d-9b0b-7b9c6288c1fe', '10.2.2.100', None, None, None, None), ('ab5530e1-5510-4c1d-9b0b-7b9c6288c1fe', '10.2.2.200', None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:36:08.961534 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-560103b5-6472-4841-886c-ab1610a4419d tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:36:08.962158 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-560103b5-6472-4841-886c-ab1610a4419d tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:36:08.978621 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-560103b5-6472-4841-886c-ab1610a4419d tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:08.979465 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-560103b5-6472-4841-886c-ab1610a4419d tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:08.980107 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-560103b5-6472-4841-886c-ab1610a4419d tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:08.981617 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-560103b5-6472-4841-886c-ab1610a4419d tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:08.982271 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-560103b5-6472-4841-886c-ab1610a4419d tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:08.982889 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-560103b5-6472-4841-886c-ab1610a4419d tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:09.673389 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-560103b5-6472-4841-886c-ab1610a4419d tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:09.676001 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=60 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:09.685290 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-560103b5-6472-4841-886c-ab1610a4419d tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b" status: 200 len: 1363 microversion: 2.1 time: 0.728844 Oct 30 01:36:09.685892 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2430/4865] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:36:08 2022] GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b => generated 1363 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:36:10.713396 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cd744960-ac31-440a-a2e8-7f049c8b7cb5 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:36:10.714700 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-cd744960-ac31-440a-a2e8-7f049c8b7cb5 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:36:10.725297 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=6 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:10.730580 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd744960-ac31-440a-a2e8-7f049c8b7cb5 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:10.731169 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd744960-ac31-440a-a2e8-7f049c8b7cb5 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:10.731662 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd744960-ac31-440a-a2e8-7f049c8b7cb5 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:10.732332 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd744960-ac31-440a-a2e8-7f049c8b7cb5 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:10.732794 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd744960-ac31-440a-a2e8-7f049c8b7cb5 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:10.733225 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd744960-ac31-440a-a2e8-7f049c8b7cb5 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:11.274982 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-cd744960-ac31-440a-a2e8-7f049c8b7cb5 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:11.286943 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cd744960-ac31-440a-a2e8-7f049c8b7cb5 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b" status: 200 len: 1363 microversion: 2.1 time: 0.575229 Oct 30 01:36:11.305861 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2431/4866] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:36:10 2022] GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b => generated 1363 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:36:11.610542 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-3fd58bbe-2819-4f71-9b3e-6b53b76ea9a4 req-c5de1bbb-963a-4e21-9fcd-cf7bce65ccc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97f81ee8-7551-4e9b-9ff6-7f542c5dab1b", "name": "network-vif-plugged", "status": "completed", "tag": "9fdf215f-6694-408c-ac71-7cabfd8535ae"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:36:11.634010 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:11.638505 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-3fd58bbe-2819-4f71-9b3e-6b53b76ea9a4 req-c5de1bbb-963a-4e21-9fcd-cf7bce65ccc2 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:11.642002 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-3fd58bbe-2819-4f71-9b3e-6b53b76ea9a4 req-c5de1bbb-963a-4e21-9fcd-cf7bce65ccc2 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:11.643332 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-3fd58bbe-2819-4f71-9b3e-6b53b76ea9a4 req-c5de1bbb-963a-4e21-9fcd-cf7bce65ccc2 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:11.670593 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-3fd58bbe-2819-4f71-9b3e-6b53b76ea9a4 req-c5de1bbb-963a-4e21-9fcd-cf7bce65ccc2 service nova] Creating event network-vif-plugged:9fdf215f-6694-408c-ac71-7cabfd8535ae for instance 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b on n-h1-master-1 Oct 30 01:36:11.681119 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-3fd58bbe-2819-4f71-9b3e-6b53b76ea9a4 req-c5de1bbb-963a-4e21-9fcd-cf7bce65ccc2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076124 Oct 30 01:36:11.683254 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2432/4867] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:36:12.322067 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-18a54388-c619-49ca-a705-a9c6ebeccfd4 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:36:12.322857 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-18a54388-c619-49ca-a705-a9c6ebeccfd4 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:36:12.351794 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-18a54388-c619-49ca-a705-a9c6ebeccfd4 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:12.356293 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-18a54388-c619-49ca-a705-a9c6ebeccfd4 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:12.357849 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-18a54388-c619-49ca-a705-a9c6ebeccfd4 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:12.360923 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-18a54388-c619-49ca-a705-a9c6ebeccfd4 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:12.363291 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-18a54388-c619-49ca-a705-a9c6ebeccfd4 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:12.365854 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-18a54388-c619-49ca-a705-a9c6ebeccfd4 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:13.361194 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-18a54388-c619-49ca-a705-a9c6ebeccfd4 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:13.384337 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-18a54388-c619-49ca-a705-a9c6ebeccfd4 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b" status: 200 len: 1363 microversion: 2.1 time: 1.067873 Oct 30 01:36:13.397095 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2433/4868] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:36:12 2022] GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b => generated 1363 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:36:14.410840 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4e37cc6b-4c80-4e9b-89a5-b57e8526e8d1 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:36:14.411524 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4e37cc6b-4c80-4e9b-89a5-b57e8526e8d1 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:36:14.434398 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4e37cc6b-4c80-4e9b-89a5-b57e8526e8d1 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:14.438054 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4e37cc6b-4c80-4e9b-89a5-b57e8526e8d1 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:14.438501 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4e37cc6b-4c80-4e9b-89a5-b57e8526e8d1 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:14.439269 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4e37cc6b-4c80-4e9b-89a5-b57e8526e8d1 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:14.439710 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4e37cc6b-4c80-4e9b-89a5-b57e8526e8d1 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:14.440138 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4e37cc6b-4c80-4e9b-89a5-b57e8526e8d1 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:14.979467 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4e37cc6b-4c80-4e9b-89a5-b57e8526e8d1 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:14.997812 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4e37cc6b-4c80-4e9b-89a5-b57e8526e8d1 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b" status: 200 len: 1548 microversion: 2.1 time: 0.584639 Oct 30 01:36:14.998457 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2434/4869] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:36:14 2022] GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b => generated 1548 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:36:15.022876 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7a8f5c0c-db10-4ee9-b4e0-538dc534f39d tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:36:15.023535 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7a8f5c0c-db10-4ee9-b4e0-538dc534f39d tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:36:15.034618 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7a8f5c0c-db10-4ee9-b4e0-538dc534f39d tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:15.037153 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7a8f5c0c-db10-4ee9-b4e0-538dc534f39d tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:15.037153 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7a8f5c0c-db10-4ee9-b4e0-538dc534f39d tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:15.037153 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7a8f5c0c-db10-4ee9-b4e0-538dc534f39d tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:15.037153 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7a8f5c0c-db10-4ee9-b4e0-538dc534f39d tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:15.037153 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7a8f5c0c-db10-4ee9-b4e0-538dc534f39d tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:15.381271 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7a8f5c0c-db10-4ee9-b4e0-538dc534f39d tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.361546 Oct 30 01:36:15.383890 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2435/4870] 10.222.0.13 () {58 vars in 1275 bytes} [Sun Oct 30 01:36:15 2022] GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b/os-interface => generated 284 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:36:15.385502 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7a8f5c0c-db10-4ee9-b4e0-538dc534f39d tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:36:15.388267 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7a8f5c0c-db10-4ee9-b4e0-538dc534f39d tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003092 Oct 30 01:36:15.388852 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2436/4871] 10.222.0.13 () {56 vars in 886 bytes} [Sun Oct 30 01:36:15 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 30 01:36:16.235503 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-785d870e-05a3-4dd2-b379-4781690d1d6a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:36:16.238908 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-785d870e-05a3-4dd2-b379-4781690d1d6a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:36:16.246735 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-785d870e-05a3-4dd2-b379-4781690d1d6a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:36:16.251731 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-785d870e-05a3-4dd2-b379-4781690d1d6a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:36:16.253071 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-785d870e-05a3-4dd2-b379-4781690d1d6a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:36:16.272856 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-785d870e-05a3-4dd2-b379-4781690d1d6a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:16.273804 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-785d870e-05a3-4dd2-b379-4781690d1d6a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:16.273976 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-785d870e-05a3-4dd2-b379-4781690d1d6a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:16.274899 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-785d870e-05a3-4dd2-b379-4781690d1d6a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:16.275534 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-785d870e-05a3-4dd2-b379-4781690d1d6a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:16.277895 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-785d870e-05a3-4dd2-b379-4781690d1d6a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:16.312366 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-785d870e-05a3-4dd2-b379-4781690d1d6a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Getting quotas for project 01acf8e8ee774c008833d5aff937b676. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:36:16.327691 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-785d870e-05a3-4dd2-b379-4781690d1d6a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Getting quotas for user 02d9c8a493ab4fc1bdac4ab6494bec15 and project 01acf8e8ee774c008833d5aff937b676. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:36:16.739573 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-785d870e-05a3-4dd2-b379-4781690d1d6a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:36:16.743067 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-785d870e-05a3-4dd2-b379-4781690d1d6a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='e88735f4-49c9-457d-b0c5-d7d4a0e70a4f',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='2dd62fe7-fdbc-4e5e-921f-b68d8dbcac8f',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d51fc3c1-b195-4983-8745-5331b3e80d83',volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:36:18.256345 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-785d870e-05a3-4dd2-b379-4781690d1d6a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 9.968788 Oct 30 01:36:18.260408 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2436/4872] 10.222.0.13 () {62 vars in 1189 bytes} [Sun Oct 30 01:36:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 9988 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 30 01:36:18.274879 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2a325d56-4bb4-45d5-8383-403bf39d92b6 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:36:18.276284 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2a325d56-4bb4-45d5-8383-403bf39d92b6 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:36:18.568056 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2a325d56-4bb4-45d5-8383-403bf39d92b6 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:18.578810 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2a325d56-4bb4-45d5-8383-403bf39d92b6 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:18.582296 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2a325d56-4bb4-45d5-8383-403bf39d92b6 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:18.582818 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2a325d56-4bb4-45d5-8383-403bf39d92b6 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1286 microversion: 2.42 time: 0.313449 Oct 30 01:36:18.583381 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2437/4873] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:36:18 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1286 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:36:19.615854 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-75127351-6e91-40bc-94be-853c2732db73 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:36:19.616770 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-75127351-6e91-40bc-94be-853c2732db73 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:36:19.922595 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-75127351-6e91-40bc-94be-853c2732db73 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:19.932624 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-75127351-6e91-40bc-94be-853c2732db73 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:19.948420 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-75127351-6e91-40bc-94be-853c2732db73 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:19.950276 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-75127351-6e91-40bc-94be-853c2732db73 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1286 microversion: 2.42 time: 0.340703 Oct 30 01:36:19.971705 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2437/4874] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:36:19 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1286 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:36:20.986550 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-fb30c53e-51af-4da4-aeca-13c96b811679 req-01d1647f-8863-4105-9ce7-406a8fc8e14e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97f81ee8-7551-4e9b-9ff6-7f542c5dab1b", "tag": "9fdf215f-6694-408c-ac71-7cabfd8535ae"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:36:20.987844 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d7aade84-0ec2-4dbd-9e67-8b27db7952b4 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:36:20.990391 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d7aade84-0ec2-4dbd-9e67-8b27db7952b4 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:36:21.046223 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-fb30c53e-51af-4da4-aeca-13c96b811679 req-01d1647f-8863-4105-9ce7-406a8fc8e14e service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:21.049212 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-fb30c53e-51af-4da4-aeca-13c96b811679 req-01d1647f-8863-4105-9ce7-406a8fc8e14e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:21.051230 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-fb30c53e-51af-4da4-aeca-13c96b811679 req-01d1647f-8863-4105-9ce7-406a8fc8e14e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:21.107821 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-fb30c53e-51af-4da4-aeca-13c96b811679 req-01d1647f-8863-4105-9ce7-406a8fc8e14e service nova] Creating event network-changed:9fdf215f-6694-408c-ac71-7cabfd8535ae for instance 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b on n-h1-master-1 Oct 30 01:36:21.124862 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-fb30c53e-51af-4da4-aeca-13c96b811679 req-01d1647f-8863-4105-9ce7-406a8fc8e14e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142817 Oct 30 01:36:21.127552 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2438/4875] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:36:21.301480 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d7aade84-0ec2-4dbd-9e67-8b27db7952b4 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:21.311421 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d7aade84-0ec2-4dbd-9e67-8b27db7952b4 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:21.312928 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d7aade84-0ec2-4dbd-9e67-8b27db7952b4 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:21.314156 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d7aade84-0ec2-4dbd-9e67-8b27db7952b4 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1286 microversion: 2.42 time: 0.338878 Oct 30 01:36:21.339330 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2438/4876] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:36:20 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1286 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:36:22.342583 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f6cb92a9-6c01-4432-8191-dfb319059f12 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:36:22.343282 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f6cb92a9-6c01-4432-8191-dfb319059f12 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:36:22.356562 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f6cb92a9-6c01-4432-8191-dfb319059f12 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:22.357057 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f6cb92a9-6c01-4432-8191-dfb319059f12 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:22.357532 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f6cb92a9-6c01-4432-8191-dfb319059f12 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:22.358249 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f6cb92a9-6c01-4432-8191-dfb319059f12 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:22.358702 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f6cb92a9-6c01-4432-8191-dfb319059f12 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:22.359124 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f6cb92a9-6c01-4432-8191-dfb319059f12 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:22.652927 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f6cb92a9-6c01-4432-8191-dfb319059f12 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:22.674099 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f6cb92a9-6c01-4432-8191-dfb319059f12 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:22.679721 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f6cb92a9-6c01-4432-8191-dfb319059f12 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:22.682794 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f6cb92a9-6c01-4432-8191-dfb319059f12 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1528 microversion: 2.42 time: 0.344988 Oct 30 01:36:22.694096 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2439/4877] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:36:22 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1528 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:36:23.710717 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-482c1fc9-a1ed-4f25-bd5f-fcd9c141644c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:36:23.711350 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-482c1fc9-a1ed-4f25-bd5f-fcd9c141644c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:36:23.747400 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-482c1fc9-a1ed-4f25-bd5f-fcd9c141644c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:23.759553 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-482c1fc9-a1ed-4f25-bd5f-fcd9c141644c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:23.760364 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-482c1fc9-a1ed-4f25-bd5f-fcd9c141644c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:23.761402 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-482c1fc9-a1ed-4f25-bd5f-fcd9c141644c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:23.766329 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-482c1fc9-a1ed-4f25-bd5f-fcd9c141644c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:23.767336 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-482c1fc9-a1ed-4f25-bd5f-fcd9c141644c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:24.339339 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-482c1fc9-a1ed-4f25-bd5f-fcd9c141644c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:24.350378 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-482c1fc9-a1ed-4f25-bd5f-fcd9c141644c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:24.352672 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-482c1fc9-a1ed-4f25-bd5f-fcd9c141644c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:24.354676 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-482c1fc9-a1ed-4f25-bd5f-fcd9c141644c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1584 microversion: 2.42 time: 0.647385 Oct 30 01:36:24.355480 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2439/4878] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:36:23 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1584 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:36:25.381296 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a8d57552-7570-4a4a-a5e1-d9a1162de411 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:36:25.382559 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a8d57552-7570-4a4a-a5e1-d9a1162de411 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:36:25.393148 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a8d57552-7570-4a4a-a5e1-d9a1162de411 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:25.394301 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a8d57552-7570-4a4a-a5e1-d9a1162de411 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:25.399579 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a8d57552-7570-4a4a-a5e1-d9a1162de411 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:25.399579 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a8d57552-7570-4a4a-a5e1-d9a1162de411 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:25.399579 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a8d57552-7570-4a4a-a5e1-d9a1162de411 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:25.399579 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a8d57552-7570-4a4a-a5e1-d9a1162de411 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:25.788900 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a8d57552-7570-4a4a-a5e1-d9a1162de411 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:25.814757 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a8d57552-7570-4a4a-a5e1-d9a1162de411 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:25.818361 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a8d57552-7570-4a4a-a5e1-d9a1162de411 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:25.822014 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a8d57552-7570-4a4a-a5e1-d9a1162de411 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1594 microversion: 2.42 time: 0.445259 Oct 30 01:36:25.826645 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2440/4879] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:36:25 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1594 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:36:26.859234 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5e5bc29a-8fe8-49d6-8afc-c705df9d0643 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:36:26.860660 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5e5bc29a-8fe8-49d6-8afc-c705df9d0643 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:36:26.876858 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5e5bc29a-8fe8-49d6-8afc-c705df9d0643 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:26.878339 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5e5bc29a-8fe8-49d6-8afc-c705df9d0643 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:26.879054 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5e5bc29a-8fe8-49d6-8afc-c705df9d0643 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:26.879966 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5e5bc29a-8fe8-49d6-8afc-c705df9d0643 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:26.880582 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5e5bc29a-8fe8-49d6-8afc-c705df9d0643 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:26.881359 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5e5bc29a-8fe8-49d6-8afc-c705df9d0643 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:27.500819 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5e5bc29a-8fe8-49d6-8afc-c705df9d0643 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:27.517198 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5e5bc29a-8fe8-49d6-8afc-c705df9d0643 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:27.523203 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5e5bc29a-8fe8-49d6-8afc-c705df9d0643 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:27.533005 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5e5bc29a-8fe8-49d6-8afc-c705df9d0643 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1662 microversion: 2.42 time: 0.681046 Oct 30 01:36:27.535396 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2440/4880] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:36:26 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1662 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:36:28.565913 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-89b00223-4857-4d3e-b2ac-afcfe5b8746c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:36:28.567306 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-89b00223-4857-4d3e-b2ac-afcfe5b8746c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:36:28.569801 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:28.592239 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-89b00223-4857-4d3e-b2ac-afcfe5b8746c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:28.595564 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-89b00223-4857-4d3e-b2ac-afcfe5b8746c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:28.596819 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-89b00223-4857-4d3e-b2ac-afcfe5b8746c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:28.599146 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-89b00223-4857-4d3e-b2ac-afcfe5b8746c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:28.601018 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-89b00223-4857-4d3e-b2ac-afcfe5b8746c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:28.601663 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-89b00223-4857-4d3e-b2ac-afcfe5b8746c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:29.047942 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-36126f3c-409c-4455-af32-ce88429c8938 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1986444692", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "23bac07c-fd15-43fe-bec7-06f0679e3987"}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:36:29.181925 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-36126f3c-409c-4455-af32-ce88429c8938 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] validate_networks() for [('23bac07c-fd15-43fe-bec7-06f0679e3987', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:36:29.227283 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-89b00223-4857-4d3e-b2ac-afcfe5b8746c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:29.235000 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=50 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:29.245401 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-89b00223-4857-4d3e-b2ac-afcfe5b8746c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:29.249152 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-89b00223-4857-4d3e-b2ac-afcfe5b8746c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:29.255315 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-89b00223-4857-4d3e-b2ac-afcfe5b8746c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1662 microversion: 2.42 time: 0.690687 Oct 30 01:36:29.272493 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2441/4881] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:36:28 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1662 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:36:30.280379 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-765b7544-fc45-4e39-b4f8-ff614f812388 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:36:30.281201 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-765b7544-fc45-4e39-b4f8-ff614f812388 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:36:30.289263 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=8 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:30.291924 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:30.300754 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-765b7544-fc45-4e39-b4f8-ff614f812388 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:30.310090 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-765b7544-fc45-4e39-b4f8-ff614f812388 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:30.310565 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-765b7544-fc45-4e39-b4f8-ff614f812388 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:30.312742 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-765b7544-fc45-4e39-b4f8-ff614f812388 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:30.315138 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-765b7544-fc45-4e39-b4f8-ff614f812388 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:30.322335 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-765b7544-fc45-4e39-b4f8-ff614f812388 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:31.310913 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=4 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:31.319658 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-765b7544-fc45-4e39-b4f8-ff614f812388 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:31.329417 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-765b7544-fc45-4e39-b4f8-ff614f812388 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:31.330872 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-765b7544-fc45-4e39-b4f8-ff614f812388 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:31.332038 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-765b7544-fc45-4e39-b4f8-ff614f812388 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1662 microversion: 2.42 time: 1.057900 Oct 30 01:36:31.332612 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2442/4882] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:36:30 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1662 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:36:31.535466 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-36126f3c-409c-4455-af32-ce88429c8938 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:36:31.536456 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-36126f3c-409c-4455-af32-ce88429c8938 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:36:31.537249 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-36126f3c-409c-4455-af32-ce88429c8938 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:36:31.537930 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-36126f3c-409c-4455-af32-ce88429c8938 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:36:31.538564 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-36126f3c-409c-4455-af32-ce88429c8938 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:36:31.559640 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-36126f3c-409c-4455-af32-ce88429c8938 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:31.560407 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-36126f3c-409c-4455-af32-ce88429c8938 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:31.561770 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-36126f3c-409c-4455-af32-ce88429c8938 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:31.564529 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-36126f3c-409c-4455-af32-ce88429c8938 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:31.567817 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-36126f3c-409c-4455-af32-ce88429c8938 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:31.568561 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-36126f3c-409c-4455-af32-ce88429c8938 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:31.633796 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-36126f3c-409c-4455-af32-ce88429c8938 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Getting quotas for project 6716e9ebbf6c4ca1950a5a0bce33276c. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:36:31.661120 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-36126f3c-409c-4455-af32-ce88429c8938 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Getting quotas for user 352cb9c0a2644e0e8743f3cc4477f88f and project 6716e9ebbf6c4ca1950a5a0bce33276c. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:36:31.702261 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-36126f3c-409c-4455-af32-ce88429c8938 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:36:31.705017 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-36126f3c-409c-4455-af32-ce88429c8938 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:36:31.911434 n-d-master-1 devstack@n-api.service[121103]: ERROR oslo.messaging._drivers.impl_rabbit [None req-36126f3c-409c-4455-af32-ce88429c8938 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [ea8419db-1e48-4acc-a09d-9b821b35612c] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 30 01:36:32.363738 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-43103869-537a-4a9b-a865-6925c66f93a7 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:36:32.365091 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-43103869-537a-4a9b-a865-6925c66f93a7 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:36:32.391181 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-43103869-537a-4a9b-a865-6925c66f93a7 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:32.397475 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-43103869-537a-4a9b-a865-6925c66f93a7 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:32.399191 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-43103869-537a-4a9b-a865-6925c66f93a7 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:32.402843 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-43103869-537a-4a9b-a865-6925c66f93a7 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:32.405739 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-43103869-537a-4a9b-a865-6925c66f93a7 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:32.406369 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-43103869-537a-4a9b-a865-6925c66f93a7 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:32.932816 n-d-master-1 devstack@n-api.service[121103]: INFO oslo.messaging._drivers.impl_rabbit [None req-36126f3c-409c-4455-af32-ce88429c8938 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [ea8419db-1e48-4acc-a09d-9b821b35612c] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 47028. Oct 30 01:36:32.940495 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-43103869-537a-4a9b-a865-6925c66f93a7 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:32.947238 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-36126f3c-409c-4455-af32-ce88429c8938 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.209430 Oct 30 01:36:32.954714 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2441/4883] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:36:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 4217 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 30 01:36:32.960799 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-43103869-537a-4a9b-a865-6925c66f93a7 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:32.972126 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-43103869-537a-4a9b-a865-6925c66f93a7 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:32.972384 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-05fabb1d-7611-4bd7-a253-51f2f58834c5 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:36:32.975925 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-43103869-537a-4a9b-a865-6925c66f93a7 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1756 microversion: 2.42 time: 0.615587 Oct 30 01:36:32.988042 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2443/4884] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:36:32 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1756 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:36:32.991183 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-05fabb1d-7611-4bd7-a253-51f2f58834c5 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:36:33.336963 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-05fabb1d-7611-4bd7-a253-51f2f58834c5 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:33.345474 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-05fabb1d-7611-4bd7-a253-51f2f58834c5 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4" status: 200 len: 1218 microversion: 2.1 time: 0.377069 Oct 30 01:36:33.349061 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2442/4885] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:36:32 2022] GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 => generated 1218 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:36:34.008077 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a120c88f-0167-48a5-be44-76ae51e566e0 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:36:34.020434 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a120c88f-0167-48a5-be44-76ae51e566e0 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:36:34.035127 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a120c88f-0167-48a5-be44-76ae51e566e0 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:34.039293 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a120c88f-0167-48a5-be44-76ae51e566e0 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:34.040818 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a120c88f-0167-48a5-be44-76ae51e566e0 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:34.045697 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a120c88f-0167-48a5-be44-76ae51e566e0 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:34.049059 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a120c88f-0167-48a5-be44-76ae51e566e0 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:34.049059 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a120c88f-0167-48a5-be44-76ae51e566e0 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:34.375840 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ee103895-8f3a-4525-a9f8-b73e97dffba0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:36:34.377014 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ee103895-8f3a-4525-a9f8-b73e97dffba0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:36:35.071151 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ee103895-8f3a-4525-a9f8-b73e97dffba0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:35.082179 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ee103895-8f3a-4525-a9f8-b73e97dffba0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4" status: 200 len: 1218 microversion: 2.1 time: 0.711387 Oct 30 01:36:35.082760 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2443/4886] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:36:34 2022] GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 => generated 1218 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:36:35.264443 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a120c88f-0167-48a5-be44-76ae51e566e0 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:35.280133 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a120c88f-0167-48a5-be44-76ae51e566e0 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:35.291457 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a120c88f-0167-48a5-be44-76ae51e566e0 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:35.294078 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a120c88f-0167-48a5-be44-76ae51e566e0 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1756 microversion: 2.42 time: 1.290227 Oct 30 01:36:35.301638 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2444/4887] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:36:34 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1756 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:36:36.112103 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a1b4e29d-39f3-49e0-bf68-965ea567a57b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:36:36.112103 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a1b4e29d-39f3-49e0-bf68-965ea567a57b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:36:36.132582 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a1b4e29d-39f3-49e0-bf68-965ea567a57b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:36.133553 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a1b4e29d-39f3-49e0-bf68-965ea567a57b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:36.134221 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a1b4e29d-39f3-49e0-bf68-965ea567a57b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:36.135106 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a1b4e29d-39f3-49e0-bf68-965ea567a57b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:36.137910 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a1b4e29d-39f3-49e0-bf68-965ea567a57b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:36.142072 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a1b4e29d-39f3-49e0-bf68-965ea567a57b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:36.225934 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-83d3dd87-dcc2-48b3-91bc-6466350e071e tempest-ExtensionsTest-1417560220 tempest-ExtensionsTest-1417560220-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:36:36.230803 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-83d3dd87-dcc2-48b3-91bc-6466350e071e tempest-ExtensionsTest-1417560220 tempest-ExtensionsTest-1417560220-project] 10.222.0.13 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.527382 Oct 30 01:36:36.230803 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2444/4888] 10.222.0.13 () {58 vars in 1170 bytes} [Sun Oct 30 01:36:35 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:36:36.239728 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8e3205ef-c9c6-4aff-9655-74e99107104f tempest-ExtensionsTest-1417560220 tempest-ExtensionsTest-1417560220-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:36:36.252188 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8e3205ef-c9c6-4aff-9655-74e99107104f tempest-ExtensionsTest-1417560220 tempest-ExtensionsTest-1417560220-project] 10.222.0.13 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.012314 Oct 30 01:36:36.254260 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2445/4889] 10.222.0.13 () {58 vars in 1134 bytes} [Sun Oct 30 01:36:36 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:36:36.327049 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-511c562f-4c9f-469f-a449-f44cb9814f90 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:36:36.333399 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-511c562f-4c9f-469f-a449-f44cb9814f90 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:36:36.343595 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-511c562f-4c9f-469f-a449-f44cb9814f90 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:36.344206 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-511c562f-4c9f-469f-a449-f44cb9814f90 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:36.344523 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-511c562f-4c9f-469f-a449-f44cb9814f90 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:36.348528 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-511c562f-4c9f-469f-a449-f44cb9814f90 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:36.349378 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-511c562f-4c9f-469f-a449-f44cb9814f90 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:36.349990 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-511c562f-4c9f-469f-a449-f44cb9814f90 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:36.490549 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a1b4e29d-39f3-49e0-bf68-965ea567a57b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:36.500357 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a1b4e29d-39f3-49e0-bf68-965ea567a57b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4" status: 200 len: 1270 microversion: 2.1 time: 0.393432 Oct 30 01:36:36.502211 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2445/4890] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:36:36 2022] GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 => generated 1270 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:36:37.532969 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5652eb9c-96a8-4697-9a45-fbbe19e9194f tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:36:37.533848 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5652eb9c-96a8-4697-9a45-fbbe19e9194f tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:36:37.545980 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5652eb9c-96a8-4697-9a45-fbbe19e9194f tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:37.546478 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5652eb9c-96a8-4697-9a45-fbbe19e9194f tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:37.551717 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5652eb9c-96a8-4697-9a45-fbbe19e9194f tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:37.552575 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5652eb9c-96a8-4697-9a45-fbbe19e9194f tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:37.553051 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5652eb9c-96a8-4697-9a45-fbbe19e9194f tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:37.553616 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5652eb9c-96a8-4697-9a45-fbbe19e9194f tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:37.682870 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-511c562f-4c9f-469f-a449-f44cb9814f90 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:37.705378 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-511c562f-4c9f-469f-a449-f44cb9814f90 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:37.711536 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-511c562f-4c9f-469f-a449-f44cb9814f90 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:37.712818 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-511c562f-4c9f-469f-a449-f44cb9814f90 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1803 microversion: 2.42 time: 1.390349 Oct 30 01:36:37.723563 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2446/4891] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:36:36 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1803 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:36:38.159182 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5652eb9c-96a8-4697-9a45-fbbe19e9194f tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:38.171331 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5652eb9c-96a8-4697-9a45-fbbe19e9194f tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4" status: 200 len: 1276 microversion: 2.1 time: 0.643127 Oct 30 01:36:38.174386 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2446/4892] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:36:37 2022] GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 => generated 1276 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:36:38.743204 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-07dbf501-76d7-43aa-8e44-8c2e283488af tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:36:38.743927 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-07dbf501-76d7-43aa-8e44-8c2e283488af tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:36:38.769160 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-07dbf501-76d7-43aa-8e44-8c2e283488af tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:38.769160 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-07dbf501-76d7-43aa-8e44-8c2e283488af tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:38.769160 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-07dbf501-76d7-43aa-8e44-8c2e283488af tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:38.769160 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-07dbf501-76d7-43aa-8e44-8c2e283488af tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:38.769160 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-07dbf501-76d7-43aa-8e44-8c2e283488af tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:38.769160 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-07dbf501-76d7-43aa-8e44-8c2e283488af tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:39.205479 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-040d8d8d-2a95-47a8-aac6-6792700f2cc4 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:36:39.206696 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-040d8d8d-2a95-47a8-aac6-6792700f2cc4 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:36:39.223411 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-040d8d8d-2a95-47a8-aac6-6792700f2cc4 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:39.224172 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-040d8d8d-2a95-47a8-aac6-6792700f2cc4 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:39.224785 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-040d8d8d-2a95-47a8-aac6-6792700f2cc4 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:39.225712 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-040d8d8d-2a95-47a8-aac6-6792700f2cc4 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:39.227725 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-040d8d8d-2a95-47a8-aac6-6792700f2cc4 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:39.228328 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-040d8d8d-2a95-47a8-aac6-6792700f2cc4 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:39.984247 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-040d8d8d-2a95-47a8-aac6-6792700f2cc4 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:39.997198 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-040d8d8d-2a95-47a8-aac6-6792700f2cc4 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4" status: 200 len: 1276 microversion: 2.1 time: 0.796373 Oct 30 01:36:40.010692 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2447/4893] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:36:39 2022] GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 => generated 1276 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:36:40.405459 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-07dbf501-76d7-43aa-8e44-8c2e283488af tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:40.423904 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-07dbf501-76d7-43aa-8e44-8c2e283488af tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:40.443550 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-07dbf501-76d7-43aa-8e44-8c2e283488af tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:40.452471 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-07dbf501-76d7-43aa-8e44-8c2e283488af tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1850 microversion: 2.42 time: 1.714226 Oct 30 01:36:40.455220 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2447/4894] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:36:38 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1850 bytes in 1718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:36:41.024453 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-33f24938-818a-4434-8c7f-322aa160e0ea tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:36:41.025893 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-33f24938-818a-4434-8c7f-322aa160e0ea tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:36:41.049141 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-33f24938-818a-4434-8c7f-322aa160e0ea tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:41.051660 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-33f24938-818a-4434-8c7f-322aa160e0ea tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:41.053477 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-33f24938-818a-4434-8c7f-322aa160e0ea tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:41.056034 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-33f24938-818a-4434-8c7f-322aa160e0ea tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:41.058912 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-33f24938-818a-4434-8c7f-322aa160e0ea tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:41.062886 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-33f24938-818a-4434-8c7f-322aa160e0ea tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:41.487405 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3198a0c4-1abc-4e8a-a6d1-b9ec843981da tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:36:41.488029 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3198a0c4-1abc-4e8a-a6d1-b9ec843981da tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:36:41.502691 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3198a0c4-1abc-4e8a-a6d1-b9ec843981da tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:41.503289 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3198a0c4-1abc-4e8a-a6d1-b9ec843981da tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:41.506818 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3198a0c4-1abc-4e8a-a6d1-b9ec843981da tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:41.506818 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3198a0c4-1abc-4e8a-a6d1-b9ec843981da tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:41.507367 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3198a0c4-1abc-4e8a-a6d1-b9ec843981da tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:41.507709 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3198a0c4-1abc-4e8a-a6d1-b9ec843981da tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:41.578117 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=52 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:41.598915 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:41.721232 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-33f24938-818a-4434-8c7f-322aa160e0ea tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:41.752147 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-33f24938-818a-4434-8c7f-322aa160e0ea tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4" status: 200 len: 1318 microversion: 2.1 time: 0.731782 Oct 30 01:36:41.782023 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2448/4895] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:36:41 2022] GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 => generated 1318 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:36:42.208865 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3198a0c4-1abc-4e8a-a6d1-b9ec843981da tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:42.233260 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3198a0c4-1abc-4e8a-a6d1-b9ec843981da tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:42.239016 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3198a0c4-1abc-4e8a-a6d1-b9ec843981da tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:42.240261 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3198a0c4-1abc-4e8a-a6d1-b9ec843981da tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1850 microversion: 2.42 time: 0.756866 Oct 30 01:36:42.240837 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2448/4896] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:36:41 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1850 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:36:42.781837 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7dabdf6c-26d5-4324-9cf4-3819e29906cf tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:36:42.782516 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7dabdf6c-26d5-4324-9cf4-3819e29906cf tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:36:42.809753 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7dabdf6c-26d5-4324-9cf4-3819e29906cf tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:42.813298 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7dabdf6c-26d5-4324-9cf4-3819e29906cf tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:42.813759 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7dabdf6c-26d5-4324-9cf4-3819e29906cf tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:42.814721 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7dabdf6c-26d5-4324-9cf4-3819e29906cf tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:42.820982 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7dabdf6c-26d5-4324-9cf4-3819e29906cf tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:42.822908 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7dabdf6c-26d5-4324-9cf4-3819e29906cf tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:43.266688 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4a29a18e-728c-48ee-9f53-62bda4f99166 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:36:43.267517 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4a29a18e-728c-48ee-9f53-62bda4f99166 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:36:43.271142 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:43.296475 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4a29a18e-728c-48ee-9f53-62bda4f99166 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:43.298163 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4a29a18e-728c-48ee-9f53-62bda4f99166 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:43.300005 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4a29a18e-728c-48ee-9f53-62bda4f99166 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:43.322299 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4a29a18e-728c-48ee-9f53-62bda4f99166 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:43.323052 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4a29a18e-728c-48ee-9f53-62bda4f99166 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:43.323796 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4a29a18e-728c-48ee-9f53-62bda4f99166 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:44.408632 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7dabdf6c-26d5-4324-9cf4-3819e29906cf tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:44.435991 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7dabdf6c-26d5-4324-9cf4-3819e29906cf tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4" status: 200 len: 1318 microversion: 2.1 time: 1.653530 Oct 30 01:36:44.435991 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2449/4897] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:36:42 2022] GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 => generated 1318 bytes in 1657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:36:44.646612 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4a29a18e-728c-48ee-9f53-62bda4f99166 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:44.660665 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4a29a18e-728c-48ee-9f53-62bda4f99166 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:44.662167 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4a29a18e-728c-48ee-9f53-62bda4f99166 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:44.663362 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4a29a18e-728c-48ee-9f53-62bda4f99166 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1850 microversion: 2.42 time: 1.401114 Oct 30 01:36:44.669257 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2449/4898] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:36:43 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1850 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:36:45.471392 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a6f5a090-6721-4805-aa93-f091b136e2d5 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:36:45.482700 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a6f5a090-6721-4805-aa93-f091b136e2d5 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:36:45.500164 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a6f5a090-6721-4805-aa93-f091b136e2d5 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:45.500662 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a6f5a090-6721-4805-aa93-f091b136e2d5 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:45.508246 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a6f5a090-6721-4805-aa93-f091b136e2d5 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:45.509307 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a6f5a090-6721-4805-aa93-f091b136e2d5 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:45.513824 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a6f5a090-6721-4805-aa93-f091b136e2d5 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:45.514666 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a6f5a090-6721-4805-aa93-f091b136e2d5 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:45.700807 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ab62959f-4212-4ac9-bd37-5079784570b6 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:36:45.708057 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ab62959f-4212-4ac9-bd37-5079784570b6 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:36:45.733875 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=10 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:45.738283 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ab62959f-4212-4ac9-bd37-5079784570b6 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:45.739049 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ab62959f-4212-4ac9-bd37-5079784570b6 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:45.746892 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ab62959f-4212-4ac9-bd37-5079784570b6 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:45.746892 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ab62959f-4212-4ac9-bd37-5079784570b6 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:45.746892 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ab62959f-4212-4ac9-bd37-5079784570b6 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:45.746892 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ab62959f-4212-4ac9-bd37-5079784570b6 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:46.593465 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a6f5a090-6721-4805-aa93-f091b136e2d5 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:46.610704 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a6f5a090-6721-4805-aa93-f091b136e2d5 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4" status: 200 len: 1318 microversion: 2.1 time: 1.145275 Oct 30 01:36:46.626474 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2450/4899] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:36:45 2022] GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 => generated 1318 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:36:46.642710 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-4e47f973-f68f-486a-8249-865fc487620d req-3d83593a-967f-4bf9-a709-5721f0facaaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef88e251-1a54-4519-ba22-ddcfa39451f9", "tag": "8b3d8d2b-c04a-49f0-ac61-050342907eee"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:36:46.671456 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-4e47f973-f68f-486a-8249-865fc487620d req-3d83593a-967f-4bf9-a709-5721f0facaaa service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:46.671944 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-4e47f973-f68f-486a-8249-865fc487620d req-3d83593a-967f-4bf9-a709-5721f0facaaa service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:46.672842 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-4e47f973-f68f-486a-8249-865fc487620d req-3d83593a-967f-4bf9-a709-5721f0facaaa service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:46.701861 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-4e47f973-f68f-486a-8249-865fc487620d req-3d83593a-967f-4bf9-a709-5721f0facaaa service nova] Creating event network-changed:8b3d8d2b-c04a-49f0-ac61-050342907eee for instance ef88e251-1a54-4519-ba22-ddcfa39451f9 on n-h2-master-1 Oct 30 01:36:46.712007 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-4e47f973-f68f-486a-8249-865fc487620d req-3d83593a-967f-4bf9-a709-5721f0facaaa service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083039 Oct 30 01:36:46.722560 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2451/4900] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:36:46.764316 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ab62959f-4212-4ac9-bd37-5079784570b6 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:46.783401 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ab62959f-4212-4ac9-bd37-5079784570b6 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:46.786207 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ab62959f-4212-4ac9-bd37-5079784570b6 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:46.789601 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ab62959f-4212-4ac9-bd37-5079784570b6 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1850 microversion: 2.42 time: 1.091379 Oct 30 01:36:46.790239 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2450/4901] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:36:45 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1850 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:36:47.641197 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c626569a-c037-442d-864b-8488af67c76a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:36:47.642169 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c626569a-c037-442d-864b-8488af67c76a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:36:47.653525 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c626569a-c037-442d-864b-8488af67c76a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:47.662629 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c626569a-c037-442d-864b-8488af67c76a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:47.662629 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c626569a-c037-442d-864b-8488af67c76a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:47.670616 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c626569a-c037-442d-864b-8488af67c76a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:47.671150 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c626569a-c037-442d-864b-8488af67c76a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:47.671600 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c626569a-c037-442d-864b-8488af67c76a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:47.710532 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a7f18d07-be08-4c45-b4e2-4d1544ea121e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Action: 'create', calling method: .version_select at 0x7f44d03de1f0>, body: {"keypair": {"name": "tempest-keypair-814063231", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKosM0qW16TDTVF/Iv1ooO1MIQKwyXaGog2KX8hlYKfIH1qMjaNM7ewZX12TArjf2uU38NPjCh6rBTq3WAtN4MlEBFk0fggr1fhD4REtTYRb2AW0Hko2aRq3VA4S/1d6A=="}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:36:47.767263 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-a7f18d07-be08-4c45-b4e2-4d1544ea121e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Getting quotas for project d206d5c4ea654a2194a77d71d27972e8. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:36:47.797922 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-a7f18d07-be08-4c45-b4e2-4d1544ea121e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Getting quotas for user 93d18cf1316742dab78a102a257608ae and project d206d5c4ea654a2194a77d71d27972e8. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:36:47.944411 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a7f18d07-be08-4c45-b4e2-4d1544ea121e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.927220 Oct 30 01:36:47.951514 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2452/4902] 10.222.0.13 () {62 vars in 1200 bytes} [Sun Oct 30 01:36:47 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 929 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 30 01:36:47.951514 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2561d733-e60f-4275-83c0-4d465072f0f5 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:36:47.960315 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2561d733-e60f-4275-83c0-4d465072f0f5 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:36:47.984616 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2561d733-e60f-4275-83c0-4d465072f0f5 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:47.985626 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2561d733-e60f-4275-83c0-4d465072f0f5 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:47.986296 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2561d733-e60f-4275-83c0-4d465072f0f5 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:47.987262 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2561d733-e60f-4275-83c0-4d465072f0f5 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:47.990100 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2561d733-e60f-4275-83c0-4d465072f0f5 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:47.990885 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2561d733-e60f-4275-83c0-4d465072f0f5 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:48.502283 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c626569a-c037-442d-864b-8488af67c76a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:48.519931 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c626569a-c037-442d-864b-8488af67c76a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4" status: 200 len: 1318 microversion: 2.1 time: 0.879740 Oct 30 01:36:48.519931 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2451/4903] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:36:47 2022] GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 => generated 1318 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:36:48.752572 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-fe12431b-b7cf-419b-b5bf-a9e7228298e0 req-e39e0b95-a991-403e-87fe-cb139909352d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "528b7413-5d73-4b6f-82a9-c1c9ac4d61e4", "tag": "aa672fc8-573c-44a3-ac5a-bf7de5637190"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:36:48.769837 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2561d733-e60f-4275-83c0-4d465072f0f5 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:48.773877 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-fe12431b-b7cf-419b-b5bf-a9e7228298e0 req-e39e0b95-a991-403e-87fe-cb139909352d service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:48.774575 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-fe12431b-b7cf-419b-b5bf-a9e7228298e0 req-e39e0b95-a991-403e-87fe-cb139909352d service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:48.775192 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-fe12431b-b7cf-419b-b5bf-a9e7228298e0 req-e39e0b95-a991-403e-87fe-cb139909352d service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:48.801632 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-fe12431b-b7cf-419b-b5bf-a9e7228298e0 req-e39e0b95-a991-403e-87fe-cb139909352d service nova] Creating event network-changed:aa672fc8-573c-44a3-ac5a-bf7de5637190 for instance 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 on n-h1-master-1 Oct 30 01:36:48.810809 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-fe12431b-b7cf-419b-b5bf-a9e7228298e0 req-e39e0b95-a991-403e-87fe-cb139909352d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061607 Oct 30 01:36:48.812502 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2561d733-e60f-4275-83c0-4d465072f0f5 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:48.813482 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2452/4904] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:36:48.814215 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2561d733-e60f-4275-83c0-4d465072f0f5 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:48.815442 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2561d733-e60f-4275-83c0-4d465072f0f5 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1850 microversion: 2.42 time: 0.869024 Oct 30 01:36:48.816197 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2453/4905] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:36:47 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1850 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:36:49.544323 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-93e12b3f-712b-4f3d-ac3a-ac7a8aeff6d2 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:36:49.546135 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-93e12b3f-712b-4f3d-ac3a-ac7a8aeff6d2 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:36:49.562565 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-93e12b3f-712b-4f3d-ac3a-ac7a8aeff6d2 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:49.564242 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-93e12b3f-712b-4f3d-ac3a-ac7a8aeff6d2 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:49.568132 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-93e12b3f-712b-4f3d-ac3a-ac7a8aeff6d2 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:49.569069 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-93e12b3f-712b-4f3d-ac3a-ac7a8aeff6d2 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:49.570512 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-93e12b3f-712b-4f3d-ac3a-ac7a8aeff6d2 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:49.571083 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-93e12b3f-712b-4f3d-ac3a-ac7a8aeff6d2 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:49.855225 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b0be3a5b-7cd1-49c9-831c-86f605adc8e7 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:36:49.857070 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b0be3a5b-7cd1-49c9-831c-86f605adc8e7 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:36:49.866649 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0be3a5b-7cd1-49c9-831c-86f605adc8e7 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:49.867945 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0be3a5b-7cd1-49c9-831c-86f605adc8e7 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:49.872808 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0be3a5b-7cd1-49c9-831c-86f605adc8e7 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:49.876417 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0be3a5b-7cd1-49c9-831c-86f605adc8e7 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:49.877371 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0be3a5b-7cd1-49c9-831c-86f605adc8e7 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:49.878075 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0be3a5b-7cd1-49c9-831c-86f605adc8e7 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:50.547526 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-93e12b3f-712b-4f3d-ac3a-ac7a8aeff6d2 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:50.593777 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-93e12b3f-712b-4f3d-ac3a-ac7a8aeff6d2 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4" status: 200 len: 1318 microversion: 2.1 time: 1.051439 Oct 30 01:36:50.594492 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2453/4906] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:36:49 2022] GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 => generated 1318 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:36:50.958263 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-ac370aff-a00f-4922-9436-48e82126b38e req-bf00e1e4-1dab-4a56-9029-5b203e6a4401 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef88e251-1a54-4519-ba22-ddcfa39451f9", "tag": "1b93efb1-1d66-4cce-94fd-03ec5abdbd99"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:36:50.977965 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ac370aff-a00f-4922-9436-48e82126b38e req-bf00e1e4-1dab-4a56-9029-5b203e6a4401 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:50.978970 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ac370aff-a00f-4922-9436-48e82126b38e req-bf00e1e4-1dab-4a56-9029-5b203e6a4401 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:50.980610 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ac370aff-a00f-4922-9436-48e82126b38e req-bf00e1e4-1dab-4a56-9029-5b203e6a4401 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:51.014667 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-ac370aff-a00f-4922-9436-48e82126b38e req-bf00e1e4-1dab-4a56-9029-5b203e6a4401 service nova] Creating event network-changed:1b93efb1-1d66-4cce-94fd-03ec5abdbd99 for instance ef88e251-1a54-4519-ba22-ddcfa39451f9 on n-h2-master-1 Oct 30 01:36:51.025306 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-ac370aff-a00f-4922-9436-48e82126b38e req-bf00e1e4-1dab-4a56-9029-5b203e6a4401 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069816 Oct 30 01:36:51.030302 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2454/4907] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:36:51.240687 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b0be3a5b-7cd1-49c9-831c-86f605adc8e7 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:51.270004 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b0be3a5b-7cd1-49c9-831c-86f605adc8e7 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:51.274515 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b0be3a5b-7cd1-49c9-831c-86f605adc8e7 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:51.277199 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b0be3a5b-7cd1-49c9-831c-86f605adc8e7 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1871 microversion: 2.42 time: 1.426049 Oct 30 01:36:51.278371 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2454/4908] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:36:49 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1871 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:36:51.467803 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-68c6e9b1-a5e3-4a39-a002-9cc272b95d43 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:36:51.468610 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-68c6e9b1-a5e3-4a39-a002-9cc272b95d43 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:36:51.481028 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-68c6e9b1-a5e3-4a39-a002-9cc272b95d43 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:51.485092 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-68c6e9b1-a5e3-4a39-a002-9cc272b95d43 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:51.485756 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-68c6e9b1-a5e3-4a39-a002-9cc272b95d43 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:51.486695 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-68c6e9b1-a5e3-4a39-a002-9cc272b95d43 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:51.487326 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-68c6e9b1-a5e3-4a39-a002-9cc272b95d43 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:51.494586 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-68c6e9b1-a5e3-4a39-a002-9cc272b95d43 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:51.545189 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-68c6e9b1-a5e3-4a39-a002-9cc272b95d43 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b/ips" status: 200 len: 145 microversion: 2.1 time: 0.082138 Oct 30 01:36:51.552085 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2455/4909] 10.222.0.13 () {58 vars in 1248 bytes} [Sun Oct 30 01:36:51 2022] GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b/ips => generated 145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:36:51.618135 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-17861428-dfe1-4ba9-b3e4-c6474605ea87 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:36:51.618668 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-17861428-dfe1-4ba9-b3e4-c6474605ea87 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:36:51.629356 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-17861428-dfe1-4ba9-b3e4-c6474605ea87 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:51.640286 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-17861428-dfe1-4ba9-b3e4-c6474605ea87 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:51.641670 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-17861428-dfe1-4ba9-b3e4-c6474605ea87 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:51.642621 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-17861428-dfe1-4ba9-b3e4-c6474605ea87 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:51.645192 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-17861428-dfe1-4ba9-b3e4-c6474605ea87 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:51.645993 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-17861428-dfe1-4ba9-b3e4-c6474605ea87 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:52.304698 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7fa2e922-621c-44c3-b07a-561fd01f27be tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:36:52.305656 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7fa2e922-621c-44c3-b07a-561fd01f27be tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:36:52.320475 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7fa2e922-621c-44c3-b07a-561fd01f27be tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:52.321001 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7fa2e922-621c-44c3-b07a-561fd01f27be tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:52.321550 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7fa2e922-621c-44c3-b07a-561fd01f27be tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:52.322481 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7fa2e922-621c-44c3-b07a-561fd01f27be tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:52.323122 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7fa2e922-621c-44c3-b07a-561fd01f27be tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:52.324270 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7fa2e922-621c-44c3-b07a-561fd01f27be tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:52.388617 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-17861428-dfe1-4ba9-b3e4-c6474605ea87 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:52.396566 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-17861428-dfe1-4ba9-b3e4-c6474605ea87 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4" status: 200 len: 1318 microversion: 2.1 time: 0.782682 Oct 30 01:36:52.397169 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2455/4910] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:36:51 2022] GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 => generated 1318 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:36:53.430862 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e0ecd05b-2ae7-4e70-a025-c8f86f61a4fe tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:36:53.430862 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e0ecd05b-2ae7-4e70-a025-c8f86f61a4fe tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:36:53.465161 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e0ecd05b-2ae7-4e70-a025-c8f86f61a4fe tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:53.468951 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e0ecd05b-2ae7-4e70-a025-c8f86f61a4fe tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:53.469742 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e0ecd05b-2ae7-4e70-a025-c8f86f61a4fe tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:53.473257 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e0ecd05b-2ae7-4e70-a025-c8f86f61a4fe tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:53.476190 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e0ecd05b-2ae7-4e70-a025-c8f86f61a4fe tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:53.481154 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e0ecd05b-2ae7-4e70-a025-c8f86f61a4fe tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:54.372545 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7fa2e922-621c-44c3-b07a-561fd01f27be tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:54.396769 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7fa2e922-621c-44c3-b07a-561fd01f27be tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:54.400775 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7fa2e922-621c-44c3-b07a-561fd01f27be tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:54.403616 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7fa2e922-621c-44c3-b07a-561fd01f27be tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1871 microversion: 2.42 time: 2.103491 Oct 30 01:36:54.415279 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2456/4911] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:36:52 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1871 bytes in 2116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:36:54.743805 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e0ecd05b-2ae7-4e70-a025-c8f86f61a4fe tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:54.755869 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e0ecd05b-2ae7-4e70-a025-c8f86f61a4fe tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4" status: 200 len: 1318 microversion: 2.1 time: 1.332946 Oct 30 01:36:54.757407 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2456/4912] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:36:53 2022] GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 => generated 1318 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:36:55.440626 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0115791b-41f1-4ab0-b9c1-6080b0641f05 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:36:55.444143 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0115791b-41f1-4ab0-b9c1-6080b0641f05 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:36:55.468324 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0115791b-41f1-4ab0-b9c1-6080b0641f05 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:55.471793 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0115791b-41f1-4ab0-b9c1-6080b0641f05 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:55.479213 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0115791b-41f1-4ab0-b9c1-6080b0641f05 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:55.480319 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0115791b-41f1-4ab0-b9c1-6080b0641f05 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:55.485193 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0115791b-41f1-4ab0-b9c1-6080b0641f05 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:55.487078 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0115791b-41f1-4ab0-b9c1-6080b0641f05 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:55.780669 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-690a398d-51c7-43a7-8140-5fd2fb01fbcb tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:36:55.781414 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-690a398d-51c7-43a7-8140-5fd2fb01fbcb tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:36:55.804330 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-690a398d-51c7-43a7-8140-5fd2fb01fbcb tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:55.805179 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-690a398d-51c7-43a7-8140-5fd2fb01fbcb tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:55.806712 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-690a398d-51c7-43a7-8140-5fd2fb01fbcb tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:55.811746 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-690a398d-51c7-43a7-8140-5fd2fb01fbcb tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:55.813508 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-690a398d-51c7-43a7-8140-5fd2fb01fbcb tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:55.827637 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-690a398d-51c7-43a7-8140-5fd2fb01fbcb tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:56.583260 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0115791b-41f1-4ab0-b9c1-6080b0641f05 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:56.605813 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0115791b-41f1-4ab0-b9c1-6080b0641f05 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:56.607541 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0115791b-41f1-4ab0-b9c1-6080b0641f05 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:56.611713 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0115791b-41f1-4ab0-b9c1-6080b0641f05 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1892 microversion: 2.42 time: 1.183270 Oct 30 01:36:56.621110 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2457/4913] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:36:55 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1892 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:36:56.631820 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-2600be25-7bb4-46cc-b58a-f632d2d0034f req-068a7bc3-ab3c-45c8-a63f-279caf6edf52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "528b7413-5d73-4b6f-82a9-c1c9ac4d61e4", "name": "network-vif-plugged", "status": "completed", "tag": "aa672fc8-573c-44a3-ac5a-bf7de5637190"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:36:56.667454 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-2600be25-7bb4-46cc-b58a-f632d2d0034f req-068a7bc3-ab3c-45c8-a63f-279caf6edf52 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:56.685571 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-2600be25-7bb4-46cc-b58a-f632d2d0034f req-068a7bc3-ab3c-45c8-a63f-279caf6edf52 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:56.686963 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-2600be25-7bb4-46cc-b58a-f632d2d0034f req-068a7bc3-ab3c-45c8-a63f-279caf6edf52 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:56.711123 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-690a398d-51c7-43a7-8140-5fd2fb01fbcb tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:36:56.725012 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-690a398d-51c7-43a7-8140-5fd2fb01fbcb tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4" status: 200 len: 1318 microversion: 2.1 time: 0.949777 Oct 30 01:36:56.730507 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2457/4914] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:36:55 2022] GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 => generated 1318 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:36:56.767929 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-2600be25-7bb4-46cc-b58a-f632d2d0034f req-068a7bc3-ab3c-45c8-a63f-279caf6edf52 service nova] Creating event network-vif-plugged:aa672fc8-573c-44a3-ac5a-bf7de5637190 for instance 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 on n-h1-master-1 Oct 30 01:36:56.794875 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-2600be25-7bb4-46cc-b58a-f632d2d0034f req-068a7bc3-ab3c-45c8-a63f-279caf6edf52 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172206 Oct 30 01:36:56.795509 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2458/4915] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:36:56.815796 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0fec4b38-a418-4fa2-b693-73893d14cbb8 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3b2ac5e6-1fb8-4020-b6a0-47436704a80f"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:36:56.819825 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0fec4b38-a418-4fa2-b693-73893d14cbb8 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:36:56.850208 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0fec4b38-a418-4fa2-b693-73893d14cbb8 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:56.850711 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0fec4b38-a418-4fa2-b693-73893d14cbb8 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:56.851150 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0fec4b38-a418-4fa2-b693-73893d14cbb8 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:56.852067 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0fec4b38-a418-4fa2-b693-73893d14cbb8 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:56.852950 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0fec4b38-a418-4fa2-b693-73893d14cbb8 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:56.853488 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0fec4b38-a418-4fa2-b693-73893d14cbb8 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:56.885059 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-e8548885-aeda-4845-94be-1296735a893c req-2e3d49d4-1375-4588-b15b-8f82eb944a4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef88e251-1a54-4519-ba22-ddcfa39451f9", "tag": "dd203276-bfbe-4e13-92c1-6e267ef12915"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:36:56.910564 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e8548885-aeda-4845-94be-1296735a893c req-2e3d49d4-1375-4588-b15b-8f82eb944a4a service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:56.911311 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e8548885-aeda-4845-94be-1296735a893c req-2e3d49d4-1375-4588-b15b-8f82eb944a4a service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:56.913111 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e8548885-aeda-4845-94be-1296735a893c req-2e3d49d4-1375-4588-b15b-8f82eb944a4a service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:56.928596 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-e8548885-aeda-4845-94be-1296735a893c req-2e3d49d4-1375-4588-b15b-8f82eb944a4a service nova] Creating event network-changed:dd203276-bfbe-4e13-92c1-6e267ef12915 for instance ef88e251-1a54-4519-ba22-ddcfa39451f9 on n-h2-master-1 Oct 30 01:36:56.937201 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-e8548885-aeda-4845-94be-1296735a893c req-2e3d49d4-1375-4588-b15b-8f82eb944a4a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062079 Oct 30 01:36:56.939840 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2459/4916] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:36:57.344240 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-66f79d65-0db6-4200-8fae-00600c3f5631 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-326600438", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "693a1153-c32e-44c9-bea1-fb3b37ac543f"}], "security_groups": [{"name": "tempest-securitygroup--1080245987"}], "key_name": "tempest-keypair-814063231", "user_data": "}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:36:57.746180 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-66f79d65-0db6-4200-8fae-00600c3f5631 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] validate_networks() for [('693a1153-c32e-44c9-bea1-fb3b37ac543f', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:36:57.822223 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=4 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:58.387279 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:58.510018 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0fec4b38-a418-4fa2-b693-73893d14cbb8 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "POST /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.696575 Oct 30 01:36:58.520516 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2458/4917] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 30 01:36:56 2022] POST /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b/os-volume_attachments => generated 194 bytes in 1710 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:36:58.539679 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-69a50e1f-4278-4692-af07-eb55c94cc0ab tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:36:58.542699 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-69a50e1f-4278-4692-af07-eb55c94cc0ab tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:36:58.566902 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-69a50e1f-4278-4692-af07-eb55c94cc0ab tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:58.568347 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-69a50e1f-4278-4692-af07-eb55c94cc0ab tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:58.568926 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-69a50e1f-4278-4692-af07-eb55c94cc0ab tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:36:58.570283 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-69a50e1f-4278-4692-af07-eb55c94cc0ab tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:36:58.570827 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-69a50e1f-4278-4692-af07-eb55c94cc0ab tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:36:58.571543 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-69a50e1f-4278-4692-af07-eb55c94cc0ab tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:00.045313 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-66f79d65-0db6-4200-8fae-00600c3f5631 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:37:00.045313 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-66f79d65-0db6-4200-8fae-00600c3f5631 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:37:00.045313 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-66f79d65-0db6-4200-8fae-00600c3f5631 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:37:00.045313 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-66f79d65-0db6-4200-8fae-00600c3f5631 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:37:00.045313 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-66f79d65-0db6-4200-8fae-00600c3f5631 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:37:00.118715 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-69a50e1f-4278-4692-af07-eb55c94cc0ab tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:00.121211 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-66f79d65-0db6-4200-8fae-00600c3f5631 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:00.121211 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-66f79d65-0db6-4200-8fae-00600c3f5631 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:00.121211 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-66f79d65-0db6-4200-8fae-00600c3f5631 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:00.121211 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-66f79d65-0db6-4200-8fae-00600c3f5631 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:00.121211 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-66f79d65-0db6-4200-8fae-00600c3f5631 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:00.121211 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-66f79d65-0db6-4200-8fae-00600c3f5631 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:00.121894 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-69a50e1f-4278-4692-af07-eb55c94cc0ab tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:00.121894 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-69a50e1f-4278-4692-af07-eb55c94cc0ab tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:00.121894 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-69a50e1f-4278-4692-af07-eb55c94cc0ab tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1892 microversion: 2.42 time: 1.543678 Oct 30 01:37:00.121894 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2459/4918] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:36:58 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1892 bytes in 1547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:37:00.122324 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-66f79d65-0db6-4200-8fae-00600c3f5631 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Getting quotas for project d206d5c4ea654a2194a77d71d27972e8. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:37:00.122943 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9bacee6f-f609-41a1-a114-de8ce5e82a99 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:00.123273 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-66f79d65-0db6-4200-8fae-00600c3f5631 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Getting quotas for user 93d18cf1316742dab78a102a257608ae and project d206d5c4ea654a2194a77d71d27972e8. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:37:00.123439 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9bacee6f-f609-41a1-a114-de8ce5e82a99 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:00.123602 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-66f79d65-0db6-4200-8fae-00600c3f5631 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:37:00.123602 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-66f79d65-0db6-4200-8fae-00600c3f5631 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:37:00.135610 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9bacee6f-f609-41a1-a114-de8ce5e82a99 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:00.142778 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9bacee6f-f609-41a1-a114-de8ce5e82a99 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:00.144204 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9bacee6f-f609-41a1-a114-de8ce5e82a99 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:00.146950 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9bacee6f-f609-41a1-a114-de8ce5e82a99 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:00.148100 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9bacee6f-f609-41a1-a114-de8ce5e82a99 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:00.149691 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9bacee6f-f609-41a1-a114-de8ce5e82a99 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:00.275685 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-66f79d65-0db6-4200-8fae-00600c3f5631 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.937516 Oct 30 01:37:00.279555 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2460/4919] 10.222.0.13 () {62 vars in 1188 bytes} [Sun Oct 30 01:36:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 2942 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 30 01:37:00.302311 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-183d12f8-ae71-412d-b167-ac90cdeaac8d req-afe7c98e-c48b-4792-a6bf-d431d13e2b5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef88e251-1a54-4519-ba22-ddcfa39451f9", "tag": "2cb96018-5b01-4537-93d5-c8b744320064"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:37:00.326232 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-183d12f8-ae71-412d-b167-ac90cdeaac8d req-afe7c98e-c48b-4792-a6bf-d431d13e2b5a service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:00.327328 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-183d12f8-ae71-412d-b167-ac90cdeaac8d req-afe7c98e-c48b-4792-a6bf-d431d13e2b5a service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:00.329725 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-183d12f8-ae71-412d-b167-ac90cdeaac8d req-afe7c98e-c48b-4792-a6bf-d431d13e2b5a service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:00.356117 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-183d12f8-ae71-412d-b167-ac90cdeaac8d req-afe7c98e-c48b-4792-a6bf-d431d13e2b5a service nova] Creating event network-changed:2cb96018-5b01-4537-93d5-c8b744320064 for instance ef88e251-1a54-4519-ba22-ddcfa39451f9 on n-h2-master-1 Oct 30 01:37:00.383972 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-183d12f8-ae71-412d-b167-ac90cdeaac8d req-afe7c98e-c48b-4792-a6bf-d431d13e2b5a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102723 Oct 30 01:37:00.389950 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2461/4920] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:37:00.397214 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7e455d96-ef8f-412d-af63-0e4f8d00c3b1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:00.409041 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7e455d96-ef8f-412d-af63-0e4f8d00c3b1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:00.695595 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7e455d96-ef8f-412d-af63-0e4f8d00c3b1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:00.729995 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7e455d96-ef8f-412d-af63-0e4f8d00c3b1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:00.738183 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7e455d96-ef8f-412d-af63-0e4f8d00c3b1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:00.741107 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7e455d96-ef8f-412d-af63-0e4f8d00c3b1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1280 microversion: 2.20 time: 0.346439 Oct 30 01:37:00.749453 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2462/4921] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:37:00 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1280 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:37:01.027793 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9bacee6f-f609-41a1-a114-de8ce5e82a99 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:01.031834 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9bacee6f-f609-41a1-a114-de8ce5e82a99 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4" status: 200 len: 1508 microversion: 2.1 time: 0.962157 Oct 30 01:37:01.038534 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2460/4922] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:37:00 2022] GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 => generated 1508 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:37:01.069978 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0f996c63-fcbb-4460-95ec-17515746781b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:01.071207 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0f996c63-fcbb-4460-95ec-17515746781b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:01.098280 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-afa639ab-cfe4-404b-a9c4-dc3c448d26cf tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:01.098973 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-afa639ab-cfe4-404b-a9c4-dc3c448d26cf tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:01.105857 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0f996c63-fcbb-4460-95ec-17515746781b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:01.109725 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0f996c63-fcbb-4460-95ec-17515746781b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:01.110722 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0f996c63-fcbb-4460-95ec-17515746781b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:01.112173 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0f996c63-fcbb-4460-95ec-17515746781b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:01.117970 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0f996c63-fcbb-4460-95ec-17515746781b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:01.118351 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-afa639ab-cfe4-404b-a9c4-dc3c448d26cf tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:01.118859 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-afa639ab-cfe4-404b-a9c4-dc3c448d26cf tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:01.119439 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-afa639ab-cfe4-404b-a9c4-dc3c448d26cf tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:01.120003 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-afa639ab-cfe4-404b-a9c4-dc3c448d26cf tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:01.121014 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-afa639ab-cfe4-404b-a9c4-dc3c448d26cf tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:01.121270 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0f996c63-fcbb-4460-95ec-17515746781b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:01.121462 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-afa639ab-cfe4-404b-a9c4-dc3c448d26cf tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:01.781943 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0f996c63-fcbb-4460-95ec-17515746781b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:01.794059 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0f996c63-fcbb-4460-95ec-17515746781b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4" status: 200 len: 1508 microversion: 2.1 time: 0.730649 Oct 30 01:37:01.795547 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2463/4923] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:37:01 2022] GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 => generated 1508 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:37:01.800742 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1e08be49-11d9-41a4-b36b-3e4bf36ec9c5 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:01.802214 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1e08be49-11d9-41a4-b36b-3e4bf36ec9c5 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:01.815827 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-afa639ab-cfe4-404b-a9c4-dc3c448d26cf tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:01.835804 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-afa639ab-cfe4-404b-a9c4-dc3c448d26cf tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:01.838835 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-afa639ab-cfe4-404b-a9c4-dc3c448d26cf tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:01.852603 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-afa639ab-cfe4-404b-a9c4-dc3c448d26cf tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1880 microversion: 2.42 time: 0.750222 Oct 30 01:37:01.857665 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2461/4924] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:37:01 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1880 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:37:01.871405 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d09a4fba-fbff-494d-9544-095b33d8f96a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "OS-DCF:diskConfig": "AUTO"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:37:01.875885 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d09a4fba-fbff-494d-9544-095b33d8f96a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:01.879910 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:01.884026 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d09a4fba-fbff-494d-9544-095b33d8f96a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:01.891235 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d09a4fba-fbff-494d-9544-095b33d8f96a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:01.891235 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d09a4fba-fbff-494d-9544-095b33d8f96a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:01.891235 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d09a4fba-fbff-494d-9544-095b33d8f96a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:01.891235 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d09a4fba-fbff-494d-9544-095b33d8f96a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:01.891235 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d09a4fba-fbff-494d-9544-095b33d8f96a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:01.938354 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1e08be49-11d9-41a4-b36b-3e4bf36ec9c5 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:01.948742 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1e08be49-11d9-41a4-b36b-3e4bf36ec9c5 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:01.953516 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1e08be49-11d9-41a4-b36b-3e4bf36ec9c5 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:01.959716 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1e08be49-11d9-41a4-b36b-3e4bf36ec9c5 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1280 microversion: 2.20 time: 0.162559 Oct 30 01:37:01.960550 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2464/4925] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:37:01 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1280 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:37:02.058255 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-d09a4fba-fbff-494d-9544-095b33d8f96a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:37:02.058757 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-d09a4fba-fbff-494d-9544-095b33d8f96a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:37:02.059257 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-d09a4fba-fbff-494d-9544-095b33d8f96a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:37:02.059832 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-d09a4fba-fbff-494d-9544-095b33d8f96a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:37:02.060321 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-d09a4fba-fbff-494d-9544-095b33d8f96a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:37:02.469901 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-060a34bc-2d4b-4330-b506-32e5b3afe247 req-ce469ffd-55bd-4286-959b-4e8f4bcb33a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef88e251-1a54-4519-ba22-ddcfa39451f9", "tag": "24b50323-80bd-4825-8628-29f3a47cc19a"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:37:02.489285 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d09a4fba-fbff-494d-9544-095b33d8f96a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:02.507416 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-060a34bc-2d4b-4330-b506-32e5b3afe247 req-ce469ffd-55bd-4286-959b-4e8f4bcb33a4 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:02.508418 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-060a34bc-2d4b-4330-b506-32e5b3afe247 req-ce469ffd-55bd-4286-959b-4e8f4bcb33a4 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:02.511714 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-060a34bc-2d4b-4330-b506-32e5b3afe247 req-ce469ffd-55bd-4286-959b-4e8f4bcb33a4 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:02.537180 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d09a4fba-fbff-494d-9544-095b33d8f96a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:02.537833 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d09a4fba-fbff-494d-9544-095b33d8f96a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:02.538359 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d09a4fba-fbff-494d-9544-095b33d8f96a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:02.539167 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d09a4fba-fbff-494d-9544-095b33d8f96a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:02.539699 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d09a4fba-fbff-494d-9544-095b33d8f96a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:02.540200 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d09a4fba-fbff-494d-9544-095b33d8f96a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:02.563555 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-060a34bc-2d4b-4330-b506-32e5b3afe247 req-ce469ffd-55bd-4286-959b-4e8f4bcb33a4 service nova] Creating event network-changed:24b50323-80bd-4825-8628-29f3a47cc19a for instance ef88e251-1a54-4519-ba22-ddcfa39451f9 on n-h2-master-1 Oct 30 01:37:02.578134 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-060a34bc-2d4b-4330-b506-32e5b3afe247 req-ce469ffd-55bd-4286-959b-4e8f4bcb33a4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109483 Oct 30 01:37:02.581256 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2465/4926] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:37:02.648795 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d09a4fba-fbff-494d-9544-095b33d8f96a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "POST /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4/action" status: 202 len: 1110 microversion: 2.1 time: 0.789688 Oct 30 01:37:02.661363 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2462/4927] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:37:01 2022] POST /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4/action => generated 1110 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 30 01:37:02.673458 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-65339013-a0af-4ded-8496-03aec5d7114b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:02.674850 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-65339013-a0af-4ded-8496-03aec5d7114b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:02.692923 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-65339013-a0af-4ded-8496-03aec5d7114b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:02.695754 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-65339013-a0af-4ded-8496-03aec5d7114b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:02.697364 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-65339013-a0af-4ded-8496-03aec5d7114b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:02.698459 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-65339013-a0af-4ded-8496-03aec5d7114b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:02.698940 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-65339013-a0af-4ded-8496-03aec5d7114b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:02.702949 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-65339013-a0af-4ded-8496-03aec5d7114b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:02.884656 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0c27dbd8-e41c-46ee-a3bc-886a3a915d8c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:02.885278 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0c27dbd8-e41c-46ee-a3bc-886a3a915d8c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:02.898645 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0c27dbd8-e41c-46ee-a3bc-886a3a915d8c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:02.902678 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0c27dbd8-e41c-46ee-a3bc-886a3a915d8c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:02.903363 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0c27dbd8-e41c-46ee-a3bc-886a3a915d8c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:02.904412 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0c27dbd8-e41c-46ee-a3bc-886a3a915d8c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:02.905042 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0c27dbd8-e41c-46ee-a3bc-886a3a915d8c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:02.905671 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0c27dbd8-e41c-46ee-a3bc-886a3a915d8c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:03.888463 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-65339013-a0af-4ded-8496-03aec5d7114b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:03.910358 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0c27dbd8-e41c-46ee-a3bc-886a3a915d8c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:03.919687 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-65339013-a0af-4ded-8496-03aec5d7114b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4" status: 200 len: 1515 microversion: 2.1 time: 1.250432 Oct 30 01:37:03.925174 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2466/4928] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:37:02 2022] GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 => generated 1515 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:37:03.926474 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0c27dbd8-e41c-46ee-a3bc-886a3a915d8c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:03.927936 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0c27dbd8-e41c-46ee-a3bc-886a3a915d8c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:03.930601 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0c27dbd8-e41c-46ee-a3bc-886a3a915d8c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1880 microversion: 2.42 time: 1.050039 Oct 30 01:37:03.938481 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2463/4929] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:37:02 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1880 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:37:03.959670 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cb252d37-d311-4e47-81fc-97e7c55fe60f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:03.962548 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-cb252d37-d311-4e47-81fc-97e7c55fe60f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:03.984646 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cb252d37-d311-4e47-81fc-97e7c55fe60f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:03.987467 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cb252d37-d311-4e47-81fc-97e7c55fe60f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:03.992750 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cb252d37-d311-4e47-81fc-97e7c55fe60f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:03.999723 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cb252d37-d311-4e47-81fc-97e7c55fe60f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:03.999723 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cb252d37-d311-4e47-81fc-97e7c55fe60f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:03.999723 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cb252d37-d311-4e47-81fc-97e7c55fe60f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:04.139253 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-cb252d37-d311-4e47-81fc-97e7c55fe60f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:04.159579 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-cb252d37-d311-4e47-81fc-97e7c55fe60f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:04.165558 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-cb252d37-d311-4e47-81fc-97e7c55fe60f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:04.168881 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cb252d37-d311-4e47-81fc-97e7c55fe60f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1332 microversion: 2.20 time: 0.225617 Oct 30 01:37:04.171516 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2467/4930] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:37:03 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1332 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:37:04.951536 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e945013d-7002-403e-8478-3b732cf8a765 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:04.952941 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e945013d-7002-403e-8478-3b732cf8a765 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:04.966193 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d67ca4c9-c414-4f59-a7fc-261e786c039a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:04.968361 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d67ca4c9-c414-4f59-a7fc-261e786c039a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:04.997855 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e945013d-7002-403e-8478-3b732cf8a765 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:04.998517 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e945013d-7002-403e-8478-3b732cf8a765 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:05.001289 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d67ca4c9-c414-4f59-a7fc-261e786c039a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:05.002074 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e945013d-7002-403e-8478-3b732cf8a765 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:05.005890 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e945013d-7002-403e-8478-3b732cf8a765 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:05.008463 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d67ca4c9-c414-4f59-a7fc-261e786c039a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:05.008990 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e945013d-7002-403e-8478-3b732cf8a765 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:05.021056 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e945013d-7002-403e-8478-3b732cf8a765 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:05.021205 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d67ca4c9-c414-4f59-a7fc-261e786c039a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:05.021205 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d67ca4c9-c414-4f59-a7fc-261e786c039a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:05.021205 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d67ca4c9-c414-4f59-a7fc-261e786c039a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:05.021205 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d67ca4c9-c414-4f59-a7fc-261e786c039a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:05.489314 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e945013d-7002-403e-8478-3b732cf8a765 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:05.505558 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e945013d-7002-403e-8478-3b732cf8a765 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4" status: 200 len: 1515 microversion: 2.1 time: 0.558354 Oct 30 01:37:05.506450 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2464/4931] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:37:04 2022] GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 => generated 1515 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:37:05.520720 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-f56b86c7-26aa-41c8-a89a-e0bf4bf7aa7b req-d1573639-0dfd-4fd3-8269-be10443689bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef88e251-1a54-4519-ba22-ddcfa39451f9", "tag": "0811537c-a662-478e-a5e0-ddeeb0322f5a"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:37:05.543363 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-f56b86c7-26aa-41c8-a89a-e0bf4bf7aa7b req-d1573639-0dfd-4fd3-8269-be10443689bd service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:05.548136 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-f56b86c7-26aa-41c8-a89a-e0bf4bf7aa7b req-d1573639-0dfd-4fd3-8269-be10443689bd service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:05.548607 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-f56b86c7-26aa-41c8-a89a-e0bf4bf7aa7b req-d1573639-0dfd-4fd3-8269-be10443689bd service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:05.590876 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d67ca4c9-c414-4f59-a7fc-261e786c039a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:05.614474 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d67ca4c9-c414-4f59-a7fc-261e786c039a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:05.617692 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-f56b86c7-26aa-41c8-a89a-e0bf4bf7aa7b req-d1573639-0dfd-4fd3-8269-be10443689bd service nova] Creating event network-changed:0811537c-a662-478e-a5e0-ddeeb0322f5a for instance ef88e251-1a54-4519-ba22-ddcfa39451f9 on n-h2-master-1 Oct 30 01:37:05.625499 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d67ca4c9-c414-4f59-a7fc-261e786c039a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:05.629547 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d67ca4c9-c414-4f59-a7fc-261e786c039a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1880 microversion: 2.42 time: 0.667199 Oct 30 01:37:05.632593 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2468/4932] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:37:04 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1880 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:37:05.638566 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-f56b86c7-26aa-41c8-a89a-e0bf4bf7aa7b req-d1573639-0dfd-4fd3-8269-be10443689bd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127576 Oct 30 01:37:05.639266 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2465/4933] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:37:05.646914 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b695d04e-6542-420d-82b7-98ec4f2ec34d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:05.649079 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b695d04e-6542-420d-82b7-98ec4f2ec34d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:05.664723 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b695d04e-6542-420d-82b7-98ec4f2ec34d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:05.679903 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b695d04e-6542-420d-82b7-98ec4f2ec34d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:05.683106 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b695d04e-6542-420d-82b7-98ec4f2ec34d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:05.687909 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b695d04e-6542-420d-82b7-98ec4f2ec34d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:05.689689 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b695d04e-6542-420d-82b7-98ec4f2ec34d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:05.690141 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b695d04e-6542-420d-82b7-98ec4f2ec34d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:05.812711 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b695d04e-6542-420d-82b7-98ec4f2ec34d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:05.826711 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b695d04e-6542-420d-82b7-98ec4f2ec34d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:05.830578 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b695d04e-6542-420d-82b7-98ec4f2ec34d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:05.834384 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b695d04e-6542-420d-82b7-98ec4f2ec34d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1338 microversion: 2.20 time: 0.200146 Oct 30 01:37:05.838335 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2469/4934] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:37:05 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1338 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:37:06.536230 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1a6859de-31b7-4802-ab34-978fd9d61283 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:06.537774 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1a6859de-31b7-4802-ab34-978fd9d61283 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:06.549693 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1a6859de-31b7-4802-ab34-978fd9d61283 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:06.556067 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1a6859de-31b7-4802-ab34-978fd9d61283 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:06.556067 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1a6859de-31b7-4802-ab34-978fd9d61283 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:06.556067 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1a6859de-31b7-4802-ab34-978fd9d61283 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:06.556067 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1a6859de-31b7-4802-ab34-978fd9d61283 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:06.556067 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1a6859de-31b7-4802-ab34-978fd9d61283 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:06.662947 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3c69ed24-c4ff-4ac7-8b7a-76b73876c464 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:06.664698 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3c69ed24-c4ff-4ac7-8b7a-76b73876c464 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:06.688286 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3c69ed24-c4ff-4ac7-8b7a-76b73876c464 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:06.688661 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3c69ed24-c4ff-4ac7-8b7a-76b73876c464 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:06.690170 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3c69ed24-c4ff-4ac7-8b7a-76b73876c464 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:06.693360 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3c69ed24-c4ff-4ac7-8b7a-76b73876c464 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:06.693862 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3c69ed24-c4ff-4ac7-8b7a-76b73876c464 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:06.695092 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3c69ed24-c4ff-4ac7-8b7a-76b73876c464 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:07.502506 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1a6859de-31b7-4802-ab34-978fd9d61283 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:07.514760 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1a6859de-31b7-4802-ab34-978fd9d61283 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4" status: 200 len: 1515 microversion: 2.1 time: 0.985866 Oct 30 01:37:07.515364 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2466/4935] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:37:06 2022] GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 => generated 1515 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:37:07.525109 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1616f225-365e-4f0b-bc67-07126e12fceb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:07.525759 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1616f225-365e-4f0b-bc67-07126e12fceb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:07.546135 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1616f225-365e-4f0b-bc67-07126e12fceb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:07.547146 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1616f225-365e-4f0b-bc67-07126e12fceb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:07.549167 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1616f225-365e-4f0b-bc67-07126e12fceb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:07.549956 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1616f225-365e-4f0b-bc67-07126e12fceb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:07.550423 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1616f225-365e-4f0b-bc67-07126e12fceb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:07.553498 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1616f225-365e-4f0b-bc67-07126e12fceb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:08.248249 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3c69ed24-c4ff-4ac7-8b7a-76b73876c464 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:08.249633 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1616f225-365e-4f0b-bc67-07126e12fceb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:08.272666 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1616f225-365e-4f0b-bc67-07126e12fceb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:08.272666 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1616f225-365e-4f0b-bc67-07126e12fceb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:08.272666 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1616f225-365e-4f0b-bc67-07126e12fceb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1338 microversion: 2.20 time: 0.754042 Oct 30 01:37:08.288916 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2467/4936] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:37:07 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1338 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:37:08.288916 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-40d2f5c6-fe30-4218-a295-0a98c1641984 req-767880ac-92a8-4fae-b37c-49f59a2d452a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef88e251-1a54-4519-ba22-ddcfa39451f9", "tag": "dac20a34-eccc-48f6-b0ff-646be623ec49"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:37:08.303494 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3c69ed24-c4ff-4ac7-8b7a-76b73876c464 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:08.305744 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-40d2f5c6-fe30-4218-a295-0a98c1641984 req-767880ac-92a8-4fae-b37c-49f59a2d452a service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:08.306958 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3c69ed24-c4ff-4ac7-8b7a-76b73876c464 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:08.313296 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3c69ed24-c4ff-4ac7-8b7a-76b73876c464 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1880 microversion: 2.42 time: 1.655191 Oct 30 01:37:08.313816 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-40d2f5c6-fe30-4218-a295-0a98c1641984 req-767880ac-92a8-4fae-b37c-49f59a2d452a service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:08.314367 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-40d2f5c6-fe30-4218-a295-0a98c1641984 req-767880ac-92a8-4fae-b37c-49f59a2d452a service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:08.336759 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2470/4937] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:37:06 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1880 bytes in 1680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:37:08.343761 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-40d2f5c6-fe30-4218-a295-0a98c1641984 req-767880ac-92a8-4fae-b37c-49f59a2d452a service nova] Creating event network-changed:dac20a34-eccc-48f6-b0ff-646be623ec49 for instance ef88e251-1a54-4519-ba22-ddcfa39451f9 on n-h2-master-1 Oct 30 01:37:08.356072 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-40d2f5c6-fe30-4218-a295-0a98c1641984 req-767880ac-92a8-4fae-b37c-49f59a2d452a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077664 Oct 30 01:37:08.357480 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2468/4938] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:37:08.544265 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c8f78cac-f123-4f34-b6da-3fc65b9f8e60 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:08.545181 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c8f78cac-f123-4f34-b6da-3fc65b9f8e60 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:08.559688 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c8f78cac-f123-4f34-b6da-3fc65b9f8e60 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:08.560334 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c8f78cac-f123-4f34-b6da-3fc65b9f8e60 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:08.561583 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c8f78cac-f123-4f34-b6da-3fc65b9f8e60 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:08.562564 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c8f78cac-f123-4f34-b6da-3fc65b9f8e60 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:08.563251 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c8f78cac-f123-4f34-b6da-3fc65b9f8e60 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:08.564444 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c8f78cac-f123-4f34-b6da-3fc65b9f8e60 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:09.306204 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d2160d51-dd44-4f26-a194-05497787241a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:09.306204 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d2160d51-dd44-4f26-a194-05497787241a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:09.325816 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2160d51-dd44-4f26-a194-05497787241a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:09.326310 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2160d51-dd44-4f26-a194-05497787241a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:09.326746 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2160d51-dd44-4f26-a194-05497787241a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:09.327447 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2160d51-dd44-4f26-a194-05497787241a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:09.327898 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2160d51-dd44-4f26-a194-05497787241a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:09.328317 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2160d51-dd44-4f26-a194-05497787241a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:09.753696 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c8f78cac-f123-4f34-b6da-3fc65b9f8e60 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:09.757658 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=100 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:09.775097 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c8f78cac-f123-4f34-b6da-3fc65b9f8e60 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4" status: 200 len: 1515 microversion: 2.1 time: 1.236160 Oct 30 01:37:09.778867 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2471/4939] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:37:08 2022] GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 => generated 1515 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:37:09.795727 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-45def6e9-a902-4f0a-8336-ba60f76c7632 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:09.806382 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-45def6e9-a902-4f0a-8336-ba60f76c7632 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:09.818858 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45def6e9-a902-4f0a-8336-ba60f76c7632 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:09.819369 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45def6e9-a902-4f0a-8336-ba60f76c7632 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:09.819811 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45def6e9-a902-4f0a-8336-ba60f76c7632 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:09.820536 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45def6e9-a902-4f0a-8336-ba60f76c7632 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:09.821004 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45def6e9-a902-4f0a-8336-ba60f76c7632 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:09.821557 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45def6e9-a902-4f0a-8336-ba60f76c7632 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:10.063083 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:10.741876 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d2160d51-dd44-4f26-a194-05497787241a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:10.752631 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d2160d51-dd44-4f26-a194-05497787241a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:10.754728 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d2160d51-dd44-4f26-a194-05497787241a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:10.756464 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d2160d51-dd44-4f26-a194-05497787241a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1406 microversion: 2.20 time: 1.456462 Oct 30 01:37:10.757950 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2469/4940] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:37:09 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1406 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:37:10.804442 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-53621d79-2116-4635-a192-cb02b5ed9d9c tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:10.805178 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-53621d79-2116-4635-a192-cb02b5ed9d9c tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:10.816038 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53621d79-2116-4635-a192-cb02b5ed9d9c tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:10.817213 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53621d79-2116-4635-a192-cb02b5ed9d9c tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:10.818823 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53621d79-2116-4635-a192-cb02b5ed9d9c tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:10.822169 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53621d79-2116-4635-a192-cb02b5ed9d9c tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:10.825786 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53621d79-2116-4635-a192-cb02b5ed9d9c tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:10.832242 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53621d79-2116-4635-a192-cb02b5ed9d9c tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:11.047526 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-45def6e9-a902-4f0a-8336-ba60f76c7632 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:11.071867 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-45def6e9-a902-4f0a-8336-ba60f76c7632 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:11.087736 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-45def6e9-a902-4f0a-8336-ba60f76c7632 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:11.089280 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-45def6e9-a902-4f0a-8336-ba60f76c7632 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1880 microversion: 2.42 time: 1.309210 Oct 30 01:37:11.094343 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2472/4941] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:37:09 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1880 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:37:11.572266 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-53621d79-2116-4635-a192-cb02b5ed9d9c tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:11.587714 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-53621d79-2116-4635-a192-cb02b5ed9d9c tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4" status: 200 len: 1515 microversion: 2.1 time: 0.785156 Oct 30 01:37:11.594225 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2470/4942] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:37:10 2022] GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 => generated 1515 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:37:11.784944 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-77323a9c-984c-4837-b538-9c7a98039240 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:11.786875 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-77323a9c-984c-4837-b538-9c7a98039240 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:11.800244 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-77323a9c-984c-4837-b538-9c7a98039240 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:11.801015 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-77323a9c-984c-4837-b538-9c7a98039240 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:11.801629 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-77323a9c-984c-4837-b538-9c7a98039240 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:11.802693 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-77323a9c-984c-4837-b538-9c7a98039240 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:11.803308 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-77323a9c-984c-4837-b538-9c7a98039240 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:11.803952 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-77323a9c-984c-4837-b538-9c7a98039240 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:11.946934 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=10 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:12.126682 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c9bd8278-0969-4bbc-a5ed-aa20769c852d tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:12.127306 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c9bd8278-0969-4bbc-a5ed-aa20769c852d tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:12.133799 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c9bd8278-0969-4bbc-a5ed-aa20769c852d tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:12.134287 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c9bd8278-0969-4bbc-a5ed-aa20769c852d tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:12.134954 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c9bd8278-0969-4bbc-a5ed-aa20769c852d tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:12.136723 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c9bd8278-0969-4bbc-a5ed-aa20769c852d tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:12.137361 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c9bd8278-0969-4bbc-a5ed-aa20769c852d tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:12.137953 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c9bd8278-0969-4bbc-a5ed-aa20769c852d tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:12.684929 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-77323a9c-984c-4837-b538-9c7a98039240 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:12.696028 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-77323a9c-984c-4837-b538-9c7a98039240 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:12.703189 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-77323a9c-984c-4837-b538-9c7a98039240 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:12.704596 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-77323a9c-984c-4837-b538-9c7a98039240 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1406 microversion: 2.20 time: 0.926293 Oct 30 01:37:12.718143 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2473/4943] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:37:11 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1406 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:37:12.740713 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c2a7e8f0-c577-485c-aa54-a4708998d00f tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:12.741654 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c2a7e8f0-c577-485c-aa54-a4708998d00f tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:12.749484 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c2a7e8f0-c577-485c-aa54-a4708998d00f tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:12.753164 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c2a7e8f0-c577-485c-aa54-a4708998d00f tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:12.758399 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c2a7e8f0-c577-485c-aa54-a4708998d00f tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:12.759381 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c2a7e8f0-c577-485c-aa54-a4708998d00f tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:12.760063 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c2a7e8f0-c577-485c-aa54-a4708998d00f tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:12.761211 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c2a7e8f0-c577-485c-aa54-a4708998d00f tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:12.929003 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c9bd8278-0969-4bbc-a5ed-aa20769c852d tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:12.945979 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c9bd8278-0969-4bbc-a5ed-aa20769c852d tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:12.947982 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c9bd8278-0969-4bbc-a5ed-aa20769c852d tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:12.950967 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c9bd8278-0969-4bbc-a5ed-aa20769c852d tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1880 microversion: 2.42 time: 0.829413 Oct 30 01:37:12.957663 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2471/4944] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:37:12 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1880 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:37:13.216788 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-c3e013ef-8fb4-4173-9459-a3e78ee825a7 req-2de925d3-610c-4b36-93ba-9412e831ef91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5389398-bf67-44ff-a1fb-a26e4a079fcb", "tag": "5fdf7d37-8815-4dca-ba2d-d6297f9d29eb"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:37:13.227305 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-c3e013ef-8fb4-4173-9459-a3e78ee825a7 req-2de925d3-610c-4b36-93ba-9412e831ef91 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:13.227800 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-c3e013ef-8fb4-4173-9459-a3e78ee825a7 req-2de925d3-610c-4b36-93ba-9412e831ef91 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:13.228232 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-c3e013ef-8fb4-4173-9459-a3e78ee825a7 req-2de925d3-610c-4b36-93ba-9412e831ef91 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:13.232654 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c2a7e8f0-c577-485c-aa54-a4708998d00f tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:13.245790 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c2a7e8f0-c577-485c-aa54-a4708998d00f tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4" status: 200 len: 1515 microversion: 2.1 time: 0.524584 Oct 30 01:37:13.246270 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2474/4945] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:37:12 2022] GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 => generated 1515 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:37:13.281778 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-c3e013ef-8fb4-4173-9459-a3e78ee825a7 req-2de925d3-610c-4b36-93ba-9412e831ef91 service nova] Creating event network-changed:5fdf7d37-8815-4dca-ba2d-d6297f9d29eb for instance a5389398-bf67-44ff-a1fb-a26e4a079fcb on n-h2-master-1 Oct 30 01:37:13.296115 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-c3e013ef-8fb4-4173-9459-a3e78ee825a7 req-2de925d3-610c-4b36-93ba-9412e831ef91 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087754 Oct 30 01:37:13.297698 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2472/4946] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:37:13.737691 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6ec3a5dd-e3d4-4389-b3c8-184c00dc2f35 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:13.739797 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6ec3a5dd-e3d4-4389-b3c8-184c00dc2f35 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:13.770633 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:13.776762 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ec3a5dd-e3d4-4389-b3c8-184c00dc2f35 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:13.780027 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ec3a5dd-e3d4-4389-b3c8-184c00dc2f35 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:13.782765 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ec3a5dd-e3d4-4389-b3c8-184c00dc2f35 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:13.787355 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ec3a5dd-e3d4-4389-b3c8-184c00dc2f35 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:13.805045 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ec3a5dd-e3d4-4389-b3c8-184c00dc2f35 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:13.808230 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ec3a5dd-e3d4-4389-b3c8-184c00dc2f35 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:13.986068 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-22198407-adcd-4469-b28d-9f0741046006 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:13.986789 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-22198407-adcd-4469-b28d-9f0741046006 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:14.004492 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-22198407-adcd-4469-b28d-9f0741046006 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:14.013208 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-22198407-adcd-4469-b28d-9f0741046006 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:14.013208 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-22198407-adcd-4469-b28d-9f0741046006 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:14.013208 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-22198407-adcd-4469-b28d-9f0741046006 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:14.013932 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-22198407-adcd-4469-b28d-9f0741046006 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:14.015404 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-22198407-adcd-4469-b28d-9f0741046006 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:14.327367 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6ec3a5dd-e3d4-4389-b3c8-184c00dc2f35 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:14.347989 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6ec3a5dd-e3d4-4389-b3c8-184c00dc2f35 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:14.350122 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6ec3a5dd-e3d4-4389-b3c8-184c00dc2f35 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:14.351628 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6ec3a5dd-e3d4-4389-b3c8-184c00dc2f35 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1406 microversion: 2.20 time: 0.621047 Oct 30 01:37:14.376831 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2475/4947] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:37:13 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1406 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:37:14.379843 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7e7ab816-dafe-49e7-9791-9ef65c64de45 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:14.380924 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7e7ab816-dafe-49e7-9791-9ef65c64de45 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:14.390131 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7e7ab816-dafe-49e7-9791-9ef65c64de45 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:14.391551 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7e7ab816-dafe-49e7-9791-9ef65c64de45 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:14.392697 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7e7ab816-dafe-49e7-9791-9ef65c64de45 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:14.394172 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7e7ab816-dafe-49e7-9791-9ef65c64de45 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:14.394885 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7e7ab816-dafe-49e7-9791-9ef65c64de45 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:14.395582 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7e7ab816-dafe-49e7-9791-9ef65c64de45 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:14.665516 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-22198407-adcd-4469-b28d-9f0741046006 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:14.679517 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-22198407-adcd-4469-b28d-9f0741046006 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:14.680997 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-22198407-adcd-4469-b28d-9f0741046006 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:14.695653 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-22198407-adcd-4469-b28d-9f0741046006 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1880 microversion: 2.42 time: 0.711527 Oct 30 01:37:14.705735 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2473/4948] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:37:13 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1880 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:37:14.773179 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7e7ab816-dafe-49e7-9791-9ef65c64de45 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:14.788961 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7e7ab816-dafe-49e7-9791-9ef65c64de45 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4" status: 200 len: 1515 microversion: 2.1 time: 0.420519 Oct 30 01:37:14.789718 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2476/4949] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:37:14 2022] GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 => generated 1515 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:37:15.385009 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-10da5c7b-9efd-4fe9-a7c5-a4801f1b6669 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:15.386191 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-10da5c7b-9efd-4fe9-a7c5-a4801f1b6669 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:15.397149 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-10da5c7b-9efd-4fe9-a7c5-a4801f1b6669 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:15.397681 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-10da5c7b-9efd-4fe9-a7c5-a4801f1b6669 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:15.400705 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-10da5c7b-9efd-4fe9-a7c5-a4801f1b6669 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:15.402047 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-10da5c7b-9efd-4fe9-a7c5-a4801f1b6669 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:15.402521 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-10da5c7b-9efd-4fe9-a7c5-a4801f1b6669 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:15.402965 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-10da5c7b-9efd-4fe9-a7c5-a4801f1b6669 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:15.722804 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f2c8bb35-a0c5-4617-8b97-65edcc256d80 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:15.725654 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f2c8bb35-a0c5-4617-8b97-65edcc256d80 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:15.744626 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f2c8bb35-a0c5-4617-8b97-65edcc256d80 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:15.746884 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f2c8bb35-a0c5-4617-8b97-65edcc256d80 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:15.756148 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f2c8bb35-a0c5-4617-8b97-65edcc256d80 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:15.756148 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f2c8bb35-a0c5-4617-8b97-65edcc256d80 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:15.756148 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f2c8bb35-a0c5-4617-8b97-65edcc256d80 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:15.756148 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f2c8bb35-a0c5-4617-8b97-65edcc256d80 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:16.042890 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-10da5c7b-9efd-4fe9-a7c5-a4801f1b6669 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:16.055425 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-10da5c7b-9efd-4fe9-a7c5-a4801f1b6669 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:16.057421 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-10da5c7b-9efd-4fe9-a7c5-a4801f1b6669 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:16.058667 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-10da5c7b-9efd-4fe9-a7c5-a4801f1b6669 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1406 microversion: 2.20 time: 0.678891 Oct 30 01:37:16.059629 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2474/4950] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:37:15 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1406 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:37:16.065133 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-96377da2-e9fb-4198-9269-6b3168b88df1 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:37:16.072571 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96377da2-e9fb-4198-9269-6b3168b88df1 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:16.073677 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96377da2-e9fb-4198-9269-6b3168b88df1 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:16.074377 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96377da2-e9fb-4198-9269-6b3168b88df1 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:16.093593 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:16.103350 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-96377da2-e9fb-4198-9269-6b3168b88df1 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Going to try to stop instance {{(pid=121102) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 30 01:37:16.305434 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f2c8bb35-a0c5-4617-8b97-65edcc256d80 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:16.330638 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-96377da2-e9fb-4198-9269-6b3168b88df1 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "POST /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b/action" status: 202 len: 0 microversion: 2.1 time: 0.268679 Oct 30 01:37:16.331234 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2475/4951] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:37:16 2022] POST /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:37:16.339589 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f2c8bb35-a0c5-4617-8b97-65edcc256d80 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:16.341798 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e9e15ae6-efd3-4593-a8e1-d71a6a6636af tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:16.342813 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f2c8bb35-a0c5-4617-8b97-65edcc256d80 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:16.343853 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e9e15ae6-efd3-4593-a8e1-d71a6a6636af tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:16.348474 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f2c8bb35-a0c5-4617-8b97-65edcc256d80 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1880 microversion: 2.42 time: 0.631289 Oct 30 01:37:16.349410 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2477/4952] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:37:15 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1880 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:37:16.372113 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9e15ae6-efd3-4593-a8e1-d71a6a6636af tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:16.373072 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fa1ebf56-2b31-48f2-b85b-49a8004db0fd tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:16.374060 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9e15ae6-efd3-4593-a8e1-d71a6a6636af tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:16.375214 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-fa1ebf56-2b31-48f2-b85b-49a8004db0fd tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:16.375681 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9e15ae6-efd3-4593-a8e1-d71a6a6636af tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:16.378232 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9e15ae6-efd3-4593-a8e1-d71a6a6636af tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:16.379288 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9e15ae6-efd3-4593-a8e1-d71a6a6636af tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:16.380268 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9e15ae6-efd3-4593-a8e1-d71a6a6636af tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:16.403644 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fa1ebf56-2b31-48f2-b85b-49a8004db0fd tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:16.404442 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fa1ebf56-2b31-48f2-b85b-49a8004db0fd tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:16.406075 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fa1ebf56-2b31-48f2-b85b-49a8004db0fd tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:16.406847 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fa1ebf56-2b31-48f2-b85b-49a8004db0fd tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:16.407327 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fa1ebf56-2b31-48f2-b85b-49a8004db0fd tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:16.407772 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fa1ebf56-2b31-48f2-b85b-49a8004db0fd tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:16.766217 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e9e15ae6-efd3-4593-a8e1-d71a6a6636af tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:16.775430 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e9e15ae6-efd3-4593-a8e1-d71a6a6636af tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4" status: 200 len: 1515 microversion: 2.1 time: 0.442832 Oct 30 01:37:16.788666 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2476/4953] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:37:16 2022] GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 => generated 1515 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:37:16.829767 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-fa1ebf56-2b31-48f2-b85b-49a8004db0fd tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:16.838853 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fa1ebf56-2b31-48f2-b85b-49a8004db0fd tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b" status: 200 len: 1723 microversion: 2.1 time: 0.487971 Oct 30 01:37:16.839442 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2478/4954] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:37:16 2022] GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b => generated 1723 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:37:17.092161 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f98e954d-24dc-4252-a261-d0fdd74a56f0 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:17.092161 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f98e954d-24dc-4252-a261-d0fdd74a56f0 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:17.107760 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f98e954d-24dc-4252-a261-d0fdd74a56f0 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:17.110551 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f98e954d-24dc-4252-a261-d0fdd74a56f0 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:17.111453 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f98e954d-24dc-4252-a261-d0fdd74a56f0 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:17.113977 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f98e954d-24dc-4252-a261-d0fdd74a56f0 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:17.115037 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f98e954d-24dc-4252-a261-d0fdd74a56f0 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:17.118192 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f98e954d-24dc-4252-a261-d0fdd74a56f0 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:17.306795 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f98e954d-24dc-4252-a261-d0fdd74a56f0 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:17.315944 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f98e954d-24dc-4252-a261-d0fdd74a56f0 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:17.317447 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f98e954d-24dc-4252-a261-d0fdd74a56f0 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:17.318581 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f98e954d-24dc-4252-a261-d0fdd74a56f0 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1406 microversion: 2.20 time: 0.236074 Oct 30 01:37:17.319155 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2477/4955] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:37:17 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1406 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:37:17.392891 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e3bca07b-c022-45ad-9e7e-4d371062779e tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:17.394678 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e3bca07b-c022-45ad-9e7e-4d371062779e tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:17.418989 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e3bca07b-c022-45ad-9e7e-4d371062779e tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:17.419524 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e3bca07b-c022-45ad-9e7e-4d371062779e tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:17.423117 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e3bca07b-c022-45ad-9e7e-4d371062779e tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:17.424100 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e3bca07b-c022-45ad-9e7e-4d371062779e tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:17.426021 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e3bca07b-c022-45ad-9e7e-4d371062779e tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:17.427226 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e3bca07b-c022-45ad-9e7e-4d371062779e tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:17.802468 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9c3db91f-5865-4f64-b439-2b45e2900222 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:17.803420 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9c3db91f-5865-4f64-b439-2b45e2900222 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:17.813606 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e3bca07b-c022-45ad-9e7e-4d371062779e tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:17.819603 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9c3db91f-5865-4f64-b439-2b45e2900222 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:17.822090 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9c3db91f-5865-4f64-b439-2b45e2900222 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:17.822809 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9c3db91f-5865-4f64-b439-2b45e2900222 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:17.828811 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e3bca07b-c022-45ad-9e7e-4d371062779e tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:17.830150 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e3bca07b-c022-45ad-9e7e-4d371062779e tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:17.839454 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e3bca07b-c022-45ad-9e7e-4d371062779e tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1880 microversion: 2.42 time: 0.460258 Oct 30 01:37:17.849671 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2479/4956] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:37:17 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1880 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:37:17.865633 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d6566f7d-3f80-4d6d-b7dd-7bf2d78aa51b tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:17.869457 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d6566f7d-3f80-4d6d-b7dd-7bf2d78aa51b tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:17.869620 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9c3db91f-5865-4f64-b439-2b45e2900222 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:17.869620 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9c3db91f-5865-4f64-b439-2b45e2900222 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.043s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:17.869620 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9c3db91f-5865-4f64-b439-2b45e2900222 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:17.879312 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d6566f7d-3f80-4d6d-b7dd-7bf2d78aa51b tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:17.879827 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d6566f7d-3f80-4d6d-b7dd-7bf2d78aa51b tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:17.880278 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d6566f7d-3f80-4d6d-b7dd-7bf2d78aa51b tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:17.881008 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d6566f7d-3f80-4d6d-b7dd-7bf2d78aa51b tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:17.885682 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d6566f7d-3f80-4d6d-b7dd-7bf2d78aa51b tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:17.886530 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d6566f7d-3f80-4d6d-b7dd-7bf2d78aa51b tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:18.359002 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d6566f7d-3f80-4d6d-b7dd-7bf2d78aa51b tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:18.375532 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d6566f7d-3f80-4d6d-b7dd-7bf2d78aa51b tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b" status: 200 len: 1723 microversion: 2.1 time: 0.513945 Oct 30 01:37:18.376174 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2480/4957] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:37:17 2022] GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b => generated 1723 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:37:18.385424 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c46d7f37-e6df-4fa4-887d-138d8336e7a2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:18.386050 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c46d7f37-e6df-4fa4-887d-138d8336e7a2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:18.405020 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c46d7f37-e6df-4fa4-887d-138d8336e7a2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:18.407675 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c46d7f37-e6df-4fa4-887d-138d8336e7a2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:18.408460 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c46d7f37-e6df-4fa4-887d-138d8336e7a2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:18.409603 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c46d7f37-e6df-4fa4-887d-138d8336e7a2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:18.410975 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c46d7f37-e6df-4fa4-887d-138d8336e7a2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:18.411709 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c46d7f37-e6df-4fa4-887d-138d8336e7a2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:18.480114 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9c3db91f-5865-4f64-b439-2b45e2900222 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:18.514794 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9c3db91f-5865-4f64-b439-2b45e2900222 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4" status: 200 len: 1515 microversion: 2.1 time: 0.714558 Oct 30 01:37:18.514794 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2478/4958] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:37:17 2022] GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 => generated 1515 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:37:18.711975 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c46d7f37-e6df-4fa4-887d-138d8336e7a2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:18.724515 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c46d7f37-e6df-4fa4-887d-138d8336e7a2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:18.726841 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c46d7f37-e6df-4fa4-887d-138d8336e7a2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:18.728778 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c46d7f37-e6df-4fa4-887d-138d8336e7a2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1406 microversion: 2.20 time: 0.346993 Oct 30 01:37:18.731020 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2481/4959] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:37:18 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1406 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:37:18.873299 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9e354e26-b9e1-4767-82b3-614dca22fd2f tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:18.875780 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9e354e26-b9e1-4767-82b3-614dca22fd2f tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:18.891180 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9e354e26-b9e1-4767-82b3-614dca22fd2f tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:18.893150 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9e354e26-b9e1-4767-82b3-614dca22fd2f tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:18.893817 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9e354e26-b9e1-4767-82b3-614dca22fd2f tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:18.894546 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9e354e26-b9e1-4767-82b3-614dca22fd2f tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:18.895056 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9e354e26-b9e1-4767-82b3-614dca22fd2f tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:18.897552 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9e354e26-b9e1-4767-82b3-614dca22fd2f tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:19.353700 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9e354e26-b9e1-4767-82b3-614dca22fd2f tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:19.378828 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9e354e26-b9e1-4767-82b3-614dca22fd2f tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:19.379612 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9e354e26-b9e1-4767-82b3-614dca22fd2f tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:19.381961 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9e354e26-b9e1-4767-82b3-614dca22fd2f tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1880 microversion: 2.42 time: 0.512769 Oct 30 01:37:19.383773 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2479/4960] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:37:18 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1880 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:37:19.420309 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b645e2f3-78ea-4132-aa1b-9d20d1632eb9 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:19.425061 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b645e2f3-78ea-4132-aa1b-9d20d1632eb9 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:19.437131 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b645e2f3-78ea-4132-aa1b-9d20d1632eb9 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:19.438010 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b645e2f3-78ea-4132-aa1b-9d20d1632eb9 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:19.438641 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b645e2f3-78ea-4132-aa1b-9d20d1632eb9 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:19.439530 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b645e2f3-78ea-4132-aa1b-9d20d1632eb9 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:19.440145 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b645e2f3-78ea-4132-aa1b-9d20d1632eb9 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:19.441044 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b645e2f3-78ea-4132-aa1b-9d20d1632eb9 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:19.537320 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6951b8dd-0960-4b05-8aae-d0d19951d1cd tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:19.539245 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6951b8dd-0960-4b05-8aae-d0d19951d1cd tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:19.548780 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6951b8dd-0960-4b05-8aae-d0d19951d1cd tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:19.551375 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6951b8dd-0960-4b05-8aae-d0d19951d1cd tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:19.552066 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6951b8dd-0960-4b05-8aae-d0d19951d1cd tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:19.554901 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6951b8dd-0960-4b05-8aae-d0d19951d1cd tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:19.555624 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6951b8dd-0960-4b05-8aae-d0d19951d1cd tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:19.557964 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6951b8dd-0960-4b05-8aae-d0d19951d1cd tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:19.761179 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b645e2f3-78ea-4132-aa1b-9d20d1632eb9 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:19.777595 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b645e2f3-78ea-4132-aa1b-9d20d1632eb9 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b" status: 200 len: 1723 microversion: 2.1 time: 0.364818 Oct 30 01:37:19.798339 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2482/4961] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:37:19 2022] GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b => generated 1723 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:37:19.835763 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4eb51463-afd1-42cb-a0ec-65abbeadacc5 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:19.836521 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6951b8dd-0960-4b05-8aae-d0d19951d1cd tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:19.836760 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4eb51463-afd1-42cb-a0ec-65abbeadacc5 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:19.845110 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6951b8dd-0960-4b05-8aae-d0d19951d1cd tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4" status: 200 len: 1515 microversion: 2.1 time: 0.312251 Oct 30 01:37:19.847369 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2480/4962] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:37:19 2022] GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 => generated 1515 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:37:19.858231 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4eb51463-afd1-42cb-a0ec-65abbeadacc5 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:19.860238 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4eb51463-afd1-42cb-a0ec-65abbeadacc5 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:19.865369 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4eb51463-afd1-42cb-a0ec-65abbeadacc5 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:19.865369 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4eb51463-afd1-42cb-a0ec-65abbeadacc5 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:19.865369 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4eb51463-afd1-42cb-a0ec-65abbeadacc5 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:19.865369 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4eb51463-afd1-42cb-a0ec-65abbeadacc5 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:20.190934 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4eb51463-afd1-42cb-a0ec-65abbeadacc5 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:20.200755 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4eb51463-afd1-42cb-a0ec-65abbeadacc5 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:20.204463 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4eb51463-afd1-42cb-a0ec-65abbeadacc5 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:20.211064 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4eb51463-afd1-42cb-a0ec-65abbeadacc5 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1406 microversion: 2.20 time: 0.410863 Oct 30 01:37:20.217257 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2483/4963] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:37:19 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1406 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:37:20.416582 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8579a040-51ee-4441-a7e5-f38513a80bbf tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:20.417136 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8579a040-51ee-4441-a7e5-f38513a80bbf tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:20.437582 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8579a040-51ee-4441-a7e5-f38513a80bbf tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:20.438099 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8579a040-51ee-4441-a7e5-f38513a80bbf tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:20.440751 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8579a040-51ee-4441-a7e5-f38513a80bbf tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:20.441787 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8579a040-51ee-4441-a7e5-f38513a80bbf tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:20.443362 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8579a040-51ee-4441-a7e5-f38513a80bbf tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:20.448848 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8579a040-51ee-4441-a7e5-f38513a80bbf tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:20.813646 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-592beff3-a5fb-4f69-a2c3-f8d50ea9f97e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:20.814279 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-592beff3-a5fb-4f69-a2c3-f8d50ea9f97e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:20.824963 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-592beff3-a5fb-4f69-a2c3-f8d50ea9f97e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:20.825486 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-592beff3-a5fb-4f69-a2c3-f8d50ea9f97e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:20.825925 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-592beff3-a5fb-4f69-a2c3-f8d50ea9f97e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:20.826942 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-592beff3-a5fb-4f69-a2c3-f8d50ea9f97e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:20.827910 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-592beff3-a5fb-4f69-a2c3-f8d50ea9f97e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:20.828565 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-592beff3-a5fb-4f69-a2c3-f8d50ea9f97e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:21.105924 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8579a040-51ee-4441-a7e5-f38513a80bbf tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:21.126604 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8579a040-51ee-4441-a7e5-f38513a80bbf tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:21.129247 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8579a040-51ee-4441-a7e5-f38513a80bbf tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:21.130846 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8579a040-51ee-4441-a7e5-f38513a80bbf tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1880 microversion: 2.42 time: 0.718730 Oct 30 01:37:21.134402 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2481/4964] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:37:20 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1880 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:37:21.152402 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4a2d9a9d-f175-4930-b07b-b5912b14d9c4 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:21.152402 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4a2d9a9d-f175-4930-b07b-b5912b14d9c4 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:21.176581 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a2d9a9d-f175-4930-b07b-b5912b14d9c4 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:21.177088 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a2d9a9d-f175-4930-b07b-b5912b14d9c4 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:21.181412 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a2d9a9d-f175-4930-b07b-b5912b14d9c4 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:21.182824 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a2d9a9d-f175-4930-b07b-b5912b14d9c4 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:21.183323 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a2d9a9d-f175-4930-b07b-b5912b14d9c4 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:21.183766 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a2d9a9d-f175-4930-b07b-b5912b14d9c4 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:21.220539 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-592beff3-a5fb-4f69-a2c3-f8d50ea9f97e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:21.233176 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-592beff3-a5fb-4f69-a2c3-f8d50ea9f97e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b" status: 200 len: 1723 microversion: 2.1 time: 0.423471 Oct 30 01:37:21.236208 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2484/4965] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:37:20 2022] GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b => generated 1723 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:37:21.250909 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4dbe9632-a812-4df4-b24f-def81a452e4f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:21.252147 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4dbe9632-a812-4df4-b24f-def81a452e4f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:21.259793 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4dbe9632-a812-4df4-b24f-def81a452e4f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:21.260714 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4dbe9632-a812-4df4-b24f-def81a452e4f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:21.263802 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4dbe9632-a812-4df4-b24f-def81a452e4f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:21.263802 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4dbe9632-a812-4df4-b24f-def81a452e4f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:21.263802 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4dbe9632-a812-4df4-b24f-def81a452e4f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:21.263802 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4dbe9632-a812-4df4-b24f-def81a452e4f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:21.559857 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4dbe9632-a812-4df4-b24f-def81a452e4f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:21.595955 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4dbe9632-a812-4df4-b24f-def81a452e4f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:21.597811 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4dbe9632-a812-4df4-b24f-def81a452e4f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:21.599250 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4dbe9632-a812-4df4-b24f-def81a452e4f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1406 microversion: 2.20 time: 0.357341 Oct 30 01:37:21.600363 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2485/4966] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:37:21 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1406 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:37:21.600965 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4a2d9a9d-f175-4930-b07b-b5912b14d9c4 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:21.606103 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-36725257-8f6a-4806-a9de-0664d4d54dd1 req-8f0f7b02-3b2c-44e2-9584-429826954b1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5389398-bf67-44ff-a1fb-a26e4a079fcb", "name": "network-vif-plugged", "status": "completed", "tag": "5fdf7d37-8815-4dca-ba2d-d6297f9d29eb"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:37:21.631432 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4a2d9a9d-f175-4930-b07b-b5912b14d9c4 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4" status: 200 len: 1515 microversion: 2.1 time: 0.491120 Oct 30 01:37:21.633513 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-36725257-8f6a-4806-a9de-0664d4d54dd1 req-8f0f7b02-3b2c-44e2-9584-429826954b1d service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:21.633936 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2482/4967] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:37:21 2022] GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 => generated 1515 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:37:21.635685 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-36725257-8f6a-4806-a9de-0664d4d54dd1 req-8f0f7b02-3b2c-44e2-9584-429826954b1d service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:21.636303 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-36725257-8f6a-4806-a9de-0664d4d54dd1 req-8f0f7b02-3b2c-44e2-9584-429826954b1d service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:21.665112 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-36725257-8f6a-4806-a9de-0664d4d54dd1 req-8f0f7b02-3b2c-44e2-9584-429826954b1d service nova] Creating event network-vif-plugged:5fdf7d37-8815-4dca-ba2d-d6297f9d29eb for instance a5389398-bf67-44ff-a1fb-a26e4a079fcb on n-h2-master-1 Oct 30 01:37:21.678370 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-36725257-8f6a-4806-a9de-0664d4d54dd1 req-8f0f7b02-3b2c-44e2-9584-429826954b1d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076288 Oct 30 01:37:21.679282 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2486/4968] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:37:22.162647 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8e473fce-07fd-498c-bc67-ec0f22e53575 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:22.163316 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8e473fce-07fd-498c-bc67-ec0f22e53575 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:22.174468 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8e473fce-07fd-498c-bc67-ec0f22e53575 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:22.179802 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8e473fce-07fd-498c-bc67-ec0f22e53575 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:22.179802 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8e473fce-07fd-498c-bc67-ec0f22e53575 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:22.179802 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8e473fce-07fd-498c-bc67-ec0f22e53575 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:22.179802 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8e473fce-07fd-498c-bc67-ec0f22e53575 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:22.183460 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8e473fce-07fd-498c-bc67-ec0f22e53575 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:22.260027 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6cd55da1-5b5d-4c09-b108-1bc6b78d3a4e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:22.260898 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6cd55da1-5b5d-4c09-b108-1bc6b78d3a4e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:22.268367 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6cd55da1-5b5d-4c09-b108-1bc6b78d3a4e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:22.269111 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6cd55da1-5b5d-4c09-b108-1bc6b78d3a4e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:22.271530 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6cd55da1-5b5d-4c09-b108-1bc6b78d3a4e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:22.271530 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6cd55da1-5b5d-4c09-b108-1bc6b78d3a4e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:22.271530 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6cd55da1-5b5d-4c09-b108-1bc6b78d3a4e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:22.271530 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6cd55da1-5b5d-4c09-b108-1bc6b78d3a4e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:22.571259 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6cd55da1-5b5d-4c09-b108-1bc6b78d3a4e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:22.581617 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6cd55da1-5b5d-4c09-b108-1bc6b78d3a4e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b" status: 200 len: 1723 microversion: 2.1 time: 0.326761 Oct 30 01:37:22.594033 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2487/4969] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:37:22 2022] GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b => generated 1723 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:37:22.632663 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-df032d8b-1252-4bd8-ac0c-9da4db169fb8 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:22.632855 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8e473fce-07fd-498c-bc67-ec0f22e53575 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:22.634569 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-df032d8b-1252-4bd8-ac0c-9da4db169fb8 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:22.643047 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df032d8b-1252-4bd8-ac0c-9da4db169fb8 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:22.643047 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df032d8b-1252-4bd8-ac0c-9da4db169fb8 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:22.643047 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df032d8b-1252-4bd8-ac0c-9da4db169fb8 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:22.644120 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df032d8b-1252-4bd8-ac0c-9da4db169fb8 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:22.645071 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df032d8b-1252-4bd8-ac0c-9da4db169fb8 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:22.645792 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df032d8b-1252-4bd8-ac0c-9da4db169fb8 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:22.656252 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8e473fce-07fd-498c-bc67-ec0f22e53575 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:22.661066 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8e473fce-07fd-498c-bc67-ec0f22e53575 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:22.666119 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8e473fce-07fd-498c-bc67-ec0f22e53575 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1880 microversion: 2.42 time: 0.506341 Oct 30 01:37:22.671231 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2483/4970] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:37:22 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1880 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:37:22.687123 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0f3320b3-cc49-4005-acff-05e43ce20046 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:22.689171 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0f3320b3-cc49-4005-acff-05e43ce20046 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:22.725973 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0f3320b3-cc49-4005-acff-05e43ce20046 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:22.727079 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0f3320b3-cc49-4005-acff-05e43ce20046 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:22.727525 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0f3320b3-cc49-4005-acff-05e43ce20046 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:22.728719 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0f3320b3-cc49-4005-acff-05e43ce20046 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:22.730750 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0f3320b3-cc49-4005-acff-05e43ce20046 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:22.731197 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0f3320b3-cc49-4005-acff-05e43ce20046 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:22.939497 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-df032d8b-1252-4bd8-ac0c-9da4db169fb8 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:22.951203 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-df032d8b-1252-4bd8-ac0c-9da4db169fb8 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:22.954243 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-df032d8b-1252-4bd8-ac0c-9da4db169fb8 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:22.956141 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-df032d8b-1252-4bd8-ac0c-9da4db169fb8 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1406 microversion: 2.20 time: 0.331531 Oct 30 01:37:22.957046 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2488/4971] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:37:22 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1406 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:37:23.003222 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0f3320b3-cc49-4005-acff-05e43ce20046 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:23.012599 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0f3320b3-cc49-4005-acff-05e43ce20046 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4" status: 200 len: 1515 microversion: 2.1 time: 0.340039 Oct 30 01:37:23.022756 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2484/4972] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:37:22 2022] GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 => generated 1515 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:37:23.621699 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e4458462-6b15-4fa2-a238-9e793ae12e93 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:23.622387 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e4458462-6b15-4fa2-a238-9e793ae12e93 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:23.629863 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e4458462-6b15-4fa2-a238-9e793ae12e93 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:23.630372 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e4458462-6b15-4fa2-a238-9e793ae12e93 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:23.630819 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e4458462-6b15-4fa2-a238-9e793ae12e93 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:23.631602 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e4458462-6b15-4fa2-a238-9e793ae12e93 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:23.632058 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e4458462-6b15-4fa2-a238-9e793ae12e93 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:23.632677 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e4458462-6b15-4fa2-a238-9e793ae12e93 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:23.649921 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=100 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:23.706885 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a680bc41-543e-4df7-b19c-997f1a28b382 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:23.707521 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a680bc41-543e-4df7-b19c-997f1a28b382 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:23.730270 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a680bc41-543e-4df7-b19c-997f1a28b382 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:23.739020 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a680bc41-543e-4df7-b19c-997f1a28b382 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:23.739756 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a680bc41-543e-4df7-b19c-997f1a28b382 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:23.741485 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a680bc41-543e-4df7-b19c-997f1a28b382 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:23.745799 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a680bc41-543e-4df7-b19c-997f1a28b382 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:23.746437 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a680bc41-543e-4df7-b19c-997f1a28b382 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:23.889468 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e4458462-6b15-4fa2-a238-9e793ae12e93 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:23.910729 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e4458462-6b15-4fa2-a238-9e793ae12e93 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b" status: 200 len: 1723 microversion: 2.1 time: 0.293305 Oct 30 01:37:23.911897 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2489/4973] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:37:23 2022] GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b => generated 1723 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:37:23.983266 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1b2cd8c4-c482-4e0f-847d-29ea845a4b04 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:23.983882 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1b2cd8c4-c482-4e0f-847d-29ea845a4b04 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:23.996322 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1b2cd8c4-c482-4e0f-847d-29ea845a4b04 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:23.996747 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1b2cd8c4-c482-4e0f-847d-29ea845a4b04 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:23.997193 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1b2cd8c4-c482-4e0f-847d-29ea845a4b04 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:23.997955 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1b2cd8c4-c482-4e0f-847d-29ea845a4b04 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:23.998408 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1b2cd8c4-c482-4e0f-847d-29ea845a4b04 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:24.005298 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1b2cd8c4-c482-4e0f-847d-29ea845a4b04 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:24.711979 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1b2cd8c4-c482-4e0f-847d-29ea845a4b04 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:24.718513 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a680bc41-543e-4df7-b19c-997f1a28b382 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:24.723880 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1b2cd8c4-c482-4e0f-847d-29ea845a4b04 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:24.728496 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1b2cd8c4-c482-4e0f-847d-29ea845a4b04 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:24.732352 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1b2cd8c4-c482-4e0f-847d-29ea845a4b04 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1597 microversion: 2.20 time: 0.753503 Oct 30 01:37:24.733097 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2490/4974] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:37:23 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1597 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:37:24.734350 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a680bc41-543e-4df7-b19c-997f1a28b382 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:24.736542 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a680bc41-543e-4df7-b19c-997f1a28b382 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:24.738037 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a680bc41-543e-4df7-b19c-997f1a28b382 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1880 microversion: 2.42 time: 1.046655 Oct 30 01:37:24.741362 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-130e6e95-16cd-47c9-a3f2-f2f7c0a9a2f0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:24.748914 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-130e6e95-16cd-47c9-a3f2-f2f7c0a9a2f0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:24.756057 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-130e6e95-16cd-47c9-a3f2-f2f7c0a9a2f0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:24.757802 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2485/4975] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:37:23 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1880 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:37:24.758682 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-130e6e95-16cd-47c9-a3f2-f2f7c0a9a2f0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:24.759134 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-130e6e95-16cd-47c9-a3f2-f2f7c0a9a2f0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:24.760077 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-130e6e95-16cd-47c9-a3f2-f2f7c0a9a2f0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:24.760671 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-130e6e95-16cd-47c9-a3f2-f2f7c0a9a2f0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:24.761102 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-130e6e95-16cd-47c9-a3f2-f2f7c0a9a2f0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:24.763087 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-04019d3b-ed48-407f-8b37-e4f23ef7b01e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:24.763681 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-04019d3b-ed48-407f-8b37-e4f23ef7b01e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:24.770639 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04019d3b-ed48-407f-8b37-e4f23ef7b01e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:24.771558 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04019d3b-ed48-407f-8b37-e4f23ef7b01e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:24.772191 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04019d3b-ed48-407f-8b37-e4f23ef7b01e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:24.774693 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04019d3b-ed48-407f-8b37-e4f23ef7b01e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:24.775247 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04019d3b-ed48-407f-8b37-e4f23ef7b01e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:24.776234 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04019d3b-ed48-407f-8b37-e4f23ef7b01e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:24.966100 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-04019d3b-ed48-407f-8b37-e4f23ef7b01e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.206478 Oct 30 01:37:24.966811 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2486/4976] 10.222.0.13 () {60 vars in 1316 bytes} [Sun Oct 30 01:37:24 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb/os-interface => generated 284 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:37:24.978822 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e9fdc9bb-ee06-459e-8255-2b282a42be8a tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:24.992646 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e9fdc9bb-ee06-459e-8255-2b282a42be8a tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:25.014348 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9fdc9bb-ee06-459e-8255-2b282a42be8a tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:25.016775 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9fdc9bb-ee06-459e-8255-2b282a42be8a tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:25.019141 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9fdc9bb-ee06-459e-8255-2b282a42be8a tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:25.020975 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9fdc9bb-ee06-459e-8255-2b282a42be8a tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:25.023033 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9fdc9bb-ee06-459e-8255-2b282a42be8a tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:25.023590 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9fdc9bb-ee06-459e-8255-2b282a42be8a tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:25.296124 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-130e6e95-16cd-47c9-a3f2-f2f7c0a9a2f0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:25.305917 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-130e6e95-16cd-47c9-a3f2-f2f7c0a9a2f0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4" status: 200 len: 1515 microversion: 2.1 time: 0.571121 Oct 30 01:37:25.306908 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2491/4977] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:37:24 2022] GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 => generated 1515 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:37:25.416927 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e9fdc9bb-ee06-459e-8255-2b282a42be8a tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:25.426568 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e9fdc9bb-ee06-459e-8255-2b282a42be8a tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b" status: 200 len: 1723 microversion: 2.1 time: 0.458453 Oct 30 01:37:25.437576 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2487/4978] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:37:24 2022] GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b => generated 1723 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:37:25.771244 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9542e09b-2925-406f-a7c3-0aff955ce5c2 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:25.771938 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9542e09b-2925-406f-a7c3-0aff955ce5c2 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:25.780263 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9542e09b-2925-406f-a7c3-0aff955ce5c2 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:25.780904 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9542e09b-2925-406f-a7c3-0aff955ce5c2 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:25.781693 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9542e09b-2925-406f-a7c3-0aff955ce5c2 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:25.782517 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9542e09b-2925-406f-a7c3-0aff955ce5c2 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:25.783074 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9542e09b-2925-406f-a7c3-0aff955ce5c2 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:25.783742 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9542e09b-2925-406f-a7c3-0aff955ce5c2 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:26.170733 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9542e09b-2925-406f-a7c3-0aff955ce5c2 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:26.186453 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9542e09b-2925-406f-a7c3-0aff955ce5c2 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:26.192187 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9542e09b-2925-406f-a7c3-0aff955ce5c2 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:26.195621 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9542e09b-2925-406f-a7c3-0aff955ce5c2 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1880 microversion: 2.42 time: 0.434968 Oct 30 01:37:26.198703 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2492/4979] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:37:25 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1880 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:37:26.335158 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b6c19576-646c-43d4-b7d8-d317427eed47 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:26.335158 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b6c19576-646c-43d4-b7d8-d317427eed47 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:26.343600 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b6c19576-646c-43d4-b7d8-d317427eed47 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:26.344127 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b6c19576-646c-43d4-b7d8-d317427eed47 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:26.344538 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b6c19576-646c-43d4-b7d8-d317427eed47 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:26.345259 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b6c19576-646c-43d4-b7d8-d317427eed47 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:26.345745 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b6c19576-646c-43d4-b7d8-d317427eed47 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:26.349585 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b6c19576-646c-43d4-b7d8-d317427eed47 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:26.455428 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e1636565-7cc2-42d0-8daf-7c4afca256e4 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:26.463864 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e1636565-7cc2-42d0-8daf-7c4afca256e4 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:26.483822 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e1636565-7cc2-42d0-8daf-7c4afca256e4 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:26.484636 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e1636565-7cc2-42d0-8daf-7c4afca256e4 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:26.485245 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e1636565-7cc2-42d0-8daf-7c4afca256e4 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:26.486152 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e1636565-7cc2-42d0-8daf-7c4afca256e4 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:26.486776 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e1636565-7cc2-42d0-8daf-7c4afca256e4 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:26.487369 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e1636565-7cc2-42d0-8daf-7c4afca256e4 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:26.685635 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b6c19576-646c-43d4-b7d8-d317427eed47 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:26.697517 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b6c19576-646c-43d4-b7d8-d317427eed47 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4" status: 200 len: 1515 microversion: 2.1 time: 0.368521 Oct 30 01:37:26.700081 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2488/4980] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:37:26 2022] GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 => generated 1515 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:37:26.962317 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e1636565-7cc2-42d0-8daf-7c4afca256e4 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:26.993609 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e1636565-7cc2-42d0-8daf-7c4afca256e4 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b" status: 200 len: 1723 microversion: 2.1 time: 0.542253 Oct 30 01:37:27.001649 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2493/4981] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:37:26 2022] GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b => generated 1723 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:37:27.228666 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-371f0137-0a3a-4e3f-bc60-ea46c49400d6 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:27.230466 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-371f0137-0a3a-4e3f-bc60-ea46c49400d6 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:27.240857 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-371f0137-0a3a-4e3f-bc60-ea46c49400d6 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:27.245926 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-371f0137-0a3a-4e3f-bc60-ea46c49400d6 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:27.245926 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-371f0137-0a3a-4e3f-bc60-ea46c49400d6 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:27.245926 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-371f0137-0a3a-4e3f-bc60-ea46c49400d6 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:27.252584 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-371f0137-0a3a-4e3f-bc60-ea46c49400d6 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:27.253967 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-371f0137-0a3a-4e3f-bc60-ea46c49400d6 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:27.309219 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-e12cb763-4fde-4b14-beef-0ddfb211b39e req-e4c09453-7b3c-4142-bac1-5c32c0d61091 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5389398-bf67-44ff-a1fb-a26e4a079fcb", "tag": "5fdf7d37-8815-4dca-ba2d-d6297f9d29eb"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:37:27.334089 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e12cb763-4fde-4b14-beef-0ddfb211b39e req-e4c09453-7b3c-4142-bac1-5c32c0d61091 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:27.334652 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e12cb763-4fde-4b14-beef-0ddfb211b39e req-e4c09453-7b3c-4142-bac1-5c32c0d61091 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:27.344125 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e12cb763-4fde-4b14-beef-0ddfb211b39e req-e4c09453-7b3c-4142-bac1-5c32c0d61091 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:27.366778 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-e12cb763-4fde-4b14-beef-0ddfb211b39e req-e4c09453-7b3c-4142-bac1-5c32c0d61091 service nova] Creating event network-changed:5fdf7d37-8815-4dca-ba2d-d6297f9d29eb for instance a5389398-bf67-44ff-a1fb-a26e4a079fcb on n-h2-master-1 Oct 30 01:37:27.377643 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-e12cb763-4fde-4b14-beef-0ddfb211b39e req-e4c09453-7b3c-4142-bac1-5c32c0d61091 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071300 Oct 30 01:37:27.379036 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2494/4982] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:37:27.728714 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-11afc17b-bc9a-40f2-9ec0-8c45dc05d668 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:27.730173 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-11afc17b-bc9a-40f2-9ec0-8c45dc05d668 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:27.743873 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-11afc17b-bc9a-40f2-9ec0-8c45dc05d668 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:27.747574 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-11afc17b-bc9a-40f2-9ec0-8c45dc05d668 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:27.749016 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-11afc17b-bc9a-40f2-9ec0-8c45dc05d668 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:27.752733 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-11afc17b-bc9a-40f2-9ec0-8c45dc05d668 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:27.754865 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-11afc17b-bc9a-40f2-9ec0-8c45dc05d668 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:27.758040 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-11afc17b-bc9a-40f2-9ec0-8c45dc05d668 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:28.098262 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-371f0137-0a3a-4e3f-bc60-ea46c49400d6 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:28.109222 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-371f0137-0a3a-4e3f-bc60-ea46c49400d6 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:28.115701 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-371f0137-0a3a-4e3f-bc60-ea46c49400d6 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:28.116950 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-371f0137-0a3a-4e3f-bc60-ea46c49400d6 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1880 microversion: 2.42 time: 0.893151 Oct 30 01:37:28.117817 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2489/4983] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:37:27 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1880 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:37:28.143899 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a47c2b17-3a82-4003-9d2a-1341930dddfb tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:28.144785 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a47c2b17-3a82-4003-9d2a-1341930dddfb tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:28.169603 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a47c2b17-3a82-4003-9d2a-1341930dddfb tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:28.170109 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a47c2b17-3a82-4003-9d2a-1341930dddfb tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:28.176571 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a47c2b17-3a82-4003-9d2a-1341930dddfb tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:28.176571 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a47c2b17-3a82-4003-9d2a-1341930dddfb tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:28.176571 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a47c2b17-3a82-4003-9d2a-1341930dddfb tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:28.176571 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a47c2b17-3a82-4003-9d2a-1341930dddfb tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:28.356318 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-11afc17b-bc9a-40f2-9ec0-8c45dc05d668 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:28.381634 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-11afc17b-bc9a-40f2-9ec0-8c45dc05d668 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4" status: 200 len: 1515 microversion: 2.1 time: 0.657053 Oct 30 01:37:28.386017 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2495/4984] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:37:27 2022] GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 => generated 1515 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:37:29.151878 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-763ce9aa-d2bd-4eaa-8924-557dc649eda3 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:29.152500 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-763ce9aa-d2bd-4eaa-8924-557dc649eda3 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:29.164263 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-763ce9aa-d2bd-4eaa-8924-557dc649eda3 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:29.172821 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-763ce9aa-d2bd-4eaa-8924-557dc649eda3 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:29.173631 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-763ce9aa-d2bd-4eaa-8924-557dc649eda3 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:29.174568 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-763ce9aa-d2bd-4eaa-8924-557dc649eda3 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:29.175212 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-763ce9aa-d2bd-4eaa-8924-557dc649eda3 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:29.175957 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-763ce9aa-d2bd-4eaa-8924-557dc649eda3 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:29.237745 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a47c2b17-3a82-4003-9d2a-1341930dddfb tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:29.270146 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a47c2b17-3a82-4003-9d2a-1341930dddfb tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b" status: 200 len: 1723 microversion: 2.1 time: 1.151131 Oct 30 01:37:29.270973 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2490/4985] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:37:28 2022] GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b => generated 1723 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:37:29.413479 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-67752d41-7f57-4b20-8875-d844fe0ac9bd tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:29.414234 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-67752d41-7f57-4b20-8875-d844fe0ac9bd tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:29.428310 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67752d41-7f57-4b20-8875-d844fe0ac9bd tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:29.430294 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67752d41-7f57-4b20-8875-d844fe0ac9bd tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:29.446147 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67752d41-7f57-4b20-8875-d844fe0ac9bd tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:29.448769 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67752d41-7f57-4b20-8875-d844fe0ac9bd tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:29.448769 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67752d41-7f57-4b20-8875-d844fe0ac9bd tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:29.448769 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67752d41-7f57-4b20-8875-d844fe0ac9bd tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:29.489644 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:30.081398 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-763ce9aa-d2bd-4eaa-8924-557dc649eda3 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:30.100361 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-763ce9aa-d2bd-4eaa-8924-557dc649eda3 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:30.102129 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-763ce9aa-d2bd-4eaa-8924-557dc649eda3 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:30.103508 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-763ce9aa-d2bd-4eaa-8924-557dc649eda3 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1880 microversion: 2.42 time: 0.956913 Oct 30 01:37:30.109278 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2496/4986] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:37:29 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1880 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:37:30.296498 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6151dfd1-a6ab-430d-b71b-c050d80a0420 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:30.297133 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6151dfd1-a6ab-430d-b71b-c050d80a0420 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:30.328193 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6151dfd1-a6ab-430d-b71b-c050d80a0420 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:30.328726 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6151dfd1-a6ab-430d-b71b-c050d80a0420 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:30.329179 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6151dfd1-a6ab-430d-b71b-c050d80a0420 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:30.329951 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6151dfd1-a6ab-430d-b71b-c050d80a0420 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:30.330494 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6151dfd1-a6ab-430d-b71b-c050d80a0420 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:30.336354 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6151dfd1-a6ab-430d-b71b-c050d80a0420 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:30.579900 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-67752d41-7f57-4b20-8875-d844fe0ac9bd tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:30.595882 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-67752d41-7f57-4b20-8875-d844fe0ac9bd tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4" status: 200 len: 1515 microversion: 2.1 time: 1.185658 Oct 30 01:37:30.599865 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2491/4987] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:37:29 2022] GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 => generated 1515 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:37:30.695300 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6151dfd1-a6ab-430d-b71b-c050d80a0420 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:30.714131 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6151dfd1-a6ab-430d-b71b-c050d80a0420 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b" status: 200 len: 1723 microversion: 2.1 time: 0.421305 Oct 30 01:37:30.725942 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2497/4988] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:37:30 2022] GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b => generated 1723 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:37:31.146415 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b709acdf-fcd5-4316-979d-81f8e33f0a49 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:31.148873 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b709acdf-fcd5-4316-979d-81f8e33f0a49 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:31.164989 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b709acdf-fcd5-4316-979d-81f8e33f0a49 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:31.165981 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b709acdf-fcd5-4316-979d-81f8e33f0a49 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:31.170149 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b709acdf-fcd5-4316-979d-81f8e33f0a49 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:31.170149 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b709acdf-fcd5-4316-979d-81f8e33f0a49 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:31.170859 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b709acdf-fcd5-4316-979d-81f8e33f0a49 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:31.171957 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b709acdf-fcd5-4316-979d-81f8e33f0a49 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:31.567070 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b709acdf-fcd5-4316-979d-81f8e33f0a49 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:31.583358 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b709acdf-fcd5-4316-979d-81f8e33f0a49 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:31.584989 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b709acdf-fcd5-4316-979d-81f8e33f0a49 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:31.586525 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b709acdf-fcd5-4316-979d-81f8e33f0a49 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1880 microversion: 2.42 time: 0.452853 Oct 30 01:37:31.605966 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2492/4989] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:37:31 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1880 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:37:31.625062 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-12dba8cb-a88d-4fe7-a583-7af4c89b4a18 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:31.626057 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-12dba8cb-a88d-4fe7-a583-7af4c89b4a18 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:31.664740 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-12dba8cb-a88d-4fe7-a583-7af4c89b4a18 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:31.665931 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-12dba8cb-a88d-4fe7-a583-7af4c89b4a18 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:31.666632 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-12dba8cb-a88d-4fe7-a583-7af4c89b4a18 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:31.667596 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-12dba8cb-a88d-4fe7-a583-7af4c89b4a18 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:31.668301 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-12dba8cb-a88d-4fe7-a583-7af4c89b4a18 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:31.668941 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-12dba8cb-a88d-4fe7-a583-7af4c89b4a18 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:31.739041 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-41897e9f-53d8-463b-8fac-33fea84567ae tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:31.740002 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-41897e9f-53d8-463b-8fac-33fea84567ae tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:31.750898 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-41897e9f-53d8-463b-8fac-33fea84567ae tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:31.751733 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-41897e9f-53d8-463b-8fac-33fea84567ae tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:31.752360 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-41897e9f-53d8-463b-8fac-33fea84567ae tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:31.753484 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-41897e9f-53d8-463b-8fac-33fea84567ae tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:31.755031 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-41897e9f-53d8-463b-8fac-33fea84567ae tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:31.759680 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-41897e9f-53d8-463b-8fac-33fea84567ae tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:31.976412 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-12dba8cb-a88d-4fe7-a583-7af4c89b4a18 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:31.990562 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-12dba8cb-a88d-4fe7-a583-7af4c89b4a18 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4" status: 200 len: 1515 microversion: 2.1 time: 0.368722 Oct 30 01:37:32.006046 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2498/4990] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:37:31 2022] GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 => generated 1515 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:37:32.024293 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-41897e9f-53d8-463b-8fac-33fea84567ae tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:32.034713 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-41897e9f-53d8-463b-8fac-33fea84567ae tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b" status: 200 len: 1723 microversion: 2.1 time: 0.299111 Oct 30 01:37:32.035232 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2493/4991] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:37:31 2022] GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b => generated 1723 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:37:32.628328 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d62ec421-ef16-44b7-9737-6379f483670c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:32.629049 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d62ec421-ef16-44b7-9737-6379f483670c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:32.645026 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d62ec421-ef16-44b7-9737-6379f483670c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:32.646897 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d62ec421-ef16-44b7-9737-6379f483670c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:32.648341 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d62ec421-ef16-44b7-9737-6379f483670c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:32.650001 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d62ec421-ef16-44b7-9737-6379f483670c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:32.650473 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d62ec421-ef16-44b7-9737-6379f483670c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:32.653848 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d62ec421-ef16-44b7-9737-6379f483670c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:33.021392 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e0ae4713-beb7-4aae-b40f-f942032b8945 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:33.022197 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e0ae4713-beb7-4aae-b40f-f942032b8945 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:33.037954 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e0ae4713-beb7-4aae-b40f-f942032b8945 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:33.038750 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e0ae4713-beb7-4aae-b40f-f942032b8945 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:33.039581 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e0ae4713-beb7-4aae-b40f-f942032b8945 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:33.043549 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e0ae4713-beb7-4aae-b40f-f942032b8945 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:33.044407 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e0ae4713-beb7-4aae-b40f-f942032b8945 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:33.045422 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e0ae4713-beb7-4aae-b40f-f942032b8945 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:33.097605 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d62ec421-ef16-44b7-9737-6379f483670c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:33.120889 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d62ec421-ef16-44b7-9737-6379f483670c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:33.122581 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d62ec421-ef16-44b7-9737-6379f483670c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:33.123833 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d62ec421-ef16-44b7-9737-6379f483670c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1880 microversion: 2.42 time: 0.503745 Oct 30 01:37:33.150463 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2499/4992] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:37:32 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1880 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:37:33.183215 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a55dabcc-f66f-44bb-86a3-b02032a689d3 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:33.184131 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a55dabcc-f66f-44bb-86a3-b02032a689d3 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:33.252614 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a55dabcc-f66f-44bb-86a3-b02032a689d3 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:33.257247 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a55dabcc-f66f-44bb-86a3-b02032a689d3 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:33.262043 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a55dabcc-f66f-44bb-86a3-b02032a689d3 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:33.262043 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a55dabcc-f66f-44bb-86a3-b02032a689d3 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:33.262043 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a55dabcc-f66f-44bb-86a3-b02032a689d3 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:33.263070 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a55dabcc-f66f-44bb-86a3-b02032a689d3 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:33.744677 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e0ae4713-beb7-4aae-b40f-f942032b8945 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:33.752836 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e0ae4713-beb7-4aae-b40f-f942032b8945 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4" status: 200 len: 1515 microversion: 2.1 time: 0.737920 Oct 30 01:37:33.771989 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2494/4993] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:37:33 2022] GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 => generated 1515 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:37:33.868966 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a55dabcc-f66f-44bb-86a3-b02032a689d3 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:33.892394 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a55dabcc-f66f-44bb-86a3-b02032a689d3 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b" status: 200 len: 1723 microversion: 2.1 time: 0.740355 Oct 30 01:37:33.893949 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2500/4994] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:37:33 2022] GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b => generated 1723 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:37:34.159747 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-92516a32-afe4-43a2-9020-f2f4bc775d07 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:34.161220 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-92516a32-afe4-43a2-9020-f2f4bc775d07 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:34.176988 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=70 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:34.181581 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92516a32-afe4-43a2-9020-f2f4bc775d07 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:34.185394 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92516a32-afe4-43a2-9020-f2f4bc775d07 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:34.186198 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92516a32-afe4-43a2-9020-f2f4bc775d07 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:34.188724 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92516a32-afe4-43a2-9020-f2f4bc775d07 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:34.189880 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92516a32-afe4-43a2-9020-f2f4bc775d07 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:34.191297 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92516a32-afe4-43a2-9020-f2f4bc775d07 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:34.730254 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-92516a32-afe4-43a2-9020-f2f4bc775d07 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:34.743848 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-92516a32-afe4-43a2-9020-f2f4bc775d07 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:34.748771 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-92516a32-afe4-43a2-9020-f2f4bc775d07 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:34.754902 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-92516a32-afe4-43a2-9020-f2f4bc775d07 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1880 microversion: 2.42 time: 0.597148 Oct 30 01:37:34.757054 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2495/4995] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:37:34 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1880 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:37:34.781578 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f2974184-5eba-4bc9-a9b8-b5150c31914e tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:34.782518 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f2974184-5eba-4bc9-a9b8-b5150c31914e tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:34.796450 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f2974184-5eba-4bc9-a9b8-b5150c31914e tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:34.797276 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f2974184-5eba-4bc9-a9b8-b5150c31914e tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:34.798014 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f2974184-5eba-4bc9-a9b8-b5150c31914e tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:34.798969 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f2974184-5eba-4bc9-a9b8-b5150c31914e tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:34.799579 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f2974184-5eba-4bc9-a9b8-b5150c31914e tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:34.800789 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f2974184-5eba-4bc9-a9b8-b5150c31914e tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:34.919003 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-44f8a231-3aaf-4fa7-9663-4129b232b72f tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:34.920042 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-44f8a231-3aaf-4fa7-9663-4129b232b72f tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:34.927370 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44f8a231-3aaf-4fa7-9663-4129b232b72f tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:34.928137 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44f8a231-3aaf-4fa7-9663-4129b232b72f tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:34.928465 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44f8a231-3aaf-4fa7-9663-4129b232b72f tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:34.934879 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44f8a231-3aaf-4fa7-9663-4129b232b72f tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:34.935578 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44f8a231-3aaf-4fa7-9663-4129b232b72f tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:34.948169 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44f8a231-3aaf-4fa7-9663-4129b232b72f tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:35.235221 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-44f8a231-3aaf-4fa7-9663-4129b232b72f tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:35.252465 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-44f8a231-3aaf-4fa7-9663-4129b232b72f tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b" status: 200 len: 1723 microversion: 2.1 time: 0.340293 Oct 30 01:37:35.254573 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f2974184-5eba-4bc9-a9b8-b5150c31914e tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:35.270499 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f2974184-5eba-4bc9-a9b8-b5150c31914e tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4" status: 200 len: 1515 microversion: 2.1 time: 0.493055 Oct 30 01:37:35.272706 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2501/4997] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:37:34 2022] GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 => generated 1515 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:37:35.274214 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2496/4996] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:37:34 2022] GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b => generated 1723 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:37:35.798881 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-aa4958b5-749b-4bbc-88b3-a10a73fbd4a6 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:35.801172 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-aa4958b5-749b-4bbc-88b3-a10a73fbd4a6 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:35.822930 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa4958b5-749b-4bbc-88b3-a10a73fbd4a6 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:35.829289 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa4958b5-749b-4bbc-88b3-a10a73fbd4a6 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:35.830889 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa4958b5-749b-4bbc-88b3-a10a73fbd4a6 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:35.832347 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa4958b5-749b-4bbc-88b3-a10a73fbd4a6 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:35.833581 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa4958b5-749b-4bbc-88b3-a10a73fbd4a6 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:35.835294 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa4958b5-749b-4bbc-88b3-a10a73fbd4a6 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:36.191056 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-aa4958b5-749b-4bbc-88b3-a10a73fbd4a6 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:36.209452 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-aa4958b5-749b-4bbc-88b3-a10a73fbd4a6 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:36.212259 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-aa4958b5-749b-4bbc-88b3-a10a73fbd4a6 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:36.214553 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-aa4958b5-749b-4bbc-88b3-a10a73fbd4a6 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1880 microversion: 2.42 time: 0.434298 Oct 30 01:37:36.240020 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2502/4998] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:37:35 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1880 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:37:36.278658 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ed44e775-3393-4363-81b0-82e57a4d6f36 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:36.279274 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ed44e775-3393-4363-81b0-82e57a4d6f36 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:36.294504 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed44e775-3393-4363-81b0-82e57a4d6f36 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:36.297936 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed44e775-3393-4363-81b0-82e57a4d6f36 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:36.298620 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed44e775-3393-4363-81b0-82e57a4d6f36 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:36.300784 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed44e775-3393-4363-81b0-82e57a4d6f36 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:36.301272 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed44e775-3393-4363-81b0-82e57a4d6f36 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:36.302906 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-41f03f0a-f84e-4062-a552-d6daac2de561 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:36.303534 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-41f03f0a-f84e-4062-a552-d6daac2de561 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:36.305506 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed44e775-3393-4363-81b0-82e57a4d6f36 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:36.315673 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-41f03f0a-f84e-4062-a552-d6daac2de561 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:36.316184 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-41f03f0a-f84e-4062-a552-d6daac2de561 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:36.316624 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-41f03f0a-f84e-4062-a552-d6daac2de561 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:36.317373 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-41f03f0a-f84e-4062-a552-d6daac2de561 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:36.317836 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-41f03f0a-f84e-4062-a552-d6daac2de561 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:36.318268 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-41f03f0a-f84e-4062-a552-d6daac2de561 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:36.709588 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-41f03f0a-f84e-4062-a552-d6daac2de561 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:36.716754 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ed44e775-3393-4363-81b0-82e57a4d6f36 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:36.734509 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-41f03f0a-f84e-4062-a552-d6daac2de561 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4" status: 200 len: 1521 microversion: 2.1 time: 0.436042 Oct 30 01:37:36.736557 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ed44e775-3393-4363-81b0-82e57a4d6f36 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b" status: 200 len: 1723 microversion: 2.1 time: 0.462320 Oct 30 01:37:36.750217 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2503/4999] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:37:36 2022] GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 => generated 1521 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:37:36.750539 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2497/5000] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:37:36 2022] GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b => generated 1723 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:37:37.246351 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3ecfae77-7368-4312-a97b-d9e3b4987f18 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:37.246676 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3ecfae77-7368-4312-a97b-d9e3b4987f18 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:37.265584 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3ecfae77-7368-4312-a97b-d9e3b4987f18 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:37.266086 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3ecfae77-7368-4312-a97b-d9e3b4987f18 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:37.269608 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3ecfae77-7368-4312-a97b-d9e3b4987f18 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:37.269608 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3ecfae77-7368-4312-a97b-d9e3b4987f18 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:37.269608 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3ecfae77-7368-4312-a97b-d9e3b4987f18 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:37.269608 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3ecfae77-7368-4312-a97b-d9e3b4987f18 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:37.761999 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ce33ffa1-52ca-4e94-945c-0cf8dc0ed45d tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:37.762786 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ce33ffa1-52ca-4e94-945c-0cf8dc0ed45d tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:37.775089 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce33ffa1-52ca-4e94-945c-0cf8dc0ed45d tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:37.775720 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce33ffa1-52ca-4e94-945c-0cf8dc0ed45d tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:37.779187 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce33ffa1-52ca-4e94-945c-0cf8dc0ed45d tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:37.781208 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce33ffa1-52ca-4e94-945c-0cf8dc0ed45d tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:37.783918 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce33ffa1-52ca-4e94-945c-0cf8dc0ed45d tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:37.785686 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce33ffa1-52ca-4e94-945c-0cf8dc0ed45d tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:37.945100 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3ecfae77-7368-4312-a97b-d9e3b4987f18 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:37.955852 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3ecfae77-7368-4312-a97b-d9e3b4987f18 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:37.961833 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3ecfae77-7368-4312-a97b-d9e3b4987f18 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:37.971329 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3ecfae77-7368-4312-a97b-d9e3b4987f18 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1880 microversion: 2.42 time: 0.730201 Oct 30 01:37:37.972109 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2504/5001] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:37:37 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1880 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:37:37.977405 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-099b66ea-94e2-4301-8591-faf9f9e8f650 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:37.980611 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-099b66ea-94e2-4301-8591-faf9f9e8f650 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:37.993837 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-099b66ea-94e2-4301-8591-faf9f9e8f650 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:37.996835 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-099b66ea-94e2-4301-8591-faf9f9e8f650 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:37.997286 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-099b66ea-94e2-4301-8591-faf9f9e8f650 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:38.001296 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-099b66ea-94e2-4301-8591-faf9f9e8f650 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:38.001839 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-099b66ea-94e2-4301-8591-faf9f9e8f650 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:38.002288 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-099b66ea-94e2-4301-8591-faf9f9e8f650 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:38.355366 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ce33ffa1-52ca-4e94-945c-0cf8dc0ed45d tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:38.364099 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ce33ffa1-52ca-4e94-945c-0cf8dc0ed45d tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4" status: 200 len: 1521 microversion: 2.1 time: 0.606642 Oct 30 01:37:38.373729 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2498/5002] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:37:37 2022] GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 => generated 1521 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:37:38.379581 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-8b7cd6a9-65f4-4f78-adc1-7cd8acc2a1e2 req-106eb55d-f004-4386-8fb1-8aa1d4bdfbf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "528b7413-5d73-4b6f-82a9-c1c9ac4d61e4", "name": "network-vif-unplugged", "status": "completed", "tag": "aa672fc8-573c-44a3-ac5a-bf7de5637190"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:37:38.404353 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-8b7cd6a9-65f4-4f78-adc1-7cd8acc2a1e2 req-106eb55d-f004-4386-8fb1-8aa1d4bdfbf0 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:38.405119 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-8b7cd6a9-65f4-4f78-adc1-7cd8acc2a1e2 req-106eb55d-f004-4386-8fb1-8aa1d4bdfbf0 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:38.405757 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-8b7cd6a9-65f4-4f78-adc1-7cd8acc2a1e2 req-106eb55d-f004-4386-8fb1-8aa1d4bdfbf0 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:38.437209 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-099b66ea-94e2-4301-8591-faf9f9e8f650 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:38.454005 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-8b7cd6a9-65f4-4f78-adc1-7cd8acc2a1e2 req-106eb55d-f004-4386-8fb1-8aa1d4bdfbf0 service nova] Creating event network-vif-unplugged:aa672fc8-573c-44a3-ac5a-bf7de5637190 for instance 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 on n-h1-master-1 Oct 30 01:37:38.455863 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-099b66ea-94e2-4301-8591-faf9f9e8f650 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b" status: 200 len: 1700 microversion: 2.1 time: 0.474148 Oct 30 01:37:38.456746 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2505/5003] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:37:37 2022] GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b => generated 1700 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:37:38.466291 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-8b7cd6a9-65f4-4f78-adc1-7cd8acc2a1e2 req-106eb55d-f004-4386-8fb1-8aa1d4bdfbf0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090790 Oct 30 01:37:38.468899 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2499/5004] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:37:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:37:38.495515 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d1ccfb81-e88f-4969-9a46-5ee8c5828c2a tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:37:38.521575 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d1ccfb81-e88f-4969-9a46-5ee8c5828c2a tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:38.523683 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d1ccfb81-e88f-4969-9a46-5ee8c5828c2a tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:38.524868 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d1ccfb81-e88f-4969-9a46-5ee8c5828c2a tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:38.574000 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=100 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:38.579879 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d1ccfb81-e88f-4969-9a46-5ee8c5828c2a tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Going to try to start instance {{(pid=121103) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 30 01:37:38.821267 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d1ccfb81-e88f-4969-9a46-5ee8c5828c2a tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "POST /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b/action" status: 202 len: 0 microversion: 2.1 time: 0.342235 Oct 30 01:37:38.822020 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2506/5005] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:37:38 2022] POST /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b/action => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:37:38.834625 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7b3c2858-8dcb-41a3-9fbe-1e5c50a975c5 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:38.836718 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7b3c2858-8dcb-41a3-9fbe-1e5c50a975c5 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:38.854748 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b3c2858-8dcb-41a3-9fbe-1e5c50a975c5 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:38.855425 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b3c2858-8dcb-41a3-9fbe-1e5c50a975c5 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:38.863478 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b3c2858-8dcb-41a3-9fbe-1e5c50a975c5 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:38.863478 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b3c2858-8dcb-41a3-9fbe-1e5c50a975c5 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:38.863478 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b3c2858-8dcb-41a3-9fbe-1e5c50a975c5 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:38.863478 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b3c2858-8dcb-41a3-9fbe-1e5c50a975c5 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:39.000400 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-032a4424-fc1c-44fe-b956-30273a6b0c70 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:39.001128 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-032a4424-fc1c-44fe-b956-30273a6b0c70 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:39.009978 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-032a4424-fc1c-44fe-b956-30273a6b0c70 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:39.010700 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-032a4424-fc1c-44fe-b956-30273a6b0c70 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:39.011480 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-032a4424-fc1c-44fe-b956-30273a6b0c70 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:39.012460 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-032a4424-fc1c-44fe-b956-30273a6b0c70 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:39.013089 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-032a4424-fc1c-44fe-b956-30273a6b0c70 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:39.013710 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-032a4424-fc1c-44fe-b956-30273a6b0c70 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:39.137502 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7b3c2858-8dcb-41a3-9fbe-1e5c50a975c5 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:39.149206 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7b3c2858-8dcb-41a3-9fbe-1e5c50a975c5 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b" status: 200 len: 1709 microversion: 2.1 time: 0.321613 Oct 30 01:37:39.171512 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2500/5006] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:37:38 2022] GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b => generated 1709 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:37:39.392525 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d2528e16-5cea-4444-97a4-dc81b2815167 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:39.395169 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d2528e16-5cea-4444-97a4-dc81b2815167 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:39.404254 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2528e16-5cea-4444-97a4-dc81b2815167 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:39.407018 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2528e16-5cea-4444-97a4-dc81b2815167 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:39.407642 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2528e16-5cea-4444-97a4-dc81b2815167 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:39.408587 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-032a4424-fc1c-44fe-b956-30273a6b0c70 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:39.409125 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2528e16-5cea-4444-97a4-dc81b2815167 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:39.412476 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2528e16-5cea-4444-97a4-dc81b2815167 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:39.413392 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2528e16-5cea-4444-97a4-dc81b2815167 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:39.422672 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-032a4424-fc1c-44fe-b956-30273a6b0c70 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:39.424534 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-032a4424-fc1c-44fe-b956-30273a6b0c70 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:39.430377 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-032a4424-fc1c-44fe-b956-30273a6b0c70 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1880 microversion: 2.42 time: 0.433684 Oct 30 01:37:39.434868 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2507/5007] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:37:38 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1880 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:37:40.115554 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d2528e16-5cea-4444-97a4-dc81b2815167 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:40.129429 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d2528e16-5cea-4444-97a4-dc81b2815167 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4" status: 200 len: 1521 microversion: 2.1 time: 0.738316 Oct 30 01:37:40.131449 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2501/5008] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:37:39 2022] GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 => generated 1521 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:37:40.179493 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2debe30d-78de-4fa3-addd-78598156630d tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:40.180805 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2debe30d-78de-4fa3-addd-78598156630d tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:40.193877 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2debe30d-78de-4fa3-addd-78598156630d tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:40.194401 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2debe30d-78de-4fa3-addd-78598156630d tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:40.197139 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2debe30d-78de-4fa3-addd-78598156630d tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:40.202648 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2debe30d-78de-4fa3-addd-78598156630d tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:40.203150 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2debe30d-78de-4fa3-addd-78598156630d tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:40.204763 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2debe30d-78de-4fa3-addd-78598156630d tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:40.462719 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d3d964e8-b07c-4e1a-8314-b6beb044be25 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:40.463507 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d3d964e8-b07c-4e1a-8314-b6beb044be25 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:40.480995 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3d964e8-b07c-4e1a-8314-b6beb044be25 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:40.481621 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3d964e8-b07c-4e1a-8314-b6beb044be25 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:40.482135 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3d964e8-b07c-4e1a-8314-b6beb044be25 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:40.482920 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3d964e8-b07c-4e1a-8314-b6beb044be25 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:40.483508 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3d964e8-b07c-4e1a-8314-b6beb044be25 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:40.484000 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3d964e8-b07c-4e1a-8314-b6beb044be25 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:40.529422 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2debe30d-78de-4fa3-addd-78598156630d tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:40.574024 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2debe30d-78de-4fa3-addd-78598156630d tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b" status: 200 len: 1709 microversion: 2.1 time: 0.392381 Oct 30 01:37:40.575158 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2508/5009] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:37:40 2022] GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b => generated 1709 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:37:40.786146 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-c64a38ea-5b4d-4880-8234-a3cebd017960 req-46af97f9-95da-45b9-b882-a5e72e85929c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef88e251-1a54-4519-ba22-ddcfa39451f9", "name": "network-vif-plugged", "status": "completed", "tag": "8b3d8d2b-c04a-49f0-ac61-050342907eee"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:37:40.809564 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-c64a38ea-5b4d-4880-8234-a3cebd017960 req-46af97f9-95da-45b9-b882-a5e72e85929c service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:40.813527 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-c64a38ea-5b4d-4880-8234-a3cebd017960 req-46af97f9-95da-45b9-b882-a5e72e85929c service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:40.814225 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-c64a38ea-5b4d-4880-8234-a3cebd017960 req-46af97f9-95da-45b9-b882-a5e72e85929c service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:40.865930 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-c64a38ea-5b4d-4880-8234-a3cebd017960 req-46af97f9-95da-45b9-b882-a5e72e85929c service nova] Creating event network-vif-plugged:8b3d8d2b-c04a-49f0-ac61-050342907eee for instance ef88e251-1a54-4519-ba22-ddcfa39451f9 on n-h2-master-1 Oct 30 01:37:40.877015 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d3d964e8-b07c-4e1a-8314-b6beb044be25 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:40.879248 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-c64a38ea-5b4d-4880-8234-a3cebd017960 req-46af97f9-95da-45b9-b882-a5e72e85929c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099210 Oct 30 01:37:40.881614 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2509/5010] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:37:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:37:40.889151 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d3d964e8-b07c-4e1a-8314-b6beb044be25 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:40.902571 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d3d964e8-b07c-4e1a-8314-b6beb044be25 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:40.906600 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d3d964e8-b07c-4e1a-8314-b6beb044be25 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1880 microversion: 2.42 time: 0.447716 Oct 30 01:37:40.927330 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2502/5011] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:37:40 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1880 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:37:41.158742 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-44f7030a-931b-4ece-b0d9-10ef273491e8 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:41.159847 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-44f7030a-931b-4ece-b0d9-10ef273491e8 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:41.172815 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-44f7030a-931b-4ece-b0d9-10ef273491e8 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:41.173912 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-44f7030a-931b-4ece-b0d9-10ef273491e8 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:41.174684 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-44f7030a-931b-4ece-b0d9-10ef273491e8 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:41.175897 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-44f7030a-931b-4ece-b0d9-10ef273491e8 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:41.176573 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-44f7030a-931b-4ece-b0d9-10ef273491e8 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:41.177211 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-44f7030a-931b-4ece-b0d9-10ef273491e8 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:41.509209 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-44f7030a-931b-4ece-b0d9-10ef273491e8 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:41.545527 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-44f7030a-931b-4ece-b0d9-10ef273491e8 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4" status: 200 len: 1521 microversion: 2.1 time: 0.378743 Oct 30 01:37:41.546377 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2510/5012] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:37:41 2022] GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 => generated 1521 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:37:41.610597 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7552f2cc-513a-4b27-ab3b-c27f33c49101 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:41.612067 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7552f2cc-513a-4b27-ab3b-c27f33c49101 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:41.625382 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7552f2cc-513a-4b27-ab3b-c27f33c49101 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:41.626513 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7552f2cc-513a-4b27-ab3b-c27f33c49101 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:41.627571 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7552f2cc-513a-4b27-ab3b-c27f33c49101 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:41.628471 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7552f2cc-513a-4b27-ab3b-c27f33c49101 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:41.629467 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7552f2cc-513a-4b27-ab3b-c27f33c49101 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:41.630199 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7552f2cc-513a-4b27-ab3b-c27f33c49101 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:41.939540 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f144fa3b-8e4a-4606-adee-c6fbcdd6eb45 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:41.940224 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f144fa3b-8e4a-4606-adee-c6fbcdd6eb45 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:41.949563 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f144fa3b-8e4a-4606-adee-c6fbcdd6eb45 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:41.950070 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f144fa3b-8e4a-4606-adee-c6fbcdd6eb45 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:41.950515 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f144fa3b-8e4a-4606-adee-c6fbcdd6eb45 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:41.956418 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f144fa3b-8e4a-4606-adee-c6fbcdd6eb45 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:41.956921 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f144fa3b-8e4a-4606-adee-c6fbcdd6eb45 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:41.957396 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f144fa3b-8e4a-4606-adee-c6fbcdd6eb45 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:42.204098 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7552f2cc-513a-4b27-ab3b-c27f33c49101 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:42.218902 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7552f2cc-513a-4b27-ab3b-c27f33c49101 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b" status: 200 len: 1709 microversion: 2.1 time: 0.623096 Oct 30 01:37:42.219748 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2503/5013] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:37:41 2022] GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b => generated 1709 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:37:42.376971 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f144fa3b-8e4a-4606-adee-c6fbcdd6eb45 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:42.393504 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f144fa3b-8e4a-4606-adee-c6fbcdd6eb45 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:42.395059 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f144fa3b-8e4a-4606-adee-c6fbcdd6eb45 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:42.401248 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f144fa3b-8e4a-4606-adee-c6fbcdd6eb45 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1880 microversion: 2.42 time: 0.465792 Oct 30 01:37:42.405476 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2511/5014] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:37:41 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1880 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:37:42.562088 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a26b681a-12f2-4f9a-9818-181a98de4b69 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:42.562915 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a26b681a-12f2-4f9a-9818-181a98de4b69 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:42.569399 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a26b681a-12f2-4f9a-9818-181a98de4b69 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:42.570212 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a26b681a-12f2-4f9a-9818-181a98de4b69 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:42.570713 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a26b681a-12f2-4f9a-9818-181a98de4b69 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:42.571809 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a26b681a-12f2-4f9a-9818-181a98de4b69 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:42.573142 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a26b681a-12f2-4f9a-9818-181a98de4b69 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:42.574017 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a26b681a-12f2-4f9a-9818-181a98de4b69 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:42.848530 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a26b681a-12f2-4f9a-9818-181a98de4b69 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:42.862869 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a26b681a-12f2-4f9a-9818-181a98de4b69 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4" status: 200 len: 1521 microversion: 2.1 time: 0.305902 Oct 30 01:37:42.873211 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2504/5015] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:37:42 2022] GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 => generated 1521 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:37:42.999399 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-269d72e7-5846-4e28-ba5d-62a68f79ab39 req-360e09c5-dc07-4283-852b-10926a6a8f00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef88e251-1a54-4519-ba22-ddcfa39451f9", "name": "network-vif-plugged", "status": "completed", "tag": "1b93efb1-1d66-4cce-94fd-03ec5abdbd99"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:37:43.018210 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-269d72e7-5846-4e28-ba5d-62a68f79ab39 req-360e09c5-dc07-4283-852b-10926a6a8f00 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:43.021405 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-269d72e7-5846-4e28-ba5d-62a68f79ab39 req-360e09c5-dc07-4283-852b-10926a6a8f00 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:43.022063 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-269d72e7-5846-4e28-ba5d-62a68f79ab39 req-360e09c5-dc07-4283-852b-10926a6a8f00 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:43.047614 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-269d72e7-5846-4e28-ba5d-62a68f79ab39 req-360e09c5-dc07-4283-852b-10926a6a8f00 service nova] Creating event network-vif-plugged:1b93efb1-1d66-4cce-94fd-03ec5abdbd99 for instance ef88e251-1a54-4519-ba22-ddcfa39451f9 on n-h2-master-1 Oct 30 01:37:43.059577 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-269d72e7-5846-4e28-ba5d-62a68f79ab39 req-360e09c5-dc07-4283-852b-10926a6a8f00 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064767 Oct 30 01:37:43.067503 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2512/5016] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:37:43.249014 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9571b678-83d1-45cc-a8d4-ca564a49e349 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:43.249942 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9571b678-83d1-45cc-a8d4-ca564a49e349 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:43.256965 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9571b678-83d1-45cc-a8d4-ca564a49e349 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:43.257799 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9571b678-83d1-45cc-a8d4-ca564a49e349 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:43.258428 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9571b678-83d1-45cc-a8d4-ca564a49e349 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:43.259369 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9571b678-83d1-45cc-a8d4-ca564a49e349 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:43.260439 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9571b678-83d1-45cc-a8d4-ca564a49e349 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:43.261052 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9571b678-83d1-45cc-a8d4-ca564a49e349 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:43.428951 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5a9eb3c4-bacb-4e39-8a55-f7360d55bfc8 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:43.429814 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5a9eb3c4-bacb-4e39-8a55-f7360d55bfc8 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:43.439823 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5a9eb3c4-bacb-4e39-8a55-f7360d55bfc8 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:43.439823 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5a9eb3c4-bacb-4e39-8a55-f7360d55bfc8 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:43.440250 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5a9eb3c4-bacb-4e39-8a55-f7360d55bfc8 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:43.441144 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5a9eb3c4-bacb-4e39-8a55-f7360d55bfc8 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:43.442204 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5a9eb3c4-bacb-4e39-8a55-f7360d55bfc8 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:43.442787 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5a9eb3c4-bacb-4e39-8a55-f7360d55bfc8 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:43.725226 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9571b678-83d1-45cc-a8d4-ca564a49e349 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:43.734012 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9571b678-83d1-45cc-a8d4-ca564a49e349 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b" status: 200 len: 1713 microversion: 2.1 time: 0.490270 Oct 30 01:37:43.746094 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2505/5017] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:37:43 2022] GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b => generated 1713 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:37:43.868581 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5a9eb3c4-bacb-4e39-8a55-f7360d55bfc8 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:43.890267 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5a9eb3c4-bacb-4e39-8a55-f7360d55bfc8 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:43.894550 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5a9eb3c4-bacb-4e39-8a55-f7360d55bfc8 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:43.901693 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d16402d7-0794-4c9b-9962-9a1ae261055f tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:43.903466 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d16402d7-0794-4c9b-9962-9a1ae261055f tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:43.908797 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5a9eb3c4-bacb-4e39-8a55-f7360d55bfc8 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1880 microversion: 2.42 time: 0.484278 Oct 30 01:37:43.912036 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2513/5018] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:37:43 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1880 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:37:43.913235 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d16402d7-0794-4c9b-9962-9a1ae261055f tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:43.913933 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d16402d7-0794-4c9b-9962-9a1ae261055f tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:43.914365 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d16402d7-0794-4c9b-9962-9a1ae261055f tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:43.915054 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d16402d7-0794-4c9b-9962-9a1ae261055f tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:43.915604 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d16402d7-0794-4c9b-9962-9a1ae261055f tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:43.916255 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d16402d7-0794-4c9b-9962-9a1ae261055f tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:44.234116 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d16402d7-0794-4c9b-9962-9a1ae261055f tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:44.251031 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d16402d7-0794-4c9b-9962-9a1ae261055f tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4" status: 200 len: 1521 microversion: 2.1 time: 0.354073 Oct 30 01:37:44.251979 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2506/5019] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:37:43 2022] GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 => generated 1521 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:37:44.948269 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-19fff112-0ccd-4e2f-a4c0-d275b55298c4 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:44.950871 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-19fff112-0ccd-4e2f-a4c0-d275b55298c4 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:44.967549 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=78 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:44.969260 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-19fff112-0ccd-4e2f-a4c0-d275b55298c4 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:44.971004 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-19fff112-0ccd-4e2f-a4c0-d275b55298c4 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:44.971638 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-19fff112-0ccd-4e2f-a4c0-d275b55298c4 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:44.972740 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-19fff112-0ccd-4e2f-a4c0-d275b55298c4 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:44.973506 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-19fff112-0ccd-4e2f-a4c0-d275b55298c4 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:44.974287 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-19fff112-0ccd-4e2f-a4c0-d275b55298c4 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:45.107211 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-cf5285e2-9952-4ff9-9efa-4ba13991ce43 req-483eb989-30f1-45ba-929c-eaa7b60c9465 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "528b7413-5d73-4b6f-82a9-c1c9ac4d61e4", "name": "network-vif-plugged", "status": "completed", "tag": "aa672fc8-573c-44a3-ac5a-bf7de5637190"}, {"server_uuid": "ef88e251-1a54-4519-ba22-ddcfa39451f9", "name": "network-vif-plugged", "status": "completed", "tag": "dd203276-bfbe-4e13-92c1-6e267ef12915"}, {"server_uuid": "ef88e251-1a54-4519-ba22-ddcfa39451f9", "name": "network-vif-plugged", "status": "completed", "tag": "24b50323-80bd-4825-8628-29f3a47cc19a"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:37:45.122995 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-cf5285e2-9952-4ff9-9efa-4ba13991ce43 req-483eb989-30f1-45ba-929c-eaa7b60c9465 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:45.129882 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-cf5285e2-9952-4ff9-9efa-4ba13991ce43 req-483eb989-30f1-45ba-929c-eaa7b60c9465 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:45.130346 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-cf5285e2-9952-4ff9-9efa-4ba13991ce43 req-483eb989-30f1-45ba-929c-eaa7b60c9465 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:45.159575 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-cf5285e2-9952-4ff9-9efa-4ba13991ce43 req-483eb989-30f1-45ba-929c-eaa7b60c9465 service nova] Creating event network-vif-plugged:aa672fc8-573c-44a3-ac5a-bf7de5637190 for instance 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 on n-h1-master-1 Oct 30 01:37:45.160081 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-cf5285e2-9952-4ff9-9efa-4ba13991ce43 req-483eb989-30f1-45ba-929c-eaa7b60c9465 service nova] Creating event network-vif-plugged:dd203276-bfbe-4e13-92c1-6e267ef12915 for instance ef88e251-1a54-4519-ba22-ddcfa39451f9 on n-h2-master-1 Oct 30 01:37:45.160594 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-cf5285e2-9952-4ff9-9efa-4ba13991ce43 req-483eb989-30f1-45ba-929c-eaa7b60c9465 service nova] Creating event network-vif-plugged:24b50323-80bd-4825-8628-29f3a47cc19a for instance ef88e251-1a54-4519-ba22-ddcfa39451f9 on n-h2-master-1 Oct 30 01:37:45.179248 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-cf5285e2-9952-4ff9-9efa-4ba13991ce43 req-483eb989-30f1-45ba-929c-eaa7b60c9465 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.082465 Oct 30 01:37:45.180413 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2507/5020] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:37:45 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:37:45.294258 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-027461f4-3012-4073-be09-28a18a0ad786 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:45.296550 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-027461f4-3012-4073-be09-28a18a0ad786 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:45.337328 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-027461f4-3012-4073-be09-28a18a0ad786 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:45.346456 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-027461f4-3012-4073-be09-28a18a0ad786 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:45.347077 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-027461f4-3012-4073-be09-28a18a0ad786 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:45.351927 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-027461f4-3012-4073-be09-28a18a0ad786 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:45.355637 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-027461f4-3012-4073-be09-28a18a0ad786 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:45.356439 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-027461f4-3012-4073-be09-28a18a0ad786 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:45.492027 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-19fff112-0ccd-4e2f-a4c0-d275b55298c4 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:45.520546 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-19fff112-0ccd-4e2f-a4c0-d275b55298c4 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:45.530282 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-19fff112-0ccd-4e2f-a4c0-d275b55298c4 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:45.534854 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-19fff112-0ccd-4e2f-a4c0-d275b55298c4 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1880 microversion: 2.42 time: 0.596284 Oct 30 01:37:45.537159 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2514/5021] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:37:44 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1880 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:37:45.714248 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-027461f4-3012-4073-be09-28a18a0ad786 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:45.723455 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-027461f4-3012-4073-be09-28a18a0ad786 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4" status: 200 len: 1521 microversion: 2.1 time: 0.445166 Oct 30 01:37:45.725379 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2508/5022] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:37:45 2022] GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 => generated 1521 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:37:46.568651 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4fe1741e-164f-4e65-999e-51762c572c1f tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:46.570811 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4fe1741e-164f-4e65-999e-51762c572c1f tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:46.579163 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4fe1741e-164f-4e65-999e-51762c572c1f tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:46.580679 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4fe1741e-164f-4e65-999e-51762c572c1f tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:46.581136 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4fe1741e-164f-4e65-999e-51762c572c1f tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:46.582135 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4fe1741e-164f-4e65-999e-51762c572c1f tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:46.582600 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4fe1741e-164f-4e65-999e-51762c572c1f tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:46.583225 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4fe1741e-164f-4e65-999e-51762c572c1f tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:46.748068 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8eedf7bd-1d82-4da7-b4d7-9cb922a441c8 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:46.748844 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8eedf7bd-1d82-4da7-b4d7-9cb922a441c8 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:46.772156 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8eedf7bd-1d82-4da7-b4d7-9cb922a441c8 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:46.965278 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8eedf7bd-1d82-4da7-b4d7-9cb922a441c8 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:46.965278 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8eedf7bd-1d82-4da7-b4d7-9cb922a441c8 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:46.965278 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8eedf7bd-1d82-4da7-b4d7-9cb922a441c8 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:46.965278 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8eedf7bd-1d82-4da7-b4d7-9cb922a441c8 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:46.965278 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8eedf7bd-1d82-4da7-b4d7-9cb922a441c8 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:46.965278 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:47.150587 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4fe1741e-164f-4e65-999e-51762c572c1f tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:47.166605 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4fe1741e-164f-4e65-999e-51762c572c1f tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:47.168084 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4fe1741e-164f-4e65-999e-51762c572c1f tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:47.169271 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4fe1741e-164f-4e65-999e-51762c572c1f tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1880 microversion: 2.42 time: 0.605188 Oct 30 01:37:47.172619 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2515/5023] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:37:46 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1880 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:37:47.209131 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8eedf7bd-1d82-4da7-b4d7-9cb922a441c8 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:47.220416 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-af0b6e83-e1bc-4810-8cc8-5a3db61daf8a req-b9837bcc-08d6-400d-a058-7acd0a94e262 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef88e251-1a54-4519-ba22-ddcfa39451f9", "name": "network-vif-plugged", "status": "completed", "tag": "2cb96018-5b01-4537-93d5-c8b744320064"}, {"server_uuid": "ef88e251-1a54-4519-ba22-ddcfa39451f9", "name": "network-vif-plugged", "status": "completed", "tag": "0811537c-a662-478e-a5e0-ddeeb0322f5a"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:37:47.233597 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8eedf7bd-1d82-4da7-b4d7-9cb922a441c8 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4" status: 200 len: 1521 microversion: 2.1 time: 0.489118 Oct 30 01:37:47.236983 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2509/5024] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:37:46 2022] GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 => generated 1521 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:37:47.261635 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-af0b6e83-e1bc-4810-8cc8-5a3db61daf8a req-b9837bcc-08d6-400d-a058-7acd0a94e262 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:47.262196 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-af0b6e83-e1bc-4810-8cc8-5a3db61daf8a req-b9837bcc-08d6-400d-a058-7acd0a94e262 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:47.262633 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-af0b6e83-e1bc-4810-8cc8-5a3db61daf8a req-b9837bcc-08d6-400d-a058-7acd0a94e262 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:47.278399 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-af0b6e83-e1bc-4810-8cc8-5a3db61daf8a req-b9837bcc-08d6-400d-a058-7acd0a94e262 service nova] Creating event network-vif-plugged:2cb96018-5b01-4537-93d5-c8b744320064 for instance ef88e251-1a54-4519-ba22-ddcfa39451f9 on n-h2-master-1 Oct 30 01:37:47.279138 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-af0b6e83-e1bc-4810-8cc8-5a3db61daf8a req-b9837bcc-08d6-400d-a058-7acd0a94e262 service nova] Creating event network-vif-plugged:0811537c-a662-478e-a5e0-ddeeb0322f5a for instance ef88e251-1a54-4519-ba22-ddcfa39451f9 on n-h2-master-1 Oct 30 01:37:47.285406 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-af0b6e83-e1bc-4810-8cc8-5a3db61daf8a req-b9837bcc-08d6-400d-a058-7acd0a94e262 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.068951 Oct 30 01:37:47.285959 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2516/5025] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:37:47 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:37:48.198876 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1922abd1-e3f3-4669-bf80-b6f8d8d4f37c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:48.199490 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1922abd1-e3f3-4669-bf80-b6f8d8d4f37c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:48.210543 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1922abd1-e3f3-4669-bf80-b6f8d8d4f37c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:48.211373 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1922abd1-e3f3-4669-bf80-b6f8d8d4f37c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:48.212183 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1922abd1-e3f3-4669-bf80-b6f8d8d4f37c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:48.214435 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1922abd1-e3f3-4669-bf80-b6f8d8d4f37c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:48.215134 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1922abd1-e3f3-4669-bf80-b6f8d8d4f37c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:48.216287 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1922abd1-e3f3-4669-bf80-b6f8d8d4f37c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:48.265190 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7e267d21-8e13-4838-8a55-bdb7515154c9 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:48.266654 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7e267d21-8e13-4838-8a55-bdb7515154c9 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:48.274447 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7e267d21-8e13-4838-8a55-bdb7515154c9 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:48.276976 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7e267d21-8e13-4838-8a55-bdb7515154c9 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:48.276976 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7e267d21-8e13-4838-8a55-bdb7515154c9 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:48.277403 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7e267d21-8e13-4838-8a55-bdb7515154c9 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:48.278079 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7e267d21-8e13-4838-8a55-bdb7515154c9 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:48.278723 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7e267d21-8e13-4838-8a55-bdb7515154c9 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:48.716002 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7e267d21-8e13-4838-8a55-bdb7515154c9 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:48.729191 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7e267d21-8e13-4838-8a55-bdb7515154c9 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4" status: 200 len: 1506 microversion: 2.1 time: 0.466895 Oct 30 01:37:48.731023 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2517/5026] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:37:48 2022] GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 => generated 1506 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:37:48.738666 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1922abd1-e3f3-4669-bf80-b6f8d8d4f37c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:48.753461 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1922abd1-e3f3-4669-bf80-b6f8d8d4f37c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:48.758349 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1922abd1-e3f3-4669-bf80-b6f8d8d4f37c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:48.760418 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1922abd1-e3f3-4669-bf80-b6f8d8d4f37c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1880 microversion: 2.42 time: 0.565347 Oct 30 01:37:48.761218 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2510/5027] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:37:48 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1880 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:37:48.784546 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-140f3c30-f054-4eee-bbb7-674975c483c9 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:48.787262 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-140f3c30-f054-4eee-bbb7-674975c483c9 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:48.821812 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-140f3c30-f054-4eee-bbb7-674975c483c9 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:48.824719 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-140f3c30-f054-4eee-bbb7-674975c483c9 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:48.825943 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-140f3c30-f054-4eee-bbb7-674975c483c9 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:48.829209 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-140f3c30-f054-4eee-bbb7-674975c483c9 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:48.830524 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-140f3c30-f054-4eee-bbb7-674975c483c9 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:48.831257 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-140f3c30-f054-4eee-bbb7-674975c483c9 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:49.172655 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-140f3c30-f054-4eee-bbb7-674975c483c9 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:49.189770 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-140f3c30-f054-4eee-bbb7-674975c483c9 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4" status: 200 len: 1506 microversion: 2.1 time: 0.421594 Oct 30 01:37:49.193927 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2518/5028] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:37:48 2022] GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 => generated 1506 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:37:49.214670 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4b228ef7-ea76-40b1-aa95-87db124447a0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:49.218493 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4b228ef7-ea76-40b1-aa95-87db124447a0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:49.225804 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b228ef7-ea76-40b1-aa95-87db124447a0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:49.226905 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b228ef7-ea76-40b1-aa95-87db124447a0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:49.227561 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b228ef7-ea76-40b1-aa95-87db124447a0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:49.230341 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b228ef7-ea76-40b1-aa95-87db124447a0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:49.231042 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b228ef7-ea76-40b1-aa95-87db124447a0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:49.231697 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b228ef7-ea76-40b1-aa95-87db124447a0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:49.289456 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4b228ef7-ea76-40b1-aa95-87db124447a0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:37:49.331477 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-8cf4b5d5-0356-4424-b7eb-6f22f517cd5e req-971679fa-b955-4317-ac4c-8313a216ef65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef88e251-1a54-4519-ba22-ddcfa39451f9", "name": "network-vif-plugged", "status": "completed", "tag": "dac20a34-eccc-48f6-b0ff-646be623ec49"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:37:49.359761 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-8cf4b5d5-0356-4424-b7eb-6f22f517cd5e req-971679fa-b955-4317-ac4c-8313a216ef65 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:49.361760 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-8cf4b5d5-0356-4424-b7eb-6f22f517cd5e req-971679fa-b955-4317-ac4c-8313a216ef65 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:49.361760 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-8cf4b5d5-0356-4424-b7eb-6f22f517cd5e req-971679fa-b955-4317-ac4c-8313a216ef65 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:49.385690 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-8cf4b5d5-0356-4424-b7eb-6f22f517cd5e req-971679fa-b955-4317-ac4c-8313a216ef65 service nova] Creating event network-vif-plugged:dac20a34-eccc-48f6-b0ff-646be623ec49 for instance ef88e251-1a54-4519-ba22-ddcfa39451f9 on n-h2-master-1 Oct 30 01:37:49.392053 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-8cf4b5d5-0356-4424-b7eb-6f22f517cd5e req-971679fa-b955-4317-ac4c-8313a216ef65 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066005 Oct 30 01:37:49.392688 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2519/5029] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:37:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:37:49.732354 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4b228ef7-ea76-40b1-aa95-87db124447a0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "DELETE /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4" status: 204 len: 0 microversion: 2.1 time: 0.524604 Oct 30 01:37:49.736055 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2511/5030] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:37:49 2022] DELETE /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:37:49.793315 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-54a376a2-1434-485c-aecd-0521123efec8 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:49.794121 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-54a376a2-1434-485c-aecd-0521123efec8 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:49.815370 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-54a376a2-1434-485c-aecd-0521123efec8 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:49.818211 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-54a376a2-1434-485c-aecd-0521123efec8 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:49.818771 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-54a376a2-1434-485c-aecd-0521123efec8 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:49.821227 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-54a376a2-1434-485c-aecd-0521123efec8 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:49.823498 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-54a376a2-1434-485c-aecd-0521123efec8 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:49.829118 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-54a376a2-1434-485c-aecd-0521123efec8 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:49.957990 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8183ed16-c3a5-430a-8ea4-33a8e0281a60 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2052968751", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "23bac07c-fd15-43fe-bec7-06f0679e3987"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:37:50.048964 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-8183ed16-c3a5-430a-8ea4-33a8e0281a60 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] validate_networks() for [('23bac07c-fd15-43fe-bec7-06f0679e3987', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:37:50.393000 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-54a376a2-1434-485c-aecd-0521123efec8 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:50.409856 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-54a376a2-1434-485c-aecd-0521123efec8 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:50.411797 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-54a376a2-1434-485c-aecd-0521123efec8 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:50.413294 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-54a376a2-1434-485c-aecd-0521123efec8 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1880 microversion: 2.42 time: 0.624944 Oct 30 01:37:50.414735 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2520/5031] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:37:49 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1880 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:37:50.821113 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-8183ed16-c3a5-430a-8ea4-33a8e0281a60 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:37:50.821113 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-8183ed16-c3a5-430a-8ea4-33a8e0281a60 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:37:50.821113 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-8183ed16-c3a5-430a-8ea4-33a8e0281a60 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:37:50.821113 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-8183ed16-c3a5-430a-8ea4-33a8e0281a60 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:37:50.821113 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-8183ed16-c3a5-430a-8ea4-33a8e0281a60 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:37:50.831072 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8183ed16-c3a5-430a-8ea4-33a8e0281a60 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:50.836677 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8183ed16-c3a5-430a-8ea4-33a8e0281a60 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:50.844297 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8183ed16-c3a5-430a-8ea4-33a8e0281a60 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:50.845149 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8183ed16-c3a5-430a-8ea4-33a8e0281a60 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:50.845718 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8183ed16-c3a5-430a-8ea4-33a8e0281a60 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:50.846158 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8183ed16-c3a5-430a-8ea4-33a8e0281a60 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:50.866257 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-8183ed16-c3a5-430a-8ea4-33a8e0281a60 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Getting quotas for project 6716e9ebbf6c4ca1950a5a0bce33276c. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:37:50.871989 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-8183ed16-c3a5-430a-8ea4-33a8e0281a60 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Getting quotas for user 352cb9c0a2644e0e8743f3cc4477f88f and project 6716e9ebbf6c4ca1950a5a0bce33276c. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:37:50.885497 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8183ed16-c3a5-430a-8ea4-33a8e0281a60 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:37:50.887958 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8183ed16-c3a5-430a-8ea4-33a8e0281a60 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 3fb366e7-0a5c-4bf8-944b-d9140af2c65c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:37:51.005820 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8183ed16-c3a5-430a-8ea4-33a8e0281a60 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.052114 Oct 30 01:37:51.013707 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2512/5032] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:37:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1061 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:37:51.018682 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ff85e185-3479-44e2-954d-e2d42b93c0ad tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:51.019466 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ff85e185-3479-44e2-954d-e2d42b93c0ad tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 3fb366e7-0a5c-4bf8-944b-d9140af2c65c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:51.166554 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ff85e185-3479-44e2-954d-e2d42b93c0ad tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:51.175595 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ff85e185-3479-44e2-954d-e2d42b93c0ad tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c" status: 200 len: 1218 microversion: 2.1 time: 0.161100 Oct 30 01:37:51.176747 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2521/5033] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:37:51 2022] GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c => generated 1218 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:37:51.442270 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-dce2f64c-0227-48bf-ad0c-d374a090e90b tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:51.443205 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-dce2f64c-0227-48bf-ad0c-d374a090e90b tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:51.458801 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dce2f64c-0227-48bf-ad0c-d374a090e90b tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:51.462564 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dce2f64c-0227-48bf-ad0c-d374a090e90b tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:51.466300 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dce2f64c-0227-48bf-ad0c-d374a090e90b tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:51.467677 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dce2f64c-0227-48bf-ad0c-d374a090e90b tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:51.468776 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dce2f64c-0227-48bf-ad0c-d374a090e90b tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:51.470288 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dce2f64c-0227-48bf-ad0c-d374a090e90b tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:52.200550 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f96629a0-d33c-4312-8d83-c102c52b6541 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:52.200550 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f96629a0-d33c-4312-8d83-c102c52b6541 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 3fb366e7-0a5c-4bf8-944b-d9140af2c65c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:52.220817 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-dce2f64c-0227-48bf-ad0c-d374a090e90b tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:52.298359 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-dce2f64c-0227-48bf-ad0c-d374a090e90b tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:52.298359 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-dce2f64c-0227-48bf-ad0c-d374a090e90b tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:52.298359 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-dce2f64c-0227-48bf-ad0c-d374a090e90b tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1880 microversion: 2.42 time: 0.855355 Oct 30 01:37:52.310359 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2513/5034] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:37:51 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1880 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:37:52.394171 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f96629a0-d33c-4312-8d83-c102c52b6541 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:52.402205 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-525321d5-753c-4cbd-a9a2-f82bee4637ee req-e83fda7c-a710-447b-b656-26c495dfd742 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "528b7413-5d73-4b6f-82a9-c1c9ac4d61e4", "name": "network-vif-deleted", "tag": "aa672fc8-573c-44a3-ac5a-bf7de5637190"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:37:52.423219 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f96629a0-d33c-4312-8d83-c102c52b6541 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c" status: 200 len: 1218 microversion: 2.1 time: 0.227590 Oct 30 01:37:52.428091 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2522/5035] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:37:52 2022] GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c => generated 1218 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:37:52.434854 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-525321d5-753c-4cbd-a9a2-f82bee4637ee req-e83fda7c-a710-447b-b656-26c495dfd742 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:52.435606 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-525321d5-753c-4cbd-a9a2-f82bee4637ee req-e83fda7c-a710-447b-b656-26c495dfd742 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:52.436212 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-525321d5-753c-4cbd-a9a2-f82bee4637ee req-e83fda7c-a710-447b-b656-26c495dfd742 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:52.454881 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-525321d5-753c-4cbd-a9a2-f82bee4637ee req-e83fda7c-a710-447b-b656-26c495dfd742 service nova] Creating event network-vif-deleted:aa672fc8-573c-44a3-ac5a-bf7de5637190 for instance 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 on n-h1-master-1 Oct 30 01:37:52.460862 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-525321d5-753c-4cbd-a9a2-f82bee4637ee req-e83fda7c-a710-447b-b656-26c495dfd742 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070561 Oct 30 01:37:52.461535 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2514/5036] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:37:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:37:53.343362 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-69f74c35-d920-4c44-a863-5af6c2c8d990 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:53.345754 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-69f74c35-d920-4c44-a863-5af6c2c8d990 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:53.365515 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-69f74c35-d920-4c44-a863-5af6c2c8d990 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:53.366248 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-69f74c35-d920-4c44-a863-5af6c2c8d990 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:53.366964 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-69f74c35-d920-4c44-a863-5af6c2c8d990 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:53.370979 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-69f74c35-d920-4c44-a863-5af6c2c8d990 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:53.371476 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-69f74c35-d920-4c44-a863-5af6c2c8d990 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:53.371925 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-69f74c35-d920-4c44-a863-5af6c2c8d990 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:53.447835 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-78b43111-b82d-4ace-b6ed-544e228cefae tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:53.448760 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-78b43111-b82d-4ace-b6ed-544e228cefae tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 3fb366e7-0a5c-4bf8-944b-d9140af2c65c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:53.460382 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-78b43111-b82d-4ace-b6ed-544e228cefae tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:53.460876 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-78b43111-b82d-4ace-b6ed-544e228cefae tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:53.461314 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-78b43111-b82d-4ace-b6ed-544e228cefae tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:53.462060 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-78b43111-b82d-4ace-b6ed-544e228cefae tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:53.488405 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-78b43111-b82d-4ace-b6ed-544e228cefae tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:53.490520 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-78b43111-b82d-4ace-b6ed-544e228cefae tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:53.646918 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-78b43111-b82d-4ace-b6ed-544e228cefae tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:53.659108 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-78b43111-b82d-4ace-b6ed-544e228cefae tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c" status: 200 len: 1214 microversion: 2.1 time: 0.216342 Oct 30 01:37:53.660469 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2515/5037] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:37:53 2022] GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c => generated 1214 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:37:53.747743 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-69f74c35-d920-4c44-a863-5af6c2c8d990 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:53.764418 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-69f74c35-d920-4c44-a863-5af6c2c8d990 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:53.767724 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-69f74c35-d920-4c44-a863-5af6c2c8d990 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:53.769781 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-69f74c35-d920-4c44-a863-5af6c2c8d990 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 2839 microversion: 2.42 time: 0.435601 Oct 30 01:37:53.772163 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2523/5038] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:37:53 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 2839 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:37:53.812348 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8e9e1ae0-f0cf-4983-a89b-27c7656923b4 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:53.815635 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8e9e1ae0-f0cf-4983-a89b-27c7656923b4 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:53.830544 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8e9e1ae0-f0cf-4983-a89b-27c7656923b4 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:53.832156 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8e9e1ae0-f0cf-4983-a89b-27c7656923b4 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:53.833748 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8e9e1ae0-f0cf-4983-a89b-27c7656923b4 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:53.834770 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8e9e1ae0-f0cf-4983-a89b-27c7656923b4 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:53.835924 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8e9e1ae0-f0cf-4983-a89b-27c7656923b4 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:53.837023 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8e9e1ae0-f0cf-4983-a89b-27c7656923b4 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:54.023135 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8e9e1ae0-f0cf-4983-a89b-27c7656923b4 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9/os-interface" status: 200 len: 1833 microversion: 2.42 time: 0.226779 Oct 30 01:37:54.023735 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2516/5039] 10.222.0.13 () {60 vars in 1316 bytes} [Sun Oct 30 01:37:53 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9/os-interface => generated 1833 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:37:54.684601 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a4d1eb6a-bb64-458a-bd95-218e53d804c0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:54.686368 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a4d1eb6a-bb64-458a-bd95-218e53d804c0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 3fb366e7-0a5c-4bf8-944b-d9140af2c65c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:54.700157 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a4d1eb6a-bb64-458a-bd95-218e53d804c0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:54.719684 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a4d1eb6a-bb64-458a-bd95-218e53d804c0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:54.724918 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a4d1eb6a-bb64-458a-bd95-218e53d804c0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:54.728407 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a4d1eb6a-bb64-458a-bd95-218e53d804c0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:54.730354 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a4d1eb6a-bb64-458a-bd95-218e53d804c0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:54.734136 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a4d1eb6a-bb64-458a-bd95-218e53d804c0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:54.899849 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a4d1eb6a-bb64-458a-bd95-218e53d804c0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:54.918555 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a4d1eb6a-bb64-458a-bd95-218e53d804c0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c" status: 200 len: 1278 microversion: 2.1 time: 0.229882 Oct 30 01:37:54.918555 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2524/5040] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:37:54 2022] GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c => generated 1278 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:37:55.935804 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b3520238-ddb6-4e8e-8c83-d1b6ccdc77ed tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:55.937102 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b3520238-ddb6-4e8e-8c83-d1b6ccdc77ed tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 3fb366e7-0a5c-4bf8-944b-d9140af2c65c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:55.952959 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b3520238-ddb6-4e8e-8c83-d1b6ccdc77ed tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:55.953482 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b3520238-ddb6-4e8e-8c83-d1b6ccdc77ed tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:55.953915 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b3520238-ddb6-4e8e-8c83-d1b6ccdc77ed tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:55.954622 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b3520238-ddb6-4e8e-8c83-d1b6ccdc77ed tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:55.955065 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b3520238-ddb6-4e8e-8c83-d1b6ccdc77ed tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:55.955482 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b3520238-ddb6-4e8e-8c83-d1b6ccdc77ed tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:56.101959 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b3520238-ddb6-4e8e-8c83-d1b6ccdc77ed tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:56.113151 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b3520238-ddb6-4e8e-8c83-d1b6ccdc77ed tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c" status: 200 len: 1276 microversion: 2.1 time: 0.181743 Oct 30 01:37:56.114194 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2517/5041] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:37:55 2022] GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c => generated 1276 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:37:56.955295 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-115cb471-f973-44ce-a3fe-5f00382bf484 req-f3bb1115-8a82-4fac-ab27-0466ddac1590 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef88e251-1a54-4519-ba22-ddcfa39451f9", "tag": "8b3d8d2b-c04a-49f0-ac61-050342907eee"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:37:56.966633 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-115cb471-f973-44ce-a3fe-5f00382bf484 req-f3bb1115-8a82-4fac-ab27-0466ddac1590 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:56.967471 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-115cb471-f973-44ce-a3fe-5f00382bf484 req-f3bb1115-8a82-4fac-ab27-0466ddac1590 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:56.968090 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-115cb471-f973-44ce-a3fe-5f00382bf484 req-f3bb1115-8a82-4fac-ab27-0466ddac1590 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:56.986750 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-115cb471-f973-44ce-a3fe-5f00382bf484 req-f3bb1115-8a82-4fac-ab27-0466ddac1590 service nova] Creating event network-changed:8b3d8d2b-c04a-49f0-ac61-050342907eee for instance ef88e251-1a54-4519-ba22-ddcfa39451f9 on n-h2-master-1 Oct 30 01:37:56.996995 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-115cb471-f973-44ce-a3fe-5f00382bf484 req-f3bb1115-8a82-4fac-ab27-0466ddac1590 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044680 Oct 30 01:37:57.000145 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2525/5042] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:37:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:37:57.145971 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d78bab6a-e433-4a7c-953a-2f98eaa33997 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:57.146913 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d78bab6a-e433-4a7c-953a-2f98eaa33997 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 3fb366e7-0a5c-4bf8-944b-d9140af2c65c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:57.160973 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d78bab6a-e433-4a7c-953a-2f98eaa33997 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:57.161512 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d78bab6a-e433-4a7c-953a-2f98eaa33997 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:57.161956 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d78bab6a-e433-4a7c-953a-2f98eaa33997 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:57.162673 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d78bab6a-e433-4a7c-953a-2f98eaa33997 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:57.163174 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d78bab6a-e433-4a7c-953a-2f98eaa33997 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:57.163602 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d78bab6a-e433-4a7c-953a-2f98eaa33997 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:57.753578 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d78bab6a-e433-4a7c-953a-2f98eaa33997 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:57.769683 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d78bab6a-e433-4a7c-953a-2f98eaa33997 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c" status: 200 len: 1318 microversion: 2.1 time: 0.627211 Oct 30 01:37:57.775987 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2518/5043] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:37:57 2022] GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c => generated 1318 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:37:58.797187 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4a962282-e29e-4838-8df3-d7e98af316f9 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:37:58.798687 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4a962282-e29e-4838-8df3-d7e98af316f9 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 3fb366e7-0a5c-4bf8-944b-d9140af2c65c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:37:58.809153 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4a962282-e29e-4838-8df3-d7e98af316f9 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:58.810586 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4a962282-e29e-4838-8df3-d7e98af316f9 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:58.811536 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4a962282-e29e-4838-8df3-d7e98af316f9 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:58.821384 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4a962282-e29e-4838-8df3-d7e98af316f9 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:37:58.823482 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4a962282-e29e-4838-8df3-d7e98af316f9 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:37:58.824240 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4a962282-e29e-4838-8df3-d7e98af316f9 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:37:59.401464 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4a962282-e29e-4838-8df3-d7e98af316f9 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:37:59.412258 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4a962282-e29e-4838-8df3-d7e98af316f9 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c" status: 200 len: 1318 microversion: 2.1 time: 0.620720 Oct 30 01:37:59.413212 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2526/5044] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:37:58 2022] GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c => generated 1318 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:38:00.379355 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f63351ac-f327-407e-8a72-bdee37b3c4e2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:00.379992 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f63351ac-f327-407e-8a72-bdee37b3c4e2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:00.394823 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f63351ac-f327-407e-8a72-bdee37b3c4e2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:00.398381 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f63351ac-f327-407e-8a72-bdee37b3c4e2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:00.398924 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f63351ac-f327-407e-8a72-bdee37b3c4e2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:00.400448 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f63351ac-f327-407e-8a72-bdee37b3c4e2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:00.403460 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f63351ac-f327-407e-8a72-bdee37b3c4e2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:00.404260 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f63351ac-f327-407e-8a72-bdee37b3c4e2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:00.436514 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0656d019-e4d3-4b8a-a11c-32a1e9ab9ba1 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:00.437894 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0656d019-e4d3-4b8a-a11c-32a1e9ab9ba1 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 3fb366e7-0a5c-4bf8-944b-d9140af2c65c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:00.445643 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f63351ac-f327-407e-8a72-bdee37b3c4e2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb/ips" status: 200 len: 151 microversion: 2.20 time: 0.069107 Oct 30 01:38:00.457067 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0656d019-e4d3-4b8a-a11c-32a1e9ab9ba1 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:00.459280 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0656d019-e4d3-4b8a-a11c-32a1e9ab9ba1 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:00.460527 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0656d019-e4d3-4b8a-a11c-32a1e9ab9ba1 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:00.465726 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0656d019-e4d3-4b8a-a11c-32a1e9ab9ba1 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:00.468180 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0656d019-e4d3-4b8a-a11c-32a1e9ab9ba1 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:00.469567 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2519/5045] 10.222.0.13 () {60 vars in 1289 bytes} [Sun Oct 30 01:38:00 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb/ips => generated 151 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:38:00.469732 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0656d019-e4d3-4b8a-a11c-32a1e9ab9ba1 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:00.502891 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-e00546ed-0241-471a-a269-4f1a23427c88 req-c1b1d657-aa75-46e0-8d84-c6cacb09e9f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fb366e7-0a5c-4bf8-944b-d9140af2c65c", "tag": "62886100-a2f3-42b7-8749-4061d7beb594"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:38:00.531836 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:38:00.555191 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-e00546ed-0241-471a-a269-4f1a23427c88 req-c1b1d657-aa75-46e0-8d84-c6cacb09e9f6 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:00.559092 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-e00546ed-0241-471a-a269-4f1a23427c88 req-c1b1d657-aa75-46e0-8d84-c6cacb09e9f6 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:00.560537 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-e00546ed-0241-471a-a269-4f1a23427c88 req-c1b1d657-aa75-46e0-8d84-c6cacb09e9f6 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:00.597247 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-e00546ed-0241-471a-a269-4f1a23427c88 req-c1b1d657-aa75-46e0-8d84-c6cacb09e9f6 service nova] Creating event network-changed:62886100-a2f3-42b7-8749-4061d7beb594 for instance 3fb366e7-0a5c-4bf8-944b-d9140af2c65c on n-h1-master-1 Oct 30 01:38:00.628220 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-e00546ed-0241-471a-a269-4f1a23427c88 req-c1b1d657-aa75-46e0-8d84-c6cacb09e9f6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137920 Oct 30 01:38:00.635302 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2520/5046] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:38:00.906329 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0656d019-e4d3-4b8a-a11c-32a1e9ab9ba1 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:00.923558 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0656d019-e4d3-4b8a-a11c-32a1e9ab9ba1 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c" status: 200 len: 1318 microversion: 2.1 time: 0.490775 Oct 30 01:38:00.926214 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2527/5047] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:38:00 2022] GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c => generated 1318 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:38:01.952828 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1b1a5650-c504-4f50-9882-2227cb5a7b67 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:01.953879 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1b1a5650-c504-4f50-9882-2227cb5a7b67 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 3fb366e7-0a5c-4bf8-944b-d9140af2c65c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:01.956436 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:38:01.957358 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=6 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:38:01.983980 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1b1a5650-c504-4f50-9882-2227cb5a7b67 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:01.987047 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1b1a5650-c504-4f50-9882-2227cb5a7b67 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:01.988142 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1b1a5650-c504-4f50-9882-2227cb5a7b67 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:01.990048 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1b1a5650-c504-4f50-9882-2227cb5a7b67 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:01.991305 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1b1a5650-c504-4f50-9882-2227cb5a7b67 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:01.992789 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1b1a5650-c504-4f50-9882-2227cb5a7b67 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:02.301665 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1b1a5650-c504-4f50-9882-2227cb5a7b67 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:02.309670 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1b1a5650-c504-4f50-9882-2227cb5a7b67 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c" status: 200 len: 1318 microversion: 2.1 time: 0.361119 Oct 30 01:38:02.311083 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2521/5048] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:38:01 2022] GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c => generated 1318 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:38:03.336864 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9ea4ca26-e32e-4f84-822d-377bf1dda6cf tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:03.339769 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9ea4ca26-e32e-4f84-822d-377bf1dda6cf tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 3fb366e7-0a5c-4bf8-944b-d9140af2c65c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:03.387998 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=4 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:38:03.387998 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9ea4ca26-e32e-4f84-822d-377bf1dda6cf tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:03.387998 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9ea4ca26-e32e-4f84-822d-377bf1dda6cf tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:03.387998 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9ea4ca26-e32e-4f84-822d-377bf1dda6cf tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:03.387998 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9ea4ca26-e32e-4f84-822d-377bf1dda6cf tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:03.387998 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9ea4ca26-e32e-4f84-822d-377bf1dda6cf tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:03.387998 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9ea4ca26-e32e-4f84-822d-377bf1dda6cf tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:03.889880 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9ea4ca26-e32e-4f84-822d-377bf1dda6cf tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:03.905282 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9ea4ca26-e32e-4f84-822d-377bf1dda6cf tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c" status: 200 len: 1318 microversion: 2.1 time: 0.572748 Oct 30 01:38:03.907184 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2528/5049] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:38:03 2022] GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c => generated 1318 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:38:04.933646 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b2617fb0-0bd8-49d8-af8f-a46aa4145262 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:04.934286 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b2617fb0-0bd8-49d8-af8f-a46aa4145262 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 3fb366e7-0a5c-4bf8-944b-d9140af2c65c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:04.981684 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:38:05.013696 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2617fb0-0bd8-49d8-af8f-a46aa4145262 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:05.014242 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2617fb0-0bd8-49d8-af8f-a46aa4145262 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:05.014696 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2617fb0-0bd8-49d8-af8f-a46aa4145262 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:05.015420 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2617fb0-0bd8-49d8-af8f-a46aa4145262 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:05.015906 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2617fb0-0bd8-49d8-af8f-a46aa4145262 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:05.016403 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2617fb0-0bd8-49d8-af8f-a46aa4145262 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:05.322699 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b2617fb0-0bd8-49d8-af8f-a46aa4145262 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:05.333054 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b2617fb0-0bd8-49d8-af8f-a46aa4145262 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c" status: 200 len: 1318 microversion: 2.1 time: 0.404239 Oct 30 01:38:05.346325 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2522/5050] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:38:04 2022] GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c => generated 1318 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:38:05.450910 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-45ae8368-7ade-497c-ae62-4d4d4ddbb7ae req-eb4c9cdb-64b0-49cc-b25b-8c4de3b54944 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fb366e7-0a5c-4bf8-944b-d9140af2c65c", "name": "network-vif-plugged", "status": "completed", "tag": "62886100-a2f3-42b7-8749-4061d7beb594"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:38:05.499422 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-45ae8368-7ade-497c-ae62-4d4d4ddbb7ae req-eb4c9cdb-64b0-49cc-b25b-8c4de3b54944 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:05.499977 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-45ae8368-7ade-497c-ae62-4d4d4ddbb7ae req-eb4c9cdb-64b0-49cc-b25b-8c4de3b54944 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:05.502308 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-45ae8368-7ade-497c-ae62-4d4d4ddbb7ae req-eb4c9cdb-64b0-49cc-b25b-8c4de3b54944 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:05.522924 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e1b9b8a8-3cbe-448c-9ac1-5e527a252abf tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:38:05.525476 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e1b9b8a8-3cbe-448c-9ac1-5e527a252abf tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:05.533529 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e1b9b8a8-3cbe-448c-9ac1-5e527a252abf tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:05.535881 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e1b9b8a8-3cbe-448c-9ac1-5e527a252abf tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:05.535881 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e1b9b8a8-3cbe-448c-9ac1-5e527a252abf tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:05.535881 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e1b9b8a8-3cbe-448c-9ac1-5e527a252abf tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:05.536380 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e1b9b8a8-3cbe-448c-9ac1-5e527a252abf tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:05.537233 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e1b9b8a8-3cbe-448c-9ac1-5e527a252abf tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:05.565869 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-45ae8368-7ade-497c-ae62-4d4d4ddbb7ae req-eb4c9cdb-64b0-49cc-b25b-8c4de3b54944 service nova] Creating event network-vif-plugged:62886100-a2f3-42b7-8749-4061d7beb594 for instance 3fb366e7-0a5c-4bf8-944b-d9140af2c65c on n-h1-master-1 Oct 30 01:38:05.573734 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-e1b9b8a8-3cbe-448c-9ac1-5e527a252abf tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lazy-loading 'flavor' on Instance uuid a5389398-bf67-44ff-a1fb-a26e4a079fcb {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:38:05.586305 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-45ae8368-7ade-497c-ae62-4d4d4ddbb7ae req-eb4c9cdb-64b0-49cc-b25b-8c4de3b54944 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141758 Oct 30 01:38:05.588747 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2529/5051] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:38:06.279567 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e1b9b8a8-3cbe-448c-9ac1-5e527a252abf tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "POST /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb/action" status: 202 len: 0 microversion: 2.20 time: 0.763389 Oct 30 01:38:06.280467 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2523/5052] 10.222.0.13 () {62 vars in 1319 bytes} [Sun Oct 30 01:38:05 2022] POST /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb/action => generated 0 bytes in 767 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:38:06.289327 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f73de8e3-d762-41a4-a4b2-21a2c14f8db5 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:06.291123 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f73de8e3-d762-41a4-a4b2-21a2c14f8db5 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:06.299063 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f73de8e3-d762-41a4-a4b2-21a2c14f8db5 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:06.299938 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f73de8e3-d762-41a4-a4b2-21a2c14f8db5 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:06.300378 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f73de8e3-d762-41a4-a4b2-21a2c14f8db5 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:06.301157 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f73de8e3-d762-41a4-a4b2-21a2c14f8db5 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:06.301716 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f73de8e3-d762-41a4-a4b2-21a2c14f8db5 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:06.302227 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f73de8e3-d762-41a4-a4b2-21a2c14f8db5 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:06.362388 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4fdbc6c5-bf5a-42ec-9fa1-0832b3f464bd tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:06.363123 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4fdbc6c5-bf5a-42ec-9fa1-0832b3f464bd tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 3fb366e7-0a5c-4bf8-944b-d9140af2c65c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:06.379005 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4fdbc6c5-bf5a-42ec-9fa1-0832b3f464bd tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:06.382825 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4fdbc6c5-bf5a-42ec-9fa1-0832b3f464bd tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:06.383360 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4fdbc6c5-bf5a-42ec-9fa1-0832b3f464bd tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:06.388404 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4fdbc6c5-bf5a-42ec-9fa1-0832b3f464bd tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:06.389584 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4fdbc6c5-bf5a-42ec-9fa1-0832b3f464bd tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:06.390870 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4fdbc6c5-bf5a-42ec-9fa1-0832b3f464bd tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:06.730711 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f73de8e3-d762-41a4-a4b2-21a2c14f8db5 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:06.733519 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4fdbc6c5-bf5a-42ec-9fa1-0832b3f464bd tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:06.742482 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4fdbc6c5-bf5a-42ec-9fa1-0832b3f464bd tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c" status: 200 len: 1318 microversion: 2.1 time: 0.386035 Oct 30 01:38:06.747072 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2524/5053] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:38:06 2022] GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c => generated 1318 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:38:06.771702 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f73de8e3-d762-41a4-a4b2-21a2c14f8db5 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:06.777316 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f73de8e3-d762-41a4-a4b2-21a2c14f8db5 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:06.778856 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f73de8e3-d762-41a4-a4b2-21a2c14f8db5 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1722 microversion: 2.20 time: 0.494016 Oct 30 01:38:06.782167 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2530/5054] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:38:06 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1722 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:38:07.772166 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2279d3b5-4fa1-443b-8f4f-01ded80e88c6 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:07.773864 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2279d3b5-4fa1-443b-8f4f-01ded80e88c6 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 3fb366e7-0a5c-4bf8-944b-d9140af2c65c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:07.797029 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2279d3b5-4fa1-443b-8f4f-01ded80e88c6 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:07.797967 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2279d3b5-4fa1-443b-8f4f-01ded80e88c6 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:07.798573 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2279d3b5-4fa1-443b-8f4f-01ded80e88c6 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:07.799736 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2279d3b5-4fa1-443b-8f4f-01ded80e88c6 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:07.800831 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2279d3b5-4fa1-443b-8f4f-01ded80e88c6 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:07.803047 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2279d3b5-4fa1-443b-8f4f-01ded80e88c6 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:07.810108 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-92dc52df-889b-4876-9073-529285e632d6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:07.815741 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-92dc52df-889b-4876-9073-529285e632d6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:07.822908 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-92dc52df-889b-4876-9073-529285e632d6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:07.823762 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-92dc52df-889b-4876-9073-529285e632d6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:07.824278 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-92dc52df-889b-4876-9073-529285e632d6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:07.825066 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-92dc52df-889b-4876-9073-529285e632d6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:07.826008 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-92dc52df-889b-4876-9073-529285e632d6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:07.826646 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-92dc52df-889b-4876-9073-529285e632d6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:07.834763 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:38:08.750758 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2279d3b5-4fa1-443b-8f4f-01ded80e88c6 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:08.768227 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2279d3b5-4fa1-443b-8f4f-01ded80e88c6 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c" status: 200 len: 1508 microversion: 2.1 time: 1.003929 Oct 30 01:38:08.771897 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2525/5055] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:38:07 2022] GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c => generated 1508 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:38:08.794098 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d5acd156-275a-4ebf-8c67-a014dcc2bdd9 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:08.794798 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d5acd156-275a-4ebf-8c67-a014dcc2bdd9 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 3fb366e7-0a5c-4bf8-944b-d9140af2c65c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:08.807729 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5acd156-275a-4ebf-8c67-a014dcc2bdd9 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:08.808531 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5acd156-275a-4ebf-8c67-a014dcc2bdd9 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:08.809214 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5acd156-275a-4ebf-8c67-a014dcc2bdd9 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:08.811647 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5acd156-275a-4ebf-8c67-a014dcc2bdd9 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:08.812277 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5acd156-275a-4ebf-8c67-a014dcc2bdd9 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:08.813164 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5acd156-275a-4ebf-8c67-a014dcc2bdd9 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:08.819743 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-92dc52df-889b-4876-9073-529285e632d6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:08.834310 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-92dc52df-889b-4876-9073-529285e632d6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:08.846279 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-92dc52df-889b-4876-9073-529285e632d6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:08.847836 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-92dc52df-889b-4876-9073-529285e632d6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1722 microversion: 2.20 time: 1.043307 Oct 30 01:38:08.848919 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2531/5056] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:38:07 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1722 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:38:09.136606 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d5acd156-275a-4ebf-8c67-a014dcc2bdd9 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:09.146752 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d5acd156-275a-4ebf-8c67-a014dcc2bdd9 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c" status: 200 len: 1508 microversion: 2.1 time: 0.354848 Oct 30 01:38:09.148357 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2526/5057] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:38:08 2022] GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c => generated 1508 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:38:09.174283 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7d9409cc-a150-482c-8300-dc3c59aa201a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:38:09.177618 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7d9409cc-a150-482c-8300-dc3c59aa201a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 3fb366e7-0a5c-4bf8-944b-d9140af2c65c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:09.190634 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7d9409cc-a150-482c-8300-dc3c59aa201a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:09.191405 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7d9409cc-a150-482c-8300-dc3c59aa201a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:09.192380 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7d9409cc-a150-482c-8300-dc3c59aa201a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:09.193370 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7d9409cc-a150-482c-8300-dc3c59aa201a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:09.193835 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7d9409cc-a150-482c-8300-dc3c59aa201a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:09.194520 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7d9409cc-a150-482c-8300-dc3c59aa201a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:09.353439 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7d9409cc-a150-482c-8300-dc3c59aa201a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "PUT /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c" status: 200 len: 1080 microversion: 2.1 time: 0.184520 Oct 30 01:38:09.354146 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2532/5058] 10.222.0.13 () {60 vars in 1256 bytes} [Sun Oct 30 01:38:09 2022] PUT /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c => generated 1080 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:38:09.373790 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f2eb70e0-7786-4654-bdf4-ebae0d082bd1 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:09.374448 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f2eb70e0-7786-4654-bdf4-ebae0d082bd1 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 3fb366e7-0a5c-4bf8-944b-d9140af2c65c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:09.380454 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f2eb70e0-7786-4654-bdf4-ebae0d082bd1 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:09.380982 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f2eb70e0-7786-4654-bdf4-ebae0d082bd1 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:09.381463 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f2eb70e0-7786-4654-bdf4-ebae0d082bd1 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:09.382163 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f2eb70e0-7786-4654-bdf4-ebae0d082bd1 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:09.382624 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f2eb70e0-7786-4654-bdf4-ebae0d082bd1 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:09.383055 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f2eb70e0-7786-4654-bdf4-ebae0d082bd1 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:09.672318 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f2eb70e0-7786-4654-bdf4-ebae0d082bd1 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:09.680081 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f2eb70e0-7786-4654-bdf4-ebae0d082bd1 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c" status: 200 len: 1506 microversion: 2.1 time: 0.310109 Oct 30 01:38:09.693534 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2527/5059] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:38:09 2022] GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c => generated 1506 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:38:09.706206 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5158fc9e-a4b6-4538-85b0-45070907330a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:09.707247 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5158fc9e-a4b6-4538-85b0-45070907330a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 3fb366e7-0a5c-4bf8-944b-d9140af2c65c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:09.721676 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5158fc9e-a4b6-4538-85b0-45070907330a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:09.724645 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5158fc9e-a4b6-4538-85b0-45070907330a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:09.725291 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5158fc9e-a4b6-4538-85b0-45070907330a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:09.726692 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5158fc9e-a4b6-4538-85b0-45070907330a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:09.727155 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5158fc9e-a4b6-4538-85b0-45070907330a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:09.728320 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5158fc9e-a4b6-4538-85b0-45070907330a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:09.876106 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-26c72858-d103-40e2-a6c0-998703f7e6f7 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:09.877639 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-26c72858-d103-40e2-a6c0-998703f7e6f7 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:09.900651 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-26c72858-d103-40e2-a6c0-998703f7e6f7 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:09.901824 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-26c72858-d103-40e2-a6c0-998703f7e6f7 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:09.904045 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-26c72858-d103-40e2-a6c0-998703f7e6f7 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:09.908749 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-26c72858-d103-40e2-a6c0-998703f7e6f7 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:09.911981 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-26c72858-d103-40e2-a6c0-998703f7e6f7 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:09.913652 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-26c72858-d103-40e2-a6c0-998703f7e6f7 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:10.279994 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5158fc9e-a4b6-4538-85b0-45070907330a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:10.299210 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5158fc9e-a4b6-4538-85b0-45070907330a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c" status: 200 len: 1506 microversion: 2.1 time: 0.591925 Oct 30 01:38:10.334229 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-26c72858-d103-40e2-a6c0-998703f7e6f7 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:10.344549 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2533/5060] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:38:09 2022] GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c => generated 1506 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:38:10.357714 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d21aaeba-a5d3-4f5e-8efb-4e6991177378 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:38:10.359419 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-26c72858-d103-40e2-a6c0-998703f7e6f7 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:10.361328 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d21aaeba-a5d3-4f5e-8efb-4e6991177378 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 3fb366e7-0a5c-4bf8-944b-d9140af2c65c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:10.364599 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-26c72858-d103-40e2-a6c0-998703f7e6f7 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:10.369751 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-26c72858-d103-40e2-a6c0-998703f7e6f7 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1722 microversion: 2.20 time: 0.497275 Oct 30 01:38:10.381515 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d21aaeba-a5d3-4f5e-8efb-4e6991177378 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:10.381515 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d21aaeba-a5d3-4f5e-8efb-4e6991177378 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:10.381515 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d21aaeba-a5d3-4f5e-8efb-4e6991177378 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:10.382915 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2528/5061] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:38:09 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1722 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:38:10.390472 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d21aaeba-a5d3-4f5e-8efb-4e6991177378 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:10.390472 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d21aaeba-a5d3-4f5e-8efb-4e6991177378 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:10.390472 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d21aaeba-a5d3-4f5e-8efb-4e6991177378 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:10.494633 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-d21aaeba-a5d3-4f5e-8efb-4e6991177378 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:38:10.495069 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-d21aaeba-a5d3-4f5e-8efb-4e6991177378 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:38:10.495744 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-d21aaeba-a5d3-4f5e-8efb-4e6991177378 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:38:10.495976 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-d21aaeba-a5d3-4f5e-8efb-4e6991177378 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:38:10.496396 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-d21aaeba-a5d3-4f5e-8efb-4e6991177378 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:38:10.850339 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d21aaeba-a5d3-4f5e-8efb-4e6991177378 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 3fb366e7-0a5c-4bf8-944b-d9140af2c65c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:10.860587 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d21aaeba-a5d3-4f5e-8efb-4e6991177378 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:10.864381 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d21aaeba-a5d3-4f5e-8efb-4e6991177378 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:10.865495 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d21aaeba-a5d3-4f5e-8efb-4e6991177378 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:10.868205 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d21aaeba-a5d3-4f5e-8efb-4e6991177378 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:10.868796 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d21aaeba-a5d3-4f5e-8efb-4e6991177378 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:10.871648 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d21aaeba-a5d3-4f5e-8efb-4e6991177378 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:10.954683 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d21aaeba-a5d3-4f5e-8efb-4e6991177378 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "POST /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c/action" status: 202 len: 1112 microversion: 2.1 time: 0.607843 Oct 30 01:38:10.955562 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2534/5062] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:38:10 2022] POST /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c/action => generated 1112 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 30 01:38:10.976728 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-87c512a4-628d-4812-b845-e172ee7efa61 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:10.979495 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-87c512a4-628d-4812-b845-e172ee7efa61 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 3fb366e7-0a5c-4bf8-944b-d9140af2c65c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:10.988656 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-87c512a4-628d-4812-b845-e172ee7efa61 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:10.989496 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-87c512a4-628d-4812-b845-e172ee7efa61 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:10.990211 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-87c512a4-628d-4812-b845-e172ee7efa61 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:10.991101 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-87c512a4-628d-4812-b845-e172ee7efa61 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:10.992042 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-87c512a4-628d-4812-b845-e172ee7efa61 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:10.992775 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-87c512a4-628d-4812-b845-e172ee7efa61 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:11.272021 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-87c512a4-628d-4812-b845-e172ee7efa61 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:11.282469 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-87c512a4-628d-4812-b845-e172ee7efa61 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c" status: 200 len: 1517 microversion: 2.1 time: 0.309578 Oct 30 01:38:11.283676 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2529/5063] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:38:10 2022] GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c => generated 1517 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:38:11.403723 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cfe412ea-468c-4a23-9339-e6d06619b35f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:11.404484 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-cfe412ea-468c-4a23-9339-e6d06619b35f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:11.416108 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cfe412ea-468c-4a23-9339-e6d06619b35f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:11.416722 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cfe412ea-468c-4a23-9339-e6d06619b35f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:11.417269 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cfe412ea-468c-4a23-9339-e6d06619b35f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:11.418131 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cfe412ea-468c-4a23-9339-e6d06619b35f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:11.420673 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cfe412ea-468c-4a23-9339-e6d06619b35f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:11.421226 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cfe412ea-468c-4a23-9339-e6d06619b35f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:11.712571 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-cfe412ea-468c-4a23-9339-e6d06619b35f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:11.726196 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-cfe412ea-468c-4a23-9339-e6d06619b35f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:11.730028 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-cfe412ea-468c-4a23-9339-e6d06619b35f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:11.732008 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cfe412ea-468c-4a23-9339-e6d06619b35f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1722 microversion: 2.20 time: 0.332449 Oct 30 01:38:11.750069 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2535/5064] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:38:11 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1722 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:38:12.310668 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-daaab24c-0047-4269-b3d6-74a34bc6dfe0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:12.311293 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-daaab24c-0047-4269-b3d6-74a34bc6dfe0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 3fb366e7-0a5c-4bf8-944b-d9140af2c65c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:12.331277 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-daaab24c-0047-4269-b3d6-74a34bc6dfe0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:12.331277 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-daaab24c-0047-4269-b3d6-74a34bc6dfe0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:12.334312 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-daaab24c-0047-4269-b3d6-74a34bc6dfe0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:12.336568 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-daaab24c-0047-4269-b3d6-74a34bc6dfe0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:12.337820 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-daaab24c-0047-4269-b3d6-74a34bc6dfe0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:12.338444 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-daaab24c-0047-4269-b3d6-74a34bc6dfe0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:12.599131 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-daaab24c-0047-4269-b3d6-74a34bc6dfe0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:12.612734 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-daaab24c-0047-4269-b3d6-74a34bc6dfe0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c" status: 200 len: 1517 microversion: 2.1 time: 0.305872 Oct 30 01:38:12.614026 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2530/5065] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:38:12 2022] GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c => generated 1517 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:38:12.769486 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c1641e2d-b6d5-401f-955d-7b0a7d2655a3 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:12.771211 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c1641e2d-b6d5-401f-955d-7b0a7d2655a3 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:12.782613 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c1641e2d-b6d5-401f-955d-7b0a7d2655a3 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:12.783378 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c1641e2d-b6d5-401f-955d-7b0a7d2655a3 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:12.784690 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c1641e2d-b6d5-401f-955d-7b0a7d2655a3 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:12.785679 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c1641e2d-b6d5-401f-955d-7b0a7d2655a3 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:12.786640 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c1641e2d-b6d5-401f-955d-7b0a7d2655a3 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:12.787837 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c1641e2d-b6d5-401f-955d-7b0a7d2655a3 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:13.014291 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c1641e2d-b6d5-401f-955d-7b0a7d2655a3 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:13.026969 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c1641e2d-b6d5-401f-955d-7b0a7d2655a3 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:13.030208 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c1641e2d-b6d5-401f-955d-7b0a7d2655a3 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:13.031678 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c1641e2d-b6d5-401f-955d-7b0a7d2655a3 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1722 microversion: 2.20 time: 0.274015 Oct 30 01:38:13.032811 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2536/5066] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:38:12 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1722 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:38:13.650292 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0677cd84-de61-4789-8341-54d10782c910 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:13.652616 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0677cd84-de61-4789-8341-54d10782c910 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 3fb366e7-0a5c-4bf8-944b-d9140af2c65c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:13.668130 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0677cd84-de61-4789-8341-54d10782c910 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:13.673065 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0677cd84-de61-4789-8341-54d10782c910 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:13.676192 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0677cd84-de61-4789-8341-54d10782c910 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:13.677077 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0677cd84-de61-4789-8341-54d10782c910 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:13.681677 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0677cd84-de61-4789-8341-54d10782c910 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:13.690239 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0677cd84-de61-4789-8341-54d10782c910 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:14.066938 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9033ab27-63fd-4536-8265-5193bdc17312 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:14.067601 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9033ab27-63fd-4536-8265-5193bdc17312 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:14.083354 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9033ab27-63fd-4536-8265-5193bdc17312 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:14.083875 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9033ab27-63fd-4536-8265-5193bdc17312 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:14.084318 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9033ab27-63fd-4536-8265-5193bdc17312 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:14.085051 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9033ab27-63fd-4536-8265-5193bdc17312 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:14.085543 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9033ab27-63fd-4536-8265-5193bdc17312 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:14.085975 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9033ab27-63fd-4536-8265-5193bdc17312 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:14.200794 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0677cd84-de61-4789-8341-54d10782c910 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:14.231187 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0677cd84-de61-4789-8341-54d10782c910 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c" status: 200 len: 1517 microversion: 2.1 time: 0.581081 Oct 30 01:38:14.231187 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2531/5067] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:38:13 2022] GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c => generated 1517 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:38:14.421106 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9033ab27-63fd-4536-8265-5193bdc17312 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:14.436655 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9033ab27-63fd-4536-8265-5193bdc17312 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:14.439141 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9033ab27-63fd-4536-8265-5193bdc17312 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:14.440840 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9033ab27-63fd-4536-8265-5193bdc17312 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1722 microversion: 2.20 time: 0.377891 Oct 30 01:38:14.454741 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2537/5068] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:38:14 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1722 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:38:15.262404 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e1b3a9a0-9357-489c-bc9a-438fdbd9b2f0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:15.262801 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e1b3a9a0-9357-489c-bc9a-438fdbd9b2f0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 3fb366e7-0a5c-4bf8-944b-d9140af2c65c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:15.279130 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e1b3a9a0-9357-489c-bc9a-438fdbd9b2f0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:15.279624 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e1b3a9a0-9357-489c-bc9a-438fdbd9b2f0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:15.289692 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e1b3a9a0-9357-489c-bc9a-438fdbd9b2f0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:15.289692 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e1b3a9a0-9357-489c-bc9a-438fdbd9b2f0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:15.289692 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e1b3a9a0-9357-489c-bc9a-438fdbd9b2f0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:15.289692 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e1b3a9a0-9357-489c-bc9a-438fdbd9b2f0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:15.471479 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7de564f6-6789-44c9-8409-94795f9cea48 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:15.472834 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7de564f6-6789-44c9-8409-94795f9cea48 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:15.478393 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=56 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:38:15.484785 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7de564f6-6789-44c9-8409-94795f9cea48 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:15.487043 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7de564f6-6789-44c9-8409-94795f9cea48 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:15.491085 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7de564f6-6789-44c9-8409-94795f9cea48 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:15.492406 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7de564f6-6789-44c9-8409-94795f9cea48 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:15.497918 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7de564f6-6789-44c9-8409-94795f9cea48 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:15.503796 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7de564f6-6789-44c9-8409-94795f9cea48 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:15.504859 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e1b3a9a0-9357-489c-bc9a-438fdbd9b2f0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:15.519109 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e1b3a9a0-9357-489c-bc9a-438fdbd9b2f0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c" status: 200 len: 1517 microversion: 2.1 time: 0.266093 Oct 30 01:38:15.520076 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2532/5069] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:38:15 2022] GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c => generated 1517 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:38:15.793596 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7de564f6-6789-44c9-8409-94795f9cea48 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:15.810562 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7de564f6-6789-44c9-8409-94795f9cea48 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:15.812202 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7de564f6-6789-44c9-8409-94795f9cea48 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:15.813639 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7de564f6-6789-44c9-8409-94795f9cea48 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1722 microversion: 2.20 time: 0.347737 Oct 30 01:38:15.814308 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2538/5070] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:38:15 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1722 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:38:16.488237 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ae34671f-8d47-4464-8080-8d5f45c68d9c tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:16.489433 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ae34671f-8d47-4464-8080-8d5f45c68d9c tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:16.497487 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae34671f-8d47-4464-8080-8d5f45c68d9c tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:16.498320 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae34671f-8d47-4464-8080-8d5f45c68d9c tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:16.498991 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae34671f-8d47-4464-8080-8d5f45c68d9c tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:16.499969 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae34671f-8d47-4464-8080-8d5f45c68d9c tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:16.500750 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae34671f-8d47-4464-8080-8d5f45c68d9c tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:16.501360 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae34671f-8d47-4464-8080-8d5f45c68d9c tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:16.547953 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-51036b63-5bf4-45c9-a6b3-41c759aaa8c7 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:16.548569 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-51036b63-5bf4-45c9-a6b3-41c759aaa8c7 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 3fb366e7-0a5c-4bf8-944b-d9140af2c65c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:16.555683 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-51036b63-5bf4-45c9-a6b3-41c759aaa8c7 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:16.556525 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-51036b63-5bf4-45c9-a6b3-41c759aaa8c7 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:16.557189 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-51036b63-5bf4-45c9-a6b3-41c759aaa8c7 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:16.558126 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-51036b63-5bf4-45c9-a6b3-41c759aaa8c7 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:16.559724 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-51036b63-5bf4-45c9-a6b3-41c759aaa8c7 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:16.560371 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-51036b63-5bf4-45c9-a6b3-41c759aaa8c7 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:16.593836 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-ae34671f-8d47-4464-8080-8d5f45c68d9c tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lazy-loading 'services' on Instance uuid 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:38:16.818416 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-51036b63-5bf4-45c9-a6b3-41c759aaa8c7 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:16.828623 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-51036b63-5bf4-45c9-a6b3-41c759aaa8c7 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c" status: 200 len: 1517 microversion: 2.1 time: 0.284854 Oct 30 01:38:16.835200 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2539/5071] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:38:16 2022] GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c => generated 1517 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:38:16.847217 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e6a5cf25-a089-4d3f-9e53-1814876efd79 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:16.847217 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e6a5cf25-a089-4d3f-9e53-1814876efd79 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:16.873820 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ae34671f-8d47-4464-8080-8d5f45c68d9c tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "DELETE /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b/os-volume_attachments/3b2ac5e6-1fb8-4020-b6a0-47436704a80f" status: 202 len: 0 microversion: 2.1 time: 0.389500 Oct 30 01:38:16.874498 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e6a5cf25-a089-4d3f-9e53-1814876efd79 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:16.875189 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2533/5072] 10.222.0.13 () {58 vars in 1416 bytes} [Sun Oct 30 01:38:16 2022] DELETE /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b/os-volume_attachments/3b2ac5e6-1fb8-4020-b6a0-47436704a80f => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:38:16.875870 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e6a5cf25-a089-4d3f-9e53-1814876efd79 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:16.890704 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e6a5cf25-a089-4d3f-9e53-1814876efd79 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:16.893356 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e6a5cf25-a089-4d3f-9e53-1814876efd79 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:16.895613 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e6a5cf25-a089-4d3f-9e53-1814876efd79 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:16.904048 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e6a5cf25-a089-4d3f-9e53-1814876efd79 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:17.309073 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e6a5cf25-a089-4d3f-9e53-1814876efd79 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:17.332228 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e6a5cf25-a089-4d3f-9e53-1814876efd79 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:17.336247 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e6a5cf25-a089-4d3f-9e53-1814876efd79 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:17.338934 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e6a5cf25-a089-4d3f-9e53-1814876efd79 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1722 microversion: 2.20 time: 0.501875 Oct 30 01:38:17.341904 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2540/5073] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:38:16 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1722 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:38:17.903874 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a7a35fed-1a34-40fa-aee7-37b554118167 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:17.910270 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a7a35fed-1a34-40fa-aee7-37b554118167 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 3fb366e7-0a5c-4bf8-944b-d9140af2c65c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:17.928003 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7a35fed-1a34-40fa-aee7-37b554118167 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:17.930171 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7a35fed-1a34-40fa-aee7-37b554118167 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:17.931258 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7a35fed-1a34-40fa-aee7-37b554118167 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:17.933007 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7a35fed-1a34-40fa-aee7-37b554118167 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:17.935615 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7a35fed-1a34-40fa-aee7-37b554118167 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:17.936258 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7a35fed-1a34-40fa-aee7-37b554118167 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:18.222048 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a7a35fed-1a34-40fa-aee7-37b554118167 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:18.230120 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a7a35fed-1a34-40fa-aee7-37b554118167 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c" status: 200 len: 1517 microversion: 2.1 time: 0.370816 Oct 30 01:38:18.230701 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2534/5074] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:38:17 2022] GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c => generated 1517 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:38:18.368270 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-26064d5a-ba9e-45c6-b415-c8158be4fe0d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:18.368857 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-26064d5a-ba9e-45c6-b415-c8158be4fe0d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:18.375832 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-26064d5a-ba9e-45c6-b415-c8158be4fe0d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:18.376322 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-26064d5a-ba9e-45c6-b415-c8158be4fe0d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:18.376757 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-26064d5a-ba9e-45c6-b415-c8158be4fe0d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:18.377481 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-26064d5a-ba9e-45c6-b415-c8158be4fe0d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:18.377937 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-26064d5a-ba9e-45c6-b415-c8158be4fe0d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:18.378356 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-26064d5a-ba9e-45c6-b415-c8158be4fe0d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:18.647393 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-26064d5a-ba9e-45c6-b415-c8158be4fe0d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:18.664292 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-26064d5a-ba9e-45c6-b415-c8158be4fe0d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:18.665361 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-26064d5a-ba9e-45c6-b415-c8158be4fe0d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:18.666725 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-26064d5a-ba9e-45c6-b415-c8158be4fe0d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1743 microversion: 2.20 time: 0.302851 Oct 30 01:38:18.690004 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2541/5075] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:38:18 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1743 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:38:19.255523 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-91c178f8-cedd-486d-997d-678be2142239 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:19.258764 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-91c178f8-cedd-486d-997d-678be2142239 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 3fb366e7-0a5c-4bf8-944b-d9140af2c65c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:19.268307 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-91c178f8-cedd-486d-997d-678be2142239 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:19.268811 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-91c178f8-cedd-486d-997d-678be2142239 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:19.273575 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-91c178f8-cedd-486d-997d-678be2142239 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:19.277601 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-91c178f8-cedd-486d-997d-678be2142239 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:19.278622 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-91c178f8-cedd-486d-997d-678be2142239 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:19.280232 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-91c178f8-cedd-486d-997d-678be2142239 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:19.715938 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-119d6ac9-263e-467b-9136-ef0e4b6d7b16 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:19.716736 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-119d6ac9-263e-467b-9136-ef0e4b6d7b16 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:19.740931 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-119d6ac9-263e-467b-9136-ef0e4b6d7b16 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:19.745015 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-119d6ac9-263e-467b-9136-ef0e4b6d7b16 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:19.745554 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-119d6ac9-263e-467b-9136-ef0e4b6d7b16 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:19.752222 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-119d6ac9-263e-467b-9136-ef0e4b6d7b16 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:19.752822 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-119d6ac9-263e-467b-9136-ef0e4b6d7b16 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:19.758095 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-119d6ac9-263e-467b-9136-ef0e4b6d7b16 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:19.779899 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:38:19.791013 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-91c178f8-cedd-486d-997d-678be2142239 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:19.806247 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-91c178f8-cedd-486d-997d-678be2142239 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c" status: 200 len: 1517 microversion: 2.1 time: 0.555667 Oct 30 01:38:19.831113 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2535/5076] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:38:19 2022] GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c => generated 1517 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:38:20.209554 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-df910eb3-43a8-4d10-97c5-78a758c78af2 req-385627cf-855b-40b9-a503-e07272f6c7c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5389398-bf67-44ff-a1fb-a26e4a079fcb", "name": "network-vif-plugged", "status": "completed", "tag": "5fdf7d37-8815-4dca-ba2d-d6297f9d29eb"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:38:20.256736 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-df910eb3-43a8-4d10-97c5-78a758c78af2 req-385627cf-855b-40b9-a503-e07272f6c7c7 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:20.257449 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-df910eb3-43a8-4d10-97c5-78a758c78af2 req-385627cf-855b-40b9-a503-e07272f6c7c7 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:20.257730 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-df910eb3-43a8-4d10-97c5-78a758c78af2 req-385627cf-855b-40b9-a503-e07272f6c7c7 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:20.321314 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-df910eb3-43a8-4d10-97c5-78a758c78af2 req-385627cf-855b-40b9-a503-e07272f6c7c7 service nova] Creating event network-vif-plugged:5fdf7d37-8815-4dca-ba2d-d6297f9d29eb for instance a5389398-bf67-44ff-a1fb-a26e4a079fcb on n-h2-master-1 Oct 30 01:38:20.340739 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-df910eb3-43a8-4d10-97c5-78a758c78af2 req-385627cf-855b-40b9-a503-e07272f6c7c7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133749 Oct 30 01:38:20.342330 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2536/5077] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:38:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:38:20.582486 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-119d6ac9-263e-467b-9136-ef0e4b6d7b16 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:20.596888 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-119d6ac9-263e-467b-9136-ef0e4b6d7b16 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:20.604508 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-119d6ac9-263e-467b-9136-ef0e4b6d7b16 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:20.606185 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-119d6ac9-263e-467b-9136-ef0e4b6d7b16 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1738 microversion: 2.20 time: 0.894847 Oct 30 01:38:20.610781 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2542/5078] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:38:19 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1738 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:38:20.837669 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6695a032-524c-4293-8f9b-e29aba28250d tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:20.838661 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6695a032-524c-4293-8f9b-e29aba28250d tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 3fb366e7-0a5c-4bf8-944b-d9140af2c65c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:20.852520 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6695a032-524c-4293-8f9b-e29aba28250d tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:20.853202 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6695a032-524c-4293-8f9b-e29aba28250d tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:20.853912 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6695a032-524c-4293-8f9b-e29aba28250d tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:20.854828 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6695a032-524c-4293-8f9b-e29aba28250d tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:20.855453 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6695a032-524c-4293-8f9b-e29aba28250d tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:20.856052 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6695a032-524c-4293-8f9b-e29aba28250d tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:21.450065 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6695a032-524c-4293-8f9b-e29aba28250d tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:21.463695 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6695a032-524c-4293-8f9b-e29aba28250d tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c" status: 200 len: 1517 microversion: 2.1 time: 0.630206 Oct 30 01:38:21.493362 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2537/5079] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:38:20 2022] GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c => generated 1517 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:38:21.642877 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8574c7b7-a1c3-48fe-82e3-65781bbfccb2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:21.643497 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8574c7b7-a1c3-48fe-82e3-65781bbfccb2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:21.652455 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8574c7b7-a1c3-48fe-82e3-65781bbfccb2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:21.652945 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8574c7b7-a1c3-48fe-82e3-65781bbfccb2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:21.653414 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8574c7b7-a1c3-48fe-82e3-65781bbfccb2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:21.654151 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8574c7b7-a1c3-48fe-82e3-65781bbfccb2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:21.654596 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8574c7b7-a1c3-48fe-82e3-65781bbfccb2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:21.655030 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8574c7b7-a1c3-48fe-82e3-65781bbfccb2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:22.042998 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8574c7b7-a1c3-48fe-82e3-65781bbfccb2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:22.058603 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8574c7b7-a1c3-48fe-82e3-65781bbfccb2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:22.063672 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8574c7b7-a1c3-48fe-82e3-65781bbfccb2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:22.077120 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8574c7b7-a1c3-48fe-82e3-65781bbfccb2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1738 microversion: 2.20 time: 0.427303 Oct 30 01:38:22.077826 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2543/5080] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:38:21 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1738 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:38:22.505982 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bd57bbb7-ca1e-4e6d-a4f0-02c80e96fc96 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:22.506566 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bd57bbb7-ca1e-4e6d-a4f0-02c80e96fc96 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 3fb366e7-0a5c-4bf8-944b-d9140af2c65c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:22.515738 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bd57bbb7-ca1e-4e6d-a4f0-02c80e96fc96 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:22.516536 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bd57bbb7-ca1e-4e6d-a4f0-02c80e96fc96 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:22.517155 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bd57bbb7-ca1e-4e6d-a4f0-02c80e96fc96 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:22.519703 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bd57bbb7-ca1e-4e6d-a4f0-02c80e96fc96 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:22.520583 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bd57bbb7-ca1e-4e6d-a4f0-02c80e96fc96 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:22.521195 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bd57bbb7-ca1e-4e6d-a4f0-02c80e96fc96 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:22.819352 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bd57bbb7-ca1e-4e6d-a4f0-02c80e96fc96 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:22.829476 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bd57bbb7-ca1e-4e6d-a4f0-02c80e96fc96 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c" status: 200 len: 1517 microversion: 2.1 time: 0.327195 Oct 30 01:38:22.847737 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2538/5081] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:38:22 2022] GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c => generated 1517 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:38:23.108158 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b4391008-962d-4097-8411-fa9210b1352f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:23.108917 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b4391008-962d-4097-8411-fa9210b1352f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:23.126734 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4391008-962d-4097-8411-fa9210b1352f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:23.127455 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4391008-962d-4097-8411-fa9210b1352f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:23.129677 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4391008-962d-4097-8411-fa9210b1352f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:23.132339 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4391008-962d-4097-8411-fa9210b1352f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:23.136407 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4391008-962d-4097-8411-fa9210b1352f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:23.136918 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4391008-962d-4097-8411-fa9210b1352f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:23.396807 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b4391008-962d-4097-8411-fa9210b1352f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:23.409549 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b4391008-962d-4097-8411-fa9210b1352f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:23.412266 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b4391008-962d-4097-8411-fa9210b1352f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:23.425385 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b4391008-962d-4097-8411-fa9210b1352f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1738 microversion: 2.20 time: 0.311096 Oct 30 01:38:23.425385 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2544/5082] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:38:23 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1738 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:38:23.859174 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3db168e1-77e6-427e-8437-6cb1469d38b5 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:23.859174 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3db168e1-77e6-427e-8437-6cb1469d38b5 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 3fb366e7-0a5c-4bf8-944b-d9140af2c65c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:23.868561 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3db168e1-77e6-427e-8437-6cb1469d38b5 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:23.869051 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3db168e1-77e6-427e-8437-6cb1469d38b5 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:23.879882 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3db168e1-77e6-427e-8437-6cb1469d38b5 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:23.881081 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3db168e1-77e6-427e-8437-6cb1469d38b5 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:23.887225 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3db168e1-77e6-427e-8437-6cb1469d38b5 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:23.890279 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3db168e1-77e6-427e-8437-6cb1469d38b5 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:24.432631 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3db168e1-77e6-427e-8437-6cb1469d38b5 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:24.441046 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3db168e1-77e6-427e-8437-6cb1469d38b5 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c" status: 200 len: 1517 microversion: 2.1 time: 0.589839 Oct 30 01:38:24.449775 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b904cd1b-2a48-4bed-ac01-c9f869bc5b30 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:24.450591 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b904cd1b-2a48-4bed-ac01-c9f869bc5b30 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:24.469491 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2539/5083] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:38:23 2022] GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c => generated 1517 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:38:24.470161 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b904cd1b-2a48-4bed-ac01-c9f869bc5b30 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:24.470161 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b904cd1b-2a48-4bed-ac01-c9f869bc5b30 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:24.470161 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b904cd1b-2a48-4bed-ac01-c9f869bc5b30 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:24.470161 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b904cd1b-2a48-4bed-ac01-c9f869bc5b30 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:24.470161 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b904cd1b-2a48-4bed-ac01-c9f869bc5b30 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:24.470161 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b904cd1b-2a48-4bed-ac01-c9f869bc5b30 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:24.997786 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b904cd1b-2a48-4bed-ac01-c9f869bc5b30 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:25.010169 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b904cd1b-2a48-4bed-ac01-c9f869bc5b30 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:25.012968 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b904cd1b-2a48-4bed-ac01-c9f869bc5b30 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:25.034485 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b904cd1b-2a48-4bed-ac01-c9f869bc5b30 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1738 microversion: 2.20 time: 0.585387 Oct 30 01:38:25.046477 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2545/5084] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:38:24 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1738 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:38:25.484516 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-08e03d9c-cf83-4027-b095-00421ccda2f4 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:25.485135 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-08e03d9c-cf83-4027-b095-00421ccda2f4 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 3fb366e7-0a5c-4bf8-944b-d9140af2c65c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:25.528415 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08e03d9c-cf83-4027-b095-00421ccda2f4 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:25.528823 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08e03d9c-cf83-4027-b095-00421ccda2f4 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:25.541664 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08e03d9c-cf83-4027-b095-00421ccda2f4 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:25.546522 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08e03d9c-cf83-4027-b095-00421ccda2f4 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:25.547302 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08e03d9c-cf83-4027-b095-00421ccda2f4 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:25.573942 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08e03d9c-cf83-4027-b095-00421ccda2f4 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:26.067151 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-08e03d9c-cf83-4027-b095-00421ccda2f4 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:26.076166 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0252b8a0-f875-4abf-98c3-8615bab7de84 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:26.077442 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0252b8a0-f875-4abf-98c3-8615bab7de84 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:26.097474 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0252b8a0-f875-4abf-98c3-8615bab7de84 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:26.101138 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-08e03d9c-cf83-4027-b095-00421ccda2f4 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c" status: 200 len: 1517 microversion: 2.1 time: 0.622663 Oct 30 01:38:26.106570 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2540/5085] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:38:25 2022] GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c => generated 1517 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:38:26.110682 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0252b8a0-f875-4abf-98c3-8615bab7de84 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:26.118631 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0252b8a0-f875-4abf-98c3-8615bab7de84 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:26.119955 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0252b8a0-f875-4abf-98c3-8615bab7de84 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:26.121215 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0252b8a0-f875-4abf-98c3-8615bab7de84 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:26.122461 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0252b8a0-f875-4abf-98c3-8615bab7de84 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:26.662552 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0252b8a0-f875-4abf-98c3-8615bab7de84 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:26.680408 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0252b8a0-f875-4abf-98c3-8615bab7de84 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:26.688224 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0252b8a0-f875-4abf-98c3-8615bab7de84 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:26.689524 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0252b8a0-f875-4abf-98c3-8615bab7de84 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1738 microversion: 2.20 time: 0.617795 Oct 30 01:38:26.690105 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2546/5086] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:38:26 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1738 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:38:27.137107 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-68aae4b5-262f-43a6-a67f-7c25561fcf02 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:27.138823 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-68aae4b5-262f-43a6-a67f-7c25561fcf02 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 3fb366e7-0a5c-4bf8-944b-d9140af2c65c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:27.160175 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-68aae4b5-262f-43a6-a67f-7c25561fcf02 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:27.160713 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-68aae4b5-262f-43a6-a67f-7c25561fcf02 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:27.164986 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-68aae4b5-262f-43a6-a67f-7c25561fcf02 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:27.172529 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-68aae4b5-262f-43a6-a67f-7c25561fcf02 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:27.175366 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-68aae4b5-262f-43a6-a67f-7c25561fcf02 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:27.176111 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-68aae4b5-262f-43a6-a67f-7c25561fcf02 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:27.723249 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-83192662-bd13-4623-8aa5-87b6828db7ec tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:27.725198 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-83192662-bd13-4623-8aa5-87b6828db7ec tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:27.733573 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-83192662-bd13-4623-8aa5-87b6828db7ec tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:27.734605 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-83192662-bd13-4623-8aa5-87b6828db7ec tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:27.738508 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-83192662-bd13-4623-8aa5-87b6828db7ec tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:27.738508 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-83192662-bd13-4623-8aa5-87b6828db7ec tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:27.738508 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-83192662-bd13-4623-8aa5-87b6828db7ec tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:27.738508 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-83192662-bd13-4623-8aa5-87b6828db7ec tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:28.263097 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-68aae4b5-262f-43a6-a67f-7c25561fcf02 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:28.269544 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:38:28.271837 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-68aae4b5-262f-43a6-a67f-7c25561fcf02 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c" status: 200 len: 1517 microversion: 2.1 time: 1.143493 Oct 30 01:38:28.296235 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2541/5087] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:38:27 2022] GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c => generated 1517 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:38:28.468396 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-83192662-bd13-4623-8aa5-87b6828db7ec tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:28.478299 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-83192662-bd13-4623-8aa5-87b6828db7ec tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:28.487299 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-83192662-bd13-4623-8aa5-87b6828db7ec tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:28.488542 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-83192662-bd13-4623-8aa5-87b6828db7ec tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1738 microversion: 2.20 time: 0.771288 Oct 30 01:38:28.502389 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2547/5088] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:38:27 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1738 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:38:29.306902 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3c8c7c7f-1d61-4407-a5f4-5fa60a07ba7e tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:29.307606 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3c8c7c7f-1d61-4407-a5f4-5fa60a07ba7e tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 3fb366e7-0a5c-4bf8-944b-d9140af2c65c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:29.317493 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3c8c7c7f-1d61-4407-a5f4-5fa60a07ba7e tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:29.317895 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3c8c7c7f-1d61-4407-a5f4-5fa60a07ba7e tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:29.318375 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3c8c7c7f-1d61-4407-a5f4-5fa60a07ba7e tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:29.319134 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3c8c7c7f-1d61-4407-a5f4-5fa60a07ba7e tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:29.319589 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3c8c7c7f-1d61-4407-a5f4-5fa60a07ba7e tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:29.320287 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3c8c7c7f-1d61-4407-a5f4-5fa60a07ba7e tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:29.526258 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-85259e3e-8b20-4af7-99d6-6c054c7868bc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:29.526258 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-85259e3e-8b20-4af7-99d6-6c054c7868bc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:29.541493 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-85259e3e-8b20-4af7-99d6-6c054c7868bc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:29.542000 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-85259e3e-8b20-4af7-99d6-6c054c7868bc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:29.542445 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-85259e3e-8b20-4af7-99d6-6c054c7868bc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:29.547652 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-85259e3e-8b20-4af7-99d6-6c054c7868bc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:29.548337 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-85259e3e-8b20-4af7-99d6-6c054c7868bc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:29.548799 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-85259e3e-8b20-4af7-99d6-6c054c7868bc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:29.573208 n-d-master-1 devstack@n-api.service[121103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 30 01:38:29.580760 n-d-master-1 devstack@n-api.service[121103]: Sun Oct 30 01:38:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb (ip 10.222.0.13) !!! Oct 30 01:38:29.643920 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3c8c7c7f-1d61-4407-a5f4-5fa60a07ba7e tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:29.673864 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3c8c7c7f-1d61-4407-a5f4-5fa60a07ba7e tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c" status: 200 len: 1517 microversion: 2.1 time: 0.371177 Oct 30 01:38:29.676624 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2542/5089] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:38:29 2022] GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c => generated 1517 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:38:29.697854 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9a33f4aa-fd38-41a7-8528-c5c52aaa47ca tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:38:29.730549 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9a33f4aa-fd38-41a7-8528-c5c52aaa47ca tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:29.730549 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9a33f4aa-fd38-41a7-8528-c5c52aaa47ca tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:29.730549 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9a33f4aa-fd38-41a7-8528-c5c52aaa47ca tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:29.800675 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9a33f4aa-fd38-41a7-8528-c5c52aaa47ca tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Going to try to stop instance {{(pid=121102) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 30 01:38:30.007690 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-85259e3e-8b20-4af7-99d6-6c054c7868bc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:30.020604 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-85259e3e-8b20-4af7-99d6-6c054c7868bc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:30.026265 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-85259e3e-8b20-4af7-99d6-6c054c7868bc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:30.029993 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-85259e3e-8b20-4af7-99d6-6c054c7868bc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1738 microversion: 2.20 time: 0.508258 Oct 30 01:38:30.032753 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2548/5090] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:38:29 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1738 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:38:30.170576 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9a33f4aa-fd38-41a7-8528-c5c52aaa47ca tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "POST /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b/action" status: 202 len: 0 microversion: 2.1 time: 0.477046 Oct 30 01:38:30.175494 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2543/5091] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:38:29 2022] POST /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b/action => generated 0 bytes in 479 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 30 01:38:30.179809 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-509391d1-e0d2-4081-996a-0f2db11cb73a tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:30.180487 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-509391d1-e0d2-4081-996a-0f2db11cb73a tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:30.198770 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-509391d1-e0d2-4081-996a-0f2db11cb73a tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:30.198770 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-509391d1-e0d2-4081-996a-0f2db11cb73a tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:30.198770 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-509391d1-e0d2-4081-996a-0f2db11cb73a tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:30.198770 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-509391d1-e0d2-4081-996a-0f2db11cb73a tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:30.198770 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-509391d1-e0d2-4081-996a-0f2db11cb73a tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:30.198770 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-509391d1-e0d2-4081-996a-0f2db11cb73a tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:30.501852 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-509391d1-e0d2-4081-996a-0f2db11cb73a tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:30.513773 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-509391d1-e0d2-4081-996a-0f2db11cb73a tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b" status: 200 len: 1677 microversion: 2.1 time: 0.337659 Oct 30 01:38:30.515390 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2549/5092] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:38:30 2022] GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b => generated 1677 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:38:30.707893 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c4dd797a-86db-4075-8f29-71c6b314a255 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:30.709236 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c4dd797a-86db-4075-8f29-71c6b314a255 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 3fb366e7-0a5c-4bf8-944b-d9140af2c65c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:30.722181 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4dd797a-86db-4075-8f29-71c6b314a255 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:30.723904 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4dd797a-86db-4075-8f29-71c6b314a255 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:30.724548 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4dd797a-86db-4075-8f29-71c6b314a255 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:30.726182 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4dd797a-86db-4075-8f29-71c6b314a255 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:30.728604 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4dd797a-86db-4075-8f29-71c6b314a255 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:30.729231 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4dd797a-86db-4075-8f29-71c6b314a255 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:30.984025 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c4dd797a-86db-4075-8f29-71c6b314a255 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:31.015073 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c4dd797a-86db-4075-8f29-71c6b314a255 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c" status: 200 len: 1517 microversion: 2.1 time: 0.292052 Oct 30 01:38:31.017859 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2544/5093] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:38:30 2022] GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c => generated 1517 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:38:31.066817 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2346bf50-1e3d-4e1d-9037-bd9aa770e59f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:31.068027 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2346bf50-1e3d-4e1d-9037-bd9aa770e59f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:31.082886 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2346bf50-1e3d-4e1d-9037-bd9aa770e59f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:31.085978 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2346bf50-1e3d-4e1d-9037-bd9aa770e59f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:31.086928 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2346bf50-1e3d-4e1d-9037-bd9aa770e59f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:31.091777 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2346bf50-1e3d-4e1d-9037-bd9aa770e59f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:31.092646 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2346bf50-1e3d-4e1d-9037-bd9aa770e59f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:31.095974 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2346bf50-1e3d-4e1d-9037-bd9aa770e59f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:31.424487 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2346bf50-1e3d-4e1d-9037-bd9aa770e59f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:31.438460 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2346bf50-1e3d-4e1d-9037-bd9aa770e59f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:31.445056 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2346bf50-1e3d-4e1d-9037-bd9aa770e59f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:31.447562 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2346bf50-1e3d-4e1d-9037-bd9aa770e59f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1738 microversion: 2.20 time: 0.386463 Oct 30 01:38:31.462173 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2550/5094] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:38:31 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1738 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:38:31.540802 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7ea5e8ed-8abb-4065-a792-87ae918cf0c0 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:31.541847 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7ea5e8ed-8abb-4065-a792-87ae918cf0c0 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:31.557821 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7ea5e8ed-8abb-4065-a792-87ae918cf0c0 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:31.558234 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7ea5e8ed-8abb-4065-a792-87ae918cf0c0 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:31.558750 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7ea5e8ed-8abb-4065-a792-87ae918cf0c0 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:31.559479 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7ea5e8ed-8abb-4065-a792-87ae918cf0c0 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:31.560125 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7ea5e8ed-8abb-4065-a792-87ae918cf0c0 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:31.561360 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7ea5e8ed-8abb-4065-a792-87ae918cf0c0 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:32.033009 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7ea5e8ed-8abb-4065-a792-87ae918cf0c0 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:32.042531 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-dbf7b015-9bba-4f78-836c-5943edc7b4a5 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:32.043583 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-dbf7b015-9bba-4f78-836c-5943edc7b4a5 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 3fb366e7-0a5c-4bf8-944b-d9140af2c65c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:32.048572 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7ea5e8ed-8abb-4065-a792-87ae918cf0c0 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b" status: 200 len: 1677 microversion: 2.1 time: 0.512164 Oct 30 01:38:32.054652 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dbf7b015-9bba-4f78-836c-5943edc7b4a5 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:32.055948 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2545/5095] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:38:31 2022] GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b => generated 1677 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:38:32.061050 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dbf7b015-9bba-4f78-836c-5943edc7b4a5 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:32.061050 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dbf7b015-9bba-4f78-836c-5943edc7b4a5 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:32.061050 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dbf7b015-9bba-4f78-836c-5943edc7b4a5 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:32.067057 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dbf7b015-9bba-4f78-836c-5943edc7b4a5 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:32.067674 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dbf7b015-9bba-4f78-836c-5943edc7b4a5 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:32.311278 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-dbf7b015-9bba-4f78-836c-5943edc7b4a5 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:32.325259 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-dbf7b015-9bba-4f78-836c-5943edc7b4a5 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c" status: 200 len: 1517 microversion: 2.1 time: 0.286920 Oct 30 01:38:32.335569 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2551/5096] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:38:32 2022] GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c => generated 1517 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:38:32.481070 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4b0b6f0c-f12c-4d39-8e9d-33d090f401ba tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:32.481719 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4b0b6f0c-f12c-4d39-8e9d-33d090f401ba tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:32.493936 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b0b6f0c-f12c-4d39-8e9d-33d090f401ba tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:32.494446 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b0b6f0c-f12c-4d39-8e9d-33d090f401ba tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:32.494887 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b0b6f0c-f12c-4d39-8e9d-33d090f401ba tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:32.503850 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b0b6f0c-f12c-4d39-8e9d-33d090f401ba tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:32.507695 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b0b6f0c-f12c-4d39-8e9d-33d090f401ba tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:32.508878 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b0b6f0c-f12c-4d39-8e9d-33d090f401ba tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:32.908148 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4b0b6f0c-f12c-4d39-8e9d-33d090f401ba tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:32.920833 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4b0b6f0c-f12c-4d39-8e9d-33d090f401ba tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:32.945125 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4b0b6f0c-f12c-4d39-8e9d-33d090f401ba tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:32.965154 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4b0b6f0c-f12c-4d39-8e9d-33d090f401ba tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1738 microversion: 2.20 time: 0.488417 Oct 30 01:38:32.967084 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2546/5097] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:38:32 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1738 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:38:33.074899 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-67628e40-5994-4901-b61f-b1621c496ccf tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:33.075680 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-67628e40-5994-4901-b61f-b1621c496ccf tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:33.095828 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-67628e40-5994-4901-b61f-b1621c496ccf tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:33.100975 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-67628e40-5994-4901-b61f-b1621c496ccf tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:33.100975 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-67628e40-5994-4901-b61f-b1621c496ccf tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:33.100975 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-67628e40-5994-4901-b61f-b1621c496ccf tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:33.100975 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-67628e40-5994-4901-b61f-b1621c496ccf tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:33.100975 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-67628e40-5994-4901-b61f-b1621c496ccf tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:33.357749 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-19a4a277-6b4e-4bfe-9c5c-fbba75a5bf5b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:33.359005 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-19a4a277-6b4e-4bfe-9c5c-fbba75a5bf5b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 3fb366e7-0a5c-4bf8-944b-d9140af2c65c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:33.375519 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-19a4a277-6b4e-4bfe-9c5c-fbba75a5bf5b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:33.378742 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-19a4a277-6b4e-4bfe-9c5c-fbba75a5bf5b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:33.379405 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-19a4a277-6b4e-4bfe-9c5c-fbba75a5bf5b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:33.379955 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-19a4a277-6b4e-4bfe-9c5c-fbba75a5bf5b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:33.386856 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-19a4a277-6b4e-4bfe-9c5c-fbba75a5bf5b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:33.389693 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-19a4a277-6b4e-4bfe-9c5c-fbba75a5bf5b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:33.474686 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-67628e40-5994-4901-b61f-b1621c496ccf tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:33.486090 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-67628e40-5994-4901-b61f-b1621c496ccf tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b" status: 200 len: 1677 microversion: 2.1 time: 0.413746 Oct 30 01:38:33.488371 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2552/5098] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:38:33 2022] GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b => generated 1677 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:38:33.697373 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-19a4a277-6b4e-4bfe-9c5c-fbba75a5bf5b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:33.707133 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-19a4a277-6b4e-4bfe-9c5c-fbba75a5bf5b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c" status: 200 len: 1517 microversion: 2.1 time: 0.353088 Oct 30 01:38:33.722448 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2547/5099] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:38:33 2022] GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c => generated 1517 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:38:34.000403 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c1ca5c20-182a-4545-86a0-3ebdc9ddbd6d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:34.001220 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c1ca5c20-182a-4545-86a0-3ebdc9ddbd6d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:34.019564 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c1ca5c20-182a-4545-86a0-3ebdc9ddbd6d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:34.020374 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c1ca5c20-182a-4545-86a0-3ebdc9ddbd6d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:34.020993 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c1ca5c20-182a-4545-86a0-3ebdc9ddbd6d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:34.021928 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c1ca5c20-182a-4545-86a0-3ebdc9ddbd6d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:34.023085 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c1ca5c20-182a-4545-86a0-3ebdc9ddbd6d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:34.024331 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c1ca5c20-182a-4545-86a0-3ebdc9ddbd6d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:34.514925 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bde9484d-9df4-41c0-92e7-a005f665d0bb tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:34.515481 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bde9484d-9df4-41c0-92e7-a005f665d0bb tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:34.527147 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bde9484d-9df4-41c0-92e7-a005f665d0bb tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:34.532329 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bde9484d-9df4-41c0-92e7-a005f665d0bb tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:34.532329 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bde9484d-9df4-41c0-92e7-a005f665d0bb tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:34.533474 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bde9484d-9df4-41c0-92e7-a005f665d0bb tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:34.534121 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bde9484d-9df4-41c0-92e7-a005f665d0bb tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:34.534850 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c1ca5c20-182a-4545-86a0-3ebdc9ddbd6d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:34.536049 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bde9484d-9df4-41c0-92e7-a005f665d0bb tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:34.549236 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c1ca5c20-182a-4545-86a0-3ebdc9ddbd6d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:34.551022 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c1ca5c20-182a-4545-86a0-3ebdc9ddbd6d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:34.557427 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c1ca5c20-182a-4545-86a0-3ebdc9ddbd6d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1738 microversion: 2.20 time: 0.561092 Oct 30 01:38:34.566764 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2553/5100] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:38:33 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1738 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:38:34.732501 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6044a0a4-e369-47c6-915b-d2296a57662a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:34.733571 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6044a0a4-e369-47c6-915b-d2296a57662a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 3fb366e7-0a5c-4bf8-944b-d9140af2c65c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:34.743274 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6044a0a4-e369-47c6-915b-d2296a57662a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:34.744171 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6044a0a4-e369-47c6-915b-d2296a57662a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:34.749843 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6044a0a4-e369-47c6-915b-d2296a57662a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:34.750961 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6044a0a4-e369-47c6-915b-d2296a57662a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:34.761466 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6044a0a4-e369-47c6-915b-d2296a57662a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:34.762105 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6044a0a4-e369-47c6-915b-d2296a57662a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:34.835675 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bde9484d-9df4-41c0-92e7-a005f665d0bb tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:34.844963 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bde9484d-9df4-41c0-92e7-a005f665d0bb tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b" status: 200 len: 1677 microversion: 2.1 time: 0.335125 Oct 30 01:38:34.845857 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2548/5101] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:38:34 2022] GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b => generated 1677 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:38:35.061596 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6044a0a4-e369-47c6-915b-d2296a57662a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:35.087906 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6044a0a4-e369-47c6-915b-d2296a57662a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c" status: 200 len: 1517 microversion: 2.1 time: 0.359535 Oct 30 01:38:35.092164 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2554/5102] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:38:34 2022] GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c => generated 1517 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:38:35.587412 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c9e9e9a4-a12f-436d-99bc-705344e6f793 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:35.590973 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c9e9e9a4-a12f-436d-99bc-705344e6f793 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:35.596450 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c9e9e9a4-a12f-436d-99bc-705344e6f793 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:35.596938 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c9e9e9a4-a12f-436d-99bc-705344e6f793 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:35.597428 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c9e9e9a4-a12f-436d-99bc-705344e6f793 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:35.598087 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c9e9e9a4-a12f-436d-99bc-705344e6f793 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:35.598592 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c9e9e9a4-a12f-436d-99bc-705344e6f793 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:35.599095 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c9e9e9a4-a12f-436d-99bc-705344e6f793 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:35.875995 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-23b372b8-fbd1-400a-9ae6-2eeb1105aa47 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:35.877141 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-23b372b8-fbd1-400a-9ae6-2eeb1105aa47 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:35.891761 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-23b372b8-fbd1-400a-9ae6-2eeb1105aa47 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:35.893807 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-23b372b8-fbd1-400a-9ae6-2eeb1105aa47 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:35.896663 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-23b372b8-fbd1-400a-9ae6-2eeb1105aa47 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:35.898053 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-23b372b8-fbd1-400a-9ae6-2eeb1105aa47 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:35.901547 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-23b372b8-fbd1-400a-9ae6-2eeb1105aa47 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:35.902147 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-23b372b8-fbd1-400a-9ae6-2eeb1105aa47 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:36.295720 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c9e9e9a4-a12f-436d-99bc-705344e6f793 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:36.318787 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c9e9e9a4-a12f-436d-99bc-705344e6f793 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:36.321554 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c9e9e9a4-a12f-436d-99bc-705344e6f793 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:36.339305 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c9e9e9a4-a12f-436d-99bc-705344e6f793 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1738 microversion: 2.20 time: 0.750313 Oct 30 01:38:36.343367 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2549/5103] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:38:35 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1738 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:38:36.347519 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-23b372b8-fbd1-400a-9ae6-2eeb1105aa47 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:36.370856 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f5fba2b8-4242-4b62-9782-71f3f7f0b661 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:36.370856 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f5fba2b8-4242-4b62-9782-71f3f7f0b661 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 3fb366e7-0a5c-4bf8-944b-d9140af2c65c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:36.378461 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5fba2b8-4242-4b62-9782-71f3f7f0b661 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:36.378881 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-23b372b8-fbd1-400a-9ae6-2eeb1105aa47 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b" status: 200 len: 1677 microversion: 2.1 time: 0.510253 Oct 30 01:38:36.379340 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5fba2b8-4242-4b62-9782-71f3f7f0b661 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:36.393411 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2555/5104] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:38:35 2022] GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b => generated 1677 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:38:36.396350 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5fba2b8-4242-4b62-9782-71f3f7f0b661 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:36.397217 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5fba2b8-4242-4b62-9782-71f3f7f0b661 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:36.405594 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5fba2b8-4242-4b62-9782-71f3f7f0b661 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:36.406809 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5fba2b8-4242-4b62-9782-71f3f7f0b661 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:36.660433 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f5fba2b8-4242-4b62-9782-71f3f7f0b661 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:36.668871 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f5fba2b8-4242-4b62-9782-71f3f7f0b661 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c" status: 200 len: 1517 microversion: 2.1 time: 0.324009 Oct 30 01:38:36.669816 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2550/5105] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:38:36 2022] GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c => generated 1517 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:38:37.385277 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a65f01c1-22b4-4771-b873-c14c38d5e1a8 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:37.388559 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a65f01c1-22b4-4771-b873-c14c38d5e1a8 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:37.416143 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-66267072-f9a2-4467-b282-5bc5c8abd3ff tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:37.416732 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-66267072-f9a2-4467-b282-5bc5c8abd3ff tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:37.423095 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a65f01c1-22b4-4771-b873-c14c38d5e1a8 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:37.423606 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a65f01c1-22b4-4771-b873-c14c38d5e1a8 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:37.424053 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a65f01c1-22b4-4771-b873-c14c38d5e1a8 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:37.424783 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a65f01c1-22b4-4771-b873-c14c38d5e1a8 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:37.425245 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a65f01c1-22b4-4771-b873-c14c38d5e1a8 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:37.425702 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a65f01c1-22b4-4771-b873-c14c38d5e1a8 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:37.437182 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-66267072-f9a2-4467-b282-5bc5c8abd3ff tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:37.438091 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-66267072-f9a2-4467-b282-5bc5c8abd3ff tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:37.438794 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-66267072-f9a2-4467-b282-5bc5c8abd3ff tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:37.439714 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-66267072-f9a2-4467-b282-5bc5c8abd3ff tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:37.440346 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-66267072-f9a2-4467-b282-5bc5c8abd3ff tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:37.441071 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-66267072-f9a2-4467-b282-5bc5c8abd3ff tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:37.709252 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a65f01c1-22b4-4771-b873-c14c38d5e1a8 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:37.721934 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a65f01c1-22b4-4771-b873-c14c38d5e1a8 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:37.723470 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a65f01c1-22b4-4771-b873-c14c38d5e1a8 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:37.724703 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a65f01c1-22b4-4771-b873-c14c38d5e1a8 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1738 microversion: 2.20 time: 0.359997 Oct 30 01:38:37.729709 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2556/5106] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:38:37 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1738 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:38:37.734719 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a56474e8-59c7-466b-afb2-da917f4b0267 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:37.739391 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a56474e8-59c7-466b-afb2-da917f4b0267 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 3fb366e7-0a5c-4bf8-944b-d9140af2c65c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:37.757501 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a56474e8-59c7-466b-afb2-da917f4b0267 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:37.763416 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a56474e8-59c7-466b-afb2-da917f4b0267 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:37.763416 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a56474e8-59c7-466b-afb2-da917f4b0267 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:37.763416 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a56474e8-59c7-466b-afb2-da917f4b0267 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:37.763416 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a56474e8-59c7-466b-afb2-da917f4b0267 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:37.763416 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a56474e8-59c7-466b-afb2-da917f4b0267 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:37.783514 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-66267072-f9a2-4467-b282-5bc5c8abd3ff tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:37.796158 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-66267072-f9a2-4467-b282-5bc5c8abd3ff tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b" status: 200 len: 1677 microversion: 2.1 time: 0.388540 Oct 30 01:38:37.797290 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2551/5107] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:38:37 2022] GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b => generated 1677 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:38:37.999907 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a56474e8-59c7-466b-afb2-da917f4b0267 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:38.012633 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a56474e8-59c7-466b-afb2-da917f4b0267 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c" status: 200 len: 1517 microversion: 2.1 time: 0.281544 Oct 30 01:38:38.016204 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2557/5108] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:38:37 2022] GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c => generated 1517 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:38:38.759842 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3eadd146-268a-433f-8ea3-4bb0cf4b94b6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:38.760470 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3eadd146-268a-433f-8ea3-4bb0cf4b94b6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:38.764261 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=60 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:38:38.775468 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3eadd146-268a-433f-8ea3-4bb0cf4b94b6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:38.776380 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3eadd146-268a-433f-8ea3-4bb0cf4b94b6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:38.776994 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3eadd146-268a-433f-8ea3-4bb0cf4b94b6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:38.777912 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3eadd146-268a-433f-8ea3-4bb0cf4b94b6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:38.778663 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3eadd146-268a-433f-8ea3-4bb0cf4b94b6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:38.779258 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3eadd146-268a-433f-8ea3-4bb0cf4b94b6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:38.826854 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c0581115-a607-4c17-a259-2a26f85ab030 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:38.828358 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c0581115-a607-4c17-a259-2a26f85ab030 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:38.837268 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0581115-a607-4c17-a259-2a26f85ab030 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:38.843588 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0581115-a607-4c17-a259-2a26f85ab030 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:38.843588 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0581115-a607-4c17-a259-2a26f85ab030 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:38.843588 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0581115-a607-4c17-a259-2a26f85ab030 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:38.843588 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0581115-a607-4c17-a259-2a26f85ab030 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:38.843588 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0581115-a607-4c17-a259-2a26f85ab030 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:39.399234 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c0581115-a607-4c17-a259-2a26f85ab030 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:39.406472 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=100 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:38:39.406712 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3eadd146-268a-433f-8ea3-4bb0cf4b94b6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:39.411660 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c0581115-a607-4c17-a259-2a26f85ab030 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b" status: 200 len: 1677 microversion: 2.1 time: 0.594115 Oct 30 01:38:39.416566 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3eadd146-268a-433f-8ea3-4bb0cf4b94b6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:39.417358 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2558/5109] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:38:38 2022] GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b => generated 1677 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:38:39.418672 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3eadd146-268a-433f-8ea3-4bb0cf4b94b6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:39.420205 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3eadd146-268a-433f-8ea3-4bb0cf4b94b6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1738 microversion: 2.20 time: 0.668883 Oct 30 01:38:39.421272 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2552/5110] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:38:38 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1738 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:38:39.426651 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e9237d99-2745-4a07-a5b5-22f234fcebbc tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:39.434482 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e9237d99-2745-4a07-a5b5-22f234fcebbc tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 3fb366e7-0a5c-4bf8-944b-d9140af2c65c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:39.455202 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e9237d99-2745-4a07-a5b5-22f234fcebbc tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:39.455689 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e9237d99-2745-4a07-a5b5-22f234fcebbc tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:39.466336 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e9237d99-2745-4a07-a5b5-22f234fcebbc tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:39.467839 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e9237d99-2745-4a07-a5b5-22f234fcebbc tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:39.472365 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e9237d99-2745-4a07-a5b5-22f234fcebbc tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:39.473055 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e9237d99-2745-4a07-a5b5-22f234fcebbc tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:40.067434 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e9237d99-2745-4a07-a5b5-22f234fcebbc tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:40.094153 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e9237d99-2745-4a07-a5b5-22f234fcebbc tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c" status: 200 len: 1517 microversion: 2.1 time: 0.670732 Oct 30 01:38:40.097862 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2559/5111] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:38:39 2022] GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c => generated 1517 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:38:40.457258 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-464701b8-4b7f-4812-9e7b-9df50b79b2a6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:40.457258 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-464701b8-4b7f-4812-9e7b-9df50b79b2a6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:40.463032 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-55685962-619c-4ef8-94a7-13ec5ed8ae68 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:40.464091 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-55685962-619c-4ef8-94a7-13ec5ed8ae68 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:40.494887 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-55685962-619c-4ef8-94a7-13ec5ed8ae68 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:40.500098 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-55685962-619c-4ef8-94a7-13ec5ed8ae68 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:40.500593 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-55685962-619c-4ef8-94a7-13ec5ed8ae68 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:40.501405 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-55685962-619c-4ef8-94a7-13ec5ed8ae68 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:40.504265 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-464701b8-4b7f-4812-9e7b-9df50b79b2a6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:40.514211 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-464701b8-4b7f-4812-9e7b-9df50b79b2a6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:40.514512 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-55685962-619c-4ef8-94a7-13ec5ed8ae68 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:40.515202 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-55685962-619c-4ef8-94a7-13ec5ed8ae68 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:40.520474 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-464701b8-4b7f-4812-9e7b-9df50b79b2a6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:40.523420 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-464701b8-4b7f-4812-9e7b-9df50b79b2a6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:40.531424 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-464701b8-4b7f-4812-9e7b-9df50b79b2a6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:40.536215 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-464701b8-4b7f-4812-9e7b-9df50b79b2a6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:41.145353 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-55685962-619c-4ef8-94a7-13ec5ed8ae68 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:41.170165 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-55685962-619c-4ef8-94a7-13ec5ed8ae68 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b" status: 200 len: 1677 microversion: 2.1 time: 0.711557 Oct 30 01:38:41.170820 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2560/5112] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:38:40 2022] GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b => generated 1677 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:38:41.216882 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4f8497a7-3192-45fe-a933-0a9106da99a1 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:41.220143 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4f8497a7-3192-45fe-a933-0a9106da99a1 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 3fb366e7-0a5c-4bf8-944b-d9140af2c65c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:41.251655 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4f8497a7-3192-45fe-a933-0a9106da99a1 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:41.251655 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4f8497a7-3192-45fe-a933-0a9106da99a1 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:41.251655 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4f8497a7-3192-45fe-a933-0a9106da99a1 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:41.251655 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4f8497a7-3192-45fe-a933-0a9106da99a1 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:41.251655 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4f8497a7-3192-45fe-a933-0a9106da99a1 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:41.260496 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4f8497a7-3192-45fe-a933-0a9106da99a1 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:41.297021 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-464701b8-4b7f-4812-9e7b-9df50b79b2a6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:41.321739 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-464701b8-4b7f-4812-9e7b-9df50b79b2a6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:41.323825 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-464701b8-4b7f-4812-9e7b-9df50b79b2a6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:41.335825 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-464701b8-4b7f-4812-9e7b-9df50b79b2a6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1738 microversion: 2.20 time: 0.891617 Oct 30 01:38:41.340870 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2553/5113] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:38:40 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1738 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:38:41.595023 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4f8497a7-3192-45fe-a933-0a9106da99a1 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:41.610046 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4f8497a7-3192-45fe-a933-0a9106da99a1 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c" status: 200 len: 1517 microversion: 2.1 time: 0.415066 Oct 30 01:38:41.622785 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2561/5114] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:38:41 2022] GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c => generated 1517 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:38:42.202206 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7de6a43c-6ddf-4174-93a5-83d194580cd0 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:42.208951 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7de6a43c-6ddf-4174-93a5-83d194580cd0 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:42.234798 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7de6a43c-6ddf-4174-93a5-83d194580cd0 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:42.235796 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7de6a43c-6ddf-4174-93a5-83d194580cd0 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:42.236409 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7de6a43c-6ddf-4174-93a5-83d194580cd0 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:42.237349 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7de6a43c-6ddf-4174-93a5-83d194580cd0 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:42.238312 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7de6a43c-6ddf-4174-93a5-83d194580cd0 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:42.239451 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7de6a43c-6ddf-4174-93a5-83d194580cd0 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:42.374895 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-50fe0d1e-9fdf-4bab-880c-cc18c1975f88 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:42.377125 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-50fe0d1e-9fdf-4bab-880c-cc18c1975f88 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:42.393454 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-50fe0d1e-9fdf-4bab-880c-cc18c1975f88 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:42.394483 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-50fe0d1e-9fdf-4bab-880c-cc18c1975f88 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:42.395174 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-50fe0d1e-9fdf-4bab-880c-cc18c1975f88 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:42.396143 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-50fe0d1e-9fdf-4bab-880c-cc18c1975f88 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:42.396768 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-50fe0d1e-9fdf-4bab-880c-cc18c1975f88 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:42.397752 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-50fe0d1e-9fdf-4bab-880c-cc18c1975f88 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:42.573123 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7de6a43c-6ddf-4174-93a5-83d194580cd0 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:42.589389 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7de6a43c-6ddf-4174-93a5-83d194580cd0 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b" status: 200 len: 1654 microversion: 2.1 time: 0.394274 Oct 30 01:38:42.602692 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2554/5115] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:38:42 2022] GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b => generated 1654 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:38:42.618323 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d3c51116-5677-461b-a7eb-fdd8f723cfdf tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:38:42.625228 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-50fe0d1e-9fdf-4bab-880c-cc18c1975f88 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:42.632436 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3c51116-5677-461b-a7eb-fdd8f723cfdf tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:42.632793 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3c51116-5677-461b-a7eb-fdd8f723cfdf tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:42.635876 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3c51116-5677-461b-a7eb-fdd8f723cfdf tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:42.636423 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-50fe0d1e-9fdf-4bab-880c-cc18c1975f88 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:42.638333 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-50fe0d1e-9fdf-4bab-880c-cc18c1975f88 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:42.640055 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-50fe0d1e-9fdf-4bab-880c-cc18c1975f88 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1738 microversion: 2.20 time: 0.271572 Oct 30 01:38:42.641204 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2562/5116] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:38:42 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1738 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:38:42.646448 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b5f685a6-40d4-46db-8821-1c34a199a9c4 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:42.647366 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b5f685a6-40d4-46db-8821-1c34a199a9c4 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 3fb366e7-0a5c-4bf8-944b-d9140af2c65c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:42.655125 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b5f685a6-40d4-46db-8821-1c34a199a9c4 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:42.662717 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b5f685a6-40d4-46db-8821-1c34a199a9c4 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:42.662717 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b5f685a6-40d4-46db-8821-1c34a199a9c4 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:42.662717 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b5f685a6-40d4-46db-8821-1c34a199a9c4 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:42.662717 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b5f685a6-40d4-46db-8821-1c34a199a9c4 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:42.662717 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b5f685a6-40d4-46db-8821-1c34a199a9c4 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:42.724078 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d3c51116-5677-461b-a7eb-fdd8f723cfdf tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Going to try to start instance {{(pid=121102) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 30 01:38:42.904466 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b5f685a6-40d4-46db-8821-1c34a199a9c4 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:42.915872 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b5f685a6-40d4-46db-8821-1c34a199a9c4 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c" status: 200 len: 1517 microversion: 2.1 time: 0.271682 Oct 30 01:38:42.916605 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2563/5117] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:38:42 2022] GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c => generated 1517 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:38:43.031878 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d3c51116-5677-461b-a7eb-fdd8f723cfdf tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "POST /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b/action" status: 202 len: 0 microversion: 2.1 time: 0.419404 Oct 30 01:38:43.035644 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2555/5118] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:38:42 2022] POST /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b/action => generated 0 bytes in 421 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:38:43.041465 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-65b557c3-d3bb-447d-aeb2-2e75d23e29aa tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:43.042097 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-65b557c3-d3bb-447d-aeb2-2e75d23e29aa tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:43.053880 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-65b557c3-d3bb-447d-aeb2-2e75d23e29aa tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:43.054386 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-65b557c3-d3bb-447d-aeb2-2e75d23e29aa tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:43.055389 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-65b557c3-d3bb-447d-aeb2-2e75d23e29aa tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:43.056335 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-65b557c3-d3bb-447d-aeb2-2e75d23e29aa tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:43.059976 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-65b557c3-d3bb-447d-aeb2-2e75d23e29aa tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:43.060621 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-65b557c3-d3bb-447d-aeb2-2e75d23e29aa tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:43.335034 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-65b557c3-d3bb-447d-aeb2-2e75d23e29aa tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:43.372143 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-65b557c3-d3bb-447d-aeb2-2e75d23e29aa tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b" status: 200 len: 1663 microversion: 2.1 time: 0.334947 Oct 30 01:38:43.382952 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2564/5119] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:38:43 2022] GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b => generated 1663 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:38:43.676218 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b3359fb5-22af-4b63-a55f-42c9801b5d89 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:43.677011 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b3359fb5-22af-4b63-a55f-42c9801b5d89 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:43.705701 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b3359fb5-22af-4b63-a55f-42c9801b5d89 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:43.712852 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b3359fb5-22af-4b63-a55f-42c9801b5d89 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:43.713009 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b3359fb5-22af-4b63-a55f-42c9801b5d89 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:43.713827 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b3359fb5-22af-4b63-a55f-42c9801b5d89 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:43.714310 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b3359fb5-22af-4b63-a55f-42c9801b5d89 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:43.714746 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b3359fb5-22af-4b63-a55f-42c9801b5d89 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:43.838889 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:38:43.950120 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8a58d824-6519-432b-be16-d8cf4ce78f4c tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:43.951116 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8a58d824-6519-432b-be16-d8cf4ce78f4c tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 3fb366e7-0a5c-4bf8-944b-d9140af2c65c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:43.961778 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8a58d824-6519-432b-be16-d8cf4ce78f4c tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:43.963018 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8a58d824-6519-432b-be16-d8cf4ce78f4c tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:43.964253 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8a58d824-6519-432b-be16-d8cf4ce78f4c tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:43.965410 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8a58d824-6519-432b-be16-d8cf4ce78f4c tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:43.966543 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8a58d824-6519-432b-be16-d8cf4ce78f4c tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:43.967238 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8a58d824-6519-432b-be16-d8cf4ce78f4c tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:44.796246 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8a58d824-6519-432b-be16-d8cf4ce78f4c tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:44.861874 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8a58d824-6519-432b-be16-d8cf4ce78f4c tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c" status: 200 len: 1523 microversion: 2.1 time: 0.918229 Oct 30 01:38:44.863445 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b3359fb5-22af-4b63-a55f-42c9801b5d89 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:44.866479 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2565/5120] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:38:43 2022] GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c => generated 1523 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:38:44.889944 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b3359fb5-22af-4b63-a55f-42c9801b5d89 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:44.897404 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6456c630-686f-4211-879c-0214038af927 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:44.897404 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6456c630-686f-4211-879c-0214038af927 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:44.908991 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6456c630-686f-4211-879c-0214038af927 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:44.909574 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b3359fb5-22af-4b63-a55f-42c9801b5d89 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:44.913614 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b3359fb5-22af-4b63-a55f-42c9801b5d89 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1738 microversion: 2.20 time: 1.240046 Oct 30 01:38:44.913757 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6456c630-686f-4211-879c-0214038af927 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:44.913872 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2556/5121] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:38:43 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1738 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:38:44.914044 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6456c630-686f-4211-879c-0214038af927 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:44.916816 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6456c630-686f-4211-879c-0214038af927 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:44.918593 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6456c630-686f-4211-879c-0214038af927 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:44.919149 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6456c630-686f-4211-879c-0214038af927 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:45.768983 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6456c630-686f-4211-879c-0214038af927 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:45.777918 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6456c630-686f-4211-879c-0214038af927 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b" status: 200 len: 1663 microversion: 2.1 time: 0.910009 Oct 30 01:38:45.778534 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2566/5122] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:38:44 2022] GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b => generated 1663 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:38:45.897882 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-701a658d-72cd-4deb-a5cf-08720d84f90a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:45.899795 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-701a658d-72cd-4deb-a5cf-08720d84f90a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 3fb366e7-0a5c-4bf8-944b-d9140af2c65c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:45.924089 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-701a658d-72cd-4deb-a5cf-08720d84f90a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:45.925006 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-701a658d-72cd-4deb-a5cf-08720d84f90a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:45.925601 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-701a658d-72cd-4deb-a5cf-08720d84f90a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:45.926427 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-701a658d-72cd-4deb-a5cf-08720d84f90a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:45.926991 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-701a658d-72cd-4deb-a5cf-08720d84f90a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:45.927641 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-701a658d-72cd-4deb-a5cf-08720d84f90a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:45.938978 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-440d4aad-c837-4ffd-8df9-302244d64ea9 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:45.941221 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-440d4aad-c837-4ffd-8df9-302244d64ea9 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:45.962450 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-440d4aad-c837-4ffd-8df9-302244d64ea9 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:45.962956 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-440d4aad-c837-4ffd-8df9-302244d64ea9 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:45.966415 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-440d4aad-c837-4ffd-8df9-302244d64ea9 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:45.974458 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-440d4aad-c837-4ffd-8df9-302244d64ea9 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:45.974963 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-440d4aad-c837-4ffd-8df9-302244d64ea9 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:45.975418 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-440d4aad-c837-4ffd-8df9-302244d64ea9 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:46.643484 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-440d4aad-c837-4ffd-8df9-302244d64ea9 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:46.657274 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-440d4aad-c837-4ffd-8df9-302244d64ea9 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:46.682637 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-440d4aad-c837-4ffd-8df9-302244d64ea9 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:46.690174 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-440d4aad-c837-4ffd-8df9-302244d64ea9 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1738 microversion: 2.20 time: 0.755145 Oct 30 01:38:46.702718 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2567/5123] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:38:45 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1738 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:38:46.803995 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-701a658d-72cd-4deb-a5cf-08720d84f90a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:46.807673 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6e7117c6-8c33-45f1-9384-4491815d7afc tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:46.810173 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6e7117c6-8c33-45f1-9384-4491815d7afc tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:46.813475 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-701a658d-72cd-4deb-a5cf-08720d84f90a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c" status: 200 len: 1523 microversion: 2.1 time: 0.925248 Oct 30 01:38:46.822989 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=60 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:38:46.825511 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6e7117c6-8c33-45f1-9384-4491815d7afc tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:46.826171 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6e7117c6-8c33-45f1-9384-4491815d7afc tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:46.826758 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6e7117c6-8c33-45f1-9384-4491815d7afc tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:46.827644 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6e7117c6-8c33-45f1-9384-4491815d7afc tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:46.828296 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6e7117c6-8c33-45f1-9384-4491815d7afc tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:46.829021 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6e7117c6-8c33-45f1-9384-4491815d7afc tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:46.839366 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2557/5124] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:38:45 2022] GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c => generated 1523 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:38:47.627508 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6e7117c6-8c33-45f1-9384-4491815d7afc tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:47.640663 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6e7117c6-8c33-45f1-9384-4491815d7afc tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b" status: 200 len: 1663 microversion: 2.1 time: 0.837675 Oct 30 01:38:47.642504 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2568/5125] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:38:46 2022] GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b => generated 1663 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:38:47.718859 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f2ca95eb-cada-4641-9d10-efc6d4cc4b39 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:47.720898 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f2ca95eb-cada-4641-9d10-efc6d4cc4b39 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:47.732387 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f2ca95eb-cada-4641-9d10-efc6d4cc4b39 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:47.733695 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f2ca95eb-cada-4641-9d10-efc6d4cc4b39 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:47.734377 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f2ca95eb-cada-4641-9d10-efc6d4cc4b39 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:47.735472 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f2ca95eb-cada-4641-9d10-efc6d4cc4b39 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:47.736764 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f2ca95eb-cada-4641-9d10-efc6d4cc4b39 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:47.737421 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f2ca95eb-cada-4641-9d10-efc6d4cc4b39 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:47.847011 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-da54510a-956c-4289-b568-aaf1371b3898 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:47.847936 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-da54510a-956c-4289-b568-aaf1371b3898 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 3fb366e7-0a5c-4bf8-944b-d9140af2c65c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:47.859992 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da54510a-956c-4289-b568-aaf1371b3898 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:47.861948 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da54510a-956c-4289-b568-aaf1371b3898 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:47.862659 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da54510a-956c-4289-b568-aaf1371b3898 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:47.863624 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da54510a-956c-4289-b568-aaf1371b3898 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:47.864268 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da54510a-956c-4289-b568-aaf1371b3898 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:47.864872 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da54510a-956c-4289-b568-aaf1371b3898 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:48.149698 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f2ca95eb-cada-4641-9d10-efc6d4cc4b39 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:48.158774 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f2ca95eb-cada-4641-9d10-efc6d4cc4b39 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:48.173587 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f2ca95eb-cada-4641-9d10-efc6d4cc4b39 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:48.178544 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f2ca95eb-cada-4641-9d10-efc6d4cc4b39 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1738 microversion: 2.20 time: 0.462923 Oct 30 01:38:48.180148 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2558/5126] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:38:47 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1738 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:38:48.189420 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-2f3ded9a-3a59-48f8-b315-fd599a9ba9a4 req-02e26634-e785-46af-92d0-eea7afacabc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fb366e7-0a5c-4bf8-944b-d9140af2c65c", "name": "network-vif-unplugged", "status": "completed", "tag": "62886100-a2f3-42b7-8749-4061d7beb594"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:38:48.203765 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-2f3ded9a-3a59-48f8-b315-fd599a9ba9a4 req-02e26634-e785-46af-92d0-eea7afacabc5 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:48.204564 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-2f3ded9a-3a59-48f8-b315-fd599a9ba9a4 req-02e26634-e785-46af-92d0-eea7afacabc5 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:48.205198 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-2f3ded9a-3a59-48f8-b315-fd599a9ba9a4 req-02e26634-e785-46af-92d0-eea7afacabc5 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:48.236233 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-2f3ded9a-3a59-48f8-b315-fd599a9ba9a4 req-02e26634-e785-46af-92d0-eea7afacabc5 service nova] Creating event network-vif-unplugged:62886100-a2f3-42b7-8749-4061d7beb594 for instance 3fb366e7-0a5c-4bf8-944b-d9140af2c65c on n-h1-master-1 Oct 30 01:38:48.256214 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-2f3ded9a-3a59-48f8-b315-fd599a9ba9a4 req-02e26634-e785-46af-92d0-eea7afacabc5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074063 Oct 30 01:38:48.259054 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2559/5127] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:38:48.322153 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-da54510a-956c-4289-b568-aaf1371b3898 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:48.344530 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-da54510a-956c-4289-b568-aaf1371b3898 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c" status: 200 len: 1523 microversion: 2.1 time: 0.501843 Oct 30 01:38:48.346945 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2569/5128] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:38:47 2022] GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c => generated 1523 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:38:48.673111 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-093d7270-97a4-405a-bcd3-61591e07a00b tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:48.674003 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-093d7270-97a4-405a-bcd3-61591e07a00b tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:48.684312 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-093d7270-97a4-405a-bcd3-61591e07a00b tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:48.686596 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-093d7270-97a4-405a-bcd3-61591e07a00b tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:48.697304 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-093d7270-97a4-405a-bcd3-61591e07a00b tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:48.698157 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-093d7270-97a4-405a-bcd3-61591e07a00b tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:48.698645 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-093d7270-97a4-405a-bcd3-61591e07a00b tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:48.699088 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-093d7270-97a4-405a-bcd3-61591e07a00b tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:49.210156 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-71ddf2ca-d07d-4214-b8a6-004b4e36c1a9 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:49.211330 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-71ddf2ca-d07d-4214-b8a6-004b4e36c1a9 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:49.225890 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-71ddf2ca-d07d-4214-b8a6-004b4e36c1a9 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:49.228210 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-71ddf2ca-d07d-4214-b8a6-004b4e36c1a9 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:49.228672 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-71ddf2ca-d07d-4214-b8a6-004b4e36c1a9 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:49.230270 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-71ddf2ca-d07d-4214-b8a6-004b4e36c1a9 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:49.230949 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-71ddf2ca-d07d-4214-b8a6-004b4e36c1a9 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:49.232749 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-71ddf2ca-d07d-4214-b8a6-004b4e36c1a9 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:49.240432 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-093d7270-97a4-405a-bcd3-61591e07a00b tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:49.257777 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-093d7270-97a4-405a-bcd3-61591e07a00b tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b" status: 200 len: 1667 microversion: 2.1 time: 0.593659 Oct 30 01:38:49.279623 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2560/5129] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:38:48 2022] GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b => generated 1667 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:38:49.371012 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b8225cae-d307-48d5-904e-028d8626f05b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:49.371846 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b8225cae-d307-48d5-904e-028d8626f05b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 3fb366e7-0a5c-4bf8-944b-d9140af2c65c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:49.385113 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b8225cae-d307-48d5-904e-028d8626f05b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:49.385502 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b8225cae-d307-48d5-904e-028d8626f05b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:49.387294 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b8225cae-d307-48d5-904e-028d8626f05b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:49.390364 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b8225cae-d307-48d5-904e-028d8626f05b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:49.391360 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b8225cae-d307-48d5-904e-028d8626f05b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:49.392007 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b8225cae-d307-48d5-904e-028d8626f05b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:49.818088 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-71ddf2ca-d07d-4214-b8a6-004b4e36c1a9 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:49.831900 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-71ddf2ca-d07d-4214-b8a6-004b4e36c1a9 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:49.834224 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-71ddf2ca-d07d-4214-b8a6-004b4e36c1a9 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:49.835440 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-71ddf2ca-d07d-4214-b8a6-004b4e36c1a9 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1720 microversion: 2.20 time: 0.633679 Oct 30 01:38:49.865365 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2570/5130] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:38:49 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1720 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:38:50.536807 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b8225cae-d307-48d5-904e-028d8626f05b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:50.555570 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b8225cae-d307-48d5-904e-028d8626f05b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c" status: 200 len: 1523 microversion: 2.1 time: 1.189223 Oct 30 01:38:50.557226 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2561/5131] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:38:49 2022] GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c => generated 1523 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:38:50.883061 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b7c04eb5-4b7b-4ecb-a346-4ba35fd8fd83 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:50.883773 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b7c04eb5-4b7b-4ecb-a346-4ba35fd8fd83 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:50.900489 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b7c04eb5-4b7b-4ecb-a346-4ba35fd8fd83 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:50.900966 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b7c04eb5-4b7b-4ecb-a346-4ba35fd8fd83 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:50.906901 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b7c04eb5-4b7b-4ecb-a346-4ba35fd8fd83 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:50.907719 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b7c04eb5-4b7b-4ecb-a346-4ba35fd8fd83 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:50.908207 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b7c04eb5-4b7b-4ecb-a346-4ba35fd8fd83 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:50.908649 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b7c04eb5-4b7b-4ecb-a346-4ba35fd8fd83 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:51.326572 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b7c04eb5-4b7b-4ecb-a346-4ba35fd8fd83 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:51.335633 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b7c04eb5-4b7b-4ecb-a346-4ba35fd8fd83 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:51.337998 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b7c04eb5-4b7b-4ecb-a346-4ba35fd8fd83 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:51.339774 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b7c04eb5-4b7b-4ecb-a346-4ba35fd8fd83 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1720 microversion: 2.20 time: 0.462668 Oct 30 01:38:51.340525 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2571/5132] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:38:50 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1720 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:38:51.582670 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a84e7bb6-5123-4dfe-8379-76292615c51e tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:51.583971 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a84e7bb6-5123-4dfe-8379-76292615c51e tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 3fb366e7-0a5c-4bf8-944b-d9140af2c65c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:51.603109 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a84e7bb6-5123-4dfe-8379-76292615c51e tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:51.604221 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a84e7bb6-5123-4dfe-8379-76292615c51e tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:51.604669 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a84e7bb6-5123-4dfe-8379-76292615c51e tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:51.605625 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a84e7bb6-5123-4dfe-8379-76292615c51e tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:51.606259 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a84e7bb6-5123-4dfe-8379-76292615c51e tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:51.606754 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a84e7bb6-5123-4dfe-8379-76292615c51e tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:51.794233 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a84e7bb6-5123-4dfe-8379-76292615c51e tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:51.807054 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a84e7bb6-5123-4dfe-8379-76292615c51e tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c" status: 200 len: 1523 microversion: 2.1 time: 0.229557 Oct 30 01:38:51.807820 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2562/5133] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:38:51 2022] GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c => generated 1523 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:38:51.835441 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-86a9fee9-ed78-4114-ba0e-0e9efc5aa9e1 req-3fb06e2f-f6f8-4d06-bfa4-58a26e29f63f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fb366e7-0a5c-4bf8-944b-d9140af2c65c", "name": "network-vif-plugged", "status": "completed", "tag": "62886100-a2f3-42b7-8749-4061d7beb594"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:38:51.852156 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-86a9fee9-ed78-4114-ba0e-0e9efc5aa9e1 req-3fb06e2f-f6f8-4d06-bfa4-58a26e29f63f service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:51.852736 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-86a9fee9-ed78-4114-ba0e-0e9efc5aa9e1 req-3fb06e2f-f6f8-4d06-bfa4-58a26e29f63f service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:51.853245 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-86a9fee9-ed78-4114-ba0e-0e9efc5aa9e1 req-3fb06e2f-f6f8-4d06-bfa4-58a26e29f63f service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:51.866588 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-86a9fee9-ed78-4114-ba0e-0e9efc5aa9e1 req-3fb06e2f-f6f8-4d06-bfa4-58a26e29f63f service nova] Creating event network-vif-plugged:62886100-a2f3-42b7-8749-4061d7beb594 for instance 3fb366e7-0a5c-4bf8-944b-d9140af2c65c on n-h1-master-1 Oct 30 01:38:51.872325 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-86a9fee9-ed78-4114-ba0e-0e9efc5aa9e1 req-3fb06e2f-f6f8-4d06-bfa4-58a26e29f63f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040519 Oct 30 01:38:51.879361 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2572/5134] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:38:52.366485 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8b6cdac5-46c9-4fb6-bec4-ee0d3535bc8f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:52.367730 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8b6cdac5-46c9-4fb6-bec4-ee0d3535bc8f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:52.384491 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b6cdac5-46c9-4fb6-bec4-ee0d3535bc8f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:52.388924 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b6cdac5-46c9-4fb6-bec4-ee0d3535bc8f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:52.388924 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b6cdac5-46c9-4fb6-bec4-ee0d3535bc8f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:52.388924 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b6cdac5-46c9-4fb6-bec4-ee0d3535bc8f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:52.388924 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b6cdac5-46c9-4fb6-bec4-ee0d3535bc8f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:52.388924 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b6cdac5-46c9-4fb6-bec4-ee0d3535bc8f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:52.606144 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8b6cdac5-46c9-4fb6-bec4-ee0d3535bc8f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:52.614640 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8b6cdac5-46c9-4fb6-bec4-ee0d3535bc8f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:52.616513 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8b6cdac5-46c9-4fb6-bec4-ee0d3535bc8f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:52.618386 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8b6cdac5-46c9-4fb6-bec4-ee0d3535bc8f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1723 microversion: 2.20 time: 0.256334 Oct 30 01:38:52.618959 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2563/5135] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:38:52 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1723 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:38:52.645588 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a10eceb1-9357-4739-96f1-4fc63ec9e3db tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "147e493e-2efd-410d-b6a1-6e6550ffc1e0"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:38:52.648634 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a10eceb1-9357-4739-96f1-4fc63ec9e3db tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:52.656216 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a10eceb1-9357-4739-96f1-4fc63ec9e3db tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:52.659124 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a10eceb1-9357-4739-96f1-4fc63ec9e3db tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:52.659124 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a10eceb1-9357-4739-96f1-4fc63ec9e3db tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:52.659124 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a10eceb1-9357-4739-96f1-4fc63ec9e3db tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:52.659124 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a10eceb1-9357-4739-96f1-4fc63ec9e3db tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:52.659124 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a10eceb1-9357-4739-96f1-4fc63ec9e3db tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:52.834293 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d7920b4d-6090-45da-ac6e-bd10f45282a6 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:52.840726 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d7920b4d-6090-45da-ac6e-bd10f45282a6 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 3fb366e7-0a5c-4bf8-944b-d9140af2c65c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:52.843927 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7920b4d-6090-45da-ac6e-bd10f45282a6 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:52.845292 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7920b4d-6090-45da-ac6e-bd10f45282a6 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:52.846409 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7920b4d-6090-45da-ac6e-bd10f45282a6 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:52.847628 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7920b4d-6090-45da-ac6e-bd10f45282a6 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:52.848343 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7920b4d-6090-45da-ac6e-bd10f45282a6 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:52.848977 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7920b4d-6090-45da-ac6e-bd10f45282a6 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:53.168957 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d7920b4d-6090-45da-ac6e-bd10f45282a6 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:53.287053 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d7920b4d-6090-45da-ac6e-bd10f45282a6 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c" status: 200 len: 1523 microversion: 2.1 time: 0.348643 Oct 30 01:38:53.287053 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2564/5136] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:38:52 2022] GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c => generated 1523 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:38:53.918554 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-5cd54713-b541-4c72-a2e1-67abce3a6dd2 req-74723c74-298f-4be4-9441-defad246c83f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5389398-bf67-44ff-a1fb-a26e4a079fcb", "name": "network-vif-unplugged", "status": "completed", "tag": "5fdf7d37-8815-4dca-ba2d-d6297f9d29eb"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:38:53.941977 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-5cd54713-b541-4c72-a2e1-67abce3a6dd2 req-74723c74-298f-4be4-9441-defad246c83f service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:53.946319 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-5cd54713-b541-4c72-a2e1-67abce3a6dd2 req-74723c74-298f-4be4-9441-defad246c83f service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:53.947615 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-5cd54713-b541-4c72-a2e1-67abce3a6dd2 req-74723c74-298f-4be4-9441-defad246c83f service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:53.959756 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.compute.server_external_events [req-5cd54713-b541-4c72-a2e1-67abce3a6dd2 req-74723c74-298f-4be4-9441-defad246c83f service nova] Unable to find a host for instance a5389398-bf67-44ff-a1fb-a26e4a079fcb. Dropping event network-vif-unplugged {{(pid=121102) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 30 01:38:53.961089 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-5cd54713-b541-4c72-a2e1-67abce3a6dd2 req-74723c74-298f-4be4-9441-defad246c83f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.050855 Oct 30 01:38:53.962255 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2565/5137] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 52 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 30 01:38:54.214414 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d1f3d28e-56c3-4f2b-bf27-4225dc3a8599 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:54.216632 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:38:54.217634 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d1f3d28e-56c3-4f2b-bf27-4225dc3a8599 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 3fb366e7-0a5c-4bf8-944b-d9140af2c65c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:54.248444 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1f3d28e-56c3-4f2b-bf27-4225dc3a8599 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:54.249273 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1f3d28e-56c3-4f2b-bf27-4225dc3a8599 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:54.253329 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1f3d28e-56c3-4f2b-bf27-4225dc3a8599 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:54.266121 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1f3d28e-56c3-4f2b-bf27-4225dc3a8599 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:54.266121 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1f3d28e-56c3-4f2b-bf27-4225dc3a8599 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:54.266121 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1f3d28e-56c3-4f2b-bf27-4225dc3a8599 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:54.467570 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a10eceb1-9357-4739-96f1-4fc63ec9e3db tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "POST /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.826810 Oct 30 01:38:54.468963 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2573/5138] 10.222.0.13 () {62 vars in 1364 bytes} [Sun Oct 30 01:38:52 2022] POST /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb/os-volume_attachments => generated 188 bytes in 1829 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:38:54.524789 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d1f3d28e-56c3-4f2b-bf27-4225dc3a8599 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:54.543653 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d1f3d28e-56c3-4f2b-bf27-4225dc3a8599 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c" status: 200 len: 1508 microversion: 2.1 time: 0.345497 Oct 30 01:38:54.544970 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2566/5139] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:38:54 2022] GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c => generated 1508 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:38:54.570745 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-94bffdde-01e8-46f9-815a-70b22990939b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:54.571442 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-94bffdde-01e8-46f9-815a-70b22990939b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 3fb366e7-0a5c-4bf8-944b-d9140af2c65c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:54.578478 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94bffdde-01e8-46f9-815a-70b22990939b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:54.579244 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94bffdde-01e8-46f9-815a-70b22990939b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:54.584806 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94bffdde-01e8-46f9-815a-70b22990939b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:54.587187 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94bffdde-01e8-46f9-815a-70b22990939b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:54.587839 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94bffdde-01e8-46f9-815a-70b22990939b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:54.589099 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94bffdde-01e8-46f9-815a-70b22990939b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:54.722615 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-05b1890f-ce40-4b42-a756-759f44bf3f8f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:38:54.723061 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-05b1890f-ce40-4b42-a756-759f44bf3f8f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:54.730605 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-05b1890f-ce40-4b42-a756-759f44bf3f8f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:54.731118 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-05b1890f-ce40-4b42-a756-759f44bf3f8f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:54.731660 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-05b1890f-ce40-4b42-a756-759f44bf3f8f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:54.736637 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-05b1890f-ce40-4b42-a756-759f44bf3f8f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:54.748656 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-05b1890f-ce40-4b42-a756-759f44bf3f8f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:54.750447 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-05b1890f-ce40-4b42-a756-759f44bf3f8f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:54.815025 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-05b1890f-ce40-4b42-a756-759f44bf3f8f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121102) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 30 01:38:54.881619 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-94bffdde-01e8-46f9-815a-70b22990939b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:54.911258 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-94bffdde-01e8-46f9-815a-70b22990939b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c" status: 200 len: 1508 microversion: 2.1 time: 0.331978 Oct 30 01:38:54.915040 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2574/5140] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:38:54 2022] GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c => generated 1508 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:38:54.946646 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-adaf249e-9a75-4501-b6f7-3c48e8ebe7be tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:54.947461 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-adaf249e-9a75-4501-b6f7-3c48e8ebe7be tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 3fb366e7-0a5c-4bf8-944b-d9140af2c65c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:54.954806 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-adaf249e-9a75-4501-b6f7-3c48e8ebe7be tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:54.955574 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-adaf249e-9a75-4501-b6f7-3c48e8ebe7be tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:54.956242 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-adaf249e-9a75-4501-b6f7-3c48e8ebe7be tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:54.957291 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-adaf249e-9a75-4501-b6f7-3c48e8ebe7be tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:54.957946 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-adaf249e-9a75-4501-b6f7-3c48e8ebe7be tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:54.961363 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-adaf249e-9a75-4501-b6f7-3c48e8ebe7be tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:54.993197 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-adaf249e-9a75-4501-b6f7-3c48e8ebe7be tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 3fb366e7-0a5c-4bf8-944b-d9140af2c65c] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:38:55.501291 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-05b1890f-ce40-4b42-a756-759f44bf3f8f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "POST /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb/action" status: 202 len: 0 microversion: 2.20 time: 0.781485 Oct 30 01:38:55.504957 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2567/5141] 10.222.0.13 () {62 vars in 1319 bytes} [Sun Oct 30 01:38:54 2022] POST /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb/action => generated 0 bytes in 788 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 30 01:38:55.523625 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-565867d5-fd5e-44bb-bb92-b4f62b3d9d30 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:55.523625 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-565867d5-fd5e-44bb-bb92-b4f62b3d9d30 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:55.533078 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-565867d5-fd5e-44bb-bb92-b4f62b3d9d30 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:55.533936 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-565867d5-fd5e-44bb-bb92-b4f62b3d9d30 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:55.534647 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-565867d5-fd5e-44bb-bb92-b4f62b3d9d30 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:55.535571 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-565867d5-fd5e-44bb-bb92-b4f62b3d9d30 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:55.536221 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-565867d5-fd5e-44bb-bb92-b4f62b3d9d30 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:55.536844 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-565867d5-fd5e-44bb-bb92-b4f62b3d9d30 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:55.680804 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-adaf249e-9a75-4501-b6f7-3c48e8ebe7be tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c" status: 204 len: 0 microversion: 2.1 time: 0.746341 Oct 30 01:38:55.690406 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2575/5142] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:38:54 2022] DELETE /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c => generated 0 bytes in 750 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 30 01:38:55.890209 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-565867d5-fd5e-44bb-bb92-b4f62b3d9d30 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:55.904256 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-565867d5-fd5e-44bb-bb92-b4f62b3d9d30 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:55.907454 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-565867d5-fd5e-44bb-bb92-b4f62b3d9d30 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:55.910016 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-565867d5-fd5e-44bb-bb92-b4f62b3d9d30 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1749 microversion: 2.20 time: 0.399023 Oct 30 01:38:55.914306 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2568/5143] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:38:55 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1749 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:38:55.979774 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-530ab82e-1f6c-4435-837e-8508e0a8bdba tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-309123199", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "23bac07c-fd15-43fe-bec7-06f0679e3987"}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:38:56.114536 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-530ab82e-1f6c-4435-837e-8508e0a8bdba tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] validate_networks() for [('23bac07c-fd15-43fe-bec7-06f0679e3987', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:38:56.834987 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-530ab82e-1f6c-4435-837e-8508e0a8bdba tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:38:56.836926 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-530ab82e-1f6c-4435-837e-8508e0a8bdba tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:38:56.838453 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-530ab82e-1f6c-4435-837e-8508e0a8bdba tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:38:56.839054 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-530ab82e-1f6c-4435-837e-8508e0a8bdba tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:38:56.840207 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-530ab82e-1f6c-4435-837e-8508e0a8bdba tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:38:56.851564 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-530ab82e-1f6c-4435-837e-8508e0a8bdba tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:56.852186 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-530ab82e-1f6c-4435-837e-8508e0a8bdba tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:56.852673 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-530ab82e-1f6c-4435-837e-8508e0a8bdba tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:56.853462 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-530ab82e-1f6c-4435-837e-8508e0a8bdba tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:56.853916 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-530ab82e-1f6c-4435-837e-8508e0a8bdba tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:56.854342 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-530ab82e-1f6c-4435-837e-8508e0a8bdba tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:56.877921 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-530ab82e-1f6c-4435-837e-8508e0a8bdba tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Getting quotas for project 6716e9ebbf6c4ca1950a5a0bce33276c. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:38:56.885583 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-530ab82e-1f6c-4435-837e-8508e0a8bdba tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Getting quotas for user 352cb9c0a2644e0e8743f3cc4477f88f and project 6716e9ebbf6c4ca1950a5a0bce33276c. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:38:56.921274 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-530ab82e-1f6c-4435-837e-8508e0a8bdba tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:38:56.927696 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-530ab82e-1f6c-4435-837e-8508e0a8bdba tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 6f087e90-1c4c-4637-9009-5f819c266271] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:38:56.942165 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a64fbfaf-b743-429b-b95d-553680819b09 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:56.942871 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a64fbfaf-b743-429b-b95d-553680819b09 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:56.958883 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a64fbfaf-b743-429b-b95d-553680819b09 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:56.959782 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a64fbfaf-b743-429b-b95d-553680819b09 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:56.960312 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a64fbfaf-b743-429b-b95d-553680819b09 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:56.961153 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a64fbfaf-b743-429b-b95d-553680819b09 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:56.964497 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a64fbfaf-b743-429b-b95d-553680819b09 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:56.965225 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a64fbfaf-b743-429b-b95d-553680819b09 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:57.200413 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-530ab82e-1f6c-4435-837e-8508e0a8bdba tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.223624 Oct 30 01:38:57.203126 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2576/5144] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:38:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1229 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:38:57.218797 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-24a96c1b-b2b6-48d0-942f-bc326636650c tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:57.219439 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-24a96c1b-b2b6-48d0-942f-bc326636650c tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 6f087e90-1c4c-4637-9009-5f819c266271] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:57.327734 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a64fbfaf-b743-429b-b95d-553680819b09 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:57.344697 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a64fbfaf-b743-429b-b95d-553680819b09 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:57.361559 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a64fbfaf-b743-429b-b95d-553680819b09 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:57.364531 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a64fbfaf-b743-429b-b95d-553680819b09 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1749 microversion: 2.20 time: 0.426356 Oct 30 01:38:57.365130 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2569/5145] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:38:56 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1749 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:38:57.421733 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-24a96c1b-b2b6-48d0-942f-bc326636650c tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:57.432808 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-24a96c1b-b2b6-48d0-942f-bc326636650c tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/6f087e90-1c4c-4637-9009-5f819c266271" status: 200 len: 1217 microversion: 2.1 time: 0.219087 Oct 30 01:38:57.434275 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2577/5146] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:38:57 2022] GET /compute/v2.1/servers/6f087e90-1c4c-4637-9009-5f819c266271 => generated 1217 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:38:58.400076 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bebec067-bc29-4995-b011-c19fffb768df tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:58.401550 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bebec067-bc29-4995-b011-c19fffb768df tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:58.416893 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bebec067-bc29-4995-b011-c19fffb768df tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:58.417838 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bebec067-bc29-4995-b011-c19fffb768df tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:58.419953 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bebec067-bc29-4995-b011-c19fffb768df tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:58.421890 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bebec067-bc29-4995-b011-c19fffb768df tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:58.422805 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bebec067-bc29-4995-b011-c19fffb768df tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:58.425819 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bebec067-bc29-4995-b011-c19fffb768df tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:58.467714 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f90b4e11-5ad8-4483-a9dc-f9d56183688b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:58.468119 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f90b4e11-5ad8-4483-a9dc-f9d56183688b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 6f087e90-1c4c-4637-9009-5f819c266271] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:58.722498 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f90b4e11-5ad8-4483-a9dc-f9d56183688b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:58.736800 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f90b4e11-5ad8-4483-a9dc-f9d56183688b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/6f087e90-1c4c-4637-9009-5f819c266271" status: 200 len: 1217 microversion: 2.1 time: 0.273344 Oct 30 01:38:58.739013 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2578/5147] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:38:58 2022] GET /compute/v2.1/servers/6f087e90-1c4c-4637-9009-5f819c266271 => generated 1217 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:38:58.749030 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-ab65f1d1-671d-41d0-a19a-83b9ebc13650 req-1092f6ec-0e17-4368-a2e9-cbef39c823c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fb366e7-0a5c-4bf8-944b-d9140af2c65c", "name": "network-vif-deleted", "tag": "62886100-a2f3-42b7-8749-4061d7beb594"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:38:58.771677 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ab65f1d1-671d-41d0-a19a-83b9ebc13650 req-1092f6ec-0e17-4368-a2e9-cbef39c823c0 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:58.772291 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ab65f1d1-671d-41d0-a19a-83b9ebc13650 req-1092f6ec-0e17-4368-a2e9-cbef39c823c0 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:58.772591 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ab65f1d1-671d-41d0-a19a-83b9ebc13650 req-1092f6ec-0e17-4368-a2e9-cbef39c823c0 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:58.802173 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-ab65f1d1-671d-41d0-a19a-83b9ebc13650 req-1092f6ec-0e17-4368-a2e9-cbef39c823c0 service nova] Creating event network-vif-deleted:62886100-a2f3-42b7-8749-4061d7beb594 for instance 3fb366e7-0a5c-4bf8-944b-d9140af2c65c on n-h1-master-1 Oct 30 01:38:58.820436 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-ab65f1d1-671d-41d0-a19a-83b9ebc13650 req-1092f6ec-0e17-4368-a2e9-cbef39c823c0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078254 Oct 30 01:38:58.822264 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2579/5148] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:38:59.177414 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bebec067-bc29-4995-b011-c19fffb768df tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:59.237369 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bebec067-bc29-4995-b011-c19fffb768df tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:59.243491 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bebec067-bc29-4995-b011-c19fffb768df tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:59.251098 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bebec067-bc29-4995-b011-c19fffb768df tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1751 microversion: 2.20 time: 0.856309 Oct 30 01:38:59.252359 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2570/5149] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:38:58 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1751 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:38:59.775070 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4794cc4b-5161-49a7-9017-ca98204afb64 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:38:59.776732 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4794cc4b-5161-49a7-9017-ca98204afb64 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 6f087e90-1c4c-4637-9009-5f819c266271] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:38:59.787315 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4794cc4b-5161-49a7-9017-ca98204afb64 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:59.791279 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4794cc4b-5161-49a7-9017-ca98204afb64 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:59.793234 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4794cc4b-5161-49a7-9017-ca98204afb64 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:59.795127 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4794cc4b-5161-49a7-9017-ca98204afb64 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:38:59.795614 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4794cc4b-5161-49a7-9017-ca98204afb64 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:38:59.796053 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4794cc4b-5161-49a7-9017-ca98204afb64 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:38:59.950455 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4794cc4b-5161-49a7-9017-ca98204afb64 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:38:59.973262 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4794cc4b-5161-49a7-9017-ca98204afb64 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/6f087e90-1c4c-4637-9009-5f819c266271" status: 200 len: 1213 microversion: 2.1 time: 0.202546 Oct 30 01:38:59.977394 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2580/5150] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:38:59 2022] GET /compute/v2.1/servers/6f087e90-1c4c-4637-9009-5f819c266271 => generated 1213 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:39:00.292047 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3738f22f-4ef0-42f7-9d49-ffd02009359e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:00.294449 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3738f22f-4ef0-42f7-9d49-ffd02009359e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:00.309530 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3738f22f-4ef0-42f7-9d49-ffd02009359e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:00.311629 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3738f22f-4ef0-42f7-9d49-ffd02009359e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:00.315281 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3738f22f-4ef0-42f7-9d49-ffd02009359e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:00.316314 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3738f22f-4ef0-42f7-9d49-ffd02009359e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:00.316998 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3738f22f-4ef0-42f7-9d49-ffd02009359e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:00.317855 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3738f22f-4ef0-42f7-9d49-ffd02009359e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:00.626753 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3738f22f-4ef0-42f7-9d49-ffd02009359e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:00.642437 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3738f22f-4ef0-42f7-9d49-ffd02009359e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:00.647527 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3738f22f-4ef0-42f7-9d49-ffd02009359e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:00.650913 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3738f22f-4ef0-42f7-9d49-ffd02009359e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1751 microversion: 2.20 time: 0.374882 Oct 30 01:39:00.680658 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2571/5151] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:39:00 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1751 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:39:01.021247 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-89645be7-0383-4b8b-821e-7338d85a2606 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:01.022670 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-89645be7-0383-4b8b-821e-7338d85a2606 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 6f087e90-1c4c-4637-9009-5f819c266271] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:01.037658 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-89645be7-0383-4b8b-821e-7338d85a2606 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:01.039007 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-89645be7-0383-4b8b-821e-7338d85a2606 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:01.040057 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-89645be7-0383-4b8b-821e-7338d85a2606 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:01.040994 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-89645be7-0383-4b8b-821e-7338d85a2606 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:01.041718 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-89645be7-0383-4b8b-821e-7338d85a2606 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:01.042370 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-89645be7-0383-4b8b-821e-7338d85a2606 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:01.188186 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-89645be7-0383-4b8b-821e-7338d85a2606 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:01.196969 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-89645be7-0383-4b8b-821e-7338d85a2606 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/6f087e90-1c4c-4637-9009-5f819c266271" status: 200 len: 1269 microversion: 2.1 time: 0.200201 Oct 30 01:39:01.220049 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2581/5152] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:39:00 2022] GET /compute/v2.1/servers/6f087e90-1c4c-4637-9009-5f819c266271 => generated 1269 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:39:01.688582 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2d8ad0ac-2ab7-43bf-8d56-1b034c46a62a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:01.689314 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2d8ad0ac-2ab7-43bf-8d56-1b034c46a62a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:01.707189 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2d8ad0ac-2ab7-43bf-8d56-1b034c46a62a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:01.710128 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2d8ad0ac-2ab7-43bf-8d56-1b034c46a62a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:01.711819 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2d8ad0ac-2ab7-43bf-8d56-1b034c46a62a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:01.722364 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2d8ad0ac-2ab7-43bf-8d56-1b034c46a62a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:01.724308 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2d8ad0ac-2ab7-43bf-8d56-1b034c46a62a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:01.724922 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2d8ad0ac-2ab7-43bf-8d56-1b034c46a62a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:02.225237 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2d715d76-7654-4256-b2dc-9ecd62f56510 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:02.225938 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2d715d76-7654-4256-b2dc-9ecd62f56510 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 6f087e90-1c4c-4637-9009-5f819c266271] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:02.244841 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2d715d76-7654-4256-b2dc-9ecd62f56510 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:02.253580 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2d715d76-7654-4256-b2dc-9ecd62f56510 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:02.254343 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2d715d76-7654-4256-b2dc-9ecd62f56510 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:02.255400 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2d715d76-7654-4256-b2dc-9ecd62f56510 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:02.256239 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2d715d76-7654-4256-b2dc-9ecd62f56510 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:02.256836 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2d715d76-7654-4256-b2dc-9ecd62f56510 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:02.569188 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2d715d76-7654-4256-b2dc-9ecd62f56510 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:02.592420 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2d715d76-7654-4256-b2dc-9ecd62f56510 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/6f087e90-1c4c-4637-9009-5f819c266271" status: 200 len: 1275 microversion: 2.1 time: 0.371708 Oct 30 01:39:02.600321 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2582/5153] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:39:02 2022] GET /compute/v2.1/servers/6f087e90-1c4c-4637-9009-5f819c266271 => generated 1275 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:39:02.810397 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2d8ad0ac-2ab7-43bf-8d56-1b034c46a62a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:02.818190 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2d8ad0ac-2ab7-43bf-8d56-1b034c46a62a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:02.824180 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2d8ad0ac-2ab7-43bf-8d56-1b034c46a62a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:02.827510 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2d8ad0ac-2ab7-43bf-8d56-1b034c46a62a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1751 microversion: 2.20 time: 1.142055 Oct 30 01:39:02.830954 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2572/5154] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:39:01 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1751 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:39:03.627358 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0c08133a-c4dd-4c44-bf60-115c972b2e5b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:03.630007 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0c08133a-c4dd-4c44-bf60-115c972b2e5b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 6f087e90-1c4c-4637-9009-5f819c266271] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:03.645390 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c08133a-c4dd-4c44-bf60-115c972b2e5b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:03.645390 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c08133a-c4dd-4c44-bf60-115c972b2e5b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:03.645390 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c08133a-c4dd-4c44-bf60-115c972b2e5b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:03.645390 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c08133a-c4dd-4c44-bf60-115c972b2e5b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:03.645390 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c08133a-c4dd-4c44-bf60-115c972b2e5b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:03.645390 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c08133a-c4dd-4c44-bf60-115c972b2e5b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:03.860310 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d197a2d9-55c3-40a0-a9bf-78b856ef0ce1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:03.860853 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d197a2d9-55c3-40a0-a9bf-78b856ef0ce1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:03.891227 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d197a2d9-55c3-40a0-a9bf-78b856ef0ce1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:03.894266 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d197a2d9-55c3-40a0-a9bf-78b856ef0ce1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:03.895355 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d197a2d9-55c3-40a0-a9bf-78b856ef0ce1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:03.902494 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d197a2d9-55c3-40a0-a9bf-78b856ef0ce1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:03.902981 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d197a2d9-55c3-40a0-a9bf-78b856ef0ce1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:03.903416 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d197a2d9-55c3-40a0-a9bf-78b856ef0ce1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:03.943087 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:39:04.709951 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d197a2d9-55c3-40a0-a9bf-78b856ef0ce1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:04.719492 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d197a2d9-55c3-40a0-a9bf-78b856ef0ce1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:04.720933 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d197a2d9-55c3-40a0-a9bf-78b856ef0ce1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:04.737430 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d197a2d9-55c3-40a0-a9bf-78b856ef0ce1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1751 microversion: 2.20 time: 0.880922 Oct 30 01:39:04.738040 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2573/5155] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:39:03 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1751 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:39:04.948443 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0c08133a-c4dd-4c44-bf60-115c972b2e5b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:04.953721 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0c08133a-c4dd-4c44-bf60-115c972b2e5b tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/6f087e90-1c4c-4637-9009-5f819c266271" status: 200 len: 1317 microversion: 2.1 time: 1.334909 Oct 30 01:39:04.961830 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2583/5156] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:39:03 2022] GET /compute/v2.1/servers/6f087e90-1c4c-4637-9009-5f819c266271 => generated 1317 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:39:05.773144 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-64ed4741-fc3d-4ffd-b8b7-fe3c8137d976 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:05.774693 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-64ed4741-fc3d-4ffd-b8b7-fe3c8137d976 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:05.790949 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-64ed4741-fc3d-4ffd-b8b7-fe3c8137d976 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:05.791842 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-64ed4741-fc3d-4ffd-b8b7-fe3c8137d976 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:05.792453 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-64ed4741-fc3d-4ffd-b8b7-fe3c8137d976 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:05.793396 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-64ed4741-fc3d-4ffd-b8b7-fe3c8137d976 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:05.794028 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-64ed4741-fc3d-4ffd-b8b7-fe3c8137d976 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:05.794630 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-64ed4741-fc3d-4ffd-b8b7-fe3c8137d976 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:05.978499 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7b357b58-4cc7-41c1-b17d-2d01042d0454 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:05.980067 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7b357b58-4cc7-41c1-b17d-2d01042d0454 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 6f087e90-1c4c-4637-9009-5f819c266271] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:05.987919 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b357b58-4cc7-41c1-b17d-2d01042d0454 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:05.991597 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b357b58-4cc7-41c1-b17d-2d01042d0454 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:05.995120 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b357b58-4cc7-41c1-b17d-2d01042d0454 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:05.995120 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b357b58-4cc7-41c1-b17d-2d01042d0454 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:05.995120 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b357b58-4cc7-41c1-b17d-2d01042d0454 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:05.998215 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b357b58-4cc7-41c1-b17d-2d01042d0454 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:06.254710 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-64ed4741-fc3d-4ffd-b8b7-fe3c8137d976 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:06.286103 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-64ed4741-fc3d-4ffd-b8b7-fe3c8137d976 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:06.287994 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-64ed4741-fc3d-4ffd-b8b7-fe3c8137d976 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:06.290675 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-64ed4741-fc3d-4ffd-b8b7-fe3c8137d976 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1751 microversion: 2.20 time: 0.531632 Oct 30 01:39:06.292048 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2574/5157] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:39:05 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1751 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:39:06.475164 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7b357b58-4cc7-41c1-b17d-2d01042d0454 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:06.499304 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7b357b58-4cc7-41c1-b17d-2d01042d0454 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/6f087e90-1c4c-4637-9009-5f819c266271" status: 200 len: 1317 microversion: 2.1 time: 0.515393 Oct 30 01:39:06.502628 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2584/5158] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:39:05 2022] GET /compute/v2.1/servers/6f087e90-1c4c-4637-9009-5f819c266271 => generated 1317 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:39:07.320787 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6ab71b24-89c4-4fdd-b736-57d377d10c74 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:07.323274 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6ab71b24-89c4-4fdd-b736-57d377d10c74 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:07.339475 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6ab71b24-89c4-4fdd-b736-57d377d10c74 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:07.342731 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6ab71b24-89c4-4fdd-b736-57d377d10c74 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:07.343365 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6ab71b24-89c4-4fdd-b736-57d377d10c74 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:07.344410 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6ab71b24-89c4-4fdd-b736-57d377d10c74 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:07.350501 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6ab71b24-89c4-4fdd-b736-57d377d10c74 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:07.350501 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6ab71b24-89c4-4fdd-b736-57d377d10c74 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:07.515926 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-3606786a-66a5-4c5d-ae48-1f515006524e req-d55e9eba-3645-45a2-957c-061b28c484b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f087e90-1c4c-4637-9009-5f819c266271", "tag": "626735af-4ec1-409b-86c7-7bde6bd4cb44"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:39:07.521817 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:39:07.537049 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-3606786a-66a5-4c5d-ae48-1f515006524e req-d55e9eba-3645-45a2-957c-061b28c484b6 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:07.539796 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-3606786a-66a5-4c5d-ae48-1f515006524e req-d55e9eba-3645-45a2-957c-061b28c484b6 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:07.542489 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-3606786a-66a5-4c5d-ae48-1f515006524e req-d55e9eba-3645-45a2-957c-061b28c484b6 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:07.568930 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-3606786a-66a5-4c5d-ae48-1f515006524e req-d55e9eba-3645-45a2-957c-061b28c484b6 service nova] Creating event network-changed:626735af-4ec1-409b-86c7-7bde6bd4cb44 for instance 6f087e90-1c4c-4637-9009-5f819c266271 on n-h2-master-1 Oct 30 01:39:07.576302 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6ab71b24-89c4-4fdd-b736-57d377d10c74 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:07.587997 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-3606786a-66a5-4c5d-ae48-1f515006524e req-d55e9eba-3645-45a2-957c-061b28c484b6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082495 Oct 30 01:39:07.606921 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2585/5159] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:39:07.610935 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6ab71b24-89c4-4fdd-b736-57d377d10c74 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:07.612581 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6ab71b24-89c4-4fdd-b736-57d377d10c74 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:07.613830 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6ab71b24-89c4-4fdd-b736-57d377d10c74 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1751 microversion: 2.20 time: 0.297495 Oct 30 01:39:07.614403 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2575/5160] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:39:07 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1751 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:39:07.657173 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a81bf2ab-fd1f-4a6a-8d4a-2f47d190211d tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:07.658289 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a81bf2ab-fd1f-4a6a-8d4a-2f47d190211d tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 6f087e90-1c4c-4637-9009-5f819c266271] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:07.670925 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a81bf2ab-fd1f-4a6a-8d4a-2f47d190211d tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:07.671754 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a81bf2ab-fd1f-4a6a-8d4a-2f47d190211d tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:07.672415 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a81bf2ab-fd1f-4a6a-8d4a-2f47d190211d tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:07.673629 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a81bf2ab-fd1f-4a6a-8d4a-2f47d190211d tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:07.674591 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a81bf2ab-fd1f-4a6a-8d4a-2f47d190211d tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:07.675427 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a81bf2ab-fd1f-4a6a-8d4a-2f47d190211d tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:08.347364 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a81bf2ab-fd1f-4a6a-8d4a-2f47d190211d tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:08.371522 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a81bf2ab-fd1f-4a6a-8d4a-2f47d190211d tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/6f087e90-1c4c-4637-9009-5f819c266271" status: 200 len: 1317 microversion: 2.1 time: 0.763171 Oct 30 01:39:08.374200 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2586/5161] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:39:07 2022] GET /compute/v2.1/servers/6f087e90-1c4c-4637-9009-5f819c266271 => generated 1317 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:39:08.645777 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5029e977-4e44-40b8-b06e-8aaa8c5b2be7 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:08.646948 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5029e977-4e44-40b8-b06e-8aaa8c5b2be7 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:08.655283 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5029e977-4e44-40b8-b06e-8aaa8c5b2be7 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:08.656708 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5029e977-4e44-40b8-b06e-8aaa8c5b2be7 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:08.657389 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5029e977-4e44-40b8-b06e-8aaa8c5b2be7 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:08.658402 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5029e977-4e44-40b8-b06e-8aaa8c5b2be7 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:08.658916 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5029e977-4e44-40b8-b06e-8aaa8c5b2be7 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:08.659434 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5029e977-4e44-40b8-b06e-8aaa8c5b2be7 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:09.249882 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5029e977-4e44-40b8-b06e-8aaa8c5b2be7 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:09.291261 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5029e977-4e44-40b8-b06e-8aaa8c5b2be7 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:09.322873 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5029e977-4e44-40b8-b06e-8aaa8c5b2be7 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:09.324755 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5029e977-4e44-40b8-b06e-8aaa8c5b2be7 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1751 microversion: 2.20 time: 0.684116 Oct 30 01:39:09.346677 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2576/5162] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:39:08 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1751 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:39:09.396260 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-00be5fdb-55a9-46f6-a41d-a3976e21dcd6 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:09.396942 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-00be5fdb-55a9-46f6-a41d-a3976e21dcd6 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 6f087e90-1c4c-4637-9009-5f819c266271] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:09.416512 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=10 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:39:09.418123 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-00be5fdb-55a9-46f6-a41d-a3976e21dcd6 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:09.421593 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-00be5fdb-55a9-46f6-a41d-a3976e21dcd6 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:09.424562 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-00be5fdb-55a9-46f6-a41d-a3976e21dcd6 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:09.424562 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-00be5fdb-55a9-46f6-a41d-a3976e21dcd6 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:09.424562 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-00be5fdb-55a9-46f6-a41d-a3976e21dcd6 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:09.424562 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-00be5fdb-55a9-46f6-a41d-a3976e21dcd6 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:09.634120 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-00be5fdb-55a9-46f6-a41d-a3976e21dcd6 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:09.646226 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-00be5fdb-55a9-46f6-a41d-a3976e21dcd6 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/6f087e90-1c4c-4637-9009-5f819c266271" status: 200 len: 1317 microversion: 2.1 time: 0.250725 Oct 30 01:39:09.648315 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2587/5163] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:39:09 2022] GET /compute/v2.1/servers/6f087e90-1c4c-4637-9009-5f819c266271 => generated 1317 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:39:10.356594 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e867d8bc-2d9b-4308-a0bf-4e998387ac8f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:10.358036 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e867d8bc-2d9b-4308-a0bf-4e998387ac8f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:10.383183 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e867d8bc-2d9b-4308-a0bf-4e998387ac8f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:10.383608 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e867d8bc-2d9b-4308-a0bf-4e998387ac8f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:10.390150 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e867d8bc-2d9b-4308-a0bf-4e998387ac8f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:10.390150 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e867d8bc-2d9b-4308-a0bf-4e998387ac8f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:10.390150 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e867d8bc-2d9b-4308-a0bf-4e998387ac8f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:10.393192 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e867d8bc-2d9b-4308-a0bf-4e998387ac8f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:10.624983 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e867d8bc-2d9b-4308-a0bf-4e998387ac8f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:10.639861 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e867d8bc-2d9b-4308-a0bf-4e998387ac8f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:10.641514 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e867d8bc-2d9b-4308-a0bf-4e998387ac8f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:10.643124 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e867d8bc-2d9b-4308-a0bf-4e998387ac8f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1807 microversion: 2.20 time: 0.290830 Oct 30 01:39:10.644010 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2577/5164] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:39:10 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1807 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:39:10.671985 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6c3d35a3-6e38-4123-b121-58948490d176 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:10.672643 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6c3d35a3-6e38-4123-b121-58948490d176 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 6f087e90-1c4c-4637-9009-5f819c266271] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:10.682379 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c3d35a3-6e38-4123-b121-58948490d176 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:10.687930 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c3d35a3-6e38-4123-b121-58948490d176 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:10.687930 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c3d35a3-6e38-4123-b121-58948490d176 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:10.687930 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c3d35a3-6e38-4123-b121-58948490d176 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:10.687930 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c3d35a3-6e38-4123-b121-58948490d176 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:10.687930 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c3d35a3-6e38-4123-b121-58948490d176 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:10.965466 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6c3d35a3-6e38-4123-b121-58948490d176 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:10.973581 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6c3d35a3-6e38-4123-b121-58948490d176 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/6f087e90-1c4c-4637-9009-5f819c266271" status: 200 len: 1317 microversion: 2.1 time: 0.305404 Oct 30 01:39:10.989891 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2588/5165] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:39:10 2022] GET /compute/v2.1/servers/6f087e90-1c4c-4637-9009-5f819c266271 => generated 1317 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:39:11.678720 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-13fab629-1cac-4581-9c91-b229b5213b9f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:11.680648 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-13fab629-1cac-4581-9c91-b229b5213b9f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:11.697326 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:39:11.698880 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-13fab629-1cac-4581-9c91-b229b5213b9f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:11.701794 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-13fab629-1cac-4581-9c91-b229b5213b9f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:11.702364 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-13fab629-1cac-4581-9c91-b229b5213b9f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:11.703386 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-13fab629-1cac-4581-9c91-b229b5213b9f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:11.704116 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-13fab629-1cac-4581-9c91-b229b5213b9f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:11.708276 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-13fab629-1cac-4581-9c91-b229b5213b9f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:11.996841 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f780f3ae-8686-4e1b-99e5-313a9e38785c tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:11.997549 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f780f3ae-8686-4e1b-99e5-313a9e38785c tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 6f087e90-1c4c-4637-9009-5f819c266271] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:12.005481 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f780f3ae-8686-4e1b-99e5-313a9e38785c tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:12.008579 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f780f3ae-8686-4e1b-99e5-313a9e38785c tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:12.011546 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f780f3ae-8686-4e1b-99e5-313a9e38785c tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:12.011546 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f780f3ae-8686-4e1b-99e5-313a9e38785c tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:12.011546 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f780f3ae-8686-4e1b-99e5-313a9e38785c tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:12.012175 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f780f3ae-8686-4e1b-99e5-313a9e38785c tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:12.291170 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-13fab629-1cac-4581-9c91-b229b5213b9f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:12.302904 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-13fab629-1cac-4581-9c91-b229b5213b9f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:12.311184 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-13fab629-1cac-4581-9c91-b229b5213b9f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:12.314035 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-13fab629-1cac-4581-9c91-b229b5213b9f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1807 microversion: 2.20 time: 0.641679 Oct 30 01:39:12.314992 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2578/5166] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:39:11 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1807 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:39:12.463633 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f780f3ae-8686-4e1b-99e5-313a9e38785c tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:12.478792 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f780f3ae-8686-4e1b-99e5-313a9e38785c tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/6f087e90-1c4c-4637-9009-5f819c266271" status: 200 len: 1317 microversion: 2.1 time: 0.483453 Oct 30 01:39:12.478792 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2589/5167] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:39:11 2022] GET /compute/v2.1/servers/6f087e90-1c4c-4637-9009-5f819c266271 => generated 1317 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:39:13.346437 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9329a4d9-68f0-47de-8d1a-49241a32ab4f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:13.347052 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9329a4d9-68f0-47de-8d1a-49241a32ab4f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:13.361955 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9329a4d9-68f0-47de-8d1a-49241a32ab4f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:13.364582 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9329a4d9-68f0-47de-8d1a-49241a32ab4f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:13.365175 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9329a4d9-68f0-47de-8d1a-49241a32ab4f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:13.367525 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9329a4d9-68f0-47de-8d1a-49241a32ab4f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:13.368243 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9329a4d9-68f0-47de-8d1a-49241a32ab4f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:13.368935 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9329a4d9-68f0-47de-8d1a-49241a32ab4f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:13.507200 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9aac1583-08f5-48ab-8e70-600721b5f375 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:13.510843 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9aac1583-08f5-48ab-8e70-600721b5f375 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 6f087e90-1c4c-4637-9009-5f819c266271] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:13.536427 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9aac1583-08f5-48ab-8e70-600721b5f375 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:13.538575 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9aac1583-08f5-48ab-8e70-600721b5f375 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:13.541150 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9aac1583-08f5-48ab-8e70-600721b5f375 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:13.544687 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9aac1583-08f5-48ab-8e70-600721b5f375 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:13.545653 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9aac1583-08f5-48ab-8e70-600721b5f375 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:13.546297 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9aac1583-08f5-48ab-8e70-600721b5f375 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:13.975672 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9329a4d9-68f0-47de-8d1a-49241a32ab4f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:13.991680 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9329a4d9-68f0-47de-8d1a-49241a32ab4f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:14.000214 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9329a4d9-68f0-47de-8d1a-49241a32ab4f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:14.005368 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9329a4d9-68f0-47de-8d1a-49241a32ab4f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1807 microversion: 2.20 time: 0.662747 Oct 30 01:39:14.009493 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2579/5168] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:39:13 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1807 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:39:14.146496 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9aac1583-08f5-48ab-8e70-600721b5f375 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:14.155151 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9aac1583-08f5-48ab-8e70-600721b5f375 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/6f087e90-1c4c-4637-9009-5f819c266271" status: 200 len: 1317 microversion: 2.1 time: 0.657516 Oct 30 01:39:14.176684 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2590/5169] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:39:13 2022] GET /compute/v2.1/servers/6f087e90-1c4c-4637-9009-5f819c266271 => generated 1317 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:39:15.036227 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f1be4c28-1344-40a1-b52b-4f0fa8506bdb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:15.037011 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f1be4c28-1344-40a1-b52b-4f0fa8506bdb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:15.076257 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f1be4c28-1344-40a1-b52b-4f0fa8506bdb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:15.076768 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f1be4c28-1344-40a1-b52b-4f0fa8506bdb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:15.079502 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f1be4c28-1344-40a1-b52b-4f0fa8506bdb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:15.080410 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f1be4c28-1344-40a1-b52b-4f0fa8506bdb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:15.083255 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f1be4c28-1344-40a1-b52b-4f0fa8506bdb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:15.083769 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f1be4c28-1344-40a1-b52b-4f0fa8506bdb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:15.183999 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-066a924b-5e8b-46bc-826a-b38aa17cbe08 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:15.185956 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-066a924b-5e8b-46bc-826a-b38aa17cbe08 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 6f087e90-1c4c-4637-9009-5f819c266271] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:15.201537 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-066a924b-5e8b-46bc-826a-b38aa17cbe08 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:15.203796 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-066a924b-5e8b-46bc-826a-b38aa17cbe08 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:15.205756 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-066a924b-5e8b-46bc-826a-b38aa17cbe08 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:15.207982 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-066a924b-5e8b-46bc-826a-b38aa17cbe08 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:15.209593 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-066a924b-5e8b-46bc-826a-b38aa17cbe08 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:15.213938 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-066a924b-5e8b-46bc-826a-b38aa17cbe08 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:15.266153 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f1be4c28-1344-40a1-b52b-4f0fa8506bdb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:15.283451 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f1be4c28-1344-40a1-b52b-4f0fa8506bdb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:15.285430 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f1be4c28-1344-40a1-b52b-4f0fa8506bdb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:15.288253 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f1be4c28-1344-40a1-b52b-4f0fa8506bdb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1807 microversion: 2.20 time: 0.257010 Oct 30 01:39:15.290284 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2580/5170] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:39:15 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1807 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:39:15.501163 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-066a924b-5e8b-46bc-826a-b38aa17cbe08 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:15.513651 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-066a924b-5e8b-46bc-826a-b38aa17cbe08 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/6f087e90-1c4c-4637-9009-5f819c266271" status: 200 len: 1317 microversion: 2.1 time: 0.333019 Oct 30 01:39:15.541596 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2591/5171] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:39:15 2022] GET /compute/v2.1/servers/6f087e90-1c4c-4637-9009-5f819c266271 => generated 1317 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:39:15.554259 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-fc1b93f9-3b11-4c56-9be1-18bd956c3444 req-cf3bf054-087c-465a-a997-f8ba84f80cd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f087e90-1c4c-4637-9009-5f819c266271", "name": "network-vif-plugged", "status": "completed", "tag": "626735af-4ec1-409b-86c7-7bde6bd4cb44"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:39:15.595955 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-fc1b93f9-3b11-4c56-9be1-18bd956c3444 req-cf3bf054-087c-465a-a997-f8ba84f80cd9 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:15.598905 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-fc1b93f9-3b11-4c56-9be1-18bd956c3444 req-cf3bf054-087c-465a-a997-f8ba84f80cd9 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:15.599517 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-fc1b93f9-3b11-4c56-9be1-18bd956c3444 req-cf3bf054-087c-465a-a997-f8ba84f80cd9 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:15.637039 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-fc1b93f9-3b11-4c56-9be1-18bd956c3444 req-cf3bf054-087c-465a-a997-f8ba84f80cd9 service nova] Creating event network-vif-plugged:626735af-4ec1-409b-86c7-7bde6bd4cb44 for instance 6f087e90-1c4c-4637-9009-5f819c266271 on n-h2-master-1 Oct 30 01:39:15.664141 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-fc1b93f9-3b11-4c56-9be1-18bd956c3444 req-cf3bf054-087c-465a-a997-f8ba84f80cd9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129154 Oct 30 01:39:15.665886 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2581/5172] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:39:16.316902 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9148612c-7e05-403c-8788-6aa81c2b6f6d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:16.317763 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9148612c-7e05-403c-8788-6aa81c2b6f6d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:16.335748 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9148612c-7e05-403c-8788-6aa81c2b6f6d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:16.336258 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9148612c-7e05-403c-8788-6aa81c2b6f6d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:16.336700 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9148612c-7e05-403c-8788-6aa81c2b6f6d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:16.337448 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9148612c-7e05-403c-8788-6aa81c2b6f6d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:16.337907 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9148612c-7e05-403c-8788-6aa81c2b6f6d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:16.339978 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9148612c-7e05-403c-8788-6aa81c2b6f6d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:16.413849 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:39:16.540251 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ea722037-2480-41bd-8641-56ab6b666edf tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:16.541201 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ea722037-2480-41bd-8641-56ab6b666edf tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 6f087e90-1c4c-4637-9009-5f819c266271] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:16.564196 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea722037-2480-41bd-8641-56ab6b666edf tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:16.564739 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea722037-2480-41bd-8641-56ab6b666edf tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:16.565191 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea722037-2480-41bd-8641-56ab6b666edf tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:16.566113 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea722037-2480-41bd-8641-56ab6b666edf tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:16.582477 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea722037-2480-41bd-8641-56ab6b666edf tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:16.583127 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea722037-2480-41bd-8641-56ab6b666edf tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:16.823478 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9148612c-7e05-403c-8788-6aa81c2b6f6d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:16.845129 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9148612c-7e05-403c-8788-6aa81c2b6f6d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:16.854598 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9148612c-7e05-403c-8788-6aa81c2b6f6d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:16.856065 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9148612c-7e05-403c-8788-6aa81c2b6f6d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1807 microversion: 2.20 time: 0.543392 Oct 30 01:39:16.871520 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2592/5173] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:39:16 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1807 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:39:17.832232 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ea722037-2480-41bd-8641-56ab6b666edf tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:17.847812 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ea722037-2480-41bd-8641-56ab6b666edf tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/6f087e90-1c4c-4637-9009-5f819c266271" status: 200 len: 1317 microversion: 2.1 time: 1.313658 Oct 30 01:39:17.849674 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2582/5174] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:39:16 2022] GET /compute/v2.1/servers/6f087e90-1c4c-4637-9009-5f819c266271 => generated 1317 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:39:17.902280 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8734364a-6d65-4974-bc1b-7348418a3bdb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:17.902898 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8734364a-6d65-4974-bc1b-7348418a3bdb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:17.924394 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:39:17.926898 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8734364a-6d65-4974-bc1b-7348418a3bdb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:17.927533 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8734364a-6d65-4974-bc1b-7348418a3bdb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:17.928157 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8734364a-6d65-4974-bc1b-7348418a3bdb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:17.929853 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8734364a-6d65-4974-bc1b-7348418a3bdb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:17.930473 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8734364a-6d65-4974-bc1b-7348418a3bdb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:17.931769 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8734364a-6d65-4974-bc1b-7348418a3bdb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:18.699000 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8734364a-6d65-4974-bc1b-7348418a3bdb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:18.724998 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8734364a-6d65-4974-bc1b-7348418a3bdb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:18.727882 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8734364a-6d65-4974-bc1b-7348418a3bdb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:18.729817 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8734364a-6d65-4974-bc1b-7348418a3bdb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1807 microversion: 2.20 time: 0.831455 Oct 30 01:39:18.742359 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2593/5175] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:39:17 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1807 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:39:18.878654 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9b415241-25d3-4d80-b624-2b75e75f8a19 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:18.879277 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9b415241-25d3-4d80-b624-2b75e75f8a19 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 6f087e90-1c4c-4637-9009-5f819c266271] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:18.894694 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b415241-25d3-4d80-b624-2b75e75f8a19 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:18.895491 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b415241-25d3-4d80-b624-2b75e75f8a19 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:18.896178 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b415241-25d3-4d80-b624-2b75e75f8a19 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:18.898723 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b415241-25d3-4d80-b624-2b75e75f8a19 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:18.899463 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b415241-25d3-4d80-b624-2b75e75f8a19 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:18.900930 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b415241-25d3-4d80-b624-2b75e75f8a19 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:19.454623 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9b415241-25d3-4d80-b624-2b75e75f8a19 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:19.467481 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9b415241-25d3-4d80-b624-2b75e75f8a19 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/6f087e90-1c4c-4637-9009-5f819c266271" status: 200 len: 1507 microversion: 2.1 time: 0.598643 Oct 30 01:39:19.468966 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2583/5176] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:39:18 2022] GET /compute/v2.1/servers/6f087e90-1c4c-4637-9009-5f819c266271 => generated 1507 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:39:19.497450 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4aecd332-7e82-4377-9ed2-f6a49d27633a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:19.497450 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4aecd332-7e82-4377-9ed2-f6a49d27633a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 6f087e90-1c4c-4637-9009-5f819c266271] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:19.520952 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4aecd332-7e82-4377-9ed2-f6a49d27633a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:19.521507 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4aecd332-7e82-4377-9ed2-f6a49d27633a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:19.521957 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4aecd332-7e82-4377-9ed2-f6a49d27633a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:19.523417 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4aecd332-7e82-4377-9ed2-f6a49d27633a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:19.523883 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4aecd332-7e82-4377-9ed2-f6a49d27633a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:19.524362 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4aecd332-7e82-4377-9ed2-f6a49d27633a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:19.762333 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-eb192514-3ec6-4c45-b00c-fe97bd917c09 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:19.762333 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-eb192514-3ec6-4c45-b00c-fe97bd917c09 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:19.770147 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eb192514-3ec6-4c45-b00c-fe97bd917c09 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:19.770967 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eb192514-3ec6-4c45-b00c-fe97bd917c09 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:19.772877 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eb192514-3ec6-4c45-b00c-fe97bd917c09 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:19.774368 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eb192514-3ec6-4c45-b00c-fe97bd917c09 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:19.776383 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eb192514-3ec6-4c45-b00c-fe97bd917c09 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:19.780072 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eb192514-3ec6-4c45-b00c-fe97bd917c09 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:20.255998 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4aecd332-7e82-4377-9ed2-f6a49d27633a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:20.271800 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4aecd332-7e82-4377-9ed2-f6a49d27633a tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/6f087e90-1c4c-4637-9009-5f819c266271" status: 200 len: 1507 microversion: 2.1 time: 0.778890 Oct 30 01:39:20.272457 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2594/5177] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:39:19 2022] GET /compute/v2.1/servers/6f087e90-1c4c-4637-9009-5f819c266271 => generated 1507 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:39:20.303998 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-eea71868-b300-443c-a2d4-2373d1d00b2f tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:39:20.315568 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-eea71868-b300-443c-a2d4-2373d1d00b2f tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 6f087e90-1c4c-4637-9009-5f819c266271] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:20.340148 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eea71868-b300-443c-a2d4-2373d1d00b2f tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:20.343463 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eea71868-b300-443c-a2d4-2373d1d00b2f tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:20.346371 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eea71868-b300-443c-a2d4-2373d1d00b2f tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:20.349252 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eea71868-b300-443c-a2d4-2373d1d00b2f tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:20.352759 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eea71868-b300-443c-a2d4-2373d1d00b2f tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:20.353589 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eea71868-b300-443c-a2d4-2373d1d00b2f tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:20.629499 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-eb192514-3ec6-4c45-b00c-fe97bd917c09 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:20.682422 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-eb192514-3ec6-4c45-b00c-fe97bd917c09 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:20.696162 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-eb192514-3ec6-4c45-b00c-fe97bd917c09 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:20.703738 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-eb192514-3ec6-4c45-b00c-fe97bd917c09 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1807 microversion: 2.20 time: 0.947985 Oct 30 01:39:20.709732 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2584/5178] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:39:19 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1807 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:39:20.856934 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-eea71868-b300-443c-a2d4-2373d1d00b2f tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "PUT /compute/v2.1/servers/6f087e90-1c4c-4637-9009-5f819c266271" status: 200 len: 1079 microversion: 2.1 time: 0.560140 Oct 30 01:39:20.872815 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2595/5179] 10.222.0.13 () {60 vars in 1256 bytes} [Sun Oct 30 01:39:20 2022] PUT /compute/v2.1/servers/6f087e90-1c4c-4637-9009-5f819c266271 => generated 1079 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:39:20.915759 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-dc1398cf-6b25-46b4-9ab4-adc8f8f4a1c8 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:20.915759 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-dc1398cf-6b25-46b4-9ab4-adc8f8f4a1c8 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 6f087e90-1c4c-4637-9009-5f819c266271] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:20.929605 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dc1398cf-6b25-46b4-9ab4-adc8f8f4a1c8 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:20.931382 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dc1398cf-6b25-46b4-9ab4-adc8f8f4a1c8 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:20.932893 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dc1398cf-6b25-46b4-9ab4-adc8f8f4a1c8 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:20.935165 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dc1398cf-6b25-46b4-9ab4-adc8f8f4a1c8 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:20.937483 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dc1398cf-6b25-46b4-9ab4-adc8f8f4a1c8 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:20.938117 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dc1398cf-6b25-46b4-9ab4-adc8f8f4a1c8 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:21.112347 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3a50adcd-d63d-4305-8226-06f5b820f495 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:21.119307 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3a50adcd-d63d-4305-8226-06f5b820f495 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:21.143114 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3a50adcd-d63d-4305-8226-06f5b820f495 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:21.148031 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3a50adcd-d63d-4305-8226-06f5b820f495 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:21.151928 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3a50adcd-d63d-4305-8226-06f5b820f495 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:21.155736 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3a50adcd-d63d-4305-8226-06f5b820f495 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:21.157389 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3a50adcd-d63d-4305-8226-06f5b820f495 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:21.160842 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3a50adcd-d63d-4305-8226-06f5b820f495 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:21.257970 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-dc1398cf-6b25-46b4-9ab4-adc8f8f4a1c8 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:21.274601 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-dc1398cf-6b25-46b4-9ab4-adc8f8f4a1c8 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/6f087e90-1c4c-4637-9009-5f819c266271" status: 200 len: 1505 microversion: 2.1 time: 0.390985 Oct 30 01:39:21.277303 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2585/5180] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:39:20 2022] GET /compute/v2.1/servers/6f087e90-1c4c-4637-9009-5f819c266271 => generated 1505 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:39:21.298398 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3a50adcd-d63d-4305-8226-06f5b820f495 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.191330 Oct 30 01:39:21.310070 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5daf91b9-e579-43f8-8d17-e6f281848de0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:21.310293 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2596/5181] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 01:39:21 2022] GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b/os-volume_attachments => generated 25 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 30 01:39:21.310402 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5daf91b9-e579-43f8-8d17-e6f281848de0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 6f087e90-1c4c-4637-9009-5f819c266271] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:21.321024 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5daf91b9-e579-43f8-8d17-e6f281848de0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:21.321783 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5daf91b9-e579-43f8-8d17-e6f281848de0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:21.325407 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5daf91b9-e579-43f8-8d17-e6f281848de0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:21.326279 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5daf91b9-e579-43f8-8d17-e6f281848de0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:21.326753 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5daf91b9-e579-43f8-8d17-e6f281848de0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:21.327188 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5daf91b9-e579-43f8-8d17-e6f281848de0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:21.471230 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-dcf40c64-d1a4-4d17-9da9-a7c871b17d9f tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:21.472131 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-dcf40c64-d1a4-4d17-9da9-a7c871b17d9f tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:21.484937 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dcf40c64-d1a4-4d17-9da9-a7c871b17d9f tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:21.486175 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dcf40c64-d1a4-4d17-9da9-a7c871b17d9f tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:21.487097 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dcf40c64-d1a4-4d17-9da9-a7c871b17d9f tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:21.488495 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dcf40c64-d1a4-4d17-9da9-a7c871b17d9f tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:21.489768 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dcf40c64-d1a4-4d17-9da9-a7c871b17d9f tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:21.491617 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dcf40c64-d1a4-4d17-9da9-a7c871b17d9f tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:21.564236 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-dcf40c64-d1a4-4d17-9da9-a7c871b17d9f tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:39:21.687099 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5daf91b9-e579-43f8-8d17-e6f281848de0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:21.699371 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5daf91b9-e579-43f8-8d17-e6f281848de0 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/6f087e90-1c4c-4637-9009-5f819c266271" status: 200 len: 1505 microversion: 2.1 time: 0.397861 Oct 30 01:39:21.700722 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2586/5182] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:39:21 2022] GET /compute/v2.1/servers/6f087e90-1c4c-4637-9009-5f819c266271 => generated 1505 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:39:21.730815 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9c43c849-7e91-4965-94df-7c8ca6cb698f tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:39:21.734672 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9c43c849-7e91-4965-94df-7c8ca6cb698f tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 6f087e90-1c4c-4637-9009-5f819c266271] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:21.764651 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9c43c849-7e91-4965-94df-7c8ca6cb698f tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:21.767722 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9c43c849-7e91-4965-94df-7c8ca6cb698f tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:21.772687 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9c43c849-7e91-4965-94df-7c8ca6cb698f tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:21.772687 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9c43c849-7e91-4965-94df-7c8ca6cb698f tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:21.772687 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9c43c849-7e91-4965-94df-7c8ca6cb698f tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:21.772687 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9c43c849-7e91-4965-94df-7c8ca6cb698f tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:22.019425 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9c43c849-7e91-4965-94df-7c8ca6cb698f tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "PUT /compute/v2.1/servers/6f087e90-1c4c-4637-9009-5f819c266271" status: 200 len: 1081 microversion: 2.1 time: 0.295718 Oct 30 01:39:22.049548 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2587/5183] 10.222.0.13 () {60 vars in 1256 bytes} [Sun Oct 30 01:39:21 2022] PUT /compute/v2.1/servers/6f087e90-1c4c-4637-9009-5f819c266271 => generated 1081 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:39:22.077643 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1df3ef58-44d7-41bd-96ce-6ec9d9c4554f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:22.078566 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1df3ef58-44d7-41bd-96ce-6ec9d9c4554f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:22.095001 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1df3ef58-44d7-41bd-96ce-6ec9d9c4554f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:22.095245 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-dcf40c64-d1a4-4d17-9da9-a7c871b17d9f tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "DELETE /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b" status: 204 len: 0 microversion: 2.1 time: 0.628538 Oct 30 01:39:22.095903 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2597/5184] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:39:21 2022] DELETE /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b => generated 0 bytes in 631 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 30 01:39:22.106937 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1df3ef58-44d7-41bd-96ce-6ec9d9c4554f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:22.106937 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1df3ef58-44d7-41bd-96ce-6ec9d9c4554f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:22.106937 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1df3ef58-44d7-41bd-96ce-6ec9d9c4554f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:22.107239 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6c4d7433-7f8e-4906-92f0-9e9a25314703 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:22.107331 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1df3ef58-44d7-41bd-96ce-6ec9d9c4554f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:22.107331 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1df3ef58-44d7-41bd-96ce-6ec9d9c4554f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:22.107501 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6c4d7433-7f8e-4906-92f0-9e9a25314703 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 6f087e90-1c4c-4637-9009-5f819c266271] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:22.132235 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c4d7433-7f8e-4906-92f0-9e9a25314703 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:22.140243 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c4d7433-7f8e-4906-92f0-9e9a25314703 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:22.141138 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c4d7433-7f8e-4906-92f0-9e9a25314703 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:22.142477 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c4d7433-7f8e-4906-92f0-9e9a25314703 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:22.143181 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c4d7433-7f8e-4906-92f0-9e9a25314703 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:22.150524 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c4d7433-7f8e-4906-92f0-9e9a25314703 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:22.941420 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6c4d7433-7f8e-4906-92f0-9e9a25314703 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:22.954062 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6c4d7433-7f8e-4906-92f0-9e9a25314703 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/6f087e90-1c4c-4637-9009-5f819c266271" status: 200 len: 1507 microversion: 2.1 time: 0.856321 Oct 30 01:39:22.955590 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2598/5185] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:39:22 2022] GET /compute/v2.1/servers/6f087e90-1c4c-4637-9009-5f819c266271 => generated 1507 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:39:22.979608 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-21313fa6-a0c4-41ff-ab4a-2c3eb2ab9a8e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:22.980465 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-21313fa6-a0c4-41ff-ab4a-2c3eb2ab9a8e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:23.002802 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1df3ef58-44d7-41bd-96ce-6ec9d9c4554f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:23.028439 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21313fa6-a0c4-41ff-ab4a-2c3eb2ab9a8e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:23.028886 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21313fa6-a0c4-41ff-ab4a-2c3eb2ab9a8e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:23.035494 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1df3ef58-44d7-41bd-96ce-6ec9d9c4554f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:23.036422 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21313fa6-a0c4-41ff-ab4a-2c3eb2ab9a8e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:23.038791 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21313fa6-a0c4-41ff-ab4a-2c3eb2ab9a8e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:23.039355 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21313fa6-a0c4-41ff-ab4a-2c3eb2ab9a8e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:23.041610 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1df3ef58-44d7-41bd-96ce-6ec9d9c4554f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:23.042829 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21313fa6-a0c4-41ff-ab4a-2c3eb2ab9a8e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:23.046346 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1df3ef58-44d7-41bd-96ce-6ec9d9c4554f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1807 microversion: 2.20 time: 1.003252 Oct 30 01:39:23.059328 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2588/5186] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:39:22 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1807 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:39:23.072923 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d6c9a4d1-cb86-4178-bff2-72e4b3b84f6c tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:23.073570 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d6c9a4d1-cb86-4178-bff2-72e4b3b84f6c tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 6f087e90-1c4c-4637-9009-5f819c266271] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:23.109564 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d6c9a4d1-cb86-4178-bff2-72e4b3b84f6c tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:23.110068 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d6c9a4d1-cb86-4178-bff2-72e4b3b84f6c tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:23.110510 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d6c9a4d1-cb86-4178-bff2-72e4b3b84f6c tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:23.111231 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d6c9a4d1-cb86-4178-bff2-72e4b3b84f6c tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:23.111681 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d6c9a4d1-cb86-4178-bff2-72e4b3b84f6c tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:23.112110 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d6c9a4d1-cb86-4178-bff2-72e4b3b84f6c tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:23.581687 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-21313fa6-a0c4-41ff-ab4a-2c3eb2ab9a8e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:23.594500 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-21313fa6-a0c4-41ff-ab4a-2c3eb2ab9a8e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b" status: 200 len: 1673 microversion: 2.1 time: 0.635847 Oct 30 01:39:23.595408 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2599/5187] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:39:22 2022] GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b => generated 1673 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:39:23.675224 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d6c9a4d1-cb86-4178-bff2-72e4b3b84f6c tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:23.684992 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d6c9a4d1-cb86-4178-bff2-72e4b3b84f6c tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/6f087e90-1c4c-4637-9009-5f819c266271" status: 200 len: 1507 microversion: 2.1 time: 0.621140 Oct 30 01:39:23.685611 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2589/5188] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:39:23 2022] GET /compute/v2.1/servers/6f087e90-1c4c-4637-9009-5f819c266271 => generated 1507 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:39:23.711818 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-460c70d7-4d69-47f8-a221-f1857b3d81c5 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:23.712621 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-460c70d7-4d69-47f8-a221-f1857b3d81c5 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 6f087e90-1c4c-4637-9009-5f819c266271] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:23.724811 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-460c70d7-4d69-47f8-a221-f1857b3d81c5 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:23.728314 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-460c70d7-4d69-47f8-a221-f1857b3d81c5 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:23.728824 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-460c70d7-4d69-47f8-a221-f1857b3d81c5 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:23.729687 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-460c70d7-4d69-47f8-a221-f1857b3d81c5 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:23.730180 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-460c70d7-4d69-47f8-a221-f1857b3d81c5 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:23.731515 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-460c70d7-4d69-47f8-a221-f1857b3d81c5 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:23.836752 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-460c70d7-4d69-47f8-a221-f1857b3d81c5 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 6f087e90-1c4c-4637-9009-5f819c266271] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:39:24.090428 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-62c35d28-da82-4d0b-8862-97d0c3cdf1de tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:24.091854 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-62c35d28-da82-4d0b-8862-97d0c3cdf1de tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:24.107011 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-62c35d28-da82-4d0b-8862-97d0c3cdf1de tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:24.119164 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-62c35d28-da82-4d0b-8862-97d0c3cdf1de tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:24.120110 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-62c35d28-da82-4d0b-8862-97d0c3cdf1de tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:24.121072 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-62c35d28-da82-4d0b-8862-97d0c3cdf1de tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:24.121783 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-62c35d28-da82-4d0b-8862-97d0c3cdf1de tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:24.122379 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-62c35d28-da82-4d0b-8862-97d0c3cdf1de tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:24.171666 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:39:24.377625 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-460c70d7-4d69-47f8-a221-f1857b3d81c5 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6f087e90-1c4c-4637-9009-5f819c266271" status: 204 len: 0 microversion: 2.1 time: 0.663665 Oct 30 01:39:24.377625 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2600/5189] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:39:23 2022] DELETE /compute/v2.1/servers/6f087e90-1c4c-4637-9009-5f819c266271 => generated 0 bytes in 665 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:39:24.395680 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8e924075-b69f-4339-be09-21943c1c30e3 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:24.396568 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8e924075-b69f-4339-be09-21943c1c30e3 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 6f087e90-1c4c-4637-9009-5f819c266271] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:24.426334 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8e924075-b69f-4339-be09-21943c1c30e3 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:24.440217 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8e924075-b69f-4339-be09-21943c1c30e3 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:24.441257 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8e924075-b69f-4339-be09-21943c1c30e3 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:24.442601 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8e924075-b69f-4339-be09-21943c1c30e3 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:24.445524 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8e924075-b69f-4339-be09-21943c1c30e3 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:24.446347 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8e924075-b69f-4339-be09-21943c1c30e3 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:24.528301 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8e924075-b69f-4339-be09-21943c1c30e3 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 6f087e90-1c4c-4637-9009-5f819c266271] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:39:24.707950 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-62c35d28-da82-4d0b-8862-97d0c3cdf1de tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:24.720713 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-62c35d28-da82-4d0b-8862-97d0c3cdf1de tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:24.724362 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-62c35d28-da82-4d0b-8862-97d0c3cdf1de tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:24.727547 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-62c35d28-da82-4d0b-8862-97d0c3cdf1de tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1807 microversion: 2.20 time: 0.641958 Oct 30 01:39:24.728627 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2590/5190] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:39:24 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1807 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:39:24.749772 n-d-master-1 devstack@n-api.service[121103]: INFO nova.compute.api [None req-8e924075-b69f-4339-be09-21943c1c30e3 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 6f087e90-1c4c-4637-9009-5f819c266271] Instance is already in deleting state, ignoring this request Oct 30 01:39:24.751351 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8e924075-b69f-4339-be09-21943c1c30e3 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6f087e90-1c4c-4637-9009-5f819c266271" status: 204 len: 0 microversion: 2.1 time: 0.370856 Oct 30 01:39:24.752771 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6f2d9d7a-f235-4fd2-92b0-81806eb55fa7 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:24.753390 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6f2d9d7a-f235-4fd2-92b0-81806eb55fa7 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:24.758401 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2601/5191] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:39:24 2022] DELETE /compute/v2.1/servers/6f087e90-1c4c-4637-9009-5f819c266271 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:39:24.764828 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6f2d9d7a-f235-4fd2-92b0-81806eb55fa7 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:24.776767 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6f2d9d7a-f235-4fd2-92b0-81806eb55fa7 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:24.777797 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6f2d9d7a-f235-4fd2-92b0-81806eb55fa7 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:24.778858 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6f2d9d7a-f235-4fd2-92b0-81806eb55fa7 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:24.779410 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6f2d9d7a-f235-4fd2-92b0-81806eb55fa7 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:24.780392 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6f2d9d7a-f235-4fd2-92b0-81806eb55fa7 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:24.782520 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bf21ca03-c6c4-4998-8180-e4d6c1711abb tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:24.784471 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-bf21ca03-c6c4-4998-8180-e4d6c1711abb tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 6f087e90-1c4c-4637-9009-5f819c266271] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:24.803897 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bf21ca03-c6c4-4998-8180-e4d6c1711abb tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:24.804668 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bf21ca03-c6c4-4998-8180-e4d6c1711abb tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:24.805182 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bf21ca03-c6c4-4998-8180-e4d6c1711abb tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:24.808057 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bf21ca03-c6c4-4998-8180-e4d6c1711abb tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:24.809607 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bf21ca03-c6c4-4998-8180-e4d6c1711abb tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:24.811181 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bf21ca03-c6c4-4998-8180-e4d6c1711abb tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:25.362626 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6f2d9d7a-f235-4fd2-92b0-81806eb55fa7 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:25.372661 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6f2d9d7a-f235-4fd2-92b0-81806eb55fa7 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b" status: 200 len: 1673 microversion: 2.1 time: 0.623681 Oct 30 01:39:25.373690 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2591/5192] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:39:24 2022] GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b => generated 1673 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:39:25.432592 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-bf21ca03-c6c4-4998-8180-e4d6c1711abb tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:25.443715 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bf21ca03-c6c4-4998-8180-e4d6c1711abb tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/6f087e90-1c4c-4637-9009-5f819c266271" status: 200 len: 1513 microversion: 2.1 time: 0.672308 Oct 30 01:39:25.454364 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2602/5193] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:39:24 2022] GET /compute/v2.1/servers/6f087e90-1c4c-4637-9009-5f819c266271 => generated 1513 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:39:25.765824 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a80d237e-95f4-44ae-8952-a356cae726fc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:25.765824 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a80d237e-95f4-44ae-8952-a356cae726fc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:25.782279 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a80d237e-95f4-44ae-8952-a356cae726fc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:25.782780 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a80d237e-95f4-44ae-8952-a356cae726fc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:25.787269 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a80d237e-95f4-44ae-8952-a356cae726fc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:25.788473 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a80d237e-95f4-44ae-8952-a356cae726fc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:25.789160 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a80d237e-95f4-44ae-8952-a356cae726fc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:25.796056 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a80d237e-95f4-44ae-8952-a356cae726fc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:26.134287 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a80d237e-95f4-44ae-8952-a356cae726fc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:26.148604 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a80d237e-95f4-44ae-8952-a356cae726fc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:26.150420 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a80d237e-95f4-44ae-8952-a356cae726fc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:26.151711 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a80d237e-95f4-44ae-8952-a356cae726fc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1807 microversion: 2.20 time: 0.397401 Oct 30 01:39:26.152351 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2592/5194] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:39:25 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1807 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:39:26.403572 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-04abda61-8454-4102-b969-9e24cd70dfdc tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:26.405022 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-04abda61-8454-4102-b969-9e24cd70dfdc tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:26.424129 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-04abda61-8454-4102-b969-9e24cd70dfdc tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:26.424744 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-04abda61-8454-4102-b969-9e24cd70dfdc tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:26.425201 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-04abda61-8454-4102-b969-9e24cd70dfdc tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:26.430115 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-04abda61-8454-4102-b969-9e24cd70dfdc tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:26.430856 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-04abda61-8454-4102-b969-9e24cd70dfdc tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:26.431627 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-04abda61-8454-4102-b969-9e24cd70dfdc tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:26.467693 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-215a4d7d-1313-48d1-ab7d-473125411a04 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:26.469707 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-215a4d7d-1313-48d1-ab7d-473125411a04 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 6f087e90-1c4c-4637-9009-5f819c266271] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:26.484116 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-215a4d7d-1313-48d1-ab7d-473125411a04 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:26.486188 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-215a4d7d-1313-48d1-ab7d-473125411a04 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:26.487933 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-215a4d7d-1313-48d1-ab7d-473125411a04 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:26.489837 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-215a4d7d-1313-48d1-ab7d-473125411a04 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:26.493464 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-215a4d7d-1313-48d1-ab7d-473125411a04 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:26.494154 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-215a4d7d-1313-48d1-ab7d-473125411a04 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:27.142023 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-04abda61-8454-4102-b969-9e24cd70dfdc tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:27.144446 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:39:27.162537 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-04abda61-8454-4102-b969-9e24cd70dfdc tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b" status: 200 len: 1673 microversion: 2.1 time: 0.769017 Oct 30 01:39:27.163131 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2603/5195] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:39:26 2022] GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b => generated 1673 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:39:27.179297 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-75d00c47-7aea-4b07-a4e7-1997e478eaa6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:27.193406 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-75d00c47-7aea-4b07-a4e7-1997e478eaa6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:27.200471 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-75d00c47-7aea-4b07-a4e7-1997e478eaa6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:27.201384 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-75d00c47-7aea-4b07-a4e7-1997e478eaa6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:27.202173 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-75d00c47-7aea-4b07-a4e7-1997e478eaa6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:27.203263 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-75d00c47-7aea-4b07-a4e7-1997e478eaa6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:27.203900 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-75d00c47-7aea-4b07-a4e7-1997e478eaa6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:27.204490 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-75d00c47-7aea-4b07-a4e7-1997e478eaa6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:27.456198 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-215a4d7d-1313-48d1-ab7d-473125411a04 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:27.469550 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-215a4d7d-1313-48d1-ab7d-473125411a04 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/6f087e90-1c4c-4637-9009-5f819c266271" status: 200 len: 1513 microversion: 2.1 time: 1.005310 Oct 30 01:39:27.478548 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2593/5196] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:39:26 2022] GET /compute/v2.1/servers/6f087e90-1c4c-4637-9009-5f819c266271 => generated 1513 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:39:28.006723 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-bda95d67-9e0f-4e01-925a-13d27979d3cf req-75439d0f-b718-42f7-b3d6-9e8a73c04879 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f087e90-1c4c-4637-9009-5f819c266271", "name": "network-vif-deleted", "tag": "626735af-4ec1-409b-86c7-7bde6bd4cb44"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:39:28.037993 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-bda95d67-9e0f-4e01-925a-13d27979d3cf req-75439d0f-b718-42f7-b3d6-9e8a73c04879 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:28.038489 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-bda95d67-9e0f-4e01-925a-13d27979d3cf req-75439d0f-b718-42f7-b3d6-9e8a73c04879 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:28.038930 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-bda95d67-9e0f-4e01-925a-13d27979d3cf req-75439d0f-b718-42f7-b3d6-9e8a73c04879 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:28.087986 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-bda95d67-9e0f-4e01-925a-13d27979d3cf req-75439d0f-b718-42f7-b3d6-9e8a73c04879 service nova] Creating event network-vif-deleted:626735af-4ec1-409b-86c7-7bde6bd4cb44 for instance 6f087e90-1c4c-4637-9009-5f819c266271 on n-h2-master-1 Oct 30 01:39:28.099770 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-bda95d67-9e0f-4e01-925a-13d27979d3cf req-75439d0f-b718-42f7-b3d6-9e8a73c04879 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100716 Oct 30 01:39:28.100787 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2594/5197] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:39:28.196202 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-62a9e02c-520c-4046-86d9-c6f0b3161e14 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:28.201107 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-62a9e02c-520c-4046-86d9-c6f0b3161e14 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:28.226005 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-62a9e02c-520c-4046-86d9-c6f0b3161e14 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:28.227971 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-62a9e02c-520c-4046-86d9-c6f0b3161e14 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:28.228651 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-62a9e02c-520c-4046-86d9-c6f0b3161e14 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:28.230760 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-62a9e02c-520c-4046-86d9-c6f0b3161e14 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:28.242666 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-62a9e02c-520c-4046-86d9-c6f0b3161e14 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:28.243347 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-62a9e02c-520c-4046-86d9-c6f0b3161e14 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:28.451644 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-62a9e02c-520c-4046-86d9-c6f0b3161e14 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:28.452546 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-62a9e02c-520c-4046-86d9-c6f0b3161e14 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b" status: 200 len: 1605 microversion: 2.1 time: 0.263442 Oct 30 01:39:28.453357 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2595/5198] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:39:28 2022] GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b => generated 1605 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:39:28.495395 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4e489044-187b-4ee8-8d36-59c5272216bb tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:28.496901 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4e489044-187b-4ee8-8d36-59c5272216bb tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 6f087e90-1c4c-4637-9009-5f819c266271] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:28.509142 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4e489044-187b-4ee8-8d36-59c5272216bb tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:28.510809 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4e489044-187b-4ee8-8d36-59c5272216bb tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:28.512599 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4e489044-187b-4ee8-8d36-59c5272216bb tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:28.513597 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4e489044-187b-4ee8-8d36-59c5272216bb tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:28.516895 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4e489044-187b-4ee8-8d36-59c5272216bb tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:28.517710 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4e489044-187b-4ee8-8d36-59c5272216bb tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:28.568205 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-75d00c47-7aea-4b07-a4e7-1997e478eaa6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:28.588081 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-75d00c47-7aea-4b07-a4e7-1997e478eaa6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:28.589745 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-75d00c47-7aea-4b07-a4e7-1997e478eaa6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:28.601812 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-75d00c47-7aea-4b07-a4e7-1997e478eaa6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1807 microversion: 2.20 time: 1.426919 Oct 30 01:39:28.620602 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2604/5199] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:39:27 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1807 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:39:28.677199 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4e489044-187b-4ee8-8d36-59c5272216bb tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:28.695475 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4e489044-187b-4ee8-8d36-59c5272216bb tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/6f087e90-1c4c-4637-9009-5f819c266271" status: 200 len: 1302 microversion: 2.1 time: 0.204784 Oct 30 01:39:28.699007 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2596/5200] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:39:28 2022] GET /compute/v2.1/servers/6f087e90-1c4c-4637-9009-5f819c266271 => generated 1302 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:39:29.080518 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-c139b713-946d-4d64-8b37-ebb9ebfd5509 req-31600df4-d3b8-4595-9400-ca534de16718 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97f81ee8-7551-4e9b-9ff6-7f542c5dab1b", "name": "network-vif-deleted", "tag": "9fdf215f-6694-408c-ac71-7cabfd8535ae"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:39:29.094373 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-c139b713-946d-4d64-8b37-ebb9ebfd5509 req-31600df4-d3b8-4595-9400-ca534de16718 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:29.095145 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-c139b713-946d-4d64-8b37-ebb9ebfd5509 req-31600df4-d3b8-4595-9400-ca534de16718 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:29.095752 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-c139b713-946d-4d64-8b37-ebb9ebfd5509 req-31600df4-d3b8-4595-9400-ca534de16718 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:29.109555 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-c139b713-946d-4d64-8b37-ebb9ebfd5509 req-31600df4-d3b8-4595-9400-ca534de16718 service nova] Creating event network-vif-deleted:9fdf215f-6694-408c-ac71-7cabfd8535ae for instance 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b on n-h1-master-1 Oct 30 01:39:29.129783 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-c139b713-946d-4d64-8b37-ebb9ebfd5509 req-31600df4-d3b8-4595-9400-ca534de16718 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.504726 Oct 30 01:39:29.132166 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2605/5201] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:39:29.478978 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-04189f2b-1a8b-457d-bdb0-97b32ff1ce33 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:29.479878 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-04189f2b-1a8b-457d-bdb0-97b32ff1ce33 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:29.486971 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04189f2b-1a8b-457d-bdb0-97b32ff1ce33 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:29.487462 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04189f2b-1a8b-457d-bdb0-97b32ff1ce33 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:29.487900 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04189f2b-1a8b-457d-bdb0-97b32ff1ce33 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:29.488619 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04189f2b-1a8b-457d-bdb0-97b32ff1ce33 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:29.489073 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04189f2b-1a8b-457d-bdb0-97b32ff1ce33 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:29.489529 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04189f2b-1a8b-457d-bdb0-97b32ff1ce33 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:29.531680 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04189f2b-1a8b-457d-bdb0-97b32ff1ce33 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:29.532343 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04189f2b-1a8b-457d-bdb0-97b32ff1ce33 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:29.533531 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04189f2b-1a8b-457d-bdb0-97b32ff1ce33 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:29.534453 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-04189f2b-1a8b-457d-bdb0-97b32ff1ce33 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lazy-loading 'fault' on Instance uuid 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:39:29.641684 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-04189f2b-1a8b-457d-bdb0-97b32ff1ce33 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:29.643612 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ce37b45a-b235-4c0d-9455-fcb07e282bcb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:29.644483 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ce37b45a-b235-4c0d-9455-fcb07e282bcb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:29.655741 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ce37b45a-b235-4c0d-9455-fcb07e282bcb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:29.656220 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ce37b45a-b235-4c0d-9455-fcb07e282bcb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:29.656604 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ce37b45a-b235-4c0d-9455-fcb07e282bcb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:29.657307 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ce37b45a-b235-4c0d-9455-fcb07e282bcb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:29.657788 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ce37b45a-b235-4c0d-9455-fcb07e282bcb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:29.658209 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ce37b45a-b235-4c0d-9455-fcb07e282bcb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:29.667382 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-04189f2b-1a8b-457d-bdb0-97b32ff1ce33 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b" status: 200 len: 1327 microversion: 2.1 time: 0.190515 Oct 30 01:39:29.672415 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2597/5202] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:39:29 2022] GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b => generated 1327 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:39:29.728606 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1aabc5e6-a653-45ee-a5db-a4bafe54ad90 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:29.729283 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1aabc5e6-a653-45ee-a5db-a4bafe54ad90 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 6f087e90-1c4c-4637-9009-5f819c266271] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:29.737047 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1aabc5e6-a653-45ee-a5db-a4bafe54ad90 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:29.739122 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1aabc5e6-a653-45ee-a5db-a4bafe54ad90 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:29.739122 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1aabc5e6-a653-45ee-a5db-a4bafe54ad90 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:29.739122 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1aabc5e6-a653-45ee-a5db-a4bafe54ad90 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:29.739907 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1aabc5e6-a653-45ee-a5db-a4bafe54ad90 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:29.741152 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1aabc5e6-a653-45ee-a5db-a4bafe54ad90 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:29.790080 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1aabc5e6-a653-45ee-a5db-a4bafe54ad90 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:29.795012 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1aabc5e6-a653-45ee-a5db-a4bafe54ad90 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:29.795742 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1aabc5e6-a653-45ee-a5db-a4bafe54ad90 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:29.796572 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-1aabc5e6-a653-45ee-a5db-a4bafe54ad90 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lazy-loading 'fault' on Instance uuid 6f087e90-1c4c-4637-9009-5f819c266271 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:39:30.064291 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1aabc5e6-a653-45ee-a5db-a4bafe54ad90 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352cb9c0a2644e0e8743f3cc4477f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6716e9ebbf6c4ca1950a5a0bce33276c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:30.076769 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1aabc5e6-a653-45ee-a5db-a4bafe54ad90 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/6f087e90-1c4c-4637-9009-5f819c266271" status: 200 len: 1307 microversion: 2.1 time: 0.356413 Oct 30 01:39:30.094619 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2598/5203] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:39:29 2022] GET /compute/v2.1/servers/6f087e90-1c4c-4637-9009-5f819c266271 => generated 1307 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:39:30.109828 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ce37b45a-b235-4c0d-9455-fcb07e282bcb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:30.121589 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ce37b45a-b235-4c0d-9455-fcb07e282bcb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:30.128665 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ce37b45a-b235-4c0d-9455-fcb07e282bcb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:30.134686 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ce37b45a-b235-4c0d-9455-fcb07e282bcb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1807 microversion: 2.20 time: 0.502407 Oct 30 01:39:30.135635 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2606/5204] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:39:29 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1807 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:39:30.694541 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-38521a17-411f-4906-bb13-c662c347b99a tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:30.695293 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-38521a17-411f-4906-bb13-c662c347b99a tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:30.702105 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-38521a17-411f-4906-bb13-c662c347b99a tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:30.702617 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-38521a17-411f-4906-bb13-c662c347b99a tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:30.703082 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-38521a17-411f-4906-bb13-c662c347b99a tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:30.703981 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-38521a17-411f-4906-bb13-c662c347b99a tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:30.704438 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-38521a17-411f-4906-bb13-c662c347b99a tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:30.704860 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-38521a17-411f-4906-bb13-c662c347b99a tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:30.721436 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-38521a17-411f-4906-bb13-c662c347b99a tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] HTTP exception thrown: Instance 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b could not be found. Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-38521a17-411f-4906-bb13-c662c347b99a tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Request method failure captured: Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b HTTP/1.1 Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdTqgn2B91_ceQKPoDM1iNAokBfCrWwyIgVilJ-1FJ-YMzDy2MOop6IG0Cc87jPfCxHDogztiWm1uOfmfK_KW4JzuPL-rRntVAmuTzNTJ-P5MxBMW8tUBSZKJtBH4PVeYnsSpbZkSiYmT2c4OLcdNoR6EOdKROXOnLOufaCNiFI0MA4 Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 7c1e4ce82aba40a2a013f2d107877b72 Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-AttachVolumeTestJSON-1714625488 Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7c1e4ce82aba40a2a013f2d107877b72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7c1e4ce82aba40a2a013f2d107877b72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7c1e4ce82aba40a2a013f2d107877b72"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7c1e4ce82aba40a2a013f2d107877b72"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-AttachVolumeTestJSON-1714625488 Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 7c1e4ce82aba40a2a013f2d107877b72 Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1714625488 Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-AttachVolumeTestJSON-1714625488-project Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: aba3c4de99ec4a5aae6fb006ab89fdb9 Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-AttachVolumeTestJSON-1714625488-project Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b could not be found. Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '97f81ee8-7551-4e9b-9ff6-7f542c5dab1b'} Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b could not be found. Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b could not be found. Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:39:30.723095 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:39:30.730949 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:39:30.730949 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:39:30.730949 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:39:30.730949 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:39:30.730949 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:39:30.730949 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b could not be found. Oct 30 01:39:30.730949 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:39:30.730949 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-38521a17-411f-4906-bb13-c662c347b99a tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Returning 404 to user: Instance 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:39:30.730949 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-38521a17-411f-4906-bb13-c662c347b99a tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b" status: 404 len: 111 microversion: 2.1 time: 0.034524 Oct 30 01:39:30.730949 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2599/5205] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:39:30 2022] GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:39:30.737295 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-aebeaa97-e4e8-44e0-a2d0-712980299e0e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '.version_select at 0x7f44c6ed0550>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:30.829632 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-aebeaa97-e4e8-44e0-a2d0-712980299e0e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1015127789" status: 202 len: 0 microversion: 2.1 time: 0.096397 Oct 30 01:39:30.830852 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2607/5206] 10.222.0.13 () {58 vars in 1221 bytes} [Sun Oct 30 01:39:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1015127789 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:39:31.103208 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7ca1b100-7ad0-40f9-94ab-6cb79c58c013 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:31.103208 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7ca1b100-7ad0-40f9-94ab-6cb79c58c013 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 6f087e90-1c4c-4637-9009-5f819c266271] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:31.109783 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7ca1b100-7ad0-40f9-94ab-6cb79c58c013 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:31.110275 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7ca1b100-7ad0-40f9-94ab-6cb79c58c013 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:31.110716 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7ca1b100-7ad0-40f9-94ab-6cb79c58c013 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:31.111413 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7ca1b100-7ad0-40f9-94ab-6cb79c58c013 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:31.112056 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7ca1b100-7ad0-40f9-94ab-6cb79c58c013 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:31.112484 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7ca1b100-7ad0-40f9-94ab-6cb79c58c013 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:31.127988 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-7ca1b100-7ad0-40f9-94ab-6cb79c58c013 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] HTTP exception thrown: Instance 6f087e90-1c4c-4637-9009-5f819c266271 could not be found. Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7ca1b100-7ad0-40f9-94ab-6cb79c58c013 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Request method failure captured: Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/6f087e90-1c4c-4637-9009-5f819c266271 HTTP/1.1 Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdUc0diJMRLuZJuSWmotRcXU8qMcNm6uldpjiUsH-GNhrgtHl5DXoDoDrS2ldPpoTEARF6jccthVTzIV6NmkOWY-0gJVseql8T16rj1VmRzQ715siBrV85sMunM024wERziufNDvY14sp-IPfP8Uo1bdRYOwUzH5QwcwHPU288xKYo4 Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 6716e9ebbf6c4ca1950a5a0bce33276c Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1656648627 Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6716e9ebbf6c4ca1950a5a0bce33276c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6716e9ebbf6c4ca1950a5a0bce33276c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6716e9ebbf6c4ca1950a5a0bce33276c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6716e9ebbf6c4ca1950a5a0bce33276c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServerDiskConfigTestJSON-1656648627 Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 6716e9ebbf6c4ca1950a5a0bce33276c Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1656648627 Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServerDiskConfigTestJSON-1656648627-project Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 352cb9c0a2644e0e8743f3cc4477f88f Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServerDiskConfigTestJSON-1656648627-project Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 6f087e90-1c4c-4637-9009-5f819c266271 could not be found. Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '6f087e90-1c4c-4637-9009-5f819c266271'} Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f087e90-1c4c-4637-9009-5f819c266271 could not be found. Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f087e90-1c4c-4637-9009-5f819c266271 could not be found. Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:39:31.128960 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:39:31.134194 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:39:31.134194 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:39:31.134194 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:39:31.134194 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:39:31.134194 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:39:31.134194 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f087e90-1c4c-4637-9009-5f819c266271 could not be found. Oct 30 01:39:31.134194 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:39:31.135578 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7ca1b100-7ad0-40f9-94ab-6cb79c58c013 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Returning 404 to user: Instance 6f087e90-1c4c-4637-9009-5f819c266271 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:39:31.136650 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7ca1b100-7ad0-40f9-94ab-6cb79c58c013 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/6f087e90-1c4c-4637-9009-5f819c266271" status: 404 len: 111 microversion: 2.1 time: 0.038947 Oct 30 01:39:31.137594 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2600/5207] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:39:31 2022] GET /compute/v2.1/servers/6f087e90-1c4c-4637-9009-5f819c266271 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:39:31.147387 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-661b75a7-fcb6-4f5b-884f-fd41e8f0b137 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:31.148719 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-661b75a7-fcb6-4f5b-884f-fd41e8f0b137 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 3fb366e7-0a5c-4bf8-944b-d9140af2c65c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:31.166023 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-661b75a7-fcb6-4f5b-884f-fd41e8f0b137 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:31.167035 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5e9a577a-19c8-4b14-8e68-975af587e763 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:31.168145 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5e9a577a-19c8-4b14-8e68-975af587e763 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:31.169030 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-661b75a7-fcb6-4f5b-884f-fd41e8f0b137 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:31.169507 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-661b75a7-fcb6-4f5b-884f-fd41e8f0b137 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:31.175302 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-661b75a7-fcb6-4f5b-884f-fd41e8f0b137 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:31.175302 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-661b75a7-fcb6-4f5b-884f-fd41e8f0b137 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:31.175302 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-661b75a7-fcb6-4f5b-884f-fd41e8f0b137 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:31.183690 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5e9a577a-19c8-4b14-8e68-975af587e763 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:31.184191 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5e9a577a-19c8-4b14-8e68-975af587e763 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:31.184629 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5e9a577a-19c8-4b14-8e68-975af587e763 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:31.185363 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5e9a577a-19c8-4b14-8e68-975af587e763 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:31.185818 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5e9a577a-19c8-4b14-8e68-975af587e763 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:31.186243 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5e9a577a-19c8-4b14-8e68-975af587e763 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:31.204019 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-661b75a7-fcb6-4f5b-884f-fd41e8f0b137 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] HTTP exception thrown: Instance 3fb366e7-0a5c-4bf8-944b-d9140af2c65c could not be found. Oct 30 01:39:31.204019 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-661b75a7-fcb6-4f5b-884f-fd41e8f0b137 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Request method failure captured: Oct 30 01:39:31.204019 n-d-master-1 devstack@n-api.service[121103]: request: DELETE /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c HTTP/1.1 Oct 30 01:39:31.204019 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:39:31.204019 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:39:31.204019 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:39:31.204019 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:39:31.204019 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:39:31.204019 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:39:31.204019 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:39:31.204019 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:39:31.204019 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdUc0diJMRLuZJuSWmotRcXU8qMcNm6uldpjiUsH-GNhrgtHl5DXoDoDrS2ldPpoTEARF6jccthVTzIV6NmkOWY-0gJVseql8T16rj1VmRzQ715siBrV85sMunM024wERziufNDvY14sp-IPfP8Uo1bdRYOwUzH5QwcwHPU288xKYo4 Oct 30 01:39:31.204019 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:39:31.204019 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:39:31.204019 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:39:31.204019 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:39:31.204019 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:39:31.204019 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:39:31.204019 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 6716e9ebbf6c4ca1950a5a0bce33276c Oct 30 01:39:31.204019 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1656648627 Oct 30 01:39:31.204019 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:39:31.204019 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:39:31.204019 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6716e9ebbf6c4ca1950a5a0bce33276c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6716e9ebbf6c4ca1950a5a0bce33276c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6716e9ebbf6c4ca1950a5a0bce33276c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6716e9ebbf6c4ca1950a5a0bce33276c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:39:31.204019 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServerDiskConfigTestJSON-1656648627 Oct 30 01:39:31.204019 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 6716e9ebbf6c4ca1950a5a0bce33276c Oct 30 01:39:31.204019 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1656648627 Oct 30 01:39:31.204019 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServerDiskConfigTestJSON-1656648627-project Oct 30 01:39:31.204019 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:39:31.204019 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:39:31.204019 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 352cb9c0a2644e0e8743f3cc4477f88f Oct 30 01:39:31.204019 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServerDiskConfigTestJSON-1656648627-project Oct 30 01:39:31.204019 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:39:31.204019 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 3fb366e7-0a5c-4bf8-944b-d9140af2c65c could not be found. Oct 30 01:39:31.204019 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '3fb366e7-0a5c-4bf8-944b-d9140af2c65c'} Oct 30 01:39:31.204019 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:39:31.204019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:39:31.204019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:39:31.204019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:39:31.204019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:39:31.204019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:39:31.204019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:39:31.204019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:39:31.204019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:39:31.204019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:39:31.204019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fb366e7-0a5c-4bf8-944b-d9140af2c65c could not be found. Oct 30 01:39:31.204019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:39:31.204019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:39:31.204019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:39:31.204019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:39:31.204019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:39:31.204019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:39:31.204019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:39:31.204019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:39:31.204019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:39:31.204019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:39:31.204019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:39:31.204019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:39:31.204019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:39:31.204019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:39:31.204019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:39:31.210078 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:39:31.210078 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:39:31.210078 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:39:31.210078 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fb366e7-0a5c-4bf8-944b-d9140af2c65c could not be found. Oct 30 01:39:31.210078 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:39:31.210078 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:39:31.210078 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:39:31.210078 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:39:31.210078 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:39:31.210078 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:39:31.210078 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:39:31.210078 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:39:31.210078 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fb366e7-0a5c-4bf8-944b-d9140af2c65c could not be found. Oct 30 01:39:31.210078 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:39:31.210078 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-661b75a7-fcb6-4f5b-884f-fd41e8f0b137 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Returning 404 to user: Instance 3fb366e7-0a5c-4bf8-944b-d9140af2c65c could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:39:31.210078 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-661b75a7-fcb6-4f5b-884f-fd41e8f0b137 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c" status: 404 len: 111 microversion: 2.1 time: 0.062056 Oct 30 01:39:31.228938 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2608/5208] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:39:31 2022] DELETE /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:39:31.235028 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f725fe37-f191-4a06-9374-64963944d446 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:31.235660 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f725fe37-f191-4a06-9374-64963944d446 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 3fb366e7-0a5c-4bf8-944b-d9140af2c65c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:31.253557 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f725fe37-f191-4a06-9374-64963944d446 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:31.254041 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f725fe37-f191-4a06-9374-64963944d446 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:31.254477 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f725fe37-f191-4a06-9374-64963944d446 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:31.255200 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f725fe37-f191-4a06-9374-64963944d446 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:31.255769 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f725fe37-f191-4a06-9374-64963944d446 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:31.256418 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f725fe37-f191-4a06-9374-64963944d446 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:31.284095 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-f725fe37-f191-4a06-9374-64963944d446 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] HTTP exception thrown: Instance 3fb366e7-0a5c-4bf8-944b-d9140af2c65c could not be found. Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f725fe37-f191-4a06-9374-64963944d446 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Request method failure captured: Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c HTTP/1.1 Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdUc0diJMRLuZJuSWmotRcXU8qMcNm6uldpjiUsH-GNhrgtHl5DXoDoDrS2ldPpoTEARF6jccthVTzIV6NmkOWY-0gJVseql8T16rj1VmRzQ715siBrV85sMunM024wERziufNDvY14sp-IPfP8Uo1bdRYOwUzH5QwcwHPU288xKYo4 Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 6716e9ebbf6c4ca1950a5a0bce33276c Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1656648627 Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6716e9ebbf6c4ca1950a5a0bce33276c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6716e9ebbf6c4ca1950a5a0bce33276c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6716e9ebbf6c4ca1950a5a0bce33276c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6716e9ebbf6c4ca1950a5a0bce33276c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServerDiskConfigTestJSON-1656648627 Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 6716e9ebbf6c4ca1950a5a0bce33276c Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1656648627 Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServerDiskConfigTestJSON-1656648627-project Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 352cb9c0a2644e0e8743f3cc4477f88f Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServerDiskConfigTestJSON-1656648627-project Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 3fb366e7-0a5c-4bf8-944b-d9140af2c65c could not be found. Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '3fb366e7-0a5c-4bf8-944b-d9140af2c65c'} Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fb366e7-0a5c-4bf8-944b-d9140af2c65c could not be found. Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fb366e7-0a5c-4bf8-944b-d9140af2c65c could not be found. Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:39:31.285814 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:39:31.294470 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:39:31.294470 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:39:31.294470 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:39:31.294470 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:39:31.294470 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:39:31.294470 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fb366e7-0a5c-4bf8-944b-d9140af2c65c could not be found. Oct 30 01:39:31.294470 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:39:31.294470 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f725fe37-f191-4a06-9374-64963944d446 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Returning 404 to user: Instance 3fb366e7-0a5c-4bf8-944b-d9140af2c65c could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:39:31.294470 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f725fe37-f191-4a06-9374-64963944d446 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c" status: 404 len: 111 microversion: 2.1 time: 0.057257 Oct 30 01:39:31.294470 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2609/5209] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:39:31 2022] GET /compute/v2.1/servers/3fb366e7-0a5c-4bf8-944b-d9140af2c65c => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:39:31.303987 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4b59cc01-b8ce-429d-80cd-f9af26607063 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:31.303987 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4b59cc01-b8ce-429d-80cd-f9af26607063 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:31.320638 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4b59cc01-b8ce-429d-80cd-f9af26607063 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:31.323181 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4b59cc01-b8ce-429d-80cd-f9af26607063 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:31.323810 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4b59cc01-b8ce-429d-80cd-f9af26607063 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:31.324910 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4b59cc01-b8ce-429d-80cd-f9af26607063 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:31.325648 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4b59cc01-b8ce-429d-80cd-f9af26607063 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:31.326828 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4b59cc01-b8ce-429d-80cd-f9af26607063 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:31.349559 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-4b59cc01-b8ce-429d-80cd-f9af26607063 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] HTTP exception thrown: Instance 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 could not be found. Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4b59cc01-b8ce-429d-80cd-f9af26607063 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Request method failure captured: Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: request: DELETE /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 HTTP/1.1 Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdUc0diJMRLuZJuSWmotRcXU8qMcNm6uldpjiUsH-GNhrgtHl5DXoDoDrS2ldPpoTEARF6jccthVTzIV6NmkOWY-0gJVseql8T16rj1VmRzQ715siBrV85sMunM024wERziufNDvY14sp-IPfP8Uo1bdRYOwUzH5QwcwHPU288xKYo4 Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 6716e9ebbf6c4ca1950a5a0bce33276c Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1656648627 Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6716e9ebbf6c4ca1950a5a0bce33276c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6716e9ebbf6c4ca1950a5a0bce33276c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6716e9ebbf6c4ca1950a5a0bce33276c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6716e9ebbf6c4ca1950a5a0bce33276c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServerDiskConfigTestJSON-1656648627 Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 6716e9ebbf6c4ca1950a5a0bce33276c Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1656648627 Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServerDiskConfigTestJSON-1656648627-project Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 352cb9c0a2644e0e8743f3cc4477f88f Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServerDiskConfigTestJSON-1656648627-project Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 could not be found. Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '528b7413-5d73-4b6f-82a9-c1c9ac4d61e4'} Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 could not be found. Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:39:31.352026 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:39:31.356650 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 could not be found. Oct 30 01:39:31.356650 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:39:31.356650 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:39:31.356650 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:39:31.356650 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:39:31.356650 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:39:31.356650 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:39:31.356650 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:39:31.356650 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:39:31.356650 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 could not be found. Oct 30 01:39:31.356650 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:39:31.360925 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4b59cc01-b8ce-429d-80cd-f9af26607063 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Returning 404 to user: Instance 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:39:31.361381 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4b59cc01-b8ce-429d-80cd-f9af26607063 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "DELETE /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4" status: 404 len: 111 microversion: 2.1 time: 0.065279 Oct 30 01:39:31.379770 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2610/5210] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:39:31 2022] DELETE /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:39:31.394489 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0e04cc8e-55a1-4c43-abed-b921565a8339 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:31.404210 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0e04cc8e-55a1-4c43-abed-b921565a8339 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] [instance: 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:31.416179 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0e04cc8e-55a1-4c43-abed-b921565a8339 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:31.416774 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0e04cc8e-55a1-4c43-abed-b921565a8339 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:31.417290 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0e04cc8e-55a1-4c43-abed-b921565a8339 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:31.418096 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0e04cc8e-55a1-4c43-abed-b921565a8339 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:31.418636 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0e04cc8e-55a1-4c43-abed-b921565a8339 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:31.419134 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0e04cc8e-55a1-4c43-abed-b921565a8339 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:31.441064 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-0e04cc8e-55a1-4c43-abed-b921565a8339 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] HTTP exception thrown: Instance 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 could not be found. Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0e04cc8e-55a1-4c43-abed-b921565a8339 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Request method failure captured: Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 HTTP/1.1 Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdUc0diJMRLuZJuSWmotRcXU8qMcNm6uldpjiUsH-GNhrgtHl5DXoDoDrS2ldPpoTEARF6jccthVTzIV6NmkOWY-0gJVseql8T16rj1VmRzQ715siBrV85sMunM024wERziufNDvY14sp-IPfP8Uo1bdRYOwUzH5QwcwHPU288xKYo4 Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 6716e9ebbf6c4ca1950a5a0bce33276c Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1656648627 Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6716e9ebbf6c4ca1950a5a0bce33276c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6716e9ebbf6c4ca1950a5a0bce33276c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6716e9ebbf6c4ca1950a5a0bce33276c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6716e9ebbf6c4ca1950a5a0bce33276c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServerDiskConfigTestJSON-1656648627 Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 6716e9ebbf6c4ca1950a5a0bce33276c Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1656648627 Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServerDiskConfigTestJSON-1656648627-project Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 352cb9c0a2644e0e8743f3cc4477f88f Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServerDiskConfigTestJSON-1656648627-project Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 could not be found. Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '528b7413-5d73-4b6f-82a9-c1c9ac4d61e4'} Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 could not be found. Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 could not be found. Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:39:31.446409 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:39:31.451690 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:39:31.451690 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:39:31.451690 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:39:31.451690 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:39:31.451690 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:39:31.451690 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 could not be found. Oct 30 01:39:31.451690 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:39:31.451690 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0e04cc8e-55a1-4c43-abed-b921565a8339 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] Returning 404 to user: Instance 528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:39:31.451690 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0e04cc8e-55a1-4c43-abed-b921565a8339 tempest-ServerDiskConfigTestJSON-1656648627 tempest-ServerDiskConfigTestJSON-1656648627-project] 10.222.0.13 "GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4" status: 404 len: 111 microversion: 2.1 time: 0.061257 Oct 30 01:39:31.451690 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2611/5211] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:39:31 2022] GET /compute/v2.1/servers/528b7413-5d73-4b6f-82a9-c1c9ac4d61e4 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:39:31.580088 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5e9a577a-19c8-4b14-8e68-975af587e763 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:31.597200 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5e9a577a-19c8-4b14-8e68-975af587e763 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:31.599656 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5e9a577a-19c8-4b14-8e68-975af587e763 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:31.602085 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5e9a577a-19c8-4b14-8e68-975af587e763 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1807 microversion: 2.20 time: 0.444036 Oct 30 01:39:31.627306 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2601/5212] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:39:31 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1807 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:39:32.545025 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-31e6428c-8a3c-4ad4-8b75-4f20b2717ed7 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Action: 'create', calling method: .version_select at 0x7f44d0328550>, body: {"keypair": {"name": "tempest-keypair-1775835975", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLDfxHEDwdKhT6J5qmn8CCFkN8IzXqUG1SWTpmkocqAb5VH9WwrO+YKqphCaUDUZfYot2WoYaa0ey4kspxxnr5hc7PNnHvffP7a9EmzGDP9xAreYOEYd5L/ApLlVkgLPQ=="}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:39:32.570000 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-31e6428c-8a3c-4ad4-8b75-4f20b2717ed7 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Getting quotas for project 7c1e4ce82aba40a2a013f2d107877b72. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:39:32.576564 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-31e6428c-8a3c-4ad4-8b75-4f20b2717ed7 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Getting quotas for user aba3c4de99ec4a5aae6fb006ab89fdb9 and project 7c1e4ce82aba40a2a013f2d107877b72. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:39:32.636229 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-242547a6-1f07-488e-b1aa-85a3cad9b0cd tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:32.637674 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-242547a6-1f07-488e-b1aa-85a3cad9b0cd tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:32.648404 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-242547a6-1f07-488e-b1aa-85a3cad9b0cd tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:32.649252 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-242547a6-1f07-488e-b1aa-85a3cad9b0cd tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:32.649830 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-242547a6-1f07-488e-b1aa-85a3cad9b0cd tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:32.651977 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-242547a6-1f07-488e-b1aa-85a3cad9b0cd tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:32.652699 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-242547a6-1f07-488e-b1aa-85a3cad9b0cd tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:32.653132 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-242547a6-1f07-488e-b1aa-85a3cad9b0cd tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:32.694881 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-31e6428c-8a3c-4ad4-8b75-4f20b2717ed7 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.161531 Oct 30 01:39:32.702676 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2612/5213] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 30 01:39:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:39:33.133591 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-242547a6-1f07-488e-b1aa-85a3cad9b0cd tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:33.151150 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-242547a6-1f07-488e-b1aa-85a3cad9b0cd tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:33.159282 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-242547a6-1f07-488e-b1aa-85a3cad9b0cd tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:33.161493 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-242547a6-1f07-488e-b1aa-85a3cad9b0cd tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1807 microversion: 2.20 time: 0.529682 Oct 30 01:39:33.162692 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2602/5214] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:39:32 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1807 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:39:34.190717 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-381136a4-8201-42f0-b35f-005861aa3458 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:34.190717 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-381136a4-8201-42f0-b35f-005861aa3458 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:34.195142 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-381136a4-8201-42f0-b35f-005861aa3458 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:34.196195 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-381136a4-8201-42f0-b35f-005861aa3458 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:34.196801 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-381136a4-8201-42f0-b35f-005861aa3458 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:34.199549 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-381136a4-8201-42f0-b35f-005861aa3458 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:34.200196 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-381136a4-8201-42f0-b35f-005861aa3458 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:34.200794 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-381136a4-8201-42f0-b35f-005861aa3458 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:35.236789 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-381136a4-8201-42f0-b35f-005861aa3458 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:35.249532 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-381136a4-8201-42f0-b35f-005861aa3458 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:35.251095 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-381136a4-8201-42f0-b35f-005861aa3458 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:35.259164 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-381136a4-8201-42f0-b35f-005861aa3458 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1807 microversion: 2.20 time: 1.076237 Oct 30 01:39:35.274009 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2613/5215] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:39:34 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1807 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:39:36.288983 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fc194262-c8ac-4efa-a8c7-0d05c928c81a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:36.289645 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fc194262-c8ac-4efa-a8c7-0d05c928c81a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:36.307052 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fc194262-c8ac-4efa-a8c7-0d05c928c81a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:36.307592 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fc194262-c8ac-4efa-a8c7-0d05c928c81a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:36.307996 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fc194262-c8ac-4efa-a8c7-0d05c928c81a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:36.312402 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fc194262-c8ac-4efa-a8c7-0d05c928c81a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:36.312402 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fc194262-c8ac-4efa-a8c7-0d05c928c81a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:36.312402 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fc194262-c8ac-4efa-a8c7-0d05c928c81a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:36.813191 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-fc194262-c8ac-4efa-a8c7-0d05c928c81a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:36.823566 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-fc194262-c8ac-4efa-a8c7-0d05c928c81a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:36.825172 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-fc194262-c8ac-4efa-a8c7-0d05c928c81a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:36.826709 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fc194262-c8ac-4efa-a8c7-0d05c928c81a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1807 microversion: 2.20 time: 0.542165 Oct 30 01:39:36.827405 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2603/5216] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:39:36 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1807 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:39:37.901514 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9ed15d4d-0e86-4658-b605-43a8fe9ca569 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:37.903956 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9ed15d4d-0e86-4658-b605-43a8fe9ca569 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:37.919231 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9ed15d4d-0e86-4658-b605-43a8fe9ca569 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:37.919898 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9ed15d4d-0e86-4658-b605-43a8fe9ca569 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:37.920426 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9ed15d4d-0e86-4658-b605-43a8fe9ca569 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:37.922082 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9ed15d4d-0e86-4658-b605-43a8fe9ca569 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:37.922724 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9ed15d4d-0e86-4658-b605-43a8fe9ca569 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:37.923235 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9ed15d4d-0e86-4658-b605-43a8fe9ca569 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:38.111819 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8fc84bb1-b237-4a42-9918-06fdd3e498bd tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1570246765", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eb5ed0de-6fb8-4008-ab8c-7a6d8633669b"}], "security_groups": [{"name": "tempest-securitygroup--2025382059"}], "key_name": "tempest-keypair-1775835975", "user_data": "}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:39:38.359715 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9ed15d4d-0e86-4658-b605-43a8fe9ca569 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:38.371343 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9ed15d4d-0e86-4658-b605-43a8fe9ca569 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:38.373158 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9ed15d4d-0e86-4658-b605-43a8fe9ca569 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:38.375020 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9ed15d4d-0e86-4658-b605-43a8fe9ca569 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1807 microversion: 2.20 time: 0.523518 Oct 30 01:39:38.376062 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2614/5217] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:39:37 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1807 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:39:38.402164 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-8fc84bb1-b237-4a42-9918-06fdd3e498bd tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] validate_networks() for [('eb5ed0de-6fb8-4008-ab8c-7a6d8633669b', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:39:38.703974 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b6db08b4-d739-4798-913a-28d137ec213d tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:38.704978 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b6db08b4-d739-4798-913a-28d137ec213d tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:38.714918 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b6db08b4-d739-4798-913a-28d137ec213d tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:38.715485 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b6db08b4-d739-4798-913a-28d137ec213d tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:38.715984 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b6db08b4-d739-4798-913a-28d137ec213d tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:38.728031 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b6db08b4-d739-4798-913a-28d137ec213d tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:38.729683 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b6db08b4-d739-4798-913a-28d137ec213d tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:38.732497 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b6db08b4-d739-4798-913a-28d137ec213d tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:39.821886 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b6db08b4-d739-4798-913a-28d137ec213d tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:39.831836 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b6db08b4-d739-4798-913a-28d137ec213d tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:39.833649 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b6db08b4-d739-4798-913a-28d137ec213d tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:39.835399 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b6db08b4-d739-4798-913a-28d137ec213d tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 2958 microversion: 2.42 time: 1.137774 Oct 30 01:39:39.835972 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2615/5218] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:39:38 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 2958 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:39:39.841006 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-37448d1c-c2b6-4daf-948d-21068c3eb80d req-224e6def-49b8-49cc-84cf-f6ee4eaff48e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5389398-bf67-44ff-a1fb-a26e4a079fcb", "name": "network-vif-plugged", "status": "completed", "tag": "5fdf7d37-8815-4dca-ba2d-d6297f9d29eb"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:39:39.865926 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-37448d1c-c2b6-4daf-948d-21068c3eb80d req-224e6def-49b8-49cc-84cf-f6ee4eaff48e service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:39.866423 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-37448d1c-c2b6-4daf-948d-21068c3eb80d req-224e6def-49b8-49cc-84cf-f6ee4eaff48e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:39.866859 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-37448d1c-c2b6-4daf-948d-21068c3eb80d req-224e6def-49b8-49cc-84cf-f6ee4eaff48e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:39.888495 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-37448d1c-c2b6-4daf-948d-21068c3eb80d req-224e6def-49b8-49cc-84cf-f6ee4eaff48e service nova] Creating event network-vif-plugged:5fdf7d37-8815-4dca-ba2d-d6297f9d29eb for instance a5389398-bf67-44ff-a1fb-a26e4a079fcb on n-h2-master-1 Oct 30 01:39:39.895743 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-37448d1c-c2b6-4daf-948d-21068c3eb80d req-224e6def-49b8-49cc-84cf-f6ee4eaff48e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058015 Oct 30 01:39:39.897823 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2616/5219] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:39:39.914970 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4390a27b-1e26-43cd-967a-32977cacb4c0 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:39.914970 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4390a27b-1e26-43cd-967a-32977cacb4c0 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:39.922633 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4390a27b-1e26-43cd-967a-32977cacb4c0 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:39.923140 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4390a27b-1e26-43cd-967a-32977cacb4c0 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:39.923671 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4390a27b-1e26-43cd-967a-32977cacb4c0 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:39.924528 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4390a27b-1e26-43cd-967a-32977cacb4c0 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:39.925105 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4390a27b-1e26-43cd-967a-32977cacb4c0 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:39.925797 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4390a27b-1e26-43cd-967a-32977cacb4c0 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:40.321360 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-8fc84bb1-b237-4a42-9918-06fdd3e498bd tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:39:40.321875 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-8fc84bb1-b237-4a42-9918-06fdd3e498bd tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:39:40.322398 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-8fc84bb1-b237-4a42-9918-06fdd3e498bd tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:39:40.322880 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-8fc84bb1-b237-4a42-9918-06fdd3e498bd tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:39:40.323435 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-8fc84bb1-b237-4a42-9918-06fdd3e498bd tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:39:40.345202 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8fc84bb1-b237-4a42-9918-06fdd3e498bd tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:40.346011 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8fc84bb1-b237-4a42-9918-06fdd3e498bd tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:40.346660 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8fc84bb1-b237-4a42-9918-06fdd3e498bd tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:40.347547 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8fc84bb1-b237-4a42-9918-06fdd3e498bd tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:40.348281 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8fc84bb1-b237-4a42-9918-06fdd3e498bd tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:40.349053 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8fc84bb1-b237-4a42-9918-06fdd3e498bd tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:40.375182 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-8fc84bb1-b237-4a42-9918-06fdd3e498bd tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Getting quotas for project 7c1e4ce82aba40a2a013f2d107877b72. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:39:40.382313 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-8fc84bb1-b237-4a42-9918-06fdd3e498bd tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Getting quotas for user aba3c4de99ec4a5aae6fb006ab89fdb9 and project 7c1e4ce82aba40a2a013f2d107877b72. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:39:40.403054 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8fc84bb1-b237-4a42-9918-06fdd3e498bd tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:39:40.431609 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8fc84bb1-b237-4a42-9918-06fdd3e498bd tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 2435fb0b-ab56-4368-9965-245b3574d012] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:39:40.439648 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4390a27b-1e26-43cd-967a-32977cacb4c0 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:40.470596 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4390a27b-1e26-43cd-967a-32977cacb4c0 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:40.483161 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4390a27b-1e26-43cd-967a-32977cacb4c0 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:40.486232 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4390a27b-1e26-43cd-967a-32977cacb4c0 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1807 microversion: 2.20 time: 0.585009 Oct 30 01:39:40.489029 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2617/5220] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:39:39 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1807 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:39:40.496345 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6d79858a-075a-4e26-a9d5-bbc6579c7586 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:40.496853 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6d79858a-075a-4e26-a9d5-bbc6579c7586 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:40.504160 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6d79858a-075a-4e26-a9d5-bbc6579c7586 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:40.506445 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6d79858a-075a-4e26-a9d5-bbc6579c7586 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:40.506445 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6d79858a-075a-4e26-a9d5-bbc6579c7586 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:40.506445 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6d79858a-075a-4e26-a9d5-bbc6579c7586 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:40.507356 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6d79858a-075a-4e26-a9d5-bbc6579c7586 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:40.508439 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6d79858a-075a-4e26-a9d5-bbc6579c7586 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:40.646448 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6d79858a-075a-4e26-a9d5-bbc6579c7586 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9/os-interface" status: 200 len: 1833 microversion: 2.42 time: 0.154998 Oct 30 01:39:40.657400 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2618/5221] 10.222.0.13 () {60 vars in 1316 bytes} [Sun Oct 30 01:39:40 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9/os-interface => generated 1833 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:39:40.714951 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8fc84bb1-b237-4a42-9918-06fdd3e498bd tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.607530 Oct 30 01:39:40.724707 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2604/5222] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:39:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 2617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 30 01:39:40.728643 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-34b91ab7-2684-47a9-aa62-8da519ad5884 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:40.729274 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-34b91ab7-2684-47a9-aa62-8da519ad5884 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 2435fb0b-ab56-4368-9965-245b3574d012] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:40.841440 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-34b91ab7-2684-47a9-aa62-8da519ad5884 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:40.863334 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-34b91ab7-2684-47a9-aa62-8da519ad5884 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012" status: 200 len: 1238 microversion: 2.1 time: 0.131635 Oct 30 01:39:40.863334 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2619/5223] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:39:40 2022] GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012 => generated 1238 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:39:41.519646 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3362866a-31b8-4233-8851-14d5705b1ccc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:41.520849 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3362866a-31b8-4233-8851-14d5705b1ccc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:41.541107 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3362866a-31b8-4233-8851-14d5705b1ccc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:41.544856 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3362866a-31b8-4233-8851-14d5705b1ccc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:41.557750 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3362866a-31b8-4233-8851-14d5705b1ccc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:41.558891 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3362866a-31b8-4233-8851-14d5705b1ccc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:41.559601 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3362866a-31b8-4233-8851-14d5705b1ccc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:41.560950 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3362866a-31b8-4233-8851-14d5705b1ccc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:41.884845 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-da78cfc4-6dac-4e1c-9865-f1894a32f5d8 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:41.887930 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-da78cfc4-6dac-4e1c-9865-f1894a32f5d8 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 2435fb0b-ab56-4368-9965-245b3574d012] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:42.066336 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-da78cfc4-6dac-4e1c-9865-f1894a32f5d8 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:42.080432 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3362866a-31b8-4233-8851-14d5705b1ccc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:42.089885 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-da78cfc4-6dac-4e1c-9865-f1894a32f5d8 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012" status: 200 len: 1238 microversion: 2.1 time: 0.209316 Oct 30 01:39:42.090334 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2620/5224] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:39:41 2022] GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012 => generated 1238 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:39:42.120564 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3362866a-31b8-4233-8851-14d5705b1ccc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:42.133684 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3362866a-31b8-4233-8851-14d5705b1ccc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:42.140435 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3362866a-31b8-4233-8851-14d5705b1ccc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1807 microversion: 2.20 time: 0.626283 Oct 30 01:39:42.145211 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2605/5225] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:39:41 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1807 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:39:43.116808 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2618dbcb-b4bb-4375-bc27-bcf120826f3e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:43.118176 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2618dbcb-b4bb-4375-bc27-bcf120826f3e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 2435fb0b-ab56-4368-9965-245b3574d012] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:43.131577 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2618dbcb-b4bb-4375-bc27-bcf120826f3e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:43.133618 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2618dbcb-b4bb-4375-bc27-bcf120826f3e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:43.133618 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2618dbcb-b4bb-4375-bc27-bcf120826f3e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:43.133618 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2618dbcb-b4bb-4375-bc27-bcf120826f3e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:43.135849 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2618dbcb-b4bb-4375-bc27-bcf120826f3e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:43.136307 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2618dbcb-b4bb-4375-bc27-bcf120826f3e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:43.175371 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1ee4f64b-cf54-4abd-909a-a828b57d515f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:43.178623 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1ee4f64b-cf54-4abd-909a-a828b57d515f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:43.216791 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ee4f64b-cf54-4abd-909a-a828b57d515f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:43.217395 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ee4f64b-cf54-4abd-909a-a828b57d515f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:43.217849 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ee4f64b-cf54-4abd-909a-a828b57d515f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:43.218783 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ee4f64b-cf54-4abd-909a-a828b57d515f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:43.219035 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ee4f64b-cf54-4abd-909a-a828b57d515f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:43.219457 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ee4f64b-cf54-4abd-909a-a828b57d515f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:43.557577 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2618dbcb-b4bb-4375-bc27-bcf120826f3e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:43.589390 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2618dbcb-b4bb-4375-bc27-bcf120826f3e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012" status: 200 len: 1242 microversion: 2.1 time: 0.471340 Oct 30 01:39:43.589390 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2621/5226] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:39:43 2022] GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012 => generated 1242 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:39:43.722643 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1ee4f64b-cf54-4abd-909a-a828b57d515f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:43.731752 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1ee4f64b-cf54-4abd-909a-a828b57d515f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:43.733531 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1ee4f64b-cf54-4abd-909a-a828b57d515f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:43.735117 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1ee4f64b-cf54-4abd-909a-a828b57d515f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1807 microversion: 2.20 time: 0.568342 Oct 30 01:39:43.751095 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2606/5227] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:39:43 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1807 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:39:44.614662 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f15febc1-f45b-4c19-bf01-5d5477be9dc0 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:44.616338 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f15febc1-f45b-4c19-bf01-5d5477be9dc0 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 2435fb0b-ab56-4368-9965-245b3574d012] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:44.617364 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-581eb39d-3dd6-4c33-9933-6b7445cf6375 tempest-MultipleCreateNegativeTestJSON-475451938 tempest-MultipleCreateNegativeTestJSON-475451938-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1160094174", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:39:44.620886 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-581eb39d-3dd6-4c33-9933-6b7445cf6375 tempest-MultipleCreateNegativeTestJSON-475451938 tempest-MultipleCreateNegativeTestJSON-475451938-project] HTTP exception thrown: min_count must be <= max_count Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-581eb39d-3dd6-4c33-9933-6b7445cf6375 tempest-MultipleCreateNegativeTestJSON-475451938 tempest-MultipleCreateNegativeTestJSON-475451938-project] Request method failure captured: Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 184 Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdXglkSEVjKNNJIj_OQ1oE6S81-LinLf7_855ti2spzC-gKvtXxTUBmI3HCM0s9aq66gYckBiXjVJ3VQwGquHklZgKoyAPLbVQpvmtVGGrsDtten7T3nTrTVUlObHeCqZCl8ZuwJGsC4Syf4YYWg__4Yv-7OxjGh0aMWr1kZmfMIt9c Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 0c233051e24144c8a0cf280503c9793a Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-475451938 Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0c233051e24144c8a0cf280503c9793a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0c233051e24144c8a0cf280503c9793a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0c233051e24144c8a0cf280503c9793a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0c233051e24144c8a0cf280503c9793a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-475451938 Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 0c233051e24144c8a0cf280503c9793a Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-475451938 Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-MultipleCreateNegativeTestJSON-475451938-project Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: ee0d664772db46a2ac07dddc4cf39d24 Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-475451938-project Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1160094174", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: exception: min_count must be <= max_count Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1160094174', 'imageRef': 'deb14158-45d8-4539-889d-ff9726d046d7', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 30 01:39:44.622532 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:39:44.629684 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-581eb39d-3dd6-4c33-9933-6b7445cf6375 tempest-MultipleCreateNegativeTestJSON-475451938 tempest-MultipleCreateNegativeTestJSON-475451938-project] Returning 400 to user: min_count must be <= max_count {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:39:44.629684 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-581eb39d-3dd6-4c33-9933-6b7445cf6375 tempest-MultipleCreateNegativeTestJSON-475451938 tempest-MultipleCreateNegativeTestJSON-475451938-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.193253 Oct 30 01:39:44.629684 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2622/5228] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:39:44 2022] POST /compute/v2.1/servers => generated 74 bytes in 194 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 30 01:39:44.633841 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f15febc1-f45b-4c19-bf01-5d5477be9dc0 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:44.635065 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f15febc1-f45b-4c19-bf01-5d5477be9dc0 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:44.635693 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f15febc1-f45b-4c19-bf01-5d5477be9dc0 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:44.637185 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f15febc1-f45b-4c19-bf01-5d5477be9dc0 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:44.637930 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f15febc1-f45b-4c19-bf01-5d5477be9dc0 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:44.638581 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f15febc1-f45b-4c19-bf01-5d5477be9dc0 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:44.677210 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b079a70c-7e91-4005-8e00-ae1193477b93 tempest-MultipleCreateNegativeTestJSON-475451938 tempest-MultipleCreateNegativeTestJSON-475451938-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2049357459", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "max_count": 0}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b079a70c-7e91-4005-8e00-ae1193477b93 tempest-MultipleCreateNegativeTestJSON-475451938 tempest-MultipleCreateNegativeTestJSON-475451938-project] Request method failure captured: Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 168 Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdXglkSEVjKNNJIj_OQ1oE6S81-LinLf7_855ti2spzC-gKvtXxTUBmI3HCM0s9aq66gYckBiXjVJ3VQwGquHklZgKoyAPLbVQpvmtVGGrsDtten7T3nTrTVUlObHeCqZCl8ZuwJGsC4Syf4YYWg__4Yv-7OxjGh0aMWr1kZmfMIt9c Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 0c233051e24144c8a0cf280503c9793a Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-475451938 Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0c233051e24144c8a0cf280503c9793a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0c233051e24144c8a0cf280503c9793a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0c233051e24144c8a0cf280503c9793a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0c233051e24144c8a0cf280503c9793a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-475451938 Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 0c233051e24144c8a0cf280503c9793a Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-475451938 Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-MultipleCreateNegativeTestJSON-475451938-project Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: ee0d664772db46a2ac07dddc4cf39d24 Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-475451938-project Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2049357459", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "max_count": 0}} Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2049357459', 'imageRef': 'deb14158-45d8-4539-889d-ff9726d046d7', 'flavorRef': '452', 'max_count': 0}}} Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise error Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi 0 Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 30 01:39:44.681987 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 30 01:39:44.698806 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 30 01:39:44.698806 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 30 01:39:44.698806 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 30 01:39:44.698806 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 30 01:39:44.698806 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 30 01:39:44.698806 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:39:44.698806 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:39:44.698806 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:39:44.698806 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:39:44.698806 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:39:44.698806 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:39:44.698806 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 30 01:39:44.698806 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 30 01:39:44.698806 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 30 01:39:44.698806 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:39:44.698806 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b079a70c-7e91-4005-8e00-ae1193477b93 tempest-MultipleCreateNegativeTestJSON-475451938 tempest-MultipleCreateNegativeTestJSON-475451938-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:39:44.698806 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b079a70c-7e91-4005-8e00-ae1193477b93 tempest-MultipleCreateNegativeTestJSON-475451938 tempest-MultipleCreateNegativeTestJSON-475451938-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.011503 Oct 30 01:39:44.698806 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2623/5229] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:39:44 2022] POST /compute/v2.1/servers => generated 130 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 30 01:39:44.737976 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f15febc1-f45b-4c19-bf01-5d5477be9dc0 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:44.746938 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f15febc1-f45b-4c19-bf01-5d5477be9dc0 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012" status: 200 len: 1290 microversion: 2.1 time: 0.136368 Oct 30 01:39:44.747518 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2607/5230] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:39:44 2022] GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012 => generated 1290 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:39:44.749042 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-04955b47-4a2d-417f-a253-151c64ef9cde tempest-MultipleCreateNegativeTestJSON-475451938 tempest-MultipleCreateNegativeTestJSON-475451938-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-250726612", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "max_count": 2.5}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-04955b47-4a2d-417f-a253-151c64ef9cde tempest-MultipleCreateNegativeTestJSON-475451938 tempest-MultipleCreateNegativeTestJSON-475451938-project] Request method failure captured: Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 169 Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdXglkSEVjKNNJIj_OQ1oE6S81-LinLf7_855ti2spzC-gKvtXxTUBmI3HCM0s9aq66gYckBiXjVJ3VQwGquHklZgKoyAPLbVQpvmtVGGrsDtten7T3nTrTVUlObHeCqZCl8ZuwJGsC4Syf4YYWg__4Yv-7OxjGh0aMWr1kZmfMIt9c Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 0c233051e24144c8a0cf280503c9793a Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-475451938 Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0c233051e24144c8a0cf280503c9793a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0c233051e24144c8a0cf280503c9793a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0c233051e24144c8a0cf280503c9793a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0c233051e24144c8a0cf280503c9793a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-475451938 Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 0c233051e24144c8a0cf280503c9793a Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-475451938 Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-MultipleCreateNegativeTestJSON-475451938-project Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: ee0d664772db46a2ac07dddc4cf39d24 Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-475451938-project Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-250726612", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "max_count": 2.5}} Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-250726612', 'imageRef': 'deb14158-45d8-4539-889d-ff9726d046d7', 'flavorRef': '452', 'max_count': 2.5}}} Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise error Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi 2.5 Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 30 01:39:44.753045 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 30 01:39:44.788215 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 30 01:39:44.788215 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 30 01:39:44.788215 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 30 01:39:44.788215 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 30 01:39:44.788215 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 30 01:39:44.788215 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:39:44.788215 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:39:44.788215 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:39:44.788215 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:39:44.788215 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:39:44.788215 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:39:44.788215 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 30 01:39:44.788215 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 30 01:39:44.788215 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 30 01:39:44.788215 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:39:44.788215 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-04955b47-4a2d-417f-a253-151c64ef9cde tempest-MultipleCreateNegativeTestJSON-475451938 tempest-MultipleCreateNegativeTestJSON-475451938-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:39:44.788215 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-04955b47-4a2d-417f-a253-151c64ef9cde tempest-MultipleCreateNegativeTestJSON-475451938 tempest-MultipleCreateNegativeTestJSON-475451938-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.009521 Oct 30 01:39:44.788215 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2624/5231] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:39:44 2022] POST /compute/v2.1/servers => generated 139 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 30 01:39:44.789982 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4e27d16a-e258-46b7-a46b-923a433eedae tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:44.789982 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4e27d16a-e258-46b7-a46b-923a433eedae tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:44.789982 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4e27d16a-e258-46b7-a46b-923a433eedae tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:44.789982 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4e27d16a-e258-46b7-a46b-923a433eedae tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:44.789982 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4e27d16a-e258-46b7-a46b-923a433eedae tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:44.789982 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4e27d16a-e258-46b7-a46b-923a433eedae tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:44.789982 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4e27d16a-e258-46b7-a46b-923a433eedae tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:44.789982 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4e27d16a-e258-46b7-a46b-923a433eedae tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:44.841257 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0dea04fa-d1dd-4eec-baf0-e4f8ba481473 tempest-MultipleCreateNegativeTestJSON-475451938 tempest-MultipleCreateNegativeTestJSON-475451938-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2082387445", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "min_count": 0}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0dea04fa-d1dd-4eec-baf0-e4f8ba481473 tempest-MultipleCreateNegativeTestJSON-475451938 tempest-MultipleCreateNegativeTestJSON-475451938-project] Request method failure captured: Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 168 Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdXglkSEVjKNNJIj_OQ1oE6S81-LinLf7_855ti2spzC-gKvtXxTUBmI3HCM0s9aq66gYckBiXjVJ3VQwGquHklZgKoyAPLbVQpvmtVGGrsDtten7T3nTrTVUlObHeCqZCl8ZuwJGsC4Syf4YYWg__4Yv-7OxjGh0aMWr1kZmfMIt9c Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 0c233051e24144c8a0cf280503c9793a Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-475451938 Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0c233051e24144c8a0cf280503c9793a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0c233051e24144c8a0cf280503c9793a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0c233051e24144c8a0cf280503c9793a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0c233051e24144c8a0cf280503c9793a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-475451938 Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 0c233051e24144c8a0cf280503c9793a Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-475451938 Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-MultipleCreateNegativeTestJSON-475451938-project Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: ee0d664772db46a2ac07dddc4cf39d24 Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-475451938-project Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2082387445", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "min_count": 0}} Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2082387445', 'imageRef': 'deb14158-45d8-4539-889d-ff9726d046d7', 'flavorRef': '452', 'min_count': 0}}} Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise error Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi 0 Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 30 01:39:44.850652 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 30 01:39:44.855881 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 30 01:39:44.855881 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 30 01:39:44.855881 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 30 01:39:44.855881 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 30 01:39:44.855881 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 30 01:39:44.855881 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:39:44.855881 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:39:44.855881 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:39:44.855881 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:39:44.855881 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:39:44.855881 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:39:44.855881 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 30 01:39:44.855881 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 30 01:39:44.855881 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 30 01:39:44.855881 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:39:44.855881 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0dea04fa-d1dd-4eec-baf0-e4f8ba481473 tempest-MultipleCreateNegativeTestJSON-475451938 tempest-MultipleCreateNegativeTestJSON-475451938-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:39:44.857214 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0dea04fa-d1dd-4eec-baf0-e4f8ba481473 tempest-MultipleCreateNegativeTestJSON-475451938 tempest-MultipleCreateNegativeTestJSON-475451938-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.019606 Oct 30 01:39:44.862066 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2625/5232] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:39:44 2022] POST /compute/v2.1/servers => generated 130 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:39:44.931606 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b764ea02-3fc2-4bcb-9b8d-b28738ccc769 tempest-MultipleCreateNegativeTestJSON-475451938 tempest-MultipleCreateNegativeTestJSON-475451938-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1778824583", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "min_count": 2.5}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b764ea02-3fc2-4bcb-9b8d-b28738ccc769 tempest-MultipleCreateNegativeTestJSON-475451938 tempest-MultipleCreateNegativeTestJSON-475451938-project] Request method failure captured: Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 170 Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdXglkSEVjKNNJIj_OQ1oE6S81-LinLf7_855ti2spzC-gKvtXxTUBmI3HCM0s9aq66gYckBiXjVJ3VQwGquHklZgKoyAPLbVQpvmtVGGrsDtten7T3nTrTVUlObHeCqZCl8ZuwJGsC4Syf4YYWg__4Yv-7OxjGh0aMWr1kZmfMIt9c Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 0c233051e24144c8a0cf280503c9793a Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-475451938 Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0c233051e24144c8a0cf280503c9793a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0c233051e24144c8a0cf280503c9793a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0c233051e24144c8a0cf280503c9793a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0c233051e24144c8a0cf280503c9793a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-475451938 Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 0c233051e24144c8a0cf280503c9793a Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-475451938 Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-MultipleCreateNegativeTestJSON-475451938-project Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: ee0d664772db46a2ac07dddc4cf39d24 Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-475451938-project Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1778824583", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "min_count": 2.5}} Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1778824583', 'imageRef': 'deb14158-45d8-4539-889d-ff9726d046d7', 'flavorRef': '452', 'min_count': 2.5}}} Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise error Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi 2.5 Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 30 01:39:44.936119 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 30 01:39:44.956981 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 30 01:39:44.956981 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 30 01:39:44.956981 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 30 01:39:44.956981 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 30 01:39:44.956981 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 30 01:39:44.956981 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:39:44.956981 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:39:44.956981 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:39:44.956981 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:39:44.956981 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:39:44.956981 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:39:44.956981 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 30 01:39:44.956981 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 30 01:39:44.956981 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 30 01:39:44.956981 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:39:44.956981 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b764ea02-3fc2-4bcb-9b8d-b28738ccc769 tempest-MultipleCreateNegativeTestJSON-475451938 tempest-MultipleCreateNegativeTestJSON-475451938-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:39:44.956981 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b764ea02-3fc2-4bcb-9b8d-b28738ccc769 tempest-MultipleCreateNegativeTestJSON-475451938 tempest-MultipleCreateNegativeTestJSON-475451938-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.011175 Oct 30 01:39:44.956981 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2626/5233] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:39:44 2022] POST /compute/v2.1/servers => generated 139 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 30 01:39:45.070451 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4e27d16a-e258-46b7-a46b-923a433eedae tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:45.074775 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:39:45.093905 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4e27d16a-e258-46b7-a46b-923a433eedae tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:45.101482 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4e27d16a-e258-46b7-a46b-923a433eedae tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:45.105119 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4e27d16a-e258-46b7-a46b-923a433eedae tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1794 microversion: 2.20 time: 0.345731 Oct 30 01:39:45.107231 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2608/5234] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:39:44 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1794 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:39:45.797778 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-34c17ae1-cd63-4302-b09a-19d5ed4e82b1 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:45.799952 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-34c17ae1-cd63-4302-b09a-19d5ed4e82b1 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 2435fb0b-ab56-4368-9965-245b3574d012] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:45.816348 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-34c17ae1-cd63-4302-b09a-19d5ed4e82b1 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:45.817076 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-34c17ae1-cd63-4302-b09a-19d5ed4e82b1 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:45.817711 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-34c17ae1-cd63-4302-b09a-19d5ed4e82b1 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:45.818635 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-34c17ae1-cd63-4302-b09a-19d5ed4e82b1 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:45.819476 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-34c17ae1-cd63-4302-b09a-19d5ed4e82b1 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:45.820067 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-34c17ae1-cd63-4302-b09a-19d5ed4e82b1 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:46.008917 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-34c17ae1-cd63-4302-b09a-19d5ed4e82b1 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:46.019535 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-34c17ae1-cd63-4302-b09a-19d5ed4e82b1 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012" status: 200 len: 1296 microversion: 2.1 time: 0.227555 Oct 30 01:39:46.020770 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2627/5235] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:39:45 2022] GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012 => generated 1296 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:39:47.048339 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4f39d0c0-048a-4822-a57d-b659da7f07aa tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:47.049117 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4f39d0c0-048a-4822-a57d-b659da7f07aa tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 2435fb0b-ab56-4368-9965-245b3574d012] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:47.057168 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:39:47.058976 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4f39d0c0-048a-4822-a57d-b659da7f07aa tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:47.059692 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4f39d0c0-048a-4822-a57d-b659da7f07aa tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:47.060411 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4f39d0c0-048a-4822-a57d-b659da7f07aa tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:47.061712 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4f39d0c0-048a-4822-a57d-b659da7f07aa tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:47.062439 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4f39d0c0-048a-4822-a57d-b659da7f07aa tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:47.063130 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4f39d0c0-048a-4822-a57d-b659da7f07aa tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:47.300126 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4f39d0c0-048a-4822-a57d-b659da7f07aa tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:47.316860 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4f39d0c0-048a-4822-a57d-b659da7f07aa tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012" status: 200 len: 1364 microversion: 2.1 time: 0.270729 Oct 30 01:39:47.323199 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2609/5236] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:39:47 2022] GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012 => generated 1364 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:39:48.349810 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6a8150e6-e0bd-4cfa-9873-29b86f39b6d2 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:48.351325 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6a8150e6-e0bd-4cfa-9873-29b86f39b6d2 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 2435fb0b-ab56-4368-9965-245b3574d012] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:48.368595 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a8150e6-e0bd-4cfa-9873-29b86f39b6d2 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:48.368595 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a8150e6-e0bd-4cfa-9873-29b86f39b6d2 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:48.368595 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a8150e6-e0bd-4cfa-9873-29b86f39b6d2 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:48.368595 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a8150e6-e0bd-4cfa-9873-29b86f39b6d2 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:48.369835 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a8150e6-e0bd-4cfa-9873-29b86f39b6d2 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:48.371433 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a8150e6-e0bd-4cfa-9873-29b86f39b6d2 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:48.732173 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6a8150e6-e0bd-4cfa-9873-29b86f39b6d2 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:48.746305 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6a8150e6-e0bd-4cfa-9873-29b86f39b6d2 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012" status: 200 len: 1364 microversion: 2.1 time: 0.401854 Oct 30 01:39:48.746913 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2628/5237] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:39:48 2022] GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012 => generated 1364 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:39:49.420708 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-6f78df0c-0856-4825-91c6-eda63d43e7a8 req-1ed5a8ce-49bb-46d4-9f14-c56a7ad01222 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2435fb0b-ab56-4368-9965-245b3574d012", "tag": "dbfeee30-a305-485d-8855-a6b6d181a616"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:39:49.438446 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-6f78df0c-0856-4825-91c6-eda63d43e7a8 req-1ed5a8ce-49bb-46d4-9f14-c56a7ad01222 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:49.438618 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-6f78df0c-0856-4825-91c6-eda63d43e7a8 req-1ed5a8ce-49bb-46d4-9f14-c56a7ad01222 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:49.439294 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-6f78df0c-0856-4825-91c6-eda63d43e7a8 req-1ed5a8ce-49bb-46d4-9f14-c56a7ad01222 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:49.454818 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-6f78df0c-0856-4825-91c6-eda63d43e7a8 req-1ed5a8ce-49bb-46d4-9f14-c56a7ad01222 service nova] Creating event network-changed:dbfeee30-a305-485d-8855-a6b6d181a616 for instance 2435fb0b-ab56-4368-9965-245b3574d012 on n-h1-master-1 Oct 30 01:39:49.462575 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-6f78df0c-0856-4825-91c6-eda63d43e7a8 req-1ed5a8ce-49bb-46d4-9f14-c56a7ad01222 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050978 Oct 30 01:39:49.463773 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2610/5238] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:39:49.770755 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-94bd1b64-09cb-42cf-b834-3056c2536f2a tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:49.772042 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-94bd1b64-09cb-42cf-b834-3056c2536f2a tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 2435fb0b-ab56-4368-9965-245b3574d012] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:49.781578 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:39:49.783136 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94bd1b64-09cb-42cf-b834-3056c2536f2a tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:49.784928 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94bd1b64-09cb-42cf-b834-3056c2536f2a tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:49.789305 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94bd1b64-09cb-42cf-b834-3056c2536f2a tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:49.791585 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94bd1b64-09cb-42cf-b834-3056c2536f2a tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:49.792709 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94bd1b64-09cb-42cf-b834-3056c2536f2a tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:49.793554 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94bd1b64-09cb-42cf-b834-3056c2536f2a tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:50.170730 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-94bd1b64-09cb-42cf-b834-3056c2536f2a tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:50.188247 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-94bd1b64-09cb-42cf-b834-3056c2536f2a tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012" status: 200 len: 1364 microversion: 2.1 time: 0.421631 Oct 30 01:39:50.189524 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2629/5239] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:39:49 2022] GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012 => generated 1364 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:39:51.210448 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:39:51.210950 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=6 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:39:51.216248 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2be08534-7c70-42fa-a9b9-ebd0c0a6e13c tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:51.217032 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2be08534-7c70-42fa-a9b9-ebd0c0a6e13c tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 2435fb0b-ab56-4368-9965-245b3574d012] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:51.241083 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2be08534-7c70-42fa-a9b9-ebd0c0a6e13c tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:51.251615 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2be08534-7c70-42fa-a9b9-ebd0c0a6e13c tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:51.252111 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2be08534-7c70-42fa-a9b9-ebd0c0a6e13c tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:51.252825 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2be08534-7c70-42fa-a9b9-ebd0c0a6e13c tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:51.253289 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2be08534-7c70-42fa-a9b9-ebd0c0a6e13c tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:51.253757 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2be08534-7c70-42fa-a9b9-ebd0c0a6e13c tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:51.805761 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2be08534-7c70-42fa-a9b9-ebd0c0a6e13c tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:51.817578 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2be08534-7c70-42fa-a9b9-ebd0c0a6e13c tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012" status: 200 len: 1364 microversion: 2.1 time: 0.609084 Oct 30 01:39:51.835602 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2611/5240] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:39:51 2022] GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012 => generated 1364 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:39:52.845259 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-13435af2-bd54-4886-9917-87e56da5036e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:52.846122 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-13435af2-bd54-4886-9917-87e56da5036e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 2435fb0b-ab56-4368-9965-245b3574d012] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:52.848866 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=8 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:39:52.861631 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-13435af2-bd54-4886-9917-87e56da5036e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:52.862464 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-13435af2-bd54-4886-9917-87e56da5036e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:52.862808 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-13435af2-bd54-4886-9917-87e56da5036e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:52.863543 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-13435af2-bd54-4886-9917-87e56da5036e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:52.864085 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-13435af2-bd54-4886-9917-87e56da5036e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:52.864427 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-13435af2-bd54-4886-9917-87e56da5036e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:53.128894 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-13435af2-bd54-4886-9917-87e56da5036e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:53.152281 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-13435af2-bd54-4886-9917-87e56da5036e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012" status: 200 len: 1364 microversion: 2.1 time: 0.311148 Oct 30 01:39:53.173729 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2630/5241] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:39:52 2022] GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012 => generated 1364 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:39:54.181296 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a676ea3d-85b3-46dd-9979-019f8e35efc2 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:54.182643 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a676ea3d-85b3-46dd-9979-019f8e35efc2 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 2435fb0b-ab56-4368-9965-245b3574d012] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:54.193033 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a676ea3d-85b3-46dd-9979-019f8e35efc2 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:54.199168 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a676ea3d-85b3-46dd-9979-019f8e35efc2 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:54.201311 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a676ea3d-85b3-46dd-9979-019f8e35efc2 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:54.205200 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a676ea3d-85b3-46dd-9979-019f8e35efc2 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:54.205200 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a676ea3d-85b3-46dd-9979-019f8e35efc2 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:54.205973 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a676ea3d-85b3-46dd-9979-019f8e35efc2 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:54.410317 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a676ea3d-85b3-46dd-9979-019f8e35efc2 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:54.434766 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a676ea3d-85b3-46dd-9979-019f8e35efc2 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012" status: 200 len: 1364 microversion: 2.1 time: 0.257760 Oct 30 01:39:54.435668 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2612/5242] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:39:54 2022] GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012 => generated 1364 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:39:55.459407 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f03b6c14-f4b3-47a2-9827-8e8949757a24 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:55.460576 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f03b6c14-f4b3-47a2-9827-8e8949757a24 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 2435fb0b-ab56-4368-9965-245b3574d012] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:55.479677 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f03b6c14-f4b3-47a2-9827-8e8949757a24 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:55.480518 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f03b6c14-f4b3-47a2-9827-8e8949757a24 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:55.485189 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f03b6c14-f4b3-47a2-9827-8e8949757a24 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:55.486381 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f03b6c14-f4b3-47a2-9827-8e8949757a24 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:55.487024 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f03b6c14-f4b3-47a2-9827-8e8949757a24 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:55.487621 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f03b6c14-f4b3-47a2-9827-8e8949757a24 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:56.200982 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f03b6c14-f4b3-47a2-9827-8e8949757a24 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:56.200982 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f03b6c14-f4b3-47a2-9827-8e8949757a24 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012" status: 200 len: 1364 microversion: 2.1 time: 0.510223 Oct 30 01:39:56.200982 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2631/5243] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:39:55 2022] GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012 => generated 1364 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:39:56.994206 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c25d0762-cf25-4608-b10a-fda0cd2492bb tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:56.995576 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c25d0762-cf25-4608-b10a-fda0cd2492bb tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 2435fb0b-ab56-4368-9965-245b3574d012] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:57.011673 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c25d0762-cf25-4608-b10a-fda0cd2492bb tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:57.013771 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c25d0762-cf25-4608-b10a-fda0cd2492bb tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:57.013771 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c25d0762-cf25-4608-b10a-fda0cd2492bb tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:57.013771 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c25d0762-cf25-4608-b10a-fda0cd2492bb tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:57.017449 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c25d0762-cf25-4608-b10a-fda0cd2492bb tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:57.039624 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c25d0762-cf25-4608-b10a-fda0cd2492bb tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:57.704370 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c25d0762-cf25-4608-b10a-fda0cd2492bb tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:57.718586 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c25d0762-cf25-4608-b10a-fda0cd2492bb tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012" status: 200 len: 1364 microversion: 2.1 time: 0.731606 Oct 30 01:39:57.721846 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2613/5244] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:39:56 2022] GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012 => generated 1364 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:39:57.903103 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-b798fd14-79c7-4c3b-91bb-5b025bba6fc3 req-2fca690e-4029-40de-a4d7-62d923149a76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2435fb0b-ab56-4368-9965-245b3574d012", "name": "network-vif-plugged", "status": "completed", "tag": "dbfeee30-a305-485d-8855-a6b6d181a616"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:39:57.927725 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-b798fd14-79c7-4c3b-91bb-5b025bba6fc3 req-2fca690e-4029-40de-a4d7-62d923149a76 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:57.928269 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-b798fd14-79c7-4c3b-91bb-5b025bba6fc3 req-2fca690e-4029-40de-a4d7-62d923149a76 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:57.928784 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-b798fd14-79c7-4c3b-91bb-5b025bba6fc3 req-2fca690e-4029-40de-a4d7-62d923149a76 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:57.957310 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=90 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:39:57.960816 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-b798fd14-79c7-4c3b-91bb-5b025bba6fc3 req-2fca690e-4029-40de-a4d7-62d923149a76 service nova] Creating event network-vif-plugged:dbfeee30-a305-485d-8855-a6b6d181a616 for instance 2435fb0b-ab56-4368-9965-245b3574d012 on n-h1-master-1 Oct 30 01:39:58.015591 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-b798fd14-79c7-4c3b-91bb-5b025bba6fc3 req-2fca690e-4029-40de-a4d7-62d923149a76 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.373881 Oct 30 01:39:58.016838 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2632/5245] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:39:58.749778 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9dd2991c-eb11-4bed-9fc8-102fefd94f04 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:39:58.757248 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9dd2991c-eb11-4bed-9fc8-102fefd94f04 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 2435fb0b-ab56-4368-9965-245b3574d012] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:39:58.784717 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9dd2991c-eb11-4bed-9fc8-102fefd94f04 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:58.792018 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9dd2991c-eb11-4bed-9fc8-102fefd94f04 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:58.792018 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9dd2991c-eb11-4bed-9fc8-102fefd94f04 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:58.792018 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9dd2991c-eb11-4bed-9fc8-102fefd94f04 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:39:58.794878 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9dd2991c-eb11-4bed-9fc8-102fefd94f04 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:39:58.795995 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9dd2991c-eb11-4bed-9fc8-102fefd94f04 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:39:59.241770 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9dd2991c-eb11-4bed-9fc8-102fefd94f04 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:39:59.252627 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9dd2991c-eb11-4bed-9fc8-102fefd94f04 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012" status: 200 len: 1364 microversion: 2.1 time: 0.508309 Oct 30 01:39:59.258116 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2614/5246] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:39:58 2022] GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012 => generated 1364 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:39:59.871473 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-95b9477b-1869-42d9-8763-1d7e33ab9f38 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Action: 'create', calling method: .version_select at 0x7f44c6f29940>, body: {"keypair": {"name": "tempest-keypair-1804497044", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNvgWEd82fOQWtr9MfisP/eRTN6BS5A0GhIXnBy4lPWSSSJqzLsBmA3/qrsCDQ7wMJEM0mrz+VJQzvpz7vh3zbkog3Ailk0niQJzk1iQMmsap9M0qR9oYjz986Rf0wWLpA=="}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:39:59.901202 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-95b9477b-1869-42d9-8763-1d7e33ab9f38 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Getting quotas for project 9f9d0d541cc3496ebf8dc71af4254506. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:39:59.906439 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-95b9477b-1869-42d9-8763-1d7e33ab9f38 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Getting quotas for user 157c0ef579434726810bb3775388b944 and project 9f9d0d541cc3496ebf8dc71af4254506. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:40:00.006154 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-95b9477b-1869-42d9-8763-1d7e33ab9f38 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.370228 Oct 30 01:40:00.007064 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2633/5247] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 30 01:39:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:40:00.283250 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-04ad03ef-d243-4644-b69e-af38b768cc8e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:40:00.283603 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-04ad03ef-d243-4644-b69e-af38b768cc8e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 2435fb0b-ab56-4368-9965-245b3574d012] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:40:00.297677 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04ad03ef-d243-4644-b69e-af38b768cc8e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:00.300203 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04ad03ef-d243-4644-b69e-af38b768cc8e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:00.300794 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04ad03ef-d243-4644-b69e-af38b768cc8e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:00.303960 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04ad03ef-d243-4644-b69e-af38b768cc8e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:00.304585 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04ad03ef-d243-4644-b69e-af38b768cc8e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:00.305131 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04ad03ef-d243-4644-b69e-af38b768cc8e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:00.563413 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-04ad03ef-d243-4644-b69e-af38b768cc8e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:00.576744 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-04ad03ef-d243-4644-b69e-af38b768cc8e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012" status: 200 len: 1550 microversion: 2.1 time: 0.293679 Oct 30 01:40:00.576744 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2615/5248] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:40:00 2022] GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012 => generated 1550 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:40:00.605669 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d25c55bd-4ab3-45f8-9e70-057b5dd49e75 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:40:00.606366 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d25c55bd-4ab3-45f8-9e70-057b5dd49e75 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 2435fb0b-ab56-4368-9965-245b3574d012] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:40:00.615165 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d25c55bd-4ab3-45f8-9e70-057b5dd49e75 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:00.615962 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d25c55bd-4ab3-45f8-9e70-057b5dd49e75 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:00.616252 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d25c55bd-4ab3-45f8-9e70-057b5dd49e75 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:00.617045 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d25c55bd-4ab3-45f8-9e70-057b5dd49e75 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:00.617939 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d25c55bd-4ab3-45f8-9e70-057b5dd49e75 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:00.618568 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d25c55bd-4ab3-45f8-9e70-057b5dd49e75 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:00.764555 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d25c55bd-4ab3-45f8-9e70-057b5dd49e75 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.166175 Oct 30 01:40:00.772883 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2634/5249] 10.222.0.13 () {58 vars in 1275 bytes} [Sun Oct 30 01:40:00 2022] GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012/os-interface => generated 285 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:40:04.619796 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-debac5fb-d757-4a34-b2cc-95f5ac4d5342 req-f6b37a53-8266-49be-a17c-b0cada72c221 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2435fb0b-ab56-4368-9965-245b3574d012", "tag": "dbfeee30-a305-485d-8855-a6b6d181a616"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:40:04.707162 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-debac5fb-d757-4a34-b2cc-95f5ac4d5342 req-f6b37a53-8266-49be-a17c-b0cada72c221 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:04.707668 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-debac5fb-d757-4a34-b2cc-95f5ac4d5342 req-f6b37a53-8266-49be-a17c-b0cada72c221 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:04.708148 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-debac5fb-d757-4a34-b2cc-95f5ac4d5342 req-f6b37a53-8266-49be-a17c-b0cada72c221 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:04.761753 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-debac5fb-d757-4a34-b2cc-95f5ac4d5342 req-f6b37a53-8266-49be-a17c-b0cada72c221 service nova] Creating event network-changed:dbfeee30-a305-485d-8855-a6b6d181a616 for instance 2435fb0b-ab56-4368-9965-245b3574d012 on n-h1-master-1 Oct 30 01:40:04.767447 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-debac5fb-d757-4a34-b2cc-95f5ac4d5342 req-f6b37a53-8266-49be-a17c-b0cada72c221 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.801553 Oct 30 01:40:04.773480 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2616/5250] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:40:05.819973 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-407b95db-ddaf-4b93-ba95-474f2e003216 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-308582556", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c8b5246f-f8f5-404d-864d-b312dbb308c5"}], "security_groups": [{"name": "tempest-securitygroup--2135488257"}], "key_name": "tempest-keypair-1804497044", "user_data": "}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:40:06.079672 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-407b95db-ddaf-4b93-ba95-474f2e003216 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] validate_networks() for [('c8b5246f-f8f5-404d-864d-b312dbb308c5', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:40:07.579482 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-407b95db-ddaf-4b93-ba95-474f2e003216 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:40:07.580100 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-407b95db-ddaf-4b93-ba95-474f2e003216 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:40:07.580354 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-407b95db-ddaf-4b93-ba95-474f2e003216 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:40:07.580761 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-407b95db-ddaf-4b93-ba95-474f2e003216 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:40:07.581169 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-407b95db-ddaf-4b93-ba95-474f2e003216 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:40:07.594506 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-407b95db-ddaf-4b93-ba95-474f2e003216 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:07.595214 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-407b95db-ddaf-4b93-ba95-474f2e003216 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:07.595789 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-407b95db-ddaf-4b93-ba95-474f2e003216 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:07.596654 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-407b95db-ddaf-4b93-ba95-474f2e003216 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:07.597259 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-407b95db-ddaf-4b93-ba95-474f2e003216 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:07.597853 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-407b95db-ddaf-4b93-ba95-474f2e003216 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:07.626592 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-407b95db-ddaf-4b93-ba95-474f2e003216 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Getting quotas for project 9f9d0d541cc3496ebf8dc71af4254506. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:40:07.633008 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-407b95db-ddaf-4b93-ba95-474f2e003216 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Getting quotas for user 157c0ef579434726810bb3775388b944 and project 9f9d0d541cc3496ebf8dc71af4254506. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:40:07.647972 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-407b95db-ddaf-4b93-ba95-474f2e003216 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:40:07.650975 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-407b95db-ddaf-4b93-ba95-474f2e003216 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:40:07.790566 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-407b95db-ddaf-4b93-ba95-474f2e003216 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.976667 Oct 30 01:40:07.791903 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2635/5251] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:40:05 2022] POST /compute/v2.1/servers => generated 409 bytes in 1981 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:40:07.804492 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-38051053-9c62-4e1d-befb-fbd149ff6e12 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:40:07.805463 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-38051053-9c62-4e1d-befb-fbd149ff6e12 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:40:07.945757 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-38051053-9c62-4e1d-befb-fbd149ff6e12 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:07.952955 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-38051053-9c62-4e1d-befb-fbd149ff6e12 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1238 microversion: 2.1 time: 0.153763 Oct 30 01:40:07.968760 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2617/5252] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:40:07 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1238 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:40:08.977516 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-81052e4d-1bb8-413b-a36b-65befd3fc7bd tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:40:08.978031 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-81052e4d-1bb8-413b-a36b-65befd3fc7bd tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:40:09.080073 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-81052e4d-1bb8-413b-a36b-65befd3fc7bd tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:09.092182 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-81052e4d-1bb8-413b-a36b-65befd3fc7bd tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1238 microversion: 2.1 time: 0.119172 Oct 30 01:40:09.092799 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2636/5253] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:40:08 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1238 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:40:10.119600 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ff67d101-e2f3-4c22-81e4-4f92faa4c60e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:40:10.120324 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ff67d101-e2f3-4c22-81e4-4f92faa4c60e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:40:10.162077 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ff67d101-e2f3-4c22-81e4-4f92faa4c60e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:10.179053 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ff67d101-e2f3-4c22-81e4-4f92faa4c60e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:10.179607 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ff67d101-e2f3-4c22-81e4-4f92faa4c60e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:10.180535 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ff67d101-e2f3-4c22-81e4-4f92faa4c60e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:10.181019 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ff67d101-e2f3-4c22-81e4-4f92faa4c60e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:10.181478 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ff67d101-e2f3-4c22-81e4-4f92faa4c60e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:10.372432 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ff67d101-e2f3-4c22-81e4-4f92faa4c60e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:10.385708 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ff67d101-e2f3-4c22-81e4-4f92faa4c60e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1234 microversion: 2.1 time: 0.271306 Oct 30 01:40:10.386727 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2618/5254] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:40:10 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1234 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:40:11.413448 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2c92e34b-a95c-4d50-a8b6-28c40cd83096 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:40:11.413448 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2c92e34b-a95c-4d50-a8b6-28c40cd83096 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:40:11.461416 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2c92e34b-a95c-4d50-a8b6-28c40cd83096 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:11.462149 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2c92e34b-a95c-4d50-a8b6-28c40cd83096 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:11.463062 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2c92e34b-a95c-4d50-a8b6-28c40cd83096 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:11.463923 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2c92e34b-a95c-4d50-a8b6-28c40cd83096 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:11.464505 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2c92e34b-a95c-4d50-a8b6-28c40cd83096 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:11.465096 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2c92e34b-a95c-4d50-a8b6-28c40cd83096 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:11.611428 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2c92e34b-a95c-4d50-a8b6-28c40cd83096 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:11.630879 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2c92e34b-a95c-4d50-a8b6-28c40cd83096 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1298 microversion: 2.1 time: 0.217344 Oct 30 01:40:11.630879 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2637/5255] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:40:11 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1298 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:40:12.677846 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cedc2d55-616d-426a-81be-ffa85e727997 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:40:12.679672 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cedc2d55-616d-426a-81be-ffa85e727997 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:40:12.699454 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cedc2d55-616d-426a-81be-ffa85e727997 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:12.700171 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cedc2d55-616d-426a-81be-ffa85e727997 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:12.703788 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cedc2d55-616d-426a-81be-ffa85e727997 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:12.704714 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cedc2d55-616d-426a-81be-ffa85e727997 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:12.705525 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cedc2d55-616d-426a-81be-ffa85e727997 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:12.706107 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cedc2d55-616d-426a-81be-ffa85e727997 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:13.113672 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-cedc2d55-616d-426a-81be-ffa85e727997 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:13.122724 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cedc2d55-616d-426a-81be-ffa85e727997 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1364 microversion: 2.1 time: 0.466955 Oct 30 01:40:13.126479 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2619/5256] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:40:12 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1364 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:40:14.152892 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f9631a33-f808-4a06-8eeb-8fa27f3bb12d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:40:14.153662 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f9631a33-f808-4a06-8eeb-8fa27f3bb12d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:40:14.160692 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f9631a33-f808-4a06-8eeb-8fa27f3bb12d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:14.161833 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f9631a33-f808-4a06-8eeb-8fa27f3bb12d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:14.162276 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f9631a33-f808-4a06-8eeb-8fa27f3bb12d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:14.162986 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f9631a33-f808-4a06-8eeb-8fa27f3bb12d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:14.163442 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f9631a33-f808-4a06-8eeb-8fa27f3bb12d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:14.165768 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f9631a33-f808-4a06-8eeb-8fa27f3bb12d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:14.232898 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-5af373b5-7b3c-4c25-b856-6ced286c84aa req-d3b7af66-14c8-417c-993c-e091bcfd6576 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0f03664-8785-4321-b32e-3622f1b747b9", "tag": "63c1537a-0706-49b0-8e88-a5c62f4ffbe3"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:40:14.263848 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-5af373b5-7b3c-4c25-b856-6ced286c84aa req-d3b7af66-14c8-417c-993c-e091bcfd6576 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:14.264570 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-5af373b5-7b3c-4c25-b856-6ced286c84aa req-d3b7af66-14c8-417c-993c-e091bcfd6576 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:14.265138 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-5af373b5-7b3c-4c25-b856-6ced286c84aa req-d3b7af66-14c8-417c-993c-e091bcfd6576 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:14.289565 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-5af373b5-7b3c-4c25-b856-6ced286c84aa req-d3b7af66-14c8-417c-993c-e091bcfd6576 service nova] Creating event network-changed:63c1537a-0706-49b0-8e88-a5c62f4ffbe3 for instance b0f03664-8785-4321-b32e-3622f1b747b9 on n-h2-master-1 Oct 30 01:40:14.295022 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-5af373b5-7b3c-4c25-b856-6ced286c84aa req-d3b7af66-14c8-417c-993c-e091bcfd6576 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065893 Oct 30 01:40:14.296557 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2620/5257] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:40:14.381034 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f9631a33-f808-4a06-8eeb-8fa27f3bb12d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:14.392711 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f9631a33-f808-4a06-8eeb-8fa27f3bb12d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1364 microversion: 2.1 time: 0.244122 Oct 30 01:40:14.394086 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2638/5258] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:40:14 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1364 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:40:15.042043 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-49944a1d-fc9b-4b60-b2a3-9777250a8d30 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:40:15.042749 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-49944a1d-fc9b-4b60-b2a3-9777250a8d30 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:40:15.050989 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-49944a1d-fc9b-4b60-b2a3-9777250a8d30 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:15.051603 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-49944a1d-fc9b-4b60-b2a3-9777250a8d30 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:15.052342 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-49944a1d-fc9b-4b60-b2a3-9777250a8d30 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:15.053315 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-49944a1d-fc9b-4b60-b2a3-9777250a8d30 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:15.053983 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-49944a1d-fc9b-4b60-b2a3-9777250a8d30 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:15.054535 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-49944a1d-fc9b-4b60-b2a3-9777250a8d30 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:15.093025 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-49944a1d-fc9b-4b60-b2a3-9777250a8d30 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb/os-volume_attachments/147e493e-2efd-410d-b6a1-6e6550ffc1e0" status: 200 len: 194 microversion: 2.20 time: 0.056791 Oct 30 01:40:15.096039 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2621/5259] 10.222.0.13 () {60 vars in 1454 bytes} [Sun Oct 30 01:40:15 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb/os-volume_attachments/147e493e-2efd-410d-b6a1-6e6550ffc1e0 => generated 194 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:40:15.181119 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bbf18d72-4f24-4d3c-a50e-15630ebc937e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:40:15.181820 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-bbf18d72-4f24-4d3c-a50e-15630ebc937e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:40:15.189614 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bbf18d72-4f24-4d3c-a50e-15630ebc937e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:15.191626 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bbf18d72-4f24-4d3c-a50e-15630ebc937e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:15.192884 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bbf18d72-4f24-4d3c-a50e-15630ebc937e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:15.193804 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bbf18d72-4f24-4d3c-a50e-15630ebc937e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:15.196277 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bbf18d72-4f24-4d3c-a50e-15630ebc937e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:15.196873 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bbf18d72-4f24-4d3c-a50e-15630ebc937e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:15.349152 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-bbf18d72-4f24-4d3c-a50e-15630ebc937e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lazy-loading 'services' on Instance uuid a5389398-bf67-44ff-a1fb-a26e4a079fcb {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:40:15.419731 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d3240922-3c8b-4450-84f8-b59edec508af tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:40:15.420371 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d3240922-3c8b-4450-84f8-b59edec508af tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:40:15.434895 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3240922-3c8b-4450-84f8-b59edec508af tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:15.435413 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3240922-3c8b-4450-84f8-b59edec508af tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:15.436166 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3240922-3c8b-4450-84f8-b59edec508af tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:15.436900 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3240922-3c8b-4450-84f8-b59edec508af tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:15.437400 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3240922-3c8b-4450-84f8-b59edec508af tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:15.438804 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3240922-3c8b-4450-84f8-b59edec508af tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:15.818189 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bbf18d72-4f24-4d3c-a50e-15630ebc937e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb/os-volume_attachments/147e493e-2efd-410d-b6a1-6e6550ffc1e0" status: 202 len: 0 microversion: 2.20 time: 0.643705 Oct 30 01:40:15.819842 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2639/5260] 10.222.0.13 () {60 vars in 1457 bytes} [Sun Oct 30 01:40:15 2022] DELETE /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb/os-volume_attachments/147e493e-2efd-410d-b6a1-6e6550ffc1e0 => generated 0 bytes in 647 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:40:15.829162 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d6728f47-c576-4776-bf5c-7644ae6b11cf tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:40:15.832406 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d6728f47-c576-4776-bf5c-7644ae6b11cf tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:40:15.840077 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d6728f47-c576-4776-bf5c-7644ae6b11cf tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:15.840574 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d6728f47-c576-4776-bf5c-7644ae6b11cf tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:15.841010 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d6728f47-c576-4776-bf5c-7644ae6b11cf tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:15.841769 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d6728f47-c576-4776-bf5c-7644ae6b11cf tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:15.842288 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d6728f47-c576-4776-bf5c-7644ae6b11cf tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:15.842655 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d6728f47-c576-4776-bf5c-7644ae6b11cf tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:15.930478 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d6728f47-c576-4776-bf5c-7644ae6b11cf tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.103390 Oct 30 01:40:15.937877 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2640/5261] 10.222.0.13 () {60 vars in 1343 bytes} [Sun Oct 30 01:40:15 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 30 01:40:16.058493 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d3240922-3c8b-4450-84f8-b59edec508af tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:16.066493 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d3240922-3c8b-4450-84f8-b59edec508af tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1364 microversion: 2.1 time: 0.654312 Oct 30 01:40:16.070547 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2622/5262] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:40:15 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1364 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:40:16.947361 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bb8c3c11-ca39-494c-a89f-6099fa388459 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:40:16.954006 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-bb8c3c11-ca39-494c-a89f-6099fa388459 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:40:16.978828 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb8c3c11-ca39-494c-a89f-6099fa388459 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:16.982220 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb8c3c11-ca39-494c-a89f-6099fa388459 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:16.983355 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb8c3c11-ca39-494c-a89f-6099fa388459 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:16.984552 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb8c3c11-ca39-494c-a89f-6099fa388459 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:16.986747 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb8c3c11-ca39-494c-a89f-6099fa388459 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:16.987640 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb8c3c11-ca39-494c-a89f-6099fa388459 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:17.064308 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bb8c3c11-ca39-494c-a89f-6099fa388459 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.123811 Oct 30 01:40:17.065418 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2641/5263] 10.222.0.13 () {60 vars in 1343 bytes} [Sun Oct 30 01:40:16 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:40:17.094526 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7c71c99b-61b2-4d4d-a643-b300c5172660 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:40:17.095192 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7c71c99b-61b2-4d4d-a643-b300c5172660 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:40:17.107091 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7c71c99b-61b2-4d4d-a643-b300c5172660 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:17.114559 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7c71c99b-61b2-4d4d-a643-b300c5172660 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:17.117700 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7c71c99b-61b2-4d4d-a643-b300c5172660 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:17.117700 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7c71c99b-61b2-4d4d-a643-b300c5172660 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:17.117700 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7c71c99b-61b2-4d4d-a643-b300c5172660 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:17.117700 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7c71c99b-61b2-4d4d-a643-b300c5172660 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:17.159900 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=68 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:40:17.388380 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7c71c99b-61b2-4d4d-a643-b300c5172660 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:17.397611 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7c71c99b-61b2-4d4d-a643-b300c5172660 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1364 microversion: 2.1 time: 0.307152 Oct 30 01:40:17.414157 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2623/5264] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:40:17 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1364 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:40:18.076669 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-19ed15b0-902a-468a-913f-5a38a54d8740 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:40:18.083735 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-19ed15b0-902a-468a-913f-5a38a54d8740 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:40:18.083735 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:40:18.094217 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-19ed15b0-902a-468a-913f-5a38a54d8740 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:18.094950 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-19ed15b0-902a-468a-913f-5a38a54d8740 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:18.095401 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-19ed15b0-902a-468a-913f-5a38a54d8740 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:18.096123 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-19ed15b0-902a-468a-913f-5a38a54d8740 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:18.096577 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-19ed15b0-902a-468a-913f-5a38a54d8740 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:18.097208 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-19ed15b0-902a-468a-913f-5a38a54d8740 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:18.136267 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-19ed15b0-902a-468a-913f-5a38a54d8740 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063784 Oct 30 01:40:18.141989 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2642/5265] 10.222.0.13 () {60 vars in 1343 bytes} [Sun Oct 30 01:40:18 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:40:18.421778 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-64be50c7-990e-4385-af34-0b8e866abdad tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:40:18.422377 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-64be50c7-990e-4385-af34-0b8e866abdad tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:40:18.426958 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:40:18.439473 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-64be50c7-990e-4385-af34-0b8e866abdad tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:18.440138 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-64be50c7-990e-4385-af34-0b8e866abdad tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:18.440716 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-64be50c7-990e-4385-af34-0b8e866abdad tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:18.442155 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-64be50c7-990e-4385-af34-0b8e866abdad tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:18.447433 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-64be50c7-990e-4385-af34-0b8e866abdad tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:18.448144 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-64be50c7-990e-4385-af34-0b8e866abdad tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:18.835315 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-64be50c7-990e-4385-af34-0b8e866abdad tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:18.850489 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-64be50c7-990e-4385-af34-0b8e866abdad tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1364 microversion: 2.1 time: 0.432527 Oct 30 01:40:18.851196 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2624/5266] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:40:18 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1364 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:40:19.150007 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7c3c146c-9e15-47f0-8409-11524af4d7cd tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:40:19.152193 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7c3c146c-9e15-47f0-8409-11524af4d7cd tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:40:19.155253 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=12 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:40:19.183479 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7c3c146c-9e15-47f0-8409-11524af4d7cd tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:19.184340 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7c3c146c-9e15-47f0-8409-11524af4d7cd tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:19.184958 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7c3c146c-9e15-47f0-8409-11524af4d7cd tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:19.186010 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7c3c146c-9e15-47f0-8409-11524af4d7cd tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:19.186655 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7c3c146c-9e15-47f0-8409-11524af4d7cd tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:19.187230 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7c3c146c-9e15-47f0-8409-11524af4d7cd tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:19.266931 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7c3c146c-9e15-47f0-8409-11524af4d7cd tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.121370 Oct 30 01:40:19.272240 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2643/5267] 10.222.0.13 () {60 vars in 1343 bytes} [Sun Oct 30 01:40:19 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:40:19.876189 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ed045d0d-ec90-418c-bcce-1d46f3c6e768 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:40:19.877599 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ed045d0d-ec90-418c-bcce-1d46f3c6e768 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:40:19.891312 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed045d0d-ec90-418c-bcce-1d46f3c6e768 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:19.892162 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed045d0d-ec90-418c-bcce-1d46f3c6e768 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:19.897073 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed045d0d-ec90-418c-bcce-1d46f3c6e768 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:19.897073 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed045d0d-ec90-418c-bcce-1d46f3c6e768 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:19.897073 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed045d0d-ec90-418c-bcce-1d46f3c6e768 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:19.898626 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed045d0d-ec90-418c-bcce-1d46f3c6e768 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:20.236992 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ed045d0d-ec90-418c-bcce-1d46f3c6e768 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:20.251019 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ed045d0d-ec90-418c-bcce-1d46f3c6e768 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1364 microversion: 2.1 time: 0.378743 Oct 30 01:40:20.268203 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2625/5268] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:40:19 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1364 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:40:20.284873 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8201032e-b416-4aac-82b9-ce06a4f79557 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:40:20.287948 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8201032e-b416-4aac-82b9-ce06a4f79557 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:40:20.306004 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8201032e-b416-4aac-82b9-ce06a4f79557 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:20.307086 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8201032e-b416-4aac-82b9-ce06a4f79557 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:20.309874 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8201032e-b416-4aac-82b9-ce06a4f79557 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:20.311417 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8201032e-b416-4aac-82b9-ce06a4f79557 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:20.316588 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8201032e-b416-4aac-82b9-ce06a4f79557 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:20.317511 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8201032e-b416-4aac-82b9-ce06a4f79557 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:20.386859 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-1e2a081d-17ca-4ef0-8b3a-8f1ee615d55b req-3c9e3340-11b8-41a6-805c-b17bf1f5306b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0f03664-8785-4321-b32e-3622f1b747b9", "name": "network-vif-plugged", "status": "completed", "tag": "63c1537a-0706-49b0-8e88-a5c62f4ffbe3"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:40:20.414716 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-1e2a081d-17ca-4ef0-8b3a-8f1ee615d55b req-3c9e3340-11b8-41a6-805c-b17bf1f5306b service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:20.417176 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-1e2a081d-17ca-4ef0-8b3a-8f1ee615d55b req-3c9e3340-11b8-41a6-805c-b17bf1f5306b service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:20.417803 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-1e2a081d-17ca-4ef0-8b3a-8f1ee615d55b req-3c9e3340-11b8-41a6-805c-b17bf1f5306b service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:20.430430 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8201032e-b416-4aac-82b9-ce06a4f79557 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.155007 Oct 30 01:40:20.435544 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2644/5269] 10.222.0.13 () {60 vars in 1343 bytes} [Sun Oct 30 01:40:20 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:40:20.454266 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-1e2a081d-17ca-4ef0-8b3a-8f1ee615d55b req-3c9e3340-11b8-41a6-805c-b17bf1f5306b service nova] Creating event network-vif-plugged:63c1537a-0706-49b0-8e88-a5c62f4ffbe3 for instance b0f03664-8785-4321-b32e-3622f1b747b9 on n-h2-master-1 Oct 30 01:40:20.473578 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-1e2a081d-17ca-4ef0-8b3a-8f1ee615d55b req-3c9e3340-11b8-41a6-805c-b17bf1f5306b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081678 Oct 30 01:40:20.477532 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2626/5270] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:40:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:40:21.281759 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a38213e7-844d-4942-8287-fa00c1b32690 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:40:21.291177 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a38213e7-844d-4942-8287-fa00c1b32690 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:40:21.311129 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a38213e7-844d-4942-8287-fa00c1b32690 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:21.311643 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a38213e7-844d-4942-8287-fa00c1b32690 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:21.312086 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a38213e7-844d-4942-8287-fa00c1b32690 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:21.312808 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a38213e7-844d-4942-8287-fa00c1b32690 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:21.313260 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a38213e7-844d-4942-8287-fa00c1b32690 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:21.313715 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a38213e7-844d-4942-8287-fa00c1b32690 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:21.452249 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-eff46025-9c84-4563-90fa-d0da4f16896d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:40:21.463096 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-eff46025-9c84-4563-90fa-d0da4f16896d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:40:21.465260 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=38 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:40:21.475811 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eff46025-9c84-4563-90fa-d0da4f16896d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:21.476599 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eff46025-9c84-4563-90fa-d0da4f16896d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:21.477271 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eff46025-9c84-4563-90fa-d0da4f16896d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:21.478222 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eff46025-9c84-4563-90fa-d0da4f16896d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:21.478906 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eff46025-9c84-4563-90fa-d0da4f16896d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:21.479539 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eff46025-9c84-4563-90fa-d0da4f16896d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:21.526742 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-eff46025-9c84-4563-90fa-d0da4f16896d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.085947 Oct 30 01:40:21.536516 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2627/5271] 10.222.0.13 () {60 vars in 1343 bytes} [Sun Oct 30 01:40:21 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:40:21.567580 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a38213e7-844d-4942-8287-fa00c1b32690 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:21.583292 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a38213e7-844d-4942-8287-fa00c1b32690 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1364 microversion: 2.1 time: 0.306330 Oct 30 01:40:21.588572 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2645/5272] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:40:21 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1364 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:40:22.538801 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7d799521-53aa-4e66-98d8-4a8d3f92243d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:40:22.542815 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7d799521-53aa-4e66-98d8-4a8d3f92243d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:40:22.559467 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7d799521-53aa-4e66-98d8-4a8d3f92243d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:22.559962 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7d799521-53aa-4e66-98d8-4a8d3f92243d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:22.560396 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7d799521-53aa-4e66-98d8-4a8d3f92243d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:22.561110 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7d799521-53aa-4e66-98d8-4a8d3f92243d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:22.561588 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7d799521-53aa-4e66-98d8-4a8d3f92243d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:22.562011 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7d799521-53aa-4e66-98d8-4a8d3f92243d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:22.608017 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-12f50401-704a-4d05-95e3-6a4c6a1fabfb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:40:22.609566 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-12f50401-704a-4d05-95e3-6a4c6a1fabfb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:40:22.624575 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-12f50401-704a-4d05-95e3-6a4c6a1fabfb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:22.625829 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-12f50401-704a-4d05-95e3-6a4c6a1fabfb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:22.628587 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-12f50401-704a-4d05-95e3-6a4c6a1fabfb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:22.629570 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-12f50401-704a-4d05-95e3-6a4c6a1fabfb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:22.632501 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-12f50401-704a-4d05-95e3-6a4c6a1fabfb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:22.633165 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-12f50401-704a-4d05-95e3-6a4c6a1fabfb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:22.651653 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7d799521-53aa-4e66-98d8-4a8d3f92243d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.117142 Oct 30 01:40:22.652632 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2628/5273] 10.222.0.13 () {60 vars in 1343 bytes} [Sun Oct 30 01:40:22 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:40:22.903918 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-12f50401-704a-4d05-95e3-6a4c6a1fabfb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:22.913560 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-12f50401-704a-4d05-95e3-6a4c6a1fabfb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1364 microversion: 2.1 time: 0.309517 Oct 30 01:40:22.915638 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2646/5274] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:40:22 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1364 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:40:23.680469 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7c7c34be-c6e5-4cb1-b863-da5ca9091882 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:40:23.688394 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7c7c34be-c6e5-4cb1-b863-da5ca9091882 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:40:23.732142 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7c7c34be-c6e5-4cb1-b863-da5ca9091882 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:23.732952 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7c7c34be-c6e5-4cb1-b863-da5ca9091882 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:23.733679 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7c7c34be-c6e5-4cb1-b863-da5ca9091882 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:23.734549 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7c7c34be-c6e5-4cb1-b863-da5ca9091882 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:23.741558 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7c7c34be-c6e5-4cb1-b863-da5ca9091882 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:23.742339 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7c7c34be-c6e5-4cb1-b863-da5ca9091882 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:23.811378 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7c7c34be-c6e5-4cb1-b863-da5ca9091882 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.150964 Oct 30 01:40:23.814974 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2629/5275] 10.222.0.13 () {60 vars in 1343 bytes} [Sun Oct 30 01:40:23 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb/os-volume_attachments => generated 197 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:40:23.941205 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c0eefed0-283e-4813-ba52-733437f2f866 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:40:23.941898 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c0eefed0-283e-4813-ba52-733437f2f866 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:40:23.966190 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0eefed0-283e-4813-ba52-733437f2f866 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:23.969811 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0eefed0-283e-4813-ba52-733437f2f866 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:23.971408 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0eefed0-283e-4813-ba52-733437f2f866 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:23.975640 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0eefed0-283e-4813-ba52-733437f2f866 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:23.981208 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0eefed0-283e-4813-ba52-733437f2f866 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:23.981929 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0eefed0-283e-4813-ba52-733437f2f866 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:24.190423 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c0eefed0-283e-4813-ba52-733437f2f866 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:24.211374 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c0eefed0-283e-4813-ba52-733437f2f866 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1552 microversion: 2.1 time: 0.270546 Oct 30 01:40:24.226459 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2647/5276] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:40:23 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1552 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:40:24.237728 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-81e745e0-3373-4078-8be4-4a8fa971f25a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:40:24.238311 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-81e745e0-3373-4078-8be4-4a8fa971f25a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:40:24.246136 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-81e745e0-3373-4078-8be4-4a8fa971f25a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:24.246788 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-81e745e0-3373-4078-8be4-4a8fa971f25a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:24.247532 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-81e745e0-3373-4078-8be4-4a8fa971f25a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:24.248505 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-81e745e0-3373-4078-8be4-4a8fa971f25a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:24.249174 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-81e745e0-3373-4078-8be4-4a8fa971f25a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:24.249845 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-81e745e0-3373-4078-8be4-4a8fa971f25a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:24.407743 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-81e745e0-3373-4078-8be4-4a8fa971f25a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.174097 Oct 30 01:40:24.408352 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2630/5277] 10.222.0.13 () {58 vars in 1275 bytes} [Sun Oct 30 01:40:24 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9/os-interface => generated 285 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:40:24.829608 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0b20c5f0-1b04-4844-9e82-34741d5b6d0f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:40:24.832702 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0b20c5f0-1b04-4844-9e82-34741d5b6d0f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:40:24.840508 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b20c5f0-1b04-4844-9e82-34741d5b6d0f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:24.841612 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b20c5f0-1b04-4844-9e82-34741d5b6d0f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:24.842561 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b20c5f0-1b04-4844-9e82-34741d5b6d0f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:24.843596 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b20c5f0-1b04-4844-9e82-34741d5b6d0f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:24.845711 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b20c5f0-1b04-4844-9e82-34741d5b6d0f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:24.846452 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b20c5f0-1b04-4844-9e82-34741d5b6d0f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:24.892901 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0b20c5f0-1b04-4844-9e82-34741d5b6d0f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.067862 Oct 30 01:40:24.893524 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2648/5278] 10.222.0.13 () {60 vars in 1343 bytes} [Sun Oct 30 01:40:24 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:40:25.803618 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-7842bdc9-9d62-4582-b3cd-2e689f66f6fa req-13e186ce-17fb-4da8-b676-da485dc07b76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0f03664-8785-4321-b32e-3622f1b747b9", "tag": "63c1537a-0706-49b0-8e88-a5c62f4ffbe3"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:40:25.819071 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-7842bdc9-9d62-4582-b3cd-2e689f66f6fa req-13e186ce-17fb-4da8-b676-da485dc07b76 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:25.819891 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-7842bdc9-9d62-4582-b3cd-2e689f66f6fa req-13e186ce-17fb-4da8-b676-da485dc07b76 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:25.820522 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-7842bdc9-9d62-4582-b3cd-2e689f66f6fa req-13e186ce-17fb-4da8-b676-da485dc07b76 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:25.833724 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-7842bdc9-9d62-4582-b3cd-2e689f66f6fa req-13e186ce-17fb-4da8-b676-da485dc07b76 service nova] Creating event network-changed:63c1537a-0706-49b0-8e88-a5c62f4ffbe3 for instance b0f03664-8785-4321-b32e-3622f1b747b9 on n-h2-master-1 Oct 30 01:40:25.839637 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-7842bdc9-9d62-4582-b3cd-2e689f66f6fa req-13e186ce-17fb-4da8-b676-da485dc07b76 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039744 Oct 30 01:40:25.844756 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2631/5279] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:40:25.907583 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f31a7b65-053d-42a9-9d23-f02f99666c05 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:40:25.913985 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f31a7b65-053d-42a9-9d23-f02f99666c05 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:40:25.935219 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f31a7b65-053d-42a9-9d23-f02f99666c05 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:25.938929 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f31a7b65-053d-42a9-9d23-f02f99666c05 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:25.942624 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f31a7b65-053d-42a9-9d23-f02f99666c05 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:25.949289 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f31a7b65-053d-42a9-9d23-f02f99666c05 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:25.950029 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f31a7b65-053d-42a9-9d23-f02f99666c05 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:25.955477 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f31a7b65-053d-42a9-9d23-f02f99666c05 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:26.085725 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f31a7b65-053d-42a9-9d23-f02f99666c05 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.182811 Oct 30 01:40:26.093597 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2649/5280] 10.222.0.13 () {60 vars in 1343 bytes} [Sun Oct 30 01:40:25 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb/os-volume_attachments => generated 25 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:40:26.259870 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7c384b22-e981-445d-9f36-be7f5b1a7e82 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:40:26.261050 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7c384b22-e981-445d-9f36-be7f5b1a7e82 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:40:26.272758 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7c384b22-e981-445d-9f36-be7f5b1a7e82 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:26.273267 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7c384b22-e981-445d-9f36-be7f5b1a7e82 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:26.273737 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7c384b22-e981-445d-9f36-be7f5b1a7e82 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:26.274678 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7c384b22-e981-445d-9f36-be7f5b1a7e82 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:26.275142 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7c384b22-e981-445d-9f36-be7f5b1a7e82 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:26.275582 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7c384b22-e981-445d-9f36-be7f5b1a7e82 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:26.309438 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7c384b22-e981-445d-9f36-be7f5b1a7e82 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:40:26.650212 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7c384b22-e981-445d-9f36-be7f5b1a7e82 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 204 len: 0 microversion: 2.20 time: 0.398423 Oct 30 01:40:26.651636 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2632/5281] 10.222.0.13 () {60 vars in 1280 bytes} [Sun Oct 30 01:40:26 2022] DELETE /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 30 01:40:26.668556 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-dc4d2a4d-d621-4542-bdc3-4dd0101ebb89 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:40:26.687657 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-dc4d2a4d-d621-4542-bdc3-4dd0101ebb89 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:40:26.727053 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc4d2a4d-d621-4542-bdc3-4dd0101ebb89 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:26.727808 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc4d2a4d-d621-4542-bdc3-4dd0101ebb89 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:26.730940 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc4d2a4d-d621-4542-bdc3-4dd0101ebb89 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:26.734146 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc4d2a4d-d621-4542-bdc3-4dd0101ebb89 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:26.735403 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc4d2a4d-d621-4542-bdc3-4dd0101ebb89 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:26.735986 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc4d2a4d-d621-4542-bdc3-4dd0101ebb89 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:26.958422 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-dc4d2a4d-d621-4542-bdc3-4dd0101ebb89 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:26.968740 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-dc4d2a4d-d621-4542-bdc3-4dd0101ebb89 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:26.970400 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-dc4d2a4d-d621-4542-bdc3-4dd0101ebb89 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:26.971812 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-dc4d2a4d-d621-4542-bdc3-4dd0101ebb89 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1722 microversion: 2.20 time: 0.314405 Oct 30 01:40:26.985857 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2650/5282] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:40:26 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1722 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:40:28.162682 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f0c24fc9-1df7-4d1d-be95-50255bdbcbbe tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:40:28.162682 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f0c24fc9-1df7-4d1d-be95-50255bdbcbbe tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:40:28.162682 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f0c24fc9-1df7-4d1d-be95-50255bdbcbbe tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:28.162682 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f0c24fc9-1df7-4d1d-be95-50255bdbcbbe tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:28.162682 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f0c24fc9-1df7-4d1d-be95-50255bdbcbbe tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:28.162682 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f0c24fc9-1df7-4d1d-be95-50255bdbcbbe tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:28.162682 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f0c24fc9-1df7-4d1d-be95-50255bdbcbbe tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:28.162682 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f0c24fc9-1df7-4d1d-be95-50255bdbcbbe tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:28.173094 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f0c24fc9-1df7-4d1d-be95-50255bdbcbbe tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:28.182819 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f0c24fc9-1df7-4d1d-be95-50255bdbcbbe tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:28.192101 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f0c24fc9-1df7-4d1d-be95-50255bdbcbbe tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:28.192101 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f0c24fc9-1df7-4d1d-be95-50255bdbcbbe tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1722 microversion: 2.20 time: 0.190202 Oct 30 01:40:28.192101 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2633/5283] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:40:27 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:40:29.214621 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-710e462c-1dfb-43ec-81d7-c67940426dee tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:40:29.215236 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-710e462c-1dfb-43ec-81d7-c67940426dee tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:40:29.222226 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-710e462c-1dfb-43ec-81d7-c67940426dee tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:29.222740 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-710e462c-1dfb-43ec-81d7-c67940426dee tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:29.223183 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-710e462c-1dfb-43ec-81d7-c67940426dee tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:29.223890 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-710e462c-1dfb-43ec-81d7-c67940426dee tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:29.224347 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-710e462c-1dfb-43ec-81d7-c67940426dee tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:29.224773 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-710e462c-1dfb-43ec-81d7-c67940426dee tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:29.835681 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-710e462c-1dfb-43ec-81d7-c67940426dee tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:29.852809 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:40:29.860665 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-710e462c-1dfb-43ec-81d7-c67940426dee tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:29.862172 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-710e462c-1dfb-43ec-81d7-c67940426dee tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:29.863429 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-710e462c-1dfb-43ec-81d7-c67940426dee tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1654 microversion: 2.20 time: 0.652722 Oct 30 01:40:29.868094 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2651/5284] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:40:29 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1654 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:40:30.217731 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-c3fd4f16-cf88-4650-9b89-f4aabb858e6e req-c4fc327f-d139-459d-a4c2-f1661f6a8e11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5389398-bf67-44ff-a1fb-a26e4a079fcb", "name": "network-vif-deleted", "tag": "5fdf7d37-8815-4dca-ba2d-d6297f9d29eb"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:40:30.251202 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-c3fd4f16-cf88-4650-9b89-f4aabb858e6e req-c4fc327f-d139-459d-a4c2-f1661f6a8e11 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:30.251707 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-c3fd4f16-cf88-4650-9b89-f4aabb858e6e req-c4fc327f-d139-459d-a4c2-f1661f6a8e11 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:30.255292 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-c3fd4f16-cf88-4650-9b89-f4aabb858e6e req-c4fc327f-d139-459d-a4c2-f1661f6a8e11 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:30.297393 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-c3fd4f16-cf88-4650-9b89-f4aabb858e6e req-c4fc327f-d139-459d-a4c2-f1661f6a8e11 service nova] Creating event network-vif-deleted:5fdf7d37-8815-4dca-ba2d-d6297f9d29eb for instance a5389398-bf67-44ff-a1fb-a26e4a079fcb on n-h2-master-1 Oct 30 01:40:30.329605 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-c3fd4f16-cf88-4650-9b89-f4aabb858e6e req-c4fc327f-d139-459d-a4c2-f1661f6a8e11 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113315 Oct 30 01:40:30.335705 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2634/5285] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:40:30.894646 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-10e3ebcd-72f4-4ca6-9786-643c3e7dcc49 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:40:30.895801 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-10e3ebcd-72f4-4ca6-9786-643c3e7dcc49 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:40:30.924229 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=4 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:40:30.928200 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-10e3ebcd-72f4-4ca6-9786-643c3e7dcc49 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:30.928898 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-10e3ebcd-72f4-4ca6-9786-643c3e7dcc49 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:30.929556 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-10e3ebcd-72f4-4ca6-9786-643c3e7dcc49 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:30.930459 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-10e3ebcd-72f4-4ca6-9786-643c3e7dcc49 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:30.931077 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-10e3ebcd-72f4-4ca6-9786-643c3e7dcc49 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:30.931508 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-10e3ebcd-72f4-4ca6-9786-643c3e7dcc49 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:30.969045 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-10e3ebcd-72f4-4ca6-9786-643c3e7dcc49 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:30.969767 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-10e3ebcd-72f4-4ca6-9786-643c3e7dcc49 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:30.970359 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-10e3ebcd-72f4-4ca6-9786-643c3e7dcc49 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:30.970990 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-10e3ebcd-72f4-4ca6-9786-643c3e7dcc49 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lazy-loading 'fault' on Instance uuid a5389398-bf67-44ff-a1fb-a26e4a079fcb {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:40:31.057107 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-10e3ebcd-72f4-4ca6-9786-643c3e7dcc49 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:31.069505 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-10e3ebcd-72f4-4ca6-9786-643c3e7dcc49 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:31.072681 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-10e3ebcd-72f4-4ca6-9786-643c3e7dcc49 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:31.074368 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-10e3ebcd-72f4-4ca6-9786-643c3e7dcc49 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 200 len: 1370 microversion: 2.20 time: 0.183661 Oct 30 01:40:31.075996 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2652/5286] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:40:30 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 1370 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:40:32.101362 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-335d3dec-5a05-4a25-86ad-2a3228eb2102 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:40:32.102120 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-335d3dec-5a05-4a25-86ad-2a3228eb2102 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:40:32.114479 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-335d3dec-5a05-4a25-86ad-2a3228eb2102 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:32.114979 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-335d3dec-5a05-4a25-86ad-2a3228eb2102 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:32.117540 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-335d3dec-5a05-4a25-86ad-2a3228eb2102 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:32.118478 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-335d3dec-5a05-4a25-86ad-2a3228eb2102 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:32.119193 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-335d3dec-5a05-4a25-86ad-2a3228eb2102 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:32.119786 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-335d3dec-5a05-4a25-86ad-2a3228eb2102 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:32.151250 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-335d3dec-5a05-4a25-86ad-2a3228eb2102 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] HTTP exception thrown: Instance a5389398-bf67-44ff-a1fb-a26e4a079fcb could not be found. Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-335d3dec-5a05-4a25-86ad-2a3228eb2102 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Request method failure captured: Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb HTTP/1.1 Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdUumvYALlX1ZEotYYfctadY85rkMIcCqpZFBAcTzKR92GeJdeuIBdMxiIzxgpC70Uj-cIJEgHazOdEuJ2nPCy0aOB6DMv1PnS8XxJSl3GFjmmFSeBD_Hmz1zCSH_Icmjv43STm9-8axTTUKObYyp4Juj43xfhv3UIItt81amHvJ3AU Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: X-Openstack-Nova-Api-Version: 2.20 Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: d206d5c4ea654a2194a77d71d27972e8 Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-119748518 Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d206d5c4ea654a2194a77d71d27972e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d206d5c4ea654a2194a77d71d27972e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d206d5c4ea654a2194a77d71d27972e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d206d5c4ea654a2194a77d71d27972e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-AttachVolumeShelveTestJSON-119748518 Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: d206d5c4ea654a2194a77d71d27972e8 Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-119748518 Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-AttachVolumeShelveTestJSON-119748518-project Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 93d18cf1316742dab78a102a257608ae Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-AttachVolumeShelveTestJSON-119748518-project Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: exception: Instance a5389398-bf67-44ff-a1fb-a26e4a079fcb could not be found. Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'a5389398-bf67-44ff-a1fb-a26e4a079fcb'} Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5389398-bf67-44ff-a1fb-a26e4a079fcb could not be found. Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5389398-bf67-44ff-a1fb-a26e4a079fcb could not be found. Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:40:32.153883 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:40:32.158024 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:40:32.158024 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:40:32.158024 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:40:32.158024 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:40:32.158024 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:40:32.158024 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:40:32.158024 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5389398-bf67-44ff-a1fb-a26e4a079fcb could not be found. Oct 30 01:40:32.158024 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:40:32.158622 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-335d3dec-5a05-4a25-86ad-2a3228eb2102 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Returning 404 to user: Instance a5389398-bf67-44ff-a1fb-a26e4a079fcb could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:40:32.159421 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-335d3dec-5a05-4a25-86ad-2a3228eb2102 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 404 len: 111 microversion: 2.20 time: 0.062634 Oct 30 01:40:32.160251 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2635/5287] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:40:32 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:40:32.168753 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f09121ca-a930-4965-88ff-033ad571c9d0 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '.version_select at 0x7f44c6efe040>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:40:32.241193 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f09121ca-a930-4965-88ff-033ad571c9d0 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-814063231" status: 204 len: 0 microversion: 2.20 time: 0.075711 Oct 30 01:40:32.241432 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2653/5288] 10.222.0.13 () {60 vars in 1259 bytes} [Sun Oct 30 01:40:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-814063231 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 30 01:40:33.663753 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fd2df44e-0bf3-48c8-bc62-69c350af9ce9 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Action: 'create', calling method: .version_select at 0x7f44c6e3bd30>, body: {"keypair": {"name": "tempest-keypair-301372314", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBmIXEQSOh0hdXDWVYHm6qhGyax3jZwlGM0FUzyQOy1MkcJSyXsCEweHe19AGQ834Ro51PalnQytj4FICPezFKH9WGuy8QtJnz+m9uFZTLoVUz/twOdDzNkQv3Y8Na35Aw=="}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:40:33.696093 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-fd2df44e-0bf3-48c8-bc62-69c350af9ce9 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Getting quotas for project d206d5c4ea654a2194a77d71d27972e8. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:40:33.696093 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-fd2df44e-0bf3-48c8-bc62-69c350af9ce9 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Getting quotas for user 93d18cf1316742dab78a102a257608ae and project d206d5c4ea654a2194a77d71d27972e8. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:40:33.800080 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fd2df44e-0bf3-48c8-bc62-69c350af9ce9 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.143195 Oct 30 01:40:33.807821 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2636/5289] 10.222.0.13 () {62 vars in 1200 bytes} [Sun Oct 30 01:40:33 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 151 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 30 01:40:36.473832 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-46d5946a-03cf-4581-9ea8-3f6b95b41ab6 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:40:36.474386 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-46d5946a-03cf-4581-9ea8-3f6b95b41ab6 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 2435fb0b-ab56-4368-9965-245b3574d012] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:40:36.495932 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-46d5946a-03cf-4581-9ea8-3f6b95b41ab6 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:36.495932 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-46d5946a-03cf-4581-9ea8-3f6b95b41ab6 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:36.495932 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-46d5946a-03cf-4581-9ea8-3f6b95b41ab6 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:36.505681 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-46d5946a-03cf-4581-9ea8-3f6b95b41ab6 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:36.506184 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-46d5946a-03cf-4581-9ea8-3f6b95b41ab6 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:36.507855 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-46d5946a-03cf-4581-9ea8-3f6b95b41ab6 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:36.586681 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-46d5946a-03cf-4581-9ea8-3f6b95b41ab6 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012/ips" status: 200 len: 146 microversion: 2.1 time: 0.119136 Oct 30 01:40:36.606771 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2654/5290] 10.222.0.13 () {58 vars in 1248 bytes} [Sun Oct 30 01:40:36 2022] GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012/ips => generated 146 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:40:37.473137 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e0844c58-53ef-4bf5-b6ee-9a16095b2c2a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-405802916", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "693a1153-c32e-44c9-bea1-fb3b37ac543f"}], "security_groups": [{"name": "tempest-securitygroup--292020437"}], "key_name": "tempest-keypair-301372314", "user_data": "}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:40:37.782313 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-e0844c58-53ef-4bf5-b6ee-9a16095b2c2a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] validate_networks() for [('693a1153-c32e-44c9-bea1-fb3b37ac543f', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:40:38.707594 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-e0844c58-53ef-4bf5-b6ee-9a16095b2c2a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:40:38.708867 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-e0844c58-53ef-4bf5-b6ee-9a16095b2c2a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:40:38.709547 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-e0844c58-53ef-4bf5-b6ee-9a16095b2c2a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:40:38.710100 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-e0844c58-53ef-4bf5-b6ee-9a16095b2c2a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:40:38.711841 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-e0844c58-53ef-4bf5-b6ee-9a16095b2c2a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:40:38.723745 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e0844c58-53ef-4bf5-b6ee-9a16095b2c2a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:38.724503 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e0844c58-53ef-4bf5-b6ee-9a16095b2c2a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:38.725973 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e0844c58-53ef-4bf5-b6ee-9a16095b2c2a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:38.726920 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e0844c58-53ef-4bf5-b6ee-9a16095b2c2a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:38.727554 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e0844c58-53ef-4bf5-b6ee-9a16095b2c2a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:38.728202 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e0844c58-53ef-4bf5-b6ee-9a16095b2c2a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:38.748165 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-e0844c58-53ef-4bf5-b6ee-9a16095b2c2a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Getting quotas for project d206d5c4ea654a2194a77d71d27972e8. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:40:38.755667 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-e0844c58-53ef-4bf5-b6ee-9a16095b2c2a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Getting quotas for user 93d18cf1316742dab78a102a257608ae and project d206d5c4ea654a2194a77d71d27972e8. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:40:38.770113 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e0844c58-53ef-4bf5-b6ee-9a16095b2c2a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:40:38.772706 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e0844c58-53ef-4bf5-b6ee-9a16095b2c2a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:40:38.973818 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e0844c58-53ef-4bf5-b6ee-9a16095b2c2a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.515152 Oct 30 01:40:38.978574 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2637/5291] 10.222.0.13 () {62 vars in 1188 bytes} [Sun Oct 30 01:40:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 1519 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 30 01:40:39.008952 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cf0a81e6-60e0-432d-9e27-d06c0d81b85d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:40:39.009306 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-cf0a81e6-60e0-432d-9e27-d06c0d81b85d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:40:39.151346 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-cf0a81e6-60e0-432d-9e27-d06c0d81b85d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:39.162643 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-cf0a81e6-60e0-432d-9e27-d06c0d81b85d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:39.172198 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-cf0a81e6-60e0-432d-9e27-d06c0d81b85d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:39.173869 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cf0a81e6-60e0-432d-9e27-d06c0d81b85d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1280 microversion: 2.20 time: 0.191845 Oct 30 01:40:39.192939 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2655/5292] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:40:38 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1280 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:40:40.121397 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-afb65d5b-4976-4455-986e-2c751da47359 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f006fb8-3196-4e4c-91b5-e7c20f5662cb"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:40:40.124463 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-afb65d5b-4976-4455-986e-2c751da47359 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 2435fb0b-ab56-4368-9965-245b3574d012] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:40:40.135323 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-afb65d5b-4976-4455-986e-2c751da47359 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:40.136103 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-afb65d5b-4976-4455-986e-2c751da47359 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:40.136765 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-afb65d5b-4976-4455-986e-2c751da47359 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:40.137739 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-afb65d5b-4976-4455-986e-2c751da47359 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:40.138492 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-afb65d5b-4976-4455-986e-2c751da47359 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:40.139454 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-afb65d5b-4976-4455-986e-2c751da47359 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:40.211273 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b9ae662b-a84e-4e27-8cf4-e13ec1366c80 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:40:40.212547 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b9ae662b-a84e-4e27-8cf4-e13ec1366c80 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:40:40.402325 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b9ae662b-a84e-4e27-8cf4-e13ec1366c80 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:40.418857 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b9ae662b-a84e-4e27-8cf4-e13ec1366c80 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:40.422463 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b9ae662b-a84e-4e27-8cf4-e13ec1366c80 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:40.437247 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b9ae662b-a84e-4e27-8cf4-e13ec1366c80 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1280 microversion: 2.20 time: 0.238814 Oct 30 01:40:40.438659 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2656/5293] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:40:40 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1280 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:40:41.334011 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-afb65d5b-4976-4455-986e-2c751da47359 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "POST /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.216736 Oct 30 01:40:41.345697 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2638/5294] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 30 01:40:40 2022] POST /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012/os-volume_attachments => generated 194 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:40:41.475917 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cb2058bb-f03a-4c46-b060-d25dc4c58605 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:40:41.477810 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-cb2058bb-f03a-4c46-b060-d25dc4c58605 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:40:41.506311 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cb2058bb-f03a-4c46-b060-d25dc4c58605 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:41.508823 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cb2058bb-f03a-4c46-b060-d25dc4c58605 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:41.509583 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cb2058bb-f03a-4c46-b060-d25dc4c58605 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:41.514493 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cb2058bb-f03a-4c46-b060-d25dc4c58605 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:41.517554 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cb2058bb-f03a-4c46-b060-d25dc4c58605 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:41.518020 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cb2058bb-f03a-4c46-b060-d25dc4c58605 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:41.800372 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-cb2058bb-f03a-4c46-b060-d25dc4c58605 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:41.823010 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-cb2058bb-f03a-4c46-b060-d25dc4c58605 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:41.824058 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-cb2058bb-f03a-4c46-b060-d25dc4c58605 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:41.832818 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cb2058bb-f03a-4c46-b060-d25dc4c58605 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1276 microversion: 2.20 time: 0.371862 Oct 30 01:40:41.837658 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2657/5295] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:40:41 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1276 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:40:42.859911 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ade28413-fdfd-4aae-9fe8-991ac6762297 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:40:42.861909 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ade28413-fdfd-4aae-9fe8-991ac6762297 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:40:42.876211 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ade28413-fdfd-4aae-9fe8-991ac6762297 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:42.882053 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ade28413-fdfd-4aae-9fe8-991ac6762297 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:42.883449 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ade28413-fdfd-4aae-9fe8-991ac6762297 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:42.889599 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ade28413-fdfd-4aae-9fe8-991ac6762297 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:42.890441 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ade28413-fdfd-4aae-9fe8-991ac6762297 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:42.891795 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ade28413-fdfd-4aae-9fe8-991ac6762297 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:43.078845 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ade28413-fdfd-4aae-9fe8-991ac6762297 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:43.094237 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ade28413-fdfd-4aae-9fe8-991ac6762297 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:43.098128 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ade28413-fdfd-4aae-9fe8-991ac6762297 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:43.116605 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ade28413-fdfd-4aae-9fe8-991ac6762297 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1340 microversion: 2.20 time: 0.244929 Oct 30 01:40:43.121311 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2639/5296] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:40:42 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1340 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:40:44.152286 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8473e0c6-9a77-4119-b340-8281c06e852f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:40:44.153544 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8473e0c6-9a77-4119-b340-8281c06e852f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:40:44.168105 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8473e0c6-9a77-4119-b340-8281c06e852f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:44.182463 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8473e0c6-9a77-4119-b340-8281c06e852f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:44.183203 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8473e0c6-9a77-4119-b340-8281c06e852f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:44.184116 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8473e0c6-9a77-4119-b340-8281c06e852f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:44.184726 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8473e0c6-9a77-4119-b340-8281c06e852f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:44.185303 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8473e0c6-9a77-4119-b340-8281c06e852f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:44.567394 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8473e0c6-9a77-4119-b340-8281c06e852f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:44.589443 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8473e0c6-9a77-4119-b340-8281c06e852f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:44.592473 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8473e0c6-9a77-4119-b340-8281c06e852f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:44.598751 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8473e0c6-9a77-4119-b340-8281c06e852f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1338 microversion: 2.20 time: 0.445932 Oct 30 01:40:44.602271 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2658/5297] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:40:44 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1338 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:40:45.635778 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-13ae8012-9734-4d01-902f-1995ed7043a1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:40:45.640211 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-13ae8012-9734-4d01-902f-1995ed7043a1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:40:45.657260 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-13ae8012-9734-4d01-902f-1995ed7043a1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:45.657800 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-13ae8012-9734-4d01-902f-1995ed7043a1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:45.658239 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-13ae8012-9734-4d01-902f-1995ed7043a1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:45.663633 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-13ae8012-9734-4d01-902f-1995ed7043a1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:45.664531 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-13ae8012-9734-4d01-902f-1995ed7043a1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:45.668079 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-13ae8012-9734-4d01-902f-1995ed7043a1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:46.078672 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-13ae8012-9734-4d01-902f-1995ed7043a1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:46.109697 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-13ae8012-9734-4d01-902f-1995ed7043a1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:46.112217 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-13ae8012-9734-4d01-902f-1995ed7043a1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:46.121838 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-13ae8012-9734-4d01-902f-1995ed7043a1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1405 microversion: 2.20 time: 0.498006 Oct 30 01:40:46.135300 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2640/5298] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:40:45 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1405 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:40:46.922279 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-98cc69bd-6d05-4535-8264-7a68b6687837 req-8d931975-e776-4356-99e2-7fd3c50bc8d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2e35e69-66f2-43a0-9baa-d8f70437561d", "tag": "6657440b-da45-40cf-ae87-7a3d5beeb7a4"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:40:46.938737 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-98cc69bd-6d05-4535-8264-7a68b6687837 req-8d931975-e776-4356-99e2-7fd3c50bc8d3 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:46.939914 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-98cc69bd-6d05-4535-8264-7a68b6687837 req-8d931975-e776-4356-99e2-7fd3c50bc8d3 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:46.939914 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-98cc69bd-6d05-4535-8264-7a68b6687837 req-8d931975-e776-4356-99e2-7fd3c50bc8d3 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:46.955391 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-98cc69bd-6d05-4535-8264-7a68b6687837 req-8d931975-e776-4356-99e2-7fd3c50bc8d3 service nova] Creating event network-changed:6657440b-da45-40cf-ae87-7a3d5beeb7a4 for instance b2e35e69-66f2-43a0-9baa-d8f70437561d on n-h1-master-1 Oct 30 01:40:46.962137 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-98cc69bd-6d05-4535-8264-7a68b6687837 req-8d931975-e776-4356-99e2-7fd3c50bc8d3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044811 Oct 30 01:40:46.965473 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2659/5299] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:40:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:40:47.149659 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f4a6f6b6-0803-4a1b-9b47-59962236ab14 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:40:47.150918 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f4a6f6b6-0803-4a1b-9b47-59962236ab14 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:40:47.172653 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f4a6f6b6-0803-4a1b-9b47-59962236ab14 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:47.176514 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f4a6f6b6-0803-4a1b-9b47-59962236ab14 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:47.177146 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f4a6f6b6-0803-4a1b-9b47-59962236ab14 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:47.178071 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f4a6f6b6-0803-4a1b-9b47-59962236ab14 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:47.181424 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f4a6f6b6-0803-4a1b-9b47-59962236ab14 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:47.182069 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f4a6f6b6-0803-4a1b-9b47-59962236ab14 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:47.217579 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:40:47.627556 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f4a6f6b6-0803-4a1b-9b47-59962236ab14 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:47.640300 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f4a6f6b6-0803-4a1b-9b47-59962236ab14 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:47.644755 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f4a6f6b6-0803-4a1b-9b47-59962236ab14 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:47.647925 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f4a6f6b6-0803-4a1b-9b47-59962236ab14 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1405 microversion: 2.20 time: 0.502731 Oct 30 01:40:47.663197 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2641/5300] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:40:47 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1405 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:40:48.677005 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f8c67f15-0ca2-4698-b4ed-099d55c893bc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:40:48.678028 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f8c67f15-0ca2-4698-b4ed-099d55c893bc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:40:48.693547 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f8c67f15-0ca2-4698-b4ed-099d55c893bc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:48.694053 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f8c67f15-0ca2-4698-b4ed-099d55c893bc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:48.700408 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f8c67f15-0ca2-4698-b4ed-099d55c893bc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:48.701229 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f8c67f15-0ca2-4698-b4ed-099d55c893bc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:48.706035 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f8c67f15-0ca2-4698-b4ed-099d55c893bc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:48.707037 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f8c67f15-0ca2-4698-b4ed-099d55c893bc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:49.088753 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f8c67f15-0ca2-4698-b4ed-099d55c893bc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:49.116033 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f8c67f15-0ca2-4698-b4ed-099d55c893bc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:49.125322 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f8c67f15-0ca2-4698-b4ed-099d55c893bc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:49.127724 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f8c67f15-0ca2-4698-b4ed-099d55c893bc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1405 microversion: 2.20 time: 0.456240 Oct 30 01:40:49.133249 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2660/5301] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:40:48 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1405 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:40:50.158670 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-76d14dbd-f4b7-489b-856b-f84ce7e2eab3 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:40:50.161898 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-76d14dbd-f4b7-489b-856b-f84ce7e2eab3 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:40:50.177753 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:40:50.179964 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=10 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:40:50.182735 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-76d14dbd-f4b7-489b-856b-f84ce7e2eab3 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:50.183152 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-76d14dbd-f4b7-489b-856b-f84ce7e2eab3 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:50.187683 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-76d14dbd-f4b7-489b-856b-f84ce7e2eab3 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:50.187683 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-76d14dbd-f4b7-489b-856b-f84ce7e2eab3 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:50.187683 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-76d14dbd-f4b7-489b-856b-f84ce7e2eab3 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:50.188723 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-76d14dbd-f4b7-489b-856b-f84ce7e2eab3 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:50.407536 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-76d14dbd-f4b7-489b-856b-f84ce7e2eab3 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:50.439934 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-76d14dbd-f4b7-489b-856b-f84ce7e2eab3 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:50.442995 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-76d14dbd-f4b7-489b-856b-f84ce7e2eab3 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:50.445457 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-76d14dbd-f4b7-489b-856b-f84ce7e2eab3 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1405 microversion: 2.20 time: 0.291957 Oct 30 01:40:50.447146 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2642/5302] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:40:50 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1405 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:40:51.484309 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-58908048-d87a-4023-83ce-5b0ffbd1bb63 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:40:51.484896 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-58908048-d87a-4023-83ce-5b0ffbd1bb63 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:40:51.489603 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=4 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:40:51.503176 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58908048-d87a-4023-83ce-5b0ffbd1bb63 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:51.505451 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58908048-d87a-4023-83ce-5b0ffbd1bb63 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:51.508124 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58908048-d87a-4023-83ce-5b0ffbd1bb63 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:51.511424 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58908048-d87a-4023-83ce-5b0ffbd1bb63 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:51.512695 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58908048-d87a-4023-83ce-5b0ffbd1bb63 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:51.513374 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58908048-d87a-4023-83ce-5b0ffbd1bb63 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:51.787904 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-58908048-d87a-4023-83ce-5b0ffbd1bb63 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:51.803182 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-58908048-d87a-4023-83ce-5b0ffbd1bb63 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:51.807622 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-58908048-d87a-4023-83ce-5b0ffbd1bb63 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:51.816014 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-58908048-d87a-4023-83ce-5b0ffbd1bb63 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1405 microversion: 2.20 time: 0.331168 Oct 30 01:40:51.818986 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2661/5303] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:40:51 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1405 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:40:52.086905 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-146b437b-66b0-4ea9-aab1-f95d08a9fd5e tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1230287960", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "64d7eb4c-2007-41f2-bdc1-acd8dcc332ad"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:40:52.197884 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-146b437b-66b0-4ea9-aab1-f95d08a9fd5e tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] validate_networks() for [('64d7eb4c-2007-41f2-bdc1-acd8dcc332ad', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:40:52.673912 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-b89a7934-74d4-4ac8-836f-1718a6f0d9c6 req-756db021-edf0-43b0-8b24-f867c8acb231 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2e35e69-66f2-43a0-9baa-d8f70437561d", "name": "network-vif-plugged", "status": "completed", "tag": "6657440b-da45-40cf-ae87-7a3d5beeb7a4"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:40:52.703103 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-b89a7934-74d4-4ac8-836f-1718a6f0d9c6 req-756db021-edf0-43b0-8b24-f867c8acb231 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:52.709905 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-b89a7934-74d4-4ac8-836f-1718a6f0d9c6 req-756db021-edf0-43b0-8b24-f867c8acb231 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:52.709995 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-b89a7934-74d4-4ac8-836f-1718a6f0d9c6 req-756db021-edf0-43b0-8b24-f867c8acb231 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:52.731821 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-b89a7934-74d4-4ac8-836f-1718a6f0d9c6 req-756db021-edf0-43b0-8b24-f867c8acb231 service nova] Creating event network-vif-plugged:6657440b-da45-40cf-ae87-7a3d5beeb7a4 for instance b2e35e69-66f2-43a0-9baa-d8f70437561d on n-h1-master-1 Oct 30 01:40:52.751165 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-b89a7934-74d4-4ac8-836f-1718a6f0d9c6 req-756db021-edf0-43b0-8b24-f867c8acb231 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088442 Oct 30 01:40:52.756080 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2662/5304] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:40:52.847891 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bbbf3e4f-ed7b-4e39-ab68-fc092a5447ee tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:40:52.849171 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-bbbf3e4f-ed7b-4e39-ab68-fc092a5447ee tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:40:52.860518 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bbbf3e4f-ed7b-4e39-ab68-fc092a5447ee tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:52.862223 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bbbf3e4f-ed7b-4e39-ab68-fc092a5447ee tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:52.863296 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bbbf3e4f-ed7b-4e39-ab68-fc092a5447ee tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:52.865028 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bbbf3e4f-ed7b-4e39-ab68-fc092a5447ee tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:52.865971 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bbbf3e4f-ed7b-4e39-ab68-fc092a5447ee tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:52.867131 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bbbf3e4f-ed7b-4e39-ab68-fc092a5447ee tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:53.333375 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-bbbf3e4f-ed7b-4e39-ab68-fc092a5447ee tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:53.348225 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-bbbf3e4f-ed7b-4e39-ab68-fc092a5447ee tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:53.353142 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-bbbf3e4f-ed7b-4e39-ab68-fc092a5447ee tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:53.355442 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bbbf3e4f-ed7b-4e39-ab68-fc092a5447ee tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1405 microversion: 2.20 time: 0.514747 Oct 30 01:40:53.357380 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2663/5305] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:40:52 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1405 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:40:53.406507 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-146b437b-66b0-4ea9-aab1-f95d08a9fd5e tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:40:53.407231 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-146b437b-66b0-4ea9-aab1-f95d08a9fd5e tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:40:53.407734 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-146b437b-66b0-4ea9-aab1-f95d08a9fd5e tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:40:53.408185 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-146b437b-66b0-4ea9-aab1-f95d08a9fd5e tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:40:53.408640 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-146b437b-66b0-4ea9-aab1-f95d08a9fd5e tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:40:53.410685 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:40:53.418687 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-146b437b-66b0-4ea9-aab1-f95d08a9fd5e tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:53.419407 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-146b437b-66b0-4ea9-aab1-f95d08a9fd5e tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:53.423269 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-146b437b-66b0-4ea9-aab1-f95d08a9fd5e tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:53.423269 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-146b437b-66b0-4ea9-aab1-f95d08a9fd5e tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:53.423269 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-146b437b-66b0-4ea9-aab1-f95d08a9fd5e tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:53.423269 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-146b437b-66b0-4ea9-aab1-f95d08a9fd5e tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:53.440232 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-146b437b-66b0-4ea9-aab1-f95d08a9fd5e tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Getting quotas for project 8512b08f05db4a469827368f47fb4c28. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:40:53.446495 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-146b437b-66b0-4ea9-aab1-f95d08a9fd5e tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Getting quotas for user 2ea515c9dbf645828f6f67c9f6bbc541 and project 8512b08f05db4a469827368f47fb4c28. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:40:53.459556 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-146b437b-66b0-4ea9-aab1-f95d08a9fd5e tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:40:53.461956 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-146b437b-66b0-4ea9-aab1-f95d08a9fd5e tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] [instance: dc7864af-b7df-4d34-8e1d-ebb956a8212b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:40:53.605732 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-146b437b-66b0-4ea9-aab1-f95d08a9fd5e tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.522855 Oct 30 01:40:53.617839 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2643/5306] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:40:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:40:53.624676 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8c3587b9-90e6-4fe5-8c44-c3f06c3ebbb0 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:40:53.625505 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8c3587b9-90e6-4fe5-8c44-c3f06c3ebbb0 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] [instance: dc7864af-b7df-4d34-8e1d-ebb956a8212b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:40:53.736317 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8c3587b9-90e6-4fe5-8c44-c3f06c3ebbb0 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea515c9dbf645828f6f67c9f6bbc541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8512b08f05db4a469827368f47fb4c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:53.749613 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8c3587b9-90e6-4fe5-8c44-c3f06c3ebbb0 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] 10.222.0.13 "GET /compute/v2.1/servers/dc7864af-b7df-4d34-8e1d-ebb956a8212b" status: 200 len: 1214 microversion: 2.1 time: 0.132138 Oct 30 01:40:53.750215 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2664/5307] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:40:53 2022] GET /compute/v2.1/servers/dc7864af-b7df-4d34-8e1d-ebb956a8212b => generated 1214 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:40:54.385677 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1342d1d9-113e-474a-8262-dc71c9c53866 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:40:54.386299 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1342d1d9-113e-474a-8262-dc71c9c53866 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:40:54.415257 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1342d1d9-113e-474a-8262-dc71c9c53866 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:54.415814 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1342d1d9-113e-474a-8262-dc71c9c53866 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:54.421063 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1342d1d9-113e-474a-8262-dc71c9c53866 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:54.423500 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1342d1d9-113e-474a-8262-dc71c9c53866 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:54.423500 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1342d1d9-113e-474a-8262-dc71c9c53866 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:54.423500 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1342d1d9-113e-474a-8262-dc71c9c53866 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:54.675838 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1342d1d9-113e-474a-8262-dc71c9c53866 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:54.685774 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1342d1d9-113e-474a-8262-dc71c9c53866 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:54.687733 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1342d1d9-113e-474a-8262-dc71c9c53866 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:54.689151 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1342d1d9-113e-474a-8262-dc71c9c53866 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1405 microversion: 2.20 time: 0.311823 Oct 30 01:40:54.689921 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2644/5308] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:40:54 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1405 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:40:54.773134 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3c26c70e-a9b0-4ffe-8ee2-489fde46f737 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:40:54.774421 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3c26c70e-a9b0-4ffe-8ee2-489fde46f737 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] [instance: dc7864af-b7df-4d34-8e1d-ebb956a8212b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:40:54.861878 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3c26c70e-a9b0-4ffe-8ee2-489fde46f737 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea515c9dbf645828f6f67c9f6bbc541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8512b08f05db4a469827368f47fb4c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:54.885317 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3c26c70e-a9b0-4ffe-8ee2-489fde46f737 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] 10.222.0.13 "GET /compute/v2.1/servers/dc7864af-b7df-4d34-8e1d-ebb956a8212b" status: 200 len: 1214 microversion: 2.1 time: 0.114543 Oct 30 01:40:54.906511 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2665/5309] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:40:54 2022] GET /compute/v2.1/servers/dc7864af-b7df-4d34-8e1d-ebb956a8212b => generated 1214 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:40:55.718336 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e5d6af70-af64-4bc1-99e7-611439698407 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:40:55.719750 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e5d6af70-af64-4bc1-99e7-611439698407 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:40:55.730244 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e5d6af70-af64-4bc1-99e7-611439698407 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:55.731616 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e5d6af70-af64-4bc1-99e7-611439698407 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:55.738911 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e5d6af70-af64-4bc1-99e7-611439698407 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:55.738911 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e5d6af70-af64-4bc1-99e7-611439698407 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:55.738911 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e5d6af70-af64-4bc1-99e7-611439698407 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:55.738911 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e5d6af70-af64-4bc1-99e7-611439698407 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:55.929949 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a591799a-6e0f-47b6-b2b6-fc76e635c8a1 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:40:55.931194 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a591799a-6e0f-47b6-b2b6-fc76e635c8a1 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] [instance: dc7864af-b7df-4d34-8e1d-ebb956a8212b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:40:55.934313 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e5d6af70-af64-4bc1-99e7-611439698407 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:55.938656 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a591799a-6e0f-47b6-b2b6-fc76e635c8a1 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:55.939157 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a591799a-6e0f-47b6-b2b6-fc76e635c8a1 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:55.939601 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a591799a-6e0f-47b6-b2b6-fc76e635c8a1 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:55.940318 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a591799a-6e0f-47b6-b2b6-fc76e635c8a1 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:55.941322 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a591799a-6e0f-47b6-b2b6-fc76e635c8a1 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:55.942042 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a591799a-6e0f-47b6-b2b6-fc76e635c8a1 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:55.945639 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e5d6af70-af64-4bc1-99e7-611439698407 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:55.947934 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e5d6af70-af64-4bc1-99e7-611439698407 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:55.949765 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e5d6af70-af64-4bc1-99e7-611439698407 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1597 microversion: 2.20 time: 0.235764 Oct 30 01:40:55.951316 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2645/5310] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:40:55 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1597 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:40:55.976426 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-08252d3e-38f6-413a-86ad-08fce942d548 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:40:55.977240 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-08252d3e-38f6-413a-86ad-08fce942d548 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:40:55.984566 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08252d3e-38f6-413a-86ad-08fce942d548 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:55.985386 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08252d3e-38f6-413a-86ad-08fce942d548 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:55.986004 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08252d3e-38f6-413a-86ad-08fce942d548 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:55.989496 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08252d3e-38f6-413a-86ad-08fce942d548 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:55.989496 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08252d3e-38f6-413a-86ad-08fce942d548 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:55.989496 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08252d3e-38f6-413a-86ad-08fce942d548 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:56.051208 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a591799a-6e0f-47b6-b2b6-fc76e635c8a1 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea515c9dbf645828f6f67c9f6bbc541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8512b08f05db4a469827368f47fb4c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:56.066442 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a591799a-6e0f-47b6-b2b6-fc76e635c8a1 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] 10.222.0.13 "GET /compute/v2.1/servers/dc7864af-b7df-4d34-8e1d-ebb956a8212b" status: 200 len: 1218 microversion: 2.1 time: 0.139653 Oct 30 01:40:56.082036 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2666/5311] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:40:55 2022] GET /compute/v2.1/servers/dc7864af-b7df-4d34-8e1d-ebb956a8212b => generated 1218 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:40:56.132705 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-08252d3e-38f6-413a-86ad-08fce942d548 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.160521 Oct 30 01:40:56.134116 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2646/5312] 10.222.0.13 () {60 vars in 1316 bytes} [Sun Oct 30 01:40:55 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d/os-interface => generated 285 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 30 01:40:56.613946 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c529134f-6e94-4ff3-bebc-fab795793a11 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:40:56.616952 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c529134f-6e94-4ff3-bebc-fab795793a11 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 2435fb0b-ab56-4368-9965-245b3574d012] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:40:56.633796 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c529134f-6e94-4ff3-bebc-fab795793a11 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:56.638436 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c529134f-6e94-4ff3-bebc-fab795793a11 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:56.639338 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c529134f-6e94-4ff3-bebc-fab795793a11 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:56.641685 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c529134f-6e94-4ff3-bebc-fab795793a11 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:56.642348 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c529134f-6e94-4ff3-bebc-fab795793a11 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:56.642938 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c529134f-6e94-4ff3-bebc-fab795793a11 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:56.702576 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c529134f-6e94-4ff3-bebc-fab795793a11 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095722 Oct 30 01:40:56.703468 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2667/5313] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 01:40:56 2022] GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:40:56.716026 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-43c6cfea-8301-4de5-8542-4f2c16a9591f tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:40:56.716625 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-43c6cfea-8301-4de5-8542-4f2c16a9591f tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 2435fb0b-ab56-4368-9965-245b3574d012] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:40:56.724108 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-43c6cfea-8301-4de5-8542-4f2c16a9591f tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:56.724815 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-43c6cfea-8301-4de5-8542-4f2c16a9591f tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:56.725032 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-43c6cfea-8301-4de5-8542-4f2c16a9591f tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:56.725757 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-43c6cfea-8301-4de5-8542-4f2c16a9591f tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:56.726206 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-43c6cfea-8301-4de5-8542-4f2c16a9591f tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:56.726770 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-43c6cfea-8301-4de5-8542-4f2c16a9591f tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:56.762658 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-43c6cfea-8301-4de5-8542-4f2c16a9591f tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012/os-volume_attachments/4f006fb8-3196-4e4c-91b5-e7c20f5662cb" status: 200 len: 194 microversion: 2.1 time: 0.051790 Oct 30 01:40:56.763707 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2647/5314] 10.222.0.13 () {58 vars in 1413 bytes} [Sun Oct 30 01:40:56 2022] GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012/os-volume_attachments/4f006fb8-3196-4e4c-91b5-e7c20f5662cb => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:40:57.091503 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ea0a181b-5d6b-4257-a339-445e126d1e42 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:40:57.092321 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ea0a181b-5d6b-4257-a339-445e126d1e42 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] [instance: dc7864af-b7df-4d34-8e1d-ebb956a8212b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:40:57.104680 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ea0a181b-5d6b-4257-a339-445e126d1e42 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:57.106353 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ea0a181b-5d6b-4257-a339-445e126d1e42 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:57.106981 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ea0a181b-5d6b-4257-a339-445e126d1e42 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:57.109552 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ea0a181b-5d6b-4257-a339-445e126d1e42 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:57.110195 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ea0a181b-5d6b-4257-a339-445e126d1e42 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:57.113861 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ea0a181b-5d6b-4257-a339-445e126d1e42 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:57.325682 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ea0a181b-5d6b-4257-a339-445e126d1e42 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea515c9dbf645828f6f67c9f6bbc541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8512b08f05db4a469827368f47fb4c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:57.339572 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ea0a181b-5d6b-4257-a339-445e126d1e42 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] 10.222.0.13 "GET /compute/v2.1/servers/dc7864af-b7df-4d34-8e1d-ebb956a8212b" status: 200 len: 1266 microversion: 2.1 time: 0.251925 Oct 30 01:40:57.341020 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2668/5315] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:40:57 2022] GET /compute/v2.1/servers/dc7864af-b7df-4d34-8e1d-ebb956a8212b => generated 1266 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:40:58.370890 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8e9e7d62-b70b-4107-856d-4d1cbcc3d7bd tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:40:58.372391 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8e9e7d62-b70b-4107-856d-4d1cbcc3d7bd tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] [instance: dc7864af-b7df-4d34-8e1d-ebb956a8212b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:40:58.383686 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8e9e7d62-b70b-4107-856d-4d1cbcc3d7bd tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:58.388741 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8e9e7d62-b70b-4107-856d-4d1cbcc3d7bd tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:58.389559 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8e9e7d62-b70b-4107-856d-4d1cbcc3d7bd tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:58.390502 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8e9e7d62-b70b-4107-856d-4d1cbcc3d7bd tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:58.391149 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8e9e7d62-b70b-4107-856d-4d1cbcc3d7bd tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:58.391788 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8e9e7d62-b70b-4107-856d-4d1cbcc3d7bd tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:58.525322 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8e9e7d62-b70b-4107-856d-4d1cbcc3d7bd tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea515c9dbf645828f6f67c9f6bbc541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8512b08f05db4a469827368f47fb4c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:58.538449 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8e9e7d62-b70b-4107-856d-4d1cbcc3d7bd tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] 10.222.0.13 "GET /compute/v2.1/servers/dc7864af-b7df-4d34-8e1d-ebb956a8212b" status: 200 len: 1272 microversion: 2.1 time: 0.172621 Oct 30 01:40:58.553363 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2648/5316] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:40:58 2022] GET /compute/v2.1/servers/dc7864af-b7df-4d34-8e1d-ebb956a8212b => generated 1272 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:40:59.348498 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-08d8b798-9e50-4315-920c-6749d173283c req-b6a1d58a-e916-49be-bfda-c8f899566fa1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2e35e69-66f2-43a0-9baa-d8f70437561d", "tag": "6657440b-da45-40cf-ae87-7a3d5beeb7a4"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:40:59.372648 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-08d8b798-9e50-4315-920c-6749d173283c req-b6a1d58a-e916-49be-bfda-c8f899566fa1 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:59.373386 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-08d8b798-9e50-4315-920c-6749d173283c req-b6a1d58a-e916-49be-bfda-c8f899566fa1 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:59.373985 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-08d8b798-9e50-4315-920c-6749d173283c req-b6a1d58a-e916-49be-bfda-c8f899566fa1 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:59.399864 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-08d8b798-9e50-4315-920c-6749d173283c req-b6a1d58a-e916-49be-bfda-c8f899566fa1 service nova] Creating event network-changed:6657440b-da45-40cf-ae87-7a3d5beeb7a4 for instance b2e35e69-66f2-43a0-9baa-d8f70437561d on n-h1-master-1 Oct 30 01:40:59.411586 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-08d8b798-9e50-4315-920c-6749d173283c req-b6a1d58a-e916-49be-bfda-c8f899566fa1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072778 Oct 30 01:40:59.412622 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2669/5317] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:40:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:40:59.564081 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b1ee9bc6-0294-4662-bbc6-d9721562510b tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:40:59.564788 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b1ee9bc6-0294-4662-bbc6-d9721562510b tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] [instance: dc7864af-b7df-4d34-8e1d-ebb956a8212b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:40:59.571958 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b1ee9bc6-0294-4662-bbc6-d9721562510b tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:59.575669 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b1ee9bc6-0294-4662-bbc6-d9721562510b tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:59.575669 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b1ee9bc6-0294-4662-bbc6-d9721562510b tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:59.575669 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b1ee9bc6-0294-4662-bbc6-d9721562510b tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:40:59.575669 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b1ee9bc6-0294-4662-bbc6-d9721562510b tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:40:59.575669 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b1ee9bc6-0294-4662-bbc6-d9721562510b tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:40:59.712670 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b1ee9bc6-0294-4662-bbc6-d9721562510b tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea515c9dbf645828f6f67c9f6bbc541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8512b08f05db4a469827368f47fb4c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:40:59.731823 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b1ee9bc6-0294-4662-bbc6-d9721562510b tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] 10.222.0.13 "GET /compute/v2.1/servers/dc7864af-b7df-4d34-8e1d-ebb956a8212b" status: 200 len: 1272 microversion: 2.1 time: 0.171605 Oct 30 01:40:59.732414 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2649/5318] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:40:59 2022] GET /compute/v2.1/servers/dc7864af-b7df-4d34-8e1d-ebb956a8212b => generated 1272 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:41:00.229082 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-412452dc-0419-4ad4-bd59-795422ea1811 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:00.230065 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-412452dc-0419-4ad4-bd59-795422ea1811 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:00.245434 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-412452dc-0419-4ad4-bd59-795422ea1811 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:00.245944 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-412452dc-0419-4ad4-bd59-795422ea1811 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:00.246380 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-412452dc-0419-4ad4-bd59-795422ea1811 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:00.247292 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-412452dc-0419-4ad4-bd59-795422ea1811 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:00.248117 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-412452dc-0419-4ad4-bd59-795422ea1811 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:00.248701 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-412452dc-0419-4ad4-bd59-795422ea1811 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:00.759319 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-964f14bf-24e1-4f57-bb00-92396b8ef6f7 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:00.765197 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-964f14bf-24e1-4f57-bb00-92396b8ef6f7 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] [instance: dc7864af-b7df-4d34-8e1d-ebb956a8212b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:00.780745 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-964f14bf-24e1-4f57-bb00-92396b8ef6f7 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:00.781318 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-964f14bf-24e1-4f57-bb00-92396b8ef6f7 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:00.782886 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-964f14bf-24e1-4f57-bb00-92396b8ef6f7 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:00.785778 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-964f14bf-24e1-4f57-bb00-92396b8ef6f7 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:00.786382 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-964f14bf-24e1-4f57-bb00-92396b8ef6f7 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:00.786935 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-964f14bf-24e1-4f57-bb00-92396b8ef6f7 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:00.871573 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-412452dc-0419-4ad4-bd59-795422ea1811 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:00.898695 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-412452dc-0419-4ad4-bd59-795422ea1811 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1670 microversion: 2.1 time: 0.673958 Oct 30 01:41:00.906054 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2670/5319] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:41:00 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1670 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:41:00.932116 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-61a5c28e-a4db-4ec8-a898-02c07a04b366 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:00.934756 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-61a5c28e-a4db-4ec8-a898-02c07a04b366 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:00.948023 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-61a5c28e-a4db-4ec8-a898-02c07a04b366 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:00.954110 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-61a5c28e-a4db-4ec8-a898-02c07a04b366 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:00.954904 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-61a5c28e-a4db-4ec8-a898-02c07a04b366 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:00.955970 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-61a5c28e-a4db-4ec8-a898-02c07a04b366 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:00.956637 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-61a5c28e-a4db-4ec8-a898-02c07a04b366 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:00.957252 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-61a5c28e-a4db-4ec8-a898-02c07a04b366 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:01.320282 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-61a5c28e-a4db-4ec8-a898-02c07a04b366 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:01.331562 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-61a5c28e-a4db-4ec8-a898-02c07a04b366 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1670 microversion: 2.1 time: 0.403231 Oct 30 01:41:01.335052 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2671/5320] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:41:00 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1670 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:41:01.351406 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1c97b4d3-3e45-447f-9276-1580f4742a70 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ea0d940-a965-4001-82ec-d8970a27be8d"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:41:01.361451 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1c97b4d3-3e45-447f-9276-1580f4742a70 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 2435fb0b-ab56-4368-9965-245b3574d012] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:01.388100 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1c97b4d3-3e45-447f-9276-1580f4742a70 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:01.394482 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1c97b4d3-3e45-447f-9276-1580f4742a70 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:01.401531 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1c97b4d3-3e45-447f-9276-1580f4742a70 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:01.402434 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1c97b4d3-3e45-447f-9276-1580f4742a70 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:01.403019 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1c97b4d3-3e45-447f-9276-1580f4742a70 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:01.407870 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1c97b4d3-3e45-447f-9276-1580f4742a70 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:01.637453 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-964f14bf-24e1-4f57-bb00-92396b8ef6f7 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea515c9dbf645828f6f67c9f6bbc541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8512b08f05db4a469827368f47fb4c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:01.650318 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-964f14bf-24e1-4f57-bb00-92396b8ef6f7 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] 10.222.0.13 "GET /compute/v2.1/servers/dc7864af-b7df-4d34-8e1d-ebb956a8212b" status: 200 len: 1314 microversion: 2.1 time: 0.894803 Oct 30 01:41:01.651104 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2650/5321] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:41:00 2022] GET /compute/v2.1/servers/dc7864af-b7df-4d34-8e1d-ebb956a8212b => generated 1314 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:41:01.669096 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ee156acc-e919-4faf-a549-a52923f2cc25 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:01.669096 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ee156acc-e919-4faf-a549-a52923f2cc25 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:01.680865 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee156acc-e919-4faf-a549-a52923f2cc25 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:01.681893 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee156acc-e919-4faf-a549-a52923f2cc25 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:01.685535 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee156acc-e919-4faf-a549-a52923f2cc25 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:01.686808 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee156acc-e919-4faf-a549-a52923f2cc25 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:01.687396 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee156acc-e919-4faf-a549-a52923f2cc25 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:01.688082 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee156acc-e919-4faf-a549-a52923f2cc25 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:02.074172 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ee156acc-e919-4faf-a549-a52923f2cc25 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:02.088795 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ee156acc-e919-4faf-a549-a52923f2cc25 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1670 microversion: 2.1 time: 0.436400 Oct 30 01:41:02.098479 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2651/5322] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:41:01 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1670 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:41:02.125356 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e3dc51f6-75e0-43ed-a870-7ff1b63aa227 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-2130735166"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:41:02.128244 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e3dc51f6-75e0-43ed-a870-7ff1b63aa227 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:02.138883 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e3dc51f6-75e0-43ed-a870-7ff1b63aa227 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:02.151188 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e3dc51f6-75e0-43ed-a870-7ff1b63aa227 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:02.154608 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e3dc51f6-75e0-43ed-a870-7ff1b63aa227 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:02.154608 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e3dc51f6-75e0-43ed-a870-7ff1b63aa227 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:02.154608 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e3dc51f6-75e0-43ed-a870-7ff1b63aa227 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:02.154608 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e3dc51f6-75e0-43ed-a870-7ff1b63aa227 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:02.342988 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:41:02.515146 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1c97b4d3-3e45-447f-9276-1580f4742a70 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "POST /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.177790 Oct 30 01:41:02.516462 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2672/5323] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 30 01:41:01 2022] POST /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012/os-volume_attachments => generated 194 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:41:02.690004 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-86c6cc4a-d3cd-4320-bb74-84a3101d224a tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:02.691613 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-86c6cc4a-d3cd-4320-bb74-84a3101d224a tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] [instance: dc7864af-b7df-4d34-8e1d-ebb956a8212b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:02.696754 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:41:02.718857 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-86c6cc4a-d3cd-4320-bb74-84a3101d224a tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:02.719385 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-86c6cc4a-d3cd-4320-bb74-84a3101d224a tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:02.719833 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-86c6cc4a-d3cd-4320-bb74-84a3101d224a tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:02.720570 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-86c6cc4a-d3cd-4320-bb74-84a3101d224a tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:02.721036 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-86c6cc4a-d3cd-4320-bb74-84a3101d224a tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:02.731014 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-86c6cc4a-d3cd-4320-bb74-84a3101d224a tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:02.807455 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e3dc51f6-75e0-43ed-a870-7ff1b63aa227 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "POST /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9/action" status: 202 len: 0 microversion: 2.1 time: 0.687594 Oct 30 01:41:02.814905 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2652/5324] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:41:02 2022] POST /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9/action => generated 0 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Oct 30 01:41:02.832652 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-d26865f2-7f26-40c1-945f-70d6b52a45cd req-a9839567-f985-4b23-acde-2cff78fa3f12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc7864af-b7df-4d34-8e1d-ebb956a8212b", "tag": "ff510152-299e-4eed-b519-796b0ea6b243"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:41:02.866985 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-d26865f2-7f26-40c1-945f-70d6b52a45cd req-a9839567-f985-4b23-acde-2cff78fa3f12 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:02.869600 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-d26865f2-7f26-40c1-945f-70d6b52a45cd req-a9839567-f985-4b23-acde-2cff78fa3f12 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:02.870683 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-d26865f2-7f26-40c1-945f-70d6b52a45cd req-a9839567-f985-4b23-acde-2cff78fa3f12 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:02.936713 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-d26865f2-7f26-40c1-945f-70d6b52a45cd req-a9839567-f985-4b23-acde-2cff78fa3f12 service nova] Creating event network-changed:ff510152-299e-4eed-b519-796b0ea6b243 for instance dc7864af-b7df-4d34-8e1d-ebb956a8212b on n-h2-master-1 Oct 30 01:41:02.943992 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-d26865f2-7f26-40c1-945f-70d6b52a45cd req-a9839567-f985-4b23-acde-2cff78fa3f12 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124399 Oct 30 01:41:02.953159 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2653/5325] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:41:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:41:03.365710 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-86c6cc4a-d3cd-4320-bb74-84a3101d224a tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea515c9dbf645828f6f67c9f6bbc541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8512b08f05db4a469827368f47fb4c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:03.381261 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-86c6cc4a-d3cd-4320-bb74-84a3101d224a tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] 10.222.0.13 "GET /compute/v2.1/servers/dc7864af-b7df-4d34-8e1d-ebb956a8212b" status: 200 len: 1314 microversion: 2.1 time: 0.701306 Oct 30 01:41:03.381261 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2673/5326] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:41:02 2022] GET /compute/v2.1/servers/dc7864af-b7df-4d34-8e1d-ebb956a8212b => generated 1314 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:41:04.401362 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:41:04.402323 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=6 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:41:04.407638 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4c2013e2-0b75-436f-a9ef-c3fa9c0bb27b tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:04.408350 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4c2013e2-0b75-436f-a9ef-c3fa9c0bb27b tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] [instance: dc7864af-b7df-4d34-8e1d-ebb956a8212b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:04.425634 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4c2013e2-0b75-436f-a9ef-c3fa9c0bb27b tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:04.428236 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4c2013e2-0b75-436f-a9ef-c3fa9c0bb27b tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:04.428690 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4c2013e2-0b75-436f-a9ef-c3fa9c0bb27b tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:04.429553 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4c2013e2-0b75-436f-a9ef-c3fa9c0bb27b tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:04.430064 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4c2013e2-0b75-436f-a9ef-c3fa9c0bb27b tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:04.430496 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4c2013e2-0b75-436f-a9ef-c3fa9c0bb27b tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:04.612804 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4c2013e2-0b75-436f-a9ef-c3fa9c0bb27b tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea515c9dbf645828f6f67c9f6bbc541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8512b08f05db4a469827368f47fb4c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:04.622481 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4c2013e2-0b75-436f-a9ef-c3fa9c0bb27b tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] 10.222.0.13 "GET /compute/v2.1/servers/dc7864af-b7df-4d34-8e1d-ebb956a8212b" status: 200 len: 1314 microversion: 2.1 time: 0.222020 Oct 30 01:41:04.623661 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2654/5327] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:41:04 2022] GET /compute/v2.1/servers/dc7864af-b7df-4d34-8e1d-ebb956a8212b => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:41:05.646785 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b8648934-7393-4e44-a2af-01780ade55b2 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:05.648040 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b8648934-7393-4e44-a2af-01780ade55b2 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] [instance: dc7864af-b7df-4d34-8e1d-ebb956a8212b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:05.650992 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=4 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:41:05.675599 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b8648934-7393-4e44-a2af-01780ade55b2 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:05.675599 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b8648934-7393-4e44-a2af-01780ade55b2 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:05.675599 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b8648934-7393-4e44-a2af-01780ade55b2 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:05.675599 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b8648934-7393-4e44-a2af-01780ade55b2 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:05.675599 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b8648934-7393-4e44-a2af-01780ade55b2 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:05.675599 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b8648934-7393-4e44-a2af-01780ade55b2 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:06.125214 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b8648934-7393-4e44-a2af-01780ade55b2 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea515c9dbf645828f6f67c9f6bbc541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8512b08f05db4a469827368f47fb4c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:06.136609 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b8648934-7393-4e44-a2af-01780ade55b2 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] 10.222.0.13 "GET /compute/v2.1/servers/dc7864af-b7df-4d34-8e1d-ebb956a8212b" status: 200 len: 1314 microversion: 2.1 time: 0.494317 Oct 30 01:41:06.140545 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2674/5328] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:41:05 2022] GET /compute/v2.1/servers/dc7864af-b7df-4d34-8e1d-ebb956a8212b => generated 1314 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:41:07.161260 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5ae9563b-4bf8-4213-9e2e-3878de592eb8 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:07.162211 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5ae9563b-4bf8-4213-9e2e-3878de592eb8 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] [instance: dc7864af-b7df-4d34-8e1d-ebb956a8212b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:07.169843 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5ae9563b-4bf8-4213-9e2e-3878de592eb8 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:07.170416 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5ae9563b-4bf8-4213-9e2e-3878de592eb8 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:07.171153 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5ae9563b-4bf8-4213-9e2e-3878de592eb8 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:07.172632 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5ae9563b-4bf8-4213-9e2e-3878de592eb8 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:07.173160 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5ae9563b-4bf8-4213-9e2e-3878de592eb8 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:07.173616 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5ae9563b-4bf8-4213-9e2e-3878de592eb8 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:07.640155 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5ae9563b-4bf8-4213-9e2e-3878de592eb8 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea515c9dbf645828f6f67c9f6bbc541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8512b08f05db4a469827368f47fb4c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:07.653012 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5ae9563b-4bf8-4213-9e2e-3878de592eb8 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] 10.222.0.13 "GET /compute/v2.1/servers/dc7864af-b7df-4d34-8e1d-ebb956a8212b" status: 200 len: 1314 microversion: 2.1 time: 0.497706 Oct 30 01:41:07.655868 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2655/5329] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:41:07 2022] GET /compute/v2.1/servers/dc7864af-b7df-4d34-8e1d-ebb956a8212b => generated 1314 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:41:08.683940 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4651f035-d7cb-4e8c-8cdd-34690ccae624 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:08.687045 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4651f035-d7cb-4e8c-8cdd-34690ccae624 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] [instance: dc7864af-b7df-4d34-8e1d-ebb956a8212b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:08.704017 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4651f035-d7cb-4e8c-8cdd-34690ccae624 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:08.704518 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4651f035-d7cb-4e8c-8cdd-34690ccae624 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:08.704954 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4651f035-d7cb-4e8c-8cdd-34690ccae624 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:08.710541 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4651f035-d7cb-4e8c-8cdd-34690ccae624 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:08.711032 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4651f035-d7cb-4e8c-8cdd-34690ccae624 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:08.711470 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4651f035-d7cb-4e8c-8cdd-34690ccae624 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:08.877508 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-b872a0cd-eeb5-4faa-bd84-305eb38c3a5f req-f83e7011-e840-4adf-8bfb-b7334dafb9ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0f03664-8785-4321-b32e-3622f1b747b9", "name": "network-vif-plugged", "status": "completed", "tag": "63c1537a-0706-49b0-8e88-a5c62f4ffbe3"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:41:08.908342 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-b872a0cd-eeb5-4faa-bd84-305eb38c3a5f req-f83e7011-e840-4adf-8bfb-b7334dafb9ab service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:08.917911 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-b872a0cd-eeb5-4faa-bd84-305eb38c3a5f req-f83e7011-e840-4adf-8bfb-b7334dafb9ab service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:08.925944 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-b872a0cd-eeb5-4faa-bd84-305eb38c3a5f req-f83e7011-e840-4adf-8bfb-b7334dafb9ab service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:08.965836 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-b872a0cd-eeb5-4faa-bd84-305eb38c3a5f req-f83e7011-e840-4adf-8bfb-b7334dafb9ab service nova] Creating event network-vif-plugged:63c1537a-0706-49b0-8e88-a5c62f4ffbe3 for instance b0f03664-8785-4321-b32e-3622f1b747b9 on n-h2-master-1 Oct 30 01:41:08.990722 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-b872a0cd-eeb5-4faa-bd84-305eb38c3a5f req-f83e7011-e840-4adf-8bfb-b7334dafb9ab service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114152 Oct 30 01:41:08.995055 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2656/5330] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:41:09.028358 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4651f035-d7cb-4e8c-8cdd-34690ccae624 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea515c9dbf645828f6f67c9f6bbc541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8512b08f05db4a469827368f47fb4c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:09.046034 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4651f035-d7cb-4e8c-8cdd-34690ccae624 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] 10.222.0.13 "GET /compute/v2.1/servers/dc7864af-b7df-4d34-8e1d-ebb956a8212b" status: 200 len: 1314 microversion: 2.1 time: 0.368349 Oct 30 01:41:09.061573 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2675/5331] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:41:08 2022] GET /compute/v2.1/servers/dc7864af-b7df-4d34-8e1d-ebb956a8212b => generated 1314 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:41:10.075220 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-727516df-e853-4900-b6f1-4c2199246262 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:10.076659 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-727516df-e853-4900-b6f1-4c2199246262 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] [instance: dc7864af-b7df-4d34-8e1d-ebb956a8212b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:10.098393 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-727516df-e853-4900-b6f1-4c2199246262 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:10.098832 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-727516df-e853-4900-b6f1-4c2199246262 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:10.099262 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-727516df-e853-4900-b6f1-4c2199246262 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:10.100147 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-727516df-e853-4900-b6f1-4c2199246262 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:10.105431 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-727516df-e853-4900-b6f1-4c2199246262 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:10.106139 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-727516df-e853-4900-b6f1-4c2199246262 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:10.307128 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-727516df-e853-4900-b6f1-4c2199246262 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea515c9dbf645828f6f67c9f6bbc541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8512b08f05db4a469827368f47fb4c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:10.322360 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-727516df-e853-4900-b6f1-4c2199246262 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] 10.222.0.13 "GET /compute/v2.1/servers/dc7864af-b7df-4d34-8e1d-ebb956a8212b" status: 200 len: 1314 microversion: 2.1 time: 0.251920 Oct 30 01:41:10.323702 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2657/5332] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:41:10 2022] GET /compute/v2.1/servers/dc7864af-b7df-4d34-8e1d-ebb956a8212b => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:41:11.347719 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2922fdba-d53e-4af3-af28-ac9645990669 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:11.349593 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2922fdba-d53e-4af3-af28-ac9645990669 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] [instance: dc7864af-b7df-4d34-8e1d-ebb956a8212b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:11.374705 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2922fdba-d53e-4af3-af28-ac9645990669 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:11.376689 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2922fdba-d53e-4af3-af28-ac9645990669 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:11.378787 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2922fdba-d53e-4af3-af28-ac9645990669 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:11.380337 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2922fdba-d53e-4af3-af28-ac9645990669 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:11.381411 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2922fdba-d53e-4af3-af28-ac9645990669 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:11.382068 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2922fdba-d53e-4af3-af28-ac9645990669 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:11.633031 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2922fdba-d53e-4af3-af28-ac9645990669 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea515c9dbf645828f6f67c9f6bbc541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8512b08f05db4a469827368f47fb4c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:11.659031 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2922fdba-d53e-4af3-af28-ac9645990669 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] 10.222.0.13 "GET /compute/v2.1/servers/dc7864af-b7df-4d34-8e1d-ebb956a8212b" status: 200 len: 1314 microversion: 2.1 time: 0.316218 Oct 30 01:41:11.660350 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2676/5333] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:41:11 2022] GET /compute/v2.1/servers/dc7864af-b7df-4d34-8e1d-ebb956a8212b => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:41:12.687316 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d2350fd8-36ea-4000-90b1-1541f9d9da92 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:12.689308 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d2350fd8-36ea-4000-90b1-1541f9d9da92 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] [instance: dc7864af-b7df-4d34-8e1d-ebb956a8212b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:12.714507 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2350fd8-36ea-4000-90b1-1541f9d9da92 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:12.715334 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2350fd8-36ea-4000-90b1-1541f9d9da92 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:12.719621 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2350fd8-36ea-4000-90b1-1541f9d9da92 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:12.719621 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2350fd8-36ea-4000-90b1-1541f9d9da92 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:12.720263 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2350fd8-36ea-4000-90b1-1541f9d9da92 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:12.721104 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2350fd8-36ea-4000-90b1-1541f9d9da92 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:13.349459 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d2350fd8-36ea-4000-90b1-1541f9d9da92 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea515c9dbf645828f6f67c9f6bbc541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8512b08f05db4a469827368f47fb4c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:13.361260 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d2350fd8-36ea-4000-90b1-1541f9d9da92 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] 10.222.0.13 "GET /compute/v2.1/servers/dc7864af-b7df-4d34-8e1d-ebb956a8212b" status: 200 len: 1314 microversion: 2.1 time: 0.678147 Oct 30 01:41:13.381406 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2658/5334] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:41:12 2022] GET /compute/v2.1/servers/dc7864af-b7df-4d34-8e1d-ebb956a8212b => generated 1314 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:41:13.521802 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-3d53dad8-6341-4b23-9dd2-d77e2aece82a req-d1c83c95-59e0-4847-8667-45c123a88acc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc7864af-b7df-4d34-8e1d-ebb956a8212b", "name": "network-vif-plugged", "status": "completed", "tag": "ff510152-299e-4eed-b519-796b0ea6b243"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:41:13.624422 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-3d53dad8-6341-4b23-9dd2-d77e2aece82a req-d1c83c95-59e0-4847-8667-45c123a88acc service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:13.634041 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-3d53dad8-6341-4b23-9dd2-d77e2aece82a req-d1c83c95-59e0-4847-8667-45c123a88acc service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:13.635832 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-3d53dad8-6341-4b23-9dd2-d77e2aece82a req-d1c83c95-59e0-4847-8667-45c123a88acc service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:13.679747 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-3d53dad8-6341-4b23-9dd2-d77e2aece82a req-d1c83c95-59e0-4847-8667-45c123a88acc service nova] Creating event network-vif-plugged:ff510152-299e-4eed-b519-796b0ea6b243 for instance dc7864af-b7df-4d34-8e1d-ebb956a8212b on n-h2-master-1 Oct 30 01:41:13.700330 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-3d53dad8-6341-4b23-9dd2-d77e2aece82a req-d1c83c95-59e0-4847-8667-45c123a88acc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.181895 Oct 30 01:41:13.701261 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2677/5335] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:41:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:41:14.397905 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2a701cae-d67e-4fca-9864-d80d2f496c7c tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:14.399628 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2a701cae-d67e-4fca-9864-d80d2f496c7c tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] [instance: dc7864af-b7df-4d34-8e1d-ebb956a8212b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:14.441258 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a701cae-d67e-4fca-9864-d80d2f496c7c tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:14.447198 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a701cae-d67e-4fca-9864-d80d2f496c7c tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:14.449345 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a701cae-d67e-4fca-9864-d80d2f496c7c tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:14.451816 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a701cae-d67e-4fca-9864-d80d2f496c7c tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:14.454576 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a701cae-d67e-4fca-9864-d80d2f496c7c tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:14.457633 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a701cae-d67e-4fca-9864-d80d2f496c7c tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:14.536458 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:41:14.855885 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2a701cae-d67e-4fca-9864-d80d2f496c7c tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea515c9dbf645828f6f67c9f6bbc541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8512b08f05db4a469827368f47fb4c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:14.870192 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2a701cae-d67e-4fca-9864-d80d2f496c7c tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] 10.222.0.13 "GET /compute/v2.1/servers/dc7864af-b7df-4d34-8e1d-ebb956a8212b" status: 200 len: 1314 microversion: 2.1 time: 0.481960 Oct 30 01:41:14.874321 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2659/5336] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:41:14 2022] GET /compute/v2.1/servers/dc7864af-b7df-4d34-8e1d-ebb956a8212b => generated 1314 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:41:15.923579 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a84e6921-1e29-447d-a38b-e37e71ceec19 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:15.926077 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a84e6921-1e29-447d-a38b-e37e71ceec19 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] [instance: dc7864af-b7df-4d34-8e1d-ebb956a8212b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:15.945669 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a84e6921-1e29-447d-a38b-e37e71ceec19 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:15.946601 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a84e6921-1e29-447d-a38b-e37e71ceec19 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:15.947250 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a84e6921-1e29-447d-a38b-e37e71ceec19 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:15.948243 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a84e6921-1e29-447d-a38b-e37e71ceec19 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:15.949069 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a84e6921-1e29-447d-a38b-e37e71ceec19 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:15.950755 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a84e6921-1e29-447d-a38b-e37e71ceec19 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:16.140447 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a84e6921-1e29-447d-a38b-e37e71ceec19 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea515c9dbf645828f6f67c9f6bbc541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8512b08f05db4a469827368f47fb4c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:16.148400 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a84e6921-1e29-447d-a38b-e37e71ceec19 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] 10.222.0.13 "GET /compute/v2.1/servers/dc7864af-b7df-4d34-8e1d-ebb956a8212b" status: 200 len: 1497 microversion: 2.1 time: 0.237068 Oct 30 01:41:16.149000 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2678/5337] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:41:15 2022] GET /compute/v2.1/servers/dc7864af-b7df-4d34-8e1d-ebb956a8212b => generated 1497 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:41:17.503528 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-47c9c5db-90d6-4c73-8007-3ad2223a903a tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:17.504596 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-47c9c5db-90d6-4c73-8007-3ad2223a903a tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] [instance: dc7864af-b7df-4d34-8e1d-ebb956a8212b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:17.524000 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-47c9c5db-90d6-4c73-8007-3ad2223a903a tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:17.527399 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-47c9c5db-90d6-4c73-8007-3ad2223a903a tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:17.530529 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-47c9c5db-90d6-4c73-8007-3ad2223a903a tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:17.531488 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-47c9c5db-90d6-4c73-8007-3ad2223a903a tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:17.534261 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-47c9c5db-90d6-4c73-8007-3ad2223a903a tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:17.535089 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-47c9c5db-90d6-4c73-8007-3ad2223a903a tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:17.605259 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-47c9c5db-90d6-4c73-8007-3ad2223a903a tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] [instance: dc7864af-b7df-4d34-8e1d-ebb956a8212b] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:41:18.042009 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-47c9c5db-90d6-4c73-8007-3ad2223a903a tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] 10.222.0.13 "DELETE /compute/v2.1/servers/dc7864af-b7df-4d34-8e1d-ebb956a8212b" status: 204 len: 0 microversion: 2.1 time: 0.543632 Oct 30 01:41:18.046127 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2660/5338] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:41:17 2022] DELETE /compute/v2.1/servers/dc7864af-b7df-4d34-8e1d-ebb956a8212b => generated 0 bytes in 545 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:41:18.052255 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2f094b47-d8c1-4763-8879-236132f068eb tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:18.052890 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2f094b47-d8c1-4763-8879-236132f068eb tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] [instance: dc7864af-b7df-4d34-8e1d-ebb956a8212b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:18.075181 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f094b47-d8c1-4763-8879-236132f068eb tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:18.076093 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f094b47-d8c1-4763-8879-236132f068eb tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:18.082683 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f094b47-d8c1-4763-8879-236132f068eb tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:18.085937 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f094b47-d8c1-4763-8879-236132f068eb tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:18.086655 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f094b47-d8c1-4763-8879-236132f068eb tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:18.094190 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f094b47-d8c1-4763-8879-236132f068eb tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:18.485934 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2f094b47-d8c1-4763-8879-236132f068eb tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea515c9dbf645828f6f67c9f6bbc541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8512b08f05db4a469827368f47fb4c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:18.499726 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2f094b47-d8c1-4763-8879-236132f068eb tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] 10.222.0.13 "GET /compute/v2.1/servers/dc7864af-b7df-4d34-8e1d-ebb956a8212b" status: 200 len: 1503 microversion: 2.1 time: 0.452427 Oct 30 01:41:18.501210 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2679/5339] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:41:18 2022] GET /compute/v2.1/servers/dc7864af-b7df-4d34-8e1d-ebb956a8212b => generated 1503 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:41:19.528832 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-59cfe888-3939-4120-8e60-072856f32af5 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:19.530591 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-59cfe888-3939-4120-8e60-072856f32af5 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] [instance: dc7864af-b7df-4d34-8e1d-ebb956a8212b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:19.554229 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-59cfe888-3939-4120-8e60-072856f32af5 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:19.555167 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-59cfe888-3939-4120-8e60-072856f32af5 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:19.561164 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-59cfe888-3939-4120-8e60-072856f32af5 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:19.561164 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-59cfe888-3939-4120-8e60-072856f32af5 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:19.561164 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-59cfe888-3939-4120-8e60-072856f32af5 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:19.561164 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-59cfe888-3939-4120-8e60-072856f32af5 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:20.036415 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-59cfe888-3939-4120-8e60-072856f32af5 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea515c9dbf645828f6f67c9f6bbc541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8512b08f05db4a469827368f47fb4c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:20.066838 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-59cfe888-3939-4120-8e60-072856f32af5 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] 10.222.0.13 "GET /compute/v2.1/servers/dc7864af-b7df-4d34-8e1d-ebb956a8212b" status: 200 len: 1503 microversion: 2.1 time: 0.543754 Oct 30 01:41:20.067460 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2661/5340] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:41:19 2022] GET /compute/v2.1/servers/dc7864af-b7df-4d34-8e1d-ebb956a8212b => generated 1503 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:41:20.739131 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-339c4aeb-a4a3-4f11-9006-44c70993ce73 req-c4915191-ff79-4afc-aef7-bec62b858c97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc7864af-b7df-4d34-8e1d-ebb956a8212b", "name": "network-vif-deleted", "tag": "ff510152-299e-4eed-b519-796b0ea6b243"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:41:20.759912 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-339c4aeb-a4a3-4f11-9006-44c70993ce73 req-c4915191-ff79-4afc-aef7-bec62b858c97 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:20.765032 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-339c4aeb-a4a3-4f11-9006-44c70993ce73 req-c4915191-ff79-4afc-aef7-bec62b858c97 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:20.765784 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-339c4aeb-a4a3-4f11-9006-44c70993ce73 req-c4915191-ff79-4afc-aef7-bec62b858c97 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:20.805126 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-339c4aeb-a4a3-4f11-9006-44c70993ce73 req-c4915191-ff79-4afc-aef7-bec62b858c97 service nova] Creating event network-vif-deleted:ff510152-299e-4eed-b519-796b0ea6b243 for instance dc7864af-b7df-4d34-8e1d-ebb956a8212b on n-h2-master-1 Oct 30 01:41:20.822857 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-339c4aeb-a4a3-4f11-9006-44c70993ce73 req-c4915191-ff79-4afc-aef7-bec62b858c97 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087933 Oct 30 01:41:20.829774 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2680/5341] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:41:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:41:21.098045 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2507a347-baa1-484c-bb26-5206edecc0ab tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:21.099237 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2507a347-baa1-484c-bb26-5206edecc0ab tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] [instance: dc7864af-b7df-4d34-8e1d-ebb956a8212b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:21.110938 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2507a347-baa1-484c-bb26-5206edecc0ab tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:21.114250 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2507a347-baa1-484c-bb26-5206edecc0ab tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:21.114838 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2507a347-baa1-484c-bb26-5206edecc0ab tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:21.115721 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2507a347-baa1-484c-bb26-5206edecc0ab tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:21.118727 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2507a347-baa1-484c-bb26-5206edecc0ab tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:21.119350 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2507a347-baa1-484c-bb26-5206edecc0ab tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:21.311166 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2507a347-baa1-484c-bb26-5206edecc0ab tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea515c9dbf645828f6f67c9f6bbc541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8512b08f05db4a469827368f47fb4c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:21.324389 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2507a347-baa1-484c-bb26-5206edecc0ab tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] 10.222.0.13 "GET /compute/v2.1/servers/dc7864af-b7df-4d34-8e1d-ebb956a8212b" status: 200 len: 1299 microversion: 2.1 time: 0.234047 Oct 30 01:41:21.348296 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2662/5342] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:41:21 2022] GET /compute/v2.1/servers/dc7864af-b7df-4d34-8e1d-ebb956a8212b => generated 1299 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:41:22.193130 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-88e160f2-8eea-4b23-b7a2-46eaf9f98fce tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:22.206746 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-88e160f2-8eea-4b23-b7a2-46eaf9f98fce tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 2435fb0b-ab56-4368-9965-245b3574d012] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:22.233690 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-88e160f2-8eea-4b23-b7a2-46eaf9f98fce tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:22.244297 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-88e160f2-8eea-4b23-b7a2-46eaf9f98fce tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:22.244297 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-88e160f2-8eea-4b23-b7a2-46eaf9f98fce tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:22.244297 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-88e160f2-8eea-4b23-b7a2-46eaf9f98fce tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:22.244297 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-88e160f2-8eea-4b23-b7a2-46eaf9f98fce tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:22.244653 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-88e160f2-8eea-4b23-b7a2-46eaf9f98fce tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:22.312255 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-88e160f2-8eea-4b23-b7a2-46eaf9f98fce tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.125190 Oct 30 01:41:22.313751 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2681/5343] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 01:41:22 2022] GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012/os-volume_attachments => generated 371 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:41:22.355304 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f512b880-a32a-4310-9c46-07c30ca17f9d tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:22.356479 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f512b880-a32a-4310-9c46-07c30ca17f9d tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] [instance: dc7864af-b7df-4d34-8e1d-ebb956a8212b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:22.394358 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f512b880-a32a-4310-9c46-07c30ca17f9d tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:22.394966 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f512b880-a32a-4310-9c46-07c30ca17f9d tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:22.395530 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f512b880-a32a-4310-9c46-07c30ca17f9d tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:22.398500 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f512b880-a32a-4310-9c46-07c30ca17f9d tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:22.399069 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f512b880-a32a-4310-9c46-07c30ca17f9d tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:22.405616 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f512b880-a32a-4310-9c46-07c30ca17f9d tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:22.462017 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-00b47a76-2c1a-49f4-8b57-41661be41807 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:22.463366 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-00b47a76-2c1a-49f4-8b57-41661be41807 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 2435fb0b-ab56-4368-9965-245b3574d012] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:22.477715 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-00b47a76-2c1a-49f4-8b57-41661be41807 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:22.478509 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-00b47a76-2c1a-49f4-8b57-41661be41807 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:22.488123 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-00b47a76-2c1a-49f4-8b57-41661be41807 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:22.489193 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-00b47a76-2c1a-49f4-8b57-41661be41807 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:22.490634 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-00b47a76-2c1a-49f4-8b57-41661be41807 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:22.492603 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-00b47a76-2c1a-49f4-8b57-41661be41807 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:22.543637 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f512b880-a32a-4310-9c46-07c30ca17f9d tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:22.544106 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f512b880-a32a-4310-9c46-07c30ca17f9d tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:22.549931 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f512b880-a32a-4310-9c46-07c30ca17f9d tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:22.550410 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-f512b880-a32a-4310-9c46-07c30ca17f9d tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lazy-loading 'fault' on Instance uuid dc7864af-b7df-4d34-8e1d-ebb956a8212b {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:41:22.550653 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-00b47a76-2c1a-49f4-8b57-41661be41807 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012/os-volume_attachments/4f006fb8-3196-4e4c-91b5-e7c20f5662cb" status: 200 len: 194 microversion: 2.1 time: 0.092821 Oct 30 01:41:22.557749 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2682/5344] 10.222.0.13 () {58 vars in 1413 bytes} [Sun Oct 30 01:41:22 2022] GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012/os-volume_attachments/4f006fb8-3196-4e4c-91b5-e7c20f5662cb => generated 194 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:41:22.567362 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-75b82ace-3f29-4386-b80f-731a073a0d15 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:22.567871 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-75b82ace-3f29-4386-b80f-731a073a0d15 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 2435fb0b-ab56-4368-9965-245b3574d012] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:22.583980 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-75b82ace-3f29-4386-b80f-731a073a0d15 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:22.583980 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-75b82ace-3f29-4386-b80f-731a073a0d15 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:22.583980 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-75b82ace-3f29-4386-b80f-731a073a0d15 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:22.583980 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-75b82ace-3f29-4386-b80f-731a073a0d15 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:22.583980 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-75b82ace-3f29-4386-b80f-731a073a0d15 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:22.583980 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-75b82ace-3f29-4386-b80f-731a073a0d15 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:22.644844 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f512b880-a32a-4310-9c46-07c30ca17f9d tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea515c9dbf645828f6f67c9f6bbc541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8512b08f05db4a469827368f47fb4c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:22.660047 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f512b880-a32a-4310-9c46-07c30ca17f9d tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] 10.222.0.13 "GET /compute/v2.1/servers/dc7864af-b7df-4d34-8e1d-ebb956a8212b" status: 200 len: 1304 microversion: 2.1 time: 0.309308 Oct 30 01:41:22.660652 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2663/5345] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:41:22 2022] GET /compute/v2.1/servers/dc7864af-b7df-4d34-8e1d-ebb956a8212b => generated 1304 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:41:22.757928 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-75b82ace-3f29-4386-b80f-731a073a0d15 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lazy-loading 'services' on Instance uuid 2435fb0b-ab56-4368-9965-245b3574d012 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:41:23.061576 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-75b82ace-3f29-4386-b80f-731a073a0d15 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012/os-volume_attachments/4f006fb8-3196-4e4c-91b5-e7c20f5662cb" status: 202 len: 0 microversion: 2.1 time: 0.501889 Oct 30 01:41:23.062795 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2683/5346] 10.222.0.13 () {58 vars in 1416 bytes} [Sun Oct 30 01:41:22 2022] DELETE /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012/os-volume_attachments/4f006fb8-3196-4e4c-91b5-e7c20f5662cb => generated 0 bytes in 504 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:41:23.685557 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ad11e9ab-9f51-45a5-9f2b-1dc5e3ce3be5 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:23.686385 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ad11e9ab-9f51-45a5-9f2b-1dc5e3ce3be5 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] [instance: dc7864af-b7df-4d34-8e1d-ebb956a8212b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:23.695324 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ad11e9ab-9f51-45a5-9f2b-1dc5e3ce3be5 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:23.695782 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ad11e9ab-9f51-45a5-9f2b-1dc5e3ce3be5 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:23.696282 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ad11e9ab-9f51-45a5-9f2b-1dc5e3ce3be5 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:23.696926 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ad11e9ab-9f51-45a5-9f2b-1dc5e3ce3be5 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:23.697403 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ad11e9ab-9f51-45a5-9f2b-1dc5e3ce3be5 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:23.697799 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ad11e9ab-9f51-45a5-9f2b-1dc5e3ce3be5 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:23.715436 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-ad11e9ab-9f51-45a5-9f2b-1dc5e3ce3be5 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] HTTP exception thrown: Instance dc7864af-b7df-4d34-8e1d-ebb956a8212b could not be found. Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ad11e9ab-9f51-45a5-9f2b-1dc5e3ce3be5 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Request method failure captured: Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/dc7864af-b7df-4d34-8e1d-ebb956a8212b HTTP/1.1 Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdYgEmU9mU7LCiDO7MF-4Rbmzw0xFEkr7F9ltwnm7BOuuiQ8Cj6JsDEfoC2LfKhzOyAS8eMeo7RpTc6Ce7A53M3HsNDuyF_9YrxoTorP5I9gVlLD9Qrn9HalbXDNZeBcxTOG0VHRDt0-93AZeSlKwMsc_bvATRCxpsEvcw-lP5HTLj8 Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 8512b08f05db4a469827368f47fb4c28 Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-VolumesActionsTest-1713780720 Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8512b08f05db4a469827368f47fb4c28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8512b08f05db4a469827368f47fb4c28"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8512b08f05db4a469827368f47fb4c28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8512b08f05db4a469827368f47fb4c28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-VolumesActionsTest-1713780720 Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 8512b08f05db4a469827368f47fb4c28 Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-VolumesActionsTest-1713780720 Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-VolumesActionsTest-1713780720-project Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 2ea515c9dbf645828f6f67c9f6bbc541 Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-VolumesActionsTest-1713780720-project Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: exception: Instance dc7864af-b7df-4d34-8e1d-ebb956a8212b could not be found. Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'dc7864af-b7df-4d34-8e1d-ebb956a8212b'} Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc7864af-b7df-4d34-8e1d-ebb956a8212b could not be found. Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc7864af-b7df-4d34-8e1d-ebb956a8212b could not be found. Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:41:23.717673 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:41:23.724932 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:41:23.724932 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:41:23.724932 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:41:23.724932 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:41:23.724932 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:41:23.724932 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc7864af-b7df-4d34-8e1d-ebb956a8212b could not be found. Oct 30 01:41:23.724932 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:41:23.724932 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ad11e9ab-9f51-45a5-9f2b-1dc5e3ce3be5 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Returning 404 to user: Instance dc7864af-b7df-4d34-8e1d-ebb956a8212b could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:41:23.724932 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ad11e9ab-9f51-45a5-9f2b-1dc5e3ce3be5 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] 10.222.0.13 "GET /compute/v2.1/servers/dc7864af-b7df-4d34-8e1d-ebb956a8212b" status: 404 len: 111 microversion: 2.1 time: 0.037705 Oct 30 01:41:23.724932 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2664/5347] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:41:23 2022] GET /compute/v2.1/servers/dc7864af-b7df-4d34-8e1d-ebb956a8212b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:41:23.815650 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e31a47f8-cb63-4111-a2d7-55f0b26e0d2b tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1546582772", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "64d7eb4c-2007-41f2-bdc1-acd8dcc332ad"}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:41:23.896169 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-e31a47f8-cb63-4111-a2d7-55f0b26e0d2b tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] validate_networks() for [('64d7eb4c-2007-41f2-bdc1-acd8dcc332ad', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:41:24.590821 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-e31a47f8-cb63-4111-a2d7-55f0b26e0d2b tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:41:24.591243 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-e31a47f8-cb63-4111-a2d7-55f0b26e0d2b tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:41:24.591880 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-e31a47f8-cb63-4111-a2d7-55f0b26e0d2b tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:41:24.592447 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-e31a47f8-cb63-4111-a2d7-55f0b26e0d2b tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:41:24.593039 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-e31a47f8-cb63-4111-a2d7-55f0b26e0d2b tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:41:24.615237 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e31a47f8-cb63-4111-a2d7-55f0b26e0d2b tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:24.615999 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e31a47f8-cb63-4111-a2d7-55f0b26e0d2b tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:24.616651 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e31a47f8-cb63-4111-a2d7-55f0b26e0d2b tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:24.617618 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e31a47f8-cb63-4111-a2d7-55f0b26e0d2b tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:24.619617 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e31a47f8-cb63-4111-a2d7-55f0b26e0d2b tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:24.620254 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e31a47f8-cb63-4111-a2d7-55f0b26e0d2b tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:24.677268 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-e31a47f8-cb63-4111-a2d7-55f0b26e0d2b tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Getting quotas for project 8512b08f05db4a469827368f47fb4c28. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:41:24.691996 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-e31a47f8-cb63-4111-a2d7-55f0b26e0d2b tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Getting quotas for user 2ea515c9dbf645828f6f67c9f6bbc541 and project 8512b08f05db4a469827368f47fb4c28. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:41:24.730992 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e31a47f8-cb63-4111-a2d7-55f0b26e0d2b tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:41:24.741276 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e31a47f8-cb63-4111-a2d7-55f0b26e0d2b tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] [instance: 7d4bddd4-8e9c-49fe-9127-55fd56c151be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:41:25.012039 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e31a47f8-cb63-4111-a2d7-55f0b26e0d2b tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.201087 Oct 30 01:41:25.013505 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2684/5348] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:41:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1204 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:41:25.032470 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-08c15d19-68d9-4a1b-965c-977bfac64185 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:25.033259 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-08c15d19-68d9-4a1b-965c-977bfac64185 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] [instance: 7d4bddd4-8e9c-49fe-9127-55fd56c151be] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:25.157404 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-08c15d19-68d9-4a1b-965c-977bfac64185 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea515c9dbf645828f6f67c9f6bbc541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8512b08f05db4a469827368f47fb4c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:25.167707 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-08c15d19-68d9-4a1b-965c-977bfac64185 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] 10.222.0.13 "GET /compute/v2.1/servers/7d4bddd4-8e9c-49fe-9127-55fd56c151be" status: 200 len: 1214 microversion: 2.1 time: 0.141179 Oct 30 01:41:25.168283 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2665/5349] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:41:25 2022] GET /compute/v2.1/servers/7d4bddd4-8e9c-49fe-9127-55fd56c151be => generated 1214 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:41:26.194029 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-24edcb10-46de-47aa-a4b9-167076625ab2 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:26.195327 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-24edcb10-46de-47aa-a4b9-167076625ab2 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] [instance: 7d4bddd4-8e9c-49fe-9127-55fd56c151be] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:26.312498 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-24edcb10-46de-47aa-a4b9-167076625ab2 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea515c9dbf645828f6f67c9f6bbc541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8512b08f05db4a469827368f47fb4c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:26.324857 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-24edcb10-46de-47aa-a4b9-167076625ab2 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] 10.222.0.13 "GET /compute/v2.1/servers/7d4bddd4-8e9c-49fe-9127-55fd56c151be" status: 200 len: 1214 microversion: 2.1 time: 0.135318 Oct 30 01:41:26.346199 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2685/5350] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:41:26 2022] GET /compute/v2.1/servers/7d4bddd4-8e9c-49fe-9127-55fd56c151be => generated 1214 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:41:27.362990 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e4c40f11-4fb7-4510-8b2f-428f219858cd tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:27.364003 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e4c40f11-4fb7-4510-8b2f-428f219858cd tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] [instance: 7d4bddd4-8e9c-49fe-9127-55fd56c151be] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:27.382256 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:41:27.384079 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e4c40f11-4fb7-4510-8b2f-428f219858cd tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:27.384846 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e4c40f11-4fb7-4510-8b2f-428f219858cd tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:27.385664 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e4c40f11-4fb7-4510-8b2f-428f219858cd tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:27.386669 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e4c40f11-4fb7-4510-8b2f-428f219858cd tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:27.387504 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e4c40f11-4fb7-4510-8b2f-428f219858cd tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:27.388128 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e4c40f11-4fb7-4510-8b2f-428f219858cd tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:27.539802 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e4c40f11-4fb7-4510-8b2f-428f219858cd tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea515c9dbf645828f6f67c9f6bbc541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8512b08f05db4a469827368f47fb4c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:27.550091 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e4c40f11-4fb7-4510-8b2f-428f219858cd tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] 10.222.0.13 "GET /compute/v2.1/servers/7d4bddd4-8e9c-49fe-9127-55fd56c151be" status: 200 len: 1210 microversion: 2.1 time: 0.194615 Oct 30 01:41:27.551712 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2666/5351] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:41:27 2022] GET /compute/v2.1/servers/7d4bddd4-8e9c-49fe-9127-55fd56c151be => generated 1210 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:41:28.577702 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4e7f7e50-5e1b-4761-a59e-b5f088c67344 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:28.578846 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4e7f7e50-5e1b-4761-a59e-b5f088c67344 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] [instance: 7d4bddd4-8e9c-49fe-9127-55fd56c151be] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:28.598648 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4e7f7e50-5e1b-4761-a59e-b5f088c67344 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:28.599374 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4e7f7e50-5e1b-4761-a59e-b5f088c67344 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:28.599970 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4e7f7e50-5e1b-4761-a59e-b5f088c67344 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:28.600845 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4e7f7e50-5e1b-4761-a59e-b5f088c67344 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:28.601498 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4e7f7e50-5e1b-4761-a59e-b5f088c67344 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:28.602072 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4e7f7e50-5e1b-4761-a59e-b5f088c67344 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:28.773002 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4e7f7e50-5e1b-4761-a59e-b5f088c67344 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea515c9dbf645828f6f67c9f6bbc541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8512b08f05db4a469827368f47fb4c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:28.788972 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4e7f7e50-5e1b-4761-a59e-b5f088c67344 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] 10.222.0.13 "GET /compute/v2.1/servers/7d4bddd4-8e9c-49fe-9127-55fd56c151be" status: 200 len: 1274 microversion: 2.1 time: 0.214642 Oct 30 01:41:28.790016 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2686/5352] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:41:28 2022] GET /compute/v2.1/servers/7d4bddd4-8e9c-49fe-9127-55fd56c151be => generated 1274 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:41:29.827080 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-186c76c0-4eb2-4949-ac7e-f62eb1a112b9 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:29.827080 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-186c76c0-4eb2-4949-ac7e-f62eb1a112b9 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] [instance: 7d4bddd4-8e9c-49fe-9127-55fd56c151be] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:29.833288 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-186c76c0-4eb2-4949-ac7e-f62eb1a112b9 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:29.833826 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-186c76c0-4eb2-4949-ac7e-f62eb1a112b9 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:29.834266 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-186c76c0-4eb2-4949-ac7e-f62eb1a112b9 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:29.854230 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-186c76c0-4eb2-4949-ac7e-f62eb1a112b9 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:29.856859 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-186c76c0-4eb2-4949-ac7e-f62eb1a112b9 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:29.861641 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-186c76c0-4eb2-4949-ac7e-f62eb1a112b9 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:30.520974 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-186c76c0-4eb2-4949-ac7e-f62eb1a112b9 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea515c9dbf645828f6f67c9f6bbc541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8512b08f05db4a469827368f47fb4c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:30.533397 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-186c76c0-4eb2-4949-ac7e-f62eb1a112b9 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] 10.222.0.13 "GET /compute/v2.1/servers/7d4bddd4-8e9c-49fe-9127-55fd56c151be" status: 200 len: 1314 microversion: 2.1 time: 0.715847 Oct 30 01:41:30.535173 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2667/5353] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:41:29 2022] GET /compute/v2.1/servers/7d4bddd4-8e9c-49fe-9127-55fd56c151be => generated 1314 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:41:31.238971 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c51a88eb-d463-43b7-a5ff-058123bb0be6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:31.239681 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c51a88eb-d463-43b7-a5ff-058123bb0be6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:31.260326 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c51a88eb-d463-43b7-a5ff-058123bb0be6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:31.261891 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c51a88eb-d463-43b7-a5ff-058123bb0be6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:31.264868 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c51a88eb-d463-43b7-a5ff-058123bb0be6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:31.265756 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c51a88eb-d463-43b7-a5ff-058123bb0be6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:31.268027 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c51a88eb-d463-43b7-a5ff-058123bb0be6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:31.270246 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c51a88eb-d463-43b7-a5ff-058123bb0be6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:31.329566 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c51a88eb-d463-43b7-a5ff-058123bb0be6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d/ips" status: 200 len: 151 microversion: 2.20 time: 0.096301 Oct 30 01:41:31.331048 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2687/5354] 10.222.0.13 () {60 vars in 1289 bytes} [Sun Oct 30 01:41:31 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d/ips => generated 151 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:41:31.395223 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-beeaee23-307d-4a6d-a1b1-f283b1ecb490 req-5310e971-8c3d-4bc5-b9ec-22bcab48a225 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d4bddd4-8e9c-49fe-9127-55fd56c151be", "tag": "b28e2fc9-22cb-4732-a114-116ce70e3d6d"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:41:31.444295 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-beeaee23-307d-4a6d-a1b1-f283b1ecb490 req-5310e971-8c3d-4bc5-b9ec-22bcab48a225 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:31.444541 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-beeaee23-307d-4a6d-a1b1-f283b1ecb490 req-5310e971-8c3d-4bc5-b9ec-22bcab48a225 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:31.444865 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-beeaee23-307d-4a6d-a1b1-f283b1ecb490 req-5310e971-8c3d-4bc5-b9ec-22bcab48a225 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:31.474919 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-beeaee23-307d-4a6d-a1b1-f283b1ecb490 req-5310e971-8c3d-4bc5-b9ec-22bcab48a225 service nova] Creating event network-changed:b28e2fc9-22cb-4732-a114-116ce70e3d6d for instance 7d4bddd4-8e9c-49fe-9127-55fd56c151be on n-h2-master-1 Oct 30 01:41:31.483246 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-beeaee23-307d-4a6d-a1b1-f283b1ecb490 req-5310e971-8c3d-4bc5-b9ec-22bcab48a225 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092317 Oct 30 01:41:31.489592 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2668/5355] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:41:31.555979 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e2fb7906-c25c-465d-a080-b011b9df0f90 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:31.556596 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e2fb7906-c25c-465d-a080-b011b9df0f90 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] [instance: 7d4bddd4-8e9c-49fe-9127-55fd56c151be] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:31.570405 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2fb7906-c25c-465d-a080-b011b9df0f90 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:31.570840 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2fb7906-c25c-465d-a080-b011b9df0f90 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:31.571286 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2fb7906-c25c-465d-a080-b011b9df0f90 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:31.572003 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2fb7906-c25c-465d-a080-b011b9df0f90 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:31.572639 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2fb7906-c25c-465d-a080-b011b9df0f90 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:31.573216 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2fb7906-c25c-465d-a080-b011b9df0f90 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:32.056065 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e2fb7906-c25c-465d-a080-b011b9df0f90 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea515c9dbf645828f6f67c9f6bbc541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8512b08f05db4a469827368f47fb4c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:32.069997 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e2fb7906-c25c-465d-a080-b011b9df0f90 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] 10.222.0.13 "GET /compute/v2.1/servers/7d4bddd4-8e9c-49fe-9127-55fd56c151be" status: 200 len: 1314 microversion: 2.1 time: 0.515943 Oct 30 01:41:32.081551 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2688/5356] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:41:31 2022] GET /compute/v2.1/servers/7d4bddd4-8e9c-49fe-9127-55fd56c151be => generated 1314 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:41:32.260828 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-935829e1-ee4f-4c54-8b79-cd02a8ed30eb tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:32.264758 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-935829e1-ee4f-4c54-8b79-cd02a8ed30eb tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 2435fb0b-ab56-4368-9965-245b3574d012] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:32.282088 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-935829e1-ee4f-4c54-8b79-cd02a8ed30eb tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:32.282583 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-935829e1-ee4f-4c54-8b79-cd02a8ed30eb tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:32.301756 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-935829e1-ee4f-4c54-8b79-cd02a8ed30eb tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:32.302622 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-935829e1-ee4f-4c54-8b79-cd02a8ed30eb tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:32.307543 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-935829e1-ee4f-4c54-8b79-cd02a8ed30eb tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:32.308265 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-935829e1-ee4f-4c54-8b79-cd02a8ed30eb tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:32.450656 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-935829e1-ee4f-4c54-8b79-cd02a8ed30eb tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012/os-volume_attachments/8ea0d940-a965-4001-82ec-d8970a27be8d" status: 200 len: 194 microversion: 2.1 time: 0.200585 Oct 30 01:41:32.454866 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2669/5357] 10.222.0.13 () {58 vars in 1413 bytes} [Sun Oct 30 01:41:32 2022] GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012/os-volume_attachments/8ea0d940-a965-4001-82ec-d8970a27be8d => generated 194 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:41:32.465327 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-329da2cf-824e-40ba-a267-46f5c719f495 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:32.466682 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-329da2cf-824e-40ba-a267-46f5c719f495 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 2435fb0b-ab56-4368-9965-245b3574d012] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:32.478726 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-329da2cf-824e-40ba-a267-46f5c719f495 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:32.483474 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-329da2cf-824e-40ba-a267-46f5c719f495 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:32.484302 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-329da2cf-824e-40ba-a267-46f5c719f495 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:32.485211 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-329da2cf-824e-40ba-a267-46f5c719f495 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:32.487278 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-329da2cf-824e-40ba-a267-46f5c719f495 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:32.488165 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-329da2cf-824e-40ba-a267-46f5c719f495 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:32.668786 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-329da2cf-824e-40ba-a267-46f5c719f495 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lazy-loading 'services' on Instance uuid 2435fb0b-ab56-4368-9965-245b3574d012 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:41:32.998487 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-329da2cf-824e-40ba-a267-46f5c719f495 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012/os-volume_attachments/8ea0d940-a965-4001-82ec-d8970a27be8d" status: 202 len: 0 microversion: 2.1 time: 0.537108 Oct 30 01:41:33.001524 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2689/5358] 10.222.0.13 () {58 vars in 1416 bytes} [Sun Oct 30 01:41:32 2022] DELETE /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012/os-volume_attachments/8ea0d940-a965-4001-82ec-d8970a27be8d => generated 0 bytes in 541 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:41:33.118994 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ec7b48a0-fc85-40c7-a1f1-1ab57ef8a62a tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:33.119986 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ec7b48a0-fc85-40c7-a1f1-1ab57ef8a62a tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] [instance: 7d4bddd4-8e9c-49fe-9127-55fd56c151be] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:33.129527 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ec7b48a0-fc85-40c7-a1f1-1ab57ef8a62a tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:33.130190 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ec7b48a0-fc85-40c7-a1f1-1ab57ef8a62a tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:33.130794 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ec7b48a0-fc85-40c7-a1f1-1ab57ef8a62a tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:33.131826 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ec7b48a0-fc85-40c7-a1f1-1ab57ef8a62a tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:33.132548 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ec7b48a0-fc85-40c7-a1f1-1ab57ef8a62a tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:33.133121 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ec7b48a0-fc85-40c7-a1f1-1ab57ef8a62a tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:33.227632 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-52dec491-d93e-40ff-a024-8e2718ed4565 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:33.228335 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-52dec491-d93e-40ff-a024-8e2718ed4565 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:33.273303 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52dec491-d93e-40ff-a024-8e2718ed4565 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:33.275698 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52dec491-d93e-40ff-a024-8e2718ed4565 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:33.276455 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52dec491-d93e-40ff-a024-8e2718ed4565 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:33.280863 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52dec491-d93e-40ff-a024-8e2718ed4565 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:33.283588 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52dec491-d93e-40ff-a024-8e2718ed4565 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:33.285764 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52dec491-d93e-40ff-a024-8e2718ed4565 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:33.335200 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=91,nova_cell1:INSERT=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:41:33.979840 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-52dec491-d93e-40ff-a024-8e2718ed4565 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:33.983878 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ec7b48a0-fc85-40c7-a1f1-1ab57ef8a62a tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea515c9dbf645828f6f67c9f6bbc541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8512b08f05db4a469827368f47fb4c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:33.994966 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-52dec491-d93e-40ff-a024-8e2718ed4565 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1683 microversion: 2.1 time: 0.771792 Oct 30 01:41:33.996138 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2690/5359] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:41:33 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1683 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:41:34.000606 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ec7b48a0-fc85-40c7-a1f1-1ab57ef8a62a tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] 10.222.0.13 "GET /compute/v2.1/servers/7d4bddd4-8e9c-49fe-9127-55fd56c151be" status: 200 len: 1314 microversion: 2.1 time: 0.893790 Oct 30 01:41:34.003181 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2670/5360] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:41:33 2022] GET /compute/v2.1/servers/7d4bddd4-8e9c-49fe-9127-55fd56c151be => generated 1314 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:41:35.019441 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-eebe452e-0cf0-4dd4-a632-3903f194c06b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:35.022314 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-eebe452e-0cf0-4dd4-a632-3903f194c06b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:35.028660 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-87e94cd2-10c0-4b18-8f7c-12ac32a1ec1b tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:35.029485 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-87e94cd2-10c0-4b18-8f7c-12ac32a1ec1b tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] [instance: 7d4bddd4-8e9c-49fe-9127-55fd56c151be] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:35.035460 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:41:35.036244 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:41:35.037852 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eebe452e-0cf0-4dd4-a632-3903f194c06b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:35.038353 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eebe452e-0cf0-4dd4-a632-3903f194c06b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:35.039686 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-87e94cd2-10c0-4b18-8f7c-12ac32a1ec1b tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:35.040696 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-87e94cd2-10c0-4b18-8f7c-12ac32a1ec1b tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:35.041729 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-87e94cd2-10c0-4b18-8f7c-12ac32a1ec1b tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:35.041838 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eebe452e-0cf0-4dd4-a632-3903f194c06b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:35.044475 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eebe452e-0cf0-4dd4-a632-3903f194c06b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:35.044580 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-87e94cd2-10c0-4b18-8f7c-12ac32a1ec1b tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:35.044684 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eebe452e-0cf0-4dd4-a632-3903f194c06b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:35.044768 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-87e94cd2-10c0-4b18-8f7c-12ac32a1ec1b tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:35.044840 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eebe452e-0cf0-4dd4-a632-3903f194c06b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:35.044910 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-87e94cd2-10c0-4b18-8f7c-12ac32a1ec1b tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:35.165675 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:41:35.608298 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-87e94cd2-10c0-4b18-8f7c-12ac32a1ec1b tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea515c9dbf645828f6f67c9f6bbc541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8512b08f05db4a469827368f47fb4c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:35.646879 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-87e94cd2-10c0-4b18-8f7c-12ac32a1ec1b tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] 10.222.0.13 "GET /compute/v2.1/servers/7d4bddd4-8e9c-49fe-9127-55fd56c151be" status: 200 len: 1314 microversion: 2.1 time: 0.623176 Oct 30 01:41:35.649558 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2671/5361] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:41:35 2022] GET /compute/v2.1/servers/7d4bddd4-8e9c-49fe-9127-55fd56c151be => generated 1314 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:41:35.654892 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-eebe452e-0cf0-4dd4-a632-3903f194c06b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:35.664112 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-eebe452e-0cf0-4dd4-a632-3903f194c06b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1670 microversion: 2.1 time: 0.648683 Oct 30 01:41:35.674584 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2691/5362] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:41:35 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1670 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:41:35.690902 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9beb97f0-8872-4816-91c1-ba409d12042d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-103555698"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:41:35.701304 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9beb97f0-8872-4816-91c1-ba409d12042d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:35.718079 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9beb97f0-8872-4816-91c1-ba409d12042d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:35.723111 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9beb97f0-8872-4816-91c1-ba409d12042d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:35.723679 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9beb97f0-8872-4816-91c1-ba409d12042d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:35.724823 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9beb97f0-8872-4816-91c1-ba409d12042d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:35.729440 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9beb97f0-8872-4816-91c1-ba409d12042d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:35.730025 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9beb97f0-8872-4816-91c1-ba409d12042d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:36.186616 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-23b63c3f-c2ce-455c-bbcd-aa3e99bd0aa6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:41:36.187823 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-23b63c3f-c2ce-455c-bbcd-aa3e99bd0aa6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:36.198395 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-23b63c3f-c2ce-455c-bbcd-aa3e99bd0aa6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:36.216312 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-23b63c3f-c2ce-455c-bbcd-aa3e99bd0aa6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:36.216312 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-23b63c3f-c2ce-455c-bbcd-aa3e99bd0aa6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:36.216312 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-23b63c3f-c2ce-455c-bbcd-aa3e99bd0aa6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:36.216312 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-23b63c3f-c2ce-455c-bbcd-aa3e99bd0aa6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:36.216312 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-23b63c3f-c2ce-455c-bbcd-aa3e99bd0aa6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:36.241692 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-23b63c3f-c2ce-455c-bbcd-aa3e99bd0aa6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lazy-loading 'flavor' on Instance uuid b2e35e69-66f2-43a0-9baa-d8f70437561d {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:41:36.319180 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=8 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:41:36.368522 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9beb97f0-8872-4816-91c1-ba409d12042d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "POST /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9/action" status: 202 len: 0 microversion: 2.1 time: 0.682719 Oct 30 01:41:36.370627 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2672/5363] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:41:35 2022] POST /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9/action => generated 0 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 30 01:41:36.679803 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-032e8ffc-0831-4025-833f-05e65fc50888 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:36.682875 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-032e8ffc-0831-4025-833f-05e65fc50888 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] [instance: 7d4bddd4-8e9c-49fe-9127-55fd56c151be] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:36.700388 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-032e8ffc-0831-4025-833f-05e65fc50888 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:36.700892 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-032e8ffc-0831-4025-833f-05e65fc50888 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:36.701426 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-032e8ffc-0831-4025-833f-05e65fc50888 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:36.702091 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-032e8ffc-0831-4025-833f-05e65fc50888 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:36.702551 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-032e8ffc-0831-4025-833f-05e65fc50888 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:36.702979 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-032e8ffc-0831-4025-833f-05e65fc50888 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:36.908661 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-032e8ffc-0831-4025-833f-05e65fc50888 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea515c9dbf645828f6f67c9f6bbc541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8512b08f05db4a469827368f47fb4c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:36.918693 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-032e8ffc-0831-4025-833f-05e65fc50888 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] 10.222.0.13 "GET /compute/v2.1/servers/7d4bddd4-8e9c-49fe-9127-55fd56c151be" status: 200 len: 1314 microversion: 2.1 time: 0.245010 Oct 30 01:41:36.934007 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2673/5364] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:41:36 2022] GET /compute/v2.1/servers/7d4bddd4-8e9c-49fe-9127-55fd56c151be => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:41:37.003400 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-23b63c3f-c2ce-455c-bbcd-aa3e99bd0aa6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "POST /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d/action" status: 202 len: 0 microversion: 2.20 time: 0.822064 Oct 30 01:41:37.005114 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2692/5365] 10.222.0.13 () {62 vars in 1319 bytes} [Sun Oct 30 01:41:36 2022] POST /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d/action => generated 0 bytes in 824 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 30 01:41:37.018878 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6a2acc73-2eec-46cb-905f-9046b02c4e6e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:37.019805 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6a2acc73-2eec-46cb-905f-9046b02c4e6e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:37.029195 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a2acc73-2eec-46cb-905f-9046b02c4e6e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:37.030055 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a2acc73-2eec-46cb-905f-9046b02c4e6e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:37.031176 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a2acc73-2eec-46cb-905f-9046b02c4e6e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:37.032302 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a2acc73-2eec-46cb-905f-9046b02c4e6e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:37.038425 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a2acc73-2eec-46cb-905f-9046b02c4e6e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:37.047409 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a2acc73-2eec-46cb-905f-9046b02c4e6e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:37.314426 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6a2acc73-2eec-46cb-905f-9046b02c4e6e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:37.317605 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:41:37.326901 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6a2acc73-2eec-46cb-905f-9046b02c4e6e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:37.329002 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6a2acc73-2eec-46cb-905f-9046b02c4e6e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:37.330387 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6a2acc73-2eec-46cb-905f-9046b02c4e6e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1721 microversion: 2.20 time: 0.321511 Oct 30 01:41:37.342100 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2674/5366] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:41:37 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1721 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:41:37.943983 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4be07232-016c-422a-8776-f8e0ea7a9de1 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:37.945813 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4be07232-016c-422a-8776-f8e0ea7a9de1 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] [instance: 7d4bddd4-8e9c-49fe-9127-55fd56c151be] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:37.961446 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4be07232-016c-422a-8776-f8e0ea7a9de1 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:37.962602 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4be07232-016c-422a-8776-f8e0ea7a9de1 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:37.963272 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4be07232-016c-422a-8776-f8e0ea7a9de1 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:37.966209 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4be07232-016c-422a-8776-f8e0ea7a9de1 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:37.971564 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4be07232-016c-422a-8776-f8e0ea7a9de1 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:37.972218 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4be07232-016c-422a-8776-f8e0ea7a9de1 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:38.362688 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-71e54da9-c209-4190-b907-114a95ad9f5a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:38.364014 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-71e54da9-c209-4190-b907-114a95ad9f5a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:38.394595 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-71e54da9-c209-4190-b907-114a95ad9f5a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:38.395224 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-71e54da9-c209-4190-b907-114a95ad9f5a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:38.395837 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-71e54da9-c209-4190-b907-114a95ad9f5a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:38.396660 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-71e54da9-c209-4190-b907-114a95ad9f5a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:38.400113 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-71e54da9-c209-4190-b907-114a95ad9f5a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:38.400672 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-71e54da9-c209-4190-b907-114a95ad9f5a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:38.516515 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4be07232-016c-422a-8776-f8e0ea7a9de1 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea515c9dbf645828f6f67c9f6bbc541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8512b08f05db4a469827368f47fb4c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:38.526273 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4be07232-016c-422a-8776-f8e0ea7a9de1 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] 10.222.0.13 "GET /compute/v2.1/servers/7d4bddd4-8e9c-49fe-9127-55fd56c151be" status: 200 len: 1314 microversion: 2.1 time: 0.586859 Oct 30 01:41:38.536371 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2693/5367] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:41:37 2022] GET /compute/v2.1/servers/7d4bddd4-8e9c-49fe-9127-55fd56c151be => generated 1314 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:41:38.566394 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-af8422c9-80b9-40f4-9374-9b2dc3518206 req-7d0c9634-e36c-481c-97f6-1cf8df48cde6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0f03664-8785-4321-b32e-3622f1b747b9", "name": "network-vif-unplugged", "status": "completed", "tag": "63c1537a-0706-49b0-8e88-a5c62f4ffbe3"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:41:38.597960 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-af8422c9-80b9-40f4-9374-9b2dc3518206 req-7d0c9634-e36c-481c-97f6-1cf8df48cde6 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:38.602821 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-af8422c9-80b9-40f4-9374-9b2dc3518206 req-7d0c9634-e36c-481c-97f6-1cf8df48cde6 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:38.604014 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-af8422c9-80b9-40f4-9374-9b2dc3518206 req-7d0c9634-e36c-481c-97f6-1cf8df48cde6 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:38.634475 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-af8422c9-80b9-40f4-9374-9b2dc3518206 req-7d0c9634-e36c-481c-97f6-1cf8df48cde6 service nova] Creating event network-vif-unplugged:63c1537a-0706-49b0-8e88-a5c62f4ffbe3 for instance b0f03664-8785-4321-b32e-3622f1b747b9 on n-h2-master-1 Oct 30 01:41:38.643080 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-af8422c9-80b9-40f4-9374-9b2dc3518206 req-7d0c9634-e36c-481c-97f6-1cf8df48cde6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104224 Oct 30 01:41:38.650767 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2694/5368] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:41:38.859608 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-71e54da9-c209-4190-b907-114a95ad9f5a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:38.894581 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-71e54da9-c209-4190-b907-114a95ad9f5a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:38.896585 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-71e54da9-c209-4190-b907-114a95ad9f5a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:38.902383 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-71e54da9-c209-4190-b907-114a95ad9f5a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1721 microversion: 2.20 time: 0.544066 Oct 30 01:41:38.905376 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2675/5369] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:41:38 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1721 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:41:39.552234 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c216e393-a11e-4a5f-b7b8-d3226dae12d4 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:39.553100 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c216e393-a11e-4a5f-b7b8-d3226dae12d4 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] [instance: 7d4bddd4-8e9c-49fe-9127-55fd56c151be] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:39.600271 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c216e393-a11e-4a5f-b7b8-d3226dae12d4 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:39.603463 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c216e393-a11e-4a5f-b7b8-d3226dae12d4 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:39.607842 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c216e393-a11e-4a5f-b7b8-d3226dae12d4 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:39.608941 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c216e393-a11e-4a5f-b7b8-d3226dae12d4 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:39.610064 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c216e393-a11e-4a5f-b7b8-d3226dae12d4 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:39.611203 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c216e393-a11e-4a5f-b7b8-d3226dae12d4 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:39.917056 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c216e393-a11e-4a5f-b7b8-d3226dae12d4 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea515c9dbf645828f6f67c9f6bbc541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8512b08f05db4a469827368f47fb4c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:39.930444 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c216e393-a11e-4a5f-b7b8-d3226dae12d4 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] 10.222.0.13 "GET /compute/v2.1/servers/7d4bddd4-8e9c-49fe-9127-55fd56c151be" status: 200 len: 1314 microversion: 2.1 time: 0.384903 Oct 30 01:41:39.931662 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2695/5370] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:41:39 2022] GET /compute/v2.1/servers/7d4bddd4-8e9c-49fe-9127-55fd56c151be => generated 1314 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:41:39.934149 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5989f795-2d17-415f-af52-7384feef35c1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:39.934764 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5989f795-2d17-415f-af52-7384feef35c1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:39.950761 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5989f795-2d17-415f-af52-7384feef35c1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:39.951263 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5989f795-2d17-415f-af52-7384feef35c1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:39.951703 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5989f795-2d17-415f-af52-7384feef35c1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:39.952430 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5989f795-2d17-415f-af52-7384feef35c1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:39.953556 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5989f795-2d17-415f-af52-7384feef35c1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:39.956075 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5989f795-2d17-415f-af52-7384feef35c1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:40.296662 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5989f795-2d17-415f-af52-7384feef35c1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:40.305860 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5989f795-2d17-415f-af52-7384feef35c1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:40.311675 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5989f795-2d17-415f-af52-7384feef35c1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:40.311675 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5989f795-2d17-415f-af52-7384feef35c1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1721 microversion: 2.20 time: 0.378516 Oct 30 01:41:40.311675 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2676/5371] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:41:39 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1721 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:41:40.958337 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-61a0fa6c-e8ca-4b5d-af51-a598c98a1766 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:40.958973 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-61a0fa6c-e8ca-4b5d-af51-a598c98a1766 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] [instance: 7d4bddd4-8e9c-49fe-9127-55fd56c151be] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:40.969071 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-61a0fa6c-e8ca-4b5d-af51-a598c98a1766 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:40.969629 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-61a0fa6c-e8ca-4b5d-af51-a598c98a1766 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:40.970108 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-61a0fa6c-e8ca-4b5d-af51-a598c98a1766 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:40.975790 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-61a0fa6c-e8ca-4b5d-af51-a598c98a1766 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:40.986142 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-61a0fa6c-e8ca-4b5d-af51-a598c98a1766 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:40.986142 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-61a0fa6c-e8ca-4b5d-af51-a598c98a1766 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:41.294982 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-e40974b2-3436-4a7e-85f5-c2766870492f req-12166942-a763-4e8b-9b45-20185f1c1ad4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d4bddd4-8e9c-49fe-9127-55fd56c151be", "name": "network-vif-plugged", "status": "completed", "tag": "b28e2fc9-22cb-4732-a114-116ce70e3d6d"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:41:41.319584 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-e40974b2-3436-4a7e-85f5-c2766870492f req-12166942-a763-4e8b-9b45-20185f1c1ad4 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:41.320020 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-e40974b2-3436-4a7e-85f5-c2766870492f req-12166942-a763-4e8b-9b45-20185f1c1ad4 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:41.321041 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-e40974b2-3436-4a7e-85f5-c2766870492f req-12166942-a763-4e8b-9b45-20185f1c1ad4 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:41.355838 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-e40974b2-3436-4a7e-85f5-c2766870492f req-12166942-a763-4e8b-9b45-20185f1c1ad4 service nova] Creating event network-vif-plugged:b28e2fc9-22cb-4732-a114-116ce70e3d6d for instance 7d4bddd4-8e9c-49fe-9127-55fd56c151be on n-h2-master-1 Oct 30 01:41:41.363382 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-e40974b2-3436-4a7e-85f5-c2766870492f req-12166942-a763-4e8b-9b45-20185f1c1ad4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070623 Oct 30 01:41:41.364394 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2677/5372] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:41:41.375526 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-efc54c7d-8e49-4e9c-be38-5fc3cc9dea06 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:41.376761 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-efc54c7d-8e49-4e9c-be38-5fc3cc9dea06 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:41.389650 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-efc54c7d-8e49-4e9c-be38-5fc3cc9dea06 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:41.393505 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-efc54c7d-8e49-4e9c-be38-5fc3cc9dea06 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:41.394119 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-efc54c7d-8e49-4e9c-be38-5fc3cc9dea06 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:41.402940 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-efc54c7d-8e49-4e9c-be38-5fc3cc9dea06 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:41.402940 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-efc54c7d-8e49-4e9c-be38-5fc3cc9dea06 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:41.402940 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-efc54c7d-8e49-4e9c-be38-5fc3cc9dea06 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:41.947060 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-61a0fa6c-e8ca-4b5d-af51-a598c98a1766 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea515c9dbf645828f6f67c9f6bbc541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8512b08f05db4a469827368f47fb4c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:41.958434 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-61a0fa6c-e8ca-4b5d-af51-a598c98a1766 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] 10.222.0.13 "GET /compute/v2.1/servers/7d4bddd4-8e9c-49fe-9127-55fd56c151be" status: 200 len: 1314 microversion: 2.1 time: 1.004725 Oct 30 01:41:41.961808 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2696/5373] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:41:40 2022] GET /compute/v2.1/servers/7d4bddd4-8e9c-49fe-9127-55fd56c151be => generated 1314 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:41:42.078456 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-efc54c7d-8e49-4e9c-be38-5fc3cc9dea06 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:42.088119 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-efc54c7d-8e49-4e9c-be38-5fc3cc9dea06 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:42.089605 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-efc54c7d-8e49-4e9c-be38-5fc3cc9dea06 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:42.090875 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-efc54c7d-8e49-4e9c-be38-5fc3cc9dea06 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1721 microversion: 2.20 time: 0.725279 Oct 30 01:41:42.091837 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2678/5374] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:41:41 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1721 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:41:42.280190 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a79e4bf9-776c-47ab-a5be-0ba13c1bef4e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:42.282585 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a79e4bf9-776c-47ab-a5be-0ba13c1bef4e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 2435fb0b-ab56-4368-9965-245b3574d012] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:42.290580 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a79e4bf9-776c-47ab-a5be-0ba13c1bef4e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:42.291471 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a79e4bf9-776c-47ab-a5be-0ba13c1bef4e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:42.292076 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a79e4bf9-776c-47ab-a5be-0ba13c1bef4e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:42.293012 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a79e4bf9-776c-47ab-a5be-0ba13c1bef4e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:42.293538 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a79e4bf9-776c-47ab-a5be-0ba13c1bef4e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:42.301097 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a79e4bf9-776c-47ab-a5be-0ba13c1bef4e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:42.368852 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a79e4bf9-776c-47ab-a5be-0ba13c1bef4e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.093229 Oct 30 01:41:42.369508 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2697/5375] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 01:41:42 2022] GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012/os-volume_attachments => generated 25 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 30 01:41:42.576657 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-19044094-c9c6-43ce-9e3e-58dc43765776 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:42.590049 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-19044094-c9c6-43ce-9e3e-58dc43765776 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 2435fb0b-ab56-4368-9965-245b3574d012] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:42.601878 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-19044094-c9c6-43ce-9e3e-58dc43765776 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:42.602637 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-19044094-c9c6-43ce-9e3e-58dc43765776 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:42.603777 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-19044094-c9c6-43ce-9e3e-58dc43765776 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:42.604649 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-19044094-c9c6-43ce-9e3e-58dc43765776 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:42.605258 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-19044094-c9c6-43ce-9e3e-58dc43765776 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:42.605889 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-19044094-c9c6-43ce-9e3e-58dc43765776 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:42.687408 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-19044094-c9c6-43ce-9e3e-58dc43765776 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.116303 Oct 30 01:41:42.701859 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2679/5376] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 01:41:42 2022] GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012/os-volume_attachments => generated 25 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:41:42.822950 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-496c607d-e735-4f14-bc04-a722b0860178 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:42.823680 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-496c607d-e735-4f14-bc04-a722b0860178 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 2435fb0b-ab56-4368-9965-245b3574d012] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:42.841206 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-496c607d-e735-4f14-bc04-a722b0860178 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:42.842812 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-496c607d-e735-4f14-bc04-a722b0860178 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:42.843424 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-496c607d-e735-4f14-bc04-a722b0860178 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:42.851427 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-496c607d-e735-4f14-bc04-a722b0860178 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:42.852303 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-496c607d-e735-4f14-bc04-a722b0860178 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:42.854887 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-496c607d-e735-4f14-bc04-a722b0860178 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:42.943127 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-496c607d-e735-4f14-bc04-a722b0860178 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 2435fb0b-ab56-4368-9965-245b3574d012] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:41:42.985104 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-40b90fec-de9c-4932-9d13-e23a607d0f42 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:42.986303 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-40b90fec-de9c-4932-9d13-e23a607d0f42 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] [instance: 7d4bddd4-8e9c-49fe-9127-55fd56c151be] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:43.001034 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-40b90fec-de9c-4932-9d13-e23a607d0f42 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:43.001573 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-40b90fec-de9c-4932-9d13-e23a607d0f42 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:43.002017 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-40b90fec-de9c-4932-9d13-e23a607d0f42 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:43.002740 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-40b90fec-de9c-4932-9d13-e23a607d0f42 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:43.008487 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-40b90fec-de9c-4932-9d13-e23a607d0f42 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:43.016344 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-40b90fec-de9c-4932-9d13-e23a607d0f42 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:43.391139 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-496c607d-e735-4f14-bc04-a722b0860178 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012" status: 204 len: 0 microversion: 2.1 time: 0.571768 Oct 30 01:41:43.392278 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2698/5377] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:41:42 2022] DELETE /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:41:43.397685 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-85a919c5-2073-4e1b-b41e-1397aed8be2b tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:43.398379 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-85a919c5-2073-4e1b-b41e-1397aed8be2b tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:43.427160 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-85a919c5-2073-4e1b-b41e-1397aed8be2b tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:43.430238 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-85a919c5-2073-4e1b-b41e-1397aed8be2b tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:43.437998 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-85a919c5-2073-4e1b-b41e-1397aed8be2b tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:43.437998 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-85a919c5-2073-4e1b-b41e-1397aed8be2b tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:43.437998 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-85a919c5-2073-4e1b-b41e-1397aed8be2b tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:43.437998 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-85a919c5-2073-4e1b-b41e-1397aed8be2b tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:43.547556 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-40b90fec-de9c-4932-9d13-e23a607d0f42 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea515c9dbf645828f6f67c9f6bbc541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8512b08f05db4a469827368f47fb4c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:43.555736 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-40b90fec-de9c-4932-9d13-e23a607d0f42 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] 10.222.0.13 "GET /compute/v2.1/servers/7d4bddd4-8e9c-49fe-9127-55fd56c151be" status: 200 len: 1314 microversion: 2.1 time: 0.575085 Oct 30 01:41:43.556326 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2680/5378] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:41:42 2022] GET /compute/v2.1/servers/7d4bddd4-8e9c-49fe-9127-55fd56c151be => generated 1314 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:41:43.582581 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-ce39287a-1c23-4ac1-869e-b0a95db63eb0 req-8505528e-4a69-4165-9186-fa110cedb82a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0f03664-8785-4321-b32e-3622f1b747b9", "name": "network-vif-plugged", "status": "completed", "tag": "63c1537a-0706-49b0-8e88-a5c62f4ffbe3"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:41:43.611736 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ce39287a-1c23-4ac1-869e-b0a95db63eb0 req-8505528e-4a69-4165-9186-fa110cedb82a service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:43.612462 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ce39287a-1c23-4ac1-869e-b0a95db63eb0 req-8505528e-4a69-4165-9186-fa110cedb82a service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:43.627223 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ce39287a-1c23-4ac1-869e-b0a95db63eb0 req-8505528e-4a69-4165-9186-fa110cedb82a service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:43.640618 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-ce39287a-1c23-4ac1-869e-b0a95db63eb0 req-8505528e-4a69-4165-9186-fa110cedb82a service nova] Creating event network-vif-plugged:63c1537a-0706-49b0-8e88-a5c62f4ffbe3 for instance b0f03664-8785-4321-b32e-3622f1b747b9 on n-h2-master-1 Oct 30 01:41:43.654327 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-ce39287a-1c23-4ac1-869e-b0a95db63eb0 req-8505528e-4a69-4165-9186-fa110cedb82a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095853 Oct 30 01:41:43.655556 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2681/5379] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:41:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:41:43.678534 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-72329c96-1381-4ef2-943a-f63e1857479e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:43.680208 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-72329c96-1381-4ef2-943a-f63e1857479e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 2435fb0b-ab56-4368-9965-245b3574d012] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:43.697371 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-72329c96-1381-4ef2-943a-f63e1857479e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:43.700601 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-72329c96-1381-4ef2-943a-f63e1857479e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:43.705719 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-72329c96-1381-4ef2-943a-f63e1857479e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:43.705719 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-72329c96-1381-4ef2-943a-f63e1857479e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:43.705719 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-72329c96-1381-4ef2-943a-f63e1857479e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:43.705719 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-72329c96-1381-4ef2-943a-f63e1857479e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:43.991211 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-85a919c5-2073-4e1b-b41e-1397aed8be2b tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:44.017778 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-85a919c5-2073-4e1b-b41e-1397aed8be2b tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:44.019535 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-85a919c5-2073-4e1b-b41e-1397aed8be2b tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:44.020765 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-85a919c5-2073-4e1b-b41e-1397aed8be2b tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1721 microversion: 2.20 time: 0.627269 Oct 30 01:41:44.023842 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2699/5380] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:41:43 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1721 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:41:44.114016 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-72329c96-1381-4ef2-943a-f63e1857479e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:44.124684 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-72329c96-1381-4ef2-943a-f63e1857479e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012" status: 200 len: 1675 microversion: 2.1 time: 0.467704 Oct 30 01:41:44.130022 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2682/5381] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:41:43 2022] GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012 => generated 1675 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:41:44.583510 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2ce11ccd-649f-49b5-9a2c-b1572b1db6ed tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:44.587548 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2ce11ccd-649f-49b5-9a2c-b1572b1db6ed tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] [instance: 7d4bddd4-8e9c-49fe-9127-55fd56c151be] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:44.600012 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2ce11ccd-649f-49b5-9a2c-b1572b1db6ed tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:44.600721 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2ce11ccd-649f-49b5-9a2c-b1572b1db6ed tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:44.601315 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2ce11ccd-649f-49b5-9a2c-b1572b1db6ed tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:44.606175 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2ce11ccd-649f-49b5-9a2c-b1572b1db6ed tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:44.606824 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2ce11ccd-649f-49b5-9a2c-b1572b1db6ed tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:44.607393 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2ce11ccd-649f-49b5-9a2c-b1572b1db6ed tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:44.839451 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2ce11ccd-649f-49b5-9a2c-b1572b1db6ed tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea515c9dbf645828f6f67c9f6bbc541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8512b08f05db4a469827368f47fb4c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:44.849269 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2ce11ccd-649f-49b5-9a2c-b1572b1db6ed tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] 10.222.0.13 "GET /compute/v2.1/servers/7d4bddd4-8e9c-49fe-9127-55fd56c151be" status: 200 len: 1498 microversion: 2.1 time: 0.269832 Oct 30 01:41:44.849993 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2700/5382] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:41:44 2022] GET /compute/v2.1/servers/7d4bddd4-8e9c-49fe-9127-55fd56c151be => generated 1498 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:41:45.052486 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e83a30f9-4c99-410e-9d70-69419a816109 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:45.055978 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e83a30f9-4c99-410e-9d70-69419a816109 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:45.064601 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e83a30f9-4c99-410e-9d70-69419a816109 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:45.065597 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e83a30f9-4c99-410e-9d70-69419a816109 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:45.066225 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e83a30f9-4c99-410e-9d70-69419a816109 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:45.067242 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e83a30f9-4c99-410e-9d70-69419a816109 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:45.067913 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e83a30f9-4c99-410e-9d70-69419a816109 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:45.068586 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e83a30f9-4c99-410e-9d70-69419a816109 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:45.153605 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-76a3ec34-8467-45f5-8654-e21bacf19181 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:45.154229 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-76a3ec34-8467-45f5-8654-e21bacf19181 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 2435fb0b-ab56-4368-9965-245b3574d012] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:45.166261 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-76a3ec34-8467-45f5-8654-e21bacf19181 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:45.167087 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-76a3ec34-8467-45f5-8654-e21bacf19181 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:45.168168 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-76a3ec34-8467-45f5-8654-e21bacf19181 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:45.170248 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-76a3ec34-8467-45f5-8654-e21bacf19181 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:45.171347 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-76a3ec34-8467-45f5-8654-e21bacf19181 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:45.175034 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-76a3ec34-8467-45f5-8654-e21bacf19181 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:45.947423 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e83a30f9-4c99-410e-9d70-69419a816109 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:45.966309 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e83a30f9-4c99-410e-9d70-69419a816109 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:45.967451 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-76a3ec34-8467-45f5-8654-e21bacf19181 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:45.970616 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e83a30f9-4c99-410e-9d70-69419a816109 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:45.972124 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e83a30f9-4c99-410e-9d70-69419a816109 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1721 microversion: 2.20 time: 0.925067 Oct 30 01:41:45.973391 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2683/5383] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:41:45 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1721 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:41:45.977191 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-76a3ec34-8467-45f5-8654-e21bacf19181 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012" status: 200 len: 1675 microversion: 2.1 time: 0.827666 Oct 30 01:41:45.980186 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2701/5384] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:41:45 2022] GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012 => generated 1675 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:41:46.373317 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a8b17469-1e06-4bb1-8fbd-e63c5afdf52f tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:46.374044 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a8b17469-1e06-4bb1-8fbd-e63c5afdf52f tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] [instance: 7d4bddd4-8e9c-49fe-9127-55fd56c151be] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:46.393032 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a8b17469-1e06-4bb1-8fbd-e63c5afdf52f tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:46.399789 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a8b17469-1e06-4bb1-8fbd-e63c5afdf52f tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:46.400425 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a8b17469-1e06-4bb1-8fbd-e63c5afdf52f tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:46.401529 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a8b17469-1e06-4bb1-8fbd-e63c5afdf52f tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:46.402028 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a8b17469-1e06-4bb1-8fbd-e63c5afdf52f tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:46.402442 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a8b17469-1e06-4bb1-8fbd-e63c5afdf52f tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:46.431963 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-56338871-eb77-45db-9cda-ab42145fe64c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:46.432663 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-56338871-eb77-45db-9cda-ab42145fe64c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:46.446345 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-56338871-eb77-45db-9cda-ab42145fe64c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:46.449882 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-56338871-eb77-45db-9cda-ab42145fe64c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:46.455907 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-56338871-eb77-45db-9cda-ab42145fe64c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:46.455907 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-56338871-eb77-45db-9cda-ab42145fe64c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:46.455907 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-56338871-eb77-45db-9cda-ab42145fe64c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:46.455907 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-56338871-eb77-45db-9cda-ab42145fe64c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:46.495636 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-56338871-eb77-45db-9cda-ab42145fe64c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:41:46.516653 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a8b17469-1e06-4bb1-8fbd-e63c5afdf52f tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] [instance: 7d4bddd4-8e9c-49fe-9127-55fd56c151be] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:41:46.626875 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:41:47.008650 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-56338871-eb77-45db-9cda-ab42145fe64c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 204 len: 0 microversion: 2.42 time: 1.019210 Oct 30 01:41:47.008839 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a8b17469-1e06-4bb1-8fbd-e63c5afdf52f tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7d4bddd4-8e9c-49fe-9127-55fd56c151be" status: 204 len: 0 microversion: 2.1 time: 0.638895 Oct 30 01:41:47.010133 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2684/5386] 10.222.0.13 () {60 vars in 1280 bytes} [Sun Oct 30 01:41:45 2022] DELETE /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 0 bytes in 1022 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 30 01:41:47.010397 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2702/5386] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:41:46 2022] DELETE /compute/v2.1/servers/7d4bddd4-8e9c-49fe-9127-55fd56c151be => generated 0 bytes in 641 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:41:47.026905 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-71f1ada6-ddb2-4a9c-bc89-530be340613c tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:47.028762 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-71f1ada6-ddb2-4a9c-bc89-530be340613c tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 2435fb0b-ab56-4368-9965-245b3574d012] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:47.037154 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-71f1ada6-ddb2-4a9c-bc89-530be340613c tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:47.037971 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-71f1ada6-ddb2-4a9c-bc89-530be340613c tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:47.038596 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-71f1ada6-ddb2-4a9c-bc89-530be340613c tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:47.039607 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-71f1ada6-ddb2-4a9c-bc89-530be340613c tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:47.040247 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-71f1ada6-ddb2-4a9c-bc89-530be340613c tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:47.041141 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-71f1ada6-ddb2-4a9c-bc89-530be340613c tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:47.400547 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-71f1ada6-ddb2-4a9c-bc89-530be340613c tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:47.417187 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-71f1ada6-ddb2-4a9c-bc89-530be340613c tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012" status: 200 len: 1675 microversion: 2.1 time: 0.404803 Oct 30 01:41:47.428508 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2703/5387] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:41:47 2022] GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012 => generated 1675 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:41:47.448370 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-260e5a26-cd94-461b-9346-02807be26b34 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:47.453402 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-260e5a26-cd94-461b-9346-02807be26b34 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] [instance: 7d4bddd4-8e9c-49fe-9127-55fd56c151be] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:47.474431 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-260e5a26-cd94-461b-9346-02807be26b34 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:47.474933 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-260e5a26-cd94-461b-9346-02807be26b34 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:47.475382 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-260e5a26-cd94-461b-9346-02807be26b34 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:47.476085 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-260e5a26-cd94-461b-9346-02807be26b34 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:47.480703 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-260e5a26-cd94-461b-9346-02807be26b34 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:47.481225 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-260e5a26-cd94-461b-9346-02807be26b34 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:47.494101 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-923bd884-c39a-4000-98d5-a4711f41d3cb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:47.495023 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-923bd884-c39a-4000-98d5-a4711f41d3cb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:47.518881 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-923bd884-c39a-4000-98d5-a4711f41d3cb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:47.522019 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-923bd884-c39a-4000-98d5-a4711f41d3cb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:47.522629 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-923bd884-c39a-4000-98d5-a4711f41d3cb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:47.525513 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-923bd884-c39a-4000-98d5-a4711f41d3cb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:47.528992 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-923bd884-c39a-4000-98d5-a4711f41d3cb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:47.531984 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-923bd884-c39a-4000-98d5-a4711f41d3cb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:47.971538 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-260e5a26-cd94-461b-9346-02807be26b34 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea515c9dbf645828f6f67c9f6bbc541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8512b08f05db4a469827368f47fb4c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:47.986170 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-923bd884-c39a-4000-98d5-a4711f41d3cb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:47.986446 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-260e5a26-cd94-461b-9346-02807be26b34 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] 10.222.0.13 "GET /compute/v2.1/servers/7d4bddd4-8e9c-49fe-9127-55fd56c151be" status: 200 len: 1504 microversion: 2.1 time: 0.558121 Oct 30 01:41:48.011548 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2704/5388] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:41:47 2022] GET /compute/v2.1/servers/7d4bddd4-8e9c-49fe-9127-55fd56c151be => generated 1504 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:41:48.012399 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-923bd884-c39a-4000-98d5-a4711f41d3cb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:48.012399 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-923bd884-c39a-4000-98d5-a4711f41d3cb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:48.013812 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-923bd884-c39a-4000-98d5-a4711f41d3cb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1721 microversion: 2.20 time: 1.001599 Oct 30 01:41:48.029368 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2685/5389] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:41:47 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1721 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:41:48.049426 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-34039296-d43f-4afa-a86c-5deee31f7829 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:48.051406 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-34039296-d43f-4afa-a86c-5deee31f7829 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:48.078363 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-34039296-d43f-4afa-a86c-5deee31f7829 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:48.079176 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-34039296-d43f-4afa-a86c-5deee31f7829 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:48.079780 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-34039296-d43f-4afa-a86c-5deee31f7829 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:48.089570 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-34039296-d43f-4afa-a86c-5deee31f7829 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:48.092432 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-34039296-d43f-4afa-a86c-5deee31f7829 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:48.093117 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-34039296-d43f-4afa-a86c-5deee31f7829 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:48.452876 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f557481c-acb4-4b51-841e-7735ec4fc3d2 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:48.453559 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f557481c-acb4-4b51-841e-7735ec4fc3d2 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 2435fb0b-ab56-4368-9965-245b3574d012] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:48.477708 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f557481c-acb4-4b51-841e-7735ec4fc3d2 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:48.478200 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f557481c-acb4-4b51-841e-7735ec4fc3d2 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:48.478641 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f557481c-acb4-4b51-841e-7735ec4fc3d2 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:48.479365 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f557481c-acb4-4b51-841e-7735ec4fc3d2 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:48.479821 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f557481c-acb4-4b51-841e-7735ec4fc3d2 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:48.480244 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f557481c-acb4-4b51-841e-7735ec4fc3d2 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:48.855240 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f557481c-acb4-4b51-841e-7735ec4fc3d2 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:48.866439 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f557481c-acb4-4b51-841e-7735ec4fc3d2 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012" status: 200 len: 1607 microversion: 2.1 time: 0.426704 Oct 30 01:41:48.883453 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2686/5390] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:41:48 2022] GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012 => generated 1607 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:41:48.883552 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-34039296-d43f-4afa-a86c-5deee31f7829 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:48.883552 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-34039296-d43f-4afa-a86c-5deee31f7829 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:48.883552 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-34039296-d43f-4afa-a86c-5deee31f7829 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:48.883552 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-34039296-d43f-4afa-a86c-5deee31f7829 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 2964 microversion: 2.42 time: 0.877406 Oct 30 01:41:48.884708 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-80b5ca8f-4dcf-4ac7-b7c4-aea09fe635ab req-44fa0060-f53e-43a2-849f-cd103ae2b38f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2435fb0b-ab56-4368-9965-245b3574d012", "name": "network-vif-deleted", "tag": "dbfeee30-a305-485d-8855-a6b6d181a616"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:41:48.892216 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2705/5391] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:41:48 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 2964 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:41:48.925315 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-80b5ca8f-4dcf-4ac7-b7c4-aea09fe635ab req-44fa0060-f53e-43a2-849f-cd103ae2b38f service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:48.930564 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-80b5ca8f-4dcf-4ac7-b7c4-aea09fe635ab req-44fa0060-f53e-43a2-849f-cd103ae2b38f service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:48.931382 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-80b5ca8f-4dcf-4ac7-b7c4-aea09fe635ab req-44fa0060-f53e-43a2-849f-cd103ae2b38f service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:48.978102 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-80b5ca8f-4dcf-4ac7-b7c4-aea09fe635ab req-44fa0060-f53e-43a2-849f-cd103ae2b38f service nova] Creating event network-vif-deleted:dbfeee30-a305-485d-8855-a6b6d181a616 for instance 2435fb0b-ab56-4368-9965-245b3574d012 on n-h1-master-1 Oct 30 01:41:48.997423 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-80b5ca8f-4dcf-4ac7-b7c4-aea09fe635ab req-44fa0060-f53e-43a2-849f-cd103ae2b38f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118431 Oct 30 01:41:48.997423 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2687/5392] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:41:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:41:49.026448 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bc952723-2274-4371-8f3a-880deec0d59e tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:49.028489 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-bc952723-2274-4371-8f3a-880deec0d59e tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] [instance: 7d4bddd4-8e9c-49fe-9127-55fd56c151be] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:49.045765 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-adef5ac6-fba9-45ae-9b82-227cf5b4d7ec tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:49.046832 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-adef5ac6-fba9-45ae-9b82-227cf5b4d7ec tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:49.064741 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-adef5ac6-fba9-45ae-9b82-227cf5b4d7ec tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:49.066131 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bc952723-2274-4371-8f3a-880deec0d59e tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:49.066719 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-adef5ac6-fba9-45ae-9b82-227cf5b4d7ec tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:49.067046 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bc952723-2274-4371-8f3a-880deec0d59e tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:49.067673 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-adef5ac6-fba9-45ae-9b82-227cf5b4d7ec tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:49.068495 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bc952723-2274-4371-8f3a-880deec0d59e tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:49.070384 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bc952723-2274-4371-8f3a-880deec0d59e tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:49.071507 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-adef5ac6-fba9-45ae-9b82-227cf5b4d7ec tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:49.072231 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bc952723-2274-4371-8f3a-880deec0d59e tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:49.072855 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-adef5ac6-fba9-45ae-9b82-227cf5b4d7ec tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:49.073908 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-adef5ac6-fba9-45ae-9b82-227cf5b4d7ec tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:49.074355 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bc952723-2274-4371-8f3a-880deec0d59e tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:49.488626 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-bc952723-2274-4371-8f3a-880deec0d59e tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea515c9dbf645828f6f67c9f6bbc541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8512b08f05db4a469827368f47fb4c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:49.518390 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bc952723-2274-4371-8f3a-880deec0d59e tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] 10.222.0.13 "GET /compute/v2.1/servers/7d4bddd4-8e9c-49fe-9127-55fd56c151be" status: 200 len: 1504 microversion: 2.1 time: 0.507786 Oct 30 01:41:49.519967 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2706/5393] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:41:49 2022] GET /compute/v2.1/servers/7d4bddd4-8e9c-49fe-9127-55fd56c151be => generated 1504 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:41:49.650396 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-adef5ac6-fba9-45ae-9b82-227cf5b4d7ec tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:49.678615 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-adef5ac6-fba9-45ae-9b82-227cf5b4d7ec tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:49.678615 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-adef5ac6-fba9-45ae-9b82-227cf5b4d7ec tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:49.680573 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-adef5ac6-fba9-45ae-9b82-227cf5b4d7ec tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1721 microversion: 2.20 time: 0.639665 Oct 30 01:41:49.681683 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2688/5394] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:41:49 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1721 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:41:49.889980 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-aa4cb785-45ac-40dc-a536-e51c7450574e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:49.890608 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-aa4cb785-45ac-40dc-a536-e51c7450574e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 2435fb0b-ab56-4368-9965-245b3574d012] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:49.898087 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa4cb785-45ac-40dc-a536-e51c7450574e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:49.898617 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa4cb785-45ac-40dc-a536-e51c7450574e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:49.899056 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa4cb785-45ac-40dc-a536-e51c7450574e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:49.899776 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa4cb785-45ac-40dc-a536-e51c7450574e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:49.900230 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa4cb785-45ac-40dc-a536-e51c7450574e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:49.900658 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa4cb785-45ac-40dc-a536-e51c7450574e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:49.920571 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7b3c64d9-ec19-4266-b6bf-2f1a24a41c0a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:49.922017 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7b3c64d9-ec19-4266-b6bf-2f1a24a41c0a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:49.929862 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b3c64d9-ec19-4266-b6bf-2f1a24a41c0a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:49.930465 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b3c64d9-ec19-4266-b6bf-2f1a24a41c0a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:49.930988 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b3c64d9-ec19-4266-b6bf-2f1a24a41c0a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:49.931817 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b3c64d9-ec19-4266-b6bf-2f1a24a41c0a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:49.933217 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b3c64d9-ec19-4266-b6bf-2f1a24a41c0a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:49.933217 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b3c64d9-ec19-4266-b6bf-2f1a24a41c0a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:49.939153 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa4cb785-45ac-40dc-a536-e51c7450574e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:49.939915 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa4cb785-45ac-40dc-a536-e51c7450574e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:49.940423 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa4cb785-45ac-40dc-a536-e51c7450574e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:49.941285 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-aa4cb785-45ac-40dc-a536-e51c7450574e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lazy-loading 'fault' on Instance uuid 2435fb0b-ab56-4368-9965-245b3574d012 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:41:49.992953 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-aa4cb785-45ac-40dc-a536-e51c7450574e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:49.995676 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-aa4cb785-45ac-40dc-a536-e51c7450574e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012" status: 200 len: 1328 microversion: 2.1 time: 0.109642 Oct 30 01:41:49.996347 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2707/5395] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:41:49 2022] GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012 => generated 1328 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:41:50.549292 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-751e4a2a-3fd5-4241-848a-10ded6d2eb02 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:50.552010 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-751e4a2a-3fd5-4241-848a-10ded6d2eb02 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] [instance: 7d4bddd4-8e9c-49fe-9127-55fd56c151be] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:50.580678 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-751e4a2a-3fd5-4241-848a-10ded6d2eb02 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:50.584821 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-751e4a2a-3fd5-4241-848a-10ded6d2eb02 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:50.586256 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-751e4a2a-3fd5-4241-848a-10ded6d2eb02 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:50.590256 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-751e4a2a-3fd5-4241-848a-10ded6d2eb02 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:50.591017 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-751e4a2a-3fd5-4241-848a-10ded6d2eb02 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:50.603804 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-751e4a2a-3fd5-4241-848a-10ded6d2eb02 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:50.926604 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7b3c64d9-ec19-4266-b6bf-2f1a24a41c0a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:50.974933 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7b3c64d9-ec19-4266-b6bf-2f1a24a41c0a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:50.985066 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7b3c64d9-ec19-4266-b6bf-2f1a24a41c0a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:50.991142 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7b3c64d9-ec19-4266-b6bf-2f1a24a41c0a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 2964 microversion: 2.42 time: 1.072905 Oct 30 01:41:50.991775 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2689/5396] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:41:49 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 2964 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:41:51.013889 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9628ab85-ea0e-4414-880f-12ff8e52c153 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:51.024416 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9628ab85-ea0e-4414-880f-12ff8e52c153 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:51.040338 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9628ab85-ea0e-4414-880f-12ff8e52c153 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:51.040849 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9628ab85-ea0e-4414-880f-12ff8e52c153 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:51.041686 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9628ab85-ea0e-4414-880f-12ff8e52c153 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:51.042595 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9628ab85-ea0e-4414-880f-12ff8e52c153 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:51.043199 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9628ab85-ea0e-4414-880f-12ff8e52c153 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:51.048785 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9628ab85-ea0e-4414-880f-12ff8e52c153 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:51.077225 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-751e4a2a-3fd5-4241-848a-10ded6d2eb02 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea515c9dbf645828f6f67c9f6bbc541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8512b08f05db4a469827368f47fb4c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:51.089947 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-751e4a2a-3fd5-4241-848a-10ded6d2eb02 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] 10.222.0.13 "GET /compute/v2.1/servers/7d4bddd4-8e9c-49fe-9127-55fd56c151be" status: 200 len: 1504 microversion: 2.1 time: 0.543950 Oct 30 01:41:51.092512 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2708/5397] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:41:50 2022] GET /compute/v2.1/servers/7d4bddd4-8e9c-49fe-9127-55fd56c151be => generated 1504 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:41:51.123645 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7b2e91d2-c204-403e-9b89-d37708f36213 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:51.128689 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7b2e91d2-c204-403e-9b89-d37708f36213 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 2435fb0b-ab56-4368-9965-245b3574d012] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:51.167379 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b2e91d2-c204-403e-9b89-d37708f36213 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:51.185869 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b2e91d2-c204-403e-9b89-d37708f36213 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:51.193998 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b2e91d2-c204-403e-9b89-d37708f36213 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:51.196580 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b2e91d2-c204-403e-9b89-d37708f36213 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:51.198940 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b2e91d2-c204-403e-9b89-d37708f36213 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:51.199678 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b2e91d2-c204-403e-9b89-d37708f36213 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:51.288040 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b2e91d2-c204-403e-9b89-d37708f36213 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:51.288450 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b2e91d2-c204-403e-9b89-d37708f36213 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:51.288885 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b2e91d2-c204-403e-9b89-d37708f36213 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:51.289362 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-7b2e91d2-c204-403e-9b89-d37708f36213 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lazy-loading 'fault' on Instance uuid 2435fb0b-ab56-4368-9965-245b3574d012 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:41:51.428468 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7b2e91d2-c204-403e-9b89-d37708f36213 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba3c4de99ec4a5aae6fb006ab89fdb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1e4ce82aba40a2a013f2d107877b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:51.462750 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7b2e91d2-c204-403e-9b89-d37708f36213 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012" status: 200 len: 1328 microversion: 2.1 time: 0.346785 Oct 30 01:41:51.463905 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2709/5398] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:41:51 2022] GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012 => generated 1328 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:41:51.727811 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9628ab85-ea0e-4414-880f-12ff8e52c153 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:51.740119 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9628ab85-ea0e-4414-880f-12ff8e52c153 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:51.746181 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9628ab85-ea0e-4414-880f-12ff8e52c153 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:51.747687 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9628ab85-ea0e-4414-880f-12ff8e52c153 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1721 microversion: 2.20 time: 0.752178 Oct 30 01:41:51.766029 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2690/5399] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:41:50 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1721 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:41:52.027596 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6a5a3017-3c23-4480-810d-3e60f70d5178 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:52.028430 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6a5a3017-3c23-4480-810d-3e60f70d5178 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:52.054038 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a5a3017-3c23-4480-810d-3e60f70d5178 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:52.055757 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a5a3017-3c23-4480-810d-3e60f70d5178 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:52.057457 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a5a3017-3c23-4480-810d-3e60f70d5178 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:52.059226 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a5a3017-3c23-4480-810d-3e60f70d5178 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:52.059712 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a5a3017-3c23-4480-810d-3e60f70d5178 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:52.060150 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a5a3017-3c23-4480-810d-3e60f70d5178 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:52.086694 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-07943567-a202-402d-bb06-94a5e4cc3a76 req-433923c8-3826-430a-9cbd-240b22bcc6fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d4bddd4-8e9c-49fe-9127-55fd56c151be", "name": "network-vif-deleted", "tag": "b28e2fc9-22cb-4732-a114-116ce70e3d6d"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:41:52.106088 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-07943567-a202-402d-bb06-94a5e4cc3a76 req-433923c8-3826-430a-9cbd-240b22bcc6fc service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:52.106574 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-07943567-a202-402d-bb06-94a5e4cc3a76 req-433923c8-3826-430a-9cbd-240b22bcc6fc service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:52.107005 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-07943567-a202-402d-bb06-94a5e4cc3a76 req-433923c8-3826-430a-9cbd-240b22bcc6fc service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:52.139409 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-07943567-a202-402d-bb06-94a5e4cc3a76 req-433923c8-3826-430a-9cbd-240b22bcc6fc service nova] Creating event network-vif-deleted:b28e2fc9-22cb-4732-a114-116ce70e3d6d for instance 7d4bddd4-8e9c-49fe-9127-55fd56c151be on n-h2-master-1 Oct 30 01:41:52.153643 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-07943567-a202-402d-bb06-94a5e4cc3a76 req-433923c8-3826-430a-9cbd-240b22bcc6fc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069587 Oct 30 01:41:52.156214 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2691/5400] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:41:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:41:52.169907 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1455229d-ff2c-4c68-bfd8-52b79012a650 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:52.172151 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1455229d-ff2c-4c68-bfd8-52b79012a650 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] [instance: 7d4bddd4-8e9c-49fe-9127-55fd56c151be] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:52.191166 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1455229d-ff2c-4c68-bfd8-52b79012a650 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:52.192322 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1455229d-ff2c-4c68-bfd8-52b79012a650 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:52.193946 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1455229d-ff2c-4c68-bfd8-52b79012a650 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:52.195871 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1455229d-ff2c-4c68-bfd8-52b79012a650 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:52.197576 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1455229d-ff2c-4c68-bfd8-52b79012a650 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:52.200531 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1455229d-ff2c-4c68-bfd8-52b79012a650 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:52.240796 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:41:52.606629 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1455229d-ff2c-4c68-bfd8-52b79012a650 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea515c9dbf645828f6f67c9f6bbc541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8512b08f05db4a469827368f47fb4c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:52.619285 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1455229d-ff2c-4c68-bfd8-52b79012a650 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] 10.222.0.13 "GET /compute/v2.1/servers/7d4bddd4-8e9c-49fe-9127-55fd56c151be" status: 200 len: 1462 microversion: 2.1 time: 0.459558 Oct 30 01:41:52.632947 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2692/5401] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:41:52 2022] GET /compute/v2.1/servers/7d4bddd4-8e9c-49fe-9127-55fd56c151be => generated 1462 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:41:52.649641 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-216c6ccc-9dc1-4bdc-b470-faf154c4f473 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:52.649641 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-216c6ccc-9dc1-4bdc-b470-faf154c4f473 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 2435fb0b-ab56-4368-9965-245b3574d012] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:52.671682 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-216c6ccc-9dc1-4bdc-b470-faf154c4f473 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:52.672753 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-216c6ccc-9dc1-4bdc-b470-faf154c4f473 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:52.675207 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-216c6ccc-9dc1-4bdc-b470-faf154c4f473 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:52.677918 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-216c6ccc-9dc1-4bdc-b470-faf154c4f473 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:52.678691 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-216c6ccc-9dc1-4bdc-b470-faf154c4f473 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:52.681358 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-216c6ccc-9dc1-4bdc-b470-faf154c4f473 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:52.716197 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-216c6ccc-9dc1-4bdc-b470-faf154c4f473 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] HTTP exception thrown: Instance 2435fb0b-ab56-4368-9965-245b3574d012 could not be found. Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-216c6ccc-9dc1-4bdc-b470-faf154c4f473 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Request method failure captured: Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012 HTTP/1.1 Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdTqgn2B91_ceQKPoDM1iNAokBfCrWwyIgVilJ-1FJ-YMzDy2MOop6IG0Cc87jPfCxHDogztiWm1uOfmfK_KW4JzuPL-rRntVAmuTzNTJ-P5MxBMW8tUBSZKJtBH4PVeYnsSpbZkSiYmT2c4OLcdNoR6EOdKROXOnLOufaCNiFI0MA4 Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 7c1e4ce82aba40a2a013f2d107877b72 Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-AttachVolumeTestJSON-1714625488 Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7c1e4ce82aba40a2a013f2d107877b72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7c1e4ce82aba40a2a013f2d107877b72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7c1e4ce82aba40a2a013f2d107877b72"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7c1e4ce82aba40a2a013f2d107877b72"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-AttachVolumeTestJSON-1714625488 Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 7c1e4ce82aba40a2a013f2d107877b72 Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1714625488 Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-AttachVolumeTestJSON-1714625488-project Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: aba3c4de99ec4a5aae6fb006ab89fdb9 Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-AttachVolumeTestJSON-1714625488-project Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 2435fb0b-ab56-4368-9965-245b3574d012 could not be found. Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '2435fb0b-ab56-4368-9965-245b3574d012'} Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2435fb0b-ab56-4368-9965-245b3574d012 could not be found. Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2435fb0b-ab56-4368-9965-245b3574d012 could not be found. Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:41:52.719943 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:41:52.723727 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:41:52.723727 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:41:52.723727 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:41:52.723727 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:41:52.723727 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:41:52.723727 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2435fb0b-ab56-4368-9965-245b3574d012 could not be found. Oct 30 01:41:52.723727 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:41:52.729854 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-216c6ccc-9dc1-4bdc-b470-faf154c4f473 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Returning 404 to user: Instance 2435fb0b-ab56-4368-9965-245b3574d012 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:41:52.735049 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-216c6ccc-9dc1-4bdc-b470-faf154c4f473 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012" status: 404 len: 111 microversion: 2.1 time: 0.110003 Oct 30 01:41:52.736206 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2693/5402] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:41:52 2022] GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:41:52.753392 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7cb5398f-5011-401f-87e1-fadb508fdad0 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '.version_select at 0x7f44c6dcce50>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:52.877063 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6a5a3017-3c23-4480-810d-3e60f70d5178 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:52.879800 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7cb5398f-5011-401f-87e1-fadb508fdad0 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1775835975" status: 202 len: 0 microversion: 2.1 time: 0.138423 Oct 30 01:41:52.884255 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2694/5403] 10.222.0.13 () {58 vars in 1221 bytes} [Sun Oct 30 01:41:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1775835975 => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 30 01:41:52.893154 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-25259dc8-8c17-49e5-9c7f-fd7f3b09884c tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:52.903347 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-25259dc8-8c17-49e5-9c7f-fd7f3b09884c tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:52.907365 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6a5a3017-3c23-4480-810d-3e60f70d5178 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:52.915304 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6a5a3017-3c23-4480-810d-3e60f70d5178 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:52.916705 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6a5a3017-3c23-4480-810d-3e60f70d5178 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 2964 microversion: 2.42 time: 0.895718 Oct 30 01:41:52.918407 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2710/5404] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:41:52 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 2964 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:41:52.950857 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25259dc8-8c17-49e5-9c7f-fd7f3b09884c tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:52.951453 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25259dc8-8c17-49e5-9c7f-fd7f3b09884c tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:52.953973 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25259dc8-8c17-49e5-9c7f-fd7f3b09884c tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:52.958749 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25259dc8-8c17-49e5-9c7f-fd7f3b09884c tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:52.958749 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25259dc8-8c17-49e5-9c7f-fd7f3b09884c tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:52.958749 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25259dc8-8c17-49e5-9c7f-fd7f3b09884c tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:53.326353 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-25259dc8-8c17-49e5-9c7f-fd7f3b09884c tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:53.336281 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-25259dc8-8c17-49e5-9c7f-fd7f3b09884c tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:53.341383 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-25259dc8-8c17-49e5-9c7f-fd7f3b09884c tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:53.347420 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-25259dc8-8c17-49e5-9c7f-fd7f3b09884c tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1742 microversion: 2.20 time: 0.466054 Oct 30 01:41:53.349566 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2695/5405] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:41:52 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1742 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:41:53.652649 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6b9f22b3-dc9e-4dad-a037-6e512b878b63 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:53.654736 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6b9f22b3-dc9e-4dad-a037-6e512b878b63 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] [instance: 7d4bddd4-8e9c-49fe-9127-55fd56c151be] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:53.676649 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6b9f22b3-dc9e-4dad-a037-6e512b878b63 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:53.681781 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6b9f22b3-dc9e-4dad-a037-6e512b878b63 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:53.684580 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6b9f22b3-dc9e-4dad-a037-6e512b878b63 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:53.686836 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6b9f22b3-dc9e-4dad-a037-6e512b878b63 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:53.691047 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6b9f22b3-dc9e-4dad-a037-6e512b878b63 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:53.698199 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6b9f22b3-dc9e-4dad-a037-6e512b878b63 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:53.773966 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6b9f22b3-dc9e-4dad-a037-6e512b878b63 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:53.774629 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6b9f22b3-dc9e-4dad-a037-6e512b878b63 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:53.775163 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6b9f22b3-dc9e-4dad-a037-6e512b878b63 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:53.775696 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-6b9f22b3-dc9e-4dad-a037-6e512b878b63 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lazy-loading 'fault' on Instance uuid 7d4bddd4-8e9c-49fe-9127-55fd56c151be {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:41:53.957828 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6b9f22b3-dc9e-4dad-a037-6e512b878b63 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea515c9dbf645828f6f67c9f6bbc541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8512b08f05db4a469827368f47fb4c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:53.962716 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4c361a09-61c6-4cc4-8cbd-871f39f17e76 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:53.964611 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4c361a09-61c6-4cc4-8cbd-871f39f17e76 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:54.000332 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6b9f22b3-dc9e-4dad-a037-6e512b878b63 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] 10.222.0.13 "GET /compute/v2.1/servers/7d4bddd4-8e9c-49fe-9127-55fd56c151be" status: 200 len: 1304 microversion: 2.1 time: 0.342312 Oct 30 01:41:54.000332 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2711/5406] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:41:53 2022] GET /compute/v2.1/servers/7d4bddd4-8e9c-49fe-9127-55fd56c151be => generated 1304 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:41:54.000916 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4c361a09-61c6-4cc4-8cbd-871f39f17e76 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:54.000916 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4c361a09-61c6-4cc4-8cbd-871f39f17e76 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:54.000916 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4c361a09-61c6-4cc4-8cbd-871f39f17e76 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:54.000916 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4c361a09-61c6-4cc4-8cbd-871f39f17e76 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:54.000916 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4c361a09-61c6-4cc4-8cbd-871f39f17e76 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:54.000916 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4c361a09-61c6-4cc4-8cbd-871f39f17e76 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:54.376081 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-71eca870-fe91-4277-9db4-c1f6c0ace140 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:54.376965 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-71eca870-fe91-4277-9db4-c1f6c0ace140 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:54.383223 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4c361a09-61c6-4cc4-8cbd-871f39f17e76 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:54.389202 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-71eca870-fe91-4277-9db4-c1f6c0ace140 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:54.389728 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-71eca870-fe91-4277-9db4-c1f6c0ace140 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:54.390345 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-71eca870-fe91-4277-9db4-c1f6c0ace140 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:54.391871 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-71eca870-fe91-4277-9db4-c1f6c0ace140 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:54.394365 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-71eca870-fe91-4277-9db4-c1f6c0ace140 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:54.395418 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-71eca870-fe91-4277-9db4-c1f6c0ace140 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:54.407464 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4c361a09-61c6-4cc4-8cbd-871f39f17e76 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:54.411546 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4c361a09-61c6-4cc4-8cbd-871f39f17e76 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:54.414512 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4c361a09-61c6-4cc4-8cbd-871f39f17e76 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 2943 microversion: 2.42 time: 0.465457 Oct 30 01:41:54.419818 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2696/5407] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:41:53 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 2943 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:41:54.838445 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-71eca870-fe91-4277-9db4-c1f6c0ace140 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:54.847736 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-71eca870-fe91-4277-9db4-c1f6c0ace140 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:54.849209 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-71eca870-fe91-4277-9db4-c1f6c0ace140 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:54.853832 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-71eca870-fe91-4277-9db4-c1f6c0ace140 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1742 microversion: 2.20 time: 0.482609 Oct 30 01:41:54.856755 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2712/5408] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:41:54 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1742 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:41:55.014160 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0e9855be-4f60-4bfe-a8ec-99b9a0c02626 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:55.016033 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0e9855be-4f60-4bfe-a8ec-99b9a0c02626 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] [instance: 7d4bddd4-8e9c-49fe-9127-55fd56c151be] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:55.032894 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e9855be-4f60-4bfe-a8ec-99b9a0c02626 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:55.034677 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e9855be-4f60-4bfe-a8ec-99b9a0c02626 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:55.035271 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e9855be-4f60-4bfe-a8ec-99b9a0c02626 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:55.040711 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e9855be-4f60-4bfe-a8ec-99b9a0c02626 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:55.041808 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e9855be-4f60-4bfe-a8ec-99b9a0c02626 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:55.047038 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e9855be-4f60-4bfe-a8ec-99b9a0c02626 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:55.077602 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-0e9855be-4f60-4bfe-a8ec-99b9a0c02626 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] HTTP exception thrown: Instance 7d4bddd4-8e9c-49fe-9127-55fd56c151be could not be found. Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0e9855be-4f60-4bfe-a8ec-99b9a0c02626 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Request method failure captured: Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/7d4bddd4-8e9c-49fe-9127-55fd56c151be HTTP/1.1 Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdYgEmU9mU7LCiDO7MF-4Rbmzw0xFEkr7F9ltwnm7BOuuiQ8Cj6JsDEfoC2LfKhzOyAS8eMeo7RpTc6Ce7A53M3HsNDuyF_9YrxoTorP5I9gVlLD9Qrn9HalbXDNZeBcxTOG0VHRDt0-93AZeSlKwMsc_bvATRCxpsEvcw-lP5HTLj8 Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 8512b08f05db4a469827368f47fb4c28 Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-VolumesActionsTest-1713780720 Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8512b08f05db4a469827368f47fb4c28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8512b08f05db4a469827368f47fb4c28"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8512b08f05db4a469827368f47fb4c28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8512b08f05db4a469827368f47fb4c28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-VolumesActionsTest-1713780720 Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 8512b08f05db4a469827368f47fb4c28 Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-VolumesActionsTest-1713780720 Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-VolumesActionsTest-1713780720-project Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 2ea515c9dbf645828f6f67c9f6bbc541 Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-VolumesActionsTest-1713780720-project Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 7d4bddd4-8e9c-49fe-9127-55fd56c151be could not be found. Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '7d4bddd4-8e9c-49fe-9127-55fd56c151be'} Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d4bddd4-8e9c-49fe-9127-55fd56c151be could not be found. Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d4bddd4-8e9c-49fe-9127-55fd56c151be could not be found. Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:41:55.082953 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:41:55.087565 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:41:55.087565 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:41:55.087565 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:41:55.087565 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:41:55.087565 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:41:55.087565 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d4bddd4-8e9c-49fe-9127-55fd56c151be could not be found. Oct 30 01:41:55.087565 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:41:55.095765 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0e9855be-4f60-4bfe-a8ec-99b9a0c02626 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] Returning 404 to user: Instance 7d4bddd4-8e9c-49fe-9127-55fd56c151be could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:41:55.098749 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0e9855be-4f60-4bfe-a8ec-99b9a0c02626 tempest-VolumesActionsTest-1713780720 tempest-VolumesActionsTest-1713780720-project] 10.222.0.13 "GET /compute/v2.1/servers/7d4bddd4-8e9c-49fe-9127-55fd56c151be" status: 404 len: 111 microversion: 2.1 time: 0.090904 Oct 30 01:41:55.104671 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2697/5409] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:41:55 2022] GET /compute/v2.1/servers/7d4bddd4-8e9c-49fe-9127-55fd56c151be => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:41:55.453003 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-84799c5d-e03a-486d-b051-9980ae60630f tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:55.454525 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-84799c5d-e03a-486d-b051-9980ae60630f tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:55.467621 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-8462491f-25c6-47cf-bce9-c537d08b4a54 req-7d33d2ae-aba6-4faf-a35b-9ebc2c982f02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef88e251-1a54-4519-ba22-ddcfa39451f9", "name": "network-vif-unplugged", "status": "completed", "tag": "dac20a34-eccc-48f6-b0ff-646be623ec49"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:41:55.487429 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-84799c5d-e03a-486d-b051-9980ae60630f tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:55.492820 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-84799c5d-e03a-486d-b051-9980ae60630f tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:55.495813 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-84799c5d-e03a-486d-b051-9980ae60630f tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:55.497278 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-84799c5d-e03a-486d-b051-9980ae60630f tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:55.501066 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-84799c5d-e03a-486d-b051-9980ae60630f tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:55.501898 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-84799c5d-e03a-486d-b051-9980ae60630f tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:55.511042 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-8462491f-25c6-47cf-bce9-c537d08b4a54 req-7d33d2ae-aba6-4faf-a35b-9ebc2c982f02 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:55.512446 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-8462491f-25c6-47cf-bce9-c537d08b4a54 req-7d33d2ae-aba6-4faf-a35b-9ebc2c982f02 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:55.513023 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-8462491f-25c6-47cf-bce9-c537d08b4a54 req-7d33d2ae-aba6-4faf-a35b-9ebc2c982f02 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:55.550788 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-8462491f-25c6-47cf-bce9-c537d08b4a54 req-7d33d2ae-aba6-4faf-a35b-9ebc2c982f02 service nova] Creating event network-vif-unplugged:dac20a34-eccc-48f6-b0ff-646be623ec49 for instance ef88e251-1a54-4519-ba22-ddcfa39451f9 on n-h2-master-1 Oct 30 01:41:55.568959 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-8462491f-25c6-47cf-bce9-c537d08b4a54 req-7d33d2ae-aba6-4faf-a35b-9ebc2c982f02 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104468 Oct 30 01:41:55.573257 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2698/5410] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:41:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:41:55.883586 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-11b5b39c-9a3c-4961-91fe-0741c64e5c9b tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:55.884872 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-11b5b39c-9a3c-4961-91fe-0741c64e5c9b tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:55.902442 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-11b5b39c-9a3c-4961-91fe-0741c64e5c9b tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:55.902442 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-11b5b39c-9a3c-4961-91fe-0741c64e5c9b tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:55.902442 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-11b5b39c-9a3c-4961-91fe-0741c64e5c9b tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:55.910692 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-11b5b39c-9a3c-4961-91fe-0741c64e5c9b tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:55.915260 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-11b5b39c-9a3c-4961-91fe-0741c64e5c9b tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:55.916958 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-11b5b39c-9a3c-4961-91fe-0741c64e5c9b tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:56.511363 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-84799c5d-e03a-486d-b051-9980ae60630f tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:56.535473 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-84799c5d-e03a-486d-b051-9980ae60630f tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:56.544642 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-84799c5d-e03a-486d-b051-9980ae60630f tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:56.546464 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-84799c5d-e03a-486d-b051-9980ae60630f tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 2922 microversion: 2.42 time: 1.101005 Oct 30 01:41:56.553536 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2713/5411] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:41:55 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 2922 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:41:56.685066 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-6bad26c2-d690-450c-86d7-0cf47ec004ad req-912327af-a747-4c73-be2b-f0a3c9bb7581 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef88e251-1a54-4519-ba22-ddcfa39451f9", "name": "network-vif-deleted", "tag": "dac20a34-eccc-48f6-b0ff-646be623ec49"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:41:56.700714 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-11b5b39c-9a3c-4961-91fe-0741c64e5c9b tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:56.726024 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-11b5b39c-9a3c-4961-91fe-0741c64e5c9b tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:56.729644 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-6bad26c2-d690-450c-86d7-0cf47ec004ad req-912327af-a747-4c73-be2b-f0a3c9bb7581 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:56.733641 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-6bad26c2-d690-450c-86d7-0cf47ec004ad req-912327af-a747-4c73-be2b-f0a3c9bb7581 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:56.733641 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-6bad26c2-d690-450c-86d7-0cf47ec004ad req-912327af-a747-4c73-be2b-f0a3c9bb7581 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:56.746620 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-11b5b39c-9a3c-4961-91fe-0741c64e5c9b tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:56.747877 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-11b5b39c-9a3c-4961-91fe-0741c64e5c9b tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1737 microversion: 2.20 time: 0.869356 Oct 30 01:41:56.778072 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2699/5412] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:41:55 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1737 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:41:56.794266 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-6bad26c2-d690-450c-86d7-0cf47ec004ad req-912327af-a747-4c73-be2b-f0a3c9bb7581 service nova] Creating event network-vif-deleted:dac20a34-eccc-48f6-b0ff-646be623ec49 for instance ef88e251-1a54-4519-ba22-ddcfa39451f9 on n-h2-master-1 Oct 30 01:41:56.822346 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-6bad26c2-d690-450c-86d7-0cf47ec004ad req-912327af-a747-4c73-be2b-f0a3c9bb7581 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140491 Oct 30 01:41:56.823375 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2714/5413] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:41:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:41:57.580675 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3670a0b8-a76f-40f6-a1bc-a5110989f639 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:57.581424 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3670a0b8-a76f-40f6-a1bc-a5110989f639 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:57.596193 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3670a0b8-a76f-40f6-a1bc-a5110989f639 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:57.597259 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3670a0b8-a76f-40f6-a1bc-a5110989f639 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:57.599406 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3670a0b8-a76f-40f6-a1bc-a5110989f639 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:57.600626 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3670a0b8-a76f-40f6-a1bc-a5110989f639 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:57.603734 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3670a0b8-a76f-40f6-a1bc-a5110989f639 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:57.606276 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3670a0b8-a76f-40f6-a1bc-a5110989f639 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:57.716010 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-7c4637da-4f0a-44b5-aa04-1de39bde7c8f req-004464df-489f-4235-abcd-f6d3eab94f45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef88e251-1a54-4519-ba22-ddcfa39451f9", "name": "network-vif-unplugged", "status": "completed", "tag": "8b3d8d2b-c04a-49f0-ac61-050342907eee"}, {"server_uuid": "ef88e251-1a54-4519-ba22-ddcfa39451f9", "name": "network-vif-unplugged", "status": "completed", "tag": "2cb96018-5b01-4537-93d5-c8b744320064"}, {"server_uuid": "b2e35e69-66f2-43a0-9baa-d8f70437561d", "name": "network-vif-plugged", "status": "completed", "tag": "6657440b-da45-40cf-ae87-7a3d5beeb7a4"}, {"server_uuid": "ef88e251-1a54-4519-ba22-ddcfa39451f9", "name": "network-vif-unplugged", "status": "completed", "tag": "0811537c-a662-478e-a5e0-ddeeb0322f5a"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:41:57.759486 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-7c4637da-4f0a-44b5-aa04-1de39bde7c8f req-004464df-489f-4235-abcd-f6d3eab94f45 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:57.767824 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-7c4637da-4f0a-44b5-aa04-1de39bde7c8f req-004464df-489f-4235-abcd-f6d3eab94f45 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:57.768436 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-7c4637da-4f0a-44b5-aa04-1de39bde7c8f req-004464df-489f-4235-abcd-f6d3eab94f45 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:57.796569 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-7c4637da-4f0a-44b5-aa04-1de39bde7c8f req-004464df-489f-4235-abcd-f6d3eab94f45 service nova] Creating event network-vif-unplugged:8b3d8d2b-c04a-49f0-ac61-050342907eee for instance ef88e251-1a54-4519-ba22-ddcfa39451f9 on n-h2-master-1 Oct 30 01:41:57.798977 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-7c4637da-4f0a-44b5-aa04-1de39bde7c8f req-004464df-489f-4235-abcd-f6d3eab94f45 service nova] Creating event network-vif-unplugged:2cb96018-5b01-4537-93d5-c8b744320064 for instance ef88e251-1a54-4519-ba22-ddcfa39451f9 on n-h2-master-1 Oct 30 01:41:57.802253 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-7c4637da-4f0a-44b5-aa04-1de39bde7c8f req-004464df-489f-4235-abcd-f6d3eab94f45 service nova] Creating event network-vif-plugged:6657440b-da45-40cf-ae87-7a3d5beeb7a4 for instance b2e35e69-66f2-43a0-9baa-d8f70437561d on n-h1-master-1 Oct 30 01:41:57.803203 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-7c4637da-4f0a-44b5-aa04-1de39bde7c8f req-004464df-489f-4235-abcd-f6d3eab94f45 service nova] Creating event network-vif-unplugged:0811537c-a662-478e-a5e0-ddeeb0322f5a for instance ef88e251-1a54-4519-ba22-ddcfa39451f9 on n-h2-master-1 Oct 30 01:41:57.822902 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-7c4637da-4f0a-44b5-aa04-1de39bde7c8f req-004464df-489f-4235-abcd-f6d3eab94f45 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 702 microversion: 2.1 time: 0.111022 Oct 30 01:41:57.829939 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2715/5414] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:41:57 2022] POST /compute/v2.1/os-server-external-events => generated 702 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:41:57.837034 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-684d548b-6f7b-4a01-a34d-7214bd6e83b2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:57.841824 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-684d548b-6f7b-4a01-a34d-7214bd6e83b2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:57.860967 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-684d548b-6f7b-4a01-a34d-7214bd6e83b2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:57.863087 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-684d548b-6f7b-4a01-a34d-7214bd6e83b2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:57.865752 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-684d548b-6f7b-4a01-a34d-7214bd6e83b2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:57.866708 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-684d548b-6f7b-4a01-a34d-7214bd6e83b2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:57.867331 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-684d548b-6f7b-4a01-a34d-7214bd6e83b2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:57.869818 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-684d548b-6f7b-4a01-a34d-7214bd6e83b2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:58.514128 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-684d548b-6f7b-4a01-a34d-7214bd6e83b2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:58.524755 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-684d548b-6f7b-4a01-a34d-7214bd6e83b2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:58.542086 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-684d548b-6f7b-4a01-a34d-7214bd6e83b2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:58.543855 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-684d548b-6f7b-4a01-a34d-7214bd6e83b2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1737 microversion: 2.20 time: 0.712580 Oct 30 01:41:58.546135 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2716/5415] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:41:57 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1737 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:41:58.575503 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3670a0b8-a76f-40f6-a1bc-a5110989f639 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:58.592048 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3670a0b8-a76f-40f6-a1bc-a5110989f639 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:58.598680 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3670a0b8-a76f-40f6-a1bc-a5110989f639 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:41:58.608200 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3670a0b8-a76f-40f6-a1bc-a5110989f639 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 2761 microversion: 2.42 time: 1.031730 Oct 30 01:41:58.620869 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2700/5416] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:41:57 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 2761 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:41:58.925036 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-c4b9ce29-20cd-4b13-b4dd-9e1a26aedd50 req-ac1ccadc-b24e-4ec0-ae7e-0281773c1ecd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef88e251-1a54-4519-ba22-ddcfa39451f9", "name": "network-vif-deleted", "tag": "24b50323-80bd-4825-8628-29f3a47cc19a"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:41:58.971438 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-c4b9ce29-20cd-4b13-b4dd-9e1a26aedd50 req-ac1ccadc-b24e-4ec0-ae7e-0281773c1ecd service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:58.974498 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-c4b9ce29-20cd-4b13-b4dd-9e1a26aedd50 req-ac1ccadc-b24e-4ec0-ae7e-0281773c1ecd service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:58.976057 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-c4b9ce29-20cd-4b13-b4dd-9e1a26aedd50 req-ac1ccadc-b24e-4ec0-ae7e-0281773c1ecd service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:59.050231 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-c4b9ce29-20cd-4b13-b4dd-9e1a26aedd50 req-ac1ccadc-b24e-4ec0-ae7e-0281773c1ecd service nova] Creating event network-vif-deleted:24b50323-80bd-4825-8628-29f3a47cc19a for instance ef88e251-1a54-4519-ba22-ddcfa39451f9 on n-h2-master-1 Oct 30 01:41:59.075392 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-c4b9ce29-20cd-4b13-b4dd-9e1a26aedd50 req-ac1ccadc-b24e-4ec0-ae7e-0281773c1ecd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159337 Oct 30 01:41:59.082289 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2717/5417] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:41:59.575005 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b3d5f9b6-9e36-43ce-9a39-e8450627f3c1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:59.575890 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b3d5f9b6-9e36-43ce-9a39-e8450627f3c1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:59.594835 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b3d5f9b6-9e36-43ce-9a39-e8450627f3c1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:59.602116 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b3d5f9b6-9e36-43ce-9a39-e8450627f3c1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:59.605232 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b3d5f9b6-9e36-43ce-9a39-e8450627f3c1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:59.606206 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b3d5f9b6-9e36-43ce-9a39-e8450627f3c1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:59.606822 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b3d5f9b6-9e36-43ce-9a39-e8450627f3c1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:59.615578 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b3d5f9b6-9e36-43ce-9a39-e8450627f3c1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:59.662957 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-819416ef-f6e5-439a-b015-1618da5ca81b tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:41:59.663670 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-819416ef-f6e5-439a-b015-1618da5ca81b tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:41:59.673683 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-819416ef-f6e5-439a-b015-1618da5ca81b tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:59.678831 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-819416ef-f6e5-439a-b015-1618da5ca81b tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:59.679297 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-819416ef-f6e5-439a-b015-1618da5ca81b tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:41:59.682769 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-819416ef-f6e5-439a-b015-1618da5ca81b tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:41:59.685637 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-819416ef-f6e5-439a-b015-1618da5ca81b tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:41:59.686588 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-819416ef-f6e5-439a-b015-1618da5ca81b tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:00.666693 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b3d5f9b6-9e36-43ce-9a39-e8450627f3c1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:00.680543 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b3d5f9b6-9e36-43ce-9a39-e8450627f3c1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:00.686159 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b3d5f9b6-9e36-43ce-9a39-e8450627f3c1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:00.687666 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b3d5f9b6-9e36-43ce-9a39-e8450627f3c1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1737 microversion: 2.20 time: 1.116807 Oct 30 01:42:00.706726 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2701/5418] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:41:59 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1737 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:42:00.822905 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-819416ef-f6e5-439a-b015-1618da5ca81b tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:00.866211 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-819416ef-f6e5-439a-b015-1618da5ca81b tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:00.868278 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-819416ef-f6e5-439a-b015-1618da5ca81b tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:00.881196 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-819416ef-f6e5-439a-b015-1618da5ca81b tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 2553 microversion: 2.42 time: 1.215791 Oct 30 01:42:00.894907 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2718/5419] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:41:59 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 2553 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:42:01.162416 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-8094106f-dd30-4ce5-9e80-ffd9395c9e18 req-8c856301-8fdb-4cd3-99f2-6eaa806b95a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef88e251-1a54-4519-ba22-ddcfa39451f9", "name": "network-vif-deleted", "tag": "0811537c-a662-478e-a5e0-ddeeb0322f5a"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:42:01.181316 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:01.197940 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-8094106f-dd30-4ce5-9e80-ffd9395c9e18 req-8c856301-8fdb-4cd3-99f2-6eaa806b95a9 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:01.198483 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-8094106f-dd30-4ce5-9e80-ffd9395c9e18 req-8c856301-8fdb-4cd3-99f2-6eaa806b95a9 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:01.198935 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-8094106f-dd30-4ce5-9e80-ffd9395c9e18 req-8c856301-8fdb-4cd3-99f2-6eaa806b95a9 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:01.269598 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-8094106f-dd30-4ce5-9e80-ffd9395c9e18 req-8c856301-8fdb-4cd3-99f2-6eaa806b95a9 service nova] Creating event network-vif-deleted:0811537c-a662-478e-a5e0-ddeeb0322f5a for instance ef88e251-1a54-4519-ba22-ddcfa39451f9 on n-h2-master-1 Oct 30 01:42:01.298263 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-8094106f-dd30-4ce5-9e80-ffd9395c9e18 req-8c856301-8fdb-4cd3-99f2-6eaa806b95a9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137207 Oct 30 01:42:01.301899 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2702/5420] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:42:01.722186 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-998b13d5-90e6-44e2-929b-9aa87ae686e1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:01.723319 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-998b13d5-90e6-44e2-929b-9aa87ae686e1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:01.740411 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-998b13d5-90e6-44e2-929b-9aa87ae686e1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:01.742803 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-998b13d5-90e6-44e2-929b-9aa87ae686e1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:01.744078 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-998b13d5-90e6-44e2-929b-9aa87ae686e1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:01.752921 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-998b13d5-90e6-44e2-929b-9aa87ae686e1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:01.752921 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-998b13d5-90e6-44e2-929b-9aa87ae686e1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:01.752921 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-998b13d5-90e6-44e2-929b-9aa87ae686e1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:01.930772 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-edfce226-7a67-4901-9ec2-6166e41ab45a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:01.931491 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-edfce226-7a67-4901-9ec2-6166e41ab45a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:01.957185 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-edfce226-7a67-4901-9ec2-6166e41ab45a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:01.960635 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-edfce226-7a67-4901-9ec2-6166e41ab45a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:01.961103 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-edfce226-7a67-4901-9ec2-6166e41ab45a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:01.973380 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-edfce226-7a67-4901-9ec2-6166e41ab45a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:01.974425 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-edfce226-7a67-4901-9ec2-6166e41ab45a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:01.979260 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-edfce226-7a67-4901-9ec2-6166e41ab45a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:02.466229 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-998b13d5-90e6-44e2-929b-9aa87ae686e1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:02.469549 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:02.484250 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-998b13d5-90e6-44e2-929b-9aa87ae686e1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:02.486436 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-998b13d5-90e6-44e2-929b-9aa87ae686e1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:02.495803 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-998b13d5-90e6-44e2-929b-9aa87ae686e1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1737 microversion: 2.20 time: 0.778190 Oct 30 01:42:02.518706 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2719/5421] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:01 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1737 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:42:02.922751 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-edfce226-7a67-4901-9ec2-6166e41ab45a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:02.946040 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-edfce226-7a67-4901-9ec2-6166e41ab45a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:02.948305 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-edfce226-7a67-4901-9ec2-6166e41ab45a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:02.964795 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-edfce226-7a67-4901-9ec2-6166e41ab45a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 2349 microversion: 2.42 time: 1.036661 Oct 30 01:42:02.976739 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2703/5422] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:01 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 2349 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:42:03.558326 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c9a96b23-5776-494c-8a29-54f032bd5ad4 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:03.558955 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c9a96b23-5776-494c-8a29-54f032bd5ad4 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:03.675009 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c9a96b23-5776-494c-8a29-54f032bd5ad4 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:03.675009 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c9a96b23-5776-494c-8a29-54f032bd5ad4 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:03.675009 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c9a96b23-5776-494c-8a29-54f032bd5ad4 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:03.675009 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c9a96b23-5776-494c-8a29-54f032bd5ad4 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:03.675009 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c9a96b23-5776-494c-8a29-54f032bd5ad4 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:03.675009 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c9a96b23-5776-494c-8a29-54f032bd5ad4 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:03.694953 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-519daa13-16ac-4a3e-83fe-0b53aff103f2 req-881f3a04-112f-4a07-bc33-3bf0290efdf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef88e251-1a54-4519-ba22-ddcfa39451f9", "name": "network-vif-deleted", "tag": "8b3d8d2b-c04a-49f0-ac61-050342907eee"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:42:03.722811 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-519daa13-16ac-4a3e-83fe-0b53aff103f2 req-881f3a04-112f-4a07-bc33-3bf0290efdf1 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:03.723420 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-519daa13-16ac-4a3e-83fe-0b53aff103f2 req-881f3a04-112f-4a07-bc33-3bf0290efdf1 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:03.727324 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-519daa13-16ac-4a3e-83fe-0b53aff103f2 req-881f3a04-112f-4a07-bc33-3bf0290efdf1 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:03.798349 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-519daa13-16ac-4a3e-83fe-0b53aff103f2 req-881f3a04-112f-4a07-bc33-3bf0290efdf1 service nova] Creating event network-vif-deleted:8b3d8d2b-c04a-49f0-ac61-050342907eee for instance ef88e251-1a54-4519-ba22-ddcfa39451f9 on n-h2-master-1 Oct 30 01:42:03.817244 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-519daa13-16ac-4a3e-83fe-0b53aff103f2 req-881f3a04-112f-4a07-bc33-3bf0290efdf1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118437 Oct 30 01:42:03.817968 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2704/5423] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:42:04.012214 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3cd77485-a307-4168-817f-47f3af3ce098 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:04.015648 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3cd77485-a307-4168-817f-47f3af3ce098 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:04.031568 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3cd77485-a307-4168-817f-47f3af3ce098 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:04.033371 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3cd77485-a307-4168-817f-47f3af3ce098 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:04.039098 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3cd77485-a307-4168-817f-47f3af3ce098 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:04.040311 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3cd77485-a307-4168-817f-47f3af3ce098 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:04.041108 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3cd77485-a307-4168-817f-47f3af3ce098 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:04.041863 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3cd77485-a307-4168-817f-47f3af3ce098 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:04.205215 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c9a96b23-5776-494c-8a29-54f032bd5ad4 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:04.216289 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c9a96b23-5776-494c-8a29-54f032bd5ad4 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:04.217706 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c9a96b23-5776-494c-8a29-54f032bd5ad4 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:04.218900 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c9a96b23-5776-494c-8a29-54f032bd5ad4 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1737 microversion: 2.20 time: 0.691940 Oct 30 01:42:04.219659 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2720/5424] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:03 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1737 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:42:04.343103 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3cd77485-a307-4168-817f-47f3af3ce098 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:04.355264 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3cd77485-a307-4168-817f-47f3af3ce098 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:04.360800 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3cd77485-a307-4168-817f-47f3af3ce098 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:04.362707 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3cd77485-a307-4168-817f-47f3af3ce098 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 2349 microversion: 2.42 time: 0.355719 Oct 30 01:42:04.376040 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2705/5425] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:04 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 2349 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:42:05.251013 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3effd2ab-e827-4ee7-8ae2-7509e70ab9ba tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:05.258413 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3effd2ab-e827-4ee7-8ae2-7509e70ab9ba tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:05.271433 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3effd2ab-e827-4ee7-8ae2-7509e70ab9ba tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:05.271901 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3effd2ab-e827-4ee7-8ae2-7509e70ab9ba tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:05.283362 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3effd2ab-e827-4ee7-8ae2-7509e70ab9ba tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:05.287870 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3effd2ab-e827-4ee7-8ae2-7509e70ab9ba tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:05.294054 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3effd2ab-e827-4ee7-8ae2-7509e70ab9ba tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:05.294745 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3effd2ab-e827-4ee7-8ae2-7509e70ab9ba tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:05.395087 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3d2f660f-a2eb-47be-903b-1c5ab2685bf8 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:05.396164 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3d2f660f-a2eb-47be-903b-1c5ab2685bf8 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:05.423753 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d2f660f-a2eb-47be-903b-1c5ab2685bf8 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:05.437795 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d2f660f-a2eb-47be-903b-1c5ab2685bf8 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:05.440870 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d2f660f-a2eb-47be-903b-1c5ab2685bf8 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:05.441687 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d2f660f-a2eb-47be-903b-1c5ab2685bf8 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:05.442331 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d2f660f-a2eb-47be-903b-1c5ab2685bf8 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:05.442940 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d2f660f-a2eb-47be-903b-1c5ab2685bf8 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:05.789030 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3d2f660f-a2eb-47be-903b-1c5ab2685bf8 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:05.798937 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3d2f660f-a2eb-47be-903b-1c5ab2685bf8 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:05.812778 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3d2f660f-a2eb-47be-903b-1c5ab2685bf8 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:05.818408 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3d2f660f-a2eb-47be-903b-1c5ab2685bf8 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1605 microversion: 2.42 time: 0.427938 Oct 30 01:42:05.822456 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2706/5426] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:05 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1605 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:42:05.847253 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3effd2ab-e827-4ee7-8ae2-7509e70ab9ba tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:05.856536 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3effd2ab-e827-4ee7-8ae2-7509e70ab9ba tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:05.875834 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3effd2ab-e827-4ee7-8ae2-7509e70ab9ba tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:05.879690 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3effd2ab-e827-4ee7-8ae2-7509e70ab9ba tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1737 microversion: 2.20 time: 0.634326 Oct 30 01:42:05.879690 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2721/5427] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:05 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1737 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:42:05.919694 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-60c5cb20-c93d-4762-848c-ecda6d00baa7 req-49ea3f50-53fb-4f5a-829d-ae85963c2f4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef88e251-1a54-4519-ba22-ddcfa39451f9", "name": "network-vif-deleted", "tag": "2cb96018-5b01-4537-93d5-c8b744320064"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:42:05.944172 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-60c5cb20-c93d-4762-848c-ecda6d00baa7 req-49ea3f50-53fb-4f5a-829d-ae85963c2f4f service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:05.944172 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-60c5cb20-c93d-4762-848c-ecda6d00baa7 req-49ea3f50-53fb-4f5a-829d-ae85963c2f4f service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:05.944524 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-60c5cb20-c93d-4762-848c-ecda6d00baa7 req-49ea3f50-53fb-4f5a-829d-ae85963c2f4f service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:05.977251 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-60c5cb20-c93d-4762-848c-ecda6d00baa7 req-49ea3f50-53fb-4f5a-829d-ae85963c2f4f service nova] Creating event network-vif-deleted:2cb96018-5b01-4537-93d5-c8b744320064 for instance ef88e251-1a54-4519-ba22-ddcfa39451f9 on n-h2-master-1 Oct 30 01:42:06.019353 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-60c5cb20-c93d-4762-848c-ecda6d00baa7 req-49ea3f50-53fb-4f5a-829d-ae85963c2f4f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103124 Oct 30 01:42:06.021926 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2707/5428] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:42:06.857182 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4a7dc2b1-c6d6-46aa-9255-be2553c63b17 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:06.857827 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4a7dc2b1-c6d6-46aa-9255-be2553c63b17 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:06.882634 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:06.888974 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4a7dc2b1-c6d6-46aa-9255-be2553c63b17 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:06.889516 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4a7dc2b1-c6d6-46aa-9255-be2553c63b17 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:06.889959 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4a7dc2b1-c6d6-46aa-9255-be2553c63b17 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:06.891297 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4a7dc2b1-c6d6-46aa-9255-be2553c63b17 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:06.912419 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7012066d-fe22-43b2-9e81-ab1eeb3d7021 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:06.914129 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7012066d-fe22-43b2-9e81-ab1eeb3d7021 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:06.918514 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4a7dc2b1-c6d6-46aa-9255-be2553c63b17 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:06.921468 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4a7dc2b1-c6d6-46aa-9255-be2553c63b17 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:06.956442 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7012066d-fe22-43b2-9e81-ab1eeb3d7021 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:06.962908 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7012066d-fe22-43b2-9e81-ab1eeb3d7021 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:06.963435 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7012066d-fe22-43b2-9e81-ab1eeb3d7021 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:06.964288 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7012066d-fe22-43b2-9e81-ab1eeb3d7021 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:06.964856 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7012066d-fe22-43b2-9e81-ab1eeb3d7021 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:06.965178 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7012066d-fe22-43b2-9e81-ab1eeb3d7021 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:07.108702 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4a7dc2b1-c6d6-46aa-9255-be2553c63b17 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:07.119408 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4a7dc2b1-c6d6-46aa-9255-be2553c63b17 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:07.145048 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4a7dc2b1-c6d6-46aa-9255-be2553c63b17 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:07.146397 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4a7dc2b1-c6d6-46aa-9255-be2553c63b17 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1605 microversion: 2.42 time: 0.293833 Oct 30 01:42:07.151873 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2722/5429] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:06 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1605 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:42:07.282207 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-48f7a49a-1099-460c-81f4-44d554da8300 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:07.284331 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-48f7a49a-1099-460c-81f4-44d554da8300 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:07.300115 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-48f7a49a-1099-460c-81f4-44d554da8300 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:07.300640 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-48f7a49a-1099-460c-81f4-44d554da8300 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:07.302245 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-48f7a49a-1099-460c-81f4-44d554da8300 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:07.302995 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-48f7a49a-1099-460c-81f4-44d554da8300 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:07.303456 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-48f7a49a-1099-460c-81f4-44d554da8300 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:07.308158 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-48f7a49a-1099-460c-81f4-44d554da8300 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:07.353029 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7012066d-fe22-43b2-9e81-ab1eeb3d7021 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:07.384719 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7012066d-fe22-43b2-9e81-ab1eeb3d7021 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:07.385630 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7012066d-fe22-43b2-9e81-ab1eeb3d7021 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:07.392010 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7012066d-fe22-43b2-9e81-ab1eeb3d7021 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1737 microversion: 2.20 time: 0.485263 Oct 30 01:42:07.394128 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2708/5430] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:06 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1737 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:42:07.966887 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-48f7a49a-1099-460c-81f4-44d554da8300 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:07.998592 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-48f7a49a-1099-460c-81f4-44d554da8300 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1683 microversion: 2.1 time: 0.721132 Oct 30 01:42:08.002681 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2723/5431] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:42:07 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1683 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:42:08.179726 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ceeaf286-34b7-4723-a3a7-513719d70cbd tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:08.180351 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ceeaf286-34b7-4723-a3a7-513719d70cbd tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:08.193026 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ceeaf286-34b7-4723-a3a7-513719d70cbd tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:08.193560 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ceeaf286-34b7-4723-a3a7-513719d70cbd tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:08.194005 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ceeaf286-34b7-4723-a3a7-513719d70cbd tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:08.194720 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ceeaf286-34b7-4723-a3a7-513719d70cbd tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:08.195179 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ceeaf286-34b7-4723-a3a7-513719d70cbd tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:08.195604 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ceeaf286-34b7-4723-a3a7-513719d70cbd tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:08.422656 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-30b80674-294a-4ea9-ad3d-86b4cfbf64c2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:08.423302 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-30b80674-294a-4ea9-ad3d-86b4cfbf64c2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:08.433643 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ceeaf286-34b7-4723-a3a7-513719d70cbd tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:08.440539 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-30b80674-294a-4ea9-ad3d-86b4cfbf64c2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:08.442645 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-30b80674-294a-4ea9-ad3d-86b4cfbf64c2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:08.446066 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-30b80674-294a-4ea9-ad3d-86b4cfbf64c2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:08.446218 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ceeaf286-34b7-4723-a3a7-513719d70cbd tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:08.448364 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ceeaf286-34b7-4723-a3a7-513719d70cbd tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:08.450466 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ceeaf286-34b7-4723-a3a7-513719d70cbd tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1605 microversion: 2.42 time: 0.274805 Oct 30 01:42:08.451097 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-30b80674-294a-4ea9-ad3d-86b4cfbf64c2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:08.451724 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-30b80674-294a-4ea9-ad3d-86b4cfbf64c2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:08.454016 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2709/5432] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:08 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1605 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:42:08.459956 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-30b80674-294a-4ea9-ad3d-86b4cfbf64c2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:09.028509 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b6957253-8990-4c79-ad13-46ec6120f706 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:09.029440 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b6957253-8990-4c79-ad13-46ec6120f706 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:09.051327 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b6957253-8990-4c79-ad13-46ec6120f706 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:09.056627 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b6957253-8990-4c79-ad13-46ec6120f706 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:09.057400 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b6957253-8990-4c79-ad13-46ec6120f706 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:09.060998 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b6957253-8990-4c79-ad13-46ec6120f706 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:09.065001 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b6957253-8990-4c79-ad13-46ec6120f706 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:09.067102 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b6957253-8990-4c79-ad13-46ec6120f706 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:09.268304 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-30b80674-294a-4ea9-ad3d-86b4cfbf64c2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:09.286940 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-30b80674-294a-4ea9-ad3d-86b4cfbf64c2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:09.291720 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-30b80674-294a-4ea9-ad3d-86b4cfbf64c2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:09.304351 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-30b80674-294a-4ea9-ad3d-86b4cfbf64c2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1737 microversion: 2.20 time: 0.883898 Oct 30 01:42:09.319498 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2724/5433] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:08 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1737 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:42:09.486144 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ccc50946-acfb-44e1-ab5f-5b4516722ba6 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:09.487057 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ccc50946-acfb-44e1-ab5f-5b4516722ba6 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:09.507678 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ccc50946-acfb-44e1-ab5f-5b4516722ba6 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:09.510362 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ccc50946-acfb-44e1-ab5f-5b4516722ba6 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:09.512994 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ccc50946-acfb-44e1-ab5f-5b4516722ba6 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:09.514042 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ccc50946-acfb-44e1-ab5f-5b4516722ba6 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:09.515197 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ccc50946-acfb-44e1-ab5f-5b4516722ba6 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:09.516907 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ccc50946-acfb-44e1-ab5f-5b4516722ba6 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:09.744177 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ccc50946-acfb-44e1-ab5f-5b4516722ba6 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:09.770535 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ccc50946-acfb-44e1-ab5f-5b4516722ba6 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:09.775202 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ccc50946-acfb-44e1-ab5f-5b4516722ba6 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:09.776788 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ccc50946-acfb-44e1-ab5f-5b4516722ba6 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1605 microversion: 2.42 time: 0.295228 Oct 30 01:42:09.782915 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2725/5434] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:09 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1605 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:42:09.800295 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b6957253-8990-4c79-ad13-46ec6120f706 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:09.821218 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b6957253-8990-4c79-ad13-46ec6120f706 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1670 microversion: 2.1 time: 0.786226 Oct 30 01:42:09.823015 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2710/5435] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:42:09 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1670 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:42:09.852308 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-31a6d023-65df-4e20-bfaf-0371d50251d9 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-121700921"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:42:09.857009 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-31a6d023-65df-4e20-bfaf-0371d50251d9 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:09.874472 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-31a6d023-65df-4e20-bfaf-0371d50251d9 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:09.879297 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-31a6d023-65df-4e20-bfaf-0371d50251d9 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:09.879938 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-31a6d023-65df-4e20-bfaf-0371d50251d9 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:09.882780 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-31a6d023-65df-4e20-bfaf-0371d50251d9 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:09.885469 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-31a6d023-65df-4e20-bfaf-0371d50251d9 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:09.886630 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-31a6d023-65df-4e20-bfaf-0371d50251d9 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:10.338692 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8c8dd4b6-7e8f-4d25-8416-ca07c8a67c4c tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:10.339299 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8c8dd4b6-7e8f-4d25-8416-ca07c8a67c4c tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:10.357652 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8c8dd4b6-7e8f-4d25-8416-ca07c8a67c4c tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:10.358135 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8c8dd4b6-7e8f-4d25-8416-ca07c8a67c4c tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:10.358568 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8c8dd4b6-7e8f-4d25-8416-ca07c8a67c4c tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:10.359321 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8c8dd4b6-7e8f-4d25-8416-ca07c8a67c4c tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:10.359770 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8c8dd4b6-7e8f-4d25-8416-ca07c8a67c4c tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:10.360190 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8c8dd4b6-7e8f-4d25-8416-ca07c8a67c4c tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:10.932194 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8c8dd4b6-7e8f-4d25-8416-ca07c8a67c4c tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:10.950647 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8c8dd4b6-7e8f-4d25-8416-ca07c8a67c4c tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:10.959942 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8c8dd4b6-7e8f-4d25-8416-ca07c8a67c4c tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:10.964383 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8c8dd4b6-7e8f-4d25-8416-ca07c8a67c4c tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1737 microversion: 2.20 time: 0.628010 Oct 30 01:42:10.967086 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2711/5436] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:10 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1737 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:42:10.980308 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bbcc5980-5304-4b8e-8e89-6cd324cb9f6d tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:10.980939 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bbcc5980-5304-4b8e-8e89-6cd324cb9f6d tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:11.002076 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bbcc5980-5304-4b8e-8e89-6cd324cb9f6d tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:11.003034 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bbcc5980-5304-4b8e-8e89-6cd324cb9f6d tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:11.004222 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bbcc5980-5304-4b8e-8e89-6cd324cb9f6d tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:11.004972 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bbcc5980-5304-4b8e-8e89-6cd324cb9f6d tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:11.005456 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bbcc5980-5304-4b8e-8e89-6cd324cb9f6d tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:11.005882 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bbcc5980-5304-4b8e-8e89-6cd324cb9f6d tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:11.242828 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bbcc5980-5304-4b8e-8e89-6cd324cb9f6d tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:11.252715 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bbcc5980-5304-4b8e-8e89-6cd324cb9f6d tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:11.265511 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bbcc5980-5304-4b8e-8e89-6cd324cb9f6d tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:11.266751 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bbcc5980-5304-4b8e-8e89-6cd324cb9f6d tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1605 microversion: 2.42 time: 0.298329 Oct 30 01:42:11.267321 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2712/5437] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:10 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1605 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:42:11.996812 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1898f15e-044c-42cd-9d54-859d2bab4b8b tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:11.997941 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1898f15e-044c-42cd-9d54-859d2bab4b8b tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:12.030111 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1898f15e-044c-42cd-9d54-859d2bab4b8b tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:12.030111 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1898f15e-044c-42cd-9d54-859d2bab4b8b tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:12.030829 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1898f15e-044c-42cd-9d54-859d2bab4b8b tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:12.032267 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1898f15e-044c-42cd-9d54-859d2bab4b8b tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:12.034122 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1898f15e-044c-42cd-9d54-859d2bab4b8b tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:12.037840 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1898f15e-044c-42cd-9d54-859d2bab4b8b tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:12.501878 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1898f15e-044c-42cd-9d54-859d2bab4b8b tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:12.513710 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1898f15e-044c-42cd-9d54-859d2bab4b8b tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:12.521455 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1898f15e-044c-42cd-9d54-859d2bab4b8b tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:12.526671 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1898f15e-044c-42cd-9d54-859d2bab4b8b tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1737 microversion: 2.20 time: 0.534642 Oct 30 01:42:12.527798 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2713/5438] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:11 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1737 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:42:12.548036 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6b571043-45c2-4544-8466-598520fd8c92 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:12.549565 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6b571043-45c2-4544-8466-598520fd8c92 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:12.565803 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b571043-45c2-4544-8466-598520fd8c92 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:12.575065 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b571043-45c2-4544-8466-598520fd8c92 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:12.576138 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b571043-45c2-4544-8466-598520fd8c92 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:12.580466 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b571043-45c2-4544-8466-598520fd8c92 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:12.581462 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b571043-45c2-4544-8466-598520fd8c92 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:12.583585 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b571043-45c2-4544-8466-598520fd8c92 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:12.649369 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:12.761861 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6b571043-45c2-4544-8466-598520fd8c92 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:12.817005 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6b571043-45c2-4544-8466-598520fd8c92 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:12.826134 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6b571043-45c2-4544-8466-598520fd8c92 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:12.838444 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6b571043-45c2-4544-8466-598520fd8c92 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1605 microversion: 2.42 time: 0.301905 Oct 30 01:42:12.846923 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2714/5439] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:12 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1605 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:42:12.874060 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b028fdae-c318-43ac-b2e8-96cc42c2f4dc tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:12.876143 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b028fdae-c318-43ac-b2e8-96cc42c2f4dc tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 2435fb0b-ab56-4368-9965-245b3574d012] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:12.883722 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b028fdae-c318-43ac-b2e8-96cc42c2f4dc tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:12.884649 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b028fdae-c318-43ac-b2e8-96cc42c2f4dc tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:12.885443 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b028fdae-c318-43ac-b2e8-96cc42c2f4dc tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:12.886488 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b028fdae-c318-43ac-b2e8-96cc42c2f4dc tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:12.887198 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b028fdae-c318-43ac-b2e8-96cc42c2f4dc tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:12.887965 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b028fdae-c318-43ac-b2e8-96cc42c2f4dc tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:12.910832 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-b028fdae-c318-43ac-b2e8-96cc42c2f4dc tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] HTTP exception thrown: Instance 2435fb0b-ab56-4368-9965-245b3574d012 could not be found. Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b028fdae-c318-43ac-b2e8-96cc42c2f4dc tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Request method failure captured: Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012 HTTP/1.1 Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdTqgn2B91_ceQKPoDM1iNAokBfCrWwyIgVilJ-1FJ-YMzDy2MOop6IG0Cc87jPfCxHDogztiWm1uOfmfK_KW4JzuPL-rRntVAmuTzNTJ-P5MxBMW8tUBSZKJtBH4PVeYnsSpbZkSiYmT2c4OLcdNoR6EOdKROXOnLOufaCNiFI0MA4 Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 7c1e4ce82aba40a2a013f2d107877b72 Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-AttachVolumeTestJSON-1714625488 Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7c1e4ce82aba40a2a013f2d107877b72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7c1e4ce82aba40a2a013f2d107877b72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7c1e4ce82aba40a2a013f2d107877b72"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7c1e4ce82aba40a2a013f2d107877b72"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-AttachVolumeTestJSON-1714625488 Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 7c1e4ce82aba40a2a013f2d107877b72 Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1714625488 Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-AttachVolumeTestJSON-1714625488-project Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: aba3c4de99ec4a5aae6fb006ab89fdb9 Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-AttachVolumeTestJSON-1714625488-project Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 2435fb0b-ab56-4368-9965-245b3574d012 could not be found. Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '2435fb0b-ab56-4368-9965-245b3574d012'} Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2435fb0b-ab56-4368-9965-245b3574d012 could not be found. Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:42:12.912509 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:42:12.916239 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2435fb0b-ab56-4368-9965-245b3574d012 could not be found. Oct 30 01:42:12.916239 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:42:12.916239 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:42:12.916239 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:42:12.916239 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:42:12.916239 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:42:12.916239 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:42:12.916239 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:42:12.916239 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:42:12.916239 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2435fb0b-ab56-4368-9965-245b3574d012 could not be found. Oct 30 01:42:12.916239 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:42:12.916239 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b028fdae-c318-43ac-b2e8-96cc42c2f4dc tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Returning 404 to user: Instance 2435fb0b-ab56-4368-9965-245b3574d012 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:42:12.916239 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b028fdae-c318-43ac-b2e8-96cc42c2f4dc tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012" status: 404 len: 111 microversion: 2.1 time: 0.065157 Oct 30 01:42:12.916239 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2715/5440] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:42:12 2022] DELETE /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:42:12.928199 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bc20f98e-5c6a-47e6-aaab-a3f7c9753520 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:12.928613 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bc20f98e-5c6a-47e6-aaab-a3f7c9753520 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 2435fb0b-ab56-4368-9965-245b3574d012] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:12.941495 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bc20f98e-5c6a-47e6-aaab-a3f7c9753520 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:12.943853 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bc20f98e-5c6a-47e6-aaab-a3f7c9753520 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:12.944382 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bc20f98e-5c6a-47e6-aaab-a3f7c9753520 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:12.947175 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bc20f98e-5c6a-47e6-aaab-a3f7c9753520 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:12.947552 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bc20f98e-5c6a-47e6-aaab-a3f7c9753520 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:12.948020 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bc20f98e-5c6a-47e6-aaab-a3f7c9753520 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:12.980495 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-bc20f98e-5c6a-47e6-aaab-a3f7c9753520 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] HTTP exception thrown: Instance 2435fb0b-ab56-4368-9965-245b3574d012 could not be found. Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bc20f98e-5c6a-47e6-aaab-a3f7c9753520 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Request method failure captured: Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012 HTTP/1.1 Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdTqgn2B91_ceQKPoDM1iNAokBfCrWwyIgVilJ-1FJ-YMzDy2MOop6IG0Cc87jPfCxHDogztiWm1uOfmfK_KW4JzuPL-rRntVAmuTzNTJ-P5MxBMW8tUBSZKJtBH4PVeYnsSpbZkSiYmT2c4OLcdNoR6EOdKROXOnLOufaCNiFI0MA4 Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 7c1e4ce82aba40a2a013f2d107877b72 Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-AttachVolumeTestJSON-1714625488 Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7c1e4ce82aba40a2a013f2d107877b72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7c1e4ce82aba40a2a013f2d107877b72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7c1e4ce82aba40a2a013f2d107877b72"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7c1e4ce82aba40a2a013f2d107877b72"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-AttachVolumeTestJSON-1714625488 Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 7c1e4ce82aba40a2a013f2d107877b72 Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1714625488 Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-AttachVolumeTestJSON-1714625488-project Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: aba3c4de99ec4a5aae6fb006ab89fdb9 Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-AttachVolumeTestJSON-1714625488-project Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 2435fb0b-ab56-4368-9965-245b3574d012 could not be found. Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '2435fb0b-ab56-4368-9965-245b3574d012'} Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2435fb0b-ab56-4368-9965-245b3574d012 could not be found. Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2435fb0b-ab56-4368-9965-245b3574d012 could not be found. Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:42:12.983408 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:42:12.987428 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:42:12.987428 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:42:12.987428 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:42:12.987428 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:42:12.987428 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:42:12.987428 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2435fb0b-ab56-4368-9965-245b3574d012 could not be found. Oct 30 01:42:12.987428 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:42:12.987428 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bc20f98e-5c6a-47e6-aaab-a3f7c9753520 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Returning 404 to user: Instance 2435fb0b-ab56-4368-9965-245b3574d012 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:42:12.987428 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bc20f98e-5c6a-47e6-aaab-a3f7c9753520 tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012" status: 404 len: 111 microversion: 2.1 time: 0.064465 Oct 30 01:42:12.987428 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2716/5441] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:42:12 2022] GET /compute/v2.1/servers/2435fb0b-ab56-4368-9965-245b3574d012 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 01:42:13.270432 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-59e2a679-62e6-4cf7-a1f7-c7996a34663e req-d42ba6db-fcf4-4b82-9254-852c2102be1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0f03664-8785-4321-b32e-3622f1b747b9", "name": "network-vif-unplugged", "status": "completed", "tag": "63c1537a-0706-49b0-8e88-a5c62f4ffbe3"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:42:13.297856 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-59e2a679-62e6-4cf7-a1f7-c7996a34663e req-d42ba6db-fcf4-4b82-9254-852c2102be1d service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:13.298647 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-59e2a679-62e6-4cf7-a1f7-c7996a34663e req-d42ba6db-fcf4-4b82-9254-852c2102be1d service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:13.301883 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-59e2a679-62e6-4cf7-a1f7-c7996a34663e req-d42ba6db-fcf4-4b82-9254-852c2102be1d service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:13.340271 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-59e2a679-62e6-4cf7-a1f7-c7996a34663e req-d42ba6db-fcf4-4b82-9254-852c2102be1d service nova] Creating event network-vif-unplugged:63c1537a-0706-49b0-8e88-a5c62f4ffbe3 for instance b0f03664-8785-4321-b32e-3622f1b747b9 on n-h2-master-1 Oct 30 01:42:13.350998 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-59e2a679-62e6-4cf7-a1f7-c7996a34663e req-d42ba6db-fcf4-4b82-9254-852c2102be1d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084295 Oct 30 01:42:13.352194 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2717/5442] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:42:13.556924 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-947b2267-46c2-422c-a5b7-1338a344df5e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:13.558066 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-947b2267-46c2-422c-a5b7-1338a344df5e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:13.590712 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-947b2267-46c2-422c-a5b7-1338a344df5e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:13.591231 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-947b2267-46c2-422c-a5b7-1338a344df5e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:13.591682 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-947b2267-46c2-422c-a5b7-1338a344df5e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:13.592424 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-947b2267-46c2-422c-a5b7-1338a344df5e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:13.592887 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-947b2267-46c2-422c-a5b7-1338a344df5e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:13.593318 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-947b2267-46c2-422c-a5b7-1338a344df5e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:14.049775 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-947b2267-46c2-422c-a5b7-1338a344df5e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:14.061279 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-947b2267-46c2-422c-a5b7-1338a344df5e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:14.063400 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-947b2267-46c2-422c-a5b7-1338a344df5e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:14.064948 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-947b2267-46c2-422c-a5b7-1338a344df5e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1737 microversion: 2.20 time: 0.512459 Oct 30 01:42:14.066207 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2718/5443] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:13 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1737 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:42:14.072106 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-71365d45-1823-4cc0-9ee9-330549f2653a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:14.073114 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-71365d45-1823-4cc0-9ee9-330549f2653a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:14.083413 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-71365d45-1823-4cc0-9ee9-330549f2653a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:14.084243 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-71365d45-1823-4cc0-9ee9-330549f2653a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:14.084901 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-71365d45-1823-4cc0-9ee9-330549f2653a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:14.085930 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-71365d45-1823-4cc0-9ee9-330549f2653a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:14.086576 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-71365d45-1823-4cc0-9ee9-330549f2653a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:14.087197 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-71365d45-1823-4cc0-9ee9-330549f2653a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:14.258171 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-71365d45-1823-4cc0-9ee9-330549f2653a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:14.283797 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-71365d45-1823-4cc0-9ee9-330549f2653a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:14.293071 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-71365d45-1823-4cc0-9ee9-330549f2653a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:14.303235 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-71365d45-1823-4cc0-9ee9-330549f2653a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1605 microversion: 2.42 time: 0.235605 Oct 30 01:42:14.307263 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2719/5444] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:14 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1605 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:42:15.095104 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-79c9eecb-4a09-4aaf-85a6-228c162a334c tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:15.096052 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-79c9eecb-4a09-4aaf-85a6-228c162a334c tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:15.115226 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-79c9eecb-4a09-4aaf-85a6-228c162a334c tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:15.119143 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-79c9eecb-4a09-4aaf-85a6-228c162a334c tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:15.119746 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-79c9eecb-4a09-4aaf-85a6-228c162a334c tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:15.123415 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-79c9eecb-4a09-4aaf-85a6-228c162a334c tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:15.125006 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-79c9eecb-4a09-4aaf-85a6-228c162a334c tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:15.126466 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-79c9eecb-4a09-4aaf-85a6-228c162a334c tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:15.535587 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-79c9eecb-4a09-4aaf-85a6-228c162a334c tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:15.553684 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-79c9eecb-4a09-4aaf-85a6-228c162a334c tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:15.555564 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-79c9eecb-4a09-4aaf-85a6-228c162a334c tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:15.565570 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-79c9eecb-4a09-4aaf-85a6-228c162a334c tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1737 microversion: 2.20 time: 0.475088 Oct 30 01:42:15.573182 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2720/5445] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:15 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1737 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:42:15.585812 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ba93f26b-6b55-4a70-8e64-c7e3e22b2e98 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:15.591358 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ba93f26b-6b55-4a70-8e64-c7e3e22b2e98 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:15.614881 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ba93f26b-6b55-4a70-8e64-c7e3e22b2e98 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:15.617164 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ba93f26b-6b55-4a70-8e64-c7e3e22b2e98 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:15.617912 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ba93f26b-6b55-4a70-8e64-c7e3e22b2e98 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:15.620370 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ba93f26b-6b55-4a70-8e64-c7e3e22b2e98 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:15.621100 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ba93f26b-6b55-4a70-8e64-c7e3e22b2e98 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:15.621975 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ba93f26b-6b55-4a70-8e64-c7e3e22b2e98 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:15.856682 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ba93f26b-6b55-4a70-8e64-c7e3e22b2e98 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:15.888002 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ba93f26b-6b55-4a70-8e64-c7e3e22b2e98 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:15.914722 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ba93f26b-6b55-4a70-8e64-c7e3e22b2e98 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:15.916001 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ba93f26b-6b55-4a70-8e64-c7e3e22b2e98 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1605 microversion: 2.42 time: 0.341291 Oct 30 01:42:15.916598 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2721/5446] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:15 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1605 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:42:16.609634 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-91bced13-55d5-4fb3-9207-90ed9971fd93 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:16.611059 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-91bced13-55d5-4fb3-9207-90ed9971fd93 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:16.627389 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-91bced13-55d5-4fb3-9207-90ed9971fd93 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:16.628288 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-91bced13-55d5-4fb3-9207-90ed9971fd93 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:16.628688 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-91bced13-55d5-4fb3-9207-90ed9971fd93 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:16.629446 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-91bced13-55d5-4fb3-9207-90ed9971fd93 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:16.629904 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-91bced13-55d5-4fb3-9207-90ed9971fd93 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:16.630326 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-91bced13-55d5-4fb3-9207-90ed9971fd93 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:17.055772 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-91bced13-55d5-4fb3-9207-90ed9971fd93 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:17.068569 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-91bced13-55d5-4fb3-9207-90ed9971fd93 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:17.070561 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-91bced13-55d5-4fb3-9207-90ed9971fd93 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:17.072323 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-91bced13-55d5-4fb3-9207-90ed9971fd93 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1737 microversion: 2.20 time: 0.478292 Oct 30 01:42:17.073481 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2722/5447] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:16 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1737 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:42:17.079259 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a7af95e4-f563-400e-ab44-8ec9679c12f2 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:17.080081 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a7af95e4-f563-400e-ab44-8ec9679c12f2 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:17.087386 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7af95e4-f563-400e-ab44-8ec9679c12f2 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:17.088089 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7af95e4-f563-400e-ab44-8ec9679c12f2 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:17.088732 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7af95e4-f563-400e-ab44-8ec9679c12f2 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:17.089685 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7af95e4-f563-400e-ab44-8ec9679c12f2 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:17.090329 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7af95e4-f563-400e-ab44-8ec9679c12f2 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:17.090929 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7af95e4-f563-400e-ab44-8ec9679c12f2 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:17.238636 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a7af95e4-f563-400e-ab44-8ec9679c12f2 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:17.253086 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a7af95e4-f563-400e-ab44-8ec9679c12f2 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:17.263499 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a7af95e4-f563-400e-ab44-8ec9679c12f2 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:17.269863 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a7af95e4-f563-400e-ab44-8ec9679c12f2 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1605 microversion: 2.42 time: 0.194711 Oct 30 01:42:17.274606 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2723/5448] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:17 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1605 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:42:18.105215 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9614e3bd-4757-4494-8208-d7f5cb42379c tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:18.106650 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9614e3bd-4757-4494-8208-d7f5cb42379c tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:18.118884 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9614e3bd-4757-4494-8208-d7f5cb42379c tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:18.120799 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9614e3bd-4757-4494-8208-d7f5cb42379c tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:18.125406 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9614e3bd-4757-4494-8208-d7f5cb42379c tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:18.126510 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9614e3bd-4757-4494-8208-d7f5cb42379c tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:18.127175 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9614e3bd-4757-4494-8208-d7f5cb42379c tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:18.127797 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9614e3bd-4757-4494-8208-d7f5cb42379c tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:18.480444 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9614e3bd-4757-4494-8208-d7f5cb42379c tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:18.505266 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9614e3bd-4757-4494-8208-d7f5cb42379c tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:18.514207 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9614e3bd-4757-4494-8208-d7f5cb42379c tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:18.514207 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9614e3bd-4757-4494-8208-d7f5cb42379c tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1737 microversion: 2.20 time: 0.415282 Oct 30 01:42:18.514407 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2724/5449] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:18 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1737 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:42:18.537080 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-86ef8d1f-10d5-4a0e-815a-b0b7675d4077 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:18.537771 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-86ef8d1f-10d5-4a0e-815a-b0b7675d4077 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:18.564473 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86ef8d1f-10d5-4a0e-815a-b0b7675d4077 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:18.565623 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86ef8d1f-10d5-4a0e-815a-b0b7675d4077 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:18.568820 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86ef8d1f-10d5-4a0e-815a-b0b7675d4077 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:18.569852 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86ef8d1f-10d5-4a0e-815a-b0b7675d4077 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:18.570327 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86ef8d1f-10d5-4a0e-815a-b0b7675d4077 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:18.572063 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86ef8d1f-10d5-4a0e-815a-b0b7675d4077 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:18.685114 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-86ef8d1f-10d5-4a0e-815a-b0b7675d4077 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:18.703488 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-86ef8d1f-10d5-4a0e-815a-b0b7675d4077 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:18.711595 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-86ef8d1f-10d5-4a0e-815a-b0b7675d4077 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:18.728169 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-86ef8d1f-10d5-4a0e-815a-b0b7675d4077 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1605 microversion: 2.42 time: 0.211305 Oct 30 01:42:18.730946 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2725/5450] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:18 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1605 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:42:19.544371 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-283010de-33ab-456f-a5cd-4d3a15efe2cf tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:19.547780 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-283010de-33ab-456f-a5cd-4d3a15efe2cf tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:19.565730 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-283010de-33ab-456f-a5cd-4d3a15efe2cf tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:19.566819 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-283010de-33ab-456f-a5cd-4d3a15efe2cf tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:19.569234 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-283010de-33ab-456f-a5cd-4d3a15efe2cf tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:19.573735 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-283010de-33ab-456f-a5cd-4d3a15efe2cf tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:19.575499 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-283010de-33ab-456f-a5cd-4d3a15efe2cf tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:19.578676 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-283010de-33ab-456f-a5cd-4d3a15efe2cf tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:19.900402 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=9 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:19.980952 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=43 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:20.082051 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-283010de-33ab-456f-a5cd-4d3a15efe2cf tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:20.082051 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-283010de-33ab-456f-a5cd-4d3a15efe2cf tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:20.082051 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-283010de-33ab-456f-a5cd-4d3a15efe2cf tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:20.082051 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-283010de-33ab-456f-a5cd-4d3a15efe2cf tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1737 microversion: 2.20 time: 0.514178 Oct 30 01:42:20.082051 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2726/5451] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:19 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1737 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:42:20.082051 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7e3f4f4b-654d-4c85-82ab-ab6562ff2f0e tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:20.082051 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7e3f4f4b-654d-4c85-82ab-ab6562ff2f0e tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:20.098669 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e3f4f4b-654d-4c85-82ab-ab6562ff2f0e tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:20.099410 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e3f4f4b-654d-4c85-82ab-ab6562ff2f0e tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:20.100037 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e3f4f4b-654d-4c85-82ab-ab6562ff2f0e tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:20.100924 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e3f4f4b-654d-4c85-82ab-ab6562ff2f0e tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:20.110105 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e3f4f4b-654d-4c85-82ab-ab6562ff2f0e tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:20.110766 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e3f4f4b-654d-4c85-82ab-ab6562ff2f0e tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:20.237264 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7e3f4f4b-654d-4c85-82ab-ab6562ff2f0e tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:20.274147 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7e3f4f4b-654d-4c85-82ab-ab6562ff2f0e tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:20.275602 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7e3f4f4b-654d-4c85-82ab-ab6562ff2f0e tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:20.279334 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7e3f4f4b-654d-4c85-82ab-ab6562ff2f0e tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1605 microversion: 2.42 time: 0.222072 Oct 30 01:42:20.281902 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2727/5452] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:20 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1605 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:42:21.102373 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-56f18375-9c53-4e7a-8e1d-f8df30fd6964 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:21.103059 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-56f18375-9c53-4e7a-8e1d-f8df30fd6964 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:21.127321 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-56f18375-9c53-4e7a-8e1d-f8df30fd6964 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:21.130543 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-56f18375-9c53-4e7a-8e1d-f8df30fd6964 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:21.130543 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-56f18375-9c53-4e7a-8e1d-f8df30fd6964 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:21.131249 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-56f18375-9c53-4e7a-8e1d-f8df30fd6964 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:21.131818 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-56f18375-9c53-4e7a-8e1d-f8df30fd6964 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:21.133008 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-56f18375-9c53-4e7a-8e1d-f8df30fd6964 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:21.737493 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-56f18375-9c53-4e7a-8e1d-f8df30fd6964 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:21.768499 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-56f18375-9c53-4e7a-8e1d-f8df30fd6964 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:21.778507 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-56f18375-9c53-4e7a-8e1d-f8df30fd6964 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:21.790672 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-56f18375-9c53-4e7a-8e1d-f8df30fd6964 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1737 microversion: 2.20 time: 0.690114 Oct 30 01:42:21.792959 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2728/5453] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:21 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1737 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:42:21.814270 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-23ab51fc-0c18-414f-9031-728afbeeb800 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:21.832860 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-23ab51fc-0c18-414f-9031-728afbeeb800 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:21.861858 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-23ab51fc-0c18-414f-9031-728afbeeb800 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:21.868776 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-23ab51fc-0c18-414f-9031-728afbeeb800 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:21.871918 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-23ab51fc-0c18-414f-9031-728afbeeb800 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:21.879402 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-23ab51fc-0c18-414f-9031-728afbeeb800 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:21.880256 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-23ab51fc-0c18-414f-9031-728afbeeb800 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:21.880905 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-23ab51fc-0c18-414f-9031-728afbeeb800 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:22.110045 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-23ab51fc-0c18-414f-9031-728afbeeb800 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:22.122465 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-23ab51fc-0c18-414f-9031-728afbeeb800 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:22.133563 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-23ab51fc-0c18-414f-9031-728afbeeb800 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:22.135376 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-23ab51fc-0c18-414f-9031-728afbeeb800 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1605 microversion: 2.42 time: 0.338160 Oct 30 01:42:22.140988 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2729/5454] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:21 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1605 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:42:22.824988 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a00ecc84-9f86-48bd-b6ce-74df1efb46f5 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:22.825784 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a00ecc84-9f86-48bd-b6ce-74df1efb46f5 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:22.844354 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a00ecc84-9f86-48bd-b6ce-74df1efb46f5 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:22.844701 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a00ecc84-9f86-48bd-b6ce-74df1efb46f5 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:22.845138 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a00ecc84-9f86-48bd-b6ce-74df1efb46f5 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:22.846550 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a00ecc84-9f86-48bd-b6ce-74df1efb46f5 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:22.847622 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a00ecc84-9f86-48bd-b6ce-74df1efb46f5 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:22.852468 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a00ecc84-9f86-48bd-b6ce-74df1efb46f5 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:23.179315 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a00ecc84-9f86-48bd-b6ce-74df1efb46f5 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:23.198091 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a00ecc84-9f86-48bd-b6ce-74df1efb46f5 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:23.202282 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a00ecc84-9f86-48bd-b6ce-74df1efb46f5 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:23.205268 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a00ecc84-9f86-48bd-b6ce-74df1efb46f5 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1737 microversion: 2.20 time: 0.383271 Oct 30 01:42:23.208390 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2730/5455] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:22 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1737 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:42:23.220481 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-eea3aff2-ce39-4a77-afc2-c51206254359 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:23.243928 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-eea3aff2-ce39-4a77-afc2-c51206254359 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:23.243928 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eea3aff2-ce39-4a77-afc2-c51206254359 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:23.243928 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eea3aff2-ce39-4a77-afc2-c51206254359 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:23.243928 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eea3aff2-ce39-4a77-afc2-c51206254359 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:23.243928 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eea3aff2-ce39-4a77-afc2-c51206254359 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:23.245712 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eea3aff2-ce39-4a77-afc2-c51206254359 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:23.247901 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eea3aff2-ce39-4a77-afc2-c51206254359 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:23.372799 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-eea3aff2-ce39-4a77-afc2-c51206254359 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:23.416555 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-eea3aff2-ce39-4a77-afc2-c51206254359 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:23.422062 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-eea3aff2-ce39-4a77-afc2-c51206254359 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:23.430016 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-eea3aff2-ce39-4a77-afc2-c51206254359 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1605 microversion: 2.42 time: 0.219423 Oct 30 01:42:23.435180 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2731/5456] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:23 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1605 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:42:23.565585 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-31a6d023-65df-4e20-bfaf-0371d50251d9 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "POST /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9/action" status: 202 len: 0 microversion: 2.1 time: 13.718596 Oct 30 01:42:23.566687 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2726/5457] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:42:09 2022] POST /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9/action => generated 0 bytes in 13721 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 30 01:42:23.577217 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fbd2a744-7188-48a7-a3d0-8aaa19231d1b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:23.578538 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fbd2a744-7188-48a7-a3d0-8aaa19231d1b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:23.607696 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fbd2a744-7188-48a7-a3d0-8aaa19231d1b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:23.608251 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fbd2a744-7188-48a7-a3d0-8aaa19231d1b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:23.609270 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fbd2a744-7188-48a7-a3d0-8aaa19231d1b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:23.610264 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fbd2a744-7188-48a7-a3d0-8aaa19231d1b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:23.610791 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fbd2a744-7188-48a7-a3d0-8aaa19231d1b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:23.611985 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fbd2a744-7188-48a7-a3d0-8aaa19231d1b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:23.976747 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-fbd2a744-7188-48a7-a3d0-8aaa19231d1b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:23.980014 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:23.990031 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fbd2a744-7188-48a7-a3d0-8aaa19231d1b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1680 microversion: 2.1 time: 0.418973 Oct 30 01:42:23.991117 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2732/5458] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:42:23 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1680 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:42:24.303432 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2f3d7ce0-bb09-42be-a467-535014d508c2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:24.304806 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2f3d7ce0-bb09-42be-a467-535014d508c2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:24.335219 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f3d7ce0-bb09-42be-a467-535014d508c2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:24.340703 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f3d7ce0-bb09-42be-a467-535014d508c2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:24.342973 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f3d7ce0-bb09-42be-a467-535014d508c2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:24.351183 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f3d7ce0-bb09-42be-a467-535014d508c2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:24.352852 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f3d7ce0-bb09-42be-a467-535014d508c2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:24.358504 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f3d7ce0-bb09-42be-a467-535014d508c2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:24.464822 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5352aff3-ec8f-42cd-b785-acc39766a1e5 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:24.465497 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5352aff3-ec8f-42cd-b785-acc39766a1e5 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:24.551586 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5352aff3-ec8f-42cd-b785-acc39766a1e5 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:24.551586 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5352aff3-ec8f-42cd-b785-acc39766a1e5 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:24.551586 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5352aff3-ec8f-42cd-b785-acc39766a1e5 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:24.551586 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5352aff3-ec8f-42cd-b785-acc39766a1e5 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:24.551586 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5352aff3-ec8f-42cd-b785-acc39766a1e5 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:24.551586 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5352aff3-ec8f-42cd-b785-acc39766a1e5 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:24.814135 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5352aff3-ec8f-42cd-b785-acc39766a1e5 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:24.820564 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5352aff3-ec8f-42cd-b785-acc39766a1e5 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:24.828069 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5352aff3-ec8f-42cd-b785-acc39766a1e5 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:24.832579 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5352aff3-ec8f-42cd-b785-acc39766a1e5 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1605 microversion: 2.42 time: 0.373464 Oct 30 01:42:24.847357 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2733/5459] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:24 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1605 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:42:25.014488 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a5320705-00d8-4136-97c8-7f57bd2d99a8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:25.015673 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a5320705-00d8-4136-97c8-7f57bd2d99a8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:25.032443 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a5320705-00d8-4136-97c8-7f57bd2d99a8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:25.035083 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a5320705-00d8-4136-97c8-7f57bd2d99a8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:25.035711 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a5320705-00d8-4136-97c8-7f57bd2d99a8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:25.038777 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a5320705-00d8-4136-97c8-7f57bd2d99a8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:25.040492 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a5320705-00d8-4136-97c8-7f57bd2d99a8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:25.044403 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a5320705-00d8-4136-97c8-7f57bd2d99a8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:25.089493 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2f3d7ce0-bb09-42be-a467-535014d508c2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:25.106925 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2f3d7ce0-bb09-42be-a467-535014d508c2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:25.113671 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2f3d7ce0-bb09-42be-a467-535014d508c2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:25.122479 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2f3d7ce0-bb09-42be-a467-535014d508c2 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1719 microversion: 2.20 time: 0.872036 Oct 30 01:42:25.126035 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2727/5460] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:24 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1719 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:42:25.479378 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a5320705-00d8-4136-97c8-7f57bd2d99a8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:25.503183 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a5320705-00d8-4136-97c8-7f57bd2d99a8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1680 microversion: 2.1 time: 0.479189 Oct 30 01:42:25.504090 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2734/5461] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:42:25 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1680 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:42:25.868566 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-49971846-3dd7-42f0-ba0e-171de1f0acf1 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:25.869621 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-49971846-3dd7-42f0-ba0e-171de1f0acf1 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:25.919129 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-49971846-3dd7-42f0-ba0e-171de1f0acf1 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:25.919856 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-49971846-3dd7-42f0-ba0e-171de1f0acf1 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:25.920827 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-49971846-3dd7-42f0-ba0e-171de1f0acf1 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:25.922352 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-49971846-3dd7-42f0-ba0e-171de1f0acf1 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:25.923013 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-49971846-3dd7-42f0-ba0e-171de1f0acf1 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:25.923639 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-49971846-3dd7-42f0-ba0e-171de1f0acf1 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:26.080927 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-49971846-3dd7-42f0-ba0e-171de1f0acf1 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:26.099939 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-49971846-3dd7-42f0-ba0e-171de1f0acf1 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:26.102667 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-49971846-3dd7-42f0-ba0e-171de1f0acf1 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:26.106517 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-49971846-3dd7-42f0-ba0e-171de1f0acf1 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1605 microversion: 2.42 time: 0.245908 Oct 30 01:42:26.108058 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2728/5462] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:25 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1605 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:42:26.152955 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f91cfeb3-48b7-48f5-a5bf-efc38ebd790a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:26.153623 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f91cfeb3-48b7-48f5-a5bf-efc38ebd790a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:26.168657 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f91cfeb3-48b7-48f5-a5bf-efc38ebd790a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:26.169162 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f91cfeb3-48b7-48f5-a5bf-efc38ebd790a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:26.170725 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f91cfeb3-48b7-48f5-a5bf-efc38ebd790a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:26.171492 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f91cfeb3-48b7-48f5-a5bf-efc38ebd790a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:26.171954 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f91cfeb3-48b7-48f5-a5bf-efc38ebd790a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:26.172383 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f91cfeb3-48b7-48f5-a5bf-efc38ebd790a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:26.461198 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f91cfeb3-48b7-48f5-a5bf-efc38ebd790a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:26.485818 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f91cfeb3-48b7-48f5-a5bf-efc38ebd790a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:26.498329 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f91cfeb3-48b7-48f5-a5bf-efc38ebd790a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:26.505452 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f91cfeb3-48b7-48f5-a5bf-efc38ebd790a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1719 microversion: 2.20 time: 0.354098 Oct 30 01:42:26.508590 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2735/5463] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:26 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1719 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:42:26.535535 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-edef8255-9be2-4406-82f8-4d3249873675 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:26.536467 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-edef8255-9be2-4406-82f8-4d3249873675 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:26.543543 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-edef8255-9be2-4406-82f8-4d3249873675 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:26.544235 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-edef8255-9be2-4406-82f8-4d3249873675 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:26.544849 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-edef8255-9be2-4406-82f8-4d3249873675 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:26.545822 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-edef8255-9be2-4406-82f8-4d3249873675 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:26.546476 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-edef8255-9be2-4406-82f8-4d3249873675 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:26.547070 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-edef8255-9be2-4406-82f8-4d3249873675 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:26.801589 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-edef8255-9be2-4406-82f8-4d3249873675 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:26.811549 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-edef8255-9be2-4406-82f8-4d3249873675 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1688 microversion: 2.1 time: 0.280709 Oct 30 01:42:26.825521 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2729/5464] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:42:26 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1688 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:42:26.856162 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d38df6aa-c3e2-4c76-ba92-9db145e1a40c tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:26.856694 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d38df6aa-c3e2-4c76-ba92-9db145e1a40c tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:26.864717 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d38df6aa-c3e2-4c76-ba92-9db145e1a40c tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:26.866066 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d38df6aa-c3e2-4c76-ba92-9db145e1a40c tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:26.866658 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d38df6aa-c3e2-4c76-ba92-9db145e1a40c tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:26.867632 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d38df6aa-c3e2-4c76-ba92-9db145e1a40c tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:26.868319 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d38df6aa-c3e2-4c76-ba92-9db145e1a40c tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:26.868921 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d38df6aa-c3e2-4c76-ba92-9db145e1a40c tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:26.885487 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-d38df6aa-c3e2-4c76-ba92-9db145e1a40c tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] HTTP exception thrown: Instance 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b could not be found. Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d38df6aa-c3e2-4c76-ba92-9db145e1a40c tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Request method failure captured: Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b HTTP/1.1 Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdTqgn2B91_ceQKPoDM1iNAokBfCrWwyIgVilJ-1FJ-YMzDy2MOop6IG0Cc87jPfCxHDogztiWm1uOfmfK_KW4JzuPL-rRntVAmuTzNTJ-P5MxBMW8tUBSZKJtBH4PVeYnsSpbZkSiYmT2c4OLcdNoR6EOdKROXOnLOufaCNiFI0MA4 Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 7c1e4ce82aba40a2a013f2d107877b72 Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-AttachVolumeTestJSON-1714625488 Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7c1e4ce82aba40a2a013f2d107877b72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7c1e4ce82aba40a2a013f2d107877b72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7c1e4ce82aba40a2a013f2d107877b72"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7c1e4ce82aba40a2a013f2d107877b72"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-AttachVolumeTestJSON-1714625488 Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 7c1e4ce82aba40a2a013f2d107877b72 Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1714625488 Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-AttachVolumeTestJSON-1714625488-project Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: aba3c4de99ec4a5aae6fb006ab89fdb9 Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-AttachVolumeTestJSON-1714625488-project Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b could not be found. Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '97f81ee8-7551-4e9b-9ff6-7f542c5dab1b'} Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b could not be found. Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:42:26.899634 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:42:26.904327 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b could not be found. Oct 30 01:42:26.904327 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:42:26.904327 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:42:26.904327 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:42:26.904327 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:42:26.904327 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:42:26.904327 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:42:26.904327 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:42:26.904327 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:42:26.904327 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b could not be found. Oct 30 01:42:26.904327 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:42:26.908135 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d38df6aa-c3e2-4c76-ba92-9db145e1a40c tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Returning 404 to user: Instance 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:42:26.910735 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d38df6aa-c3e2-4c76-ba92-9db145e1a40c tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "DELETE /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b" status: 404 len: 111 microversion: 2.1 time: 0.058396 Oct 30 01:42:26.911747 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2736/5465] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:42:26 2022] DELETE /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:42:26.921763 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-aef7b988-64f1-415f-b7ec-ae4fecd7e55e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:26.933562 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-aef7b988-64f1-415f-b7ec-ae4fecd7e55e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] [instance: 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:26.949036 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aef7b988-64f1-415f-b7ec-ae4fecd7e55e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:26.952595 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aef7b988-64f1-415f-b7ec-ae4fecd7e55e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:26.956656 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aef7b988-64f1-415f-b7ec-ae4fecd7e55e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:26.956656 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aef7b988-64f1-415f-b7ec-ae4fecd7e55e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:26.956656 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aef7b988-64f1-415f-b7ec-ae4fecd7e55e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:26.956656 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aef7b988-64f1-415f-b7ec-ae4fecd7e55e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:27.010007 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-aef7b988-64f1-415f-b7ec-ae4fecd7e55e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] HTTP exception thrown: Instance 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b could not be found. Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-aef7b988-64f1-415f-b7ec-ae4fecd7e55e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Request method failure captured: Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b HTTP/1.1 Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdTqgn2B91_ceQKPoDM1iNAokBfCrWwyIgVilJ-1FJ-YMzDy2MOop6IG0Cc87jPfCxHDogztiWm1uOfmfK_KW4JzuPL-rRntVAmuTzNTJ-P5MxBMW8tUBSZKJtBH4PVeYnsSpbZkSiYmT2c4OLcdNoR6EOdKROXOnLOufaCNiFI0MA4 Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 7c1e4ce82aba40a2a013f2d107877b72 Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-AttachVolumeTestJSON-1714625488 Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7c1e4ce82aba40a2a013f2d107877b72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7c1e4ce82aba40a2a013f2d107877b72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7c1e4ce82aba40a2a013f2d107877b72"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7c1e4ce82aba40a2a013f2d107877b72"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-AttachVolumeTestJSON-1714625488 Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 7c1e4ce82aba40a2a013f2d107877b72 Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1714625488 Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-AttachVolumeTestJSON-1714625488-project Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: aba3c4de99ec4a5aae6fb006ab89fdb9 Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-AttachVolumeTestJSON-1714625488-project Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b could not be found. Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '97f81ee8-7551-4e9b-9ff6-7f542c5dab1b'} Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b could not be found. Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b could not be found. Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:42:27.013997 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:42:27.018730 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:42:27.018730 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:42:27.018730 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:42:27.018730 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:42:27.018730 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:42:27.018730 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b could not be found. Oct 30 01:42:27.018730 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:42:27.026576 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-aef7b988-64f1-415f-b7ec-ae4fecd7e55e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] Returning 404 to user: Instance 97f81ee8-7551-4e9b-9ff6-7f542c5dab1b could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:42:27.029292 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-aef7b988-64f1-415f-b7ec-ae4fecd7e55e tempest-AttachVolumeTestJSON-1714625488 tempest-AttachVolumeTestJSON-1714625488-project] 10.222.0.13 "GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b" status: 404 len: 111 microversion: 2.1 time: 0.113340 Oct 30 01:42:27.033457 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2730/5466] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:42:26 2022] GET /compute/v2.1/servers/97f81ee8-7551-4e9b-9ff6-7f542c5dab1b => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:42:27.138074 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-75bc0d25-5c9a-4a18-a105-212ba7e68b50 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:27.138074 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-75bc0d25-5c9a-4a18-a105-212ba7e68b50 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:27.144479 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-75bc0d25-5c9a-4a18-a105-212ba7e68b50 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:27.150115 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-75bc0d25-5c9a-4a18-a105-212ba7e68b50 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:27.153635 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-75bc0d25-5c9a-4a18-a105-212ba7e68b50 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:27.156220 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-75bc0d25-5c9a-4a18-a105-212ba7e68b50 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:27.162050 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-75bc0d25-5c9a-4a18-a105-212ba7e68b50 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:27.165253 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-75bc0d25-5c9a-4a18-a105-212ba7e68b50 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:27.497173 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-75bc0d25-5c9a-4a18-a105-212ba7e68b50 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:27.522371 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-75bc0d25-5c9a-4a18-a105-212ba7e68b50 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:27.533374 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-75bc0d25-5c9a-4a18-a105-212ba7e68b50 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:27.534660 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-75bc0d25-5c9a-4a18-a105-212ba7e68b50 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1605 microversion: 2.42 time: 0.403440 Oct 30 01:42:27.536852 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c6affdb6-b875-4b2e-abfa-b18f9cebba13 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:27.538394 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c6affdb6-b875-4b2e-abfa-b18f9cebba13 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:27.539195 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2737/5467] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:27 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1605 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:42:27.548836 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6affdb6-b875-4b2e-abfa-b18f9cebba13 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:27.552129 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6affdb6-b875-4b2e-abfa-b18f9cebba13 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:27.554947 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6affdb6-b875-4b2e-abfa-b18f9cebba13 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:27.558646 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6affdb6-b875-4b2e-abfa-b18f9cebba13 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:27.558646 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6affdb6-b875-4b2e-abfa-b18f9cebba13 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:27.561866 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6affdb6-b875-4b2e-abfa-b18f9cebba13 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:27.840139 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-21a1fa78-a4fb-4464-a2ac-59883ef845ff tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:27.841033 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-21a1fa78-a4fb-4464-a2ac-59883ef845ff tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:27.886985 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-21a1fa78-a4fb-4464-a2ac-59883ef845ff tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:27.907747 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-21a1fa78-a4fb-4464-a2ac-59883ef845ff tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:27.912519 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-21a1fa78-a4fb-4464-a2ac-59883ef845ff tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:27.917030 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-21a1fa78-a4fb-4464-a2ac-59883ef845ff tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:27.924092 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-21a1fa78-a4fb-4464-a2ac-59883ef845ff tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:27.924553 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-21a1fa78-a4fb-4464-a2ac-59883ef845ff tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:28.594218 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c6affdb6-b875-4b2e-abfa-b18f9cebba13 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:28.633597 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c6affdb6-b875-4b2e-abfa-b18f9cebba13 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:28.639525 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c6affdb6-b875-4b2e-abfa-b18f9cebba13 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:28.643342 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c6affdb6-b875-4b2e-abfa-b18f9cebba13 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1719 microversion: 2.20 time: 1.110504 Oct 30 01:42:28.648933 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2731/5468] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:27 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1719 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:42:28.675268 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-40c8150d-3ae2-4bcd-b075-b5f2d94e9175 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:28.680019 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-40c8150d-3ae2-4bcd-b075-b5f2d94e9175 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:28.714245 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-40c8150d-3ae2-4bcd-b075-b5f2d94e9175 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:28.720374 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-40c8150d-3ae2-4bcd-b075-b5f2d94e9175 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:28.721273 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-40c8150d-3ae2-4bcd-b075-b5f2d94e9175 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:28.724688 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-40c8150d-3ae2-4bcd-b075-b5f2d94e9175 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:28.726719 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-40c8150d-3ae2-4bcd-b075-b5f2d94e9175 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:28.728023 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-40c8150d-3ae2-4bcd-b075-b5f2d94e9175 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:28.830743 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-21a1fa78-a4fb-4464-a2ac-59883ef845ff tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:28.887097 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-21a1fa78-a4fb-4464-a2ac-59883ef845ff tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1688 microversion: 2.1 time: 1.045929 Oct 30 01:42:28.887641 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2738/5469] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:42:27 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1688 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:42:29.015675 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-40c8150d-3ae2-4bcd-b075-b5f2d94e9175 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:29.041569 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-40c8150d-3ae2-4bcd-b075-b5f2d94e9175 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:29.043895 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-40c8150d-3ae2-4bcd-b075-b5f2d94e9175 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:29.046350 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-40c8150d-3ae2-4bcd-b075-b5f2d94e9175 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1605 microversion: 2.42 time: 0.392843 Oct 30 01:42:29.064125 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2732/5470] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:28 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1605 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:42:29.332330 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-ea64ff7e-f59e-4cb0-a2e3-9d58f75af7d0 req-3869c1f2-a825-4e61-bb79-92599fd6a273 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2e35e69-66f2-43a0-9baa-d8f70437561d", "name": "network-vif-unplugged", "status": "completed", "tag": "6657440b-da45-40cf-ae87-7a3d5beeb7a4"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:42:29.391329 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ea64ff7e-f59e-4cb0-a2e3-9d58f75af7d0 req-3869c1f2-a825-4e61-bb79-92599fd6a273 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:29.394294 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ea64ff7e-f59e-4cb0-a2e3-9d58f75af7d0 req-3869c1f2-a825-4e61-bb79-92599fd6a273 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:29.398782 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ea64ff7e-f59e-4cb0-a2e3-9d58f75af7d0 req-3869c1f2-a825-4e61-bb79-92599fd6a273 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:29.463441 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.compute.server_external_events [req-ea64ff7e-f59e-4cb0-a2e3-9d58f75af7d0 req-3869c1f2-a825-4e61-bb79-92599fd6a273 service nova] Unable to find a host for instance b2e35e69-66f2-43a0-9baa-d8f70437561d. Dropping event network-vif-unplugged {{(pid=121102) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 30 01:42:29.470499 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-ea64ff7e-f59e-4cb0-a2e3-9d58f75af7d0 req-3869c1f2-a825-4e61-bb79-92599fd6a273 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.141089 Oct 30 01:42:29.474821 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2739/5471] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 148 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 30 01:42:29.679211 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f2e662ee-4e54-49a3-b329-fcbb481e5862 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:29.679825 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f2e662ee-4e54-49a3-b329-fcbb481e5862 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:29.690765 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f2e662ee-4e54-49a3-b329-fcbb481e5862 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:29.694538 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f2e662ee-4e54-49a3-b329-fcbb481e5862 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:29.696402 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f2e662ee-4e54-49a3-b329-fcbb481e5862 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:29.700973 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f2e662ee-4e54-49a3-b329-fcbb481e5862 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:29.702889 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f2e662ee-4e54-49a3-b329-fcbb481e5862 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:29.714845 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f2e662ee-4e54-49a3-b329-fcbb481e5862 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:29.919484 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-18464939-153e-4d4f-b473-0fd046788ff0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:29.922856 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-18464939-153e-4d4f-b473-0fd046788ff0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:29.944983 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-18464939-153e-4d4f-b473-0fd046788ff0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:29.946249 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-18464939-153e-4d4f-b473-0fd046788ff0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:29.951052 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-18464939-153e-4d4f-b473-0fd046788ff0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:29.951052 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-18464939-153e-4d4f-b473-0fd046788ff0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:29.951052 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-18464939-153e-4d4f-b473-0fd046788ff0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:29.956163 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-18464939-153e-4d4f-b473-0fd046788ff0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:30.721260 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f2e662ee-4e54-49a3-b329-fcbb481e5862 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:30.730777 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f2e662ee-4e54-49a3-b329-fcbb481e5862 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:30.745650 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f2e662ee-4e54-49a3-b329-fcbb481e5862 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:30.747313 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f2e662ee-4e54-49a3-b329-fcbb481e5862 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1662 microversion: 2.20 time: 1.072615 Oct 30 01:42:30.762408 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2733/5472] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:29 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1662 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:42:30.777050 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c6fbadb8-1d5d-47bc-99f4-5e48bfd8945a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:30.777967 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c6fbadb8-1d5d-47bc-99f4-5e48bfd8945a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:30.789610 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6fbadb8-1d5d-47bc-99f4-5e48bfd8945a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:30.793234 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6fbadb8-1d5d-47bc-99f4-5e48bfd8945a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:30.794008 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6fbadb8-1d5d-47bc-99f4-5e48bfd8945a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:30.794963 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6fbadb8-1d5d-47bc-99f4-5e48bfd8945a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:30.807038 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6fbadb8-1d5d-47bc-99f4-5e48bfd8945a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:30.812853 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6fbadb8-1d5d-47bc-99f4-5e48bfd8945a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:31.167141 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c6fbadb8-1d5d-47bc-99f4-5e48bfd8945a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:31.185428 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c6fbadb8-1d5d-47bc-99f4-5e48bfd8945a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:31.202881 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-18464939-153e-4d4f-b473-0fd046788ff0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:31.205681 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c6fbadb8-1d5d-47bc-99f4-5e48bfd8945a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:31.212196 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c6fbadb8-1d5d-47bc-99f4-5e48bfd8945a tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1605 microversion: 2.42 time: 0.448373 Oct 30 01:42:31.214759 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2734/5473] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:30 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1605 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:42:31.221939 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-18464939-153e-4d4f-b473-0fd046788ff0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1683 microversion: 2.1 time: 1.298234 Oct 30 01:42:31.222604 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2740/5474] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:42:29 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1683 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:42:31.282510 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4aa95df4-e7ec-47c7-b51e-8a49ef22c504 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "40fa3efe-66fb-41b2-9f11-e6194cd599f1"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:42:31.303579 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4aa95df4-e7ec-47c7-b51e-8a49ef22c504 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:31.344555 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4aa95df4-e7ec-47c7-b51e-8a49ef22c504 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:31.355601 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4aa95df4-e7ec-47c7-b51e-8a49ef22c504 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:31.380837 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4aa95df4-e7ec-47c7-b51e-8a49ef22c504 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:31.383905 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4aa95df4-e7ec-47c7-b51e-8a49ef22c504 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:31.384745 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4aa95df4-e7ec-47c7-b51e-8a49ef22c504 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:31.389792 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4aa95df4-e7ec-47c7-b51e-8a49ef22c504 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:31.602121 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-e6c93e18-ba24-4039-8b47-5e1f1f3d6949 req-017c10ae-fa5c-4fc1-a2d7-299d0aff3b30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0f03664-8785-4321-b32e-3622f1b747b9", "name": "network-vif-plugged", "status": "completed", "tag": "63c1537a-0706-49b0-8e88-a5c62f4ffbe3"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:42:31.644679 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-e6c93e18-ba24-4039-8b47-5e1f1f3d6949 req-017c10ae-fa5c-4fc1-a2d7-299d0aff3b30 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:31.649078 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-e6c93e18-ba24-4039-8b47-5e1f1f3d6949 req-017c10ae-fa5c-4fc1-a2d7-299d0aff3b30 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:31.650012 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-e6c93e18-ba24-4039-8b47-5e1f1f3d6949 req-017c10ae-fa5c-4fc1-a2d7-299d0aff3b30 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:31.700638 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-e6c93e18-ba24-4039-8b47-5e1f1f3d6949 req-017c10ae-fa5c-4fc1-a2d7-299d0aff3b30 service nova] Creating event network-vif-plugged:63c1537a-0706-49b0-8e88-a5c62f4ffbe3 for instance b0f03664-8785-4321-b32e-3622f1b747b9 on n-h2-master-1 Oct 30 01:42:31.716481 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-e6c93e18-ba24-4039-8b47-5e1f1f3d6949 req-017c10ae-fa5c-4fc1-a2d7-299d0aff3b30 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119775 Oct 30 01:42:31.723344 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2741/5475] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:42:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:42:32.246922 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-51c61def-ac8a-4218-a91b-ab8513bdfb5f tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:32.248628 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-51c61def-ac8a-4218-a91b-ab8513bdfb5f tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:32.261813 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51c61def-ac8a-4218-a91b-ab8513bdfb5f tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:32.265696 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51c61def-ac8a-4218-a91b-ab8513bdfb5f tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:32.268115 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51c61def-ac8a-4218-a91b-ab8513bdfb5f tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:32.274078 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51c61def-ac8a-4218-a91b-ab8513bdfb5f tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:32.283195 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51c61def-ac8a-4218-a91b-ab8513bdfb5f tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:32.290294 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51c61def-ac8a-4218-a91b-ab8513bdfb5f tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:32.803101 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-51c61def-ac8a-4218-a91b-ab8513bdfb5f tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:32.816583 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-51c61def-ac8a-4218-a91b-ab8513bdfb5f tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:32.836080 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-51c61def-ac8a-4218-a91b-ab8513bdfb5f tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:32.837803 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-51c61def-ac8a-4218-a91b-ab8513bdfb5f tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1605 microversion: 2.42 time: 0.597356 Oct 30 01:42:32.846044 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2742/5476] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:32 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1605 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:42:32.881880 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4bb5c80f-bff8-4a0f-963d-a441bf26dfeb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:32.885965 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4aa95df4-e7ec-47c7-b51e-8a49ef22c504 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "POST /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.664319 Oct 30 01:42:32.887663 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2735/5477] 10.222.0.13 () {62 vars in 1364 bytes} [Sun Oct 30 01:42:31 2022] POST /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d/os-volume_attachments => generated 188 bytes in 1671 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:42:32.902447 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4bb5c80f-bff8-4a0f-963d-a441bf26dfeb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:32.933289 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=82 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:32.937438 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4bb5c80f-bff8-4a0f-963d-a441bf26dfeb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:32.938141 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4bb5c80f-bff8-4a0f-963d-a441bf26dfeb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:32.941480 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4bb5c80f-bff8-4a0f-963d-a441bf26dfeb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:32.942765 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4bb5c80f-bff8-4a0f-963d-a441bf26dfeb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:32.943750 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4bb5c80f-bff8-4a0f-963d-a441bf26dfeb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:32.944440 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4bb5c80f-bff8-4a0f-963d-a441bf26dfeb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:33.219902 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d1d20540-87a4-4c2c-8132-cfe11c28051a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:33.220404 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d1d20540-87a4-4c2c-8132-cfe11c28051a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:33.255260 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d1d20540-87a4-4c2c-8132-cfe11c28051a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:33.260852 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d1d20540-87a4-4c2c-8132-cfe11c28051a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:33.264389 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d1d20540-87a4-4c2c-8132-cfe11c28051a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:33.264389 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d1d20540-87a4-4c2c-8132-cfe11c28051a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:33.264389 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d1d20540-87a4-4c2c-8132-cfe11c28051a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:33.264389 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d1d20540-87a4-4c2c-8132-cfe11c28051a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:33.825189 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4bb5c80f-bff8-4a0f-963d-a441bf26dfeb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:33.843903 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4bb5c80f-bff8-4a0f-963d-a441bf26dfeb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1683 microversion: 2.1 time: 0.994431 Oct 30 01:42:33.850587 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2743/5478] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:42:32 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1683 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:42:33.871414 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a7ce5e7d-7c6e-45f1-a328-17a5cacf4f96 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:33.873691 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a7ce5e7d-7c6e-45f1-a328-17a5cacf4f96 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:33.912073 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7ce5e7d-7c6e-45f1-a328-17a5cacf4f96 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:33.912898 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7ce5e7d-7c6e-45f1-a328-17a5cacf4f96 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:33.913523 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7ce5e7d-7c6e-45f1-a328-17a5cacf4f96 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:33.914410 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7ce5e7d-7c6e-45f1-a328-17a5cacf4f96 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:33.915014 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7ce5e7d-7c6e-45f1-a328-17a5cacf4f96 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:33.915593 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7ce5e7d-7c6e-45f1-a328-17a5cacf4f96 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:34.297876 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a7ce5e7d-7c6e-45f1-a328-17a5cacf4f96 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:34.322726 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a7ce5e7d-7c6e-45f1-a328-17a5cacf4f96 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:34.328638 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a7ce5e7d-7c6e-45f1-a328-17a5cacf4f96 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:34.335752 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a7ce5e7d-7c6e-45f1-a328-17a5cacf4f96 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1605 microversion: 2.42 time: 0.466178 Oct 30 01:42:34.340717 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2744/5479] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:33 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1605 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:42:34.465608 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d1d20540-87a4-4c2c-8132-cfe11c28051a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d/os-volume_attachments/40fa3efe-66fb-41b2-9f11-e6194cd599f1" status: 202 len: 0 microversion: 2.20 time: 1.250375 Oct 30 01:42:34.466760 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2736/5480] 10.222.0.13 () {60 vars in 1457 bytes} [Sun Oct 30 01:42:33 2022] DELETE /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d/os-volume_attachments/40fa3efe-66fb-41b2-9f11-e6194cd599f1 => generated 0 bytes in 1253 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 30 01:42:34.708276 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1f404432-9cd2-437b-b4f5-79857f8ebf36 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:42:34.708882 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1f404432-9cd2-437b-b4f5-79857f8ebf36 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:34.739363 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1f404432-9cd2-437b-b4f5-79857f8ebf36 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:34.739860 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1f404432-9cd2-437b-b4f5-79857f8ebf36 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:34.740291 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1f404432-9cd2-437b-b4f5-79857f8ebf36 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:34.741009 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1f404432-9cd2-437b-b4f5-79857f8ebf36 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:34.741480 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1f404432-9cd2-437b-b4f5-79857f8ebf36 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:34.741906 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1f404432-9cd2-437b-b4f5-79857f8ebf36 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:34.872073 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c6ba4dfe-b8ba-43c8-b62c-edb95e13a98e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:34.872572 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c6ba4dfe-b8ba-43c8-b62c-edb95e13a98e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:34.907122 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6ba4dfe-b8ba-43c8-b62c-edb95e13a98e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:34.910077 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1f404432-9cd2-437b-b4f5-79857f8ebf36 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121102) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 30 01:42:34.915496 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6ba4dfe-b8ba-43c8-b62c-edb95e13a98e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:34.928009 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6ba4dfe-b8ba-43c8-b62c-edb95e13a98e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:34.928009 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6ba4dfe-b8ba-43c8-b62c-edb95e13a98e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:34.928009 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6ba4dfe-b8ba-43c8-b62c-edb95e13a98e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:34.928009 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6ba4dfe-b8ba-43c8-b62c-edb95e13a98e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:35.347977 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1f404432-9cd2-437b-b4f5-79857f8ebf36 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "POST /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d/action" status: 202 len: 0 microversion: 2.20 time: 0.641038 Oct 30 01:42:35.352139 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2745/5481] 10.222.0.13 () {62 vars in 1319 bytes} [Sun Oct 30 01:42:34 2022] POST /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d/action => generated 0 bytes in 649 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 30 01:42:35.414251 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c7957e70-c396-4e22-b6f9-a45eef0ba131 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:35.424488 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c7957e70-c396-4e22-b6f9-a45eef0ba131 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:35.445255 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c7957e70-c396-4e22-b6f9-a45eef0ba131 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:35.446157 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c7957e70-c396-4e22-b6f9-a45eef0ba131 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:35.449763 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c7957e70-c396-4e22-b6f9-a45eef0ba131 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:35.450755 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c7957e70-c396-4e22-b6f9-a45eef0ba131 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:35.451399 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c7957e70-c396-4e22-b6f9-a45eef0ba131 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:35.453682 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c7957e70-c396-4e22-b6f9-a45eef0ba131 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:36.316894 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c6ba4dfe-b8ba-43c8-b62c-edb95e13a98e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:36.320115 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=9,nova_cell1:INSERT=6 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:36.353847 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c6ba4dfe-b8ba-43c8-b62c-edb95e13a98e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1683 microversion: 2.1 time: 1.489005 Oct 30 01:42:36.355210 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2737/5482] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:42:34 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1683 bytes in 1491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:42:36.394606 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e4317653-583f-474f-8e06-b14c5730903b tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:36.395567 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e4317653-583f-474f-8e06-b14c5730903b tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:36.427147 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e4317653-583f-474f-8e06-b14c5730903b tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:36.434149 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e4317653-583f-474f-8e06-b14c5730903b tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:36.434832 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e4317653-583f-474f-8e06-b14c5730903b tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:36.439952 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e4317653-583f-474f-8e06-b14c5730903b tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:36.450107 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e4317653-583f-474f-8e06-b14c5730903b tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:36.450896 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e4317653-583f-474f-8e06-b14c5730903b tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:36.680591 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e4317653-583f-474f-8e06-b14c5730903b tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:36.688240 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c7957e70-c396-4e22-b6f9-a45eef0ba131 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:36.690747 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e4317653-583f-474f-8e06-b14c5730903b tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:36.697899 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c7957e70-c396-4e22-b6f9-a45eef0ba131 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:36.703304 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c7957e70-c396-4e22-b6f9-a45eef0ba131 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:36.707565 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c7957e70-c396-4e22-b6f9-a45eef0ba131 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1670 microversion: 2.20 time: 1.351225 Oct 30 01:42:36.707886 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e4317653-583f-474f-8e06-b14c5730903b tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:36.709364 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e4317653-583f-474f-8e06-b14c5730903b tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1605 microversion: 2.42 time: 0.352839 Oct 30 01:42:36.710476 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2746/5483] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:35 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1670 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:42:36.710698 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2738/5484] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:36 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1605 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:42:37.380127 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-40451fdb-85d0-4b50-a7f2-cd173f2e2e17 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:37.382805 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-40451fdb-85d0-4b50-a7f2-cd173f2e2e17 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:37.418462 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-40451fdb-85d0-4b50-a7f2-cd173f2e2e17 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:37.425143 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-40451fdb-85d0-4b50-a7f2-cd173f2e2e17 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:37.429057 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-40451fdb-85d0-4b50-a7f2-cd173f2e2e17 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:37.452192 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-40451fdb-85d0-4b50-a7f2-cd173f2e2e17 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:37.453482 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-40451fdb-85d0-4b50-a7f2-cd173f2e2e17 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:37.460492 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-40451fdb-85d0-4b50-a7f2-cd173f2e2e17 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:37.744231 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fbbdec72-7e10-437a-93e3-e7b27e9596a9 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:37.745063 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-fbbdec72-7e10-437a-93e3-e7b27e9596a9 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:37.777128 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fbbdec72-7e10-437a-93e3-e7b27e9596a9 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:37.778117 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fbbdec72-7e10-437a-93e3-e7b27e9596a9 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:37.782867 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fbbdec72-7e10-437a-93e3-e7b27e9596a9 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:37.784345 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fbbdec72-7e10-437a-93e3-e7b27e9596a9 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:37.787698 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fbbdec72-7e10-437a-93e3-e7b27e9596a9 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:37.791306 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fbbdec72-7e10-437a-93e3-e7b27e9596a9 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:38.938166 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-40451fdb-85d0-4b50-a7f2-cd173f2e2e17 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:38.963859 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-40451fdb-85d0-4b50-a7f2-cd173f2e2e17 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1683 microversion: 2.1 time: 1.588055 Oct 30 01:42:38.964461 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2747/5485] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:42:37 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1683 bytes in 1589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:42:38.970275 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-987614bd-9a4a-4bc2-8cda-f05059c97909 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:38.997876 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-987614bd-9a4a-4bc2-8cda-f05059c97909 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:39.032728 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-987614bd-9a4a-4bc2-8cda-f05059c97909 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:39.034650 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-987614bd-9a4a-4bc2-8cda-f05059c97909 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:39.035274 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-987614bd-9a4a-4bc2-8cda-f05059c97909 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:39.040734 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-987614bd-9a4a-4bc2-8cda-f05059c97909 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:39.041467 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-987614bd-9a4a-4bc2-8cda-f05059c97909 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:39.042779 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-987614bd-9a4a-4bc2-8cda-f05059c97909 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:39.088902 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-fbbdec72-7e10-437a-93e3-e7b27e9596a9 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:39.105863 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-fbbdec72-7e10-437a-93e3-e7b27e9596a9 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:39.116400 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-fbbdec72-7e10-437a-93e3-e7b27e9596a9 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:39.118074 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fbbdec72-7e10-437a-93e3-e7b27e9596a9 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1670 microversion: 2.20 time: 1.380178 Oct 30 01:42:39.130053 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2739/5486] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:37 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1670 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:42:39.479534 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-987614bd-9a4a-4bc2-8cda-f05059c97909 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:39.502973 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-987614bd-9a4a-4bc2-8cda-f05059c97909 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:39.504861 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-987614bd-9a4a-4bc2-8cda-f05059c97909 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:39.516591 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-987614bd-9a4a-4bc2-8cda-f05059c97909 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1605 microversion: 2.42 time: 0.544216 Oct 30 01:42:39.516591 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2748/5487] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:38 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1605 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:42:40.009602 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-73aad9c8-9750-4342-b7c8-43676f6ebd40 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:40.013534 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-73aad9c8-9750-4342-b7c8-43676f6ebd40 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:40.059928 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-73aad9c8-9750-4342-b7c8-43676f6ebd40 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:40.063491 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-73aad9c8-9750-4342-b7c8-43676f6ebd40 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:40.073760 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-73aad9c8-9750-4342-b7c8-43676f6ebd40 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:40.092243 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-73aad9c8-9750-4342-b7c8-43676f6ebd40 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:40.097389 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-73aad9c8-9750-4342-b7c8-43676f6ebd40 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:40.109024 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-73aad9c8-9750-4342-b7c8-43676f6ebd40 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:40.174579 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fbc9ca84-b0b0-432e-81b5-322eb01bb2b8 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:40.175192 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fbc9ca84-b0b0-432e-81b5-322eb01bb2b8 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:40.181736 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fbc9ca84-b0b0-432e-81b5-322eb01bb2b8 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:40.182451 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fbc9ca84-b0b0-432e-81b5-322eb01bb2b8 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:40.183076 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fbc9ca84-b0b0-432e-81b5-322eb01bb2b8 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:40.184207 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fbc9ca84-b0b0-432e-81b5-322eb01bb2b8 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:40.184817 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fbc9ca84-b0b0-432e-81b5-322eb01bb2b8 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:40.185414 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fbc9ca84-b0b0-432e-81b5-322eb01bb2b8 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:40.762087 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-fbc9ca84-b0b0-432e-81b5-322eb01bb2b8 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:40.782838 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-fbc9ca84-b0b0-432e-81b5-322eb01bb2b8 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:40.783522 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-fbc9ca84-b0b0-432e-81b5-322eb01bb2b8 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:40.786736 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fbc9ca84-b0b0-432e-81b5-322eb01bb2b8 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1670 microversion: 2.20 time: 0.638546 Oct 30 01:42:40.788017 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2749/5488] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:40 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1670 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:42:40.793166 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c511c5b3-b9e6-4132-96ae-dff042d2f142 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:40.795149 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c511c5b3-b9e6-4132-96ae-dff042d2f142 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:40.802449 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c511c5b3-b9e6-4132-96ae-dff042d2f142 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:40.803177 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c511c5b3-b9e6-4132-96ae-dff042d2f142 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:40.803848 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c511c5b3-b9e6-4132-96ae-dff042d2f142 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:40.806039 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c511c5b3-b9e6-4132-96ae-dff042d2f142 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:40.806733 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c511c5b3-b9e6-4132-96ae-dff042d2f142 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:40.821585 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c511c5b3-b9e6-4132-96ae-dff042d2f142 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:40.849311 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-73aad9c8-9750-4342-b7c8-43676f6ebd40 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:40.857840 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-73aad9c8-9750-4342-b7c8-43676f6ebd40 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1683 microversion: 2.1 time: 0.862454 Oct 30 01:42:40.883317 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2740/5489] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:42:39 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1683 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:42:40.914859 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:41.077590 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c511c5b3-b9e6-4132-96ae-dff042d2f142 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:41.102515 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c511c5b3-b9e6-4132-96ae-dff042d2f142 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:41.114080 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c511c5b3-b9e6-4132-96ae-dff042d2f142 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:41.120970 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c511c5b3-b9e6-4132-96ae-dff042d2f142 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1605 microversion: 2.42 time: 0.328692 Oct 30 01:42:41.122990 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2750/5490] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:40 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1605 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:42:41.815807 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-93b5320c-0b5f-4175-aca0-d43f21fcbc35 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:41.816425 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-93b5320c-0b5f-4175-aca0-d43f21fcbc35 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:41.836089 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-93b5320c-0b5f-4175-aca0-d43f21fcbc35 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:41.836632 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-93b5320c-0b5f-4175-aca0-d43f21fcbc35 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:41.837134 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-93b5320c-0b5f-4175-aca0-d43f21fcbc35 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:41.838015 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-93b5320c-0b5f-4175-aca0-d43f21fcbc35 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:41.838710 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-93b5320c-0b5f-4175-aca0-d43f21fcbc35 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:41.839176 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-93b5320c-0b5f-4175-aca0-d43f21fcbc35 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:41.885616 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b44afd23-de05-49cf-bf5f-29ba1e20a84d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:41.886380 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b44afd23-de05-49cf-bf5f-29ba1e20a84d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:41.917944 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b44afd23-de05-49cf-bf5f-29ba1e20a84d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:41.918495 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b44afd23-de05-49cf-bf5f-29ba1e20a84d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:41.919227 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b44afd23-de05-49cf-bf5f-29ba1e20a84d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:41.919697 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b44afd23-de05-49cf-bf5f-29ba1e20a84d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:41.920142 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b44afd23-de05-49cf-bf5f-29ba1e20a84d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:41.920601 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b44afd23-de05-49cf-bf5f-29ba1e20a84d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:42.647894 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-93b5320c-0b5f-4175-aca0-d43f21fcbc35 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:42.677012 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-93b5320c-0b5f-4175-aca0-d43f21fcbc35 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:42.685553 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-93b5320c-0b5f-4175-aca0-d43f21fcbc35 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:42.705631 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-93b5320c-0b5f-4175-aca0-d43f21fcbc35 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1670 microversion: 2.20 time: 0.887992 Oct 30 01:42:42.710287 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2741/5491] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:41 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1670 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:42:42.716961 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8b94dda9-f746-477a-875e-04d01eb045ad tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:42.718518 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8b94dda9-f746-477a-875e-04d01eb045ad tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:42.728270 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8b94dda9-f746-477a-875e-04d01eb045ad tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:42.730831 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8b94dda9-f746-477a-875e-04d01eb045ad tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:42.730831 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8b94dda9-f746-477a-875e-04d01eb045ad tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:42.733744 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8b94dda9-f746-477a-875e-04d01eb045ad tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:42.739159 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8b94dda9-f746-477a-875e-04d01eb045ad tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:42.741729 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8b94dda9-f746-477a-875e-04d01eb045ad tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:43.273003 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b44afd23-de05-49cf-bf5f-29ba1e20a84d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:43.281998 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b44afd23-de05-49cf-bf5f-29ba1e20a84d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1683 microversion: 2.1 time: 1.403501 Oct 30 01:42:43.294070 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2751/5492] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:42:41 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1683 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:42:43.407180 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8b94dda9-f746-477a-875e-04d01eb045ad tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:43.433180 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8b94dda9-f746-477a-875e-04d01eb045ad tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:43.442739 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8b94dda9-f746-477a-875e-04d01eb045ad tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:43.466330 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8b94dda9-f746-477a-875e-04d01eb045ad tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1605 microversion: 2.42 time: 0.749972 Oct 30 01:42:43.470666 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2742/5493] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:42 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1605 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:42:43.737353 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-392e6eca-eeea-46ab-9822-a348045a0571 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:43.741255 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-392e6eca-eeea-46ab-9822-a348045a0571 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:43.763028 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-392e6eca-eeea-46ab-9822-a348045a0571 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:43.771682 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-392e6eca-eeea-46ab-9822-a348045a0571 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:43.772918 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-392e6eca-eeea-46ab-9822-a348045a0571 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:43.773844 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-392e6eca-eeea-46ab-9822-a348045a0571 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:43.777962 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-392e6eca-eeea-46ab-9822-a348045a0571 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:43.778575 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-392e6eca-eeea-46ab-9822-a348045a0571 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:44.321962 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fd6e8993-6bdc-40a2-a68a-f16a5a43a9f7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:44.322978 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-fd6e8993-6bdc-40a2-a68a-f16a5a43a9f7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:44.339020 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fd6e8993-6bdc-40a2-a68a-f16a5a43a9f7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:44.340903 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fd6e8993-6bdc-40a2-a68a-f16a5a43a9f7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:44.341958 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fd6e8993-6bdc-40a2-a68a-f16a5a43a9f7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:44.343475 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fd6e8993-6bdc-40a2-a68a-f16a5a43a9f7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:44.344132 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fd6e8993-6bdc-40a2-a68a-f16a5a43a9f7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:44.347757 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fd6e8993-6bdc-40a2-a68a-f16a5a43a9f7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:44.677279 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-392e6eca-eeea-46ab-9822-a348045a0571 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:44.705087 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-392e6eca-eeea-46ab-9822-a348045a0571 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:44.717768 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-392e6eca-eeea-46ab-9822-a348045a0571 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:44.720940 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-392e6eca-eeea-46ab-9822-a348045a0571 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1670 microversion: 2.20 time: 0.988571 Oct 30 01:42:44.725790 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2752/5494] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:43 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1670 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:42:44.737295 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8a61df2f-3fb4-451c-83d7-601d3fb7d15f tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:44.744222 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8a61df2f-3fb4-451c-83d7-601d3fb7d15f tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:44.804808 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8a61df2f-3fb4-451c-83d7-601d3fb7d15f tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:44.805742 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8a61df2f-3fb4-451c-83d7-601d3fb7d15f tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:44.806538 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8a61df2f-3fb4-451c-83d7-601d3fb7d15f tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:44.809102 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8a61df2f-3fb4-451c-83d7-601d3fb7d15f tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:44.814405 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8a61df2f-3fb4-451c-83d7-601d3fb7d15f tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:44.815404 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8a61df2f-3fb4-451c-83d7-601d3fb7d15f tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:45.468619 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8a61df2f-3fb4-451c-83d7-601d3fb7d15f tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:45.483035 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8a61df2f-3fb4-451c-83d7-601d3fb7d15f tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:45.495540 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8a61df2f-3fb4-451c-83d7-601d3fb7d15f tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:45.497663 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8a61df2f-3fb4-451c-83d7-601d3fb7d15f tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1605 microversion: 2.42 time: 0.770357 Oct 30 01:42:45.501602 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2753/5495] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:44 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1605 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:42:45.763302 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b789aad4-a82f-430c-b10f-37805c9d7a65 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:45.765109 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b789aad4-a82f-430c-b10f-37805c9d7a65 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:45.785328 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b789aad4-a82f-430c-b10f-37805c9d7a65 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:45.790699 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b789aad4-a82f-430c-b10f-37805c9d7a65 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:45.792226 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b789aad4-a82f-430c-b10f-37805c9d7a65 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:45.798651 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b789aad4-a82f-430c-b10f-37805c9d7a65 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:45.799362 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b789aad4-a82f-430c-b10f-37805c9d7a65 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:45.805329 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b789aad4-a82f-430c-b10f-37805c9d7a65 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:46.546151 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-fd6e8993-6bdc-40a2-a68a-f16a5a43a9f7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:46.571433 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fd6e8993-6bdc-40a2-a68a-f16a5a43a9f7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1683 microversion: 2.1 time: 2.253626 Oct 30 01:42:46.573412 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2743/5496] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:42:44 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1683 bytes in 2256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:42:47.062638 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-89ff03ab-fd21-4076-b98b-91498386b28a tempest-VolumesNegativeTest-451905097 tempest-VolumesNegativeTest-451905097-project] Action: 'create', calling method: .version_select at 0x7f44c73b2dc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-909381358", "metadata": {"Type": "work"}}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-89ff03ab-fd21-4076-b98b-91498386b28a tempest-VolumesNegativeTest-451905097 tempest-VolumesNegativeTest-451905097-project] Request method failure captured: Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 121 Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdaVIKY-e_sOA63GPKmUaAIK3ulpBayYyI5nm2hnU4VLAZ6ODMAgs4TdkiIv_XbzYAUKuaqkhm7x87h-4VRjJBkHNTdjY-u-Wuxp5JgARIAZwSMa0pqdq0iIab4OIckBZ5ZadQQ2DYVACQm0R5b17v3Q0nJCG1c42eFjicsgGfNEjO8 Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 4f18aff2d4054db8988f4840a0f29838 Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-VolumesNegativeTest-451905097 Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4f18aff2d4054db8988f4840a0f29838"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4f18aff2d4054db8988f4840a0f29838"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4f18aff2d4054db8988f4840a0f29838"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4f18aff2d4054db8988f4840a0f29838"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-VolumesNegativeTest-451905097 Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 4f18aff2d4054db8988f4840a0f29838 Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-VolumesNegativeTest-451905097 Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-VolumesNegativeTest-451905097-project Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 21c1838f010e44b3a8ee349ccc2dbbb5 Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-VolumesNegativeTest-451905097-project Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-909381358", "metadata": {"Type": "work"}}} Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: method: Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-909381358', 'metadata': {'Type': 'work'}}}} Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise error Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi '#$%' Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 30 01:42:47.079183 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 30 01:42:47.084640 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 30 01:42:47.084640 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:42:47.084640 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:42:47.084640 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:42:47.084640 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:42:47.084640 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:42:47.084640 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:42:47.084640 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 30 01:42:47.084640 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 30 01:42:47.084640 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 30 01:42:47.084640 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:42:47.086237 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-89ff03ab-fd21-4076-b98b-91498386b28a tempest-VolumesNegativeTest-451905097 tempest-VolumesNegativeTest-451905097-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:42:47.087396 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-89ff03ab-fd21-4076-b98b-91498386b28a tempest-VolumesNegativeTest-451905097 tempest-VolumesNegativeTest-451905097-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.511548 Oct 30 01:42:47.090586 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2744/5497] 10.222.0.13 () {60 vars in 1156 bytes} [Sun Oct 30 01:42:46 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 515 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:42:47.100259 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d18cc937-6518-4325-a00f-2b67069b550c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:47.109032 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d18cc937-6518-4325-a00f-2b67069b550c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:47.134593 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d18cc937-6518-4325-a00f-2b67069b550c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:47.137788 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d18cc937-6518-4325-a00f-2b67069b550c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:47.138549 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d18cc937-6518-4325-a00f-2b67069b550c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:47.142749 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d18cc937-6518-4325-a00f-2b67069b550c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:47.143383 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d18cc937-6518-4325-a00f-2b67069b550c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:47.145389 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d18cc937-6518-4325-a00f-2b67069b550c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:47.234775 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b789aad4-a82f-430c-b10f-37805c9d7a65 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:47.252196 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b789aad4-a82f-430c-b10f-37805c9d7a65 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:47.261448 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b789aad4-a82f-430c-b10f-37805c9d7a65 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:47.266453 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b789aad4-a82f-430c-b10f-37805c9d7a65 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1670 microversion: 2.20 time: 1.507216 Oct 30 01:42:47.274401 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2754/5498] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:45 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1670 bytes in 1516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:42:47.286581 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-75c36c6d-c3ad-42a6-af84-b8a405e72a9a tempest-VolumesNegativeTest-451905097 tempest-VolumesNegativeTest-451905097-project] Action: 'create', calling method: .version_select at 0x7f44c6d94430>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-649829425", "metadata": {"Type": "work"}}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-75c36c6d-c3ad-42a6-af84-b8a405e72a9a tempest-VolumesNegativeTest-451905097 tempest-VolumesNegativeTest-451905097-project] Request method failure captured: Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 119 Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdaVIKY-e_sOA63GPKmUaAIK3ulpBayYyI5nm2hnU4VLAZ6ODMAgs4TdkiIv_XbzYAUKuaqkhm7x87h-4VRjJBkHNTdjY-u-Wuxp5JgARIAZwSMa0pqdq0iIab4OIckBZ5ZadQQ2DYVACQm0R5b17v3Q0nJCG1c42eFjicsgGfNEjO8 Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 4f18aff2d4054db8988f4840a0f29838 Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-VolumesNegativeTest-451905097 Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4f18aff2d4054db8988f4840a0f29838"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4f18aff2d4054db8988f4840a0f29838"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4f18aff2d4054db8988f4840a0f29838"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4f18aff2d4054db8988f4840a0f29838"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-VolumesNegativeTest-451905097 Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 4f18aff2d4054db8988f4840a0f29838 Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-VolumesNegativeTest-451905097 Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-VolumesNegativeTest-451905097-project Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 21c1838f010e44b3a8ee349ccc2dbbb5 Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-VolumesNegativeTest-451905097-project Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-649829425", "metadata": {"Type": "work"}}} Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: method: Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-649829425', 'metadata': {'Type': 'work'}}}} Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise error Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi '0' Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 30 01:42:47.306087 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 30 01:42:47.310331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 30 01:42:47.310331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:42:47.310331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:42:47.310331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:42:47.310331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:42:47.310331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:42:47.310331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:42:47.310331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 30 01:42:47.310331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 30 01:42:47.310331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 30 01:42:47.310331 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:42:47.312991 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-75c36c6d-c3ad-42a6-af84-b8a405e72a9a tempest-VolumesNegativeTest-451905097 tempest-VolumesNegativeTest-451905097-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:42:47.325234 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-75c36c6d-c3ad-42a6-af84-b8a405e72a9a tempest-VolumesNegativeTest-451905097 tempest-VolumesNegativeTest-451905097-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.048471 Oct 30 01:42:47.326094 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2755/5499] 10.222.0.13 () {60 vars in 1156 bytes} [Sun Oct 30 01:42:47 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:42:47.347675 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9298ce5a-97c6-4962-bc99-009e63dc2639 tempest-VolumesNegativeTest-451905097 tempest-VolumesNegativeTest-451905097-project] Action: 'create', calling method: .version_select at 0x7f44c7693430>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1351631732", "metadata": {"Type": "work"}}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9298ce5a-97c6-4962-bc99-009e63dc2639 tempest-VolumesNegativeTest-451905097 tempest-VolumesNegativeTest-451905097-project] Request method failure captured: Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 119 Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdaVIKY-e_sOA63GPKmUaAIK3ulpBayYyI5nm2hnU4VLAZ6ODMAgs4TdkiIv_XbzYAUKuaqkhm7x87h-4VRjJBkHNTdjY-u-Wuxp5JgARIAZwSMa0pqdq0iIab4OIckBZ5ZadQQ2DYVACQm0R5b17v3Q0nJCG1c42eFjicsgGfNEjO8 Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 4f18aff2d4054db8988f4840a0f29838 Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-VolumesNegativeTest-451905097 Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4f18aff2d4054db8988f4840a0f29838"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4f18aff2d4054db8988f4840a0f29838"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4f18aff2d4054db8988f4840a0f29838"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4f18aff2d4054db8988f4840a0f29838"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-VolumesNegativeTest-451905097 Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 4f18aff2d4054db8988f4840a0f29838 Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-VolumesNegativeTest-451905097 Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-VolumesNegativeTest-451905097-project Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 21c1838f010e44b3a8ee349ccc2dbbb5 Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-VolumesNegativeTest-451905097-project Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1351631732", "metadata": {"Type": "work"}}} Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: method: Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1351631732', 'metadata': {'Type': 'work'}}}} Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise error Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi '' Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 30 01:42:47.352997 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 30 01:42:47.357030 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 30 01:42:47.357030 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:42:47.357030 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:42:47.357030 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:42:47.357030 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:42:47.357030 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:42:47.357030 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:42:47.357030 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 30 01:42:47.357030 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 30 01:42:47.357030 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 30 01:42:47.357030 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:42:47.376288 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9298ce5a-97c6-4962-bc99-009e63dc2639 tempest-VolumesNegativeTest-451905097 tempest-VolumesNegativeTest-451905097-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:42:47.377600 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9298ce5a-97c6-4962-bc99-009e63dc2639 tempest-VolumesNegativeTest-451905097 tempest-VolumesNegativeTest-451905097-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.043953 Oct 30 01:42:47.378396 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2756/5500] 10.222.0.13 () {60 vars in 1156 bytes} [Sun Oct 30 01:42:47 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:42:47.395878 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5226b688-5935-42fb-a310-5fbb67111648 tempest-VolumesNegativeTest-451905097 tempest-VolumesNegativeTest-451905097-project] Calling method '.version_select at 0x7f44c6d3fdc0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:47.454673 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d18cc937-6518-4325-a00f-2b67069b550c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:47.482783 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-5226b688-5935-42fb-a310-5fbb67111648 tempest-VolumesNegativeTest-451905097 tempest-VolumesNegativeTest-451905097-project] HTTP exception thrown: Volume tempest-invalid-368540449 could not be found. Oct 30 01:42:47.483987 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d18cc937-6518-4325-a00f-2b67069b550c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5226b688-5935-42fb-a310-5fbb67111648 tempest-VolumesNegativeTest-451905097 tempest-VolumesNegativeTest-451905097-project] Request method failure captured: Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-368540449 HTTP/1.1 Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdaVIKY-e_sOA63GPKmUaAIK3ulpBayYyI5nm2hnU4VLAZ6ODMAgs4TdkiIv_XbzYAUKuaqkhm7x87h-4VRjJBkHNTdjY-u-Wuxp5JgARIAZwSMa0pqdq0iIab4OIckBZ5ZadQQ2DYVACQm0R5b17v3Q0nJCG1c42eFjicsgGfNEjO8 Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 4f18aff2d4054db8988f4840a0f29838 Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-VolumesNegativeTest-451905097 Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4f18aff2d4054db8988f4840a0f29838"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4f18aff2d4054db8988f4840a0f29838"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4f18aff2d4054db8988f4840a0f29838"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4f18aff2d4054db8988f4840a0f29838"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-VolumesNegativeTest-451905097 Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 4f18aff2d4054db8988f4840a0f29838 Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-VolumesNegativeTest-451905097 Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-VolumesNegativeTest-451905097-project Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 21c1838f010e44b3a8ee349ccc2dbbb5 Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-VolumesNegativeTest-451905097-project Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: method: Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: exception: Volume tempest-invalid-368540449 could not be found. Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'tempest-invalid-368540449'} Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-368540449 could not be found. (HTTP 404) (Request-ID: req-ff714726-7a5a-4ddd-815c-424561d356f3) Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 30 01:42:47.487087 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 30 01:42:47.492346 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 30 01:42:47.492346 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 30 01:42:47.492346 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 30 01:42:47.492346 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 30 01:42:47.492346 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 30 01:42:47.492346 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 30 01:42:47.492346 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 30 01:42:47.492346 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 30 01:42:47.492346 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 30 01:42:47.492346 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 30 01:42:47.492346 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 30 01:42:47.492346 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 30 01:42:47.492346 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-368540449 could not be found. Oct 30 01:42:47.492346 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:42:47.492346 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:42:47.492346 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:42:47.492346 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:42:47.492346 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:42:47.492346 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:42:47.492346 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:42:47.492346 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:42:47.492346 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:42:47.492346 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:42:47.492346 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:42:47.492346 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:42:47.492346 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 30 01:42:47.492346 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:42:47.492346 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-368540449 could not be found. Oct 30 01:42:47.492346 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:42:47.492346 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:42:47.492346 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:42:47.492346 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:42:47.492346 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:42:47.492346 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:42:47.492346 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:42:47.492346 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:42:47.492346 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-368540449 could not be found. Oct 30 01:42:47.492346 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:42:47.492346 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5226b688-5935-42fb-a310-5fbb67111648 tempest-VolumesNegativeTest-451905097 tempest-VolumesNegativeTest-451905097-project] Returning 404 to user: Volume tempest-invalid-368540449 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:42:47.492346 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5226b688-5935-42fb-a310-5fbb67111648 tempest-VolumesNegativeTest-451905097 tempest-VolumesNegativeTest-451905097-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/tempest-invalid-368540449" status: 404 len: 98 microversion: 2.1 time: 0.104091 Oct 30 01:42:47.492346 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2757/5501] 10.222.0.13 () {58 vars in 1215 bytes} [Sun Oct 30 01:42:47 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-368540449 => generated 98 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:42:47.504188 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d18cc937-6518-4325-a00f-2b67069b550c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:47.506950 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d18cc937-6518-4325-a00f-2b67069b550c tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1605 microversion: 2.42 time: 0.415236 Oct 30 01:42:47.508565 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4788c455-c355-495e-8619-39428dbf2a56 tempest-VolumesNegativeTest-451905097 tempest-VolumesNegativeTest-451905097-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.010749 Oct 30 01:42:47.508952 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2745/5502] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:47 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1605 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:42:47.510164 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2758/5503] 10.222.0.13 () {58 vars in 1140 bytes} [Sun Oct 30 01:42:47 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 30 01:42:47.544988 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-23f19fe7-7850-4b95-be82-799a4fc459ef tempest-VolumesNegativeTest-451905097 tempest-VolumesNegativeTest-451905097-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004521 Oct 30 01:42:47.545790 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2759/5504] 10.222.0.13 () {58 vars in 1137 bytes} [Sun Oct 30 01:42:47 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 30 01:42:47.556056 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-286f9fe6-ab87-4ecc-9200-77fb8f594861 tempest-VolumesNegativeTest-451905097 tempest-VolumesNegativeTest-451905097-project] Calling method '.version_select at 0x7f44c6f11550>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:47.596938 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5f14766d-cf38-42b5-9cd9-1fa7c6f9f2cc tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:47.601116 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5f14766d-cf38-42b5-9cd9-1fa7c6f9f2cc tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:47.609612 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f14766d-cf38-42b5-9cd9-1fa7c6f9f2cc tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:47.612782 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f14766d-cf38-42b5-9cd9-1fa7c6f9f2cc tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:47.613441 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f14766d-cf38-42b5-9cd9-1fa7c6f9f2cc tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:47.614403 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f14766d-cf38-42b5-9cd9-1fa7c6f9f2cc tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:47.615152 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f14766d-cf38-42b5-9cd9-1fa7c6f9f2cc tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:47.618960 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-286f9fe6-ab87-4ecc-9200-77fb8f594861 tempest-VolumesNegativeTest-451905097 tempest-VolumesNegativeTest-451905097-project] HTTP exception thrown: Volume 08dad88d-b26b-4467-bb5b-3ebd9775b24b could not be found. Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-286f9fe6-ab87-4ecc-9200-77fb8f594861 tempest-VolumesNegativeTest-451905097 tempest-VolumesNegativeTest-451905097-project] Request method failure captured: Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: request: DELETE /compute/v2.1/os-volumes/08dad88d-b26b-4467-bb5b-3ebd9775b24b HTTP/1.1 Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdaVIKY-e_sOA63GPKmUaAIK3ulpBayYyI5nm2hnU4VLAZ6ODMAgs4TdkiIv_XbzYAUKuaqkhm7x87h-4VRjJBkHNTdjY-u-Wuxp5JgARIAZwSMa0pqdq0iIab4OIckBZ5ZadQQ2DYVACQm0R5b17v3Q0nJCG1c42eFjicsgGfNEjO8 Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 4f18aff2d4054db8988f4840a0f29838 Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-VolumesNegativeTest-451905097 Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4f18aff2d4054db8988f4840a0f29838"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4f18aff2d4054db8988f4840a0f29838"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4f18aff2d4054db8988f4840a0f29838"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4f18aff2d4054db8988f4840a0f29838"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-VolumesNegativeTest-451905097 Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 4f18aff2d4054db8988f4840a0f29838 Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-VolumesNegativeTest-451905097 Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-VolumesNegativeTest-451905097-project Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 21c1838f010e44b3a8ee349ccc2dbbb5 Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-VolumesNegativeTest-451905097-project Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: method: Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: exception: Volume 08dad88d-b26b-4467-bb5b-3ebd9775b24b could not be found. Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '08dad88d-b26b-4467-bb5b-3ebd9775b24b'} Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 08dad88d-b26b-4467-bb5b-3ebd9775b24b could not be found. (HTTP 404) (Request-ID: req-5fdd947a-1fa5-4afb-8348-218132a35730) Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 30 01:42:47.623763 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 30 01:42:47.628967 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 30 01:42:47.628967 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 30 01:42:47.628967 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 30 01:42:47.628967 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 30 01:42:47.628967 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 30 01:42:47.628967 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 30 01:42:47.628967 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 30 01:42:47.628967 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 30 01:42:47.628967 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 30 01:42:47.628967 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 30 01:42:47.628967 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 30 01:42:47.628967 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 30 01:42:47.628967 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 30 01:42:47.628967 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 08dad88d-b26b-4467-bb5b-3ebd9775b24b could not be found. Oct 30 01:42:47.628967 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:42:47.628967 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:42:47.628967 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:42:47.628967 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:42:47.628967 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:42:47.628967 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:42:47.628967 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:42:47.628967 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:42:47.628967 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:42:47.628967 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:42:47.628967 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:42:47.628967 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:42:47.628967 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 30 01:42:47.628967 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:42:47.628967 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 08dad88d-b26b-4467-bb5b-3ebd9775b24b could not be found. Oct 30 01:42:47.628967 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:42:47.628967 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:42:47.628967 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:42:47.628967 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:42:47.628967 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:42:47.628967 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:42:47.628967 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:42:47.628967 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:42:47.628967 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 08dad88d-b26b-4467-bb5b-3ebd9775b24b could not be found. Oct 30 01:42:47.628967 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:42:47.633765 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-286f9fe6-ab87-4ecc-9200-77fb8f594861 tempest-VolumesNegativeTest-451905097 tempest-VolumesNegativeTest-451905097-project] Returning 404 to user: Volume 08dad88d-b26b-4467-bb5b-3ebd9775b24b could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:42:47.633765 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-286f9fe6-ab87-4ecc-9200-77fb8f594861 tempest-VolumesNegativeTest-451905097 tempest-VolumesNegativeTest-451905097-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/08dad88d-b26b-4467-bb5b-3ebd9775b24b" status: 404 len: 109 microversion: 2.1 time: 0.078947 Oct 30 01:42:47.633765 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2746/5505] 10.222.0.13 () {58 vars in 1248 bytes} [Sun Oct 30 01:42:47 2022] DELETE /compute/v2.1/os-volumes/08dad88d-b26b-4467-bb5b-3ebd9775b24b => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 01:42:47.637836 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f14766d-cf38-42b5-9cd9-1fa7c6f9f2cc tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:47.651887 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-59b27ff8-0f56-4f88-9870-30a19125f9c9 tempest-VolumesNegativeTest-451905097 tempest-VolumesNegativeTest-451905097-project] Calling method '.version_select at 0x7f44c6e1c790>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:47.716955 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-59b27ff8-0f56-4f88-9870-30a19125f9c9 tempest-VolumesNegativeTest-451905097 tempest-VolumesNegativeTest-451905097-project] HTTP exception thrown: Volume 9a2be6ea-3b2d-4dc3-8a58-2dafad968d36 could not be found. Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-59b27ff8-0f56-4f88-9870-30a19125f9c9 tempest-VolumesNegativeTest-451905097 tempest-VolumesNegativeTest-451905097-project] Request method failure captured: Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/os-volumes/9a2be6ea-3b2d-4dc3-8a58-2dafad968d36 HTTP/1.1 Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdaVIKY-e_sOA63GPKmUaAIK3ulpBayYyI5nm2hnU4VLAZ6ODMAgs4TdkiIv_XbzYAUKuaqkhm7x87h-4VRjJBkHNTdjY-u-Wuxp5JgARIAZwSMa0pqdq0iIab4OIckBZ5ZadQQ2DYVACQm0R5b17v3Q0nJCG1c42eFjicsgGfNEjO8 Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 4f18aff2d4054db8988f4840a0f29838 Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-VolumesNegativeTest-451905097 Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4f18aff2d4054db8988f4840a0f29838"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4f18aff2d4054db8988f4840a0f29838"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4f18aff2d4054db8988f4840a0f29838"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4f18aff2d4054db8988f4840a0f29838"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-VolumesNegativeTest-451905097 Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 4f18aff2d4054db8988f4840a0f29838 Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-VolumesNegativeTest-451905097 Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-VolumesNegativeTest-451905097-project Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 21c1838f010e44b3a8ee349ccc2dbbb5 Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-VolumesNegativeTest-451905097-project Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: method: Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: exception: Volume 9a2be6ea-3b2d-4dc3-8a58-2dafad968d36 could not be found. Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '9a2be6ea-3b2d-4dc3-8a58-2dafad968d36'} Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9a2be6ea-3b2d-4dc3-8a58-2dafad968d36 could not be found. (HTTP 404) (Request-ID: req-534441ab-a080-4f36-8f80-7e77635ba3d1) Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 30 01:42:47.719865 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 30 01:42:47.727675 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 30 01:42:47.727675 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 30 01:42:47.727675 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 30 01:42:47.727675 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 30 01:42:47.727675 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 30 01:42:47.727675 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 30 01:42:47.727675 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 30 01:42:47.727675 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 30 01:42:47.727675 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 30 01:42:47.727675 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 30 01:42:47.727675 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 30 01:42:47.727675 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 30 01:42:47.727675 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 30 01:42:47.727675 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9a2be6ea-3b2d-4dc3-8a58-2dafad968d36 could not be found. Oct 30 01:42:47.727675 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:42:47.727675 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:42:47.727675 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:42:47.727675 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:42:47.727675 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:42:47.727675 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:42:47.727675 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:42:47.727675 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:42:47.727675 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:42:47.727675 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:42:47.727675 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:42:47.727675 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:42:47.727675 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 30 01:42:47.727675 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:42:47.727675 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9a2be6ea-3b2d-4dc3-8a58-2dafad968d36 could not be found. Oct 30 01:42:47.727675 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:42:47.727675 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:42:47.727675 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:42:47.727675 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:42:47.727675 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:42:47.727675 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:42:47.727675 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:42:47.727675 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:42:47.727675 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9a2be6ea-3b2d-4dc3-8a58-2dafad968d36 could not be found. Oct 30 01:42:47.727675 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:42:47.727675 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-59b27ff8-0f56-4f88-9870-30a19125f9c9 tempest-VolumesNegativeTest-451905097 tempest-VolumesNegativeTest-451905097-project] Returning 404 to user: Volume 9a2be6ea-3b2d-4dc3-8a58-2dafad968d36 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:42:47.727675 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-59b27ff8-0f56-4f88-9870-30a19125f9c9 tempest-VolumesNegativeTest-451905097 tempest-VolumesNegativeTest-451905097-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/9a2be6ea-3b2d-4dc3-8a58-2dafad968d36" status: 404 len: 109 microversion: 2.1 time: 0.079489 Oct 30 01:42:47.731336 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2747/5506] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 30 01:42:47 2022] GET /compute/v2.1/os-volumes/9a2be6ea-3b2d-4dc3-8a58-2dafad968d36 => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:42:48.283118 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5f14766d-cf38-42b5-9cd9-1fa7c6f9f2cc tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:48.303075 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-309d95ad-5d4f-49a3-987f-7d26121cf666 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:48.304006 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-309d95ad-5d4f-49a3-987f-7d26121cf666 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:48.312591 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-309d95ad-5d4f-49a3-987f-7d26121cf666 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:48.327170 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5f14766d-cf38-42b5-9cd9-1fa7c6f9f2cc tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1683 microversion: 2.1 time: 0.734038 Oct 30 01:42:48.329196 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2760/5507] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:42:47 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1683 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:42:48.345321 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-309d95ad-5d4f-49a3-987f-7d26121cf666 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:48.345321 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-309d95ad-5d4f-49a3-987f-7d26121cf666 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:48.345321 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-309d95ad-5d4f-49a3-987f-7d26121cf666 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:48.345321 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-309d95ad-5d4f-49a3-987f-7d26121cf666 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:48.345321 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-309d95ad-5d4f-49a3-987f-7d26121cf666 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:48.544080 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f70e5d01-516e-4683-a544-814e8bb67c09 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:48.545131 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f70e5d01-516e-4683-a544-814e8bb67c09 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:48.572932 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f70e5d01-516e-4683-a544-814e8bb67c09 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:48.573745 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f70e5d01-516e-4683-a544-814e8bb67c09 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:48.577283 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f70e5d01-516e-4683-a544-814e8bb67c09 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:48.578337 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f70e5d01-516e-4683-a544-814e8bb67c09 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:48.578968 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f70e5d01-516e-4683-a544-814e8bb67c09 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:48.580783 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f70e5d01-516e-4683-a544-814e8bb67c09 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:48.834970 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f70e5d01-516e-4683-a544-814e8bb67c09 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:48.853725 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f70e5d01-516e-4683-a544-814e8bb67c09 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:48.856938 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f70e5d01-516e-4683-a544-814e8bb67c09 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:48.859325 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f70e5d01-516e-4683-a544-814e8bb67c09 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1605 microversion: 2.42 time: 0.320096 Oct 30 01:42:48.861435 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2761/5508] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:48 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1605 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:42:48.895380 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-309d95ad-5d4f-49a3-987f-7d26121cf666 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:48.910495 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-309d95ad-5d4f-49a3-987f-7d26121cf666 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:48.911894 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-309d95ad-5d4f-49a3-987f-7d26121cf666 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:48.913654 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-309d95ad-5d4f-49a3-987f-7d26121cf666 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1670 microversion: 2.20 time: 0.614424 Oct 30 01:42:48.914466 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2748/5509] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:48 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1670 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:42:49.357012 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1ddbf69c-610d-4903-8edf-3e25d76e5dd1 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:49.359052 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1ddbf69c-610d-4903-8edf-3e25d76e5dd1 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:49.386079 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ddbf69c-610d-4903-8edf-3e25d76e5dd1 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:49.389609 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ddbf69c-610d-4903-8edf-3e25d76e5dd1 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:49.390540 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ddbf69c-610d-4903-8edf-3e25d76e5dd1 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:49.394915 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ddbf69c-610d-4903-8edf-3e25d76e5dd1 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:49.399172 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ddbf69c-610d-4903-8edf-3e25d76e5dd1 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:49.399172 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ddbf69c-610d-4903-8edf-3e25d76e5dd1 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:49.892561 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e90b3ee8-33e0-472c-8508-1d574a48f975 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:49.896178 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e90b3ee8-33e0-472c-8508-1d574a48f975 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:49.912930 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e90b3ee8-33e0-472c-8508-1d574a48f975 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:49.922537 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e90b3ee8-33e0-472c-8508-1d574a48f975 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:49.925269 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e90b3ee8-33e0-472c-8508-1d574a48f975 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:49.927849 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e90b3ee8-33e0-472c-8508-1d574a48f975 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:49.928591 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e90b3ee8-33e0-472c-8508-1d574a48f975 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:49.932602 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e90b3ee8-33e0-472c-8508-1d574a48f975 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:49.935454 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1ddbf69c-610d-4903-8edf-3e25d76e5dd1 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:49.945742 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1ddbf69c-610d-4903-8edf-3e25d76e5dd1 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1683 microversion: 2.1 time: 0.594994 Oct 30 01:42:49.964761 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2762/5510] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:42:49 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1683 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:42:49.975676 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-506526c3-09f3-4869-b5c1-e209e534feb1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:49.976658 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-506526c3-09f3-4869-b5c1-e209e534feb1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:49.986122 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-506526c3-09f3-4869-b5c1-e209e534feb1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:49.986996 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-506526c3-09f3-4869-b5c1-e209e534feb1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:49.987613 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-506526c3-09f3-4869-b5c1-e209e534feb1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:49.988502 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-506526c3-09f3-4869-b5c1-e209e534feb1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:49.989122 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-506526c3-09f3-4869-b5c1-e209e534feb1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:49.989760 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-506526c3-09f3-4869-b5c1-e209e534feb1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:50.295955 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e90b3ee8-33e0-472c-8508-1d574a48f975 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:50.312859 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e90b3ee8-33e0-472c-8508-1d574a48f975 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:50.317666 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e90b3ee8-33e0-472c-8508-1d574a48f975 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:50.322539 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e90b3ee8-33e0-472c-8508-1d574a48f975 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1605 microversion: 2.42 time: 0.434641 Oct 30 01:42:50.323998 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2749/5511] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:49 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1605 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:42:50.443374 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-506526c3-09f3-4869-b5c1-e209e534feb1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:50.460372 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-506526c3-09f3-4869-b5c1-e209e534feb1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:50.473968 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-506526c3-09f3-4869-b5c1-e209e534feb1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:50.488451 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-506526c3-09f3-4869-b5c1-e209e534feb1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1670 microversion: 2.20 time: 0.521947 Oct 30 01:42:50.495576 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2763/5512] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:49 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1670 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:42:50.979288 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0c2f2f56-48b8-44bc-909f-a78f494f0e0e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:50.980060 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0c2f2f56-48b8-44bc-909f-a78f494f0e0e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:50.985922 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=41 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:51.000054 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c2f2f56-48b8-44bc-909f-a78f494f0e0e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:51.000633 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c2f2f56-48b8-44bc-909f-a78f494f0e0e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:51.001101 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c2f2f56-48b8-44bc-909f-a78f494f0e0e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:51.004934 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c2f2f56-48b8-44bc-909f-a78f494f0e0e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:51.005485 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c2f2f56-48b8-44bc-909f-a78f494f0e0e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:51.005938 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c2f2f56-48b8-44bc-909f-a78f494f0e0e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:51.412187 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a9de785a-cf9e-44cd-bd42-9df3ee36bebf tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:51.426876 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a9de785a-cf9e-44cd-bd42-9df3ee36bebf tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:51.465696 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a9de785a-cf9e-44cd-bd42-9df3ee36bebf tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:51.466923 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a9de785a-cf9e-44cd-bd42-9df3ee36bebf tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:51.467535 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a9de785a-cf9e-44cd-bd42-9df3ee36bebf tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:51.471609 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a9de785a-cf9e-44cd-bd42-9df3ee36bebf tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:51.475145 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a9de785a-cf9e-44cd-bd42-9df3ee36bebf tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:51.475870 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a9de785a-cf9e-44cd-bd42-9df3ee36bebf tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:51.634427 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a9de785a-cf9e-44cd-bd42-9df3ee36bebf tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:51.640816 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a9de785a-cf9e-44cd-bd42-9df3ee36bebf tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:51.647629 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a9de785a-cf9e-44cd-bd42-9df3ee36bebf tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:51.650699 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-a9de785a-cf9e-44cd-bd42-9df3ee36bebf tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lazy-loading 'fault' on Instance uuid ef88e251-1a54-4519-ba22-ddcfa39451f9 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:42:51.883021 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a9de785a-cf9e-44cd-bd42-9df3ee36bebf tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:51.892854 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a9de785a-cf9e-44cd-bd42-9df3ee36bebf tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:51.899580 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a9de785a-cf9e-44cd-bd42-9df3ee36bebf tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02d9c8a493ab4fc1bdac4ab6494bec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01acf8e8ee774c008833d5aff937b676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:51.907871 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a9de785a-cf9e-44cd-bd42-9df3ee36bebf tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 200 len: 1372 microversion: 2.42 time: 0.553352 Oct 30 01:42:51.911631 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2764/5513] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:51 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 1372 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:42:51.931033 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-96207fa0-505f-4a6a-ae62-c002c23a4acb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:51.933212 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-96207fa0-505f-4a6a-ae62-c002c23a4acb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:51.977880 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96207fa0-505f-4a6a-ae62-c002c23a4acb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:51.978390 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96207fa0-505f-4a6a-ae62-c002c23a4acb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:51.978826 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96207fa0-505f-4a6a-ae62-c002c23a4acb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:51.979538 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96207fa0-505f-4a6a-ae62-c002c23a4acb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:51.979988 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96207fa0-505f-4a6a-ae62-c002c23a4acb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:51.988113 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96207fa0-505f-4a6a-ae62-c002c23a4acb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:52.038486 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0c2f2f56-48b8-44bc-909f-a78f494f0e0e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:52.051904 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0c2f2f56-48b8-44bc-909f-a78f494f0e0e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1683 microversion: 2.1 time: 1.076819 Oct 30 01:42:52.061041 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2750/5514] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:42:50 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1683 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:42:52.307866 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-96207fa0-505f-4a6a-ae62-c002c23a4acb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:52.325946 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-96207fa0-505f-4a6a-ae62-c002c23a4acb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:52.332486 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-96207fa0-505f-4a6a-ae62-c002c23a4acb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:52.339234 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-96207fa0-505f-4a6a-ae62-c002c23a4acb tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1670 microversion: 2.20 time: 0.422677 Oct 30 01:42:52.357215 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2765/5515] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:51 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1670 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:42:52.936530 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6bc090b5-185f-46a8-94e7-f47085f6d9fa tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:52.938324 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6bc090b5-185f-46a8-94e7-f47085f6d9fa tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:52.954779 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6bc090b5-185f-46a8-94e7-f47085f6d9fa tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:52.955436 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6bc090b5-185f-46a8-94e7-f47085f6d9fa tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:52.958141 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6bc090b5-185f-46a8-94e7-f47085f6d9fa tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:52.960210 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6bc090b5-185f-46a8-94e7-f47085f6d9fa tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:52.960960 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6bc090b5-185f-46a8-94e7-f47085f6d9fa tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:52.968404 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6bc090b5-185f-46a8-94e7-f47085f6d9fa tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:53.025492 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-6bc090b5-185f-46a8-94e7-f47085f6d9fa tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] HTTP exception thrown: Instance ef88e251-1a54-4519-ba22-ddcfa39451f9 could not be found. Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6bc090b5-185f-46a8-94e7-f47085f6d9fa tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Request method failure captured: Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 HTTP/1.1 Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdSk2Kf1GhGLdLzoRZ5XHVxHFBi2n0LHLxBCw-H3U5_vSJFJMIEgV1gYgRTgX8gMFC8Pd2Z3lMVyld50hyPvD0G5xR-Pw9g7TjPMX44dA18kRC50NRpdc6ztaP5tojJ3u2c9zLGhOqkZ4p3JGcrkc1Kx1uxscun3NIk5T15_xyhTE7A Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: X-Openstack-Nova-Api-Version: 2.42 Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 01acf8e8ee774c008833d5aff937b676 Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1588431945 Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/01acf8e8ee774c008833d5aff937b676"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_01acf8e8ee774c008833d5aff937b676"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/01acf8e8ee774c008833d5aff937b676"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/01acf8e8ee774c008833d5aff937b676"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1588431945 Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 01acf8e8ee774c008833d5aff937b676 Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1588431945 Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-TaggedBootDevicesTest_v242-1588431945-project Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 02d9c8a493ab4fc1bdac4ab6494bec15 Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1588431945-project Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: exception: Instance ef88e251-1a54-4519-ba22-ddcfa39451f9 could not be found. Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'ef88e251-1a54-4519-ba22-ddcfa39451f9'} Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef88e251-1a54-4519-ba22-ddcfa39451f9 could not be found. Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef88e251-1a54-4519-ba22-ddcfa39451f9 could not be found. Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:42:53.038792 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:42:53.046691 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:42:53.046691 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:42:53.046691 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:42:53.046691 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:42:53.046691 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:42:53.046691 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:42:53.046691 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef88e251-1a54-4519-ba22-ddcfa39451f9 could not be found. Oct 30 01:42:53.046691 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:42:53.046691 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6bc090b5-185f-46a8-94e7-f47085f6d9fa tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Returning 404 to user: Instance ef88e251-1a54-4519-ba22-ddcfa39451f9 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:42:53.048970 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6bc090b5-185f-46a8-94e7-f47085f6d9fa tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 404 len: 111 microversion: 2.42 time: 0.112182 Oct 30 01:42:53.052547 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2751/5516] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:52 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:42:53.060335 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d3fa5768-c2ce-45ae-80a4-63fd47b1e0a9 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '.version_select at 0x7f44c6d6a160>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:53.085535 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8c877850-c085-4be7-bca9-72dcc134bdc6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:53.087343 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8c877850-c085-4be7-bca9-72dcc134bdc6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:53.121688 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8c877850-c085-4be7-bca9-72dcc134bdc6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:53.126099 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8c877850-c085-4be7-bca9-72dcc134bdc6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:53.126966 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8c877850-c085-4be7-bca9-72dcc134bdc6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:53.127899 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8c877850-c085-4be7-bca9-72dcc134bdc6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:53.128527 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8c877850-c085-4be7-bca9-72dcc134bdc6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:53.129127 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8c877850-c085-4be7-bca9-72dcc134bdc6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:53.216679 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d3fa5768-c2ce-45ae-80a4-63fd47b1e0a9 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2089258761" status: 204 len: 0 microversion: 2.42 time: 0.160391 Oct 30 01:42:53.217973 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2766/5517] 10.222.0.13 () {60 vars in 1262 bytes} [Sun Oct 30 01:42:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2089258761 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 30 01:42:53.391657 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-17bdb399-9c81-4600-b029-5b4550e434d4 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:53.395198 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-17bdb399-9c81-4600-b029-5b4550e434d4 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:53.422951 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-17bdb399-9c81-4600-b029-5b4550e434d4 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:53.423693 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-17bdb399-9c81-4600-b029-5b4550e434d4 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:53.426306 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-17bdb399-9c81-4600-b029-5b4550e434d4 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:53.435849 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-17bdb399-9c81-4600-b029-5b4550e434d4 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:53.439768 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-17bdb399-9c81-4600-b029-5b4550e434d4 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:53.441529 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-17bdb399-9c81-4600-b029-5b4550e434d4 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:53.652410 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8c877850-c085-4be7-bca9-72dcc134bdc6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:53.662718 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8c877850-c085-4be7-bca9-72dcc134bdc6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1683 microversion: 2.1 time: 0.581298 Oct 30 01:42:53.665683 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2752/5518] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:42:53 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1683 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:42:54.317207 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-17bdb399-9c81-4600-b029-5b4550e434d4 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:54.325886 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-17bdb399-9c81-4600-b029-5b4550e434d4 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:54.330758 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-17bdb399-9c81-4600-b029-5b4550e434d4 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:54.342810 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-17bdb399-9c81-4600-b029-5b4550e434d4 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1670 microversion: 2.20 time: 0.959657 Oct 30 01:42:54.355171 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2767/5519] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:53 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1670 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:42:54.696210 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6cb7e522-5514-4a5d-bf59-8556c0e89bb7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:54.698409 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6cb7e522-5514-4a5d-bf59-8556c0e89bb7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:54.709091 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6cb7e522-5514-4a5d-bf59-8556c0e89bb7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:54.709604 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6cb7e522-5514-4a5d-bf59-8556c0e89bb7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:54.716970 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6cb7e522-5514-4a5d-bf59-8556c0e89bb7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:54.721396 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6cb7e522-5514-4a5d-bf59-8556c0e89bb7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:54.721396 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6cb7e522-5514-4a5d-bf59-8556c0e89bb7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:54.721396 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6cb7e522-5514-4a5d-bf59-8556c0e89bb7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:55.193048 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6cb7e522-5514-4a5d-bf59-8556c0e89bb7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:55.208927 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6cb7e522-5514-4a5d-bf59-8556c0e89bb7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1683 microversion: 2.1 time: 0.521930 Oct 30 01:42:55.210834 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2753/5520] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:42:54 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1683 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:42:55.393905 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-05904664-bb18-4c63-8cc1-23e72c5caaba tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:55.399785 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-05904664-bb18-4c63-8cc1-23e72c5caaba tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:55.447645 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-05904664-bb18-4c63-8cc1-23e72c5caaba tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:55.451859 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-05904664-bb18-4c63-8cc1-23e72c5caaba tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:55.456522 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-05904664-bb18-4c63-8cc1-23e72c5caaba tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:55.457680 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-05904664-bb18-4c63-8cc1-23e72c5caaba tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:55.458473 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-05904664-bb18-4c63-8cc1-23e72c5caaba tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:55.459145 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-05904664-bb18-4c63-8cc1-23e72c5caaba tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:55.841490 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-05904664-bb18-4c63-8cc1-23e72c5caaba tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:55.862235 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-05904664-bb18-4c63-8cc1-23e72c5caaba tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:55.866140 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-05904664-bb18-4c63-8cc1-23e72c5caaba tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:55.878945 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-05904664-bb18-4c63-8cc1-23e72c5caaba tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1670 microversion: 2.20 time: 0.508468 Oct 30 01:42:55.880435 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2768/5521] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:55 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1670 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:42:56.247860 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5ade91df-cdf7-4842-90b3-126e5e63464d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:56.249862 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5ade91df-cdf7-4842-90b3-126e5e63464d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:56.296244 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ade91df-cdf7-4842-90b3-126e5e63464d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:56.304314 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ade91df-cdf7-4842-90b3-126e5e63464d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:56.306483 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ade91df-cdf7-4842-90b3-126e5e63464d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:56.314966 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ade91df-cdf7-4842-90b3-126e5e63464d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:56.317201 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ade91df-cdf7-4842-90b3-126e5e63464d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:56.318653 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ade91df-cdf7-4842-90b3-126e5e63464d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:56.861629 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5ade91df-cdf7-4842-90b3-126e5e63464d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:56.871836 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5ade91df-cdf7-4842-90b3-126e5e63464d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1683 microversion: 2.1 time: 0.638412 Oct 30 01:42:56.881783 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2754/5522] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:42:56 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1683 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:42:56.910424 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-063400c3-4c22-4545-bed3-3a3aba87b191 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:56.911837 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-063400c3-4c22-4545-bed3-3a3aba87b191 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:56.920352 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-063400c3-4c22-4545-bed3-3a3aba87b191 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:56.921219 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-063400c3-4c22-4545-bed3-3a3aba87b191 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:56.921916 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-063400c3-4c22-4545-bed3-3a3aba87b191 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:56.922865 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-063400c3-4c22-4545-bed3-3a3aba87b191 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:56.923531 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-063400c3-4c22-4545-bed3-3a3aba87b191 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:56.924179 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-063400c3-4c22-4545-bed3-3a3aba87b191 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:57.806564 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-063400c3-4c22-4545-bed3-3a3aba87b191 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:57.822525 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-063400c3-4c22-4545-bed3-3a3aba87b191 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:57.827650 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-063400c3-4c22-4545-bed3-3a3aba87b191 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:57.846934 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-063400c3-4c22-4545-bed3-3a3aba87b191 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1670 microversion: 2.20 time: 0.932250 Oct 30 01:42:57.850991 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2769/5523] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:56 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1670 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:42:57.909300 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ee8bcab3-e304-49fe-9dfe-1836303adfa0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:57.911035 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ee8bcab3-e304-49fe-9dfe-1836303adfa0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:57.931389 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ee8bcab3-e304-49fe-9dfe-1836303adfa0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:57.939571 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ee8bcab3-e304-49fe-9dfe-1836303adfa0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:57.939571 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ee8bcab3-e304-49fe-9dfe-1836303adfa0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:57.941166 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ee8bcab3-e304-49fe-9dfe-1836303adfa0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:57.942702 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ee8bcab3-e304-49fe-9dfe-1836303adfa0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:57.943288 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ee8bcab3-e304-49fe-9dfe-1836303adfa0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:58.438305 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ee8bcab3-e304-49fe-9dfe-1836303adfa0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:58.449198 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ee8bcab3-e304-49fe-9dfe-1836303adfa0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1683 microversion: 2.1 time: 0.545112 Oct 30 01:42:58.450487 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2755/5524] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:42:57 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1683 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:42:58.886669 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ac89a912-e717-43cb-97b4-18239be9d89f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:58.889624 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ac89a912-e717-43cb-97b4-18239be9d89f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:58.955190 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ac89a912-e717-43cb-97b4-18239be9d89f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:58.956522 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ac89a912-e717-43cb-97b4-18239be9d89f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:58.959391 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ac89a912-e717-43cb-97b4-18239be9d89f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:58.979517 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ac89a912-e717-43cb-97b4-18239be9d89f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:58.987230 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ac89a912-e717-43cb-97b4-18239be9d89f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:59.000490 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ac89a912-e717-43cb-97b4-18239be9d89f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:59.483284 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ac263955-1249-4787-b5d1-86f334334a8f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:42:59.484740 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ac263955-1249-4787-b5d1-86f334334a8f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:42:59.512294 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ac263955-1249-4787-b5d1-86f334334a8f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:59.516185 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ac263955-1249-4787-b5d1-86f334334a8f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:59.518512 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ac263955-1249-4787-b5d1-86f334334a8f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:59.522605 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ac263955-1249-4787-b5d1-86f334334a8f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:42:59.524634 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ac263955-1249-4787-b5d1-86f334334a8f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:42:59.526170 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ac263955-1249-4787-b5d1-86f334334a8f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:42:59.846397 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ac89a912-e717-43cb-97b4-18239be9d89f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:59.854888 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ac89a912-e717-43cb-97b4-18239be9d89f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:59.856343 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ac89a912-e717-43cb-97b4-18239be9d89f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:42:59.872748 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ac89a912-e717-43cb-97b4-18239be9d89f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1670 microversion: 2.20 time: 0.982862 Oct 30 01:42:59.873520 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2770/5525] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:42:58 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1670 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:43:00.166539 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ac263955-1249-4787-b5d1-86f334334a8f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:00.176956 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ac263955-1249-4787-b5d1-86f334334a8f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1683 microversion: 2.1 time: 0.696404 Oct 30 01:43:00.201722 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2756/5526] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:42:59 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1683 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:43:00.900444 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a9efeed8-cf93-47b9-b087-d3215f46b1a4 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:00.901611 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a9efeed8-cf93-47b9-b087-d3215f46b1a4 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:00.916431 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a9efeed8-cf93-47b9-b087-d3215f46b1a4 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:00.928073 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a9efeed8-cf93-47b9-b087-d3215f46b1a4 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:00.928935 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a9efeed8-cf93-47b9-b087-d3215f46b1a4 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:00.932347 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a9efeed8-cf93-47b9-b087-d3215f46b1a4 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:00.932347 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a9efeed8-cf93-47b9-b087-d3215f46b1a4 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:00.932347 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a9efeed8-cf93-47b9-b087-d3215f46b1a4 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:01.207744 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7847abaf-3ebb-4da3-b853-4426258f6f94 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:01.208942 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7847abaf-3ebb-4da3-b853-4426258f6f94 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:01.226317 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7847abaf-3ebb-4da3-b853-4426258f6f94 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:01.237982 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7847abaf-3ebb-4da3-b853-4426258f6f94 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:01.243046 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7847abaf-3ebb-4da3-b853-4426258f6f94 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:01.251046 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7847abaf-3ebb-4da3-b853-4426258f6f94 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:01.255953 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7847abaf-3ebb-4da3-b853-4426258f6f94 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:01.257379 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7847abaf-3ebb-4da3-b853-4426258f6f94 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:01.877198 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a9efeed8-cf93-47b9-b087-d3215f46b1a4 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:01.895304 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a9efeed8-cf93-47b9-b087-d3215f46b1a4 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:01.897940 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a9efeed8-cf93-47b9-b087-d3215f46b1a4 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:01.904811 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a9efeed8-cf93-47b9-b087-d3215f46b1a4 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1670 microversion: 2.20 time: 1.009013 Oct 30 01:43:01.905486 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2771/5527] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:43:00 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1670 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:43:02.224008 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7847abaf-3ebb-4da3-b853-4426258f6f94 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:02.238297 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7847abaf-3ebb-4da3-b853-4426258f6f94 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1683 microversion: 2.1 time: 1.034931 Oct 30 01:43:02.246014 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2757/5528] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:43:01 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1683 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:43:02.949146 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6c809fc3-4cc4-4b1e-97af-cc8fe794169d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:02.953083 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6c809fc3-4cc4-4b1e-97af-cc8fe794169d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:02.963549 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c809fc3-4cc4-4b1e-97af-cc8fe794169d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:02.964034 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c809fc3-4cc4-4b1e-97af-cc8fe794169d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:02.966417 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c809fc3-4cc4-4b1e-97af-cc8fe794169d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:02.968791 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c809fc3-4cc4-4b1e-97af-cc8fe794169d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:02.969447 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c809fc3-4cc4-4b1e-97af-cc8fe794169d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:02.973364 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c809fc3-4cc4-4b1e-97af-cc8fe794169d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:03.273607 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cec523d3-a79f-4507-96c6-d0622e5e5a2d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:03.274890 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-cec523d3-a79f-4507-96c6-d0622e5e5a2d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:03.286798 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cec523d3-a79f-4507-96c6-d0622e5e5a2d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:03.291042 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cec523d3-a79f-4507-96c6-d0622e5e5a2d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:03.293588 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cec523d3-a79f-4507-96c6-d0622e5e5a2d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:03.294344 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cec523d3-a79f-4507-96c6-d0622e5e5a2d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:03.297853 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cec523d3-a79f-4507-96c6-d0622e5e5a2d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:03.298496 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cec523d3-a79f-4507-96c6-d0622e5e5a2d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:03.323192 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=100 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:03.767659 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6c809fc3-4cc4-4b1e-97af-cc8fe794169d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:03.777113 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:03.795284 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6c809fc3-4cc4-4b1e-97af-cc8fe794169d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:03.798349 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6c809fc3-4cc4-4b1e-97af-cc8fe794169d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:03.800005 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6c809fc3-4cc4-4b1e-97af-cc8fe794169d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1670 microversion: 2.20 time: 0.865023 Oct 30 01:43:03.817766 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2772/5529] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:43:02 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1670 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:43:04.038618 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-cec523d3-a79f-4507-96c6-d0622e5e5a2d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:04.057235 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cec523d3-a79f-4507-96c6-d0622e5e5a2d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1670 microversion: 2.1 time: 0.790347 Oct 30 01:43:04.066762 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2758/5530] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:43:03 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1670 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:43:04.831274 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-124cc54a-22ac-40ed-acf4-f8d74a5c7875 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:04.833566 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-124cc54a-22ac-40ed-acf4-f8d74a5c7875 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:04.845627 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:04.847257 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-124cc54a-22ac-40ed-acf4-f8d74a5c7875 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:04.847956 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-124cc54a-22ac-40ed-acf4-f8d74a5c7875 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:04.848587 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-124cc54a-22ac-40ed-acf4-f8d74a5c7875 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:04.849658 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-124cc54a-22ac-40ed-acf4-f8d74a5c7875 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:04.851011 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-124cc54a-22ac-40ed-acf4-f8d74a5c7875 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:04.851601 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-124cc54a-22ac-40ed-acf4-f8d74a5c7875 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:05.330415 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-124cc54a-22ac-40ed-acf4-f8d74a5c7875 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:05.347222 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-124cc54a-22ac-40ed-acf4-f8d74a5c7875 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:05.351841 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-124cc54a-22ac-40ed-acf4-f8d74a5c7875 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:05.356170 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-124cc54a-22ac-40ed-acf4-f8d74a5c7875 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1670 microversion: 2.20 time: 0.531117 Oct 30 01:43:05.358779 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2773/5531] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:43:04 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1670 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:43:06.389387 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7b20922f-9947-41a6-8fe5-9de757be94f4 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:06.390722 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7b20922f-9947-41a6-8fe5-9de757be94f4 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:06.429765 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b20922f-9947-41a6-8fe5-9de757be94f4 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:06.433472 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b20922f-9947-41a6-8fe5-9de757be94f4 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:06.438926 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b20922f-9947-41a6-8fe5-9de757be94f4 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:06.441322 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b20922f-9947-41a6-8fe5-9de757be94f4 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:06.445575 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b20922f-9947-41a6-8fe5-9de757be94f4 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:06.448105 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b20922f-9947-41a6-8fe5-9de757be94f4 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:06.478289 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-42471d3e-4386-4803-9675-71c9602f1ca5 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Action: 'create', calling method: .version_select at 0x7f44d03f59d0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1029733019", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8bd3gsMiLMZdKRvxfndrLIUknAtSOC1h0pPWSSAHdnVFIjsPSQe5IaUEf4/3bvMZ7j1Yg4MAnt79xUBPkPEPA0mtnTABg0dcX1/gxeeTZzFQNtQKqoy0beGN0dyTl7Uw=="}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:43:06.549621 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-42471d3e-4386-4803-9675-71c9602f1ca5 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Getting quotas for project 8d68930ed61745eea8adfda72f3d139f. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:43:06.584984 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-42471d3e-4386-4803-9675-71c9602f1ca5 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Getting quotas for user 759025c4133f4074ba59beb1a08c7a21 and project 8d68930ed61745eea8adfda72f3d139f. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:43:06.742290 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-42471d3e-4386-4803-9675-71c9602f1ca5 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.733536 Oct 30 01:43:06.742290 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2759/5532] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 30 01:43:05 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:43:06.742290 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0daf62a9-3240-47be-b85d-0e93c3bd5293 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:06.742290 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0daf62a9-3240-47be-b85d-0e93c3bd5293 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:06.749118 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0daf62a9-3240-47be-b85d-0e93c3bd5293 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:06.749590 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0daf62a9-3240-47be-b85d-0e93c3bd5293 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:06.750027 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0daf62a9-3240-47be-b85d-0e93c3bd5293 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:06.750739 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0daf62a9-3240-47be-b85d-0e93c3bd5293 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:06.751198 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0daf62a9-3240-47be-b85d-0e93c3bd5293 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:06.751628 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0daf62a9-3240-47be-b85d-0e93c3bd5293 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:06.766967 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-0daf62a9-3240-47be-b85d-0e93c3bd5293 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] HTTP exception thrown: Instance ef88e251-1a54-4519-ba22-ddcfa39451f9 could not be found. Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0daf62a9-3240-47be-b85d-0e93c3bd5293 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Request method failure captured: Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: request: DELETE /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 HTTP/1.1 Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdSk2Kf1GhGLdLzoRZ5XHVxHFBi2n0LHLxBCw-H3U5_vSJFJMIEgV1gYgRTgX8gMFC8Pd2Z3lMVyld50hyPvD0G5xR-Pw9g7TjPMX44dA18kRC50NRpdc6ztaP5tojJ3u2c9zLGhOqkZ4p3JGcrkc1Kx1uxscun3NIk5T15_xyhTE7A Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: X-Openstack-Nova-Api-Version: 2.42 Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 01acf8e8ee774c008833d5aff937b676 Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1588431945 Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/01acf8e8ee774c008833d5aff937b676"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_01acf8e8ee774c008833d5aff937b676"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/01acf8e8ee774c008833d5aff937b676"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/01acf8e8ee774c008833d5aff937b676"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1588431945 Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 01acf8e8ee774c008833d5aff937b676 Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1588431945 Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-TaggedBootDevicesTest_v242-1588431945-project Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 02d9c8a493ab4fc1bdac4ab6494bec15 Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1588431945-project Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: exception: Instance ef88e251-1a54-4519-ba22-ddcfa39451f9 could not be found. Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'ef88e251-1a54-4519-ba22-ddcfa39451f9'} Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef88e251-1a54-4519-ba22-ddcfa39451f9 could not be found. Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:43:06.768873 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:43:06.783315 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef88e251-1a54-4519-ba22-ddcfa39451f9 could not be found. Oct 30 01:43:06.783315 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:43:06.783315 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:43:06.783315 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:43:06.783315 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:43:06.783315 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:43:06.783315 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:43:06.783315 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:43:06.783315 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:43:06.783315 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef88e251-1a54-4519-ba22-ddcfa39451f9 could not be found. Oct 30 01:43:06.783315 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:43:06.783315 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0daf62a9-3240-47be-b85d-0e93c3bd5293 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Returning 404 to user: Instance ef88e251-1a54-4519-ba22-ddcfa39451f9 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:43:06.783315 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0daf62a9-3240-47be-b85d-0e93c3bd5293 tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 404 len: 111 microversion: 2.42 time: 0.032898 Oct 30 01:43:06.783315 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2760/5533] 10.222.0.13 () {60 vars in 1280 bytes} [Sun Oct 30 01:43:06 2022] DELETE /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:43:06.807557 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7b20922f-9947-41a6-8fe5-9de757be94f4 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:06.816675 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e33f6673-7d34-4f8f-808a-4ed3c8b5951e tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:06.820253 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e33f6673-7d34-4f8f-808a-4ed3c8b5951e tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] [instance: ef88e251-1a54-4519-ba22-ddcfa39451f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:06.828244 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7b20922f-9947-41a6-8fe5-9de757be94f4 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:06.829984 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7b20922f-9947-41a6-8fe5-9de757be94f4 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:06.831499 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7b20922f-9947-41a6-8fe5-9de757be94f4 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1728 microversion: 2.20 time: 0.448503 Oct 30 01:43:06.836205 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e33f6673-7d34-4f8f-808a-4ed3c8b5951e tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:06.840131 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e33f6673-7d34-4f8f-808a-4ed3c8b5951e tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:06.840830 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e33f6673-7d34-4f8f-808a-4ed3c8b5951e tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:06.843358 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e33f6673-7d34-4f8f-808a-4ed3c8b5951e tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:06.847992 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2774/5534] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:43:06 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1728 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:43:06.848414 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e33f6673-7d34-4f8f-808a-4ed3c8b5951e tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:06.849552 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e33f6673-7d34-4f8f-808a-4ed3c8b5951e tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:06.871300 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-e33f6673-7d34-4f8f-808a-4ed3c8b5951e tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] HTTP exception thrown: Instance ef88e251-1a54-4519-ba22-ddcfa39451f9 could not be found. Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e33f6673-7d34-4f8f-808a-4ed3c8b5951e tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Request method failure captured: Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 HTTP/1.1 Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdSk2Kf1GhGLdLzoRZ5XHVxHFBi2n0LHLxBCw-H3U5_vSJFJMIEgV1gYgRTgX8gMFC8Pd2Z3lMVyld50hyPvD0G5xR-Pw9g7TjPMX44dA18kRC50NRpdc6ztaP5tojJ3u2c9zLGhOqkZ4p3JGcrkc1Kx1uxscun3NIk5T15_xyhTE7A Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: X-Openstack-Nova-Api-Version: 2.42 Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 01acf8e8ee774c008833d5aff937b676 Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1588431945 Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/01acf8e8ee774c008833d5aff937b676"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_01acf8e8ee774c008833d5aff937b676"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/01acf8e8ee774c008833d5aff937b676"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/01acf8e8ee774c008833d5aff937b676"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1588431945 Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 01acf8e8ee774c008833d5aff937b676 Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1588431945 Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-TaggedBootDevicesTest_v242-1588431945-project Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 02d9c8a493ab4fc1bdac4ab6494bec15 Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1588431945-project Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: exception: Instance ef88e251-1a54-4519-ba22-ddcfa39451f9 could not be found. Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'ef88e251-1a54-4519-ba22-ddcfa39451f9'} Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef88e251-1a54-4519-ba22-ddcfa39451f9 could not be found. Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef88e251-1a54-4519-ba22-ddcfa39451f9 could not be found. Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:43:06.874355 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:43:06.879143 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:43:06.879143 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:43:06.879143 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:43:06.879143 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:43:06.879143 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:43:06.879143 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:43:06.879143 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef88e251-1a54-4519-ba22-ddcfa39451f9 could not be found. Oct 30 01:43:06.879143 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:43:06.881191 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e33f6673-7d34-4f8f-808a-4ed3c8b5951e tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] Returning 404 to user: Instance ef88e251-1a54-4519-ba22-ddcfa39451f9 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:43:06.881191 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e33f6673-7d34-4f8f-808a-4ed3c8b5951e tempest-TaggedBootDevicesTest_v242-1588431945 tempest-TaggedBootDevicesTest_v242-1588431945-project] 10.222.0.13 "GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9" status: 404 len: 111 microversion: 2.42 time: 0.093128 Oct 30 01:43:06.884416 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2761/5535] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:43:06 2022] GET /compute/v2.1/servers/ef88e251-1a54-4519-ba22-ddcfa39451f9 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:43:07.435825 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-88e27648-66ff-4c3f-9bf6-2abc895a2462 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:07.436950 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-88e27648-66ff-4c3f-9bf6-2abc895a2462 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:07.461735 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-88e27648-66ff-4c3f-9bf6-2abc895a2462 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:07.462667 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-88e27648-66ff-4c3f-9bf6-2abc895a2462 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:07.469257 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-88e27648-66ff-4c3f-9bf6-2abc895a2462 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:07.470461 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-88e27648-66ff-4c3f-9bf6-2abc895a2462 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:07.472446 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-88e27648-66ff-4c3f-9bf6-2abc895a2462 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:07.473089 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-88e27648-66ff-4c3f-9bf6-2abc895a2462 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:07.797727 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-88e27648-66ff-4c3f-9bf6-2abc895a2462 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:07.828971 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-88e27648-66ff-4c3f-9bf6-2abc895a2462 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1670 microversion: 2.1 time: 0.397211 Oct 30 01:43:07.833549 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2775/5536] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:43:07 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1670 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:43:07.866314 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b34c66b5-a9c8-485c-acbd-76543b88d527 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:07.866314 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b34c66b5-a9c8-485c-acbd-76543b88d527 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:07.912289 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-75cdc0ec-fc6b-453e-b558-62e7c52734df req-525328b6-056c-496f-95ba-1b94aeef5545 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0f03664-8785-4321-b32e-3622f1b747b9", "name": "network-vif-unplugged", "status": "completed", "tag": "63c1537a-0706-49b0-8e88-a5c62f4ffbe3"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:43:07.922208 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b34c66b5-a9c8-485c-acbd-76543b88d527 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:07.923350 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b34c66b5-a9c8-485c-acbd-76543b88d527 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:07.925252 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b34c66b5-a9c8-485c-acbd-76543b88d527 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:07.926355 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b34c66b5-a9c8-485c-acbd-76543b88d527 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:07.927315 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b34c66b5-a9c8-485c-acbd-76543b88d527 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:07.928439 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b34c66b5-a9c8-485c-acbd-76543b88d527 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:07.933020 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-75cdc0ec-fc6b-453e-b558-62e7c52734df req-525328b6-056c-496f-95ba-1b94aeef5545 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:07.933502 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-75cdc0ec-fc6b-453e-b558-62e7c52734df req-525328b6-056c-496f-95ba-1b94aeef5545 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:07.933944 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-75cdc0ec-fc6b-453e-b558-62e7c52734df req-525328b6-056c-496f-95ba-1b94aeef5545 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:07.971654 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-75cdc0ec-fc6b-453e-b558-62e7c52734df req-525328b6-056c-496f-95ba-1b94aeef5545 service nova] Creating event network-vif-unplugged:63c1537a-0706-49b0-8e88-a5c62f4ffbe3 for instance b0f03664-8785-4321-b32e-3622f1b747b9 on n-h2-master-1 Oct 30 01:43:07.984805 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-75cdc0ec-fc6b-453e-b558-62e7c52734df req-525328b6-056c-496f-95ba-1b94aeef5545 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079242 Oct 30 01:43:07.992839 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2776/5537] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:43:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:43:08.308052 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b34c66b5-a9c8-485c-acbd-76543b88d527 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:08.330395 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b34c66b5-a9c8-485c-acbd-76543b88d527 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:08.335659 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b34c66b5-a9c8-485c-acbd-76543b88d527 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:08.342483 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b34c66b5-a9c8-485c-acbd-76543b88d527 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1728 microversion: 2.20 time: 0.485074 Oct 30 01:43:08.343565 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2762/5538] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:43:07 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1728 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:43:09.374274 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-660ca727-9b06-4941-af8a-8e4571568cec tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:09.374981 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-660ca727-9b06-4941-af8a-8e4571568cec tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:09.399094 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-660ca727-9b06-4941-af8a-8e4571568cec tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:09.400509 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-660ca727-9b06-4941-af8a-8e4571568cec tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:09.401823 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-660ca727-9b06-4941-af8a-8e4571568cec tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:09.406900 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-660ca727-9b06-4941-af8a-8e4571568cec tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:09.408229 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-660ca727-9b06-4941-af8a-8e4571568cec tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:09.409611 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-660ca727-9b06-4941-af8a-8e4571568cec tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:09.753508 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-660ca727-9b06-4941-af8a-8e4571568cec tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:09.766349 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-660ca727-9b06-4941-af8a-8e4571568cec tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:09.768375 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-660ca727-9b06-4941-af8a-8e4571568cec tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:09.771380 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-660ca727-9b06-4941-af8a-8e4571568cec tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1728 microversion: 2.20 time: 0.401736 Oct 30 01:43:09.771380 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2777/5539] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:43:09 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1728 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:43:10.796272 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-395b2ff1-bc75-4c24-8309-5625dacfeb84 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:10.796881 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-395b2ff1-bc75-4c24-8309-5625dacfeb84 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:10.810129 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-395b2ff1-bc75-4c24-8309-5625dacfeb84 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:10.810631 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-395b2ff1-bc75-4c24-8309-5625dacfeb84 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:10.811076 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-395b2ff1-bc75-4c24-8309-5625dacfeb84 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:10.811806 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-395b2ff1-bc75-4c24-8309-5625dacfeb84 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:10.812307 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-395b2ff1-bc75-4c24-8309-5625dacfeb84 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:10.816724 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-395b2ff1-bc75-4c24-8309-5625dacfeb84 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:11.156501 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-395b2ff1-bc75-4c24-8309-5625dacfeb84 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:11.178884 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-395b2ff1-bc75-4c24-8309-5625dacfeb84 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:11.192225 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-395b2ff1-bc75-4c24-8309-5625dacfeb84 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:11.210282 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-395b2ff1-bc75-4c24-8309-5625dacfeb84 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1728 microversion: 2.20 time: 0.414917 Oct 30 01:43:11.210282 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2763/5540] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:43:10 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1728 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:43:11.572245 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5f5d3e7c-fa92-4388-8468-afc77147cd86 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1855297339", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1029733019", "security_groups": [{"name": "tempest-secgroup-smoke-702719215"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "af29edab-d012-4c57-955e-a5084c21f70e"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:43:12.241242 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-73f7152f-3fa7-4b6e-8046-8a8be8b36117 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:12.242408 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-73f7152f-3fa7-4b6e-8046-8a8be8b36117 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:12.255586 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-73f7152f-3fa7-4b6e-8046-8a8be8b36117 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:12.257512 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-73f7152f-3fa7-4b6e-8046-8a8be8b36117 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:12.258776 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-73f7152f-3fa7-4b6e-8046-8a8be8b36117 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:12.260687 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-73f7152f-3fa7-4b6e-8046-8a8be8b36117 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:12.261780 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-73f7152f-3fa7-4b6e-8046-8a8be8b36117 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:12.272431 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-73f7152f-3fa7-4b6e-8046-8a8be8b36117 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:12.689670 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-73f7152f-3fa7-4b6e-8046-8a8be8b36117 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:12.702368 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-73f7152f-3fa7-4b6e-8046-8a8be8b36117 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:12.705617 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-73f7152f-3fa7-4b6e-8046-8a8be8b36117 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:12.705617 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-73f7152f-3fa7-4b6e-8046-8a8be8b36117 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1728 microversion: 2.20 time: 0.469019 Oct 30 01:43:12.707448 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2764/5541] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:43:12 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1728 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:43:12.714608 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1083a19b-bf47-49cd-b381-9119d642ce1c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:12.719345 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1083a19b-bf47-49cd-b381-9119d642ce1c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:12.744105 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1083a19b-bf47-49cd-b381-9119d642ce1c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:12.746301 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1083a19b-bf47-49cd-b381-9119d642ce1c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:12.749223 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1083a19b-bf47-49cd-b381-9119d642ce1c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:12.767436 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1083a19b-bf47-49cd-b381-9119d642ce1c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:12.769383 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1083a19b-bf47-49cd-b381-9119d642ce1c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:12.770561 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1083a19b-bf47-49cd-b381-9119d642ce1c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:13.283285 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1083a19b-bf47-49cd-b381-9119d642ce1c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:13.292424 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1083a19b-bf47-49cd-b381-9119d642ce1c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1670 microversion: 2.1 time: 0.583666 Oct 30 01:43:13.296545 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2765/5542] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:43:12 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1670 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:43:13.323588 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6f020249-a3ed-439c-81c0-0e73d1090e0c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:13.324341 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6f020249-a3ed-439c-81c0-0e73d1090e0c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:13.337395 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f020249-a3ed-439c-81c0-0e73d1090e0c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:13.346095 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f020249-a3ed-439c-81c0-0e73d1090e0c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:13.348071 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f020249-a3ed-439c-81c0-0e73d1090e0c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:13.349912 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f020249-a3ed-439c-81c0-0e73d1090e0c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:13.350395 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f020249-a3ed-439c-81c0-0e73d1090e0c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:13.350820 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f020249-a3ed-439c-81c0-0e73d1090e0c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:14.389273 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6f020249-a3ed-439c-81c0-0e73d1090e0c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:14.400857 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6f020249-a3ed-439c-81c0-0e73d1090e0c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1670 microversion: 2.1 time: 1.082606 Oct 30 01:43:14.407406 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2766/5543] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:43:13 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1670 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:43:14.430319 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-215b4c60-6eb8-4435-808b-075824ae182d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:14.431225 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-215b4c60-6eb8-4435-808b-075824ae182d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:14.449048 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-215b4c60-6eb8-4435-808b-075824ae182d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:14.451448 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-215b4c60-6eb8-4435-808b-075824ae182d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:14.453097 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-215b4c60-6eb8-4435-808b-075824ae182d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:14.455218 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-215b4c60-6eb8-4435-808b-075824ae182d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:14.455696 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-215b4c60-6eb8-4435-808b-075824ae182d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:14.456124 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-215b4c60-6eb8-4435-808b-075824ae182d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:14.780104 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-215b4c60-6eb8-4435-808b-075824ae182d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:14.792898 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-215b4c60-6eb8-4435-808b-075824ae182d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:14.795282 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-215b4c60-6eb8-4435-808b-075824ae182d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:14.797560 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-215b4c60-6eb8-4435-808b-075824ae182d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1728 microversion: 2.20 time: 0.388542 Oct 30 01:43:14.798622 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2767/5544] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:43:14 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1728 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:43:14.804874 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b09d0b2a-85b0-4cb3-bc51-feaee9bbee96 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:14.805513 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b09d0b2a-85b0-4cb3-bc51-feaee9bbee96 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:14.812424 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b09d0b2a-85b0-4cb3-bc51-feaee9bbee96 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:14.813144 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b09d0b2a-85b0-4cb3-bc51-feaee9bbee96 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:14.813757 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b09d0b2a-85b0-4cb3-bc51-feaee9bbee96 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:14.814767 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b09d0b2a-85b0-4cb3-bc51-feaee9bbee96 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:14.815373 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b09d0b2a-85b0-4cb3-bc51-feaee9bbee96 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:14.815951 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b09d0b2a-85b0-4cb3-bc51-feaee9bbee96 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:15.759296 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b09d0b2a-85b0-4cb3-bc51-feaee9bbee96 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:15.767746 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b09d0b2a-85b0-4cb3-bc51-feaee9bbee96 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1670 microversion: 2.1 time: 0.967896 Oct 30 01:43:15.768337 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2768/5545] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:43:14 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1670 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:43:15.807375 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0326c025-d4f8-4407-85b3-1a9a99d98874 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:43:15.815398 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0326c025-d4f8-4407-85b3-1a9a99d98874 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:15.833221 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0326c025-d4f8-4407-85b3-1a9a99d98874 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:15.834442 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0326c025-d4f8-4407-85b3-1a9a99d98874 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:15.841290 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0326c025-d4f8-4407-85b3-1a9a99d98874 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:15.841290 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0326c025-d4f8-4407-85b3-1a9a99d98874 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:15.841290 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0326c025-d4f8-4407-85b3-1a9a99d98874 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:15.841290 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0326c025-d4f8-4407-85b3-1a9a99d98874 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:16.295913 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0326c025-d4f8-4407-85b3-1a9a99d98874 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "POST /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9/action" status: 202 len: 0 microversion: 2.1 time: 0.501025 Oct 30 01:43:16.295913 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2769/5546] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:43:15 2022] POST /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9/action => generated 0 bytes in 503 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:43:16.320193 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1894af60-9fd9-4fee-a89e-051f6d530a15 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:16.324243 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1894af60-9fd9-4fee-a89e-051f6d530a15 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:16.361155 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1894af60-9fd9-4fee-a89e-051f6d530a15 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:16.361728 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1894af60-9fd9-4fee-a89e-051f6d530a15 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:16.368972 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1894af60-9fd9-4fee-a89e-051f6d530a15 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:16.376158 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1894af60-9fd9-4fee-a89e-051f6d530a15 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:16.376676 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1894af60-9fd9-4fee-a89e-051f6d530a15 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:16.377917 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1894af60-9fd9-4fee-a89e-051f6d530a15 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:16.605549 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=4 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:17.257980 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1894af60-9fd9-4fee-a89e-051f6d530a15 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:17.279623 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1894af60-9fd9-4fee-a89e-051f6d530a15 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:17.295595 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1894af60-9fd9-4fee-a89e-051f6d530a15 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:17.295595 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1894af60-9fd9-4fee-a89e-051f6d530a15 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1728 microversion: 2.20 time: 0.988702 Oct 30 01:43:17.321736 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2770/5547] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:43:16 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1728 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:43:17.341646 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1ffa162c-f6d4-4bde-83a5-6d0dee8050f6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:17.350908 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1ffa162c-f6d4-4bde-83a5-6d0dee8050f6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:17.367009 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1ffa162c-f6d4-4bde-83a5-6d0dee8050f6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:17.367971 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1ffa162c-f6d4-4bde-83a5-6d0dee8050f6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:17.369658 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1ffa162c-f6d4-4bde-83a5-6d0dee8050f6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:17.371606 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1ffa162c-f6d4-4bde-83a5-6d0dee8050f6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:17.373089 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1ffa162c-f6d4-4bde-83a5-6d0dee8050f6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:17.373833 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1ffa162c-f6d4-4bde-83a5-6d0dee8050f6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:17.797913 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1ffa162c-f6d4-4bde-83a5-6d0dee8050f6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:17.815761 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1ffa162c-f6d4-4bde-83a5-6d0dee8050f6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1672 microversion: 2.1 time: 0.482056 Oct 30 01:43:17.819040 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2771/5548] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:43:17 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1672 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:43:18.344978 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-25487bf1-35fe-4012-9954-3960628ccb8b tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:18.345866 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-25487bf1-35fe-4012-9954-3960628ccb8b tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:18.385528 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-25487bf1-35fe-4012-9954-3960628ccb8b tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:18.386197 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-25487bf1-35fe-4012-9954-3960628ccb8b tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:18.394473 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-25487bf1-35fe-4012-9954-3960628ccb8b tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:18.396934 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-25487bf1-35fe-4012-9954-3960628ccb8b tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:18.401417 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-25487bf1-35fe-4012-9954-3960628ccb8b tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:18.401977 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-25487bf1-35fe-4012-9954-3960628ccb8b tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:19.012045 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-25487bf1-35fe-4012-9954-3960628ccb8b tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:19.018758 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-25487bf1-35fe-4012-9954-3960628ccb8b tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:19.020389 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-25487bf1-35fe-4012-9954-3960628ccb8b tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:19.022847 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-25487bf1-35fe-4012-9954-3960628ccb8b tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1728 microversion: 2.20 time: 0.684167 Oct 30 01:43:19.024731 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2772/5549] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:43:18 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1728 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:43:19.031697 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1d84fb05-2359-4e44-94d1-7453a8b8e524 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:19.032600 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1d84fb05-2359-4e44-94d1-7453a8b8e524 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:19.042226 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1d84fb05-2359-4e44-94d1-7453a8b8e524 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:19.042778 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1d84fb05-2359-4e44-94d1-7453a8b8e524 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:19.043222 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1d84fb05-2359-4e44-94d1-7453a8b8e524 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:19.044705 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1d84fb05-2359-4e44-94d1-7453a8b8e524 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:19.045165 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1d84fb05-2359-4e44-94d1-7453a8b8e524 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:19.045615 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1d84fb05-2359-4e44-94d1-7453a8b8e524 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:19.338232 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1d84fb05-2359-4e44-94d1-7453a8b8e524 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:19.347462 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1d84fb05-2359-4e44-94d1-7453a8b8e524 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1672 microversion: 2.1 time: 0.322171 Oct 30 01:43:19.348129 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2773/5550] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:43:19 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1672 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:43:19.758196 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=27 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:20.064354 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4ddefcd0-a65c-429a-831e-4e1407134e3c tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:20.065291 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4ddefcd0-a65c-429a-831e-4e1407134e3c tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:20.080572 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4ddefcd0-a65c-429a-831e-4e1407134e3c tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:20.081431 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4ddefcd0-a65c-429a-831e-4e1407134e3c tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:20.083461 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4ddefcd0-a65c-429a-831e-4e1407134e3c tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:20.086482 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4ddefcd0-a65c-429a-831e-4e1407134e3c tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:20.090000 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4ddefcd0-a65c-429a-831e-4e1407134e3c tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:20.090757 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4ddefcd0-a65c-429a-831e-4e1407134e3c tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:20.407291 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4ddefcd0-a65c-429a-831e-4e1407134e3c tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:20.422207 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4ddefcd0-a65c-429a-831e-4e1407134e3c tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:20.428796 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4ddefcd0-a65c-429a-831e-4e1407134e3c tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:20.428796 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4ddefcd0-a65c-429a-831e-4e1407134e3c tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1728 microversion: 2.20 time: 0.366954 Oct 30 01:43:20.428796 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2774/5551] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:43:20 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1728 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:43:20.432463 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-aba92053-9a63-43b9-b447-498fa5e91aea tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:20.433089 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-aba92053-9a63-43b9-b447-498fa5e91aea tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:20.444134 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aba92053-9a63-43b9-b447-498fa5e91aea tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:20.446296 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aba92053-9a63-43b9-b447-498fa5e91aea tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:20.448142 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aba92053-9a63-43b9-b447-498fa5e91aea tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:20.452383 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aba92053-9a63-43b9-b447-498fa5e91aea tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:20.456739 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aba92053-9a63-43b9-b447-498fa5e91aea tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:20.457478 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aba92053-9a63-43b9-b447-498fa5e91aea tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:20.787344 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-aba92053-9a63-43b9-b447-498fa5e91aea tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:20.798080 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-aba92053-9a63-43b9-b447-498fa5e91aea tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1677 microversion: 2.1 time: 0.370190 Oct 30 01:43:20.799064 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2775/5552] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:43:20 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1677 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:43:21.456990 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4f8c024e-9d05-4929-a652-bf041e112a96 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:21.457613 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4f8c024e-9d05-4929-a652-bf041e112a96 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:21.460731 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:21.484171 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4f8c024e-9d05-4929-a652-bf041e112a96 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:21.487762 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4f8c024e-9d05-4929-a652-bf041e112a96 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:21.493646 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4f8c024e-9d05-4929-a652-bf041e112a96 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:21.494681 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4f8c024e-9d05-4929-a652-bf041e112a96 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:21.496041 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4f8c024e-9d05-4929-a652-bf041e112a96 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:21.501531 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4f8c024e-9d05-4929-a652-bf041e112a96 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:21.509530 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:21.662864 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=11 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:21.890081 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4f8c024e-9d05-4929-a652-bf041e112a96 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:21.900412 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4f8c024e-9d05-4929-a652-bf041e112a96 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:21.909077 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4f8c024e-9d05-4929-a652-bf041e112a96 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:21.916831 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4f8c024e-9d05-4929-a652-bf041e112a96 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1728 microversion: 2.20 time: 0.461498 Oct 30 01:43:21.921715 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2776/5553] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:43:21 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1728 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:43:21.940512 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a695c86b-6c54-4121-b6ff-660aa105f014 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:21.958241 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a695c86b-6c54-4121-b6ff-660aa105f014 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:21.971524 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a695c86b-6c54-4121-b6ff-660aa105f014 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:21.974640 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a695c86b-6c54-4121-b6ff-660aa105f014 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:21.976724 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a695c86b-6c54-4121-b6ff-660aa105f014 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:21.977998 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a695c86b-6c54-4121-b6ff-660aa105f014 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:21.979541 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a695c86b-6c54-4121-b6ff-660aa105f014 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:21.981795 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a695c86b-6c54-4121-b6ff-660aa105f014 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:22.279293 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a695c86b-6c54-4121-b6ff-660aa105f014 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:22.293989 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a695c86b-6c54-4121-b6ff-660aa105f014 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1670 microversion: 2.1 time: 0.370760 Oct 30 01:43:22.310356 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2777/5554] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:43:21 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1670 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:43:22.324313 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1f9c78ef-7dc9-43f9-8538-e260573d054c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:43:22.331192 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1f9c78ef-7dc9-43f9-8538-e260573d054c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:22.354719 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1f9c78ef-7dc9-43f9-8538-e260573d054c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:22.360444 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1f9c78ef-7dc9-43f9-8538-e260573d054c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:22.361170 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1f9c78ef-7dc9-43f9-8538-e260573d054c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:22.362431 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1f9c78ef-7dc9-43f9-8538-e260573d054c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:22.365486 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1f9c78ef-7dc9-43f9-8538-e260573d054c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:22.366008 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1f9c78ef-7dc9-43f9-8538-e260573d054c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:22.473513 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1f9c78ef-7dc9-43f9-8538-e260573d054c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "POST /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9/action" status: 200 len: 322 microversion: 2.1 time: 0.152531 Oct 30 01:43:22.479005 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2778/5555] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:43:22 2022] POST /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9/action => generated 322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:43:22.500132 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-32ed4dbf-358f-4d04-b4c3-b8e0a0d1dc05 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:22.514534 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-32ed4dbf-358f-4d04-b4c3-b8e0a0d1dc05 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:22.541393 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-32ed4dbf-358f-4d04-b4c3-b8e0a0d1dc05 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:22.541907 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-32ed4dbf-358f-4d04-b4c3-b8e0a0d1dc05 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:22.542351 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-32ed4dbf-358f-4d04-b4c3-b8e0a0d1dc05 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:22.544575 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-32ed4dbf-358f-4d04-b4c3-b8e0a0d1dc05 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:22.545068 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-32ed4dbf-358f-4d04-b4c3-b8e0a0d1dc05 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:22.547472 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-32ed4dbf-358f-4d04-b4c3-b8e0a0d1dc05 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:22.951362 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-32ed4dbf-358f-4d04-b4c3-b8e0a0d1dc05 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:22.990240 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-32ed4dbf-358f-4d04-b4c3-b8e0a0d1dc05 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1670 microversion: 2.1 time: 0.505502 Oct 30 01:43:22.994422 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2779/5556] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:43:22 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1670 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:43:23.011661 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d3f5209e-323a-4fb2-8035-2433c6395e6e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:23.017160 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d3f5209e-323a-4fb2-8035-2433c6395e6e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:23.068368 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d3f5209e-323a-4fb2-8035-2433c6395e6e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:23.069059 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d3f5209e-323a-4fb2-8035-2433c6395e6e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:23.070885 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d3f5209e-323a-4fb2-8035-2433c6395e6e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:23.073020 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d3f5209e-323a-4fb2-8035-2433c6395e6e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:23.073823 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d3f5209e-323a-4fb2-8035-2433c6395e6e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:23.074795 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d3f5209e-323a-4fb2-8035-2433c6395e6e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:23.393131 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d3f5209e-323a-4fb2-8035-2433c6395e6e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:23.408756 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d3f5209e-323a-4fb2-8035-2433c6395e6e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:23.411599 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d3f5209e-323a-4fb2-8035-2433c6395e6e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:23.411599 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d3f5209e-323a-4fb2-8035-2433c6395e6e tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1728 microversion: 2.20 time: 0.415605 Oct 30 01:43:23.412404 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2780/5557] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:43:22 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1728 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:43:23.418548 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2819aafd-e138-4ddd-811a-55cc52152558 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:23.419710 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2819aafd-e138-4ddd-811a-55cc52152558 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:23.428708 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2819aafd-e138-4ddd-811a-55cc52152558 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:23.429205 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2819aafd-e138-4ddd-811a-55cc52152558 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:23.429668 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2819aafd-e138-4ddd-811a-55cc52152558 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:23.430465 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2819aafd-e138-4ddd-811a-55cc52152558 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:23.430903 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2819aafd-e138-4ddd-811a-55cc52152558 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:23.431332 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2819aafd-e138-4ddd-811a-55cc52152558 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:23.696916 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2819aafd-e138-4ddd-811a-55cc52152558 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:23.720008 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2819aafd-e138-4ddd-811a-55cc52152558 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1670 microversion: 2.1 time: 0.305405 Oct 30 01:43:23.722507 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2781/5558] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:43:23 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1670 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:43:23.751919 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-af3e2d81-2a3c-4f4a-a618-37ceb90ba23c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:23.752870 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-af3e2d81-2a3c-4f4a-a618-37ceb90ba23c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:23.767002 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af3e2d81-2a3c-4f4a-a618-37ceb90ba23c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:23.769173 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af3e2d81-2a3c-4f4a-a618-37ceb90ba23c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:23.769173 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af3e2d81-2a3c-4f4a-a618-37ceb90ba23c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:23.769173 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af3e2d81-2a3c-4f4a-a618-37ceb90ba23c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:23.770509 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af3e2d81-2a3c-4f4a-a618-37ceb90ba23c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:23.771809 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af3e2d81-2a3c-4f4a-a618-37ceb90ba23c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:24.172711 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-af3e2d81-2a3c-4f4a-a618-37ceb90ba23c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:24.210130 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-af3e2d81-2a3c-4f4a-a618-37ceb90ba23c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1670 microversion: 2.1 time: 0.458691 Oct 30 01:43:24.210130 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2782/5559] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:43:23 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1670 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:43:24.246755 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d71b212f-c9f7-4d63-ba07-e2f34b9b5c4a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:24.247393 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d71b212f-c9f7-4d63-ba07-e2f34b9b5c4a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:24.257974 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d71b212f-c9f7-4d63-ba07-e2f34b9b5c4a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:24.258518 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d71b212f-c9f7-4d63-ba07-e2f34b9b5c4a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:24.258975 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d71b212f-c9f7-4d63-ba07-e2f34b9b5c4a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:24.276944 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d71b212f-c9f7-4d63-ba07-e2f34b9b5c4a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:24.289801 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d71b212f-c9f7-4d63-ba07-e2f34b9b5c4a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:24.290737 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d71b212f-c9f7-4d63-ba07-e2f34b9b5c4a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:24.651731 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d71b212f-c9f7-4d63-ba07-e2f34b9b5c4a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:24.662865 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d71b212f-c9f7-4d63-ba07-e2f34b9b5c4a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1670 microversion: 2.1 time: 0.420603 Oct 30 01:43:24.664015 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2783/5560] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:43:24 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1670 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:43:24.674688 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b1cb4ede-edcf-468d-af76-97e32b1a70fd tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:24.675615 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b1cb4ede-edcf-468d-af76-97e32b1a70fd tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:24.682778 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1cb4ede-edcf-468d-af76-97e32b1a70fd tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:24.683540 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1cb4ede-edcf-468d-af76-97e32b1a70fd tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:24.684807 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1cb4ede-edcf-468d-af76-97e32b1a70fd tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:24.685857 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1cb4ede-edcf-468d-af76-97e32b1a70fd tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:24.686533 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1cb4ede-edcf-468d-af76-97e32b1a70fd tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:24.687165 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1cb4ede-edcf-468d-af76-97e32b1a70fd tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:25.083591 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b1cb4ede-edcf-468d-af76-97e32b1a70fd tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:25.095299 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b1cb4ede-edcf-468d-af76-97e32b1a70fd tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:25.113671 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b1cb4ede-edcf-468d-af76-97e32b1a70fd tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:25.115106 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b1cb4ede-edcf-468d-af76-97e32b1a70fd tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1728 microversion: 2.20 time: 0.449933 Oct 30 01:43:25.128299 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2784/5561] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:43:24 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1728 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:43:25.138702 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9347ccf6-cbb7-42f9-b6ed-8c45d52762e7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-980744089", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "c8b5246f-f8f5-404d-864d-b312dbb308c5"}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:43:29.777453 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-9347ccf6-cbb7-42f9-b6ed-8c45d52762e7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] validate_networks() for [('c8b5246f-f8f5-404d-864d-b312dbb308c5', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:43:29.967138 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-5f5d3e7c-fa92-4388-8468-afc77147cd86 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] validate_networks() for [('af29edab-d012-4c57-955e-a5084c21f70e', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:43:30.632533 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-5f5d3e7c-fa92-4388-8468-afc77147cd86 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Getting quotas for project 8d68930ed61745eea8adfda72f3d139f. Resources: dict_keys(['metadata_items']) {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:43:30.645166 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-5f5d3e7c-fa92-4388-8468-afc77147cd86 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Getting quotas for user 759025c4133f4074ba59beb1a08c7a21 and project 8d68930ed61745eea8adfda72f3d139f. Resources: dict_keys(['metadata_items']) {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:43:30.672984 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-5f5d3e7c-fa92-4388-8468-afc77147cd86 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:43:30.674320 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-5f5d3e7c-fa92-4388-8468-afc77147cd86 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:43:30.675012 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-5f5d3e7c-fa92-4388-8468-afc77147cd86 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:43:30.676001 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-5f5d3e7c-fa92-4388-8468-afc77147cd86 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:43:30.676647 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-5f5d3e7c-fa92-4388-8468-afc77147cd86 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:43:30.687223 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f5d3e7c-fa92-4388-8468-afc77147cd86 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:30.687845 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f5d3e7c-fa92-4388-8468-afc77147cd86 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:30.688532 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f5d3e7c-fa92-4388-8468-afc77147cd86 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:30.689595 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f5d3e7c-fa92-4388-8468-afc77147cd86 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:30.690264 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f5d3e7c-fa92-4388-8468-afc77147cd86 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:30.690941 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f5d3e7c-fa92-4388-8468-afc77147cd86 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:30.711322 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-5f5d3e7c-fa92-4388-8468-afc77147cd86 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Getting quotas for project 8d68930ed61745eea8adfda72f3d139f. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:43:30.719187 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-5f5d3e7c-fa92-4388-8468-afc77147cd86 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Getting quotas for user 759025c4133f4074ba59beb1a08c7a21 and project 8d68930ed61745eea8adfda72f3d139f. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:43:30.733780 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-9347ccf6-cbb7-42f9-b6ed-8c45d52762e7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:43:30.734222 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-9347ccf6-cbb7-42f9-b6ed-8c45d52762e7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:43:30.734955 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-9347ccf6-cbb7-42f9-b6ed-8c45d52762e7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:43:30.735370 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-9347ccf6-cbb7-42f9-b6ed-8c45d52762e7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:43:30.735786 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-9347ccf6-cbb7-42f9-b6ed-8c45d52762e7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:43:30.737016 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5f5d3e7c-fa92-4388-8468-afc77147cd86 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:43:30.739719 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5f5d3e7c-fa92-4388-8468-afc77147cd86 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] [instance: 7b678024-1288-425e-9985-41c2554f36c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:43:30.752149 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9347ccf6-cbb7-42f9-b6ed-8c45d52762e7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:30.754071 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9347ccf6-cbb7-42f9-b6ed-8c45d52762e7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:30.755880 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9347ccf6-cbb7-42f9-b6ed-8c45d52762e7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:30.759527 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9347ccf6-cbb7-42f9-b6ed-8c45d52762e7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:30.760074 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9347ccf6-cbb7-42f9-b6ed-8c45d52762e7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:30.766431 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9347ccf6-cbb7-42f9-b6ed-8c45d52762e7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:30.809374 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-9347ccf6-cbb7-42f9-b6ed-8c45d52762e7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Getting quotas for project 9f9d0d541cc3496ebf8dc71af4254506. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:43:30.816278 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-9347ccf6-cbb7-42f9-b6ed-8c45d52762e7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Getting quotas for user 157c0ef579434726810bb3775388b944 and project 9f9d0d541cc3496ebf8dc71af4254506. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:43:30.846863 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9347ccf6-cbb7-42f9-b6ed-8c45d52762e7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:43:30.856913 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9347ccf6-cbb7-42f9-b6ed-8c45d52762e7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:43:30.939617 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5f5d3e7c-fa92-4388-8468-afc77147cd86 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 19.372036 Oct 30 01:43:30.941460 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2778/5562] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:43:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 19375 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:43:30.954034 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-872a2a54-5b11-4f32-a3c5-5d187687bbe6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:30.954615 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-872a2a54-5b11-4f32-a3c5-5d187687bbe6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:30.963061 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-872a2a54-5b11-4f32-a3c5-5d187687bbe6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:30.965448 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-872a2a54-5b11-4f32-a3c5-5d187687bbe6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:30.965448 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-872a2a54-5b11-4f32-a3c5-5d187687bbe6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:30.965448 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-872a2a54-5b11-4f32-a3c5-5d187687bbe6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:30.965993 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-872a2a54-5b11-4f32-a3c5-5d187687bbe6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:30.966255 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-872a2a54-5b11-4f32-a3c5-5d187687bbe6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:31.060931 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9347ccf6-cbb7-42f9-b6ed-8c45d52762e7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.937622 Oct 30 01:43:31.061873 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2785/5563] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:43:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 5942 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:43:31.081532 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f0f1854f-2f3f-4aaa-8691-9b44624ed830 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:31.086945 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f0f1854f-2f3f-4aaa-8691-9b44624ed830 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] [instance: 7b678024-1288-425e-9985-41c2554f36c8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:31.206201 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f0f1854f-2f3f-4aaa-8691-9b44624ed830 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759025c4133f4074ba59beb1a08c7a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68930ed61745eea8adfda72f3d139f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:31.216021 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f0f1854f-2f3f-4aaa-8691-9b44624ed830 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] 10.222.0.13 "GET /compute/v2.1/servers/7b678024-1288-425e-9985-41c2554f36c8" status: 200 len: 1303 microversion: 2.1 time: 0.152794 Oct 30 01:43:31.216612 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2786/5564] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:43:31 2022] GET /compute/v2.1/servers/7b678024-1288-425e-9985-41c2554f36c8 => generated 1303 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:43:31.244045 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-221875b7-88ac-4852-9050-741fd11a02d0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:31.244664 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-221875b7-88ac-4852-9050-741fd11a02d0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:31.318031 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-872a2a54-5b11-4f32-a3c5-5d187687bbe6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:31.336414 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-872a2a54-5b11-4f32-a3c5-5d187687bbe6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:31.338470 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-872a2a54-5b11-4f32-a3c5-5d187687bbe6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:31.343179 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-872a2a54-5b11-4f32-a3c5-5d187687bbe6 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1728 microversion: 2.20 time: 0.395905 Oct 30 01:43:31.344001 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2779/5565] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:43:30 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1728 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:43:31.425507 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-221875b7-88ac-4852-9050-741fd11a02d0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:31.437988 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-221875b7-88ac-4852-9050-741fd11a02d0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1" status: 200 len: 1214 microversion: 2.1 time: 0.197486 Oct 30 01:43:31.439777 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2787/5566] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:43:31 2022] GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1 => generated 1214 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:43:32.244827 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-05ade6ac-fe80-451c-b935-77b9308c7c5f tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:32.245661 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-05ade6ac-fe80-451c-b935-77b9308c7c5f tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] [instance: 7b678024-1288-425e-9985-41c2554f36c8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:32.372219 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d7858785-2af4-4cf7-ad57-fbbe3acd47c1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:32.373563 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d7858785-2af4-4cf7-ad57-fbbe3acd47c1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:32.392293 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d7858785-2af4-4cf7-ad57-fbbe3acd47c1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:32.394889 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d7858785-2af4-4cf7-ad57-fbbe3acd47c1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:32.396275 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d7858785-2af4-4cf7-ad57-fbbe3acd47c1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:32.397593 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d7858785-2af4-4cf7-ad57-fbbe3acd47c1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:32.399728 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d7858785-2af4-4cf7-ad57-fbbe3acd47c1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:32.400238 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d7858785-2af4-4cf7-ad57-fbbe3acd47c1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:32.463473 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-05ade6ac-fe80-451c-b935-77b9308c7c5f tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759025c4133f4074ba59beb1a08c7a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68930ed61745eea8adfda72f3d139f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:32.471577 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-05ade6ac-fe80-451c-b935-77b9308c7c5f tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] 10.222.0.13 "GET /compute/v2.1/servers/7b678024-1288-425e-9985-41c2554f36c8" status: 200 len: 1303 microversion: 2.1 time: 0.232365 Oct 30 01:43:32.473429 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2780/5567] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:43:32 2022] GET /compute/v2.1/servers/7b678024-1288-425e-9985-41c2554f36c8 => generated 1303 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:43:32.481041 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cee35361-3144-41b5-a261-49d854641331 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:32.481881 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cee35361-3144-41b5-a261-49d854641331 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:32.641670 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-cee35361-3144-41b5-a261-49d854641331 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:32.666722 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cee35361-3144-41b5-a261-49d854641331 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1" status: 200 len: 1214 microversion: 2.1 time: 0.190757 Oct 30 01:43:32.690770 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2781/5568] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:43:32 2022] GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1 => generated 1214 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:43:32.764804 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d7858785-2af4-4cf7-ad57-fbbe3acd47c1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:32.776277 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d7858785-2af4-4cf7-ad57-fbbe3acd47c1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:32.779234 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d7858785-2af4-4cf7-ad57-fbbe3acd47c1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:32.788316 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d7858785-2af4-4cf7-ad57-fbbe3acd47c1 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1728 microversion: 2.20 time: 0.413328 Oct 30 01:43:32.795133 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2788/5569] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:43:32 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1728 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:43:33.501093 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a2c9d6dc-d90a-4f1c-a709-053baeed6c5f tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:33.502441 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a2c9d6dc-d90a-4f1c-a709-053baeed6c5f tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] [instance: 7b678024-1288-425e-9985-41c2554f36c8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:33.512663 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a2c9d6dc-d90a-4f1c-a709-053baeed6c5f tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:33.513446 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a2c9d6dc-d90a-4f1c-a709-053baeed6c5f tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:33.514099 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a2c9d6dc-d90a-4f1c-a709-053baeed6c5f tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:33.515074 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a2c9d6dc-d90a-4f1c-a709-053baeed6c5f tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:33.515533 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a2c9d6dc-d90a-4f1c-a709-053baeed6c5f tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:33.516447 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a2c9d6dc-d90a-4f1c-a709-053baeed6c5f tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:33.674815 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a2c9d6dc-d90a-4f1c-a709-053baeed6c5f tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759025c4133f4074ba59beb1a08c7a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68930ed61745eea8adfda72f3d139f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:33.691127 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6701d65d-3a2a-495b-bdc5-f3e8f302da8d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:33.692442 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6701d65d-3a2a-495b-bdc5-f3e8f302da8d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:33.722204 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a2c9d6dc-d90a-4f1c-a709-053baeed6c5f tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] 10.222.0.13 "GET /compute/v2.1/servers/7b678024-1288-425e-9985-41c2554f36c8" status: 200 len: 1299 microversion: 2.1 time: 0.223401 Oct 30 01:43:33.723292 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2782/5570] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:43:33 2022] GET /compute/v2.1/servers/7b678024-1288-425e-9985-41c2554f36c8 => generated 1299 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:43:33.723557 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6701d65d-3a2a-495b-bdc5-f3e8f302da8d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:33.724417 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6701d65d-3a2a-495b-bdc5-f3e8f302da8d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:33.726305 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6701d65d-3a2a-495b-bdc5-f3e8f302da8d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:33.728973 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6701d65d-3a2a-495b-bdc5-f3e8f302da8d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:33.730822 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6701d65d-3a2a-495b-bdc5-f3e8f302da8d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:33.732293 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6701d65d-3a2a-495b-bdc5-f3e8f302da8d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:33.814916 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a368e8a2-9078-40fc-950e-e88ffa7fa67a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:33.815534 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a368e8a2-9078-40fc-950e-e88ffa7fa67a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:33.827118 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a368e8a2-9078-40fc-950e-e88ffa7fa67a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:33.827816 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a368e8a2-9078-40fc-950e-e88ffa7fa67a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:33.830895 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a368e8a2-9078-40fc-950e-e88ffa7fa67a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:33.832281 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a368e8a2-9078-40fc-950e-e88ffa7fa67a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:33.832934 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a368e8a2-9078-40fc-950e-e88ffa7fa67a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:33.835060 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a368e8a2-9078-40fc-950e-e88ffa7fa67a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:34.532573 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6701d65d-3a2a-495b-bdc5-f3e8f302da8d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:34.545914 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6701d65d-3a2a-495b-bdc5-f3e8f302da8d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1" status: 200 len: 1266 microversion: 2.1 time: 0.859132 Oct 30 01:43:34.551406 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2789/5571] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:43:33 2022] GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1 => generated 1266 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:43:34.751023 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-92f3ef7f-0fbd-4b85-ba07-2e0c3938b3b0 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:34.751762 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-92f3ef7f-0fbd-4b85-ba07-2e0c3938b3b0 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] [instance: 7b678024-1288-425e-9985-41c2554f36c8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:34.764799 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-92f3ef7f-0fbd-4b85-ba07-2e0c3938b3b0 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:34.765677 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-92f3ef7f-0fbd-4b85-ba07-2e0c3938b3b0 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:34.766121 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-92f3ef7f-0fbd-4b85-ba07-2e0c3938b3b0 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:34.766843 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-92f3ef7f-0fbd-4b85-ba07-2e0c3938b3b0 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:34.767524 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-92f3ef7f-0fbd-4b85-ba07-2e0c3938b3b0 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:34.778212 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-92f3ef7f-0fbd-4b85-ba07-2e0c3938b3b0 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:35.115108 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a368e8a2-9078-40fc-950e-e88ffa7fa67a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:35.135587 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a368e8a2-9078-40fc-950e-e88ffa7fa67a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:35.138324 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a368e8a2-9078-40fc-950e-e88ffa7fa67a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:35.141504 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a368e8a2-9078-40fc-950e-e88ffa7fa67a tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1728 microversion: 2.20 time: 1.329273 Oct 30 01:43:35.143407 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2783/5572] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:43:33 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1728 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:43:35.228866 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-597100d0-f97d-4ed4-982e-4af73e99054a req-6b1485b3-5b52-4899-b0ee-7f33ee1a7367 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2e35e69-66f2-43a0-9baa-d8f70437561d", "name": "network-vif-plugged", "status": "completed", "tag": "6657440b-da45-40cf-ae87-7a3d5beeb7a4"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:43:35.255382 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-597100d0-f97d-4ed4-982e-4af73e99054a req-6b1485b3-5b52-4899-b0ee-7f33ee1a7367 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:35.256204 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-597100d0-f97d-4ed4-982e-4af73e99054a req-6b1485b3-5b52-4899-b0ee-7f33ee1a7367 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:35.256728 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-597100d0-f97d-4ed4-982e-4af73e99054a req-6b1485b3-5b52-4899-b0ee-7f33ee1a7367 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:35.271224 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-597100d0-f97d-4ed4-982e-4af73e99054a req-6b1485b3-5b52-4899-b0ee-7f33ee1a7367 service nova] Creating event network-vif-plugged:6657440b-da45-40cf-ae87-7a3d5beeb7a4 for instance b2e35e69-66f2-43a0-9baa-d8f70437561d on n-h1-master-1 Oct 30 01:43:35.277658 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-597100d0-f97d-4ed4-982e-4af73e99054a req-6b1485b3-5b52-4899-b0ee-7f33ee1a7367 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053937 Oct 30 01:43:35.283051 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2784/5573] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:43:35.327895 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-92f3ef7f-0fbd-4b85-ba07-2e0c3938b3b0 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759025c4133f4074ba59beb1a08c7a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68930ed61745eea8adfda72f3d139f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:35.337491 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-92f3ef7f-0fbd-4b85-ba07-2e0c3938b3b0 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] 10.222.0.13 "GET /compute/v2.1/servers/7b678024-1288-425e-9985-41c2554f36c8" status: 200 len: 1355 microversion: 2.1 time: 0.590116 Oct 30 01:43:35.339075 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2790/5574] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:43:34 2022] GET /compute/v2.1/servers/7b678024-1288-425e-9985-41c2554f36c8 => generated 1355 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:43:35.592256 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a7773de8-f6fe-412d-b552-efe3c90d5332 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:35.593666 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a7773de8-f6fe-412d-b552-efe3c90d5332 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:35.604577 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7773de8-f6fe-412d-b552-efe3c90d5332 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:35.607472 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7773de8-f6fe-412d-b552-efe3c90d5332 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:35.608174 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7773de8-f6fe-412d-b552-efe3c90d5332 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:35.610750 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7773de8-f6fe-412d-b552-efe3c90d5332 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:35.612597 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7773de8-f6fe-412d-b552-efe3c90d5332 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:35.613728 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7773de8-f6fe-412d-b552-efe3c90d5332 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:36.178984 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-84522884-6ac4-4b73-a27f-57dedaf35a07 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:36.179626 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-84522884-6ac4-4b73-a27f-57dedaf35a07 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:36.204532 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-84522884-6ac4-4b73-a27f-57dedaf35a07 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:36.205984 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-84522884-6ac4-4b73-a27f-57dedaf35a07 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:36.206921 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-84522884-6ac4-4b73-a27f-57dedaf35a07 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:36.207903 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-84522884-6ac4-4b73-a27f-57dedaf35a07 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:36.208992 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-84522884-6ac4-4b73-a27f-57dedaf35a07 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:36.209651 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-84522884-6ac4-4b73-a27f-57dedaf35a07 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:36.856761 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-84522884-6ac4-4b73-a27f-57dedaf35a07 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:36.872677 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-84522884-6ac4-4b73-a27f-57dedaf35a07 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:36.915818 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-84522884-6ac4-4b73-a27f-57dedaf35a07 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:36.920740 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-84522884-6ac4-4b73-a27f-57dedaf35a07 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1728 microversion: 2.20 time: 0.747963 Oct 30 01:43:36.946236 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2791/5575] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:43:36 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1728 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:43:36.960668 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cd699a45-d625-40e1-9004-d5d55024bc66 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:36.961765 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-cd699a45-d625-40e1-9004-d5d55024bc66 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] [instance: 7b678024-1288-425e-9985-41c2554f36c8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:36.976889 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd699a45-d625-40e1-9004-d5d55024bc66 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:36.977417 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd699a45-d625-40e1-9004-d5d55024bc66 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:36.982074 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd699a45-d625-40e1-9004-d5d55024bc66 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:36.982894 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd699a45-d625-40e1-9004-d5d55024bc66 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:36.986014 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd699a45-d625-40e1-9004-d5d55024bc66 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:36.986715 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd699a45-d625-40e1-9004-d5d55024bc66 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:37.193850 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-cd699a45-d625-40e1-9004-d5d55024bc66 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759025c4133f4074ba59beb1a08c7a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68930ed61745eea8adfda72f3d139f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:37.216427 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cd699a45-d625-40e1-9004-d5d55024bc66 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] 10.222.0.13 "GET /compute/v2.1/servers/7b678024-1288-425e-9985-41c2554f36c8" status: 200 len: 1363 microversion: 2.1 time: 0.267104 Oct 30 01:43:37.217045 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2792/5576] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:43:36 2022] GET /compute/v2.1/servers/7b678024-1288-425e-9985-41c2554f36c8 => generated 1363 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:43:37.509667 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a7773de8-f6fe-412d-b552-efe3c90d5332 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:37.521267 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a7773de8-f6fe-412d-b552-efe3c90d5332 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1" status: 200 len: 1274 microversion: 2.1 time: 1.944806 Oct 30 01:43:37.522557 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2785/5577] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:43:35 2022] GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1 => generated 1274 bytes in 1950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:43:37.972706 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e7192cc4-079d-42c2-9f36-3708a7c1a022 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:37.973687 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e7192cc4-079d-42c2-9f36-3708a7c1a022 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:37.993910 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7192cc4-079d-42c2-9f36-3708a7c1a022 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:37.997322 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7192cc4-079d-42c2-9f36-3708a7c1a022 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:38.005992 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7192cc4-079d-42c2-9f36-3708a7c1a022 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:38.010943 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7192cc4-079d-42c2-9f36-3708a7c1a022 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:38.010943 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7192cc4-079d-42c2-9f36-3708a7c1a022 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:38.010943 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7192cc4-079d-42c2-9f36-3708a7c1a022 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:38.253587 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b0a8d060-ab70-4bb2-99b0-710ae68a8f08 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:38.254214 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b0a8d060-ab70-4bb2-99b0-710ae68a8f08 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] [instance: 7b678024-1288-425e-9985-41c2554f36c8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:38.271752 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0a8d060-ab70-4bb2-99b0-710ae68a8f08 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:38.272917 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0a8d060-ab70-4bb2-99b0-710ae68a8f08 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:38.273386 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0a8d060-ab70-4bb2-99b0-710ae68a8f08 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:38.278906 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0a8d060-ab70-4bb2-99b0-710ae68a8f08 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:38.279467 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0a8d060-ab70-4bb2-99b0-710ae68a8f08 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:38.279937 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0a8d060-ab70-4bb2-99b0-710ae68a8f08 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:38.451964 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b0a8d060-ab70-4bb2-99b0-710ae68a8f08 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759025c4133f4074ba59beb1a08c7a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68930ed61745eea8adfda72f3d139f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:38.465727 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b0a8d060-ab70-4bb2-99b0-710ae68a8f08 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] 10.222.0.13 "GET /compute/v2.1/servers/7b678024-1288-425e-9985-41c2554f36c8" status: 200 len: 1361 microversion: 2.1 time: 0.215943 Oct 30 01:43:38.466438 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2786/5578] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:43:38 2022] GET /compute/v2.1/servers/7b678024-1288-425e-9985-41c2554f36c8 => generated 1361 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:43:38.548515 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1052faac-c756-4a2e-8efa-42f822b6e1f7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:38.549892 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1052faac-c756-4a2e-8efa-42f822b6e1f7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:38.563826 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1052faac-c756-4a2e-8efa-42f822b6e1f7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:38.564574 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1052faac-c756-4a2e-8efa-42f822b6e1f7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:38.565941 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1052faac-c756-4a2e-8efa-42f822b6e1f7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:38.566844 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1052faac-c756-4a2e-8efa-42f822b6e1f7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:38.575517 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1052faac-c756-4a2e-8efa-42f822b6e1f7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:38.575817 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1052faac-c756-4a2e-8efa-42f822b6e1f7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:38.802451 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e7192cc4-079d-42c2-9f36-3708a7c1a022 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:38.816044 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e7192cc4-079d-42c2-9f36-3708a7c1a022 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:38.817579 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e7192cc4-079d-42c2-9f36-3708a7c1a022 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:38.819989 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e7192cc4-079d-42c2-9f36-3708a7c1a022 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1728 microversion: 2.20 time: 0.867397 Oct 30 01:43:38.821120 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2793/5579] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:43:37 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1728 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:43:39.319383 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1052faac-c756-4a2e-8efa-42f822b6e1f7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:39.329391 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1052faac-c756-4a2e-8efa-42f822b6e1f7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1" status: 200 len: 1314 microversion: 2.1 time: 0.785111 Oct 30 01:43:39.331179 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2787/5580] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:43:38 2022] GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1 => generated 1314 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:43:39.499186 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e15e9f65-60bb-472e-a952-5cda53ac9c65 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:39.500044 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e15e9f65-60bb-472e-a952-5cda53ac9c65 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] [instance: 7b678024-1288-425e-9985-41c2554f36c8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:39.508283 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e15e9f65-60bb-472e-a952-5cda53ac9c65 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:39.509386 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e15e9f65-60bb-472e-a952-5cda53ac9c65 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:39.510494 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e15e9f65-60bb-472e-a952-5cda53ac9c65 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:39.513464 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e15e9f65-60bb-472e-a952-5cda53ac9c65 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:39.515961 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e15e9f65-60bb-472e-a952-5cda53ac9c65 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:39.518056 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e15e9f65-60bb-472e-a952-5cda53ac9c65 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:39.851967 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-791871f5-0f9b-4c05-a15a-436a3f4d8fbc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:39.856376 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-791871f5-0f9b-4c05-a15a-436a3f4d8fbc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:39.863782 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-791871f5-0f9b-4c05-a15a-436a3f4d8fbc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:39.864265 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-791871f5-0f9b-4c05-a15a-436a3f4d8fbc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:39.866136 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-791871f5-0f9b-4c05-a15a-436a3f4d8fbc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:39.867443 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-791871f5-0f9b-4c05-a15a-436a3f4d8fbc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:39.870010 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-791871f5-0f9b-4c05-a15a-436a3f4d8fbc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:39.870868 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-791871f5-0f9b-4c05-a15a-436a3f4d8fbc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:40.131542 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e15e9f65-60bb-472e-a952-5cda53ac9c65 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759025c4133f4074ba59beb1a08c7a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68930ed61745eea8adfda72f3d139f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:40.146325 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e15e9f65-60bb-472e-a952-5cda53ac9c65 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] 10.222.0.13 "GET /compute/v2.1/servers/7b678024-1288-425e-9985-41c2554f36c8" status: 200 len: 1361 microversion: 2.1 time: 0.651507 Oct 30 01:43:40.160726 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2794/5581] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:43:39 2022] GET /compute/v2.1/servers/7b678024-1288-425e-9985-41c2554f36c8 => generated 1361 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:43:40.357698 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-631b8ba2-75f0-49c7-ad8a-17c93383748f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:40.358646 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-631b8ba2-75f0-49c7-ad8a-17c93383748f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:40.369734 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-631b8ba2-75f0-49c7-ad8a-17c93383748f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:40.370519 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-631b8ba2-75f0-49c7-ad8a-17c93383748f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:40.372065 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-631b8ba2-75f0-49c7-ad8a-17c93383748f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:40.372965 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-631b8ba2-75f0-49c7-ad8a-17c93383748f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:40.373697 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-631b8ba2-75f0-49c7-ad8a-17c93383748f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:40.374348 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-631b8ba2-75f0-49c7-ad8a-17c93383748f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:40.702498 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:40.786697 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:40.858019 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-631b8ba2-75f0-49c7-ad8a-17c93383748f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:40.888240 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=100 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:40.892025 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-631b8ba2-75f0-49c7-ad8a-17c93383748f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1" status: 200 len: 1314 microversion: 2.1 time: 0.539987 Oct 30 01:43:40.902122 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2795/5582] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:43:40 2022] GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1 => generated 1314 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:43:40.921966 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-791871f5-0f9b-4c05-a15a-436a3f4d8fbc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:40.945195 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-791871f5-0f9b-4c05-a15a-436a3f4d8fbc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:40.951208 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-791871f5-0f9b-4c05-a15a-436a3f4d8fbc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:40.957177 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-791871f5-0f9b-4c05-a15a-436a3f4d8fbc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1728 microversion: 2.20 time: 1.109022 Oct 30 01:43:40.965807 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2788/5583] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:43:39 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1728 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:43:41.186872 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-67326802-20ee-4748-846f-d7a77b78bfec tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:41.187499 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-67326802-20ee-4748-846f-d7a77b78bfec tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] [instance: 7b678024-1288-425e-9985-41c2554f36c8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:41.205491 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-67326802-20ee-4748-846f-d7a77b78bfec tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:41.206314 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-67326802-20ee-4748-846f-d7a77b78bfec tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:41.207424 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-67326802-20ee-4748-846f-d7a77b78bfec tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:41.211800 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-67326802-20ee-4748-846f-d7a77b78bfec tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:41.213739 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-67326802-20ee-4748-846f-d7a77b78bfec tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:41.215749 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-67326802-20ee-4748-846f-d7a77b78bfec tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:41.432187 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=10 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:41.703929 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-bdf4f064-1bde-43b0-a43e-cc488ae3d45b req-c3c2acd7-1907-4f6f-9d5f-b3ec6f0eb584 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1", "tag": "aec2c86c-d872-42f2-b3ac-b4e746ac4585"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:43:41.715053 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-bdf4f064-1bde-43b0-a43e-cc488ae3d45b req-c3c2acd7-1907-4f6f-9d5f-b3ec6f0eb584 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:41.715788 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-bdf4f064-1bde-43b0-a43e-cc488ae3d45b req-c3c2acd7-1907-4f6f-9d5f-b3ec6f0eb584 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:41.716385 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-bdf4f064-1bde-43b0-a43e-cc488ae3d45b req-c3c2acd7-1907-4f6f-9d5f-b3ec6f0eb584 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:41.738199 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-bdf4f064-1bde-43b0-a43e-cc488ae3d45b req-c3c2acd7-1907-4f6f-9d5f-b3ec6f0eb584 service nova] Creating event network-changed:aec2c86c-d872-42f2-b3ac-b4e746ac4585 for instance 6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1 on n-h1-master-1 Oct 30 01:43:41.744089 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-bdf4f064-1bde-43b0-a43e-cc488ae3d45b req-c3c2acd7-1907-4f6f-9d5f-b3ec6f0eb584 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044907 Oct 30 01:43:41.745212 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2789/5584] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:43:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:43:41.926982 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5a0dacc9-afaa-48de-b094-3fd8e7db9379 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:41.928457 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5a0dacc9-afaa-48de-b094-3fd8e7db9379 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:41.945668 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a0dacc9-afaa-48de-b094-3fd8e7db9379 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:41.950427 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a0dacc9-afaa-48de-b094-3fd8e7db9379 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:41.951287 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a0dacc9-afaa-48de-b094-3fd8e7db9379 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:41.952353 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a0dacc9-afaa-48de-b094-3fd8e7db9379 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:41.953068 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a0dacc9-afaa-48de-b094-3fd8e7db9379 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:41.955555 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a0dacc9-afaa-48de-b094-3fd8e7db9379 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:41.993775 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-67326802-20ee-4748-846f-d7a77b78bfec tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759025c4133f4074ba59beb1a08c7a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68930ed61745eea8adfda72f3d139f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:42.007775 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-67326802-20ee-4748-846f-d7a77b78bfec tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] 10.222.0.13 "GET /compute/v2.1/servers/7b678024-1288-425e-9985-41c2554f36c8" status: 200 len: 1428 microversion: 2.1 time: 0.824688 Oct 30 01:43:42.011477 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2796/5585] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:43:41 2022] GET /compute/v2.1/servers/7b678024-1288-425e-9985-41c2554f36c8 => generated 1428 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:43:42.022107 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-46361e02-155e-4d17-b7eb-2130c486a2dc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:42.029194 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-46361e02-155e-4d17-b7eb-2130c486a2dc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:42.073847 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-46361e02-155e-4d17-b7eb-2130c486a2dc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:42.073847 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-46361e02-155e-4d17-b7eb-2130c486a2dc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:42.073847 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-46361e02-155e-4d17-b7eb-2130c486a2dc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:42.073847 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-46361e02-155e-4d17-b7eb-2130c486a2dc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:42.073847 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-46361e02-155e-4d17-b7eb-2130c486a2dc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:42.076716 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-46361e02-155e-4d17-b7eb-2130c486a2dc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:42.646955 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=14 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:42.698722 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-46361e02-155e-4d17-b7eb-2130c486a2dc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:42.708994 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-46361e02-155e-4d17-b7eb-2130c486a2dc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:42.715267 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-46361e02-155e-4d17-b7eb-2130c486a2dc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:42.720567 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-46361e02-155e-4d17-b7eb-2130c486a2dc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1715 microversion: 2.20 time: 0.707826 Oct 30 01:43:42.721811 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2797/5586] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:43:42 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1715 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:43:42.730170 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5a0dacc9-afaa-48de-b094-3fd8e7db9379 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:42.739224 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5a0dacc9-afaa-48de-b094-3fd8e7db9379 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1" status: 200 len: 1314 microversion: 2.1 time: 0.818107 Oct 30 01:43:42.750056 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2790/5587] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:43:41 2022] GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1 => generated 1314 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:43:43.039654 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-dc62ce1f-9e2b-4881-9d09-044a83352b95 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:43.040452 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-dc62ce1f-9e2b-4881-9d09-044a83352b95 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] [instance: 7b678024-1288-425e-9985-41c2554f36c8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:43.050464 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc62ce1f-9e2b-4881-9d09-044a83352b95 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:43.053633 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc62ce1f-9e2b-4881-9d09-044a83352b95 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:43.054211 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc62ce1f-9e2b-4881-9d09-044a83352b95 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:43.056452 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc62ce1f-9e2b-4881-9d09-044a83352b95 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:43.061831 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc62ce1f-9e2b-4881-9d09-044a83352b95 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:43.064159 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc62ce1f-9e2b-4881-9d09-044a83352b95 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:43.783054 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-02373b03-17c9-4daf-b20b-b7b0b2dc1e35 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:43.783054 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-02373b03-17c9-4daf-b20b-b7b0b2dc1e35 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:43.799846 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-02373b03-17c9-4daf-b20b-b7b0b2dc1e35 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:43.800501 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-02373b03-17c9-4daf-b20b-b7b0b2dc1e35 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:43.801051 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-02373b03-17c9-4daf-b20b-b7b0b2dc1e35 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:43.801915 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-02373b03-17c9-4daf-b20b-b7b0b2dc1e35 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:43.802485 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-02373b03-17c9-4daf-b20b-b7b0b2dc1e35 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:43.803021 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-02373b03-17c9-4daf-b20b-b7b0b2dc1e35 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:44.299393 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-dc62ce1f-9e2b-4881-9d09-044a83352b95 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759025c4133f4074ba59beb1a08c7a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68930ed61745eea8adfda72f3d139f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:44.327600 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-dc62ce1f-9e2b-4881-9d09-044a83352b95 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] 10.222.0.13 "GET /compute/v2.1/servers/7b678024-1288-425e-9985-41c2554f36c8" status: 200 len: 1428 microversion: 2.1 time: 1.287097 Oct 30 01:43:44.341902 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2798/5588] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:43:43 2022] GET /compute/v2.1/servers/7b678024-1288-425e-9985-41c2554f36c8 => generated 1428 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:43:44.502015 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-02373b03-17c9-4daf-b20b-b7b0b2dc1e35 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:44.514634 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-02373b03-17c9-4daf-b20b-b7b0b2dc1e35 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1" status: 200 len: 1314 microversion: 2.1 time: 0.743170 Oct 30 01:43:44.515562 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2791/5589] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:43:43 2022] GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1 => generated 1314 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:43:45.053445 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-4b6367e3-7112-47cd-9272-4f199b872ad7 req-84478b80-e172-446b-9874-12bb59007dec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b678024-1288-425e-9985-41c2554f36c8", "tag": "3781b23f-588a-4afc-a386-764a0199c6bd"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:43:45.067649 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-4b6367e3-7112-47cd-9272-4f199b872ad7 req-84478b80-e172-446b-9874-12bb59007dec service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:45.068658 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-4b6367e3-7112-47cd-9272-4f199b872ad7 req-84478b80-e172-446b-9874-12bb59007dec service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:45.069252 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-4b6367e3-7112-47cd-9272-4f199b872ad7 req-84478b80-e172-446b-9874-12bb59007dec service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:45.083786 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-4b6367e3-7112-47cd-9272-4f199b872ad7 req-84478b80-e172-446b-9874-12bb59007dec service nova] Creating event network-changed:3781b23f-588a-4afc-a386-764a0199c6bd for instance 7b678024-1288-425e-9985-41c2554f36c8 on n-h1-master-1 Oct 30 01:43:45.090257 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-4b6367e3-7112-47cd-9272-4f199b872ad7 req-84478b80-e172-446b-9874-12bb59007dec service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040483 Oct 30 01:43:45.091461 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2799/5590] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:43:45.356184 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e69f422e-58cf-4c62-ae02-1c31238795d5 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:45.356837 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e69f422e-58cf-4c62-ae02-1c31238795d5 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] [instance: 7b678024-1288-425e-9985-41c2554f36c8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:45.377997 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e69f422e-58cf-4c62-ae02-1c31238795d5 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:45.388710 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e69f422e-58cf-4c62-ae02-1c31238795d5 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:45.389177 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e69f422e-58cf-4c62-ae02-1c31238795d5 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:45.410133 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e69f422e-58cf-4c62-ae02-1c31238795d5 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:45.410695 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e69f422e-58cf-4c62-ae02-1c31238795d5 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:45.411081 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e69f422e-58cf-4c62-ae02-1c31238795d5 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:45.543326 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5bb82e50-b741-4f2c-9acd-583b53d5cf9a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:45.544568 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5bb82e50-b741-4f2c-9acd-583b53d5cf9a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:45.577482 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5bb82e50-b741-4f2c-9acd-583b53d5cf9a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:45.579854 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5bb82e50-b741-4f2c-9acd-583b53d5cf9a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:45.580602 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5bb82e50-b741-4f2c-9acd-583b53d5cf9a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:45.582211 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5bb82e50-b741-4f2c-9acd-583b53d5cf9a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:45.592295 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5bb82e50-b741-4f2c-9acd-583b53d5cf9a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:45.593834 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5bb82e50-b741-4f2c-9acd-583b53d5cf9a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:46.347696 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5bb82e50-b741-4f2c-9acd-583b53d5cf9a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:46.359990 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5bb82e50-b741-4f2c-9acd-583b53d5cf9a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1" status: 200 len: 1314 microversion: 2.1 time: 0.821953 Oct 30 01:43:46.366329 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2800/5591] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:43:45 2022] GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1 => generated 1314 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:43:46.379031 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e69f422e-58cf-4c62-ae02-1c31238795d5 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759025c4133f4074ba59beb1a08c7a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68930ed61745eea8adfda72f3d139f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:46.401754 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e69f422e-58cf-4c62-ae02-1c31238795d5 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] 10.222.0.13 "GET /compute/v2.1/servers/7b678024-1288-425e-9985-41c2554f36c8" status: 200 len: 1428 microversion: 2.1 time: 1.048615 Oct 30 01:43:46.417931 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2792/5592] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:43:45 2022] GET /compute/v2.1/servers/7b678024-1288-425e-9985-41c2554f36c8 => generated 1428 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:43:47.385553 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-90986fff-fc6d-4510-a712-63858beb13b9 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:47.386756 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-90986fff-fc6d-4510-a712-63858beb13b9 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:47.397659 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-90986fff-fc6d-4510-a712-63858beb13b9 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:47.398420 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-90986fff-fc6d-4510-a712-63858beb13b9 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:47.402930 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-90986fff-fc6d-4510-a712-63858beb13b9 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:47.405253 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-90986fff-fc6d-4510-a712-63858beb13b9 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:47.407903 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-90986fff-fc6d-4510-a712-63858beb13b9 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:47.408696 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-90986fff-fc6d-4510-a712-63858beb13b9 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:47.435441 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7fd38de7-9268-4242-af7a-75951eac4002 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:47.435441 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7fd38de7-9268-4242-af7a-75951eac4002 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] [instance: 7b678024-1288-425e-9985-41c2554f36c8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:47.452856 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7fd38de7-9268-4242-af7a-75951eac4002 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:47.456708 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7fd38de7-9268-4242-af7a-75951eac4002 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:47.459159 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7fd38de7-9268-4242-af7a-75951eac4002 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:47.461671 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7fd38de7-9268-4242-af7a-75951eac4002 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:47.465445 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7fd38de7-9268-4242-af7a-75951eac4002 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:47.470205 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7fd38de7-9268-4242-af7a-75951eac4002 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:48.106283 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-90986fff-fc6d-4510-a712-63858beb13b9 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:48.115658 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-90986fff-fc6d-4510-a712-63858beb13b9 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1" status: 200 len: 1314 microversion: 2.1 time: 0.735298 Oct 30 01:43:48.116234 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2801/5593] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:43:47 2022] GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1 => generated 1314 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:43:48.166322 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7fd38de7-9268-4242-af7a-75951eac4002 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759025c4133f4074ba59beb1a08c7a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68930ed61745eea8adfda72f3d139f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:48.174653 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7fd38de7-9268-4242-af7a-75951eac4002 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] 10.222.0.13 "GET /compute/v2.1/servers/7b678024-1288-425e-9985-41c2554f36c8" status: 200 len: 1428 microversion: 2.1 time: 0.744722 Oct 30 01:43:48.175243 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2793/5594] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:43:47 2022] GET /compute/v2.1/servers/7b678024-1288-425e-9985-41c2554f36c8 => generated 1428 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:43:49.151126 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-957c456c-b5ca-400c-a212-a081d6a5d429 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:49.155068 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-957c456c-b5ca-400c-a212-a081d6a5d429 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:49.192750 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-957c456c-b5ca-400c-a212-a081d6a5d429 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:49.197865 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-957c456c-b5ca-400c-a212-a081d6a5d429 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:49.199777 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9e2e9a00-434f-4c99-9a6e-49461d586931 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:49.200802 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9e2e9a00-434f-4c99-9a6e-49461d586931 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] [instance: 7b678024-1288-425e-9985-41c2554f36c8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:49.202736 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-957c456c-b5ca-400c-a212-a081d6a5d429 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:49.206592 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-957c456c-b5ca-400c-a212-a081d6a5d429 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:49.207498 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-957c456c-b5ca-400c-a212-a081d6a5d429 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:49.211232 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-957c456c-b5ca-400c-a212-a081d6a5d429 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:49.218611 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9e2e9a00-434f-4c99-9a6e-49461d586931 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:49.219081 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9e2e9a00-434f-4c99-9a6e-49461d586931 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:49.225668 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9e2e9a00-434f-4c99-9a6e-49461d586931 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:49.226623 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9e2e9a00-434f-4c99-9a6e-49461d586931 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:49.231556 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9e2e9a00-434f-4c99-9a6e-49461d586931 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:49.232237 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9e2e9a00-434f-4c99-9a6e-49461d586931 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:49.607815 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9e2e9a00-434f-4c99-9a6e-49461d586931 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759025c4133f4074ba59beb1a08c7a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68930ed61745eea8adfda72f3d139f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:49.617935 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9e2e9a00-434f-4c99-9a6e-49461d586931 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] 10.222.0.13 "GET /compute/v2.1/servers/7b678024-1288-425e-9985-41c2554f36c8" status: 200 len: 1428 microversion: 2.1 time: 0.422842 Oct 30 01:43:49.620375 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2794/5595] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:43:49 2022] GET /compute/v2.1/servers/7b678024-1288-425e-9985-41c2554f36c8 => generated 1428 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:43:49.748066 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-957c456c-b5ca-400c-a212-a081d6a5d429 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:49.761017 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-957c456c-b5ca-400c-a212-a081d6a5d429 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1" status: 200 len: 1314 microversion: 2.1 time: 0.621461 Oct 30 01:43:49.772603 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2802/5596] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:43:49 2022] GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1 => generated 1314 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:43:50.643748 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fae06994-7304-448e-811a-6a6972ec71da tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:50.645998 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fae06994-7304-448e-811a-6a6972ec71da tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] [instance: 7b678024-1288-425e-9985-41c2554f36c8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:50.660329 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fae06994-7304-448e-811a-6a6972ec71da tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:50.662853 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fae06994-7304-448e-811a-6a6972ec71da tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:50.664543 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fae06994-7304-448e-811a-6a6972ec71da tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:50.665526 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fae06994-7304-448e-811a-6a6972ec71da tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:50.666095 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fae06994-7304-448e-811a-6a6972ec71da tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:50.666673 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fae06994-7304-448e-811a-6a6972ec71da tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:50.791784 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a26c1779-119f-404b-875b-1222bb635b2e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:50.792979 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a26c1779-119f-404b-875b-1222bb635b2e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:50.801472 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a26c1779-119f-404b-875b-1222bb635b2e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:50.802192 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a26c1779-119f-404b-875b-1222bb635b2e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:50.803501 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a26c1779-119f-404b-875b-1222bb635b2e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:50.804974 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a26c1779-119f-404b-875b-1222bb635b2e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:50.805754 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a26c1779-119f-404b-875b-1222bb635b2e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:50.806530 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a26c1779-119f-404b-875b-1222bb635b2e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:50.859752 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-fae06994-7304-448e-811a-6a6972ec71da tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759025c4133f4074ba59beb1a08c7a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68930ed61745eea8adfda72f3d139f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:50.868188 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fae06994-7304-448e-811a-6a6972ec71da tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] 10.222.0.13 "GET /compute/v2.1/servers/7b678024-1288-425e-9985-41c2554f36c8" status: 200 len: 1428 microversion: 2.1 time: 0.228301 Oct 30 01:43:50.868861 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2795/5597] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:43:50 2022] GET /compute/v2.1/servers/7b678024-1288-425e-9985-41c2554f36c8 => generated 1428 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:43:51.349041 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-f23cbbf7-ba87-424e-a8bd-78bcce516091 req-b136b0fe-7f52-434b-b079-fc18ea23e69e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1", "name": "network-vif-plugged", "status": "completed", "tag": "aec2c86c-d872-42f2-b3ac-b4e746ac4585"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:43:51.384950 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-f23cbbf7-ba87-424e-a8bd-78bcce516091 req-b136b0fe-7f52-434b-b079-fc18ea23e69e service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:51.385932 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-f23cbbf7-ba87-424e-a8bd-78bcce516091 req-b136b0fe-7f52-434b-b079-fc18ea23e69e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:51.387092 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-f23cbbf7-ba87-424e-a8bd-78bcce516091 req-b136b0fe-7f52-434b-b079-fc18ea23e69e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:51.423859 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-f23cbbf7-ba87-424e-a8bd-78bcce516091 req-b136b0fe-7f52-434b-b079-fc18ea23e69e service nova] Creating event network-vif-plugged:aec2c86c-d872-42f2-b3ac-b4e746ac4585 for instance 6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1 on n-h1-master-1 Oct 30 01:43:51.446243 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-f23cbbf7-ba87-424e-a8bd-78bcce516091 req-b136b0fe-7f52-434b-b079-fc18ea23e69e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100956 Oct 30 01:43:51.447290 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2796/5598] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:43:51.896442 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5f6390fd-556e-4c63-95a3-96170020d97b tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:51.903589 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5f6390fd-556e-4c63-95a3-96170020d97b tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] [instance: 7b678024-1288-425e-9985-41c2554f36c8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:51.910231 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:51.927654 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f6390fd-556e-4c63-95a3-96170020d97b tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:51.929946 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f6390fd-556e-4c63-95a3-96170020d97b tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:51.931373 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f6390fd-556e-4c63-95a3-96170020d97b tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:51.932852 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f6390fd-556e-4c63-95a3-96170020d97b tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:51.934058 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f6390fd-556e-4c63-95a3-96170020d97b tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:51.935903 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f6390fd-556e-4c63-95a3-96170020d97b tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:52.067751 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a26c1779-119f-404b-875b-1222bb635b2e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:52.076755 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a26c1779-119f-404b-875b-1222bb635b2e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1" status: 200 len: 1314 microversion: 2.1 time: 1.291066 Oct 30 01:43:52.092521 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2803/5599] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:43:50 2022] GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1 => generated 1314 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:43:52.270368 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5f6390fd-556e-4c63-95a3-96170020d97b tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759025c4133f4074ba59beb1a08c7a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68930ed61745eea8adfda72f3d139f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:52.279029 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5f6390fd-556e-4c63-95a3-96170020d97b tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] 10.222.0.13 "GET /compute/v2.1/servers/7b678024-1288-425e-9985-41c2554f36c8" status: 200 len: 1428 microversion: 2.1 time: 0.387077 Oct 30 01:43:52.293883 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2797/5600] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:43:51 2022] GET /compute/v2.1/servers/7b678024-1288-425e-9985-41c2554f36c8 => generated 1428 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:43:53.113498 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b3073714-18a6-410b-9f24-2a4dce903b3a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:53.114159 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b3073714-18a6-410b-9f24-2a4dce903b3a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:53.117566 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:53.122474 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3073714-18a6-410b-9f24-2a4dce903b3a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:53.122960 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3073714-18a6-410b-9f24-2a4dce903b3a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:53.123489 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3073714-18a6-410b-9f24-2a4dce903b3a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:53.124196 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3073714-18a6-410b-9f24-2a4dce903b3a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:53.124728 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3073714-18a6-410b-9f24-2a4dce903b3a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:53.125055 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3073714-18a6-410b-9f24-2a4dce903b3a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:53.304322 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b3073714-18a6-410b-9f24-2a4dce903b3a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:53.305392 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-61bd7d67-a3a3-40fd-9880-d21baae18d56 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:53.306018 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-61bd7d67-a3a3-40fd-9880-d21baae18d56 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] [instance: 7b678024-1288-425e-9985-41c2554f36c8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:53.314204 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-61bd7d67-a3a3-40fd-9880-d21baae18d56 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:53.314468 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-61bd7d67-a3a3-40fd-9880-d21baae18d56 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:53.314900 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-61bd7d67-a3a3-40fd-9880-d21baae18d56 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:53.316395 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b3073714-18a6-410b-9f24-2a4dce903b3a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1" status: 200 len: 1314 microversion: 2.1 time: 0.206949 Oct 30 01:43:53.317849 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2804/5601] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:43:53 2022] GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:43:53.322557 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-61bd7d67-a3a3-40fd-9880-d21baae18d56 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:53.323052 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-61bd7d67-a3a3-40fd-9880-d21baae18d56 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:53.325514 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-61bd7d67-a3a3-40fd-9880-d21baae18d56 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:53.502020 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-c3665beb-8508-47ef-985f-2d16df52fadb req-3d51dd53-3836-4fba-aff3-7f397ea3bbce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b678024-1288-425e-9985-41c2554f36c8", "name": "network-vif-plugged", "status": "completed", "tag": "3781b23f-588a-4afc-a386-764a0199c6bd"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:43:53.514873 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-c3665beb-8508-47ef-985f-2d16df52fadb req-3d51dd53-3836-4fba-aff3-7f397ea3bbce service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:53.515371 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-c3665beb-8508-47ef-985f-2d16df52fadb req-3d51dd53-3836-4fba-aff3-7f397ea3bbce service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:53.515952 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-c3665beb-8508-47ef-985f-2d16df52fadb req-3d51dd53-3836-4fba-aff3-7f397ea3bbce service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:53.528928 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-c3665beb-8508-47ef-985f-2d16df52fadb req-3d51dd53-3836-4fba-aff3-7f397ea3bbce service nova] Creating event network-vif-plugged:3781b23f-588a-4afc-a386-764a0199c6bd for instance 7b678024-1288-425e-9985-41c2554f36c8 on n-h1-master-1 Oct 30 01:43:53.529101 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-61bd7d67-a3a3-40fd-9880-d21baae18d56 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759025c4133f4074ba59beb1a08c7a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68930ed61745eea8adfda72f3d139f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:53.535085 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-c3665beb-8508-47ef-985f-2d16df52fadb req-3d51dd53-3836-4fba-aff3-7f397ea3bbce service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036652 Oct 30 01:43:53.535823 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2805/5602] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:43:53.549509 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-61bd7d67-a3a3-40fd-9880-d21baae18d56 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] 10.222.0.13 "GET /compute/v2.1/servers/7b678024-1288-425e-9985-41c2554f36c8" status: 200 len: 1428 microversion: 2.1 time: 0.247730 Oct 30 01:43:53.560617 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2798/5603] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:43:53 2022] GET /compute/v2.1/servers/7b678024-1288-425e-9985-41c2554f36c8 => generated 1428 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:43:54.342084 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-268b0d62-5f25-44c4-997a-83f7cf2808f0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:54.342823 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-268b0d62-5f25-44c4-997a-83f7cf2808f0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:54.350825 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-268b0d62-5f25-44c4-997a-83f7cf2808f0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:54.351589 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-268b0d62-5f25-44c4-997a-83f7cf2808f0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:54.352033 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-268b0d62-5f25-44c4-997a-83f7cf2808f0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:54.352866 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-268b0d62-5f25-44c4-997a-83f7cf2808f0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:54.353431 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-268b0d62-5f25-44c4-997a-83f7cf2808f0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:54.353786 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-268b0d62-5f25-44c4-997a-83f7cf2808f0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:54.505549 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-268b0d62-5f25-44c4-997a-83f7cf2808f0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:54.518432 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-268b0d62-5f25-44c4-997a-83f7cf2808f0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1" status: 200 len: 1501 microversion: 2.1 time: 0.181622 Oct 30 01:43:54.520090 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2806/5604] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:43:54 2022] GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1 => generated 1501 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:43:54.545521 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b6919d1b-a486-438b-b975-f853cbdcb939 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:43:54.557049 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b6919d1b-a486-438b-b975-f853cbdcb939 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:54.557570 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b6919d1b-a486-438b-b975-f853cbdcb939 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:54.558044 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b6919d1b-a486-438b-b975-f853cbdcb939 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:54.562607 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:54.576114 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fb90138e-34af-4166-be37-56fcdbcae4c6 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:54.576891 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-fb90138e-34af-4166-be37-56fcdbcae4c6 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] [instance: 7b678024-1288-425e-9985-41c2554f36c8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:54.585077 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fb90138e-34af-4166-be37-56fcdbcae4c6 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:54.586379 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fb90138e-34af-4166-be37-56fcdbcae4c6 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:54.589102 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fb90138e-34af-4166-be37-56fcdbcae4c6 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:54.589897 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b6919d1b-a486-438b-b975-f853cbdcb939 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1] Going to try to stop instance {{(pid=121102) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 30 01:43:54.590001 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fb90138e-34af-4166-be37-56fcdbcae4c6 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:54.590001 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fb90138e-34af-4166-be37-56fcdbcae4c6 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:54.590001 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fb90138e-34af-4166-be37-56fcdbcae4c6 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:54.752515 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-fb90138e-34af-4166-be37-56fcdbcae4c6 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759025c4133f4074ba59beb1a08c7a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68930ed61745eea8adfda72f3d139f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:54.761525 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fb90138e-34af-4166-be37-56fcdbcae4c6 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] 10.222.0.13 "GET /compute/v2.1/servers/7b678024-1288-425e-9985-41c2554f36c8" status: 200 len: 1428 microversion: 2.1 time: 0.190217 Oct 30 01:43:54.762317 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2807/5605] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:43:54 2022] GET /compute/v2.1/servers/7b678024-1288-425e-9985-41c2554f36c8 => generated 1428 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:43:54.819028 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b6919d1b-a486-438b-b975-f853cbdcb939 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "POST /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1/action" status: 202 len: 0 microversion: 2.1 time: 0.279704 Oct 30 01:43:54.820083 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2799/5606] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:43:54 2022] POST /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:43:54.828442 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f14ab9de-b330-4a91-a55f-b827810f841b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:54.829163 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f14ab9de-b330-4a91-a55f-b827810f841b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:54.837726 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f14ab9de-b330-4a91-a55f-b827810f841b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:54.840602 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f14ab9de-b330-4a91-a55f-b827810f841b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:54.844971 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f14ab9de-b330-4a91-a55f-b827810f841b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:54.844971 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f14ab9de-b330-4a91-a55f-b827810f841b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:54.844971 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f14ab9de-b330-4a91-a55f-b827810f841b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:54.845459 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f14ab9de-b330-4a91-a55f-b827810f841b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:55.019964 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f14ab9de-b330-4a91-a55f-b827810f841b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:55.028783 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f14ab9de-b330-4a91-a55f-b827810f841b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1" status: 200 len: 1511 microversion: 2.1 time: 0.204221 Oct 30 01:43:55.033495 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2808/5607] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:43:54 2022] GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1 => generated 1511 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:43:55.789572 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0aac29e5-08df-4cdf-af91-d2fbad97c637 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:55.790579 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0aac29e5-08df-4cdf-af91-d2fbad97c637 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] [instance: 7b678024-1288-425e-9985-41c2554f36c8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:55.803288 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0aac29e5-08df-4cdf-af91-d2fbad97c637 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:55.803785 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0aac29e5-08df-4cdf-af91-d2fbad97c637 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:55.804222 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0aac29e5-08df-4cdf-af91-d2fbad97c637 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:55.804977 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0aac29e5-08df-4cdf-af91-d2fbad97c637 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:55.805522 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0aac29e5-08df-4cdf-af91-d2fbad97c637 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:55.805953 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0aac29e5-08df-4cdf-af91-d2fbad97c637 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:55.963701 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0aac29e5-08df-4cdf-af91-d2fbad97c637 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759025c4133f4074ba59beb1a08c7a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68930ed61745eea8adfda72f3d139f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:55.972630 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0aac29e5-08df-4cdf-af91-d2fbad97c637 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] 10.222.0.13 "GET /compute/v2.1/servers/7b678024-1288-425e-9985-41c2554f36c8" status: 200 len: 1608 microversion: 2.1 time: 0.189738 Oct 30 01:43:55.977141 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2800/5608] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:43:55 2022] GET /compute/v2.1/servers/7b678024-1288-425e-9985-41c2554f36c8 => generated 1608 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:43:55.999052 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4ec5c139-ca1f-4d65-be2b-2fb3a41ec69f tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:55.999669 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4ec5c139-ca1f-4d65-be2b-2fb3a41ec69f tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] [instance: 7b678024-1288-425e-9985-41c2554f36c8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:56.006873 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4ec5c139-ca1f-4d65-be2b-2fb3a41ec69f tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:56.007567 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4ec5c139-ca1f-4d65-be2b-2fb3a41ec69f tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:56.008477 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4ec5c139-ca1f-4d65-be2b-2fb3a41ec69f tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:56.009391 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4ec5c139-ca1f-4d65-be2b-2fb3a41ec69f tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:56.010148 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4ec5c139-ca1f-4d65-be2b-2fb3a41ec69f tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:56.011568 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4ec5c139-ca1f-4d65-be2b-2fb3a41ec69f tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:56.061663 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-34b43ff9-3403-4e5a-ab40-3d6cebbcf6db tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:56.062503 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-34b43ff9-3403-4e5a-ab40-3d6cebbcf6db tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:56.076578 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-34b43ff9-3403-4e5a-ab40-3d6cebbcf6db tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:56.087820 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-34b43ff9-3403-4e5a-ab40-3d6cebbcf6db tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:56.087820 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-34b43ff9-3403-4e5a-ab40-3d6cebbcf6db tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:56.087820 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-34b43ff9-3403-4e5a-ab40-3d6cebbcf6db tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:56.087820 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-34b43ff9-3403-4e5a-ab40-3d6cebbcf6db tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:56.087820 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-34b43ff9-3403-4e5a-ab40-3d6cebbcf6db tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:56.353912 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-34b43ff9-3403-4e5a-ab40-3d6cebbcf6db tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:56.363865 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-34b43ff9-3403-4e5a-ab40-3d6cebbcf6db tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1" status: 200 len: 1511 microversion: 2.1 time: 0.313306 Oct 30 01:43:56.368253 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2801/5609] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:43:56 2022] GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1 => generated 1511 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:43:56.413143 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4ec5c139-ca1f-4d65-be2b-2fb3a41ec69f tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759025c4133f4074ba59beb1a08c7a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68930ed61745eea8adfda72f3d139f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:56.425650 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4ec5c139-ca1f-4d65-be2b-2fb3a41ec69f tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] 10.222.0.13 "GET /compute/v2.1/servers/7b678024-1288-425e-9985-41c2554f36c8" status: 200 len: 1608 microversion: 2.1 time: 0.431231 Oct 30 01:43:56.428894 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2809/5610] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:43:55 2022] GET /compute/v2.1/servers/7b678024-1288-425e-9985-41c2554f36c8 => generated 1608 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:43:56.451110 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-56b8a5c6-78a3-450c-86d5-b73407cb8811 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:56.451936 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-56b8a5c6-78a3-450c-86d5-b73407cb8811 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] [instance: 7b678024-1288-425e-9985-41c2554f36c8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:56.458679 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-56b8a5c6-78a3-450c-86d5-b73407cb8811 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:56.459320 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-56b8a5c6-78a3-450c-86d5-b73407cb8811 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:56.459906 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-56b8a5c6-78a3-450c-86d5-b73407cb8811 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:56.464185 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-56b8a5c6-78a3-450c-86d5-b73407cb8811 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:56.464185 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-56b8a5c6-78a3-450c-86d5-b73407cb8811 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:56.464185 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-56b8a5c6-78a3-450c-86d5-b73407cb8811 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:56.672685 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-56b8a5c6-78a3-450c-86d5-b73407cb8811 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759025c4133f4074ba59beb1a08c7a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68930ed61745eea8adfda72f3d139f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:56.684055 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-56b8a5c6-78a3-450c-86d5-b73407cb8811 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] 10.222.0.13 "GET /compute/v2.1/servers/7b678024-1288-425e-9985-41c2554f36c8" status: 200 len: 1608 microversion: 2.1 time: 0.236695 Oct 30 01:43:56.685386 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2802/5611] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:43:56 2022] GET /compute/v2.1/servers/7b678024-1288-425e-9985-41c2554f36c8 => generated 1608 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:43:57.396110 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9853b947-28d3-4ceb-ba21-ff1f9b4abbb5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:57.396935 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9853b947-28d3-4ceb-ba21-ff1f9b4abbb5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:57.407398 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9853b947-28d3-4ceb-ba21-ff1f9b4abbb5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:57.408560 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9853b947-28d3-4ceb-ba21-ff1f9b4abbb5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:57.409314 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9853b947-28d3-4ceb-ba21-ff1f9b4abbb5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:57.410266 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9853b947-28d3-4ceb-ba21-ff1f9b4abbb5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:57.425547 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9853b947-28d3-4ceb-ba21-ff1f9b4abbb5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:57.427485 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9853b947-28d3-4ceb-ba21-ff1f9b4abbb5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:57.798623 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9853b947-28d3-4ceb-ba21-ff1f9b4abbb5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:57.810408 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9853b947-28d3-4ceb-ba21-ff1f9b4abbb5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1" status: 200 len: 1511 microversion: 2.1 time: 0.419838 Oct 30 01:43:57.826007 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2810/5612] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:43:57 2022] GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1 => generated 1511 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:43:58.840398 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a01eab99-3fe4-4f99-8453-388769abf01f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:43:58.841028 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a01eab99-3fe4-4f99-8453-388769abf01f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:43:58.855158 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a01eab99-3fe4-4f99-8453-388769abf01f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:58.861024 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a01eab99-3fe4-4f99-8453-388769abf01f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:58.861514 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a01eab99-3fe4-4f99-8453-388769abf01f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:58.862276 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a01eab99-3fe4-4f99-8453-388769abf01f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:43:58.862732 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a01eab99-3fe4-4f99-8453-388769abf01f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:43:58.863173 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a01eab99-3fe4-4f99-8453-388769abf01f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:43:59.237201 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a01eab99-3fe4-4f99-8453-388769abf01f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:43:59.255216 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a01eab99-3fe4-4f99-8453-388769abf01f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1" status: 200 len: 1511 microversion: 2.1 time: 0.419190 Oct 30 01:43:59.257842 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2803/5613] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:43:58 2022] GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1 => generated 1511 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:00.280754 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-25ff4611-bcbd-46fe-b227-78b30638ce26 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:00.281818 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-25ff4611-bcbd-46fe-b227-78b30638ce26 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:00.288680 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-25ff4611-bcbd-46fe-b227-78b30638ce26 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:00.290897 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-25ff4611-bcbd-46fe-b227-78b30638ce26 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:00.294357 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-25ff4611-bcbd-46fe-b227-78b30638ce26 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:00.295490 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-25ff4611-bcbd-46fe-b227-78b30638ce26 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:00.296098 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-25ff4611-bcbd-46fe-b227-78b30638ce26 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:00.296651 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-25ff4611-bcbd-46fe-b227-78b30638ce26 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:00.533419 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-25ff4611-bcbd-46fe-b227-78b30638ce26 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:00.551888 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-25ff4611-bcbd-46fe-b227-78b30638ce26 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1" status: 200 len: 1511 microversion: 2.1 time: 0.275717 Oct 30 01:44:00.556525 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2811/5614] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:00 2022] GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1 => generated 1511 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:00.880100 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-2ff68872-20c5-4fa1-92b1-3d00a44a96df req-71bec578-d1a0-490b-9b62-d347f29325a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b678024-1288-425e-9985-41c2554f36c8", "tag": "3781b23f-588a-4afc-a386-764a0199c6bd"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:44:00.925778 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-2ff68872-20c5-4fa1-92b1-3d00a44a96df req-71bec578-d1a0-490b-9b62-d347f29325a1 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:00.926644 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-2ff68872-20c5-4fa1-92b1-3d00a44a96df req-71bec578-d1a0-490b-9b62-d347f29325a1 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:00.927322 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-2ff68872-20c5-4fa1-92b1-3d00a44a96df req-71bec578-d1a0-490b-9b62-d347f29325a1 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:00.946916 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-2ff68872-20c5-4fa1-92b1-3d00a44a96df req-71bec578-d1a0-490b-9b62-d347f29325a1 service nova] Creating event network-changed:3781b23f-588a-4afc-a386-764a0199c6bd for instance 7b678024-1288-425e-9985-41c2554f36c8 on n-h1-master-1 Oct 30 01:44:00.954692 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-2ff68872-20c5-4fa1-92b1-3d00a44a96df req-71bec578-d1a0-490b-9b62-d347f29325a1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084301 Oct 30 01:44:00.957179 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2804/5615] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:44:01.003340 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6df9c780-b016-4389-bf1d-d987ef92eafb tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-752459539", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:44:01.161209 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-6df9c780-b016-4389-bf1d-d987ef92eafb tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] validate_networks() for None {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:44:01.584388 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2698bc3b-8d36-4292-8c15-188a5cbd5451 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:01.585827 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2698bc3b-8d36-4292-8c15-188a5cbd5451 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:01.599932 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2698bc3b-8d36-4292-8c15-188a5cbd5451 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:01.601138 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2698bc3b-8d36-4292-8c15-188a5cbd5451 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:01.602289 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2698bc3b-8d36-4292-8c15-188a5cbd5451 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:01.603984 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2698bc3b-8d36-4292-8c15-188a5cbd5451 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:01.605620 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2698bc3b-8d36-4292-8c15-188a5cbd5451 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:01.606129 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2698bc3b-8d36-4292-8c15-188a5cbd5451 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:01.710048 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-6df9c780-b016-4389-bf1d-d987ef92eafb tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:44:01.711010 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-6df9c780-b016-4389-bf1d-d987ef92eafb tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:44:01.711710 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-6df9c780-b016-4389-bf1d-d987ef92eafb tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:44:01.712261 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-6df9c780-b016-4389-bf1d-d987ef92eafb tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:44:01.713145 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-6df9c780-b016-4389-bf1d-d987ef92eafb tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:44:01.735298 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6df9c780-b016-4389-bf1d-d987ef92eafb tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:01.735298 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6df9c780-b016-4389-bf1d-d987ef92eafb tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:01.735298 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6df9c780-b016-4389-bf1d-d987ef92eafb tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:01.743340 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6df9c780-b016-4389-bf1d-d987ef92eafb tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:01.746801 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6df9c780-b016-4389-bf1d-d987ef92eafb tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:01.747848 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6df9c780-b016-4389-bf1d-d987ef92eafb tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:01.803989 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-6df9c780-b016-4389-bf1d-d987ef92eafb tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Getting quotas for project c1735a8d4dc541c7993bcf8a4f34dda8. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:44:01.821065 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-6df9c780-b016-4389-bf1d-d987ef92eafb tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Getting quotas for user f7e0dceb70ee44978260397d3c196dc2 and project c1735a8d4dc541c7993bcf8a4f34dda8. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:44:01.860088 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6df9c780-b016-4389-bf1d-d987ef92eafb tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:44:01.868487 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6df9c780-b016-4389-bf1d-d987ef92eafb tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] [instance: 0843d451-4ade-4a76-9a8a-a803182d73f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:44:01.922982 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2698bc3b-8d36-4292-8c15-188a5cbd5451 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:01.942818 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2698bc3b-8d36-4292-8c15-188a5cbd5451 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1" status: 200 len: 1511 microversion: 2.1 time: 0.361765 Oct 30 01:44:01.953405 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2805/5616] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:01 2022] GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1 => generated 1511 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:44:02.091435 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6df9c780-b016-4389-bf1d-d987ef92eafb tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.100929 Oct 30 01:44:02.100587 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2812/5617] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:44:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1106 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:44:02.103141 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-190d78a8-2c23-4650-872e-739ea56c7801 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:02.103721 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-190d78a8-2c23-4650-872e-739ea56c7801 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] [instance: 0843d451-4ade-4a76-9a8a-a803182d73f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:02.229208 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-190d78a8-2c23-4650-872e-739ea56c7801 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e0dceb70ee44978260397d3c196dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1735a8d4dc541c7993bcf8a4f34dda8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:02.243503 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-190d78a8-2c23-4650-872e-739ea56c7801 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] 10.222.0.13 "GET /compute/v2.1/servers/0843d451-4ade-4a76-9a8a-a803182d73f9" status: 200 len: 1214 microversion: 2.1 time: 0.139437 Oct 30 01:44:02.243503 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2806/5618] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:02 2022] GET /compute/v2.1/servers/0843d451-4ade-4a76-9a8a-a803182d73f9 => generated 1214 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:02.998101 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7d86b70a-6d05-4000-8be8-3fec4fb44a0c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:03.010166 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7d86b70a-6d05-4000-8be8-3fec4fb44a0c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:03.029778 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7d86b70a-6d05-4000-8be8-3fec4fb44a0c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:03.031697 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7d86b70a-6d05-4000-8be8-3fec4fb44a0c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:03.036247 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7d86b70a-6d05-4000-8be8-3fec4fb44a0c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:03.039407 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7d86b70a-6d05-4000-8be8-3fec4fb44a0c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:03.040983 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7d86b70a-6d05-4000-8be8-3fec4fb44a0c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:03.041955 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7d86b70a-6d05-4000-8be8-3fec4fb44a0c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:03.270780 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5499624b-05a1-40fd-b691-95b2236958fb tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:03.272092 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5499624b-05a1-40fd-b691-95b2236958fb tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] [instance: 0843d451-4ade-4a76-9a8a-a803182d73f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:03.332010 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7d86b70a-6d05-4000-8be8-3fec4fb44a0c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:03.343546 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7d86b70a-6d05-4000-8be8-3fec4fb44a0c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1" status: 200 len: 1511 microversion: 2.1 time: 0.377185 Oct 30 01:44:03.346879 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2813/5619] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:02 2022] GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1 => generated 1511 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:03.363414 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5499624b-05a1-40fd-b691-95b2236958fb tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e0dceb70ee44978260397d3c196dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1735a8d4dc541c7993bcf8a4f34dda8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:03.371775 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5499624b-05a1-40fd-b691-95b2236958fb tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] 10.222.0.13 "GET /compute/v2.1/servers/0843d451-4ade-4a76-9a8a-a803182d73f9" status: 200 len: 1214 microversion: 2.1 time: 0.107534 Oct 30 01:44:03.375609 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2807/5620] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:03 2022] GET /compute/v2.1/servers/0843d451-4ade-4a76-9a8a-a803182d73f9 => generated 1214 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:04.368560 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6d0df76b-9f77-4902-9afb-6a1e6ab72f7d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:04.369289 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6d0df76b-9f77-4902-9afb-6a1e6ab72f7d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:04.379000 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6d0df76b-9f77-4902-9afb-6a1e6ab72f7d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:04.382124 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6d0df76b-9f77-4902-9afb-6a1e6ab72f7d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:04.384130 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6d0df76b-9f77-4902-9afb-6a1e6ab72f7d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:04.384964 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6d0df76b-9f77-4902-9afb-6a1e6ab72f7d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:04.387283 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6d0df76b-9f77-4902-9afb-6a1e6ab72f7d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:04.387962 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6d0df76b-9f77-4902-9afb-6a1e6ab72f7d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:04.397463 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7e20ddd1-2887-48ac-bdd6-b3077705332d tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:04.398176 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7e20ddd1-2887-48ac-bdd6-b3077705332d tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] [instance: 0843d451-4ade-4a76-9a8a-a803182d73f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:04.410255 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e20ddd1-2887-48ac-bdd6-b3077705332d tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:04.410749 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e20ddd1-2887-48ac-bdd6-b3077705332d tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:04.411189 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e20ddd1-2887-48ac-bdd6-b3077705332d tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:04.411899 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e20ddd1-2887-48ac-bdd6-b3077705332d tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:04.412350 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e20ddd1-2887-48ac-bdd6-b3077705332d tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:04.413406 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e20ddd1-2887-48ac-bdd6-b3077705332d tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:04.429067 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=100 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:04.591241 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7e20ddd1-2887-48ac-bdd6-b3077705332d tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e0dceb70ee44978260397d3c196dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1735a8d4dc541c7993bcf8a4f34dda8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:04.612440 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7e20ddd1-2887-48ac-bdd6-b3077705332d tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] 10.222.0.13 "GET /compute/v2.1/servers/0843d451-4ade-4a76-9a8a-a803182d73f9" status: 200 len: 1210 microversion: 2.1 time: 0.218248 Oct 30 01:44:04.629899 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2808/5621] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:04 2022] GET /compute/v2.1/servers/0843d451-4ade-4a76-9a8a-a803182d73f9 => generated 1210 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:44:04.865236 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6d0df76b-9f77-4902-9afb-6a1e6ab72f7d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:04.880198 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6d0df76b-9f77-4902-9afb-6a1e6ab72f7d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1" status: 200 len: 1511 microversion: 2.1 time: 0.516169 Oct 30 01:44:04.880797 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2814/5622] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:04 2022] GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1 => generated 1511 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:05.191163 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7be61113-9568-4f94-ae01-7ced7fdc51ff tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Action: 'create', calling method: .version_select at 0x7f44c7348040>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-2008586975", "policies": ["affinity"]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:44:05.227644 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-7be61113-9568-4f94-ae01-7ced7fdc51ff tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Getting quotas for project 15a1dab1c45d4be9946ec98786f36b5f. Resources: {'server_groups'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:44:05.240683 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-7be61113-9568-4f94-ae01-7ced7fdc51ff tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Getting quotas for user 23ccf9b5810f4c1a8d95e70e15624a43 and project 15a1dab1c45d4be9946ec98786f36b5f. Resources: {'server_groups'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:44:05.476772 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-7be61113-9568-4f94-ae01-7ced7fdc51ff tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Getting quotas for project 15a1dab1c45d4be9946ec98786f36b5f. Resources: {'server_groups'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:44:05.484984 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-7be61113-9568-4f94-ae01-7ced7fdc51ff tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Getting quotas for user 23ccf9b5810f4c1a8d95e70e15624a43 and project 15a1dab1c45d4be9946ec98786f36b5f. Resources: {'server_groups'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:44:05.508892 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7be61113-9568-4f94-ae01-7ced7fdc51ff tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] 10.222.0.13 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.488615 Oct 30 01:44:05.511901 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2809/5623] 10.222.0.13 () {60 vars in 1174 bytes} [Sun Oct 30 01:44:05 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:44:05.528538 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fcedde4a-0a7f-48d5-9f2b-1d039fc248f6 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Action: 'create', calling method: .version_select at 0x7f44c73078b0>, body: {"server_group": {"name": "tempest-server-group-1046606072", "policies": ["affinity"]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:44:05.584203 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-fcedde4a-0a7f-48d5-9f2b-1d039fc248f6 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Getting quotas for project 15a1dab1c45d4be9946ec98786f36b5f. Resources: {'server_groups'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:44:05.600540 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-fcedde4a-0a7f-48d5-9f2b-1d039fc248f6 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Getting quotas for user 23ccf9b5810f4c1a8d95e70e15624a43 and project 15a1dab1c45d4be9946ec98786f36b5f. Resources: {'server_groups'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:44:05.641816 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1b7f4787-3c57-4640-a85d-f4a43b2cfb62 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:05.642364 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1b7f4787-3c57-4640-a85d-f4a43b2cfb62 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] [instance: 0843d451-4ade-4a76-9a8a-a803182d73f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:05.648604 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1b7f4787-3c57-4640-a85d-f4a43b2cfb62 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:05.649115 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1b7f4787-3c57-4640-a85d-f4a43b2cfb62 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:05.649589 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1b7f4787-3c57-4640-a85d-f4a43b2cfb62 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:05.650310 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1b7f4787-3c57-4640-a85d-f4a43b2cfb62 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:05.650771 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1b7f4787-3c57-4640-a85d-f4a43b2cfb62 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:05.657673 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1b7f4787-3c57-4640-a85d-f4a43b2cfb62 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:05.770564 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1b7f4787-3c57-4640-a85d-f4a43b2cfb62 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e0dceb70ee44978260397d3c196dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1735a8d4dc541c7993bcf8a4f34dda8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:05.805326 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1b7f4787-3c57-4640-a85d-f4a43b2cfb62 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] 10.222.0.13 "GET /compute/v2.1/servers/0843d451-4ade-4a76-9a8a-a803182d73f9" status: 200 len: 1274 microversion: 2.1 time: 0.167322 Oct 30 01:44:05.807773 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2810/5624] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:05 2022] GET /compute/v2.1/servers/0843d451-4ade-4a76-9a8a-a803182d73f9 => generated 1274 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:05.828352 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-fcedde4a-0a7f-48d5-9f2b-1d039fc248f6 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Getting quotas for project 15a1dab1c45d4be9946ec98786f36b5f. Resources: {'server_groups'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:44:05.842067 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-fcedde4a-0a7f-48d5-9f2b-1d039fc248f6 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Getting quotas for user 23ccf9b5810f4c1a8d95e70e15624a43 and project 15a1dab1c45d4be9946ec98786f36b5f. Resources: {'server_groups'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:44:05.871754 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fcedde4a-0a7f-48d5-9f2b-1d039fc248f6 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] 10.222.0.13 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.349768 Oct 30 01:44:05.873092 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2815/5625] 10.222.0.13 () {60 vars in 1173 bytes} [Sun Oct 30 01:44:05 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:44:05.884643 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-789683ca-effc-4b72-95a4-a18456e6c9b1 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Action: 'create', calling method: .version_select at 0x7f44c6eac160>, body: {"server_group": {"name": "tempest-server-group-1046606072", "policies": ["affinity"]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:44:05.939728 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-42c669de-e7b6-4e1d-bb2b-f5f44cb0e9cf tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:05.939728 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-42c669de-e7b6-4e1d-bb2b-f5f44cb0e9cf tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:05.939728 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42c669de-e7b6-4e1d-bb2b-f5f44cb0e9cf tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:05.939728 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42c669de-e7b6-4e1d-bb2b-f5f44cb0e9cf tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:05.939728 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42c669de-e7b6-4e1d-bb2b-f5f44cb0e9cf tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:05.939728 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42c669de-e7b6-4e1d-bb2b-f5f44cb0e9cf tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:05.939728 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42c669de-e7b6-4e1d-bb2b-f5f44cb0e9cf tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:05.940504 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-789683ca-effc-4b72-95a4-a18456e6c9b1 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Getting quotas for project 15a1dab1c45d4be9946ec98786f36b5f. Resources: {'server_groups'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:44:05.942688 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42c669de-e7b6-4e1d-bb2b-f5f44cb0e9cf tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:05.954209 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-789683ca-effc-4b72-95a4-a18456e6c9b1 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Getting quotas for user 23ccf9b5810f4c1a8d95e70e15624a43 and project 15a1dab1c45d4be9946ec98786f36b5f. Resources: {'server_groups'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:44:06.128211 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-42c669de-e7b6-4e1d-bb2b-f5f44cb0e9cf tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:06.138300 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-42c669de-e7b6-4e1d-bb2b-f5f44cb0e9cf tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1" status: 200 len: 1511 microversion: 2.1 time: 0.234858 Oct 30 01:44:06.142177 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2816/5626] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:05 2022] GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1 => generated 1511 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:44:06.259724 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-789683ca-effc-4b72-95a4-a18456e6c9b1 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Getting quotas for project 15a1dab1c45d4be9946ec98786f36b5f. Resources: {'server_groups'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:44:06.266809 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-789683ca-effc-4b72-95a4-a18456e6c9b1 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Getting quotas for user 23ccf9b5810f4c1a8d95e70e15624a43 and project 15a1dab1c45d4be9946ec98786f36b5f. Resources: {'server_groups'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:44:06.281826 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-789683ca-effc-4b72-95a4-a18456e6c9b1 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] 10.222.0.13 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.401223 Oct 30 01:44:06.282980 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2811/5627] 10.222.0.13 () {60 vars in 1173 bytes} [Sun Oct 30 01:44:05 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:44:06.296492 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-29e37bae-bd87-48d4-8eee-356f05ffa725 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:06.443616 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-29e37bae-bd87-48d4-8eee-356f05ffa725 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/a1d8f67f-5e0a-4875-8436-519612c41750" status: 204 len: 0 microversion: 2.1 time: 0.153398 Oct 30 01:44:06.445786 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2817/5628] 10.222.0.13 () {58 vars in 1266 bytes} [Sun Oct 30 01:44:06 2022] DELETE /compute/v2.1/os-server-groups/a1d8f67f-5e0a-4875-8436-519612c41750 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:44:06.454106 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-38de3d0e-a78b-4e8d-ba93-a386f88d6b72 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:06.471625 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-38de3d0e-a78b-4e8d-ba93-a386f88d6b72 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] 10.222.0.13 "GET /compute/v2.1/os-server-groups" status: 200 len: 335 microversion: 2.1 time: 0.021319 Oct 30 01:44:06.472511 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2812/5629] 10.222.0.13 () {58 vars in 1152 bytes} [Sun Oct 30 01:44:06 2022] GET /compute/v2.1/os-server-groups => generated 335 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:44:06.484533 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3407abfe-21c3-458c-ae2d-4ab0d8df12ba tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:06.639430 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3407abfe-21c3-458c-ae2d-4ab0d8df12ba tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/c3fc1297-16b9-4271-b2f5-6ea55e7083af" status: 204 len: 0 microversion: 2.1 time: 0.159420 Oct 30 01:44:06.641012 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2818/5630] 10.222.0.13 () {58 vars in 1266 bytes} [Sun Oct 30 01:44:06 2022] DELETE /compute/v2.1/os-server-groups/c3fc1297-16b9-4271-b2f5-6ea55e7083af => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:44:06.651176 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-eab07346-1337-42cc-96f9-b288c88a187f tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:06.670395 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-eab07346-1337-42cc-96f9-b288c88a187f tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] 10.222.0.13 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.023501 Oct 30 01:44:06.670992 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2813/5631] 10.222.0.13 () {58 vars in 1152 bytes} [Sun Oct 30 01:44:06 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:44:06.685925 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-76b34b08-ab0a-4816-8993-e07627e010db tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Action: 'create', calling method: .version_select at 0x7f44c6e15dc0>, body: {"server_group": {"name": "tempest-server-group-1120933020", "policies": ["affinity"]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:44:06.717637 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-76b34b08-ab0a-4816-8993-e07627e010db tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Getting quotas for project 15a1dab1c45d4be9946ec98786f36b5f. Resources: {'server_groups'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:44:06.724048 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-76b34b08-ab0a-4816-8993-e07627e010db tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Getting quotas for user 23ccf9b5810f4c1a8d95e70e15624a43 and project 15a1dab1c45d4be9946ec98786f36b5f. Resources: {'server_groups'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:44:06.836711 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ad1efbcc-2799-4816-b016-47c49a3754e0 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:06.837427 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ad1efbcc-2799-4816-b016-47c49a3754e0 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] [instance: 0843d451-4ade-4a76-9a8a-a803182d73f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:06.861901 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ad1efbcc-2799-4816-b016-47c49a3754e0 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:06.862984 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ad1efbcc-2799-4816-b016-47c49a3754e0 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:06.863808 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ad1efbcc-2799-4816-b016-47c49a3754e0 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:06.864875 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ad1efbcc-2799-4816-b016-47c49a3754e0 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:06.865797 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ad1efbcc-2799-4816-b016-47c49a3754e0 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:06.866574 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ad1efbcc-2799-4816-b016-47c49a3754e0 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:06.881778 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=7,nova_api:DELETE=6 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:06.895483 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-76b34b08-ab0a-4816-8993-e07627e010db tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Getting quotas for project 15a1dab1c45d4be9946ec98786f36b5f. Resources: {'server_groups'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:44:06.905855 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-76b34b08-ab0a-4816-8993-e07627e010db tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Getting quotas for user 23ccf9b5810f4c1a8d95e70e15624a43 and project 15a1dab1c45d4be9946ec98786f36b5f. Resources: {'server_groups'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:44:06.923341 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-76b34b08-ab0a-4816-8993-e07627e010db tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] 10.222.0.13 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.242252 Oct 30 01:44:06.924340 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2819/5632] 10.222.0.13 () {60 vars in 1173 bytes} [Sun Oct 30 01:44:06 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:44:06.936624 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-db7973da-c6ec-442f-9ea2-07548a549fa2 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:07.078170 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-db7973da-c6ec-442f-9ea2-07548a549fa2 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/6a6cf7bb-da00-4185-b444-43dd508762e3" status: 204 len: 0 microversion: 2.1 time: 0.146579 Oct 30 01:44:07.078865 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2820/5633] 10.222.0.13 () {58 vars in 1266 bytes} [Sun Oct 30 01:44:06 2022] DELETE /compute/v2.1/os-server-groups/6a6cf7bb-da00-4185-b444-43dd508762e3 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:44:07.087452 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-11975a04-d490-4fc5-af5a-b1b1835f1df6 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:07.106162 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-11975a04-d490-4fc5-af5a-b1b1835f1df6 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] 10.222.0.13 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.022698 Oct 30 01:44:07.107372 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2821/5634] 10.222.0.13 () {58 vars in 1152 bytes} [Sun Oct 30 01:44:07 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:44:07.118820 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9f41485b-00c7-4eb1-881d-d6f42335678d tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Action: 'create', calling method: .version_select at 0x7f44c6fb0ca0>, body: {"server_group": {"name": "tempest-server-group-859252562", "policies": ["anti-affinity"]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:44:07.144891 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-9f41485b-00c7-4eb1-881d-d6f42335678d tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Getting quotas for project 15a1dab1c45d4be9946ec98786f36b5f. Resources: {'server_groups'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:44:07.151853 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-9f41485b-00c7-4eb1-881d-d6f42335678d tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Getting quotas for user 23ccf9b5810f4c1a8d95e70e15624a43 and project 15a1dab1c45d4be9946ec98786f36b5f. Resources: {'server_groups'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:44:07.307639 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ad1efbcc-2799-4816-b016-47c49a3754e0 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e0dceb70ee44978260397d3c196dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1735a8d4dc541c7993bcf8a4f34dda8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:07.326552 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ad1efbcc-2799-4816-b016-47c49a3754e0 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] 10.222.0.13 "GET /compute/v2.1/servers/0843d451-4ade-4a76-9a8a-a803182d73f9" status: 200 len: 1272 microversion: 2.1 time: 0.494649 Oct 30 01:44:07.333448 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2814/5635] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:06 2022] GET /compute/v2.1/servers/0843d451-4ade-4a76-9a8a-a803182d73f9 => generated 1272 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:44:07.333448 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f93c2ccc-b503-4fbe-9665-e8a5001d127b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:07.333448 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f93c2ccc-b503-4fbe-9665-e8a5001d127b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:07.341291 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f93c2ccc-b503-4fbe-9665-e8a5001d127b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:07.342585 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f93c2ccc-b503-4fbe-9665-e8a5001d127b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:07.343381 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f93c2ccc-b503-4fbe-9665-e8a5001d127b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:07.347364 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f93c2ccc-b503-4fbe-9665-e8a5001d127b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:07.347364 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f93c2ccc-b503-4fbe-9665-e8a5001d127b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:07.347364 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f93c2ccc-b503-4fbe-9665-e8a5001d127b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:07.398446 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-9f41485b-00c7-4eb1-881d-d6f42335678d tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Getting quotas for project 15a1dab1c45d4be9946ec98786f36b5f. Resources: {'server_groups'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:44:07.416027 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-9f41485b-00c7-4eb1-881d-d6f42335678d tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Getting quotas for user 23ccf9b5810f4c1a8d95e70e15624a43 and project 15a1dab1c45d4be9946ec98786f36b5f. Resources: {'server_groups'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:44:07.461888 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9f41485b-00c7-4eb1-881d-d6f42335678d tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] 10.222.0.13 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.346772 Oct 30 01:44:07.471707 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2822/5636] 10.222.0.13 () {60 vars in 1173 bytes} [Sun Oct 30 01:44:07 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:44:07.477187 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0f64fb5b-71a1-4dde-9e65-fd3fe4b67df6 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:07.609510 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0f64fb5b-71a1-4dde-9e65-fd3fe4b67df6 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/2714d4eb-9f72-431a-b733-e6dad60511a8" status: 204 len: 0 microversion: 2.1 time: 0.136110 Oct 30 01:44:07.611305 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2823/5637] 10.222.0.13 () {58 vars in 1266 bytes} [Sun Oct 30 01:44:07 2022] DELETE /compute/v2.1/os-server-groups/2714d4eb-9f72-431a-b733-e6dad60511a8 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:44:07.620379 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a30e345e-040c-4021-803c-8dd1289035fa tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:07.631660 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a30e345e-040c-4021-803c-8dd1289035fa tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] 10.222.0.13 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.016191 Oct 30 01:44:07.632376 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2824/5638] 10.222.0.13 () {58 vars in 1152 bytes} [Sun Oct 30 01:44:07 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:44:07.646337 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f93c2ccc-b503-4fbe-9665-e8a5001d127b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:07.658483 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f93c2ccc-b503-4fbe-9665-e8a5001d127b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1" status: 200 len: 1511 microversion: 2.1 time: 0.330045 Oct 30 01:44:07.660019 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2815/5639] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:07 2022] GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1 => generated 1511 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:07.885268 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-45fa28d4-4488-41c9-9265-4459a8f6f9fa tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-522550906", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "aa2a4e5a-1abe-4910-bf15-98b679745f11"}]}, "os:scheduler_hints": {"group": "23cf4f00-6b57-4be0-abf9-09d3ef54cc86"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:44:07.980565 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-45fa28d4-4488-41c9-9265-4459a8f6f9fa tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] validate_networks() for [('aa2a4e5a-1abe-4910-bf15-98b679745f11', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:44:08.356385 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ce6c7f68-3fc9-4b46-a4fd-aa5cbec20532 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:08.357053 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ce6c7f68-3fc9-4b46-a4fd-aa5cbec20532 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] [instance: 0843d451-4ade-4a76-9a8a-a803182d73f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:08.367359 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce6c7f68-3fc9-4b46-a4fd-aa5cbec20532 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:08.369133 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce6c7f68-3fc9-4b46-a4fd-aa5cbec20532 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:08.369603 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce6c7f68-3fc9-4b46-a4fd-aa5cbec20532 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:08.371368 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce6c7f68-3fc9-4b46-a4fd-aa5cbec20532 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:08.371838 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce6c7f68-3fc9-4b46-a4fd-aa5cbec20532 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:08.375056 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce6c7f68-3fc9-4b46-a4fd-aa5cbec20532 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:08.783703 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ce6c7f68-3fc9-4b46-a4fd-aa5cbec20532 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e0dceb70ee44978260397d3c196dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1735a8d4dc541c7993bcf8a4f34dda8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:08.792441 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ce6c7f68-3fc9-4b46-a4fd-aa5cbec20532 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] 10.222.0.13 "GET /compute/v2.1/servers/0843d451-4ade-4a76-9a8a-a803182d73f9" status: 200 len: 1314 microversion: 2.1 time: 0.440861 Oct 30 01:44:08.793453 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2816/5640] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:08 2022] GET /compute/v2.1/servers/0843d451-4ade-4a76-9a8a-a803182d73f9 => generated 1314 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:08.798222 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-44dee4ed-505e-48a9-a4c9-f0a0cbec11c2 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:08.799033 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-44dee4ed-505e-48a9-a4c9-f0a0cbec11c2 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:08.805414 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44dee4ed-505e-48a9-a4c9-f0a0cbec11c2 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:08.806580 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44dee4ed-505e-48a9-a4c9-f0a0cbec11c2 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:08.807258 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44dee4ed-505e-48a9-a4c9-f0a0cbec11c2 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:08.808216 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44dee4ed-505e-48a9-a4c9-f0a0cbec11c2 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:08.808673 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44dee4ed-505e-48a9-a4c9-f0a0cbec11c2 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:08.809193 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44dee4ed-505e-48a9-a4c9-f0a0cbec11c2 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:09.098506 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-45fa28d4-4488-41c9-9265-4459a8f6f9fa tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:44:09.099022 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-45fa28d4-4488-41c9-9265-4459a8f6f9fa tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:44:09.100201 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-45fa28d4-4488-41c9-9265-4459a8f6f9fa tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:44:09.100735 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-45fa28d4-4488-41c9-9265-4459a8f6f9fa tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:44:09.101873 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-45fa28d4-4488-41c9-9265-4459a8f6f9fa tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:44:09.138845 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45fa28d4-4488-41c9-9265-4459a8f6f9fa tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:09.140785 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45fa28d4-4488-41c9-9265-4459a8f6f9fa tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:09.142094 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45fa28d4-4488-41c9-9265-4459a8f6f9fa tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:09.144378 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45fa28d4-4488-41c9-9265-4459a8f6f9fa tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:09.144866 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45fa28d4-4488-41c9-9265-4459a8f6f9fa tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:09.148216 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45fa28d4-4488-41c9-9265-4459a8f6f9fa tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:09.161231 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-44dee4ed-505e-48a9-a4c9-f0a0cbec11c2 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:09.173751 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-44dee4ed-505e-48a9-a4c9-f0a0cbec11c2 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1" status: 200 len: 1511 microversion: 2.1 time: 0.377997 Oct 30 01:44:09.191146 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2817/5641] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:08 2022] GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1 => generated 1511 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:09.196861 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-45fa28d4-4488-41c9-9265-4459a8f6f9fa tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Getting quotas for project 15a1dab1c45d4be9946ec98786f36b5f. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:44:09.212278 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-45fa28d4-4488-41c9-9265-4459a8f6f9fa tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Getting quotas for user 23ccf9b5810f4c1a8d95e70e15624a43 and project 15a1dab1c45d4be9946ec98786f36b5f. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:44:09.248740 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-45fa28d4-4488-41c9-9265-4459a8f6f9fa tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:44:09.252023 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-45fa28d4-4488-41c9-9265-4459a8f6f9fa tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] [instance: fad9d370-62bc-4997-919b-6671d4bbd740] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:44:09.493288 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-45fa28d4-4488-41c9-9265-4459a8f6f9fa tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Getting quotas for project 15a1dab1c45d4be9946ec98786f36b5f. Resources: {'server_group_members'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:44:09.520733 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-45fa28d4-4488-41c9-9265-4459a8f6f9fa tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Getting quotas for user 23ccf9b5810f4c1a8d95e70e15624a43 and project 15a1dab1c45d4be9946ec98786f36b5f. Resources: {'server_group_members'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:44:09.672490 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-45fa28d4-4488-41c9-9265-4459a8f6f9fa tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Getting quotas for project 15a1dab1c45d4be9946ec98786f36b5f. Resources: {'server_group_members'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:44:09.679434 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-45fa28d4-4488-41c9-9265-4459a8f6f9fa tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Getting quotas for user 23ccf9b5810f4c1a8d95e70e15624a43 and project 15a1dab1c45d4be9946ec98786f36b5f. Resources: {'server_group_members'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:44:09.715936 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-45fa28d4-4488-41c9-9265-4459a8f6f9fa tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.835022 Oct 30 01:44:09.717432 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2825/5642] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:44:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:44:09.736237 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2b906352-a227-4052-a3f3-de2d3b8e7050 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:09.736942 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2b906352-a227-4052-a3f3-de2d3b8e7050 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] [instance: fad9d370-62bc-4997-919b-6671d4bbd740] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:09.802109 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2b906352-a227-4052-a3f3-de2d3b8e7050 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ccf9b5810f4c1a8d95e70e15624a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a1dab1c45d4be9946ec98786f36b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:09.824145 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1df2496f-e71b-40f2-8ea3-40d2f61bb1ad tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:09.826975 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1df2496f-e71b-40f2-8ea3-40d2f61bb1ad tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] [instance: 0843d451-4ade-4a76-9a8a-a803182d73f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:09.846808 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2b906352-a227-4052-a3f3-de2d3b8e7050 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] 10.222.0.13 "GET /compute/v2.1/servers/fad9d370-62bc-4997-919b-6671d4bbd740" status: 200 len: 1212 microversion: 2.1 time: 0.112652 Oct 30 01:44:09.850140 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2818/5643] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:09 2022] GET /compute/v2.1/servers/fad9d370-62bc-4997-919b-6671d4bbd740 => generated 1212 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:09.855127 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1df2496f-e71b-40f2-8ea3-40d2f61bb1ad tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:09.857300 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1df2496f-e71b-40f2-8ea3-40d2f61bb1ad tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:09.857976 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1df2496f-e71b-40f2-8ea3-40d2f61bb1ad tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:09.860663 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1df2496f-e71b-40f2-8ea3-40d2f61bb1ad tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:09.861302 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1df2496f-e71b-40f2-8ea3-40d2f61bb1ad tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:09.863723 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1df2496f-e71b-40f2-8ea3-40d2f61bb1ad tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:09.866492 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-a79a9eb6-707b-4b94-aa5f-284d8b5527a1 req-d0575a0e-230c-4ff6-bde7-b322a5329afc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0843d451-4ade-4a76-9a8a-a803182d73f9", "tag": "50c4b16e-b4f8-4133-9fe0-4b0233432502"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:44:09.890425 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:09.908913 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-a79a9eb6-707b-4b94-aa5f-284d8b5527a1 req-d0575a0e-230c-4ff6-bde7-b322a5329afc service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:09.909448 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-a79a9eb6-707b-4b94-aa5f-284d8b5527a1 req-d0575a0e-230c-4ff6-bde7-b322a5329afc service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:09.909897 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-a79a9eb6-707b-4b94-aa5f-284d8b5527a1 req-d0575a0e-230c-4ff6-bde7-b322a5329afc service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:09.947245 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-a79a9eb6-707b-4b94-aa5f-284d8b5527a1 req-d0575a0e-230c-4ff6-bde7-b322a5329afc service nova] Creating event network-changed:50c4b16e-b4f8-4133-9fe0-4b0233432502 for instance 0843d451-4ade-4a76-9a8a-a803182d73f9 on n-h2-master-1 Oct 30 01:44:09.964315 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-a79a9eb6-707b-4b94-aa5f-284d8b5527a1 req-d0575a0e-230c-4ff6-bde7-b322a5329afc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108583 Oct 30 01:44:09.964315 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2819/5644] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:44:10.201245 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3494d144-f720-40a1-9db3-1caeb1ec2a31 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:10.202004 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3494d144-f720-40a1-9db3-1caeb1ec2a31 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:10.209860 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3494d144-f720-40a1-9db3-1caeb1ec2a31 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:10.210423 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3494d144-f720-40a1-9db3-1caeb1ec2a31 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:10.211506 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3494d144-f720-40a1-9db3-1caeb1ec2a31 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:10.212371 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3494d144-f720-40a1-9db3-1caeb1ec2a31 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:10.212657 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3494d144-f720-40a1-9db3-1caeb1ec2a31 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:10.214941 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3494d144-f720-40a1-9db3-1caeb1ec2a31 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:10.224944 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1df2496f-e71b-40f2-8ea3-40d2f61bb1ad tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e0dceb70ee44978260397d3c196dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1735a8d4dc541c7993bcf8a4f34dda8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:10.235154 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1df2496f-e71b-40f2-8ea3-40d2f61bb1ad tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] 10.222.0.13 "GET /compute/v2.1/servers/0843d451-4ade-4a76-9a8a-a803182d73f9" status: 200 len: 1314 microversion: 2.1 time: 0.424025 Oct 30 01:44:10.236314 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2826/5645] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:09 2022] GET /compute/v2.1/servers/0843d451-4ade-4a76-9a8a-a803182d73f9 => generated 1314 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:10.450490 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3494d144-f720-40a1-9db3-1caeb1ec2a31 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:10.459562 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3494d144-f720-40a1-9db3-1caeb1ec2a31 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1" status: 200 len: 1511 microversion: 2.1 time: 0.262991 Oct 30 01:44:10.460910 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2820/5646] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:10 2022] GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1 => generated 1511 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:44:10.878246 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ff89e633-e00d-4a7f-9bfd-e4a07054a5df tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:10.886905 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ff89e633-e00d-4a7f-9bfd-e4a07054a5df tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] [instance: fad9d370-62bc-4997-919b-6671d4bbd740] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:10.901383 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=6,nova_api:INSERT=6 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:10.998604 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ff89e633-e00d-4a7f-9bfd-e4a07054a5df tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ccf9b5810f4c1a8d95e70e15624a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a1dab1c45d4be9946ec98786f36b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:11.019731 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ff89e633-e00d-4a7f-9bfd-e4a07054a5df tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] 10.222.0.13 "GET /compute/v2.1/servers/fad9d370-62bc-4997-919b-6671d4bbd740" status: 200 len: 1212 microversion: 2.1 time: 0.146924 Oct 30 01:44:11.026019 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2827/5647] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:10 2022] GET /compute/v2.1/servers/fad9d370-62bc-4997-919b-6671d4bbd740 => generated 1212 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:11.261293 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-da026393-47c8-485d-b384-906834828715 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:11.265512 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-da026393-47c8-485d-b384-906834828715 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] [instance: 0843d451-4ade-4a76-9a8a-a803182d73f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:11.273297 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-da026393-47c8-485d-b384-906834828715 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:11.273878 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-da026393-47c8-485d-b384-906834828715 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:11.274518 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-da026393-47c8-485d-b384-906834828715 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:11.275504 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-da026393-47c8-485d-b384-906834828715 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:11.276033 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-da026393-47c8-485d-b384-906834828715 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:11.276607 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-da026393-47c8-485d-b384-906834828715 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:11.468768 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-da026393-47c8-485d-b384-906834828715 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e0dceb70ee44978260397d3c196dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1735a8d4dc541c7993bcf8a4f34dda8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:11.485158 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-da026393-47c8-485d-b384-906834828715 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] 10.222.0.13 "GET /compute/v2.1/servers/0843d451-4ade-4a76-9a8a-a803182d73f9" status: 200 len: 1314 microversion: 2.1 time: 0.224396 Oct 30 01:44:11.485158 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2821/5648] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:11 2022] GET /compute/v2.1/servers/0843d451-4ade-4a76-9a8a-a803182d73f9 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:11.487301 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d6b99e7b-ebcf-4b8d-913c-eb3e75b3d6f8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:11.487913 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d6b99e7b-ebcf-4b8d-913c-eb3e75b3d6f8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:11.501166 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d6b99e7b-ebcf-4b8d-913c-eb3e75b3d6f8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:11.501984 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d6b99e7b-ebcf-4b8d-913c-eb3e75b3d6f8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:11.502617 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d6b99e7b-ebcf-4b8d-913c-eb3e75b3d6f8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:11.503526 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d6b99e7b-ebcf-4b8d-913c-eb3e75b3d6f8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:11.504139 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d6b99e7b-ebcf-4b8d-913c-eb3e75b3d6f8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:11.504722 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d6b99e7b-ebcf-4b8d-913c-eb3e75b3d6f8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:11.684586 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d6b99e7b-ebcf-4b8d-913c-eb3e75b3d6f8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:11.694376 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d6b99e7b-ebcf-4b8d-913c-eb3e75b3d6f8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1" status: 200 len: 1511 microversion: 2.1 time: 0.211700 Oct 30 01:44:11.694984 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2828/5649] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:11 2022] GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1 => generated 1511 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:12.043815 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-55764097-44e4-4421-8395-c7f261bff4bc tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:12.044437 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-55764097-44e4-4421-8395-c7f261bff4bc tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] [instance: fad9d370-62bc-4997-919b-6671d4bbd740] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:12.058085 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-55764097-44e4-4421-8395-c7f261bff4bc tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:12.058653 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-55764097-44e4-4421-8395-c7f261bff4bc tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:12.060328 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-55764097-44e4-4421-8395-c7f261bff4bc tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:12.061230 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-55764097-44e4-4421-8395-c7f261bff4bc tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:12.061772 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-55764097-44e4-4421-8395-c7f261bff4bc tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:12.066577 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-55764097-44e4-4421-8395-c7f261bff4bc tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:12.141979 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-55764097-44e4-4421-8395-c7f261bff4bc tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ccf9b5810f4c1a8d95e70e15624a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a1dab1c45d4be9946ec98786f36b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:12.150902 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-55764097-44e4-4421-8395-c7f261bff4bc tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] 10.222.0.13 "GET /compute/v2.1/servers/fad9d370-62bc-4997-919b-6671d4bbd740" status: 200 len: 1216 microversion: 2.1 time: 0.111358 Oct 30 01:44:12.152548 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2822/5650] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:12 2022] GET /compute/v2.1/servers/fad9d370-62bc-4997-919b-6671d4bbd740 => generated 1216 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:12.424395 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0642c813-5778-4815-ad06-7cddc1988cb0 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:12.427546 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0642c813-5778-4815-ad06-7cddc1988cb0 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:12.436396 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0642c813-5778-4815-ad06-7cddc1988cb0 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:12.438095 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0642c813-5778-4815-ad06-7cddc1988cb0 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:12.440385 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0642c813-5778-4815-ad06-7cddc1988cb0 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:12.441132 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0642c813-5778-4815-ad06-7cddc1988cb0 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:12.441626 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0642c813-5778-4815-ad06-7cddc1988cb0 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:12.442056 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0642c813-5778-4815-ad06-7cddc1988cb0 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:12.484200 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0642c813-5778-4815-ad06-7cddc1988cb0 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.064689 Oct 30 01:44:12.484800 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2829/5651] 10.222.0.13 () {60 vars in 1343 bytes} [Sun Oct 30 01:44:12 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:12.516949 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7a0a2af1-bc53-4af0-89a7-583bea66c649 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:12.516949 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7a0a2af1-bc53-4af0-89a7-583bea66c649 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] [instance: 0843d451-4ade-4a76-9a8a-a803182d73f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:12.516949 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7a0a2af1-bc53-4af0-89a7-583bea66c649 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:12.516949 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7a0a2af1-bc53-4af0-89a7-583bea66c649 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:12.516949 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7a0a2af1-bc53-4af0-89a7-583bea66c649 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:12.516949 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7a0a2af1-bc53-4af0-89a7-583bea66c649 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:12.516949 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7a0a2af1-bc53-4af0-89a7-583bea66c649 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:12.516949 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7a0a2af1-bc53-4af0-89a7-583bea66c649 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:12.521206 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:12.581896 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2f7fba09-72b3-4d17-86d6-a2cc832f88f7 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:12.583209 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2f7fba09-72b3-4d17-86d6-a2cc832f88f7 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:12.602280 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f7fba09-72b3-4d17-86d6-a2cc832f88f7 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:12.602804 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f7fba09-72b3-4d17-86d6-a2cc832f88f7 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:12.603205 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f7fba09-72b3-4d17-86d6-a2cc832f88f7 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:12.604397 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f7fba09-72b3-4d17-86d6-a2cc832f88f7 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:12.604866 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f7fba09-72b3-4d17-86d6-a2cc832f88f7 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:12.606367 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f7fba09-72b3-4d17-86d6-a2cc832f88f7 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:12.670512 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2f7fba09-72b3-4d17-86d6-a2cc832f88f7 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:44:12.714687 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7a0a2af1-bc53-4af0-89a7-583bea66c649 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e0dceb70ee44978260397d3c196dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1735a8d4dc541c7993bcf8a4f34dda8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:12.727188 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7a0a2af1-bc53-4af0-89a7-583bea66c649 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] 10.222.0.13 "GET /compute/v2.1/servers/0843d451-4ade-4a76-9a8a-a803182d73f9" status: 200 len: 1314 microversion: 2.1 time: 0.227476 Oct 30 01:44:12.736302 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2823/5652] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:12 2022] GET /compute/v2.1/servers/0843d451-4ade-4a76-9a8a-a803182d73f9 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:12.746629 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ae5144aa-4b2a-4456-b722-871fb88d1972 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:12.748515 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ae5144aa-4b2a-4456-b722-871fb88d1972 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:12.754634 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae5144aa-4b2a-4456-b722-871fb88d1972 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:12.755119 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae5144aa-4b2a-4456-b722-871fb88d1972 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:12.755548 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae5144aa-4b2a-4456-b722-871fb88d1972 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:12.756408 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae5144aa-4b2a-4456-b722-871fb88d1972 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:12.757249 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae5144aa-4b2a-4456-b722-871fb88d1972 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:12.761971 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae5144aa-4b2a-4456-b722-871fb88d1972 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:12.902619 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ae5144aa-4b2a-4456-b722-871fb88d1972 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:12.914568 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ae5144aa-4b2a-4456-b722-871fb88d1972 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1" status: 200 len: 1511 microversion: 2.1 time: 0.176835 Oct 30 01:44:12.921691 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2824/5653] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:12 2022] GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1 => generated 1511 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:13.170328 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2f7fba09-72b3-4d17-86d6-a2cc832f88f7 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 204 len: 0 microversion: 2.20 time: 0.591959 Oct 30 01:44:13.170995 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2830/5654] 10.222.0.13 () {60 vars in 1280 bytes} [Sun Oct 30 01:44:12 2022] DELETE /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 0 bytes in 594 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 30 01:44:13.175065 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3f99b073-416f-4f42-a383-cd54543f403b tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:13.175679 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3f99b073-416f-4f42-a383-cd54543f403b tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] [instance: fad9d370-62bc-4997-919b-6671d4bbd740] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:13.179239 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8ac16bc7-4afe-48be-9fd9-1fb6f54f487d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:13.179961 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8ac16bc7-4afe-48be-9fd9-1fb6f54f487d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:13.182141 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f99b073-416f-4f42-a383-cd54543f403b tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:13.182640 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f99b073-416f-4f42-a383-cd54543f403b tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:13.183058 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f99b073-416f-4f42-a383-cd54543f403b tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:13.183918 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f99b073-416f-4f42-a383-cd54543f403b tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:13.184371 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f99b073-416f-4f42-a383-cd54543f403b tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:13.184797 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f99b073-416f-4f42-a383-cd54543f403b tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:13.186260 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ac16bc7-4afe-48be-9fd9-1fb6f54f487d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:13.186752 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ac16bc7-4afe-48be-9fd9-1fb6f54f487d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:13.187193 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ac16bc7-4afe-48be-9fd9-1fb6f54f487d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:13.187930 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ac16bc7-4afe-48be-9fd9-1fb6f54f487d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:13.188384 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ac16bc7-4afe-48be-9fd9-1fb6f54f487d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:13.188805 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ac16bc7-4afe-48be-9fd9-1fb6f54f487d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:13.292639 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3f99b073-416f-4f42-a383-cd54543f403b tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ccf9b5810f4c1a8d95e70e15624a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a1dab1c45d4be9946ec98786f36b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:13.303447 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3f99b073-416f-4f42-a383-cd54543f403b tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] 10.222.0.13 "GET /compute/v2.1/servers/fad9d370-62bc-4997-919b-6671d4bbd740" status: 200 len: 1264 microversion: 2.1 time: 0.132585 Oct 30 01:44:13.304034 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2825/5655] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:13 2022] GET /compute/v2.1/servers/fad9d370-62bc-4997-919b-6671d4bbd740 => generated 1264 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:44:13.400038 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8ac16bc7-4afe-48be-9fd9-1fb6f54f487d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:13.413379 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8ac16bc7-4afe-48be-9fd9-1fb6f54f487d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:13.415023 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8ac16bc7-4afe-48be-9fd9-1fb6f54f487d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:13.416240 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8ac16bc7-4afe-48be-9fd9-1fb6f54f487d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1721 microversion: 2.20 time: 0.241122 Oct 30 01:44:13.417041 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2831/5656] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:44:13 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1721 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:44:13.751594 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-beb8e810-b8cb-4f65-8813-e3fe72e55bd6 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:13.752233 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-beb8e810-b8cb-4f65-8813-e3fe72e55bd6 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] [instance: 0843d451-4ade-4a76-9a8a-a803182d73f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:13.759066 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-beb8e810-b8cb-4f65-8813-e3fe72e55bd6 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:13.759608 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-beb8e810-b8cb-4f65-8813-e3fe72e55bd6 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:13.760929 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-beb8e810-b8cb-4f65-8813-e3fe72e55bd6 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:13.761679 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-beb8e810-b8cb-4f65-8813-e3fe72e55bd6 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:13.762195 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-beb8e810-b8cb-4f65-8813-e3fe72e55bd6 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:13.762625 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-beb8e810-b8cb-4f65-8813-e3fe72e55bd6 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:13.912373 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-beb8e810-b8cb-4f65-8813-e3fe72e55bd6 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e0dceb70ee44978260397d3c196dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1735a8d4dc541c7993bcf8a4f34dda8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:13.920138 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-beb8e810-b8cb-4f65-8813-e3fe72e55bd6 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] 10.222.0.13 "GET /compute/v2.1/servers/0843d451-4ade-4a76-9a8a-a803182d73f9" status: 200 len: 1314 microversion: 2.1 time: 0.172494 Oct 30 01:44:13.921587 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2826/5657] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:13 2022] GET /compute/v2.1/servers/0843d451-4ade-4a76-9a8a-a803182d73f9 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:44:13.939530 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-eaacc546-639f-422f-af6d-bfc2b6a7f06f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:13.940289 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-eaacc546-639f-422f-af6d-bfc2b6a7f06f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:13.954764 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eaacc546-639f-422f-af6d-bfc2b6a7f06f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:13.955478 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eaacc546-639f-422f-af6d-bfc2b6a7f06f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:13.956125 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eaacc546-639f-422f-af6d-bfc2b6a7f06f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:13.957004 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eaacc546-639f-422f-af6d-bfc2b6a7f06f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:13.958156 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eaacc546-639f-422f-af6d-bfc2b6a7f06f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:13.958156 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eaacc546-639f-422f-af6d-bfc2b6a7f06f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:14.194607 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-eaacc546-639f-422f-af6d-bfc2b6a7f06f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:14.202926 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-eaacc546-639f-422f-af6d-bfc2b6a7f06f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1" status: 200 len: 1511 microversion: 2.1 time: 0.267667 Oct 30 01:44:14.204139 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2832/5658] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:13 2022] GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1 => generated 1511 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:14.328077 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f622acde-b9f5-4ba3-8fff-b524e2ecd77e tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:14.328754 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f622acde-b9f5-4ba3-8fff-b524e2ecd77e tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] [instance: fad9d370-62bc-4997-919b-6671d4bbd740] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:14.336329 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f622acde-b9f5-4ba3-8fff-b524e2ecd77e tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:14.341278 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f622acde-b9f5-4ba3-8fff-b524e2ecd77e tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:14.341278 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f622acde-b9f5-4ba3-8fff-b524e2ecd77e tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:14.341278 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f622acde-b9f5-4ba3-8fff-b524e2ecd77e tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:14.341278 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f622acde-b9f5-4ba3-8fff-b524e2ecd77e tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:14.341278 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f622acde-b9f5-4ba3-8fff-b524e2ecd77e tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:14.423683 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f622acde-b9f5-4ba3-8fff-b524e2ecd77e tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ccf9b5810f4c1a8d95e70e15624a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a1dab1c45d4be9946ec98786f36b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:14.433582 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f622acde-b9f5-4ba3-8fff-b524e2ecd77e tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] 10.222.0.13 "GET /compute/v2.1/servers/fad9d370-62bc-4997-919b-6671d4bbd740" status: 200 len: 1270 microversion: 2.1 time: 0.109254 Oct 30 01:44:14.435032 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2827/5659] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:14 2022] GET /compute/v2.1/servers/fad9d370-62bc-4997-919b-6671d4bbd740 => generated 1270 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:14.449156 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-814b424e-6584-4326-b95c-87cf979e586f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:14.450220 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-814b424e-6584-4326-b95c-87cf979e586f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:14.459190 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-814b424e-6584-4326-b95c-87cf979e586f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:14.459190 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-814b424e-6584-4326-b95c-87cf979e586f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:14.459778 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-814b424e-6584-4326-b95c-87cf979e586f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:14.460737 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-814b424e-6584-4326-b95c-87cf979e586f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:14.461323 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-814b424e-6584-4326-b95c-87cf979e586f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:14.461732 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-814b424e-6584-4326-b95c-87cf979e586f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:14.887843 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-814b424e-6584-4326-b95c-87cf979e586f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:14.902576 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-814b424e-6584-4326-b95c-87cf979e586f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:14.907602 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-814b424e-6584-4326-b95c-87cf979e586f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:14.909238 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-814b424e-6584-4326-b95c-87cf979e586f tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1721 microversion: 2.20 time: 0.466506 Oct 30 01:44:14.922493 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2833/5660] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:44:14 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1721 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:44:14.945130 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-569082a0-6cb0-47ad-b5aa-d98346f15ee5 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:14.945782 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-569082a0-6cb0-47ad-b5aa-d98346f15ee5 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] [instance: 0843d451-4ade-4a76-9a8a-a803182d73f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:14.957632 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-569082a0-6cb0-47ad-b5aa-d98346f15ee5 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:14.958046 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-569082a0-6cb0-47ad-b5aa-d98346f15ee5 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:14.958451 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-569082a0-6cb0-47ad-b5aa-d98346f15ee5 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:14.959263 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-569082a0-6cb0-47ad-b5aa-d98346f15ee5 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:14.959983 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-569082a0-6cb0-47ad-b5aa-d98346f15ee5 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:14.960433 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-569082a0-6cb0-47ad-b5aa-d98346f15ee5 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:15.230553 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-569082a0-6cb0-47ad-b5aa-d98346f15ee5 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e0dceb70ee44978260397d3c196dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1735a8d4dc541c7993bcf8a4f34dda8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:15.234123 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-569082a0-6cb0-47ad-b5aa-d98346f15ee5 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] 10.222.0.13 "GET /compute/v2.1/servers/0843d451-4ade-4a76-9a8a-a803182d73f9" status: 200 len: 1314 microversion: 2.1 time: 0.293576 Oct 30 01:44:15.235726 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2828/5661] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:14 2022] GET /compute/v2.1/servers/0843d451-4ade-4a76-9a8a-a803182d73f9 => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:15.237951 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a4a9b450-a1f9-41ae-9379-4b65a547f34e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:15.241409 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a4a9b450-a1f9-41ae-9379-4b65a547f34e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:15.264927 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a4a9b450-a1f9-41ae-9379-4b65a547f34e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:15.264927 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a4a9b450-a1f9-41ae-9379-4b65a547f34e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:15.264927 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a4a9b450-a1f9-41ae-9379-4b65a547f34e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:15.268621 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a4a9b450-a1f9-41ae-9379-4b65a547f34e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:15.269927 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a4a9b450-a1f9-41ae-9379-4b65a547f34e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:15.270700 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a4a9b450-a1f9-41ae-9379-4b65a547f34e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:15.475928 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-aab6d377-c5b7-4138-9723-f0d3cc8c4565 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:15.475928 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-aab6d377-c5b7-4138-9723-f0d3cc8c4565 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] [instance: fad9d370-62bc-4997-919b-6671d4bbd740] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:15.489225 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aab6d377-c5b7-4138-9723-f0d3cc8c4565 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:15.489858 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aab6d377-c5b7-4138-9723-f0d3cc8c4565 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:15.493513 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aab6d377-c5b7-4138-9723-f0d3cc8c4565 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:15.495150 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aab6d377-c5b7-4138-9723-f0d3cc8c4565 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:15.498830 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aab6d377-c5b7-4138-9723-f0d3cc8c4565 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:15.499408 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aab6d377-c5b7-4138-9723-f0d3cc8c4565 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:15.775557 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a4a9b450-a1f9-41ae-9379-4b65a547f34e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:15.787224 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a4a9b450-a1f9-41ae-9379-4b65a547f34e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1" status: 200 len: 1511 microversion: 2.1 time: 0.555079 Oct 30 01:44:15.802390 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2834/5662] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:15 2022] GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1 => generated 1511 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:15.936745 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6ece026f-f977-4381-8216-f36a333c5b2d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:15.937753 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6ece026f-f977-4381-8216-f36a333c5b2d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:15.948967 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ece026f-f977-4381-8216-f36a333c5b2d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:15.949897 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ece026f-f977-4381-8216-f36a333c5b2d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:15.955839 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ece026f-f977-4381-8216-f36a333c5b2d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:15.957036 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ece026f-f977-4381-8216-f36a333c5b2d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:15.957800 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ece026f-f977-4381-8216-f36a333c5b2d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:15.958645 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ece026f-f977-4381-8216-f36a333c5b2d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:15.999999 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-aab6d377-c5b7-4138-9723-f0d3cc8c4565 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ccf9b5810f4c1a8d95e70e15624a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a1dab1c45d4be9946ec98786f36b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:16.010147 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-aab6d377-c5b7-4138-9723-f0d3cc8c4565 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] 10.222.0.13 "GET /compute/v2.1/servers/fad9d370-62bc-4997-919b-6671d4bbd740" status: 200 len: 1312 microversion: 2.1 time: 0.556392 Oct 30 01:44:16.015380 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2829/5663] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:15 2022] GET /compute/v2.1/servers/fad9d370-62bc-4997-919b-6671d4bbd740 => generated 1312 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:44:16.215138 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6ece026f-f977-4381-8216-f36a333c5b2d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:16.226302 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6ece026f-f977-4381-8216-f36a333c5b2d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:16.230374 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6ece026f-f977-4381-8216-f36a333c5b2d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:16.232721 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6ece026f-f977-4381-8216-f36a333c5b2d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1721 microversion: 2.20 time: 0.300516 Oct 30 01:44:16.245150 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2835/5664] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:44:15 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1721 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 01:44:16.264448 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-875b11d5-452e-4e4f-bf02-0ae768c928a1 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:16.275373 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-875b11d5-452e-4e4f-bf02-0ae768c928a1 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] [instance: 0843d451-4ade-4a76-9a8a-a803182d73f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:16.292246 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-875b11d5-452e-4e4f-bf02-0ae768c928a1 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:16.292769 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-875b11d5-452e-4e4f-bf02-0ae768c928a1 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:16.293208 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-875b11d5-452e-4e4f-bf02-0ae768c928a1 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:16.293946 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-875b11d5-452e-4e4f-bf02-0ae768c928a1 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:16.294399 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-875b11d5-452e-4e4f-bf02-0ae768c928a1 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:16.294820 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-875b11d5-452e-4e4f-bf02-0ae768c928a1 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:16.819332 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-39736ac9-6798-40e4-9827-9042e3bd3920 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:16.820292 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-39736ac9-6798-40e4-9827-9042e3bd3920 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:16.830195 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-39736ac9-6798-40e4-9827-9042e3bd3920 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:16.831185 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-39736ac9-6798-40e4-9827-9042e3bd3920 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:16.832795 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-39736ac9-6798-40e4-9827-9042e3bd3920 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:16.837134 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-39736ac9-6798-40e4-9827-9042e3bd3920 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:16.837134 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-39736ac9-6798-40e4-9827-9042e3bd3920 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:16.837134 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-39736ac9-6798-40e4-9827-9042e3bd3920 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:17.117798 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-875b11d5-452e-4e4f-bf02-0ae768c928a1 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e0dceb70ee44978260397d3c196dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1735a8d4dc541c7993bcf8a4f34dda8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:17.126922 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-875b11d5-452e-4e4f-bf02-0ae768c928a1 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] 10.222.0.13 "GET /compute/v2.1/servers/0843d451-4ade-4a76-9a8a-a803182d73f9" status: 200 len: 1314 microversion: 2.1 time: 0.868073 Oct 30 01:44:17.127822 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2830/5665] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:16 2022] GET /compute/v2.1/servers/0843d451-4ade-4a76-9a8a-a803182d73f9 => generated 1314 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:17.133270 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c464335d-a6ec-4225-9f28-3b715d065952 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:17.134176 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c464335d-a6ec-4225-9f28-3b715d065952 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] [instance: fad9d370-62bc-4997-919b-6671d4bbd740] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:17.141089 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c464335d-a6ec-4225-9f28-3b715d065952 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:17.141786 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c464335d-a6ec-4225-9f28-3b715d065952 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:17.142541 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c464335d-a6ec-4225-9f28-3b715d065952 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:17.143241 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c464335d-a6ec-4225-9f28-3b715d065952 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:17.143696 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c464335d-a6ec-4225-9f28-3b715d065952 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:17.144121 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c464335d-a6ec-4225-9f28-3b715d065952 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:17.250387 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-39736ac9-6798-40e4-9827-9042e3bd3920 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:17.263124 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-39736ac9-6798-40e4-9827-9042e3bd3920 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1" status: 200 len: 1511 microversion: 2.1 time: 0.453328 Oct 30 01:44:17.264908 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2836/5666] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:16 2022] GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1 => generated 1511 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:17.277419 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e0952e35-6817-47b6-9a0a-5a574dc9b021 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:17.279251 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e0952e35-6817-47b6-9a0a-5a574dc9b021 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:17.290678 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e0952e35-6817-47b6-9a0a-5a574dc9b021 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:17.292277 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e0952e35-6817-47b6-9a0a-5a574dc9b021 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:17.293065 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e0952e35-6817-47b6-9a0a-5a574dc9b021 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:17.294027 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e0952e35-6817-47b6-9a0a-5a574dc9b021 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:17.294811 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e0952e35-6817-47b6-9a0a-5a574dc9b021 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:17.295426 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e0952e35-6817-47b6-9a0a-5a574dc9b021 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:17.447051 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c464335d-a6ec-4225-9f28-3b715d065952 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ccf9b5810f4c1a8d95e70e15624a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a1dab1c45d4be9946ec98786f36b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:17.456535 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c464335d-a6ec-4225-9f28-3b715d065952 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] 10.222.0.13 "GET /compute/v2.1/servers/fad9d370-62bc-4997-919b-6671d4bbd740" status: 200 len: 1312 microversion: 2.1 time: 0.327452 Oct 30 01:44:17.459375 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2831/5667] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:17 2022] GET /compute/v2.1/servers/fad9d370-62bc-4997-919b-6671d4bbd740 => generated 1312 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:17.467923 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-785b93c7-0ad6-474e-a018-a6e94b196dec req-3433f50a-ee52-4f10-a46c-abf4412f75ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2e35e69-66f2-43a0-9baa-d8f70437561d", "name": "network-vif-deleted", "tag": "6657440b-da45-40cf-ae87-7a3d5beeb7a4"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:44:17.476992 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e0952e35-6817-47b6-9a0a-5a574dc9b021 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:17.498633 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-785b93c7-0ad6-474e-a018-a6e94b196dec req-3433f50a-ee52-4f10-a46c-abf4412f75ff service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:17.503088 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-785b93c7-0ad6-474e-a018-a6e94b196dec req-3433f50a-ee52-4f10-a46c-abf4412f75ff service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:17.505860 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-785b93c7-0ad6-474e-a018-a6e94b196dec req-3433f50a-ee52-4f10-a46c-abf4412f75ff service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:17.506977 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e0952e35-6817-47b6-9a0a-5a574dc9b021 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:17.508674 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e0952e35-6817-47b6-9a0a-5a574dc9b021 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93d18cf1316742dab78a102a257608ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd206d5c4ea654a2194a77d71d27972e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:17.516210 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e0952e35-6817-47b6-9a0a-5a574dc9b021 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 200 len: 1654 microversion: 2.20 time: 0.249997 Oct 30 01:44:17.520018 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2837/5668] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:44:17 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 1654 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 01:44:17.530142 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-785b93c7-0ad6-474e-a018-a6e94b196dec req-3433f50a-ee52-4f10-a46c-abf4412f75ff service nova] Creating event network-vif-deleted:6657440b-da45-40cf-ae87-7a3d5beeb7a4 for instance b2e35e69-66f2-43a0-9baa-d8f70437561d on n-h1-master-1 Oct 30 01:44:17.553452 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-785b93c7-0ad6-474e-a018-a6e94b196dec req-3433f50a-ee52-4f10-a46c-abf4412f75ff service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091949 Oct 30 01:44:17.554270 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2832/5669] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:44:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:44:17.797710 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-e071dea8-2fb5-4653-a0c7-c5af5c5e9b47 req-3a73f79e-ec0f-47af-b6d9-2b94e4d6c448 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0843d451-4ade-4a76-9a8a-a803182d73f9", "name": "network-vif-plugged", "status": "completed", "tag": "50c4b16e-b4f8-4133-9fe0-4b0233432502"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:44:17.816501 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e071dea8-2fb5-4653-a0c7-c5af5c5e9b47 req-3a73f79e-ec0f-47af-b6d9-2b94e4d6c448 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:17.819742 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e071dea8-2fb5-4653-a0c7-c5af5c5e9b47 req-3a73f79e-ec0f-47af-b6d9-2b94e4d6c448 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:17.821982 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e071dea8-2fb5-4653-a0c7-c5af5c5e9b47 req-3a73f79e-ec0f-47af-b6d9-2b94e4d6c448 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:17.860670 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-e071dea8-2fb5-4653-a0c7-c5af5c5e9b47 req-3a73f79e-ec0f-47af-b6d9-2b94e4d6c448 service nova] Creating event network-vif-plugged:50c4b16e-b4f8-4133-9fe0-4b0233432502 for instance 0843d451-4ade-4a76-9a8a-a803182d73f9 on n-h2-master-1 Oct 30 01:44:17.871717 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-e071dea8-2fb5-4653-a0c7-c5af5c5e9b47 req-3a73f79e-ec0f-47af-b6d9-2b94e4d6c448 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078672 Oct 30 01:44:17.875279 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2838/5670] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:44:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:44:18.151253 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-454f6a1a-1268-4854-a200-72a2a440691c tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:18.152903 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-454f6a1a-1268-4854-a200-72a2a440691c tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] [instance: 0843d451-4ade-4a76-9a8a-a803182d73f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:18.169040 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-454f6a1a-1268-4854-a200-72a2a440691c tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:18.169572 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-454f6a1a-1268-4854-a200-72a2a440691c tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:18.170421 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-454f6a1a-1268-4854-a200-72a2a440691c tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:18.171147 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-454f6a1a-1268-4854-a200-72a2a440691c tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:18.171593 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-454f6a1a-1268-4854-a200-72a2a440691c tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:18.172012 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-454f6a1a-1268-4854-a200-72a2a440691c tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:18.288043 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-567495bc-1785-4855-af63-8fc84cd8994f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:18.288741 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-567495bc-1785-4855-af63-8fc84cd8994f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:18.308322 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-567495bc-1785-4855-af63-8fc84cd8994f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:18.308833 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-567495bc-1785-4855-af63-8fc84cd8994f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:18.309268 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-567495bc-1785-4855-af63-8fc84cd8994f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:18.310174 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-567495bc-1785-4855-af63-8fc84cd8994f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:18.310644 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-567495bc-1785-4855-af63-8fc84cd8994f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:18.311069 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-567495bc-1785-4855-af63-8fc84cd8994f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:18.507145 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-454f6a1a-1268-4854-a200-72a2a440691c tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e0dceb70ee44978260397d3c196dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1735a8d4dc541c7993bcf8a4f34dda8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:18.515645 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-454f6a1a-1268-4854-a200-72a2a440691c tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] 10.222.0.13 "GET /compute/v2.1/servers/0843d451-4ade-4a76-9a8a-a803182d73f9" status: 200 len: 1314 microversion: 2.1 time: 0.369442 Oct 30 01:44:18.533509 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2833/5671] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:18 2022] GET /compute/v2.1/servers/0843d451-4ade-4a76-9a8a-a803182d73f9 => generated 1314 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:18.546737 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-af6b30e1-280f-4bb9-b636-27b28fa7d6bb tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:18.562180 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-af6b30e1-280f-4bb9-b636-27b28fa7d6bb tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] [instance: fad9d370-62bc-4997-919b-6671d4bbd740] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:18.567067 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af6b30e1-280f-4bb9-b636-27b28fa7d6bb tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:18.571705 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af6b30e1-280f-4bb9-b636-27b28fa7d6bb tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:18.572579 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af6b30e1-280f-4bb9-b636-27b28fa7d6bb tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:18.575144 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af6b30e1-280f-4bb9-b636-27b28fa7d6bb tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:18.578946 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af6b30e1-280f-4bb9-b636-27b28fa7d6bb tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:18.579729 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af6b30e1-280f-4bb9-b636-27b28fa7d6bb tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:19.172180 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=4 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:19.183276 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-567495bc-1785-4855-af63-8fc84cd8994f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:19.192526 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-567495bc-1785-4855-af63-8fc84cd8994f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1" status: 200 len: 1511 microversion: 2.1 time: 0.908754 Oct 30 01:44:19.198357 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2839/5672] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:18 2022] GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1 => generated 1511 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:19.201729 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-af6b30e1-280f-4bb9-b636-27b28fa7d6bb tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ccf9b5810f4c1a8d95e70e15624a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a1dab1c45d4be9946ec98786f36b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:19.207463 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7addccf9-619a-43de-8b24-8cb04b6d72cc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:19.210128 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7addccf9-619a-43de-8b24-8cb04b6d72cc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:19.223129 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-af6b30e1-280f-4bb9-b636-27b28fa7d6bb tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] 10.222.0.13 "GET /compute/v2.1/servers/fad9d370-62bc-4997-919b-6671d4bbd740" status: 200 len: 1312 microversion: 2.1 time: 0.688080 Oct 30 01:44:19.223883 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2834/5673] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:18 2022] GET /compute/v2.1/servers/fad9d370-62bc-4997-919b-6671d4bbd740 => generated 1312 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:19.225781 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7addccf9-619a-43de-8b24-8cb04b6d72cc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:19.226587 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7addccf9-619a-43de-8b24-8cb04b6d72cc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:19.228933 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7addccf9-619a-43de-8b24-8cb04b6d72cc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:19.230726 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7addccf9-619a-43de-8b24-8cb04b6d72cc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:19.231512 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7addccf9-619a-43de-8b24-8cb04b6d72cc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:19.232164 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7addccf9-619a-43de-8b24-8cb04b6d72cc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:19.269975 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-7addccf9-619a-43de-8b24-8cb04b6d72cc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] HTTP exception thrown: Instance b2e35e69-66f2-43a0-9baa-d8f70437561d could not be found. Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7addccf9-619a-43de-8b24-8cb04b6d72cc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Request method failure captured: Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d HTTP/1.1 Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdUumvYALlX1ZEotYYfctadY85rkMIcCqpZFBAcTzKR92GeJdeuIBdMxiIzxgpC70Uj-cIJEgHazOdEuJ2nPCy0aOB6DMv1PnS8XxJSl3GFjmmFSeBD_Hmz1zCSH_Icmjv43STm9-8axTTUKObYyp4Juj43xfhv3UIItt81amHvJ3AU Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: X-Openstack-Nova-Api-Version: 2.20 Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: d206d5c4ea654a2194a77d71d27972e8 Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-119748518 Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d206d5c4ea654a2194a77d71d27972e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d206d5c4ea654a2194a77d71d27972e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d206d5c4ea654a2194a77d71d27972e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d206d5c4ea654a2194a77d71d27972e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-AttachVolumeShelveTestJSON-119748518 Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: d206d5c4ea654a2194a77d71d27972e8 Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-119748518 Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-AttachVolumeShelveTestJSON-119748518-project Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 93d18cf1316742dab78a102a257608ae Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-AttachVolumeShelveTestJSON-119748518-project Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: exception: Instance b2e35e69-66f2-43a0-9baa-d8f70437561d could not be found. Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'b2e35e69-66f2-43a0-9baa-d8f70437561d'} Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2e35e69-66f2-43a0-9baa-d8f70437561d could not be found. Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2e35e69-66f2-43a0-9baa-d8f70437561d could not be found. Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:44:19.271697 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:44:19.284838 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:44:19.284838 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:44:19.284838 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:44:19.284838 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:44:19.284838 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:44:19.284838 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:44:19.284838 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2e35e69-66f2-43a0-9baa-d8f70437561d could not be found. Oct 30 01:44:19.284838 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:44:19.284838 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7addccf9-619a-43de-8b24-8cb04b6d72cc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Returning 404 to user: Instance b2e35e69-66f2-43a0-9baa-d8f70437561d could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:44:19.284838 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7addccf9-619a-43de-8b24-8cb04b6d72cc tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 404 len: 111 microversion: 2.20 time: 0.075717 Oct 30 01:44:19.284838 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2840/5674] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:44:19 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:44:19.287450 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fb91eae0-c15f-4a47-943c-5ce59caded06 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '.version_select at 0x7f44d04d0940>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:19.409347 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fb91eae0-c15f-4a47-943c-5ce59caded06 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-301372314" status: 204 len: 0 microversion: 2.20 time: 0.126687 Oct 30 01:44:19.411320 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2835/5675] 10.222.0.13 () {60 vars in 1259 bytes} [Sun Oct 30 01:44:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-301372314 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 30 01:44:19.543211 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ceca15d8-5417-482c-855b-e34f0300e4f5 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:19.544557 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ceca15d8-5417-482c-855b-e34f0300e4f5 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] [instance: 0843d451-4ade-4a76-9a8a-a803182d73f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:19.551386 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ceca15d8-5417-482c-855b-e34f0300e4f5 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:19.552242 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ceca15d8-5417-482c-855b-e34f0300e4f5 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:19.553044 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ceca15d8-5417-482c-855b-e34f0300e4f5 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:19.553959 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ceca15d8-5417-482c-855b-e34f0300e4f5 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:19.554570 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ceca15d8-5417-482c-855b-e34f0300e4f5 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:19.555253 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ceca15d8-5417-482c-855b-e34f0300e4f5 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:19.579375 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-76eddc14-08d8-41f3-abf0-b09de07bb239 req-d2dacfb3-53e3-4080-966f-6df1c405700d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fad9d370-62bc-4997-919b-6671d4bbd740", "tag": "43a46968-b849-4a2e-8258-663cb42fcef9"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:44:19.611091 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-76eddc14-08d8-41f3-abf0-b09de07bb239 req-d2dacfb3-53e3-4080-966f-6df1c405700d service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:19.611870 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-76eddc14-08d8-41f3-abf0-b09de07bb239 req-d2dacfb3-53e3-4080-966f-6df1c405700d service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:19.618400 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-76eddc14-08d8-41f3-abf0-b09de07bb239 req-d2dacfb3-53e3-4080-966f-6df1c405700d service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:19.624289 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:19.660598 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-76eddc14-08d8-41f3-abf0-b09de07bb239 req-d2dacfb3-53e3-4080-966f-6df1c405700d service nova] Creating event network-changed:43a46968-b849-4a2e-8258-663cb42fcef9 for instance fad9d370-62bc-4997-919b-6671d4bbd740 on n-h2-master-1 Oct 30 01:44:19.673040 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-76eddc14-08d8-41f3-abf0-b09de07bb239 req-d2dacfb3-53e3-4080-966f-6df1c405700d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097405 Oct 30 01:44:19.676039 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2836/5676] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:44:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:44:19.832599 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ceca15d8-5417-482c-855b-e34f0300e4f5 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e0dceb70ee44978260397d3c196dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1735a8d4dc541c7993bcf8a4f34dda8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:19.842579 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ceca15d8-5417-482c-855b-e34f0300e4f5 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] 10.222.0.13 "GET /compute/v2.1/servers/0843d451-4ade-4a76-9a8a-a803182d73f9" status: 200 len: 1314 microversion: 2.1 time: 0.303292 Oct 30 01:44:19.853390 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2841/5677] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:19 2022] GET /compute/v2.1/servers/0843d451-4ade-4a76-9a8a-a803182d73f9 => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:20.223309 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=22 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:20.229411 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f93b1c05-67a7-49fd-90f5-ecbea7e5be5d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:20.230127 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f93b1c05-67a7-49fd-90f5-ecbea7e5be5d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:20.239547 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f93b1c05-67a7-49fd-90f5-ecbea7e5be5d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:20.241363 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f93b1c05-67a7-49fd-90f5-ecbea7e5be5d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:20.241828 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f93b1c05-67a7-49fd-90f5-ecbea7e5be5d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:20.242544 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f93b1c05-67a7-49fd-90f5-ecbea7e5be5d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:20.243009 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f93b1c05-67a7-49fd-90f5-ecbea7e5be5d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:20.243443 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f93b1c05-67a7-49fd-90f5-ecbea7e5be5d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:20.253419 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6f23dc25-0fd3-44ff-9213-c78c1bc52a0b tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:20.259873 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6f23dc25-0fd3-44ff-9213-c78c1bc52a0b tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] [instance: fad9d370-62bc-4997-919b-6671d4bbd740] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:20.266254 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f23dc25-0fd3-44ff-9213-c78c1bc52a0b tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:20.267794 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f23dc25-0fd3-44ff-9213-c78c1bc52a0b tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:20.271438 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f23dc25-0fd3-44ff-9213-c78c1bc52a0b tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:20.272427 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f23dc25-0fd3-44ff-9213-c78c1bc52a0b tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:20.273071 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f23dc25-0fd3-44ff-9213-c78c1bc52a0b tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:20.273819 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f23dc25-0fd3-44ff-9213-c78c1bc52a0b tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:20.659981 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f93b1c05-67a7-49fd-90f5-ecbea7e5be5d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:20.671417 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6f23dc25-0fd3-44ff-9213-c78c1bc52a0b tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ccf9b5810f4c1a8d95e70e15624a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a1dab1c45d4be9946ec98786f36b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:20.680456 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6f23dc25-0fd3-44ff-9213-c78c1bc52a0b tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] 10.222.0.13 "GET /compute/v2.1/servers/fad9d370-62bc-4997-919b-6671d4bbd740" status: 200 len: 1312 microversion: 2.1 time: 0.433442 Oct 30 01:44:20.681041 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2842/5678] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:20 2022] GET /compute/v2.1/servers/fad9d370-62bc-4997-919b-6671d4bbd740 => generated 1312 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:44:20.686060 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f93b1c05-67a7-49fd-90f5-ecbea7e5be5d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1" status: 200 len: 1511 microversion: 2.1 time: 0.463579 Oct 30 01:44:20.700226 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2837/5679] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:20 2022] GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1 => generated 1511 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:20.868384 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-06321f6d-e401-4a62-89b5-0ad94a6810f6 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:20.869008 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-06321f6d-e401-4a62-89b5-0ad94a6810f6 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] [instance: 0843d451-4ade-4a76-9a8a-a803182d73f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:20.881846 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-06321f6d-e401-4a62-89b5-0ad94a6810f6 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:20.887136 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-06321f6d-e401-4a62-89b5-0ad94a6810f6 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:20.889024 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-06321f6d-e401-4a62-89b5-0ad94a6810f6 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:20.891673 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-06321f6d-e401-4a62-89b5-0ad94a6810f6 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:20.892169 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-06321f6d-e401-4a62-89b5-0ad94a6810f6 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:20.892611 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-06321f6d-e401-4a62-89b5-0ad94a6810f6 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:21.003363 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=46 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:21.288845 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-06321f6d-e401-4a62-89b5-0ad94a6810f6 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e0dceb70ee44978260397d3c196dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1735a8d4dc541c7993bcf8a4f34dda8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:21.300202 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-06321f6d-e401-4a62-89b5-0ad94a6810f6 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] 10.222.0.13 "GET /compute/v2.1/servers/0843d451-4ade-4a76-9a8a-a803182d73f9" status: 200 len: 1314 microversion: 2.1 time: 0.435698 Oct 30 01:44:21.310005 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2843/5680] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:20 2022] GET /compute/v2.1/servers/0843d451-4ade-4a76-9a8a-a803182d73f9 => generated 1314 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:21.704384 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-12ea69a2-405d-4bdc-b59c-77566177a9a1 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:21.705620 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-12ea69a2-405d-4bdc-b59c-77566177a9a1 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] [instance: fad9d370-62bc-4997-919b-6671d4bbd740] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:21.712296 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-12ea69a2-405d-4bdc-b59c-77566177a9a1 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:21.712793 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-12ea69a2-405d-4bdc-b59c-77566177a9a1 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:21.713253 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-12ea69a2-405d-4bdc-b59c-77566177a9a1 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:21.713971 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-12ea69a2-405d-4bdc-b59c-77566177a9a1 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:21.714589 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-12ea69a2-405d-4bdc-b59c-77566177a9a1 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:21.715032 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-12ea69a2-405d-4bdc-b59c-77566177a9a1 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:21.726936 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fa73e7c0-aa1e-4a29-b68a-235c1ad7147a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:21.727806 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-fa73e7c0-aa1e-4a29-b68a-235c1ad7147a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:21.737916 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fa73e7c0-aa1e-4a29-b68a-235c1ad7147a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:21.738803 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fa73e7c0-aa1e-4a29-b68a-235c1ad7147a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:21.742554 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fa73e7c0-aa1e-4a29-b68a-235c1ad7147a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:21.742554 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fa73e7c0-aa1e-4a29-b68a-235c1ad7147a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:21.742554 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fa73e7c0-aa1e-4a29-b68a-235c1ad7147a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:21.742554 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fa73e7c0-aa1e-4a29-b68a-235c1ad7147a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:22.108261 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-fa73e7c0-aa1e-4a29-b68a-235c1ad7147a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:22.114677 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-12ea69a2-405d-4bdc-b59c-77566177a9a1 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ccf9b5810f4c1a8d95e70e15624a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a1dab1c45d4be9946ec98786f36b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:22.122917 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-12ea69a2-405d-4bdc-b59c-77566177a9a1 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] 10.222.0.13 "GET /compute/v2.1/servers/fad9d370-62bc-4997-919b-6671d4bbd740" status: 200 len: 1312 microversion: 2.1 time: 0.422527 Oct 30 01:44:22.124018 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fa73e7c0-aa1e-4a29-b68a-235c1ad7147a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1" status: 200 len: 1511 microversion: 2.1 time: 0.399819 Oct 30 01:44:22.125374 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2844/5681] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:21 2022] GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1 => generated 1511 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:44:22.129504 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2838/5682] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:21 2022] GET /compute/v2.1/servers/fad9d370-62bc-4997-919b-6671d4bbd740 => generated 1312 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:22.326289 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d613cf74-fef6-41ba-b0e1-e2a8f193e13e tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:22.327270 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d613cf74-fef6-41ba-b0e1-e2a8f193e13e tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] [instance: 0843d451-4ade-4a76-9a8a-a803182d73f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:22.345106 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d613cf74-fef6-41ba-b0e1-e2a8f193e13e tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:22.347263 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d613cf74-fef6-41ba-b0e1-e2a8f193e13e tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:22.348069 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d613cf74-fef6-41ba-b0e1-e2a8f193e13e tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:22.349056 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d613cf74-fef6-41ba-b0e1-e2a8f193e13e tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:22.349977 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d613cf74-fef6-41ba-b0e1-e2a8f193e13e tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:22.350624 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d613cf74-fef6-41ba-b0e1-e2a8f193e13e tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:22.561249 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d613cf74-fef6-41ba-b0e1-e2a8f193e13e tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e0dceb70ee44978260397d3c196dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1735a8d4dc541c7993bcf8a4f34dda8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:22.571912 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d613cf74-fef6-41ba-b0e1-e2a8f193e13e tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] 10.222.0.13 "GET /compute/v2.1/servers/0843d451-4ade-4a76-9a8a-a803182d73f9" status: 200 len: 1464 microversion: 2.1 time: 0.251989 Oct 30 01:44:22.586845 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2845/5683] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:22 2022] GET /compute/v2.1/servers/0843d451-4ade-4a76-9a8a-a803182d73f9 => generated 1464 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:22.632448 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-606d0aa8-bf6f-47cd-a521-b309ff4c1995 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:22.632968 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-606d0aa8-bf6f-47cd-a521-b309ff4c1995 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] [instance: 0843d451-4ade-4a76-9a8a-a803182d73f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:22.645375 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-606d0aa8-bf6f-47cd-a521-b309ff4c1995 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:22.645875 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-606d0aa8-bf6f-47cd-a521-b309ff4c1995 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:22.646954 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-606d0aa8-bf6f-47cd-a521-b309ff4c1995 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:22.647707 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-606d0aa8-bf6f-47cd-a521-b309ff4c1995 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:22.650824 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-606d0aa8-bf6f-47cd-a521-b309ff4c1995 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:22.655659 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-606d0aa8-bf6f-47cd-a521-b309ff4c1995 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:22.704836 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-606d0aa8-bf6f-47cd-a521-b309ff4c1995 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] [instance: 0843d451-4ade-4a76-9a8a-a803182d73f9] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:44:23.164026 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a0b10166-a448-4c00-b3ea-d4ccd566b626 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:23.165217 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a0b10166-a448-4c00-b3ea-d4ccd566b626 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] [instance: fad9d370-62bc-4997-919b-6671d4bbd740] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:23.185161 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a0b10166-a448-4c00-b3ea-d4ccd566b626 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:23.185694 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a0b10166-a448-4c00-b3ea-d4ccd566b626 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:23.186139 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a0b10166-a448-4c00-b3ea-d4ccd566b626 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:23.189349 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a0b10166-a448-4c00-b3ea-d4ccd566b626 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:23.190807 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a0b10166-a448-4c00-b3ea-d4ccd566b626 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:23.191721 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a0b10166-a448-4c00-b3ea-d4ccd566b626 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:23.262567 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-606d0aa8-bf6f-47cd-a521-b309ff4c1995 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0843d451-4ade-4a76-9a8a-a803182d73f9" status: 204 len: 0 microversion: 2.1 time: 0.618272 Oct 30 01:44:23.263537 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2839/5684] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:44:22 2022] DELETE /compute/v2.1/servers/0843d451-4ade-4a76-9a8a-a803182d73f9 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:44:23.273832 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a8063092-7e26-4387-be3e-52839a424fda tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:23.274597 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a8063092-7e26-4387-be3e-52839a424fda tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:23.281267 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a8063092-7e26-4387-be3e-52839a424fda tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:23.282167 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a8063092-7e26-4387-be3e-52839a424fda tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:23.283508 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a8063092-7e26-4387-be3e-52839a424fda tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:23.284455 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a8063092-7e26-4387-be3e-52839a424fda tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:23.285118 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a8063092-7e26-4387-be3e-52839a424fda tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:23.285792 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a8063092-7e26-4387-be3e-52839a424fda tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:23.324275 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:23.544283 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a0b10166-a448-4c00-b3ea-d4ccd566b626 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ccf9b5810f4c1a8d95e70e15624a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a1dab1c45d4be9946ec98786f36b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:23.555915 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a0b10166-a448-4c00-b3ea-d4ccd566b626 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] 10.222.0.13 "GET /compute/v2.1/servers/fad9d370-62bc-4997-919b-6671d4bbd740" status: 200 len: 1312 microversion: 2.1 time: 0.395103 Oct 30 01:44:23.560752 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2846/5685] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:23 2022] GET /compute/v2.1/servers/fad9d370-62bc-4997-919b-6671d4bbd740 => generated 1312 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:23.571018 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6a102c39-8195-40f9-a755-4564ecc6873a tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:23.571680 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6a102c39-8195-40f9-a755-4564ecc6873a tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] [instance: 0843d451-4ade-4a76-9a8a-a803182d73f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:23.604232 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a102c39-8195-40f9-a755-4564ecc6873a tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:23.607292 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a102c39-8195-40f9-a755-4564ecc6873a tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:23.609059 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a102c39-8195-40f9-a755-4564ecc6873a tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:23.610102 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a102c39-8195-40f9-a755-4564ecc6873a tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:23.612652 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a102c39-8195-40f9-a755-4564ecc6873a tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:23.613315 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a102c39-8195-40f9-a755-4564ecc6873a tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:23.629210 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a8063092-7e26-4387-be3e-52839a424fda tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:23.655602 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a8063092-7e26-4387-be3e-52839a424fda tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1" status: 200 len: 1511 microversion: 2.1 time: 0.390640 Oct 30 01:44:23.656170 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2840/5686] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:23 2022] GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1 => generated 1511 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:23.944924 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6a102c39-8195-40f9-a755-4564ecc6873a tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e0dceb70ee44978260397d3c196dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1735a8d4dc541c7993bcf8a4f34dda8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:23.954753 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6a102c39-8195-40f9-a755-4564ecc6873a tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] 10.222.0.13 "GET /compute/v2.1/servers/0843d451-4ade-4a76-9a8a-a803182d73f9" status: 200 len: 1470 microversion: 2.1 time: 0.393113 Oct 30 01:44:23.955669 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2847/5687] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:23 2022] GET /compute/v2.1/servers/0843d451-4ade-4a76-9a8a-a803182d73f9 => generated 1470 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:24.301850 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d6d3c625-c48a-44bd-9851-c4804b5a4594 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:24.302358 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d6d3c625-c48a-44bd-9851-c4804b5a4594 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:24.311078 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d6d3c625-c48a-44bd-9851-c4804b5a4594 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:24.313619 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d6d3c625-c48a-44bd-9851-c4804b5a4594 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:24.317951 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d6d3c625-c48a-44bd-9851-c4804b5a4594 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:24.318734 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d6d3c625-c48a-44bd-9851-c4804b5a4594 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:24.319434 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d6d3c625-c48a-44bd-9851-c4804b5a4594 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:24.319617 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d6d3c625-c48a-44bd-9851-c4804b5a4594 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:24.335499 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-d6d3c625-c48a-44bd-9851-c4804b5a4594 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] HTTP exception thrown: Instance b2e35e69-66f2-43a0-9baa-d8f70437561d could not be found. Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d6d3c625-c48a-44bd-9851-c4804b5a4594 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Request method failure captured: Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d HTTP/1.1 Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdUumvYALlX1ZEotYYfctadY85rkMIcCqpZFBAcTzKR92GeJdeuIBdMxiIzxgpC70Uj-cIJEgHazOdEuJ2nPCy0aOB6DMv1PnS8XxJSl3GFjmmFSeBD_Hmz1zCSH_Icmjv43STm9-8axTTUKObYyp4Juj43xfhv3UIItt81amHvJ3AU Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: X-Openstack-Nova-Api-Version: 2.20 Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: d206d5c4ea654a2194a77d71d27972e8 Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-119748518 Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d206d5c4ea654a2194a77d71d27972e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d206d5c4ea654a2194a77d71d27972e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d206d5c4ea654a2194a77d71d27972e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d206d5c4ea654a2194a77d71d27972e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-AttachVolumeShelveTestJSON-119748518 Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: d206d5c4ea654a2194a77d71d27972e8 Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-119748518 Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-AttachVolumeShelveTestJSON-119748518-project Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 93d18cf1316742dab78a102a257608ae Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-AttachVolumeShelveTestJSON-119748518-project Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: exception: Instance b2e35e69-66f2-43a0-9baa-d8f70437561d could not be found. Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'b2e35e69-66f2-43a0-9baa-d8f70437561d'} Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2e35e69-66f2-43a0-9baa-d8f70437561d could not be found. Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:44:24.337563 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:44:24.343029 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2e35e69-66f2-43a0-9baa-d8f70437561d could not be found. Oct 30 01:44:24.343029 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:44:24.343029 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:44:24.343029 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:44:24.343029 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:44:24.343029 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:44:24.343029 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:44:24.343029 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:44:24.343029 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:44:24.343029 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2e35e69-66f2-43a0-9baa-d8f70437561d could not be found. Oct 30 01:44:24.343029 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:44:24.345291 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d6d3c625-c48a-44bd-9851-c4804b5a4594 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Returning 404 to user: Instance b2e35e69-66f2-43a0-9baa-d8f70437561d could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:44:24.346408 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d6d3c625-c48a-44bd-9851-c4804b5a4594 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 404 len: 111 microversion: 2.20 time: 0.049289 Oct 30 01:44:24.350633 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2841/5688] 10.222.0.13 () {60 vars in 1280 bytes} [Sun Oct 30 01:44:24 2022] DELETE /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:44:24.355521 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d592adfc-2aba-440b-a96f-d8713750d027 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:24.356157 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d592adfc-2aba-440b-a96f-d8713750d027 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: b2e35e69-66f2-43a0-9baa-d8f70437561d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:24.384137 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d592adfc-2aba-440b-a96f-d8713750d027 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:24.384705 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d592adfc-2aba-440b-a96f-d8713750d027 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:24.385667 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d592adfc-2aba-440b-a96f-d8713750d027 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:24.389062 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d592adfc-2aba-440b-a96f-d8713750d027 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:24.389062 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d592adfc-2aba-440b-a96f-d8713750d027 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:24.389062 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d592adfc-2aba-440b-a96f-d8713750d027 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:24.418877 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-d592adfc-2aba-440b-a96f-d8713750d027 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] HTTP exception thrown: Instance b2e35e69-66f2-43a0-9baa-d8f70437561d could not be found. Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d592adfc-2aba-440b-a96f-d8713750d027 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Request method failure captured: Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d HTTP/1.1 Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdUumvYALlX1ZEotYYfctadY85rkMIcCqpZFBAcTzKR92GeJdeuIBdMxiIzxgpC70Uj-cIJEgHazOdEuJ2nPCy0aOB6DMv1PnS8XxJSl3GFjmmFSeBD_Hmz1zCSH_Icmjv43STm9-8axTTUKObYyp4Juj43xfhv3UIItt81amHvJ3AU Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: X-Openstack-Nova-Api-Version: 2.20 Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: d206d5c4ea654a2194a77d71d27972e8 Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-119748518 Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d206d5c4ea654a2194a77d71d27972e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d206d5c4ea654a2194a77d71d27972e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d206d5c4ea654a2194a77d71d27972e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d206d5c4ea654a2194a77d71d27972e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-AttachVolumeShelveTestJSON-119748518 Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: d206d5c4ea654a2194a77d71d27972e8 Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-119748518 Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-AttachVolumeShelveTestJSON-119748518-project Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 93d18cf1316742dab78a102a257608ae Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-AttachVolumeShelveTestJSON-119748518-project Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: exception: Instance b2e35e69-66f2-43a0-9baa-d8f70437561d could not be found. Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'b2e35e69-66f2-43a0-9baa-d8f70437561d'} Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2e35e69-66f2-43a0-9baa-d8f70437561d could not be found. Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2e35e69-66f2-43a0-9baa-d8f70437561d could not be found. Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:44:24.422218 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:44:24.426857 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:44:24.426857 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:44:24.426857 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:44:24.426857 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:44:24.426857 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:44:24.426857 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:44:24.426857 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2e35e69-66f2-43a0-9baa-d8f70437561d could not be found. Oct 30 01:44:24.426857 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:44:24.427808 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d592adfc-2aba-440b-a96f-d8713750d027 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Returning 404 to user: Instance b2e35e69-66f2-43a0-9baa-d8f70437561d could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:44:24.428303 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d592adfc-2aba-440b-a96f-d8713750d027 tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d" status: 404 len: 111 microversion: 2.20 time: 0.076589 Oct 30 01:44:24.428854 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2848/5689] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:44:24 2022] GET /compute/v2.1/servers/b2e35e69-66f2-43a0-9baa-d8f70437561d => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:44:24.587536 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b7e7332e-5c21-458e-b148-5eb4d90b0671 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:24.588095 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b7e7332e-5c21-458e-b148-5eb4d90b0671 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] [instance: fad9d370-62bc-4997-919b-6671d4bbd740] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:24.594278 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b7e7332e-5c21-458e-b148-5eb4d90b0671 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:24.594771 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b7e7332e-5c21-458e-b148-5eb4d90b0671 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:24.595310 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b7e7332e-5c21-458e-b148-5eb4d90b0671 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:24.596021 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b7e7332e-5c21-458e-b148-5eb4d90b0671 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:24.596480 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b7e7332e-5c21-458e-b148-5eb4d90b0671 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:24.596910 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b7e7332e-5c21-458e-b148-5eb4d90b0671 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:24.690070 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-08e3d868-e2c3-4227-953d-9fa8588d15d2 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:24.692684 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-08e3d868-e2c3-4227-953d-9fa8588d15d2 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:24.715444 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08e3d868-e2c3-4227-953d-9fa8588d15d2 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:24.717109 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08e3d868-e2c3-4227-953d-9fa8588d15d2 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:24.723151 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08e3d868-e2c3-4227-953d-9fa8588d15d2 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:24.724386 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08e3d868-e2c3-4227-953d-9fa8588d15d2 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:24.724976 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08e3d868-e2c3-4227-953d-9fa8588d15d2 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:24.726782 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08e3d868-e2c3-4227-953d-9fa8588d15d2 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:24.997496 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b7e7332e-5c21-458e-b148-5eb4d90b0671 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ccf9b5810f4c1a8d95e70e15624a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a1dab1c45d4be9946ec98786f36b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:25.019768 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b7e7332e-5c21-458e-b148-5eb4d90b0671 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] 10.222.0.13 "GET /compute/v2.1/servers/fad9d370-62bc-4997-919b-6671d4bbd740" status: 200 len: 1312 microversion: 2.1 time: 0.431107 Oct 30 01:44:25.019768 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2842/5690] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:24 2022] GET /compute/v2.1/servers/fad9d370-62bc-4997-919b-6671d4bbd740 => generated 1312 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:25.033709 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-db8091c4-2248-4595-a701-7b2fda59fe62 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:25.048655 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-db8091c4-2248-4595-a701-7b2fda59fe62 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] [instance: 0843d451-4ade-4a76-9a8a-a803182d73f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:25.070148 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-db8091c4-2248-4595-a701-7b2fda59fe62 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:25.077280 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-db8091c4-2248-4595-a701-7b2fda59fe62 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:25.080934 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-db8091c4-2248-4595-a701-7b2fda59fe62 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:25.081804 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-db8091c4-2248-4595-a701-7b2fda59fe62 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:25.082324 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-db8091c4-2248-4595-a701-7b2fda59fe62 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:25.087735 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-db8091c4-2248-4595-a701-7b2fda59fe62 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:25.421254 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-08e3d868-e2c3-4227-953d-9fa8588d15d2 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:25.432401 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-08e3d868-e2c3-4227-953d-9fa8588d15d2 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1" status: 200 len: 1511 microversion: 2.1 time: 0.755276 Oct 30 01:44:25.440661 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2849/5691] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:24 2022] GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1 => generated 1511 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:25.531763 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-db8091c4-2248-4595-a701-7b2fda59fe62 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e0dceb70ee44978260397d3c196dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1735a8d4dc541c7993bcf8a4f34dda8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:25.543896 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-db8091c4-2248-4595-a701-7b2fda59fe62 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] 10.222.0.13 "GET /compute/v2.1/servers/0843d451-4ade-4a76-9a8a-a803182d73f9" status: 200 len: 1470 microversion: 2.1 time: 0.522992 Oct 30 01:44:25.545175 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2843/5692] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:25 2022] GET /compute/v2.1/servers/0843d451-4ade-4a76-9a8a-a803182d73f9 => generated 1470 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:25.842631 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-d4c7e514-7871-4e09-b311-9d9238f37359 req-4740238b-6c74-4abc-b3dc-26d7fdd545c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fad9d370-62bc-4997-919b-6671d4bbd740", "name": "network-vif-plugged", "status": "completed", "tag": "43a46968-b849-4a2e-8258-663cb42fcef9"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:44:25.855283 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d4c7e514-7871-4e09-b311-9d9238f37359 req-4740238b-6c74-4abc-b3dc-26d7fdd545c6 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:25.856499 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d4c7e514-7871-4e09-b311-9d9238f37359 req-4740238b-6c74-4abc-b3dc-26d7fdd545c6 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:25.857252 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d4c7e514-7871-4e09-b311-9d9238f37359 req-4740238b-6c74-4abc-b3dc-26d7fdd545c6 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:25.879969 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-d4c7e514-7871-4e09-b311-9d9238f37359 req-4740238b-6c74-4abc-b3dc-26d7fdd545c6 service nova] Creating event network-vif-plugged:43a46968-b849-4a2e-8258-663cb42fcef9 for instance fad9d370-62bc-4997-919b-6671d4bbd740 on n-h2-master-1 Oct 30 01:44:25.898100 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-d4c7e514-7871-4e09-b311-9d9238f37359 req-4740238b-6c74-4abc-b3dc-26d7fdd545c6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058882 Oct 30 01:44:25.899239 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2850/5693] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:44:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:44:26.049145 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f7031b04-9f87-4221-8ba8-0dc83a281175 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:26.050248 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f7031b04-9f87-4221-8ba8-0dc83a281175 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] [instance: fad9d370-62bc-4997-919b-6671d4bbd740] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:26.063697 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f7031b04-9f87-4221-8ba8-0dc83a281175 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:26.079388 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f7031b04-9f87-4221-8ba8-0dc83a281175 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:26.082658 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f7031b04-9f87-4221-8ba8-0dc83a281175 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:26.088804 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f7031b04-9f87-4221-8ba8-0dc83a281175 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:26.089328 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f7031b04-9f87-4221-8ba8-0dc83a281175 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:26.093702 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f7031b04-9f87-4221-8ba8-0dc83a281175 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:26.165635 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-0e5460ba-8d8b-4d9b-940b-6231e626625e req-ea8beb13-9ed6-4b2c-b444-972ac20ddd30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0843d451-4ade-4a76-9a8a-a803182d73f9", "name": "network-vif-deleted", "tag": "50c4b16e-b4f8-4133-9fe0-4b0233432502"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:44:26.207076 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-0e5460ba-8d8b-4d9b-940b-6231e626625e req-ea8beb13-9ed6-4b2c-b444-972ac20ddd30 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:26.208604 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-0e5460ba-8d8b-4d9b-940b-6231e626625e req-ea8beb13-9ed6-4b2c-b444-972ac20ddd30 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:26.211271 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-0e5460ba-8d8b-4d9b-940b-6231e626625e req-ea8beb13-9ed6-4b2c-b444-972ac20ddd30 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:26.258893 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-0e5460ba-8d8b-4d9b-940b-6231e626625e req-ea8beb13-9ed6-4b2c-b444-972ac20ddd30 service nova] Creating event network-vif-deleted:50c4b16e-b4f8-4133-9fe0-4b0233432502 for instance 0843d451-4ade-4a76-9a8a-a803182d73f9 on n-h2-master-1 Oct 30 01:44:26.273505 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-0e5460ba-8d8b-4d9b-940b-6231e626625e req-ea8beb13-9ed6-4b2c-b444-972ac20ddd30 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110466 Oct 30 01:44:26.282694 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2851/5694] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:44:26.394609 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f7031b04-9f87-4221-8ba8-0dc83a281175 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ccf9b5810f4c1a8d95e70e15624a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a1dab1c45d4be9946ec98786f36b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:26.402800 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f7031b04-9f87-4221-8ba8-0dc83a281175 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] 10.222.0.13 "GET /compute/v2.1/servers/fad9d370-62bc-4997-919b-6671d4bbd740" status: 200 len: 1312 microversion: 2.1 time: 0.358982 Oct 30 01:44:26.403115 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2844/5695] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:26 2022] GET /compute/v2.1/servers/fad9d370-62bc-4997-919b-6671d4bbd740 => generated 1312 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:26.464980 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3e29cc91-20d4-4274-bba6-0c229b4cdf55 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:26.465643 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3e29cc91-20d4-4274-bba6-0c229b4cdf55 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:26.473867 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3e29cc91-20d4-4274-bba6-0c229b4cdf55 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:26.474614 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3e29cc91-20d4-4274-bba6-0c229b4cdf55 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:26.475209 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3e29cc91-20d4-4274-bba6-0c229b4cdf55 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:26.476003 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3e29cc91-20d4-4274-bba6-0c229b4cdf55 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:26.476453 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3e29cc91-20d4-4274-bba6-0c229b4cdf55 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:26.476875 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3e29cc91-20d4-4274-bba6-0c229b4cdf55 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:26.570841 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-793fa442-7aa0-4eca-996b-7ba82055bac7 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:26.571484 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-793fa442-7aa0-4eca-996b-7ba82055bac7 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] [instance: 0843d451-4ade-4a76-9a8a-a803182d73f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:26.587807 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-793fa442-7aa0-4eca-996b-7ba82055bac7 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:26.587807 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-793fa442-7aa0-4eca-996b-7ba82055bac7 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:26.587807 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-793fa442-7aa0-4eca-996b-7ba82055bac7 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:26.587807 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-793fa442-7aa0-4eca-996b-7ba82055bac7 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:26.588228 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-793fa442-7aa0-4eca-996b-7ba82055bac7 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:26.588783 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-793fa442-7aa0-4eca-996b-7ba82055bac7 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:26.679923 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-793fa442-7aa0-4eca-996b-7ba82055bac7 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e0dceb70ee44978260397d3c196dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1735a8d4dc541c7993bcf8a4f34dda8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:26.687332 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3e29cc91-20d4-4274-bba6-0c229b4cdf55 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:26.696505 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3e29cc91-20d4-4274-bba6-0c229b4cdf55 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1" status: 200 len: 1488 microversion: 2.1 time: 0.235977 Oct 30 01:44:26.696966 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-793fa442-7aa0-4eca-996b-7ba82055bac7 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] 10.222.0.13 "GET /compute/v2.1/servers/0843d451-4ade-4a76-9a8a-a803182d73f9" status: 200 len: 1299 microversion: 2.1 time: 0.130717 Oct 30 01:44:26.697922 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2852/5696] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:26 2022] GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1 => generated 1488 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:44:26.701708 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2845/5697] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:26 2022] GET /compute/v2.1/servers/0843d451-4ade-4a76-9a8a-a803182d73f9 => generated 1299 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:26.727097 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-870f5cfb-1f4c-4c15-bcfc-dc509d51979f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:44:26.730758 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-870f5cfb-1f4c-4c15-bcfc-dc509d51979f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:26.739284 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-870f5cfb-1f4c-4c15-bcfc-dc509d51979f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:26.740147 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-870f5cfb-1f4c-4c15-bcfc-dc509d51979f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:26.740979 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-870f5cfb-1f4c-4c15-bcfc-dc509d51979f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:26.741924 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-870f5cfb-1f4c-4c15-bcfc-dc509d51979f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:26.742811 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-870f5cfb-1f4c-4c15-bcfc-dc509d51979f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:26.743611 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-870f5cfb-1f4c-4c15-bcfc-dc509d51979f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:27.001597 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-870f5cfb-1f4c-4c15-bcfc-dc509d51979f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "POST /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9/action" status: 200 len: 126 microversion: 2.1 time: 0.278349 Oct 30 01:44:27.002564 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2853/5698] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:44:26 2022] POST /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9/action => generated 126 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:44:27.015225 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-92d3787b-1391-4468-8035-fce240a2751d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:27.016047 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-92d3787b-1391-4468-8035-fce240a2751d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:27.023029 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92d3787b-1391-4468-8035-fce240a2751d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:27.023533 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92d3787b-1391-4468-8035-fce240a2751d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:27.023971 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92d3787b-1391-4468-8035-fce240a2751d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:27.024748 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92d3787b-1391-4468-8035-fce240a2751d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:27.025244 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92d3787b-1391-4468-8035-fce240a2751d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:27.025914 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92d3787b-1391-4468-8035-fce240a2751d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:27.201195 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-92d3787b-1391-4468-8035-fce240a2751d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:27.234389 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-92d3787b-1391-4468-8035-fce240a2751d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1670 microversion: 2.1 time: 0.225091 Oct 30 01:44:27.237286 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2846/5699] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:27 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1670 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:27.269001 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e497ade2-c56e-4dcc-bf1a-86e8890c386d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:27.269856 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e497ade2-c56e-4dcc-bf1a-86e8890c386d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:27.277824 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e497ade2-c56e-4dcc-bf1a-86e8890c386d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:27.278427 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e497ade2-c56e-4dcc-bf1a-86e8890c386d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:27.279245 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e497ade2-c56e-4dcc-bf1a-86e8890c386d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:27.280163 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e497ade2-c56e-4dcc-bf1a-86e8890c386d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:27.280827 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e497ade2-c56e-4dcc-bf1a-86e8890c386d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:27.281513 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e497ade2-c56e-4dcc-bf1a-86e8890c386d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:27.427635 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b6640f3e-2aaf-4500-8f41-6ceae61a3b04 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:27.427635 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b6640f3e-2aaf-4500-8f41-6ceae61a3b04 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] [instance: fad9d370-62bc-4997-919b-6671d4bbd740] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:27.440155 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b6640f3e-2aaf-4500-8f41-6ceae61a3b04 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:27.441640 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b6640f3e-2aaf-4500-8f41-6ceae61a3b04 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:27.442401 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b6640f3e-2aaf-4500-8f41-6ceae61a3b04 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:27.443417 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b6640f3e-2aaf-4500-8f41-6ceae61a3b04 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:27.462221 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b6640f3e-2aaf-4500-8f41-6ceae61a3b04 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:27.462340 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b6640f3e-2aaf-4500-8f41-6ceae61a3b04 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:27.503201 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e497ade2-c56e-4dcc-bf1a-86e8890c386d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:27.516893 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e497ade2-c56e-4dcc-bf1a-86e8890c386d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1670 microversion: 2.1 time: 0.251466 Oct 30 01:44:27.518197 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2854/5700] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:27 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1670 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:27.541202 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bf1bd9a5-1d36-4625-a7e9-866046e5a658 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:27.542528 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-bf1bd9a5-1d36-4625-a7e9-866046e5a658 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:27.549524 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bf1bd9a5-1d36-4625-a7e9-866046e5a658 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:27.550481 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bf1bd9a5-1d36-4625-a7e9-866046e5a658 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:27.551085 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bf1bd9a5-1d36-4625-a7e9-866046e5a658 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:27.551973 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bf1bd9a5-1d36-4625-a7e9-866046e5a658 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:27.553224 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bf1bd9a5-1d36-4625-a7e9-866046e5a658 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:27.553884 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bf1bd9a5-1d36-4625-a7e9-866046e5a658 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:27.726098 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b6640f3e-2aaf-4500-8f41-6ceae61a3b04 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ccf9b5810f4c1a8d95e70e15624a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a1dab1c45d4be9946ec98786f36b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:27.737629 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b6640f3e-2aaf-4500-8f41-6ceae61a3b04 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] 10.222.0.13 "GET /compute/v2.1/servers/fad9d370-62bc-4997-919b-6671d4bbd740" status: 200 len: 1312 microversion: 2.1 time: 0.315403 Oct 30 01:44:27.738330 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2847/5701] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:27 2022] GET /compute/v2.1/servers/fad9d370-62bc-4997-919b-6671d4bbd740 => generated 1312 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:44:27.760250 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cbdde8aa-c9b7-4110-9d32-e1bf12802c3b tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:27.760250 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cbdde8aa-c9b7-4110-9d32-e1bf12802c3b tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] [instance: 0843d451-4ade-4a76-9a8a-a803182d73f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:27.760866 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-bf1bd9a5-1d36-4625-a7e9-866046e5a658 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:27.765357 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cbdde8aa-c9b7-4110-9d32-e1bf12802c3b tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:27.765855 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cbdde8aa-c9b7-4110-9d32-e1bf12802c3b tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:27.766329 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cbdde8aa-c9b7-4110-9d32-e1bf12802c3b tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:27.767054 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cbdde8aa-c9b7-4110-9d32-e1bf12802c3b tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:27.767515 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cbdde8aa-c9b7-4110-9d32-e1bf12802c3b tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:27.767946 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cbdde8aa-c9b7-4110-9d32-e1bf12802c3b tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:27.773846 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bf1bd9a5-1d36-4625-a7e9-866046e5a658 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1670 microversion: 2.1 time: 0.236989 Oct 30 01:44:27.774593 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2855/5702] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:27 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1670 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:44:27.806163 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e2eed056-1e41-453a-8ec8-f465382fdfa4 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:27.807234 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e2eed056-1e41-453a-8ec8-f465382fdfa4 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:27.826737 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2eed056-1e41-453a-8ec8-f465382fdfa4 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:27.828759 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2eed056-1e41-453a-8ec8-f465382fdfa4 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:27.829209 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2eed056-1e41-453a-8ec8-f465382fdfa4 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:27.829957 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2eed056-1e41-453a-8ec8-f465382fdfa4 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:27.830414 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2eed056-1e41-453a-8ec8-f465382fdfa4 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:27.833638 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2eed056-1e41-453a-8ec8-f465382fdfa4 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:27.834207 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cbdde8aa-c9b7-4110-9d32-e1bf12802c3b tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:27.834696 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cbdde8aa-c9b7-4110-9d32-e1bf12802c3b tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:27.835123 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cbdde8aa-c9b7-4110-9d32-e1bf12802c3b tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:27.835574 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-cbdde8aa-c9b7-4110-9d32-e1bf12802c3b tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lazy-loading 'fault' on Instance uuid 0843d451-4ade-4a76-9a8a-a803182d73f9 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:44:27.891353 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-cbdde8aa-c9b7-4110-9d32-e1bf12802c3b tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e0dceb70ee44978260397d3c196dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1735a8d4dc541c7993bcf8a4f34dda8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:27.903376 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cbdde8aa-c9b7-4110-9d32-e1bf12802c3b tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] 10.222.0.13 "GET /compute/v2.1/servers/0843d451-4ade-4a76-9a8a-a803182d73f9" status: 200 len: 1304 microversion: 2.1 time: 0.163704 Oct 30 01:44:27.906460 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2848/5703] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:27 2022] GET /compute/v2.1/servers/0843d451-4ade-4a76-9a8a-a803182d73f9 => generated 1304 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:28.026829 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e2eed056-1e41-453a-8ec8-f465382fdfa4 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:28.036543 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e2eed056-1e41-453a-8ec8-f465382fdfa4 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1670 microversion: 2.1 time: 0.234824 Oct 30 01:44:28.041387 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2856/5704] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:27 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1670 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:44:28.169901 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d4f9a27c-3235-443c-a2ec-f3581060582f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1766764282", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "c8b5246f-f8f5-404d-864d-b312dbb308c5"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:44:28.230701 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-d4f9a27c-3235-443c-a2ec-f3581060582f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] validate_networks() for [('c8b5246f-f8f5-404d-864d-b312dbb308c5', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:44:28.667131 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-d4f9a27c-3235-443c-a2ec-f3581060582f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:44:28.667539 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-d4f9a27c-3235-443c-a2ec-f3581060582f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:44:28.679852 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-d4f9a27c-3235-443c-a2ec-f3581060582f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:44:28.679852 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-d4f9a27c-3235-443c-a2ec-f3581060582f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:44:28.679852 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-d4f9a27c-3235-443c-a2ec-f3581060582f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:44:28.679852 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4f9a27c-3235-443c-a2ec-f3581060582f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:28.679852 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4f9a27c-3235-443c-a2ec-f3581060582f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:28.679852 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4f9a27c-3235-443c-a2ec-f3581060582f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:28.679852 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4f9a27c-3235-443c-a2ec-f3581060582f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:28.680462 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4f9a27c-3235-443c-a2ec-f3581060582f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:28.680717 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4f9a27c-3235-443c-a2ec-f3581060582f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:28.697726 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-d4f9a27c-3235-443c-a2ec-f3581060582f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Getting quotas for project 9f9d0d541cc3496ebf8dc71af4254506. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:44:28.702934 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-d4f9a27c-3235-443c-a2ec-f3581060582f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Getting quotas for user 157c0ef579434726810bb3775388b944 and project 9f9d0d541cc3496ebf8dc71af4254506. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:44:28.715823 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d4f9a27c-3235-443c-a2ec-f3581060582f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:44:28.718253 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d4f9a27c-3235-443c-a2ec-f3581060582f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: a0a1550e-e885-495b-9199-04334dce39dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:44:28.763758 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-860f2b6f-5568-4e5b-982c-704da300030d tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:28.764530 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-860f2b6f-5568-4e5b-982c-704da300030d tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] [instance: fad9d370-62bc-4997-919b-6671d4bbd740] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:28.771489 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-860f2b6f-5568-4e5b-982c-704da300030d tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:28.772006 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-860f2b6f-5568-4e5b-982c-704da300030d tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:28.772444 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-860f2b6f-5568-4e5b-982c-704da300030d tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:28.773263 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-860f2b6f-5568-4e5b-982c-704da300030d tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:28.773746 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-860f2b6f-5568-4e5b-982c-704da300030d tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:28.774169 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-860f2b6f-5568-4e5b-982c-704da300030d tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:28.849540 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d4f9a27c-3235-443c-a2ec-f3581060582f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.684581 Oct 30 01:44:28.851258 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2849/5705] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:44:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:44:28.863923 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-74589651-357a-4553-a388-39bedcc7dcd9 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:28.864994 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-74589651-357a-4553-a388-39bedcc7dcd9 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: a0a1550e-e885-495b-9199-04334dce39dd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:28.946843 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-74589651-357a-4553-a388-39bedcc7dcd9 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:28.956576 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-74589651-357a-4553-a388-39bedcc7dcd9 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd" status: 200 len: 1215 microversion: 2.1 time: 0.096877 Oct 30 01:44:28.957784 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2850/5706] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:28 2022] GET /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd => generated 1215 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:28.964475 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-47e97e44-b019-48e9-b45f-849d92b55f11 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:28.965296 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-47e97e44-b019-48e9-b45f-849d92b55f11 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] [instance: 0843d451-4ade-4a76-9a8a-a803182d73f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:28.974777 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-47e97e44-b019-48e9-b45f-849d92b55f11 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:28.975926 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-47e97e44-b019-48e9-b45f-849d92b55f11 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:28.976495 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-47e97e44-b019-48e9-b45f-849d92b55f11 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:28.977700 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-47e97e44-b019-48e9-b45f-849d92b55f11 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:28.984162 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-47e97e44-b019-48e9-b45f-849d92b55f11 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:28.984162 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-47e97e44-b019-48e9-b45f-849d92b55f11 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:28.999045 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-860f2b6f-5568-4e5b-982c-704da300030d tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ccf9b5810f4c1a8d95e70e15624a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a1dab1c45d4be9946ec98786f36b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:29.008793 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-860f2b6f-5568-4e5b-982c-704da300030d tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] 10.222.0.13 "GET /compute/v2.1/servers/fad9d370-62bc-4997-919b-6671d4bbd740" status: 200 len: 1496 microversion: 2.1 time: 0.249040 Oct 30 01:44:29.012477 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-47e97e44-b019-48e9-b45f-849d92b55f11 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] HTTP exception thrown: Instance 0843d451-4ade-4a76-9a8a-a803182d73f9 could not be found. Oct 30 01:44:29.013686 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2857/5707] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:28 2022] GET /compute/v2.1/servers/fad9d370-62bc-4997-919b-6671d4bbd740 => generated 1496 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-47e97e44-b019-48e9-b45f-849d92b55f11 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Request method failure captured: Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/0843d451-4ade-4a76-9a8a-a803182d73f9 HTTP/1.1 Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdbdOkf_9MiY7dQR0TCgMldXOkulYc9SckTTs8JWwschGZxGvoME8lX6rcT-V_z0l6-O1GEGhtdOH2U8NyFNs8GBSH_f8gEtY6-hLliVdHnAV2BM09CtIxEnhGAo7EyLcAWJ0rV0zBbshJS3JwPmFUmhwbzIkXzdhYNHlzNk2Gj6e5A Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: c1735a8d4dc541c7993bcf8a4f34dda8 Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-VolumesNegativeTest-420725466 Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c1735a8d4dc541c7993bcf8a4f34dda8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c1735a8d4dc541c7993bcf8a4f34dda8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c1735a8d4dc541c7993bcf8a4f34dda8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c1735a8d4dc541c7993bcf8a4f34dda8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-VolumesNegativeTest-420725466 Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: c1735a8d4dc541c7993bcf8a4f34dda8 Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-VolumesNegativeTest-420725466 Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-VolumesNegativeTest-420725466-project Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: f7e0dceb70ee44978260397d3c196dc2 Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-VolumesNegativeTest-420725466-project Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 0843d451-4ade-4a76-9a8a-a803182d73f9 could not be found. Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '0843d451-4ade-4a76-9a8a-a803182d73f9'} Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0843d451-4ade-4a76-9a8a-a803182d73f9 could not be found. Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0843d451-4ade-4a76-9a8a-a803182d73f9 could not be found. Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:44:29.021931 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:44:29.035727 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:44:29.035727 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:44:29.035727 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:44:29.035727 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:44:29.035727 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:44:29.035727 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0843d451-4ade-4a76-9a8a-a803182d73f9 could not be found. Oct 30 01:44:29.035727 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:44:29.035727 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-47e97e44-b019-48e9-b45f-849d92b55f11 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] Returning 404 to user: Instance 0843d451-4ade-4a76-9a8a-a803182d73f9 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:44:29.035727 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-47e97e44-b019-48e9-b45f-849d92b55f11 tempest-VolumesNegativeTest-420725466 tempest-VolumesNegativeTest-420725466-project] 10.222.0.13 "GET /compute/v2.1/servers/0843d451-4ade-4a76-9a8a-a803182d73f9" status: 404 len: 111 microversion: 2.1 time: 0.064707 Oct 30 01:44:29.035727 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2851/5708] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:28 2022] GET /compute/v2.1/servers/0843d451-4ade-4a76-9a8a-a803182d73f9 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:44:29.038883 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2458e187-7bf0-4efb-99f3-a3ab8521e511 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:29.053016 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.compute.server_groups [None req-2458e187-7bf0-4efb-99f3-a3ab8521e511 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Querying cell 7a264aef-b8bb-4843-8958-43bc38c25cb0(cell1) for 1 instances {{(pid=121103) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 30 01:44:29.054010 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2458e187-7bf0-4efb-99f3-a3ab8521e511 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:29.054650 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2458e187-7bf0-4efb-99f3-a3ab8521e511 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:29.056389 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2458e187-7bf0-4efb-99f3-a3ab8521e511 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:29.085383 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-82dc8310-f034-4bd1-ae01-0dd78abee52d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:29.085383 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-82dc8310-f034-4bd1-ae01-0dd78abee52d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:29.090172 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2458e187-7bf0-4efb-99f3-a3ab8521e511 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] 10.222.0.13 "GET /compute/v2.1/os-server-groups/23cf4f00-6b57-4be0-abf9-09d3ef54cc86" status: 200 len: 222 microversion: 2.1 time: 0.056212 Oct 30 01:44:29.092736 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-82dc8310-f034-4bd1-ae01-0dd78abee52d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:29.093229 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-82dc8310-f034-4bd1-ae01-0dd78abee52d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:29.094006 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2858/5709] 10.222.0.13 () {58 vars in 1263 bytes} [Sun Oct 30 01:44:29 2022] GET /compute/v2.1/os-server-groups/23cf4f00-6b57-4be0-abf9-09d3ef54cc86 => generated 222 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:44:29.094537 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-82dc8310-f034-4bd1-ae01-0dd78abee52d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:29.095315 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-82dc8310-f034-4bd1-ae01-0dd78abee52d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:29.095763 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-82dc8310-f034-4bd1-ae01-0dd78abee52d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:29.096424 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-82dc8310-f034-4bd1-ae01-0dd78abee52d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:29.109247 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-892387de-d3b2-4b50-ba36-3c78e39322e8 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:29.109247 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-892387de-d3b2-4b50-ba36-3c78e39322e8 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] [instance: fad9d370-62bc-4997-919b-6671d4bbd740] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:29.117017 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-892387de-d3b2-4b50-ba36-3c78e39322e8 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:29.117548 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-892387de-d3b2-4b50-ba36-3c78e39322e8 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:29.117974 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-892387de-d3b2-4b50-ba36-3c78e39322e8 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:29.125394 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-892387de-d3b2-4b50-ba36-3c78e39322e8 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:29.125949 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-892387de-d3b2-4b50-ba36-3c78e39322e8 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:29.126371 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-892387de-d3b2-4b50-ba36-3c78e39322e8 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:29.131140 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-82dc8310-f034-4bd1-ae01-0dd78abee52d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] HTTP exception thrown: Instance a5389398-bf67-44ff-a1fb-a26e4a079fcb could not be found. Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-82dc8310-f034-4bd1-ae01-0dd78abee52d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Request method failure captured: Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb HTTP/1.1 Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdUumvYALlX1ZEotYYfctadY85rkMIcCqpZFBAcTzKR92GeJdeuIBdMxiIzxgpC70Uj-cIJEgHazOdEuJ2nPCy0aOB6DMv1PnS8XxJSl3GFjmmFSeBD_Hmz1zCSH_Icmjv43STm9-8axTTUKObYyp4Juj43xfhv3UIItt81amHvJ3AU Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: X-Openstack-Nova-Api-Version: 2.20 Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: d206d5c4ea654a2194a77d71d27972e8 Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-119748518 Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d206d5c4ea654a2194a77d71d27972e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d206d5c4ea654a2194a77d71d27972e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d206d5c4ea654a2194a77d71d27972e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d206d5c4ea654a2194a77d71d27972e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-AttachVolumeShelveTestJSON-119748518 Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: d206d5c4ea654a2194a77d71d27972e8 Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-119748518 Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-AttachVolumeShelveTestJSON-119748518-project Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 93d18cf1316742dab78a102a257608ae Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-AttachVolumeShelveTestJSON-119748518-project Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: exception: Instance a5389398-bf67-44ff-a1fb-a26e4a079fcb could not be found. Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'a5389398-bf67-44ff-a1fb-a26e4a079fcb'} Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5389398-bf67-44ff-a1fb-a26e4a079fcb could not be found. Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:44:29.132442 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:44:29.137223 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5389398-bf67-44ff-a1fb-a26e4a079fcb could not be found. Oct 30 01:44:29.137223 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:44:29.137223 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:44:29.137223 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:44:29.137223 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:44:29.137223 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:44:29.137223 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:44:29.137223 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:44:29.137223 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:44:29.137223 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5389398-bf67-44ff-a1fb-a26e4a079fcb could not be found. Oct 30 01:44:29.137223 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:44:29.137223 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-82dc8310-f034-4bd1-ae01-0dd78abee52d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Returning 404 to user: Instance a5389398-bf67-44ff-a1fb-a26e4a079fcb could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:44:29.137223 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-82dc8310-f034-4bd1-ae01-0dd78abee52d tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 404 len: 111 microversion: 2.20 time: 0.055465 Oct 30 01:44:29.139512 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2852/5710] 10.222.0.13 () {60 vars in 1280 bytes} [Sun Oct 30 01:44:29 2022] DELETE /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:44:29.145137 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9ade7d38-c368-4f51-8f45-b004d9a129fe tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:29.146267 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9ade7d38-c368-4f51-8f45-b004d9a129fe tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] [instance: a5389398-bf67-44ff-a1fb-a26e4a079fcb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:29.155108 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9ade7d38-c368-4f51-8f45-b004d9a129fe tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:29.157452 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9ade7d38-c368-4f51-8f45-b004d9a129fe tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:29.157452 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9ade7d38-c368-4f51-8f45-b004d9a129fe tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:29.157452 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9ade7d38-c368-4f51-8f45-b004d9a129fe tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:29.158533 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9ade7d38-c368-4f51-8f45-b004d9a129fe tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:29.159153 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9ade7d38-c368-4f51-8f45-b004d9a129fe tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:29.161115 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-892387de-d3b2-4b50-ba36-3c78e39322e8 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] [instance: fad9d370-62bc-4997-919b-6671d4bbd740] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:44:29.176412 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-9ade7d38-c368-4f51-8f45-b004d9a129fe tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] HTTP exception thrown: Instance a5389398-bf67-44ff-a1fb-a26e4a079fcb could not be found. Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9ade7d38-c368-4f51-8f45-b004d9a129fe tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Request method failure captured: Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb HTTP/1.1 Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdUumvYALlX1ZEotYYfctadY85rkMIcCqpZFBAcTzKR92GeJdeuIBdMxiIzxgpC70Uj-cIJEgHazOdEuJ2nPCy0aOB6DMv1PnS8XxJSl3GFjmmFSeBD_Hmz1zCSH_Icmjv43STm9-8axTTUKObYyp4Juj43xfhv3UIItt81amHvJ3AU Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: X-Openstack-Nova-Api-Version: 2.20 Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: d206d5c4ea654a2194a77d71d27972e8 Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-119748518 Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d206d5c4ea654a2194a77d71d27972e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d206d5c4ea654a2194a77d71d27972e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d206d5c4ea654a2194a77d71d27972e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d206d5c4ea654a2194a77d71d27972e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-AttachVolumeShelveTestJSON-119748518 Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: d206d5c4ea654a2194a77d71d27972e8 Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-119748518 Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-AttachVolumeShelveTestJSON-119748518-project Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 93d18cf1316742dab78a102a257608ae Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-AttachVolumeShelveTestJSON-119748518-project Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: exception: Instance a5389398-bf67-44ff-a1fb-a26e4a079fcb could not be found. Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'a5389398-bf67-44ff-a1fb-a26e4a079fcb'} Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5389398-bf67-44ff-a1fb-a26e4a079fcb could not be found. Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5389398-bf67-44ff-a1fb-a26e4a079fcb could not be found. Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:44:29.178226 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:44:29.188583 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:44:29.188583 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:44:29.188583 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:44:29.188583 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:44:29.188583 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:44:29.188583 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:44:29.188583 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5389398-bf67-44ff-a1fb-a26e4a079fcb could not be found. Oct 30 01:44:29.188583 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:44:29.188583 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9ade7d38-c368-4f51-8f45-b004d9a129fe tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] Returning 404 to user: Instance a5389398-bf67-44ff-a1fb-a26e4a079fcb could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:44:29.188583 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9ade7d38-c368-4f51-8f45-b004d9a129fe tempest-AttachVolumeShelveTestJSON-119748518 tempest-AttachVolumeShelveTestJSON-119748518-project] 10.222.0.13 "GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb" status: 404 len: 111 microversion: 2.20 time: 0.039252 Oct 30 01:44:29.188583 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2853/5711] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 30 01:44:29 2022] GET /compute/v2.1/servers/a5389398-bf67-44ff-a1fb-a26e4a079fcb => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:44:29.248231 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:29.622364 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-892387de-d3b2-4b50-ba36-3c78e39322e8 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] 10.222.0.13 "DELETE /compute/v2.1/servers/fad9d370-62bc-4997-919b-6671d4bbd740" status: 204 len: 0 microversion: 2.1 time: 0.521293 Oct 30 01:44:29.622962 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2859/5712] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:44:29 2022] DELETE /compute/v2.1/servers/fad9d370-62bc-4997-919b-6671d4bbd740 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 30 01:44:29.633567 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-488ec58f-362a-4840-bd69-d76826d34f58 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:29.634287 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-488ec58f-362a-4840-bd69-d76826d34f58 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] [instance: fad9d370-62bc-4997-919b-6671d4bbd740] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:29.646408 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-488ec58f-362a-4840-bd69-d76826d34f58 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:29.646911 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-488ec58f-362a-4840-bd69-d76826d34f58 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:29.649554 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-488ec58f-362a-4840-bd69-d76826d34f58 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:29.654056 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-488ec58f-362a-4840-bd69-d76826d34f58 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:29.654056 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-488ec58f-362a-4840-bd69-d76826d34f58 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:29.654056 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-488ec58f-362a-4840-bd69-d76826d34f58 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:29.986382 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-998b15ab-fdd2-46a8-b371-ff8788aee821 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:29.987108 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-998b15ab-fdd2-46a8-b371-ff8788aee821 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: a0a1550e-e885-495b-9199-04334dce39dd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:30.276984 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-998b15ab-fdd2-46a8-b371-ff8788aee821 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:30.289672 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-998b15ab-fdd2-46a8-b371-ff8788aee821 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd" status: 200 len: 1215 microversion: 2.1 time: 0.307133 Oct 30 01:44:30.292772 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2860/5713] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:29 2022] GET /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd => generated 1215 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:44:30.659514 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-488ec58f-362a-4840-bd69-d76826d34f58 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ccf9b5810f4c1a8d95e70e15624a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a1dab1c45d4be9946ec98786f36b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:30.670340 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-488ec58f-362a-4840-bd69-d76826d34f58 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] 10.222.0.13 "GET /compute/v2.1/servers/fad9d370-62bc-4997-919b-6671d4bbd740" status: 200 len: 1502 microversion: 2.1 time: 1.042482 Oct 30 01:44:30.671509 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2854/5714] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:29 2022] GET /compute/v2.1/servers/fad9d370-62bc-4997-919b-6671d4bbd740 => generated 1502 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:31.328358 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9bffebe6-bd0c-457a-97fb-1dda3afce79a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:31.329815 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9bffebe6-bd0c-457a-97fb-1dda3afce79a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: a0a1550e-e885-495b-9199-04334dce39dd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:31.353939 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9bffebe6-bd0c-457a-97fb-1dda3afce79a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:31.353939 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9bffebe6-bd0c-457a-97fb-1dda3afce79a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:31.353939 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9bffebe6-bd0c-457a-97fb-1dda3afce79a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:31.353939 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9bffebe6-bd0c-457a-97fb-1dda3afce79a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:31.353939 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9bffebe6-bd0c-457a-97fb-1dda3afce79a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:31.356361 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9bffebe6-bd0c-457a-97fb-1dda3afce79a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:31.434784 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9bffebe6-bd0c-457a-97fb-1dda3afce79a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:31.442547 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9bffebe6-bd0c-457a-97fb-1dda3afce79a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd" status: 200 len: 1211 microversion: 2.1 time: 0.124695 Oct 30 01:44:31.443123 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2861/5715] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:31 2022] GET /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd => generated 1211 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:31.695740 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-48d1adfe-ff31-4f83-aa4f-7e57da12b472 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:31.696954 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-48d1adfe-ff31-4f83-aa4f-7e57da12b472 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] [instance: fad9d370-62bc-4997-919b-6671d4bbd740] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:31.708260 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-48d1adfe-ff31-4f83-aa4f-7e57da12b472 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:31.708759 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-48d1adfe-ff31-4f83-aa4f-7e57da12b472 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:31.709202 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-48d1adfe-ff31-4f83-aa4f-7e57da12b472 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:31.709974 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-48d1adfe-ff31-4f83-aa4f-7e57da12b472 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:31.710436 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-48d1adfe-ff31-4f83-aa4f-7e57da12b472 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:31.710863 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-48d1adfe-ff31-4f83-aa4f-7e57da12b472 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:31.930699 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-48d1adfe-ff31-4f83-aa4f-7e57da12b472 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ccf9b5810f4c1a8d95e70e15624a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a1dab1c45d4be9946ec98786f36b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:31.947341 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-7ef47d23-1a93-407c-bd0f-ddc2aef31a08 req-9c5db02e-f71b-4487-8c96-cc6949b31e08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fad9d370-62bc-4997-919b-6671d4bbd740", "name": "network-vif-deleted", "tag": "43a46968-b849-4a2e-8258-663cb42fcef9"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:44:31.947484 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-48d1adfe-ff31-4f83-aa4f-7e57da12b472 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] 10.222.0.13 "GET /compute/v2.1/servers/fad9d370-62bc-4997-919b-6671d4bbd740" status: 200 len: 1460 microversion: 2.1 time: 0.254235 Oct 30 01:44:31.964755 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2855/5716] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:31 2022] GET /compute/v2.1/servers/fad9d370-62bc-4997-919b-6671d4bbd740 => generated 1460 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:31.970707 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-7ef47d23-1a93-407c-bd0f-ddc2aef31a08 req-9c5db02e-f71b-4487-8c96-cc6949b31e08 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:31.974711 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-7ef47d23-1a93-407c-bd0f-ddc2aef31a08 req-9c5db02e-f71b-4487-8c96-cc6949b31e08 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:31.977825 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-7ef47d23-1a93-407c-bd0f-ddc2aef31a08 req-9c5db02e-f71b-4487-8c96-cc6949b31e08 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:32.006093 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-7ef47d23-1a93-407c-bd0f-ddc2aef31a08 req-9c5db02e-f71b-4487-8c96-cc6949b31e08 service nova] Creating event network-vif-deleted:43a46968-b849-4a2e-8258-663cb42fcef9 for instance fad9d370-62bc-4997-919b-6671d4bbd740 on n-h2-master-1 Oct 30 01:44:32.016977 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-7ef47d23-1a93-407c-bd0f-ddc2aef31a08 req-9c5db02e-f71b-4487-8c96-cc6949b31e08 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075387 Oct 30 01:44:32.019816 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2862/5717] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:44:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:44:32.467523 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-221fa864-eb8f-452f-8c0d-945ca9bf0aec tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:32.468217 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-221fa864-eb8f-452f-8c0d-945ca9bf0aec tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: a0a1550e-e885-495b-9199-04334dce39dd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:32.470214 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:32.491058 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-221fa864-eb8f-452f-8c0d-945ca9bf0aec tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:32.492238 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-221fa864-eb8f-452f-8c0d-945ca9bf0aec tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:32.497173 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-221fa864-eb8f-452f-8c0d-945ca9bf0aec tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:32.498180 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-221fa864-eb8f-452f-8c0d-945ca9bf0aec tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:32.499319 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-221fa864-eb8f-452f-8c0d-945ca9bf0aec tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:32.499947 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-221fa864-eb8f-452f-8c0d-945ca9bf0aec tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:32.763667 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-221fa864-eb8f-452f-8c0d-945ca9bf0aec tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:32.772957 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-221fa864-eb8f-452f-8c0d-945ca9bf0aec tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd" status: 200 len: 1275 microversion: 2.1 time: 0.310390 Oct 30 01:44:32.773567 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2856/5718] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:32 2022] GET /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd => generated 1275 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:32.976103 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6a5e4170-31bc-4020-b490-59d3eab4d5f7 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:32.976887 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6a5e4170-31bc-4020-b490-59d3eab4d5f7 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] [instance: fad9d370-62bc-4997-919b-6671d4bbd740] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:32.991946 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a5e4170-31bc-4020-b490-59d3eab4d5f7 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:32.992458 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a5e4170-31bc-4020-b490-59d3eab4d5f7 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:32.992906 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a5e4170-31bc-4020-b490-59d3eab4d5f7 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:32.993679 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a5e4170-31bc-4020-b490-59d3eab4d5f7 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:32.994477 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a5e4170-31bc-4020-b490-59d3eab4d5f7 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:32.995131 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a5e4170-31bc-4020-b490-59d3eab4d5f7 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:33.074471 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a5e4170-31bc-4020-b490-59d3eab4d5f7 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:33.076594 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a5e4170-31bc-4020-b490-59d3eab4d5f7 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:33.077874 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a5e4170-31bc-4020-b490-59d3eab4d5f7 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:33.078341 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-6a5e4170-31bc-4020-b490-59d3eab4d5f7 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lazy-loading 'fault' on Instance uuid fad9d370-62bc-4997-919b-6671d4bbd740 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:44:33.172899 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6a5e4170-31bc-4020-b490-59d3eab4d5f7 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ccf9b5810f4c1a8d95e70e15624a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a1dab1c45d4be9946ec98786f36b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:33.198162 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6a5e4170-31bc-4020-b490-59d3eab4d5f7 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] 10.222.0.13 "GET /compute/v2.1/servers/fad9d370-62bc-4997-919b-6671d4bbd740" status: 200 len: 1302 microversion: 2.1 time: 0.222897 Oct 30 01:44:33.200257 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2863/5719] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:32 2022] GET /compute/v2.1/servers/fad9d370-62bc-4997-919b-6671d4bbd740 => generated 1302 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:33.808254 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8f503579-e5c3-4b50-8ba1-22a1164fe18e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:33.808870 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8f503579-e5c3-4b50-8ba1-22a1164fe18e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: a0a1550e-e885-495b-9199-04334dce39dd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:33.824917 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8f503579-e5c3-4b50-8ba1-22a1164fe18e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:33.825441 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8f503579-e5c3-4b50-8ba1-22a1164fe18e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:33.827792 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8f503579-e5c3-4b50-8ba1-22a1164fe18e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:33.829308 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8f503579-e5c3-4b50-8ba1-22a1164fe18e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:33.829961 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8f503579-e5c3-4b50-8ba1-22a1164fe18e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:33.830716 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8f503579-e5c3-4b50-8ba1-22a1164fe18e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:34.001581 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8f503579-e5c3-4b50-8ba1-22a1164fe18e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:34.013394 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8f503579-e5c3-4b50-8ba1-22a1164fe18e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd" status: 200 len: 1273 microversion: 2.1 time: 0.210269 Oct 30 01:44:34.022016 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2857/5720] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:33 2022] GET /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd => generated 1273 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:34.223780 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a1600060-461f-4b0f-b54b-bc6a721d0f64 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:34.224534 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a1600060-461f-4b0f-b54b-bc6a721d0f64 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] [instance: fad9d370-62bc-4997-919b-6671d4bbd740] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:34.235432 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a1600060-461f-4b0f-b54b-bc6a721d0f64 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:34.235938 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a1600060-461f-4b0f-b54b-bc6a721d0f64 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:34.236478 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a1600060-461f-4b0f-b54b-bc6a721d0f64 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:34.237517 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a1600060-461f-4b0f-b54b-bc6a721d0f64 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:34.238057 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a1600060-461f-4b0f-b54b-bc6a721d0f64 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:34.238588 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a1600060-461f-4b0f-b54b-bc6a721d0f64 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:34.261505 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-a1600060-461f-4b0f-b54b-bc6a721d0f64 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] HTTP exception thrown: Instance fad9d370-62bc-4997-919b-6671d4bbd740 could not be found. Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a1600060-461f-4b0f-b54b-bc6a721d0f64 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Request method failure captured: Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/fad9d370-62bc-4997-919b-6671d4bbd740 HTTP/1.1 Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdbkqlih0e_pMWTBHzxmDMEjzqfGy4DtvObgRWlIG7j3mHcePJKQLsk4NNL1QgKMaZMp1Vjz3-YJIUqc1wU4O2mwC5ukeRhDZQleTAJgx6QC4vEjpCDLhbFZtj4PNgxjDJS4IXuATn-3ifB45XYOpaNby7LObryF7RDQaRo1MVBTQlo Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 15a1dab1c45d4be9946ec98786f36b5f Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServerGroupTestJSON-947436400 Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/15a1dab1c45d4be9946ec98786f36b5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_15a1dab1c45d4be9946ec98786f36b5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/15a1dab1c45d4be9946ec98786f36b5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/15a1dab1c45d4be9946ec98786f36b5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServerGroupTestJSON-947436400 Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 15a1dab1c45d4be9946ec98786f36b5f Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServerGroupTestJSON-947436400 Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServerGroupTestJSON-947436400-project Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 23ccf9b5810f4c1a8d95e70e15624a43 Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServerGroupTestJSON-947436400-project Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: exception: Instance fad9d370-62bc-4997-919b-6671d4bbd740 could not be found. Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'fad9d370-62bc-4997-919b-6671d4bbd740'} Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fad9d370-62bc-4997-919b-6671d4bbd740 could not be found. Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fad9d370-62bc-4997-919b-6671d4bbd740 could not be found. Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:44:34.263341 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:44:34.267844 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:44:34.267844 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:44:34.267844 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:44:34.267844 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:44:34.267844 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:44:34.267844 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fad9d370-62bc-4997-919b-6671d4bbd740 could not be found. Oct 30 01:44:34.267844 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:44:34.267844 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a1600060-461f-4b0f-b54b-bc6a721d0f64 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Returning 404 to user: Instance fad9d370-62bc-4997-919b-6671d4bbd740 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:44:34.267844 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a1600060-461f-4b0f-b54b-bc6a721d0f64 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] 10.222.0.13 "GET /compute/v2.1/servers/fad9d370-62bc-4997-919b-6671d4bbd740" status: 404 len: 111 microversion: 2.1 time: 0.046391 Oct 30 01:44:34.267844 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2864/5721] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:34 2022] GET /compute/v2.1/servers/fad9d370-62bc-4997-919b-6671d4bbd740 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:44:34.276962 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e7cb5d49-d18a-4d24-8274-27102b77016b tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:34.294204 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.compute.server_groups [None req-e7cb5d49-d18a-4d24-8274-27102b77016b tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Querying cell 7a264aef-b8bb-4843-8958-43bc38c25cb0(cell1) for 1 instances {{(pid=121102) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 30 01:44:34.295003 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e7cb5d49-d18a-4d24-8274-27102b77016b tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:34.295558 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e7cb5d49-d18a-4d24-8274-27102b77016b tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:34.296061 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e7cb5d49-d18a-4d24-8274-27102b77016b tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:34.307293 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e7cb5d49-d18a-4d24-8274-27102b77016b tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] 10.222.0.13 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.034824 Oct 30 01:44:34.308363 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2858/5722] 10.222.0.13 () {58 vars in 1152 bytes} [Sun Oct 30 01:44:34 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:44:34.326709 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1dbc799c-2b6c-4b70-b276-27f904dd93fd tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:34.343073 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.compute.server_groups [None req-1dbc799c-2b6c-4b70-b276-27f904dd93fd tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Querying cell 7a264aef-b8bb-4843-8958-43bc38c25cb0(cell1) for 1 instances {{(pid=121103) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 30 01:44:34.344276 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1dbc799c-2b6c-4b70-b276-27f904dd93fd tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:34.345634 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1dbc799c-2b6c-4b70-b276-27f904dd93fd tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:34.348415 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1dbc799c-2b6c-4b70-b276-27f904dd93fd tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:34.377189 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1dbc799c-2b6c-4b70-b276-27f904dd93fd tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] 10.222.0.13 "GET /compute/v2.1/os-server-groups/23cf4f00-6b57-4be0-abf9-09d3ef54cc86" status: 200 len: 184 microversion: 2.1 time: 0.052522 Oct 30 01:44:34.377189 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2865/5723] 10.222.0.13 () {58 vars in 1263 bytes} [Sun Oct 30 01:44:34 2022] GET /compute/v2.1/os-server-groups/23cf4f00-6b57-4be0-abf9-09d3ef54cc86 => generated 184 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:44:34.390545 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-460881ba-b389-4c8c-b35e-0952896226a2 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:34.391059 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-460881ba-b389-4c8c-b35e-0952896226a2 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] [instance: fad9d370-62bc-4997-919b-6671d4bbd740] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:34.398187 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-460881ba-b389-4c8c-b35e-0952896226a2 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:34.398689 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-460881ba-b389-4c8c-b35e-0952896226a2 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:34.399247 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-460881ba-b389-4c8c-b35e-0952896226a2 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:34.400559 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-460881ba-b389-4c8c-b35e-0952896226a2 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:34.401015 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-460881ba-b389-4c8c-b35e-0952896226a2 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:34.405870 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-460881ba-b389-4c8c-b35e-0952896226a2 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:34.419586 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-460881ba-b389-4c8c-b35e-0952896226a2 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] HTTP exception thrown: Instance fad9d370-62bc-4997-919b-6671d4bbd740 could not be found. Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-460881ba-b389-4c8c-b35e-0952896226a2 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Request method failure captured: Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/servers/fad9d370-62bc-4997-919b-6671d4bbd740 HTTP/1.1 Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdbkqlih0e_pMWTBHzxmDMEjzqfGy4DtvObgRWlIG7j3mHcePJKQLsk4NNL1QgKMaZMp1Vjz3-YJIUqc1wU4O2mwC5ukeRhDZQleTAJgx6QC4vEjpCDLhbFZtj4PNgxjDJS4IXuATn-3ifB45XYOpaNby7LObryF7RDQaRo1MVBTQlo Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 15a1dab1c45d4be9946ec98786f36b5f Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServerGroupTestJSON-947436400 Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/15a1dab1c45d4be9946ec98786f36b5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_15a1dab1c45d4be9946ec98786f36b5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/15a1dab1c45d4be9946ec98786f36b5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/15a1dab1c45d4be9946ec98786f36b5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServerGroupTestJSON-947436400 Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 15a1dab1c45d4be9946ec98786f36b5f Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServerGroupTestJSON-947436400 Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServerGroupTestJSON-947436400-project Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 23ccf9b5810f4c1a8d95e70e15624a43 Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServerGroupTestJSON-947436400-project Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: exception: Instance fad9d370-62bc-4997-919b-6671d4bbd740 could not be found. Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'fad9d370-62bc-4997-919b-6671d4bbd740'} Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fad9d370-62bc-4997-919b-6671d4bbd740 could not be found. Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:44:34.421671 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:44:34.426162 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fad9d370-62bc-4997-919b-6671d4bbd740 could not be found. Oct 30 01:44:34.426162 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:44:34.426162 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:44:34.426162 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:44:34.426162 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:44:34.426162 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:44:34.426162 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:44:34.426162 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:44:34.426162 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:44:34.426162 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fad9d370-62bc-4997-919b-6671d4bbd740 could not be found. Oct 30 01:44:34.426162 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:44:34.428429 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-460881ba-b389-4c8c-b35e-0952896226a2 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Returning 404 to user: Instance fad9d370-62bc-4997-919b-6671d4bbd740 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:44:34.429575 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-460881ba-b389-4c8c-b35e-0952896226a2 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] 10.222.0.13 "DELETE /compute/v2.1/servers/fad9d370-62bc-4997-919b-6671d4bbd740" status: 404 len: 111 microversion: 2.1 time: 0.044374 Oct 30 01:44:34.430743 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2859/5724] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:44:34 2022] DELETE /compute/v2.1/servers/fad9d370-62bc-4997-919b-6671d4bbd740 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:44:34.442076 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9624768b-2403-4270-88c0-08fe319661bf tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:34.443203 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9624768b-2403-4270-88c0-08fe319661bf tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] [instance: fad9d370-62bc-4997-919b-6671d4bbd740] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:34.468200 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:34.470115 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9624768b-2403-4270-88c0-08fe319661bf tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:34.472398 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9624768b-2403-4270-88c0-08fe319661bf tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:34.472829 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9624768b-2403-4270-88c0-08fe319661bf tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:34.474550 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9624768b-2403-4270-88c0-08fe319661bf tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:34.477549 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9624768b-2403-4270-88c0-08fe319661bf tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:34.478035 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9624768b-2403-4270-88c0-08fe319661bf tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:34.561908 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-9624768b-2403-4270-88c0-08fe319661bf tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] HTTP exception thrown: Instance fad9d370-62bc-4997-919b-6671d4bbd740 could not be found. Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9624768b-2403-4270-88c0-08fe319661bf tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Request method failure captured: Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/fad9d370-62bc-4997-919b-6671d4bbd740 HTTP/1.1 Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdbkqlih0e_pMWTBHzxmDMEjzqfGy4DtvObgRWlIG7j3mHcePJKQLsk4NNL1QgKMaZMp1Vjz3-YJIUqc1wU4O2mwC5ukeRhDZQleTAJgx6QC4vEjpCDLhbFZtj4PNgxjDJS4IXuATn-3ifB45XYOpaNby7LObryF7RDQaRo1MVBTQlo Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 15a1dab1c45d4be9946ec98786f36b5f Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServerGroupTestJSON-947436400 Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/15a1dab1c45d4be9946ec98786f36b5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_15a1dab1c45d4be9946ec98786f36b5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/15a1dab1c45d4be9946ec98786f36b5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/15a1dab1c45d4be9946ec98786f36b5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServerGroupTestJSON-947436400 Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 15a1dab1c45d4be9946ec98786f36b5f Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServerGroupTestJSON-947436400 Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServerGroupTestJSON-947436400-project Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 23ccf9b5810f4c1a8d95e70e15624a43 Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServerGroupTestJSON-947436400-project Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: exception: Instance fad9d370-62bc-4997-919b-6671d4bbd740 could not be found. Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'fad9d370-62bc-4997-919b-6671d4bbd740'} Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fad9d370-62bc-4997-919b-6671d4bbd740 could not be found. Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fad9d370-62bc-4997-919b-6671d4bbd740 could not be found. Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:44:34.563985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:44:34.568242 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:44:34.568242 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:44:34.568242 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:44:34.568242 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:44:34.568242 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:44:34.568242 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fad9d370-62bc-4997-919b-6671d4bbd740 could not be found. Oct 30 01:44:34.568242 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:44:34.571256 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9624768b-2403-4270-88c0-08fe319661bf tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Returning 404 to user: Instance fad9d370-62bc-4997-919b-6671d4bbd740 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:44:34.574547 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9624768b-2403-4270-88c0-08fe319661bf tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] 10.222.0.13 "GET /compute/v2.1/servers/fad9d370-62bc-4997-919b-6671d4bbd740" status: 404 len: 111 microversion: 2.1 time: 0.139080 Oct 30 01:44:34.575913 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2866/5725] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:34 2022] GET /compute/v2.1/servers/fad9d370-62bc-4997-919b-6671d4bbd740 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:44:34.594350 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d1e3d917-5c4a-460a-83d1-263f030f0523 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:34.618372 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-d1e3d917-5c4a-460a-83d1-263f030f0523 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] HTTP exception thrown: Instance group 2714d4eb-9f72-431a-b733-e6dad60511a8 could not be found. Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d1e3d917-5c4a-460a-83d1-263f030f0523 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Request method failure captured: Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/os-server-groups/2714d4eb-9f72-431a-b733-e6dad60511a8 HTTP/1.1 Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdbkqlih0e_pMWTBHzxmDMEjzqfGy4DtvObgRWlIG7j3mHcePJKQLsk4NNL1QgKMaZMp1Vjz3-YJIUqc1wU4O2mwC5ukeRhDZQleTAJgx6QC4vEjpCDLhbFZtj4PNgxjDJS4IXuATn-3ifB45XYOpaNby7LObryF7RDQaRo1MVBTQlo Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 15a1dab1c45d4be9946ec98786f36b5f Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServerGroupTestJSON-947436400 Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/15a1dab1c45d4be9946ec98786f36b5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_15a1dab1c45d4be9946ec98786f36b5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/15a1dab1c45d4be9946ec98786f36b5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/15a1dab1c45d4be9946ec98786f36b5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServerGroupTestJSON-947436400 Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 15a1dab1c45d4be9946ec98786f36b5f Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServerGroupTestJSON-947436400 Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServerGroupTestJSON-947436400-project Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 23ccf9b5810f4c1a8d95e70e15624a43 Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServerGroupTestJSON-947436400-project Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: exception: Instance group 2714d4eb-9f72-431a-b733-e6dad60511a8 could not be found. Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '2714d4eb-9f72-431a-b733-e6dad60511a8'} Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 2714d4eb-9f72-431a-b733-e6dad60511a8 could not be found. Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 2714d4eb-9f72-431a-b733-e6dad60511a8 could not be found. Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:44:34.638194 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:44:34.642593 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:44:34.642593 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:44:34.642593 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:44:34.642593 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:44:34.642593 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 2714d4eb-9f72-431a-b733-e6dad60511a8 could not be found. Oct 30 01:44:34.642593 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:44:34.645714 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d1e3d917-5c4a-460a-83d1-263f030f0523 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Returning 404 to user: Instance group 2714d4eb-9f72-431a-b733-e6dad60511a8 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:44:34.646613 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d1e3d917-5c4a-460a-83d1-263f030f0523 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/2714d4eb-9f72-431a-b733-e6dad60511a8" status: 404 len: 117 microversion: 2.1 time: 0.066292 Oct 30 01:44:34.647576 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2860/5726] 10.222.0.13 () {58 vars in 1266 bytes} [Sun Oct 30 01:44:34 2022] DELETE /compute/v2.1/os-server-groups/2714d4eb-9f72-431a-b733-e6dad60511a8 => generated 117 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 01:44:34.656197 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8cd58902-c9f0-4969-a8df-5345780c63de tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:34.676077 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-8cd58902-c9f0-4969-a8df-5345780c63de tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] HTTP exception thrown: Instance group 6a6cf7bb-da00-4185-b444-43dd508762e3 could not be found. Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8cd58902-c9f0-4969-a8df-5345780c63de tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Request method failure captured: Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: request: DELETE /compute/v2.1/os-server-groups/6a6cf7bb-da00-4185-b444-43dd508762e3 HTTP/1.1 Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdbkqlih0e_pMWTBHzxmDMEjzqfGy4DtvObgRWlIG7j3mHcePJKQLsk4NNL1QgKMaZMp1Vjz3-YJIUqc1wU4O2mwC5ukeRhDZQleTAJgx6QC4vEjpCDLhbFZtj4PNgxjDJS4IXuATn-3ifB45XYOpaNby7LObryF7RDQaRo1MVBTQlo Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 15a1dab1c45d4be9946ec98786f36b5f Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServerGroupTestJSON-947436400 Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/15a1dab1c45d4be9946ec98786f36b5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_15a1dab1c45d4be9946ec98786f36b5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/15a1dab1c45d4be9946ec98786f36b5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/15a1dab1c45d4be9946ec98786f36b5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServerGroupTestJSON-947436400 Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 15a1dab1c45d4be9946ec98786f36b5f Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServerGroupTestJSON-947436400 Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServerGroupTestJSON-947436400-project Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 23ccf9b5810f4c1a8d95e70e15624a43 Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServerGroupTestJSON-947436400-project Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: exception: Instance group 6a6cf7bb-da00-4185-b444-43dd508762e3 could not be found. Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '6a6cf7bb-da00-4185-b444-43dd508762e3'} Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 6a6cf7bb-da00-4185-b444-43dd508762e3 could not be found. Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 6a6cf7bb-da00-4185-b444-43dd508762e3 could not be found. Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:44:34.696176 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:44:34.704968 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:44:34.704968 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:44:34.704968 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:44:34.704968 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:44:34.704968 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 6a6cf7bb-da00-4185-b444-43dd508762e3 could not be found. Oct 30 01:44:34.704968 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:44:34.704968 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8cd58902-c9f0-4969-a8df-5345780c63de tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Returning 404 to user: Instance group 6a6cf7bb-da00-4185-b444-43dd508762e3 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:44:34.704968 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8cd58902-c9f0-4969-a8df-5345780c63de tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/6a6cf7bb-da00-4185-b444-43dd508762e3" status: 404 len: 117 microversion: 2.1 time: 0.046901 Oct 30 01:44:34.704968 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2867/5727] 10.222.0.13 () {58 vars in 1266 bytes} [Sun Oct 30 01:44:34 2022] DELETE /compute/v2.1/os-server-groups/6a6cf7bb-da00-4185-b444-43dd508762e3 => generated 117 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:44:34.707582 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c19cf2ab-ebc9-4c19-b68b-cedd8902a7fc tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:34.717272 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-c19cf2ab-ebc9-4c19-b68b-cedd8902a7fc tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] HTTP exception thrown: Instance group c3fc1297-16b9-4271-b2f5-6ea55e7083af could not be found. Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c19cf2ab-ebc9-4c19-b68b-cedd8902a7fc tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Request method failure captured: Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/os-server-groups/c3fc1297-16b9-4271-b2f5-6ea55e7083af HTTP/1.1 Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdbkqlih0e_pMWTBHzxmDMEjzqfGy4DtvObgRWlIG7j3mHcePJKQLsk4NNL1QgKMaZMp1Vjz3-YJIUqc1wU4O2mwC5ukeRhDZQleTAJgx6QC4vEjpCDLhbFZtj4PNgxjDJS4IXuATn-3ifB45XYOpaNby7LObryF7RDQaRo1MVBTQlo Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 15a1dab1c45d4be9946ec98786f36b5f Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServerGroupTestJSON-947436400 Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/15a1dab1c45d4be9946ec98786f36b5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_15a1dab1c45d4be9946ec98786f36b5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/15a1dab1c45d4be9946ec98786f36b5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/15a1dab1c45d4be9946ec98786f36b5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServerGroupTestJSON-947436400 Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 15a1dab1c45d4be9946ec98786f36b5f Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServerGroupTestJSON-947436400 Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServerGroupTestJSON-947436400-project Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 23ccf9b5810f4c1a8d95e70e15624a43 Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServerGroupTestJSON-947436400-project Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: exception: Instance group c3fc1297-16b9-4271-b2f5-6ea55e7083af could not be found. Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'c3fc1297-16b9-4271-b2f5-6ea55e7083af'} Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group c3fc1297-16b9-4271-b2f5-6ea55e7083af could not be found. Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group c3fc1297-16b9-4271-b2f5-6ea55e7083af could not be found. Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:44:34.718967 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:44:34.723211 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:44:34.723211 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:44:34.723211 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:44:34.723211 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:44:34.723211 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group c3fc1297-16b9-4271-b2f5-6ea55e7083af could not be found. Oct 30 01:44:34.723211 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:44:34.723211 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c19cf2ab-ebc9-4c19-b68b-cedd8902a7fc tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Returning 404 to user: Instance group c3fc1297-16b9-4271-b2f5-6ea55e7083af could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:44:34.723211 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c19cf2ab-ebc9-4c19-b68b-cedd8902a7fc tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/c3fc1297-16b9-4271-b2f5-6ea55e7083af" status: 404 len: 117 microversion: 2.1 time: 0.016947 Oct 30 01:44:34.723211 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2861/5728] 10.222.0.13 () {58 vars in 1266 bytes} [Sun Oct 30 01:44:34 2022] DELETE /compute/v2.1/os-server-groups/c3fc1297-16b9-4271-b2f5-6ea55e7083af => generated 117 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:44:34.733805 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-11984f85-e746-479e-b183-17516ff82cd9 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:34.754406 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-11984f85-e746-479e-b183-17516ff82cd9 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] HTTP exception thrown: Instance group a1d8f67f-5e0a-4875-8436-519612c41750 could not be found. Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-11984f85-e746-479e-b183-17516ff82cd9 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Request method failure captured: Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: request: DELETE /compute/v2.1/os-server-groups/a1d8f67f-5e0a-4875-8436-519612c41750 HTTP/1.1 Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdbkqlih0e_pMWTBHzxmDMEjzqfGy4DtvObgRWlIG7j3mHcePJKQLsk4NNL1QgKMaZMp1Vjz3-YJIUqc1wU4O2mwC5ukeRhDZQleTAJgx6QC4vEjpCDLhbFZtj4PNgxjDJS4IXuATn-3ifB45XYOpaNby7LObryF7RDQaRo1MVBTQlo Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 15a1dab1c45d4be9946ec98786f36b5f Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServerGroupTestJSON-947436400 Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/15a1dab1c45d4be9946ec98786f36b5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_15a1dab1c45d4be9946ec98786f36b5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/15a1dab1c45d4be9946ec98786f36b5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/15a1dab1c45d4be9946ec98786f36b5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServerGroupTestJSON-947436400 Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 15a1dab1c45d4be9946ec98786f36b5f Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServerGroupTestJSON-947436400 Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServerGroupTestJSON-947436400-project Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 23ccf9b5810f4c1a8d95e70e15624a43 Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServerGroupTestJSON-947436400-project Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: exception: Instance group a1d8f67f-5e0a-4875-8436-519612c41750 could not be found. Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'a1d8f67f-5e0a-4875-8436-519612c41750'} Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group a1d8f67f-5e0a-4875-8436-519612c41750 could not be found. Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group a1d8f67f-5e0a-4875-8436-519612c41750 could not be found. Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:44:34.756069 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:44:34.761804 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:44:34.761804 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:44:34.761804 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:44:34.761804 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:44:34.761804 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group a1d8f67f-5e0a-4875-8436-519612c41750 could not be found. Oct 30 01:44:34.761804 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:44:34.772162 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-11984f85-e746-479e-b183-17516ff82cd9 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Returning 404 to user: Instance group a1d8f67f-5e0a-4875-8436-519612c41750 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:44:34.772162 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-11984f85-e746-479e-b183-17516ff82cd9 tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/a1d8f67f-5e0a-4875-8436-519612c41750" status: 404 len: 117 microversion: 2.1 time: 0.042846 Oct 30 01:44:34.772750 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2868/5729] 10.222.0.13 () {58 vars in 1266 bytes} [Sun Oct 30 01:44:34 2022] DELETE /compute/v2.1/os-server-groups/a1d8f67f-5e0a-4875-8436-519612c41750 => generated 117 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:44:34.779986 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-81f02a72-0da8-49c0-879b-c7dcaea63d5d tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:34.950833 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-81f02a72-0da8-49c0-879b-c7dcaea63d5d tempest-ServerGroupTestJSON-947436400 tempest-ServerGroupTestJSON-947436400-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/23cf4f00-6b57-4be0-abf9-09d3ef54cc86" status: 204 len: 0 microversion: 2.1 time: 0.175259 Oct 30 01:44:34.950833 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2862/5730] 10.222.0.13 () {58 vars in 1266 bytes} [Sun Oct 30 01:44:34 2022] DELETE /compute/v2.1/os-server-groups/23cf4f00-6b57-4be0-abf9-09d3ef54cc86 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:44:35.058697 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b5c821a2-0ab8-4465-944b-661f3f6ea9de tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:35.059334 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b5c821a2-0ab8-4465-944b-661f3f6ea9de tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: a0a1550e-e885-495b-9199-04334dce39dd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:35.080268 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b5c821a2-0ab8-4465-944b-661f3f6ea9de tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:35.081029 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b5c821a2-0ab8-4465-944b-661f3f6ea9de tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:35.081509 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b5c821a2-0ab8-4465-944b-661f3f6ea9de tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:35.082305 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b5c821a2-0ab8-4465-944b-661f3f6ea9de tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:35.083072 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b5c821a2-0ab8-4465-944b-661f3f6ea9de tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:35.083700 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b5c821a2-0ab8-4465-944b-661f3f6ea9de tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:35.499222 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b5c821a2-0ab8-4465-944b-661f3f6ea9de tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:35.520267 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b5c821a2-0ab8-4465-944b-661f3f6ea9de tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd" status: 200 len: 1315 microversion: 2.1 time: 0.467083 Oct 30 01:44:35.521686 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2869/5731] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:35 2022] GET /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd => generated 1315 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:36.549996 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-07dc8beb-71b7-4e12-9bfb-ded96ee178b7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:36.551139 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-07dc8beb-71b7-4e12-9bfb-ded96ee178b7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: a0a1550e-e885-495b-9199-04334dce39dd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:36.562950 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-07dc8beb-71b7-4e12-9bfb-ded96ee178b7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:36.563712 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-07dc8beb-71b7-4e12-9bfb-ded96ee178b7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:36.564328 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-07dc8beb-71b7-4e12-9bfb-ded96ee178b7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:36.569597 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-07dc8beb-71b7-4e12-9bfb-ded96ee178b7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:36.571925 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-07dc8beb-71b7-4e12-9bfb-ded96ee178b7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:36.572537 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-07dc8beb-71b7-4e12-9bfb-ded96ee178b7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:36.616816 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-5b9f18f0-2a24-49e5-bc83-03fc183484c6 req-40cf5b60-907e-4496-ae41-6cea7f70e4b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0a1550e-e885-495b-9199-04334dce39dd", "tag": "02e84120-803f-4ae5-9f89-0f81d7bb7a9b"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:44:36.637701 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-5b9f18f0-2a24-49e5-bc83-03fc183484c6 req-40cf5b60-907e-4496-ae41-6cea7f70e4b3 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:36.638435 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-5b9f18f0-2a24-49e5-bc83-03fc183484c6 req-40cf5b60-907e-4496-ae41-6cea7f70e4b3 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:36.639036 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-5b9f18f0-2a24-49e5-bc83-03fc183484c6 req-40cf5b60-907e-4496-ae41-6cea7f70e4b3 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:36.664110 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-5b9f18f0-2a24-49e5-bc83-03fc183484c6 req-40cf5b60-907e-4496-ae41-6cea7f70e4b3 service nova] Creating event network-changed:02e84120-803f-4ae5-9f89-0f81d7bb7a9b for instance a0a1550e-e885-495b-9199-04334dce39dd on n-h2-master-1 Oct 30 01:44:36.676700 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-5b9f18f0-2a24-49e5-bc83-03fc183484c6 req-40cf5b60-907e-4496-ae41-6cea7f70e4b3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062473 Oct 30 01:44:36.679802 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2870/5732] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:44:37.114812 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-07dc8beb-71b7-4e12-9bfb-ded96ee178b7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:37.125565 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-07dc8beb-71b7-4e12-9bfb-ded96ee178b7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd" status: 200 len: 1315 microversion: 2.1 time: 0.579679 Oct 30 01:44:37.137405 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2863/5733] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:36 2022] GET /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd => generated 1315 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:37.534227 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b06bcf55-6de6-4018-ba6c-23d296ccfff2 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:37.534826 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b06bcf55-6de6-4018-ba6c-23d296ccfff2 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] [instance: 7b678024-1288-425e-9985-41c2554f36c8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:37.551535 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b06bcf55-6de6-4018-ba6c-23d296ccfff2 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:37.552043 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b06bcf55-6de6-4018-ba6c-23d296ccfff2 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:37.552486 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b06bcf55-6de6-4018-ba6c-23d296ccfff2 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:37.553686 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b06bcf55-6de6-4018-ba6c-23d296ccfff2 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:37.554331 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b06bcf55-6de6-4018-ba6c-23d296ccfff2 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:37.555509 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b06bcf55-6de6-4018-ba6c-23d296ccfff2 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:37.616383 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b06bcf55-6de6-4018-ba6c-23d296ccfff2 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] 10.222.0.13 "GET /compute/v2.1/servers/7b678024-1288-425e-9985-41c2554f36c8/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.086852 Oct 30 01:44:37.622408 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2871/5734] 10.222.0.13 () {58 vars in 1293 bytes} [Sun Oct 30 01:44:37 2022] GET /compute/v2.1/servers/7b678024-1288-425e-9985-41c2554f36c8/os-server-password => generated 116 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:44:38.149416 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7a308286-e766-4587-9d8b-c3be4c4755e0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:38.150391 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7a308286-e766-4587-9d8b-c3be4c4755e0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: a0a1550e-e885-495b-9199-04334dce39dd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:38.167488 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7a308286-e766-4587-9d8b-c3be4c4755e0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:38.169976 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7a308286-e766-4587-9d8b-c3be4c4755e0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:38.171016 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7a308286-e766-4587-9d8b-c3be4c4755e0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:38.172204 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7a308286-e766-4587-9d8b-c3be4c4755e0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:38.173534 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7a308286-e766-4587-9d8b-c3be4c4755e0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:38.174589 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7a308286-e766-4587-9d8b-c3be4c4755e0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:38.504241 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7a308286-e766-4587-9d8b-c3be4c4755e0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:38.514861 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7a308286-e766-4587-9d8b-c3be4c4755e0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd" status: 200 len: 1315 microversion: 2.1 time: 0.370134 Oct 30 01:44:38.517427 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2864/5735] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:38 2022] GET /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd => generated 1315 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:39.540138 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-92a757d0-3bd3-4346-9509-530f46294495 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:39.541859 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-92a757d0-3bd3-4346-9509-530f46294495 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: a0a1550e-e885-495b-9199-04334dce39dd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:39.553040 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-92a757d0-3bd3-4346-9509-530f46294495 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:39.556705 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-92a757d0-3bd3-4346-9509-530f46294495 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:39.557418 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-92a757d0-3bd3-4346-9509-530f46294495 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:39.558534 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-92a757d0-3bd3-4346-9509-530f46294495 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:39.560535 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-92a757d0-3bd3-4346-9509-530f46294495 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:39.561182 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-92a757d0-3bd3-4346-9509-530f46294495 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:39.785452 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-92a757d0-3bd3-4346-9509-530f46294495 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:39.801616 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-92a757d0-3bd3-4346-9509-530f46294495 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd" status: 200 len: 1315 microversion: 2.1 time: 0.260845 Oct 30 01:44:39.802785 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2872/5736] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:39 2022] GET /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:40.828191 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d3bdd13e-a1a9-4c2b-9e2c-2e55c1f7ac26 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:40.849490 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d3bdd13e-a1a9-4c2b-9e2c-2e55c1f7ac26 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: a0a1550e-e885-495b-9199-04334dce39dd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:40.862567 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:40.863248 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=8 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:40.886414 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3bdd13e-a1a9-4c2b-9e2c-2e55c1f7ac26 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:40.905992 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3bdd13e-a1a9-4c2b-9e2c-2e55c1f7ac26 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:40.906553 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3bdd13e-a1a9-4c2b-9e2c-2e55c1f7ac26 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:40.907253 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3bdd13e-a1a9-4c2b-9e2c-2e55c1f7ac26 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:40.907727 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3bdd13e-a1a9-4c2b-9e2c-2e55c1f7ac26 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:40.908154 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3bdd13e-a1a9-4c2b-9e2c-2e55c1f7ac26 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:40.965065 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:41.231860 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d3bdd13e-a1a9-4c2b-9e2c-2e55c1f7ac26 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:41.240159 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d3bdd13e-a1a9-4c2b-9e2c-2e55c1f7ac26 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd" status: 200 len: 1315 microversion: 2.1 time: 0.417061 Oct 30 01:44:41.240759 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2865/5737] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:40 2022] GET /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd => generated 1315 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:42.264721 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e742de18-21da-42d6-867a-27957b132693 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:42.265479 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e742de18-21da-42d6-867a-27957b132693 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: a0a1550e-e885-495b-9199-04334dce39dd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:42.269127 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:42.278424 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e742de18-21da-42d6-867a-27957b132693 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:42.279161 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e742de18-21da-42d6-867a-27957b132693 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:42.279774 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e742de18-21da-42d6-867a-27957b132693 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:42.280822 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e742de18-21da-42d6-867a-27957b132693 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:42.281576 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e742de18-21da-42d6-867a-27957b132693 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:42.282260 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e742de18-21da-42d6-867a-27957b132693 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:42.536166 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e742de18-21da-42d6-867a-27957b132693 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:42.545465 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e742de18-21da-42d6-867a-27957b132693 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd" status: 200 len: 1315 microversion: 2.1 time: 0.284657 Oct 30 01:44:42.546050 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2873/5738] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:42 2022] GET /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:43.568170 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fe97fe5b-c23f-41b6-a608-0d0a61e40523 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:43.568791 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fe97fe5b-c23f-41b6-a608-0d0a61e40523 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: a0a1550e-e885-495b-9199-04334dce39dd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:43.581979 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fe97fe5b-c23f-41b6-a608-0d0a61e40523 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:43.582475 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fe97fe5b-c23f-41b6-a608-0d0a61e40523 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:43.582913 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fe97fe5b-c23f-41b6-a608-0d0a61e40523 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:43.583618 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fe97fe5b-c23f-41b6-a608-0d0a61e40523 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:43.593464 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fe97fe5b-c23f-41b6-a608-0d0a61e40523 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:43.593919 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fe97fe5b-c23f-41b6-a608-0d0a61e40523 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:43.941141 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-fe97fe5b-c23f-41b6-a608-0d0a61e40523 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:43.948502 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fe97fe5b-c23f-41b6-a608-0d0a61e40523 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd" status: 200 len: 1315 microversion: 2.1 time: 0.384184 Oct 30 01:44:43.960117 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2866/5739] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:43 2022] GET /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd => generated 1315 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:43.988298 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-df06fc11-cd73-464c-8ebd-44c85d64b44d req-e75a7c3e-370e-4a21-92fa-3719a0c3017b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0a1550e-e885-495b-9199-04334dce39dd", "name": "network-vif-plugged", "status": "completed", "tag": "02e84120-803f-4ae5-9f89-0f81d7bb7a9b"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:44:44.011279 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-df06fc11-cd73-464c-8ebd-44c85d64b44d req-e75a7c3e-370e-4a21-92fa-3719a0c3017b service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:44.017205 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-df06fc11-cd73-464c-8ebd-44c85d64b44d req-e75a7c3e-370e-4a21-92fa-3719a0c3017b service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:44.017205 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-df06fc11-cd73-464c-8ebd-44c85d64b44d req-e75a7c3e-370e-4a21-92fa-3719a0c3017b service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:44.028488 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-df06fc11-cd73-464c-8ebd-44c85d64b44d req-e75a7c3e-370e-4a21-92fa-3719a0c3017b service nova] Creating event network-vif-plugged:02e84120-803f-4ae5-9f89-0f81d7bb7a9b for instance a0a1550e-e885-495b-9199-04334dce39dd on n-h2-master-1 Oct 30 01:44:44.033941 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-df06fc11-cd73-464c-8ebd-44c85d64b44d req-e75a7c3e-370e-4a21-92fa-3719a0c3017b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053019 Oct 30 01:44:44.035322 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2874/5740] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:44:44.986727 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8bad0310-a437-4fd7-bc37-e7e1efa40c57 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:44.986727 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8bad0310-a437-4fd7-bc37-e7e1efa40c57 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: a0a1550e-e885-495b-9199-04334dce39dd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:44.999154 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8bad0310-a437-4fd7-bc37-e7e1efa40c57 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:44.999649 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8bad0310-a437-4fd7-bc37-e7e1efa40c57 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:45.000166 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8bad0310-a437-4fd7-bc37-e7e1efa40c57 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:45.000908 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8bad0310-a437-4fd7-bc37-e7e1efa40c57 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:45.001415 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8bad0310-a437-4fd7-bc37-e7e1efa40c57 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:45.001799 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8bad0310-a437-4fd7-bc37-e7e1efa40c57 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:45.454811 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8bad0310-a437-4fd7-bc37-e7e1efa40c57 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:45.465576 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8bad0310-a437-4fd7-bc37-e7e1efa40c57 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd" status: 200 len: 1315 microversion: 2.1 time: 0.485185 Oct 30 01:44:45.467453 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2867/5741] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:44 2022] GET /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd => generated 1315 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:45.869441 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f9a7a5d7-2525-4915-960a-688e23920623 tempest-QuotasTestJSON-356474143 tempest-QuotasTestJSON-356474143-project] Calling method '.version_select at 0x7f44c7307700>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:46.047187 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f9a7a5d7-2525-4915-960a-688e23920623 tempest-QuotasTestJSON-356474143 tempest-QuotasTestJSON-356474143-project] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/31fd00b0e9164b20a6255be322056081/defaults" status: 200 len: 371 microversion: 2.1 time: 0.519330 Oct 30 01:44:46.048182 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2875/5742] 10.222.0.13 () {58 vars in 1269 bytes} [Sun Oct 30 01:44:45 2022] GET /compute/v2.1/os-quota-sets/31fd00b0e9164b20a6255be322056081/defaults => generated 371 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:44:46.061549 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-aa922f8e-d8b4-42ca-bebe-7d1fcfa4de0f tempest-QuotasTestJSON-356474143 tempest-QuotasTestJSON-356474143-project] Calling method '.version_select at 0x7f44d03ce790>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:46.492496 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-25298516-fa05-46e8-b517-78b5335f43c8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:46.493593 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-25298516-fa05-46e8-b517-78b5335f43c8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: a0a1550e-e885-495b-9199-04334dce39dd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:46.502048 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-25298516-fa05-46e8-b517-78b5335f43c8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:46.502547 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-25298516-fa05-46e8-b517-78b5335f43c8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:46.502989 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-25298516-fa05-46e8-b517-78b5335f43c8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:46.503707 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-25298516-fa05-46e8-b517-78b5335f43c8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:46.504166 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-25298516-fa05-46e8-b517-78b5335f43c8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:46.504691 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-25298516-fa05-46e8-b517-78b5335f43c8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:46.583352 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-aa922f8e-d8b4-42ca-bebe-7d1fcfa4de0f tempest-QuotasTestJSON-356474143 tempest-QuotasTestJSON-356474143-project] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/31fd00b0e9164b20a6255be322056081" status: 200 len: 371 microversion: 2.1 time: 0.526489 Oct 30 01:44:46.615188 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2868/5743] 10.222.0.13 () {58 vars in 1242 bytes} [Sun Oct 30 01:44:46 2022] GET /compute/v2.1/os-quota-sets/31fd00b0e9164b20a6255be322056081 => generated 371 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:44:46.635388 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6868df5a-1394-4797-ac34-d819129c552f tempest-QuotasTestJSON-356474143 tempest-QuotasTestJSON-356474143-project] Calling method '.version_select at 0x7f44d04d0160>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:46.897402 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-25298516-fa05-46e8-b517-78b5335f43c8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:46.916891 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-25298516-fa05-46e8-b517-78b5335f43c8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd" status: 200 len: 1503 microversion: 2.1 time: 0.425479 Oct 30 01:44:46.916891 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2876/5744] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:46 2022] GET /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd => generated 1503 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:44:46.938712 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-42b1e195-c7ee-429c-8478-7fcf6b4b3cd5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:44:46.941943 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-42b1e195-c7ee-429c-8478-7fcf6b4b3cd5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: a0a1550e-e885-495b-9199-04334dce39dd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:46.949424 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42b1e195-c7ee-429c-8478-7fcf6b4b3cd5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:46.951118 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42b1e195-c7ee-429c-8478-7fcf6b4b3cd5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:46.951470 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42b1e195-c7ee-429c-8478-7fcf6b4b3cd5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:46.952462 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42b1e195-c7ee-429c-8478-7fcf6b4b3cd5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:46.953080 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42b1e195-c7ee-429c-8478-7fcf6b4b3cd5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:46.953700 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42b1e195-c7ee-429c-8478-7fcf6b4b3cd5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:47.006931 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6868df5a-1394-4797-ac34-d819129c552f tempest-QuotasTestJSON-356474143 tempest-QuotasTestJSON-356474143-project] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/31fd00b0e9164b20a6255be322056081/defaults" status: 200 len: 371 microversion: 2.1 time: 0.390435 Oct 30 01:44:47.009789 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2869/5745] 10.222.0.13 () {58 vars in 1269 bytes} [Sun Oct 30 01:44:46 2022] GET /compute/v2.1/os-quota-sets/31fd00b0e9164b20a6255be322056081/defaults => generated 371 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:44:47.019167 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-42b1e195-c7ee-429c-8478-7fcf6b4b3cd5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "POST /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd/action" status: 200 len: 14 microversion: 2.1 time: 0.084671 Oct 30 01:44:47.022135 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2877/5746] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:44:46 2022] POST /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:44:47.029891 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-50e3fa31-9789-40de-9fce-1d275976cc1e tempest-QuotasTestJSON-356474143 tempest-QuotasTestJSON-356474143-project] Calling method '.version_select at 0x7f44c7ac9dc0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:47.333047 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-50e3fa31-9789-40de-9fce-1d275976cc1e tempest-QuotasTestJSON-356474143 tempest-QuotasTestJSON-356474143-project] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/31fd00b0e9164b20a6255be322056081" status: 200 len: 371 microversion: 2.1 time: 0.309608 Oct 30 01:44:47.334271 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2878/5747] 10.222.0.13 () {58 vars in 1242 bytes} [Sun Oct 30 01:44:47 2022] GET /compute/v2.1/os-quota-sets/31fd00b0e9164b20a6255be322056081 => generated 371 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:44:47.347509 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1b3afb87-c034-4b71-8267-779385494d95 tempest-QuotasTestJSON-356474143 tempest-QuotasTestJSON-356474143-project] Calling method '.version_select at 0x7f44c6d50ee0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:47.613940 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1b3afb87-c034-4b71-8267-779385494d95 tempest-QuotasTestJSON-356474143 tempest-QuotasTestJSON-356474143-project] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/31fd00b0e9164b20a6255be322056081?user_id=0e82bdb5a67f4d05bd624c1bb23753a8" status: 200 len: 371 microversion: 2.1 time: 0.270923 Oct 30 01:44:47.615166 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2870/5748] 10.222.0.13 () {58 vars in 1323 bytes} [Sun Oct 30 01:44:47 2022] GET /compute/v2.1/os-quota-sets/31fd00b0e9164b20a6255be322056081?user_id=0e82bdb5a67f4d05bd624c1bb23753a8 => generated 371 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:44:48.036018 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d16203f4-8f1b-4c52-a92b-541487aef76c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:44:48.038415 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d16203f4-8f1b-4c52-a92b-541487aef76c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: a0a1550e-e885-495b-9199-04334dce39dd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:48.045963 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d16203f4-8f1b-4c52-a92b-541487aef76c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:48.046462 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d16203f4-8f1b-4c52-a92b-541487aef76c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:48.046901 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d16203f4-8f1b-4c52-a92b-541487aef76c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:48.048860 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d16203f4-8f1b-4c52-a92b-541487aef76c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:48.048860 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d16203f4-8f1b-4c52-a92b-541487aef76c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:48.048860 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d16203f4-8f1b-4c52-a92b-541487aef76c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:48.144260 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d16203f4-8f1b-4c52-a92b-541487aef76c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "POST /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd/action" status: 200 len: 14 microversion: 2.1 time: 0.080654 Oct 30 01:44:48.151938 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2879/5749] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:44:48 2022] POST /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:44:49.158616 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d7a6c57a-5e7a-4905-bbd3-d30ff064ff68 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:44:49.160973 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d7a6c57a-5e7a-4905-bbd3-d30ff064ff68 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: a0a1550e-e885-495b-9199-04334dce39dd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:49.172649 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7a6c57a-5e7a-4905-bbd3-d30ff064ff68 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:49.177595 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7a6c57a-5e7a-4905-bbd3-d30ff064ff68 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:49.180695 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7a6c57a-5e7a-4905-bbd3-d30ff064ff68 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:49.182657 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7a6c57a-5e7a-4905-bbd3-d30ff064ff68 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:49.185466 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7a6c57a-5e7a-4905-bbd3-d30ff064ff68 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:49.185466 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7a6c57a-5e7a-4905-bbd3-d30ff064ff68 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:49.279850 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d7a6c57a-5e7a-4905-bbd3-d30ff064ff68 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "POST /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd/action" status: 200 len: 14 microversion: 2.1 time: 0.125080 Oct 30 01:44:49.284203 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2871/5750] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:44:49 2022] POST /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd/action => generated 14 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:44:50.292603 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b316177a-e49e-4a33-b048-7055a24df46b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:44:50.297477 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b316177a-e49e-4a33-b048-7055a24df46b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: a0a1550e-e885-495b-9199-04334dce39dd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:50.302751 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-02e91bc9-cf6a-4d94-98a0-0956a7611c13 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Action: 'create', calling method: .version_select at 0x7f44c79f0280>, body: {"keypair": {"name": "tempest-keypair-1267645079", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTnm5EmH46EJASM/KLB9fMsKOyeBjtzwzpZm7sDGIqWCYcErFtIuKUdHc4ZW2jrvxBDvRTMJomkQvaF52oeKFZ4xyDTj1iu4Z/4ZWRm86RsfAH5gu+CDEnYDZiKa/im9w=="}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:44:50.306615 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b316177a-e49e-4a33-b048-7055a24df46b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:50.307343 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b316177a-e49e-4a33-b048-7055a24df46b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:50.308012 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b316177a-e49e-4a33-b048-7055a24df46b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:50.308971 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b316177a-e49e-4a33-b048-7055a24df46b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:50.309838 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b316177a-e49e-4a33-b048-7055a24df46b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:50.310482 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b316177a-e49e-4a33-b048-7055a24df46b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:50.322347 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-02e91bc9-cf6a-4d94-98a0-0956a7611c13 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Getting quotas for project 311cde01e89442f1ab3aa930070b7343. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:44:50.332253 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-02e91bc9-cf6a-4d94-98a0-0956a7611c13 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Getting quotas for user dcb021152c684983b31e5db439518921 and project 311cde01e89442f1ab3aa930070b7343. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:44:50.379107 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b316177a-e49e-4a33-b048-7055a24df46b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "POST /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd/action" status: 200 len: 14 microversion: 2.1 time: 0.090508 Oct 30 01:44:50.380029 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2872/5751] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:44:50 2022] POST /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 30 01:44:50.447883 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-02e91bc9-cf6a-4d94-98a0-0956a7611c13 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.390083 Oct 30 01:44:50.448493 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2880/5752] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 30 01:44:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:44:51.392140 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9e37d7f6-626e-4836-9bef-68db82f0a32f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:44:51.396832 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9e37d7f6-626e-4836-9bef-68db82f0a32f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: a0a1550e-e885-495b-9199-04334dce39dd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:51.406280 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9e37d7f6-626e-4836-9bef-68db82f0a32f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:51.407053 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9e37d7f6-626e-4836-9bef-68db82f0a32f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:51.407871 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9e37d7f6-626e-4836-9bef-68db82f0a32f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:51.409220 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9e37d7f6-626e-4836-9bef-68db82f0a32f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:51.410749 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9e37d7f6-626e-4836-9bef-68db82f0a32f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:51.411608 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9e37d7f6-626e-4836-9bef-68db82f0a32f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:51.489487 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9e37d7f6-626e-4836-9bef-68db82f0a32f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "POST /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd/action" status: 200 len: 14 microversion: 2.1 time: 0.101786 Oct 30 01:44:51.492910 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2873/5753] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:44:51 2022] POST /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:44:52.501767 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8463f377-00ce-434b-bc0e-2fbd70924ecb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:44:52.504886 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8463f377-00ce-434b-bc0e-2fbd70924ecb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: a0a1550e-e885-495b-9199-04334dce39dd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:52.511518 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8463f377-00ce-434b-bc0e-2fbd70924ecb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:52.512129 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8463f377-00ce-434b-bc0e-2fbd70924ecb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:52.512777 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8463f377-00ce-434b-bc0e-2fbd70924ecb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:52.513704 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8463f377-00ce-434b-bc0e-2fbd70924ecb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:52.514377 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8463f377-00ce-434b-bc0e-2fbd70924ecb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:52.515001 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8463f377-00ce-434b-bc0e-2fbd70924ecb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:52.589074 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8463f377-00ce-434b-bc0e-2fbd70924ecb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "POST /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd/action" status: 200 len: 14 microversion: 2.1 time: 0.079516 Oct 30 01:44:52.589074 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2881/5754] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:44:52 2022] POST /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:44:53.602931 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-565ec160-2c91-4b92-a16c-7861bb0744d2 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:44:53.612169 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-565ec160-2c91-4b92-a16c-7861bb0744d2 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: a0a1550e-e885-495b-9199-04334dce39dd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:53.627827 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-565ec160-2c91-4b92-a16c-7861bb0744d2 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:53.628670 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-565ec160-2c91-4b92-a16c-7861bb0744d2 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:53.629674 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-565ec160-2c91-4b92-a16c-7861bb0744d2 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:53.631793 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-565ec160-2c91-4b92-a16c-7861bb0744d2 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:53.632284 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-565ec160-2c91-4b92-a16c-7861bb0744d2 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:53.640318 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-565ec160-2c91-4b92-a16c-7861bb0744d2 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:53.721088 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-565ec160-2c91-4b92-a16c-7861bb0744d2 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "POST /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd/action" status: 200 len: 14 microversion: 2.1 time: 0.133222 Oct 30 01:44:53.725836 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2882/5755] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:44:53 2022] POST /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd/action => generated 14 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:44:53.950319 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-311fd0fb-6991-4f14-b685-1cd3827f5455 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-787829742", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1ac83571-0ede-40a0-ae99-0e3341ce15be"}], "security_groups": [{"name": "tempest-securitygroup--47049276"}], "key_name": "tempest-keypair-1267645079", "user_data": "}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:44:53.958028 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d73d0501-d477-4792-9eb9-319dd3847d25 tempest-ComputeTenantNetworksTest-1142067239 tempest-ComputeTenantNetworksTest-1142067239-project] Calling method '.version_select at 0x7f44d03ceb80>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:54.240119 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-311fd0fb-6991-4f14-b685-1cd3827f5455 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] validate_networks() for [('1ac83571-0ede-40a0-ae99-0e3341ce15be', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:44:54.816802 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d73d0501-d477-4792-9eb9-319dd3847d25 tempest-ComputeTenantNetworksTest-1142067239 tempest-ComputeTenantNetworksTest-1142067239-project] 10.222.0.13 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 1.286416 Oct 30 01:44:54.818520 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2874/5756] 10.222.0.13 () {58 vars in 1158 bytes} [Sun Oct 30 01:44:53 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:44:54.823190 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a23450d9-5751-4c64-87e1-e8d19577d266 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:44:54.825607 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a23450d9-5751-4c64-87e1-e8d19577d266 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: a0a1550e-e885-495b-9199-04334dce39dd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:54.833705 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a23450d9-5751-4c64-87e1-e8d19577d266 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:54.834205 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a23450d9-5751-4c64-87e1-e8d19577d266 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:54.834647 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a23450d9-5751-4c64-87e1-e8d19577d266 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:54.835683 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a23450d9-5751-4c64-87e1-e8d19577d266 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:54.836138 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a23450d9-5751-4c64-87e1-e8d19577d266 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:54.837274 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a23450d9-5751-4c64-87e1-e8d19577d266 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:54.930140 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a23450d9-5751-4c64-87e1-e8d19577d266 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "POST /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd/action" status: 200 len: 14 microversion: 2.1 time: 0.110272 Oct 30 01:44:54.935138 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2875/5757] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:44:54 2022] POST /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:44:54.964024 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-57bebe11-7946-4575-8667-06e8b4ebf4f1 tempest-ComputeTenantNetworksTest-1142067239 tempest-ComputeTenantNetworksTest-1142067239-project] Calling method '.version_select at 0x7f44d03deee0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:55.175978 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-57bebe11-7946-4575-8667-06e8b4ebf4f1 tempest-ComputeTenantNetworksTest-1142067239 tempest-ComputeTenantNetworksTest-1142067239-project] 10.222.0.13 "GET /compute/v2.1/os-tenant-networks/02dd46b6-268e-4144-a2f2-4ba8c85f0edd" status: 200 len: 139 microversion: 2.1 time: 0.238616 Oct 30 01:44:55.177032 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2876/5758] 10.222.0.13 () {58 vars in 1269 bytes} [Sun Oct 30 01:44:54 2022] GET /compute/v2.1/os-tenant-networks/02dd46b6-268e-4144-a2f2-4ba8c85f0edd => generated 139 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:44:55.349727 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-311fd0fb-6991-4f14-b685-1cd3827f5455 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:44:55.350207 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-311fd0fb-6991-4f14-b685-1cd3827f5455 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:44:55.350963 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-311fd0fb-6991-4f14-b685-1cd3827f5455 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:44:55.351747 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-311fd0fb-6991-4f14-b685-1cd3827f5455 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:44:55.352645 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-311fd0fb-6991-4f14-b685-1cd3827f5455 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:44:55.368475 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-311fd0fb-6991-4f14-b685-1cd3827f5455 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:55.369464 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-311fd0fb-6991-4f14-b685-1cd3827f5455 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:55.369917 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-311fd0fb-6991-4f14-b685-1cd3827f5455 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:55.371106 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-311fd0fb-6991-4f14-b685-1cd3827f5455 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:55.371774 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-311fd0fb-6991-4f14-b685-1cd3827f5455 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:55.372224 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-311fd0fb-6991-4f14-b685-1cd3827f5455 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:55.404961 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-311fd0fb-6991-4f14-b685-1cd3827f5455 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Getting quotas for project 311cde01e89442f1ab3aa930070b7343. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:44:55.415688 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-311fd0fb-6991-4f14-b685-1cd3827f5455 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Getting quotas for user dcb021152c684983b31e5db439518921 and project 311cde01e89442f1ab3aa930070b7343. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:44:55.434561 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-311fd0fb-6991-4f14-b685-1cd3827f5455 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:44:55.437984 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-311fd0fb-6991-4f14-b685-1cd3827f5455 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 0671096f-ed83-4341-8f95-d138a9eebffc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:44:55.574583 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-311fd0fb-6991-4f14-b685-1cd3827f5455 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.630183 Oct 30 01:44:55.575597 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2883/5759] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:44:53 2022] POST /compute/v2.1/servers => generated 400 bytes in 1632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 30 01:44:55.588810 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d427b6c7-ca06-4af4-922a-0f9e51076cba tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:55.589924 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d427b6c7-ca06-4af4-922a-0f9e51076cba tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 0671096f-ed83-4341-8f95-d138a9eebffc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:55.676862 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d427b6c7-ca06-4af4-922a-0f9e51076cba tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:55.686735 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d427b6c7-ca06-4af4-922a-0f9e51076cba tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc" status: 200 len: 1241 microversion: 2.1 time: 0.103945 Oct 30 01:44:55.687457 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2877/5760] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:55 2022] GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc => generated 1241 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:55.946327 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8a512e47-3769-4f3f-88ed-fb3ae0ab2f20 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:44:55.946652 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8a512e47-3769-4f3f-88ed-fb3ae0ab2f20 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: a0a1550e-e885-495b-9199-04334dce39dd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:55.960020 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8a512e47-3769-4f3f-88ed-fb3ae0ab2f20 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:55.960513 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8a512e47-3769-4f3f-88ed-fb3ae0ab2f20 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:55.961143 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8a512e47-3769-4f3f-88ed-fb3ae0ab2f20 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:55.962107 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8a512e47-3769-4f3f-88ed-fb3ae0ab2f20 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:55.962583 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8a512e47-3769-4f3f-88ed-fb3ae0ab2f20 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:55.967711 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8a512e47-3769-4f3f-88ed-fb3ae0ab2f20 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:56.035380 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8a512e47-3769-4f3f-88ed-fb3ae0ab2f20 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "POST /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd/action" status: 200 len: 14 microversion: 2.1 time: 0.096540 Oct 30 01:44:56.036833 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2884/5761] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:44:55 2022] POST /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:44:56.711134 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1bd56d59-6bc2-4545-8390-8e5f1f9eb72f tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:56.712974 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1bd56d59-6bc2-4545-8390-8e5f1f9eb72f tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 0671096f-ed83-4341-8f95-d138a9eebffc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:56.776069 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1bd56d59-6bc2-4545-8390-8e5f1f9eb72f tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:56.797516 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1bd56d59-6bc2-4545-8390-8e5f1f9eb72f tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc" status: 200 len: 1241 microversion: 2.1 time: 0.089406 Oct 30 01:44:56.807343 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2878/5762] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:56 2022] GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc => generated 1241 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:57.050764 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-16058947-f9e1-475b-8268-706885a00d78 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:44:57.054032 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-16058947-f9e1-475b-8268-706885a00d78 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: a0a1550e-e885-495b-9199-04334dce39dd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:57.089700 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-16058947-f9e1-475b-8268-706885a00d78 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:57.090413 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-16058947-f9e1-475b-8268-706885a00d78 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:57.090980 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-16058947-f9e1-475b-8268-706885a00d78 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:57.091918 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-16058947-f9e1-475b-8268-706885a00d78 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:57.092903 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-16058947-f9e1-475b-8268-706885a00d78 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:57.094152 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-16058947-f9e1-475b-8268-706885a00d78 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:57.167262 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-16058947-f9e1-475b-8268-706885a00d78 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "POST /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd/action" status: 200 len: 14 microversion: 2.1 time: 0.122406 Oct 30 01:44:57.168288 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2885/5763] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:44:57 2022] POST /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:44:57.820951 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9bba7855-9ebb-4a20-a011-f4e94a02df7b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:57.822514 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9bba7855-9ebb-4a20-a011-f4e94a02df7b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 0671096f-ed83-4341-8f95-d138a9eebffc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:57.829642 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9bba7855-9ebb-4a20-a011-f4e94a02df7b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:57.830286 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9bba7855-9ebb-4a20-a011-f4e94a02df7b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:57.830837 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9bba7855-9ebb-4a20-a011-f4e94a02df7b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:57.831630 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9bba7855-9ebb-4a20-a011-f4e94a02df7b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:57.832223 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9bba7855-9ebb-4a20-a011-f4e94a02df7b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:57.832702 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9bba7855-9ebb-4a20-a011-f4e94a02df7b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:57.932257 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9bba7855-9ebb-4a20-a011-f4e94a02df7b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:57.950102 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9bba7855-9ebb-4a20-a011-f4e94a02df7b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc" status: 200 len: 1237 microversion: 2.1 time: 0.127419 Oct 30 01:44:57.959283 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2879/5764] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:57 2022] GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc => generated 1237 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:58.185948 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c556c1e6-75c2-4912-944c-05ad133d8fb9 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:44:58.186476 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c556c1e6-75c2-4912-944c-05ad133d8fb9 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: a0a1550e-e885-495b-9199-04334dce39dd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:58.243382 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c556c1e6-75c2-4912-944c-05ad133d8fb9 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:58.243896 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c556c1e6-75c2-4912-944c-05ad133d8fb9 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:58.244525 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c556c1e6-75c2-4912-944c-05ad133d8fb9 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:58.245724 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c556c1e6-75c2-4912-944c-05ad133d8fb9 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:58.246342 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c556c1e6-75c2-4912-944c-05ad133d8fb9 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:58.246945 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c556c1e6-75c2-4912-944c-05ad133d8fb9 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:58.361940 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c556c1e6-75c2-4912-944c-05ad133d8fb9 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "POST /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd/action" status: 200 len: 8206 microversion: 2.1 time: 0.184030 Oct 30 01:44:58.375586 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2886/5765] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:44:58 2022] POST /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd/action => generated 8206 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:58.376082 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-22dec358-c87d-4a1b-b506-5bdab76d5acb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:58.376082 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-22dec358-c87d-4a1b-b506-5bdab76d5acb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:58.394879 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-22dec358-c87d-4a1b-b506-5bdab76d5acb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:58.395419 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-22dec358-c87d-4a1b-b506-5bdab76d5acb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:58.402037 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-22dec358-c87d-4a1b-b506-5bdab76d5acb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:58.403049 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-22dec358-c87d-4a1b-b506-5bdab76d5acb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:58.403545 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-22dec358-c87d-4a1b-b506-5bdab76d5acb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:58.403990 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-22dec358-c87d-4a1b-b506-5bdab76d5acb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:58.590065 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-22dec358-c87d-4a1b-b506-5bdab76d5acb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:58.598900 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-22dec358-c87d-4a1b-b506-5bdab76d5acb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1670 microversion: 2.1 time: 0.229660 Oct 30 01:44:58.599474 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2880/5766] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:58 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1670 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:58.637656 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b8119367-32ba-4550-ac7f-42cee79d07b1 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:58.637994 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b8119367-32ba-4550-ac7f-42cee79d07b1 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:58.652800 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b8119367-32ba-4550-ac7f-42cee79d07b1 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:58.655153 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b8119367-32ba-4550-ac7f-42cee79d07b1 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:58.655840 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b8119367-32ba-4550-ac7f-42cee79d07b1 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:58.656829 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b8119367-32ba-4550-ac7f-42cee79d07b1 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:58.657583 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b8119367-32ba-4550-ac7f-42cee79d07b1 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:58.658020 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b8119367-32ba-4550-ac7f-42cee79d07b1 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:58.829967 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b8119367-32ba-4550-ac7f-42cee79d07b1 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:58.837012 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b8119367-32ba-4550-ac7f-42cee79d07b1 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1670 microversion: 2.1 time: 0.205281 Oct 30 01:44:58.837816 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2887/5767] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:58 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1670 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:58.860090 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-66985e0e-718b-4080-9509-764b4f1a781c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:58.861832 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-66985e0e-718b-4080-9509-764b4f1a781c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:58.872051 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-66985e0e-718b-4080-9509-764b4f1a781c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:58.872601 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-66985e0e-718b-4080-9509-764b4f1a781c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:58.876229 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-66985e0e-718b-4080-9509-764b4f1a781c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:58.876229 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-66985e0e-718b-4080-9509-764b4f1a781c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:58.876229 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-66985e0e-718b-4080-9509-764b4f1a781c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:58.876229 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-66985e0e-718b-4080-9509-764b4f1a781c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:58.975185 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-471be3b6-af6a-4f56-8177-171820f6ecba tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:58.975781 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-471be3b6-af6a-4f56-8177-171820f6ecba tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 0671096f-ed83-4341-8f95-d138a9eebffc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:58.984773 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-471be3b6-af6a-4f56-8177-171820f6ecba tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:58.985686 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-471be3b6-af6a-4f56-8177-171820f6ecba tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:58.986284 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-471be3b6-af6a-4f56-8177-171820f6ecba tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:58.987275 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-471be3b6-af6a-4f56-8177-171820f6ecba tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:58.987924 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-471be3b6-af6a-4f56-8177-171820f6ecba tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:58.988502 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-471be3b6-af6a-4f56-8177-171820f6ecba tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:59.195335 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-471be3b6-af6a-4f56-8177-171820f6ecba tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:59.216515 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:59.220505 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-471be3b6-af6a-4f56-8177-171820f6ecba tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc" status: 200 len: 1301 microversion: 2.1 time: 0.249073 Oct 30 01:44:59.235279 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2888/5768] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:58 2022] GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc => generated 1301 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:44:59.608269 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-66985e0e-718b-4080-9509-764b4f1a781c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:59.625634 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-66985e0e-718b-4080-9509-764b4f1a781c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1670 microversion: 2.1 time: 0.769633 Oct 30 01:44:59.626577 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2881/5769] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:58 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1670 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:59.650500 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-413d601b-fe81-4d86-bdd5-fa52d95fe832 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:44:59.652684 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-413d601b-fe81-4d86-bdd5-fa52d95fe832 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:59.665261 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-413d601b-fe81-4d86-bdd5-fa52d95fe832 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:59.666043 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-413d601b-fe81-4d86-bdd5-fa52d95fe832 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:59.678953 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-413d601b-fe81-4d86-bdd5-fa52d95fe832 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:59.680663 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-413d601b-fe81-4d86-bdd5-fa52d95fe832 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:59.681864 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-413d601b-fe81-4d86-bdd5-fa52d95fe832 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:59.685521 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-413d601b-fe81-4d86-bdd5-fa52d95fe832 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:44:59.933984 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-413d601b-fe81-4d86-bdd5-fa52d95fe832 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:44:59.950510 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-413d601b-fe81-4d86-bdd5-fa52d95fe832 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1670 microversion: 2.1 time: 0.306153 Oct 30 01:44:59.951457 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2889/5770] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:44:59 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1670 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:44:59.974856 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9a3cf09c-973f-45c7-9b51-ebe29d004c9c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:44:59.975439 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9a3cf09c-973f-45c7-9b51-ebe29d004c9c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:44:59.987028 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9a3cf09c-973f-45c7-9b51-ebe29d004c9c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:44:59.988874 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9a3cf09c-973f-45c7-9b51-ebe29d004c9c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:44:59.989514 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9a3cf09c-973f-45c7-9b51-ebe29d004c9c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:00.002303 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9a3cf09c-973f-45c7-9b51-ebe29d004c9c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:00.002793 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9a3cf09c-973f-45c7-9b51-ebe29d004c9c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:00.003327 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9a3cf09c-973f-45c7-9b51-ebe29d004c9c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:00.248729 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d1d2dd90-fe78-4485-948c-89744932cbfe tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:45:00.249249 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d1d2dd90-fe78-4485-948c-89744932cbfe tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 0671096f-ed83-4341-8f95-d138a9eebffc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:00.258663 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d1d2dd90-fe78-4485-948c-89744932cbfe tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:00.259892 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d1d2dd90-fe78-4485-948c-89744932cbfe tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:00.260502 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d1d2dd90-fe78-4485-948c-89744932cbfe tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:00.261835 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d1d2dd90-fe78-4485-948c-89744932cbfe tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:00.262781 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d1d2dd90-fe78-4485-948c-89744932cbfe tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:00.263368 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d1d2dd90-fe78-4485-948c-89744932cbfe tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:00.268188 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9a3cf09c-973f-45c7-9b51-ebe29d004c9c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Locking {{(pid=121102) lock /opt/stack/nova/nova/compute/api.py:4845}} Oct 30 01:45:00.542547 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9a3cf09c-973f-45c7-9b51-ebe29d004c9c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "POST /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9/action" status: 202 len: 0 microversion: 2.1 time: 0.572158 Oct 30 01:45:00.547897 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2882/5771] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:44:59 2022] POST /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9/action => generated 0 bytes in 578 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:45:00.559462 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-03ac68bd-9fd4-43f6-8e53-2237e4a0849b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:45:00.560083 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-03ac68bd-9fd4-43f6-8e53-2237e4a0849b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:00.567209 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-03ac68bd-9fd4-43f6-8e53-2237e4a0849b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:00.573824 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-03ac68bd-9fd4-43f6-8e53-2237e4a0849b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:00.574202 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-03ac68bd-9fd4-43f6-8e53-2237e4a0849b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:00.574953 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-03ac68bd-9fd4-43f6-8e53-2237e4a0849b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:00.575410 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-03ac68bd-9fd4-43f6-8e53-2237e4a0849b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:00.582046 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-03ac68bd-9fd4-43f6-8e53-2237e4a0849b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:00.614089 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d1d2dd90-fe78-4485-948c-89744932cbfe tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:45:00.658868 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d1d2dd90-fe78-4485-948c-89744932cbfe tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc" status: 200 len: 1365 microversion: 2.1 time: 0.407771 Oct 30 01:45:00.660161 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2890/5772] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:45:00 2022] GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc => generated 1365 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:45:00.860645 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-03ac68bd-9fd4-43f6-8e53-2237e4a0849b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:45:00.869163 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-03ac68bd-9fd4-43f6-8e53-2237e4a0849b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1670 microversion: 2.1 time: 0.318338 Oct 30 01:45:00.872789 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2883/5773] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:45:00 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1670 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:45:00.897581 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-20ac3298-f489-4f4d-b231-6e9766a7793b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:45:00.908326 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-20ac3298-f489-4f4d-b231-6e9766a7793b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:00.909778 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-20ac3298-f489-4f4d-b231-6e9766a7793b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:00.909778 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-20ac3298-f489-4f4d-b231-6e9766a7793b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:00.982898 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-20ac3298-f489-4f4d-b231-6e9766a7793b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] HTTP exception thrown: Instance b0f03664-8785-4321-b32e-3622f1b747b9 is locked Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-20ac3298-f489-4f4d-b231-6e9766a7793b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Request method failure captured: Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: request: POST /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9/action HTTP/1.1 Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 15 Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdXv08UieK2P0p6pvt8NCvlDNpE7nwwmqKRy3GqbMTGA0eIN66Y4wpKQHzC9fqGSwWNMELWbqq5UQS3MEVOVNfA2QR9cXwwAeRlgzmSRghjjPbvWjrnWlt2xXhoJQePHPZSUYBnEovFZtPMPN8ilqbXGb8wb5Tc4mNTDR3WIqu8sIR0 Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 9f9d0d541cc3496ebf8dc71af4254506 Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServerActionsTestJSON-1828815177 Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9f9d0d541cc3496ebf8dc71af4254506"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9f9d0d541cc3496ebf8dc71af4254506"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9f9d0d541cc3496ebf8dc71af4254506"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9f9d0d541cc3496ebf8dc71af4254506"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServerActionsTestJSON-1828815177 Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 9f9d0d541cc3496ebf8dc71af4254506 Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServerActionsTestJSON-1828815177 Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServerActionsTestJSON-1828815177-project Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 157c0ef579434726810bb3775388b944 Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServerActionsTestJSON-1828815177-project Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: {"os-stop": {}} Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: exception: Instance b0f03664-8785-4321-b32e-3622f1b747b9 is locked Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'b0f03664-8785-4321-b32e-3622f1b747b9', 'body': {'os-stop': {}}} Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance b0f03664-8785-4321-b32e-3622f1b747b9 is locked Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance b0f03664-8785-4321-b32e-3622f1b747b9 is locked Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0f03664-8785-4321-b32e-3622f1b747b9 is locked Oct 30 01:45:00.984604 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:45:00.990171 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-20ac3298-f489-4f4d-b231-6e9766a7793b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Returning 409 to user: Instance b0f03664-8785-4321-b32e-3622f1b747b9 is locked {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:45:00.991458 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-20ac3298-f489-4f4d-b231-6e9766a7793b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "POST /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9/action" status: 409 len: 107 microversion: 2.1 time: 0.097703 Oct 30 01:45:00.995217 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2891/5774] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:45:00 2022] POST /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9/action => generated 107 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 30 01:45:01.001261 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1ec56c67-6491-4bbd-9290-68a74834fa6e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:45:01.001884 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1ec56c67-6491-4bbd-9290-68a74834fa6e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:01.012390 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ec56c67-6491-4bbd-9290-68a74834fa6e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:01.018124 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ec56c67-6491-4bbd-9290-68a74834fa6e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:01.018651 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ec56c67-6491-4bbd-9290-68a74834fa6e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:01.019411 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ec56c67-6491-4bbd-9290-68a74834fa6e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:01.019879 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ec56c67-6491-4bbd-9290-68a74834fa6e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:01.020306 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ec56c67-6491-4bbd-9290-68a74834fa6e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:01.251248 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1ec56c67-6491-4bbd-9290-68a74834fa6e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Unlocking {{(pid=121102) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 30 01:45:01.463383 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1ec56c67-6491-4bbd-9290-68a74834fa6e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "POST /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9/action" status: 202 len: 0 microversion: 2.1 time: 0.466753 Oct 30 01:45:01.464886 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2884/5775] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:45:00 2022] POST /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9/action => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:45:01.479661 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ee8a558a-ad78-4cc0-a290-10bfd4ce9537 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:45:01.495533 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ee8a558a-ad78-4cc0-a290-10bfd4ce9537 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:01.499304 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ee8a558a-ad78-4cc0-a290-10bfd4ce9537 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:01.501632 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ee8a558a-ad78-4cc0-a290-10bfd4ce9537 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:01.536849 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ee8a558a-ad78-4cc0-a290-10bfd4ce9537 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Going to try to stop instance {{(pid=121103) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 30 01:45:01.684443 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-46e77b35-c9be-4fce-8d62-08055ae69add tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:45:01.685087 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-46e77b35-c9be-4fce-8d62-08055ae69add tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 0671096f-ed83-4341-8f95-d138a9eebffc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:01.709489 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-46e77b35-c9be-4fce-8d62-08055ae69add tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:01.710000 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-46e77b35-c9be-4fce-8d62-08055ae69add tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:01.710448 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-46e77b35-c9be-4fce-8d62-08055ae69add tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:01.714342 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-46e77b35-c9be-4fce-8d62-08055ae69add tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:01.715899 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-46e77b35-c9be-4fce-8d62-08055ae69add tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:01.719349 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-46e77b35-c9be-4fce-8d62-08055ae69add tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:01.730768 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ee8a558a-ad78-4cc0-a290-10bfd4ce9537 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "POST /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9/action" status: 202 len: 0 microversion: 2.1 time: 0.261887 Oct 30 01:45:01.732822 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2892/5776] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:45:01 2022] POST /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:45:01.750466 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7e3e4e0f-1d5b-4d80-91eb-6d168b9fd8aa tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:45:01.751346 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7e3e4e0f-1d5b-4d80-91eb-6d168b9fd8aa tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:01.771302 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7e3e4e0f-1d5b-4d80-91eb-6d168b9fd8aa tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:01.771814 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7e3e4e0f-1d5b-4d80-91eb-6d168b9fd8aa tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:01.772454 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7e3e4e0f-1d5b-4d80-91eb-6d168b9fd8aa tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:01.773400 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7e3e4e0f-1d5b-4d80-91eb-6d168b9fd8aa tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:01.774215 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7e3e4e0f-1d5b-4d80-91eb-6d168b9fd8aa tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:01.777505 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7e3e4e0f-1d5b-4d80-91eb-6d168b9fd8aa tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:01.794620 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=4,nova_cell1:UPDATE=8 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:02.138505 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-46e77b35-c9be-4fce-8d62-08055ae69add tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:45:02.156737 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-46e77b35-c9be-4fce-8d62-08055ae69add tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc" status: 200 len: 1365 microversion: 2.1 time: 0.476556 Oct 30 01:45:02.157769 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2885/5777] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:45:01 2022] GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc => generated 1365 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:45:02.243240 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7e3e4e0f-1d5b-4d80-91eb-6d168b9fd8aa tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:45:02.253109 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7e3e4e0f-1d5b-4d80-91eb-6d168b9fd8aa tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1680 microversion: 2.1 time: 0.516739 Oct 30 01:45:02.254272 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2893/5778] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:45:01 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1680 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:45:02.622229 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-62e87e2b-2feb-4db5-8e40-ec5c0b7803a0 req-98bff112-c476-4ecd-86b5-0bffb04ead9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0671096f-ed83-4341-8f95-d138a9eebffc", "tag": "9693fed6-7a6c-4db5-9887-3da909c0a76e"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:45:02.632285 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-62e87e2b-2feb-4db5-8e40-ec5c0b7803a0 req-98bff112-c476-4ecd-86b5-0bffb04ead9e service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:02.632756 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-62e87e2b-2feb-4db5-8e40-ec5c0b7803a0 req-98bff112-c476-4ecd-86b5-0bffb04ead9e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:02.633501 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-62e87e2b-2feb-4db5-8e40-ec5c0b7803a0 req-98bff112-c476-4ecd-86b5-0bffb04ead9e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:02.652189 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-62e87e2b-2feb-4db5-8e40-ec5c0b7803a0 req-98bff112-c476-4ecd-86b5-0bffb04ead9e service nova] Creating event network-changed:9693fed6-7a6c-4db5-9887-3da909c0a76e for instance 0671096f-ed83-4341-8f95-d138a9eebffc on n-h1-master-1 Oct 30 01:45:02.657614 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-62e87e2b-2feb-4db5-8e40-ec5c0b7803a0 req-98bff112-c476-4ecd-86b5-0bffb04ead9e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.498274 Oct 30 01:45:02.658295 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2886/5779] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:45:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:45:03.183197 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4b7e37ed-932c-414d-b4d7-dde932a71def tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:45:03.184411 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4b7e37ed-932c-414d-b4d7-dde932a71def tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 0671096f-ed83-4341-8f95-d138a9eebffc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:03.191369 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4b7e37ed-932c-414d-b4d7-dde932a71def tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:03.192174 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4b7e37ed-932c-414d-b4d7-dde932a71def tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:03.192606 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4b7e37ed-932c-414d-b4d7-dde932a71def tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:03.193503 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4b7e37ed-932c-414d-b4d7-dde932a71def tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:03.193955 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4b7e37ed-932c-414d-b4d7-dde932a71def tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:03.194563 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4b7e37ed-932c-414d-b4d7-dde932a71def tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:03.278058 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7afd8871-27f3-4ca3-9da1-82c7a16540ab tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:45:03.278992 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7afd8871-27f3-4ca3-9da1-82c7a16540ab tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:03.294161 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7afd8871-27f3-4ca3-9da1-82c7a16540ab tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:03.295110 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7afd8871-27f3-4ca3-9da1-82c7a16540ab tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:03.297772 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7afd8871-27f3-4ca3-9da1-82c7a16540ab tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:03.298738 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7afd8871-27f3-4ca3-9da1-82c7a16540ab tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:03.301752 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7afd8871-27f3-4ca3-9da1-82c7a16540ab tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:03.304581 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7afd8871-27f3-4ca3-9da1-82c7a16540ab tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:03.474827 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4b7e37ed-932c-414d-b4d7-dde932a71def tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:45:03.483848 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4b7e37ed-932c-414d-b4d7-dde932a71def tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc" status: 200 len: 1365 microversion: 2.1 time: 0.305450 Oct 30 01:45:03.484584 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2894/5780] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:45:03 2022] GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc => generated 1365 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:45:03.583194 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7afd8871-27f3-4ca3-9da1-82c7a16540ab tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:45:03.592152 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7afd8871-27f3-4ca3-9da1-82c7a16540ab tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1680 microversion: 2.1 time: 0.319188 Oct 30 01:45:03.605802 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2887/5781] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:45:03 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1680 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:45:04.509386 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-dab73886-e602-4027-a6bc-046d8a5acecd tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:45:04.510611 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-dab73886-e602-4027-a6bc-046d8a5acecd tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 0671096f-ed83-4341-8f95-d138a9eebffc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:04.522989 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dab73886-e602-4027-a6bc-046d8a5acecd tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:04.524156 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dab73886-e602-4027-a6bc-046d8a5acecd tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:04.524958 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dab73886-e602-4027-a6bc-046d8a5acecd tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:04.525875 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dab73886-e602-4027-a6bc-046d8a5acecd tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:04.526448 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dab73886-e602-4027-a6bc-046d8a5acecd tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:04.527615 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dab73886-e602-4027-a6bc-046d8a5acecd tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:04.620258 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f347c209-14ad-42ba-b4ee-c458e16373ad tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:45:04.621681 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f347c209-14ad-42ba-b4ee-c458e16373ad tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:04.628544 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f347c209-14ad-42ba-b4ee-c458e16373ad tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:04.629036 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f347c209-14ad-42ba-b4ee-c458e16373ad tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:04.629630 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f347c209-14ad-42ba-b4ee-c458e16373ad tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:04.630342 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f347c209-14ad-42ba-b4ee-c458e16373ad tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:04.630798 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f347c209-14ad-42ba-b4ee-c458e16373ad tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:04.631248 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f347c209-14ad-42ba-b4ee-c458e16373ad tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:04.847893 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-dab73886-e602-4027-a6bc-046d8a5acecd tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:45:04.861683 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-dab73886-e602-4027-a6bc-046d8a5acecd tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc" status: 200 len: 1365 microversion: 2.1 time: 0.357100 Oct 30 01:45:04.862684 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2895/5782] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:45:04 2022] GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc => generated 1365 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:45:04.878685 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f347c209-14ad-42ba-b4ee-c458e16373ad tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:45:04.888198 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f347c209-14ad-42ba-b4ee-c458e16373ad tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1680 microversion: 2.1 time: 0.274148 Oct 30 01:45:04.919157 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2888/5783] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:45:04 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1680 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:45:05.890213 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-11da0994-07de-4905-89d7-66a8719ea666 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:45:05.890882 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-11da0994-07de-4905-89d7-66a8719ea666 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 0671096f-ed83-4341-8f95-d138a9eebffc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:05.892872 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:05.893607 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=12 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:05.899294 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=4 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:05.901249 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-11da0994-07de-4905-89d7-66a8719ea666 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:05.901894 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-11da0994-07de-4905-89d7-66a8719ea666 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:05.902340 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-11da0994-07de-4905-89d7-66a8719ea666 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:05.903054 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-11da0994-07de-4905-89d7-66a8719ea666 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:05.903518 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-11da0994-07de-4905-89d7-66a8719ea666 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:05.904461 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-11da0994-07de-4905-89d7-66a8719ea666 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:05.928026 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d2aec45c-635f-4ae3-814d-a12dd6c42162 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:45:05.928758 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d2aec45c-635f-4ae3-814d-a12dd6c42162 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:05.937295 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2aec45c-635f-4ae3-814d-a12dd6c42162 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:05.937902 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2aec45c-635f-4ae3-814d-a12dd6c42162 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:05.938572 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2aec45c-635f-4ae3-814d-a12dd6c42162 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:05.939327 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2aec45c-635f-4ae3-814d-a12dd6c42162 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:05.939985 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2aec45c-635f-4ae3-814d-a12dd6c42162 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:05.940414 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2aec45c-635f-4ae3-814d-a12dd6c42162 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:06.149427 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-11da0994-07de-4905-89d7-66a8719ea666 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:45:06.158227 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-11da0994-07de-4905-89d7-66a8719ea666 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc" status: 200 len: 1365 microversion: 2.1 time: 0.271467 Oct 30 01:45:06.160350 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2896/5784] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:45:05 2022] GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc => generated 1365 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:45:06.167348 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d2aec45c-635f-4ae3-814d-a12dd6c42162 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:45:06.177130 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d2aec45c-635f-4ae3-814d-a12dd6c42162 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1680 microversion: 2.1 time: 0.254650 Oct 30 01:45:06.183613 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2889/5785] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:45:05 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1680 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:45:07.189252 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5ca88def-4782-47fc-bc8d-7d38028cd620 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:45:07.189968 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5ca88def-4782-47fc-bc8d-7d38028cd620 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 0671096f-ed83-4341-8f95-d138a9eebffc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:07.201114 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ca88def-4782-47fc-bc8d-7d38028cd620 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:07.201690 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ca88def-4782-47fc-bc8d-7d38028cd620 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:07.202357 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ca88def-4782-47fc-bc8d-7d38028cd620 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:07.203103 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ca88def-4782-47fc-bc8d-7d38028cd620 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:07.203618 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ca88def-4782-47fc-bc8d-7d38028cd620 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:07.204045 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ca88def-4782-47fc-bc8d-7d38028cd620 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:07.204365 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-add24446-a99f-4e14-8974-54c6f590f26f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:45:07.204990 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-add24446-a99f-4e14-8974-54c6f590f26f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:07.207089 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=10 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:07.217002 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-add24446-a99f-4e14-8974-54c6f590f26f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:07.217543 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-add24446-a99f-4e14-8974-54c6f590f26f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:07.217987 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-add24446-a99f-4e14-8974-54c6f590f26f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:07.218704 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-add24446-a99f-4e14-8974-54c6f590f26f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:07.219164 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-add24446-a99f-4e14-8974-54c6f590f26f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:07.219593 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-add24446-a99f-4e14-8974-54c6f590f26f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:07.572697 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5ca88def-4782-47fc-bc8d-7d38028cd620 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:45:07.583170 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5ca88def-4782-47fc-bc8d-7d38028cd620 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc" status: 200 len: 1365 microversion: 2.1 time: 0.403521 Oct 30 01:45:07.583502 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-add24446-a99f-4e14-8974-54c6f590f26f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:45:07.585274 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2897/5786] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:45:07 2022] GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc => generated 1365 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:45:07.593022 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-add24446-a99f-4e14-8974-54c6f590f26f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1680 microversion: 2.1 time: 0.394661 Oct 30 01:45:07.593633 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2890/5787] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:45:07 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1680 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:45:07.946369 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-ac1ba352-69a8-483b-a509-ff737ccb1487 req-c24f4371-b159-418e-9a4f-137961b8cf60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0671096f-ed83-4341-8f95-d138a9eebffc", "name": "network-vif-plugged", "status": "completed", "tag": "9693fed6-7a6c-4db5-9887-3da909c0a76e"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:45:07.956064 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ac1ba352-69a8-483b-a509-ff737ccb1487 req-c24f4371-b159-418e-9a4f-137961b8cf60 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:07.963640 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ac1ba352-69a8-483b-a509-ff737ccb1487 req-c24f4371-b159-418e-9a4f-137961b8cf60 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:07.963640 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ac1ba352-69a8-483b-a509-ff737ccb1487 req-c24f4371-b159-418e-9a4f-137961b8cf60 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:07.992697 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-ac1ba352-69a8-483b-a509-ff737ccb1487 req-c24f4371-b159-418e-9a4f-137961b8cf60 service nova] Creating event network-vif-plugged:9693fed6-7a6c-4db5-9887-3da909c0a76e for instance 0671096f-ed83-4341-8f95-d138a9eebffc on n-h1-master-1 Oct 30 01:45:08.000173 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-ac1ba352-69a8-483b-a509-ff737ccb1487 req-c24f4371-b159-418e-9a4f-137961b8cf60 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.337431 Oct 30 01:45:08.001098 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2898/5788] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:45:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:45:08.608770 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9a4691b9-d653-4d9d-a67d-9f2644582eff tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:45:08.609677 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9a4691b9-d653-4d9d-a67d-9f2644582eff tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 0671096f-ed83-4341-8f95-d138a9eebffc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:08.616808 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:08.617797 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-111f50f4-2f2a-45b5-a3e6-cfaefa85e026 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:45:08.618446 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9a4691b9-d653-4d9d-a67d-9f2644582eff tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:08.619091 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-111f50f4-2f2a-45b5-a3e6-cfaefa85e026 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:08.619370 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9a4691b9-d653-4d9d-a67d-9f2644582eff tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:08.620246 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9a4691b9-d653-4d9d-a67d-9f2644582eff tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:08.621464 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9a4691b9-d653-4d9d-a67d-9f2644582eff tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:08.622115 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9a4691b9-d653-4d9d-a67d-9f2644582eff tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:08.622730 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9a4691b9-d653-4d9d-a67d-9f2644582eff tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:08.628972 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-111f50f4-2f2a-45b5-a3e6-cfaefa85e026 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:08.629604 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-111f50f4-2f2a-45b5-a3e6-cfaefa85e026 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:08.630045 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-111f50f4-2f2a-45b5-a3e6-cfaefa85e026 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:08.631075 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-111f50f4-2f2a-45b5-a3e6-cfaefa85e026 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:08.631377 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-111f50f4-2f2a-45b5-a3e6-cfaefa85e026 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:08.631865 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-111f50f4-2f2a-45b5-a3e6-cfaefa85e026 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:08.920875 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9a4691b9-d653-4d9d-a67d-9f2644582eff tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:45:08.926804 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-111f50f4-2f2a-45b5-a3e6-cfaefa85e026 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:45:08.928935 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9a4691b9-d653-4d9d-a67d-9f2644582eff tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc" status: 200 len: 1365 microversion: 2.1 time: 0.325692 Oct 30 01:45:08.938854 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-111f50f4-2f2a-45b5-a3e6-cfaefa85e026 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1680 microversion: 2.1 time: 0.325712 Oct 30 01:45:08.939520 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2899/5790] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:45:08 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1680 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:45:08.947708 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2891/5790] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:45:08 2022] GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc => generated 1365 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:45:09.953770 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d6c2e570-2803-45c6-aad1-01b080746825 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:45:09.954726 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d6c2e570-2803-45c6-aad1-01b080746825 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 0671096f-ed83-4341-8f95-d138a9eebffc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:09.963529 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d6c2e570-2803-45c6-aad1-01b080746825 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:09.964172 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d6c2e570-2803-45c6-aad1-01b080746825 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:09.964869 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d6c2e570-2803-45c6-aad1-01b080746825 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:09.965800 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d6c2e570-2803-45c6-aad1-01b080746825 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:09.966328 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d6c2e570-2803-45c6-aad1-01b080746825 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:09.966795 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-efcd51dc-a2d5-43e4-9f46-10ccd617a3a1 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:45:09.967257 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d6c2e570-2803-45c6-aad1-01b080746825 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:09.969537 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-efcd51dc-a2d5-43e4-9f46-10ccd617a3a1 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:09.983298 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-efcd51dc-a2d5-43e4-9f46-10ccd617a3a1 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:09.983844 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-efcd51dc-a2d5-43e4-9f46-10ccd617a3a1 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:09.984336 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-efcd51dc-a2d5-43e4-9f46-10ccd617a3a1 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:09.985319 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-efcd51dc-a2d5-43e4-9f46-10ccd617a3a1 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:09.985848 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-efcd51dc-a2d5-43e4-9f46-10ccd617a3a1 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:09.986286 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-efcd51dc-a2d5-43e4-9f46-10ccd617a3a1 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:10.293273 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d6c2e570-2803-45c6-aad1-01b080746825 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:45:10.305611 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d6c2e570-2803-45c6-aad1-01b080746825 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc" status: 200 len: 1554 microversion: 2.1 time: 0.355923 Oct 30 01:45:10.306565 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2900/5791] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:45:09 2022] GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc => generated 1554 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:45:10.320280 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-efcd51dc-a2d5-43e4-9f46-10ccd617a3a1 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:45:10.331434 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d257912f-389c-4f3f-85fc-f95ee483027d tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:45:10.332259 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d257912f-389c-4f3f-85fc-f95ee483027d tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 0671096f-ed83-4341-8f95-d138a9eebffc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:10.332917 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-efcd51dc-a2d5-43e4-9f46-10ccd617a3a1 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1680 microversion: 2.1 time: 0.370020 Oct 30 01:45:10.334356 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2892/5792] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:45:09 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1680 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:45:10.347861 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d257912f-389c-4f3f-85fc-f95ee483027d tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:10.349281 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d257912f-389c-4f3f-85fc-f95ee483027d tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:10.349752 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d257912f-389c-4f3f-85fc-f95ee483027d tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:10.350472 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d257912f-389c-4f3f-85fc-f95ee483027d tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:10.351088 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d257912f-389c-4f3f-85fc-f95ee483027d tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:10.352343 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d257912f-389c-4f3f-85fc-f95ee483027d tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:10.473537 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d257912f-389c-4f3f-85fc-f95ee483027d tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.148468 Oct 30 01:45:10.474396 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2901/5793] 10.222.0.13 () {58 vars in 1275 bytes} [Sun Oct 30 01:45:10 2022] GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc/os-interface => generated 284 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:45:11.357675 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-03a2f87a-3966-4f36-8d2b-a354f295f962 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:45:11.358466 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-03a2f87a-3966-4f36-8d2b-a354f295f962 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:11.378945 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-03a2f87a-3966-4f36-8d2b-a354f295f962 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:11.381766 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-03a2f87a-3966-4f36-8d2b-a354f295f962 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:11.382228 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-03a2f87a-3966-4f36-8d2b-a354f295f962 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:11.383535 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-03a2f87a-3966-4f36-8d2b-a354f295f962 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:11.388434 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-03a2f87a-3966-4f36-8d2b-a354f295f962 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:11.388907 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-03a2f87a-3966-4f36-8d2b-a354f295f962 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:12.078000 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-03a2f87a-3966-4f36-8d2b-a354f295f962 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:45:12.088660 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-03a2f87a-3966-4f36-8d2b-a354f295f962 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1680 microversion: 2.1 time: 0.736286 Oct 30 01:45:12.089678 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2893/5794] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:45:11 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1680 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:45:12.421911 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-6f08a2ff-2d00-4917-9cf1-a4ae1337c9ab req-5c5a719a-0cbf-4973-879a-41e0dda17db9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0671096f-ed83-4341-8f95-d138a9eebffc", "tag": "9693fed6-7a6c-4db5-9887-3da909c0a76e"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:45:12.432660 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-6f08a2ff-2d00-4917-9cf1-a4ae1337c9ab req-5c5a719a-0cbf-4973-879a-41e0dda17db9 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:12.433416 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-6f08a2ff-2d00-4917-9cf1-a4ae1337c9ab req-5c5a719a-0cbf-4973-879a-41e0dda17db9 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:12.433859 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-6f08a2ff-2d00-4917-9cf1-a4ae1337c9ab req-5c5a719a-0cbf-4973-879a-41e0dda17db9 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:12.445860 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-6f08a2ff-2d00-4917-9cf1-a4ae1337c9ab req-5c5a719a-0cbf-4973-879a-41e0dda17db9 service nova] Creating event network-changed:9693fed6-7a6c-4db5-9887-3da909c0a76e for instance 0671096f-ed83-4341-8f95-d138a9eebffc on n-h1-master-1 Oct 30 01:45:12.450893 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-6f08a2ff-2d00-4917-9cf1-a4ae1337c9ab req-5c5a719a-0cbf-4973-879a-41e0dda17db9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034239 Oct 30 01:45:12.451614 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2902/5795] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:45:13.114090 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-27a08a95-3093-4186-a266-a32f71223fcd tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:45:13.114716 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-27a08a95-3093-4186-a266-a32f71223fcd tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:13.121951 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27a08a95-3093-4186-a266-a32f71223fcd tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:13.122441 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27a08a95-3093-4186-a266-a32f71223fcd tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:13.122873 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27a08a95-3093-4186-a266-a32f71223fcd tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:13.131690 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27a08a95-3093-4186-a266-a32f71223fcd tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:13.132185 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27a08a95-3093-4186-a266-a32f71223fcd tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:13.132688 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27a08a95-3093-4186-a266-a32f71223fcd tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:13.716469 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-27a08a95-3093-4186-a266-a32f71223fcd tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:45:13.724515 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-27a08a95-3093-4186-a266-a32f71223fcd tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1680 microversion: 2.1 time: 0.614332 Oct 30 01:45:13.725098 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2894/5796] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:45:13 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1680 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:45:14.773873 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-63c1659b-d6f7-47a6-88cc-55566e525af2 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:45:14.776345 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-63c1659b-d6f7-47a6-88cc-55566e525af2 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:14.785068 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-63c1659b-d6f7-47a6-88cc-55566e525af2 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:14.786267 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-63c1659b-d6f7-47a6-88cc-55566e525af2 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:14.786900 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-63c1659b-d6f7-47a6-88cc-55566e525af2 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:14.789433 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-63c1659b-d6f7-47a6-88cc-55566e525af2 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:14.790270 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-63c1659b-d6f7-47a6-88cc-55566e525af2 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:14.790998 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-63c1659b-d6f7-47a6-88cc-55566e525af2 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:15.041659 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-63c1659b-d6f7-47a6-88cc-55566e525af2 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:45:15.051675 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-63c1659b-d6f7-47a6-88cc-55566e525af2 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1680 microversion: 2.1 time: 0.292669 Oct 30 01:45:15.057415 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2903/5797] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:45:14 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1680 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:45:16.078397 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-dab3eefd-cca6-4a3b-bdb7-7cd969444aae tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:45:16.080441 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-dab3eefd-cca6-4a3b-bdb7-7cd969444aae tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:16.095090 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dab3eefd-cca6-4a3b-bdb7-7cd969444aae tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:16.098047 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dab3eefd-cca6-4a3b-bdb7-7cd969444aae tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:16.098942 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dab3eefd-cca6-4a3b-bdb7-7cd969444aae tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:16.100312 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dab3eefd-cca6-4a3b-bdb7-7cd969444aae tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:16.101804 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dab3eefd-cca6-4a3b-bdb7-7cd969444aae tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:16.102926 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dab3eefd-cca6-4a3b-bdb7-7cd969444aae tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:16.401636 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-dab3eefd-cca6-4a3b-bdb7-7cd969444aae tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:45:16.415317 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-dab3eefd-cca6-4a3b-bdb7-7cd969444aae tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1680 microversion: 2.1 time: 0.338621 Oct 30 01:45:16.422950 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2895/5798] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:45:16 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1680 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:45:17.442812 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b0363b52-5886-4b19-854b-6b6d53165cf8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:45:17.443518 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b0363b52-5886-4b19-854b-6b6d53165cf8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:17.454654 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b0363b52-5886-4b19-854b-6b6d53165cf8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:17.455549 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b0363b52-5886-4b19-854b-6b6d53165cf8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:17.470938 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b0363b52-5886-4b19-854b-6b6d53165cf8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:17.471937 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b0363b52-5886-4b19-854b-6b6d53165cf8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:17.472759 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b0363b52-5886-4b19-854b-6b6d53165cf8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:17.475124 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b0363b52-5886-4b19-854b-6b6d53165cf8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:17.691158 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b0363b52-5886-4b19-854b-6b6d53165cf8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:45:17.715167 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b0363b52-5886-4b19-854b-6b6d53165cf8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1657 microversion: 2.1 time: 0.275916 Oct 30 01:45:17.716714 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2904/5799] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:45:17 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1657 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:45:17.750052 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2dbc9366-fbc3-4908-a961-2dfabd283306 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:45:17.757137 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2dbc9366-fbc3-4908-a961-2dfabd283306 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:17.757751 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2dbc9366-fbc3-4908-a961-2dfabd283306 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:17.758198 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2dbc9366-fbc3-4908-a961-2dfabd283306 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:17.781627 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2dbc9366-fbc3-4908-a961-2dfabd283306 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Going to try to start instance {{(pid=121102) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 30 01:45:18.124820 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2dbc9366-fbc3-4908-a961-2dfabd283306 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "POST /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9/action" status: 202 len: 0 microversion: 2.1 time: 0.369728 Oct 30 01:45:18.124820 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2896/5800] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:45:17 2022] POST /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9/action => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:45:18.134867 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5119e717-a196-4adc-ab0a-57ef05c6c6b6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:45:18.135497 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5119e717-a196-4adc-ab0a-57ef05c6c6b6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:18.146037 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5119e717-a196-4adc-ab0a-57ef05c6c6b6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:18.146600 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5119e717-a196-4adc-ab0a-57ef05c6c6b6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:18.147096 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5119e717-a196-4adc-ab0a-57ef05c6c6b6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:18.148356 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5119e717-a196-4adc-ab0a-57ef05c6c6b6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:18.148865 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5119e717-a196-4adc-ab0a-57ef05c6c6b6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:18.149359 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5119e717-a196-4adc-ab0a-57ef05c6c6b6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:18.290541 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5119e717-a196-4adc-ab0a-57ef05c6c6b6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:45:18.301136 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5119e717-a196-4adc-ab0a-57ef05c6c6b6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1666 microversion: 2.1 time: 0.174268 Oct 30 01:45:18.301937 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2905/5801] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:45:18 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1666 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:45:19.331304 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9610505e-72f3-4344-b491-1d5d88251add tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:45:19.332845 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9610505e-72f3-4344-b491-1d5d88251add tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:19.351760 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9610505e-72f3-4344-b491-1d5d88251add tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:19.351760 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9610505e-72f3-4344-b491-1d5d88251add tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:19.351760 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9610505e-72f3-4344-b491-1d5d88251add tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:19.352403 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9610505e-72f3-4344-b491-1d5d88251add tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:19.369731 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9610505e-72f3-4344-b491-1d5d88251add tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:19.371112 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9610505e-72f3-4344-b491-1d5d88251add tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:19.761616 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9610505e-72f3-4344-b491-1d5d88251add tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:45:19.770578 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9610505e-72f3-4344-b491-1d5d88251add tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1666 microversion: 2.1 time: 0.445398 Oct 30 01:45:19.771170 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2897/5802] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:45:19 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1666 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:45:20.799142 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-51d35303-ec35-41b8-a777-d74a147c3127 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:45:20.800237 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-51d35303-ec35-41b8-a777-d74a147c3127 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:20.809138 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-51d35303-ec35-41b8-a777-d74a147c3127 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:20.809831 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-51d35303-ec35-41b8-a777-d74a147c3127 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:20.810409 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-51d35303-ec35-41b8-a777-d74a147c3127 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:20.811192 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-51d35303-ec35-41b8-a777-d74a147c3127 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:20.811723 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-51d35303-ec35-41b8-a777-d74a147c3127 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:20.812220 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-51d35303-ec35-41b8-a777-d74a147c3127 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:20.829959 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:21.060604 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-51d35303-ec35-41b8-a777-d74a147c3127 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:45:21.068580 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-51d35303-ec35-41b8-a777-d74a147c3127 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1670 microversion: 2.1 time: 0.277876 Oct 30 01:45:21.069247 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2906/5803] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:45:20 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1670 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:45:21.096130 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c264d0cd-dc29-48a3-bdb0-18c213f4445b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:45:21.096819 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c264d0cd-dc29-48a3-bdb0-18c213f4445b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:21.104450 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c264d0cd-dc29-48a3-bdb0-18c213f4445b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:21.105061 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c264d0cd-dc29-48a3-bdb0-18c213f4445b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:21.105653 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c264d0cd-dc29-48a3-bdb0-18c213f4445b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:21.106712 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c264d0cd-dc29-48a3-bdb0-18c213f4445b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:21.107872 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c264d0cd-dc29-48a3-bdb0-18c213f4445b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:21.108371 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c264d0cd-dc29-48a3-bdb0-18c213f4445b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:21.341989 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c264d0cd-dc29-48a3-bdb0-18c213f4445b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:45:21.350246 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c264d0cd-dc29-48a3-bdb0-18c213f4445b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1670 microversion: 2.1 time: 0.258249 Oct 30 01:45:21.352014 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2898/5804] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:45:21 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1670 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:45:21.373545 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f71ddd9b-29a8-4a38-867e-dbd25c31d01a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:45:21.374301 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f71ddd9b-29a8-4a38-867e-dbd25c31d01a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:21.382978 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f71ddd9b-29a8-4a38-867e-dbd25c31d01a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:21.386298 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f71ddd9b-29a8-4a38-867e-dbd25c31d01a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:21.386941 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f71ddd9b-29a8-4a38-867e-dbd25c31d01a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:21.394417 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f71ddd9b-29a8-4a38-867e-dbd25c31d01a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:21.394974 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f71ddd9b-29a8-4a38-867e-dbd25c31d01a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:21.395435 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f71ddd9b-29a8-4a38-867e-dbd25c31d01a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:21.622138 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f71ddd9b-29a8-4a38-867e-dbd25c31d01a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Unlocking {{(pid=121103) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 30 01:45:21.886369 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f71ddd9b-29a8-4a38-867e-dbd25c31d01a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "POST /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9/action" status: 202 len: 0 microversion: 2.1 time: 0.516703 Oct 30 01:45:21.889876 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2907/5805] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:45:21 2022] POST /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9/action => generated 0 bytes in 518 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 30 01:45:21.901435 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9bb65ac0-1dc5-4965-8a23-6d8bc2857228 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:45:21.902436 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9bb65ac0-1dc5-4965-8a23-6d8bc2857228 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:21.909813 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9bb65ac0-1dc5-4965-8a23-6d8bc2857228 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:21.912183 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9bb65ac0-1dc5-4965-8a23-6d8bc2857228 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:21.912183 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9bb65ac0-1dc5-4965-8a23-6d8bc2857228 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:21.912183 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9bb65ac0-1dc5-4965-8a23-6d8bc2857228 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:21.912183 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9bb65ac0-1dc5-4965-8a23-6d8bc2857228 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:21.912617 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9bb65ac0-1dc5-4965-8a23-6d8bc2857228 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:22.167891 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9bb65ac0-1dc5-4965-8a23-6d8bc2857228 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:45:22.183444 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9bb65ac0-1dc5-4965-8a23-6d8bc2857228 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1670 microversion: 2.1 time: 0.286736 Oct 30 01:45:22.184462 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2899/5806] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:45:21 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1670 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:45:22.217826 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e6927733-73a2-444d-b706-da9a847a3468 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:45:22.219978 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e6927733-73a2-444d-b706-da9a847a3468 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:22.230956 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e6927733-73a2-444d-b706-da9a847a3468 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:22.231715 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e6927733-73a2-444d-b706-da9a847a3468 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:22.232151 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e6927733-73a2-444d-b706-da9a847a3468 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:22.232868 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e6927733-73a2-444d-b706-da9a847a3468 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:22.233326 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e6927733-73a2-444d-b706-da9a847a3468 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:22.233775 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e6927733-73a2-444d-b706-da9a847a3468 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:22.936364 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e6927733-73a2-444d-b706-da9a847a3468 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:45:22.954804 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e6927733-73a2-444d-b706-da9a847a3468 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1670 microversion: 2.1 time: 0.744370 Oct 30 01:45:22.957429 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2908/5807] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:45:22 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1670 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:45:22.980981 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d2cd0b8c-c224-4226-8d69-2ff64b701708 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:45:22.987431 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d2cd0b8c-c224-4226-8d69-2ff64b701708 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:22.988908 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2cd0b8c-c224-4226-8d69-2ff64b701708 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:22.989607 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2cd0b8c-c224-4226-8d69-2ff64b701708 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:22.990208 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2cd0b8c-c224-4226-8d69-2ff64b701708 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:22.991072 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2cd0b8c-c224-4226-8d69-2ff64b701708 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:22.992090 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2cd0b8c-c224-4226-8d69-2ff64b701708 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:22.992510 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2cd0b8c-c224-4226-8d69-2ff64b701708 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:23.315796 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d2cd0b8c-c224-4226-8d69-2ff64b701708 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:45:23.318114 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d2cd0b8c-c224-4226-8d69-2ff64b701708 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1670 microversion: 2.1 time: 0.341151 Oct 30 01:45:23.320415 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2900/5808] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:45:22 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1670 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:45:23.346783 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8d09a3cc-8a28-44f4-9269-45aec8bd4334 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:45:23.347341 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8d09a3cc-8a28-44f4-9269-45aec8bd4334 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:23.361101 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8d09a3cc-8a28-44f4-9269-45aec8bd4334 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:23.366599 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8d09a3cc-8a28-44f4-9269-45aec8bd4334 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:23.367144 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8d09a3cc-8a28-44f4-9269-45aec8bd4334 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:23.367883 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8d09a3cc-8a28-44f4-9269-45aec8bd4334 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:23.368420 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8d09a3cc-8a28-44f4-9269-45aec8bd4334 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:23.368782 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8d09a3cc-8a28-44f4-9269-45aec8bd4334 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:23.682949 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8d09a3cc-8a28-44f4-9269-45aec8bd4334 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "POST /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9/action" status: 202 len: 0 microversion: 2.1 time: 0.341739 Oct 30 01:45:23.687427 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2909/5809] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:45:23 2022] POST /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9/action => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:45:23.708560 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cdd1e448-157d-445b-ace8-c6f512202674 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:45:23.713953 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cdd1e448-157d-445b-ace8-c6f512202674 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:23.726359 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cdd1e448-157d-445b-ace8-c6f512202674 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:23.727033 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cdd1e448-157d-445b-ace8-c6f512202674 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:23.727834 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cdd1e448-157d-445b-ace8-c6f512202674 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:23.728841 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cdd1e448-157d-445b-ace8-c6f512202674 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:23.729672 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cdd1e448-157d-445b-ace8-c6f512202674 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:23.730565 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cdd1e448-157d-445b-ace8-c6f512202674 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:23.966749 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-cdd1e448-157d-445b-ace8-c6f512202674 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:45:23.970771 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:23.976070 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cdd1e448-157d-445b-ace8-c6f512202674 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1675 microversion: 2.1 time: 0.285511 Oct 30 01:45:23.977224 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2901/5810] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:45:23 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1675 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:45:25.003814 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b115d069-904c-4ae5-b131-e858c4c5b664 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:45:25.004976 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b115d069-904c-4ae5-b131-e858c4c5b664 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:25.011640 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b115d069-904c-4ae5-b131-e858c4c5b664 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:25.012142 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b115d069-904c-4ae5-b131-e858c4c5b664 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:25.013081 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b115d069-904c-4ae5-b131-e858c4c5b664 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:25.014370 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b115d069-904c-4ae5-b131-e858c4c5b664 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:25.015110 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b115d069-904c-4ae5-b131-e858c4c5b664 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:25.015867 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b115d069-904c-4ae5-b131-e858c4c5b664 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:25.211662 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b115d069-904c-4ae5-b131-e858c4c5b664 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:45:25.222378 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b115d069-904c-4ae5-b131-e858c4c5b664 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1655 microversion: 2.1 time: 0.224742 Oct 30 01:45:25.223280 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2910/5811] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:45:24 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1655 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:45:25.247147 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ceb0b25a-59d2-402f-9590-6762e0b59a61 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:45:25.247886 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ceb0b25a-59d2-402f-9590-6762e0b59a61 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:25.255448 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ceb0b25a-59d2-402f-9590-6762e0b59a61 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:25.255936 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ceb0b25a-59d2-402f-9590-6762e0b59a61 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:25.256382 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ceb0b25a-59d2-402f-9590-6762e0b59a61 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:25.257667 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ceb0b25a-59d2-402f-9590-6762e0b59a61 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:25.258133 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ceb0b25a-59d2-402f-9590-6762e0b59a61 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:25.258566 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ceb0b25a-59d2-402f-9590-6762e0b59a61 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:25.511334 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ceb0b25a-59d2-402f-9590-6762e0b59a61 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "POST /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9/action" status: 202 len: 0 microversion: 2.1 time: 0.264659 Oct 30 01:45:25.511334 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2902/5812] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:45:25 2022] POST /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:45:25.518142 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cea2378f-b666-4604-afd1-b82434487cd5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:45:25.518767 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-cea2378f-b666-4604-afd1-b82434487cd5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:25.562055 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cea2378f-b666-4604-afd1-b82434487cd5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:25.562055 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cea2378f-b666-4604-afd1-b82434487cd5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:25.567318 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cea2378f-b666-4604-afd1-b82434487cd5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:25.567318 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cea2378f-b666-4604-afd1-b82434487cd5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:25.567702 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cea2378f-b666-4604-afd1-b82434487cd5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:25.567895 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cea2378f-b666-4604-afd1-b82434487cd5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:25.927295 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-cea2378f-b666-4604-afd1-b82434487cd5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:45:25.937138 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cea2378f-b666-4604-afd1-b82434487cd5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1662 microversion: 2.1 time: 0.422852 Oct 30 01:45:25.938022 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2911/5813] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:45:25 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1662 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:45:26.968535 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-42e33dc0-73c8-4221-ba32-7f0286a6e021 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:45:26.970828 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-42e33dc0-73c8-4221-ba32-7f0286a6e021 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:26.989122 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-42e33dc0-73c8-4221-ba32-7f0286a6e021 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:26.989666 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-42e33dc0-73c8-4221-ba32-7f0286a6e021 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:26.990827 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-42e33dc0-73c8-4221-ba32-7f0286a6e021 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:26.990966 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-42e33dc0-73c8-4221-ba32-7f0286a6e021 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:26.991409 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-42e33dc0-73c8-4221-ba32-7f0286a6e021 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:26.991896 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-42e33dc0-73c8-4221-ba32-7f0286a6e021 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:27.311841 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-42e33dc0-73c8-4221-ba32-7f0286a6e021 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:45:27.321371 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-42e33dc0-73c8-4221-ba32-7f0286a6e021 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1670 microversion: 2.1 time: 0.358624 Oct 30 01:45:27.329304 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2903/5814] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:45:26 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1670 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:45:27.344372 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b5f49804-713d-403b-ad27-6134ab48a4e4 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:45:27.345906 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b5f49804-713d-403b-ad27-6134ab48a4e4 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:27.354222 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b5f49804-713d-403b-ad27-6134ab48a4e4 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:27.355171 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b5f49804-713d-403b-ad27-6134ab48a4e4 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:27.355925 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b5f49804-713d-403b-ad27-6134ab48a4e4 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:27.357191 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b5f49804-713d-403b-ad27-6134ab48a4e4 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:27.357888 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b5f49804-713d-403b-ad27-6134ab48a4e4 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:27.358607 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b5f49804-713d-403b-ad27-6134ab48a4e4 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:27.732166 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b5f49804-713d-403b-ad27-6134ab48a4e4 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:45:27.755167 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b5f49804-713d-403b-ad27-6134ab48a4e4 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1670 microversion: 2.1 time: 0.401915 Oct 30 01:45:27.755810 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2912/5815] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:45:27 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1670 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:45:27.768688 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-11af5052-2b2e-4d94-b549-093caed92487 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:45:27.776596 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-11af5052-2b2e-4d94-b549-093caed92487 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:27.776596 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-11af5052-2b2e-4d94-b549-093caed92487 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:27.777100 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-11af5052-2b2e-4d94-b549-093caed92487 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:27.777806 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-11af5052-2b2e-4d94-b549-093caed92487 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:27.778740 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-11af5052-2b2e-4d94-b549-093caed92487 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:27.779425 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-11af5052-2b2e-4d94-b549-093caed92487 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:27.780064 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-11af5052-2b2e-4d94-b549-093caed92487 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:28.070667 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-11af5052-2b2e-4d94-b549-093caed92487 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:45:28.082643 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-11af5052-2b2e-4d94-b549-093caed92487 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1670 microversion: 2.1 time: 0.318116 Oct 30 01:45:28.083262 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2904/5816] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:45:27 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1670 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:45:28.107266 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-85390e7b-3c30-44a3-b153-22ec8dd78cff tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:45:28.107888 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-85390e7b-3c30-44a3-b153-22ec8dd78cff tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:28.120090 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-85390e7b-3c30-44a3-b153-22ec8dd78cff tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:28.120090 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-85390e7b-3c30-44a3-b153-22ec8dd78cff tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:28.120090 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-85390e7b-3c30-44a3-b153-22ec8dd78cff tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:28.120090 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-85390e7b-3c30-44a3-b153-22ec8dd78cff tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:28.120090 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-85390e7b-3c30-44a3-b153-22ec8dd78cff tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:28.120090 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-85390e7b-3c30-44a3-b153-22ec8dd78cff tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:28.300452 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-85390e7b-3c30-44a3-b153-22ec8dd78cff tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:45:28.318034 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-85390e7b-3c30-44a3-b153-22ec8dd78cff tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1670 microversion: 2.1 time: 0.210270 Oct 30 01:45:28.321808 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2913/5817] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:45:28 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1670 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:45:28.364060 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-28b52fd2-191b-4347-8169-f79c1bdc6b74 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:45:28.364605 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-28b52fd2-191b-4347-8169-f79c1bdc6b74 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:28.380080 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-28b52fd2-191b-4347-8169-f79c1bdc6b74 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:28.380637 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-28b52fd2-191b-4347-8169-f79c1bdc6b74 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:28.381284 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-28b52fd2-191b-4347-8169-f79c1bdc6b74 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:28.382741 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-28b52fd2-191b-4347-8169-f79c1bdc6b74 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:28.383391 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-28b52fd2-191b-4347-8169-f79c1bdc6b74 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:28.383988 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-28b52fd2-191b-4347-8169-f79c1bdc6b74 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:28.695603 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-28b52fd2-191b-4347-8169-f79c1bdc6b74 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:45:28.708906 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-28b52fd2-191b-4347-8169-f79c1bdc6b74 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1670 microversion: 2.1 time: 0.348742 Oct 30 01:45:28.710307 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2905/5818] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:45:28 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1670 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:45:28.734739 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-85967dcc-e1f3-4128-a299-dc60192e31d3 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:45:28.735363 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-85967dcc-e1f3-4128-a299-dc60192e31d3 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:28.743001 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-85967dcc-e1f3-4128-a299-dc60192e31d3 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:28.747313 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-85967dcc-e1f3-4128-a299-dc60192e31d3 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:28.747757 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-85967dcc-e1f3-4128-a299-dc60192e31d3 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:28.748629 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-85967dcc-e1f3-4128-a299-dc60192e31d3 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:28.749089 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-85967dcc-e1f3-4128-a299-dc60192e31d3 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:28.749545 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-85967dcc-e1f3-4128-a299-dc60192e31d3 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:28.820577 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-70431db5-3df0-4ef3-a627-23ee4d85cb59 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Action: 'create', calling method: .version_select at 0x7f44c7c1bdc0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-425939995", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKqJZnexDqiNg+DlCKR5YcCU1VsBVt9HJTDJ08tsQ2ZiE4L9tVCl8OmAgk8vv5tp8KPaPdSckMrKly5aOsYhPkdWQL8wMSCMFTxdUqIOJmM3EI1FeYGBIg90tjfxUsLPzQ=="}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:45:28.836561 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-70431db5-3df0-4ef3-a627-23ee4d85cb59 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Getting quotas for project 73f4af2d7cc742b98447e28e3c204c11. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:45:28.846099 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-70431db5-3df0-4ef3-a627-23ee4d85cb59 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Getting quotas for user 9c53d510d75542a283b7f851a58d3dbf and project 73f4af2d7cc742b98447e28e3c204c11. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:45:28.970398 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-85967dcc-e1f3-4128-a299-dc60192e31d3 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:45:28.984094 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-85967dcc-e1f3-4128-a299-dc60192e31d3 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1670 microversion: 2.1 time: 0.254629 Oct 30 01:45:28.984718 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2906/5819] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:45:28 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1670 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:45:29.017002 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-70431db5-3df0-4ef3-a627-23ee4d85cb59 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.439773 Oct 30 01:45:29.020628 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2914/5820] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 30 01:45:28 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:45:39.971883 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-580369a3-c880-4b45-b7a2-777fe085eb9d tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-665416734-access_point-678725129", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "ea4cfb31-31a4-44ae-926a-0d5a8e399373"}], "key_name": "tempest-TestSecurityGroupsBasicOps-425939995", "security_groups": [{"name": "tempest-secgroup_access--168842658"}, {"name": "tempest-secgroup_general--128931657"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:45:39.983031 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=31 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:39.984079 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:40.281167 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-580369a3-c880-4b45-b7a2-777fe085eb9d tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] validate_networks() for [('ea4cfb31-31a4-44ae-926a-0d5a8e399373', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:45:40.969818 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-580369a3-c880-4b45-b7a2-777fe085eb9d tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:45:40.970462 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-580369a3-c880-4b45-b7a2-777fe085eb9d tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:45:40.971400 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-580369a3-c880-4b45-b7a2-777fe085eb9d tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:45:40.972125 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-580369a3-c880-4b45-b7a2-777fe085eb9d tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:45:40.973187 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-580369a3-c880-4b45-b7a2-777fe085eb9d tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:45:40.985676 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-580369a3-c880-4b45-b7a2-777fe085eb9d tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:40.985942 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-580369a3-c880-4b45-b7a2-777fe085eb9d tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:40.986370 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-580369a3-c880-4b45-b7a2-777fe085eb9d tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:40.987098 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-580369a3-c880-4b45-b7a2-777fe085eb9d tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:40.987574 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-580369a3-c880-4b45-b7a2-777fe085eb9d tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:40.987997 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-580369a3-c880-4b45-b7a2-777fe085eb9d tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:41.009150 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-580369a3-c880-4b45-b7a2-777fe085eb9d tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Getting quotas for project 73f4af2d7cc742b98447e28e3c204c11. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:45:41.015274 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-580369a3-c880-4b45-b7a2-777fe085eb9d tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Getting quotas for user 9c53d510d75542a283b7f851a58d3dbf and project 73f4af2d7cc742b98447e28e3c204c11. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:45:41.030866 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-580369a3-c880-4b45-b7a2-777fe085eb9d tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:45:41.033116 n-d-master-1 devstack@n-api.service[121102]: WARNING nova.utils [None req-580369a3-c880-4b45-b7a2-777fe085eb9d tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-665416734-access_point-678725129 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-665416734-acc Oct 30 01:45:41.033890 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-580369a3-c880-4b45-b7a2-777fe085eb9d tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] [instance: 324131f5-3ba0-4222-bb43-a20812dba495] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:45:41.179932 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-580369a3-c880-4b45-b7a2-777fe085eb9d tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 456 microversion: 2.1 time: 1.212774 Oct 30 01:45:41.191208 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=58,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:41.194672 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=4 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:41.195671 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:41.201614 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2907/5821] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:45:39 2022] POST /compute/v2.1/servers => generated 456 bytes in 1236 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:45:41.205951 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-617daeae-3233-47f8-a047-1c1b2d2e7b88 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:45:41.205951 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-617daeae-3233-47f8-a047-1c1b2d2e7b88 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] [instance: 324131f5-3ba0-4222-bb43-a20812dba495] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:41.463865 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-617daeae-3233-47f8-a047-1c1b2d2e7b88 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53d510d75542a283b7f851a58d3dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f4af2d7cc742b98447e28e3c204c11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:45:41.470034 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-617daeae-3233-47f8-a047-1c1b2d2e7b88 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] 10.222.0.13 "GET /compute/v2.1/servers/324131f5-3ba0-4222-bb43-a20812dba495" status: 200 len: 1292 microversion: 2.1 time: 0.280882 Oct 30 01:45:41.471910 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2915/5822] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:45:41 2022] GET /compute/v2.1/servers/324131f5-3ba0-4222-bb43-a20812dba495 => generated 1292 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:45:42.496455 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f501b2f5-fca4-4195-88af-9a0c21dc18c7 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:45:42.498065 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f501b2f5-fca4-4195-88af-9a0c21dc18c7 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] [instance: 324131f5-3ba0-4222-bb43-a20812dba495] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:42.598959 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f501b2f5-fca4-4195-88af-9a0c21dc18c7 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53d510d75542a283b7f851a58d3dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f4af2d7cc742b98447e28e3c204c11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:45:42.607294 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f501b2f5-fca4-4195-88af-9a0c21dc18c7 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] 10.222.0.13 "GET /compute/v2.1/servers/324131f5-3ba0-4222-bb43-a20812dba495" status: 200 len: 1292 microversion: 2.1 time: 0.116638 Oct 30 01:45:42.607965 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2908/5823] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:45:42 2022] GET /compute/v2.1/servers/324131f5-3ba0-4222-bb43-a20812dba495 => generated 1292 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:45:43.633601 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ceedc48e-8407-43e7-aaed-6a5bb17c8b5f tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:45:43.634346 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ceedc48e-8407-43e7-aaed-6a5bb17c8b5f tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] [instance: 324131f5-3ba0-4222-bb43-a20812dba495] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:43.649704 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ceedc48e-8407-43e7-aaed-6a5bb17c8b5f tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:43.654139 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ceedc48e-8407-43e7-aaed-6a5bb17c8b5f tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:43.654139 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ceedc48e-8407-43e7-aaed-6a5bb17c8b5f tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:43.654139 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ceedc48e-8407-43e7-aaed-6a5bb17c8b5f tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:43.654139 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ceedc48e-8407-43e7-aaed-6a5bb17c8b5f tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:43.654139 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ceedc48e-8407-43e7-aaed-6a5bb17c8b5f tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:43.744598 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ceedc48e-8407-43e7-aaed-6a5bb17c8b5f tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53d510d75542a283b7f851a58d3dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f4af2d7cc742b98447e28e3c204c11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:45:43.752507 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ceedc48e-8407-43e7-aaed-6a5bb17c8b5f tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] 10.222.0.13 "GET /compute/v2.1/servers/324131f5-3ba0-4222-bb43-a20812dba495" status: 200 len: 1344 microversion: 2.1 time: 0.123977 Oct 30 01:45:43.753093 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2916/5824] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:45:43 2022] GET /compute/v2.1/servers/324131f5-3ba0-4222-bb43-a20812dba495 => generated 1344 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:45:44.777107 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e9e7180d-6341-42ba-b8cd-0771375a3d6d tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:45:44.778428 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e9e7180d-6341-42ba-b8cd-0771375a3d6d tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] [instance: 324131f5-3ba0-4222-bb43-a20812dba495] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:44.788310 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9e7180d-6341-42ba-b8cd-0771375a3d6d tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:44.789189 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9e7180d-6341-42ba-b8cd-0771375a3d6d tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:44.789505 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9e7180d-6341-42ba-b8cd-0771375a3d6d tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:44.790252 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9e7180d-6341-42ba-b8cd-0771375a3d6d tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:44.790709 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9e7180d-6341-42ba-b8cd-0771375a3d6d tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:44.791138 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9e7180d-6341-42ba-b8cd-0771375a3d6d tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:44.879429 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e9e7180d-6341-42ba-b8cd-0771375a3d6d tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53d510d75542a283b7f851a58d3dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f4af2d7cc742b98447e28e3c204c11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:45:44.890038 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e9e7180d-6341-42ba-b8cd-0771375a3d6d tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] 10.222.0.13 "GET /compute/v2.1/servers/324131f5-3ba0-4222-bb43-a20812dba495" status: 200 len: 1350 microversion: 2.1 time: 0.115780 Oct 30 01:45:44.890038 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2909/5825] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:45:44 2022] GET /compute/v2.1/servers/324131f5-3ba0-4222-bb43-a20812dba495 => generated 1350 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:45:45.912632 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4d20baa8-e78c-40ca-87d0-80d34b066ed8 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:45:45.913972 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4d20baa8-e78c-40ca-87d0-80d34b066ed8 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] [instance: 324131f5-3ba0-4222-bb43-a20812dba495] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:45.922429 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4d20baa8-e78c-40ca-87d0-80d34b066ed8 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:45.923186 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4d20baa8-e78c-40ca-87d0-80d34b066ed8 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:45.923812 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4d20baa8-e78c-40ca-87d0-80d34b066ed8 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:45.924873 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4d20baa8-e78c-40ca-87d0-80d34b066ed8 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:45.925526 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4d20baa8-e78c-40ca-87d0-80d34b066ed8 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:45.926140 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4d20baa8-e78c-40ca-87d0-80d34b066ed8 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:46.318032 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ae12bee8-55c6-44aa-bd96-a47bb718784e tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:45:46.319506 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ae12bee8-55c6-44aa-bd96-a47bb718784e tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 0671096f-ed83-4341-8f95-d138a9eebffc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:46.327975 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae12bee8-55c6-44aa-bd96-a47bb718784e tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:46.329186 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae12bee8-55c6-44aa-bd96-a47bb718784e tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:46.329897 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae12bee8-55c6-44aa-bd96-a47bb718784e tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:46.330843 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae12bee8-55c6-44aa-bd96-a47bb718784e tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:46.331585 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae12bee8-55c6-44aa-bd96-a47bb718784e tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:46.332306 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae12bee8-55c6-44aa-bd96-a47bb718784e tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:46.367600 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ae12bee8-55c6-44aa-bd96-a47bb718784e tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc/ips" status: 200 len: 149 microversion: 2.1 time: 0.054614 Oct 30 01:45:46.368449 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2910/5826] 10.222.0.13 () {58 vars in 1248 bytes} [Sun Oct 30 01:45:46 2022] GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc/ips => generated 149 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:45:46.372552 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4d20baa8-e78c-40ca-87d0-80d34b066ed8 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53d510d75542a283b7f851a58d3dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f4af2d7cc742b98447e28e3c204c11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:45:46.395732 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4d20baa8-e78c-40ca-87d0-80d34b066ed8 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] 10.222.0.13 "GET /compute/v2.1/servers/324131f5-3ba0-4222-bb43-a20812dba495" status: 200 len: 1468 microversion: 2.1 time: 0.485009 Oct 30 01:45:46.398475 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2917/5827] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:45:45 2022] GET /compute/v2.1/servers/324131f5-3ba0-4222-bb43-a20812dba495 => generated 1468 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:45:46.786490 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-ccb1f86b-a24f-4c35-8666-407cbbcacfe1 req-e9e6c118-fa6f-4399-a914-f40df4aa62bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "324131f5-3ba0-4222-bb43-a20812dba495", "tag": "513258c1-74aa-493d-9ce2-a04232fdcb10"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:45:46.799108 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ccb1f86b-a24f-4c35-8666-407cbbcacfe1 req-e9e6c118-fa6f-4399-a914-f40df4aa62bf service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:46.799766 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ccb1f86b-a24f-4c35-8666-407cbbcacfe1 req-e9e6c118-fa6f-4399-a914-f40df4aa62bf service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:46.800355 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ccb1f86b-a24f-4c35-8666-407cbbcacfe1 req-e9e6c118-fa6f-4399-a914-f40df4aa62bf service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:46.812748 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-ccb1f86b-a24f-4c35-8666-407cbbcacfe1 req-e9e6c118-fa6f-4399-a914-f40df4aa62bf service nova] Creating event network-changed:513258c1-74aa-493d-9ce2-a04232fdcb10 for instance 324131f5-3ba0-4222-bb43-a20812dba495 on n-h2-master-1 Oct 30 01:45:46.819296 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-ccb1f86b-a24f-4c35-8666-407cbbcacfe1 req-e9e6c118-fa6f-4399-a914-f40df4aa62bf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.286477 Oct 30 01:45:46.820983 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2911/5828] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:45:47.419802 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4f3c01ad-67a4-4678-af59-5b7f6ae56da3 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:45:47.420429 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4f3c01ad-67a4-4678-af59-5b7f6ae56da3 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] [instance: 324131f5-3ba0-4222-bb43-a20812dba495] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:47.428551 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4f3c01ad-67a4-4678-af59-5b7f6ae56da3 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:47.429047 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4f3c01ad-67a4-4678-af59-5b7f6ae56da3 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:47.442071 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4f3c01ad-67a4-4678-af59-5b7f6ae56da3 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:47.443110 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4f3c01ad-67a4-4678-af59-5b7f6ae56da3 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:47.443630 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4f3c01ad-67a4-4678-af59-5b7f6ae56da3 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:47.444067 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4f3c01ad-67a4-4678-af59-5b7f6ae56da3 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:47.724317 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4f3c01ad-67a4-4678-af59-5b7f6ae56da3 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53d510d75542a283b7f851a58d3dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f4af2d7cc742b98447e28e3c204c11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:45:47.732791 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4f3c01ad-67a4-4678-af59-5b7f6ae56da3 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] 10.222.0.13 "GET /compute/v2.1/servers/324131f5-3ba0-4222-bb43-a20812dba495" status: 200 len: 1468 microversion: 2.1 time: 0.316878 Oct 30 01:45:47.733949 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2918/5829] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:45:47 2022] GET /compute/v2.1/servers/324131f5-3ba0-4222-bb43-a20812dba495 => generated 1468 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:45:48.758434 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-901c63c3-ff76-4902-b3c6-79acbf7f9b87 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:45:48.759267 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-901c63c3-ff76-4902-b3c6-79acbf7f9b87 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] [instance: 324131f5-3ba0-4222-bb43-a20812dba495] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:48.766292 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-901c63c3-ff76-4902-b3c6-79acbf7f9b87 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:48.766860 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-901c63c3-ff76-4902-b3c6-79acbf7f9b87 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:48.767738 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-901c63c3-ff76-4902-b3c6-79acbf7f9b87 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:48.778195 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-901c63c3-ff76-4902-b3c6-79acbf7f9b87 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:48.778901 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-901c63c3-ff76-4902-b3c6-79acbf7f9b87 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:48.779346 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-901c63c3-ff76-4902-b3c6-79acbf7f9b87 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:48.961291 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-901c63c3-ff76-4902-b3c6-79acbf7f9b87 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53d510d75542a283b7f851a58d3dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f4af2d7cc742b98447e28e3c204c11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:45:48.974284 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-901c63c3-ff76-4902-b3c6-79acbf7f9b87 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] 10.222.0.13 "GET /compute/v2.1/servers/324131f5-3ba0-4222-bb43-a20812dba495" status: 200 len: 1468 microversion: 2.1 time: 0.221455 Oct 30 01:45:48.977133 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2912/5830] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:45:48 2022] GET /compute/v2.1/servers/324131f5-3ba0-4222-bb43-a20812dba495 => generated 1468 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:45:49.604414 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-407282bd-f7d3-4ee0-9c90-9ba28be0043c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "59150179-56ff-45d3-8287-e352470fea7d"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:45:49.609786 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-407282bd-f7d3-4ee0-9c90-9ba28be0043c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 0671096f-ed83-4341-8f95-d138a9eebffc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:49.618879 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-407282bd-f7d3-4ee0-9c90-9ba28be0043c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:49.619947 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-407282bd-f7d3-4ee0-9c90-9ba28be0043c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:49.620617 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-407282bd-f7d3-4ee0-9c90-9ba28be0043c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:49.621664 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-407282bd-f7d3-4ee0-9c90-9ba28be0043c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:49.622861 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-407282bd-f7d3-4ee0-9c90-9ba28be0043c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:49.623594 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-407282bd-f7d3-4ee0-9c90-9ba28be0043c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:50.001476 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-46d0d97a-f85e-46ab-a1d8-b4281f3b553e tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:45:50.002294 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-46d0d97a-f85e-46ab-a1d8-b4281f3b553e tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] [instance: 324131f5-3ba0-4222-bb43-a20812dba495] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:50.014088 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-46d0d97a-f85e-46ab-a1d8-b4281f3b553e tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:50.018849 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-46d0d97a-f85e-46ab-a1d8-b4281f3b553e tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:50.018849 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-46d0d97a-f85e-46ab-a1d8-b4281f3b553e tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:50.018849 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-46d0d97a-f85e-46ab-a1d8-b4281f3b553e tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:50.018849 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-46d0d97a-f85e-46ab-a1d8-b4281f3b553e tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:50.018849 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-46d0d97a-f85e-46ab-a1d8-b4281f3b553e tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:50.312376 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-46d0d97a-f85e-46ab-a1d8-b4281f3b553e tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53d510d75542a283b7f851a58d3dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f4af2d7cc742b98447e28e3c204c11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:45:50.335901 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-46d0d97a-f85e-46ab-a1d8-b4281f3b553e tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] 10.222.0.13 "GET /compute/v2.1/servers/324131f5-3ba0-4222-bb43-a20812dba495" status: 200 len: 1468 microversion: 2.1 time: 0.337013 Oct 30 01:45:50.336834 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2913/5831] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:45:49 2022] GET /compute/v2.1/servers/324131f5-3ba0-4222-bb43-a20812dba495 => generated 1468 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:45:50.446752 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-407282bd-f7d3-4ee0-9c90-9ba28be0043c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "POST /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.847478 Oct 30 01:45:50.447533 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2919/5832] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 30 01:45:49 2022] POST /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc/os-volume_attachments => generated 194 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:45:51.359784 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6a1ed18d-9055-4892-a79b-8e57838b5a35 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:45:51.361036 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6a1ed18d-9055-4892-a79b-8e57838b5a35 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] [instance: 324131f5-3ba0-4222-bb43-a20812dba495] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:51.363174 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:51.375294 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a1ed18d-9055-4892-a79b-8e57838b5a35 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:51.375948 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a1ed18d-9055-4892-a79b-8e57838b5a35 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:51.376515 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a1ed18d-9055-4892-a79b-8e57838b5a35 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:51.377426 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a1ed18d-9055-4892-a79b-8e57838b5a35 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:51.377984 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a1ed18d-9055-4892-a79b-8e57838b5a35 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:51.378524 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a1ed18d-9055-4892-a79b-8e57838b5a35 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:51.613708 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6a1ed18d-9055-4892-a79b-8e57838b5a35 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53d510d75542a283b7f851a58d3dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f4af2d7cc742b98447e28e3c204c11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:45:51.641764 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6a1ed18d-9055-4892-a79b-8e57838b5a35 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] 10.222.0.13 "GET /compute/v2.1/servers/324131f5-3ba0-4222-bb43-a20812dba495" status: 200 len: 1468 microversion: 2.1 time: 0.285784 Oct 30 01:45:51.643322 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2914/5833] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:45:51 2022] GET /compute/v2.1/servers/324131f5-3ba0-4222-bb43-a20812dba495 => generated 1468 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:45:52.090279 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-b440dfc6-dd39-4189-a599-d4207ebd1c30 req-7ac6fc3d-9d1d-43d5-8d6a-69cfee601cd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "324131f5-3ba0-4222-bb43-a20812dba495", "name": "network-vif-plugged", "status": "completed", "tag": "513258c1-74aa-493d-9ce2-a04232fdcb10"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:45:52.121491 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-b440dfc6-dd39-4189-a599-d4207ebd1c30 req-7ac6fc3d-9d1d-43d5-8d6a-69cfee601cd6 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:52.121855 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-b440dfc6-dd39-4189-a599-d4207ebd1c30 req-7ac6fc3d-9d1d-43d5-8d6a-69cfee601cd6 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:52.122303 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-b440dfc6-dd39-4189-a599-d4207ebd1c30 req-7ac6fc3d-9d1d-43d5-8d6a-69cfee601cd6 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:52.150000 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-b440dfc6-dd39-4189-a599-d4207ebd1c30 req-7ac6fc3d-9d1d-43d5-8d6a-69cfee601cd6 service nova] Creating event network-vif-plugged:513258c1-74aa-493d-9ce2-a04232fdcb10 for instance 324131f5-3ba0-4222-bb43-a20812dba495 on n-h2-master-1 Oct 30 01:45:52.157949 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-b440dfc6-dd39-4189-a599-d4207ebd1c30 req-7ac6fc3d-9d1d-43d5-8d6a-69cfee601cd6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079449 Oct 30 01:45:52.161900 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2920/5834] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:45:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:45:52.672510 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6f1b2468-8121-4d87-89f8-4a9814e46a8d tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:45:52.674018 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6f1b2468-8121-4d87-89f8-4a9814e46a8d tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] [instance: 324131f5-3ba0-4222-bb43-a20812dba495] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:52.680895 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=8 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:52.692654 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6f1b2468-8121-4d87-89f8-4a9814e46a8d tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:52.693595 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6f1b2468-8121-4d87-89f8-4a9814e46a8d tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:52.696195 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6f1b2468-8121-4d87-89f8-4a9814e46a8d tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:52.697194 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6f1b2468-8121-4d87-89f8-4a9814e46a8d tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:52.698029 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6f1b2468-8121-4d87-89f8-4a9814e46a8d tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:52.700264 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6f1b2468-8121-4d87-89f8-4a9814e46a8d tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:52.982543 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3dc14534-f7cd-48d8-8471-7caf6add5f7d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:45:52.984930 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3dc14534-f7cd-48d8-8471-7caf6add5f7d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:53.017984 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3dc14534-f7cd-48d8-8471-7caf6add5f7d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:53.022384 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3dc14534-f7cd-48d8-8471-7caf6add5f7d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:53.022384 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3dc14534-f7cd-48d8-8471-7caf6add5f7d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:53.022384 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3dc14534-f7cd-48d8-8471-7caf6add5f7d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:53.022384 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3dc14534-f7cd-48d8-8471-7caf6add5f7d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:53.022384 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3dc14534-f7cd-48d8-8471-7caf6add5f7d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:53.289279 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6f1b2468-8121-4d87-89f8-4a9814e46a8d tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53d510d75542a283b7f851a58d3dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f4af2d7cc742b98447e28e3c204c11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:45:53.309794 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6f1b2468-8121-4d87-89f8-4a9814e46a8d tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] 10.222.0.13 "GET /compute/v2.1/servers/324131f5-3ba0-4222-bb43-a20812dba495" status: 200 len: 1468 microversion: 2.1 time: 0.635392 Oct 30 01:45:53.309794 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2915/5835] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:45:52 2022] GET /compute/v2.1/servers/324131f5-3ba0-4222-bb43-a20812dba495 => generated 1468 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:45:53.373305 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3dc14534-f7cd-48d8-8471-7caf6add5f7d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "POST /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9/action" status: 202 len: 0 microversion: 2.1 time: 0.395594 Oct 30 01:45:53.374488 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2921/5836] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:45:52 2022] POST /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9/action => generated 0 bytes in 398 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 30 01:45:53.383053 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-41fddefe-d18b-47a7-a4f3-e1c8ae4b91aa tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:45:53.383670 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-41fddefe-d18b-47a7-a4f3-e1c8ae4b91aa tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:53.390426 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-41fddefe-d18b-47a7-a4f3-e1c8ae4b91aa tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:53.390915 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-41fddefe-d18b-47a7-a4f3-e1c8ae4b91aa tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:53.391658 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-41fddefe-d18b-47a7-a4f3-e1c8ae4b91aa tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:53.392546 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-41fddefe-d18b-47a7-a4f3-e1c8ae4b91aa tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:53.393164 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-41fddefe-d18b-47a7-a4f3-e1c8ae4b91aa tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:53.393774 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-41fddefe-d18b-47a7-a4f3-e1c8ae4b91aa tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:53.689798 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-41fddefe-d18b-47a7-a4f3-e1c8ae4b91aa tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:45:53.698571 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-41fddefe-d18b-47a7-a4f3-e1c8ae4b91aa tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1672 microversion: 2.1 time: 0.319938 Oct 30 01:45:53.699378 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2916/5837] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:45:53 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1672 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:45:54.329842 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9c8ae621-0fce-47ec-9532-ce2b63a969ab tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:45:54.330822 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9c8ae621-0fce-47ec-9532-ce2b63a969ab tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] [instance: 324131f5-3ba0-4222-bb43-a20812dba495] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:54.333010 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:54.343122 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9c8ae621-0fce-47ec-9532-ce2b63a969ab tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:54.343624 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9c8ae621-0fce-47ec-9532-ce2b63a969ab tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:54.344066 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9c8ae621-0fce-47ec-9532-ce2b63a969ab tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:54.344790 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9c8ae621-0fce-47ec-9532-ce2b63a969ab tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:54.345258 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9c8ae621-0fce-47ec-9532-ce2b63a969ab tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:54.347270 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9c8ae621-0fce-47ec-9532-ce2b63a969ab tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:54.622893 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9c8ae621-0fce-47ec-9532-ce2b63a969ab tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53d510d75542a283b7f851a58d3dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f4af2d7cc742b98447e28e3c204c11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:45:54.632466 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9c8ae621-0fce-47ec-9532-ce2b63a969ab tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] 10.222.0.13 "GET /compute/v2.1/servers/324131f5-3ba0-4222-bb43-a20812dba495" status: 200 len: 1641 microversion: 2.1 time: 0.306791 Oct 30 01:45:54.633286 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2922/5838] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:45:54 2022] GET /compute/v2.1/servers/324131f5-3ba0-4222-bb43-a20812dba495 => generated 1641 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:45:54.659111 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a8891f34-8636-48f7-bfb3-db8506ee75d0 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:45:54.659740 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a8891f34-8636-48f7-bfb3-db8506ee75d0 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] [instance: 324131f5-3ba0-4222-bb43-a20812dba495] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:54.666794 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a8891f34-8636-48f7-bfb3-db8506ee75d0 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:54.667556 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a8891f34-8636-48f7-bfb3-db8506ee75d0 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:54.668224 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a8891f34-8636-48f7-bfb3-db8506ee75d0 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:54.668955 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a8891f34-8636-48f7-bfb3-db8506ee75d0 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:54.669437 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a8891f34-8636-48f7-bfb3-db8506ee75d0 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:54.669864 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a8891f34-8636-48f7-bfb3-db8506ee75d0 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:54.728740 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-febf6934-58f1-494c-9771-a14a71a54c90 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:45:54.729702 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-febf6934-58f1-494c-9771-a14a71a54c90 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:54.744997 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-febf6934-58f1-494c-9771-a14a71a54c90 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:54.745990 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-febf6934-58f1-494c-9771-a14a71a54c90 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:54.746436 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-febf6934-58f1-494c-9771-a14a71a54c90 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:54.752398 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-febf6934-58f1-494c-9771-a14a71a54c90 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:54.765534 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-febf6934-58f1-494c-9771-a14a71a54c90 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:54.766778 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-febf6934-58f1-494c-9771-a14a71a54c90 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:54.964651 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a8891f34-8636-48f7-bfb3-db8506ee75d0 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53d510d75542a283b7f851a58d3dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f4af2d7cc742b98447e28e3c204c11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:45:54.977893 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a8891f34-8636-48f7-bfb3-db8506ee75d0 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] 10.222.0.13 "GET /compute/v2.1/servers/324131f5-3ba0-4222-bb43-a20812dba495" status: 200 len: 1641 microversion: 2.1 time: 0.320670 Oct 30 01:45:54.981195 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2917/5839] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:45:54 2022] GET /compute/v2.1/servers/324131f5-3ba0-4222-bb43-a20812dba495 => generated 1641 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:45:55.000569 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-febf6934-58f1-494c-9771-a14a71a54c90 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:45:55.011587 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-22e66857-0df3-4a72-bcce-3d2579bb9ea9 tempest-TestSecurityGroupsBasicOps-49535370 tempest-TestSecurityGroupsBasicOps-49535370-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:45:55.011587 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-22e66857-0df3-4a72-bcce-3d2579bb9ea9 tempest-TestSecurityGroupsBasicOps-49535370 tempest-TestSecurityGroupsBasicOps-49535370-project-admin] [instance: 324131f5-3ba0-4222-bb43-a20812dba495] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:55.011847 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-febf6934-58f1-494c-9771-a14a71a54c90 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1677 microversion: 2.1 time: 0.285457 Oct 30 01:45:55.011847 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2923/5840] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:45:54 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1677 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:45:55.014809 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-22e66857-0df3-4a72-bcce-3d2579bb9ea9 tempest-TestSecurityGroupsBasicOps-49535370 tempest-TestSecurityGroupsBasicOps-49535370-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:55.016582 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-22e66857-0df3-4a72-bcce-3d2579bb9ea9 tempest-TestSecurityGroupsBasicOps-49535370 tempest-TestSecurityGroupsBasicOps-49535370-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:55.017495 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-22e66857-0df3-4a72-bcce-3d2579bb9ea9 tempest-TestSecurityGroupsBasicOps-49535370 tempest-TestSecurityGroupsBasicOps-49535370-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:55.018493 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-22e66857-0df3-4a72-bcce-3d2579bb9ea9 tempest-TestSecurityGroupsBasicOps-49535370 tempest-TestSecurityGroupsBasicOps-49535370-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:55.019167 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-22e66857-0df3-4a72-bcce-3d2579bb9ea9 tempest-TestSecurityGroupsBasicOps-49535370 tempest-TestSecurityGroupsBasicOps-49535370-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:55.019808 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-22e66857-0df3-4a72-bcce-3d2579bb9ea9 tempest-TestSecurityGroupsBasicOps-49535370 tempest-TestSecurityGroupsBasicOps-49535370-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:55.406057 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-22e66857-0df3-4a72-bcce-3d2579bb9ea9 tempest-TestSecurityGroupsBasicOps-49535370 tempest-TestSecurityGroupsBasicOps-49535370-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/324131f5-3ba0-4222-bb43-a20812dba495" status: 200 len: 1792 microversion: 2.1 time: 0.403606 Oct 30 01:45:55.406653 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2918/5841] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:45:55 2022] GET /compute/v2.1/servers/324131f5-3ba0-4222-bb43-a20812dba495 => generated 1792 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:45:56.035260 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f4c200eb-3810-41cc-b448-2b9bff16bf0b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:45:56.035887 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f4c200eb-3810-41cc-b448-2b9bff16bf0b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:45:56.056634 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f4c200eb-3810-41cc-b448-2b9bff16bf0b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:56.059393 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f4c200eb-3810-41cc-b448-2b9bff16bf0b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:56.062098 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f4c200eb-3810-41cc-b448-2b9bff16bf0b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:56.062919 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f4c200eb-3810-41cc-b448-2b9bff16bf0b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:56.063397 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f4c200eb-3810-41cc-b448-2b9bff16bf0b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:56.063835 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f4c200eb-3810-41cc-b448-2b9bff16bf0b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:56.316093 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f4c200eb-3810-41cc-b448-2b9bff16bf0b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:45:56.332136 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f4c200eb-3810-41cc-b448-2b9bff16bf0b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1670 microversion: 2.1 time: 0.301593 Oct 30 01:45:56.334631 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2924/5842] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:45:56 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1670 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:45:59.209162 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-d20bd052-4736-4319-a888-0df44f642a26 req-5e8f2813-486b-4387-a4ea-4723694cb94a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "324131f5-3ba0-4222-bb43-a20812dba495", "tag": "513258c1-74aa-493d-9ce2-a04232fdcb10"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:45:59.239476 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-d20bd052-4736-4319-a888-0df44f642a26 req-5e8f2813-486b-4387-a4ea-4723694cb94a service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:45:59.240378 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-d20bd052-4736-4319-a888-0df44f642a26 req-5e8f2813-486b-4387-a4ea-4723694cb94a service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:45:59.241021 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-d20bd052-4736-4319-a888-0df44f642a26 req-5e8f2813-486b-4387-a4ea-4723694cb94a service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:45:59.272413 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-d20bd052-4736-4319-a888-0df44f642a26 req-5e8f2813-486b-4387-a4ea-4723694cb94a service nova] Creating event network-changed:513258c1-74aa-493d-9ce2-a04232fdcb10 for instance 324131f5-3ba0-4222-bb43-a20812dba495 on n-h2-master-1 Oct 30 01:45:59.287806 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-d20bd052-4736-4319-a888-0df44f642a26 req-5e8f2813-486b-4387-a4ea-4723694cb94a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082889 Oct 30 01:45:59.292507 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2919/5843] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:45:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:46:03.758244 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f1588572-5983-4a81-85b1-6f1ad2763e6f tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Action: 'create', calling method: .version_select at 0x7f44c6fb0e50>, body: {"keypair": {"name": "tempest-keypair-1967195409", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnkkP9bn35xER4ft32aHz/ut4aZzVTg793xBYn1n2tcr+GVEpNejS/dIxt6CXaOgCA5tW0YYvkbaHczlh0BOZv2AzwHd4OUi22vA3iwqAfR7ji7ZRwyYLtFIM2gRre9bA=="}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:46:03.781722 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-f1588572-5983-4a81-85b1-6f1ad2763e6f tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Getting quotas for project 311cde01e89442f1ab3aa930070b7343. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:46:03.787258 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-f1588572-5983-4a81-85b1-6f1ad2763e6f tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Getting quotas for user dcb021152c684983b31e5db439518921 and project 311cde01e89442f1ab3aa930070b7343. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:46:03.897196 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f1588572-5983-4a81-85b1-6f1ad2763e6f tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.145810 Oct 30 01:46:03.899011 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2925/5844] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 30 01:46:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:46:06.939191 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-48f5c5d2-0289-4da5-b0aa-1158916b25d4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1195780315", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1ac83571-0ede-40a0-ae99-0e3341ce15be"}], "security_groups": [{"name": "tempest-securitygroup--577753363"}], "key_name": "tempest-keypair-1967195409", "user_data": "}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:46:07.090492 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-48f5c5d2-0289-4da5-b0aa-1158916b25d4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] validate_networks() for [('1ac83571-0ede-40a0-ae99-0e3341ce15be', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:46:07.781272 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-48f5c5d2-0289-4da5-b0aa-1158916b25d4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:46:07.782015 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-48f5c5d2-0289-4da5-b0aa-1158916b25d4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:46:07.782973 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-48f5c5d2-0289-4da5-b0aa-1158916b25d4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:46:07.783389 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-48f5c5d2-0289-4da5-b0aa-1158916b25d4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:46:07.783807 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-48f5c5d2-0289-4da5-b0aa-1158916b25d4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:46:07.793177 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-48f5c5d2-0289-4da5-b0aa-1158916b25d4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:07.793696 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-48f5c5d2-0289-4da5-b0aa-1158916b25d4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:07.794246 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-48f5c5d2-0289-4da5-b0aa-1158916b25d4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:07.794974 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-48f5c5d2-0289-4da5-b0aa-1158916b25d4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:07.795491 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-48f5c5d2-0289-4da5-b0aa-1158916b25d4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:07.795919 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-48f5c5d2-0289-4da5-b0aa-1158916b25d4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:07.816057 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-48f5c5d2-0289-4da5-b0aa-1158916b25d4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Getting quotas for project 311cde01e89442f1ab3aa930070b7343. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:46:07.822097 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-48f5c5d2-0289-4da5-b0aa-1158916b25d4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Getting quotas for user dcb021152c684983b31e5db439518921 and project 311cde01e89442f1ab3aa930070b7343. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:46:07.835204 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-48f5c5d2-0289-4da5-b0aa-1158916b25d4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:46:07.837715 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-48f5c5d2-0289-4da5-b0aa-1158916b25d4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 9408045e-5de5-45a4-9415-e270fd97dcdd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:46:08.124076 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-48f5c5d2-0289-4da5-b0aa-1158916b25d4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.192508 Oct 30 01:46:08.124809 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2920/5845] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:46:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 1194 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:46:08.133872 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:08.139171 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-75def2b3-d054-4df4-b9f0-2d12efe2c539 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:46:08.140215 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-75def2b3-d054-4df4-b9f0-2d12efe2c539 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 9408045e-5de5-45a4-9415-e270fd97dcdd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:46:08.221074 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-75def2b3-d054-4df4-b9f0-2d12efe2c539 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:46:08.238026 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-75def2b3-d054-4df4-b9f0-2d12efe2c539 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/9408045e-5de5-45a4-9415-e270fd97dcdd" status: 200 len: 1242 microversion: 2.1 time: 0.104525 Oct 30 01:46:08.240560 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2926/5846] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:46:08 2022] GET /compute/v2.1/servers/9408045e-5de5-45a4-9415-e270fd97dcdd => generated 1242 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:46:09.267517 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9d8bbe77-306a-4975-9705-711540594de1 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:46:09.268054 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9d8bbe77-306a-4975-9705-711540594de1 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 9408045e-5de5-45a4-9415-e270fd97dcdd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:46:09.274452 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9d8bbe77-306a-4975-9705-711540594de1 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:09.274939 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9d8bbe77-306a-4975-9705-711540594de1 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:09.275372 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9d8bbe77-306a-4975-9705-711540594de1 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:09.276069 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9d8bbe77-306a-4975-9705-711540594de1 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:09.276520 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9d8bbe77-306a-4975-9705-711540594de1 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:09.276945 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9d8bbe77-306a-4975-9705-711540594de1 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:09.348790 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9d8bbe77-306a-4975-9705-711540594de1 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:46:09.357817 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9d8bbe77-306a-4975-9705-711540594de1 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/9408045e-5de5-45a4-9415-e270fd97dcdd" status: 200 len: 1246 microversion: 2.1 time: 0.095609 Oct 30 01:46:09.365967 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2921/5847] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:46:09 2022] GET /compute/v2.1/servers/9408045e-5de5-45a4-9415-e270fd97dcdd => generated 1246 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:46:10.476751 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-df2e5781-ed36-4114-9073-63152c2b90d8 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:46:10.476751 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-df2e5781-ed36-4114-9073-63152c2b90d8 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 9408045e-5de5-45a4-9415-e270fd97dcdd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:46:10.476751 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df2e5781-ed36-4114-9073-63152c2b90d8 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:10.476751 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df2e5781-ed36-4114-9073-63152c2b90d8 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:10.476751 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df2e5781-ed36-4114-9073-63152c2b90d8 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:10.476751 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df2e5781-ed36-4114-9073-63152c2b90d8 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:10.476751 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df2e5781-ed36-4114-9073-63152c2b90d8 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:10.476751 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df2e5781-ed36-4114-9073-63152c2b90d8 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:10.476751 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-df2e5781-ed36-4114-9073-63152c2b90d8 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:46:10.476751 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-df2e5781-ed36-4114-9073-63152c2b90d8 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/9408045e-5de5-45a4-9415-e270fd97dcdd" status: 200 len: 1294 microversion: 2.1 time: 0.089869 Oct 30 01:46:10.476751 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2927/5848] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:46:10 2022] GET /compute/v2.1/servers/9408045e-5de5-45a4-9415-e270fd97dcdd => generated 1294 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:46:11.501471 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e0b3d8e9-da9d-4863-8b9c-7a552977690e tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:46:11.502818 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e0b3d8e9-da9d-4863-8b9c-7a552977690e tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 9408045e-5de5-45a4-9415-e270fd97dcdd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:46:11.506476 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=6 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:11.511436 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e0b3d8e9-da9d-4863-8b9c-7a552977690e tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:11.512002 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e0b3d8e9-da9d-4863-8b9c-7a552977690e tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:11.512438 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e0b3d8e9-da9d-4863-8b9c-7a552977690e tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:11.513140 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e0b3d8e9-da9d-4863-8b9c-7a552977690e tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:11.513620 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e0b3d8e9-da9d-4863-8b9c-7a552977690e tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:11.514047 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e0b3d8e9-da9d-4863-8b9c-7a552977690e tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:11.589751 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e0b3d8e9-da9d-4863-8b9c-7a552977690e tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:46:11.598598 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e0b3d8e9-da9d-4863-8b9c-7a552977690e tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/9408045e-5de5-45a4-9415-e270fd97dcdd" status: 200 len: 1300 microversion: 2.1 time: 0.101013 Oct 30 01:46:11.613845 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2922/5849] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:46:11 2022] GET /compute/v2.1/servers/9408045e-5de5-45a4-9415-e270fd97dcdd => generated 1300 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:46:12.627290 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-beb66373-e965-418a-99ba-f1f5f148ce8e tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:46:12.627927 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-beb66373-e965-418a-99ba-f1f5f148ce8e tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 9408045e-5de5-45a4-9415-e270fd97dcdd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:46:12.642834 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-beb66373-e965-418a-99ba-f1f5f148ce8e tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:12.646096 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-beb66373-e965-418a-99ba-f1f5f148ce8e tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:12.646096 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-beb66373-e965-418a-99ba-f1f5f148ce8e tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:12.646096 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-beb66373-e965-418a-99ba-f1f5f148ce8e tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:12.646096 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-beb66373-e965-418a-99ba-f1f5f148ce8e tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:12.646869 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-beb66373-e965-418a-99ba-f1f5f148ce8e tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:13.311423 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-beb66373-e965-418a-99ba-f1f5f148ce8e tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:46:13.328258 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-beb66373-e965-418a-99ba-f1f5f148ce8e tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/9408045e-5de5-45a4-9415-e270fd97dcdd" status: 200 len: 1367 microversion: 2.1 time: 0.696953 Oct 30 01:46:13.328258 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2928/5850] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:46:12 2022] GET /compute/v2.1/servers/9408045e-5de5-45a4-9415-e270fd97dcdd => generated 1367 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:46:13.918256 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-cd471a8e-c641-4256-920c-951370e4504c req-1a137d9e-95f9-4c6e-b43f-5b2189e89221 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9408045e-5de5-45a4-9415-e270fd97dcdd", "tag": "98b4cf11-4409-43bf-8622-dc9452f865cb"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:46:13.930521 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-cd471a8e-c641-4256-920c-951370e4504c req-1a137d9e-95f9-4c6e-b43f-5b2189e89221 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:13.930905 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-cd471a8e-c641-4256-920c-951370e4504c req-1a137d9e-95f9-4c6e-b43f-5b2189e89221 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:13.931720 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-cd471a8e-c641-4256-920c-951370e4504c req-1a137d9e-95f9-4c6e-b43f-5b2189e89221 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:13.945274 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=73 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:13.947975 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-cd471a8e-c641-4256-920c-951370e4504c req-1a137d9e-95f9-4c6e-b43f-5b2189e89221 service nova] Creating event network-changed:98b4cf11-4409-43bf-8622-dc9452f865cb for instance 9408045e-5de5-45a4-9415-e270fd97dcdd on n-h1-master-1 Oct 30 01:46:13.956488 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-cd471a8e-c641-4256-920c-951370e4504c req-1a137d9e-95f9-4c6e-b43f-5b2189e89221 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043966 Oct 30 01:46:13.957748 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2923/5851] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:46:14.342729 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-684cab25-075a-4b43-942e-4032fff306a6 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:46:14.343354 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-684cab25-075a-4b43-942e-4032fff306a6 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 9408045e-5de5-45a4-9415-e270fd97dcdd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:46:14.356227 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-684cab25-075a-4b43-942e-4032fff306a6 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:14.357029 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-684cab25-075a-4b43-942e-4032fff306a6 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:14.357654 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-684cab25-075a-4b43-942e-4032fff306a6 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:14.358680 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-684cab25-075a-4b43-942e-4032fff306a6 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:14.359351 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-684cab25-075a-4b43-942e-4032fff306a6 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:14.360027 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-684cab25-075a-4b43-942e-4032fff306a6 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:14.581397 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-684cab25-075a-4b43-942e-4032fff306a6 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:46:14.595255 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-684cab25-075a-4b43-942e-4032fff306a6 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/9408045e-5de5-45a4-9415-e270fd97dcdd" status: 200 len: 1367 microversion: 2.1 time: 0.256547 Oct 30 01:46:14.605099 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2929/5852] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:46:14 2022] GET /compute/v2.1/servers/9408045e-5de5-45a4-9415-e270fd97dcdd => generated 1367 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:46:15.630264 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6dd39ac3-abde-4270-8c6d-b635e8539f47 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:46:15.631664 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6dd39ac3-abde-4270-8c6d-b635e8539f47 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 9408045e-5de5-45a4-9415-e270fd97dcdd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:46:15.643178 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6dd39ac3-abde-4270-8c6d-b635e8539f47 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:15.643719 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6dd39ac3-abde-4270-8c6d-b635e8539f47 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:15.644180 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6dd39ac3-abde-4270-8c6d-b635e8539f47 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:15.647694 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6dd39ac3-abde-4270-8c6d-b635e8539f47 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:15.653157 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6dd39ac3-abde-4270-8c6d-b635e8539f47 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:15.653157 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6dd39ac3-abde-4270-8c6d-b635e8539f47 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:15.844951 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6dd39ac3-abde-4270-8c6d-b635e8539f47 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:46:15.855942 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6dd39ac3-abde-4270-8c6d-b635e8539f47 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/9408045e-5de5-45a4-9415-e270fd97dcdd" status: 200 len: 1367 microversion: 2.1 time: 0.231959 Oct 30 01:46:15.856630 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2924/5853] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:46:15 2022] GET /compute/v2.1/servers/9408045e-5de5-45a4-9415-e270fd97dcdd => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:46:16.879199 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d9f9c19c-efab-403b-8919-89b449ff70fc tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:46:16.882941 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d9f9c19c-efab-403b-8919-89b449ff70fc tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 9408045e-5de5-45a4-9415-e270fd97dcdd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:46:16.882941 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:16.896742 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d9f9c19c-efab-403b-8919-89b449ff70fc tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:16.897556 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d9f9c19c-efab-403b-8919-89b449ff70fc tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:16.898200 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d9f9c19c-efab-403b-8919-89b449ff70fc tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:16.899245 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d9f9c19c-efab-403b-8919-89b449ff70fc tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:16.900794 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d9f9c19c-efab-403b-8919-89b449ff70fc tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:16.901231 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d9f9c19c-efab-403b-8919-89b449ff70fc tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:17.145768 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d9f9c19c-efab-403b-8919-89b449ff70fc tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:46:17.153767 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d9f9c19c-efab-403b-8919-89b449ff70fc tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/9408045e-5de5-45a4-9415-e270fd97dcdd" status: 200 len: 1367 microversion: 2.1 time: 0.278707 Oct 30 01:46:17.154350 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2930/5854] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:46:16 2022] GET /compute/v2.1/servers/9408045e-5de5-45a4-9415-e270fd97dcdd => generated 1367 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:46:18.180472 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ff97bd1e-97f9-44dd-9246-45b538701f6a tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:46:18.181082 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ff97bd1e-97f9-44dd-9246-45b538701f6a tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 9408045e-5de5-45a4-9415-e270fd97dcdd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:46:18.184395 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:18.185439 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=6 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:18.191030 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ff97bd1e-97f9-44dd-9246-45b538701f6a tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:18.191580 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ff97bd1e-97f9-44dd-9246-45b538701f6a tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:18.192059 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ff97bd1e-97f9-44dd-9246-45b538701f6a tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:18.192806 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ff97bd1e-97f9-44dd-9246-45b538701f6a tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:18.193448 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ff97bd1e-97f9-44dd-9246-45b538701f6a tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:18.193932 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ff97bd1e-97f9-44dd-9246-45b538701f6a tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:18.498019 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ff97bd1e-97f9-44dd-9246-45b538701f6a tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:46:18.506116 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ff97bd1e-97f9-44dd-9246-45b538701f6a tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/9408045e-5de5-45a4-9415-e270fd97dcdd" status: 200 len: 1367 microversion: 2.1 time: 0.329787 Oct 30 01:46:18.507074 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2925/5855] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:46:18 2022] GET /compute/v2.1/servers/9408045e-5de5-45a4-9415-e270fd97dcdd => generated 1367 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:46:19.530225 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9d0e0c21-3308-4d6c-b54e-d8edc6db7377 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:46:19.531430 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9d0e0c21-3308-4d6c-b54e-d8edc6db7377 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 9408045e-5de5-45a4-9415-e270fd97dcdd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:46:19.535742 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=6 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:19.540851 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9d0e0c21-3308-4d6c-b54e-d8edc6db7377 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:19.541541 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9d0e0c21-3308-4d6c-b54e-d8edc6db7377 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:19.542131 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9d0e0c21-3308-4d6c-b54e-d8edc6db7377 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:19.543021 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9d0e0c21-3308-4d6c-b54e-d8edc6db7377 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:19.543637 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9d0e0c21-3308-4d6c-b54e-d8edc6db7377 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:19.544217 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9d0e0c21-3308-4d6c-b54e-d8edc6db7377 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:19.720654 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9d0e0c21-3308-4d6c-b54e-d8edc6db7377 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:46:19.731827 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9d0e0c21-3308-4d6c-b54e-d8edc6db7377 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/9408045e-5de5-45a4-9415-e270fd97dcdd" status: 200 len: 1367 microversion: 2.1 time: 0.203660 Oct 30 01:46:19.733026 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2931/5856] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:46:19 2022] GET /compute/v2.1/servers/9408045e-5de5-45a4-9415-e270fd97dcdd => generated 1367 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:46:20.108451 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-cd8e226e-a8d8-448d-a783-edd701455907 req-2b881ec1-c868-4a02-82f6-086cee2da2ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9408045e-5de5-45a4-9415-e270fd97dcdd", "name": "network-vif-plugged", "status": "completed", "tag": "98b4cf11-4409-43bf-8622-dc9452f865cb"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:46:20.122505 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-cd8e226e-a8d8-448d-a783-edd701455907 req-2b881ec1-c868-4a02-82f6-086cee2da2ee service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:20.123306 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-cd8e226e-a8d8-448d-a783-edd701455907 req-2b881ec1-c868-4a02-82f6-086cee2da2ee service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:20.123952 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-cd8e226e-a8d8-448d-a783-edd701455907 req-2b881ec1-c868-4a02-82f6-086cee2da2ee service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:20.136991 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-cd8e226e-a8d8-448d-a783-edd701455907 req-2b881ec1-c868-4a02-82f6-086cee2da2ee service nova] Creating event network-vif-plugged:98b4cf11-4409-43bf-8622-dc9452f865cb for instance 9408045e-5de5-45a4-9415-e270fd97dcdd on n-h1-master-1 Oct 30 01:46:20.142520 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-cd8e226e-a8d8-448d-a783-edd701455907 req-2b881ec1-c868-4a02-82f6-086cee2da2ee service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038749 Oct 30 01:46:20.159643 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2926/5857] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:46:20.758377 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c1f5dee4-8069-4014-8dc1-01d8c06c8625 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:46:20.760276 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c1f5dee4-8069-4014-8dc1-01d8c06c8625 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 9408045e-5de5-45a4-9415-e270fd97dcdd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:46:20.767961 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c1f5dee4-8069-4014-8dc1-01d8c06c8625 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:20.768524 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c1f5dee4-8069-4014-8dc1-01d8c06c8625 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:20.768966 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c1f5dee4-8069-4014-8dc1-01d8c06c8625 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:20.769747 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c1f5dee4-8069-4014-8dc1-01d8c06c8625 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:20.770791 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c1f5dee4-8069-4014-8dc1-01d8c06c8625 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:20.771313 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c1f5dee4-8069-4014-8dc1-01d8c06c8625 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:20.906222 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c1f5dee4-8069-4014-8dc1-01d8c06c8625 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:46:20.914264 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c1f5dee4-8069-4014-8dc1-01d8c06c8625 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/9408045e-5de5-45a4-9415-e270fd97dcdd" status: 200 len: 1367 microversion: 2.1 time: 0.160758 Oct 30 01:46:20.914861 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2932/5858] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:46:20 2022] GET /compute/v2.1/servers/9408045e-5de5-45a4-9415-e270fd97dcdd => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:46:21.939790 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ff2a5d1f-3b3c-48a1-b91b-283daa9cff3f tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:46:21.948632 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ff2a5d1f-3b3c-48a1-b91b-283daa9cff3f tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 9408045e-5de5-45a4-9415-e270fd97dcdd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:46:21.948632 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ff2a5d1f-3b3c-48a1-b91b-283daa9cff3f tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:21.948632 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ff2a5d1f-3b3c-48a1-b91b-283daa9cff3f tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:21.948632 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ff2a5d1f-3b3c-48a1-b91b-283daa9cff3f tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:21.949770 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ff2a5d1f-3b3c-48a1-b91b-283daa9cff3f tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:21.949770 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ff2a5d1f-3b3c-48a1-b91b-283daa9cff3f tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:21.950196 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ff2a5d1f-3b3c-48a1-b91b-283daa9cff3f tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:22.094297 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ff2a5d1f-3b3c-48a1-b91b-283daa9cff3f tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:46:22.105698 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ff2a5d1f-3b3c-48a1-b91b-283daa9cff3f tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/9408045e-5de5-45a4-9415-e270fd97dcdd" status: 200 len: 1556 microversion: 2.1 time: 0.171045 Oct 30 01:46:22.106351 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2927/5859] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:46:21 2022] GET /compute/v2.1/servers/9408045e-5de5-45a4-9415-e270fd97dcdd => generated 1556 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:46:22.129159 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3b033b98-4089-4879-a9dd-4187e9c63fc5 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:46:22.130408 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3b033b98-4089-4879-a9dd-4187e9c63fc5 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 9408045e-5de5-45a4-9415-e270fd97dcdd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:46:22.137474 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b033b98-4089-4879-a9dd-4187e9c63fc5 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:22.137976 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b033b98-4089-4879-a9dd-4187e9c63fc5 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:22.138424 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b033b98-4089-4879-a9dd-4187e9c63fc5 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:22.139136 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b033b98-4089-4879-a9dd-4187e9c63fc5 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:22.139600 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b033b98-4089-4879-a9dd-4187e9c63fc5 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:22.140034 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b033b98-4089-4879-a9dd-4187e9c63fc5 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:22.222608 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3b033b98-4089-4879-a9dd-4187e9c63fc5 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/9408045e-5de5-45a4-9415-e270fd97dcdd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097658 Oct 30 01:46:22.223834 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2933/5860] 10.222.0.13 () {58 vars in 1275 bytes} [Sun Oct 30 01:46:22 2022] GET /compute/v2.1/servers/9408045e-5de5-45a4-9415-e270fd97dcdd/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:46:23.900523 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-b7c65013-5e74-48a1-aae3-35298f844b4c req-3a87770c-01c2-41ba-b67f-e91e76a4c8a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9408045e-5de5-45a4-9415-e270fd97dcdd", "tag": "98b4cf11-4409-43bf-8622-dc9452f865cb"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:46:23.929448 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-b7c65013-5e74-48a1-aae3-35298f844b4c req-3a87770c-01c2-41ba-b67f-e91e76a4c8a9 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:23.929448 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-b7c65013-5e74-48a1-aae3-35298f844b4c req-3a87770c-01c2-41ba-b67f-e91e76a4c8a9 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:23.929448 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-b7c65013-5e74-48a1-aae3-35298f844b4c req-3a87770c-01c2-41ba-b67f-e91e76a4c8a9 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:23.939642 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-b7c65013-5e74-48a1-aae3-35298f844b4c req-3a87770c-01c2-41ba-b67f-e91e76a4c8a9 service nova] Creating event network-changed:98b4cf11-4409-43bf-8622-dc9452f865cb for instance 9408045e-5de5-45a4-9415-e270fd97dcdd on n-h1-master-1 Oct 30 01:46:23.945780 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-b7c65013-5e74-48a1-aae3-35298f844b4c req-3a87770c-01c2-41ba-b67f-e91e76a4c8a9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051260 Oct 30 01:46:23.947086 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2928/5861] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:46:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:46:28.363453 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-962c96b9-c3f4-495d-af6a-30d51a452702 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:46:28.373793 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-962c96b9-c3f4-495d-af6a-30d51a452702 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:46:28.386783 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-962c96b9-c3f4-495d-af6a-30d51a452702 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:28.387449 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-962c96b9-c3f4-495d-af6a-30d51a452702 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:28.389747 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-962c96b9-c3f4-495d-af6a-30d51a452702 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:28.389747 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-962c96b9-c3f4-495d-af6a-30d51a452702 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:28.389747 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-962c96b9-c3f4-495d-af6a-30d51a452702 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:28.389747 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-962c96b9-c3f4-495d-af6a-30d51a452702 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:28.566965 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-962c96b9-c3f4-495d-af6a-30d51a452702 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:46:28.578804 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-962c96b9-c3f4-495d-af6a-30d51a452702 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1670 microversion: 2.1 time: 0.220964 Oct 30 01:46:28.579509 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2934/5862] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:46:28 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1670 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:46:28.608254 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a59a7df1-0a6a-449e-9eb0-144ccc56aa71 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:46:28.609073 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a59a7df1-0a6a-449e-9eb0-144ccc56aa71 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:46:28.617369 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a59a7df1-0a6a-449e-9eb0-144ccc56aa71 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:28.618062 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a59a7df1-0a6a-449e-9eb0-144ccc56aa71 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:28.618503 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a59a7df1-0a6a-449e-9eb0-144ccc56aa71 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:28.619511 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a59a7df1-0a6a-449e-9eb0-144ccc56aa71 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:28.619960 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a59a7df1-0a6a-449e-9eb0-144ccc56aa71 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:28.620390 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a59a7df1-0a6a-449e-9eb0-144ccc56aa71 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:28.758407 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a59a7df1-0a6a-449e-9eb0-144ccc56aa71 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:46:28.766740 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a59a7df1-0a6a-449e-9eb0-144ccc56aa71 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1670 microversion: 2.1 time: 0.163086 Oct 30 01:46:28.767578 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2929/5863] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:46:28 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1670 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:46:28.794747 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-38632be7-5a3e-46b3-9bf9-f213af34e482 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:46:28.795618 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-38632be7-5a3e-46b3-9bf9-f213af34e482 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:46:28.806054 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38632be7-5a3e-46b3-9bf9-f213af34e482 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:28.806593 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38632be7-5a3e-46b3-9bf9-f213af34e482 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:28.807036 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38632be7-5a3e-46b3-9bf9-f213af34e482 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:28.808100 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38632be7-5a3e-46b3-9bf9-f213af34e482 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:28.808598 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38632be7-5a3e-46b3-9bf9-f213af34e482 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:28.809028 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38632be7-5a3e-46b3-9bf9-f213af34e482 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:28.955792 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-38632be7-5a3e-46b3-9bf9-f213af34e482 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:46:28.964161 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-38632be7-5a3e-46b3-9bf9-f213af34e482 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1670 microversion: 2.1 time: 0.177653 Oct 30 01:46:28.964926 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2935/5864] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:46:28 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1670 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:46:28.987293 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1dc2d818-fe95-4eeb-96ec-ee586da92f4e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:46:28.987963 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1dc2d818-fe95-4eeb-96ec-ee586da92f4e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:46:28.994529 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1dc2d818-fe95-4eeb-96ec-ee586da92f4e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:28.995055 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1dc2d818-fe95-4eeb-96ec-ee586da92f4e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:28.995515 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1dc2d818-fe95-4eeb-96ec-ee586da92f4e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:28.996201 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1dc2d818-fe95-4eeb-96ec-ee586da92f4e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:28.996651 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1dc2d818-fe95-4eeb-96ec-ee586da92f4e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:28.997073 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1dc2d818-fe95-4eeb-96ec-ee586da92f4e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:29.154219 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1dc2d818-fe95-4eeb-96ec-ee586da92f4e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:46:29.161412 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1dc2d818-fe95-4eeb-96ec-ee586da92f4e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1670 microversion: 2.1 time: 0.177901 Oct 30 01:46:29.165440 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2930/5865] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:46:28 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1670 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:46:29.315038 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c6a53ab2-4df9-4500-bbfa-38cb80b46c01 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-745547259", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "c8b5246f-f8f5-404d-864d-b312dbb308c5"}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:46:29.390528 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-c6a53ab2-4df9-4500-bbfa-38cb80b46c01 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] validate_networks() for [('c8b5246f-f8f5-404d-864d-b312dbb308c5', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:46:29.820538 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-c6a53ab2-4df9-4500-bbfa-38cb80b46c01 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:46:29.826744 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-c6a53ab2-4df9-4500-bbfa-38cb80b46c01 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:46:29.826744 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-c6a53ab2-4df9-4500-bbfa-38cb80b46c01 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:46:29.826744 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-c6a53ab2-4df9-4500-bbfa-38cb80b46c01 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:46:29.826744 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-c6a53ab2-4df9-4500-bbfa-38cb80b46c01 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:46:29.836388 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6a53ab2-4df9-4500-bbfa-38cb80b46c01 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:29.836879 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6a53ab2-4df9-4500-bbfa-38cb80b46c01 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:29.837313 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6a53ab2-4df9-4500-bbfa-38cb80b46c01 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:29.838049 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6a53ab2-4df9-4500-bbfa-38cb80b46c01 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:29.839007 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6a53ab2-4df9-4500-bbfa-38cb80b46c01 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:29.839434 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6a53ab2-4df9-4500-bbfa-38cb80b46c01 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:29.858274 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-c6a53ab2-4df9-4500-bbfa-38cb80b46c01 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Getting quotas for project 9f9d0d541cc3496ebf8dc71af4254506. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:46:29.863971 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-c6a53ab2-4df9-4500-bbfa-38cb80b46c01 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Getting quotas for user 157c0ef579434726810bb3775388b944 and project 9f9d0d541cc3496ebf8dc71af4254506. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:46:29.883496 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c6a53ab2-4df9-4500-bbfa-38cb80b46c01 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:46:29.885872 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c6a53ab2-4df9-4500-bbfa-38cb80b46c01 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 1f5100bd-9d74-4990-8b1f-52011ed9d19f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:46:30.029320 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c6a53ab2-4df9-4500-bbfa-38cb80b46c01 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.717408 Oct 30 01:46:30.032430 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2936/5866] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:46:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:46:30.044088 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6c38257e-07da-4724-affc-6615c87eb807 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:46:30.045434 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6c38257e-07da-4724-affc-6615c87eb807 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 1f5100bd-9d74-4990-8b1f-52011ed9d19f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:46:30.127600 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6c38257e-07da-4724-affc-6615c87eb807 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:46:30.131754 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6c38257e-07da-4724-affc-6615c87eb807 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/1f5100bd-9d74-4990-8b1f-52011ed9d19f" status: 200 len: 1214 microversion: 2.1 time: 0.091478 Oct 30 01:46:30.145770 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2931/5867] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:46:30 2022] GET /compute/v2.1/servers/1f5100bd-9d74-4990-8b1f-52011ed9d19f => generated 1214 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:46:31.156237 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ca5cab22-4ba2-450b-a7fd-1a89e848328a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:46:31.157032 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ca5cab22-4ba2-450b-a7fd-1a89e848328a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 1f5100bd-9d74-4990-8b1f-52011ed9d19f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:46:31.166460 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ca5cab22-4ba2-450b-a7fd-1a89e848328a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:31.167053 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ca5cab22-4ba2-450b-a7fd-1a89e848328a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:31.167591 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ca5cab22-4ba2-450b-a7fd-1a89e848328a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:31.168402 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ca5cab22-4ba2-450b-a7fd-1a89e848328a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:31.169144 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ca5cab22-4ba2-450b-a7fd-1a89e848328a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:31.169793 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ca5cab22-4ba2-450b-a7fd-1a89e848328a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:31.265204 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ca5cab22-4ba2-450b-a7fd-1a89e848328a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:46:31.278419 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ca5cab22-4ba2-450b-a7fd-1a89e848328a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/1f5100bd-9d74-4990-8b1f-52011ed9d19f" status: 200 len: 1218 microversion: 2.1 time: 0.126330 Oct 30 01:46:31.279178 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2937/5868] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:46:31 2022] GET /compute/v2.1/servers/1f5100bd-9d74-4990-8b1f-52011ed9d19f => generated 1218 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:46:32.305976 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-86405354-8a70-4a59-a99b-5d0340911ab6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:46:32.317402 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-86405354-8a70-4a59-a99b-5d0340911ab6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 1f5100bd-9d74-4990-8b1f-52011ed9d19f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:46:32.325920 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86405354-8a70-4a59-a99b-5d0340911ab6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:32.327155 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86405354-8a70-4a59-a99b-5d0340911ab6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:32.327827 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86405354-8a70-4a59-a99b-5d0340911ab6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:32.342767 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86405354-8a70-4a59-a99b-5d0340911ab6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:32.342767 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86405354-8a70-4a59-a99b-5d0340911ab6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:32.342767 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86405354-8a70-4a59-a99b-5d0340911ab6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:32.478112 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-86405354-8a70-4a59-a99b-5d0340911ab6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:46:32.499858 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-86405354-8a70-4a59-a99b-5d0340911ab6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/1f5100bd-9d74-4990-8b1f-52011ed9d19f" status: 200 len: 1266 microversion: 2.1 time: 0.198487 Oct 30 01:46:32.508429 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2932/5869] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:46:32 2022] GET /compute/v2.1/servers/1f5100bd-9d74-4990-8b1f-52011ed9d19f => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:46:33.525577 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-91687ff3-d98a-4e3f-b8db-92385bd9c665 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:46:33.526793 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-91687ff3-d98a-4e3f-b8db-92385bd9c665 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 1f5100bd-9d74-4990-8b1f-52011ed9d19f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:46:33.540591 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91687ff3-d98a-4e3f-b8db-92385bd9c665 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:33.542627 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91687ff3-d98a-4e3f-b8db-92385bd9c665 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:33.556210 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91687ff3-d98a-4e3f-b8db-92385bd9c665 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:33.556210 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91687ff3-d98a-4e3f-b8db-92385bd9c665 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:33.556210 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91687ff3-d98a-4e3f-b8db-92385bd9c665 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:33.556210 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91687ff3-d98a-4e3f-b8db-92385bd9c665 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:33.708063 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-91687ff3-d98a-4e3f-b8db-92385bd9c665 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:46:33.719668 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-91687ff3-d98a-4e3f-b8db-92385bd9c665 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/1f5100bd-9d74-4990-8b1f-52011ed9d19f" status: 200 len: 1272 microversion: 2.1 time: 0.199641 Oct 30 01:46:33.722761 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2938/5870] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:46:33 2022] GET /compute/v2.1/servers/1f5100bd-9d74-4990-8b1f-52011ed9d19f => generated 1272 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:46:34.751124 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-10e06378-6eb1-4436-9620-e9c3ca53a705 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:46:34.753354 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-10e06378-6eb1-4436-9620-e9c3ca53a705 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 1f5100bd-9d74-4990-8b1f-52011ed9d19f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:46:34.768289 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-10e06378-6eb1-4436-9620-e9c3ca53a705 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:34.769188 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-10e06378-6eb1-4436-9620-e9c3ca53a705 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:34.770752 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-10e06378-6eb1-4436-9620-e9c3ca53a705 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:34.775733 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-10e06378-6eb1-4436-9620-e9c3ca53a705 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:34.776645 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-10e06378-6eb1-4436-9620-e9c3ca53a705 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:34.778627 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-10e06378-6eb1-4436-9620-e9c3ca53a705 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:35.121663 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-10e06378-6eb1-4436-9620-e9c3ca53a705 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:46:35.131428 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-10e06378-6eb1-4436-9620-e9c3ca53a705 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/1f5100bd-9d74-4990-8b1f-52011ed9d19f" status: 200 len: 1314 microversion: 2.1 time: 0.384153 Oct 30 01:46:35.142791 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2933/5871] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:46:34 2022] GET /compute/v2.1/servers/1f5100bd-9d74-4990-8b1f-52011ed9d19f => generated 1314 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:46:35.935070 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-cc71aa22-0c90-444c-966e-5abbf103f560 req-712c7b4e-efc3-499c-9f7d-c4159999ef41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f5100bd-9d74-4990-8b1f-52011ed9d19f", "tag": "3221ff94-adbf-42f6-a6dc-7d703b7ea10e"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:46:35.953453 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-cc71aa22-0c90-444c-966e-5abbf103f560 req-712c7b4e-efc3-499c-9f7d-c4159999ef41 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:35.966135 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-cc71aa22-0c90-444c-966e-5abbf103f560 req-712c7b4e-efc3-499c-9f7d-c4159999ef41 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:35.966832 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-cc71aa22-0c90-444c-966e-5abbf103f560 req-712c7b4e-efc3-499c-9f7d-c4159999ef41 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:35.979886 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-cc71aa22-0c90-444c-966e-5abbf103f560 req-712c7b4e-efc3-499c-9f7d-c4159999ef41 service nova] Creating event network-changed:3221ff94-adbf-42f6-a6dc-7d703b7ea10e for instance 1f5100bd-9d74-4990-8b1f-52011ed9d19f on n-h2-master-1 Oct 30 01:46:35.999229 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-cc71aa22-0c90-444c-966e-5abbf103f560 req-712c7b4e-efc3-499c-9f7d-c4159999ef41 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067960 Oct 30 01:46:36.000006 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2939/5872] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:46:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:46:36.174545 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-66377de4-1635-4d8d-ae63-904f4d69491e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:46:36.174937 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-66377de4-1635-4d8d-ae63-904f4d69491e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 1f5100bd-9d74-4990-8b1f-52011ed9d19f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:46:36.199229 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-66377de4-1635-4d8d-ae63-904f4d69491e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:36.202930 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-66377de4-1635-4d8d-ae63-904f4d69491e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:36.206175 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-66377de4-1635-4d8d-ae63-904f4d69491e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:36.207565 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-66377de4-1635-4d8d-ae63-904f4d69491e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:36.210294 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-66377de4-1635-4d8d-ae63-904f4d69491e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:36.212105 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-66377de4-1635-4d8d-ae63-904f4d69491e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:36.654201 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-66377de4-1635-4d8d-ae63-904f4d69491e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:46:36.669050 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-66377de4-1635-4d8d-ae63-904f4d69491e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/1f5100bd-9d74-4990-8b1f-52011ed9d19f" status: 200 len: 1314 microversion: 2.1 time: 0.500578 Oct 30 01:46:36.669050 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2934/5873] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:46:36 2022] GET /compute/v2.1/servers/1f5100bd-9d74-4990-8b1f-52011ed9d19f => generated 1314 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:46:37.690574 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7b86edef-7e3a-47bd-9103-e16b6ae911e5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:46:37.691292 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7b86edef-7e3a-47bd-9103-e16b6ae911e5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 1f5100bd-9d74-4990-8b1f-52011ed9d19f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:46:37.699378 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b86edef-7e3a-47bd-9103-e16b6ae911e5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:37.700146 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b86edef-7e3a-47bd-9103-e16b6ae911e5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:37.700786 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b86edef-7e3a-47bd-9103-e16b6ae911e5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:37.701821 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b86edef-7e3a-47bd-9103-e16b6ae911e5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:37.702280 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b86edef-7e3a-47bd-9103-e16b6ae911e5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:37.702714 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b86edef-7e3a-47bd-9103-e16b6ae911e5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:38.170850 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7b86edef-7e3a-47bd-9103-e16b6ae911e5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:46:38.181125 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7b86edef-7e3a-47bd-9103-e16b6ae911e5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/1f5100bd-9d74-4990-8b1f-52011ed9d19f" status: 200 len: 1314 microversion: 2.1 time: 0.494855 Oct 30 01:46:38.182578 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2940/5874] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:46:37 2022] GET /compute/v2.1/servers/1f5100bd-9d74-4990-8b1f-52011ed9d19f => generated 1314 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:46:39.210694 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e18ad043-110e-4541-87ed-03cf2db132b6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:46:39.211355 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e18ad043-110e-4541-87ed-03cf2db132b6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 1f5100bd-9d74-4990-8b1f-52011ed9d19f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:46:39.226638 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e18ad043-110e-4541-87ed-03cf2db132b6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:39.227152 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e18ad043-110e-4541-87ed-03cf2db132b6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:39.227595 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e18ad043-110e-4541-87ed-03cf2db132b6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:39.232872 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e18ad043-110e-4541-87ed-03cf2db132b6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:39.233809 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e18ad043-110e-4541-87ed-03cf2db132b6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:39.234461 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e18ad043-110e-4541-87ed-03cf2db132b6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:39.422890 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e18ad043-110e-4541-87ed-03cf2db132b6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:46:39.432864 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e18ad043-110e-4541-87ed-03cf2db132b6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/1f5100bd-9d74-4990-8b1f-52011ed9d19f" status: 200 len: 1314 microversion: 2.1 time: 0.232222 Oct 30 01:46:39.433913 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2935/5875] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:46:39 2022] GET /compute/v2.1/servers/1f5100bd-9d74-4990-8b1f-52011ed9d19f => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:46:40.465485 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f0c06af7-c81f-4a9d-985f-76bcf55a8e38 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:46:40.466183 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f0c06af7-c81f-4a9d-985f-76bcf55a8e38 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 1f5100bd-9d74-4990-8b1f-52011ed9d19f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:46:40.469548 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:40.470651 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=6 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:40.476376 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f0c06af7-c81f-4a9d-985f-76bcf55a8e38 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:40.477115 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f0c06af7-c81f-4a9d-985f-76bcf55a8e38 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:40.477740 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f0c06af7-c81f-4a9d-985f-76bcf55a8e38 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:40.478659 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f0c06af7-c81f-4a9d-985f-76bcf55a8e38 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:40.479533 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f0c06af7-c81f-4a9d-985f-76bcf55a8e38 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:40.480302 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f0c06af7-c81f-4a9d-985f-76bcf55a8e38 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:40.741060 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f0c06af7-c81f-4a9d-985f-76bcf55a8e38 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:46:40.754421 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f0c06af7-c81f-4a9d-985f-76bcf55a8e38 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/1f5100bd-9d74-4990-8b1f-52011ed9d19f" status: 200 len: 1314 microversion: 2.1 time: 0.293415 Oct 30 01:46:40.757200 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2941/5876] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:46:40 2022] GET /compute/v2.1/servers/1f5100bd-9d74-4990-8b1f-52011ed9d19f => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:46:41.781272 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-24d697bc-05d8-4856-a84c-3b1aa88bdc47 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:46:41.782772 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-24d697bc-05d8-4856-a84c-3b1aa88bdc47 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 1f5100bd-9d74-4990-8b1f-52011ed9d19f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:46:41.785055 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:41.797896 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24d697bc-05d8-4856-a84c-3b1aa88bdc47 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:41.798427 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24d697bc-05d8-4856-a84c-3b1aa88bdc47 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:41.798875 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24d697bc-05d8-4856-a84c-3b1aa88bdc47 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:41.799604 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24d697bc-05d8-4856-a84c-3b1aa88bdc47 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:41.800067 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24d697bc-05d8-4856-a84c-3b1aa88bdc47 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:41.800498 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24d697bc-05d8-4856-a84c-3b1aa88bdc47 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:42.121765 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-24d697bc-05d8-4856-a84c-3b1aa88bdc47 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:46:42.147347 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-24d697bc-05d8-4856-a84c-3b1aa88bdc47 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/1f5100bd-9d74-4990-8b1f-52011ed9d19f" status: 200 len: 1314 microversion: 2.1 time: 0.370262 Oct 30 01:46:42.155362 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2936/5877] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:46:41 2022] GET /compute/v2.1/servers/1f5100bd-9d74-4990-8b1f-52011ed9d19f => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:46:43.174024 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b6d7ba53-e8d4-42e5-83cd-a177b6b65492 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:46:43.175326 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b6d7ba53-e8d4-42e5-83cd-a177b6b65492 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 1f5100bd-9d74-4990-8b1f-52011ed9d19f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:46:43.192194 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b6d7ba53-e8d4-42e5-83cd-a177b6b65492 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:43.194257 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b6d7ba53-e8d4-42e5-83cd-a177b6b65492 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:43.195076 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b6d7ba53-e8d4-42e5-83cd-a177b6b65492 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:43.195938 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b6d7ba53-e8d4-42e5-83cd-a177b6b65492 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:43.196490 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b6d7ba53-e8d4-42e5-83cd-a177b6b65492 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:43.197006 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b6d7ba53-e8d4-42e5-83cd-a177b6b65492 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:43.203995 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=81 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:43.531264 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b6d7ba53-e8d4-42e5-83cd-a177b6b65492 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:46:43.544955 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b6d7ba53-e8d4-42e5-83cd-a177b6b65492 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/1f5100bd-9d74-4990-8b1f-52011ed9d19f" status: 200 len: 1314 microversion: 2.1 time: 0.375072 Oct 30 01:46:43.546128 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2942/5878] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:46:43 2022] GET /compute/v2.1/servers/1f5100bd-9d74-4990-8b1f-52011ed9d19f => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:46:44.540295 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-71c0a3be-655a-4aff-907d-f9cde9664888 req-68d9864e-95c7-4a4a-a965-0413ef7e6ac0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f5100bd-9d74-4990-8b1f-52011ed9d19f", "name": "network-vif-plugged", "status": "completed", "tag": "3221ff94-adbf-42f6-a6dc-7d703b7ea10e"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:46:44.554637 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-71c0a3be-655a-4aff-907d-f9cde9664888 req-68d9864e-95c7-4a4a-a965-0413ef7e6ac0 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:44.555133 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-71c0a3be-655a-4aff-907d-f9cde9664888 req-68d9864e-95c7-4a4a-a965-0413ef7e6ac0 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:44.555752 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-71c0a3be-655a-4aff-907d-f9cde9664888 req-68d9864e-95c7-4a4a-a965-0413ef7e6ac0 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:44.570710 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cdb40c38-2b09-4973-aba8-8fbe68997435 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:46:44.571912 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-cdb40c38-2b09-4973-aba8-8fbe68997435 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 1f5100bd-9d74-4990-8b1f-52011ed9d19f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:46:44.585008 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cdb40c38-2b09-4973-aba8-8fbe68997435 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:44.587271 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-71c0a3be-655a-4aff-907d-f9cde9664888 req-68d9864e-95c7-4a4a-a965-0413ef7e6ac0 service nova] Creating event network-vif-plugged:3221ff94-adbf-42f6-a6dc-7d703b7ea10e for instance 1f5100bd-9d74-4990-8b1f-52011ed9d19f on n-h2-master-1 Oct 30 01:46:44.587926 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cdb40c38-2b09-4973-aba8-8fbe68997435 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:44.588445 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cdb40c38-2b09-4973-aba8-8fbe68997435 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:44.590453 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cdb40c38-2b09-4973-aba8-8fbe68997435 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:44.591155 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cdb40c38-2b09-4973-aba8-8fbe68997435 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:44.594694 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cdb40c38-2b09-4973-aba8-8fbe68997435 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:44.600936 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-71c0a3be-655a-4aff-907d-f9cde9664888 req-68d9864e-95c7-4a4a-a965-0413ef7e6ac0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063456 Oct 30 01:46:44.602763 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2937/5879] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:46:44.933232 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-cdb40c38-2b09-4973-aba8-8fbe68997435 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:46:44.941734 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cdb40c38-2b09-4973-aba8-8fbe68997435 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/1f5100bd-9d74-4990-8b1f-52011ed9d19f" status: 200 len: 1314 microversion: 2.1 time: 0.376915 Oct 30 01:46:44.946714 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2943/5880] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:46:44 2022] GET /compute/v2.1/servers/1f5100bd-9d74-4990-8b1f-52011ed9d19f => generated 1314 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:46:45.337011 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7acd60a5-72cf-4e97-aa04-e798c6846f4c tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-851713305", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "9eab2fbd-c86c-4ee7-8ed9-653ec256ad2d"}], "key_name": "tempest-TestSecurityGroupsBasicOps-425939995", "security_groups": []}, "os:scheduler_hints": {"different_host": ["324131f5-3ba0-4222-bb43-a20812dba495"]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:46:45.482826 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-7acd60a5-72cf-4e97-aa04-e798c6846f4c tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] validate_networks() for [('9eab2fbd-c86c-4ee7-8ed9-653ec256ad2d', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:46:45.867264 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=36 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:45.973182 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-af5c16cb-ca6c-4140-8b67-3df42db73ec6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:46:45.979171 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-af5c16cb-ca6c-4140-8b67-3df42db73ec6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 1f5100bd-9d74-4990-8b1f-52011ed9d19f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:46:45.987121 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af5c16cb-ca6c-4140-8b67-3df42db73ec6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:45.988280 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af5c16cb-ca6c-4140-8b67-3df42db73ec6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:45.989118 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af5c16cb-ca6c-4140-8b67-3df42db73ec6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:45.990090 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af5c16cb-ca6c-4140-8b67-3df42db73ec6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:45.991128 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af5c16cb-ca6c-4140-8b67-3df42db73ec6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:45.992189 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af5c16cb-ca6c-4140-8b67-3df42db73ec6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:46.754536 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-af5c16cb-ca6c-4140-8b67-3df42db73ec6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:46:46.769966 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-af5c16cb-ca6c-4140-8b67-3df42db73ec6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/1f5100bd-9d74-4990-8b1f-52011ed9d19f" status: 200 len: 1314 microversion: 2.1 time: 0.803561 Oct 30 01:46:46.786601 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2944/5881] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:46:45 2022] GET /compute/v2.1/servers/1f5100bd-9d74-4990-8b1f-52011ed9d19f => generated 1314 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:46:46.804881 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-7acd60a5-72cf-4e97-aa04-e798c6846f4c tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:46:46.805520 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-7acd60a5-72cf-4e97-aa04-e798c6846f4c tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:46:46.806074 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-7acd60a5-72cf-4e97-aa04-e798c6846f4c tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:46:46.806644 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-7acd60a5-72cf-4e97-aa04-e798c6846f4c tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:46:46.807262 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-7acd60a5-72cf-4e97-aa04-e798c6846f4c tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:46:46.819509 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7acd60a5-72cf-4e97-aa04-e798c6846f4c tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:46.820350 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7acd60a5-72cf-4e97-aa04-e798c6846f4c tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:46.821018 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7acd60a5-72cf-4e97-aa04-e798c6846f4c tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:46.821987 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7acd60a5-72cf-4e97-aa04-e798c6846f4c tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:46.822644 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7acd60a5-72cf-4e97-aa04-e798c6846f4c tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:46.823280 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7acd60a5-72cf-4e97-aa04-e798c6846f4c tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:46.835007 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=68 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:46.847001 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-7acd60a5-72cf-4e97-aa04-e798c6846f4c tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Getting quotas for project 73f4af2d7cc742b98447e28e3c204c11. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:46:46.861225 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-7acd60a5-72cf-4e97-aa04-e798c6846f4c tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Getting quotas for user 9c53d510d75542a283b7f851a58d3dbf and project 73f4af2d7cc742b98447e28e3c204c11. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:46:46.877965 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7acd60a5-72cf-4e97-aa04-e798c6846f4c tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:46:46.883530 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7acd60a5-72cf-4e97-aa04-e798c6846f4c tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] [instance: a5d50e4d-466b-4339-89e3-2cc477f9207f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:46:47.046057 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7acd60a5-72cf-4e97-aa04-e798c6846f4c tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.715278 Oct 30 01:46:47.047322 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2938/5882] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:46:45 2022] POST /compute/v2.1/servers => generated 361 bytes in 1718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:46:47.061650 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-db2188ac-6486-4904-9310-e8d73802f560 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:46:47.062619 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-db2188ac-6486-4904-9310-e8d73802f560 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] [instance: a5d50e4d-466b-4339-89e3-2cc477f9207f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:46:47.186611 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-db2188ac-6486-4904-9310-e8d73802f560 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53d510d75542a283b7f851a58d3dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f4af2d7cc742b98447e28e3c204c11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:46:47.196210 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-db2188ac-6486-4904-9310-e8d73802f560 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d50e4d-466b-4339-89e3-2cc477f9207f" status: 200 len: 1240 microversion: 2.1 time: 0.140861 Oct 30 01:46:47.197598 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2945/5883] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:46:47 2022] GET /compute/v2.1/servers/a5d50e4d-466b-4339-89e3-2cc477f9207f => generated 1240 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:46:47.793933 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3e08f55b-ece5-4cca-aed1-d22cda432883 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:46:47.794838 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3e08f55b-ece5-4cca-aed1-d22cda432883 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 1f5100bd-9d74-4990-8b1f-52011ed9d19f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:46:47.809038 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3e08f55b-ece5-4cca-aed1-d22cda432883 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:47.809687 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3e08f55b-ece5-4cca-aed1-d22cda432883 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:47.810614 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3e08f55b-ece5-4cca-aed1-d22cda432883 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:47.820339 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3e08f55b-ece5-4cca-aed1-d22cda432883 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:47.822825 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3e08f55b-ece5-4cca-aed1-d22cda432883 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:47.823798 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3e08f55b-ece5-4cca-aed1-d22cda432883 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:48.220363 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8d6c7e21-fbb4-4a1e-9acd-73fba770da3e tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:46:48.221035 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8d6c7e21-fbb4-4a1e-9acd-73fba770da3e tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] [instance: a5d50e4d-466b-4339-89e3-2cc477f9207f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:46:48.303460 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3e08f55b-ece5-4cca-aed1-d22cda432883 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:46:48.326618 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3e08f55b-ece5-4cca-aed1-d22cda432883 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/1f5100bd-9d74-4990-8b1f-52011ed9d19f" status: 200 len: 1501 microversion: 2.1 time: 0.536796 Oct 30 01:46:48.327588 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2939/5884] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:46:47 2022] GET /compute/v2.1/servers/1f5100bd-9d74-4990-8b1f-52011ed9d19f => generated 1501 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:46:48.342618 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8d6c7e21-fbb4-4a1e-9acd-73fba770da3e tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53d510d75542a283b7f851a58d3dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f4af2d7cc742b98447e28e3c204c11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:46:48.355933 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f7f46967-10fd-4497-bd6d-7629b410ee9c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:46:48.355933 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f7f46967-10fd-4497-bd6d-7629b410ee9c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 1f5100bd-9d74-4990-8b1f-52011ed9d19f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:46:48.365738 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8d6c7e21-fbb4-4a1e-9acd-73fba770da3e tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d50e4d-466b-4339-89e3-2cc477f9207f" status: 200 len: 1240 microversion: 2.1 time: 0.145648 Oct 30 01:46:48.368744 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f7f46967-10fd-4497-bd6d-7629b410ee9c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:48.369375 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f7f46967-10fd-4497-bd6d-7629b410ee9c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:48.377237 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f7f46967-10fd-4497-bd6d-7629b410ee9c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:48.377237 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f7f46967-10fd-4497-bd6d-7629b410ee9c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:48.377659 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2946/5885] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:46:48 2022] GET /compute/v2.1/servers/a5d50e4d-466b-4339-89e3-2cc477f9207f => generated 1240 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:46:48.377772 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f7f46967-10fd-4497-bd6d-7629b410ee9c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:48.377772 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f7f46967-10fd-4497-bd6d-7629b410ee9c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:48.636355 n-d-master-1 devstack@n-api.service[121102]: INFO nova.network.security_group_api [None req-f7f46967-10fd-4497-bd6d-7629b410ee9c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Removing security group a3514cd5-8749-4f2f-be4b-ff69089384fe from port 3221ff94-adbf-42f6-a6dc-7d703b7ea10e Oct 30 01:46:49.279071 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f7f46967-10fd-4497-bd6d-7629b410ee9c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "POST /compute/v2.1/servers/1f5100bd-9d74-4990-8b1f-52011ed9d19f/action" status: 202 len: 0 microversion: 2.1 time: 0.932318 Oct 30 01:46:49.280595 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2940/5886] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:46:48 2022] POST /compute/v2.1/servers/1f5100bd-9d74-4990-8b1f-52011ed9d19f/action => generated 0 bytes in 935 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 30 01:46:49.289768 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b920acbb-ffda-4b19-a2af-c3b0e9d7d00b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:46:49.290511 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b920acbb-ffda-4b19-a2af-c3b0e9d7d00b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 1f5100bd-9d74-4990-8b1f-52011ed9d19f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:46:49.298899 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-b5054d42-82b3-4e1c-b59f-79001ebb1f23 req-fcd40b0f-a610-4062-bed4-b707c1706ae5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f5100bd-9d74-4990-8b1f-52011ed9d19f", "tag": "3221ff94-adbf-42f6-a6dc-7d703b7ea10e"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:46:49.332734 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b920acbb-ffda-4b19-a2af-c3b0e9d7d00b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:49.332734 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b920acbb-ffda-4b19-a2af-c3b0e9d7d00b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:49.332734 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b920acbb-ffda-4b19-a2af-c3b0e9d7d00b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:49.333457 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b920acbb-ffda-4b19-a2af-c3b0e9d7d00b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:49.334215 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b920acbb-ffda-4b19-a2af-c3b0e9d7d00b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:49.335420 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-b5054d42-82b3-4e1c-b59f-79001ebb1f23 req-fcd40b0f-a610-4062-bed4-b707c1706ae5 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:49.336417 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b920acbb-ffda-4b19-a2af-c3b0e9d7d00b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:49.341352 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-b5054d42-82b3-4e1c-b59f-79001ebb1f23 req-fcd40b0f-a610-4062-bed4-b707c1706ae5 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:49.342108 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-b5054d42-82b3-4e1c-b59f-79001ebb1f23 req-fcd40b0f-a610-4062-bed4-b707c1706ae5 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:49.390154 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-b5054d42-82b3-4e1c-b59f-79001ebb1f23 req-fcd40b0f-a610-4062-bed4-b707c1706ae5 service nova] Creating event network-changed:3221ff94-adbf-42f6-a6dc-7d703b7ea10e for instance 1f5100bd-9d74-4990-8b1f-52011ed9d19f on n-h2-master-1 Oct 30 01:46:49.406601 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-b5054d42-82b3-4e1c-b59f-79001ebb1f23 req-fcd40b0f-a610-4062-bed4-b707c1706ae5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112217 Oct 30 01:46:49.407437 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2941/5887] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:46:49.420001 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1ba29ff2-39ec-4e14-81df-7eef503cffdf tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:46:49.425618 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1ba29ff2-39ec-4e14-81df-7eef503cffdf tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] [instance: a5d50e4d-466b-4339-89e3-2cc477f9207f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:46:49.439910 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ba29ff2-39ec-4e14-81df-7eef503cffdf tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:49.440986 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ba29ff2-39ec-4e14-81df-7eef503cffdf tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:49.441730 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ba29ff2-39ec-4e14-81df-7eef503cffdf tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:49.442906 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ba29ff2-39ec-4e14-81df-7eef503cffdf tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:49.443612 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ba29ff2-39ec-4e14-81df-7eef503cffdf tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:49.444267 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ba29ff2-39ec-4e14-81df-7eef503cffdf tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:49.579607 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1ba29ff2-39ec-4e14-81df-7eef503cffdf tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53d510d75542a283b7f851a58d3dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f4af2d7cc742b98447e28e3c204c11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:46:49.592551 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1ba29ff2-39ec-4e14-81df-7eef503cffdf tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d50e4d-466b-4339-89e3-2cc477f9207f" status: 200 len: 1292 microversion: 2.1 time: 0.183623 Oct 30 01:46:49.594263 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2942/5888] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:46:49 2022] GET /compute/v2.1/servers/a5d50e4d-466b-4339-89e3-2cc477f9207f => generated 1292 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:46:49.604358 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b920acbb-ffda-4b19-a2af-c3b0e9d7d00b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:46:49.617691 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b920acbb-ffda-4b19-a2af-c3b0e9d7d00b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/1f5100bd-9d74-4990-8b1f-52011ed9d19f" status: 200 len: 1459 microversion: 2.1 time: 0.328696 Oct 30 01:46:49.619190 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2947/5889] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:46:49 2022] GET /compute/v2.1/servers/1f5100bd-9d74-4990-8b1f-52011ed9d19f => generated 1459 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:46:49.650162 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e34e413f-9d46-4e8b-b165-4bb658f47465 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:46:49.650477 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e34e413f-9d46-4e8b-b165-4bb658f47465 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:46:49.660497 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e34e413f-9d46-4e8b-b165-4bb658f47465 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:49.660939 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e34e413f-9d46-4e8b-b165-4bb658f47465 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:49.661814 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e34e413f-9d46-4e8b-b165-4bb658f47465 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:49.663242 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e34e413f-9d46-4e8b-b165-4bb658f47465 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:49.663865 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e34e413f-9d46-4e8b-b165-4bb658f47465 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:49.665101 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e34e413f-9d46-4e8b-b165-4bb658f47465 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:50.046482 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e34e413f-9d46-4e8b-b165-4bb658f47465 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:46:50.060610 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e34e413f-9d46-4e8b-b165-4bb658f47465 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1670 microversion: 2.1 time: 0.414370 Oct 30 01:46:50.074098 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2943/5890] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:46:49 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1670 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:46:50.089493 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-072d19d9-832d-43d4-82a3-0bad03775772 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:46:50.090155 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-072d19d9-832d-43d4-82a3-0bad03775772 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:46:50.097282 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-072d19d9-832d-43d4-82a3-0bad03775772 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:50.097880 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-072d19d9-832d-43d4-82a3-0bad03775772 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:50.098340 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-072d19d9-832d-43d4-82a3-0bad03775772 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:50.101511 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-072d19d9-832d-43d4-82a3-0bad03775772 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:50.101511 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-072d19d9-832d-43d4-82a3-0bad03775772 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:50.101511 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-072d19d9-832d-43d4-82a3-0bad03775772 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:50.375495 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-072d19d9-832d-43d4-82a3-0bad03775772 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:46:50.385990 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-072d19d9-832d-43d4-82a3-0bad03775772 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1670 microversion: 2.1 time: 0.300970 Oct 30 01:46:50.398963 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2948/5891] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:46:50 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1670 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:46:50.411398 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c9a8982c-40b1-4060-80b5-807c592728a0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:46:50.412711 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c9a8982c-40b1-4060-80b5-807c592728a0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:46:50.420660 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c9a8982c-40b1-4060-80b5-807c592728a0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:50.421393 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c9a8982c-40b1-4060-80b5-807c592728a0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:50.422177 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c9a8982c-40b1-4060-80b5-807c592728a0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:50.423234 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c9a8982c-40b1-4060-80b5-807c592728a0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:50.423870 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c9a8982c-40b1-4060-80b5-807c592728a0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:50.424460 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c9a8982c-40b1-4060-80b5-807c592728a0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:50.620434 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c9a8982c-40b1-4060-80b5-807c592728a0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:46:50.625653 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9c5ec0b4-b980-4d04-87f3-5fa9997d65bf tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:46:50.626275 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9c5ec0b4-b980-4d04-87f3-5fa9997d65bf tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] [instance: a5d50e4d-466b-4339-89e3-2cc477f9207f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:46:50.627795 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c9a8982c-40b1-4060-80b5-807c592728a0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1670 microversion: 2.1 time: 0.221169 Oct 30 01:46:50.628877 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2944/5892] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:46:50 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1670 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:46:50.638569 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9c5ec0b4-b980-4d04-87f3-5fa9997d65bf tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:50.639205 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9c5ec0b4-b980-4d04-87f3-5fa9997d65bf tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:50.639762 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9c5ec0b4-b980-4d04-87f3-5fa9997d65bf tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:50.640574 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9c5ec0b4-b980-4d04-87f3-5fa9997d65bf tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:50.641301 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9c5ec0b4-b980-4d04-87f3-5fa9997d65bf tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:50.641855 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9c5ec0b4-b980-4d04-87f3-5fa9997d65bf tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:50.650978 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9b09652c-bb6a-43db-92d8-afe7dfc2bc31 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:46:50.658274 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9b09652c-bb6a-43db-92d8-afe7dfc2bc31 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:46:50.658274 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b09652c-bb6a-43db-92d8-afe7dfc2bc31 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:50.658738 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b09652c-bb6a-43db-92d8-afe7dfc2bc31 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:50.659277 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b09652c-bb6a-43db-92d8-afe7dfc2bc31 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:50.660215 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b09652c-bb6a-43db-92d8-afe7dfc2bc31 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:50.661370 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b09652c-bb6a-43db-92d8-afe7dfc2bc31 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:50.662419 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b09652c-bb6a-43db-92d8-afe7dfc2bc31 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:50.785251 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9c5ec0b4-b980-4d04-87f3-5fa9997d65bf tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53d510d75542a283b7f851a58d3dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f4af2d7cc742b98447e28e3c204c11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:46:50.794827 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9c5ec0b4-b980-4d04-87f3-5fa9997d65bf tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d50e4d-466b-4339-89e3-2cc477f9207f" status: 200 len: 1292 microversion: 2.1 time: 0.172998 Oct 30 01:46:50.795671 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2949/5893] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:46:50 2022] GET /compute/v2.1/servers/a5d50e4d-466b-4339-89e3-2cc477f9207f => generated 1292 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:46:51.085932 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9b09652c-bb6a-43db-92d8-afe7dfc2bc31 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:46:51.102551 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9b09652c-bb6a-43db-92d8-afe7dfc2bc31 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1670 microversion: 2.1 time: 0.455441 Oct 30 01:46:51.103190 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2945/5894] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:46:50 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1670 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:46:51.252465 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8ab12ce9-9378-4ca4-873d-f1f941fd04d3 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1610050610", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "c8b5246f-f8f5-404d-864d-b312dbb308c5"}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:46:51.262097 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:51.324965 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-8ab12ce9-9378-4ca4-873d-f1f941fd04d3 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] validate_networks() for [('c8b5246f-f8f5-404d-864d-b312dbb308c5', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:46:51.830100 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fe915ae8-d12c-445b-a480-0c54429cce4f tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:46:51.831403 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fe915ae8-d12c-445b-a480-0c54429cce4f tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] [instance: a5d50e4d-466b-4339-89e3-2cc477f9207f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:46:51.839466 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fe915ae8-d12c-445b-a480-0c54429cce4f tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:51.841385 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fe915ae8-d12c-445b-a480-0c54429cce4f tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:51.841385 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fe915ae8-d12c-445b-a480-0c54429cce4f tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:51.841385 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fe915ae8-d12c-445b-a480-0c54429cce4f tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:51.842226 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fe915ae8-d12c-445b-a480-0c54429cce4f tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:51.842663 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fe915ae8-d12c-445b-a480-0c54429cce4f tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:51.948740 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-fe915ae8-d12c-445b-a480-0c54429cce4f tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53d510d75542a283b7f851a58d3dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f4af2d7cc742b98447e28e3c204c11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:46:51.956589 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fe915ae8-d12c-445b-a480-0c54429cce4f tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d50e4d-466b-4339-89e3-2cc477f9207f" status: 200 len: 1298 microversion: 2.1 time: 0.142359 Oct 30 01:46:51.957250 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2946/5895] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:46:51 2022] GET /compute/v2.1/servers/a5d50e4d-466b-4339-89e3-2cc477f9207f => generated 1298 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:46:51.963343 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-8ab12ce9-9378-4ca4-873d-f1f941fd04d3 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:46:51.963798 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-8ab12ce9-9378-4ca4-873d-f1f941fd04d3 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:46:51.964236 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-8ab12ce9-9378-4ca4-873d-f1f941fd04d3 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:46:51.964646 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-8ab12ce9-9378-4ca4-873d-f1f941fd04d3 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:46:51.965060 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-8ab12ce9-9378-4ca4-873d-f1f941fd04d3 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:46:51.975153 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ab12ce9-9378-4ca4-873d-f1f941fd04d3 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:51.975657 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ab12ce9-9378-4ca4-873d-f1f941fd04d3 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:51.976092 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ab12ce9-9378-4ca4-873d-f1f941fd04d3 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:51.976916 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ab12ce9-9378-4ca4-873d-f1f941fd04d3 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:51.977408 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ab12ce9-9378-4ca4-873d-f1f941fd04d3 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:51.977843 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ab12ce9-9378-4ca4-873d-f1f941fd04d3 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:51.995346 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-8ab12ce9-9378-4ca4-873d-f1f941fd04d3 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Getting quotas for project 9f9d0d541cc3496ebf8dc71af4254506. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:46:52.000913 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-8ab12ce9-9378-4ca4-873d-f1f941fd04d3 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Getting quotas for user 157c0ef579434726810bb3775388b944 and project 9f9d0d541cc3496ebf8dc71af4254506. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:46:52.039410 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8ab12ce9-9378-4ca4-873d-f1f941fd04d3 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:46:52.044096 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8ab12ce9-9378-4ca4-873d-f1f941fd04d3 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: ded1b2fb-9552-4973-bf20-2c590b49e179] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:46:52.195171 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8ab12ce9-9378-4ca4-873d-f1f941fd04d3 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.946873 Oct 30 01:46:52.196002 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2950/5896] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:46:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 948 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:46:52.218062 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8cd5ebe7-622c-4cd9-bcfc-4c2cf08ec7b4 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:46:52.219274 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8cd5ebe7-622c-4cd9-bcfc-4c2cf08ec7b4 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: ded1b2fb-9552-4973-bf20-2c590b49e179] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:46:52.327912 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8cd5ebe7-622c-4cd9-bcfc-4c2cf08ec7b4 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:46:52.337662 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8cd5ebe7-622c-4cd9-bcfc-4c2cf08ec7b4 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179" status: 200 len: 1215 microversion: 2.1 time: 0.133709 Oct 30 01:46:52.338783 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2947/5897] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:46:52 2022] GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179 => generated 1215 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:46:52.983292 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-12927b16-4f0e-4368-824d-349f6d52fa08 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:46:52.983939 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-12927b16-4f0e-4368-824d-349f6d52fa08 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] [instance: a5d50e4d-466b-4339-89e3-2cc477f9207f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:46:53.000241 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-12927b16-4f0e-4368-824d-349f6d52fa08 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:53.000241 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-12927b16-4f0e-4368-824d-349f6d52fa08 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:53.000241 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-12927b16-4f0e-4368-824d-349f6d52fa08 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:53.000241 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-12927b16-4f0e-4368-824d-349f6d52fa08 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:53.000701 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-12927b16-4f0e-4368-824d-349f6d52fa08 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:53.001862 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-12927b16-4f0e-4368-824d-349f6d52fa08 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:53.137526 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-12927b16-4f0e-4368-824d-349f6d52fa08 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53d510d75542a283b7f851a58d3dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f4af2d7cc742b98447e28e3c204c11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:46:53.153256 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-12927b16-4f0e-4368-824d-349f6d52fa08 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d50e4d-466b-4339-89e3-2cc477f9207f" status: 200 len: 1298 microversion: 2.1 time: 0.176088 Oct 30 01:46:53.155291 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2951/5898] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:46:52 2022] GET /compute/v2.1/servers/a5d50e4d-466b-4339-89e3-2cc477f9207f => generated 1298 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:46:53.310939 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-7dee2ea3-8795-4f39-b9aa-1ffee9b391b2 req-704b66c6-ff93-4a85-82fa-39b0f26c506e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5d50e4d-466b-4339-89e3-2cc477f9207f", "tag": "3c43afbf-da1b-4532-93d9-cafa815adfbb"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:46:53.330056 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-7dee2ea3-8795-4f39-b9aa-1ffee9b391b2 req-704b66c6-ff93-4a85-82fa-39b0f26c506e service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:53.345421 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-7dee2ea3-8795-4f39-b9aa-1ffee9b391b2 req-704b66c6-ff93-4a85-82fa-39b0f26c506e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:53.345421 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-7dee2ea3-8795-4f39-b9aa-1ffee9b391b2 req-704b66c6-ff93-4a85-82fa-39b0f26c506e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:53.362993 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-aaa33976-03f4-4864-8dd6-8dd54a99bb77 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:46:53.363751 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-aaa33976-03f4-4864-8dd6-8dd54a99bb77 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: ded1b2fb-9552-4973-bf20-2c590b49e179] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:46:53.380445 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aaa33976-03f4-4864-8dd6-8dd54a99bb77 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:53.383129 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aaa33976-03f4-4864-8dd6-8dd54a99bb77 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:53.386183 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aaa33976-03f4-4864-8dd6-8dd54a99bb77 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:53.389096 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aaa33976-03f4-4864-8dd6-8dd54a99bb77 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:53.389942 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aaa33976-03f4-4864-8dd6-8dd54a99bb77 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:53.390632 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-7dee2ea3-8795-4f39-b9aa-1ffee9b391b2 req-704b66c6-ff93-4a85-82fa-39b0f26c506e service nova] Creating event network-changed:3c43afbf-da1b-4532-93d9-cafa815adfbb for instance a5d50e4d-466b-4339-89e3-2cc477f9207f on n-h1-master-1 Oct 30 01:46:53.391878 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aaa33976-03f4-4864-8dd6-8dd54a99bb77 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:53.406418 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-7dee2ea3-8795-4f39-b9aa-1ffee9b391b2 req-704b66c6-ff93-4a85-82fa-39b0f26c506e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097091 Oct 30 01:46:53.407712 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2948/5899] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:46:53.517749 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-aaa33976-03f4-4864-8dd6-8dd54a99bb77 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:46:53.531060 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-aaa33976-03f4-4864-8dd6-8dd54a99bb77 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179" status: 200 len: 1219 microversion: 2.1 time: 0.172190 Oct 30 01:46:53.531829 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2952/5900] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:46:53 2022] GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179 => generated 1219 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:46:54.179719 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-04032838-1820-4482-a078-4651f0702c06 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:46:54.179719 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-04032838-1820-4482-a078-4651f0702c06 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] [instance: a5d50e4d-466b-4339-89e3-2cc477f9207f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:46:54.187274 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04032838-1820-4482-a078-4651f0702c06 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:54.187997 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04032838-1820-4482-a078-4651f0702c06 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:54.188442 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04032838-1820-4482-a078-4651f0702c06 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:54.189144 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04032838-1820-4482-a078-4651f0702c06 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:54.189621 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04032838-1820-4482-a078-4651f0702c06 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:54.190896 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04032838-1820-4482-a078-4651f0702c06 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:54.385318 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-04032838-1820-4482-a078-4651f0702c06 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53d510d75542a283b7f851a58d3dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f4af2d7cc742b98447e28e3c204c11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:46:54.397970 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-04032838-1820-4482-a078-4651f0702c06 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d50e4d-466b-4339-89e3-2cc477f9207f" status: 200 len: 1298 microversion: 2.1 time: 0.224147 Oct 30 01:46:54.405887 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2949/5901] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:46:54 2022] GET /compute/v2.1/servers/a5d50e4d-466b-4339-89e3-2cc477f9207f => generated 1298 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:46:54.556010 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b779d64d-5f3a-4f22-bdcd-15840e1ba602 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:46:54.556890 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b779d64d-5f3a-4f22-bdcd-15840e1ba602 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: ded1b2fb-9552-4973-bf20-2c590b49e179] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:46:54.565458 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b779d64d-5f3a-4f22-bdcd-15840e1ba602 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:54.566047 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b779d64d-5f3a-4f22-bdcd-15840e1ba602 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:54.566579 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b779d64d-5f3a-4f22-bdcd-15840e1ba602 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:54.567609 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b779d64d-5f3a-4f22-bdcd-15840e1ba602 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:54.568092 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b779d64d-5f3a-4f22-bdcd-15840e1ba602 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:54.568522 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b779d64d-5f3a-4f22-bdcd-15840e1ba602 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:54.655936 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b779d64d-5f3a-4f22-bdcd-15840e1ba602 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:46:54.669835 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b779d64d-5f3a-4f22-bdcd-15840e1ba602 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179" status: 200 len: 1267 microversion: 2.1 time: 0.117605 Oct 30 01:46:54.670949 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2953/5902] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:46:54 2022] GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179 => generated 1267 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:46:55.424984 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f30f6357-47fe-42a4-973b-7ee7be6b74b9 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:46:55.426924 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f30f6357-47fe-42a4-973b-7ee7be6b74b9 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] [instance: a5d50e4d-466b-4339-89e3-2cc477f9207f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:46:55.434579 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f30f6357-47fe-42a4-973b-7ee7be6b74b9 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:55.435345 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f30f6357-47fe-42a4-973b-7ee7be6b74b9 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:55.435786 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f30f6357-47fe-42a4-973b-7ee7be6b74b9 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:55.436503 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f30f6357-47fe-42a4-973b-7ee7be6b74b9 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:55.436959 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f30f6357-47fe-42a4-973b-7ee7be6b74b9 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:55.437599 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f30f6357-47fe-42a4-973b-7ee7be6b74b9 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:55.696381 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-12a34119-a84d-46ec-8f4a-ce92f30fdd48 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:46:55.697929 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-12a34119-a84d-46ec-8f4a-ce92f30fdd48 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: ded1b2fb-9552-4973-bf20-2c590b49e179] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:46:55.699695 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f30f6357-47fe-42a4-973b-7ee7be6b74b9 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53d510d75542a283b7f851a58d3dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f4af2d7cc742b98447e28e3c204c11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:46:55.713962 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f30f6357-47fe-42a4-973b-7ee7be6b74b9 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d50e4d-466b-4339-89e3-2cc477f9207f" status: 200 len: 1298 microversion: 2.1 time: 0.292780 Oct 30 01:46:55.714891 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2950/5903] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:46:55 2022] GET /compute/v2.1/servers/a5d50e4d-466b-4339-89e3-2cc477f9207f => generated 1298 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:46:55.715208 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-12a34119-a84d-46ec-8f4a-ce92f30fdd48 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:55.716565 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-12a34119-a84d-46ec-8f4a-ce92f30fdd48 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:55.719123 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-12a34119-a84d-46ec-8f4a-ce92f30fdd48 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:55.720311 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-12a34119-a84d-46ec-8f4a-ce92f30fdd48 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:55.721645 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-12a34119-a84d-46ec-8f4a-ce92f30fdd48 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:55.723911 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-12a34119-a84d-46ec-8f4a-ce92f30fdd48 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:55.827424 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-12a34119-a84d-46ec-8f4a-ce92f30fdd48 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:46:55.837899 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-12a34119-a84d-46ec-8f4a-ce92f30fdd48 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179" status: 200 len: 1273 microversion: 2.1 time: 0.147201 Oct 30 01:46:55.838968 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2954/5904] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:46:55 2022] GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179 => generated 1273 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:46:56.739551 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ec6e758e-2929-4468-ad09-1c6013779106 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:46:56.741616 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ec6e758e-2929-4468-ad09-1c6013779106 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] [instance: a5d50e4d-466b-4339-89e3-2cc477f9207f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:46:56.752850 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ec6e758e-2929-4468-ad09-1c6013779106 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:56.756020 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ec6e758e-2929-4468-ad09-1c6013779106 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:56.759473 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ec6e758e-2929-4468-ad09-1c6013779106 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:56.759473 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ec6e758e-2929-4468-ad09-1c6013779106 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:56.760816 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ec6e758e-2929-4468-ad09-1c6013779106 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:56.761454 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ec6e758e-2929-4468-ad09-1c6013779106 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:56.835337 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:56.863656 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-13106826-2f32-4e3b-997a-4db6a83ea73f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:46:56.864312 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-13106826-2f32-4e3b-997a-4db6a83ea73f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: ded1b2fb-9552-4973-bf20-2c590b49e179] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:46:56.879869 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-13106826-2f32-4e3b-997a-4db6a83ea73f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:56.892045 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-13106826-2f32-4e3b-997a-4db6a83ea73f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:56.892770 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-13106826-2f32-4e3b-997a-4db6a83ea73f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:56.893730 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-13106826-2f32-4e3b-997a-4db6a83ea73f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:56.894526 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-13106826-2f32-4e3b-997a-4db6a83ea73f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:56.895686 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-13106826-2f32-4e3b-997a-4db6a83ea73f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:57.034684 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ec6e758e-2929-4468-ad09-1c6013779106 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53d510d75542a283b7f851a58d3dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f4af2d7cc742b98447e28e3c204c11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:46:57.044051 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ec6e758e-2929-4468-ad09-1c6013779106 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d50e4d-466b-4339-89e3-2cc477f9207f" status: 200 len: 1298 microversion: 2.1 time: 0.309407 Oct 30 01:46:57.048453 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2951/5905] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:46:56 2022] GET /compute/v2.1/servers/a5d50e4d-466b-4339-89e3-2cc477f9207f => generated 1298 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:46:57.199386 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-13106826-2f32-4e3b-997a-4db6a83ea73f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:46:57.208347 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-13106826-2f32-4e3b-997a-4db6a83ea73f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179" status: 200 len: 1315 microversion: 2.1 time: 0.349319 Oct 30 01:46:57.209016 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2955/5906] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:46:56 2022] GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179 => generated 1315 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:46:57.790947 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-9458fa8a-f584-407f-a490-2733e8d44b1c req-f9ef3713-5ad0-4541-a3e3-3e19ce964ad1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ded1b2fb-9552-4973-bf20-2c590b49e179", "tag": "94a9922b-c61b-418a-981f-f3039568b8ea"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:46:57.821583 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-9458fa8a-f584-407f-a490-2733e8d44b1c req-f9ef3713-5ad0-4541-a3e3-3e19ce964ad1 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:57.822282 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-9458fa8a-f584-407f-a490-2733e8d44b1c req-f9ef3713-5ad0-4541-a3e3-3e19ce964ad1 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:57.822924 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-9458fa8a-f584-407f-a490-2733e8d44b1c req-f9ef3713-5ad0-4541-a3e3-3e19ce964ad1 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:57.857724 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-9458fa8a-f584-407f-a490-2733e8d44b1c req-f9ef3713-5ad0-4541-a3e3-3e19ce964ad1 service nova] Creating event network-changed:94a9922b-c61b-418a-981f-f3039568b8ea for instance ded1b2fb-9552-4973-bf20-2c590b49e179 on n-h2-master-1 Oct 30 01:46:57.868052 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-9458fa8a-f584-407f-a490-2733e8d44b1c req-f9ef3713-5ad0-4541-a3e3-3e19ce964ad1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081183 Oct 30 01:46:57.868797 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2952/5907] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:46:58.068210 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ebda068f-b9bf-42b0-9dd1-b4e397445621 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:46:58.068866 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ebda068f-b9bf-42b0-9dd1-b4e397445621 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] [instance: a5d50e4d-466b-4339-89e3-2cc477f9207f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:46:58.085698 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ebda068f-b9bf-42b0-9dd1-b4e397445621 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:58.086210 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ebda068f-b9bf-42b0-9dd1-b4e397445621 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:58.086649 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ebda068f-b9bf-42b0-9dd1-b4e397445621 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:58.087371 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ebda068f-b9bf-42b0-9dd1-b4e397445621 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:58.087830 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ebda068f-b9bf-42b0-9dd1-b4e397445621 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:58.088257 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ebda068f-b9bf-42b0-9dd1-b4e397445621 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:58.252185 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-66f46837-84b8-4ebe-94c0-906b0136cf55 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:46:58.256764 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-66f46837-84b8-4ebe-94c0-906b0136cf55 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: ded1b2fb-9552-4973-bf20-2c590b49e179] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:46:58.260390 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-66f46837-84b8-4ebe-94c0-906b0136cf55 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:58.261394 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-66f46837-84b8-4ebe-94c0-906b0136cf55 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:58.262233 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-66f46837-84b8-4ebe-94c0-906b0136cf55 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:58.263191 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-66f46837-84b8-4ebe-94c0-906b0136cf55 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:58.263866 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-66f46837-84b8-4ebe-94c0-906b0136cf55 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:58.264484 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-66f46837-84b8-4ebe-94c0-906b0136cf55 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:58.307529 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ebda068f-b9bf-42b0-9dd1-b4e397445621 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53d510d75542a283b7f851a58d3dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f4af2d7cc742b98447e28e3c204c11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:46:58.320301 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ebda068f-b9bf-42b0-9dd1-b4e397445621 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d50e4d-466b-4339-89e3-2cc477f9207f" status: 200 len: 1298 microversion: 2.1 time: 0.256058 Oct 30 01:46:58.338469 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2956/5908] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:46:58 2022] GET /compute/v2.1/servers/a5d50e4d-466b-4339-89e3-2cc477f9207f => generated 1298 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:46:58.726070 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-66f46837-84b8-4ebe-94c0-906b0136cf55 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:46:58.741806 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-66f46837-84b8-4ebe-94c0-906b0136cf55 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179" status: 200 len: 1315 microversion: 2.1 time: 0.509884 Oct 30 01:46:58.759361 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2953/5909] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:46:58 2022] GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179 => generated 1315 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:46:59.345476 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e1618638-9e33-4893-8658-e00fbd7c2826 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:46:59.346010 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e1618638-9e33-4893-8658-e00fbd7c2826 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] [instance: a5d50e4d-466b-4339-89e3-2cc477f9207f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:46:59.354139 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e1618638-9e33-4893-8658-e00fbd7c2826 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:59.359851 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e1618638-9e33-4893-8658-e00fbd7c2826 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:59.359851 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e1618638-9e33-4893-8658-e00fbd7c2826 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:59.359851 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e1618638-9e33-4893-8658-e00fbd7c2826 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:59.359851 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e1618638-9e33-4893-8658-e00fbd7c2826 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:59.359851 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e1618638-9e33-4893-8658-e00fbd7c2826 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:59.442289 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e1618638-9e33-4893-8658-e00fbd7c2826 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53d510d75542a283b7f851a58d3dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f4af2d7cc742b98447e28e3c204c11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:46:59.452052 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e1618638-9e33-4893-8658-e00fbd7c2826 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d50e4d-466b-4339-89e3-2cc477f9207f" status: 200 len: 1298 microversion: 2.1 time: 0.110723 Oct 30 01:46:59.452782 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2957/5910] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:46:59 2022] GET /compute/v2.1/servers/a5d50e4d-466b-4339-89e3-2cc477f9207f => generated 1298 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:46:59.764712 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bfd1883e-9b84-4ceb-b908-c85aa9a16f1c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:46:59.764712 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bfd1883e-9b84-4ceb-b908-c85aa9a16f1c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 9408045e-5de5-45a4-9415-e270fd97dcdd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:46:59.765890 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-75a3d32e-164c-44f1-886e-2dc49e7500c6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:46:59.766521 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-75a3d32e-164c-44f1-886e-2dc49e7500c6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: ded1b2fb-9552-4973-bf20-2c590b49e179] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:46:59.775674 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-75a3d32e-164c-44f1-886e-2dc49e7500c6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:59.776179 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-75a3d32e-164c-44f1-886e-2dc49e7500c6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:59.776623 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-75a3d32e-164c-44f1-886e-2dc49e7500c6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:59.777379 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-75a3d32e-164c-44f1-886e-2dc49e7500c6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:59.777575 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bfd1883e-9b84-4ceb-b908-c85aa9a16f1c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:59.777894 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-75a3d32e-164c-44f1-886e-2dc49e7500c6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:59.778326 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-75a3d32e-164c-44f1-886e-2dc49e7500c6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:59.781513 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bfd1883e-9b84-4ceb-b908-c85aa9a16f1c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:59.782007 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bfd1883e-9b84-4ceb-b908-c85aa9a16f1c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:59.782754 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bfd1883e-9b84-4ceb-b908-c85aa9a16f1c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:59.785199 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bfd1883e-9b84-4ceb-b908-c85aa9a16f1c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:59.786236 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bfd1883e-9b84-4ceb-b908-c85aa9a16f1c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:59.837253 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bfd1883e-9b84-4ceb-b908-c85aa9a16f1c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/9408045e-5de5-45a4-9415-e270fd97dcdd/ips" status: 200 len: 149 microversion: 2.1 time: 0.079012 Oct 30 01:46:59.838498 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2954/5911] 10.222.0.13 () {58 vars in 1248 bytes} [Sun Oct 30 01:46:59 2022] GET /compute/v2.1/servers/9408045e-5de5-45a4-9415-e270fd97dcdd/ips => generated 149 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:46:59.855232 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9a400de4-a190-4d6c-b044-111819ca018b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "59150179-56ff-45d3-8287-e352470fea7d"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:46:59.859271 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9a400de4-a190-4d6c-b044-111819ca018b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 9408045e-5de5-45a4-9415-e270fd97dcdd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:46:59.871888 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9a400de4-a190-4d6c-b044-111819ca018b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:59.873098 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9a400de4-a190-4d6c-b044-111819ca018b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:59.874544 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9a400de4-a190-4d6c-b044-111819ca018b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:46:59.875125 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9a400de4-a190-4d6c-b044-111819ca018b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:46:59.875909 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9a400de4-a190-4d6c-b044-111819ca018b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:46:59.876799 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9a400de4-a190-4d6c-b044-111819ca018b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:00.081303 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-9a400de4-a190-4d6c-b044-111819ca018b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] HTTP exception thrown: Invalid volume: volume 59150179-56ff-45d3-8287-e352470fea7d is already attached to instances: 0671096f-ed83-4341-8f95-d138a9eebffc Oct 30 01:47:00.081303 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9a400de4-a190-4d6c-b044-111819ca018b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Request method failure captured: Oct 30 01:47:00.081303 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/servers/9408045e-5de5-45a4-9415-e270fd97dcdd/os-volume_attachments HTTP/1.1 Oct 30 01:47:00.081303 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:47:00.081303 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:47:00.081303 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:47:00.081303 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 74 Oct 30 01:47:00.081303 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:47:00.081303 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:47:00.081303 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:47:00.081303 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:47:00.081303 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdcRtc4GzHkShMdH9tTupejgTwf3ZNgIcyJqp9yicfp5OD1pJcQPZv1XBaNx7doePOAnkL0JpoIe5_T8iLiz5QjNjR1hpdjjFconMkrxU8FPHulGdRMQx61K_rAf0z9mDPUn9FfJ2msqRaRZPanWCScsW3BEB8X_vbKTz8C4TVCF-Ys Oct 30 01:47:00.081303 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:47:00.081303 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:47:00.081303 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:47:00.081303 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:47:00.081303 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:47:00.081303 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:47:00.081303 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 311cde01e89442f1ab3aa930070b7343 Oct 30 01:47:00.081303 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-AttachVolumeNegativeTest-812748574 Oct 30 01:47:00.081303 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:47:00.081303 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:47:00.081303 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/311cde01e89442f1ab3aa930070b7343"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_311cde01e89442f1ab3aa930070b7343"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/311cde01e89442f1ab3aa930070b7343"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/311cde01e89442f1ab3aa930070b7343"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:47:00.081303 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-AttachVolumeNegativeTest-812748574 Oct 30 01:47:00.081303 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 311cde01e89442f1ab3aa930070b7343 Oct 30 01:47:00.081303 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-812748574 Oct 30 01:47:00.081303 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-AttachVolumeNegativeTest-812748574-project Oct 30 01:47:00.081303 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:47:00.081303 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:47:00.081303 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: dcb021152c684983b31e5db439518921 Oct 30 01:47:00.081303 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-AttachVolumeNegativeTest-812748574-project Oct 30 01:47:00.081303 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:47:00.081303 n-d-master-1 devstack@n-api.service[121102]: {"volumeAttachment": {"volumeId": "59150179-56ff-45d3-8287-e352470fea7d"}} Oct 30 01:47:00.081303 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:47:00.081303 n-d-master-1 devstack@n-api.service[121102]: exception: Invalid volume: volume 59150179-56ff-45d3-8287-e352470fea7d is already attached to instances: 0671096f-ed83-4341-8f95-d138a9eebffc Oct 30 01:47:00.081303 n-d-master-1 devstack@n-api.service[121102]: action_args: {'server_id': '9408045e-5de5-45a4-9415-e270fd97dcdd', 'body': {'volumeAttachment': {'volumeId': '59150179-56ff-45d3-8287-e352470fea7d'}}} Oct 30 01:47:00.081303 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:47:00.081303 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:47:00.081303 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 30 01:47:00.081303 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 30 01:47:00.081303 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 30 01:47:00.081303 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 30 01:47:00.081303 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 30 01:47:00.081303 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 30 01:47:00.081303 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 30 01:47:00.081303 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 30 01:47:00.081303 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 30 01:47:00.081303 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 30 01:47:00.081303 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 59150179-56ff-45d3-8287-e352470fea7d is already attached to instances: 0671096f-ed83-4341-8f95-d138a9eebffc Oct 30 01:47:00.081303 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:47:00.081303 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:47:00.081303 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:47:00.081303 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:47:00.081303 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:47:00.081303 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:47:00.081303 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:47:00.081303 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:47:00.081303 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:47:00.081303 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:47:00.089320 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:47:00.089320 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:47:00.089320 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:47:00.089320 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:47:00.089320 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:47:00.089320 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:47:00.089320 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 30 01:47:00.089320 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 30 01:47:00.089320 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 59150179-56ff-45d3-8287-e352470fea7d is already attached to instances: 0671096f-ed83-4341-8f95-d138a9eebffc Oct 30 01:47:00.089320 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:47:00.089320 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:47:00.089320 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:47:00.089320 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:47:00.089320 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:47:00.089320 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:47:00.089320 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:47:00.089320 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:47:00.089320 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 59150179-56ff-45d3-8287-e352470fea7d is already attached to instances: 0671096f-ed83-4341-8f95-d138a9eebffc Oct 30 01:47:00.089320 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:47:00.089320 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9a400de4-a190-4d6c-b044-111819ca018b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Returning 400 to user: Invalid volume: volume 59150179-56ff-45d3-8287-e352470fea7d is already attached to instances: 0671096f-ed83-4341-8f95-d138a9eebffc {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:47:00.089320 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9a400de4-a190-4d6c-b044-111819ca018b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "POST /compute/v2.1/servers/9408045e-5de5-45a4-9415-e270fd97dcdd/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.196650 Oct 30 01:47:00.089320 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2955/5912] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 30 01:46:59 2022] POST /compute/v2.1/servers/9408045e-5de5-45a4-9415-e270fd97dcdd/os-volume_attachments => generated 174 bytes in 201 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 30 01:47:00.089320 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ef47a6fe-9878-489d-a478-173f0d28f439 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:00.089320 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ef47a6fe-9878-489d-a478-173f0d28f439 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 9408045e-5de5-45a4-9415-e270fd97dcdd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:00.103212 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ef47a6fe-9878-489d-a478-173f0d28f439 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:00.103212 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ef47a6fe-9878-489d-a478-173f0d28f439 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:00.103212 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ef47a6fe-9878-489d-a478-173f0d28f439 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:00.103212 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ef47a6fe-9878-489d-a478-173f0d28f439 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:00.103212 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ef47a6fe-9878-489d-a478-173f0d28f439 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:00.103212 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ef47a6fe-9878-489d-a478-173f0d28f439 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:00.182523 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ef47a6fe-9878-489d-a478-173f0d28f439 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 9408045e-5de5-45a4-9415-e270fd97dcdd] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:47:00.196255 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-75a3d32e-164c-44f1-886e-2dc49e7500c6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:00.201900 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-75a3d32e-164c-44f1-886e-2dc49e7500c6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179" status: 200 len: 1315 microversion: 2.1 time: 0.440078 Oct 30 01:47:00.202512 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2958/5913] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:46:59 2022] GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179 => generated 1315 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:00.357663 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-debc1aea-04d2-4697-b0aa-5599bb1d322d req-4dfc59c1-567e-42e5-a2ed-86d1cfb448e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5d50e4d-466b-4339-89e3-2cc477f9207f", "name": "network-vif-plugged", "status": "completed", "tag": "3c43afbf-da1b-4532-93d9-cafa815adfbb"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:47:00.434514 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-debc1aea-04d2-4697-b0aa-5599bb1d322d req-4dfc59c1-567e-42e5-a2ed-86d1cfb448e5 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:00.434514 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-debc1aea-04d2-4697-b0aa-5599bb1d322d req-4dfc59c1-567e-42e5-a2ed-86d1cfb448e5 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:00.434514 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-debc1aea-04d2-4697-b0aa-5599bb1d322d req-4dfc59c1-567e-42e5-a2ed-86d1cfb448e5 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:00.434514 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-debc1aea-04d2-4697-b0aa-5599bb1d322d req-4dfc59c1-567e-42e5-a2ed-86d1cfb448e5 service nova] Creating event network-vif-plugged:3c43afbf-da1b-4532-93d9-cafa815adfbb for instance a5d50e4d-466b-4339-89e3-2cc477f9207f on n-h1-master-1 Oct 30 01:47:00.434514 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-debc1aea-04d2-4697-b0aa-5599bb1d322d req-4dfc59c1-567e-42e5-a2ed-86d1cfb448e5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065513 Oct 30 01:47:00.434514 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2959/5914] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:47:00.477258 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b8d4cdf4-4a99-4873-a48a-967c13a501d6 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:00.478754 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b8d4cdf4-4a99-4873-a48a-967c13a501d6 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] [instance: a5d50e4d-466b-4339-89e3-2cc477f9207f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:00.495513 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b8d4cdf4-4a99-4873-a48a-967c13a501d6 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:00.496015 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b8d4cdf4-4a99-4873-a48a-967c13a501d6 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:00.496452 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b8d4cdf4-4a99-4873-a48a-967c13a501d6 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:00.497171 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b8d4cdf4-4a99-4873-a48a-967c13a501d6 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:00.497686 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b8d4cdf4-4a99-4873-a48a-967c13a501d6 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:00.498116 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b8d4cdf4-4a99-4873-a48a-967c13a501d6 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:00.671083 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ef47a6fe-9878-489d-a478-173f0d28f439 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9408045e-5de5-45a4-9415-e270fd97dcdd" status: 204 len: 0 microversion: 2.1 time: 0.621974 Oct 30 01:47:00.671683 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2956/5915] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:47:00 2022] DELETE /compute/v2.1/servers/9408045e-5de5-45a4-9415-e270fd97dcdd => generated 0 bytes in 623 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:47:00.681537 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-18d355c7-f2d3-4c9e-a8a5-2267505fc949 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:00.682800 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-18d355c7-f2d3-4c9e-a8a5-2267505fc949 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 9408045e-5de5-45a4-9415-e270fd97dcdd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:00.709289 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-18d355c7-f2d3-4c9e-a8a5-2267505fc949 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:00.712651 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-18d355c7-f2d3-4c9e-a8a5-2267505fc949 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:00.713121 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-18d355c7-f2d3-4c9e-a8a5-2267505fc949 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:00.713895 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-18d355c7-f2d3-4c9e-a8a5-2267505fc949 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:00.714357 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-18d355c7-f2d3-4c9e-a8a5-2267505fc949 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:00.714785 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-18d355c7-f2d3-4c9e-a8a5-2267505fc949 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:00.737886 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b8d4cdf4-4a99-4873-a48a-967c13a501d6 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53d510d75542a283b7f851a58d3dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f4af2d7cc742b98447e28e3c204c11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:00.752771 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b8d4cdf4-4a99-4873-a48a-967c13a501d6 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d50e4d-466b-4339-89e3-2cc477f9207f" status: 200 len: 1298 microversion: 2.1 time: 0.276910 Oct 30 01:47:00.754133 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2960/5916] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:00 2022] GET /compute/v2.1/servers/a5d50e4d-466b-4339-89e3-2cc477f9207f => generated 1298 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:00.766385 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:47:00.987227 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-18d355c7-f2d3-4c9e-a8a5-2267505fc949 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:00.999295 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-18d355c7-f2d3-4c9e-a8a5-2267505fc949 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/9408045e-5de5-45a4-9415-e270fd97dcdd" status: 200 len: 1681 microversion: 2.1 time: 0.322257 Oct 30 01:47:01.000774 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2957/5917] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:00 2022] GET /compute/v2.1/servers/9408045e-5de5-45a4-9415-e270fd97dcdd => generated 1681 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:01.236705 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-94049b18-e483-4034-b3c3-492795f1ed8b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:01.240002 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-94049b18-e483-4034-b3c3-492795f1ed8b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: ded1b2fb-9552-4973-bf20-2c590b49e179] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:01.249689 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94049b18-e483-4034-b3c3-492795f1ed8b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:01.251648 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94049b18-e483-4034-b3c3-492795f1ed8b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:01.256402 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94049b18-e483-4034-b3c3-492795f1ed8b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:01.257624 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94049b18-e483-4034-b3c3-492795f1ed8b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:01.258278 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94049b18-e483-4034-b3c3-492795f1ed8b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:01.258907 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94049b18-e483-4034-b3c3-492795f1ed8b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:01.450492 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-94049b18-e483-4034-b3c3-492795f1ed8b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:01.459447 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-94049b18-e483-4034-b3c3-492795f1ed8b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179" status: 200 len: 1315 microversion: 2.1 time: 0.229098 Oct 30 01:47:01.474463 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2961/5918] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:01 2022] GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179 => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:01.779419 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d4198e74-82f5-4e43-9ff6-ab15b41d73cc tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:01.780805 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d4198e74-82f5-4e43-9ff6-ab15b41d73cc tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] [instance: a5d50e4d-466b-4339-89e3-2cc477f9207f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:01.788768 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4198e74-82f5-4e43-9ff6-ab15b41d73cc tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:01.789259 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4198e74-82f5-4e43-9ff6-ab15b41d73cc tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:01.789724 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4198e74-82f5-4e43-9ff6-ab15b41d73cc tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:01.790464 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4198e74-82f5-4e43-9ff6-ab15b41d73cc tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:01.790925 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4198e74-82f5-4e43-9ff6-ab15b41d73cc tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:01.791354 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4198e74-82f5-4e43-9ff6-ab15b41d73cc tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:01.959989 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d4198e74-82f5-4e43-9ff6-ab15b41d73cc tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53d510d75542a283b7f851a58d3dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f4af2d7cc742b98447e28e3c204c11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:01.970854 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d4198e74-82f5-4e43-9ff6-ab15b41d73cc tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d50e4d-466b-4339-89e3-2cc477f9207f" status: 200 len: 1298 microversion: 2.1 time: 0.196141 Oct 30 01:47:01.971792 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2958/5919] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:01 2022] GET /compute/v2.1/servers/a5d50e4d-466b-4339-89e3-2cc477f9207f => generated 1298 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:02.024959 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4738d33b-f31f-4f27-bd93-9e55b63212cd tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:02.025616 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4738d33b-f31f-4f27-bd93-9e55b63212cd tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 9408045e-5de5-45a4-9415-e270fd97dcdd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:02.027873 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:47:02.028766 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=10 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:47:02.038608 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4738d33b-f31f-4f27-bd93-9e55b63212cd tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:02.042999 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4738d33b-f31f-4f27-bd93-9e55b63212cd tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:02.043460 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4738d33b-f31f-4f27-bd93-9e55b63212cd tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:02.044207 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4738d33b-f31f-4f27-bd93-9e55b63212cd tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:02.044669 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4738d33b-f31f-4f27-bd93-9e55b63212cd tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:02.046960 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4738d33b-f31f-4f27-bd93-9e55b63212cd tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:02.050209 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=100 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:47:02.302357 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4738d33b-f31f-4f27-bd93-9e55b63212cd tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:02.321118 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4738d33b-f31f-4f27-bd93-9e55b63212cd tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/9408045e-5de5-45a4-9415-e270fd97dcdd" status: 200 len: 1681 microversion: 2.1 time: 0.299915 Oct 30 01:47:02.321913 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2962/5920] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:02 2022] GET /compute/v2.1/servers/9408045e-5de5-45a4-9415-e270fd97dcdd => generated 1681 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:02.486018 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-758f1b42-3706-45c6-b378-a578e14ed752 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:02.486798 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-758f1b42-3706-45c6-b378-a578e14ed752 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: ded1b2fb-9552-4973-bf20-2c590b49e179] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:02.492340 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=8 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:47:02.502492 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-758f1b42-3706-45c6-b378-a578e14ed752 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:02.503063 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-758f1b42-3706-45c6-b378-a578e14ed752 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:02.503621 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-758f1b42-3706-45c6-b378-a578e14ed752 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:02.504930 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-758f1b42-3706-45c6-b378-a578e14ed752 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:02.505441 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-758f1b42-3706-45c6-b378-a578e14ed752 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:02.508091 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-758f1b42-3706-45c6-b378-a578e14ed752 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:02.823420 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-758f1b42-3706-45c6-b378-a578e14ed752 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:02.855655 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-758f1b42-3706-45c6-b378-a578e14ed752 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179" status: 200 len: 1315 microversion: 2.1 time: 0.375625 Oct 30 01:47:02.856453 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2959/5921] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:02 2022] GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179 => generated 1315 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:03.000446 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0af5aee0-c47a-4ba5-a836-c7fbb2b3521a tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:03.001683 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0af5aee0-c47a-4ba5-a836-c7fbb2b3521a tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] [instance: a5d50e4d-466b-4339-89e3-2cc477f9207f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:03.012321 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0af5aee0-c47a-4ba5-a836-c7fbb2b3521a tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:03.012835 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0af5aee0-c47a-4ba5-a836-c7fbb2b3521a tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:03.013542 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0af5aee0-c47a-4ba5-a836-c7fbb2b3521a tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:03.014439 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0af5aee0-c47a-4ba5-a836-c7fbb2b3521a tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:03.015901 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0af5aee0-c47a-4ba5-a836-c7fbb2b3521a tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:03.017791 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0af5aee0-c47a-4ba5-a836-c7fbb2b3521a tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:03.273197 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0af5aee0-c47a-4ba5-a836-c7fbb2b3521a tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53d510d75542a283b7f851a58d3dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f4af2d7cc742b98447e28e3c204c11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:03.284087 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0af5aee0-c47a-4ba5-a836-c7fbb2b3521a tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d50e4d-466b-4339-89e3-2cc477f9207f" status: 200 len: 1298 microversion: 2.1 time: 0.287596 Oct 30 01:47:03.288514 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2963/5922] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:02 2022] GET /compute/v2.1/servers/a5d50e4d-466b-4339-89e3-2cc477f9207f => generated 1298 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:03.353066 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-419c7be4-dd94-40d2-a188-bf05c927cda6 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:03.354234 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-419c7be4-dd94-40d2-a188-bf05c927cda6 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 9408045e-5de5-45a4-9415-e270fd97dcdd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:03.362207 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-419c7be4-dd94-40d2-a188-bf05c927cda6 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:03.363063 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-419c7be4-dd94-40d2-a188-bf05c927cda6 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:03.363774 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-419c7be4-dd94-40d2-a188-bf05c927cda6 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:03.364932 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-419c7be4-dd94-40d2-a188-bf05c927cda6 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:03.365694 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-419c7be4-dd94-40d2-a188-bf05c927cda6 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:03.366357 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-419c7be4-dd94-40d2-a188-bf05c927cda6 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:03.683465 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-419c7be4-dd94-40d2-a188-bf05c927cda6 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:03.696103 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-419c7be4-dd94-40d2-a188-bf05c927cda6 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/9408045e-5de5-45a4-9415-e270fd97dcdd" status: 200 len: 1681 microversion: 2.1 time: 0.346041 Oct 30 01:47:03.698656 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2960/5923] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:03 2022] GET /compute/v2.1/servers/9408045e-5de5-45a4-9415-e270fd97dcdd => generated 1681 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:03.886211 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ff63bf44-908a-4ca3-a0ea-96cf9a7247e0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:03.887473 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ff63bf44-908a-4ca3-a0ea-96cf9a7247e0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: ded1b2fb-9552-4973-bf20-2c590b49e179] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:03.902331 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ff63bf44-908a-4ca3-a0ea-96cf9a7247e0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:03.904489 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ff63bf44-908a-4ca3-a0ea-96cf9a7247e0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:03.905247 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ff63bf44-908a-4ca3-a0ea-96cf9a7247e0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:03.906256 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ff63bf44-908a-4ca3-a0ea-96cf9a7247e0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:03.906974 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ff63bf44-908a-4ca3-a0ea-96cf9a7247e0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:03.907627 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ff63bf44-908a-4ca3-a0ea-96cf9a7247e0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:04.152983 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ff63bf44-908a-4ca3-a0ea-96cf9a7247e0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:04.163858 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ff63bf44-908a-4ca3-a0ea-96cf9a7247e0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179" status: 200 len: 1315 microversion: 2.1 time: 0.283176 Oct 30 01:47:04.174901 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2964/5924] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:03 2022] GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179 => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:04.309484 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2734aeba-c196-46f9-b4f2-22e60411042f tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:04.310754 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2734aeba-c196-46f9-b4f2-22e60411042f tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] [instance: a5d50e4d-466b-4339-89e3-2cc477f9207f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:04.319880 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2734aeba-c196-46f9-b4f2-22e60411042f tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:04.323671 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2734aeba-c196-46f9-b4f2-22e60411042f tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:04.326631 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2734aeba-c196-46f9-b4f2-22e60411042f tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:04.327587 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2734aeba-c196-46f9-b4f2-22e60411042f tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:04.328211 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2734aeba-c196-46f9-b4f2-22e60411042f tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:04.330329 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2734aeba-c196-46f9-b4f2-22e60411042f tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:04.540815 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-f8ceffc7-b07d-48f3-bc13-8237a9bbb735 req-a9f4827b-fac1-421a-895f-20a3b6095f89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9408045e-5de5-45a4-9415-e270fd97dcdd", "name": "network-vif-deleted", "tag": "98b4cf11-4409-43bf-8622-dc9452f865cb"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:47:04.560553 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-f8ceffc7-b07d-48f3-bc13-8237a9bbb735 req-a9f4827b-fac1-421a-895f-20a3b6095f89 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:04.561049 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-f8ceffc7-b07d-48f3-bc13-8237a9bbb735 req-a9f4827b-fac1-421a-895f-20a3b6095f89 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:04.563013 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-f8ceffc7-b07d-48f3-bc13-8237a9bbb735 req-a9f4827b-fac1-421a-895f-20a3b6095f89 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:04.564745 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2734aeba-c196-46f9-b4f2-22e60411042f tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53d510d75542a283b7f851a58d3dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f4af2d7cc742b98447e28e3c204c11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:04.574434 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2734aeba-c196-46f9-b4f2-22e60411042f tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d50e4d-466b-4339-89e3-2cc477f9207f" status: 200 len: 1471 microversion: 2.1 time: 0.270025 Oct 30 01:47:04.585846 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2961/5925] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:04 2022] GET /compute/v2.1/servers/a5d50e4d-466b-4339-89e3-2cc477f9207f => generated 1471 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:04.586455 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-f8ceffc7-b07d-48f3-bc13-8237a9bbb735 req-a9f4827b-fac1-421a-895f-20a3b6095f89 service nova] Creating event network-vif-deleted:98b4cf11-4409-43bf-8622-dc9452f865cb for instance 9408045e-5de5-45a4-9415-e270fd97dcdd on n-h1-master-1 Oct 30 01:47:04.596907 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-f8ceffc7-b07d-48f3-bc13-8237a9bbb735 req-a9f4827b-fac1-421a-895f-20a3b6095f89 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059907 Oct 30 01:47:04.598857 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2965/5926] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:47:04.599002 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-34fbb1df-2d8d-40b9-9b59-3159f61ad866 req-2e8cdab0-8b91-4f20-b137-345745ca56df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ded1b2fb-9552-4973-bf20-2c590b49e179", "name": "network-vif-plugged", "status": "completed", "tag": "94a9922b-c61b-418a-981f-f3039568b8ea"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:47:04.615042 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-894d6ab2-99e5-4f71-a15f-09ad51ee359b tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:04.616187 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-894d6ab2-99e5-4f71-a15f-09ad51ee359b tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] [instance: a5d50e4d-466b-4339-89e3-2cc477f9207f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:04.632991 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-34fbb1df-2d8d-40b9-9b59-3159f61ad866 req-2e8cdab0-8b91-4f20-b137-345745ca56df service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:04.633680 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-34fbb1df-2d8d-40b9-9b59-3159f61ad866 req-2e8cdab0-8b91-4f20-b137-345745ca56df service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:04.634139 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-34fbb1df-2d8d-40b9-9b59-3159f61ad866 req-2e8cdab0-8b91-4f20-b137-345745ca56df service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:04.635435 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-894d6ab2-99e5-4f71-a15f-09ad51ee359b tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:04.637519 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-894d6ab2-99e5-4f71-a15f-09ad51ee359b tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:04.639763 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-894d6ab2-99e5-4f71-a15f-09ad51ee359b tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:04.641911 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-894d6ab2-99e5-4f71-a15f-09ad51ee359b tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:04.647443 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-894d6ab2-99e5-4f71-a15f-09ad51ee359b tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:04.648185 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-894d6ab2-99e5-4f71-a15f-09ad51ee359b tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:04.660080 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-34fbb1df-2d8d-40b9-9b59-3159f61ad866 req-2e8cdab0-8b91-4f20-b137-345745ca56df service nova] Creating event network-vif-plugged:94a9922b-c61b-418a-981f-f3039568b8ea for instance ded1b2fb-9552-4973-bf20-2c590b49e179 on n-h2-master-1 Oct 30 01:47:04.670312 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-34fbb1df-2d8d-40b9-9b59-3159f61ad866 req-2e8cdab0-8b91-4f20-b137-345745ca56df service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082618 Oct 30 01:47:04.673712 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2962/5927] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:47:04.721284 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-69f9a8d5-aac0-4ab7-ad3f-830e90697772 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:04.722209 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-69f9a8d5-aac0-4ab7-ad3f-830e90697772 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 9408045e-5de5-45a4-9415-e270fd97dcdd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:04.743918 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-69f9a8d5-aac0-4ab7-ad3f-830e90697772 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:04.744435 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-69f9a8d5-aac0-4ab7-ad3f-830e90697772 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:04.744888 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-69f9a8d5-aac0-4ab7-ad3f-830e90697772 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:04.745648 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-69f9a8d5-aac0-4ab7-ad3f-830e90697772 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:04.746115 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-69f9a8d5-aac0-4ab7-ad3f-830e90697772 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:04.746554 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-69f9a8d5-aac0-4ab7-ad3f-830e90697772 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:04.871828 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-894d6ab2-99e5-4f71-a15f-09ad51ee359b tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53d510d75542a283b7f851a58d3dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f4af2d7cc742b98447e28e3c204c11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:04.882129 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-894d6ab2-99e5-4f71-a15f-09ad51ee359b tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d50e4d-466b-4339-89e3-2cc477f9207f" status: 200 len: 1471 microversion: 2.1 time: 0.274597 Oct 30 01:47:04.883815 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2966/5928] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:04 2022] GET /compute/v2.1/servers/a5d50e4d-466b-4339-89e3-2cc477f9207f => generated 1471 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:47:04.912665 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8fae9837-7e25-4cec-8950-f6d01019ed64 tempest-TestSecurityGroupsBasicOps-49535370 tempest-TestSecurityGroupsBasicOps-49535370-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:04.915584 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8fae9837-7e25-4cec-8950-f6d01019ed64 tempest-TestSecurityGroupsBasicOps-49535370 tempest-TestSecurityGroupsBasicOps-49535370-project-admin] [instance: a5d50e4d-466b-4339-89e3-2cc477f9207f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:04.925768 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8fae9837-7e25-4cec-8950-f6d01019ed64 tempest-TestSecurityGroupsBasicOps-49535370 tempest-TestSecurityGroupsBasicOps-49535370-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:04.928828 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8fae9837-7e25-4cec-8950-f6d01019ed64 tempest-TestSecurityGroupsBasicOps-49535370 tempest-TestSecurityGroupsBasicOps-49535370-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:04.931510 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8fae9837-7e25-4cec-8950-f6d01019ed64 tempest-TestSecurityGroupsBasicOps-49535370 tempest-TestSecurityGroupsBasicOps-49535370-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:04.934766 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8fae9837-7e25-4cec-8950-f6d01019ed64 tempest-TestSecurityGroupsBasicOps-49535370 tempest-TestSecurityGroupsBasicOps-49535370-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:04.937659 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8fae9837-7e25-4cec-8950-f6d01019ed64 tempest-TestSecurityGroupsBasicOps-49535370 tempest-TestSecurityGroupsBasicOps-49535370-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:04.938882 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8fae9837-7e25-4cec-8950-f6d01019ed64 tempest-TestSecurityGroupsBasicOps-49535370 tempest-TestSecurityGroupsBasicOps-49535370-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:04.985202 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-69f9a8d5-aac0-4ab7-ad3f-830e90697772 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:05.032747 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-69f9a8d5-aac0-4ab7-ad3f-830e90697772 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/9408045e-5de5-45a4-9415-e270fd97dcdd" status: 200 len: 1327 microversion: 2.1 time: 0.315440 Oct 30 01:47:05.059833 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2963/5929] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:04 2022] GET /compute/v2.1/servers/9408045e-5de5-45a4-9415-e270fd97dcdd => generated 1327 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:05.101919 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8fae9837-7e25-4cec-8950-f6d01019ed64 tempest-TestSecurityGroupsBasicOps-49535370 tempest-TestSecurityGroupsBasicOps-49535370-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/a5d50e4d-466b-4339-89e3-2cc477f9207f" status: 200 len: 1622 microversion: 2.1 time: 0.197390 Oct 30 01:47:05.102539 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2967/5930] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:04 2022] GET /compute/v2.1/servers/a5d50e4d-466b-4339-89e3-2cc477f9207f => generated 1622 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:47:05.129706 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-93366981-b01e-41bb-a439-a60e022c45ae tempest-TestSecurityGroupsBasicOps-49535370 tempest-TestSecurityGroupsBasicOps-49535370-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:05.132066 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-93366981-b01e-41bb-a439-a60e022c45ae tempest-TestSecurityGroupsBasicOps-49535370 tempest-TestSecurityGroupsBasicOps-49535370-project-admin] [instance: 324131f5-3ba0-4222-bb43-a20812dba495] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:05.140229 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-93366981-b01e-41bb-a439-a60e022c45ae tempest-TestSecurityGroupsBasicOps-49535370 tempest-TestSecurityGroupsBasicOps-49535370-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:05.140804 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-93366981-b01e-41bb-a439-a60e022c45ae tempest-TestSecurityGroupsBasicOps-49535370 tempest-TestSecurityGroupsBasicOps-49535370-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:05.141252 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-93366981-b01e-41bb-a439-a60e022c45ae tempest-TestSecurityGroupsBasicOps-49535370 tempest-TestSecurityGroupsBasicOps-49535370-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:05.141990 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-93366981-b01e-41bb-a439-a60e022c45ae tempest-TestSecurityGroupsBasicOps-49535370 tempest-TestSecurityGroupsBasicOps-49535370-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:05.142509 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-93366981-b01e-41bb-a439-a60e022c45ae tempest-TestSecurityGroupsBasicOps-49535370 tempest-TestSecurityGroupsBasicOps-49535370-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:05.143063 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-93366981-b01e-41bb-a439-a60e022c45ae tempest-TestSecurityGroupsBasicOps-49535370 tempest-TestSecurityGroupsBasicOps-49535370-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:05.188614 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5ec06075-c24c-4ba7-9a3a-3395a8659865 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:05.189257 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5ec06075-c24c-4ba7-9a3a-3395a8659865 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: ded1b2fb-9552-4973-bf20-2c590b49e179] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:05.240818 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ec06075-c24c-4ba7-9a3a-3395a8659865 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:05.244725 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ec06075-c24c-4ba7-9a3a-3395a8659865 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:05.246099 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ec06075-c24c-4ba7-9a3a-3395a8659865 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:05.250638 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ec06075-c24c-4ba7-9a3a-3395a8659865 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:05.251139 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ec06075-c24c-4ba7-9a3a-3395a8659865 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:05.258266 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ec06075-c24c-4ba7-9a3a-3395a8659865 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:05.426263 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-93366981-b01e-41bb-a439-a60e022c45ae tempest-TestSecurityGroupsBasicOps-49535370 tempest-TestSecurityGroupsBasicOps-49535370-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/324131f5-3ba0-4222-bb43-a20812dba495" status: 200 len: 1910 microversion: 2.1 time: 0.296286 Oct 30 01:47:05.426263 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2964/5931] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:05 2022] GET /compute/v2.1/servers/324131f5-3ba0-4222-bb43-a20812dba495 => generated 1910 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:05.494405 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5ec06075-c24c-4ba7-9a3a-3395a8659865 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:05.503961 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5ec06075-c24c-4ba7-9a3a-3395a8659865 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179" status: 200 len: 1315 microversion: 2.1 time: 0.319919 Oct 30 01:47:05.518680 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2968/5932] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:05 2022] GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179 => generated 1315 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:47:05.541754 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-26122b16-22b7-4aa5-a7a1-d97c171c6a49 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:05.542575 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-26122b16-22b7-4aa5-a7a1-d97c171c6a49 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] [instance: a5d50e4d-466b-4339-89e3-2cc477f9207f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:05.549176 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-26122b16-22b7-4aa5-a7a1-d97c171c6a49 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:05.553655 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-26122b16-22b7-4aa5-a7a1-d97c171c6a49 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:05.553655 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-26122b16-22b7-4aa5-a7a1-d97c171c6a49 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:05.553655 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-26122b16-22b7-4aa5-a7a1-d97c171c6a49 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:05.553655 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-26122b16-22b7-4aa5-a7a1-d97c171c6a49 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:05.553655 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-26122b16-22b7-4aa5-a7a1-d97c171c6a49 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:05.596013 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-26122b16-22b7-4aa5-a7a1-d97c171c6a49 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] [instance: a5d50e4d-466b-4339-89e3-2cc477f9207f] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:47:06.020697 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-26122b16-22b7-4aa5-a7a1-d97c171c6a49 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a5d50e4d-466b-4339-89e3-2cc477f9207f" status: 204 len: 0 microversion: 2.1 time: 0.482283 Oct 30 01:47:06.021717 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2965/5933] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:47:05 2022] DELETE /compute/v2.1/servers/a5d50e4d-466b-4339-89e3-2cc477f9207f => generated 0 bytes in 485 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 30 01:47:06.030314 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2353570a-05b1-4d51-bea5-99e67a065a38 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:06.030948 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2353570a-05b1-4d51-bea5-99e67a065a38 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] [instance: a5d50e4d-466b-4339-89e3-2cc477f9207f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:06.043281 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2353570a-05b1-4d51-bea5-99e67a065a38 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:06.043994 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2353570a-05b1-4d51-bea5-99e67a065a38 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:06.044476 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2353570a-05b1-4d51-bea5-99e67a065a38 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:06.046142 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2353570a-05b1-4d51-bea5-99e67a065a38 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:06.046858 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2353570a-05b1-4d51-bea5-99e67a065a38 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:06.047503 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2353570a-05b1-4d51-bea5-99e67a065a38 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:06.076191 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b4ecf9d7-9447-4bf7-8264-437fed4d079a tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:06.080539 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b4ecf9d7-9447-4bf7-8264-437fed4d079a tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 9408045e-5de5-45a4-9415-e270fd97dcdd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:06.106607 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b4ecf9d7-9447-4bf7-8264-437fed4d079a tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:06.107549 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b4ecf9d7-9447-4bf7-8264-437fed4d079a tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:06.109624 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b4ecf9d7-9447-4bf7-8264-437fed4d079a tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:06.111436 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b4ecf9d7-9447-4bf7-8264-437fed4d079a tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:06.112193 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b4ecf9d7-9447-4bf7-8264-437fed4d079a tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:06.113018 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b4ecf9d7-9447-4bf7-8264-437fed4d079a tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:06.197785 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b4ecf9d7-9447-4bf7-8264-437fed4d079a tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:06.198776 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b4ecf9d7-9447-4bf7-8264-437fed4d079a tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:06.199811 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b4ecf9d7-9447-4bf7-8264-437fed4d079a tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:06.201234 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-b4ecf9d7-9447-4bf7-8264-437fed4d079a tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lazy-loading 'fault' on Instance uuid 9408045e-5de5-45a4-9415-e270fd97dcdd {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:47:06.206314 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2353570a-05b1-4d51-bea5-99e67a065a38 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53d510d75542a283b7f851a58d3dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f4af2d7cc742b98447e28e3c204c11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:06.221966 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2353570a-05b1-4d51-bea5-99e67a065a38 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d50e4d-466b-4339-89e3-2cc477f9207f" status: 200 len: 1477 microversion: 2.1 time: 0.195600 Oct 30 01:47:06.246088 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2969/5934] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:06 2022] GET /compute/v2.1/servers/a5d50e4d-466b-4339-89e3-2cc477f9207f => generated 1477 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:06.299221 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b4ecf9d7-9447-4bf7-8264-437fed4d079a tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:06.309388 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b4ecf9d7-9447-4bf7-8264-437fed4d079a tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/9408045e-5de5-45a4-9415-e270fd97dcdd" status: 200 len: 1332 microversion: 2.1 time: 0.248701 Oct 30 01:47:06.310219 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2966/5935] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:06 2022] GET /compute/v2.1/servers/9408045e-5de5-45a4-9415-e270fd97dcdd => generated 1332 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:47:06.534200 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-963805a7-c6bb-4c65-88b1-3318d261c6b6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:06.534755 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-963805a7-c6bb-4c65-88b1-3318d261c6b6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: ded1b2fb-9552-4973-bf20-2c590b49e179] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:06.544104 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-963805a7-c6bb-4c65-88b1-3318d261c6b6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:06.545655 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-963805a7-c6bb-4c65-88b1-3318d261c6b6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:06.548500 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-963805a7-c6bb-4c65-88b1-3318d261c6b6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:06.549473 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-963805a7-c6bb-4c65-88b1-3318d261c6b6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:06.550642 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-963805a7-c6bb-4c65-88b1-3318d261c6b6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:06.551241 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-963805a7-c6bb-4c65-88b1-3318d261c6b6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:06.700717 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-963805a7-c6bb-4c65-88b1-3318d261c6b6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:06.709182 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-963805a7-c6bb-4c65-88b1-3318d261c6b6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179" status: 200 len: 1503 microversion: 2.1 time: 0.179909 Oct 30 01:47:06.710324 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2970/5936] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:06 2022] GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179 => generated 1503 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:06.739493 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3adde0f7-5c6f-4342-ab04-508aa5deb42a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:47:06.740109 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3adde0f7-5c6f-4342-ab04-508aa5deb42a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: ded1b2fb-9552-4973-bf20-2c590b49e179] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:06.746484 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3adde0f7-5c6f-4342-ab04-508aa5deb42a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:06.747033 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3adde0f7-5c6f-4342-ab04-508aa5deb42a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:06.747473 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3adde0f7-5c6f-4342-ab04-508aa5deb42a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:06.748179 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3adde0f7-5c6f-4342-ab04-508aa5deb42a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:06.748829 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3adde0f7-5c6f-4342-ab04-508aa5deb42a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:06.749455 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3adde0f7-5c6f-4342-ab04-508aa5deb42a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:07.046144 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3adde0f7-5c6f-4342-ab04-508aa5deb42a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "POST /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179/action" status: 202 len: 0 microversion: 2.1 time: 0.310637 Oct 30 01:47:07.047104 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2967/5937] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:47:06 2022] POST /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:47:07.057776 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b525e24e-9bf6-43b4-85ac-f3eb8f3aff62 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:07.058814 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b525e24e-9bf6-43b4-85ac-f3eb8f3aff62 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: ded1b2fb-9552-4973-bf20-2c590b49e179] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:07.067276 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b525e24e-9bf6-43b4-85ac-f3eb8f3aff62 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:07.068060 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b525e24e-9bf6-43b4-85ac-f3eb8f3aff62 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:07.068500 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b525e24e-9bf6-43b4-85ac-f3eb8f3aff62 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:07.069439 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b525e24e-9bf6-43b4-85ac-f3eb8f3aff62 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:07.070091 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b525e24e-9bf6-43b4-85ac-f3eb8f3aff62 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:07.070508 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b525e24e-9bf6-43b4-85ac-f3eb8f3aff62 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:07.250446 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a02251e2-4b82-4746-9ac8-42d8256321f8 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:07.251252 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a02251e2-4b82-4746-9ac8-42d8256321f8 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] [instance: a5d50e4d-466b-4339-89e3-2cc477f9207f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:07.258723 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a02251e2-4b82-4746-9ac8-42d8256321f8 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:07.259258 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a02251e2-4b82-4746-9ac8-42d8256321f8 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:07.259705 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a02251e2-4b82-4746-9ac8-42d8256321f8 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:07.260506 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a02251e2-4b82-4746-9ac8-42d8256321f8 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:07.260966 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a02251e2-4b82-4746-9ac8-42d8256321f8 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:07.261443 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a02251e2-4b82-4746-9ac8-42d8256321f8 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:07.704828 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a02251e2-4b82-4746-9ac8-42d8256321f8 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53d510d75542a283b7f851a58d3dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f4af2d7cc742b98447e28e3c204c11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:07.713660 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a02251e2-4b82-4746-9ac8-42d8256321f8 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d50e4d-466b-4339-89e3-2cc477f9207f" status: 200 len: 1477 microversion: 2.1 time: 0.467929 Oct 30 01:47:07.714634 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2968/5938] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:07 2022] GET /compute/v2.1/servers/a5d50e4d-466b-4339-89e3-2cc477f9207f => generated 1477 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:47:07.717136 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b525e24e-9bf6-43b4-85ac-f3eb8f3aff62 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:07.719179 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-74c58fb4-034f-4dd1-bc19-52192144ea03 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:07.719985 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-74c58fb4-034f-4dd1-bc19-52192144ea03 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 9408045e-5de5-45a4-9415-e270fd97dcdd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:07.728945 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-74c58fb4-034f-4dd1-bc19-52192144ea03 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:07.729709 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-74c58fb4-034f-4dd1-bc19-52192144ea03 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:07.730149 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-74c58fb4-034f-4dd1-bc19-52192144ea03 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:07.730901 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-74c58fb4-034f-4dd1-bc19-52192144ea03 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:07.731560 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-74c58fb4-034f-4dd1-bc19-52192144ea03 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:07.732174 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-74c58fb4-034f-4dd1-bc19-52192144ea03 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:07.733813 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b525e24e-9bf6-43b4-85ac-f3eb8f3aff62 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179" status: 200 len: 1508 microversion: 2.1 time: 0.680022 Oct 30 01:47:07.734416 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2971/5939] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:07 2022] GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179 => generated 1508 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:07.748146 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-74c58fb4-034f-4dd1-bc19-52192144ea03 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] HTTP exception thrown: Instance 9408045e-5de5-45a4-9415-e270fd97dcdd could not be found. Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-74c58fb4-034f-4dd1-bc19-52192144ea03 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Request method failure captured: Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/9408045e-5de5-45a4-9415-e270fd97dcdd HTTP/1.1 Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdcRtc4GzHkShMdH9tTupejgTwf3ZNgIcyJqp9yicfp5OD1pJcQPZv1XBaNx7doePOAnkL0JpoIe5_T8iLiz5QjNjR1hpdjjFconMkrxU8FPHulGdRMQx61K_rAf0z9mDPUn9FfJ2msqRaRZPanWCScsW3BEB8X_vbKTz8C4TVCF-Ys Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 311cde01e89442f1ab3aa930070b7343 Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-AttachVolumeNegativeTest-812748574 Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/311cde01e89442f1ab3aa930070b7343"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_311cde01e89442f1ab3aa930070b7343"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/311cde01e89442f1ab3aa930070b7343"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/311cde01e89442f1ab3aa930070b7343"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-AttachVolumeNegativeTest-812748574 Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 311cde01e89442f1ab3aa930070b7343 Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-812748574 Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-AttachVolumeNegativeTest-812748574-project Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: dcb021152c684983b31e5db439518921 Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-AttachVolumeNegativeTest-812748574-project Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 9408045e-5de5-45a4-9415-e270fd97dcdd could not be found. Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '9408045e-5de5-45a4-9415-e270fd97dcdd'} Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9408045e-5de5-45a4-9415-e270fd97dcdd could not be found. Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9408045e-5de5-45a4-9415-e270fd97dcdd could not be found. Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:47:07.750945 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:47:07.755726 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:47:07.755726 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:47:07.755726 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:47:07.755726 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:47:07.755726 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:47:07.755726 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9408045e-5de5-45a4-9415-e270fd97dcdd could not be found. Oct 30 01:47:07.755726 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:47:07.755726 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-74c58fb4-034f-4dd1-bc19-52192144ea03 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Returning 404 to user: Instance 9408045e-5de5-45a4-9415-e270fd97dcdd could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:47:07.755726 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-74c58fb4-034f-4dd1-bc19-52192144ea03 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/9408045e-5de5-45a4-9415-e270fd97dcdd" status: 404 len: 111 microversion: 2.1 time: 0.039905 Oct 30 01:47:07.760396 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2969/5940] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:07 2022] GET /compute/v2.1/servers/9408045e-5de5-45a4-9415-e270fd97dcdd => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:47:07.765066 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-78a3487d-ffc3-4543-b148-f1f5f08963a0 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '.version_select at 0x7f44c7b3be50>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:07.898148 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-78a3487d-ffc3-4543-b148-f1f5f08963a0 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1967195409" status: 202 len: 0 microversion: 2.1 time: 0.136057 Oct 30 01:47:07.899369 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2972/5941] 10.222.0.13 () {58 vars in 1221 bytes} [Sun Oct 30 01:47:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1967195409 => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:47:08.477520 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-ffa7bfe3-e6ea-4fb2-a5a9-9839d623e6ae req-9df1f1dd-cfa4-4fde-bcb6-a431634ac579 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5d50e4d-466b-4339-89e3-2cc477f9207f", "name": "network-vif-deleted", "tag": "3c43afbf-da1b-4532-93d9-cafa815adfbb"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:47:08.507129 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ffa7bfe3-e6ea-4fb2-a5a9-9839d623e6ae req-9df1f1dd-cfa4-4fde-bcb6-a431634ac579 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:08.508002 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ffa7bfe3-e6ea-4fb2-a5a9-9839d623e6ae req-9df1f1dd-cfa4-4fde-bcb6-a431634ac579 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:08.512572 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ffa7bfe3-e6ea-4fb2-a5a9-9839d623e6ae req-9df1f1dd-cfa4-4fde-bcb6-a431634ac579 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:08.544637 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-ffa7bfe3-e6ea-4fb2-a5a9-9839d623e6ae req-9df1f1dd-cfa4-4fde-bcb6-a431634ac579 service nova] Creating event network-vif-deleted:3c43afbf-da1b-4532-93d9-cafa815adfbb for instance a5d50e4d-466b-4339-89e3-2cc477f9207f on n-h1-master-1 Oct 30 01:47:08.557004 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-ffa7bfe3-e6ea-4fb2-a5a9-9839d623e6ae req-9df1f1dd-cfa4-4fde-bcb6-a431634ac579 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083472 Oct 30 01:47:08.562255 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2970/5942] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:47:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:47:08.744310 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-299f8102-1de9-4231-b38f-ee38471c6d96 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:08.745589 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-299f8102-1de9-4231-b38f-ee38471c6d96 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] [instance: a5d50e4d-466b-4339-89e3-2cc477f9207f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:08.758243 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-12c98863-8511-487d-9116-2567ac59eb35 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:08.760313 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-12c98863-8511-487d-9116-2567ac59eb35 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: ded1b2fb-9552-4973-bf20-2c590b49e179] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:08.776039 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-12c98863-8511-487d-9116-2567ac59eb35 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:08.776830 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-299f8102-1de9-4231-b38f-ee38471c6d96 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:08.777598 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-299f8102-1de9-4231-b38f-ee38471c6d96 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:08.777989 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-12c98863-8511-487d-9116-2567ac59eb35 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:08.780277 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-299f8102-1de9-4231-b38f-ee38471c6d96 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:08.780414 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-12c98863-8511-487d-9116-2567ac59eb35 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:08.780414 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-12c98863-8511-487d-9116-2567ac59eb35 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:08.780414 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-12c98863-8511-487d-9116-2567ac59eb35 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:08.781312 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-299f8102-1de9-4231-b38f-ee38471c6d96 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:08.781867 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-299f8102-1de9-4231-b38f-ee38471c6d96 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:08.782261 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-12c98863-8511-487d-9116-2567ac59eb35 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:08.782744 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-299f8102-1de9-4231-b38f-ee38471c6d96 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:08.891235 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-299f8102-1de9-4231-b38f-ee38471c6d96 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53d510d75542a283b7f851a58d3dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f4af2d7cc742b98447e28e3c204c11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:08.893905 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-299f8102-1de9-4231-b38f-ee38471c6d96 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d50e4d-466b-4339-89e3-2cc477f9207f" status: 200 len: 1325 microversion: 2.1 time: 0.155511 Oct 30 01:47:08.895925 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2973/5943] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:08 2022] GET /compute/v2.1/servers/a5d50e4d-466b-4339-89e3-2cc477f9207f => generated 1325 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:09.286204 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-12c98863-8511-487d-9116-2567ac59eb35 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:09.302123 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-12c98863-8511-487d-9116-2567ac59eb35 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179" status: 200 len: 1488 microversion: 2.1 time: 0.548721 Oct 30 01:47:09.304784 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2971/5944] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:08 2022] GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179 => generated 1488 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:09.329933 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-357983f5-8cc6-419c-a9a0-ae1920c93a74 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:47:09.331061 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-357983f5-8cc6-419c-a9a0-ae1920c93a74 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: ded1b2fb-9552-4973-bf20-2c590b49e179] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:09.345676 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-357983f5-8cc6-419c-a9a0-ae1920c93a74 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:09.346987 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-357983f5-8cc6-419c-a9a0-ae1920c93a74 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:09.351893 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-357983f5-8cc6-419c-a9a0-ae1920c93a74 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:09.359213 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-357983f5-8cc6-419c-a9a0-ae1920c93a74 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:09.360407 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-357983f5-8cc6-419c-a9a0-ae1920c93a74 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:09.360933 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-357983f5-8cc6-419c-a9a0-ae1920c93a74 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:09.408909 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-357983f5-8cc6-419c-a9a0-ae1920c93a74 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lazy-loading 'flavor' on Instance uuid ded1b2fb-9552-4973-bf20-2c590b49e179 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:47:09.437812 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ad0b8977-5f0e-40a9-a401-073ecf81f250 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:09.438959 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ad0b8977-5f0e-40a9-a401-073ecf81f250 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 0671096f-ed83-4341-8f95-d138a9eebffc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:09.447725 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ad0b8977-5f0e-40a9-a401-073ecf81f250 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:09.448221 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ad0b8977-5f0e-40a9-a401-073ecf81f250 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:09.448657 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ad0b8977-5f0e-40a9-a401-073ecf81f250 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:09.449461 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ad0b8977-5f0e-40a9-a401-073ecf81f250 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:09.449922 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ad0b8977-5f0e-40a9-a401-073ecf81f250 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:09.450500 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ad0b8977-5f0e-40a9-a401-073ecf81f250 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:09.594633 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-ad0b8977-5f0e-40a9-a401-073ecf81f250 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lazy-loading 'services' on Instance uuid 0671096f-ed83-4341-8f95-d138a9eebffc {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:47:09.597438 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:47:10.026200 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ad0b8977-5f0e-40a9-a401-073ecf81f250 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc/os-volume_attachments/59150179-56ff-45d3-8287-e352470fea7d" status: 202 len: 0 microversion: 2.1 time: 0.593871 Oct 30 01:47:10.032494 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2972/5945] 10.222.0.13 () {58 vars in 1416 bytes} [Sun Oct 30 01:47:09 2022] DELETE /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc/os-volume_attachments/59150179-56ff-45d3-8287-e352470fea7d => generated 0 bytes in 601 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 30 01:47:10.045894 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d66608d3-a5c2-48ff-a2ab-30bcf3e5d4f2 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:10.047876 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d66608d3-a5c2-48ff-a2ab-30bcf3e5d4f2 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] [instance: a5d50e4d-466b-4339-89e3-2cc477f9207f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:10.051545 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:47:10.066823 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d66608d3-a5c2-48ff-a2ab-30bcf3e5d4f2 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:10.067330 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d66608d3-a5c2-48ff-a2ab-30bcf3e5d4f2 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:10.067765 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d66608d3-a5c2-48ff-a2ab-30bcf3e5d4f2 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:10.069028 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d66608d3-a5c2-48ff-a2ab-30bcf3e5d4f2 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:10.069690 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d66608d3-a5c2-48ff-a2ab-30bcf3e5d4f2 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:10.070279 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d66608d3-a5c2-48ff-a2ab-30bcf3e5d4f2 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:10.111389 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d66608d3-a5c2-48ff-a2ab-30bcf3e5d4f2 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:10.112080 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d66608d3-a5c2-48ff-a2ab-30bcf3e5d4f2 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:10.112527 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d66608d3-a5c2-48ff-a2ab-30bcf3e5d4f2 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:10.113698 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-d66608d3-a5c2-48ff-a2ab-30bcf3e5d4f2 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lazy-loading 'fault' on Instance uuid a5d50e4d-466b-4339-89e3-2cc477f9207f {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:47:10.161666 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-357983f5-8cc6-419c-a9a0-ae1920c93a74 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "POST /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179/action" status: 202 len: 0 microversion: 2.1 time: 0.827465 Oct 30 01:47:10.165537 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2974/5946] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:47:09 2022] POST /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179/action => generated 0 bytes in 842 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:47:10.179795 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7f2d52a1-39d4-4b89-96ed-63c386d691f4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:10.218637 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7f2d52a1-39d4-4b89-96ed-63c386d691f4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 0671096f-ed83-4341-8f95-d138a9eebffc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:10.218750 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d66608d3-a5c2-48ff-a2ab-30bcf3e5d4f2 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53d510d75542a283b7f851a58d3dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f4af2d7cc742b98447e28e3c204c11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:10.229151 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d66608d3-a5c2-48ff-a2ab-30bcf3e5d4f2 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d50e4d-466b-4339-89e3-2cc477f9207f" status: 200 len: 1330 microversion: 2.1 time: 0.193831 Oct 30 01:47:10.235119 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7f2d52a1-39d4-4b89-96ed-63c386d691f4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:10.235336 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2973/5947] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:10 2022] GET /compute/v2.1/servers/a5d50e4d-466b-4339-89e3-2cc477f9207f => generated 1330 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:10.238816 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7f2d52a1-39d4-4b89-96ed-63c386d691f4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:10.239272 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7f2d52a1-39d4-4b89-96ed-63c386d691f4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:10.240026 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7f2d52a1-39d4-4b89-96ed-63c386d691f4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:10.254701 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7f2d52a1-39d4-4b89-96ed-63c386d691f4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:10.254701 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7f2d52a1-39d4-4b89-96ed-63c386d691f4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:10.254994 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-83eff9c0-7c46-4504-a84c-874f2096d99a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:10.254994 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-83eff9c0-7c46-4504-a84c-874f2096d99a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: ded1b2fb-9552-4973-bf20-2c590b49e179] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:10.256207 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-83eff9c0-7c46-4504-a84c-874f2096d99a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:10.256711 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-83eff9c0-7c46-4504-a84c-874f2096d99a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:10.257153 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-83eff9c0-7c46-4504-a84c-874f2096d99a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:10.257883 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-83eff9c0-7c46-4504-a84c-874f2096d99a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:10.258342 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-83eff9c0-7c46-4504-a84c-874f2096d99a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:10.258767 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-83eff9c0-7c46-4504-a84c-874f2096d99a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:10.306609 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7f2d52a1-39d4-4b89-96ed-63c386d691f4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134245 Oct 30 01:47:10.307511 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2975/5948] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 01:47:10 2022] GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:47:10.430225 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-83eff9c0-7c46-4504-a84c-874f2096d99a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:10.441308 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-83eff9c0-7c46-4504-a84c-874f2096d99a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179" status: 200 len: 1494 microversion: 2.1 time: 0.204746 Oct 30 01:47:10.443256 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2974/5949] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:10 2022] GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179 => generated 1494 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:11.292506 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c6ea6b31-342c-445e-b7df-e5a00320fa67 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:11.293184 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c6ea6b31-342c-445e-b7df-e5a00320fa67 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] [instance: a5d50e4d-466b-4339-89e3-2cc477f9207f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:11.301260 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6ea6b31-342c-445e-b7df-e5a00320fa67 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:11.301793 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6ea6b31-342c-445e-b7df-e5a00320fa67 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:11.302241 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6ea6b31-342c-445e-b7df-e5a00320fa67 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:11.302936 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6ea6b31-342c-445e-b7df-e5a00320fa67 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:11.303506 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6ea6b31-342c-445e-b7df-e5a00320fa67 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:11.304102 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c6ea6b31-342c-445e-b7df-e5a00320fa67 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:11.320115 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9e91a806-1cce-478d-80c4-f5c0373ec55b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:11.321363 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-c6ea6b31-342c-445e-b7df-e5a00320fa67 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] HTTP exception thrown: Instance a5d50e4d-466b-4339-89e3-2cc477f9207f could not be found. Oct 30 01:47:11.322460 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9e91a806-1cce-478d-80c4-f5c0373ec55b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 0671096f-ed83-4341-8f95-d138a9eebffc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c6ea6b31-342c-445e-b7df-e5a00320fa67 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Request method failure captured: Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/a5d50e4d-466b-4339-89e3-2cc477f9207f HTTP/1.1 Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdc2EUTdXGRSl13R81I_NsTmSwjalnnU8plIjo2ff3CaCwBIIHE4qfKh-Z4Hl8U7GAKEC6uCifGCgbKlT_S3u2qP0Tzi0PR4bDyvcx_4RyuBzVB-VIaiz2GyJPJTp72IHRGD9Yv1AkL2uxAWXwCtogEVN_OsQhk8eQoEKv2y0ZJ2fLY Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 73f4af2d7cc742b98447e28e3c204c11 Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-665416734 Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/73f4af2d7cc742b98447e28e3c204c11"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_73f4af2d7cc742b98447e28e3c204c11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/73f4af2d7cc742b98447e28e3c204c11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/73f4af2d7cc742b98447e28e3c204c11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-TestSecurityGroupsBasicOps-665416734 Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 73f4af2d7cc742b98447e28e3c204c11 Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-665416734 Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-TestSecurityGroupsBasicOps-665416734-project Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 9c53d510d75542a283b7f851a58d3dbf Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-TestSecurityGroupsBasicOps-665416734-project Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: exception: Instance a5d50e4d-466b-4339-89e3-2cc477f9207f could not be found. Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'a5d50e4d-466b-4339-89e3-2cc477f9207f'} Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5d50e4d-466b-4339-89e3-2cc477f9207f could not be found. Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5d50e4d-466b-4339-89e3-2cc477f9207f could not be found. Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:47:11.324585 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:47:11.329985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:47:11.329985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:47:11.329985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:47:11.329985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:47:11.329985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:47:11.329985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5d50e4d-466b-4339-89e3-2cc477f9207f could not be found. Oct 30 01:47:11.329985 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:47:11.334202 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c6ea6b31-342c-445e-b7df-e5a00320fa67 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Returning 404 to user: Instance a5d50e4d-466b-4339-89e3-2cc477f9207f could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:47:11.335298 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c6ea6b31-342c-445e-b7df-e5a00320fa67 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d50e4d-466b-4339-89e3-2cc477f9207f" status: 404 len: 111 microversion: 2.1 time: 0.046874 Oct 30 01:47:11.337323 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2976/5950] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:11 2022] GET /compute/v2.1/servers/a5d50e4d-466b-4339-89e3-2cc477f9207f => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:47:11.343669 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9e91a806-1cce-478d-80c4-f5c0373ec55b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:11.344023 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9e91a806-1cce-478d-80c4-f5c0373ec55b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:11.344467 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9e91a806-1cce-478d-80c4-f5c0373ec55b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:11.345310 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9e91a806-1cce-478d-80c4-f5c0373ec55b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:11.345694 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9e91a806-1cce-478d-80c4-f5c0373ec55b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:11.346127 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9e91a806-1cce-478d-80c4-f5c0373ec55b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:11.410988 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9e91a806-1cce-478d-80c4-f5c0373ec55b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091381 Oct 30 01:47:11.411092 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2975/5951] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 01:47:11 2022] GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:47:11.465828 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1bdcb809-7ead-42a8-a637-8ca4d0c37dc8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:11.466767 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1bdcb809-7ead-42a8-a637-8ca4d0c37dc8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: ded1b2fb-9552-4973-bf20-2c590b49e179] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:11.475345 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1bdcb809-7ead-42a8-a637-8ca4d0c37dc8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:11.476072 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1bdcb809-7ead-42a8-a637-8ca4d0c37dc8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:11.483071 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1bdcb809-7ead-42a8-a637-8ca4d0c37dc8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:11.483071 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1bdcb809-7ead-42a8-a637-8ca4d0c37dc8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:11.483071 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1bdcb809-7ead-42a8-a637-8ca4d0c37dc8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:11.483071 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1bdcb809-7ead-42a8-a637-8ca4d0c37dc8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:11.917513 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1bdcb809-7ead-42a8-a637-8ca4d0c37dc8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:11.935365 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1bdcb809-7ead-42a8-a637-8ca4d0c37dc8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179" status: 200 len: 1515 microversion: 2.1 time: 0.470446 Oct 30 01:47:11.938694 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2977/5952] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:11 2022] GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179 => generated 1515 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:12.427320 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d4c4a4b0-6dd3-41fe-8c25-936e47cecf73 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:12.429754 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d4c4a4b0-6dd3-41fe-8c25-936e47cecf73 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 0671096f-ed83-4341-8f95-d138a9eebffc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:12.467953 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4c4a4b0-6dd3-41fe-8c25-936e47cecf73 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:12.468475 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4c4a4b0-6dd3-41fe-8c25-936e47cecf73 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:12.468945 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4c4a4b0-6dd3-41fe-8c25-936e47cecf73 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:12.469698 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4c4a4b0-6dd3-41fe-8c25-936e47cecf73 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:12.470163 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4c4a4b0-6dd3-41fe-8c25-936e47cecf73 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:12.470598 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4c4a4b0-6dd3-41fe-8c25-936e47cecf73 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:12.563099 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d4c4a4b0-6dd3-41fe-8c25-936e47cecf73 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.143713 Oct 30 01:47:12.568813 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2976/5953] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 01:47:12 2022] GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:47:12.970087 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bfbd1609-e6a3-49d5-b171-597407fe39a8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:12.970876 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-bfbd1609-e6a3-49d5-b171-597407fe39a8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: ded1b2fb-9552-4973-bf20-2c590b49e179] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:12.979260 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bfbd1609-e6a3-49d5-b171-597407fe39a8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:12.980024 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bfbd1609-e6a3-49d5-b171-597407fe39a8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:12.980466 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bfbd1609-e6a3-49d5-b171-597407fe39a8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:12.981423 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bfbd1609-e6a3-49d5-b171-597407fe39a8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:12.982135 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bfbd1609-e6a3-49d5-b171-597407fe39a8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:12.987606 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bfbd1609-e6a3-49d5-b171-597407fe39a8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:13.584183 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6e788a12-3f7f-4c2d-beda-6da641a28e23 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:13.587548 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6e788a12-3f7f-4c2d-beda-6da641a28e23 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 0671096f-ed83-4341-8f95-d138a9eebffc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:13.606269 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e788a12-3f7f-4c2d-beda-6da641a28e23 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:13.607428 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e788a12-3f7f-4c2d-beda-6da641a28e23 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:13.613972 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e788a12-3f7f-4c2d-beda-6da641a28e23 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:13.616432 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e788a12-3f7f-4c2d-beda-6da641a28e23 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:13.617164 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e788a12-3f7f-4c2d-beda-6da641a28e23 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:13.619027 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e788a12-3f7f-4c2d-beda-6da641a28e23 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:13.721386 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6e788a12-3f7f-4c2d-beda-6da641a28e23 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.141442 Oct 30 01:47:13.724564 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2977/5954] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 01:47:13 2022] GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:47:13.982347 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-bfbd1609-e6a3-49d5-b171-597407fe39a8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:13.997865 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bfbd1609-e6a3-49d5-b171-597407fe39a8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179" status: 200 len: 1515 microversion: 2.1 time: 1.037198 Oct 30 01:47:14.024523 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2978/5955] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:12 2022] GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179 => generated 1515 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:14.740545 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-46da9e35-8d95-4794-ab3e-477f638a328f tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:14.745146 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-46da9e35-8d95-4794-ab3e-477f638a328f tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 0671096f-ed83-4341-8f95-d138a9eebffc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:14.781839 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-46da9e35-8d95-4794-ab3e-477f638a328f tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:14.788838 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-46da9e35-8d95-4794-ab3e-477f638a328f tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:14.789616 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-46da9e35-8d95-4794-ab3e-477f638a328f tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:14.791862 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-46da9e35-8d95-4794-ab3e-477f638a328f tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:14.793646 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-46da9e35-8d95-4794-ab3e-477f638a328f tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:14.794634 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-46da9e35-8d95-4794-ab3e-477f638a328f tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:14.889985 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-46da9e35-8d95-4794-ab3e-477f638a328f tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.154556 Oct 30 01:47:14.903468 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2978/5956] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 01:47:14 2022] GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:47:15.030075 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1fe8f5ce-9b6b-4bc6-9af9-94e9073443f1 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:15.031537 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1fe8f5ce-9b6b-4bc6-9af9-94e9073443f1 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: ded1b2fb-9552-4973-bf20-2c590b49e179] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:15.068600 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1fe8f5ce-9b6b-4bc6-9af9-94e9073443f1 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:15.069210 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1fe8f5ce-9b6b-4bc6-9af9-94e9073443f1 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:15.091137 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1fe8f5ce-9b6b-4bc6-9af9-94e9073443f1 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:15.093056 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1fe8f5ce-9b6b-4bc6-9af9-94e9073443f1 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:15.093781 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1fe8f5ce-9b6b-4bc6-9af9-94e9073443f1 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:15.094878 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1fe8f5ce-9b6b-4bc6-9af9-94e9073443f1 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:15.159329 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:47:15.798479 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1fe8f5ce-9b6b-4bc6-9af9-94e9073443f1 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:15.814648 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1fe8f5ce-9b6b-4bc6-9af9-94e9073443f1 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179" status: 200 len: 1510 microversion: 2.1 time: 0.785247 Oct 30 01:47:15.815727 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2979/5957] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:15 2022] GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179 => generated 1510 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:15.908791 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7850be70-9cd5-4849-9958-9ff9fd98a45a tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:15.916427 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7850be70-9cd5-4849-9958-9ff9fd98a45a tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 0671096f-ed83-4341-8f95-d138a9eebffc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:15.935681 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7850be70-9cd5-4849-9958-9ff9fd98a45a tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:15.950955 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7850be70-9cd5-4849-9958-9ff9fd98a45a tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:15.950955 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7850be70-9cd5-4849-9958-9ff9fd98a45a tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:15.950955 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7850be70-9cd5-4849-9958-9ff9fd98a45a tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:15.950955 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7850be70-9cd5-4849-9958-9ff9fd98a45a tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:15.950955 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7850be70-9cd5-4849-9958-9ff9fd98a45a tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:16.058448 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7850be70-9cd5-4849-9958-9ff9fd98a45a tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.156205 Oct 30 01:47:16.059654 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2979/5958] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 01:47:15 2022] GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc/os-volume_attachments => generated 197 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:47:16.839716 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5196da6e-5b0b-4484-8e07-8746dbee86c0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:16.841104 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5196da6e-5b0b-4484-8e07-8746dbee86c0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: ded1b2fb-9552-4973-bf20-2c590b49e179] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:16.854308 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5196da6e-5b0b-4484-8e07-8746dbee86c0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:16.867878 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5196da6e-5b0b-4484-8e07-8746dbee86c0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:16.868932 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5196da6e-5b0b-4484-8e07-8746dbee86c0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:16.869988 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5196da6e-5b0b-4484-8e07-8746dbee86c0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:16.870694 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5196da6e-5b0b-4484-8e07-8746dbee86c0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:16.871501 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5196da6e-5b0b-4484-8e07-8746dbee86c0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:17.072744 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-74c02c41-e566-40f9-9aa8-950de5c21010 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:17.076390 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-74c02c41-e566-40f9-9aa8-950de5c21010 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 0671096f-ed83-4341-8f95-d138a9eebffc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:17.116418 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-74c02c41-e566-40f9-9aa8-950de5c21010 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:17.117251 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-74c02c41-e566-40f9-9aa8-950de5c21010 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:17.121267 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-74c02c41-e566-40f9-9aa8-950de5c21010 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:17.124013 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-74c02c41-e566-40f9-9aa8-950de5c21010 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:17.124808 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-74c02c41-e566-40f9-9aa8-950de5c21010 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:17.126958 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-74c02c41-e566-40f9-9aa8-950de5c21010 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:17.343969 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-74c02c41-e566-40f9-9aa8-950de5c21010 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.275996 Oct 30 01:47:17.344472 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2980/5959] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 01:47:17 2022] GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc/os-volume_attachments => generated 197 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:47:17.541263 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5196da6e-5b0b-4484-8e07-8746dbee86c0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:17.574922 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5196da6e-5b0b-4484-8e07-8746dbee86c0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179" status: 200 len: 1510 microversion: 2.1 time: 0.721334 Oct 30 01:47:17.581255 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2980/5960] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:16 2022] GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179 => generated 1510 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:17.586155 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-e9d8d38d-1540-4371-bc62-c35c5f9be7fa req-a405737b-eb35-4a92-ab38-97d571f7ff76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ded1b2fb-9552-4973-bf20-2c590b49e179", "name": "network-vif-plugged", "status": "completed", "tag": "94a9922b-c61b-418a-981f-f3039568b8ea"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:47:17.612105 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-e9d8d38d-1540-4371-bc62-c35c5f9be7fa req-a405737b-eb35-4a92-ab38-97d571f7ff76 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:17.612255 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-e9d8d38d-1540-4371-bc62-c35c5f9be7fa req-a405737b-eb35-4a92-ab38-97d571f7ff76 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:17.612637 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-e9d8d38d-1540-4371-bc62-c35c5f9be7fa req-a405737b-eb35-4a92-ab38-97d571f7ff76 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:17.721548 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-e9d8d38d-1540-4371-bc62-c35c5f9be7fa req-a405737b-eb35-4a92-ab38-97d571f7ff76 service nova] Creating event network-vif-plugged:94a9922b-c61b-418a-981f-f3039568b8ea for instance ded1b2fb-9552-4973-bf20-2c590b49e179 on n-h2-master-1 Oct 30 01:47:17.742609 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-e9d8d38d-1540-4371-bc62-c35c5f9be7fa req-a405737b-eb35-4a92-ab38-97d571f7ff76 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160634 Oct 30 01:47:17.749987 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2981/5961] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:47:18.361045 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a1f407c6-f87a-4061-9ce7-e2dbd0d5e20c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:18.367562 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a1f407c6-f87a-4061-9ce7-e2dbd0d5e20c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 0671096f-ed83-4341-8f95-d138a9eebffc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:18.414963 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a1f407c6-f87a-4061-9ce7-e2dbd0d5e20c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:18.417589 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a1f407c6-f87a-4061-9ce7-e2dbd0d5e20c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:18.419131 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a1f407c6-f87a-4061-9ce7-e2dbd0d5e20c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:18.442157 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a1f407c6-f87a-4061-9ce7-e2dbd0d5e20c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:18.442157 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a1f407c6-f87a-4061-9ce7-e2dbd0d5e20c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:18.442157 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a1f407c6-f87a-4061-9ce7-e2dbd0d5e20c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:18.568410 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a1f407c6-f87a-4061-9ce7-e2dbd0d5e20c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.215692 Oct 30 01:47:18.569016 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2981/5962] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 01:47:18 2022] GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc/os-volume_attachments => generated 197 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:47:18.603082 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8b8ce35d-81a5-4618-b448-5b19c3f76e39 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:18.603082 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8b8ce35d-81a5-4618-b448-5b19c3f76e39 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: ded1b2fb-9552-4973-bf20-2c590b49e179] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:18.615915 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b8ce35d-81a5-4618-b448-5b19c3f76e39 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:18.616414 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b8ce35d-81a5-4618-b448-5b19c3f76e39 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:18.616847 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b8ce35d-81a5-4618-b448-5b19c3f76e39 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:18.617586 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b8ce35d-81a5-4618-b448-5b19c3f76e39 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:18.618041 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b8ce35d-81a5-4618-b448-5b19c3f76e39 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:18.618463 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b8ce35d-81a5-4618-b448-5b19c3f76e39 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:19.023469 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8b8ce35d-81a5-4618-b448-5b19c3f76e39 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:19.056143 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8b8ce35d-81a5-4618-b448-5b19c3f76e39 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179" status: 200 len: 1510 microversion: 2.1 time: 0.460609 Oct 30 01:47:19.058033 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2982/5963] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:18 2022] GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179 => generated 1510 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:19.587226 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-198cdf41-e0ef-4336-9cf5-21d51c679587 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:19.589842 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-198cdf41-e0ef-4336-9cf5-21d51c679587 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 0671096f-ed83-4341-8f95-d138a9eebffc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:19.616204 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-198cdf41-e0ef-4336-9cf5-21d51c679587 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:19.617109 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-198cdf41-e0ef-4336-9cf5-21d51c679587 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:19.627412 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-198cdf41-e0ef-4336-9cf5-21d51c679587 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:19.630403 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-198cdf41-e0ef-4336-9cf5-21d51c679587 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:19.638461 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-198cdf41-e0ef-4336-9cf5-21d51c679587 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:19.639300 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-198cdf41-e0ef-4336-9cf5-21d51c679587 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:19.726291 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-198cdf41-e0ef-4336-9cf5-21d51c679587 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148639 Oct 30 01:47:19.730372 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2982/5964] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 01:47:19 2022] GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:47:20.082059 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bb6bfe3c-fb66-4159-afae-4905d24d73e1 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:20.086826 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bb6bfe3c-fb66-4159-afae-4905d24d73e1 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: ded1b2fb-9552-4973-bf20-2c590b49e179] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:20.097895 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb6bfe3c-fb66-4159-afae-4905d24d73e1 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:20.098400 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb6bfe3c-fb66-4159-afae-4905d24d73e1 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:20.098843 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb6bfe3c-fb66-4159-afae-4905d24d73e1 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:20.099565 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb6bfe3c-fb66-4159-afae-4905d24d73e1 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:20.100024 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb6bfe3c-fb66-4159-afae-4905d24d73e1 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:20.100454 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb6bfe3c-fb66-4159-afae-4905d24d73e1 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:20.707294 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bb6bfe3c-fb66-4159-afae-4905d24d73e1 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:20.722999 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bb6bfe3c-fb66-4159-afae-4905d24d73e1 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179" status: 200 len: 1510 microversion: 2.1 time: 0.646314 Oct 30 01:47:20.725745 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2983/5965] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:20 2022] GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179 => generated 1510 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:20.742272 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-29ea273e-e6f8-401e-81c9-bcfeabbce605 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:20.745099 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-29ea273e-e6f8-401e-81c9-bcfeabbce605 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 0671096f-ed83-4341-8f95-d138a9eebffc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:20.764201 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-29ea273e-e6f8-401e-81c9-bcfeabbce605 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:20.766953 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-29ea273e-e6f8-401e-81c9-bcfeabbce605 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:20.767550 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-29ea273e-e6f8-401e-81c9-bcfeabbce605 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:20.774114 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-29ea273e-e6f8-401e-81c9-bcfeabbce605 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:20.775992 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-29ea273e-e6f8-401e-81c9-bcfeabbce605 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:20.777740 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-29ea273e-e6f8-401e-81c9-bcfeabbce605 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:20.862115 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-29ea273e-e6f8-401e-81c9-bcfeabbce605 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.121275 Oct 30 01:47:20.862972 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2983/5966] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 01:47:20 2022] GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc/os-volume_attachments => generated 25 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:47:20.964987 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-169f626d-1169-4488-9331-09325b1019a8 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:20.966538 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-169f626d-1169-4488-9331-09325b1019a8 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 0671096f-ed83-4341-8f95-d138a9eebffc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:20.974250 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-169f626d-1169-4488-9331-09325b1019a8 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:20.975146 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-169f626d-1169-4488-9331-09325b1019a8 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:20.975825 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-169f626d-1169-4488-9331-09325b1019a8 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:20.976877 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-169f626d-1169-4488-9331-09325b1019a8 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:20.978165 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-169f626d-1169-4488-9331-09325b1019a8 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:20.978832 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-169f626d-1169-4488-9331-09325b1019a8 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:21.030132 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-169f626d-1169-4488-9331-09325b1019a8 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 0671096f-ed83-4341-8f95-d138a9eebffc] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:47:21.436081 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-169f626d-1169-4488-9331-09325b1019a8 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc" status: 204 len: 0 microversion: 2.1 time: 0.476967 Oct 30 01:47:21.437377 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2984/5967] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:47:20 2022] DELETE /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc => generated 0 bytes in 479 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:47:21.466978 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c84c9407-df48-4cd9-a0ed-827677125a6f tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:21.468498 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c84c9407-df48-4cd9-a0ed-827677125a6f tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 0671096f-ed83-4341-8f95-d138a9eebffc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:21.490037 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c84c9407-df48-4cd9-a0ed-827677125a6f tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:21.491511 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c84c9407-df48-4cd9-a0ed-827677125a6f tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:21.502382 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c84c9407-df48-4cd9-a0ed-827677125a6f tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:21.505760 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c84c9407-df48-4cd9-a0ed-827677125a6f tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:21.510419 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c84c9407-df48-4cd9-a0ed-827677125a6f tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:21.513117 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c84c9407-df48-4cd9-a0ed-827677125a6f tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:21.748621 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-57de5519-7290-4d6a-b29b-93f953249caf tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:21.749373 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-57de5519-7290-4d6a-b29b-93f953249caf tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: ded1b2fb-9552-4973-bf20-2c590b49e179] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:21.762843 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-57de5519-7290-4d6a-b29b-93f953249caf tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:21.763617 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-57de5519-7290-4d6a-b29b-93f953249caf tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:21.766045 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-57de5519-7290-4d6a-b29b-93f953249caf tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:21.768422 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-57de5519-7290-4d6a-b29b-93f953249caf tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:21.771919 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-57de5519-7290-4d6a-b29b-93f953249caf tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:21.775804 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-57de5519-7290-4d6a-b29b-93f953249caf tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:22.185422 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-57de5519-7290-4d6a-b29b-93f953249caf tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:22.205774 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-57de5519-7290-4d6a-b29b-93f953249caf tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179" status: 200 len: 1510 microversion: 2.1 time: 0.459488 Oct 30 01:47:22.234174 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2985/5968] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:21 2022] GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179 => generated 1510 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:47:22.506612 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c84c9407-df48-4cd9-a0ed-827677125a6f tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:22.516332 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c84c9407-df48-4cd9-a0ed-827677125a6f tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc" status: 200 len: 1679 microversion: 2.1 time: 1.067127 Oct 30 01:47:22.525745 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2984/5969] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:21 2022] GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc => generated 1679 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:23.251298 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-26b01521-803b-4e6f-a21e-2c446bb2ea0f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:23.252832 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-26b01521-803b-4e6f-a21e-2c446bb2ea0f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: ded1b2fb-9552-4973-bf20-2c590b49e179] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:23.275153 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-26b01521-803b-4e6f-a21e-2c446bb2ea0f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:23.282091 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-26b01521-803b-4e6f-a21e-2c446bb2ea0f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:23.285551 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-26b01521-803b-4e6f-a21e-2c446bb2ea0f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:23.297897 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-26b01521-803b-4e6f-a21e-2c446bb2ea0f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:23.300466 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-26b01521-803b-4e6f-a21e-2c446bb2ea0f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:23.300816 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-26b01521-803b-4e6f-a21e-2c446bb2ea0f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:23.557185 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-52b50901-f908-428b-a07a-24a5853e9131 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:23.557185 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-52b50901-f908-428b-a07a-24a5853e9131 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 0671096f-ed83-4341-8f95-d138a9eebffc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:23.564253 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:47:23.566775 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52b50901-f908-428b-a07a-24a5853e9131 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:23.568028 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52b50901-f908-428b-a07a-24a5853e9131 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:23.568647 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52b50901-f908-428b-a07a-24a5853e9131 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:23.570032 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52b50901-f908-428b-a07a-24a5853e9131 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:23.570663 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52b50901-f908-428b-a07a-24a5853e9131 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:23.571281 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52b50901-f908-428b-a07a-24a5853e9131 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:24.172218 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-26b01521-803b-4e6f-a21e-2c446bb2ea0f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:24.181699 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-26b01521-803b-4e6f-a21e-2c446bb2ea0f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179" status: 200 len: 1510 microversion: 2.1 time: 0.947295 Oct 30 01:47:24.182693 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2986/5970] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:23 2022] GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179 => generated 1510 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:24.246416 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-52b50901-f908-428b-a07a-24a5853e9131 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:24.257192 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-52b50901-f908-428b-a07a-24a5853e9131 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc" status: 200 len: 1679 microversion: 2.1 time: 0.708610 Oct 30 01:47:24.263392 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2985/5971] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:23 2022] GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc => generated 1679 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:25.210021 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8362e107-f180-4cbb-9ba1-85e33f3c22b4 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:25.210656 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8362e107-f180-4cbb-9ba1-85e33f3c22b4 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: ded1b2fb-9552-4973-bf20-2c590b49e179] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:25.217807 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8362e107-f180-4cbb-9ba1-85e33f3c22b4 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:25.218310 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8362e107-f180-4cbb-9ba1-85e33f3c22b4 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:25.218781 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8362e107-f180-4cbb-9ba1-85e33f3c22b4 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:25.219485 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8362e107-f180-4cbb-9ba1-85e33f3c22b4 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:25.219949 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8362e107-f180-4cbb-9ba1-85e33f3c22b4 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:25.220382 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8362e107-f180-4cbb-9ba1-85e33f3c22b4 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:25.287905 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a1edd873-ffbc-4e22-9ca9-f73bd1efdb3d tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:25.289692 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a1edd873-ffbc-4e22-9ca9-f73bd1efdb3d tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 0671096f-ed83-4341-8f95-d138a9eebffc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:25.304313 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a1edd873-ffbc-4e22-9ca9-f73bd1efdb3d tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:25.305569 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a1edd873-ffbc-4e22-9ca9-f73bd1efdb3d tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:25.306269 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a1edd873-ffbc-4e22-9ca9-f73bd1efdb3d tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:25.309447 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a1edd873-ffbc-4e22-9ca9-f73bd1efdb3d tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:25.310276 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a1edd873-ffbc-4e22-9ca9-f73bd1efdb3d tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:25.310894 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a1edd873-ffbc-4e22-9ca9-f73bd1efdb3d tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:25.470288 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a1edd873-ffbc-4e22-9ca9-f73bd1efdb3d tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:25.485430 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a1edd873-ffbc-4e22-9ca9-f73bd1efdb3d tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc" status: 200 len: 1613 microversion: 2.1 time: 0.205855 Oct 30 01:47:25.486041 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2986/5972] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:25 2022] GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc => generated 1613 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:47:25.810891 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-587f978b-a9d4-4211-8fbe-aa4a5e8a65e9 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:25.811402 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-587f978b-a9d4-4211-8fbe-aa4a5e8a65e9 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] [instance: 324131f5-3ba0-4222-bb43-a20812dba495] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:25.821068 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-587f978b-a9d4-4211-8fbe-aa4a5e8a65e9 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:25.821416 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-587f978b-a9d4-4211-8fbe-aa4a5e8a65e9 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:25.821854 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-587f978b-a9d4-4211-8fbe-aa4a5e8a65e9 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:25.825544 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-587f978b-a9d4-4211-8fbe-aa4a5e8a65e9 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:25.828243 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-587f978b-a9d4-4211-8fbe-aa4a5e8a65e9 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:25.828921 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-587f978b-a9d4-4211-8fbe-aa4a5e8a65e9 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:25.896222 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-587f978b-a9d4-4211-8fbe-aa4a5e8a65e9 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] [instance: 324131f5-3ba0-4222-bb43-a20812dba495] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:47:25.898292 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8362e107-f180-4cbb-9ba1-85e33f3c22b4 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:25.906993 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:47:25.922855 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8362e107-f180-4cbb-9ba1-85e33f3c22b4 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179" status: 200 len: 1510 microversion: 2.1 time: 0.710005 Oct 30 01:47:25.922855 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2987/5973] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:25 2022] GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179 => generated 1510 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:25.935955 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-35fc5a15-d3fe-4e63-bd80-bdf14b8c25ff req-570657ef-7d81-4b9b-ac04-409836bba100 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "324131f5-3ba0-4222-bb43-a20812dba495", "tag": "513258c1-74aa-493d-9ce2-a04232fdcb10"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:47:25.957047 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-35fc5a15-d3fe-4e63-bd80-bdf14b8c25ff req-570657ef-7d81-4b9b-ac04-409836bba100 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:25.960752 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-35fc5a15-d3fe-4e63-bd80-bdf14b8c25ff req-570657ef-7d81-4b9b-ac04-409836bba100 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:25.961228 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-35fc5a15-d3fe-4e63-bd80-bdf14b8c25ff req-570657ef-7d81-4b9b-ac04-409836bba100 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:26.002688 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-35fc5a15-d3fe-4e63-bd80-bdf14b8c25ff req-570657ef-7d81-4b9b-ac04-409836bba100 service nova] Creating event network-changed:513258c1-74aa-493d-9ce2-a04232fdcb10 for instance 324131f5-3ba0-4222-bb43-a20812dba495 on n-h2-master-1 Oct 30 01:47:26.016825 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-35fc5a15-d3fe-4e63-bd80-bdf14b8c25ff req-570657ef-7d81-4b9b-ac04-409836bba100 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096914 Oct 30 01:47:26.021276 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2988/5974] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:47:26.367369 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-587f978b-a9d4-4211-8fbe-aa4a5e8a65e9 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] 10.222.0.13 "DELETE /compute/v2.1/servers/324131f5-3ba0-4222-bb43-a20812dba495" status: 204 len: 0 microversion: 2.1 time: 0.560113 Oct 30 01:47:26.368353 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2987/5975] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:47:25 2022] DELETE /compute/v2.1/servers/324131f5-3ba0-4222-bb43-a20812dba495 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 30 01:47:26.385031 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-218973a3-2a62-46ef-a214-b9853df73d77 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:26.385785 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-218973a3-2a62-46ef-a214-b9853df73d77 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] [instance: 324131f5-3ba0-4222-bb43-a20812dba495] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:26.435767 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-218973a3-2a62-46ef-a214-b9853df73d77 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:26.451991 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-218973a3-2a62-46ef-a214-b9853df73d77 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:26.453668 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-218973a3-2a62-46ef-a214-b9853df73d77 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:26.457153 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-218973a3-2a62-46ef-a214-b9853df73d77 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:26.465228 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-218973a3-2a62-46ef-a214-b9853df73d77 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:26.465228 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-218973a3-2a62-46ef-a214-b9853df73d77 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:26.512113 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b778c447-068b-44d2-9212-f2ddc8c42089 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:26.513867 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b778c447-068b-44d2-9212-f2ddc8c42089 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 0671096f-ed83-4341-8f95-d138a9eebffc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:26.525379 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b778c447-068b-44d2-9212-f2ddc8c42089 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:26.526192 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b778c447-068b-44d2-9212-f2ddc8c42089 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:26.526817 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b778c447-068b-44d2-9212-f2ddc8c42089 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:26.527728 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b778c447-068b-44d2-9212-f2ddc8c42089 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:26.538120 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b778c447-068b-44d2-9212-f2ddc8c42089 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:26.538843 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b778c447-068b-44d2-9212-f2ddc8c42089 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:26.822730 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b778c447-068b-44d2-9212-f2ddc8c42089 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:26.830779 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b778c447-068b-44d2-9212-f2ddc8c42089 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc" status: 200 len: 1613 microversion: 2.1 time: 0.322891 Oct 30 01:47:26.837835 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2988/5976] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:26 2022] GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc => generated 1613 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:47:26.945448 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6f18d337-a0ad-405e-a2b4-92b277d7a6f6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:26.952671 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6f18d337-a0ad-405e-a2b4-92b277d7a6f6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: ded1b2fb-9552-4973-bf20-2c590b49e179] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:26.956787 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f18d337-a0ad-405e-a2b4-92b277d7a6f6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:26.963695 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-218973a3-2a62-46ef-a214-b9853df73d77 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53d510d75542a283b7f851a58d3dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f4af2d7cc742b98447e28e3c204c11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:26.965971 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f18d337-a0ad-405e-a2b4-92b277d7a6f6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:26.966430 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f18d337-a0ad-405e-a2b4-92b277d7a6f6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:26.967396 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f18d337-a0ad-405e-a2b4-92b277d7a6f6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:26.972550 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f18d337-a0ad-405e-a2b4-92b277d7a6f6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:26.973184 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f18d337-a0ad-405e-a2b4-92b277d7a6f6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:26.978818 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-218973a3-2a62-46ef-a214-b9853df73d77 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] 10.222.0.13 "GET /compute/v2.1/servers/324131f5-3ba0-4222-bb43-a20812dba495" status: 200 len: 1765 microversion: 2.1 time: 0.604099 Oct 30 01:47:26.980094 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2989/5977] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:26 2022] GET /compute/v2.1/servers/324131f5-3ba0-4222-bb43-a20812dba495 => generated 1765 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:27.278585 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6f18d337-a0ad-405e-a2b4-92b277d7a6f6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:27.291135 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6f18d337-a0ad-405e-a2b4-92b277d7a6f6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179" status: 200 len: 1510 microversion: 2.1 time: 0.349447 Oct 30 01:47:27.316654 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2989/5978] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:26 2022] GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179 => generated 1510 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:47:27.865651 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f9a4015e-40df-4d6f-8863-5b13c6a7f87b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:27.866905 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f9a4015e-40df-4d6f-8863-5b13c6a7f87b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 0671096f-ed83-4341-8f95-d138a9eebffc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:27.905142 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f9a4015e-40df-4d6f-8863-5b13c6a7f87b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:27.906399 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f9a4015e-40df-4d6f-8863-5b13c6a7f87b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:27.911050 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f9a4015e-40df-4d6f-8863-5b13c6a7f87b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:27.912516 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f9a4015e-40df-4d6f-8863-5b13c6a7f87b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:27.913318 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f9a4015e-40df-4d6f-8863-5b13c6a7f87b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:27.914919 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f9a4015e-40df-4d6f-8863-5b13c6a7f87b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:28.008454 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ef6453ac-3dfc-4696-844d-2037e00b2a94 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:28.009980 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ef6453ac-3dfc-4696-844d-2037e00b2a94 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] [instance: 324131f5-3ba0-4222-bb43-a20812dba495] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:28.022720 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ef6453ac-3dfc-4696-844d-2037e00b2a94 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:28.026853 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f9a4015e-40df-4d6f-8863-5b13c6a7f87b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:28.027749 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f9a4015e-40df-4d6f-8863-5b13c6a7f87b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:28.029693 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ef6453ac-3dfc-4696-844d-2037e00b2a94 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:28.030948 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f9a4015e-40df-4d6f-8863-5b13c6a7f87b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:28.032195 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ef6453ac-3dfc-4696-844d-2037e00b2a94 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:28.033971 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-f9a4015e-40df-4d6f-8863-5b13c6a7f87b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lazy-loading 'fault' on Instance uuid 0671096f-ed83-4341-8f95-d138a9eebffc {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:47:28.037381 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ef6453ac-3dfc-4696-844d-2037e00b2a94 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:28.038090 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ef6453ac-3dfc-4696-844d-2037e00b2a94 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:28.040835 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ef6453ac-3dfc-4696-844d-2037e00b2a94 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:28.340274 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f9a4015e-40df-4d6f-8863-5b13c6a7f87b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:28.350247 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f9a4015e-40df-4d6f-8863-5b13c6a7f87b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc" status: 200 len: 1331 microversion: 2.1 time: 0.490035 Oct 30 01:47:28.353716 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2990/5979] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:27 2022] GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc => generated 1331 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:28.370827 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-0d6786be-1c23-4540-b49c-232323779649 req-3cbec200-ca2d-4d6f-b314-35ad6b4fa4fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0671096f-ed83-4341-8f95-d138a9eebffc", "name": "network-vif-deleted", "tag": "9693fed6-7a6c-4db5-9887-3da909c0a76e"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:47:28.415477 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-0d6786be-1c23-4540-b49c-232323779649 req-3cbec200-ca2d-4d6f-b314-35ad6b4fa4fb service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:28.417311 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-0d6786be-1c23-4540-b49c-232323779649 req-3cbec200-ca2d-4d6f-b314-35ad6b4fa4fb service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:28.418041 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-0d6786be-1c23-4540-b49c-232323779649 req-3cbec200-ca2d-4d6f-b314-35ad6b4fa4fb service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:28.458599 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-0d6786be-1c23-4540-b49c-232323779649 req-3cbec200-ca2d-4d6f-b314-35ad6b4fa4fb service nova] Creating event network-vif-deleted:9693fed6-7a6c-4db5-9887-3da909c0a76e for instance 0671096f-ed83-4341-8f95-d138a9eebffc on n-h1-master-1 Oct 30 01:47:28.475328 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-0d6786be-1c23-4540-b49c-232323779649 req-3cbec200-ca2d-4d6f-b314-35ad6b4fa4fb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117147 Oct 30 01:47:28.476198 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2991/5980] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:47:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:47:28.495288 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5565859a-c7de-47dd-83b9-47a2e602ee4f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:28.496739 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5565859a-c7de-47dd-83b9-47a2e602ee4f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: ded1b2fb-9552-4973-bf20-2c590b49e179] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:28.519590 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5565859a-c7de-47dd-83b9-47a2e602ee4f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:28.520088 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5565859a-c7de-47dd-83b9-47a2e602ee4f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:28.534263 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5565859a-c7de-47dd-83b9-47a2e602ee4f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:28.535176 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5565859a-c7de-47dd-83b9-47a2e602ee4f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:28.539411 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5565859a-c7de-47dd-83b9-47a2e602ee4f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:28.539928 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5565859a-c7de-47dd-83b9-47a2e602ee4f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:28.744106 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ef6453ac-3dfc-4696-844d-2037e00b2a94 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53d510d75542a283b7f851a58d3dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f4af2d7cc742b98447e28e3c204c11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:28.756076 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ef6453ac-3dfc-4696-844d-2037e00b2a94 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] 10.222.0.13 "GET /compute/v2.1/servers/324131f5-3ba0-4222-bb43-a20812dba495" status: 200 len: 1765 microversion: 2.1 time: 0.753205 Oct 30 01:47:28.762096 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2990/5981] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:28 2022] GET /compute/v2.1/servers/324131f5-3ba0-4222-bb43-a20812dba495 => generated 1765 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:29.171820 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5565859a-c7de-47dd-83b9-47a2e602ee4f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:29.197089 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5565859a-c7de-47dd-83b9-47a2e602ee4f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179" status: 200 len: 1510 microversion: 2.1 time: 0.719825 Oct 30 01:47:29.202776 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2992/5982] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:28 2022] GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179 => generated 1510 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:29.380340 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-329c8fe0-63d3-4281-b7ec-4f54197afe19 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:29.381005 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-329c8fe0-63d3-4281-b7ec-4f54197afe19 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 0671096f-ed83-4341-8f95-d138a9eebffc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:29.454754 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-329c8fe0-63d3-4281-b7ec-4f54197afe19 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:29.460303 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-329c8fe0-63d3-4281-b7ec-4f54197afe19 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:29.462336 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-329c8fe0-63d3-4281-b7ec-4f54197afe19 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:29.465755 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-329c8fe0-63d3-4281-b7ec-4f54197afe19 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:29.478627 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-329c8fe0-63d3-4281-b7ec-4f54197afe19 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:29.481604 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-329c8fe0-63d3-4281-b7ec-4f54197afe19 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:29.628420 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-329c8fe0-63d3-4281-b7ec-4f54197afe19 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] HTTP exception thrown: Instance 0671096f-ed83-4341-8f95-d138a9eebffc could not be found. Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-329c8fe0-63d3-4281-b7ec-4f54197afe19 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Request method failure captured: Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc HTTP/1.1 Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdcRtc4GzHkShMdH9tTupejgTwf3ZNgIcyJqp9yicfp5OD1pJcQPZv1XBaNx7doePOAnkL0JpoIe5_T8iLiz5QjNjR1hpdjjFconMkrxU8FPHulGdRMQx61K_rAf0z9mDPUn9FfJ2msqRaRZPanWCScsW3BEB8X_vbKTz8C4TVCF-Ys Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 311cde01e89442f1ab3aa930070b7343 Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-AttachVolumeNegativeTest-812748574 Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/311cde01e89442f1ab3aa930070b7343"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_311cde01e89442f1ab3aa930070b7343"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/311cde01e89442f1ab3aa930070b7343"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/311cde01e89442f1ab3aa930070b7343"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-AttachVolumeNegativeTest-812748574 Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 311cde01e89442f1ab3aa930070b7343 Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-812748574 Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-AttachVolumeNegativeTest-812748574-project Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: dcb021152c684983b31e5db439518921 Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-AttachVolumeNegativeTest-812748574-project Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 0671096f-ed83-4341-8f95-d138a9eebffc could not be found. Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '0671096f-ed83-4341-8f95-d138a9eebffc'} Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0671096f-ed83-4341-8f95-d138a9eebffc could not be found. Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0671096f-ed83-4341-8f95-d138a9eebffc could not be found. Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:47:29.630984 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:47:29.637784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:47:29.637784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:47:29.637784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:47:29.637784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:47:29.637784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:47:29.637784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0671096f-ed83-4341-8f95-d138a9eebffc could not be found. Oct 30 01:47:29.637784 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:47:29.637784 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-329c8fe0-63d3-4281-b7ec-4f54197afe19 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Returning 404 to user: Instance 0671096f-ed83-4341-8f95-d138a9eebffc could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:47:29.637784 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-329c8fe0-63d3-4281-b7ec-4f54197afe19 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc" status: 404 len: 111 microversion: 2.1 time: 0.260708 Oct 30 01:47:29.637784 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2991/5983] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:29 2022] GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc => generated 111 bytes in 266 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:47:29.646454 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-baef05c7-01ab-4f4a-add1-7d2961610a6f tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '.version_select at 0x7f44cc5d5790>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:29.783286 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-baef05c7-01ab-4f4a-add1-7d2961610a6f tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1267645079" status: 202 len: 0 microversion: 2.1 time: 0.145170 Oct 30 01:47:29.785097 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2993/5984] 10.222.0.13 () {58 vars in 1221 bytes} [Sun Oct 30 01:47:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1267645079 => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:47:29.791421 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8c2b0158-eb87-43fe-8ad4-c66e2f51a7df tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:29.792319 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8c2b0158-eb87-43fe-8ad4-c66e2f51a7df tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] [instance: 324131f5-3ba0-4222-bb43-a20812dba495] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:29.826629 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8c2b0158-eb87-43fe-8ad4-c66e2f51a7df tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:29.830435 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8c2b0158-eb87-43fe-8ad4-c66e2f51a7df tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:29.834386 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8c2b0158-eb87-43fe-8ad4-c66e2f51a7df tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:29.837094 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8c2b0158-eb87-43fe-8ad4-c66e2f51a7df tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:29.838177 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8c2b0158-eb87-43fe-8ad4-c66e2f51a7df tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:29.843734 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8c2b0158-eb87-43fe-8ad4-c66e2f51a7df tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:30.142959 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8c2b0158-eb87-43fe-8ad4-c66e2f51a7df tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53d510d75542a283b7f851a58d3dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f4af2d7cc742b98447e28e3c204c11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:30.177381 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8c2b0158-eb87-43fe-8ad4-c66e2f51a7df tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] 10.222.0.13 "GET /compute/v2.1/servers/324131f5-3ba0-4222-bb43-a20812dba495" status: 200 len: 1529 microversion: 2.1 time: 0.394681 Oct 30 01:47:30.180309 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2992/5985] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:29 2022] GET /compute/v2.1/servers/324131f5-3ba0-4222-bb43-a20812dba495 => generated 1529 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:30.227175 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-482f144b-c23c-4bd2-b14e-304f952e78da tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:30.228037 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-482f144b-c23c-4bd2-b14e-304f952e78da tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: ded1b2fb-9552-4973-bf20-2c590b49e179] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:30.249576 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-482f144b-c23c-4bd2-b14e-304f952e78da tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:30.249985 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-482f144b-c23c-4bd2-b14e-304f952e78da tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:30.253831 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-482f144b-c23c-4bd2-b14e-304f952e78da tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:30.260257 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-482f144b-c23c-4bd2-b14e-304f952e78da tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:30.267236 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-482f144b-c23c-4bd2-b14e-304f952e78da tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:30.268126 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-482f144b-c23c-4bd2-b14e-304f952e78da tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:30.556371 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-f7b08368-6ce5-458d-acba-647e6b69ccff req-9357ec17-75b6-4032-a9c9-44d999fc4144 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "324131f5-3ba0-4222-bb43-a20812dba495", "name": "network-vif-deleted", "tag": "513258c1-74aa-493d-9ce2-a04232fdcb10"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:47:30.579175 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-f7b08368-6ce5-458d-acba-647e6b69ccff req-9357ec17-75b6-4032-a9c9-44d999fc4144 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:30.579939 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-f7b08368-6ce5-458d-acba-647e6b69ccff req-9357ec17-75b6-4032-a9c9-44d999fc4144 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:30.581893 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-f7b08368-6ce5-458d-acba-647e6b69ccff req-9357ec17-75b6-4032-a9c9-44d999fc4144 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:30.598399 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-f7b08368-6ce5-458d-acba-647e6b69ccff req-9357ec17-75b6-4032-a9c9-44d999fc4144 service nova] Creating event network-vif-deleted:513258c1-74aa-493d-9ce2-a04232fdcb10 for instance 324131f5-3ba0-4222-bb43-a20812dba495 on n-h2-master-1 Oct 30 01:47:30.612576 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-f7b08368-6ce5-458d-acba-647e6b69ccff req-9357ec17-75b6-4032-a9c9-44d999fc4144 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064983 Oct 30 01:47:30.613789 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2993/5986] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:47:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:47:30.701654 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-482f144b-c23c-4bd2-b14e-304f952e78da tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:30.716136 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-482f144b-c23c-4bd2-b14e-304f952e78da tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179" status: 200 len: 1510 microversion: 2.1 time: 0.494186 Oct 30 01:47:30.721709 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2994/5987] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:30 2022] GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179 => generated 1510 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:31.207621 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9393717b-55f0-4a18-8722-c66617e30195 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:31.208332 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9393717b-55f0-4a18-8722-c66617e30195 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] [instance: 324131f5-3ba0-4222-bb43-a20812dba495] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:31.229266 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9393717b-55f0-4a18-8722-c66617e30195 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:31.234775 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9393717b-55f0-4a18-8722-c66617e30195 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:31.235431 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9393717b-55f0-4a18-8722-c66617e30195 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:31.236202 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9393717b-55f0-4a18-8722-c66617e30195 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:31.246802 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9393717b-55f0-4a18-8722-c66617e30195 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:31.247259 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9393717b-55f0-4a18-8722-c66617e30195 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:31.338730 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9393717b-55f0-4a18-8722-c66617e30195 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:31.338730 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9393717b-55f0-4a18-8722-c66617e30195 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:31.338730 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9393717b-55f0-4a18-8722-c66617e30195 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:31.338730 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-9393717b-55f0-4a18-8722-c66617e30195 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lazy-loading 'fault' on Instance uuid 324131f5-3ba0-4222-bb43-a20812dba495 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:47:31.371197 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3060db81-efb1-4077-b9f1-bd98483b9eec tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Action: 'create', calling method: .version_select at 0x7f44ccaafa60>, body: {"keypair": {"name": "tempest-keypair-1217338871", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGtuZP49Cq7DcLL+4jETIlqd6HmL7/j7qxsu/a6foukU6Vb3S+sOHiINRtZ4yNprSe5nyB0/eecg+/YSyjiBBV5ghw5I6eklI3bt1dhg5lFOXuZg4WK7vqGdb/m5c1PuA=="}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:47:31.431805 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-3060db81-efb1-4077-b9f1-bd98483b9eec tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Getting quotas for project 311cde01e89442f1ab3aa930070b7343. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:47:31.434976 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9393717b-55f0-4a18-8722-c66617e30195 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53d510d75542a283b7f851a58d3dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f4af2d7cc742b98447e28e3c204c11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:31.444241 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9393717b-55f0-4a18-8722-c66617e30195 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] 10.222.0.13 "GET /compute/v2.1/servers/324131f5-3ba0-4222-bb43-a20812dba495" status: 200 len: 1382 microversion: 2.1 time: 0.240958 Oct 30 01:47:31.454001 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2994/5988] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:31 2022] GET /compute/v2.1/servers/324131f5-3ba0-4222-bb43-a20812dba495 => generated 1382 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:31.455150 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-3060db81-efb1-4077-b9f1-bd98483b9eec tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Getting quotas for user dcb021152c684983b31e5db439518921 and project 311cde01e89442f1ab3aa930070b7343. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:47:31.585743 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3060db81-efb1-4077-b9f1-bd98483b9eec tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.218382 Oct 30 01:47:31.586742 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2995/5989] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 30 01:47:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:47:31.748415 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6f31dc6d-8aeb-45b2-941f-0729db1aef06 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:31.749077 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6f31dc6d-8aeb-45b2-941f-0729db1aef06 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: ded1b2fb-9552-4973-bf20-2c590b49e179] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:31.760308 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f31dc6d-8aeb-45b2-941f-0729db1aef06 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:31.765553 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f31dc6d-8aeb-45b2-941f-0729db1aef06 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:31.766624 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f31dc6d-8aeb-45b2-941f-0729db1aef06 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:31.767581 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f31dc6d-8aeb-45b2-941f-0729db1aef06 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:31.772456 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f31dc6d-8aeb-45b2-941f-0729db1aef06 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:31.773124 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f31dc6d-8aeb-45b2-941f-0729db1aef06 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:31.776796 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:47:32.111737 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6f31dc6d-8aeb-45b2-941f-0729db1aef06 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:32.145541 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6f31dc6d-8aeb-45b2-941f-0729db1aef06 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179" status: 200 len: 1510 microversion: 2.1 time: 0.402642 Oct 30 01:47:32.151869 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2995/5990] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:31 2022] GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179 => generated 1510 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:32.482272 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6fa67c21-b777-4466-bf24-24649c59cee7 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:32.482890 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6fa67c21-b777-4466-bf24-24649c59cee7 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] [instance: 324131f5-3ba0-4222-bb43-a20812dba495] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:32.500168 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6fa67c21-b777-4466-bf24-24649c59cee7 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:32.500994 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6fa67c21-b777-4466-bf24-24649c59cee7 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:32.505927 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6fa67c21-b777-4466-bf24-24649c59cee7 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:32.505927 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6fa67c21-b777-4466-bf24-24649c59cee7 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:32.505927 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6fa67c21-b777-4466-bf24-24649c59cee7 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:32.505927 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6fa67c21-b777-4466-bf24-24649c59cee7 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:32.534382 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-6fa67c21-b777-4466-bf24-24649c59cee7 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] HTTP exception thrown: Instance 324131f5-3ba0-4222-bb43-a20812dba495 could not be found. Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6fa67c21-b777-4466-bf24-24649c59cee7 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Request method failure captured: Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/324131f5-3ba0-4222-bb43-a20812dba495 HTTP/1.1 Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdc2EUTdXGRSl13R81I_NsTmSwjalnnU8plIjo2ff3CaCwBIIHE4qfKh-Z4Hl8U7GAKEC6uCifGCgbKlT_S3u2qP0Tzi0PR4bDyvcx_4RyuBzVB-VIaiz2GyJPJTp72IHRGD9Yv1AkL2uxAWXwCtogEVN_OsQhk8eQoEKv2y0ZJ2fLY Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 73f4af2d7cc742b98447e28e3c204c11 Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-665416734 Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/73f4af2d7cc742b98447e28e3c204c11"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_73f4af2d7cc742b98447e28e3c204c11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/73f4af2d7cc742b98447e28e3c204c11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/73f4af2d7cc742b98447e28e3c204c11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-TestSecurityGroupsBasicOps-665416734 Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 73f4af2d7cc742b98447e28e3c204c11 Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-665416734 Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-TestSecurityGroupsBasicOps-665416734-project Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 9c53d510d75542a283b7f851a58d3dbf Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-TestSecurityGroupsBasicOps-665416734-project Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 324131f5-3ba0-4222-bb43-a20812dba495 could not be found. Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '324131f5-3ba0-4222-bb43-a20812dba495'} Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 324131f5-3ba0-4222-bb43-a20812dba495 could not be found. Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 324131f5-3ba0-4222-bb43-a20812dba495 could not be found. Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:47:32.536483 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:47:32.542255 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:47:32.542255 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:47:32.542255 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:47:32.542255 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:47:32.542255 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:47:32.542255 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 324131f5-3ba0-4222-bb43-a20812dba495 could not be found. Oct 30 01:47:32.542255 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:47:32.544134 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6fa67c21-b777-4466-bf24-24649c59cee7 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Returning 404 to user: Instance 324131f5-3ba0-4222-bb43-a20812dba495 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:47:32.545221 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6fa67c21-b777-4466-bf24-24649c59cee7 tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] 10.222.0.13 "GET /compute/v2.1/servers/324131f5-3ba0-4222-bb43-a20812dba495" status: 404 len: 111 microversion: 2.1 time: 0.066907 Oct 30 01:47:32.546375 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2996/5991] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:32 2022] GET /compute/v2.1/servers/324131f5-3ba0-4222-bb43-a20812dba495 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:47:33.185845 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3adcf37d-5d6f-4790-8a54-7c3d465b10f0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:33.186455 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3adcf37d-5d6f-4790-8a54-7c3d465b10f0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: ded1b2fb-9552-4973-bf20-2c590b49e179] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:33.200994 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3adcf37d-5d6f-4790-8a54-7c3d465b10f0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:33.201643 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3adcf37d-5d6f-4790-8a54-7c3d465b10f0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:33.202356 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3adcf37d-5d6f-4790-8a54-7c3d465b10f0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:33.203314 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3adcf37d-5d6f-4790-8a54-7c3d465b10f0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:33.204099 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3adcf37d-5d6f-4790-8a54-7c3d465b10f0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:33.204782 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3adcf37d-5d6f-4790-8a54-7c3d465b10f0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:33.546264 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3adcf37d-5d6f-4790-8a54-7c3d465b10f0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:33.566723 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3adcf37d-5d6f-4790-8a54-7c3d465b10f0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179" status: 200 len: 1510 microversion: 2.1 time: 0.384828 Oct 30 01:47:33.567360 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2996/5992] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:33 2022] GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179 => generated 1510 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:34.621482 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-824a9874-55cf-4780-8409-5e48747c910f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:34.622718 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-824a9874-55cf-4780-8409-5e48747c910f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: ded1b2fb-9552-4973-bf20-2c590b49e179] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:34.636612 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-824a9874-55cf-4780-8409-5e48747c910f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:34.639313 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-824a9874-55cf-4780-8409-5e48747c910f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:34.640020 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-824a9874-55cf-4780-8409-5e48747c910f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:34.641117 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-824a9874-55cf-4780-8409-5e48747c910f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:34.641617 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-824a9874-55cf-4780-8409-5e48747c910f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:34.642048 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-824a9874-55cf-4780-8409-5e48747c910f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:35.078662 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-824a9874-55cf-4780-8409-5e48747c910f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:35.092775 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-824a9874-55cf-4780-8409-5e48747c910f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179" status: 200 len: 1510 microversion: 2.1 time: 0.475232 Oct 30 01:47:35.093665 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2997/5993] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:34 2022] GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179 => generated 1510 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:36.121619 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-76d9956f-c7b8-45c7-8627-524560b95a27 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:36.122405 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-76d9956f-c7b8-45c7-8627-524560b95a27 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: ded1b2fb-9552-4973-bf20-2c590b49e179] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:36.142828 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-76d9956f-c7b8-45c7-8627-524560b95a27 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:36.148052 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-76d9956f-c7b8-45c7-8627-524560b95a27 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:36.153313 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-76d9956f-c7b8-45c7-8627-524560b95a27 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:36.156247 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-76d9956f-c7b8-45c7-8627-524560b95a27 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:36.159670 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-76d9956f-c7b8-45c7-8627-524560b95a27 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:36.162131 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-76d9956f-c7b8-45c7-8627-524560b95a27 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:36.767059 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-76d9956f-c7b8-45c7-8627-524560b95a27 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:36.784761 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-76d9956f-c7b8-45c7-8627-524560b95a27 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179" status: 200 len: 1510 microversion: 2.1 time: 0.663030 Oct 30 01:47:36.786179 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2997/5994] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:36 2022] GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179 => generated 1510 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:47:37.808576 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-69da8417-18a4-4cde-b791-73052a5d4b9e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:37.809194 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-69da8417-18a4-4cde-b791-73052a5d4b9e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: ded1b2fb-9552-4973-bf20-2c590b49e179] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:37.817888 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-69da8417-18a4-4cde-b791-73052a5d4b9e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:37.818386 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-69da8417-18a4-4cde-b791-73052a5d4b9e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:37.819183 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-69da8417-18a4-4cde-b791-73052a5d4b9e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:37.819535 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-69da8417-18a4-4cde-b791-73052a5d4b9e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:37.831475 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-69da8417-18a4-4cde-b791-73052a5d4b9e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:37.831900 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-69da8417-18a4-4cde-b791-73052a5d4b9e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:37.850458 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8c4b1c38-5653-4897-9f94-8dba671f1692 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1189307601", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1ac83571-0ede-40a0-ae99-0e3341ce15be"}], "security_groups": [{"name": "tempest-securitygroup--1699514387"}], "key_name": "tempest-keypair-1217338871", "user_data": "}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:47:38.249615 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-8c4b1c38-5653-4897-9f94-8dba671f1692 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] validate_networks() for [('1ac83571-0ede-40a0-ae99-0e3341ce15be', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:47:38.602539 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-69da8417-18a4-4cde-b791-73052a5d4b9e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:38.618658 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-69da8417-18a4-4cde-b791-73052a5d4b9e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179" status: 200 len: 1510 microversion: 2.1 time: 0.813927 Oct 30 01:47:38.637358 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2998/5995] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:37 2022] GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179 => generated 1510 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:39.429622 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-8c4b1c38-5653-4897-9f94-8dba671f1692 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:47:39.430181 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-8c4b1c38-5653-4897-9f94-8dba671f1692 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:47:39.430725 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-8c4b1c38-5653-4897-9f94-8dba671f1692 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:47:39.431142 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-8c4b1c38-5653-4897-9f94-8dba671f1692 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:47:39.431556 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-8c4b1c38-5653-4897-9f94-8dba671f1692 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:47:39.458041 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8c4b1c38-5653-4897-9f94-8dba671f1692 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:39.458792 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8c4b1c38-5653-4897-9f94-8dba671f1692 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:39.461152 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8c4b1c38-5653-4897-9f94-8dba671f1692 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:39.461152 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8c4b1c38-5653-4897-9f94-8dba671f1692 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:39.461152 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8c4b1c38-5653-4897-9f94-8dba671f1692 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:39.466184 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8c4b1c38-5653-4897-9f94-8dba671f1692 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:39.535797 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-8c4b1c38-5653-4897-9f94-8dba671f1692 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Getting quotas for project 311cde01e89442f1ab3aa930070b7343. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:47:39.558598 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-8c4b1c38-5653-4897-9f94-8dba671f1692 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Getting quotas for user dcb021152c684983b31e5db439518921 and project 311cde01e89442f1ab3aa930070b7343. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:47:39.606648 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8c4b1c38-5653-4897-9f94-8dba671f1692 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:47:39.616705 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8c4b1c38-5653-4897-9f94-8dba671f1692 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: b1a11d01-7560-4d97-af75-2904cea5408f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:47:39.649020 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e7995c62-f6ba-49a3-aee2-000d9a17046f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:39.649667 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e7995c62-f6ba-49a3-aee2-000d9a17046f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: ded1b2fb-9552-4973-bf20-2c590b49e179] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:39.690429 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e7995c62-f6ba-49a3-aee2-000d9a17046f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:39.690429 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e7995c62-f6ba-49a3-aee2-000d9a17046f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:39.690429 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e7995c62-f6ba-49a3-aee2-000d9a17046f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:39.690429 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e7995c62-f6ba-49a3-aee2-000d9a17046f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:39.702783 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e7995c62-f6ba-49a3-aee2-000d9a17046f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:39.702783 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e7995c62-f6ba-49a3-aee2-000d9a17046f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:40.079499 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8c4b1c38-5653-4897-9f94-8dba671f1692 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.239433 Oct 30 01:47:40.141675 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2998/5996] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:47:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 2299 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:47:40.167624 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f4fd6bc8-ca58-41c2-8f50-56ed517c7e3b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:40.168261 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f4fd6bc8-ca58-41c2-8f50-56ed517c7e3b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: b1a11d01-7560-4d97-af75-2904cea5408f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:40.409775 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e7995c62-f6ba-49a3-aee2-000d9a17046f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:40.422247 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e7995c62-f6ba-49a3-aee2-000d9a17046f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179" status: 200 len: 1510 microversion: 2.1 time: 0.778276 Oct 30 01:47:40.422854 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2999/5997] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:39 2022] GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179 => generated 1510 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:47:40.505918 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f4fd6bc8-ca58-41c2-8f50-56ed517c7e3b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:40.519584 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f4fd6bc8-ca58-41c2-8f50-56ed517c7e3b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f" status: 200 len: 1242 microversion: 2.1 time: 0.374007 Oct 30 01:47:40.529859 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2999/5998] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:40 2022] GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f => generated 1242 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:41.453762 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ec89cb78-3bb9-4558-b2d8-9ee2b373aab0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:41.453762 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ec89cb78-3bb9-4558-b2d8-9ee2b373aab0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: ded1b2fb-9552-4973-bf20-2c590b49e179] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:41.475239 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ec89cb78-3bb9-4558-b2d8-9ee2b373aab0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:41.483210 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ec89cb78-3bb9-4558-b2d8-9ee2b373aab0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:41.485143 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ec89cb78-3bb9-4558-b2d8-9ee2b373aab0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:41.488806 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ec89cb78-3bb9-4558-b2d8-9ee2b373aab0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:41.492952 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ec89cb78-3bb9-4558-b2d8-9ee2b373aab0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:41.496185 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ec89cb78-3bb9-4558-b2d8-9ee2b373aab0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:41.499213 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=4 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:47:41.567742 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-008a5520-d8c7-4200-a2ed-202ee7dfcda3 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:41.574634 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-008a5520-d8c7-4200-a2ed-202ee7dfcda3 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: b1a11d01-7560-4d97-af75-2904cea5408f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:41.814722 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-008a5520-d8c7-4200-a2ed-202ee7dfcda3 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:41.824570 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-008a5520-d8c7-4200-a2ed-202ee7dfcda3 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f" status: 200 len: 1242 microversion: 2.1 time: 0.261593 Oct 30 01:47:41.828685 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3000/5999] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:41 2022] GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f => generated 1242 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:47:41.964392 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ec89cb78-3bb9-4558-b2d8-9ee2b373aab0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:41.978477 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ec89cb78-3bb9-4558-b2d8-9ee2b373aab0 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179" status: 200 len: 1510 microversion: 2.1 time: 0.531322 Oct 30 01:47:41.981450 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3000/6000] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:41 2022] GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179 => generated 1510 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:42.022704 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cdc1828b-77da-42f7-9d2a-d3b31e5fc46f tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] Calling method '.version_select at 0x7f44c7e7e940>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:42.175902 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cdc1828b-77da-42f7-9d2a-d3b31e5fc46f tempest-TestSecurityGroupsBasicOps-665416734 tempest-TestSecurityGroupsBasicOps-665416734-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-425939995" status: 202 len: 0 microversion: 2.1 time: 0.156407 Oct 30 01:47:42.177218 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3001/6001] 10.222.0.13 () {58 vars in 1275 bytes} [Sun Oct 30 01:47:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-425939995 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:47:42.863554 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7350c512-e021-4d7b-b8b9-7a0986070102 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:42.867557 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7350c512-e021-4d7b-b8b9-7a0986070102 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: b1a11d01-7560-4d97-af75-2904cea5408f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:42.871937 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:47:42.875506 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7350c512-e021-4d7b-b8b9-7a0986070102 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:42.876000 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7350c512-e021-4d7b-b8b9-7a0986070102 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:42.876442 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7350c512-e021-4d7b-b8b9-7a0986070102 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:42.877192 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7350c512-e021-4d7b-b8b9-7a0986070102 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:42.877700 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7350c512-e021-4d7b-b8b9-7a0986070102 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:42.878153 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7350c512-e021-4d7b-b8b9-7a0986070102 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:42.965005 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7350c512-e021-4d7b-b8b9-7a0986070102 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:42.973866 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7350c512-e021-4d7b-b8b9-7a0986070102 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f" status: 200 len: 1294 microversion: 2.1 time: 0.121828 Oct 30 01:47:42.974127 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3001/6002] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:42 2022] GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f => generated 1294 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:47:43.008739 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f861d1b9-2c60-4d1c-969e-e3f1ee86b6ab tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:43.012419 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f861d1b9-2c60-4d1c-969e-e3f1ee86b6ab tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: ded1b2fb-9552-4973-bf20-2c590b49e179] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:43.044380 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f861d1b9-2c60-4d1c-969e-e3f1ee86b6ab tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:43.044380 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f861d1b9-2c60-4d1c-969e-e3f1ee86b6ab tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:43.045458 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f861d1b9-2c60-4d1c-969e-e3f1ee86b6ab tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:43.046658 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f861d1b9-2c60-4d1c-969e-e3f1ee86b6ab tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:43.047353 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f861d1b9-2c60-4d1c-969e-e3f1ee86b6ab tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:43.048093 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f861d1b9-2c60-4d1c-969e-e3f1ee86b6ab tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:43.319819 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f861d1b9-2c60-4d1c-969e-e3f1ee86b6ab tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:43.353858 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f861d1b9-2c60-4d1c-969e-e3f1ee86b6ab tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179" status: 200 len: 1510 microversion: 2.1 time: 0.350843 Oct 30 01:47:43.354754 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3002/6003] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:43 2022] GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179 => generated 1510 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:44.003970 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d5dde0b4-fa9d-42ea-8fb9-419307b3527f tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:44.005665 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d5dde0b4-fa9d-42ea-8fb9-419307b3527f tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: b1a11d01-7560-4d97-af75-2904cea5408f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:44.018949 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5dde0b4-fa9d-42ea-8fb9-419307b3527f tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:44.019844 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5dde0b4-fa9d-42ea-8fb9-419307b3527f tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:44.020502 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5dde0b4-fa9d-42ea-8fb9-419307b3527f tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:44.021453 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5dde0b4-fa9d-42ea-8fb9-419307b3527f tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:44.022343 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5dde0b4-fa9d-42ea-8fb9-419307b3527f tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:44.022951 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5dde0b4-fa9d-42ea-8fb9-419307b3527f tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:44.155337 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d5dde0b4-fa9d-42ea-8fb9-419307b3527f tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:44.169065 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d5dde0b4-fa9d-42ea-8fb9-419307b3527f tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f" status: 200 len: 1312 microversion: 2.1 time: 0.170783 Oct 30 01:47:44.169935 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3002/6004] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:43 2022] GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f => generated 1312 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:44.396739 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-42a68ce0-3d0c-4cbc-a1fa-5d1cd7d8a871 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:44.398730 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-42a68ce0-3d0c-4cbc-a1fa-5d1cd7d8a871 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: ded1b2fb-9552-4973-bf20-2c590b49e179] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:44.435918 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42a68ce0-3d0c-4cbc-a1fa-5d1cd7d8a871 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:44.436925 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42a68ce0-3d0c-4cbc-a1fa-5d1cd7d8a871 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:44.445434 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42a68ce0-3d0c-4cbc-a1fa-5d1cd7d8a871 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:44.445434 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42a68ce0-3d0c-4cbc-a1fa-5d1cd7d8a871 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:44.445434 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42a68ce0-3d0c-4cbc-a1fa-5d1cd7d8a871 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:44.445434 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42a68ce0-3d0c-4cbc-a1fa-5d1cd7d8a871 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:44.776647 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-42a68ce0-3d0c-4cbc-a1fa-5d1cd7d8a871 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:44.788817 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-42a68ce0-3d0c-4cbc-a1fa-5d1cd7d8a871 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179" status: 200 len: 1507 microversion: 2.1 time: 0.399673 Oct 30 01:47:44.789447 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3003/6005] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:44 2022] GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179 => generated 1507 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:45.194704 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f0d82975-af7d-479a-955f-433e6f39f8ca tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:45.196731 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f0d82975-af7d-479a-955f-433e6f39f8ca tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: b1a11d01-7560-4d97-af75-2904cea5408f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:45.212594 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f0d82975-af7d-479a-955f-433e6f39f8ca tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:45.213318 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f0d82975-af7d-479a-955f-433e6f39f8ca tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:45.213796 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f0d82975-af7d-479a-955f-433e6f39f8ca tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:45.214495 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f0d82975-af7d-479a-955f-433e6f39f8ca tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:45.214947 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f0d82975-af7d-479a-955f-433e6f39f8ca tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:45.215370 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f0d82975-af7d-479a-955f-433e6f39f8ca tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:45.468564 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f0d82975-af7d-479a-955f-433e6f39f8ca tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:45.474730 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f0d82975-af7d-479a-955f-433e6f39f8ca tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f" status: 200 len: 1368 microversion: 2.1 time: 0.284451 Oct 30 01:47:45.494906 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3003/6006] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:45 2022] GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f => generated 1368 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:45.813625 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-08a7a95e-ab16-4f7d-a4ab-2ac46e597c3c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:45.815079 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-08a7a95e-ab16-4f7d-a4ab-2ac46e597c3c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: ded1b2fb-9552-4973-bf20-2c590b49e179] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:45.822139 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08a7a95e-ab16-4f7d-a4ab-2ac46e597c3c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:45.822718 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08a7a95e-ab16-4f7d-a4ab-2ac46e597c3c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:45.823217 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08a7a95e-ab16-4f7d-a4ab-2ac46e597c3c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:45.824150 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08a7a95e-ab16-4f7d-a4ab-2ac46e597c3c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:45.824959 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08a7a95e-ab16-4f7d-a4ab-2ac46e597c3c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:45.825594 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08a7a95e-ab16-4f7d-a4ab-2ac46e597c3c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:46.128451 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-08a7a95e-ab16-4f7d-a4ab-2ac46e597c3c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:46.137692 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-08a7a95e-ab16-4f7d-a4ab-2ac46e597c3c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179" status: 200 len: 1507 microversion: 2.1 time: 0.327909 Oct 30 01:47:46.138274 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3004/6007] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:45 2022] GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179 => generated 1507 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:46.509694 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-dc332d2c-cfc8-49d7-9147-94cd3f6bd8a0 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:46.519137 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-7c848483-b4ad-48c8-98df-ef897830fb42 req-b7c624ca-406c-429d-9537-aae36cb183fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ded1b2fb-9552-4973-bf20-2c590b49e179", "name": "network-vif-unplugged", "status": "completed", "tag": "94a9922b-c61b-418a-981f-f3039568b8ea"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:47:46.521960 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-dc332d2c-cfc8-49d7-9147-94cd3f6bd8a0 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: b1a11d01-7560-4d97-af75-2904cea5408f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:46.548833 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc332d2c-cfc8-49d7-9147-94cd3f6bd8a0 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:46.548833 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc332d2c-cfc8-49d7-9147-94cd3f6bd8a0 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:46.548833 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc332d2c-cfc8-49d7-9147-94cd3f6bd8a0 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:46.548833 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc332d2c-cfc8-49d7-9147-94cd3f6bd8a0 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:46.548833 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc332d2c-cfc8-49d7-9147-94cd3f6bd8a0 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:46.550007 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc332d2c-cfc8-49d7-9147-94cd3f6bd8a0 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:46.557960 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-7c848483-b4ad-48c8-98df-ef897830fb42 req-b7c624ca-406c-429d-9537-aae36cb183fe service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:46.569119 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-7c848483-b4ad-48c8-98df-ef897830fb42 req-b7c624ca-406c-429d-9537-aae36cb183fe service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:46.570174 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-7c848483-b4ad-48c8-98df-ef897830fb42 req-b7c624ca-406c-429d-9537-aae36cb183fe service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:46.621247 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-7c848483-b4ad-48c8-98df-ef897830fb42 req-b7c624ca-406c-429d-9537-aae36cb183fe service nova] Creating event network-vif-unplugged:94a9922b-c61b-418a-981f-f3039568b8ea for instance ded1b2fb-9552-4973-bf20-2c590b49e179 on n-h2-master-1 Oct 30 01:47:46.635015 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-7c848483-b4ad-48c8-98df-ef897830fb42 req-b7c624ca-406c-429d-9537-aae36cb183fe service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.143046 Oct 30 01:47:46.639444 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3004/6008] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:47:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:47:47.166050 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fab60952-c725-4daa-a051-dc47732ff6c7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:47.166896 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fab60952-c725-4daa-a051-dc47732ff6c7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: ded1b2fb-9552-4973-bf20-2c590b49e179] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:47.176510 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fab60952-c725-4daa-a051-dc47732ff6c7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:47.177829 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fab60952-c725-4daa-a051-dc47732ff6c7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:47.178454 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fab60952-c725-4daa-a051-dc47732ff6c7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:47.179804 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fab60952-c725-4daa-a051-dc47732ff6c7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:47.180432 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fab60952-c725-4daa-a051-dc47732ff6c7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:47.181156 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fab60952-c725-4daa-a051-dc47732ff6c7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:47.386241 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-dc332d2c-cfc8-49d7-9147-94cd3f6bd8a0 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:47.409018 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-dc332d2c-cfc8-49d7-9147-94cd3f6bd8a0 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f" status: 200 len: 1368 microversion: 2.1 time: 0.912380 Oct 30 01:47:47.415398 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3005/6009] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:46 2022] GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f => generated 1368 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:47.537839 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-fab60952-c725-4daa-a051-dc47732ff6c7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:47.546474 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fab60952-c725-4daa-a051-dc47732ff6c7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179" status: 200 len: 1507 microversion: 2.1 time: 0.386916 Oct 30 01:47:47.547363 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3005/6010] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:47 2022] GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179 => generated 1507 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:47.625042 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-64e889c7-fd65-43b0-b0b2-c9677bb906d1 req-4e526a08-83cf-4cda-a1b8-2fb0e7994b50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1a11d01-7560-4d97-af75-2904cea5408f", "tag": "10cb167f-2464-4262-8c62-e8e2481f80bc"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:47:47.644845 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-64e889c7-fd65-43b0-b0b2-c9677bb906d1 req-4e526a08-83cf-4cda-a1b8-2fb0e7994b50 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:47.645594 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-64e889c7-fd65-43b0-b0b2-c9677bb906d1 req-4e526a08-83cf-4cda-a1b8-2fb0e7994b50 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:47.646340 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-64e889c7-fd65-43b0-b0b2-c9677bb906d1 req-4e526a08-83cf-4cda-a1b8-2fb0e7994b50 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:47.691893 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-64e889c7-fd65-43b0-b0b2-c9677bb906d1 req-4e526a08-83cf-4cda-a1b8-2fb0e7994b50 service nova] Creating event network-changed:10cb167f-2464-4262-8c62-e8e2481f80bc for instance b1a11d01-7560-4d97-af75-2904cea5408f on n-h1-master-1 Oct 30 01:47:47.703699 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-64e889c7-fd65-43b0-b0b2-c9677bb906d1 req-4e526a08-83cf-4cda-a1b8-2fb0e7994b50 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081713 Oct 30 01:47:47.704752 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3006/6011] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:47:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:47:48.435915 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ccb65253-90bf-4c8d-9bc1-9b191f631406 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:48.436744 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ccb65253-90bf-4c8d-9bc1-9b191f631406 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: b1a11d01-7560-4d97-af75-2904cea5408f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:48.448512 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ccb65253-90bf-4c8d-9bc1-9b191f631406 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:48.450315 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ccb65253-90bf-4c8d-9bc1-9b191f631406 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:48.455653 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ccb65253-90bf-4c8d-9bc1-9b191f631406 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:48.455653 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ccb65253-90bf-4c8d-9bc1-9b191f631406 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:48.455653 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ccb65253-90bf-4c8d-9bc1-9b191f631406 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:48.455653 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ccb65253-90bf-4c8d-9bc1-9b191f631406 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:48.573482 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-81af8ecb-ffcb-4983-9d21-4b30926c9f83 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:48.577591 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-81af8ecb-ffcb-4983-9d21-4b30926c9f83 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: ded1b2fb-9552-4973-bf20-2c590b49e179] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:48.591745 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-81af8ecb-ffcb-4983-9d21-4b30926c9f83 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:48.595004 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-81af8ecb-ffcb-4983-9d21-4b30926c9f83 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:48.596912 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-81af8ecb-ffcb-4983-9d21-4b30926c9f83 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:48.600156 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-81af8ecb-ffcb-4983-9d21-4b30926c9f83 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:48.602280 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-81af8ecb-ffcb-4983-9d21-4b30926c9f83 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:48.605447 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-81af8ecb-ffcb-4983-9d21-4b30926c9f83 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:48.887090 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ccb65253-90bf-4c8d-9bc1-9b191f631406 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:48.904959 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ccb65253-90bf-4c8d-9bc1-9b191f631406 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f" status: 200 len: 1368 microversion: 2.1 time: 0.473256 Oct 30 01:47:48.919982 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3006/6012] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:48 2022] GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f => generated 1368 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:48.924572 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-81af8ecb-ffcb-4983-9d21-4b30926c9f83 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:48.938826 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-81af8ecb-ffcb-4983-9d21-4b30926c9f83 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179" status: 200 len: 1510 microversion: 2.1 time: 0.372097 Oct 30 01:47:48.940747 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3007/6013] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:48 2022] GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179 => generated 1510 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:47:48.969964 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a0f82e7f-3638-4c1c-b25b-d44a56537094 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:48.969964 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a0f82e7f-3638-4c1c-b25b-d44a56537094 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:48.973999 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a0f82e7f-3638-4c1c-b25b-d44a56537094 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:48.974804 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a0f82e7f-3638-4c1c-b25b-d44a56537094 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:48.975586 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a0f82e7f-3638-4c1c-b25b-d44a56537094 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:48.977075 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a0f82e7f-3638-4c1c-b25b-d44a56537094 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:48.977771 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a0f82e7f-3638-4c1c-b25b-d44a56537094 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:48.978373 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a0f82e7f-3638-4c1c-b25b-d44a56537094 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:49.208465 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a0f82e7f-3638-4c1c-b25b-d44a56537094 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:49.226316 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a0f82e7f-3638-4c1c-b25b-d44a56537094 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1670 microversion: 2.1 time: 0.264968 Oct 30 01:47:49.240875 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3007/6014] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:48 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1670 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:49.255480 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4ff857c3-dce2-4d2e-b634-127c852f726b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:49.256030 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4ff857c3-dce2-4d2e-b634-127c852f726b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:49.262395 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4ff857c3-dce2-4d2e-b634-127c852f726b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:49.262880 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4ff857c3-dce2-4d2e-b634-127c852f726b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:49.263314 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4ff857c3-dce2-4d2e-b634-127c852f726b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:49.264055 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4ff857c3-dce2-4d2e-b634-127c852f726b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:49.264499 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4ff857c3-dce2-4d2e-b634-127c852f726b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:49.264968 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4ff857c3-dce2-4d2e-b634-127c852f726b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:49.413710 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4ff857c3-dce2-4d2e-b634-127c852f726b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:49.422374 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4ff857c3-dce2-4d2e-b634-127c852f726b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1670 microversion: 2.1 time: 0.171261 Oct 30 01:47:49.425831 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3008/6015] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:49 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1670 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:49.448752 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-36b0c7d7-8b36-4871-9a66-a44e552e361a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:49.448752 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-36b0c7d7-8b36-4871-9a66-a44e552e361a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:49.458114 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-36b0c7d7-8b36-4871-9a66-a44e552e361a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:49.461792 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-36b0c7d7-8b36-4871-9a66-a44e552e361a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:49.462485 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-36b0c7d7-8b36-4871-9a66-a44e552e361a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:49.463320 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-36b0c7d7-8b36-4871-9a66-a44e552e361a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:49.463849 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-36b0c7d7-8b36-4871-9a66-a44e552e361a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:49.464342 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-36b0c7d7-8b36-4871-9a66-a44e552e361a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:49.656542 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-36b0c7d7-8b36-4871-9a66-a44e552e361a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:49.674822 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:47:49.690799 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-36b0c7d7-8b36-4871-9a66-a44e552e361a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1670 microversion: 2.1 time: 0.241854 Oct 30 01:47:49.691495 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3008/6016] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:49 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1670 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:49.717381 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-53f216c4-47a7-4cfa-828a-e590d1e3560b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:49.718128 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-53f216c4-47a7-4cfa-828a-e590d1e3560b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:49.720327 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:47:49.732789 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-53f216c4-47a7-4cfa-828a-e590d1e3560b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:49.740746 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-53f216c4-47a7-4cfa-828a-e590d1e3560b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:49.740746 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-53f216c4-47a7-4cfa-828a-e590d1e3560b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:49.740746 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-53f216c4-47a7-4cfa-828a-e590d1e3560b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:49.740746 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-53f216c4-47a7-4cfa-828a-e590d1e3560b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:49.740746 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-53f216c4-47a7-4cfa-828a-e590d1e3560b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:49.901959 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-53f216c4-47a7-4cfa-828a-e590d1e3560b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:49.911158 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-53f216c4-47a7-4cfa-828a-e590d1e3560b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1670 microversion: 2.1 time: 0.197337 Oct 30 01:47:49.911158 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3009/6017] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:49 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1670 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:49.930855 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-44069169-2f0e-4578-8afd-6e48f72cd97c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:49.934223 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-44069169-2f0e-4578-8afd-6e48f72cd97c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: b1a11d01-7560-4d97-af75-2904cea5408f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:49.937049 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1e44051b-c308-4220-a880-7e4ffe11f0dd tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:47:49.942303 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44069169-2f0e-4578-8afd-6e48f72cd97c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:49.945742 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44069169-2f0e-4578-8afd-6e48f72cd97c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:49.945742 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44069169-2f0e-4578-8afd-6e48f72cd97c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:49.945938 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1e44051b-c308-4220-a880-7e4ffe11f0dd tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:49.945938 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1e44051b-c308-4220-a880-7e4ffe11f0dd tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:49.945938 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1e44051b-c308-4220-a880-7e4ffe11f0dd tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:49.955801 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44069169-2f0e-4578-8afd-6e48f72cd97c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:49.956424 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44069169-2f0e-4578-8afd-6e48f72cd97c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:49.958008 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44069169-2f0e-4578-8afd-6e48f72cd97c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:49.974722 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1e44051b-c308-4220-a880-7e4ffe11f0dd tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Going to try to stop instance {{(pid=121103) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 30 01:47:50.171605 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-44069169-2f0e-4578-8afd-6e48f72cd97c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:50.182648 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-44069169-2f0e-4578-8afd-6e48f72cd97c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f" status: 200 len: 1368 microversion: 2.1 time: 0.255909 Oct 30 01:47:50.183830 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3009/6018] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:49 2022] GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f => generated 1368 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:50.209716 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1e44051b-c308-4220-a880-7e4ffe11f0dd tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "POST /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9/action" status: 202 len: 0 microversion: 2.1 time: 0.276780 Oct 30 01:47:50.213813 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3010/6019] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:47:49 2022] POST /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:47:50.233030 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a4247c40-1f78-4d9d-bea3-1af604929466 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:50.235703 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a4247c40-1f78-4d9d-bea3-1af604929466 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:50.247008 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a4247c40-1f78-4d9d-bea3-1af604929466 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:50.247008 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a4247c40-1f78-4d9d-bea3-1af604929466 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:50.247008 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a4247c40-1f78-4d9d-bea3-1af604929466 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:50.247483 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a4247c40-1f78-4d9d-bea3-1af604929466 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:50.248768 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a4247c40-1f78-4d9d-bea3-1af604929466 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:50.249652 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a4247c40-1f78-4d9d-bea3-1af604929466 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:50.475996 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a4247c40-1f78-4d9d-bea3-1af604929466 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:50.485916 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a4247c40-1f78-4d9d-bea3-1af604929466 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1680 microversion: 2.1 time: 0.268067 Oct 30 01:47:50.487109 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3010/6020] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:50 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1680 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:51.207795 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c4218ae6-aa77-47c7-8f72-789c513e03b8 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:51.208578 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c4218ae6-aa77-47c7-8f72-789c513e03b8 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: b1a11d01-7560-4d97-af75-2904cea5408f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:51.222834 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c4218ae6-aa77-47c7-8f72-789c513e03b8 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:51.223346 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c4218ae6-aa77-47c7-8f72-789c513e03b8 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:51.224029 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c4218ae6-aa77-47c7-8f72-789c513e03b8 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:51.224933 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c4218ae6-aa77-47c7-8f72-789c513e03b8 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:51.225597 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c4218ae6-aa77-47c7-8f72-789c513e03b8 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:51.226201 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c4218ae6-aa77-47c7-8f72-789c513e03b8 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:51.483065 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c4218ae6-aa77-47c7-8f72-789c513e03b8 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:51.490048 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c4218ae6-aa77-47c7-8f72-789c513e03b8 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f" status: 200 len: 1368 microversion: 2.1 time: 0.287126 Oct 30 01:47:51.505460 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3011/6021] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:51 2022] GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f => generated 1368 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:51.514874 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-70f954e6-9c45-497c-adb5-2d54ef412b83 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:51.515498 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-70f954e6-9c45-497c-adb5-2d54ef412b83 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:51.535089 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-70f954e6-9c45-497c-adb5-2d54ef412b83 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:51.542610 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-70f954e6-9c45-497c-adb5-2d54ef412b83 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:51.543071 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-70f954e6-9c45-497c-adb5-2d54ef412b83 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:51.543823 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-70f954e6-9c45-497c-adb5-2d54ef412b83 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:51.545074 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-70f954e6-9c45-497c-adb5-2d54ef412b83 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:51.545719 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-70f954e6-9c45-497c-adb5-2d54ef412b83 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:51.751451 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-70f954e6-9c45-497c-adb5-2d54ef412b83 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:51.770823 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-70f954e6-9c45-497c-adb5-2d54ef412b83 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1680 microversion: 2.1 time: 0.250903 Oct 30 01:47:51.770823 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3011/6022] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:51 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1680 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:52.520954 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e2516fb1-2ac3-436d-9792-2b6ff76a3b78 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:52.521837 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e2516fb1-2ac3-436d-9792-2b6ff76a3b78 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: b1a11d01-7560-4d97-af75-2904cea5408f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:52.531624 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=10 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:47:52.536178 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2516fb1-2ac3-436d-9792-2b6ff76a3b78 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:52.536668 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2516fb1-2ac3-436d-9792-2b6ff76a3b78 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:52.542012 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2516fb1-2ac3-436d-9792-2b6ff76a3b78 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:52.542958 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2516fb1-2ac3-436d-9792-2b6ff76a3b78 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:52.543608 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2516fb1-2ac3-436d-9792-2b6ff76a3b78 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:52.544449 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2516fb1-2ac3-436d-9792-2b6ff76a3b78 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:52.778863 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e2516fb1-2ac3-436d-9792-2b6ff76a3b78 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:52.792369 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c43b5279-a597-421b-99f9-fa1ff845b72c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:52.794102 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c43b5279-a597-421b-99f9-fa1ff845b72c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:52.803438 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e2516fb1-2ac3-436d-9792-2b6ff76a3b78 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f" status: 200 len: 1368 microversion: 2.1 time: 0.287730 Oct 30 01:47:52.803668 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c43b5279-a597-421b-99f9-fa1ff845b72c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:52.804352 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c43b5279-a597-421b-99f9-fa1ff845b72c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:52.804517 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3012/6023] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:52 2022] GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f => generated 1368 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:52.805388 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c43b5279-a597-421b-99f9-fa1ff845b72c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:52.806278 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c43b5279-a597-421b-99f9-fa1ff845b72c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:52.806891 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c43b5279-a597-421b-99f9-fa1ff845b72c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:52.807325 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c43b5279-a597-421b-99f9-fa1ff845b72c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:52.990578 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c43b5279-a597-421b-99f9-fa1ff845b72c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:52.999318 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c43b5279-a597-421b-99f9-fa1ff845b72c tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1680 microversion: 2.1 time: 0.211109 Oct 30 01:47:53.000066 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3012/6024] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:52 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1680 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:47:53.827491 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-48690beb-3224-49e8-aa12-39bab857afe6 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:53.828312 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-48690beb-3224-49e8-aa12-39bab857afe6 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: b1a11d01-7560-4d97-af75-2904cea5408f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:53.831157 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:47:53.840970 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-48690beb-3224-49e8-aa12-39bab857afe6 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:53.841517 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-48690beb-3224-49e8-aa12-39bab857afe6 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:53.841964 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-48690beb-3224-49e8-aa12-39bab857afe6 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:53.842689 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-48690beb-3224-49e8-aa12-39bab857afe6 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:53.843153 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-48690beb-3224-49e8-aa12-39bab857afe6 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:53.843654 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-48690beb-3224-49e8-aa12-39bab857afe6 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:54.024176 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a52981eb-d33c-431d-9430-1aefb5a1cdb6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:54.024868 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a52981eb-d33c-431d-9430-1aefb5a1cdb6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:54.042894 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a52981eb-d33c-431d-9430-1aefb5a1cdb6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:54.043411 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a52981eb-d33c-431d-9430-1aefb5a1cdb6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:54.044101 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a52981eb-d33c-431d-9430-1aefb5a1cdb6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:54.044843 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a52981eb-d33c-431d-9430-1aefb5a1cdb6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:54.045308 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a52981eb-d33c-431d-9430-1aefb5a1cdb6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:54.045784 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a52981eb-d33c-431d-9430-1aefb5a1cdb6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:54.153362 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-48690beb-3224-49e8-aa12-39bab857afe6 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:54.169447 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-48690beb-3224-49e8-aa12-39bab857afe6 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f" status: 200 len: 1368 microversion: 2.1 time: 0.340220 Oct 30 01:47:54.170322 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3013/6025] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:53 2022] GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f => generated 1368 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:54.241414 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a52981eb-d33c-431d-9430-1aefb5a1cdb6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:54.258689 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a52981eb-d33c-431d-9430-1aefb5a1cdb6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1680 microversion: 2.1 time: 0.238440 Oct 30 01:47:54.285504 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3013/6026] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:54 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1680 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:47:54.611664 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-d027aef5-e1c6-426f-b18a-5919101bdc0d req-2ed7df09-b6a5-4e65-87f9-c8f7b51047e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1a11d01-7560-4d97-af75-2904cea5408f", "name": "network-vif-plugged", "status": "completed", "tag": "10cb167f-2464-4262-8c62-e8e2481f80bc"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:47:54.640062 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d027aef5-e1c6-426f-b18a-5919101bdc0d req-2ed7df09-b6a5-4e65-87f9-c8f7b51047e3 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:54.640778 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d027aef5-e1c6-426f-b18a-5919101bdc0d req-2ed7df09-b6a5-4e65-87f9-c8f7b51047e3 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:54.650571 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d027aef5-e1c6-426f-b18a-5919101bdc0d req-2ed7df09-b6a5-4e65-87f9-c8f7b51047e3 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:54.670992 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-d027aef5-e1c6-426f-b18a-5919101bdc0d req-2ed7df09-b6a5-4e65-87f9-c8f7b51047e3 service nova] Creating event network-vif-plugged:10cb167f-2464-4262-8c62-e8e2481f80bc for instance b1a11d01-7560-4d97-af75-2904cea5408f on n-h1-master-1 Oct 30 01:47:54.680511 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-d027aef5-e1c6-426f-b18a-5919101bdc0d req-2ed7df09-b6a5-4e65-87f9-c8f7b51047e3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073072 Oct 30 01:47:54.682746 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3014/6027] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:47:55.097715 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-99792fad-df35-4c74-a8bc-c11557f78da4 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-422806565", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "b8178cef-11d7-4300-9d9c-b127ed58ff3f"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:47:55.172870 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-99792fad-df35-4c74-a8bc-c11557f78da4 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] validate_networks() for [('b8178cef-11d7-4300-9d9c-b127ed58ff3f', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:47:55.193694 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b55aa876-0fe9-4a3c-b998-2c194e7ae83e tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:55.195170 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b55aa876-0fe9-4a3c-b998-2c194e7ae83e tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: b1a11d01-7560-4d97-af75-2904cea5408f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:55.204062 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b55aa876-0fe9-4a3c-b998-2c194e7ae83e tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:55.205000 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b55aa876-0fe9-4a3c-b998-2c194e7ae83e tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:55.205618 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b55aa876-0fe9-4a3c-b998-2c194e7ae83e tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:55.206502 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b55aa876-0fe9-4a3c-b998-2c194e7ae83e tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:55.207247 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b55aa876-0fe9-4a3c-b998-2c194e7ae83e tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:55.208319 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b55aa876-0fe9-4a3c-b998-2c194e7ae83e tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:55.510354 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b55aa876-0fe9-4a3c-b998-2c194e7ae83e tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:55.513879 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:47:55.527560 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b55aa876-0fe9-4a3c-b998-2c194e7ae83e tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f" status: 200 len: 1368 microversion: 2.1 time: 0.338967 Oct 30 01:47:55.545859 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3015/6028] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:55 2022] GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f => generated 1368 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:47:55.552525 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5c387ba2-475d-495f-a0b4-83ed399e0cfe tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:55.553443 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5c387ba2-475d-495f-a0b4-83ed399e0cfe tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:55.560730 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5c387ba2-475d-495f-a0b4-83ed399e0cfe tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:55.561557 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5c387ba2-475d-495f-a0b4-83ed399e0cfe tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:55.562238 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5c387ba2-475d-495f-a0b4-83ed399e0cfe tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:55.563171 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5c387ba2-475d-495f-a0b4-83ed399e0cfe tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:55.563835 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5c387ba2-475d-495f-a0b4-83ed399e0cfe tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:55.564516 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5c387ba2-475d-495f-a0b4-83ed399e0cfe tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:55.852730 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5c387ba2-475d-495f-a0b4-83ed399e0cfe tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:55.863184 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5c387ba2-475d-495f-a0b4-83ed399e0cfe tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1680 microversion: 2.1 time: 0.315622 Oct 30 01:47:55.869999 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3016/6029] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:55 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1680 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:55.890962 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-99792fad-df35-4c74-a8bc-c11557f78da4 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:47:55.894737 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-99792fad-df35-4c74-a8bc-c11557f78da4 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:47:55.902155 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-99792fad-df35-4c74-a8bc-c11557f78da4 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:47:55.902815 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-99792fad-df35-4c74-a8bc-c11557f78da4 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:47:55.903450 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-99792fad-df35-4c74-a8bc-c11557f78da4 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:47:55.915795 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-99792fad-df35-4c74-a8bc-c11557f78da4 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:55.916905 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-99792fad-df35-4c74-a8bc-c11557f78da4 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:55.917598 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-99792fad-df35-4c74-a8bc-c11557f78da4 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:55.918594 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-99792fad-df35-4c74-a8bc-c11557f78da4 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:55.919290 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-99792fad-df35-4c74-a8bc-c11557f78da4 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:55.919981 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-99792fad-df35-4c74-a8bc-c11557f78da4 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:55.946927 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-99792fad-df35-4c74-a8bc-c11557f78da4 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Getting quotas for project 96f00019b8a440b994269dce91d83768. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:47:55.954445 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-99792fad-df35-4c74-a8bc-c11557f78da4 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Getting quotas for user 44d699d4b51d4dc8ac1d8ff5aee36290 and project 96f00019b8a440b994269dce91d83768. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:47:55.976421 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-99792fad-df35-4c74-a8bc-c11557f78da4 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:47:55.979080 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-99792fad-df35-4c74-a8bc-c11557f78da4 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] [instance: 93431237-06a2-41b5-a732-ddcdfada26d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:47:56.102261 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-99792fad-df35-4c74-a8bc-c11557f78da4 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.236130 Oct 30 01:47:56.103803 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3014/6030] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:47:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1239 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 30 01:47:56.117081 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-487531ab-afae-41b0-b3d7-0b2984494a8b tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:56.118048 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-487531ab-afae-41b0-b3d7-0b2984494a8b tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] [instance: 93431237-06a2-41b5-a732-ddcdfada26d1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:56.219517 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-487531ab-afae-41b0-b3d7-0b2984494a8b tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d699d4b51d4dc8ac1d8ff5aee36290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f00019b8a440b994269dce91d83768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:56.241523 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-487531ab-afae-41b0-b3d7-0b2984494a8b tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] 10.222.0.13 "GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1" status: 200 len: 1214 microversion: 2.1 time: 0.129508 Oct 30 01:47:56.242973 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3017/6031] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:56 2022] GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1 => generated 1214 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:56.557881 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f86a5138-3b08-40e1-9c89-067f567984b4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:56.558982 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f86a5138-3b08-40e1-9c89-067f567984b4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: b1a11d01-7560-4d97-af75-2904cea5408f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:56.566031 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f86a5138-3b08-40e1-9c89-067f567984b4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:56.567244 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f86a5138-3b08-40e1-9c89-067f567984b4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:56.568864 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f86a5138-3b08-40e1-9c89-067f567984b4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:56.571195 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f86a5138-3b08-40e1-9c89-067f567984b4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:56.571750 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f86a5138-3b08-40e1-9c89-067f567984b4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:56.572191 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f86a5138-3b08-40e1-9c89-067f567984b4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:56.791084 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f86a5138-3b08-40e1-9c89-067f567984b4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:56.802290 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f86a5138-3b08-40e1-9c89-067f567984b4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f" status: 200 len: 1368 microversion: 2.1 time: 0.248282 Oct 30 01:47:56.802890 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3015/6032] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:56 2022] GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f => generated 1368 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:56.886565 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f0add74f-e417-424e-b38a-fb9a99292b5e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:56.887194 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f0add74f-e417-424e-b38a-fb9a99292b5e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:56.897274 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f0add74f-e417-424e-b38a-fb9a99292b5e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:56.897829 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f0add74f-e417-424e-b38a-fb9a99292b5e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:56.898292 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f0add74f-e417-424e-b38a-fb9a99292b5e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:56.899072 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f0add74f-e417-424e-b38a-fb9a99292b5e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:56.899733 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f0add74f-e417-424e-b38a-fb9a99292b5e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:56.899950 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f0add74f-e417-424e-b38a-fb9a99292b5e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:57.050893 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f0add74f-e417-424e-b38a-fb9a99292b5e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:57.058956 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f0add74f-e417-424e-b38a-fb9a99292b5e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1680 microversion: 2.1 time: 0.176361 Oct 30 01:47:57.059678 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3018/6033] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:56 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1680 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:57.265937 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0fa292c5-4d1a-4007-a86e-b04c14f343e7 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:57.267847 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0fa292c5-4d1a-4007-a86e-b04c14f343e7 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] [instance: 93431237-06a2-41b5-a732-ddcdfada26d1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:57.338025 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0fa292c5-4d1a-4007-a86e-b04c14f343e7 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d699d4b51d4dc8ac1d8ff5aee36290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f00019b8a440b994269dce91d83768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:57.346171 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0fa292c5-4d1a-4007-a86e-b04c14f343e7 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] 10.222.0.13 "GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1" status: 200 len: 1214 microversion: 2.1 time: 0.083679 Oct 30 01:47:57.347099 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3016/6034] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:57 2022] GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:57.826146 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-91debe41-a2f7-4937-99c6-7d69a31c74ac tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:57.827545 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-91debe41-a2f7-4937-99c6-7d69a31c74ac tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: b1a11d01-7560-4d97-af75-2904cea5408f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:57.836432 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91debe41-a2f7-4937-99c6-7d69a31c74ac tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:57.837494 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91debe41-a2f7-4937-99c6-7d69a31c74ac tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:57.838132 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91debe41-a2f7-4937-99c6-7d69a31c74ac tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:57.839152 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91debe41-a2f7-4937-99c6-7d69a31c74ac tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:57.839780 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91debe41-a2f7-4937-99c6-7d69a31c74ac tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:57.840382 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91debe41-a2f7-4937-99c6-7d69a31c74ac tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:58.040751 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-91debe41-a2f7-4937-99c6-7d69a31c74ac tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:58.053214 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-91debe41-a2f7-4937-99c6-7d69a31c74ac tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f" status: 200 len: 1557 microversion: 2.1 time: 0.228862 Oct 30 01:47:58.053214 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3019/6035] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:57 2022] GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f => generated 1557 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:58.082605 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6d8da75c-1226-47b6-b1a6-3725b00e17eb tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:58.083114 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6d8da75c-1226-47b6-b1a6-3725b00e17eb tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: b1a11d01-7560-4d97-af75-2904cea5408f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:58.091319 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d8da75c-1226-47b6-b1a6-3725b00e17eb tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:58.091822 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d8da75c-1226-47b6-b1a6-3725b00e17eb tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:58.093259 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d8da75c-1226-47b6-b1a6-3725b00e17eb tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:58.094050 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d8da75c-1226-47b6-b1a6-3725b00e17eb tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:58.094519 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d8da75c-1226-47b6-b1a6-3725b00e17eb tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:58.094954 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d8da75c-1226-47b6-b1a6-3725b00e17eb tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:58.102926 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b36670a6-bc00-4c32-adf2-0d3161eb30f7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:58.102926 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b36670a6-bc00-4c32-adf2-0d3161eb30f7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:58.114751 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b36670a6-bc00-4c32-adf2-0d3161eb30f7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:58.117220 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b36670a6-bc00-4c32-adf2-0d3161eb30f7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:58.117772 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b36670a6-bc00-4c32-adf2-0d3161eb30f7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:58.118496 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b36670a6-bc00-4c32-adf2-0d3161eb30f7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:58.118951 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b36670a6-bc00-4c32-adf2-0d3161eb30f7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:58.123895 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b36670a6-bc00-4c32-adf2-0d3161eb30f7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:58.308783 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6d8da75c-1226-47b6-b1a6-3725b00e17eb tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.232404 Oct 30 01:47:58.309417 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3017/6036] 10.222.0.13 () {58 vars in 1275 bytes} [Sun Oct 30 01:47:58 2022] GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f/os-interface => generated 284 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:47:58.368359 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b36670a6-bc00-4c32-adf2-0d3161eb30f7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:58.378380 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c24673f4-6e6f-4aac-942a-a8fb9121ff6d tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:58.382912 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c24673f4-6e6f-4aac-942a-a8fb9121ff6d tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] [instance: 93431237-06a2-41b5-a732-ddcdfada26d1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:58.383042 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b36670a6-bc00-4c32-adf2-0d3161eb30f7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1680 microversion: 2.1 time: 0.290159 Oct 30 01:47:58.383042 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3020/6037] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:58 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1680 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:47:58.403844 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c24673f4-6e6f-4aac-942a-a8fb9121ff6d tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:58.404351 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c24673f4-6e6f-4aac-942a-a8fb9121ff6d tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:58.404922 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c24673f4-6e6f-4aac-942a-a8fb9121ff6d tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:58.405636 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c24673f4-6e6f-4aac-942a-a8fb9121ff6d tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:58.406100 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c24673f4-6e6f-4aac-942a-a8fb9121ff6d tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:58.406531 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c24673f4-6e6f-4aac-942a-a8fb9121ff6d tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:58.488578 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c24673f4-6e6f-4aac-942a-a8fb9121ff6d tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d699d4b51d4dc8ac1d8ff5aee36290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f00019b8a440b994269dce91d83768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:58.509682 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c24673f4-6e6f-4aac-942a-a8fb9121ff6d tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] 10.222.0.13 "GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1" status: 200 len: 1266 microversion: 2.1 time: 0.135721 Oct 30 01:47:58.511730 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3018/6038] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:58 2022] GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1 => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:47:59.409794 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b35b7067-2cdd-43a2-9725-a2f08ebdbe41 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:59.410463 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b35b7067-2cdd-43a2-9725-a2f08ebdbe41 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:59.435167 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b35b7067-2cdd-43a2-9725-a2f08ebdbe41 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:59.435714 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b35b7067-2cdd-43a2-9725-a2f08ebdbe41 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:59.436176 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b35b7067-2cdd-43a2-9725-a2f08ebdbe41 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:59.439891 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b35b7067-2cdd-43a2-9725-a2f08ebdbe41 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:59.440381 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b35b7067-2cdd-43a2-9725-a2f08ebdbe41 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:59.440827 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b35b7067-2cdd-43a2-9725-a2f08ebdbe41 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:59.534256 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0f3e370f-89b1-40d9-b589-b48402b4fcd3 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:47:59.534863 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0f3e370f-89b1-40d9-b589-b48402b4fcd3 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] [instance: 93431237-06a2-41b5-a732-ddcdfada26d1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:47:59.543006 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0f3e370f-89b1-40d9-b589-b48402b4fcd3 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:59.543500 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0f3e370f-89b1-40d9-b589-b48402b4fcd3 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:59.543930 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0f3e370f-89b1-40d9-b589-b48402b4fcd3 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:59.544630 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0f3e370f-89b1-40d9-b589-b48402b4fcd3 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:47:59.545082 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0f3e370f-89b1-40d9-b589-b48402b4fcd3 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:47:59.545563 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0f3e370f-89b1-40d9-b589-b48402b4fcd3 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:47:59.668729 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0f3e370f-89b1-40d9-b589-b48402b4fcd3 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d699d4b51d4dc8ac1d8ff5aee36290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f00019b8a440b994269dce91d83768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:47:59.679348 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0f3e370f-89b1-40d9-b589-b48402b4fcd3 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] 10.222.0.13 "GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1" status: 200 len: 1284 microversion: 2.1 time: 0.149368 Oct 30 01:47:59.681049 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3019/6039] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:59 2022] GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1 => generated 1284 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:48:00.203043 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-c3fc348f-b574-4a85-9648-a30772de86a6 req-6109c707-b4d8-4e1b-a0cf-afb59845aa70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1a11d01-7560-4d97-af75-2904cea5408f", "tag": "10cb167f-2464-4262-8c62-e8e2481f80bc"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:48:00.212457 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b35b7067-2cdd-43a2-9725-a2f08ebdbe41 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:00.236204 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b35b7067-2cdd-43a2-9725-a2f08ebdbe41 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1680 microversion: 2.1 time: 0.833090 Oct 30 01:48:00.237841 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3021/6040] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:47:59 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1680 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:00.245582 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-c3fc348f-b574-4a85-9648-a30772de86a6 req-6109c707-b4d8-4e1b-a0cf-afb59845aa70 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:00.258545 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-c3fc348f-b574-4a85-9648-a30772de86a6 req-6109c707-b4d8-4e1b-a0cf-afb59845aa70 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:00.259004 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-c3fc348f-b574-4a85-9648-a30772de86a6 req-6109c707-b4d8-4e1b-a0cf-afb59845aa70 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:00.285793 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-c3fc348f-b574-4a85-9648-a30772de86a6 req-6109c707-b4d8-4e1b-a0cf-afb59845aa70 service nova] Creating event network-changed:10cb167f-2464-4262-8c62-e8e2481f80bc for instance b1a11d01-7560-4d97-af75-2904cea5408f on n-h1-master-1 Oct 30 01:48:00.295589 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-c3fc348f-b574-4a85-9648-a30772de86a6 req-6109c707-b4d8-4e1b-a0cf-afb59845aa70 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100407 Oct 30 01:48:00.308920 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3020/6041] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:48:00.707597 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-df3f2880-290e-47e1-9b54-38fdd718f29d tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:00.709712 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-df3f2880-290e-47e1-9b54-38fdd718f29d tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] [instance: 93431237-06a2-41b5-a732-ddcdfada26d1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:00.730498 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df3f2880-290e-47e1-9b54-38fdd718f29d tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:00.735865 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df3f2880-290e-47e1-9b54-38fdd718f29d tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:00.738328 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df3f2880-290e-47e1-9b54-38fdd718f29d tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:00.740234 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df3f2880-290e-47e1-9b54-38fdd718f29d tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:00.746693 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df3f2880-290e-47e1-9b54-38fdd718f29d tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:00.747401 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df3f2880-290e-47e1-9b54-38fdd718f29d tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:00.980845 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-df3f2880-290e-47e1-9b54-38fdd718f29d tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d699d4b51d4dc8ac1d8ff5aee36290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f00019b8a440b994269dce91d83768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:01.007044 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-df3f2880-290e-47e1-9b54-38fdd718f29d tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] 10.222.0.13 "GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1" status: 200 len: 1272 microversion: 2.1 time: 0.302008 Oct 30 01:48:01.013832 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3022/6042] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:00 2022] GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1 => generated 1272 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:01.264451 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-60641d39-5231-42a5-b75f-3b72b9ac5697 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:01.264949 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-60641d39-5231-42a5-b75f-3b72b9ac5697 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:01.280457 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-60641d39-5231-42a5-b75f-3b72b9ac5697 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:01.282157 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-60641d39-5231-42a5-b75f-3b72b9ac5697 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:01.283001 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-60641d39-5231-42a5-b75f-3b72b9ac5697 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:01.284921 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-60641d39-5231-42a5-b75f-3b72b9ac5697 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:01.288110 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-60641d39-5231-42a5-b75f-3b72b9ac5697 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:01.289077 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-60641d39-5231-42a5-b75f-3b72b9ac5697 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:01.665454 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-60641d39-5231-42a5-b75f-3b72b9ac5697 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:01.678321 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-60641d39-5231-42a5-b75f-3b72b9ac5697 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1657 microversion: 2.1 time: 0.420175 Oct 30 01:48:01.679254 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3021/6043] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:01 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1657 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:48:01.704927 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-93325ce5-6d87-4c0a-90c5-b79f26e6cbbf tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:48:01.711173 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-93325ce5-6d87-4c0a-90c5-b79f26e6cbbf tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:01.711816 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-93325ce5-6d87-4c0a-90c5-b79f26e6cbbf tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:01.712155 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-93325ce5-6d87-4c0a-90c5-b79f26e6cbbf tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:01.737137 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-93325ce5-6d87-4c0a-90c5-b79f26e6cbbf tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Going to try to start instance {{(pid=121103) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 30 01:48:02.010789 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-93325ce5-6d87-4c0a-90c5-b79f26e6cbbf tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "POST /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9/action" status: 202 len: 0 microversion: 2.1 time: 0.310330 Oct 30 01:48:02.015546 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3023/6044] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:48:01 2022] POST /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:48:02.023111 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bbee3776-905f-48dc-bb25-3e64bb9b9060 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:02.023732 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bbee3776-905f-48dc-bb25-3e64bb9b9060 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:02.035351 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bbee3776-905f-48dc-bb25-3e64bb9b9060 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:02.041706 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-dcd117d5-1bc1-46cb-b219-0a881ac432a2 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:02.044091 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-dcd117d5-1bc1-46cb-b219-0a881ac432a2 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] [instance: 93431237-06a2-41b5-a732-ddcdfada26d1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:02.050399 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bbee3776-905f-48dc-bb25-3e64bb9b9060 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:02.052210 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bbee3776-905f-48dc-bb25-3e64bb9b9060 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:02.059802 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dcd117d5-1bc1-46cb-b219-0a881ac432a2 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:02.062405 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dcd117d5-1bc1-46cb-b219-0a881ac432a2 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:02.063093 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dcd117d5-1bc1-46cb-b219-0a881ac432a2 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:02.067372 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dcd117d5-1bc1-46cb-b219-0a881ac432a2 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:02.068112 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dcd117d5-1bc1-46cb-b219-0a881ac432a2 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:02.072123 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dcd117d5-1bc1-46cb-b219-0a881ac432a2 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:02.072791 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bbee3776-905f-48dc-bb25-3e64bb9b9060 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:02.073310 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bbee3776-905f-48dc-bb25-3e64bb9b9060 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:02.073782 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bbee3776-905f-48dc-bb25-3e64bb9b9060 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:02.491575 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bbee3776-905f-48dc-bb25-3e64bb9b9060 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:02.493498 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-dcd117d5-1bc1-46cb-b219-0a881ac432a2 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d699d4b51d4dc8ac1d8ff5aee36290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f00019b8a440b994269dce91d83768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:02.501930 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bbee3776-905f-48dc-bb25-3e64bb9b9060 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1666 microversion: 2.1 time: 0.484558 Oct 30 01:48:02.503103 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3022/6045] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:02 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1666 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:48:02.504307 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-dcd117d5-1bc1-46cb-b219-0a881ac432a2 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] 10.222.0.13 "GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1" status: 200 len: 1314 microversion: 2.1 time: 0.469796 Oct 30 01:48:02.524416 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3024/6046] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:02 2022] GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1 => generated 1314 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:03.219343 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-8e326aec-3535-47a0-8379-819103a3eee0 req-23174322-c497-487c-895a-4aee57a93ab3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93431237-06a2-41b5-a732-ddcdfada26d1", "tag": "10d46536-4363-40b9-9656-850e2cf4a276"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:48:03.242668 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-8e326aec-3535-47a0-8379-819103a3eee0 req-23174322-c497-487c-895a-4aee57a93ab3 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:03.244558 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-8e326aec-3535-47a0-8379-819103a3eee0 req-23174322-c497-487c-895a-4aee57a93ab3 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:03.254137 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-8e326aec-3535-47a0-8379-819103a3eee0 req-23174322-c497-487c-895a-4aee57a93ab3 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:03.288526 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-8e326aec-3535-47a0-8379-819103a3eee0 req-23174322-c497-487c-895a-4aee57a93ab3 service nova] Creating event network-changed:10d46536-4363-40b9-9656-850e2cf4a276 for instance 93431237-06a2-41b5-a732-ddcdfada26d1 on n-h2-master-1 Oct 30 01:48:03.299640 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-8e326aec-3535-47a0-8379-819103a3eee0 req-23174322-c497-487c-895a-4aee57a93ab3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085170 Oct 30 01:48:03.302653 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3023/6047] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:48:03.526581 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d75aa479-8bb2-4434-ae9c-dee0de4b9b77 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:03.527810 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d75aa479-8bb2-4434-ae9c-dee0de4b9b77 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:03.528219 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-158f9ba5-fcb9-4254-a7f4-e646fd5aa8d9 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:03.529282 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-158f9ba5-fcb9-4254-a7f4-e646fd5aa8d9 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] [instance: 93431237-06a2-41b5-a732-ddcdfada26d1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:03.543315 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-158f9ba5-fcb9-4254-a7f4-e646fd5aa8d9 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:03.546418 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-158f9ba5-fcb9-4254-a7f4-e646fd5aa8d9 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:03.546810 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d75aa479-8bb2-4434-ae9c-dee0de4b9b77 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:03.547511 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-158f9ba5-fcb9-4254-a7f4-e646fd5aa8d9 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:03.549699 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d75aa479-8bb2-4434-ae9c-dee0de4b9b77 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:03.551168 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-158f9ba5-fcb9-4254-a7f4-e646fd5aa8d9 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:03.551403 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d75aa479-8bb2-4434-ae9c-dee0de4b9b77 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:03.552780 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-158f9ba5-fcb9-4254-a7f4-e646fd5aa8d9 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:03.553667 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-158f9ba5-fcb9-4254-a7f4-e646fd5aa8d9 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:03.553799 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d75aa479-8bb2-4434-ae9c-dee0de4b9b77 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:03.554497 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d75aa479-8bb2-4434-ae9c-dee0de4b9b77 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:03.554947 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d75aa479-8bb2-4434-ae9c-dee0de4b9b77 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:03.927828 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-158f9ba5-fcb9-4254-a7f4-e646fd5aa8d9 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d699d4b51d4dc8ac1d8ff5aee36290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f00019b8a440b994269dce91d83768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:03.936763 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-158f9ba5-fcb9-4254-a7f4-e646fd5aa8d9 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] 10.222.0.13 "GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1" status: 200 len: 1314 microversion: 2.1 time: 0.413352 Oct 30 01:48:03.937366 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3024/6048] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:03 2022] GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1 => generated 1314 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:03.945370 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d75aa479-8bb2-4434-ae9c-dee0de4b9b77 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:03.956068 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d75aa479-8bb2-4434-ae9c-dee0de4b9b77 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1666 microversion: 2.1 time: 0.433917 Oct 30 01:48:03.964732 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3025/6049] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:03 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1666 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:04.959718 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7fc1a176-7670-403f-be73-2c69f97998fe tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:04.960656 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7fc1a176-7670-403f-be73-2c69f97998fe tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] [instance: 93431237-06a2-41b5-a732-ddcdfada26d1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:04.977175 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7fc1a176-7670-403f-be73-2c69f97998fe tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:04.977822 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7fc1a176-7670-403f-be73-2c69f97998fe tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:04.978526 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7fc1a176-7670-403f-be73-2c69f97998fe tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:04.980754 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7fc1a176-7670-403f-be73-2c69f97998fe tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:04.981653 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7fc1a176-7670-403f-be73-2c69f97998fe tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:04.982434 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7fc1a176-7670-403f-be73-2c69f97998fe tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:04.982810 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a73a6759-a201-4f22-8793-dadc67f19737 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:04.983535 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a73a6759-a201-4f22-8793-dadc67f19737 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:04.991569 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a73a6759-a201-4f22-8793-dadc67f19737 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:04.992287 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a73a6759-a201-4f22-8793-dadc67f19737 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:04.992923 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a73a6759-a201-4f22-8793-dadc67f19737 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:04.995051 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a73a6759-a201-4f22-8793-dadc67f19737 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:04.995689 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a73a6759-a201-4f22-8793-dadc67f19737 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:04.996673 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a73a6759-a201-4f22-8793-dadc67f19737 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:05.287515 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7fc1a176-7670-403f-be73-2c69f97998fe tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d699d4b51d4dc8ac1d8ff5aee36290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f00019b8a440b994269dce91d83768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:05.290093 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a73a6759-a201-4f22-8793-dadc67f19737 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:05.302218 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7fc1a176-7670-403f-be73-2c69f97998fe tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] 10.222.0.13 "GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1" status: 200 len: 1314 microversion: 2.1 time: 0.346204 Oct 30 01:48:05.302816 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3025/6050] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:04 2022] GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1 => generated 1314 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:05.306145 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a73a6759-a201-4f22-8793-dadc67f19737 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1670 microversion: 2.1 time: 0.326852 Oct 30 01:48:05.307196 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3026/6051] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:04 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1670 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:05.364126 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7e834ee4-225c-4085-a42a-2d6a6bcd4f3f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:05.364852 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7e834ee4-225c-4085-a42a-2d6a6bcd4f3f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:05.381892 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e834ee4-225c-4085-a42a-2d6a6bcd4f3f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:05.381892 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e834ee4-225c-4085-a42a-2d6a6bcd4f3f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:05.381892 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e834ee4-225c-4085-a42a-2d6a6bcd4f3f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:05.389839 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e834ee4-225c-4085-a42a-2d6a6bcd4f3f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:05.390346 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e834ee4-225c-4085-a42a-2d6a6bcd4f3f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:05.390795 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e834ee4-225c-4085-a42a-2d6a6bcd4f3f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:05.637595 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7e834ee4-225c-4085-a42a-2d6a6bcd4f3f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:05.646508 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7e834ee4-225c-4085-a42a-2d6a6bcd4f3f tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1670 microversion: 2.1 time: 0.309049 Oct 30 01:48:05.647100 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3026/6052] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:05 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1670 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:05.671718 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-222e0c55-f00f-492d-a77d-0737c10473b7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:05.672852 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-222e0c55-f00f-492d-a77d-0737c10473b7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:05.679354 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-222e0c55-f00f-492d-a77d-0737c10473b7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:05.679855 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-222e0c55-f00f-492d-a77d-0737c10473b7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:05.680301 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-222e0c55-f00f-492d-a77d-0737c10473b7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:05.681011 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-222e0c55-f00f-492d-a77d-0737c10473b7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:05.681500 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-222e0c55-f00f-492d-a77d-0737c10473b7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:05.681933 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-222e0c55-f00f-492d-a77d-0737c10473b7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:05.922742 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-222e0c55-f00f-492d-a77d-0737c10473b7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:05.931611 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-222e0c55-f00f-492d-a77d-0737c10473b7 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1670 microversion: 2.1 time: 0.263867 Oct 30 01:48:05.932207 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3027/6053] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:05 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1670 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:05.954798 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a38340a5-a600-4413-85be-bdc0e2016e38 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:05.955969 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a38340a5-a600-4413-85be-bdc0e2016e38 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:05.959778 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:05.964109 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a38340a5-a600-4413-85be-bdc0e2016e38 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:05.964606 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a38340a5-a600-4413-85be-bdc0e2016e38 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:05.965046 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a38340a5-a600-4413-85be-bdc0e2016e38 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:05.965806 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a38340a5-a600-4413-85be-bdc0e2016e38 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:05.966271 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a38340a5-a600-4413-85be-bdc0e2016e38 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:05.966694 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a38340a5-a600-4413-85be-bdc0e2016e38 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:06.117873 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a38340a5-a600-4413-85be-bdc0e2016e38 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:06.126892 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a38340a5-a600-4413-85be-bdc0e2016e38 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1670 microversion: 2.1 time: 0.176077 Oct 30 01:48:06.127481 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3027/6054] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:05 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1670 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:06.154722 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a9cfd696-83e2-45fd-8b22-42f9b9d17f55 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:06.155405 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a9cfd696-83e2-45fd-8b22-42f9b9d17f55 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:06.163149 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a9cfd696-83e2-45fd-8b22-42f9b9d17f55 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:06.163863 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a9cfd696-83e2-45fd-8b22-42f9b9d17f55 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:06.164513 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a9cfd696-83e2-45fd-8b22-42f9b9d17f55 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:06.165448 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a9cfd696-83e2-45fd-8b22-42f9b9d17f55 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:06.165908 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a9cfd696-83e2-45fd-8b22-42f9b9d17f55 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:06.166516 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a9cfd696-83e2-45fd-8b22-42f9b9d17f55 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:06.239741 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:06.318565 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a9cfd696-83e2-45fd-8b22-42f9b9d17f55 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:06.329028 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a9cfd696-83e2-45fd-8b22-42f9b9d17f55 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1670 microversion: 2.1 time: 0.178530 Oct 30 01:48:06.329780 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3028/6055] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:06 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1670 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:06.347301 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ea7a165b-fb4d-44cc-9fb3-d5fe4b8ec683 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:06.348112 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ea7a165b-fb4d-44cc-9fb3-d5fe4b8ec683 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] [instance: 93431237-06a2-41b5-a732-ddcdfada26d1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:06.355655 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea7a165b-fb4d-44cc-9fb3-d5fe4b8ec683 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:06.356395 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea7a165b-fb4d-44cc-9fb3-d5fe4b8ec683 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:06.357066 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea7a165b-fb4d-44cc-9fb3-d5fe4b8ec683 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:06.358106 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea7a165b-fb4d-44cc-9fb3-d5fe4b8ec683 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:06.358874 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea7a165b-fb4d-44cc-9fb3-d5fe4b8ec683 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:06.359542 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea7a165b-fb4d-44cc-9fb3-d5fe4b8ec683 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:06.362639 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-302c58e4-1275-4183-b085-ea78de640de5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:48:06.365396 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-302c58e4-1275-4183-b085-ea78de640de5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:06.373548 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-302c58e4-1275-4183-b085-ea78de640de5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:06.374561 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-302c58e4-1275-4183-b085-ea78de640de5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:06.375372 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-302c58e4-1275-4183-b085-ea78de640de5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:06.377271 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-302c58e4-1275-4183-b085-ea78de640de5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:06.377918 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-302c58e4-1275-4183-b085-ea78de640de5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:06.378794 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-302c58e4-1275-4183-b085-ea78de640de5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:06.438758 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-302c58e4-1275-4183-b085-ea78de640de5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lazy-loading 'flavor' on Instance uuid b0f03664-8785-4321-b32e-3622f1b747b9 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:48:06.587490 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ea7a165b-fb4d-44cc-9fb3-d5fe4b8ec683 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d699d4b51d4dc8ac1d8ff5aee36290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f00019b8a440b994269dce91d83768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:06.589931 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:06.600986 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ea7a165b-fb4d-44cc-9fb3-d5fe4b8ec683 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] 10.222.0.13 "GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1" status: 200 len: 1314 microversion: 2.1 time: 0.255555 Oct 30 01:48:06.600986 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3028/6056] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:06 2022] GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:06.731088 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-302c58e4-1275-4183-b085-ea78de640de5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "POST /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9/action" status: 202 len: 0 microversion: 2.1 time: 0.376886 Oct 30 01:48:06.732036 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3029/6057] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:48:06 2022] POST /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9/action => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:48:06.742049 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0123339e-250d-450d-9413-3f860636332a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:06.747216 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0123339e-250d-450d-9413-3f860636332a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:06.756147 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0123339e-250d-450d-9413-3f860636332a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:06.756850 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0123339e-250d-450d-9413-3f860636332a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:06.757521 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0123339e-250d-450d-9413-3f860636332a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:06.758427 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0123339e-250d-450d-9413-3f860636332a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:06.759105 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0123339e-250d-450d-9413-3f860636332a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:06.760273 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0123339e-250d-450d-9413-3f860636332a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:06.952720 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0123339e-250d-450d-9413-3f860636332a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:06.968458 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0123339e-250d-450d-9413-3f860636332a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1678 microversion: 2.1 time: 0.231406 Oct 30 01:48:06.971214 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3029/6058] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:06 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1678 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:07.625887 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cdb6e163-ba97-4112-876d-236dc6839972 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:07.626611 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-cdb6e163-ba97-4112-876d-236dc6839972 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] [instance: 93431237-06a2-41b5-a732-ddcdfada26d1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:07.635567 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cdb6e163-ba97-4112-876d-236dc6839972 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:07.636143 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cdb6e163-ba97-4112-876d-236dc6839972 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:07.636686 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cdb6e163-ba97-4112-876d-236dc6839972 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:07.637568 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cdb6e163-ba97-4112-876d-236dc6839972 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:07.638262 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cdb6e163-ba97-4112-876d-236dc6839972 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:07.638962 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cdb6e163-ba97-4112-876d-236dc6839972 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:07.776572 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-cdb6e163-ba97-4112-876d-236dc6839972 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d699d4b51d4dc8ac1d8ff5aee36290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f00019b8a440b994269dce91d83768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:07.777150 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:07.784676 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cdb6e163-ba97-4112-876d-236dc6839972 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] 10.222.0.13 "GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1" status: 200 len: 1314 microversion: 2.1 time: 0.164412 Oct 30 01:48:07.785345 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3030/6059] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:07 2022] GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:07.995829 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-28ce0b90-4e40-4c09-b7ed-f7fe032b37c9 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:07.996481 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-28ce0b90-4e40-4c09-b7ed-f7fe032b37c9 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:08.003804 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=8 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:08.009720 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-28ce0b90-4e40-4c09-b7ed-f7fe032b37c9 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:08.014697 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-28ce0b90-4e40-4c09-b7ed-f7fe032b37c9 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:08.014697 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-28ce0b90-4e40-4c09-b7ed-f7fe032b37c9 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:08.014697 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-28ce0b90-4e40-4c09-b7ed-f7fe032b37c9 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:08.014697 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-28ce0b90-4e40-4c09-b7ed-f7fe032b37c9 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:08.014697 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-28ce0b90-4e40-4c09-b7ed-f7fe032b37c9 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:08.153359 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-28ce0b90-4e40-4c09-b7ed-f7fe032b37c9 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:08.161510 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-28ce0b90-4e40-4c09-b7ed-f7fe032b37c9 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1661 microversion: 2.1 time: 0.169597 Oct 30 01:48:08.165446 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3030/6060] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:07 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1661 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:08.185188 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-140eadbc-e488-4cac-9811-7f7879042147 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:48:08.186894 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-140eadbc-e488-4cac-9811-7f7879042147 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:08.194059 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-140eadbc-e488-4cac-9811-7f7879042147 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:08.194566 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-140eadbc-e488-4cac-9811-7f7879042147 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:08.195286 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-140eadbc-e488-4cac-9811-7f7879042147 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:08.196011 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-140eadbc-e488-4cac-9811-7f7879042147 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:08.196639 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-140eadbc-e488-4cac-9811-7f7879042147 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:08.197108 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-140eadbc-e488-4cac-9811-7f7879042147 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:08.492124 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-140eadbc-e488-4cac-9811-7f7879042147 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "POST /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9/action" status: 202 len: 0 microversion: 2.1 time: 0.310928 Oct 30 01:48:08.492711 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3031/6061] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:48:08 2022] POST /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9/action => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:48:08.509224 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-502b2d02-9a82-4a9a-838b-1095d4be4a60 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:08.510403 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-502b2d02-9a82-4a9a-838b-1095d4be4a60 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:08.521520 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-502b2d02-9a82-4a9a-838b-1095d4be4a60 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:08.530461 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-502b2d02-9a82-4a9a-838b-1095d4be4a60 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:08.530461 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-502b2d02-9a82-4a9a-838b-1095d4be4a60 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:08.530461 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-502b2d02-9a82-4a9a-838b-1095d4be4a60 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:08.530461 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-502b2d02-9a82-4a9a-838b-1095d4be4a60 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:08.530461 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-502b2d02-9a82-4a9a-838b-1095d4be4a60 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:08.664094 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-5be81ffc-395e-438e-860e-7b6dcf092026 req-1f9400fa-3879-4060-ba10-234314528506 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93431237-06a2-41b5-a732-ddcdfada26d1", "name": "network-vif-plugged", "status": "completed", "tag": "10d46536-4363-40b9-9656-850e2cf4a276"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:48:08.676930 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-5be81ffc-395e-438e-860e-7b6dcf092026 req-1f9400fa-3879-4060-ba10-234314528506 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:08.677469 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-5be81ffc-395e-438e-860e-7b6dcf092026 req-1f9400fa-3879-4060-ba10-234314528506 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:08.677996 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-5be81ffc-395e-438e-860e-7b6dcf092026 req-1f9400fa-3879-4060-ba10-234314528506 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:08.691423 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-5be81ffc-395e-438e-860e-7b6dcf092026 req-1f9400fa-3879-4060-ba10-234314528506 service nova] Creating event network-vif-plugged:10d46536-4363-40b9-9656-850e2cf4a276 for instance 93431237-06a2-41b5-a732-ddcdfada26d1 on n-h2-master-1 Oct 30 01:48:08.697037 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-5be81ffc-395e-438e-860e-7b6dcf092026 req-1f9400fa-3879-4060-ba10-234314528506 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038476 Oct 30 01:48:08.697690 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3032/6062] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:48:08.830845 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-88085640-09cc-4208-83ff-8410b2234db1 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:08.832936 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-88085640-09cc-4208-83ff-8410b2234db1 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] [instance: 93431237-06a2-41b5-a732-ddcdfada26d1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:08.844105 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-88085640-09cc-4208-83ff-8410b2234db1 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:08.844752 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-88085640-09cc-4208-83ff-8410b2234db1 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:08.845257 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-88085640-09cc-4208-83ff-8410b2234db1 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:08.846271 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-88085640-09cc-4208-83ff-8410b2234db1 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:08.846805 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-88085640-09cc-4208-83ff-8410b2234db1 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:08.847438 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-88085640-09cc-4208-83ff-8410b2234db1 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:08.873822 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-502b2d02-9a82-4a9a-838b-1095d4be4a60 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:08.882668 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-502b2d02-9a82-4a9a-838b-1095d4be4a60 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1667 microversion: 2.1 time: 0.378394 Oct 30 01:48:08.883983 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3031/6063] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:08 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1667 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:09.097747 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-88085640-09cc-4208-83ff-8410b2234db1 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d699d4b51d4dc8ac1d8ff5aee36290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f00019b8a440b994269dce91d83768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:09.105586 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-88085640-09cc-4208-83ff-8410b2234db1 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] 10.222.0.13 "GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1" status: 200 len: 1314 microversion: 2.1 time: 0.299659 Oct 30 01:48:09.106199 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3033/6064] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:08 2022] GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1 => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:09.912147 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cd8208fd-ea51-41dc-bc4c-5eeb1484adaf tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:09.912823 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cd8208fd-ea51-41dc-bc4c-5eeb1484adaf tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:09.927103 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cd8208fd-ea51-41dc-bc4c-5eeb1484adaf tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:09.927987 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cd8208fd-ea51-41dc-bc4c-5eeb1484adaf tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:09.928650 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cd8208fd-ea51-41dc-bc4c-5eeb1484adaf tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:09.929808 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cd8208fd-ea51-41dc-bc4c-5eeb1484adaf tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:09.930551 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cd8208fd-ea51-41dc-bc4c-5eeb1484adaf tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:09.931837 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cd8208fd-ea51-41dc-bc4c-5eeb1484adaf tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:10.129965 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3fffb8f3-5d4a-47ca-a036-1925e088027b tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:10.130691 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3fffb8f3-5d4a-47ca-a036-1925e088027b tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] [instance: 93431237-06a2-41b5-a732-ddcdfada26d1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:10.138368 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3fffb8f3-5d4a-47ca-a036-1925e088027b tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:10.138963 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3fffb8f3-5d4a-47ca-a036-1925e088027b tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:10.139477 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3fffb8f3-5d4a-47ca-a036-1925e088027b tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:10.140299 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3fffb8f3-5d4a-47ca-a036-1925e088027b tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:10.141009 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3fffb8f3-5d4a-47ca-a036-1925e088027b tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:10.142215 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3fffb8f3-5d4a-47ca-a036-1925e088027b tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:10.524809 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-cd8208fd-ea51-41dc-bc4c-5eeb1484adaf tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:10.539302 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cd8208fd-ea51-41dc-bc4c-5eeb1484adaf tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1667 microversion: 2.1 time: 0.632758 Oct 30 01:48:10.540797 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3032/6065] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:09 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1667 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:10.553668 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3fffb8f3-5d4a-47ca-a036-1925e088027b tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d699d4b51d4dc8ac1d8ff5aee36290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f00019b8a440b994269dce91d83768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:10.562395 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3fffb8f3-5d4a-47ca-a036-1925e088027b tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] 10.222.0.13 "GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1" status: 200 len: 1314 microversion: 2.1 time: 0.437450 Oct 30 01:48:10.562993 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3034/6066] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:10 2022] GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1 => generated 1314 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:48:11.564837 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e2611197-2d4d-40e1-9808-510b4b7ceac6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:11.565508 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e2611197-2d4d-40e1-9808-510b4b7ceac6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:11.573832 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e2611197-2d4d-40e1-9808-510b4b7ceac6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:11.574278 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e2611197-2d4d-40e1-9808-510b4b7ceac6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:11.574720 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e2611197-2d4d-40e1-9808-510b4b7ceac6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:11.575479 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e2611197-2d4d-40e1-9808-510b4b7ceac6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:11.575940 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e2611197-2d4d-40e1-9808-510b4b7ceac6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:11.576366 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e2611197-2d4d-40e1-9808-510b4b7ceac6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:11.589178 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a1bd9719-6b54-4bed-8c13-dc7649a7e9d0 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:11.589958 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a1bd9719-6b54-4bed-8c13-dc7649a7e9d0 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] [instance: 93431237-06a2-41b5-a732-ddcdfada26d1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:11.600105 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a1bd9719-6b54-4bed-8c13-dc7649a7e9d0 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:11.602282 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a1bd9719-6b54-4bed-8c13-dc7649a7e9d0 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:11.602282 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a1bd9719-6b54-4bed-8c13-dc7649a7e9d0 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:11.602282 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a1bd9719-6b54-4bed-8c13-dc7649a7e9d0 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:11.603114 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a1bd9719-6b54-4bed-8c13-dc7649a7e9d0 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:11.603610 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a1bd9719-6b54-4bed-8c13-dc7649a7e9d0 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:11.825791 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e2611197-2d4d-40e1-9808-510b4b7ceac6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:11.830111 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a1bd9719-6b54-4bed-8c13-dc7649a7e9d0 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d699d4b51d4dc8ac1d8ff5aee36290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f00019b8a440b994269dce91d83768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:11.834829 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e2611197-2d4d-40e1-9808-510b4b7ceac6 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1667 microversion: 2.1 time: 0.274116 Oct 30 01:48:11.835503 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3033/6067] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:11 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1667 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:11.844383 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a1bd9719-6b54-4bed-8c13-dc7649a7e9d0 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] 10.222.0.13 "GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1" status: 200 len: 1501 microversion: 2.1 time: 0.259479 Oct 30 01:48:11.845093 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3035/6068] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:11 2022] GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1 => generated 1501 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:48:11.872675 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-760369e2-84c9-4912-bbe0-459b6fbd7ff9 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:11.873327 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-760369e2-84c9-4912-bbe0-459b6fbd7ff9 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] [instance: 93431237-06a2-41b5-a732-ddcdfada26d1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:11.880761 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-760369e2-84c9-4912-bbe0-459b6fbd7ff9 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:11.881203 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-760369e2-84c9-4912-bbe0-459b6fbd7ff9 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:11.881704 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-760369e2-84c9-4912-bbe0-459b6fbd7ff9 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:11.882436 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-760369e2-84c9-4912-bbe0-459b6fbd7ff9 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:11.882908 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-760369e2-84c9-4912-bbe0-459b6fbd7ff9 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:11.883450 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-760369e2-84c9-4912-bbe0-459b6fbd7ff9 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:12.054874 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-760369e2-84c9-4912-bbe0-459b6fbd7ff9 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d699d4b51d4dc8ac1d8ff5aee36290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f00019b8a440b994269dce91d83768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:12.063905 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-760369e2-84c9-4912-bbe0-459b6fbd7ff9 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] 10.222.0.13 "GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1" status: 200 len: 1501 microversion: 2.1 time: 0.194837 Oct 30 01:48:12.064476 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3034/6069] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:11 2022] GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1 => generated 1501 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:12.086927 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e4bf45b9-972e-442d-b4df-ba4ead24fa4f tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:48:12.087479 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e4bf45b9-972e-442d-b4df-ba4ead24fa4f tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] [instance: 93431237-06a2-41b5-a732-ddcdfada26d1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:12.098382 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e4bf45b9-972e-442d-b4df-ba4ead24fa4f tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:12.098382 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e4bf45b9-972e-442d-b4df-ba4ead24fa4f tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:12.098382 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e4bf45b9-972e-442d-b4df-ba4ead24fa4f tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:12.098382 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e4bf45b9-972e-442d-b4df-ba4ead24fa4f tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:12.098382 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e4bf45b9-972e-442d-b4df-ba4ead24fa4f tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:12.098382 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e4bf45b9-972e-442d-b4df-ba4ead24fa4f tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:12.120472 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-e4bf45b9-972e-442d-b4df-ba4ead24fa4f tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lazy-loading 'flavor' on Instance uuid 93431237-06a2-41b5-a732-ddcdfada26d1 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:48:12.462023 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e4bf45b9-972e-442d-b4df-ba4ead24fa4f tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] 10.222.0.13 "POST /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1/action" status: 202 len: 0 microversion: 2.1 time: 0.378800 Oct 30 01:48:12.462963 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3036/6070] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:48:12 2022] POST /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1/action => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:48:12.472348 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-81f634e3-6b4c-47cb-9bd6-b27b31b070c4 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:12.474193 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-81f634e3-6b4c-47cb-9bd6-b27b31b070c4 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] [instance: 93431237-06a2-41b5-a732-ddcdfada26d1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:12.482683 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-81f634e3-6b4c-47cb-9bd6-b27b31b070c4 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:12.483489 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-81f634e3-6b4c-47cb-9bd6-b27b31b070c4 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:12.484342 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-81f634e3-6b4c-47cb-9bd6-b27b31b070c4 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:12.485194 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-81f634e3-6b4c-47cb-9bd6-b27b31b070c4 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:12.485888 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-81f634e3-6b4c-47cb-9bd6-b27b31b070c4 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:12.486530 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-81f634e3-6b4c-47cb-9bd6-b27b31b070c4 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:12.647259 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-81f634e3-6b4c-47cb-9bd6-b27b31b070c4 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d699d4b51d4dc8ac1d8ff5aee36290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f00019b8a440b994269dce91d83768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:12.674192 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-81f634e3-6b4c-47cb-9bd6-b27b31b070c4 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] 10.222.0.13 "GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1" status: 200 len: 1509 microversion: 2.1 time: 0.206311 Oct 30 01:48:12.685609 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3035/6071] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:12 2022] GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1 => generated 1509 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:12.863564 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d43cbec7-709d-4a63-a63a-35b992551d28 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:12.865181 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d43cbec7-709d-4a63-a63a-35b992551d28 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:12.871877 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d43cbec7-709d-4a63-a63a-35b992551d28 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:12.878111 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d43cbec7-709d-4a63-a63a-35b992551d28 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:12.878111 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d43cbec7-709d-4a63-a63a-35b992551d28 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:12.878111 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d43cbec7-709d-4a63-a63a-35b992551d28 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:12.878111 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d43cbec7-709d-4a63-a63a-35b992551d28 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:12.878111 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d43cbec7-709d-4a63-a63a-35b992551d28 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:13.052169 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d43cbec7-709d-4a63-a63a-35b992551d28 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:13.065569 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d43cbec7-709d-4a63-a63a-35b992551d28 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1670 microversion: 2.1 time: 0.207915 Oct 30 01:48:13.066810 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3037/6072] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:12 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1670 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:13.089767 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-76cf8b45-2cee-4b37-a1ca-a560970dda66 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:13.090748 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-76cf8b45-2cee-4b37-a1ca-a560970dda66 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:13.097950 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-76cf8b45-2cee-4b37-a1ca-a560970dda66 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:13.098448 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-76cf8b45-2cee-4b37-a1ca-a560970dda66 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:13.101914 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-76cf8b45-2cee-4b37-a1ca-a560970dda66 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:13.101914 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-76cf8b45-2cee-4b37-a1ca-a560970dda66 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:13.101914 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-76cf8b45-2cee-4b37-a1ca-a560970dda66 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:13.101914 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-76cf8b45-2cee-4b37-a1ca-a560970dda66 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:13.278860 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-76cf8b45-2cee-4b37-a1ca-a560970dda66 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:13.287295 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-76cf8b45-2cee-4b37-a1ca-a560970dda66 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1670 microversion: 2.1 time: 0.202339 Oct 30 01:48:13.287871 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3036/6073] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:13 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1670 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:13.313149 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-149b8113-5a6e-4bff-bb94-bc4fa5b64ac9 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:13.313776 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-149b8113-5a6e-4bff-bb94-bc4fa5b64ac9 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: ded1b2fb-9552-4973-bf20-2c590b49e179] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:13.320214 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-149b8113-5a6e-4bff-bb94-bc4fa5b64ac9 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:13.330118 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-149b8113-5a6e-4bff-bb94-bc4fa5b64ac9 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:13.330803 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-149b8113-5a6e-4bff-bb94-bc4fa5b64ac9 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:13.331917 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-149b8113-5a6e-4bff-bb94-bc4fa5b64ac9 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:13.332584 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-149b8113-5a6e-4bff-bb94-bc4fa5b64ac9 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:13.333407 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-149b8113-5a6e-4bff-bb94-bc4fa5b64ac9 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:13.365184 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-149b8113-5a6e-4bff-bb94-bc4fa5b64ac9 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: ded1b2fb-9552-4973-bf20-2c590b49e179] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:48:13.372542 n-d-master-1 devstack@n-api.service[121103]: INFO nova.compute.api [None req-149b8113-5a6e-4bff-bb94-bc4fa5b64ac9 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: ded1b2fb-9552-4973-bf20-2c590b49e179] Working on deleting snapshot 6539bff8-1e1a-4a2e-ba92-125ad46c700f from shelved instance... Oct 30 01:48:13.699755 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4a1b7415-751e-461f-ab63-33a0f2b8b2da tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:13.704642 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4a1b7415-751e-461f-ab63-33a0f2b8b2da tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] [instance: 93431237-06a2-41b5-a732-ddcdfada26d1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:13.720955 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a1b7415-751e-461f-ab63-33a0f2b8b2da tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:13.721505 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a1b7415-751e-461f-ab63-33a0f2b8b2da tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:13.721946 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a1b7415-751e-461f-ab63-33a0f2b8b2da tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:13.722936 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a1b7415-751e-461f-ab63-33a0f2b8b2da tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:13.723857 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a1b7415-751e-461f-ab63-33a0f2b8b2da tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:13.724724 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a1b7415-751e-461f-ab63-33a0f2b8b2da tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:13.881967 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4a1b7415-751e-461f-ab63-33a0f2b8b2da tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d699d4b51d4dc8ac1d8ff5aee36290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f00019b8a440b994269dce91d83768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:13.891846 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4a1b7415-751e-461f-ab63-33a0f2b8b2da tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] 10.222.0.13 "GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1" status: 200 len: 1492 microversion: 2.1 time: 0.195206 Oct 30 01:48:13.911046 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3037/6074] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:13 2022] GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1 => generated 1492 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:13.935810 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6d58f501-08a9-4168-afc7-7e983d5aaae2 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:48:13.937909 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6d58f501-08a9-4168-afc7-7e983d5aaae2 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] [instance: 93431237-06a2-41b5-a732-ddcdfada26d1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:13.947365 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d58f501-08a9-4168-afc7-7e983d5aaae2 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:13.948342 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d58f501-08a9-4168-afc7-7e983d5aaae2 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:13.949558 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d58f501-08a9-4168-afc7-7e983d5aaae2 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:13.950822 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d58f501-08a9-4168-afc7-7e983d5aaae2 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:13.951516 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d58f501-08a9-4168-afc7-7e983d5aaae2 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:13.952242 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d58f501-08a9-4168-afc7-7e983d5aaae2 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:14.210046 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6d58f501-08a9-4168-afc7-7e983d5aaae2 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] 10.222.0.13 "POST /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1/action" status: 202 len: 0 microversion: 2.1 time: 0.279134 Oct 30 01:48:14.211218 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3038/6075] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:48:13 2022] POST /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1/action => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:48:14.220300 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8977fb49-fc4d-4696-827b-a887d958164b tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:14.221317 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8977fb49-fc4d-4696-827b-a887d958164b tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] [instance: 93431237-06a2-41b5-a732-ddcdfada26d1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:14.231242 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8977fb49-fc4d-4696-827b-a887d958164b tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:14.231763 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8977fb49-fc4d-4696-827b-a887d958164b tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:14.232186 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8977fb49-fc4d-4696-827b-a887d958164b tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:14.233144 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8977fb49-fc4d-4696-827b-a887d958164b tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:14.233639 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8977fb49-fc4d-4696-827b-a887d958164b tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:14.235849 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8977fb49-fc4d-4696-827b-a887d958164b tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:14.403158 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8977fb49-fc4d-4696-827b-a887d958164b tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d699d4b51d4dc8ac1d8ff5aee36290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f00019b8a440b994269dce91d83768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:14.412713 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8977fb49-fc4d-4696-827b-a887d958164b tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] 10.222.0.13 "GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1" status: 200 len: 1498 microversion: 2.1 time: 0.197372 Oct 30 01:48:14.413305 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3039/6076] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:14 2022] GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1 => generated 1498 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:48:15.235279 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0e7ee15a-0b63-43f0-9105-427f4bc22a1d tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-659525138", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "69a1d5ee-32a1-44c8-ace2-8f5e83626632"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:48:15.264548 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-149b8113-5a6e-4bff-bb94-bc4fa5b64ac9 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: ded1b2fb-9552-4973-bf20-2c590b49e179] Doing local delete in cell 7a264aef-b8bb-4843-8958-43bc38c25cb0(cell1) {{(pid=121103) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 30 01:48:15.265409 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-149b8113-5a6e-4bff-bb94-bc4fa5b64ac9 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:15.266017 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-149b8113-5a6e-4bff-bb94-bc4fa5b64ac9 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:15.266677 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-149b8113-5a6e-4bff-bb94-bc4fa5b64ac9 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:15.267181 n-d-master-1 devstack@n-api.service[121103]: INFO nova.compute.api [None req-149b8113-5a6e-4bff-bb94-bc4fa5b64ac9 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: ded1b2fb-9552-4973-bf20-2c590b49e179] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 30 01:48:15.273687 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-149b8113-5a6e-4bff-bb94-bc4fa5b64ac9 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: ded1b2fb-9552-4973-bf20-2c590b49e179] deallocate_for_instance() {{(pid=121103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 30 01:48:15.312451 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-0e7ee15a-0b63-43f0-9105-427f4bc22a1d tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] validate_networks() for [('69a1d5ee-32a1-44c8-ace2-8f5e83626632', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:48:15.960207 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-0e7ee15a-0b63-43f0-9105-427f4bc22a1d tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:48:15.960645 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-0e7ee15a-0b63-43f0-9105-427f4bc22a1d tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:48:15.961538 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-0e7ee15a-0b63-43f0-9105-427f4bc22a1d tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:48:15.962487 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-0e7ee15a-0b63-43f0-9105-427f4bc22a1d tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:48:15.963530 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-0e7ee15a-0b63-43f0-9105-427f4bc22a1d tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:48:15.973829 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e7ee15a-0b63-43f0-9105-427f4bc22a1d tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:15.974739 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e7ee15a-0b63-43f0-9105-427f4bc22a1d tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:15.975424 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e7ee15a-0b63-43f0-9105-427f4bc22a1d tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:15.976493 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e7ee15a-0b63-43f0-9105-427f4bc22a1d tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:15.977175 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e7ee15a-0b63-43f0-9105-427f4bc22a1d tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:15.977698 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e7ee15a-0b63-43f0-9105-427f4bc22a1d tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:15.996358 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-0e7ee15a-0b63-43f0-9105-427f4bc22a1d tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Getting quotas for project c7f136933de5465f8590e9b153955d04. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:48:15.998642 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:16.002366 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-0e7ee15a-0b63-43f0-9105-427f4bc22a1d tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Getting quotas for user b7978c02b2bf413b81e1d14350af13b4 and project c7f136933de5465f8590e9b153955d04. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:48:16.015552 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0e7ee15a-0b63-43f0-9105-427f4bc22a1d tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:48:16.018465 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0e7ee15a-0b63-43f0-9105-427f4bc22a1d tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] [instance: 300173a2-4840-4875-8e23-b3b86907a590] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:48:16.205592 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0e7ee15a-0b63-43f0-9105-427f4bc22a1d tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.129502 Oct 30 01:48:16.210333 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3040/6077] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:48:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1135 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 30 01:48:16.223353 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8d21ed7f-30fa-4551-8c2c-30798e9b4c9f tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:16.224173 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8d21ed7f-30fa-4551-8c2c-30798e9b4c9f tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] [instance: 93431237-06a2-41b5-a732-ddcdfada26d1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:16.235508 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d21ed7f-30fa-4551-8c2c-30798e9b4c9f tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:16.242163 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d21ed7f-30fa-4551-8c2c-30798e9b4c9f tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:16.243008 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d21ed7f-30fa-4551-8c2c-30798e9b4c9f tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:16.244113 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d21ed7f-30fa-4551-8c2c-30798e9b4c9f tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:16.244745 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d21ed7f-30fa-4551-8c2c-30798e9b4c9f tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:16.245404 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d21ed7f-30fa-4551-8c2c-30798e9b4c9f tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:16.318821 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-149b8113-5a6e-4bff-bb94-bc4fa5b64ac9 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: ded1b2fb-9552-4973-bf20-2c590b49e179] Updating instance_info_cache with network_info: [] {{(pid=121103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 30 01:48:16.578673 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8d21ed7f-30fa-4551-8c2c-30798e9b4c9f tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d699d4b51d4dc8ac1d8ff5aee36290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f00019b8a440b994269dce91d83768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:16.588873 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8d21ed7f-30fa-4551-8c2c-30798e9b4c9f tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] 10.222.0.13 "GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1" status: 200 len: 1501 microversion: 2.1 time: 0.377049 Oct 30 01:48:16.589738 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3041/6078] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:16 2022] GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1 => generated 1501 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:16.594484 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0caf1baf-d579-443e-8de3-0bd5a3cdae81 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:16.595091 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0caf1baf-d579-443e-8de3-0bd5a3cdae81 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] [instance: 300173a2-4840-4875-8e23-b3b86907a590] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:16.659653 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0caf1baf-d579-443e-8de3-0bd5a3cdae81 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7978c02b2bf413b81e1d14350af13b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f136933de5465f8590e9b153955d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:16.702674 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0caf1baf-d579-443e-8de3-0bd5a3cdae81 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] 10.222.0.13 "GET /compute/v2.1/servers/300173a2-4840-4875-8e23-b3b86907a590" status: 200 len: 1213 microversion: 2.1 time: 0.103229 Oct 30 01:48:16.703349 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3042/6079] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:16 2022] GET /compute/v2.1/servers/300173a2-4840-4875-8e23-b3b86907a590 => generated 1213 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:16.709902 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-5cce04fc-28f8-436f-8765-54d5781c672c req-a06605e2-31ed-46c1-be7e-9c8461501e03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ded1b2fb-9552-4973-bf20-2c590b49e179", "name": "network-vif-deleted", "tag": "94a9922b-c61b-418a-981f-f3039568b8ea"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:48:16.720583 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-5cce04fc-28f8-436f-8765-54d5781c672c req-a06605e2-31ed-46c1-be7e-9c8461501e03 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:16.723185 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-5cce04fc-28f8-436f-8765-54d5781c672c req-a06605e2-31ed-46c1-be7e-9c8461501e03 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:16.723185 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-5cce04fc-28f8-436f-8765-54d5781c672c req-a06605e2-31ed-46c1-be7e-9c8461501e03 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:16.733631 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.compute.server_external_events [req-5cce04fc-28f8-436f-8765-54d5781c672c req-a06605e2-31ed-46c1-be7e-9c8461501e03 service nova] Unable to find a host for instance ded1b2fb-9552-4973-bf20-2c590b49e179. Dropping event network-vif-deleted {{(pid=121102) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 30 01:48:16.735179 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-5cce04fc-28f8-436f-8765-54d5781c672c req-a06605e2-31ed-46c1-be7e-9c8461501e03 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.029098 Oct 30 01:48:16.736000 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3043/6080] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:48:16 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 30 01:48:16.753544 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-dfbf2733-2adb-4308-b874-764cc8642f64 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:48:16.757626 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-dfbf2733-2adb-4308-b874-764cc8642f64 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] [instance: 93431237-06a2-41b5-a732-ddcdfada26d1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:16.761098 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dfbf2733-2adb-4308-b874-764cc8642f64 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:16.761873 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dfbf2733-2adb-4308-b874-764cc8642f64 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:16.762542 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dfbf2733-2adb-4308-b874-764cc8642f64 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:16.763507 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dfbf2733-2adb-4308-b874-764cc8642f64 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:16.764192 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dfbf2733-2adb-4308-b874-764cc8642f64 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:16.764844 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dfbf2733-2adb-4308-b874-764cc8642f64 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:16.792050 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-dfbf2733-2adb-4308-b874-764cc8642f64 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lazy-loading 'flavor' on Instance uuid 93431237-06a2-41b5-a732-ddcdfada26d1 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:48:17.116268 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-dfbf2733-2adb-4308-b874-764cc8642f64 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] 10.222.0.13 "POST /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1/action" status: 202 len: 0 microversion: 2.1 time: 0.378345 Oct 30 01:48:17.120246 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3044/6081] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:48:16 2022] POST /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1/action => generated 0 bytes in 383 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:48:17.137141 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8860d8dd-6fb8-4cf4-9ca4-287a150d262c tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:17.138260 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8860d8dd-6fb8-4cf4-9ca4-287a150d262c tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] [instance: 93431237-06a2-41b5-a732-ddcdfada26d1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:17.146418 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8860d8dd-6fb8-4cf4-9ca4-287a150d262c tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:17.147793 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8860d8dd-6fb8-4cf4-9ca4-287a150d262c tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:17.148695 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8860d8dd-6fb8-4cf4-9ca4-287a150d262c tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:17.149800 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8860d8dd-6fb8-4cf4-9ca4-287a150d262c tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:17.155866 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8860d8dd-6fb8-4cf4-9ca4-287a150d262c tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:17.156364 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8860d8dd-6fb8-4cf4-9ca4-287a150d262c tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:17.187792 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-149b8113-5a6e-4bff-bb94-bc4fa5b64ac9 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179" status: 204 len: 0 microversion: 2.1 time: 3.878590 Oct 30 01:48:17.188128 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:17.192324 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3038/6082] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:48:13 2022] DELETE /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179 => generated 0 bytes in 3880 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:48:17.197028 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8b5f364e-30c8-45ae-82a5-f2e31fe73773 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:17.197934 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8b5f364e-30c8-45ae-82a5-f2e31fe73773 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: ded1b2fb-9552-4973-bf20-2c590b49e179] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:17.210001 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8b5f364e-30c8-45ae-82a5-f2e31fe73773 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:17.211645 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8b5f364e-30c8-45ae-82a5-f2e31fe73773 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:17.212892 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8b5f364e-30c8-45ae-82a5-f2e31fe73773 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:17.214222 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8b5f364e-30c8-45ae-82a5-f2e31fe73773 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:17.214940 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8b5f364e-30c8-45ae-82a5-f2e31fe73773 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:17.215556 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8b5f364e-30c8-45ae-82a5-f2e31fe73773 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:17.235393 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=19,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:17.237398 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-8b5f364e-30c8-45ae-82a5-f2e31fe73773 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] HTTP exception thrown: Instance ded1b2fb-9552-4973-bf20-2c590b49e179 could not be found. Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8b5f364e-30c8-45ae-82a5-f2e31fe73773 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Request method failure captured: Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179 HTTP/1.1 Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdXv08UieK2P0p6pvt8NCvlDNpE7nwwmqKRy3GqbMTGA0eIN66Y4wpKQHzC9fqGSwWNMELWbqq5UQS3MEVOVNfA2QR9cXwwAeRlgzmSRghjjPbvWjrnWlt2xXhoJQePHPZSUYBnEovFZtPMPN8ilqbXGb8wb5Tc4mNTDR3WIqu8sIR0 Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 9f9d0d541cc3496ebf8dc71af4254506 Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServerActionsTestJSON-1828815177 Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9f9d0d541cc3496ebf8dc71af4254506"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9f9d0d541cc3496ebf8dc71af4254506"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9f9d0d541cc3496ebf8dc71af4254506"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9f9d0d541cc3496ebf8dc71af4254506"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServerActionsTestJSON-1828815177 Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 9f9d0d541cc3496ebf8dc71af4254506 Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServerActionsTestJSON-1828815177 Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServerActionsTestJSON-1828815177-project Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 157c0ef579434726810bb3775388b944 Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServerActionsTestJSON-1828815177-project Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: exception: Instance ded1b2fb-9552-4973-bf20-2c590b49e179 could not be found. Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'ded1b2fb-9552-4973-bf20-2c590b49e179'} Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ded1b2fb-9552-4973-bf20-2c590b49e179 could not be found. Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ded1b2fb-9552-4973-bf20-2c590b49e179 could not be found. Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:48:17.239972 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:48:17.251055 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:48:17.251055 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:48:17.251055 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:48:17.251055 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:48:17.251055 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:48:17.251055 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ded1b2fb-9552-4973-bf20-2c590b49e179 could not be found. Oct 30 01:48:17.251055 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:48:17.251055 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8b5f364e-30c8-45ae-82a5-f2e31fe73773 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Returning 404 to user: Instance ded1b2fb-9552-4973-bf20-2c590b49e179 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:48:17.251055 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8b5f364e-30c8-45ae-82a5-f2e31fe73773 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179" status: 404 len: 111 microversion: 2.1 time: 0.049900 Oct 30 01:48:17.251055 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3039/6083] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:17 2022] GET /compute/v2.1/servers/ded1b2fb-9552-4973-bf20-2c590b49e179 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:48:17.255061 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-39026453-d22e-4801-a7b3-26901cdee897 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:17.255771 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-39026453-d22e-4801-a7b3-26901cdee897 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 1f5100bd-9d74-4990-8b1f-52011ed9d19f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:17.262245 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-39026453-d22e-4801-a7b3-26901cdee897 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:17.262869 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-39026453-d22e-4801-a7b3-26901cdee897 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:17.263404 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-39026453-d22e-4801-a7b3-26901cdee897 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:17.264348 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-39026453-d22e-4801-a7b3-26901cdee897 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:17.264910 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-39026453-d22e-4801-a7b3-26901cdee897 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:17.265475 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-39026453-d22e-4801-a7b3-26901cdee897 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:17.305649 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-39026453-d22e-4801-a7b3-26901cdee897 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 1f5100bd-9d74-4990-8b1f-52011ed9d19f] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:48:17.382402 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8860d8dd-6fb8-4cf4-9ca4-287a150d262c tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d699d4b51d4dc8ac1d8ff5aee36290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f00019b8a440b994269dce91d83768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:17.390073 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8860d8dd-6fb8-4cf4-9ca4-287a150d262c tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] 10.222.0.13 "GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1" status: 200 len: 1509 microversion: 2.1 time: 0.267914 Oct 30 01:48:17.390670 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3045/6084] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:17 2022] GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1 => generated 1509 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:17.692016 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-39026453-d22e-4801-a7b3-26901cdee897 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "DELETE /compute/v2.1/servers/1f5100bd-9d74-4990-8b1f-52011ed9d19f" status: 204 len: 0 microversion: 2.1 time: 0.442802 Oct 30 01:48:17.692617 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3040/6085] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:48:17 2022] DELETE /compute/v2.1/servers/1f5100bd-9d74-4990-8b1f-52011ed9d19f => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 30 01:48:17.701961 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-26725319-1ce4-45f5-8ba7-0ec8aa1dc909 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:17.702725 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-26725319-1ce4-45f5-8ba7-0ec8aa1dc909 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 1f5100bd-9d74-4990-8b1f-52011ed9d19f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:17.711105 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-26725319-1ce4-45f5-8ba7-0ec8aa1dc909 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:17.712250 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-26725319-1ce4-45f5-8ba7-0ec8aa1dc909 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:17.713026 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-26725319-1ce4-45f5-8ba7-0ec8aa1dc909 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:17.714512 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-26725319-1ce4-45f5-8ba7-0ec8aa1dc909 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:17.715404 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-26725319-1ce4-45f5-8ba7-0ec8aa1dc909 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:17.716394 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-26725319-1ce4-45f5-8ba7-0ec8aa1dc909 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:17.727135 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-58cce896-05f2-4242-9cc3-ae63d714d187 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:17.727873 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-58cce896-05f2-4242-9cc3-ae63d714d187 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] [instance: 300173a2-4840-4875-8e23-b3b86907a590] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:17.741283 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58cce896-05f2-4242-9cc3-ae63d714d187 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:17.741283 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58cce896-05f2-4242-9cc3-ae63d714d187 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:17.741283 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58cce896-05f2-4242-9cc3-ae63d714d187 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:17.743787 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58cce896-05f2-4242-9cc3-ae63d714d187 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:17.744285 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58cce896-05f2-4242-9cc3-ae63d714d187 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:17.744724 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58cce896-05f2-4242-9cc3-ae63d714d187 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:17.855388 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-58cce896-05f2-4242-9cc3-ae63d714d187 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7978c02b2bf413b81e1d14350af13b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f136933de5465f8590e9b153955d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:17.864104 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-58cce896-05f2-4242-9cc3-ae63d714d187 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] 10.222.0.13 "GET /compute/v2.1/servers/300173a2-4840-4875-8e23-b3b86907a590" status: 200 len: 1217 microversion: 2.1 time: 0.141572 Oct 30 01:48:17.864989 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3041/6086] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:17 2022] GET /compute/v2.1/servers/300173a2-4840-4875-8e23-b3b86907a590 => generated 1217 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:48:17.873121 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-26725319-1ce4-45f5-8ba7-0ec8aa1dc909 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:17.885561 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-26725319-1ce4-45f5-8ba7-0ec8aa1dc909 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/1f5100bd-9d74-4990-8b1f-52011ed9d19f" status: 200 len: 1465 microversion: 2.1 time: 0.188512 Oct 30 01:48:17.886188 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3046/6087] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:17 2022] GET /compute/v2.1/servers/1f5100bd-9d74-4990-8b1f-52011ed9d19f => generated 1465 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:18.414229 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-13b58c4f-2eb7-45b4-8b72-413315523934 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:18.469310 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-13b58c4f-2eb7-45b4-8b72-413315523934 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] [instance: 93431237-06a2-41b5-a732-ddcdfada26d1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:18.469310 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-13b58c4f-2eb7-45b4-8b72-413315523934 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:18.469310 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-13b58c4f-2eb7-45b4-8b72-413315523934 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:18.469310 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-13b58c4f-2eb7-45b4-8b72-413315523934 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:18.469310 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-13b58c4f-2eb7-45b4-8b72-413315523934 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:18.469310 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-13b58c4f-2eb7-45b4-8b72-413315523934 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:18.469310 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-13b58c4f-2eb7-45b4-8b72-413315523934 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:18.565531 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-13b58c4f-2eb7-45b4-8b72-413315523934 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d699d4b51d4dc8ac1d8ff5aee36290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f00019b8a440b994269dce91d83768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:18.573083 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-13b58c4f-2eb7-45b4-8b72-413315523934 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] 10.222.0.13 "GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1" status: 200 len: 1492 microversion: 2.1 time: 0.163125 Oct 30 01:48:18.573682 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3042/6088] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:18 2022] GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1 => generated 1492 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:18.596686 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-20928919-a1fb-4350-ab50-4d0bb3ae9d9c tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:48:18.597947 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-20928919-a1fb-4350-ab50-4d0bb3ae9d9c tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] [instance: 93431237-06a2-41b5-a732-ddcdfada26d1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:18.605547 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-20928919-a1fb-4350-ab50-4d0bb3ae9d9c tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:18.606041 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-20928919-a1fb-4350-ab50-4d0bb3ae9d9c tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:18.606508 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-20928919-a1fb-4350-ab50-4d0bb3ae9d9c tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:18.607211 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-20928919-a1fb-4350-ab50-4d0bb3ae9d9c tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:18.607956 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-20928919-a1fb-4350-ab50-4d0bb3ae9d9c tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:18.608470 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-20928919-a1fb-4350-ab50-4d0bb3ae9d9c tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:18.847594 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-20928919-a1fb-4350-ab50-4d0bb3ae9d9c tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] 10.222.0.13 "POST /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1/action" status: 202 len: 0 microversion: 2.1 time: 0.254091 Oct 30 01:48:18.848900 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3047/6089] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:48:18 2022] POST /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:48:18.859067 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4ff95039-4f46-467c-a8ac-0eb45dbce349 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:18.861584 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4ff95039-4f46-467c-a8ac-0eb45dbce349 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] [instance: 93431237-06a2-41b5-a732-ddcdfada26d1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:18.868651 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4ff95039-4f46-467c-a8ac-0eb45dbce349 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:18.869583 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4ff95039-4f46-467c-a8ac-0eb45dbce349 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:18.872352 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4ff95039-4f46-467c-a8ac-0eb45dbce349 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:18.887268 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4ff95039-4f46-467c-a8ac-0eb45dbce349 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:18.887689 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4ff95039-4f46-467c-a8ac-0eb45dbce349 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:18.888323 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4ff95039-4f46-467c-a8ac-0eb45dbce349 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:18.889042 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-00333374-3567-4333-bb8f-f304ca157e2d tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:18.889773 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-00333374-3567-4333-bb8f-f304ca157e2d tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] [instance: 300173a2-4840-4875-8e23-b3b86907a590] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:18.899539 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00333374-3567-4333-bb8f-f304ca157e2d tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:18.900031 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00333374-3567-4333-bb8f-f304ca157e2d tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:18.901089 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00333374-3567-4333-bb8f-f304ca157e2d tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:18.901880 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00333374-3567-4333-bb8f-f304ca157e2d tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:18.902721 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00333374-3567-4333-bb8f-f304ca157e2d tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:18.903318 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00333374-3567-4333-bb8f-f304ca157e2d tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:19.014837 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-00333374-3567-4333-bb8f-f304ca157e2d tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7978c02b2bf413b81e1d14350af13b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f136933de5465f8590e9b153955d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:19.023314 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-00333374-3567-4333-bb8f-f304ca157e2d tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] 10.222.0.13 "GET /compute/v2.1/servers/300173a2-4840-4875-8e23-b3b86907a590" status: 200 len: 1265 microversion: 2.1 time: 0.138765 Oct 30 01:48:19.024497 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3048/6090] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:18 2022] GET /compute/v2.1/servers/300173a2-4840-4875-8e23-b3b86907a590 => generated 1265 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:48:19.035304 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c06ea944-b030-41e8-81a6-11abb7432735 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:19.035304 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c06ea944-b030-41e8-81a6-11abb7432735 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 1f5100bd-9d74-4990-8b1f-52011ed9d19f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:19.045912 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c06ea944-b030-41e8-81a6-11abb7432735 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:19.046686 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c06ea944-b030-41e8-81a6-11abb7432735 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:19.047863 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c06ea944-b030-41e8-81a6-11abb7432735 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:19.048799 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c06ea944-b030-41e8-81a6-11abb7432735 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:19.049500 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c06ea944-b030-41e8-81a6-11abb7432735 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:19.050431 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c06ea944-b030-41e8-81a6-11abb7432735 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:19.195439 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c06ea944-b030-41e8-81a6-11abb7432735 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:19.201715 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c06ea944-b030-41e8-81a6-11abb7432735 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/1f5100bd-9d74-4990-8b1f-52011ed9d19f" status: 200 len: 1465 microversion: 2.1 time: 0.175914 Oct 30 01:48:19.207479 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4ff95039-4f46-467c-a8ac-0eb45dbce349 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d699d4b51d4dc8ac1d8ff5aee36290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f00019b8a440b994269dce91d83768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:19.213676 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3049/6091] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:19 2022] GET /compute/v2.1/servers/1f5100bd-9d74-4990-8b1f-52011ed9d19f => generated 1465 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:19.218159 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4ff95039-4f46-467c-a8ac-0eb45dbce349 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] 10.222.0.13 "GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1" status: 200 len: 1498 microversion: 2.1 time: 0.364841 Oct 30 01:48:19.233381 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3043/6092] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:18 2022] GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1 => generated 1498 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:20.049027 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c5b6bbea-2001-4b0a-ba00-ba822e320249 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:20.049667 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c5b6bbea-2001-4b0a-ba00-ba822e320249 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] [instance: 300173a2-4840-4875-8e23-b3b86907a590] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:20.077653 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-da8d78f6-e8d7-4e34-ad6e-ca8438307c29 req-5a7b9fb0-2184-402c-be52-9a5c962550d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f5100bd-9d74-4990-8b1f-52011ed9d19f", "name": "network-vif-deleted", "tag": "3221ff94-adbf-42f6-a6dc-7d703b7ea10e"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:48:20.082888 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c5b6bbea-2001-4b0a-ba00-ba822e320249 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:20.084928 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c5b6bbea-2001-4b0a-ba00-ba822e320249 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:20.087116 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c5b6bbea-2001-4b0a-ba00-ba822e320249 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:20.096183 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-da8d78f6-e8d7-4e34-ad6e-ca8438307c29 req-5a7b9fb0-2184-402c-be52-9a5c962550d0 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:20.096435 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c5b6bbea-2001-4b0a-ba00-ba822e320249 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:20.096691 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-da8d78f6-e8d7-4e34-ad6e-ca8438307c29 req-5a7b9fb0-2184-402c-be52-9a5c962550d0 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:20.097134 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-da8d78f6-e8d7-4e34-ad6e-ca8438307c29 req-5a7b9fb0-2184-402c-be52-9a5c962550d0 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:20.106597 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c5b6bbea-2001-4b0a-ba00-ba822e320249 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:20.106597 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c5b6bbea-2001-4b0a-ba00-ba822e320249 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:20.115760 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-da8d78f6-e8d7-4e34-ad6e-ca8438307c29 req-5a7b9fb0-2184-402c-be52-9a5c962550d0 service nova] Creating event network-vif-deleted:3221ff94-adbf-42f6-a6dc-7d703b7ea10e for instance 1f5100bd-9d74-4990-8b1f-52011ed9d19f on n-h2-master-1 Oct 30 01:48:20.124490 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-da8d78f6-e8d7-4e34-ad6e-ca8438307c29 req-5a7b9fb0-2184-402c-be52-9a5c962550d0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056626 Oct 30 01:48:20.130523 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3044/6093] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:48:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:48:20.230672 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-670006f7-1972-4848-b7b4-004fee1c259d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:20.235117 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-670006f7-1972-4848-b7b4-004fee1c259d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 1f5100bd-9d74-4990-8b1f-52011ed9d19f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:20.267036 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-670006f7-1972-4848-b7b4-004fee1c259d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:20.268777 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-670006f7-1972-4848-b7b4-004fee1c259d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:20.269539 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-670006f7-1972-4848-b7b4-004fee1c259d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:20.270484 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-670006f7-1972-4848-b7b4-004fee1c259d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:20.274069 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-670006f7-1972-4848-b7b4-004fee1c259d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:20.275085 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-670006f7-1972-4848-b7b4-004fee1c259d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:20.349871 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c5b6bbea-2001-4b0a-ba00-ba822e320249 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7978c02b2bf413b81e1d14350af13b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f136933de5465f8590e9b153955d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:20.362918 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c5b6bbea-2001-4b0a-ba00-ba822e320249 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] 10.222.0.13 "GET /compute/v2.1/servers/300173a2-4840-4875-8e23-b3b86907a590" status: 200 len: 1271 microversion: 2.1 time: 0.317968 Oct 30 01:48:20.365415 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3050/6094] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:20 2022] GET /compute/v2.1/servers/300173a2-4840-4875-8e23-b3b86907a590 => generated 1271 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:20.378736 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3f9c4462-cab9-4adf-996b-948f394e3916 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:20.379361 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3f9c4462-cab9-4adf-996b-948f394e3916 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] [instance: 93431237-06a2-41b5-a732-ddcdfada26d1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:20.389098 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f9c4462-cab9-4adf-996b-948f394e3916 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:20.389732 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f9c4462-cab9-4adf-996b-948f394e3916 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:20.390055 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f9c4462-cab9-4adf-996b-948f394e3916 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:20.390770 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f9c4462-cab9-4adf-996b-948f394e3916 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:20.391266 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f9c4462-cab9-4adf-996b-948f394e3916 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:20.392413 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f9c4462-cab9-4adf-996b-948f394e3916 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:20.412846 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-670006f7-1972-4848-b7b4-004fee1c259d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:20.425211 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-670006f7-1972-4848-b7b4-004fee1c259d tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/1f5100bd-9d74-4990-8b1f-52011ed9d19f" status: 200 len: 1465 microversion: 2.1 time: 0.199697 Oct 30 01:48:20.425905 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3045/6095] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:20 2022] GET /compute/v2.1/servers/1f5100bd-9d74-4990-8b1f-52011ed9d19f => generated 1465 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:48:20.659498 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3f9c4462-cab9-4adf-996b-948f394e3916 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d699d4b51d4dc8ac1d8ff5aee36290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f00019b8a440b994269dce91d83768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:20.689049 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3f9c4462-cab9-4adf-996b-948f394e3916 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] 10.222.0.13 "GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1" status: 200 len: 1498 microversion: 2.1 time: 0.321937 Oct 30 01:48:20.702787 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3051/6096] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:20 2022] GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1 => generated 1498 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:21.399580 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d8844836-fb46-4f55-834a-e6916241d838 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:21.401008 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d8844836-fb46-4f55-834a-e6916241d838 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] [instance: 300173a2-4840-4875-8e23-b3b86907a590] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:21.412028 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d8844836-fb46-4f55-834a-e6916241d838 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:21.412955 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d8844836-fb46-4f55-834a-e6916241d838 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:21.413619 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d8844836-fb46-4f55-834a-e6916241d838 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:21.415417 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d8844836-fb46-4f55-834a-e6916241d838 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:21.437710 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d8844836-fb46-4f55-834a-e6916241d838 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:21.437710 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d8844836-fb46-4f55-834a-e6916241d838 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:21.449888 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f841a914-87e2-4fb8-98f3-c741098ae35e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:21.450594 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f841a914-87e2-4fb8-98f3-c741098ae35e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 1f5100bd-9d74-4990-8b1f-52011ed9d19f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:21.458948 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f841a914-87e2-4fb8-98f3-c741098ae35e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:21.459801 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f841a914-87e2-4fb8-98f3-c741098ae35e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:21.465612 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f841a914-87e2-4fb8-98f3-c741098ae35e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:21.465612 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f841a914-87e2-4fb8-98f3-c741098ae35e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:21.465612 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f841a914-87e2-4fb8-98f3-c741098ae35e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:21.465612 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f841a914-87e2-4fb8-98f3-c741098ae35e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:21.506382 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f841a914-87e2-4fb8-98f3-c741098ae35e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:21.507109 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f841a914-87e2-4fb8-98f3-c741098ae35e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:21.507745 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f841a914-87e2-4fb8-98f3-c741098ae35e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:21.508395 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-f841a914-87e2-4fb8-98f3-c741098ae35e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lazy-loading 'fault' on Instance uuid 1f5100bd-9d74-4990-8b1f-52011ed9d19f {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:48:21.596800 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f841a914-87e2-4fb8-98f3-c741098ae35e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:21.610967 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f841a914-87e2-4fb8-98f3-c741098ae35e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/1f5100bd-9d74-4990-8b1f-52011ed9d19f" status: 200 len: 1304 microversion: 2.1 time: 0.165197 Oct 30 01:48:21.612967 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3052/6097] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:21 2022] GET /compute/v2.1/servers/1f5100bd-9d74-4990-8b1f-52011ed9d19f => generated 1304 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:48:21.716690 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5b9140db-806d-471f-a740-ee869eaefb7d tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:21.717643 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5b9140db-806d-471f-a740-ee869eaefb7d tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] [instance: 93431237-06a2-41b5-a732-ddcdfada26d1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:21.723841 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5b9140db-806d-471f-a740-ee869eaefb7d tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:21.724630 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5b9140db-806d-471f-a740-ee869eaefb7d tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:21.725251 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5b9140db-806d-471f-a740-ee869eaefb7d tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:21.726447 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5b9140db-806d-471f-a740-ee869eaefb7d tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:21.726973 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5b9140db-806d-471f-a740-ee869eaefb7d tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:21.727591 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5b9140db-806d-471f-a740-ee869eaefb7d tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:21.727862 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d8844836-fb46-4f55-834a-e6916241d838 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7978c02b2bf413b81e1d14350af13b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f136933de5465f8590e9b153955d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:21.741695 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d8844836-fb46-4f55-834a-e6916241d838 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] 10.222.0.13 "GET /compute/v2.1/servers/300173a2-4840-4875-8e23-b3b86907a590" status: 200 len: 1313 microversion: 2.1 time: 0.350637 Oct 30 01:48:21.743004 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3046/6098] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:21 2022] GET /compute/v2.1/servers/300173a2-4840-4875-8e23-b3b86907a590 => generated 1313 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:21.977041 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5b9140db-806d-471f-a740-ee869eaefb7d tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d699d4b51d4dc8ac1d8ff5aee36290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f00019b8a440b994269dce91d83768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:21.986572 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5b9140db-806d-471f-a740-ee869eaefb7d tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] 10.222.0.13 "GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1" status: 200 len: 1501 microversion: 2.1 time: 0.274113 Oct 30 01:48:22.005762 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3053/6099] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:21 2022] GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1 => generated 1501 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:22.012077 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-da5822fc-7132-4371-aa19-03706b7101ca tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:22.012876 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-da5822fc-7132-4371-aa19-03706b7101ca tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] [instance: 93431237-06a2-41b5-a732-ddcdfada26d1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:22.019978 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da5822fc-7132-4371-aa19-03706b7101ca tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:22.020788 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da5822fc-7132-4371-aa19-03706b7101ca tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:22.021443 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da5822fc-7132-4371-aa19-03706b7101ca tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:22.022345 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da5822fc-7132-4371-aa19-03706b7101ca tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:22.023030 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da5822fc-7132-4371-aa19-03706b7101ca tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:22.023678 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da5822fc-7132-4371-aa19-03706b7101ca tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:22.050731 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-da5822fc-7132-4371-aa19-03706b7101ca tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] [instance: 93431237-06a2-41b5-a732-ddcdfada26d1] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:48:22.405837 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-da5822fc-7132-4371-aa19-03706b7101ca tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] 10.222.0.13 "DELETE /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1" status: 204 len: 0 microversion: 2.1 time: 0.397528 Oct 30 01:48:22.414819 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3047/6100] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:48:22 2022] DELETE /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:48:22.420128 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d45e3bb3-b57f-493e-94fa-94f0cd419739 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:22.423554 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d45e3bb3-b57f-493e-94fa-94f0cd419739 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] [instance: 93431237-06a2-41b5-a732-ddcdfada26d1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:22.433847 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d45e3bb3-b57f-493e-94fa-94f0cd419739 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:22.434638 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d45e3bb3-b57f-493e-94fa-94f0cd419739 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:22.435300 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d45e3bb3-b57f-493e-94fa-94f0cd419739 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:22.436183 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d45e3bb3-b57f-493e-94fa-94f0cd419739 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:22.437740 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-195a7cbd-626b-4765-bfae-ba9d292680ae req-bb10f5d0-351e-488c-8a2a-4484ac1290de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "300173a2-4840-4875-8e23-b3b86907a590", "tag": "16ec17ae-ae4d-4fe2-9a13-248f6b46edcb"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:48:22.455444 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d45e3bb3-b57f-493e-94fa-94f0cd419739 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:22.456028 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d45e3bb3-b57f-493e-94fa-94f0cd419739 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:22.468151 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-195a7cbd-626b-4765-bfae-ba9d292680ae req-bb10f5d0-351e-488c-8a2a-4484ac1290de service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:22.468304 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-195a7cbd-626b-4765-bfae-ba9d292680ae req-bb10f5d0-351e-488c-8a2a-4484ac1290de service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:22.468759 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-195a7cbd-626b-4765-bfae-ba9d292680ae req-bb10f5d0-351e-488c-8a2a-4484ac1290de service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:22.484035 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-195a7cbd-626b-4765-bfae-ba9d292680ae req-bb10f5d0-351e-488c-8a2a-4484ac1290de service nova] Creating event network-changed:16ec17ae-ae4d-4fe2-9a13-248f6b46edcb for instance 300173a2-4840-4875-8e23-b3b86907a590 on n-h1-master-1 Oct 30 01:48:22.490902 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-195a7cbd-626b-4765-bfae-ba9d292680ae req-bb10f5d0-351e-488c-8a2a-4484ac1290de service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066215 Oct 30 01:48:22.492085 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3048/6101] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:48:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:48:22.639399 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0ebd6cd0-6a45-4843-b7a4-9998469eb659 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:22.640106 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0ebd6cd0-6a45-4843-b7a4-9998469eb659 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 1f5100bd-9d74-4990-8b1f-52011ed9d19f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:22.647380 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0ebd6cd0-6a45-4843-b7a4-9998469eb659 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:22.647871 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0ebd6cd0-6a45-4843-b7a4-9998469eb659 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:22.648435 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0ebd6cd0-6a45-4843-b7a4-9998469eb659 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:22.649046 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0ebd6cd0-6a45-4843-b7a4-9998469eb659 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:22.649854 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0ebd6cd0-6a45-4843-b7a4-9998469eb659 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:22.650387 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0ebd6cd0-6a45-4843-b7a4-9998469eb659 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:22.665713 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-0ebd6cd0-6a45-4843-b7a4-9998469eb659 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] HTTP exception thrown: Instance 1f5100bd-9d74-4990-8b1f-52011ed9d19f could not be found. Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0ebd6cd0-6a45-4843-b7a4-9998469eb659 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Request method failure captured: Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/1f5100bd-9d74-4990-8b1f-52011ed9d19f HTTP/1.1 Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdXv08UieK2P0p6pvt8NCvlDNpE7nwwmqKRy3GqbMTGA0eIN66Y4wpKQHzC9fqGSwWNMELWbqq5UQS3MEVOVNfA2QR9cXwwAeRlgzmSRghjjPbvWjrnWlt2xXhoJQePHPZSUYBnEovFZtPMPN8ilqbXGb8wb5Tc4mNTDR3WIqu8sIR0 Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 9f9d0d541cc3496ebf8dc71af4254506 Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServerActionsTestJSON-1828815177 Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9f9d0d541cc3496ebf8dc71af4254506"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9f9d0d541cc3496ebf8dc71af4254506"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9f9d0d541cc3496ebf8dc71af4254506"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9f9d0d541cc3496ebf8dc71af4254506"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServerActionsTestJSON-1828815177 Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 9f9d0d541cc3496ebf8dc71af4254506 Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServerActionsTestJSON-1828815177 Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServerActionsTestJSON-1828815177-project Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 157c0ef579434726810bb3775388b944 Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServerActionsTestJSON-1828815177-project Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 1f5100bd-9d74-4990-8b1f-52011ed9d19f could not be found. Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '1f5100bd-9d74-4990-8b1f-52011ed9d19f'} Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f5100bd-9d74-4990-8b1f-52011ed9d19f could not be found. Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f5100bd-9d74-4990-8b1f-52011ed9d19f could not be found. Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:48:22.670267 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:48:22.675984 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:48:22.675984 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:48:22.675984 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:48:22.675984 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:48:22.675984 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:48:22.675984 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f5100bd-9d74-4990-8b1f-52011ed9d19f could not be found. Oct 30 01:48:22.675984 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:48:22.675984 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0ebd6cd0-6a45-4843-b7a4-9998469eb659 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Returning 404 to user: Instance 1f5100bd-9d74-4990-8b1f-52011ed9d19f could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:48:22.675984 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0ebd6cd0-6a45-4843-b7a4-9998469eb659 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/1f5100bd-9d74-4990-8b1f-52011ed9d19f" status: 404 len: 111 microversion: 2.1 time: 0.036527 Oct 30 01:48:22.675984 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3049/6102] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:22 2022] GET /compute/v2.1/servers/1f5100bd-9d74-4990-8b1f-52011ed9d19f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 01:48:22.679548 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a2126e16-7e28-4b7c-9704-2fedabe1aeff tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:22.680115 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a2126e16-7e28-4b7c-9704-2fedabe1aeff tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: a0a1550e-e885-495b-9199-04334dce39dd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:22.686051 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a2126e16-7e28-4b7c-9704-2fedabe1aeff tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:22.686608 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a2126e16-7e28-4b7c-9704-2fedabe1aeff tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:22.687130 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a2126e16-7e28-4b7c-9704-2fedabe1aeff tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:22.687859 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a2126e16-7e28-4b7c-9704-2fedabe1aeff tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:22.688450 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a2126e16-7e28-4b7c-9704-2fedabe1aeff tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:22.689111 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a2126e16-7e28-4b7c-9704-2fedabe1aeff tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:22.701837 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d45e3bb3-b57f-493e-94fa-94f0cd419739 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d699d4b51d4dc8ac1d8ff5aee36290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f00019b8a440b994269dce91d83768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:22.711701 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d45e3bb3-b57f-493e-94fa-94f0cd419739 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] 10.222.0.13 "GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1" status: 200 len: 1507 microversion: 2.1 time: 0.298203 Oct 30 01:48:22.712494 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3054/6103] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:22 2022] GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1 => generated 1507 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:22.715966 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a2126e16-7e28-4b7c-9704-2fedabe1aeff tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: a0a1550e-e885-495b-9199-04334dce39dd] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:48:22.766509 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6acbc53a-88cb-4517-b625-b9f4963476fb tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:22.769602 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6acbc53a-88cb-4517-b625-b9f4963476fb tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] [instance: 300173a2-4840-4875-8e23-b3b86907a590] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:22.776184 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6acbc53a-88cb-4517-b625-b9f4963476fb tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:22.776693 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6acbc53a-88cb-4517-b625-b9f4963476fb tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:22.777154 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6acbc53a-88cb-4517-b625-b9f4963476fb tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:22.779951 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6acbc53a-88cb-4517-b625-b9f4963476fb tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:22.779951 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6acbc53a-88cb-4517-b625-b9f4963476fb tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:22.779951 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6acbc53a-88cb-4517-b625-b9f4963476fb tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:22.965779 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6acbc53a-88cb-4517-b625-b9f4963476fb tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7978c02b2bf413b81e1d14350af13b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f136933de5465f8590e9b153955d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:22.978416 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6acbc53a-88cb-4517-b625-b9f4963476fb tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] 10.222.0.13 "GET /compute/v2.1/servers/300173a2-4840-4875-8e23-b3b86907a590" status: 200 len: 1313 microversion: 2.1 time: 0.216233 Oct 30 01:48:22.979496 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3055/6104] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:22 2022] GET /compute/v2.1/servers/300173a2-4840-4875-8e23-b3b86907a590 => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:48:23.010681 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:23.089572 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a2126e16-7e28-4b7c-9704-2fedabe1aeff tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd" status: 204 len: 0 microversion: 2.1 time: 0.411032 Oct 30 01:48:23.091004 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3050/6105] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:48:22 2022] DELETE /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 30 01:48:23.099003 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d3de7b73-f5d2-4d3d-95ca-501c437e67e8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:23.099624 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d3de7b73-f5d2-4d3d-95ca-501c437e67e8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: a0a1550e-e885-495b-9199-04334dce39dd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:23.111217 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3de7b73-f5d2-4d3d-95ca-501c437e67e8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:23.112655 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3de7b73-f5d2-4d3d-95ca-501c437e67e8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:23.112655 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3de7b73-f5d2-4d3d-95ca-501c437e67e8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:23.113026 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3de7b73-f5d2-4d3d-95ca-501c437e67e8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:23.113262 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3de7b73-f5d2-4d3d-95ca-501c437e67e8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:23.113718 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3de7b73-f5d2-4d3d-95ca-501c437e67e8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:23.372180 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d3de7b73-f5d2-4d3d-95ca-501c437e67e8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:23.381154 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d3de7b73-f5d2-4d3d-95ca-501c437e67e8 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd" status: 200 len: 1509 microversion: 2.1 time: 0.286127 Oct 30 01:48:23.381772 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3056/6106] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:23 2022] GET /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd => generated 1509 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:23.737033 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-13304b24-fff4-480e-ac9b-f1b08ed4008c tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:23.737811 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-13304b24-fff4-480e-ac9b-f1b08ed4008c tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] [instance: 93431237-06a2-41b5-a732-ddcdfada26d1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:23.745551 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-13304b24-fff4-480e-ac9b-f1b08ed4008c tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:23.746153 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-13304b24-fff4-480e-ac9b-f1b08ed4008c tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:23.746604 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-13304b24-fff4-480e-ac9b-f1b08ed4008c tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:23.747320 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-13304b24-fff4-480e-ac9b-f1b08ed4008c tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:23.747785 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-13304b24-fff4-480e-ac9b-f1b08ed4008c tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:23.748220 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-13304b24-fff4-480e-ac9b-f1b08ed4008c tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:23.898220 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-13304b24-fff4-480e-ac9b-f1b08ed4008c tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d699d4b51d4dc8ac1d8ff5aee36290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f00019b8a440b994269dce91d83768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:23.908459 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-13304b24-fff4-480e-ac9b-f1b08ed4008c tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] 10.222.0.13 "GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1" status: 200 len: 1507 microversion: 2.1 time: 0.175847 Oct 30 01:48:23.909391 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3051/6107] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:23 2022] GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1 => generated 1507 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:24.004244 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b0160357-8af3-4e27-81f0-1b313778f661 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:24.004859 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b0160357-8af3-4e27-81f0-1b313778f661 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] [instance: 300173a2-4840-4875-8e23-b3b86907a590] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:24.012193 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0160357-8af3-4e27-81f0-1b313778f661 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:24.012870 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0160357-8af3-4e27-81f0-1b313778f661 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:24.013304 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0160357-8af3-4e27-81f0-1b313778f661 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:24.014227 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0160357-8af3-4e27-81f0-1b313778f661 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:24.014679 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0160357-8af3-4e27-81f0-1b313778f661 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:24.015099 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0160357-8af3-4e27-81f0-1b313778f661 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:24.172236 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b0160357-8af3-4e27-81f0-1b313778f661 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7978c02b2bf413b81e1d14350af13b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f136933de5465f8590e9b153955d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:24.182059 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b0160357-8af3-4e27-81f0-1b313778f661 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] 10.222.0.13 "GET /compute/v2.1/servers/300173a2-4840-4875-8e23-b3b86907a590" status: 200 len: 1313 microversion: 2.1 time: 0.181839 Oct 30 01:48:24.182865 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3057/6108] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:23 2022] GET /compute/v2.1/servers/300173a2-4840-4875-8e23-b3b86907a590 => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:24.405898 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-680be00a-d457-494c-8bf6-025af0f1344e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:24.405898 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-680be00a-d457-494c-8bf6-025af0f1344e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: a0a1550e-e885-495b-9199-04334dce39dd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:24.412111 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-680be00a-d457-494c-8bf6-025af0f1344e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:24.412710 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-680be00a-d457-494c-8bf6-025af0f1344e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:24.413240 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-680be00a-d457-494c-8bf6-025af0f1344e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:24.413977 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-680be00a-d457-494c-8bf6-025af0f1344e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:24.414435 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-680be00a-d457-494c-8bf6-025af0f1344e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:24.414863 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-680be00a-d457-494c-8bf6-025af0f1344e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:24.550331 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-680be00a-d457-494c-8bf6-025af0f1344e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:24.558567 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-680be00a-d457-494c-8bf6-025af0f1344e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd" status: 200 len: 1509 microversion: 2.1 time: 0.158376 Oct 30 01:48:24.559144 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3052/6109] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:24 2022] GET /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:24.932378 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-77738283-8a85-48f8-bca4-ce7c2cb33174 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:24.932995 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-77738283-8a85-48f8-bca4-ce7c2cb33174 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] [instance: 93431237-06a2-41b5-a732-ddcdfada26d1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:24.939229 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-77738283-8a85-48f8-bca4-ce7c2cb33174 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:24.939971 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-77738283-8a85-48f8-bca4-ce7c2cb33174 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:24.940838 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-77738283-8a85-48f8-bca4-ce7c2cb33174 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:24.941571 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-77738283-8a85-48f8-bca4-ce7c2cb33174 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:24.942032 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-77738283-8a85-48f8-bca4-ce7c2cb33174 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:24.942496 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-77738283-8a85-48f8-bca4-ce7c2cb33174 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:25.086160 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-77738283-8a85-48f8-bca4-ce7c2cb33174 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d699d4b51d4dc8ac1d8ff5aee36290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f00019b8a440b994269dce91d83768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:25.094951 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-77738283-8a85-48f8-bca4-ce7c2cb33174 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] 10.222.0.13 "GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1" status: 200 len: 1507 microversion: 2.1 time: 0.166856 Oct 30 01:48:25.095528 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3058/6110] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:24 2022] GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1 => generated 1507 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:25.205100 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ffba3daf-def1-4386-858b-dc650355007b tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:25.205891 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ffba3daf-def1-4386-858b-dc650355007b tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] [instance: 300173a2-4840-4875-8e23-b3b86907a590] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:25.213061 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ffba3daf-def1-4386-858b-dc650355007b tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:25.213688 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ffba3daf-def1-4386-858b-dc650355007b tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:25.214197 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ffba3daf-def1-4386-858b-dc650355007b tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:25.214965 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ffba3daf-def1-4386-858b-dc650355007b tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:25.215484 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ffba3daf-def1-4386-858b-dc650355007b tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:25.216035 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ffba3daf-def1-4386-858b-dc650355007b tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:25.232215 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:25.356264 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ffba3daf-def1-4386-858b-dc650355007b tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7978c02b2bf413b81e1d14350af13b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f136933de5465f8590e9b153955d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:25.365402 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ffba3daf-def1-4386-858b-dc650355007b tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] 10.222.0.13 "GET /compute/v2.1/servers/300173a2-4840-4875-8e23-b3b86907a590" status: 200 len: 1313 microversion: 2.1 time: 0.164234 Oct 30 01:48:25.366170 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3053/6111] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:25 2022] GET /compute/v2.1/servers/300173a2-4840-4875-8e23-b3b86907a590 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:25.584435 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b9c3281d-1433-4a85-a331-de9c0e3c549a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:25.585200 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b9c3281d-1433-4a85-a331-de9c0e3c549a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: a0a1550e-e885-495b-9199-04334dce39dd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:25.591359 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b9c3281d-1433-4a85-a331-de9c0e3c549a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:25.592132 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b9c3281d-1433-4a85-a331-de9c0e3c549a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:25.592598 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b9c3281d-1433-4a85-a331-de9c0e3c549a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:25.593297 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b9c3281d-1433-4a85-a331-de9c0e3c549a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:25.593919 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b9c3281d-1433-4a85-a331-de9c0e3c549a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:25.594440 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b9c3281d-1433-4a85-a331-de9c0e3c549a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:25.787430 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b9c3281d-1433-4a85-a331-de9c0e3c549a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:25.796575 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b9c3281d-1433-4a85-a331-de9c0e3c549a tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd" status: 200 len: 1509 microversion: 2.1 time: 0.217846 Oct 30 01:48:25.797797 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3059/6112] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:25 2022] GET /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd => generated 1509 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:26.120438 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0b3903cc-03fe-4297-bc67-a09c23226a57 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:26.123368 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0b3903cc-03fe-4297-bc67-a09c23226a57 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] [instance: 93431237-06a2-41b5-a732-ddcdfada26d1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:26.131495 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b3903cc-03fe-4297-bc67-a09c23226a57 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:26.134050 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b3903cc-03fe-4297-bc67-a09c23226a57 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:26.135460 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b3903cc-03fe-4297-bc67-a09c23226a57 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:26.136424 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b3903cc-03fe-4297-bc67-a09c23226a57 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:26.137198 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b3903cc-03fe-4297-bc67-a09c23226a57 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:26.137945 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b3903cc-03fe-4297-bc67-a09c23226a57 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:26.389276 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b30c2855-9ec9-4222-acc2-63cd43c87b15 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:26.391361 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b30c2855-9ec9-4222-acc2-63cd43c87b15 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] [instance: 300173a2-4840-4875-8e23-b3b86907a590] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:26.396633 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:26.409587 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b30c2855-9ec9-4222-acc2-63cd43c87b15 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:26.411721 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b30c2855-9ec9-4222-acc2-63cd43c87b15 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:26.417626 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b30c2855-9ec9-4222-acc2-63cd43c87b15 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:26.419312 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b30c2855-9ec9-4222-acc2-63cd43c87b15 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:26.422117 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b30c2855-9ec9-4222-acc2-63cd43c87b15 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:26.422780 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b30c2855-9ec9-4222-acc2-63cd43c87b15 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:26.464356 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:26.676751 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=8 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:26.826376 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b30c2855-9ec9-4222-acc2-63cd43c87b15 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7978c02b2bf413b81e1d14350af13b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f136933de5465f8590e9b153955d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:26.835575 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b30c2855-9ec9-4222-acc2-63cd43c87b15 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] 10.222.0.13 "GET /compute/v2.1/servers/300173a2-4840-4875-8e23-b3b86907a590" status: 200 len: 1313 microversion: 2.1 time: 0.451196 Oct 30 01:48:26.842618 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3060/6113] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:26 2022] GET /compute/v2.1/servers/300173a2-4840-4875-8e23-b3b86907a590 => generated 1313 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:48:26.855274 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0b3903cc-03fe-4297-bc67-a09c23226a57 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d699d4b51d4dc8ac1d8ff5aee36290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f00019b8a440b994269dce91d83768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:26.866447 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0b3903cc-03fe-4297-bc67-a09c23226a57 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] 10.222.0.13 "GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1" status: 200 len: 1507 microversion: 2.1 time: 0.750796 Oct 30 01:48:26.866692 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-35fd332f-ccd8-4948-9a93-7c10d102d4ec req-8e6ee312-0c27-4198-8ba5-c4f8f13d5ddf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0a1550e-e885-495b-9199-04334dce39dd", "name": "network-vif-deleted", "tag": "02e84120-803f-4ae5-9f89-0f81d7bb7a9b"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:48:26.867920 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3054/6114] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:26 2022] GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1 => generated 1507 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:26.877651 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-dc54ba96-a42f-4849-97b9-a00f2288484e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:26.878507 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-dc54ba96-a42f-4849-97b9-a00f2288484e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: a0a1550e-e885-495b-9199-04334dce39dd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:26.892034 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-35fd332f-ccd8-4948-9a93-7c10d102d4ec req-8e6ee312-0c27-4198-8ba5-c4f8f13d5ddf service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:26.892786 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-35fd332f-ccd8-4948-9a93-7c10d102d4ec req-8e6ee312-0c27-4198-8ba5-c4f8f13d5ddf service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:26.893906 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-35fd332f-ccd8-4948-9a93-7c10d102d4ec req-8e6ee312-0c27-4198-8ba5-c4f8f13d5ddf service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:26.895175 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc54ba96-a42f-4849-97b9-a00f2288484e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:26.896783 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc54ba96-a42f-4849-97b9-a00f2288484e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:26.898112 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc54ba96-a42f-4849-97b9-a00f2288484e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:26.901264 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc54ba96-a42f-4849-97b9-a00f2288484e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:26.902028 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc54ba96-a42f-4849-97b9-a00f2288484e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:26.910458 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc54ba96-a42f-4849-97b9-a00f2288484e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:26.927028 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-35fd332f-ccd8-4948-9a93-7c10d102d4ec req-8e6ee312-0c27-4198-8ba5-c4f8f13d5ddf service nova] Creating event network-vif-deleted:02e84120-803f-4ae5-9f89-0f81d7bb7a9b for instance a0a1550e-e885-495b-9199-04334dce39dd on n-h2-master-1 Oct 30 01:48:26.933956 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-35fd332f-ccd8-4948-9a93-7c10d102d4ec req-8e6ee312-0c27-4198-8ba5-c4f8f13d5ddf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089733 Oct 30 01:48:26.934634 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3061/6115] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:48:26.998334 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-dc54ba96-a42f-4849-97b9-a00f2288484e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:27.007800 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-dc54ba96-a42f-4849-97b9-a00f2288484e tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd" status: 200 len: 1467 microversion: 2.1 time: 0.138654 Oct 30 01:48:27.029724 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3055/6116] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:26 2022] GET /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd => generated 1467 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:27.330791 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-dc7f17bc-dda3-4a8e-ad0a-d5a28613a1de req-1b7f64e5-af82-4a83-b307-e03420bdc226 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93431237-06a2-41b5-a732-ddcdfada26d1", "name": "network-vif-deleted", "tag": "10d46536-4363-40b9-9656-850e2cf4a276"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:48:27.342709 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-dc7f17bc-dda3-4a8e-ad0a-d5a28613a1de req-1b7f64e5-af82-4a83-b307-e03420bdc226 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:27.343563 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-dc7f17bc-dda3-4a8e-ad0a-d5a28613a1de req-1b7f64e5-af82-4a83-b307-e03420bdc226 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:27.344218 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-dc7f17bc-dda3-4a8e-ad0a-d5a28613a1de req-1b7f64e5-af82-4a83-b307-e03420bdc226 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:27.358415 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-dc7f17bc-dda3-4a8e-ad0a-d5a28613a1de req-1b7f64e5-af82-4a83-b307-e03420bdc226 service nova] Creating event network-vif-deleted:10d46536-4363-40b9-9656-850e2cf4a276 for instance 93431237-06a2-41b5-a732-ddcdfada26d1 on n-h2-master-1 Oct 30 01:48:27.364271 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-dc7f17bc-dda3-4a8e-ad0a-d5a28613a1de req-1b7f64e5-af82-4a83-b307-e03420bdc226 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038075 Oct 30 01:48:27.365485 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3062/6117] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:48:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:48:27.867952 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-323e035e-2ed5-48d7-893c-baffa7a2725a tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:27.868861 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-323e035e-2ed5-48d7-893c-baffa7a2725a tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] [instance: 300173a2-4840-4875-8e23-b3b86907a590] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:27.876727 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-323e035e-2ed5-48d7-893c-baffa7a2725a tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:27.883078 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-323e035e-2ed5-48d7-893c-baffa7a2725a tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:27.883078 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-323e035e-2ed5-48d7-893c-baffa7a2725a tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:27.883078 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-323e035e-2ed5-48d7-893c-baffa7a2725a tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:27.883078 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-323e035e-2ed5-48d7-893c-baffa7a2725a tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:27.883078 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-323e035e-2ed5-48d7-893c-baffa7a2725a tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:27.903987 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6af43e1a-fcf4-47c0-9d98-eebf150fc31e tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:27.905876 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6af43e1a-fcf4-47c0-9d98-eebf150fc31e tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] [instance: 93431237-06a2-41b5-a732-ddcdfada26d1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:27.916615 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6af43e1a-fcf4-47c0-9d98-eebf150fc31e tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:27.917157 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6af43e1a-fcf4-47c0-9d98-eebf150fc31e tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:27.917614 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6af43e1a-fcf4-47c0-9d98-eebf150fc31e tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:27.918360 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6af43e1a-fcf4-47c0-9d98-eebf150fc31e tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:27.918815 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6af43e1a-fcf4-47c0-9d98-eebf150fc31e tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:27.919236 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6af43e1a-fcf4-47c0-9d98-eebf150fc31e tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:27.966395 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6af43e1a-fcf4-47c0-9d98-eebf150fc31e tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:27.967141 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6af43e1a-fcf4-47c0-9d98-eebf150fc31e tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:27.967744 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6af43e1a-fcf4-47c0-9d98-eebf150fc31e tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:27.968377 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-6af43e1a-fcf4-47c0-9d98-eebf150fc31e tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lazy-loading 'fault' on Instance uuid 93431237-06a2-41b5-a732-ddcdfada26d1 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:48:28.039382 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6af43e1a-fcf4-47c0-9d98-eebf150fc31e tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d699d4b51d4dc8ac1d8ff5aee36290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f00019b8a440b994269dce91d83768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:28.049101 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6af43e1a-fcf4-47c0-9d98-eebf150fc31e tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] 10.222.0.13 "GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1" status: 200 len: 1304 microversion: 2.1 time: 0.152389 Oct 30 01:48:28.050355 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3063/6118] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:27 2022] GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1 => generated 1304 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:28.057793 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-29858e55-9497-4630-9171-86d764b44a83 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:28.058704 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-29858e55-9497-4630-9171-86d764b44a83 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: a0a1550e-e885-495b-9199-04334dce39dd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:28.071156 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-29858e55-9497-4630-9171-86d764b44a83 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:28.072098 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-29858e55-9497-4630-9171-86d764b44a83 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:28.075946 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-29858e55-9497-4630-9171-86d764b44a83 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:28.075946 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-29858e55-9497-4630-9171-86d764b44a83 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:28.075946 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-29858e55-9497-4630-9171-86d764b44a83 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:28.075946 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-29858e55-9497-4630-9171-86d764b44a83 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:28.100109 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-323e035e-2ed5-48d7-893c-baffa7a2725a tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7978c02b2bf413b81e1d14350af13b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f136933de5465f8590e9b153955d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:28.112295 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-323e035e-2ed5-48d7-893c-baffa7a2725a tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] 10.222.0.13 "GET /compute/v2.1/servers/300173a2-4840-4875-8e23-b3b86907a590" status: 200 len: 1313 microversion: 2.1 time: 0.248825 Oct 30 01:48:28.113548 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3056/6119] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:27 2022] GET /compute/v2.1/servers/300173a2-4840-4875-8e23-b3b86907a590 => generated 1313 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:48:28.120638 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-29858e55-9497-4630-9171-86d764b44a83 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:28.121205 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-29858e55-9497-4630-9171-86d764b44a83 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:28.121756 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-29858e55-9497-4630-9171-86d764b44a83 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:28.122247 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-29858e55-9497-4630-9171-86d764b44a83 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lazy-loading 'fault' on Instance uuid a0a1550e-e885-495b-9199-04334dce39dd {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:48:28.191023 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-29858e55-9497-4630-9171-86d764b44a83 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:28.198206 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-29858e55-9497-4630-9171-86d764b44a83 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd" status: 200 len: 1305 microversion: 2.1 time: 0.145693 Oct 30 01:48:28.199728 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3064/6120] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:28 2022] GET /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd => generated 1305 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:29.072130 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-adbaba31-3507-4d41-a75c-f65d46439a1d tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:29.072657 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-adbaba31-3507-4d41-a75c-f65d46439a1d tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] [instance: 93431237-06a2-41b5-a732-ddcdfada26d1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:29.080830 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-adbaba31-3507-4d41-a75c-f65d46439a1d tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:29.081835 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-adbaba31-3507-4d41-a75c-f65d46439a1d tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:29.082348 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-adbaba31-3507-4d41-a75c-f65d46439a1d tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:29.083147 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-adbaba31-3507-4d41-a75c-f65d46439a1d tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:29.083662 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-adbaba31-3507-4d41-a75c-f65d46439a1d tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:29.084097 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-adbaba31-3507-4d41-a75c-f65d46439a1d tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:29.118220 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-adbaba31-3507-4d41-a75c-f65d46439a1d tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:29.118818 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-adbaba31-3507-4d41-a75c-f65d46439a1d tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:29.119321 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-adbaba31-3507-4d41-a75c-f65d46439a1d tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:29.119867 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-adbaba31-3507-4d41-a75c-f65d46439a1d tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lazy-loading 'fault' on Instance uuid 93431237-06a2-41b5-a732-ddcdfada26d1 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:48:29.136146 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4857ad1b-f783-4d0e-b7e2-99df537f3b76 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:29.136847 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4857ad1b-f783-4d0e-b7e2-99df537f3b76 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] [instance: 300173a2-4840-4875-8e23-b3b86907a590] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:29.144078 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4857ad1b-f783-4d0e-b7e2-99df537f3b76 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:29.144651 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4857ad1b-f783-4d0e-b7e2-99df537f3b76 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:29.145210 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4857ad1b-f783-4d0e-b7e2-99df537f3b76 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:29.146013 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4857ad1b-f783-4d0e-b7e2-99df537f3b76 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:29.146711 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4857ad1b-f783-4d0e-b7e2-99df537f3b76 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:29.147220 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4857ad1b-f783-4d0e-b7e2-99df537f3b76 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:29.174860 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-adbaba31-3507-4d41-a75c-f65d46439a1d tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d699d4b51d4dc8ac1d8ff5aee36290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f00019b8a440b994269dce91d83768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:29.185093 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-adbaba31-3507-4d41-a75c-f65d46439a1d tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] 10.222.0.13 "GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1" status: 200 len: 1304 microversion: 2.1 time: 0.116868 Oct 30 01:48:29.185839 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3057/6121] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:29 2022] GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1 => generated 1304 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:29.224519 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8751868f-d8d5-4f24-bc52-c699a8a8edb5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:29.225272 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8751868f-d8d5-4f24-bc52-c699a8a8edb5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: a0a1550e-e885-495b-9199-04334dce39dd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:29.233443 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8751868f-d8d5-4f24-bc52-c699a8a8edb5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:29.235573 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8751868f-d8d5-4f24-bc52-c699a8a8edb5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:29.236027 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8751868f-d8d5-4f24-bc52-c699a8a8edb5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:29.236752 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8751868f-d8d5-4f24-bc52-c699a8a8edb5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:29.238106 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8751868f-d8d5-4f24-bc52-c699a8a8edb5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:29.238865 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8751868f-d8d5-4f24-bc52-c699a8a8edb5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:29.262487 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-8751868f-d8d5-4f24-bc52-c699a8a8edb5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] HTTP exception thrown: Instance a0a1550e-e885-495b-9199-04334dce39dd could not be found. Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8751868f-d8d5-4f24-bc52-c699a8a8edb5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Request method failure captured: Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd HTTP/1.1 Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdXv08UieK2P0p6pvt8NCvlDNpE7nwwmqKRy3GqbMTGA0eIN66Y4wpKQHzC9fqGSwWNMELWbqq5UQS3MEVOVNfA2QR9cXwwAeRlgzmSRghjjPbvWjrnWlt2xXhoJQePHPZSUYBnEovFZtPMPN8ilqbXGb8wb5Tc4mNTDR3WIqu8sIR0 Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 9f9d0d541cc3496ebf8dc71af4254506 Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServerActionsTestJSON-1828815177 Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9f9d0d541cc3496ebf8dc71af4254506"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9f9d0d541cc3496ebf8dc71af4254506"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9f9d0d541cc3496ebf8dc71af4254506"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9f9d0d541cc3496ebf8dc71af4254506"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServerActionsTestJSON-1828815177 Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 9f9d0d541cc3496ebf8dc71af4254506 Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServerActionsTestJSON-1828815177 Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServerActionsTestJSON-1828815177-project Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 157c0ef579434726810bb3775388b944 Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServerActionsTestJSON-1828815177-project Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: exception: Instance a0a1550e-e885-495b-9199-04334dce39dd could not be found. Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'a0a1550e-e885-495b-9199-04334dce39dd'} Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0a1550e-e885-495b-9199-04334dce39dd could not be found. Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0a1550e-e885-495b-9199-04334dce39dd could not be found. Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:48:29.264443 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:48:29.275936 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:48:29.275936 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:48:29.275936 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:48:29.275936 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:48:29.275936 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:48:29.275936 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0a1550e-e885-495b-9199-04334dce39dd could not be found. Oct 30 01:48:29.275936 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:48:29.275936 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8751868f-d8d5-4f24-bc52-c699a8a8edb5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Returning 404 to user: Instance a0a1550e-e885-495b-9199-04334dce39dd could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:48:29.275936 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8751868f-d8d5-4f24-bc52-c699a8a8edb5 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd" status: 404 len: 111 microversion: 2.1 time: 0.048083 Oct 30 01:48:29.275936 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3058/6122] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:29 2022] GET /compute/v2.1/servers/a0a1550e-e885-495b-9199-04334dce39dd => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:48:29.282617 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-01335cc1-08e0-48d8-ba6b-65eb99561c79 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:29.283448 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-01335cc1-08e0-48d8-ba6b-65eb99561c79 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:29.290403 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-01335cc1-08e0-48d8-ba6b-65eb99561c79 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:29.290986 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-01335cc1-08e0-48d8-ba6b-65eb99561c79 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:29.291498 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-01335cc1-08e0-48d8-ba6b-65eb99561c79 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:29.292283 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-01335cc1-08e0-48d8-ba6b-65eb99561c79 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:29.293827 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-01335cc1-08e0-48d8-ba6b-65eb99561c79 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:29.294329 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-01335cc1-08e0-48d8-ba6b-65eb99561c79 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:29.309503 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4857ad1b-f783-4d0e-b7e2-99df537f3b76 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7978c02b2bf413b81e1d14350af13b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f136933de5465f8590e9b153955d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:29.318566 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4857ad1b-f783-4d0e-b7e2-99df537f3b76 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] 10.222.0.13 "GET /compute/v2.1/servers/300173a2-4840-4875-8e23-b3b86907a590" status: 200 len: 1313 microversion: 2.1 time: 0.186314 Oct 30 01:48:29.319159 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3065/6123] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:29 2022] GET /compute/v2.1/servers/300173a2-4840-4875-8e23-b3b86907a590 => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:48:29.325268 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-01335cc1-08e0-48d8-ba6b-65eb99561c79 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:48:29.501391 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-3f9fcc81-ee89-4a37-8b3e-d39f47eb1e8b req-9596dfd9-497e-480c-bd62-f26d3c7555aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "300173a2-4840-4875-8e23-b3b86907a590", "name": "network-vif-plugged", "status": "completed", "tag": "16ec17ae-ae4d-4fe2-9a13-248f6b46edcb"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:48:29.521039 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-3f9fcc81-ee89-4a37-8b3e-d39f47eb1e8b req-9596dfd9-497e-480c-bd62-f26d3c7555aa service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:29.521880 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-3f9fcc81-ee89-4a37-8b3e-d39f47eb1e8b req-9596dfd9-497e-480c-bd62-f26d3c7555aa service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:29.524830 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-3f9fcc81-ee89-4a37-8b3e-d39f47eb1e8b req-9596dfd9-497e-480c-bd62-f26d3c7555aa service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:29.546129 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-3f9fcc81-ee89-4a37-8b3e-d39f47eb1e8b req-9596dfd9-497e-480c-bd62-f26d3c7555aa service nova] Creating event network-vif-plugged:16ec17ae-ae4d-4fe2-9a13-248f6b46edcb for instance 300173a2-4840-4875-8e23-b3b86907a590 on n-h1-master-1 Oct 30 01:48:29.552521 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-3f9fcc81-ee89-4a37-8b3e-d39f47eb1e8b req-9596dfd9-497e-480c-bd62-f26d3c7555aa service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055211 Oct 30 01:48:29.553570 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3066/6124] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:48:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:48:29.622845 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-01335cc1-08e0-48d8-ba6b-65eb99561c79 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1" status: 204 len: 0 microversion: 2.1 time: 0.343954 Oct 30 01:48:29.623668 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3059/6125] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:48:29 2022] DELETE /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:48:29.632537 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-09e849e8-caa6-434d-aab1-8196f06c97ab tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:29.633573 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-09e849e8-caa6-434d-aab1-8196f06c97ab tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:29.640219 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-09e849e8-caa6-434d-aab1-8196f06c97ab tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:29.646323 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-09e849e8-caa6-434d-aab1-8196f06c97ab tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:29.646973 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-09e849e8-caa6-434d-aab1-8196f06c97ab tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:29.647870 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-09e849e8-caa6-434d-aab1-8196f06c97ab tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:29.649546 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-09e849e8-caa6-434d-aab1-8196f06c97ab tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:29.650561 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-09e849e8-caa6-434d-aab1-8196f06c97ab tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:29.792876 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-09e849e8-caa6-434d-aab1-8196f06c97ab tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:29.802474 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-09e849e8-caa6-434d-aab1-8196f06c97ab tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1" status: 200 len: 1494 microversion: 2.1 time: 0.174100 Oct 30 01:48:29.805402 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3067/6126] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:29 2022] GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1 => generated 1494 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:48:30.212339 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bcd3fed5-404f-4636-97c5-804029b7cad0 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:30.213062 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-bcd3fed5-404f-4636-97c5-804029b7cad0 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] [instance: 93431237-06a2-41b5-a732-ddcdfada26d1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:30.220858 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bcd3fed5-404f-4636-97c5-804029b7cad0 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:30.221626 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bcd3fed5-404f-4636-97c5-804029b7cad0 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:30.222354 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bcd3fed5-404f-4636-97c5-804029b7cad0 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:30.223058 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bcd3fed5-404f-4636-97c5-804029b7cad0 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:30.223517 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bcd3fed5-404f-4636-97c5-804029b7cad0 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:30.223942 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bcd3fed5-404f-4636-97c5-804029b7cad0 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:30.239355 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-bcd3fed5-404f-4636-97c5-804029b7cad0 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] HTTP exception thrown: Instance 93431237-06a2-41b5-a732-ddcdfada26d1 could not be found. Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bcd3fed5-404f-4636-97c5-804029b7cad0 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Request method failure captured: Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1 HTTP/1.1 Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdfH7LgLEdFKd0kqL93UHRtR_JzcgimiyUsTJS5JiM81HbMxf9Of5-3Tzzb1-VDzOF8QjXhWEh86RXWrwd2NBRG-qhSb9WFE2cpTWFcJfrF0T7VnI_mmLvDsjBBm9CVBMW8N-k20u1bDNldwe4jBftUOWBZxkZ7UO7f6qHba14ln9bM Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 96f00019b8a440b994269dce91d83768 Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-TestServerAdvancedOps-509400617 Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/96f00019b8a440b994269dce91d83768"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_96f00019b8a440b994269dce91d83768"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/96f00019b8a440b994269dce91d83768"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/96f00019b8a440b994269dce91d83768"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-TestServerAdvancedOps-509400617 Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 96f00019b8a440b994269dce91d83768 Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-TestServerAdvancedOps-509400617 Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-TestServerAdvancedOps-509400617-project Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 44d699d4b51d4dc8ac1d8ff5aee36290 Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-TestServerAdvancedOps-509400617-project Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 93431237-06a2-41b5-a732-ddcdfada26d1 could not be found. Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '93431237-06a2-41b5-a732-ddcdfada26d1'} Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93431237-06a2-41b5-a732-ddcdfada26d1 could not be found. Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93431237-06a2-41b5-a732-ddcdfada26d1 could not be found. Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:48:30.241019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:48:30.246437 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:48:30.246437 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:48:30.246437 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:48:30.246437 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:48:30.246437 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:48:30.246437 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93431237-06a2-41b5-a732-ddcdfada26d1 could not be found. Oct 30 01:48:30.246437 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:48:30.246437 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bcd3fed5-404f-4636-97c5-804029b7cad0 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] Returning 404 to user: Instance 93431237-06a2-41b5-a732-ddcdfada26d1 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:48:30.246437 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bcd3fed5-404f-4636-97c5-804029b7cad0 tempest-TestServerAdvancedOps-509400617 tempest-TestServerAdvancedOps-509400617-project] 10.222.0.13 "GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1" status: 404 len: 111 microversion: 2.1 time: 0.037615 Oct 30 01:48:30.262577 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3060/6127] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:30 2022] GET /compute/v2.1/servers/93431237-06a2-41b5-a732-ddcdfada26d1 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:48:30.345054 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-db0410e3-0bb4-4826-a71b-085ed89f5b64 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:30.345818 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-db0410e3-0bb4-4826-a71b-085ed89f5b64 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] [instance: 300173a2-4840-4875-8e23-b3b86907a590] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:30.353158 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-db0410e3-0bb4-4826-a71b-085ed89f5b64 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:30.353882 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-db0410e3-0bb4-4826-a71b-085ed89f5b64 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:30.354573 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-db0410e3-0bb4-4826-a71b-085ed89f5b64 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:30.357017 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-db0410e3-0bb4-4826-a71b-085ed89f5b64 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:30.357819 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-db0410e3-0bb4-4826-a71b-085ed89f5b64 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:30.358497 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-db0410e3-0bb4-4826-a71b-085ed89f5b64 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:30.533481 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-db0410e3-0bb4-4826-a71b-085ed89f5b64 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7978c02b2bf413b81e1d14350af13b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f136933de5465f8590e9b153955d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:30.541760 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-db0410e3-0bb4-4826-a71b-085ed89f5b64 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] 10.222.0.13 "GET /compute/v2.1/servers/300173a2-4840-4875-8e23-b3b86907a590" status: 200 len: 1313 microversion: 2.1 time: 0.203391 Oct 30 01:48:30.543113 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3068/6128] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:30 2022] GET /compute/v2.1/servers/300173a2-4840-4875-8e23-b3b86907a590 => generated 1313 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:30.827018 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4bf9be1e-555f-4200-ad28-d92ea8ebba58 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:30.828647 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4bf9be1e-555f-4200-ad28-d92ea8ebba58 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:30.839481 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4bf9be1e-555f-4200-ad28-d92ea8ebba58 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:30.841168 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4bf9be1e-555f-4200-ad28-d92ea8ebba58 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:30.842078 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4bf9be1e-555f-4200-ad28-d92ea8ebba58 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:30.845087 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4bf9be1e-555f-4200-ad28-d92ea8ebba58 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:30.846247 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4bf9be1e-555f-4200-ad28-d92ea8ebba58 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:30.846882 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4bf9be1e-555f-4200-ad28-d92ea8ebba58 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:31.188280 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4bf9be1e-555f-4200-ad28-d92ea8ebba58 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:31.197157 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4bf9be1e-555f-4200-ad28-d92ea8ebba58 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1" status: 200 len: 1494 microversion: 2.1 time: 0.374736 Oct 30 01:48:31.211144 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3061/6129] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:30 2022] GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1 => generated 1494 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:31.565714 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fbb0ad19-3bee-4877-95db-d72ccbe5eeca tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:31.567199 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fbb0ad19-3bee-4877-95db-d72ccbe5eeca tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] [instance: 300173a2-4840-4875-8e23-b3b86907a590] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:31.581674 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fbb0ad19-3bee-4877-95db-d72ccbe5eeca tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:31.582345 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fbb0ad19-3bee-4877-95db-d72ccbe5eeca tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:31.585876 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fbb0ad19-3bee-4877-95db-d72ccbe5eeca tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:31.585876 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fbb0ad19-3bee-4877-95db-d72ccbe5eeca tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:31.585876 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fbb0ad19-3bee-4877-95db-d72ccbe5eeca tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:31.585876 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fbb0ad19-3bee-4877-95db-d72ccbe5eeca tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:31.776383 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-e6257a80-368a-4d8b-a3fc-2cb1a12af552 req-bc090098-208c-476b-9522-75823dc72398 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1", "name": "network-vif-deleted", "tag": "aec2c86c-d872-42f2-b3ac-b4e746ac4585"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:48:31.796916 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e6257a80-368a-4d8b-a3fc-2cb1a12af552 req-bc090098-208c-476b-9522-75823dc72398 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:31.799370 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e6257a80-368a-4d8b-a3fc-2cb1a12af552 req-bc090098-208c-476b-9522-75823dc72398 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:31.802319 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e6257a80-368a-4d8b-a3fc-2cb1a12af552 req-bc090098-208c-476b-9522-75823dc72398 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:31.832217 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-e6257a80-368a-4d8b-a3fc-2cb1a12af552 req-bc090098-208c-476b-9522-75823dc72398 service nova] Creating event network-vif-deleted:aec2c86c-d872-42f2-b3ac-b4e746ac4585 for instance 6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1 on n-h1-master-1 Oct 30 01:48:31.840247 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-e6257a80-368a-4d8b-a3fc-2cb1a12af552 req-bc090098-208c-476b-9522-75823dc72398 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067508 Oct 30 01:48:31.842655 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3062/6130] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:48:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:48:31.955080 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-fbb0ad19-3bee-4877-95db-d72ccbe5eeca tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7978c02b2bf413b81e1d14350af13b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f136933de5465f8590e9b153955d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:31.959546 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fbb0ad19-3bee-4877-95db-d72ccbe5eeca tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] 10.222.0.13 "GET /compute/v2.1/servers/300173a2-4840-4875-8e23-b3b86907a590" status: 200 len: 1313 microversion: 2.1 time: 0.397812 Oct 30 01:48:31.961205 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3069/6131] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:31 2022] GET /compute/v2.1/servers/300173a2-4840-4875-8e23-b3b86907a590 => generated 1313 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:32.226314 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-00b5169a-08b0-41b2-8389-d3458a0bc8cc tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:32.227031 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-00b5169a-08b0-41b2-8389-d3458a0bc8cc tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:32.247979 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-00b5169a-08b0-41b2-8389-d3458a0bc8cc tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:32.250767 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-00b5169a-08b0-41b2-8389-d3458a0bc8cc tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:32.250767 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-00b5169a-08b0-41b2-8389-d3458a0bc8cc tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:32.252531 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-00b5169a-08b0-41b2-8389-d3458a0bc8cc tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:32.253059 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-00b5169a-08b0-41b2-8389-d3458a0bc8cc tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:32.256748 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-00b5169a-08b0-41b2-8389-d3458a0bc8cc tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:32.358269 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-00b5169a-08b0-41b2-8389-d3458a0bc8cc tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:32.366886 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-00b5169a-08b0-41b2-8389-d3458a0bc8cc tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1" status: 200 len: 1286 microversion: 2.1 time: 0.146741 Oct 30 01:48:32.370063 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3063/6132] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:32 2022] GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1 => generated 1286 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:32.927280 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cbc5d022-37e8-4080-8875-14ce2a986000 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:32.929700 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cbc5d022-37e8-4080-8875-14ce2a986000 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: b1a11d01-7560-4d97-af75-2904cea5408f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:32.941920 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cbc5d022-37e8-4080-8875-14ce2a986000 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:32.943570 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cbc5d022-37e8-4080-8875-14ce2a986000 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:32.945006 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cbc5d022-37e8-4080-8875-14ce2a986000 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:32.947736 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cbc5d022-37e8-4080-8875-14ce2a986000 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:32.948545 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cbc5d022-37e8-4080-8875-14ce2a986000 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:32.948985 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cbc5d022-37e8-4080-8875-14ce2a986000 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:32.976949 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cbc5d022-37e8-4080-8875-14ce2a986000 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f/ips" status: 200 len: 149 microversion: 2.1 time: 0.053819 Oct 30 01:48:32.977582 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3070/6133] 10.222.0.13 () {58 vars in 1248 bytes} [Sun Oct 30 01:48:32 2022] GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f/ips => generated 149 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:48:32.988715 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ca3b3c8e-8a6b-410c-a2b9-258d3c6c7c58 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:32.989714 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ca3b3c8e-8a6b-410c-a2b9-258d3c6c7c58 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] [instance: 300173a2-4840-4875-8e23-b3b86907a590] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:33.000046 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ca3b3c8e-8a6b-410c-a2b9-258d3c6c7c58 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:33.000901 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ca3b3c8e-8a6b-410c-a2b9-258d3c6c7c58 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:33.001468 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ca3b3c8e-8a6b-410c-a2b9-258d3c6c7c58 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:33.003348 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ca3b3c8e-8a6b-410c-a2b9-258d3c6c7c58 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:33.005830 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ca3b3c8e-8a6b-410c-a2b9-258d3c6c7c58 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:33.008272 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ca3b3c8e-8a6b-410c-a2b9-258d3c6c7c58 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:33.299182 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ca3b3c8e-8a6b-410c-a2b9-258d3c6c7c58 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7978c02b2bf413b81e1d14350af13b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f136933de5465f8590e9b153955d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:33.307543 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ca3b3c8e-8a6b-410c-a2b9-258d3c6c7c58 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] 10.222.0.13 "GET /compute/v2.1/servers/300173a2-4840-4875-8e23-b3b86907a590" status: 200 len: 1497 microversion: 2.1 time: 0.323883 Oct 30 01:48:33.308134 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3064/6134] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:32 2022] GET /compute/v2.1/servers/300173a2-4840-4875-8e23-b3b86907a590 => generated 1497 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:48:33.410478 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bb4c1454-1cce-41c9-9d58-7a04c04f4665 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:33.413380 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bb4c1454-1cce-41c9-9d58-7a04c04f4665 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: 6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:33.426604 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb4c1454-1cce-41c9-9d58-7a04c04f4665 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:33.427514 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb4c1454-1cce-41c9-9d58-7a04c04f4665 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:33.428188 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb4c1454-1cce-41c9-9d58-7a04c04f4665 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:33.429373 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb4c1454-1cce-41c9-9d58-7a04c04f4665 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:33.430005 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb4c1454-1cce-41c9-9d58-7a04c04f4665 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:33.430433 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb4c1454-1cce-41c9-9d58-7a04c04f4665 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:33.446770 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-bb4c1454-1cce-41c9-9d58-7a04c04f4665 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] HTTP exception thrown: Instance 6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1 could not be found. Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bb4c1454-1cce-41c9-9d58-7a04c04f4665 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Request method failure captured: Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1 HTTP/1.1 Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdXv08UieK2P0p6pvt8NCvlDNpE7nwwmqKRy3GqbMTGA0eIN66Y4wpKQHzC9fqGSwWNMELWbqq5UQS3MEVOVNfA2QR9cXwwAeRlgzmSRghjjPbvWjrnWlt2xXhoJQePHPZSUYBnEovFZtPMPN8ilqbXGb8wb5Tc4mNTDR3WIqu8sIR0 Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 9f9d0d541cc3496ebf8dc71af4254506 Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServerActionsTestJSON-1828815177 Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9f9d0d541cc3496ebf8dc71af4254506"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9f9d0d541cc3496ebf8dc71af4254506"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9f9d0d541cc3496ebf8dc71af4254506"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9f9d0d541cc3496ebf8dc71af4254506"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServerActionsTestJSON-1828815177 Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 9f9d0d541cc3496ebf8dc71af4254506 Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServerActionsTestJSON-1828815177 Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServerActionsTestJSON-1828815177-project Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 157c0ef579434726810bb3775388b944 Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServerActionsTestJSON-1828815177-project Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1 could not be found. Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1'} Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1 could not be found. Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1 could not be found. Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:48:33.448527 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:48:33.454961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:48:33.454961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:48:33.454961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:48:33.454961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:48:33.454961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:48:33.454961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1 could not be found. Oct 30 01:48:33.454961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:48:33.454961 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bb4c1454-1cce-41c9-9d58-7a04c04f4665 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Returning 404 to user: Instance 6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:48:33.454961 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bb4c1454-1cce-41c9-9d58-7a04c04f4665 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1" status: 404 len: 111 microversion: 2.1 time: 0.061669 Oct 30 01:48:33.454961 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3071/6135] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:33 2022] GET /compute/v2.1/servers/6a5ebb33-61b5-4a22-895a-20ecc6a6f7f1 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:48:33.459618 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7c2a4d0d-a080-41d0-b872-48c93193d58b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:33.460117 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7c2a4d0d-a080-41d0-b872-48c93193d58b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:33.467007 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7c2a4d0d-a080-41d0-b872-48c93193d58b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:33.467780 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7c2a4d0d-a080-41d0-b872-48c93193d58b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:33.468487 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7c2a4d0d-a080-41d0-b872-48c93193d58b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:33.469476 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7c2a4d0d-a080-41d0-b872-48c93193d58b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:33.470300 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7c2a4d0d-a080-41d0-b872-48c93193d58b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:33.470723 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7c2a4d0d-a080-41d0-b872-48c93193d58b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:33.538098 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7c2a4d0d-a080-41d0-b872-48c93193d58b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:48:34.030324 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7c2a4d0d-a080-41d0-b872-48c93193d58b tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 204 len: 0 microversion: 2.1 time: 0.573976 Oct 30 01:48:34.031367 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3065/6136] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:48:33 2022] DELETE /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:48:34.039730 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a2191da7-ae33-4df9-bda9-7daeff0cceeb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:34.040928 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a2191da7-ae33-4df9-bda9-7daeff0cceeb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:34.048481 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a2191da7-ae33-4df9-bda9-7daeff0cceeb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:34.048970 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a2191da7-ae33-4df9-bda9-7daeff0cceeb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:34.049443 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a2191da7-ae33-4df9-bda9-7daeff0cceeb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:34.050150 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a2191da7-ae33-4df9-bda9-7daeff0cceeb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:34.050600 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a2191da7-ae33-4df9-bda9-7daeff0cceeb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:34.051075 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a2191da7-ae33-4df9-bda9-7daeff0cceeb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:34.269749 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a2191da7-ae33-4df9-bda9-7daeff0cceeb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:34.282207 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a2191da7-ae33-4df9-bda9-7daeff0cceeb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1676 microversion: 2.1 time: 0.242245 Oct 30 01:48:34.283166 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3072/6137] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:34 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1676 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:35.315670 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-25881ec9-77cb-4e06-8d5a-71f93e4a8ecf tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:35.316388 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-25881ec9-77cb-4e06-8d5a-71f93e4a8ecf tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:35.328986 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-25881ec9-77cb-4e06-8d5a-71f93e4a8ecf tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:35.333879 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-25881ec9-77cb-4e06-8d5a-71f93e4a8ecf tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:35.334639 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-25881ec9-77cb-4e06-8d5a-71f93e4a8ecf tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:35.335784 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-25881ec9-77cb-4e06-8d5a-71f93e4a8ecf tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:35.336912 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-25881ec9-77cb-4e06-8d5a-71f93e4a8ecf tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:35.338664 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-25881ec9-77cb-4e06-8d5a-71f93e4a8ecf tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:35.546692 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-25881ec9-77cb-4e06-8d5a-71f93e4a8ecf tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:35.558624 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-25881ec9-77cb-4e06-8d5a-71f93e4a8ecf tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1676 microversion: 2.1 time: 0.249725 Oct 30 01:48:35.561907 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3066/6138] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:35 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1676 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:35.860854 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-509d05f0-9ee3-4101-b3cb-a2d43d5e6d6d tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "19038b80-e08a-4d4c-b66a-0dca462bc3fa"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:48:35.863662 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-509d05f0-9ee3-4101-b3cb-a2d43d5e6d6d tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: b1a11d01-7560-4d97-af75-2904cea5408f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:35.871156 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-509d05f0-9ee3-4101-b3cb-a2d43d5e6d6d tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:35.871647 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-509d05f0-9ee3-4101-b3cb-a2d43d5e6d6d tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:35.872088 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-509d05f0-9ee3-4101-b3cb-a2d43d5e6d6d tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:35.872793 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-509d05f0-9ee3-4101-b3cb-a2d43d5e6d6d tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:35.873248 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-509d05f0-9ee3-4101-b3cb-a2d43d5e6d6d tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:35.873896 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-509d05f0-9ee3-4101-b3cb-a2d43d5e6d6d tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:36.584479 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5d471c69-dffb-4730-8569-9f5132d1e0fa tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:36.588435 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5d471c69-dffb-4730-8569-9f5132d1e0fa tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:36.598857 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5d471c69-dffb-4730-8569-9f5132d1e0fa tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:36.599611 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5d471c69-dffb-4730-8569-9f5132d1e0fa tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:36.600826 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5d471c69-dffb-4730-8569-9f5132d1e0fa tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:36.601933 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5d471c69-dffb-4730-8569-9f5132d1e0fa tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:36.602848 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5d471c69-dffb-4730-8569-9f5132d1e0fa tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:36.606167 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5d471c69-dffb-4730-8569-9f5132d1e0fa tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:36.716654 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5d471c69-dffb-4730-8569-9f5132d1e0fa tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:36.728267 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5d471c69-dffb-4730-8569-9f5132d1e0fa tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1608 microversion: 2.1 time: 0.149067 Oct 30 01:48:36.729383 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3067/6139] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:36 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1608 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:36.738705 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-343dd00a-f6f1-4082-8455-4946a5826065 req-59fc54c9-a0cf-4e86-ab3b-a7c6d924b06e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0f03664-8785-4321-b32e-3622f1b747b9", "name": "network-vif-deleted", "tag": "63c1537a-0706-49b0-8e88-a5c62f4ffbe3"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:48:36.779027 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-343dd00a-f6f1-4082-8455-4946a5826065 req-59fc54c9-a0cf-4e86-ab3b-a7c6d924b06e service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:36.779027 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-343dd00a-f6f1-4082-8455-4946a5826065 req-59fc54c9-a0cf-4e86-ab3b-a7c6d924b06e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:36.779027 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-343dd00a-f6f1-4082-8455-4946a5826065 req-59fc54c9-a0cf-4e86-ab3b-a7c6d924b06e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:36.794339 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-343dd00a-f6f1-4082-8455-4946a5826065 req-59fc54c9-a0cf-4e86-ab3b-a7c6d924b06e service nova] Creating event network-vif-deleted:63c1537a-0706-49b0-8e88-a5c62f4ffbe3 for instance b0f03664-8785-4321-b32e-3622f1b747b9 on n-h2-master-1 Oct 30 01:48:36.810590 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-343dd00a-f6f1-4082-8455-4946a5826065 req-59fc54c9-a0cf-4e86-ab3b-a7c6d924b06e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069693 Oct 30 01:48:36.810590 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3068/6140] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:48:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:48:36.893185 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-509d05f0-9ee3-4101-b3cb-a2d43d5e6d6d tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "POST /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.036492 Oct 30 01:48:36.896042 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3073/6141] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 30 01:48:35 2022] POST /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f/os-volume_attachments => generated 194 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:48:37.756673 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-eff1f2f7-369c-4263-acac-27ce3e05c754 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:37.757410 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-eff1f2f7-369c-4263-acac-27ce3e05c754 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:37.769227 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eff1f2f7-369c-4263-acac-27ce3e05c754 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:37.769707 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eff1f2f7-369c-4263-acac-27ce3e05c754 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:37.770152 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eff1f2f7-369c-4263-acac-27ce3e05c754 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:37.774131 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eff1f2f7-369c-4263-acac-27ce3e05c754 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:37.774616 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eff1f2f7-369c-4263-acac-27ce3e05c754 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:37.775055 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eff1f2f7-369c-4263-acac-27ce3e05c754 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:37.788490 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:37.840791 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eff1f2f7-369c-4263-acac-27ce3e05c754 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:37.841435 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eff1f2f7-369c-4263-acac-27ce3e05c754 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:37.842161 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eff1f2f7-369c-4263-acac-27ce3e05c754 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:37.846143 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-eff1f2f7-369c-4263-acac-27ce3e05c754 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lazy-loading 'fault' on Instance uuid b0f03664-8785-4321-b32e-3622f1b747b9 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:48:37.913926 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-eff1f2f7-369c-4263-acac-27ce3e05c754 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157c0ef579434726810bb3775388b944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9d0d541cc3496ebf8dc71af4254506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:37.932025 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-eff1f2f7-369c-4263-acac-27ce3e05c754 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 200 len: 1328 microversion: 2.1 time: 0.180789 Oct 30 01:48:37.934441 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3069/6142] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:37 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 1328 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:38.788069 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-600a28e9-aa72-484e-88fb-f1140079f101 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:38.788705 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-600a28e9-aa72-484e-88fb-f1140079f101 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] [instance: 300173a2-4840-4875-8e23-b3b86907a590] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:38.798060 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-600a28e9-aa72-484e-88fb-f1140079f101 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:38.798586 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-600a28e9-aa72-484e-88fb-f1140079f101 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:38.799011 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-600a28e9-aa72-484e-88fb-f1140079f101 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:38.800042 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-600a28e9-aa72-484e-88fb-f1140079f101 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:38.800499 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-600a28e9-aa72-484e-88fb-f1140079f101 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:38.801457 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-600a28e9-aa72-484e-88fb-f1140079f101 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:38.832729 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-600a28e9-aa72-484e-88fb-f1140079f101 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] [instance: 300173a2-4840-4875-8e23-b3b86907a590] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:48:38.965943 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-36bb25cb-4f64-4184-a568-905cfed158fb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:38.966559 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-36bb25cb-4f64-4184-a568-905cfed158fb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] [instance: b0f03664-8785-4321-b32e-3622f1b747b9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:38.974021 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-36bb25cb-4f64-4184-a568-905cfed158fb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:38.974498 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-36bb25cb-4f64-4184-a568-905cfed158fb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:38.974930 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-36bb25cb-4f64-4184-a568-905cfed158fb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:38.975880 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-36bb25cb-4f64-4184-a568-905cfed158fb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:38.976322 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-36bb25cb-4f64-4184-a568-905cfed158fb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:38.976745 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-36bb25cb-4f64-4184-a568-905cfed158fb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:38.993575 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-36bb25cb-4f64-4184-a568-905cfed158fb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] HTTP exception thrown: Instance b0f03664-8785-4321-b32e-3622f1b747b9 could not be found. Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-36bb25cb-4f64-4184-a568-905cfed158fb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Request method failure captured: Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 HTTP/1.1 Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdXv08UieK2P0p6pvt8NCvlDNpE7nwwmqKRy3GqbMTGA0eIN66Y4wpKQHzC9fqGSwWNMELWbqq5UQS3MEVOVNfA2QR9cXwwAeRlgzmSRghjjPbvWjrnWlt2xXhoJQePHPZSUYBnEovFZtPMPN8ilqbXGb8wb5Tc4mNTDR3WIqu8sIR0 Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 9f9d0d541cc3496ebf8dc71af4254506 Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServerActionsTestJSON-1828815177 Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9f9d0d541cc3496ebf8dc71af4254506"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9f9d0d541cc3496ebf8dc71af4254506"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9f9d0d541cc3496ebf8dc71af4254506"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9f9d0d541cc3496ebf8dc71af4254506"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServerActionsTestJSON-1828815177 Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 9f9d0d541cc3496ebf8dc71af4254506 Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServerActionsTestJSON-1828815177 Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServerActionsTestJSON-1828815177-project Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 157c0ef579434726810bb3775388b944 Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServerActionsTestJSON-1828815177-project Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: exception: Instance b0f03664-8785-4321-b32e-3622f1b747b9 could not be found. Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'b0f03664-8785-4321-b32e-3622f1b747b9'} Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0f03664-8785-4321-b32e-3622f1b747b9 could not be found. Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0f03664-8785-4321-b32e-3622f1b747b9 could not be found. Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:48:38.995490 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:48:39.005282 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:48:39.005282 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:48:39.005282 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:48:39.005282 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:48:39.005282 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:48:39.005282 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0f03664-8785-4321-b32e-3622f1b747b9 could not be found. Oct 30 01:48:39.005282 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:48:39.005282 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-36bb25cb-4f64-4184-a568-905cfed158fb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Returning 404 to user: Instance b0f03664-8785-4321-b32e-3622f1b747b9 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:48:39.005282 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-36bb25cb-4f64-4184-a568-905cfed158fb tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9" status: 404 len: 111 microversion: 2.1 time: 0.035601 Oct 30 01:48:39.005282 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3070/6143] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:38 2022] GET /compute/v2.1/servers/b0f03664-8785-4321-b32e-3622f1b747b9 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:48:39.006225 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b6fa50c6-adaf-4d65-a253-e47feac54647 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] Calling method '.version_select at 0x7f44d03fb5e0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:39.115845 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b6fa50c6-adaf-4d65-a253-e47feac54647 tempest-ServerActionsTestJSON-1828815177 tempest-ServerActionsTestJSON-1828815177-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1804497044" status: 202 len: 0 microversion: 2.1 time: 0.113200 Oct 30 01:48:39.116365 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3071/6144] 10.222.0.13 () {58 vars in 1221 bytes} [Sun Oct 30 01:48:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1804497044 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:48:39.981953 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-600a28e9-aa72-484e-88fb-f1140079f101 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] 10.222.0.13 "DELETE /compute/v2.1/servers/300173a2-4840-4875-8e23-b3b86907a590" status: 204 len: 0 microversion: 2.1 time: 1.201300 Oct 30 01:48:39.983713 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3074/6145] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:48:38 2022] DELETE /compute/v2.1/servers/300173a2-4840-4875-8e23-b3b86907a590 => generated 0 bytes in 1203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:48:39.992417 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6ec25ddd-d23e-4a97-81b0-9660f539abc2 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:39.993613 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6ec25ddd-d23e-4a97-81b0-9660f539abc2 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] [instance: 300173a2-4840-4875-8e23-b3b86907a590] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:40.001150 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ec25ddd-d23e-4a97-81b0-9660f539abc2 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:40.001887 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ec25ddd-d23e-4a97-81b0-9660f539abc2 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:40.006607 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ec25ddd-d23e-4a97-81b0-9660f539abc2 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:40.006607 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ec25ddd-d23e-4a97-81b0-9660f539abc2 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:40.006607 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ec25ddd-d23e-4a97-81b0-9660f539abc2 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:40.006607 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ec25ddd-d23e-4a97-81b0-9660f539abc2 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:40.230059 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6ec25ddd-d23e-4a97-81b0-9660f539abc2 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7978c02b2bf413b81e1d14350af13b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f136933de5465f8590e9b153955d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:40.239178 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6ec25ddd-d23e-4a97-81b0-9660f539abc2 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] 10.222.0.13 "GET /compute/v2.1/servers/300173a2-4840-4875-8e23-b3b86907a590" status: 200 len: 1503 microversion: 2.1 time: 0.252157 Oct 30 01:48:40.241260 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3072/6146] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:39 2022] GET /compute/v2.1/servers/300173a2-4840-4875-8e23-b3b86907a590 => generated 1503 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:41.264000 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-af2428f2-53a7-412c-9708-31cd4242d59c tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:41.264767 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-af2428f2-53a7-412c-9708-31cd4242d59c tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] [instance: 300173a2-4840-4875-8e23-b3b86907a590] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:41.272468 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af2428f2-53a7-412c-9708-31cd4242d59c tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:41.273244 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af2428f2-53a7-412c-9708-31cd4242d59c tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:41.273889 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af2428f2-53a7-412c-9708-31cd4242d59c tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:41.274952 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af2428f2-53a7-412c-9708-31cd4242d59c tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:41.275581 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af2428f2-53a7-412c-9708-31cd4242d59c tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:41.276175 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af2428f2-53a7-412c-9708-31cd4242d59c tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:41.487474 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1056284e-51e1-4d1e-8fa3-088203247f03 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:41.488069 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1056284e-51e1-4d1e-8fa3-088203247f03 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] [instance: 7b678024-1288-425e-9985-41c2554f36c8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:41.495792 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-af2428f2-53a7-412c-9708-31cd4242d59c tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7978c02b2bf413b81e1d14350af13b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f136933de5465f8590e9b153955d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:41.497395 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1056284e-51e1-4d1e-8fa3-088203247f03 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:41.497901 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1056284e-51e1-4d1e-8fa3-088203247f03 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:41.498341 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1056284e-51e1-4d1e-8fa3-088203247f03 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:41.499053 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1056284e-51e1-4d1e-8fa3-088203247f03 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:41.500902 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1056284e-51e1-4d1e-8fa3-088203247f03 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:41.501373 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1056284e-51e1-4d1e-8fa3-088203247f03 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:41.511070 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-af2428f2-53a7-412c-9708-31cd4242d59c tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] 10.222.0.13 "GET /compute/v2.1/servers/300173a2-4840-4875-8e23-b3b86907a590" status: 200 len: 1503 microversion: 2.1 time: 0.250134 Oct 30 01:48:41.528467 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3073/6147] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:41 2022] GET /compute/v2.1/servers/300173a2-4840-4875-8e23-b3b86907a590 => generated 1503 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:41.529956 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1056284e-51e1-4d1e-8fa3-088203247f03 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] [instance: 7b678024-1288-425e-9985-41c2554f36c8] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:48:41.583887 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:41.891072 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1056284e-51e1-4d1e-8fa3-088203247f03 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7b678024-1288-425e-9985-41c2554f36c8" status: 204 len: 0 microversion: 2.1 time: 0.756962 Oct 30 01:48:41.892162 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3075/6148] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:48:41 2022] DELETE /compute/v2.1/servers/7b678024-1288-425e-9985-41c2554f36c8 => generated 0 bytes in 760 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:48:41.909004 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d4876766-953e-4226-91a8-5b5456997a4e tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:41.909680 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d4876766-953e-4226-91a8-5b5456997a4e tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] [instance: 7b678024-1288-425e-9985-41c2554f36c8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:41.918167 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d4876766-953e-4226-91a8-5b5456997a4e tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:41.918662 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d4876766-953e-4226-91a8-5b5456997a4e tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:41.919100 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d4876766-953e-4226-91a8-5b5456997a4e tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:41.919799 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d4876766-953e-4226-91a8-5b5456997a4e tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:41.921007 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d4876766-953e-4226-91a8-5b5456997a4e tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:41.921686 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d4876766-953e-4226-91a8-5b5456997a4e tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:42.184089 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d4876766-953e-4226-91a8-5b5456997a4e tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759025c4133f4074ba59beb1a08c7a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68930ed61745eea8adfda72f3d139f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:42.198279 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d4876766-953e-4226-91a8-5b5456997a4e tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] 10.222.0.13 "GET /compute/v2.1/servers/7b678024-1288-425e-9985-41c2554f36c8" status: 200 len: 1732 microversion: 2.1 time: 0.295253 Oct 30 01:48:42.216728 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3074/6149] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:41 2022] GET /compute/v2.1/servers/7b678024-1288-425e-9985-41c2554f36c8 => generated 1732 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:42.536267 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-52510fd9-9474-4f4e-93cb-acb9faaede98 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:42.537079 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-52510fd9-9474-4f4e-93cb-acb9faaede98 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] [instance: 300173a2-4840-4875-8e23-b3b86907a590] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:42.553013 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:42.554734 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-52510fd9-9474-4f4e-93cb-acb9faaede98 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:42.555449 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-52510fd9-9474-4f4e-93cb-acb9faaede98 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:42.556084 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-52510fd9-9474-4f4e-93cb-acb9faaede98 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:42.556987 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-52510fd9-9474-4f4e-93cb-acb9faaede98 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:42.557498 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-52510fd9-9474-4f4e-93cb-acb9faaede98 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:42.557961 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-52510fd9-9474-4f4e-93cb-acb9faaede98 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:42.581507 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-c0949cf6-9813-4111-a8a3-3e7e5689157a req-85614a0d-1426-4338-b3c1-400c22f677c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "300173a2-4840-4875-8e23-b3b86907a590", "name": "network-vif-deleted", "tag": "16ec17ae-ae4d-4fe2-9a13-248f6b46edcb"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:48:42.618901 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-c0949cf6-9813-4111-a8a3-3e7e5689157a req-85614a0d-1426-4338-b3c1-400c22f677c8 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:42.618901 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-c0949cf6-9813-4111-a8a3-3e7e5689157a req-85614a0d-1426-4338-b3c1-400c22f677c8 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:42.619334 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-c0949cf6-9813-4111-a8a3-3e7e5689157a req-85614a0d-1426-4338-b3c1-400c22f677c8 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:42.633053 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-c0949cf6-9813-4111-a8a3-3e7e5689157a req-85614a0d-1426-4338-b3c1-400c22f677c8 service nova] Creating event network-vif-deleted:16ec17ae-ae4d-4fe2-9a13-248f6b46edcb for instance 300173a2-4840-4875-8e23-b3b86907a590 on n-h1-master-1 Oct 30 01:48:42.639096 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-c0949cf6-9813-4111-a8a3-3e7e5689157a req-85614a0d-1426-4338-b3c1-400c22f677c8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066169 Oct 30 01:48:42.640496 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3075/6150] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:48:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 30 01:48:42.734909 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-52510fd9-9474-4f4e-93cb-acb9faaede98 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7978c02b2bf413b81e1d14350af13b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f136933de5465f8590e9b153955d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:42.745297 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-52510fd9-9474-4f4e-93cb-acb9faaede98 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] 10.222.0.13 "GET /compute/v2.1/servers/300173a2-4840-4875-8e23-b3b86907a590" status: 200 len: 1461 microversion: 2.1 time: 0.213809 Oct 30 01:48:42.747558 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3076/6151] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:42 2022] GET /compute/v2.1/servers/300173a2-4840-4875-8e23-b3b86907a590 => generated 1461 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:43.225541 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d2ca9c9b-8f3c-4749-b04d-2c09be67b7a1 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:43.227178 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d2ca9c9b-8f3c-4749-b04d-2c09be67b7a1 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] [instance: 7b678024-1288-425e-9985-41c2554f36c8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:43.235635 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d2ca9c9b-8f3c-4749-b04d-2c09be67b7a1 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:43.237580 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d2ca9c9b-8f3c-4749-b04d-2c09be67b7a1 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:43.238193 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d2ca9c9b-8f3c-4749-b04d-2c09be67b7a1 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:43.239448 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d2ca9c9b-8f3c-4749-b04d-2c09be67b7a1 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:43.240080 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d2ca9c9b-8f3c-4749-b04d-2c09be67b7a1 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:43.240741 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d2ca9c9b-8f3c-4749-b04d-2c09be67b7a1 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:43.505227 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d2ca9c9b-8f3c-4749-b04d-2c09be67b7a1 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759025c4133f4074ba59beb1a08c7a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68930ed61745eea8adfda72f3d139f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:43.519053 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d2ca9c9b-8f3c-4749-b04d-2c09be67b7a1 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] 10.222.0.13 "GET /compute/v2.1/servers/7b678024-1288-425e-9985-41c2554f36c8" status: 200 len: 1732 microversion: 2.1 time: 0.298670 Oct 30 01:48:43.519962 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3076/6152] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:43 2022] GET /compute/v2.1/servers/7b678024-1288-425e-9985-41c2554f36c8 => generated 1732 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:43.773946 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cceb402f-09f3-462f-9b88-bd898c7ac7b3 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:43.778089 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cceb402f-09f3-462f-9b88-bd898c7ac7b3 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] [instance: 300173a2-4840-4875-8e23-b3b86907a590] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:43.812162 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cceb402f-09f3-462f-9b88-bd898c7ac7b3 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:43.812922 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cceb402f-09f3-462f-9b88-bd898c7ac7b3 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:43.814032 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cceb402f-09f3-462f-9b88-bd898c7ac7b3 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:43.816465 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cceb402f-09f3-462f-9b88-bd898c7ac7b3 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:43.817963 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cceb402f-09f3-462f-9b88-bd898c7ac7b3 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:43.818478 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cceb402f-09f3-462f-9b88-bd898c7ac7b3 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:43.941639 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cceb402f-09f3-462f-9b88-bd898c7ac7b3 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:43.941639 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cceb402f-09f3-462f-9b88-bd898c7ac7b3 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:43.941639 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cceb402f-09f3-462f-9b88-bd898c7ac7b3 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:43.943783 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-cceb402f-09f3-462f-9b88-bd898c7ac7b3 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lazy-loading 'fault' on Instance uuid 300173a2-4840-4875-8e23-b3b86907a590 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:48:44.019052 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-cceb402f-09f3-462f-9b88-bd898c7ac7b3 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7978c02b2bf413b81e1d14350af13b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f136933de5465f8590e9b153955d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:44.029159 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cceb402f-09f3-462f-9b88-bd898c7ac7b3 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] 10.222.0.13 "GET /compute/v2.1/servers/300173a2-4840-4875-8e23-b3b86907a590" status: 200 len: 1303 microversion: 2.1 time: 0.259860 Oct 30 01:48:44.032436 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3077/6153] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:43 2022] GET /compute/v2.1/servers/300173a2-4840-4875-8e23-b3b86907a590 => generated 1303 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:44.545081 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bc815480-02fe-44ab-b587-37b31f86492a tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:44.547363 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-bc815480-02fe-44ab-b587-37b31f86492a tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] [instance: 7b678024-1288-425e-9985-41c2554f36c8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:44.555958 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bc815480-02fe-44ab-b587-37b31f86492a tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:44.556839 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bc815480-02fe-44ab-b587-37b31f86492a tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:44.557394 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bc815480-02fe-44ab-b587-37b31f86492a tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:44.558278 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bc815480-02fe-44ab-b587-37b31f86492a tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:44.558791 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bc815480-02fe-44ab-b587-37b31f86492a tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:44.559228 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bc815480-02fe-44ab-b587-37b31f86492a tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:44.786112 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-bc815480-02fe-44ab-b587-37b31f86492a tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759025c4133f4074ba59beb1a08c7a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68930ed61745eea8adfda72f3d139f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:44.794594 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bc815480-02fe-44ab-b587-37b31f86492a tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] 10.222.0.13 "GET /compute/v2.1/servers/7b678024-1288-425e-9985-41c2554f36c8" status: 200 len: 1732 microversion: 2.1 time: 0.254310 Oct 30 01:48:44.797554 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3077/6154] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:44 2022] GET /compute/v2.1/servers/7b678024-1288-425e-9985-41c2554f36c8 => generated 1732 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:45.055889 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-28fd6610-8ff7-44b3-ba3e-f72daa12ec79 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:45.056520 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-28fd6610-8ff7-44b3-ba3e-f72daa12ec79 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] [instance: 300173a2-4840-4875-8e23-b3b86907a590] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:45.065142 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-28fd6610-8ff7-44b3-ba3e-f72daa12ec79 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:45.066613 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-28fd6610-8ff7-44b3-ba3e-f72daa12ec79 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:45.071669 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-28fd6610-8ff7-44b3-ba3e-f72daa12ec79 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:45.071669 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-28fd6610-8ff7-44b3-ba3e-f72daa12ec79 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:45.071669 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-28fd6610-8ff7-44b3-ba3e-f72daa12ec79 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:45.071669 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-28fd6610-8ff7-44b3-ba3e-f72daa12ec79 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:45.096693 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-28fd6610-8ff7-44b3-ba3e-f72daa12ec79 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] HTTP exception thrown: Instance 300173a2-4840-4875-8e23-b3b86907a590 could not be found. Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-28fd6610-8ff7-44b3-ba3e-f72daa12ec79 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Request method failure captured: Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/300173a2-4840-4875-8e23-b3b86907a590 HTTP/1.1 Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdfcMlS5cW7CthUsqO3PMmYRyHYwFHVheDQCAeppS6DO4SXuCzvcpA0NApWsT-NO_EplbbovlPhKAmXBbhT66ynWUfxRGoeok21xurxhgRTRziy8pm986cDY5GCZkNiomOIl_WK4ppOWWXAhekuwGa5zlqcafp1B1AAXdxtcBgsN5P4 Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: c7f136933de5465f8590e9b153955d04 Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-VolumesActionsTest-503798690 Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c7f136933de5465f8590e9b153955d04"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c7f136933de5465f8590e9b153955d04"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c7f136933de5465f8590e9b153955d04"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c7f136933de5465f8590e9b153955d04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-VolumesActionsTest-503798690 Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: c7f136933de5465f8590e9b153955d04 Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-VolumesActionsTest-503798690 Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-VolumesActionsTest-503798690-project Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: b7978c02b2bf413b81e1d14350af13b4 Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-VolumesActionsTest-503798690-project Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 300173a2-4840-4875-8e23-b3b86907a590 could not be found. Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '300173a2-4840-4875-8e23-b3b86907a590'} Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 300173a2-4840-4875-8e23-b3b86907a590 could not be found. Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 300173a2-4840-4875-8e23-b3b86907a590 could not be found. Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:48:45.099288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:48:45.105168 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:48:45.105168 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:48:45.105168 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:48:45.105168 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:48:45.105168 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:48:45.105168 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 300173a2-4840-4875-8e23-b3b86907a590 could not be found. Oct 30 01:48:45.105168 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:48:45.105168 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-28fd6610-8ff7-44b3-ba3e-f72daa12ec79 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] Returning 404 to user: Instance 300173a2-4840-4875-8e23-b3b86907a590 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:48:45.105168 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-28fd6610-8ff7-44b3-ba3e-f72daa12ec79 tempest-VolumesActionsTest-503798690 tempest-VolumesActionsTest-503798690-project] 10.222.0.13 "GET /compute/v2.1/servers/300173a2-4840-4875-8e23-b3b86907a590" status: 404 len: 111 microversion: 2.1 time: 0.049475 Oct 30 01:48:45.113931 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3078/6155] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:45 2022] GET /compute/v2.1/servers/300173a2-4840-4875-8e23-b3b86907a590 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:48:45.393002 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-14c1740b-22d0-4724-9c18-b4b1e0d56c07 req-091f6321-68cf-4b31-b9b5-e3bb7c1d07fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b678024-1288-425e-9985-41c2554f36c8", "name": "network-vif-deleted", "tag": "3781b23f-588a-4afc-a386-764a0199c6bd"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:48:45.418137 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-14c1740b-22d0-4724-9c18-b4b1e0d56c07 req-091f6321-68cf-4b31-b9b5-e3bb7c1d07fe service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:45.420371 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-14c1740b-22d0-4724-9c18-b4b1e0d56c07 req-091f6321-68cf-4b31-b9b5-e3bb7c1d07fe service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:45.420963 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-14c1740b-22d0-4724-9c18-b4b1e0d56c07 req-091f6321-68cf-4b31-b9b5-e3bb7c1d07fe service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:45.477103 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-14c1740b-22d0-4724-9c18-b4b1e0d56c07 req-091f6321-68cf-4b31-b9b5-e3bb7c1d07fe service nova] Creating event network-vif-deleted:3781b23f-588a-4afc-a386-764a0199c6bd for instance 7b678024-1288-425e-9985-41c2554f36c8 on n-h1-master-1 Oct 30 01:48:45.494430 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-14c1740b-22d0-4724-9c18-b4b1e0d56c07 req-091f6321-68cf-4b31-b9b5-e3bb7c1d07fe service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105558 Oct 30 01:48:45.497205 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3078/6156] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:48:45.819588 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fd4bbe19-f464-4789-9624-cf407a8dea86 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:45.820528 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fd4bbe19-f464-4789-9624-cf407a8dea86 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] [instance: 7b678024-1288-425e-9985-41c2554f36c8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:45.832819 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fd4bbe19-f464-4789-9624-cf407a8dea86 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:45.840580 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fd4bbe19-f464-4789-9624-cf407a8dea86 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:45.848805 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fd4bbe19-f464-4789-9624-cf407a8dea86 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:45.848805 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fd4bbe19-f464-4789-9624-cf407a8dea86 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:45.848805 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fd4bbe19-f464-4789-9624-cf407a8dea86 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:45.848805 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fd4bbe19-f464-4789-9624-cf407a8dea86 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:45.939454 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b2e8d7f2-7e72-466c-8368-c472b25f72f0 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-833409530", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "fd08bcb3-8b91-4f90-a2f0-4a84bf28c8ee"}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:48:45.961011 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fd4bbe19-f464-4789-9624-cf407a8dea86 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:45.962027 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fd4bbe19-f464-4789-9624-cf407a8dea86 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:45.962576 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fd4bbe19-f464-4789-9624-cf407a8dea86 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:45.963299 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-fd4bbe19-f464-4789-9624-cf407a8dea86 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lazy-loading 'fault' on Instance uuid 7b678024-1288-425e-9985-41c2554f36c8 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:48:46.041501 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-b2e8d7f2-7e72-466c-8368-c472b25f72f0 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] validate_networks() for [('fd08bcb3-8b91-4f90-a2f0-4a84bf28c8ee', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:48:46.087353 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-fd4bbe19-f464-4789-9624-cf407a8dea86 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759025c4133f4074ba59beb1a08c7a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68930ed61745eea8adfda72f3d139f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:46.097792 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fd4bbe19-f464-4789-9624-cf407a8dea86 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] 10.222.0.13 "GET /compute/v2.1/servers/7b678024-1288-425e-9985-41c2554f36c8" status: 200 len: 1389 microversion: 2.1 time: 0.282016 Oct 30 01:48:46.104003 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3079/6157] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:45 2022] GET /compute/v2.1/servers/7b678024-1288-425e-9985-41c2554f36c8 => generated 1389 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:46.966788 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-b2e8d7f2-7e72-466c-8368-c472b25f72f0 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:48:46.968163 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-b2e8d7f2-7e72-466c-8368-c472b25f72f0 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:48:46.968920 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-b2e8d7f2-7e72-466c-8368-c472b25f72f0 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:48:46.969715 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-b2e8d7f2-7e72-466c-8368-c472b25f72f0 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:48:46.970240 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-b2e8d7f2-7e72-466c-8368-c472b25f72f0 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:48:46.996404 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b2e8d7f2-7e72-466c-8368-c472b25f72f0 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:47.001981 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b2e8d7f2-7e72-466c-8368-c472b25f72f0 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:47.002443 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b2e8d7f2-7e72-466c-8368-c472b25f72f0 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:47.003249 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b2e8d7f2-7e72-466c-8368-c472b25f72f0 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:47.003715 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b2e8d7f2-7e72-466c-8368-c472b25f72f0 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:47.004136 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b2e8d7f2-7e72-466c-8368-c472b25f72f0 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:47.055976 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-b2e8d7f2-7e72-466c-8368-c472b25f72f0 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Getting quotas for project 767edc5f9e7a4c81929df4fa8a12d94b. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:48:47.061619 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-b2e8d7f2-7e72-466c-8368-c472b25f72f0 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Getting quotas for user cb21ecdda88d49b59e11a30b0f3afc72 and project 767edc5f9e7a4c81929df4fa8a12d94b. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:48:47.076875 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b2e8d7f2-7e72-466c-8368-c472b25f72f0 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:48:47.080822 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b2e8d7f2-7e72-466c-8368-c472b25f72f0 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] [instance: ffd648ae-9abd-4906-8b40-c398878310eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:48:47.128926 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7084744e-da4a-4a09-ba87-392dd890fd11 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:47.129595 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7084744e-da4a-4a09-ba87-392dd890fd11 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] [instance: 7b678024-1288-425e-9985-41c2554f36c8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:47.136863 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7084744e-da4a-4a09-ba87-392dd890fd11 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:47.137375 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7084744e-da4a-4a09-ba87-392dd890fd11 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:47.137821 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7084744e-da4a-4a09-ba87-392dd890fd11 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:47.138533 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7084744e-da4a-4a09-ba87-392dd890fd11 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:47.139024 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7084744e-da4a-4a09-ba87-392dd890fd11 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:47.141001 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7084744e-da4a-4a09-ba87-392dd890fd11 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:47.156035 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-7084744e-da4a-4a09-ba87-392dd890fd11 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] HTTP exception thrown: Instance 7b678024-1288-425e-9985-41c2554f36c8 could not be found. Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7084744e-da4a-4a09-ba87-392dd890fd11 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Request method failure captured: Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/7b678024-1288-425e-9985-41c2554f36c8 HTTP/1.1 Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdaXo0fuDKqK5bXQbo-zckzQ0NgqCFdTXD5JdlseCHj73ezASzQFJWdpAAtxpYfpaPnMild7bg9YduPPtRGvaLEWLJmRW58KYSTmTQqQcsSo9k0UDsv6Z1JtZoXhJ1AVSH_uHJbWYhzHacRETwC72WVw8fAs_NoTSHioWCvhnaxGSog Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 8d68930ed61745eea8adfda72f3d139f Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-TestServerBasicOps-937468217 Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8d68930ed61745eea8adfda72f3d139f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8d68930ed61745eea8adfda72f3d139f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8d68930ed61745eea8adfda72f3d139f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8d68930ed61745eea8adfda72f3d139f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-TestServerBasicOps-937468217 Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 8d68930ed61745eea8adfda72f3d139f Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-TestServerBasicOps-937468217 Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-TestServerBasicOps-937468217-project Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 759025c4133f4074ba59beb1a08c7a21 Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-TestServerBasicOps-937468217-project Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 7b678024-1288-425e-9985-41c2554f36c8 could not be found. Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '7b678024-1288-425e-9985-41c2554f36c8'} Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b678024-1288-425e-9985-41c2554f36c8 could not be found. Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b678024-1288-425e-9985-41c2554f36c8 could not be found. Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:48:47.157890 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:48:47.164110 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:48:47.164110 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:48:47.164110 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:48:47.164110 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:48:47.164110 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:48:47.164110 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b678024-1288-425e-9985-41c2554f36c8 could not be found. Oct 30 01:48:47.164110 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:48:47.164110 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7084744e-da4a-4a09-ba87-392dd890fd11 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Returning 404 to user: Instance 7b678024-1288-425e-9985-41c2554f36c8 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:48:47.164110 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7084744e-da4a-4a09-ba87-392dd890fd11 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] 10.222.0.13 "GET /compute/v2.1/servers/7b678024-1288-425e-9985-41c2554f36c8" status: 404 len: 111 microversion: 2.1 time: 0.035020 Oct 30 01:48:47.166098 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3080/6158] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:47 2022] GET /compute/v2.1/servers/7b678024-1288-425e-9985-41c2554f36c8 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:48:47.208785 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b2e8d7f2-7e72-466c-8368-c472b25f72f0 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.274013 Oct 30 01:48:47.210186 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3079/6159] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:48:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1276 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:48:47.230148 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9210e38a-e5b7-4601-acc1-6ed1c4dbfeb2 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:47.232204 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9210e38a-e5b7-4601-acc1-6ed1c4dbfeb2 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] [instance: ffd648ae-9abd-4906-8b40-c398878310eb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:47.321059 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9210e38a-e5b7-4601-acc1-6ed1c4dbfeb2 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb21ecdda88d49b59e11a30b0f3afc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767edc5f9e7a4c81929df4fa8a12d94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:47.329096 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9210e38a-e5b7-4601-acc1-6ed1c4dbfeb2 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd648ae-9abd-4906-8b40-c398878310eb" status: 200 len: 1218 microversion: 2.1 time: 0.110987 Oct 30 01:48:47.332425 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3081/6160] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:47 2022] GET /compute/v2.1/servers/ffd648ae-9abd-4906-8b40-c398878310eb => generated 1218 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:47.914005 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-81bf7ee2-c8ff-4207-b21f-3aa3d35a6185 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:47.914522 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-81bf7ee2-c8ff-4207-b21f-3aa3d35a6185 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] [instance: 7b678024-1288-425e-9985-41c2554f36c8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:47.921761 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-81bf7ee2-c8ff-4207-b21f-3aa3d35a6185 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:47.922334 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-81bf7ee2-c8ff-4207-b21f-3aa3d35a6185 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:47.922781 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-81bf7ee2-c8ff-4207-b21f-3aa3d35a6185 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:47.923474 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-81bf7ee2-c8ff-4207-b21f-3aa3d35a6185 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:47.923935 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-81bf7ee2-c8ff-4207-b21f-3aa3d35a6185 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:47.924363 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-81bf7ee2-c8ff-4207-b21f-3aa3d35a6185 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:47.940647 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-81bf7ee2-c8ff-4207-b21f-3aa3d35a6185 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] HTTP exception thrown: Instance 7b678024-1288-425e-9985-41c2554f36c8 could not be found. Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-81bf7ee2-c8ff-4207-b21f-3aa3d35a6185 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Request method failure captured: Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: request: DELETE /compute/v2.1/servers/7b678024-1288-425e-9985-41c2554f36c8 HTTP/1.1 Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdaXo0fuDKqK5bXQbo-zckzQ0NgqCFdTXD5JdlseCHj73ezASzQFJWdpAAtxpYfpaPnMild7bg9YduPPtRGvaLEWLJmRW58KYSTmTQqQcsSo9k0UDsv6Z1JtZoXhJ1AVSH_uHJbWYhzHacRETwC72WVw8fAs_NoTSHioWCvhnaxGSog Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 8d68930ed61745eea8adfda72f3d139f Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-TestServerBasicOps-937468217 Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8d68930ed61745eea8adfda72f3d139f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8d68930ed61745eea8adfda72f3d139f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8d68930ed61745eea8adfda72f3d139f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8d68930ed61745eea8adfda72f3d139f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-TestServerBasicOps-937468217 Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 8d68930ed61745eea8adfda72f3d139f Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-TestServerBasicOps-937468217 Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-TestServerBasicOps-937468217-project Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 759025c4133f4074ba59beb1a08c7a21 Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-TestServerBasicOps-937468217-project Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 7b678024-1288-425e-9985-41c2554f36c8 could not be found. Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '7b678024-1288-425e-9985-41c2554f36c8'} Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b678024-1288-425e-9985-41c2554f36c8 could not be found. Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:48:47.942346 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:48:47.957879 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b678024-1288-425e-9985-41c2554f36c8 could not be found. Oct 30 01:48:47.957879 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:48:47.957879 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:48:47.957879 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:48:47.957879 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:48:47.957879 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:48:47.957879 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:48:47.957879 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:48:47.957879 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:48:47.957879 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b678024-1288-425e-9985-41c2554f36c8 could not be found. Oct 30 01:48:47.957879 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:48:47.957879 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-81bf7ee2-c8ff-4207-b21f-3aa3d35a6185 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Returning 404 to user: Instance 7b678024-1288-425e-9985-41c2554f36c8 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:48:47.957879 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-81bf7ee2-c8ff-4207-b21f-3aa3d35a6185 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7b678024-1288-425e-9985-41c2554f36c8" status: 404 len: 111 microversion: 2.1 time: 0.034509 Oct 30 01:48:47.957879 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3080/6161] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:48:47 2022] DELETE /compute/v2.1/servers/7b678024-1288-425e-9985-41c2554f36c8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:48:47.959116 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-971ed980-9466-4d30-915e-4de750542832 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:47.959116 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-971ed980-9466-4d30-915e-4de750542832 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] [instance: 7b678024-1288-425e-9985-41c2554f36c8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:47.960869 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-971ed980-9466-4d30-915e-4de750542832 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:47.961369 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-971ed980-9466-4d30-915e-4de750542832 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:47.961813 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-971ed980-9466-4d30-915e-4de750542832 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:47.962500 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-971ed980-9466-4d30-915e-4de750542832 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:47.963018 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-971ed980-9466-4d30-915e-4de750542832 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:47.963529 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-971ed980-9466-4d30-915e-4de750542832 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:47.976846 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-971ed980-9466-4d30-915e-4de750542832 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] HTTP exception thrown: Instance 7b678024-1288-425e-9985-41c2554f36c8 could not be found. Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-971ed980-9466-4d30-915e-4de750542832 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Request method failure captured: Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/7b678024-1288-425e-9985-41c2554f36c8 HTTP/1.1 Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdaXo0fuDKqK5bXQbo-zckzQ0NgqCFdTXD5JdlseCHj73ezASzQFJWdpAAtxpYfpaPnMild7bg9YduPPtRGvaLEWLJmRW58KYSTmTQqQcsSo9k0UDsv6Z1JtZoXhJ1AVSH_uHJbWYhzHacRETwC72WVw8fAs_NoTSHioWCvhnaxGSog Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 8d68930ed61745eea8adfda72f3d139f Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-TestServerBasicOps-937468217 Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8d68930ed61745eea8adfda72f3d139f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8d68930ed61745eea8adfda72f3d139f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8d68930ed61745eea8adfda72f3d139f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8d68930ed61745eea8adfda72f3d139f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-TestServerBasicOps-937468217 Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 8d68930ed61745eea8adfda72f3d139f Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-TestServerBasicOps-937468217 Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-TestServerBasicOps-937468217-project Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 759025c4133f4074ba59beb1a08c7a21 Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-TestServerBasicOps-937468217-project Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 7b678024-1288-425e-9985-41c2554f36c8 could not be found. Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '7b678024-1288-425e-9985-41c2554f36c8'} Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b678024-1288-425e-9985-41c2554f36c8 could not be found. Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b678024-1288-425e-9985-41c2554f36c8 could not be found. Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:48:47.978416 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:48:47.986404 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:48:47.986404 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:48:47.986404 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:48:47.986404 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:48:47.986404 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:48:47.986404 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b678024-1288-425e-9985-41c2554f36c8 could not be found. Oct 30 01:48:47.986404 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:48:47.986404 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-971ed980-9466-4d30-915e-4de750542832 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Returning 404 to user: Instance 7b678024-1288-425e-9985-41c2554f36c8 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:48:47.986404 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-971ed980-9466-4d30-915e-4de750542832 tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] 10.222.0.13 "GET /compute/v2.1/servers/7b678024-1288-425e-9985-41c2554f36c8" status: 404 len: 111 microversion: 2.1 time: 0.031167 Oct 30 01:48:47.986404 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3082/6162] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:47 2022] GET /compute/v2.1/servers/7b678024-1288-425e-9985-41c2554f36c8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:48:48.252164 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b386e9a2-3d7b-4b88-bf27-a0376d9bc68e tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Calling method '.version_select at 0x7f44cd906dc0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:48.359712 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3e6aa653-7810-4028-b058-ab7361925da7 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:48.361309 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3e6aa653-7810-4028-b058-ab7361925da7 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] [instance: ffd648ae-9abd-4906-8b40-c398878310eb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:48.407195 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b386e9a2-3d7b-4b88-bf27-a0376d9bc68e tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1029733019" status: 202 len: 0 microversion: 2.1 time: 0.157038 Oct 30 01:48:48.408013 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3081/6163] 10.222.0.13 () {58 vars in 1254 bytes} [Sun Oct 30 01:48:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1029733019 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:48:48.443204 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3e6aa653-7810-4028-b058-ab7361925da7 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb21ecdda88d49b59e11a30b0f3afc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767edc5f9e7a4c81929df4fa8a12d94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:48.451555 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3e6aa653-7810-4028-b058-ab7361925da7 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd648ae-9abd-4906-8b40-c398878310eb" status: 200 len: 1218 microversion: 2.1 time: 0.098615 Oct 30 01:48:48.452526 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3083/6164] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:48 2022] GET /compute/v2.1/servers/ffd648ae-9abd-4906-8b40-c398878310eb => generated 1218 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:49.222256 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b386e9a2-3d7b-4b88-bf27-a0376d9bc68e tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:49.223437 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b386e9a2-3d7b-4b88-bf27-a0376d9bc68e tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] 10.222.0.13 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001461 Oct 30 01:48:49.224003 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3082/6165] 10.222.0.13 () {56 vars in 886 bytes} [Sun Oct 30 01:48:49 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 30 01:48:49.232956 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3e6aa653-7810-4028-b058-ab7361925da7 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:49.234978 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3e6aa653-7810-4028-b058-ab7361925da7 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] 10.222.0.13 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002555 Oct 30 01:48:49.235581 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3084/6166] 10.222.0.13 () {54 vars in 1035 bytes} [Sun Oct 30 01:48:49 2022] GET /compute/v2/ => generated 379 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Oct 30 01:48:49.243242 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b386e9a2-3d7b-4b88-bf27-a0376d9bc68e tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:49.244282 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b386e9a2-3d7b-4b88-bf27-a0376d9bc68e tempest-TestServerBasicOps-937468217 tempest-TestServerBasicOps-937468217-project] 10.222.0.13 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001502 Oct 30 01:48:49.252512 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3083/6167] 10.222.0.13 () {54 vars in 1041 bytes} [Sun Oct 30 01:48:49 2022] GET /compute/v2.1/ => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:48:49.254378 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3e6aa653-7810-4028-b058-ab7361925da7 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:49.254960 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3e6aa653-7810-4028-b058-ab7361925da7 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] 10.222.0.13 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001432 Oct 30 01:48:49.255299 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3085/6168] 10.222.0.13 () {56 vars in 886 bytes} [Sun Oct 30 01:48:49 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 30 01:48:49.479709 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-eb7b72e3-d083-4b2b-9715-8625086a3a1e tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:49.480534 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-eb7b72e3-d083-4b2b-9715-8625086a3a1e tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] [instance: ffd648ae-9abd-4906-8b40-c398878310eb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:49.495507 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:49.500686 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eb7b72e3-d083-4b2b-9715-8625086a3a1e tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:49.503316 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eb7b72e3-d083-4b2b-9715-8625086a3a1e tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:49.503905 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eb7b72e3-d083-4b2b-9715-8625086a3a1e tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:49.504776 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eb7b72e3-d083-4b2b-9715-8625086a3a1e tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:49.505839 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eb7b72e3-d083-4b2b-9715-8625086a3a1e tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:49.508611 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eb7b72e3-d083-4b2b-9715-8625086a3a1e tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:49.592770 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b913bb21-b201-4c2b-9280-87cef6722354 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "19038b80-e08a-4d4c-b66a-0dca462bc3fa"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:48:49.595574 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b913bb21-b201-4c2b-9280-87cef6722354 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: b1a11d01-7560-4d97-af75-2904cea5408f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:49.612142 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b913bb21-b201-4c2b-9280-87cef6722354 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:49.612767 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b913bb21-b201-4c2b-9280-87cef6722354 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:49.613981 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b913bb21-b201-4c2b-9280-87cef6722354 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:49.618443 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b913bb21-b201-4c2b-9280-87cef6722354 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:49.619280 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b913bb21-b201-4c2b-9280-87cef6722354 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:49.619836 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b913bb21-b201-4c2b-9280-87cef6722354 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:49.629657 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-eb7b72e3-d083-4b2b-9715-8625086a3a1e tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb21ecdda88d49b59e11a30b0f3afc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767edc5f9e7a4c81929df4fa8a12d94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:49.639656 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-eb7b72e3-d083-4b2b-9715-8625086a3a1e tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd648ae-9abd-4906-8b40-c398878310eb" status: 200 len: 1270 microversion: 2.1 time: 0.164615 Oct 30 01:48:49.641036 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3084/6169] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:49 2022] GET /compute/v2.1/servers/ffd648ae-9abd-4906-8b40-c398878310eb => generated 1270 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:49.766003 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-b913bb21-b201-4c2b-9280-87cef6722354 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] HTTP exception thrown: Invalid volume: volume 19038b80-e08a-4d4c-b66a-0dca462bc3fa is already attached to instances: b1a11d01-7560-4d97-af75-2904cea5408f Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b913bb21-b201-4c2b-9280-87cef6722354 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Request method failure captured: Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f/os-volume_attachments HTTP/1.1 Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 74 Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdcRtc4GzHkShMdH9tTupejgTwf3ZNgIcyJqp9yicfp5OD1pJcQPZv1XBaNx7doePOAnkL0JpoIe5_T8iLiz5QjNjR1hpdjjFconMkrxU8FPHulGdRMQx61K_rAf0z9mDPUn9FfJ2msqRaRZPanWCScsW3BEB8X_vbKTz8C4TVCF-Ys Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 311cde01e89442f1ab3aa930070b7343 Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-AttachVolumeNegativeTest-812748574 Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/311cde01e89442f1ab3aa930070b7343"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_311cde01e89442f1ab3aa930070b7343"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/311cde01e89442f1ab3aa930070b7343"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/311cde01e89442f1ab3aa930070b7343"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-AttachVolumeNegativeTest-812748574 Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 311cde01e89442f1ab3aa930070b7343 Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-812748574 Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-AttachVolumeNegativeTest-812748574-project Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: dcb021152c684983b31e5db439518921 Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-AttachVolumeNegativeTest-812748574-project Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: {"volumeAttachment": {"volumeId": "19038b80-e08a-4d4c-b66a-0dca462bc3fa"}} Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: exception: Invalid volume: volume 19038b80-e08a-4d4c-b66a-0dca462bc3fa is already attached to instances: b1a11d01-7560-4d97-af75-2904cea5408f Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: action_args: {'server_id': 'b1a11d01-7560-4d97-af75-2904cea5408f', 'body': {'volumeAttachment': {'volumeId': '19038b80-e08a-4d4c-b66a-0dca462bc3fa'}}} Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 19038b80-e08a-4d4c-b66a-0dca462bc3fa is already attached to instances: b1a11d01-7560-4d97-af75-2904cea5408f Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:48:49.773425 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:48:49.778708 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:48:49.778708 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:48:49.778708 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 30 01:48:49.778708 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 30 01:48:49.778708 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 19038b80-e08a-4d4c-b66a-0dca462bc3fa is already attached to instances: b1a11d01-7560-4d97-af75-2904cea5408f Oct 30 01:48:49.778708 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:48:49.778708 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:48:49.778708 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:48:49.778708 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:48:49.778708 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:48:49.778708 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:48:49.778708 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:48:49.778708 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:48:49.778708 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 19038b80-e08a-4d4c-b66a-0dca462bc3fa is already attached to instances: b1a11d01-7560-4d97-af75-2904cea5408f Oct 30 01:48:49.778708 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:48:49.785128 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b913bb21-b201-4c2b-9280-87cef6722354 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Returning 400 to user: Invalid volume: volume 19038b80-e08a-4d4c-b66a-0dca462bc3fa is already attached to instances: b1a11d01-7560-4d97-af75-2904cea5408f {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:48:49.787790 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b913bb21-b201-4c2b-9280-87cef6722354 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "POST /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.198424 Oct 30 01:48:49.788522 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3086/6170] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 30 01:48:49 2022] POST /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f/os-volume_attachments => generated 174 bytes in 201 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 30 01:48:49.898358 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2db717ee-f726-4916-8fbc-ed7fc9734a46 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:49.899118 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2db717ee-f726-4916-8fbc-ed7fc9734a46 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: b1a11d01-7560-4d97-af75-2904cea5408f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:49.915778 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2db717ee-f726-4916-8fbc-ed7fc9734a46 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:49.916540 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2db717ee-f726-4916-8fbc-ed7fc9734a46 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:49.917081 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2db717ee-f726-4916-8fbc-ed7fc9734a46 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:49.917980 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2db717ee-f726-4916-8fbc-ed7fc9734a46 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:49.918654 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2db717ee-f726-4916-8fbc-ed7fc9734a46 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:49.919176 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2db717ee-f726-4916-8fbc-ed7fc9734a46 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:50.027128 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-2db717ee-f726-4916-8fbc-ed7fc9734a46 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lazy-loading 'services' on Instance uuid b1a11d01-7560-4d97-af75-2904cea5408f {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:48:50.287014 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2db717ee-f726-4916-8fbc-ed7fc9734a46 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f/os-volume_attachments/19038b80-e08a-4d4c-b66a-0dca462bc3fa" status: 202 len: 0 microversion: 2.1 time: 0.395877 Oct 30 01:48:50.291289 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3085/6171] 10.222.0.13 () {58 vars in 1416 bytes} [Sun Oct 30 01:48:49 2022] DELETE /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f/os-volume_attachments/19038b80-e08a-4d4c-b66a-0dca462bc3fa => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:48:50.298178 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-87c13295-cc0a-4831-8f5a-670680da3503 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:50.300870 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-87c13295-cc0a-4831-8f5a-670680da3503 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: b1a11d01-7560-4d97-af75-2904cea5408f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:50.315532 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-87c13295-cc0a-4831-8f5a-670680da3503 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:50.316032 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-87c13295-cc0a-4831-8f5a-670680da3503 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:50.316472 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-87c13295-cc0a-4831-8f5a-670680da3503 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:50.317254 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-87c13295-cc0a-4831-8f5a-670680da3503 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:50.321288 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-87c13295-cc0a-4831-8f5a-670680da3503 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:50.321802 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-87c13295-cc0a-4831-8f5a-670680da3503 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:50.411136 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-87c13295-cc0a-4831-8f5a-670680da3503 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118148 Oct 30 01:48:50.411726 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3087/6172] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 01:48:50 2022] GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:48:50.664957 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8b181fa2-b017-4e7f-a579-8c16530d3dd6 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:50.666058 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8b181fa2-b017-4e7f-a579-8c16530d3dd6 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] [instance: ffd648ae-9abd-4906-8b40-c398878310eb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:50.684484 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8b181fa2-b017-4e7f-a579-8c16530d3dd6 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:50.684616 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8b181fa2-b017-4e7f-a579-8c16530d3dd6 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:50.684964 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8b181fa2-b017-4e7f-a579-8c16530d3dd6 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:50.685722 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8b181fa2-b017-4e7f-a579-8c16530d3dd6 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:50.686181 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8b181fa2-b017-4e7f-a579-8c16530d3dd6 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:50.687132 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8b181fa2-b017-4e7f-a579-8c16530d3dd6 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:50.814443 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8b181fa2-b017-4e7f-a579-8c16530d3dd6 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb21ecdda88d49b59e11a30b0f3afc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767edc5f9e7a4c81929df4fa8a12d94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:50.830376 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8b181fa2-b017-4e7f-a579-8c16530d3dd6 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd648ae-9abd-4906-8b40-c398878310eb" status: 200 len: 1276 microversion: 2.1 time: 0.170063 Oct 30 01:48:50.846172 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3086/6173] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:50 2022] GET /compute/v2.1/servers/ffd648ae-9abd-4906-8b40-c398878310eb => generated 1276 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:51.424865 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-da7a2629-6e32-4f03-aa01-756a12e8f42b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:51.427244 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-da7a2629-6e32-4f03-aa01-756a12e8f42b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: b1a11d01-7560-4d97-af75-2904cea5408f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:51.451339 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-da7a2629-6e32-4f03-aa01-756a12e8f42b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:51.452156 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-da7a2629-6e32-4f03-aa01-756a12e8f42b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:51.455050 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-da7a2629-6e32-4f03-aa01-756a12e8f42b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:51.456052 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-da7a2629-6e32-4f03-aa01-756a12e8f42b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:51.456692 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-da7a2629-6e32-4f03-aa01-756a12e8f42b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:51.459084 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-da7a2629-6e32-4f03-aa01-756a12e8f42b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:51.511459 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-da7a2629-6e32-4f03-aa01-756a12e8f42b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091155 Oct 30 01:48:51.517958 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3088/6174] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 01:48:51 2022] GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:48:51.858004 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9850a138-d5c6-476c-a2de-506050cdb804 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:51.858004 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9850a138-d5c6-476c-a2de-506050cdb804 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] [instance: ffd648ae-9abd-4906-8b40-c398878310eb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:51.871352 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9850a138-d5c6-476c-a2de-506050cdb804 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:51.871847 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9850a138-d5c6-476c-a2de-506050cdb804 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:51.872988 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9850a138-d5c6-476c-a2de-506050cdb804 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:51.876213 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9850a138-d5c6-476c-a2de-506050cdb804 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:51.876918 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9850a138-d5c6-476c-a2de-506050cdb804 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:51.877692 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9850a138-d5c6-476c-a2de-506050cdb804 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:52.488851 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9850a138-d5c6-476c-a2de-506050cdb804 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb21ecdda88d49b59e11a30b0f3afc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767edc5f9e7a4c81929df4fa8a12d94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:52.502431 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9850a138-d5c6-476c-a2de-506050cdb804 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd648ae-9abd-4906-8b40-c398878310eb" status: 200 len: 1318 microversion: 2.1 time: 0.650968 Oct 30 01:48:52.503941 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3087/6175] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:51 2022] GET /compute/v2.1/servers/ffd648ae-9abd-4906-8b40-c398878310eb => generated 1318 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:52.526233 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0f5d5d34-981d-4dd6-9040-555eb51e62d3 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:52.528906 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0f5d5d34-981d-4dd6-9040-555eb51e62d3 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: b1a11d01-7560-4d97-af75-2904cea5408f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:52.546782 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0f5d5d34-981d-4dd6-9040-555eb51e62d3 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:52.549489 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0f5d5d34-981d-4dd6-9040-555eb51e62d3 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:52.549489 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0f5d5d34-981d-4dd6-9040-555eb51e62d3 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:52.549489 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0f5d5d34-981d-4dd6-9040-555eb51e62d3 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:52.549489 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0f5d5d34-981d-4dd6-9040-555eb51e62d3 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:52.550192 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0f5d5d34-981d-4dd6-9040-555eb51e62d3 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:52.601898 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0f5d5d34-981d-4dd6-9040-555eb51e62d3 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081147 Oct 30 01:48:52.607325 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3089/6176] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 01:48:52 2022] GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:48:53.527509 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8c4d25be-282e-47bd-9cb8-65836b520814 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:53.529247 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8c4d25be-282e-47bd-9cb8-65836b520814 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] [instance: ffd648ae-9abd-4906-8b40-c398878310eb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:53.539136 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8c4d25be-282e-47bd-9cb8-65836b520814 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:53.539739 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8c4d25be-282e-47bd-9cb8-65836b520814 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:53.540405 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8c4d25be-282e-47bd-9cb8-65836b520814 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:53.541718 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8c4d25be-282e-47bd-9cb8-65836b520814 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:53.541718 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8c4d25be-282e-47bd-9cb8-65836b520814 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:53.542276 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8c4d25be-282e-47bd-9cb8-65836b520814 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:53.616686 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-aff0adff-4f8b-41c9-a1ac-be1dc9416ac5 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:53.620610 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-aff0adff-4f8b-41c9-a1ac-be1dc9416ac5 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: b1a11d01-7560-4d97-af75-2904cea5408f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:53.630192 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aff0adff-4f8b-41c9-a1ac-be1dc9416ac5 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:53.631087 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aff0adff-4f8b-41c9-a1ac-be1dc9416ac5 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:53.632352 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aff0adff-4f8b-41c9-a1ac-be1dc9416ac5 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:53.634823 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aff0adff-4f8b-41c9-a1ac-be1dc9416ac5 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:53.635746 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aff0adff-4f8b-41c9-a1ac-be1dc9416ac5 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:53.637221 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aff0adff-4f8b-41c9-a1ac-be1dc9416ac5 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:53.691107 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-aff0adff-4f8b-41c9-a1ac-be1dc9416ac5 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078854 Oct 30 01:48:53.697392 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3090/6177] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 01:48:53 2022] GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:48:54.065587 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8c4d25be-282e-47bd-9cb8-65836b520814 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb21ecdda88d49b59e11a30b0f3afc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767edc5f9e7a4c81929df4fa8a12d94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:54.079596 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8c4d25be-282e-47bd-9cb8-65836b520814 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd648ae-9abd-4906-8b40-c398878310eb" status: 200 len: 1318 microversion: 2.1 time: 0.556126 Oct 30 01:48:54.085514 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3088/6178] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:53 2022] GET /compute/v2.1/servers/ffd648ae-9abd-4906-8b40-c398878310eb => generated 1318 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:54.638325 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-5ad31d35-efd7-457f-a1c4-58d9713fbd02 req-c21e6ee0-59d2-49fe-b3c0-29b7019781d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffd648ae-9abd-4906-8b40-c398878310eb", "tag": "eef21b63-a56b-43f1-b58e-6b544c4ce632"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:48:54.668925 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-5ad31d35-efd7-457f-a1c4-58d9713fbd02 req-c21e6ee0-59d2-49fe-b3c0-29b7019781d0 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:54.678449 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-5ad31d35-efd7-457f-a1c4-58d9713fbd02 req-c21e6ee0-59d2-49fe-b3c0-29b7019781d0 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:54.678934 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-5ad31d35-efd7-457f-a1c4-58d9713fbd02 req-c21e6ee0-59d2-49fe-b3c0-29b7019781d0 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:54.705580 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ddc511ff-995a-42fa-b546-ec51e79a4237 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:54.709223 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ddc511ff-995a-42fa-b546-ec51e79a4237 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: b1a11d01-7560-4d97-af75-2904cea5408f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:54.726373 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ddc511ff-995a-42fa-b546-ec51e79a4237 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:54.727223 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ddc511ff-995a-42fa-b546-ec51e79a4237 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:54.727516 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ddc511ff-995a-42fa-b546-ec51e79a4237 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:54.734632 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-5ad31d35-efd7-457f-a1c4-58d9713fbd02 req-c21e6ee0-59d2-49fe-b3c0-29b7019781d0 service nova] Creating event network-changed:eef21b63-a56b-43f1-b58e-6b544c4ce632 for instance ffd648ae-9abd-4906-8b40-c398878310eb on n-h2-master-1 Oct 30 01:48:54.735171 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ddc511ff-995a-42fa-b546-ec51e79a4237 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:54.735677 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ddc511ff-995a-42fa-b546-ec51e79a4237 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:54.736123 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ddc511ff-995a-42fa-b546-ec51e79a4237 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:54.750030 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-5ad31d35-efd7-457f-a1c4-58d9713fbd02 req-c21e6ee0-59d2-49fe-b3c0-29b7019781d0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115206 Oct 30 01:48:54.753982 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3091/6179] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:48:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:48:54.835511 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ddc511ff-995a-42fa-b546-ec51e79a4237 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.135010 Oct 30 01:48:54.838441 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3089/6180] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 01:48:54 2022] GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:48:55.104762 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b33d0fc6-fdd3-4ef8-8764-6c4123556631 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:55.106094 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b33d0fc6-fdd3-4ef8-8764-6c4123556631 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] [instance: ffd648ae-9abd-4906-8b40-c398878310eb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:55.124836 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b33d0fc6-fdd3-4ef8-8764-6c4123556631 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:55.125762 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b33d0fc6-fdd3-4ef8-8764-6c4123556631 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:55.126460 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b33d0fc6-fdd3-4ef8-8764-6c4123556631 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:55.127478 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b33d0fc6-fdd3-4ef8-8764-6c4123556631 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:55.128171 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b33d0fc6-fdd3-4ef8-8764-6c4123556631 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:55.128939 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b33d0fc6-fdd3-4ef8-8764-6c4123556631 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:55.593294 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b33d0fc6-fdd3-4ef8-8764-6c4123556631 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb21ecdda88d49b59e11a30b0f3afc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767edc5f9e7a4c81929df4fa8a12d94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:55.604069 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b33d0fc6-fdd3-4ef8-8764-6c4123556631 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd648ae-9abd-4906-8b40-c398878310eb" status: 200 len: 1318 microversion: 2.1 time: 0.503840 Oct 30 01:48:55.604839 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3092/6181] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:55 2022] GET /compute/v2.1/servers/ffd648ae-9abd-4906-8b40-c398878310eb => generated 1318 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:55.851282 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f29c37bc-6022-4eaf-9453-fc66a3c6c81b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:55.854797 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f29c37bc-6022-4eaf-9453-fc66a3c6c81b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: b1a11d01-7560-4d97-af75-2904cea5408f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:55.865296 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f29c37bc-6022-4eaf-9453-fc66a3c6c81b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:55.873696 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f29c37bc-6022-4eaf-9453-fc66a3c6c81b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:55.873696 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f29c37bc-6022-4eaf-9453-fc66a3c6c81b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:55.873696 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f29c37bc-6022-4eaf-9453-fc66a3c6c81b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:55.873696 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f29c37bc-6022-4eaf-9453-fc66a3c6c81b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:55.873696 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f29c37bc-6022-4eaf-9453-fc66a3c6c81b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:55.918731 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f29c37bc-6022-4eaf-9453-fc66a3c6c81b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073074 Oct 30 01:48:55.919723 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3090/6182] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 01:48:55 2022] GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:48:56.629252 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-dde385e5-a2d9-4bf5-aba6-dbf86dc9d4fa tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:56.629931 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-dde385e5-a2d9-4bf5-aba6-dbf86dc9d4fa tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] [instance: ffd648ae-9abd-4906-8b40-c398878310eb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:56.638073 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dde385e5-a2d9-4bf5-aba6-dbf86dc9d4fa tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:56.638729 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dde385e5-a2d9-4bf5-aba6-dbf86dc9d4fa tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:56.639424 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dde385e5-a2d9-4bf5-aba6-dbf86dc9d4fa tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:56.640549 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dde385e5-a2d9-4bf5-aba6-dbf86dc9d4fa tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:56.641049 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dde385e5-a2d9-4bf5-aba6-dbf86dc9d4fa tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:56.641543 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dde385e5-a2d9-4bf5-aba6-dbf86dc9d4fa tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:56.934141 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7012c7c0-7a82-4dee-99f9-8739df1e5c42 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:56.937645 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7012c7c0-7a82-4dee-99f9-8739df1e5c42 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: b1a11d01-7560-4d97-af75-2904cea5408f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:56.946232 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7012c7c0-7a82-4dee-99f9-8739df1e5c42 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:56.946728 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7012c7c0-7a82-4dee-99f9-8739df1e5c42 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:56.947166 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7012c7c0-7a82-4dee-99f9-8739df1e5c42 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:56.950334 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7012c7c0-7a82-4dee-99f9-8739df1e5c42 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:56.950334 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7012c7c0-7a82-4dee-99f9-8739df1e5c42 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:56.950334 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7012c7c0-7a82-4dee-99f9-8739df1e5c42 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:56.989958 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7012c7c0-7a82-4dee-99f9-8739df1e5c42 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061694 Oct 30 01:48:56.990585 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3091/6183] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 01:48:56 2022] GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:48:57.018718 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-dde385e5-a2d9-4bf5-aba6-dbf86dc9d4fa tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb21ecdda88d49b59e11a30b0f3afc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767edc5f9e7a4c81929df4fa8a12d94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:57.028047 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-dde385e5-a2d9-4bf5-aba6-dbf86dc9d4fa tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd648ae-9abd-4906-8b40-c398878310eb" status: 200 len: 1318 microversion: 2.1 time: 0.404318 Oct 30 01:48:57.028641 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3093/6184] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:56 2022] GET /compute/v2.1/servers/ffd648ae-9abd-4906-8b40-c398878310eb => generated 1318 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:58.005121 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-67b1ffa8-4e30-4082-a910-ab61f45a0d43 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:58.020356 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ad63b344-fb5f-4b59-855f-7107323bd116 tempest-VolumesTestJSON-1152927102 tempest-VolumesTestJSON-1152927102-project] Calling method '.version_select at 0x7f44c6e71ee0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:58.025647 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-67b1ffa8-4e30-4082-a910-ab61f45a0d43 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: b1a11d01-7560-4d97-af75-2904cea5408f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:58.055319 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67b1ffa8-4e30-4082-a910-ab61f45a0d43 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:58.059341 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:58.062338 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=6 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:58.063270 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67b1ffa8-4e30-4082-a910-ab61f45a0d43 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:58.065603 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67b1ffa8-4e30-4082-a910-ab61f45a0d43 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:58.066665 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67b1ffa8-4e30-4082-a910-ab61f45a0d43 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:58.068991 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67b1ffa8-4e30-4082-a910-ab61f45a0d43 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:58.072903 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67b1ffa8-4e30-4082-a910-ab61f45a0d43 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:58.140406 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ad63b344-fb5f-4b59-855f-7107323bd116 tempest-VolumesTestJSON-1152927102 tempest-VolumesTestJSON-1152927102-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/a6761523-9988-418b-b8cd-73379fe01918" status: 200 len: 351 microversion: 2.1 time: 0.138036 Oct 30 01:48:58.140406 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3092/6185] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 30 01:48:57 2022] GET /compute/v2.1/os-volumes/a6761523-9988-418b-b8cd-73379fe01918 => generated 351 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:48:58.142719 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2186b7c5-64a0-4ded-a0dc-2701abe4cdad tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:58.144132 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2186b7c5-64a0-4ded-a0dc-2701abe4cdad tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] [instance: ffd648ae-9abd-4906-8b40-c398878310eb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:58.162996 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2186b7c5-64a0-4ded-a0dc-2701abe4cdad tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:58.166931 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-67b1ffa8-4e30-4082-a910-ab61f45a0d43 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.166167 Oct 30 01:48:58.168960 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2186b7c5-64a0-4ded-a0dc-2701abe4cdad tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:58.169601 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2186b7c5-64a0-4ded-a0dc-2701abe4cdad tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:58.177991 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2186b7c5-64a0-4ded-a0dc-2701abe4cdad tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:58.184422 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3094/6186] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 01:48:57 2022] GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f/os-volume_attachments => generated 25 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:48:58.185490 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2186b7c5-64a0-4ded-a0dc-2701abe4cdad tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:58.187033 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2186b7c5-64a0-4ded-a0dc-2701abe4cdad tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:58.194177 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:58.284554 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6fb3b51f-1912-4fd7-a939-1e4f41444378 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:58.285478 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6fb3b51f-1912-4fd7-a939-1e4f41444378 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: b1a11d01-7560-4d97-af75-2904cea5408f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:58.294054 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6fb3b51f-1912-4fd7-a939-1e4f41444378 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:58.295239 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6fb3b51f-1912-4fd7-a939-1e4f41444378 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:58.295905 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6fb3b51f-1912-4fd7-a939-1e4f41444378 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:58.297774 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6fb3b51f-1912-4fd7-a939-1e4f41444378 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:58.298485 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6fb3b51f-1912-4fd7-a939-1e4f41444378 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:58.301100 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6fb3b51f-1912-4fd7-a939-1e4f41444378 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:58.340243 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6fb3b51f-1912-4fd7-a939-1e4f41444378 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: b1a11d01-7560-4d97-af75-2904cea5408f] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:48:58.448432 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=4 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:58.544067 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:58.741557 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6fb3b51f-1912-4fd7-a939-1e4f41444378 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f" status: 204 len: 0 microversion: 2.1 time: 0.461891 Oct 30 01:48:58.745719 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3095/6187] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:48:58 2022] DELETE /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f => generated 0 bytes in 464 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:48:58.753758 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-aba977cf-aaef-4604-befa-7c13efae6b2a tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:48:58.755354 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-aba977cf-aaef-4604-befa-7c13efae6b2a tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: b1a11d01-7560-4d97-af75-2904cea5408f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:48:58.774155 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aba977cf-aaef-4604-befa-7c13efae6b2a tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:58.776568 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aba977cf-aaef-4604-befa-7c13efae6b2a tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:58.776568 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aba977cf-aaef-4604-befa-7c13efae6b2a tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:58.776568 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aba977cf-aaef-4604-befa-7c13efae6b2a tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:48:58.777073 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aba977cf-aaef-4604-befa-7c13efae6b2a tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:48:58.780726 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aba977cf-aaef-4604-befa-7c13efae6b2a tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:48:59.137975 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2186b7c5-64a0-4ded-a0dc-2701abe4cdad tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb21ecdda88d49b59e11a30b0f3afc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767edc5f9e7a4c81929df4fa8a12d94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:59.151706 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2186b7c5-64a0-4ded-a0dc-2701abe4cdad tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd648ae-9abd-4906-8b40-c398878310eb" status: 200 len: 1318 microversion: 2.1 time: 1.013199 Oct 30 01:48:59.173626 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3093/6188] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:58 2022] GET /compute/v2.1/servers/ffd648ae-9abd-4906-8b40-c398878310eb => generated 1318 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:48:59.240984 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-aba977cf-aaef-4604-befa-7c13efae6b2a tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:48:59.249110 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-aba977cf-aaef-4604-befa-7c13efae6b2a tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f" status: 200 len: 1682 microversion: 2.1 time: 0.500058 Oct 30 01:48:59.252855 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3096/6189] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:48:58 2022] GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f => generated 1682 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:49:00.180246 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b0058a98-3cda-427f-9edf-ae72ab6dba3e tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:49:00.180868 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b0058a98-3cda-427f-9edf-ae72ab6dba3e tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] [instance: ffd648ae-9abd-4906-8b40-c398878310eb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:49:00.191350 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b0058a98-3cda-427f-9edf-ae72ab6dba3e tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:49:00.195605 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b0058a98-3cda-427f-9edf-ae72ab6dba3e tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:49:00.195605 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b0058a98-3cda-427f-9edf-ae72ab6dba3e tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:49:00.195605 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b0058a98-3cda-427f-9edf-ae72ab6dba3e tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:49:00.195605 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b0058a98-3cda-427f-9edf-ae72ab6dba3e tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:49:00.195605 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b0058a98-3cda-427f-9edf-ae72ab6dba3e tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:49:00.272515 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-169c63da-8f3e-40b9-be41-6e9a51159416 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:49:00.273695 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-169c63da-8f3e-40b9-be41-6e9a51159416 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: b1a11d01-7560-4d97-af75-2904cea5408f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:49:00.293931 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-169c63da-8f3e-40b9-be41-6e9a51159416 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:49:00.307801 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-169c63da-8f3e-40b9-be41-6e9a51159416 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:49:00.316913 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-169c63da-8f3e-40b9-be41-6e9a51159416 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:49:00.317927 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-169c63da-8f3e-40b9-be41-6e9a51159416 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:49:00.318432 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-169c63da-8f3e-40b9-be41-6e9a51159416 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:49:00.318883 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-169c63da-8f3e-40b9-be41-6e9a51159416 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:49:00.422035 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b0058a98-3cda-427f-9edf-ae72ab6dba3e tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb21ecdda88d49b59e11a30b0f3afc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767edc5f9e7a4c81929df4fa8a12d94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:49:00.437736 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b0058a98-3cda-427f-9edf-ae72ab6dba3e tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd648ae-9abd-4906-8b40-c398878310eb" status: 200 len: 1318 microversion: 2.1 time: 0.261190 Oct 30 01:49:00.438901 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3094/6190] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:49:00 2022] GET /compute/v2.1/servers/ffd648ae-9abd-4906-8b40-c398878310eb => generated 1318 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:49:00.669170 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-169c63da-8f3e-40b9-be41-6e9a51159416 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:49:00.687337 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-169c63da-8f3e-40b9-be41-6e9a51159416 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f" status: 200 len: 1682 microversion: 2.1 time: 0.417347 Oct 30 01:49:00.690579 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3097/6191] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:49:00 2022] GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f => generated 1682 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:49:01.256187 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5f0964b2-d160-45c5-af43-6b8bdbd1d3e3 tempest-VolumesTestJSON-1152927102 tempest-VolumesTestJSON-1152927102-project] Calling method '.version_select at 0x7f44c6e71af0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:49:01.389061 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-8d44599d-bc1a-4aa3-a136-9d758ea4aee4 req-6acc5582-c95d-460d-b351-5fe189bdbb3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffd648ae-9abd-4906-8b40-c398878310eb", "name": "network-vif-plugged", "status": "completed", "tag": "eef21b63-a56b-43f1-b58e-6b544c4ce632"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:49:01.407231 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-8d44599d-bc1a-4aa3-a136-9d758ea4aee4 req-6acc5582-c95d-460d-b351-5fe189bdbb3d service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:49:01.408095 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-8d44599d-bc1a-4aa3-a136-9d758ea4aee4 req-6acc5582-c95d-460d-b351-5fe189bdbb3d service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:49:01.411726 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-8d44599d-bc1a-4aa3-a136-9d758ea4aee4 req-6acc5582-c95d-460d-b351-5fe189bdbb3d service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:49:01.423773 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-8d44599d-bc1a-4aa3-a136-9d758ea4aee4 req-6acc5582-c95d-460d-b351-5fe189bdbb3d service nova] Creating event network-vif-plugged:eef21b63-a56b-43f1-b58e-6b544c4ce632 for instance ffd648ae-9abd-4906-8b40-c398878310eb on n-h2-master-1 Oct 30 01:49:01.434958 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5f0964b2-d160-45c5-af43-6b8bdbd1d3e3 tempest-VolumesTestJSON-1152927102 tempest-VolumesTestJSON-1152927102-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/60c98dca-273f-4e07-a7fa-44c7dc3b1187" status: 200 len: 351 microversion: 2.1 time: 0.182789 Oct 30 01:49:01.435207 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3095/6192] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 30 01:49:01 2022] GET /compute/v2.1/os-volumes/60c98dca-273f-4e07-a7fa-44c7dc3b1187 => generated 351 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:49:01.445957 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-8d44599d-bc1a-4aa3-a136-9d758ea4aee4 req-6acc5582-c95d-460d-b351-5fe189bdbb3d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055739 Oct 30 01:49:01.445957 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3098/6193] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:49:01.462847 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e1cf2161-e5e5-40fe-844c-d5ccfaa06fbb tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:49:01.463488 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e1cf2161-e5e5-40fe-844c-d5ccfaa06fbb tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] [instance: ffd648ae-9abd-4906-8b40-c398878310eb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:49:01.503483 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e1cf2161-e5e5-40fe-844c-d5ccfaa06fbb tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:49:01.504005 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e1cf2161-e5e5-40fe-844c-d5ccfaa06fbb tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:49:01.504454 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e1cf2161-e5e5-40fe-844c-d5ccfaa06fbb tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:49:01.505172 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e1cf2161-e5e5-40fe-844c-d5ccfaa06fbb tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:49:01.514680 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e1cf2161-e5e5-40fe-844c-d5ccfaa06fbb tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:49:01.515140 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e1cf2161-e5e5-40fe-844c-d5ccfaa06fbb tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:49:01.719285 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-27e97c56-17d1-4111-9810-7fc23e8d899f tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:49:01.720007 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-27e97c56-17d1-4111-9810-7fc23e8d899f tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: b1a11d01-7560-4d97-af75-2904cea5408f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:49:01.740753 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27e97c56-17d1-4111-9810-7fc23e8d899f tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:49:01.741258 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27e97c56-17d1-4111-9810-7fc23e8d899f tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:49:01.741722 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27e97c56-17d1-4111-9810-7fc23e8d899f tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:49:01.742434 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27e97c56-17d1-4111-9810-7fc23e8d899f tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:49:01.748629 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27e97c56-17d1-4111-9810-7fc23e8d899f tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:49:01.749098 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27e97c56-17d1-4111-9810-7fc23e8d899f tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:49:02.018838 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-27e97c56-17d1-4111-9810-7fc23e8d899f tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:49:02.028986 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-27e97c56-17d1-4111-9810-7fc23e8d899f tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f" status: 200 len: 1614 microversion: 2.1 time: 0.315594 Oct 30 01:49:02.030212 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3099/6194] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:49:01 2022] GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f => generated 1614 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:49:02.248495 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-5c480dd9-c928-4e1a-ac46-4c4281a591b2 req-f4939ca4-829b-43ed-8609-001663216cf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1a11d01-7560-4d97-af75-2904cea5408f", "name": "network-vif-deleted", "tag": "10cb167f-2464-4262-8c62-e8e2481f80bc"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:49:02.254940 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e1cf2161-e5e5-40fe-844c-d5ccfaa06fbb tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb21ecdda88d49b59e11a30b0f3afc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767edc5f9e7a4c81929df4fa8a12d94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:49:02.269673 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e1cf2161-e5e5-40fe-844c-d5ccfaa06fbb tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd648ae-9abd-4906-8b40-c398878310eb" status: 200 len: 1318 microversion: 2.1 time: 0.808690 Oct 30 01:49:02.271279 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3096/6195] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:49:01 2022] GET /compute/v2.1/servers/ffd648ae-9abd-4906-8b40-c398878310eb => generated 1318 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:49:02.273770 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-5c480dd9-c928-4e1a-ac46-4c4281a591b2 req-f4939ca4-829b-43ed-8609-001663216cf8 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:49:02.274422 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-5c480dd9-c928-4e1a-ac46-4c4281a591b2 req-f4939ca4-829b-43ed-8609-001663216cf8 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:49:02.277368 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-5c480dd9-c928-4e1a-ac46-4c4281a591b2 req-f4939ca4-829b-43ed-8609-001663216cf8 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:49:02.308151 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-5c480dd9-c928-4e1a-ac46-4c4281a591b2 req-f4939ca4-829b-43ed-8609-001663216cf8 service nova] Creating event network-vif-deleted:10cb167f-2464-4262-8c62-e8e2481f80bc for instance b1a11d01-7560-4d97-af75-2904cea5408f on n-h1-master-1 Oct 30 01:49:02.314442 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-5c480dd9-c928-4e1a-ac46-4c4281a591b2 req-f4939ca4-829b-43ed-8609-001663216cf8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069911 Oct 30 01:49:02.317152 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3100/6196] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:49:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:49:03.052398 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3f463554-efd7-4f62-a950-e2ab965eaa8d tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:49:03.053286 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3f463554-efd7-4f62-a950-e2ab965eaa8d tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: b1a11d01-7560-4d97-af75-2904cea5408f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:49:03.065212 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f463554-efd7-4f62-a950-e2ab965eaa8d tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:49:03.068983 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f463554-efd7-4f62-a950-e2ab965eaa8d tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:49:03.069661 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f463554-efd7-4f62-a950-e2ab965eaa8d tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:49:03.071152 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f463554-efd7-4f62-a950-e2ab965eaa8d tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:49:03.071797 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f463554-efd7-4f62-a950-e2ab965eaa8d tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:49:03.072407 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f463554-efd7-4f62-a950-e2ab965eaa8d tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:49:03.122702 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f463554-efd7-4f62-a950-e2ab965eaa8d tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:49:03.124402 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f463554-efd7-4f62-a950-e2ab965eaa8d tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:49:03.125316 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f463554-efd7-4f62-a950-e2ab965eaa8d tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:49:03.125964 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-3f463554-efd7-4f62-a950-e2ab965eaa8d tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lazy-loading 'fault' on Instance uuid b1a11d01-7560-4d97-af75-2904cea5408f {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:49:03.193825 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3f463554-efd7-4f62-a950-e2ab965eaa8d tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:49:03.203855 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3f463554-efd7-4f62-a950-e2ab965eaa8d tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f" status: 200 len: 1332 microversion: 2.1 time: 0.155251 Oct 30 01:49:03.206709 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3097/6197] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:49:03 2022] GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f => generated 1332 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:49:03.300946 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-35acb259-bb4d-427c-a512-e2ddaf35b0ce tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:49:03.302490 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-35acb259-bb4d-427c-a512-e2ddaf35b0ce tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] [instance: ffd648ae-9abd-4906-8b40-c398878310eb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:49:03.317847 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-35acb259-bb4d-427c-a512-e2ddaf35b0ce tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:49:03.318654 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-35acb259-bb4d-427c-a512-e2ddaf35b0ce tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:49:03.321927 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-35acb259-bb4d-427c-a512-e2ddaf35b0ce tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:49:03.322976 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-35acb259-bb4d-427c-a512-e2ddaf35b0ce tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:49:03.324141 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-35acb259-bb4d-427c-a512-e2ddaf35b0ce tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:49:03.325611 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-35acb259-bb4d-427c-a512-e2ddaf35b0ce tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:49:03.548679 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-35acb259-bb4d-427c-a512-e2ddaf35b0ce tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb21ecdda88d49b59e11a30b0f3afc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767edc5f9e7a4c81929df4fa8a12d94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:49:03.562188 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-35acb259-bb4d-427c-a512-e2ddaf35b0ce tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd648ae-9abd-4906-8b40-c398878310eb" status: 200 len: 1318 microversion: 2.1 time: 0.262323 Oct 30 01:49:03.565782 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3101/6198] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:49:03 2022] GET /compute/v2.1/servers/ffd648ae-9abd-4906-8b40-c398878310eb => generated 1318 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:49:04.230197 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4bad4172-4752-4911-9f00-d4668e7cb04b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:49:04.231516 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4bad4172-4752-4911-9f00-d4668e7cb04b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: b1a11d01-7560-4d97-af75-2904cea5408f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:49:04.238865 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4bad4172-4752-4911-9f00-d4668e7cb04b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:49:04.239351 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4bad4172-4752-4911-9f00-d4668e7cb04b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:49:04.241143 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4bad4172-4752-4911-9f00-d4668e7cb04b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:49:04.241143 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4bad4172-4752-4911-9f00-d4668e7cb04b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:49:04.241143 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4bad4172-4752-4911-9f00-d4668e7cb04b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:49:04.241549 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4bad4172-4752-4911-9f00-d4668e7cb04b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:49:04.256980 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-4bad4172-4752-4911-9f00-d4668e7cb04b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] HTTP exception thrown: Instance b1a11d01-7560-4d97-af75-2904cea5408f could not be found. Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4bad4172-4752-4911-9f00-d4668e7cb04b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Request method failure captured: Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f HTTP/1.1 Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdcRtc4GzHkShMdH9tTupejgTwf3ZNgIcyJqp9yicfp5OD1pJcQPZv1XBaNx7doePOAnkL0JpoIe5_T8iLiz5QjNjR1hpdjjFconMkrxU8FPHulGdRMQx61K_rAf0z9mDPUn9FfJ2msqRaRZPanWCScsW3BEB8X_vbKTz8C4TVCF-Ys Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 311cde01e89442f1ab3aa930070b7343 Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-AttachVolumeNegativeTest-812748574 Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/311cde01e89442f1ab3aa930070b7343"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_311cde01e89442f1ab3aa930070b7343"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/311cde01e89442f1ab3aa930070b7343"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/311cde01e89442f1ab3aa930070b7343"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-AttachVolumeNegativeTest-812748574 Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 311cde01e89442f1ab3aa930070b7343 Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-812748574 Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-AttachVolumeNegativeTest-812748574-project Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: dcb021152c684983b31e5db439518921 Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-AttachVolumeNegativeTest-812748574-project Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: exception: Instance b1a11d01-7560-4d97-af75-2904cea5408f could not be found. Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'b1a11d01-7560-4d97-af75-2904cea5408f'} Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1a11d01-7560-4d97-af75-2904cea5408f could not be found. Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1a11d01-7560-4d97-af75-2904cea5408f could not be found. Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:49:04.258600 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:49:04.264887 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:49:04.264887 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:49:04.264887 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:49:04.264887 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:49:04.264887 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:49:04.264887 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1a11d01-7560-4d97-af75-2904cea5408f could not be found. Oct 30 01:49:04.264887 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:49:04.264887 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4bad4172-4752-4911-9f00-d4668e7cb04b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Returning 404 to user: Instance b1a11d01-7560-4d97-af75-2904cea5408f could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:49:04.264887 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4bad4172-4752-4911-9f00-d4668e7cb04b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f" status: 404 len: 111 microversion: 2.1 time: 0.034400 Oct 30 01:49:04.264887 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3098/6199] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:49:04 2022] GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:49:04.270470 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8c54c473-49aa-4673-a609-7771e61a6027 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '.version_select at 0x7f44cca78940>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:49:04.348413 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8c54c473-49aa-4673-a609-7771e61a6027 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1217338871" status: 202 len: 0 microversion: 2.1 time: 0.081772 Oct 30 01:49:04.351662 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3102/6200] 10.222.0.13 () {58 vars in 1221 bytes} [Sun Oct 30 01:49:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1217338871 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:49:04.617365 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-44c57811-d72b-4299-978c-3a2f09347eee tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:49:04.621378 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-44c57811-d72b-4299-978c-3a2f09347eee tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] [instance: ffd648ae-9abd-4906-8b40-c398878310eb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:49:04.630903 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-44c57811-d72b-4299-978c-3a2f09347eee tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:49:04.631434 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-44c57811-d72b-4299-978c-3a2f09347eee tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:49:04.631999 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-44c57811-d72b-4299-978c-3a2f09347eee tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:49:04.632732 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-44c57811-d72b-4299-978c-3a2f09347eee tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:49:04.633209 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-44c57811-d72b-4299-978c-3a2f09347eee tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:49:04.633770 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-44c57811-d72b-4299-978c-3a2f09347eee tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:49:04.734652 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c9284163-d40d-4dda-ba93-c5b23c0ffdc5 tempest-VolumesTestJSON-1152927102 tempest-VolumesTestJSON-1152927102-project] Calling method '.version_select at 0x7f44cc13b430>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:49:04.902919 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c9284163-d40d-4dda-ba93-c5b23c0ffdc5 tempest-VolumesTestJSON-1152927102 tempest-VolumesTestJSON-1152927102-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/74e8d8fa-9ec6-4f5a-9757-1c8bf6c846a0" status: 200 len: 350 microversion: 2.1 time: 0.172882 Oct 30 01:49:04.904101 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3103/6201] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 30 01:49:04 2022] GET /compute/v2.1/os-volumes/74e8d8fa-9ec6-4f5a-9757-1c8bf6c846a0 => generated 350 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:49:04.929305 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-902795c1-eaa3-4f06-8d52-76261e890cc0 tempest-VolumesTestJSON-1152927102 tempest-VolumesTestJSON-1152927102-project] Calling method '.version_select at 0x7f44c6fa7ee0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:49:05.030465 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-902795c1-eaa3-4f06-8d52-76261e890cc0 tempest-VolumesTestJSON-1152927102 tempest-VolumesTestJSON-1152927102-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.110489 Oct 30 01:49:05.031539 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3104/6202] 10.222.0.13 () {58 vars in 1134 bytes} [Sun Oct 30 01:49:04 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:49:05.038802 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-44c57811-d72b-4299-978c-3a2f09347eee tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb21ecdda88d49b59e11a30b0f3afc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767edc5f9e7a4c81929df4fa8a12d94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:49:05.048130 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-217fe104-167e-4262-b4c1-870b1d828af5 tempest-VolumesTestJSON-1152927102 tempest-VolumesTestJSON-1152927102-project] Calling method '.version_select at 0x7f44c70bc8b0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:49:05.055915 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-44c57811-d72b-4299-978c-3a2f09347eee tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd648ae-9abd-4906-8b40-c398878310eb" status: 200 len: 1508 microversion: 2.1 time: 0.463445 Oct 30 01:49:05.057959 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3099/6203] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:49:04 2022] GET /compute/v2.1/servers/ffd648ae-9abd-4906-8b40-c398878310eb => generated 1508 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:49:05.169278 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-217fe104-167e-4262-b4c1-870b1d828af5 tempest-VolumesTestJSON-1152927102 tempest-VolumesTestJSON-1152927102-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.125337 Oct 30 01:49:05.170773 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3105/6204] 10.222.0.13 () {58 vars in 1149 bytes} [Sun Oct 30 01:49:05 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:49:05.186563 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8643de70-1d67-458a-aa4c-e6bed0dfe8f5 tempest-VolumesTestJSON-1152927102 tempest-VolumesTestJSON-1152927102-project] Calling method '.version_select at 0x7f44cda98670>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:49:05.284687 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8643de70-1d67-458a-aa4c-e6bed0dfe8f5 tempest-VolumesTestJSON-1152927102 tempest-VolumesTestJSON-1152927102-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.101981 Oct 30 01:49:05.290013 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3100/6205] 10.222.0.13 () {58 vars in 1134 bytes} [Sun Oct 30 01:49:05 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:49:05.300530 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-77e1f27c-7963-47f7-be47-bc47d8b568e3 tempest-VolumesTestJSON-1152927102 tempest-VolumesTestJSON-1152927102-project] Calling method '.version_select at 0x7f44c76a2280>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:49:05.401860 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-77e1f27c-7963-47f7-be47-bc47d8b568e3 tempest-VolumesTestJSON-1152927102 tempest-VolumesTestJSON-1152927102-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.106873 Oct 30 01:49:05.402507 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3106/6206] 10.222.0.13 () {58 vars in 1167 bytes} [Sun Oct 30 01:49:05 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:49:05.426051 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-be39d5d4-f6a9-4162-acdc-54326ba70c3c tempest-VolumesTestJSON-1152927102 tempest-VolumesTestJSON-1152927102-project] Calling method '.version_select at 0x7f44d0358160>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:49:05.554262 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0ffc13df-877b-474e-a73c-44eb041fd7a1 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Action: 'create', calling method: .version_select at 0x7f44c70bca60>, body: {"keypair": {"name": "tempest-keypair-304745793", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlmX15FCqPJUZvCsvvt40vnNMubAA2mMr4R7nWvZDovjiF+pEEci1rhQmpzzRxdxHJKa0R5DvnNDnhHhcJ5/Wvv8JAhbke7XFINe2fknN95/9mwP2HcyCPoQ6KjeFAF8Q=="}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:49:05.572915 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-be39d5d4-f6a9-4162-acdc-54326ba70c3c tempest-VolumesTestJSON-1152927102 tempest-VolumesTestJSON-1152927102-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.154088 Oct 30 01:49:05.586164 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3101/6207] 10.222.0.13 () {58 vars in 1170 bytes} [Sun Oct 30 01:49:05 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:49:05.591393 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8221fbf0-653a-4f6b-963b-61444ee11495 tempest-VolumesTestJSON-1152927102 tempest-VolumesTestJSON-1152927102-project] Calling method '.version_select at 0x7f44cc8db310>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:49:05.607084 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-0ffc13df-877b-474e-a73c-44eb041fd7a1 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Getting quotas for project 311cde01e89442f1ab3aa930070b7343. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:49:05.613873 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-0ffc13df-877b-474e-a73c-44eb041fd7a1 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Getting quotas for user dcb021152c684983b31e5db439518921 and project 311cde01e89442f1ab3aa930070b7343. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:49:05.704275 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0ffc13df-877b-474e-a73c-44eb041fd7a1 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.153946 Oct 30 01:49:05.709189 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3107/6208] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 30 01:49:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:49:05.754820 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8221fbf0-653a-4f6b-963b-61444ee11495 tempest-VolumesTestJSON-1152927102 tempest-VolumesTestJSON-1152927102-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.167260 Oct 30 01:49:05.755400 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3102/6209] 10.222.0.13 () {58 vars in 1155 bytes} [Sun Oct 30 01:49:05 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:49:05.770524 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-32771ff0-caef-4f4b-9bb0-c0af243dc3bd tempest-VolumesTestJSON-1152927102 tempest-VolumesTestJSON-1152927102-project] Calling method '.version_select at 0x7f44c6fa7820>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:49:05.870602 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-32771ff0-caef-4f4b-9bb0-c0af243dc3bd tempest-VolumesTestJSON-1152927102 tempest-VolumesTestJSON-1152927102-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.103596 Oct 30 01:49:05.870602 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3108/6210] 10.222.0.13 () {58 vars in 1188 bytes} [Sun Oct 30 01:49:05 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:49:05.886450 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-21702995-72e1-489f-bf53-d460c6b6f9f0 tempest-VolumesTestJSON-1152927102 tempest-VolumesTestJSON-1152927102-project] Calling method '.version_select at 0x7f44d04849d0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:49:06.062256 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-21702995-72e1-489f-bf53-d460c6b6f9f0 tempest-VolumesTestJSON-1152927102 tempest-VolumesTestJSON-1152927102-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.179517 Oct 30 01:49:06.062853 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3103/6211] 10.222.0.13 () {58 vars in 1155 bytes} [Sun Oct 30 01:49:05 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:49:08.927918 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f32eea00-6bf9-42d5-b826-8653374f894b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-163735275", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1ac83571-0ede-40a0-ae99-0e3341ce15be"}], "security_groups": [{"name": "tempest-securitygroup--1956522623"}], "key_name": "tempest-keypair-304745793", "user_data": "}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:49:09.069477 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-f32eea00-6bf9-42d5-b826-8653374f894b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] validate_networks() for [('1ac83571-0ede-40a0-ae99-0e3341ce15be', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:49:09.521381 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-f32eea00-6bf9-42d5-b826-8653374f894b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:49:09.521808 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-f32eea00-6bf9-42d5-b826-8653374f894b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:49:09.522283 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-f32eea00-6bf9-42d5-b826-8653374f894b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:49:09.522680 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-f32eea00-6bf9-42d5-b826-8653374f894b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:49:09.523090 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-f32eea00-6bf9-42d5-b826-8653374f894b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:49:09.534424 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f32eea00-6bf9-42d5-b826-8653374f894b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:49:09.534904 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f32eea00-6bf9-42d5-b826-8653374f894b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:49:09.535639 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f32eea00-6bf9-42d5-b826-8653374f894b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:49:09.538557 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f32eea00-6bf9-42d5-b826-8653374f894b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:49:09.538557 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f32eea00-6bf9-42d5-b826-8653374f894b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:49:09.538557 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f32eea00-6bf9-42d5-b826-8653374f894b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:49:09.563170 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-f32eea00-6bf9-42d5-b826-8653374f894b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Getting quotas for project 311cde01e89442f1ab3aa930070b7343. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:49:09.569710 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-f32eea00-6bf9-42d5-b826-8653374f894b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Getting quotas for user dcb021152c684983b31e5db439518921 and project 311cde01e89442f1ab3aa930070b7343. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:49:09.597058 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f32eea00-6bf9-42d5-b826-8653374f894b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:49:09.600543 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f32eea00-6bf9-42d5-b826-8653374f894b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: d5697528-7254-4540-bef5-9cc1a8432fdc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:49:09.798588 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f32eea00-6bf9-42d5-b826-8653374f894b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.876241 Oct 30 01:49:09.800231 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3109/6212] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:49:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 879 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:49:09.813001 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bd8daade-40b7-451f-bb73-883be158aecd tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:49:09.814478 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-bd8daade-40b7-451f-bb73-883be158aecd tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: d5697528-7254-4540-bef5-9cc1a8432fdc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:49:09.915961 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-bd8daade-40b7-451f-bb73-883be158aecd tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:49:09.927571 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bd8daade-40b7-451f-bb73-883be158aecd tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc" status: 200 len: 1240 microversion: 2.1 time: 0.117684 Oct 30 01:49:09.934988 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3104/6213] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:49:09 2022] GET /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc => generated 1240 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:49:10.957047 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c2c6abfc-63ec-4c48-8706-bfd364a73f63 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:49:10.962027 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c2c6abfc-63ec-4c48-8706-bfd364a73f63 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: d5697528-7254-4540-bef5-9cc1a8432fdc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:49:11.106048 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c2c6abfc-63ec-4c48-8706-bfd364a73f63 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:49:11.114001 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c2c6abfc-63ec-4c48-8706-bfd364a73f63 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc" status: 200 len: 1240 microversion: 2.1 time: 0.160825 Oct 30 01:49:11.117046 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3110/6214] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:49:10 2022] GET /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc => generated 1240 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:49:12.142902 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7152b0e5-9a13-4ff8-b4f5-b229fe02bdb1 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:49:12.143783 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7152b0e5-9a13-4ff8-b4f5-b229fe02bdb1 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: d5697528-7254-4540-bef5-9cc1a8432fdc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:49:12.154671 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7152b0e5-9a13-4ff8-b4f5-b229fe02bdb1 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:49:12.155594 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7152b0e5-9a13-4ff8-b4f5-b229fe02bdb1 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:49:12.156487 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7152b0e5-9a13-4ff8-b4f5-b229fe02bdb1 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:49:12.157729 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7152b0e5-9a13-4ff8-b4f5-b229fe02bdb1 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:49:12.158592 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7152b0e5-9a13-4ff8-b4f5-b229fe02bdb1 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:49:12.159437 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7152b0e5-9a13-4ff8-b4f5-b229fe02bdb1 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:49:12.266639 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7152b0e5-9a13-4ff8-b4f5-b229fe02bdb1 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:49:12.276278 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7152b0e5-9a13-4ff8-b4f5-b229fe02bdb1 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc" status: 200 len: 1292 microversion: 2.1 time: 0.141743 Oct 30 01:49:12.293061 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3105/6215] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:49:12 2022] GET /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc => generated 1292 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:49:13.302774 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3909b6f8-f387-4e63-b2ae-b4a7e772eeb4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:49:13.303402 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3909b6f8-f387-4e63-b2ae-b4a7e772eeb4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: d5697528-7254-4540-bef5-9cc1a8432fdc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:49:13.326937 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:13.330443 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3909b6f8-f387-4e63-b2ae-b4a7e772eeb4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:49:13.332314 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3909b6f8-f387-4e63-b2ae-b4a7e772eeb4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:49:13.334145 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3909b6f8-f387-4e63-b2ae-b4a7e772eeb4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:49:13.337409 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3909b6f8-f387-4e63-b2ae-b4a7e772eeb4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:49:13.338160 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3909b6f8-f387-4e63-b2ae-b4a7e772eeb4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:49:13.339615 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3909b6f8-f387-4e63-b2ae-b4a7e772eeb4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:49:13.464017 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3909b6f8-f387-4e63-b2ae-b4a7e772eeb4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:49:13.475288 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3909b6f8-f387-4e63-b2ae-b4a7e772eeb4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc" status: 200 len: 1298 microversion: 2.1 time: 0.178680 Oct 30 01:49:13.476782 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3111/6216] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:49:13 2022] GET /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc => generated 1298 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:49:14.509962 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-111aa07b-0cec-4f04-81ff-a51258047177 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:49:14.510626 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-111aa07b-0cec-4f04-81ff-a51258047177 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: d5697528-7254-4540-bef5-9cc1a8432fdc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:49:14.543109 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-111aa07b-0cec-4f04-81ff-a51258047177 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:49:14.544067 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-111aa07b-0cec-4f04-81ff-a51258047177 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:49:14.546356 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-111aa07b-0cec-4f04-81ff-a51258047177 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:49:14.550921 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-111aa07b-0cec-4f04-81ff-a51258047177 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:49:14.556442 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-111aa07b-0cec-4f04-81ff-a51258047177 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:49:14.556442 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-111aa07b-0cec-4f04-81ff-a51258047177 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:49:14.917220 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-111aa07b-0cec-4f04-81ff-a51258047177 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:49:14.927355 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-111aa07b-0cec-4f04-81ff-a51258047177 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc" status: 200 len: 1366 microversion: 2.1 time: 0.422636 Oct 30 01:49:14.932052 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3106/6217] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:49:14 2022] GET /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc => generated 1366 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:49:15.958088 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5ff0f160-8ecc-4fa0-8c05-4a02f40ab00c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:49:15.962481 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5ff0f160-8ecc-4fa0-8c05-4a02f40ab00c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: d5697528-7254-4540-bef5-9cc1a8432fdc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:49:15.974511 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5ff0f160-8ecc-4fa0-8c05-4a02f40ab00c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:49:15.975361 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5ff0f160-8ecc-4fa0-8c05-4a02f40ab00c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:49:15.979277 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5ff0f160-8ecc-4fa0-8c05-4a02f40ab00c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:49:15.982564 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5ff0f160-8ecc-4fa0-8c05-4a02f40ab00c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:49:15.983347 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5ff0f160-8ecc-4fa0-8c05-4a02f40ab00c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:49:15.987753 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5ff0f160-8ecc-4fa0-8c05-4a02f40ab00c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:49:16.053214 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-f5f2d9b5-bd92-4a62-b888-5d15eab6093e req-7cd2156b-5de4-4e12-9bdb-c788a37ed8e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5697528-7254-4540-bef5-9cc1a8432fdc", "tag": "88a6f688-b738-4cfa-bc7c-2b8f0a35c930"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:49:16.081799 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-f5f2d9b5-bd92-4a62-b888-5d15eab6093e req-7cd2156b-5de4-4e12-9bdb-c788a37ed8e0 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:49:16.082250 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-f5f2d9b5-bd92-4a62-b888-5d15eab6093e req-7cd2156b-5de4-4e12-9bdb-c788a37ed8e0 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:49:16.082897 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-f5f2d9b5-bd92-4a62-b888-5d15eab6093e req-7cd2156b-5de4-4e12-9bdb-c788a37ed8e0 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:49:16.100553 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-f5f2d9b5-bd92-4a62-b888-5d15eab6093e req-7cd2156b-5de4-4e12-9bdb-c788a37ed8e0 service nova] Creating event network-changed:88a6f688-b738-4cfa-bc7c-2b8f0a35c930 for instance d5697528-7254-4540-bef5-9cc1a8432fdc on n-h1-master-1 Oct 30 01:49:16.111936 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-f5f2d9b5-bd92-4a62-b888-5d15eab6093e req-7cd2156b-5de4-4e12-9bdb-c788a37ed8e0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067622 Oct 30 01:49:16.117287 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3107/6218] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:49:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:49:16.260358 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5ff0f160-8ecc-4fa0-8c05-4a02f40ab00c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:49:16.277778 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5ff0f160-8ecc-4fa0-8c05-4a02f40ab00c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc" status: 200 len: 1366 microversion: 2.1 time: 0.321772 Oct 30 01:49:16.279736 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3112/6219] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:49:15 2022] GET /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc => generated 1366 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:49:17.305855 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f1c52735-6279-45b8-9c94-6bc24602bf46 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:49:17.311213 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f1c52735-6279-45b8-9c94-6bc24602bf46 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: d5697528-7254-4540-bef5-9cc1a8432fdc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:49:17.318512 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f1c52735-6279-45b8-9c94-6bc24602bf46 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:49:17.319425 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f1c52735-6279-45b8-9c94-6bc24602bf46 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:49:17.320121 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f1c52735-6279-45b8-9c94-6bc24602bf46 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:49:17.320951 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f1c52735-6279-45b8-9c94-6bc24602bf46 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:49:17.321597 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f1c52735-6279-45b8-9c94-6bc24602bf46 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:49:17.322610 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f1c52735-6279-45b8-9c94-6bc24602bf46 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:49:17.514822 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f1c52735-6279-45b8-9c94-6bc24602bf46 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:49:17.524649 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f1c52735-6279-45b8-9c94-6bc24602bf46 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc" status: 200 len: 1366 microversion: 2.1 time: 0.226307 Oct 30 01:49:17.525235 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3108/6220] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:49:17 2022] GET /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:49:18.554412 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c64bfff9-f7eb-4a33-abb4-66e0fd4d0a9c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:49:18.555677 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c64bfff9-f7eb-4a33-abb4-66e0fd4d0a9c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: d5697528-7254-4540-bef5-9cc1a8432fdc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:49:18.563863 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c64bfff9-f7eb-4a33-abb4-66e0fd4d0a9c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:49:18.564857 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c64bfff9-f7eb-4a33-abb4-66e0fd4d0a9c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:49:18.565809 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c64bfff9-f7eb-4a33-abb4-66e0fd4d0a9c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:49:18.566861 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c64bfff9-f7eb-4a33-abb4-66e0fd4d0a9c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:49:18.568003 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c64bfff9-f7eb-4a33-abb4-66e0fd4d0a9c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:49:18.568447 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c64bfff9-f7eb-4a33-abb4-66e0fd4d0a9c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:49:18.741467 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c64bfff9-f7eb-4a33-abb4-66e0fd4d0a9c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:49:18.751174 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c64bfff9-f7eb-4a33-abb4-66e0fd4d0a9c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc" status: 200 len: 1366 microversion: 2.1 time: 0.204122 Oct 30 01:49:18.752466 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3113/6221] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:49:18 2022] GET /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:49:19.776944 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0d854ffb-d669-4ef5-915b-8fe4e4cd160d tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:49:19.777570 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0d854ffb-d669-4ef5-915b-8fe4e4cd160d tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: d5697528-7254-4540-bef5-9cc1a8432fdc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:49:19.785690 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d854ffb-d669-4ef5-915b-8fe4e4cd160d tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:49:19.786473 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d854ffb-d669-4ef5-915b-8fe4e4cd160d tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:49:19.787090 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d854ffb-d669-4ef5-915b-8fe4e4cd160d tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:49:19.787996 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d854ffb-d669-4ef5-915b-8fe4e4cd160d tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:49:19.788656 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d854ffb-d669-4ef5-915b-8fe4e4cd160d tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:49:19.789238 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d854ffb-d669-4ef5-915b-8fe4e4cd160d tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:49:19.920531 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:20.026271 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0d854ffb-d669-4ef5-915b-8fe4e4cd160d tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:49:20.041425 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0d854ffb-d669-4ef5-915b-8fe4e4cd160d tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc" status: 200 len: 1366 microversion: 2.1 time: 0.268376 Oct 30 01:49:20.061947 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3109/6222] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:49:19 2022] GET /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc => generated 1366 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:49:21.071880 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-25178d03-7214-46c7-a916-fafe5a30401c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:49:21.073032 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-25178d03-7214-46c7-a916-fafe5a30401c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: d5697528-7254-4540-bef5-9cc1a8432fdc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:49:21.076540 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:21.084162 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25178d03-7214-46c7-a916-fafe5a30401c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:49:21.086304 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25178d03-7214-46c7-a916-fafe5a30401c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:49:21.088530 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25178d03-7214-46c7-a916-fafe5a30401c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:49:21.089509 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25178d03-7214-46c7-a916-fafe5a30401c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:49:21.090764 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25178d03-7214-46c7-a916-fafe5a30401c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:49:21.093725 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25178d03-7214-46c7-a916-fafe5a30401c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:49:21.125260 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=12 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:21.378810 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-25178d03-7214-46c7-a916-fafe5a30401c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:49:21.387507 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-25178d03-7214-46c7-a916-fafe5a30401c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc" status: 200 len: 1366 microversion: 2.1 time: 0.319435 Oct 30 01:49:21.404633 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3114/6223] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:49:21 2022] GET /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc => generated 1366 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:49:22.414218 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-16d2f4b2-f86d-4eed-a430-8cec38bb54ee tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:49:22.414838 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-16d2f4b2-f86d-4eed-a430-8cec38bb54ee tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: d5697528-7254-4540-bef5-9cc1a8432fdc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:49:22.416785 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=44 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:22.430529 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-16d2f4b2-f86d-4eed-a430-8cec38bb54ee tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:49:22.431104 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-16d2f4b2-f86d-4eed-a430-8cec38bb54ee tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:49:22.439042 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-16d2f4b2-f86d-4eed-a430-8cec38bb54ee tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:49:22.439042 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-16d2f4b2-f86d-4eed-a430-8cec38bb54ee tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:49:22.439042 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-16d2f4b2-f86d-4eed-a430-8cec38bb54ee tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:49:22.439042 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-16d2f4b2-f86d-4eed-a430-8cec38bb54ee tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:49:22.676011 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-16d2f4b2-f86d-4eed-a430-8cec38bb54ee tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:49:22.690371 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-16d2f4b2-f86d-4eed-a430-8cec38bb54ee tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc" status: 200 len: 1366 microversion: 2.1 time: 0.281126 Oct 30 01:49:22.691090 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3110/6224] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:49:22 2022] GET /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc => generated 1366 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:49:22.834909 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-7ba3aff5-5717-48c3-b95c-d0a952c40870 req-d36ca176-d52d-42ff-a029-6a9588833749 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5697528-7254-4540-bef5-9cc1a8432fdc", "name": "network-vif-plugged", "status": "completed", "tag": "88a6f688-b738-4cfa-bc7c-2b8f0a35c930"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:49:22.849753 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-7ba3aff5-5717-48c3-b95c-d0a952c40870 req-d36ca176-d52d-42ff-a029-6a9588833749 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:49:22.852665 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-7ba3aff5-5717-48c3-b95c-d0a952c40870 req-d36ca176-d52d-42ff-a029-6a9588833749 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:49:22.853106 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-7ba3aff5-5717-48c3-b95c-d0a952c40870 req-d36ca176-d52d-42ff-a029-6a9588833749 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:49:22.865763 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-7ba3aff5-5717-48c3-b95c-d0a952c40870 req-d36ca176-d52d-42ff-a029-6a9588833749 service nova] Creating event network-vif-plugged:88a6f688-b738-4cfa-bc7c-2b8f0a35c930 for instance d5697528-7254-4540-bef5-9cc1a8432fdc on n-h1-master-1 Oct 30 01:49:22.871325 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-7ba3aff5-5717-48c3-b95c-d0a952c40870 req-d36ca176-d52d-42ff-a029-6a9588833749 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040274 Oct 30 01:49:22.876080 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3115/6225] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:49:23.717709 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6f071fad-c999-46c5-9304-e41d2236eeea tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:49:23.718931 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6f071fad-c999-46c5-9304-e41d2236eeea tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: d5697528-7254-4540-bef5-9cc1a8432fdc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:49:23.730443 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f071fad-c999-46c5-9304-e41d2236eeea tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:49:23.731257 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f071fad-c999-46c5-9304-e41d2236eeea tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:49:23.732748 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f071fad-c999-46c5-9304-e41d2236eeea tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:49:23.733728 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f071fad-c999-46c5-9304-e41d2236eeea tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:49:23.734187 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f071fad-c999-46c5-9304-e41d2236eeea tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:49:23.734797 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f071fad-c999-46c5-9304-e41d2236eeea tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:49:23.894531 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6f071fad-c999-46c5-9304-e41d2236eeea tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:49:23.906952 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6f071fad-c999-46c5-9304-e41d2236eeea tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc" status: 200 len: 1366 microversion: 2.1 time: 0.191647 Oct 30 01:49:23.906952 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3111/6226] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:49:23 2022] GET /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:49:24.930121 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-051f5ef9-b2f2-44c2-b2ac-16019bdba1f4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:49:24.930896 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-051f5ef9-b2f2-44c2-b2ac-16019bdba1f4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: d5697528-7254-4540-bef5-9cc1a8432fdc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:49:24.939789 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-051f5ef9-b2f2-44c2-b2ac-16019bdba1f4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:49:24.940651 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-051f5ef9-b2f2-44c2-b2ac-16019bdba1f4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:49:24.941212 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-051f5ef9-b2f2-44c2-b2ac-16019bdba1f4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:49:24.942110 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-051f5ef9-b2f2-44c2-b2ac-16019bdba1f4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:49:24.942727 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-051f5ef9-b2f2-44c2-b2ac-16019bdba1f4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:49:24.943443 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-051f5ef9-b2f2-44c2-b2ac-16019bdba1f4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:49:25.165457 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-051f5ef9-b2f2-44c2-b2ac-16019bdba1f4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:49:25.180392 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-051f5ef9-b2f2-44c2-b2ac-16019bdba1f4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc" status: 200 len: 1555 microversion: 2.1 time: 0.255812 Oct 30 01:49:25.181672 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3116/6227] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:49:24 2022] GET /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc => generated 1555 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:49:25.205478 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-66289063-a365-49a2-a97b-4086c34d4320 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:49:25.205977 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-66289063-a365-49a2-a97b-4086c34d4320 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: d5697528-7254-4540-bef5-9cc1a8432fdc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:49:25.213347 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-66289063-a365-49a2-a97b-4086c34d4320 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:49:25.216460 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-66289063-a365-49a2-a97b-4086c34d4320 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:49:25.220629 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-66289063-a365-49a2-a97b-4086c34d4320 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:49:25.220629 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-66289063-a365-49a2-a97b-4086c34d4320 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:49:25.220629 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-66289063-a365-49a2-a97b-4086c34d4320 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:49:25.220629 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-66289063-a365-49a2-a97b-4086c34d4320 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:49:25.346910 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-66289063-a365-49a2-a97b-4086c34d4320 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.144371 Oct 30 01:49:25.348028 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3112/6228] 10.222.0.13 () {58 vars in 1275 bytes} [Sun Oct 30 01:49:25 2022] GET /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc/os-interface => generated 284 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:49:27.011338 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-9c7b0dc0-9f28-4bbf-bcc6-2c82efd0e5e1 req-01a17e7e-efde-4f8a-b0a0-1b1dc237cd1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5697528-7254-4540-bef5-9cc1a8432fdc", "tag": "88a6f688-b738-4cfa-bc7c-2b8f0a35c930"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:49:27.032233 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-9c7b0dc0-9f28-4bbf-bcc6-2c82efd0e5e1 req-01a17e7e-efde-4f8a-b0a0-1b1dc237cd1e service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:49:27.033007 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-9c7b0dc0-9f28-4bbf-bcc6-2c82efd0e5e1 req-01a17e7e-efde-4f8a-b0a0-1b1dc237cd1e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:49:27.034165 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-9c7b0dc0-9f28-4bbf-bcc6-2c82efd0e5e1 req-01a17e7e-efde-4f8a-b0a0-1b1dc237cd1e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:49:27.063804 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-9c7b0dc0-9f28-4bbf-bcc6-2c82efd0e5e1 req-01a17e7e-efde-4f8a-b0a0-1b1dc237cd1e service nova] Creating event network-changed:88a6f688-b738-4cfa-bc7c-2b8f0a35c930 for instance d5697528-7254-4540-bef5-9cc1a8432fdc on n-h1-master-1 Oct 30 01:49:27.074523 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-9c7b0dc0-9f28-4bbf-bcc6-2c82efd0e5e1 req-01a17e7e-efde-4f8a-b0a0-1b1dc237cd1e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066033 Oct 30 01:49:27.081318 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3117/6229] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:49:41.206773 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=5 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:41.207561 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=75 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:41.211970 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-48e73535-8752-496b-98b5-cea55cf81d0d tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dd35d6d3-4035-4a3b-b517-17ded2952915", "device": "/dev/sdb"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:49:41.214219 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-48e73535-8752-496b-98b5-cea55cf81d0d tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] [instance: ffd648ae-9abd-4906-8b40-c398878310eb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:49:41.222877 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-48e73535-8752-496b-98b5-cea55cf81d0d tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:49:41.223641 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-48e73535-8752-496b-98b5-cea55cf81d0d tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:49:41.224092 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-48e73535-8752-496b-98b5-cea55cf81d0d tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:49:41.229780 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-48e73535-8752-496b-98b5-cea55cf81d0d tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:49:41.229780 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-48e73535-8752-496b-98b5-cea55cf81d0d tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:49:41.229780 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-48e73535-8752-496b-98b5-cea55cf81d0d tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:49:41.984589 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-48e73535-8752-496b-98b5-cea55cf81d0d tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] 10.222.0.13 "POST /compute/v2.1/servers/ffd648ae-9abd-4906-8b40-c398878310eb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.779362 Oct 30 01:49:41.985853 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3113/6230] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 30 01:49:41 2022] POST /compute/v2.1/servers/ffd648ae-9abd-4906-8b40-c398878310eb/os-volume_attachments => generated 194 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:50:00.846981 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=13 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:50:00.848012 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=64 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:50:01.119223 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ff92317e-bb4b-4f7c-a319-198dc3b1c548 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:50:01.119888 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ff92317e-bb4b-4f7c-a319-198dc3b1c548 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: d5697528-7254-4540-bef5-9cc1a8432fdc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:50:01.126329 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ff92317e-bb4b-4f7c-a319-198dc3b1c548 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:01.126819 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ff92317e-bb4b-4f7c-a319-198dc3b1c548 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:01.127262 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ff92317e-bb4b-4f7c-a319-198dc3b1c548 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:01.127966 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ff92317e-bb4b-4f7c-a319-198dc3b1c548 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:01.128421 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ff92317e-bb4b-4f7c-a319-198dc3b1c548 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:01.128849 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ff92317e-bb4b-4f7c-a319-198dc3b1c548 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:01.153571 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ff92317e-bb4b-4f7c-a319-198dc3b1c548 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc/ips" status: 200 len: 148 microversion: 2.1 time: 0.308933 Oct 30 01:50:01.154160 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3118/6231] 10.222.0.13 () {58 vars in 1248 bytes} [Sun Oct 30 01:50:00 2022] GET /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc/ips => generated 148 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:50:04.022014 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:50:04.022820 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:50:04.027276 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2a132d48-ce81-4ced-a88a-80857bf3541b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ad838c3-0fd7-4301-8b8a-47530bf59e8f"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:50:04.029860 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2a132d48-ce81-4ced-a88a-80857bf3541b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: d5697528-7254-4540-bef5-9cc1a8432fdc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:50:04.036499 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a132d48-ce81-4ced-a88a-80857bf3541b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:04.037421 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a132d48-ce81-4ced-a88a-80857bf3541b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:04.037543 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a132d48-ce81-4ced-a88a-80857bf3541b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:04.038178 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a132d48-ce81-4ced-a88a-80857bf3541b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:04.038636 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a132d48-ce81-4ced-a88a-80857bf3541b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:04.039068 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a132d48-ce81-4ced-a88a-80857bf3541b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:05.014752 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2a132d48-ce81-4ced-a88a-80857bf3541b tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "POST /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.994610 Oct 30 01:50:05.019779 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3114/6232] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 30 01:50:04 2022] POST /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc/os-volume_attachments => generated 194 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:50:13.062532 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c1e4d718-5935-4206-87fd-baca22cd569e tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:50:13.063075 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c1e4d718-5935-4206-87fd-baca22cd569e tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] [instance: ffd648ae-9abd-4906-8b40-c398878310eb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:50:13.066320 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:50:13.071527 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c1e4d718-5935-4206-87fd-baca22cd569e tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:13.072050 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c1e4d718-5935-4206-87fd-baca22cd569e tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:13.072483 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c1e4d718-5935-4206-87fd-baca22cd569e tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:13.073208 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c1e4d718-5935-4206-87fd-baca22cd569e tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:13.073679 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c1e4d718-5935-4206-87fd-baca22cd569e tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:13.074102 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c1e4d718-5935-4206-87fd-baca22cd569e tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:13.171380 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-c1e4d718-5935-4206-87fd-baca22cd569e tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lazy-loading 'services' on Instance uuid ffd648ae-9abd-4906-8b40-c398878310eb {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:50:13.408959 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c1e4d718-5935-4206-87fd-baca22cd569e tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ffd648ae-9abd-4906-8b40-c398878310eb/os-volume_attachments/dd35d6d3-4035-4a3b-b517-17ded2952915" status: 202 len: 0 microversion: 2.1 time: 0.351155 Oct 30 01:50:13.413702 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3119/6233] 10.222.0.13 () {58 vars in 1416 bytes} [Sun Oct 30 01:50:13 2022] DELETE /compute/v2.1/servers/ffd648ae-9abd-4906-8b40-c398878310eb/os-volume_attachments/dd35d6d3-4035-4a3b-b517-17ded2952915 => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:50:17.543722 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:50:17.549147 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b1c18359-9955-4f53-948b-7cf4c007ee9c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:50:17.549979 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b1c18359-9955-4f53-948b-7cf4c007ee9c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: d5697528-7254-4540-bef5-9cc1a8432fdc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:50:17.559645 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1c18359-9955-4f53-948b-7cf4c007ee9c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:17.560417 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1c18359-9955-4f53-948b-7cf4c007ee9c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:17.560904 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1c18359-9955-4f53-948b-7cf4c007ee9c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:17.561880 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1c18359-9955-4f53-948b-7cf4c007ee9c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:17.562361 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1c18359-9955-4f53-948b-7cf4c007ee9c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:17.563143 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1c18359-9955-4f53-948b-7cf4c007ee9c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:17.671018 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-b1c18359-9955-4f53-948b-7cf4c007ee9c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lazy-loading 'services' on Instance uuid d5697528-7254-4540-bef5-9cc1a8432fdc {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:50:17.947388 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b1c18359-9955-4f53-948b-7cf4c007ee9c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc/os-volume_attachments/8ad838c3-0fd7-4301-8b8a-47530bf59e8f" status: 202 len: 0 microversion: 2.1 time: 0.406224 Oct 30 01:50:17.951694 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3115/6234] 10.222.0.13 () {58 vars in 1416 bytes} [Sun Oct 30 01:50:17 2022] DELETE /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc/os-volume_attachments/8ad838c3-0fd7-4301-8b8a-47530bf59e8f => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:50:17.972089 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b1a8c043-0f28-4e50-9108-32e4da1f8aa1 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:50:17.976414 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b1a8c043-0f28-4e50-9108-32e4da1f8aa1 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: d5697528-7254-4540-bef5-9cc1a8432fdc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:50:17.984664 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b1a8c043-0f28-4e50-9108-32e4da1f8aa1 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:17.985304 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b1a8c043-0f28-4e50-9108-32e4da1f8aa1 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:17.985845 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b1a8c043-0f28-4e50-9108-32e4da1f8aa1 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:17.986614 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b1a8c043-0f28-4e50-9108-32e4da1f8aa1 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:17.987158 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b1a8c043-0f28-4e50-9108-32e4da1f8aa1 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:17.987720 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b1a8c043-0f28-4e50-9108-32e4da1f8aa1 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:18.022685 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b1a8c043-0f28-4e50-9108-32e4da1f8aa1 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068037 Oct 30 01:50:18.027856 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3120/6235] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 01:50:17 2022] GET /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:50:19.016761 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cf6c8b47-545c-459c-ab81-daf34d7101ca tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:50:19.017408 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-cf6c8b47-545c-459c-ab81-daf34d7101ca tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] [instance: ffd648ae-9abd-4906-8b40-c398878310eb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:50:19.029368 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cf6c8b47-545c-459c-ab81-daf34d7101ca tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:19.030447 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cf6c8b47-545c-459c-ab81-daf34d7101ca tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:19.030943 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cf6c8b47-545c-459c-ab81-daf34d7101ca tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:19.031891 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cf6c8b47-545c-459c-ab81-daf34d7101ca tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:19.032373 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cf6c8b47-545c-459c-ab81-daf34d7101ca tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:19.032804 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cf6c8b47-545c-459c-ab81-daf34d7101ca tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:19.035298 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-10e3ee99-7652-43d7-b07c-bfc3af44f340 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:50:19.038164 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-10e3ee99-7652-43d7-b07c-bfc3af44f340 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: d5697528-7254-4540-bef5-9cc1a8432fdc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:50:19.054197 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-10e3ee99-7652-43d7-b07c-bfc3af44f340 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:19.054886 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-10e3ee99-7652-43d7-b07c-bfc3af44f340 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:19.055537 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-10e3ee99-7652-43d7-b07c-bfc3af44f340 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:19.056319 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-10e3ee99-7652-43d7-b07c-bfc3af44f340 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:19.059949 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-10e3ee99-7652-43d7-b07c-bfc3af44f340 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:19.070616 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-10e3ee99-7652-43d7-b07c-bfc3af44f340 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:19.071229 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-cf6c8b47-545c-459c-ab81-daf34d7101ca tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] [instance: ffd648ae-9abd-4906-8b40-c398878310eb] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:50:19.123793 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-10e3ee99-7652-43d7-b07c-bfc3af44f340 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092798 Oct 30 01:50:19.125024 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3121/6236] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 01:50:19 2022] GET /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:50:19.474457 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cf6c8b47-545c-459c-ab81-daf34d7101ca tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ffd648ae-9abd-4906-8b40-c398878310eb" status: 204 len: 0 microversion: 2.1 time: 0.462445 Oct 30 01:50:19.475311 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3116/6237] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:50:19 2022] DELETE /compute/v2.1/servers/ffd648ae-9abd-4906-8b40-c398878310eb => generated 0 bytes in 465 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:50:19.485695 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fb94cef0-85b4-4f24-9e3a-7707572ce39d tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:50:19.486822 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fb94cef0-85b4-4f24-9e3a-7707572ce39d tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] [instance: ffd648ae-9abd-4906-8b40-c398878310eb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:50:19.497772 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb94cef0-85b4-4f24-9e3a-7707572ce39d tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:19.504366 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb94cef0-85b4-4f24-9e3a-7707572ce39d tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:19.504829 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb94cef0-85b4-4f24-9e3a-7707572ce39d tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:19.505607 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb94cef0-85b4-4f24-9e3a-7707572ce39d tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:19.506365 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb94cef0-85b4-4f24-9e3a-7707572ce39d tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:19.515289 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb94cef0-85b4-4f24-9e3a-7707572ce39d tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:19.815002 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-fb94cef0-85b4-4f24-9e3a-7707572ce39d tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb21ecdda88d49b59e11a30b0f3afc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767edc5f9e7a4c81929df4fa8a12d94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:50:19.833961 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fb94cef0-85b4-4f24-9e3a-7707572ce39d tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd648ae-9abd-4906-8b40-c398878310eb" status: 200 len: 1514 microversion: 2.1 time: 0.353177 Oct 30 01:50:19.834902 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3122/6238] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:50:19 2022] GET /compute/v2.1/servers/ffd648ae-9abd-4906-8b40-c398878310eb => generated 1514 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:50:20.139701 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5e5f9c5f-e3b6-480f-898d-6b52944058dc tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:50:20.142145 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5e5f9c5f-e3b6-480f-898d-6b52944058dc tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: d5697528-7254-4540-bef5-9cc1a8432fdc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:50:20.169897 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5e5f9c5f-e3b6-480f-898d-6b52944058dc tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:20.171379 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5e5f9c5f-e3b6-480f-898d-6b52944058dc tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:20.172206 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5e5f9c5f-e3b6-480f-898d-6b52944058dc tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:20.173457 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5e5f9c5f-e3b6-480f-898d-6b52944058dc tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:20.174302 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5e5f9c5f-e3b6-480f-898d-6b52944058dc tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:20.174971 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5e5f9c5f-e3b6-480f-898d-6b52944058dc tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:20.265087 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5e5f9c5f-e3b6-480f-898d-6b52944058dc tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132121 Oct 30 01:50:20.266262 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3117/6239] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 01:50:20 2022] GET /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:50:20.861578 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0153f193-d3ab-4058-ad89-f491dea6a194 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:50:20.863410 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0153f193-d3ab-4058-ad89-f491dea6a194 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] [instance: ffd648ae-9abd-4906-8b40-c398878310eb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:50:20.875308 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0153f193-d3ab-4058-ad89-f491dea6a194 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:20.876160 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0153f193-d3ab-4058-ad89-f491dea6a194 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:20.876823 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0153f193-d3ab-4058-ad89-f491dea6a194 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:20.877978 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0153f193-d3ab-4058-ad89-f491dea6a194 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:20.878660 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0153f193-d3ab-4058-ad89-f491dea6a194 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:20.879311 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0153f193-d3ab-4058-ad89-f491dea6a194 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:21.051389 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0153f193-d3ab-4058-ad89-f491dea6a194 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb21ecdda88d49b59e11a30b0f3afc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767edc5f9e7a4c81929df4fa8a12d94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:50:21.059762 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0153f193-d3ab-4058-ad89-f491dea6a194 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd648ae-9abd-4906-8b40-c398878310eb" status: 200 len: 1514 microversion: 2.1 time: 0.202415 Oct 30 01:50:21.060848 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3123/6240] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:50:20 2022] GET /compute/v2.1/servers/ffd648ae-9abd-4906-8b40-c398878310eb => generated 1514 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:50:21.281724 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fe692e14-99db-42b2-a731-e538a9053774 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:50:21.284863 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-fe692e14-99db-42b2-a731-e538a9053774 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: d5697528-7254-4540-bef5-9cc1a8432fdc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:50:21.312469 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe692e14-99db-42b2-a731-e538a9053774 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:21.313219 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe692e14-99db-42b2-a731-e538a9053774 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:21.314227 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe692e14-99db-42b2-a731-e538a9053774 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:21.316605 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe692e14-99db-42b2-a731-e538a9053774 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:21.318064 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe692e14-99db-42b2-a731-e538a9053774 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:21.323019 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe692e14-99db-42b2-a731-e538a9053774 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:21.440516 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fe692e14-99db-42b2-a731-e538a9053774 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147332 Oct 30 01:50:21.447098 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3118/6241] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 01:50:21 2022] GET /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc/os-volume_attachments => generated 197 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:50:22.087842 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0bc4ec4d-9c69-4bb7-b5ec-5a032621f2fa tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:50:22.089043 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0bc4ec4d-9c69-4bb7-b5ec-5a032621f2fa tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] [instance: ffd648ae-9abd-4906-8b40-c398878310eb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:50:22.116596 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0bc4ec4d-9c69-4bb7-b5ec-5a032621f2fa tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:22.118589 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0bc4ec4d-9c69-4bb7-b5ec-5a032621f2fa tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:22.123980 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0bc4ec4d-9c69-4bb7-b5ec-5a032621f2fa tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:22.123980 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0bc4ec4d-9c69-4bb7-b5ec-5a032621f2fa tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:22.123980 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0bc4ec4d-9c69-4bb7-b5ec-5a032621f2fa tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:22.123980 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0bc4ec4d-9c69-4bb7-b5ec-5a032621f2fa tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:22.283628 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0bc4ec4d-9c69-4bb7-b5ec-5a032621f2fa tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb21ecdda88d49b59e11a30b0f3afc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767edc5f9e7a4c81929df4fa8a12d94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:50:22.308252 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0bc4ec4d-9c69-4bb7-b5ec-5a032621f2fa tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd648ae-9abd-4906-8b40-c398878310eb" status: 200 len: 1472 microversion: 2.1 time: 0.219509 Oct 30 01:50:22.308916 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3119/6242] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:50:22 2022] GET /compute/v2.1/servers/ffd648ae-9abd-4906-8b40-c398878310eb => generated 1472 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:50:22.382751 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-b22c3437-d62e-4137-a006-ed9fefe4583b req-c02bbe2e-64fe-4196-bd52-48ecb7a79081 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffd648ae-9abd-4906-8b40-c398878310eb", "name": "network-vif-deleted", "tag": "eef21b63-a56b-43f1-b58e-6b544c4ce632"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:50:22.404037 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-b22c3437-d62e-4137-a006-ed9fefe4583b req-c02bbe2e-64fe-4196-bd52-48ecb7a79081 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:22.404536 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-b22c3437-d62e-4137-a006-ed9fefe4583b req-c02bbe2e-64fe-4196-bd52-48ecb7a79081 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:22.408946 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-b22c3437-d62e-4137-a006-ed9fefe4583b req-c02bbe2e-64fe-4196-bd52-48ecb7a79081 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:22.419117 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-b22c3437-d62e-4137-a006-ed9fefe4583b req-c02bbe2e-64fe-4196-bd52-48ecb7a79081 service nova] Creating event network-vif-deleted:eef21b63-a56b-43f1-b58e-6b544c4ce632 for instance ffd648ae-9abd-4906-8b40-c398878310eb on n-h2-master-1 Oct 30 01:50:22.428374 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-b22c3437-d62e-4137-a006-ed9fefe4583b req-c02bbe2e-64fe-4196-bd52-48ecb7a79081 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.487562 Oct 30 01:50:22.429673 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3124/6243] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:50:22.461518 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-23040d45-7e59-47f6-8e1a-de7b6b8f5193 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:50:22.463707 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-23040d45-7e59-47f6-8e1a-de7b6b8f5193 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: d5697528-7254-4540-bef5-9cc1a8432fdc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:50:22.482057 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-23040d45-7e59-47f6-8e1a-de7b6b8f5193 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:22.482741 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-23040d45-7e59-47f6-8e1a-de7b6b8f5193 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:22.483333 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-23040d45-7e59-47f6-8e1a-de7b6b8f5193 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:22.484238 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-23040d45-7e59-47f6-8e1a-de7b6b8f5193 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:22.485070 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-23040d45-7e59-47f6-8e1a-de7b6b8f5193 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:22.485525 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-23040d45-7e59-47f6-8e1a-de7b6b8f5193 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:22.546058 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-23040d45-7e59-47f6-8e1a-de7b6b8f5193 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088541 Oct 30 01:50:22.555334 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3120/6244] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 01:50:22 2022] GET /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:50:23.342935 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f4874c41-2da3-4079-ad9a-70694d7063a1 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:50:23.344116 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f4874c41-2da3-4079-ad9a-70694d7063a1 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] [instance: ffd648ae-9abd-4906-8b40-c398878310eb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:50:23.359321 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f4874c41-2da3-4079-ad9a-70694d7063a1 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:23.360102 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f4874c41-2da3-4079-ad9a-70694d7063a1 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:23.360769 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f4874c41-2da3-4079-ad9a-70694d7063a1 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:23.361829 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f4874c41-2da3-4079-ad9a-70694d7063a1 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:23.363527 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f4874c41-2da3-4079-ad9a-70694d7063a1 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:23.369306 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f4874c41-2da3-4079-ad9a-70694d7063a1 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:23.394267 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-f4874c41-2da3-4079-ad9a-70694d7063a1 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] HTTP exception thrown: Instance ffd648ae-9abd-4906-8b40-c398878310eb could not be found. Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f4874c41-2da3-4079-ad9a-70694d7063a1 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Request method failure captured: Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/ffd648ae-9abd-4906-8b40-c398878310eb HTTP/1.1 Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdeJMuLgIk3Qce-9g5FdTdHKjaYL9BTmeGl-fU7t66Vaaei8MyKi2bLu1x5vZyu8NGbgMkNTsEjQOuOqdhWVQXdFnfOVXBNKgInNowjF160dRXxA7z8_Xi4HI_mKlnLZdpUQMkjShmM2H0dd65J4H6SOqS6BrDILhNKWRsnxuMyI6NI Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 767edc5f9e7a4c81929df4fa8a12d94b Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1784009539 Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/767edc5f9e7a4c81929df4fa8a12d94b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_767edc5f9e7a4c81929df4fa8a12d94b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/767edc5f9e7a4c81929df4fa8a12d94b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/767edc5f9e7a4c81929df4fa8a12d94b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-VolumesSnapshotTestJSON-1784009539 Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 767edc5f9e7a4c81929df4fa8a12d94b Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1784009539 Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-VolumesSnapshotTestJSON-1784009539-project Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: cb21ecdda88d49b59e11a30b0f3afc72 Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-VolumesSnapshotTestJSON-1784009539-project Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: exception: Instance ffd648ae-9abd-4906-8b40-c398878310eb could not be found. Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'ffd648ae-9abd-4906-8b40-c398878310eb'} Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffd648ae-9abd-4906-8b40-c398878310eb could not be found. Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffd648ae-9abd-4906-8b40-c398878310eb could not be found. Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:50:23.396066 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:50:23.400096 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:50:23.400096 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:50:23.400096 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:50:23.400096 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:50:23.400096 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:50:23.400096 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffd648ae-9abd-4906-8b40-c398878310eb could not be found. Oct 30 01:50:23.400096 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:50:23.400096 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f4874c41-2da3-4079-ad9a-70694d7063a1 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Returning 404 to user: Instance ffd648ae-9abd-4906-8b40-c398878310eb could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:50:23.400096 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f4874c41-2da3-4079-ad9a-70694d7063a1 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] 10.222.0.13 "GET /compute/v2.1/servers/ffd648ae-9abd-4906-8b40-c398878310eb" status: 404 len: 111 microversion: 2.1 time: 0.062155 Oct 30 01:50:23.400096 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3125/6245] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:50:23 2022] GET /compute/v2.1/servers/ffd648ae-9abd-4906-8b40-c398878310eb => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 01:50:23.565490 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e0c3c448-7963-44ff-a79f-65edbea69959 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:50:23.569491 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e0c3c448-7963-44ff-a79f-65edbea69959 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: d5697528-7254-4540-bef5-9cc1a8432fdc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:50:23.577797 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e0c3c448-7963-44ff-a79f-65edbea69959 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:23.579467 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e0c3c448-7963-44ff-a79f-65edbea69959 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:23.579467 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e0c3c448-7963-44ff-a79f-65edbea69959 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:23.579666 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e0c3c448-7963-44ff-a79f-65edbea69959 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:23.579959 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e0c3c448-7963-44ff-a79f-65edbea69959 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:23.580591 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e0c3c448-7963-44ff-a79f-65edbea69959 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:23.666674 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e0c3c448-7963-44ff-a79f-65edbea69959 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105605 Oct 30 01:50:23.669872 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3121/6246] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 01:50:23 2022] GET /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:50:24.679767 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b0f10cad-281d-4811-873d-41a5bc143989 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:50:24.687090 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b0f10cad-281d-4811-873d-41a5bc143989 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: d5697528-7254-4540-bef5-9cc1a8432fdc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:50:24.695024 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0f10cad-281d-4811-873d-41a5bc143989 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:24.698754 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0f10cad-281d-4811-873d-41a5bc143989 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:24.698754 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0f10cad-281d-4811-873d-41a5bc143989 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:24.698754 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0f10cad-281d-4811-873d-41a5bc143989 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:24.698754 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0f10cad-281d-4811-873d-41a5bc143989 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:24.698754 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0f10cad-281d-4811-873d-41a5bc143989 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:24.739478 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b0f10cad-281d-4811-873d-41a5bc143989 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064180 Oct 30 01:50:24.740054 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3126/6247] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 01:50:24 2022] GET /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:50:24.814723 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ca7490fc-dcb3-4e53-be3a-53b166150e22 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:50:24.820317 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ca7490fc-dcb3-4e53-be3a-53b166150e22 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: d5697528-7254-4540-bef5-9cc1a8432fdc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:50:24.824640 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ca7490fc-dcb3-4e53-be3a-53b166150e22 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:24.825173 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ca7490fc-dcb3-4e53-be3a-53b166150e22 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:24.825735 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ca7490fc-dcb3-4e53-be3a-53b166150e22 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:24.826469 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ca7490fc-dcb3-4e53-be3a-53b166150e22 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:24.826936 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ca7490fc-dcb3-4e53-be3a-53b166150e22 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:24.827390 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ca7490fc-dcb3-4e53-be3a-53b166150e22 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:24.866005 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ca7490fc-dcb3-4e53-be3a-53b166150e22 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: d5697528-7254-4540-bef5-9cc1a8432fdc] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:50:25.270849 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ca7490fc-dcb3-4e53-be3a-53b166150e22 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc" status: 204 len: 0 microversion: 2.1 time: 0.459823 Oct 30 01:50:25.271697 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3122/6248] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:50:24 2022] DELETE /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:50:25.280864 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d1440ca5-67a5-4dfa-bb1c-5798aed9c6f9 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:50:25.281754 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d1440ca5-67a5-4dfa-bb1c-5798aed9c6f9 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: d5697528-7254-4540-bef5-9cc1a8432fdc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:50:25.288145 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1440ca5-67a5-4dfa-bb1c-5798aed9c6f9 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:25.288666 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1440ca5-67a5-4dfa-bb1c-5798aed9c6f9 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:25.289408 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1440ca5-67a5-4dfa-bb1c-5798aed9c6f9 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:25.290670 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1440ca5-67a5-4dfa-bb1c-5798aed9c6f9 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:25.292402 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1440ca5-67a5-4dfa-bb1c-5798aed9c6f9 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:25.293406 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1440ca5-67a5-4dfa-bb1c-5798aed9c6f9 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:25.450527 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d1440ca5-67a5-4dfa-bb1c-5798aed9c6f9 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:50:25.464457 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d1440ca5-67a5-4dfa-bb1c-5798aed9c6f9 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc" status: 200 len: 1679 microversion: 2.1 time: 0.187841 Oct 30 01:50:25.465045 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3127/6249] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:50:25 2022] GET /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc => generated 1679 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:50:26.489643 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8c0fd13c-d882-452c-814d-29003c4a43e4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:50:26.490339 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8c0fd13c-d882-452c-814d-29003c4a43e4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: d5697528-7254-4540-bef5-9cc1a8432fdc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:50:26.499702 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8c0fd13c-d882-452c-814d-29003c4a43e4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:26.500477 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8c0fd13c-d882-452c-814d-29003c4a43e4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:26.501083 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8c0fd13c-d882-452c-814d-29003c4a43e4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:26.501823 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8c0fd13c-d882-452c-814d-29003c4a43e4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:26.502268 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8c0fd13c-d882-452c-814d-29003c4a43e4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:26.502871 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8c0fd13c-d882-452c-814d-29003c4a43e4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:26.773754 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8c0fd13c-d882-452c-814d-29003c4a43e4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:50:26.784631 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8c0fd13c-d882-452c-814d-29003c4a43e4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc" status: 200 len: 1679 microversion: 2.1 time: 0.299118 Oct 30 01:50:26.798344 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3123/6250] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:50:26 2022] GET /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc => generated 1679 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:50:27.812519 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-20ece783-f0f4-45e2-989d-f461dc19dfd6 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:50:27.813831 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-20ece783-f0f4-45e2-989d-f461dc19dfd6 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: d5697528-7254-4540-bef5-9cc1a8432fdc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:50:27.827389 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-20ece783-f0f4-45e2-989d-f461dc19dfd6 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:27.829729 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-20ece783-f0f4-45e2-989d-f461dc19dfd6 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:27.832249 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-20ece783-f0f4-45e2-989d-f461dc19dfd6 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:27.834436 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-20ece783-f0f4-45e2-989d-f461dc19dfd6 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:27.835450 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-20ece783-f0f4-45e2-989d-f461dc19dfd6 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:27.836550 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-20ece783-f0f4-45e2-989d-f461dc19dfd6 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:28.405131 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-20ece783-f0f4-45e2-989d-f461dc19dfd6 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:50:28.418685 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-20ece783-f0f4-45e2-989d-f461dc19dfd6 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc" status: 200 len: 1679 microversion: 2.1 time: 0.611400 Oct 30 01:50:28.419825 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3128/6251] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:50:27 2022] GET /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc => generated 1679 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:50:29.444969 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-40ad15ac-7a33-461e-abdc-7e19d1080db3 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:50:29.446177 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-40ad15ac-7a33-461e-abdc-7e19d1080db3 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: d5697528-7254-4540-bef5-9cc1a8432fdc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:50:29.463079 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-40ad15ac-7a33-461e-abdc-7e19d1080db3 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:29.463604 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-40ad15ac-7a33-461e-abdc-7e19d1080db3 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:29.464056 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-40ad15ac-7a33-461e-abdc-7e19d1080db3 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:29.466553 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-40ad15ac-7a33-461e-abdc-7e19d1080db3 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:29.469415 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-40ad15ac-7a33-461e-abdc-7e19d1080db3 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:29.470263 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-40ad15ac-7a33-461e-abdc-7e19d1080db3 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:29.710136 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-40ad15ac-7a33-461e-abdc-7e19d1080db3 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:50:29.726625 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-40ad15ac-7a33-461e-abdc-7e19d1080db3 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc" status: 200 len: 1611 microversion: 2.1 time: 0.285895 Oct 30 01:50:29.727225 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3124/6252] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:50:29 2022] GET /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc => generated 1611 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:50:29.910822 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-9ff817f8-a602-4bab-8135-a7be7ae46e15 req-97fc3d19-ac03-4fe9-801e-342fbf55b106 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5697528-7254-4540-bef5-9cc1a8432fdc", "name": "network-vif-deleted", "tag": "88a6f688-b738-4cfa-bc7c-2b8f0a35c930"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:50:29.927212 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-9ff817f8-a602-4bab-8135-a7be7ae46e15 req-97fc3d19-ac03-4fe9-801e-342fbf55b106 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:29.927698 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-9ff817f8-a602-4bab-8135-a7be7ae46e15 req-97fc3d19-ac03-4fe9-801e-342fbf55b106 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:29.928701 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-9ff817f8-a602-4bab-8135-a7be7ae46e15 req-97fc3d19-ac03-4fe9-801e-342fbf55b106 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:29.952851 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-9ff817f8-a602-4bab-8135-a7be7ae46e15 req-97fc3d19-ac03-4fe9-801e-342fbf55b106 service nova] Creating event network-vif-deleted:88a6f688-b738-4cfa-bc7c-2b8f0a35c930 for instance d5697528-7254-4540-bef5-9cc1a8432fdc on n-h1-master-1 Oct 30 01:50:29.963193 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-9ff817f8-a602-4bab-8135-a7be7ae46e15 req-97fc3d19-ac03-4fe9-801e-342fbf55b106 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075730 Oct 30 01:50:29.963193 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3129/6253] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:50:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:50:30.764209 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b3f895d5-2bcf-4ac5-b3dd-679ef4ac6226 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:50:30.764209 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b3f895d5-2bcf-4ac5-b3dd-679ef4ac6226 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: d5697528-7254-4540-bef5-9cc1a8432fdc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:50:30.792922 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3f895d5-2bcf-4ac5-b3dd-679ef4ac6226 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:30.793663 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3f895d5-2bcf-4ac5-b3dd-679ef4ac6226 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:30.800399 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3f895d5-2bcf-4ac5-b3dd-679ef4ac6226 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:30.803743 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3f895d5-2bcf-4ac5-b3dd-679ef4ac6226 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:30.804568 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3f895d5-2bcf-4ac5-b3dd-679ef4ac6226 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:30.810519 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3f895d5-2bcf-4ac5-b3dd-679ef4ac6226 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:30.835866 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:50:30.919605 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3f895d5-2bcf-4ac5-b3dd-679ef4ac6226 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:30.920538 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3f895d5-2bcf-4ac5-b3dd-679ef4ac6226 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:30.921228 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3f895d5-2bcf-4ac5-b3dd-679ef4ac6226 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:30.927501 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-b3f895d5-2bcf-4ac5-b3dd-679ef4ac6226 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lazy-loading 'fault' on Instance uuid d5697528-7254-4540-bef5-9cc1a8432fdc {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:50:31.063416 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b3f895d5-2bcf-4ac5-b3dd-679ef4ac6226 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb021152c684983b31e5db439518921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311cde01e89442f1ab3aa930070b7343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:50:31.082576 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b3f895d5-2bcf-4ac5-b3dd-679ef4ac6226 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc" status: 200 len: 1330 microversion: 2.1 time: 0.330040 Oct 30 01:50:31.097630 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3125/6254] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:50:30 2022] GET /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc => generated 1330 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:50:32.123378 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-99e2c32f-71c0-47f9-a9a4-1956f888c887 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:50:32.124797 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-99e2c32f-71c0-47f9-a9a4-1956f888c887 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: d5697528-7254-4540-bef5-9cc1a8432fdc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:50:32.142472 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-99e2c32f-71c0-47f9-a9a4-1956f888c887 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:32.143231 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-99e2c32f-71c0-47f9-a9a4-1956f888c887 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:32.143829 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-99e2c32f-71c0-47f9-a9a4-1956f888c887 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:32.144704 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-99e2c32f-71c0-47f9-a9a4-1956f888c887 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:32.145753 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-99e2c32f-71c0-47f9-a9a4-1956f888c887 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:32.150838 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-99e2c32f-71c0-47f9-a9a4-1956f888c887 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:32.176578 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-99e2c32f-71c0-47f9-a9a4-1956f888c887 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] HTTP exception thrown: Instance d5697528-7254-4540-bef5-9cc1a8432fdc could not be found. Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-99e2c32f-71c0-47f9-a9a4-1956f888c887 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Request method failure captured: Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc HTTP/1.1 Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdcRtc4GzHkShMdH9tTupejgTwf3ZNgIcyJqp9yicfp5OD1pJcQPZv1XBaNx7doePOAnkL0JpoIe5_T8iLiz5QjNjR1hpdjjFconMkrxU8FPHulGdRMQx61K_rAf0z9mDPUn9FfJ2msqRaRZPanWCScsW3BEB8X_vbKTz8C4TVCF-Ys Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 311cde01e89442f1ab3aa930070b7343 Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-AttachVolumeNegativeTest-812748574 Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/311cde01e89442f1ab3aa930070b7343"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_311cde01e89442f1ab3aa930070b7343"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/311cde01e89442f1ab3aa930070b7343"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/311cde01e89442f1ab3aa930070b7343"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-AttachVolumeNegativeTest-812748574 Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 311cde01e89442f1ab3aa930070b7343 Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-812748574 Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-AttachVolumeNegativeTest-812748574-project Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: dcb021152c684983b31e5db439518921 Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-AttachVolumeNegativeTest-812748574-project Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: exception: Instance d5697528-7254-4540-bef5-9cc1a8432fdc could not be found. Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'd5697528-7254-4540-bef5-9cc1a8432fdc'} Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5697528-7254-4540-bef5-9cc1a8432fdc could not be found. Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5697528-7254-4540-bef5-9cc1a8432fdc could not be found. Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:50:32.183358 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:50:32.187037 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:50:32.187037 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:50:32.187037 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:50:32.187037 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:50:32.187037 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:50:32.187037 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5697528-7254-4540-bef5-9cc1a8432fdc could not be found. Oct 30 01:50:32.187037 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:50:32.191740 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-99e2c32f-71c0-47f9-a9a4-1956f888c887 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Returning 404 to user: Instance d5697528-7254-4540-bef5-9cc1a8432fdc could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:50:32.193287 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-99e2c32f-71c0-47f9-a9a4-1956f888c887 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc" status: 404 len: 111 microversion: 2.1 time: 0.076748 Oct 30 01:50:32.194074 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3130/6255] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:50:32 2022] GET /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 01:50:32.206261 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d621eb07-1874-423e-8ca1-534160186dc2 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '.version_select at 0x7f44c6f4c700>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:50:32.318519 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d621eb07-1874-423e-8ca1-534160186dc2 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-304745793" status: 202 len: 0 microversion: 2.1 time: 0.118989 Oct 30 01:50:32.320815 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3126/6256] 10.222.0.13 () {58 vars in 1218 bytes} [Sun Oct 30 01:50:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-304745793 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:50:33.811000 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c553381f-32fa-4835-89ed-61faf5b110a7 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1971843707", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "fd08bcb3-8b91-4f90-a2f0-4a84bf28c8ee"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:50:33.882028 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-c553381f-32fa-4835-89ed-61faf5b110a7 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] validate_networks() for [('fd08bcb3-8b91-4f90-a2f0-4a84bf28c8ee', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:50:34.843911 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-c553381f-32fa-4835-89ed-61faf5b110a7 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:50:34.845369 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-c553381f-32fa-4835-89ed-61faf5b110a7 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:50:34.846596 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-c553381f-32fa-4835-89ed-61faf5b110a7 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:50:34.847429 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-c553381f-32fa-4835-89ed-61faf5b110a7 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:50:34.853741 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-c553381f-32fa-4835-89ed-61faf5b110a7 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:50:34.876413 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c553381f-32fa-4835-89ed-61faf5b110a7 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:34.877702 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c553381f-32fa-4835-89ed-61faf5b110a7 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:34.881092 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c553381f-32fa-4835-89ed-61faf5b110a7 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:34.887535 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c553381f-32fa-4835-89ed-61faf5b110a7 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:34.887535 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c553381f-32fa-4835-89ed-61faf5b110a7 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:34.887535 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c553381f-32fa-4835-89ed-61faf5b110a7 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:34.917978 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-c553381f-32fa-4835-89ed-61faf5b110a7 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Getting quotas for project 767edc5f9e7a4c81929df4fa8a12d94b. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:50:34.927651 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-c553381f-32fa-4835-89ed-61faf5b110a7 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Getting quotas for user cb21ecdda88d49b59e11a30b0f3afc72 and project 767edc5f9e7a4c81929df4fa8a12d94b. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:50:34.953202 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c553381f-32fa-4835-89ed-61faf5b110a7 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:50:34.956636 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c553381f-32fa-4835-89ed-61faf5b110a7 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] [instance: 2da44c38-67a1-416e-847b-4a848c1bb4ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:50:35.145362 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c553381f-32fa-4835-89ed-61faf5b110a7 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.338656 Oct 30 01:50:35.146761 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3131/6257] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:50:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1341 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:50:35.159166 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fd9e3d0e-0ac3-4a32-ba3d-08e2d35bfb01 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:50:35.160876 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-fd9e3d0e-0ac3-4a32-ba3d-08e2d35bfb01 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] [instance: 2da44c38-67a1-416e-847b-4a848c1bb4ec] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:50:35.252292 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-fd9e3d0e-0ac3-4a32-ba3d-08e2d35bfb01 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb21ecdda88d49b59e11a30b0f3afc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767edc5f9e7a4c81929df4fa8a12d94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:50:35.265062 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fd9e3d0e-0ac3-4a32-ba3d-08e2d35bfb01 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] 10.222.0.13 "GET /compute/v2.1/servers/2da44c38-67a1-416e-847b-4a848c1bb4ec" status: 200 len: 1219 microversion: 2.1 time: 0.108195 Oct 30 01:50:35.267659 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3127/6258] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:50:35 2022] GET /compute/v2.1/servers/2da44c38-67a1-416e-847b-4a848c1bb4ec => generated 1219 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:50:36.292489 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-602301b9-fbf6-4644-a28e-c983eff2a286 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:50:36.293814 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-602301b9-fbf6-4644-a28e-c983eff2a286 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] [instance: 2da44c38-67a1-416e-847b-4a848c1bb4ec] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:50:36.503424 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-602301b9-fbf6-4644-a28e-c983eff2a286 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb21ecdda88d49b59e11a30b0f3afc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767edc5f9e7a4c81929df4fa8a12d94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:50:36.514805 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-602301b9-fbf6-4644-a28e-c983eff2a286 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] 10.222.0.13 "GET /compute/v2.1/servers/2da44c38-67a1-416e-847b-4a848c1bb4ec" status: 200 len: 1219 microversion: 2.1 time: 0.227782 Oct 30 01:50:36.515984 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3132/6259] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:50:36 2022] GET /compute/v2.1/servers/2da44c38-67a1-416e-847b-4a848c1bb4ec => generated 1219 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:50:37.540215 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d2a1db88-f9ab-4a44-b150-203ef2305f7b tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:50:37.541409 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d2a1db88-f9ab-4a44-b150-203ef2305f7b tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] [instance: 2da44c38-67a1-416e-847b-4a848c1bb4ec] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:50:37.549423 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d2a1db88-f9ab-4a44-b150-203ef2305f7b tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:37.550202 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d2a1db88-f9ab-4a44-b150-203ef2305f7b tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:37.551048 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d2a1db88-f9ab-4a44-b150-203ef2305f7b tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:37.551925 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d2a1db88-f9ab-4a44-b150-203ef2305f7b tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:37.552528 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d2a1db88-f9ab-4a44-b150-203ef2305f7b tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:37.553255 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d2a1db88-f9ab-4a44-b150-203ef2305f7b tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:37.682680 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d2a1db88-f9ab-4a44-b150-203ef2305f7b tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb21ecdda88d49b59e11a30b0f3afc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767edc5f9e7a4c81929df4fa8a12d94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:50:37.700370 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d2a1db88-f9ab-4a44-b150-203ef2305f7b tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] 10.222.0.13 "GET /compute/v2.1/servers/2da44c38-67a1-416e-847b-4a848c1bb4ec" status: 200 len: 1223 microversion: 2.1 time: 0.156387 Oct 30 01:50:37.701474 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3128/6260] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:50:37 2022] GET /compute/v2.1/servers/2da44c38-67a1-416e-847b-4a848c1bb4ec => generated 1223 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:50:38.726618 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-349279c6-a947-47d3-9a20-1e282bd0d39f tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:50:38.735746 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-349279c6-a947-47d3-9a20-1e282bd0d39f tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] [instance: 2da44c38-67a1-416e-847b-4a848c1bb4ec] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:50:38.753031 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-349279c6-a947-47d3-9a20-1e282bd0d39f tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:38.761043 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-349279c6-a947-47d3-9a20-1e282bd0d39f tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:38.761877 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-349279c6-a947-47d3-9a20-1e282bd0d39f tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:38.764473 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-349279c6-a947-47d3-9a20-1e282bd0d39f tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:38.767957 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-349279c6-a947-47d3-9a20-1e282bd0d39f tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:38.768455 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-349279c6-a947-47d3-9a20-1e282bd0d39f tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:38.910668 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-10b5e441-eeef-46f0-a19e-76dbb6b17666 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:50:38.911234 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-10b5e441-eeef-46f0-a19e-76dbb6b17666 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: d5697528-7254-4540-bef5-9cc1a8432fdc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:50:38.926696 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-10b5e441-eeef-46f0-a19e-76dbb6b17666 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:38.927268 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-10b5e441-eeef-46f0-a19e-76dbb6b17666 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:38.927765 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-10b5e441-eeef-46f0-a19e-76dbb6b17666 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:38.929625 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-10b5e441-eeef-46f0-a19e-76dbb6b17666 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:38.930136 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-10b5e441-eeef-46f0-a19e-76dbb6b17666 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:38.930584 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-10b5e441-eeef-46f0-a19e-76dbb6b17666 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:38.938580 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-349279c6-a947-47d3-9a20-1e282bd0d39f tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb21ecdda88d49b59e11a30b0f3afc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767edc5f9e7a4c81929df4fa8a12d94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:50:38.975044 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-349279c6-a947-47d3-9a20-1e282bd0d39f tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] 10.222.0.13 "GET /compute/v2.1/servers/2da44c38-67a1-416e-847b-4a848c1bb4ec" status: 200 len: 1271 microversion: 2.1 time: 0.254018 Oct 30 01:50:38.977419 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3133/6261] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:50:38 2022] GET /compute/v2.1/servers/2da44c38-67a1-416e-847b-4a848c1bb4ec => generated 1271 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:50:39.013916 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-10b5e441-eeef-46f0-a19e-76dbb6b17666 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] HTTP exception thrown: Instance d5697528-7254-4540-bef5-9cc1a8432fdc could not be found. Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-10b5e441-eeef-46f0-a19e-76dbb6b17666 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Request method failure captured: Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: request: DELETE /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc HTTP/1.1 Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdcRtc4GzHkShMdH9tTupejgTwf3ZNgIcyJqp9yicfp5OD1pJcQPZv1XBaNx7doePOAnkL0JpoIe5_T8iLiz5QjNjR1hpdjjFconMkrxU8FPHulGdRMQx61K_rAf0z9mDPUn9FfJ2msqRaRZPanWCScsW3BEB8X_vbKTz8C4TVCF-Ys Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 311cde01e89442f1ab3aa930070b7343 Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-AttachVolumeNegativeTest-812748574 Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/311cde01e89442f1ab3aa930070b7343"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_311cde01e89442f1ab3aa930070b7343"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/311cde01e89442f1ab3aa930070b7343"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/311cde01e89442f1ab3aa930070b7343"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-AttachVolumeNegativeTest-812748574 Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 311cde01e89442f1ab3aa930070b7343 Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-812748574 Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-AttachVolumeNegativeTest-812748574-project Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: dcb021152c684983b31e5db439518921 Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-AttachVolumeNegativeTest-812748574-project Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: exception: Instance d5697528-7254-4540-bef5-9cc1a8432fdc could not be found. Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'd5697528-7254-4540-bef5-9cc1a8432fdc'} Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5697528-7254-4540-bef5-9cc1a8432fdc could not be found. Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:50:39.019293 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:50:39.023574 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5697528-7254-4540-bef5-9cc1a8432fdc could not be found. Oct 30 01:50:39.023574 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:50:39.023574 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:50:39.023574 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:50:39.023574 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:50:39.023574 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:50:39.023574 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:50:39.023574 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:50:39.023574 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:50:39.023574 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5697528-7254-4540-bef5-9cc1a8432fdc could not be found. Oct 30 01:50:39.023574 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:50:39.028366 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-10b5e441-eeef-46f0-a19e-76dbb6b17666 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Returning 404 to user: Instance d5697528-7254-4540-bef5-9cc1a8432fdc could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:50:39.038823 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-10b5e441-eeef-46f0-a19e-76dbb6b17666 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc" status: 404 len: 111 microversion: 2.1 time: 0.130903 Oct 30 01:50:39.042556 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3129/6262] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:50:38 2022] DELETE /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:50:39.057548 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bdd1c28b-a619-4c91-afa2-d05946ab5749 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:50:39.059145 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bdd1c28b-a619-4c91-afa2-d05946ab5749 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: d5697528-7254-4540-bef5-9cc1a8432fdc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:50:39.071253 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bdd1c28b-a619-4c91-afa2-d05946ab5749 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:39.073936 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bdd1c28b-a619-4c91-afa2-d05946ab5749 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:39.077868 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bdd1c28b-a619-4c91-afa2-d05946ab5749 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:39.079633 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bdd1c28b-a619-4c91-afa2-d05946ab5749 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:39.080297 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bdd1c28b-a619-4c91-afa2-d05946ab5749 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:39.081149 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bdd1c28b-a619-4c91-afa2-d05946ab5749 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:39.179825 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-bdd1c28b-a619-4c91-afa2-d05946ab5749 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] HTTP exception thrown: Instance d5697528-7254-4540-bef5-9cc1a8432fdc could not be found. Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bdd1c28b-a619-4c91-afa2-d05946ab5749 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Request method failure captured: Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc HTTP/1.1 Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdcRtc4GzHkShMdH9tTupejgTwf3ZNgIcyJqp9yicfp5OD1pJcQPZv1XBaNx7doePOAnkL0JpoIe5_T8iLiz5QjNjR1hpdjjFconMkrxU8FPHulGdRMQx61K_rAf0z9mDPUn9FfJ2msqRaRZPanWCScsW3BEB8X_vbKTz8C4TVCF-Ys Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 311cde01e89442f1ab3aa930070b7343 Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-AttachVolumeNegativeTest-812748574 Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/311cde01e89442f1ab3aa930070b7343"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_311cde01e89442f1ab3aa930070b7343"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/311cde01e89442f1ab3aa930070b7343"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/311cde01e89442f1ab3aa930070b7343"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-AttachVolumeNegativeTest-812748574 Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 311cde01e89442f1ab3aa930070b7343 Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-812748574 Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-AttachVolumeNegativeTest-812748574-project Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: dcb021152c684983b31e5db439518921 Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-AttachVolumeNegativeTest-812748574-project Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: exception: Instance d5697528-7254-4540-bef5-9cc1a8432fdc could not be found. Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'd5697528-7254-4540-bef5-9cc1a8432fdc'} Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5697528-7254-4540-bef5-9cc1a8432fdc could not be found. Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5697528-7254-4540-bef5-9cc1a8432fdc could not be found. Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:50:39.186969 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:50:39.190909 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:50:39.190909 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:50:39.190909 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:50:39.190909 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:50:39.190909 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:50:39.190909 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5697528-7254-4540-bef5-9cc1a8432fdc could not be found. Oct 30 01:50:39.190909 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:50:39.192137 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bdd1c28b-a619-4c91-afa2-d05946ab5749 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Returning 404 to user: Instance d5697528-7254-4540-bef5-9cc1a8432fdc could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:50:39.193707 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bdd1c28b-a619-4c91-afa2-d05946ab5749 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc" status: 404 len: 111 microversion: 2.1 time: 0.145981 Oct 30 01:50:39.202262 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3134/6263] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:50:39 2022] GET /compute/v2.1/servers/d5697528-7254-4540-bef5-9cc1a8432fdc => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:50:40.014200 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-38748b97-cfc1-4c74-8db8-20f1d23d5a03 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:50:40.015594 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-38748b97-cfc1-4c74-8db8-20f1d23d5a03 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] [instance: 2da44c38-67a1-416e-847b-4a848c1bb4ec] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:50:40.026074 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38748b97-cfc1-4c74-8db8-20f1d23d5a03 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:40.029915 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38748b97-cfc1-4c74-8db8-20f1d23d5a03 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:40.029915 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38748b97-cfc1-4c74-8db8-20f1d23d5a03 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:40.039229 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38748b97-cfc1-4c74-8db8-20f1d23d5a03 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:40.039897 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38748b97-cfc1-4c74-8db8-20f1d23d5a03 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:40.040525 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38748b97-cfc1-4c74-8db8-20f1d23d5a03 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:40.200177 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-38748b97-cfc1-4c74-8db8-20f1d23d5a03 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb21ecdda88d49b59e11a30b0f3afc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767edc5f9e7a4c81929df4fa8a12d94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:50:40.214415 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-38748b97-cfc1-4c74-8db8-20f1d23d5a03 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] 10.222.0.13 "GET /compute/v2.1/servers/2da44c38-67a1-416e-847b-4a848c1bb4ec" status: 200 len: 1277 microversion: 2.1 time: 0.213896 Oct 30 01:50:40.215011 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3130/6264] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:50:39 2022] GET /compute/v2.1/servers/2da44c38-67a1-416e-847b-4a848c1bb4ec => generated 1277 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:50:41.238888 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-761e8164-fb9e-439b-93c5-70c0d5850a99 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:50:41.240033 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-761e8164-fb9e-439b-93c5-70c0d5850a99 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] [instance: 2da44c38-67a1-416e-847b-4a848c1bb4ec] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:50:41.252933 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-761e8164-fb9e-439b-93c5-70c0d5850a99 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:41.253468 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-761e8164-fb9e-439b-93c5-70c0d5850a99 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:41.253914 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-761e8164-fb9e-439b-93c5-70c0d5850a99 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:41.254636 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-761e8164-fb9e-439b-93c5-70c0d5850a99 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:41.265771 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-761e8164-fb9e-439b-93c5-70c0d5850a99 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:41.272039 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-761e8164-fb9e-439b-93c5-70c0d5850a99 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:41.608689 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-761e8164-fb9e-439b-93c5-70c0d5850a99 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb21ecdda88d49b59e11a30b0f3afc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767edc5f9e7a4c81929df4fa8a12d94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:50:41.623104 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-761e8164-fb9e-439b-93c5-70c0d5850a99 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] 10.222.0.13 "GET /compute/v2.1/servers/2da44c38-67a1-416e-847b-4a848c1bb4ec" status: 200 len: 1319 microversion: 2.1 time: 0.388130 Oct 30 01:50:41.624204 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3135/6265] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:50:41 2022] GET /compute/v2.1/servers/2da44c38-67a1-416e-847b-4a848c1bb4ec => generated 1319 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:50:42.646403 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2af801a5-d619-487d-9106-621764322aca tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:50:42.647038 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2af801a5-d619-487d-9106-621764322aca tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] [instance: 2da44c38-67a1-416e-847b-4a848c1bb4ec] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:50:42.655520 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2af801a5-d619-487d-9106-621764322aca tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:42.661846 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2af801a5-d619-487d-9106-621764322aca tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:42.661846 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2af801a5-d619-487d-9106-621764322aca tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:42.661846 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2af801a5-d619-487d-9106-621764322aca tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:42.661846 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2af801a5-d619-487d-9106-621764322aca tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:42.661846 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2af801a5-d619-487d-9106-621764322aca tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:42.908063 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-56759bd3-42c8-42ff-8c67-1c22537a3d4e req-64f46898-8e2f-4853-98d0-22e14cec683e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2da44c38-67a1-416e-847b-4a848c1bb4ec", "tag": "7004236e-2948-4d0d-a11b-f39d518f397c"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:50:42.928925 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-56759bd3-42c8-42ff-8c67-1c22537a3d4e req-64f46898-8e2f-4853-98d0-22e14cec683e service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:42.931733 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-56759bd3-42c8-42ff-8c67-1c22537a3d4e req-64f46898-8e2f-4853-98d0-22e14cec683e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:42.933534 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-56759bd3-42c8-42ff-8c67-1c22537a3d4e req-64f46898-8e2f-4853-98d0-22e14cec683e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:42.961543 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-56759bd3-42c8-42ff-8c67-1c22537a3d4e req-64f46898-8e2f-4853-98d0-22e14cec683e service nova] Creating event network-changed:7004236e-2948-4d0d-a11b-f39d518f397c for instance 2da44c38-67a1-416e-847b-4a848c1bb4ec on n-h2-master-1 Oct 30 01:50:42.972556 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-56759bd3-42c8-42ff-8c67-1c22537a3d4e req-64f46898-8e2f-4853-98d0-22e14cec683e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068616 Oct 30 01:50:42.975271 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3136/6266] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:50:43.340844 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2af801a5-d619-487d-9106-621764322aca tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb21ecdda88d49b59e11a30b0f3afc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767edc5f9e7a4c81929df4fa8a12d94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:50:43.352785 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2af801a5-d619-487d-9106-621764322aca tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] 10.222.0.13 "GET /compute/v2.1/servers/2da44c38-67a1-416e-847b-4a848c1bb4ec" status: 200 len: 1319 microversion: 2.1 time: 0.710185 Oct 30 01:50:43.358304 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3131/6267] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:50:42 2022] GET /compute/v2.1/servers/2da44c38-67a1-416e-847b-4a848c1bb4ec => generated 1319 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:50:44.383695 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8957603d-2ebf-42aa-929f-1c725350aafe tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:50:44.385600 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8957603d-2ebf-42aa-929f-1c725350aafe tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] [instance: 2da44c38-67a1-416e-847b-4a848c1bb4ec] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:50:44.401654 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:50:44.404897 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8957603d-2ebf-42aa-929f-1c725350aafe tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:44.405416 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8957603d-2ebf-42aa-929f-1c725350aafe tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:44.407267 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8957603d-2ebf-42aa-929f-1c725350aafe tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:44.409509 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8957603d-2ebf-42aa-929f-1c725350aafe tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:44.411297 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8957603d-2ebf-42aa-929f-1c725350aafe tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:44.411726 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8957603d-2ebf-42aa-929f-1c725350aafe tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:44.418662 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=82,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:50:44.588828 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8957603d-2ebf-42aa-929f-1c725350aafe tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb21ecdda88d49b59e11a30b0f3afc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767edc5f9e7a4c81929df4fa8a12d94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:50:44.602059 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8957603d-2ebf-42aa-929f-1c725350aafe tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] 10.222.0.13 "GET /compute/v2.1/servers/2da44c38-67a1-416e-847b-4a848c1bb4ec" status: 200 len: 1319 microversion: 2.1 time: 0.224948 Oct 30 01:50:44.603413 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3137/6268] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:50:44 2022] GET /compute/v2.1/servers/2da44c38-67a1-416e-847b-4a848c1bb4ec => generated 1319 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:50:45.121240 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-eeeccc83-9df4-4e03-a0ea-96f37487aab9 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:50:45.126369 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-eeeccc83-9df4-4e03-a0ea-96f37487aab9 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: b1a11d01-7560-4d97-af75-2904cea5408f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:50:45.140725 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eeeccc83-9df4-4e03-a0ea-96f37487aab9 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:45.141485 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eeeccc83-9df4-4e03-a0ea-96f37487aab9 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:45.142024 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eeeccc83-9df4-4e03-a0ea-96f37487aab9 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:45.147603 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eeeccc83-9df4-4e03-a0ea-96f37487aab9 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:45.148343 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eeeccc83-9df4-4e03-a0ea-96f37487aab9 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:45.149016 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eeeccc83-9df4-4e03-a0ea-96f37487aab9 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:45.177501 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-eeeccc83-9df4-4e03-a0ea-96f37487aab9 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] HTTP exception thrown: Instance b1a11d01-7560-4d97-af75-2904cea5408f could not be found. Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-eeeccc83-9df4-4e03-a0ea-96f37487aab9 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Request method failure captured: Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: request: DELETE /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f HTTP/1.1 Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdcRtc4GzHkShMdH9tTupejgTwf3ZNgIcyJqp9yicfp5OD1pJcQPZv1XBaNx7doePOAnkL0JpoIe5_T8iLiz5QjNjR1hpdjjFconMkrxU8FPHulGdRMQx61K_rAf0z9mDPUn9FfJ2msqRaRZPanWCScsW3BEB8X_vbKTz8C4TVCF-Ys Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 311cde01e89442f1ab3aa930070b7343 Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-AttachVolumeNegativeTest-812748574 Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/311cde01e89442f1ab3aa930070b7343"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_311cde01e89442f1ab3aa930070b7343"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/311cde01e89442f1ab3aa930070b7343"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/311cde01e89442f1ab3aa930070b7343"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-AttachVolumeNegativeTest-812748574 Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 311cde01e89442f1ab3aa930070b7343 Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-812748574 Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-AttachVolumeNegativeTest-812748574-project Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: dcb021152c684983b31e5db439518921 Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-AttachVolumeNegativeTest-812748574-project Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: exception: Instance b1a11d01-7560-4d97-af75-2904cea5408f could not be found. Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'b1a11d01-7560-4d97-af75-2904cea5408f'} Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1a11d01-7560-4d97-af75-2904cea5408f could not be found. Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:50:45.184013 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:50:45.188687 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1a11d01-7560-4d97-af75-2904cea5408f could not be found. Oct 30 01:50:45.188687 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:50:45.188687 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:50:45.188687 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:50:45.188687 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:50:45.188687 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:50:45.188687 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:50:45.188687 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:50:45.188687 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:50:45.188687 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1a11d01-7560-4d97-af75-2904cea5408f could not be found. Oct 30 01:50:45.188687 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:50:45.195665 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-eeeccc83-9df4-4e03-a0ea-96f37487aab9 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Returning 404 to user: Instance b1a11d01-7560-4d97-af75-2904cea5408f could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:50:45.195665 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-eeeccc83-9df4-4e03-a0ea-96f37487aab9 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f" status: 404 len: 111 microversion: 2.1 time: 0.073971 Oct 30 01:50:45.195665 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3132/6269] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:50:45 2022] DELETE /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:50:45.206086 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-225802e4-b8fa-4c0e-ad20-04dabe5cd2f4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:50:45.207127 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-225802e4-b8fa-4c0e-ad20-04dabe5cd2f4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: b1a11d01-7560-4d97-af75-2904cea5408f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:50:45.217863 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:50:45.221954 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-225802e4-b8fa-4c0e-ad20-04dabe5cd2f4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:45.222458 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-225802e4-b8fa-4c0e-ad20-04dabe5cd2f4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:45.222930 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-225802e4-b8fa-4c0e-ad20-04dabe5cd2f4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:45.227867 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-225802e4-b8fa-4c0e-ad20-04dabe5cd2f4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:45.228494 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-225802e4-b8fa-4c0e-ad20-04dabe5cd2f4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:45.229206 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-225802e4-b8fa-4c0e-ad20-04dabe5cd2f4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:45.265803 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-225802e4-b8fa-4c0e-ad20-04dabe5cd2f4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] HTTP exception thrown: Instance b1a11d01-7560-4d97-af75-2904cea5408f could not be found. Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-225802e4-b8fa-4c0e-ad20-04dabe5cd2f4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Request method failure captured: Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f HTTP/1.1 Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdcRtc4GzHkShMdH9tTupejgTwf3ZNgIcyJqp9yicfp5OD1pJcQPZv1XBaNx7doePOAnkL0JpoIe5_T8iLiz5QjNjR1hpdjjFconMkrxU8FPHulGdRMQx61K_rAf0z9mDPUn9FfJ2msqRaRZPanWCScsW3BEB8X_vbKTz8C4TVCF-Ys Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 311cde01e89442f1ab3aa930070b7343 Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-AttachVolumeNegativeTest-812748574 Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/311cde01e89442f1ab3aa930070b7343"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_311cde01e89442f1ab3aa930070b7343"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/311cde01e89442f1ab3aa930070b7343"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/311cde01e89442f1ab3aa930070b7343"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-AttachVolumeNegativeTest-812748574 Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 311cde01e89442f1ab3aa930070b7343 Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-812748574 Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-AttachVolumeNegativeTest-812748574-project Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: dcb021152c684983b31e5db439518921 Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-AttachVolumeNegativeTest-812748574-project Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: exception: Instance b1a11d01-7560-4d97-af75-2904cea5408f could not be found. Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'b1a11d01-7560-4d97-af75-2904cea5408f'} Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1a11d01-7560-4d97-af75-2904cea5408f could not be found. Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1a11d01-7560-4d97-af75-2904cea5408f could not be found. Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:50:45.269961 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:50:45.280267 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:50:45.280267 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:50:45.280267 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:50:45.280267 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:50:45.280267 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:50:45.280267 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1a11d01-7560-4d97-af75-2904cea5408f could not be found. Oct 30 01:50:45.280267 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:50:45.280267 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-225802e4-b8fa-4c0e-ad20-04dabe5cd2f4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Returning 404 to user: Instance b1a11d01-7560-4d97-af75-2904cea5408f could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:50:45.280267 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-225802e4-b8fa-4c0e-ad20-04dabe5cd2f4 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f" status: 404 len: 111 microversion: 2.1 time: 0.072609 Oct 30 01:50:45.280872 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:50:45.280959 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3138/6270] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:50:45 2022] GET /compute/v2.1/servers/b1a11d01-7560-4d97-af75-2904cea5408f => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:50:45.282899 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-de33240e-c803-40cd-b5e5-9fe47600b9eb tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:50:45.283586 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-de33240e-c803-40cd-b5e5-9fe47600b9eb tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 9408045e-5de5-45a4-9415-e270fd97dcdd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:50:45.292559 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de33240e-c803-40cd-b5e5-9fe47600b9eb tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:45.293059 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de33240e-c803-40cd-b5e5-9fe47600b9eb tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:45.294162 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de33240e-c803-40cd-b5e5-9fe47600b9eb tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:45.297241 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de33240e-c803-40cd-b5e5-9fe47600b9eb tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:45.297792 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de33240e-c803-40cd-b5e5-9fe47600b9eb tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:45.299960 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de33240e-c803-40cd-b5e5-9fe47600b9eb tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:45.334719 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-de33240e-c803-40cd-b5e5-9fe47600b9eb tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] HTTP exception thrown: Instance 9408045e-5de5-45a4-9415-e270fd97dcdd could not be found. Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-de33240e-c803-40cd-b5e5-9fe47600b9eb tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Request method failure captured: Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: request: DELETE /compute/v2.1/servers/9408045e-5de5-45a4-9415-e270fd97dcdd HTTP/1.1 Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdcRtc4GzHkShMdH9tTupejgTwf3ZNgIcyJqp9yicfp5OD1pJcQPZv1XBaNx7doePOAnkL0JpoIe5_T8iLiz5QjNjR1hpdjjFconMkrxU8FPHulGdRMQx61K_rAf0z9mDPUn9FfJ2msqRaRZPanWCScsW3BEB8X_vbKTz8C4TVCF-Ys Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 311cde01e89442f1ab3aa930070b7343 Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-AttachVolumeNegativeTest-812748574 Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/311cde01e89442f1ab3aa930070b7343"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_311cde01e89442f1ab3aa930070b7343"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/311cde01e89442f1ab3aa930070b7343"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/311cde01e89442f1ab3aa930070b7343"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-AttachVolumeNegativeTest-812748574 Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 311cde01e89442f1ab3aa930070b7343 Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-812748574 Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-AttachVolumeNegativeTest-812748574-project Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: dcb021152c684983b31e5db439518921 Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-AttachVolumeNegativeTest-812748574-project Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 9408045e-5de5-45a4-9415-e270fd97dcdd could not be found. Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '9408045e-5de5-45a4-9415-e270fd97dcdd'} Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9408045e-5de5-45a4-9415-e270fd97dcdd could not be found. Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:50:45.337829 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:50:45.341064 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9408045e-5de5-45a4-9415-e270fd97dcdd could not be found. Oct 30 01:50:45.341064 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:50:45.341064 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:50:45.341064 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:50:45.341064 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:50:45.341064 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:50:45.341064 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:50:45.341064 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:50:45.341064 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:50:45.341064 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9408045e-5de5-45a4-9415-e270fd97dcdd could not be found. Oct 30 01:50:45.341064 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:50:45.341064 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-de33240e-c803-40cd-b5e5-9fe47600b9eb tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Returning 404 to user: Instance 9408045e-5de5-45a4-9415-e270fd97dcdd could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:50:45.341064 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-de33240e-c803-40cd-b5e5-9fe47600b9eb tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9408045e-5de5-45a4-9415-e270fd97dcdd" status: 404 len: 111 microversion: 2.1 time: 0.061705 Oct 30 01:50:45.341064 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3133/6271] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:50:45 2022] DELETE /compute/v2.1/servers/9408045e-5de5-45a4-9415-e270fd97dcdd => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 01:50:45.349753 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a65e84e0-789a-4f86-860e-c21b8efef13c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:50:45.350365 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a65e84e0-789a-4f86-860e-c21b8efef13c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 9408045e-5de5-45a4-9415-e270fd97dcdd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:50:45.360427 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a65e84e0-789a-4f86-860e-c21b8efef13c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:45.360996 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a65e84e0-789a-4f86-860e-c21b8efef13c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:45.361595 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a65e84e0-789a-4f86-860e-c21b8efef13c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:45.362501 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a65e84e0-789a-4f86-860e-c21b8efef13c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:45.363692 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a65e84e0-789a-4f86-860e-c21b8efef13c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:45.364285 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a65e84e0-789a-4f86-860e-c21b8efef13c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:45.381783 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-a65e84e0-789a-4f86-860e-c21b8efef13c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] HTTP exception thrown: Instance 9408045e-5de5-45a4-9415-e270fd97dcdd could not be found. Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a65e84e0-789a-4f86-860e-c21b8efef13c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Request method failure captured: Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/9408045e-5de5-45a4-9415-e270fd97dcdd HTTP/1.1 Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdcRtc4GzHkShMdH9tTupejgTwf3ZNgIcyJqp9yicfp5OD1pJcQPZv1XBaNx7doePOAnkL0JpoIe5_T8iLiz5QjNjR1hpdjjFconMkrxU8FPHulGdRMQx61K_rAf0z9mDPUn9FfJ2msqRaRZPanWCScsW3BEB8X_vbKTz8C4TVCF-Ys Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 311cde01e89442f1ab3aa930070b7343 Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-AttachVolumeNegativeTest-812748574 Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/311cde01e89442f1ab3aa930070b7343"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_311cde01e89442f1ab3aa930070b7343"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/311cde01e89442f1ab3aa930070b7343"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/311cde01e89442f1ab3aa930070b7343"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-AttachVolumeNegativeTest-812748574 Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 311cde01e89442f1ab3aa930070b7343 Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-812748574 Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-AttachVolumeNegativeTest-812748574-project Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: dcb021152c684983b31e5db439518921 Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-AttachVolumeNegativeTest-812748574-project Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 9408045e-5de5-45a4-9415-e270fd97dcdd could not be found. Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '9408045e-5de5-45a4-9415-e270fd97dcdd'} Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9408045e-5de5-45a4-9415-e270fd97dcdd could not be found. Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9408045e-5de5-45a4-9415-e270fd97dcdd could not be found. Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:50:45.383589 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:50:45.389818 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:50:45.389818 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:50:45.389818 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:50:45.389818 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:50:45.389818 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:50:45.389818 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9408045e-5de5-45a4-9415-e270fd97dcdd could not be found. Oct 30 01:50:45.389818 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:50:45.390808 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a65e84e0-789a-4f86-860e-c21b8efef13c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Returning 404 to user: Instance 9408045e-5de5-45a4-9415-e270fd97dcdd could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:50:45.392017 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a65e84e0-789a-4f86-860e-c21b8efef13c tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/9408045e-5de5-45a4-9415-e270fd97dcdd" status: 404 len: 111 microversion: 2.1 time: 0.047868 Oct 30 01:50:45.392754 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3139/6272] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:50:45 2022] GET /compute/v2.1/servers/9408045e-5de5-45a4-9415-e270fd97dcdd => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:50:45.627867 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-08637534-3949-4109-8fb3-195f67ede15e tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:50:45.628691 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-08637534-3949-4109-8fb3-195f67ede15e tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] [instance: 2da44c38-67a1-416e-847b-4a848c1bb4ec] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:50:45.640697 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08637534-3949-4109-8fb3-195f67ede15e tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:45.641454 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08637534-3949-4109-8fb3-195f67ede15e tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:45.641676 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08637534-3949-4109-8fb3-195f67ede15e tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:45.642397 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08637534-3949-4109-8fb3-195f67ede15e tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:45.645840 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08637534-3949-4109-8fb3-195f67ede15e tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:45.646597 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08637534-3949-4109-8fb3-195f67ede15e tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:45.906736 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-08637534-3949-4109-8fb3-195f67ede15e tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb21ecdda88d49b59e11a30b0f3afc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767edc5f9e7a4c81929df4fa8a12d94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:50:45.919107 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-08637534-3949-4109-8fb3-195f67ede15e tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] 10.222.0.13 "GET /compute/v2.1/servers/2da44c38-67a1-416e-847b-4a848c1bb4ec" status: 200 len: 1319 microversion: 2.1 time: 0.297755 Oct 30 01:50:45.936859 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3134/6273] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:50:45 2022] GET /compute/v2.1/servers/2da44c38-67a1-416e-847b-4a848c1bb4ec => generated 1319 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:50:46.951366 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6085306f-7c29-40b4-8d4a-e06fca0f9336 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:50:46.952630 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6085306f-7c29-40b4-8d4a-e06fca0f9336 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] [instance: 2da44c38-67a1-416e-847b-4a848c1bb4ec] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:50:46.960601 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=8 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:50:46.963310 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6085306f-7c29-40b4-8d4a-e06fca0f9336 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:46.963973 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6085306f-7c29-40b4-8d4a-e06fca0f9336 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:46.965446 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6085306f-7c29-40b4-8d4a-e06fca0f9336 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:46.966378 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6085306f-7c29-40b4-8d4a-e06fca0f9336 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:46.967046 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6085306f-7c29-40b4-8d4a-e06fca0f9336 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:46.967656 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6085306f-7c29-40b4-8d4a-e06fca0f9336 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:47.190424 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6085306f-7c29-40b4-8d4a-e06fca0f9336 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb21ecdda88d49b59e11a30b0f3afc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767edc5f9e7a4c81929df4fa8a12d94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:50:47.207411 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6085306f-7c29-40b4-8d4a-e06fca0f9336 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] 10.222.0.13 "GET /compute/v2.1/servers/2da44c38-67a1-416e-847b-4a848c1bb4ec" status: 200 len: 1319 microversion: 2.1 time: 0.261230 Oct 30 01:50:47.226560 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3140/6274] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:50:46 2022] GET /compute/v2.1/servers/2da44c38-67a1-416e-847b-4a848c1bb4ec => generated 1319 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:50:48.239542 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d4bcc065-cbff-4df0-b817-8da0e5408003 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:50:48.241072 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d4bcc065-cbff-4df0-b817-8da0e5408003 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] [instance: 2da44c38-67a1-416e-847b-4a848c1bb4ec] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:50:48.250395 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:50:48.260653 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d4bcc065-cbff-4df0-b817-8da0e5408003 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:48.261178 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d4bcc065-cbff-4df0-b817-8da0e5408003 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:48.265185 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d4bcc065-cbff-4df0-b817-8da0e5408003 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:48.266067 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d4bcc065-cbff-4df0-b817-8da0e5408003 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:48.266566 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d4bcc065-cbff-4df0-b817-8da0e5408003 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:48.270475 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d4bcc065-cbff-4df0-b817-8da0e5408003 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:48.601507 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d4bcc065-cbff-4df0-b817-8da0e5408003 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb21ecdda88d49b59e11a30b0f3afc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767edc5f9e7a4c81929df4fa8a12d94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:50:48.610433 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d4bcc065-cbff-4df0-b817-8da0e5408003 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] 10.222.0.13 "GET /compute/v2.1/servers/2da44c38-67a1-416e-847b-4a848c1bb4ec" status: 200 len: 1319 microversion: 2.1 time: 0.374891 Oct 30 01:50:48.611031 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3135/6275] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:50:48 2022] GET /compute/v2.1/servers/2da44c38-67a1-416e-847b-4a848c1bb4ec => generated 1319 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:50:49.322982 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3b76c1f5-5664-4f0f-aac6-6908e4c55499 tempest-TestAggregatesBasicOps-1506584011 tempest-TestAggregatesBasicOps-1506584011-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-992652995", "availability_zone": "foo_zone"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:50:49.329032 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.aggregate [None req-3b76c1f5-5664-4f0f-aac6-6908e4c55499 tempest-TestAggregatesBasicOps-1506584011 tempest-TestAggregatesBasicOps-1506584011-project-admin] Generated uuid b7823fbe-5375-4ed4-a442-81498e64d249 for aggregate {{(pid=121102) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 30 01:50:49.460869 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3b76c1f5-5664-4f0f-aac6-6908e4c55499 tempest-TestAggregatesBasicOps-1506584011 tempest-TestAggregatesBasicOps-1506584011-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.613281 Oct 30 01:50:49.466360 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3141/6276] 10.222.0.13 () {60 vars in 1164 bytes} [Sun Oct 30 01:50:48 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:50:49.479070 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cc455a95-5001-4e95-a329-f7eb3b4b7c1f tempest-TestAggregatesBasicOps-1506584011 tempest-TestAggregatesBasicOps-1506584011-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:50:49.591395 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-3fd44207-68ab-4c82-ad3f-9024144fe00e req-c70af793-8330-4c32-ae71-bf64748a2a79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2da44c38-67a1-416e-847b-4a848c1bb4ec", "name": "network-vif-plugged", "status": "completed", "tag": "7004236e-2948-4d0d-a11b-f39d518f397c"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:50:49.596889 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cc455a95-5001-4e95-a329-f7eb3b4b7c1f tempest-TestAggregatesBasicOps-1506584011 tempest-TestAggregatesBasicOps-1506584011-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.122991 Oct 30 01:50:49.605255 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-3fd44207-68ab-4c82-ad3f-9024144fe00e req-c70af793-8330-4c32-ae71-bf64748a2a79 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:49.606048 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-3fd44207-68ab-4c82-ad3f-9024144fe00e req-c70af793-8330-4c32-ae71-bf64748a2a79 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:49.606701 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-3fd44207-68ab-4c82-ad3f-9024144fe00e req-c70af793-8330-4c32-ae71-bf64748a2a79 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:49.607116 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3142/6277] 10.222.0.13 () {60 vars in 1194 bytes} [Sun Oct 30 01:50:49 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:50:49.613990 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d9e40152-d859-49eb-bc0b-1326d6f66ec7 tempest-TestAggregatesBasicOps-1506584011 tempest-TestAggregatesBasicOps-1506584011-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:50:49.620517 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-3fd44207-68ab-4c82-ad3f-9024144fe00e req-c70af793-8330-4c32-ae71-bf64748a2a79 service nova] Creating event network-vif-plugged:7004236e-2948-4d0d-a11b-f39d518f397c for instance 2da44c38-67a1-416e-847b-4a848c1bb4ec on n-h2-master-1 Oct 30 01:50:49.622142 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9e40152-d859-49eb-bc0b-1326d6f66ec7 tempest-TestAggregatesBasicOps-1506584011 tempest-TestAggregatesBasicOps-1506584011-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:49.622645 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9e40152-d859-49eb-bc0b-1326d6f66ec7 tempest-TestAggregatesBasicOps-1506584011 tempest-TestAggregatesBasicOps-1506584011-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:49.623086 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9e40152-d859-49eb-bc0b-1326d6f66ec7 tempest-TestAggregatesBasicOps-1506584011 tempest-TestAggregatesBasicOps-1506584011-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:49.623824 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9e40152-d859-49eb-bc0b-1326d6f66ec7 tempest-TestAggregatesBasicOps-1506584011 tempest-TestAggregatesBasicOps-1506584011-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:49.624283 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9e40152-d859-49eb-bc0b-1326d6f66ec7 tempest-TestAggregatesBasicOps-1506584011 tempest-TestAggregatesBasicOps-1506584011-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:49.624714 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9e40152-d859-49eb-bc0b-1326d6f66ec7 tempest-TestAggregatesBasicOps-1506584011 tempest-TestAggregatesBasicOps-1506584011-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:49.629206 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-3fd44207-68ab-4c82-ad3f-9024144fe00e req-c70af793-8330-4c32-ae71-bf64748a2a79 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.184720 Oct 30 01:50:49.632269 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3136/6278] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:50:49.640601 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6b4c12b6-90aa-442c-9ce5-7f9d785c4ddd tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:50:49.641890 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6b4c12b6-90aa-442c-9ce5-7f9d785c4ddd tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] [instance: 2da44c38-67a1-416e-847b-4a848c1bb4ec] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:50:49.651386 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6b4c12b6-90aa-442c-9ce5-7f9d785c4ddd tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:49.652650 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6b4c12b6-90aa-442c-9ce5-7f9d785c4ddd tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:49.653749 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6b4c12b6-90aa-442c-9ce5-7f9d785c4ddd tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:49.655047 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6b4c12b6-90aa-442c-9ce5-7f9d785c4ddd tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:49.655715 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6b4c12b6-90aa-442c-9ce5-7f9d785c4ddd tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:49.656368 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6b4c12b6-90aa-442c-9ce5-7f9d785c4ddd tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:49.658898 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d9e40152-d859-49eb-bc0b-1326d6f66ec7 tempest-TestAggregatesBasicOps-1506584011 tempest-TestAggregatesBasicOps-1506584011-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.050070 Oct 30 01:50:49.661507 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3143/6279] 10.222.0.13 () {58 vars in 1176 bytes} [Sun Oct 30 01:50:49 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:50:49.674769 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b4e79df2-9374-4ae5-8f06-cd00d79a699a tempest-TestAggregatesBasicOps-1506584011 tempest-TestAggregatesBasicOps-1506584011-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:50:49.701476 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b4e79df2-9374-4ae5-8f06-cd00d79a699a tempest-TestAggregatesBasicOps-1506584011 tempest-TestAggregatesBasicOps-1506584011-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.030671 Oct 30 01:50:49.702339 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3144/6280] 10.222.0.13 () {58 vars in 1143 bytes} [Sun Oct 30 01:50:49 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:50:49.718857 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-839fc6c5-422d-4a9b-92a0-a296c9aa1ae7 tempest-TestAggregatesBasicOps-1506584011 tempest-TestAggregatesBasicOps-1506584011-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:50:49.732409 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-839fc6c5-422d-4a9b-92a0-a296c9aa1ae7 tempest-TestAggregatesBasicOps-1506584011 tempest-TestAggregatesBasicOps-1506584011-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:49.733248 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-839fc6c5-422d-4a9b-92a0-a296c9aa1ae7 tempest-TestAggregatesBasicOps-1506584011 tempest-TestAggregatesBasicOps-1506584011-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:49.733960 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-839fc6c5-422d-4a9b-92a0-a296c9aa1ae7 tempest-TestAggregatesBasicOps-1506584011 tempest-TestAggregatesBasicOps-1506584011-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:50.118895 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6b4c12b6-90aa-442c-9ce5-7f9d785c4ddd tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb21ecdda88d49b59e11a30b0f3afc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767edc5f9e7a4c81929df4fa8a12d94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:50:50.137912 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6b4c12b6-90aa-442c-9ce5-7f9d785c4ddd tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] 10.222.0.13 "GET /compute/v2.1/servers/2da44c38-67a1-416e-847b-4a848c1bb4ec" status: 200 len: 1319 microversion: 2.1 time: 0.504169 Oct 30 01:50:50.138493 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3137/6281] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:50:49 2022] GET /compute/v2.1/servers/2da44c38-67a1-416e-847b-4a848c1bb4ec => generated 1319 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:50:50.311042 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-839fc6c5-422d-4a9b-92a0-a296c9aa1ae7 tempest-TestAggregatesBasicOps-1506584011 tempest-TestAggregatesBasicOps-1506584011-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.595455 Oct 30 01:50:50.313124 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3145/6282] 10.222.0.13 () {60 vars in 1194 bytes} [Sun Oct 30 01:50:49 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:50:50.324907 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-796f6123-826b-42b3-a150-3da71df18352 tempest-TestAggregatesBasicOps-1506584011 tempest-TestAggregatesBasicOps-1506584011-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:50:50.336895 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-796f6123-826b-42b3-a150-3da71df18352 tempest-TestAggregatesBasicOps-1506584011 tempest-TestAggregatesBasicOps-1506584011-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.015985 Oct 30 01:50:50.338860 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3138/6283] 10.222.0.13 () {58 vars in 1152 bytes} [Sun Oct 30 01:50:50 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:50:50.363927 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cd7a3eec-74dd-4bd0-acfa-474fa407a912 tempest-TestAggregatesBasicOps-1506584011 tempest-TestAggregatesBasicOps-1506584011-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1120235372", "availability_zone": "foo_zone"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:50:50.519877 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cd7a3eec-74dd-4bd0-acfa-474fa407a912 tempest-TestAggregatesBasicOps-1506584011 tempest-TestAggregatesBasicOps-1506584011-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.165348 Oct 30 01:50:50.534153 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3146/6284] 10.222.0.13 () {60 vars in 1173 bytes} [Sun Oct 30 01:50:50 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:50:50.535427 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e703a3c7-6270-4f16-94f6-9aa9a823cb8a tempest-TestAggregatesBasicOps-1506584011 tempest-TestAggregatesBasicOps-1506584011-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:50:50.681654 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e703a3c7-6270-4f16-94f6-9aa9a823cb8a tempest-TestAggregatesBasicOps-1506584011 tempest-TestAggregatesBasicOps-1506584011-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.152928 Oct 30 01:50:50.682921 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3139/6285] 10.222.0.13 () {60 vars in 1194 bytes} [Sun Oct 30 01:50:50 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:50:50.694825 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c7b4d5c9-2fd7-438a-9038-1ca63d2329c7 tempest-TestAggregatesBasicOps-1506584011 tempest-TestAggregatesBasicOps-1506584011-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:50:50.713631 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c7b4d5c9-2fd7-438a-9038-1ca63d2329c7 tempest-TestAggregatesBasicOps-1506584011 tempest-TestAggregatesBasicOps-1506584011-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.022422 Oct 30 01:50:50.722209 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3147/6286] 10.222.0.13 () {58 vars in 1152 bytes} [Sun Oct 30 01:50:50 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:50:50.726920 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-96b5f0f3-3721-4015-99e1-f05c3ff4bdae tempest-TestAggregatesBasicOps-1506584011 tempest-TestAggregatesBasicOps-1506584011-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:50:50.755682 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-96b5f0f3-3721-4015-99e1-f05c3ff4bdae tempest-TestAggregatesBasicOps-1506584011 tempest-TestAggregatesBasicOps-1506584011-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:50.756242 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-96b5f0f3-3721-4015-99e1-f05c3ff4bdae tempest-TestAggregatesBasicOps-1506584011 tempest-TestAggregatesBasicOps-1506584011-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:50.756742 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-96b5f0f3-3721-4015-99e1-f05c3ff4bdae tempest-TestAggregatesBasicOps-1506584011 tempest-TestAggregatesBasicOps-1506584011-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:51.109044 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-96b5f0f3-3721-4015-99e1-f05c3ff4bdae tempest-TestAggregatesBasicOps-1506584011 tempest-TestAggregatesBasicOps-1506584011-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.379169 Oct 30 01:50:51.117963 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3140/6287] 10.222.0.13 () {60 vars in 1194 bytes} [Sun Oct 30 01:50:50 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:50:51.137680 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bc02fd04-5812-4e12-bc17-1e92aad584f6 tempest-TestAggregatesBasicOps-1506584011 tempest-TestAggregatesBasicOps-1506584011-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:50:51.167740 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8a73668b-410d-4e0f-aea2-bb168f1ea2b7 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:50:51.169549 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8a73668b-410d-4e0f-aea2-bb168f1ea2b7 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] [instance: 2da44c38-67a1-416e-847b-4a848c1bb4ec] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:50:51.187278 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8a73668b-410d-4e0f-aea2-bb168f1ea2b7 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:51.189217 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8a73668b-410d-4e0f-aea2-bb168f1ea2b7 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:51.189217 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8a73668b-410d-4e0f-aea2-bb168f1ea2b7 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:51.189623 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8a73668b-410d-4e0f-aea2-bb168f1ea2b7 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:51.190193 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8a73668b-410d-4e0f-aea2-bb168f1ea2b7 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:51.192387 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8a73668b-410d-4e0f-aea2-bb168f1ea2b7 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:51.209224 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bc02fd04-5812-4e12-bc17-1e92aad584f6 tempest-TestAggregatesBasicOps-1506584011 tempest-TestAggregatesBasicOps-1506584011-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.080963 Oct 30 01:50:51.210607 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3148/6288] 10.222.0.13 () {58 vars in 1155 bytes} [Sun Oct 30 01:50:51 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 30 01:50:51.230544 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-731e21bd-6f0d-4a52-8174-faf2246702a1 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:50:51.233399 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-731e21bd-6f0d-4a52-8174-faf2246702a1 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 0671096f-ed83-4341-8f95-d138a9eebffc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:50:51.255549 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-731e21bd-6f0d-4a52-8174-faf2246702a1 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:51.256307 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-731e21bd-6f0d-4a52-8174-faf2246702a1 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:51.256971 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-731e21bd-6f0d-4a52-8174-faf2246702a1 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:51.257930 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-731e21bd-6f0d-4a52-8174-faf2246702a1 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:51.258621 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-731e21bd-6f0d-4a52-8174-faf2246702a1 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:51.259363 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-731e21bd-6f0d-4a52-8174-faf2246702a1 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:51.284397 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-731e21bd-6f0d-4a52-8174-faf2246702a1 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] HTTP exception thrown: Instance 0671096f-ed83-4341-8f95-d138a9eebffc could not be found. Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-731e21bd-6f0d-4a52-8174-faf2246702a1 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Request method failure captured: Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc HTTP/1.1 Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdcRtc4GzHkShMdH9tTupejgTwf3ZNgIcyJqp9yicfp5OD1pJcQPZv1XBaNx7doePOAnkL0JpoIe5_T8iLiz5QjNjR1hpdjjFconMkrxU8FPHulGdRMQx61K_rAf0z9mDPUn9FfJ2msqRaRZPanWCScsW3BEB8X_vbKTz8C4TVCF-Ys Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 311cde01e89442f1ab3aa930070b7343 Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-AttachVolumeNegativeTest-812748574 Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/311cde01e89442f1ab3aa930070b7343"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_311cde01e89442f1ab3aa930070b7343"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/311cde01e89442f1ab3aa930070b7343"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/311cde01e89442f1ab3aa930070b7343"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-AttachVolumeNegativeTest-812748574 Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 311cde01e89442f1ab3aa930070b7343 Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-812748574 Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-AttachVolumeNegativeTest-812748574-project Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: dcb021152c684983b31e5db439518921 Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-AttachVolumeNegativeTest-812748574-project Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 0671096f-ed83-4341-8f95-d138a9eebffc could not be found. Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '0671096f-ed83-4341-8f95-d138a9eebffc'} Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0671096f-ed83-4341-8f95-d138a9eebffc could not be found. Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:50:51.292171 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:50:51.296540 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0671096f-ed83-4341-8f95-d138a9eebffc could not be found. Oct 30 01:50:51.296540 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:50:51.296540 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:50:51.296540 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:50:51.296540 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:50:51.296540 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:50:51.296540 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:50:51.296540 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:50:51.296540 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:50:51.296540 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0671096f-ed83-4341-8f95-d138a9eebffc could not be found. Oct 30 01:50:51.296540 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:50:51.296540 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-731e21bd-6f0d-4a52-8174-faf2246702a1 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Returning 404 to user: Instance 0671096f-ed83-4341-8f95-d138a9eebffc could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:50:51.304090 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-731e21bd-6f0d-4a52-8174-faf2246702a1 tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc" status: 404 len: 111 microversion: 2.1 time: 0.081365 Oct 30 01:50:51.304090 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3149/6289] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:50:51 2022] DELETE /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:50:51.318256 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-de3d5c0c-0611-408d-b4e2-04fcc98594cf tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:50:51.321315 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-de3d5c0c-0611-408d-b4e2-04fcc98594cf tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] [instance: 0671096f-ed83-4341-8f95-d138a9eebffc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:50:51.325603 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-de3d5c0c-0611-408d-b4e2-04fcc98594cf tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:51.326218 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-de3d5c0c-0611-408d-b4e2-04fcc98594cf tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:51.331668 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-de3d5c0c-0611-408d-b4e2-04fcc98594cf tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:51.332518 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-de3d5c0c-0611-408d-b4e2-04fcc98594cf tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:51.333169 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-de3d5c0c-0611-408d-b4e2-04fcc98594cf tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:51.334348 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-de3d5c0c-0611-408d-b4e2-04fcc98594cf tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:51.370292 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-de3d5c0c-0611-408d-b4e2-04fcc98594cf tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] HTTP exception thrown: Instance 0671096f-ed83-4341-8f95-d138a9eebffc could not be found. Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-de3d5c0c-0611-408d-b4e2-04fcc98594cf tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Request method failure captured: Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc HTTP/1.1 Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdcRtc4GzHkShMdH9tTupejgTwf3ZNgIcyJqp9yicfp5OD1pJcQPZv1XBaNx7doePOAnkL0JpoIe5_T8iLiz5QjNjR1hpdjjFconMkrxU8FPHulGdRMQx61K_rAf0z9mDPUn9FfJ2msqRaRZPanWCScsW3BEB8X_vbKTz8C4TVCF-Ys Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 311cde01e89442f1ab3aa930070b7343 Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-AttachVolumeNegativeTest-812748574 Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/311cde01e89442f1ab3aa930070b7343"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_311cde01e89442f1ab3aa930070b7343"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/311cde01e89442f1ab3aa930070b7343"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/311cde01e89442f1ab3aa930070b7343"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-AttachVolumeNegativeTest-812748574 Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 311cde01e89442f1ab3aa930070b7343 Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-812748574 Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-AttachVolumeNegativeTest-812748574-project Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: dcb021152c684983b31e5db439518921 Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-AttachVolumeNegativeTest-812748574-project Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 0671096f-ed83-4341-8f95-d138a9eebffc could not be found. Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '0671096f-ed83-4341-8f95-d138a9eebffc'} Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0671096f-ed83-4341-8f95-d138a9eebffc could not be found. Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0671096f-ed83-4341-8f95-d138a9eebffc could not be found. Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:50:51.372179 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:50:51.376357 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:50:51.376357 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:50:51.376357 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:50:51.376357 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:50:51.376357 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:50:51.376357 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0671096f-ed83-4341-8f95-d138a9eebffc could not be found. Oct 30 01:50:51.376357 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:50:51.389652 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-de3d5c0c-0611-408d-b4e2-04fcc98594cf tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] Returning 404 to user: Instance 0671096f-ed83-4341-8f95-d138a9eebffc could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:50:51.389652 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-de3d5c0c-0611-408d-b4e2-04fcc98594cf tempest-AttachVolumeNegativeTest-812748574 tempest-AttachVolumeNegativeTest-812748574-project] 10.222.0.13 "GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc" status: 404 len: 111 microversion: 2.1 time: 0.075904 Oct 30 01:50:51.389652 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3150/6290] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:50:51 2022] GET /compute/v2.1/servers/0671096f-ed83-4341-8f95-d138a9eebffc => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:50:51.516336 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8a73668b-410d-4e0f-aea2-bb168f1ea2b7 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb21ecdda88d49b59e11a30b0f3afc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767edc5f9e7a4c81929df4fa8a12d94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:50:51.528354 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8a73668b-410d-4e0f-aea2-bb168f1ea2b7 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] 10.222.0.13 "GET /compute/v2.1/servers/2da44c38-67a1-416e-847b-4a848c1bb4ec" status: 200 len: 1319 microversion: 2.1 time: 0.365928 Oct 30 01:50:51.529270 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3141/6291] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:50:51 2022] GET /compute/v2.1/servers/2da44c38-67a1-416e-847b-4a848c1bb4ec => generated 1319 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:50:52.552603 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6be380b5-bca6-400e-8e6c-2b2d43e2148e tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:50:52.553997 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6be380b5-bca6-400e-8e6c-2b2d43e2148e tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] [instance: 2da44c38-67a1-416e-847b-4a848c1bb4ec] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:50:52.561810 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6be380b5-bca6-400e-8e6c-2b2d43e2148e tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:52.562580 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6be380b5-bca6-400e-8e6c-2b2d43e2148e tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:52.563020 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6be380b5-bca6-400e-8e6c-2b2d43e2148e tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:52.563729 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6be380b5-bca6-400e-8e6c-2b2d43e2148e tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:52.564430 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6be380b5-bca6-400e-8e6c-2b2d43e2148e tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:52.565015 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6be380b5-bca6-400e-8e6c-2b2d43e2148e tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:52.717812 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6be380b5-bca6-400e-8e6c-2b2d43e2148e tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb21ecdda88d49b59e11a30b0f3afc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767edc5f9e7a4c81929df4fa8a12d94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:50:52.726267 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6be380b5-bca6-400e-8e6c-2b2d43e2148e tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] 10.222.0.13 "GET /compute/v2.1/servers/2da44c38-67a1-416e-847b-4a848c1bb4ec" status: 200 len: 1508 microversion: 2.1 time: 0.177813 Oct 30 01:50:52.727751 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3151/6292] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:50:52 2022] GET /compute/v2.1/servers/2da44c38-67a1-416e-847b-4a848c1bb4ec => generated 1508 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:50:52.759821 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7b1ac317-e7d3-4965-92c4-f397e89069b3 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c9a37cbe-c375-448a-b7ec-aaf73443b381", "device": "/dev/sdb"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:50:52.765847 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7b1ac317-e7d3-4965-92c4-f397e89069b3 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] [instance: 2da44c38-67a1-416e-847b-4a848c1bb4ec] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:50:52.790752 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b1ac317-e7d3-4965-92c4-f397e89069b3 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:52.792167 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b1ac317-e7d3-4965-92c4-f397e89069b3 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:52.792694 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b1ac317-e7d3-4965-92c4-f397e89069b3 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:52.793482 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b1ac317-e7d3-4965-92c4-f397e89069b3 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:50:52.793959 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b1ac317-e7d3-4965-92c4-f397e89069b3 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:50:52.794406 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b1ac317-e7d3-4965-92c4-f397e89069b3 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:50:53.921010 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7b1ac317-e7d3-4965-92c4-f397e89069b3 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] 10.222.0.13 "POST /compute/v2.1/servers/2da44c38-67a1-416e-847b-4a848c1bb4ec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.166080 Oct 30 01:50:53.922200 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3142/6293] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 30 01:50:52 2022] POST /compute/v2.1/servers/2da44c38-67a1-416e-847b-4a848c1bb4ec/os-volume_attachments => generated 194 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:51:01.873700 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:51:02.021817 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-dbbd27d7-a6af-4220-9073-a074d89c41b6 tempest-VolumesSnapshotsTestJSON-171724288 tempest-VolumesSnapshotsTestJSON-171724288-project] Action: 'create', calling method: .version_select at 0x7f44c761f160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1614480542"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:51:02.562636 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:51:02.725270 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=31 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:51:02.884621 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-dbbd27d7-a6af-4220-9073-a074d89c41b6 tempest-VolumesSnapshotsTestJSON-171724288 tempest-VolumesSnapshotsTestJSON-171724288-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.015161 Oct 30 01:51:02.900072 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f17d3721-476d-426d-819e-ec941f2da929 tempest-VolumesSnapshotsTestJSON-171724288 tempest-VolumesSnapshotsTestJSON-171724288-project] Calling method '.version_select at 0x7f44c6e6c040>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:51:02.911992 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3152/6294] 10.222.0.13 () {60 vars in 1155 bytes} [Sun Oct 30 01:51:01 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1038 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 30 01:51:02.912353 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:51:02.984401 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f17d3721-476d-426d-819e-ec941f2da929 tempest-VolumesSnapshotsTestJSON-171724288 tempest-VolumesSnapshotsTestJSON-171724288-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/30a66547-8829-4cd4-8fa1-080814117bb4" status: 200 len: 345 microversion: 2.1 time: 0.089385 Oct 30 01:51:02.989486 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3143/6295] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 30 01:51:02 2022] GET /compute/v2.1/os-volumes/30a66547-8829-4cd4-8fa1-080814117bb4 => generated 345 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:51:03.999832 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c1d6a2d4-40ec-452f-a952-929abb1cba87 tempest-VolumesSnapshotsTestJSON-171724288 tempest-VolumesSnapshotsTestJSON-171724288-project] Calling method '.version_select at 0x7f44c6e04160>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:51:04.160069 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c1d6a2d4-40ec-452f-a952-929abb1cba87 tempest-VolumesSnapshotsTestJSON-171724288 tempest-VolumesSnapshotsTestJSON-171724288-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/30a66547-8829-4cd4-8fa1-080814117bb4" status: 200 len: 345 microversion: 2.1 time: 0.164613 Oct 30 01:51:04.161235 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3153/6296] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 30 01:51:03 2022] GET /compute/v2.1/os-volumes/30a66547-8829-4cd4-8fa1-080814117bb4 => generated 345 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:51:05.172223 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:51:05.181235 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-74289a71-f3e0-444a-b215-71cbdcdb7167 tempest-VolumesSnapshotsTestJSON-171724288 tempest-VolumesSnapshotsTestJSON-171724288-project] Calling method '.version_select at 0x7f44c6e571f0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:51:05.295867 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-74289a71-f3e0-444a-b215-71cbdcdb7167 tempest-VolumesSnapshotsTestJSON-171724288 tempest-VolumesSnapshotsTestJSON-171724288-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/30a66547-8829-4cd4-8fa1-080814117bb4" status: 200 len: 346 microversion: 2.1 time: 0.125282 Oct 30 01:51:05.303450 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3144/6297] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 30 01:51:05 2022] GET /compute/v2.1/os-volumes/30a66547-8829-4cd4-8fa1-080814117bb4 => generated 346 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:51:05.311962 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-80d0ce6b-dfe3-4ac3-8287-779700386953 tempest-VolumesSnapshotsTestJSON-171724288 tempest-VolumesSnapshotsTestJSON-171724288-project] Action: 'create', calling method: .version_select at 0x7f44c6fde9d0>, body: {"snapshot": {"volume_id": "30a66547-8829-4cd4-8fa1-080814117bb4", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2111522835"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:51:05.855904 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-80d0ce6b-dfe3-4ac3-8287-779700386953 tempest-VolumesSnapshotsTestJSON-171724288 tempest-VolumesSnapshotsTestJSON-171724288-project] 10.222.0.13 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.549565 Oct 30 01:51:05.856830 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3154/6298] 10.222.0.13 () {60 vars in 1162 bytes} [Sun Oct 30 01:51:05 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:51:05.868879 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-79be8800-dc78-4fe9-931e-d940e64e0de7 tempest-VolumesSnapshotsTestJSON-171724288 tempest-VolumesSnapshotsTestJSON-171724288-project] Calling method '.version_select at 0x7f44c6ef8f70>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:51:05.911610 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-79be8800-dc78-4fe9-931e-d940e64e0de7 tempest-VolumesSnapshotsTestJSON-171724288 tempest-VolumesSnapshotsTestJSON-171724288-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/914e8536-7480-4713-96a7-9e95b8c62c20" status: 200 len: 287 microversion: 2.1 time: 0.046497 Oct 30 01:51:05.923503 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cb5033df-132d-4a22-a6eb-b0ff1328be1a tempest-VolumesSnapshotsTestJSON-171724288 tempest-VolumesSnapshotsTestJSON-171724288-project] Calling method '.version_select at 0x7f44c6e04af0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:51:05.928769 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3145/6299] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 30 01:51:05 2022] GET /compute/v2.1/os-snapshots/914e8536-7480-4713-96a7-9e95b8c62c20 => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:51:05.958367 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cb5033df-132d-4a22-a6eb-b0ff1328be1a tempest-VolumesSnapshotsTestJSON-171724288 tempest-VolumesSnapshotsTestJSON-171724288-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.038687 Oct 30 01:51:05.969503 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3155/6300] 10.222.0.13 () {58 vars in 1140 bytes} [Sun Oct 30 01:51:05 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:51:05.971751 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d1397c92-bff6-41af-8d35-db3337e7f5ed tempest-VolumesSnapshotsTestJSON-171724288 tempest-VolumesSnapshotsTestJSON-171724288-project] Calling method '.version_select at 0x7f44cd906dc0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:51:06.011980 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d1397c92-bff6-41af-8d35-db3337e7f5ed tempest-VolumesSnapshotsTestJSON-171724288 tempest-VolumesSnapshotsTestJSON-171724288-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/914e8536-7480-4713-96a7-9e95b8c62c20" status: 200 len: 287 microversion: 2.1 time: 0.045010 Oct 30 01:51:06.013072 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3146/6301] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 30 01:51:05 2022] GET /compute/v2.1/os-snapshots/914e8536-7480-4713-96a7-9e95b8c62c20 => generated 287 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:51:07.027198 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bb751a6a-c69a-4aec-be7e-e2fe66b82f18 tempest-VolumesSnapshotsTestJSON-171724288 tempest-VolumesSnapshotsTestJSON-171724288-project] Calling method '.version_select at 0x7f44c6e04ee0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:51:07.063230 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bb751a6a-c69a-4aec-be7e-e2fe66b82f18 tempest-VolumesSnapshotsTestJSON-171724288 tempest-VolumesSnapshotsTestJSON-171724288-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/914e8536-7480-4713-96a7-9e95b8c62c20" status: 200 len: 287 microversion: 2.1 time: 0.041621 Oct 30 01:51:07.063816 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3156/6302] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 30 01:51:07 2022] GET /compute/v2.1/os-snapshots/914e8536-7480-4713-96a7-9e95b8c62c20 => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:51:08.078042 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ca39177a-b5fa-49af-a623-cbc326fce14e tempest-VolumesSnapshotsTestJSON-171724288 tempest-VolumesSnapshotsTestJSON-171724288-project] Calling method '.version_select at 0x7f44c6f4c700>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:51:08.122907 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ca39177a-b5fa-49af-a623-cbc326fce14e tempest-VolumesSnapshotsTestJSON-171724288 tempest-VolumesSnapshotsTestJSON-171724288-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/914e8536-7480-4713-96a7-9e95b8c62c20" status: 200 len: 287 microversion: 2.1 time: 0.050584 Oct 30 01:51:08.128854 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3147/6303] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 30 01:51:08 2022] GET /compute/v2.1/os-snapshots/914e8536-7480-4713-96a7-9e95b8c62c20 => generated 287 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:51:09.138613 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fb2957a0-07b3-4987-a4b2-c35f625d33fe tempest-VolumesSnapshotsTestJSON-171724288 tempest-VolumesSnapshotsTestJSON-171724288-project] Calling method '.version_select at 0x7f44c6fb8790>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:51:09.203044 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fb2957a0-07b3-4987-a4b2-c35f625d33fe tempest-VolumesSnapshotsTestJSON-171724288 tempest-VolumesSnapshotsTestJSON-171724288-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/914e8536-7480-4713-96a7-9e95b8c62c20" status: 200 len: 288 microversion: 2.1 time: 0.071208 Oct 30 01:51:09.203863 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3157/6304] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 30 01:51:09 2022] GET /compute/v2.1/os-snapshots/914e8536-7480-4713-96a7-9e95b8c62c20 => generated 288 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:51:09.214739 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9f22ea8d-5e1d-48b6-b05d-dbf81be8a70b tempest-VolumesSnapshotsTestJSON-171724288 tempest-VolumesSnapshotsTestJSON-171724288-project] Calling method '.version_select at 0x7f44cd906ee0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:51:09.369137 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9f22ea8d-5e1d-48b6-b05d-dbf81be8a70b tempest-VolumesSnapshotsTestJSON-171724288 tempest-VolumesSnapshotsTestJSON-171724288-project] 10.222.0.13 "DELETE /compute/v2.1/os-snapshots/914e8536-7480-4713-96a7-9e95b8c62c20" status: 202 len: 0 microversion: 2.1 time: 0.152577 Oct 30 01:51:09.369137 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3148/6305] 10.222.0.13 () {58 vars in 1254 bytes} [Sun Oct 30 01:51:09 2022] DELETE /compute/v2.1/os-snapshots/914e8536-7480-4713-96a7-9e95b8c62c20 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:51:09.373568 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f4313881-2b88-467e-abc5-5dfa5a9fab9f tempest-VolumesSnapshotsTestJSON-171724288 tempest-VolumesSnapshotsTestJSON-171724288-project] Calling method '.version_select at 0x7f44c6e04ee0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:51:09.409960 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f4313881-2b88-467e-abc5-5dfa5a9fab9f tempest-VolumesSnapshotsTestJSON-171724288 tempest-VolumesSnapshotsTestJSON-171724288-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/914e8536-7480-4713-96a7-9e95b8c62c20" status: 200 len: 287 microversion: 2.1 time: 0.040775 Oct 30 01:51:09.410769 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3158/6306] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 30 01:51:09 2022] GET /compute/v2.1/os-snapshots/914e8536-7480-4713-96a7-9e95b8c62c20 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:51:10.424400 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-27b6af66-047c-428d-b147-6356b3c26887 tempest-VolumesSnapshotsTestJSON-171724288 tempest-VolumesSnapshotsTestJSON-171724288-project] Calling method '.version_select at 0x7f44d044fe50>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:51:10.476827 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-27b6af66-047c-428d-b147-6356b3c26887 tempest-VolumesSnapshotsTestJSON-171724288 tempest-VolumesSnapshotsTestJSON-171724288-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/914e8536-7480-4713-96a7-9e95b8c62c20" status: 200 len: 287 microversion: 2.1 time: 0.057460 Oct 30 01:51:10.477627 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3149/6307] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 30 01:51:10 2022] GET /compute/v2.1/os-snapshots/914e8536-7480-4713-96a7-9e95b8c62c20 => generated 287 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:51:11.495697 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7c0bbc06-c41a-468a-a0b1-2bc242c3a10f tempest-VolumesSnapshotsTestJSON-171724288 tempest-VolumesSnapshotsTestJSON-171724288-project] Calling method '.version_select at 0x7f44c7ecdca0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:51:11.541415 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7c0bbc06-c41a-468a-a0b1-2bc242c3a10f tempest-VolumesSnapshotsTestJSON-171724288 tempest-VolumesSnapshotsTestJSON-171724288-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/914e8536-7480-4713-96a7-9e95b8c62c20" status: 200 len: 287 microversion: 2.1 time: 0.051853 Oct 30 01:51:11.542076 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3159/6308] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 30 01:51:11 2022] GET /compute/v2.1/os-snapshots/914e8536-7480-4713-96a7-9e95b8c62c20 => generated 287 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:51:12.556409 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d6415511-fc84-48a4-8a32-c432ab9b25a3 tempest-VolumesSnapshotsTestJSON-171724288 tempest-VolumesSnapshotsTestJSON-171724288-project] Calling method '.version_select at 0x7f44c6ef8d30>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:51:12.589942 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d6415511-fc84-48a4-8a32-c432ab9b25a3 tempest-VolumesSnapshotsTestJSON-171724288 tempest-VolumesSnapshotsTestJSON-171724288-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/914e8536-7480-4713-96a7-9e95b8c62c20" status: 200 len: 287 microversion: 2.1 time: 0.039102 Oct 30 01:51:12.590524 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3150/6309] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 30 01:51:12 2022] GET /compute/v2.1/os-snapshots/914e8536-7480-4713-96a7-9e95b8c62c20 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:51:13.605374 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bb6cb2af-a43c-4c77-90c3-cac3d891c243 tempest-VolumesSnapshotsTestJSON-171724288 tempest-VolumesSnapshotsTestJSON-171724288-project] Calling method '.version_select at 0x7f44c71ad4c0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:51:13.660905 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-bb6cb2af-a43c-4c77-90c3-cac3d891c243 tempest-VolumesSnapshotsTestJSON-171724288 tempest-VolumesSnapshotsTestJSON-171724288-project] HTTP exception thrown: Snapshot 914e8536-7480-4713-96a7-9e95b8c62c20 could not be found. Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bb6cb2af-a43c-4c77-90c3-cac3d891c243 tempest-VolumesSnapshotsTestJSON-171724288 tempest-VolumesSnapshotsTestJSON-171724288-project] Request method failure captured: Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/os-snapshots/914e8536-7480-4713-96a7-9e95b8c62c20 HTTP/1.1 Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdiFU_qpBfkpL_9UcYuQyZKkzxzTPmvV5GGu5EKlhRke_1zRWXdHKDGR7YZwBCJT4sIgIFJ3OxrWmLRQaFMqndi2jnVqG5JyPz_mgLsYWSilLDWlctlikkhzQ0Xf2hYuYRn13sc7XQZ3vyGuZIOhpc27OwD6RMN7iePQNjHHNPbkW38 Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 460d84157c4c4366933fd5274ad0fb9b Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-171724288 Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/460d84157c4c4366933fd5274ad0fb9b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_460d84157c4c4366933fd5274ad0fb9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/460d84157c4c4366933fd5274ad0fb9b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/460d84157c4c4366933fd5274ad0fb9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-VolumesSnapshotsTestJSON-171724288 Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 460d84157c4c4366933fd5274ad0fb9b Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-171724288 Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-VolumesSnapshotsTestJSON-171724288-project Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: adaaee54d4904ef28bd5b78bb1c7b2fc Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-VolumesSnapshotsTestJSON-171724288-project Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: method: Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: exception: Snapshot 914e8536-7480-4713-96a7-9e95b8c62c20 could not be found. Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '914e8536-7480-4713-96a7-9e95b8c62c20'} Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 914e8536-7480-4713-96a7-9e95b8c62c20 could not be found. (HTTP 404) (Request-ID: req-9b41ed00-56d4-4ffd-90fe-4fe7bbfdc9e5) Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 30 01:51:13.673152 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 30 01:51:13.676672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 30 01:51:13.676672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 30 01:51:13.676672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 30 01:51:13.676672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 30 01:51:13.676672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 30 01:51:13.676672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 30 01:51:13.676672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 30 01:51:13.676672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 30 01:51:13.676672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 30 01:51:13.676672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 30 01:51:13.676672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 30 01:51:13.676672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 30 01:51:13.676672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 30 01:51:13.676672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 30 01:51:13.676672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 914e8536-7480-4713-96a7-9e95b8c62c20 could not be found. Oct 30 01:51:13.676672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:51:13.676672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:51:13.676672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:51:13.676672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:51:13.676672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:51:13.676672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:51:13.676672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:51:13.676672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:51:13.676672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:51:13.676672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:51:13.676672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:51:13.676672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:51:13.676672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 30 01:51:13.676672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:51:13.676672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 914e8536-7480-4713-96a7-9e95b8c62c20 could not be found. Oct 30 01:51:13.676672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:51:13.676672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:51:13.676672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:51:13.676672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:51:13.676672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:51:13.676672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:51:13.676672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:51:13.676672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:51:13.676672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 914e8536-7480-4713-96a7-9e95b8c62c20 could not be found. Oct 30 01:51:13.676672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:51:13.681957 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bb6cb2af-a43c-4c77-90c3-cac3d891c243 tempest-VolumesSnapshotsTestJSON-171724288 tempest-VolumesSnapshotsTestJSON-171724288-project] Returning 404 to user: Snapshot 914e8536-7480-4713-96a7-9e95b8c62c20 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:51:13.682862 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bb6cb2af-a43c-4c77-90c3-cac3d891c243 tempest-VolumesSnapshotsTestJSON-171724288 tempest-VolumesSnapshotsTestJSON-171724288-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/914e8536-7480-4713-96a7-9e95b8c62c20" status: 404 len: 111 microversion: 2.1 time: 0.081942 Oct 30 01:51:13.687202 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3160/6310] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 30 01:51:13 2022] GET /compute/v2.1/os-snapshots/914e8536-7480-4713-96a7-9e95b8c62c20 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 01:51:13.693748 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a3bb82d4-74b8-4723-b32b-bac4df5534d1 tempest-VolumesSnapshotsTestJSON-171724288 tempest-VolumesSnapshotsTestJSON-171724288-project] Calling method '.version_select at 0x7f44c6e57dc0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:51:13.945837 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a3bb82d4-74b8-4723-b32b-bac4df5534d1 tempest-VolumesSnapshotsTestJSON-171724288 tempest-VolumesSnapshotsTestJSON-171724288-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/30a66547-8829-4cd4-8fa1-080814117bb4" status: 202 len: 0 microversion: 2.1 time: 0.256658 Oct 30 01:51:13.949737 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3151/6311] 10.222.0.13 () {58 vars in 1248 bytes} [Sun Oct 30 01:51:13 2022] DELETE /compute/v2.1/os-volumes/30a66547-8829-4cd4-8fa1-080814117bb4 => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:51:13.956452 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fa988d39-16cc-4179-aaa0-1d32ac62609a tempest-VolumesSnapshotsTestJSON-171724288 tempest-VolumesSnapshotsTestJSON-171724288-project] Calling method '.version_select at 0x7f44c70bc3a0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:51:14.016993 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fa988d39-16cc-4179-aaa0-1d32ac62609a tempest-VolumesSnapshotsTestJSON-171724288 tempest-VolumesSnapshotsTestJSON-171724288-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/30a66547-8829-4cd4-8fa1-080814117bb4" status: 200 len: 345 microversion: 2.1 time: 0.065885 Oct 30 01:51:14.017781 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3161/6312] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 30 01:51:13 2022] GET /compute/v2.1/os-volumes/30a66547-8829-4cd4-8fa1-080814117bb4 => generated 345 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:51:15.033684 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e7d451e3-29c5-403b-9927-2aeb613756a5 tempest-VolumesSnapshotsTestJSON-171724288 tempest-VolumesSnapshotsTestJSON-171724288-project] Calling method '.version_select at 0x7f44d0358ca0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:51:15.091839 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e7d451e3-29c5-403b-9927-2aeb613756a5 tempest-VolumesSnapshotsTestJSON-171724288 tempest-VolumesSnapshotsTestJSON-171724288-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/30a66547-8829-4cd4-8fa1-080814117bb4" status: 200 len: 345 microversion: 2.1 time: 0.063629 Oct 30 01:51:15.092624 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3152/6313] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 30 01:51:15 2022] GET /compute/v2.1/os-volumes/30a66547-8829-4cd4-8fa1-080814117bb4 => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:51:16.107170 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fb4de30a-15f5-437d-b98f-1b443d912f8a tempest-VolumesSnapshotsTestJSON-171724288 tempest-VolumesSnapshotsTestJSON-171724288-project] Calling method '.version_select at 0x7f44d04e5310>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:51:16.240480 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fb4de30a-15f5-437d-b98f-1b443d912f8a tempest-VolumesSnapshotsTestJSON-171724288 tempest-VolumesSnapshotsTestJSON-171724288-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/30a66547-8829-4cd4-8fa1-080814117bb4" status: 200 len: 345 microversion: 2.1 time: 0.137148 Oct 30 01:51:16.251090 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3162/6314] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 30 01:51:16 2022] GET /compute/v2.1/os-volumes/30a66547-8829-4cd4-8fa1-080814117bb4 => generated 345 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:51:17.264320 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-98d03839-90d6-448b-80bd-af68e9469eda tempest-VolumesSnapshotsTestJSON-171724288 tempest-VolumesSnapshotsTestJSON-171724288-project] Calling method '.version_select at 0x7f44d044f0d0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:51:17.330991 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-98d03839-90d6-448b-80bd-af68e9469eda tempest-VolumesSnapshotsTestJSON-171724288 tempest-VolumesSnapshotsTestJSON-171724288-project] HTTP exception thrown: Volume 30a66547-8829-4cd4-8fa1-080814117bb4 could not be found. Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-98d03839-90d6-448b-80bd-af68e9469eda tempest-VolumesSnapshotsTestJSON-171724288 tempest-VolumesSnapshotsTestJSON-171724288-project] Request method failure captured: Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/os-volumes/30a66547-8829-4cd4-8fa1-080814117bb4 HTTP/1.1 Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdiFU_qpBfkpL_9UcYuQyZKkzxzTPmvV5GGu5EKlhRke_1zRWXdHKDGR7YZwBCJT4sIgIFJ3OxrWmLRQaFMqndi2jnVqG5JyPz_mgLsYWSilLDWlctlikkhzQ0Xf2hYuYRn13sc7XQZ3vyGuZIOhpc27OwD6RMN7iePQNjHHNPbkW38 Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 460d84157c4c4366933fd5274ad0fb9b Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-171724288 Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/460d84157c4c4366933fd5274ad0fb9b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_460d84157c4c4366933fd5274ad0fb9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/460d84157c4c4366933fd5274ad0fb9b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/460d84157c4c4366933fd5274ad0fb9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-VolumesSnapshotsTestJSON-171724288 Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 460d84157c4c4366933fd5274ad0fb9b Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-171724288 Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-VolumesSnapshotsTestJSON-171724288-project Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: adaaee54d4904ef28bd5b78bb1c7b2fc Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-VolumesSnapshotsTestJSON-171724288-project Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: method: Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: exception: Volume 30a66547-8829-4cd4-8fa1-080814117bb4 could not be found. Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '30a66547-8829-4cd4-8fa1-080814117bb4'} Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 30a66547-8829-4cd4-8fa1-080814117bb4 could not be found. (HTTP 404) (Request-ID: req-ffc031a0-de14-4a9d-8733-f33201dcd833) Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 30 01:51:17.332995 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 30 01:51:17.342710 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 30 01:51:17.342710 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 30 01:51:17.342710 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 30 01:51:17.342710 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 30 01:51:17.342710 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 30 01:51:17.342710 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 30 01:51:17.342710 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 30 01:51:17.342710 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 30 01:51:17.342710 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 30 01:51:17.342710 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 30 01:51:17.342710 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 30 01:51:17.342710 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 30 01:51:17.342710 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 30 01:51:17.342710 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 30a66547-8829-4cd4-8fa1-080814117bb4 could not be found. Oct 30 01:51:17.342710 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:51:17.342710 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:51:17.342710 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:51:17.342710 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:51:17.342710 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:51:17.342710 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:51:17.342710 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:51:17.342710 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:51:17.342710 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:51:17.342710 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:51:17.342710 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:51:17.342710 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:51:17.342710 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 30 01:51:17.342710 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:51:17.342710 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 30a66547-8829-4cd4-8fa1-080814117bb4 could not be found. Oct 30 01:51:17.342710 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:51:17.342710 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:51:17.342710 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:51:17.342710 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:51:17.342710 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:51:17.342710 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:51:17.342710 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:51:17.342710 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:51:17.342710 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 30a66547-8829-4cd4-8fa1-080814117bb4 could not be found. Oct 30 01:51:17.342710 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:51:17.342710 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-98d03839-90d6-448b-80bd-af68e9469eda tempest-VolumesSnapshotsTestJSON-171724288 tempest-VolumesSnapshotsTestJSON-171724288-project] Returning 404 to user: Volume 30a66547-8829-4cd4-8fa1-080814117bb4 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:51:17.342710 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-98d03839-90d6-448b-80bd-af68e9469eda tempest-VolumesSnapshotsTestJSON-171724288 tempest-VolumesSnapshotsTestJSON-171724288-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/30a66547-8829-4cd4-8fa1-080814117bb4" status: 404 len: 109 microversion: 2.1 time: 0.081069 Oct 30 01:51:17.342710 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3153/6315] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 30 01:51:17 2022] GET /compute/v2.1/os-volumes/30a66547-8829-4cd4-8fa1-080814117bb4 => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:51:17.348107 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-99e665c5-1165-498c-82a2-6637b3b3f480 tempest-VolumesSnapshotsTestJSON-171724288 tempest-VolumesSnapshotsTestJSON-171724288-project] Calling method '.version_select at 0x7f44cc13b310>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:51:17.416927 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-99e665c5-1165-498c-82a2-6637b3b3f480 tempest-VolumesSnapshotsTestJSON-171724288 tempest-VolumesSnapshotsTestJSON-171724288-project] HTTP exception thrown: Volume 30a66547-8829-4cd4-8fa1-080814117bb4 could not be found. Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-99e665c5-1165-498c-82a2-6637b3b3f480 tempest-VolumesSnapshotsTestJSON-171724288 tempest-VolumesSnapshotsTestJSON-171724288-project] Request method failure captured: Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/os-volumes/30a66547-8829-4cd4-8fa1-080814117bb4 HTTP/1.1 Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdiFU_qpBfkpL_9UcYuQyZKkzxzTPmvV5GGu5EKlhRke_1zRWXdHKDGR7YZwBCJT4sIgIFJ3OxrWmLRQaFMqndi2jnVqG5JyPz_mgLsYWSilLDWlctlikkhzQ0Xf2hYuYRn13sc7XQZ3vyGuZIOhpc27OwD6RMN7iePQNjHHNPbkW38 Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 460d84157c4c4366933fd5274ad0fb9b Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-171724288 Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/460d84157c4c4366933fd5274ad0fb9b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_460d84157c4c4366933fd5274ad0fb9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/460d84157c4c4366933fd5274ad0fb9b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/460d84157c4c4366933fd5274ad0fb9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-VolumesSnapshotsTestJSON-171724288 Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 460d84157c4c4366933fd5274ad0fb9b Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-171724288 Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-VolumesSnapshotsTestJSON-171724288-project Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: adaaee54d4904ef28bd5b78bb1c7b2fc Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-VolumesSnapshotsTestJSON-171724288-project Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: method: Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: exception: Volume 30a66547-8829-4cd4-8fa1-080814117bb4 could not be found. Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '30a66547-8829-4cd4-8fa1-080814117bb4'} Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 30a66547-8829-4cd4-8fa1-080814117bb4 could not be found. (HTTP 404) (Request-ID: req-ad0cbe3e-00c4-4ea6-8172-754cb28ba14b) Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 30 01:51:17.426741 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 30 01:51:17.430452 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 30 01:51:17.430452 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 30 01:51:17.430452 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 30 01:51:17.430452 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 30 01:51:17.430452 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 30 01:51:17.430452 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 30 01:51:17.430452 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 30 01:51:17.430452 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 30 01:51:17.430452 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 30 01:51:17.430452 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 30 01:51:17.430452 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 30 01:51:17.430452 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 30 01:51:17.430452 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 30 01:51:17.430452 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 30a66547-8829-4cd4-8fa1-080814117bb4 could not be found. Oct 30 01:51:17.430452 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:51:17.430452 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:51:17.430452 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:51:17.430452 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:51:17.430452 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:51:17.430452 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:51:17.430452 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:51:17.430452 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:51:17.430452 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:51:17.430452 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:51:17.430452 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:51:17.430452 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:51:17.430452 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 30 01:51:17.430452 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:51:17.430452 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 30a66547-8829-4cd4-8fa1-080814117bb4 could not be found. Oct 30 01:51:17.430452 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:51:17.430452 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:51:17.430452 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:51:17.430452 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:51:17.430452 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:51:17.430452 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:51:17.430452 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:51:17.430452 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:51:17.430452 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 30a66547-8829-4cd4-8fa1-080814117bb4 could not be found. Oct 30 01:51:17.430452 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:51:17.430452 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-99e665c5-1165-498c-82a2-6637b3b3f480 tempest-VolumesSnapshotsTestJSON-171724288 tempest-VolumesSnapshotsTestJSON-171724288-project] Returning 404 to user: Volume 30a66547-8829-4cd4-8fa1-080814117bb4 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:51:17.430452 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-99e665c5-1165-498c-82a2-6637b3b3f480 tempest-VolumesSnapshotsTestJSON-171724288 tempest-VolumesSnapshotsTestJSON-171724288-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/30a66547-8829-4cd4-8fa1-080814117bb4" status: 404 len: 109 microversion: 2.1 time: 0.084832 Oct 30 01:51:17.432679 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3163/6316] 10.222.0.13 () {58 vars in 1248 bytes} [Sun Oct 30 01:51:17 2022] DELETE /compute/v2.1/os-volumes/30a66547-8829-4cd4-8fa1-080814117bb4 => generated 109 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:51:17.436924 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e3a9f980-2577-4c31-9d84-5075d23d7316 tempest-VolumesSnapshotsTestJSON-171724288 tempest-VolumesSnapshotsTestJSON-171724288-project] Calling method '.version_select at 0x7f44c6e57c10>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:51:17.527871 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-e3a9f980-2577-4c31-9d84-5075d23d7316 tempest-VolumesSnapshotsTestJSON-171724288 tempest-VolumesSnapshotsTestJSON-171724288-project] HTTP exception thrown: Volume 30a66547-8829-4cd4-8fa1-080814117bb4 could not be found. Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e3a9f980-2577-4c31-9d84-5075d23d7316 tempest-VolumesSnapshotsTestJSON-171724288 tempest-VolumesSnapshotsTestJSON-171724288-project] Request method failure captured: Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/os-volumes/30a66547-8829-4cd4-8fa1-080814117bb4 HTTP/1.1 Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdiFU_qpBfkpL_9UcYuQyZKkzxzTPmvV5GGu5EKlhRke_1zRWXdHKDGR7YZwBCJT4sIgIFJ3OxrWmLRQaFMqndi2jnVqG5JyPz_mgLsYWSilLDWlctlikkhzQ0Xf2hYuYRn13sc7XQZ3vyGuZIOhpc27OwD6RMN7iePQNjHHNPbkW38 Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 460d84157c4c4366933fd5274ad0fb9b Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-171724288 Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/460d84157c4c4366933fd5274ad0fb9b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_460d84157c4c4366933fd5274ad0fb9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/460d84157c4c4366933fd5274ad0fb9b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/460d84157c4c4366933fd5274ad0fb9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-VolumesSnapshotsTestJSON-171724288 Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 460d84157c4c4366933fd5274ad0fb9b Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-171724288 Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-VolumesSnapshotsTestJSON-171724288-project Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: adaaee54d4904ef28bd5b78bb1c7b2fc Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-VolumesSnapshotsTestJSON-171724288-project Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: method: Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: exception: Volume 30a66547-8829-4cd4-8fa1-080814117bb4 could not be found. Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '30a66547-8829-4cd4-8fa1-080814117bb4'} Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 30a66547-8829-4cd4-8fa1-080814117bb4 could not be found. (HTTP 404) (Request-ID: req-a3e9c10f-5bce-47b8-8bf4-5f3a2cb64947) Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 30 01:51:17.538181 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 30 01:51:17.547150 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 30 01:51:17.547150 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 30 01:51:17.547150 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 30 01:51:17.547150 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 30 01:51:17.547150 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 30 01:51:17.547150 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 30 01:51:17.547150 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 30 01:51:17.547150 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 30 01:51:17.547150 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 30 01:51:17.547150 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 30 01:51:17.547150 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 30 01:51:17.547150 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 30 01:51:17.547150 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 30 01:51:17.547150 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 30a66547-8829-4cd4-8fa1-080814117bb4 could not be found. Oct 30 01:51:17.547150 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:51:17.547150 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:51:17.547150 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:51:17.547150 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:51:17.547150 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:51:17.547150 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:51:17.547150 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:51:17.547150 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:51:17.547150 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:51:17.547150 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:51:17.547150 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:51:17.547150 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:51:17.547150 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 30 01:51:17.547150 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:51:17.547150 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 30a66547-8829-4cd4-8fa1-080814117bb4 could not be found. Oct 30 01:51:17.547150 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:51:17.547150 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:51:17.547150 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:51:17.547150 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:51:17.547150 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:51:17.547150 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:51:17.547150 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:51:17.547150 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:51:17.547150 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 30a66547-8829-4cd4-8fa1-080814117bb4 could not be found. Oct 30 01:51:17.547150 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:51:17.547150 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e3a9f980-2577-4c31-9d84-5075d23d7316 tempest-VolumesSnapshotsTestJSON-171724288 tempest-VolumesSnapshotsTestJSON-171724288-project] Returning 404 to user: Volume 30a66547-8829-4cd4-8fa1-080814117bb4 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:51:17.556635 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e3a9f980-2577-4c31-9d84-5075d23d7316 tempest-VolumesSnapshotsTestJSON-171724288 tempest-VolumesSnapshotsTestJSON-171724288-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/30a66547-8829-4cd4-8fa1-080814117bb4" status: 404 len: 109 microversion: 2.1 time: 0.110156 Oct 30 01:51:17.559662 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3154/6317] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 30 01:51:17 2022] GET /compute/v2.1/os-volumes/30a66547-8829-4cd4-8fa1-080814117bb4 => generated 109 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:51:26.692314 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-76e88e63-5108-474e-a7a8-9f875f1407ec tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Action: 'create', calling method: .version_select at 0x7f44cc6f3ee0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1352884653", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLFq9PWvxTT3JzGzG1kKDZgm4tQmtaXuJy1d9huqsev3zMqqtBFgW+fvEBqqFrtPfza9jFF+Jv7Axkrr3EWll+HfDCLrNjGzeShSsKmS3eS2//iLNkrnS7+dReXdvd4yw=="}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:51:26.744458 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-76e88e63-5108-474e-a7a8-9f875f1407ec tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Getting quotas for project 735c13f1d49640319694d0a6a3a16519. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:51:26.761135 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-76e88e63-5108-474e-a7a8-9f875f1407ec tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Getting quotas for user 33a9a7ae4f5a42d7ac76baf67fdb7a2d and project 735c13f1d49640319694d0a6a3a16519. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:51:26.964113 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-76e88e63-5108-474e-a7a8-9f875f1407ec tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.264099 Oct 30 01:51:26.964113 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3164/6318] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 30 01:51:26 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:51:27.298309 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2d642a09-3ba0-495a-ab70-532557ad7d66 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:51:27.300122 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2d642a09-3ba0-495a-ab70-532557ad7d66 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] [instance: 2da44c38-67a1-416e-847b-4a848c1bb4ec] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:51:27.319890 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2d642a09-3ba0-495a-ab70-532557ad7d66 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:51:27.323256 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2d642a09-3ba0-495a-ab70-532557ad7d66 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:51:27.323256 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2d642a09-3ba0-495a-ab70-532557ad7d66 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:51:27.323256 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2d642a09-3ba0-495a-ab70-532557ad7d66 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:51:27.323256 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2d642a09-3ba0-495a-ab70-532557ad7d66 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:51:27.323860 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2d642a09-3ba0-495a-ab70-532557ad7d66 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:51:27.449809 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-2d642a09-3ba0-495a-ab70-532557ad7d66 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lazy-loading 'services' on Instance uuid 2da44c38-67a1-416e-847b-4a848c1bb4ec {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:51:27.767974 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2d642a09-3ba0-495a-ab70-532557ad7d66 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2da44c38-67a1-416e-847b-4a848c1bb4ec/os-volume_attachments/c9a37cbe-c375-448a-b7ec-aaf73443b381" status: 202 len: 0 microversion: 2.1 time: 0.499588 Oct 30 01:51:27.770079 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3155/6319] 10.222.0.13 () {58 vars in 1416 bytes} [Sun Oct 30 01:51:27 2022] DELETE /compute/v2.1/servers/2da44c38-67a1-416e-847b-4a848c1bb4ec/os-volume_attachments/c9a37cbe-c375-448a-b7ec-aaf73443b381 => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:51:31.677241 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c2af34ec-40f4-41f3-aae5-233b0830960d tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1741648123", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "40d067d9-6d94-4364-b5e2-88beef2ebef3"}], "key_name": "tempest-TestNetworkBasicOps-1352884653", "security_groups": [{"name": "tempest-secgroup-smoke-1384550346"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:51:31.861448 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-c2af34ec-40f4-41f3-aae5-233b0830960d tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] validate_networks() for [('40d067d9-6d94-4364-b5e2-88beef2ebef3', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:51:32.634839 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-c2af34ec-40f4-41f3-aae5-233b0830960d tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:51:32.635341 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-c2af34ec-40f4-41f3-aae5-233b0830960d tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:51:32.635892 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-c2af34ec-40f4-41f3-aae5-233b0830960d tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:51:32.636446 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-c2af34ec-40f4-41f3-aae5-233b0830960d tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:51:32.637105 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-c2af34ec-40f4-41f3-aae5-233b0830960d tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:51:32.652215 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c2af34ec-40f4-41f3-aae5-233b0830960d tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:51:32.652791 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c2af34ec-40f4-41f3-aae5-233b0830960d tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:51:32.660974 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c2af34ec-40f4-41f3-aae5-233b0830960d tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:51:32.662016 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c2af34ec-40f4-41f3-aae5-233b0830960d tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:51:32.662501 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c2af34ec-40f4-41f3-aae5-233b0830960d tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:51:32.664156 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c2af34ec-40f4-41f3-aae5-233b0830960d tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:51:32.687652 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-c2af34ec-40f4-41f3-aae5-233b0830960d tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Getting quotas for project 735c13f1d49640319694d0a6a3a16519. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:51:32.693374 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-c2af34ec-40f4-41f3-aae5-233b0830960d tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Getting quotas for user 33a9a7ae4f5a42d7ac76baf67fdb7a2d and project 735c13f1d49640319694d0a6a3a16519. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:51:32.706993 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c2af34ec-40f4-41f3-aae5-233b0830960d tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:51:32.709385 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c2af34ec-40f4-41f3-aae5-233b0830960d tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: d62901e2-3c37-4897-ad0d-1cea7bc6c9c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:51:32.842377 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c2af34ec-40f4-41f3-aae5-233b0830960d tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.169203 Oct 30 01:51:32.857711 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5f0e6537-daf5-48ac-a308-4548b3d1aa9e tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:51:32.859121 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5f0e6537-daf5-48ac-a308-4548b3d1aa9e tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: d62901e2-3c37-4897-ad0d-1cea7bc6c9c7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:51:32.864456 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3165/6320] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:51:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 1192 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:51:32.984311 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5f0e6537-daf5-48ac-a308-4548b3d1aa9e tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a9a7ae4f5a42d7ac76baf67fdb7a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735c13f1d49640319694d0a6a3a16519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:51:32.993826 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5f0e6537-daf5-48ac-a308-4548b3d1aa9e tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "GET /compute/v2.1/servers/d62901e2-3c37-4897-ad0d-1cea7bc6c9c7" status: 200 len: 1249 microversion: 2.1 time: 0.140706 Oct 30 01:51:32.994415 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3156/6321] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:51:32 2022] GET /compute/v2.1/servers/d62901e2-3c37-4897-ad0d-1cea7bc6c9c7 => generated 1249 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:51:34.030499 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b339ce76-985e-49c7-a5f0-6dbd6d550164 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:51:34.031135 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b339ce76-985e-49c7-a5f0-6dbd6d550164 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: d62901e2-3c37-4897-ad0d-1cea7bc6c9c7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:51:34.191436 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b339ce76-985e-49c7-a5f0-6dbd6d550164 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a9a7ae4f5a42d7ac76baf67fdb7a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735c13f1d49640319694d0a6a3a16519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:51:34.202781 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b339ce76-985e-49c7-a5f0-6dbd6d550164 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "GET /compute/v2.1/servers/d62901e2-3c37-4897-ad0d-1cea7bc6c9c7" status: 200 len: 1249 microversion: 2.1 time: 0.177165 Oct 30 01:51:34.219385 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3166/6322] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:51:34 2022] GET /compute/v2.1/servers/d62901e2-3c37-4897-ad0d-1cea7bc6c9c7 => generated 1249 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:51:35.229872 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6827089a-ef81-4385-9341-1abb94fa021a tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:51:35.230891 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6827089a-ef81-4385-9341-1abb94fa021a tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: d62901e2-3c37-4897-ad0d-1cea7bc6c9c7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:51:35.247127 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6827089a-ef81-4385-9341-1abb94fa021a tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:51:35.247639 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6827089a-ef81-4385-9341-1abb94fa021a tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:51:35.248087 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6827089a-ef81-4385-9341-1abb94fa021a tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:51:35.248810 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6827089a-ef81-4385-9341-1abb94fa021a tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:51:35.249273 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6827089a-ef81-4385-9341-1abb94fa021a tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:51:35.249958 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6827089a-ef81-4385-9341-1abb94fa021a tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:51:35.348937 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6827089a-ef81-4385-9341-1abb94fa021a tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a9a7ae4f5a42d7ac76baf67fdb7a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735c13f1d49640319694d0a6a3a16519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:51:35.357984 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6827089a-ef81-4385-9341-1abb94fa021a tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "GET /compute/v2.1/servers/d62901e2-3c37-4897-ad0d-1cea7bc6c9c7" status: 200 len: 1245 microversion: 2.1 time: 0.132797 Oct 30 01:51:35.358565 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3157/6323] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:51:35 2022] GET /compute/v2.1/servers/d62901e2-3c37-4897-ad0d-1cea7bc6c9c7 => generated 1245 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:51:36.383374 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-67bca108-89ce-46da-9d26-d99ae4c6968f tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:51:36.384719 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-67bca108-89ce-46da-9d26-d99ae4c6968f tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: d62901e2-3c37-4897-ad0d-1cea7bc6c9c7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:51:36.394887 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67bca108-89ce-46da-9d26-d99ae4c6968f tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:51:36.395558 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67bca108-89ce-46da-9d26-d99ae4c6968f tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:51:36.396190 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67bca108-89ce-46da-9d26-d99ae4c6968f tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:51:36.397762 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67bca108-89ce-46da-9d26-d99ae4c6968f tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:51:36.398387 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67bca108-89ce-46da-9d26-d99ae4c6968f tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:51:36.398968 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67bca108-89ce-46da-9d26-d99ae4c6968f tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:51:36.648292 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-67bca108-89ce-46da-9d26-d99ae4c6968f tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a9a7ae4f5a42d7ac76baf67fdb7a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735c13f1d49640319694d0a6a3a16519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:51:36.657894 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-67bca108-89ce-46da-9d26-d99ae4c6968f tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "GET /compute/v2.1/servers/d62901e2-3c37-4897-ad0d-1cea7bc6c9c7" status: 200 len: 1309 microversion: 2.1 time: 0.280356 Oct 30 01:51:36.663206 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3167/6324] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:51:36 2022] GET /compute/v2.1/servers/d62901e2-3c37-4897-ad0d-1cea7bc6c9c7 => generated 1309 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:51:36.926993 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-27c03b4f-2545-4f14-a833-6bed0d459529 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:51:36.926993 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-27c03b4f-2545-4f14-a833-6bed0d459529 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] [instance: 2da44c38-67a1-416e-847b-4a848c1bb4ec] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:51:36.935231 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-27c03b4f-2545-4f14-a833-6bed0d459529 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:51:36.935740 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-27c03b4f-2545-4f14-a833-6bed0d459529 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:51:36.936185 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-27c03b4f-2545-4f14-a833-6bed0d459529 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:51:36.937038 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-27c03b4f-2545-4f14-a833-6bed0d459529 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:51:36.937896 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-27c03b4f-2545-4f14-a833-6bed0d459529 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:51:36.938364 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-27c03b4f-2545-4f14-a833-6bed0d459529 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:51:36.971538 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-27c03b4f-2545-4f14-a833-6bed0d459529 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] [instance: 2da44c38-67a1-416e-847b-4a848c1bb4ec] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:51:37.447047 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-27c03b4f-2545-4f14-a833-6bed0d459529 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2da44c38-67a1-416e-847b-4a848c1bb4ec" status: 204 len: 0 microversion: 2.1 time: 0.524643 Oct 30 01:51:37.447649 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3158/6325] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:51:36 2022] DELETE /compute/v2.1/servers/2da44c38-67a1-416e-847b-4a848c1bb4ec => generated 0 bytes in 528 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:51:37.458571 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f505b771-5d63-4662-aab1-a00d857e50d2 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:51:37.461515 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f505b771-5d63-4662-aab1-a00d857e50d2 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] [instance: 2da44c38-67a1-416e-847b-4a848c1bb4ec] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:51:37.487935 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f505b771-5d63-4662-aab1-a00d857e50d2 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:51:37.488922 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f505b771-5d63-4662-aab1-a00d857e50d2 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:51:37.490243 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f505b771-5d63-4662-aab1-a00d857e50d2 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:51:37.492279 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f505b771-5d63-4662-aab1-a00d857e50d2 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:51:37.492903 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f505b771-5d63-4662-aab1-a00d857e50d2 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:51:37.494666 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f505b771-5d63-4662-aab1-a00d857e50d2 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:51:37.695998 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4265dbea-b58d-42c3-88b3-2a88611bddc8 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:51:37.695998 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4265dbea-b58d-42c3-88b3-2a88611bddc8 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: d62901e2-3c37-4897-ad0d-1cea7bc6c9c7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:51:37.706356 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4265dbea-b58d-42c3-88b3-2a88611bddc8 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:51:37.710097 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4265dbea-b58d-42c3-88b3-2a88611bddc8 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:51:37.710097 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4265dbea-b58d-42c3-88b3-2a88611bddc8 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:51:37.710097 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4265dbea-b58d-42c3-88b3-2a88611bddc8 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:51:37.710097 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4265dbea-b58d-42c3-88b3-2a88611bddc8 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:51:37.710097 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4265dbea-b58d-42c3-88b3-2a88611bddc8 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:51:37.830290 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4265dbea-b58d-42c3-88b3-2a88611bddc8 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a9a7ae4f5a42d7ac76baf67fdb7a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735c13f1d49640319694d0a6a3a16519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:51:37.833375 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f505b771-5d63-4662-aab1-a00d857e50d2 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb21ecdda88d49b59e11a30b0f3afc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767edc5f9e7a4c81929df4fa8a12d94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:51:37.840127 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4265dbea-b58d-42c3-88b3-2a88611bddc8 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "GET /compute/v2.1/servers/d62901e2-3c37-4897-ad0d-1cea7bc6c9c7" status: 200 len: 1307 microversion: 2.1 time: 0.152930 Oct 30 01:51:37.840699 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3159/6326] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:51:37 2022] GET /compute/v2.1/servers/d62901e2-3c37-4897-ad0d-1cea7bc6c9c7 => generated 1307 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:51:37.842137 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f505b771-5d63-4662-aab1-a00d857e50d2 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] 10.222.0.13 "GET /compute/v2.1/servers/2da44c38-67a1-416e-847b-4a848c1bb4ec" status: 200 len: 1514 microversion: 2.1 time: 0.389450 Oct 30 01:51:37.843019 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3168/6327] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:51:37 2022] GET /compute/v2.1/servers/2da44c38-67a1-416e-847b-4a848c1bb4ec => generated 1514 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:51:38.871600 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-733ac74c-d661-4cbd-8e0a-774173d688bb tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:51:38.872257 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-733ac74c-d661-4cbd-8e0a-774173d688bb tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] [instance: 2da44c38-67a1-416e-847b-4a848c1bb4ec] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:51:38.873228 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e66b3ef6-3f9b-4cf4-a2ef-0d8cdeec37e7 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:51:38.873900 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e66b3ef6-3f9b-4cf4-a2ef-0d8cdeec37e7 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: d62901e2-3c37-4897-ad0d-1cea7bc6c9c7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:51:38.899580 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e66b3ef6-3f9b-4cf4-a2ef-0d8cdeec37e7 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:51:38.899580 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e66b3ef6-3f9b-4cf4-a2ef-0d8cdeec37e7 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:51:38.899976 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e66b3ef6-3f9b-4cf4-a2ef-0d8cdeec37e7 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:51:38.900693 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e66b3ef6-3f9b-4cf4-a2ef-0d8cdeec37e7 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:51:38.901151 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e66b3ef6-3f9b-4cf4-a2ef-0d8cdeec37e7 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:51:38.901606 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e66b3ef6-3f9b-4cf4-a2ef-0d8cdeec37e7 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:51:38.905935 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-733ac74c-d661-4cbd-8e0a-774173d688bb tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:51:38.906446 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-733ac74c-d661-4cbd-8e0a-774173d688bb tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:51:38.906888 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-733ac74c-d661-4cbd-8e0a-774173d688bb tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:51:38.907622 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-733ac74c-d661-4cbd-8e0a-774173d688bb tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:51:38.908069 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-733ac74c-d661-4cbd-8e0a-774173d688bb tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:51:38.908509 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-733ac74c-d661-4cbd-8e0a-774173d688bb tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:51:39.401357 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e66b3ef6-3f9b-4cf4-a2ef-0d8cdeec37e7 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a9a7ae4f5a42d7ac76baf67fdb7a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735c13f1d49640319694d0a6a3a16519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:51:39.416304 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e66b3ef6-3f9b-4cf4-a2ef-0d8cdeec37e7 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "GET /compute/v2.1/servers/d62901e2-3c37-4897-ad0d-1cea7bc6c9c7" status: 200 len: 1375 microversion: 2.1 time: 0.553730 Oct 30 01:51:39.418902 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3160/6328] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:51:38 2022] GET /compute/v2.1/servers/d62901e2-3c37-4897-ad0d-1cea7bc6c9c7 => generated 1375 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:51:39.441424 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-733ac74c-d661-4cbd-8e0a-774173d688bb tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb21ecdda88d49b59e11a30b0f3afc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767edc5f9e7a4c81929df4fa8a12d94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:51:39.455926 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-733ac74c-d661-4cbd-8e0a-774173d688bb tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] 10.222.0.13 "GET /compute/v2.1/servers/2da44c38-67a1-416e-847b-4a848c1bb4ec" status: 200 len: 1514 microversion: 2.1 time: 0.592021 Oct 30 01:51:39.459333 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3169/6329] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:51:38 2022] GET /compute/v2.1/servers/2da44c38-67a1-416e-847b-4a848c1bb4ec => generated 1514 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:51:39.893811 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-31fc51c6-d717-4db2-bebe-a3fe766622b7 req-4d6bd7e6-308f-44e7-9547-268aae485112 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d62901e2-3c37-4897-ad0d-1cea7bc6c9c7", "tag": "0cf4f008-3e3b-4170-ac30-2b55f712e8e5"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:51:39.904960 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-31fc51c6-d717-4db2-bebe-a3fe766622b7 req-4d6bd7e6-308f-44e7-9547-268aae485112 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:51:39.906589 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-31fc51c6-d717-4db2-bebe-a3fe766622b7 req-4d6bd7e6-308f-44e7-9547-268aae485112 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:51:39.907214 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-31fc51c6-d717-4db2-bebe-a3fe766622b7 req-4d6bd7e6-308f-44e7-9547-268aae485112 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:51:39.922404 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-31fc51c6-d717-4db2-bebe-a3fe766622b7 req-4d6bd7e6-308f-44e7-9547-268aae485112 service nova] Creating event network-changed:0cf4f008-3e3b-4170-ac30-2b55f712e8e5 for instance d62901e2-3c37-4897-ad0d-1cea7bc6c9c7 on n-h1-master-1 Oct 30 01:51:39.927876 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-31fc51c6-d717-4db2-bebe-a3fe766622b7 req-4d6bd7e6-308f-44e7-9547-268aae485112 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038771 Oct 30 01:51:39.929367 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3161/6330] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:51:40.451462 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3fb1dc84-6397-4332-9dd8-5f4849e59e5b tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:51:40.452082 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3fb1dc84-6397-4332-9dd8-5f4849e59e5b tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: d62901e2-3c37-4897-ad0d-1cea7bc6c9c7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:51:40.481820 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9a48bdf1-5ecf-4b1b-b1cc-d69aa1908b88 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:51:40.482555 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9a48bdf1-5ecf-4b1b-b1cc-d69aa1908b88 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] [instance: 2da44c38-67a1-416e-847b-4a848c1bb4ec] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:51:40.489856 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3fb1dc84-6397-4332-9dd8-5f4849e59e5b tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:51:40.491961 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3fb1dc84-6397-4332-9dd8-5f4849e59e5b tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:51:40.492419 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3fb1dc84-6397-4332-9dd8-5f4849e59e5b tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:51:40.497186 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9a48bdf1-5ecf-4b1b-b1cc-d69aa1908b88 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:51:40.497719 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9a48bdf1-5ecf-4b1b-b1cc-d69aa1908b88 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:51:40.498163 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9a48bdf1-5ecf-4b1b-b1cc-d69aa1908b88 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:51:40.498874 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9a48bdf1-5ecf-4b1b-b1cc-d69aa1908b88 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:51:40.503462 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3fb1dc84-6397-4332-9dd8-5f4849e59e5b tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:51:40.504254 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3fb1dc84-6397-4332-9dd8-5f4849e59e5b tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:51:40.504710 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3fb1dc84-6397-4332-9dd8-5f4849e59e5b tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:51:40.510244 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9a48bdf1-5ecf-4b1b-b1cc-d69aa1908b88 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:51:40.510831 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9a48bdf1-5ecf-4b1b-b1cc-d69aa1908b88 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:51:40.618990 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9a48bdf1-5ecf-4b1b-b1cc-d69aa1908b88 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:51:40.619513 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9a48bdf1-5ecf-4b1b-b1cc-d69aa1908b88 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:51:40.620009 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9a48bdf1-5ecf-4b1b-b1cc-d69aa1908b88 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:51:40.620441 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-9a48bdf1-5ecf-4b1b-b1cc-d69aa1908b88 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lazy-loading 'fault' on Instance uuid 2da44c38-67a1-416e-847b-4a848c1bb4ec {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:51:40.770832 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9a48bdf1-5ecf-4b1b-b1cc-d69aa1908b88 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb21ecdda88d49b59e11a30b0f3afc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767edc5f9e7a4c81929df4fa8a12d94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:51:40.781881 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9a48bdf1-5ecf-4b1b-b1cc-d69aa1908b88 tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] 10.222.0.13 "GET /compute/v2.1/servers/2da44c38-67a1-416e-847b-4a848c1bb4ec" status: 200 len: 1309 microversion: 2.1 time: 0.305660 Oct 30 01:51:40.786123 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3162/6331] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:51:40 2022] GET /compute/v2.1/servers/2da44c38-67a1-416e-847b-4a848c1bb4ec => generated 1309 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:51:40.904929 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3fb1dc84-6397-4332-9dd8-5f4849e59e5b tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a9a7ae4f5a42d7ac76baf67fdb7a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735c13f1d49640319694d0a6a3a16519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:51:40.916089 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3fb1dc84-6397-4332-9dd8-5f4849e59e5b tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "GET /compute/v2.1/servers/d62901e2-3c37-4897-ad0d-1cea7bc6c9c7" status: 200 len: 1375 microversion: 2.1 time: 0.472442 Oct 30 01:51:40.917040 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3170/6332] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:51:40 2022] GET /compute/v2.1/servers/d62901e2-3c37-4897-ad0d-1cea7bc6c9c7 => generated 1375 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:51:41.813790 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1d6c856e-49f6-4148-9ac3-ed10b3df88db tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:51:41.813790 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1d6c856e-49f6-4148-9ac3-ed10b3df88db tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] [instance: 2da44c38-67a1-416e-847b-4a848c1bb4ec] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:51:41.824352 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1d6c856e-49f6-4148-9ac3-ed10b3df88db tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:51:41.825045 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1d6c856e-49f6-4148-9ac3-ed10b3df88db tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:51:41.825815 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1d6c856e-49f6-4148-9ac3-ed10b3df88db tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:51:41.826765 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1d6c856e-49f6-4148-9ac3-ed10b3df88db tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:51:41.827470 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1d6c856e-49f6-4148-9ac3-ed10b3df88db tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:51:41.828804 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1d6c856e-49f6-4148-9ac3-ed10b3df88db tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:51:41.847071 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-1d6c856e-49f6-4148-9ac3-ed10b3df88db tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] HTTP exception thrown: Instance 2da44c38-67a1-416e-847b-4a848c1bb4ec could not be found. Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1d6c856e-49f6-4148-9ac3-ed10b3df88db tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Request method failure captured: Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/2da44c38-67a1-416e-847b-4a848c1bb4ec HTTP/1.1 Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdeJMuLgIk3Qce-9g5FdTdHKjaYL9BTmeGl-fU7t66Vaaei8MyKi2bLu1x5vZyu8NGbgMkNTsEjQOuOqdhWVQXdFnfOVXBNKgInNowjF160dRXxA7z8_Xi4HI_mKlnLZdpUQMkjShmM2H0dd65J4H6SOqS6BrDILhNKWRsnxuMyI6NI Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 767edc5f9e7a4c81929df4fa8a12d94b Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1784009539 Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/767edc5f9e7a4c81929df4fa8a12d94b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_767edc5f9e7a4c81929df4fa8a12d94b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/767edc5f9e7a4c81929df4fa8a12d94b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/767edc5f9e7a4c81929df4fa8a12d94b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-VolumesSnapshotTestJSON-1784009539 Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 767edc5f9e7a4c81929df4fa8a12d94b Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1784009539 Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-VolumesSnapshotTestJSON-1784009539-project Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: cb21ecdda88d49b59e11a30b0f3afc72 Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-VolumesSnapshotTestJSON-1784009539-project Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 2da44c38-67a1-416e-847b-4a848c1bb4ec could not be found. Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '2da44c38-67a1-416e-847b-4a848c1bb4ec'} Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2da44c38-67a1-416e-847b-4a848c1bb4ec could not be found. Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2da44c38-67a1-416e-847b-4a848c1bb4ec could not be found. Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:51:41.849988 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:51:41.854574 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:51:41.854574 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:51:41.854574 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:51:41.854574 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:51:41.854574 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:51:41.854574 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2da44c38-67a1-416e-847b-4a848c1bb4ec could not be found. Oct 30 01:51:41.854574 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:51:41.854574 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1d6c856e-49f6-4148-9ac3-ed10b3df88db tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] Returning 404 to user: Instance 2da44c38-67a1-416e-847b-4a848c1bb4ec could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:51:41.854574 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1d6c856e-49f6-4148-9ac3-ed10b3df88db tempest-VolumesSnapshotTestJSON-1784009539 tempest-VolumesSnapshotTestJSON-1784009539-project] 10.222.0.13 "GET /compute/v2.1/servers/2da44c38-67a1-416e-847b-4a848c1bb4ec" status: 404 len: 111 microversion: 2.1 time: 0.044582 Oct 30 01:51:41.854574 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3163/6333] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:51:41 2022] GET /compute/v2.1/servers/2da44c38-67a1-416e-847b-4a848c1bb4ec => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:51:41.943053 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5b6e3ce3-962b-4698-868a-cbf8bf2d2f26 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:51:41.944877 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5b6e3ce3-962b-4698-868a-cbf8bf2d2f26 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: d62901e2-3c37-4897-ad0d-1cea7bc6c9c7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:51:41.953811 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5b6e3ce3-962b-4698-868a-cbf8bf2d2f26 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:51:41.954819 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5b6e3ce3-962b-4698-868a-cbf8bf2d2f26 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:51:41.955371 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5b6e3ce3-962b-4698-868a-cbf8bf2d2f26 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:51:41.956276 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5b6e3ce3-962b-4698-868a-cbf8bf2d2f26 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:51:41.956810 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5b6e3ce3-962b-4698-868a-cbf8bf2d2f26 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:51:41.957310 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5b6e3ce3-962b-4698-868a-cbf8bf2d2f26 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:51:41.959438 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-36e96cb0-aa49-4f17-9256-2695d962a389 req-f0cd40a7-b157-4430-9992-59ea4a33b06d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2da44c38-67a1-416e-847b-4a848c1bb4ec", "name": "network-vif-deleted", "tag": "7004236e-2948-4d0d-a11b-f39d518f397c"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:51:41.974302 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-36e96cb0-aa49-4f17-9256-2695d962a389 req-f0cd40a7-b157-4430-9992-59ea4a33b06d service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:51:41.975103 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-36e96cb0-aa49-4f17-9256-2695d962a389 req-f0cd40a7-b157-4430-9992-59ea4a33b06d service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:51:41.975685 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-36e96cb0-aa49-4f17-9256-2695d962a389 req-f0cd40a7-b157-4430-9992-59ea4a33b06d service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:51:41.989460 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-36e96cb0-aa49-4f17-9256-2695d962a389 req-f0cd40a7-b157-4430-9992-59ea4a33b06d service nova] Creating event network-vif-deleted:7004236e-2948-4d0d-a11b-f39d518f397c for instance 2da44c38-67a1-416e-847b-4a848c1bb4ec on n-h2-master-1 Oct 30 01:51:41.996493 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-36e96cb0-aa49-4f17-9256-2695d962a389 req-f0cd40a7-b157-4430-9992-59ea4a33b06d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040995 Oct 30 01:51:41.997482 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3164/6334] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:51:42.288761 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5b6e3ce3-962b-4698-868a-cbf8bf2d2f26 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a9a7ae4f5a42d7ac76baf67fdb7a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735c13f1d49640319694d0a6a3a16519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:51:42.313632 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5b6e3ce3-962b-4698-868a-cbf8bf2d2f26 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "GET /compute/v2.1/servers/d62901e2-3c37-4897-ad0d-1cea7bc6c9c7" status: 200 len: 1375 microversion: 2.1 time: 0.375960 Oct 30 01:51:42.315065 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3171/6335] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:51:41 2022] GET /compute/v2.1/servers/d62901e2-3c37-4897-ad0d-1cea7bc6c9c7 => generated 1375 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:51:43.343849 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:51:43.348276 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f1b818f4-46c9-4da1-a2de-ddab7ec16647 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:51:43.349373 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f1b818f4-46c9-4da1-a2de-ddab7ec16647 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: d62901e2-3c37-4897-ad0d-1cea7bc6c9c7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:51:43.356069 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f1b818f4-46c9-4da1-a2de-ddab7ec16647 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:51:43.356568 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f1b818f4-46c9-4da1-a2de-ddab7ec16647 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:51:43.357007 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f1b818f4-46c9-4da1-a2de-ddab7ec16647 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:51:43.359345 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f1b818f4-46c9-4da1-a2de-ddab7ec16647 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:51:43.359345 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f1b818f4-46c9-4da1-a2de-ddab7ec16647 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:51:43.359345 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f1b818f4-46c9-4da1-a2de-ddab7ec16647 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:51:43.626828 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f1b818f4-46c9-4da1-a2de-ddab7ec16647 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a9a7ae4f5a42d7ac76baf67fdb7a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735c13f1d49640319694d0a6a3a16519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:51:43.658821 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f1b818f4-46c9-4da1-a2de-ddab7ec16647 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "GET /compute/v2.1/servers/d62901e2-3c37-4897-ad0d-1cea7bc6c9c7" status: 200 len: 1375 microversion: 2.1 time: 0.316623 Oct 30 01:51:43.664775 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3165/6336] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:51:43 2022] GET /compute/v2.1/servers/d62901e2-3c37-4897-ad0d-1cea7bc6c9c7 => generated 1375 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:51:44.691361 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bc6c523f-2d36-4b06-b4a2-361111736db4 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:51:44.692219 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bc6c523f-2d36-4b06-b4a2-361111736db4 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: d62901e2-3c37-4897-ad0d-1cea7bc6c9c7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:51:44.694553 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:51:44.696213 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=12 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:51:44.705197 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bc6c523f-2d36-4b06-b4a2-361111736db4 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:51:44.708516 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bc6c523f-2d36-4b06-b4a2-361111736db4 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:51:44.710119 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bc6c523f-2d36-4b06-b4a2-361111736db4 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:51:44.712417 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bc6c523f-2d36-4b06-b4a2-361111736db4 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:51:44.713121 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bc6c523f-2d36-4b06-b4a2-361111736db4 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:51:44.713831 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bc6c523f-2d36-4b06-b4a2-361111736db4 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:51:45.034148 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bc6c523f-2d36-4b06-b4a2-361111736db4 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a9a7ae4f5a42d7ac76baf67fdb7a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735c13f1d49640319694d0a6a3a16519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:51:45.055232 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bc6c523f-2d36-4b06-b4a2-361111736db4 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "GET /compute/v2.1/servers/d62901e2-3c37-4897-ad0d-1cea7bc6c9c7" status: 200 len: 1375 microversion: 2.1 time: 0.368637 Oct 30 01:51:45.057063 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3172/6337] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:51:44 2022] GET /compute/v2.1/servers/d62901e2-3c37-4897-ad0d-1cea7bc6c9c7 => generated 1375 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:51:45.593704 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-d052787e-45c2-4491-8ec1-35feea53bce6 req-e4b67784-7ade-45b9-8a75-84429599aed9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d62901e2-3c37-4897-ad0d-1cea7bc6c9c7", "name": "network-vif-plugged", "status": "completed", "tag": "0cf4f008-3e3b-4170-ac30-2b55f712e8e5"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:51:45.615163 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d052787e-45c2-4491-8ec1-35feea53bce6 req-e4b67784-7ade-45b9-8a75-84429599aed9 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:51:45.616824 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d052787e-45c2-4491-8ec1-35feea53bce6 req-e4b67784-7ade-45b9-8a75-84429599aed9 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:51:45.617275 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d052787e-45c2-4491-8ec1-35feea53bce6 req-e4b67784-7ade-45b9-8a75-84429599aed9 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:51:45.652930 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-d052787e-45c2-4491-8ec1-35feea53bce6 req-e4b67784-7ade-45b9-8a75-84429599aed9 service nova] Creating event network-vif-plugged:0cf4f008-3e3b-4170-ac30-2b55f712e8e5 for instance d62901e2-3c37-4897-ad0d-1cea7bc6c9c7 on n-h1-master-1 Oct 30 01:51:45.663241 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-d052787e-45c2-4491-8ec1-35feea53bce6 req-e4b67784-7ade-45b9-8a75-84429599aed9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075426 Oct 30 01:51:45.663947 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3166/6338] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:51:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:51:46.082161 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f383b78f-3886-4682-bc8f-57bece327c19 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:51:46.083427 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f383b78f-3886-4682-bc8f-57bece327c19 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: d62901e2-3c37-4897-ad0d-1cea7bc6c9c7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:51:46.102084 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f383b78f-3886-4682-bc8f-57bece327c19 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:51:46.102084 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f383b78f-3886-4682-bc8f-57bece327c19 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:51:46.102084 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f383b78f-3886-4682-bc8f-57bece327c19 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:51:46.102084 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f383b78f-3886-4682-bc8f-57bece327c19 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:51:46.102084 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f383b78f-3886-4682-bc8f-57bece327c19 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:51:46.102084 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f383b78f-3886-4682-bc8f-57bece327c19 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:51:46.322696 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f383b78f-3886-4682-bc8f-57bece327c19 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a9a7ae4f5a42d7ac76baf67fdb7a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735c13f1d49640319694d0a6a3a16519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:51:46.336106 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f383b78f-3886-4682-bc8f-57bece327c19 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "GET /compute/v2.1/servers/d62901e2-3c37-4897-ad0d-1cea7bc6c9c7" status: 200 len: 1375 microversion: 2.1 time: 0.258262 Oct 30 01:51:46.362849 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3173/6339] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:51:46 2022] GET /compute/v2.1/servers/d62901e2-3c37-4897-ad0d-1cea7bc6c9c7 => generated 1375 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:51:47.370047 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-54651f49-1b37-4ca4-90de-b0fd748f6529 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:51:47.371464 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-54651f49-1b37-4ca4-90de-b0fd748f6529 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: d62901e2-3c37-4897-ad0d-1cea7bc6c9c7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:51:47.383934 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-54651f49-1b37-4ca4-90de-b0fd748f6529 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:51:47.385464 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-54651f49-1b37-4ca4-90de-b0fd748f6529 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:51:47.387484 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-54651f49-1b37-4ca4-90de-b0fd748f6529 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:51:47.389004 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-54651f49-1b37-4ca4-90de-b0fd748f6529 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:51:47.389733 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-54651f49-1b37-4ca4-90de-b0fd748f6529 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:51:47.391201 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-54651f49-1b37-4ca4-90de-b0fd748f6529 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:51:47.690915 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-54651f49-1b37-4ca4-90de-b0fd748f6529 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a9a7ae4f5a42d7ac76baf67fdb7a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735c13f1d49640319694d0a6a3a16519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:51:47.702540 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-54651f49-1b37-4ca4-90de-b0fd748f6529 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "GET /compute/v2.1/servers/d62901e2-3c37-4897-ad0d-1cea7bc6c9c7" status: 200 len: 1375 microversion: 2.1 time: 0.338600 Oct 30 01:51:47.703818 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3167/6340] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:51:47 2022] GET /compute/v2.1/servers/d62901e2-3c37-4897-ad0d-1cea7bc6c9c7 => generated 1375 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:51:48.729407 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-744210e0-f984-42c7-b904-6bc62ae03dc1 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:51:48.730120 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-744210e0-f984-42c7-b904-6bc62ae03dc1 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: d62901e2-3c37-4897-ad0d-1cea7bc6c9c7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:51:48.738452 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-744210e0-f984-42c7-b904-6bc62ae03dc1 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:51:48.750117 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-744210e0-f984-42c7-b904-6bc62ae03dc1 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:51:48.757142 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-744210e0-f984-42c7-b904-6bc62ae03dc1 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:51:48.757967 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-744210e0-f984-42c7-b904-6bc62ae03dc1 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:51:48.758453 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-744210e0-f984-42c7-b904-6bc62ae03dc1 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:51:48.758892 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-744210e0-f984-42c7-b904-6bc62ae03dc1 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:51:49.031901 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-744210e0-f984-42c7-b904-6bc62ae03dc1 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a9a7ae4f5a42d7ac76baf67fdb7a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735c13f1d49640319694d0a6a3a16519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:51:49.044497 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-744210e0-f984-42c7-b904-6bc62ae03dc1 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "GET /compute/v2.1/servers/d62901e2-3c37-4897-ad0d-1cea7bc6c9c7" status: 200 len: 1547 microversion: 2.1 time: 0.321685 Oct 30 01:51:49.048237 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3174/6341] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:51:48 2022] GET /compute/v2.1/servers/d62901e2-3c37-4897-ad0d-1cea7bc6c9c7 => generated 1547 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:51:49.069274 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1af4dcfb-4fc2-4a00-9f59-f91f62a13c75 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:51:49.069917 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1af4dcfb-4fc2-4a00-9f59-f91f62a13c75 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: d62901e2-3c37-4897-ad0d-1cea7bc6c9c7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:51:49.081844 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1af4dcfb-4fc2-4a00-9f59-f91f62a13c75 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:51:49.082317 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1af4dcfb-4fc2-4a00-9f59-f91f62a13c75 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:51:49.087093 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1af4dcfb-4fc2-4a00-9f59-f91f62a13c75 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:51:49.087093 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1af4dcfb-4fc2-4a00-9f59-f91f62a13c75 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:51:49.087093 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1af4dcfb-4fc2-4a00-9f59-f91f62a13c75 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:51:49.087093 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1af4dcfb-4fc2-4a00-9f59-f91f62a13c75 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:51:49.410190 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1af4dcfb-4fc2-4a00-9f59-f91f62a13c75 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a9a7ae4f5a42d7ac76baf67fdb7a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735c13f1d49640319694d0a6a3a16519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:51:49.427081 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1af4dcfb-4fc2-4a00-9f59-f91f62a13c75 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "GET /compute/v2.1/servers/d62901e2-3c37-4897-ad0d-1cea7bc6c9c7" status: 200 len: 1547 microversion: 2.1 time: 0.359235 Oct 30 01:51:49.431897 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3168/6342] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:51:49 2022] GET /compute/v2.1/servers/d62901e2-3c37-4897-ad0d-1cea7bc6c9c7 => generated 1547 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:51:53.306252 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-7dc67abf-b56a-4f1c-9f42-31fa8e900433 req-d2387e34-bbd0-4320-9512-ab61515fbf76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d62901e2-3c37-4897-ad0d-1cea7bc6c9c7", "tag": "0cf4f008-3e3b-4170-ac30-2b55f712e8e5"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:51:53.337245 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-7dc67abf-b56a-4f1c-9f42-31fa8e900433 req-d2387e34-bbd0-4320-9512-ab61515fbf76 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:51:53.338290 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-7dc67abf-b56a-4f1c-9f42-31fa8e900433 req-d2387e34-bbd0-4320-9512-ab61515fbf76 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:51:53.339914 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-7dc67abf-b56a-4f1c-9f42-31fa8e900433 req-d2387e34-bbd0-4320-9512-ab61515fbf76 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:51:53.383780 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-7dc67abf-b56a-4f1c-9f42-31fa8e900433 req-d2387e34-bbd0-4320-9512-ab61515fbf76 service nova] Creating event network-changed:0cf4f008-3e3b-4170-ac30-2b55f712e8e5 for instance d62901e2-3c37-4897-ad0d-1cea7bc6c9c7 on n-h1-master-1 Oct 30 01:51:53.399184 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-7dc67abf-b56a-4f1c-9f42-31fa8e900433 req-d2387e34-bbd0-4320-9512-ab61515fbf76 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.455754 Oct 30 01:51:53.402505 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3175/6343] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:51:54.798650 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7a2139de-83dc-429c-b0d4-18fa9816c93c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Action: 'create', calling method: .version_select at 0x7f44c6e44d30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-139940220", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE58E0iXnste+02Z6oypg9zcHHN72VoQnr4c/PSNQsODi9g8zo2KR3YLnnfbdB0vgF2Ya6V7vM1Y24L9avb/Ki4MH49sJs9EqjHAx0vVtnSrOvg8qm7nKVDXddQBRxmVSQ=="}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:51:54.814905 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-7a2139de-83dc-429c-b0d4-18fa9816c93c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Getting quotas for project f2bf165fe12748b29e66ea4f61364aef. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:51:54.821537 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-7a2139de-83dc-429c-b0d4-18fa9816c93c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Getting quotas for user f0f51fe515ee4375a252a8d8a98ec77b and project f2bf165fe12748b29e66ea4f61364aef. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:51:55.007616 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7a2139de-83dc-429c-b0d4-18fa9816c93c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.424562 Oct 30 01:51:55.013827 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3169/6344] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 30 01:51:54 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:52:08.741319 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a7301dd6-bea2-4281-8e5a-8efcbc79581c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1345654698", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "d611dffd-7f4f-4bc9-b603-bb5dbe62a00d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-139940220", "security_groups": [{"name": "tempest-secgroup-smoke-16630554"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:52:08.782676 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=4 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:52:08.783395 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=52 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:52:09.097086 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-a7301dd6-bea2-4281-8e5a-8efcbc79581c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] validate_networks() for [('d611dffd-7f4f-4bc9-b603-bb5dbe62a00d', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:52:09.978763 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-a7301dd6-bea2-4281-8e5a-8efcbc79581c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:52:09.979429 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-a7301dd6-bea2-4281-8e5a-8efcbc79581c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:52:09.980016 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-a7301dd6-bea2-4281-8e5a-8efcbc79581c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:52:09.981064 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-a7301dd6-bea2-4281-8e5a-8efcbc79581c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:52:09.981540 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-a7301dd6-bea2-4281-8e5a-8efcbc79581c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:52:09.999636 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7301dd6-bea2-4281-8e5a-8efcbc79581c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:52:10.003150 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7301dd6-bea2-4281-8e5a-8efcbc79581c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:52:10.003660 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7301dd6-bea2-4281-8e5a-8efcbc79581c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:52:10.004454 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7301dd6-bea2-4281-8e5a-8efcbc79581c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:52:10.005901 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7301dd6-bea2-4281-8e5a-8efcbc79581c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:52:10.006202 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7301dd6-bea2-4281-8e5a-8efcbc79581c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:52:10.054343 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-a7301dd6-bea2-4281-8e5a-8efcbc79581c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Getting quotas for project f2bf165fe12748b29e66ea4f61364aef. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:52:10.068913 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-a7301dd6-bea2-4281-8e5a-8efcbc79581c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Getting quotas for user f0f51fe515ee4375a252a8d8a98ec77b and project f2bf165fe12748b29e66ea4f61364aef. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:52:10.100628 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a7301dd6-bea2-4281-8e5a-8efcbc79581c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:52:10.106660 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a7301dd6-bea2-4281-8e5a-8efcbc79581c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: c83d025e-76be-4e93-a864-936fbf5f7a16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:52:10.276182 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a7301dd6-bea2-4281-8e5a-8efcbc79581c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.538806 Oct 30 01:52:10.288983 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d614affd-dcd1-4a09-8db5-d05771d93459 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:52:10.290770 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d614affd-dcd1-4a09-8db5-d05771d93459 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: c83d025e-76be-4e93-a864-936fbf5f7a16] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:52:10.302987 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3176/6345] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:52:08 2022] POST /compute/v2.1/servers => generated 404 bytes in 1547 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:52:10.303146 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=75,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:52:10.303146 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=4 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:52:10.303146 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:52:10.436351 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d614affd-dcd1-4a09-8db5-d05771d93459 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:52:10.452014 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d614affd-dcd1-4a09-8db5-d05771d93459 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16" status: 200 len: 1266 microversion: 2.1 time: 0.167014 Oct 30 01:52:10.461365 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3170/6346] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:52:10 2022] GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:52:11.416640 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6732d58d-6e9e-406f-9cf0-9f758bdabd4c tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:52:11.422053 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6732d58d-6e9e-406f-9cf0-9f758bdabd4c tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: d62901e2-3c37-4897-ad0d-1cea7bc6c9c7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:52:11.432973 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6732d58d-6e9e-406f-9cf0-9f758bdabd4c tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:52:11.433658 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6732d58d-6e9e-406f-9cf0-9f758bdabd4c tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:52:11.434269 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6732d58d-6e9e-406f-9cf0-9f758bdabd4c tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:52:11.435503 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6732d58d-6e9e-406f-9cf0-9f758bdabd4c tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:52:11.436586 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6732d58d-6e9e-406f-9cf0-9f758bdabd4c tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:52:11.437236 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6732d58d-6e9e-406f-9cf0-9f758bdabd4c tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:52:11.483946 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-55fcb0a9-2570-4789-8e22-83a3375e92fe tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:52:11.484566 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-55fcb0a9-2570-4789-8e22-83a3375e92fe tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: c83d025e-76be-4e93-a864-936fbf5f7a16] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:52:11.525194 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6732d58d-6e9e-406f-9cf0-9f758bdabd4c tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "POST /compute/v2.1/servers/d62901e2-3c37-4897-ad0d-1cea7bc6c9c7/action" status: 200 len: 24570 microversion: 2.1 time: 0.117163 Oct 30 01:52:11.526007 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3177/6347] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:52:11 2022] POST /compute/v2.1/servers/d62901e2-3c37-4897-ad0d-1cea7bc6c9c7/action => generated 24570 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:52:11.574149 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-55fcb0a9-2570-4789-8e22-83a3375e92fe tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:52:11.594201 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-55fcb0a9-2570-4789-8e22-83a3375e92fe tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16" status: 200 len: 1266 microversion: 2.1 time: 0.114083 Oct 30 01:52:11.595296 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3171/6348] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:52:11 2022] GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16 => generated 1266 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:52:12.619253 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-023439f5-5e90-44d2-9cfc-bae7dab18c32 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:52:12.620616 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-023439f5-5e90-44d2-9cfc-bae7dab18c32 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: c83d025e-76be-4e93-a864-936fbf5f7a16] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:52:12.628207 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-023439f5-5e90-44d2-9cfc-bae7dab18c32 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:52:12.628921 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-023439f5-5e90-44d2-9cfc-bae7dab18c32 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:52:12.630327 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-023439f5-5e90-44d2-9cfc-bae7dab18c32 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:52:12.631965 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-023439f5-5e90-44d2-9cfc-bae7dab18c32 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:52:12.632603 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-023439f5-5e90-44d2-9cfc-bae7dab18c32 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:52:12.633198 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-023439f5-5e90-44d2-9cfc-bae7dab18c32 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:52:12.703416 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-023439f5-5e90-44d2-9cfc-bae7dab18c32 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:52:12.713570 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-023439f5-5e90-44d2-9cfc-bae7dab18c32 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16" status: 200 len: 1262 microversion: 2.1 time: 0.099155 Oct 30 01:52:12.714257 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3178/6349] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:52:12 2022] GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16 => generated 1262 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:52:13.736249 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2214fef6-0d30-4584-a67b-ce795384c781 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:52:13.737491 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2214fef6-0d30-4584-a67b-ce795384c781 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: c83d025e-76be-4e93-a864-936fbf5f7a16] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:52:13.748175 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2214fef6-0d30-4584-a67b-ce795384c781 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:52:13.748921 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2214fef6-0d30-4584-a67b-ce795384c781 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:52:13.749575 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2214fef6-0d30-4584-a67b-ce795384c781 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:52:13.750463 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2214fef6-0d30-4584-a67b-ce795384c781 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:52:13.751070 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2214fef6-0d30-4584-a67b-ce795384c781 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:52:13.751652 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2214fef6-0d30-4584-a67b-ce795384c781 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:52:13.929725 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2214fef6-0d30-4584-a67b-ce795384c781 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:52:13.940212 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2214fef6-0d30-4584-a67b-ce795384c781 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16" status: 200 len: 1326 microversion: 2.1 time: 0.207192 Oct 30 01:52:13.957645 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3172/6350] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:52:13 2022] GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16 => generated 1326 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:52:14.967173 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e86042fb-2e03-4f1e-aa0a-1a865b05a337 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:52:14.968099 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e86042fb-2e03-4f1e-aa0a-1a865b05a337 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: c83d025e-76be-4e93-a864-936fbf5f7a16] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:52:14.984256 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e86042fb-2e03-4f1e-aa0a-1a865b05a337 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:52:14.984858 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e86042fb-2e03-4f1e-aa0a-1a865b05a337 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:52:14.985866 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e86042fb-2e03-4f1e-aa0a-1a865b05a337 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:52:14.986817 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e86042fb-2e03-4f1e-aa0a-1a865b05a337 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:52:14.987481 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e86042fb-2e03-4f1e-aa0a-1a865b05a337 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:52:14.988353 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e86042fb-2e03-4f1e-aa0a-1a865b05a337 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:52:15.102052 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e86042fb-2e03-4f1e-aa0a-1a865b05a337 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:52:15.118580 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e86042fb-2e03-4f1e-aa0a-1a865b05a337 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16" status: 200 len: 1324 microversion: 2.1 time: 0.155567 Oct 30 01:52:15.120837 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3179/6351] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:52:14 2022] GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16 => generated 1324 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:52:16.145922 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cdeb36f9-61b0-4b7e-8927-719b2f9d8cc9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:52:16.146594 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-cdeb36f9-61b0-4b7e-8927-719b2f9d8cc9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: c83d025e-76be-4e93-a864-936fbf5f7a16] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:52:16.172962 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cdeb36f9-61b0-4b7e-8927-719b2f9d8cc9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:52:16.174039 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cdeb36f9-61b0-4b7e-8927-719b2f9d8cc9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:52:16.174911 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cdeb36f9-61b0-4b7e-8927-719b2f9d8cc9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:52:16.175793 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cdeb36f9-61b0-4b7e-8927-719b2f9d8cc9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:52:16.181670 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cdeb36f9-61b0-4b7e-8927-719b2f9d8cc9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:52:16.182434 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cdeb36f9-61b0-4b7e-8927-719b2f9d8cc9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:52:16.939544 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-cdeb36f9-61b0-4b7e-8927-719b2f9d8cc9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:52:16.954822 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cdeb36f9-61b0-4b7e-8927-719b2f9d8cc9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16" status: 200 len: 1390 microversion: 2.1 time: 0.815476 Oct 30 01:52:16.958000 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3173/6352] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:52:16 2022] GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16 => generated 1390 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:52:17.969148 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-ba9d72ab-7ab4-42d2-8dd7-4c42e5a5d8a8 req-6acde6d4-28c1-4196-9b35-e7598dcc4544 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c83d025e-76be-4e93-a864-936fbf5f7a16", "tag": "065ae8cd-82e5-483d-82fe-f09b43b9bc76"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:52:17.985187 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-428e8731-e8ff-46a5-95ae-9148b6aaf4aa tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:52:17.985851 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-428e8731-e8ff-46a5-95ae-9148b6aaf4aa tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: c83d025e-76be-4e93-a864-936fbf5f7a16] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:52:18.006572 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-428e8731-e8ff-46a5-95ae-9148b6aaf4aa tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:52:18.014181 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-428e8731-e8ff-46a5-95ae-9148b6aaf4aa tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:52:18.020004 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ba9d72ab-7ab4-42d2-8dd7-4c42e5a5d8a8 req-6acde6d4-28c1-4196-9b35-e7598dcc4544 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:52:18.020881 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-428e8731-e8ff-46a5-95ae-9148b6aaf4aa tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:52:18.021828 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-428e8731-e8ff-46a5-95ae-9148b6aaf4aa tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:52:18.024038 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-428e8731-e8ff-46a5-95ae-9148b6aaf4aa tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:52:18.027210 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ba9d72ab-7ab4-42d2-8dd7-4c42e5a5d8a8 req-6acde6d4-28c1-4196-9b35-e7598dcc4544 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:52:18.033598 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-428e8731-e8ff-46a5-95ae-9148b6aaf4aa tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:52:18.035232 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ba9d72ab-7ab4-42d2-8dd7-4c42e5a5d8a8 req-6acde6d4-28c1-4196-9b35-e7598dcc4544 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:52:18.117092 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-ba9d72ab-7ab4-42d2-8dd7-4c42e5a5d8a8 req-6acde6d4-28c1-4196-9b35-e7598dcc4544 service nova] Creating event network-changed:065ae8cd-82e5-483d-82fe-f09b43b9bc76 for instance c83d025e-76be-4e93-a864-936fbf5f7a16 on n-h2-master-1 Oct 30 01:52:18.135739 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-ba9d72ab-7ab4-42d2-8dd7-4c42e5a5d8a8 req-6acde6d4-28c1-4196-9b35-e7598dcc4544 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.179543 Oct 30 01:52:18.137273 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3180/6353] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:52:18.443853 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-428e8731-e8ff-46a5-95ae-9148b6aaf4aa tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:52:18.456046 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-428e8731-e8ff-46a5-95ae-9148b6aaf4aa tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16" status: 200 len: 1390 microversion: 2.1 time: 0.475788 Oct 30 01:52:18.466071 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3174/6354] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:52:17 2022] GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16 => generated 1390 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:52:19.483465 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1a7cc8d7-6aef-43e8-9545-293c7f8970df tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:52:19.484186 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1a7cc8d7-6aef-43e8-9545-293c7f8970df tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: c83d025e-76be-4e93-a864-936fbf5f7a16] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:52:19.497569 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1a7cc8d7-6aef-43e8-9545-293c7f8970df tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:52:19.499699 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1a7cc8d7-6aef-43e8-9545-293c7f8970df tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:52:19.500957 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1a7cc8d7-6aef-43e8-9545-293c7f8970df tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:52:19.503085 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1a7cc8d7-6aef-43e8-9545-293c7f8970df tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:52:19.505421 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1a7cc8d7-6aef-43e8-9545-293c7f8970df tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:52:19.505421 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1a7cc8d7-6aef-43e8-9545-293c7f8970df tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:52:19.853295 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1a7cc8d7-6aef-43e8-9545-293c7f8970df tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:52:19.867585 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1a7cc8d7-6aef-43e8-9545-293c7f8970df tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16" status: 200 len: 1390 microversion: 2.1 time: 0.389119 Oct 30 01:52:19.871139 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3181/6355] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:52:19 2022] GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16 => generated 1390 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:52:20.893700 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9e9e70f1-3691-4d31-b71d-3c9bbe53a136 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:52:20.895416 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9e9e70f1-3691-4d31-b71d-3c9bbe53a136 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: c83d025e-76be-4e93-a864-936fbf5f7a16] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:52:20.902973 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e9e70f1-3691-4d31-b71d-3c9bbe53a136 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:52:20.903471 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e9e70f1-3691-4d31-b71d-3c9bbe53a136 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:52:20.903912 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e9e70f1-3691-4d31-b71d-3c9bbe53a136 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:52:20.904713 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e9e70f1-3691-4d31-b71d-3c9bbe53a136 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:52:20.905166 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e9e70f1-3691-4d31-b71d-3c9bbe53a136 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:52:20.905712 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e9e70f1-3691-4d31-b71d-3c9bbe53a136 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:52:21.084572 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9e9e70f1-3691-4d31-b71d-3c9bbe53a136 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:52:21.119851 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9e9e70f1-3691-4d31-b71d-3c9bbe53a136 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16" status: 200 len: 1390 microversion: 2.1 time: 0.230218 Oct 30 01:52:21.120456 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3175/6356] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:52:20 2022] GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16 => generated 1390 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:52:22.147852 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0dafe374-f72e-4fef-8056-b00e6e388f46 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:52:22.148767 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0dafe374-f72e-4fef-8056-b00e6e388f46 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: c83d025e-76be-4e93-a864-936fbf5f7a16] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:52:22.150984 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:52:22.158349 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=6 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:52:22.158349 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0dafe374-f72e-4fef-8056-b00e6e388f46 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:52:22.158349 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0dafe374-f72e-4fef-8056-b00e6e388f46 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:52:22.158776 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0dafe374-f72e-4fef-8056-b00e6e388f46 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:52:22.159345 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0dafe374-f72e-4fef-8056-b00e6e388f46 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:52:22.159809 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0dafe374-f72e-4fef-8056-b00e6e388f46 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:52:22.160238 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0dafe374-f72e-4fef-8056-b00e6e388f46 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:52:22.311330 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0dafe374-f72e-4fef-8056-b00e6e388f46 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:52:22.330845 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0dafe374-f72e-4fef-8056-b00e6e388f46 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16" status: 200 len: 1390 microversion: 2.1 time: 0.188162 Oct 30 01:52:22.341582 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3182/6357] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:52:22 2022] GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16 => generated 1390 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:52:23.374793 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7fd0bd37-ff36-4a04-8fa8-fb486ab24269 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:52:23.380648 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7fd0bd37-ff36-4a04-8fa8-fb486ab24269 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: c83d025e-76be-4e93-a864-936fbf5f7a16] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:52:23.384375 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=4 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:52:23.399653 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7fd0bd37-ff36-4a04-8fa8-fb486ab24269 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:52:23.403470 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7fd0bd37-ff36-4a04-8fa8-fb486ab24269 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:52:23.409505 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7fd0bd37-ff36-4a04-8fa8-fb486ab24269 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:52:23.409505 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7fd0bd37-ff36-4a04-8fa8-fb486ab24269 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:52:23.409505 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7fd0bd37-ff36-4a04-8fa8-fb486ab24269 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:52:23.409505 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7fd0bd37-ff36-4a04-8fa8-fb486ab24269 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:52:23.663898 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7fd0bd37-ff36-4a04-8fa8-fb486ab24269 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:52:23.675493 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7fd0bd37-ff36-4a04-8fa8-fb486ab24269 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16" status: 200 len: 1390 microversion: 2.1 time: 0.323534 Oct 30 01:52:23.678963 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3176/6358] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:52:23 2022] GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16 => generated 1390 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:52:23.741147 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-5f01d402-4fc6-4167-b21f-2326b18a80db req-5ffd5447-be84-4935-b031-b76eaf652ed5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c83d025e-76be-4e93-a864-936fbf5f7a16", "name": "network-vif-plugged", "status": "completed", "tag": "065ae8cd-82e5-483d-82fe-f09b43b9bc76"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:52:23.755287 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-5f01d402-4fc6-4167-b21f-2326b18a80db req-5ffd5447-be84-4935-b031-b76eaf652ed5 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:52:23.755865 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-5f01d402-4fc6-4167-b21f-2326b18a80db req-5ffd5447-be84-4935-b031-b76eaf652ed5 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:52:23.756420 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-5f01d402-4fc6-4167-b21f-2326b18a80db req-5ffd5447-be84-4935-b031-b76eaf652ed5 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:52:23.773991 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-5f01d402-4fc6-4167-b21f-2326b18a80db req-5ffd5447-be84-4935-b031-b76eaf652ed5 service nova] Creating event network-vif-plugged:065ae8cd-82e5-483d-82fe-f09b43b9bc76 for instance c83d025e-76be-4e93-a864-936fbf5f7a16 on n-h2-master-1 Oct 30 01:52:23.779809 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-5f01d402-4fc6-4167-b21f-2326b18a80db req-5ffd5447-be84-4935-b031-b76eaf652ed5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044265 Oct 30 01:52:23.780747 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3183/6359] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:52:24.703630 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b42dd8fd-6c29-41fe-98be-42ade42ee892 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:52:24.704304 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b42dd8fd-6c29-41fe-98be-42ade42ee892 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: c83d025e-76be-4e93-a864-936fbf5f7a16] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:52:24.713673 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b42dd8fd-6c29-41fe-98be-42ade42ee892 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:52:24.714189 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b42dd8fd-6c29-41fe-98be-42ade42ee892 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:52:24.714588 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b42dd8fd-6c29-41fe-98be-42ade42ee892 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:52:24.715295 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b42dd8fd-6c29-41fe-98be-42ade42ee892 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:52:24.715742 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b42dd8fd-6c29-41fe-98be-42ade42ee892 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:52:24.716161 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b42dd8fd-6c29-41fe-98be-42ade42ee892 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:52:24.935799 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b42dd8fd-6c29-41fe-98be-42ade42ee892 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:52:24.944214 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b42dd8fd-6c29-41fe-98be-42ade42ee892 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16" status: 200 len: 1390 microversion: 2.1 time: 0.245182 Oct 30 01:52:24.956467 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3177/6360] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:52:24 2022] GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16 => generated 1390 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:52:25.973850 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8f860416-9ffa-4ae4-a6ff-0443761aa47f tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:52:25.974671 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8f860416-9ffa-4ae4-a6ff-0443761aa47f tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: c83d025e-76be-4e93-a864-936fbf5f7a16] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:52:25.983592 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8f860416-9ffa-4ae4-a6ff-0443761aa47f tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:52:25.984346 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8f860416-9ffa-4ae4-a6ff-0443761aa47f tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:52:25.984974 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8f860416-9ffa-4ae4-a6ff-0443761aa47f tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:52:25.985866 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8f860416-9ffa-4ae4-a6ff-0443761aa47f tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:52:25.986478 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8f860416-9ffa-4ae4-a6ff-0443761aa47f tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:52:25.987055 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8f860416-9ffa-4ae4-a6ff-0443761aa47f tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:52:26.289123 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8f860416-9ffa-4ae4-a6ff-0443761aa47f tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:52:26.302691 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8f860416-9ffa-4ae4-a6ff-0443761aa47f tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16" status: 200 len: 1562 microversion: 2.1 time: 0.333973 Oct 30 01:52:26.304593 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3184/6361] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:52:25 2022] GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16 => generated 1562 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:52:26.333528 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-63279708-84df-4149-8f63-d581ec4c3b24 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:52:26.334925 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-63279708-84df-4149-8f63-d581ec4c3b24 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: c83d025e-76be-4e93-a864-936fbf5f7a16] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:52:26.344389 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-63279708-84df-4149-8f63-d581ec4c3b24 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:52:26.347150 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-63279708-84df-4149-8f63-d581ec4c3b24 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:52:26.347150 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-63279708-84df-4149-8f63-d581ec4c3b24 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:52:26.347150 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-63279708-84df-4149-8f63-d581ec4c3b24 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:52:26.347150 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-63279708-84df-4149-8f63-d581ec4c3b24 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:52:26.347150 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-63279708-84df-4149-8f63-d581ec4c3b24 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:52:26.908189 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-63279708-84df-4149-8f63-d581ec4c3b24 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:52:26.929816 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-63279708-84df-4149-8f63-d581ec4c3b24 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16" status: 200 len: 1562 microversion: 2.1 time: 0.602131 Oct 30 01:52:26.931683 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3178/6362] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:52:26 2022] GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16 => generated 1562 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:52:27.767593 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f2d2428e-6fc8-48f7-b0e2-5eedf124f337 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Action: 'create', calling method: .version_select at 0x7f44cc258160>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-2072841535", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwCIyNUyalpUJD0nnPs7ImatNn81s77ZlnpXhbyYq+g0znURV6dm24Qpa+4zlmKZzfqmxzJRFTQwdKgUjqVQX+4y5yVVsUUSI44vjZjCEWigMAoX1KHIbRAmZHhUlkdGQ=="}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:52:27.787087 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-f2d2428e-6fc8-48f7-b0e2-5eedf124f337 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Getting quotas for project 735c13f1d49640319694d0a6a3a16519. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:52:27.793394 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-f2d2428e-6fc8-48f7-b0e2-5eedf124f337 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Getting quotas for user 33a9a7ae4f5a42d7ac76baf67fdb7a2d and project 735c13f1d49640319694d0a6a3a16519. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:52:27.892633 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f2d2428e-6fc8-48f7-b0e2-5eedf124f337 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.128920 Oct 30 01:52:27.894370 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3185/6363] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 30 01:52:27 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:52:30.088552 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9752f9ef-571c-4616-9ea8-90e5bf8d968b tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:52:30.089740 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9752f9ef-571c-4616-9ea8-90e5bf8d968b tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: c83d025e-76be-4e93-a864-936fbf5f7a16] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:52:30.095999 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-25c5f7d0-72d7-4e05-bc30-23a74c9a3235 req-cfc68129-efc7-4084-afef-41263944f86f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c83d025e-76be-4e93-a864-936fbf5f7a16", "tag": "065ae8cd-82e5-483d-82fe-f09b43b9bc76"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:52:30.107119 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9752f9ef-571c-4616-9ea8-90e5bf8d968b tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:52:30.107641 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9752f9ef-571c-4616-9ea8-90e5bf8d968b tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:52:30.108153 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9752f9ef-571c-4616-9ea8-90e5bf8d968b tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:52:30.114339 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-25c5f7d0-72d7-4e05-bc30-23a74c9a3235 req-cfc68129-efc7-4084-afef-41263944f86f service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:52:30.114820 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-25c5f7d0-72d7-4e05-bc30-23a74c9a3235 req-cfc68129-efc7-4084-afef-41263944f86f service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:52:30.115239 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-25c5f7d0-72d7-4e05-bc30-23a74c9a3235 req-cfc68129-efc7-4084-afef-41263944f86f service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:52:30.116204 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9752f9ef-571c-4616-9ea8-90e5bf8d968b tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:52:30.117968 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9752f9ef-571c-4616-9ea8-90e5bf8d968b tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:52:30.119526 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9752f9ef-571c-4616-9ea8-90e5bf8d968b tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:52:30.148038 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-25c5f7d0-72d7-4e05-bc30-23a74c9a3235 req-cfc68129-efc7-4084-afef-41263944f86f service nova] Creating event network-changed:065ae8cd-82e5-483d-82fe-f09b43b9bc76 for instance c83d025e-76be-4e93-a864-936fbf5f7a16 on n-h2-master-1 Oct 30 01:52:30.164527 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-25c5f7d0-72d7-4e05-bc30-23a74c9a3235 req-cfc68129-efc7-4084-afef-41263944f86f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072690 Oct 30 01:52:30.170153 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3186/6364] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:52:30.526426 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9752f9ef-571c-4616-9ea8-90e5bf8d968b tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:52:30.551403 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9752f9ef-571c-4616-9ea8-90e5bf8d968b tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16" status: 200 len: 1562 microversion: 2.1 time: 0.466091 Oct 30 01:52:30.567161 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3179/6365] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:52:30 2022] GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16 => generated 1562 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:52:32.751343 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5d97af35-63b6-446e-9761-52f11c9b81ad tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1645875884", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "74e977c0-eac1-45f1-a444-0e2cd02a024d"}], "key_name": "tempest-TestNetworkBasicOps-2072841535", "security_groups": [{"name": "tempest-secgroup-smoke-98322431"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:52:33.024897 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-5d97af35-63b6-446e-9761-52f11c9b81ad tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] validate_networks() for [('74e977c0-eac1-45f1-a444-0e2cd02a024d', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:52:33.855135 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-5d97af35-63b6-446e-9761-52f11c9b81ad tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:52:33.855760 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-5d97af35-63b6-446e-9761-52f11c9b81ad tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:52:33.856048 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-5d97af35-63b6-446e-9761-52f11c9b81ad tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:52:33.856458 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-5d97af35-63b6-446e-9761-52f11c9b81ad tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:52:33.856866 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-5d97af35-63b6-446e-9761-52f11c9b81ad tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:52:33.877490 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5d97af35-63b6-446e-9761-52f11c9b81ad tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:52:33.879500 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5d97af35-63b6-446e-9761-52f11c9b81ad tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:52:33.879500 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5d97af35-63b6-446e-9761-52f11c9b81ad tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:52:33.879500 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5d97af35-63b6-446e-9761-52f11c9b81ad tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:52:33.883233 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5d97af35-63b6-446e-9761-52f11c9b81ad tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:52:33.883709 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5d97af35-63b6-446e-9761-52f11c9b81ad tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:52:33.914619 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-5d97af35-63b6-446e-9761-52f11c9b81ad tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Getting quotas for project 735c13f1d49640319694d0a6a3a16519. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:52:33.923908 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-5d97af35-63b6-446e-9761-52f11c9b81ad tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Getting quotas for user 33a9a7ae4f5a42d7ac76baf67fdb7a2d and project 735c13f1d49640319694d0a6a3a16519. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:52:33.944787 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5d97af35-63b6-446e-9761-52f11c9b81ad tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:52:33.947389 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5d97af35-63b6-446e-9761-52f11c9b81ad tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: 7f324da2-04a8-434c-95c8-37f0bee2a744] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:52:34.124943 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5d97af35-63b6-446e-9761-52f11c9b81ad tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.378046 Oct 30 01:52:34.125991 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3187/6366] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:52:32 2022] POST /compute/v2.1/servers => generated 404 bytes in 1380 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 30 01:52:34.142965 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-48347364-0be4-4063-86ae-1b02bccee6ad tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:52:34.143675 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-48347364-0be4-4063-86ae-1b02bccee6ad tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: 7f324da2-04a8-434c-95c8-37f0bee2a744] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:52:34.255066 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-48347364-0be4-4063-86ae-1b02bccee6ad tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a9a7ae4f5a42d7ac76baf67fdb7a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735c13f1d49640319694d0a6a3a16519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:52:34.267497 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-48347364-0be4-4063-86ae-1b02bccee6ad tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "GET /compute/v2.1/servers/7f324da2-04a8-434c-95c8-37f0bee2a744" status: 200 len: 1249 microversion: 2.1 time: 0.133528 Oct 30 01:52:34.268673 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3180/6367] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:52:34 2022] GET /compute/v2.1/servers/7f324da2-04a8-434c-95c8-37f0bee2a744 => generated 1249 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:52:35.297875 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4ad45302-abb8-4339-88b9-f404bf22d185 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:52:35.298553 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4ad45302-abb8-4339-88b9-f404bf22d185 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: 7f324da2-04a8-434c-95c8-37f0bee2a744] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:52:35.425230 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4ad45302-abb8-4339-88b9-f404bf22d185 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a9a7ae4f5a42d7ac76baf67fdb7a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735c13f1d49640319694d0a6a3a16519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:52:35.435987 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4ad45302-abb8-4339-88b9-f404bf22d185 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "GET /compute/v2.1/servers/7f324da2-04a8-434c-95c8-37f0bee2a744" status: 200 len: 1249 microversion: 2.1 time: 0.145948 Oct 30 01:52:35.436976 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3188/6368] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:52:35 2022] GET /compute/v2.1/servers/7f324da2-04a8-434c-95c8-37f0bee2a744 => generated 1249 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:52:36.465101 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-078741f6-1a2c-408e-a57f-57c4e235aaf6 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:52:36.466317 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-078741f6-1a2c-408e-a57f-57c4e235aaf6 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: 7f324da2-04a8-434c-95c8-37f0bee2a744] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:52:36.489985 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-078741f6-1a2c-408e-a57f-57c4e235aaf6 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:52:36.491813 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-078741f6-1a2c-408e-a57f-57c4e235aaf6 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:52:36.492449 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-078741f6-1a2c-408e-a57f-57c4e235aaf6 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:52:36.493480 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-078741f6-1a2c-408e-a57f-57c4e235aaf6 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:52:36.494088 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-078741f6-1a2c-408e-a57f-57c4e235aaf6 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:52:36.495207 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-078741f6-1a2c-408e-a57f-57c4e235aaf6 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:52:36.602703 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-078741f6-1a2c-408e-a57f-57c4e235aaf6 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a9a7ae4f5a42d7ac76baf67fdb7a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735c13f1d49640319694d0a6a3a16519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:52:36.620395 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-078741f6-1a2c-408e-a57f-57c4e235aaf6 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "GET /compute/v2.1/servers/7f324da2-04a8-434c-95c8-37f0bee2a744" status: 200 len: 1301 microversion: 2.1 time: 0.162714 Oct 30 01:52:36.621046 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3181/6369] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:52:36 2022] GET /compute/v2.1/servers/7f324da2-04a8-434c-95c8-37f0bee2a744 => generated 1301 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:52:37.654429 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-07314a83-b23d-4bd4-bd89-fdf5a03e873d tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:52:37.655798 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-07314a83-b23d-4bd4-bd89-fdf5a03e873d tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: 7f324da2-04a8-434c-95c8-37f0bee2a744] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:52:37.668712 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-07314a83-b23d-4bd4-bd89-fdf5a03e873d tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:52:37.670382 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-07314a83-b23d-4bd4-bd89-fdf5a03e873d tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:52:37.674570 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-07314a83-b23d-4bd4-bd89-fdf5a03e873d tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:52:37.675495 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-07314a83-b23d-4bd4-bd89-fdf5a03e873d tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:52:37.676020 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-07314a83-b23d-4bd4-bd89-fdf5a03e873d tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:52:37.676466 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-07314a83-b23d-4bd4-bd89-fdf5a03e873d tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:52:37.795859 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-07314a83-b23d-4bd4-bd89-fdf5a03e873d tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a9a7ae4f5a42d7ac76baf67fdb7a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735c13f1d49640319694d0a6a3a16519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:52:37.804892 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-07314a83-b23d-4bd4-bd89-fdf5a03e873d tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "GET /compute/v2.1/servers/7f324da2-04a8-434c-95c8-37f0bee2a744" status: 200 len: 1307 microversion: 2.1 time: 0.155535 Oct 30 01:52:37.806151 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3189/6370] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:52:37 2022] GET /compute/v2.1/servers/7f324da2-04a8-434c-95c8-37f0bee2a744 => generated 1307 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:52:38.829496 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fe7e65df-f687-43b8-91b7-3ab27a88a5de tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:52:38.830155 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-fe7e65df-f687-43b8-91b7-3ab27a88a5de tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: 7f324da2-04a8-434c-95c8-37f0bee2a744] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:52:38.837822 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe7e65df-f687-43b8-91b7-3ab27a88a5de tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:52:38.838462 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe7e65df-f687-43b8-91b7-3ab27a88a5de tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:52:38.839085 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe7e65df-f687-43b8-91b7-3ab27a88a5de tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:52:38.840656 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe7e65df-f687-43b8-91b7-3ab27a88a5de tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:52:38.841229 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe7e65df-f687-43b8-91b7-3ab27a88a5de tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:52:38.842047 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe7e65df-f687-43b8-91b7-3ab27a88a5de tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:52:39.313606 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-fe7e65df-f687-43b8-91b7-3ab27a88a5de tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a9a7ae4f5a42d7ac76baf67fdb7a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735c13f1d49640319694d0a6a3a16519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:52:39.316239 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fe7e65df-f687-43b8-91b7-3ab27a88a5de tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "GET /compute/v2.1/servers/7f324da2-04a8-434c-95c8-37f0bee2a744" status: 200 len: 1373 microversion: 2.1 time: 0.490746 Oct 30 01:52:39.318621 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3182/6371] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:52:38 2022] GET /compute/v2.1/servers/7f324da2-04a8-434c-95c8-37f0bee2a744 => generated 1373 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:52:40.293575 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-a1dd900d-4ad4-419c-8ff3-37206f41a9fb req-dce871f7-61a9-4ee2-a26b-dd68a59e802c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f324da2-04a8-434c-95c8-37f0bee2a744", "tag": "df4fe508-b27e-4a14-8156-cd0317113b90"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:52:40.305009 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=7 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:52:40.307653 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-a1dd900d-4ad4-419c-8ff3-37206f41a9fb req-dce871f7-61a9-4ee2-a26b-dd68a59e802c service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:52:40.308378 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-a1dd900d-4ad4-419c-8ff3-37206f41a9fb req-dce871f7-61a9-4ee2-a26b-dd68a59e802c service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:52:40.308967 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-a1dd900d-4ad4-419c-8ff3-37206f41a9fb req-dce871f7-61a9-4ee2-a26b-dd68a59e802c service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:52:40.314642 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=51 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:52:40.344613 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5c37a0b0-3228-4ead-a684-70b79ab8c608 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:52:40.346450 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5c37a0b0-3228-4ead-a684-70b79ab8c608 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: 7f324da2-04a8-434c-95c8-37f0bee2a744] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:52:40.361290 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-a1dd900d-4ad4-419c-8ff3-37206f41a9fb req-dce871f7-61a9-4ee2-a26b-dd68a59e802c service nova] Creating event network-changed:df4fe508-b27e-4a14-8156-cd0317113b90 for instance 7f324da2-04a8-434c-95c8-37f0bee2a744 on n-h1-master-1 Oct 30 01:52:40.362353 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5c37a0b0-3228-4ead-a684-70b79ab8c608 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:52:40.367135 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5c37a0b0-3228-4ead-a684-70b79ab8c608 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:52:40.368879 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5c37a0b0-3228-4ead-a684-70b79ab8c608 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:52:40.380963 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5c37a0b0-3228-4ead-a684-70b79ab8c608 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:52:40.380963 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5c37a0b0-3228-4ead-a684-70b79ab8c608 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:52:40.380963 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5c37a0b0-3228-4ead-a684-70b79ab8c608 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:52:40.382147 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-a1dd900d-4ad4-419c-8ff3-37206f41a9fb req-dce871f7-61a9-4ee2-a26b-dd68a59e802c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092629 Oct 30 01:52:40.386626 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3190/6372] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:52:41.211358 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5c37a0b0-3228-4ead-a684-70b79ab8c608 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a9a7ae4f5a42d7ac76baf67fdb7a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735c13f1d49640319694d0a6a3a16519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:52:41.230815 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5c37a0b0-3228-4ead-a684-70b79ab8c608 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "GET /compute/v2.1/servers/7f324da2-04a8-434c-95c8-37f0bee2a744" status: 200 len: 1373 microversion: 2.1 time: 0.890391 Oct 30 01:52:41.242864 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3183/6373] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:52:40 2022] GET /compute/v2.1/servers/7f324da2-04a8-434c-95c8-37f0bee2a744 => generated 1373 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:52:42.262313 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-70b994c1-3d53-40cb-a7af-fe29be433afa tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:52:42.263686 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-70b994c1-3d53-40cb-a7af-fe29be433afa tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: 7f324da2-04a8-434c-95c8-37f0bee2a744] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:52:42.273168 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-70b994c1-3d53-40cb-a7af-fe29be433afa tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:52:42.273945 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-70b994c1-3d53-40cb-a7af-fe29be433afa tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:52:42.274612 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-70b994c1-3d53-40cb-a7af-fe29be433afa tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:52:42.275536 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-70b994c1-3d53-40cb-a7af-fe29be433afa tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:52:42.276281 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-70b994c1-3d53-40cb-a7af-fe29be433afa tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:52:42.276907 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-70b994c1-3d53-40cb-a7af-fe29be433afa tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:52:42.460040 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-70b994c1-3d53-40cb-a7af-fe29be433afa tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a9a7ae4f5a42d7ac76baf67fdb7a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735c13f1d49640319694d0a6a3a16519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:52:42.469073 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-70b994c1-3d53-40cb-a7af-fe29be433afa tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "GET /compute/v2.1/servers/7f324da2-04a8-434c-95c8-37f0bee2a744" status: 200 len: 1373 microversion: 2.1 time: 0.213980 Oct 30 01:52:42.470327 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3191/6374] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:52:42 2022] GET /compute/v2.1/servers/7f324da2-04a8-434c-95c8-37f0bee2a744 => generated 1373 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:52:43.494354 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8f79bd3f-28be-4f16-9e41-8e53e1a99bc2 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:52:43.495000 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8f79bd3f-28be-4f16-9e41-8e53e1a99bc2 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: 7f324da2-04a8-434c-95c8-37f0bee2a744] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:52:43.502575 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f79bd3f-28be-4f16-9e41-8e53e1a99bc2 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:52:43.506348 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f79bd3f-28be-4f16-9e41-8e53e1a99bc2 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:52:43.506813 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f79bd3f-28be-4f16-9e41-8e53e1a99bc2 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:52:43.509397 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f79bd3f-28be-4f16-9e41-8e53e1a99bc2 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:52:43.512110 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f79bd3f-28be-4f16-9e41-8e53e1a99bc2 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:52:43.516449 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f79bd3f-28be-4f16-9e41-8e53e1a99bc2 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:52:43.841184 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8f79bd3f-28be-4f16-9e41-8e53e1a99bc2 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a9a7ae4f5a42d7ac76baf67fdb7a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735c13f1d49640319694d0a6a3a16519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:52:43.851577 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8f79bd3f-28be-4f16-9e41-8e53e1a99bc2 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "GET /compute/v2.1/servers/7f324da2-04a8-434c-95c8-37f0bee2a744" status: 200 len: 1373 microversion: 2.1 time: 0.357623 Oct 30 01:52:43.852197 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3184/6375] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:52:43 2022] GET /compute/v2.1/servers/7f324da2-04a8-434c-95c8-37f0bee2a744 => generated 1373 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:52:44.874606 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-edf16620-4aa7-46f8-90e8-4cd96b5e0bbe tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:52:44.885876 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-edf16620-4aa7-46f8-90e8-4cd96b5e0bbe tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: 7f324da2-04a8-434c-95c8-37f0bee2a744] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:52:44.902117 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:52:44.909005 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-edf16620-4aa7-46f8-90e8-4cd96b5e0bbe tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:52:44.914119 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-edf16620-4aa7-46f8-90e8-4cd96b5e0bbe tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:52:44.915076 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-edf16620-4aa7-46f8-90e8-4cd96b5e0bbe tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:52:44.917130 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-edf16620-4aa7-46f8-90e8-4cd96b5e0bbe tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:52:44.917816 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-edf16620-4aa7-46f8-90e8-4cd96b5e0bbe tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:52:44.919103 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-edf16620-4aa7-46f8-90e8-4cd96b5e0bbe tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:52:45.166405 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-edf16620-4aa7-46f8-90e8-4cd96b5e0bbe tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a9a7ae4f5a42d7ac76baf67fdb7a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735c13f1d49640319694d0a6a3a16519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:52:45.175608 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-edf16620-4aa7-46f8-90e8-4cd96b5e0bbe tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "GET /compute/v2.1/servers/7f324da2-04a8-434c-95c8-37f0bee2a744" status: 200 len: 1373 microversion: 2.1 time: 0.304156 Oct 30 01:52:45.176215 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3192/6376] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:52:44 2022] GET /compute/v2.1/servers/7f324da2-04a8-434c-95c8-37f0bee2a744 => generated 1373 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:52:45.791522 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-51f51c98-ab84-4b64-9c60-78135ce19d79 req-aa4b3507-c68a-448b-bfb0-59e311178e7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f324da2-04a8-434c-95c8-37f0bee2a744", "name": "network-vif-plugged", "status": "completed", "tag": "df4fe508-b27e-4a14-8156-cd0317113b90"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:52:45.804399 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:52:45.815969 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-51f51c98-ab84-4b64-9c60-78135ce19d79 req-aa4b3507-c68a-448b-bfb0-59e311178e7a service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:52:45.816494 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-51f51c98-ab84-4b64-9c60-78135ce19d79 req-aa4b3507-c68a-448b-bfb0-59e311178e7a service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:52:45.817129 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-51f51c98-ab84-4b64-9c60-78135ce19d79 req-aa4b3507-c68a-448b-bfb0-59e311178e7a service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:52:45.830241 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-51f51c98-ab84-4b64-9c60-78135ce19d79 req-aa4b3507-c68a-448b-bfb0-59e311178e7a service nova] Creating event network-vif-plugged:df4fe508-b27e-4a14-8156-cd0317113b90 for instance 7f324da2-04a8-434c-95c8-37f0bee2a744 on n-h1-master-1 Oct 30 01:52:45.837488 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-51f51c98-ab84-4b64-9c60-78135ce19d79 req-aa4b3507-c68a-448b-bfb0-59e311178e7a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054995 Oct 30 01:52:45.838289 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3185/6377] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:52:46.208510 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-814090bf-4c5e-45d6-a618-9c852a87e1e0 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:52:46.208510 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-814090bf-4c5e-45d6-a618-9c852a87e1e0 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: 7f324da2-04a8-434c-95c8-37f0bee2a744] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:52:46.208510 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=12 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:52:46.214926 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-814090bf-4c5e-45d6-a618-9c852a87e1e0 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:52:46.215898 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-814090bf-4c5e-45d6-a618-9c852a87e1e0 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:52:46.216341 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-814090bf-4c5e-45d6-a618-9c852a87e1e0 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:52:46.217052 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-814090bf-4c5e-45d6-a618-9c852a87e1e0 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:52:46.217792 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-814090bf-4c5e-45d6-a618-9c852a87e1e0 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:52:46.218335 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-814090bf-4c5e-45d6-a618-9c852a87e1e0 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:52:46.388141 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-814090bf-4c5e-45d6-a618-9c852a87e1e0 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a9a7ae4f5a42d7ac76baf67fdb7a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735c13f1d49640319694d0a6a3a16519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:52:46.405678 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-814090bf-4c5e-45d6-a618-9c852a87e1e0 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "GET /compute/v2.1/servers/7f324da2-04a8-434c-95c8-37f0bee2a744" status: 200 len: 1373 microversion: 2.1 time: 0.205300 Oct 30 01:52:46.405678 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3193/6378] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:52:46 2022] GET /compute/v2.1/servers/7f324da2-04a8-434c-95c8-37f0bee2a744 => generated 1373 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:52:47.430779 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3e56e91b-e88a-4778-af81-3d8e1ba1ae32 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:52:47.431485 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3e56e91b-e88a-4778-af81-3d8e1ba1ae32 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: 7f324da2-04a8-434c-95c8-37f0bee2a744] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:52:47.449710 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=39 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:52:47.451506 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3e56e91b-e88a-4778-af81-3d8e1ba1ae32 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:52:47.452015 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3e56e91b-e88a-4778-af81-3d8e1ba1ae32 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:52:47.452489 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3e56e91b-e88a-4778-af81-3d8e1ba1ae32 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:52:47.453403 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3e56e91b-e88a-4778-af81-3d8e1ba1ae32 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:52:47.454025 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3e56e91b-e88a-4778-af81-3d8e1ba1ae32 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:52:47.454612 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3e56e91b-e88a-4778-af81-3d8e1ba1ae32 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:52:47.499395 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=75 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:52:47.732727 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3e56e91b-e88a-4778-af81-3d8e1ba1ae32 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a9a7ae4f5a42d7ac76baf67fdb7a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735c13f1d49640319694d0a6a3a16519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:52:47.742853 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3e56e91b-e88a-4778-af81-3d8e1ba1ae32 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "GET /compute/v2.1/servers/7f324da2-04a8-434c-95c8-37f0bee2a744" status: 200 len: 1545 microversion: 2.1 time: 0.317707 Oct 30 01:52:47.747687 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3186/6379] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:52:47 2022] GET /compute/v2.1/servers/7f324da2-04a8-434c-95c8-37f0bee2a744 => generated 1545 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:52:47.772761 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-39c6f82b-1a66-45ab-8852-bb2e9736f7e7 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:52:47.773413 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-39c6f82b-1a66-45ab-8852-bb2e9736f7e7 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: 7f324da2-04a8-434c-95c8-37f0bee2a744] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:52:47.782897 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-39c6f82b-1a66-45ab-8852-bb2e9736f7e7 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:52:47.782897 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-39c6f82b-1a66-45ab-8852-bb2e9736f7e7 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:52:47.782897 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-39c6f82b-1a66-45ab-8852-bb2e9736f7e7 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:52:47.783261 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-39c6f82b-1a66-45ab-8852-bb2e9736f7e7 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:52:47.783638 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-39c6f82b-1a66-45ab-8852-bb2e9736f7e7 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:52:47.784091 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-39c6f82b-1a66-45ab-8852-bb2e9736f7e7 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:52:48.049997 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-39c6f82b-1a66-45ab-8852-bb2e9736f7e7 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a9a7ae4f5a42d7ac76baf67fdb7a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735c13f1d49640319694d0a6a3a16519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:52:48.061001 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-39c6f82b-1a66-45ab-8852-bb2e9736f7e7 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "GET /compute/v2.1/servers/7f324da2-04a8-434c-95c8-37f0bee2a744" status: 200 len: 1545 microversion: 2.1 time: 0.291797 Oct 30 01:52:48.062238 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3194/6380] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:52:47 2022] GET /compute/v2.1/servers/7f324da2-04a8-434c-95c8-37f0bee2a744 => generated 1545 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:52:49.656153 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e3a82e01-1591-4ff3-bc3a-5213521d63ab tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:52:49.660272 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e3a82e01-1591-4ff3-bc3a-5213521d63ab tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: c83d025e-76be-4e93-a864-936fbf5f7a16] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:52:49.675668 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e3a82e01-1591-4ff3-bc3a-5213521d63ab tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:52:49.677189 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e3a82e01-1591-4ff3-bc3a-5213521d63ab tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:52:49.677917 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e3a82e01-1591-4ff3-bc3a-5213521d63ab tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:52:49.678880 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e3a82e01-1591-4ff3-bc3a-5213521d63ab tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:52:49.679669 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e3a82e01-1591-4ff3-bc3a-5213521d63ab tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:52:49.681639 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e3a82e01-1591-4ff3-bc3a-5213521d63ab tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:52:49.800377 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e3a82e01-1591-4ff3-bc3a-5213521d63ab tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "POST /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16/action" status: 200 len: 24575 microversion: 2.1 time: 0.146314 Oct 30 01:52:49.800377 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3187/6381] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:52:49 2022] POST /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16/action => generated 24575 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:53:00.829382 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6abaa943-63b4-48f6-956f-e06a06de52bb tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:53:00.832080 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6abaa943-63b4-48f6-956f-e06a06de52bb tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] [instance: c83d025e-76be-4e93-a864-936fbf5f7a16] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:53:00.840165 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=9 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:53:00.841195 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=25 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:53:00.843351 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6abaa943-63b4-48f6-956f-e06a06de52bb tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:00.844487 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6abaa943-63b4-48f6-956f-e06a06de52bb tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:00.845482 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6abaa943-63b4-48f6-956f-e06a06de52bb tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:00.847232 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6abaa943-63b4-48f6-956f-e06a06de52bb tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:00.848248 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6abaa943-63b4-48f6-956f-e06a06de52bb tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:00.849204 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6abaa943-63b4-48f6-956f-e06a06de52bb tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:01.206032 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6abaa943-63b4-48f6-956f-e06a06de52bb tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16" status: 200 len: 1832 microversion: 2.1 time: 0.375485 Oct 30 01:53:01.215060 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3195/6382] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:53:00 2022] GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16 => generated 1832 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:53:01.229305 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-aae39bbe-968b-49dc-85ac-c585c8fe3082 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:53:01.230227 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-aae39bbe-968b-49dc-85ac-c585c8fe3082 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: c83d025e-76be-4e93-a864-936fbf5f7a16] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:53:01.237399 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:53:01.238215 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=9 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:53:01.240098 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aae39bbe-968b-49dc-85ac-c585c8fe3082 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:01.240587 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aae39bbe-968b-49dc-85ac-c585c8fe3082 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:01.241021 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aae39bbe-968b-49dc-85ac-c585c8fe3082 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:01.241788 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aae39bbe-968b-49dc-85ac-c585c8fe3082 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:01.242720 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aae39bbe-968b-49dc-85ac-c585c8fe3082 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:01.243302 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aae39bbe-968b-49dc-85ac-c585c8fe3082 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:01.476034 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-aae39bbe-968b-49dc-85ac-c585c8fe3082 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:53:01.486003 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-aae39bbe-968b-49dc-85ac-c585c8fe3082 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16" status: 200 len: 1681 microversion: 2.1 time: 0.260944 Oct 30 01:53:01.490162 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3188/6383] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:53:01 2022] GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16 => generated 1681 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:53:01.698008 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7a60e157-e93e-4599-9f49-469144b75a2c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:53:01.701306 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7a60e157-e93e-4599-9f49-469144b75a2c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: c83d025e-76be-4e93-a864-936fbf5f7a16] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:53:01.719280 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7a60e157-e93e-4599-9f49-469144b75a2c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:01.719280 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7a60e157-e93e-4599-9f49-469144b75a2c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:01.719280 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7a60e157-e93e-4599-9f49-469144b75a2c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:01.719567 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7a60e157-e93e-4599-9f49-469144b75a2c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:01.723663 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7a60e157-e93e-4599-9f49-469144b75a2c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:01.724930 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7a60e157-e93e-4599-9f49-469144b75a2c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:01.854933 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7a60e157-e93e-4599-9f49-469144b75a2c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "POST /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16/action" status: 200 len: 32647 microversion: 2.1 time: 0.160899 Oct 30 01:53:01.857586 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3196/6384] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:53:01 2022] POST /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16/action => generated 32647 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:53:02.015162 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c9595c31-70e0-44bd-a8d8-9d2455e7ffd7 tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:53:02.015760 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c9595c31-70e0-44bd-a8d8-9d2455e7ffd7 tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] [instance: c83d025e-76be-4e93-a864-936fbf5f7a16] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:53:02.022801 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c9595c31-70e0-44bd-a8d8-9d2455e7ffd7 tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:02.023526 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c9595c31-70e0-44bd-a8d8-9d2455e7ffd7 tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:02.024126 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c9595c31-70e0-44bd-a8d8-9d2455e7ffd7 tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:02.025011 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c9595c31-70e0-44bd-a8d8-9d2455e7ffd7 tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:02.026229 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c9595c31-70e0-44bd-a8d8-9d2455e7ffd7 tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:02.026814 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c9595c31-70e0-44bd-a8d8-9d2455e7ffd7 tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:02.166825 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c9595c31-70e0-44bd-a8d8-9d2455e7ffd7 tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '1c171756ca034defa78c77d149f59d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5645b1258faf4b1483556cea1d3197c3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:53:02.167700 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c9595c31-70e0-44bd-a8d8-9d2455e7ffd7 tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] [instance: c83d025e-76be-4e93-a864-936fbf5f7a16] flavor_id is None. Assuming migration. {{(pid=121103) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 30 01:53:02.168519 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c9595c31-70e0-44bd-a8d8-9d2455e7ffd7 tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] [instance: c83d025e-76be-4e93-a864-936fbf5f7a16] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=121103) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 30 01:53:02.557228 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c9595c31-70e0-44bd-a8d8-9d2455e7ffd7 tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16/action" status: 202 len: 0 microversion: 2.1 time: 0.545797 Oct 30 01:53:02.558306 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3189/6385] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:53:02 2022] POST /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16/action => generated 0 bytes in 547 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:53:02.567428 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-99f5a823-f367-4145-aaf4-608bf36325a8 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:53:02.569009 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-99f5a823-f367-4145-aaf4-608bf36325a8 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: c83d025e-76be-4e93-a864-936fbf5f7a16] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:53:02.576015 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-99f5a823-f367-4145-aaf4-608bf36325a8 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:02.576736 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-99f5a823-f367-4145-aaf4-608bf36325a8 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:02.577354 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-99f5a823-f367-4145-aaf4-608bf36325a8 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:02.578614 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-99f5a823-f367-4145-aaf4-608bf36325a8 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:02.579229 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-99f5a823-f367-4145-aaf4-608bf36325a8 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:02.580084 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-99f5a823-f367-4145-aaf4-608bf36325a8 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:02.967646 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-99f5a823-f367-4145-aaf4-608bf36325a8 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:53:02.977075 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-99f5a823-f367-4145-aaf4-608bf36325a8 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16" status: 200 len: 1690 microversion: 2.1 time: 0.414455 Oct 30 01:53:02.977884 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3197/6386] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:53:02 2022] GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16 => generated 1690 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:53:04.000515 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7eb86ccb-7561-4708-a657-b5d58f81c598 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:53:04.001808 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7eb86ccb-7561-4708-a657-b5d58f81c598 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: c83d025e-76be-4e93-a864-936fbf5f7a16] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:53:04.016339 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7eb86ccb-7561-4708-a657-b5d58f81c598 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:04.017103 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7eb86ccb-7561-4708-a657-b5d58f81c598 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:04.023012 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7eb86ccb-7561-4708-a657-b5d58f81c598 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:04.024418 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7eb86ccb-7561-4708-a657-b5d58f81c598 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:04.025069 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7eb86ccb-7561-4708-a657-b5d58f81c598 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:04.025542 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7eb86ccb-7561-4708-a657-b5d58f81c598 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:04.621142 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7eb86ccb-7561-4708-a657-b5d58f81c598 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:53:04.630872 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7eb86ccb-7561-4708-a657-b5d58f81c598 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16" status: 200 len: 1690 microversion: 2.1 time: 0.634564 Oct 30 01:53:04.632012 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3190/6387] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:53:03 2022] GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16 => generated 1690 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:53:05.677086 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c13df328-48bd-47e6-a7c1-77f7eff673d3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:53:05.678684 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c13df328-48bd-47e6-a7c1-77f7eff673d3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: c83d025e-76be-4e93-a864-936fbf5f7a16] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:53:05.740204 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c13df328-48bd-47e6-a7c1-77f7eff673d3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:05.744436 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c13df328-48bd-47e6-a7c1-77f7eff673d3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:05.746224 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c13df328-48bd-47e6-a7c1-77f7eff673d3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:05.750854 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c13df328-48bd-47e6-a7c1-77f7eff673d3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:05.759566 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c13df328-48bd-47e6-a7c1-77f7eff673d3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:05.760638 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c13df328-48bd-47e6-a7c1-77f7eff673d3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:06.058565 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c13df328-48bd-47e6-a7c1-77f7eff673d3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:53:06.070696 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c13df328-48bd-47e6-a7c1-77f7eff673d3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16" status: 200 len: 1690 microversion: 2.1 time: 0.396123 Oct 30 01:53:06.075718 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3198/6388] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:53:05 2022] GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16 => generated 1690 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:53:07.107967 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c3196abc-5063-4d8e-99a9-d10d3872667f tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:53:07.108710 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c3196abc-5063-4d8e-99a9-d10d3872667f tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: c83d025e-76be-4e93-a864-936fbf5f7a16] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:53:07.118063 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c3196abc-5063-4d8e-99a9-d10d3872667f tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:07.118673 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c3196abc-5063-4d8e-99a9-d10d3872667f tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:07.119395 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c3196abc-5063-4d8e-99a9-d10d3872667f tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:07.120113 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c3196abc-5063-4d8e-99a9-d10d3872667f tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:07.120569 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c3196abc-5063-4d8e-99a9-d10d3872667f tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:07.120990 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c3196abc-5063-4d8e-99a9-d10d3872667f tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:07.438467 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c3196abc-5063-4d8e-99a9-d10d3872667f tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:53:07.450117 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c3196abc-5063-4d8e-99a9-d10d3872667f tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16" status: 200 len: 1690 microversion: 2.1 time: 0.348733 Oct 30 01:53:07.451567 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3191/6389] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:53:07 2022] GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16 => generated 1690 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:53:08.476335 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2cc27afc-cf90-493d-bece-4f5001545d8c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:53:08.479298 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2cc27afc-cf90-493d-bece-4f5001545d8c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: c83d025e-76be-4e93-a864-936fbf5f7a16] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:53:08.489586 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2cc27afc-cf90-493d-bece-4f5001545d8c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:08.490826 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2cc27afc-cf90-493d-bece-4f5001545d8c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:08.491419 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2cc27afc-cf90-493d-bece-4f5001545d8c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:08.492577 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2cc27afc-cf90-493d-bece-4f5001545d8c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:08.493207 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2cc27afc-cf90-493d-bece-4f5001545d8c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:08.493659 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2cc27afc-cf90-493d-bece-4f5001545d8c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:08.787102 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2cc27afc-cf90-493d-bece-4f5001545d8c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:53:08.794981 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2cc27afc-cf90-493d-bece-4f5001545d8c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16" status: 200 len: 1695 microversion: 2.1 time: 0.324996 Oct 30 01:53:08.795971 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3199/6390] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:53:08 2022] GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16 => generated 1695 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:53:09.819256 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-841fedf9-28a6-439e-8899-4b355b3a4441 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:53:09.823932 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-841fedf9-28a6-439e-8899-4b355b3a4441 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: c83d025e-76be-4e93-a864-936fbf5f7a16] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:53:09.831379 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-841fedf9-28a6-439e-8899-4b355b3a4441 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:09.831872 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-841fedf9-28a6-439e-8899-4b355b3a4441 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:09.832305 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-841fedf9-28a6-439e-8899-4b355b3a4441 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:09.833254 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-841fedf9-28a6-439e-8899-4b355b3a4441 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:09.842393 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-841fedf9-28a6-439e-8899-4b355b3a4441 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:09.842855 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-841fedf9-28a6-439e-8899-4b355b3a4441 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:10.438451 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-841fedf9-28a6-439e-8899-4b355b3a4441 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:53:10.455446 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-841fedf9-28a6-439e-8899-4b355b3a4441 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16" status: 200 len: 1695 microversion: 2.1 time: 0.640455 Oct 30 01:53:10.456155 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3192/6391] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:53:09 2022] GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16 => generated 1695 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:53:11.480536 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-98a4e95c-3a3e-43ee-b3d2-56a086306a6a tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:53:11.481083 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-98a4e95c-3a3e-43ee-b3d2-56a086306a6a tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: c83d025e-76be-4e93-a864-936fbf5f7a16] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:53:11.488528 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-98a4e95c-3a3e-43ee-b3d2-56a086306a6a tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:11.489034 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-98a4e95c-3a3e-43ee-b3d2-56a086306a6a tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:11.489507 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-98a4e95c-3a3e-43ee-b3d2-56a086306a6a tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:11.490227 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-98a4e95c-3a3e-43ee-b3d2-56a086306a6a tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:11.490694 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-98a4e95c-3a3e-43ee-b3d2-56a086306a6a tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:11.491128 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-98a4e95c-3a3e-43ee-b3d2-56a086306a6a tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:11.650110 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-98a4e95c-3a3e-43ee-b3d2-56a086306a6a tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:53:11.658794 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-98a4e95c-3a3e-43ee-b3d2-56a086306a6a tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16" status: 200 len: 1695 microversion: 2.1 time: 0.182826 Oct 30 01:53:11.660181 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3200/6392] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:53:11 2022] GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16 => generated 1695 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:53:12.687483 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-08a1ccd9-170c-4183-9853-47677352190c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:53:12.689454 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-08a1ccd9-170c-4183-9853-47677352190c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: c83d025e-76be-4e93-a864-936fbf5f7a16] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:53:12.712493 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08a1ccd9-170c-4183-9853-47677352190c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:12.712998 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08a1ccd9-170c-4183-9853-47677352190c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:12.713471 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08a1ccd9-170c-4183-9853-47677352190c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:12.714184 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08a1ccd9-170c-4183-9853-47677352190c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:12.718096 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08a1ccd9-170c-4183-9853-47677352190c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:12.721752 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08a1ccd9-170c-4183-9853-47677352190c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:13.103447 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-08a1ccd9-170c-4183-9853-47677352190c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:53:13.117669 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-08a1ccd9-170c-4183-9853-47677352190c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16" status: 200 len: 1695 microversion: 2.1 time: 0.436407 Oct 30 01:53:13.119424 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3193/6393] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:53:12 2022] GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16 => generated 1695 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:53:14.142230 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5299026b-39cc-4d70-bc85-4f33a0d054b7 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:53:14.143530 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5299026b-39cc-4d70-bc85-4f33a0d054b7 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: c83d025e-76be-4e93-a864-936fbf5f7a16] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:53:14.155811 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5299026b-39cc-4d70-bc85-4f33a0d054b7 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:14.159962 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5299026b-39cc-4d70-bc85-4f33a0d054b7 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:14.161679 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5299026b-39cc-4d70-bc85-4f33a0d054b7 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:14.163339 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5299026b-39cc-4d70-bc85-4f33a0d054b7 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:14.164972 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5299026b-39cc-4d70-bc85-4f33a0d054b7 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:14.166397 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5299026b-39cc-4d70-bc85-4f33a0d054b7 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:14.612001 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5299026b-39cc-4d70-bc85-4f33a0d054b7 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:53:14.621263 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5299026b-39cc-4d70-bc85-4f33a0d054b7 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16" status: 200 len: 1695 microversion: 2.1 time: 0.483605 Oct 30 01:53:14.639030 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3201/6394] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:53:14 2022] GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16 => generated 1695 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:53:15.650026 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-08aca1f9-cd34-45a6-9e1a-a8bdd1bb6afb tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:53:15.653919 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-08aca1f9-cd34-45a6-9e1a-a8bdd1bb6afb tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: c83d025e-76be-4e93-a864-936fbf5f7a16] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:53:15.657789 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08aca1f9-cd34-45a6-9e1a-a8bdd1bb6afb tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:15.659122 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08aca1f9-cd34-45a6-9e1a-a8bdd1bb6afb tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:15.659744 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08aca1f9-cd34-45a6-9e1a-a8bdd1bb6afb tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:15.664716 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08aca1f9-cd34-45a6-9e1a-a8bdd1bb6afb tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:15.664716 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08aca1f9-cd34-45a6-9e1a-a8bdd1bb6afb tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:15.664716 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08aca1f9-cd34-45a6-9e1a-a8bdd1bb6afb tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:15.730618 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c241d253-557d-49e0-8023-59d1ac8249bc tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:53:15.731188 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c241d253-557d-49e0-8023-59d1ac8249bc tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: 7f324da2-04a8-434c-95c8-37f0bee2a744] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:53:15.744356 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c241d253-557d-49e0-8023-59d1ac8249bc tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:15.744875 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c241d253-557d-49e0-8023-59d1ac8249bc tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:15.750682 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c241d253-557d-49e0-8023-59d1ac8249bc tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:15.751608 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c241d253-557d-49e0-8023-59d1ac8249bc tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:15.752976 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c241d253-557d-49e0-8023-59d1ac8249bc tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:15.753458 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c241d253-557d-49e0-8023-59d1ac8249bc tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:15.804787 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c241d253-557d-49e0-8023-59d1ac8249bc tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: 7f324da2-04a8-434c-95c8-37f0bee2a744] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:53:16.001028 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-08aca1f9-cd34-45a6-9e1a-a8bdd1bb6afb tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:53:16.010069 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-08aca1f9-cd34-45a6-9e1a-a8bdd1bb6afb tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16" status: 200 len: 1695 microversion: 2.1 time: 0.367967 Oct 30 01:53:16.011120 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3194/6395] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:53:15 2022] GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16 => generated 1695 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:53:16.199367 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c241d253-557d-49e0-8023-59d1ac8249bc tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7f324da2-04a8-434c-95c8-37f0bee2a744" status: 204 len: 0 microversion: 2.1 time: 0.460117 Oct 30 01:53:16.199367 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3202/6396] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:53:15 2022] DELETE /compute/v2.1/servers/7f324da2-04a8-434c-95c8-37f0bee2a744 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 30 01:53:16.201042 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e5560f56-80b0-4387-ab63-11f387424268 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:53:16.201720 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e5560f56-80b0-4387-ab63-11f387424268 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: 7f324da2-04a8-434c-95c8-37f0bee2a744] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:53:16.210927 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e5560f56-80b0-4387-ab63-11f387424268 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:16.211434 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e5560f56-80b0-4387-ab63-11f387424268 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:16.212070 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e5560f56-80b0-4387-ab63-11f387424268 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:16.213068 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e5560f56-80b0-4387-ab63-11f387424268 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:16.214061 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e5560f56-80b0-4387-ab63-11f387424268 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:16.214825 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e5560f56-80b0-4387-ab63-11f387424268 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:16.454100 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e5560f56-80b0-4387-ab63-11f387424268 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a9a7ae4f5a42d7ac76baf67fdb7a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735c13f1d49640319694d0a6a3a16519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:53:16.466067 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e5560f56-80b0-4387-ab63-11f387424268 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "GET /compute/v2.1/servers/7f324da2-04a8-434c-95c8-37f0bee2a744" status: 200 len: 1551 microversion: 2.1 time: 0.273556 Oct 30 01:53:16.468244 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3195/6397] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:53:16 2022] GET /compute/v2.1/servers/7f324da2-04a8-434c-95c8-37f0bee2a744 => generated 1551 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:53:17.042016 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d7134209-32b8-4028-b86c-91f18fd82be4 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:53:17.042016 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d7134209-32b8-4028-b86c-91f18fd82be4 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: c83d025e-76be-4e93-a864-936fbf5f7a16] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:53:17.047336 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7134209-32b8-4028-b86c-91f18fd82be4 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:17.047859 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7134209-32b8-4028-b86c-91f18fd82be4 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:17.048326 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7134209-32b8-4028-b86c-91f18fd82be4 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:17.049074 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7134209-32b8-4028-b86c-91f18fd82be4 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:17.049549 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7134209-32b8-4028-b86c-91f18fd82be4 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:17.050188 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7134209-32b8-4028-b86c-91f18fd82be4 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:17.238332 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d7134209-32b8-4028-b86c-91f18fd82be4 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:53:17.247122 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d7134209-32b8-4028-b86c-91f18fd82be4 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16" status: 200 len: 1695 microversion: 2.1 time: 0.216443 Oct 30 01:53:17.257957 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3203/6398] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:53:17 2022] GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16 => generated 1695 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:53:17.492674 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d5dd7275-0ece-46e3-8d72-06444f03f62f tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:53:17.493432 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d5dd7275-0ece-46e3-8d72-06444f03f62f tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: 7f324da2-04a8-434c-95c8-37f0bee2a744] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:53:17.500505 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d5dd7275-0ece-46e3-8d72-06444f03f62f tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:17.501004 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d5dd7275-0ece-46e3-8d72-06444f03f62f tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:17.502625 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d5dd7275-0ece-46e3-8d72-06444f03f62f tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:17.502625 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d5dd7275-0ece-46e3-8d72-06444f03f62f tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:17.502788 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d5dd7275-0ece-46e3-8d72-06444f03f62f tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:17.503161 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d5dd7275-0ece-46e3-8d72-06444f03f62f tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:17.670748 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d5dd7275-0ece-46e3-8d72-06444f03f62f tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a9a7ae4f5a42d7ac76baf67fdb7a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735c13f1d49640319694d0a6a3a16519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:53:17.679641 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d5dd7275-0ece-46e3-8d72-06444f03f62f tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "GET /compute/v2.1/servers/7f324da2-04a8-434c-95c8-37f0bee2a744" status: 200 len: 1551 microversion: 2.1 time: 0.191233 Oct 30 01:53:17.680230 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3196/6399] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:53:17 2022] GET /compute/v2.1/servers/7f324da2-04a8-434c-95c8-37f0bee2a744 => generated 1551 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:53:18.272230 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1292c230-d7ec-48b2-8aed-dec9013219d2 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:53:18.274502 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1292c230-d7ec-48b2-8aed-dec9013219d2 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: c83d025e-76be-4e93-a864-936fbf5f7a16] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:53:18.287522 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1292c230-d7ec-48b2-8aed-dec9013219d2 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:18.288978 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1292c230-d7ec-48b2-8aed-dec9013219d2 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:18.289461 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1292c230-d7ec-48b2-8aed-dec9013219d2 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:18.293088 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1292c230-d7ec-48b2-8aed-dec9013219d2 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:18.293088 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1292c230-d7ec-48b2-8aed-dec9013219d2 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:18.293088 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1292c230-d7ec-48b2-8aed-dec9013219d2 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:18.349965 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-79b0fbf8-9ad7-48ff-bd5c-5542fc4736af req-1402fcf9-5a3b-4231-8a9a-f4ff0d98c851 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f324da2-04a8-434c-95c8-37f0bee2a744", "name": "network-vif-deleted", "tag": "df4fe508-b27e-4a14-8156-cd0317113b90"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:53:18.366025 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-79b0fbf8-9ad7-48ff-bd5c-5542fc4736af req-1402fcf9-5a3b-4231-8a9a-f4ff0d98c851 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:18.367096 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-79b0fbf8-9ad7-48ff-bd5c-5542fc4736af req-1402fcf9-5a3b-4231-8a9a-f4ff0d98c851 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:18.369482 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-79b0fbf8-9ad7-48ff-bd5c-5542fc4736af req-1402fcf9-5a3b-4231-8a9a-f4ff0d98c851 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:18.401678 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-79b0fbf8-9ad7-48ff-bd5c-5542fc4736af req-1402fcf9-5a3b-4231-8a9a-f4ff0d98c851 service nova] Creating event network-vif-deleted:df4fe508-b27e-4a14-8156-cd0317113b90 for instance 7f324da2-04a8-434c-95c8-37f0bee2a744 on n-h1-master-1 Oct 30 01:53:18.410738 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-79b0fbf8-9ad7-48ff-bd5c-5542fc4736af req-1402fcf9-5a3b-4231-8a9a-f4ff0d98c851 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065500 Oct 30 01:53:18.412089 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3197/6400] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:53:18.476983 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1292c230-d7ec-48b2-8aed-dec9013219d2 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:53:18.487599 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1292c230-d7ec-48b2-8aed-dec9013219d2 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16" status: 200 len: 1695 microversion: 2.1 time: 0.219337 Oct 30 01:53:18.505541 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3204/6401] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:53:18 2022] GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16 => generated 1695 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:53:18.706678 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ccdc1234-b663-4f60-9374-9cc8ad841a84 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:53:18.707595 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ccdc1234-b663-4f60-9374-9cc8ad841a84 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: 7f324da2-04a8-434c-95c8-37f0bee2a744] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:53:18.714740 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ccdc1234-b663-4f60-9374-9cc8ad841a84 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:18.715593 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ccdc1234-b663-4f60-9374-9cc8ad841a84 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:18.716162 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ccdc1234-b663-4f60-9374-9cc8ad841a84 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:18.717456 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ccdc1234-b663-4f60-9374-9cc8ad841a84 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:18.718016 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ccdc1234-b663-4f60-9374-9cc8ad841a84 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:18.718514 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ccdc1234-b663-4f60-9374-9cc8ad841a84 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:18.752898 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ccdc1234-b663-4f60-9374-9cc8ad841a84 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:18.753608 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ccdc1234-b663-4f60-9374-9cc8ad841a84 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:18.754312 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ccdc1234-b663-4f60-9374-9cc8ad841a84 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:18.754921 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-ccdc1234-b663-4f60-9374-9cc8ad841a84 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lazy-loading 'fault' on Instance uuid 7f324da2-04a8-434c-95c8-37f0bee2a744 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:53:18.828658 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ccdc1234-b663-4f60-9374-9cc8ad841a84 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a9a7ae4f5a42d7ac76baf67fdb7a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735c13f1d49640319694d0a6a3a16519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:53:18.839942 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ccdc1234-b663-4f60-9374-9cc8ad841a84 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "GET /compute/v2.1/servers/7f324da2-04a8-434c-95c8-37f0bee2a744" status: 200 len: 1339 microversion: 2.1 time: 0.139213 Oct 30 01:53:18.843594 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3198/6402] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:53:18 2022] GET /compute/v2.1/servers/7f324da2-04a8-434c-95c8-37f0bee2a744 => generated 1339 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:53:19.512593 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-087189f5-2da6-406a-a909-164fb309f2fb tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:53:19.514020 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-087189f5-2da6-406a-a909-164fb309f2fb tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: c83d025e-76be-4e93-a864-936fbf5f7a16] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:53:19.522152 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-087189f5-2da6-406a-a909-164fb309f2fb tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:19.526723 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-087189f5-2da6-406a-a909-164fb309f2fb tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:19.526723 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-087189f5-2da6-406a-a909-164fb309f2fb tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:19.526723 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-087189f5-2da6-406a-a909-164fb309f2fb tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:19.526723 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-087189f5-2da6-406a-a909-164fb309f2fb tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:19.526723 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-087189f5-2da6-406a-a909-164fb309f2fb tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:19.694450 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-087189f5-2da6-406a-a909-164fb309f2fb tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:53:19.703335 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-087189f5-2da6-406a-a909-164fb309f2fb tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16" status: 200 len: 1695 microversion: 2.1 time: 0.195141 Oct 30 01:53:19.704013 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3205/6403] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:53:19 2022] GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16 => generated 1695 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:53:19.868123 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-831e23ea-0b90-497a-8d8f-495cc414c24c tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:53:19.868741 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-831e23ea-0b90-497a-8d8f-495cc414c24c tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: 7f324da2-04a8-434c-95c8-37f0bee2a744] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:53:19.875681 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-831e23ea-0b90-497a-8d8f-495cc414c24c tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:19.879481 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-831e23ea-0b90-497a-8d8f-495cc414c24c tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:19.880734 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-831e23ea-0b90-497a-8d8f-495cc414c24c tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:19.885606 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-831e23ea-0b90-497a-8d8f-495cc414c24c tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:19.887084 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-831e23ea-0b90-497a-8d8f-495cc414c24c tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:19.887883 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-831e23ea-0b90-497a-8d8f-495cc414c24c tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:19.917777 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-831e23ea-0b90-497a-8d8f-495cc414c24c tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] HTTP exception thrown: Instance 7f324da2-04a8-434c-95c8-37f0bee2a744 could not be found. Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-831e23ea-0b90-497a-8d8f-495cc414c24c tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Request method failure captured: Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/7f324da2-04a8-434c-95c8-37f0bee2a744 HTTP/1.1 Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdiO_kkGyv2VSSiTYM6ZxYZHR-AHHcKTmir1ZDK6wlz8YIuQadqoSJ1K139qnr9GiD559wqynvYW1VdNoyBW7gzAU_MUfFPYKN_xkSoHrA3wXAWbxThrQL-0__zAswVZrJLPI7cuVVc-JkAphuzKHw6jWtoAW_yfAWE3WBoR_Z-5Xf0 Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 735c13f1d49640319694d0a6a3a16519 Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-TestNetworkBasicOps-1200307483 Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/735c13f1d49640319694d0a6a3a16519"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_735c13f1d49640319694d0a6a3a16519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/735c13f1d49640319694d0a6a3a16519"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/735c13f1d49640319694d0a6a3a16519"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-TestNetworkBasicOps-1200307483 Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 735c13f1d49640319694d0a6a3a16519 Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-TestNetworkBasicOps-1200307483 Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-TestNetworkBasicOps-1200307483-project Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 33a9a7ae4f5a42d7ac76baf67fdb7a2d Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-TestNetworkBasicOps-1200307483-project Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 7f324da2-04a8-434c-95c8-37f0bee2a744 could not be found. Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '7f324da2-04a8-434c-95c8-37f0bee2a744'} Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f324da2-04a8-434c-95c8-37f0bee2a744 could not be found. Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f324da2-04a8-434c-95c8-37f0bee2a744 could not be found. Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:53:19.920525 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:53:19.925532 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:53:19.925532 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:53:19.925532 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:53:19.925532 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:53:19.925532 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:53:19.925532 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f324da2-04a8-434c-95c8-37f0bee2a744 could not be found. Oct 30 01:53:19.925532 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:53:19.925532 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-831e23ea-0b90-497a-8d8f-495cc414c24c tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Returning 404 to user: Instance 7f324da2-04a8-434c-95c8-37f0bee2a744 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:53:19.926121 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-831e23ea-0b90-497a-8d8f-495cc414c24c tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "GET /compute/v2.1/servers/7f324da2-04a8-434c-95c8-37f0bee2a744" status: 404 len: 111 microversion: 2.1 time: 0.059698 Oct 30 01:53:19.927092 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3199/6404] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:53:19 2022] GET /compute/v2.1/servers/7f324da2-04a8-434c-95c8-37f0bee2a744 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:53:20.230357 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0af31337-47d4-4404-98d0-3448c4fc404b tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Calling method '.version_select at 0x7f44c773b040>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:53:20.363193 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0af31337-47d4-4404-98d0-3448c4fc404b tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2072841535" status: 202 len: 0 microversion: 2.1 time: 0.137546 Oct 30 01:53:20.363801 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3206/6405] 10.222.0.13 () {58 vars in 1257 bytes} [Sun Oct 30 01:53:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2072841535 => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 30 01:53:20.728082 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-66ba146b-2829-4692-9631-97aeadeaaa4e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:53:20.728653 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-66ba146b-2829-4692-9631-97aeadeaaa4e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: c83d025e-76be-4e93-a864-936fbf5f7a16] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:53:20.734900 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-66ba146b-2829-4692-9631-97aeadeaaa4e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:20.735400 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-66ba146b-2829-4692-9631-97aeadeaaa4e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:20.735841 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-66ba146b-2829-4692-9631-97aeadeaaa4e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:20.736626 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-66ba146b-2829-4692-9631-97aeadeaaa4e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:20.737081 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-66ba146b-2829-4692-9631-97aeadeaaa4e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:20.737536 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-66ba146b-2829-4692-9631-97aeadeaaa4e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:21.300868 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-66ba146b-2829-4692-9631-97aeadeaaa4e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:53:21.311654 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-66ba146b-2829-4692-9631-97aeadeaaa4e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16" status: 200 len: 1694 microversion: 2.1 time: 0.587486 Oct 30 01:53:21.312749 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3200/6406] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:53:20 2022] GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16 => generated 1694 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:53:21.653187 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-64c613b0-2589-4bf4-ae9a-6876e7ddd5e4 req-9f0955a8-a3d1-439d-aa62-489bc24e8ddb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c83d025e-76be-4e93-a864-936fbf5f7a16", "name": "network-vif-unplugged", "status": "completed", "tag": "065ae8cd-82e5-483d-82fe-f09b43b9bc76"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:53:21.669778 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-64c613b0-2589-4bf4-ae9a-6876e7ddd5e4 req-9f0955a8-a3d1-439d-aa62-489bc24e8ddb service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:21.670603 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-64c613b0-2589-4bf4-ae9a-6876e7ddd5e4 req-9f0955a8-a3d1-439d-aa62-489bc24e8ddb service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:21.671473 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-64c613b0-2589-4bf4-ae9a-6876e7ddd5e4 req-9f0955a8-a3d1-439d-aa62-489bc24e8ddb service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:21.692623 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-64c613b0-2589-4bf4-ae9a-6876e7ddd5e4 req-9f0955a8-a3d1-439d-aa62-489bc24e8ddb service nova] Creating event network-vif-unplugged:065ae8cd-82e5-483d-82fe-f09b43b9bc76 for instance c83d025e-76be-4e93-a864-936fbf5f7a16 on n-h1-master-1 Oct 30 01:53:21.703250 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [req-64c613b0-2589-4bf4-ae9a-6876e7ddd5e4 req-9f0955a8-a3d1-439d-aa62-489bc24e8ddb service nova] Instance c83d025e-76be-4e93-a864-936fbf5f7a16 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=121102) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 30 01:53:21.717905 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-64c613b0-2589-4bf4-ae9a-6876e7ddd5e4 req-9f0955a8-a3d1-439d-aa62-489bc24e8ddb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071217 Oct 30 01:53:21.718962 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3207/6407] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:53:22.336631 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-de660d7b-2796-436a-be57-059a653f122a tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:53:22.339861 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-de660d7b-2796-436a-be57-059a653f122a tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: c83d025e-76be-4e93-a864-936fbf5f7a16] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:53:22.347378 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de660d7b-2796-436a-be57-059a653f122a tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:22.347881 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de660d7b-2796-436a-be57-059a653f122a tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:22.348324 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de660d7b-2796-436a-be57-059a653f122a tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:22.349139 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de660d7b-2796-436a-be57-059a653f122a tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:22.349630 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de660d7b-2796-436a-be57-059a653f122a tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:22.355597 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de660d7b-2796-436a-be57-059a653f122a tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:22.640411 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-de660d7b-2796-436a-be57-059a653f122a tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:53:22.659183 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-de660d7b-2796-436a-be57-059a653f122a tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16" status: 200 len: 1694 microversion: 2.1 time: 0.325119 Oct 30 01:53:22.661137 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3201/6408] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:53:22 2022] GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16 => generated 1694 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:53:23.686626 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3fe1e40f-8a6d-4bf2-b52b-7501fbe2536b tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:53:23.688079 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3fe1e40f-8a6d-4bf2-b52b-7501fbe2536b tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: c83d025e-76be-4e93-a864-936fbf5f7a16] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:53:23.696509 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3fe1e40f-8a6d-4bf2-b52b-7501fbe2536b tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:23.697536 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3fe1e40f-8a6d-4bf2-b52b-7501fbe2536b tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:23.698197 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3fe1e40f-8a6d-4bf2-b52b-7501fbe2536b tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:23.699147 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3fe1e40f-8a6d-4bf2-b52b-7501fbe2536b tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:23.700300 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3fe1e40f-8a6d-4bf2-b52b-7501fbe2536b tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:23.700931 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3fe1e40f-8a6d-4bf2-b52b-7501fbe2536b tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:23.738021 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-7f5ce87e-5bdb-482a-b658-aceb918061fb req-d34a8224-2d5c-4a1d-b9ec-9fc0a950fd29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c83d025e-76be-4e93-a864-936fbf5f7a16", "tag": "065ae8cd-82e5-483d-82fe-f09b43b9bc76"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:53:23.753548 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-7f5ce87e-5bdb-482a-b658-aceb918061fb req-d34a8224-2d5c-4a1d-b9ec-9fc0a950fd29 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:23.754453 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-7f5ce87e-5bdb-482a-b658-aceb918061fb req-d34a8224-2d5c-4a1d-b9ec-9fc0a950fd29 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:23.755181 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-7f5ce87e-5bdb-482a-b658-aceb918061fb req-d34a8224-2d5c-4a1d-b9ec-9fc0a950fd29 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:23.778987 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-7f5ce87e-5bdb-482a-b658-aceb918061fb req-d34a8224-2d5c-4a1d-b9ec-9fc0a950fd29 service nova] Creating event network-changed:065ae8cd-82e5-483d-82fe-f09b43b9bc76 for instance c83d025e-76be-4e93-a864-936fbf5f7a16 on n-h1-master-1 Oct 30 01:53:23.801151 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [req-7f5ce87e-5bdb-482a-b658-aceb918061fb req-d34a8224-2d5c-4a1d-b9ec-9fc0a950fd29 service nova] Instance c83d025e-76be-4e93-a864-936fbf5f7a16 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=121103) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 30 01:53:23.820510 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-7f5ce87e-5bdb-482a-b658-aceb918061fb req-d34a8224-2d5c-4a1d-b9ec-9fc0a950fd29 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086146 Oct 30 01:53:23.821823 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3202/6409] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:53:23.970225 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9e1abb0f-3804-46c4-b652-3f9889b4b03c tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:53:23.970867 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9e1abb0f-3804-46c4-b652-3f9889b4b03c tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: d62901e2-3c37-4897-ad0d-1cea7bc6c9c7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:53:23.977376 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e1abb0f-3804-46c4-b652-3f9889b4b03c tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:23.978321 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e1abb0f-3804-46c4-b652-3f9889b4b03c tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:23.978936 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e1abb0f-3804-46c4-b652-3f9889b4b03c tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:23.979646 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e1abb0f-3804-46c4-b652-3f9889b4b03c tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:23.980298 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e1abb0f-3804-46c4-b652-3f9889b4b03c tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:23.980928 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e1abb0f-3804-46c4-b652-3f9889b4b03c tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:24.015065 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9e1abb0f-3804-46c4-b652-3f9889b4b03c tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: d62901e2-3c37-4897-ad0d-1cea7bc6c9c7] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:53:24.043361 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:53:24.364552 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9e1abb0f-3804-46c4-b652-3f9889b4b03c tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d62901e2-3c37-4897-ad0d-1cea7bc6c9c7" status: 204 len: 0 microversion: 2.1 time: 0.398480 Oct 30 01:53:24.365443 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3203/6410] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:53:23 2022] DELETE /compute/v2.1/servers/d62901e2-3c37-4897-ad0d-1cea7bc6c9c7 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 30 01:53:24.371959 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-97c01ebe-fa51-448c-b768-a72e1c8fff18 req-94b13b82-81e8-40d6-8958-2555742dc244 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d62901e2-3c37-4897-ad0d-1cea7bc6c9c7", "tag": "0cf4f008-3e3b-4170-ac30-2b55f712e8e5"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:53:24.383844 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-97c01ebe-fa51-448c-b768-a72e1c8fff18 req-94b13b82-81e8-40d6-8958-2555742dc244 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:24.387129 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-97c01ebe-fa51-448c-b768-a72e1c8fff18 req-94b13b82-81e8-40d6-8958-2555742dc244 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:24.387129 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-97c01ebe-fa51-448c-b768-a72e1c8fff18 req-94b13b82-81e8-40d6-8958-2555742dc244 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:24.399403 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-97c01ebe-fa51-448c-b768-a72e1c8fff18 req-94b13b82-81e8-40d6-8958-2555742dc244 service nova] Creating event network-changed:0cf4f008-3e3b-4170-ac30-2b55f712e8e5 for instance d62901e2-3c37-4897-ad0d-1cea7bc6c9c7 on n-h1-master-1 Oct 30 01:53:24.406953 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-97c01ebe-fa51-448c-b768-a72e1c8fff18 req-94b13b82-81e8-40d6-8958-2555742dc244 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039663 Oct 30 01:53:24.407842 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3204/6411] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:53:24.417628 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ea7e9fa4-a0d5-4a29-ad20-d64515e333d3 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:53:24.430785 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ea7e9fa4-a0d5-4a29-ad20-d64515e333d3 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: d62901e2-3c37-4897-ad0d-1cea7bc6c9c7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:53:24.430785 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ea7e9fa4-a0d5-4a29-ad20-d64515e333d3 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:24.430785 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ea7e9fa4-a0d5-4a29-ad20-d64515e333d3 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:24.430785 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ea7e9fa4-a0d5-4a29-ad20-d64515e333d3 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:24.430785 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ea7e9fa4-a0d5-4a29-ad20-d64515e333d3 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:24.430785 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ea7e9fa4-a0d5-4a29-ad20-d64515e333d3 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:24.430785 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ea7e9fa4-a0d5-4a29-ad20-d64515e333d3 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:24.454470 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3fe1e40f-8a6d-4bf2-b52b-7501fbe2536b tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:53:24.475701 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3fe1e40f-8a6d-4bf2-b52b-7501fbe2536b tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16" status: 200 len: 1694 microversion: 2.1 time: 0.792606 Oct 30 01:53:24.491239 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3208/6412] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:53:23 2022] GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16 => generated 1694 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:53:24.835180 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ea7e9fa4-a0d5-4a29-ad20-d64515e333d3 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a9a7ae4f5a42d7ac76baf67fdb7a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735c13f1d49640319694d0a6a3a16519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:53:24.847052 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ea7e9fa4-a0d5-4a29-ad20-d64515e333d3 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "GET /compute/v2.1/servers/d62901e2-3c37-4897-ad0d-1cea7bc6c9c7" status: 200 len: 1671 microversion: 2.1 time: 0.436304 Oct 30 01:53:24.847946 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3205/6413] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:53:24 2022] GET /compute/v2.1/servers/d62901e2-3c37-4897-ad0d-1cea7bc6c9c7 => generated 1671 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:53:25.499471 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-178da056-5ae5-4ab5-a9b7-b7ba84540f46 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:53:25.501869 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-178da056-5ae5-4ab5-a9b7-b7ba84540f46 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: c83d025e-76be-4e93-a864-936fbf5f7a16] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:53:25.512550 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-178da056-5ae5-4ab5-a9b7-b7ba84540f46 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:25.513633 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-178da056-5ae5-4ab5-a9b7-b7ba84540f46 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:25.514336 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-178da056-5ae5-4ab5-a9b7-b7ba84540f46 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:25.516347 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-178da056-5ae5-4ab5-a9b7-b7ba84540f46 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:25.517189 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-178da056-5ae5-4ab5-a9b7-b7ba84540f46 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:25.518103 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-178da056-5ae5-4ab5-a9b7-b7ba84540f46 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:25.729935 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-178da056-5ae5-4ab5-a9b7-b7ba84540f46 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:53:25.741007 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-178da056-5ae5-4ab5-a9b7-b7ba84540f46 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16" status: 200 len: 1692 microversion: 2.1 time: 0.247853 Oct 30 01:53:25.741995 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3209/6414] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:53:25 2022] GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16 => generated 1692 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:53:25.874413 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1beec299-5119-413b-b6a4-ca09495e1eb6 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:53:25.874973 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1beec299-5119-413b-b6a4-ca09495e1eb6 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: d62901e2-3c37-4897-ad0d-1cea7bc6c9c7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:53:25.902065 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1beec299-5119-413b-b6a4-ca09495e1eb6 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:25.902222 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1beec299-5119-413b-b6a4-ca09495e1eb6 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:25.902670 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1beec299-5119-413b-b6a4-ca09495e1eb6 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:25.903383 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1beec299-5119-413b-b6a4-ca09495e1eb6 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:25.903843 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1beec299-5119-413b-b6a4-ca09495e1eb6 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:25.904298 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1beec299-5119-413b-b6a4-ca09495e1eb6 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:26.141511 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1beec299-5119-413b-b6a4-ca09495e1eb6 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a9a7ae4f5a42d7ac76baf67fdb7a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735c13f1d49640319694d0a6a3a16519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:53:26.150180 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1beec299-5119-413b-b6a4-ca09495e1eb6 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "GET /compute/v2.1/servers/d62901e2-3c37-4897-ad0d-1cea7bc6c9c7" status: 200 len: 1671 microversion: 2.1 time: 0.280038 Oct 30 01:53:26.150764 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3206/6415] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:53:25 2022] GET /compute/v2.1/servers/d62901e2-3c37-4897-ad0d-1cea7bc6c9c7 => generated 1671 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:53:26.777723 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-76508f63-756d-489c-9b95-7f01e1068be4 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:53:26.778873 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-76508f63-756d-489c-9b95-7f01e1068be4 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: c83d025e-76be-4e93-a864-936fbf5f7a16] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:53:26.792227 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-76508f63-756d-489c-9b95-7f01e1068be4 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:26.793696 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-76508f63-756d-489c-9b95-7f01e1068be4 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:26.794943 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-76508f63-756d-489c-9b95-7f01e1068be4 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:26.796588 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-76508f63-756d-489c-9b95-7f01e1068be4 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:26.797745 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-76508f63-756d-489c-9b95-7f01e1068be4 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:26.798970 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-76508f63-756d-489c-9b95-7f01e1068be4 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:27.175565 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5cf2492f-09f8-4679-bf4b-5ad0aed7d2cc tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:53:27.176493 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5cf2492f-09f8-4679-bf4b-5ad0aed7d2cc tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: d62901e2-3c37-4897-ad0d-1cea7bc6c9c7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:53:27.184292 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5cf2492f-09f8-4679-bf4b-5ad0aed7d2cc tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:27.184975 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5cf2492f-09f8-4679-bf4b-5ad0aed7d2cc tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:27.185654 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5cf2492f-09f8-4679-bf4b-5ad0aed7d2cc tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:27.186968 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5cf2492f-09f8-4679-bf4b-5ad0aed7d2cc tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:27.187632 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5cf2492f-09f8-4679-bf4b-5ad0aed7d2cc tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:27.188449 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5cf2492f-09f8-4679-bf4b-5ad0aed7d2cc tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:27.477015 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-76508f63-756d-489c-9b95-7f01e1068be4 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:53:27.487706 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-76508f63-756d-489c-9b95-7f01e1068be4 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16" status: 200 len: 1692 microversion: 2.1 time: 0.721080 Oct 30 01:53:27.489305 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3210/6416] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:53:26 2022] GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16 => generated 1692 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:53:28.065049 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5cf2492f-09f8-4679-bf4b-5ad0aed7d2cc tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a9a7ae4f5a42d7ac76baf67fdb7a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735c13f1d49640319694d0a6a3a16519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:53:28.084326 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5cf2492f-09f8-4679-bf4b-5ad0aed7d2cc tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "GET /compute/v2.1/servers/d62901e2-3c37-4897-ad0d-1cea7bc6c9c7" status: 200 len: 1671 microversion: 2.1 time: 0.913122 Oct 30 01:53:28.085030 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3207/6417] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:53:27 2022] GET /compute/v2.1/servers/d62901e2-3c37-4897-ad0d-1cea7bc6c9c7 => generated 1671 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:53:28.253548 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-93a1efbd-51d1-4b86-b89c-4ce785adb7ac req-619f31c4-3eda-4966-b95f-ed894d5369dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c83d025e-76be-4e93-a864-936fbf5f7a16", "name": "network-vif-plugged", "status": "completed", "tag": "065ae8cd-82e5-483d-82fe-f09b43b9bc76"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:53:28.266173 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-93a1efbd-51d1-4b86-b89c-4ce785adb7ac req-619f31c4-3eda-4966-b95f-ed894d5369dd service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:28.266897 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-93a1efbd-51d1-4b86-b89c-4ce785adb7ac req-619f31c4-3eda-4966-b95f-ed894d5369dd service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:28.268510 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-93a1efbd-51d1-4b86-b89c-4ce785adb7ac req-619f31c4-3eda-4966-b95f-ed894d5369dd service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:28.287181 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-93a1efbd-51d1-4b86-b89c-4ce785adb7ac req-619f31c4-3eda-4966-b95f-ed894d5369dd service nova] Creating event network-vif-plugged:065ae8cd-82e5-483d-82fe-f09b43b9bc76 for instance c83d025e-76be-4e93-a864-936fbf5f7a16 on n-h1-master-1 Oct 30 01:53:28.294284 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:53:28.296036 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [req-93a1efbd-51d1-4b86-b89c-4ce785adb7ac req-619f31c4-3eda-4966-b95f-ed894d5369dd service nova] Instance c83d025e-76be-4e93-a864-936fbf5f7a16 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=121102) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 30 01:53:28.309996 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-93a1efbd-51d1-4b86-b89c-4ce785adb7ac req-619f31c4-3eda-4966-b95f-ed894d5369dd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064737 Oct 30 01:53:28.311307 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3211/6418] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:53:28.519783 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c4deeef7-9303-4c3e-807d-19039aed88fd tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:53:28.520481 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c4deeef7-9303-4c3e-807d-19039aed88fd tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: c83d025e-76be-4e93-a864-936fbf5f7a16] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:53:28.529022 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c4deeef7-9303-4c3e-807d-19039aed88fd tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:28.529748 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c4deeef7-9303-4c3e-807d-19039aed88fd tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:28.530451 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c4deeef7-9303-4c3e-807d-19039aed88fd tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:28.531425 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c4deeef7-9303-4c3e-807d-19039aed88fd tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:28.532252 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c4deeef7-9303-4c3e-807d-19039aed88fd tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:28.532926 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c4deeef7-9303-4c3e-807d-19039aed88fd tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:28.808483 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-97720ce3-96c6-46e1-a15b-c9194811f8ad req-a6f4f5f6-1a6d-4652-a3bb-763579e9964c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d62901e2-3c37-4897-ad0d-1cea7bc6c9c7", "name": "network-vif-deleted", "tag": "0cf4f008-3e3b-4170-ac30-2b55f712e8e5"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:53:28.834596 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-97720ce3-96c6-46e1-a15b-c9194811f8ad req-a6f4f5f6-1a6d-4652-a3bb-763579e9964c service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:28.835288 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-97720ce3-96c6-46e1-a15b-c9194811f8ad req-a6f4f5f6-1a6d-4652-a3bb-763579e9964c service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:28.835953 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-97720ce3-96c6-46e1-a15b-c9194811f8ad req-a6f4f5f6-1a6d-4652-a3bb-763579e9964c service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:28.850884 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-97720ce3-96c6-46e1-a15b-c9194811f8ad req-a6f4f5f6-1a6d-4652-a3bb-763579e9964c service nova] Creating event network-vif-deleted:0cf4f008-3e3b-4170-ac30-2b55f712e8e5 for instance d62901e2-3c37-4897-ad0d-1cea7bc6c9c7 on n-h1-master-1 Oct 30 01:53:28.857692 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-97720ce3-96c6-46e1-a15b-c9194811f8ad req-a6f4f5f6-1a6d-4652-a3bb-763579e9964c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053261 Oct 30 01:53:28.858977 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3212/6419] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:53:28.872150 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c4deeef7-9303-4c3e-807d-19039aed88fd tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:53:28.884170 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c4deeef7-9303-4c3e-807d-19039aed88fd tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16" status: 200 len: 1689 microversion: 2.1 time: 0.374541 Oct 30 01:53:28.900745 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3208/6420] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:53:28 2022] GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16 => generated 1689 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:53:28.912098 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2bda27d0-f522-47a3-b59e-c2d3566fe706 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:53:28.915153 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2bda27d0-f522-47a3-b59e-c2d3566fe706 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: c83d025e-76be-4e93-a864-936fbf5f7a16] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:53:28.919937 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2bda27d0-f522-47a3-b59e-c2d3566fe706 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:28.920275 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2bda27d0-f522-47a3-b59e-c2d3566fe706 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:28.920755 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2bda27d0-f522-47a3-b59e-c2d3566fe706 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:28.921818 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2bda27d0-f522-47a3-b59e-c2d3566fe706 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:28.922496 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2bda27d0-f522-47a3-b59e-c2d3566fe706 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:28.922934 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2bda27d0-f522-47a3-b59e-c2d3566fe706 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:29.108640 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-317d7414-8014-423f-a11d-59c3aff7c628 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:53:29.109464 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-317d7414-8014-423f-a11d-59c3aff7c628 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: d62901e2-3c37-4897-ad0d-1cea7bc6c9c7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:53:29.117990 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-317d7414-8014-423f-a11d-59c3aff7c628 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:29.119320 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-317d7414-8014-423f-a11d-59c3aff7c628 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:29.119944 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-317d7414-8014-423f-a11d-59c3aff7c628 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:29.120840 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-317d7414-8014-423f-a11d-59c3aff7c628 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:29.121562 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-317d7414-8014-423f-a11d-59c3aff7c628 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:29.122201 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-317d7414-8014-423f-a11d-59c3aff7c628 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:29.206934 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2bda27d0-f522-47a3-b59e-c2d3566fe706 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "POST /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16/action" status: 204 len: 0 microversion: 2.1 time: 0.299809 Oct 30 01:53:29.209927 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3213/6421] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:53:28 2022] POST /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16/action => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 30 01:53:29.225657 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d2b1ad03-c3c8-4412-a7c0-baa728b17086 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:53:29.231114 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d2b1ad03-c3c8-4412-a7c0-baa728b17086 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: c83d025e-76be-4e93-a864-936fbf5f7a16] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:53:29.237208 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-317d7414-8014-423f-a11d-59c3aff7c628 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a9a7ae4f5a42d7ac76baf67fdb7a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735c13f1d49640319694d0a6a3a16519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:53:29.248302 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-317d7414-8014-423f-a11d-59c3aff7c628 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "GET /compute/v2.1/servers/d62901e2-3c37-4897-ad0d-1cea7bc6c9c7" status: 200 len: 1334 microversion: 2.1 time: 0.143425 Oct 30 01:53:29.249153 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2b1ad03-c3c8-4412-a7c0-baa728b17086 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:29.249444 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3209/6422] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:53:29 2022] GET /compute/v2.1/servers/d62901e2-3c37-4897-ad0d-1cea7bc6c9c7 => generated 1334 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:53:29.261694 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2b1ad03-c3c8-4412-a7c0-baa728b17086 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:29.261694 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2b1ad03-c3c8-4412-a7c0-baa728b17086 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:29.261694 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2b1ad03-c3c8-4412-a7c0-baa728b17086 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:29.261694 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2b1ad03-c3c8-4412-a7c0-baa728b17086 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:29.261694 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2b1ad03-c3c8-4412-a7c0-baa728b17086 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:29.562135 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d2b1ad03-c3c8-4412-a7c0-baa728b17086 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:53:29.576666 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d2b1ad03-c3c8-4412-a7c0-baa728b17086 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16" status: 200 len: 1689 microversion: 2.1 time: 0.362098 Oct 30 01:53:29.577241 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3214/6423] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:53:29 2022] GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16 => generated 1689 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:53:30.276030 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-466b3969-36b6-431d-95d8-bd662e5c5955 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:53:30.276639 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-466b3969-36b6-431d-95d8-bd662e5c5955 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: d62901e2-3c37-4897-ad0d-1cea7bc6c9c7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:53:30.283577 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-466b3969-36b6-431d-95d8-bd662e5c5955 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:30.284066 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-466b3969-36b6-431d-95d8-bd662e5c5955 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:30.284506 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-466b3969-36b6-431d-95d8-bd662e5c5955 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:30.285205 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-466b3969-36b6-431d-95d8-bd662e5c5955 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:30.285709 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-466b3969-36b6-431d-95d8-bd662e5c5955 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:30.286136 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-466b3969-36b6-431d-95d8-bd662e5c5955 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:30.299566 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-466b3969-36b6-431d-95d8-bd662e5c5955 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] HTTP exception thrown: Instance d62901e2-3c37-4897-ad0d-1cea7bc6c9c7 could not be found. Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-466b3969-36b6-431d-95d8-bd662e5c5955 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Request method failure captured: Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/d62901e2-3c37-4897-ad0d-1cea7bc6c9c7 HTTP/1.1 Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdiO_kkGyv2VSSiTYM6ZxYZHR-AHHcKTmir1ZDK6wlz8YIuQadqoSJ1K139qnr9GiD559wqynvYW1VdNoyBW7gzAU_MUfFPYKN_xkSoHrA3wXAWbxThrQL-0__zAswVZrJLPI7cuVVc-JkAphuzKHw6jWtoAW_yfAWE3WBoR_Z-5Xf0 Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 735c13f1d49640319694d0a6a3a16519 Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-TestNetworkBasicOps-1200307483 Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/735c13f1d49640319694d0a6a3a16519"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_735c13f1d49640319694d0a6a3a16519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/735c13f1d49640319694d0a6a3a16519"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/735c13f1d49640319694d0a6a3a16519"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-TestNetworkBasicOps-1200307483 Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 735c13f1d49640319694d0a6a3a16519 Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-TestNetworkBasicOps-1200307483 Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-TestNetworkBasicOps-1200307483-project Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 33a9a7ae4f5a42d7ac76baf67fdb7a2d Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-TestNetworkBasicOps-1200307483-project Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: exception: Instance d62901e2-3c37-4897-ad0d-1cea7bc6c9c7 could not be found. Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'd62901e2-3c37-4897-ad0d-1cea7bc6c9c7'} Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d62901e2-3c37-4897-ad0d-1cea7bc6c9c7 could not be found. Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d62901e2-3c37-4897-ad0d-1cea7bc6c9c7 could not be found. Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:53:30.301259 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:53:30.308102 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:53:30.308102 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:53:30.308102 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:53:30.308102 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:53:30.308102 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:53:30.308102 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d62901e2-3c37-4897-ad0d-1cea7bc6c9c7 could not be found. Oct 30 01:53:30.308102 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:53:30.308102 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-466b3969-36b6-431d-95d8-bd662e5c5955 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Returning 404 to user: Instance d62901e2-3c37-4897-ad0d-1cea7bc6c9c7 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:53:30.308102 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-466b3969-36b6-431d-95d8-bd662e5c5955 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "GET /compute/v2.1/servers/d62901e2-3c37-4897-ad0d-1cea7bc6c9c7" status: 404 len: 111 microversion: 2.1 time: 0.030593 Oct 30 01:53:30.308102 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3210/6424] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:53:30 2022] GET /compute/v2.1/servers/d62901e2-3c37-4897-ad0d-1cea7bc6c9c7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:53:30.600656 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-526a722f-a583-4c24-8578-486bc9a6cc9b tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:53:30.601275 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-526a722f-a583-4c24-8578-486bc9a6cc9b tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: c83d025e-76be-4e93-a864-936fbf5f7a16] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:53:30.608054 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-526a722f-a583-4c24-8578-486bc9a6cc9b tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:30.608538 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-526a722f-a583-4c24-8578-486bc9a6cc9b tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:30.608976 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-526a722f-a583-4c24-8578-486bc9a6cc9b tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:30.609696 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-526a722f-a583-4c24-8578-486bc9a6cc9b tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:30.610151 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-526a722f-a583-4c24-8578-486bc9a6cc9b tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:30.610574 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-526a722f-a583-4c24-8578-486bc9a6cc9b tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:30.639612 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-64206ca8-9e36-4368-b747-56446e42d970 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Calling method '.version_select at 0x7f44c6e46b80>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:53:30.721465 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-64206ca8-9e36-4368-b747-56446e42d970 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1352884653" status: 202 len: 0 microversion: 2.1 time: 0.086154 Oct 30 01:53:30.727354 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3211/6425] 10.222.0.13 () {58 vars in 1257 bytes} [Sun Oct 30 01:53:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1352884653 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 30 01:53:30.785676 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-526a722f-a583-4c24-8578-486bc9a6cc9b tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:53:30.795948 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-526a722f-a583-4c24-8578-486bc9a6cc9b tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16" status: 200 len: 1689 microversion: 2.1 time: 0.199212 Oct 30 01:53:30.801184 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3215/6426] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:53:30 2022] GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16 => generated 1689 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:53:31.821920 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-14849535-4477-4505-b45e-6132e7b92376 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:53:31.822876 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-14849535-4477-4505-b45e-6132e7b92376 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: c83d025e-76be-4e93-a864-936fbf5f7a16] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:53:31.825040 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:53:31.831911 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14849535-4477-4505-b45e-6132e7b92376 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:31.832573 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14849535-4477-4505-b45e-6132e7b92376 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:31.833293 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14849535-4477-4505-b45e-6132e7b92376 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:31.834134 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14849535-4477-4505-b45e-6132e7b92376 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:31.834674 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14849535-4477-4505-b45e-6132e7b92376 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:31.835174 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14849535-4477-4505-b45e-6132e7b92376 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:32.022593 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-14849535-4477-4505-b45e-6132e7b92376 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:53:32.031084 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-14849535-4477-4505-b45e-6132e7b92376 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16" status: 200 len: 1681 microversion: 2.1 time: 0.214202 Oct 30 01:53:32.031959 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3212/6427] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:53:31 2022] GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16 => generated 1681 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:53:45.391162 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4d5182d5-1d87-4849-b8ff-f90b658b907a tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Action: 'create', calling method: .version_select at 0x7f44c6e3edc0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-869178345", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTShjYsstr9GhIZrn6cmwlcyGN+gVs3HFHLZqlrtsoZY9HMDzID4Dfrhd5tQSj3R2gi5vGVrxKhtSE2nYYT70nXd8X0xKxKNBEU4pPDnz6u9oAaT24li/Eme4XtWQCf2Q=="}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:53:45.400800 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:53:45.401516 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:53:45.433419 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-4d5182d5-1d87-4849-b8ff-f90b658b907a tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Getting quotas for project 735c13f1d49640319694d0a6a3a16519. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:53:45.449176 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-4d5182d5-1d87-4849-b8ff-f90b658b907a tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Getting quotas for user 33a9a7ae4f5a42d7ac76baf67fdb7a2d and project 735c13f1d49640319694d0a6a3a16519. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:53:45.571585 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4d5182d5-1d87-4849-b8ff-f90b658b907a tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.183851 Oct 30 01:53:45.572280 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3216/6428] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 30 01:53:45 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:53:49.243320 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-330216af-9231-4557-855b-46c251eaef01 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-921674493", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "b695b2de-ae37-41ec-88e6-4e1ad48b888f"}], "key_name": "tempest-TestNetworkBasicOps-869178345", "security_groups": [{"name": "tempest-secgroup-smoke-2086226311"}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:53:49.255636 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:53:49.358026 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-330216af-9231-4557-855b-46c251eaef01 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] validate_networks() for [('b695b2de-ae37-41ec-88e6-4e1ad48b888f', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:53:49.955910 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-330216af-9231-4557-855b-46c251eaef01 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:53:49.956343 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-330216af-9231-4557-855b-46c251eaef01 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:53:49.956820 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-330216af-9231-4557-855b-46c251eaef01 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:53:49.957233 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-330216af-9231-4557-855b-46c251eaef01 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:53:49.957712 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-330216af-9231-4557-855b-46c251eaef01 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:53:49.967327 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-330216af-9231-4557-855b-46c251eaef01 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:49.967821 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-330216af-9231-4557-855b-46c251eaef01 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:49.968255 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-330216af-9231-4557-855b-46c251eaef01 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:49.968983 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-330216af-9231-4557-855b-46c251eaef01 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:49.969667 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-330216af-9231-4557-855b-46c251eaef01 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:49.970154 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-330216af-9231-4557-855b-46c251eaef01 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:49.988769 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-330216af-9231-4557-855b-46c251eaef01 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Getting quotas for project 735c13f1d49640319694d0a6a3a16519. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:53:49.994320 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-330216af-9231-4557-855b-46c251eaef01 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Getting quotas for user 33a9a7ae4f5a42d7ac76baf67fdb7a2d and project 735c13f1d49640319694d0a6a3a16519. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:53:50.008084 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-330216af-9231-4557-855b-46c251eaef01 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:53:50.010556 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-330216af-9231-4557-855b-46c251eaef01 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: 267bfb8f-ffd4-4505-a95b-5ae2efa3ae83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:53:50.191071 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-330216af-9231-4557-855b-46c251eaef01 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.951958 Oct 30 01:53:50.192028 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3213/6429] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:53:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 953 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:53:50.204549 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7fce51fe-5b82-4107-b254-dfc8bdae1076 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:53:50.205165 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7fce51fe-5b82-4107-b254-dfc8bdae1076 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: 267bfb8f-ffd4-4505-a95b-5ae2efa3ae83] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:53:50.255170 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0b7d3625-dce9-499a-8c71-0bee4f72e9f3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:53:50.257469 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0b7d3625-dce9-499a-8c71-0bee4f72e9f3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: c83d025e-76be-4e93-a864-936fbf5f7a16] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:53:50.267397 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b7d3625-dce9-499a-8c71-0bee4f72e9f3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:50.267628 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b7d3625-dce9-499a-8c71-0bee4f72e9f3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:50.268255 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b7d3625-dce9-499a-8c71-0bee4f72e9f3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:50.269257 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b7d3625-dce9-499a-8c71-0bee4f72e9f3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:50.270127 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b7d3625-dce9-499a-8c71-0bee4f72e9f3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:50.270715 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b7d3625-dce9-499a-8c71-0bee4f72e9f3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:50.349973 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0b7d3625-dce9-499a-8c71-0bee4f72e9f3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "POST /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16/action" status: 200 len: 24579 microversion: 2.1 time: 0.099516 Oct 30 01:53:50.351325 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3214/6430] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:53:50 2022] POST /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16/action => generated 24579 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 30 01:53:50.563582 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7fce51fe-5b82-4107-b254-dfc8bdae1076 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a9a7ae4f5a42d7ac76baf67fdb7a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735c13f1d49640319694d0a6a3a16519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:53:50.571288 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7fce51fe-5b82-4107-b254-dfc8bdae1076 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "GET /compute/v2.1/servers/267bfb8f-ffd4-4505-a95b-5ae2efa3ae83" status: 200 len: 1247 microversion: 2.1 time: 0.372117 Oct 30 01:53:50.571859 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3217/6431] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:53:50 2022] GET /compute/v2.1/servers/267bfb8f-ffd4-4505-a95b-5ae2efa3ae83 => generated 1247 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:53:51.595718 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4801e2a7-0385-40cc-a6f9-32c196761e55 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:53:51.597280 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4801e2a7-0385-40cc-a6f9-32c196761e55 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: 267bfb8f-ffd4-4505-a95b-5ae2efa3ae83] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:53:51.606576 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4801e2a7-0385-40cc-a6f9-32c196761e55 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:51.607379 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4801e2a7-0385-40cc-a6f9-32c196761e55 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:51.609632 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4801e2a7-0385-40cc-a6f9-32c196761e55 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:51.609632 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4801e2a7-0385-40cc-a6f9-32c196761e55 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:51.609632 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4801e2a7-0385-40cc-a6f9-32c196761e55 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:51.609632 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4801e2a7-0385-40cc-a6f9-32c196761e55 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:51.722243 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4801e2a7-0385-40cc-a6f9-32c196761e55 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a9a7ae4f5a42d7ac76baf67fdb7a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735c13f1d49640319694d0a6a3a16519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:53:51.737591 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4801e2a7-0385-40cc-a6f9-32c196761e55 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "GET /compute/v2.1/servers/267bfb8f-ffd4-4505-a95b-5ae2efa3ae83" status: 200 len: 1243 microversion: 2.1 time: 0.146260 Oct 30 01:53:51.738587 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3215/6432] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:53:51 2022] GET /compute/v2.1/servers/267bfb8f-ffd4-4505-a95b-5ae2efa3ae83 => generated 1243 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:53:52.771650 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5f742fe5-d6f8-4856-afe0-b98c2cacd623 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:53:52.772283 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5f742fe5-d6f8-4856-afe0-b98c2cacd623 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: 267bfb8f-ffd4-4505-a95b-5ae2efa3ae83] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:53:52.788859 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f742fe5-d6f8-4856-afe0-b98c2cacd623 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:52.789380 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f742fe5-d6f8-4856-afe0-b98c2cacd623 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:52.789824 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f742fe5-d6f8-4856-afe0-b98c2cacd623 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:52.790534 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f742fe5-d6f8-4856-afe0-b98c2cacd623 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:52.790991 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f742fe5-d6f8-4856-afe0-b98c2cacd623 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:52.791414 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f742fe5-d6f8-4856-afe0-b98c2cacd623 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:52.926802 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5f742fe5-d6f8-4856-afe0-b98c2cacd623 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a9a7ae4f5a42d7ac76baf67fdb7a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735c13f1d49640319694d0a6a3a16519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:53:52.936279 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5f742fe5-d6f8-4856-afe0-b98c2cacd623 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "GET /compute/v2.1/servers/267bfb8f-ffd4-4505-a95b-5ae2efa3ae83" status: 200 len: 1307 microversion: 2.1 time: 0.168894 Oct 30 01:53:52.937374 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3218/6433] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:53:52 2022] GET /compute/v2.1/servers/267bfb8f-ffd4-4505-a95b-5ae2efa3ae83 => generated 1307 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:53:53.971524 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-10d627e6-f407-4bf2-8439-5673e4977f7c tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:53:53.973813 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-10d627e6-f407-4bf2-8439-5673e4977f7c tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: 267bfb8f-ffd4-4505-a95b-5ae2efa3ae83] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:53:53.981778 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-10d627e6-f407-4bf2-8439-5673e4977f7c tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:53.982619 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-10d627e6-f407-4bf2-8439-5673e4977f7c tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:53.983158 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-10d627e6-f407-4bf2-8439-5673e4977f7c tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:53.984221 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-10d627e6-f407-4bf2-8439-5673e4977f7c tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:53.985401 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-10d627e6-f407-4bf2-8439-5673e4977f7c tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:53.986453 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-10d627e6-f407-4bf2-8439-5673e4977f7c tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:54.480008 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-10d627e6-f407-4bf2-8439-5673e4977f7c tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a9a7ae4f5a42d7ac76baf67fdb7a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735c13f1d49640319694d0a6a3a16519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:53:54.488389 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-10d627e6-f407-4bf2-8439-5673e4977f7c tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "GET /compute/v2.1/servers/267bfb8f-ffd4-4505-a95b-5ae2efa3ae83" status: 200 len: 1373 microversion: 2.1 time: 0.522033 Oct 30 01:53:54.488967 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3216/6434] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:53:53 2022] GET /compute/v2.1/servers/267bfb8f-ffd4-4505-a95b-5ae2efa3ae83 => generated 1373 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:53:55.513844 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ed9967b0-797f-4c07-abf4-0b8cb3a752ec tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:53:55.514611 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ed9967b0-797f-4c07-abf4-0b8cb3a752ec tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: 267bfb8f-ffd4-4505-a95b-5ae2efa3ae83] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:53:55.523557 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed9967b0-797f-4c07-abf4-0b8cb3a752ec tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:55.524042 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed9967b0-797f-4c07-abf4-0b8cb3a752ec tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:55.524616 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed9967b0-797f-4c07-abf4-0b8cb3a752ec tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:55.525319 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed9967b0-797f-4c07-abf4-0b8cb3a752ec tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:55.525787 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed9967b0-797f-4c07-abf4-0b8cb3a752ec tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:55.526207 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed9967b0-797f-4c07-abf4-0b8cb3a752ec tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:55.833204 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ed9967b0-797f-4c07-abf4-0b8cb3a752ec tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a9a7ae4f5a42d7ac76baf67fdb7a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735c13f1d49640319694d0a6a3a16519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:53:55.845291 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ed9967b0-797f-4c07-abf4-0b8cb3a752ec tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "GET /compute/v2.1/servers/267bfb8f-ffd4-4505-a95b-5ae2efa3ae83" status: 200 len: 1373 microversion: 2.1 time: 0.336979 Oct 30 01:53:55.845983 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3219/6435] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:53:55 2022] GET /compute/v2.1/servers/267bfb8f-ffd4-4505-a95b-5ae2efa3ae83 => generated 1373 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:53:56.169627 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-2e42d9e5-9031-4343-a39a-d2642c13f300 req-14882886-4a7c-4c8d-bd25-14067c0f9775 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "267bfb8f-ffd4-4505-a95b-5ae2efa3ae83", "tag": "1ad474a3-bbdd-4804-96fc-c9fb211b3c57"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:53:56.186612 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-2e42d9e5-9031-4343-a39a-d2642c13f300 req-14882886-4a7c-4c8d-bd25-14067c0f9775 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:56.187395 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-2e42d9e5-9031-4343-a39a-d2642c13f300 req-14882886-4a7c-4c8d-bd25-14067c0f9775 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:56.187842 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-2e42d9e5-9031-4343-a39a-d2642c13f300 req-14882886-4a7c-4c8d-bd25-14067c0f9775 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:56.206567 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-2e42d9e5-9031-4343-a39a-d2642c13f300 req-14882886-4a7c-4c8d-bd25-14067c0f9775 service nova] Creating event network-changed:1ad474a3-bbdd-4804-96fc-c9fb211b3c57 for instance 267bfb8f-ffd4-4505-a95b-5ae2efa3ae83 on n-h2-master-1 Oct 30 01:53:56.212359 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-2e42d9e5-9031-4343-a39a-d2642c13f300 req-14882886-4a7c-4c8d-bd25-14067c0f9775 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050143 Oct 30 01:53:56.213199 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3217/6436] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:53:56.675250 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ad85edec-6e3b-4c2e-b69a-3e17f113fb3e tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:53:56.676489 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ad85edec-6e3b-4c2e-b69a-3e17f113fb3e tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] [instance: c83d025e-76be-4e93-a864-936fbf5f7a16] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:53:56.686402 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ad85edec-6e3b-4c2e-b69a-3e17f113fb3e tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:56.687438 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ad85edec-6e3b-4c2e-b69a-3e17f113fb3e tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:56.688039 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ad85edec-6e3b-4c2e-b69a-3e17f113fb3e tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:56.689190 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ad85edec-6e3b-4c2e-b69a-3e17f113fb3e tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:56.690476 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ad85edec-6e3b-4c2e-b69a-3e17f113fb3e tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:56.690906 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ad85edec-6e3b-4c2e-b69a-3e17f113fb3e tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:56.875129 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5581b9e3-4027-4aa4-a311-51c210a766a2 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:53:56.886987 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5581b9e3-4027-4aa4-a311-51c210a766a2 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: 267bfb8f-ffd4-4505-a95b-5ae2efa3ae83] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:53:56.907394 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5581b9e3-4027-4aa4-a311-51c210a766a2 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:56.907899 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5581b9e3-4027-4aa4-a311-51c210a766a2 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:56.908367 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5581b9e3-4027-4aa4-a311-51c210a766a2 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:56.909074 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5581b9e3-4027-4aa4-a311-51c210a766a2 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:56.910063 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5581b9e3-4027-4aa4-a311-51c210a766a2 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:56.910906 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5581b9e3-4027-4aa4-a311-51c210a766a2 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:57.088102 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ad85edec-6e3b-4c2e-b69a-3e17f113fb3e tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16" status: 200 len: 1832 microversion: 2.1 time: 0.418684 Oct 30 01:53:57.089348 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3220/6437] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:53:56 2022] GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16 => generated 1832 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:53:57.289963 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5581b9e3-4027-4aa4-a311-51c210a766a2 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a9a7ae4f5a42d7ac76baf67fdb7a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735c13f1d49640319694d0a6a3a16519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:53:57.301604 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5581b9e3-4027-4aa4-a311-51c210a766a2 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "GET /compute/v2.1/servers/267bfb8f-ffd4-4505-a95b-5ae2efa3ae83" status: 200 len: 1373 microversion: 2.1 time: 0.436602 Oct 30 01:53:57.313800 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3218/6438] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:53:56 2022] GET /compute/v2.1/servers/267bfb8f-ffd4-4505-a95b-5ae2efa3ae83 => generated 1373 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:53:58.326391 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6a1e3dd6-feb2-4c21-9aef-3092a73d548a tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:53:58.327031 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6a1e3dd6-feb2-4c21-9aef-3092a73d548a tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: 267bfb8f-ffd4-4505-a95b-5ae2efa3ae83] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:53:58.334764 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a1e3dd6-feb2-4c21-9aef-3092a73d548a tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:58.335885 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a1e3dd6-feb2-4c21-9aef-3092a73d548a tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:58.336335 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a1e3dd6-feb2-4c21-9aef-3092a73d548a tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:58.337260 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a1e3dd6-feb2-4c21-9aef-3092a73d548a tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:58.337910 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a1e3dd6-feb2-4c21-9aef-3092a73d548a tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:58.338348 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a1e3dd6-feb2-4c21-9aef-3092a73d548a tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:58.947277 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6a1e3dd6-feb2-4c21-9aef-3092a73d548a tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a9a7ae4f5a42d7ac76baf67fdb7a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735c13f1d49640319694d0a6a3a16519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:53:58.956083 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6a1e3dd6-feb2-4c21-9aef-3092a73d548a tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "GET /compute/v2.1/servers/267bfb8f-ffd4-4505-a95b-5ae2efa3ae83" status: 200 len: 1373 microversion: 2.1 time: 0.633703 Oct 30 01:53:58.956762 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3221/6439] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:53:58 2022] GET /compute/v2.1/servers/267bfb8f-ffd4-4505-a95b-5ae2efa3ae83 => generated 1373 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:53:59.102101 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-2ef06f5f-2dea-494a-9ff3-5e7a1a8e589c req-06a22005-8985-42d8-bdc4-2676f279193f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c83d025e-76be-4e93-a864-936fbf5f7a16", "tag": "065ae8cd-82e5-483d-82fe-f09b43b9bc76"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:53:59.104407 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0b86aa16-8136-4287-9428-5d27c6695f61 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:53:59.104928 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0b86aa16-8136-4287-9428-5d27c6695f61 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: c83d025e-76be-4e93-a864-936fbf5f7a16] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:53:59.112351 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-2ef06f5f-2dea-494a-9ff3-5e7a1a8e589c req-06a22005-8985-42d8-bdc4-2676f279193f service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:59.113609 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-2ef06f5f-2dea-494a-9ff3-5e7a1a8e589c req-06a22005-8985-42d8-bdc4-2676f279193f service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:59.114228 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-2ef06f5f-2dea-494a-9ff3-5e7a1a8e589c req-06a22005-8985-42d8-bdc4-2676f279193f service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:59.117197 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b86aa16-8136-4287-9428-5d27c6695f61 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:59.117643 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b86aa16-8136-4287-9428-5d27c6695f61 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:59.124154 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b86aa16-8136-4287-9428-5d27c6695f61 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:59.125095 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b86aa16-8136-4287-9428-5d27c6695f61 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:59.125515 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b86aa16-8136-4287-9428-5d27c6695f61 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:59.125964 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b86aa16-8136-4287-9428-5d27c6695f61 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:59.131916 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-2ef06f5f-2dea-494a-9ff3-5e7a1a8e589c req-06a22005-8985-42d8-bdc4-2676f279193f service nova] Creating event network-changed:065ae8cd-82e5-483d-82fe-f09b43b9bc76 for instance c83d025e-76be-4e93-a864-936fbf5f7a16 on n-h1-master-1 Oct 30 01:53:59.137959 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-2ef06f5f-2dea-494a-9ff3-5e7a1a8e589c req-06a22005-8985-42d8-bdc4-2676f279193f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043860 Oct 30 01:53:59.142274 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3222/6440] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:53:59.166104 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0b86aa16-8136-4287-9428-5d27c6695f61 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: c83d025e-76be-4e93-a864-936fbf5f7a16] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:53:59.540025 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0b86aa16-8136-4287-9428-5d27c6695f61 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16" status: 204 len: 0 microversion: 2.1 time: 0.444744 Oct 30 01:53:59.540025 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3219/6441] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:53:59 2022] DELETE /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:53:59.547346 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b20cdbc5-665d-481c-ac02-eee5100a3ff6 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:53:59.548049 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b20cdbc5-665d-481c-ac02-eee5100a3ff6 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: c83d025e-76be-4e93-a864-936fbf5f7a16] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:53:59.556758 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b20cdbc5-665d-481c-ac02-eee5100a3ff6 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:59.559596 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b20cdbc5-665d-481c-ac02-eee5100a3ff6 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:59.560238 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b20cdbc5-665d-481c-ac02-eee5100a3ff6 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:59.561144 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b20cdbc5-665d-481c-ac02-eee5100a3ff6 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:59.561800 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b20cdbc5-665d-481c-ac02-eee5100a3ff6 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:59.562407 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b20cdbc5-665d-481c-ac02-eee5100a3ff6 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:59.729040 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b20cdbc5-665d-481c-ac02-eee5100a3ff6 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:53:59.745618 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b20cdbc5-665d-481c-ac02-eee5100a3ff6 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16" status: 200 len: 1687 microversion: 2.1 time: 0.199589 Oct 30 01:53:59.758898 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3223/6442] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:53:59 2022] GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16 => generated 1687 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:53:59.983568 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1a0d7121-a1c7-4600-aec3-6260f3edd1fd tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:53:59.984281 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1a0d7121-a1c7-4600-aec3-6260f3edd1fd tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: 267bfb8f-ffd4-4505-a95b-5ae2efa3ae83] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:53:59.986843 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:53:59.996442 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a0d7121-a1c7-4600-aec3-6260f3edd1fd tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:53:59.997649 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a0d7121-a1c7-4600-aec3-6260f3edd1fd tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:53:59.998374 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a0d7121-a1c7-4600-aec3-6260f3edd1fd tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:53:59.999678 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a0d7121-a1c7-4600-aec3-6260f3edd1fd tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:00.000373 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a0d7121-a1c7-4600-aec3-6260f3edd1fd tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:00.001674 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a0d7121-a1c7-4600-aec3-6260f3edd1fd tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:00.002768 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=6 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:54:00.194450 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1a0d7121-a1c7-4600-aec3-6260f3edd1fd tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a9a7ae4f5a42d7ac76baf67fdb7a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735c13f1d49640319694d0a6a3a16519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:54:00.204243 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1a0d7121-a1c7-4600-aec3-6260f3edd1fd tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "GET /compute/v2.1/servers/267bfb8f-ffd4-4505-a95b-5ae2efa3ae83" status: 200 len: 1373 microversion: 2.1 time: 0.227479 Oct 30 01:54:00.220219 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3220/6443] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:53:59 2022] GET /compute/v2.1/servers/267bfb8f-ffd4-4505-a95b-5ae2efa3ae83 => generated 1373 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:54:00.768360 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-26fbf930-7bf8-414e-ab05-16b70dcdde71 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:54:00.768992 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-26fbf930-7bf8-414e-ab05-16b70dcdde71 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: c83d025e-76be-4e93-a864-936fbf5f7a16] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:54:00.772782 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=6 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:54:00.776686 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-26fbf930-7bf8-414e-ab05-16b70dcdde71 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:00.777411 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-26fbf930-7bf8-414e-ab05-16b70dcdde71 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:00.778028 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-26fbf930-7bf8-414e-ab05-16b70dcdde71 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:00.778908 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-26fbf930-7bf8-414e-ab05-16b70dcdde71 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:00.779521 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-26fbf930-7bf8-414e-ab05-16b70dcdde71 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:00.780109 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-26fbf930-7bf8-414e-ab05-16b70dcdde71 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:01.167058 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-26fbf930-7bf8-414e-ab05-16b70dcdde71 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:54:01.180445 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-26fbf930-7bf8-414e-ab05-16b70dcdde71 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16" status: 200 len: 1687 microversion: 2.1 time: 0.416704 Oct 30 01:54:01.183642 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3224/6444] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:54:00 2022] GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16 => generated 1687 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:54:01.228333 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c8ef2b49-56e5-47f1-9558-deeb62e92b40 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:54:01.228885 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c8ef2b49-56e5-47f1-9558-deeb62e92b40 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: 267bfb8f-ffd4-4505-a95b-5ae2efa3ae83] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:54:01.235982 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c8ef2b49-56e5-47f1-9558-deeb62e92b40 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:01.236499 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c8ef2b49-56e5-47f1-9558-deeb62e92b40 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:01.236940 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c8ef2b49-56e5-47f1-9558-deeb62e92b40 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:01.237675 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c8ef2b49-56e5-47f1-9558-deeb62e92b40 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:01.238134 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c8ef2b49-56e5-47f1-9558-deeb62e92b40 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:01.238566 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c8ef2b49-56e5-47f1-9558-deeb62e92b40 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:01.583921 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c8ef2b49-56e5-47f1-9558-deeb62e92b40 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a9a7ae4f5a42d7ac76baf67fdb7a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735c13f1d49640319694d0a6a3a16519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:54:01.591662 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c8ef2b49-56e5-47f1-9558-deeb62e92b40 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "GET /compute/v2.1/servers/267bfb8f-ffd4-4505-a95b-5ae2efa3ae83" status: 200 len: 1373 microversion: 2.1 time: 0.367383 Oct 30 01:54:01.592558 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3221/6445] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:54:01 2022] GET /compute/v2.1/servers/267bfb8f-ffd4-4505-a95b-5ae2efa3ae83 => generated 1373 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:54:01.957846 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-be7d36fc-be16-49de-9daa-d91acf9bdbc9 req-b9210019-4613-4aea-8a21-0e4a8ca8d45a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c83d025e-76be-4e93-a864-936fbf5f7a16", "name": "network-vif-deleted", "tag": "065ae8cd-82e5-483d-82fe-f09b43b9bc76"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:54:01.977278 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-be7d36fc-be16-49de-9daa-d91acf9bdbc9 req-b9210019-4613-4aea-8a21-0e4a8ca8d45a service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:01.977798 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-be7d36fc-be16-49de-9daa-d91acf9bdbc9 req-b9210019-4613-4aea-8a21-0e4a8ca8d45a service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:01.978225 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-be7d36fc-be16-49de-9daa-d91acf9bdbc9 req-b9210019-4613-4aea-8a21-0e4a8ca8d45a service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:01.990671 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-be7d36fc-be16-49de-9daa-d91acf9bdbc9 req-b9210019-4613-4aea-8a21-0e4a8ca8d45a service nova] Creating event network-vif-deleted:065ae8cd-82e5-483d-82fe-f09b43b9bc76 for instance c83d025e-76be-4e93-a864-936fbf5f7a16 on n-h1-master-1 Oct 30 01:54:01.996399 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-be7d36fc-be16-49de-9daa-d91acf9bdbc9 req-b9210019-4613-4aea-8a21-0e4a8ca8d45a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045351 Oct 30 01:54:01.997015 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3225/6446] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:54:02.037774 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-e5e5a011-0a26-46ad-a9d0-fef7b9611a0f req-5147395b-a071-425d-86c8-d9412af488ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "267bfb8f-ffd4-4505-a95b-5ae2efa3ae83", "name": "network-vif-plugged", "status": "completed", "tag": "1ad474a3-bbdd-4804-96fc-c9fb211b3c57"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:54:02.048221 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e5e5a011-0a26-46ad-a9d0-fef7b9611a0f req-5147395b-a071-425d-86c8-d9412af488ee service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:02.049235 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e5e5a011-0a26-46ad-a9d0-fef7b9611a0f req-5147395b-a071-425d-86c8-d9412af488ee service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:02.049700 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e5e5a011-0a26-46ad-a9d0-fef7b9611a0f req-5147395b-a071-425d-86c8-d9412af488ee service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:02.062714 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-e5e5a011-0a26-46ad-a9d0-fef7b9611a0f req-5147395b-a071-425d-86c8-d9412af488ee service nova] Creating event network-vif-plugged:1ad474a3-bbdd-4804-96fc-c9fb211b3c57 for instance 267bfb8f-ffd4-4505-a95b-5ae2efa3ae83 on n-h2-master-1 Oct 30 01:54:02.070801 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-e5e5a011-0a26-46ad-a9d0-fef7b9611a0f req-5147395b-a071-425d-86c8-d9412af488ee service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035712 Oct 30 01:54:02.070801 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3222/6447] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:54:02.204706 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2f736258-92af-4292-b6cd-c8dfc229cb61 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:54:02.205814 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2f736258-92af-4292-b6cd-c8dfc229cb61 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: c83d025e-76be-4e93-a864-936fbf5f7a16] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:54:02.212526 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2f736258-92af-4292-b6cd-c8dfc229cb61 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:02.213270 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2f736258-92af-4292-b6cd-c8dfc229cb61 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:02.213925 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2f736258-92af-4292-b6cd-c8dfc229cb61 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:02.214650 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2f736258-92af-4292-b6cd-c8dfc229cb61 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:02.215261 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2f736258-92af-4292-b6cd-c8dfc229cb61 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:02.215863 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2f736258-92af-4292-b6cd-c8dfc229cb61 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:02.322761 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2f736258-92af-4292-b6cd-c8dfc229cb61 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:54:02.332968 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2f736258-92af-4292-b6cd-c8dfc229cb61 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16" status: 200 len: 1351 microversion: 2.1 time: 0.132386 Oct 30 01:54:02.335665 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3226/6448] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:54:02 2022] GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16 => generated 1351 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:54:02.622929 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6da3d170-a04e-41ef-be5b-8a01182e765a tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:54:02.623652 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6da3d170-a04e-41ef-be5b-8a01182e765a tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: 267bfb8f-ffd4-4505-a95b-5ae2efa3ae83] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:54:02.630468 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6da3d170-a04e-41ef-be5b-8a01182e765a tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:02.630970 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6da3d170-a04e-41ef-be5b-8a01182e765a tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:02.631412 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6da3d170-a04e-41ef-be5b-8a01182e765a tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:02.632126 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6da3d170-a04e-41ef-be5b-8a01182e765a tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:02.632624 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6da3d170-a04e-41ef-be5b-8a01182e765a tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:02.633059 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6da3d170-a04e-41ef-be5b-8a01182e765a tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:02.795345 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6da3d170-a04e-41ef-be5b-8a01182e765a tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a9a7ae4f5a42d7ac76baf67fdb7a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735c13f1d49640319694d0a6a3a16519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:54:02.803597 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6da3d170-a04e-41ef-be5b-8a01182e765a tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "GET /compute/v2.1/servers/267bfb8f-ffd4-4505-a95b-5ae2efa3ae83" status: 200 len: 1373 microversion: 2.1 time: 0.190517 Oct 30 01:54:02.804436 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3223/6449] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:54:02 2022] GET /compute/v2.1/servers/267bfb8f-ffd4-4505-a95b-5ae2efa3ae83 => generated 1373 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:54:03.362642 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-21c33ffe-2dcf-4f07-943d-2b146e915d08 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:54:03.363493 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-21c33ffe-2dcf-4f07-943d-2b146e915d08 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: c83d025e-76be-4e93-a864-936fbf5f7a16] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:54:03.370799 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-21c33ffe-2dcf-4f07-943d-2b146e915d08 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:03.371286 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-21c33ffe-2dcf-4f07-943d-2b146e915d08 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:03.371734 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-21c33ffe-2dcf-4f07-943d-2b146e915d08 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:03.372418 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-21c33ffe-2dcf-4f07-943d-2b146e915d08 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:03.372862 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-21c33ffe-2dcf-4f07-943d-2b146e915d08 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:03.373600 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-21c33ffe-2dcf-4f07-943d-2b146e915d08 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:03.389798 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-21c33ffe-2dcf-4f07-943d-2b146e915d08 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] HTTP exception thrown: Instance c83d025e-76be-4e93-a864-936fbf5f7a16 could not be found. Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-21c33ffe-2dcf-4f07-943d-2b146e915d08 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Request method failure captured: Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16 HTTP/1.1 Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdi5g692Uv5xl51AXx_zH5DqygQV5gilQk65Zrt4awXG-qNzrnkspnA78K5Gla_Xr75NP6Y6TYXCTZgpS6AZ1uwBTWQJyiZW5VCW1eOoSX9Nhid2ZA0O0wE2AoU3HGyFGPzUs9NxTgw8u0D_JE9Zhgtle7Vspzqc0hxjWXJSlhOuR44 Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: f2bf165fe12748b29e66ea4f61364aef Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1545186841 Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f2bf165fe12748b29e66ea4f61364aef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f2bf165fe12748b29e66ea4f61364aef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f2bf165fe12748b29e66ea4f61364aef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f2bf165fe12748b29e66ea4f61364aef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1545186841 Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: f2bf165fe12748b29e66ea4f61364aef Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1545186841 Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-TestNetworkAdvancedServerOps-1545186841-project Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: f0f51fe515ee4375a252a8d8a98ec77b Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1545186841-project Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: exception: Instance c83d025e-76be-4e93-a864-936fbf5f7a16 could not be found. Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'c83d025e-76be-4e93-a864-936fbf5f7a16'} Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c83d025e-76be-4e93-a864-936fbf5f7a16 could not be found. Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c83d025e-76be-4e93-a864-936fbf5f7a16 could not be found. Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:54:03.391474 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:54:03.407422 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:54:03.407422 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:54:03.407422 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:54:03.407422 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:54:03.407422 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:54:03.407422 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:54:03.407422 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c83d025e-76be-4e93-a864-936fbf5f7a16 could not be found. Oct 30 01:54:03.407422 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:54:03.407422 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-21c33ffe-2dcf-4f07-943d-2b146e915d08 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Returning 404 to user: Instance c83d025e-76be-4e93-a864-936fbf5f7a16 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:54:03.407422 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-21c33ffe-2dcf-4f07-943d-2b146e915d08 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16" status: 404 len: 111 microversion: 2.1 time: 0.035487 Oct 30 01:54:03.407422 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3227/6450] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:54:03 2022] GET /compute/v2.1/servers/c83d025e-76be-4e93-a864-936fbf5f7a16 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:54:03.828367 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-929e6b34-1925-46ef-8d87-e2afc6f6f2a2 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:54:03.828991 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-929e6b34-1925-46ef-8d87-e2afc6f6f2a2 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: 267bfb8f-ffd4-4505-a95b-5ae2efa3ae83] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:54:03.839320 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-929e6b34-1925-46ef-8d87-e2afc6f6f2a2 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:03.841537 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-929e6b34-1925-46ef-8d87-e2afc6f6f2a2 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:03.842617 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-929e6b34-1925-46ef-8d87-e2afc6f6f2a2 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:03.843563 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-929e6b34-1925-46ef-8d87-e2afc6f6f2a2 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:03.844209 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-929e6b34-1925-46ef-8d87-e2afc6f6f2a2 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:03.844810 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-929e6b34-1925-46ef-8d87-e2afc6f6f2a2 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:04.161834 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-929e6b34-1925-46ef-8d87-e2afc6f6f2a2 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a9a7ae4f5a42d7ac76baf67fdb7a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735c13f1d49640319694d0a6a3a16519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:54:04.178326 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-929e6b34-1925-46ef-8d87-e2afc6f6f2a2 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "GET /compute/v2.1/servers/267bfb8f-ffd4-4505-a95b-5ae2efa3ae83" status: 200 len: 1544 microversion: 2.1 time: 0.353753 Oct 30 01:54:04.179935 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3224/6451] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:54:03 2022] GET /compute/v2.1/servers/267bfb8f-ffd4-4505-a95b-5ae2efa3ae83 => generated 1544 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:54:04.212935 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-59ce3258-3561-4ad0-94b7-9fe84897d3b5 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:54:04.213967 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-59ce3258-3561-4ad0-94b7-9fe84897d3b5 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: 267bfb8f-ffd4-4505-a95b-5ae2efa3ae83] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:54:04.239991 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-59ce3258-3561-4ad0-94b7-9fe84897d3b5 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:04.241695 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-59ce3258-3561-4ad0-94b7-9fe84897d3b5 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:04.242389 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-59ce3258-3561-4ad0-94b7-9fe84897d3b5 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:04.244014 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-59ce3258-3561-4ad0-94b7-9fe84897d3b5 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:04.244832 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-59ce3258-3561-4ad0-94b7-9fe84897d3b5 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:04.245452 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-59ce3258-3561-4ad0-94b7-9fe84897d3b5 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:04.587812 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-59ce3258-3561-4ad0-94b7-9fe84897d3b5 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a9a7ae4f5a42d7ac76baf67fdb7a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735c13f1d49640319694d0a6a3a16519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:54:04.601513 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-59ce3258-3561-4ad0-94b7-9fe84897d3b5 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "GET /compute/v2.1/servers/267bfb8f-ffd4-4505-a95b-5ae2efa3ae83" status: 200 len: 1544 microversion: 2.1 time: 0.400330 Oct 30 01:54:04.603033 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3228/6452] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:54:04 2022] GET /compute/v2.1/servers/267bfb8f-ffd4-4505-a95b-5ae2efa3ae83 => generated 1544 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:54:09.544491 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-39815198-9b7a-4521-b7e4-03500f6418d3 req-82346533-595c-4c91-9b33-56897c5e02d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "267bfb8f-ffd4-4505-a95b-5ae2efa3ae83", "tag": "1ad474a3-bbdd-4804-96fc-c9fb211b3c57"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:54:09.567252 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-39815198-9b7a-4521-b7e4-03500f6418d3 req-82346533-595c-4c91-9b33-56897c5e02d1 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:09.567843 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-39815198-9b7a-4521-b7e4-03500f6418d3 req-82346533-595c-4c91-9b33-56897c5e02d1 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:09.568386 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-39815198-9b7a-4521-b7e4-03500f6418d3 req-82346533-595c-4c91-9b33-56897c5e02d1 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:09.590290 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-39815198-9b7a-4521-b7e4-03500f6418d3 req-82346533-595c-4c91-9b33-56897c5e02d1 service nova] Creating event network-changed:1ad474a3-bbdd-4804-96fc-c9fb211b3c57 for instance 267bfb8f-ffd4-4505-a95b-5ae2efa3ae83 on n-h2-master-1 Oct 30 01:54:09.596121 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-39815198-9b7a-4521-b7e4-03500f6418d3 req-82346533-595c-4c91-9b33-56897c5e02d1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055481 Oct 30 01:54:09.597281 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3225/6453] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:54:10.908448 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-15049fb2-aa00-4d3d-a151-22166265e1d4 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '.version_select at 0x7f44c77d1310>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:54:11.004130 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-15049fb2-aa00-4d3d-a151-22166265e1d4 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-139940220" status: 202 len: 0 microversion: 2.1 time: 0.100206 Oct 30 01:54:11.009010 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3229/6454] 10.222.0.13 () {58 vars in 1281 bytes} [Sun Oct 30 01:54:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-139940220 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:54:11.032210 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-528cd653-b37d-4754-8f8e-3d8416b6649f tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Action: 'create', calling method: .version_select at 0x7f44c6ef8a60>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-325320653", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHI9/2T0kFiDgSrb5HGiFsz1d9LfzWByyMk2RHBrQbP0fYCGA3WvZLxm/a2c7keKB/T+zSBv6SI+ewqx1nj/VUJFuKxb2aYFc3WRCw2xnyl4JWCNJybMtRCC5dpLub2ntA=="}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:54:11.050559 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-528cd653-b37d-4754-8f8e-3d8416b6649f tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Getting quotas for project f2bf165fe12748b29e66ea4f61364aef. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:54:11.056745 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-528cd653-b37d-4754-8f8e-3d8416b6649f tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Getting quotas for user f0f51fe515ee4375a252a8d8a98ec77b and project f2bf165fe12748b29e66ea4f61364aef. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:54:11.176924 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-528cd653-b37d-4754-8f8e-3d8416b6649f tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.150050 Oct 30 01:54:11.177637 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3226/6455] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 30 01:54:11 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:54:23.172170 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b03e51aa-f68b-49bb-a272-54b2027269f8 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1871688748", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "d665ed66-2bc9-418e-a6c9-4decc927c7cd"}], "key_name": "tempest-TestNetworkAdvancedServerOps-325320653", "security_groups": [{"name": "tempest-secgroup-smoke-1736246257"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:54:23.188450 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=54 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:54:23.191950 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:54:23.360236 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-b03e51aa-f68b-49bb-a272-54b2027269f8 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] validate_networks() for [('d665ed66-2bc9-418e-a6c9-4decc927c7cd', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:54:23.976804 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-b03e51aa-f68b-49bb-a272-54b2027269f8 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:54:23.977540 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-b03e51aa-f68b-49bb-a272-54b2027269f8 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:54:23.978125 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-b03e51aa-f68b-49bb-a272-54b2027269f8 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:54:23.978545 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-b03e51aa-f68b-49bb-a272-54b2027269f8 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:54:23.978991 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-b03e51aa-f68b-49bb-a272-54b2027269f8 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:54:23.991748 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b03e51aa-f68b-49bb-a272-54b2027269f8 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:23.992469 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b03e51aa-f68b-49bb-a272-54b2027269f8 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:23.993082 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b03e51aa-f68b-49bb-a272-54b2027269f8 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:23.994138 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b03e51aa-f68b-49bb-a272-54b2027269f8 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:23.994985 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b03e51aa-f68b-49bb-a272-54b2027269f8 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:23.995603 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b03e51aa-f68b-49bb-a272-54b2027269f8 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:24.018461 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-b03e51aa-f68b-49bb-a272-54b2027269f8 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Getting quotas for project f2bf165fe12748b29e66ea4f61364aef. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:54:24.024806 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-b03e51aa-f68b-49bb-a272-54b2027269f8 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Getting quotas for user f0f51fe515ee4375a252a8d8a98ec77b and project f2bf165fe12748b29e66ea4f61364aef. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:54:24.054885 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b03e51aa-f68b-49bb-a272-54b2027269f8 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:54:24.057631 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b03e51aa-f68b-49bb-a272-54b2027269f8 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 5fe3e5b5-f742-42be-9665-5dc90d4474c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:54:24.254051 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b03e51aa-f68b-49bb-a272-54b2027269f8 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.085628 Oct 30 01:54:24.274176 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3230/6456] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:54:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 1107 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:54:24.286127 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f4fe4e1f-b3f9-4bd3-855b-35535dc0f980 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:54:24.286867 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f4fe4e1f-b3f9-4bd3-855b-35535dc0f980 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 5fe3e5b5-f742-42be-9665-5dc90d4474c2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:54:24.306749 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:54:24.308679 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=4 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:54:24.310965 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:54:24.457883 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f4fe4e1f-b3f9-4bd3-855b-35535dc0f980 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:54:24.469120 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f4fe4e1f-b3f9-4bd3-855b-35535dc0f980 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2" status: 200 len: 1266 microversion: 2.1 time: 0.186279 Oct 30 01:54:24.469664 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3227/6457] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:54:24 2022] GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2 => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:54:25.492435 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-107711fb-d1aa-4010-8bcf-1eecac63af29 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:54:25.497970 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-107711fb-d1aa-4010-8bcf-1eecac63af29 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 5fe3e5b5-f742-42be-9665-5dc90d4474c2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:54:25.502349 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-107711fb-d1aa-4010-8bcf-1eecac63af29 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:25.502917 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-107711fb-d1aa-4010-8bcf-1eecac63af29 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:25.503370 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-107711fb-d1aa-4010-8bcf-1eecac63af29 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:25.504088 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-107711fb-d1aa-4010-8bcf-1eecac63af29 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:25.504551 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-107711fb-d1aa-4010-8bcf-1eecac63af29 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:25.504982 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-107711fb-d1aa-4010-8bcf-1eecac63af29 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:25.577253 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-107711fb-d1aa-4010-8bcf-1eecac63af29 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:54:25.586781 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-107711fb-d1aa-4010-8bcf-1eecac63af29 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2" status: 200 len: 1270 microversion: 2.1 time: 0.098403 Oct 30 01:54:25.594266 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3231/6458] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:54:25 2022] GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2 => generated 1270 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:54:26.624395 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-983ade3c-1846-43b7-873d-d4bba0d318e9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:54:26.625126 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-983ade3c-1846-43b7-873d-d4bba0d318e9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 5fe3e5b5-f742-42be-9665-5dc90d4474c2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:54:26.635771 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-983ade3c-1846-43b7-873d-d4bba0d318e9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:26.636375 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-983ade3c-1846-43b7-873d-d4bba0d318e9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:26.636925 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-983ade3c-1846-43b7-873d-d4bba0d318e9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:26.638169 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-983ade3c-1846-43b7-873d-d4bba0d318e9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:26.638778 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-983ade3c-1846-43b7-873d-d4bba0d318e9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:26.639308 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-983ade3c-1846-43b7-873d-d4bba0d318e9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:26.731637 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-983ade3c-1846-43b7-873d-d4bba0d318e9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:54:26.742359 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-983ade3c-1846-43b7-873d-d4bba0d318e9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2" status: 200 len: 1318 microversion: 2.1 time: 0.122322 Oct 30 01:54:26.746362 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3228/6459] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:54:26 2022] GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2 => generated 1318 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:54:27.771663 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5600d2d6-9660-402b-984e-a67cca70bac6 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:54:27.773175 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5600d2d6-9660-402b-984e-a67cca70bac6 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 5fe3e5b5-f742-42be-9665-5dc90d4474c2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:54:27.781725 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5600d2d6-9660-402b-984e-a67cca70bac6 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:27.782802 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5600d2d6-9660-402b-984e-a67cca70bac6 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:27.783483 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5600d2d6-9660-402b-984e-a67cca70bac6 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:27.784440 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5600d2d6-9660-402b-984e-a67cca70bac6 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:27.785126 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5600d2d6-9660-402b-984e-a67cca70bac6 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:27.785813 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5600d2d6-9660-402b-984e-a67cca70bac6 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:27.931365 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-92a92a00-edf2-42cc-b339-e21dfe721f93 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:54:27.933500 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-92a92a00-edf2-42cc-b339-e21dfe721f93 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: 267bfb8f-ffd4-4505-a95b-5ae2efa3ae83] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:54:27.943672 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-92a92a00-edf2-42cc-b339-e21dfe721f93 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:27.944183 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-92a92a00-edf2-42cc-b339-e21dfe721f93 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:27.944627 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-92a92a00-edf2-42cc-b339-e21dfe721f93 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:27.945405 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-92a92a00-edf2-42cc-b339-e21dfe721f93 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:27.949603 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-92a92a00-edf2-42cc-b339-e21dfe721f93 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:27.949603 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-92a92a00-edf2-42cc-b339-e21dfe721f93 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:28.017671 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-92a92a00-edf2-42cc-b339-e21dfe721f93 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "POST /compute/v2.1/servers/267bfb8f-ffd4-4505-a95b-5ae2efa3ae83/action" status: 200 len: 24573 microversion: 2.1 time: 0.089031 Oct 30 01:54:28.025754 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3229/6460] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:54:27 2022] POST /compute/v2.1/servers/267bfb8f-ffd4-4505-a95b-5ae2efa3ae83/action => generated 24573 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 30 01:54:28.082989 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5600d2d6-9660-402b-984e-a67cca70bac6 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:54:28.090940 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5600d2d6-9660-402b-984e-a67cca70bac6 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2" status: 200 len: 1324 microversion: 2.1 time: 0.324390 Oct 30 01:54:28.091622 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3232/6461] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:54:27 2022] GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2 => generated 1324 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:54:29.120891 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-da11569c-d91a-4644-81f4-588b8fa3dbbe tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:54:29.121771 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-da11569c-d91a-4644-81f4-588b8fa3dbbe tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 5fe3e5b5-f742-42be-9665-5dc90d4474c2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:54:29.133861 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da11569c-d91a-4644-81f4-588b8fa3dbbe tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:29.134661 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da11569c-d91a-4644-81f4-588b8fa3dbbe tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:29.134661 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da11569c-d91a-4644-81f4-588b8fa3dbbe tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:29.135365 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da11569c-d91a-4644-81f4-588b8fa3dbbe tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:29.135889 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da11569c-d91a-4644-81f4-588b8fa3dbbe tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:29.136381 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da11569c-d91a-4644-81f4-588b8fa3dbbe tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:29.463607 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-da11569c-d91a-4644-81f4-588b8fa3dbbe tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:54:29.481113 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-da11569c-d91a-4644-81f4-588b8fa3dbbe tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2" status: 200 len: 1392 microversion: 2.1 time: 0.364675 Oct 30 01:54:29.482745 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3230/6462] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:54:29 2022] GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2 => generated 1392 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:54:30.507228 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fb18e49b-6e82-4546-a582-d4df825058aa tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:54:30.508914 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fb18e49b-6e82-4546-a582-d4df825058aa tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 5fe3e5b5-f742-42be-9665-5dc90d4474c2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:54:30.520707 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb18e49b-6e82-4546-a582-d4df825058aa tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:30.521757 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb18e49b-6e82-4546-a582-d4df825058aa tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:30.522471 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb18e49b-6e82-4546-a582-d4df825058aa tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:30.523436 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb18e49b-6e82-4546-a582-d4df825058aa tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:30.524124 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb18e49b-6e82-4546-a582-d4df825058aa tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:30.524787 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb18e49b-6e82-4546-a582-d4df825058aa tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:30.705184 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-fb18e49b-6e82-4546-a582-d4df825058aa tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:54:30.715000 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fb18e49b-6e82-4546-a582-d4df825058aa tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2" status: 200 len: 1392 microversion: 2.1 time: 0.214717 Oct 30 01:54:30.729780 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3233/6463] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:54:30 2022] GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2 => generated 1392 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:54:30.788043 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-62699a38-dcfd-4524-88ed-6e8bb054917b req-01722163-f06b-45e8-a6cc-147ff184a96a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fe3e5b5-f742-42be-9665-5dc90d4474c2", "tag": "69daaac0-4496-4426-b057-3b20189fdfd6"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:54:30.810610 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-62699a38-dcfd-4524-88ed-6e8bb054917b req-01722163-f06b-45e8-a6cc-147ff184a96a service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:30.811952 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-62699a38-dcfd-4524-88ed-6e8bb054917b req-01722163-f06b-45e8-a6cc-147ff184a96a service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:30.812599 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-62699a38-dcfd-4524-88ed-6e8bb054917b req-01722163-f06b-45e8-a6cc-147ff184a96a service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:30.826111 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-62699a38-dcfd-4524-88ed-6e8bb054917b req-01722163-f06b-45e8-a6cc-147ff184a96a service nova] Creating event network-changed:69daaac0-4496-4426-b057-3b20189fdfd6 for instance 5fe3e5b5-f742-42be-9665-5dc90d4474c2 on n-h1-master-1 Oct 30 01:54:30.831738 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-62699a38-dcfd-4524-88ed-6e8bb054917b req-01722163-f06b-45e8-a6cc-147ff184a96a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053089 Oct 30 01:54:30.832289 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3231/6464] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:54:31.739822 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ca284fa0-b57e-4bd0-acfe-4f7f51d9d4ff tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:54:31.740434 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ca284fa0-b57e-4bd0-acfe-4f7f51d9d4ff tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 5fe3e5b5-f742-42be-9665-5dc90d4474c2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:54:31.758698 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ca284fa0-b57e-4bd0-acfe-4f7f51d9d4ff tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:31.770188 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ca284fa0-b57e-4bd0-acfe-4f7f51d9d4ff tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:31.770188 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ca284fa0-b57e-4bd0-acfe-4f7f51d9d4ff tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:31.770188 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ca284fa0-b57e-4bd0-acfe-4f7f51d9d4ff tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:31.770188 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ca284fa0-b57e-4bd0-acfe-4f7f51d9d4ff tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:31.770188 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ca284fa0-b57e-4bd0-acfe-4f7f51d9d4ff tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:31.947931 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ca284fa0-b57e-4bd0-acfe-4f7f51d9d4ff tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:54:31.956903 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ca284fa0-b57e-4bd0-acfe-4f7f51d9d4ff tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2" status: 200 len: 1392 microversion: 2.1 time: 0.220941 Oct 30 01:54:31.957795 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3234/6465] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:54:31 2022] GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2 => generated 1392 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:54:32.981901 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fc79d699-758f-4ff3-a4f2-449830442ab6 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:54:32.982792 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-fc79d699-758f-4ff3-a4f2-449830442ab6 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 5fe3e5b5-f742-42be-9665-5dc90d4474c2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:54:32.998420 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fc79d699-758f-4ff3-a4f2-449830442ab6 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:32.999186 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fc79d699-758f-4ff3-a4f2-449830442ab6 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:32.999882 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fc79d699-758f-4ff3-a4f2-449830442ab6 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:33.000788 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fc79d699-758f-4ff3-a4f2-449830442ab6 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:33.001944 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fc79d699-758f-4ff3-a4f2-449830442ab6 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:33.003568 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fc79d699-758f-4ff3-a4f2-449830442ab6 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:33.314321 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-fc79d699-758f-4ff3-a4f2-449830442ab6 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:54:33.322805 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fc79d699-758f-4ff3-a4f2-449830442ab6 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2" status: 200 len: 1392 microversion: 2.1 time: 0.346081 Oct 30 01:54:33.341197 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3232/6466] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:54:32 2022] GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2 => generated 1392 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:54:34.349589 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ee899464-6a8d-458c-9ae4-326023081295 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:54:34.350101 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ee899464-6a8d-458c-9ae4-326023081295 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 5fe3e5b5-f742-42be-9665-5dc90d4474c2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:54:34.354050 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:54:34.357010 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=6 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:54:34.375122 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee899464-6a8d-458c-9ae4-326023081295 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:34.375976 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee899464-6a8d-458c-9ae4-326023081295 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:34.376662 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee899464-6a8d-458c-9ae4-326023081295 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:34.378546 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee899464-6a8d-458c-9ae4-326023081295 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:34.385833 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee899464-6a8d-458c-9ae4-326023081295 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:34.385833 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee899464-6a8d-458c-9ae4-326023081295 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:34.597747 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ee899464-6a8d-458c-9ae4-326023081295 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:54:34.613962 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ee899464-6a8d-458c-9ae4-326023081295 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2" status: 200 len: 1392 microversion: 2.1 time: 0.269219 Oct 30 01:54:34.617050 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3235/6467] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:54:34 2022] GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2 => generated 1392 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:54:35.637292 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:54:35.641304 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9247fb13-032a-45dd-ba8e-db430adf3ca5 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:54:35.642108 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9247fb13-032a-45dd-ba8e-db430adf3ca5 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 5fe3e5b5-f742-42be-9665-5dc90d4474c2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:54:35.648102 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9247fb13-032a-45dd-ba8e-db430adf3ca5 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:35.648598 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9247fb13-032a-45dd-ba8e-db430adf3ca5 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:35.649041 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9247fb13-032a-45dd-ba8e-db430adf3ca5 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:35.649773 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9247fb13-032a-45dd-ba8e-db430adf3ca5 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:35.650411 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9247fb13-032a-45dd-ba8e-db430adf3ca5 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:35.650998 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9247fb13-032a-45dd-ba8e-db430adf3ca5 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:35.899426 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9247fb13-032a-45dd-ba8e-db430adf3ca5 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:54:35.938786 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9247fb13-032a-45dd-ba8e-db430adf3ca5 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2" status: 200 len: 1392 microversion: 2.1 time: 0.299876 Oct 30 01:54:35.955657 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3233/6468] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:54:35 2022] GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2 => generated 1392 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:54:36.227767 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-dffe7e16-168a-4eb3-a80e-9fed037623d1 req-1cd9b266-7155-4376-b463-56e8e5f676f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fe3e5b5-f742-42be-9665-5dc90d4474c2", "name": "network-vif-plugged", "status": "completed", "tag": "69daaac0-4496-4426-b057-3b20189fdfd6"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:54:36.244437 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-dffe7e16-168a-4eb3-a80e-9fed037623d1 req-1cd9b266-7155-4376-b463-56e8e5f676f8 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:36.245486 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-dffe7e16-168a-4eb3-a80e-9fed037623d1 req-1cd9b266-7155-4376-b463-56e8e5f676f8 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:36.246238 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-dffe7e16-168a-4eb3-a80e-9fed037623d1 req-1cd9b266-7155-4376-b463-56e8e5f676f8 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:36.272919 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-dffe7e16-168a-4eb3-a80e-9fed037623d1 req-1cd9b266-7155-4376-b463-56e8e5f676f8 service nova] Creating event network-vif-plugged:69daaac0-4496-4426-b057-3b20189fdfd6 for instance 5fe3e5b5-f742-42be-9665-5dc90d4474c2 on n-h1-master-1 Oct 30 01:54:36.287400 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-dffe7e16-168a-4eb3-a80e-9fed037623d1 req-1cd9b266-7155-4376-b463-56e8e5f676f8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064644 Oct 30 01:54:36.289282 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3236/6469] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:54:36.988664 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d3a7cd83-0c52-4750-bd66-c95776092929 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:54:36.989452 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d3a7cd83-0c52-4750-bd66-c95776092929 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 5fe3e5b5-f742-42be-9665-5dc90d4474c2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:54:37.012325 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d3a7cd83-0c52-4750-bd66-c95776092929 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:37.013025 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d3a7cd83-0c52-4750-bd66-c95776092929 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:37.014136 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d3a7cd83-0c52-4750-bd66-c95776092929 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:37.015815 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d3a7cd83-0c52-4750-bd66-c95776092929 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:37.016435 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d3a7cd83-0c52-4750-bd66-c95776092929 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:37.017633 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d3a7cd83-0c52-4750-bd66-c95776092929 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:37.240303 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d3a7cd83-0c52-4750-bd66-c95776092929 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:54:37.251708 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d3a7cd83-0c52-4750-bd66-c95776092929 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2" status: 200 len: 1392 microversion: 2.1 time: 0.289837 Oct 30 01:54:37.259434 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3234/6470] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:54:36 2022] GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2 => generated 1392 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:54:38.276712 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cc9393cf-ce35-42cf-a8d3-efdf4ad49512 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:54:38.277447 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cc9393cf-ce35-42cf-a8d3-efdf4ad49512 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 5fe3e5b5-f742-42be-9665-5dc90d4474c2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:54:38.299182 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cc9393cf-ce35-42cf-a8d3-efdf4ad49512 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:38.299901 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cc9393cf-ce35-42cf-a8d3-efdf4ad49512 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:38.300946 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cc9393cf-ce35-42cf-a8d3-efdf4ad49512 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:38.302196 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cc9393cf-ce35-42cf-a8d3-efdf4ad49512 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:38.303079 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cc9393cf-ce35-42cf-a8d3-efdf4ad49512 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:38.304198 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cc9393cf-ce35-42cf-a8d3-efdf4ad49512 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:38.502120 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-cc9393cf-ce35-42cf-a8d3-efdf4ad49512 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:54:38.510581 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cc9393cf-ce35-42cf-a8d3-efdf4ad49512 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2" status: 200 len: 1563 microversion: 2.1 time: 0.239738 Oct 30 01:54:38.511497 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3237/6471] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:54:38 2022] GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2 => generated 1563 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:54:38.535656 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c81a13fa-b317-4935-8799-72f1777a18f9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:54:38.536521 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c81a13fa-b317-4935-8799-72f1777a18f9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 5fe3e5b5-f742-42be-9665-5dc90d4474c2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:54:38.544004 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c81a13fa-b317-4935-8799-72f1777a18f9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:38.544786 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c81a13fa-b317-4935-8799-72f1777a18f9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:38.546499 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c81a13fa-b317-4935-8799-72f1777a18f9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:38.547746 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c81a13fa-b317-4935-8799-72f1777a18f9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:38.548240 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c81a13fa-b317-4935-8799-72f1777a18f9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:38.548827 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c81a13fa-b317-4935-8799-72f1777a18f9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:38.707742 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c81a13fa-b317-4935-8799-72f1777a18f9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:54:38.715652 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c81a13fa-b317-4935-8799-72f1777a18f9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2" status: 200 len: 1563 microversion: 2.1 time: 0.184541 Oct 30 01:54:38.716227 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3235/6472] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:54:38 2022] GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2 => generated 1563 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:54:39.157564 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-42dea465-9c33-4919-a69f-590a731abfbe tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:54:39.160887 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-42dea465-9c33-4919-a69f-590a731abfbe tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: 267bfb8f-ffd4-4505-a95b-5ae2efa3ae83] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:54:39.177712 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-42dea465-9c33-4919-a69f-590a731abfbe tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:39.178486 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-42dea465-9c33-4919-a69f-590a731abfbe tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:39.179018 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-42dea465-9c33-4919-a69f-590a731abfbe tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:39.179860 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-42dea465-9c33-4919-a69f-590a731abfbe tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:39.180423 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-42dea465-9c33-4919-a69f-590a731abfbe tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:39.180927 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-42dea465-9c33-4919-a69f-590a731abfbe tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:39.305933 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-42dea465-9c33-4919-a69f-590a731abfbe tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "POST /compute/v2.1/servers/267bfb8f-ffd4-4505-a95b-5ae2efa3ae83/action" status: 200 len: 32646 microversion: 2.1 time: 0.154693 Oct 30 01:54:39.308420 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3238/6473] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:54:39 2022] POST /compute/v2.1/servers/267bfb8f-ffd4-4505-a95b-5ae2efa3ae83/action => generated 32646 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:54:41.128199 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-79e27b84-1f75-4b07-8b2d-93d08b37b5a5 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:54:41.128709 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-79e27b84-1f75-4b07-8b2d-93d08b37b5a5 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: 267bfb8f-ffd4-4505-a95b-5ae2efa3ae83] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:54:41.132979 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-be8824f5-6696-4f2c-8fa4-bc5acd62e0fe req-dd2f7329-0b52-4dd1-b0c0-d22e5f6aa166 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "267bfb8f-ffd4-4505-a95b-5ae2efa3ae83", "tag": "1ad474a3-bbdd-4804-96fc-c9fb211b3c57"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:54:41.142233 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-79e27b84-1f75-4b07-8b2d-93d08b37b5a5 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:41.142984 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-79e27b84-1f75-4b07-8b2d-93d08b37b5a5 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:41.145603 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-79e27b84-1f75-4b07-8b2d-93d08b37b5a5 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:41.145603 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-79e27b84-1f75-4b07-8b2d-93d08b37b5a5 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:41.147229 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-79e27b84-1f75-4b07-8b2d-93d08b37b5a5 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:41.151338 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-79e27b84-1f75-4b07-8b2d-93d08b37b5a5 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:41.153057 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-be8824f5-6696-4f2c-8fa4-bc5acd62e0fe req-dd2f7329-0b52-4dd1-b0c0-d22e5f6aa166 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:41.155667 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-be8824f5-6696-4f2c-8fa4-bc5acd62e0fe req-dd2f7329-0b52-4dd1-b0c0-d22e5f6aa166 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:41.157082 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-be8824f5-6696-4f2c-8fa4-bc5acd62e0fe req-dd2f7329-0b52-4dd1-b0c0-d22e5f6aa166 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:41.182970 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-be8824f5-6696-4f2c-8fa4-bc5acd62e0fe req-dd2f7329-0b52-4dd1-b0c0-d22e5f6aa166 service nova] Creating event network-changed:1ad474a3-bbdd-4804-96fc-c9fb211b3c57 for instance 267bfb8f-ffd4-4505-a95b-5ae2efa3ae83 on n-h2-master-1 Oct 30 01:54:41.189502 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-be8824f5-6696-4f2c-8fa4-bc5acd62e0fe req-dd2f7329-0b52-4dd1-b0c0-d22e5f6aa166 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060388 Oct 30 01:54:41.190697 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3239/6474] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:54:41.203505 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-79e27b84-1f75-4b07-8b2d-93d08b37b5a5 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: 267bfb8f-ffd4-4505-a95b-5ae2efa3ae83] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:54:41.532630 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-79e27b84-1f75-4b07-8b2d-93d08b37b5a5 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "DELETE /compute/v2.1/servers/267bfb8f-ffd4-4505-a95b-5ae2efa3ae83" status: 204 len: 0 microversion: 2.1 time: 0.408298 Oct 30 01:54:41.535036 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3236/6475] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:54:41 2022] DELETE /compute/v2.1/servers/267bfb8f-ffd4-4505-a95b-5ae2efa3ae83 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:54:41.545523 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2c0e8c97-d440-4fd1-9880-97f08edc9aec tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:54:41.548726 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2c0e8c97-d440-4fd1-9880-97f08edc9aec tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: 267bfb8f-ffd4-4505-a95b-5ae2efa3ae83] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:54:41.554739 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2c0e8c97-d440-4fd1-9880-97f08edc9aec tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:41.563217 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2c0e8c97-d440-4fd1-9880-97f08edc9aec tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:41.564483 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2c0e8c97-d440-4fd1-9880-97f08edc9aec tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:41.565410 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2c0e8c97-d440-4fd1-9880-97f08edc9aec tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:41.566041 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2c0e8c97-d440-4fd1-9880-97f08edc9aec tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:41.566624 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2c0e8c97-d440-4fd1-9880-97f08edc9aec tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:42.081380 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2c0e8c97-d440-4fd1-9880-97f08edc9aec tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a9a7ae4f5a42d7ac76baf67fdb7a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735c13f1d49640319694d0a6a3a16519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:54:42.096373 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2c0e8c97-d440-4fd1-9880-97f08edc9aec tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "GET /compute/v2.1/servers/267bfb8f-ffd4-4505-a95b-5ae2efa3ae83" status: 200 len: 1669 microversion: 2.1 time: 0.556457 Oct 30 01:54:42.100688 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3240/6476] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:54:41 2022] GET /compute/v2.1/servers/267bfb8f-ffd4-4505-a95b-5ae2efa3ae83 => generated 1669 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:54:42.816569 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-b285a3cd-3acc-4bbf-a180-c7b138286ff6 req-6d679c03-cfaa-405f-87d8-3a9ab196693c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fe3e5b5-f742-42be-9665-5dc90d4474c2", "tag": "69daaac0-4496-4426-b057-3b20189fdfd6"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:54:42.821622 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1727a686-e300-4d7f-b2cb-10319d750816 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:54:42.824964 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1727a686-e300-4d7f-b2cb-10319d750816 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 5fe3e5b5-f742-42be-9665-5dc90d4474c2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:54:42.870388 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1727a686-e300-4d7f-b2cb-10319d750816 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:42.873173 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1727a686-e300-4d7f-b2cb-10319d750816 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:42.874748 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1727a686-e300-4d7f-b2cb-10319d750816 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:42.876663 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1727a686-e300-4d7f-b2cb-10319d750816 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:42.877762 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1727a686-e300-4d7f-b2cb-10319d750816 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:42.878292 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1727a686-e300-4d7f-b2cb-10319d750816 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:42.897028 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-b285a3cd-3acc-4bbf-a180-c7b138286ff6 req-6d679c03-cfaa-405f-87d8-3a9ab196693c service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:42.901142 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-b285a3cd-3acc-4bbf-a180-c7b138286ff6 req-6d679c03-cfaa-405f-87d8-3a9ab196693c service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:42.902171 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-b285a3cd-3acc-4bbf-a180-c7b138286ff6 req-6d679c03-cfaa-405f-87d8-3a9ab196693c service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:42.921049 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-b285a3cd-3acc-4bbf-a180-c7b138286ff6 req-6d679c03-cfaa-405f-87d8-3a9ab196693c service nova] Creating event network-changed:69daaac0-4496-4426-b057-3b20189fdfd6 for instance 5fe3e5b5-f742-42be-9665-5dc90d4474c2 on n-h1-master-1 Oct 30 01:54:42.942173 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-b285a3cd-3acc-4bbf-a180-c7b138286ff6 req-6d679c03-cfaa-405f-87d8-3a9ab196693c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129545 Oct 30 01:54:42.946515 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3241/6477] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:54:43.137931 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5c3360d3-3c77-491b-88a8-3e98dbadb25f tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:54:43.138649 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5c3360d3-3c77-491b-88a8-3e98dbadb25f tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: 267bfb8f-ffd4-4505-a95b-5ae2efa3ae83] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:54:43.147267 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c3360d3-3c77-491b-88a8-3e98dbadb25f tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:43.147760 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c3360d3-3c77-491b-88a8-3e98dbadb25f tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:43.148195 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c3360d3-3c77-491b-88a8-3e98dbadb25f tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:43.148906 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c3360d3-3c77-491b-88a8-3e98dbadb25f tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:43.150910 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c3360d3-3c77-491b-88a8-3e98dbadb25f tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:43.158450 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c3360d3-3c77-491b-88a8-3e98dbadb25f tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:43.634494 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1727a686-e300-4d7f-b2cb-10319d750816 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:54:43.644059 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1727a686-e300-4d7f-b2cb-10319d750816 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2" status: 200 len: 1563 microversion: 2.1 time: 0.846726 Oct 30 01:54:43.650385 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3237/6478] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:54:42 2022] GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2 => generated 1563 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:54:43.904551 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5c3360d3-3c77-491b-88a8-3e98dbadb25f tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a9a7ae4f5a42d7ac76baf67fdb7a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735c13f1d49640319694d0a6a3a16519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:54:43.917905 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5c3360d3-3c77-491b-88a8-3e98dbadb25f tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "GET /compute/v2.1/servers/267bfb8f-ffd4-4505-a95b-5ae2efa3ae83" status: 200 len: 1669 microversion: 2.1 time: 0.787603 Oct 30 01:54:43.918561 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3242/6479] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:54:43 2022] GET /compute/v2.1/servers/267bfb8f-ffd4-4505-a95b-5ae2efa3ae83 => generated 1669 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:54:43.925095 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-38a1cf0e-fb26-4df6-8c59-631cc0bd3798 req-aed0c006-bc37-431a-8dbc-518b10d56886 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "267bfb8f-ffd4-4505-a95b-5ae2efa3ae83", "name": "network-vif-deleted", "tag": "1ad474a3-bbdd-4804-96fc-c9fb211b3c57"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:54:43.952902 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-38a1cf0e-fb26-4df6-8c59-631cc0bd3798 req-aed0c006-bc37-431a-8dbc-518b10d56886 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:43.953489 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-38a1cf0e-fb26-4df6-8c59-631cc0bd3798 req-aed0c006-bc37-431a-8dbc-518b10d56886 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:43.953923 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-38a1cf0e-fb26-4df6-8c59-631cc0bd3798 req-aed0c006-bc37-431a-8dbc-518b10d56886 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:43.971877 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-38a1cf0e-fb26-4df6-8c59-631cc0bd3798 req-aed0c006-bc37-431a-8dbc-518b10d56886 service nova] Creating event network-vif-deleted:1ad474a3-bbdd-4804-96fc-c9fb211b3c57 for instance 267bfb8f-ffd4-4505-a95b-5ae2efa3ae83 on n-h2-master-1 Oct 30 01:54:43.978729 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-38a1cf0e-fb26-4df6-8c59-631cc0bd3798 req-aed0c006-bc37-431a-8dbc-518b10d56886 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057747 Oct 30 01:54:43.979336 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3238/6480] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:54:44.943560 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-19545530-c2c2-480e-96e0-62e783c6f3f8 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:54:44.944812 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-19545530-c2c2-480e-96e0-62e783c6f3f8 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: 267bfb8f-ffd4-4505-a95b-5ae2efa3ae83] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:54:44.960315 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-19545530-c2c2-480e-96e0-62e783c6f3f8 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:44.961727 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-19545530-c2c2-480e-96e0-62e783c6f3f8 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:44.962352 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-19545530-c2c2-480e-96e0-62e783c6f3f8 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:44.965866 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-19545530-c2c2-480e-96e0-62e783c6f3f8 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:44.966835 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-19545530-c2c2-480e-96e0-62e783c6f3f8 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:44.967453 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-19545530-c2c2-480e-96e0-62e783c6f3f8 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:45.039142 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-19545530-c2c2-480e-96e0-62e783c6f3f8 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:45.040068 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-19545530-c2c2-480e-96e0-62e783c6f3f8 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:45.040958 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-19545530-c2c2-480e-96e0-62e783c6f3f8 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:45.041784 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-19545530-c2c2-480e-96e0-62e783c6f3f8 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lazy-loading 'fault' on Instance uuid 267bfb8f-ffd4-4505-a95b-5ae2efa3ae83 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:54:45.101861 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-19545530-c2c2-480e-96e0-62e783c6f3f8 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a9a7ae4f5a42d7ac76baf67fdb7a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735c13f1d49640319694d0a6a3a16519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:54:45.112879 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-19545530-c2c2-480e-96e0-62e783c6f3f8 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "GET /compute/v2.1/servers/267bfb8f-ffd4-4505-a95b-5ae2efa3ae83" status: 200 len: 1487 microversion: 2.1 time: 0.174346 Oct 30 01:54:45.113758 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3243/6481] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:54:44 2022] GET /compute/v2.1/servers/267bfb8f-ffd4-4505-a95b-5ae2efa3ae83 => generated 1487 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:54:46.141201 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-98463fc5-1d52-4a9a-96c5-0891dacdb361 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:54:46.147245 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-98463fc5-1d52-4a9a-96c5-0891dacdb361 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] [instance: 267bfb8f-ffd4-4505-a95b-5ae2efa3ae83] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:54:46.166424 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-98463fc5-1d52-4a9a-96c5-0891dacdb361 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:46.167273 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-98463fc5-1d52-4a9a-96c5-0891dacdb361 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:46.167731 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-98463fc5-1d52-4a9a-96c5-0891dacdb361 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:46.168488 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-98463fc5-1d52-4a9a-96c5-0891dacdb361 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:54:46.168950 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-98463fc5-1d52-4a9a-96c5-0891dacdb361 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:54:46.169402 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-98463fc5-1d52-4a9a-96c5-0891dacdb361 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-98463fc5-1d52-4a9a-96c5-0891dacdb361 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] HTTP exception thrown: Instance 267bfb8f-ffd4-4505-a95b-5ae2efa3ae83 could not be found. Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-98463fc5-1d52-4a9a-96c5-0891dacdb361 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Request method failure captured: Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/267bfb8f-ffd4-4505-a95b-5ae2efa3ae83 HTTP/1.1 Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdiO_kkGyv2VSSiTYM6ZxYZHR-AHHcKTmir1ZDK6wlz8YIuQadqoSJ1K139qnr9GiD559wqynvYW1VdNoyBW7gzAU_MUfFPYKN_xkSoHrA3wXAWbxThrQL-0__zAswVZrJLPI7cuVVc-JkAphuzKHw6jWtoAW_yfAWE3WBoR_Z-5Xf0 Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 735c13f1d49640319694d0a6a3a16519 Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-TestNetworkBasicOps-1200307483 Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/735c13f1d49640319694d0a6a3a16519"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_735c13f1d49640319694d0a6a3a16519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/735c13f1d49640319694d0a6a3a16519"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/735c13f1d49640319694d0a6a3a16519"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-TestNetworkBasicOps-1200307483 Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 735c13f1d49640319694d0a6a3a16519 Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-TestNetworkBasicOps-1200307483 Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-TestNetworkBasicOps-1200307483-project Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 33a9a7ae4f5a42d7ac76baf67fdb7a2d Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-TestNetworkBasicOps-1200307483-project Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 267bfb8f-ffd4-4505-a95b-5ae2efa3ae83 could not be found. Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '267bfb8f-ffd4-4505-a95b-5ae2efa3ae83'} Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 267bfb8f-ffd4-4505-a95b-5ae2efa3ae83 could not be found. Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:54:46.196966 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:54:46.201579 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 267bfb8f-ffd4-4505-a95b-5ae2efa3ae83 could not be found. Oct 30 01:54:46.201579 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:54:46.201579 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:54:46.201579 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:54:46.201579 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:54:46.201579 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:54:46.201579 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:54:46.201579 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:54:46.201579 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:54:46.201579 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 267bfb8f-ffd4-4505-a95b-5ae2efa3ae83 could not be found. Oct 30 01:54:46.201579 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:54:46.201579 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-98463fc5-1d52-4a9a-96c5-0891dacdb361 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Returning 404 to user: Instance 267bfb8f-ffd4-4505-a95b-5ae2efa3ae83 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:54:46.201579 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-98463fc5-1d52-4a9a-96c5-0891dacdb361 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "GET /compute/v2.1/servers/267bfb8f-ffd4-4505-a95b-5ae2efa3ae83" status: 404 len: 111 microversion: 2.1 time: 0.061267 Oct 30 01:54:46.201579 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3239/6482] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:54:46 2022] GET /compute/v2.1/servers/267bfb8f-ffd4-4505-a95b-5ae2efa3ae83 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:54:46.500593 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9ff5aa85-e8ef-44af-8e2e-63f4e6bb5543 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] Calling method '.version_select at 0x7f44c6ea4d30>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:54:46.649158 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9ff5aa85-e8ef-44af-8e2e-63f4e6bb5543 tempest-TestNetworkBasicOps-1200307483 tempest-TestNetworkBasicOps-1200307483-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-869178345" status: 202 len: 0 microversion: 2.1 time: 0.153958 Oct 30 01:54:46.649968 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3244/6483] 10.222.0.13 () {58 vars in 1254 bytes} [Sun Oct 30 01:54:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-869178345 => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:55:02.104092 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2bd83241-c948-4192-a590-13fe01d9b275 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:55:02.107055 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2bd83241-c948-4192-a590-13fe01d9b275 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 5fe3e5b5-f742-42be-9665-5dc90d4474c2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:55:02.116684 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:55:02.117416 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:55:02.119303 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2bd83241-c948-4192-a590-13fe01d9b275 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:02.119798 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2bd83241-c948-4192-a590-13fe01d9b275 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:02.120234 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2bd83241-c948-4192-a590-13fe01d9b275 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:02.121012 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2bd83241-c948-4192-a590-13fe01d9b275 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:02.125544 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2bd83241-c948-4192-a590-13fe01d9b275 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:02.126005 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2bd83241-c948-4192-a590-13fe01d9b275 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:02.208989 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2bd83241-c948-4192-a590-13fe01d9b275 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "POST /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2/action" status: 200 len: 24563 microversion: 2.1 time: 0.109234 Oct 30 01:55:02.215332 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3240/6484] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:55:02 2022] POST /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2/action => generated 24563 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:55:13.186412 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b2c6b588-6445-4ed8-bda2-5c614a34006a tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:55:13.187507 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b2c6b588-6445-4ed8-bda2-5c614a34006a tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] [instance: 5fe3e5b5-f742-42be-9665-5dc90d4474c2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:55:13.193618 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=68 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:55:13.194578 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:55:13.198606 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2c6b588-6445-4ed8-bda2-5c614a34006a tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:13.199153 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2c6b588-6445-4ed8-bda2-5c614a34006a tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:13.199609 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2c6b588-6445-4ed8-bda2-5c614a34006a tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:13.200516 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2c6b588-6445-4ed8-bda2-5c614a34006a tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:13.201215 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2c6b588-6445-4ed8-bda2-5c614a34006a tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:13.201598 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2c6b588-6445-4ed8-bda2-5c614a34006a tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:13.380348 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b2c6b588-6445-4ed8-bda2-5c614a34006a tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2" status: 200 len: 1832 microversion: 2.1 time: 0.198002 Oct 30 01:55:13.382027 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3245/6485] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:55:13 2022] GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2 => generated 1832 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:55:13.405802 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fe27dce9-7f04-4626-b6b5-a843af5832b5 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:55:13.406491 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-fe27dce9-7f04-4626-b6b5-a843af5832b5 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 5fe3e5b5-f742-42be-9665-5dc90d4474c2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:55:13.415084 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe27dce9-7f04-4626-b6b5-a843af5832b5 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:13.415578 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe27dce9-7f04-4626-b6b5-a843af5832b5 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:13.416014 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe27dce9-7f04-4626-b6b5-a843af5832b5 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:13.416709 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe27dce9-7f04-4626-b6b5-a843af5832b5 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:13.417164 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe27dce9-7f04-4626-b6b5-a843af5832b5 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:13.417639 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe27dce9-7f04-4626-b6b5-a843af5832b5 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:13.568998 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-fe27dce9-7f04-4626-b6b5-a843af5832b5 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:55:13.577246 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fe27dce9-7f04-4626-b6b5-a843af5832b5 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2" status: 200 len: 1681 microversion: 2.1 time: 0.175735 Oct 30 01:55:13.577847 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3241/6486] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:55:13 2022] GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2 => generated 1681 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:55:13.718084 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6b7c472e-4efb-48f5-8143-45274fd84edb tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:55:13.720515 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6b7c472e-4efb-48f5-8143-45274fd84edb tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 5fe3e5b5-f742-42be-9665-5dc90d4474c2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:55:13.727918 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b7c472e-4efb-48f5-8143-45274fd84edb tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:13.728555 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b7c472e-4efb-48f5-8143-45274fd84edb tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:13.729003 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b7c472e-4efb-48f5-8143-45274fd84edb tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:13.729826 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b7c472e-4efb-48f5-8143-45274fd84edb tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:13.730301 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b7c472e-4efb-48f5-8143-45274fd84edb tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:13.730731 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b7c472e-4efb-48f5-8143-45274fd84edb tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:13.802873 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6b7c472e-4efb-48f5-8143-45274fd84edb tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "POST /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2/action" status: 200 len: 32635 microversion: 2.1 time: 0.088965 Oct 30 01:55:13.803555 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3246/6487] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:55:13 2022] POST /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2/action => generated 32635 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 30 01:55:13.977504 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3f90ee0b-1983-46b5-b3f5-6d53e527cabf tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:55:13.978483 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3f90ee0b-1983-46b5-b3f5-6d53e527cabf tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] [instance: 5fe3e5b5-f742-42be-9665-5dc90d4474c2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:55:13.985841 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f90ee0b-1983-46b5-b3f5-6d53e527cabf tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:13.986330 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f90ee0b-1983-46b5-b3f5-6d53e527cabf tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:13.986810 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f90ee0b-1983-46b5-b3f5-6d53e527cabf tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:13.987495 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f90ee0b-1983-46b5-b3f5-6d53e527cabf tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:13.987944 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f90ee0b-1983-46b5-b3f5-6d53e527cabf tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:13.988417 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f90ee0b-1983-46b5-b3f5-6d53e527cabf tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:14.019092 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3f90ee0b-1983-46b5-b3f5-6d53e527cabf tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '1c171756ca034defa78c77d149f59d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5645b1258faf4b1483556cea1d3197c3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:55:14.019683 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3f90ee0b-1983-46b5-b3f5-6d53e527cabf tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] [instance: 5fe3e5b5-f742-42be-9665-5dc90d4474c2] flavor_id is None. Assuming migration. {{(pid=121103) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 30 01:55:14.020119 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3f90ee0b-1983-46b5-b3f5-6d53e527cabf tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] [instance: 5fe3e5b5-f742-42be-9665-5dc90d4474c2] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=121103) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 30 01:55:14.482100 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3f90ee0b-1983-46b5-b3f5-6d53e527cabf tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2/action" status: 202 len: 0 microversion: 2.1 time: 0.508498 Oct 30 01:55:14.483033 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3242/6488] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:55:13 2022] POST /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2/action => generated 0 bytes in 510 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:55:14.492204 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c7f2bddd-2cbe-40b9-9373-55a4702ab3d3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:55:14.493170 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c7f2bddd-2cbe-40b9-9373-55a4702ab3d3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 5fe3e5b5-f742-42be-9665-5dc90d4474c2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:55:14.502950 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c7f2bddd-2cbe-40b9-9373-55a4702ab3d3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:14.508927 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c7f2bddd-2cbe-40b9-9373-55a4702ab3d3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:14.508927 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c7f2bddd-2cbe-40b9-9373-55a4702ab3d3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:14.508927 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c7f2bddd-2cbe-40b9-9373-55a4702ab3d3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:14.508927 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c7f2bddd-2cbe-40b9-9373-55a4702ab3d3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:14.508927 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c7f2bddd-2cbe-40b9-9373-55a4702ab3d3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:14.653013 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c7f2bddd-2cbe-40b9-9373-55a4702ab3d3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:55:14.661517 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c7f2bddd-2cbe-40b9-9373-55a4702ab3d3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2" status: 200 len: 1690 microversion: 2.1 time: 0.173615 Oct 30 01:55:14.662081 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3247/6489] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:55:14 2022] GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2 => generated 1690 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:55:15.691110 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ecb94983-7ae3-48d1-a597-a1e72eccb7f9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:55:15.691745 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ecb94983-7ae3-48d1-a597-a1e72eccb7f9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 5fe3e5b5-f742-42be-9665-5dc90d4474c2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:55:15.702906 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ecb94983-7ae3-48d1-a597-a1e72eccb7f9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:15.703406 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ecb94983-7ae3-48d1-a597-a1e72eccb7f9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:15.703851 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ecb94983-7ae3-48d1-a597-a1e72eccb7f9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:15.705087 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ecb94983-7ae3-48d1-a597-a1e72eccb7f9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:15.715937 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ecb94983-7ae3-48d1-a597-a1e72eccb7f9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:15.716742 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ecb94983-7ae3-48d1-a597-a1e72eccb7f9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:15.890933 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ecb94983-7ae3-48d1-a597-a1e72eccb7f9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:55:15.899297 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ecb94983-7ae3-48d1-a597-a1e72eccb7f9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2" status: 200 len: 1690 microversion: 2.1 time: 0.218863 Oct 30 01:55:15.899974 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3243/6490] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:55:15 2022] GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2 => generated 1690 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:55:16.922911 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-54fec42f-3f88-45fd-a69c-c4c80faec875 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:55:16.923660 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-54fec42f-3f88-45fd-a69c-c4c80faec875 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 5fe3e5b5-f742-42be-9665-5dc90d4474c2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:55:16.931350 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-54fec42f-3f88-45fd-a69c-c4c80faec875 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:16.931835 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-54fec42f-3f88-45fd-a69c-c4c80faec875 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:16.932271 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-54fec42f-3f88-45fd-a69c-c4c80faec875 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:16.932971 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-54fec42f-3f88-45fd-a69c-c4c80faec875 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:16.933443 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-54fec42f-3f88-45fd-a69c-c4c80faec875 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:16.933867 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-54fec42f-3f88-45fd-a69c-c4c80faec875 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:17.071639 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-54fec42f-3f88-45fd-a69c-c4c80faec875 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:55:17.079890 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-54fec42f-3f88-45fd-a69c-c4c80faec875 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2" status: 200 len: 1690 microversion: 2.1 time: 0.160462 Oct 30 01:55:17.080459 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3248/6491] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:55:16 2022] GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2 => generated 1690 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:55:18.105471 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c54c7514-0e57-480f-a1ef-a37ff5d7858f tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:55:18.109580 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c54c7514-0e57-480f-a1ef-a37ff5d7858f tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 5fe3e5b5-f742-42be-9665-5dc90d4474c2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:55:18.114775 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c54c7514-0e57-480f-a1ef-a37ff5d7858f tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:18.115425 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c54c7514-0e57-480f-a1ef-a37ff5d7858f tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:18.115969 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c54c7514-0e57-480f-a1ef-a37ff5d7858f tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:18.116711 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c54c7514-0e57-480f-a1ef-a37ff5d7858f tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:18.117163 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c54c7514-0e57-480f-a1ef-a37ff5d7858f tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:18.117614 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c54c7514-0e57-480f-a1ef-a37ff5d7858f tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:18.264059 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c54c7514-0e57-480f-a1ef-a37ff5d7858f tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:55:18.272009 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c54c7514-0e57-480f-a1ef-a37ff5d7858f tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2" status: 200 len: 1690 microversion: 2.1 time: 0.171689 Oct 30 01:55:18.272585 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3244/6492] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:55:18 2022] GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2 => generated 1690 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:55:19.303265 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4b809bb2-8b90-4229-892c-8b2267a82b94 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:55:19.304620 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4b809bb2-8b90-4229-892c-8b2267a82b94 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 5fe3e5b5-f742-42be-9665-5dc90d4474c2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:55:19.313224 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b809bb2-8b90-4229-892c-8b2267a82b94 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:19.314689 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b809bb2-8b90-4229-892c-8b2267a82b94 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:19.315341 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b809bb2-8b90-4229-892c-8b2267a82b94 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:19.316224 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b809bb2-8b90-4229-892c-8b2267a82b94 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:19.316855 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b809bb2-8b90-4229-892c-8b2267a82b94 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:19.317474 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b809bb2-8b90-4229-892c-8b2267a82b94 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:19.470631 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4b809bb2-8b90-4229-892c-8b2267a82b94 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:55:19.478981 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4b809bb2-8b90-4229-892c-8b2267a82b94 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2" status: 200 len: 1695 microversion: 2.1 time: 0.186579 Oct 30 01:55:19.479761 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3249/6493] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:55:19 2022] GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2 => generated 1695 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:55:20.503666 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c674a952-ef67-4e79-880a-d7661b4a8b75 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:55:20.504242 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c674a952-ef67-4e79-880a-d7661b4a8b75 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 5fe3e5b5-f742-42be-9665-5dc90d4474c2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:55:20.511495 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c674a952-ef67-4e79-880a-d7661b4a8b75 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:20.511992 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c674a952-ef67-4e79-880a-d7661b4a8b75 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:20.512430 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c674a952-ef67-4e79-880a-d7661b4a8b75 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:20.513142 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c674a952-ef67-4e79-880a-d7661b4a8b75 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:20.513632 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c674a952-ef67-4e79-880a-d7661b4a8b75 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:20.514060 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c674a952-ef67-4e79-880a-d7661b4a8b75 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:20.652071 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c674a952-ef67-4e79-880a-d7661b4a8b75 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:55:20.660101 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c674a952-ef67-4e79-880a-d7661b4a8b75 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2" status: 200 len: 1695 microversion: 2.1 time: 0.161038 Oct 30 01:55:20.660682 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3245/6494] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:55:20 2022] GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2 => generated 1695 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:55:20.930090 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d5e8a7a5-2ebc-4243-84a2-f1695e08477a tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1549957004", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:55:20.987043 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-d5e8a7a5-2ebc-4243-84a2-f1695e08477a tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] validate_networks() for None {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:55:21.258993 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-d5e8a7a5-2ebc-4243-84a2-f1695e08477a tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:55:21.259418 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-d5e8a7a5-2ebc-4243-84a2-f1695e08477a tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:55:21.259893 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-d5e8a7a5-2ebc-4243-84a2-f1695e08477a tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:55:21.260304 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-d5e8a7a5-2ebc-4243-84a2-f1695e08477a tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:55:21.260744 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-d5e8a7a5-2ebc-4243-84a2-f1695e08477a tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:55:21.270280 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5e8a7a5-2ebc-4243-84a2-f1695e08477a tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:21.270761 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5e8a7a5-2ebc-4243-84a2-f1695e08477a tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:21.271199 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5e8a7a5-2ebc-4243-84a2-f1695e08477a tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:21.271922 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5e8a7a5-2ebc-4243-84a2-f1695e08477a tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:21.272378 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5e8a7a5-2ebc-4243-84a2-f1695e08477a tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:21.272854 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5e8a7a5-2ebc-4243-84a2-f1695e08477a tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:21.290232 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-d5e8a7a5-2ebc-4243-84a2-f1695e08477a tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Getting quotas for project 384d691c08fa4a48b57896d89f252526. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:55:21.295917 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-d5e8a7a5-2ebc-4243-84a2-f1695e08477a tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Getting quotas for user 7348b82c87cf428dad89bc4fbb6ac1c4 and project 384d691c08fa4a48b57896d89f252526. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:55:21.310921 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d5e8a7a5-2ebc-4243-84a2-f1695e08477a tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:55:21.313323 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d5e8a7a5-2ebc-4243-84a2-f1695e08477a tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] [instance: 58aeb565-c0d0-49b0-854b-22766f508507] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:55:21.453776 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d5e8a7a5-2ebc-4243-84a2-f1695e08477a tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.527431 Oct 30 01:55:21.455116 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3250/6495] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:55:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:55:21.466286 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-84664035-2a63-4f37-9f82-0211c31ad111 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:55:21.467510 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-84664035-2a63-4f37-9f82-0211c31ad111 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] [instance: 58aeb565-c0d0-49b0-854b-22766f508507] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:55:21.524081 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-84664035-2a63-4f37-9f82-0211c31ad111 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7348b82c87cf428dad89bc4fbb6ac1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '384d691c08fa4a48b57896d89f252526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:55:21.532159 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-84664035-2a63-4f37-9f82-0211c31ad111 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] 10.222.0.13 "GET /compute/v2.1/servers/58aeb565-c0d0-49b0-854b-22766f508507" status: 200 len: 1214 microversion: 2.1 time: 0.069795 Oct 30 01:55:21.533533 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3246/6496] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:55:21 2022] GET /compute/v2.1/servers/58aeb565-c0d0-49b0-854b-22766f508507 => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:55:21.683841 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d8081abf-0668-4053-931f-5b76e0eb7770 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:55:21.684691 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d8081abf-0668-4053-931f-5b76e0eb7770 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 5fe3e5b5-f742-42be-9665-5dc90d4474c2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:55:21.691631 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8081abf-0668-4053-931f-5b76e0eb7770 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:21.692216 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8081abf-0668-4053-931f-5b76e0eb7770 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:21.692660 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8081abf-0668-4053-931f-5b76e0eb7770 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:21.693411 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8081abf-0668-4053-931f-5b76e0eb7770 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:21.693893 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8081abf-0668-4053-931f-5b76e0eb7770 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:21.694329 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8081abf-0668-4053-931f-5b76e0eb7770 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:21.834438 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d8081abf-0668-4053-931f-5b76e0eb7770 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:55:21.842977 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d8081abf-0668-4053-931f-5b76e0eb7770 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2" status: 200 len: 1695 microversion: 2.1 time: 0.163801 Oct 30 01:55:21.845584 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3251/6497] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:55:21 2022] GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2 => generated 1695 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:55:22.556687 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5dd5e372-10a3-4e52-91ed-09af2669ec44 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:55:22.557296 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5dd5e372-10a3-4e52-91ed-09af2669ec44 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] [instance: 58aeb565-c0d0-49b0-854b-22766f508507] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:55:22.613197 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5dd5e372-10a3-4e52-91ed-09af2669ec44 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7348b82c87cf428dad89bc4fbb6ac1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '384d691c08fa4a48b57896d89f252526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:55:22.620293 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5dd5e372-10a3-4e52-91ed-09af2669ec44 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] 10.222.0.13 "GET /compute/v2.1/servers/58aeb565-c0d0-49b0-854b-22766f508507" status: 200 len: 1214 microversion: 2.1 time: 0.068493 Oct 30 01:55:22.620862 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3247/6498] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:55:22 2022] GET /compute/v2.1/servers/58aeb565-c0d0-49b0-854b-22766f508507 => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:55:22.866726 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0e36b6f9-1a8f-408a-afa9-01715c407357 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:55:22.867379 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0e36b6f9-1a8f-408a-afa9-01715c407357 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 5fe3e5b5-f742-42be-9665-5dc90d4474c2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:55:22.874402 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e36b6f9-1a8f-408a-afa9-01715c407357 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:22.874955 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e36b6f9-1a8f-408a-afa9-01715c407357 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:22.875470 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e36b6f9-1a8f-408a-afa9-01715c407357 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:22.876897 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e36b6f9-1a8f-408a-afa9-01715c407357 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:22.877459 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e36b6f9-1a8f-408a-afa9-01715c407357 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:22.877975 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e36b6f9-1a8f-408a-afa9-01715c407357 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:23.052651 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0e36b6f9-1a8f-408a-afa9-01715c407357 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:55:23.060596 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0e36b6f9-1a8f-408a-afa9-01715c407357 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2" status: 200 len: 1695 microversion: 2.1 time: 0.198011 Oct 30 01:55:23.061178 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3252/6499] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:55:22 2022] GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2 => generated 1695 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:55:23.645949 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-110aa0ef-7346-4fb4-bb4a-7b3a674c6162 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:55:23.646528 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-110aa0ef-7346-4fb4-bb4a-7b3a674c6162 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] [instance: 58aeb565-c0d0-49b0-854b-22766f508507] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:55:23.653835 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-110aa0ef-7346-4fb4-bb4a-7b3a674c6162 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:23.654326 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-110aa0ef-7346-4fb4-bb4a-7b3a674c6162 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:23.655571 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-110aa0ef-7346-4fb4-bb4a-7b3a674c6162 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:23.655571 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-110aa0ef-7346-4fb4-bb4a-7b3a674c6162 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:23.656063 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-110aa0ef-7346-4fb4-bb4a-7b3a674c6162 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:23.656490 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-110aa0ef-7346-4fb4-bb4a-7b3a674c6162 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:23.721562 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-110aa0ef-7346-4fb4-bb4a-7b3a674c6162 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7348b82c87cf428dad89bc4fbb6ac1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '384d691c08fa4a48b57896d89f252526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:55:23.729159 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-110aa0ef-7346-4fb4-bb4a-7b3a674c6162 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] 10.222.0.13 "GET /compute/v2.1/servers/58aeb565-c0d0-49b0-854b-22766f508507" status: 200 len: 1266 microversion: 2.1 time: 0.087796 Oct 30 01:55:23.729762 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3248/6500] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:55:23 2022] GET /compute/v2.1/servers/58aeb565-c0d0-49b0-854b-22766f508507 => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:55:24.085608 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d36519e1-f4cf-49bb-826c-c2f2eb14fe0c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:55:24.086236 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d36519e1-f4cf-49bb-826c-c2f2eb14fe0c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 5fe3e5b5-f742-42be-9665-5dc90d4474c2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:55:24.095156 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d36519e1-f4cf-49bb-826c-c2f2eb14fe0c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:24.095976 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d36519e1-f4cf-49bb-826c-c2f2eb14fe0c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:24.096615 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d36519e1-f4cf-49bb-826c-c2f2eb14fe0c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:24.097365 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d36519e1-f4cf-49bb-826c-c2f2eb14fe0c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:24.097846 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d36519e1-f4cf-49bb-826c-c2f2eb14fe0c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:24.098855 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d36519e1-f4cf-49bb-826c-c2f2eb14fe0c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:24.271361 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d36519e1-f4cf-49bb-826c-c2f2eb14fe0c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:55:24.279913 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d36519e1-f4cf-49bb-826c-c2f2eb14fe0c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2" status: 200 len: 1695 microversion: 2.1 time: 0.198695 Oct 30 01:55:24.280497 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3253/6501] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:55:24 2022] GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2 => generated 1695 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:55:24.753866 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-abaea9a4-522e-4afc-a0a3-db1b05b2a0dc tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:55:24.754966 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-abaea9a4-522e-4afc-a0a3-db1b05b2a0dc tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] [instance: 58aeb565-c0d0-49b0-854b-22766f508507] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:55:24.762178 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-abaea9a4-522e-4afc-a0a3-db1b05b2a0dc tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:24.762538 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-abaea9a4-522e-4afc-a0a3-db1b05b2a0dc tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:24.762971 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-abaea9a4-522e-4afc-a0a3-db1b05b2a0dc tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:24.763673 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-abaea9a4-522e-4afc-a0a3-db1b05b2a0dc tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:24.764122 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-abaea9a4-522e-4afc-a0a3-db1b05b2a0dc tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:24.764541 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-abaea9a4-522e-4afc-a0a3-db1b05b2a0dc tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:24.828257 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-abaea9a4-522e-4afc-a0a3-db1b05b2a0dc tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7348b82c87cf428dad89bc4fbb6ac1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '384d691c08fa4a48b57896d89f252526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:55:24.838424 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-abaea9a4-522e-4afc-a0a3-db1b05b2a0dc tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] 10.222.0.13 "GET /compute/v2.1/servers/58aeb565-c0d0-49b0-854b-22766f508507" status: 200 len: 1272 microversion: 2.1 time: 0.089859 Oct 30 01:55:24.839234 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3249/6502] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:55:24 2022] GET /compute/v2.1/servers/58aeb565-c0d0-49b0-854b-22766f508507 => generated 1272 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:55:25.304620 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c1a30ead-765a-4619-ae43-2720ed0f62fd tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:55:25.305236 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c1a30ead-765a-4619-ae43-2720ed0f62fd tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 5fe3e5b5-f742-42be-9665-5dc90d4474c2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:55:25.312439 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c1a30ead-765a-4619-ae43-2720ed0f62fd tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:25.322766 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c1a30ead-765a-4619-ae43-2720ed0f62fd tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:25.323270 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c1a30ead-765a-4619-ae43-2720ed0f62fd tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:25.324010 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c1a30ead-765a-4619-ae43-2720ed0f62fd tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:25.324479 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c1a30ead-765a-4619-ae43-2720ed0f62fd tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:25.324918 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c1a30ead-765a-4619-ae43-2720ed0f62fd tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:25.544162 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c1a30ead-765a-4619-ae43-2720ed0f62fd tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:55:25.551947 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c1a30ead-765a-4619-ae43-2720ed0f62fd tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2" status: 200 len: 1695 microversion: 2.1 time: 0.251349 Oct 30 01:55:25.552525 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3254/6503] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:55:25 2022] GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2 => generated 1695 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:55:25.863108 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b6c31ad0-ccfb-47c8-b9aa-d5ac2a5585d5 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:55:25.863899 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b6c31ad0-ccfb-47c8-b9aa-d5ac2a5585d5 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] [instance: 58aeb565-c0d0-49b0-854b-22766f508507] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:55:25.871200 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b6c31ad0-ccfb-47c8-b9aa-d5ac2a5585d5 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:25.871793 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b6c31ad0-ccfb-47c8-b9aa-d5ac2a5585d5 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:25.872231 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b6c31ad0-ccfb-47c8-b9aa-d5ac2a5585d5 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:25.872921 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b6c31ad0-ccfb-47c8-b9aa-d5ac2a5585d5 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:25.873417 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b6c31ad0-ccfb-47c8-b9aa-d5ac2a5585d5 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:25.873819 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b6c31ad0-ccfb-47c8-b9aa-d5ac2a5585d5 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:26.050119 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b6c31ad0-ccfb-47c8-b9aa-d5ac2a5585d5 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7348b82c87cf428dad89bc4fbb6ac1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '384d691c08fa4a48b57896d89f252526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:55:26.060139 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b6c31ad0-ccfb-47c8-b9aa-d5ac2a5585d5 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] 10.222.0.13 "GET /compute/v2.1/servers/58aeb565-c0d0-49b0-854b-22766f508507" status: 200 len: 1314 microversion: 2.1 time: 0.200099 Oct 30 01:55:26.060139 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3250/6504] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:55:25 2022] GET /compute/v2.1/servers/58aeb565-c0d0-49b0-854b-22766f508507 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:55:26.279813 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-51f54ada-0fce-46af-8cf0-753542465d69 req-76f74e2a-1f34-4187-8a07-e3dd8a55f986 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58aeb565-c0d0-49b0-854b-22766f508507", "tag": "9f168a7a-39fb-40a3-b4db-dd52a40463e6"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:55:26.290655 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-51f54ada-0fce-46af-8cf0-753542465d69 req-76f74e2a-1f34-4187-8a07-e3dd8a55f986 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:26.291129 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-51f54ada-0fce-46af-8cf0-753542465d69 req-76f74e2a-1f34-4187-8a07-e3dd8a55f986 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:26.292028 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-51f54ada-0fce-46af-8cf0-753542465d69 req-76f74e2a-1f34-4187-8a07-e3dd8a55f986 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:26.304723 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-51f54ada-0fce-46af-8cf0-753542465d69 req-76f74e2a-1f34-4187-8a07-e3dd8a55f986 service nova] Creating event network-changed:9f168a7a-39fb-40a3-b4db-dd52a40463e6 for instance 58aeb565-c0d0-49b0-854b-22766f508507 on n-h2-master-1 Oct 30 01:55:26.310574 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-51f54ada-0fce-46af-8cf0-753542465d69 req-76f74e2a-1f34-4187-8a07-e3dd8a55f986 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.190990 Oct 30 01:55:26.311307 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3255/6505] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:55:26.576078 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6a8b6a6f-a3c7-4b5e-b395-da684139f223 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:55:26.576709 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6a8b6a6f-a3c7-4b5e-b395-da684139f223 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 5fe3e5b5-f742-42be-9665-5dc90d4474c2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:55:26.583369 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a8b6a6f-a3c7-4b5e-b395-da684139f223 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:26.583857 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a8b6a6f-a3c7-4b5e-b395-da684139f223 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:26.584292 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a8b6a6f-a3c7-4b5e-b395-da684139f223 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:26.584981 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a8b6a6f-a3c7-4b5e-b395-da684139f223 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:26.585456 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a8b6a6f-a3c7-4b5e-b395-da684139f223 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:26.585878 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a8b6a6f-a3c7-4b5e-b395-da684139f223 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:27.084242 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e5a5ca5a-cf97-416a-a530-a9f169d5b3bb tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:55:27.084880 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e5a5ca5a-cf97-416a-a530-a9f169d5b3bb tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] [instance: 58aeb565-c0d0-49b0-854b-22766f508507] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:55:27.092579 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e5a5ca5a-cf97-416a-a530-a9f169d5b3bb tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:27.093128 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e5a5ca5a-cf97-416a-a530-a9f169d5b3bb tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:27.093600 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e5a5ca5a-cf97-416a-a530-a9f169d5b3bb tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:27.094298 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e5a5ca5a-cf97-416a-a530-a9f169d5b3bb tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:27.094783 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e5a5ca5a-cf97-416a-a530-a9f169d5b3bb tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:27.095211 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e5a5ca5a-cf97-416a-a530-a9f169d5b3bb tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:27.098423 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6a8b6a6f-a3c7-4b5e-b395-da684139f223 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:55:27.106330 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6a8b6a6f-a3c7-4b5e-b395-da684139f223 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2" status: 200 len: 1695 microversion: 2.1 time: 0.534254 Oct 30 01:55:27.106917 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3251/6506] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:55:26 2022] GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2 => generated 1695 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:55:27.226526 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e5a5ca5a-cf97-416a-a530-a9f169d5b3bb tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7348b82c87cf428dad89bc4fbb6ac1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '384d691c08fa4a48b57896d89f252526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:55:27.234668 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e5a5ca5a-cf97-416a-a530-a9f169d5b3bb tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] 10.222.0.13 "GET /compute/v2.1/servers/58aeb565-c0d0-49b0-854b-22766f508507" status: 200 len: 1314 microversion: 2.1 time: 0.156720 Oct 30 01:55:27.235239 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3256/6507] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:55:27 2022] GET /compute/v2.1/servers/58aeb565-c0d0-49b0-854b-22766f508507 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:55:28.129986 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-92544a58-7257-41ac-9405-9f136d5fc3fc tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:55:28.131282 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-92544a58-7257-41ac-9405-9f136d5fc3fc tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 5fe3e5b5-f742-42be-9665-5dc90d4474c2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:55:28.138329 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-92544a58-7257-41ac-9405-9f136d5fc3fc tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:28.138817 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-92544a58-7257-41ac-9405-9f136d5fc3fc tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:28.139259 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-92544a58-7257-41ac-9405-9f136d5fc3fc tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:28.139959 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-92544a58-7257-41ac-9405-9f136d5fc3fc tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:28.140625 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-92544a58-7257-41ac-9405-9f136d5fc3fc tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:28.141108 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-92544a58-7257-41ac-9405-9f136d5fc3fc tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:28.258913 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-35a45531-de84-4bd3-a54a-56ac5a34d0a7 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:55:28.263854 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-35a45531-de84-4bd3-a54a-56ac5a34d0a7 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] [instance: 58aeb565-c0d0-49b0-854b-22766f508507] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:55:28.268159 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-35a45531-de84-4bd3-a54a-56ac5a34d0a7 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:28.269277 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-35a45531-de84-4bd3-a54a-56ac5a34d0a7 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:28.269909 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-35a45531-de84-4bd3-a54a-56ac5a34d0a7 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:28.270820 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-35a45531-de84-4bd3-a54a-56ac5a34d0a7 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:28.271464 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-35a45531-de84-4bd3-a54a-56ac5a34d0a7 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:28.272120 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-35a45531-de84-4bd3-a54a-56ac5a34d0a7 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:28.412487 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-92544a58-7257-41ac-9405-9f136d5fc3fc tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:55:28.421649 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-92544a58-7257-41ac-9405-9f136d5fc3fc tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2" status: 200 len: 1695 microversion: 2.1 time: 0.295530 Oct 30 01:55:28.422338 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3252/6508] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:55:28 2022] GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2 => generated 1695 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:55:28.515112 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-35a45531-de84-4bd3-a54a-56ac5a34d0a7 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7348b82c87cf428dad89bc4fbb6ac1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '384d691c08fa4a48b57896d89f252526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:55:28.523946 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-35a45531-de84-4bd3-a54a-56ac5a34d0a7 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] 10.222.0.13 "GET /compute/v2.1/servers/58aeb565-c0d0-49b0-854b-22766f508507" status: 200 len: 1314 microversion: 2.1 time: 0.269183 Oct 30 01:55:28.524532 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3257/6509] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:55:28 2022] GET /compute/v2.1/servers/58aeb565-c0d0-49b0-854b-22766f508507 => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:55:29.445479 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a986c928-5c04-4240-91f2-adf234edf601 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:55:29.446105 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a986c928-5c04-4240-91f2-adf234edf601 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 5fe3e5b5-f742-42be-9665-5dc90d4474c2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:55:29.452932 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a986c928-5c04-4240-91f2-adf234edf601 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:29.453453 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a986c928-5c04-4240-91f2-adf234edf601 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:29.453891 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a986c928-5c04-4240-91f2-adf234edf601 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:29.455189 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a986c928-5c04-4240-91f2-adf234edf601 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:29.455644 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a986c928-5c04-4240-91f2-adf234edf601 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:29.456081 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a986c928-5c04-4240-91f2-adf234edf601 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:29.546922 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8eac5372-9f7f-4148-98b3-5790d2347296 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:55:29.547664 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8eac5372-9f7f-4148-98b3-5790d2347296 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] [instance: 58aeb565-c0d0-49b0-854b-22766f508507] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:55:29.554534 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8eac5372-9f7f-4148-98b3-5790d2347296 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:29.555093 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8eac5372-9f7f-4148-98b3-5790d2347296 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:29.555595 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8eac5372-9f7f-4148-98b3-5790d2347296 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:29.556364 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8eac5372-9f7f-4148-98b3-5790d2347296 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:29.556908 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8eac5372-9f7f-4148-98b3-5790d2347296 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:29.557421 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8eac5372-9f7f-4148-98b3-5790d2347296 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:29.588742 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a986c928-5c04-4240-91f2-adf234edf601 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:55:29.596987 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a986c928-5c04-4240-91f2-adf234edf601 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2" status: 200 len: 1695 microversion: 2.1 time: 0.155440 Oct 30 01:55:29.597610 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3253/6510] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:55:29 2022] GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2 => generated 1695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:55:29.688287 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8eac5372-9f7f-4148-98b3-5790d2347296 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7348b82c87cf428dad89bc4fbb6ac1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '384d691c08fa4a48b57896d89f252526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:55:29.696618 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8eac5372-9f7f-4148-98b3-5790d2347296 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] 10.222.0.13 "GET /compute/v2.1/servers/58aeb565-c0d0-49b0-854b-22766f508507" status: 200 len: 1314 microversion: 2.1 time: 0.153480 Oct 30 01:55:29.697125 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3258/6511] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:55:29 2022] GET /compute/v2.1/servers/58aeb565-c0d0-49b0-854b-22766f508507 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:55:30.620706 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-71314a7b-1153-4bba-b319-2a939f2a5854 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:55:30.621236 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-71314a7b-1153-4bba-b319-2a939f2a5854 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 5fe3e5b5-f742-42be-9665-5dc90d4474c2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:55:30.635899 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-71314a7b-1153-4bba-b319-2a939f2a5854 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:30.636406 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-71314a7b-1153-4bba-b319-2a939f2a5854 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:30.637057 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-71314a7b-1153-4bba-b319-2a939f2a5854 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:30.637815 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-71314a7b-1153-4bba-b319-2a939f2a5854 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:30.639806 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-71314a7b-1153-4bba-b319-2a939f2a5854 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:30.640278 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-71314a7b-1153-4bba-b319-2a939f2a5854 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:30.721101 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-52ffda9c-9d4d-4709-99f9-ddbab427db8f tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:55:30.722455 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-52ffda9c-9d4d-4709-99f9-ddbab427db8f tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] [instance: 58aeb565-c0d0-49b0-854b-22766f508507] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:55:30.729592 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-52ffda9c-9d4d-4709-99f9-ddbab427db8f tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:30.730277 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-52ffda9c-9d4d-4709-99f9-ddbab427db8f tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:30.730878 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-52ffda9c-9d4d-4709-99f9-ddbab427db8f tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:30.731831 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-52ffda9c-9d4d-4709-99f9-ddbab427db8f tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:30.732528 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-52ffda9c-9d4d-4709-99f9-ddbab427db8f tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:30.733108 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-52ffda9c-9d4d-4709-99f9-ddbab427db8f tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:30.965317 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-71314a7b-1153-4bba-b319-2a939f2a5854 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:55:30.974861 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-71314a7b-1153-4bba-b319-2a939f2a5854 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2" status: 200 len: 1694 microversion: 2.1 time: 0.358585 Oct 30 01:55:30.975456 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3254/6512] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:55:30 2022] GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2 => generated 1694 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:55:31.048644 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-52ffda9c-9d4d-4709-99f9-ddbab427db8f tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7348b82c87cf428dad89bc4fbb6ac1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '384d691c08fa4a48b57896d89f252526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:55:31.057274 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-52ffda9c-9d4d-4709-99f9-ddbab427db8f tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] 10.222.0.13 "GET /compute/v2.1/servers/58aeb565-c0d0-49b0-854b-22766f508507" status: 200 len: 1314 microversion: 2.1 time: 0.341139 Oct 30 01:55:31.058290 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3259/6513] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:55:30 2022] GET /compute/v2.1/servers/58aeb565-c0d0-49b0-854b-22766f508507 => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:55:31.163391 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-b7fb3e12-ba0b-45ed-9533-c91a18998908 req-3c10fe4f-66c3-44d1-b724-2264d28d400c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fe3e5b5-f742-42be-9665-5dc90d4474c2", "name": "network-vif-unplugged", "status": "completed", "tag": "69daaac0-4496-4426-b057-3b20189fdfd6"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:55:31.176780 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-b7fb3e12-ba0b-45ed-9533-c91a18998908 req-3c10fe4f-66c3-44d1-b724-2264d28d400c service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:31.177482 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-b7fb3e12-ba0b-45ed-9533-c91a18998908 req-3c10fe4f-66c3-44d1-b724-2264d28d400c service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:31.178075 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-b7fb3e12-ba0b-45ed-9533-c91a18998908 req-3c10fe4f-66c3-44d1-b724-2264d28d400c service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:31.191003 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-b7fb3e12-ba0b-45ed-9533-c91a18998908 req-3c10fe4f-66c3-44d1-b724-2264d28d400c service nova] Creating event network-vif-unplugged:69daaac0-4496-4426-b057-3b20189fdfd6 for instance 5fe3e5b5-f742-42be-9665-5dc90d4474c2 on n-h2-master-1 Oct 30 01:55:31.199731 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [req-b7fb3e12-ba0b-45ed-9533-c91a18998908 req-3c10fe4f-66c3-44d1-b724-2264d28d400c service nova] Instance 5fe3e5b5-f742-42be-9665-5dc90d4474c2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=121103) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 30 01:55:31.208192 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-b7fb3e12-ba0b-45ed-9533-c91a18998908 req-3c10fe4f-66c3-44d1-b724-2264d28d400c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050278 Oct 30 01:55:31.208792 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3255/6514] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:55:31.999567 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e1f3c519-7a1b-4348-b91a-653321dad0b5 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:55:32.000365 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e1f3c519-7a1b-4348-b91a-653321dad0b5 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 5fe3e5b5-f742-42be-9665-5dc90d4474c2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:55:32.006112 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:55:32.006808 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=6 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:55:32.009247 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e1f3c519-7a1b-4348-b91a-653321dad0b5 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:32.010032 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e1f3c519-7a1b-4348-b91a-653321dad0b5 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:32.010616 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e1f3c519-7a1b-4348-b91a-653321dad0b5 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:32.011690 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e1f3c519-7a1b-4348-b91a-653321dad0b5 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:32.012140 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e1f3c519-7a1b-4348-b91a-653321dad0b5 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:32.012768 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e1f3c519-7a1b-4348-b91a-653321dad0b5 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:32.082059 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-34931f1b-140f-4371-adc6-6a7379ada87d tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:55:32.082751 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-34931f1b-140f-4371-adc6-6a7379ada87d tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] [instance: 58aeb565-c0d0-49b0-854b-22766f508507] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:55:32.088985 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-34931f1b-140f-4371-adc6-6a7379ada87d tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:32.089518 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-34931f1b-140f-4371-adc6-6a7379ada87d tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:32.090402 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-34931f1b-140f-4371-adc6-6a7379ada87d tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:32.091112 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-34931f1b-140f-4371-adc6-6a7379ada87d tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:32.091824 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-34931f1b-140f-4371-adc6-6a7379ada87d tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:32.092251 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-34931f1b-140f-4371-adc6-6a7379ada87d tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:32.306242 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e1f3c519-7a1b-4348-b91a-653321dad0b5 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:55:32.314595 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e1f3c519-7a1b-4348-b91a-653321dad0b5 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2" status: 200 len: 1694 microversion: 2.1 time: 0.319348 Oct 30 01:55:32.315182 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3260/6515] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:55:31 2022] GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2 => generated 1694 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:55:32.320502 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-98aba269-b567-468e-bafd-d494c972710c req-0cc412d5-3131-4ab1-bee2-e022b30ea2c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58aeb565-c0d0-49b0-854b-22766f508507", "name": "network-vif-plugged", "status": "completed", "tag": "9f168a7a-39fb-40a3-b4db-dd52a40463e6"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:55:32.331337 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-98aba269-b567-468e-bafd-d494c972710c req-0cc412d5-3131-4ab1-bee2-e022b30ea2c6 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:32.332274 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-98aba269-b567-468e-bafd-d494c972710c req-0cc412d5-3131-4ab1-bee2-e022b30ea2c6 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:32.332466 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-98aba269-b567-468e-bafd-d494c972710c req-0cc412d5-3131-4ab1-bee2-e022b30ea2c6 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:32.345229 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-98aba269-b567-468e-bafd-d494c972710c req-0cc412d5-3131-4ab1-bee2-e022b30ea2c6 service nova] Creating event network-vif-plugged:9f168a7a-39fb-40a3-b4db-dd52a40463e6 for instance 58aeb565-c0d0-49b0-854b-22766f508507 on n-h2-master-1 Oct 30 01:55:32.350296 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-98aba269-b567-468e-bafd-d494c972710c req-0cc412d5-3131-4ab1-bee2-e022b30ea2c6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033986 Oct 30 01:55:32.350899 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3261/6516] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:55:32.359689 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-34931f1b-140f-4371-adc6-6a7379ada87d tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7348b82c87cf428dad89bc4fbb6ac1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '384d691c08fa4a48b57896d89f252526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:55:32.373091 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-34931f1b-140f-4371-adc6-6a7379ada87d tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] 10.222.0.13 "GET /compute/v2.1/servers/58aeb565-c0d0-49b0-854b-22766f508507" status: 200 len: 1314 microversion: 2.1 time: 0.296418 Oct 30 01:55:32.374205 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3256/6517] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:55:32 2022] GET /compute/v2.1/servers/58aeb565-c0d0-49b0-854b-22766f508507 => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:55:33.225598 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-ff8f59e2-416d-40de-bf05-69d437739790 req-815d45a1-6362-47de-b4d0-4caf1fa1e55a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fe3e5b5-f742-42be-9665-5dc90d4474c2", "tag": "69daaac0-4496-4426-b057-3b20189fdfd6"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:55:33.235342 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ff8f59e2-416d-40de-bf05-69d437739790 req-815d45a1-6362-47de-b4d0-4caf1fa1e55a service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:33.236381 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ff8f59e2-416d-40de-bf05-69d437739790 req-815d45a1-6362-47de-b4d0-4caf1fa1e55a service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:33.236821 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ff8f59e2-416d-40de-bf05-69d437739790 req-815d45a1-6362-47de-b4d0-4caf1fa1e55a service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:33.248658 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-ff8f59e2-416d-40de-bf05-69d437739790 req-815d45a1-6362-47de-b4d0-4caf1fa1e55a service nova] Creating event network-changed:69daaac0-4496-4426-b057-3b20189fdfd6 for instance 5fe3e5b5-f742-42be-9665-5dc90d4474c2 on n-h2-master-1 Oct 30 01:55:33.254261 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [req-ff8f59e2-416d-40de-bf05-69d437739790 req-815d45a1-6362-47de-b4d0-4caf1fa1e55a service nova] Instance 5fe3e5b5-f742-42be-9665-5dc90d4474c2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=121102) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 30 01:55:33.264945 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-ff8f59e2-416d-40de-bf05-69d437739790 req-815d45a1-6362-47de-b4d0-4caf1fa1e55a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044844 Oct 30 01:55:33.268370 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3262/6518] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:55:33.340223 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0110b8e6-2911-48d0-9fb4-d1e0ceaa22c7 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:55:33.341994 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0110b8e6-2911-48d0-9fb4-d1e0ceaa22c7 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 5fe3e5b5-f742-42be-9665-5dc90d4474c2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:55:33.346362 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=4 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:55:33.353090 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0110b8e6-2911-48d0-9fb4-d1e0ceaa22c7 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:33.353800 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0110b8e6-2911-48d0-9fb4-d1e0ceaa22c7 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:33.359619 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0110b8e6-2911-48d0-9fb4-d1e0ceaa22c7 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:33.359619 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0110b8e6-2911-48d0-9fb4-d1e0ceaa22c7 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:33.359619 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0110b8e6-2911-48d0-9fb4-d1e0ceaa22c7 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:33.359619 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0110b8e6-2911-48d0-9fb4-d1e0ceaa22c7 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:33.377097 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:55:33.398344 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8dccce41-13e7-4c24-be6c-b17f42d1c397 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:55:33.399177 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8dccce41-13e7-4c24-be6c-b17f42d1c397 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] [instance: 58aeb565-c0d0-49b0-854b-22766f508507] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:55:33.406206 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8dccce41-13e7-4c24-be6c-b17f42d1c397 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:33.406962 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8dccce41-13e7-4c24-be6c-b17f42d1c397 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:33.408172 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8dccce41-13e7-4c24-be6c-b17f42d1c397 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:33.409136 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8dccce41-13e7-4c24-be6c-b17f42d1c397 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:33.410007 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8dccce41-13e7-4c24-be6c-b17f42d1c397 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:33.410640 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8dccce41-13e7-4c24-be6c-b17f42d1c397 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:33.655195 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0110b8e6-2911-48d0-9fb4-d1e0ceaa22c7 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:55:33.662114 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0110b8e6-2911-48d0-9fb4-d1e0ceaa22c7 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2" status: 200 len: 1692 microversion: 2.1 time: 0.325610 Oct 30 01:55:33.674271 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3257/6519] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:55:33 2022] GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2 => generated 1692 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:55:33.686437 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8dccce41-13e7-4c24-be6c-b17f42d1c397 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7348b82c87cf428dad89bc4fbb6ac1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '384d691c08fa4a48b57896d89f252526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:55:33.694769 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8dccce41-13e7-4c24-be6c-b17f42d1c397 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] 10.222.0.13 "GET /compute/v2.1/servers/58aeb565-c0d0-49b0-854b-22766f508507" status: 200 len: 1314 microversion: 2.1 time: 0.300633 Oct 30 01:55:33.695461 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3263/6520] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:55:33 2022] GET /compute/v2.1/servers/58aeb565-c0d0-49b0-854b-22766f508507 => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:55:34.686882 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d8fa346b-d99e-449f-ac6f-2e960d0cafbf tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:55:34.687738 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d8fa346b-d99e-449f-ac6f-2e960d0cafbf tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 5fe3e5b5-f742-42be-9665-5dc90d4474c2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:55:34.695701 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d8fa346b-d99e-449f-ac6f-2e960d0cafbf tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:34.696295 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d8fa346b-d99e-449f-ac6f-2e960d0cafbf tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:34.696811 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d8fa346b-d99e-449f-ac6f-2e960d0cafbf tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:34.697724 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d8fa346b-d99e-449f-ac6f-2e960d0cafbf tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:34.698443 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d8fa346b-d99e-449f-ac6f-2e960d0cafbf tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:34.698945 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d8fa346b-d99e-449f-ac6f-2e960d0cafbf tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:34.719356 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-19c68a0e-ba85-476b-9285-d4a16c6e70c5 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:55:34.720839 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-19c68a0e-ba85-476b-9285-d4a16c6e70c5 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] [instance: 58aeb565-c0d0-49b0-854b-22766f508507] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:55:34.734484 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-19c68a0e-ba85-476b-9285-d4a16c6e70c5 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:34.734753 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-19c68a0e-ba85-476b-9285-d4a16c6e70c5 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:34.739501 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-19c68a0e-ba85-476b-9285-d4a16c6e70c5 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:34.740279 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-19c68a0e-ba85-476b-9285-d4a16c6e70c5 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:34.740755 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-19c68a0e-ba85-476b-9285-d4a16c6e70c5 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:34.748465 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-19c68a0e-ba85-476b-9285-d4a16c6e70c5 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:34.748465 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:55:34.901053 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d8fa346b-d99e-449f-ac6f-2e960d0cafbf tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:55:34.910927 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d8fa346b-d99e-449f-ac6f-2e960d0cafbf tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2" status: 200 len: 1692 microversion: 2.1 time: 0.227859 Oct 30 01:55:34.911626 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3258/6521] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:55:34 2022] GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2 => generated 1692 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:55:34.928198 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-19c68a0e-ba85-476b-9285-d4a16c6e70c5 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7348b82c87cf428dad89bc4fbb6ac1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '384d691c08fa4a48b57896d89f252526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:55:34.936055 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-19c68a0e-ba85-476b-9285-d4a16c6e70c5 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] 10.222.0.13 "GET /compute/v2.1/servers/58aeb565-c0d0-49b0-854b-22766f508507" status: 200 len: 1464 microversion: 2.1 time: 0.221613 Oct 30 01:55:34.937813 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3264/6522] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:55:34 2022] GET /compute/v2.1/servers/58aeb565-c0d0-49b0-854b-22766f508507 => generated 1464 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:55:34.959329 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e6d6e03b-0556-4db8-b598-2cd4b81f87f0 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "11e50be2-4387-42cf-8bf6-de301c3d7584", "device": "/dev/sdb"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:55:34.961790 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e6d6e03b-0556-4db8-b598-2cd4b81f87f0 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] [instance: 58aeb565-c0d0-49b0-854b-22766f508507] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:55:34.967941 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e6d6e03b-0556-4db8-b598-2cd4b81f87f0 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:34.971411 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e6d6e03b-0556-4db8-b598-2cd4b81f87f0 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:34.971411 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e6d6e03b-0556-4db8-b598-2cd4b81f87f0 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:34.971411 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e6d6e03b-0556-4db8-b598-2cd4b81f87f0 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:34.971411 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e6d6e03b-0556-4db8-b598-2cd4b81f87f0 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:34.971411 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e6d6e03b-0556-4db8-b598-2cd4b81f87f0 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:35.896506 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e6d6e03b-0556-4db8-b598-2cd4b81f87f0 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] 10.222.0.13 "POST /compute/v2.1/servers/58aeb565-c0d0-49b0-854b-22766f508507/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.941561 Oct 30 01:55:35.897214 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3259/6523] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 30 01:55:34 2022] POST /compute/v2.1/servers/58aeb565-c0d0-49b0-854b-22766f508507/os-volume_attachments => generated 194 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:55:35.935490 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-82f2dd6d-a732-4801-a194-7ce09825836e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:55:35.936100 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-82f2dd6d-a732-4801-a194-7ce09825836e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 5fe3e5b5-f742-42be-9665-5dc90d4474c2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:55:35.944271 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-82f2dd6d-a732-4801-a194-7ce09825836e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:35.944667 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-82f2dd6d-a732-4801-a194-7ce09825836e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:35.945311 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-82f2dd6d-a732-4801-a194-7ce09825836e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:35.946051 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-82f2dd6d-a732-4801-a194-7ce09825836e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:35.946508 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-82f2dd6d-a732-4801-a194-7ce09825836e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:35.946935 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-82f2dd6d-a732-4801-a194-7ce09825836e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:36.118678 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-82f2dd6d-a732-4801-a194-7ce09825836e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:55:36.134790 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-82f2dd6d-a732-4801-a194-7ce09825836e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2" status: 200 len: 1689 microversion: 2.1 time: 0.202969 Oct 30 01:55:36.136121 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3265/6524] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:55:35 2022] GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2 => generated 1689 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:55:36.159166 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d2aca955-348c-44ad-8872-de2f2c9bc022 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:55:36.160001 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d2aca955-348c-44ad-8872-de2f2c9bc022 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 5fe3e5b5-f742-42be-9665-5dc90d4474c2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:55:36.176530 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d2aca955-348c-44ad-8872-de2f2c9bc022 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:36.177272 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d2aca955-348c-44ad-8872-de2f2c9bc022 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:36.178503 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d2aca955-348c-44ad-8872-de2f2c9bc022 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:36.179223 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d2aca955-348c-44ad-8872-de2f2c9bc022 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:36.179899 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d2aca955-348c-44ad-8872-de2f2c9bc022 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:36.180483 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d2aca955-348c-44ad-8872-de2f2c9bc022 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:36.504297 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d2aca955-348c-44ad-8872-de2f2c9bc022 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "POST /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2/action" status: 202 len: 0 microversion: 2.1 time: 0.349632 Oct 30 01:55:36.505105 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3260/6525] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:55:36 2022] POST /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2/action => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:55:36.513070 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-84990672-6e50-4e70-a492-b211c52bac32 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:55:36.513797 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-84990672-6e50-4e70-a492-b211c52bac32 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 5fe3e5b5-f742-42be-9665-5dc90d4474c2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:55:36.520604 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-84990672-6e50-4e70-a492-b211c52bac32 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:36.521171 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-84990672-6e50-4e70-a492-b211c52bac32 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:36.521852 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-84990672-6e50-4e70-a492-b211c52bac32 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:36.522627 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-84990672-6e50-4e70-a492-b211c52bac32 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:36.523206 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-84990672-6e50-4e70-a492-b211c52bac32 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:36.523796 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-84990672-6e50-4e70-a492-b211c52bac32 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:36.684888 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-84990672-6e50-4e70-a492-b211c52bac32 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:55:36.694507 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-84990672-6e50-4e70-a492-b211c52bac32 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2" status: 200 len: 1688 microversion: 2.1 time: 0.185176 Oct 30 01:55:36.696289 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3266/6526] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:55:36 2022] GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2 => generated 1688 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:55:37.724853 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d0264c4f-c677-4401-ad0a-67ea6c3b738a tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:55:37.726476 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d0264c4f-c677-4401-ad0a-67ea6c3b738a tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 5fe3e5b5-f742-42be-9665-5dc90d4474c2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:55:37.732941 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d0264c4f-c677-4401-ad0a-67ea6c3b738a tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:37.733499 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d0264c4f-c677-4401-ad0a-67ea6c3b738a tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:37.733945 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d0264c4f-c677-4401-ad0a-67ea6c3b738a tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:37.734670 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d0264c4f-c677-4401-ad0a-67ea6c3b738a tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:37.735132 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d0264c4f-c677-4401-ad0a-67ea6c3b738a tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:37.735570 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d0264c4f-c677-4401-ad0a-67ea6c3b738a tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:37.896330 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d0264c4f-c677-4401-ad0a-67ea6c3b738a tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:55:37.904964 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d0264c4f-c677-4401-ad0a-67ea6c3b738a tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2" status: 200 len: 1688 microversion: 2.1 time: 0.185936 Oct 30 01:55:37.906005 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3261/6527] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:55:37 2022] GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2 => generated 1688 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:55:38.260718 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-d11d867e-20de-4bd2-b705-a10606396bf2 req-d63fa6b5-05df-45d5-b1b5-1ed4c736a1a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fe3e5b5-f742-42be-9665-5dc90d4474c2", "name": "network-vif-plugged", "status": "completed", "tag": "69daaac0-4496-4426-b057-3b20189fdfd6"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:55:38.272431 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-d11d867e-20de-4bd2-b705-a10606396bf2 req-d63fa6b5-05df-45d5-b1b5-1ed4c736a1a5 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:38.272977 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-d11d867e-20de-4bd2-b705-a10606396bf2 req-d63fa6b5-05df-45d5-b1b5-1ed4c736a1a5 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:38.273508 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-d11d867e-20de-4bd2-b705-a10606396bf2 req-d63fa6b5-05df-45d5-b1b5-1ed4c736a1a5 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:38.286125 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-d11d867e-20de-4bd2-b705-a10606396bf2 req-d63fa6b5-05df-45d5-b1b5-1ed4c736a1a5 service nova] Creating event network-vif-plugged:69daaac0-4496-4426-b057-3b20189fdfd6 for instance 5fe3e5b5-f742-42be-9665-5dc90d4474c2 on n-h2-master-1 Oct 30 01:55:38.292058 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [req-d11d867e-20de-4bd2-b705-a10606396bf2 req-d63fa6b5-05df-45d5-b1b5-1ed4c736a1a5 service nova] Instance 5fe3e5b5-f742-42be-9665-5dc90d4474c2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=121102) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 30 01:55:38.304344 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-d11d867e-20de-4bd2-b705-a10606396bf2 req-d63fa6b5-05df-45d5-b1b5-1ed4c736a1a5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047233 Oct 30 01:55:38.305288 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3267/6528] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:55:38.929371 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-786f3011-30de-4c86-ab04-f1fe72fbd6b5 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:55:38.930010 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-786f3011-30de-4c86-ab04-f1fe72fbd6b5 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 5fe3e5b5-f742-42be-9665-5dc90d4474c2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:55:38.937352 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-786f3011-30de-4c86-ab04-f1fe72fbd6b5 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:38.938312 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-786f3011-30de-4c86-ab04-f1fe72fbd6b5 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:38.939514 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-786f3011-30de-4c86-ab04-f1fe72fbd6b5 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:38.940449 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-786f3011-30de-4c86-ab04-f1fe72fbd6b5 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:38.941073 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-786f3011-30de-4c86-ab04-f1fe72fbd6b5 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:38.941702 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-786f3011-30de-4c86-ab04-f1fe72fbd6b5 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:39.121199 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-786f3011-30de-4c86-ab04-f1fe72fbd6b5 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:55:39.125632 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-786f3011-30de-4c86-ab04-f1fe72fbd6b5 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2" status: 200 len: 1688 microversion: 2.1 time: 0.200680 Oct 30 01:55:39.127085 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3262/6529] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:55:38 2022] GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2 => generated 1688 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:55:40.151957 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a0cf8586-40e6-4dd2-aa4a-c99f53051e14 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:55:40.153297 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a0cf8586-40e6-4dd2-aa4a-c99f53051e14 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 5fe3e5b5-f742-42be-9665-5dc90d4474c2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:55:40.171266 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a0cf8586-40e6-4dd2-aa4a-c99f53051e14 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:40.171266 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a0cf8586-40e6-4dd2-aa4a-c99f53051e14 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:40.171266 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a0cf8586-40e6-4dd2-aa4a-c99f53051e14 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:40.171266 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a0cf8586-40e6-4dd2-aa4a-c99f53051e14 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:40.171266 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a0cf8586-40e6-4dd2-aa4a-c99f53051e14 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:40.171266 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a0cf8586-40e6-4dd2-aa4a-c99f53051e14 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:40.410023 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a0cf8586-40e6-4dd2-aa4a-c99f53051e14 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:55:40.419750 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a0cf8586-40e6-4dd2-aa4a-c99f53051e14 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2" status: 200 len: 1688 microversion: 2.1 time: 0.273769 Oct 30 01:55:40.429891 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3268/6530] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:55:40 2022] GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2 => generated 1688 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:55:40.748502 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-d7722482-e014-4001-a941-5a978adbd315 req-2010a762-230e-43c6-9c65-dca76039095e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fe3e5b5-f742-42be-9665-5dc90d4474c2", "name": "network-vif-unplugged", "status": "completed", "tag": "69daaac0-4496-4426-b057-3b20189fdfd6"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:55:40.762943 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d7722482-e014-4001-a941-5a978adbd315 req-2010a762-230e-43c6-9c65-dca76039095e service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:40.763558 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d7722482-e014-4001-a941-5a978adbd315 req-2010a762-230e-43c6-9c65-dca76039095e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:40.764069 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d7722482-e014-4001-a941-5a978adbd315 req-2010a762-230e-43c6-9c65-dca76039095e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:40.778259 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-d7722482-e014-4001-a941-5a978adbd315 req-2010a762-230e-43c6-9c65-dca76039095e service nova] Creating event network-vif-unplugged:69daaac0-4496-4426-b057-3b20189fdfd6 for instance 5fe3e5b5-f742-42be-9665-5dc90d4474c2 on n-h1-master-1 Oct 30 01:55:40.784207 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [req-d7722482-e014-4001-a941-5a978adbd315 req-2010a762-230e-43c6-9c65-dca76039095e service nova] Instance 5fe3e5b5-f742-42be-9665-5dc90d4474c2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=121103) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 30 01:55:40.796813 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-d7722482-e014-4001-a941-5a978adbd315 req-2010a762-230e-43c6-9c65-dca76039095e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054127 Oct 30 01:55:40.797577 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3263/6531] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:55:41.447144 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-11c6e403-847f-4381-822d-851e877bb2b3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:55:41.447631 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-11c6e403-847f-4381-822d-851e877bb2b3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 5fe3e5b5-f742-42be-9665-5dc90d4474c2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:55:41.453749 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-11c6e403-847f-4381-822d-851e877bb2b3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:41.454234 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-11c6e403-847f-4381-822d-851e877bb2b3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:41.455288 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-11c6e403-847f-4381-822d-851e877bb2b3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:41.456277 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-11c6e403-847f-4381-822d-851e877bb2b3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:41.456727 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-11c6e403-847f-4381-822d-851e877bb2b3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:41.457148 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-11c6e403-847f-4381-822d-851e877bb2b3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:42.030144 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-11c6e403-847f-4381-822d-851e877bb2b3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:55:42.038031 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-11c6e403-847f-4381-822d-851e877bb2b3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2" status: 200 len: 1688 microversion: 2.1 time: 0.597639 Oct 30 01:55:42.039065 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3269/6532] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:55:41 2022] GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2 => generated 1688 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:55:42.812571 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-b7fa07e1-5616-4d79-8191-0e7d805d7b0a req-2b837ea9-32d4-429b-af7e-c0df92ca663b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fe3e5b5-f742-42be-9665-5dc90d4474c2", "tag": "69daaac0-4496-4426-b057-3b20189fdfd6"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:55:42.822969 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-b7fa07e1-5616-4d79-8191-0e7d805d7b0a req-2b837ea9-32d4-429b-af7e-c0df92ca663b service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:42.823466 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-b7fa07e1-5616-4d79-8191-0e7d805d7b0a req-2b837ea9-32d4-429b-af7e-c0df92ca663b service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:42.823894 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-b7fa07e1-5616-4d79-8191-0e7d805d7b0a req-2b837ea9-32d4-429b-af7e-c0df92ca663b service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:42.835405 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-b7fa07e1-5616-4d79-8191-0e7d805d7b0a req-2b837ea9-32d4-429b-af7e-c0df92ca663b service nova] Creating event network-changed:69daaac0-4496-4426-b057-3b20189fdfd6 for instance 5fe3e5b5-f742-42be-9665-5dc90d4474c2 on n-h1-master-1 Oct 30 01:55:42.840552 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [req-b7fa07e1-5616-4d79-8191-0e7d805d7b0a req-2b837ea9-32d4-429b-af7e-c0df92ca663b service nova] Instance 5fe3e5b5-f742-42be-9665-5dc90d4474c2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=121103) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 30 01:55:42.853408 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-b7fa07e1-5616-4d79-8191-0e7d805d7b0a req-2b837ea9-32d4-429b-af7e-c0df92ca663b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044922 Oct 30 01:55:42.853978 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3264/6533] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:55:43.061559 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1730e2be-cb81-4d95-bfa8-738075e73378 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:55:43.064378 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1730e2be-cb81-4d95-bfa8-738075e73378 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 5fe3e5b5-f742-42be-9665-5dc90d4474c2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:55:43.071489 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1730e2be-cb81-4d95-bfa8-738075e73378 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:43.071971 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1730e2be-cb81-4d95-bfa8-738075e73378 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:43.072407 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1730e2be-cb81-4d95-bfa8-738075e73378 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:43.073107 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1730e2be-cb81-4d95-bfa8-738075e73378 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:43.073592 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1730e2be-cb81-4d95-bfa8-738075e73378 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:43.074016 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1730e2be-cb81-4d95-bfa8-738075e73378 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:43.248334 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1730e2be-cb81-4d95-bfa8-738075e73378 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:55:43.259837 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1730e2be-cb81-4d95-bfa8-738075e73378 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2" status: 200 len: 1688 microversion: 2.1 time: 0.202347 Oct 30 01:55:43.260964 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3270/6534] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:55:43 2022] GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2 => generated 1688 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:55:44.286694 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-49e22b22-db07-4a27-a407-b8cecb75f19f tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:55:44.287513 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-49e22b22-db07-4a27-a407-b8cecb75f19f tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 5fe3e5b5-f742-42be-9665-5dc90d4474c2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:55:44.292450 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=61 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:55:44.305673 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-49e22b22-db07-4a27-a407-b8cecb75f19f tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:44.306203 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-49e22b22-db07-4a27-a407-b8cecb75f19f tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:44.306663 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-49e22b22-db07-4a27-a407-b8cecb75f19f tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:44.307428 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-49e22b22-db07-4a27-a407-b8cecb75f19f tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:44.307899 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-49e22b22-db07-4a27-a407-b8cecb75f19f tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:44.308334 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-49e22b22-db07-4a27-a407-b8cecb75f19f tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:44.458657 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-49e22b22-db07-4a27-a407-b8cecb75f19f tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:55:44.468487 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-49e22b22-db07-4a27-a407-b8cecb75f19f tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2" status: 200 len: 1681 microversion: 2.1 time: 0.187603 Oct 30 01:55:44.469148 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3265/6535] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:55:44 2022] GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2 => generated 1681 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:55:46.371124 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-f544deb6-911f-4cf4-b409-1576aad97904 req-3f22f700-0c02-44c9-ab03-7b83097fb471 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fe3e5b5-f742-42be-9665-5dc90d4474c2", "name": "network-vif-plugged", "status": "completed", "tag": "69daaac0-4496-4426-b057-3b20189fdfd6"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:55:46.376648 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:55:46.382033 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-f544deb6-911f-4cf4-b409-1576aad97904 req-3f22f700-0c02-44c9-ab03-7b83097fb471 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:55:46.382517 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-f544deb6-911f-4cf4-b409-1576aad97904 req-3f22f700-0c02-44c9-ab03-7b83097fb471 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:55:46.382949 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-f544deb6-911f-4cf4-b409-1576aad97904 req-3f22f700-0c02-44c9-ab03-7b83097fb471 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:55:46.398541 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-f544deb6-911f-4cf4-b409-1576aad97904 req-3f22f700-0c02-44c9-ab03-7b83097fb471 service nova] Creating event network-vif-plugged:69daaac0-4496-4426-b057-3b20189fdfd6 for instance 5fe3e5b5-f742-42be-9665-5dc90d4474c2 on n-h1-master-1 Oct 30 01:55:46.403960 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-f544deb6-911f-4cf4-b409-1576aad97904 req-3f22f700-0c02-44c9-ab03-7b83097fb471 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036765 Oct 30 01:55:46.404607 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3271/6536] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:56:08.702168 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-61470dd5-aeaf-4e9b-9624-33a7fea9e7bf tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:56:08.705104 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-61470dd5-aeaf-4e9b-9624-33a7fea9e7bf tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 5fe3e5b5-f742-42be-9665-5dc90d4474c2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:56:08.707850 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:56:08.709616 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:56:08.715348 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-61470dd5-aeaf-4e9b-9624-33a7fea9e7bf tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:56:08.716398 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-61470dd5-aeaf-4e9b-9624-33a7fea9e7bf tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:56:08.716825 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-61470dd5-aeaf-4e9b-9624-33a7fea9e7bf tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:56:08.717682 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-61470dd5-aeaf-4e9b-9624-33a7fea9e7bf tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:56:08.718206 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-61470dd5-aeaf-4e9b-9624-33a7fea9e7bf tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:56:08.718694 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-61470dd5-aeaf-4e9b-9624-33a7fea9e7bf tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:56:08.795168 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-61470dd5-aeaf-4e9b-9624-33a7fea9e7bf tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "POST /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2/action" status: 200 len: 63188 microversion: 2.1 time: 0.104372 Oct 30 01:56:08.801380 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3266/6537] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:56:08 2022] POST /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2/action => generated 63188 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:56:15.029572 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=40 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:56:15.033615 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1410331f-88db-49d7-bc86-843232202595 tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:56:15.034342 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1410331f-88db-49d7-bc86-843232202595 tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] [instance: 5fe3e5b5-f742-42be-9665-5dc90d4474c2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:56:15.046877 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1410331f-88db-49d7-bc86-843232202595 tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:56:15.046877 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1410331f-88db-49d7-bc86-843232202595 tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:56:15.046877 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1410331f-88db-49d7-bc86-843232202595 tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:56:15.046877 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1410331f-88db-49d7-bc86-843232202595 tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:56:15.046877 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1410331f-88db-49d7-bc86-843232202595 tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:56:15.046877 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1410331f-88db-49d7-bc86-843232202595 tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:56:15.175657 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1410331f-88db-49d7-bc86-843232202595 tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2" status: 200 len: 1832 microversion: 2.1 time: 0.148114 Oct 30 01:56:15.176230 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3272/6538] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:56:15 2022] GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2 => generated 1832 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:56:16.150497 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-68c21ff5-595a-43e1-9a36-c53cf118c458 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:56:16.151727 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-68c21ff5-595a-43e1-9a36-c53cf118c458 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 5fe3e5b5-f742-42be-9665-5dc90d4474c2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:56:16.153708 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-97ca1d6b-efac-4a2b-9f77-0acea04584fc req-ac77a697-5e55-44be-af8e-01002783f346 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fe3e5b5-f742-42be-9665-5dc90d4474c2", "tag": "69daaac0-4496-4426-b057-3b20189fdfd6"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:56:16.160111 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-68c21ff5-595a-43e1-9a36-c53cf118c458 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:56:16.160905 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-68c21ff5-595a-43e1-9a36-c53cf118c458 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:56:16.161592 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-68c21ff5-595a-43e1-9a36-c53cf118c458 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:56:16.163088 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-68c21ff5-595a-43e1-9a36-c53cf118c458 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:56:16.163766 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-68c21ff5-595a-43e1-9a36-c53cf118c458 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:56:16.164414 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-68c21ff5-595a-43e1-9a36-c53cf118c458 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:56:16.168994 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-97ca1d6b-efac-4a2b-9f77-0acea04584fc req-ac77a697-5e55-44be-af8e-01002783f346 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:56:16.168994 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-97ca1d6b-efac-4a2b-9f77-0acea04584fc req-ac77a697-5e55-44be-af8e-01002783f346 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:56:16.169492 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-97ca1d6b-efac-4a2b-9f77-0acea04584fc req-ac77a697-5e55-44be-af8e-01002783f346 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:56:16.181864 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-97ca1d6b-efac-4a2b-9f77-0acea04584fc req-ac77a697-5e55-44be-af8e-01002783f346 service nova] Creating event network-changed:69daaac0-4496-4426-b057-3b20189fdfd6 for instance 5fe3e5b5-f742-42be-9665-5dc90d4474c2 on n-h1-master-1 Oct 30 01:56:16.186971 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-97ca1d6b-efac-4a2b-9f77-0acea04584fc req-ac77a697-5e55-44be-af8e-01002783f346 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036977 Oct 30 01:56:16.187573 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3273/6539] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:56:16.195686 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-68c21ff5-595a-43e1-9a36-c53cf118c458 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 5fe3e5b5-f742-42be-9665-5dc90d4474c2] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:56:16.508030 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-68c21ff5-595a-43e1-9a36-c53cf118c458 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2" status: 204 len: 0 microversion: 2.1 time: 0.360444 Oct 30 01:56:16.508651 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3267/6540] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:56:16 2022] DELETE /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 30 01:56:16.520584 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2aadbf45-35b1-455a-a5e1-4bdd5658b7dc tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:56:16.521711 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2aadbf45-35b1-455a-a5e1-4bdd5658b7dc tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 5fe3e5b5-f742-42be-9665-5dc90d4474c2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:56:16.528510 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2aadbf45-35b1-455a-a5e1-4bdd5658b7dc tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:56:16.529161 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2aadbf45-35b1-455a-a5e1-4bdd5658b7dc tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:56:16.529728 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2aadbf45-35b1-455a-a5e1-4bdd5658b7dc tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:56:16.530665 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2aadbf45-35b1-455a-a5e1-4bdd5658b7dc tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:56:16.531321 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2aadbf45-35b1-455a-a5e1-4bdd5658b7dc tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:56:16.532304 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2aadbf45-35b1-455a-a5e1-4bdd5658b7dc tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:56:16.686527 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2aadbf45-35b1-455a-a5e1-4bdd5658b7dc tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:56:16.698328 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2aadbf45-35b1-455a-a5e1-4bdd5658b7dc tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2" status: 200 len: 1687 microversion: 2.1 time: 0.184960 Oct 30 01:56:16.699343 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3274/6541] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:56:16 2022] GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2 => generated 1687 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:56:17.722732 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-eccffecd-fe3f-40a1-9120-b7b8ebc4988d tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:56:17.723555 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-eccffecd-fe3f-40a1-9120-b7b8ebc4988d tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 5fe3e5b5-f742-42be-9665-5dc90d4474c2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:56:17.731526 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eccffecd-fe3f-40a1-9120-b7b8ebc4988d tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:56:17.732208 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eccffecd-fe3f-40a1-9120-b7b8ebc4988d tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:56:17.732834 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eccffecd-fe3f-40a1-9120-b7b8ebc4988d tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:56:17.733750 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eccffecd-fe3f-40a1-9120-b7b8ebc4988d tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:56:17.734206 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eccffecd-fe3f-40a1-9120-b7b8ebc4988d tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:56:17.734666 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eccffecd-fe3f-40a1-9120-b7b8ebc4988d tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:56:17.989698 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-eccffecd-fe3f-40a1-9120-b7b8ebc4988d tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:56:17.998813 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-eccffecd-fe3f-40a1-9120-b7b8ebc4988d tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2" status: 200 len: 1687 microversion: 2.1 time: 0.280458 Oct 30 01:56:17.999670 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3268/6542] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:56:17 2022] GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2 => generated 1687 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:56:18.496925 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-b3840a2a-6382-475a-b548-05c92142629e req-f03f5043-a049-41cd-ad25-48879986ddb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fe3e5b5-f742-42be-9665-5dc90d4474c2", "name": "network-vif-deleted", "tag": "69daaac0-4496-4426-b057-3b20189fdfd6"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:56:18.508995 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-b3840a2a-6382-475a-b548-05c92142629e req-f03f5043-a049-41cd-ad25-48879986ddb4 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:56:18.509643 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-b3840a2a-6382-475a-b548-05c92142629e req-f03f5043-a049-41cd-ad25-48879986ddb4 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:56:18.510083 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-b3840a2a-6382-475a-b548-05c92142629e req-f03f5043-a049-41cd-ad25-48879986ddb4 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:56:18.521584 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-b3840a2a-6382-475a-b548-05c92142629e req-f03f5043-a049-41cd-ad25-48879986ddb4 service nova] Creating event network-vif-deleted:69daaac0-4496-4426-b057-3b20189fdfd6 for instance 5fe3e5b5-f742-42be-9665-5dc90d4474c2 on n-h1-master-1 Oct 30 01:56:18.527173 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-b3840a2a-6382-475a-b548-05c92142629e req-f03f5043-a049-41cd-ad25-48879986ddb4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034258 Oct 30 01:56:18.532378 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3275/6543] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:56:19.024271 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bb327c8a-bbe0-4d67-86ed-e38508a984cb tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:56:19.025367 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-bb327c8a-bbe0-4d67-86ed-e38508a984cb tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 5fe3e5b5-f742-42be-9665-5dc90d4474c2] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:56:19.032979 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb327c8a-bbe0-4d67-86ed-e38508a984cb tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:56:19.033576 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb327c8a-bbe0-4d67-86ed-e38508a984cb tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:56:19.034604 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb327c8a-bbe0-4d67-86ed-e38508a984cb tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:56:19.034860 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb327c8a-bbe0-4d67-86ed-e38508a984cb tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:56:19.035388 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb327c8a-bbe0-4d67-86ed-e38508a984cb tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:56:19.035892 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb327c8a-bbe0-4d67-86ed-e38508a984cb tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:56:19.074067 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb327c8a-bbe0-4d67-86ed-e38508a984cb tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:56:19.074957 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb327c8a-bbe0-4d67-86ed-e38508a984cb tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:56:19.075547 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb327c8a-bbe0-4d67-86ed-e38508a984cb tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:56:19.076156 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-bb327c8a-bbe0-4d67-86ed-e38508a984cb tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lazy-loading 'fault' on Instance uuid 5fe3e5b5-f742-42be-9665-5dc90d4474c2 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:56:19.130548 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-bb327c8a-bbe0-4d67-86ed-e38508a984cb tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:56:19.142291 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bb327c8a-bbe0-4d67-86ed-e38508a984cb tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2" status: 200 len: 1356 microversion: 2.1 time: 0.122004 Oct 30 01:56:19.142874 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3269/6544] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:56:19 2022] GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2 => generated 1356 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:56:20.166698 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cea871db-018c-4e04-bd91-8835a43cbf25 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:56:20.167618 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cea871db-018c-4e04-bd91-8835a43cbf25 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 5fe3e5b5-f742-42be-9665-5dc90d4474c2] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:56:20.173790 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cea871db-018c-4e04-bd91-8835a43cbf25 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:56:20.174275 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cea871db-018c-4e04-bd91-8835a43cbf25 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:56:20.174708 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cea871db-018c-4e04-bd91-8835a43cbf25 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:56:20.175504 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cea871db-018c-4e04-bd91-8835a43cbf25 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:56:20.175953 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cea871db-018c-4e04-bd91-8835a43cbf25 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:56:20.176382 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cea871db-018c-4e04-bd91-8835a43cbf25 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:56:20.190622 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-cea871db-018c-4e04-bd91-8835a43cbf25 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] HTTP exception thrown: Instance 5fe3e5b5-f742-42be-9665-5dc90d4474c2 could not be found. Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cea871db-018c-4e04-bd91-8835a43cbf25 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Request method failure captured: Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2 HTTP/1.1 Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdi5g692Uv5xl51AXx_zH5DqygQV5gilQk65Zrt4awXG-qNzrnkspnA78K5Gla_Xr75NP6Y6TYXCTZgpS6AZ1uwBTWQJyiZW5VCW1eOoSX9Nhid2ZA0O0wE2AoU3HGyFGPzUs9NxTgw8u0D_JE9Zhgtle7Vspzqc0hxjWXJSlhOuR44 Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: f2bf165fe12748b29e66ea4f61364aef Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1545186841 Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f2bf165fe12748b29e66ea4f61364aef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f2bf165fe12748b29e66ea4f61364aef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f2bf165fe12748b29e66ea4f61364aef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f2bf165fe12748b29e66ea4f61364aef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1545186841 Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: f2bf165fe12748b29e66ea4f61364aef Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1545186841 Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-TestNetworkAdvancedServerOps-1545186841-project Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: f0f51fe515ee4375a252a8d8a98ec77b Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1545186841-project Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 5fe3e5b5-f742-42be-9665-5dc90d4474c2 could not be found. Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '5fe3e5b5-f742-42be-9665-5dc90d4474c2'} Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fe3e5b5-f742-42be-9665-5dc90d4474c2 could not be found. Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fe3e5b5-f742-42be-9665-5dc90d4474c2 could not be found. Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:56:20.192538 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:56:20.208795 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:56:20.208795 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:56:20.208795 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:56:20.208795 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:56:20.208795 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:56:20.208795 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:56:20.208795 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fe3e5b5-f742-42be-9665-5dc90d4474c2 could not be found. Oct 30 01:56:20.208795 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:56:20.208795 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cea871db-018c-4e04-bd91-8835a43cbf25 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Returning 404 to user: Instance 5fe3e5b5-f742-42be-9665-5dc90d4474c2 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:56:20.208795 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cea871db-018c-4e04-bd91-8835a43cbf25 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2" status: 404 len: 111 microversion: 2.1 time: 0.032311 Oct 30 01:56:20.208795 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3276/6545] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:56:20 2022] GET /compute/v2.1/servers/5fe3e5b5-f742-42be-9665-5dc90d4474c2 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:56:24.589169 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d3458b8e-31a2-4fac-9b33-df6289fea782 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '.version_select at 0x7f44c6e09670>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:56:24.707669 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d3458b8e-31a2-4fac-9b33-df6289fea782 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-325320653" status: 202 len: 0 microversion: 2.1 time: 0.127765 Oct 30 01:56:24.712235 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3270/6546] 10.222.0.13 () {58 vars in 1281 bytes} [Sun Oct 30 01:56:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-325320653 => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:56:24.742543 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fe3bf7f6-402f-45b7-94e1-21516d4611b9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Action: 'create', calling method: .version_select at 0x7f44cc6f3dc0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-330442908", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2iG5bUYeYVagTXVKAldP9Nfb6mMHYbDzsWK/a52KnR8zFsTkFfiHx5XPY6E9SSiPvfcgpbIHrrqq5ctDwzDbXfWiF5sSmHocm2qXhUEAjJwTO8k/X3mNIeYi1GUNPvWA=="}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:56:24.761636 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-fe3bf7f6-402f-45b7-94e1-21516d4611b9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Getting quotas for project f2bf165fe12748b29e66ea4f61364aef. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:56:24.767406 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-fe3bf7f6-402f-45b7-94e1-21516d4611b9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Getting quotas for user f0f51fe515ee4375a252a8d8a98ec77b and project f2bf165fe12748b29e66ea4f61364aef. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:56:24.900769 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fe3bf7f6-402f-45b7-94e1-21516d4611b9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.159579 Oct 30 01:56:24.900769 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3277/6547] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 30 01:56:24 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:56:34.423919 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5f9b6de9-a1e3-4423-ae4c-52187221ad5e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-384273212", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "7a5c3d8b-dd41-4f7a-86a8-fb244378ee99"}], "key_name": "tempest-TestNetworkAdvancedServerOps-330442908", "security_groups": [{"name": "tempest-secgroup-smoke-1599389276"}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:56:34.474084 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:56:34.618252 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-5f9b6de9-a1e3-4423-ae4c-52187221ad5e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] validate_networks() for [('7a5c3d8b-dd41-4f7a-86a8-fb244378ee99', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:56:35.072970 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-5f9b6de9-a1e3-4423-ae4c-52187221ad5e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:56:35.073540 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-5f9b6de9-a1e3-4423-ae4c-52187221ad5e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:56:35.074226 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-5f9b6de9-a1e3-4423-ae4c-52187221ad5e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:56:35.074685 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-5f9b6de9-a1e3-4423-ae4c-52187221ad5e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:56:35.075167 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-5f9b6de9-a1e3-4423-ae4c-52187221ad5e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:56:35.087353 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f9b6de9-a1e3-4423-ae4c-52187221ad5e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:56:35.087353 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f9b6de9-a1e3-4423-ae4c-52187221ad5e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:56:35.087353 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f9b6de9-a1e3-4423-ae4c-52187221ad5e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:56:35.088038 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f9b6de9-a1e3-4423-ae4c-52187221ad5e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:56:35.088677 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f9b6de9-a1e3-4423-ae4c-52187221ad5e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:56:35.089098 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f9b6de9-a1e3-4423-ae4c-52187221ad5e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:56:35.107520 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-5f9b6de9-a1e3-4423-ae4c-52187221ad5e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Getting quotas for project f2bf165fe12748b29e66ea4f61364aef. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:56:35.116330 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-5f9b6de9-a1e3-4423-ae4c-52187221ad5e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Getting quotas for user f0f51fe515ee4375a252a8d8a98ec77b and project f2bf165fe12748b29e66ea4f61364aef. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:56:35.126408 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5f9b6de9-a1e3-4423-ae4c-52187221ad5e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:56:35.129004 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5f9b6de9-a1e3-4423-ae4c-52187221ad5e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7032c925-acf4-42e1-9e30-abf86d2b0c06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:56:35.278846 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5f9b6de9-a1e3-4423-ae4c-52187221ad5e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.858692 Oct 30 01:56:35.279595 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3271/6548] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:56:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 860 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:56:35.288819 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=18 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:56:35.289644 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=4 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:56:35.291010 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:56:35.294237 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-047ce543-9f57-45a9-abde-5f0a7baacee7 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:56:35.294853 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-047ce543-9f57-45a9-abde-5f0a7baacee7 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7032c925-acf4-42e1-9e30-abf86d2b0c06] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:56:35.352188 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-047ce543-9f57-45a9-abde-5f0a7baacee7 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:56:35.359225 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-047ce543-9f57-45a9-abde-5f0a7baacee7 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06" status: 200 len: 1265 microversion: 2.1 time: 0.072324 Oct 30 01:56:35.360377 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3278/6549] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:56:35 2022] GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06 => generated 1265 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:56:36.383786 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2d83d92e-d4ed-40e0-b126-d693f11d0015 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:56:36.384444 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2d83d92e-d4ed-40e0-b126-d693f11d0015 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7032c925-acf4-42e1-9e30-abf86d2b0c06] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:56:36.458330 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2d83d92e-d4ed-40e0-b126-d693f11d0015 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:56:36.466625 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2d83d92e-d4ed-40e0-b126-d693f11d0015 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06" status: 200 len: 1265 microversion: 2.1 time: 0.086867 Oct 30 01:56:36.470666 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3272/6550] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:56:36 2022] GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06 => generated 1265 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:56:37.492218 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d6bd5d3b-7e79-488c-bb5c-de953452285c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:56:37.492988 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d6bd5d3b-7e79-488c-bb5c-de953452285c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7032c925-acf4-42e1-9e30-abf86d2b0c06] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:56:37.510247 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d6bd5d3b-7e79-488c-bb5c-de953452285c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:56:37.510247 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d6bd5d3b-7e79-488c-bb5c-de953452285c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:56:37.510247 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d6bd5d3b-7e79-488c-bb5c-de953452285c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:56:37.510247 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d6bd5d3b-7e79-488c-bb5c-de953452285c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:56:37.510247 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d6bd5d3b-7e79-488c-bb5c-de953452285c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:56:37.510247 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d6bd5d3b-7e79-488c-bb5c-de953452285c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:56:37.585204 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d6bd5d3b-7e79-488c-bb5c-de953452285c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:56:37.595818 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d6bd5d3b-7e79-488c-bb5c-de953452285c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06" status: 200 len: 1317 microversion: 2.1 time: 0.109537 Oct 30 01:56:37.596512 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3279/6551] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:56:37 2022] GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06 => generated 1317 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:56:38.622596 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4444334a-7ebe-4b08-ab7d-f9441f9bc54e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:56:38.623292 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4444334a-7ebe-4b08-ab7d-f9441f9bc54e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7032c925-acf4-42e1-9e30-abf86d2b0c06] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:56:38.632138 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4444334a-7ebe-4b08-ab7d-f9441f9bc54e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:56:38.632975 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4444334a-7ebe-4b08-ab7d-f9441f9bc54e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:56:38.633605 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4444334a-7ebe-4b08-ab7d-f9441f9bc54e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:56:38.634649 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4444334a-7ebe-4b08-ab7d-f9441f9bc54e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:56:38.635363 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4444334a-7ebe-4b08-ab7d-f9441f9bc54e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:56:38.636031 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4444334a-7ebe-4b08-ab7d-f9441f9bc54e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:56:38.906180 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4444334a-7ebe-4b08-ab7d-f9441f9bc54e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:56:38.915436 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4444334a-7ebe-4b08-ab7d-f9441f9bc54e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06" status: 200 len: 1323 microversion: 2.1 time: 0.298566 Oct 30 01:56:38.916823 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3273/6552] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:56:38 2022] GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06 => generated 1323 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:56:39.949403 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3f15bd6b-a65f-40f7-9c1d-5bb646b3fb21 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:56:39.969762 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3f15bd6b-a65f-40f7-9c1d-5bb646b3fb21 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7032c925-acf4-42e1-9e30-abf86d2b0c06] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:56:39.990189 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f15bd6b-a65f-40f7-9c1d-5bb646b3fb21 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:56:39.991246 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f15bd6b-a65f-40f7-9c1d-5bb646b3fb21 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:56:39.991901 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f15bd6b-a65f-40f7-9c1d-5bb646b3fb21 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:56:39.994892 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f15bd6b-a65f-40f7-9c1d-5bb646b3fb21 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:56:39.995359 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f15bd6b-a65f-40f7-9c1d-5bb646b3fb21 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:56:39.995849 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f15bd6b-a65f-40f7-9c1d-5bb646b3fb21 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:56:40.267936 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3f15bd6b-a65f-40f7-9c1d-5bb646b3fb21 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:56:40.279007 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3f15bd6b-a65f-40f7-9c1d-5bb646b3fb21 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06" status: 200 len: 1391 microversion: 2.1 time: 0.341550 Oct 30 01:56:40.280623 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3280/6553] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:56:39 2022] GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06 => generated 1391 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:56:40.446760 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-211be5a2-0ebf-4524-a6ba-cd97c40cbfe8 req-cc98fed0-5e62-4770-80b3-b6f5a9fcea91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7032c925-acf4-42e1-9e30-abf86d2b0c06", "tag": "484cb75b-2fe8-42b1-902b-24cba1a87ac5"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:56:40.467022 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:56:40.484861 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-211be5a2-0ebf-4524-a6ba-cd97c40cbfe8 req-cc98fed0-5e62-4770-80b3-b6f5a9fcea91 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:56:40.485580 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-211be5a2-0ebf-4524-a6ba-cd97c40cbfe8 req-cc98fed0-5e62-4770-80b3-b6f5a9fcea91 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:56:40.494106 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-211be5a2-0ebf-4524-a6ba-cd97c40cbfe8 req-cc98fed0-5e62-4770-80b3-b6f5a9fcea91 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:56:40.512502 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-211be5a2-0ebf-4524-a6ba-cd97c40cbfe8 req-cc98fed0-5e62-4770-80b3-b6f5a9fcea91 service nova] Creating event network-changed:484cb75b-2fe8-42b1-902b-24cba1a87ac5 for instance 7032c925-acf4-42e1-9e30-abf86d2b0c06 on n-h1-master-1 Oct 30 01:56:40.518189 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-211be5a2-0ebf-4524-a6ba-cd97c40cbfe8 req-cc98fed0-5e62-4770-80b3-b6f5a9fcea91 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088428 Oct 30 01:56:40.519665 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3274/6554] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:56:41.305499 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f3272d94-390e-4da6-8f6e-317c68052465 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:56:41.306741 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f3272d94-390e-4da6-8f6e-317c68052465 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7032c925-acf4-42e1-9e30-abf86d2b0c06] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:56:41.314354 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3272d94-390e-4da6-8f6e-317c68052465 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:56:41.315136 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3272d94-390e-4da6-8f6e-317c68052465 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:56:41.315672 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3272d94-390e-4da6-8f6e-317c68052465 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:56:41.316524 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3272d94-390e-4da6-8f6e-317c68052465 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:56:41.317090 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3272d94-390e-4da6-8f6e-317c68052465 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:56:41.317665 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3272d94-390e-4da6-8f6e-317c68052465 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:56:41.473508 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f3272d94-390e-4da6-8f6e-317c68052465 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:56:41.481773 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f3272d94-390e-4da6-8f6e-317c68052465 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06" status: 200 len: 1391 microversion: 2.1 time: 0.180529 Oct 30 01:56:41.482373 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3281/6555] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:56:41 2022] GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06 => generated 1391 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:56:42.504976 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-832e240d-fd90-4537-93b1-895e76f692aa tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:56:42.505975 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-832e240d-fd90-4537-93b1-895e76f692aa tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7032c925-acf4-42e1-9e30-abf86d2b0c06] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:56:42.519410 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-832e240d-fd90-4537-93b1-895e76f692aa tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:56:42.519888 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-832e240d-fd90-4537-93b1-895e76f692aa tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:56:42.520363 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-832e240d-fd90-4537-93b1-895e76f692aa tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:56:42.521592 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-832e240d-fd90-4537-93b1-895e76f692aa tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:56:42.521592 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-832e240d-fd90-4537-93b1-895e76f692aa tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:56:42.528219 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-832e240d-fd90-4537-93b1-895e76f692aa tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:56:42.703337 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-832e240d-fd90-4537-93b1-895e76f692aa tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:56:42.717659 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-832e240d-fd90-4537-93b1-895e76f692aa tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06" status: 200 len: 1391 microversion: 2.1 time: 0.217074 Oct 30 01:56:42.718607 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3275/6556] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:56:42 2022] GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06 => generated 1391 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:56:43.741543 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-10e7d41c-f89a-4921-ab83-b50b46ca072d tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:56:43.743001 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-10e7d41c-f89a-4921-ab83-b50b46ca072d tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7032c925-acf4-42e1-9e30-abf86d2b0c06] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:56:43.761587 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-10e7d41c-f89a-4921-ab83-b50b46ca072d tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:56:43.762503 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-10e7d41c-f89a-4921-ab83-b50b46ca072d tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:56:43.763221 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-10e7d41c-f89a-4921-ab83-b50b46ca072d tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:56:43.764657 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-10e7d41c-f89a-4921-ab83-b50b46ca072d tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:56:43.765366 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-10e7d41c-f89a-4921-ab83-b50b46ca072d tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:56:43.766005 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-10e7d41c-f89a-4921-ab83-b50b46ca072d tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:56:43.934141 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-10e7d41c-f89a-4921-ab83-b50b46ca072d tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:56:43.941998 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-10e7d41c-f89a-4921-ab83-b50b46ca072d tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06" status: 200 len: 1391 microversion: 2.1 time: 0.205804 Oct 30 01:56:43.942574 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3282/6557] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:56:43 2022] GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06 => generated 1391 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:56:44.964028 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fccddd04-2420-4e8b-a615-9a36243eeeb1 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:56:44.973350 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-2efbd3ee-66e7-4a2d-9643-712cb86dceb8 req-5aeaf357-efc2-4f43-885f-c8b327117258 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7032c925-acf4-42e1-9e30-abf86d2b0c06", "name": "network-vif-plugged", "status": "completed", "tag": "484cb75b-2fe8-42b1-902b-24cba1a87ac5"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:56:44.981141 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fccddd04-2420-4e8b-a615-9a36243eeeb1 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7032c925-acf4-42e1-9e30-abf86d2b0c06] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:56:44.989431 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fccddd04-2420-4e8b-a615-9a36243eeeb1 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:56:44.990005 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fccddd04-2420-4e8b-a615-9a36243eeeb1 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:56:44.991282 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fccddd04-2420-4e8b-a615-9a36243eeeb1 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:56:44.992068 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fccddd04-2420-4e8b-a615-9a36243eeeb1 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:56:44.992657 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fccddd04-2420-4e8b-a615-9a36243eeeb1 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:56:44.993093 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fccddd04-2420-4e8b-a615-9a36243eeeb1 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:56:44.996945 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-2efbd3ee-66e7-4a2d-9643-712cb86dceb8 req-5aeaf357-efc2-4f43-885f-c8b327117258 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:56:44.997462 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-2efbd3ee-66e7-4a2d-9643-712cb86dceb8 req-5aeaf357-efc2-4f43-885f-c8b327117258 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:56:45.001007 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-2efbd3ee-66e7-4a2d-9643-712cb86dceb8 req-5aeaf357-efc2-4f43-885f-c8b327117258 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:56:45.015069 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-2efbd3ee-66e7-4a2d-9643-712cb86dceb8 req-5aeaf357-efc2-4f43-885f-c8b327117258 service nova] Creating event network-vif-plugged:484cb75b-2fe8-42b1-902b-24cba1a87ac5 for instance 7032c925-acf4-42e1-9e30-abf86d2b0c06 on n-h1-master-1 Oct 30 01:56:45.021731 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-2efbd3ee-66e7-4a2d-9643-712cb86dceb8 req-5aeaf357-efc2-4f43-885f-c8b327117258 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.277564 Oct 30 01:56:45.022699 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3276/6558] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:56:45.188913 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-fccddd04-2420-4e8b-a615-9a36243eeeb1 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:56:45.197866 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fccddd04-2420-4e8b-a615-9a36243eeeb1 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06" status: 200 len: 1391 microversion: 2.1 time: 0.237516 Oct 30 01:56:45.198446 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3283/6559] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:56:44 2022] GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06 => generated 1391 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:56:46.218935 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:56:46.224270 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-20b8f8aa-0a62-46ec-9ac1-8619f834cb6a tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:56:46.225208 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-20b8f8aa-0a62-46ec-9ac1-8619f834cb6a tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7032c925-acf4-42e1-9e30-abf86d2b0c06] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:56:46.232259 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-20b8f8aa-0a62-46ec-9ac1-8619f834cb6a tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:56:46.233211 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-20b8f8aa-0a62-46ec-9ac1-8619f834cb6a tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:56:46.234858 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-20b8f8aa-0a62-46ec-9ac1-8619f834cb6a tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:56:46.239665 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-20b8f8aa-0a62-46ec-9ac1-8619f834cb6a tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:56:46.239665 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-20b8f8aa-0a62-46ec-9ac1-8619f834cb6a tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:56:46.239665 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-20b8f8aa-0a62-46ec-9ac1-8619f834cb6a tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:56:46.401298 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-20b8f8aa-0a62-46ec-9ac1-8619f834cb6a tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:56:46.410647 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-20b8f8aa-0a62-46ec-9ac1-8619f834cb6a tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06" status: 200 len: 1391 microversion: 2.1 time: 0.192628 Oct 30 01:56:46.411265 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3277/6560] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:56:46 2022] GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06 => generated 1391 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:56:47.433568 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c6cbd941-de94-4359-a532-4aa29f9b2b02 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:56:47.434213 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c6cbd941-de94-4359-a532-4aa29f9b2b02 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7032c925-acf4-42e1-9e30-abf86d2b0c06] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:56:47.440915 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c6cbd941-de94-4359-a532-4aa29f9b2b02 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:56:47.441421 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c6cbd941-de94-4359-a532-4aa29f9b2b02 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:56:47.441857 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c6cbd941-de94-4359-a532-4aa29f9b2b02 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:56:47.442542 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c6cbd941-de94-4359-a532-4aa29f9b2b02 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:56:47.442991 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c6cbd941-de94-4359-a532-4aa29f9b2b02 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:56:47.443904 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c6cbd941-de94-4359-a532-4aa29f9b2b02 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:56:47.502067 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:56:47.580092 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c6cbd941-de94-4359-a532-4aa29f9b2b02 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:56:47.588538 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c6cbd941-de94-4359-a532-4aa29f9b2b02 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06" status: 200 len: 1563 microversion: 2.1 time: 0.159045 Oct 30 01:56:47.589107 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3284/6561] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:56:47 2022] GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06 => generated 1563 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:56:47.613530 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ea016f91-2e6b-44e3-adb1-1fe6302adbf2 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:56:47.614145 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ea016f91-2e6b-44e3-adb1-1fe6302adbf2 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7032c925-acf4-42e1-9e30-abf86d2b0c06] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:56:47.616219 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=8 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:56:47.625203 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ea016f91-2e6b-44e3-adb1-1fe6302adbf2 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:56:47.625745 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ea016f91-2e6b-44e3-adb1-1fe6302adbf2 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:56:47.626198 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ea016f91-2e6b-44e3-adb1-1fe6302adbf2 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:56:47.627073 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ea016f91-2e6b-44e3-adb1-1fe6302adbf2 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:56:47.627657 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ea016f91-2e6b-44e3-adb1-1fe6302adbf2 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:56:47.628146 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ea016f91-2e6b-44e3-adb1-1fe6302adbf2 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:56:47.764371 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ea016f91-2e6b-44e3-adb1-1fe6302adbf2 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:56:47.772773 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ea016f91-2e6b-44e3-adb1-1fe6302adbf2 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06" status: 200 len: 1563 microversion: 2.1 time: 0.164333 Oct 30 01:56:47.773356 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3278/6562] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:56:47 2022] GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06 => generated 1563 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:56:49.848090 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a22bc907-bb85-42bf-bbcc-6e7c72e54428 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:56:49.848706 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a22bc907-bb85-42bf-bbcc-6e7c72e54428 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7032c925-acf4-42e1-9e30-abf86d2b0c06] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:56:49.852053 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-1a1b3658-027b-4cef-8026-f166cec0c279 req-d4e90cd6-1613-4b9a-9d58-25d7cda3b9fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7032c925-acf4-42e1-9e30-abf86d2b0c06", "tag": "484cb75b-2fe8-42b1-902b-24cba1a87ac5"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:56:49.856753 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a22bc907-bb85-42bf-bbcc-6e7c72e54428 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:56:49.857239 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a22bc907-bb85-42bf-bbcc-6e7c72e54428 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:56:49.857697 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a22bc907-bb85-42bf-bbcc-6e7c72e54428 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:56:49.858391 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a22bc907-bb85-42bf-bbcc-6e7c72e54428 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:56:49.858838 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a22bc907-bb85-42bf-bbcc-6e7c72e54428 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:56:49.859256 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a22bc907-bb85-42bf-bbcc-6e7c72e54428 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:56:49.868892 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-1a1b3658-027b-4cef-8026-f166cec0c279 req-d4e90cd6-1613-4b9a-9d58-25d7cda3b9fb service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:56:49.878036 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-1a1b3658-027b-4cef-8026-f166cec0c279 req-d4e90cd6-1613-4b9a-9d58-25d7cda3b9fb service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:56:49.878036 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-1a1b3658-027b-4cef-8026-f166cec0c279 req-d4e90cd6-1613-4b9a-9d58-25d7cda3b9fb service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:56:49.900252 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-1a1b3658-027b-4cef-8026-f166cec0c279 req-d4e90cd6-1613-4b9a-9d58-25d7cda3b9fb service nova] Creating event network-changed:484cb75b-2fe8-42b1-902b-24cba1a87ac5 for instance 7032c925-acf4-42e1-9e30-abf86d2b0c06 on n-h1-master-1 Oct 30 01:56:49.905647 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-1a1b3658-027b-4cef-8026-f166cec0c279 req-d4e90cd6-1613-4b9a-9d58-25d7cda3b9fb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058850 Oct 30 01:56:49.907557 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3279/6563] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:56:50.068505 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a22bc907-bb85-42bf-bbcc-6e7c72e54428 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:56:50.108724 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a22bc907-bb85-42bf-bbcc-6e7c72e54428 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06" status: 200 len: 1563 microversion: 2.1 time: 0.255558 Oct 30 01:56:50.109999 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3285/6564] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:56:49 2022] GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06 => generated 1563 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:57:11.435457 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=11 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:57:11.436229 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=32 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:57:11.548245 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0c924781-5f4b-4264-a97a-6a8d3266b0d1 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:57:11.550391 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0c924781-5f4b-4264-a97a-6a8d3266b0d1 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7032c925-acf4-42e1-9e30-abf86d2b0c06] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:57:11.557424 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c924781-5f4b-4264-a97a-6a8d3266b0d1 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:11.557830 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c924781-5f4b-4264-a97a-6a8d3266b0d1 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:11.558262 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c924781-5f4b-4264-a97a-6a8d3266b0d1 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:11.559040 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c924781-5f4b-4264-a97a-6a8d3266b0d1 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:11.559494 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c924781-5f4b-4264-a97a-6a8d3266b0d1 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:11.559916 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c924781-5f4b-4264-a97a-6a8d3266b0d1 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:11.629703 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0c924781-5f4b-4264-a97a-6a8d3266b0d1 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "POST /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06/action" status: 200 len: 24565 microversion: 2.1 time: 0.196021 Oct 30 01:57:11.630501 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3280/6565] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:57:11 2022] POST /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06/action => generated 24565 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 30 01:57:18.054723 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-53899cd2-7dd7-4ddb-836c-8bec065df3e9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:57:18.055308 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-53899cd2-7dd7-4ddb-836c-8bec065df3e9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7032c925-acf4-42e1-9e30-abf86d2b0c06] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:57:18.058099 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=18 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:57:18.058816 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=42 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:57:18.064279 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53899cd2-7dd7-4ddb-836c-8bec065df3e9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:18.064755 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53899cd2-7dd7-4ddb-836c-8bec065df3e9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:18.065259 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53899cd2-7dd7-4ddb-836c-8bec065df3e9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:18.065974 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53899cd2-7dd7-4ddb-836c-8bec065df3e9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:18.066424 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53899cd2-7dd7-4ddb-836c-8bec065df3e9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:18.066844 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53899cd2-7dd7-4ddb-836c-8bec065df3e9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:18.213289 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-53899cd2-7dd7-4ddb-836c-8bec065df3e9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:57:18.221961 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-53899cd2-7dd7-4ddb-836c-8bec065df3e9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06" status: 200 len: 1682 microversion: 2.1 time: 0.171218 Oct 30 01:57:18.223196 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3286/6566] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:57:18 2022] GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06 => generated 1682 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:57:18.340729 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-13c904cf-a3da-4548-bc6c-22a2d4395686 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:57:18.343144 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-13c904cf-a3da-4548-bc6c-22a2d4395686 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7032c925-acf4-42e1-9e30-abf86d2b0c06] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:57:18.351015 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-13c904cf-a3da-4548-bc6c-22a2d4395686 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:18.353672 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-13c904cf-a3da-4548-bc6c-22a2d4395686 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:18.353672 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-13c904cf-a3da-4548-bc6c-22a2d4395686 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:18.353672 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-13c904cf-a3da-4548-bc6c-22a2d4395686 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:18.353672 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-13c904cf-a3da-4548-bc6c-22a2d4395686 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:18.354069 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-13c904cf-a3da-4548-bc6c-22a2d4395686 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:18.437479 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-13c904cf-a3da-4548-bc6c-22a2d4395686 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "POST /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06/action" status: 200 len: 32638 microversion: 2.1 time: 0.101202 Oct 30 01:57:18.444534 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3281/6567] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:57:18 2022] POST /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06/action => generated 32638 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:57:18.736183 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-61550122-fb07-421b-99fd-2de42e54ccd1 tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:57:18.739239 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-61550122-fb07-421b-99fd-2de42e54ccd1 tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] [instance: 7032c925-acf4-42e1-9e30-abf86d2b0c06] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:57:18.743016 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-61550122-fb07-421b-99fd-2de42e54ccd1 tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:18.743502 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-61550122-fb07-421b-99fd-2de42e54ccd1 tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:18.743938 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-61550122-fb07-421b-99fd-2de42e54ccd1 tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:18.744628 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-61550122-fb07-421b-99fd-2de42e54ccd1 tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:18.745078 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-61550122-fb07-421b-99fd-2de42e54ccd1 tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:18.745536 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-61550122-fb07-421b-99fd-2de42e54ccd1 tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:18.876699 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-61550122-fb07-421b-99fd-2de42e54ccd1 tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06" status: 200 len: 1833 microversion: 2.1 time: 0.267064 Oct 30 01:57:18.877312 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3287/6568] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:57:18 2022] GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06 => generated 1833 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:57:18.909615 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4ce2f89f-b6f1-4221-a2bf-4c0cd224ea54 tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:57:18.912158 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4ce2f89f-b6f1-4221-a2bf-4c0cd224ea54 tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] [instance: 7032c925-acf4-42e1-9e30-abf86d2b0c06] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:57:18.919243 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4ce2f89f-b6f1-4221-a2bf-4c0cd224ea54 tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:18.919730 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4ce2f89f-b6f1-4221-a2bf-4c0cd224ea54 tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:18.920169 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4ce2f89f-b6f1-4221-a2bf-4c0cd224ea54 tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:18.920863 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4ce2f89f-b6f1-4221-a2bf-4c0cd224ea54 tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:18.921324 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4ce2f89f-b6f1-4221-a2bf-4c0cd224ea54 tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:18.921847 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4ce2f89f-b6f1-4221-a2bf-4c0cd224ea54 tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:18.947478 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-4ce2f89f-b6f1-4221-a2bf-4c0cd224ea54 tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Lazy-loading 'flavor' on Instance uuid 7032c925-acf4-42e1-9e30-abf86d2b0c06 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:57:18.959977 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4ce2f89f-b6f1-4221-a2bf-4c0cd224ea54 tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] [instance: 7032c925-acf4-42e1-9e30-abf86d2b0c06] Going to try to live migrate instance to another host {{(pid=121103) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 30 01:57:19.412137 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c101d77d-deb2-43d9-a4b1-8b65007972ad tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:57:19.415855 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c101d77d-deb2-43d9-a4b1-8b65007972ad tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] [instance: 58aeb565-c0d0-49b0-854b-22766f508507] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:57:19.430639 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c101d77d-deb2-43d9-a4b1-8b65007972ad tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:19.431668 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c101d77d-deb2-43d9-a4b1-8b65007972ad tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:19.432165 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c101d77d-deb2-43d9-a4b1-8b65007972ad tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:19.432875 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c101d77d-deb2-43d9-a4b1-8b65007972ad tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:19.433329 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c101d77d-deb2-43d9-a4b1-8b65007972ad tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:19.434019 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c101d77d-deb2-43d9-a4b1-8b65007972ad tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:19.548431 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-c101d77d-deb2-43d9-a4b1-8b65007972ad tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lazy-loading 'services' on Instance uuid 58aeb565-c0d0-49b0-854b-22766f508507 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:57:19.781492 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c101d77d-deb2-43d9-a4b1-8b65007972ad tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] 10.222.0.13 "DELETE /compute/v2.1/servers/58aeb565-c0d0-49b0-854b-22766f508507/os-volume_attachments/11e50be2-4387-42cf-8bf6-de301c3d7584" status: 202 len: 0 microversion: 2.1 time: 0.373014 Oct 30 01:57:19.784590 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3288/6569] 10.222.0.13 () {58 vars in 1416 bytes} [Sun Oct 30 01:57:19 2022] DELETE /compute/v2.1/servers/58aeb565-c0d0-49b0-854b-22766f508507/os-volume_attachments/11e50be2-4387-42cf-8bf6-de301c3d7584 => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:57:21.631212 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4ce2f89f-b6f1-4221-a2bf-4c0cd224ea54 tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06/action" status: 202 len: 0 microversion: 2.1 time: 2.725819 Oct 30 01:57:21.631914 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3282/6570] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:57:18 2022] POST /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06/action => generated 0 bytes in 2727 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:57:21.641297 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a6e34a61-0b01-4b8f-96b2-2061c5e2d1d9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:57:21.642028 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a6e34a61-0b01-4b8f-96b2-2061c5e2d1d9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7032c925-acf4-42e1-9e30-abf86d2b0c06] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:57:21.649543 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a6e34a61-0b01-4b8f-96b2-2061c5e2d1d9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:21.650555 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a6e34a61-0b01-4b8f-96b2-2061c5e2d1d9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:21.650988 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a6e34a61-0b01-4b8f-96b2-2061c5e2d1d9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:21.651779 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a6e34a61-0b01-4b8f-96b2-2061c5e2d1d9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:21.652327 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a6e34a61-0b01-4b8f-96b2-2061c5e2d1d9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:21.652641 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a6e34a61-0b01-4b8f-96b2-2061c5e2d1d9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:21.806429 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a6e34a61-0b01-4b8f-96b2-2061c5e2d1d9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:57:21.815052 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a6e34a61-0b01-4b8f-96b2-2061c5e2d1d9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06" status: 200 len: 1692 microversion: 2.1 time: 0.177983 Oct 30 01:57:21.815632 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3289/6571] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:57:21 2022] GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06 => generated 1692 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:57:22.840678 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-26188d38-1706-44f6-a203-1472e8803fea tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:57:22.842146 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-26188d38-1706-44f6-a203-1472e8803fea tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7032c925-acf4-42e1-9e30-abf86d2b0c06] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:57:22.850784 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-26188d38-1706-44f6-a203-1472e8803fea tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:22.851748 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-26188d38-1706-44f6-a203-1472e8803fea tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:22.853373 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-26188d38-1706-44f6-a203-1472e8803fea tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:22.854620 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-26188d38-1706-44f6-a203-1472e8803fea tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:22.855306 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-26188d38-1706-44f6-a203-1472e8803fea tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:22.855902 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-26188d38-1706-44f6-a203-1472e8803fea tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:23.020344 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-26188d38-1706-44f6-a203-1472e8803fea tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:57:23.031593 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-26188d38-1706-44f6-a203-1472e8803fea tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06" status: 200 len: 1692 microversion: 2.1 time: 0.195167 Oct 30 01:57:23.032982 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3283/6572] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:57:22 2022] GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06 => generated 1692 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:57:23.206575 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-245695a6-8744-4fc7-8ff1-d6baee566564 req-9ea58e14-c3a4-4279-8fc4-73aed9fe7c30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7032c925-acf4-42e1-9e30-abf86d2b0c06", "name": "network-vif-unplugged", "status": "completed", "tag": "484cb75b-2fe8-42b1-902b-24cba1a87ac5"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:57:23.228520 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-245695a6-8744-4fc7-8ff1-d6baee566564 req-9ea58e14-c3a4-4279-8fc4-73aed9fe7c30 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:23.229276 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-245695a6-8744-4fc7-8ff1-d6baee566564 req-9ea58e14-c3a4-4279-8fc4-73aed9fe7c30 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:23.229732 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-245695a6-8744-4fc7-8ff1-d6baee566564 req-9ea58e14-c3a4-4279-8fc4-73aed9fe7c30 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:23.242633 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-245695a6-8744-4fc7-8ff1-d6baee566564 req-9ea58e14-c3a4-4279-8fc4-73aed9fe7c30 service nova] Creating event network-vif-unplugged:484cb75b-2fe8-42b1-902b-24cba1a87ac5 for instance 7032c925-acf4-42e1-9e30-abf86d2b0c06 on n-h1-master-1 Oct 30 01:57:23.248324 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-245695a6-8744-4fc7-8ff1-d6baee566564 req-9ea58e14-c3a4-4279-8fc4-73aed9fe7c30 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.117070 Oct 30 01:57:23.249137 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3290/6573] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:57:24.056366 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-06b66309-e584-421c-8105-8447fd920c45 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:57:24.057578 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-06b66309-e584-421c-8105-8447fd920c45 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7032c925-acf4-42e1-9e30-abf86d2b0c06] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:57:24.072955 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-06b66309-e584-421c-8105-8447fd920c45 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:24.073718 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-06b66309-e584-421c-8105-8447fd920c45 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:24.074162 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-06b66309-e584-421c-8105-8447fd920c45 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:24.074872 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-06b66309-e584-421c-8105-8447fd920c45 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:24.075326 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-06b66309-e584-421c-8105-8447fd920c45 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:24.075754 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-06b66309-e584-421c-8105-8447fd920c45 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:24.246767 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-06b66309-e584-421c-8105-8447fd920c45 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:57:24.255437 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-06b66309-e584-421c-8105-8447fd920c45 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06" status: 200 len: 1692 microversion: 2.1 time: 0.203302 Oct 30 01:57:24.256026 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3284/6574] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:57:24 2022] GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06 => generated 1692 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:57:25.238819 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c0be1f69-c459-47fd-955a-df004a5cb3d2 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:57:25.239491 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c0be1f69-c459-47fd-955a-df004a5cb3d2 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] [instance: 58aeb565-c0d0-49b0-854b-22766f508507] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:57:25.246681 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c0be1f69-c459-47fd-955a-df004a5cb3d2 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:25.247165 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c0be1f69-c459-47fd-955a-df004a5cb3d2 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:25.247921 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c0be1f69-c459-47fd-955a-df004a5cb3d2 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:25.248628 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c0be1f69-c459-47fd-955a-df004a5cb3d2 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:25.249083 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c0be1f69-c459-47fd-955a-df004a5cb3d2 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:25.249540 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c0be1f69-c459-47fd-955a-df004a5cb3d2 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:25.275148 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c0be1f69-c459-47fd-955a-df004a5cb3d2 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] [instance: 58aeb565-c0d0-49b0-854b-22766f508507] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:57:25.279130 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6f3c3172-6c75-4e93-beb6-0755d09140a6 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:57:25.280037 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6f3c3172-6c75-4e93-beb6-0755d09140a6 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7032c925-acf4-42e1-9e30-abf86d2b0c06] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:57:25.288556 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f3c3172-6c75-4e93-beb6-0755d09140a6 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:25.289053 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f3c3172-6c75-4e93-beb6-0755d09140a6 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:25.289650 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f3c3172-6c75-4e93-beb6-0755d09140a6 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:25.290868 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f3c3172-6c75-4e93-beb6-0755d09140a6 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:25.291332 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f3c3172-6c75-4e93-beb6-0755d09140a6 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:25.291766 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f3c3172-6c75-4e93-beb6-0755d09140a6 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:25.424147 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6f3c3172-6c75-4e93-beb6-0755d09140a6 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:57:25.432606 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6f3c3172-6c75-4e93-beb6-0755d09140a6 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06" status: 200 len: 1692 microversion: 2.1 time: 0.157664 Oct 30 01:57:25.433175 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3285/6575] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:57:25 2022] GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06 => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:57:25.437743 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-4e0bffe1-dead-48b2-8d54-0de7cd7cb811 req-5fda200b-7e07-4a95-a577-afe8aa564352 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7032c925-acf4-42e1-9e30-abf86d2b0c06", "tag": "484cb75b-2fe8-42b1-902b-24cba1a87ac5"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:57:25.447497 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-4e0bffe1-dead-48b2-8d54-0de7cd7cb811 req-5fda200b-7e07-4a95-a577-afe8aa564352 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:25.447969 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-4e0bffe1-dead-48b2-8d54-0de7cd7cb811 req-5fda200b-7e07-4a95-a577-afe8aa564352 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:25.448394 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-4e0bffe1-dead-48b2-8d54-0de7cd7cb811 req-5fda200b-7e07-4a95-a577-afe8aa564352 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:25.462441 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-4e0bffe1-dead-48b2-8d54-0de7cd7cb811 req-5fda200b-7e07-4a95-a577-afe8aa564352 service nova] Creating event network-changed:484cb75b-2fe8-42b1-902b-24cba1a87ac5 for instance 7032c925-acf4-42e1-9e30-abf86d2b0c06 on n-h1-master-1 Oct 30 01:57:25.467500 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-4e0bffe1-dead-48b2-8d54-0de7cd7cb811 req-5fda200b-7e07-4a95-a577-afe8aa564352 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033209 Oct 30 01:57:25.468115 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3286/6576] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:57:25.581497 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c0be1f69-c459-47fd-955a-df004a5cb3d2 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] 10.222.0.13 "DELETE /compute/v2.1/servers/58aeb565-c0d0-49b0-854b-22766f508507" status: 204 len: 0 microversion: 2.1 time: 0.338963 Oct 30 01:57:25.582288 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3291/6577] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:57:25 2022] DELETE /compute/v2.1/servers/58aeb565-c0d0-49b0-854b-22766f508507 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:57:25.591317 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fe4597f7-e62a-4106-8afa-787ed5606531 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:57:25.592038 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-fe4597f7-e62a-4106-8afa-787ed5606531 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] [instance: 58aeb565-c0d0-49b0-854b-22766f508507] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:57:25.598342 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe4597f7-e62a-4106-8afa-787ed5606531 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:25.599632 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe4597f7-e62a-4106-8afa-787ed5606531 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:25.599632 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe4597f7-e62a-4106-8afa-787ed5606531 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:25.599965 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe4597f7-e62a-4106-8afa-787ed5606531 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:25.600420 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe4597f7-e62a-4106-8afa-787ed5606531 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:25.600847 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe4597f7-e62a-4106-8afa-787ed5606531 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:26.391361 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-fe4597f7-e62a-4106-8afa-787ed5606531 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7348b82c87cf428dad89bc4fbb6ac1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '384d691c08fa4a48b57896d89f252526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:57:26.399301 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fe4597f7-e62a-4106-8afa-787ed5606531 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] 10.222.0.13 "GET /compute/v2.1/servers/58aeb565-c0d0-49b0-854b-22766f508507" status: 200 len: 1470 microversion: 2.1 time: 0.812525 Oct 30 01:57:26.400421 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3287/6578] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:57:25 2022] GET /compute/v2.1/servers/58aeb565-c0d0-49b0-854b-22766f508507 => generated 1470 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:57:26.456848 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-05ddd426-3274-42c1-a817-db9e9644f181 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:57:26.457633 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-05ddd426-3274-42c1-a817-db9e9644f181 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7032c925-acf4-42e1-9e30-abf86d2b0c06] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:57:26.464563 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-05ddd426-3274-42c1-a817-db9e9644f181 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:26.465045 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-05ddd426-3274-42c1-a817-db9e9644f181 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:26.465754 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-05ddd426-3274-42c1-a817-db9e9644f181 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:26.466467 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-05ddd426-3274-42c1-a817-db9e9644f181 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:26.466914 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-05ddd426-3274-42c1-a817-db9e9644f181 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:26.467331 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-05ddd426-3274-42c1-a817-db9e9644f181 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:26.606972 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-05ddd426-3274-42c1-a817-db9e9644f181 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:57:26.615098 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-05ddd426-3274-42c1-a817-db9e9644f181 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06" status: 200 len: 1692 microversion: 2.1 time: 0.162632 Oct 30 01:57:26.615678 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3292/6579] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:57:26 2022] GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06 => generated 1692 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:57:27.423576 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-77b3af0e-447e-4ac0-af06-1264333dfe91 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:57:27.425017 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-77b3af0e-447e-4ac0-af06-1264333dfe91 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] [instance: 58aeb565-c0d0-49b0-854b-22766f508507] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:57:27.433723 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-77b3af0e-447e-4ac0-af06-1264333dfe91 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:27.434530 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-77b3af0e-447e-4ac0-af06-1264333dfe91 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:27.435263 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-77b3af0e-447e-4ac0-af06-1264333dfe91 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:27.436385 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-77b3af0e-447e-4ac0-af06-1264333dfe91 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:27.436836 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-77b3af0e-447e-4ac0-af06-1264333dfe91 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:27.437565 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-77b3af0e-447e-4ac0-af06-1264333dfe91 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:27.579385 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-77b3af0e-447e-4ac0-af06-1264333dfe91 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7348b82c87cf428dad89bc4fbb6ac1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '384d691c08fa4a48b57896d89f252526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:57:27.588243 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-77b3af0e-447e-4ac0-af06-1264333dfe91 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] 10.222.0.13 "GET /compute/v2.1/servers/58aeb565-c0d0-49b0-854b-22766f508507" status: 200 len: 1470 microversion: 2.1 time: 0.168848 Oct 30 01:57:27.588821 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3288/6580] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:57:27 2022] GET /compute/v2.1/servers/58aeb565-c0d0-49b0-854b-22766f508507 => generated 1470 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:57:27.638688 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-80488ddb-92b0-4ee5-8be5-a0d72e9605a3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:57:27.639306 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-80488ddb-92b0-4ee5-8be5-a0d72e9605a3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7032c925-acf4-42e1-9e30-abf86d2b0c06] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:57:27.646379 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-80488ddb-92b0-4ee5-8be5-a0d72e9605a3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:27.646867 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-80488ddb-92b0-4ee5-8be5-a0d72e9605a3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:27.647304 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-80488ddb-92b0-4ee5-8be5-a0d72e9605a3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:27.647999 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-80488ddb-92b0-4ee5-8be5-a0d72e9605a3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:27.648450 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-80488ddb-92b0-4ee5-8be5-a0d72e9605a3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:27.648870 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-80488ddb-92b0-4ee5-8be5-a0d72e9605a3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:27.812004 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-80488ddb-92b0-4ee5-8be5-a0d72e9605a3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:57:27.831453 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-80488ddb-92b0-4ee5-8be5-a0d72e9605a3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06" status: 200 len: 1692 microversion: 2.1 time: 0.196791 Oct 30 01:57:27.839117 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3293/6581] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:57:27 2022] GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06 => generated 1692 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:57:27.905645 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-aa79e7a8-216f-419c-81df-a4de51135f4a req-f9ecce0b-a5b0-4dc9-b54b-e37c70e87552 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58aeb565-c0d0-49b0-854b-22766f508507", "name": "network-vif-deleted", "tag": "9f168a7a-39fb-40a3-b4db-dd52a40463e6"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:57:27.915613 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-aa79e7a8-216f-419c-81df-a4de51135f4a req-f9ecce0b-a5b0-4dc9-b54b-e37c70e87552 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:27.916099 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-aa79e7a8-216f-419c-81df-a4de51135f4a req-f9ecce0b-a5b0-4dc9-b54b-e37c70e87552 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:27.916654 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-aa79e7a8-216f-419c-81df-a4de51135f4a req-f9ecce0b-a5b0-4dc9-b54b-e37c70e87552 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:27.927620 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-aa79e7a8-216f-419c-81df-a4de51135f4a req-f9ecce0b-a5b0-4dc9-b54b-e37c70e87552 service nova] Creating event network-vif-deleted:9f168a7a-39fb-40a3-b4db-dd52a40463e6 for instance 58aeb565-c0d0-49b0-854b-22766f508507 on n-h2-master-1 Oct 30 01:57:27.932594 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-aa79e7a8-216f-419c-81df-a4de51135f4a req-f9ecce0b-a5b0-4dc9-b54b-e37c70e87552 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030761 Oct 30 01:57:27.933158 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3289/6582] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:57:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:57:28.612300 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-44742d0b-62b3-44aa-a50a-7bab4e2d46a5 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:57:28.612916 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-44742d0b-62b3-44aa-a50a-7bab4e2d46a5 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] [instance: 58aeb565-c0d0-49b0-854b-22766f508507] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:57:28.619265 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44742d0b-62b3-44aa-a50a-7bab4e2d46a5 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:28.619745 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44742d0b-62b3-44aa-a50a-7bab4e2d46a5 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:28.620173 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44742d0b-62b3-44aa-a50a-7bab4e2d46a5 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:28.620866 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44742d0b-62b3-44aa-a50a-7bab4e2d46a5 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:28.621318 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44742d0b-62b3-44aa-a50a-7bab4e2d46a5 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:28.621761 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44742d0b-62b3-44aa-a50a-7bab4e2d46a5 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:28.660610 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44742d0b-62b3-44aa-a50a-7bab4e2d46a5 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:28.661269 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44742d0b-62b3-44aa-a50a-7bab4e2d46a5 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:28.662017 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44742d0b-62b3-44aa-a50a-7bab4e2d46a5 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:28.662475 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-44742d0b-62b3-44aa-a50a-7bab4e2d46a5 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lazy-loading 'fault' on Instance uuid 58aeb565-c0d0-49b0-854b-22766f508507 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:57:28.708980 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-44742d0b-62b3-44aa-a50a-7bab4e2d46a5 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7348b82c87cf428dad89bc4fbb6ac1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '384d691c08fa4a48b57896d89f252526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:57:28.717194 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-44742d0b-62b3-44aa-a50a-7bab4e2d46a5 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] 10.222.0.13 "GET /compute/v2.1/servers/58aeb565-c0d0-49b0-854b-22766f508507" status: 200 len: 1304 microversion: 2.1 time: 0.108824 Oct 30 01:57:28.718127 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3294/6583] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:57:28 2022] GET /compute/v2.1/servers/58aeb565-c0d0-49b0-854b-22766f508507 => generated 1304 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:57:28.858450 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-196a7a3e-60c7-41a1-989b-80f39307837d tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:57:28.859171 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-196a7a3e-60c7-41a1-989b-80f39307837d tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7032c925-acf4-42e1-9e30-abf86d2b0c06] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:57:28.866076 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-196a7a3e-60c7-41a1-989b-80f39307837d tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:28.866575 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-196a7a3e-60c7-41a1-989b-80f39307837d tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:28.867021 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-196a7a3e-60c7-41a1-989b-80f39307837d tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:28.867734 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-196a7a3e-60c7-41a1-989b-80f39307837d tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:28.868846 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-196a7a3e-60c7-41a1-989b-80f39307837d tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:28.869689 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-196a7a3e-60c7-41a1-989b-80f39307837d tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:29.015313 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-196a7a3e-60c7-41a1-989b-80f39307837d tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:57:29.023489 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-196a7a3e-60c7-41a1-989b-80f39307837d tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06" status: 200 len: 1692 microversion: 2.1 time: 0.170550 Oct 30 01:57:29.024902 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3290/6584] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:57:28 2022] GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06 => generated 1692 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:57:29.741030 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0e968116-5874-4503-ace4-0c2a31d6d193 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:57:29.741617 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0e968116-5874-4503-ace4-0c2a31d6d193 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] [instance: 58aeb565-c0d0-49b0-854b-22766f508507] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:57:29.749019 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e968116-5874-4503-ace4-0c2a31d6d193 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:29.749713 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e968116-5874-4503-ace4-0c2a31d6d193 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:29.750192 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e968116-5874-4503-ace4-0c2a31d6d193 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:29.752122 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e968116-5874-4503-ace4-0c2a31d6d193 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:29.752580 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e968116-5874-4503-ace4-0c2a31d6d193 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:29.753007 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e968116-5874-4503-ace4-0c2a31d6d193 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:29.770408 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-0e968116-5874-4503-ace4-0c2a31d6d193 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] HTTP exception thrown: Instance 58aeb565-c0d0-49b0-854b-22766f508507 could not be found. Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0e968116-5874-4503-ace4-0c2a31d6d193 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Request method failure captured: Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/58aeb565-c0d0-49b0-854b-22766f508507 HTTP/1.1 Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdmFXdMCwEm9Z7cZn6BW6a1DibCQPJM1leqnKc8OyV8G6zsViqzxdwqXI_zqD0WgB_g95LBMSwNhr1N2hSeGqY5WH-2z9Dk56KYVk3tFOZ_-WFxnp7-Bu75bnvi_AiKlJVOSmH1iCLD3CKVW1dnQm2xNcTN8thSzQ5NXkbDJOL8FIUM Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 384d691c08fa4a48b57896d89f252526 Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-VolumesBackupsTest-999961335 Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/384d691c08fa4a48b57896d89f252526"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_384d691c08fa4a48b57896d89f252526"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/384d691c08fa4a48b57896d89f252526"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/384d691c08fa4a48b57896d89f252526"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-VolumesBackupsTest-999961335 Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 384d691c08fa4a48b57896d89f252526 Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-VolumesBackupsTest-999961335 Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-VolumesBackupsTest-999961335-project Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 7348b82c87cf428dad89bc4fbb6ac1c4 Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-VolumesBackupsTest-999961335-project Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 58aeb565-c0d0-49b0-854b-22766f508507 could not be found. Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '58aeb565-c0d0-49b0-854b-22766f508507'} Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58aeb565-c0d0-49b0-854b-22766f508507 could not be found. Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58aeb565-c0d0-49b0-854b-22766f508507 could not be found. Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:57:29.772551 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:57:29.778217 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:57:29.778217 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:57:29.778217 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:57:29.778217 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:57:29.778217 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:57:29.778217 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58aeb565-c0d0-49b0-854b-22766f508507 could not be found. Oct 30 01:57:29.778217 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 01:57:29.778217 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0e968116-5874-4503-ace4-0c2a31d6d193 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] Returning 404 to user: Instance 58aeb565-c0d0-49b0-854b-22766f508507 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:57:29.778217 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0e968116-5874-4503-ace4-0c2a31d6d193 tempest-VolumesBackupsTest-999961335 tempest-VolumesBackupsTest-999961335-project] 10.222.0.13 "GET /compute/v2.1/servers/58aeb565-c0d0-49b0-854b-22766f508507" status: 404 len: 111 microversion: 2.1 time: 0.037913 Oct 30 01:57:29.779211 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3295/6585] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:57:29 2022] GET /compute/v2.1/servers/58aeb565-c0d0-49b0-854b-22766f508507 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:57:30.047339 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5b36b5a4-9b08-416d-9ec5-84f0e826f3f2 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:57:30.048966 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5b36b5a4-9b08-416d-9ec5-84f0e826f3f2 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7032c925-acf4-42e1-9e30-abf86d2b0c06] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:57:30.056306 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5b36b5a4-9b08-416d-9ec5-84f0e826f3f2 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:30.056796 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5b36b5a4-9b08-416d-9ec5-84f0e826f3f2 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:30.073370 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5b36b5a4-9b08-416d-9ec5-84f0e826f3f2 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:30.073370 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5b36b5a4-9b08-416d-9ec5-84f0e826f3f2 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:30.073370 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5b36b5a4-9b08-416d-9ec5-84f0e826f3f2 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:30.073370 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5b36b5a4-9b08-416d-9ec5-84f0e826f3f2 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:30.298640 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5b36b5a4-9b08-416d-9ec5-84f0e826f3f2 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:57:30.320326 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5b36b5a4-9b08-416d-9ec5-84f0e826f3f2 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06" status: 200 len: 1692 microversion: 2.1 time: 0.264917 Oct 30 01:57:30.320326 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3291/6586] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:57:30 2022] GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06 => generated 1692 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:57:31.338079 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f917636e-4cb2-4321-a9e5-434b5a684156 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:57:31.338962 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f917636e-4cb2-4321-a9e5-434b5a684156 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7032c925-acf4-42e1-9e30-abf86d2b0c06] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:57:31.347442 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f917636e-4cb2-4321-a9e5-434b5a684156 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:31.348017 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f917636e-4cb2-4321-a9e5-434b5a684156 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:31.348638 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f917636e-4cb2-4321-a9e5-434b5a684156 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:31.349678 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f917636e-4cb2-4321-a9e5-434b5a684156 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:31.350214 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f917636e-4cb2-4321-a9e5-434b5a684156 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:31.351134 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f917636e-4cb2-4321-a9e5-434b5a684156 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:31.493730 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f917636e-4cb2-4321-a9e5-434b5a684156 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:57:31.501981 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f917636e-4cb2-4321-a9e5-434b5a684156 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06" status: 200 len: 1692 microversion: 2.1 time: 0.170342 Oct 30 01:57:31.502632 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3296/6587] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:57:31 2022] GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06 => generated 1692 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:57:32.526009 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-44970be4-e8e6-40e3-a2f1-6d3257200013 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:57:32.526617 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-44970be4-e8e6-40e3-a2f1-6d3257200013 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7032c925-acf4-42e1-9e30-abf86d2b0c06] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:57:32.534261 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-44970be4-e8e6-40e3-a2f1-6d3257200013 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:32.539068 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-44970be4-e8e6-40e3-a2f1-6d3257200013 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:32.539068 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-44970be4-e8e6-40e3-a2f1-6d3257200013 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:32.539068 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-44970be4-e8e6-40e3-a2f1-6d3257200013 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:32.539068 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-44970be4-e8e6-40e3-a2f1-6d3257200013 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:32.539068 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-44970be4-e8e6-40e3-a2f1-6d3257200013 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:32.692876 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-44970be4-e8e6-40e3-a2f1-6d3257200013 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:57:32.701765 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-44970be4-e8e6-40e3-a2f1-6d3257200013 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06" status: 200 len: 1682 microversion: 2.1 time: 0.180155 Oct 30 01:57:32.702331 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3292/6588] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:57:32 2022] GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06 => generated 1682 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:57:32.726344 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d421f939-74ac-4c7e-815d-ab7090e02c85 tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:57:32.726728 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d421f939-74ac-4c7e-815d-ab7090e02c85 tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] [instance: 7032c925-acf4-42e1-9e30-abf86d2b0c06] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:57:32.733811 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d421f939-74ac-4c7e-815d-ab7090e02c85 tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:32.734277 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d421f939-74ac-4c7e-815d-ab7090e02c85 tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:32.734716 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d421f939-74ac-4c7e-815d-ab7090e02c85 tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:32.735415 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d421f939-74ac-4c7e-815d-ab7090e02c85 tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:32.735870 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d421f939-74ac-4c7e-815d-ab7090e02c85 tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:32.736298 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d421f939-74ac-4c7e-815d-ab7090e02c85 tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:32.880409 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d421f939-74ac-4c7e-815d-ab7090e02c85 tempest-TestNetworkAdvancedServerOps-1368952617 tempest-TestNetworkAdvancedServerOps-1368952617-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06" status: 200 len: 1833 microversion: 2.1 time: 0.158180 Oct 30 01:57:32.886002 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3297/6589] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:57:32 2022] GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06 => generated 1833 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:57:32.905780 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3278d7cc-a9ff-4753-8d9a-f1f47d970919 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:57:32.906492 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3278d7cc-a9ff-4753-8d9a-f1f47d970919 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7032c925-acf4-42e1-9e30-abf86d2b0c06] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:57:32.913574 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3278d7cc-a9ff-4753-8d9a-f1f47d970919 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:32.914151 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3278d7cc-a9ff-4753-8d9a-f1f47d970919 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:32.914669 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3278d7cc-a9ff-4753-8d9a-f1f47d970919 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:32.915655 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3278d7cc-a9ff-4753-8d9a-f1f47d970919 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:32.916209 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3278d7cc-a9ff-4753-8d9a-f1f47d970919 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:32.916714 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3278d7cc-a9ff-4753-8d9a-f1f47d970919 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:33.063510 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3278d7cc-a9ff-4753-8d9a-f1f47d970919 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:57:33.079262 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3278d7cc-a9ff-4753-8d9a-f1f47d970919 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06" status: 200 len: 1682 microversion: 2.1 time: 0.177450 Oct 30 01:57:33.081477 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3293/6590] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:57:32 2022] GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06 => generated 1682 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:57:33.184471 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-748b42c0-51a3-4fbd-9b01-974db5ca13b9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:57:33.186882 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-748b42c0-51a3-4fbd-9b01-974db5ca13b9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7032c925-acf4-42e1-9e30-abf86d2b0c06] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:57:33.193892 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-748b42c0-51a3-4fbd-9b01-974db5ca13b9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:33.194135 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-748b42c0-51a3-4fbd-9b01-974db5ca13b9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:33.194574 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-748b42c0-51a3-4fbd-9b01-974db5ca13b9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:33.195279 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-748b42c0-51a3-4fbd-9b01-974db5ca13b9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:33.195736 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-748b42c0-51a3-4fbd-9b01-974db5ca13b9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:33.196245 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-748b42c0-51a3-4fbd-9b01-974db5ca13b9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:33.269743 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-748b42c0-51a3-4fbd-9b01-974db5ca13b9 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "POST /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06/action" status: 200 len: 38674 microversion: 2.1 time: 0.091070 Oct 30 01:57:33.270581 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3298/6591] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:57:33 2022] POST /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06/action => generated 38674 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:57:34.522934 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-58efeda0-633b-4f88-857a-03cab4a56d55 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:57:34.523545 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-58efeda0-633b-4f88-857a-03cab4a56d55 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7032c925-acf4-42e1-9e30-abf86d2b0c06] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:57:34.537116 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58efeda0-633b-4f88-857a-03cab4a56d55 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:34.537116 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58efeda0-633b-4f88-857a-03cab4a56d55 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:34.537116 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58efeda0-633b-4f88-857a-03cab4a56d55 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:34.545578 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-ebf62827-e9b7-428b-957a-83654a656367 req-63ded516-006a-4bac-a050-9b2accb9579d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7032c925-acf4-42e1-9e30-abf86d2b0c06", "tag": "484cb75b-2fe8-42b1-902b-24cba1a87ac5"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:57:34.550822 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58efeda0-633b-4f88-857a-03cab4a56d55 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:34.551540 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58efeda0-633b-4f88-857a-03cab4a56d55 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:34.555197 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58efeda0-633b-4f88-857a-03cab4a56d55 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:34.572866 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ebf62827-e9b7-428b-957a-83654a656367 req-63ded516-006a-4bac-a050-9b2accb9579d service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:34.573646 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ebf62827-e9b7-428b-957a-83654a656367 req-63ded516-006a-4bac-a050-9b2accb9579d service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:34.574261 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ebf62827-e9b7-428b-957a-83654a656367 req-63ded516-006a-4bac-a050-9b2accb9579d service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:34.609429 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-ebf62827-e9b7-428b-957a-83654a656367 req-63ded516-006a-4bac-a050-9b2accb9579d service nova] Creating event network-changed:484cb75b-2fe8-42b1-902b-24cba1a87ac5 for instance 7032c925-acf4-42e1-9e30-abf86d2b0c06 on n-h2-master-1 Oct 30 01:57:34.616932 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-58efeda0-633b-4f88-857a-03cab4a56d55 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7032c925-acf4-42e1-9e30-abf86d2b0c06] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:57:34.621072 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-ebf62827-e9b7-428b-957a-83654a656367 req-63ded516-006a-4bac-a050-9b2accb9579d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079728 Oct 30 01:57:34.632033 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3299/6592] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:57:34.904111 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-58efeda0-633b-4f88-857a-03cab4a56d55 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06" status: 204 len: 0 microversion: 2.1 time: 0.384854 Oct 30 01:57:34.905871 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3294/6593] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:57:34 2022] DELETE /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:57:34.916361 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3ee6051e-d463-4d54-a214-26c8d93fc174 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:57:34.917171 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3ee6051e-d463-4d54-a214-26c8d93fc174 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7032c925-acf4-42e1-9e30-abf86d2b0c06] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:57:34.926479 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3ee6051e-d463-4d54-a214-26c8d93fc174 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:34.927776 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3ee6051e-d463-4d54-a214-26c8d93fc174 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:34.929007 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3ee6051e-d463-4d54-a214-26c8d93fc174 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:34.930643 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3ee6051e-d463-4d54-a214-26c8d93fc174 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:34.931796 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3ee6051e-d463-4d54-a214-26c8d93fc174 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:34.934474 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3ee6051e-d463-4d54-a214-26c8d93fc174 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:35.119632 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3ee6051e-d463-4d54-a214-26c8d93fc174 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:57:35.127919 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3ee6051e-d463-4d54-a214-26c8d93fc174 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06" status: 200 len: 1688 microversion: 2.1 time: 0.218240 Oct 30 01:57:35.136200 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3300/6594] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:57:34 2022] GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06 => generated 1688 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:57:36.112330 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-d92f5d08-6cc3-4904-a47a-2292845dfe9e req-3ec96e1c-cc9a-48c8-b9a6-54adb8262865 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7032c925-acf4-42e1-9e30-abf86d2b0c06", "name": "network-vif-deleted", "tag": "484cb75b-2fe8-42b1-902b-24cba1a87ac5"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:57:36.139387 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d92f5d08-6cc3-4904-a47a-2292845dfe9e req-3ec96e1c-cc9a-48c8-b9a6-54adb8262865 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:36.141293 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d92f5d08-6cc3-4904-a47a-2292845dfe9e req-3ec96e1c-cc9a-48c8-b9a6-54adb8262865 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:36.141835 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d92f5d08-6cc3-4904-a47a-2292845dfe9e req-3ec96e1c-cc9a-48c8-b9a6-54adb8262865 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:36.160238 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-61a6b696-7bb0-4812-9e08-e2109d81c906 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:57:36.161682 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-61a6b696-7bb0-4812-9e08-e2109d81c906 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7032c925-acf4-42e1-9e30-abf86d2b0c06] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:57:36.162877 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:57:36.170738 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-61a6b696-7bb0-4812-9e08-e2109d81c906 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:36.171338 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-61a6b696-7bb0-4812-9e08-e2109d81c906 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:36.171925 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-61a6b696-7bb0-4812-9e08-e2109d81c906 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:36.172061 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-d92f5d08-6cc3-4904-a47a-2292845dfe9e req-3ec96e1c-cc9a-48c8-b9a6-54adb8262865 service nova] Creating event network-vif-deleted:484cb75b-2fe8-42b1-902b-24cba1a87ac5 for instance 7032c925-acf4-42e1-9e30-abf86d2b0c06 on n-h2-master-1 Oct 30 01:57:36.172773 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-61a6b696-7bb0-4812-9e08-e2109d81c906 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:36.173498 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-61a6b696-7bb0-4812-9e08-e2109d81c906 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:36.174136 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-61a6b696-7bb0-4812-9e08-e2109d81c906 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:36.179236 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-d92f5d08-6cc3-4904-a47a-2292845dfe9e req-3ec96e1c-cc9a-48c8-b9a6-54adb8262865 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070750 Oct 30 01:57:36.180427 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3295/6595] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:57:36.247523 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-61a6b696-7bb0-4812-9e08-e2109d81c906 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:57:36.255915 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-61a6b696-7bb0-4812-9e08-e2109d81c906 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06" status: 200 len: 1501 microversion: 2.1 time: 0.100408 Oct 30 01:57:36.256505 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3301/6596] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:57:36 2022] GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06 => generated 1501 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:57:37.282232 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-766a59cb-10c8-4168-bbb9-92c4dbf27397 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:57:37.282944 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-766a59cb-10c8-4168-bbb9-92c4dbf27397 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7032c925-acf4-42e1-9e30-abf86d2b0c06] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:57:37.291542 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-766a59cb-10c8-4168-bbb9-92c4dbf27397 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:37.292032 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-766a59cb-10c8-4168-bbb9-92c4dbf27397 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:37.292477 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-766a59cb-10c8-4168-bbb9-92c4dbf27397 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:37.294522 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-766a59cb-10c8-4168-bbb9-92c4dbf27397 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:37.294522 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-766a59cb-10c8-4168-bbb9-92c4dbf27397 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:37.294522 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-766a59cb-10c8-4168-bbb9-92c4dbf27397 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:37.309704 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-766a59cb-10c8-4168-bbb9-92c4dbf27397 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] HTTP exception thrown: Instance 7032c925-acf4-42e1-9e30-abf86d2b0c06 could not be found. Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-766a59cb-10c8-4168-bbb9-92c4dbf27397 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Request method failure captured: Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06 HTTP/1.1 Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdi5g692Uv5xl51AXx_zH5DqygQV5gilQk65Zrt4awXG-qNzrnkspnA78K5Gla_Xr75NP6Y6TYXCTZgpS6AZ1uwBTWQJyiZW5VCW1eOoSX9Nhid2ZA0O0wE2AoU3HGyFGPzUs9NxTgw8u0D_JE9Zhgtle7Vspzqc0hxjWXJSlhOuR44 Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: f2bf165fe12748b29e66ea4f61364aef Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1545186841 Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f2bf165fe12748b29e66ea4f61364aef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f2bf165fe12748b29e66ea4f61364aef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f2bf165fe12748b29e66ea4f61364aef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f2bf165fe12748b29e66ea4f61364aef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1545186841 Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: f2bf165fe12748b29e66ea4f61364aef Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1545186841 Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-TestNetworkAdvancedServerOps-1545186841-project Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: f0f51fe515ee4375a252a8d8a98ec77b Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1545186841-project Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 7032c925-acf4-42e1-9e30-abf86d2b0c06 could not be found. Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '7032c925-acf4-42e1-9e30-abf86d2b0c06'} Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7032c925-acf4-42e1-9e30-abf86d2b0c06 could not be found. Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7032c925-acf4-42e1-9e30-abf86d2b0c06 could not be found. Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:57:37.311723 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:57:37.317059 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:57:37.317059 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:57:37.317059 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:57:37.317059 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:57:37.317059 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:57:37.317059 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:57:37.317059 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7032c925-acf4-42e1-9e30-abf86d2b0c06 could not be found. Oct 30 01:57:37.317059 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:57:37.317059 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-766a59cb-10c8-4168-bbb9-92c4dbf27397 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Returning 404 to user: Instance 7032c925-acf4-42e1-9e30-abf86d2b0c06 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:57:37.317059 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-766a59cb-10c8-4168-bbb9-92c4dbf27397 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06" status: 404 len: 111 microversion: 2.1 time: 0.037645 Oct 30 01:57:37.317059 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3296/6597] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:57:37 2022] GET /compute/v2.1/servers/7032c925-acf4-42e1-9e30-abf86d2b0c06 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:57:41.494982 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e5ae9e79-ab49-4470-a8ec-3e8f5af3ebae tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '.version_select at 0x7f44c6d3f430>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:57:41.572797 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e5ae9e79-ab49-4470-a8ec-3e8f5af3ebae tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-330442908" status: 202 len: 0 microversion: 2.1 time: 0.084015 Oct 30 01:57:41.573921 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3302/6598] 10.222.0.13 () {58 vars in 1281 bytes} [Sun Oct 30 01:57:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-330442908 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:57:41.601528 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-36c91abc-e6a2-4604-857f-109e0db03d52 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Action: 'create', calling method: .version_select at 0x7f44c6cd8670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-876002968", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfVxSl48XsOfdFNvTZfrwbo+EYRmrA3nFJ4Fc96Eok7a9DVBIzzhb2ET/E+GsxJdgx+bHaIYfR7utDVfqtSVSHZWlbUbCdUYjYbSwM+y11NEx1YF33X5GwAfSNMSDBmHg=="}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:57:41.609949 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:57:41.624963 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-36c91abc-e6a2-4604-857f-109e0db03d52 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Getting quotas for project f2bf165fe12748b29e66ea4f61364aef. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:57:41.633786 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-36c91abc-e6a2-4604-857f-109e0db03d52 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Getting quotas for user f0f51fe515ee4375a252a8d8a98ec77b and project f2bf165fe12748b29e66ea4f61364aef. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:57:41.719349 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-36c91abc-e6a2-4604-857f-109e0db03d52 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.122246 Oct 30 01:57:41.720070 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3297/6599] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 30 01:57:41 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:57:52.115204 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-136f1a37-d430-44e7-87a8-8a151e4fadcf tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1625424169", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "2bc462f5-18da-4edf-a130-d2c07a72d58b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-876002968", "security_groups": [{"name": "tempest-secgroup-smoke-489906686"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:57:52.170150 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:57:52.173037 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:57:52.302367 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-136f1a37-d430-44e7-87a8-8a151e4fadcf tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] validate_networks() for [('2bc462f5-18da-4edf-a130-d2c07a72d58b', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:57:53.057062 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-136f1a37-d430-44e7-87a8-8a151e4fadcf tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:57:53.057714 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-136f1a37-d430-44e7-87a8-8a151e4fadcf tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:57:53.058266 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-136f1a37-d430-44e7-87a8-8a151e4fadcf tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:57:53.058887 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-136f1a37-d430-44e7-87a8-8a151e4fadcf tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:57:53.059301 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-136f1a37-d430-44e7-87a8-8a151e4fadcf tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:57:53.069028 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-136f1a37-d430-44e7-87a8-8a151e4fadcf tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:53.069568 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-136f1a37-d430-44e7-87a8-8a151e4fadcf tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:53.069996 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-136f1a37-d430-44e7-87a8-8a151e4fadcf tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:53.071772 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-136f1a37-d430-44e7-87a8-8a151e4fadcf tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:53.072165 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-136f1a37-d430-44e7-87a8-8a151e4fadcf tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:53.072796 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-136f1a37-d430-44e7-87a8-8a151e4fadcf tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:53.093216 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-136f1a37-d430-44e7-87a8-8a151e4fadcf tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Getting quotas for project f2bf165fe12748b29e66ea4f61364aef. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:57:53.100453 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-136f1a37-d430-44e7-87a8-8a151e4fadcf tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Getting quotas for user f0f51fe515ee4375a252a8d8a98ec77b and project f2bf165fe12748b29e66ea4f61364aef. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:57:53.114708 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-136f1a37-d430-44e7-87a8-8a151e4fadcf tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:57:53.117255 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-136f1a37-d430-44e7-87a8-8a151e4fadcf tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7694b2a7-b20e-41ed-8361-72aec7975dfe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:57:53.255545 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-136f1a37-d430-44e7-87a8-8a151e4fadcf tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.154262 Oct 30 01:57:53.256316 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3303/6600] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:57:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 1156 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 30 01:57:53.270461 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-48b02aa2-51a7-4333-93f9-5229dc51dc79 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:57:53.271271 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-48b02aa2-51a7-4333-93f9-5229dc51dc79 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7694b2a7-b20e-41ed-8361-72aec7975dfe] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:57:53.283773 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=4 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:57:53.359601 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-48b02aa2-51a7-4333-93f9-5229dc51dc79 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:57:53.367048 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-48b02aa2-51a7-4333-93f9-5229dc51dc79 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe" status: 200 len: 1266 microversion: 2.1 time: 0.102727 Oct 30 01:57:53.368801 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3298/6601] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:57:53 2022] GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe => generated 1266 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:57:54.392478 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2b4b8ed1-1396-4e68-b159-5d0313fb8571 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:57:54.393127 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2b4b8ed1-1396-4e68-b159-5d0313fb8571 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7694b2a7-b20e-41ed-8361-72aec7975dfe] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:57:54.402117 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2b4b8ed1-1396-4e68-b159-5d0313fb8571 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:54.403702 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2b4b8ed1-1396-4e68-b159-5d0313fb8571 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:54.403702 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2b4b8ed1-1396-4e68-b159-5d0313fb8571 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:54.408547 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2b4b8ed1-1396-4e68-b159-5d0313fb8571 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:54.409284 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2b4b8ed1-1396-4e68-b159-5d0313fb8571 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:54.409788 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2b4b8ed1-1396-4e68-b159-5d0313fb8571 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:54.500096 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2b4b8ed1-1396-4e68-b159-5d0313fb8571 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:57:54.508573 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2b4b8ed1-1396-4e68-b159-5d0313fb8571 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe" status: 200 len: 1270 microversion: 2.1 time: 0.120250 Oct 30 01:57:54.509618 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3304/6602] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:57:54 2022] GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe => generated 1270 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:57:55.531065 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-60d73734-4c83-47a5-a614-0b459cfffa9d tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:57:55.531709 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-60d73734-4c83-47a5-a614-0b459cfffa9d tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7694b2a7-b20e-41ed-8361-72aec7975dfe] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:57:55.539003 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-60d73734-4c83-47a5-a614-0b459cfffa9d tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:55.539628 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-60d73734-4c83-47a5-a614-0b459cfffa9d tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:55.548135 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-60d73734-4c83-47a5-a614-0b459cfffa9d tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:55.548135 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-60d73734-4c83-47a5-a614-0b459cfffa9d tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:55.548135 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-60d73734-4c83-47a5-a614-0b459cfffa9d tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:55.548135 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-60d73734-4c83-47a5-a614-0b459cfffa9d tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:55.608120 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-60d73734-4c83-47a5-a614-0b459cfffa9d tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:57:55.623102 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-60d73734-4c83-47a5-a614-0b459cfffa9d tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe" status: 200 len: 1318 microversion: 2.1 time: 0.089989 Oct 30 01:57:55.623102 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3299/6603] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:57:55 2022] GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe => generated 1318 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:57:56.640281 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3f7cf662-d8b9-4d73-872f-cb29d25c9879 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:57:56.641185 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3f7cf662-d8b9-4d73-872f-cb29d25c9879 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7694b2a7-b20e-41ed-8361-72aec7975dfe] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:57:56.650863 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f7cf662-d8b9-4d73-872f-cb29d25c9879 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:56.651359 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f7cf662-d8b9-4d73-872f-cb29d25c9879 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:56.652070 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f7cf662-d8b9-4d73-872f-cb29d25c9879 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:56.652909 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f7cf662-d8b9-4d73-872f-cb29d25c9879 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:56.653642 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f7cf662-d8b9-4d73-872f-cb29d25c9879 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:56.654261 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f7cf662-d8b9-4d73-872f-cb29d25c9879 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:56.854812 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3f7cf662-d8b9-4d73-872f-cb29d25c9879 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:57:56.863503 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3f7cf662-d8b9-4d73-872f-cb29d25c9879 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe" status: 200 len: 1391 microversion: 2.1 time: 0.227342 Oct 30 01:57:56.864137 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3305/6604] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:57:56 2022] GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe => generated 1391 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:57:57.683126 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-fbf6c5c8-c4bc-4608-9bdc-52a3074edd3e req-756f6e53-b5c3-4c30-8a7f-0cbbcd3066b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7694b2a7-b20e-41ed-8361-72aec7975dfe", "tag": "09aebc2a-7191-4613-801c-111ebcad7ac3"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:57:57.695562 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-fbf6c5c8-c4bc-4608-9bdc-52a3074edd3e req-756f6e53-b5c3-4c30-8a7f-0cbbcd3066b1 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:57.696083 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-fbf6c5c8-c4bc-4608-9bdc-52a3074edd3e req-756f6e53-b5c3-4c30-8a7f-0cbbcd3066b1 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:57.696589 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-fbf6c5c8-c4bc-4608-9bdc-52a3074edd3e req-756f6e53-b5c3-4c30-8a7f-0cbbcd3066b1 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:57.712182 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-fbf6c5c8-c4bc-4608-9bdc-52a3074edd3e req-756f6e53-b5c3-4c30-8a7f-0cbbcd3066b1 service nova] Creating event network-changed:09aebc2a-7191-4613-801c-111ebcad7ac3 for instance 7694b2a7-b20e-41ed-8361-72aec7975dfe on n-h1-master-1 Oct 30 01:57:57.724443 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-fbf6c5c8-c4bc-4608-9bdc-52a3074edd3e req-756f6e53-b5c3-4c30-8a7f-0cbbcd3066b1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043271 Oct 30 01:57:57.724443 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3300/6605] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:57:57.895897 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5c2e1291-f1eb-4100-90cf-9acdd7562165 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:57:57.897272 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5c2e1291-f1eb-4100-90cf-9acdd7562165 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7694b2a7-b20e-41ed-8361-72aec7975dfe] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:57:57.907867 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c2e1291-f1eb-4100-90cf-9acdd7562165 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:57.908623 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c2e1291-f1eb-4100-90cf-9acdd7562165 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:57.909187 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c2e1291-f1eb-4100-90cf-9acdd7562165 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:57.910008 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c2e1291-f1eb-4100-90cf-9acdd7562165 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:57.910626 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c2e1291-f1eb-4100-90cf-9acdd7562165 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:57.911214 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c2e1291-f1eb-4100-90cf-9acdd7562165 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:58.138820 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5c2e1291-f1eb-4100-90cf-9acdd7562165 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:57:58.147857 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5c2e1291-f1eb-4100-90cf-9acdd7562165 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe" status: 200 len: 1391 microversion: 2.1 time: 0.256074 Oct 30 01:57:58.148454 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3306/6606] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:57:57 2022] GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe => generated 1391 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:57:59.173254 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6e4dcc9a-c8c0-4efa-91a5-6d862af91d54 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:57:59.174098 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6e4dcc9a-c8c0-4efa-91a5-6d862af91d54 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7694b2a7-b20e-41ed-8361-72aec7975dfe] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:57:59.181929 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6e4dcc9a-c8c0-4efa-91a5-6d862af91d54 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:59.182423 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6e4dcc9a-c8c0-4efa-91a5-6d862af91d54 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:59.182865 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6e4dcc9a-c8c0-4efa-91a5-6d862af91d54 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:59.183578 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6e4dcc9a-c8c0-4efa-91a5-6d862af91d54 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:57:59.184033 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6e4dcc9a-c8c0-4efa-91a5-6d862af91d54 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:57:59.184919 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6e4dcc9a-c8c0-4efa-91a5-6d862af91d54 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:57:59.326791 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6e4dcc9a-c8c0-4efa-91a5-6d862af91d54 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:57:59.338315 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6e4dcc9a-c8c0-4efa-91a5-6d862af91d54 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe" status: 200 len: 1391 microversion: 2.1 time: 0.169220 Oct 30 01:57:59.339457 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3301/6607] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:57:59 2022] GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe => generated 1391 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:58:00.362933 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-18e6005b-7598-4880-ae3b-d3b9bdd17c5e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:58:00.363547 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-18e6005b-7598-4880-ae3b-d3b9bdd17c5e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7694b2a7-b20e-41ed-8361-72aec7975dfe] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:58:00.370476 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-18e6005b-7598-4880-ae3b-d3b9bdd17c5e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:58:00.371104 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-18e6005b-7598-4880-ae3b-d3b9bdd17c5e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:58:00.371649 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-18e6005b-7598-4880-ae3b-d3b9bdd17c5e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:58:00.372470 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-18e6005b-7598-4880-ae3b-d3b9bdd17c5e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:58:00.373032 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-18e6005b-7598-4880-ae3b-d3b9bdd17c5e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:58:00.373523 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-18e6005b-7598-4880-ae3b-d3b9bdd17c5e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:58:00.518141 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-18e6005b-7598-4880-ae3b-d3b9bdd17c5e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:58:00.527251 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-18e6005b-7598-4880-ae3b-d3b9bdd17c5e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe" status: 200 len: 1391 microversion: 2.1 time: 0.168259 Oct 30 01:58:00.543283 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3307/6608] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:58:00 2022] GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe => generated 1391 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:58:01.550607 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7d9ec10e-7471-4898-9b61-46ce2a864fdb tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:58:01.551315 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7d9ec10e-7471-4898-9b61-46ce2a864fdb tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7694b2a7-b20e-41ed-8361-72aec7975dfe] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:58:01.564064 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7d9ec10e-7471-4898-9b61-46ce2a864fdb tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:58:01.564897 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7d9ec10e-7471-4898-9b61-46ce2a864fdb tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:58:01.565429 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7d9ec10e-7471-4898-9b61-46ce2a864fdb tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:58:01.566354 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7d9ec10e-7471-4898-9b61-46ce2a864fdb tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:58:01.566992 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7d9ec10e-7471-4898-9b61-46ce2a864fdb tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:58:01.567607 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7d9ec10e-7471-4898-9b61-46ce2a864fdb tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:58:01.752893 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7d9ec10e-7471-4898-9b61-46ce2a864fdb tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:58:01.765170 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7d9ec10e-7471-4898-9b61-46ce2a864fdb tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe" status: 200 len: 1391 microversion: 2.1 time: 0.218387 Oct 30 01:58:01.768144 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3302/6609] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:58:01 2022] GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe => generated 1391 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:58:02.796780 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a4ef9757-e25d-4645-9935-1744af3764f5 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:58:02.797468 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a4ef9757-e25d-4645-9935-1744af3764f5 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7694b2a7-b20e-41ed-8361-72aec7975dfe] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:58:02.805260 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a4ef9757-e25d-4645-9935-1744af3764f5 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:58:02.805801 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a4ef9757-e25d-4645-9935-1744af3764f5 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:58:02.806232 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a4ef9757-e25d-4645-9935-1744af3764f5 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:58:02.806954 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a4ef9757-e25d-4645-9935-1744af3764f5 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:58:02.807408 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a4ef9757-e25d-4645-9935-1744af3764f5 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:58:02.807862 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a4ef9757-e25d-4645-9935-1744af3764f5 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:58:02.974784 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a4ef9757-e25d-4645-9935-1744af3764f5 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:58:02.984701 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a4ef9757-e25d-4645-9935-1744af3764f5 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe" status: 200 len: 1391 microversion: 2.1 time: 0.191885 Oct 30 01:58:02.985289 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3308/6610] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:58:02 2022] GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe => generated 1391 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:58:03.119893 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-e8fec7c7-c18d-4856-81b4-7c25bd0cad03 req-da7dd67a-b6aa-41f8-9437-07419bf3d3fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7694b2a7-b20e-41ed-8361-72aec7975dfe", "name": "network-vif-plugged", "status": "completed", "tag": "09aebc2a-7191-4613-801c-111ebcad7ac3"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:58:03.131213 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e8fec7c7-c18d-4856-81b4-7c25bd0cad03 req-da7dd67a-b6aa-41f8-9437-07419bf3d3fc service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:58:03.131678 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e8fec7c7-c18d-4856-81b4-7c25bd0cad03 req-da7dd67a-b6aa-41f8-9437-07419bf3d3fc service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:58:03.132103 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e8fec7c7-c18d-4856-81b4-7c25bd0cad03 req-da7dd67a-b6aa-41f8-9437-07419bf3d3fc service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:58:03.143312 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-e8fec7c7-c18d-4856-81b4-7c25bd0cad03 req-da7dd67a-b6aa-41f8-9437-07419bf3d3fc service nova] Creating event network-vif-plugged:09aebc2a-7191-4613-801c-111ebcad7ac3 for instance 7694b2a7-b20e-41ed-8361-72aec7975dfe on n-h1-master-1 Oct 30 01:58:03.148307 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-e8fec7c7-c18d-4856-81b4-7c25bd0cad03 req-da7dd67a-b6aa-41f8-9437-07419bf3d3fc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032809 Oct 30 01:58:03.149043 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3303/6611] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:58:04.008426 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fcedac51-b2e3-4ecd-8895-93a1723318bd tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:58:04.009799 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fcedac51-b2e3-4ecd-8895-93a1723318bd tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7694b2a7-b20e-41ed-8361-72aec7975dfe] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:58:04.011917 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:58:04.012626 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=6 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:58:04.018324 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fcedac51-b2e3-4ecd-8895-93a1723318bd tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:58:04.018809 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fcedac51-b2e3-4ecd-8895-93a1723318bd tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:58:04.019247 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fcedac51-b2e3-4ecd-8895-93a1723318bd tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:58:04.019940 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fcedac51-b2e3-4ecd-8895-93a1723318bd tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:58:04.020387 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fcedac51-b2e3-4ecd-8895-93a1723318bd tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:58:04.020804 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fcedac51-b2e3-4ecd-8895-93a1723318bd tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:58:04.167144 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-fcedac51-b2e3-4ecd-8895-93a1723318bd tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:58:04.174817 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fcedac51-b2e3-4ecd-8895-93a1723318bd tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe" status: 200 len: 1391 microversion: 2.1 time: 0.170968 Oct 30 01:58:04.175381 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3309/6612] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:58:04 2022] GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe => generated 1391 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:58:05.195016 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:58:05.200413 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-881f92ed-a261-426d-aae0-6b5361660b94 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:58:05.201327 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-881f92ed-a261-426d-aae0-6b5361660b94 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7694b2a7-b20e-41ed-8361-72aec7975dfe] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:58:05.207823 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-881f92ed-a261-426d-aae0-6b5361660b94 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:58:05.208321 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-881f92ed-a261-426d-aae0-6b5361660b94 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:58:05.208762 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-881f92ed-a261-426d-aae0-6b5361660b94 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:58:05.209515 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-881f92ed-a261-426d-aae0-6b5361660b94 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:58:05.210156 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-881f92ed-a261-426d-aae0-6b5361660b94 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:58:05.210758 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-881f92ed-a261-426d-aae0-6b5361660b94 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:58:05.422158 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-881f92ed-a261-426d-aae0-6b5361660b94 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:58:05.435049 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-881f92ed-a261-426d-aae0-6b5361660b94 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe" status: 200 len: 1562 microversion: 2.1 time: 0.240716 Oct 30 01:58:05.435932 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3304/6613] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:58:05 2022] GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe => generated 1562 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:58:05.459777 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3aa913bc-283e-465a-b45b-7dffc5de1311 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:58:05.460559 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3aa913bc-283e-465a-b45b-7dffc5de1311 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7694b2a7-b20e-41ed-8361-72aec7975dfe] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:58:05.477488 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3aa913bc-283e-465a-b45b-7dffc5de1311 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:58:05.481543 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3aa913bc-283e-465a-b45b-7dffc5de1311 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:58:05.481543 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3aa913bc-283e-465a-b45b-7dffc5de1311 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:58:05.481543 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3aa913bc-283e-465a-b45b-7dffc5de1311 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:58:05.481543 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3aa913bc-283e-465a-b45b-7dffc5de1311 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:58:05.481543 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3aa913bc-283e-465a-b45b-7dffc5de1311 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:58:05.739448 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3aa913bc-283e-465a-b45b-7dffc5de1311 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:58:05.754663 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3aa913bc-283e-465a-b45b-7dffc5de1311 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe" status: 200 len: 1562 microversion: 2.1 time: 0.299601 Oct 30 01:58:05.759411 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3310/6614] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:58:05 2022] GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe => generated 1562 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:58:09.465193 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-09a4ea36-4f4c-48c8-a715-86b7731246f7 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:58:09.466005 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-09a4ea36-4f4c-48c8-a715-86b7731246f7 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7694b2a7-b20e-41ed-8361-72aec7975dfe] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:58:09.474045 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-2f17560f-ad2d-49d2-9593-774766abb56f req-b074aa56-481a-4989-93b5-8c6832a6e38c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7694b2a7-b20e-41ed-8361-72aec7975dfe", "tag": "09aebc2a-7191-4613-801c-111ebcad7ac3"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:58:09.474582 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-09a4ea36-4f4c-48c8-a715-86b7731246f7 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:58:09.474849 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-09a4ea36-4f4c-48c8-a715-86b7731246f7 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:58:09.475296 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-09a4ea36-4f4c-48c8-a715-86b7731246f7 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:58:09.476019 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-09a4ea36-4f4c-48c8-a715-86b7731246f7 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:58:09.476533 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-09a4ea36-4f4c-48c8-a715-86b7731246f7 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:58:09.477486 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-09a4ea36-4f4c-48c8-a715-86b7731246f7 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:58:09.495328 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-2f17560f-ad2d-49d2-9593-774766abb56f req-b074aa56-481a-4989-93b5-8c6832a6e38c service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:58:09.495837 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-2f17560f-ad2d-49d2-9593-774766abb56f req-b074aa56-481a-4989-93b5-8c6832a6e38c service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:58:09.496228 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-2f17560f-ad2d-49d2-9593-774766abb56f req-b074aa56-481a-4989-93b5-8c6832a6e38c service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:58:09.516376 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-2f17560f-ad2d-49d2-9593-774766abb56f req-b074aa56-481a-4989-93b5-8c6832a6e38c service nova] Creating event network-changed:09aebc2a-7191-4613-801c-111ebcad7ac3 for instance 7694b2a7-b20e-41ed-8361-72aec7975dfe on n-h1-master-1 Oct 30 01:58:09.522911 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-2f17560f-ad2d-49d2-9593-774766abb56f req-b074aa56-481a-4989-93b5-8c6832a6e38c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052414 Oct 30 01:58:09.524583 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3311/6615] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:58:09.803435 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-09a4ea36-4f4c-48c8-a715-86b7731246f7 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:58:09.812209 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-09a4ea36-4f4c-48c8-a715-86b7731246f7 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe" status: 200 len: 1562 microversion: 2.1 time: 0.351997 Oct 30 01:58:09.812812 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3305/6616] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:58:09 2022] GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe => generated 1562 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:58:28.314292 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-41e1f4a2-c4a8-4dd0-8830-c354586f1052 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:58:28.323290 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-41e1f4a2-c4a8-4dd0-8830-c354586f1052 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7694b2a7-b20e-41ed-8361-72aec7975dfe] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:58:28.364358 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:58:28.365317 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=46 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:58:28.367722 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-41e1f4a2-c4a8-4dd0-8830-c354586f1052 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:58:28.368337 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-41e1f4a2-c4a8-4dd0-8830-c354586f1052 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:58:28.368852 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-41e1f4a2-c4a8-4dd0-8830-c354586f1052 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:58:28.370626 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-41e1f4a2-c4a8-4dd0-8830-c354586f1052 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:58:28.372723 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-41e1f4a2-c4a8-4dd0-8830-c354586f1052 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:58:28.373301 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-41e1f4a2-c4a8-4dd0-8830-c354586f1052 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:58:28.516645 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-41e1f4a2-c4a8-4dd0-8830-c354586f1052 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "POST /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe/action" status: 200 len: 24570 microversion: 2.1 time: 0.212633 Oct 30 01:58:28.517968 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3312/6617] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:58:28 2022] POST /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe/action => generated 24570 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:58:39.511813 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3975a3e9-3bf3-43a0-ab50-d2b9125c9666 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "deb14158-45d8-4539-889d-ff9726d046d7"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:58:39.515944 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3975a3e9-3bf3-43a0-ab50-d2b9125c9666 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7694b2a7-b20e-41ed-8361-72aec7975dfe] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:58:39.518505 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:58:39.519732 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=36 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:58:39.525432 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3975a3e9-3bf3-43a0-ab50-d2b9125c9666 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:58:39.525998 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3975a3e9-3bf3-43a0-ab50-d2b9125c9666 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:58:39.526651 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3975a3e9-3bf3-43a0-ab50-d2b9125c9666 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:58:39.527365 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3975a3e9-3bf3-43a0-ab50-d2b9125c9666 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:58:39.527825 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3975a3e9-3bf3-43a0-ab50-d2b9125c9666 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:58:39.528254 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3975a3e9-3bf3-43a0-ab50-d2b9125c9666 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:58:39.622674 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-3975a3e9-3bf3-43a0-ab50-d2b9125c9666 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:58:39.623103 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-3975a3e9-3bf3-43a0-ab50-d2b9125c9666 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:58:39.623732 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-3975a3e9-3bf3-43a0-ab50-d2b9125c9666 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:58:39.624157 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-3975a3e9-3bf3-43a0-ab50-d2b9125c9666 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:58:39.624583 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-3975a3e9-3bf3-43a0-ab50-d2b9125c9666 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:58:39.807799 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3975a3e9-3bf3-43a0-ab50-d2b9125c9666 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7694b2a7-b20e-41ed-8361-72aec7975dfe] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:58:39.815269 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3975a3e9-3bf3-43a0-ab50-d2b9125c9666 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:58:39.815769 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3975a3e9-3bf3-43a0-ab50-d2b9125c9666 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:58:39.816209 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3975a3e9-3bf3-43a0-ab50-d2b9125c9666 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:58:39.816937 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3975a3e9-3bf3-43a0-ab50-d2b9125c9666 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:58:39.817402 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3975a3e9-3bf3-43a0-ab50-d2b9125c9666 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:58:39.817835 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3975a3e9-3bf3-43a0-ab50-d2b9125c9666 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:58:39.856532 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3975a3e9-3bf3-43a0-ab50-d2b9125c9666 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "POST /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe/action" status: 202 len: 1137 microversion: 2.1 time: 0.348861 Oct 30 01:58:39.857207 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3306/6618] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:58:39 2022] POST /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe/action => generated 1137 bytes in 350 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 30 01:58:39.877477 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2993fda3-22d6-43fa-9b59-3c339cb7254e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:58:39.878174 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2993fda3-22d6-43fa-9b59-3c339cb7254e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7694b2a7-b20e-41ed-8361-72aec7975dfe] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:58:39.880790 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=4 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:58:39.881543 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:58:39.887776 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2993fda3-22d6-43fa-9b59-3c339cb7254e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:58:39.889667 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2993fda3-22d6-43fa-9b59-3c339cb7254e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:58:39.892447 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2993fda3-22d6-43fa-9b59-3c339cb7254e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:58:39.892447 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2993fda3-22d6-43fa-9b59-3c339cb7254e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:58:39.892447 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2993fda3-22d6-43fa-9b59-3c339cb7254e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:58:39.892447 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2993fda3-22d6-43fa-9b59-3c339cb7254e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:58:40.079767 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2993fda3-22d6-43fa-9b59-3c339cb7254e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:58:40.089156 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2993fda3-22d6-43fa-9b59-3c339cb7254e tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe" status: 200 len: 1690 microversion: 2.1 time: 0.216770 Oct 30 01:58:40.090017 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3313/6619] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:58:39 2022] GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe => generated 1690 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:58:41.112670 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-35a4d38d-d805-49ec-9922-fa596fe031d3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:58:41.114053 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-35a4d38d-d805-49ec-9922-fa596fe031d3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7694b2a7-b20e-41ed-8361-72aec7975dfe] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:58:41.121868 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-35a4d38d-d805-49ec-9922-fa596fe031d3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:58:41.122364 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-35a4d38d-d805-49ec-9922-fa596fe031d3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:58:41.123072 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-35a4d38d-d805-49ec-9922-fa596fe031d3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:58:41.123784 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-35a4d38d-d805-49ec-9922-fa596fe031d3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:58:41.124244 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-35a4d38d-d805-49ec-9922-fa596fe031d3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:58:41.124878 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-35a4d38d-d805-49ec-9922-fa596fe031d3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:58:41.275022 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-35a4d38d-d805-49ec-9922-fa596fe031d3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:58:41.286040 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-35a4d38d-d805-49ec-9922-fa596fe031d3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe" status: 200 len: 1690 microversion: 2.1 time: 0.177363 Oct 30 01:58:41.302100 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3307/6620] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:58:41 2022] GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe => generated 1690 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:58:42.310441 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-da6456f7-62ab-4457-ad3e-e12e12ca0a06 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:58:42.311065 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-da6456f7-62ab-4457-ad3e-e12e12ca0a06 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7694b2a7-b20e-41ed-8361-72aec7975dfe] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:58:42.317917 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-da6456f7-62ab-4457-ad3e-e12e12ca0a06 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:58:42.318402 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-da6456f7-62ab-4457-ad3e-e12e12ca0a06 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:58:42.318839 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-da6456f7-62ab-4457-ad3e-e12e12ca0a06 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:58:42.319574 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-da6456f7-62ab-4457-ad3e-e12e12ca0a06 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:58:42.320026 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-da6456f7-62ab-4457-ad3e-e12e12ca0a06 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:58:42.320450 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-da6456f7-62ab-4457-ad3e-e12e12ca0a06 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:58:42.466762 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-da6456f7-62ab-4457-ad3e-e12e12ca0a06 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:58:42.475789 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-da6456f7-62ab-4457-ad3e-e12e12ca0a06 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe" status: 200 len: 1690 microversion: 2.1 time: 0.169155 Oct 30 01:58:42.476939 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3314/6621] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:58:42 2022] GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe => generated 1690 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:58:43.499800 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-816f3d5a-a47c-498e-a7c1-d5abd241328c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:58:43.500661 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-816f3d5a-a47c-498e-a7c1-d5abd241328c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7694b2a7-b20e-41ed-8361-72aec7975dfe] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:58:43.508751 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-816f3d5a-a47c-498e-a7c1-d5abd241328c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:58:43.509249 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-816f3d5a-a47c-498e-a7c1-d5abd241328c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:58:43.509845 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-816f3d5a-a47c-498e-a7c1-d5abd241328c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:58:43.510622 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-816f3d5a-a47c-498e-a7c1-d5abd241328c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:58:43.511226 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-816f3d5a-a47c-498e-a7c1-d5abd241328c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:58:43.511665 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-816f3d5a-a47c-498e-a7c1-d5abd241328c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:58:43.667368 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-816f3d5a-a47c-498e-a7c1-d5abd241328c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:58:43.675980 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-816f3d5a-a47c-498e-a7c1-d5abd241328c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe" status: 200 len: 1690 microversion: 2.1 time: 0.179988 Oct 30 01:58:43.690773 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3308/6622] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:58:43 2022] GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe => generated 1690 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:58:44.704083 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8609ab1b-c867-4851-931f-c07135c63b34 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:58:44.705737 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8609ab1b-c867-4851-931f-c07135c63b34 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7694b2a7-b20e-41ed-8361-72aec7975dfe] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:58:44.715684 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8609ab1b-c867-4851-931f-c07135c63b34 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:58:44.716504 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8609ab1b-c867-4851-931f-c07135c63b34 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:58:44.717980 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8609ab1b-c867-4851-931f-c07135c63b34 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:58:44.719053 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8609ab1b-c867-4851-931f-c07135c63b34 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:58:44.719743 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8609ab1b-c867-4851-931f-c07135c63b34 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:58:44.720420 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8609ab1b-c867-4851-931f-c07135c63b34 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:58:44.860701 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8609ab1b-c867-4851-931f-c07135c63b34 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:58:44.869473 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8609ab1b-c867-4851-931f-c07135c63b34 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe" status: 200 len: 1690 microversion: 2.1 time: 0.171778 Oct 30 01:58:44.870065 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3315/6623] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:58:44 2022] GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe => generated 1690 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:58:45.893762 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7350bba2-d66b-4b34-a4ab-93018cb10f82 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:58:45.895465 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7350bba2-d66b-4b34-a4ab-93018cb10f82 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7694b2a7-b20e-41ed-8361-72aec7975dfe] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:58:45.902700 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7350bba2-d66b-4b34-a4ab-93018cb10f82 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:58:45.903209 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7350bba2-d66b-4b34-a4ab-93018cb10f82 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:58:45.903703 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7350bba2-d66b-4b34-a4ab-93018cb10f82 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:58:45.904414 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7350bba2-d66b-4b34-a4ab-93018cb10f82 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:58:45.904876 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7350bba2-d66b-4b34-a4ab-93018cb10f82 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:58:45.905408 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7350bba2-d66b-4b34-a4ab-93018cb10f82 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:58:46.049514 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7350bba2-d66b-4b34-a4ab-93018cb10f82 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:58:46.057921 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7350bba2-d66b-4b34-a4ab-93018cb10f82 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe" status: 200 len: 1690 microversion: 2.1 time: 0.168217 Oct 30 01:58:46.058500 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3309/6624] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:58:45 2022] GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe => generated 1690 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:58:47.082113 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-072d6bdc-90c7-4610-8515-1197fc79d20d tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:58:47.082756 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-072d6bdc-90c7-4610-8515-1197fc79d20d tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7694b2a7-b20e-41ed-8361-72aec7975dfe] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:58:47.090949 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-072d6bdc-90c7-4610-8515-1197fc79d20d tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:58:47.091504 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-072d6bdc-90c7-4610-8515-1197fc79d20d tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:58:47.092034 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-072d6bdc-90c7-4610-8515-1197fc79d20d tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:58:47.092743 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-072d6bdc-90c7-4610-8515-1197fc79d20d tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:58:47.093570 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-072d6bdc-90c7-4610-8515-1197fc79d20d tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:58:47.094285 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-072d6bdc-90c7-4610-8515-1197fc79d20d tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:58:47.229649 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-072d6bdc-90c7-4610-8515-1197fc79d20d tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:58:47.238472 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-072d6bdc-90c7-4610-8515-1197fc79d20d tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe" status: 200 len: 1690 microversion: 2.1 time: 0.160747 Oct 30 01:58:47.239039 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3316/6625] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:58:47 2022] GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe => generated 1690 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:58:48.264504 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a36cb7a6-66b4-4b92-ae69-0b911fb9a6dd tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:58:48.265343 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a36cb7a6-66b4-4b92-ae69-0b911fb9a6dd tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7694b2a7-b20e-41ed-8361-72aec7975dfe] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:58:48.272162 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a36cb7a6-66b4-4b92-ae69-0b911fb9a6dd tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:58:48.273408 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a36cb7a6-66b4-4b92-ae69-0b911fb9a6dd tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:58:48.273923 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a36cb7a6-66b4-4b92-ae69-0b911fb9a6dd tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:58:48.274706 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a36cb7a6-66b4-4b92-ae69-0b911fb9a6dd tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:58:48.275164 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a36cb7a6-66b4-4b92-ae69-0b911fb9a6dd tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:58:48.276050 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a36cb7a6-66b4-4b92-ae69-0b911fb9a6dd tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:58:48.419984 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a36cb7a6-66b4-4b92-ae69-0b911fb9a6dd tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:58:48.427350 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a36cb7a6-66b4-4b92-ae69-0b911fb9a6dd tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe" status: 200 len: 1690 microversion: 2.1 time: 0.167064 Oct 30 01:58:48.428557 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3310/6626] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:58:48 2022] GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe => generated 1690 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:58:49.452698 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c3fd09a7-9681-41f0-bbd5-526272d320dc tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:58:49.455073 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c3fd09a7-9681-41f0-bbd5-526272d320dc tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7694b2a7-b20e-41ed-8361-72aec7975dfe] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:58:49.462583 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c3fd09a7-9681-41f0-bbd5-526272d320dc tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:58:49.463071 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c3fd09a7-9681-41f0-bbd5-526272d320dc tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:58:49.463571 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c3fd09a7-9681-41f0-bbd5-526272d320dc tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:58:49.464501 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c3fd09a7-9681-41f0-bbd5-526272d320dc tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:58:49.464962 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c3fd09a7-9681-41f0-bbd5-526272d320dc tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:58:49.465420 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c3fd09a7-9681-41f0-bbd5-526272d320dc tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:58:49.773091 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c3fd09a7-9681-41f0-bbd5-526272d320dc tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:58:49.781275 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c3fd09a7-9681-41f0-bbd5-526272d320dc tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe" status: 200 len: 1690 microversion: 2.1 time: 0.332534 Oct 30 01:58:49.782040 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3317/6627] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:58:49 2022] GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe => generated 1690 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:58:50.804962 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8b4d142f-2387-436b-8d87-432e858ad13c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:58:50.805891 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8b4d142f-2387-436b-8d87-432e858ad13c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7694b2a7-b20e-41ed-8361-72aec7975dfe] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:58:50.812774 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8b4d142f-2387-436b-8d87-432e858ad13c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:58:50.813266 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8b4d142f-2387-436b-8d87-432e858ad13c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:58:50.813740 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8b4d142f-2387-436b-8d87-432e858ad13c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:58:50.814448 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8b4d142f-2387-436b-8d87-432e858ad13c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:58:50.814905 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8b4d142f-2387-436b-8d87-432e858ad13c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:58:50.815333 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8b4d142f-2387-436b-8d87-432e858ad13c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:58:50.955624 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8b4d142f-2387-436b-8d87-432e858ad13c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:58:50.965623 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8b4d142f-2387-436b-8d87-432e858ad13c tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe" status: 200 len: 1690 microversion: 2.1 time: 0.164493 Oct 30 01:58:50.967375 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3311/6628] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:58:50 2022] GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe => generated 1690 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:58:51.990163 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-eabb0d3d-b9d3-42b2-9cab-8d613c53238a tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:58:51.990830 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-eabb0d3d-b9d3-42b2-9cab-8d613c53238a tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7694b2a7-b20e-41ed-8361-72aec7975dfe] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:58:51.999675 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eabb0d3d-b9d3-42b2-9cab-8d613c53238a tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:58:52.000303 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eabb0d3d-b9d3-42b2-9cab-8d613c53238a tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:58:52.000791 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eabb0d3d-b9d3-42b2-9cab-8d613c53238a tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:58:52.001530 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eabb0d3d-b9d3-42b2-9cab-8d613c53238a tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:58:52.001981 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eabb0d3d-b9d3-42b2-9cab-8d613c53238a tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:58:52.002404 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eabb0d3d-b9d3-42b2-9cab-8d613c53238a tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:58:52.479920 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-eabb0d3d-b9d3-42b2-9cab-8d613c53238a tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:58:52.488182 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-eabb0d3d-b9d3-42b2-9cab-8d613c53238a tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe" status: 200 len: 1690 microversion: 2.1 time: 0.501956 Oct 30 01:58:52.488764 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3318/6629] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:58:51 2022] GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe => generated 1690 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:58:53.512079 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ff4c6151-c8d0-47ba-af74-fe7bc84741ec tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:58:53.512764 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ff4c6151-c8d0-47ba-af74-fe7bc84741ec tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7694b2a7-b20e-41ed-8361-72aec7975dfe] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:58:53.520510 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ff4c6151-c8d0-47ba-af74-fe7bc84741ec tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:58:53.521001 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ff4c6151-c8d0-47ba-af74-fe7bc84741ec tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:58:53.521460 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ff4c6151-c8d0-47ba-af74-fe7bc84741ec tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:58:53.522158 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ff4c6151-c8d0-47ba-af74-fe7bc84741ec tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:58:53.522612 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ff4c6151-c8d0-47ba-af74-fe7bc84741ec tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:58:53.523192 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ff4c6151-c8d0-47ba-af74-fe7bc84741ec tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:58:53.658880 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ff4c6151-c8d0-47ba-af74-fe7bc84741ec tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:58:53.667676 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ff4c6151-c8d0-47ba-af74-fe7bc84741ec tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe" status: 200 len: 1690 microversion: 2.1 time: 0.159436 Oct 30 01:58:53.668165 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3312/6630] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:58:53 2022] GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:58:54.690612 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4a9e8c75-59dd-4169-8c03-e09094146812 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:58:54.691216 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4a9e8c75-59dd-4169-8c03-e09094146812 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7694b2a7-b20e-41ed-8361-72aec7975dfe] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:58:54.698921 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a9e8c75-59dd-4169-8c03-e09094146812 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:58:54.699399 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a9e8c75-59dd-4169-8c03-e09094146812 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:58:54.699831 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a9e8c75-59dd-4169-8c03-e09094146812 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:58:54.700515 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a9e8c75-59dd-4169-8c03-e09094146812 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:58:54.700967 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a9e8c75-59dd-4169-8c03-e09094146812 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:58:54.701482 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a9e8c75-59dd-4169-8c03-e09094146812 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:58:54.831971 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4a9e8c75-59dd-4169-8c03-e09094146812 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:58:54.840180 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4a9e8c75-59dd-4169-8c03-e09094146812 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe" status: 200 len: 1690 microversion: 2.1 time: 0.153517 Oct 30 01:58:54.840754 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3319/6631] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:58:54 2022] GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe => generated 1690 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:58:55.863950 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-32720d9a-2cf5-439f-bdd7-995e83400999 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:58:55.864548 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-32720d9a-2cf5-439f-bdd7-995e83400999 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7694b2a7-b20e-41ed-8361-72aec7975dfe] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:58:55.871944 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-32720d9a-2cf5-439f-bdd7-995e83400999 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:58:55.872445 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-32720d9a-2cf5-439f-bdd7-995e83400999 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:58:55.872905 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-32720d9a-2cf5-439f-bdd7-995e83400999 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:58:55.873614 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-32720d9a-2cf5-439f-bdd7-995e83400999 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:58:55.874075 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-32720d9a-2cf5-439f-bdd7-995e83400999 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:58:55.878315 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-32720d9a-2cf5-439f-bdd7-995e83400999 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:58:56.086831 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-32720d9a-2cf5-439f-bdd7-995e83400999 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:58:56.096465 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-32720d9a-2cf5-439f-bdd7-995e83400999 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe" status: 200 len: 1690 microversion: 2.1 time: 0.236478 Oct 30 01:58:56.097149 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3313/6632] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:58:55 2022] GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe => generated 1690 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:58:57.120333 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-48296097-4b93-45c4-9945-ba3857b0e197 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:58:57.120942 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-48296097-4b93-45c4-9945-ba3857b0e197 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7694b2a7-b20e-41ed-8361-72aec7975dfe] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:58:57.127883 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-48296097-4b93-45c4-9945-ba3857b0e197 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:58:57.128365 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-48296097-4b93-45c4-9945-ba3857b0e197 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:58:57.128799 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-48296097-4b93-45c4-9945-ba3857b0e197 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:58:57.129560 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-48296097-4b93-45c4-9945-ba3857b0e197 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:58:57.130012 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-48296097-4b93-45c4-9945-ba3857b0e197 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:58:57.130433 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-48296097-4b93-45c4-9945-ba3857b0e197 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:58:57.294855 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-48296097-4b93-45c4-9945-ba3857b0e197 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:58:57.303643 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-48296097-4b93-45c4-9945-ba3857b0e197 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe" status: 200 len: 1690 microversion: 2.1 time: 0.187666 Oct 30 01:58:57.305440 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3320/6633] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:58:57 2022] GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe => generated 1690 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:58:58.328170 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9c89e617-cc94-43c8-b229-13d6efaf52f0 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:58:58.328777 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9c89e617-cc94-43c8-b229-13d6efaf52f0 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7694b2a7-b20e-41ed-8361-72aec7975dfe] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:58:58.335721 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9c89e617-cc94-43c8-b229-13d6efaf52f0 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:58:58.336206 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9c89e617-cc94-43c8-b229-13d6efaf52f0 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:58:58.336644 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9c89e617-cc94-43c8-b229-13d6efaf52f0 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:58:58.337355 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9c89e617-cc94-43c8-b229-13d6efaf52f0 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:58:58.337812 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9c89e617-cc94-43c8-b229-13d6efaf52f0 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:58:58.338236 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9c89e617-cc94-43c8-b229-13d6efaf52f0 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:58:58.486926 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9c89e617-cc94-43c8-b229-13d6efaf52f0 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:58:58.496024 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9c89e617-cc94-43c8-b229-13d6efaf52f0 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe" status: 200 len: 1696 microversion: 2.1 time: 0.171781 Oct 30 01:58:58.496612 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3314/6634] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:58:58 2022] GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe => generated 1696 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:58:59.519739 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-630b90df-fcc1-47d3-abae-822802d74a35 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:58:59.520477 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-630b90df-fcc1-47d3-abae-822802d74a35 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7694b2a7-b20e-41ed-8361-72aec7975dfe] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:58:59.528782 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-630b90df-fcc1-47d3-abae-822802d74a35 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:58:59.529276 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-630b90df-fcc1-47d3-abae-822802d74a35 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:58:59.529759 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-630b90df-fcc1-47d3-abae-822802d74a35 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:58:59.530461 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-630b90df-fcc1-47d3-abae-822802d74a35 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:58:59.531177 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-630b90df-fcc1-47d3-abae-822802d74a35 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:58:59.531341 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-630b90df-fcc1-47d3-abae-822802d74a35 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:58:59.674909 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-630b90df-fcc1-47d3-abae-822802d74a35 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:58:59.683195 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-630b90df-fcc1-47d3-abae-822802d74a35 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe" status: 200 len: 1696 microversion: 2.1 time: 0.167415 Oct 30 01:58:59.683763 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3321/6635] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:58:59 2022] GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe => generated 1696 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:59:00.707393 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a7c599b0-f10d-46b8-954e-a0911515e88b tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:59:00.708544 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a7c599b0-f10d-46b8-954e-a0911515e88b tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7694b2a7-b20e-41ed-8361-72aec7975dfe] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:59:00.715802 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a7c599b0-f10d-46b8-954e-a0911515e88b tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:59:00.716297 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a7c599b0-f10d-46b8-954e-a0911515e88b tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:59:00.717112 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a7c599b0-f10d-46b8-954e-a0911515e88b tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:59:00.717475 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a7c599b0-f10d-46b8-954e-a0911515e88b tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:59:00.717935 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a7c599b0-f10d-46b8-954e-a0911515e88b tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:59:00.718363 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a7c599b0-f10d-46b8-954e-a0911515e88b tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:59:00.890370 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a7c599b0-f10d-46b8-954e-a0911515e88b tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:59:00.902636 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a7c599b0-f10d-46b8-954e-a0911515e88b tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe" status: 200 len: 1681 microversion: 2.1 time: 0.199040 Oct 30 01:59:00.921377 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3315/6636] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:59:00 2022] GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe => generated 1681 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:59:01.561709 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-79968ceb-7dc7-4ce1-aaf1-22417e1c634f req-8be2b0a1-5308-4351-958f-9fa33d319584 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7694b2a7-b20e-41ed-8361-72aec7975dfe", "name": "network-vif-plugged", "status": "completed", "tag": "09aebc2a-7191-4613-801c-111ebcad7ac3"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:59:01.572330 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-79968ceb-7dc7-4ce1-aaf1-22417e1c634f req-8be2b0a1-5308-4351-958f-9fa33d319584 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:59:01.572863 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-79968ceb-7dc7-4ce1-aaf1-22417e1c634f req-8be2b0a1-5308-4351-958f-9fa33d319584 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:59:01.573297 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-79968ceb-7dc7-4ce1-aaf1-22417e1c634f req-8be2b0a1-5308-4351-958f-9fa33d319584 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:59:01.584909 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-79968ceb-7dc7-4ce1-aaf1-22417e1c634f req-8be2b0a1-5308-4351-958f-9fa33d319584 service nova] Creating event network-vif-plugged:09aebc2a-7191-4613-801c-111ebcad7ac3 for instance 7694b2a7-b20e-41ed-8361-72aec7975dfe on n-h1-master-1 Oct 30 01:59:01.591109 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-79968ceb-7dc7-4ce1-aaf1-22417e1c634f req-8be2b0a1-5308-4351-958f-9fa33d319584 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033101 Oct 30 01:59:01.592039 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3322/6637] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:59:25.119104 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ba3db916-fa24-4706-a3e7-4959ee4a2a37 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:59:25.121455 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ba3db916-fa24-4706-a3e7-4959ee4a2a37 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7694b2a7-b20e-41ed-8361-72aec7975dfe] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:59:25.123821 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=24 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:59:25.124676 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:59:25.129882 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ba3db916-fa24-4706-a3e7-4959ee4a2a37 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:59:25.130366 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ba3db916-fa24-4706-a3e7-4959ee4a2a37 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:59:25.130813 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ba3db916-fa24-4706-a3e7-4959ee4a2a37 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:59:25.131581 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ba3db916-fa24-4706-a3e7-4959ee4a2a37 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:59:25.132048 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ba3db916-fa24-4706-a3e7-4959ee4a2a37 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:59:25.132484 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ba3db916-fa24-4706-a3e7-4959ee4a2a37 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:59:25.200035 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ba3db916-fa24-4706-a3e7-4959ee4a2a37 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "POST /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe/action" status: 200 len: 24574 microversion: 2.1 time: 0.085764 Oct 30 01:59:25.200737 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3316/6638] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 01:59:25 2022] POST /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe/action => generated 24574 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 01:59:32.536323 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=20 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:59:32.539763 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-89461e41-040b-4b24-a80b-f9d4e2d0c5d8 req-f5fdb63c-c14d-4fa2-bc58-8fc66c5ec3ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7694b2a7-b20e-41ed-8361-72aec7975dfe", "tag": "09aebc2a-7191-4613-801c-111ebcad7ac3"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:59:32.540709 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=56 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:59:32.545039 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ae349aa9-b5fe-4aa8-9362-a1ba88e779ea tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:59:32.550033 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ae349aa9-b5fe-4aa8-9362-a1ba88e779ea tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7694b2a7-b20e-41ed-8361-72aec7975dfe] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:59:32.560989 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae349aa9-b5fe-4aa8-9362-a1ba88e779ea tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:59:32.565293 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-89461e41-040b-4b24-a80b-f9d4e2d0c5d8 req-f5fdb63c-c14d-4fa2-bc58-8fc66c5ec3ae service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:59:32.566098 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae349aa9-b5fe-4aa8-9362-a1ba88e779ea tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:59:32.566731 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae349aa9-b5fe-4aa8-9362-a1ba88e779ea tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:59:32.567622 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae349aa9-b5fe-4aa8-9362-a1ba88e779ea tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:59:32.568248 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae349aa9-b5fe-4aa8-9362-a1ba88e779ea tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:59:32.568901 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae349aa9-b5fe-4aa8-9362-a1ba88e779ea tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:59:32.569598 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-89461e41-040b-4b24-a80b-f9d4e2d0c5d8 req-f5fdb63c-c14d-4fa2-bc58-8fc66c5ec3ae service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:59:32.573880 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-89461e41-040b-4b24-a80b-f9d4e2d0c5d8 req-f5fdb63c-c14d-4fa2-bc58-8fc66c5ec3ae service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:59:32.596041 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-89461e41-040b-4b24-a80b-f9d4e2d0c5d8 req-f5fdb63c-c14d-4fa2-bc58-8fc66c5ec3ae service nova] Creating event network-changed:09aebc2a-7191-4613-801c-111ebcad7ac3 for instance 7694b2a7-b20e-41ed-8361-72aec7975dfe on n-h1-master-1 Oct 30 01:59:32.607016 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-89461e41-040b-4b24-a80b-f9d4e2d0c5d8 req-f5fdb63c-c14d-4fa2-bc58-8fc66c5ec3ae service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073778 Oct 30 01:59:32.608272 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3317/6639] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:59:32.619273 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ae349aa9-b5fe-4aa8-9362-a1ba88e779ea tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7694b2a7-b20e-41ed-8361-72aec7975dfe] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:59:32.952351 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ae349aa9-b5fe-4aa8-9362-a1ba88e779ea tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe" status: 204 len: 0 microversion: 2.1 time: 0.422640 Oct 30 01:59:32.953088 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3323/6640] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:59:32 2022] DELETE /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:59:32.963843 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6ca29060-9043-450d-995a-eb889b95a9c3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:59:32.964660 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6ca29060-9043-450d-995a-eb889b95a9c3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7694b2a7-b20e-41ed-8361-72aec7975dfe] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:59:32.973024 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ca29060-9043-450d-995a-eb889b95a9c3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:59:32.973649 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ca29060-9043-450d-995a-eb889b95a9c3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:59:32.974165 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ca29060-9043-450d-995a-eb889b95a9c3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:59:32.975505 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ca29060-9043-450d-995a-eb889b95a9c3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:59:32.976044 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ca29060-9043-450d-995a-eb889b95a9c3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:59:32.976702 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ca29060-9043-450d-995a-eb889b95a9c3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:59:33.129257 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6ca29060-9043-450d-995a-eb889b95a9c3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:59:33.139497 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6ca29060-9043-450d-995a-eb889b95a9c3 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe" status: 200 len: 1687 microversion: 2.1 time: 0.181607 Oct 30 01:59:33.157923 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3318/6641] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:59:32 2022] GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe => generated 1687 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:59:34.165934 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b0556e5c-2349-45c4-b419-b82ba6e6a9fe tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:59:34.166708 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b0556e5c-2349-45c4-b419-b82ba6e6a9fe tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7694b2a7-b20e-41ed-8361-72aec7975dfe] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:59:34.173475 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0556e5c-2349-45c4-b419-b82ba6e6a9fe tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:59:34.173962 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0556e5c-2349-45c4-b419-b82ba6e6a9fe tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:59:34.174396 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0556e5c-2349-45c4-b419-b82ba6e6a9fe tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:59:34.177950 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0556e5c-2349-45c4-b419-b82ba6e6a9fe tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:59:34.177950 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0556e5c-2349-45c4-b419-b82ba6e6a9fe tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:59:34.177950 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0556e5c-2349-45c4-b419-b82ba6e6a9fe tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:59:34.354460 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b0556e5c-2349-45c4-b419-b82ba6e6a9fe tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:59:34.362548 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b0556e5c-2349-45c4-b419-b82ba6e6a9fe tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe" status: 200 len: 1687 microversion: 2.1 time: 0.201543 Oct 30 01:59:34.363120 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3324/6642] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:59:34 2022] GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe => generated 1687 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:59:35.166978 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-c3e45620-f6dc-4521-9c35-a4bed8c0df3c req-149f71b5-5ee9-4f52-aa5b-4377277e96e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7694b2a7-b20e-41ed-8361-72aec7975dfe", "name": "network-vif-deleted", "tag": "09aebc2a-7191-4613-801c-111ebcad7ac3"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:59:35.176884 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-c3e45620-f6dc-4521-9c35-a4bed8c0df3c req-149f71b5-5ee9-4f52-aa5b-4377277e96e8 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:59:35.177401 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-c3e45620-f6dc-4521-9c35-a4bed8c0df3c req-149f71b5-5ee9-4f52-aa5b-4377277e96e8 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:59:35.177838 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-c3e45620-f6dc-4521-9c35-a4bed8c0df3c req-149f71b5-5ee9-4f52-aa5b-4377277e96e8 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:59:35.190390 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-c3e45620-f6dc-4521-9c35-a4bed8c0df3c req-149f71b5-5ee9-4f52-aa5b-4377277e96e8 service nova] Creating event network-vif-deleted:09aebc2a-7191-4613-801c-111ebcad7ac3 for instance 7694b2a7-b20e-41ed-8361-72aec7975dfe on n-h1-master-1 Oct 30 01:59:35.195957 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-c3e45620-f6dc-4521-9c35-a4bed8c0df3c req-149f71b5-5ee9-4f52-aa5b-4377277e96e8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032923 Oct 30 01:59:35.198905 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3319/6643] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 01:59:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:59:35.386901 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-57693ac6-3a42-45bd-a1ef-ca014e6ac1b8 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:59:35.387547 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-57693ac6-3a42-45bd-a1ef-ca014e6ac1b8 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7694b2a7-b20e-41ed-8361-72aec7975dfe] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:59:35.395069 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-57693ac6-3a42-45bd-a1ef-ca014e6ac1b8 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:59:35.395556 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-57693ac6-3a42-45bd-a1ef-ca014e6ac1b8 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:59:35.396083 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-57693ac6-3a42-45bd-a1ef-ca014e6ac1b8 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:59:35.396823 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-57693ac6-3a42-45bd-a1ef-ca014e6ac1b8 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:59:35.397280 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-57693ac6-3a42-45bd-a1ef-ca014e6ac1b8 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:59:35.397735 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-57693ac6-3a42-45bd-a1ef-ca014e6ac1b8 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:59:35.473934 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-57693ac6-3a42-45bd-a1ef-ca014e6ac1b8 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f51fe515ee4375a252a8d8a98ec77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bf165fe12748b29e66ea4f61364aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:59:35.496366 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-57693ac6-3a42-45bd-a1ef-ca014e6ac1b8 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe" status: 200 len: 1351 microversion: 2.1 time: 0.113248 Oct 30 01:59:35.514438 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3325/6644] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:59:35 2022] GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe => generated 1351 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:59:36.525036 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-513343f2-9524-4de3-b2d2-9b0b7736f4a2 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:59:36.526851 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-513343f2-9524-4de3-b2d2-9b0b7736f4a2 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] [instance: 7694b2a7-b20e-41ed-8361-72aec7975dfe] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:59:36.533968 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-513343f2-9524-4de3-b2d2-9b0b7736f4a2 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:59:36.534824 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-513343f2-9524-4de3-b2d2-9b0b7736f4a2 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:59:36.535546 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-513343f2-9524-4de3-b2d2-9b0b7736f4a2 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:59:36.536980 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-513343f2-9524-4de3-b2d2-9b0b7736f4a2 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:59:36.537873 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-513343f2-9524-4de3-b2d2-9b0b7736f4a2 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:59:36.538521 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-513343f2-9524-4de3-b2d2-9b0b7736f4a2 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:59:36.554937 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-513343f2-9524-4de3-b2d2-9b0b7736f4a2 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] HTTP exception thrown: Instance 7694b2a7-b20e-41ed-8361-72aec7975dfe could not be found. Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-513343f2-9524-4de3-b2d2-9b0b7736f4a2 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Request method failure captured: Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe HTTP/1.1 Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdi5g692Uv5xl51AXx_zH5DqygQV5gilQk65Zrt4awXG-qNzrnkspnA78K5Gla_Xr75NP6Y6TYXCTZgpS6AZ1uwBTWQJyiZW5VCW1eOoSX9Nhid2ZA0O0wE2AoU3HGyFGPzUs9NxTgw8u0D_JE9Zhgtle7Vspzqc0hxjWXJSlhOuR44 Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: f2bf165fe12748b29e66ea4f61364aef Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1545186841 Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f2bf165fe12748b29e66ea4f61364aef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f2bf165fe12748b29e66ea4f61364aef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f2bf165fe12748b29e66ea4f61364aef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f2bf165fe12748b29e66ea4f61364aef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1545186841 Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: f2bf165fe12748b29e66ea4f61364aef Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1545186841 Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-TestNetworkAdvancedServerOps-1545186841-project Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: f0f51fe515ee4375a252a8d8a98ec77b Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1545186841-project Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 7694b2a7-b20e-41ed-8361-72aec7975dfe could not be found. Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '7694b2a7-b20e-41ed-8361-72aec7975dfe'} Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7694b2a7-b20e-41ed-8361-72aec7975dfe could not be found. Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7694b2a7-b20e-41ed-8361-72aec7975dfe could not be found. Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:59:36.556996 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:59:36.563062 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:59:36.563062 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:59:36.563062 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:59:36.563062 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:59:36.563062 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:59:36.563062 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:59:36.563062 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7694b2a7-b20e-41ed-8361-72aec7975dfe could not be found. Oct 30 01:59:36.563062 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 01:59:36.563062 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-513343f2-9524-4de3-b2d2-9b0b7736f4a2 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Returning 404 to user: Instance 7694b2a7-b20e-41ed-8361-72aec7975dfe could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:59:36.563062 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-513343f2-9524-4de3-b2d2-9b0b7736f4a2 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe" status: 404 len: 111 microversion: 2.1 time: 0.039030 Oct 30 01:59:36.563062 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3320/6645] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:59:36 2022] GET /compute/v2.1/servers/7694b2a7-b20e-41ed-8361-72aec7975dfe => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:59:40.844604 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-931a2119-2238-4c7d-b141-b03d26bcbf14 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] Calling method '.version_select at 0x7f44c6d714c0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:59:40.948116 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-931a2119-2238-4c7d-b141-b03d26bcbf14 tempest-TestNetworkAdvancedServerOps-1545186841 tempest-TestNetworkAdvancedServerOps-1545186841-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-876002968" status: 202 len: 0 microversion: 2.1 time: 0.107846 Oct 30 01:59:40.948716 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3326/6646] 10.222.0.13 () {58 vars in 1281 bytes} [Sun Oct 30 01:59:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-876002968 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:59:58.531687 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=10 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:59:58.533351 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=16 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:59:58.734010 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-115d9e18-cf3c-481e-899d-dec141aca4b8 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:59:58.736142 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-115d9e18-cf3c-481e-899d-dec141aca4b8 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:59:58.736815 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-115d9e18-cf3c-481e-899d-dec141aca4b8 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:59:58.737638 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-115d9e18-cf3c-481e-899d-dec141aca4b8 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:59:58.738608 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-115d9e18-cf3c-481e-899d-dec141aca4b8 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:59:58.739258 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-115d9e18-cf3c-481e-899d-dec141aca4b8 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:59:58.740146 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-115d9e18-cf3c-481e-899d-dec141aca4b8 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:59:58.781416 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-115d9e18-cf3c-481e-899d-dec141aca4b8 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] 10.222.0.13 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.257175 Oct 30 01:59:58.791271 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3321/6647] 10.222.0.13 () {58 vars in 1185 bytes} [Sun Oct 30 01:59:58 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:59:58.918847 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-22b0d17e-37d1-4e34-8b23-ceea5224aed6 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-26502412", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "availability_zone": "nova:n-h2-master-1", "networks": [{"uuid": "a567ff36-2490-4144-9716-0766b659f967"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:59:58.932242 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:59:58.933017 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:59:59.004801 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-22b0d17e-37d1-4e34-8b23-ceea5224aed6 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] validate_networks() for [('a567ff36-2490-4144-9716-0766b659f967', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:59:59.756135 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-22b0d17e-37d1-4e34-8b23-ceea5224aed6 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:59:59.756564 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-22b0d17e-37d1-4e34-8b23-ceea5224aed6 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:59:59.757040 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-22b0d17e-37d1-4e34-8b23-ceea5224aed6 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:59:59.757496 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-22b0d17e-37d1-4e34-8b23-ceea5224aed6 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:59:59.757909 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-22b0d17e-37d1-4e34-8b23-ceea5224aed6 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:59:59.770226 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-22b0d17e-37d1-4e34-8b23-ceea5224aed6 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:59:59.771562 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-22b0d17e-37d1-4e34-8b23-ceea5224aed6 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:59:59.772212 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-22b0d17e-37d1-4e34-8b23-ceea5224aed6 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:59:59.773282 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-22b0d17e-37d1-4e34-8b23-ceea5224aed6 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:59:59.773928 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-22b0d17e-37d1-4e34-8b23-ceea5224aed6 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:59:59.774521 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-22b0d17e-37d1-4e34-8b23-ceea5224aed6 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:59:59.797533 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-22b0d17e-37d1-4e34-8b23-ceea5224aed6 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Getting quotas for project d34dd5457509403092ddffb5289fcbc9. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:59:59.805586 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-22b0d17e-37d1-4e34-8b23-ceea5224aed6 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Getting quotas for user 8444f27f53f342d6afff548d2caf79a9 and project d34dd5457509403092ddffb5289fcbc9. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:59:59.821851 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-22b0d17e-37d1-4e34-8b23-ceea5224aed6 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:59:59.824757 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-22b0d17e-37d1-4e34-8b23-ceea5224aed6 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] [instance: 9e50588f-b014-4922-849b-aa216c3dd25d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:59:59.964745 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-22b0d17e-37d1-4e34-8b23-ceea5224aed6 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.055975 Oct 30 01:59:59.965891 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3327/6648] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:59:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1058 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 30 01:59:59.981793 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-46c49ff5-0c03-4ba9-99af-759f5c2ae2f7 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:59:59.982439 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-46c49ff5-0c03-4ba9-99af-759f5c2ae2f7 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] [instance: 9e50588f-b014-4922-849b-aa216c3dd25d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:00:00.108083 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-46c49ff5-0c03-4ba9-99af-759f5c2ae2f7 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/9e50588f-b014-4922-849b-aa216c3dd25d" status: 200 len: 1327 microversion: 2.1 time: 0.130546 Oct 30 02:00:00.109598 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3322/6649] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:59:59 2022] GET /compute/v2.1/servers/9e50588f-b014-4922-849b-aa216c3dd25d => generated 1327 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:00:01.133985 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-67cfcd4b-a2b0-4fe3-bc3a-b3cd805e3de5 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:00:01.134868 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-67cfcd4b-a2b0-4fe3-bc3a-b3cd805e3de5 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] [instance: 9e50588f-b014-4922-849b-aa216c3dd25d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:00:01.142447 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67cfcd4b-a2b0-4fe3-bc3a-b3cd805e3de5 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:01.143082 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67cfcd4b-a2b0-4fe3-bc3a-b3cd805e3de5 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:01.143530 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67cfcd4b-a2b0-4fe3-bc3a-b3cd805e3de5 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:01.144233 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67cfcd4b-a2b0-4fe3-bc3a-b3cd805e3de5 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:01.144934 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67cfcd4b-a2b0-4fe3-bc3a-b3cd805e3de5 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:01.145452 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67cfcd4b-a2b0-4fe3-bc3a-b3cd805e3de5 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:01.224066 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-67cfcd4b-a2b0-4fe3-bc3a-b3cd805e3de5 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/9e50588f-b014-4922-849b-aa216c3dd25d" status: 200 len: 1344 microversion: 2.1 time: 0.095465 Oct 30 02:00:01.225833 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3328/6650] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:00:01 2022] GET /compute/v2.1/servers/9e50588f-b014-4922-849b-aa216c3dd25d => generated 1344 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:00:02.248824 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d0971f7e-a5cf-4bba-a67a-60219ec8e806 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:00:02.249569 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d0971f7e-a5cf-4bba-a67a-60219ec8e806 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] [instance: 9e50588f-b014-4922-849b-aa216c3dd25d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:00:02.260510 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d0971f7e-a5cf-4bba-a67a-60219ec8e806 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:02.261306 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d0971f7e-a5cf-4bba-a67a-60219ec8e806 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:02.262198 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d0971f7e-a5cf-4bba-a67a-60219ec8e806 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:02.263355 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d0971f7e-a5cf-4bba-a67a-60219ec8e806 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:02.264224 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d0971f7e-a5cf-4bba-a67a-60219ec8e806 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:02.264873 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d0971f7e-a5cf-4bba-a67a-60219ec8e806 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:02.353559 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d0971f7e-a5cf-4bba-a67a-60219ec8e806 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/9e50588f-b014-4922-849b-aa216c3dd25d" status: 200 len: 1414 microversion: 2.1 time: 0.094593 Oct 30 02:00:02.353559 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3323/6651] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:00:02 2022] GET /compute/v2.1/servers/9e50588f-b014-4922-849b-aa216c3dd25d => generated 1414 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:00:03.367010 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b9dd71d5-e9b0-4a74-8e43-a6a8f1b3f240 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:00:03.367625 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b9dd71d5-e9b0-4a74-8e43-a6a8f1b3f240 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] [instance: 9e50588f-b014-4922-849b-aa216c3dd25d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:00:03.383551 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b9dd71d5-e9b0-4a74-8e43-a6a8f1b3f240 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:03.384060 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b9dd71d5-e9b0-4a74-8e43-a6a8f1b3f240 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:03.384502 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b9dd71d5-e9b0-4a74-8e43-a6a8f1b3f240 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:03.385210 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b9dd71d5-e9b0-4a74-8e43-a6a8f1b3f240 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:03.390075 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b9dd71d5-e9b0-4a74-8e43-a6a8f1b3f240 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:03.390741 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b9dd71d5-e9b0-4a74-8e43-a6a8f1b3f240 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:03.485363 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b9dd71d5-e9b0-4a74-8e43-a6a8f1b3f240 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/9e50588f-b014-4922-849b-aa216c3dd25d" status: 200 len: 1420 microversion: 2.1 time: 0.121998 Oct 30 02:00:03.487708 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3329/6652] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:00:03 2022] GET /compute/v2.1/servers/9e50588f-b014-4922-849b-aa216c3dd25d => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:00:04.510644 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e2e9d01a-d0ca-4064-8ef0-140df75ec3c3 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:00:04.511110 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e2e9d01a-d0ca-4064-8ef0-140df75ec3c3 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] [instance: 9e50588f-b014-4922-849b-aa216c3dd25d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:00:04.529696 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2e9d01a-d0ca-4064-8ef0-140df75ec3c3 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:04.530545 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2e9d01a-d0ca-4064-8ef0-140df75ec3c3 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:04.531252 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2e9d01a-d0ca-4064-8ef0-140df75ec3c3 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:04.532298 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2e9d01a-d0ca-4064-8ef0-140df75ec3c3 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:04.532940 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2e9d01a-d0ca-4064-8ef0-140df75ec3c3 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:04.533757 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2e9d01a-d0ca-4064-8ef0-140df75ec3c3 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:04.862788 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e2e9d01a-d0ca-4064-8ef0-140df75ec3c3 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/9e50588f-b014-4922-849b-aa216c3dd25d" status: 200 len: 1462 microversion: 2.1 time: 0.356149 Oct 30 02:00:04.882573 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3324/6653] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:00:04 2022] GET /compute/v2.1/servers/9e50588f-b014-4922-849b-aa216c3dd25d => generated 1462 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:00:05.266601 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-f701f8d7-8c8b-4892-971b-6a55004f3268 req-3bd01def-fdd3-4494-8d72-ff9cbdb61c84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e50588f-b014-4922-849b-aa216c3dd25d", "tag": "f35030ad-9d94-42d3-93c7-26cb0f7e84d2"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:00:05.279928 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-f701f8d7-8c8b-4892-971b-6a55004f3268 req-3bd01def-fdd3-4494-8d72-ff9cbdb61c84 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:05.280863 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-f701f8d7-8c8b-4892-971b-6a55004f3268 req-3bd01def-fdd3-4494-8d72-ff9cbdb61c84 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:05.281594 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-f701f8d7-8c8b-4892-971b-6a55004f3268 req-3bd01def-fdd3-4494-8d72-ff9cbdb61c84 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:05.293947 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-f701f8d7-8c8b-4892-971b-6a55004f3268 req-3bd01def-fdd3-4494-8d72-ff9cbdb61c84 service nova] Creating event network-changed:f35030ad-9d94-42d3-93c7-26cb0f7e84d2 for instance 9e50588f-b014-4922-849b-aa216c3dd25d on n-h2-master-1 Oct 30 02:00:05.304097 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-f701f8d7-8c8b-4892-971b-6a55004f3268 req-3bd01def-fdd3-4494-8d72-ff9cbdb61c84 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038769 Oct 30 02:00:05.307051 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3330/6654] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:00:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:00:05.889424 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-620956a2-0936-4373-9361-5eda405811b1 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:00:05.890657 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-620956a2-0936-4373-9361-5eda405811b1 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] [instance: 9e50588f-b014-4922-849b-aa216c3dd25d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:00:05.899799 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-620956a2-0936-4373-9361-5eda405811b1 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:05.900302 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-620956a2-0936-4373-9361-5eda405811b1 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:05.900745 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-620956a2-0936-4373-9361-5eda405811b1 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:05.901490 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-620956a2-0936-4373-9361-5eda405811b1 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:05.902002 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-620956a2-0936-4373-9361-5eda405811b1 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:05.902847 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-620956a2-0936-4373-9361-5eda405811b1 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:06.110428 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-620956a2-0936-4373-9361-5eda405811b1 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/9e50588f-b014-4922-849b-aa216c3dd25d" status: 200 len: 1462 microversion: 2.1 time: 0.226507 Oct 30 02:00:06.110428 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3325/6655] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:00:05 2022] GET /compute/v2.1/servers/9e50588f-b014-4922-849b-aa216c3dd25d => generated 1462 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:00:07.133051 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-33ccaa92-8ddc-422b-bf07-4664b0f1a559 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:00:07.135536 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-33ccaa92-8ddc-422b-bf07-4664b0f1a559 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] [instance: 9e50588f-b014-4922-849b-aa216c3dd25d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:00:07.141144 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-33ccaa92-8ddc-422b-bf07-4664b0f1a559 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:07.141693 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-33ccaa92-8ddc-422b-bf07-4664b0f1a559 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:07.142138 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-33ccaa92-8ddc-422b-bf07-4664b0f1a559 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:07.142849 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-33ccaa92-8ddc-422b-bf07-4664b0f1a559 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:07.143625 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-33ccaa92-8ddc-422b-bf07-4664b0f1a559 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:07.144130 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-33ccaa92-8ddc-422b-bf07-4664b0f1a559 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:07.287514 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-33ccaa92-8ddc-422b-bf07-4664b0f1a559 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/9e50588f-b014-4922-849b-aa216c3dd25d" status: 200 len: 1462 microversion: 2.1 time: 0.159133 Oct 30 02:00:07.288103 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3331/6656] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:00:07 2022] GET /compute/v2.1/servers/9e50588f-b014-4922-849b-aa216c3dd25d => generated 1462 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:00:08.310732 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b6cd3c26-9a00-4716-aa7d-822483eaa6ff tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:00:08.311419 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b6cd3c26-9a00-4716-aa7d-822483eaa6ff tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] [instance: 9e50588f-b014-4922-849b-aa216c3dd25d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:00:08.320389 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b6cd3c26-9a00-4716-aa7d-822483eaa6ff tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:08.320966 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b6cd3c26-9a00-4716-aa7d-822483eaa6ff tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:08.321519 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b6cd3c26-9a00-4716-aa7d-822483eaa6ff tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:08.322298 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b6cd3c26-9a00-4716-aa7d-822483eaa6ff tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:08.322833 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b6cd3c26-9a00-4716-aa7d-822483eaa6ff tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:08.323441 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b6cd3c26-9a00-4716-aa7d-822483eaa6ff tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:08.468163 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b6cd3c26-9a00-4716-aa7d-822483eaa6ff tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/9e50588f-b014-4922-849b-aa216c3dd25d" status: 200 len: 1462 microversion: 2.1 time: 0.157834 Oct 30 02:00:08.468163 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3326/6657] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:00:08 2022] GET /compute/v2.1/servers/9e50588f-b014-4922-849b-aa216c3dd25d => generated 1462 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:00:09.487329 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-baa8fd91-3234-449a-86ae-c09ec9e0f684 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:00:09.490309 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-baa8fd91-3234-449a-86ae-c09ec9e0f684 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] [instance: 9e50588f-b014-4922-849b-aa216c3dd25d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:00:09.499001 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-baa8fd91-3234-449a-86ae-c09ec9e0f684 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:09.499346 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-baa8fd91-3234-449a-86ae-c09ec9e0f684 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:09.499909 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-baa8fd91-3234-449a-86ae-c09ec9e0f684 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:09.500685 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-baa8fd91-3234-449a-86ae-c09ec9e0f684 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:09.501206 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-baa8fd91-3234-449a-86ae-c09ec9e0f684 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:09.501671 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-baa8fd91-3234-449a-86ae-c09ec9e0f684 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:09.639351 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-baa8fd91-3234-449a-86ae-c09ec9e0f684 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/9e50588f-b014-4922-849b-aa216c3dd25d" status: 200 len: 1462 microversion: 2.1 time: 0.155756 Oct 30 02:00:09.640104 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3332/6658] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:00:09 2022] GET /compute/v2.1/servers/9e50588f-b014-4922-849b-aa216c3dd25d => generated 1462 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:00:10.663014 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e529b0c2-847f-4c0d-8fb3-f547cb055438 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:00:10.663741 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e529b0c2-847f-4c0d-8fb3-f547cb055438 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] [instance: 9e50588f-b014-4922-849b-aa216c3dd25d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:00:10.665848 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:00:10.667343 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:00:10.672318 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e529b0c2-847f-4c0d-8fb3-f547cb055438 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:10.672812 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e529b0c2-847f-4c0d-8fb3-f547cb055438 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:10.673323 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e529b0c2-847f-4c0d-8fb3-f547cb055438 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:10.674060 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e529b0c2-847f-4c0d-8fb3-f547cb055438 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:10.674506 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e529b0c2-847f-4c0d-8fb3-f547cb055438 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:10.674933 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e529b0c2-847f-4c0d-8fb3-f547cb055438 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:10.806734 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e529b0c2-847f-4c0d-8fb3-f547cb055438 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/9e50588f-b014-4922-849b-aa216c3dd25d" status: 200 len: 1462 microversion: 2.1 time: 0.147509 Oct 30 02:00:10.807301 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3327/6659] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:00:10 2022] GET /compute/v2.1/servers/9e50588f-b014-4922-849b-aa216c3dd25d => generated 1462 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:00:11.426732 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-4316e2eb-f8f8-4061-a480-049638580467 req-a13bdd30-72a3-41ad-9378-6a069b8ad434 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e50588f-b014-4922-849b-aa216c3dd25d", "name": "network-vif-plugged", "status": "completed", "tag": "f35030ad-9d94-42d3-93c7-26cb0f7e84d2"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:00:11.437588 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:00:11.438285 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=6 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:00:11.441439 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-4316e2eb-f8f8-4061-a480-049638580467 req-a13bdd30-72a3-41ad-9378-6a069b8ad434 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:11.442000 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-4316e2eb-f8f8-4061-a480-049638580467 req-a13bdd30-72a3-41ad-9378-6a069b8ad434 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:11.442348 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-4316e2eb-f8f8-4061-a480-049638580467 req-a13bdd30-72a3-41ad-9378-6a069b8ad434 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:11.455480 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-4316e2eb-f8f8-4061-a480-049638580467 req-a13bdd30-72a3-41ad-9378-6a069b8ad434 service nova] Creating event network-vif-plugged:f35030ad-9d94-42d3-93c7-26cb0f7e84d2 for instance 9e50588f-b014-4922-849b-aa216c3dd25d on n-h2-master-1 Oct 30 02:00:11.460647 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-4316e2eb-f8f8-4061-a480-049638580467 req-a13bdd30-72a3-41ad-9378-6a069b8ad434 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038412 Oct 30 02:00:11.461253 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3333/6660] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:00:11.830215 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-503bc3a4-45b0-45eb-ad5a-cc8e4cc9b739 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:00:11.831465 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-503bc3a4-45b0-45eb-ad5a-cc8e4cc9b739 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] [instance: 9e50588f-b014-4922-849b-aa216c3dd25d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:00:11.842383 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-503bc3a4-45b0-45eb-ad5a-cc8e4cc9b739 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:11.842892 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-503bc3a4-45b0-45eb-ad5a-cc8e4cc9b739 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:11.843342 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-503bc3a4-45b0-45eb-ad5a-cc8e4cc9b739 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:11.844071 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-503bc3a4-45b0-45eb-ad5a-cc8e4cc9b739 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:11.844538 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-503bc3a4-45b0-45eb-ad5a-cc8e4cc9b739 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:11.844979 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-503bc3a4-45b0-45eb-ad5a-cc8e4cc9b739 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:11.978648 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-503bc3a4-45b0-45eb-ad5a-cc8e4cc9b739 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/9e50588f-b014-4922-849b-aa216c3dd25d" status: 200 len: 1462 microversion: 2.1 time: 0.152773 Oct 30 02:00:11.979541 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3328/6661] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:00:11 2022] GET /compute/v2.1/servers/9e50588f-b014-4922-849b-aa216c3dd25d => generated 1462 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:00:13.003268 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1772b205-0ad1-4283-a9b3-50a2b4703296 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:00:13.004151 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1772b205-0ad1-4283-a9b3-50a2b4703296 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] [instance: 9e50588f-b014-4922-849b-aa216c3dd25d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:00:13.011175 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1772b205-0ad1-4283-a9b3-50a2b4703296 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:13.011635 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1772b205-0ad1-4283-a9b3-50a2b4703296 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:13.012074 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1772b205-0ad1-4283-a9b3-50a2b4703296 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:13.012773 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1772b205-0ad1-4283-a9b3-50a2b4703296 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:13.013272 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1772b205-0ad1-4283-a9b3-50a2b4703296 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:13.013680 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1772b205-0ad1-4283-a9b3-50a2b4703296 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:13.164283 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1772b205-0ad1-4283-a9b3-50a2b4703296 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/9e50588f-b014-4922-849b-aa216c3dd25d" status: 200 len: 1646 microversion: 2.1 time: 0.166672 Oct 30 02:00:13.166715 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3334/6662] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:00:12 2022] GET /compute/v2.1/servers/9e50588f-b014-4922-849b-aa216c3dd25d => generated 1646 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:00:13.187313 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3d23aa93-d1cd-4d3f-af0e-ca0abfc359c0 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:00:13.187961 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3d23aa93-d1cd-4d3f-af0e-ca0abfc359c0 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] [instance: 9e50588f-b014-4922-849b-aa216c3dd25d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:00:13.195270 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3d23aa93-d1cd-4d3f-af0e-ca0abfc359c0 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:13.195759 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3d23aa93-d1cd-4d3f-af0e-ca0abfc359c0 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:13.196195 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3d23aa93-d1cd-4d3f-af0e-ca0abfc359c0 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:13.196894 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3d23aa93-d1cd-4d3f-af0e-ca0abfc359c0 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:13.197361 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3d23aa93-d1cd-4d3f-af0e-ca0abfc359c0 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:13.197796 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3d23aa93-d1cd-4d3f-af0e-ca0abfc359c0 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:13.332366 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3d23aa93-d1cd-4d3f-af0e-ca0abfc359c0 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/9e50588f-b014-4922-849b-aa216c3dd25d" status: 200 len: 1646 microversion: 2.1 time: 0.148762 Oct 30 02:00:13.332940 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3329/6663] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:00:13 2022] GET /compute/v2.1/servers/9e50588f-b014-4922-849b-aa216c3dd25d => generated 1646 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:00:13.355070 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a82968b3-fdf6-4ea9-bf6e-3cf1cd5ab392 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:00:13.355685 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a82968b3-fdf6-4ea9-bf6e-3cf1cd5ab392 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] [instance: 9e50588f-b014-4922-849b-aa216c3dd25d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:00:13.361615 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a82968b3-fdf6-4ea9-bf6e-3cf1cd5ab392 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:13.362103 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a82968b3-fdf6-4ea9-bf6e-3cf1cd5ab392 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:13.362536 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a82968b3-fdf6-4ea9-bf6e-3cf1cd5ab392 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:13.363227 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a82968b3-fdf6-4ea9-bf6e-3cf1cd5ab392 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:13.363680 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a82968b3-fdf6-4ea9-bf6e-3cf1cd5ab392 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:13.364105 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a82968b3-fdf6-4ea9-bf6e-3cf1cd5ab392 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:13.504281 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a82968b3-fdf6-4ea9-bf6e-3cf1cd5ab392 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/9e50588f-b014-4922-849b-aa216c3dd25d" status: 200 len: 1646 microversion: 2.1 time: 0.152854 Oct 30 02:00:13.504971 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3335/6664] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:00:13 2022] GET /compute/v2.1/servers/9e50588f-b014-4922-849b-aa216c3dd25d => generated 1646 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:00:13.569033 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-aec66b50-49ef-4903-9fe3-83e2d22a62e9 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-2007866331", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "availability_zone": "nova:n-h1-master-1", "networks": [{"uuid": "a567ff36-2490-4144-9716-0766b659f967"}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:00:13.632500 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-aec66b50-49ef-4903-9fe3-83e2d22a62e9 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] validate_networks() for [('a567ff36-2490-4144-9716-0766b659f967', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 02:00:14.131769 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-aec66b50-49ef-4903-9fe3-83e2d22a62e9 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 02:00:14.131769 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-aec66b50-49ef-4903-9fe3-83e2d22a62e9 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 02:00:14.131769 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-aec66b50-49ef-4903-9fe3-83e2d22a62e9 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 02:00:14.131769 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-aec66b50-49ef-4903-9fe3-83e2d22a62e9 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 02:00:14.131769 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-aec66b50-49ef-4903-9fe3-83e2d22a62e9 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 02:00:14.140266 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aec66b50-49ef-4903-9fe3-83e2d22a62e9 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:14.140751 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aec66b50-49ef-4903-9fe3-83e2d22a62e9 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:14.141182 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aec66b50-49ef-4903-9fe3-83e2d22a62e9 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:14.141941 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aec66b50-49ef-4903-9fe3-83e2d22a62e9 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:14.142396 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aec66b50-49ef-4903-9fe3-83e2d22a62e9 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:14.142850 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aec66b50-49ef-4903-9fe3-83e2d22a62e9 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:14.160338 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-aec66b50-49ef-4903-9fe3-83e2d22a62e9 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Getting quotas for project d34dd5457509403092ddffb5289fcbc9. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 02:00:14.166130 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-aec66b50-49ef-4903-9fe3-83e2d22a62e9 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Getting quotas for user 8444f27f53f342d6afff548d2caf79a9 and project d34dd5457509403092ddffb5289fcbc9. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 02:00:14.178446 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-aec66b50-49ef-4903-9fe3-83e2d22a62e9 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 02:00:14.180750 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-aec66b50-49ef-4903-9fe3-83e2d22a62e9 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] [instance: be158ea8-3a97-46ac-b26a-095c3064a7cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 02:00:14.320488 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-aec66b50-49ef-4903-9fe3-83e2d22a62e9 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.755530 Oct 30 02:00:14.321475 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3330/6665] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 02:00:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 02:00:14.332491 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-091c1d12-9153-4910-b270-64d89d83f7e2 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:00:14.333933 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-091c1d12-9153-4910-b270-64d89d83f7e2 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] [instance: be158ea8-3a97-46ac-b26a-095c3064a7cb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:00:14.401621 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-091c1d12-9153-4910-b270-64d89d83f7e2 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/be158ea8-3a97-46ac-b26a-095c3064a7cb" status: 200 len: 1329 microversion: 2.1 time: 0.072911 Oct 30 02:00:14.402229 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3336/6666] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:00:14 2022] GET /compute/v2.1/servers/be158ea8-3a97-46ac-b26a-095c3064a7cb => generated 1329 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:00:15.425530 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5b3bce84-2fce-421c-a19d-01cb700640da tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:00:15.427507 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5b3bce84-2fce-421c-a19d-01cb700640da tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] [instance: be158ea8-3a97-46ac-b26a-095c3064a7cb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:00:15.502191 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5b3bce84-2fce-421c-a19d-01cb700640da tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/be158ea8-3a97-46ac-b26a-095c3064a7cb" status: 200 len: 1329 microversion: 2.1 time: 0.081294 Oct 30 02:00:15.514169 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3331/6667] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:00:15 2022] GET /compute/v2.1/servers/be158ea8-3a97-46ac-b26a-095c3064a7cb => generated 1329 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:00:16.525599 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-297650f0-a512-40c4-a22b-3d8d97e4833b tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:00:16.526320 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-297650f0-a512-40c4-a22b-3d8d97e4833b tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] [instance: be158ea8-3a97-46ac-b26a-095c3064a7cb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:00:16.533998 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-297650f0-a512-40c4-a22b-3d8d97e4833b tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:16.534537 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-297650f0-a512-40c4-a22b-3d8d97e4833b tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:16.534978 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-297650f0-a512-40c4-a22b-3d8d97e4833b tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:16.538520 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-297650f0-a512-40c4-a22b-3d8d97e4833b tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:16.538520 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-297650f0-a512-40c4-a22b-3d8d97e4833b tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:16.538520 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-297650f0-a512-40c4-a22b-3d8d97e4833b tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:16.616361 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-297650f0-a512-40c4-a22b-3d8d97e4833b tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/be158ea8-3a97-46ac-b26a-095c3064a7cb" status: 200 len: 1346 microversion: 2.1 time: 0.094505 Oct 30 02:00:16.617030 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3337/6668] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:00:16 2022] GET /compute/v2.1/servers/be158ea8-3a97-46ac-b26a-095c3064a7cb => generated 1346 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:00:17.639366 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8f107467-cb69-4bbb-9a91-c3c2ddc678f1 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:00:17.640056 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8f107467-cb69-4bbb-9a91-c3c2ddc678f1 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] [instance: be158ea8-3a97-46ac-b26a-095c3064a7cb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:00:17.647474 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f107467-cb69-4bbb-9a91-c3c2ddc678f1 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:17.647968 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f107467-cb69-4bbb-9a91-c3c2ddc678f1 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:17.648410 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f107467-cb69-4bbb-9a91-c3c2ddc678f1 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:17.649117 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f107467-cb69-4bbb-9a91-c3c2ddc678f1 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:17.649607 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f107467-cb69-4bbb-9a91-c3c2ddc678f1 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:17.653508 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f107467-cb69-4bbb-9a91-c3c2ddc678f1 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:17.738767 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8f107467-cb69-4bbb-9a91-c3c2ddc678f1 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/be158ea8-3a97-46ac-b26a-095c3064a7cb" status: 200 len: 1424 microversion: 2.1 time: 0.103305 Oct 30 02:00:17.739836 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3332/6669] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:00:17 2022] GET /compute/v2.1/servers/be158ea8-3a97-46ac-b26a-095c3064a7cb => generated 1424 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:00:18.761877 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7a18f3fd-533d-4155-810d-cb82e4a6c15f tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:00:18.762485 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7a18f3fd-533d-4155-810d-cb82e4a6c15f tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] [instance: be158ea8-3a97-46ac-b26a-095c3064a7cb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:00:18.769569 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7a18f3fd-533d-4155-810d-cb82e4a6c15f tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:18.770055 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7a18f3fd-533d-4155-810d-cb82e4a6c15f tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:18.770989 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7a18f3fd-533d-4155-810d-cb82e4a6c15f tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:18.771676 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7a18f3fd-533d-4155-810d-cb82e4a6c15f tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:18.772313 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7a18f3fd-533d-4155-810d-cb82e4a6c15f tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:18.772729 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7a18f3fd-533d-4155-810d-cb82e4a6c15f tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:19.043184 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7a18f3fd-533d-4155-810d-cb82e4a6c15f tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/be158ea8-3a97-46ac-b26a-095c3064a7cb" status: 200 len: 1464 microversion: 2.1 time: 0.283363 Oct 30 02:00:19.053427 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3338/6670] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:00:18 2022] GET /compute/v2.1/servers/be158ea8-3a97-46ac-b26a-095c3064a7cb => generated 1464 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:00:19.296192 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-bf97104f-e028-4d81-b9af-e8108f3f2500 req-80d9914e-52a5-4500-ba0a-0039cc6b6705 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be158ea8-3a97-46ac-b26a-095c3064a7cb", "tag": "dd0a9b04-7ece-44db-99af-7e0f5a02ea06"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:00:19.307948 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-bf97104f-e028-4d81-b9af-e8108f3f2500 req-80d9914e-52a5-4500-ba0a-0039cc6b6705 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:19.308506 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-bf97104f-e028-4d81-b9af-e8108f3f2500 req-80d9914e-52a5-4500-ba0a-0039cc6b6705 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:19.309207 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-bf97104f-e028-4d81-b9af-e8108f3f2500 req-80d9914e-52a5-4500-ba0a-0039cc6b6705 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:19.324002 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-bf97104f-e028-4d81-b9af-e8108f3f2500 req-80d9914e-52a5-4500-ba0a-0039cc6b6705 service nova] Creating event network-changed:dd0a9b04-7ece-44db-99af-7e0f5a02ea06 for instance be158ea8-3a97-46ac-b26a-095c3064a7cb on n-h1-master-1 Oct 30 02:00:19.329852 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-bf97104f-e028-4d81-b9af-e8108f3f2500 req-80d9914e-52a5-4500-ba0a-0039cc6b6705 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037005 Oct 30 02:00:19.330399 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3333/6671] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:00:20.070235 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3dce99f5-7274-4c3f-b5c8-6d5739a32c5c tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:00:20.071803 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3dce99f5-7274-4c3f-b5c8-6d5739a32c5c tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] [instance: be158ea8-3a97-46ac-b26a-095c3064a7cb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:00:20.081164 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3dce99f5-7274-4c3f-b5c8-6d5739a32c5c tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:20.083592 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3dce99f5-7274-4c3f-b5c8-6d5739a32c5c tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:20.083592 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3dce99f5-7274-4c3f-b5c8-6d5739a32c5c tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:20.084547 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3dce99f5-7274-4c3f-b5c8-6d5739a32c5c tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:20.085214 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3dce99f5-7274-4c3f-b5c8-6d5739a32c5c tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:20.085966 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3dce99f5-7274-4c3f-b5c8-6d5739a32c5c tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:20.367769 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3dce99f5-7274-4c3f-b5c8-6d5739a32c5c tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/be158ea8-3a97-46ac-b26a-095c3064a7cb" status: 200 len: 1464 microversion: 2.1 time: 0.302205 Oct 30 02:00:20.373883 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3339/6672] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:00:20 2022] GET /compute/v2.1/servers/be158ea8-3a97-46ac-b26a-095c3064a7cb => generated 1464 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:00:21.393288 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5c867c0f-dfcc-4fd7-8355-d6d87bb42ced tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:00:21.394698 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5c867c0f-dfcc-4fd7-8355-d6d87bb42ced tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] [instance: be158ea8-3a97-46ac-b26a-095c3064a7cb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:00:21.401907 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5c867c0f-dfcc-4fd7-8355-d6d87bb42ced tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:21.402516 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5c867c0f-dfcc-4fd7-8355-d6d87bb42ced tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:21.403071 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5c867c0f-dfcc-4fd7-8355-d6d87bb42ced tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:21.403942 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5c867c0f-dfcc-4fd7-8355-d6d87bb42ced tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:21.404514 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5c867c0f-dfcc-4fd7-8355-d6d87bb42ced tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:21.405077 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5c867c0f-dfcc-4fd7-8355-d6d87bb42ced tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:21.547577 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5c867c0f-dfcc-4fd7-8355-d6d87bb42ced tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/be158ea8-3a97-46ac-b26a-095c3064a7cb" status: 200 len: 1464 microversion: 2.1 time: 0.160014 Oct 30 02:00:21.548342 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3334/6673] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:00:21 2022] GET /compute/v2.1/servers/be158ea8-3a97-46ac-b26a-095c3064a7cb => generated 1464 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:00:22.571657 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-94becc3d-e7b9-47da-b24c-f3ce9a368421 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:00:22.572407 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-94becc3d-e7b9-47da-b24c-f3ce9a368421 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] [instance: be158ea8-3a97-46ac-b26a-095c3064a7cb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:00:22.579727 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-94becc3d-e7b9-47da-b24c-f3ce9a368421 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:22.580217 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-94becc3d-e7b9-47da-b24c-f3ce9a368421 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:22.580655 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-94becc3d-e7b9-47da-b24c-f3ce9a368421 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:22.581375 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-94becc3d-e7b9-47da-b24c-f3ce9a368421 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:22.581836 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-94becc3d-e7b9-47da-b24c-f3ce9a368421 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:22.582257 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-94becc3d-e7b9-47da-b24c-f3ce9a368421 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:22.722919 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-94becc3d-e7b9-47da-b24c-f3ce9a368421 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/be158ea8-3a97-46ac-b26a-095c3064a7cb" status: 200 len: 1464 microversion: 2.1 time: 0.155601 Oct 30 02:00:22.724625 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3340/6674] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:00:22 2022] GET /compute/v2.1/servers/be158ea8-3a97-46ac-b26a-095c3064a7cb => generated 1464 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:00:23.746469 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-536ffbc7-149c-45bc-b56c-9f4886553b09 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:00:23.747220 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-536ffbc7-149c-45bc-b56c-9f4886553b09 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] [instance: be158ea8-3a97-46ac-b26a-095c3064a7cb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:00:23.756171 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-536ffbc7-149c-45bc-b56c-9f4886553b09 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:23.756866 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-536ffbc7-149c-45bc-b56c-9f4886553b09 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:23.757508 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-536ffbc7-149c-45bc-b56c-9f4886553b09 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:23.758326 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-536ffbc7-149c-45bc-b56c-9f4886553b09 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:23.759081 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-536ffbc7-149c-45bc-b56c-9f4886553b09 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:23.759595 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-536ffbc7-149c-45bc-b56c-9f4886553b09 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:23.910185 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-536ffbc7-149c-45bc-b56c-9f4886553b09 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/be158ea8-3a97-46ac-b26a-095c3064a7cb" status: 200 len: 1464 microversion: 2.1 time: 0.167648 Oct 30 02:00:23.910809 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3335/6675] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:00:23 2022] GET /compute/v2.1/servers/be158ea8-3a97-46ac-b26a-095c3064a7cb => generated 1464 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:00:24.178581 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-3480f72e-a254-435f-9715-6ebc7c90d4ae req-26c0d779-2650-4019-8ab6-81582c46652b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be158ea8-3a97-46ac-b26a-095c3064a7cb", "name": "network-vif-plugged", "status": "completed", "tag": "dd0a9b04-7ece-44db-99af-7e0f5a02ea06"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:00:24.196478 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-3480f72e-a254-435f-9715-6ebc7c90d4ae req-26c0d779-2650-4019-8ab6-81582c46652b service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:24.196968 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-3480f72e-a254-435f-9715-6ebc7c90d4ae req-26c0d779-2650-4019-8ab6-81582c46652b service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:24.197466 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-3480f72e-a254-435f-9715-6ebc7c90d4ae req-26c0d779-2650-4019-8ab6-81582c46652b service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:24.210173 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-3480f72e-a254-435f-9715-6ebc7c90d4ae req-26c0d779-2650-4019-8ab6-81582c46652b service nova] Creating event network-vif-plugged:dd0a9b04-7ece-44db-99af-7e0f5a02ea06 for instance be158ea8-3a97-46ac-b26a-095c3064a7cb on n-h1-master-1 Oct 30 02:00:24.215735 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-3480f72e-a254-435f-9715-6ebc7c90d4ae req-26c0d779-2650-4019-8ab6-81582c46652b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044323 Oct 30 02:00:24.216346 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3341/6676] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:00:24.933687 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5830c54b-5bdc-40d1-929f-bf833eb98e05 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:00:24.934346 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5830c54b-5bdc-40d1-929f-bf833eb98e05 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] [instance: be158ea8-3a97-46ac-b26a-095c3064a7cb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:00:24.936353 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:00:24.942503 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5830c54b-5bdc-40d1-929f-bf833eb98e05 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:24.943012 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5830c54b-5bdc-40d1-929f-bf833eb98e05 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:24.943458 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5830c54b-5bdc-40d1-929f-bf833eb98e05 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:24.944228 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5830c54b-5bdc-40d1-929f-bf833eb98e05 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:24.944704 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5830c54b-5bdc-40d1-929f-bf833eb98e05 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:24.945145 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5830c54b-5bdc-40d1-929f-bf833eb98e05 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:25.090898 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5830c54b-5bdc-40d1-929f-bf833eb98e05 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/be158ea8-3a97-46ac-b26a-095c3064a7cb" status: 200 len: 1464 microversion: 2.1 time: 0.160964 Oct 30 02:00:25.091522 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3336/6677] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:00:24 2022] GET /compute/v2.1/servers/be158ea8-3a97-46ac-b26a-095c3064a7cb => generated 1464 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:00:26.117290 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-727a6169-6982-4221-bfb0-89e28cbce38f tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:00:26.118135 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-727a6169-6982-4221-bfb0-89e28cbce38f tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] [instance: be158ea8-3a97-46ac-b26a-095c3064a7cb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:00:26.123571 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:00:26.127063 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-727a6169-6982-4221-bfb0-89e28cbce38f tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:26.127561 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-727a6169-6982-4221-bfb0-89e28cbce38f tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:26.128214 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-727a6169-6982-4221-bfb0-89e28cbce38f tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:26.129111 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-727a6169-6982-4221-bfb0-89e28cbce38f tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:26.130493 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-727a6169-6982-4221-bfb0-89e28cbce38f tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:26.131098 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-727a6169-6982-4221-bfb0-89e28cbce38f tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:26.281676 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-727a6169-6982-4221-bfb0-89e28cbce38f tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/be158ea8-3a97-46ac-b26a-095c3064a7cb" status: 200 len: 1648 microversion: 2.1 time: 0.169209 Oct 30 02:00:26.282272 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3342/6678] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:00:26 2022] GET /compute/v2.1/servers/be158ea8-3a97-46ac-b26a-095c3064a7cb => generated 1648 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:00:26.304493 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-52d5f088-b24a-4162-aa33-e0aabb0c7762 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:00:26.305514 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-52d5f088-b24a-4162-aa33-e0aabb0c7762 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] [instance: be158ea8-3a97-46ac-b26a-095c3064a7cb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:00:26.307481 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=8 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:00:26.313759 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52d5f088-b24a-4162-aa33-e0aabb0c7762 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:26.317691 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52d5f088-b24a-4162-aa33-e0aabb0c7762 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:26.317691 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52d5f088-b24a-4162-aa33-e0aabb0c7762 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:26.317691 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52d5f088-b24a-4162-aa33-e0aabb0c7762 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:26.317691 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52d5f088-b24a-4162-aa33-e0aabb0c7762 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:26.317691 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52d5f088-b24a-4162-aa33-e0aabb0c7762 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:26.454358 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-52d5f088-b24a-4162-aa33-e0aabb0c7762 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/be158ea8-3a97-46ac-b26a-095c3064a7cb" status: 200 len: 1648 microversion: 2.1 time: 0.154472 Oct 30 02:00:26.454937 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3337/6679] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:00:26 2022] GET /compute/v2.1/servers/be158ea8-3a97-46ac-b26a-095c3064a7cb => generated 1648 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:00:26.477114 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6db68fa2-9551-49b4-ab3c-c0709e0ae223 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:00:26.477771 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6db68fa2-9551-49b4-ab3c-c0709e0ae223 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] [instance: be158ea8-3a97-46ac-b26a-095c3064a7cb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:00:26.483883 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6db68fa2-9551-49b4-ab3c-c0709e0ae223 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:26.484369 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6db68fa2-9551-49b4-ab3c-c0709e0ae223 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:26.484811 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6db68fa2-9551-49b4-ab3c-c0709e0ae223 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:26.485615 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6db68fa2-9551-49b4-ab3c-c0709e0ae223 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:26.486077 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6db68fa2-9551-49b4-ab3c-c0709e0ae223 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:26.486506 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6db68fa2-9551-49b4-ab3c-c0709e0ae223 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:26.624301 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6db68fa2-9551-49b4-ab3c-c0709e0ae223 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/be158ea8-3a97-46ac-b26a-095c3064a7cb" status: 200 len: 1648 microversion: 2.1 time: 0.151485 Oct 30 02:00:26.624992 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3343/6680] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:00:26 2022] GET /compute/v2.1/servers/be158ea8-3a97-46ac-b26a-095c3064a7cb => generated 1648 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:00:26.646927 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-78b06970-e647-4699-b8cf-104db2f4a950 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:00:26.647434 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-78b06970-e647-4699-b8cf-104db2f4a950 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] [instance: be158ea8-3a97-46ac-b26a-095c3064a7cb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:00:26.653604 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-78b06970-e647-4699-b8cf-104db2f4a950 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:26.654089 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-78b06970-e647-4699-b8cf-104db2f4a950 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:26.654549 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-78b06970-e647-4699-b8cf-104db2f4a950 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:26.655248 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-78b06970-e647-4699-b8cf-104db2f4a950 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:26.655705 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-78b06970-e647-4699-b8cf-104db2f4a950 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:26.656133 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-78b06970-e647-4699-b8cf-104db2f4a950 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:26.682511 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-78b06970-e647-4699-b8cf-104db2f4a950 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] [instance: be158ea8-3a97-46ac-b26a-095c3064a7cb] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 02:00:26.997137 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-78b06970-e647-4699-b8cf-104db2f4a950 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] 10.222.0.13 "DELETE /compute/v2.1/servers/be158ea8-3a97-46ac-b26a-095c3064a7cb" status: 204 len: 0 microversion: 2.1 time: 0.353773 Oct 30 02:00:26.997981 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3338/6681] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 02:00:26 2022] DELETE /compute/v2.1/servers/be158ea8-3a97-46ac-b26a-095c3064a7cb => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 02:00:27.006782 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cf88d71a-8d6b-4653-bd82-d473ec6efc96 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:00:27.007054 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cf88d71a-8d6b-4653-bd82-d473ec6efc96 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] [instance: be158ea8-3a97-46ac-b26a-095c3064a7cb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:00:27.013999 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cf88d71a-8d6b-4653-bd82-d473ec6efc96 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:27.014491 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cf88d71a-8d6b-4653-bd82-d473ec6efc96 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:27.014922 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cf88d71a-8d6b-4653-bd82-d473ec6efc96 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:27.015623 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cf88d71a-8d6b-4653-bd82-d473ec6efc96 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:27.016068 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cf88d71a-8d6b-4653-bd82-d473ec6efc96 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:27.016518 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cf88d71a-8d6b-4653-bd82-d473ec6efc96 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:27.150718 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cf88d71a-8d6b-4653-bd82-d473ec6efc96 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/be158ea8-3a97-46ac-b26a-095c3064a7cb" status: 200 len: 1654 microversion: 2.1 time: 0.148241 Oct 30 02:00:27.152096 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3344/6682] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:00:27 2022] GET /compute/v2.1/servers/be158ea8-3a97-46ac-b26a-095c3064a7cb => generated 1654 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:00:28.175270 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-12573b38-b7b1-495c-a3e5-c245dd6e078c tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:00:28.176036 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-12573b38-b7b1-495c-a3e5-c245dd6e078c tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] [instance: be158ea8-3a97-46ac-b26a-095c3064a7cb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:00:28.183649 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-12573b38-b7b1-495c-a3e5-c245dd6e078c tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:28.184151 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-12573b38-b7b1-495c-a3e5-c245dd6e078c tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:28.184583 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-12573b38-b7b1-495c-a3e5-c245dd6e078c tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:28.185289 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-12573b38-b7b1-495c-a3e5-c245dd6e078c tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:28.185800 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-12573b38-b7b1-495c-a3e5-c245dd6e078c tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:28.186231 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-12573b38-b7b1-495c-a3e5-c245dd6e078c tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:28.318129 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:00:28.323049 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-12573b38-b7b1-495c-a3e5-c245dd6e078c tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/be158ea8-3a97-46ac-b26a-095c3064a7cb" status: 200 len: 1654 microversion: 2.1 time: 0.151893 Oct 30 02:00:28.323615 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3339/6683] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:00:28 2022] GET /compute/v2.1/servers/be158ea8-3a97-46ac-b26a-095c3064a7cb => generated 1654 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:00:29.029534 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-6fc2720e-e349-4f57-a228-cd528f055ce4 req-7dccb12f-820c-425d-9cc1-53c61db3e862 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be158ea8-3a97-46ac-b26a-095c3064a7cb", "name": "network-vif-deleted", "tag": "dd0a9b04-7ece-44db-99af-7e0f5a02ea06"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:00:29.046703 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-6fc2720e-e349-4f57-a228-cd528f055ce4 req-7dccb12f-820c-425d-9cc1-53c61db3e862 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:29.047583 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-6fc2720e-e349-4f57-a228-cd528f055ce4 req-7dccb12f-820c-425d-9cc1-53c61db3e862 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:29.048197 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-6fc2720e-e349-4f57-a228-cd528f055ce4 req-7dccb12f-820c-425d-9cc1-53c61db3e862 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:29.062362 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-6fc2720e-e349-4f57-a228-cd528f055ce4 req-7dccb12f-820c-425d-9cc1-53c61db3e862 service nova] Creating event network-vif-deleted:dd0a9b04-7ece-44db-99af-7e0f5a02ea06 for instance be158ea8-3a97-46ac-b26a-095c3064a7cb on n-h1-master-1 Oct 30 02:00:29.069325 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-6fc2720e-e349-4f57-a228-cd528f055ce4 req-7dccb12f-820c-425d-9cc1-53c61db3e862 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.192802 Oct 30 02:00:29.075998 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3345/6684] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:00:29.347266 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b4273eae-f325-42bf-83b8-2e0a27e74517 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:00:29.347926 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b4273eae-f325-42bf-83b8-2e0a27e74517 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] [instance: be158ea8-3a97-46ac-b26a-095c3064a7cb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:00:29.351293 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:00:29.356896 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4273eae-f325-42bf-83b8-2e0a27e74517 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:29.360293 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4273eae-f325-42bf-83b8-2e0a27e74517 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:29.360293 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4273eae-f325-42bf-83b8-2e0a27e74517 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:29.360293 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4273eae-f325-42bf-83b8-2e0a27e74517 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:29.360293 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4273eae-f325-42bf-83b8-2e0a27e74517 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:29.360293 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4273eae-f325-42bf-83b8-2e0a27e74517 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:29.396737 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4273eae-f325-42bf-83b8-2e0a27e74517 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:29.397377 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4273eae-f325-42bf-83b8-2e0a27e74517 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:29.397976 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4273eae-f325-42bf-83b8-2e0a27e74517 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:29.398694 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-b4273eae-f325-42bf-83b8-2e0a27e74517 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lazy-loading 'fault' on Instance uuid be158ea8-3a97-46ac-b26a-095c3064a7cb {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 02:00:29.450961 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b4273eae-f325-42bf-83b8-2e0a27e74517 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/be158ea8-3a97-46ac-b26a-095c3064a7cb" status: 200 len: 1454 microversion: 2.1 time: 0.107827 Oct 30 02:00:29.457577 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3340/6685] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:00:29 2022] GET /compute/v2.1/servers/be158ea8-3a97-46ac-b26a-095c3064a7cb => generated 1454 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:00:30.474956 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3ab738b4-de0b-49aa-830c-ad9052305500 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:00:30.475652 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3ab738b4-de0b-49aa-830c-ad9052305500 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] [instance: be158ea8-3a97-46ac-b26a-095c3064a7cb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:00:30.478321 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:00:30.483239 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3ab738b4-de0b-49aa-830c-ad9052305500 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:30.483729 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3ab738b4-de0b-49aa-830c-ad9052305500 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:30.484154 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3ab738b4-de0b-49aa-830c-ad9052305500 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:30.484844 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3ab738b4-de0b-49aa-830c-ad9052305500 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:30.485292 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3ab738b4-de0b-49aa-830c-ad9052305500 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:30.485737 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3ab738b4-de0b-49aa-830c-ad9052305500 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:30.488167 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=89 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:00:30.499954 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-3ab738b4-de0b-49aa-830c-ad9052305500 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] HTTP exception thrown: Instance be158ea8-3a97-46ac-b26a-095c3064a7cb could not be found. Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3ab738b4-de0b-49aa-830c-ad9052305500 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Request method failure captured: Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/be158ea8-3a97-46ac-b26a-095c3064a7cb HTTP/1.1 Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdqeOuTD_Eq_T5MH8cD-A4-SEtfcnSdcqTbjP69SULlBHLWGLTtcWLTHFs65WAClz_m4bTDhSIJZWGKQektFessH8GQLJFXYsO2dYxTSciDh7zY-Vq4bkjMbNLEXiHgBxN1dZdueeVmh0OBBLVmqeWNZPw31d27mFYGlrJq17TXDz5k Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: d34dd5457509403092ddffb5289fcbc9 Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-TestServerMultinode-2137893291 Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,admin,reader Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,admin,reader Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d34dd5457509403092ddffb5289fcbc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d34dd5457509403092ddffb5289fcbc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d34dd5457509403092ddffb5289fcbc9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d34dd5457509403092ddffb5289fcbc9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-TestServerMultinode-2137893291 Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: d34dd5457509403092ddffb5289fcbc9 Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-TestServerMultinode-2137893291 Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-TestServerMultinode-2137893291-project-admin Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 8444f27f53f342d6afff548d2caf79a9 Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-TestServerMultinode-2137893291-project-admin Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: exception: Instance be158ea8-3a97-46ac-b26a-095c3064a7cb could not be found. Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'be158ea8-3a97-46ac-b26a-095c3064a7cb'} Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be158ea8-3a97-46ac-b26a-095c3064a7cb could not be found. Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be158ea8-3a97-46ac-b26a-095c3064a7cb could not be found. Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:00:30.501625 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:00:30.507314 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:00:30.507314 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:00:30.507314 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:00:30.507314 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:00:30.507314 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:00:30.507314 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be158ea8-3a97-46ac-b26a-095c3064a7cb could not be found. Oct 30 02:00:30.507314 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:00:30.507314 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3ab738b4-de0b-49aa-830c-ad9052305500 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Returning 404 to user: Instance be158ea8-3a97-46ac-b26a-095c3064a7cb could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:00:30.507314 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3ab738b4-de0b-49aa-830c-ad9052305500 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/be158ea8-3a97-46ac-b26a-095c3064a7cb" status: 404 len: 111 microversion: 2.1 time: 0.032197 Oct 30 02:00:30.507314 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3346/6686] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:00:30 2022] GET /compute/v2.1/servers/be158ea8-3a97-46ac-b26a-095c3064a7cb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 02:00:30.513904 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d445fd4a-9805-43d9-925a-bc073778b9c3 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:00:30.514539 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d445fd4a-9805-43d9-925a-bc073778b9c3 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] [instance: 9e50588f-b014-4922-849b-aa216c3dd25d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:00:30.522857 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d445fd4a-9805-43d9-925a-bc073778b9c3 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:30.530337 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d445fd4a-9805-43d9-925a-bc073778b9c3 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:30.530337 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d445fd4a-9805-43d9-925a-bc073778b9c3 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:30.530337 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d445fd4a-9805-43d9-925a-bc073778b9c3 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:30.530337 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d445fd4a-9805-43d9-925a-bc073778b9c3 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:30.530337 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d445fd4a-9805-43d9-925a-bc073778b9c3 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:30.551727 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d445fd4a-9805-43d9-925a-bc073778b9c3 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] [instance: 9e50588f-b014-4922-849b-aa216c3dd25d] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 02:00:30.821000 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d445fd4a-9805-43d9-925a-bc073778b9c3 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] 10.222.0.13 "DELETE /compute/v2.1/servers/9e50588f-b014-4922-849b-aa216c3dd25d" status: 204 len: 0 microversion: 2.1 time: 0.311237 Oct 30 02:00:30.821640 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3341/6687] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 02:00:30 2022] DELETE /compute/v2.1/servers/9e50588f-b014-4922-849b-aa216c3dd25d => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 30 02:00:30.830199 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-30096d02-9821-4d95-9fb2-06a2bfb435a1 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:00:30.830986 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-30096d02-9821-4d95-9fb2-06a2bfb435a1 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] [instance: 9e50588f-b014-4922-849b-aa216c3dd25d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:00:30.838445 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-30096d02-9821-4d95-9fb2-06a2bfb435a1 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:30.838937 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-30096d02-9821-4d95-9fb2-06a2bfb435a1 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:30.839371 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-30096d02-9821-4d95-9fb2-06a2bfb435a1 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:30.840180 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-30096d02-9821-4d95-9fb2-06a2bfb435a1 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:30.840629 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-30096d02-9821-4d95-9fb2-06a2bfb435a1 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:30.841050 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-30096d02-9821-4d95-9fb2-06a2bfb435a1 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:30.986880 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-30096d02-9821-4d95-9fb2-06a2bfb435a1 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/9e50588f-b014-4922-849b-aa216c3dd25d" status: 200 len: 1652 microversion: 2.1 time: 0.160706 Oct 30 02:00:30.987899 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3347/6688] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:00:30 2022] GET /compute/v2.1/servers/9e50588f-b014-4922-849b-aa216c3dd25d => generated 1652 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:00:32.013306 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5d1499a8-3eb9-49e7-9fb4-090849e97369 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:00:32.021391 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5d1499a8-3eb9-49e7-9fb4-090849e97369 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] [instance: 9e50588f-b014-4922-849b-aa216c3dd25d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:00:32.021391 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5d1499a8-3eb9-49e7-9fb4-090849e97369 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:32.021711 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5d1499a8-3eb9-49e7-9fb4-090849e97369 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:32.022153 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5d1499a8-3eb9-49e7-9fb4-090849e97369 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:32.022859 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5d1499a8-3eb9-49e7-9fb4-090849e97369 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:32.023319 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5d1499a8-3eb9-49e7-9fb4-090849e97369 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:32.023750 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5d1499a8-3eb9-49e7-9fb4-090849e97369 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:32.156509 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5d1499a8-3eb9-49e7-9fb4-090849e97369 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/9e50588f-b014-4922-849b-aa216c3dd25d" status: 200 len: 1652 microversion: 2.1 time: 0.147540 Oct 30 02:00:32.157293 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3342/6689] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:00:32 2022] GET /compute/v2.1/servers/9e50588f-b014-4922-849b-aa216c3dd25d => generated 1652 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:00:32.853629 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-d9119912-0d2b-40a7-b99b-3fcff70d65f3 req-09ed4379-bfb1-4571-ab2d-548588fe03bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e50588f-b014-4922-849b-aa216c3dd25d", "name": "network-vif-deleted", "tag": "f35030ad-9d94-42d3-93c7-26cb0f7e84d2"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:00:32.865709 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-d9119912-0d2b-40a7-b99b-3fcff70d65f3 req-09ed4379-bfb1-4571-ab2d-548588fe03bc service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:32.866200 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-d9119912-0d2b-40a7-b99b-3fcff70d65f3 req-09ed4379-bfb1-4571-ab2d-548588fe03bc service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:32.866631 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-d9119912-0d2b-40a7-b99b-3fcff70d65f3 req-09ed4379-bfb1-4571-ab2d-548588fe03bc service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:32.880951 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-d9119912-0d2b-40a7-b99b-3fcff70d65f3 req-09ed4379-bfb1-4571-ab2d-548588fe03bc service nova] Creating event network-vif-deleted:f35030ad-9d94-42d3-93c7-26cb0f7e84d2 for instance 9e50588f-b014-4922-849b-aa216c3dd25d on n-h2-master-1 Oct 30 02:00:32.887010 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-d9119912-0d2b-40a7-b99b-3fcff70d65f3 req-09ed4379-bfb1-4571-ab2d-548588fe03bc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037220 Oct 30 02:00:32.887629 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3348/6690] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:00:33.179008 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1f20ded7-fe83-4770-b4b7-2c198e863098 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:00:33.179727 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1f20ded7-fe83-4770-b4b7-2c198e863098 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] [instance: 9e50588f-b014-4922-849b-aa216c3dd25d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:00:33.186661 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1f20ded7-fe83-4770-b4b7-2c198e863098 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:33.187244 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1f20ded7-fe83-4770-b4b7-2c198e863098 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:33.187737 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1f20ded7-fe83-4770-b4b7-2c198e863098 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:33.188547 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1f20ded7-fe83-4770-b4b7-2c198e863098 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:33.189059 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1f20ded7-fe83-4770-b4b7-2c198e863098 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:33.189596 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1f20ded7-fe83-4770-b4b7-2c198e863098 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:33.223058 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1f20ded7-fe83-4770-b4b7-2c198e863098 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:33.223638 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1f20ded7-fe83-4770-b4b7-2c198e863098 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:33.224146 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1f20ded7-fe83-4770-b4b7-2c198e863098 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:33.224670 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-1f20ded7-fe83-4770-b4b7-2c198e863098 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lazy-loading 'fault' on Instance uuid 9e50588f-b014-4922-849b-aa216c3dd25d {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 02:00:33.284315 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1f20ded7-fe83-4770-b4b7-2c198e863098 tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/9e50588f-b014-4922-849b-aa216c3dd25d" status: 200 len: 1452 microversion: 2.1 time: 0.109097 Oct 30 02:00:33.284986 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3343/6691] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:00:33 2022] GET /compute/v2.1/servers/9e50588f-b014-4922-849b-aa216c3dd25d => generated 1452 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:00:34.308908 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-61d2444b-d66f-43ec-9d6e-240c76612d3f tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:00:34.310342 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-61d2444b-d66f-43ec-9d6e-240c76612d3f tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] [instance: 9e50588f-b014-4922-849b-aa216c3dd25d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:00:34.319943 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-61d2444b-d66f-43ec-9d6e-240c76612d3f tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:34.320443 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-61d2444b-d66f-43ec-9d6e-240c76612d3f tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:34.320884 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-61d2444b-d66f-43ec-9d6e-240c76612d3f tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:34.321675 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-61d2444b-d66f-43ec-9d6e-240c76612d3f tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:00:34.322138 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-61d2444b-d66f-43ec-9d6e-240c76612d3f tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:00:34.322632 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-61d2444b-d66f-43ec-9d6e-240c76612d3f tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:00:34.337096 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-61d2444b-d66f-43ec-9d6e-240c76612d3f tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] HTTP exception thrown: Instance 9e50588f-b014-4922-849b-aa216c3dd25d could not be found. Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-61d2444b-d66f-43ec-9d6e-240c76612d3f tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Request method failure captured: Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/9e50588f-b014-4922-849b-aa216c3dd25d HTTP/1.1 Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdqeOuTD_Eq_T5MH8cD-A4-SEtfcnSdcqTbjP69SULlBHLWGLTtcWLTHFs65WAClz_m4bTDhSIJZWGKQektFessH8GQLJFXYsO2dYxTSciDh7zY-Vq4bkjMbNLEXiHgBxN1dZdueeVmh0OBBLVmqeWNZPw31d27mFYGlrJq17TXDz5k Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: d34dd5457509403092ddffb5289fcbc9 Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-TestServerMultinode-2137893291 Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,admin,reader Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,admin,reader Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d34dd5457509403092ddffb5289fcbc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d34dd5457509403092ddffb5289fcbc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d34dd5457509403092ddffb5289fcbc9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d34dd5457509403092ddffb5289fcbc9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-TestServerMultinode-2137893291 Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: d34dd5457509403092ddffb5289fcbc9 Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-TestServerMultinode-2137893291 Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-TestServerMultinode-2137893291-project-admin Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 8444f27f53f342d6afff548d2caf79a9 Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-TestServerMultinode-2137893291-project-admin Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 9e50588f-b014-4922-849b-aa216c3dd25d could not be found. Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '9e50588f-b014-4922-849b-aa216c3dd25d'} Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e50588f-b014-4922-849b-aa216c3dd25d could not be found. Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e50588f-b014-4922-849b-aa216c3dd25d could not be found. Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:00:34.339111 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:00:34.345216 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:00:34.345216 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:00:34.345216 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:00:34.345216 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:00:34.345216 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:00:34.345216 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e50588f-b014-4922-849b-aa216c3dd25d could not be found. Oct 30 02:00:34.345216 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:00:34.345216 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-61d2444b-d66f-43ec-9d6e-240c76612d3f tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] Returning 404 to user: Instance 9e50588f-b014-4922-849b-aa216c3dd25d could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:00:34.345216 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-61d2444b-d66f-43ec-9d6e-240c76612d3f tempest-TestServerMultinode-2137893291 tempest-TestServerMultinode-2137893291-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/9e50588f-b014-4922-849b-aa216c3dd25d" status: 404 len: 111 microversion: 2.1 time: 0.035816 Oct 30 02:00:34.345216 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3349/6692] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:00:34 2022] GET /compute/v2.1/servers/9e50588f-b014-4922-849b-aa216c3dd25d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 02:01:04.058466 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-faad970c-a800-4dc4-ae0d-7b458d6d5422 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1533632404", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "af814460-a5c7-4df3-a95d-26543d4525a0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "aa518046-7164-40fa-a3f3-11422c6acc97"}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:01:04.083568 n-d-master-1 devstack@n-api.service[121103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 30 02:01:04.088803 n-d-master-1 devstack@n-api.service[121103]: Sun Oct 30 02:01:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.13) !!! Oct 30 02:01:04.090946 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:01:04.092178 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:01:04.156244 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-faad970c-a800-4dc4-ae0d-7b458d6d5422 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] validate_networks() for [('aa518046-7164-40fa-a3f3-11422c6acc97', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 02:01:04.657620 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-faad970c-a800-4dc4-ae0d-7b458d6d5422 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 02:01:04.658049 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-faad970c-a800-4dc4-ae0d-7b458d6d5422 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 02:01:04.658731 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-faad970c-a800-4dc4-ae0d-7b458d6d5422 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 02:01:04.659155 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-faad970c-a800-4dc4-ae0d-7b458d6d5422 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 02:01:04.659600 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-faad970c-a800-4dc4-ae0d-7b458d6d5422 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 02:01:04.673846 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-faad970c-a800-4dc4-ae0d-7b458d6d5422 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:04.674559 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-faad970c-a800-4dc4-ae0d-7b458d6d5422 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:04.675055 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-faad970c-a800-4dc4-ae0d-7b458d6d5422 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:04.676013 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-faad970c-a800-4dc4-ae0d-7b458d6d5422 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:04.676784 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-faad970c-a800-4dc4-ae0d-7b458d6d5422 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:04.677215 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-faad970c-a800-4dc4-ae0d-7b458d6d5422 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:04.697994 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-faad970c-a800-4dc4-ae0d-7b458d6d5422 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Getting quotas for project 99e1cde224c845caaa743246e60e338d. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 02:01:04.704617 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-faad970c-a800-4dc4-ae0d-7b458d6d5422 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Getting quotas for user a0ec990e687d427d88dcf9879a1d5b0c and project 99e1cde224c845caaa743246e60e338d. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 02:01:04.817310 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-faad970c-a800-4dc4-ae0d-7b458d6d5422 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 02:01:04.820211 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-faad970c-a800-4dc4-ae0d-7b458d6d5422 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: c2f68445-c19b-468c-b58c-00a2c97dd786] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='af814460-a5c7-4df3-a95d-26543d4525a0',volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 02:01:05.317622 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-faad970c-a800-4dc4-ae0d-7b458d6d5422 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.254539 Oct 30 02:01:05.330788 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bb811d99-fe05-4e1c-b429-f0fed44fd9d2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:01:05.331829 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bb811d99-fe05-4e1c-b429-f0fed44fd9d2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: c2f68445-c19b-468c-b58c-00a2c97dd786] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:01:05.337524 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3344/6693] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 02:01:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1284 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 02:01:05.346229 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=7 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:01:05.347201 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=11 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:01:05.402519 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bb811d99-fe05-4e1c-b429-f0fed44fd9d2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:01:05.423393 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bb811d99-fe05-4e1c-b429-f0fed44fd9d2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786" status: 200 len: 1057 microversion: 2.1 time: 0.096605 Oct 30 02:01:05.428081 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3350/6694] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:01:05 2022] GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786 => generated 1057 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:01:06.455167 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5a5ad196-55fc-4fe9-9d5c-5d44d1fcec40 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:01:06.455802 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5a5ad196-55fc-4fe9-9d5c-5d44d1fcec40 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: c2f68445-c19b-468c-b58c-00a2c97dd786] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:01:06.463151 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5a5ad196-55fc-4fe9-9d5c-5d44d1fcec40 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:06.463806 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5a5ad196-55fc-4fe9-9d5c-5d44d1fcec40 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:06.464250 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5a5ad196-55fc-4fe9-9d5c-5d44d1fcec40 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:06.464970 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5a5ad196-55fc-4fe9-9d5c-5d44d1fcec40 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:06.465458 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5a5ad196-55fc-4fe9-9d5c-5d44d1fcec40 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:06.465895 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5a5ad196-55fc-4fe9-9d5c-5d44d1fcec40 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:06.545237 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5a5ad196-55fc-4fe9-9d5c-5d44d1fcec40 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:01:06.554487 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5a5ad196-55fc-4fe9-9d5c-5d44d1fcec40 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786" status: 200 len: 1107 microversion: 2.1 time: 0.104374 Oct 30 02:01:06.555095 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3345/6695] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:01:06 2022] GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786 => generated 1107 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:01:07.578477 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d65b522f-d769-4ca4-acd7-619aaf4e10b8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:01:07.580283 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d65b522f-d769-4ca4-acd7-619aaf4e10b8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: c2f68445-c19b-468c-b58c-00a2c97dd786] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:01:07.588036 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d65b522f-d769-4ca4-acd7-619aaf4e10b8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:07.588521 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d65b522f-d769-4ca4-acd7-619aaf4e10b8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:07.588950 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d65b522f-d769-4ca4-acd7-619aaf4e10b8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:07.589714 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d65b522f-d769-4ca4-acd7-619aaf4e10b8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:07.591785 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d65b522f-d769-4ca4-acd7-619aaf4e10b8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:07.591785 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d65b522f-d769-4ca4-acd7-619aaf4e10b8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:07.672593 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d65b522f-d769-4ca4-acd7-619aaf4e10b8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:01:07.681082 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d65b522f-d769-4ca4-acd7-619aaf4e10b8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786" status: 200 len: 1163 microversion: 2.1 time: 0.107288 Oct 30 02:01:07.681683 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3351/6696] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:01:07 2022] GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786 => generated 1163 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:01:08.455563 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6000fa45-eebe-4108-bf42-d8dbea250e6b tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Action: 'create', calling method: .version_select at 0x7f44c7c17b80>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-781308768", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ4F/qUxrGor1uTfetbWmJMCgBZbU8q9mnmi6PsmFp/wbYy4x3q5czz8L31pD+jZVxSYPg6XU1tZ+Xyl5rZw6KOgMDZOUkasjJEmDDUNuGdcWFmFrZ1VJPju2t7KUO1ggw=="}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:01:08.511082 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-6000fa45-eebe-4108-bf42-d8dbea250e6b tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Getting quotas for project 815809ec42e44bce9da3c4e354b425bf. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 02:01:08.529791 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-6000fa45-eebe-4108-bf42-d8dbea250e6b tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Getting quotas for user 685162cc09ea436baabe059b9b346ef1 and project 815809ec42e44bce9da3c4e354b425bf. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 02:01:08.683784 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6000fa45-eebe-4108-bf42-d8dbea250e6b tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.232037 Oct 30 02:01:08.684418 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3346/6697] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 30 02:01:08 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:01:08.704674 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-77a0a0d8-aba9-452b-b892-23a250153ae5 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:01:08.705309 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-77a0a0d8-aba9-452b-b892-23a250153ae5 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: c2f68445-c19b-468c-b58c-00a2c97dd786] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:01:08.717662 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-77a0a0d8-aba9-452b-b892-23a250153ae5 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:08.718168 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-77a0a0d8-aba9-452b-b892-23a250153ae5 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:08.718609 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-77a0a0d8-aba9-452b-b892-23a250153ae5 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:08.722956 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-77a0a0d8-aba9-452b-b892-23a250153ae5 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:08.724602 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-77a0a0d8-aba9-452b-b892-23a250153ae5 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:08.725080 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-77a0a0d8-aba9-452b-b892-23a250153ae5 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:08.980035 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-77a0a0d8-aba9-452b-b892-23a250153ae5 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:01:08.991408 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-77a0a0d8-aba9-452b-b892-23a250153ae5 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786" status: 200 len: 1215 microversion: 2.1 time: 0.289711 Oct 30 02:01:08.991408 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3352/6698] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:01:08 2022] GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786 => generated 1215 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:01:10.012956 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-38979987-8859-4193-ad4e-5fe1ce4fd689 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:01:10.013572 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-bb38248c-bc02-4811-a719-bead0e3f1b43 req-d530125a-f7a2-4e0b-85d8-296cd5edf36b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2f68445-c19b-468c-b58c-00a2c97dd786", "tag": "453669ef-526b-4cf0-bf69-95793fc87590"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:01:10.014906 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-38979987-8859-4193-ad4e-5fe1ce4fd689 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: c2f68445-c19b-468c-b58c-00a2c97dd786] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:01:10.024129 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-bb38248c-bc02-4811-a719-bead0e3f1b43 req-d530125a-f7a2-4e0b-85d8-296cd5edf36b service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:10.025028 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-bb38248c-bc02-4811-a719-bead0e3f1b43 req-d530125a-f7a2-4e0b-85d8-296cd5edf36b service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:10.025647 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-bb38248c-bc02-4811-a719-bead0e3f1b43 req-d530125a-f7a2-4e0b-85d8-296cd5edf36b service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:10.036867 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38979987-8859-4193-ad4e-5fe1ce4fd689 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:10.043335 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38979987-8859-4193-ad4e-5fe1ce4fd689 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:10.043983 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38979987-8859-4193-ad4e-5fe1ce4fd689 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:10.044889 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38979987-8859-4193-ad4e-5fe1ce4fd689 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:10.045678 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38979987-8859-4193-ad4e-5fe1ce4fd689 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:10.046265 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38979987-8859-4193-ad4e-5fe1ce4fd689 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:10.053194 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-bb38248c-bc02-4811-a719-bead0e3f1b43 req-d530125a-f7a2-4e0b-85d8-296cd5edf36b service nova] Creating event network-changed:453669ef-526b-4cf0-bf69-95793fc87590 for instance c2f68445-c19b-468c-b58c-00a2c97dd786 on n-h2-master-1 Oct 30 02:01:10.067921 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-bb38248c-bc02-4811-a719-bead0e3f1b43 req-d530125a-f7a2-4e0b-85d8-296cd5edf36b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054841 Oct 30 02:01:10.067921 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3353/6699] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:01:10.308765 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-38979987-8859-4193-ad4e-5fe1ce4fd689 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:01:10.316892 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-38979987-8859-4193-ad4e-5fe1ce4fd689 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786" status: 200 len: 1215 microversion: 2.1 time: 0.308704 Oct 30 02:01:10.317628 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3347/6700] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:01:10 2022] GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786 => generated 1215 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:01:11.347778 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fd71003c-e597-4982-af9c-c0b1fe077274 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:01:11.348445 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fd71003c-e597-4982-af9c-c0b1fe077274 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: c2f68445-c19b-468c-b58c-00a2c97dd786] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:01:11.355831 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fd71003c-e597-4982-af9c-c0b1fe077274 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:11.356353 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fd71003c-e597-4982-af9c-c0b1fe077274 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:11.356931 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fd71003c-e597-4982-af9c-c0b1fe077274 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:11.362837 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fd71003c-e597-4982-af9c-c0b1fe077274 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:11.362837 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fd71003c-e597-4982-af9c-c0b1fe077274 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:11.362837 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fd71003c-e597-4982-af9c-c0b1fe077274 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:11.504724 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-fd71003c-e597-4982-af9c-c0b1fe077274 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:01:11.514314 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fd71003c-e597-4982-af9c-c0b1fe077274 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786" status: 200 len: 1215 microversion: 2.1 time: 0.174237 Oct 30 02:01:11.514918 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3354/6701] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:01:11 2022] GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786 => generated 1215 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:01:11.653867 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f15f8be0-67dc-4c72-b34b-d5866318fd49 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-256844537", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "024302bd-ed03-45be-9ff4-0d80c70f8468", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-781308768", "security_groups": [{"name": "tempest-secgroup-smoke-1943731239"}], "networks": [{"uuid": "773f2203-c7a6-41e8-a4fc-bf18695fcded"}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:01:11.780521 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-f15f8be0-67dc-4c72-b34b-d5866318fd49 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] validate_networks() for [('773f2203-c7a6-41e8-a4fc-bf18695fcded', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 02:01:12.179786 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-f15f8be0-67dc-4c72-b34b-d5866318fd49 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 02:01:12.180211 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-f15f8be0-67dc-4c72-b34b-d5866318fd49 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 02:01:12.180691 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-f15f8be0-67dc-4c72-b34b-d5866318fd49 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 02:01:12.181100 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-f15f8be0-67dc-4c72-b34b-d5866318fd49 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 02:01:12.181543 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-f15f8be0-67dc-4c72-b34b-d5866318fd49 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 02:01:12.190619 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f15f8be0-67dc-4c72-b34b-d5866318fd49 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:12.191100 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f15f8be0-67dc-4c72-b34b-d5866318fd49 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:12.191537 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f15f8be0-67dc-4c72-b34b-d5866318fd49 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:12.192264 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f15f8be0-67dc-4c72-b34b-d5866318fd49 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:12.192722 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f15f8be0-67dc-4c72-b34b-d5866318fd49 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:12.193145 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f15f8be0-67dc-4c72-b34b-d5866318fd49 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:12.210730 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-f15f8be0-67dc-4c72-b34b-d5866318fd49 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Getting quotas for project 815809ec42e44bce9da3c4e354b425bf. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 02:01:12.216365 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-f15f8be0-67dc-4c72-b34b-d5866318fd49 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Getting quotas for user 685162cc09ea436baabe059b9b346ef1 and project 815809ec42e44bce9da3c4e354b425bf. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 02:01:12.282510 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f15f8be0-67dc-4c72-b34b-d5866318fd49 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 02:01:12.285139 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f15f8be0-67dc-4c72-b34b-d5866318fd49 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] [instance: 57baac8d-c9ab-47fc-821c-3e82036eea26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='024302bd-ed03-45be-9ff4-0d80c70f8468',volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 02:01:12.538099 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-261da7e2-0cb1-4d46-8cda-d8847abf7f27 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:01:12.538718 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-261da7e2-0cb1-4d46-8cda-d8847abf7f27 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: c2f68445-c19b-468c-b58c-00a2c97dd786] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:01:12.545796 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-261da7e2-0cb1-4d46-8cda-d8847abf7f27 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:12.546232 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-261da7e2-0cb1-4d46-8cda-d8847abf7f27 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:12.546674 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-261da7e2-0cb1-4d46-8cda-d8847abf7f27 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:12.547371 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-261da7e2-0cb1-4d46-8cda-d8847abf7f27 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:12.547992 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-261da7e2-0cb1-4d46-8cda-d8847abf7f27 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:12.548284 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-261da7e2-0cb1-4d46-8cda-d8847abf7f27 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:12.695292 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-261da7e2-0cb1-4d46-8cda-d8847abf7f27 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:01:12.703770 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-261da7e2-0cb1-4d46-8cda-d8847abf7f27 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786" status: 200 len: 1215 microversion: 2.1 time: 0.170024 Oct 30 02:01:12.704369 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3355/6702] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:01:12 2022] GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786 => generated 1215 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:01:12.765634 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f15f8be0-67dc-4c72-b34b-d5866318fd49 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.115897 Oct 30 02:01:12.767439 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3348/6703] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 02:01:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 1118 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 02:01:12.778115 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ad08655c-f10d-4baa-9c71-7ea3af41e95a tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:01:12.778943 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ad08655c-f10d-4baa-9c71-7ea3af41e95a tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] [instance: 57baac8d-c9ab-47fc-821c-3e82036eea26] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:01:12.844207 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ad08655c-f10d-4baa-9c71-7ea3af41e95a tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685162cc09ea436baabe059b9b346ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815809ec42e44bce9da3c4e354b425bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:01:12.854392 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ad08655c-f10d-4baa-9c71-7ea3af41e95a tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] 10.222.0.13 "GET /compute/v2.1/servers/57baac8d-c9ab-47fc-821c-3e82036eea26" status: 200 len: 1097 microversion: 2.1 time: 0.080090 Oct 30 02:01:12.869520 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3356/6704] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:01:12 2022] GET /compute/v2.1/servers/57baac8d-c9ab-47fc-821c-3e82036eea26 => generated 1097 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:01:13.728405 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-128ff3a6-e344-416e-8d6c-56d2abce0aa1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:01:13.729048 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-128ff3a6-e344-416e-8d6c-56d2abce0aa1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: c2f68445-c19b-468c-b58c-00a2c97dd786] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:01:13.735652 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-128ff3a6-e344-416e-8d6c-56d2abce0aa1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:13.736251 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-128ff3a6-e344-416e-8d6c-56d2abce0aa1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:13.736987 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-128ff3a6-e344-416e-8d6c-56d2abce0aa1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:13.738595 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-128ff3a6-e344-416e-8d6c-56d2abce0aa1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:13.739405 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-128ff3a6-e344-416e-8d6c-56d2abce0aa1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:13.739839 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-128ff3a6-e344-416e-8d6c-56d2abce0aa1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:13.907843 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b0fce740-86d7-4251-a767-0a59f830be0a tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:01:13.908463 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b0fce740-86d7-4251-a767-0a59f830be0a tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] [instance: 57baac8d-c9ab-47fc-821c-3e82036eea26] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:01:13.916405 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0fce740-86d7-4251-a767-0a59f830be0a tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:13.917112 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0fce740-86d7-4251-a767-0a59f830be0a tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:13.917709 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0fce740-86d7-4251-a767-0a59f830be0a tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:13.918549 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0fce740-86d7-4251-a767-0a59f830be0a tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:13.919140 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0fce740-86d7-4251-a767-0a59f830be0a tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:13.919729 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0fce740-86d7-4251-a767-0a59f830be0a tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:13.923267 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-128ff3a6-e344-416e-8d6c-56d2abce0aa1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:01:13.937830 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-128ff3a6-e344-416e-8d6c-56d2abce0aa1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786" status: 200 len: 1215 microversion: 2.1 time: 0.214086 Oct 30 02:01:13.945507 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3349/6705] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:01:13 2022] GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786 => generated 1215 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:01:13.988126 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b0fce740-86d7-4251-a767-0a59f830be0a tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685162cc09ea436baabe059b9b346ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815809ec42e44bce9da3c4e354b425bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:01:13.999334 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b0fce740-86d7-4251-a767-0a59f830be0a tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] 10.222.0.13 "GET /compute/v2.1/servers/57baac8d-c9ab-47fc-821c-3e82036eea26" status: 200 len: 1147 microversion: 2.1 time: 0.112613 Oct 30 02:01:14.000432 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3357/6706] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:01:13 2022] GET /compute/v2.1/servers/57baac8d-c9ab-47fc-821c-3e82036eea26 => generated 1147 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:01:14.961612 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a2e2dd39-0925-454c-910c-ce5fa382ad35 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:01:14.963261 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a2e2dd39-0925-454c-910c-ce5fa382ad35 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: c2f68445-c19b-468c-b58c-00a2c97dd786] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:01:14.970574 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a2e2dd39-0925-454c-910c-ce5fa382ad35 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:14.971188 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a2e2dd39-0925-454c-910c-ce5fa382ad35 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:14.972287 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a2e2dd39-0925-454c-910c-ce5fa382ad35 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:14.973181 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a2e2dd39-0925-454c-910c-ce5fa382ad35 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:14.973783 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a2e2dd39-0925-454c-910c-ce5fa382ad35 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:14.974308 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a2e2dd39-0925-454c-910c-ce5fa382ad35 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:15.024089 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-354b92cc-c194-49de-b9d8-4fc9b43b7e77 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:01:15.024799 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-354b92cc-c194-49de-b9d8-4fc9b43b7e77 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] [instance: 57baac8d-c9ab-47fc-821c-3e82036eea26] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:01:15.034784 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-354b92cc-c194-49de-b9d8-4fc9b43b7e77 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:15.035370 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-354b92cc-c194-49de-b9d8-4fc9b43b7e77 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:15.035876 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-354b92cc-c194-49de-b9d8-4fc9b43b7e77 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:15.037146 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-354b92cc-c194-49de-b9d8-4fc9b43b7e77 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:15.037698 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-354b92cc-c194-49de-b9d8-4fc9b43b7e77 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:15.038190 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-354b92cc-c194-49de-b9d8-4fc9b43b7e77 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:15.151870 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-354b92cc-c194-49de-b9d8-4fc9b43b7e77 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685162cc09ea436baabe059b9b346ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815809ec42e44bce9da3c4e354b425bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:01:15.160333 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-354b92cc-c194-49de-b9d8-4fc9b43b7e77 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] 10.222.0.13 "GET /compute/v2.1/servers/57baac8d-c9ab-47fc-821c-3e82036eea26" status: 200 len: 1203 microversion: 2.1 time: 0.140793 Oct 30 02:01:15.161035 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3358/6707] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:01:15 2022] GET /compute/v2.1/servers/57baac8d-c9ab-47fc-821c-3e82036eea26 => generated 1203 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:01:15.204669 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a2e2dd39-0925-454c-910c-ce5fa382ad35 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:01:15.215396 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a2e2dd39-0925-454c-910c-ce5fa382ad35 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786" status: 200 len: 1203 microversion: 2.1 time: 0.257593 Oct 30 02:01:15.215870 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3350/6708] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:01:14 2022] GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786 => generated 1203 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:01:16.184268 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f6a49841-0708-45bc-b2c5-a50318421194 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:01:16.185480 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f6a49841-0708-45bc-b2c5-a50318421194 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] [instance: 57baac8d-c9ab-47fc-821c-3e82036eea26] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:01:16.197916 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f6a49841-0708-45bc-b2c5-a50318421194 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:16.199679 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f6a49841-0708-45bc-b2c5-a50318421194 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:16.200274 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f6a49841-0708-45bc-b2c5-a50318421194 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:16.201900 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f6a49841-0708-45bc-b2c5-a50318421194 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:16.203726 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f6a49841-0708-45bc-b2c5-a50318421194 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:16.205882 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f6a49841-0708-45bc-b2c5-a50318421194 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:16.242032 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-df040c5b-4d39-4ef3-858e-32a01fce843e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:01:16.242662 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-df040c5b-4d39-4ef3-858e-32a01fce843e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: c2f68445-c19b-468c-b58c-00a2c97dd786] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:01:16.258102 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df040c5b-4d39-4ef3-858e-32a01fce843e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:16.258834 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df040c5b-4d39-4ef3-858e-32a01fce843e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:16.259455 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df040c5b-4d39-4ef3-858e-32a01fce843e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:16.260336 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df040c5b-4d39-4ef3-858e-32a01fce843e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:16.260947 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df040c5b-4d39-4ef3-858e-32a01fce843e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:16.261561 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df040c5b-4d39-4ef3-858e-32a01fce843e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:16.558837 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f6a49841-0708-45bc-b2c5-a50318421194 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685162cc09ea436baabe059b9b346ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815809ec42e44bce9da3c4e354b425bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:01:16.565773 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-df040c5b-4d39-4ef3-858e-32a01fce843e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:01:16.581192 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-df040c5b-4d39-4ef3-858e-32a01fce843e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786" status: 200 len: 1203 microversion: 2.1 time: 0.342991 Oct 30 02:01:16.581797 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f6a49841-0708-45bc-b2c5-a50318421194 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] 10.222.0.13 "GET /compute/v2.1/servers/57baac8d-c9ab-47fc-821c-3e82036eea26" status: 200 len: 1281 microversion: 2.1 time: 0.401594 Oct 30 02:01:16.594792 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3359/6710] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:01:16 2022] GET /compute/v2.1/servers/57baac8d-c9ab-47fc-821c-3e82036eea26 => generated 1281 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:01:16.594954 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3351/6710] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:01:16 2022] GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786 => generated 1203 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:01:17.402349 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-e552efdc-e9ca-43e5-967f-4984955c9e1b req-c00de4ba-391a-4786-9222-e0860d004edf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57baac8d-c9ab-47fc-821c-3e82036eea26", "tag": "7d6a0c00-b1ed-4923-a952-8d2779e021df"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:01:17.413073 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-e552efdc-e9ca-43e5-967f-4984955c9e1b req-c00de4ba-391a-4786-9222-e0860d004edf service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:17.413750 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-e552efdc-e9ca-43e5-967f-4984955c9e1b req-c00de4ba-391a-4786-9222-e0860d004edf service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:17.414324 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-e552efdc-e9ca-43e5-967f-4984955c9e1b req-c00de4ba-391a-4786-9222-e0860d004edf service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:17.427574 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-e552efdc-e9ca-43e5-967f-4984955c9e1b req-c00de4ba-391a-4786-9222-e0860d004edf service nova] Creating event network-changed:7d6a0c00-b1ed-4923-a952-8d2779e021df for instance 57baac8d-c9ab-47fc-821c-3e82036eea26 on n-h1-master-1 Oct 30 02:01:17.432945 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-e552efdc-e9ca-43e5-967f-4984955c9e1b req-c00de4ba-391a-4786-9222-e0860d004edf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034853 Oct 30 02:01:17.434089 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3360/6711] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:01:17.606580 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4de196de-8174-4c46-89b7-1d5db57c158d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:01:17.606847 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-669d011e-995f-4609-8790-252557931073 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:01:17.607558 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4de196de-8174-4c46-89b7-1d5db57c158d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: c2f68445-c19b-468c-b58c-00a2c97dd786] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:01:17.608308 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-669d011e-995f-4609-8790-252557931073 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] [instance: 57baac8d-c9ab-47fc-821c-3e82036eea26] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:01:17.618555 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-669d011e-995f-4609-8790-252557931073 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:17.618783 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4de196de-8174-4c46-89b7-1d5db57c158d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:17.619461 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-669d011e-995f-4609-8790-252557931073 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:17.619580 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4de196de-8174-4c46-89b7-1d5db57c158d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:17.620133 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4de196de-8174-4c46-89b7-1d5db57c158d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:17.620312 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-669d011e-995f-4609-8790-252557931073 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:17.621011 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4de196de-8174-4c46-89b7-1d5db57c158d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:17.621542 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-669d011e-995f-4609-8790-252557931073 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:17.621673 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4de196de-8174-4c46-89b7-1d5db57c158d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:17.622066 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4de196de-8174-4c46-89b7-1d5db57c158d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:17.622575 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-669d011e-995f-4609-8790-252557931073 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:17.623123 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-669d011e-995f-4609-8790-252557931073 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:17.917141 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4de196de-8174-4c46-89b7-1d5db57c158d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:01:17.926080 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4de196de-8174-4c46-89b7-1d5db57c158d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786" status: 200 len: 1203 microversion: 2.1 time: 0.323907 Oct 30 02:01:17.927010 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3361/6712] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:01:17 2022] GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786 => generated 1203 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:01:17.971030 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-669d011e-995f-4609-8790-252557931073 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685162cc09ea436baabe059b9b346ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815809ec42e44bce9da3c4e354b425bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:01:17.979943 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-669d011e-995f-4609-8790-252557931073 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] 10.222.0.13 "GET /compute/v2.1/servers/57baac8d-c9ab-47fc-821c-3e82036eea26" status: 200 len: 1281 microversion: 2.1 time: 0.377934 Oct 30 02:01:17.980855 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3352/6713] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:01:17 2022] GET /compute/v2.1/servers/57baac8d-c9ab-47fc-821c-3e82036eea26 => generated 1281 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:01:18.949508 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-63c59e2a-b266-4c61-95d9-7e9510dd5c5c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:01:18.950129 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-63c59e2a-b266-4c61-95d9-7e9510dd5c5c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: c2f68445-c19b-468c-b58c-00a2c97dd786] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:01:18.957685 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-63c59e2a-b266-4c61-95d9-7e9510dd5c5c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:18.958187 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-63c59e2a-b266-4c61-95d9-7e9510dd5c5c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:18.958859 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-63c59e2a-b266-4c61-95d9-7e9510dd5c5c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:18.959565 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-63c59e2a-b266-4c61-95d9-7e9510dd5c5c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:18.960020 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-63c59e2a-b266-4c61-95d9-7e9510dd5c5c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:18.960456 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-63c59e2a-b266-4c61-95d9-7e9510dd5c5c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:19.008108 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-02f53f39-b9c8-4852-a8e4-81375957f84d tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:01:19.008744 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-02f53f39-b9c8-4852-a8e4-81375957f84d tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] [instance: 57baac8d-c9ab-47fc-821c-3e82036eea26] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:01:19.023031 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-02f53f39-b9c8-4852-a8e4-81375957f84d tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:19.023031 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-02f53f39-b9c8-4852-a8e4-81375957f84d tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:19.023031 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-02f53f39-b9c8-4852-a8e4-81375957f84d tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:19.023031 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-02f53f39-b9c8-4852-a8e4-81375957f84d tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:19.023031 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-02f53f39-b9c8-4852-a8e4-81375957f84d tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:19.023031 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-02f53f39-b9c8-4852-a8e4-81375957f84d tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:19.159590 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-63c59e2a-b266-4c61-95d9-7e9510dd5c5c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:01:19.177486 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-63c59e2a-b266-4c61-95d9-7e9510dd5c5c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786" status: 200 len: 1203 microversion: 2.1 time: 0.227221 Oct 30 02:01:19.178390 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3362/6714] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:01:18 2022] GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786 => generated 1203 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:01:19.216330 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-02f53f39-b9c8-4852-a8e4-81375957f84d tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685162cc09ea436baabe059b9b346ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815809ec42e44bce9da3c4e354b425bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:01:19.224944 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-02f53f39-b9c8-4852-a8e4-81375957f84d tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] 10.222.0.13 "GET /compute/v2.1/servers/57baac8d-c9ab-47fc-821c-3e82036eea26" status: 200 len: 1281 microversion: 2.1 time: 0.220800 Oct 30 02:01:19.229855 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3353/6715] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:01:19 2022] GET /compute/v2.1/servers/57baac8d-c9ab-47fc-821c-3e82036eea26 => generated 1281 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:01:20.206361 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-26bc830a-05fe-4d8a-a759-1f4504b3743b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:01:20.209473 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-26bc830a-05fe-4d8a-a759-1f4504b3743b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: c2f68445-c19b-468c-b58c-00a2c97dd786] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:01:20.219503 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-26bc830a-05fe-4d8a-a759-1f4504b3743b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:20.220304 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-26bc830a-05fe-4d8a-a759-1f4504b3743b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:20.220934 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-26bc830a-05fe-4d8a-a759-1f4504b3743b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:20.222299 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-26bc830a-05fe-4d8a-a759-1f4504b3743b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:20.223160 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-26bc830a-05fe-4d8a-a759-1f4504b3743b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:20.223784 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-26bc830a-05fe-4d8a-a759-1f4504b3743b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:20.253665 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-00dd5b1d-3ab9-43e9-9694-62cfdd6ea7bd tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:01:20.253665 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-00dd5b1d-3ab9-43e9-9694-62cfdd6ea7bd tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] [instance: 57baac8d-c9ab-47fc-821c-3e82036eea26] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:01:20.263828 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-00dd5b1d-3ab9-43e9-9694-62cfdd6ea7bd tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:20.264329 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-00dd5b1d-3ab9-43e9-9694-62cfdd6ea7bd tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:20.264803 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-00dd5b1d-3ab9-43e9-9694-62cfdd6ea7bd tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:20.265565 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-00dd5b1d-3ab9-43e9-9694-62cfdd6ea7bd tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:20.266029 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-00dd5b1d-3ab9-43e9-9694-62cfdd6ea7bd tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:20.266464 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-00dd5b1d-3ab9-43e9-9694-62cfdd6ea7bd tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:20.429243 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-26bc830a-05fe-4d8a-a759-1f4504b3743b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:01:20.437207 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-26bc830a-05fe-4d8a-a759-1f4504b3743b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786" status: 200 len: 1203 microversion: 2.1 time: 0.236959 Oct 30 02:01:20.437888 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3363/6716] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:01:20 2022] GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786 => generated 1203 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:01:20.458486 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-00dd5b1d-3ab9-43e9-9694-62cfdd6ea7bd tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685162cc09ea436baabe059b9b346ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815809ec42e44bce9da3c4e354b425bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:01:20.466652 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-00dd5b1d-3ab9-43e9-9694-62cfdd6ea7bd tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] 10.222.0.13 "GET /compute/v2.1/servers/57baac8d-c9ab-47fc-821c-3e82036eea26" status: 200 len: 1281 microversion: 2.1 time: 0.223055 Oct 30 02:01:20.467225 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3354/6717] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:01:20 2022] GET /compute/v2.1/servers/57baac8d-c9ab-47fc-821c-3e82036eea26 => generated 1281 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:01:21.460229 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f08fbb36-0af7-4309-aedb-0d88c8e08ed6 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:01:21.460859 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f08fbb36-0af7-4309-aedb-0d88c8e08ed6 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: c2f68445-c19b-468c-b58c-00a2c97dd786] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:01:21.467814 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f08fbb36-0af7-4309-aedb-0d88c8e08ed6 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:21.468293 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f08fbb36-0af7-4309-aedb-0d88c8e08ed6 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:21.468725 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f08fbb36-0af7-4309-aedb-0d88c8e08ed6 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:21.469440 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f08fbb36-0af7-4309-aedb-0d88c8e08ed6 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:21.469891 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f08fbb36-0af7-4309-aedb-0d88c8e08ed6 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:21.470312 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f08fbb36-0af7-4309-aedb-0d88c8e08ed6 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:21.492726 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-46070e6b-d4de-4a0c-b19d-d9d8cb1b4fcd tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:01:21.493837 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-46070e6b-d4de-4a0c-b19d-d9d8cb1b4fcd tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] [instance: 57baac8d-c9ab-47fc-821c-3e82036eea26] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:01:21.501206 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-46070e6b-d4de-4a0c-b19d-d9d8cb1b4fcd tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:21.501818 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-46070e6b-d4de-4a0c-b19d-d9d8cb1b4fcd tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:21.502367 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-46070e6b-d4de-4a0c-b19d-d9d8cb1b4fcd tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:21.503848 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-46070e6b-d4de-4a0c-b19d-d9d8cb1b4fcd tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:21.504309 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-46070e6b-d4de-4a0c-b19d-d9d8cb1b4fcd tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:21.504739 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-46070e6b-d4de-4a0c-b19d-d9d8cb1b4fcd tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:21.660180 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f08fbb36-0af7-4309-aedb-0d88c8e08ed6 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:01:21.670024 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f08fbb36-0af7-4309-aedb-0d88c8e08ed6 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786" status: 200 len: 1203 microversion: 2.1 time: 0.213660 Oct 30 02:01:21.685325 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3364/6718] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:01:21 2022] GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786 => generated 1203 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:01:21.687460 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-46070e6b-d4de-4a0c-b19d-d9d8cb1b4fcd tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685162cc09ea436baabe059b9b346ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815809ec42e44bce9da3c4e354b425bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:01:21.696380 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-46070e6b-d4de-4a0c-b19d-d9d8cb1b4fcd tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] 10.222.0.13 "GET /compute/v2.1/servers/57baac8d-c9ab-47fc-821c-3e82036eea26" status: 200 len: 1269 microversion: 2.1 time: 0.207822 Oct 30 02:01:21.697035 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3355/6719] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:01:21 2022] GET /compute/v2.1/servers/57baac8d-c9ab-47fc-821c-3e82036eea26 => generated 1269 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:01:22.693193 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cb52714c-456e-4cb6-b704-ce3f74d6a275 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:01:22.693831 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cb52714c-456e-4cb6-b704-ce3f74d6a275 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: c2f68445-c19b-468c-b58c-00a2c97dd786] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:01:22.700622 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cb52714c-456e-4cb6-b704-ce3f74d6a275 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:22.701101 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cb52714c-456e-4cb6-b704-ce3f74d6a275 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:22.701634 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cb52714c-456e-4cb6-b704-ce3f74d6a275 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:22.702325 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cb52714c-456e-4cb6-b704-ce3f74d6a275 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:22.702778 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cb52714c-456e-4cb6-b704-ce3f74d6a275 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:22.703197 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cb52714c-456e-4cb6-b704-ce3f74d6a275 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:22.719861 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-327f9d49-b3aa-4719-a129-7b0436d0ec6b tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:01:22.720477 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-327f9d49-b3aa-4719-a129-7b0436d0ec6b tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] [instance: 57baac8d-c9ab-47fc-821c-3e82036eea26] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:01:22.722371 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=4 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:01:22.723767 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=16 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:01:22.729605 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-327f9d49-b3aa-4719-a129-7b0436d0ec6b tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:22.739220 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-327f9d49-b3aa-4719-a129-7b0436d0ec6b tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:22.739220 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-327f9d49-b3aa-4719-a129-7b0436d0ec6b tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:22.739220 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-327f9d49-b3aa-4719-a129-7b0436d0ec6b tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:22.739220 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-327f9d49-b3aa-4719-a129-7b0436d0ec6b tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:22.739220 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-327f9d49-b3aa-4719-a129-7b0436d0ec6b tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:22.853209 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=4 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:01:22.889371 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-cb52714c-456e-4cb6-b704-ce3f74d6a275 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:01:22.904691 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cb52714c-456e-4cb6-b704-ce3f74d6a275 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786" status: 200 len: 1203 microversion: 2.1 time: 0.215924 Oct 30 02:01:22.905283 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3365/6720] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:01:22 2022] GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786 => generated 1203 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:01:22.916697 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-327f9d49-b3aa-4719-a129-7b0436d0ec6b tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685162cc09ea436baabe059b9b346ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815809ec42e44bce9da3c4e354b425bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:01:22.925688 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-327f9d49-b3aa-4719-a129-7b0436d0ec6b tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] 10.222.0.13 "GET /compute/v2.1/servers/57baac8d-c9ab-47fc-821c-3e82036eea26" status: 200 len: 1269 microversion: 2.1 time: 0.209653 Oct 30 02:01:22.926267 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3356/6721] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:01:22 2022] GET /compute/v2.1/servers/57baac8d-c9ab-47fc-821c-3e82036eea26 => generated 1269 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:01:23.926963 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-04468095-e938-427e-bcba-cbf1f4925cae tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:01:23.932048 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-04468095-e938-427e-bcba-cbf1f4925cae tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: c2f68445-c19b-468c-b58c-00a2c97dd786] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:01:23.938806 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04468095-e938-427e-bcba-cbf1f4925cae tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:23.939298 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04468095-e938-427e-bcba-cbf1f4925cae tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:23.939730 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04468095-e938-427e-bcba-cbf1f4925cae tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:23.940430 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04468095-e938-427e-bcba-cbf1f4925cae tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:23.940877 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04468095-e938-427e-bcba-cbf1f4925cae tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:23.941296 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04468095-e938-427e-bcba-cbf1f4925cae tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:23.953272 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cb748e99-7ece-4cec-9d97-dc4626b22ce2 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:01:23.954532 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-cb748e99-7ece-4cec-9d97-dc4626b22ce2 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] [instance: 57baac8d-c9ab-47fc-821c-3e82036eea26] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:01:23.965582 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cb748e99-7ece-4cec-9d97-dc4626b22ce2 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:23.966559 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cb748e99-7ece-4cec-9d97-dc4626b22ce2 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:23.967069 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cb748e99-7ece-4cec-9d97-dc4626b22ce2 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:23.967912 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cb748e99-7ece-4cec-9d97-dc4626b22ce2 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:23.968493 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cb748e99-7ece-4cec-9d97-dc4626b22ce2 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:23.969145 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cb748e99-7ece-4cec-9d97-dc4626b22ce2 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:24.153841 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-04468095-e938-427e-bcba-cbf1f4925cae tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:01:24.164503 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-04468095-e938-427e-bcba-cbf1f4925cae tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786" status: 200 len: 1203 microversion: 2.1 time: 0.241199 Oct 30 02:01:24.180788 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3366/6722] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:01:23 2022] GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786 => generated 1203 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:01:24.181016 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-cb748e99-7ece-4cec-9d97-dc4626b22ce2 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685162cc09ea436baabe059b9b346ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815809ec42e44bce9da3c4e354b425bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:01:24.189509 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cb748e99-7ece-4cec-9d97-dc4626b22ce2 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] 10.222.0.13 "GET /compute/v2.1/servers/57baac8d-c9ab-47fc-821c-3e82036eea26" status: 200 len: 1269 microversion: 2.1 time: 0.244543 Oct 30 02:01:24.190625 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3357/6723] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:01:23 2022] GET /compute/v2.1/servers/57baac8d-c9ab-47fc-821c-3e82036eea26 => generated 1269 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:01:25.187502 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3ce337cc-81a1-40cb-8b41-e34a8cc8af8c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:01:25.188124 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3ce337cc-81a1-40cb-8b41-e34a8cc8af8c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: c2f68445-c19b-468c-b58c-00a2c97dd786] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:01:25.195093 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3ce337cc-81a1-40cb-8b41-e34a8cc8af8c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:25.195576 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3ce337cc-81a1-40cb-8b41-e34a8cc8af8c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:25.196013 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3ce337cc-81a1-40cb-8b41-e34a8cc8af8c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:25.196714 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3ce337cc-81a1-40cb-8b41-e34a8cc8af8c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:25.197166 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3ce337cc-81a1-40cb-8b41-e34a8cc8af8c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:25.197746 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3ce337cc-81a1-40cb-8b41-e34a8cc8af8c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:25.212781 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f36c3987-0b58-44f6-91c5-a149469f8bf0 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:01:25.214481 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f36c3987-0b58-44f6-91c5-a149469f8bf0 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] [instance: 57baac8d-c9ab-47fc-821c-3e82036eea26] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:01:25.221151 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f36c3987-0b58-44f6-91c5-a149469f8bf0 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:25.221784 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f36c3987-0b58-44f6-91c5-a149469f8bf0 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:25.222964 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f36c3987-0b58-44f6-91c5-a149469f8bf0 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:25.223767 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f36c3987-0b58-44f6-91c5-a149469f8bf0 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:25.224593 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f36c3987-0b58-44f6-91c5-a149469f8bf0 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:25.225243 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f36c3987-0b58-44f6-91c5-a149469f8bf0 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:25.405404 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3ce337cc-81a1-40cb-8b41-e34a8cc8af8c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:01:25.412235 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f36c3987-0b58-44f6-91c5-a149469f8bf0 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685162cc09ea436baabe059b9b346ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815809ec42e44bce9da3c4e354b425bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:01:25.414320 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3ce337cc-81a1-40cb-8b41-e34a8cc8af8c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786" status: 200 len: 1203 microversion: 2.1 time: 0.230639 Oct 30 02:01:25.415146 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3367/6724] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:01:25 2022] GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786 => generated 1203 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:01:25.421047 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f36c3987-0b58-44f6-91c5-a149469f8bf0 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] 10.222.0.13 "GET /compute/v2.1/servers/57baac8d-c9ab-47fc-821c-3e82036eea26" status: 200 len: 1269 microversion: 2.1 time: 0.212343 Oct 30 02:01:25.421668 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3358/6725] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:01:25 2022] GET /compute/v2.1/servers/57baac8d-c9ab-47fc-821c-3e82036eea26 => generated 1269 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:01:25.760562 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-bccee7b5-da26-4812-a012-db47f6aa6373 req-8dda9c5d-a74a-4a80-ac21-8fc004f2dc3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2f68445-c19b-468c-b58c-00a2c97dd786", "name": "network-vif-plugged", "status": "completed", "tag": "453669ef-526b-4cf0-bf69-95793fc87590"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:01:25.770793 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-bccee7b5-da26-4812-a012-db47f6aa6373 req-8dda9c5d-a74a-4a80-ac21-8fc004f2dc3e service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:25.771276 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-bccee7b5-da26-4812-a012-db47f6aa6373 req-8dda9c5d-a74a-4a80-ac21-8fc004f2dc3e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:25.771709 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-bccee7b5-da26-4812-a012-db47f6aa6373 req-8dda9c5d-a74a-4a80-ac21-8fc004f2dc3e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:25.782786 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-bccee7b5-da26-4812-a012-db47f6aa6373 req-8dda9c5d-a74a-4a80-ac21-8fc004f2dc3e service nova] Creating event network-vif-plugged:453669ef-526b-4cf0-bf69-95793fc87590 for instance c2f68445-c19b-468c-b58c-00a2c97dd786 on n-h2-master-1 Oct 30 02:01:25.787704 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-bccee7b5-da26-4812-a012-db47f6aa6373 req-8dda9c5d-a74a-4a80-ac21-8fc004f2dc3e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030958 Oct 30 02:01:25.788282 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3368/6726] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:01:26.437905 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8ada7098-8bba-4725-bdd1-b5b3f045f59c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:01:26.438635 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8ada7098-8bba-4725-bdd1-b5b3f045f59c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: c2f68445-c19b-468c-b58c-00a2c97dd786] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:01:26.445395 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d8d8f2d8-7246-4348-b7dd-adadb62591ec tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:01:26.445957 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ada7098-8bba-4725-bdd1-b5b3f045f59c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:26.446158 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d8d8f2d8-7246-4348-b7dd-adadb62591ec tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] [instance: 57baac8d-c9ab-47fc-821c-3e82036eea26] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:01:26.446462 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ada7098-8bba-4725-bdd1-b5b3f045f59c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:26.451293 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ada7098-8bba-4725-bdd1-b5b3f045f59c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:26.451293 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ada7098-8bba-4725-bdd1-b5b3f045f59c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:26.451293 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ada7098-8bba-4725-bdd1-b5b3f045f59c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:26.451293 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ada7098-8bba-4725-bdd1-b5b3f045f59c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:26.452270 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8d8f2d8-7246-4348-b7dd-adadb62591ec tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:26.452764 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8d8f2d8-7246-4348-b7dd-adadb62591ec tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:26.453245 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8d8f2d8-7246-4348-b7dd-adadb62591ec tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:26.453986 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8d8f2d8-7246-4348-b7dd-adadb62591ec tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:26.454445 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8d8f2d8-7246-4348-b7dd-adadb62591ec tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:26.454876 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8d8f2d8-7246-4348-b7dd-adadb62591ec tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:26.649076 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8ada7098-8bba-4725-bdd1-b5b3f045f59c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:01:26.651470 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d8d8f2d8-7246-4348-b7dd-adadb62591ec tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685162cc09ea436baabe059b9b346ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815809ec42e44bce9da3c4e354b425bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:01:26.658901 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8ada7098-8bba-4725-bdd1-b5b3f045f59c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786" status: 200 len: 1203 microversion: 2.1 time: 0.224914 Oct 30 02:01:26.660336 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d8d8f2d8-7246-4348-b7dd-adadb62591ec tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] 10.222.0.13 "GET /compute/v2.1/servers/57baac8d-c9ab-47fc-821c-3e82036eea26" status: 200 len: 1269 microversion: 2.1 time: 0.219289 Oct 30 02:01:26.665744 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3359/6727] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:01:26 2022] GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786 => generated 1203 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:01:26.676374 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3369/6728] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:01:26 2022] GET /compute/v2.1/servers/57baac8d-c9ab-47fc-821c-3e82036eea26 => generated 1269 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:01:27.684782 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ecc9de43-9606-4b08-977f-de531ee8b1cf tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:01:27.685298 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8c3ca867-d92c-406e-aa5b-5eb13eed002f tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:01:27.685687 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8c3ca867-d92c-406e-aa5b-5eb13eed002f tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] [instance: 57baac8d-c9ab-47fc-821c-3e82036eea26] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:01:27.686777 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ecc9de43-9606-4b08-977f-de531ee8b1cf tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: c2f68445-c19b-468c-b58c-00a2c97dd786] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:01:27.694890 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ecc9de43-9606-4b08-977f-de531ee8b1cf tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:27.695419 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8c3ca867-d92c-406e-aa5b-5eb13eed002f tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:27.695595 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ecc9de43-9606-4b08-977f-de531ee8b1cf tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:27.695930 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8c3ca867-d92c-406e-aa5b-5eb13eed002f tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:27.696294 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ecc9de43-9606-4b08-977f-de531ee8b1cf tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:27.696403 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8c3ca867-d92c-406e-aa5b-5eb13eed002f tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:27.697072 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8c3ca867-d92c-406e-aa5b-5eb13eed002f tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:27.697311 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ecc9de43-9606-4b08-977f-de531ee8b1cf tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:27.697564 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8c3ca867-d92c-406e-aa5b-5eb13eed002f tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:27.697972 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ecc9de43-9606-4b08-977f-de531ee8b1cf tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:27.698061 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8c3ca867-d92c-406e-aa5b-5eb13eed002f tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:27.698562 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ecc9de43-9606-4b08-977f-de531ee8b1cf tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:27.722204 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:01:27.902556 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8c3ca867-d92c-406e-aa5b-5eb13eed002f tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685162cc09ea436baabe059b9b346ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815809ec42e44bce9da3c4e354b425bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:01:27.909592 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ecc9de43-9606-4b08-977f-de531ee8b1cf tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:01:27.915785 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8c3ca867-d92c-406e-aa5b-5eb13eed002f tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] 10.222.0.13 "GET /compute/v2.1/servers/57baac8d-c9ab-47fc-821c-3e82036eea26" status: 200 len: 1269 microversion: 2.1 time: 0.230535 Oct 30 02:01:27.915785 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3370/6729] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:01:27 2022] GET /compute/v2.1/servers/57baac8d-c9ab-47fc-821c-3e82036eea26 => generated 1269 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:01:27.918287 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ecc9de43-9606-4b08-977f-de531ee8b1cf tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786" status: 200 len: 1390 microversion: 2.1 time: 0.238463 Oct 30 02:01:27.918880 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3360/6730] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:01:27 2022] GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786 => generated 1390 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:01:27.941028 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4c82a602-86d7-4fff-865e-db22b8582b79 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:01:27.941722 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4c82a602-86d7-4fff-865e-db22b8582b79 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: c2f68445-c19b-468c-b58c-00a2c97dd786] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:01:27.948322 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4c82a602-86d7-4fff-865e-db22b8582b79 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:27.948811 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4c82a602-86d7-4fff-865e-db22b8582b79 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:27.949250 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4c82a602-86d7-4fff-865e-db22b8582b79 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:27.950366 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4c82a602-86d7-4fff-865e-db22b8582b79 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:27.950547 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4c82a602-86d7-4fff-865e-db22b8582b79 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:27.950861 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4c82a602-86d7-4fff-865e-db22b8582b79 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:28.096315 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4c82a602-86d7-4fff-865e-db22b8582b79 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:01:28.104531 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4c82a602-86d7-4fff-865e-db22b8582b79 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786" status: 200 len: 1390 microversion: 2.1 time: 0.167577 Oct 30 02:01:28.105091 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3371/6731] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:01:27 2022] GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786 => generated 1390 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:01:28.126864 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ff1e8259-f04a-4c7e-9031-15bf79dc92ab tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:01:28.127548 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ff1e8259-f04a-4c7e-9031-15bf79dc92ab tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: c2f68445-c19b-468c-b58c-00a2c97dd786] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:01:28.133686 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ff1e8259-f04a-4c7e-9031-15bf79dc92ab tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:28.134181 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ff1e8259-f04a-4c7e-9031-15bf79dc92ab tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:28.134626 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ff1e8259-f04a-4c7e-9031-15bf79dc92ab tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:28.135326 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ff1e8259-f04a-4c7e-9031-15bf79dc92ab tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:28.135788 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ff1e8259-f04a-4c7e-9031-15bf79dc92ab tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:28.136222 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ff1e8259-f04a-4c7e-9031-15bf79dc92ab tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:28.268473 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ff1e8259-f04a-4c7e-9031-15bf79dc92ab tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:01:28.276967 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ff1e8259-f04a-4c7e-9031-15bf79dc92ab tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786" status: 200 len: 1390 microversion: 2.1 time: 0.154056 Oct 30 02:01:28.278462 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3361/6732] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:01:28 2022] GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786 => generated 1390 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:01:28.299541 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-58cc9891-3c50-496d-b49d-722369ef444e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:01:28.300034 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-58cc9891-3c50-496d-b49d-722369ef444e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: c2f68445-c19b-468c-b58c-00a2c97dd786] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:01:28.306128 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-58cc9891-3c50-496d-b49d-722369ef444e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:28.306621 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-58cc9891-3c50-496d-b49d-722369ef444e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:28.307050 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-58cc9891-3c50-496d-b49d-722369ef444e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:28.307745 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-58cc9891-3c50-496d-b49d-722369ef444e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:28.308191 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-58cc9891-3c50-496d-b49d-722369ef444e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:28.308613 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-58cc9891-3c50-496d-b49d-722369ef444e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:28.334182 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-58cc9891-3c50-496d-b49d-722369ef444e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: c2f68445-c19b-468c-b58c-00a2c97dd786] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 02:01:28.612552 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-58cc9891-3c50-496d-b49d-722369ef444e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786" status: 204 len: 0 microversion: 2.1 time: 0.316748 Oct 30 02:01:28.613141 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3372/6733] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 02:01:28 2022] DELETE /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 30 02:01:28.621464 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4010918e-26ed-4934-8168-cdd83e31203a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:01:28.622072 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4010918e-26ed-4934-8168-cdd83e31203a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: c2f68445-c19b-468c-b58c-00a2c97dd786] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:01:28.628089 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4010918e-26ed-4934-8168-cdd83e31203a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:28.631185 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4010918e-26ed-4934-8168-cdd83e31203a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:28.631185 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4010918e-26ed-4934-8168-cdd83e31203a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:28.631185 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4010918e-26ed-4934-8168-cdd83e31203a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:28.631185 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4010918e-26ed-4934-8168-cdd83e31203a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:28.631185 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4010918e-26ed-4934-8168-cdd83e31203a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:28.767952 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4010918e-26ed-4934-8168-cdd83e31203a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:01:28.772182 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=100 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:01:28.776918 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4010918e-26ed-4934-8168-cdd83e31203a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786" status: 200 len: 1396 microversion: 2.1 time: 0.159427 Oct 30 02:01:28.777562 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3362/6734] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:01:28 2022] GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786 => generated 1396 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:01:28.934986 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-642d8e54-f21d-4954-b1c1-f2b549ef3e24 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:01:28.936138 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-642d8e54-f21d-4954-b1c1-f2b549ef3e24 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] [instance: 57baac8d-c9ab-47fc-821c-3e82036eea26] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:01:28.956699 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-642d8e54-f21d-4954-b1c1-f2b549ef3e24 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:28.958113 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-642d8e54-f21d-4954-b1c1-f2b549ef3e24 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:28.958784 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-642d8e54-f21d-4954-b1c1-f2b549ef3e24 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:28.959899 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-642d8e54-f21d-4954-b1c1-f2b549ef3e24 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:28.960515 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-642d8e54-f21d-4954-b1c1-f2b549ef3e24 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:28.961880 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-642d8e54-f21d-4954-b1c1-f2b549ef3e24 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:29.108983 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-642d8e54-f21d-4954-b1c1-f2b549ef3e24 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685162cc09ea436baabe059b9b346ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815809ec42e44bce9da3c4e354b425bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:01:29.117832 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-642d8e54-f21d-4954-b1c1-f2b549ef3e24 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] 10.222.0.13 "GET /compute/v2.1/servers/57baac8d-c9ab-47fc-821c-3e82036eea26" status: 200 len: 1269 microversion: 2.1 time: 0.187894 Oct 30 02:01:29.118734 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3373/6735] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:01:28 2022] GET /compute/v2.1/servers/57baac8d-c9ab-47fc-821c-3e82036eea26 => generated 1269 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:01:29.799984 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0b8ba8a5-0348-4b02-b6a1-98a280de4253 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:01:29.800617 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0b8ba8a5-0348-4b02-b6a1-98a280de4253 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: c2f68445-c19b-468c-b58c-00a2c97dd786] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:01:29.808001 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b8ba8a5-0348-4b02-b6a1-98a280de4253 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:29.808500 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b8ba8a5-0348-4b02-b6a1-98a280de4253 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:29.808975 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b8ba8a5-0348-4b02-b6a1-98a280de4253 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:29.809717 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b8ba8a5-0348-4b02-b6a1-98a280de4253 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:29.810179 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b8ba8a5-0348-4b02-b6a1-98a280de4253 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:29.819792 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b8ba8a5-0348-4b02-b6a1-98a280de4253 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:29.948964 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0b8ba8a5-0348-4b02-b6a1-98a280de4253 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:01:29.958106 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0b8ba8a5-0348-4b02-b6a1-98a280de4253 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786" status: 200 len: 1396 microversion: 2.1 time: 0.162081 Oct 30 02:01:29.958907 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3363/6736] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:01:29 2022] GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786 => generated 1396 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:01:30.141175 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a97b61ba-2173-4ad6-91e4-6067952ab1b8 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:01:30.141910 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a97b61ba-2173-4ad6-91e4-6067952ab1b8 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] [instance: 57baac8d-c9ab-47fc-821c-3e82036eea26] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:01:30.148772 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a97b61ba-2173-4ad6-91e4-6067952ab1b8 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:30.149262 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a97b61ba-2173-4ad6-91e4-6067952ab1b8 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:30.149756 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a97b61ba-2173-4ad6-91e4-6067952ab1b8 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:30.150455 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a97b61ba-2173-4ad6-91e4-6067952ab1b8 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:30.150930 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a97b61ba-2173-4ad6-91e4-6067952ab1b8 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:30.151344 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a97b61ba-2173-4ad6-91e4-6067952ab1b8 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:30.393251 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a97b61ba-2173-4ad6-91e4-6067952ab1b8 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685162cc09ea436baabe059b9b346ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815809ec42e44bce9da3c4e354b425bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:01:30.402389 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a97b61ba-2173-4ad6-91e4-6067952ab1b8 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] 10.222.0.13 "GET /compute/v2.1/servers/57baac8d-c9ab-47fc-821c-3e82036eea26" status: 200 len: 1269 microversion: 2.1 time: 0.265161 Oct 30 02:01:30.419452 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3374/6737] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:01:30 2022] GET /compute/v2.1/servers/57baac8d-c9ab-47fc-821c-3e82036eea26 => generated 1269 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:01:30.498353 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-e3b5bcb9-ac41-4283-8b55-e4313a1a94ee req-cd06b638-a023-4ddd-947a-664380a8eede service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57baac8d-c9ab-47fc-821c-3e82036eea26", "name": "network-vif-plugged", "status": "completed", "tag": "7d6a0c00-b1ed-4923-a952-8d2779e021df"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:01:30.513368 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e3b5bcb9-ac41-4283-8b55-e4313a1a94ee req-cd06b638-a023-4ddd-947a-664380a8eede service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:30.517154 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e3b5bcb9-ac41-4283-8b55-e4313a1a94ee req-cd06b638-a023-4ddd-947a-664380a8eede service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:30.517154 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e3b5bcb9-ac41-4283-8b55-e4313a1a94ee req-cd06b638-a023-4ddd-947a-664380a8eede service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:30.526607 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-e3b5bcb9-ac41-4283-8b55-e4313a1a94ee req-cd06b638-a023-4ddd-947a-664380a8eede service nova] Creating event network-vif-plugged:7d6a0c00-b1ed-4923-a952-8d2779e021df for instance 57baac8d-c9ab-47fc-821c-3e82036eea26 on n-h1-master-1 Oct 30 02:01:30.532055 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-e3b5bcb9-ac41-4283-8b55-e4313a1a94ee req-cd06b638-a023-4ddd-947a-664380a8eede service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040525 Oct 30 02:01:30.532660 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3364/6738] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:01:30.857896 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-c0a41700-025c-48a5-ae0e-2ce82d8c6ff4 req-adc29093-2095-4742-9c66-6b2ae3e9f710 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2f68445-c19b-468c-b58c-00a2c97dd786", "name": "network-vif-deleted", "tag": "453669ef-526b-4cf0-bf69-95793fc87590"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:01:30.867624 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-c0a41700-025c-48a5-ae0e-2ce82d8c6ff4 req-adc29093-2095-4742-9c66-6b2ae3e9f710 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:30.868107 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-c0a41700-025c-48a5-ae0e-2ce82d8c6ff4 req-adc29093-2095-4742-9c66-6b2ae3e9f710 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:30.868553 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-c0a41700-025c-48a5-ae0e-2ce82d8c6ff4 req-adc29093-2095-4742-9c66-6b2ae3e9f710 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:30.887897 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-c0a41700-025c-48a5-ae0e-2ce82d8c6ff4 req-adc29093-2095-4742-9c66-6b2ae3e9f710 service nova] Creating event network-vif-deleted:453669ef-526b-4cf0-bf69-95793fc87590 for instance c2f68445-c19b-468c-b58c-00a2c97dd786 on n-h2-master-1 Oct 30 02:01:30.893066 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-c0a41700-025c-48a5-ae0e-2ce82d8c6ff4 req-adc29093-2095-4742-9c66-6b2ae3e9f710 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038954 Oct 30 02:01:30.894039 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3375/6739] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:01:30.983126 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e1024fcd-5ce8-4307-8c94-1f053c38b127 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:01:30.985046 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e1024fcd-5ce8-4307-8c94-1f053c38b127 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: c2f68445-c19b-468c-b58c-00a2c97dd786] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:01:30.994595 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e1024fcd-5ce8-4307-8c94-1f053c38b127 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:30.995332 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e1024fcd-5ce8-4307-8c94-1f053c38b127 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:30.995934 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e1024fcd-5ce8-4307-8c94-1f053c38b127 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:30.997285 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e1024fcd-5ce8-4307-8c94-1f053c38b127 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:30.997937 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e1024fcd-5ce8-4307-8c94-1f053c38b127 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:30.998515 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e1024fcd-5ce8-4307-8c94-1f053c38b127 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:31.068812 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e1024fcd-5ce8-4307-8c94-1f053c38b127 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:01:31.081669 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e1024fcd-5ce8-4307-8c94-1f053c38b127 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786" status: 200 len: 1188 microversion: 2.1 time: 0.103181 Oct 30 02:01:31.082888 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3365/6740] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:01:30 2022] GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786 => generated 1188 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:01:31.428353 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-53561327-d9a4-4abf-9e40-cf0f355e6dbd tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:01:31.429115 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-53561327-d9a4-4abf-9e40-cf0f355e6dbd tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] [instance: 57baac8d-c9ab-47fc-821c-3e82036eea26] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:01:31.435418 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53561327-d9a4-4abf-9e40-cf0f355e6dbd tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:31.436094 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53561327-d9a4-4abf-9e40-cf0f355e6dbd tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:31.436526 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53561327-d9a4-4abf-9e40-cf0f355e6dbd tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:31.437210 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53561327-d9a4-4abf-9e40-cf0f355e6dbd tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:31.437695 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53561327-d9a4-4abf-9e40-cf0f355e6dbd tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:31.438115 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53561327-d9a4-4abf-9e40-cf0f355e6dbd tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:31.573667 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-53561327-d9a4-4abf-9e40-cf0f355e6dbd tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685162cc09ea436baabe059b9b346ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815809ec42e44bce9da3c4e354b425bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:01:31.581665 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-53561327-d9a4-4abf-9e40-cf0f355e6dbd tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] 10.222.0.13 "GET /compute/v2.1/servers/57baac8d-c9ab-47fc-821c-3e82036eea26" status: 200 len: 1269 microversion: 2.1 time: 0.159045 Oct 30 02:01:31.582236 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3376/6741] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:01:31 2022] GET /compute/v2.1/servers/57baac8d-c9ab-47fc-821c-3e82036eea26 => generated 1269 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:01:32.107397 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9bab3575-bbd2-4687-a0a7-b544f21b58ac tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:01:32.108112 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9bab3575-bbd2-4687-a0a7-b544f21b58ac tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: c2f68445-c19b-468c-b58c-00a2c97dd786] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:01:32.115932 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9bab3575-bbd2-4687-a0a7-b544f21b58ac tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:32.116427 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9bab3575-bbd2-4687-a0a7-b544f21b58ac tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:32.116864 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9bab3575-bbd2-4687-a0a7-b544f21b58ac tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:32.117613 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9bab3575-bbd2-4687-a0a7-b544f21b58ac tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:32.118122 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9bab3575-bbd2-4687-a0a7-b544f21b58ac tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:32.118579 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9bab3575-bbd2-4687-a0a7-b544f21b58ac tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:32.185558 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9bab3575-bbd2-4687-a0a7-b544f21b58ac tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:01:32.193436 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9bab3575-bbd2-4687-a0a7-b544f21b58ac tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786" status: 200 len: 1188 microversion: 2.1 time: 0.091798 Oct 30 02:01:32.194038 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3366/6742] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:01:32 2022] GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786 => generated 1188 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:01:32.604617 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-eaf77abd-e9f6-4146-ae88-4082a0dd2bae tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:01:32.605229 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-eaf77abd-e9f6-4146-ae88-4082a0dd2bae tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] [instance: 57baac8d-c9ab-47fc-821c-3e82036eea26] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:01:32.612162 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eaf77abd-e9f6-4146-ae88-4082a0dd2bae tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:32.612650 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eaf77abd-e9f6-4146-ae88-4082a0dd2bae tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:32.613089 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eaf77abd-e9f6-4146-ae88-4082a0dd2bae tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:32.614431 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eaf77abd-e9f6-4146-ae88-4082a0dd2bae tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:32.614893 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eaf77abd-e9f6-4146-ae88-4082a0dd2bae tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:32.615322 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eaf77abd-e9f6-4146-ae88-4082a0dd2bae tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:32.743885 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-eaf77abd-e9f6-4146-ae88-4082a0dd2bae tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685162cc09ea436baabe059b9b346ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815809ec42e44bce9da3c4e354b425bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:01:32.751823 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-eaf77abd-e9f6-4146-ae88-4082a0dd2bae tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] 10.222.0.13 "GET /compute/v2.1/servers/57baac8d-c9ab-47fc-821c-3e82036eea26" status: 200 len: 1458 microversion: 2.1 time: 0.151090 Oct 30 02:01:32.752651 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3377/6743] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:01:32 2022] GET /compute/v2.1/servers/57baac8d-c9ab-47fc-821c-3e82036eea26 => generated 1458 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:01:32.775156 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d300761b-87eb-4ac9-941b-a1fd1a888a25 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:01:32.775902 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d300761b-87eb-4ac9-941b-a1fd1a888a25 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] [instance: 57baac8d-c9ab-47fc-821c-3e82036eea26] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:01:32.782146 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d300761b-87eb-4ac9-941b-a1fd1a888a25 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:32.782707 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d300761b-87eb-4ac9-941b-a1fd1a888a25 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:32.783211 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d300761b-87eb-4ac9-941b-a1fd1a888a25 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:32.783991 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d300761b-87eb-4ac9-941b-a1fd1a888a25 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:32.784517 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d300761b-87eb-4ac9-941b-a1fd1a888a25 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:32.785020 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d300761b-87eb-4ac9-941b-a1fd1a888a25 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:32.929396 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d300761b-87eb-4ac9-941b-a1fd1a888a25 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685162cc09ea436baabe059b9b346ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815809ec42e44bce9da3c4e354b425bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:01:32.937608 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d300761b-87eb-4ac9-941b-a1fd1a888a25 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] 10.222.0.13 "GET /compute/v2.1/servers/57baac8d-c9ab-47fc-821c-3e82036eea26" status: 200 len: 1458 microversion: 2.1 time: 0.166299 Oct 30 02:01:32.938202 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3367/6744] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:01:32 2022] GET /compute/v2.1/servers/57baac8d-c9ab-47fc-821c-3e82036eea26 => generated 1458 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:01:33.215764 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4ecdd054-ec3d-4b96-b9d5-286382c0146e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:01:33.216445 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4ecdd054-ec3d-4b96-b9d5-286382c0146e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: c2f68445-c19b-468c-b58c-00a2c97dd786] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:01:33.223332 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4ecdd054-ec3d-4b96-b9d5-286382c0146e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:33.223830 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4ecdd054-ec3d-4b96-b9d5-286382c0146e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:33.224273 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4ecdd054-ec3d-4b96-b9d5-286382c0146e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:33.224971 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4ecdd054-ec3d-4b96-b9d5-286382c0146e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:33.225460 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4ecdd054-ec3d-4b96-b9d5-286382c0146e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:33.225892 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4ecdd054-ec3d-4b96-b9d5-286382c0146e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:33.288373 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4ecdd054-ec3d-4b96-b9d5-286382c0146e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:01:33.296378 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4ecdd054-ec3d-4b96-b9d5-286382c0146e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786" status: 200 len: 1188 microversion: 2.1 time: 0.084906 Oct 30 02:01:33.300616 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3378/6745] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:01:33 2022] GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786 => generated 1188 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:01:34.319386 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0acfc5e2-f6ae-424f-8004-e6579abca8e7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:01:34.320010 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0acfc5e2-f6ae-424f-8004-e6579abca8e7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: c2f68445-c19b-468c-b58c-00a2c97dd786] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:01:34.322733 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=7 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:01:34.327790 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0acfc5e2-f6ae-424f-8004-e6579abca8e7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:34.334211 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0acfc5e2-f6ae-424f-8004-e6579abca8e7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:34.334211 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0acfc5e2-f6ae-424f-8004-e6579abca8e7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:34.334211 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0acfc5e2-f6ae-424f-8004-e6579abca8e7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:34.334211 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0acfc5e2-f6ae-424f-8004-e6579abca8e7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:34.334211 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0acfc5e2-f6ae-424f-8004-e6579abca8e7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:34.402515 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0acfc5e2-f6ae-424f-8004-e6579abca8e7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:01:34.411591 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0acfc5e2-f6ae-424f-8004-e6579abca8e7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786" status: 200 len: 1188 microversion: 2.1 time: 0.096254 Oct 30 02:01:34.412371 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3368/6746] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:01:34 2022] GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786 => generated 1188 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:01:35.379112 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-4d635805-d2f5-4d71-971d-ec3c4215db81 req-d6ef752c-a8ca-4f84-8b07-bde6f9e7f6e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57baac8d-c9ab-47fc-821c-3e82036eea26", "tag": "7d6a0c00-b1ed-4923-a952-8d2779e021df"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:01:35.409322 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-4d635805-d2f5-4d71-971d-ec3c4215db81 req-d6ef752c-a8ca-4f84-8b07-bde6f9e7f6e8 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:35.409322 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-4d635805-d2f5-4d71-971d-ec3c4215db81 req-d6ef752c-a8ca-4f84-8b07-bde6f9e7f6e8 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:35.410405 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-4d635805-d2f5-4d71-971d-ec3c4215db81 req-d6ef752c-a8ca-4f84-8b07-bde6f9e7f6e8 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:35.435115 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c7f0bfd8-224f-4f8e-bc13-0436930c9483 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:01:35.435969 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-4d635805-d2f5-4d71-971d-ec3c4215db81 req-d6ef752c-a8ca-4f84-8b07-bde6f9e7f6e8 service nova] Creating event network-changed:7d6a0c00-b1ed-4923-a952-8d2779e021df for instance 57baac8d-c9ab-47fc-821c-3e82036eea26 on n-h1-master-1 Oct 30 02:01:35.437192 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c7f0bfd8-224f-4f8e-bc13-0436930c9483 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: c2f68445-c19b-468c-b58c-00a2c97dd786] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:01:35.442238 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-4d635805-d2f5-4d71-971d-ec3c4215db81 req-d6ef752c-a8ca-4f84-8b07-bde6f9e7f6e8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068245 Oct 30 02:01:35.442842 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3379/6747] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:01:35.454810 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c7f0bfd8-224f-4f8e-bc13-0436930c9483 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:35.455340 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c7f0bfd8-224f-4f8e-bc13-0436930c9483 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:35.455793 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c7f0bfd8-224f-4f8e-bc13-0436930c9483 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:35.456565 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c7f0bfd8-224f-4f8e-bc13-0436930c9483 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:35.458993 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c7f0bfd8-224f-4f8e-bc13-0436930c9483 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:35.459509 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c7f0bfd8-224f-4f8e-bc13-0436930c9483 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:35.611334 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c7f0bfd8-224f-4f8e-bc13-0436930c9483 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:01:35.621151 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c7f0bfd8-224f-4f8e-bc13-0436930c9483 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786" status: 200 len: 1188 microversion: 2.1 time: 0.191233 Oct 30 02:01:35.621703 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3369/6748] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:01:35 2022] GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786 => generated 1188 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:01:36.644020 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-73413e21-aeac-45b2-a036-9163c5f22625 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:01:36.648648 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-73413e21-aeac-45b2-a036-9163c5f22625 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: c2f68445-c19b-468c-b58c-00a2c97dd786] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:01:36.664053 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-73413e21-aeac-45b2-a036-9163c5f22625 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:36.665545 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-73413e21-aeac-45b2-a036-9163c5f22625 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:36.666164 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-73413e21-aeac-45b2-a036-9163c5f22625 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:36.667477 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-73413e21-aeac-45b2-a036-9163c5f22625 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:36.668079 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-73413e21-aeac-45b2-a036-9163c5f22625 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:36.668651 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-73413e21-aeac-45b2-a036-9163c5f22625 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:36.704211 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-73413e21-aeac-45b2-a036-9163c5f22625 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:36.704690 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-73413e21-aeac-45b2-a036-9163c5f22625 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:36.705118 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-73413e21-aeac-45b2-a036-9163c5f22625 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:36.706089 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-73413e21-aeac-45b2-a036-9163c5f22625 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lazy-loading 'fault' on Instance uuid c2f68445-c19b-468c-b58c-00a2c97dd786 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 02:01:36.757306 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-73413e21-aeac-45b2-a036-9163c5f22625 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:01:36.765994 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-73413e21-aeac-45b2-a036-9163c5f22625 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786" status: 200 len: 1193 microversion: 2.1 time: 0.126394 Oct 30 02:01:36.778688 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3380/6749] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:01:36 2022] GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786 => generated 1193 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:01:37.458206 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-7caa337a-ba65-4997-9ea2-9706fce64151 req-cabbcbc0-7490-40db-ac62-c778596111e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57baac8d-c9ab-47fc-821c-3e82036eea26", "tag": "7d6a0c00-b1ed-4923-a952-8d2779e021df"}, {"name": "network-changed", "server_uuid": "57baac8d-c9ab-47fc-821c-3e82036eea26", "tag": "7d6a0c00-b1ed-4923-a952-8d2779e021df"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:01:37.469310 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-7caa337a-ba65-4997-9ea2-9706fce64151 req-cabbcbc0-7490-40db-ac62-c778596111e7 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:37.470082 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-7caa337a-ba65-4997-9ea2-9706fce64151 req-cabbcbc0-7490-40db-ac62-c778596111e7 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:37.470609 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-7caa337a-ba65-4997-9ea2-9706fce64151 req-cabbcbc0-7490-40db-ac62-c778596111e7 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:37.483885 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-7caa337a-ba65-4997-9ea2-9706fce64151 req-cabbcbc0-7490-40db-ac62-c778596111e7 service nova] Creating event network-changed:7d6a0c00-b1ed-4923-a952-8d2779e021df for instance 57baac8d-c9ab-47fc-821c-3e82036eea26 on n-h1-master-1 Oct 30 02:01:37.484663 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-7caa337a-ba65-4997-9ea2-9706fce64151 req-cabbcbc0-7490-40db-ac62-c778596111e7 service nova] Creating event network-changed:7d6a0c00-b1ed-4923-a952-8d2779e021df for instance 57baac8d-c9ab-47fc-821c-3e82036eea26 on n-h1-master-1 Oct 30 02:01:37.490573 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-7caa337a-ba65-4997-9ea2-9706fce64151 req-cabbcbc0-7490-40db-ac62-c778596111e7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.036935 Oct 30 02:01:37.491491 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3370/6750] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:01:37.789703 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-deef0e47-28af-4d2a-b114-3c6ed1bff40d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:01:37.790491 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-deef0e47-28af-4d2a-b114-3c6ed1bff40d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: c2f68445-c19b-468c-b58c-00a2c97dd786] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:01:37.794490 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:01:37.797978 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-deef0e47-28af-4d2a-b114-3c6ed1bff40d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:37.798467 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-deef0e47-28af-4d2a-b114-3c6ed1bff40d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:37.798902 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-deef0e47-28af-4d2a-b114-3c6ed1bff40d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:37.799601 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-deef0e47-28af-4d2a-b114-3c6ed1bff40d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:01:37.800053 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-deef0e47-28af-4d2a-b114-3c6ed1bff40d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:01:37.800711 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-deef0e47-28af-4d2a-b114-3c6ed1bff40d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:01:37.814929 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-deef0e47-28af-4d2a-b114-3c6ed1bff40d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] HTTP exception thrown: Instance c2f68445-c19b-468c-b58c-00a2c97dd786 could not be found. Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-deef0e47-28af-4d2a-b114-3c6ed1bff40d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Request method failure captured: Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786 HTTP/1.1 Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdrUzAoetWsdn8k4HYTcqbVG7Zs75eMmndnkEOPA0S-TmAgSQ2b5nMGLS0qTcKbMaQTaaQPoAGl2nSU9lucNctaJ1zTE6xKSNocI5VbroWnIgVb8SnDnXRJPuQdp0_RS-b7KWfvV5q_soI5fUH8iU2dwXESX56PU08-DTzNpHjo6aLI Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 99e1cde224c845caaa743246e60e338d Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-TestVolumeBootPattern-1509499038 Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/99e1cde224c845caaa743246e60e338d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_99e1cde224c845caaa743246e60e338d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/99e1cde224c845caaa743246e60e338d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/99e1cde224c845caaa743246e60e338d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-TestVolumeBootPattern-1509499038 Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 99e1cde224c845caaa743246e60e338d Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-TestVolumeBootPattern-1509499038 Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-TestVolumeBootPattern-1509499038-project Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: a0ec990e687d427d88dcf9879a1d5b0c Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-TestVolumeBootPattern-1509499038-project Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: exception: Instance c2f68445-c19b-468c-b58c-00a2c97dd786 could not be found. Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'c2f68445-c19b-468c-b58c-00a2c97dd786'} Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2f68445-c19b-468c-b58c-00a2c97dd786 could not be found. Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2f68445-c19b-468c-b58c-00a2c97dd786 could not be found. Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:01:37.817144 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:01:37.820658 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:01:37.820658 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:01:37.820658 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:01:37.820658 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:01:37.820658 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:01:37.820658 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2f68445-c19b-468c-b58c-00a2c97dd786 could not be found. Oct 30 02:01:37.820658 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:01:37.820658 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-deef0e47-28af-4d2a-b114-3c6ed1bff40d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Returning 404 to user: Instance c2f68445-c19b-468c-b58c-00a2c97dd786 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:01:37.820658 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-deef0e47-28af-4d2a-b114-3c6ed1bff40d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786" status: 404 len: 111 microversion: 2.1 time: 0.032930 Oct 30 02:01:37.824902 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3381/6751] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:01:37 2022] GET /compute/v2.1/servers/c2f68445-c19b-468c-b58c-00a2c97dd786 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 02:01:44.755630 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8178fc88-d9fe-4376-9c3d-b6483d24add1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-91144235", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "780536ec-e7cb-4e01-b1a8-8474778e09b0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "aa518046-7164-40fa-a3f3-11422c6acc97"}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:01:44.830488 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-8178fc88-d9fe-4376-9c3d-b6483d24add1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] validate_networks() for [('aa518046-7164-40fa-a3f3-11422c6acc97', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 02:01:47.476629 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=40 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:01:54.768014 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=7 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:02:40.286221 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:02:40.290454 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7e00bff1-6ef6-44ff-9e5c-48d8a88953ae tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:02:40.293560 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7e00bff1-6ef6-44ff-9e5c-48d8a88953ae tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] [instance: 57baac8d-c9ab-47fc-821c-3e82036eea26] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:02:40.297525 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e00bff1-6ef6-44ff-9e5c-48d8a88953ae tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:02:40.298735 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e00bff1-6ef6-44ff-9e5c-48d8a88953ae tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:02:40.299327 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e00bff1-6ef6-44ff-9e5c-48d8a88953ae tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:02:40.300185 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e00bff1-6ef6-44ff-9e5c-48d8a88953ae tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:02:40.300649 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e00bff1-6ef6-44ff-9e5c-48d8a88953ae tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:02:40.301072 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e00bff1-6ef6-44ff-9e5c-48d8a88953ae tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:02:40.329595 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7e00bff1-6ef6-44ff-9e5c-48d8a88953ae tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] [instance: 57baac8d-c9ab-47fc-821c-3e82036eea26] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 02:02:40.726238 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7e00bff1-6ef6-44ff-9e5c-48d8a88953ae tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] 10.222.0.13 "DELETE /compute/v2.1/servers/57baac8d-c9ab-47fc-821c-3e82036eea26" status: 204 len: 0 microversion: 2.1 time: 0.442120 Oct 30 02:02:40.726850 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3382/6752] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 02:02:40 2022] DELETE /compute/v2.1/servers/57baac8d-c9ab-47fc-821c-3e82036eea26 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 02:02:40.940557 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-f45e37de-4d3d-4be3-8dcd-d888b68d2c49 req-a33fcf0d-dcd8-418b-998d-d8bf2a0ac617 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57baac8d-c9ab-47fc-821c-3e82036eea26", "tag": "7d6a0c00-b1ed-4923-a952-8d2779e021df"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:02:40.950452 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-f45e37de-4d3d-4be3-8dcd-d888b68d2c49 req-a33fcf0d-dcd8-418b-998d-d8bf2a0ac617 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:02:40.950930 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-f45e37de-4d3d-4be3-8dcd-d888b68d2c49 req-a33fcf0d-dcd8-418b-998d-d8bf2a0ac617 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:02:40.951364 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-f45e37de-4d3d-4be3-8dcd-d888b68d2c49 req-a33fcf0d-dcd8-418b-998d-d8bf2a0ac617 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:02:40.964344 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-f45e37de-4d3d-4be3-8dcd-d888b68d2c49 req-a33fcf0d-dcd8-418b-998d-d8bf2a0ac617 service nova] Creating event network-changed:7d6a0c00-b1ed-4923-a952-8d2779e021df for instance 57baac8d-c9ab-47fc-821c-3e82036eea26 on n-h1-master-1 Oct 30 02:02:40.969496 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-f45e37de-4d3d-4be3-8dcd-d888b68d2c49 req-a33fcf0d-dcd8-418b-998d-d8bf2a0ac617 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.241191 Oct 30 02:02:40.970954 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3383/6753] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:02:40.976478 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3d4b096c-8835-4f9c-b835-8d2ac2622f2b tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:02:40.977247 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3d4b096c-8835-4f9c-b835-8d2ac2622f2b tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] [instance: 57baac8d-c9ab-47fc-821c-3e82036eea26] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:02:40.983730 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d4b096c-8835-4f9c-b835-8d2ac2622f2b tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:02:40.984292 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d4b096c-8835-4f9c-b835-8d2ac2622f2b tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:02:40.984795 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d4b096c-8835-4f9c-b835-8d2ac2622f2b tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:02:40.985610 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d4b096c-8835-4f9c-b835-8d2ac2622f2b tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:02:40.986157 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d4b096c-8835-4f9c-b835-8d2ac2622f2b tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:02:40.986724 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d4b096c-8835-4f9c-b835-8d2ac2622f2b tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:02:41.125728 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3d4b096c-8835-4f9c-b835-8d2ac2622f2b tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685162cc09ea436baabe059b9b346ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815809ec42e44bce9da3c4e354b425bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:02:41.133845 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3d4b096c-8835-4f9c-b835-8d2ac2622f2b tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] 10.222.0.13 "GET /compute/v2.1/servers/57baac8d-c9ab-47fc-821c-3e82036eea26" status: 200 len: 1583 microversion: 2.1 time: 0.161634 Oct 30 02:02:41.134415 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3384/6754] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:02:40 2022] GET /compute/v2.1/servers/57baac8d-c9ab-47fc-821c-3e82036eea26 => generated 1583 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:02:42.162824 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1be05f64-51cf-4213-ae9f-f8dee306fa41 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:02:42.163434 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1be05f64-51cf-4213-ae9f-f8dee306fa41 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] [instance: 57baac8d-c9ab-47fc-821c-3e82036eea26] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:02:42.171261 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1be05f64-51cf-4213-ae9f-f8dee306fa41 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:02:42.171740 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1be05f64-51cf-4213-ae9f-f8dee306fa41 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:02:42.172170 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1be05f64-51cf-4213-ae9f-f8dee306fa41 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:02:42.172849 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1be05f64-51cf-4213-ae9f-f8dee306fa41 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:02:42.173921 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1be05f64-51cf-4213-ae9f-f8dee306fa41 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:02:42.174349 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1be05f64-51cf-4213-ae9f-f8dee306fa41 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:02:42.309690 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1be05f64-51cf-4213-ae9f-f8dee306fa41 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685162cc09ea436baabe059b9b346ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815809ec42e44bce9da3c4e354b425bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:02:42.317528 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1be05f64-51cf-4213-ae9f-f8dee306fa41 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] 10.222.0.13 "GET /compute/v2.1/servers/57baac8d-c9ab-47fc-821c-3e82036eea26" status: 200 len: 1583 microversion: 2.1 time: 0.158787 Oct 30 02:02:42.318098 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3385/6755] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:02:42 2022] GET /compute/v2.1/servers/57baac8d-c9ab-47fc-821c-3e82036eea26 => generated 1583 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:02:43.125872 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-3c864612-59b5-4cc9-9f69-20b78619f028 req-80f19e2d-5b6f-4440-bbae-464510036705 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57baac8d-c9ab-47fc-821c-3e82036eea26", "name": "network-vif-deleted", "tag": "7d6a0c00-b1ed-4923-a952-8d2779e021df"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:02:43.135683 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-3c864612-59b5-4cc9-9f69-20b78619f028 req-80f19e2d-5b6f-4440-bbae-464510036705 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:02:43.136156 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-3c864612-59b5-4cc9-9f69-20b78619f028 req-80f19e2d-5b6f-4440-bbae-464510036705 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:02:43.136587 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-3c864612-59b5-4cc9-9f69-20b78619f028 req-80f19e2d-5b6f-4440-bbae-464510036705 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:02:43.147974 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-3c864612-59b5-4cc9-9f69-20b78619f028 req-80f19e2d-5b6f-4440-bbae-464510036705 service nova] Creating event network-vif-deleted:7d6a0c00-b1ed-4923-a952-8d2779e021df for instance 57baac8d-c9ab-47fc-821c-3e82036eea26 on n-h1-master-1 Oct 30 02:02:43.155502 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-3c864612-59b5-4cc9-9f69-20b78619f028 req-80f19e2d-5b6f-4440-bbae-464510036705 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033149 Oct 30 02:02:43.156112 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3386/6756] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:02:43.341850 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-27373976-16fe-4aef-a91e-32b24fa30553 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:02:43.342548 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-27373976-16fe-4aef-a91e-32b24fa30553 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] [instance: 57baac8d-c9ab-47fc-821c-3e82036eea26] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:02:43.349378 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27373976-16fe-4aef-a91e-32b24fa30553 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:02:43.349853 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27373976-16fe-4aef-a91e-32b24fa30553 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:02:43.350290 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27373976-16fe-4aef-a91e-32b24fa30553 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:02:43.350979 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27373976-16fe-4aef-a91e-32b24fa30553 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:02:43.351477 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27373976-16fe-4aef-a91e-32b24fa30553 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:02:43.351922 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27373976-16fe-4aef-a91e-32b24fa30553 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:02:43.420618 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-27373976-16fe-4aef-a91e-32b24fa30553 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685162cc09ea436baabe059b9b346ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815809ec42e44bce9da3c4e354b425bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:02:43.430143 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-27373976-16fe-4aef-a91e-32b24fa30553 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] 10.222.0.13 "GET /compute/v2.1/servers/57baac8d-c9ab-47fc-821c-3e82036eea26" status: 200 len: 1228 microversion: 2.1 time: 0.093311 Oct 30 02:02:43.430641 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3387/6757] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:02:43 2022] GET /compute/v2.1/servers/57baac8d-c9ab-47fc-821c-3e82036eea26 => generated 1228 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:02:44.458611 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-dce0c725-3508-4a10-a1bf-fee46ff80d32 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:02:44.459273 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-dce0c725-3508-4a10-a1bf-fee46ff80d32 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] [instance: 57baac8d-c9ab-47fc-821c-3e82036eea26] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:02:44.466539 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dce0c725-3508-4a10-a1bf-fee46ff80d32 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:02:44.467017 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dce0c725-3508-4a10-a1bf-fee46ff80d32 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:02:44.467450 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dce0c725-3508-4a10-a1bf-fee46ff80d32 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:02:44.468137 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dce0c725-3508-4a10-a1bf-fee46ff80d32 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:02:44.468611 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dce0c725-3508-4a10-a1bf-fee46ff80d32 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:02:44.469028 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dce0c725-3508-4a10-a1bf-fee46ff80d32 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:02:44.533114 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-dce0c725-3508-4a10-a1bf-fee46ff80d32 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685162cc09ea436baabe059b9b346ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815809ec42e44bce9da3c4e354b425bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:02:44.541089 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-dce0c725-3508-4a10-a1bf-fee46ff80d32 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] 10.222.0.13 "GET /compute/v2.1/servers/57baac8d-c9ab-47fc-821c-3e82036eea26" status: 200 len: 1228 microversion: 2.1 time: 0.087101 Oct 30 02:02:44.553329 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3388/6758] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:02:44 2022] GET /compute/v2.1/servers/57baac8d-c9ab-47fc-821c-3e82036eea26 => generated 1228 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:02:45.564402 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1be8db2e-0b65-4ef5-9c9b-a1b94df731a1 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:02:45.565020 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1be8db2e-0b65-4ef5-9c9b-a1b94df731a1 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] [instance: 57baac8d-c9ab-47fc-821c-3e82036eea26] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:02:45.571819 n-d-master-1 devstack@n-api.service[121102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 30 02:02:45.572214 n-d-master-1 devstack@n-api.service[121102]: Sun Oct 30 02:02:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/57baac8d-c9ab-47fc-821c-3e82036eea26 (ip 10.222.0.13) !!! Oct 30 02:02:45.573710 n-d-master-1 devstack@n-api.service[121102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 30 02:02:45.574072 n-d-master-1 devstack@n-api.service[121102]: Sun Oct 30 02:02:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/57baac8d-c9ab-47fc-821c-3e82036eea26 (ip 10.222.0.13) !!! Oct 30 02:02:45.578247 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1be8db2e-0b65-4ef5-9c9b-a1b94df731a1 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:02:45.579000 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1be8db2e-0b65-4ef5-9c9b-a1b94df731a1 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:02:45.580208 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1be8db2e-0b65-4ef5-9c9b-a1b94df731a1 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:02:45.581170 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1be8db2e-0b65-4ef5-9c9b-a1b94df731a1 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:02:45.581860 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1be8db2e-0b65-4ef5-9c9b-a1b94df731a1 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:02:45.582485 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1be8db2e-0b65-4ef5-9c9b-a1b94df731a1 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:02:45.667876 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1be8db2e-0b65-4ef5-9c9b-a1b94df731a1 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685162cc09ea436baabe059b9b346ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815809ec42e44bce9da3c4e354b425bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:02:45.677153 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1be8db2e-0b65-4ef5-9c9b-a1b94df731a1 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] 10.222.0.13 "GET /compute/v2.1/servers/57baac8d-c9ab-47fc-821c-3e82036eea26" status: 200 len: 1228 microversion: 2.1 time: 0.116815 Oct 30 02:02:45.678466 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3389/6759] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:02:45 2022] GET /compute/v2.1/servers/57baac8d-c9ab-47fc-821c-3e82036eea26 => generated 1228 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:02:46.700653 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-34912bff-0851-4cef-a8a6-d9764f6743d5 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:02:46.701460 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-34912bff-0851-4cef-a8a6-d9764f6743d5 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] [instance: 57baac8d-c9ab-47fc-821c-3e82036eea26] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:02:46.708932 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-34912bff-0851-4cef-a8a6-d9764f6743d5 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:02:46.709591 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-34912bff-0851-4cef-a8a6-d9764f6743d5 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:02:46.710412 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-34912bff-0851-4cef-a8a6-d9764f6743d5 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:02:46.711270 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-34912bff-0851-4cef-a8a6-d9764f6743d5 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:02:46.711876 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-34912bff-0851-4cef-a8a6-d9764f6743d5 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:02:46.712402 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-34912bff-0851-4cef-a8a6-d9764f6743d5 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:02:47.037532 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-34912bff-0851-4cef-a8a6-d9764f6743d5 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685162cc09ea436baabe059b9b346ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815809ec42e44bce9da3c4e354b425bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:02:47.045477 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-34912bff-0851-4cef-a8a6-d9764f6743d5 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] 10.222.0.13 "GET /compute/v2.1/servers/57baac8d-c9ab-47fc-821c-3e82036eea26" status: 200 len: 1228 microversion: 2.1 time: 0.348794 Oct 30 02:02:47.046031 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3390/6760] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:02:46 2022] GET /compute/v2.1/servers/57baac8d-c9ab-47fc-821c-3e82036eea26 => generated 1228 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:02:48.068798 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3596df90-5f17-4f43-b9f2-c1338723973a tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:02:48.069461 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3596df90-5f17-4f43-b9f2-c1338723973a tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] [instance: 57baac8d-c9ab-47fc-821c-3e82036eea26] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:02:48.076509 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3596df90-5f17-4f43-b9f2-c1338723973a tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:02:48.077003 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3596df90-5f17-4f43-b9f2-c1338723973a tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:02:48.077506 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3596df90-5f17-4f43-b9f2-c1338723973a tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:02:48.078289 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3596df90-5f17-4f43-b9f2-c1338723973a tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:02:48.078747 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3596df90-5f17-4f43-b9f2-c1338723973a tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:02:48.079174 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3596df90-5f17-4f43-b9f2-c1338723973a tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:02:48.114854 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3596df90-5f17-4f43-b9f2-c1338723973a tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:02:48.115358 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3596df90-5f17-4f43-b9f2-c1338723973a tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:02:48.115802 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3596df90-5f17-4f43-b9f2-c1338723973a tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:02:48.116264 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-3596df90-5f17-4f43-b9f2-c1338723973a tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lazy-loading 'fault' on Instance uuid 57baac8d-c9ab-47fc-821c-3e82036eea26 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 02:02:48.161236 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3596df90-5f17-4f43-b9f2-c1338723973a tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685162cc09ea436baabe059b9b346ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815809ec42e44bce9da3c4e354b425bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:02:48.169165 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3596df90-5f17-4f43-b9f2-c1338723973a tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] 10.222.0.13 "GET /compute/v2.1/servers/57baac8d-c9ab-47fc-821c-3e82036eea26" status: 200 len: 1233 microversion: 2.1 time: 0.104452 Oct 30 02:02:48.170222 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3391/6761] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:02:48 2022] GET /compute/v2.1/servers/57baac8d-c9ab-47fc-821c-3e82036eea26 => generated 1233 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:02:49.192502 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f82f586c-2a21-4f15-944e-c64a010f5b5b tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:02:49.193141 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f82f586c-2a21-4f15-944e-c64a010f5b5b tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] [instance: 57baac8d-c9ab-47fc-821c-3e82036eea26] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:02:49.199894 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f82f586c-2a21-4f15-944e-c64a010f5b5b tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:02:49.202501 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f82f586c-2a21-4f15-944e-c64a010f5b5b tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:02:49.202501 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f82f586c-2a21-4f15-944e-c64a010f5b5b tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:02:49.202501 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f82f586c-2a21-4f15-944e-c64a010f5b5b tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:02:49.202501 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f82f586c-2a21-4f15-944e-c64a010f5b5b tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:02:49.202501 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f82f586c-2a21-4f15-944e-c64a010f5b5b tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:02:49.216921 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-f82f586c-2a21-4f15-944e-c64a010f5b5b tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] HTTP exception thrown: Instance 57baac8d-c9ab-47fc-821c-3e82036eea26 could not be found. Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f82f586c-2a21-4f15-944e-c64a010f5b5b tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Request method failure captured: Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/57baac8d-c9ab-47fc-821c-3e82036eea26 HTTP/1.1 Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdo_CkEBgo5KZgCuVuK99kq4eQo6i6bHsoUshVaIQYW-rDeNO64cNLSX4asrEFc5iQFHgi_iAdUwUdAKRORUli5t8rLFdXpOgG9QMtobGJgWfRWKtMGootg9yxklzrD5YBpGY2y9wJlKZhZE-7V5LMBhHE3clbn3K7dDmzy26vlkR_g Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 815809ec42e44bce9da3c4e354b425bf Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-TestVolumeBackupRestore-43540577 Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/815809ec42e44bce9da3c4e354b425bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_815809ec42e44bce9da3c4e354b425bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/815809ec42e44bce9da3c4e354b425bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/815809ec42e44bce9da3c4e354b425bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-TestVolumeBackupRestore-43540577 Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 815809ec42e44bce9da3c4e354b425bf Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-TestVolumeBackupRestore-43540577 Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-TestVolumeBackupRestore-43540577-project Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 685162cc09ea436baabe059b9b346ef1 Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-TestVolumeBackupRestore-43540577-project Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 57baac8d-c9ab-47fc-821c-3e82036eea26 could not be found. Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '57baac8d-c9ab-47fc-821c-3e82036eea26'} Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57baac8d-c9ab-47fc-821c-3e82036eea26 could not be found. Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57baac8d-c9ab-47fc-821c-3e82036eea26 could not be found. Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:02:49.218628 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:02:49.223295 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:02:49.223295 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:02:49.223295 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:02:49.223295 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:02:49.223295 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:02:49.223295 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57baac8d-c9ab-47fc-821c-3e82036eea26 could not be found. Oct 30 02:02:49.223295 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:02:49.223295 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f82f586c-2a21-4f15-944e-c64a010f5b5b tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Returning 404 to user: Instance 57baac8d-c9ab-47fc-821c-3e82036eea26 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:02:49.223295 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f82f586c-2a21-4f15-944e-c64a010f5b5b tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] 10.222.0.13 "GET /compute/v2.1/servers/57baac8d-c9ab-47fc-821c-3e82036eea26" status: 404 len: 111 microversion: 2.1 time: 0.031522 Oct 30 02:02:49.225187 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3392/6762] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:02:49 2022] GET /compute/v2.1/servers/57baac8d-c9ab-47fc-821c-3e82036eea26 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 02:02:49.474680 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b3a29528-92d1-464a-8b19-f916e4b3c243 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] Calling method '.version_select at 0x7f44c6deb280>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:02:49.572830 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b3a29528-92d1-464a-8b19-f916e4b3c243 tempest-TestVolumeBackupRestore-43540577 tempest-TestVolumeBackupRestore-43540577-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-781308768" status: 202 len: 0 microversion: 2.1 time: 0.102659 Oct 30 02:02:49.573729 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3393/6763] 10.222.0.13 () {58 vars in 1266 bytes} [Sun Oct 30 02:02:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-781308768 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 30 02:03:17.390888 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-256a66a3-1eeb-4c82-9144-eaf4202a2957 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-113804376", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "50647226-708e-4201-8e74-391436a2846e", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "aa518046-7164-40fa-a3f3-11422c6acc97"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:03:17.402172 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:03:17.402822 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:03:17.484808 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-256a66a3-1eeb-4c82-9144-eaf4202a2957 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] validate_networks() for [('aa518046-7164-40fa-a3f3-11422c6acc97', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 02:03:17.936823 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-256a66a3-1eeb-4c82-9144-eaf4202a2957 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 02:03:17.937251 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-256a66a3-1eeb-4c82-9144-eaf4202a2957 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 02:03:17.937767 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-256a66a3-1eeb-4c82-9144-eaf4202a2957 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 02:03:17.938177 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-256a66a3-1eeb-4c82-9144-eaf4202a2957 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 02:03:17.938589 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-256a66a3-1eeb-4c82-9144-eaf4202a2957 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 02:03:17.948059 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-256a66a3-1eeb-4c82-9144-eaf4202a2957 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:17.948537 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-256a66a3-1eeb-4c82-9144-eaf4202a2957 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:17.948970 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-256a66a3-1eeb-4c82-9144-eaf4202a2957 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:17.949732 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-256a66a3-1eeb-4c82-9144-eaf4202a2957 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:17.950188 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-256a66a3-1eeb-4c82-9144-eaf4202a2957 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:17.950614 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-256a66a3-1eeb-4c82-9144-eaf4202a2957 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:17.967911 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-256a66a3-1eeb-4c82-9144-eaf4202a2957 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Getting quotas for project 99e1cde224c845caaa743246e60e338d. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 02:03:17.973093 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-256a66a3-1eeb-4c82-9144-eaf4202a2957 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Getting quotas for user a0ec990e687d427d88dcf9879a1d5b0c and project 99e1cde224c845caaa743246e60e338d. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 02:03:17.985812 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-256a66a3-1eeb-4c82-9144-eaf4202a2957 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 02:03:17.987774 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-256a66a3-1eeb-4c82-9144-eaf4202a2957 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: a50781df-47bb-42f6-bca6-a6ddab11284a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='50647226-708e-4201-8e74-391436a2846e',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 02:03:18.122551 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-256a66a3-1eeb-4c82-9144-eaf4202a2957 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.735635 Oct 30 02:03:18.123206 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3394/6764] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 02:03:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 30 02:03:18.133938 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-999855f4-af30-412f-b418-1e48247da76d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:03:18.134549 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-999855f4-af30-412f-b418-1e48247da76d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: a50781df-47bb-42f6-bca6-a6ddab11284a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:03:18.189134 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-999855f4-af30-412f-b418-1e48247da76d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:03:18.196706 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-999855f4-af30-412f-b418-1e48247da76d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a" status: 200 len: 1056 microversion: 2.1 time: 0.066397 Oct 30 02:03:18.197269 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3395/6765] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:03:18 2022] GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a => generated 1056 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:03:19.218920 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fef472fd-2be5-454d-9494-1656e037800b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:03:19.219639 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fef472fd-2be5-454d-9494-1656e037800b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: a50781df-47bb-42f6-bca6-a6ddab11284a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:03:19.226915 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fef472fd-2be5-454d-9494-1656e037800b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:19.229157 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fef472fd-2be5-454d-9494-1656e037800b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:19.229157 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fef472fd-2be5-454d-9494-1656e037800b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:19.229157 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fef472fd-2be5-454d-9494-1656e037800b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:19.229157 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fef472fd-2be5-454d-9494-1656e037800b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:19.229518 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fef472fd-2be5-454d-9494-1656e037800b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:19.293272 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-fef472fd-2be5-454d-9494-1656e037800b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:03:19.301320 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fef472fd-2be5-454d-9494-1656e037800b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a" status: 200 len: 1060 microversion: 2.1 time: 0.086304 Oct 30 02:03:19.302443 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3396/6766] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:03:19 2022] GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a => generated 1060 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:03:20.324403 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-22adce83-ec63-411d-9ffd-6423259a636d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:03:20.325002 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-22adce83-ec63-411d-9ffd-6423259a636d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: a50781df-47bb-42f6-bca6-a6ddab11284a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:03:20.332536 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-22adce83-ec63-411d-9ffd-6423259a636d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:20.333732 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-22adce83-ec63-411d-9ffd-6423259a636d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:20.334172 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-22adce83-ec63-411d-9ffd-6423259a636d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:20.335138 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-22adce83-ec63-411d-9ffd-6423259a636d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:20.335587 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-22adce83-ec63-411d-9ffd-6423259a636d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:20.336702 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-22adce83-ec63-411d-9ffd-6423259a636d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:20.402478 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-22adce83-ec63-411d-9ffd-6423259a636d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:03:20.411497 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-22adce83-ec63-411d-9ffd-6423259a636d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a" status: 200 len: 1126 microversion: 2.1 time: 0.091022 Oct 30 02:03:20.412365 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3397/6767] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:03:20 2022] GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a => generated 1126 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:03:21.435729 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-922da4cf-6a37-40db-acdd-883cd6901eba tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:03:21.436390 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-922da4cf-6a37-40db-acdd-883cd6901eba tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: a50781df-47bb-42f6-bca6-a6ddab11284a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:03:21.443978 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-922da4cf-6a37-40db-acdd-883cd6901eba tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:21.444596 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-922da4cf-6a37-40db-acdd-883cd6901eba tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:21.445132 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-922da4cf-6a37-40db-acdd-883cd6901eba tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:21.445987 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-922da4cf-6a37-40db-acdd-883cd6901eba tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:21.446586 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-922da4cf-6a37-40db-acdd-883cd6901eba tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:21.447199 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-922da4cf-6a37-40db-acdd-883cd6901eba tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:21.649116 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-922da4cf-6a37-40db-acdd-883cd6901eba tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:03:21.657189 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-922da4cf-6a37-40db-acdd-883cd6901eba tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a" status: 200 len: 1168 microversion: 2.1 time: 0.225802 Oct 30 02:03:21.657880 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3398/6768] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:03:21 2022] GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a => generated 1168 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:03:22.069241 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-e7c6d4c8-3c96-48e3-adeb-d96b9823d00e req-43c6356c-cbe4-4b43-b8d3-04eb36cbac9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a50781df-47bb-42f6-bca6-a6ddab11284a", "tag": "48d9d1e4-3c80-4517-bd28-c3bfd8fcc5d3"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:03:22.084919 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-e7c6d4c8-3c96-48e3-adeb-d96b9823d00e req-43c6356c-cbe4-4b43-b8d3-04eb36cbac9f service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:22.085956 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-e7c6d4c8-3c96-48e3-adeb-d96b9823d00e req-43c6356c-cbe4-4b43-b8d3-04eb36cbac9f service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:22.085956 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-e7c6d4c8-3c96-48e3-adeb-d96b9823d00e req-43c6356c-cbe4-4b43-b8d3-04eb36cbac9f service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:22.101749 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-e7c6d4c8-3c96-48e3-adeb-d96b9823d00e req-43c6356c-cbe4-4b43-b8d3-04eb36cbac9f service nova] Creating event network-changed:48d9d1e4-3c80-4517-bd28-c3bfd8fcc5d3 for instance a50781df-47bb-42f6-bca6-a6ddab11284a on n-h2-master-1 Oct 30 02:03:22.107045 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-e7c6d4c8-3c96-48e3-adeb-d96b9823d00e req-43c6356c-cbe4-4b43-b8d3-04eb36cbac9f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042517 Oct 30 02:03:22.107842 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3399/6769] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:03:22.682227 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-02155ab9-42a1-4124-a1dc-410204a92674 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:03:22.683135 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-02155ab9-42a1-4124-a1dc-410204a92674 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: a50781df-47bb-42f6-bca6-a6ddab11284a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:03:22.689379 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-02155ab9-42a1-4124-a1dc-410204a92674 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:22.689944 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-02155ab9-42a1-4124-a1dc-410204a92674 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:22.690449 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-02155ab9-42a1-4124-a1dc-410204a92674 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:22.691208 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-02155ab9-42a1-4124-a1dc-410204a92674 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:22.691727 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-02155ab9-42a1-4124-a1dc-410204a92674 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:22.692218 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-02155ab9-42a1-4124-a1dc-410204a92674 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:22.901389 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-02155ab9-42a1-4124-a1dc-410204a92674 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:03:22.909950 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-02155ab9-42a1-4124-a1dc-410204a92674 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a" status: 200 len: 1168 microversion: 2.1 time: 0.233183 Oct 30 02:03:22.910685 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3400/6770] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:03:22 2022] GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a => generated 1168 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:03:23.933728 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-689928c0-9225-430b-8e0b-075ba975be2d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:03:23.934345 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-689928c0-9225-430b-8e0b-075ba975be2d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: a50781df-47bb-42f6-bca6-a6ddab11284a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:03:23.941114 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-689928c0-9225-430b-8e0b-075ba975be2d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:23.941636 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-689928c0-9225-430b-8e0b-075ba975be2d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:23.942077 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-689928c0-9225-430b-8e0b-075ba975be2d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:23.943405 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-689928c0-9225-430b-8e0b-075ba975be2d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:23.943857 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-689928c0-9225-430b-8e0b-075ba975be2d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:23.944281 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-689928c0-9225-430b-8e0b-075ba975be2d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:24.088402 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-689928c0-9225-430b-8e0b-075ba975be2d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:03:24.096163 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-689928c0-9225-430b-8e0b-075ba975be2d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a" status: 200 len: 1168 microversion: 2.1 time: 0.166455 Oct 30 02:03:24.096721 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3401/6771] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:03:23 2022] GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a => generated 1168 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:03:25.120270 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7163fb77-b2ce-40e9-b2c2-58af364c039e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:03:25.121687 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7163fb77-b2ce-40e9-b2c2-58af364c039e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: a50781df-47bb-42f6-bca6-a6ddab11284a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:03:25.128607 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7163fb77-b2ce-40e9-b2c2-58af364c039e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:25.129091 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7163fb77-b2ce-40e9-b2c2-58af364c039e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:25.129612 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7163fb77-b2ce-40e9-b2c2-58af364c039e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:25.130818 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7163fb77-b2ce-40e9-b2c2-58af364c039e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:25.131276 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7163fb77-b2ce-40e9-b2c2-58af364c039e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:25.131705 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7163fb77-b2ce-40e9-b2c2-58af364c039e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:25.262765 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7163fb77-b2ce-40e9-b2c2-58af364c039e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:03:25.270568 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7163fb77-b2ce-40e9-b2c2-58af364c039e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a" status: 200 len: 1168 microversion: 2.1 time: 0.154394 Oct 30 02:03:25.271146 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3402/6772] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:03:25 2022] GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a => generated 1168 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:03:26.292096 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c66b26f4-e7f8-40c8-9e28-ccca1bfbf8fc tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:03:26.292764 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c66b26f4-e7f8-40c8-9e28-ccca1bfbf8fc tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: a50781df-47bb-42f6-bca6-a6ddab11284a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:03:26.299724 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c66b26f4-e7f8-40c8-9e28-ccca1bfbf8fc tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:26.300211 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c66b26f4-e7f8-40c8-9e28-ccca1bfbf8fc tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:26.300648 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c66b26f4-e7f8-40c8-9e28-ccca1bfbf8fc tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:26.301366 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c66b26f4-e7f8-40c8-9e28-ccca1bfbf8fc tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:26.301833 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c66b26f4-e7f8-40c8-9e28-ccca1bfbf8fc tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:26.302260 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c66b26f4-e7f8-40c8-9e28-ccca1bfbf8fc tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:26.435435 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c66b26f4-e7f8-40c8-9e28-ccca1bfbf8fc tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:03:26.444327 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c66b26f4-e7f8-40c8-9e28-ccca1bfbf8fc tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a" status: 200 len: 1168 microversion: 2.1 time: 0.156008 Oct 30 02:03:26.444903 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3403/6773] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:03:26 2022] GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a => generated 1168 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:03:27.471801 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-63c2fa9d-0f05-4dbe-929e-81b815bb08d5 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:03:27.472678 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-63c2fa9d-0f05-4dbe-929e-81b815bb08d5 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: a50781df-47bb-42f6-bca6-a6ddab11284a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:03:27.479346 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-63c2fa9d-0f05-4dbe-929e-81b815bb08d5 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:27.479828 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-63c2fa9d-0f05-4dbe-929e-81b815bb08d5 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:27.480261 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-63c2fa9d-0f05-4dbe-929e-81b815bb08d5 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:27.480959 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-63c2fa9d-0f05-4dbe-929e-81b815bb08d5 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:27.481440 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-63c2fa9d-0f05-4dbe-929e-81b815bb08d5 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:27.481861 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-63c2fa9d-0f05-4dbe-929e-81b815bb08d5 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:27.622914 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-63c2fa9d-0f05-4dbe-929e-81b815bb08d5 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:03:27.631274 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-63c2fa9d-0f05-4dbe-929e-81b815bb08d5 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a" status: 200 len: 1168 microversion: 2.1 time: 0.163529 Oct 30 02:03:27.631850 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3404/6774] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:03:27 2022] GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a => generated 1168 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:03:28.656376 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ceb88ad0-f742-421f-9d86-9f048011437b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:03:28.657503 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ceb88ad0-f742-421f-9d86-9f048011437b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: a50781df-47bb-42f6-bca6-a6ddab11284a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:03:28.659396 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:03:28.660118 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=8 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:03:28.665819 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ceb88ad0-f742-421f-9d86-9f048011437b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:28.666307 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ceb88ad0-f742-421f-9d86-9f048011437b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:28.666741 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ceb88ad0-f742-421f-9d86-9f048011437b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:28.667473 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ceb88ad0-f742-421f-9d86-9f048011437b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:28.667896 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ceb88ad0-f742-421f-9d86-9f048011437b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:28.668320 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ceb88ad0-f742-421f-9d86-9f048011437b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:28.806749 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ceb88ad0-f742-421f-9d86-9f048011437b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:03:28.814808 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ceb88ad0-f742-421f-9d86-9f048011437b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a" status: 200 len: 1168 microversion: 2.1 time: 0.162801 Oct 30 02:03:28.821555 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3405/6775] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:03:28 2022] GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a => generated 1168 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:03:29.839945 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9a1aafe2-fceb-4c67-8910-bfbec2b7a6a3 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:03:29.840778 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9a1aafe2-fceb-4c67-8910-bfbec2b7a6a3 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: a50781df-47bb-42f6-bca6-a6ddab11284a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:03:29.847622 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9a1aafe2-fceb-4c67-8910-bfbec2b7a6a3 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:29.848101 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9a1aafe2-fceb-4c67-8910-bfbec2b7a6a3 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:29.848533 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9a1aafe2-fceb-4c67-8910-bfbec2b7a6a3 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:29.849840 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9a1aafe2-fceb-4c67-8910-bfbec2b7a6a3 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:29.850299 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9a1aafe2-fceb-4c67-8910-bfbec2b7a6a3 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:29.850723 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9a1aafe2-fceb-4c67-8910-bfbec2b7a6a3 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:30.000307 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9a1aafe2-fceb-4c67-8910-bfbec2b7a6a3 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:03:30.009301 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9a1aafe2-fceb-4c67-8910-bfbec2b7a6a3 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a" status: 200 len: 1168 microversion: 2.1 time: 0.173764 Oct 30 02:03:30.009914 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3406/6776] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:03:29 2022] GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a => generated 1168 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:03:31.032160 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9ac1e79d-29a5-47bb-be43-654fb9a85e3d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:03:31.032781 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9ac1e79d-29a5-47bb-be43-654fb9a85e3d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: a50781df-47bb-42f6-bca6-a6ddab11284a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:03:31.040061 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9ac1e79d-29a5-47bb-be43-654fb9a85e3d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:31.040551 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9ac1e79d-29a5-47bb-be43-654fb9a85e3d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:31.040990 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9ac1e79d-29a5-47bb-be43-654fb9a85e3d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:31.041743 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9ac1e79d-29a5-47bb-be43-654fb9a85e3d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:31.042201 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9ac1e79d-29a5-47bb-be43-654fb9a85e3d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:31.042625 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9ac1e79d-29a5-47bb-be43-654fb9a85e3d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:31.183582 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9ac1e79d-29a5-47bb-be43-654fb9a85e3d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:03:31.191273 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9ac1e79d-29a5-47bb-be43-654fb9a85e3d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a" status: 200 len: 1168 microversion: 2.1 time: 0.163089 Oct 30 02:03:31.192044 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3407/6777] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:03:31 2022] GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a => generated 1168 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:03:32.214284 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-39e2ef5f-f9cd-4bb4-bcdd-9c0c8f4cb32a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:03:32.214975 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-39e2ef5f-f9cd-4bb4-bcdd-9c0c8f4cb32a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: a50781df-47bb-42f6-bca6-a6ddab11284a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:03:32.221817 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-39e2ef5f-f9cd-4bb4-bcdd-9c0c8f4cb32a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:32.222303 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-39e2ef5f-f9cd-4bb4-bcdd-9c0c8f4cb32a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:32.222735 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-39e2ef5f-f9cd-4bb4-bcdd-9c0c8f4cb32a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:32.223427 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-39e2ef5f-f9cd-4bb4-bcdd-9c0c8f4cb32a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:32.223876 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-39e2ef5f-f9cd-4bb4-bcdd-9c0c8f4cb32a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:32.224835 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-39e2ef5f-f9cd-4bb4-bcdd-9c0c8f4cb32a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:32.372760 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-39e2ef5f-f9cd-4bb4-bcdd-9c0c8f4cb32a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:03:32.380699 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-39e2ef5f-f9cd-4bb4-bcdd-9c0c8f4cb32a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a" status: 200 len: 1168 microversion: 2.1 time: 0.170322 Oct 30 02:03:32.381260 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3408/6778] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:03:32 2022] GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a => generated 1168 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:03:33.403867 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-decd9d9f-82ca-4afc-8aa8-0574116fa80d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:03:33.404519 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-decd9d9f-82ca-4afc-8aa8-0574116fa80d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: a50781df-47bb-42f6-bca6-a6ddab11284a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:03:33.411336 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-decd9d9f-82ca-4afc-8aa8-0574116fa80d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:33.411820 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-decd9d9f-82ca-4afc-8aa8-0574116fa80d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:33.412260 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-decd9d9f-82ca-4afc-8aa8-0574116fa80d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:33.412953 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-decd9d9f-82ca-4afc-8aa8-0574116fa80d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:33.414117 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-decd9d9f-82ca-4afc-8aa8-0574116fa80d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:33.414545 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-decd9d9f-82ca-4afc-8aa8-0574116fa80d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:33.558276 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-decd9d9f-82ca-4afc-8aa8-0574116fa80d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:03:33.567329 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-decd9d9f-82ca-4afc-8aa8-0574116fa80d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a" status: 200 len: 1168 microversion: 2.1 time: 0.167372 Oct 30 02:03:33.568043 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3409/6779] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:03:33 2022] GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a => generated 1168 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:03:34.592279 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d7e77da2-ac74-4ed8-8493-a206ecb81c0a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:03:34.592894 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d7e77da2-ac74-4ed8-8493-a206ecb81c0a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: a50781df-47bb-42f6-bca6-a6ddab11284a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:03:34.599470 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7e77da2-ac74-4ed8-8493-a206ecb81c0a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:34.599950 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7e77da2-ac74-4ed8-8493-a206ecb81c0a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:34.600381 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7e77da2-ac74-4ed8-8493-a206ecb81c0a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:34.601077 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7e77da2-ac74-4ed8-8493-a206ecb81c0a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:34.601566 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7e77da2-ac74-4ed8-8493-a206ecb81c0a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:34.601995 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7e77da2-ac74-4ed8-8493-a206ecb81c0a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:34.734661 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d7e77da2-ac74-4ed8-8493-a206ecb81c0a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:03:34.742542 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d7e77da2-ac74-4ed8-8493-a206ecb81c0a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a" status: 200 len: 1168 microversion: 2.1 time: 0.154248 Oct 30 02:03:34.743815 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3410/6780] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:03:34 2022] GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a => generated 1168 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:03:35.766138 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-339a8332-4b59-4ae8-a600-04dcb237cbc0 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:03:35.766852 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-339a8332-4b59-4ae8-a600-04dcb237cbc0 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: a50781df-47bb-42f6-bca6-a6ddab11284a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:03:35.773592 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-339a8332-4b59-4ae8-a600-04dcb237cbc0 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:35.774074 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-339a8332-4b59-4ae8-a600-04dcb237cbc0 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:35.774508 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-339a8332-4b59-4ae8-a600-04dcb237cbc0 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:35.775201 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-339a8332-4b59-4ae8-a600-04dcb237cbc0 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:35.775651 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-339a8332-4b59-4ae8-a600-04dcb237cbc0 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:35.776598 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-339a8332-4b59-4ae8-a600-04dcb237cbc0 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:35.914201 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-339a8332-4b59-4ae8-a600-04dcb237cbc0 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:03:35.922207 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-339a8332-4b59-4ae8-a600-04dcb237cbc0 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a" status: 200 len: 1168 microversion: 2.1 time: 0.159964 Oct 30 02:03:35.922778 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3411/6781] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:03:35 2022] GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a => generated 1168 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:03:36.945219 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6a5b10c7-3d0b-4d29-9855-918dc9c92b7e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:03:36.945947 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6a5b10c7-3d0b-4d29-9855-918dc9c92b7e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: a50781df-47bb-42f6-bca6-a6ddab11284a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:03:36.952712 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a5b10c7-3d0b-4d29-9855-918dc9c92b7e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:36.953192 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a5b10c7-3d0b-4d29-9855-918dc9c92b7e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:36.953671 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a5b10c7-3d0b-4d29-9855-918dc9c92b7e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:36.954357 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a5b10c7-3d0b-4d29-9855-918dc9c92b7e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:36.954814 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a5b10c7-3d0b-4d29-9855-918dc9c92b7e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:36.955249 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a5b10c7-3d0b-4d29-9855-918dc9c92b7e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:37.085495 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6a5b10c7-3d0b-4d29-9855-918dc9c92b7e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:03:37.089460 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:03:37.094092 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6a5b10c7-3d0b-4d29-9855-918dc9c92b7e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a" status: 200 len: 1168 microversion: 2.1 time: 0.152759 Oct 30 02:03:37.094669 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3412/6782] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:03:36 2022] GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a => generated 1168 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:03:38.119852 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b271626b-5511-4864-9b7b-f03c363f36c4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:03:38.120514 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b271626b-5511-4864-9b7b-f03c363f36c4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: a50781df-47bb-42f6-bca6-a6ddab11284a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:03:38.127043 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b271626b-5511-4864-9b7b-f03c363f36c4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:38.127542 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b271626b-5511-4864-9b7b-f03c363f36c4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:38.127965 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b271626b-5511-4864-9b7b-f03c363f36c4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:38.128656 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b271626b-5511-4864-9b7b-f03c363f36c4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:38.129110 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b271626b-5511-4864-9b7b-f03c363f36c4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:38.129577 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b271626b-5511-4864-9b7b-f03c363f36c4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:38.265670 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b271626b-5511-4864-9b7b-f03c363f36c4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:03:38.273676 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b271626b-5511-4864-9b7b-f03c363f36c4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a" status: 200 len: 1168 microversion: 2.1 time: 0.159204 Oct 30 02:03:38.274307 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3413/6783] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:03:38 2022] GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a => generated 1168 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:03:39.298614 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a244cb57-0f96-436c-a6e0-3238505d190d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:03:39.299230 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a244cb57-0f96-436c-a6e0-3238505d190d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: a50781df-47bb-42f6-bca6-a6ddab11284a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:03:39.306508 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a244cb57-0f96-436c-a6e0-3238505d190d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:39.306990 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a244cb57-0f96-436c-a6e0-3238505d190d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:39.307434 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a244cb57-0f96-436c-a6e0-3238505d190d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:39.308137 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a244cb57-0f96-436c-a6e0-3238505d190d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:39.308738 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a244cb57-0f96-436c-a6e0-3238505d190d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:39.309021 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a244cb57-0f96-436c-a6e0-3238505d190d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:39.440496 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a244cb57-0f96-436c-a6e0-3238505d190d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:03:39.448163 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a244cb57-0f96-436c-a6e0-3238505d190d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a" status: 200 len: 1168 microversion: 2.1 time: 0.154860 Oct 30 02:03:39.448738 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3414/6784] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:03:39 2022] GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a => generated 1168 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:03:40.471750 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d74affa9-5276-4956-9cd9-bfa927dd000f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:03:40.472436 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d74affa9-5276-4956-9cd9-bfa927dd000f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: a50781df-47bb-42f6-bca6-a6ddab11284a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:03:40.479248 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d74affa9-5276-4956-9cd9-bfa927dd000f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:40.479735 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d74affa9-5276-4956-9cd9-bfa927dd000f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:40.480186 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d74affa9-5276-4956-9cd9-bfa927dd000f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:40.481000 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d74affa9-5276-4956-9cd9-bfa927dd000f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:40.481510 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d74affa9-5276-4956-9cd9-bfa927dd000f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:40.481923 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d74affa9-5276-4956-9cd9-bfa927dd000f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:40.611826 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d74affa9-5276-4956-9cd9-bfa927dd000f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:03:40.619862 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d74affa9-5276-4956-9cd9-bfa927dd000f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a" status: 200 len: 1168 microversion: 2.1 time: 0.152640 Oct 30 02:03:40.620754 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3415/6785] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:03:40 2022] GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a => generated 1168 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:03:41.643381 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-34a20719-23d6-431d-8ac2-267b9e2f937b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:03:41.644078 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-34a20719-23d6-431d-8ac2-267b9e2f937b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: a50781df-47bb-42f6-bca6-a6ddab11284a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:03:41.651216 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-34a20719-23d6-431d-8ac2-267b9e2f937b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:41.651705 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-34a20719-23d6-431d-8ac2-267b9e2f937b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:41.652146 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-34a20719-23d6-431d-8ac2-267b9e2f937b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:41.652842 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-34a20719-23d6-431d-8ac2-267b9e2f937b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:41.653299 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-34a20719-23d6-431d-8ac2-267b9e2f937b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:41.653752 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-34a20719-23d6-431d-8ac2-267b9e2f937b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:41.790290 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-34a20719-23d6-431d-8ac2-267b9e2f937b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:03:41.798445 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-34a20719-23d6-431d-8ac2-267b9e2f937b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a" status: 200 len: 1168 microversion: 2.1 time: 0.159778 Oct 30 02:03:41.799026 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3416/6786] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:03:41 2022] GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a => generated 1168 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:03:42.821511 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b5c11f29-a0f2-4367-b44d-de7f8fdbedfe tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:03:42.822110 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b5c11f29-a0f2-4367-b44d-de7f8fdbedfe tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: a50781df-47bb-42f6-bca6-a6ddab11284a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:03:42.828930 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b5c11f29-a0f2-4367-b44d-de7f8fdbedfe tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:42.829482 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b5c11f29-a0f2-4367-b44d-de7f8fdbedfe tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:42.830464 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b5c11f29-a0f2-4367-b44d-de7f8fdbedfe tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:42.831163 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b5c11f29-a0f2-4367-b44d-de7f8fdbedfe tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:42.831624 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b5c11f29-a0f2-4367-b44d-de7f8fdbedfe tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:42.832055 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b5c11f29-a0f2-4367-b44d-de7f8fdbedfe tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:42.960049 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b5c11f29-a0f2-4367-b44d-de7f8fdbedfe tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:03:42.967964 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b5c11f29-a0f2-4367-b44d-de7f8fdbedfe tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a" status: 200 len: 1168 microversion: 2.1 time: 0.150580 Oct 30 02:03:42.968548 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3417/6787] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:03:42 2022] GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a => generated 1168 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:03:43.990451 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-14fa068c-eba5-44f9-9321-a030ca6515e1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:03:43.991095 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-14fa068c-eba5-44f9-9321-a030ca6515e1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: a50781df-47bb-42f6-bca6-a6ddab11284a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:03:43.998109 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-14fa068c-eba5-44f9-9321-a030ca6515e1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:43.998595 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-14fa068c-eba5-44f9-9321-a030ca6515e1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:43.999031 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-14fa068c-eba5-44f9-9321-a030ca6515e1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:43.999733 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-14fa068c-eba5-44f9-9321-a030ca6515e1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:44.000188 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-14fa068c-eba5-44f9-9321-a030ca6515e1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:44.000618 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-14fa068c-eba5-44f9-9321-a030ca6515e1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:44.129783 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-14fa068c-eba5-44f9-9321-a030ca6515e1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:03:44.137492 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-14fa068c-eba5-44f9-9321-a030ca6515e1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a" status: 200 len: 1168 microversion: 2.1 time: 0.150926 Oct 30 02:03:44.138078 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3418/6788] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:03:43 2022] GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a => generated 1168 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:03:45.160062 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0ba4d70a-b353-4ca5-a7cc-6440559a58ee tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:03:45.160772 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0ba4d70a-b353-4ca5-a7cc-6440559a58ee tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: a50781df-47bb-42f6-bca6-a6ddab11284a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:03:45.167527 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0ba4d70a-b353-4ca5-a7cc-6440559a58ee tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:45.168016 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0ba4d70a-b353-4ca5-a7cc-6440559a58ee tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:45.168454 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0ba4d70a-b353-4ca5-a7cc-6440559a58ee tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:45.169153 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0ba4d70a-b353-4ca5-a7cc-6440559a58ee tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:45.169636 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0ba4d70a-b353-4ca5-a7cc-6440559a58ee tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:45.170066 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0ba4d70a-b353-4ca5-a7cc-6440559a58ee tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:45.297124 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0ba4d70a-b353-4ca5-a7cc-6440559a58ee tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:03:45.306238 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0ba4d70a-b353-4ca5-a7cc-6440559a58ee tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a" status: 200 len: 1168 microversion: 2.1 time: 0.150541 Oct 30 02:03:45.306807 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3419/6789] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:03:45 2022] GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a => generated 1168 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:03:46.328409 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-13804ca2-e311-4c3e-bb59-27ea36dfa34e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:03:46.329126 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-13804ca2-e311-4c3e-bb59-27ea36dfa34e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: a50781df-47bb-42f6-bca6-a6ddab11284a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:03:46.336486 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-13804ca2-e311-4c3e-bb59-27ea36dfa34e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:46.336983 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-13804ca2-e311-4c3e-bb59-27ea36dfa34e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:46.337455 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-13804ca2-e311-4c3e-bb59-27ea36dfa34e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:46.338174 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-13804ca2-e311-4c3e-bb59-27ea36dfa34e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:46.338632 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-13804ca2-e311-4c3e-bb59-27ea36dfa34e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:46.339063 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-13804ca2-e311-4c3e-bb59-27ea36dfa34e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:46.469919 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-13804ca2-e311-4c3e-bb59-27ea36dfa34e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:03:46.477841 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-13804ca2-e311-4c3e-bb59-27ea36dfa34e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a" status: 200 len: 1168 microversion: 2.1 time: 0.153391 Oct 30 02:03:46.478659 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3420/6790] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:03:46 2022] GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a => generated 1168 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:03:47.500134 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b312b63c-0cb0-456d-9450-72a884b7fea7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:03:47.500850 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b312b63c-0cb0-456d-9450-72a884b7fea7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: a50781df-47bb-42f6-bca6-a6ddab11284a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:03:47.507812 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b312b63c-0cb0-456d-9450-72a884b7fea7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:47.508295 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b312b63c-0cb0-456d-9450-72a884b7fea7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:47.508724 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b312b63c-0cb0-456d-9450-72a884b7fea7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:47.509443 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b312b63c-0cb0-456d-9450-72a884b7fea7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:47.510196 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b312b63c-0cb0-456d-9450-72a884b7fea7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:47.512682 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b312b63c-0cb0-456d-9450-72a884b7fea7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:47.642376 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b312b63c-0cb0-456d-9450-72a884b7fea7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:03:47.650693 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b312b63c-0cb0-456d-9450-72a884b7fea7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a" status: 200 len: 1168 microversion: 2.1 time: 0.154441 Oct 30 02:03:47.651277 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3421/6791] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:03:47 2022] GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a => generated 1168 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:03:48.673577 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d5a385b3-b890-4696-ba4a-b7f02610cda2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:03:48.674325 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d5a385b3-b890-4696-ba4a-b7f02610cda2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: a50781df-47bb-42f6-bca6-a6ddab11284a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:03:48.677054 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:03:48.682010 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5a385b3-b890-4696-ba4a-b7f02610cda2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:48.682499 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5a385b3-b890-4696-ba4a-b7f02610cda2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:48.682935 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5a385b3-b890-4696-ba4a-b7f02610cda2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:48.683646 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5a385b3-b890-4696-ba4a-b7f02610cda2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:48.684102 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5a385b3-b890-4696-ba4a-b7f02610cda2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:48.684533 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5a385b3-b890-4696-ba4a-b7f02610cda2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:48.821206 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d5a385b3-b890-4696-ba4a-b7f02610cda2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:03:48.829399 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d5a385b3-b890-4696-ba4a-b7f02610cda2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a" status: 200 len: 1168 microversion: 2.1 time: 0.159885 Oct 30 02:03:48.830071 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3422/6792] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:03:48 2022] GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a => generated 1168 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:03:49.852898 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-03e95a6f-534a-4401-b7f1-9e2117b9f153 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:03:49.853566 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-03e95a6f-534a-4401-b7f1-9e2117b9f153 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: a50781df-47bb-42f6-bca6-a6ddab11284a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:03:49.860706 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-03e95a6f-534a-4401-b7f1-9e2117b9f153 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:49.861193 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-03e95a6f-534a-4401-b7f1-9e2117b9f153 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:49.861667 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-03e95a6f-534a-4401-b7f1-9e2117b9f153 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:49.862371 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-03e95a6f-534a-4401-b7f1-9e2117b9f153 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:49.862828 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-03e95a6f-534a-4401-b7f1-9e2117b9f153 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:49.863258 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-03e95a6f-534a-4401-b7f1-9e2117b9f153 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:50.130103 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-03e95a6f-534a-4401-b7f1-9e2117b9f153 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:03:50.137865 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-03e95a6f-534a-4401-b7f1-9e2117b9f153 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a" status: 200 len: 1168 microversion: 2.1 time: 0.289033 Oct 30 02:03:50.138440 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3423/6793] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:03:49 2022] GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a => generated 1168 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:03:51.160642 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2a2ef4a2-db46-4c3d-8678-e399fd5c4c48 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:03:51.161366 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2a2ef4a2-db46-4c3d-8678-e399fd5c4c48 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: a50781df-47bb-42f6-bca6-a6ddab11284a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:03:51.168500 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a2ef4a2-db46-4c3d-8678-e399fd5c4c48 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:51.168989 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a2ef4a2-db46-4c3d-8678-e399fd5c4c48 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:51.169479 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a2ef4a2-db46-4c3d-8678-e399fd5c4c48 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:51.170177 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a2ef4a2-db46-4c3d-8678-e399fd5c4c48 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:51.170680 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a2ef4a2-db46-4c3d-8678-e399fd5c4c48 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:51.171107 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a2ef4a2-db46-4c3d-8678-e399fd5c4c48 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:51.297809 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2a2ef4a2-db46-4c3d-8678-e399fd5c4c48 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:03:51.306107 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2a2ef4a2-db46-4c3d-8678-e399fd5c4c48 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a" status: 200 len: 1202 microversion: 2.1 time: 0.149962 Oct 30 02:03:51.306688 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3424/6794] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:03:51 2022] GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a => generated 1202 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:03:52.329434 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2f3faa28-5158-42ba-b2b5-82a26051aa74 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:03:52.330091 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2f3faa28-5158-42ba-b2b5-82a26051aa74 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: a50781df-47bb-42f6-bca6-a6ddab11284a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:03:52.337681 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2f3faa28-5158-42ba-b2b5-82a26051aa74 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:52.338165 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2f3faa28-5158-42ba-b2b5-82a26051aa74 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:52.338597 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2f3faa28-5158-42ba-b2b5-82a26051aa74 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:52.339285 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2f3faa28-5158-42ba-b2b5-82a26051aa74 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:52.339734 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2f3faa28-5158-42ba-b2b5-82a26051aa74 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:52.340163 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2f3faa28-5158-42ba-b2b5-82a26051aa74 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:52.470366 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2f3faa28-5158-42ba-b2b5-82a26051aa74 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:03:52.478751 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2f3faa28-5158-42ba-b2b5-82a26051aa74 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a" status: 200 len: 1202 microversion: 2.1 time: 0.153259 Oct 30 02:03:52.479336 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3425/6795] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:03:52 2022] GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a => generated 1202 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:03:53.501400 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b2cc97c9-d7a6-4893-a655-9d1b6456d4db tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:03:53.502043 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b2cc97c9-d7a6-4893-a655-9d1b6456d4db tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: a50781df-47bb-42f6-bca6-a6ddab11284a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:03:53.509376 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2cc97c9-d7a6-4893-a655-9d1b6456d4db tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:53.509859 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2cc97c9-d7a6-4893-a655-9d1b6456d4db tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:53.510292 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2cc97c9-d7a6-4893-a655-9d1b6456d4db tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:53.510982 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2cc97c9-d7a6-4893-a655-9d1b6456d4db tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:53.511431 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2cc97c9-d7a6-4893-a655-9d1b6456d4db tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:53.511855 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2cc97c9-d7a6-4893-a655-9d1b6456d4db tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:53.641843 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b2cc97c9-d7a6-4893-a655-9d1b6456d4db tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:03:53.647016 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b2cc97c9-d7a6-4893-a655-9d1b6456d4db tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a" status: 200 len: 1202 microversion: 2.1 time: 0.149494 Oct 30 02:03:53.647652 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3426/6796] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:03:53 2022] GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a => generated 1202 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:03:54.669567 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3521ab30-e567-4ae7-a77b-e40afc782990 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:03:54.670191 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3521ab30-e567-4ae7-a77b-e40afc782990 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: a50781df-47bb-42f6-bca6-a6ddab11284a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:03:54.677770 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3521ab30-e567-4ae7-a77b-e40afc782990 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:54.678253 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3521ab30-e567-4ae7-a77b-e40afc782990 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:54.678687 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3521ab30-e567-4ae7-a77b-e40afc782990 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:54.679378 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3521ab30-e567-4ae7-a77b-e40afc782990 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:54.679832 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3521ab30-e567-4ae7-a77b-e40afc782990 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:54.680301 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3521ab30-e567-4ae7-a77b-e40afc782990 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:54.807015 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3521ab30-e567-4ae7-a77b-e40afc782990 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:03:54.814771 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3521ab30-e567-4ae7-a77b-e40afc782990 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a" status: 200 len: 1202 microversion: 2.1 time: 0.149114 Oct 30 02:03:54.815281 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3427/6797] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:03:54 2022] GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a => generated 1202 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:03:55.837635 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-eb2ef765-6f47-4c6e-b450-865dbf6b588e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:03:55.838296 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-eb2ef765-6f47-4c6e-b450-865dbf6b588e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: a50781df-47bb-42f6-bca6-a6ddab11284a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:03:55.845138 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eb2ef765-6f47-4c6e-b450-865dbf6b588e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:55.845652 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eb2ef765-6f47-4c6e-b450-865dbf6b588e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:55.846590 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eb2ef765-6f47-4c6e-b450-865dbf6b588e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:55.847283 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eb2ef765-6f47-4c6e-b450-865dbf6b588e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:55.847821 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eb2ef765-6f47-4c6e-b450-865dbf6b588e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:55.848247 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eb2ef765-6f47-4c6e-b450-865dbf6b588e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:55.983069 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-eb2ef765-6f47-4c6e-b450-865dbf6b588e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:03:55.990821 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-eb2ef765-6f47-4c6e-b450-865dbf6b588e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a" status: 200 len: 1202 microversion: 2.1 time: 0.157476 Oct 30 02:03:55.991406 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3428/6798] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:03:55 2022] GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a => generated 1202 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:03:57.013265 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-547614e7-c81e-41a1-bb27-9c2e370fb0c3 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:03:57.013928 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-547614e7-c81e-41a1-bb27-9c2e370fb0c3 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: a50781df-47bb-42f6-bca6-a6ddab11284a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:03:57.020702 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-547614e7-c81e-41a1-bb27-9c2e370fb0c3 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:57.021185 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-547614e7-c81e-41a1-bb27-9c2e370fb0c3 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:57.021651 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-547614e7-c81e-41a1-bb27-9c2e370fb0c3 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:57.022341 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-547614e7-c81e-41a1-bb27-9c2e370fb0c3 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:57.022788 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-547614e7-c81e-41a1-bb27-9c2e370fb0c3 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:57.023214 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-547614e7-c81e-41a1-bb27-9c2e370fb0c3 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:57.041274 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:03:57.151153 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-547614e7-c81e-41a1-bb27-9c2e370fb0c3 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:03:57.159546 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-547614e7-c81e-41a1-bb27-9c2e370fb0c3 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a" status: 200 len: 1202 microversion: 2.1 time: 0.150372 Oct 30 02:03:57.160121 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3429/6799] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:03:57 2022] GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a => generated 1202 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:03:58.182007 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-03569f7c-b23b-42cc-864b-e2bf1046ccb8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:03:58.182657 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-03569f7c-b23b-42cc-864b-e2bf1046ccb8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: a50781df-47bb-42f6-bca6-a6ddab11284a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:03:58.189410 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-03569f7c-b23b-42cc-864b-e2bf1046ccb8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:58.189897 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-03569f7c-b23b-42cc-864b-e2bf1046ccb8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:58.190344 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-03569f7c-b23b-42cc-864b-e2bf1046ccb8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:58.191038 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-03569f7c-b23b-42cc-864b-e2bf1046ccb8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:58.191497 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-03569f7c-b23b-42cc-864b-e2bf1046ccb8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:58.191927 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-03569f7c-b23b-42cc-864b-e2bf1046ccb8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:58.322611 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-03569f7c-b23b-42cc-864b-e2bf1046ccb8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:03:58.330968 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-03569f7c-b23b-42cc-864b-e2bf1046ccb8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a" status: 200 len: 1202 microversion: 2.1 time: 0.152425 Oct 30 02:03:58.331544 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3430/6800] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:03:58 2022] GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a => generated 1202 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:03:59.354313 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b1ef37db-ed6c-40cd-8d62-332de35802f0 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:03:59.354992 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b1ef37db-ed6c-40cd-8d62-332de35802f0 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: a50781df-47bb-42f6-bca6-a6ddab11284a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:03:59.361820 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b1ef37db-ed6c-40cd-8d62-332de35802f0 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:59.362864 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b1ef37db-ed6c-40cd-8d62-332de35802f0 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:59.363309 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b1ef37db-ed6c-40cd-8d62-332de35802f0 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:59.364006 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b1ef37db-ed6c-40cd-8d62-332de35802f0 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:03:59.364463 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b1ef37db-ed6c-40cd-8d62-332de35802f0 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:03:59.364891 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b1ef37db-ed6c-40cd-8d62-332de35802f0 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:03:59.489924 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b1ef37db-ed6c-40cd-8d62-332de35802f0 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:03:59.497609 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b1ef37db-ed6c-40cd-8d62-332de35802f0 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a" status: 200 len: 1202 microversion: 2.1 time: 0.147239 Oct 30 02:03:59.498188 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3431/6801] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:03:59 2022] GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a => generated 1202 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:04:00.520469 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-af3704c9-b060-447f-8f03-8e05041e2721 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:04:00.521114 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-af3704c9-b060-447f-8f03-8e05041e2721 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: a50781df-47bb-42f6-bca6-a6ddab11284a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:04:00.527757 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af3704c9-b060-447f-8f03-8e05041e2721 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:00.528250 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af3704c9-b060-447f-8f03-8e05041e2721 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:00.528689 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af3704c9-b060-447f-8f03-8e05041e2721 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:00.529443 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af3704c9-b060-447f-8f03-8e05041e2721 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:00.529905 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af3704c9-b060-447f-8f03-8e05041e2721 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:00.530335 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af3704c9-b060-447f-8f03-8e05041e2721 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:00.663619 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-af3704c9-b060-447f-8f03-8e05041e2721 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:04:00.671289 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-af3704c9-b060-447f-8f03-8e05041e2721 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a" status: 200 len: 1202 microversion: 2.1 time: 0.155184 Oct 30 02:04:00.671855 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3432/6802] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:04:00 2022] GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a => generated 1202 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:04:01.694645 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5f2d888c-0953-4256-b531-1c7eb94573b1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:04:01.695306 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5f2d888c-0953-4256-b531-1c7eb94573b1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: a50781df-47bb-42f6-bca6-a6ddab11284a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:04:01.702046 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f2d888c-0953-4256-b531-1c7eb94573b1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:01.702525 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f2d888c-0953-4256-b531-1c7eb94573b1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:01.702959 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f2d888c-0953-4256-b531-1c7eb94573b1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:01.703647 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f2d888c-0953-4256-b531-1c7eb94573b1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:01.704130 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f2d888c-0953-4256-b531-1c7eb94573b1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:01.704557 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f2d888c-0953-4256-b531-1c7eb94573b1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:01.836628 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5f2d888c-0953-4256-b531-1c7eb94573b1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:04:01.844362 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5f2d888c-0953-4256-b531-1c7eb94573b1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a" status: 200 len: 1202 microversion: 2.1 time: 0.154200 Oct 30 02:04:01.844944 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3433/6803] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:04:01 2022] GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a => generated 1202 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:04:02.644410 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-6edd54f0-1956-431c-aee6-d40ef676732f req-13c50eea-3ac7-457a-ac24-cf1338fb3309 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a50781df-47bb-42f6-bca6-a6ddab11284a", "name": "network-vif-plugged", "status": "completed", "tag": "48d9d1e4-3c80-4517-bd28-c3bfd8fcc5d3"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:04:02.654424 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-6edd54f0-1956-431c-aee6-d40ef676732f req-13c50eea-3ac7-457a-ac24-cf1338fb3309 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:02.654966 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-6edd54f0-1956-431c-aee6-d40ef676732f req-13c50eea-3ac7-457a-ac24-cf1338fb3309 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:02.655344 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-6edd54f0-1956-431c-aee6-d40ef676732f req-13c50eea-3ac7-457a-ac24-cf1338fb3309 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:02.667827 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-6edd54f0-1956-431c-aee6-d40ef676732f req-13c50eea-3ac7-457a-ac24-cf1338fb3309 service nova] Creating event network-vif-plugged:48d9d1e4-3c80-4517-bd28-c3bfd8fcc5d3 for instance a50781df-47bb-42f6-bca6-a6ddab11284a on n-h2-master-1 Oct 30 02:04:02.673251 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-6edd54f0-1956-431c-aee6-d40ef676732f req-13c50eea-3ac7-457a-ac24-cf1338fb3309 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099649 Oct 30 02:04:02.673921 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3434/6804] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:04:02.868242 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-356fa9ab-c576-48ff-8ca0-2aea88a507ed tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:04:02.868864 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-356fa9ab-c576-48ff-8ca0-2aea88a507ed tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: a50781df-47bb-42f6-bca6-a6ddab11284a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:04:02.875189 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-356fa9ab-c576-48ff-8ca0-2aea88a507ed tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:02.875680 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-356fa9ab-c576-48ff-8ca0-2aea88a507ed tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:02.876123 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-356fa9ab-c576-48ff-8ca0-2aea88a507ed tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:02.876819 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-356fa9ab-c576-48ff-8ca0-2aea88a507ed tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:02.877277 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-356fa9ab-c576-48ff-8ca0-2aea88a507ed tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:02.877736 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-356fa9ab-c576-48ff-8ca0-2aea88a507ed tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:03.013686 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-356fa9ab-c576-48ff-8ca0-2aea88a507ed tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:04:03.022147 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-356fa9ab-c576-48ff-8ca0-2aea88a507ed tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a" status: 200 len: 1202 microversion: 2.1 time: 0.159092 Oct 30 02:04:03.022718 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3435/6805] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:04:02 2022] GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a => generated 1202 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:04:04.044365 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-494383af-11ea-4885-a9a2-11f9190adca1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:04:04.045026 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-494383af-11ea-4885-a9a2-11f9190adca1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: a50781df-47bb-42f6-bca6-a6ddab11284a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:04:04.052554 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-494383af-11ea-4885-a9a2-11f9190adca1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:04.053043 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-494383af-11ea-4885-a9a2-11f9190adca1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:04.053584 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-494383af-11ea-4885-a9a2-11f9190adca1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:04.054286 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-494383af-11ea-4885-a9a2-11f9190adca1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:04.054747 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-494383af-11ea-4885-a9a2-11f9190adca1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:04.055177 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-494383af-11ea-4885-a9a2-11f9190adca1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:04.184032 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-494383af-11ea-4885-a9a2-11f9190adca1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:04:04.191888 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-494383af-11ea-4885-a9a2-11f9190adca1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a" status: 200 len: 1390 microversion: 2.1 time: 0.151688 Oct 30 02:04:04.192486 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3436/6806] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:04:04 2022] GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a => generated 1390 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:04:04.213801 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9498570e-b688-49e2-8e03-a63eab6d007a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:04:04.214411 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9498570e-b688-49e2-8e03-a63eab6d007a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: a50781df-47bb-42f6-bca6-a6ddab11284a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:04:04.220040 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9498570e-b688-49e2-8e03-a63eab6d007a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:04.220528 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9498570e-b688-49e2-8e03-a63eab6d007a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:04.220968 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9498570e-b688-49e2-8e03-a63eab6d007a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:04.222344 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9498570e-b688-49e2-8e03-a63eab6d007a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:04.222803 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9498570e-b688-49e2-8e03-a63eab6d007a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:04.223231 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9498570e-b688-49e2-8e03-a63eab6d007a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:04.352550 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9498570e-b688-49e2-8e03-a63eab6d007a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:04:04.360274 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9498570e-b688-49e2-8e03-a63eab6d007a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a" status: 200 len: 1390 microversion: 2.1 time: 0.149985 Oct 30 02:04:04.360856 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3437/6807] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:04:04 2022] GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a => generated 1390 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:04:04.381881 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-aee2308a-3bd7-4318-ad45-c9d23efbecc4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:04:04.382499 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-aee2308a-3bd7-4318-ad45-c9d23efbecc4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: a50781df-47bb-42f6-bca6-a6ddab11284a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:04:04.388420 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aee2308a-3bd7-4318-ad45-c9d23efbecc4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:04.388908 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aee2308a-3bd7-4318-ad45-c9d23efbecc4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:04.389367 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aee2308a-3bd7-4318-ad45-c9d23efbecc4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:04.390068 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aee2308a-3bd7-4318-ad45-c9d23efbecc4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:04.390523 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aee2308a-3bd7-4318-ad45-c9d23efbecc4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:04.390952 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aee2308a-3bd7-4318-ad45-c9d23efbecc4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:04.520806 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-aee2308a-3bd7-4318-ad45-c9d23efbecc4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:04:04.528736 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-aee2308a-3bd7-4318-ad45-c9d23efbecc4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a" status: 200 len: 1390 microversion: 2.1 time: 0.150554 Oct 30 02:04:04.529349 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3438/6808] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:04:04 2022] GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a => generated 1390 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:04:04.609117 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c2190190-e69c-4195-a9d9-aa1b34c7afee tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:04:04.609651 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c2190190-e69c-4195-a9d9-aa1b34c7afee tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: a50781df-47bb-42f6-bca6-a6ddab11284a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:04:04.615663 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c2190190-e69c-4195-a9d9-aa1b34c7afee tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:04.616146 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c2190190-e69c-4195-a9d9-aa1b34c7afee tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:04.616581 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c2190190-e69c-4195-a9d9-aa1b34c7afee tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:04.617269 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c2190190-e69c-4195-a9d9-aa1b34c7afee tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:04.617746 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c2190190-e69c-4195-a9d9-aa1b34c7afee tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:04.618207 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c2190190-e69c-4195-a9d9-aa1b34c7afee tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:04.642938 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c2190190-e69c-4195-a9d9-aa1b34c7afee tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: a50781df-47bb-42f6-bca6-a6ddab11284a] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 02:04:04.946937 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c2190190-e69c-4195-a9d9-aa1b34c7afee tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a" status: 204 len: 0 microversion: 2.1 time: 0.341363 Oct 30 02:04:04.947537 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3439/6809] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 02:04:04 2022] DELETE /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 30 02:04:04.956126 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3e5f35cb-0292-492d-a8ae-e6a189257963 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:04:04.956830 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3e5f35cb-0292-492d-a8ae-e6a189257963 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: a50781df-47bb-42f6-bca6-a6ddab11284a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:04:04.962962 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3e5f35cb-0292-492d-a8ae-e6a189257963 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:04.963450 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3e5f35cb-0292-492d-a8ae-e6a189257963 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:04.963886 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3e5f35cb-0292-492d-a8ae-e6a189257963 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:04.964581 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3e5f35cb-0292-492d-a8ae-e6a189257963 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:04.965039 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3e5f35cb-0292-492d-a8ae-e6a189257963 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:04.965501 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3e5f35cb-0292-492d-a8ae-e6a189257963 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:05.093695 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3e5f35cb-0292-492d-a8ae-e6a189257963 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:04:05.101606 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3e5f35cb-0292-492d-a8ae-e6a189257963 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a" status: 200 len: 1396 microversion: 2.1 time: 0.149486 Oct 30 02:04:05.102116 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3440/6810] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:04:04 2022] GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a => generated 1396 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:04:06.124792 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4febda00-c969-4a0c-af4f-5bed24cd853b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:04:06.125433 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4febda00-c969-4a0c-af4f-5bed24cd853b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: a50781df-47bb-42f6-bca6-a6ddab11284a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:04:06.132688 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4febda00-c969-4a0c-af4f-5bed24cd853b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:06.133169 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4febda00-c969-4a0c-af4f-5bed24cd853b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:06.133663 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4febda00-c969-4a0c-af4f-5bed24cd853b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:06.134329 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4febda00-c969-4a0c-af4f-5bed24cd853b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:06.134780 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4febda00-c969-4a0c-af4f-5bed24cd853b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:06.135199 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4febda00-c969-4a0c-af4f-5bed24cd853b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:06.265110 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4febda00-c969-4a0c-af4f-5bed24cd853b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:04:06.273492 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4febda00-c969-4a0c-af4f-5bed24cd853b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a" status: 200 len: 1396 microversion: 2.1 time: 0.152667 Oct 30 02:04:06.274075 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3441/6811] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:04:06 2022] GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a => generated 1396 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:04:07.296461 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-873ed8c8-f455-474a-b5f8-f9a80e511639 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:04:07.297188 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-873ed8c8-f455-474a-b5f8-f9a80e511639 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: a50781df-47bb-42f6-bca6-a6ddab11284a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:04:07.304421 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-873ed8c8-f455-474a-b5f8-f9a80e511639 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:07.305037 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-873ed8c8-f455-474a-b5f8-f9a80e511639 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:07.305588 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-873ed8c8-f455-474a-b5f8-f9a80e511639 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:07.306378 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-873ed8c8-f455-474a-b5f8-f9a80e511639 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:07.306884 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-873ed8c8-f455-474a-b5f8-f9a80e511639 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:07.307724 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-873ed8c8-f455-474a-b5f8-f9a80e511639 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:07.541467 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-873ed8c8-f455-474a-b5f8-f9a80e511639 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:04:07.550428 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-873ed8c8-f455-474a-b5f8-f9a80e511639 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a" status: 200 len: 1396 microversion: 2.1 time: 0.257983 Oct 30 02:04:07.551022 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3442/6812] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:04:07 2022] GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a => generated 1396 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:04:07.556221 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-f7002778-fdbd-4208-800f-1a28eed494bc req-8664de5a-21a2-4d05-8caf-459f134befde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a50781df-47bb-42f6-bca6-a6ddab11284a", "name": "network-vif-deleted", "tag": "48d9d1e4-3c80-4517-bd28-c3bfd8fcc5d3"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:04:07.566893 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-f7002778-fdbd-4208-800f-1a28eed494bc req-8664de5a-21a2-4d05-8caf-459f134befde service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:07.567897 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-f7002778-fdbd-4208-800f-1a28eed494bc req-8664de5a-21a2-4d05-8caf-459f134befde service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:07.568348 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-f7002778-fdbd-4208-800f-1a28eed494bc req-8664de5a-21a2-4d05-8caf-459f134befde service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:07.580728 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-f7002778-fdbd-4208-800f-1a28eed494bc req-8664de5a-21a2-4d05-8caf-459f134befde service nova] Creating event network-vif-deleted:48d9d1e4-3c80-4517-bd28-c3bfd8fcc5d3 for instance a50781df-47bb-42f6-bca6-a6ddab11284a on n-h2-master-1 Oct 30 02:04:07.586852 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-f7002778-fdbd-4208-800f-1a28eed494bc req-8664de5a-21a2-4d05-8caf-459f134befde service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034443 Oct 30 02:04:07.587466 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3443/6813] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:04:08.577728 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6b9ec030-ef69-4eb5-bd12-aa0eb54a5eb8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:04:08.578576 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6b9ec030-ef69-4eb5-bd12-aa0eb54a5eb8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: a50781df-47bb-42f6-bca6-a6ddab11284a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:04:08.585680 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b9ec030-ef69-4eb5-bd12-aa0eb54a5eb8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:08.586178 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b9ec030-ef69-4eb5-bd12-aa0eb54a5eb8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:08.586619 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b9ec030-ef69-4eb5-bd12-aa0eb54a5eb8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:08.587329 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b9ec030-ef69-4eb5-bd12-aa0eb54a5eb8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:08.587785 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b9ec030-ef69-4eb5-bd12-aa0eb54a5eb8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:08.588212 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b9ec030-ef69-4eb5-bd12-aa0eb54a5eb8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:08.652802 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6b9ec030-ef69-4eb5-bd12-aa0eb54a5eb8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:04:08.661361 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6b9ec030-ef69-4eb5-bd12-aa0eb54a5eb8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a" status: 200 len: 1187 microversion: 2.1 time: 0.088380 Oct 30 02:04:08.661954 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3444/6814] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:04:08 2022] GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a => generated 1187 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:04:09.684295 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7203b168-5c93-4109-ad69-ef8cff42c260 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:04:09.684964 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7203b168-5c93-4109-ad69-ef8cff42c260 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: a50781df-47bb-42f6-bca6-a6ddab11284a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:04:09.691839 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7203b168-5c93-4109-ad69-ef8cff42c260 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:09.692889 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7203b168-5c93-4109-ad69-ef8cff42c260 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:09.693324 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7203b168-5c93-4109-ad69-ef8cff42c260 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:09.694054 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7203b168-5c93-4109-ad69-ef8cff42c260 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:09.694508 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7203b168-5c93-4109-ad69-ef8cff42c260 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:09.694934 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7203b168-5c93-4109-ad69-ef8cff42c260 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:09.756615 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7203b168-5c93-4109-ad69-ef8cff42c260 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:04:09.760224 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:04:09.764779 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7203b168-5c93-4109-ad69-ef8cff42c260 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a" status: 200 len: 1187 microversion: 2.1 time: 0.084509 Oct 30 02:04:09.765355 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3445/6815] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:04:09 2022] GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a => generated 1187 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:04:10.788594 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c0a82bf4-a85d-4c15-827f-8609fbca682f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:04:10.789226 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c0a82bf4-a85d-4c15-827f-8609fbca682f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: a50781df-47bb-42f6-bca6-a6ddab11284a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:04:10.796590 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c0a82bf4-a85d-4c15-827f-8609fbca682f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:10.797074 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c0a82bf4-a85d-4c15-827f-8609fbca682f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:10.797555 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c0a82bf4-a85d-4c15-827f-8609fbca682f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:10.798253 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c0a82bf4-a85d-4c15-827f-8609fbca682f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:10.798710 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c0a82bf4-a85d-4c15-827f-8609fbca682f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:10.799142 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c0a82bf4-a85d-4c15-827f-8609fbca682f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:10.867012 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c0a82bf4-a85d-4c15-827f-8609fbca682f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:04:10.875414 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c0a82bf4-a85d-4c15-827f-8609fbca682f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a" status: 200 len: 1187 microversion: 2.1 time: 0.091215 Oct 30 02:04:10.876250 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3446/6816] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:04:10 2022] GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a => generated 1187 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:04:11.899218 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4e62b983-982a-447d-a1ec-2fd5f1c312c6 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:04:11.899838 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4e62b983-982a-447d-a1ec-2fd5f1c312c6 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: a50781df-47bb-42f6-bca6-a6ddab11284a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:04:11.906898 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4e62b983-982a-447d-a1ec-2fd5f1c312c6 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:11.907387 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4e62b983-982a-447d-a1ec-2fd5f1c312c6 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:11.907830 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4e62b983-982a-447d-a1ec-2fd5f1c312c6 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:11.908531 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4e62b983-982a-447d-a1ec-2fd5f1c312c6 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:11.908993 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4e62b983-982a-447d-a1ec-2fd5f1c312c6 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:11.909451 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4e62b983-982a-447d-a1ec-2fd5f1c312c6 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:11.971440 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4e62b983-982a-447d-a1ec-2fd5f1c312c6 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:04:11.980049 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4e62b983-982a-447d-a1ec-2fd5f1c312c6 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a" status: 200 len: 1187 microversion: 2.1 time: 0.085354 Oct 30 02:04:11.980627 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3447/6817] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:04:11 2022] GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a => generated 1187 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:04:13.002700 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e345141b-b236-450c-a92a-c0831e6e3bc9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:04:13.003371 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e345141b-b236-450c-a92a-c0831e6e3bc9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: a50781df-47bb-42f6-bca6-a6ddab11284a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:04:13.010585 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e345141b-b236-450c-a92a-c0831e6e3bc9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:13.011078 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e345141b-b236-450c-a92a-c0831e6e3bc9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:13.011515 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e345141b-b236-450c-a92a-c0831e6e3bc9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:13.012217 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e345141b-b236-450c-a92a-c0831e6e3bc9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:13.012678 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e345141b-b236-450c-a92a-c0831e6e3bc9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:13.013104 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e345141b-b236-450c-a92a-c0831e6e3bc9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:13.026566 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-e345141b-b236-450c-a92a-c0831e6e3bc9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] HTTP exception thrown: Instance a50781df-47bb-42f6-bca6-a6ddab11284a could not be found. Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e345141b-b236-450c-a92a-c0831e6e3bc9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Request method failure captured: Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a HTTP/1.1 Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdrUzAoetWsdn8k4HYTcqbVG7Zs75eMmndnkEOPA0S-TmAgSQ2b5nMGLS0qTcKbMaQTaaQPoAGl2nSU9lucNctaJ1zTE6xKSNocI5VbroWnIgVb8SnDnXRJPuQdp0_RS-b7KWfvV5q_soI5fUH8iU2dwXESX56PU08-DTzNpHjo6aLI Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 99e1cde224c845caaa743246e60e338d Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-TestVolumeBootPattern-1509499038 Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/99e1cde224c845caaa743246e60e338d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_99e1cde224c845caaa743246e60e338d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/99e1cde224c845caaa743246e60e338d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/99e1cde224c845caaa743246e60e338d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-TestVolumeBootPattern-1509499038 Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 99e1cde224c845caaa743246e60e338d Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-TestVolumeBootPattern-1509499038 Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-TestVolumeBootPattern-1509499038-project Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: a0ec990e687d427d88dcf9879a1d5b0c Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-TestVolumeBootPattern-1509499038-project Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: exception: Instance a50781df-47bb-42f6-bca6-a6ddab11284a could not be found. Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'a50781df-47bb-42f6-bca6-a6ddab11284a'} Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a50781df-47bb-42f6-bca6-a6ddab11284a could not be found. Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a50781df-47bb-42f6-bca6-a6ddab11284a could not be found. Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:04:13.028288 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:04:13.036466 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:04:13.036466 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:04:13.036466 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:04:13.036466 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:04:13.036466 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:04:13.036466 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a50781df-47bb-42f6-bca6-a6ddab11284a could not be found. Oct 30 02:04:13.036466 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:04:13.036466 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e345141b-b236-450c-a92a-c0831e6e3bc9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Returning 404 to user: Instance a50781df-47bb-42f6-bca6-a6ddab11284a could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:04:13.036466 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e345141b-b236-450c-a92a-c0831e6e3bc9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a" status: 404 len: 111 microversion: 2.1 time: 0.031141 Oct 30 02:04:13.036466 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3448/6818] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:04:12 2022] GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 02:04:15.172977 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-30ca95d5-1456-4fb1-b8c1-18c90a6e153a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:04:15.173578 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-30ca95d5-1456-4fb1-b8c1-18c90a6e153a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: a50781df-47bb-42f6-bca6-a6ddab11284a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:04:15.181142 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-30ca95d5-1456-4fb1-b8c1-18c90a6e153a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:15.181663 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-30ca95d5-1456-4fb1-b8c1-18c90a6e153a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:15.182108 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-30ca95d5-1456-4fb1-b8c1-18c90a6e153a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:15.182813 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-30ca95d5-1456-4fb1-b8c1-18c90a6e153a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:15.183270 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-30ca95d5-1456-4fb1-b8c1-18c90a6e153a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:15.183704 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-30ca95d5-1456-4fb1-b8c1-18c90a6e153a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:15.200325 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-30ca95d5-1456-4fb1-b8c1-18c90a6e153a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] HTTP exception thrown: Instance a50781df-47bb-42f6-bca6-a6ddab11284a could not be found. Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-30ca95d5-1456-4fb1-b8c1-18c90a6e153a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Request method failure captured: Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a HTTP/1.1 Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdrUzAoetWsdn8k4HYTcqbVG7Zs75eMmndnkEOPA0S-TmAgSQ2b5nMGLS0qTcKbMaQTaaQPoAGl2nSU9lucNctaJ1zTE6xKSNocI5VbroWnIgVb8SnDnXRJPuQdp0_RS-b7KWfvV5q_soI5fUH8iU2dwXESX56PU08-DTzNpHjo6aLI Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 99e1cde224c845caaa743246e60e338d Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-TestVolumeBootPattern-1509499038 Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/99e1cde224c845caaa743246e60e338d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_99e1cde224c845caaa743246e60e338d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/99e1cde224c845caaa743246e60e338d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/99e1cde224c845caaa743246e60e338d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-TestVolumeBootPattern-1509499038 Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 99e1cde224c845caaa743246e60e338d Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-TestVolumeBootPattern-1509499038 Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-TestVolumeBootPattern-1509499038-project Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: a0ec990e687d427d88dcf9879a1d5b0c Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-TestVolumeBootPattern-1509499038-project Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: exception: Instance a50781df-47bb-42f6-bca6-a6ddab11284a could not be found. Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'a50781df-47bb-42f6-bca6-a6ddab11284a'} Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a50781df-47bb-42f6-bca6-a6ddab11284a could not be found. Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 02:04:15.201931 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 02:04:15.205359 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a50781df-47bb-42f6-bca6-a6ddab11284a could not be found. Oct 30 02:04:15.205359 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:04:15.205359 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:04:15.205359 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:04:15.205359 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:04:15.205359 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:04:15.205359 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:04:15.205359 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:04:15.205359 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:04:15.205359 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a50781df-47bb-42f6-bca6-a6ddab11284a could not be found. Oct 30 02:04:15.205359 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:04:15.205359 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-30ca95d5-1456-4fb1-b8c1-18c90a6e153a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Returning 404 to user: Instance a50781df-47bb-42f6-bca6-a6ddab11284a could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:04:15.205359 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-30ca95d5-1456-4fb1-b8c1-18c90a6e153a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a" status: 404 len: 111 microversion: 2.1 time: 0.034267 Oct 30 02:04:15.205359 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3449/6819] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 02:04:15 2022] DELETE /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 02:04:15.211912 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3501b92c-66af-4490-a5c5-1b211b66b9bc tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:04:15.212519 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3501b92c-66af-4490-a5c5-1b211b66b9bc tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: a50781df-47bb-42f6-bca6-a6ddab11284a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:04:15.218350 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3501b92c-66af-4490-a5c5-1b211b66b9bc tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:15.218833 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3501b92c-66af-4490-a5c5-1b211b66b9bc tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:15.219270 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3501b92c-66af-4490-a5c5-1b211b66b9bc tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:15.219958 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3501b92c-66af-4490-a5c5-1b211b66b9bc tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:15.220411 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3501b92c-66af-4490-a5c5-1b211b66b9bc tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:15.220838 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3501b92c-66af-4490-a5c5-1b211b66b9bc tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:15.234621 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-3501b92c-66af-4490-a5c5-1b211b66b9bc tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] HTTP exception thrown: Instance a50781df-47bb-42f6-bca6-a6ddab11284a could not be found. Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3501b92c-66af-4490-a5c5-1b211b66b9bc tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Request method failure captured: Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a HTTP/1.1 Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdrUzAoetWsdn8k4HYTcqbVG7Zs75eMmndnkEOPA0S-TmAgSQ2b5nMGLS0qTcKbMaQTaaQPoAGl2nSU9lucNctaJ1zTE6xKSNocI5VbroWnIgVb8SnDnXRJPuQdp0_RS-b7KWfvV5q_soI5fUH8iU2dwXESX56PU08-DTzNpHjo6aLI Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 99e1cde224c845caaa743246e60e338d Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-TestVolumeBootPattern-1509499038 Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/99e1cde224c845caaa743246e60e338d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_99e1cde224c845caaa743246e60e338d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/99e1cde224c845caaa743246e60e338d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/99e1cde224c845caaa743246e60e338d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-TestVolumeBootPattern-1509499038 Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 99e1cde224c845caaa743246e60e338d Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-TestVolumeBootPattern-1509499038 Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-TestVolumeBootPattern-1509499038-project Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: a0ec990e687d427d88dcf9879a1d5b0c Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-TestVolumeBootPattern-1509499038-project Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: exception: Instance a50781df-47bb-42f6-bca6-a6ddab11284a could not be found. Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'a50781df-47bb-42f6-bca6-a6ddab11284a'} Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a50781df-47bb-42f6-bca6-a6ddab11284a could not be found. Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a50781df-47bb-42f6-bca6-a6ddab11284a could not be found. Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:04:15.236104 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:04:15.240248 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:04:15.240248 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:04:15.240248 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:04:15.240248 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:04:15.240248 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:04:15.240248 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a50781df-47bb-42f6-bca6-a6ddab11284a could not be found. Oct 30 02:04:15.240248 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:04:15.240248 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3501b92c-66af-4490-a5c5-1b211b66b9bc tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Returning 404 to user: Instance a50781df-47bb-42f6-bca6-a6ddab11284a could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:04:15.240248 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3501b92c-66af-4490-a5c5-1b211b66b9bc tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a" status: 404 len: 111 microversion: 2.1 time: 0.029507 Oct 30 02:04:15.240248 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3450/6820] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:04:15 2022] GET /compute/v2.1/servers/a50781df-47bb-42f6-bca6-a6ddab11284a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 02:04:24.098509 n-d-master-1 devstack@n-api.service[121103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 30 02:04:24.099084 n-d-master-1 devstack@n-api.service[121103]: Sun Oct 30 02:04:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.13) !!! Oct 30 02:04:24.102705 n-d-master-1 devstack@n-api.service[121103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 30 02:04:24.102823 n-d-master-1 devstack@n-api.service[121103]: Sun Oct 30 02:04:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.13) !!! Oct 30 02:04:25.133319 n-d-master-1 devstack@n-api.service[121103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 30 02:04:25.134152 n-d-master-1 devstack@n-api.service[121103]: Sun Oct 30 02:04:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.13) !!! Oct 30 02:04:41.739210 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1d16a8be-8071-42a5-8c40-4dc3b4f90c45 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-977104270", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "9e455a6b-8892-40b4-abd9-341e9c661c8a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "aa518046-7164-40fa-a3f3-11422c6acc97"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:04:41.749327 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:04:41.750003 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=18 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:04:41.801488 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-1d16a8be-8071-42a5-8c40-4dc3b4f90c45 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] validate_networks() for [('aa518046-7164-40fa-a3f3-11422c6acc97', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 02:04:42.163625 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-1d16a8be-8071-42a5-8c40-4dc3b4f90c45 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 02:04:42.164077 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-1d16a8be-8071-42a5-8c40-4dc3b4f90c45 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 02:04:42.164551 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-1d16a8be-8071-42a5-8c40-4dc3b4f90c45 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 02:04:42.164977 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-1d16a8be-8071-42a5-8c40-4dc3b4f90c45 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 02:04:42.165441 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-1d16a8be-8071-42a5-8c40-4dc3b4f90c45 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 02:04:42.175836 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1d16a8be-8071-42a5-8c40-4dc3b4f90c45 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:42.176313 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1d16a8be-8071-42a5-8c40-4dc3b4f90c45 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:42.176749 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1d16a8be-8071-42a5-8c40-4dc3b4f90c45 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:42.177510 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1d16a8be-8071-42a5-8c40-4dc3b4f90c45 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:42.177965 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1d16a8be-8071-42a5-8c40-4dc3b4f90c45 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:42.178390 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1d16a8be-8071-42a5-8c40-4dc3b4f90c45 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:42.195400 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-1d16a8be-8071-42a5-8c40-4dc3b4f90c45 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Getting quotas for project 99e1cde224c845caaa743246e60e338d. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 02:04:42.200520 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-1d16a8be-8071-42a5-8c40-4dc3b4f90c45 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Getting quotas for user a0ec990e687d427d88dcf9879a1d5b0c and project 99e1cde224c845caaa743246e60e338d. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 02:04:42.257711 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1d16a8be-8071-42a5-8c40-4dc3b4f90c45 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 02:04:42.259859 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1d16a8be-8071-42a5-8c40-4dc3b4f90c45 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9e455a6b-8892-40b4-abd9-341e9c661c8a',volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 02:04:42.598841 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1d16a8be-8071-42a5-8c40-4dc3b4f90c45 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.863725 Oct 30 02:04:42.599530 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3451/6821] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 02:04:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 30 02:04:42.610595 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6f05a6bb-6c8b-408d-bb9b-9101419da183 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:04:42.611215 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6f05a6bb-6c8b-408d-bb9b-9101419da183 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:04:42.664599 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6f05a6bb-6c8b-408d-bb9b-9101419da183 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:04:42.672710 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6f05a6bb-6c8b-408d-bb9b-9101419da183 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6" status: 200 len: 1070 microversion: 2.1 time: 0.065844 Oct 30 02:04:42.673281 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3452/6822] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:04:42 2022] GET /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6 => generated 1070 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:04:43.696260 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-57245ced-4b20-4170-8526-2515c4c04755 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:04:43.696948 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-57245ced-4b20-4170-8526-2515c4c04755 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:04:43.703812 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-57245ced-4b20-4170-8526-2515c4c04755 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:43.704298 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-57245ced-4b20-4170-8526-2515c4c04755 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:43.704769 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-57245ced-4b20-4170-8526-2515c4c04755 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:43.705489 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-57245ced-4b20-4170-8526-2515c4c04755 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:43.705948 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-57245ced-4b20-4170-8526-2515c4c04755 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:43.706376 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-57245ced-4b20-4170-8526-2515c4c04755 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:43.767619 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-57245ced-4b20-4170-8526-2515c4c04755 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:04:43.776133 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-57245ced-4b20-4170-8526-2515c4c04755 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6" status: 200 len: 1120 microversion: 2.1 time: 0.084327 Oct 30 02:04:43.776695 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3453/6823] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:04:43 2022] GET /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6 => generated 1120 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:04:44.799082 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2421df89-6dcc-4212-b6c3-ddaf1109cf77 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:04:44.800551 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2421df89-6dcc-4212-b6c3-ddaf1109cf77 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:04:44.807440 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2421df89-6dcc-4212-b6c3-ddaf1109cf77 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:44.807931 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2421df89-6dcc-4212-b6c3-ddaf1109cf77 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:44.808621 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2421df89-6dcc-4212-b6c3-ddaf1109cf77 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:44.809447 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2421df89-6dcc-4212-b6c3-ddaf1109cf77 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:44.810022 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2421df89-6dcc-4212-b6c3-ddaf1109cf77 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:44.810515 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2421df89-6dcc-4212-b6c3-ddaf1109cf77 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:44.885181 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2421df89-6dcc-4212-b6c3-ddaf1109cf77 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:04:44.898230 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2421df89-6dcc-4212-b6c3-ddaf1109cf77 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6" status: 200 len: 1186 microversion: 2.1 time: 0.102843 Oct 30 02:04:44.898854 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3454/6824] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:04:44 2022] GET /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6 => generated 1186 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:04:45.922386 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7deb1362-770c-4dbf-a538-8a453b342286 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:04:45.923100 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7deb1362-770c-4dbf-a538-8a453b342286 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:04:45.930912 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7deb1362-770c-4dbf-a538-8a453b342286 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:45.931510 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7deb1362-770c-4dbf-a538-8a453b342286 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:45.932193 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7deb1362-770c-4dbf-a538-8a453b342286 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:45.932916 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7deb1362-770c-4dbf-a538-8a453b342286 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:45.933399 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7deb1362-770c-4dbf-a538-8a453b342286 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:45.933830 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7deb1362-770c-4dbf-a538-8a453b342286 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:46.388439 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7deb1362-770c-4dbf-a538-8a453b342286 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:04:46.397016 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7deb1362-770c-4dbf-a538-8a453b342286 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6" status: 200 len: 1228 microversion: 2.1 time: 0.478575 Oct 30 02:04:46.400808 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3455/6825] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:04:45 2022] GET /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6 => generated 1228 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:04:46.470254 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-3dc31152-5eec-4893-9115-ca57a0084d00 req-28e33524-5a4b-487c-9559-c8cceede9b51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6", "tag": "191e29b5-17f4-4bd0-889a-47415b54af04"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:04:46.480796 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-3dc31152-5eec-4893-9115-ca57a0084d00 req-28e33524-5a4b-487c-9559-c8cceede9b51 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:46.481287 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-3dc31152-5eec-4893-9115-ca57a0084d00 req-28e33524-5a4b-487c-9559-c8cceede9b51 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:46.481770 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-3dc31152-5eec-4893-9115-ca57a0084d00 req-28e33524-5a4b-487c-9559-c8cceede9b51 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:46.496011 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-3dc31152-5eec-4893-9115-ca57a0084d00 req-28e33524-5a4b-487c-9559-c8cceede9b51 service nova] Creating event network-changed:191e29b5-17f4-4bd0-889a-47415b54af04 for instance 04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6 on n-h2-master-1 Oct 30 02:04:46.498845 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-3dc31152-5eec-4893-9115-ca57a0084d00 req-28e33524-5a4b-487c-9559-c8cceede9b51 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034991 Oct 30 02:04:46.499464 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3456/6826] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:04:47.421609 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ae73e4d1-8a54-4925-946b-ba71878ebc52 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:04:47.422319 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ae73e4d1-8a54-4925-946b-ba71878ebc52 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:04:47.429163 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae73e4d1-8a54-4925-946b-ba71878ebc52 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:47.429692 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae73e4d1-8a54-4925-946b-ba71878ebc52 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:47.430135 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae73e4d1-8a54-4925-946b-ba71878ebc52 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:47.430829 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae73e4d1-8a54-4925-946b-ba71878ebc52 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:47.431284 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae73e4d1-8a54-4925-946b-ba71878ebc52 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:47.431738 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae73e4d1-8a54-4925-946b-ba71878ebc52 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:47.570968 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ae73e4d1-8a54-4925-946b-ba71878ebc52 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:04:47.579021 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ae73e4d1-8a54-4925-946b-ba71878ebc52 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6" status: 200 len: 1228 microversion: 2.1 time: 0.162730 Oct 30 02:04:47.579601 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3457/6827] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:04:47 2022] GET /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6 => generated 1228 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:04:48.602870 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-375f2cda-636f-48e7-be1a-fa33186a86d5 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:04:48.603479 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-375f2cda-636f-48e7-be1a-fa33186a86d5 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:04:48.610317 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-375f2cda-636f-48e7-be1a-fa33186a86d5 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:48.610827 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-375f2cda-636f-48e7-be1a-fa33186a86d5 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:48.611260 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-375f2cda-636f-48e7-be1a-fa33186a86d5 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:48.611954 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-375f2cda-636f-48e7-be1a-fa33186a86d5 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:48.612400 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-375f2cda-636f-48e7-be1a-fa33186a86d5 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:48.612820 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-375f2cda-636f-48e7-be1a-fa33186a86d5 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:48.747487 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-375f2cda-636f-48e7-be1a-fa33186a86d5 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:04:48.756126 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-375f2cda-636f-48e7-be1a-fa33186a86d5 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6" status: 200 len: 1228 microversion: 2.1 time: 0.157160 Oct 30 02:04:48.756707 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3458/6828] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:04:48 2022] GET /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6 => generated 1228 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:04:49.779687 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4a571d26-33da-454a-9c23-148d1abb9920 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:04:49.780336 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4a571d26-33da-454a-9c23-148d1abb9920 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:04:49.787650 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a571d26-33da-454a-9c23-148d1abb9920 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:49.788140 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a571d26-33da-454a-9c23-148d1abb9920 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:49.788580 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a571d26-33da-454a-9c23-148d1abb9920 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:49.789349 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a571d26-33da-454a-9c23-148d1abb9920 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:49.789812 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a571d26-33da-454a-9c23-148d1abb9920 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:49.790242 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a571d26-33da-454a-9c23-148d1abb9920 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:49.924313 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4a571d26-33da-454a-9c23-148d1abb9920 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:04:49.932563 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4a571d26-33da-454a-9c23-148d1abb9920 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6" status: 200 len: 1228 microversion: 2.1 time: 0.157051 Oct 30 02:04:49.933140 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3459/6829] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:04:49 2022] GET /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6 => generated 1228 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:04:50.954972 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0b96cca3-6953-4fd4-be35-0bc379a14ea8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:04:50.955588 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0b96cca3-6953-4fd4-be35-0bc379a14ea8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:04:50.962732 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b96cca3-6953-4fd4-be35-0bc379a14ea8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:50.963214 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b96cca3-6953-4fd4-be35-0bc379a14ea8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:50.963648 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b96cca3-6953-4fd4-be35-0bc379a14ea8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:50.964338 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b96cca3-6953-4fd4-be35-0bc379a14ea8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:50.964786 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b96cca3-6953-4fd4-be35-0bc379a14ea8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:50.965210 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b96cca3-6953-4fd4-be35-0bc379a14ea8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:51.090934 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0b96cca3-6953-4fd4-be35-0bc379a14ea8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:04:51.098643 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0b96cca3-6953-4fd4-be35-0bc379a14ea8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6" status: 200 len: 1216 microversion: 2.1 time: 0.147631 Oct 30 02:04:51.099701 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3460/6830] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:04:50 2022] GET /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6 => generated 1216 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:04:52.121886 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-37db8ca4-4b16-4baa-97b3-8df9b55db00f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:04:52.122532 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-37db8ca4-4b16-4baa-97b3-8df9b55db00f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:04:52.129530 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-37db8ca4-4b16-4baa-97b3-8df9b55db00f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:52.130016 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-37db8ca4-4b16-4baa-97b3-8df9b55db00f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:52.131024 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-37db8ca4-4b16-4baa-97b3-8df9b55db00f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:52.131720 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-37db8ca4-4b16-4baa-97b3-8df9b55db00f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:52.132176 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-37db8ca4-4b16-4baa-97b3-8df9b55db00f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:52.132605 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-37db8ca4-4b16-4baa-97b3-8df9b55db00f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:52.185991 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:04:52.261048 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-37db8ca4-4b16-4baa-97b3-8df9b55db00f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:04:52.268723 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-37db8ca4-4b16-4baa-97b3-8df9b55db00f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6" status: 200 len: 1216 microversion: 2.1 time: 0.150778 Oct 30 02:04:52.269298 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3461/6831] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:04:52 2022] GET /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6 => generated 1216 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:04:53.291616 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-365b7c22-ee6b-4d75-9c04-e04b149df4f4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:04:53.292273 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-365b7c22-ee6b-4d75-9c04-e04b149df4f4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:04:53.294206 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=8 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:04:53.299878 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-365b7c22-ee6b-4d75-9c04-e04b149df4f4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:53.300370 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-365b7c22-ee6b-4d75-9c04-e04b149df4f4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:53.300807 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-365b7c22-ee6b-4d75-9c04-e04b149df4f4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:53.301537 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-365b7c22-ee6b-4d75-9c04-e04b149df4f4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:53.301996 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-365b7c22-ee6b-4d75-9c04-e04b149df4f4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:53.302427 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-365b7c22-ee6b-4d75-9c04-e04b149df4f4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:53.433591 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-365b7c22-ee6b-4d75-9c04-e04b149df4f4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:04:53.441641 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-365b7c22-ee6b-4d75-9c04-e04b149df4f4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6" status: 200 len: 1216 microversion: 2.1 time: 0.154008 Oct 30 02:04:53.442272 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3462/6832] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:04:53 2022] GET /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6 => generated 1216 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:04:54.465222 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fa63b3ce-c798-434d-9569-784c8222ae77 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:04:54.465928 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fa63b3ce-c798-434d-9569-784c8222ae77 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:04:54.472721 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fa63b3ce-c798-434d-9569-784c8222ae77 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:54.473204 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fa63b3ce-c798-434d-9569-784c8222ae77 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:54.473664 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fa63b3ce-c798-434d-9569-784c8222ae77 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:54.474916 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fa63b3ce-c798-434d-9569-784c8222ae77 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:54.475370 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fa63b3ce-c798-434d-9569-784c8222ae77 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:54.475794 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fa63b3ce-c798-434d-9569-784c8222ae77 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:54.603552 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-fa63b3ce-c798-434d-9569-784c8222ae77 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:04:54.611473 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fa63b3ce-c798-434d-9569-784c8222ae77 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6" status: 200 len: 1216 microversion: 2.1 time: 0.150060 Oct 30 02:04:54.612060 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3463/6833] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:04:54 2022] GET /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6 => generated 1216 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:04:55.634400 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5ed61f56-c3af-41d9-8f5f-f8999f667a34 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:04:55.635046 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5ed61f56-c3af-41d9-8f5f-f8999f667a34 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:04:55.641873 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5ed61f56-c3af-41d9-8f5f-f8999f667a34 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:55.642351 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5ed61f56-c3af-41d9-8f5f-f8999f667a34 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:55.642789 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5ed61f56-c3af-41d9-8f5f-f8999f667a34 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:55.643472 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5ed61f56-c3af-41d9-8f5f-f8999f667a34 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:55.643919 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5ed61f56-c3af-41d9-8f5f-f8999f667a34 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:55.644338 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5ed61f56-c3af-41d9-8f5f-f8999f667a34 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:55.774251 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5ed61f56-c3af-41d9-8f5f-f8999f667a34 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:04:55.781863 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5ed61f56-c3af-41d9-8f5f-f8999f667a34 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6" status: 200 len: 1216 microversion: 2.1 time: 0.151901 Oct 30 02:04:55.782428 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3464/6834] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:04:55 2022] GET /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6 => generated 1216 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:04:56.804315 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d884db0e-772e-4488-b82f-a2564f119bca tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:04:56.804941 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d884db0e-772e-4488-b82f-a2564f119bca tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:04:56.811767 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d884db0e-772e-4488-b82f-a2564f119bca tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:56.812250 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d884db0e-772e-4488-b82f-a2564f119bca tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:56.812687 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d884db0e-772e-4488-b82f-a2564f119bca tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:56.813399 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d884db0e-772e-4488-b82f-a2564f119bca tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:56.813860 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d884db0e-772e-4488-b82f-a2564f119bca tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:56.814286 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d884db0e-772e-4488-b82f-a2564f119bca tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:56.941934 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d884db0e-772e-4488-b82f-a2564f119bca tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:04:56.949626 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d884db0e-772e-4488-b82f-a2564f119bca tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6" status: 200 len: 1216 microversion: 2.1 time: 0.149781 Oct 30 02:04:56.950198 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3465/6835] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:04:56 2022] GET /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6 => generated 1216 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:04:57.972187 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0460866b-cef5-47fb-a4f4-b7ba448d9fbc tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:04:57.972814 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0460866b-cef5-47fb-a4f4-b7ba448d9fbc tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:04:57.980226 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0460866b-cef5-47fb-a4f4-b7ba448d9fbc tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:57.980709 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0460866b-cef5-47fb-a4f4-b7ba448d9fbc tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:57.981146 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0460866b-cef5-47fb-a4f4-b7ba448d9fbc tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:57.981870 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0460866b-cef5-47fb-a4f4-b7ba448d9fbc tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:57.982327 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0460866b-cef5-47fb-a4f4-b7ba448d9fbc tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:57.982754 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0460866b-cef5-47fb-a4f4-b7ba448d9fbc tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:58.110577 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0460866b-cef5-47fb-a4f4-b7ba448d9fbc tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:04:58.118563 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0460866b-cef5-47fb-a4f4-b7ba448d9fbc tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6" status: 200 len: 1216 microversion: 2.1 time: 0.150331 Oct 30 02:04:58.119153 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3466/6836] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:04:57 2022] GET /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6 => generated 1216 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:04:59.140278 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-334985de-7a05-4df3-ae83-15e12bdfdad5 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:04:59.140886 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-334985de-7a05-4df3-ae83-15e12bdfdad5 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:04:59.148872 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-334985de-7a05-4df3-ae83-15e12bdfdad5 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:59.149400 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-334985de-7a05-4df3-ae83-15e12bdfdad5 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:59.149850 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-334985de-7a05-4df3-ae83-15e12bdfdad5 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:59.150558 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-334985de-7a05-4df3-ae83-15e12bdfdad5 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:04:59.151020 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-334985de-7a05-4df3-ae83-15e12bdfdad5 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:04:59.151455 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-334985de-7a05-4df3-ae83-15e12bdfdad5 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:04:59.286764 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-334985de-7a05-4df3-ae83-15e12bdfdad5 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:04:59.294693 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-334985de-7a05-4df3-ae83-15e12bdfdad5 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6" status: 200 len: 1216 microversion: 2.1 time: 0.158433 Oct 30 02:04:59.295276 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3467/6837] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:04:59 2022] GET /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6 => generated 1216 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:05:00.316748 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e2173cda-91c9-4172-9378-a82c147b45c9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:05:00.317410 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e2173cda-91c9-4172-9378-a82c147b45c9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:05:00.324387 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e2173cda-91c9-4172-9378-a82c147b45c9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:00.324895 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e2173cda-91c9-4172-9378-a82c147b45c9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:00.325348 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e2173cda-91c9-4172-9378-a82c147b45c9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:00.326048 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e2173cda-91c9-4172-9378-a82c147b45c9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:00.326503 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e2173cda-91c9-4172-9378-a82c147b45c9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:00.326931 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e2173cda-91c9-4172-9378-a82c147b45c9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:00.452725 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e2173cda-91c9-4172-9378-a82c147b45c9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:05:00.461188 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e2173cda-91c9-4172-9378-a82c147b45c9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6" status: 200 len: 1216 microversion: 2.1 time: 0.148637 Oct 30 02:05:00.461788 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3468/6838] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:05:00 2022] GET /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6 => generated 1216 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:05:00.853395 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-d9c1b32b-2cb0-4af2-8b64-ba50719c67ed req-0051d56b-609c-41d0-bd80-1346ca5b43ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6", "name": "network-vif-plugged", "status": "completed", "tag": "191e29b5-17f4-4bd0-889a-47415b54af04"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:05:00.857731 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-d9c1b32b-2cb0-4af2-8b64-ba50719c67ed req-0051d56b-609c-41d0-bd80-1346ca5b43ae service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:00.858221 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-d9c1b32b-2cb0-4af2-8b64-ba50719c67ed req-0051d56b-609c-41d0-bd80-1346ca5b43ae service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:00.858660 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-d9c1b32b-2cb0-4af2-8b64-ba50719c67ed req-0051d56b-609c-41d0-bd80-1346ca5b43ae service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:00.870232 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-d9c1b32b-2cb0-4af2-8b64-ba50719c67ed req-0051d56b-609c-41d0-bd80-1346ca5b43ae service nova] Creating event network-vif-plugged:191e29b5-17f4-4bd0-889a-47415b54af04 for instance 04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6 on n-h2-master-1 Oct 30 02:05:00.875771 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-d9c1b32b-2cb0-4af2-8b64-ba50719c67ed req-0051d56b-609c-41d0-bd80-1346ca5b43ae service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032207 Oct 30 02:05:00.876370 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3469/6839] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:05:01.485612 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c059ddf7-dddf-4b94-ac71-a65afcc1e08e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:05:01.486312 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c059ddf7-dddf-4b94-ac71-a65afcc1e08e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:05:01.493050 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c059ddf7-dddf-4b94-ac71-a65afcc1e08e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:01.493558 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c059ddf7-dddf-4b94-ac71-a65afcc1e08e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:01.493995 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c059ddf7-dddf-4b94-ac71-a65afcc1e08e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:01.494681 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c059ddf7-dddf-4b94-ac71-a65afcc1e08e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:01.495133 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c059ddf7-dddf-4b94-ac71-a65afcc1e08e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:01.495555 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c059ddf7-dddf-4b94-ac71-a65afcc1e08e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:01.515890 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:05:01.626182 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c059ddf7-dddf-4b94-ac71-a65afcc1e08e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:05:01.633815 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c059ddf7-dddf-4b94-ac71-a65afcc1e08e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6" status: 200 len: 1216 microversion: 2.1 time: 0.153447 Oct 30 02:05:01.634376 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3470/6840] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:05:01 2022] GET /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6 => generated 1216 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:05:02.655935 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4cf1bc12-6a56-4bf7-8e59-16fd3e132355 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:05:02.656553 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4cf1bc12-6a56-4bf7-8e59-16fd3e132355 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:05:02.664063 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4cf1bc12-6a56-4bf7-8e59-16fd3e132355 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:02.664549 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4cf1bc12-6a56-4bf7-8e59-16fd3e132355 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:02.664981 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4cf1bc12-6a56-4bf7-8e59-16fd3e132355 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:02.665690 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4cf1bc12-6a56-4bf7-8e59-16fd3e132355 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:02.666141 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4cf1bc12-6a56-4bf7-8e59-16fd3e132355 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:02.666563 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4cf1bc12-6a56-4bf7-8e59-16fd3e132355 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:02.796282 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4cf1bc12-6a56-4bf7-8e59-16fd3e132355 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:05:02.804203 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4cf1bc12-6a56-4bf7-8e59-16fd3e132355 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6" status: 200 len: 1404 microversion: 2.1 time: 0.152168 Oct 30 02:05:02.804774 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3471/6841] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:05:02 2022] GET /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6 => generated 1404 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:05:02.825676 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4c29e39a-766d-4692-b53c-4ca51248ab3e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:05:02.830423 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4c29e39a-766d-4692-b53c-4ca51248ab3e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:05:02.832403 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4c29e39a-766d-4692-b53c-4ca51248ab3e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:02.832895 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4c29e39a-766d-4692-b53c-4ca51248ab3e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:02.833855 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4c29e39a-766d-4692-b53c-4ca51248ab3e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:02.834556 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4c29e39a-766d-4692-b53c-4ca51248ab3e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:02.835042 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4c29e39a-766d-4692-b53c-4ca51248ab3e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:02.835477 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4c29e39a-766d-4692-b53c-4ca51248ab3e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:02.963967 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4c29e39a-766d-4692-b53c-4ca51248ab3e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:05:02.971776 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4c29e39a-766d-4692-b53c-4ca51248ab3e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6" status: 200 len: 1404 microversion: 2.1 time: 0.150034 Oct 30 02:05:02.972365 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3472/6842] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:05:02 2022] GET /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6 => generated 1404 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:05:02.995493 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-24efa7c9-73e1-41fe-a933-d1aef25f1a23 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1234611872"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:05:02.997829 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-24efa7c9-73e1-41fe-a933-d1aef25f1a23 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:05:03.003467 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24efa7c9-73e1-41fe-a933-d1aef25f1a23 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:03.003953 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24efa7c9-73e1-41fe-a933-d1aef25f1a23 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:03.004392 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24efa7c9-73e1-41fe-a933-d1aef25f1a23 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:03.005088 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24efa7c9-73e1-41fe-a933-d1aef25f1a23 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:03.005572 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24efa7c9-73e1-41fe-a933-d1aef25f1a23 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:03.006004 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24efa7c9-73e1-41fe-a933-d1aef25f1a23 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:03.096618 n-d-master-1 devstack@n-api.service[121102]: INFO nova.compute.api [None req-24efa7c9-73e1-41fe-a933-d1aef25f1a23 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6] Attempting to quiesce instance before volume snapshot. Oct 30 02:05:03.144324 n-d-master-1 devstack@n-api.service[121102]: INFO nova.compute.api [None req-24efa7c9-73e1-41fe-a933-d1aef25f1a23 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 30 02:05:03.288050 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-24efa7c9-73e1-41fe-a933-d1aef25f1a23 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6] Creating snapshot from volume 9e455a6b-8892-40b4-abd9-341e9c661c8a. {{(pid=121102) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 30 02:05:04.781596 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-24efa7c9-73e1-41fe-a933-d1aef25f1a23 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "POST /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6/action" status: 202 len: 0 microversion: 2.1 time: 1.789542 Oct 30 02:05:04.787021 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3473/6843] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 02:05:02 2022] POST /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6/action => generated 0 bytes in 1791 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 30 02:05:06.065423 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6bb40f70-a9ab-44f8-9d39-d3e5558c94c7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1505683582", "imageRef": "3bda7c03-69d2-45aa-ba3f-e53cbc4b7b39", "flavorRef": "452", "networks": [{"uuid": "aa518046-7164-40fa-a3f3-11422c6acc97"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:05:06.118966 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-6bb40f70-a9ab-44f8-9d39-d3e5558c94c7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] validate_networks() for [('aa518046-7164-40fa-a3f3-11422c6acc97', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 02:05:06.493326 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-6bb40f70-a9ab-44f8-9d39-d3e5558c94c7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 02:05:06.493794 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-6bb40f70-a9ab-44f8-9d39-d3e5558c94c7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 02:05:06.494289 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-6bb40f70-a9ab-44f8-9d39-d3e5558c94c7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 02:05:06.494719 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-6bb40f70-a9ab-44f8-9d39-d3e5558c94c7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 02:05:06.495151 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-6bb40f70-a9ab-44f8-9d39-d3e5558c94c7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 02:05:06.504131 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6bb40f70-a9ab-44f8-9d39-d3e5558c94c7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:06.504632 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6bb40f70-a9ab-44f8-9d39-d3e5558c94c7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:06.505085 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6bb40f70-a9ab-44f8-9d39-d3e5558c94c7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:06.505875 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6bb40f70-a9ab-44f8-9d39-d3e5558c94c7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:06.506347 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6bb40f70-a9ab-44f8-9d39-d3e5558c94c7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:06.506789 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6bb40f70-a9ab-44f8-9d39-d3e5558c94c7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:06.524587 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-6bb40f70-a9ab-44f8-9d39-d3e5558c94c7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Getting quotas for project 99e1cde224c845caaa743246e60e338d. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 02:05:06.529938 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-6bb40f70-a9ab-44f8-9d39-d3e5558c94c7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Getting quotas for user a0ec990e687d427d88dcf9879a1d5b0c and project 99e1cde224c845caaa743246e60e338d. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 02:05:06.543031 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6bb40f70-a9ab-44f8-9d39-d3e5558c94c7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 02:05:06.545800 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6bb40f70-a9ab-44f8-9d39-d3e5558c94c7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='52fb3b09-2bad-436e-9d95-d7592571a3a9',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 02:05:06.663098 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6bb40f70-a9ab-44f8-9d39-d3e5558c94c7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.602775 Oct 30 02:05:06.663792 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3474/6844] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 02:05:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 30 02:05:06.675345 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bcd51219-7f36-4f79-9e08-d53e2609d577 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:05:06.678000 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bcd51219-7f36-4f79-9e08-d53e2609d577 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:05:06.734259 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bcd51219-7f36-4f79-9e08-d53e2609d577 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:05:06.742730 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bcd51219-7f36-4f79-9e08-d53e2609d577 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78" status: 200 len: 1230 microversion: 2.1 time: 0.071383 Oct 30 02:05:06.743333 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3475/6845] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:05:06 2022] GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 => generated 1230 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:05:07.764711 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a9bc398b-df94-4527-9d97-baa6bd12d1c2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:05:07.765405 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a9bc398b-df94-4527-9d97-baa6bd12d1c2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:05:07.772959 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a9bc398b-df94-4527-9d97-baa6bd12d1c2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:07.773486 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a9bc398b-df94-4527-9d97-baa6bd12d1c2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:07.773938 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a9bc398b-df94-4527-9d97-baa6bd12d1c2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:07.774643 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a9bc398b-df94-4527-9d97-baa6bd12d1c2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:07.775107 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a9bc398b-df94-4527-9d97-baa6bd12d1c2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:07.775546 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a9bc398b-df94-4527-9d97-baa6bd12d1c2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:07.839015 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a9bc398b-df94-4527-9d97-baa6bd12d1c2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:05:07.846896 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a9bc398b-df94-4527-9d97-baa6bd12d1c2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78" status: 200 len: 1226 microversion: 2.1 time: 0.086040 Oct 30 02:05:07.847471 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3476/6846] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:05:07 2022] GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:05:08.870028 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fb591a7c-345d-49e6-85a7-a920ea98f1d9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:05:08.871252 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fb591a7c-345d-49e6-85a7-a920ea98f1d9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:05:08.880055 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb591a7c-345d-49e6-85a7-a920ea98f1d9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:08.880677 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb591a7c-345d-49e6-85a7-a920ea98f1d9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:08.882468 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb591a7c-345d-49e6-85a7-a920ea98f1d9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:08.885611 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb591a7c-345d-49e6-85a7-a920ea98f1d9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:08.886124 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb591a7c-345d-49e6-85a7-a920ea98f1d9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:08.886708 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb591a7c-345d-49e6-85a7-a920ea98f1d9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:08.983937 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-fb591a7c-345d-49e6-85a7-a920ea98f1d9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:05:08.992325 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fb591a7c-345d-49e6-85a7-a920ea98f1d9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78" status: 200 len: 1300 microversion: 2.1 time: 0.126570 Oct 30 02:05:08.992910 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3477/6847] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:05:08 2022] GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 => generated 1300 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:05:10.017707 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-43289bc9-459c-429b-bcb7-43d5a588d0c4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:05:10.018704 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-43289bc9-459c-429b-bcb7-43d5a588d0c4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:05:10.026847 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-43289bc9-459c-429b-bcb7-43d5a588d0c4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:10.027486 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-43289bc9-459c-429b-bcb7-43d5a588d0c4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:10.028084 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-43289bc9-459c-429b-bcb7-43d5a588d0c4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:10.029067 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-43289bc9-459c-429b-bcb7-43d5a588d0c4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:10.029851 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-43289bc9-459c-429b-bcb7-43d5a588d0c4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:10.031704 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-43289bc9-459c-429b-bcb7-43d5a588d0c4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:10.262245 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-43289bc9-459c-429b-bcb7-43d5a588d0c4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:05:10.269990 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-43289bc9-459c-429b-bcb7-43d5a588d0c4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78" status: 200 len: 1342 microversion: 2.1 time: 0.256437 Oct 30 02:05:10.270577 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3478/6848] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:05:10 2022] GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 => generated 1342 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:05:10.344701 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-4357ee47-c882-4429-b693-01eb0515cdb4 req-bb82b66b-87e4-4b77-ba4a-519de9e8c174 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69d3c7df-4f0d-4402-8ad7-880f69c13e78", "tag": "4a840186-bf5a-4f55-a071-afa4681ce47f"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:05:10.362878 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-4357ee47-c882-4429-b693-01eb0515cdb4 req-bb82b66b-87e4-4b77-ba4a-519de9e8c174 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:10.363632 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-4357ee47-c882-4429-b693-01eb0515cdb4 req-bb82b66b-87e4-4b77-ba4a-519de9e8c174 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:10.363826 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-4357ee47-c882-4429-b693-01eb0515cdb4 req-bb82b66b-87e4-4b77-ba4a-519de9e8c174 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:10.376405 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-4357ee47-c882-4429-b693-01eb0515cdb4 req-bb82b66b-87e4-4b77-ba4a-519de9e8c174 service nova] Creating event network-changed:4a840186-bf5a-4f55-a071-afa4681ce47f for instance 69d3c7df-4f0d-4402-8ad7-880f69c13e78 on n-h1-master-1 Oct 30 02:05:10.385135 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-4357ee47-c882-4429-b693-01eb0515cdb4 req-bb82b66b-87e4-4b77-ba4a-519de9e8c174 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047388 Oct 30 02:05:10.385789 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3479/6849] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:05:11.296538 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-44f19695-76fd-42ee-a3c5-ac14c4a60cff tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:05:11.297254 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-44f19695-76fd-42ee-a3c5-ac14c4a60cff tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:05:11.304828 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44f19695-76fd-42ee-a3c5-ac14c4a60cff tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:11.305357 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44f19695-76fd-42ee-a3c5-ac14c4a60cff tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:11.305804 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44f19695-76fd-42ee-a3c5-ac14c4a60cff tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:11.306575 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44f19695-76fd-42ee-a3c5-ac14c4a60cff tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:11.307046 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44f19695-76fd-42ee-a3c5-ac14c4a60cff tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:11.307485 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44f19695-76fd-42ee-a3c5-ac14c4a60cff tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:11.527522 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-44f19695-76fd-42ee-a3c5-ac14c4a60cff tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:05:11.536241 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-44f19695-76fd-42ee-a3c5-ac14c4a60cff tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78" status: 200 len: 1342 microversion: 2.1 time: 0.246566 Oct 30 02:05:11.536836 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3480/6850] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:05:11 2022] GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 => generated 1342 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:05:12.560885 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0a82c07e-8262-406f-a333-07bab22dc5da tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:05:12.561607 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0a82c07e-8262-406f-a333-07bab22dc5da tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:05:12.564789 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=6 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:05:12.570628 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0a82c07e-8262-406f-a333-07bab22dc5da tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:12.571247 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0a82c07e-8262-406f-a333-07bab22dc5da tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:12.571799 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0a82c07e-8262-406f-a333-07bab22dc5da tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:12.572823 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0a82c07e-8262-406f-a333-07bab22dc5da tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:12.573297 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0a82c07e-8262-406f-a333-07bab22dc5da tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:12.573895 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0a82c07e-8262-406f-a333-07bab22dc5da tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:12.716782 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0a82c07e-8262-406f-a333-07bab22dc5da tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:05:12.726252 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0a82c07e-8262-406f-a333-07bab22dc5da tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78" status: 200 len: 1342 microversion: 2.1 time: 0.170174 Oct 30 02:05:12.726834 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3481/6851] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:05:12 2022] GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 => generated 1342 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:05:13.751155 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-120628c5-7c29-4eaa-8412-c26046723798 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:05:13.751916 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-120628c5-7c29-4eaa-8412-c26046723798 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:05:13.759912 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-120628c5-7c29-4eaa-8412-c26046723798 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:13.760427 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-120628c5-7c29-4eaa-8412-c26046723798 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:13.760890 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-120628c5-7c29-4eaa-8412-c26046723798 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:13.761651 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-120628c5-7c29-4eaa-8412-c26046723798 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:13.762126 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-120628c5-7c29-4eaa-8412-c26046723798 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:13.762608 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-120628c5-7c29-4eaa-8412-c26046723798 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:13.907363 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-120628c5-7c29-4eaa-8412-c26046723798 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:05:13.915316 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-120628c5-7c29-4eaa-8412-c26046723798 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78" status: 200 len: 1342 microversion: 2.1 time: 0.168597 Oct 30 02:05:13.915903 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3482/6852] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:05:13 2022] GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 => generated 1342 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:05:14.938430 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ee982113-0007-430c-80ce-be1b25c7ca4b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:05:14.939183 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ee982113-0007-430c-80ce-be1b25c7ca4b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:05:14.946151 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee982113-0007-430c-80ce-be1b25c7ca4b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:14.946670 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee982113-0007-430c-80ce-be1b25c7ca4b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:14.947567 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee982113-0007-430c-80ce-be1b25c7ca4b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:14.948721 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee982113-0007-430c-80ce-be1b25c7ca4b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:14.948721 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee982113-0007-430c-80ce-be1b25c7ca4b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:14.949180 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee982113-0007-430c-80ce-be1b25c7ca4b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:15.086579 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ee982113-0007-430c-80ce-be1b25c7ca4b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:05:15.095393 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ee982113-0007-430c-80ce-be1b25c7ca4b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78" status: 200 len: 1342 microversion: 2.1 time: 0.160946 Oct 30 02:05:15.095970 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3483/6853] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:05:14 2022] GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 => generated 1342 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:05:16.119312 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ee0f8e99-5877-40fe-be09-9c5893259cc1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:05:16.121952 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ee0f8e99-5877-40fe-be09-9c5893259cc1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:05:16.127091 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee0f8e99-5877-40fe-be09-9c5893259cc1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:16.127590 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee0f8e99-5877-40fe-be09-9c5893259cc1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:16.128039 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee0f8e99-5877-40fe-be09-9c5893259cc1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:16.128748 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee0f8e99-5877-40fe-be09-9c5893259cc1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:16.129213 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee0f8e99-5877-40fe-be09-9c5893259cc1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:16.129684 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee0f8e99-5877-40fe-be09-9c5893259cc1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:16.262484 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ee0f8e99-5877-40fe-be09-9c5893259cc1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:05:16.270310 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ee0f8e99-5877-40fe-be09-9c5893259cc1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78" status: 200 len: 1342 microversion: 2.1 time: 0.154941 Oct 30 02:05:16.270879 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3484/6854] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:05:16 2022] GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 => generated 1342 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:05:17.293805 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9968d8b8-845f-47f7-b23b-19cf0a570a9c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:05:17.294438 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9968d8b8-845f-47f7-b23b-19cf0a570a9c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:05:17.296352 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:05:17.297069 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=8 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:05:17.304027 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9968d8b8-845f-47f7-b23b-19cf0a570a9c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:17.304533 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9968d8b8-845f-47f7-b23b-19cf0a570a9c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:17.304992 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9968d8b8-845f-47f7-b23b-19cf0a570a9c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:17.305736 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9968d8b8-845f-47f7-b23b-19cf0a570a9c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:17.306210 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9968d8b8-845f-47f7-b23b-19cf0a570a9c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:17.306651 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9968d8b8-845f-47f7-b23b-19cf0a570a9c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:17.450933 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9968d8b8-845f-47f7-b23b-19cf0a570a9c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:05:17.458954 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9968d8b8-845f-47f7-b23b-19cf0a570a9c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78" status: 200 len: 1342 microversion: 2.1 time: 0.169336 Oct 30 02:05:17.459531 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3485/6855] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:05:17 2022] GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 => generated 1342 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:05:18.482495 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-33d38cd4-5b84-4924-8c15-bee09f2a01aa tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:05:18.483157 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-33d38cd4-5b84-4924-8c15-bee09f2a01aa tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:05:18.490766 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-33d38cd4-5b84-4924-8c15-bee09f2a01aa tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:18.491278 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-33d38cd4-5b84-4924-8c15-bee09f2a01aa tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:18.491767 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-33d38cd4-5b84-4924-8c15-bee09f2a01aa tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:18.492531 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-33d38cd4-5b84-4924-8c15-bee09f2a01aa tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:18.493171 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-33d38cd4-5b84-4924-8c15-bee09f2a01aa tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:18.493649 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-33d38cd4-5b84-4924-8c15-bee09f2a01aa tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:18.639098 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-33d38cd4-5b84-4924-8c15-bee09f2a01aa tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:05:18.647757 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-33d38cd4-5b84-4924-8c15-bee09f2a01aa tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78" status: 200 len: 1342 microversion: 2.1 time: 0.169780 Oct 30 02:05:18.648332 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3486/6856] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:05:18 2022] GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 => generated 1342 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:05:19.674792 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d802e398-0b7c-4493-963f-813d86b3ab84 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:05:19.675472 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d802e398-0b7c-4493-963f-813d86b3ab84 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:05:19.683210 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d802e398-0b7c-4493-963f-813d86b3ab84 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:19.683715 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d802e398-0b7c-4493-963f-813d86b3ab84 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:19.684171 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d802e398-0b7c-4493-963f-813d86b3ab84 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:19.684899 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d802e398-0b7c-4493-963f-813d86b3ab84 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:19.685396 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d802e398-0b7c-4493-963f-813d86b3ab84 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:19.685849 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d802e398-0b7c-4493-963f-813d86b3ab84 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:19.704076 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:05:19.842730 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d802e398-0b7c-4493-963f-813d86b3ab84 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:05:19.851147 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d802e398-0b7c-4493-963f-813d86b3ab84 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78" status: 200 len: 1342 microversion: 2.1 time: 0.180326 Oct 30 02:05:19.851724 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3487/6857] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:05:19 2022] GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 => generated 1342 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:05:20.874888 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-51270e2d-b155-4a02-9a9c-4634041558ab tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:05:20.875536 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-51270e2d-b155-4a02-9a9c-4634041558ab tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:05:20.884902 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51270e2d-b155-4a02-9a9c-4634041558ab tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:20.886303 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51270e2d-b155-4a02-9a9c-4634041558ab tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:20.886986 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51270e2d-b155-4a02-9a9c-4634041558ab tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:20.888361 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51270e2d-b155-4a02-9a9c-4634041558ab tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:20.889451 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51270e2d-b155-4a02-9a9c-4634041558ab tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:20.890156 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51270e2d-b155-4a02-9a9c-4634041558ab tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:21.033940 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-51270e2d-b155-4a02-9a9c-4634041558ab tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:05:21.041572 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-51270e2d-b155-4a02-9a9c-4634041558ab tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78" status: 200 len: 1342 microversion: 2.1 time: 0.170728 Oct 30 02:05:21.042727 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3488/6858] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:05:20 2022] GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 => generated 1342 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:05:22.067472 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8b314077-4b04-4f0b-8368-97eac3b2edc8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:05:22.068401 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8b314077-4b04-4f0b-8368-97eac3b2edc8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:05:22.075711 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b314077-4b04-4f0b-8368-97eac3b2edc8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:22.076211 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b314077-4b04-4f0b-8368-97eac3b2edc8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:22.076664 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b314077-4b04-4f0b-8368-97eac3b2edc8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:22.077411 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b314077-4b04-4f0b-8368-97eac3b2edc8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:22.077883 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b314077-4b04-4f0b-8368-97eac3b2edc8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:22.078330 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b314077-4b04-4f0b-8368-97eac3b2edc8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:22.219135 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8b314077-4b04-4f0b-8368-97eac3b2edc8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:05:22.229809 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8b314077-4b04-4f0b-8368-97eac3b2edc8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78" status: 200 len: 1342 microversion: 2.1 time: 0.166219 Oct 30 02:05:22.230365 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3489/6859] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:05:22 2022] GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 => generated 1342 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:05:23.255236 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d772dc4b-9a5b-496e-aae4-4482e15f2b9f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:05:23.255909 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d772dc4b-9a5b-496e-aae4-4482e15f2b9f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:05:23.263580 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d772dc4b-9a5b-496e-aae4-4482e15f2b9f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:23.264078 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d772dc4b-9a5b-496e-aae4-4482e15f2b9f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:23.267550 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d772dc4b-9a5b-496e-aae4-4482e15f2b9f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:23.267550 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d772dc4b-9a5b-496e-aae4-4482e15f2b9f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:23.267550 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d772dc4b-9a5b-496e-aae4-4482e15f2b9f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:23.267550 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d772dc4b-9a5b-496e-aae4-4482e15f2b9f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:23.401688 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d772dc4b-9a5b-496e-aae4-4482e15f2b9f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:05:23.410062 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d772dc4b-9a5b-496e-aae4-4482e15f2b9f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78" status: 200 len: 1342 microversion: 2.1 time: 0.159086 Oct 30 02:05:23.410849 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3490/6860] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:05:23 2022] GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 => generated 1342 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:05:24.436936 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-38543068-55eb-4da5-8b25-da89a23cfdcf tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:05:24.437651 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-38543068-55eb-4da5-8b25-da89a23cfdcf tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:05:24.444694 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-38543068-55eb-4da5-8b25-da89a23cfdcf tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:24.445496 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-38543068-55eb-4da5-8b25-da89a23cfdcf tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:24.457940 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-38543068-55eb-4da5-8b25-da89a23cfdcf tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:24.457940 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-38543068-55eb-4da5-8b25-da89a23cfdcf tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:24.457940 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-38543068-55eb-4da5-8b25-da89a23cfdcf tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:24.457940 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-38543068-55eb-4da5-8b25-da89a23cfdcf tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:24.583008 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-38543068-55eb-4da5-8b25-da89a23cfdcf tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:05:24.591692 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-38543068-55eb-4da5-8b25-da89a23cfdcf tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78" status: 200 len: 1342 microversion: 2.1 time: 0.158447 Oct 30 02:05:24.592022 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3491/6861] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:05:24 2022] GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 => generated 1342 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:05:25.613615 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-53d7f64a-5e06-47c3-99f7-251a578ddb9e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:05:25.614262 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-53d7f64a-5e06-47c3-99f7-251a578ddb9e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:05:25.621644 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53d7f64a-5e06-47c3-99f7-251a578ddb9e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:25.622157 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53d7f64a-5e06-47c3-99f7-251a578ddb9e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:25.622610 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53d7f64a-5e06-47c3-99f7-251a578ddb9e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:25.623313 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53d7f64a-5e06-47c3-99f7-251a578ddb9e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:25.623779 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53d7f64a-5e06-47c3-99f7-251a578ddb9e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:25.624217 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53d7f64a-5e06-47c3-99f7-251a578ddb9e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:25.763924 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-53d7f64a-5e06-47c3-99f7-251a578ddb9e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:05:25.771700 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-53d7f64a-5e06-47c3-99f7-251a578ddb9e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78" status: 200 len: 1342 microversion: 2.1 time: 0.162215 Oct 30 02:05:25.772269 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3492/6862] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:05:25 2022] GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 => generated 1342 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:05:26.795662 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c0ce406a-31a6-48a2-b9c9-a2e0c955a935 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:05:26.796414 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c0ce406a-31a6-48a2-b9c9-a2e0c955a935 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:05:26.803728 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c0ce406a-31a6-48a2-b9c9-a2e0c955a935 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:26.804280 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c0ce406a-31a6-48a2-b9c9-a2e0c955a935 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:26.804743 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c0ce406a-31a6-48a2-b9c9-a2e0c955a935 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:26.805496 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c0ce406a-31a6-48a2-b9c9-a2e0c955a935 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:26.805974 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c0ce406a-31a6-48a2-b9c9-a2e0c955a935 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:26.806419 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c0ce406a-31a6-48a2-b9c9-a2e0c955a935 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:26.940872 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c0ce406a-31a6-48a2-b9c9-a2e0c955a935 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:05:26.949036 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c0ce406a-31a6-48a2-b9c9-a2e0c955a935 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78" status: 200 len: 1342 microversion: 2.1 time: 0.157994 Oct 30 02:05:26.950105 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3493/6863] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:05:26 2022] GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 => generated 1342 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:05:27.972996 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f141b5b8-e818-4fe0-920e-4e8fd9ed1ea7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:05:27.973691 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f141b5b8-e818-4fe0-920e-4e8fd9ed1ea7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:05:27.980749 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f141b5b8-e818-4fe0-920e-4e8fd9ed1ea7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:27.981251 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f141b5b8-e818-4fe0-920e-4e8fd9ed1ea7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:27.982303 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f141b5b8-e818-4fe0-920e-4e8fd9ed1ea7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:27.983008 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f141b5b8-e818-4fe0-920e-4e8fd9ed1ea7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:27.983469 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f141b5b8-e818-4fe0-920e-4e8fd9ed1ea7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:27.983904 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f141b5b8-e818-4fe0-920e-4e8fd9ed1ea7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:28.121796 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f141b5b8-e818-4fe0-920e-4e8fd9ed1ea7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:05:28.129595 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f141b5b8-e818-4fe0-920e-4e8fd9ed1ea7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78" status: 200 len: 1342 microversion: 2.1 time: 0.160622 Oct 30 02:05:28.130167 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3494/6864] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:05:27 2022] GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 => generated 1342 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:05:29.153035 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5c2be639-f83a-41fa-9c58-39c83bcd852f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:05:29.153738 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5c2be639-f83a-41fa-9c58-39c83bcd852f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:05:29.161455 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c2be639-f83a-41fa-9c58-39c83bcd852f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:29.161961 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c2be639-f83a-41fa-9c58-39c83bcd852f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:29.162408 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c2be639-f83a-41fa-9c58-39c83bcd852f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:29.167320 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c2be639-f83a-41fa-9c58-39c83bcd852f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:29.167320 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c2be639-f83a-41fa-9c58-39c83bcd852f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:29.167320 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c2be639-f83a-41fa-9c58-39c83bcd852f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:29.301168 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5c2be639-f83a-41fa-9c58-39c83bcd852f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:05:29.308973 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5c2be639-f83a-41fa-9c58-39c83bcd852f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78" status: 200 len: 1342 microversion: 2.1 time: 0.159923 Oct 30 02:05:29.309583 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3495/6865] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:05:29 2022] GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 => generated 1342 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:05:30.333718 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1301fc61-4cc2-490c-bf06-4ccdf7a3067a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:05:30.334477 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1301fc61-4cc2-490c-bf06-4ccdf7a3067a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:05:30.340900 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1301fc61-4cc2-490c-bf06-4ccdf7a3067a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:30.341432 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1301fc61-4cc2-490c-bf06-4ccdf7a3067a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:30.341887 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1301fc61-4cc2-490c-bf06-4ccdf7a3067a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:30.343097 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1301fc61-4cc2-490c-bf06-4ccdf7a3067a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:30.343563 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1301fc61-4cc2-490c-bf06-4ccdf7a3067a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:30.344004 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1301fc61-4cc2-490c-bf06-4ccdf7a3067a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:30.478064 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1301fc61-4cc2-490c-bf06-4ccdf7a3067a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:05:30.486930 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1301fc61-4cc2-490c-bf06-4ccdf7a3067a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78" status: 200 len: 1342 microversion: 2.1 time: 0.157670 Oct 30 02:05:30.487502 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3496/6866] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:05:30 2022] GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 => generated 1342 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:05:31.509401 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0bca5c1a-0c03-4e5e-b18b-778ac426dc45 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:05:31.510079 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0bca5c1a-0c03-4e5e-b18b-778ac426dc45 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:05:31.517193 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0bca5c1a-0c03-4e5e-b18b-778ac426dc45 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:31.517725 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0bca5c1a-0c03-4e5e-b18b-778ac426dc45 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:31.518178 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0bca5c1a-0c03-4e5e-b18b-778ac426dc45 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:31.518890 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0bca5c1a-0c03-4e5e-b18b-778ac426dc45 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:31.519359 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0bca5c1a-0c03-4e5e-b18b-778ac426dc45 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:31.519799 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0bca5c1a-0c03-4e5e-b18b-778ac426dc45 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:31.652174 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0bca5c1a-0c03-4e5e-b18b-778ac426dc45 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:05:31.660519 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0bca5c1a-0c03-4e5e-b18b-778ac426dc45 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78" status: 200 len: 1342 microversion: 2.1 time: 0.155092 Oct 30 02:05:31.665520 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3497/6867] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:05:31 2022] GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 => generated 1342 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:05:32.684233 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ba73ee7f-69d9-413b-b7ee-d412465c823b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:05:32.684849 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ba73ee7f-69d9-413b-b7ee-d412465c823b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:05:32.692654 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ba73ee7f-69d9-413b-b7ee-d412465c823b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:32.693457 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ba73ee7f-69d9-413b-b7ee-d412465c823b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:32.693714 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ba73ee7f-69d9-413b-b7ee-d412465c823b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:32.694331 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ba73ee7f-69d9-413b-b7ee-d412465c823b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:32.694870 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ba73ee7f-69d9-413b-b7ee-d412465c823b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:32.695309 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ba73ee7f-69d9-413b-b7ee-d412465c823b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:32.829103 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ba73ee7f-69d9-413b-b7ee-d412465c823b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:05:32.838123 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ba73ee7f-69d9-413b-b7ee-d412465c823b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78" status: 200 len: 1342 microversion: 2.1 time: 0.157922 Oct 30 02:05:32.842626 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3498/6868] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:05:32 2022] GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 => generated 1342 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:05:33.861298 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8d80a4ab-1cbe-40b8-8ed6-7975ad846fd2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:05:33.861959 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8d80a4ab-1cbe-40b8-8ed6-7975ad846fd2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:05:33.868794 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d80a4ab-1cbe-40b8-8ed6-7975ad846fd2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:33.869286 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d80a4ab-1cbe-40b8-8ed6-7975ad846fd2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:33.869772 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d80a4ab-1cbe-40b8-8ed6-7975ad846fd2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:33.870472 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d80a4ab-1cbe-40b8-8ed6-7975ad846fd2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:33.870986 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d80a4ab-1cbe-40b8-8ed6-7975ad846fd2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:33.871421 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d80a4ab-1cbe-40b8-8ed6-7975ad846fd2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:34.006341 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8d80a4ab-1cbe-40b8-8ed6-7975ad846fd2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:05:34.014065 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8d80a4ab-1cbe-40b8-8ed6-7975ad846fd2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78" status: 200 len: 1342 microversion: 2.1 time: 0.157412 Oct 30 02:05:34.014635 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3499/6869] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:05:33 2022] GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 => generated 1342 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:05:35.036741 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6d8654d1-51b5-4c38-917e-5b51fe8d6880 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:05:35.037434 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6d8654d1-51b5-4c38-917e-5b51fe8d6880 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:05:35.044811 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d8654d1-51b5-4c38-917e-5b51fe8d6880 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:35.045312 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d8654d1-51b5-4c38-917e-5b51fe8d6880 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:35.045841 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d8654d1-51b5-4c38-917e-5b51fe8d6880 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:35.046564 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d8654d1-51b5-4c38-917e-5b51fe8d6880 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:35.047228 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d8654d1-51b5-4c38-917e-5b51fe8d6880 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:35.048180 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d8654d1-51b5-4c38-917e-5b51fe8d6880 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:35.182031 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6d8654d1-51b5-4c38-917e-5b51fe8d6880 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:05:35.190566 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6d8654d1-51b5-4c38-917e-5b51fe8d6880 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78" status: 200 len: 1342 microversion: 2.1 time: 0.158324 Oct 30 02:05:35.191139 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3500/6870] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:05:35 2022] GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 => generated 1342 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:05:36.214005 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b02c9717-c21c-49f0-b02f-130e735932c2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:05:36.214675 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b02c9717-c21c-49f0-b02f-130e735932c2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:05:36.222453 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b02c9717-c21c-49f0-b02f-130e735932c2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:36.222981 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b02c9717-c21c-49f0-b02f-130e735932c2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:36.223458 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b02c9717-c21c-49f0-b02f-130e735932c2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:36.224221 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b02c9717-c21c-49f0-b02f-130e735932c2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:36.224720 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b02c9717-c21c-49f0-b02f-130e735932c2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:36.225191 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b02c9717-c21c-49f0-b02f-130e735932c2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:36.356463 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b02c9717-c21c-49f0-b02f-130e735932c2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:05:36.364242 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b02c9717-c21c-49f0-b02f-130e735932c2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78" status: 200 len: 1342 microversion: 2.1 time: 0.154257 Oct 30 02:05:36.364827 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3501/6871] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:05:36 2022] GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 => generated 1342 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:05:37.386930 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4934d8d4-828d-4f60-8256-1f6121eb1071 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:05:37.387569 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4934d8d4-828d-4f60-8256-1f6121eb1071 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:05:37.394488 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4934d8d4-828d-4f60-8256-1f6121eb1071 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:37.394985 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4934d8d4-828d-4f60-8256-1f6121eb1071 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:37.395433 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4934d8d4-828d-4f60-8256-1f6121eb1071 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:37.396137 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4934d8d4-828d-4f60-8256-1f6121eb1071 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:37.396603 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4934d8d4-828d-4f60-8256-1f6121eb1071 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:37.397038 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4934d8d4-828d-4f60-8256-1f6121eb1071 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:37.531961 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4934d8d4-828d-4f60-8256-1f6121eb1071 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:05:37.540669 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4934d8d4-828d-4f60-8256-1f6121eb1071 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78" status: 200 len: 1342 microversion: 2.1 time: 0.157640 Oct 30 02:05:37.541253 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3502/6872] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:05:37 2022] GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 => generated 1342 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:05:38.564657 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-63a13468-6109-4f0c-8a72-a212dd23c408 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:05:38.565303 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-63a13468-6109-4f0c-8a72-a212dd23c408 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:05:38.572427 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-63a13468-6109-4f0c-8a72-a212dd23c408 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:38.572936 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-63a13468-6109-4f0c-8a72-a212dd23c408 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:38.573418 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-63a13468-6109-4f0c-8a72-a212dd23c408 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:38.574140 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-63a13468-6109-4f0c-8a72-a212dd23c408 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:38.574614 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-63a13468-6109-4f0c-8a72-a212dd23c408 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:38.575061 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-63a13468-6109-4f0c-8a72-a212dd23c408 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:38.704842 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-63a13468-6109-4f0c-8a72-a212dd23c408 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:05:38.712928 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-63a13468-6109-4f0c-8a72-a212dd23c408 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78" status: 200 len: 1342 microversion: 2.1 time: 0.152331 Oct 30 02:05:38.713485 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3503/6873] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:05:38 2022] GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 => generated 1342 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:05:39.735670 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d3533ab0-ac6c-440d-95c7-ee41b3ddb60f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:05:39.736392 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d3533ab0-ac6c-440d-95c7-ee41b3ddb60f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:05:39.743166 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3533ab0-ac6c-440d-95c7-ee41b3ddb60f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:39.744736 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3533ab0-ac6c-440d-95c7-ee41b3ddb60f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:39.744736 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3533ab0-ac6c-440d-95c7-ee41b3ddb60f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:39.744919 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3533ab0-ac6c-440d-95c7-ee41b3ddb60f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:39.745227 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3533ab0-ac6c-440d-95c7-ee41b3ddb60f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:39.745691 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3533ab0-ac6c-440d-95c7-ee41b3ddb60f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:39.748229 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:05:39.882531 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d3533ab0-ac6c-440d-95c7-ee41b3ddb60f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:05:39.890446 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d3533ab0-ac6c-440d-95c7-ee41b3ddb60f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78" status: 200 len: 1342 microversion: 2.1 time: 0.158736 Oct 30 02:05:39.891023 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3504/6874] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:05:39 2022] GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 => generated 1342 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:05:40.913720 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-66418250-3596-481f-802a-aad093dd6c0a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:05:40.914529 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-66418250-3596-481f-802a-aad093dd6c0a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:05:40.921629 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-66418250-3596-481f-802a-aad093dd6c0a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:40.922258 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-66418250-3596-481f-802a-aad093dd6c0a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:40.922790 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-66418250-3596-481f-802a-aad093dd6c0a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:40.923584 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-66418250-3596-481f-802a-aad093dd6c0a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:40.924138 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-66418250-3596-481f-802a-aad093dd6c0a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:40.925302 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-66418250-3596-481f-802a-aad093dd6c0a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:41.056867 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-66418250-3596-481f-802a-aad093dd6c0a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:05:41.064752 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-66418250-3596-481f-802a-aad093dd6c0a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78" status: 200 len: 1342 microversion: 2.1 time: 0.155145 Oct 30 02:05:41.066048 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3505/6875] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:05:40 2022] GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 => generated 1342 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:05:42.088457 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d4a8bb26-58f2-45a0-88cb-3cd1d47072a2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:05:42.089135 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d4a8bb26-58f2-45a0-88cb-3cd1d47072a2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:05:42.096367 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4a8bb26-58f2-45a0-88cb-3cd1d47072a2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:42.096869 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4a8bb26-58f2-45a0-88cb-3cd1d47072a2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:42.097320 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4a8bb26-58f2-45a0-88cb-3cd1d47072a2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:42.098054 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4a8bb26-58f2-45a0-88cb-3cd1d47072a2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:42.098521 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4a8bb26-58f2-45a0-88cb-3cd1d47072a2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:42.098970 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4a8bb26-58f2-45a0-88cb-3cd1d47072a2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:42.234427 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d4a8bb26-58f2-45a0-88cb-3cd1d47072a2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:05:42.242590 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d4a8bb26-58f2-45a0-88cb-3cd1d47072a2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78" status: 200 len: 1342 microversion: 2.1 time: 0.158016 Oct 30 02:05:42.243180 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3506/6876] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:05:42 2022] GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 => generated 1342 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:05:43.266148 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-68ad85ca-2fb2-4bfb-bf45-ace8c4a3c7d4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:05:43.266891 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-68ad85ca-2fb2-4bfb-bf45-ace8c4a3c7d4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:05:43.269667 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=52 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:05:43.274691 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-68ad85ca-2fb2-4bfb-bf45-ace8c4a3c7d4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:43.275195 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-68ad85ca-2fb2-4bfb-bf45-ace8c4a3c7d4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:43.275671 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-68ad85ca-2fb2-4bfb-bf45-ace8c4a3c7d4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:43.276469 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-68ad85ca-2fb2-4bfb-bf45-ace8c4a3c7d4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:43.276939 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-68ad85ca-2fb2-4bfb-bf45-ace8c4a3c7d4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:43.277397 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-68ad85ca-2fb2-4bfb-bf45-ace8c4a3c7d4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:43.414647 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-68ad85ca-2fb2-4bfb-bf45-ace8c4a3c7d4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:05:43.422425 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-68ad85ca-2fb2-4bfb-bf45-ace8c4a3c7d4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78" status: 200 len: 1342 microversion: 2.1 time: 0.160275 Oct 30 02:05:43.423001 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3507/6877] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:05:43 2022] GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 => generated 1342 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:05:44.450650 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1d1a925f-350b-433b-8dff-d3552eb4e7d8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:05:44.451352 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1d1a925f-350b-433b-8dff-d3552eb4e7d8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:05:44.459462 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1d1a925f-350b-433b-8dff-d3552eb4e7d8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:44.460019 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1d1a925f-350b-433b-8dff-d3552eb4e7d8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:44.460496 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1d1a925f-350b-433b-8dff-d3552eb4e7d8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:44.461249 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1d1a925f-350b-433b-8dff-d3552eb4e7d8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:44.461922 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1d1a925f-350b-433b-8dff-d3552eb4e7d8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:44.462578 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1d1a925f-350b-433b-8dff-d3552eb4e7d8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:44.596493 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1d1a925f-350b-433b-8dff-d3552eb4e7d8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:05:44.604356 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1d1a925f-350b-433b-8dff-d3552eb4e7d8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78" status: 200 len: 1342 microversion: 2.1 time: 0.157673 Oct 30 02:05:44.604942 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3508/6878] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:05:44 2022] GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 => generated 1342 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:05:45.627586 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-207f907c-837f-4ad6-ac37-eef704e07179 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:05:45.628395 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-207f907c-837f-4ad6-ac37-eef704e07179 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:05:45.635346 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-207f907c-837f-4ad6-ac37-eef704e07179 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:45.635866 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-207f907c-837f-4ad6-ac37-eef704e07179 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:45.636289 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-207f907c-837f-4ad6-ac37-eef704e07179 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:45.637024 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-207f907c-837f-4ad6-ac37-eef704e07179 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:45.637531 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-207f907c-837f-4ad6-ac37-eef704e07179 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:45.637973 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-207f907c-837f-4ad6-ac37-eef704e07179 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:45.771321 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-207f907c-837f-4ad6-ac37-eef704e07179 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:05:45.779168 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-207f907c-837f-4ad6-ac37-eef704e07179 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78" status: 200 len: 1376 microversion: 2.1 time: 0.155582 Oct 30 02:05:45.779763 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3509/6879] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:05:45 2022] GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 => generated 1376 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:05:46.804202 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4e46b64a-33ad-499d-b343-7acb2051cf6f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:05:46.804817 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4e46b64a-33ad-499d-b343-7acb2051cf6f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:05:46.811453 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4e46b64a-33ad-499d-b343-7acb2051cf6f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:46.811947 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4e46b64a-33ad-499d-b343-7acb2051cf6f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:46.812403 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4e46b64a-33ad-499d-b343-7acb2051cf6f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:46.813117 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4e46b64a-33ad-499d-b343-7acb2051cf6f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:46.813615 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4e46b64a-33ad-499d-b343-7acb2051cf6f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:46.814060 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4e46b64a-33ad-499d-b343-7acb2051cf6f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:46.943948 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4e46b64a-33ad-499d-b343-7acb2051cf6f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:05:46.951840 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4e46b64a-33ad-499d-b343-7acb2051cf6f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78" status: 200 len: 1376 microversion: 2.1 time: 0.151672 Oct 30 02:05:46.952622 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3510/6880] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:05:46 2022] GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 => generated 1376 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:05:47.976028 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-82dc499f-f59e-479f-8e20-5883edb9033f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:05:47.976656 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-82dc499f-f59e-479f-8e20-5883edb9033f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:05:47.983744 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-82dc499f-f59e-479f-8e20-5883edb9033f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:47.984245 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-82dc499f-f59e-479f-8e20-5883edb9033f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:47.984705 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-82dc499f-f59e-479f-8e20-5883edb9033f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:47.985455 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-82dc499f-f59e-479f-8e20-5883edb9033f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:47.985932 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-82dc499f-f59e-479f-8e20-5883edb9033f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:47.986379 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-82dc499f-f59e-479f-8e20-5883edb9033f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:48.120924 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-82dc499f-f59e-479f-8e20-5883edb9033f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:05:48.128872 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-82dc499f-f59e-479f-8e20-5883edb9033f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78" status: 200 len: 1376 microversion: 2.1 time: 0.157299 Oct 30 02:05:48.129479 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3511/6881] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:05:47 2022] GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 => generated 1376 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:05:49.151548 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ada9e299-319b-43e4-8af2-2fc55a910cdb tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:05:49.152218 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ada9e299-319b-43e4-8af2-2fc55a910cdb tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:05:49.159063 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ada9e299-319b-43e4-8af2-2fc55a910cdb tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:49.160187 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ada9e299-319b-43e4-8af2-2fc55a910cdb tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:49.160646 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ada9e299-319b-43e4-8af2-2fc55a910cdb tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:49.161385 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ada9e299-319b-43e4-8af2-2fc55a910cdb tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:49.161864 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ada9e299-319b-43e4-8af2-2fc55a910cdb tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:49.162306 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ada9e299-319b-43e4-8af2-2fc55a910cdb tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:49.296800 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ada9e299-319b-43e4-8af2-2fc55a910cdb tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:05:49.304887 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ada9e299-319b-43e4-8af2-2fc55a910cdb tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78" status: 200 len: 1376 microversion: 2.1 time: 0.157413 Oct 30 02:05:49.305482 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3512/6882] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:05:49 2022] GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 => generated 1376 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:05:50.327659 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4891bfa2-4b29-487e-8638-57251f9383f4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:05:50.328323 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4891bfa2-4b29-487e-8638-57251f9383f4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:05:50.335342 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4891bfa2-4b29-487e-8638-57251f9383f4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:50.335835 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4891bfa2-4b29-487e-8638-57251f9383f4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:50.336284 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4891bfa2-4b29-487e-8638-57251f9383f4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:50.336989 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4891bfa2-4b29-487e-8638-57251f9383f4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:50.337479 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4891bfa2-4b29-487e-8638-57251f9383f4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:50.337924 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4891bfa2-4b29-487e-8638-57251f9383f4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:50.467263 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4891bfa2-4b29-487e-8638-57251f9383f4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:05:50.475492 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4891bfa2-4b29-487e-8638-57251f9383f4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78" status: 200 len: 1376 microversion: 2.1 time: 0.151810 Oct 30 02:05:50.476059 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3513/6883] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:05:50 2022] GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 => generated 1376 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:05:51.499433 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b0cb1cae-5545-499f-a90c-3b8f728d8be9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:05:51.500081 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b0cb1cae-5545-499f-a90c-3b8f728d8be9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:05:51.507179 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0cb1cae-5545-499f-a90c-3b8f728d8be9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:51.511757 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0cb1cae-5545-499f-a90c-3b8f728d8be9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:51.511757 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0cb1cae-5545-499f-a90c-3b8f728d8be9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:51.511757 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0cb1cae-5545-499f-a90c-3b8f728d8be9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:51.511757 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0cb1cae-5545-499f-a90c-3b8f728d8be9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:51.511757 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0cb1cae-5545-499f-a90c-3b8f728d8be9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:51.642546 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b0cb1cae-5545-499f-a90c-3b8f728d8be9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:05:51.651185 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b0cb1cae-5545-499f-a90c-3b8f728d8be9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78" status: 200 len: 1376 microversion: 2.1 time: 0.155802 Oct 30 02:05:51.651769 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3514/6884] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:05:51 2022] GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 => generated 1376 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:05:52.673918 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-00a4a9e9-25d2-40e6-985c-8d2eb67e6def tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:05:52.674549 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-00a4a9e9-25d2-40e6-985c-8d2eb67e6def tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:05:52.682113 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00a4a9e9-25d2-40e6-985c-8d2eb67e6def tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:52.682612 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00a4a9e9-25d2-40e6-985c-8d2eb67e6def tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:52.683068 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00a4a9e9-25d2-40e6-985c-8d2eb67e6def tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:52.683774 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00a4a9e9-25d2-40e6-985c-8d2eb67e6def tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:52.684242 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00a4a9e9-25d2-40e6-985c-8d2eb67e6def tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:52.684681 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00a4a9e9-25d2-40e6-985c-8d2eb67e6def tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:52.814244 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-00a4a9e9-25d2-40e6-985c-8d2eb67e6def tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:05:52.822018 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-00a4a9e9-25d2-40e6-985c-8d2eb67e6def tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78" status: 200 len: 1376 microversion: 2.1 time: 0.152099 Oct 30 02:05:52.824155 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3515/6885] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:05:52 2022] GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 => generated 1376 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:05:53.845771 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0caf8eca-3b0a-49d6-96e2-738e15473670 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:05:53.846418 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0caf8eca-3b0a-49d6-96e2-738e15473670 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:05:53.853869 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0caf8eca-3b0a-49d6-96e2-738e15473670 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:53.854389 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0caf8eca-3b0a-49d6-96e2-738e15473670 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:53.854834 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0caf8eca-3b0a-49d6-96e2-738e15473670 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:53.855534 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0caf8eca-3b0a-49d6-96e2-738e15473670 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:53.855997 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0caf8eca-3b0a-49d6-96e2-738e15473670 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:53.856434 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0caf8eca-3b0a-49d6-96e2-738e15473670 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:53.990641 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0caf8eca-3b0a-49d6-96e2-738e15473670 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:05:53.998480 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0caf8eca-3b0a-49d6-96e2-738e15473670 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78" status: 200 len: 1376 microversion: 2.1 time: 0.156760 Oct 30 02:05:53.999055 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3516/6886] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:05:53 2022] GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 => generated 1376 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:05:55.021769 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fe063e91-66b3-4353-92be-19f87fe21daa tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:05:55.022412 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fe063e91-66b3-4353-92be-19f87fe21daa tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:05:55.029604 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fe063e91-66b3-4353-92be-19f87fe21daa tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:55.030121 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fe063e91-66b3-4353-92be-19f87fe21daa tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:55.030568 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fe063e91-66b3-4353-92be-19f87fe21daa tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:55.031303 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fe063e91-66b3-4353-92be-19f87fe21daa tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:55.031770 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fe063e91-66b3-4353-92be-19f87fe21daa tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:55.032206 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fe063e91-66b3-4353-92be-19f87fe21daa tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:55.161377 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-fe063e91-66b3-4353-92be-19f87fe21daa tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:05:55.169110 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fe063e91-66b3-4353-92be-19f87fe21daa tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78" status: 200 len: 1376 microversion: 2.1 time: 0.152386 Oct 30 02:05:55.169711 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3517/6887] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:05:55 2022] GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 => generated 1376 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:05:56.192155 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7a15ed58-7145-449c-ac73-24bebbe575be tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:05:56.192821 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7a15ed58-7145-449c-ac73-24bebbe575be tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:05:56.200122 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7a15ed58-7145-449c-ac73-24bebbe575be tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:56.200618 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7a15ed58-7145-449c-ac73-24bebbe575be tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:56.201065 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7a15ed58-7145-449c-ac73-24bebbe575be tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:56.201797 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7a15ed58-7145-449c-ac73-24bebbe575be tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:56.202265 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7a15ed58-7145-449c-ac73-24bebbe575be tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:56.202702 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7a15ed58-7145-449c-ac73-24bebbe575be tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:56.337183 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7a15ed58-7145-449c-ac73-24bebbe575be tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:05:56.344974 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7a15ed58-7145-449c-ac73-24bebbe575be tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78" status: 200 len: 1376 microversion: 2.1 time: 0.156756 Oct 30 02:05:56.345587 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3518/6888] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:05:56 2022] GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 => generated 1376 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:05:57.368785 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-12aa43a4-78a4-4230-ad1d-689e7469bce1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:05:57.369485 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-12aa43a4-78a4-4230-ad1d-689e7469bce1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:05:57.376421 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-12aa43a4-78a4-4230-ad1d-689e7469bce1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:57.376920 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-12aa43a4-78a4-4230-ad1d-689e7469bce1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:57.377393 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-12aa43a4-78a4-4230-ad1d-689e7469bce1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:57.378103 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-12aa43a4-78a4-4230-ad1d-689e7469bce1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:57.378636 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-12aa43a4-78a4-4230-ad1d-689e7469bce1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:57.379070 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-12aa43a4-78a4-4230-ad1d-689e7469bce1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:57.514873 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-12aa43a4-78a4-4230-ad1d-689e7469bce1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:05:57.523136 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-12aa43a4-78a4-4230-ad1d-689e7469bce1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78" status: 200 len: 1376 microversion: 2.1 time: 0.158989 Oct 30 02:05:57.523716 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3519/6889] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:05:57 2022] GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 => generated 1376 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:05:57.614707 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-ac47b816-b7b1-453e-b799-97f40f2c5995 req-6188e50a-1e3f-4735-bf7b-3c39ac2b9acc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69d3c7df-4f0d-4402-8ad7-880f69c13e78", "name": "network-vif-plugged", "status": "completed", "tag": "4a840186-bf5a-4f55-a071-afa4681ce47f"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:05:57.624941 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ac47b816-b7b1-453e-b799-97f40f2c5995 req-6188e50a-1e3f-4735-bf7b-3c39ac2b9acc service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:57.625475 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ac47b816-b7b1-453e-b799-97f40f2c5995 req-6188e50a-1e3f-4735-bf7b-3c39ac2b9acc service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:57.625919 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ac47b816-b7b1-453e-b799-97f40f2c5995 req-6188e50a-1e3f-4735-bf7b-3c39ac2b9acc service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:57.636673 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-ac47b816-b7b1-453e-b799-97f40f2c5995 req-6188e50a-1e3f-4735-bf7b-3c39ac2b9acc service nova] Creating event network-vif-plugged:4a840186-bf5a-4f55-a071-afa4681ce47f for instance 69d3c7df-4f0d-4402-8ad7-880f69c13e78 on n-h1-master-1 Oct 30 02:05:57.642539 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-ac47b816-b7b1-453e-b799-97f40f2c5995 req-6188e50a-1e3f-4735-bf7b-3c39ac2b9acc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031413 Oct 30 02:05:57.643132 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3520/6890] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:05:58.546810 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c8a864ff-3742-4591-8b6a-d567bbfc2488 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:05:58.547529 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c8a864ff-3742-4591-8b6a-d567bbfc2488 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:05:58.554727 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c8a864ff-3742-4591-8b6a-d567bbfc2488 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:58.555222 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c8a864ff-3742-4591-8b6a-d567bbfc2488 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:58.555669 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c8a864ff-3742-4591-8b6a-d567bbfc2488 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:58.556376 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c8a864ff-3742-4591-8b6a-d567bbfc2488 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:58.556844 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c8a864ff-3742-4591-8b6a-d567bbfc2488 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:58.557285 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c8a864ff-3742-4591-8b6a-d567bbfc2488 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:58.572784 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:05:58.690723 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c8a864ff-3742-4591-8b6a-d567bbfc2488 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:05:58.699069 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c8a864ff-3742-4591-8b6a-d567bbfc2488 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78" status: 200 len: 1376 microversion: 2.1 time: 0.156561 Oct 30 02:05:58.699641 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3521/6891] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:05:58 2022] GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 => generated 1376 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:05:59.723419 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-82b9c7cc-e596-4d45-a024-90e52ef9baea tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:05:59.724095 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-82b9c7cc-e596-4d45-a024-90e52ef9baea tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:05:59.731684 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-82b9c7cc-e596-4d45-a024-90e52ef9baea tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:59.735764 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-82b9c7cc-e596-4d45-a024-90e52ef9baea tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:59.735764 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-82b9c7cc-e596-4d45-a024-90e52ef9baea tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:59.735764 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-82b9c7cc-e596-4d45-a024-90e52ef9baea tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:59.735764 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-82b9c7cc-e596-4d45-a024-90e52ef9baea tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:59.735764 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-82b9c7cc-e596-4d45-a024-90e52ef9baea tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:59.862659 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-82b9c7cc-e596-4d45-a024-90e52ef9baea tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:05:59.870615 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-82b9c7cc-e596-4d45-a024-90e52ef9baea tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78" status: 200 len: 1564 microversion: 2.1 time: 0.151105 Oct 30 02:05:59.871177 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3522/6892] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:05:59 2022] GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 => generated 1564 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:05:59.892849 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-dc3ccf03-c122-4321-a087-c3aac863d20f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:05:59.893506 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-dc3ccf03-c122-4321-a087-c3aac863d20f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:05:59.900328 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dc3ccf03-c122-4321-a087-c3aac863d20f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:59.900832 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dc3ccf03-c122-4321-a087-c3aac863d20f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:59.901286 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dc3ccf03-c122-4321-a087-c3aac863d20f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:05:59.902024 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dc3ccf03-c122-4321-a087-c3aac863d20f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:05:59.902543 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dc3ccf03-c122-4321-a087-c3aac863d20f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:05:59.902983 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dc3ccf03-c122-4321-a087-c3aac863d20f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:00.035056 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-dc3ccf03-c122-4321-a087-c3aac863d20f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:06:00.042980 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-dc3ccf03-c122-4321-a087-c3aac863d20f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78" status: 200 len: 1564 microversion: 2.1 time: 0.153935 Oct 30 02:06:00.043670 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3523/6893] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:05:59 2022] GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 => generated 1564 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:06:00.123503 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a46dc39c-7c65-48ba-8f02-a3f4022d0a5a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:06:00.124022 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a46dc39c-7c65-48ba-8f02-a3f4022d0a5a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:06:00.130300 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a46dc39c-7c65-48ba-8f02-a3f4022d0a5a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:00.130800 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a46dc39c-7c65-48ba-8f02-a3f4022d0a5a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:00.131802 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a46dc39c-7c65-48ba-8f02-a3f4022d0a5a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:00.132512 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a46dc39c-7c65-48ba-8f02-a3f4022d0a5a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:00.132985 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a46dc39c-7c65-48ba-8f02-a3f4022d0a5a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:00.133469 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a46dc39c-7c65-48ba-8f02-a3f4022d0a5a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:00.162653 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a46dc39c-7c65-48ba-8f02-a3f4022d0a5a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 02:06:00.498437 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a46dc39c-7c65-48ba-8f02-a3f4022d0a5a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "DELETE /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78" status: 204 len: 0 microversion: 2.1 time: 0.378470 Oct 30 02:06:00.499038 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3524/6894] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 02:06:00 2022] DELETE /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 30 02:06:00.508076 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-70bf0320-7a1f-4c62-a2e4-aece35e0057b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:06:00.508774 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-70bf0320-7a1f-4c62-a2e4-aece35e0057b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:06:00.514628 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-70bf0320-7a1f-4c62-a2e4-aece35e0057b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:00.515119 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-70bf0320-7a1f-4c62-a2e4-aece35e0057b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:00.515565 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-70bf0320-7a1f-4c62-a2e4-aece35e0057b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:00.516263 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-70bf0320-7a1f-4c62-a2e4-aece35e0057b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:00.516724 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-70bf0320-7a1f-4c62-a2e4-aece35e0057b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:00.517158 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-70bf0320-7a1f-4c62-a2e4-aece35e0057b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:00.648031 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-70bf0320-7a1f-4c62-a2e4-aece35e0057b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:06:00.656118 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-70bf0320-7a1f-4c62-a2e4-aece35e0057b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78" status: 200 len: 1570 microversion: 2.1 time: 0.152586 Oct 30 02:06:00.656811 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3525/6895] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:06:00 2022] GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:06:01.734331 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9d414db3-41f1-4a2e-8c23-9616cda92d25 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:06:01.734952 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9d414db3-41f1-4a2e-8c23-9616cda92d25 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:06:01.741502 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9d414db3-41f1-4a2e-8c23-9616cda92d25 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:01.742005 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9d414db3-41f1-4a2e-8c23-9616cda92d25 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:01.742452 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9d414db3-41f1-4a2e-8c23-9616cda92d25 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:01.743149 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9d414db3-41f1-4a2e-8c23-9616cda92d25 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:01.743614 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9d414db3-41f1-4a2e-8c23-9616cda92d25 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:01.744051 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9d414db3-41f1-4a2e-8c23-9616cda92d25 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:01.876490 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9d414db3-41f1-4a2e-8c23-9616cda92d25 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:06:01.885136 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9d414db3-41f1-4a2e-8c23-9616cda92d25 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78" status: 200 len: 1570 microversion: 2.1 time: 0.209332 Oct 30 02:06:01.885744 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3526/6896] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:06:01 2022] GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 => generated 1570 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:06:02.913454 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-9cf41788-36e6-4635-b6f8-9c81b334162c req-308e0f03-9191-462b-a5c2-24c9fe37003e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69d3c7df-4f0d-4402-8ad7-880f69c13e78", "name": "network-vif-deleted", "tag": "4a840186-bf5a-4f55-a071-afa4681ce47f"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:06:02.923734 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-9cf41788-36e6-4635-b6f8-9c81b334162c req-308e0f03-9191-462b-a5c2-24c9fe37003e service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:02.924242 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-9cf41788-36e6-4635-b6f8-9c81b334162c req-308e0f03-9191-462b-a5c2-24c9fe37003e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:02.924687 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-9cf41788-36e6-4635-b6f8-9c81b334162c req-308e0f03-9191-462b-a5c2-24c9fe37003e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:02.937238 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-9cf41788-36e6-4635-b6f8-9c81b334162c req-308e0f03-9191-462b-a5c2-24c9fe37003e service nova] Creating event network-vif-deleted:4a840186-bf5a-4f55-a071-afa4681ce47f for instance 69d3c7df-4f0d-4402-8ad7-880f69c13e78 on n-h1-master-1 Oct 30 02:06:02.942380 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-9cf41788-36e6-4635-b6f8-9c81b334162c req-308e0f03-9191-462b-a5c2-24c9fe37003e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110501 Oct 30 02:06:02.943292 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3527/6897] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:06:02.949875 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-aa8832e4-3d01-469b-a011-4e76944f94d4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:06:02.950075 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-aa8832e4-3d01-469b-a011-4e76944f94d4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:06:02.957104 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aa8832e4-3d01-469b-a011-4e76944f94d4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:02.957661 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aa8832e4-3d01-469b-a011-4e76944f94d4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:02.958138 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aa8832e4-3d01-469b-a011-4e76944f94d4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:02.958858 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aa8832e4-3d01-469b-a011-4e76944f94d4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:02.960072 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aa8832e4-3d01-469b-a011-4e76944f94d4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:02.960535 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aa8832e4-3d01-469b-a011-4e76944f94d4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:03.026378 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-aa8832e4-3d01-469b-a011-4e76944f94d4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:06:03.034320 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-aa8832e4-3d01-469b-a011-4e76944f94d4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78" status: 200 len: 1528 microversion: 2.1 time: 0.089142 Oct 30 02:06:03.034910 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3528/6898] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:06:02 2022] GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 => generated 1528 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:06:04.057641 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-22c7d8e2-db9a-4d17-94ea-510c397f45fd tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:06:04.058311 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-22c7d8e2-db9a-4d17-94ea-510c397f45fd tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:06:04.065416 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-22c7d8e2-db9a-4d17-94ea-510c397f45fd tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:04.065948 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-22c7d8e2-db9a-4d17-94ea-510c397f45fd tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:04.066406 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-22c7d8e2-db9a-4d17-94ea-510c397f45fd tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:04.067127 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-22c7d8e2-db9a-4d17-94ea-510c397f45fd tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:04.067603 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-22c7d8e2-db9a-4d17-94ea-510c397f45fd tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:04.068048 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-22c7d8e2-db9a-4d17-94ea-510c397f45fd tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:04.133442 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-22c7d8e2-db9a-4d17-94ea-510c397f45fd tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:06:04.141642 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-22c7d8e2-db9a-4d17-94ea-510c397f45fd tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78" status: 200 len: 1361 microversion: 2.1 time: 0.088092 Oct 30 02:06:04.142228 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3529/6899] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:06:04 2022] GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 => generated 1361 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:06:05.164483 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5f095564-ba73-4d76-8901-31f0c79a2dea tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:06:05.165224 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5f095564-ba73-4d76-8901-31f0c79a2dea tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:06:05.172249 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f095564-ba73-4d76-8901-31f0c79a2dea tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:05.172738 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f095564-ba73-4d76-8901-31f0c79a2dea tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:05.173185 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f095564-ba73-4d76-8901-31f0c79a2dea tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:05.173915 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f095564-ba73-4d76-8901-31f0c79a2dea tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:05.174377 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f095564-ba73-4d76-8901-31f0c79a2dea tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:05.174810 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f095564-ba73-4d76-8901-31f0c79a2dea tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:05.244437 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5f095564-ba73-4d76-8901-31f0c79a2dea tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:06:05.252477 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5f095564-ba73-4d76-8901-31f0c79a2dea tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78" status: 200 len: 1361 microversion: 2.1 time: 0.092196 Oct 30 02:06:05.253053 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3530/6900] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:06:05 2022] GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 => generated 1361 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:06:06.276672 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9674912e-a997-479b-b9ad-fa3725292400 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:06:06.277369 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9674912e-a997-479b-b9ad-fa3725292400 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:06:06.284485 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9674912e-a997-479b-b9ad-fa3725292400 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:06.284983 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9674912e-a997-479b-b9ad-fa3725292400 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:06.285463 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9674912e-a997-479b-b9ad-fa3725292400 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:06.286176 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9674912e-a997-479b-b9ad-fa3725292400 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:06.286644 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9674912e-a997-479b-b9ad-fa3725292400 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:06.287081 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9674912e-a997-479b-b9ad-fa3725292400 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:06.354764 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9674912e-a997-479b-b9ad-fa3725292400 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:06:06.363067 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9674912e-a997-479b-b9ad-fa3725292400 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78" status: 200 len: 1361 microversion: 2.1 time: 0.090358 Oct 30 02:06:06.371790 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3531/6901] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:06:06 2022] GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 => generated 1361 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:06:07.391596 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2410c1c9-3eba-4ae6-a773-4855e49630cf tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:06:07.391596 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2410c1c9-3eba-4ae6-a773-4855e49630cf tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:06:07.394391 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2410c1c9-3eba-4ae6-a773-4855e49630cf tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:07.394885 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2410c1c9-3eba-4ae6-a773-4855e49630cf tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:07.395331 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2410c1c9-3eba-4ae6-a773-4855e49630cf tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:07.396037 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2410c1c9-3eba-4ae6-a773-4855e49630cf tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:07.396512 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2410c1c9-3eba-4ae6-a773-4855e49630cf tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:07.397605 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2410c1c9-3eba-4ae6-a773-4855e49630cf tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:07.462239 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2410c1c9-3eba-4ae6-a773-4855e49630cf tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:06:07.470214 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2410c1c9-3eba-4ae6-a773-4855e49630cf tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78" status: 200 len: 1361 microversion: 2.1 time: 0.087228 Oct 30 02:06:07.470787 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3532/6902] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:06:07 2022] GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 => generated 1361 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:06:08.495640 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2513dd30-a46c-48c5-948e-d051a239ac8e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:06:08.495640 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2513dd30-a46c-48c5-948e-d051a239ac8e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:06:08.503535 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2513dd30-a46c-48c5-948e-d051a239ac8e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:08.505349 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2513dd30-a46c-48c5-948e-d051a239ac8e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:08.506653 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2513dd30-a46c-48c5-948e-d051a239ac8e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:08.507768 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2513dd30-a46c-48c5-948e-d051a239ac8e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:08.508479 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2513dd30-a46c-48c5-948e-d051a239ac8e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:08.509128 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2513dd30-a46c-48c5-948e-d051a239ac8e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:08.547391 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2513dd30-a46c-48c5-948e-d051a239ac8e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:08.547893 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2513dd30-a46c-48c5-948e-d051a239ac8e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:08.548385 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2513dd30-a46c-48c5-948e-d051a239ac8e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:08.548963 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-2513dd30-a46c-48c5-948e-d051a239ac8e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lazy-loading 'fault' on Instance uuid 69d3c7df-4f0d-4402-8ad7-880f69c13e78 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 02:06:08.593696 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2513dd30-a46c-48c5-948e-d051a239ac8e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:06:08.602228 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2513dd30-a46c-48c5-948e-d051a239ac8e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78" status: 200 len: 1366 microversion: 2.1 time: 0.112218 Oct 30 02:06:08.602828 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3533/6903] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:06:08 2022] GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 => generated 1366 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:06:09.626899 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-095f8219-d679-4f62-9a16-23e8a9fbb61f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:06:09.627551 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-095f8219-d679-4f62-9a16-23e8a9fbb61f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:06:09.634410 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-095f8219-d679-4f62-9a16-23e8a9fbb61f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:09.634912 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-095f8219-d679-4f62-9a16-23e8a9fbb61f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:09.635364 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-095f8219-d679-4f62-9a16-23e8a9fbb61f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:09.636076 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-095f8219-d679-4f62-9a16-23e8a9fbb61f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:09.636550 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-095f8219-d679-4f62-9a16-23e8a9fbb61f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:09.636988 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-095f8219-d679-4f62-9a16-23e8a9fbb61f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:09.650621 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-095f8219-d679-4f62-9a16-23e8a9fbb61f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] HTTP exception thrown: Instance 69d3c7df-4f0d-4402-8ad7-880f69c13e78 could not be found. Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-095f8219-d679-4f62-9a16-23e8a9fbb61f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Request method failure captured: Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 HTTP/1.1 Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdrUzAoetWsdn8k4HYTcqbVG7Zs75eMmndnkEOPA0S-TmAgSQ2b5nMGLS0qTcKbMaQTaaQPoAGl2nSU9lucNctaJ1zTE6xKSNocI5VbroWnIgVb8SnDnXRJPuQdp0_RS-b7KWfvV5q_soI5fUH8iU2dwXESX56PU08-DTzNpHjo6aLI Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 99e1cde224c845caaa743246e60e338d Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-TestVolumeBootPattern-1509499038 Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/99e1cde224c845caaa743246e60e338d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_99e1cde224c845caaa743246e60e338d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/99e1cde224c845caaa743246e60e338d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/99e1cde224c845caaa743246e60e338d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-TestVolumeBootPattern-1509499038 Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 99e1cde224c845caaa743246e60e338d Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-TestVolumeBootPattern-1509499038 Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-TestVolumeBootPattern-1509499038-project Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: a0ec990e687d427d88dcf9879a1d5b0c Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-TestVolumeBootPattern-1509499038-project Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 69d3c7df-4f0d-4402-8ad7-880f69c13e78 could not be found. Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '69d3c7df-4f0d-4402-8ad7-880f69c13e78'} Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69d3c7df-4f0d-4402-8ad7-880f69c13e78 could not be found. Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69d3c7df-4f0d-4402-8ad7-880f69c13e78 could not be found. Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:06:09.652342 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:06:09.656418 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:06:09.656418 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:06:09.656418 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:06:09.656418 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:06:09.656418 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:06:09.656418 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69d3c7df-4f0d-4402-8ad7-880f69c13e78 could not be found. Oct 30 02:06:09.656418 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:06:09.656418 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-095f8219-d679-4f62-9a16-23e8a9fbb61f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Returning 404 to user: Instance 69d3c7df-4f0d-4402-8ad7-880f69c13e78 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:06:09.656418 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-095f8219-d679-4f62-9a16-23e8a9fbb61f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78" status: 404 len: 111 microversion: 2.1 time: 0.030969 Oct 30 02:06:09.656418 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3534/6904] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:06:09 2022] GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 02:06:12.941766 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-021137e9-f882-489b-8bbe-5b6bb30ed3a9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:06:12.942422 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-021137e9-f882-489b-8bbe-5b6bb30ed3a9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:06:12.949447 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-021137e9-f882-489b-8bbe-5b6bb30ed3a9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:12.949996 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-021137e9-f882-489b-8bbe-5b6bb30ed3a9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:12.950453 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-021137e9-f882-489b-8bbe-5b6bb30ed3a9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:12.951163 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-021137e9-f882-489b-8bbe-5b6bb30ed3a9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:12.951634 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-021137e9-f882-489b-8bbe-5b6bb30ed3a9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:12.952077 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-021137e9-f882-489b-8bbe-5b6bb30ed3a9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:12.978797 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-021137e9-f882-489b-8bbe-5b6bb30ed3a9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 02:06:13.109569 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:06:13.316599 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-021137e9-f882-489b-8bbe-5b6bb30ed3a9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "DELETE /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6" status: 204 len: 0 microversion: 2.1 time: 0.378682 Oct 30 02:06:13.317185 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3535/6905] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 02:06:12 2022] DELETE /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 02:06:13.326904 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-642b0da4-4a3a-47a2-8fc2-3c50f25ee7b8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:06:13.327633 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-642b0da4-4a3a-47a2-8fc2-3c50f25ee7b8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:06:13.334417 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-642b0da4-4a3a-47a2-8fc2-3c50f25ee7b8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:13.335496 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-642b0da4-4a3a-47a2-8fc2-3c50f25ee7b8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:13.335940 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-642b0da4-4a3a-47a2-8fc2-3c50f25ee7b8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:13.336644 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-642b0da4-4a3a-47a2-8fc2-3c50f25ee7b8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:13.337111 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-642b0da4-4a3a-47a2-8fc2-3c50f25ee7b8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:13.337569 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-642b0da4-4a3a-47a2-8fc2-3c50f25ee7b8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:13.478383 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-642b0da4-4a3a-47a2-8fc2-3c50f25ee7b8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:06:13.486388 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-642b0da4-4a3a-47a2-8fc2-3c50f25ee7b8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6" status: 200 len: 1410 microversion: 2.1 time: 0.164327 Oct 30 02:06:13.486979 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3536/6906] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:06:13 2022] GET /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6 => generated 1410 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:06:14.508954 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-98d0e767-2a23-4adf-8841-51aa3e3fa9d9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:06:14.509653 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-98d0e767-2a23-4adf-8841-51aa3e3fa9d9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:06:14.512390 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:06:14.517158 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-98d0e767-2a23-4adf-8841-51aa3e3fa9d9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:14.517695 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-98d0e767-2a23-4adf-8841-51aa3e3fa9d9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:14.518143 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-98d0e767-2a23-4adf-8841-51aa3e3fa9d9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:14.518856 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-98d0e767-2a23-4adf-8841-51aa3e3fa9d9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:14.519325 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-98d0e767-2a23-4adf-8841-51aa3e3fa9d9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:14.519767 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-98d0e767-2a23-4adf-8841-51aa3e3fa9d9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:14.649960 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-98d0e767-2a23-4adf-8841-51aa3e3fa9d9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:06:14.657722 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-98d0e767-2a23-4adf-8841-51aa3e3fa9d9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6" status: 200 len: 1410 microversion: 2.1 time: 0.152702 Oct 30 02:06:14.658288 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3537/6907] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:06:14 2022] GET /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6 => generated 1410 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:06:15.530121 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-2c79f3c1-45bf-48e9-a22d-3c205939cc11 req-1ba5e3a7-36f5-4e96-9e58-2fd8c873df46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6", "name": "network-vif-deleted", "tag": "191e29b5-17f4-4bd0-889a-47415b54af04"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:06:15.541161 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-2c79f3c1-45bf-48e9-a22d-3c205939cc11 req-1ba5e3a7-36f5-4e96-9e58-2fd8c873df46 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:15.541686 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-2c79f3c1-45bf-48e9-a22d-3c205939cc11 req-1ba5e3a7-36f5-4e96-9e58-2fd8c873df46 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:15.542190 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-2c79f3c1-45bf-48e9-a22d-3c205939cc11 req-1ba5e3a7-36f5-4e96-9e58-2fd8c873df46 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:15.554000 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-2c79f3c1-45bf-48e9-a22d-3c205939cc11 req-1ba5e3a7-36f5-4e96-9e58-2fd8c873df46 service nova] Creating event network-vif-deleted:191e29b5-17f4-4bd0-889a-47415b54af04 for instance 04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6 on n-h2-master-1 Oct 30 02:06:15.558978 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-2c79f3c1-45bf-48e9-a22d-3c205939cc11 req-1ba5e3a7-36f5-4e96-9e58-2fd8c873df46 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032623 Oct 30 02:06:15.560527 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3538/6908] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:06:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:06:15.681661 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-34361388-919a-4484-a951-3f1bbae5d894 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:06:15.682333 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-34361388-919a-4484-a951-3f1bbae5d894 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:06:15.688582 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-34361388-919a-4484-a951-3f1bbae5d894 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:15.692432 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-34361388-919a-4484-a951-3f1bbae5d894 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:15.692432 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-34361388-919a-4484-a951-3f1bbae5d894 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:15.692432 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-34361388-919a-4484-a951-3f1bbae5d894 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:15.692432 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-34361388-919a-4484-a951-3f1bbae5d894 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:15.692432 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-34361388-919a-4484-a951-3f1bbae5d894 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:15.754999 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-34361388-919a-4484-a951-3f1bbae5d894 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:06:15.762994 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-34361388-919a-4484-a951-3f1bbae5d894 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6" status: 200 len: 1201 microversion: 2.1 time: 0.086271 Oct 30 02:06:15.763572 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3539/6909] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:06:15 2022] GET /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6 => generated 1201 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:06:16.785879 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-09038195-a41a-4f0b-a0ae-3868513daa83 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:06:16.786506 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-09038195-a41a-4f0b-a0ae-3868513daa83 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:06:16.793157 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-09038195-a41a-4f0b-a0ae-3868513daa83 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:16.793691 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-09038195-a41a-4f0b-a0ae-3868513daa83 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:16.794142 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-09038195-a41a-4f0b-a0ae-3868513daa83 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:16.794849 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-09038195-a41a-4f0b-a0ae-3868513daa83 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:16.795318 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-09038195-a41a-4f0b-a0ae-3868513daa83 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:16.795757 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-09038195-a41a-4f0b-a0ae-3868513daa83 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:16.859086 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-09038195-a41a-4f0b-a0ae-3868513daa83 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:06:16.867783 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-09038195-a41a-4f0b-a0ae-3868513daa83 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6" status: 200 len: 1201 microversion: 2.1 time: 0.086036 Oct 30 02:06:16.868359 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3540/6910] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:06:16 2022] GET /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6 => generated 1201 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:06:17.891124 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e713e4b9-e1a7-4def-8f8b-75f4f715e0e5 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:06:17.891735 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e713e4b9-e1a7-4def-8f8b-75f4f715e0e5 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:06:17.898748 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e713e4b9-e1a7-4def-8f8b-75f4f715e0e5 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:17.899246 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e713e4b9-e1a7-4def-8f8b-75f4f715e0e5 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:17.899692 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e713e4b9-e1a7-4def-8f8b-75f4f715e0e5 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:17.900403 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e713e4b9-e1a7-4def-8f8b-75f4f715e0e5 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:17.900866 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e713e4b9-e1a7-4def-8f8b-75f4f715e0e5 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:17.901445 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e713e4b9-e1a7-4def-8f8b-75f4f715e0e5 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:17.967570 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e713e4b9-e1a7-4def-8f8b-75f4f715e0e5 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:06:17.975929 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e713e4b9-e1a7-4def-8f8b-75f4f715e0e5 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6" status: 200 len: 1201 microversion: 2.1 time: 0.088351 Oct 30 02:06:17.976509 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3541/6911] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:06:17 2022] GET /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6 => generated 1201 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:06:18.998125 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-97c53b66-24f9-4698-a03c-311424b20e12 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:06:18.998762 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-97c53b66-24f9-4698-a03c-311424b20e12 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:06:19.006214 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-97c53b66-24f9-4698-a03c-311424b20e12 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:19.007402 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-97c53b66-24f9-4698-a03c-311424b20e12 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:19.007932 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-97c53b66-24f9-4698-a03c-311424b20e12 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:19.008732 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-97c53b66-24f9-4698-a03c-311424b20e12 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:19.009320 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-97c53b66-24f9-4698-a03c-311424b20e12 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:19.009950 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-97c53b66-24f9-4698-a03c-311424b20e12 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:19.074445 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-97c53b66-24f9-4698-a03c-311424b20e12 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:06:19.083043 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-97c53b66-24f9-4698-a03c-311424b20e12 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6" status: 200 len: 1201 microversion: 2.1 time: 0.088877 Oct 30 02:06:19.083816 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3542/6912] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:06:18 2022] GET /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6 => generated 1201 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:06:20.106442 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-99df3e97-8b62-432f-8bfa-9ecfd2e8c628 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:06:20.107120 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-99df3e97-8b62-432f-8bfa-9ecfd2e8c628 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:06:20.114616 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-99df3e97-8b62-432f-8bfa-9ecfd2e8c628 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:20.115132 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-99df3e97-8b62-432f-8bfa-9ecfd2e8c628 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:20.115591 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-99df3e97-8b62-432f-8bfa-9ecfd2e8c628 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:20.116327 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-99df3e97-8b62-432f-8bfa-9ecfd2e8c628 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:20.116799 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-99df3e97-8b62-432f-8bfa-9ecfd2e8c628 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:20.117241 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-99df3e97-8b62-432f-8bfa-9ecfd2e8c628 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:20.195146 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-99df3e97-8b62-432f-8bfa-9ecfd2e8c628 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:06:20.204590 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-99df3e97-8b62-432f-8bfa-9ecfd2e8c628 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6" status: 200 len: 1201 microversion: 2.1 time: 0.101743 Oct 30 02:06:20.205183 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3543/6913] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:06:20 2022] GET /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6 => generated 1201 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:06:21.227948 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cee7a50a-208e-401f-a803-c6fd0649379c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:06:21.228668 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cee7a50a-208e-401f-a803-c6fd0649379c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:06:21.235566 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cee7a50a-208e-401f-a803-c6fd0649379c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:21.236071 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cee7a50a-208e-401f-a803-c6fd0649379c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:21.236526 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cee7a50a-208e-401f-a803-c6fd0649379c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:21.237249 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cee7a50a-208e-401f-a803-c6fd0649379c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:21.237750 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cee7a50a-208e-401f-a803-c6fd0649379c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:21.238196 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cee7a50a-208e-401f-a803-c6fd0649379c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:21.252292 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-cee7a50a-208e-401f-a803-c6fd0649379c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] HTTP exception thrown: Instance 04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6 could not be found. Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cee7a50a-208e-401f-a803-c6fd0649379c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Request method failure captured: Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6 HTTP/1.1 Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdrUzAoetWsdn8k4HYTcqbVG7Zs75eMmndnkEOPA0S-TmAgSQ2b5nMGLS0qTcKbMaQTaaQPoAGl2nSU9lucNctaJ1zTE6xKSNocI5VbroWnIgVb8SnDnXRJPuQdp0_RS-b7KWfvV5q_soI5fUH8iU2dwXESX56PU08-DTzNpHjo6aLI Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 99e1cde224c845caaa743246e60e338d Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-TestVolumeBootPattern-1509499038 Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/99e1cde224c845caaa743246e60e338d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_99e1cde224c845caaa743246e60e338d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/99e1cde224c845caaa743246e60e338d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/99e1cde224c845caaa743246e60e338d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-TestVolumeBootPattern-1509499038 Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 99e1cde224c845caaa743246e60e338d Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-TestVolumeBootPattern-1509499038 Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-TestVolumeBootPattern-1509499038-project Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: a0ec990e687d427d88dcf9879a1d5b0c Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-TestVolumeBootPattern-1509499038-project Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6 could not be found. Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6'} Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6 could not be found. Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6 could not be found. Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:06:21.254076 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:06:21.258471 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:06:21.258471 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:06:21.258471 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:06:21.258471 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:06:21.258471 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:06:21.258471 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6 could not be found. Oct 30 02:06:21.258471 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:06:21.258471 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cee7a50a-208e-401f-a803-c6fd0649379c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Returning 404 to user: Instance 04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:06:21.258471 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cee7a50a-208e-401f-a803-c6fd0649379c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6" status: 404 len: 111 microversion: 2.1 time: 0.032279 Oct 30 02:06:21.258471 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3544/6914] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:06:21 2022] GET /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 02:06:23.396339 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ba37703c-ee7a-4921-aced-e14cbdfcf7b9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:06:23.396951 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ba37703c-ee7a-4921-aced-e14cbdfcf7b9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:06:23.399163 n-d-master-1 devstack@n-api.service[121102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 30 02:06:23.399324 n-d-master-1 devstack@n-api.service[121102]: Sun Oct 30 02:06:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 (ip 10.222.0.13) !!! Oct 30 02:06:23.407042 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ba37703c-ee7a-4921-aced-e14cbdfcf7b9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:23.407546 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ba37703c-ee7a-4921-aced-e14cbdfcf7b9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:23.408004 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ba37703c-ee7a-4921-aced-e14cbdfcf7b9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:23.408729 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ba37703c-ee7a-4921-aced-e14cbdfcf7b9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:23.409206 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ba37703c-ee7a-4921-aced-e14cbdfcf7b9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:23.409699 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ba37703c-ee7a-4921-aced-e14cbdfcf7b9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:23.424571 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-ba37703c-ee7a-4921-aced-e14cbdfcf7b9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] HTTP exception thrown: Instance 69d3c7df-4f0d-4402-8ad7-880f69c13e78 could not be found. Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ba37703c-ee7a-4921-aced-e14cbdfcf7b9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Request method failure captured: Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 HTTP/1.1 Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdrUzAoetWsdn8k4HYTcqbVG7Zs75eMmndnkEOPA0S-TmAgSQ2b5nMGLS0qTcKbMaQTaaQPoAGl2nSU9lucNctaJ1zTE6xKSNocI5VbroWnIgVb8SnDnXRJPuQdp0_RS-b7KWfvV5q_soI5fUH8iU2dwXESX56PU08-DTzNpHjo6aLI Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 99e1cde224c845caaa743246e60e338d Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-TestVolumeBootPattern-1509499038 Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/99e1cde224c845caaa743246e60e338d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_99e1cde224c845caaa743246e60e338d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/99e1cde224c845caaa743246e60e338d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/99e1cde224c845caaa743246e60e338d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-TestVolumeBootPattern-1509499038 Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 99e1cde224c845caaa743246e60e338d Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-TestVolumeBootPattern-1509499038 Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-TestVolumeBootPattern-1509499038-project Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: a0ec990e687d427d88dcf9879a1d5b0c Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-TestVolumeBootPattern-1509499038-project Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 69d3c7df-4f0d-4402-8ad7-880f69c13e78 could not be found. Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '69d3c7df-4f0d-4402-8ad7-880f69c13e78'} Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69d3c7df-4f0d-4402-8ad7-880f69c13e78 could not be found. Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 02:06:23.426207 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 02:06:23.430267 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69d3c7df-4f0d-4402-8ad7-880f69c13e78 could not be found. Oct 30 02:06:23.430267 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:06:23.430267 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:06:23.430267 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:06:23.430267 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:06:23.430267 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:06:23.430267 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:06:23.430267 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:06:23.430267 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:06:23.430267 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69d3c7df-4f0d-4402-8ad7-880f69c13e78 could not be found. Oct 30 02:06:23.430267 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:06:23.430267 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ba37703c-ee7a-4921-aced-e14cbdfcf7b9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Returning 404 to user: Instance 69d3c7df-4f0d-4402-8ad7-880f69c13e78 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:06:23.430267 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ba37703c-ee7a-4921-aced-e14cbdfcf7b9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "DELETE /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78" status: 404 len: 111 microversion: 2.1 time: 0.035377 Oct 30 02:06:23.430267 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3545/6915] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 02:06:23 2022] DELETE /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 02:06:23.436661 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-233085d8-3423-4be1-b374-8deb35a18a52 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:06:23.437292 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-233085d8-3423-4be1-b374-8deb35a18a52 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 69d3c7df-4f0d-4402-8ad7-880f69c13e78] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:06:23.443165 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-233085d8-3423-4be1-b374-8deb35a18a52 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:23.443669 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-233085d8-3423-4be1-b374-8deb35a18a52 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:23.444126 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-233085d8-3423-4be1-b374-8deb35a18a52 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:23.444838 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-233085d8-3423-4be1-b374-8deb35a18a52 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:23.445968 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-233085d8-3423-4be1-b374-8deb35a18a52 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:23.446419 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-233085d8-3423-4be1-b374-8deb35a18a52 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:23.460211 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-233085d8-3423-4be1-b374-8deb35a18a52 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] HTTP exception thrown: Instance 69d3c7df-4f0d-4402-8ad7-880f69c13e78 could not be found. Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-233085d8-3423-4be1-b374-8deb35a18a52 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Request method failure captured: Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 HTTP/1.1 Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdrUzAoetWsdn8k4HYTcqbVG7Zs75eMmndnkEOPA0S-TmAgSQ2b5nMGLS0qTcKbMaQTaaQPoAGl2nSU9lucNctaJ1zTE6xKSNocI5VbroWnIgVb8SnDnXRJPuQdp0_RS-b7KWfvV5q_soI5fUH8iU2dwXESX56PU08-DTzNpHjo6aLI Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 99e1cde224c845caaa743246e60e338d Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-TestVolumeBootPattern-1509499038 Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/99e1cde224c845caaa743246e60e338d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_99e1cde224c845caaa743246e60e338d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/99e1cde224c845caaa743246e60e338d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/99e1cde224c845caaa743246e60e338d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-TestVolumeBootPattern-1509499038 Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 99e1cde224c845caaa743246e60e338d Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-TestVolumeBootPattern-1509499038 Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-TestVolumeBootPattern-1509499038-project Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: a0ec990e687d427d88dcf9879a1d5b0c Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-TestVolumeBootPattern-1509499038-project Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 69d3c7df-4f0d-4402-8ad7-880f69c13e78 could not be found. Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '69d3c7df-4f0d-4402-8ad7-880f69c13e78'} Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69d3c7df-4f0d-4402-8ad7-880f69c13e78 could not be found. Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69d3c7df-4f0d-4402-8ad7-880f69c13e78 could not be found. Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:06:23.461802 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:06:23.466566 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:06:23.466566 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:06:23.466566 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:06:23.466566 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:06:23.466566 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:06:23.466566 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69d3c7df-4f0d-4402-8ad7-880f69c13e78 could not be found. Oct 30 02:06:23.466566 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:06:23.466566 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-233085d8-3423-4be1-b374-8deb35a18a52 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Returning 404 to user: Instance 69d3c7df-4f0d-4402-8ad7-880f69c13e78 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:06:23.466566 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-233085d8-3423-4be1-b374-8deb35a18a52 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78" status: 404 len: 111 microversion: 2.1 time: 0.030204 Oct 30 02:06:23.467474 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3546/6916] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:06:23 2022] GET /compute/v2.1/servers/69d3c7df-4f0d-4402-8ad7-880f69c13e78 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 02:06:24.218234 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1c061e62-afcc-4f86-9e31-ed8520a0a15a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:06:24.218759 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1c061e62-afcc-4f86-9e31-ed8520a0a15a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:06:24.224715 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1c061e62-afcc-4f86-9e31-ed8520a0a15a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:24.225222 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1c061e62-afcc-4f86-9e31-ed8520a0a15a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:24.225850 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1c061e62-afcc-4f86-9e31-ed8520a0a15a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:24.226598 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1c061e62-afcc-4f86-9e31-ed8520a0a15a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:24.227073 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1c061e62-afcc-4f86-9e31-ed8520a0a15a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:24.227517 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1c061e62-afcc-4f86-9e31-ed8520a0a15a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:24.241127 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-1c061e62-afcc-4f86-9e31-ed8520a0a15a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] HTTP exception thrown: Instance 04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6 could not be found. Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1c061e62-afcc-4f86-9e31-ed8520a0a15a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Request method failure captured: Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6 HTTP/1.1 Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdrUzAoetWsdn8k4HYTcqbVG7Zs75eMmndnkEOPA0S-TmAgSQ2b5nMGLS0qTcKbMaQTaaQPoAGl2nSU9lucNctaJ1zTE6xKSNocI5VbroWnIgVb8SnDnXRJPuQdp0_RS-b7KWfvV5q_soI5fUH8iU2dwXESX56PU08-DTzNpHjo6aLI Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 99e1cde224c845caaa743246e60e338d Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-TestVolumeBootPattern-1509499038 Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/99e1cde224c845caaa743246e60e338d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_99e1cde224c845caaa743246e60e338d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/99e1cde224c845caaa743246e60e338d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/99e1cde224c845caaa743246e60e338d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-TestVolumeBootPattern-1509499038 Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 99e1cde224c845caaa743246e60e338d Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-TestVolumeBootPattern-1509499038 Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-TestVolumeBootPattern-1509499038-project Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: a0ec990e687d427d88dcf9879a1d5b0c Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-TestVolumeBootPattern-1509499038-project Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6 could not be found. Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6'} Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6 could not be found. Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 02:06:24.243238 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 02:06:24.247156 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6 could not be found. Oct 30 02:06:24.247156 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:06:24.247156 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:06:24.247156 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:06:24.247156 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:06:24.247156 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:06:24.247156 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:06:24.247156 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:06:24.247156 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:06:24.247156 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6 could not be found. Oct 30 02:06:24.247156 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:06:24.247156 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1c061e62-afcc-4f86-9e31-ed8520a0a15a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Returning 404 to user: Instance 04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:06:24.247156 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1c061e62-afcc-4f86-9e31-ed8520a0a15a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "DELETE /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6" status: 404 len: 111 microversion: 2.1 time: 0.030543 Oct 30 02:06:24.247156 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3547/6917] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 02:06:24 2022] DELETE /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 02:06:24.252783 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d63a0e64-2321-448d-b709-5c626d01d2b9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:06:24.253442 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d63a0e64-2321-448d-b709-5c626d01d2b9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:06:24.260455 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d63a0e64-2321-448d-b709-5c626d01d2b9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:24.260960 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d63a0e64-2321-448d-b709-5c626d01d2b9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:24.261454 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d63a0e64-2321-448d-b709-5c626d01d2b9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:24.262331 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d63a0e64-2321-448d-b709-5c626d01d2b9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:24.262805 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d63a0e64-2321-448d-b709-5c626d01d2b9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:24.263244 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d63a0e64-2321-448d-b709-5c626d01d2b9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:24.279114 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-d63a0e64-2321-448d-b709-5c626d01d2b9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] HTTP exception thrown: Instance 04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6 could not be found. Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d63a0e64-2321-448d-b709-5c626d01d2b9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Request method failure captured: Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6 HTTP/1.1 Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdrUzAoetWsdn8k4HYTcqbVG7Zs75eMmndnkEOPA0S-TmAgSQ2b5nMGLS0qTcKbMaQTaaQPoAGl2nSU9lucNctaJ1zTE6xKSNocI5VbroWnIgVb8SnDnXRJPuQdp0_RS-b7KWfvV5q_soI5fUH8iU2dwXESX56PU08-DTzNpHjo6aLI Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 99e1cde224c845caaa743246e60e338d Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-TestVolumeBootPattern-1509499038 Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/99e1cde224c845caaa743246e60e338d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_99e1cde224c845caaa743246e60e338d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/99e1cde224c845caaa743246e60e338d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/99e1cde224c845caaa743246e60e338d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-TestVolumeBootPattern-1509499038 Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 99e1cde224c845caaa743246e60e338d Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-TestVolumeBootPattern-1509499038 Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-TestVolumeBootPattern-1509499038-project Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: a0ec990e687d427d88dcf9879a1d5b0c Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-TestVolumeBootPattern-1509499038-project Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6 could not be found. Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6'} Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6 could not be found. Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6 could not be found. Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:06:24.280929 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:06:24.285945 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:06:24.285945 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:06:24.285945 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:06:24.285945 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:06:24.285945 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:06:24.285945 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6 could not be found. Oct 30 02:06:24.285945 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:06:24.285945 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d63a0e64-2321-448d-b709-5c626d01d2b9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Returning 404 to user: Instance 04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:06:24.285945 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d63a0e64-2321-448d-b709-5c626d01d2b9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6" status: 404 len: 111 microversion: 2.1 time: 0.033180 Oct 30 02:06:24.285945 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3548/6918] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:06:24 2022] GET /compute/v2.1/servers/04bb19c6-3e4c-49f6-a82b-2cbcfd21a1f6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 02:06:24.361434 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-55d85e84-ef06-4e05-a347-51e332a05ca4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Action: 'create', calling method: .version_select at 0x7f44c783edc0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-236561478", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIeAcEBLr67RfH2SgJ9pX7DZuD8vLNEolArm0iL4nG34+w3ZSo/MiYNmzml3c9IygDitjjpgasNNMmDJRZy3Aq/EHQj/WuhuDub/8RLYLGDWh/A7ntu+wqEca4NBPQKuEA=="}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:06:24.378076 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-55d85e84-ef06-4e05-a347-51e332a05ca4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Getting quotas for project 99e1cde224c845caaa743246e60e338d. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 02:06:24.383992 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-55d85e84-ef06-4e05-a347-51e332a05ca4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Getting quotas for user a0ec990e687d427d88dcf9879a1d5b0c and project 99e1cde224c845caaa743246e60e338d. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 02:06:24.477048 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-55d85e84-ef06-4e05-a347-51e332a05ca4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.119643 Oct 30 02:06:24.477706 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3549/6919] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 30 02:06:24 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:06:47.385901 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=54 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:06:47.386706 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=4 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:06:47.387350 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:06:47.391340 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fe7ee741-cb24-4141-9ef7-9b5ec637df83 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-54810752", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-236561478", "security_groups": [{"name": "tempest-secgroup-smoke-520452041"}], "block_device_mapping_v2": [{"uuid": "fbd978d5-c2fc-44a8-a90b-e2144d477887", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "aa518046-7164-40fa-a3f3-11422c6acc97"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:06:47.504696 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-fe7ee741-cb24-4141-9ef7-9b5ec637df83 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] validate_networks() for [('aa518046-7164-40fa-a3f3-11422c6acc97', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 02:06:47.866808 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-fe7ee741-cb24-4141-9ef7-9b5ec637df83 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 02:06:47.867244 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-fe7ee741-cb24-4141-9ef7-9b5ec637df83 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 02:06:47.867726 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-fe7ee741-cb24-4141-9ef7-9b5ec637df83 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 02:06:47.868145 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-fe7ee741-cb24-4141-9ef7-9b5ec637df83 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 02:06:47.868567 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-fe7ee741-cb24-4141-9ef7-9b5ec637df83 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 02:06:47.878045 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fe7ee741-cb24-4141-9ef7-9b5ec637df83 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:47.878542 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fe7ee741-cb24-4141-9ef7-9b5ec637df83 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:47.878990 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fe7ee741-cb24-4141-9ef7-9b5ec637df83 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:47.879734 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fe7ee741-cb24-4141-9ef7-9b5ec637df83 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:47.880199 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fe7ee741-cb24-4141-9ef7-9b5ec637df83 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:47.880645 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fe7ee741-cb24-4141-9ef7-9b5ec637df83 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:47.898808 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-fe7ee741-cb24-4141-9ef7-9b5ec637df83 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Getting quotas for project 99e1cde224c845caaa743246e60e338d. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 02:06:47.904149 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-fe7ee741-cb24-4141-9ef7-9b5ec637df83 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Getting quotas for user a0ec990e687d427d88dcf9879a1d5b0c and project 99e1cde224c845caaa743246e60e338d. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 02:06:47.961367 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fe7ee741-cb24-4141-9ef7-9b5ec637df83 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 02:06:47.964023 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fe7ee741-cb24-4141-9ef7-9b5ec637df83 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 1a56660b-3b62-4531-8a68-79d7565c967b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fbd978d5-c2fc-44a8-a90b-e2144d477887',volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 02:06:48.368980 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fe7ee741-cb24-4141-9ef7-9b5ec637df83 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.984781 Oct 30 02:06:48.369724 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3550/6920] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 02:06:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 02:06:48.380643 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b97a2059-dcbe-4c45-b60b-8f499d3dddbc tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:06:48.381269 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b97a2059-dcbe-4c45-b60b-8f499d3dddbc tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 1a56660b-3b62-4531-8a68-79d7565c967b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:06:48.436981 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b97a2059-dcbe-4c45-b60b-8f499d3dddbc tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:06:48.444734 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b97a2059-dcbe-4c45-b60b-8f499d3dddbc tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b" status: 200 len: 1092 microversion: 2.1 time: 0.067788 Oct 30 02:06:48.445285 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3551/6921] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:06:48 2022] GET /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b => generated 1092 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:06:49.469057 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2112ae0c-8a8b-40eb-b5cf-418343f3beb6 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:06:49.469748 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2112ae0c-8a8b-40eb-b5cf-418343f3beb6 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 1a56660b-3b62-4531-8a68-79d7565c967b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:06:49.476868 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2112ae0c-8a8b-40eb-b5cf-418343f3beb6 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:49.477392 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2112ae0c-8a8b-40eb-b5cf-418343f3beb6 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:49.482179 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2112ae0c-8a8b-40eb-b5cf-418343f3beb6 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:49.482179 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2112ae0c-8a8b-40eb-b5cf-418343f3beb6 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:49.482179 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2112ae0c-8a8b-40eb-b5cf-418343f3beb6 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:49.482179 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2112ae0c-8a8b-40eb-b5cf-418343f3beb6 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:49.545387 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2112ae0c-8a8b-40eb-b5cf-418343f3beb6 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:06:49.553797 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2112ae0c-8a8b-40eb-b5cf-418343f3beb6 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b" status: 200 len: 1134 microversion: 2.1 time: 0.088452 Oct 30 02:06:49.556611 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3552/6922] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:06:49 2022] GET /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b => generated 1134 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:06:50.577567 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e9e96499-6de2-48e9-959f-fbef9aee404b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:06:50.578286 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e9e96499-6de2-48e9-959f-fbef9aee404b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 1a56660b-3b62-4531-8a68-79d7565c967b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:06:50.586139 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9e96499-6de2-48e9-959f-fbef9aee404b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:50.586661 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9e96499-6de2-48e9-959f-fbef9aee404b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:50.587120 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9e96499-6de2-48e9-959f-fbef9aee404b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:50.587857 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9e96499-6de2-48e9-959f-fbef9aee404b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:50.588400 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9e96499-6de2-48e9-959f-fbef9aee404b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:50.588853 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9e96499-6de2-48e9-959f-fbef9aee404b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:50.821270 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e9e96499-6de2-48e9-959f-fbef9aee404b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:06:50.829122 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e9e96499-6de2-48e9-959f-fbef9aee404b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b" status: 200 len: 1208 microversion: 2.1 time: 0.255539 Oct 30 02:06:50.830564 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3553/6923] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:06:50 2022] GET /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b => generated 1208 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:06:51.856012 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-84b81348-9162-44f4-b0c4-32dfd1df710d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:06:51.856814 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-84b81348-9162-44f4-b0c4-32dfd1df710d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 1a56660b-3b62-4531-8a68-79d7565c967b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:06:51.865241 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-84b81348-9162-44f4-b0c4-32dfd1df710d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:51.866053 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-84b81348-9162-44f4-b0c4-32dfd1df710d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:51.866508 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-84b81348-9162-44f4-b0c4-32dfd1df710d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:51.867463 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-84b81348-9162-44f4-b0c4-32dfd1df710d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:51.868076 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-84b81348-9162-44f4-b0c4-32dfd1df710d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:51.868525 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-84b81348-9162-44f4-b0c4-32dfd1df710d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:52.039988 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-84b81348-9162-44f4-b0c4-32dfd1df710d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:06:52.048929 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-84b81348-9162-44f4-b0c4-32dfd1df710d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b" status: 200 len: 1275 microversion: 2.1 time: 0.198161 Oct 30 02:06:52.049844 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3554/6924] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:06:51 2022] GET /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b => generated 1275 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:06:52.368803 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-eecf0a7a-f215-4962-a21a-5f7912776974 req-143538ee-eaec-4488-b65f-745fa3171ae3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a56660b-3b62-4531-8a68-79d7565c967b", "tag": "eb103553-c6cc-4ddf-a29e-95232153322f"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:06:52.381256 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-eecf0a7a-f215-4962-a21a-5f7912776974 req-143538ee-eaec-4488-b65f-745fa3171ae3 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:52.382098 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-eecf0a7a-f215-4962-a21a-5f7912776974 req-143538ee-eaec-4488-b65f-745fa3171ae3 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:52.382650 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-eecf0a7a-f215-4962-a21a-5f7912776974 req-143538ee-eaec-4488-b65f-745fa3171ae3 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:52.395071 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-eecf0a7a-f215-4962-a21a-5f7912776974 req-143538ee-eaec-4488-b65f-745fa3171ae3 service nova] Creating event network-changed:eb103553-c6cc-4ddf-a29e-95232153322f for instance 1a56660b-3b62-4531-8a68-79d7565c967b on n-h1-master-1 Oct 30 02:06:52.401343 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-eecf0a7a-f215-4962-a21a-5f7912776974 req-143538ee-eaec-4488-b65f-745fa3171ae3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036571 Oct 30 02:06:52.402591 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3555/6925] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:06:53.073143 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ed5689a7-0c25-4790-b07b-62c615ed19ad tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:06:53.074606 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ed5689a7-0c25-4790-b07b-62c615ed19ad tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 1a56660b-3b62-4531-8a68-79d7565c967b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:06:53.081962 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed5689a7-0c25-4790-b07b-62c615ed19ad tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:53.082472 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed5689a7-0c25-4790-b07b-62c615ed19ad tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:53.082934 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed5689a7-0c25-4790-b07b-62c615ed19ad tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:53.083668 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed5689a7-0c25-4790-b07b-62c615ed19ad tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:53.084174 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed5689a7-0c25-4790-b07b-62c615ed19ad tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:53.084623 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed5689a7-0c25-4790-b07b-62c615ed19ad tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:53.238439 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ed5689a7-0c25-4790-b07b-62c615ed19ad tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:06:53.246959 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ed5689a7-0c25-4790-b07b-62c615ed19ad tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b" status: 200 len: 1275 microversion: 2.1 time: 0.178213 Oct 30 02:06:53.248036 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3556/6926] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:06:53 2022] GET /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b => generated 1275 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:06:54.270071 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-91188161-591c-4e34-8487-3babe5426128 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:06:54.270717 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-91188161-591c-4e34-8487-3babe5426128 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 1a56660b-3b62-4531-8a68-79d7565c967b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:06:54.278438 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-91188161-591c-4e34-8487-3babe5426128 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:54.278946 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-91188161-591c-4e34-8487-3babe5426128 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:54.279391 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-91188161-591c-4e34-8487-3babe5426128 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:54.280103 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-91188161-591c-4e34-8487-3babe5426128 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:54.280567 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-91188161-591c-4e34-8487-3babe5426128 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:54.281004 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-91188161-591c-4e34-8487-3babe5426128 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:54.418517 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-91188161-591c-4e34-8487-3babe5426128 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:06:54.427194 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-91188161-591c-4e34-8487-3babe5426128 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b" status: 200 len: 1275 microversion: 2.1 time: 0.160894 Oct 30 02:06:54.427796 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3557/6927] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:06:54 2022] GET /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b => generated 1275 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:06:55.450717 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-18fbf44a-6b64-4aa3-a9a1-8d40b3198d3a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:06:55.451402 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-18fbf44a-6b64-4aa3-a9a1-8d40b3198d3a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 1a56660b-3b62-4531-8a68-79d7565c967b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:06:55.458465 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-18fbf44a-6b64-4aa3-a9a1-8d40b3198d3a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:55.458965 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-18fbf44a-6b64-4aa3-a9a1-8d40b3198d3a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:55.459416 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-18fbf44a-6b64-4aa3-a9a1-8d40b3198d3a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:55.460130 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-18fbf44a-6b64-4aa3-a9a1-8d40b3198d3a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:55.460608 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-18fbf44a-6b64-4aa3-a9a1-8d40b3198d3a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:55.461045 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-18fbf44a-6b64-4aa3-a9a1-8d40b3198d3a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:55.596729 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-18fbf44a-6b64-4aa3-a9a1-8d40b3198d3a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:06:55.605091 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-18fbf44a-6b64-4aa3-a9a1-8d40b3198d3a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b" status: 200 len: 1275 microversion: 2.1 time: 0.158326 Oct 30 02:06:55.605765 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3558/6928] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:06:55 2022] GET /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b => generated 1275 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:06:56.627541 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-869bbbbf-ce60-4ad0-8966-6bb662ce1e99 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:06:56.628182 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-869bbbbf-ce60-4ad0-8966-6bb662ce1e99 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 1a56660b-3b62-4531-8a68-79d7565c967b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:06:56.635028 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-869bbbbf-ce60-4ad0-8966-6bb662ce1e99 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:56.635521 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-869bbbbf-ce60-4ad0-8966-6bb662ce1e99 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:56.636266 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-869bbbbf-ce60-4ad0-8966-6bb662ce1e99 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:56.636969 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-869bbbbf-ce60-4ad0-8966-6bb662ce1e99 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:56.637479 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-869bbbbf-ce60-4ad0-8966-6bb662ce1e99 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:56.637919 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-869bbbbf-ce60-4ad0-8966-6bb662ce1e99 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:56.773488 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-869bbbbf-ce60-4ad0-8966-6bb662ce1e99 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:06:56.781687 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-869bbbbf-ce60-4ad0-8966-6bb662ce1e99 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b" status: 200 len: 1263 microversion: 2.1 time: 0.158017 Oct 30 02:06:56.782256 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3559/6929] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:06:56 2022] GET /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b => generated 1263 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:06:57.804082 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3ef9018c-4ebd-489f-a82c-a963eb47eba1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:06:57.804745 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3ef9018c-4ebd-489f-a82c-a963eb47eba1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 1a56660b-3b62-4531-8a68-79d7565c967b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:06:57.811542 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3ef9018c-4ebd-489f-a82c-a963eb47eba1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:57.812036 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3ef9018c-4ebd-489f-a82c-a963eb47eba1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:57.812483 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3ef9018c-4ebd-489f-a82c-a963eb47eba1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:57.813184 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3ef9018c-4ebd-489f-a82c-a963eb47eba1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:57.813675 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3ef9018c-4ebd-489f-a82c-a963eb47eba1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:57.814111 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3ef9018c-4ebd-489f-a82c-a963eb47eba1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:57.888107 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:06:57.946756 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3ef9018c-4ebd-489f-a82c-a963eb47eba1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:06:57.955444 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3ef9018c-4ebd-489f-a82c-a963eb47eba1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b" status: 200 len: 1263 microversion: 2.1 time: 0.155283 Oct 30 02:06:57.956017 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3560/6930] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:06:57 2022] GET /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b => generated 1263 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:06:58.978927 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5ff5ae64-75bf-476b-a5d9-64d4711b5b45 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:06:58.979561 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5ff5ae64-75bf-476b-a5d9-64d4711b5b45 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 1a56660b-3b62-4531-8a68-79d7565c967b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:06:58.982361 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=8 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:06:58.988131 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5ff5ae64-75bf-476b-a5d9-64d4711b5b45 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:58.993018 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5ff5ae64-75bf-476b-a5d9-64d4711b5b45 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:58.993018 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5ff5ae64-75bf-476b-a5d9-64d4711b5b45 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:58.993018 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5ff5ae64-75bf-476b-a5d9-64d4711b5b45 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:06:58.993018 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5ff5ae64-75bf-476b-a5d9-64d4711b5b45 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:06:58.993018 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5ff5ae64-75bf-476b-a5d9-64d4711b5b45 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:06:59.124900 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5ff5ae64-75bf-476b-a5d9-64d4711b5b45 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:06:59.132709 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5ff5ae64-75bf-476b-a5d9-64d4711b5b45 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b" status: 200 len: 1263 microversion: 2.1 time: 0.157700 Oct 30 02:06:59.133253 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3561/6931] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:06:58 2022] GET /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b => generated 1263 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:07:00.155574 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8555835a-013d-4393-8ee8-4590d42a9dd2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:07:00.347140 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8555835a-013d-4393-8ee8-4590d42a9dd2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 1a56660b-3b62-4531-8a68-79d7565c967b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:07:00.347140 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8555835a-013d-4393-8ee8-4590d42a9dd2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:07:00.347140 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8555835a-013d-4393-8ee8-4590d42a9dd2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:07:00.347140 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8555835a-013d-4393-8ee8-4590d42a9dd2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:07:00.347140 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8555835a-013d-4393-8ee8-4590d42a9dd2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:07:00.347140 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8555835a-013d-4393-8ee8-4590d42a9dd2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:07:00.347140 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8555835a-013d-4393-8ee8-4590d42a9dd2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:07:00.347140 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8555835a-013d-4393-8ee8-4590d42a9dd2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:07:00.347140 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8555835a-013d-4393-8ee8-4590d42a9dd2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b" status: 200 len: 1263 microversion: 2.1 time: 0.165783 Oct 30 02:07:00.347140 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3562/6932] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:07:00 2022] GET /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b => generated 1263 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:07:01.340281 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1eef84a5-edad-4d93-a2a0-d9a9005c3d13 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:07:01.340936 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1eef84a5-edad-4d93-a2a0-d9a9005c3d13 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 1a56660b-3b62-4531-8a68-79d7565c967b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:07:01.347844 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1eef84a5-edad-4d93-a2a0-d9a9005c3d13 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:07:01.348345 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1eef84a5-edad-4d93-a2a0-d9a9005c3d13 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:07:01.348796 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1eef84a5-edad-4d93-a2a0-d9a9005c3d13 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:07:01.349538 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1eef84a5-edad-4d93-a2a0-d9a9005c3d13 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:07:01.350012 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1eef84a5-edad-4d93-a2a0-d9a9005c3d13 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:07:01.350449 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1eef84a5-edad-4d93-a2a0-d9a9005c3d13 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:07:01.477687 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1eef84a5-edad-4d93-a2a0-d9a9005c3d13 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:07:01.486060 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1eef84a5-edad-4d93-a2a0-d9a9005c3d13 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b" status: 200 len: 1263 microversion: 2.1 time: 0.150234 Oct 30 02:07:01.486632 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3563/6933] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:07:01 2022] GET /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b => generated 1263 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:07:02.508149 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d1b3c2e7-2650-4c89-bac9-ac719b666184 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:07:02.508853 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d1b3c2e7-2650-4c89-bac9-ac719b666184 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 1a56660b-3b62-4531-8a68-79d7565c967b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:07:02.516236 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1b3c2e7-2650-4c89-bac9-ac719b666184 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:07:02.516745 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1b3c2e7-2650-4c89-bac9-ac719b666184 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:07:02.517181 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1b3c2e7-2650-4c89-bac9-ac719b666184 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:07:02.517928 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1b3c2e7-2650-4c89-bac9-ac719b666184 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:07:02.518392 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1b3c2e7-2650-4c89-bac9-ac719b666184 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:07:02.518832 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1b3c2e7-2650-4c89-bac9-ac719b666184 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:07:02.651281 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d1b3c2e7-2650-4c89-bac9-ac719b666184 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:07:02.659801 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d1b3c2e7-2650-4c89-bac9-ac719b666184 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b" status: 200 len: 1263 microversion: 2.1 time: 0.155557 Oct 30 02:07:02.660445 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3564/6934] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:07:02 2022] GET /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:07:03.682227 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9e4f9c93-5db5-487a-a20c-d22ab304462a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:07:03.682884 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9e4f9c93-5db5-487a-a20c-d22ab304462a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 1a56660b-3b62-4531-8a68-79d7565c967b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:07:03.689712 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9e4f9c93-5db5-487a-a20c-d22ab304462a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:07:03.690203 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9e4f9c93-5db5-487a-a20c-d22ab304462a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:07:03.690648 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9e4f9c93-5db5-487a-a20c-d22ab304462a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:07:03.691354 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9e4f9c93-5db5-487a-a20c-d22ab304462a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:07:03.691816 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9e4f9c93-5db5-487a-a20c-d22ab304462a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:07:03.692251 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9e4f9c93-5db5-487a-a20c-d22ab304462a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:07:03.823395 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9e4f9c93-5db5-487a-a20c-d22ab304462a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:07:03.831804 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9e4f9c93-5db5-487a-a20c-d22ab304462a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b" status: 200 len: 1263 microversion: 2.1 time: 0.153756 Oct 30 02:07:03.832375 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3565/6935] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:07:03 2022] GET /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b => generated 1263 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:07:04.855561 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-48d4eec8-a2d0-4ec7-9937-1d89c46636b4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:07:04.856170 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-48d4eec8-a2d0-4ec7-9937-1d89c46636b4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 1a56660b-3b62-4531-8a68-79d7565c967b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:07:04.862939 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-48d4eec8-a2d0-4ec7-9937-1d89c46636b4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:07:04.863443 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-48d4eec8-a2d0-4ec7-9937-1d89c46636b4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:07:04.863898 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-48d4eec8-a2d0-4ec7-9937-1d89c46636b4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:07:04.864606 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-48d4eec8-a2d0-4ec7-9937-1d89c46636b4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:07:04.865083 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-48d4eec8-a2d0-4ec7-9937-1d89c46636b4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:07:04.865550 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-48d4eec8-a2d0-4ec7-9937-1d89c46636b4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:07:05.000740 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-48d4eec8-a2d0-4ec7-9937-1d89c46636b4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:07:05.008484 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-48d4eec8-a2d0-4ec7-9937-1d89c46636b4 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b" status: 200 len: 1263 microversion: 2.1 time: 0.157482 Oct 30 02:07:05.009054 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3566/6936] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:07:04 2022] GET /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b => generated 1263 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:07:06.030610 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-dd04962f-9bf5-42a9-97e5-cc0aab88ea00 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:07:06.031242 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-dd04962f-9bf5-42a9-97e5-cc0aab88ea00 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 1a56660b-3b62-4531-8a68-79d7565c967b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:07:06.038260 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dd04962f-9bf5-42a9-97e5-cc0aab88ea00 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:07:06.038758 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dd04962f-9bf5-42a9-97e5-cc0aab88ea00 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:07:06.039206 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dd04962f-9bf5-42a9-97e5-cc0aab88ea00 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:07:06.039925 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dd04962f-9bf5-42a9-97e5-cc0aab88ea00 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:07:06.040369 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dd04962f-9bf5-42a9-97e5-cc0aab88ea00 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:07:06.040804 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dd04962f-9bf5-42a9-97e5-cc0aab88ea00 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:07:06.170510 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-dd04962f-9bf5-42a9-97e5-cc0aab88ea00 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:07:06.178252 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-dd04962f-9bf5-42a9-97e5-cc0aab88ea00 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b" status: 200 len: 1263 microversion: 2.1 time: 0.151609 Oct 30 02:07:06.178814 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3567/6937] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:07:06 2022] GET /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b => generated 1263 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:07:07.201487 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8be4b6a0-1d0f-441a-a61c-fc2026d7cc7d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:07:07.202133 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8be4b6a0-1d0f-441a-a61c-fc2026d7cc7d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 1a56660b-3b62-4531-8a68-79d7565c967b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:07:07.209112 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8be4b6a0-1d0f-441a-a61c-fc2026d7cc7d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:07:07.209641 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8be4b6a0-1d0f-441a-a61c-fc2026d7cc7d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:07:07.210177 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8be4b6a0-1d0f-441a-a61c-fc2026d7cc7d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:07:07.210889 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8be4b6a0-1d0f-441a-a61c-fc2026d7cc7d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:07:07.211354 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8be4b6a0-1d0f-441a-a61c-fc2026d7cc7d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:07:07.211788 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8be4b6a0-1d0f-441a-a61c-fc2026d7cc7d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:07:07.342792 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8be4b6a0-1d0f-441a-a61c-fc2026d7cc7d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:07:07.346534 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:07:07.351008 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8be4b6a0-1d0f-441a-a61c-fc2026d7cc7d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b" status: 200 len: 1263 microversion: 2.1 time: 0.153561 Oct 30 02:07:07.351580 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3568/6938] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:07:07 2022] GET /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b => generated 1263 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:07:07.934702 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-11cb78a0-4988-4373-9fca-c53979e69e1d req-9205be33-7924-438c-9d8d-33a76e42f288 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a56660b-3b62-4531-8a68-79d7565c967b", "name": "network-vif-plugged", "status": "completed", "tag": "eb103553-c6cc-4ddf-a29e-95232153322f"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:07:07.944323 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-11cb78a0-4988-4373-9fca-c53979e69e1d req-9205be33-7924-438c-9d8d-33a76e42f288 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:07:07.944839 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-11cb78a0-4988-4373-9fca-c53979e69e1d req-9205be33-7924-438c-9d8d-33a76e42f288 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:07:07.945280 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-11cb78a0-4988-4373-9fca-c53979e69e1d req-9205be33-7924-438c-9d8d-33a76e42f288 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:07:07.956281 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-11cb78a0-4988-4373-9fca-c53979e69e1d req-9205be33-7924-438c-9d8d-33a76e42f288 service nova] Creating event network-vif-plugged:eb103553-c6cc-4ddf-a29e-95232153322f for instance 1a56660b-3b62-4531-8a68-79d7565c967b on n-h1-master-1 Oct 30 02:07:07.961295 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-11cb78a0-4988-4373-9fca-c53979e69e1d req-9205be33-7924-438c-9d8d-33a76e42f288 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030735 Oct 30 02:07:07.961897 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3569/6939] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:07:08.375981 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d8359c11-4440-4a30-9101-44f2f2fc31c3 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:07:08.376631 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d8359c11-4440-4a30-9101-44f2f2fc31c3 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 1a56660b-3b62-4531-8a68-79d7565c967b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:07:08.382893 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8359c11-4440-4a30-9101-44f2f2fc31c3 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:07:08.383401 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8359c11-4440-4a30-9101-44f2f2fc31c3 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:07:08.383857 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8359c11-4440-4a30-9101-44f2f2fc31c3 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:07:08.384570 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8359c11-4440-4a30-9101-44f2f2fc31c3 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:07:08.385045 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8359c11-4440-4a30-9101-44f2f2fc31c3 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:07:08.385520 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8359c11-4440-4a30-9101-44f2f2fc31c3 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:07:08.518397 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d8359c11-4440-4a30-9101-44f2f2fc31c3 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:07:08.526218 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d8359c11-4440-4a30-9101-44f2f2fc31c3 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b" status: 200 len: 1263 microversion: 2.1 time: 0.156278 Oct 30 02:07:08.526818 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3570/6940] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:07:08 2022] GET /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b => generated 1263 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:07:09.548541 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8fee1cfa-3748-4f83-8143-482f73ef6c22 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:07:09.549220 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8fee1cfa-3748-4f83-8143-482f73ef6c22 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 1a56660b-3b62-4531-8a68-79d7565c967b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:07:09.556015 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8fee1cfa-3748-4f83-8143-482f73ef6c22 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:07:09.556510 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8fee1cfa-3748-4f83-8143-482f73ef6c22 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:07:09.556955 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8fee1cfa-3748-4f83-8143-482f73ef6c22 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:07:09.557699 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8fee1cfa-3748-4f83-8143-482f73ef6c22 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:07:09.558168 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8fee1cfa-3748-4f83-8143-482f73ef6c22 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:07:09.558605 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8fee1cfa-3748-4f83-8143-482f73ef6c22 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:07:09.691068 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8fee1cfa-3748-4f83-8143-482f73ef6c22 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:07:09.698798 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8fee1cfa-3748-4f83-8143-482f73ef6c22 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b" status: 200 len: 1450 microversion: 2.1 time: 0.154281 Oct 30 02:07:09.699368 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3571/6941] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:07:09 2022] GET /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:07:09.721016 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-55301097-5f26-4e86-be83-e8e833fec8b1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:07:09.721652 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-55301097-5f26-4e86-be83-e8e833fec8b1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 1a56660b-3b62-4531-8a68-79d7565c967b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:07:09.727223 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-55301097-5f26-4e86-be83-e8e833fec8b1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:07:09.727718 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-55301097-5f26-4e86-be83-e8e833fec8b1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:07:09.728162 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-55301097-5f26-4e86-be83-e8e833fec8b1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:07:09.728859 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-55301097-5f26-4e86-be83-e8e833fec8b1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:07:09.729323 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-55301097-5f26-4e86-be83-e8e833fec8b1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:07:09.729775 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-55301097-5f26-4e86-be83-e8e833fec8b1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:07:09.861226 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-55301097-5f26-4e86-be83-e8e833fec8b1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:07:09.869002 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-55301097-5f26-4e86-be83-e8e833fec8b1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b" status: 200 len: 1450 microversion: 2.1 time: 0.151496 Oct 30 02:07:09.869630 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3572/6942] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:07:09 2022] GET /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:07:11.834867 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-6c1ec8ee-89ae-4275-8b48-f4280441c5b0 req-b50ed9c8-1ae6-4b12-ab30-dfadbba96f29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a56660b-3b62-4531-8a68-79d7565c967b", "tag": "eb103553-c6cc-4ddf-a29e-95232153322f"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:07:11.846351 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-6c1ec8ee-89ae-4275-8b48-f4280441c5b0 req-b50ed9c8-1ae6-4b12-ab30-dfadbba96f29 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:07:11.850708 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-6c1ec8ee-89ae-4275-8b48-f4280441c5b0 req-b50ed9c8-1ae6-4b12-ab30-dfadbba96f29 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:07:11.850708 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-6c1ec8ee-89ae-4275-8b48-f4280441c5b0 req-b50ed9c8-1ae6-4b12-ab30-dfadbba96f29 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:07:11.859500 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-6c1ec8ee-89ae-4275-8b48-f4280441c5b0 req-b50ed9c8-1ae6-4b12-ab30-dfadbba96f29 service nova] Creating event network-changed:eb103553-c6cc-4ddf-a29e-95232153322f for instance 1a56660b-3b62-4531-8a68-79d7565c967b on n-h1-master-1 Oct 30 02:07:11.864625 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-6c1ec8ee-89ae-4275-8b48-f4280441c5b0 req-b50ed9c8-1ae6-4b12-ab30-dfadbba96f29 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033563 Oct 30 02:07:11.865527 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3573/6943] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:07:44.111560 n-d-master-1 devstack@n-api.service[121103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 30 02:07:44.112092 n-d-master-1 devstack@n-api.service[121103]: Sun Oct 30 02:07:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.13) !!! Oct 30 02:07:44.112805 n-d-master-1 devstack@n-api.service[121103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 30 02:07:44.112912 n-d-master-1 devstack@n-api.service[121103]: Sun Oct 30 02:07:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.13) !!! Oct 30 02:07:45.144712 n-d-master-1 devstack@n-api.service[121103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 30 02:07:45.145283 n-d-master-1 devstack@n-api.service[121103]: Sun Oct 30 02:07:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.13) !!! Oct 30 02:09:36.844411 n-d-master-1 devstack@n-api.service[121102]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8caffca0-53fa-4143-8e03-000c8bb53286] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 30 02:09:36.845467 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:09:36.846227 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=22 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:09:36.848083 n-d-master-1 devstack@n-api.service[121102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 30 02:09:36.848228 n-d-master-1 devstack@n-api.service[121102]: Sun Oct 30 02:09:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b (ip 10.222.0.13) !!! Oct 30 02:09:36.854560 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-42959eb4-6da9-4e13-8329-8a15452e7fb9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:09:36.855170 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-42959eb4-6da9-4e13-8329-8a15452e7fb9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 1a56660b-3b62-4531-8a68-79d7565c967b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:09:36.862609 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-42959eb4-6da9-4e13-8329-8a15452e7fb9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:09:36.863283 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-42959eb4-6da9-4e13-8329-8a15452e7fb9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:09:36.863740 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-42959eb4-6da9-4e13-8329-8a15452e7fb9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:09:36.864463 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-42959eb4-6da9-4e13-8329-8a15452e7fb9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:09:36.864922 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-42959eb4-6da9-4e13-8329-8a15452e7fb9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:09:36.865380 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-42959eb4-6da9-4e13-8329-8a15452e7fb9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:09:36.892770 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-42959eb4-6da9-4e13-8329-8a15452e7fb9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 1a56660b-3b62-4531-8a68-79d7565c967b] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 02:09:37.198803 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-42959eb4-6da9-4e13-8329-8a15452e7fb9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "DELETE /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b" status: 204 len: 0 microversion: 2.1 time: 0.356350 Oct 30 02:09:37.199408 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3574/6944] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 02:09:36 2022] DELETE /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 30 02:09:37.208301 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cc6ba05a-87a9-4fe6-bf6a-98826be96cf1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:09:37.209020 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cc6ba05a-87a9-4fe6-bf6a-98826be96cf1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 1a56660b-3b62-4531-8a68-79d7565c967b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:09:37.215007 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cc6ba05a-87a9-4fe6-bf6a-98826be96cf1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:09:37.215511 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cc6ba05a-87a9-4fe6-bf6a-98826be96cf1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:09:37.215974 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cc6ba05a-87a9-4fe6-bf6a-98826be96cf1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:09:37.216671 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cc6ba05a-87a9-4fe6-bf6a-98826be96cf1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:09:37.217141 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cc6ba05a-87a9-4fe6-bf6a-98826be96cf1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:09:37.217624 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cc6ba05a-87a9-4fe6-bf6a-98826be96cf1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:09:37.400149 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-cc6ba05a-87a9-4fe6-bf6a-98826be96cf1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:09:37.408714 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cc6ba05a-87a9-4fe6-bf6a-98826be96cf1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b" status: 200 len: 1575 microversion: 2.1 time: 0.204528 Oct 30 02:09:37.409290 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3575/6945] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:09:37 2022] GET /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b => generated 1575 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:09:38.431781 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-37711f52-802f-480d-8491-111bc5bc352d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:09:38.432461 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-37711f52-802f-480d-8491-111bc5bc352d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 1a56660b-3b62-4531-8a68-79d7565c967b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:09:38.442457 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-37711f52-802f-480d-8491-111bc5bc352d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:09:38.442964 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-37711f52-802f-480d-8491-111bc5bc352d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:09:38.443419 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-37711f52-802f-480d-8491-111bc5bc352d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:09:38.444143 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-37711f52-802f-480d-8491-111bc5bc352d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:09:38.444614 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-37711f52-802f-480d-8491-111bc5bc352d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:09:38.445066 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-37711f52-802f-480d-8491-111bc5bc352d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:09:38.464262 n-d-master-1 devstack@n-api.service[121102]: INFO oslo.messaging._drivers.impl_rabbit [-] [8caffca0-53fa-4143-8e03-000c8bb53286] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 55554. Oct 30 02:09:38.584117 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-37711f52-802f-480d-8491-111bc5bc352d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:09:38.591889 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-37711f52-802f-480d-8491-111bc5bc352d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b" status: 200 len: 1575 microversion: 2.1 time: 0.164086 Oct 30 02:09:38.592469 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3576/6946] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:09:38 2022] GET /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:09:39.615792 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-dbd1ab0d-9bea-46ba-9675-0b20c305e9b3 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:09:39.618598 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-dbd1ab0d-9bea-46ba-9675-0b20c305e9b3 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 1a56660b-3b62-4531-8a68-79d7565c967b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:09:39.623563 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dbd1ab0d-9bea-46ba-9675-0b20c305e9b3 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:09:39.624189 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dbd1ab0d-9bea-46ba-9675-0b20c305e9b3 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:09:39.624678 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dbd1ab0d-9bea-46ba-9675-0b20c305e9b3 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:09:39.625449 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dbd1ab0d-9bea-46ba-9675-0b20c305e9b3 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:09:39.625914 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dbd1ab0d-9bea-46ba-9675-0b20c305e9b3 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:09:39.626350 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dbd1ab0d-9bea-46ba-9675-0b20c305e9b3 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:09:39.718539 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-dbd1ab0d-9bea-46ba-9675-0b20c305e9b3 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:09:39.726928 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-dbd1ab0d-9bea-46ba-9675-0b20c305e9b3 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b" status: 200 len: 1508 microversion: 2.1 time: 0.115964 Oct 30 02:09:39.727514 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3577/6947] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:09:39 2022] GET /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b => generated 1508 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:09:39.888678 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-ca65ca94-8bba-4b85-a1a3-b861ab09984e req-68ebf209-b406-42ad-882a-66732ec6fd74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a56660b-3b62-4531-8a68-79d7565c967b", "name": "network-vif-deleted", "tag": "eb103553-c6cc-4ddf-a29e-95232153322f"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:09:39.900051 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ca65ca94-8bba-4b85-a1a3-b861ab09984e req-68ebf209-b406-42ad-882a-66732ec6fd74 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:09:39.900552 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ca65ca94-8bba-4b85-a1a3-b861ab09984e req-68ebf209-b406-42ad-882a-66732ec6fd74 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:09:39.901003 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ca65ca94-8bba-4b85-a1a3-b861ab09984e req-68ebf209-b406-42ad-882a-66732ec6fd74 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:09:39.913305 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-ca65ca94-8bba-4b85-a1a3-b861ab09984e req-68ebf209-b406-42ad-882a-66732ec6fd74 service nova] Creating event network-vif-deleted:eb103553-c6cc-4ddf-a29e-95232153322f for instance 1a56660b-3b62-4531-8a68-79d7565c967b on n-h1-master-1 Oct 30 02:09:39.918913 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-ca65ca94-8bba-4b85-a1a3-b861ab09984e req-68ebf209-b406-42ad-882a-66732ec6fd74 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033845 Oct 30 02:09:39.922862 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3578/6948] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:09:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:09:40.750518 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ea1291bd-4b51-4243-8f5e-b4e34dd4beed tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:09:40.752073 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ea1291bd-4b51-4243-8f5e-b4e34dd4beed tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 1a56660b-3b62-4531-8a68-79d7565c967b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:09:40.761116 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea1291bd-4b51-4243-8f5e-b4e34dd4beed tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:09:40.761660 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea1291bd-4b51-4243-8f5e-b4e34dd4beed tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:09:40.762109 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea1291bd-4b51-4243-8f5e-b4e34dd4beed tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:09:40.762832 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea1291bd-4b51-4243-8f5e-b4e34dd4beed tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:09:40.763299 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea1291bd-4b51-4243-8f5e-b4e34dd4beed tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:09:40.763999 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea1291bd-4b51-4243-8f5e-b4e34dd4beed tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:09:40.836296 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ea1291bd-4b51-4243-8f5e-b4e34dd4beed tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:09:40.846564 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ea1291bd-4b51-4243-8f5e-b4e34dd4beed tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b" status: 200 len: 1223 microversion: 2.1 time: 0.100145 Oct 30 02:09:40.847757 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3579/6949] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:09:40 2022] GET /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b => generated 1223 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:09:41.869846 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2755d40d-6f88-4566-ab55-7a96fd80b7ea tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:09:41.870520 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2755d40d-6f88-4566-ab55-7a96fd80b7ea tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 1a56660b-3b62-4531-8a68-79d7565c967b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:09:41.877452 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2755d40d-6f88-4566-ab55-7a96fd80b7ea tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:09:41.877958 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2755d40d-6f88-4566-ab55-7a96fd80b7ea tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:09:41.878408 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2755d40d-6f88-4566-ab55-7a96fd80b7ea tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:09:41.879127 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2755d40d-6f88-4566-ab55-7a96fd80b7ea tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:09:41.879590 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2755d40d-6f88-4566-ab55-7a96fd80b7ea tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:09:41.880030 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2755d40d-6f88-4566-ab55-7a96fd80b7ea tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:09:41.945305 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2755d40d-6f88-4566-ab55-7a96fd80b7ea tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:09:41.953957 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2755d40d-6f88-4566-ab55-7a96fd80b7ea tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b" status: 200 len: 1223 microversion: 2.1 time: 0.088077 Oct 30 02:09:41.954527 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3580/6950] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:09:41 2022] GET /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:09:42.977380 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fe5b7b87-430d-4760-83dd-af763c681f36 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:09:42.978065 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fe5b7b87-430d-4760-83dd-af763c681f36 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 1a56660b-3b62-4531-8a68-79d7565c967b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:09:42.985579 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fe5b7b87-430d-4760-83dd-af763c681f36 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:09:42.986078 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fe5b7b87-430d-4760-83dd-af763c681f36 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:09:42.986525 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fe5b7b87-430d-4760-83dd-af763c681f36 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:09:42.987227 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fe5b7b87-430d-4760-83dd-af763c681f36 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:09:42.987692 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fe5b7b87-430d-4760-83dd-af763c681f36 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:09:42.988127 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fe5b7b87-430d-4760-83dd-af763c681f36 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:09:43.052003 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-fe5b7b87-430d-4760-83dd-af763c681f36 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:09:43.060120 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fe5b7b87-430d-4760-83dd-af763c681f36 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b" status: 200 len: 1223 microversion: 2.1 time: 0.086691 Oct 30 02:09:43.060703 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3581/6951] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:09:42 2022] GET /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:09:44.082654 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a815fa5a-b6bd-48a0-abd0-40d2fb965926 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:09:44.083310 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a815fa5a-b6bd-48a0-abd0-40d2fb965926 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 1a56660b-3b62-4531-8a68-79d7565c967b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:09:44.091658 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a815fa5a-b6bd-48a0-abd0-40d2fb965926 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:09:44.092191 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a815fa5a-b6bd-48a0-abd0-40d2fb965926 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:09:44.092643 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a815fa5a-b6bd-48a0-abd0-40d2fb965926 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:09:44.093416 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a815fa5a-b6bd-48a0-abd0-40d2fb965926 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:09:44.093885 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a815fa5a-b6bd-48a0-abd0-40d2fb965926 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:09:44.094324 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a815fa5a-b6bd-48a0-abd0-40d2fb965926 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:09:44.162849 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a815fa5a-b6bd-48a0-abd0-40d2fb965926 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:09:44.170672 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a815fa5a-b6bd-48a0-abd0-40d2fb965926 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b" status: 200 len: 1223 microversion: 2.1 time: 0.091962 Oct 30 02:09:44.174841 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3582/6952] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:09:44 2022] GET /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:09:45.194151 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-130c6700-6695-49f5-a756-bc218acaf487 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:09:45.194833 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-130c6700-6695-49f5-a756-bc218acaf487 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 1a56660b-3b62-4531-8a68-79d7565c967b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:09:45.202027 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-130c6700-6695-49f5-a756-bc218acaf487 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:09:45.202589 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-130c6700-6695-49f5-a756-bc218acaf487 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:09:45.203047 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-130c6700-6695-49f5-a756-bc218acaf487 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:09:45.204386 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-130c6700-6695-49f5-a756-bc218acaf487 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:09:45.204872 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-130c6700-6695-49f5-a756-bc218acaf487 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:09:45.205321 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-130c6700-6695-49f5-a756-bc218acaf487 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:09:45.218984 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-130c6700-6695-49f5-a756-bc218acaf487 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] HTTP exception thrown: Instance 1a56660b-3b62-4531-8a68-79d7565c967b could not be found. Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-130c6700-6695-49f5-a756-bc218acaf487 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Request method failure captured: Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b HTTP/1.1 Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdrUzAoetWsdn8k4HYTcqbVG7Zs75eMmndnkEOPA0S-TmAgSQ2b5nMGLS0qTcKbMaQTaaQPoAGl2nSU9lucNctaJ1zTE6xKSNocI5VbroWnIgVb8SnDnXRJPuQdp0_RS-b7KWfvV5q_soI5fUH8iU2dwXESX56PU08-DTzNpHjo6aLI Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 99e1cde224c845caaa743246e60e338d Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-TestVolumeBootPattern-1509499038 Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/99e1cde224c845caaa743246e60e338d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_99e1cde224c845caaa743246e60e338d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/99e1cde224c845caaa743246e60e338d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/99e1cde224c845caaa743246e60e338d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-TestVolumeBootPattern-1509499038 Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 99e1cde224c845caaa743246e60e338d Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-TestVolumeBootPattern-1509499038 Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-TestVolumeBootPattern-1509499038-project Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: a0ec990e687d427d88dcf9879a1d5b0c Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-TestVolumeBootPattern-1509499038-project Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 1a56660b-3b62-4531-8a68-79d7565c967b could not be found. Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '1a56660b-3b62-4531-8a68-79d7565c967b'} Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a56660b-3b62-4531-8a68-79d7565c967b could not be found. Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a56660b-3b62-4531-8a68-79d7565c967b could not be found. Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:09:45.233245 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:09:45.237499 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:09:45.237499 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:09:45.237499 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:09:45.237499 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:09:45.237499 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:09:45.237499 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a56660b-3b62-4531-8a68-79d7565c967b could not be found. Oct 30 02:09:45.237499 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:09:45.237499 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-130c6700-6695-49f5-a756-bc218acaf487 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Returning 404 to user: Instance 1a56660b-3b62-4531-8a68-79d7565c967b could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:09:45.237499 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-130c6700-6695-49f5-a756-bc218acaf487 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b" status: 404 len: 111 microversion: 2.1 time: 0.031938 Oct 30 02:09:45.237499 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3583/6953] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:09:45 2022] GET /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 02:09:45.271588 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a5bb4759-60b7-4642-8693-4ae49e92310c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1346261419", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-236561478", "security_groups": [{"name": "tempest-secgroup-smoke-520452041"}], "block_device_mapping_v2": [{"uuid": "fbd978d5-c2fc-44a8-a90b-e2144d477887", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "aa518046-7164-40fa-a3f3-11422c6acc97"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:09:45.383919 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-a5bb4759-60b7-4642-8693-4ae49e92310c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] validate_networks() for [('aa518046-7164-40fa-a3f3-11422c6acc97', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 02:09:46.044838 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-a5bb4759-60b7-4642-8693-4ae49e92310c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 02:09:46.045284 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-a5bb4759-60b7-4642-8693-4ae49e92310c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 02:09:46.045815 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-a5bb4759-60b7-4642-8693-4ae49e92310c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 02:09:46.046242 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-a5bb4759-60b7-4642-8693-4ae49e92310c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 02:09:46.046674 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-a5bb4759-60b7-4642-8693-4ae49e92310c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 02:09:46.056174 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a5bb4759-60b7-4642-8693-4ae49e92310c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:09:46.056674 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a5bb4759-60b7-4642-8693-4ae49e92310c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:09:46.057128 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a5bb4759-60b7-4642-8693-4ae49e92310c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:09:46.057909 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a5bb4759-60b7-4642-8693-4ae49e92310c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:09:46.058383 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a5bb4759-60b7-4642-8693-4ae49e92310c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:09:46.058822 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a5bb4759-60b7-4642-8693-4ae49e92310c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:09:46.075958 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-a5bb4759-60b7-4642-8693-4ae49e92310c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Getting quotas for project 99e1cde224c845caaa743246e60e338d. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 02:09:46.081186 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-a5bb4759-60b7-4642-8693-4ae49e92310c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Getting quotas for user a0ec990e687d427d88dcf9879a1d5b0c and project 99e1cde224c845caaa743246e60e338d. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 02:09:46.138902 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a5bb4759-60b7-4642-8693-4ae49e92310c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 02:09:46.141111 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a5bb4759-60b7-4642-8693-4ae49e92310c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 3df44c76-4a56-4e31-b59a-27e91a3992f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fbd978d5-c2fc-44a8-a90b-e2144d477887',volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 02:09:46.529227 n-d-master-1 devstack@n-api.service[121102]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a5bb4759-60b7-4642-8693-4ae49e92310c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [99dd99fd-7d30-4252-b8a4-f149b0ca47a6] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 30 02:09:47.536687 n-d-master-1 devstack@n-api.service[121102]: INFO oslo.messaging._drivers.impl_rabbit [None req-a5bb4759-60b7-4642-8693-4ae49e92310c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [99dd99fd-7d30-4252-b8a4-f149b0ca47a6] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 55590. Oct 30 02:09:47.541203 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a5bb4759-60b7-4642-8693-4ae49e92310c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.273644 Oct 30 02:09:47.541901 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3584/6954] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 02:09:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 2275 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 30 02:09:47.553703 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-948088f8-4563-4dd1-bab8-e40339adf4eb tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:09:47.554334 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-948088f8-4563-4dd1-bab8-e40339adf4eb tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 3df44c76-4a56-4e31-b59a-27e91a3992f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:09:47.613778 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-948088f8-4563-4dd1-bab8-e40339adf4eb tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:09:47.621576 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-948088f8-4563-4dd1-bab8-e40339adf4eb tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/3df44c76-4a56-4e31-b59a-27e91a3992f9" status: 200 len: 1094 microversion: 2.1 time: 0.071069 Oct 30 02:09:47.622157 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3585/6955] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:09:47 2022] GET /compute/v2.1/servers/3df44c76-4a56-4e31-b59a-27e91a3992f9 => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:09:48.644158 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5688498a-1ba1-425b-84e0-4cec3d616d09 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:09:48.644826 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5688498a-1ba1-425b-84e0-4cec3d616d09 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 3df44c76-4a56-4e31-b59a-27e91a3992f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:09:48.652628 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5688498a-1ba1-425b-84e0-4cec3d616d09 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:09:48.653136 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5688498a-1ba1-425b-84e0-4cec3d616d09 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:09:48.653621 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5688498a-1ba1-425b-84e0-4cec3d616d09 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:09:48.654341 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5688498a-1ba1-425b-84e0-4cec3d616d09 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:09:48.654811 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5688498a-1ba1-425b-84e0-4cec3d616d09 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:09:48.655255 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5688498a-1ba1-425b-84e0-4cec3d616d09 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:09:48.719896 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5688498a-1ba1-425b-84e0-4cec3d616d09 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:09:48.727960 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5688498a-1ba1-425b-84e0-4cec3d616d09 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/3df44c76-4a56-4e31-b59a-27e91a3992f9" status: 200 len: 1144 microversion: 2.1 time: 0.087775 Oct 30 02:09:48.728546 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3586/6956] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:09:48 2022] GET /compute/v2.1/servers/3df44c76-4a56-4e31-b59a-27e91a3992f9 => generated 1144 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:09:49.752093 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-79a42e50-99de-4f89-ba73-d8426856c054 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:09:49.752768 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-79a42e50-99de-4f89-ba73-d8426856c054 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 3df44c76-4a56-4e31-b59a-27e91a3992f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:09:49.760336 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-79a42e50-99de-4f89-ba73-d8426856c054 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:09:49.761191 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-79a42e50-99de-4f89-ba73-d8426856c054 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:09:49.761667 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-79a42e50-99de-4f89-ba73-d8426856c054 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:09:49.762614 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-79a42e50-99de-4f89-ba73-d8426856c054 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:09:49.763073 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-79a42e50-99de-4f89-ba73-d8426856c054 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:09:49.763703 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-79a42e50-99de-4f89-ba73-d8426856c054 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:09:49.854794 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-79a42e50-99de-4f89-ba73-d8426856c054 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:09:49.862891 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-79a42e50-99de-4f89-ba73-d8426856c054 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/3df44c76-4a56-4e31-b59a-27e91a3992f9" status: 200 len: 1200 microversion: 2.1 time: 0.115292 Oct 30 02:09:49.863784 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3587/6957] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:09:49 2022] GET /compute/v2.1/servers/3df44c76-4a56-4e31-b59a-27e91a3992f9 => generated 1200 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:09:50.886259 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-37b0efbd-348c-4626-9a9d-cdc99eea2f1f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:09:50.886884 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-37b0efbd-348c-4626-9a9d-cdc99eea2f1f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 3df44c76-4a56-4e31-b59a-27e91a3992f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:09:50.896387 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-37b0efbd-348c-4626-9a9d-cdc99eea2f1f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:09:50.897197 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-37b0efbd-348c-4626-9a9d-cdc99eea2f1f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:09:50.898435 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-37b0efbd-348c-4626-9a9d-cdc99eea2f1f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:09:50.899334 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-37b0efbd-348c-4626-9a9d-cdc99eea2f1f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:09:50.899808 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-37b0efbd-348c-4626-9a9d-cdc99eea2f1f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:09:50.900250 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-37b0efbd-348c-4626-9a9d-cdc99eea2f1f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:09:51.112731 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-37b0efbd-348c-4626-9a9d-cdc99eea2f1f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:09:51.126200 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-37b0efbd-348c-4626-9a9d-cdc99eea2f1f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/3df44c76-4a56-4e31-b59a-27e91a3992f9" status: 200 len: 1277 microversion: 2.1 time: 0.240363 Oct 30 02:09:51.126200 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3588/6958] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:09:50 2022] GET /compute/v2.1/servers/3df44c76-4a56-4e31-b59a-27e91a3992f9 => generated 1277 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:09:51.454475 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-180eaa38-9c48-4ea8-9471-48f1495b1fd8 req-09166d82-7a57-4c51-9e1e-102128b805bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3df44c76-4a56-4e31-b59a-27e91a3992f9", "tag": "a93aa28f-bd2d-4c2f-a97b-d8bf82af668b"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:09:51.456218 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-180eaa38-9c48-4ea8-9471-48f1495b1fd8 req-09166d82-7a57-4c51-9e1e-102128b805bc service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:09:51.456832 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-180eaa38-9c48-4ea8-9471-48f1495b1fd8 req-09166d82-7a57-4c51-9e1e-102128b805bc service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:09:51.457364 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-180eaa38-9c48-4ea8-9471-48f1495b1fd8 req-09166d82-7a57-4c51-9e1e-102128b805bc service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:09:51.469047 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-180eaa38-9c48-4ea8-9471-48f1495b1fd8 req-09166d82-7a57-4c51-9e1e-102128b805bc service nova] Creating event network-changed:a93aa28f-bd2d-4c2f-a97b-d8bf82af668b for instance 3df44c76-4a56-4e31-b59a-27e91a3992f9 on n-h2-master-1 Oct 30 02:09:51.474911 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-180eaa38-9c48-4ea8-9471-48f1495b1fd8 req-09166d82-7a57-4c51-9e1e-102128b805bc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033753 Oct 30 02:09:51.475458 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3589/6959] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:09:52.147343 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0b3204b2-2d8b-41ae-b538-a0c9bbef5484 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:09:52.148395 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0b3204b2-2d8b-41ae-b538-a0c9bbef5484 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 3df44c76-4a56-4e31-b59a-27e91a3992f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:09:52.155864 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b3204b2-2d8b-41ae-b538-a0c9bbef5484 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:09:52.157186 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b3204b2-2d8b-41ae-b538-a0c9bbef5484 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:09:52.157764 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b3204b2-2d8b-41ae-b538-a0c9bbef5484 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:09:52.158607 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b3204b2-2d8b-41ae-b538-a0c9bbef5484 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:09:52.159146 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b3204b2-2d8b-41ae-b538-a0c9bbef5484 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:09:52.159654 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b3204b2-2d8b-41ae-b538-a0c9bbef5484 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:09:52.344203 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0b3204b2-2d8b-41ae-b538-a0c9bbef5484 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:09:52.351174 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0b3204b2-2d8b-41ae-b538-a0c9bbef5484 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/3df44c76-4a56-4e31-b59a-27e91a3992f9" status: 200 len: 1277 microversion: 2.1 time: 0.208326 Oct 30 02:09:52.351748 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3590/6960] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:09:52 2022] GET /compute/v2.1/servers/3df44c76-4a56-4e31-b59a-27e91a3992f9 => generated 1277 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:09:53.373208 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-351a7d4a-60fc-4940-a7de-0ece05ccbcf7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:09:53.373892 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-351a7d4a-60fc-4940-a7de-0ece05ccbcf7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 3df44c76-4a56-4e31-b59a-27e91a3992f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:09:53.381224 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-351a7d4a-60fc-4940-a7de-0ece05ccbcf7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:09:53.381753 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-351a7d4a-60fc-4940-a7de-0ece05ccbcf7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:09:53.382201 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-351a7d4a-60fc-4940-a7de-0ece05ccbcf7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:09:53.382912 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-351a7d4a-60fc-4940-a7de-0ece05ccbcf7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:09:53.383375 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-351a7d4a-60fc-4940-a7de-0ece05ccbcf7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:09:53.383835 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-351a7d4a-60fc-4940-a7de-0ece05ccbcf7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:09:53.515185 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-351a7d4a-60fc-4940-a7de-0ece05ccbcf7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:09:53.522996 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-351a7d4a-60fc-4940-a7de-0ece05ccbcf7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/3df44c76-4a56-4e31-b59a-27e91a3992f9" status: 200 len: 1277 microversion: 2.1 time: 0.153820 Oct 30 02:09:53.523582 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3591/6961] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:09:53 2022] GET /compute/v2.1/servers/3df44c76-4a56-4e31-b59a-27e91a3992f9 => generated 1277 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:09:54.546009 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2ec901a9-de88-4a9d-8522-21d182c68ecb tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:09:54.547159 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2ec901a9-de88-4a9d-8522-21d182c68ecb tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 3df44c76-4a56-4e31-b59a-27e91a3992f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:09:54.554056 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ec901a9-de88-4a9d-8522-21d182c68ecb tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:09:54.554550 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ec901a9-de88-4a9d-8522-21d182c68ecb tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:09:54.555091 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ec901a9-de88-4a9d-8522-21d182c68ecb tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:09:54.555796 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ec901a9-de88-4a9d-8522-21d182c68ecb tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:09:54.556199 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ec901a9-de88-4a9d-8522-21d182c68ecb tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:09:54.556638 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ec901a9-de88-4a9d-8522-21d182c68ecb tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:09:54.577615 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:09:54.704093 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2ec901a9-de88-4a9d-8522-21d182c68ecb tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:09:54.711917 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2ec901a9-de88-4a9d-8522-21d182c68ecb tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/3df44c76-4a56-4e31-b59a-27e91a3992f9" status: 200 len: 1277 microversion: 2.1 time: 0.169799 Oct 30 02:09:54.712494 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3592/6962] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:09:54 2022] GET /compute/v2.1/servers/3df44c76-4a56-4e31-b59a-27e91a3992f9 => generated 1277 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:09:55.734340 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cbf26acf-0f2d-4661-9e40-81bdc7b4a3c9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:09:55.735004 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cbf26acf-0f2d-4661-9e40-81bdc7b4a3c9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 3df44c76-4a56-4e31-b59a-27e91a3992f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:09:55.741812 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cbf26acf-0f2d-4661-9e40-81bdc7b4a3c9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:09:55.742328 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cbf26acf-0f2d-4661-9e40-81bdc7b4a3c9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:09:55.742761 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cbf26acf-0f2d-4661-9e40-81bdc7b4a3c9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:09:55.743464 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cbf26acf-0f2d-4661-9e40-81bdc7b4a3c9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:09:55.743929 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cbf26acf-0f2d-4661-9e40-81bdc7b4a3c9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:09:55.744365 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cbf26acf-0f2d-4661-9e40-81bdc7b4a3c9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:09:55.875284 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-cbf26acf-0f2d-4661-9e40-81bdc7b4a3c9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:09:55.883067 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cbf26acf-0f2d-4661-9e40-81bdc7b4a3c9 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/3df44c76-4a56-4e31-b59a-27e91a3992f9" status: 200 len: 1265 microversion: 2.1 time: 0.152638 Oct 30 02:09:55.883656 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3593/6963] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:09:55 2022] GET /compute/v2.1/servers/3df44c76-4a56-4e31-b59a-27e91a3992f9 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:09:56.907360 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1e52cec5-6e11-4d86-9370-496e74206e1f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:09:56.907990 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1e52cec5-6e11-4d86-9370-496e74206e1f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 3df44c76-4a56-4e31-b59a-27e91a3992f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:09:56.909872 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:09:56.915460 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1e52cec5-6e11-4d86-9370-496e74206e1f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:09:56.915951 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1e52cec5-6e11-4d86-9370-496e74206e1f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:09:56.916398 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1e52cec5-6e11-4d86-9370-496e74206e1f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:09:56.917094 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1e52cec5-6e11-4d86-9370-496e74206e1f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:09:56.917585 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1e52cec5-6e11-4d86-9370-496e74206e1f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:09:56.918020 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1e52cec5-6e11-4d86-9370-496e74206e1f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:09:57.046155 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1e52cec5-6e11-4d86-9370-496e74206e1f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:09:57.054012 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1e52cec5-6e11-4d86-9370-496e74206e1f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/3df44c76-4a56-4e31-b59a-27e91a3992f9" status: 200 len: 1265 microversion: 2.1 time: 0.151242 Oct 30 02:09:57.054586 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3594/6964] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:09:56 2022] GET /compute/v2.1/servers/3df44c76-4a56-4e31-b59a-27e91a3992f9 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:09:58.077453 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f70f1d83-d8d2-4c4a-8c14-7001817a4571 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:09:58.078155 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f70f1d83-d8d2-4c4a-8c14-7001817a4571 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 3df44c76-4a56-4e31-b59a-27e91a3992f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:09:58.080052 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=8 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:09:58.085954 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f70f1d83-d8d2-4c4a-8c14-7001817a4571 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:09:58.092097 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f70f1d83-d8d2-4c4a-8c14-7001817a4571 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:09:58.092097 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f70f1d83-d8d2-4c4a-8c14-7001817a4571 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:09:58.092097 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f70f1d83-d8d2-4c4a-8c14-7001817a4571 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:09:58.092097 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f70f1d83-d8d2-4c4a-8c14-7001817a4571 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:09:58.092097 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f70f1d83-d8d2-4c4a-8c14-7001817a4571 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:09:58.222816 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f70f1d83-d8d2-4c4a-8c14-7001817a4571 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:09:58.230683 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f70f1d83-d8d2-4c4a-8c14-7001817a4571 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/3df44c76-4a56-4e31-b59a-27e91a3992f9" status: 200 len: 1265 microversion: 2.1 time: 0.157455 Oct 30 02:09:58.231253 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3595/6965] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:09:58 2022] GET /compute/v2.1/servers/3df44c76-4a56-4e31-b59a-27e91a3992f9 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:09:59.254586 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bb066543-9d0d-413c-b9bf-7a8251914f3b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:09:59.255247 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bb066543-9d0d-413c-b9bf-7a8251914f3b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 3df44c76-4a56-4e31-b59a-27e91a3992f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:09:59.262418 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb066543-9d0d-413c-b9bf-7a8251914f3b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:09:59.262923 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb066543-9d0d-413c-b9bf-7a8251914f3b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:09:59.263382 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb066543-9d0d-413c-b9bf-7a8251914f3b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:09:59.264099 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb066543-9d0d-413c-b9bf-7a8251914f3b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:09:59.264597 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb066543-9d0d-413c-b9bf-7a8251914f3b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:09:59.265040 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb066543-9d0d-413c-b9bf-7a8251914f3b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:09:59.397814 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bb066543-9d0d-413c-b9bf-7a8251914f3b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:09:59.405867 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bb066543-9d0d-413c-b9bf-7a8251914f3b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/3df44c76-4a56-4e31-b59a-27e91a3992f9" status: 200 len: 1265 microversion: 2.1 time: 0.155908 Oct 30 02:09:59.406452 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3596/6966] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:09:59 2022] GET /compute/v2.1/servers/3df44c76-4a56-4e31-b59a-27e91a3992f9 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:10:00.428617 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a2a79e97-bc10-439a-95c6-f5c66e9abe41 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:10:00.429300 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a2a79e97-bc10-439a-95c6-f5c66e9abe41 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 3df44c76-4a56-4e31-b59a-27e91a3992f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:10:00.436103 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a2a79e97-bc10-439a-95c6-f5c66e9abe41 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:10:00.436599 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a2a79e97-bc10-439a-95c6-f5c66e9abe41 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:10:00.437581 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a2a79e97-bc10-439a-95c6-f5c66e9abe41 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:10:00.438285 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a2a79e97-bc10-439a-95c6-f5c66e9abe41 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:10:00.438751 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a2a79e97-bc10-439a-95c6-f5c66e9abe41 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:10:00.439186 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a2a79e97-bc10-439a-95c6-f5c66e9abe41 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:10:00.570970 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a2a79e97-bc10-439a-95c6-f5c66e9abe41 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:10:00.578953 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a2a79e97-bc10-439a-95c6-f5c66e9abe41 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/3df44c76-4a56-4e31-b59a-27e91a3992f9" status: 200 len: 1265 microversion: 2.1 time: 0.154253 Oct 30 02:10:00.579525 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3597/6967] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:10:00 2022] GET /compute/v2.1/servers/3df44c76-4a56-4e31-b59a-27e91a3992f9 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:10:01.601562 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d3076770-dad1-45ef-b201-0746088657b1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:10:01.602261 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d3076770-dad1-45ef-b201-0746088657b1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 3df44c76-4a56-4e31-b59a-27e91a3992f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:10:01.609102 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3076770-dad1-45ef-b201-0746088657b1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:10:01.610134 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3076770-dad1-45ef-b201-0746088657b1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:10:01.610578 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3076770-dad1-45ef-b201-0746088657b1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:10:01.611304 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3076770-dad1-45ef-b201-0746088657b1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:10:01.611758 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3076770-dad1-45ef-b201-0746088657b1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:10:01.612199 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3076770-dad1-45ef-b201-0746088657b1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:10:01.740286 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d3076770-dad1-45ef-b201-0746088657b1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:10:01.747866 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d3076770-dad1-45ef-b201-0746088657b1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/3df44c76-4a56-4e31-b59a-27e91a3992f9" status: 200 len: 1265 microversion: 2.1 time: 0.150229 Oct 30 02:10:01.748437 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3598/6968] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:10:01 2022] GET /compute/v2.1/servers/3df44c76-4a56-4e31-b59a-27e91a3992f9 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:10:02.770789 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-419bc3dc-9605-48a1-83ba-220467d79929 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:10:02.771415 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-419bc3dc-9605-48a1-83ba-220467d79929 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 3df44c76-4a56-4e31-b59a-27e91a3992f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:10:02.778253 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-419bc3dc-9605-48a1-83ba-220467d79929 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:10:02.778752 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-419bc3dc-9605-48a1-83ba-220467d79929 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:10:02.779200 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-419bc3dc-9605-48a1-83ba-220467d79929 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:10:02.779902 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-419bc3dc-9605-48a1-83ba-220467d79929 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:10:02.780365 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-419bc3dc-9605-48a1-83ba-220467d79929 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:10:02.780798 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-419bc3dc-9605-48a1-83ba-220467d79929 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:10:02.912400 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-419bc3dc-9605-48a1-83ba-220467d79929 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:10:02.920133 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-419bc3dc-9605-48a1-83ba-220467d79929 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/3df44c76-4a56-4e31-b59a-27e91a3992f9" status: 200 len: 1265 microversion: 2.1 time: 0.153897 Oct 30 02:10:02.920713 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3599/6969] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:10:02 2022] GET /compute/v2.1/servers/3df44c76-4a56-4e31-b59a-27e91a3992f9 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:10:03.943608 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-48cf47fc-5320-42d6-a532-08ecd9b8c411 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:10:03.944172 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-48cf47fc-5320-42d6-a532-08ecd9b8c411 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 3df44c76-4a56-4e31-b59a-27e91a3992f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:10:03.951323 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-48cf47fc-5320-42d6-a532-08ecd9b8c411 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:10:03.951820 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-48cf47fc-5320-42d6-a532-08ecd9b8c411 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:10:03.952270 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-48cf47fc-5320-42d6-a532-08ecd9b8c411 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:10:03.952978 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-48cf47fc-5320-42d6-a532-08ecd9b8c411 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:10:03.954032 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-48cf47fc-5320-42d6-a532-08ecd9b8c411 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:10:03.954476 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-48cf47fc-5320-42d6-a532-08ecd9b8c411 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:10:04.085658 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-48cf47fc-5320-42d6-a532-08ecd9b8c411 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:10:04.093654 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-48cf47fc-5320-42d6-a532-08ecd9b8c411 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/3df44c76-4a56-4e31-b59a-27e91a3992f9" status: 200 len: 1265 microversion: 2.1 time: 0.153940 Oct 30 02:10:04.094744 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3600/6970] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:10:03 2022] GET /compute/v2.1/servers/3df44c76-4a56-4e31-b59a-27e91a3992f9 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:10:05.117159 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-40efaa6b-c58f-4020-88f0-c7ed77a195e7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:10:05.117840 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-40efaa6b-c58f-4020-88f0-c7ed77a195e7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 3df44c76-4a56-4e31-b59a-27e91a3992f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:10:05.124578 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-40efaa6b-c58f-4020-88f0-c7ed77a195e7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:10:05.125079 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-40efaa6b-c58f-4020-88f0-c7ed77a195e7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:10:05.126599 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-40efaa6b-c58f-4020-88f0-c7ed77a195e7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:10:05.127608 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-40efaa6b-c58f-4020-88f0-c7ed77a195e7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:10:05.128083 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-40efaa6b-c58f-4020-88f0-c7ed77a195e7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:10:05.128529 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-40efaa6b-c58f-4020-88f0-c7ed77a195e7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:10:05.259527 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-40efaa6b-c58f-4020-88f0-c7ed77a195e7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:10:05.267298 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-40efaa6b-c58f-4020-88f0-c7ed77a195e7 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/3df44c76-4a56-4e31-b59a-27e91a3992f9" status: 200 len: 1265 microversion: 2.1 time: 0.154308 Oct 30 02:10:05.267871 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3601/6971] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:10:05 2022] GET /compute/v2.1/servers/3df44c76-4a56-4e31-b59a-27e91a3992f9 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:10:06.289390 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a2b089fc-54e9-4aed-8fa7-f5788f775038 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:10:06.290055 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a2b089fc-54e9-4aed-8fa7-f5788f775038 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 3df44c76-4a56-4e31-b59a-27e91a3992f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:10:06.296745 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a2b089fc-54e9-4aed-8fa7-f5788f775038 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:10:06.297893 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a2b089fc-54e9-4aed-8fa7-f5788f775038 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:10:06.298353 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a2b089fc-54e9-4aed-8fa7-f5788f775038 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:10:06.299062 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a2b089fc-54e9-4aed-8fa7-f5788f775038 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:10:06.299531 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a2b089fc-54e9-4aed-8fa7-f5788f775038 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:10:06.299971 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a2b089fc-54e9-4aed-8fa7-f5788f775038 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:10:06.434098 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a2b089fc-54e9-4aed-8fa7-f5788f775038 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:10:06.441830 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a2b089fc-54e9-4aed-8fa7-f5788f775038 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/3df44c76-4a56-4e31-b59a-27e91a3992f9" status: 200 len: 1265 microversion: 2.1 time: 0.156381 Oct 30 02:10:06.442404 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3602/6972] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:10:06 2022] GET /compute/v2.1/servers/3df44c76-4a56-4e31-b59a-27e91a3992f9 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:10:06.554137 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-662e41be-ae53-4d4a-bf17-caca791eac1d req-46430b6f-2b0b-46f9-bda9-5593482c6399 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3df44c76-4a56-4e31-b59a-27e91a3992f9", "name": "network-vif-plugged", "status": "completed", "tag": "a93aa28f-bd2d-4c2f-a97b-d8bf82af668b"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:10:06.563621 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-662e41be-ae53-4d4a-bf17-caca791eac1d req-46430b6f-2b0b-46f9-bda9-5593482c6399 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:10:06.564118 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-662e41be-ae53-4d4a-bf17-caca791eac1d req-46430b6f-2b0b-46f9-bda9-5593482c6399 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:10:06.564563 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-662e41be-ae53-4d4a-bf17-caca791eac1d req-46430b6f-2b0b-46f9-bda9-5593482c6399 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:10:06.576051 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-662e41be-ae53-4d4a-bf17-caca791eac1d req-46430b6f-2b0b-46f9-bda9-5593482c6399 service nova] Creating event network-vif-plugged:a93aa28f-bd2d-4c2f-a97b-d8bf82af668b for instance 3df44c76-4a56-4e31-b59a-27e91a3992f9 on n-h2-master-1 Oct 30 02:10:06.581599 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-662e41be-ae53-4d4a-bf17-caca791eac1d req-46430b6f-2b0b-46f9-bda9-5593482c6399 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086645 Oct 30 02:10:06.582154 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3603/6973] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:10:07.467576 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7f905f70-f367-4d6a-8012-86be3a48e767 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:10:07.468313 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7f905f70-f367-4d6a-8012-86be3a48e767 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 3df44c76-4a56-4e31-b59a-27e91a3992f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:10:07.470926 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:10:07.475864 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7f905f70-f367-4d6a-8012-86be3a48e767 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:10:07.476364 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7f905f70-f367-4d6a-8012-86be3a48e767 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:10:07.476808 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7f905f70-f367-4d6a-8012-86be3a48e767 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:10:07.477535 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7f905f70-f367-4d6a-8012-86be3a48e767 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:10:07.478002 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7f905f70-f367-4d6a-8012-86be3a48e767 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:10:07.478484 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7f905f70-f367-4d6a-8012-86be3a48e767 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:10:07.612469 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7f905f70-f367-4d6a-8012-86be3a48e767 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:10:07.620102 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7f905f70-f367-4d6a-8012-86be3a48e767 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/3df44c76-4a56-4e31-b59a-27e91a3992f9" status: 200 len: 1265 microversion: 2.1 time: 0.158104 Oct 30 02:10:07.620670 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3604/6974] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:10:07 2022] GET /compute/v2.1/servers/3df44c76-4a56-4e31-b59a-27e91a3992f9 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:10:08.643027 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3340394b-f5dc-40bb-8c5a-db2ebbc7523e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:10:08.643658 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3340394b-f5dc-40bb-8c5a-db2ebbc7523e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 3df44c76-4a56-4e31-b59a-27e91a3992f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:10:08.650682 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3340394b-f5dc-40bb-8c5a-db2ebbc7523e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:10:08.651182 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3340394b-f5dc-40bb-8c5a-db2ebbc7523e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:10:08.651637 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3340394b-f5dc-40bb-8c5a-db2ebbc7523e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:10:08.652345 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3340394b-f5dc-40bb-8c5a-db2ebbc7523e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:10:08.652843 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3340394b-f5dc-40bb-8c5a-db2ebbc7523e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:10:08.653288 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3340394b-f5dc-40bb-8c5a-db2ebbc7523e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:10:08.788098 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3340394b-f5dc-40bb-8c5a-db2ebbc7523e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:10:08.796388 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3340394b-f5dc-40bb-8c5a-db2ebbc7523e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/3df44c76-4a56-4e31-b59a-27e91a3992f9" status: 200 len: 1452 microversion: 2.1 time: 0.157772 Oct 30 02:10:08.796970 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3605/6975] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:10:08 2022] GET /compute/v2.1/servers/3df44c76-4a56-4e31-b59a-27e91a3992f9 => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:10:08.817963 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-941a4679-7d10-4306-afc3-8c23a929a254 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:10:08.818591 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-941a4679-7d10-4306-afc3-8c23a929a254 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 3df44c76-4a56-4e31-b59a-27e91a3992f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:10:08.824205 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-941a4679-7d10-4306-afc3-8c23a929a254 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:10:08.824702 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-941a4679-7d10-4306-afc3-8c23a929a254 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:10:08.825438 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-941a4679-7d10-4306-afc3-8c23a929a254 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:10:08.826142 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-941a4679-7d10-4306-afc3-8c23a929a254 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:10:08.826611 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-941a4679-7d10-4306-afc3-8c23a929a254 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:10:08.827866 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-941a4679-7d10-4306-afc3-8c23a929a254 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:10:08.956845 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-941a4679-7d10-4306-afc3-8c23a929a254 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:10:08.964620 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-941a4679-7d10-4306-afc3-8c23a929a254 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/3df44c76-4a56-4e31-b59a-27e91a3992f9" status: 200 len: 1452 microversion: 2.1 time: 0.150176 Oct 30 02:10:08.965195 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3606/6976] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:10:08 2022] GET /compute/v2.1/servers/3df44c76-4a56-4e31-b59a-27e91a3992f9 => generated 1452 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:10:11.243115 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-1606e448-0e18-4b32-80e5-7029507da5d3 req-cc50e1e3-2fdc-4ddb-8014-c0b448926262 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3df44c76-4a56-4e31-b59a-27e91a3992f9", "tag": "a93aa28f-bd2d-4c2f-a97b-d8bf82af668b"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:10:11.254198 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-1606e448-0e18-4b32-80e5-7029507da5d3 req-cc50e1e3-2fdc-4ddb-8014-c0b448926262 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:10:11.254773 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-1606e448-0e18-4b32-80e5-7029507da5d3 req-cc50e1e3-2fdc-4ddb-8014-c0b448926262 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:10:11.255284 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-1606e448-0e18-4b32-80e5-7029507da5d3 req-cc50e1e3-2fdc-4ddb-8014-c0b448926262 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:10:11.266741 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-1606e448-0e18-4b32-80e5-7029507da5d3 req-cc50e1e3-2fdc-4ddb-8014-c0b448926262 service nova] Creating event network-changed:a93aa28f-bd2d-4c2f-a97b-d8bf82af668b for instance 3df44c76-4a56-4e31-b59a-27e91a3992f9 on n-h2-master-1 Oct 30 02:10:11.271857 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-1606e448-0e18-4b32-80e5-7029507da5d3 req-cc50e1e3-2fdc-4ddb-8014-c0b448926262 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032563 Oct 30 02:10:11.272655 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3607/6977] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:11:04.123223 n-d-master-1 devstack@n-api.service[121103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 30 02:11:04.123767 n-d-master-1 devstack@n-api.service[121103]: Sun Oct 30 02:11:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.13) !!! Oct 30 02:11:04.125786 n-d-master-1 devstack@n-api.service[121103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 30 02:11:04.125786 n-d-master-1 devstack@n-api.service[121103]: Sun Oct 30 02:11:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.13) !!! Oct 30 02:11:05.154888 n-d-master-1 devstack@n-api.service[121103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 30 02:11:05.155504 n-d-master-1 devstack@n-api.service[121103]: Sun Oct 30 02:11:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.13) !!! Oct 30 02:12:41.346634 n-d-master-1 devstack@n-api.service[121102]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8caffca0-53fa-4143-8e03-000c8bb53286] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 30 02:12:41.347472 n-d-master-1 devstack@n-api.service[121102]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ea6ec045-ee0c-4212-8fa5-a40465026485] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 30 02:12:41.348143 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=7 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:12:41.348935 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=84 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:12:41.350669 n-d-master-1 devstack@n-api.service[121102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 30 02:12:41.350822 n-d-master-1 devstack@n-api.service[121102]: Sun Oct 30 02:12:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.13) !!! Oct 30 02:12:41.356679 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-083d4fea-5f51-447d-afae-9e9a42db190f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-396655636", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-236561478", "security_groups": [{"name": "tempest-secgroup-smoke-520452041"}], "block_device_mapping_v2": [{"uuid": "58d0bab7-99f4-4cfa-b218-2b7651dd876e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "aa518046-7164-40fa-a3f3-11422c6acc97"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:12:41.627251 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-083d4fea-5f51-447d-afae-9e9a42db190f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] validate_networks() for [('aa518046-7164-40fa-a3f3-11422c6acc97', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 02:12:42.088926 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-083d4fea-5f51-447d-afae-9e9a42db190f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 02:12:42.089378 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-083d4fea-5f51-447d-afae-9e9a42db190f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 02:12:42.089873 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-083d4fea-5f51-447d-afae-9e9a42db190f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 02:12:42.090300 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-083d4fea-5f51-447d-afae-9e9a42db190f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 02:12:42.091397 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-083d4fea-5f51-447d-afae-9e9a42db190f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 02:12:42.102930 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-083d4fea-5f51-447d-afae-9e9a42db190f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:12:42.107545 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-083d4fea-5f51-447d-afae-9e9a42db190f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:12:42.107545 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-083d4fea-5f51-447d-afae-9e9a42db190f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:12:42.107545 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-083d4fea-5f51-447d-afae-9e9a42db190f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:12:42.107545 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-083d4fea-5f51-447d-afae-9e9a42db190f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:12:42.107545 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-083d4fea-5f51-447d-afae-9e9a42db190f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:12:42.126493 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-083d4fea-5f51-447d-afae-9e9a42db190f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Getting quotas for project 99e1cde224c845caaa743246e60e338d. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 02:12:42.136069 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-083d4fea-5f51-447d-afae-9e9a42db190f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Getting quotas for user a0ec990e687d427d88dcf9879a1d5b0c and project 99e1cde224c845caaa743246e60e338d. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 02:12:42.190854 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-083d4fea-5f51-447d-afae-9e9a42db190f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 02:12:42.193103 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-083d4fea-5f51-447d-afae-9e9a42db190f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: ec27a3e6-bd38-401b-a4da-1006a79b1f6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='58d0bab7-99f4-4cfa-b218-2b7651dd876e',volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 02:12:42.355539 n-d-master-1 devstack@n-api.service[121102]: INFO oslo.messaging._drivers.impl_rabbit [-] [8caffca0-53fa-4143-8e03-000c8bb53286] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 55824. Oct 30 02:12:42.356181 n-d-master-1 devstack@n-api.service[121102]: INFO oslo.messaging._drivers.impl_rabbit [-] [ea6ec045-ee0c-4212-8fa5-a40465026485] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 55826. Oct 30 02:12:42.645109 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-083d4fea-5f51-447d-afae-9e9a42db190f tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.300109 Oct 30 02:12:42.645771 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3608/6978] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 02:12:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 1302 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 30 02:12:42.656583 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-078d403b-d89f-4256-9b7d-a0f7df2e5738 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:12:42.657376 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-078d403b-d89f-4256-9b7d-a0f7df2e5738 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: ec27a3e6-bd38-401b-a4da-1006a79b1f6e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:12:42.712991 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-078d403b-d89f-4256-9b7d-a0f7df2e5738 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:12:42.721033 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-078d403b-d89f-4256-9b7d-a0f7df2e5738 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/ec27a3e6-bd38-401b-a4da-1006a79b1f6e" status: 200 len: 1093 microversion: 2.1 time: 0.068254 Oct 30 02:12:42.725605 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3609/6979] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:12:42 2022] GET /compute/v2.1/servers/ec27a3e6-bd38-401b-a4da-1006a79b1f6e => generated 1093 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:12:43.743853 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-351e3153-0255-4d22-baa6-b88836018e95 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:12:43.744506 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-351e3153-0255-4d22-baa6-b88836018e95 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: ec27a3e6-bd38-401b-a4da-1006a79b1f6e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:12:43.752405 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-351e3153-0255-4d22-baa6-b88836018e95 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:12:43.752928 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-351e3153-0255-4d22-baa6-b88836018e95 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:12:43.753402 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-351e3153-0255-4d22-baa6-b88836018e95 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:12:43.754119 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-351e3153-0255-4d22-baa6-b88836018e95 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:12:43.754592 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-351e3153-0255-4d22-baa6-b88836018e95 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:12:43.755033 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-351e3153-0255-4d22-baa6-b88836018e95 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:12:43.820206 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-351e3153-0255-4d22-baa6-b88836018e95 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:12:43.829192 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-351e3153-0255-4d22-baa6-b88836018e95 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/ec27a3e6-bd38-401b-a4da-1006a79b1f6e" status: 200 len: 1143 microversion: 2.1 time: 0.089360 Oct 30 02:12:43.829800 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3610/6980] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:12:43 2022] GET /compute/v2.1/servers/ec27a3e6-bd38-401b-a4da-1006a79b1f6e => generated 1143 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:12:44.852107 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-89d179ca-4c36-42b0-90cd-7e47f42159fd tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:12:44.852743 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-89d179ca-4c36-42b0-90cd-7e47f42159fd tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: ec27a3e6-bd38-401b-a4da-1006a79b1f6e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:12:44.859736 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-89d179ca-4c36-42b0-90cd-7e47f42159fd tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:12:44.860240 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-89d179ca-4c36-42b0-90cd-7e47f42159fd tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:12:44.861995 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-89d179ca-4c36-42b0-90cd-7e47f42159fd tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:12:44.861995 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-89d179ca-4c36-42b0-90cd-7e47f42159fd tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:12:44.861995 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-89d179ca-4c36-42b0-90cd-7e47f42159fd tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:12:44.862307 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-89d179ca-4c36-42b0-90cd-7e47f42159fd tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:12:44.940239 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-89d179ca-4c36-42b0-90cd-7e47f42159fd tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:12:44.948691 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-89d179ca-4c36-42b0-90cd-7e47f42159fd tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/ec27a3e6-bd38-401b-a4da-1006a79b1f6e" status: 200 len: 1199 microversion: 2.1 time: 0.100549 Oct 30 02:12:44.949268 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3611/6981] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:12:44 2022] GET /compute/v2.1/servers/ec27a3e6-bd38-401b-a4da-1006a79b1f6e => generated 1199 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:12:45.976552 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3f25ba54-4b91-4da3-86f2-8200a4c4dd32 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:12:45.976552 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3f25ba54-4b91-4da3-86f2-8200a4c4dd32 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: ec27a3e6-bd38-401b-a4da-1006a79b1f6e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:12:45.982714 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f25ba54-4b91-4da3-86f2-8200a4c4dd32 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:12:45.983569 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f25ba54-4b91-4da3-86f2-8200a4c4dd32 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:12:45.992659 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f25ba54-4b91-4da3-86f2-8200a4c4dd32 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:12:45.999077 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f25ba54-4b91-4da3-86f2-8200a4c4dd32 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:12:45.999077 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f25ba54-4b91-4da3-86f2-8200a4c4dd32 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:12:45.999077 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f25ba54-4b91-4da3-86f2-8200a4c4dd32 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:12:46.246846 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3f25ba54-4b91-4da3-86f2-8200a4c4dd32 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:12:46.256490 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3f25ba54-4b91-4da3-86f2-8200a4c4dd32 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/ec27a3e6-bd38-401b-a4da-1006a79b1f6e" status: 200 len: 1276 microversion: 2.1 time: 0.287218 Oct 30 02:12:46.266260 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3612/6982] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:12:45 2022] GET /compute/v2.1/servers/ec27a3e6-bd38-401b-a4da-1006a79b1f6e => generated 1276 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:12:47.025927 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-0621ce41-1f8f-40f7-aae0-74474fb8d108 req-d773a180-41f5-484a-9605-cccfd7b53ca2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec27a3e6-bd38-401b-a4da-1006a79b1f6e", "tag": "60bc7816-d837-48a4-9e0d-5bb582e6a64e"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:12:47.036226 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-0621ce41-1f8f-40f7-aae0-74474fb8d108 req-d773a180-41f5-484a-9605-cccfd7b53ca2 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:12:47.036735 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-0621ce41-1f8f-40f7-aae0-74474fb8d108 req-d773a180-41f5-484a-9605-cccfd7b53ca2 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:12:47.037181 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-0621ce41-1f8f-40f7-aae0-74474fb8d108 req-d773a180-41f5-484a-9605-cccfd7b53ca2 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:12:47.048685 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-0621ce41-1f8f-40f7-aae0-74474fb8d108 req-d773a180-41f5-484a-9605-cccfd7b53ca2 service nova] Creating event network-changed:60bc7816-d837-48a4-9e0d-5bb582e6a64e for instance ec27a3e6-bd38-401b-a4da-1006a79b1f6e on n-h1-master-1 Oct 30 02:12:47.052064 n-d-master-1 devstack@n-api.service[121102]: ERROR oslo.messaging._drivers.impl_rabbit [req-0621ce41-1f8f-40f7-aae0-74474fb8d108 req-d773a180-41f5-484a-9605-cccfd7b53ca2 service nova] [9fa1548e-4713-4d8f-9692-65591b8a8cee] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 30 02:12:48.060593 n-d-master-1 devstack@n-api.service[121102]: INFO oslo.messaging._drivers.impl_rabbit [req-0621ce41-1f8f-40f7-aae0-74474fb8d108 req-d773a180-41f5-484a-9605-cccfd7b53ca2 service nova] [9fa1548e-4713-4d8f-9692-65591b8a8cee] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 55858. Oct 30 02:12:48.064914 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-0621ce41-1f8f-40f7-aae0-74474fb8d108 req-d773a180-41f5-484a-9605-cccfd7b53ca2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.093869 Oct 30 02:12:48.069296 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3613/6983] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:12:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:12:48.075184 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-59dc675f-b96c-403a-a10a-3e52dabb62ce tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:12:48.076646 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-59dc675f-b96c-403a-a10a-3e52dabb62ce tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: ec27a3e6-bd38-401b-a4da-1006a79b1f6e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:12:48.084301 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-59dc675f-b96c-403a-a10a-3e52dabb62ce tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:12:48.084944 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-59dc675f-b96c-403a-a10a-3e52dabb62ce tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:12:48.085601 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-59dc675f-b96c-403a-a10a-3e52dabb62ce tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:12:48.086439 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-59dc675f-b96c-403a-a10a-3e52dabb62ce tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:12:48.087042 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-59dc675f-b96c-403a-a10a-3e52dabb62ce tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:12:48.087600 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-59dc675f-b96c-403a-a10a-3e52dabb62ce tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:12:48.335677 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-59dc675f-b96c-403a-a10a-3e52dabb62ce tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:12:48.344038 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-59dc675f-b96c-403a-a10a-3e52dabb62ce tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/ec27a3e6-bd38-401b-a4da-1006a79b1f6e" status: 200 len: 1276 microversion: 2.1 time: 0.273852 Oct 30 02:12:48.344641 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3614/6984] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:12:48 2022] GET /compute/v2.1/servers/ec27a3e6-bd38-401b-a4da-1006a79b1f6e => generated 1276 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:12:49.368616 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-861b798e-d0a4-474b-b041-3a23d002331d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:12:49.369325 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-861b798e-d0a4-474b-b041-3a23d002331d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: ec27a3e6-bd38-401b-a4da-1006a79b1f6e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:12:49.376919 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-861b798e-d0a4-474b-b041-3a23d002331d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:12:49.377449 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-861b798e-d0a4-474b-b041-3a23d002331d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:12:49.377930 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-861b798e-d0a4-474b-b041-3a23d002331d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:12:49.378637 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-861b798e-d0a4-474b-b041-3a23d002331d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:12:49.379107 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-861b798e-d0a4-474b-b041-3a23d002331d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:12:49.379546 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-861b798e-d0a4-474b-b041-3a23d002331d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:12:49.513542 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-861b798e-d0a4-474b-b041-3a23d002331d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:12:49.521682 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-861b798e-d0a4-474b-b041-3a23d002331d tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/ec27a3e6-bd38-401b-a4da-1006a79b1f6e" status: 200 len: 1276 microversion: 2.1 time: 0.157307 Oct 30 02:12:49.527047 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3615/6985] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:12:49 2022] GET /compute/v2.1/servers/ec27a3e6-bd38-401b-a4da-1006a79b1f6e => generated 1276 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:12:50.544221 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ebd51eaf-e96b-4629-8efc-8b260133e5ac tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:12:50.544855 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ebd51eaf-e96b-4629-8efc-8b260133e5ac tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: ec27a3e6-bd38-401b-a4da-1006a79b1f6e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:12:50.552317 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ebd51eaf-e96b-4629-8efc-8b260133e5ac tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:12:50.553554 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ebd51eaf-e96b-4629-8efc-8b260133e5ac tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:12:50.553554 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ebd51eaf-e96b-4629-8efc-8b260133e5ac tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:12:50.554079 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ebd51eaf-e96b-4629-8efc-8b260133e5ac tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:12:50.554547 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ebd51eaf-e96b-4629-8efc-8b260133e5ac tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:12:50.555066 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ebd51eaf-e96b-4629-8efc-8b260133e5ac tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:12:50.687599 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ebd51eaf-e96b-4629-8efc-8b260133e5ac tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:12:50.695494 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ebd51eaf-e96b-4629-8efc-8b260133e5ac tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/ec27a3e6-bd38-401b-a4da-1006a79b1f6e" status: 200 len: 1276 microversion: 2.1 time: 0.155384 Oct 30 02:12:50.700246 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3616/6986] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:12:50 2022] GET /compute/v2.1/servers/ec27a3e6-bd38-401b-a4da-1006a79b1f6e => generated 1276 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:12:51.719151 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-081a35f4-2c01-4f25-9fbc-d4114ad3fe90 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:12:51.719803 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-081a35f4-2c01-4f25-9fbc-d4114ad3fe90 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: ec27a3e6-bd38-401b-a4da-1006a79b1f6e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:12:51.726757 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-081a35f4-2c01-4f25-9fbc-d4114ad3fe90 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:12:51.728817 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-081a35f4-2c01-4f25-9fbc-d4114ad3fe90 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:12:51.728817 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-081a35f4-2c01-4f25-9fbc-d4114ad3fe90 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:12:51.728817 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-081a35f4-2c01-4f25-9fbc-d4114ad3fe90 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:12:51.729108 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-081a35f4-2c01-4f25-9fbc-d4114ad3fe90 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:12:51.729350 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-081a35f4-2c01-4f25-9fbc-d4114ad3fe90 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:12:51.865381 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-081a35f4-2c01-4f25-9fbc-d4114ad3fe90 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:12:51.873300 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-081a35f4-2c01-4f25-9fbc-d4114ad3fe90 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/ec27a3e6-bd38-401b-a4da-1006a79b1f6e" status: 200 len: 1264 microversion: 2.1 time: 0.158677 Oct 30 02:12:51.873897 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3617/6987] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:12:51 2022] GET /compute/v2.1/servers/ec27a3e6-bd38-401b-a4da-1006a79b1f6e => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:12:52.896274 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-45dcba7b-587f-4f29-82ca-a6945d776502 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:12:52.897063 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-45dcba7b-587f-4f29-82ca-a6945d776502 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: ec27a3e6-bd38-401b-a4da-1006a79b1f6e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:12:52.898925 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:12:52.899629 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=8 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:12:52.905258 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-45dcba7b-587f-4f29-82ca-a6945d776502 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:12:52.905785 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-45dcba7b-587f-4f29-82ca-a6945d776502 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:12:52.906228 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-45dcba7b-587f-4f29-82ca-a6945d776502 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:12:52.906932 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-45dcba7b-587f-4f29-82ca-a6945d776502 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:12:52.907398 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-45dcba7b-587f-4f29-82ca-a6945d776502 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:12:52.907834 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-45dcba7b-587f-4f29-82ca-a6945d776502 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:12:53.038187 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-45dcba7b-587f-4f29-82ca-a6945d776502 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:12:53.046615 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-45dcba7b-587f-4f29-82ca-a6945d776502 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/ec27a3e6-bd38-401b-a4da-1006a79b1f6e" status: 200 len: 1264 microversion: 2.1 time: 0.154401 Oct 30 02:12:53.047207 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3618/6988] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:12:52 2022] GET /compute/v2.1/servers/ec27a3e6-bd38-401b-a4da-1006a79b1f6e => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:12:54.069769 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8d629a1c-377e-4de2-bbbc-afe12d35aa8e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:12:54.070396 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8d629a1c-377e-4de2-bbbc-afe12d35aa8e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: ec27a3e6-bd38-401b-a4da-1006a79b1f6e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:12:54.078441 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d629a1c-377e-4de2-bbbc-afe12d35aa8e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:12:54.078938 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d629a1c-377e-4de2-bbbc-afe12d35aa8e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:12:54.079387 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d629a1c-377e-4de2-bbbc-afe12d35aa8e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:12:54.080092 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d629a1c-377e-4de2-bbbc-afe12d35aa8e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:12:54.080555 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d629a1c-377e-4de2-bbbc-afe12d35aa8e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:12:54.080992 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d629a1c-377e-4de2-bbbc-afe12d35aa8e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:12:54.216741 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8d629a1c-377e-4de2-bbbc-afe12d35aa8e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:12:54.224517 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8d629a1c-377e-4de2-bbbc-afe12d35aa8e tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/ec27a3e6-bd38-401b-a4da-1006a79b1f6e" status: 200 len: 1264 microversion: 2.1 time: 0.158922 Oct 30 02:12:54.225183 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3619/6989] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:12:54 2022] GET /compute/v2.1/servers/ec27a3e6-bd38-401b-a4da-1006a79b1f6e => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:12:55.247932 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7c63f08c-d28c-43ab-bbc2-3d7bc035dd50 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:12:55.248649 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7c63f08c-d28c-43ab-bbc2-3d7bc035dd50 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: ec27a3e6-bd38-401b-a4da-1006a79b1f6e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:12:55.255520 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7c63f08c-d28c-43ab-bbc2-3d7bc035dd50 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:12:55.256016 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7c63f08c-d28c-43ab-bbc2-3d7bc035dd50 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:12:55.256461 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7c63f08c-d28c-43ab-bbc2-3d7bc035dd50 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:12:55.257167 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7c63f08c-d28c-43ab-bbc2-3d7bc035dd50 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:12:55.257672 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7c63f08c-d28c-43ab-bbc2-3d7bc035dd50 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:12:55.258111 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7c63f08c-d28c-43ab-bbc2-3d7bc035dd50 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:12:55.393307 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7c63f08c-d28c-43ab-bbc2-3d7bc035dd50 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:12:55.401020 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7c63f08c-d28c-43ab-bbc2-3d7bc035dd50 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/ec27a3e6-bd38-401b-a4da-1006a79b1f6e" status: 200 len: 1264 microversion: 2.1 time: 0.157575 Oct 30 02:12:55.401634 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3620/6990] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:12:55 2022] GET /compute/v2.1/servers/ec27a3e6-bd38-401b-a4da-1006a79b1f6e => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:12:56.429541 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4ca3d9ea-98f4-482e-81f9-e3fd5d4e7b63 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:12:56.430238 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4ca3d9ea-98f4-482e-81f9-e3fd5d4e7b63 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: ec27a3e6-bd38-401b-a4da-1006a79b1f6e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:12:56.436990 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4ca3d9ea-98f4-482e-81f9-e3fd5d4e7b63 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:12:56.437521 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4ca3d9ea-98f4-482e-81f9-e3fd5d4e7b63 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:12:56.437967 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4ca3d9ea-98f4-482e-81f9-e3fd5d4e7b63 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:12:56.438664 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4ca3d9ea-98f4-482e-81f9-e3fd5d4e7b63 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:12:56.439127 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4ca3d9ea-98f4-482e-81f9-e3fd5d4e7b63 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:12:56.439560 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4ca3d9ea-98f4-482e-81f9-e3fd5d4e7b63 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:12:56.572486 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4ca3d9ea-98f4-482e-81f9-e3fd5d4e7b63 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:12:56.580750 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4ca3d9ea-98f4-482e-81f9-e3fd5d4e7b63 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/ec27a3e6-bd38-401b-a4da-1006a79b1f6e" status: 200 len: 1264 microversion: 2.1 time: 0.155159 Oct 30 02:12:56.581320 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3621/6991] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:12:56 2022] GET /compute/v2.1/servers/ec27a3e6-bd38-401b-a4da-1006a79b1f6e => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:12:57.603705 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-369452ab-05a7-4c76-b943-4908f36386dd tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:12:57.604388 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-369452ab-05a7-4c76-b943-4908f36386dd tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: ec27a3e6-bd38-401b-a4da-1006a79b1f6e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:12:57.611943 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-369452ab-05a7-4c76-b943-4908f36386dd tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:12:57.613837 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-369452ab-05a7-4c76-b943-4908f36386dd tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:12:57.613837 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-369452ab-05a7-4c76-b943-4908f36386dd tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:12:57.613837 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-369452ab-05a7-4c76-b943-4908f36386dd tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:12:57.614179 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-369452ab-05a7-4c76-b943-4908f36386dd tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:12:57.614652 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-369452ab-05a7-4c76-b943-4908f36386dd tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:12:57.745720 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-369452ab-05a7-4c76-b943-4908f36386dd tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:12:57.753736 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-369452ab-05a7-4c76-b943-4908f36386dd tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/ec27a3e6-bd38-401b-a4da-1006a79b1f6e" status: 200 len: 1264 microversion: 2.1 time: 0.154071 Oct 30 02:12:57.754312 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3622/6992] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:12:57 2022] GET /compute/v2.1/servers/ec27a3e6-bd38-401b-a4da-1006a79b1f6e => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:12:58.776167 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4f4682ef-f09f-4ce7-a74b-8e6c37d50518 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:12:58.776874 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4f4682ef-f09f-4ce7-a74b-8e6c37d50518 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: ec27a3e6-bd38-401b-a4da-1006a79b1f6e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:12:58.783755 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4f4682ef-f09f-4ce7-a74b-8e6c37d50518 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:12:58.790368 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4f4682ef-f09f-4ce7-a74b-8e6c37d50518 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:12:58.790368 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4f4682ef-f09f-4ce7-a74b-8e6c37d50518 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:12:58.790368 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4f4682ef-f09f-4ce7-a74b-8e6c37d50518 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:12:58.790368 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4f4682ef-f09f-4ce7-a74b-8e6c37d50518 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:12:58.790368 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4f4682ef-f09f-4ce7-a74b-8e6c37d50518 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:12:58.916422 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4f4682ef-f09f-4ce7-a74b-8e6c37d50518 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:12:58.924786 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4f4682ef-f09f-4ce7-a74b-8e6c37d50518 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/ec27a3e6-bd38-401b-a4da-1006a79b1f6e" status: 200 len: 1264 microversion: 2.1 time: 0.152580 Oct 30 02:12:58.925608 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3623/6993] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:12:58 2022] GET /compute/v2.1/servers/ec27a3e6-bd38-401b-a4da-1006a79b1f6e => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:12:59.948000 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-92511607-5016-4da5-90ce-7d6c9175e515 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:12:59.948723 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-92511607-5016-4da5-90ce-7d6c9175e515 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: ec27a3e6-bd38-401b-a4da-1006a79b1f6e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:12:59.956297 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92511607-5016-4da5-90ce-7d6c9175e515 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:12:59.956933 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92511607-5016-4da5-90ce-7d6c9175e515 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:12:59.957400 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92511607-5016-4da5-90ce-7d6c9175e515 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:12:59.958114 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92511607-5016-4da5-90ce-7d6c9175e515 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:12:59.958582 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92511607-5016-4da5-90ce-7d6c9175e515 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:12:59.959018 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92511607-5016-4da5-90ce-7d6c9175e515 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:13:00.096505 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-92511607-5016-4da5-90ce-7d6c9175e515 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:13:00.104307 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-92511607-5016-4da5-90ce-7d6c9175e515 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/ec27a3e6-bd38-401b-a4da-1006a79b1f6e" status: 200 len: 1264 microversion: 2.1 time: 0.160625 Oct 30 02:13:00.104886 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3624/6994] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:12:59 2022] GET /compute/v2.1/servers/ec27a3e6-bd38-401b-a4da-1006a79b1f6e => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:13:01.127652 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fa58818f-2a08-400a-8a02-4da1f700fbd3 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:13:01.128258 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fa58818f-2a08-400a-8a02-4da1f700fbd3 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: ec27a3e6-bd38-401b-a4da-1006a79b1f6e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:13:01.135080 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fa58818f-2a08-400a-8a02-4da1f700fbd3 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:13:01.135644 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fa58818f-2a08-400a-8a02-4da1f700fbd3 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:13:01.136093 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fa58818f-2a08-400a-8a02-4da1f700fbd3 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:13:01.136800 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fa58818f-2a08-400a-8a02-4da1f700fbd3 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:13:01.137792 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fa58818f-2a08-400a-8a02-4da1f700fbd3 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:13:01.138238 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fa58818f-2a08-400a-8a02-4da1f700fbd3 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:13:01.268936 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-fa58818f-2a08-400a-8a02-4da1f700fbd3 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:13:01.276829 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fa58818f-2a08-400a-8a02-4da1f700fbd3 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/ec27a3e6-bd38-401b-a4da-1006a79b1f6e" status: 200 len: 1264 microversion: 2.1 time: 0.153270 Oct 30 02:13:01.277430 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3625/6995] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:13:01 2022] GET /compute/v2.1/servers/ec27a3e6-bd38-401b-a4da-1006a79b1f6e => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:13:01.732632 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-aa7bf5c5-6239-44eb-8c1a-63fa26165561 req-d200ae9c-a3c6-40e2-bafc-39bc4dd33a77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec27a3e6-bd38-401b-a4da-1006a79b1f6e", "name": "network-vif-plugged", "status": "completed", "tag": "60bc7816-d837-48a4-9e0d-5bb582e6a64e"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:13:01.742216 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-aa7bf5c5-6239-44eb-8c1a-63fa26165561 req-d200ae9c-a3c6-40e2-bafc-39bc4dd33a77 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:13:01.742709 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-aa7bf5c5-6239-44eb-8c1a-63fa26165561 req-d200ae9c-a3c6-40e2-bafc-39bc4dd33a77 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:13:01.743159 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-aa7bf5c5-6239-44eb-8c1a-63fa26165561 req-d200ae9c-a3c6-40e2-bafc-39bc4dd33a77 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:13:01.757877 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-aa7bf5c5-6239-44eb-8c1a-63fa26165561 req-d200ae9c-a3c6-40e2-bafc-39bc4dd33a77 service nova] Creating event network-vif-plugged:60bc7816-d837-48a4-9e0d-5bb582e6a64e for instance ec27a3e6-bd38-401b-a4da-1006a79b1f6e on n-h1-master-1 Oct 30 02:13:01.762923 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-aa7bf5c5-6239-44eb-8c1a-63fa26165561 req-d200ae9c-a3c6-40e2-bafc-39bc4dd33a77 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081543 Oct 30 02:13:01.763531 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3626/6996] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:13:02.301538 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-46740c7d-4002-4a35-9040-fa5787349515 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:13:02.302259 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-46740c7d-4002-4a35-9040-fa5787349515 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: ec27a3e6-bd38-401b-a4da-1006a79b1f6e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:13:02.308425 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-46740c7d-4002-4a35-9040-fa5787349515 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:13:02.308926 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-46740c7d-4002-4a35-9040-fa5787349515 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:13:02.309410 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-46740c7d-4002-4a35-9040-fa5787349515 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:13:02.310185 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-46740c7d-4002-4a35-9040-fa5787349515 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:13:02.310658 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-46740c7d-4002-4a35-9040-fa5787349515 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:13:02.311096 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-46740c7d-4002-4a35-9040-fa5787349515 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:13:02.329764 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:13:02.442244 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-46740c7d-4002-4a35-9040-fa5787349515 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:13:02.450870 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-46740c7d-4002-4a35-9040-fa5787349515 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/ec27a3e6-bd38-401b-a4da-1006a79b1f6e" status: 200 len: 1264 microversion: 2.1 time: 0.154439 Oct 30 02:13:02.451470 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3627/6997] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:13:02 2022] GET /compute/v2.1/servers/ec27a3e6-bd38-401b-a4da-1006a79b1f6e => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:13:03.473423 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-90c75b36-ffa0-4b95-b9d7-3be52b9d9410 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:13:03.474104 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-90c75b36-ffa0-4b95-b9d7-3be52b9d9410 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: ec27a3e6-bd38-401b-a4da-1006a79b1f6e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:13:03.481869 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-90c75b36-ffa0-4b95-b9d7-3be52b9d9410 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:13:03.482376 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-90c75b36-ffa0-4b95-b9d7-3be52b9d9410 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:13:03.482832 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-90c75b36-ffa0-4b95-b9d7-3be52b9d9410 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:13:03.483548 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-90c75b36-ffa0-4b95-b9d7-3be52b9d9410 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:13:03.484091 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-90c75b36-ffa0-4b95-b9d7-3be52b9d9410 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:13:03.484538 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-90c75b36-ffa0-4b95-b9d7-3be52b9d9410 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:13:03.614761 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-90c75b36-ffa0-4b95-b9d7-3be52b9d9410 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:13:03.622586 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-90c75b36-ffa0-4b95-b9d7-3be52b9d9410 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/ec27a3e6-bd38-401b-a4da-1006a79b1f6e" status: 200 len: 1452 microversion: 2.1 time: 0.153204 Oct 30 02:13:03.623159 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3628/6998] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:13:03 2022] GET /compute/v2.1/servers/ec27a3e6-bd38-401b-a4da-1006a79b1f6e => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:13:03.644103 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c79917bb-094f-4388-83fd-a12e99c348a3 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:13:03.644816 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c79917bb-094f-4388-83fd-a12e99c348a3 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: ec27a3e6-bd38-401b-a4da-1006a79b1f6e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:13:03.650738 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c79917bb-094f-4388-83fd-a12e99c348a3 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:13:03.651241 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c79917bb-094f-4388-83fd-a12e99c348a3 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:13:03.651698 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c79917bb-094f-4388-83fd-a12e99c348a3 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:13:03.652411 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c79917bb-094f-4388-83fd-a12e99c348a3 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:13:03.653411 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c79917bb-094f-4388-83fd-a12e99c348a3 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:13:03.653881 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c79917bb-094f-4388-83fd-a12e99c348a3 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:13:03.789884 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c79917bb-094f-4388-83fd-a12e99c348a3 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:13:03.798382 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c79917bb-094f-4388-83fd-a12e99c348a3 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/ec27a3e6-bd38-401b-a4da-1006a79b1f6e" status: 200 len: 1452 microversion: 2.1 time: 0.157845 Oct 30 02:13:03.799080 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3629/6999] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:13:03 2022] GET /compute/v2.1/servers/ec27a3e6-bd38-401b-a4da-1006a79b1f6e => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:13:05.912174 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-cb9b9b8e-1515-4dfe-9f53-9b989baf97d3 req-02663e2b-5f16-4f9e-a8f5-76136f984762 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec27a3e6-bd38-401b-a4da-1006a79b1f6e", "tag": "60bc7816-d837-48a4-9e0d-5bb582e6a64e"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:13:05.923040 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-cb9b9b8e-1515-4dfe-9f53-9b989baf97d3 req-02663e2b-5f16-4f9e-a8f5-76136f984762 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:13:05.924597 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-cb9b9b8e-1515-4dfe-9f53-9b989baf97d3 req-02663e2b-5f16-4f9e-a8f5-76136f984762 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:13:05.924597 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-cb9b9b8e-1515-4dfe-9f53-9b989baf97d3 req-02663e2b-5f16-4f9e-a8f5-76136f984762 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:13:05.936704 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-cb9b9b8e-1515-4dfe-9f53-9b989baf97d3 req-02663e2b-5f16-4f9e-a8f5-76136f984762 service nova] Creating event network-changed:60bc7816-d837-48a4-9e0d-5bb582e6a64e for instance ec27a3e6-bd38-401b-a4da-1006a79b1f6e on n-h1-master-1 Oct 30 02:13:05.942149 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-cb9b9b8e-1515-4dfe-9f53-9b989baf97d3 req-02663e2b-5f16-4f9e-a8f5-76136f984762 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033650 Oct 30 02:13:05.942884 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3630/7000] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:13:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:14:24.135613 n-d-master-1 devstack@n-api.service[121103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 30 02:14:24.136149 n-d-master-1 devstack@n-api.service[121103]: Sun Oct 30 02:14:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.13) !!! Oct 30 02:14:24.136860 n-d-master-1 devstack@n-api.service[121103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 30 02:14:24.137022 n-d-master-1 devstack@n-api.service[121103]: Sun Oct 30 02:14:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.13) !!! Oct 30 02:14:25.164486 n-d-master-1 devstack@n-api.service[121103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 30 02:14:25.165089 n-d-master-1 devstack@n-api.service[121103]: Sun Oct 30 02:14:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.13) !!! Oct 30 02:15:09.259247 n-d-master-1 devstack@n-api.service[121102]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8caffca0-53fa-4143-8e03-000c8bb53286] AMQP server on 10.222.0.13:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 30 02:15:09.261407 n-d-master-1 devstack@n-api.service[121102]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ea6ec045-ee0c-4212-8fa5-a40465026485] AMQP server on 10.222.0.13:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 30 02:15:09.262278 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:15:09.263056 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=16 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:15:09.264309 n-d-master-1 devstack@n-api.service[121102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 30 02:15:09.264446 n-d-master-1 devstack@n-api.service[121102]: Sun Oct 30 02:15:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ec27a3e6-bd38-401b-a4da-1006a79b1f6e (ip 10.222.0.13) !!! Oct 30 02:15:09.270052 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2e8fe00d-1882-4374-97ae-23a82c5498e8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:15:09.270659 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2e8fe00d-1882-4374-97ae-23a82c5498e8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: ec27a3e6-bd38-401b-a4da-1006a79b1f6e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:15:09.280927 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2e8fe00d-1882-4374-97ae-23a82c5498e8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:15:09.281626 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2e8fe00d-1882-4374-97ae-23a82c5498e8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:15:09.281952 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2e8fe00d-1882-4374-97ae-23a82c5498e8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:15:09.282667 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2e8fe00d-1882-4374-97ae-23a82c5498e8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:15:09.283126 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2e8fe00d-1882-4374-97ae-23a82c5498e8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:15:09.283584 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2e8fe00d-1882-4374-97ae-23a82c5498e8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:15:09.311086 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2e8fe00d-1882-4374-97ae-23a82c5498e8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: ec27a3e6-bd38-401b-a4da-1006a79b1f6e] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 02:15:09.627331 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2e8fe00d-1882-4374-97ae-23a82c5498e8 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ec27a3e6-bd38-401b-a4da-1006a79b1f6e" status: 204 len: 0 microversion: 2.1 time: 0.369995 Oct 30 02:15:09.628055 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3631/7001] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 02:15:09 2022] DELETE /compute/v2.1/servers/ec27a3e6-bd38-401b-a4da-1006a79b1f6e => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 02:15:09.633601 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-9a0367cb-2aca-49b6-b6e5-8aee5d5c98a4 req-14e4b167-86e5-46a0-936d-ef59211fc97c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec27a3e6-bd38-401b-a4da-1006a79b1f6e", "tag": "60bc7816-d837-48a4-9e0d-5bb582e6a64e"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:15:09.645503 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-9a0367cb-2aca-49b6-b6e5-8aee5d5c98a4 req-14e4b167-86e5-46a0-936d-ef59211fc97c service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:15:09.646006 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-9a0367cb-2aca-49b6-b6e5-8aee5d5c98a4 req-14e4b167-86e5-46a0-936d-ef59211fc97c service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:15:09.646474 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-9a0367cb-2aca-49b6-b6e5-8aee5d5c98a4 req-14e4b167-86e5-46a0-936d-ef59211fc97c service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:15:09.658619 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-9a0367cb-2aca-49b6-b6e5-8aee5d5c98a4 req-14e4b167-86e5-46a0-936d-ef59211fc97c service nova] Creating event network-changed:60bc7816-d837-48a4-9e0d-5bb582e6a64e for instance ec27a3e6-bd38-401b-a4da-1006a79b1f6e on n-h1-master-1 Oct 30 02:15:09.664645 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-9a0367cb-2aca-49b6-b6e5-8aee5d5c98a4 req-14e4b167-86e5-46a0-936d-ef59211fc97c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035141 Oct 30 02:15:09.667119 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3632/7002] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:15:09.670442 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-52f26623-77cf-4bc6-8383-f0c945d8b20a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:15:09.671158 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-52f26623-77cf-4bc6-8383-f0c945d8b20a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: ec27a3e6-bd38-401b-a4da-1006a79b1f6e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:15:09.677309 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-52f26623-77cf-4bc6-8383-f0c945d8b20a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:15:09.677849 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-52f26623-77cf-4bc6-8383-f0c945d8b20a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:15:09.678330 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-52f26623-77cf-4bc6-8383-f0c945d8b20a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:15:09.679042 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-52f26623-77cf-4bc6-8383-f0c945d8b20a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:15:09.679553 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-52f26623-77cf-4bc6-8383-f0c945d8b20a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:15:09.680002 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-52f26623-77cf-4bc6-8383-f0c945d8b20a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:15:09.815518 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-52f26623-77cf-4bc6-8383-f0c945d8b20a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:15:09.828052 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-52f26623-77cf-4bc6-8383-f0c945d8b20a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/ec27a3e6-bd38-401b-a4da-1006a79b1f6e" status: 200 len: 1577 microversion: 2.1 time: 0.157965 Oct 30 02:15:09.828052 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3633/7003] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:15:09 2022] GET /compute/v2.1/servers/ec27a3e6-bd38-401b-a4da-1006a79b1f6e => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:15:10.848078 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f3f5114a-cc0a-40f2-86da-a605198d21db tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:15:10.848708 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f3f5114a-cc0a-40f2-86da-a605198d21db tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: ec27a3e6-bd38-401b-a4da-1006a79b1f6e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:15:10.864263 n-d-master-1 devstack@n-api.service[121102]: INFO oslo.messaging._drivers.impl_rabbit [-] [ea6ec045-ee0c-4212-8fa5-a40465026485] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 55982. Oct 30 02:15:10.865960 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3f5114a-cc0a-40f2-86da-a605198d21db tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:15:10.867079 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3f5114a-cc0a-40f2-86da-a605198d21db tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:15:10.867523 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3f5114a-cc0a-40f2-86da-a605198d21db tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:15:10.868230 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3f5114a-cc0a-40f2-86da-a605198d21db tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:15:10.868699 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3f5114a-cc0a-40f2-86da-a605198d21db tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:15:10.869153 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3f5114a-cc0a-40f2-86da-a605198d21db tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:15:10.875745 n-d-master-1 devstack@n-api.service[121102]: INFO oslo.messaging._drivers.impl_rabbit [-] [8caffca0-53fa-4143-8e03-000c8bb53286] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 55980. Oct 30 02:15:11.025003 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f3f5114a-cc0a-40f2-86da-a605198d21db tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:15:11.032866 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f3f5114a-cc0a-40f2-86da-a605198d21db tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/ec27a3e6-bd38-401b-a4da-1006a79b1f6e" status: 200 len: 1577 microversion: 2.1 time: 0.188754 Oct 30 02:15:11.045362 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3634/7004] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:15:10 2022] GET /compute/v2.1/servers/ec27a3e6-bd38-401b-a4da-1006a79b1f6e => generated 1577 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:15:12.059573 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f428f7bc-4b5a-4240-9482-55c7ea882568 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:15:12.060292 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f428f7bc-4b5a-4240-9482-55c7ea882568 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: ec27a3e6-bd38-401b-a4da-1006a79b1f6e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:15:12.067355 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f428f7bc-4b5a-4240-9482-55c7ea882568 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:15:12.067885 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f428f7bc-4b5a-4240-9482-55c7ea882568 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:15:12.068371 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f428f7bc-4b5a-4240-9482-55c7ea882568 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:15:12.069107 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f428f7bc-4b5a-4240-9482-55c7ea882568 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:15:12.069612 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f428f7bc-4b5a-4240-9482-55c7ea882568 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:15:12.070049 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f428f7bc-4b5a-4240-9482-55c7ea882568 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:15:12.159191 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f428f7bc-4b5a-4240-9482-55c7ea882568 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:15:12.167595 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f428f7bc-4b5a-4240-9482-55c7ea882568 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/ec27a3e6-bd38-401b-a4da-1006a79b1f6e" status: 200 len: 1391 microversion: 2.1 time: 0.112135 Oct 30 02:15:12.168114 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3635/7005] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:15:12 2022] GET /compute/v2.1/servers/ec27a3e6-bd38-401b-a4da-1006a79b1f6e => generated 1391 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:15:12.172456 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-affa7ed1-698f-44b0-8a4e-4bec90392dd2 req-3e2d18ca-0f55-4c58-956f-882ca3b496ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec27a3e6-bd38-401b-a4da-1006a79b1f6e", "name": "network-vif-deleted", "tag": "60bc7816-d837-48a4-9e0d-5bb582e6a64e"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:15:12.182087 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-affa7ed1-698f-44b0-8a4e-4bec90392dd2 req-3e2d18ca-0f55-4c58-956f-882ca3b496ff service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:15:12.182627 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-affa7ed1-698f-44b0-8a4e-4bec90392dd2 req-3e2d18ca-0f55-4c58-956f-882ca3b496ff service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:15:12.183074 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-affa7ed1-698f-44b0-8a4e-4bec90392dd2 req-3e2d18ca-0f55-4c58-956f-882ca3b496ff service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:15:12.194152 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-affa7ed1-698f-44b0-8a4e-4bec90392dd2 req-3e2d18ca-0f55-4c58-956f-882ca3b496ff service nova] Creating event network-vif-deleted:60bc7816-d837-48a4-9e0d-5bb582e6a64e for instance ec27a3e6-bd38-401b-a4da-1006a79b1f6e on n-h1-master-1 Oct 30 02:15:12.199499 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-affa7ed1-698f-44b0-8a4e-4bec90392dd2 req-3e2d18ca-0f55-4c58-956f-882ca3b496ff service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030242 Oct 30 02:15:12.200094 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3636/7006] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:15:13.192017 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-104ba178-4036-4b83-bae9-6dc8ed6dc47a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:15:13.192931 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-104ba178-4036-4b83-bae9-6dc8ed6dc47a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: ec27a3e6-bd38-401b-a4da-1006a79b1f6e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:15:13.201059 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-104ba178-4036-4b83-bae9-6dc8ed6dc47a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:15:13.201605 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-104ba178-4036-4b83-bae9-6dc8ed6dc47a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:15:13.202050 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-104ba178-4036-4b83-bae9-6dc8ed6dc47a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:15:13.202758 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-104ba178-4036-4b83-bae9-6dc8ed6dc47a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:15:13.203224 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-104ba178-4036-4b83-bae9-6dc8ed6dc47a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:15:13.203663 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-104ba178-4036-4b83-bae9-6dc8ed6dc47a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:15:13.268543 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-104ba178-4036-4b83-bae9-6dc8ed6dc47a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:15:13.276562 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-104ba178-4036-4b83-bae9-6dc8ed6dc47a tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/ec27a3e6-bd38-401b-a4da-1006a79b1f6e" status: 200 len: 1224 microversion: 2.1 time: 0.089314 Oct 30 02:15:13.277137 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3637/7007] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:15:13 2022] GET /compute/v2.1/servers/ec27a3e6-bd38-401b-a4da-1006a79b1f6e => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:15:14.299534 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-35347c12-f688-42a4-9042-0b8aac5f0383 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:15:14.300157 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-35347c12-f688-42a4-9042-0b8aac5f0383 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: ec27a3e6-bd38-401b-a4da-1006a79b1f6e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:15:14.307000 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-35347c12-f688-42a4-9042-0b8aac5f0383 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:15:14.307492 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-35347c12-f688-42a4-9042-0b8aac5f0383 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:15:14.307934 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-35347c12-f688-42a4-9042-0b8aac5f0383 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:15:14.308639 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-35347c12-f688-42a4-9042-0b8aac5f0383 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:15:14.309100 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-35347c12-f688-42a4-9042-0b8aac5f0383 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:15:14.309559 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-35347c12-f688-42a4-9042-0b8aac5f0383 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:15:14.372102 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-35347c12-f688-42a4-9042-0b8aac5f0383 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:15:14.380058 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-35347c12-f688-42a4-9042-0b8aac5f0383 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/ec27a3e6-bd38-401b-a4da-1006a79b1f6e" status: 200 len: 1224 microversion: 2.1 time: 0.084586 Oct 30 02:15:14.380622 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3638/7008] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:15:14 2022] GET /compute/v2.1/servers/ec27a3e6-bd38-401b-a4da-1006a79b1f6e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:15:15.403715 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-81d893f0-3825-416c-a880-1737f9492fb1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:15:15.404477 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-81d893f0-3825-416c-a880-1737f9492fb1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: ec27a3e6-bd38-401b-a4da-1006a79b1f6e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:15:15.411372 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-81d893f0-3825-416c-a880-1737f9492fb1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:15:15.411865 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-81d893f0-3825-416c-a880-1737f9492fb1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:15:15.412307 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-81d893f0-3825-416c-a880-1737f9492fb1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:15:15.413062 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-81d893f0-3825-416c-a880-1737f9492fb1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:15:15.413559 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-81d893f0-3825-416c-a880-1737f9492fb1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:15:15.413994 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-81d893f0-3825-416c-a880-1737f9492fb1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:15:15.475819 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-81d893f0-3825-416c-a880-1737f9492fb1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:15:15.484141 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-81d893f0-3825-416c-a880-1737f9492fb1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/ec27a3e6-bd38-401b-a4da-1006a79b1f6e" status: 200 len: 1224 microversion: 2.1 time: 0.084303 Oct 30 02:15:15.484964 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3639/7009] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:15:15 2022] GET /compute/v2.1/servers/ec27a3e6-bd38-401b-a4da-1006a79b1f6e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:15:16.506735 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7fcc6e6e-c9d7-4062-a220-69486bea8544 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:15:16.507672 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7fcc6e6e-c9d7-4062-a220-69486bea8544 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: ec27a3e6-bd38-401b-a4da-1006a79b1f6e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:15:16.514662 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7fcc6e6e-c9d7-4062-a220-69486bea8544 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:15:16.515172 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7fcc6e6e-c9d7-4062-a220-69486bea8544 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:15:16.515631 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7fcc6e6e-c9d7-4062-a220-69486bea8544 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:15:16.516353 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7fcc6e6e-c9d7-4062-a220-69486bea8544 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:15:16.516836 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7fcc6e6e-c9d7-4062-a220-69486bea8544 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:15:16.517284 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7fcc6e6e-c9d7-4062-a220-69486bea8544 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:15:16.582828 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7fcc6e6e-c9d7-4062-a220-69486bea8544 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:15:16.591548 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7fcc6e6e-c9d7-4062-a220-69486bea8544 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/ec27a3e6-bd38-401b-a4da-1006a79b1f6e" status: 200 len: 1224 microversion: 2.1 time: 0.088716 Oct 30 02:15:16.592074 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3640/7010] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:15:16 2022] GET /compute/v2.1/servers/ec27a3e6-bd38-401b-a4da-1006a79b1f6e => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:15:17.615141 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ad25785a-2bc5-460e-8730-ed22695bca7c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:15:17.615755 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ad25785a-2bc5-460e-8730-ed22695bca7c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: ec27a3e6-bd38-401b-a4da-1006a79b1f6e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:15:17.622557 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ad25785a-2bc5-460e-8730-ed22695bca7c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:15:17.623067 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ad25785a-2bc5-460e-8730-ed22695bca7c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:15:17.623520 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ad25785a-2bc5-460e-8730-ed22695bca7c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:15:17.624239 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ad25785a-2bc5-460e-8730-ed22695bca7c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:15:17.624712 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ad25785a-2bc5-460e-8730-ed22695bca7c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:15:17.625152 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ad25785a-2bc5-460e-8730-ed22695bca7c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:15:17.639028 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-ad25785a-2bc5-460e-8730-ed22695bca7c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] HTTP exception thrown: Instance ec27a3e6-bd38-401b-a4da-1006a79b1f6e could not be found. Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ad25785a-2bc5-460e-8730-ed22695bca7c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Request method failure captured: Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/ec27a3e6-bd38-401b-a4da-1006a79b1f6e HTTP/1.1 Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdrUzAoetWsdn8k4HYTcqbVG7Zs75eMmndnkEOPA0S-TmAgSQ2b5nMGLS0qTcKbMaQTaaQPoAGl2nSU9lucNctaJ1zTE6xKSNocI5VbroWnIgVb8SnDnXRJPuQdp0_RS-b7KWfvV5q_soI5fUH8iU2dwXESX56PU08-DTzNpHjo6aLI Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 99e1cde224c845caaa743246e60e338d Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-TestVolumeBootPattern-1509499038 Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/99e1cde224c845caaa743246e60e338d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_99e1cde224c845caaa743246e60e338d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/99e1cde224c845caaa743246e60e338d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/99e1cde224c845caaa743246e60e338d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-TestVolumeBootPattern-1509499038 Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 99e1cde224c845caaa743246e60e338d Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-TestVolumeBootPattern-1509499038 Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-TestVolumeBootPattern-1509499038-project Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: a0ec990e687d427d88dcf9879a1d5b0c Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-TestVolumeBootPattern-1509499038-project Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: exception: Instance ec27a3e6-bd38-401b-a4da-1006a79b1f6e could not be found. Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'ec27a3e6-bd38-401b-a4da-1006a79b1f6e'} Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec27a3e6-bd38-401b-a4da-1006a79b1f6e could not be found. Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec27a3e6-bd38-401b-a4da-1006a79b1f6e could not be found. Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:15:17.640705 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:15:17.645641 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:15:17.645641 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:15:17.645641 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:15:17.645641 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:15:17.645641 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:15:17.645641 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec27a3e6-bd38-401b-a4da-1006a79b1f6e could not be found. Oct 30 02:15:17.645641 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:15:17.645641 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ad25785a-2bc5-460e-8730-ed22695bca7c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Returning 404 to user: Instance ec27a3e6-bd38-401b-a4da-1006a79b1f6e could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:15:17.645641 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ad25785a-2bc5-460e-8730-ed22695bca7c tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/ec27a3e6-bd38-401b-a4da-1006a79b1f6e" status: 404 len: 111 microversion: 2.1 time: 0.031189 Oct 30 02:15:17.645641 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3641/7011] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:15:17 2022] GET /compute/v2.1/servers/ec27a3e6-bd38-401b-a4da-1006a79b1f6e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 02:15:24.121210 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-790a116b-ad21-4462-93e8-c84a5edc6f9b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:15:24.121897 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-790a116b-ad21-4462-93e8-c84a5edc6f9b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 3df44c76-4a56-4e31-b59a-27e91a3992f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:15:24.128543 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-790a116b-ad21-4462-93e8-c84a5edc6f9b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:15:24.129037 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-790a116b-ad21-4462-93e8-c84a5edc6f9b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:15:24.129520 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-790a116b-ad21-4462-93e8-c84a5edc6f9b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:15:24.130233 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-790a116b-ad21-4462-93e8-c84a5edc6f9b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:15:24.130703 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-790a116b-ad21-4462-93e8-c84a5edc6f9b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:15:24.131137 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-790a116b-ad21-4462-93e8-c84a5edc6f9b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:15:24.158047 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-790a116b-ad21-4462-93e8-c84a5edc6f9b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 3df44c76-4a56-4e31-b59a-27e91a3992f9] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 02:15:24.466869 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-790a116b-ad21-4462-93e8-c84a5edc6f9b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3df44c76-4a56-4e31-b59a-27e91a3992f9" status: 204 len: 0 microversion: 2.1 time: 0.349193 Oct 30 02:15:24.467580 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3642/7012] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 02:15:24 2022] DELETE /compute/v2.1/servers/3df44c76-4a56-4e31-b59a-27e91a3992f9 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 30 02:15:24.473462 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-ae382bc0-0153-4562-a983-82e98ca6e929 req-451eb510-499c-48ed-a277-b5735d240a35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3df44c76-4a56-4e31-b59a-27e91a3992f9", "tag": "a93aa28f-bd2d-4c2f-a97b-d8bf82af668b"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:15:24.483716 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ae382bc0-0153-4562-a983-82e98ca6e929 req-451eb510-499c-48ed-a277-b5735d240a35 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:15:24.484220 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ae382bc0-0153-4562-a983-82e98ca6e929 req-451eb510-499c-48ed-a277-b5735d240a35 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:15:24.484675 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ae382bc0-0153-4562-a983-82e98ca6e929 req-451eb510-499c-48ed-a277-b5735d240a35 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:15:24.497761 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-ae382bc0-0153-4562-a983-82e98ca6e929 req-451eb510-499c-48ed-a277-b5735d240a35 service nova] Creating event network-changed:a93aa28f-bd2d-4c2f-a97b-d8bf82af668b for instance 3df44c76-4a56-4e31-b59a-27e91a3992f9 on n-h2-master-1 Oct 30 02:15:24.502832 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-ae382bc0-0153-4562-a983-82e98ca6e929 req-451eb510-499c-48ed-a277-b5735d240a35 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033621 Oct 30 02:15:24.503454 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3643/7013] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:15:24.517534 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2803ad04-16f2-466b-b993-7101c9e83fa6 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:15:24.517534 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2803ad04-16f2-466b-b993-7101c9e83fa6 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 3df44c76-4a56-4e31-b59a-27e91a3992f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:15:24.517534 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2803ad04-16f2-466b-b993-7101c9e83fa6 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:15:24.517534 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2803ad04-16f2-466b-b993-7101c9e83fa6 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:15:24.517915 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2803ad04-16f2-466b-b993-7101c9e83fa6 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:15:24.518321 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2803ad04-16f2-466b-b993-7101c9e83fa6 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:15:24.518797 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2803ad04-16f2-466b-b993-7101c9e83fa6 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:15:24.519242 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2803ad04-16f2-466b-b993-7101c9e83fa6 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:15:24.654588 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2803ad04-16f2-466b-b993-7101c9e83fa6 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:15:24.662389 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2803ad04-16f2-466b-b993-7101c9e83fa6 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/3df44c76-4a56-4e31-b59a-27e91a3992f9" status: 200 len: 1577 microversion: 2.1 time: 0.157713 Oct 30 02:15:24.663020 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3644/7014] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:15:24 2022] GET /compute/v2.1/servers/3df44c76-4a56-4e31-b59a-27e91a3992f9 => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:15:25.685814 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9c186316-40db-4816-a98a-ba2460929816 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:15:25.687832 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9c186316-40db-4816-a98a-ba2460929816 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 3df44c76-4a56-4e31-b59a-27e91a3992f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:15:25.696048 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9c186316-40db-4816-a98a-ba2460929816 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:15:25.696765 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9c186316-40db-4816-a98a-ba2460929816 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:15:25.697216 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9c186316-40db-4816-a98a-ba2460929816 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:15:25.697967 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9c186316-40db-4816-a98a-ba2460929816 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:15:25.698462 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9c186316-40db-4816-a98a-ba2460929816 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:15:25.698908 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9c186316-40db-4816-a98a-ba2460929816 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:15:25.765238 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9c186316-40db-4816-a98a-ba2460929816 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:15:25.774951 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9c186316-40db-4816-a98a-ba2460929816 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/3df44c76-4a56-4e31-b59a-27e91a3992f9" status: 200 len: 1391 microversion: 2.1 time: 0.092909 Oct 30 02:15:25.775251 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3645/7015] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:15:25 2022] GET /compute/v2.1/servers/3df44c76-4a56-4e31-b59a-27e91a3992f9 => generated 1391 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:15:25.961585 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-6007f9ac-3d0d-47b0-87b8-8c7c3d3a5cd5 req-7f2cdf9f-ce58-4b27-80ee-78a4229cd8b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3df44c76-4a56-4e31-b59a-27e91a3992f9", "name": "network-vif-deleted", "tag": "a93aa28f-bd2d-4c2f-a97b-d8bf82af668b"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:15:25.966659 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-6007f9ac-3d0d-47b0-87b8-8c7c3d3a5cd5 req-7f2cdf9f-ce58-4b27-80ee-78a4229cd8b9 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:15:25.967084 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-6007f9ac-3d0d-47b0-87b8-8c7c3d3a5cd5 req-7f2cdf9f-ce58-4b27-80ee-78a4229cd8b9 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:15:25.967529 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-6007f9ac-3d0d-47b0-87b8-8c7c3d3a5cd5 req-7f2cdf9f-ce58-4b27-80ee-78a4229cd8b9 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:15:25.978421 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-6007f9ac-3d0d-47b0-87b8-8c7c3d3a5cd5 req-7f2cdf9f-ce58-4b27-80ee-78a4229cd8b9 service nova] Creating event network-vif-deleted:a93aa28f-bd2d-4c2f-a97b-d8bf82af668b for instance 3df44c76-4a56-4e31-b59a-27e91a3992f9 on n-h2-master-1 Oct 30 02:15:25.982898 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-6007f9ac-3d0d-47b0-87b8-8c7c3d3a5cd5 req-7f2cdf9f-ce58-4b27-80ee-78a4229cd8b9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078039 Oct 30 02:15:25.983501 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3646/7016] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:15:26.799227 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-115e904f-0d65-41fb-9888-0652fc539f36 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:15:26.800074 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-115e904f-0d65-41fb-9888-0652fc539f36 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 3df44c76-4a56-4e31-b59a-27e91a3992f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:15:26.806399 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-115e904f-0d65-41fb-9888-0652fc539f36 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:15:26.806898 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-115e904f-0d65-41fb-9888-0652fc539f36 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:15:26.807444 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-115e904f-0d65-41fb-9888-0652fc539f36 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:15:26.808057 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-115e904f-0d65-41fb-9888-0652fc539f36 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:15:26.808530 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-115e904f-0d65-41fb-9888-0652fc539f36 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:15:26.808969 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-115e904f-0d65-41fb-9888-0652fc539f36 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:15:26.829998 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:15:26.875128 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-115e904f-0d65-41fb-9888-0652fc539f36 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:15:26.883181 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-115e904f-0d65-41fb-9888-0652fc539f36 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/3df44c76-4a56-4e31-b59a-27e91a3992f9" status: 200 len: 1225 microversion: 2.1 time: 0.089075 Oct 30 02:15:26.883754 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3647/7017] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:15:26 2022] GET /compute/v2.1/servers/3df44c76-4a56-4e31-b59a-27e91a3992f9 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:15:27.907598 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9affb992-5d02-4aba-9a36-34c8163f5e60 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:15:27.908263 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9affb992-5d02-4aba-9a36-34c8163f5e60 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 3df44c76-4a56-4e31-b59a-27e91a3992f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:15:27.916450 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9affb992-5d02-4aba-9a36-34c8163f5e60 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:15:27.916952 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9affb992-5d02-4aba-9a36-34c8163f5e60 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:15:27.917431 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9affb992-5d02-4aba-9a36-34c8163f5e60 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:15:27.918146 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9affb992-5d02-4aba-9a36-34c8163f5e60 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:15:27.918624 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9affb992-5d02-4aba-9a36-34c8163f5e60 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:15:27.919068 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9affb992-5d02-4aba-9a36-34c8163f5e60 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:15:27.982543 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9affb992-5d02-4aba-9a36-34c8163f5e60 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:15:27.990323 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9affb992-5d02-4aba-9a36-34c8163f5e60 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/3df44c76-4a56-4e31-b59a-27e91a3992f9" status: 200 len: 1225 microversion: 2.1 time: 0.087302 Oct 30 02:15:27.991511 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3648/7018] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:15:27 2022] GET /compute/v2.1/servers/3df44c76-4a56-4e31-b59a-27e91a3992f9 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:15:29.013664 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9f72dd89-b25e-4d35-a87f-7467b010d76b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:15:29.014360 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9f72dd89-b25e-4d35-a87f-7467b010d76b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 3df44c76-4a56-4e31-b59a-27e91a3992f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:15:29.021194 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9f72dd89-b25e-4d35-a87f-7467b010d76b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:15:29.021731 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9f72dd89-b25e-4d35-a87f-7467b010d76b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:15:29.022181 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9f72dd89-b25e-4d35-a87f-7467b010d76b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:15:29.022890 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9f72dd89-b25e-4d35-a87f-7467b010d76b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:15:29.023359 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9f72dd89-b25e-4d35-a87f-7467b010d76b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:15:29.023798 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9f72dd89-b25e-4d35-a87f-7467b010d76b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:15:29.089626 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9f72dd89-b25e-4d35-a87f-7467b010d76b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:15:29.097988 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9f72dd89-b25e-4d35-a87f-7467b010d76b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/3df44c76-4a56-4e31-b59a-27e91a3992f9" status: 200 len: 1225 microversion: 2.1 time: 0.088208 Oct 30 02:15:29.098586 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3649/7019] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:15:29 2022] GET /compute/v2.1/servers/3df44c76-4a56-4e31-b59a-27e91a3992f9 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:15:30.120964 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a48c8f55-1ac3-4d13-a86a-9bb9b3aee274 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:15:30.121635 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a48c8f55-1ac3-4d13-a86a-9bb9b3aee274 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 3df44c76-4a56-4e31-b59a-27e91a3992f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:15:30.128422 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a48c8f55-1ac3-4d13-a86a-9bb9b3aee274 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:15:30.128915 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a48c8f55-1ac3-4d13-a86a-9bb9b3aee274 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:15:30.129447 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a48c8f55-1ac3-4d13-a86a-9bb9b3aee274 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:15:30.130156 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a48c8f55-1ac3-4d13-a86a-9bb9b3aee274 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:15:30.130622 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a48c8f55-1ac3-4d13-a86a-9bb9b3aee274 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:15:30.131062 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a48c8f55-1ac3-4d13-a86a-9bb9b3aee274 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:15:30.192804 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a48c8f55-1ac3-4d13-a86a-9bb9b3aee274 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ec990e687d427d88dcf9879a1d5b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e1cde224c845caaa743246e60e338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:15:30.200652 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a48c8f55-1ac3-4d13-a86a-9bb9b3aee274 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/3df44c76-4a56-4e31-b59a-27e91a3992f9" status: 200 len: 1225 microversion: 2.1 time: 0.083644 Oct 30 02:15:30.201221 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3650/7020] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:15:30 2022] GET /compute/v2.1/servers/3df44c76-4a56-4e31-b59a-27e91a3992f9 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:15:31.223984 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cb32fde6-21cf-4f9d-a93e-0f7b64e6f0a6 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:15:31.224615 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cb32fde6-21cf-4f9d-a93e-0f7b64e6f0a6 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 3df44c76-4a56-4e31-b59a-27e91a3992f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:15:31.231395 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cb32fde6-21cf-4f9d-a93e-0f7b64e6f0a6 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:15:31.231998 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cb32fde6-21cf-4f9d-a93e-0f7b64e6f0a6 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:15:31.232454 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cb32fde6-21cf-4f9d-a93e-0f7b64e6f0a6 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:15:31.233154 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cb32fde6-21cf-4f9d-a93e-0f7b64e6f0a6 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:15:31.233644 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cb32fde6-21cf-4f9d-a93e-0f7b64e6f0a6 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:15:31.234080 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cb32fde6-21cf-4f9d-a93e-0f7b64e6f0a6 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:15:31.247635 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-cb32fde6-21cf-4f9d-a93e-0f7b64e6f0a6 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] HTTP exception thrown: Instance 3df44c76-4a56-4e31-b59a-27e91a3992f9 could not be found. Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cb32fde6-21cf-4f9d-a93e-0f7b64e6f0a6 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Request method failure captured: Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/3df44c76-4a56-4e31-b59a-27e91a3992f9 HTTP/1.1 Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdrUzAoetWsdn8k4HYTcqbVG7Zs75eMmndnkEOPA0S-TmAgSQ2b5nMGLS0qTcKbMaQTaaQPoAGl2nSU9lucNctaJ1zTE6xKSNocI5VbroWnIgVb8SnDnXRJPuQdp0_RS-b7KWfvV5q_soI5fUH8iU2dwXESX56PU08-DTzNpHjo6aLI Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 99e1cde224c845caaa743246e60e338d Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-TestVolumeBootPattern-1509499038 Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/99e1cde224c845caaa743246e60e338d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_99e1cde224c845caaa743246e60e338d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/99e1cde224c845caaa743246e60e338d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/99e1cde224c845caaa743246e60e338d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-TestVolumeBootPattern-1509499038 Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 99e1cde224c845caaa743246e60e338d Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-TestVolumeBootPattern-1509499038 Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-TestVolumeBootPattern-1509499038-project Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: a0ec990e687d427d88dcf9879a1d5b0c Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-TestVolumeBootPattern-1509499038-project Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 3df44c76-4a56-4e31-b59a-27e91a3992f9 could not be found. Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '3df44c76-4a56-4e31-b59a-27e91a3992f9'} Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3df44c76-4a56-4e31-b59a-27e91a3992f9 could not be found. Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3df44c76-4a56-4e31-b59a-27e91a3992f9 could not be found. Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:15:31.249287 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:15:31.254253 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:15:31.254253 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:15:31.254253 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:15:31.254253 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:15:31.254253 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:15:31.254253 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3df44c76-4a56-4e31-b59a-27e91a3992f9 could not be found. Oct 30 02:15:31.254253 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:15:31.254253 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cb32fde6-21cf-4f9d-a93e-0f7b64e6f0a6 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Returning 404 to user: Instance 3df44c76-4a56-4e31-b59a-27e91a3992f9 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:15:31.254253 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cb32fde6-21cf-4f9d-a93e-0f7b64e6f0a6 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/3df44c76-4a56-4e31-b59a-27e91a3992f9" status: 404 len: 111 microversion: 2.1 time: 0.030649 Oct 30 02:15:31.254253 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3651/7021] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:15:31 2022] GET /compute/v2.1/servers/3df44c76-4a56-4e31-b59a-27e91a3992f9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 02:15:31.775536 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c9085e1f-3c5b-456c-8f2e-1cc67f805491 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:15:31.776059 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c9085e1f-3c5b-456c-8f2e-1cc67f805491 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 1a56660b-3b62-4531-8a68-79d7565c967b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:15:31.782074 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c9085e1f-3c5b-456c-8f2e-1cc67f805491 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:15:31.782577 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c9085e1f-3c5b-456c-8f2e-1cc67f805491 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:15:31.783029 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c9085e1f-3c5b-456c-8f2e-1cc67f805491 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:15:31.783735 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c9085e1f-3c5b-456c-8f2e-1cc67f805491 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:15:31.784207 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c9085e1f-3c5b-456c-8f2e-1cc67f805491 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:15:31.784646 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c9085e1f-3c5b-456c-8f2e-1cc67f805491 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:15:31.798696 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-c9085e1f-3c5b-456c-8f2e-1cc67f805491 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] HTTP exception thrown: Instance 1a56660b-3b62-4531-8a68-79d7565c967b could not be found. Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c9085e1f-3c5b-456c-8f2e-1cc67f805491 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Request method failure captured: Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b HTTP/1.1 Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdrUzAoetWsdn8k4HYTcqbVG7Zs75eMmndnkEOPA0S-TmAgSQ2b5nMGLS0qTcKbMaQTaaQPoAGl2nSU9lucNctaJ1zTE6xKSNocI5VbroWnIgVb8SnDnXRJPuQdp0_RS-b7KWfvV5q_soI5fUH8iU2dwXESX56PU08-DTzNpHjo6aLI Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 99e1cde224c845caaa743246e60e338d Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-TestVolumeBootPattern-1509499038 Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/99e1cde224c845caaa743246e60e338d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_99e1cde224c845caaa743246e60e338d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/99e1cde224c845caaa743246e60e338d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/99e1cde224c845caaa743246e60e338d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-TestVolumeBootPattern-1509499038 Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 99e1cde224c845caaa743246e60e338d Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-TestVolumeBootPattern-1509499038 Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-TestVolumeBootPattern-1509499038-project Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: a0ec990e687d427d88dcf9879a1d5b0c Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-TestVolumeBootPattern-1509499038-project Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 1a56660b-3b62-4531-8a68-79d7565c967b could not be found. Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '1a56660b-3b62-4531-8a68-79d7565c967b'} Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a56660b-3b62-4531-8a68-79d7565c967b could not be found. Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 02:15:31.800254 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 02:15:31.804672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a56660b-3b62-4531-8a68-79d7565c967b could not be found. Oct 30 02:15:31.804672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:15:31.804672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:15:31.804672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:15:31.804672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:15:31.804672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:15:31.804672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:15:31.804672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:15:31.804672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:15:31.804672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a56660b-3b62-4531-8a68-79d7565c967b could not be found. Oct 30 02:15:31.804672 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:15:31.804672 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c9085e1f-3c5b-456c-8f2e-1cc67f805491 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Returning 404 to user: Instance 1a56660b-3b62-4531-8a68-79d7565c967b could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:15:31.804672 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c9085e1f-3c5b-456c-8f2e-1cc67f805491 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "DELETE /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b" status: 404 len: 111 microversion: 2.1 time: 0.030075 Oct 30 02:15:31.804672 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3652/7022] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 02:15:31 2022] DELETE /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 02:15:31.810416 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b04aa6ab-3ffd-45e6-91b0-775afea4779b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:15:31.811035 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b04aa6ab-3ffd-45e6-91b0-775afea4779b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] [instance: 1a56660b-3b62-4531-8a68-79d7565c967b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:15:31.817099 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b04aa6ab-3ffd-45e6-91b0-775afea4779b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:15:31.817635 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b04aa6ab-3ffd-45e6-91b0-775afea4779b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:15:31.818135 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b04aa6ab-3ffd-45e6-91b0-775afea4779b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:15:31.818838 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b04aa6ab-3ffd-45e6-91b0-775afea4779b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:15:31.819307 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b04aa6ab-3ffd-45e6-91b0-775afea4779b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:15:31.819748 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b04aa6ab-3ffd-45e6-91b0-775afea4779b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:15:31.832917 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-b04aa6ab-3ffd-45e6-91b0-775afea4779b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] HTTP exception thrown: Instance 1a56660b-3b62-4531-8a68-79d7565c967b could not be found. Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b04aa6ab-3ffd-45e6-91b0-775afea4779b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Request method failure captured: Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b HTTP/1.1 Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXdrUzAoetWsdn8k4HYTcqbVG7Zs75eMmndnkEOPA0S-TmAgSQ2b5nMGLS0qTcKbMaQTaaQPoAGl2nSU9lucNctaJ1zTE6xKSNocI5VbroWnIgVb8SnDnXRJPuQdp0_RS-b7KWfvV5q_soI5fUH8iU2dwXESX56PU08-DTzNpHjo6aLI Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 99e1cde224c845caaa743246e60e338d Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-TestVolumeBootPattern-1509499038 Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/99e1cde224c845caaa743246e60e338d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_99e1cde224c845caaa743246e60e338d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/99e1cde224c845caaa743246e60e338d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/99e1cde224c845caaa743246e60e338d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-TestVolumeBootPattern-1509499038 Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 99e1cde224c845caaa743246e60e338d Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-TestVolumeBootPattern-1509499038 Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-TestVolumeBootPattern-1509499038-project Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: a0ec990e687d427d88dcf9879a1d5b0c Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-TestVolumeBootPattern-1509499038-project Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 1a56660b-3b62-4531-8a68-79d7565c967b could not be found. Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '1a56660b-3b62-4531-8a68-79d7565c967b'} Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a56660b-3b62-4531-8a68-79d7565c967b could not be found. Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a56660b-3b62-4531-8a68-79d7565c967b could not be found. Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:15:31.834446 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:15:31.838954 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:15:31.838954 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:15:31.838954 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:15:31.838954 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:15:31.838954 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:15:31.838954 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a56660b-3b62-4531-8a68-79d7565c967b could not be found. Oct 30 02:15:31.838954 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:15:31.838954 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b04aa6ab-3ffd-45e6-91b0-775afea4779b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Returning 404 to user: Instance 1a56660b-3b62-4531-8a68-79d7565c967b could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:15:31.838954 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b04aa6ab-3ffd-45e6-91b0-775afea4779b tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "GET /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b" status: 404 len: 111 microversion: 2.1 time: 0.028909 Oct 30 02:15:31.838954 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3653/7023] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:15:31 2022] GET /compute/v2.1/servers/1a56660b-3b62-4531-8a68-79d7565c967b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 02:15:35.477081 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0d0c0efa-e41f-49aa-b19d-9fedb79ebaf2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Calling method '.version_select at 0x7f44c7660430>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:15:35.553042 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0d0c0efa-e41f-49aa-b19d-9fedb79ebaf2 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-236561478" status: 202 len: 0 microversion: 2.1 time: 0.079952 Oct 30 02:15:35.553682 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3654/7024] 10.222.0.13 () {58 vars in 1260 bytes} [Sun Oct 30 02:15:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-236561478 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 30 02:15:56.140381 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=26 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:15:56.141252 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:15:56.255852 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bdde7ac8-471c-4b89-9380-be4ce7c07240 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-877780771", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:15:56.307670 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-bdde7ac8-471c-4b89-9380-be4ce7c07240 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] validate_networks() for None {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 02:15:56.851876 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-bdde7ac8-471c-4b89-9380-be4ce7c07240 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 02:15:56.852316 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-bdde7ac8-471c-4b89-9380-be4ce7c07240 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 02:15:56.852803 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-bdde7ac8-471c-4b89-9380-be4ce7c07240 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 02:15:56.853222 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-bdde7ac8-471c-4b89-9380-be4ce7c07240 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 02:15:56.853671 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-bdde7ac8-471c-4b89-9380-be4ce7c07240 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 02:15:56.862630 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bdde7ac8-471c-4b89-9380-be4ce7c07240 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:15:56.863125 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bdde7ac8-471c-4b89-9380-be4ce7c07240 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:15:56.863569 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bdde7ac8-471c-4b89-9380-be4ce7c07240 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:15:56.864306 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bdde7ac8-471c-4b89-9380-be4ce7c07240 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:15:56.864771 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bdde7ac8-471c-4b89-9380-be4ce7c07240 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:15:56.865206 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bdde7ac8-471c-4b89-9380-be4ce7c07240 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:15:56.886273 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-bdde7ac8-471c-4b89-9380-be4ce7c07240 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Getting quotas for project 49f019b35dd8401eb575d5cde596857f. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 02:15:56.891665 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-bdde7ac8-471c-4b89-9380-be4ce7c07240 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Getting quotas for user 0512b272391943fd80ee839e49e88834 and project 49f019b35dd8401eb575d5cde596857f. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 02:15:56.904252 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bdde7ac8-471c-4b89-9380-be4ce7c07240 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 02:15:56.906633 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bdde7ac8-471c-4b89-9380-be4ce7c07240 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] [instance: 7da508a7-c1df-4110-8942-1932ef87f422] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 02:15:57.016057 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bdde7ac8-471c-4b89-9380-be4ce7c07240 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.877339 Oct 30 02:15:57.016726 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3655/7025] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 02:15:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 879 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 30 02:15:57.029654 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-63582680-9c9a-4454-860b-6fd1d39a6657 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:15:57.030298 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-63582680-9c9a-4454-860b-6fd1d39a6657 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] [instance: 7da508a7-c1df-4110-8942-1932ef87f422] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:15:57.083676 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-63582680-9c9a-4454-860b-6fd1d39a6657 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0512b272391943fd80ee839e49e88834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f019b35dd8401eb575d5cde596857f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:15:57.091151 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-63582680-9c9a-4454-860b-6fd1d39a6657 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] 10.222.0.13 "GET /compute/v2.1/servers/7da508a7-c1df-4110-8942-1932ef87f422" status: 200 len: 1221 microversion: 2.1 time: 0.065343 Oct 30 02:15:57.092058 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3656/7026] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:15:57 2022] GET /compute/v2.1/servers/7da508a7-c1df-4110-8942-1932ef87f422 => generated 1221 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:15:58.114487 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-081b3a8c-e26a-43af-b9f8-0e7e04d72b64 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:15:58.115127 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-081b3a8c-e26a-43af-b9f8-0e7e04d72b64 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] [instance: 7da508a7-c1df-4110-8942-1932ef87f422] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:15:58.123239 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-081b3a8c-e26a-43af-b9f8-0e7e04d72b64 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:15:58.123745 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-081b3a8c-e26a-43af-b9f8-0e7e04d72b64 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:15:58.124199 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-081b3a8c-e26a-43af-b9f8-0e7e04d72b64 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:15:58.124982 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-081b3a8c-e26a-43af-b9f8-0e7e04d72b64 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:15:58.125489 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-081b3a8c-e26a-43af-b9f8-0e7e04d72b64 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:15:58.125933 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-081b3a8c-e26a-43af-b9f8-0e7e04d72b64 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:15:58.188912 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-081b3a8c-e26a-43af-b9f8-0e7e04d72b64 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0512b272391943fd80ee839e49e88834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f019b35dd8401eb575d5cde596857f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:15:58.197041 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-081b3a8c-e26a-43af-b9f8-0e7e04d72b64 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] 10.222.0.13 "GET /compute/v2.1/servers/7da508a7-c1df-4110-8942-1932ef87f422" status: 200 len: 1225 microversion: 2.1 time: 0.086600 Oct 30 02:15:58.197651 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3657/7027] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:15:58 2022] GET /compute/v2.1/servers/7da508a7-c1df-4110-8942-1932ef87f422 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:15:59.221723 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-04839e95-b662-427a-9154-31bdfaf94c9b tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:15:59.222395 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-04839e95-b662-427a-9154-31bdfaf94c9b tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] [instance: 7da508a7-c1df-4110-8942-1932ef87f422] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:15:59.229197 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04839e95-b662-427a-9154-31bdfaf94c9b tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:15:59.234405 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04839e95-b662-427a-9154-31bdfaf94c9b tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:15:59.234405 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04839e95-b662-427a-9154-31bdfaf94c9b tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:15:59.234405 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04839e95-b662-427a-9154-31bdfaf94c9b tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:15:59.234405 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04839e95-b662-427a-9154-31bdfaf94c9b tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:15:59.234405 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04839e95-b662-427a-9154-31bdfaf94c9b tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:15:59.304022 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-04839e95-b662-427a-9154-31bdfaf94c9b tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0512b272391943fd80ee839e49e88834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f019b35dd8401eb575d5cde596857f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:15:59.311854 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-04839e95-b662-427a-9154-31bdfaf94c9b tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] 10.222.0.13 "GET /compute/v2.1/servers/7da508a7-c1df-4110-8942-1932ef87f422" status: 200 len: 1281 microversion: 2.1 time: 0.095108 Oct 30 02:15:59.312443 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3658/7028] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:15:59 2022] GET /compute/v2.1/servers/7da508a7-c1df-4110-8942-1932ef87f422 => generated 1281 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:16:00.340452 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1d5f0ca0-7e75-4969-8487-0f88177732b5 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:16:00.341064 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1d5f0ca0-7e75-4969-8487-0f88177732b5 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] [instance: 7da508a7-c1df-4110-8942-1932ef87f422] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:16:00.348025 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1d5f0ca0-7e75-4969-8487-0f88177732b5 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:00.348974 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1d5f0ca0-7e75-4969-8487-0f88177732b5 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:00.348974 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1d5f0ca0-7e75-4969-8487-0f88177732b5 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:00.350780 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1d5f0ca0-7e75-4969-8487-0f88177732b5 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:00.350979 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1d5f0ca0-7e75-4969-8487-0f88177732b5 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:00.351405 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1d5f0ca0-7e75-4969-8487-0f88177732b5 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:00.585632 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1d5f0ca0-7e75-4969-8487-0f88177732b5 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0512b272391943fd80ee839e49e88834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f019b35dd8401eb575d5cde596857f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:16:00.593418 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1d5f0ca0-7e75-4969-8487-0f88177732b5 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] 10.222.0.13 "GET /compute/v2.1/servers/7da508a7-c1df-4110-8942-1932ef87f422" status: 200 len: 1321 microversion: 2.1 time: 0.257599 Oct 30 02:16:00.593934 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3659/7029] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:16:00 2022] GET /compute/v2.1/servers/7da508a7-c1df-4110-8942-1932ef87f422 => generated 1321 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:16:01.071332 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-a2fb0b73-c1ee-4b8f-b82e-ee7ee274f90c req-342a32bd-cfa0-4122-b805-07df7d0cb5a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7da508a7-c1df-4110-8942-1932ef87f422", "tag": "3b46d9b3-335a-4c8f-87b8-fcd7d907a67c"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:16:01.081808 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-a2fb0b73-c1ee-4b8f-b82e-ee7ee274f90c req-342a32bd-cfa0-4122-b805-07df7d0cb5a8 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:01.082310 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-a2fb0b73-c1ee-4b8f-b82e-ee7ee274f90c req-342a32bd-cfa0-4122-b805-07df7d0cb5a8 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:01.082783 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-a2fb0b73-c1ee-4b8f-b82e-ee7ee274f90c req-342a32bd-cfa0-4122-b805-07df7d0cb5a8 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:01.094257 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-a2fb0b73-c1ee-4b8f-b82e-ee7ee274f90c req-342a32bd-cfa0-4122-b805-07df7d0cb5a8 service nova] Creating event network-changed:3b46d9b3-335a-4c8f-87b8-fcd7d907a67c for instance 7da508a7-c1df-4110-8942-1932ef87f422 on n-h1-master-1 Oct 30 02:16:01.099327 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-a2fb0b73-c1ee-4b8f-b82e-ee7ee274f90c req-342a32bd-cfa0-4122-b805-07df7d0cb5a8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032018 Oct 30 02:16:01.101897 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3660/7030] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:16:01.618479 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a033bfec-03ce-45cc-9c46-34cd79588ee0 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:16:01.619225 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a033bfec-03ce-45cc-9c46-34cd79588ee0 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] [instance: 7da508a7-c1df-4110-8942-1932ef87f422] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:16:01.625395 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a033bfec-03ce-45cc-9c46-34cd79588ee0 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:01.625895 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a033bfec-03ce-45cc-9c46-34cd79588ee0 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:01.626339 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a033bfec-03ce-45cc-9c46-34cd79588ee0 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:01.627039 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a033bfec-03ce-45cc-9c46-34cd79588ee0 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:01.627496 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a033bfec-03ce-45cc-9c46-34cd79588ee0 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:01.627927 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a033bfec-03ce-45cc-9c46-34cd79588ee0 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:01.835102 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a033bfec-03ce-45cc-9c46-34cd79588ee0 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0512b272391943fd80ee839e49e88834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f019b35dd8401eb575d5cde596857f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:16:01.835102 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a033bfec-03ce-45cc-9c46-34cd79588ee0 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] 10.222.0.13 "GET /compute/v2.1/servers/7da508a7-c1df-4110-8942-1932ef87f422" status: 200 len: 1321 microversion: 2.1 time: 0.220343 Oct 30 02:16:01.835102 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3661/7031] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:16:01 2022] GET /compute/v2.1/servers/7da508a7-c1df-4110-8942-1932ef87f422 => generated 1321 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:16:02.856433 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c3b7cf88-cf6c-45b3-9135-f38102f0019d tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:16:02.857114 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c3b7cf88-cf6c-45b3-9135-f38102f0019d tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] [instance: 7da508a7-c1df-4110-8942-1932ef87f422] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:16:02.863940 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c3b7cf88-cf6c-45b3-9135-f38102f0019d tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:02.864438 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c3b7cf88-cf6c-45b3-9135-f38102f0019d tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:02.864894 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c3b7cf88-cf6c-45b3-9135-f38102f0019d tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:02.865641 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c3b7cf88-cf6c-45b3-9135-f38102f0019d tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:02.866114 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c3b7cf88-cf6c-45b3-9135-f38102f0019d tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:02.866556 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c3b7cf88-cf6c-45b3-9135-f38102f0019d tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:03.001180 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c3b7cf88-cf6c-45b3-9135-f38102f0019d tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0512b272391943fd80ee839e49e88834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f019b35dd8401eb575d5cde596857f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:16:03.009385 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c3b7cf88-cf6c-45b3-9135-f38102f0019d tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] 10.222.0.13 "GET /compute/v2.1/servers/7da508a7-c1df-4110-8942-1932ef87f422" status: 200 len: 1321 microversion: 2.1 time: 0.156838 Oct 30 02:16:03.009948 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3662/7032] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:16:02 2022] GET /compute/v2.1/servers/7da508a7-c1df-4110-8942-1932ef87f422 => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:16:04.032524 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fb7c728e-75d6-4e94-8383-17ce57f5d6e2 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:16:04.033144 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fb7c728e-75d6-4e94-8383-17ce57f5d6e2 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] [instance: 7da508a7-c1df-4110-8942-1932ef87f422] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:16:04.040388 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb7c728e-75d6-4e94-8383-17ce57f5d6e2 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:04.040877 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb7c728e-75d6-4e94-8383-17ce57f5d6e2 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:04.041322 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb7c728e-75d6-4e94-8383-17ce57f5d6e2 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:04.042049 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb7c728e-75d6-4e94-8383-17ce57f5d6e2 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:04.042513 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb7c728e-75d6-4e94-8383-17ce57f5d6e2 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:04.042952 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb7c728e-75d6-4e94-8383-17ce57f5d6e2 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:04.173524 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-fb7c728e-75d6-4e94-8383-17ce57f5d6e2 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0512b272391943fd80ee839e49e88834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f019b35dd8401eb575d5cde596857f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:16:04.181275 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fb7c728e-75d6-4e94-8383-17ce57f5d6e2 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] 10.222.0.13 "GET /compute/v2.1/servers/7da508a7-c1df-4110-8942-1932ef87f422" status: 200 len: 1321 microversion: 2.1 time: 0.152853 Oct 30 02:16:04.181891 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3663/7033] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:16:04 2022] GET /compute/v2.1/servers/7da508a7-c1df-4110-8942-1932ef87f422 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:16:05.204073 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ece8432d-9e08-4910-b8e1-eb80d4824200 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:16:05.204745 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ece8432d-9e08-4910-b8e1-eb80d4824200 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] [instance: 7da508a7-c1df-4110-8942-1932ef87f422] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:16:05.212059 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ece8432d-9e08-4910-b8e1-eb80d4824200 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:05.212588 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ece8432d-9e08-4910-b8e1-eb80d4824200 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:05.213047 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ece8432d-9e08-4910-b8e1-eb80d4824200 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:05.214129 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ece8432d-9e08-4910-b8e1-eb80d4824200 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:05.214609 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ece8432d-9e08-4910-b8e1-eb80d4824200 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:05.215055 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ece8432d-9e08-4910-b8e1-eb80d4824200 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:05.341464 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ece8432d-9e08-4910-b8e1-eb80d4824200 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0512b272391943fd80ee839e49e88834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f019b35dd8401eb575d5cde596857f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:16:05.349091 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ece8432d-9e08-4910-b8e1-eb80d4824200 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] 10.222.0.13 "GET /compute/v2.1/servers/7da508a7-c1df-4110-8942-1932ef87f422" status: 200 len: 1321 microversion: 2.1 time: 0.148983 Oct 30 02:16:05.349704 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3664/7034] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:16:05 2022] GET /compute/v2.1/servers/7da508a7-c1df-4110-8942-1932ef87f422 => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:16:06.372837 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c0e028b3-215a-4bef-ba56-7dd188ffbef9 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:16:06.373544 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c0e028b3-215a-4bef-ba56-7dd188ffbef9 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] [instance: 7da508a7-c1df-4110-8942-1932ef87f422] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:16:06.380491 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c0e028b3-215a-4bef-ba56-7dd188ffbef9 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:06.380995 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c0e028b3-215a-4bef-ba56-7dd188ffbef9 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:06.381551 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c0e028b3-215a-4bef-ba56-7dd188ffbef9 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:06.382903 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c0e028b3-215a-4bef-ba56-7dd188ffbef9 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:06.383380 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c0e028b3-215a-4bef-ba56-7dd188ffbef9 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:06.383859 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c0e028b3-215a-4bef-ba56-7dd188ffbef9 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:06.519112 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c0e028b3-215a-4bef-ba56-7dd188ffbef9 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0512b272391943fd80ee839e49e88834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f019b35dd8401eb575d5cde596857f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:16:06.527216 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c0e028b3-215a-4bef-ba56-7dd188ffbef9 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] 10.222.0.13 "GET /compute/v2.1/servers/7da508a7-c1df-4110-8942-1932ef87f422" status: 200 len: 1321 microversion: 2.1 time: 0.158476 Oct 30 02:16:06.527800 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3665/7035] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:16:06 2022] GET /compute/v2.1/servers/7da508a7-c1df-4110-8942-1932ef87f422 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:16:06.548776 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-4bc06b84-ed36-42a7-b161-de3f57c3b72e req-9ec82872-03d1-4cf4-95f2-51ce1ffe3335 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7da508a7-c1df-4110-8942-1932ef87f422", "name": "network-vif-plugged", "status": "completed", "tag": "3b46d9b3-335a-4c8f-87b8-fcd7d907a67c"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:16:06.558687 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-4bc06b84-ed36-42a7-b161-de3f57c3b72e req-9ec82872-03d1-4cf4-95f2-51ce1ffe3335 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:06.559185 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-4bc06b84-ed36-42a7-b161-de3f57c3b72e req-9ec82872-03d1-4cf4-95f2-51ce1ffe3335 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:06.559662 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-4bc06b84-ed36-42a7-b161-de3f57c3b72e req-9ec82872-03d1-4cf4-95f2-51ce1ffe3335 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:06.571350 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-4bc06b84-ed36-42a7-b161-de3f57c3b72e req-9ec82872-03d1-4cf4-95f2-51ce1ffe3335 service nova] Creating event network-vif-plugged:3b46d9b3-335a-4c8f-87b8-fcd7d907a67c for instance 7da508a7-c1df-4110-8942-1932ef87f422 on n-h1-master-1 Oct 30 02:16:06.576593 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-4bc06b84-ed36-42a7-b161-de3f57c3b72e req-9ec82872-03d1-4cf4-95f2-51ce1ffe3335 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031685 Oct 30 02:16:06.577239 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3666/7036] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:16:07.547361 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:16:07.548221 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=8 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:16:07.553265 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bec742b4-fef8-4500-a889-facb1fe6c081 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:16:07.557145 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bec742b4-fef8-4500-a889-facb1fe6c081 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] [instance: 7da508a7-c1df-4110-8942-1932ef87f422] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:16:07.560944 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bec742b4-fef8-4500-a889-facb1fe6c081 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:07.561482 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bec742b4-fef8-4500-a889-facb1fe6c081 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:07.561940 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bec742b4-fef8-4500-a889-facb1fe6c081 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:07.562819 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bec742b4-fef8-4500-a889-facb1fe6c081 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:07.563318 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bec742b4-fef8-4500-a889-facb1fe6c081 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:07.563765 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bec742b4-fef8-4500-a889-facb1fe6c081 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:07.702865 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bec742b4-fef8-4500-a889-facb1fe6c081 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0512b272391943fd80ee839e49e88834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f019b35dd8401eb575d5cde596857f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:16:07.711888 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bec742b4-fef8-4500-a889-facb1fe6c081 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] 10.222.0.13 "GET /compute/v2.1/servers/7da508a7-c1df-4110-8942-1932ef87f422" status: 200 len: 1321 microversion: 2.1 time: 0.165481 Oct 30 02:16:07.712514 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3667/7037] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:16:07 2022] GET /compute/v2.1/servers/7da508a7-c1df-4110-8942-1932ef87f422 => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:16:08.735110 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e36231ca-4646-47ba-862f-ea71911fe233 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:16:08.735807 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e36231ca-4646-47ba-862f-ea71911fe233 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] [instance: 7da508a7-c1df-4110-8942-1932ef87f422] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:16:08.743069 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e36231ca-4646-47ba-862f-ea71911fe233 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:08.743568 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e36231ca-4646-47ba-862f-ea71911fe233 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:08.744016 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e36231ca-4646-47ba-862f-ea71911fe233 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:08.744715 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e36231ca-4646-47ba-862f-ea71911fe233 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:08.745178 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e36231ca-4646-47ba-862f-ea71911fe233 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:08.745637 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e36231ca-4646-47ba-862f-ea71911fe233 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:08.874436 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e36231ca-4646-47ba-862f-ea71911fe233 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0512b272391943fd80ee839e49e88834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f019b35dd8401eb575d5cde596857f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:16:08.882748 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e36231ca-4646-47ba-862f-ea71911fe233 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] 10.222.0.13 "GET /compute/v2.1/servers/7da508a7-c1df-4110-8942-1932ef87f422" status: 200 len: 1471 microversion: 2.1 time: 0.151007 Oct 30 02:16:08.883330 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3668/7038] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:16:08 2022] GET /compute/v2.1/servers/7da508a7-c1df-4110-8942-1932ef87f422 => generated 1471 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:16:08.951997 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cc398b0d-e35f-46e5-bfc5-99eca15b1478 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] Calling method '.version_select at 0x7f44cc578e50>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:16:09.014266 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cc398b0d-e35f-46e5-bfc5-99eca15b1478 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/8a53f6832f6c4f7db11a0ba1c3992a7f" status: 200 len: 371 microversion: 2.1 time: 0.110336 Oct 30 02:16:09.014841 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3669/7039] 10.222.0.13 () {58 vars in 1242 bytes} [Sun Oct 30 02:16:08 2022] GET /compute/v2.1/os-quota-sets/8a53f6832f6c4f7db11a0ba1c3992a7f => generated 371 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:16:09.026696 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8c35af3f-5646-47bb-ab61-adb7b12af187 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1734376443", "id": 677399377, "os-flavor-access:is_public": "True"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:16:09.089233 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8c35af3f-5646-47bb-ab61-adb7b12af187 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.066494 Oct 30 02:16:09.089842 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3670/7040] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 02:16:09 2022] POST /compute/v2.1/flavors => generated 435 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:16:09.101779 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f2ba29c6-4111-4b25-8379-e61e42bc1e89 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "677399377"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:16:09.104023 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f2ba29c6-4111-4b25-8379-e61e42bc1e89 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] [instance: 7da508a7-c1df-4110-8942-1932ef87f422] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:16:09.109769 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f2ba29c6-4111-4b25-8379-e61e42bc1e89 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:09.110267 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f2ba29c6-4111-4b25-8379-e61e42bc1e89 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:09.110717 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f2ba29c6-4111-4b25-8379-e61e42bc1e89 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:09.111421 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f2ba29c6-4111-4b25-8379-e61e42bc1e89 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:09.111891 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f2ba29c6-4111-4b25-8379-e61e42bc1e89 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:09.112331 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f2ba29c6-4111-4b25-8379-e61e42bc1e89 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:09.201018 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f2ba29c6-4111-4b25-8379-e61e42bc1e89 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '851873e133da4c18b468c4e9e6412033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a53f6832f6c4f7db11a0ba1c3992a7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:16:09.207119 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f2ba29c6-4111-4b25-8379-e61e42bc1e89 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] [instance: 7da508a7-c1df-4110-8942-1932ef87f422] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1734376443 {{(pid=121102) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 30 02:16:09.214535 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f2ba29c6-4111-4b25-8379-e61e42bc1e89 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:09.215046 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f2ba29c6-4111-4b25-8379-e61e42bc1e89 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:09.215495 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f2ba29c6-4111-4b25-8379-e61e42bc1e89 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:09.216230 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f2ba29c6-4111-4b25-8379-e61e42bc1e89 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:09.216698 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f2ba29c6-4111-4b25-8379-e61e42bc1e89 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:09.217227 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f2ba29c6-4111-4b25-8379-e61e42bc1e89 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:09.238807 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-f2ba29c6-4111-4b25-8379-e61e42bc1e89 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] Getting quotas for project 49f019b35dd8401eb575d5cde596857f. Resources: {'ram', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 02:16:09.244075 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-f2ba29c6-4111-4b25-8379-e61e42bc1e89 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] Getting quotas for user 0512b272391943fd80ee839e49e88834 and project 49f019b35dd8401eb575d5cde596857f. Resources: {'ram', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 02:16:09.257469 n-d-master-1 devstack@n-api.service[121102]: INFO nova.compute.api [None req-f2ba29c6-4111-4b25-8379-e61e42bc1e89 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] ram quota exceeded for 8a53f6832f6c4f7db11a0ba1c3992a7f, tried to resize instance. Oct 30 02:16:09.258019 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-f2ba29c6-4111-4b25-8379-e61e42bc1e89 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f2ba29c6-4111-4b25-8379-e61e42bc1e89 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] Request method failure captured: Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/servers/7da508a7-c1df-4110-8942-1932ef87f422/action HTTP/1.1 Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 38 Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXd5bEF6lAkFKE6bWjrVtBYN7cUoReLl42nqKljUJDeN0K1f2V31BPe13L929cMOuglN0MhkOe0ktQw8oCaHkA4TuNks0zYMJJhSV3MPv5pXcfTi5y_w_HGq4E9SkoindKBBtF5TkImV5OFMxv4b70TZo1ENT9EZTjWnsJAn1XYg49Ho Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 8a53f6832f6c4f7db11a0ba1c3992a7f Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-98777390 Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,admin,reader Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,admin,reader Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8a53f6832f6c4f7db11a0ba1c3992a7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8a53f6832f6c4f7db11a0ba1c3992a7f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8a53f6832f6c4f7db11a0ba1c3992a7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8a53f6832f6c4f7db11a0ba1c3992a7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServersAdminNegativeTestJSON-98777390 Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 8a53f6832f6c4f7db11a0ba1c3992a7f Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-98777390 Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServersAdminNegativeTestJSON-98777390-project-admin Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 851873e133da4c18b468c4e9e6412033 Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServersAdminNegativeTestJSON-98777390-project-admin Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: {"resize": {"flavorRef": "677399377"}} Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '7da508a7-c1df-4110-8942-1932ef87f422', 'body': {'resize': {'flavorRef': '677399377'}}} Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 30 02:16:09.260270 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 30 02:16:09.264835 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 30 02:16:09.264835 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 30 02:16:09.264835 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 30 02:16:09.264835 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 30 02:16:09.264835 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 30 02:16:09.264835 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 30 02:16:09.264835 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 30 02:16:09.264835 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 30 02:16:09.264835 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 30 02:16:09.264835 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 30 02:16:09.264835 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 30 02:16:09.264835 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 30 02:16:09.264835 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 30 02:16:09.264835 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 30 02:16:09.264835 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:16:09.264835 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:16:09.264835 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:16:09.264835 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:16:09.264835 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:16:09.264835 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:16:09.264835 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:16:09.264835 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:16:09.264835 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:16:09.264835 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:16:09.264835 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 02:16:09.264835 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 02:16:09.264835 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 30 02:16:09.264835 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 30 02:16:09.264835 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 30 02:16:09.264835 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 30 02:16:09.264835 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 30 02:16:09.264835 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:16:09.264835 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:16:09.264835 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:16:09.264835 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:16:09.264835 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:16:09.264835 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:16:09.264835 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:16:09.264835 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:16:09.264835 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 30 02:16:09.264835 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:16:09.264835 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f2ba29c6-4111-4b25-8379-e61e42bc1e89 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:16:09.264835 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f2ba29c6-4111-4b25-8379-e61e42bc1e89 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/7da508a7-c1df-4110-8942-1932ef87f422/action" status: 403 len: 118 microversion: 2.1 time: 0.163431 Oct 30 02:16:09.264835 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3671/7041] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 02:16:09 2022] POST /compute/v2.1/servers/7da508a7-c1df-4110-8942-1932ef87f422/action => generated 118 bytes in 165 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 30 02:16:09.270336 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e3334b42-3043-4bd6-b1c5-44e95d45f35a tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:16:09.333626 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e3334b42-3043-4bd6-b1c5-44e95d45f35a tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/677399377" status: 202 len: 0 microversion: 2.1 time: 0.066693 Oct 30 02:16:09.334259 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3672/7042] 10.222.0.13 () {58 vars in 1158 bytes} [Sun Oct 30 02:16:09 2022] DELETE /compute/v2.1/flavors/677399377 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 30 02:16:09.342385 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e2506337-aa57-471e-94e4-ec5486da738b tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:16:09.362042 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e2506337-aa57-471e-94e4-ec5486da738b tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023006 Oct 30 02:16:09.362599 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3673/7043] 10.222.0.13 () {58 vars in 1146 bytes} [Sun Oct 30 02:16:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:16:09.382775 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e569d6e4-b1b9-48d7-829e-fac00ac03362 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] Calling method '.version_select at 0x7f44c7357790>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:16:09.445181 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e569d6e4-b1b9-48d7-829e-fac00ac03362 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/8a53f6832f6c4f7db11a0ba1c3992a7f" status: 200 len: 371 microversion: 2.1 time: 0.065559 Oct 30 02:16:09.445822 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3674/7044] 10.222.0.13 () {58 vars in 1242 bytes} [Sun Oct 30 02:16:09 2022] GET /compute/v2.1/os-quota-sets/8a53f6832f6c4f7db11a0ba1c3992a7f => generated 371 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:16:09.457137 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9be64ae5-539f-4818-b591-6c6c4ce9f097 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1645306681", "id": 96409608, "os-flavor-access:is_public": "True"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:16:09.515923 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9be64ae5-539f-4818-b591-6c6c4ce9f097 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.062209 Oct 30 02:16:09.516445 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3675/7045] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 02:16:09 2022] POST /compute/v2.1/flavors => generated 431 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:16:09.528025 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-53cd5cea-d74c-49b7-a9c6-248762d3d392 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "96409608"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:16:09.530322 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-53cd5cea-d74c-49b7-a9c6-248762d3d392 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] [instance: 7da508a7-c1df-4110-8942-1932ef87f422] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:16:09.536681 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53cd5cea-d74c-49b7-a9c6-248762d3d392 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:09.537205 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53cd5cea-d74c-49b7-a9c6-248762d3d392 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:09.537701 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53cd5cea-d74c-49b7-a9c6-248762d3d392 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:09.538409 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53cd5cea-d74c-49b7-a9c6-248762d3d392 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:09.538879 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53cd5cea-d74c-49b7-a9c6-248762d3d392 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:09.539323 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53cd5cea-d74c-49b7-a9c6-248762d3d392 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:09.566812 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-53cd5cea-d74c-49b7-a9c6-248762d3d392 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '851873e133da4c18b468c4e9e6412033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a53f6832f6c4f7db11a0ba1c3992a7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:16:09.572640 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-53cd5cea-d74c-49b7-a9c6-248762d3d392 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] [instance: 7da508a7-c1df-4110-8942-1932ef87f422] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1645306681 {{(pid=121102) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 30 02:16:09.578973 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53cd5cea-d74c-49b7-a9c6-248762d3d392 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:09.579467 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53cd5cea-d74c-49b7-a9c6-248762d3d392 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:09.579913 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53cd5cea-d74c-49b7-a9c6-248762d3d392 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:09.580651 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53cd5cea-d74c-49b7-a9c6-248762d3d392 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:09.581114 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53cd5cea-d74c-49b7-a9c6-248762d3d392 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:09.581577 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53cd5cea-d74c-49b7-a9c6-248762d3d392 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:09.602341 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-53cd5cea-d74c-49b7-a9c6-248762d3d392 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] Getting quotas for project 49f019b35dd8401eb575d5cde596857f. Resources: {'ram', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 02:16:09.607462 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-53cd5cea-d74c-49b7-a9c6-248762d3d392 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] Getting quotas for user 0512b272391943fd80ee839e49e88834 and project 49f019b35dd8401eb575d5cde596857f. Resources: {'ram', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 02:16:09.619242 n-d-master-1 devstack@n-api.service[121102]: INFO nova.compute.api [None req-53cd5cea-d74c-49b7-a9c6-248762d3d392 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] cores quota exceeded for 8a53f6832f6c4f7db11a0ba1c3992a7f, tried to resize instance. Oct 30 02:16:09.619786 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-53cd5cea-d74c-49b7-a9c6-248762d3d392 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-53cd5cea-d74c-49b7-a9c6-248762d3d392 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] Request method failure captured: Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/servers/7da508a7-c1df-4110-8942-1932ef87f422/action HTTP/1.1 Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 37 Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXd5bEF6lAkFKE6bWjrVtBYN7cUoReLl42nqKljUJDeN0K1f2V31BPe13L929cMOuglN0MhkOe0ktQw8oCaHkA4TuNks0zYMJJhSV3MPv5pXcfTi5y_w_HGq4E9SkoindKBBtF5TkImV5OFMxv4b70TZo1ENT9EZTjWnsJAn1XYg49Ho Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 8a53f6832f6c4f7db11a0ba1c3992a7f Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-98777390 Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,admin,reader Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,admin,reader Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8a53f6832f6c4f7db11a0ba1c3992a7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8a53f6832f6c4f7db11a0ba1c3992a7f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8a53f6832f6c4f7db11a0ba1c3992a7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8a53f6832f6c4f7db11a0ba1c3992a7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServersAdminNegativeTestJSON-98777390 Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 8a53f6832f6c4f7db11a0ba1c3992a7f Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-98777390 Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServersAdminNegativeTestJSON-98777390-project-admin Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 851873e133da4c18b468c4e9e6412033 Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServersAdminNegativeTestJSON-98777390-project-admin Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: {"resize": {"flavorRef": "96409608"}} Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '7da508a7-c1df-4110-8942-1932ef87f422', 'body': {'resize': {'flavorRef': '96409608'}}} Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 30 02:16:09.621755 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 30 02:16:09.625900 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 30 02:16:09.625900 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 30 02:16:09.625900 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 30 02:16:09.625900 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 30 02:16:09.625900 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 30 02:16:09.625900 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 30 02:16:09.625900 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 30 02:16:09.625900 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 30 02:16:09.625900 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 30 02:16:09.625900 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 30 02:16:09.625900 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 30 02:16:09.625900 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 30 02:16:09.625900 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 30 02:16:09.625900 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 30 02:16:09.625900 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:16:09.625900 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:16:09.625900 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:16:09.625900 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:16:09.625900 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:16:09.625900 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:16:09.625900 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:16:09.625900 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:16:09.625900 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:16:09.625900 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:16:09.625900 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 02:16:09.625900 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 02:16:09.625900 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 30 02:16:09.625900 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 30 02:16:09.625900 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 30 02:16:09.625900 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 30 02:16:09.625900 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 30 02:16:09.625900 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:16:09.625900 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:16:09.625900 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:16:09.625900 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:16:09.625900 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:16:09.625900 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:16:09.625900 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:16:09.625900 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:16:09.625900 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 30 02:16:09.625900 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:16:09.625900 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-53cd5cea-d74c-49b7-a9c6-248762d3d392 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:16:09.625900 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-53cd5cea-d74c-49b7-a9c6-248762d3d392 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/7da508a7-c1df-4110-8942-1932ef87f422/action" status: 403 len: 113 microversion: 2.1 time: 0.098680 Oct 30 02:16:09.625900 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3676/7046] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 02:16:09 2022] POST /compute/v2.1/servers/7da508a7-c1df-4110-8942-1932ef87f422/action => generated 113 bytes in 100 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 30 02:16:09.631236 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6078cbb3-25a2-4d19-a0ec-e4038e690e6b tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:16:09.643465 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=5,nova_api:DELETE=6 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:16:09.750716 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6078cbb3-25a2-4d19-a0ec-e4038e690e6b tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/96409608" status: 202 len: 0 microversion: 2.1 time: 0.122724 Oct 30 02:16:09.751343 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3677/7047] 10.222.0.13 () {58 vars in 1155 bytes} [Sun Oct 30 02:16:09 2022] DELETE /compute/v2.1/flavors/96409608 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 30 02:16:09.759452 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3ccf9e74-bf95-49ef-ad36-37044b5893f9 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:16:09.780348 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3ccf9e74-bf95-49ef-ad36-37044b5893f9 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024608 Oct 30 02:16:09.780839 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3678/7048] 10.222.0.13 () {58 vars in 1146 bytes} [Sun Oct 30 02:16:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:16:09.800685 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-46ec594c-3c2b-4426-a469-fa25c49cbfe0 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:16:09.801196 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-46ec594c-3c2b-4426-a469-fa25c49cbfe0 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] [instance: 7da508a7-c1df-4110-8942-1932ef87f422] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:16:09.807358 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-46ec594c-3c2b-4426-a469-fa25c49cbfe0 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:09.807859 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-46ec594c-3c2b-4426-a469-fa25c49cbfe0 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:09.808345 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-46ec594c-3c2b-4426-a469-fa25c49cbfe0 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:09.809064 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-46ec594c-3c2b-4426-a469-fa25c49cbfe0 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:09.809573 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-46ec594c-3c2b-4426-a469-fa25c49cbfe0 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:09.810022 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-46ec594c-3c2b-4426-a469-fa25c49cbfe0 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:09.835620 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-46ec594c-3c2b-4426-a469-fa25c49cbfe0 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] [instance: 7da508a7-c1df-4110-8942-1932ef87f422] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 02:16:09.849516 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:16:10.042485 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-46ec594c-3c2b-4426-a469-fa25c49cbfe0 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7da508a7-c1df-4110-8942-1932ef87f422" status: 204 len: 0 microversion: 2.1 time: 0.244986 Oct 30 02:16:10.043058 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3679/7049] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 02:16:09 2022] DELETE /compute/v2.1/servers/7da508a7-c1df-4110-8942-1932ef87f422 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 30 02:16:10.051077 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-be7aea89-a1ec-48ca-bf87-40c63dc1f04d tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:16:10.051783 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-be7aea89-a1ec-48ca-bf87-40c63dc1f04d tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] [instance: 7da508a7-c1df-4110-8942-1932ef87f422] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:16:10.057614 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-be7aea89-a1ec-48ca-bf87-40c63dc1f04d tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:10.058104 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-be7aea89-a1ec-48ca-bf87-40c63dc1f04d tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:10.058547 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-be7aea89-a1ec-48ca-bf87-40c63dc1f04d tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:10.059272 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-be7aea89-a1ec-48ca-bf87-40c63dc1f04d tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:10.059731 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-be7aea89-a1ec-48ca-bf87-40c63dc1f04d tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:10.060162 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-be7aea89-a1ec-48ca-bf87-40c63dc1f04d tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:10.193682 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-be7aea89-a1ec-48ca-bf87-40c63dc1f04d tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0512b272391943fd80ee839e49e88834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f019b35dd8401eb575d5cde596857f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:16:10.202416 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-be7aea89-a1ec-48ca-bf87-40c63dc1f04d tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] 10.222.0.13 "GET /compute/v2.1/servers/7da508a7-c1df-4110-8942-1932ef87f422" status: 200 len: 1477 microversion: 2.1 time: 0.155237 Oct 30 02:16:10.203001 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3680/7050] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:16:10 2022] GET /compute/v2.1/servers/7da508a7-c1df-4110-8942-1932ef87f422 => generated 1477 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:16:11.227144 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2f3ad8b4-5ef2-4e68-a496-d14379e595af tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:16:11.227836 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2f3ad8b4-5ef2-4e68-a496-d14379e595af tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] [instance: 7da508a7-c1df-4110-8942-1932ef87f422] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:16:11.234747 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2f3ad8b4-5ef2-4e68-a496-d14379e595af tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:11.235257 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2f3ad8b4-5ef2-4e68-a496-d14379e595af tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:11.240617 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2f3ad8b4-5ef2-4e68-a496-d14379e595af tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:11.240617 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2f3ad8b4-5ef2-4e68-a496-d14379e595af tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:11.240617 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2f3ad8b4-5ef2-4e68-a496-d14379e595af tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:11.240617 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2f3ad8b4-5ef2-4e68-a496-d14379e595af tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:11.368846 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2f3ad8b4-5ef2-4e68-a496-d14379e595af tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0512b272391943fd80ee839e49e88834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f019b35dd8401eb575d5cde596857f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:16:11.376509 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2f3ad8b4-5ef2-4e68-a496-d14379e595af tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] 10.222.0.13 "GET /compute/v2.1/servers/7da508a7-c1df-4110-8942-1932ef87f422" status: 200 len: 1477 microversion: 2.1 time: 0.154328 Oct 30 02:16:11.377091 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3681/7051] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:16:11 2022] GET /compute/v2.1/servers/7da508a7-c1df-4110-8942-1932ef87f422 => generated 1477 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:16:12.032796 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-9166f6db-5f1b-4b51-b7ba-5bdedd413cac req-78ad3d33-4cb6-44da-bd06-5056d1f05eb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7da508a7-c1df-4110-8942-1932ef87f422", "name": "network-vif-deleted", "tag": "3b46d9b3-335a-4c8f-87b8-fcd7d907a67c"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:16:12.042681 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-9166f6db-5f1b-4b51-b7ba-5bdedd413cac req-78ad3d33-4cb6-44da-bd06-5056d1f05eb7 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:12.043182 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-9166f6db-5f1b-4b51-b7ba-5bdedd413cac req-78ad3d33-4cb6-44da-bd06-5056d1f05eb7 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:12.043639 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-9166f6db-5f1b-4b51-b7ba-5bdedd413cac req-78ad3d33-4cb6-44da-bd06-5056d1f05eb7 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:12.056169 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-9166f6db-5f1b-4b51-b7ba-5bdedd413cac req-78ad3d33-4cb6-44da-bd06-5056d1f05eb7 service nova] Creating event network-vif-deleted:3b46d9b3-335a-4c8f-87b8-fcd7d907a67c for instance 7da508a7-c1df-4110-8942-1932ef87f422 on n-h1-master-1 Oct 30 02:16:12.061674 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-9166f6db-5f1b-4b51-b7ba-5bdedd413cac req-78ad3d33-4cb6-44da-bd06-5056d1f05eb7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032524 Oct 30 02:16:12.062622 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3682/7052] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:16:12.400900 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8d6f0232-3ed5-4485-9160-a7d169d1902c tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:16:12.401561 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8d6f0232-3ed5-4485-9160-a7d169d1902c tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] [instance: 7da508a7-c1df-4110-8942-1932ef87f422] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:16:12.407672 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d6f0232-3ed5-4485-9160-a7d169d1902c tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:12.416558 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d6f0232-3ed5-4485-9160-a7d169d1902c tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:12.416558 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d6f0232-3ed5-4485-9160-a7d169d1902c tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:12.416558 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d6f0232-3ed5-4485-9160-a7d169d1902c tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:12.416558 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d6f0232-3ed5-4485-9160-a7d169d1902c tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:12.416558 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d6f0232-3ed5-4485-9160-a7d169d1902c tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:12.440973 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d6f0232-3ed5-4485-9160-a7d169d1902c tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:12.441497 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d6f0232-3ed5-4485-9160-a7d169d1902c tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:12.445089 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d6f0232-3ed5-4485-9160-a7d169d1902c tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:12.445089 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-8d6f0232-3ed5-4485-9160-a7d169d1902c tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lazy-loading 'fault' on Instance uuid 7da508a7-c1df-4110-8942-1932ef87f422 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 02:16:12.484373 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8d6f0232-3ed5-4485-9160-a7d169d1902c tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0512b272391943fd80ee839e49e88834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f019b35dd8401eb575d5cde596857f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:16:12.492660 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8d6f0232-3ed5-4485-9160-a7d169d1902c tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] 10.222.0.13 "GET /compute/v2.1/servers/7da508a7-c1df-4110-8942-1932ef87f422" status: 200 len: 1311 microversion: 2.1 time: 0.096720 Oct 30 02:16:12.493237 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3683/7053] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:16:12 2022] GET /compute/v2.1/servers/7da508a7-c1df-4110-8942-1932ef87f422 => generated 1311 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:16:13.516459 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2441d34b-7898-44f6-bdcb-72d4cbed9cb5 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:16:13.517147 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2441d34b-7898-44f6-bdcb-72d4cbed9cb5 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] [instance: 7da508a7-c1df-4110-8942-1932ef87f422] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:16:13.524576 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2441d34b-7898-44f6-bdcb-72d4cbed9cb5 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:13.525054 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2441d34b-7898-44f6-bdcb-72d4cbed9cb5 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:13.525531 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2441d34b-7898-44f6-bdcb-72d4cbed9cb5 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:13.526233 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2441d34b-7898-44f6-bdcb-72d4cbed9cb5 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:13.526699 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2441d34b-7898-44f6-bdcb-72d4cbed9cb5 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:13.527135 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2441d34b-7898-44f6-bdcb-72d4cbed9cb5 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:13.541004 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-2441d34b-7898-44f6-bdcb-72d4cbed9cb5 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] HTTP exception thrown: Instance 7da508a7-c1df-4110-8942-1932ef87f422 could not be found. Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2441d34b-7898-44f6-bdcb-72d4cbed9cb5 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Request method failure captured: Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/7da508a7-c1df-4110-8942-1932ef87f422 HTTP/1.1 Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXd5b3lcYSA_pkHvNc8Q2-LYVPlwSJIUPuPbvYw0uEJCPHlL-Hgmpu_QniCq8Bhr-R6t91UuO0hw2xDnymr5qKYV2Am2M-vJcmAK7ry6mCgvkowba-YIv11murRsN1CQvGSwCuvyqJAlkhJBXbzwjYIuZYdb34O8Xfc9Dh0RP5t99BUE Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 49f019b35dd8401eb575d5cde596857f Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2110773358 Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/49f019b35dd8401eb575d5cde596857f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_49f019b35dd8401eb575d5cde596857f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/49f019b35dd8401eb575d5cde596857f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/49f019b35dd8401eb575d5cde596857f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2110773358 Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 49f019b35dd8401eb575d5cde596857f Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2110773358 Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServersAdminNegativeTestJSON-2110773358-project Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 0512b272391943fd80ee839e49e88834 Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2110773358-project Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 7da508a7-c1df-4110-8942-1932ef87f422 could not be found. Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '7da508a7-c1df-4110-8942-1932ef87f422'} Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7da508a7-c1df-4110-8942-1932ef87f422 could not be found. Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7da508a7-c1df-4110-8942-1932ef87f422 could not be found. Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:16:13.542704 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:16:13.547535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:16:13.547535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:16:13.547535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:16:13.547535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:16:13.547535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:16:13.547535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:16:13.547535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7da508a7-c1df-4110-8942-1932ef87f422 could not be found. Oct 30 02:16:13.547535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:16:13.547535 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2441d34b-7898-44f6-bdcb-72d4cbed9cb5 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] Returning 404 to user: Instance 7da508a7-c1df-4110-8942-1932ef87f422 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:16:13.547535 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2441d34b-7898-44f6-bdcb-72d4cbed9cb5 tempest-ServersAdminNegativeTestJSON-2110773358 tempest-ServersAdminNegativeTestJSON-2110773358-project] 10.222.0.13 "GET /compute/v2.1/servers/7da508a7-c1df-4110-8942-1932ef87f422" status: 404 len: 111 microversion: 2.1 time: 0.032159 Oct 30 02:16:13.547535 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3684/7054] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:16:13 2022] GET /compute/v2.1/servers/7da508a7-c1df-4110-8942-1932ef87f422 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 02:16:21.998716 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=4 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:16:21.999526 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=6 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:16:22.108878 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d2bf5a02-8f36-48a1-85f3-9b5562c3a2aa tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-101699485", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "bebcf3a3-38be-4dc5-9b96-3c03459fe82b"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:16:22.164716 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-d2bf5a02-8f36-48a1-85f3-9b5562c3a2aa tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] validate_networks() for [('bebcf3a3-38be-4dc5-9b96-3c03459fe82b', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 02:16:22.537829 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-d2bf5a02-8f36-48a1-85f3-9b5562c3a2aa tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 02:16:22.538281 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-d2bf5a02-8f36-48a1-85f3-9b5562c3a2aa tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 02:16:22.538805 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-d2bf5a02-8f36-48a1-85f3-9b5562c3a2aa tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 02:16:22.539235 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-d2bf5a02-8f36-48a1-85f3-9b5562c3a2aa tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 02:16:22.539692 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-d2bf5a02-8f36-48a1-85f3-9b5562c3a2aa tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 02:16:22.548963 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2bf5a02-8f36-48a1-85f3-9b5562c3a2aa tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:22.549519 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2bf5a02-8f36-48a1-85f3-9b5562c3a2aa tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:22.550003 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2bf5a02-8f36-48a1-85f3-9b5562c3a2aa tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:22.550749 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2bf5a02-8f36-48a1-85f3-9b5562c3a2aa tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:22.551221 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2bf5a02-8f36-48a1-85f3-9b5562c3a2aa tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:22.551705 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2bf5a02-8f36-48a1-85f3-9b5562c3a2aa tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:22.570990 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-d2bf5a02-8f36-48a1-85f3-9b5562c3a2aa tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Getting quotas for project 52cb154d20324ed9815f877d58472dc3. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 02:16:22.577178 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-d2bf5a02-8f36-48a1-85f3-9b5562c3a2aa tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Getting quotas for user 9885dc064e3c46f6a7f9c19659ae96b3 and project 52cb154d20324ed9815f877d58472dc3. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 02:16:22.590574 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d2bf5a02-8f36-48a1-85f3-9b5562c3a2aa tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 02:16:22.592918 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d2bf5a02-8f36-48a1-85f3-9b5562c3a2aa tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] [instance: a507bdfd-c799-4fab-8ea0-0ecf879e644a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 02:16:22.706937 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d2bf5a02-8f36-48a1-85f3-9b5562c3a2aa tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.713800 Oct 30 02:16:22.707774 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3685/7055] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 02:16:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 30 02:16:22.720238 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8add48d0-7037-4a14-b910-586bb1d4ef91 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:16:22.721183 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8add48d0-7037-4a14-b910-586bb1d4ef91 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] [instance: a507bdfd-c799-4fab-8ea0-0ecf879e644a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:16:22.783152 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8add48d0-7037-4a14-b910-586bb1d4ef91 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885dc064e3c46f6a7f9c19659ae96b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cb154d20324ed9815f877d58472dc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:16:22.792530 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8add48d0-7037-4a14-b910-586bb1d4ef91 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] 10.222.0.13 "GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a" status: 200 len: 1214 microversion: 2.1 time: 0.076767 Oct 30 02:16:22.793208 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3686/7056] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:16:22 2022] GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:16:23.815808 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b26bf86a-34cc-496f-8559-ae552b9648de tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:16:23.816718 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b26bf86a-34cc-496f-8559-ae552b9648de tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] [instance: a507bdfd-c799-4fab-8ea0-0ecf879e644a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:16:23.869437 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b26bf86a-34cc-496f-8559-ae552b9648de tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885dc064e3c46f6a7f9c19659ae96b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cb154d20324ed9815f877d58472dc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:16:23.876400 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b26bf86a-34cc-496f-8559-ae552b9648de tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] 10.222.0.13 "GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a" status: 200 len: 1214 microversion: 2.1 time: 0.064700 Oct 30 02:16:23.876969 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3687/7057] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:16:23 2022] GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a => generated 1214 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:16:24.900769 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c62b6433-a239-4643-bec4-05e84e845dae tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:16:24.901427 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c62b6433-a239-4643-bec4-05e84e845dae tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] [instance: a507bdfd-c799-4fab-8ea0-0ecf879e644a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:16:24.909239 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c62b6433-a239-4643-bec4-05e84e845dae tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:24.909774 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c62b6433-a239-4643-bec4-05e84e845dae tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:24.910247 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c62b6433-a239-4643-bec4-05e84e845dae tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:24.910962 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c62b6433-a239-4643-bec4-05e84e845dae tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:24.911424 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c62b6433-a239-4643-bec4-05e84e845dae tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:24.911865 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c62b6433-a239-4643-bec4-05e84e845dae tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:24.977154 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c62b6433-a239-4643-bec4-05e84e845dae tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885dc064e3c46f6a7f9c19659ae96b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cb154d20324ed9815f877d58472dc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:16:24.988215 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c62b6433-a239-4643-bec4-05e84e845dae tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] 10.222.0.13 "GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a" status: 200 len: 1266 microversion: 2.1 time: 0.091952 Oct 30 02:16:24.989299 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3688/7058] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:16:24 2022] GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a => generated 1266 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:16:26.011944 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1039f1ea-fff6-43e8-9e00-ad69b1ad9e54 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:16:26.012570 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1039f1ea-fff6-43e8-9e00-ad69b1ad9e54 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] [instance: a507bdfd-c799-4fab-8ea0-0ecf879e644a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:16:26.019526 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1039f1ea-fff6-43e8-9e00-ad69b1ad9e54 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:26.020093 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1039f1ea-fff6-43e8-9e00-ad69b1ad9e54 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:26.020445 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1039f1ea-fff6-43e8-9e00-ad69b1ad9e54 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:26.021143 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1039f1ea-fff6-43e8-9e00-ad69b1ad9e54 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:26.021628 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1039f1ea-fff6-43e8-9e00-ad69b1ad9e54 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:26.022063 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1039f1ea-fff6-43e8-9e00-ad69b1ad9e54 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:26.175317 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1039f1ea-fff6-43e8-9e00-ad69b1ad9e54 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885dc064e3c46f6a7f9c19659ae96b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cb154d20324ed9815f877d58472dc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:16:26.182765 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1039f1ea-fff6-43e8-9e00-ad69b1ad9e54 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] 10.222.0.13 "GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a" status: 200 len: 1314 microversion: 2.1 time: 0.174767 Oct 30 02:16:26.184199 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3689/7059] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:16:26 2022] GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:16:27.055385 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-81d3ea8c-8e07-439e-851e-97cd36ccd70f req-98badeb7-ae31-46a5-96fc-cb43374ea696 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a507bdfd-c799-4fab-8ea0-0ecf879e644a", "tag": "a90f0680-8b29-4e20-9f4b-3422195c0dfa"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:16:27.069137 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-81d3ea8c-8e07-439e-851e-97cd36ccd70f req-98badeb7-ae31-46a5-96fc-cb43374ea696 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:27.069686 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-81d3ea8c-8e07-439e-851e-97cd36ccd70f req-98badeb7-ae31-46a5-96fc-cb43374ea696 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:27.070138 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-81d3ea8c-8e07-439e-851e-97cd36ccd70f req-98badeb7-ae31-46a5-96fc-cb43374ea696 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:27.084741 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-81d3ea8c-8e07-439e-851e-97cd36ccd70f req-98badeb7-ae31-46a5-96fc-cb43374ea696 service nova] Creating event network-changed:a90f0680-8b29-4e20-9f4b-3422195c0dfa for instance a507bdfd-c799-4fab-8ea0-0ecf879e644a on n-h2-master-1 Oct 30 02:16:27.090334 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-81d3ea8c-8e07-439e-851e-97cd36ccd70f req-98badeb7-ae31-46a5-96fc-cb43374ea696 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039967 Oct 30 02:16:27.091251 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3690/7060] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:16:27.215556 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c19b0438-541d-4d28-a1af-41077df28a70 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:16:27.216263 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c19b0438-541d-4d28-a1af-41077df28a70 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] [instance: a507bdfd-c799-4fab-8ea0-0ecf879e644a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:16:27.222481 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c19b0438-541d-4d28-a1af-41077df28a70 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:27.226532 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c19b0438-541d-4d28-a1af-41077df28a70 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:27.226532 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c19b0438-541d-4d28-a1af-41077df28a70 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:27.226532 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c19b0438-541d-4d28-a1af-41077df28a70 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:27.226532 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c19b0438-541d-4d28-a1af-41077df28a70 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:27.226532 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c19b0438-541d-4d28-a1af-41077df28a70 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:27.367926 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c19b0438-541d-4d28-a1af-41077df28a70 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885dc064e3c46f6a7f9c19659ae96b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cb154d20324ed9815f877d58472dc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:16:27.376151 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c19b0438-541d-4d28-a1af-41077df28a70 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] 10.222.0.13 "GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a" status: 200 len: 1314 microversion: 2.1 time: 0.164791 Oct 30 02:16:27.382187 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3691/7061] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:16:27 2022] GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:16:28.399735 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2c58f62f-89cb-4480-afa1-fc5bbfbafcaa tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:16:28.400410 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2c58f62f-89cb-4480-afa1-fc5bbfbafcaa tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] [instance: a507bdfd-c799-4fab-8ea0-0ecf879e644a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:16:28.406998 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2c58f62f-89cb-4480-afa1-fc5bbfbafcaa tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:28.407481 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2c58f62f-89cb-4480-afa1-fc5bbfbafcaa tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:28.407921 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2c58f62f-89cb-4480-afa1-fc5bbfbafcaa tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:28.408614 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2c58f62f-89cb-4480-afa1-fc5bbfbafcaa tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:28.409080 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2c58f62f-89cb-4480-afa1-fc5bbfbafcaa tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:28.409544 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2c58f62f-89cb-4480-afa1-fc5bbfbafcaa tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:28.536444 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2c58f62f-89cb-4480-afa1-fc5bbfbafcaa tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885dc064e3c46f6a7f9c19659ae96b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cb154d20324ed9815f877d58472dc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:16:28.544166 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2c58f62f-89cb-4480-afa1-fc5bbfbafcaa tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] 10.222.0.13 "GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a" status: 200 len: 1314 microversion: 2.1 time: 0.148919 Oct 30 02:16:28.544737 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3692/7062] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:16:28 2022] GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:16:29.566312 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b8a1a0a8-a21e-438a-b787-3c9f80eb18a6 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:16:29.566992 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b8a1a0a8-a21e-438a-b787-3c9f80eb18a6 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] [instance: a507bdfd-c799-4fab-8ea0-0ecf879e644a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:16:29.574369 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b8a1a0a8-a21e-438a-b787-3c9f80eb18a6 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:29.574865 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b8a1a0a8-a21e-438a-b787-3c9f80eb18a6 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:29.575317 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b8a1a0a8-a21e-438a-b787-3c9f80eb18a6 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:29.576021 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b8a1a0a8-a21e-438a-b787-3c9f80eb18a6 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:29.576488 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b8a1a0a8-a21e-438a-b787-3c9f80eb18a6 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:29.576925 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b8a1a0a8-a21e-438a-b787-3c9f80eb18a6 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:29.706407 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b8a1a0a8-a21e-438a-b787-3c9f80eb18a6 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885dc064e3c46f6a7f9c19659ae96b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cb154d20324ed9815f877d58472dc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:16:29.715087 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b8a1a0a8-a21e-438a-b787-3c9f80eb18a6 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] 10.222.0.13 "GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a" status: 200 len: 1314 microversion: 2.1 time: 0.153004 Oct 30 02:16:29.715662 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3693/7063] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:16:29 2022] GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:16:30.737703 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2ff824dd-e8f1-451f-8f6f-fb57721c0536 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:16:30.738336 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2ff824dd-e8f1-451f-8f6f-fb57721c0536 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] [instance: a507bdfd-c799-4fab-8ea0-0ecf879e644a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:16:30.745016 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ff824dd-e8f1-451f-8f6f-fb57721c0536 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:30.745554 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ff824dd-e8f1-451f-8f6f-fb57721c0536 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:30.746008 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ff824dd-e8f1-451f-8f6f-fb57721c0536 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:30.746712 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ff824dd-e8f1-451f-8f6f-fb57721c0536 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:30.747188 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ff824dd-e8f1-451f-8f6f-fb57721c0536 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:30.747637 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ff824dd-e8f1-451f-8f6f-fb57721c0536 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:30.874307 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2ff824dd-e8f1-451f-8f6f-fb57721c0536 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885dc064e3c46f6a7f9c19659ae96b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cb154d20324ed9815f877d58472dc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:16:30.882627 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2ff824dd-e8f1-451f-8f6f-fb57721c0536 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] 10.222.0.13 "GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a" status: 200 len: 1314 microversion: 2.1 time: 0.148429 Oct 30 02:16:30.883215 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3694/7064] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:16:30 2022] GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:16:31.906097 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8c020881-21ff-4f87-91ad-808134c315ec tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:16:31.906734 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8c020881-21ff-4f87-91ad-808134c315ec tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] [instance: a507bdfd-c799-4fab-8ea0-0ecf879e644a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:16:31.914330 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8c020881-21ff-4f87-91ad-808134c315ec tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:31.914834 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8c020881-21ff-4f87-91ad-808134c315ec tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:31.915288 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8c020881-21ff-4f87-91ad-808134c315ec tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:31.915994 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8c020881-21ff-4f87-91ad-808134c315ec tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:31.916465 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8c020881-21ff-4f87-91ad-808134c315ec tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:31.916951 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8c020881-21ff-4f87-91ad-808134c315ec tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:32.050937 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8c020881-21ff-4f87-91ad-808134c315ec tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885dc064e3c46f6a7f9c19659ae96b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cb154d20324ed9815f877d58472dc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:16:32.058862 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8c020881-21ff-4f87-91ad-808134c315ec tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] 10.222.0.13 "GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a" status: 200 len: 1314 microversion: 2.1 time: 0.156648 Oct 30 02:16:32.059432 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3695/7065] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:16:31 2022] GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:16:33.081849 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e94e13b9-fa82-42d1-ac5e-e8d011e5c32f tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:16:33.082469 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e94e13b9-fa82-42d1-ac5e-e8d011e5c32f tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] [instance: a507bdfd-c799-4fab-8ea0-0ecf879e644a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:16:33.084426 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:16:33.090683 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e94e13b9-fa82-42d1-ac5e-e8d011e5c32f tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:33.094029 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e94e13b9-fa82-42d1-ac5e-e8d011e5c32f tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:33.094029 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e94e13b9-fa82-42d1-ac5e-e8d011e5c32f tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:33.094029 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e94e13b9-fa82-42d1-ac5e-e8d011e5c32f tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:33.094029 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e94e13b9-fa82-42d1-ac5e-e8d011e5c32f tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:33.094029 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e94e13b9-fa82-42d1-ac5e-e8d011e5c32f tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:33.223076 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e94e13b9-fa82-42d1-ac5e-e8d011e5c32f tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885dc064e3c46f6a7f9c19659ae96b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cb154d20324ed9815f877d58472dc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:16:33.230718 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e94e13b9-fa82-42d1-ac5e-e8d011e5c32f tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] 10.222.0.13 "GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a" status: 200 len: 1314 microversion: 2.1 time: 0.152743 Oct 30 02:16:33.231297 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3696/7066] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:16:33 2022] GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:16:34.253314 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a0bd2b74-7613-4abf-9f68-27bf1deec9fc tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:16:34.253985 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a0bd2b74-7613-4abf-9f68-27bf1deec9fc tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] [instance: a507bdfd-c799-4fab-8ea0-0ecf879e644a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:16:34.255861 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=10 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:16:34.261780 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a0bd2b74-7613-4abf-9f68-27bf1deec9fc tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:34.267262 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a0bd2b74-7613-4abf-9f68-27bf1deec9fc tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:34.267262 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a0bd2b74-7613-4abf-9f68-27bf1deec9fc tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:34.267262 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a0bd2b74-7613-4abf-9f68-27bf1deec9fc tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:34.267262 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a0bd2b74-7613-4abf-9f68-27bf1deec9fc tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:34.267262 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a0bd2b74-7613-4abf-9f68-27bf1deec9fc tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:34.395204 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a0bd2b74-7613-4abf-9f68-27bf1deec9fc tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885dc064e3c46f6a7f9c19659ae96b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cb154d20324ed9815f877d58472dc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:16:34.403905 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a0bd2b74-7613-4abf-9f68-27bf1deec9fc tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] 10.222.0.13 "GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a" status: 200 len: 1314 microversion: 2.1 time: 0.154506 Oct 30 02:16:34.404497 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3697/7067] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:16:34 2022] GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:16:34.409287 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-884f86a7-5c63-4e7b-a379-1105f7bd7c23 req-c1202067-a06c-4a9f-b149-a0445b51f93f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a507bdfd-c799-4fab-8ea0-0ecf879e644a", "name": "network-vif-plugged", "status": "completed", "tag": "a90f0680-8b29-4e20-9f4b-3422195c0dfa"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:16:34.419489 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-884f86a7-5c63-4e7b-a379-1105f7bd7c23 req-c1202067-a06c-4a9f-b149-a0445b51f93f service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:34.420010 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-884f86a7-5c63-4e7b-a379-1105f7bd7c23 req-c1202067-a06c-4a9f-b149-a0445b51f93f service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:34.420454 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-884f86a7-5c63-4e7b-a379-1105f7bd7c23 req-c1202067-a06c-4a9f-b149-a0445b51f93f service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:34.431891 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-884f86a7-5c63-4e7b-a379-1105f7bd7c23 req-c1202067-a06c-4a9f-b149-a0445b51f93f service nova] Creating event network-vif-plugged:a90f0680-8b29-4e20-9f4b-3422195c0dfa for instance a507bdfd-c799-4fab-8ea0-0ecf879e644a on n-h2-master-1 Oct 30 02:16:34.436949 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-884f86a7-5c63-4e7b-a379-1105f7bd7c23 req-c1202067-a06c-4a9f-b149-a0445b51f93f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031237 Oct 30 02:16:34.437687 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3698/7068] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:16:35.429398 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b063ba73-4460-4d54-9a51-887999515824 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:16:35.430243 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b063ba73-4460-4d54-9a51-887999515824 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] [instance: a507bdfd-c799-4fab-8ea0-0ecf879e644a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:16:35.436445 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b063ba73-4460-4d54-9a51-887999515824 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:35.436939 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b063ba73-4460-4d54-9a51-887999515824 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:35.437408 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b063ba73-4460-4d54-9a51-887999515824 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:35.438110 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b063ba73-4460-4d54-9a51-887999515824 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:35.438577 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b063ba73-4460-4d54-9a51-887999515824 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:35.439014 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b063ba73-4460-4d54-9a51-887999515824 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:35.571022 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b063ba73-4460-4d54-9a51-887999515824 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885dc064e3c46f6a7f9c19659ae96b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cb154d20324ed9815f877d58472dc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:16:35.578982 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b063ba73-4460-4d54-9a51-887999515824 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] 10.222.0.13 "GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a" status: 200 len: 1314 microversion: 2.1 time: 0.155381 Oct 30 02:16:35.579559 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3699/7069] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:16:35 2022] GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:16:36.601929 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-397c7b97-dd06-4f80-bfbd-c6043c76310d tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:16:36.602608 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-397c7b97-dd06-4f80-bfbd-c6043c76310d tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] [instance: a507bdfd-c799-4fab-8ea0-0ecf879e644a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:16:36.609428 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-397c7b97-dd06-4f80-bfbd-c6043c76310d tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:36.609946 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-397c7b97-dd06-4f80-bfbd-c6043c76310d tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:36.610412 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-397c7b97-dd06-4f80-bfbd-c6043c76310d tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:36.611106 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-397c7b97-dd06-4f80-bfbd-c6043c76310d tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:36.611564 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-397c7b97-dd06-4f80-bfbd-c6043c76310d tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:36.611994 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-397c7b97-dd06-4f80-bfbd-c6043c76310d tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:36.616565 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:16:36.739508 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-397c7b97-dd06-4f80-bfbd-c6043c76310d tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885dc064e3c46f6a7f9c19659ae96b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cb154d20324ed9815f877d58472dc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:16:36.747879 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-397c7b97-dd06-4f80-bfbd-c6043c76310d tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] 10.222.0.13 "GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a" status: 200 len: 1500 microversion: 2.1 time: 0.149888 Oct 30 02:16:36.748450 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3700/7070] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:16:36 2022] GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a => generated 1500 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:16:36.770019 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b913005f-3d54-427d-99c3-37b5eb4e4ddb tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:16:36.772265 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b913005f-3d54-427d-99c3-37b5eb4e4ddb tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] [instance: a507bdfd-c799-4fab-8ea0-0ecf879e644a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:16:36.777995 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b913005f-3d54-427d-99c3-37b5eb4e4ddb tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:36.778485 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b913005f-3d54-427d-99c3-37b5eb4e4ddb tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:36.778929 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b913005f-3d54-427d-99c3-37b5eb4e4ddb tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:36.779625 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b913005f-3d54-427d-99c3-37b5eb4e4ddb tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:36.780086 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b913005f-3d54-427d-99c3-37b5eb4e4ddb tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:36.780518 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b913005f-3d54-427d-99c3-37b5eb4e4ddb tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:36.855549 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b913005f-3d54-427d-99c3-37b5eb4e4ddb tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9885dc064e3c46f6a7f9c19659ae96b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cb154d20324ed9815f877d58472dc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:16:36.860778 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b913005f-3d54-427d-99c3-37b5eb4e4ddb tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] [instance: a507bdfd-c799-4fab-8ea0-0ecf879e644a] Old instance type m1.heat2, new instance type m1.heat {{(pid=121102) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 30 02:16:36.867794 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-b913005f-3d54-427d-99c3-37b5eb4e4ddb tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 02:16:36.868225 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-b913005f-3d54-427d-99c3-37b5eb4e4ddb tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 02:16:36.868708 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-b913005f-3d54-427d-99c3-37b5eb4e4ddb tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 02:16:36.869124 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-b913005f-3d54-427d-99c3-37b5eb4e4ddb tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 02:16:36.869570 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-b913005f-3d54-427d-99c3-37b5eb4e4ddb tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 02:16:37.108181 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b913005f-3d54-427d-99c3-37b5eb4e4ddb tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] 10.222.0.13 "POST /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a/action" status: 202 len: 0 microversion: 2.1 time: 0.341744 Oct 30 02:16:37.108720 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3701/7071] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 02:16:36 2022] POST /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a/action => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 30 02:16:37.116654 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-602708f2-96c6-4e36-b875-0e36bc9f092a tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:16:37.117279 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-602708f2-96c6-4e36-b875-0e36bc9f092a tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] [instance: a507bdfd-c799-4fab-8ea0-0ecf879e644a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:16:37.123379 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-602708f2-96c6-4e36-b875-0e36bc9f092a tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:37.123880 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-602708f2-96c6-4e36-b875-0e36bc9f092a tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:37.124388 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-602708f2-96c6-4e36-b875-0e36bc9f092a tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:37.125129 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-602708f2-96c6-4e36-b875-0e36bc9f092a tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:37.125607 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-602708f2-96c6-4e36-b875-0e36bc9f092a tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:37.126047 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-602708f2-96c6-4e36-b875-0e36bc9f092a tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:37.262738 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-602708f2-96c6-4e36-b875-0e36bc9f092a tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885dc064e3c46f6a7f9c19659ae96b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cb154d20324ed9815f877d58472dc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:16:37.270620 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-602708f2-96c6-4e36-b875-0e36bc9f092a tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] 10.222.0.13 "GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a" status: 200 len: 1509 microversion: 2.1 time: 0.157701 Oct 30 02:16:37.275882 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3702/7072] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:16:37 2022] GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:16:38.294683 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5d5e66ed-fc95-46eb-a237-4965066a02b7 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:16:38.295395 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5d5e66ed-fc95-46eb-a237-4965066a02b7 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] [instance: a507bdfd-c799-4fab-8ea0-0ecf879e644a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:16:38.302544 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5d5e66ed-fc95-46eb-a237-4965066a02b7 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:38.303038 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5d5e66ed-fc95-46eb-a237-4965066a02b7 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:38.303524 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5d5e66ed-fc95-46eb-a237-4965066a02b7 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:38.304738 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5d5e66ed-fc95-46eb-a237-4965066a02b7 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:38.305206 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5d5e66ed-fc95-46eb-a237-4965066a02b7 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:38.305671 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5d5e66ed-fc95-46eb-a237-4965066a02b7 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:38.433508 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5d5e66ed-fc95-46eb-a237-4965066a02b7 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885dc064e3c46f6a7f9c19659ae96b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cb154d20324ed9815f877d58472dc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:16:38.441691 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5d5e66ed-fc95-46eb-a237-4965066a02b7 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] 10.222.0.13 "GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a" status: 200 len: 1509 microversion: 2.1 time: 0.150940 Oct 30 02:16:38.444258 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3703/7073] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:16:38 2022] GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:16:39.464674 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-40127993-100e-4c36-bab6-6431df5e722b tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:16:39.465324 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-40127993-100e-4c36-bab6-6431df5e722b tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] [instance: a507bdfd-c799-4fab-8ea0-0ecf879e644a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:16:39.472211 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-40127993-100e-4c36-bab6-6431df5e722b tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:39.472716 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-40127993-100e-4c36-bab6-6431df5e722b tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:39.473163 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-40127993-100e-4c36-bab6-6431df5e722b tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:39.473897 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-40127993-100e-4c36-bab6-6431df5e722b tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:39.474368 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-40127993-100e-4c36-bab6-6431df5e722b tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:39.474808 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-40127993-100e-4c36-bab6-6431df5e722b tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:39.604787 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-40127993-100e-4c36-bab6-6431df5e722b tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885dc064e3c46f6a7f9c19659ae96b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cb154d20324ed9815f877d58472dc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:16:39.612709 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-40127993-100e-4c36-bab6-6431df5e722b tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] 10.222.0.13 "GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a" status: 200 len: 1509 microversion: 2.1 time: 0.152066 Oct 30 02:16:39.613287 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3704/7074] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:16:39 2022] GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:16:40.636279 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1f24dcf1-bd16-4dd1-8b51-08cc3eedc108 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:16:40.636972 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1f24dcf1-bd16-4dd1-8b51-08cc3eedc108 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] [instance: a507bdfd-c799-4fab-8ea0-0ecf879e644a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:16:40.639631 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:16:40.644357 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1f24dcf1-bd16-4dd1-8b51-08cc3eedc108 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:40.644855 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1f24dcf1-bd16-4dd1-8b51-08cc3eedc108 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:40.645305 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1f24dcf1-bd16-4dd1-8b51-08cc3eedc108 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:40.646068 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1f24dcf1-bd16-4dd1-8b51-08cc3eedc108 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:40.646537 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1f24dcf1-bd16-4dd1-8b51-08cc3eedc108 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:40.647003 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1f24dcf1-bd16-4dd1-8b51-08cc3eedc108 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:40.782684 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1f24dcf1-bd16-4dd1-8b51-08cc3eedc108 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885dc064e3c46f6a7f9c19659ae96b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cb154d20324ed9815f877d58472dc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:16:40.790497 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1f24dcf1-bd16-4dd1-8b51-08cc3eedc108 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] 10.222.0.13 "GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a" status: 200 len: 1514 microversion: 2.1 time: 0.158620 Oct 30 02:16:40.791079 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3705/7075] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:16:40 2022] GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:16:41.814173 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-14e39d68-ca3e-4da0-8336-09f19aec8892 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:16:41.815078 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-14e39d68-ca3e-4da0-8336-09f19aec8892 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] [instance: a507bdfd-c799-4fab-8ea0-0ecf879e644a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:16:41.821803 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-14e39d68-ca3e-4da0-8336-09f19aec8892 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:41.822291 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-14e39d68-ca3e-4da0-8336-09f19aec8892 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:41.822732 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-14e39d68-ca3e-4da0-8336-09f19aec8892 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:41.823427 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-14e39d68-ca3e-4da0-8336-09f19aec8892 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:41.823885 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-14e39d68-ca3e-4da0-8336-09f19aec8892 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:41.824312 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-14e39d68-ca3e-4da0-8336-09f19aec8892 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:41.950724 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-14e39d68-ca3e-4da0-8336-09f19aec8892 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885dc064e3c46f6a7f9c19659ae96b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cb154d20324ed9815f877d58472dc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:16:41.958473 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-14e39d68-ca3e-4da0-8336-09f19aec8892 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] 10.222.0.13 "GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a" status: 200 len: 1514 microversion: 2.1 time: 0.148456 Oct 30 02:16:41.959045 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3706/7076] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:16:41 2022] GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:16:42.981735 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-15464d64-7e37-4e3c-81dc-f67b87a85cfb tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:16:42.982354 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-15464d64-7e37-4e3c-81dc-f67b87a85cfb tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] [instance: a507bdfd-c799-4fab-8ea0-0ecf879e644a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:16:42.989120 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-15464d64-7e37-4e3c-81dc-f67b87a85cfb tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:42.989762 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-15464d64-7e37-4e3c-81dc-f67b87a85cfb tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:42.990206 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-15464d64-7e37-4e3c-81dc-f67b87a85cfb tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:42.990906 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-15464d64-7e37-4e3c-81dc-f67b87a85cfb tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:42.992010 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-15464d64-7e37-4e3c-81dc-f67b87a85cfb tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:42.992443 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-15464d64-7e37-4e3c-81dc-f67b87a85cfb tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:43.124196 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-15464d64-7e37-4e3c-81dc-f67b87a85cfb tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885dc064e3c46f6a7f9c19659ae96b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cb154d20324ed9815f877d58472dc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:16:43.132478 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-15464d64-7e37-4e3c-81dc-f67b87a85cfb tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] 10.222.0.13 "GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a" status: 200 len: 1514 microversion: 2.1 time: 0.154043 Oct 30 02:16:43.133045 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3707/7077] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:16:42 2022] GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:16:44.155348 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-78c5bb17-3e06-4cc3-b127-2795d41ba523 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:16:44.155956 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-78c5bb17-3e06-4cc3-b127-2795d41ba523 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] [instance: a507bdfd-c799-4fab-8ea0-0ecf879e644a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:16:44.162670 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-78c5bb17-3e06-4cc3-b127-2795d41ba523 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:44.163164 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-78c5bb17-3e06-4cc3-b127-2795d41ba523 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:44.163607 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-78c5bb17-3e06-4cc3-b127-2795d41ba523 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:44.164301 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-78c5bb17-3e06-4cc3-b127-2795d41ba523 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:44.164757 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-78c5bb17-3e06-4cc3-b127-2795d41ba523 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:44.165189 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-78c5bb17-3e06-4cc3-b127-2795d41ba523 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:44.294293 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-78c5bb17-3e06-4cc3-b127-2795d41ba523 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885dc064e3c46f6a7f9c19659ae96b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cb154d20324ed9815f877d58472dc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:16:44.302009 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-78c5bb17-3e06-4cc3-b127-2795d41ba523 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] 10.222.0.13 "GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a" status: 200 len: 1514 microversion: 2.1 time: 0.150635 Oct 30 02:16:44.302567 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3708/7078] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:16:44 2022] GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:16:45.199253 n-d-master-1 devstack@n-api.service[121103]: DEBUG neutronclient.v2_0.client [None req-8178fc88-d9fe-4376-9c3d-b6483d24add1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Error message: {"NeutronError": {"type": "NetworkNotFound", "message": "Network aa518046-7164-40fa-a3f3-11422c6acc97 could not be found.", "detail": ""}} {{(pid=121103) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 30 02:16:45.218151 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi [None req-8178fc88-d9fe-4376-9c3d-b6483d24add1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Unexpected exception in API method: neutronclient.common.exceptions.NetworkNotFoundClient: Network aa518046-7164-40fa-a3f3-11422c6acc97 could not be found. Oct 30 02:16:45.218151 n-d-master-1 devstack@n-api.service[121103]: Neutron server returns request_ids: ['req-9696f142-9fdd-4608-9467-253ba5d68d8a'] Oct 30 02:16:45.218151 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:16:45.218151 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:16:45.218151 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:16:45.218151 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 02:16:45.218151 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 02:16:45.218151 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 02:16:45.218151 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 02:16:45.218151 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 02:16:45.218151 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 02:16:45.218151 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 30 02:16:45.218151 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 30 02:16:45.218151 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 30 02:16:45.218151 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 30 02:16:45.218151 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 30 02:16:45.218151 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 30 02:16:45.218151 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 30 02:16:45.218151 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 30 02:16:45.218151 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 30 02:16:45.218151 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2347, in create_resource_requests Oct 30 02:16:45.218151 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi physnet, tunneled_ = self._get_physnet_tunneled_info( Oct 30 02:16:45.218151 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2133, in _get_physnet_tunneled_info Oct 30 02:16:45.218151 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi network = neutron.show_network(net_id, Oct 30 02:16:45.218151 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 02:16:45.218151 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 02:16:45.218151 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 865, in show_network Oct 30 02:16:45.218151 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.get(self.network_path % (network), params=_params) Oct 30 02:16:45.218151 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 02:16:45.218151 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 02:16:45.218151 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 30 02:16:45.218151 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 30 02:16:45.218151 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 02:16:45.218151 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 02:16:45.218151 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 30 02:16:45.218151 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 30 02:16:45.218151 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 02:16:45.218151 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 02:16:45.218151 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 30 02:16:45.218151 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 30 02:16:45.218151 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 02:16:45.218151 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 02:16:45.218151 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 30 02:16:45.218151 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 30 02:16:45.218151 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 30 02:16:45.218151 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 30 02:16:45.218151 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NetworkNotFoundClient: Network aa518046-7164-40fa-a3f3-11422c6acc97 could not be found. Oct 30 02:16:45.218151 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9696f142-9fdd-4608-9467-253ba5d68d8a'] Oct 30 02:16:45.218151 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:16:45.222085 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-8178fc88-d9fe-4376-9c3d-b6483d24add1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 30 02:16:45.222085 n-d-master-1 devstack@n-api.service[121103]: Oct 30 02:16:45.222085 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8178fc88-d9fe-4376-9c3d-b6483d24add1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Request method failure captured: Oct 30 02:16:45.222085 n-d-master-1 devstack@n-api.service[121103]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 30 02:16:45.222085 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 02:16:45.222085 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 02:16:45.222085 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 02:16:45.222085 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 352 Oct 30 02:16:45.222085 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 02:16:45.222085 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 02:16:45.222085 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 02:16:45.222085 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 02:16:45.222085 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXdrUzAoetWsdn8k4HYTcqbVG7Zs75eMmndnkEOPA0S-TmAgSQ2b5nMGLS0qTcKbMaQTaaQPoAGl2nSU9lucNctaJ1zTE6xKSNocI5VbroWnIgVb8SnDnXRJPuQdp0_RS-b7KWfvV5q_soI5fUH8iU2dwXESX56PU08-DTzNpHjo6aLI Oct 30 02:16:45.222085 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 02:16:45.222085 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 02:16:45.222085 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 02:16:45.222085 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 02:16:45.222085 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 02:16:45.222085 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 02:16:45.222085 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 99e1cde224c845caaa743246e60e338d Oct 30 02:16:45.222085 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-TestVolumeBootPattern-1509499038 Oct 30 02:16:45.222085 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 02:16:45.222085 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 02:16:45.222085 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/99e1cde224c845caaa743246e60e338d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_99e1cde224c845caaa743246e60e338d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/99e1cde224c845caaa743246e60e338d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/99e1cde224c845caaa743246e60e338d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:16:45.222085 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-TestVolumeBootPattern-1509499038 Oct 30 02:16:45.222085 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 99e1cde224c845caaa743246e60e338d Oct 30 02:16:45.222085 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-TestVolumeBootPattern-1509499038 Oct 30 02:16:45.222085 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-TestVolumeBootPattern-1509499038-project Oct 30 02:16:45.222085 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 02:16:45.222085 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 02:16:45.222085 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: a0ec990e687d427d88dcf9879a1d5b0c Oct 30 02:16:45.222085 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-TestVolumeBootPattern-1509499038-project Oct 30 02:16:45.222085 n-d-master-1 devstack@n-api.service[121103]: Oct 30 02:16:45.222085 n-d-master-1 devstack@n-api.service[121103]: {"server": {"name": "tempest-TestVolumeBootPattern-server-91144235", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "780536ec-e7cb-4e01-b1a8-8474778e09b0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "aa518046-7164-40fa-a3f3-11422c6acc97"}]}} Oct 30 02:16:45.222085 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 02:16:45.222085 n-d-master-1 devstack@n-api.service[121103]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 30 02:16:45.222085 n-d-master-1 devstack@n-api.service[121103]: Oct 30 02:16:45.222085 n-d-master-1 devstack@n-api.service[121103]: action_args: {'body': {'server': {'name': 'tempest-TestVolumeBootPattern-server-91144235', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'delete_on_termination': False, 'volume_id': '780536ec-e7cb-4e01-b1a8-8474778e09b0'}], 'networks': [{'uuid': 'aa518046-7164-40fa-a3f3-11422c6acc97'}]}}} Oct 30 02:16:45.222085 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:16:45.222085 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:16:45.222085 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:16:45.222085 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:16:45.222085 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 02:16:45.222085 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 02:16:45.222085 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 02:16:45.222085 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 02:16:45.222085 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 02:16:45.222085 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 02:16:45.222085 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 30 02:16:45.222085 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 30 02:16:45.222085 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 30 02:16:45.222085 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 30 02:16:45.222085 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 30 02:16:45.222085 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 30 02:16:45.222085 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 30 02:16:45.222085 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 30 02:16:45.222085 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 30 02:16:45.226253 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2347, in create_resource_requests Oct 30 02:16:45.226253 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi physnet, tunneled_ = self._get_physnet_tunneled_info( Oct 30 02:16:45.226253 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2133, in _get_physnet_tunneled_info Oct 30 02:16:45.226253 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi network = neutron.show_network(net_id, Oct 30 02:16:45.226253 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 02:16:45.226253 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 02:16:45.226253 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 865, in show_network Oct 30 02:16:45.226253 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.get(self.network_path % (network), params=_params) Oct 30 02:16:45.226253 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 02:16:45.226253 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 02:16:45.226253 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 30 02:16:45.226253 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 30 02:16:45.226253 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 02:16:45.226253 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 02:16:45.226253 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 30 02:16:45.226253 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 30 02:16:45.226253 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 02:16:45.226253 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 02:16:45.226253 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 30 02:16:45.226253 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 30 02:16:45.226253 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 30 02:16:45.226253 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 30 02:16:45.226253 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 30 02:16:45.226253 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 30 02:16:45.226253 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 30 02:16:45.226253 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 30 02:16:45.226253 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NetworkNotFoundClient: Network aa518046-7164-40fa-a3f3-11422c6acc97 could not be found. Oct 30 02:16:45.226253 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9696f142-9fdd-4608-9467-253ba5d68d8a'] Oct 30 02:16:45.226253 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:16:45.226253 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:16:45.226253 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:16:45.226253 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:16:45.226253 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:16:45.226253 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:16:45.226253 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:16:45.226253 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:16:45.226253 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 30 02:16:45.226253 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 30 02:16:45.226253 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 30 02:16:45.226253 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:16:45.226253 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:16:45.226253 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:16:45.226253 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:16:45.226253 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:16:45.226253 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:16:45.226253 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:16:45.226253 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:16:45.226253 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:16:45.226253 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 30 02:16:45.226253 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:16:45.226253 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:16:45.226253 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8178fc88-d9fe-4376-9c3d-b6483d24add1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 30 02:16:45.226253 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:16:45.230040 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8178fc88-d9fe-4376-9c3d-b6483d24add1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 500 len: 227 microversion: 2.1 time: 900.474179 Oct 30 02:16:45.230040 n-d-master-1 devstack@n-api.service[121103]: Sun Oct 30 02:16:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.13) !!! Oct 30 02:16:45.230040 n-d-master-1 devstack@n-api.service[121103]: Sun Oct 30 02:16:45 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during POST /compute/v2.1/servers (10.222.0.13) Oct 30 02:16:45.230040 n-d-master-1 devstack@n-api.service[121103]: CRITICAL nova [None req-8178fc88-d9fe-4376-9c3d-b6483d24add1 tempest-TestVolumeBootPattern-1509499038 tempest-TestVolumeBootPattern-1509499038-project] Unhandled error: OSError: write error Oct 30 02:16:45.230040 n-d-master-1 devstack@n-api.service[121103]: ERROR nova OSError: write error Oct 30 02:16:45.230040 n-d-master-1 devstack@n-api.service[121103]: ERROR nova Oct 30 02:16:45.230040 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3371/7079] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 02:01:44 2022] POST /compute/v2.1/servers => generated 0 bytes in 900476 msecs (HTTP/1.1 500) 9 headers in 0 bytes (0 switches on core 0) Oct 30 02:16:45.326090 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-364dff3b-7c2f-47f0-bd7b-d89200633c7e tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:16:45.326725 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-364dff3b-7c2f-47f0-bd7b-d89200633c7e tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] [instance: a507bdfd-c799-4fab-8ea0-0ecf879e644a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:16:45.333854 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-364dff3b-7c2f-47f0-bd7b-d89200633c7e tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:45.334352 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-364dff3b-7c2f-47f0-bd7b-d89200633c7e tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:45.335352 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-364dff3b-7c2f-47f0-bd7b-d89200633c7e tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:45.336071 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-364dff3b-7c2f-47f0-bd7b-d89200633c7e tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:45.336543 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-364dff3b-7c2f-47f0-bd7b-d89200633c7e tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:45.336983 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-364dff3b-7c2f-47f0-bd7b-d89200633c7e tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:45.468288 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-364dff3b-7c2f-47f0-bd7b-d89200633c7e tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885dc064e3c46f6a7f9c19659ae96b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cb154d20324ed9815f877d58472dc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:16:45.476147 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-364dff3b-7c2f-47f0-bd7b-d89200633c7e tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] 10.222.0.13 "GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a" status: 200 len: 1514 microversion: 2.1 time: 0.153987 Oct 30 02:16:45.476719 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3709/7080] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:16:45 2022] GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:16:46.500762 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0e2ac28c-b675-4ac4-889a-80dc2fcdaafc tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:16:46.501525 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0e2ac28c-b675-4ac4-889a-80dc2fcdaafc tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] [instance: a507bdfd-c799-4fab-8ea0-0ecf879e644a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:16:46.510612 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0e2ac28c-b675-4ac4-889a-80dc2fcdaafc tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:46.511100 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0e2ac28c-b675-4ac4-889a-80dc2fcdaafc tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:46.511534 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0e2ac28c-b675-4ac4-889a-80dc2fcdaafc tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:46.512222 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0e2ac28c-b675-4ac4-889a-80dc2fcdaafc tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:46.512676 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0e2ac28c-b675-4ac4-889a-80dc2fcdaafc tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:46.513103 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0e2ac28c-b675-4ac4-889a-80dc2fcdaafc tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:46.759366 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0e2ac28c-b675-4ac4-889a-80dc2fcdaafc tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885dc064e3c46f6a7f9c19659ae96b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cb154d20324ed9815f877d58472dc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:16:46.767087 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0e2ac28c-b675-4ac4-889a-80dc2fcdaafc tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] 10.222.0.13 "GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a" status: 200 len: 1514 microversion: 2.1 time: 0.271968 Oct 30 02:16:46.767655 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3372/7081] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:16:46 2022] GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a => generated 1514 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:16:47.791159 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f4703cf1-eaad-4ee4-905c-0827175f8eb2 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:16:47.791705 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f4703cf1-eaad-4ee4-905c-0827175f8eb2 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] [instance: a507bdfd-c799-4fab-8ea0-0ecf879e644a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:16:47.798726 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f4703cf1-eaad-4ee4-905c-0827175f8eb2 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:47.799220 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f4703cf1-eaad-4ee4-905c-0827175f8eb2 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:47.799663 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f4703cf1-eaad-4ee4-905c-0827175f8eb2 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:47.800363 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f4703cf1-eaad-4ee4-905c-0827175f8eb2 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:47.800823 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f4703cf1-eaad-4ee4-905c-0827175f8eb2 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:47.801259 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f4703cf1-eaad-4ee4-905c-0827175f8eb2 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:47.929164 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f4703cf1-eaad-4ee4-905c-0827175f8eb2 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885dc064e3c46f6a7f9c19659ae96b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cb154d20324ed9815f877d58472dc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:16:47.936926 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f4703cf1-eaad-4ee4-905c-0827175f8eb2 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] 10.222.0.13 "GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a" status: 200 len: 1514 microversion: 2.1 time: 0.150377 Oct 30 02:16:47.937524 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3710/7082] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:16:47 2022] GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:16:48.960496 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f6ef3363-10dc-48b4-9b90-cbc705adaa4b tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:16:48.961200 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f6ef3363-10dc-48b4-9b90-cbc705adaa4b tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] [instance: a507bdfd-c799-4fab-8ea0-0ecf879e644a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:16:48.970657 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f6ef3363-10dc-48b4-9b90-cbc705adaa4b tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:48.970755 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f6ef3363-10dc-48b4-9b90-cbc705adaa4b tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:48.971228 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f6ef3363-10dc-48b4-9b90-cbc705adaa4b tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:48.971892 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f6ef3363-10dc-48b4-9b90-cbc705adaa4b tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:48.972351 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f6ef3363-10dc-48b4-9b90-cbc705adaa4b tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:48.972781 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f6ef3363-10dc-48b4-9b90-cbc705adaa4b tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:49.429443 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f6ef3363-10dc-48b4-9b90-cbc705adaa4b tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885dc064e3c46f6a7f9c19659ae96b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cb154d20324ed9815f877d58472dc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:16:49.437284 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f6ef3363-10dc-48b4-9b90-cbc705adaa4b tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] 10.222.0.13 "GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a" status: 200 len: 1514 microversion: 2.1 time: 0.480820 Oct 30 02:16:49.437886 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3373/7083] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:16:48 2022] GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a => generated 1514 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:16:50.460980 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-470f3463-6722-4250-9765-e259ceeac6a7 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:16:50.461629 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-470f3463-6722-4250-9765-e259ceeac6a7 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] [instance: a507bdfd-c799-4fab-8ea0-0ecf879e644a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:16:50.468978 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-470f3463-6722-4250-9765-e259ceeac6a7 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:50.469492 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-470f3463-6722-4250-9765-e259ceeac6a7 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:50.469936 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-470f3463-6722-4250-9765-e259ceeac6a7 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:50.470633 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-470f3463-6722-4250-9765-e259ceeac6a7 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:50.471125 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-470f3463-6722-4250-9765-e259ceeac6a7 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:50.471556 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-470f3463-6722-4250-9765-e259ceeac6a7 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:50.598517 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-470f3463-6722-4250-9765-e259ceeac6a7 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885dc064e3c46f6a7f9c19659ae96b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cb154d20324ed9815f877d58472dc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:16:50.606769 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-470f3463-6722-4250-9765-e259ceeac6a7 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] 10.222.0.13 "GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a" status: 200 len: 1514 microversion: 2.1 time: 0.149711 Oct 30 02:16:50.607342 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3711/7084] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:16:50 2022] GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:16:51.629133 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d5289f8a-1017-4a2f-b1a3-9fb925e57c0e tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:16:51.629784 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d5289f8a-1017-4a2f-b1a3-9fb925e57c0e tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] [instance: a507bdfd-c799-4fab-8ea0-0ecf879e644a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:16:51.638874 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d5289f8a-1017-4a2f-b1a3-9fb925e57c0e tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:51.639363 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d5289f8a-1017-4a2f-b1a3-9fb925e57c0e tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:51.639802 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d5289f8a-1017-4a2f-b1a3-9fb925e57c0e tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:51.640502 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d5289f8a-1017-4a2f-b1a3-9fb925e57c0e tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:51.640963 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d5289f8a-1017-4a2f-b1a3-9fb925e57c0e tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:51.641425 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d5289f8a-1017-4a2f-b1a3-9fb925e57c0e tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:51.768508 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d5289f8a-1017-4a2f-b1a3-9fb925e57c0e tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885dc064e3c46f6a7f9c19659ae96b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cb154d20324ed9815f877d58472dc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:16:51.776826 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d5289f8a-1017-4a2f-b1a3-9fb925e57c0e tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] 10.222.0.13 "GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a" status: 200 len: 1514 microversion: 2.1 time: 0.151785 Oct 30 02:16:51.777425 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3374/7085] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:16:51 2022] GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:16:52.800380 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-231d8fb8-a096-409e-b6a6-432a1354af93 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:16:52.800926 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-231d8fb8-a096-409e-b6a6-432a1354af93 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] [instance: a507bdfd-c799-4fab-8ea0-0ecf879e644a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:16:52.808504 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-231d8fb8-a096-409e-b6a6-432a1354af93 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:52.808997 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-231d8fb8-a096-409e-b6a6-432a1354af93 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:52.809731 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-231d8fb8-a096-409e-b6a6-432a1354af93 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:52.810612 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-231d8fb8-a096-409e-b6a6-432a1354af93 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:52.811080 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-231d8fb8-a096-409e-b6a6-432a1354af93 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:52.811517 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-231d8fb8-a096-409e-b6a6-432a1354af93 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:52.945509 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-231d8fb8-a096-409e-b6a6-432a1354af93 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885dc064e3c46f6a7f9c19659ae96b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cb154d20324ed9815f877d58472dc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:16:52.953294 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-231d8fb8-a096-409e-b6a6-432a1354af93 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] 10.222.0.13 "GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a" status: 200 len: 1514 microversion: 2.1 time: 0.157219 Oct 30 02:16:52.953908 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3712/7086] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:16:52 2022] GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:16:53.977288 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c1a0b50d-e9a8-4d3a-9014-ed55b4acf98d tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:16:53.977918 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c1a0b50d-e9a8-4d3a-9014-ed55b4acf98d tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] [instance: a507bdfd-c799-4fab-8ea0-0ecf879e644a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:16:53.986920 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c1a0b50d-e9a8-4d3a-9014-ed55b4acf98d tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:53.987411 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c1a0b50d-e9a8-4d3a-9014-ed55b4acf98d tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:53.987853 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c1a0b50d-e9a8-4d3a-9014-ed55b4acf98d tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:53.988550 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c1a0b50d-e9a8-4d3a-9014-ed55b4acf98d tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:53.989007 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c1a0b50d-e9a8-4d3a-9014-ed55b4acf98d tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:53.989463 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c1a0b50d-e9a8-4d3a-9014-ed55b4acf98d tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:54.118109 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c1a0b50d-e9a8-4d3a-9014-ed55b4acf98d tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885dc064e3c46f6a7f9c19659ae96b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cb154d20324ed9815f877d58472dc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:16:54.125896 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c1a0b50d-e9a8-4d3a-9014-ed55b4acf98d tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] 10.222.0.13 "GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a" status: 200 len: 1514 microversion: 2.1 time: 0.152550 Oct 30 02:16:54.126491 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3375/7087] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:16:53 2022] GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:16:55.149599 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6327ddfe-7cac-4299-9ce3-eeea57bf66bd tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:16:55.150198 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6327ddfe-7cac-4299-9ce3-eeea57bf66bd tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] [instance: a507bdfd-c799-4fab-8ea0-0ecf879e644a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:16:55.156928 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6327ddfe-7cac-4299-9ce3-eeea57bf66bd tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:55.157476 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6327ddfe-7cac-4299-9ce3-eeea57bf66bd tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:55.157926 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6327ddfe-7cac-4299-9ce3-eeea57bf66bd tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:55.158616 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6327ddfe-7cac-4299-9ce3-eeea57bf66bd tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:55.159078 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6327ddfe-7cac-4299-9ce3-eeea57bf66bd tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:55.159506 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6327ddfe-7cac-4299-9ce3-eeea57bf66bd tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:55.289117 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6327ddfe-7cac-4299-9ce3-eeea57bf66bd tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885dc064e3c46f6a7f9c19659ae96b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cb154d20324ed9815f877d58472dc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:16:55.297348 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6327ddfe-7cac-4299-9ce3-eeea57bf66bd tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] 10.222.0.13 "GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a" status: 200 len: 1514 microversion: 2.1 time: 0.152178 Oct 30 02:16:55.297931 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3713/7088] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:16:55 2022] GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:16:56.320281 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1c39f452-691f-49eb-ad2a-2575393ca2dd tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:16:56.320937 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1c39f452-691f-49eb-ad2a-2575393ca2dd tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] [instance: a507bdfd-c799-4fab-8ea0-0ecf879e644a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:16:56.329962 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1c39f452-691f-49eb-ad2a-2575393ca2dd tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:56.331628 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1c39f452-691f-49eb-ad2a-2575393ca2dd tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:56.331628 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1c39f452-691f-49eb-ad2a-2575393ca2dd tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:56.331628 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1c39f452-691f-49eb-ad2a-2575393ca2dd tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:56.332038 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1c39f452-691f-49eb-ad2a-2575393ca2dd tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:56.332461 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1c39f452-691f-49eb-ad2a-2575393ca2dd tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:56.461156 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1c39f452-691f-49eb-ad2a-2575393ca2dd tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885dc064e3c46f6a7f9c19659ae96b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cb154d20324ed9815f877d58472dc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:16:56.468901 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1c39f452-691f-49eb-ad2a-2575393ca2dd tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] 10.222.0.13 "GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a" status: 200 len: 1514 microversion: 2.1 time: 0.152583 Oct 30 02:16:56.469501 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3376/7089] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:16:56 2022] GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:16:57.492230 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f8793fd9-5484-4fbd-9d78-e8055b8d2981 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:16:57.493277 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f8793fd9-5484-4fbd-9d78-e8055b8d2981 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] [instance: a507bdfd-c799-4fab-8ea0-0ecf879e644a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:16:57.500255 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f8793fd9-5484-4fbd-9d78-e8055b8d2981 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:57.500757 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f8793fd9-5484-4fbd-9d78-e8055b8d2981 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:57.501195 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f8793fd9-5484-4fbd-9d78-e8055b8d2981 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:57.501924 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f8793fd9-5484-4fbd-9d78-e8055b8d2981 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:57.502385 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f8793fd9-5484-4fbd-9d78-e8055b8d2981 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:57.502820 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f8793fd9-5484-4fbd-9d78-e8055b8d2981 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:57.635092 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f8793fd9-5484-4fbd-9d78-e8055b8d2981 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885dc064e3c46f6a7f9c19659ae96b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cb154d20324ed9815f877d58472dc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:16:57.642982 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f8793fd9-5484-4fbd-9d78-e8055b8d2981 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] 10.222.0.13 "GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a" status: 200 len: 1514 microversion: 2.1 time: 0.154673 Oct 30 02:16:57.643565 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3714/7090] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:16:57 2022] GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:16:58.666327 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-04736725-8f02-4f1a-9b3a-32acc4724a6b tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:16:58.666951 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-04736725-8f02-4f1a-9b3a-32acc4724a6b tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] [instance: a507bdfd-c799-4fab-8ea0-0ecf879e644a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:16:58.673878 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-04736725-8f02-4f1a-9b3a-32acc4724a6b tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:58.674366 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-04736725-8f02-4f1a-9b3a-32acc4724a6b tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:58.674809 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-04736725-8f02-4f1a-9b3a-32acc4724a6b tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:58.675503 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-04736725-8f02-4f1a-9b3a-32acc4724a6b tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:58.675960 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-04736725-8f02-4f1a-9b3a-32acc4724a6b tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:58.676387 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-04736725-8f02-4f1a-9b3a-32acc4724a6b tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:58.809587 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-04736725-8f02-4f1a-9b3a-32acc4724a6b tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885dc064e3c46f6a7f9c19659ae96b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cb154d20324ed9815f877d58472dc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:16:58.817654 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-04736725-8f02-4f1a-9b3a-32acc4724a6b tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] 10.222.0.13 "GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a" status: 200 len: 1514 microversion: 2.1 time: 0.155236 Oct 30 02:16:58.818246 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3377/7091] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:16:58 2022] GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:16:59.840379 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-04920d0a-7acc-4ab1-bc32-10464e8a9c00 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:16:59.841037 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-04920d0a-7acc-4ab1-bc32-10464e8a9c00 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] [instance: a507bdfd-c799-4fab-8ea0-0ecf879e644a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:16:59.847922 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04920d0a-7acc-4ab1-bc32-10464e8a9c00 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:59.848420 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04920d0a-7acc-4ab1-bc32-10464e8a9c00 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:59.848867 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04920d0a-7acc-4ab1-bc32-10464e8a9c00 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:59.849592 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04920d0a-7acc-4ab1-bc32-10464e8a9c00 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:16:59.850058 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04920d0a-7acc-4ab1-bc32-10464e8a9c00 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:16:59.850496 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04920d0a-7acc-4ab1-bc32-10464e8a9c00 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:16:59.868472 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:16:59.979869 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-04920d0a-7acc-4ab1-bc32-10464e8a9c00 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885dc064e3c46f6a7f9c19659ae96b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cb154d20324ed9815f877d58472dc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:16:59.987472 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-04920d0a-7acc-4ab1-bc32-10464e8a9c00 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] 10.222.0.13 "GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a" status: 200 len: 1514 microversion: 2.1 time: 0.150990 Oct 30 02:16:59.988051 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3715/7092] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:16:59 2022] GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:17:01.009900 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5d426e83-5907-404b-bae7-d8a3ba327d3a tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:17:01.010529 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5d426e83-5907-404b-bae7-d8a3ba327d3a tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] [instance: a507bdfd-c799-4fab-8ea0-0ecf879e644a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:17:01.018178 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5d426e83-5907-404b-bae7-d8a3ba327d3a tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:01.018665 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5d426e83-5907-404b-bae7-d8a3ba327d3a tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:01.019098 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5d426e83-5907-404b-bae7-d8a3ba327d3a tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:01.019789 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5d426e83-5907-404b-bae7-d8a3ba327d3a tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:01.020240 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5d426e83-5907-404b-bae7-d8a3ba327d3a tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:01.020662 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5d426e83-5907-404b-bae7-d8a3ba327d3a tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:01.147422 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5d426e83-5907-404b-bae7-d8a3ba327d3a tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885dc064e3c46f6a7f9c19659ae96b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cb154d20324ed9815f877d58472dc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:17:01.155082 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5d426e83-5907-404b-bae7-d8a3ba327d3a tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] 10.222.0.13 "GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a" status: 200 len: 1514 microversion: 2.1 time: 0.149150 Oct 30 02:17:01.155774 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3378/7093] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:17:01 2022] GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:17:02.178742 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ce2840ac-e9cc-4515-b546-400b5b97daf2 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:17:02.179381 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ce2840ac-e9cc-4515-b546-400b5b97daf2 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] [instance: a507bdfd-c799-4fab-8ea0-0ecf879e644a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:17:02.186451 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce2840ac-e9cc-4515-b546-400b5b97daf2 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:02.187020 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce2840ac-e9cc-4515-b546-400b5b97daf2 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:02.187469 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce2840ac-e9cc-4515-b546-400b5b97daf2 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:02.188179 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce2840ac-e9cc-4515-b546-400b5b97daf2 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:02.188650 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce2840ac-e9cc-4515-b546-400b5b97daf2 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:02.189356 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce2840ac-e9cc-4515-b546-400b5b97daf2 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:02.317346 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ce2840ac-e9cc-4515-b546-400b5b97daf2 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885dc064e3c46f6a7f9c19659ae96b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cb154d20324ed9815f877d58472dc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:17:02.325643 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ce2840ac-e9cc-4515-b546-400b5b97daf2 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] 10.222.0.13 "GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a" status: 200 len: 1514 microversion: 2.1 time: 0.150872 Oct 30 02:17:02.326216 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3716/7094] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:17:02 2022] GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:17:03.348938 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-152a2258-2998-4aa5-adc4-c6a523249ea4 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:17:03.349679 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-152a2258-2998-4aa5-adc4-c6a523249ea4 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] [instance: a507bdfd-c799-4fab-8ea0-0ecf879e644a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:17:03.356484 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-152a2258-2998-4aa5-adc4-c6a523249ea4 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:03.356972 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-152a2258-2998-4aa5-adc4-c6a523249ea4 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:03.357440 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-152a2258-2998-4aa5-adc4-c6a523249ea4 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:03.358139 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-152a2258-2998-4aa5-adc4-c6a523249ea4 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:03.358594 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-152a2258-2998-4aa5-adc4-c6a523249ea4 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:03.359020 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-152a2258-2998-4aa5-adc4-c6a523249ea4 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:03.487498 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-152a2258-2998-4aa5-adc4-c6a523249ea4 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885dc064e3c46f6a7f9c19659ae96b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cb154d20324ed9815f877d58472dc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:17:03.495711 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-152a2258-2998-4aa5-adc4-c6a523249ea4 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] 10.222.0.13 "GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a" status: 200 len: 1514 microversion: 2.1 time: 0.150806 Oct 30 02:17:03.496284 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3379/7095] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:17:03 2022] GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:17:04.518568 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e7ba8366-378d-4a50-b000-c5926cc61675 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:17:04.519189 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e7ba8366-378d-4a50-b000-c5926cc61675 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] [instance: a507bdfd-c799-4fab-8ea0-0ecf879e644a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:17:04.526988 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e7ba8366-378d-4a50-b000-c5926cc61675 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:04.527499 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e7ba8366-378d-4a50-b000-c5926cc61675 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:04.527977 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e7ba8366-378d-4a50-b000-c5926cc61675 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:04.528692 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e7ba8366-378d-4a50-b000-c5926cc61675 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:04.529160 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e7ba8366-378d-4a50-b000-c5926cc61675 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:04.529628 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e7ba8366-378d-4a50-b000-c5926cc61675 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:04.660255 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e7ba8366-378d-4a50-b000-c5926cc61675 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885dc064e3c46f6a7f9c19659ae96b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cb154d20324ed9815f877d58472dc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:17:04.667978 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e7ba8366-378d-4a50-b000-c5926cc61675 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] 10.222.0.13 "GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a" status: 200 len: 1514 microversion: 2.1 time: 0.153318 Oct 30 02:17:04.668553 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3717/7096] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:17:04 2022] GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:17:05.691740 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-67b4d04b-9306-4a08-a711-6206bf4b631d tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:17:05.692383 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-67b4d04b-9306-4a08-a711-6206bf4b631d tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] [instance: a507bdfd-c799-4fab-8ea0-0ecf879e644a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:17:05.699812 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-67b4d04b-9306-4a08-a711-6206bf4b631d tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:05.700298 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-67b4d04b-9306-4a08-a711-6206bf4b631d tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:05.700729 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-67b4d04b-9306-4a08-a711-6206bf4b631d tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:05.701455 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-67b4d04b-9306-4a08-a711-6206bf4b631d tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:05.701915 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-67b4d04b-9306-4a08-a711-6206bf4b631d tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:05.702337 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-67b4d04b-9306-4a08-a711-6206bf4b631d tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:05.834716 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-67b4d04b-9306-4a08-a711-6206bf4b631d tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885dc064e3c46f6a7f9c19659ae96b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cb154d20324ed9815f877d58472dc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:17:05.842495 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-67b4d04b-9306-4a08-a711-6206bf4b631d tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] 10.222.0.13 "GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a" status: 200 len: 1514 microversion: 2.1 time: 0.155310 Oct 30 02:17:05.843067 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3380/7097] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:17:05 2022] GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:17:06.865446 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6487e205-d799-45d5-90bf-4998b1ccfc79 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:17:06.866083 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6487e205-d799-45d5-90bf-4998b1ccfc79 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] [instance: a507bdfd-c799-4fab-8ea0-0ecf879e644a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:17:06.873679 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6487e205-d799-45d5-90bf-4998b1ccfc79 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:06.874179 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6487e205-d799-45d5-90bf-4998b1ccfc79 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:06.874626 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6487e205-d799-45d5-90bf-4998b1ccfc79 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:06.875331 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6487e205-d799-45d5-90bf-4998b1ccfc79 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:06.875802 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6487e205-d799-45d5-90bf-4998b1ccfc79 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:06.876247 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6487e205-d799-45d5-90bf-4998b1ccfc79 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:07.008377 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6487e205-d799-45d5-90bf-4998b1ccfc79 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885dc064e3c46f6a7f9c19659ae96b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cb154d20324ed9815f877d58472dc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:17:07.016224 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6487e205-d799-45d5-90bf-4998b1ccfc79 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] 10.222.0.13 "GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a" status: 200 len: 1514 microversion: 2.1 time: 0.154710 Oct 30 02:17:07.016806 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3718/7098] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:17:06 2022] GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:17:08.039443 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8e232fc5-9ec4-4c6f-b33f-04d74c55740a tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:17:08.040070 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8e232fc5-9ec4-4c6f-b33f-04d74c55740a tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] [instance: a507bdfd-c799-4fab-8ea0-0ecf879e644a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:17:08.047649 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8e232fc5-9ec4-4c6f-b33f-04d74c55740a tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:08.048139 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8e232fc5-9ec4-4c6f-b33f-04d74c55740a tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:08.048608 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8e232fc5-9ec4-4c6f-b33f-04d74c55740a tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:08.049299 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8e232fc5-9ec4-4c6f-b33f-04d74c55740a tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:08.049780 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8e232fc5-9ec4-4c6f-b33f-04d74c55740a tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:08.050207 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8e232fc5-9ec4-4c6f-b33f-04d74c55740a tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:08.052803 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=55 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:17:08.179736 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8e232fc5-9ec4-4c6f-b33f-04d74c55740a tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885dc064e3c46f6a7f9c19659ae96b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cb154d20324ed9815f877d58472dc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:17:08.187708 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8e232fc5-9ec4-4c6f-b33f-04d74c55740a tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] 10.222.0.13 "GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a" status: 200 len: 1514 microversion: 2.1 time: 0.152239 Oct 30 02:17:08.188276 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3381/7099] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:17:08 2022] GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:17:09.211008 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7313eb04-d1bc-4549-bdd5-ba3aebcfaf6f tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:17:09.211629 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7313eb04-d1bc-4549-bdd5-ba3aebcfaf6f tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] [instance: a507bdfd-c799-4fab-8ea0-0ecf879e644a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:17:09.218593 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7313eb04-d1bc-4549-bdd5-ba3aebcfaf6f tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:09.219080 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7313eb04-d1bc-4549-bdd5-ba3aebcfaf6f tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:09.219522 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7313eb04-d1bc-4549-bdd5-ba3aebcfaf6f tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:09.220215 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7313eb04-d1bc-4549-bdd5-ba3aebcfaf6f tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:09.220675 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7313eb04-d1bc-4549-bdd5-ba3aebcfaf6f tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:09.221106 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7313eb04-d1bc-4549-bdd5-ba3aebcfaf6f tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:09.353628 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7313eb04-d1bc-4549-bdd5-ba3aebcfaf6f tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885dc064e3c46f6a7f9c19659ae96b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cb154d20324ed9815f877d58472dc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:17:09.361482 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7313eb04-d1bc-4549-bdd5-ba3aebcfaf6f tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] 10.222.0.13 "GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a" status: 200 len: 1514 microversion: 2.1 time: 0.154314 Oct 30 02:17:09.362058 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3719/7100] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:17:09 2022] GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:17:10.384049 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-255e6f1b-f886-4cd6-a41b-631f685136ff tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:17:10.384669 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-255e6f1b-f886-4cd6-a41b-631f685136ff tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] [instance: a507bdfd-c799-4fab-8ea0-0ecf879e644a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:17:10.391520 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-255e6f1b-f886-4cd6-a41b-631f685136ff tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:10.392005 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-255e6f1b-f886-4cd6-a41b-631f685136ff tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:10.392442 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-255e6f1b-f886-4cd6-a41b-631f685136ff tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:10.393138 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-255e6f1b-f886-4cd6-a41b-631f685136ff tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:10.393625 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-255e6f1b-f886-4cd6-a41b-631f685136ff tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:10.394055 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-255e6f1b-f886-4cd6-a41b-631f685136ff tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:10.525887 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-255e6f1b-f886-4cd6-a41b-631f685136ff tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885dc064e3c46f6a7f9c19659ae96b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cb154d20324ed9815f877d58472dc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:17:10.533923 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-255e6f1b-f886-4cd6-a41b-631f685136ff tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] 10.222.0.13 "GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a" status: 200 len: 1514 microversion: 2.1 time: 0.153828 Oct 30 02:17:10.534504 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3382/7101] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:17:10 2022] GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:17:11.557985 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1fafd215-6384-4b60-84f2-2efc5d253fa9 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:17:11.558639 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1fafd215-6384-4b60-84f2-2efc5d253fa9 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] [instance: a507bdfd-c799-4fab-8ea0-0ecf879e644a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:17:11.560657 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=30 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:17:11.565626 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1fafd215-6384-4b60-84f2-2efc5d253fa9 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:11.566121 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1fafd215-6384-4b60-84f2-2efc5d253fa9 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:11.566566 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1fafd215-6384-4b60-84f2-2efc5d253fa9 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:11.567263 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1fafd215-6384-4b60-84f2-2efc5d253fa9 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:11.567726 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1fafd215-6384-4b60-84f2-2efc5d253fa9 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:11.568164 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1fafd215-6384-4b60-84f2-2efc5d253fa9 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:11.694268 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1fafd215-6384-4b60-84f2-2efc5d253fa9 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885dc064e3c46f6a7f9c19659ae96b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cb154d20324ed9815f877d58472dc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:17:11.702515 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1fafd215-6384-4b60-84f2-2efc5d253fa9 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] 10.222.0.13 "GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a" status: 200 len: 1514 microversion: 2.1 time: 0.149151 Oct 30 02:17:11.703081 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3720/7102] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:17:11 2022] GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:17:12.725053 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2280b62b-3e4b-411a-9d60-f33b12580abc tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:17:12.725698 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2280b62b-3e4b-411a-9d60-f33b12580abc tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] [instance: a507bdfd-c799-4fab-8ea0-0ecf879e644a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:17:12.732934 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2280b62b-3e4b-411a-9d60-f33b12580abc tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:12.733462 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2280b62b-3e4b-411a-9d60-f33b12580abc tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:12.733901 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2280b62b-3e4b-411a-9d60-f33b12580abc tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:12.734600 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2280b62b-3e4b-411a-9d60-f33b12580abc tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:12.735058 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2280b62b-3e4b-411a-9d60-f33b12580abc tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:12.735534 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2280b62b-3e4b-411a-9d60-f33b12580abc tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:12.874046 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2280b62b-3e4b-411a-9d60-f33b12580abc tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885dc064e3c46f6a7f9c19659ae96b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cb154d20324ed9815f877d58472dc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:17:12.882040 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2280b62b-3e4b-411a-9d60-f33b12580abc tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] 10.222.0.13 "GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a" status: 200 len: 1514 microversion: 2.1 time: 0.160968 Oct 30 02:17:12.882636 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3383/7103] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:17:12 2022] GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:17:13.365567 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-9d697c4a-b109-412f-9312-9dd812ef3467 req-450ba3f6-75bd-49b6-b1ca-d82281a10056 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a507bdfd-c799-4fab-8ea0-0ecf879e644a", "name": "network-vif-unplugged", "status": "completed", "tag": "a90f0680-8b29-4e20-9f4b-3422195c0dfa"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:17:13.375677 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-9d697c4a-b109-412f-9312-9dd812ef3467 req-450ba3f6-75bd-49b6-b1ca-d82281a10056 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:13.376172 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-9d697c4a-b109-412f-9312-9dd812ef3467 req-450ba3f6-75bd-49b6-b1ca-d82281a10056 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:13.376614 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-9d697c4a-b109-412f-9312-9dd812ef3467 req-450ba3f6-75bd-49b6-b1ca-d82281a10056 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:13.388747 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-9d697c4a-b109-412f-9312-9dd812ef3467 req-450ba3f6-75bd-49b6-b1ca-d82281a10056 service nova] Creating event network-vif-unplugged:a90f0680-8b29-4e20-9f4b-3422195c0dfa for instance a507bdfd-c799-4fab-8ea0-0ecf879e644a on n-h1-master-1 Oct 30 02:17:13.394241 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [req-9d697c4a-b109-412f-9312-9dd812ef3467 req-450ba3f6-75bd-49b6-b1ca-d82281a10056 service nova] Instance a507bdfd-c799-4fab-8ea0-0ecf879e644a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=121102) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 30 02:17:13.406893 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-9d697c4a-b109-412f-9312-9dd812ef3467 req-450ba3f6-75bd-49b6-b1ca-d82281a10056 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045118 Oct 30 02:17:13.407481 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3721/7104] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:17:13.905358 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ccea3cde-947e-48d9-a325-de4944dec79c tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:17:13.905992 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ccea3cde-947e-48d9-a325-de4944dec79c tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] [instance: a507bdfd-c799-4fab-8ea0-0ecf879e644a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:17:13.912790 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ccea3cde-947e-48d9-a325-de4944dec79c tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:13.913281 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ccea3cde-947e-48d9-a325-de4944dec79c tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:13.913762 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ccea3cde-947e-48d9-a325-de4944dec79c tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:13.914460 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ccea3cde-947e-48d9-a325-de4944dec79c tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:13.914926 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ccea3cde-947e-48d9-a325-de4944dec79c tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:13.915354 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ccea3cde-947e-48d9-a325-de4944dec79c tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:14.051399 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ccea3cde-947e-48d9-a325-de4944dec79c tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885dc064e3c46f6a7f9c19659ae96b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cb154d20324ed9815f877d58472dc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:17:14.059925 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ccea3cde-947e-48d9-a325-de4944dec79c tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] 10.222.0.13 "GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a" status: 200 len: 1513 microversion: 2.1 time: 0.158538 Oct 30 02:17:14.060511 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3384/7105] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:17:13 2022] GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:17:15.086158 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4854cf39-14fb-4b90-9ab3-461a1bb09ea5 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:17:15.086892 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4854cf39-14fb-4b90-9ab3-461a1bb09ea5 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] [instance: a507bdfd-c799-4fab-8ea0-0ecf879e644a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:17:15.093053 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4854cf39-14fb-4b90-9ab3-461a1bb09ea5 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:15.093587 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4854cf39-14fb-4b90-9ab3-461a1bb09ea5 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:15.094034 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4854cf39-14fb-4b90-9ab3-461a1bb09ea5 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:15.094728 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4854cf39-14fb-4b90-9ab3-461a1bb09ea5 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:15.095191 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4854cf39-14fb-4b90-9ab3-461a1bb09ea5 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:15.095626 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4854cf39-14fb-4b90-9ab3-461a1bb09ea5 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:15.225728 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4854cf39-14fb-4b90-9ab3-461a1bb09ea5 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885dc064e3c46f6a7f9c19659ae96b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cb154d20324ed9815f877d58472dc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:17:15.234256 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4854cf39-14fb-4b90-9ab3-461a1bb09ea5 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] 10.222.0.13 "GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a" status: 200 len: 1511 microversion: 2.1 time: 0.153342 Oct 30 02:17:15.234867 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3722/7106] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:17:15 2022] GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a => generated 1511 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:17:15.421935 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-453f8474-4d66-4906-819b-14097fa561cd req-ab51ab16-78ba-4a15-8604-815ae99b758a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a507bdfd-c799-4fab-8ea0-0ecf879e644a", "tag": "a90f0680-8b29-4e20-9f4b-3422195c0dfa"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:17:15.427840 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=27 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:17:15.432856 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-453f8474-4d66-4906-819b-14097fa561cd req-ab51ab16-78ba-4a15-8604-815ae99b758a service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:15.433353 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-453f8474-4d66-4906-819b-14097fa561cd req-ab51ab16-78ba-4a15-8604-815ae99b758a service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:15.433954 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-453f8474-4d66-4906-819b-14097fa561cd req-ab51ab16-78ba-4a15-8604-815ae99b758a service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:15.445907 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-453f8474-4d66-4906-819b-14097fa561cd req-ab51ab16-78ba-4a15-8604-815ae99b758a service nova] Creating event network-changed:a90f0680-8b29-4e20-9f4b-3422195c0dfa for instance a507bdfd-c799-4fab-8ea0-0ecf879e644a on n-h1-master-1 Oct 30 02:17:15.451559 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [req-453f8474-4d66-4906-819b-14097fa561cd req-ab51ab16-78ba-4a15-8604-815ae99b758a service nova] Instance a507bdfd-c799-4fab-8ea0-0ecf879e644a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=121103) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 30 02:17:15.463932 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-453f8474-4d66-4906-819b-14097fa561cd req-ab51ab16-78ba-4a15-8604-815ae99b758a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045282 Oct 30 02:17:15.464518 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3385/7107] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:17:16.257174 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d9b87a75-22d3-475f-867b-b5113e95538e tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:17:16.257829 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d9b87a75-22d3-475f-867b-b5113e95538e tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] [instance: a507bdfd-c799-4fab-8ea0-0ecf879e644a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:17:16.265491 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9b87a75-22d3-475f-867b-b5113e95538e tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:16.265997 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9b87a75-22d3-475f-867b-b5113e95538e tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:16.266442 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9b87a75-22d3-475f-867b-b5113e95538e tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:16.267162 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9b87a75-22d3-475f-867b-b5113e95538e tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:16.267628 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9b87a75-22d3-475f-867b-b5113e95538e tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:16.268055 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9b87a75-22d3-475f-867b-b5113e95538e tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:16.469018 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d9b87a75-22d3-475f-867b-b5113e95538e tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885dc064e3c46f6a7f9c19659ae96b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cb154d20324ed9815f877d58472dc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:17:16.477191 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d9b87a75-22d3-475f-867b-b5113e95538e tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] 10.222.0.13 "GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a" status: 200 len: 1511 microversion: 2.1 time: 0.223928 Oct 30 02:17:16.477796 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3723/7108] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:17:16 2022] GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a => generated 1511 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:17:17.501163 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5595d095-5ab1-4630-accf-8e13b8390b5e tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:17:17.501911 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5595d095-5ab1-4630-accf-8e13b8390b5e tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] [instance: a507bdfd-c799-4fab-8ea0-0ecf879e644a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:17:17.508893 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5595d095-5ab1-4630-accf-8e13b8390b5e tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:17.509422 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5595d095-5ab1-4630-accf-8e13b8390b5e tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:17.509867 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5595d095-5ab1-4630-accf-8e13b8390b5e tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:17.511220 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5595d095-5ab1-4630-accf-8e13b8390b5e tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:17.511686 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5595d095-5ab1-4630-accf-8e13b8390b5e tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:17.512126 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5595d095-5ab1-4630-accf-8e13b8390b5e tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:17.646439 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5595d095-5ab1-4630-accf-8e13b8390b5e tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885dc064e3c46f6a7f9c19659ae96b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cb154d20324ed9815f877d58472dc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:17:17.654228 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5595d095-5ab1-4630-accf-8e13b8390b5e tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] 10.222.0.13 "GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a" status: 200 len: 1508 microversion: 2.1 time: 0.157461 Oct 30 02:17:17.654796 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3386/7109] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:17:17 2022] GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:17:17.675778 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9188abff-ca47-41bb-939e-1ae027d74791 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:17:17.676297 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9188abff-ca47-41bb-939e-1ae027d74791 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] [instance: a507bdfd-c799-4fab-8ea0-0ecf879e644a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:17:17.683714 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9188abff-ca47-41bb-939e-1ae027d74791 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:17.684214 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9188abff-ca47-41bb-939e-1ae027d74791 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:17.684665 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9188abff-ca47-41bb-939e-1ae027d74791 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:17.685397 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9188abff-ca47-41bb-939e-1ae027d74791 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:17.685867 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9188abff-ca47-41bb-939e-1ae027d74791 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:17.686306 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9188abff-ca47-41bb-939e-1ae027d74791 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:17.712267 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9188abff-ca47-41bb-939e-1ae027d74791 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] [instance: a507bdfd-c799-4fab-8ea0-0ecf879e644a] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 02:17:17.820175 n-d-master-1 devstack@n-api.service[121102]: INFO nova.compute.api [None req-9188abff-ca47-41bb-939e-1ae027d74791 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] [instance: a507bdfd-c799-4fab-8ea0-0ecf879e644a] Found an unconfirmed migration during delete, id: 16, status: finished Oct 30 02:17:18.871664 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-8f1df8c4-0f0e-42e0-8875-887860b4d631 req-60905c3f-7020-46ee-9d13-49c4248ed88d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a507bdfd-c799-4fab-8ea0-0ecf879e644a", "name": "network-vif-plugged", "status": "completed", "tag": "a90f0680-8b29-4e20-9f4b-3422195c0dfa"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:17:18.884181 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-8f1df8c4-0f0e-42e0-8875-887860b4d631 req-60905c3f-7020-46ee-9d13-49c4248ed88d service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:18.884667 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-8f1df8c4-0f0e-42e0-8875-887860b4d631 req-60905c3f-7020-46ee-9d13-49c4248ed88d service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:18.885628 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-8f1df8c4-0f0e-42e0-8875-887860b4d631 req-60905c3f-7020-46ee-9d13-49c4248ed88d service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:18.897962 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-8f1df8c4-0f0e-42e0-8875-887860b4d631 req-60905c3f-7020-46ee-9d13-49c4248ed88d service nova] Creating event network-vif-plugged:a90f0680-8b29-4e20-9f4b-3422195c0dfa for instance a507bdfd-c799-4fab-8ea0-0ecf879e644a on n-h1-master-1 Oct 30 02:17:18.904190 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [req-8f1df8c4-0f0e-42e0-8875-887860b4d631 req-60905c3f-7020-46ee-9d13-49c4248ed88d service nova] Instance a507bdfd-c799-4fab-8ea0-0ecf879e644a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=121103) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 30 02:17:18.916141 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-8f1df8c4-0f0e-42e0-8875-887860b4d631 req-60905c3f-7020-46ee-9d13-49c4248ed88d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048604 Oct 30 02:17:18.916914 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3387/7110] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:17:20.109631 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9188abff-ca47-41bb-939e-1ae027d74791 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a" status: 204 len: 0 microversion: 2.1 time: 2.437333 Oct 30 02:17:20.110312 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3724/7111] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 02:17:17 2022] DELETE /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a => generated 0 bytes in 2439 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 02:17:20.120976 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9f4cb722-efc3-46ca-9f7c-6d4e742696bf tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:17:20.121705 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9f4cb722-efc3-46ca-9f7c-6d4e742696bf tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] [instance: a507bdfd-c799-4fab-8ea0-0ecf879e644a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:17:20.127864 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9f4cb722-efc3-46ca-9f7c-6d4e742696bf tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:20.128346 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9f4cb722-efc3-46ca-9f7c-6d4e742696bf tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:20.128779 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9f4cb722-efc3-46ca-9f7c-6d4e742696bf tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:20.129494 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9f4cb722-efc3-46ca-9f7c-6d4e742696bf tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:20.129945 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9f4cb722-efc3-46ca-9f7c-6d4e742696bf tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:20.130383 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9f4cb722-efc3-46ca-9f7c-6d4e742696bf tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:20.269031 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9f4cb722-efc3-46ca-9f7c-6d4e742696bf tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885dc064e3c46f6a7f9c19659ae96b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cb154d20324ed9815f877d58472dc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:17:20.277769 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9f4cb722-efc3-46ca-9f7c-6d4e742696bf tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] 10.222.0.13 "GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a" status: 200 len: 1500 microversion: 2.1 time: 0.161893 Oct 30 02:17:20.278356 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3388/7112] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:17:20 2022] GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a => generated 1500 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:17:21.301460 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cf07911b-89e0-4a42-802b-cb68cf26e15e tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:17:21.302185 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cf07911b-89e0-4a42-802b-cb68cf26e15e tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] [instance: a507bdfd-c799-4fab-8ea0-0ecf879e644a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:17:21.309690 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cf07911b-89e0-4a42-802b-cb68cf26e15e tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:21.310192 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cf07911b-89e0-4a42-802b-cb68cf26e15e tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:21.310647 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cf07911b-89e0-4a42-802b-cb68cf26e15e tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:21.311358 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cf07911b-89e0-4a42-802b-cb68cf26e15e tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:21.311862 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cf07911b-89e0-4a42-802b-cb68cf26e15e tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:21.312309 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cf07911b-89e0-4a42-802b-cb68cf26e15e tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:21.441975 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-cf07911b-89e0-4a42-802b-cb68cf26e15e tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885dc064e3c46f6a7f9c19659ae96b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cb154d20324ed9815f877d58472dc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:17:21.449824 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cf07911b-89e0-4a42-802b-cb68cf26e15e tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] 10.222.0.13 "GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a" status: 200 len: 1500 microversion: 2.1 time: 0.152734 Oct 30 02:17:21.450395 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3725/7113] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:17:21 2022] GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a => generated 1500 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:17:22.182853 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-724aa594-d4f8-46b3-a8c4-b19f466ec59c req-d9ce2d0a-f806-4c2e-833c-1a8e5de8be63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a507bdfd-c799-4fab-8ea0-0ecf879e644a", "name": "network-vif-deleted", "tag": "a90f0680-8b29-4e20-9f4b-3422195c0dfa"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:17:22.195175 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-724aa594-d4f8-46b3-a8c4-b19f466ec59c req-d9ce2d0a-f806-4c2e-833c-1a8e5de8be63 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:22.195653 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-724aa594-d4f8-46b3-a8c4-b19f466ec59c req-d9ce2d0a-f806-4c2e-833c-1a8e5de8be63 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:22.196085 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-724aa594-d4f8-46b3-a8c4-b19f466ec59c req-d9ce2d0a-f806-4c2e-833c-1a8e5de8be63 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:22.208083 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-724aa594-d4f8-46b3-a8c4-b19f466ec59c req-d9ce2d0a-f806-4c2e-833c-1a8e5de8be63 service nova] Creating event network-vif-deleted:a90f0680-8b29-4e20-9f4b-3422195c0dfa for instance a507bdfd-c799-4fab-8ea0-0ecf879e644a on n-h1-master-1 Oct 30 02:17:22.213945 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-724aa594-d4f8-46b3-a8c4-b19f466ec59c req-d9ce2d0a-f806-4c2e-833c-1a8e5de8be63 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034388 Oct 30 02:17:22.214580 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3389/7114] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:17:22.472698 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3de3900f-94f4-4a58-9783-f618e84128c8 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:17:22.473268 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3de3900f-94f4-4a58-9783-f618e84128c8 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] [instance: a507bdfd-c799-4fab-8ea0-0ecf879e644a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:17:22.480439 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3de3900f-94f4-4a58-9783-f618e84128c8 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:22.480946 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3de3900f-94f4-4a58-9783-f618e84128c8 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:22.481431 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3de3900f-94f4-4a58-9783-f618e84128c8 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:22.482141 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3de3900f-94f4-4a58-9783-f618e84128c8 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:22.482606 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3de3900f-94f4-4a58-9783-f618e84128c8 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:22.483042 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3de3900f-94f4-4a58-9783-f618e84128c8 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:22.515747 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3de3900f-94f4-4a58-9783-f618e84128c8 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:22.516380 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3de3900f-94f4-4a58-9783-f618e84128c8 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:22.516865 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3de3900f-94f4-4a58-9783-f618e84128c8 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:22.517416 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-3de3900f-94f4-4a58-9783-f618e84128c8 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lazy-loading 'fault' on Instance uuid a507bdfd-c799-4fab-8ea0-0ecf879e644a {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 02:17:22.558969 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3de3900f-94f4-4a58-9783-f618e84128c8 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885dc064e3c46f6a7f9c19659ae96b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cb154d20324ed9815f877d58472dc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:17:22.566998 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3de3900f-94f4-4a58-9783-f618e84128c8 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] 10.222.0.13 "GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a" status: 200 len: 1304 microversion: 2.1 time: 0.098406 Oct 30 02:17:22.567559 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3726/7115] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:17:22 2022] GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:17:23.591339 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2b97d7df-a8da-4d30-acb4-0420279e69b7 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:17:23.592069 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2b97d7df-a8da-4d30-acb4-0420279e69b7 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] [instance: a507bdfd-c799-4fab-8ea0-0ecf879e644a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:17:23.599082 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2b97d7df-a8da-4d30-acb4-0420279e69b7 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:23.599564 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2b97d7df-a8da-4d30-acb4-0420279e69b7 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:23.599999 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2b97d7df-a8da-4d30-acb4-0420279e69b7 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:23.600689 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2b97d7df-a8da-4d30-acb4-0420279e69b7 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:23.601144 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2b97d7df-a8da-4d30-acb4-0420279e69b7 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:23.601598 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2b97d7df-a8da-4d30-acb4-0420279e69b7 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:23.615445 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-2b97d7df-a8da-4d30-acb4-0420279e69b7 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] HTTP exception thrown: Instance a507bdfd-c799-4fab-8ea0-0ecf879e644a could not be found. Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2b97d7df-a8da-4d30-acb4-0420279e69b7 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Request method failure captured: Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a HTTP/1.1 Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXd51-4i8J3IXJM476hIY5BuHcdNcKp77p6Mb7SvTXbVlt4Ug5DT2nAwFxvPKEITjDZRgs8uOMH-_xXBrNDsHXw1bvJTVjItetvbyM97HDEvZxJAH0yN8ZdsaTrOMyUEWlRiLBaKfFe2LqyDte1Rz_ooKQH7BLfFEl-lxX3aKW4JoNfc Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 52cb154d20324ed9815f877d58472dc3 Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-DeleteServersTestJSON-1426900780 Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/52cb154d20324ed9815f877d58472dc3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_52cb154d20324ed9815f877d58472dc3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/52cb154d20324ed9815f877d58472dc3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/52cb154d20324ed9815f877d58472dc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-DeleteServersTestJSON-1426900780 Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 52cb154d20324ed9815f877d58472dc3 Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-DeleteServersTestJSON-1426900780 Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-DeleteServersTestJSON-1426900780-project Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 9885dc064e3c46f6a7f9c19659ae96b3 Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-DeleteServersTestJSON-1426900780-project Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: exception: Instance a507bdfd-c799-4fab-8ea0-0ecf879e644a could not be found. Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'a507bdfd-c799-4fab-8ea0-0ecf879e644a'} Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a507bdfd-c799-4fab-8ea0-0ecf879e644a could not be found. Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a507bdfd-c799-4fab-8ea0-0ecf879e644a could not be found. Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:17:23.617051 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:17:23.622130 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:17:23.622130 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:17:23.622130 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:17:23.622130 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:17:23.622130 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:17:23.622130 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a507bdfd-c799-4fab-8ea0-0ecf879e644a could not be found. Oct 30 02:17:23.622130 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:17:23.622130 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2b97d7df-a8da-4d30-acb4-0420279e69b7 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Returning 404 to user: Instance a507bdfd-c799-4fab-8ea0-0ecf879e644a could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:17:23.622130 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2b97d7df-a8da-4d30-acb4-0420279e69b7 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] 10.222.0.13 "GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a" status: 404 len: 111 microversion: 2.1 time: 0.031927 Oct 30 02:17:23.622130 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3390/7116] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:17:23 2022] GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 02:17:23.635422 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-21dcd2fe-1eb1-4d5d-a8db-8363290e51bd tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:17:23.635956 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-21dcd2fe-1eb1-4d5d-a8db-8363290e51bd tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] [instance: a507bdfd-c799-4fab-8ea0-0ecf879e644a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:17:23.642697 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-21dcd2fe-1eb1-4d5d-a8db-8363290e51bd tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:23.643189 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-21dcd2fe-1eb1-4d5d-a8db-8363290e51bd tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:23.643633 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-21dcd2fe-1eb1-4d5d-a8db-8363290e51bd tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:23.644330 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-21dcd2fe-1eb1-4d5d-a8db-8363290e51bd tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:23.644794 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-21dcd2fe-1eb1-4d5d-a8db-8363290e51bd tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:23.645227 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-21dcd2fe-1eb1-4d5d-a8db-8363290e51bd tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:23.658650 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-21dcd2fe-1eb1-4d5d-a8db-8363290e51bd tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] HTTP exception thrown: Instance a507bdfd-c799-4fab-8ea0-0ecf879e644a could not be found. Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-21dcd2fe-1eb1-4d5d-a8db-8363290e51bd tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Request method failure captured: Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a HTTP/1.1 Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXd51-4i8J3IXJM476hIY5BuHcdNcKp77p6Mb7SvTXbVlt4Ug5DT2nAwFxvPKEITjDZRgs8uOMH-_xXBrNDsHXw1bvJTVjItetvbyM97HDEvZxJAH0yN8ZdsaTrOMyUEWlRiLBaKfFe2LqyDte1Rz_ooKQH7BLfFEl-lxX3aKW4JoNfc Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 52cb154d20324ed9815f877d58472dc3 Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-DeleteServersTestJSON-1426900780 Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/52cb154d20324ed9815f877d58472dc3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_52cb154d20324ed9815f877d58472dc3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/52cb154d20324ed9815f877d58472dc3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/52cb154d20324ed9815f877d58472dc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-DeleteServersTestJSON-1426900780 Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 52cb154d20324ed9815f877d58472dc3 Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-DeleteServersTestJSON-1426900780 Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-DeleteServersTestJSON-1426900780-project Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 9885dc064e3c46f6a7f9c19659ae96b3 Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-DeleteServersTestJSON-1426900780-project Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: exception: Instance a507bdfd-c799-4fab-8ea0-0ecf879e644a could not be found. Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'a507bdfd-c799-4fab-8ea0-0ecf879e644a'} Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a507bdfd-c799-4fab-8ea0-0ecf879e644a could not be found. Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 02:17:23.660290 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 02:17:23.665293 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a507bdfd-c799-4fab-8ea0-0ecf879e644a could not be found. Oct 30 02:17:23.665293 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:17:23.665293 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:17:23.665293 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:17:23.665293 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:17:23.665293 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:17:23.665293 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:17:23.665293 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:17:23.665293 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:17:23.665293 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a507bdfd-c799-4fab-8ea0-0ecf879e644a could not be found. Oct 30 02:17:23.665293 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:17:23.665293 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-21dcd2fe-1eb1-4d5d-a8db-8363290e51bd tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Returning 404 to user: Instance a507bdfd-c799-4fab-8ea0-0ecf879e644a could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:17:23.665293 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-21dcd2fe-1eb1-4d5d-a8db-8363290e51bd tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a" status: 404 len: 111 microversion: 2.1 time: 0.030253 Oct 30 02:17:23.665293 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3727/7117] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 02:17:23 2022] DELETE /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 02:17:23.670926 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0b0f03e0-67b5-4e72-8470-1fe68e1926b9 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:17:23.671578 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0b0f03e0-67b5-4e72-8470-1fe68e1926b9 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] [instance: a507bdfd-c799-4fab-8ea0-0ecf879e644a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:17:23.677548 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b0f03e0-67b5-4e72-8470-1fe68e1926b9 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:23.678032 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b0f03e0-67b5-4e72-8470-1fe68e1926b9 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:23.678471 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b0f03e0-67b5-4e72-8470-1fe68e1926b9 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:23.679179 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b0f03e0-67b5-4e72-8470-1fe68e1926b9 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:23.679632 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b0f03e0-67b5-4e72-8470-1fe68e1926b9 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:23.680058 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b0f03e0-67b5-4e72-8470-1fe68e1926b9 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:23.696789 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-0b0f03e0-67b5-4e72-8470-1fe68e1926b9 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] HTTP exception thrown: Instance a507bdfd-c799-4fab-8ea0-0ecf879e644a could not be found. Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0b0f03e0-67b5-4e72-8470-1fe68e1926b9 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Request method failure captured: Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a HTTP/1.1 Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXd51-4i8J3IXJM476hIY5BuHcdNcKp77p6Mb7SvTXbVlt4Ug5DT2nAwFxvPKEITjDZRgs8uOMH-_xXBrNDsHXw1bvJTVjItetvbyM97HDEvZxJAH0yN8ZdsaTrOMyUEWlRiLBaKfFe2LqyDte1Rz_ooKQH7BLfFEl-lxX3aKW4JoNfc Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 52cb154d20324ed9815f877d58472dc3 Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-DeleteServersTestJSON-1426900780 Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/52cb154d20324ed9815f877d58472dc3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_52cb154d20324ed9815f877d58472dc3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/52cb154d20324ed9815f877d58472dc3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/52cb154d20324ed9815f877d58472dc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-DeleteServersTestJSON-1426900780 Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 52cb154d20324ed9815f877d58472dc3 Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-DeleteServersTestJSON-1426900780 Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-DeleteServersTestJSON-1426900780-project Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 9885dc064e3c46f6a7f9c19659ae96b3 Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-DeleteServersTestJSON-1426900780-project Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: exception: Instance a507bdfd-c799-4fab-8ea0-0ecf879e644a could not be found. Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'a507bdfd-c799-4fab-8ea0-0ecf879e644a'} Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a507bdfd-c799-4fab-8ea0-0ecf879e644a could not be found. Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a507bdfd-c799-4fab-8ea0-0ecf879e644a could not be found. Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:17:23.698335 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:17:23.703289 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:17:23.703289 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:17:23.703289 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:17:23.703289 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:17:23.703289 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:17:23.703289 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a507bdfd-c799-4fab-8ea0-0ecf879e644a could not be found. Oct 30 02:17:23.703289 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:17:23.703289 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0b0f03e0-67b5-4e72-8470-1fe68e1926b9 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] Returning 404 to user: Instance a507bdfd-c799-4fab-8ea0-0ecf879e644a could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:17:23.703289 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0b0f03e0-67b5-4e72-8470-1fe68e1926b9 tempest-DeleteServersTestJSON-1426900780 tempest-DeleteServersTestJSON-1426900780-project] 10.222.0.13 "GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a" status: 404 len: 111 microversion: 2.1 time: 0.033462 Oct 30 02:17:23.703289 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3391/7118] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:17:23 2022] GET /compute/v2.1/servers/a507bdfd-c799-4fab-8ea0-0ecf879e644a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 02:17:34.004281 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:17:34.005062 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:17:34.124160 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-08a7d289-bcfb-4285-bbbb-7ada45834802 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1804155597", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "d8dfcb3d-f006-47d5-8a24-efcb99fa7d86"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:17:34.182460 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-08a7d289-bcfb-4285-bbbb-7ada45834802 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] validate_networks() for [('d8dfcb3d-f006-47d5-8a24-efcb99fa7d86', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 02:17:34.554697 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-08a7d289-bcfb-4285-bbbb-7ada45834802 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 02:17:34.555147 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-08a7d289-bcfb-4285-bbbb-7ada45834802 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 02:17:34.555635 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-08a7d289-bcfb-4285-bbbb-7ada45834802 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 02:17:34.556064 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-08a7d289-bcfb-4285-bbbb-7ada45834802 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 02:17:34.556495 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-08a7d289-bcfb-4285-bbbb-7ada45834802 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 02:17:34.566041 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08a7d289-bcfb-4285-bbbb-7ada45834802 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:34.566569 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08a7d289-bcfb-4285-bbbb-7ada45834802 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:34.567019 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08a7d289-bcfb-4285-bbbb-7ada45834802 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:34.567791 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08a7d289-bcfb-4285-bbbb-7ada45834802 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:34.568258 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08a7d289-bcfb-4285-bbbb-7ada45834802 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:34.568699 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08a7d289-bcfb-4285-bbbb-7ada45834802 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:34.586803 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-08a7d289-bcfb-4285-bbbb-7ada45834802 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Getting quotas for project 5c755ba9d0c1434c9e73634c2cc4a80a. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 02:17:34.592923 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-08a7d289-bcfb-4285-bbbb-7ada45834802 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Getting quotas for user 65b8f0f9740b44d59ca2617609cac5ab and project 5c755ba9d0c1434c9e73634c2cc4a80a. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 02:17:34.605648 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-08a7d289-bcfb-4285-bbbb-7ada45834802 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 02:17:34.607994 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-08a7d289-bcfb-4285-bbbb-7ada45834802 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 02:17:34.699813 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-08a7d289-bcfb-4285-bbbb-7ada45834802 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.701220 Oct 30 02:17:34.700554 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3728/7119] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 02:17:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 02:17:34.713709 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6a1d89a4-c497-4515-a448-a8f92f217ab7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:17:34.715074 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6a1d89a4-c497-4515-a448-a8f92f217ab7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:17:34.717948 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=13 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:17:34.718601 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=49 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:17:34.778064 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6a1d89a4-c497-4515-a448-a8f92f217ab7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:17:34.788093 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6a1d89a4-c497-4515-a448-a8f92f217ab7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1" status: 200 len: 1218 microversion: 2.1 time: 0.080133 Oct 30 02:17:34.788675 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3392/7120] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:17:34 2022] GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:17:35.811877 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4e2e87c0-947f-4cb8-a548-dee7eb1b70b0 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:17:35.813602 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4e2e87c0-947f-4cb8-a548-dee7eb1b70b0 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:17:35.820094 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4e2e87c0-947f-4cb8-a548-dee7eb1b70b0 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:35.820655 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4e2e87c0-947f-4cb8-a548-dee7eb1b70b0 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:35.821096 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4e2e87c0-947f-4cb8-a548-dee7eb1b70b0 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:35.821831 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4e2e87c0-947f-4cb8-a548-dee7eb1b70b0 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:35.822786 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4e2e87c0-947f-4cb8-a548-dee7eb1b70b0 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:35.823225 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4e2e87c0-947f-4cb8-a548-dee7eb1b70b0 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:35.897392 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4e2e87c0-947f-4cb8-a548-dee7eb1b70b0 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:17:35.905808 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4e2e87c0-947f-4cb8-a548-dee7eb1b70b0 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1" status: 200 len: 1222 microversion: 2.1 time: 0.099159 Oct 30 02:17:35.906406 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3729/7121] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:17:35 2022] GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 => generated 1222 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:17:36.928439 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a4770794-f9ed-4074-bc1d-b9fc7a5c7968 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:17:36.929241 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a4770794-f9ed-4074-bc1d-b9fc7a5c7968 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:17:36.940038 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a4770794-f9ed-4074-bc1d-b9fc7a5c7968 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:36.940687 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a4770794-f9ed-4074-bc1d-b9fc7a5c7968 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:36.941249 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a4770794-f9ed-4074-bc1d-b9fc7a5c7968 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:36.942163 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a4770794-f9ed-4074-bc1d-b9fc7a5c7968 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:36.942723 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a4770794-f9ed-4074-bc1d-b9fc7a5c7968 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:36.943253 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a4770794-f9ed-4074-bc1d-b9fc7a5c7968 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:37.053451 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a4770794-f9ed-4074-bc1d-b9fc7a5c7968 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:17:37.065166 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a4770794-f9ed-4074-bc1d-b9fc7a5c7968 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1" status: 200 len: 1278 microversion: 2.1 time: 0.140627 Oct 30 02:17:37.066316 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3393/7122] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:17:36 2022] GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 => generated 1278 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:17:38.088482 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e498978b-7f19-41d3-b3f2-968015d46654 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:17:38.089366 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e498978b-7f19-41d3-b3f2-968015d46654 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:17:38.096752 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e498978b-7f19-41d3-b3f2-968015d46654 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:38.097446 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e498978b-7f19-41d3-b3f2-968015d46654 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:38.097903 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e498978b-7f19-41d3-b3f2-968015d46654 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:38.098657 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e498978b-7f19-41d3-b3f2-968015d46654 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:38.099129 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e498978b-7f19-41d3-b3f2-968015d46654 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:38.099571 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e498978b-7f19-41d3-b3f2-968015d46654 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:38.240425 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e498978b-7f19-41d3-b3f2-968015d46654 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:17:38.249650 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e498978b-7f19-41d3-b3f2-968015d46654 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1" status: 200 len: 1318 microversion: 2.1 time: 0.165342 Oct 30 02:17:38.250323 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3730/7123] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:17:38 2022] GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:17:38.753812 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-3ae4dd1c-7a2d-4b4c-88fb-e4a89499fef1 req-bceebb34-9f90-4b1d-a57a-f0006216571b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d6c217b-d03f-4ae7-ae1b-db354ea22ca1", "tag": "6e9d14a4-2b80-4bc8-a5db-d99ad982e852"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:17:38.764096 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-3ae4dd1c-7a2d-4b4c-88fb-e4a89499fef1 req-bceebb34-9f90-4b1d-a57a-f0006216571b service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:38.764574 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-3ae4dd1c-7a2d-4b4c-88fb-e4a89499fef1 req-bceebb34-9f90-4b1d-a57a-f0006216571b service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:38.765000 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-3ae4dd1c-7a2d-4b4c-88fb-e4a89499fef1 req-bceebb34-9f90-4b1d-a57a-f0006216571b service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:38.776447 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-3ae4dd1c-7a2d-4b4c-88fb-e4a89499fef1 req-bceebb34-9f90-4b1d-a57a-f0006216571b service nova] Creating event network-changed:6e9d14a4-2b80-4bc8-a5db-d99ad982e852 for instance 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 on n-h2-master-1 Oct 30 02:17:38.781431 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-3ae4dd1c-7a2d-4b4c-88fb-e4a89499fef1 req-bceebb34-9f90-4b1d-a57a-f0006216571b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037656 Oct 30 02:17:38.782025 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3394/7124] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:17:39.275083 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-86a3140e-99b7-4903-bc87-be1f3c040ef7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:17:39.275851 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-86a3140e-99b7-4903-bc87-be1f3c040ef7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:17:39.283356 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86a3140e-99b7-4903-bc87-be1f3c040ef7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:39.284123 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86a3140e-99b7-4903-bc87-be1f3c040ef7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:39.284668 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86a3140e-99b7-4903-bc87-be1f3c040ef7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:39.285614 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86a3140e-99b7-4903-bc87-be1f3c040ef7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:39.286088 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86a3140e-99b7-4903-bc87-be1f3c040ef7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:39.286545 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86a3140e-99b7-4903-bc87-be1f3c040ef7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:39.426289 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-86a3140e-99b7-4903-bc87-be1f3c040ef7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:17:39.434989 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-86a3140e-99b7-4903-bc87-be1f3c040ef7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1" status: 200 len: 1318 microversion: 2.1 time: 0.164068 Oct 30 02:17:39.435582 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3731/7125] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:17:39 2022] GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:17:40.459673 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c2f2cd49-9d45-495f-925f-c462faa2b26e tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:17:40.460377 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c2f2cd49-9d45-495f-925f-c462faa2b26e tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:17:40.467236 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c2f2cd49-9d45-495f-925f-c462faa2b26e tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:40.467724 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c2f2cd49-9d45-495f-925f-c462faa2b26e tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:40.468160 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c2f2cd49-9d45-495f-925f-c462faa2b26e tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:40.468855 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c2f2cd49-9d45-495f-925f-c462faa2b26e tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:40.469313 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c2f2cd49-9d45-495f-925f-c462faa2b26e tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:40.469768 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c2f2cd49-9d45-495f-925f-c462faa2b26e tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:40.597598 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c2f2cd49-9d45-495f-925f-c462faa2b26e tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:17:40.605316 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c2f2cd49-9d45-495f-925f-c462faa2b26e tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1" status: 200 len: 1318 microversion: 2.1 time: 0.150742 Oct 30 02:17:40.605917 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3395/7126] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:17:40 2022] GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:17:41.627745 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ac17c7d9-5611-41b2-9bd8-1b99977dac9e tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:17:41.628366 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ac17c7d9-5611-41b2-9bd8-1b99977dac9e tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:17:41.634998 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ac17c7d9-5611-41b2-9bd8-1b99977dac9e tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:41.635488 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ac17c7d9-5611-41b2-9bd8-1b99977dac9e tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:41.635936 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ac17c7d9-5611-41b2-9bd8-1b99977dac9e tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:41.636660 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ac17c7d9-5611-41b2-9bd8-1b99977dac9e tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:41.637120 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ac17c7d9-5611-41b2-9bd8-1b99977dac9e tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:41.637582 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ac17c7d9-5611-41b2-9bd8-1b99977dac9e tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:41.815230 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ac17c7d9-5611-41b2-9bd8-1b99977dac9e tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:17:41.823381 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ac17c7d9-5611-41b2-9bd8-1b99977dac9e tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1" status: 200 len: 1318 microversion: 2.1 time: 0.199542 Oct 30 02:17:41.823983 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3732/7127] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:17:41 2022] GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:17:42.846572 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-12d537ac-33b5-4ece-a93c-4ad329d1ac86 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:17:42.847193 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-12d537ac-33b5-4ece-a93c-4ad329d1ac86 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:17:42.854539 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-12d537ac-33b5-4ece-a93c-4ad329d1ac86 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:42.855028 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-12d537ac-33b5-4ece-a93c-4ad329d1ac86 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:42.855466 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-12d537ac-33b5-4ece-a93c-4ad329d1ac86 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:42.856222 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-12d537ac-33b5-4ece-a93c-4ad329d1ac86 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:42.856738 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-12d537ac-33b5-4ece-a93c-4ad329d1ac86 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:42.857164 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-12d537ac-33b5-4ece-a93c-4ad329d1ac86 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:42.991958 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-12d537ac-33b5-4ece-a93c-4ad329d1ac86 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:17:43.000492 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-12d537ac-33b5-4ece-a93c-4ad329d1ac86 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1" status: 200 len: 1318 microversion: 2.1 time: 0.157871 Oct 30 02:17:43.001069 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3396/7128] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:17:42 2022] GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:17:44.022963 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f2a47e79-01a4-4612-aa28-0ab7e0652405 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:17:44.023587 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f2a47e79-01a4-4612-aa28-0ab7e0652405 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:17:44.030406 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f2a47e79-01a4-4612-aa28-0ab7e0652405 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:44.030901 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f2a47e79-01a4-4612-aa28-0ab7e0652405 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:44.031347 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f2a47e79-01a4-4612-aa28-0ab7e0652405 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:44.032046 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f2a47e79-01a4-4612-aa28-0ab7e0652405 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:44.032510 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f2a47e79-01a4-4612-aa28-0ab7e0652405 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:44.032944 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f2a47e79-01a4-4612-aa28-0ab7e0652405 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:44.166336 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f2a47e79-01a4-4612-aa28-0ab7e0652405 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:17:44.171417 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f2a47e79-01a4-4612-aa28-0ab7e0652405 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1" status: 200 len: 1318 microversion: 2.1 time: 0.152406 Oct 30 02:17:44.172001 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3733/7129] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:17:44 2022] GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:17:44.580215 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-f43c8ab2-a40a-4f7b-a3e7-867fe23497dd req-9aed91bd-661a-4352-b052-6b09552e330e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d6c217b-d03f-4ae7-ae1b-db354ea22ca1", "name": "network-vif-plugged", "status": "completed", "tag": "6e9d14a4-2b80-4bc8-a5db-d99ad982e852"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:17:44.586400 n-d-master-1 devstack@n-api.service[121103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 30 02:17:44.586539 n-d-master-1 devstack@n-api.service[121103]: Sun Oct 30 02:17:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.13) !!! Oct 30 02:17:44.588295 n-d-master-1 devstack@n-api.service[121103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 30 02:17:44.588414 n-d-master-1 devstack@n-api.service[121103]: Sun Oct 30 02:17:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.13) !!! Oct 30 02:17:44.598522 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-f43c8ab2-a40a-4f7b-a3e7-867fe23497dd req-9aed91bd-661a-4352-b052-6b09552e330e service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:44.599005 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-f43c8ab2-a40a-4f7b-a3e7-867fe23497dd req-9aed91bd-661a-4352-b052-6b09552e330e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:44.599436 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-f43c8ab2-a40a-4f7b-a3e7-867fe23497dd req-9aed91bd-661a-4352-b052-6b09552e330e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:44.610873 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-f43c8ab2-a40a-4f7b-a3e7-867fe23497dd req-9aed91bd-661a-4352-b052-6b09552e330e service nova] Creating event network-vif-plugged:6e9d14a4-2b80-4bc8-a5db-d99ad982e852 for instance 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 on n-h2-master-1 Oct 30 02:17:44.615706 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-f43c8ab2-a40a-4f7b-a3e7-867fe23497dd req-9aed91bd-661a-4352-b052-6b09552e330e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039602 Oct 30 02:17:44.616299 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3397/7130] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:17:45.195215 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-45323408-7594-40d6-aeb6-8ca1152e9f70 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:17:45.195840 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-45323408-7594-40d6-aeb6-8ca1152e9f70 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:17:45.197800 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:17:45.198477 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=6 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:17:45.204087 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-45323408-7594-40d6-aeb6-8ca1152e9f70 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:45.204577 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-45323408-7594-40d6-aeb6-8ca1152e9f70 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:45.205023 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-45323408-7594-40d6-aeb6-8ca1152e9f70 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:45.205758 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-45323408-7594-40d6-aeb6-8ca1152e9f70 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:45.206217 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-45323408-7594-40d6-aeb6-8ca1152e9f70 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:45.206647 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-45323408-7594-40d6-aeb6-8ca1152e9f70 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:45.353875 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-45323408-7594-40d6-aeb6-8ca1152e9f70 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:17:45.361502 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-45323408-7594-40d6-aeb6-8ca1152e9f70 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1" status: 200 len: 1318 microversion: 2.1 time: 0.170226 Oct 30 02:17:45.362086 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3734/7131] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:17:45 2022] GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:17:46.381302 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:17:46.386809 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-702e2349-e466-45cc-8df1-535d58d97261 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:17:46.387506 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-702e2349-e466-45cc-8df1-535d58d97261 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:17:46.393660 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-702e2349-e466-45cc-8df1-535d58d97261 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:46.394141 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-702e2349-e466-45cc-8df1-535d58d97261 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:46.394576 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-702e2349-e466-45cc-8df1-535d58d97261 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:46.395263 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-702e2349-e466-45cc-8df1-535d58d97261 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:46.395714 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-702e2349-e466-45cc-8df1-535d58d97261 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:46.396132 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-702e2349-e466-45cc-8df1-535d58d97261 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:46.539763 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-702e2349-e466-45cc-8df1-535d58d97261 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:17:46.548506 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-702e2349-e466-45cc-8df1-535d58d97261 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1" status: 200 len: 1506 microversion: 2.1 time: 0.168169 Oct 30 02:17:46.549026 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3398/7132] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:17:46 2022] GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 => generated 1506 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:17:46.571382 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b765cc6f-8e06-4534-aaa9-4c6246362420 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:17:46.572036 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b765cc6f-8e06-4534-aaa9-4c6246362420 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:17:46.578965 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b765cc6f-8e06-4534-aaa9-4c6246362420 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:46.579448 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b765cc6f-8e06-4534-aaa9-4c6246362420 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:46.579959 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b765cc6f-8e06-4534-aaa9-4c6246362420 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:46.580655 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b765cc6f-8e06-4534-aaa9-4c6246362420 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:46.581117 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b765cc6f-8e06-4534-aaa9-4c6246362420 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:46.581578 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b765cc6f-8e06-4534-aaa9-4c6246362420 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:46.711623 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b765cc6f-8e06-4534-aaa9-4c6246362420 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:17:46.719813 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b765cc6f-8e06-4534-aaa9-4c6246362420 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1" status: 200 len: 1506 microversion: 2.1 time: 0.152311 Oct 30 02:17:46.720392 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3735/7133] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:17:46 2022] GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:17:46.742484 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-df863278-0dc3-4033-bde5-e3985ece50b2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:17:46.744940 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-df863278-0dc3-4033-bde5-e3985ece50b2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:17:46.751021 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df863278-0dc3-4033-bde5-e3985ece50b2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:46.751511 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df863278-0dc3-4033-bde5-e3985ece50b2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:46.751955 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df863278-0dc3-4033-bde5-e3985ece50b2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:46.752655 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df863278-0dc3-4033-bde5-e3985ece50b2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:46.753115 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df863278-0dc3-4033-bde5-e3985ece50b2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:46.753576 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df863278-0dc3-4033-bde5-e3985ece50b2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:46.889499 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-df863278-0dc3-4033-bde5-e3985ece50b2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "PUT /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1" status: 200 len: 1078 microversion: 2.1 time: 0.150988 Oct 30 02:17:46.894308 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3399/7134] 10.222.0.13 () {60 vars in 1256 bytes} [Sun Oct 30 02:17:46 2022] PUT /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 => generated 1078 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:17:46.909038 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-902a6186-5ef7-4d65-8c93-6ff97be96545 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:17:46.909715 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-902a6186-5ef7-4d65-8c93-6ff97be96545 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:17:46.916477 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-902a6186-5ef7-4d65-8c93-6ff97be96545 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:46.917000 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-902a6186-5ef7-4d65-8c93-6ff97be96545 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:46.917494 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-902a6186-5ef7-4d65-8c93-6ff97be96545 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:46.918201 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-902a6186-5ef7-4d65-8c93-6ff97be96545 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:46.918669 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-902a6186-5ef7-4d65-8c93-6ff97be96545 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:46.919106 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-902a6186-5ef7-4d65-8c93-6ff97be96545 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:47.047270 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-902a6186-5ef7-4d65-8c93-6ff97be96545 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:17:47.055105 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-902a6186-5ef7-4d65-8c93-6ff97be96545 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1" status: 200 len: 1504 microversion: 2.1 time: 0.150189 Oct 30 02:17:47.055680 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3736/7135] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:17:46 2022] GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:17:47.077771 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e77a9b00-5263-4505-9539-80bfaab7064a tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:17:47.078423 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e77a9b00-5263-4505-9539-80bfaab7064a tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:17:47.084499 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e77a9b00-5263-4505-9539-80bfaab7064a tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:47.084991 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e77a9b00-5263-4505-9539-80bfaab7064a tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:47.085468 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e77a9b00-5263-4505-9539-80bfaab7064a tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:47.086171 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e77a9b00-5263-4505-9539-80bfaab7064a tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:47.086630 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e77a9b00-5263-4505-9539-80bfaab7064a tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:47.087061 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e77a9b00-5263-4505-9539-80bfaab7064a tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:47.215742 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e77a9b00-5263-4505-9539-80bfaab7064a tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:17:47.223652 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e77a9b00-5263-4505-9539-80bfaab7064a tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1" status: 200 len: 1504 microversion: 2.1 time: 0.149842 Oct 30 02:17:47.224232 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3400/7136] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:17:47 2022] GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:17:47.245878 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-06d12357-1b0b-4236-90d6-559b553a3cf2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:17:47.248372 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-06d12357-1b0b-4236-90d6-559b553a3cf2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:17:47.254392 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-06d12357-1b0b-4236-90d6-559b553a3cf2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:47.254892 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-06d12357-1b0b-4236-90d6-559b553a3cf2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:47.255344 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-06d12357-1b0b-4236-90d6-559b553a3cf2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:47.256047 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-06d12357-1b0b-4236-90d6-559b553a3cf2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:47.256520 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-06d12357-1b0b-4236-90d6-559b553a3cf2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:47.256960 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-06d12357-1b0b-4236-90d6-559b553a3cf2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:47.288313 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-06d12357-1b0b-4236-90d6-559b553a3cf2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:17:47.294009 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-06d12357-1b0b-4236-90d6-559b553a3cf2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Old instance type m1.heat2, new instance type m1.heat {{(pid=121102) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 30 02:17:47.300514 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-06d12357-1b0b-4236-90d6-559b553a3cf2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 02:17:47.300948 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-06d12357-1b0b-4236-90d6-559b553a3cf2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 02:17:47.301470 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-06d12357-1b0b-4236-90d6-559b553a3cf2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 02:17:47.301891 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-06d12357-1b0b-4236-90d6-559b553a3cf2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 02:17:47.302316 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-06d12357-1b0b-4236-90d6-559b553a3cf2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 02:17:47.472338 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-06d12357-1b0b-4236-90d6-559b553a3cf2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "POST /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1/action" status: 202 len: 0 microversion: 2.1 time: 0.230263 Oct 30 02:17:47.472798 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3737/7137] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 02:17:47 2022] POST /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 02:17:47.481137 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d062c5ff-246a-4380-9aca-3a0beb4aa0fe tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:17:47.481785 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d062c5ff-246a-4380-9aca-3a0beb4aa0fe tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:17:47.489038 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d062c5ff-246a-4380-9aca-3a0beb4aa0fe tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:47.489621 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d062c5ff-246a-4380-9aca-3a0beb4aa0fe tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:47.490061 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d062c5ff-246a-4380-9aca-3a0beb4aa0fe tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:47.490765 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d062c5ff-246a-4380-9aca-3a0beb4aa0fe tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:47.491215 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d062c5ff-246a-4380-9aca-3a0beb4aa0fe tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:47.491646 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d062c5ff-246a-4380-9aca-3a0beb4aa0fe tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:47.636234 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d062c5ff-246a-4380-9aca-3a0beb4aa0fe tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:17:47.644089 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d062c5ff-246a-4380-9aca-3a0beb4aa0fe tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1" status: 200 len: 1515 microversion: 2.1 time: 0.166988 Oct 30 02:17:47.644668 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3401/7138] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:17:47 2022] GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:17:48.668547 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-817a4ea7-1970-4f32-9bf1-f39ad138e7f9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:17:48.669185 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-817a4ea7-1970-4f32-9bf1-f39ad138e7f9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:17:48.676204 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-817a4ea7-1970-4f32-9bf1-f39ad138e7f9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:48.676702 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-817a4ea7-1970-4f32-9bf1-f39ad138e7f9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:48.677202 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-817a4ea7-1970-4f32-9bf1-f39ad138e7f9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:48.677939 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-817a4ea7-1970-4f32-9bf1-f39ad138e7f9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:48.678406 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-817a4ea7-1970-4f32-9bf1-f39ad138e7f9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:48.678845 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-817a4ea7-1970-4f32-9bf1-f39ad138e7f9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:48.818073 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-817a4ea7-1970-4f32-9bf1-f39ad138e7f9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:17:48.824651 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-817a4ea7-1970-4f32-9bf1-f39ad138e7f9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1" status: 200 len: 1515 microversion: 2.1 time: 0.161476 Oct 30 02:17:48.825228 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3738/7139] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:17:48 2022] GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:17:49.847566 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5ecdae45-a060-4179-adc4-a1a92f1acadf tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:17:49.848200 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5ecdae45-a060-4179-adc4-a1a92f1acadf tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:17:49.855229 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ecdae45-a060-4179-adc4-a1a92f1acadf tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:49.855722 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ecdae45-a060-4179-adc4-a1a92f1acadf tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:49.856169 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ecdae45-a060-4179-adc4-a1a92f1acadf tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:49.856873 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ecdae45-a060-4179-adc4-a1a92f1acadf tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:49.857346 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ecdae45-a060-4179-adc4-a1a92f1acadf tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:49.858172 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5ecdae45-a060-4179-adc4-a1a92f1acadf tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:50.067226 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5ecdae45-a060-4179-adc4-a1a92f1acadf tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:17:50.076061 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5ecdae45-a060-4179-adc4-a1a92f1acadf tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1" status: 200 len: 1515 microversion: 2.1 time: 0.232233 Oct 30 02:17:50.076378 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3402/7140] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:17:49 2022] GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 => generated 1515 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:17:51.098348 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-96640ddd-9f86-48b6-b33c-c3a223ce9538 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:17:51.099257 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-96640ddd-9f86-48b6-b33c-c3a223ce9538 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:17:51.106853 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96640ddd-9f86-48b6-b33c-c3a223ce9538 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:51.107342 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96640ddd-9f86-48b6-b33c-c3a223ce9538 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:51.107955 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96640ddd-9f86-48b6-b33c-c3a223ce9538 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:51.108825 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96640ddd-9f86-48b6-b33c-c3a223ce9538 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:51.109359 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96640ddd-9f86-48b6-b33c-c3a223ce9538 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:51.110083 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96640ddd-9f86-48b6-b33c-c3a223ce9538 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:51.243535 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-96640ddd-9f86-48b6-b33c-c3a223ce9538 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:17:51.251227 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-96640ddd-9f86-48b6-b33c-c3a223ce9538 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1" status: 200 len: 1520 microversion: 2.1 time: 0.156785 Oct 30 02:17:51.251834 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3739/7141] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:17:51 2022] GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:17:52.274725 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-225d1f01-d804-4186-9dff-c53bc3f08170 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:17:52.275879 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-225d1f01-d804-4186-9dff-c53bc3f08170 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:17:52.282669 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-225d1f01-d804-4186-9dff-c53bc3f08170 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:52.283147 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-225d1f01-d804-4186-9dff-c53bc3f08170 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:52.283578 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-225d1f01-d804-4186-9dff-c53bc3f08170 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:52.284264 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-225d1f01-d804-4186-9dff-c53bc3f08170 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:52.284715 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-225d1f01-d804-4186-9dff-c53bc3f08170 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:52.285139 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-225d1f01-d804-4186-9dff-c53bc3f08170 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:52.419260 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-225d1f01-d804-4186-9dff-c53bc3f08170 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:17:52.427241 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-225d1f01-d804-4186-9dff-c53bc3f08170 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1" status: 200 len: 1520 microversion: 2.1 time: 0.156471 Oct 30 02:17:52.427823 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3403/7142] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:17:52 2022] GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:17:53.449752 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4cf8ccaf-9e83-409a-a248-6ef3795a9100 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:17:53.450371 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4cf8ccaf-9e83-409a-a248-6ef3795a9100 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:17:53.457176 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4cf8ccaf-9e83-409a-a248-6ef3795a9100 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:53.457634 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4cf8ccaf-9e83-409a-a248-6ef3795a9100 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:53.458079 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4cf8ccaf-9e83-409a-a248-6ef3795a9100 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:53.458775 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4cf8ccaf-9e83-409a-a248-6ef3795a9100 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:53.459235 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4cf8ccaf-9e83-409a-a248-6ef3795a9100 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:53.459670 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4cf8ccaf-9e83-409a-a248-6ef3795a9100 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:53.586467 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4cf8ccaf-9e83-409a-a248-6ef3795a9100 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:17:53.594649 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4cf8ccaf-9e83-409a-a248-6ef3795a9100 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1" status: 200 len: 1520 microversion: 2.1 time: 0.148796 Oct 30 02:17:53.595211 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3740/7143] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:17:53 2022] GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:17:54.617462 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4e015638-9645-42a4-9e7f-cf0273fe28bc tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:17:54.618006 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4e015638-9645-42a4-9e7f-cf0273fe28bc tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:17:54.624959 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4e015638-9645-42a4-9e7f-cf0273fe28bc tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:54.625488 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4e015638-9645-42a4-9e7f-cf0273fe28bc tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:54.625942 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4e015638-9645-42a4-9e7f-cf0273fe28bc tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:54.626647 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4e015638-9645-42a4-9e7f-cf0273fe28bc tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:54.627107 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4e015638-9645-42a4-9e7f-cf0273fe28bc tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:54.627539 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4e015638-9645-42a4-9e7f-cf0273fe28bc tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:54.755119 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4e015638-9645-42a4-9e7f-cf0273fe28bc tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:17:54.763658 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4e015638-9645-42a4-9e7f-cf0273fe28bc tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1" status: 200 len: 1520 microversion: 2.1 time: 0.150260 Oct 30 02:17:54.764244 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3404/7144] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:17:54 2022] GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:17:55.787337 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bd708b19-0d53-42cc-a4c6-112a797f8f68 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:17:55.787956 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bd708b19-0d53-42cc-a4c6-112a797f8f68 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:17:55.795483 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bd708b19-0d53-42cc-a4c6-112a797f8f68 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:55.795973 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bd708b19-0d53-42cc-a4c6-112a797f8f68 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:55.796419 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bd708b19-0d53-42cc-a4c6-112a797f8f68 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:55.797110 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bd708b19-0d53-42cc-a4c6-112a797f8f68 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:55.797605 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bd708b19-0d53-42cc-a4c6-112a797f8f68 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:55.798040 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bd708b19-0d53-42cc-a4c6-112a797f8f68 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:55.930202 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bd708b19-0d53-42cc-a4c6-112a797f8f68 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:17:55.938333 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bd708b19-0d53-42cc-a4c6-112a797f8f68 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1" status: 200 len: 1520 microversion: 2.1 time: 0.154969 Oct 30 02:17:55.938907 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3741/7145] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:17:55 2022] GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:17:56.961640 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-719a62e2-3f9d-436f-a8cc-b5923b8dfee1 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:17:56.962268 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-719a62e2-3f9d-436f-a8cc-b5923b8dfee1 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:17:56.969826 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-719a62e2-3f9d-436f-a8cc-b5923b8dfee1 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:56.970309 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-719a62e2-3f9d-436f-a8cc-b5923b8dfee1 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:56.970746 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-719a62e2-3f9d-436f-a8cc-b5923b8dfee1 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:56.971444 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-719a62e2-3f9d-436f-a8cc-b5923b8dfee1 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:56.971899 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-719a62e2-3f9d-436f-a8cc-b5923b8dfee1 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:56.972332 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-719a62e2-3f9d-436f-a8cc-b5923b8dfee1 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:57.104167 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-719a62e2-3f9d-436f-a8cc-b5923b8dfee1 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:17:57.112004 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-719a62e2-3f9d-436f-a8cc-b5923b8dfee1 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1" status: 200 len: 1520 microversion: 2.1 time: 0.154315 Oct 30 02:17:57.112591 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3405/7146] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:17:56 2022] GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:17:58.136070 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-380ef599-7393-47dd-982a-7d64191e25fb tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:17:58.136703 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-380ef599-7393-47dd-982a-7d64191e25fb tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:17:58.143661 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-380ef599-7393-47dd-982a-7d64191e25fb tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:58.144150 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-380ef599-7393-47dd-982a-7d64191e25fb tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:58.144606 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-380ef599-7393-47dd-982a-7d64191e25fb tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:58.145314 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-380ef599-7393-47dd-982a-7d64191e25fb tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:58.145855 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-380ef599-7393-47dd-982a-7d64191e25fb tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:58.146242 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-380ef599-7393-47dd-982a-7d64191e25fb tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:58.277584 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-380ef599-7393-47dd-982a-7d64191e25fb tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:17:58.285461 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-380ef599-7393-47dd-982a-7d64191e25fb tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1" status: 200 len: 1520 microversion: 2.1 time: 0.153837 Oct 30 02:17:58.286035 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3742/7147] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:17:58 2022] GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:17:59.308143 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2f6869bc-e445-47ed-9122-6bce7663c4c0 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:17:59.308833 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2f6869bc-e445-47ed-9122-6bce7663c4c0 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:17:59.316041 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f6869bc-e445-47ed-9122-6bce7663c4c0 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:59.316521 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f6869bc-e445-47ed-9122-6bce7663c4c0 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:59.317017 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f6869bc-e445-47ed-9122-6bce7663c4c0 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:59.317733 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f6869bc-e445-47ed-9122-6bce7663c4c0 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:17:59.318187 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f6869bc-e445-47ed-9122-6bce7663c4c0 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:17:59.318606 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f6869bc-e445-47ed-9122-6bce7663c4c0 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:17:59.451078 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2f6869bc-e445-47ed-9122-6bce7663c4c0 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:17:59.458833 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2f6869bc-e445-47ed-9122-6bce7663c4c0 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1" status: 200 len: 1520 microversion: 2.1 time: 0.154669 Oct 30 02:17:59.459409 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3406/7148] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:17:59 2022] GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:18:00.481689 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fa975c08-f1ea-48f6-8dac-ed72f9c337f9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:18:00.482300 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fa975c08-f1ea-48f6-8dac-ed72f9c337f9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:18:00.489072 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fa975c08-f1ea-48f6-8dac-ed72f9c337f9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:00.489605 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fa975c08-f1ea-48f6-8dac-ed72f9c337f9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:00.490056 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fa975c08-f1ea-48f6-8dac-ed72f9c337f9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:00.490758 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fa975c08-f1ea-48f6-8dac-ed72f9c337f9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:00.491225 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fa975c08-f1ea-48f6-8dac-ed72f9c337f9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:00.491662 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fa975c08-f1ea-48f6-8dac-ed72f9c337f9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:00.621455 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-fa975c08-f1ea-48f6-8dac-ed72f9c337f9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:18:00.624872 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:18:00.629458 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fa975c08-f1ea-48f6-8dac-ed72f9c337f9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1" status: 200 len: 1520 microversion: 2.1 time: 0.152276 Oct 30 02:18:00.630034 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3743/7149] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:18:00 2022] GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:18:01.652545 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-45d8d1ff-f353-4bec-8cd7-79d560714401 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:18:01.653189 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-45d8d1ff-f353-4bec-8cd7-79d560714401 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:18:01.660019 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45d8d1ff-f353-4bec-8cd7-79d560714401 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:01.660498 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45d8d1ff-f353-4bec-8cd7-79d560714401 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:01.660932 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45d8d1ff-f353-4bec-8cd7-79d560714401 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:01.661647 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45d8d1ff-f353-4bec-8cd7-79d560714401 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:01.662102 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45d8d1ff-f353-4bec-8cd7-79d560714401 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:01.662528 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45d8d1ff-f353-4bec-8cd7-79d560714401 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:01.790218 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-45d8d1ff-f353-4bec-8cd7-79d560714401 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:18:01.798509 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-45d8d1ff-f353-4bec-8cd7-79d560714401 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1" status: 200 len: 1520 microversion: 2.1 time: 0.149875 Oct 30 02:18:01.799076 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3407/7150] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:18:01 2022] GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:18:02.822623 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ce353131-b814-4e3a-b59f-4c3ecf39547e tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:18:02.823247 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ce353131-b814-4e3a-b59f-4c3ecf39547e tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:18:02.830401 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce353131-b814-4e3a-b59f-4c3ecf39547e tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:02.830924 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce353131-b814-4e3a-b59f-4c3ecf39547e tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:02.831374 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce353131-b814-4e3a-b59f-4c3ecf39547e tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:02.832078 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce353131-b814-4e3a-b59f-4c3ecf39547e tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:02.832551 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce353131-b814-4e3a-b59f-4c3ecf39547e tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:02.832987 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce353131-b814-4e3a-b59f-4c3ecf39547e tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:02.961105 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ce353131-b814-4e3a-b59f-4c3ecf39547e tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:18:02.968736 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ce353131-b814-4e3a-b59f-4c3ecf39547e tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1" status: 200 len: 1520 microversion: 2.1 time: 0.151072 Oct 30 02:18:02.969305 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3744/7151] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:18:02 2022] GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:18:03.992402 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-86298043-9e95-4861-8eff-eb1708bab6e6 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:18:03.992958 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-86298043-9e95-4861-8eff-eb1708bab6e6 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:18:04.000083 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-86298043-9e95-4861-8eff-eb1708bab6e6 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:04.000567 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-86298043-9e95-4861-8eff-eb1708bab6e6 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:04.001004 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-86298043-9e95-4861-8eff-eb1708bab6e6 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:04.001718 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-86298043-9e95-4861-8eff-eb1708bab6e6 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:04.002177 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-86298043-9e95-4861-8eff-eb1708bab6e6 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:04.002600 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-86298043-9e95-4861-8eff-eb1708bab6e6 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:04.135493 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-86298043-9e95-4861-8eff-eb1708bab6e6 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:18:04.143244 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-86298043-9e95-4861-8eff-eb1708bab6e6 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1" status: 200 len: 1520 microversion: 2.1 time: 0.154820 Oct 30 02:18:04.143824 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3408/7152] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:18:03 2022] GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:18:05.166903 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b2e179e8-c5ad-45b7-ba38-910b1b27b57d tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:18:05.167533 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b2e179e8-c5ad-45b7-ba38-910b1b27b57d tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:18:05.170275 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:18:05.174960 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2e179e8-c5ad-45b7-ba38-910b1b27b57d tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:05.184959 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2e179e8-c5ad-45b7-ba38-910b1b27b57d tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:05.184959 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2e179e8-c5ad-45b7-ba38-910b1b27b57d tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:05.184959 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2e179e8-c5ad-45b7-ba38-910b1b27b57d tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:05.184959 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2e179e8-c5ad-45b7-ba38-910b1b27b57d tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:05.184959 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2e179e8-c5ad-45b7-ba38-910b1b27b57d tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:05.304974 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b2e179e8-c5ad-45b7-ba38-910b1b27b57d tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:18:05.313048 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b2e179e8-c5ad-45b7-ba38-910b1b27b57d tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1" status: 200 len: 1520 microversion: 2.1 time: 0.150569 Oct 30 02:18:05.313645 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3745/7153] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:18:05 2022] GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:18:06.336334 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-14a3189e-8d8c-428d-a32a-5800e1b9b118 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:18:06.336951 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-14a3189e-8d8c-428d-a32a-5800e1b9b118 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:18:06.339706 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=37 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:18:06.344430 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14a3189e-8d8c-428d-a32a-5800e1b9b118 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:06.346836 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14a3189e-8d8c-428d-a32a-5800e1b9b118 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:06.346836 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14a3189e-8d8c-428d-a32a-5800e1b9b118 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:06.346836 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14a3189e-8d8c-428d-a32a-5800e1b9b118 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:06.346836 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14a3189e-8d8c-428d-a32a-5800e1b9b118 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:06.347204 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14a3189e-8d8c-428d-a32a-5800e1b9b118 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:06.349643 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:18:06.476810 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-14a3189e-8d8c-428d-a32a-5800e1b9b118 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:18:06.485785 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-14a3189e-8d8c-428d-a32a-5800e1b9b118 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1" status: 200 len: 1520 microversion: 2.1 time: 0.153505 Oct 30 02:18:06.486367 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3409/7154] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:18:06 2022] GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:18:07.509267 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a60489dc-ecbb-4e1b-b874-92e25238e726 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:18:07.509833 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a60489dc-ecbb-4e1b-b874-92e25238e726 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:18:07.516779 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a60489dc-ecbb-4e1b-b874-92e25238e726 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:07.517277 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a60489dc-ecbb-4e1b-b874-92e25238e726 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:07.517759 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a60489dc-ecbb-4e1b-b874-92e25238e726 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:07.518461 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a60489dc-ecbb-4e1b-b874-92e25238e726 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:07.518930 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a60489dc-ecbb-4e1b-b874-92e25238e726 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:07.519366 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a60489dc-ecbb-4e1b-b874-92e25238e726 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:07.651484 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a60489dc-ecbb-4e1b-b874-92e25238e726 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:18:07.659164 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a60489dc-ecbb-4e1b-b874-92e25238e726 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1" status: 200 len: 1520 microversion: 2.1 time: 0.153863 Oct 30 02:18:07.659791 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3746/7155] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:18:07 2022] GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:18:08.682922 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c04da6db-ea24-4548-988c-c1649fee6fe3 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:18:08.683546 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c04da6db-ea24-4548-988c-c1649fee6fe3 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:18:08.690806 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c04da6db-ea24-4548-988c-c1649fee6fe3 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:08.691292 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c04da6db-ea24-4548-988c-c1649fee6fe3 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:08.691728 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c04da6db-ea24-4548-988c-c1649fee6fe3 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:08.692422 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c04da6db-ea24-4548-988c-c1649fee6fe3 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:08.692880 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c04da6db-ea24-4548-988c-c1649fee6fe3 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:08.693307 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c04da6db-ea24-4548-988c-c1649fee6fe3 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:08.824365 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c04da6db-ea24-4548-988c-c1649fee6fe3 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:18:08.832200 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c04da6db-ea24-4548-988c-c1649fee6fe3 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1" status: 200 len: 1520 microversion: 2.1 time: 0.153167 Oct 30 02:18:08.832778 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3410/7156] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:18:08 2022] GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:18:09.855602 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8a2eca42-801d-429d-ab74-b2a0dc6f88bc tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:18:09.856233 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8a2eca42-801d-429d-ab74-b2a0dc6f88bc tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:18:09.863065 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8a2eca42-801d-429d-ab74-b2a0dc6f88bc tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:09.863563 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8a2eca42-801d-429d-ab74-b2a0dc6f88bc tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:09.864013 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8a2eca42-801d-429d-ab74-b2a0dc6f88bc tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:09.864712 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8a2eca42-801d-429d-ab74-b2a0dc6f88bc tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:09.865178 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8a2eca42-801d-429d-ab74-b2a0dc6f88bc tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:09.865639 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8a2eca42-801d-429d-ab74-b2a0dc6f88bc tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:09.991966 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8a2eca42-801d-429d-ab74-b2a0dc6f88bc tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:18:10.000079 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8a2eca42-801d-429d-ab74-b2a0dc6f88bc tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1" status: 200 len: 1520 microversion: 2.1 time: 0.148374 Oct 30 02:18:10.000652 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3747/7157] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:18:09 2022] GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:18:11.023482 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-50626e98-f7c9-4832-9cff-bdf446f2babf tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:18:11.024125 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-50626e98-f7c9-4832-9cff-bdf446f2babf tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:18:11.032132 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-50626e98-f7c9-4832-9cff-bdf446f2babf tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:11.032616 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-50626e98-f7c9-4832-9cff-bdf446f2babf tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:11.033052 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-50626e98-f7c9-4832-9cff-bdf446f2babf tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:11.033776 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-50626e98-f7c9-4832-9cff-bdf446f2babf tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:11.034229 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-50626e98-f7c9-4832-9cff-bdf446f2babf tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:11.034652 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-50626e98-f7c9-4832-9cff-bdf446f2babf tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:11.171437 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-50626e98-f7c9-4832-9cff-bdf446f2babf tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:18:11.174554 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-50626e98-f7c9-4832-9cff-bdf446f2babf tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1" status: 200 len: 1520 microversion: 2.1 time: 0.155074 Oct 30 02:18:11.175125 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3411/7158] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:18:11 2022] GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:18:12.197753 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1824a73b-b430-4694-95f0-917466b82bd9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:18:12.198383 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1824a73b-b430-4694-95f0-917466b82bd9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:18:12.204748 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1824a73b-b430-4694-95f0-917466b82bd9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:12.205275 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1824a73b-b430-4694-95f0-917466b82bd9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:12.205763 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1824a73b-b430-4694-95f0-917466b82bd9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:12.206462 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1824a73b-b430-4694-95f0-917466b82bd9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:12.206932 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1824a73b-b430-4694-95f0-917466b82bd9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:12.207369 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1824a73b-b430-4694-95f0-917466b82bd9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:12.340772 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1824a73b-b430-4694-95f0-917466b82bd9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:18:12.348536 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1824a73b-b430-4694-95f0-917466b82bd9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1" status: 200 len: 1520 microversion: 2.1 time: 0.154844 Oct 30 02:18:12.349103 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3748/7159] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:18:12 2022] GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:18:13.372006 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d6f2be18-92db-4b6e-b066-1c96b523581b tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:18:13.372617 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d6f2be18-92db-4b6e-b066-1c96b523581b tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:18:13.379508 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d6f2be18-92db-4b6e-b066-1c96b523581b tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:13.379994 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d6f2be18-92db-4b6e-b066-1c96b523581b tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:13.380465 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d6f2be18-92db-4b6e-b066-1c96b523581b tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:13.381155 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d6f2be18-92db-4b6e-b066-1c96b523581b tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:13.381643 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d6f2be18-92db-4b6e-b066-1c96b523581b tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:13.382070 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d6f2be18-92db-4b6e-b066-1c96b523581b tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:13.510831 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d6f2be18-92db-4b6e-b066-1c96b523581b tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:18:13.518710 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d6f2be18-92db-4b6e-b066-1c96b523581b tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1" status: 200 len: 1520 microversion: 2.1 time: 0.150616 Oct 30 02:18:13.519291 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3412/7160] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:18:13 2022] GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:18:14.541653 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a2794d26-9802-45f2-bbed-1114ebf34902 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:18:14.542305 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a2794d26-9802-45f2-bbed-1114ebf34902 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:18:14.549038 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a2794d26-9802-45f2-bbed-1114ebf34902 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:14.551946 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a2794d26-9802-45f2-bbed-1114ebf34902 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:14.551946 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a2794d26-9802-45f2-bbed-1114ebf34902 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:14.551946 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a2794d26-9802-45f2-bbed-1114ebf34902 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:14.551946 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a2794d26-9802-45f2-bbed-1114ebf34902 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:14.551946 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a2794d26-9802-45f2-bbed-1114ebf34902 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:14.685413 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a2794d26-9802-45f2-bbed-1114ebf34902 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:18:14.693440 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a2794d26-9802-45f2-bbed-1114ebf34902 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1" status: 200 len: 1520 microversion: 2.1 time: 0.155824 Oct 30 02:18:14.694009 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3749/7161] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:18:14 2022] GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:18:15.716531 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5f90c35d-73dd-4b79-bf4a-e3d98b6b5cab tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:18:15.717158 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5f90c35d-73dd-4b79-bf4a-e3d98b6b5cab tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:18:15.724023 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f90c35d-73dd-4b79-bf4a-e3d98b6b5cab tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:15.724516 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f90c35d-73dd-4b79-bf4a-e3d98b6b5cab tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:15.724959 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f90c35d-73dd-4b79-bf4a-e3d98b6b5cab tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:15.725678 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f90c35d-73dd-4b79-bf4a-e3d98b6b5cab tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:15.726137 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f90c35d-73dd-4b79-bf4a-e3d98b6b5cab tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:15.726564 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f90c35d-73dd-4b79-bf4a-e3d98b6b5cab tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:15.867063 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5f90c35d-73dd-4b79-bf4a-e3d98b6b5cab tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:18:15.867063 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5f90c35d-73dd-4b79-bf4a-e3d98b6b5cab tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1" status: 200 len: 1520 microversion: 2.1 time: 0.153423 Oct 30 02:18:15.867063 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3413/7162] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:18:15 2022] GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:18:16.890064 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-58bfe202-a18d-409e-ac84-3b46c5b79867 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:18:16.890689 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-58bfe202-a18d-409e-ac84-3b46c5b79867 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:18:16.897637 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-58bfe202-a18d-409e-ac84-3b46c5b79867 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:16.898135 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-58bfe202-a18d-409e-ac84-3b46c5b79867 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:16.898581 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-58bfe202-a18d-409e-ac84-3b46c5b79867 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:16.899279 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-58bfe202-a18d-409e-ac84-3b46c5b79867 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:16.899740 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-58bfe202-a18d-409e-ac84-3b46c5b79867 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:16.900673 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-58bfe202-a18d-409e-ac84-3b46c5b79867 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:17.036044 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-58bfe202-a18d-409e-ac84-3b46c5b79867 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:18:17.044518 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-58bfe202-a18d-409e-ac84-3b46c5b79867 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1" status: 200 len: 1520 microversion: 2.1 time: 0.158332 Oct 30 02:18:17.045082 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3750/7163] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:18:16 2022] GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:18:18.068066 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f5b438fa-43c8-4598-955d-49290eaa3e2e tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:18:18.068805 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f5b438fa-43c8-4598-955d-49290eaa3e2e tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:18:18.075888 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f5b438fa-43c8-4598-955d-49290eaa3e2e tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:18.078914 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f5b438fa-43c8-4598-955d-49290eaa3e2e tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:18.078914 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f5b438fa-43c8-4598-955d-49290eaa3e2e tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:18.078914 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f5b438fa-43c8-4598-955d-49290eaa3e2e tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:18.078914 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f5b438fa-43c8-4598-955d-49290eaa3e2e tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:18.078914 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f5b438fa-43c8-4598-955d-49290eaa3e2e tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:18.208101 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f5b438fa-43c8-4598-955d-49290eaa3e2e tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:18:18.216470 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f5b438fa-43c8-4598-955d-49290eaa3e2e tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1" status: 200 len: 1520 microversion: 2.1 time: 0.152536 Oct 30 02:18:18.217052 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3414/7164] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:18:18 2022] GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:18:19.240073 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ee937e59-3e31-48f7-979f-dc027bb453ba tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:18:19.240819 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ee937e59-3e31-48f7-979f-dc027bb453ba tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:18:19.247568 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee937e59-3e31-48f7-979f-dc027bb453ba tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:19.248064 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee937e59-3e31-48f7-979f-dc027bb453ba tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:19.248519 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee937e59-3e31-48f7-979f-dc027bb453ba tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:19.249225 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee937e59-3e31-48f7-979f-dc027bb453ba tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:19.249722 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee937e59-3e31-48f7-979f-dc027bb453ba tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:19.250162 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee937e59-3e31-48f7-979f-dc027bb453ba tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:19.382456 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ee937e59-3e31-48f7-979f-dc027bb453ba tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:18:19.390723 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ee937e59-3e31-48f7-979f-dc027bb453ba tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1" status: 200 len: 1520 microversion: 2.1 time: 0.154601 Oct 30 02:18:19.391286 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3751/7165] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:18:19 2022] GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:18:20.414697 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b9135813-14f5-4ca7-9587-a3cb6c7ff6bb tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:18:20.415325 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b9135813-14f5-4ca7-9587-a3cb6c7ff6bb tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:18:20.422812 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b9135813-14f5-4ca7-9587-a3cb6c7ff6bb tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:20.423300 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b9135813-14f5-4ca7-9587-a3cb6c7ff6bb tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:20.423741 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b9135813-14f5-4ca7-9587-a3cb6c7ff6bb tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:20.424442 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b9135813-14f5-4ca7-9587-a3cb6c7ff6bb tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:20.424899 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b9135813-14f5-4ca7-9587-a3cb6c7ff6bb tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:20.425326 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b9135813-14f5-4ca7-9587-a3cb6c7ff6bb tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:20.559296 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b9135813-14f5-4ca7-9587-a3cb6c7ff6bb tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:18:20.567288 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b9135813-14f5-4ca7-9587-a3cb6c7ff6bb tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1" status: 200 len: 1520 microversion: 2.1 time: 0.156536 Oct 30 02:18:20.567862 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3415/7166] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:18:20 2022] GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:18:21.590587 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-daddc8af-4c08-4ac4-9069-66dcf710878a tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:18:21.591215 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-daddc8af-4c08-4ac4-9069-66dcf710878a tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:18:21.598115 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-daddc8af-4c08-4ac4-9069-66dcf710878a tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:21.598602 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-daddc8af-4c08-4ac4-9069-66dcf710878a tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:21.599044 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-daddc8af-4c08-4ac4-9069-66dcf710878a tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:21.599737 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-daddc8af-4c08-4ac4-9069-66dcf710878a tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:21.600194 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-daddc8af-4c08-4ac4-9069-66dcf710878a tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:21.600626 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-daddc8af-4c08-4ac4-9069-66dcf710878a tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:21.727131 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-daddc8af-4c08-4ac4-9069-66dcf710878a tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:18:21.735619 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-daddc8af-4c08-4ac4-9069-66dcf710878a tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1" status: 200 len: 1520 microversion: 2.1 time: 0.149481 Oct 30 02:18:21.736187 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3752/7167] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:18:21 2022] GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:18:22.759886 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ed237a73-48fd-42a5-bfc2-e4abb026d0c9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:18:22.760705 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ed237a73-48fd-42a5-bfc2-e4abb026d0c9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:18:22.767625 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ed237a73-48fd-42a5-bfc2-e4abb026d0c9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:22.768188 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ed237a73-48fd-42a5-bfc2-e4abb026d0c9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:22.768694 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ed237a73-48fd-42a5-bfc2-e4abb026d0c9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:22.769554 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ed237a73-48fd-42a5-bfc2-e4abb026d0c9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:22.770077 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ed237a73-48fd-42a5-bfc2-e4abb026d0c9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:22.770585 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ed237a73-48fd-42a5-bfc2-e4abb026d0c9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:22.910930 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ed237a73-48fd-42a5-bfc2-e4abb026d0c9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:18:22.919535 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ed237a73-48fd-42a5-bfc2-e4abb026d0c9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1" status: 200 len: 1519 microversion: 2.1 time: 0.163615 Oct 30 02:18:22.920119 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3416/7168] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:18:22 2022] GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:18:23.106476 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-b86e2d0f-e086-4a7e-ae1e-e1188e068739 req-26883919-5ffb-46ab-b93b-585c373f6015 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d6c217b-d03f-4ae7-ae1b-db354ea22ca1", "name": "network-vif-unplugged", "status": "completed", "tag": "6e9d14a4-2b80-4bc8-a5db-d99ad982e852"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:18:23.116168 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-b86e2d0f-e086-4a7e-ae1e-e1188e068739 req-26883919-5ffb-46ab-b93b-585c373f6015 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:23.116652 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-b86e2d0f-e086-4a7e-ae1e-e1188e068739 req-26883919-5ffb-46ab-b93b-585c373f6015 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:23.117085 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-b86e2d0f-e086-4a7e-ae1e-e1188e068739 req-26883919-5ffb-46ab-b93b-585c373f6015 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:23.128469 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-b86e2d0f-e086-4a7e-ae1e-e1188e068739 req-26883919-5ffb-46ab-b93b-585c373f6015 service nova] Creating event network-vif-unplugged:6e9d14a4-2b80-4bc8-a5db-d99ad982e852 for instance 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 on n-h1-master-1 Oct 30 02:18:23.133907 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [req-b86e2d0f-e086-4a7e-ae1e-e1188e068739 req-26883919-5ffb-46ab-b93b-585c373f6015 service nova] Instance 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=121102) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 30 02:18:23.145394 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-b86e2d0f-e086-4a7e-ae1e-e1188e068739 req-26883919-5ffb-46ab-b93b-585c373f6015 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096470 Oct 30 02:18:23.146006 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3753/7169] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:18:23.943160 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6bc1f97a-4dbf-436b-b8c5-04e95b59a8e4 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:18:23.943645 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6bc1f97a-4dbf-436b-b8c5-04e95b59a8e4 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:18:23.950974 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6bc1f97a-4dbf-436b-b8c5-04e95b59a8e4 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:23.951456 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6bc1f97a-4dbf-436b-b8c5-04e95b59a8e4 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:23.951888 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6bc1f97a-4dbf-436b-b8c5-04e95b59a8e4 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:23.952577 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6bc1f97a-4dbf-436b-b8c5-04e95b59a8e4 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:23.953026 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6bc1f97a-4dbf-436b-b8c5-04e95b59a8e4 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:23.954320 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6bc1f97a-4dbf-436b-b8c5-04e95b59a8e4 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:24.092342 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6bc1f97a-4dbf-436b-b8c5-04e95b59a8e4 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:18:24.100387 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6bc1f97a-4dbf-436b-b8c5-04e95b59a8e4 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1" status: 200 len: 1519 microversion: 2.1 time: 0.161200 Oct 30 02:18:24.100973 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3417/7170] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:18:23 2022] GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:18:25.125462 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5ee719ed-e7b8-4fec-bdf5-c785b066b0c7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:18:25.126176 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5ee719ed-e7b8-4fec-bdf5-c785b066b0c7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:18:25.132345 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5ee719ed-e7b8-4fec-bdf5-c785b066b0c7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:25.132845 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5ee719ed-e7b8-4fec-bdf5-c785b066b0c7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:25.133296 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5ee719ed-e7b8-4fec-bdf5-c785b066b0c7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:25.134660 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5ee719ed-e7b8-4fec-bdf5-c785b066b0c7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:25.135134 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5ee719ed-e7b8-4fec-bdf5-c785b066b0c7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:25.135573 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5ee719ed-e7b8-4fec-bdf5-c785b066b0c7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:25.164474 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-67439fcd-0e9b-4add-b8cc-0ed3d640cb9b req-d82c1499-cc47-4df3-8bc3-824282397e15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d6c217b-d03f-4ae7-ae1b-db354ea22ca1", "tag": "6e9d14a4-2b80-4bc8-a5db-d99ad982e852"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:18:25.175978 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-67439fcd-0e9b-4add-b8cc-0ed3d640cb9b req-d82c1499-cc47-4df3-8bc3-824282397e15 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:25.178512 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-67439fcd-0e9b-4add-b8cc-0ed3d640cb9b req-d82c1499-cc47-4df3-8bc3-824282397e15 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:25.178512 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-67439fcd-0e9b-4add-b8cc-0ed3d640cb9b req-d82c1499-cc47-4df3-8bc3-824282397e15 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:25.190322 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-67439fcd-0e9b-4add-b8cc-0ed3d640cb9b req-d82c1499-cc47-4df3-8bc3-824282397e15 service nova] Creating event network-changed:6e9d14a4-2b80-4bc8-a5db-d99ad982e852 for instance 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 on n-h1-master-1 Oct 30 02:18:25.195705 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [req-67439fcd-0e9b-4add-b8cc-0ed3d640cb9b req-d82c1499-cc47-4df3-8bc3-824282397e15 service nova] Instance 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=121103) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 30 02:18:25.207742 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-67439fcd-0e9b-4add-b8cc-0ed3d640cb9b req-d82c1499-cc47-4df3-8bc3-824282397e15 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046857 Oct 30 02:18:25.208363 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3418/7171] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:18:25.275628 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5ee719ed-e7b8-4fec-bdf5-c785b066b0c7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:18:25.284316 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5ee719ed-e7b8-4fec-bdf5-c785b066b0c7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1" status: 200 len: 1517 microversion: 2.1 time: 0.163985 Oct 30 02:18:25.284895 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3754/7172] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:18:25 2022] GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:18:26.309650 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f705cfb9-8d38-4260-8e80-65592ad138ef tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:18:26.310413 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f705cfb9-8d38-4260-8e80-65592ad138ef tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:18:26.316812 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f705cfb9-8d38-4260-8e80-65592ad138ef tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:26.317297 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f705cfb9-8d38-4260-8e80-65592ad138ef tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:26.318323 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f705cfb9-8d38-4260-8e80-65592ad138ef tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:26.319023 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f705cfb9-8d38-4260-8e80-65592ad138ef tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:26.319476 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f705cfb9-8d38-4260-8e80-65592ad138ef tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:26.319902 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f705cfb9-8d38-4260-8e80-65592ad138ef tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:26.457495 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f705cfb9-8d38-4260-8e80-65592ad138ef tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:18:26.465298 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f705cfb9-8d38-4260-8e80-65592ad138ef tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1" status: 200 len: 1514 microversion: 2.1 time: 0.160818 Oct 30 02:18:26.465888 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3419/7173] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:18:26 2022] GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:18:26.487908 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a41c8365-e353-44c5-bad8-d7cef027129f tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:18:26.488484 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a41c8365-e353-44c5-bad8-d7cef027129f tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:18:26.495820 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a41c8365-e353-44c5-bad8-d7cef027129f tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:26.496310 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a41c8365-e353-44c5-bad8-d7cef027129f tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:26.496752 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a41c8365-e353-44c5-bad8-d7cef027129f tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:26.497477 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a41c8365-e353-44c5-bad8-d7cef027129f tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:26.497939 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a41c8365-e353-44c5-bad8-d7cef027129f tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:26.498373 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a41c8365-e353-44c5-bad8-d7cef027129f tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:26.729554 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a41c8365-e353-44c5-bad8-d7cef027129f tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "POST /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1/action" status: 204 len: 0 microversion: 2.1 time: 0.245332 Oct 30 02:18:26.730224 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3755/7174] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 02:18:26 2022] POST /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1/action => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 02:18:26.739290 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-13e950c7-d1b7-47f3-a7e8-ba85b97acdca tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:18:26.743922 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-13e950c7-d1b7-47f3-a7e8-ba85b97acdca tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:18:26.745893 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-13e950c7-d1b7-47f3-a7e8-ba85b97acdca tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:26.746389 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-13e950c7-d1b7-47f3-a7e8-ba85b97acdca tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:26.746826 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-13e950c7-d1b7-47f3-a7e8-ba85b97acdca tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:26.747527 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-13e950c7-d1b7-47f3-a7e8-ba85b97acdca tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:26.747983 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-13e950c7-d1b7-47f3-a7e8-ba85b97acdca tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:26.748412 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-13e950c7-d1b7-47f3-a7e8-ba85b97acdca tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:26.893841 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-13e950c7-d1b7-47f3-a7e8-ba85b97acdca tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:18:26.902727 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-13e950c7-d1b7-47f3-a7e8-ba85b97acdca tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1" status: 200 len: 1514 microversion: 2.1 time: 0.167390 Oct 30 02:18:26.903313 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3420/7175] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:18:26 2022] GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:18:27.926895 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-80977f52-d0c7-441a-9ec7-1c7a5a77491b tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:18:27.927655 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-80977f52-d0c7-441a-9ec7-1c7a5a77491b tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:18:27.934563 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-80977f52-d0c7-441a-9ec7-1c7a5a77491b tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:27.935051 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-80977f52-d0c7-441a-9ec7-1c7a5a77491b tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:27.935500 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-80977f52-d0c7-441a-9ec7-1c7a5a77491b tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:27.936207 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-80977f52-d0c7-441a-9ec7-1c7a5a77491b tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:27.936942 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-80977f52-d0c7-441a-9ec7-1c7a5a77491b tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:27.937443 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-80977f52-d0c7-441a-9ec7-1c7a5a77491b tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:28.073243 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-80977f52-d0c7-441a-9ec7-1c7a5a77491b tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:18:28.080991 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-80977f52-d0c7-441a-9ec7-1c7a5a77491b tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1" status: 200 len: 1514 microversion: 2.1 time: 0.159265 Oct 30 02:18:28.081628 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3756/7176] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:18:27 2022] GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:18:29.104781 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0383f5eb-d88e-4a82-82d7-dd354353fe93 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:18:29.105425 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0383f5eb-d88e-4a82-82d7-dd354353fe93 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:18:29.112275 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0383f5eb-d88e-4a82-82d7-dd354353fe93 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:29.112772 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0383f5eb-d88e-4a82-82d7-dd354353fe93 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:29.113208 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0383f5eb-d88e-4a82-82d7-dd354353fe93 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:29.113950 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0383f5eb-d88e-4a82-82d7-dd354353fe93 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:29.114406 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0383f5eb-d88e-4a82-82d7-dd354353fe93 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:29.114831 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0383f5eb-d88e-4a82-82d7-dd354353fe93 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:29.246624 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0383f5eb-d88e-4a82-82d7-dd354353fe93 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:18:29.256532 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0383f5eb-d88e-4a82-82d7-dd354353fe93 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1" status: 200 len: 1506 microversion: 2.1 time: 0.156267 Oct 30 02:18:29.257147 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3421/7177] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:18:29 2022] GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:18:29.280992 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-656ca956-1f27-40d1-9120-b604ab80b45d tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:18:29.281852 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-656ca956-1f27-40d1-9120-b604ab80b45d tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:18:29.292157 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-656ca956-1f27-40d1-9120-b604ab80b45d tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:29.292157 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-656ca956-1f27-40d1-9120-b604ab80b45d tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:29.292157 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-656ca956-1f27-40d1-9120-b604ab80b45d tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:29.292157 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-656ca956-1f27-40d1-9120-b604ab80b45d tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:29.292567 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-656ca956-1f27-40d1-9120-b604ab80b45d tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:29.292683 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-656ca956-1f27-40d1-9120-b604ab80b45d tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:29.390569 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-35c79c44-91e2-4b73-acc1-a46790b27ed6 req-05f8a67c-d624-4ac2-99da-dbfffdda7c05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d6c217b-d03f-4ae7-ae1b-db354ea22ca1", "name": "network-vif-plugged", "status": "completed", "tag": "6e9d14a4-2b80-4bc8-a5db-d99ad982e852"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:18:29.400804 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-35c79c44-91e2-4b73-acc1-a46790b27ed6 req-05f8a67c-d624-4ac2-99da-dbfffdda7c05 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:29.401295 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-35c79c44-91e2-4b73-acc1-a46790b27ed6 req-05f8a67c-d624-4ac2-99da-dbfffdda7c05 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:29.401776 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-35c79c44-91e2-4b73-acc1-a46790b27ed6 req-05f8a67c-d624-4ac2-99da-dbfffdda7c05 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:29.417552 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-35c79c44-91e2-4b73-acc1-a46790b27ed6 req-05f8a67c-d624-4ac2-99da-dbfffdda7c05 service nova] Creating event network-vif-plugged:6e9d14a4-2b80-4bc8-a5db-d99ad982e852 for instance 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 on n-h1-master-1 Oct 30 02:18:29.423102 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-35c79c44-91e2-4b73-acc1-a46790b27ed6 req-05f8a67c-d624-4ac2-99da-dbfffdda7c05 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099421 Oct 30 02:18:29.424309 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3422/7178] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:18:29.440135 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-656ca956-1f27-40d1-9120-b604ab80b45d tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:18:29.446357 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-656ca956-1f27-40d1-9120-b604ab80b45d tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1" status: 200 len: 1506 microversion: 2.1 time: 0.168992 Oct 30 02:18:29.447482 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3757/7179] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:18:29 2022] GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 => generated 1506 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:18:29.479458 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e77b514a-2dc1-44cc-8a47-25efc9fce8f7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Action: 'create', calling method: .version_select at 0x7f44d045c5e0>, body: {"keypair": {"name": "tempest-keypair-725829123", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHh20A6aFIT+JD7JR45sgBVgy3dc2JoE/ajb8LYTTOrXr3US3Uy1pwM1bKOaObInxVzjd2bO0aG0t4N84eQJqgqo0qyakmhso28Y90P/EMTnczklL9J3cLxdZHYpd3eA/Q=="}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:18:29.495209 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-e77b514a-2dc1-44cc-8a47-25efc9fce8f7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Getting quotas for project 5c755ba9d0c1434c9e73634c2cc4a80a. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 02:18:29.500455 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-e77b514a-2dc1-44cc-8a47-25efc9fce8f7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Getting quotas for user 65b8f0f9740b44d59ca2617609cac5ab and project 5c755ba9d0c1434c9e73634c2cc4a80a. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 02:18:29.571713 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e77b514a-2dc1-44cc-8a47-25efc9fce8f7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.097320 Oct 30 02:18:29.572320 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3423/7180] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 30 02:18:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:18:31.454665 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ee1e3a8d-4360-41b7-a6dc-8a4d0b8743bb tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:18:31.459243 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ee1e3a8d-4360-41b7-a6dc-8a4d0b8743bb tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:18:31.459243 n-d-master-1 devstack@n-api.service[121102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 30 02:18:31.459243 n-d-master-1 devstack@n-api.service[121102]: Sun Oct 30 02:18:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 (ip 10.222.0.13) !!! Oct 30 02:18:31.465171 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee1e3a8d-4360-41b7-a6dc-8a4d0b8743bb tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:31.465695 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee1e3a8d-4360-41b7-a6dc-8a4d0b8743bb tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:31.466137 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee1e3a8d-4360-41b7-a6dc-8a4d0b8743bb tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:31.466835 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee1e3a8d-4360-41b7-a6dc-8a4d0b8743bb tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:31.467296 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee1e3a8d-4360-41b7-a6dc-8a4d0b8743bb tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:31.467734 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee1e3a8d-4360-41b7-a6dc-8a4d0b8743bb tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:31.880050 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ee1e3a8d-4360-41b7-a6dc-8a4d0b8743bb tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:18:31.888384 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ee1e3a8d-4360-41b7-a6dc-8a4d0b8743bb tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1" status: 200 len: 1506 microversion: 2.1 time: 0.437649 Oct 30 02:18:31.888951 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3758/7181] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:18:31 2022] GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 => generated 1506 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:18:31.911052 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d06a3944-27f3-4e7f-a141-0c46cfc8bc90 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:18:31.911676 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d06a3944-27f3-4e7f-a141-0c46cfc8bc90 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:18:31.918367 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d06a3944-27f3-4e7f-a141-0c46cfc8bc90 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:31.918895 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d06a3944-27f3-4e7f-a141-0c46cfc8bc90 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:31.919327 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d06a3944-27f3-4e7f-a141-0c46cfc8bc90 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:31.920025 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d06a3944-27f3-4e7f-a141-0c46cfc8bc90 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:31.920470 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d06a3944-27f3-4e7f-a141-0c46cfc8bc90 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:31.920890 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d06a3944-27f3-4e7f-a141-0c46cfc8bc90 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:31.945641 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d06a3944-27f3-4e7f-a141-0c46cfc8bc90 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 02:18:32.221131 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d06a3944-27f3-4e7f-a141-0c46cfc8bc90 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1" status: 204 len: 0 microversion: 2.1 time: 0.314641 Oct 30 02:18:32.221777 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3424/7182] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 02:18:31 2022] DELETE /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 02:18:32.285234 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bdd42523-9de2-42ee-aaa6-735d701718b9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-200238974", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "d8dfcb3d-f006-47d5-8a24-efcb99fa7d86"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:18:32.339435 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-bdd42523-9de2-42ee-aaa6-735d701718b9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] validate_networks() for [('d8dfcb3d-f006-47d5-8a24-efcb99fa7d86', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 02:18:32.749755 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-bdd42523-9de2-42ee-aaa6-735d701718b9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 02:18:32.750368 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-bdd42523-9de2-42ee-aaa6-735d701718b9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 02:18:32.750687 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-bdd42523-9de2-42ee-aaa6-735d701718b9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 02:18:32.751105 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-bdd42523-9de2-42ee-aaa6-735d701718b9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 02:18:32.751527 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-bdd42523-9de2-42ee-aaa6-735d701718b9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 02:18:32.760938 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bdd42523-9de2-42ee-aaa6-735d701718b9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:32.761461 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bdd42523-9de2-42ee-aaa6-735d701718b9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:32.761907 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bdd42523-9de2-42ee-aaa6-735d701718b9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:32.762644 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bdd42523-9de2-42ee-aaa6-735d701718b9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:32.763104 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bdd42523-9de2-42ee-aaa6-735d701718b9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:32.763539 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bdd42523-9de2-42ee-aaa6-735d701718b9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:32.780659 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-bdd42523-9de2-42ee-aaa6-735d701718b9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Getting quotas for project 5c755ba9d0c1434c9e73634c2cc4a80a. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 02:18:32.786079 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-bdd42523-9de2-42ee-aaa6-735d701718b9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Getting quotas for user 65b8f0f9740b44d59ca2617609cac5ab and project 5c755ba9d0c1434c9e73634c2cc4a80a. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 02:18:32.798279 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bdd42523-9de2-42ee-aaa6-735d701718b9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 02:18:32.800580 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bdd42523-9de2-42ee-aaa6-735d701718b9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 02:18:32.903373 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bdd42523-9de2-42ee-aaa6-735d701718b9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.621994 Oct 30 02:18:32.909314 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3759/7183] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 02:18:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 02:18:32.916144 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cf0685cb-0400-429b-8f19-9fb927c918b1 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:18:32.916860 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-cf0685cb-0400-429b-8f19-9fb927c918b1 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:18:32.972360 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-cf0685cb-0400-429b-8f19-9fb927c918b1 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:18:32.980124 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cf0685cb-0400-429b-8f19-9fb927c918b1 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a" status: 200 len: 1217 microversion: 2.1 time: 0.068420 Oct 30 02:18:32.980694 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3425/7184] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:18:32 2022] GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a => generated 1217 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:18:34.005061 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b757597e-7a9b-4d17-9203-4c7d02bbe9fd tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:18:34.005884 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b757597e-7a9b-4d17-9203-4c7d02bbe9fd tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:18:34.012581 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b757597e-7a9b-4d17-9203-4c7d02bbe9fd tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:34.015601 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b757597e-7a9b-4d17-9203-4c7d02bbe9fd tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:34.015601 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b757597e-7a9b-4d17-9203-4c7d02bbe9fd tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:34.015601 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b757597e-7a9b-4d17-9203-4c7d02bbe9fd tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:34.015601 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b757597e-7a9b-4d17-9203-4c7d02bbe9fd tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:34.015601 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b757597e-7a9b-4d17-9203-4c7d02bbe9fd tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:34.020253 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:18:34.103222 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b757597e-7a9b-4d17-9203-4c7d02bbe9fd tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:18:34.112154 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b757597e-7a9b-4d17-9203-4c7d02bbe9fd tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a" status: 200 len: 1213 microversion: 2.1 time: 0.113249 Oct 30 02:18:34.112744 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3760/7185] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:18:33 2022] GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a => generated 1213 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:18:34.300081 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-0398168c-c19e-47cb-814b-3993b80f4bdd req-b67d32d7-397b-4de8-a880-617ee891ceb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d6c217b-d03f-4ae7-ae1b-db354ea22ca1", "name": "network-vif-deleted", "tag": "6e9d14a4-2b80-4bc8-a5db-d99ad982e852"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:18:34.310322 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-0398168c-c19e-47cb-814b-3993b80f4bdd req-b67d32d7-397b-4de8-a880-617ee891ceb5 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:34.311055 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-0398168c-c19e-47cb-814b-3993b80f4bdd req-b67d32d7-397b-4de8-a880-617ee891ceb5 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:34.311490 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-0398168c-c19e-47cb-814b-3993b80f4bdd req-b67d32d7-397b-4de8-a880-617ee891ceb5 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:34.326952 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-0398168c-c19e-47cb-814b-3993b80f4bdd req-b67d32d7-397b-4de8-a880-617ee891ceb5 service nova] Creating event network-vif-deleted:6e9d14a4-2b80-4bc8-a5db-d99ad982e852 for instance 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 on n-h1-master-1 Oct 30 02:18:34.331927 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-0398168c-c19e-47cb-814b-3993b80f4bdd req-b67d32d7-397b-4de8-a880-617ee891ceb5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035857 Oct 30 02:18:34.332821 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3426/7186] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:18:35.144593 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f8694d55-eb63-4135-92ce-63f0ce4a9611 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:18:35.145268 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f8694d55-eb63-4135-92ce-63f0ce4a9611 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:18:35.152452 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f8694d55-eb63-4135-92ce-63f0ce4a9611 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:35.152888 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f8694d55-eb63-4135-92ce-63f0ce4a9611 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:35.153353 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f8694d55-eb63-4135-92ce-63f0ce4a9611 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:35.154071 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f8694d55-eb63-4135-92ce-63f0ce4a9611 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:35.154585 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f8694d55-eb63-4135-92ce-63f0ce4a9611 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:35.154979 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f8694d55-eb63-4135-92ce-63f0ce4a9611 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:35.223425 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f8694d55-eb63-4135-92ce-63f0ce4a9611 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:18:35.231668 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f8694d55-eb63-4135-92ce-63f0ce4a9611 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a" status: 200 len: 1287 microversion: 2.1 time: 0.091434 Oct 30 02:18:35.232233 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3761/7187] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:18:35 2022] GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a => generated 1287 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:18:36.256556 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f32df67a-2254-46c2-a41e-b23261b2625b tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:18:36.257379 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f32df67a-2254-46c2-a41e-b23261b2625b tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:18:36.263679 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f32df67a-2254-46c2-a41e-b23261b2625b tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:36.264254 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f32df67a-2254-46c2-a41e-b23261b2625b tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:36.264710 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f32df67a-2254-46c2-a41e-b23261b2625b tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:36.265483 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f32df67a-2254-46c2-a41e-b23261b2625b tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:36.265952 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f32df67a-2254-46c2-a41e-b23261b2625b tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:36.266377 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f32df67a-2254-46c2-a41e-b23261b2625b tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:36.403643 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f32df67a-2254-46c2-a41e-b23261b2625b tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:18:36.406039 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:18:36.413188 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f32df67a-2254-46c2-a41e-b23261b2625b tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a" status: 200 len: 1317 microversion: 2.1 time: 0.160952 Oct 30 02:18:36.413188 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3427/7188] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:18:36 2022] GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:18:36.839748 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-c4f9fe5e-82a1-4043-acce-808e4e0b8757 req-08c20408-e269-43c7-b114-605fc0ee5c72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8530d205-5781-4ce6-bc77-fed36c2b597a", "tag": "8cd5be01-cd20-4303-b411-2d993a4dfb9f"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:18:36.846067 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:18:36.851341 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-c4f9fe5e-82a1-4043-acce-808e4e0b8757 req-08c20408-e269-43c7-b114-605fc0ee5c72 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:36.852129 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-c4f9fe5e-82a1-4043-acce-808e4e0b8757 req-08c20408-e269-43c7-b114-605fc0ee5c72 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:36.852588 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-c4f9fe5e-82a1-4043-acce-808e4e0b8757 req-08c20408-e269-43c7-b114-605fc0ee5c72 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:36.863698 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-c4f9fe5e-82a1-4043-acce-808e4e0b8757 req-08c20408-e269-43c7-b114-605fc0ee5c72 service nova] Creating event network-changed:8cd5be01-cd20-4303-b411-2d993a4dfb9f for instance 8530d205-5781-4ce6-bc77-fed36c2b597a on n-h1-master-1 Oct 30 02:18:36.869226 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-c4f9fe5e-82a1-4043-acce-808e4e0b8757 req-08c20408-e269-43c7-b114-605fc0ee5c72 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034635 Oct 30 02:18:36.870709 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3762/7189] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:18:37.436422 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d35fd5dd-7ed1-44c7-84cf-986481dd5769 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:18:37.437050 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d35fd5dd-7ed1-44c7-84cf-986481dd5769 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:18:37.441050 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:18:37.445163 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d35fd5dd-7ed1-44c7-84cf-986481dd5769 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:37.445690 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d35fd5dd-7ed1-44c7-84cf-986481dd5769 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:37.446132 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d35fd5dd-7ed1-44c7-84cf-986481dd5769 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:37.446840 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d35fd5dd-7ed1-44c7-84cf-986481dd5769 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:37.447295 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d35fd5dd-7ed1-44c7-84cf-986481dd5769 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:37.447752 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d35fd5dd-7ed1-44c7-84cf-986481dd5769 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:37.581636 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d35fd5dd-7ed1-44c7-84cf-986481dd5769 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:18:37.589513 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d35fd5dd-7ed1-44c7-84cf-986481dd5769 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a" status: 200 len: 1317 microversion: 2.1 time: 0.157807 Oct 30 02:18:37.590132 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3428/7190] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:18:37 2022] GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:18:38.614006 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0259feb0-b8cf-41b1-89ea-a377b0b3b214 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:18:38.614752 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0259feb0-b8cf-41b1-89ea-a377b0b3b214 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:18:38.621951 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0259feb0-b8cf-41b1-89ea-a377b0b3b214 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:38.622454 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0259feb0-b8cf-41b1-89ea-a377b0b3b214 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:38.622913 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0259feb0-b8cf-41b1-89ea-a377b0b3b214 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:38.623618 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0259feb0-b8cf-41b1-89ea-a377b0b3b214 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:38.624091 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0259feb0-b8cf-41b1-89ea-a377b0b3b214 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:38.624537 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0259feb0-b8cf-41b1-89ea-a377b0b3b214 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:38.760287 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0259feb0-b8cf-41b1-89ea-a377b0b3b214 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:18:38.768228 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0259feb0-b8cf-41b1-89ea-a377b0b3b214 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a" status: 200 len: 1317 microversion: 2.1 time: 0.159399 Oct 30 02:18:38.768806 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3763/7191] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:18:38 2022] GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:18:39.790837 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1f0f434a-d04a-41a3-8311-01f0e62ff632 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:18:39.791488 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1f0f434a-d04a-41a3-8311-01f0e62ff632 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:18:39.798475 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1f0f434a-d04a-41a3-8311-01f0e62ff632 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:39.798965 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1f0f434a-d04a-41a3-8311-01f0e62ff632 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:39.799402 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1f0f434a-d04a-41a3-8311-01f0e62ff632 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:39.800096 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1f0f434a-d04a-41a3-8311-01f0e62ff632 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:39.800552 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1f0f434a-d04a-41a3-8311-01f0e62ff632 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:39.800979 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1f0f434a-d04a-41a3-8311-01f0e62ff632 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:39.931859 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1f0f434a-d04a-41a3-8311-01f0e62ff632 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:18:39.940346 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1f0f434a-d04a-41a3-8311-01f0e62ff632 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a" status: 200 len: 1317 microversion: 2.1 time: 0.153434 Oct 30 02:18:39.940924 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3429/7192] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:18:39 2022] GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:18:40.963687 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e37370ea-7896-41c1-a3a4-84849746a7c7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:18:40.964317 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e37370ea-7896-41c1-a3a4-84849746a7c7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:18:40.970564 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e37370ea-7896-41c1-a3a4-84849746a7c7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:40.971062 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e37370ea-7896-41c1-a3a4-84849746a7c7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:40.971513 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e37370ea-7896-41c1-a3a4-84849746a7c7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:40.972215 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e37370ea-7896-41c1-a3a4-84849746a7c7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:40.972680 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e37370ea-7896-41c1-a3a4-84849746a7c7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:40.973118 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e37370ea-7896-41c1-a3a4-84849746a7c7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:41.100196 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e37370ea-7896-41c1-a3a4-84849746a7c7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:18:41.108774 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e37370ea-7896-41c1-a3a4-84849746a7c7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a" status: 200 len: 1317 microversion: 2.1 time: 0.149252 Oct 30 02:18:41.109353 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3764/7193] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:18:40 2022] GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:18:42.132397 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e6add934-9564-4e61-a68a-0a17984c0acc tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:18:42.132923 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e6add934-9564-4e61-a68a-0a17984c0acc tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:18:42.140412 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e6add934-9564-4e61-a68a-0a17984c0acc tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:42.140892 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e6add934-9564-4e61-a68a-0a17984c0acc tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:42.141325 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e6add934-9564-4e61-a68a-0a17984c0acc tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:42.142036 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e6add934-9564-4e61-a68a-0a17984c0acc tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:42.142488 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e6add934-9564-4e61-a68a-0a17984c0acc tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:42.142908 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e6add934-9564-4e61-a68a-0a17984c0acc tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:42.270101 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e6add934-9564-4e61-a68a-0a17984c0acc tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:18:42.278074 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e6add934-9564-4e61-a68a-0a17984c0acc tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a" status: 200 len: 1317 microversion: 2.1 time: 0.149738 Oct 30 02:18:42.278658 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3430/7194] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:18:42 2022] GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:18:43.300090 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a73eab9e-4802-4176-a921-f6b3df77eba9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:18:43.307235 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a73eab9e-4802-4176-a921-f6b3df77eba9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:18:43.307235 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:18:43.307235 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=6 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:18:43.308716 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a73eab9e-4802-4176-a921-f6b3df77eba9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:43.309210 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a73eab9e-4802-4176-a921-f6b3df77eba9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:43.309703 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a73eab9e-4802-4176-a921-f6b3df77eba9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:43.310466 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a73eab9e-4802-4176-a921-f6b3df77eba9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:43.310930 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a73eab9e-4802-4176-a921-f6b3df77eba9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:43.311617 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a73eab9e-4802-4176-a921-f6b3df77eba9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:43.406728 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-650283c5-2623-4fee-8ad0-df92effe0e31 req-bfbfa34b-f9d8-4b06-97b1-7c6c099534e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8530d205-5781-4ce6-bc77-fed36c2b597a", "name": "network-vif-plugged", "status": "completed", "tag": "8cd5be01-cd20-4303-b411-2d993a4dfb9f"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:18:43.412997 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=6 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:18:43.419937 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-650283c5-2623-4fee-8ad0-df92effe0e31 req-bfbfa34b-f9d8-4b06-97b1-7c6c099534e0 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:43.420427 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-650283c5-2623-4fee-8ad0-df92effe0e31 req-bfbfa34b-f9d8-4b06-97b1-7c6c099534e0 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:43.420865 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-650283c5-2623-4fee-8ad0-df92effe0e31 req-bfbfa34b-f9d8-4b06-97b1-7c6c099534e0 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:43.432551 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-650283c5-2623-4fee-8ad0-df92effe0e31 req-bfbfa34b-f9d8-4b06-97b1-7c6c099534e0 service nova] Creating event network-vif-plugged:8cd5be01-cd20-4303-b411-2d993a4dfb9f for instance 8530d205-5781-4ce6-bc77-fed36c2b597a on n-h1-master-1 Oct 30 02:18:43.438214 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-650283c5-2623-4fee-8ad0-df92effe0e31 req-bfbfa34b-f9d8-4b06-97b1-7c6c099534e0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036758 Oct 30 02:18:43.439246 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3431/7195] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:18:43.442522 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a73eab9e-4802-4176-a921-f6b3df77eba9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:18:43.450765 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a73eab9e-4802-4176-a921-f6b3df77eba9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a" status: 200 len: 1317 microversion: 2.1 time: 0.154580 Oct 30 02:18:43.451328 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3765/7196] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:18:43 2022] GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:18:44.475320 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-52fcbc90-1ebb-419f-9216-cb7bf916d9f5 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:18:44.476020 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-52fcbc90-1ebb-419f-9216-cb7bf916d9f5 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:18:44.483171 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52fcbc90-1ebb-419f-9216-cb7bf916d9f5 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:44.483652 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52fcbc90-1ebb-419f-9216-cb7bf916d9f5 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:44.484089 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52fcbc90-1ebb-419f-9216-cb7bf916d9f5 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:44.484770 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52fcbc90-1ebb-419f-9216-cb7bf916d9f5 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:44.485224 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52fcbc90-1ebb-419f-9216-cb7bf916d9f5 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:44.485669 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52fcbc90-1ebb-419f-9216-cb7bf916d9f5 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:44.618421 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-52fcbc90-1ebb-419f-9216-cb7bf916d9f5 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:18:44.626491 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-52fcbc90-1ebb-419f-9216-cb7bf916d9f5 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a" status: 200 len: 1317 microversion: 2.1 time: 0.156276 Oct 30 02:18:44.627070 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3432/7197] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:18:44 2022] GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:18:45.649476 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-da4749e4-6f8e-445b-bd45-14699d9ab4fa tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:18:45.650101 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-da4749e4-6f8e-445b-bd45-14699d9ab4fa tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:18:45.657511 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-da4749e4-6f8e-445b-bd45-14699d9ab4fa tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:45.657998 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-da4749e4-6f8e-445b-bd45-14699d9ab4fa tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:45.658445 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-da4749e4-6f8e-445b-bd45-14699d9ab4fa tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:45.659137 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-da4749e4-6f8e-445b-bd45-14699d9ab4fa tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:45.659595 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-da4749e4-6f8e-445b-bd45-14699d9ab4fa tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:45.660026 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-da4749e4-6f8e-445b-bd45-14699d9ab4fa tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:45.785663 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-da4749e4-6f8e-445b-bd45-14699d9ab4fa tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:18:45.793277 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-da4749e4-6f8e-445b-bd45-14699d9ab4fa tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a" status: 200 len: 1506 microversion: 2.1 time: 0.147735 Oct 30 02:18:45.793873 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3766/7198] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:18:45 2022] GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a => generated 1506 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:18:45.815363 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ec26453b-5040-45bd-a724-a095d503fda5 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:18:45.815985 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ec26453b-5040-45bd-a724-a095d503fda5 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:18:45.823303 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ec26453b-5040-45bd-a724-a095d503fda5 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:45.823729 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ec26453b-5040-45bd-a724-a095d503fda5 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:45.824170 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ec26453b-5040-45bd-a724-a095d503fda5 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:45.824863 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ec26453b-5040-45bd-a724-a095d503fda5 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:45.825319 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ec26453b-5040-45bd-a724-a095d503fda5 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:45.825768 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ec26453b-5040-45bd-a724-a095d503fda5 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:45.956337 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ec26453b-5040-45bd-a724-a095d503fda5 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:18:45.964168 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ec26453b-5040-45bd-a724-a095d503fda5 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a" status: 200 len: 1506 microversion: 2.1 time: 0.152929 Oct 30 02:18:45.964758 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3433/7199] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:18:45 2022] GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:18:45.985720 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6411ed74-99b8-42bd-8315-e814a758ac48 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:18:45.988086 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6411ed74-99b8-42bd-8315-e814a758ac48 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:18:45.993953 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6411ed74-99b8-42bd-8315-e814a758ac48 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:45.994442 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6411ed74-99b8-42bd-8315-e814a758ac48 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:45.995418 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6411ed74-99b8-42bd-8315-e814a758ac48 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:45.996112 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6411ed74-99b8-42bd-8315-e814a758ac48 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:45.996574 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6411ed74-99b8-42bd-8315-e814a758ac48 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:45.997008 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6411ed74-99b8-42bd-8315-e814a758ac48 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:46.024656 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6411ed74-99b8-42bd-8315-e814a758ac48 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:18:46.029956 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6411ed74-99b8-42bd-8315-e814a758ac48 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Old instance type m1.heat2, new instance type m1.heat {{(pid=121102) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 30 02:18:46.036318 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-6411ed74-99b8-42bd-8315-e814a758ac48 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 02:18:46.036746 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-6411ed74-99b8-42bd-8315-e814a758ac48 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 02:18:46.037227 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-6411ed74-99b8-42bd-8315-e814a758ac48 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 02:18:46.037670 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-6411ed74-99b8-42bd-8315-e814a758ac48 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 02:18:46.038092 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-6411ed74-99b8-42bd-8315-e814a758ac48 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 02:18:46.208242 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6411ed74-99b8-42bd-8315-e814a758ac48 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "POST /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a/action" status: 202 len: 0 microversion: 2.1 time: 0.226269 Oct 30 02:18:46.208852 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3767/7200] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 02:18:45 2022] POST /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 02:18:46.217247 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-94e53c3c-ac75-4e43-8c71-47e8bab10596 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:18:46.218000 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-94e53c3c-ac75-4e43-8c71-47e8bab10596 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:18:46.224043 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94e53c3c-ac75-4e43-8c71-47e8bab10596 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:46.224569 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94e53c3c-ac75-4e43-8c71-47e8bab10596 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:46.225005 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94e53c3c-ac75-4e43-8c71-47e8bab10596 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:46.225744 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94e53c3c-ac75-4e43-8c71-47e8bab10596 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:46.226221 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94e53c3c-ac75-4e43-8c71-47e8bab10596 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:46.226637 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94e53c3c-ac75-4e43-8c71-47e8bab10596 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:46.356993 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-94e53c3c-ac75-4e43-8c71-47e8bab10596 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:18:46.364955 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-94e53c3c-ac75-4e43-8c71-47e8bab10596 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a" status: 200 len: 1513 microversion: 2.1 time: 0.151829 Oct 30 02:18:46.365615 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3434/7201] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:18:46 2022] GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:18:47.389512 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-26f0b115-df33-4cee-98e7-2cbc2376bfa9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:18:47.390134 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-26f0b115-df33-4cee-98e7-2cbc2376bfa9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:18:47.399319 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-26f0b115-df33-4cee-98e7-2cbc2376bfa9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:47.399816 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-26f0b115-df33-4cee-98e7-2cbc2376bfa9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:47.400261 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-26f0b115-df33-4cee-98e7-2cbc2376bfa9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:47.400957 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-26f0b115-df33-4cee-98e7-2cbc2376bfa9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:47.401450 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-26f0b115-df33-4cee-98e7-2cbc2376bfa9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:47.401885 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-26f0b115-df33-4cee-98e7-2cbc2376bfa9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:47.539363 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-26f0b115-df33-4cee-98e7-2cbc2376bfa9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:18:47.548049 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-26f0b115-df33-4cee-98e7-2cbc2376bfa9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a" status: 200 len: 1513 microversion: 2.1 time: 0.163771 Oct 30 02:18:47.548649 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3768/7202] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:18:47 2022] GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:18:48.572392 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f2f208f8-83f0-418e-9c1f-60438319f3dd tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:18:48.573567 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f2f208f8-83f0-418e-9c1f-60438319f3dd tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:18:48.580254 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f2f208f8-83f0-418e-9c1f-60438319f3dd tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:48.580735 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f2f208f8-83f0-418e-9c1f-60438319f3dd tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:48.581170 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f2f208f8-83f0-418e-9c1f-60438319f3dd tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:48.581895 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f2f208f8-83f0-418e-9c1f-60438319f3dd tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:48.582351 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f2f208f8-83f0-418e-9c1f-60438319f3dd tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:48.582774 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f2f208f8-83f0-418e-9c1f-60438319f3dd tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:48.712214 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f2f208f8-83f0-418e-9c1f-60438319f3dd tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:18:48.720841 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f2f208f8-83f0-418e-9c1f-60438319f3dd tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a" status: 200 len: 1513 microversion: 2.1 time: 0.152383 Oct 30 02:18:48.721624 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3435/7203] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:18:48 2022] GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:18:49.743266 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-acd60d70-f868-446b-a57e-e7a5c203273a tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:18:49.743889 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-acd60d70-f868-446b-a57e-e7a5c203273a tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:18:49.750704 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-acd60d70-f868-446b-a57e-e7a5c203273a tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:49.751194 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-acd60d70-f868-446b-a57e-e7a5c203273a tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:49.751646 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-acd60d70-f868-446b-a57e-e7a5c203273a tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:49.752341 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-acd60d70-f868-446b-a57e-e7a5c203273a tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:49.752804 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-acd60d70-f868-446b-a57e-e7a5c203273a tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:49.753242 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-acd60d70-f868-446b-a57e-e7a5c203273a tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:49.885730 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-acd60d70-f868-446b-a57e-e7a5c203273a tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:18:49.893476 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-acd60d70-f868-446b-a57e-e7a5c203273a tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a" status: 200 len: 1518 microversion: 2.1 time: 0.154075 Oct 30 02:18:49.894261 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3769/7204] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:18:49 2022] GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:18:50.917405 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2eb7557d-5963-4cdb-976f-b35f288bb8d2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:18:50.918040 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2eb7557d-5963-4cdb-976f-b35f288bb8d2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:18:50.925075 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2eb7557d-5963-4cdb-976f-b35f288bb8d2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:50.925600 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2eb7557d-5963-4cdb-976f-b35f288bb8d2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:50.926089 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2eb7557d-5963-4cdb-976f-b35f288bb8d2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:50.926793 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2eb7557d-5963-4cdb-976f-b35f288bb8d2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:50.927253 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2eb7557d-5963-4cdb-976f-b35f288bb8d2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:50.927683 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2eb7557d-5963-4cdb-976f-b35f288bb8d2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:51.060063 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2eb7557d-5963-4cdb-976f-b35f288bb8d2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:18:51.068155 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2eb7557d-5963-4cdb-976f-b35f288bb8d2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a" status: 200 len: 1518 microversion: 2.1 time: 0.155180 Oct 30 02:18:51.068739 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3436/7205] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:18:50 2022] GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:18:52.090173 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a879c78b-764d-40eb-a3be-2ae7bc4223b2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:18:52.090823 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a879c78b-764d-40eb-a3be-2ae7bc4223b2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:18:52.097666 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a879c78b-764d-40eb-a3be-2ae7bc4223b2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:52.098155 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a879c78b-764d-40eb-a3be-2ae7bc4223b2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:52.098597 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a879c78b-764d-40eb-a3be-2ae7bc4223b2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:52.099293 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a879c78b-764d-40eb-a3be-2ae7bc4223b2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:52.099755 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a879c78b-764d-40eb-a3be-2ae7bc4223b2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:52.100184 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a879c78b-764d-40eb-a3be-2ae7bc4223b2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:52.226775 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a879c78b-764d-40eb-a3be-2ae7bc4223b2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:18:52.235157 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a879c78b-764d-40eb-a3be-2ae7bc4223b2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a" status: 200 len: 1518 microversion: 2.1 time: 0.148895 Oct 30 02:18:52.235733 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3770/7206] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:18:52 2022] GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a => generated 1518 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:18:53.258059 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0ec6dfbd-4ba5-4bdd-9540-ce5728b92f8b tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:18:53.258806 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0ec6dfbd-4ba5-4bdd-9540-ce5728b92f8b tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:18:53.266140 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0ec6dfbd-4ba5-4bdd-9540-ce5728b92f8b tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:53.266631 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0ec6dfbd-4ba5-4bdd-9540-ce5728b92f8b tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:53.267103 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0ec6dfbd-4ba5-4bdd-9540-ce5728b92f8b tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:53.267810 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0ec6dfbd-4ba5-4bdd-9540-ce5728b92f8b tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:53.268266 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0ec6dfbd-4ba5-4bdd-9540-ce5728b92f8b tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:53.268745 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0ec6dfbd-4ba5-4bdd-9540-ce5728b92f8b tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:53.397170 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0ec6dfbd-4ba5-4bdd-9540-ce5728b92f8b tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:18:53.404944 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0ec6dfbd-4ba5-4bdd-9540-ce5728b92f8b tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a" status: 200 len: 1518 microversion: 2.1 time: 0.150944 Oct 30 02:18:53.405551 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3437/7207] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:18:53 2022] GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a => generated 1518 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:18:54.427981 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-18beb914-fb3e-44c2-bc54-38ab4f9f903f tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:18:54.428600 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-18beb914-fb3e-44c2-bc54-38ab4f9f903f tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:18:54.435495 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-18beb914-fb3e-44c2-bc54-38ab4f9f903f tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:54.436234 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-18beb914-fb3e-44c2-bc54-38ab4f9f903f tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:54.436676 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-18beb914-fb3e-44c2-bc54-38ab4f9f903f tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:54.437403 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-18beb914-fb3e-44c2-bc54-38ab4f9f903f tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:54.437864 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-18beb914-fb3e-44c2-bc54-38ab4f9f903f tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:54.438296 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-18beb914-fb3e-44c2-bc54-38ab4f9f903f tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:54.568146 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-18beb914-fb3e-44c2-bc54-38ab4f9f903f tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:18:54.576358 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-18beb914-fb3e-44c2-bc54-38ab4f9f903f tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a" status: 200 len: 1518 microversion: 2.1 time: 0.152337 Oct 30 02:18:54.576923 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3771/7208] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:18:54 2022] GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a => generated 1518 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:18:55.600450 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-48c1eb8c-8376-49ec-a0cb-fa09d773010c tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:18:55.601062 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-48c1eb8c-8376-49ec-a0cb-fa09d773010c tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:18:55.607947 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-48c1eb8c-8376-49ec-a0cb-fa09d773010c tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:55.608429 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-48c1eb8c-8376-49ec-a0cb-fa09d773010c tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:55.608869 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-48c1eb8c-8376-49ec-a0cb-fa09d773010c tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:55.609577 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-48c1eb8c-8376-49ec-a0cb-fa09d773010c tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:55.610029 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-48c1eb8c-8376-49ec-a0cb-fa09d773010c tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:55.610452 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-48c1eb8c-8376-49ec-a0cb-fa09d773010c tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:55.753478 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-48c1eb8c-8376-49ec-a0cb-fa09d773010c tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:18:55.761813 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-48c1eb8c-8376-49ec-a0cb-fa09d773010c tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a" status: 200 len: 1518 microversion: 2.1 time: 0.165310 Oct 30 02:18:55.762396 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3438/7209] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:18:55 2022] GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a => generated 1518 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:18:56.785360 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1233d581-59ed-489c-9170-18707e34db79 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:18:56.785999 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1233d581-59ed-489c-9170-18707e34db79 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:18:56.793303 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1233d581-59ed-489c-9170-18707e34db79 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:56.793820 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1233d581-59ed-489c-9170-18707e34db79 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:56.794263 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1233d581-59ed-489c-9170-18707e34db79 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:56.794965 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1233d581-59ed-489c-9170-18707e34db79 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:56.795430 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1233d581-59ed-489c-9170-18707e34db79 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:56.795863 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1233d581-59ed-489c-9170-18707e34db79 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:56.924713 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1233d581-59ed-489c-9170-18707e34db79 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:18:56.933018 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1233d581-59ed-489c-9170-18707e34db79 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a" status: 200 len: 1518 microversion: 2.1 time: 0.151676 Oct 30 02:18:56.933614 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3772/7210] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:18:56 2022] GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a => generated 1518 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:18:57.956210 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cb1708cf-1ae1-4fc5-bfe0-aad26450c583 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:18:57.956832 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-cb1708cf-1ae1-4fc5-bfe0-aad26450c583 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:18:57.964419 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cb1708cf-1ae1-4fc5-bfe0-aad26450c583 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:57.965050 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cb1708cf-1ae1-4fc5-bfe0-aad26450c583 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:57.965541 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cb1708cf-1ae1-4fc5-bfe0-aad26450c583 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:57.966257 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cb1708cf-1ae1-4fc5-bfe0-aad26450c583 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:57.966716 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cb1708cf-1ae1-4fc5-bfe0-aad26450c583 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:57.967148 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cb1708cf-1ae1-4fc5-bfe0-aad26450c583 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:58.102786 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-cb1708cf-1ae1-4fc5-bfe0-aad26450c583 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:18:58.110874 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cb1708cf-1ae1-4fc5-bfe0-aad26450c583 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a" status: 200 len: 1518 microversion: 2.1 time: 0.158575 Oct 30 02:18:58.111468 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3439/7211] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:18:57 2022] GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:18:59.134406 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2c6a5eef-c934-4782-99e5-81b17cc5a3d0 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:18:59.135032 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2c6a5eef-c934-4782-99e5-81b17cc5a3d0 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:18:59.141945 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2c6a5eef-c934-4782-99e5-81b17cc5a3d0 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:59.142452 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2c6a5eef-c934-4782-99e5-81b17cc5a3d0 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:59.142904 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2c6a5eef-c934-4782-99e5-81b17cc5a3d0 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:59.143622 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2c6a5eef-c934-4782-99e5-81b17cc5a3d0 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:18:59.144091 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2c6a5eef-c934-4782-99e5-81b17cc5a3d0 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:18:59.144536 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2c6a5eef-c934-4782-99e5-81b17cc5a3d0 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:18:59.275091 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2c6a5eef-c934-4782-99e5-81b17cc5a3d0 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:18:59.282929 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2c6a5eef-c934-4782-99e5-81b17cc5a3d0 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a" status: 200 len: 1518 microversion: 2.1 time: 0.152452 Oct 30 02:18:59.283510 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3773/7212] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:18:59 2022] GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:19:00.307467 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-04e8d0ab-23df-4243-a475-dcb4a3d8f96c tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:19:00.308119 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-04e8d0ab-23df-4243-a475-dcb4a3d8f96c tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:19:00.315349 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-04e8d0ab-23df-4243-a475-dcb4a3d8f96c tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:00.315841 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-04e8d0ab-23df-4243-a475-dcb4a3d8f96c tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:00.316285 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-04e8d0ab-23df-4243-a475-dcb4a3d8f96c tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:00.316999 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-04e8d0ab-23df-4243-a475-dcb4a3d8f96c tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:00.317503 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-04e8d0ab-23df-4243-a475-dcb4a3d8f96c tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:00.317939 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-04e8d0ab-23df-4243-a475-dcb4a3d8f96c tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:00.449377 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-04e8d0ab-23df-4243-a475-dcb4a3d8f96c tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:19:00.457121 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-04e8d0ab-23df-4243-a475-dcb4a3d8f96c tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a" status: 200 len: 1518 microversion: 2.1 time: 0.154308 Oct 30 02:19:00.457732 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3440/7213] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:19:00 2022] GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:19:01.479999 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8f968d7d-a5c9-41db-8bbc-9465bce9d50d tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:19:01.480651 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8f968d7d-a5c9-41db-8bbc-9465bce9d50d tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:19:01.487539 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8f968d7d-a5c9-41db-8bbc-9465bce9d50d tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:01.488036 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8f968d7d-a5c9-41db-8bbc-9465bce9d50d tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:01.488486 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8f968d7d-a5c9-41db-8bbc-9465bce9d50d tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:01.489190 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8f968d7d-a5c9-41db-8bbc-9465bce9d50d tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:01.489684 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8f968d7d-a5c9-41db-8bbc-9465bce9d50d tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:01.490125 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8f968d7d-a5c9-41db-8bbc-9465bce9d50d tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:01.626606 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8f968d7d-a5c9-41db-8bbc-9465bce9d50d tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:19:01.634446 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8f968d7d-a5c9-41db-8bbc-9465bce9d50d tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a" status: 200 len: 1518 microversion: 2.1 time: 0.158862 Oct 30 02:19:01.635036 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3774/7214] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:19:01 2022] GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:19:02.657575 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0d5d16d6-6e2d-47d3-a5fb-2821d5d3b29a tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:19:02.658213 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0d5d16d6-6e2d-47d3-a5fb-2821d5d3b29a tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:19:02.665027 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d5d16d6-6e2d-47d3-a5fb-2821d5d3b29a tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:02.665549 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d5d16d6-6e2d-47d3-a5fb-2821d5d3b29a tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:02.665997 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d5d16d6-6e2d-47d3-a5fb-2821d5d3b29a tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:02.666700 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d5d16d6-6e2d-47d3-a5fb-2821d5d3b29a tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:02.667158 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d5d16d6-6e2d-47d3-a5fb-2821d5d3b29a tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:02.667590 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d5d16d6-6e2d-47d3-a5fb-2821d5d3b29a tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:02.801872 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0d5d16d6-6e2d-47d3-a5fb-2821d5d3b29a tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:19:02.810006 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0d5d16d6-6e2d-47d3-a5fb-2821d5d3b29a tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a" status: 200 len: 1518 microversion: 2.1 time: 0.156421 Oct 30 02:19:02.811027 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3441/7215] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:19:02 2022] GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:19:03.833862 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7d520dcd-7199-4ba6-8c86-b2dd57eb761d tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:19:03.834490 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7d520dcd-7199-4ba6-8c86-b2dd57eb761d tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:19:03.841304 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7d520dcd-7199-4ba6-8c86-b2dd57eb761d tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:03.841836 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7d520dcd-7199-4ba6-8c86-b2dd57eb761d tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:03.842284 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7d520dcd-7199-4ba6-8c86-b2dd57eb761d tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:03.842991 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7d520dcd-7199-4ba6-8c86-b2dd57eb761d tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:03.843454 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7d520dcd-7199-4ba6-8c86-b2dd57eb761d tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:03.843888 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7d520dcd-7199-4ba6-8c86-b2dd57eb761d tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:03.972878 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7d520dcd-7199-4ba6-8c86-b2dd57eb761d tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:19:03.981371 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7d520dcd-7199-4ba6-8c86-b2dd57eb761d tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a" status: 200 len: 1518 microversion: 2.1 time: 0.151454 Oct 30 02:19:03.981935 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3775/7216] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:19:03 2022] GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a => generated 1518 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:19:05.004412 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c095787e-1cb2-4cb8-95ae-25bc3bef6a25 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:19:05.005104 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c095787e-1cb2-4cb8-95ae-25bc3bef6a25 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:19:05.011672 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c095787e-1cb2-4cb8-95ae-25bc3bef6a25 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:05.012169 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c095787e-1cb2-4cb8-95ae-25bc3bef6a25 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:05.012611 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c095787e-1cb2-4cb8-95ae-25bc3bef6a25 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:05.013307 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c095787e-1cb2-4cb8-95ae-25bc3bef6a25 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:05.013788 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c095787e-1cb2-4cb8-95ae-25bc3bef6a25 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:05.014216 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c095787e-1cb2-4cb8-95ae-25bc3bef6a25 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:05.143751 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c095787e-1cb2-4cb8-95ae-25bc3bef6a25 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:19:05.151750 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c095787e-1cb2-4cb8-95ae-25bc3bef6a25 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a" status: 200 len: 1518 microversion: 2.1 time: 0.151368 Oct 30 02:19:05.152270 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3442/7217] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:19:04 2022] GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a => generated 1518 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:19:06.176409 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4a93b24e-c7c4-49ef-a024-8b2fcab5d508 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:19:06.177064 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4a93b24e-c7c4-49ef-a024-8b2fcab5d508 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:19:06.184145 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a93b24e-c7c4-49ef-a024-8b2fcab5d508 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:06.184646 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a93b24e-c7c4-49ef-a024-8b2fcab5d508 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:06.185099 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a93b24e-c7c4-49ef-a024-8b2fcab5d508 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:06.186090 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a93b24e-c7c4-49ef-a024-8b2fcab5d508 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:06.186593 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a93b24e-c7c4-49ef-a024-8b2fcab5d508 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:06.187038 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a93b24e-c7c4-49ef-a024-8b2fcab5d508 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:06.191010 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:19:06.323556 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4a93b24e-c7c4-49ef-a024-8b2fcab5d508 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:19:06.331322 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4a93b24e-c7c4-49ef-a024-8b2fcab5d508 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a" status: 200 len: 1518 microversion: 2.1 time: 0.158824 Oct 30 02:19:06.331901 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3776/7218] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:19:06 2022] GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:19:07.354354 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9dc55882-aacc-4156-aa56-cf21ed77b49c tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:19:07.354973 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9dc55882-aacc-4156-aa56-cf21ed77b49c tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:19:07.362243 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9dc55882-aacc-4156-aa56-cf21ed77b49c tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:07.362734 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9dc55882-aacc-4156-aa56-cf21ed77b49c tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:07.363174 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9dc55882-aacc-4156-aa56-cf21ed77b49c tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:07.363883 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9dc55882-aacc-4156-aa56-cf21ed77b49c tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:07.364375 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9dc55882-aacc-4156-aa56-cf21ed77b49c tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:07.365107 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9dc55882-aacc-4156-aa56-cf21ed77b49c tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:07.501433 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9dc55882-aacc-4156-aa56-cf21ed77b49c tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:19:07.509213 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9dc55882-aacc-4156-aa56-cf21ed77b49c tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a" status: 200 len: 1518 microversion: 2.1 time: 0.159339 Oct 30 02:19:07.509990 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3443/7219] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:19:07 2022] GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:19:08.532123 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-001da766-b14b-4b8f-8cd1-d19ccf13c4e2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:19:08.532785 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-001da766-b14b-4b8f-8cd1-d19ccf13c4e2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:19:08.539765 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-001da766-b14b-4b8f-8cd1-d19ccf13c4e2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:08.540268 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-001da766-b14b-4b8f-8cd1-d19ccf13c4e2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:08.540720 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-001da766-b14b-4b8f-8cd1-d19ccf13c4e2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:08.541469 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-001da766-b14b-4b8f-8cd1-d19ccf13c4e2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:08.541944 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-001da766-b14b-4b8f-8cd1-d19ccf13c4e2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:08.542387 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-001da766-b14b-4b8f-8cd1-d19ccf13c4e2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:08.676245 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-001da766-b14b-4b8f-8cd1-d19ccf13c4e2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:19:08.684844 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-001da766-b14b-4b8f-8cd1-d19ccf13c4e2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a" status: 200 len: 1518 microversion: 2.1 time: 0.156696 Oct 30 02:19:08.685700 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3777/7220] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:19:08 2022] GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:19:09.709017 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-14344860-e269-443e-b91f-2b85bb641790 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:19:09.709681 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-14344860-e269-443e-b91f-2b85bb641790 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:19:09.713047 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=32 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:19:09.717791 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14344860-e269-443e-b91f-2b85bb641790 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:09.723628 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14344860-e269-443e-b91f-2b85bb641790 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:09.723628 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14344860-e269-443e-b91f-2b85bb641790 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:09.723628 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14344860-e269-443e-b91f-2b85bb641790 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:09.723628 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14344860-e269-443e-b91f-2b85bb641790 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:09.723628 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14344860-e269-443e-b91f-2b85bb641790 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:09.723628 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=94 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:19:09.848952 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-14344860-e269-443e-b91f-2b85bb641790 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:19:09.856837 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-14344860-e269-443e-b91f-2b85bb641790 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a" status: 200 len: 1518 microversion: 2.1 time: 0.151784 Oct 30 02:19:09.857446 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3444/7221] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:19:09 2022] GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a => generated 1518 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:19:10.880286 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-50464d4a-aafb-4b19-981f-db7fce161f09 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:19:10.880941 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-50464d4a-aafb-4b19-981f-db7fce161f09 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:19:10.883195 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=36 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:19:10.888511 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-50464d4a-aafb-4b19-981f-db7fce161f09 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:10.889009 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-50464d4a-aafb-4b19-981f-db7fce161f09 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:10.889488 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-50464d4a-aafb-4b19-981f-db7fce161f09 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:10.890208 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-50464d4a-aafb-4b19-981f-db7fce161f09 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:10.890679 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-50464d4a-aafb-4b19-981f-db7fce161f09 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:10.891115 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-50464d4a-aafb-4b19-981f-db7fce161f09 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:11.028927 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-50464d4a-aafb-4b19-981f-db7fce161f09 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:19:11.036659 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-50464d4a-aafb-4b19-981f-db7fce161f09 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a" status: 200 len: 1518 microversion: 2.1 time: 0.160274 Oct 30 02:19:11.037227 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3778/7222] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:19:10 2022] GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:19:12.060546 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-73744d9b-5d48-4906-a3c4-3ca4788629a3 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:19:12.061168 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-73744d9b-5d48-4906-a3c4-3ca4788629a3 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:19:12.068133 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-73744d9b-5d48-4906-a3c4-3ca4788629a3 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:12.068620 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-73744d9b-5d48-4906-a3c4-3ca4788629a3 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:12.069065 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-73744d9b-5d48-4906-a3c4-3ca4788629a3 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:12.069794 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-73744d9b-5d48-4906-a3c4-3ca4788629a3 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:12.070254 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-73744d9b-5d48-4906-a3c4-3ca4788629a3 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:12.070683 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-73744d9b-5d48-4906-a3c4-3ca4788629a3 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:12.203050 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-73744d9b-5d48-4906-a3c4-3ca4788629a3 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:19:12.210949 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-73744d9b-5d48-4906-a3c4-3ca4788629a3 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a" status: 200 len: 1518 microversion: 2.1 time: 0.155382 Oct 30 02:19:12.211541 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3445/7223] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:19:12 2022] GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:19:13.235483 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-16096cd2-a13a-4be8-9a85-bef558c82891 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:19:13.236111 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-16096cd2-a13a-4be8-9a85-bef558c82891 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:19:13.242952 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-16096cd2-a13a-4be8-9a85-bef558c82891 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:13.247222 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-16096cd2-a13a-4be8-9a85-bef558c82891 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:13.247222 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-16096cd2-a13a-4be8-9a85-bef558c82891 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:13.247222 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-16096cd2-a13a-4be8-9a85-bef558c82891 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:13.247222 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-16096cd2-a13a-4be8-9a85-bef558c82891 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:13.247222 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-16096cd2-a13a-4be8-9a85-bef558c82891 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:13.377010 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-16096cd2-a13a-4be8-9a85-bef558c82891 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:19:13.385257 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-16096cd2-a13a-4be8-9a85-bef558c82891 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a" status: 200 len: 1518 microversion: 2.1 time: 0.154118 Oct 30 02:19:13.385872 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3779/7224] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:19:13 2022] GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:19:14.408226 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-553f0d6b-f78f-43ad-9c9b-61493a652aba tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:19:14.408902 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-553f0d6b-f78f-43ad-9c9b-61493a652aba tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:19:14.416534 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-553f0d6b-f78f-43ad-9c9b-61493a652aba tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:14.417026 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-553f0d6b-f78f-43ad-9c9b-61493a652aba tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:14.417489 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-553f0d6b-f78f-43ad-9c9b-61493a652aba tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:14.418190 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-553f0d6b-f78f-43ad-9c9b-61493a652aba tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:14.418643 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-553f0d6b-f78f-43ad-9c9b-61493a652aba tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:14.419072 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-553f0d6b-f78f-43ad-9c9b-61493a652aba tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:14.551770 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-553f0d6b-f78f-43ad-9c9b-61493a652aba tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:19:14.559741 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-553f0d6b-f78f-43ad-9c9b-61493a652aba tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a" status: 200 len: 1518 microversion: 2.1 time: 0.155420 Oct 30 02:19:14.560664 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3446/7225] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:19:14 2022] GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:19:15.583637 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7b8846e5-33bc-4396-a36d-c05bec201565 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:19:15.584302 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7b8846e5-33bc-4396-a36d-c05bec201565 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:19:15.591170 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b8846e5-33bc-4396-a36d-c05bec201565 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:15.591665 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b8846e5-33bc-4396-a36d-c05bec201565 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:15.592110 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b8846e5-33bc-4396-a36d-c05bec201565 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:15.592823 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b8846e5-33bc-4396-a36d-c05bec201565 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:15.593283 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b8846e5-33bc-4396-a36d-c05bec201565 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:15.593746 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b8846e5-33bc-4396-a36d-c05bec201565 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:15.725493 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7b8846e5-33bc-4396-a36d-c05bec201565 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:19:15.733654 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7b8846e5-33bc-4396-a36d-c05bec201565 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a" status: 200 len: 1518 microversion: 2.1 time: 0.153939 Oct 30 02:19:15.734220 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3780/7226] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:19:15 2022] GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:19:16.757982 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bd3732a1-d4f3-4707-a161-dc88a9dfd989 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:19:16.758601 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-bd3732a1-d4f3-4707-a161-dc88a9dfd989 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:19:16.766124 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd3732a1-d4f3-4707-a161-dc88a9dfd989 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:16.766618 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd3732a1-d4f3-4707-a161-dc88a9dfd989 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:16.767065 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd3732a1-d4f3-4707-a161-dc88a9dfd989 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:16.767780 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd3732a1-d4f3-4707-a161-dc88a9dfd989 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:16.768245 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd3732a1-d4f3-4707-a161-dc88a9dfd989 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:16.768681 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd3732a1-d4f3-4707-a161-dc88a9dfd989 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:16.897324 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-bd3732a1-d4f3-4707-a161-dc88a9dfd989 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:19:16.905479 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bd3732a1-d4f3-4707-a161-dc88a9dfd989 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a" status: 200 len: 1518 microversion: 2.1 time: 0.151385 Oct 30 02:19:16.906038 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3447/7227] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:19:16 2022] GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a => generated 1518 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:19:17.928121 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7316ba6b-a917-4810-9845-6a7ff9488ec7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:19:17.930774 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7316ba6b-a917-4810-9845-6a7ff9488ec7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:19:17.935936 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7316ba6b-a917-4810-9845-6a7ff9488ec7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:17.936429 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7316ba6b-a917-4810-9845-6a7ff9488ec7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:17.936875 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7316ba6b-a917-4810-9845-6a7ff9488ec7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:17.937635 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7316ba6b-a917-4810-9845-6a7ff9488ec7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:17.938070 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7316ba6b-a917-4810-9845-6a7ff9488ec7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:17.938507 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7316ba6b-a917-4810-9845-6a7ff9488ec7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:18.069186 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7316ba6b-a917-4810-9845-6a7ff9488ec7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:19:18.077368 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7316ba6b-a917-4810-9845-6a7ff9488ec7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a" status: 200 len: 1518 microversion: 2.1 time: 0.153180 Oct 30 02:19:18.077938 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3781/7228] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:19:17 2022] GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:19:19.100433 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b7a3228d-7d26-47df-859b-de71c7a56578 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:19:19.101049 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b7a3228d-7d26-47df-859b-de71c7a56578 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:19:19.108177 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b7a3228d-7d26-47df-859b-de71c7a56578 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:19.108702 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b7a3228d-7d26-47df-859b-de71c7a56578 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:19.109144 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b7a3228d-7d26-47df-859b-de71c7a56578 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:19.109891 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b7a3228d-7d26-47df-859b-de71c7a56578 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:19.110353 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b7a3228d-7d26-47df-859b-de71c7a56578 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:19.110806 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b7a3228d-7d26-47df-859b-de71c7a56578 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:19.501631 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b7a3228d-7d26-47df-859b-de71c7a56578 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:19:19.509462 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b7a3228d-7d26-47df-859b-de71c7a56578 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a" status: 200 len: 1518 microversion: 2.1 time: 0.412973 Oct 30 02:19:19.510034 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3448/7229] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:19:19 2022] GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a => generated 1518 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:19:20.536935 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c83564ba-a5cc-492f-b898-6a2ac57cdcf7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:19:20.537531 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c83564ba-a5cc-492f-b898-6a2ac57cdcf7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:19:20.544451 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c83564ba-a5cc-492f-b898-6a2ac57cdcf7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:20.544952 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c83564ba-a5cc-492f-b898-6a2ac57cdcf7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:20.545432 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c83564ba-a5cc-492f-b898-6a2ac57cdcf7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:20.546142 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c83564ba-a5cc-492f-b898-6a2ac57cdcf7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:20.546612 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c83564ba-a5cc-492f-b898-6a2ac57cdcf7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:20.547050 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c83564ba-a5cc-492f-b898-6a2ac57cdcf7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:20.678944 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c83564ba-a5cc-492f-b898-6a2ac57cdcf7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:19:20.687533 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c83564ba-a5cc-492f-b898-6a2ac57cdcf7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a" status: 200 len: 1518 microversion: 2.1 time: 0.154585 Oct 30 02:19:20.688106 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3782/7230] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:19:20 2022] GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:19:21.712302 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-efabaeae-130b-4fca-ae99-56e98bba1bf8 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:19:21.712999 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-efabaeae-130b-4fca-ae99-56e98bba1bf8 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:19:21.719831 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-efabaeae-130b-4fca-ae99-56e98bba1bf8 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:21.720411 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-efabaeae-130b-4fca-ae99-56e98bba1bf8 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:21.720854 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-efabaeae-130b-4fca-ae99-56e98bba1bf8 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:21.721576 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-efabaeae-130b-4fca-ae99-56e98bba1bf8 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:21.722031 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-efabaeae-130b-4fca-ae99-56e98bba1bf8 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:21.722482 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-efabaeae-130b-4fca-ae99-56e98bba1bf8 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:21.963559 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-efabaeae-130b-4fca-ae99-56e98bba1bf8 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:19:21.971383 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-efabaeae-130b-4fca-ae99-56e98bba1bf8 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a" status: 200 len: 1517 microversion: 2.1 time: 0.264111 Oct 30 02:19:21.971901 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3449/7231] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:19:21 2022] GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a => generated 1517 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:19:22.060585 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-d9e3c365-f919-413c-bd1b-0e2ec1c8153a req-6aea59fa-8129-4191-aef9-dcbe4c7a67d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8530d205-5781-4ce6-bc77-fed36c2b597a", "name": "network-vif-unplugged", "status": "completed", "tag": "8cd5be01-cd20-4303-b411-2d993a4dfb9f"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:19:22.070715 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-d9e3c365-f919-413c-bd1b-0e2ec1c8153a req-6aea59fa-8129-4191-aef9-dcbe4c7a67d0 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:22.071809 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-d9e3c365-f919-413c-bd1b-0e2ec1c8153a req-6aea59fa-8129-4191-aef9-dcbe4c7a67d0 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:22.072246 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-d9e3c365-f919-413c-bd1b-0e2ec1c8153a req-6aea59fa-8129-4191-aef9-dcbe4c7a67d0 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:22.083756 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-d9e3c365-f919-413c-bd1b-0e2ec1c8153a req-6aea59fa-8129-4191-aef9-dcbe4c7a67d0 service nova] Creating event network-vif-unplugged:8cd5be01-cd20-4303-b411-2d993a4dfb9f for instance 8530d205-5781-4ce6-bc77-fed36c2b597a on n-h2-master-1 Oct 30 02:19:22.089039 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [req-d9e3c365-f919-413c-bd1b-0e2ec1c8153a req-6aea59fa-8129-4191-aef9-dcbe4c7a67d0 service nova] Instance 8530d205-5781-4ce6-bc77-fed36c2b597a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=121102) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 30 02:19:22.100035 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-d9e3c365-f919-413c-bd1b-0e2ec1c8153a req-6aea59fa-8129-4191-aef9-dcbe4c7a67d0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043383 Oct 30 02:19:22.100631 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3783/7232] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:19:22.994790 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d07e3b32-f5fc-49e8-852b-59525230e6bd tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:19:22.995474 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d07e3b32-f5fc-49e8-852b-59525230e6bd tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:19:23.002480 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d07e3b32-f5fc-49e8-852b-59525230e6bd tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:23.002974 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d07e3b32-f5fc-49e8-852b-59525230e6bd tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:23.003446 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d07e3b32-f5fc-49e8-852b-59525230e6bd tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:23.004154 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d07e3b32-f5fc-49e8-852b-59525230e6bd tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:23.004617 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d07e3b32-f5fc-49e8-852b-59525230e6bd tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:23.005051 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d07e3b32-f5fc-49e8-852b-59525230e6bd tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:23.144322 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d07e3b32-f5fc-49e8-852b-59525230e6bd tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:19:23.152656 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d07e3b32-f5fc-49e8-852b-59525230e6bd tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a" status: 200 len: 1517 microversion: 2.1 time: 0.161892 Oct 30 02:19:23.153235 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3450/7233] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:19:22 2022] GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a => generated 1517 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:19:24.116562 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-2d168698-6e26-4591-aae1-264fdf3ccf45 req-f9b9b7b5-30a6-4279-a6d3-8dda04326f8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8530d205-5781-4ce6-bc77-fed36c2b597a", "tag": "8cd5be01-cd20-4303-b411-2d993a4dfb9f"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:19:24.126582 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-2d168698-6e26-4591-aae1-264fdf3ccf45 req-f9b9b7b5-30a6-4279-a6d3-8dda04326f8a service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:24.127072 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-2d168698-6e26-4591-aae1-264fdf3ccf45 req-f9b9b7b5-30a6-4279-a6d3-8dda04326f8a service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:24.127514 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-2d168698-6e26-4591-aae1-264fdf3ccf45 req-f9b9b7b5-30a6-4279-a6d3-8dda04326f8a service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:24.138816 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-2d168698-6e26-4591-aae1-264fdf3ccf45 req-f9b9b7b5-30a6-4279-a6d3-8dda04326f8a service nova] Creating event network-changed:8cd5be01-cd20-4303-b411-2d993a4dfb9f for instance 8530d205-5781-4ce6-bc77-fed36c2b597a on n-h2-master-1 Oct 30 02:19:24.144014 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [req-2d168698-6e26-4591-aae1-264fdf3ccf45 req-f9b9b7b5-30a6-4279-a6d3-8dda04326f8a service nova] Instance 8530d205-5781-4ce6-bc77-fed36c2b597a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=121102) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 30 02:19:24.154951 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-2d168698-6e26-4591-aae1-264fdf3ccf45 req-f9b9b7b5-30a6-4279-a6d3-8dda04326f8a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043465 Oct 30 02:19:24.155482 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3784/7234] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:19:24.175473 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d0590482-56ce-4090-9b12-774fa94995a2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:19:24.176755 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d0590482-56ce-4090-9b12-774fa94995a2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:19:24.183840 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d0590482-56ce-4090-9b12-774fa94995a2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:24.187040 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d0590482-56ce-4090-9b12-774fa94995a2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:24.187040 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d0590482-56ce-4090-9b12-774fa94995a2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:24.187040 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d0590482-56ce-4090-9b12-774fa94995a2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:24.187040 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d0590482-56ce-4090-9b12-774fa94995a2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:24.187040 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d0590482-56ce-4090-9b12-774fa94995a2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:24.327451 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d0590482-56ce-4090-9b12-774fa94995a2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:19:24.335342 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d0590482-56ce-4090-9b12-774fa94995a2 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a" status: 200 len: 1515 microversion: 2.1 time: 0.163741 Oct 30 02:19:24.335926 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3451/7235] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:19:24 2022] GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:19:25.360868 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ff3cec85-b4e6-4c7f-8593-90c93cc62826 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:19:25.361536 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ff3cec85-b4e6-4c7f-8593-90c93cc62826 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:19:25.367749 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ff3cec85-b4e6-4c7f-8593-90c93cc62826 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:25.368824 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ff3cec85-b4e6-4c7f-8593-90c93cc62826 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:25.369465 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ff3cec85-b4e6-4c7f-8593-90c93cc62826 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:25.370002 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ff3cec85-b4e6-4c7f-8593-90c93cc62826 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:25.370469 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ff3cec85-b4e6-4c7f-8593-90c93cc62826 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:25.370911 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ff3cec85-b4e6-4c7f-8593-90c93cc62826 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:25.499673 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ff3cec85-b4e6-4c7f-8593-90c93cc62826 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:19:25.507300 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ff3cec85-b4e6-4c7f-8593-90c93cc62826 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a" status: 200 len: 1512 microversion: 2.1 time: 0.151746 Oct 30 02:19:25.507872 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3785/7236] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:19:25 2022] GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:19:25.529188 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ad6cbff1-46fb-4966-8bf8-b712af713b1b tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:19:25.529789 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ad6cbff1-46fb-4966-8bf8-b712af713b1b tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:19:25.536918 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ad6cbff1-46fb-4966-8bf8-b712af713b1b tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:25.537429 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ad6cbff1-46fb-4966-8bf8-b712af713b1b tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:25.537866 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ad6cbff1-46fb-4966-8bf8-b712af713b1b tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:25.538553 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ad6cbff1-46fb-4966-8bf8-b712af713b1b tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:25.539004 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ad6cbff1-46fb-4966-8bf8-b712af713b1b tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:25.539430 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ad6cbff1-46fb-4966-8bf8-b712af713b1b tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:25.728713 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ad6cbff1-46fb-4966-8bf8-b712af713b1b tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "POST /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a/action" status: 204 len: 0 microversion: 2.1 time: 0.203229 Oct 30 02:19:25.729425 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3452/7237] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 02:19:25 2022] POST /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a/action => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 02:19:25.738068 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0f2b6509-164b-4cce-a5a6-2c843f0a97ab tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:19:25.738696 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0f2b6509-164b-4cce-a5a6-2c843f0a97ab tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:19:25.744776 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0f2b6509-164b-4cce-a5a6-2c843f0a97ab tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:25.745268 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0f2b6509-164b-4cce-a5a6-2c843f0a97ab tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:25.745771 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0f2b6509-164b-4cce-a5a6-2c843f0a97ab tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:25.746455 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0f2b6509-164b-4cce-a5a6-2c843f0a97ab tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:25.746927 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0f2b6509-164b-4cce-a5a6-2c843f0a97ab tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:25.747345 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0f2b6509-164b-4cce-a5a6-2c843f0a97ab tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:25.909440 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0f2b6509-164b-4cce-a5a6-2c843f0a97ab tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:19:25.918147 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0f2b6509-164b-4cce-a5a6-2c843f0a97ab tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a" status: 200 len: 1512 microversion: 2.1 time: 0.183942 Oct 30 02:19:25.918715 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3786/7238] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:19:25 2022] GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a => generated 1512 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:19:26.942324 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-dfc8c7dd-0a73-415c-8518-c646b39a8cb5 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:19:26.943099 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-dfc8c7dd-0a73-415c-8518-c646b39a8cb5 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:19:26.950826 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dfc8c7dd-0a73-415c-8518-c646b39a8cb5 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:26.951313 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dfc8c7dd-0a73-415c-8518-c646b39a8cb5 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:26.951751 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dfc8c7dd-0a73-415c-8518-c646b39a8cb5 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:26.952458 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dfc8c7dd-0a73-415c-8518-c646b39a8cb5 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:26.952912 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dfc8c7dd-0a73-415c-8518-c646b39a8cb5 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:26.953356 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dfc8c7dd-0a73-415c-8518-c646b39a8cb5 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:27.093625 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-dfc8c7dd-0a73-415c-8518-c646b39a8cb5 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:19:27.102096 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-dfc8c7dd-0a73-415c-8518-c646b39a8cb5 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a" status: 200 len: 1512 microversion: 2.1 time: 0.163980 Oct 30 02:19:27.102688 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3453/7239] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:19:26 2022] GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a => generated 1512 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:19:28.124342 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c8c9eb31-bce9-4906-9d25-6e3f5cb1d311 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:19:28.124971 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c8c9eb31-bce9-4906-9d25-6e3f5cb1d311 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:19:28.131671 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c8c9eb31-bce9-4906-9d25-6e3f5cb1d311 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:28.132166 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c8c9eb31-bce9-4906-9d25-6e3f5cb1d311 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:28.132616 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c8c9eb31-bce9-4906-9d25-6e3f5cb1d311 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:28.133327 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c8c9eb31-bce9-4906-9d25-6e3f5cb1d311 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:28.133817 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c8c9eb31-bce9-4906-9d25-6e3f5cb1d311 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:28.139361 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c8c9eb31-bce9-4906-9d25-6e3f5cb1d311 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:28.272536 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c8c9eb31-bce9-4906-9d25-6e3f5cb1d311 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:19:28.280897 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c8c9eb31-bce9-4906-9d25-6e3f5cb1d311 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a" status: 200 len: 1504 microversion: 2.1 time: 0.160467 Oct 30 02:19:28.281508 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3787/7240] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:19:28 2022] GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:19:28.303620 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b471d8c1-ec53-4bd9-9769-3eeba6d1b3b8 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:19:28.304243 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b471d8c1-ec53-4bd9-9769-3eeba6d1b3b8 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:19:28.311365 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b471d8c1-ec53-4bd9-9769-3eeba6d1b3b8 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:28.311851 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b471d8c1-ec53-4bd9-9769-3eeba6d1b3b8 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:28.312289 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b471d8c1-ec53-4bd9-9769-3eeba6d1b3b8 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:28.312986 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b471d8c1-ec53-4bd9-9769-3eeba6d1b3b8 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:28.313473 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b471d8c1-ec53-4bd9-9769-3eeba6d1b3b8 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:28.313904 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b471d8c1-ec53-4bd9-9769-3eeba6d1b3b8 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:28.445925 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b471d8c1-ec53-4bd9-9769-3eeba6d1b3b8 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:19:28.454192 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b471d8c1-ec53-4bd9-9769-3eeba6d1b3b8 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a" status: 200 len: 1504 microversion: 2.1 time: 0.154560 Oct 30 02:19:28.454767 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3454/7241] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:19:28 2022] GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:19:28.476424 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f770dfad-1259-44f5-a0be-3d3f2b4b3109 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:19:28.477052 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f770dfad-1259-44f5-a0be-3d3f2b4b3109 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:19:28.482985 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f770dfad-1259-44f5-a0be-3d3f2b4b3109 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:28.483477 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f770dfad-1259-44f5-a0be-3d3f2b4b3109 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:28.483925 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f770dfad-1259-44f5-a0be-3d3f2b4b3109 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:28.484629 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f770dfad-1259-44f5-a0be-3d3f2b4b3109 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:28.485099 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f770dfad-1259-44f5-a0be-3d3f2b4b3109 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:28.485566 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f770dfad-1259-44f5-a0be-3d3f2b4b3109 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:28.610630 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f770dfad-1259-44f5-a0be-3d3f2b4b3109 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:19:28.618333 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f770dfad-1259-44f5-a0be-3d3f2b4b3109 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a" status: 200 len: 1504 microversion: 2.1 time: 0.145725 Oct 30 02:19:28.619416 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3788/7242] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:19:28 2022] GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a => generated 1504 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:19:28.641114 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e07190cf-ab76-46c9-9d3a-7e044593e5b7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:19:28.641678 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e07190cf-ab76-46c9-9d3a-7e044593e5b7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:19:28.647659 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e07190cf-ab76-46c9-9d3a-7e044593e5b7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:28.648074 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e07190cf-ab76-46c9-9d3a-7e044593e5b7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:28.648528 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e07190cf-ab76-46c9-9d3a-7e044593e5b7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:28.649232 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e07190cf-ab76-46c9-9d3a-7e044593e5b7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:28.649715 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e07190cf-ab76-46c9-9d3a-7e044593e5b7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:28.650174 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e07190cf-ab76-46c9-9d3a-7e044593e5b7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:28.674476 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e07190cf-ab76-46c9-9d3a-7e044593e5b7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 02:19:28.905574 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e07190cf-ab76-46c9-9d3a-7e044593e5b7 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a" status: 204 len: 0 microversion: 2.1 time: 0.268028 Oct 30 02:19:28.906189 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3455/7243] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 02:19:28 2022] DELETE /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 02:19:28.924349 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5916f181-a9a3-48bc-ab86-ae98b089bfa9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:19:28.924876 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5916f181-a9a3-48bc-ab86-ae98b089bfa9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:19:28.930938 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5916f181-a9a3-48bc-ab86-ae98b089bfa9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:28.931936 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5916f181-a9a3-48bc-ab86-ae98b089bfa9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:28.932419 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5916f181-a9a3-48bc-ab86-ae98b089bfa9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:28.933135 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5916f181-a9a3-48bc-ab86-ae98b089bfa9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:28.933631 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5916f181-a9a3-48bc-ab86-ae98b089bfa9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:28.940628 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5916f181-a9a3-48bc-ab86-ae98b089bfa9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:28.961622 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5916f181-a9a3-48bc-ab86-ae98b089bfa9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 02:19:29.007167 n-d-master-1 devstack@n-api.service[121102]: INFO nova.compute.api [None req-5916f181-a9a3-48bc-ab86-ae98b089bfa9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Instance is already in deleting state, ignoring this request Oct 30 02:19:29.007998 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5916f181-a9a3-48bc-ab86-ae98b089bfa9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a" status: 204 len: 0 microversion: 2.1 time: 0.087687 Oct 30 02:19:29.008564 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3789/7244] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 02:19:28 2022] DELETE /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 30 02:19:29.017327 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0e4bfd32-25b0-46c3-80cd-8a2276c3a8a9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:19:29.018101 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0e4bfd32-25b0-46c3-80cd-8a2276c3a8a9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:19:29.024057 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0e4bfd32-25b0-46c3-80cd-8a2276c3a8a9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:29.024552 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0e4bfd32-25b0-46c3-80cd-8a2276c3a8a9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:29.025032 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0e4bfd32-25b0-46c3-80cd-8a2276c3a8a9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:29.025809 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0e4bfd32-25b0-46c3-80cd-8a2276c3a8a9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:29.026276 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0e4bfd32-25b0-46c3-80cd-8a2276c3a8a9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:29.026714 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0e4bfd32-25b0-46c3-80cd-8a2276c3a8a9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:29.135064 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-825fd629-3d4a-4f67-a570-a758160a6658 req-dcd1399b-86d1-4f78-82b7-d0ea06a3bd32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8530d205-5781-4ce6-bc77-fed36c2b597a", "name": "network-vif-plugged", "status": "completed", "tag": "8cd5be01-cd20-4303-b411-2d993a4dfb9f"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:19:29.146622 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-825fd629-3d4a-4f67-a570-a758160a6658 req-dcd1399b-86d1-4f78-82b7-d0ea06a3bd32 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:29.147157 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-825fd629-3d4a-4f67-a570-a758160a6658 req-dcd1399b-86d1-4f78-82b7-d0ea06a3bd32 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:29.147607 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-825fd629-3d4a-4f67-a570-a758160a6658 req-dcd1399b-86d1-4f78-82b7-d0ea06a3bd32 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:29.159043 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-825fd629-3d4a-4f67-a570-a758160a6658 req-dcd1399b-86d1-4f78-82b7-d0ea06a3bd32 service nova] Creating event network-vif-plugged:8cd5be01-cd20-4303-b411-2d993a4dfb9f for instance 8530d205-5781-4ce6-bc77-fed36c2b597a on n-h2-master-1 Oct 30 02:19:29.160426 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0e4bfd32-25b0-46c3-80cd-8a2276c3a8a9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:19:29.164086 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-825fd629-3d4a-4f67-a570-a758160a6658 req-dcd1399b-86d1-4f78-82b7-d0ea06a3bd32 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033278 Oct 30 02:19:29.164723 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3790/7245] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:19:29.169926 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0e4bfd32-25b0-46c3-80cd-8a2276c3a8a9 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a" status: 200 len: 1510 microversion: 2.1 time: 0.156925 Oct 30 02:19:29.175520 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3456/7246] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:19:29 2022] GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:19:30.194547 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1e05f0ec-f71f-497b-8cdc-a848fc93e6c5 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:19:30.195256 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1e05f0ec-f71f-497b-8cdc-a848fc93e6c5 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:19:30.202083 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1e05f0ec-f71f-497b-8cdc-a848fc93e6c5 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:30.202573 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1e05f0ec-f71f-497b-8cdc-a848fc93e6c5 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:30.203015 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1e05f0ec-f71f-497b-8cdc-a848fc93e6c5 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:30.203734 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1e05f0ec-f71f-497b-8cdc-a848fc93e6c5 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:30.204194 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1e05f0ec-f71f-497b-8cdc-a848fc93e6c5 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:30.204628 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1e05f0ec-f71f-497b-8cdc-a848fc93e6c5 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:30.336493 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1e05f0ec-f71f-497b-8cdc-a848fc93e6c5 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:19:30.344271 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1e05f0ec-f71f-497b-8cdc-a848fc93e6c5 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a" status: 200 len: 1510 microversion: 2.1 time: 0.155280 Oct 30 02:19:30.344851 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3791/7247] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:19:30 2022] GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:19:30.878149 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-1f156f6b-c23f-4977-9a31-4c5e8672d582 req-84232ca2-b96f-48fc-8c68-95a5fd2d12c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8530d205-5781-4ce6-bc77-fed36c2b597a", "name": "network-vif-deleted", "tag": "8cd5be01-cd20-4303-b411-2d993a4dfb9f"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:19:30.888630 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-1f156f6b-c23f-4977-9a31-4c5e8672d582 req-84232ca2-b96f-48fc-8c68-95a5fd2d12c4 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:30.893606 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-1f156f6b-c23f-4977-9a31-4c5e8672d582 req-84232ca2-b96f-48fc-8c68-95a5fd2d12c4 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:30.893606 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-1f156f6b-c23f-4977-9a31-4c5e8672d582 req-84232ca2-b96f-48fc-8c68-95a5fd2d12c4 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:30.902759 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-1f156f6b-c23f-4977-9a31-4c5e8672d582 req-84232ca2-b96f-48fc-8c68-95a5fd2d12c4 service nova] Creating event network-vif-deleted:8cd5be01-cd20-4303-b411-2d993a4dfb9f for instance 8530d205-5781-4ce6-bc77-fed36c2b597a on n-h2-master-1 Oct 30 02:19:30.907804 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-1f156f6b-c23f-4977-9a31-4c5e8672d582 req-84232ca2-b96f-48fc-8c68-95a5fd2d12c4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033417 Oct 30 02:19:30.908419 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3457/7248] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:19:31.366572 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6155c346-ade3-4304-8749-22c7c24cb967 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:19:31.367114 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6155c346-ade3-4304-8749-22c7c24cb967 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:19:31.374469 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6155c346-ade3-4304-8749-22c7c24cb967 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:31.374961 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6155c346-ade3-4304-8749-22c7c24cb967 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:31.375404 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6155c346-ade3-4304-8749-22c7c24cb967 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:31.376102 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6155c346-ade3-4304-8749-22c7c24cb967 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:31.376568 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6155c346-ade3-4304-8749-22c7c24cb967 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:31.376999 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6155c346-ade3-4304-8749-22c7c24cb967 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:31.410901 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6155c346-ade3-4304-8749-22c7c24cb967 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:31.411397 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6155c346-ade3-4304-8749-22c7c24cb967 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:31.411838 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6155c346-ade3-4304-8749-22c7c24cb967 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:31.412295 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-6155c346-ade3-4304-8749-22c7c24cb967 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lazy-loading 'fault' on Instance uuid 8530d205-5781-4ce6-bc77-fed36c2b597a {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 02:19:31.415168 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:19:31.454822 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6155c346-ade3-4304-8749-22c7c24cb967 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b8f0f9740b44d59ca2617609cac5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c755ba9d0c1434c9e73634c2cc4a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:19:31.464256 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6155c346-ade3-4304-8749-22c7c24cb967 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a" status: 200 len: 1305 microversion: 2.1 time: 0.101650 Oct 30 02:19:31.464835 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3792/7249] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:19:31 2022] GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a => generated 1305 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:19:32.488045 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-140eeb13-7e59-444a-81b4-3c47e9523991 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:19:32.488745 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-140eeb13-7e59-444a-81b4-3c47e9523991 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 8530d205-5781-4ce6-bc77-fed36c2b597a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:19:32.494900 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-140eeb13-7e59-444a-81b4-3c47e9523991 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:32.495383 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-140eeb13-7e59-444a-81b4-3c47e9523991 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:32.495820 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-140eeb13-7e59-444a-81b4-3c47e9523991 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:32.496507 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-140eeb13-7e59-444a-81b4-3c47e9523991 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:32.496962 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-140eeb13-7e59-444a-81b4-3c47e9523991 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:32.497405 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-140eeb13-7e59-444a-81b4-3c47e9523991 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:32.513428 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-140eeb13-7e59-444a-81b4-3c47e9523991 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] HTTP exception thrown: Instance 8530d205-5781-4ce6-bc77-fed36c2b597a could not be found. Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-140eeb13-7e59-444a-81b4-3c47e9523991 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Request method failure captured: Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a HTTP/1.1 Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXd69Bnqrwm9ig7MLGtP5UqPbtXyKwXmBhSlr9-Q51piAMQ6uS5QdXVP_YEsjsHOa3JL4AU_9cZl5MOyLJnZ9bRESXLdvunnNGtKFPOxpP9k_ijA4arSa4ANtHCkUdthi1oYLzS1Jd0afCA_W1ZrYHXtBQgNLcbCVjYC3eWoO2LFoaaE Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 5c755ba9d0c1434c9e73634c2cc4a80a Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1785045900 Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5c755ba9d0c1434c9e73634c2cc4a80a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5c755ba9d0c1434c9e73634c2cc4a80a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5c755ba9d0c1434c9e73634c2cc4a80a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5c755ba9d0c1434c9e73634c2cc4a80a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServerDiskConfigTestJSON-1785045900 Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 5c755ba9d0c1434c9e73634c2cc4a80a Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1785045900 Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServerDiskConfigTestJSON-1785045900-project Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 65b8f0f9740b44d59ca2617609cac5ab Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServerDiskConfigTestJSON-1785045900-project Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 8530d205-5781-4ce6-bc77-fed36c2b597a could not be found. Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '8530d205-5781-4ce6-bc77-fed36c2b597a'} Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8530d205-5781-4ce6-bc77-fed36c2b597a could not be found. Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8530d205-5781-4ce6-bc77-fed36c2b597a could not be found. Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:19:32.515069 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:19:32.520094 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:19:32.520094 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:19:32.520094 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:19:32.520094 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:19:32.520094 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:19:32.520094 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8530d205-5781-4ce6-bc77-fed36c2b597a could not be found. Oct 30 02:19:32.520094 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:19:32.520094 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-140eeb13-7e59-444a-81b4-3c47e9523991 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Returning 404 to user: Instance 8530d205-5781-4ce6-bc77-fed36c2b597a could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:19:32.520094 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-140eeb13-7e59-444a-81b4-3c47e9523991 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a" status: 404 len: 111 microversion: 2.1 time: 0.033517 Oct 30 02:19:32.520094 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3458/7250] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:19:32 2022] GET /compute/v2.1/servers/8530d205-5781-4ce6-bc77-fed36c2b597a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 02:19:32.526273 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3c49a268-2a3c-412f-8e29-7ca2812c1528 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '.version_select at 0x7f44c44afb80>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:19:32.667664 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3c49a268-2a3c-412f-8e29-7ca2812c1528 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-725829123" status: 202 len: 0 microversion: 2.1 time: 0.146161 Oct 30 02:19:32.668370 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3793/7251] 10.222.0.13 () {58 vars in 1218 bytes} [Sun Oct 30 02:19:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-725829123 => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 02:19:33.413110 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-42142895-1304-4197-8c24-c702fb998182 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:19:33.413639 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-42142895-1304-4197-8c24-c702fb998182 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:19:33.419862 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42142895-1304-4197-8c24-c702fb998182 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:33.420344 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42142895-1304-4197-8c24-c702fb998182 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:33.420779 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42142895-1304-4197-8c24-c702fb998182 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:33.421502 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42142895-1304-4197-8c24-c702fb998182 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:33.421966 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42142895-1304-4197-8c24-c702fb998182 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:33.422377 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42142895-1304-4197-8c24-c702fb998182 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:33.426465 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:19:33.437043 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-42142895-1304-4197-8c24-c702fb998182 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] HTTP exception thrown: Instance 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 could not be found. Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-42142895-1304-4197-8c24-c702fb998182 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Request method failure captured: Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: request: DELETE /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 HTTP/1.1 Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXd69Bnqrwm9ig7MLGtP5UqPbtXyKwXmBhSlr9-Q51piAMQ6uS5QdXVP_YEsjsHOa3JL4AU_9cZl5MOyLJnZ9bRESXLdvunnNGtKFPOxpP9k_ijA4arSa4ANtHCkUdthi1oYLzS1Jd0afCA_W1ZrYHXtBQgNLcbCVjYC3eWoO2LFoaaE Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 5c755ba9d0c1434c9e73634c2cc4a80a Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1785045900 Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5c755ba9d0c1434c9e73634c2cc4a80a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5c755ba9d0c1434c9e73634c2cc4a80a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5c755ba9d0c1434c9e73634c2cc4a80a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5c755ba9d0c1434c9e73634c2cc4a80a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServerDiskConfigTestJSON-1785045900 Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 5c755ba9d0c1434c9e73634c2cc4a80a Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1785045900 Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServerDiskConfigTestJSON-1785045900-project Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 65b8f0f9740b44d59ca2617609cac5ab Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServerDiskConfigTestJSON-1785045900-project Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 could not be found. Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '7d6c217b-d03f-4ae7-ae1b-db354ea22ca1'} Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 could not be found. Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 02:19:33.438677 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 02:19:33.442633 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 could not be found. Oct 30 02:19:33.442633 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:19:33.442633 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:19:33.442633 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:19:33.442633 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:19:33.442633 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:19:33.442633 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:19:33.442633 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:19:33.442633 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:19:33.442633 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 could not be found. Oct 30 02:19:33.442633 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:19:33.442633 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-42142895-1304-4197-8c24-c702fb998182 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Returning 404 to user: Instance 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:19:33.442633 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-42142895-1304-4197-8c24-c702fb998182 tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1" status: 404 len: 111 microversion: 2.1 time: 0.030874 Oct 30 02:19:33.442633 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3459/7252] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 02:19:33 2022] DELETE /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 02:19:33.449271 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e33d2a0f-6d46-4e66-8b08-8dba6e771f2c tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:19:33.449929 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e33d2a0f-6d46-4e66-8b08-8dba6e771f2c tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] [instance: 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:19:33.456494 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e33d2a0f-6d46-4e66-8b08-8dba6e771f2c tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:33.456983 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e33d2a0f-6d46-4e66-8b08-8dba6e771f2c tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:33.457467 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e33d2a0f-6d46-4e66-8b08-8dba6e771f2c tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:33.458172 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e33d2a0f-6d46-4e66-8b08-8dba6e771f2c tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:33.458636 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e33d2a0f-6d46-4e66-8b08-8dba6e771f2c tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:33.459072 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e33d2a0f-6d46-4e66-8b08-8dba6e771f2c tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:33.472029 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-e33d2a0f-6d46-4e66-8b08-8dba6e771f2c tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] HTTP exception thrown: Instance 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 could not be found. Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e33d2a0f-6d46-4e66-8b08-8dba6e771f2c tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Request method failure captured: Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 HTTP/1.1 Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXd69Bnqrwm9ig7MLGtP5UqPbtXyKwXmBhSlr9-Q51piAMQ6uS5QdXVP_YEsjsHOa3JL4AU_9cZl5MOyLJnZ9bRESXLdvunnNGtKFPOxpP9k_ijA4arSa4ANtHCkUdthi1oYLzS1Jd0afCA_W1ZrYHXtBQgNLcbCVjYC3eWoO2LFoaaE Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 5c755ba9d0c1434c9e73634c2cc4a80a Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1785045900 Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5c755ba9d0c1434c9e73634c2cc4a80a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5c755ba9d0c1434c9e73634c2cc4a80a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5c755ba9d0c1434c9e73634c2cc4a80a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5c755ba9d0c1434c9e73634c2cc4a80a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServerDiskConfigTestJSON-1785045900 Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 5c755ba9d0c1434c9e73634c2cc4a80a Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1785045900 Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServerDiskConfigTestJSON-1785045900-project Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 65b8f0f9740b44d59ca2617609cac5ab Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServerDiskConfigTestJSON-1785045900-project Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 could not be found. Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '7d6c217b-d03f-4ae7-ae1b-db354ea22ca1'} Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 could not be found. Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 could not be found. Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:19:33.473701 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:19:33.482404 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:19:33.482404 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:19:33.482404 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:19:33.482404 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:19:33.482404 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:19:33.482404 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 could not be found. Oct 30 02:19:33.482404 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:19:33.482404 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e33d2a0f-6d46-4e66-8b08-8dba6e771f2c tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] Returning 404 to user: Instance 7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:19:33.482404 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e33d2a0f-6d46-4e66-8b08-8dba6e771f2c tempest-ServerDiskConfigTestJSON-1785045900 tempest-ServerDiskConfigTestJSON-1785045900-project] 10.222.0.13 "GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1" status: 404 len: 111 microversion: 2.1 time: 0.030316 Oct 30 02:19:33.482404 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3794/7253] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:19:33 2022] GET /compute/v2.1/servers/7d6c217b-d03f-4ae7-ae1b-db354ea22ca1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 02:19:43.959713 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:19:44.073642 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8a5bb306-8ced-4f14-a25d-5a22a3f260ec tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Action: 'create', calling method: .version_select at 0x7f44c73b1820>, body: {"keypair": {"name": "tempest-keypair-1057397827", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBdj9y8ySqvU8vBUsHVrnp4wmu5qyTKqPpZfwvbWtTiuqqPFFVmoW+clGAMArxcQjc5gMHBNHeeaEQHQhREl4kExgXFiZgWAEoRWdXQEAq7fijJTZAncFvi4Pza55LVcQ=="}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:19:44.090323 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-8a5bb306-8ced-4f14-a25d-5a22a3f260ec tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Getting quotas for project ec54882ff5fa47fe9303222e3f936de9. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 02:19:44.095517 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-8a5bb306-8ced-4f14-a25d-5a22a3f260ec tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Getting quotas for user bd6a4d32970a4d72be7109ceaf173241 and project ec54882ff5fa47fe9303222e3f936de9. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 02:19:44.204136 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8a5bb306-8ced-4f14-a25d-5a22a3f260ec tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.250136 Oct 30 02:19:44.204753 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3460/7254] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 30 02:19:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:19:46.332912 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a38fda0e-f91b-47fe-b739-8ce53e3d1ee9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1723703194", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "69a7f320-9fb0-467c-85eb-ca0c978501c8"}], "security_groups": [{"name": "tempest-securitygroup--1896496015"}], "key_name": "tempest-keypair-1057397827", "user_data": "}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:19:46.342720 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=36,nova_api:DELETE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:19:46.343414 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=5 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:19:46.445412 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-a38fda0e-f91b-47fe-b739-8ce53e3d1ee9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] validate_networks() for [('69a7f320-9fb0-467c-85eb-ca0c978501c8', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 02:19:46.861710 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-a38fda0e-f91b-47fe-b739-8ce53e3d1ee9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 02:19:46.862145 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-a38fda0e-f91b-47fe-b739-8ce53e3d1ee9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 02:19:46.862634 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-a38fda0e-f91b-47fe-b739-8ce53e3d1ee9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 02:19:46.863054 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-a38fda0e-f91b-47fe-b739-8ce53e3d1ee9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 02:19:46.863475 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-a38fda0e-f91b-47fe-b739-8ce53e3d1ee9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 02:19:46.872743 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a38fda0e-f91b-47fe-b739-8ce53e3d1ee9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:46.873237 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a38fda0e-f91b-47fe-b739-8ce53e3d1ee9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:46.873720 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a38fda0e-f91b-47fe-b739-8ce53e3d1ee9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:46.874457 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a38fda0e-f91b-47fe-b739-8ce53e3d1ee9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:46.874920 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a38fda0e-f91b-47fe-b739-8ce53e3d1ee9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:46.875798 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a38fda0e-f91b-47fe-b739-8ce53e3d1ee9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:46.893381 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-a38fda0e-f91b-47fe-b739-8ce53e3d1ee9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Getting quotas for project ec54882ff5fa47fe9303222e3f936de9. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 02:19:46.898969 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-a38fda0e-f91b-47fe-b739-8ce53e3d1ee9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Getting quotas for user bd6a4d32970a4d72be7109ceaf173241 and project ec54882ff5fa47fe9303222e3f936de9. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 02:19:46.912197 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a38fda0e-f91b-47fe-b739-8ce53e3d1ee9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 02:19:46.914569 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a38fda0e-f91b-47fe-b739-8ce53e3d1ee9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: aefa3d4a-410a-48ec-8ae1-c66ee39b3aab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 02:19:47.023050 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a38fda0e-f91b-47fe-b739-8ce53e3d1ee9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.694526 Oct 30 02:19:47.023703 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3795/7255] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 02:19:46 2022] POST /compute/v2.1/servers => generated 409 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 30 02:19:47.036801 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8d193d98-ce99-4727-b84f-3a51ef811982 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:19:47.037450 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8d193d98-ce99-4727-b84f-3a51ef811982 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: aefa3d4a-410a-48ec-8ae1-c66ee39b3aab] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:19:47.110934 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8d193d98-ce99-4727-b84f-3a51ef811982 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:19:47.119483 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8d193d98-ce99-4727-b84f-3a51ef811982 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab" status: 200 len: 1239 microversion: 2.1 time: 0.087572 Oct 30 02:19:47.120418 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3461/7256] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:19:47 2022] GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab => generated 1239 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:19:48.147231 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c4a9fe43-a008-4547-962a-0b5ff8ff5b1e tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:19:48.148614 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c4a9fe43-a008-4547-962a-0b5ff8ff5b1e tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: aefa3d4a-410a-48ec-8ae1-c66ee39b3aab] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:19:48.158808 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4a9fe43-a008-4547-962a-0b5ff8ff5b1e tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:48.159311 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4a9fe43-a008-4547-962a-0b5ff8ff5b1e tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:48.159758 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4a9fe43-a008-4547-962a-0b5ff8ff5b1e tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:48.160471 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4a9fe43-a008-4547-962a-0b5ff8ff5b1e tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:48.161009 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4a9fe43-a008-4547-962a-0b5ff8ff5b1e tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:48.161446 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4a9fe43-a008-4547-962a-0b5ff8ff5b1e tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:48.225245 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c4a9fe43-a008-4547-962a-0b5ff8ff5b1e tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:19:48.233921 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c4a9fe43-a008-4547-962a-0b5ff8ff5b1e tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab" status: 200 len: 1243 microversion: 2.1 time: 0.091584 Oct 30 02:19:48.234500 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3796/7257] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:19:48 2022] GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab => generated 1243 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:19:49.257261 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-52c31abd-32e6-4f16-98d8-e3eb51cc24ad tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:19:49.258019 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-52c31abd-32e6-4f16-98d8-e3eb51cc24ad tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: aefa3d4a-410a-48ec-8ae1-c66ee39b3aab] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:19:49.266211 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52c31abd-32e6-4f16-98d8-e3eb51cc24ad tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:49.266707 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52c31abd-32e6-4f16-98d8-e3eb51cc24ad tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:49.267158 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52c31abd-32e6-4f16-98d8-e3eb51cc24ad tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:49.267875 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52c31abd-32e6-4f16-98d8-e3eb51cc24ad tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:49.268533 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52c31abd-32e6-4f16-98d8-e3eb51cc24ad tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:49.269511 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52c31abd-32e6-4f16-98d8-e3eb51cc24ad tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:49.336610 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-52c31abd-32e6-4f16-98d8-e3eb51cc24ad tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:19:49.347390 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-52c31abd-32e6-4f16-98d8-e3eb51cc24ad tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab" status: 200 len: 1299 microversion: 2.1 time: 0.094601 Oct 30 02:19:49.348290 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3462/7258] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:19:49 2022] GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab => generated 1299 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:19:50.371162 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-034fb19d-4655-4088-a699-4e292ee6f5d9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:19:50.371801 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-034fb19d-4655-4088-a699-4e292ee6f5d9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: aefa3d4a-410a-48ec-8ae1-c66ee39b3aab] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:19:50.378997 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-034fb19d-4655-4088-a699-4e292ee6f5d9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:50.379509 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-034fb19d-4655-4088-a699-4e292ee6f5d9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:50.379965 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-034fb19d-4655-4088-a699-4e292ee6f5d9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:50.380694 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-034fb19d-4655-4088-a699-4e292ee6f5d9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:50.381163 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-034fb19d-4655-4088-a699-4e292ee6f5d9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:50.381701 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-034fb19d-4655-4088-a699-4e292ee6f5d9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:50.711156 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-034fb19d-4655-4088-a699-4e292ee6f5d9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:19:50.719989 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-034fb19d-4655-4088-a699-4e292ee6f5d9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab" status: 200 len: 1365 microversion: 2.1 time: 0.352873 Oct 30 02:19:50.720569 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3797/7259] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:19:50 2022] GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab => generated 1365 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:19:51.298146 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-f5e9c27c-9725-4ef7-bcdc-42035638c9d2 req-3e489258-9c40-4185-b6d8-43734ae2efe1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aefa3d4a-410a-48ec-8ae1-c66ee39b3aab", "tag": "9e2bfd35-cb11-411d-823d-e12efe2a0c9e"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:19:51.311156 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-f5e9c27c-9725-4ef7-bcdc-42035638c9d2 req-3e489258-9c40-4185-b6d8-43734ae2efe1 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:51.311896 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-f5e9c27c-9725-4ef7-bcdc-42035638c9d2 req-3e489258-9c40-4185-b6d8-43734ae2efe1 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:51.312529 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-f5e9c27c-9725-4ef7-bcdc-42035638c9d2 req-3e489258-9c40-4185-b6d8-43734ae2efe1 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:51.324487 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-f5e9c27c-9725-4ef7-bcdc-42035638c9d2 req-3e489258-9c40-4185-b6d8-43734ae2efe1 service nova] Creating event network-changed:9e2bfd35-cb11-411d-823d-e12efe2a0c9e for instance aefa3d4a-410a-48ec-8ae1-c66ee39b3aab on n-h1-master-1 Oct 30 02:19:51.329702 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-f5e9c27c-9725-4ef7-bcdc-42035638c9d2 req-3e489258-9c40-4185-b6d8-43734ae2efe1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035923 Oct 30 02:19:51.330300 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3463/7260] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:19:51.742442 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b126d6e8-0f53-44d1-9117-cfa6a01da0cd tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:19:51.743806 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b126d6e8-0f53-44d1-9117-cfa6a01da0cd tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: aefa3d4a-410a-48ec-8ae1-c66ee39b3aab] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:19:51.750649 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b126d6e8-0f53-44d1-9117-cfa6a01da0cd tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:51.751141 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b126d6e8-0f53-44d1-9117-cfa6a01da0cd tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:51.751584 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b126d6e8-0f53-44d1-9117-cfa6a01da0cd tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:51.752284 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b126d6e8-0f53-44d1-9117-cfa6a01da0cd tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:51.752743 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b126d6e8-0f53-44d1-9117-cfa6a01da0cd tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:51.753172 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b126d6e8-0f53-44d1-9117-cfa6a01da0cd tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:51.987006 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b126d6e8-0f53-44d1-9117-cfa6a01da0cd tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:19:51.994580 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b126d6e8-0f53-44d1-9117-cfa6a01da0cd tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab" status: 200 len: 1365 microversion: 2.1 time: 0.256038 Oct 30 02:19:51.995154 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3798/7261] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:19:51 2022] GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab => generated 1365 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:19:53.017558 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-03653d4f-3bd0-47ac-a56a-c831d146e1d1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:19:53.018194 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-03653d4f-3bd0-47ac-a56a-c831d146e1d1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: aefa3d4a-410a-48ec-8ae1-c66ee39b3aab] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:19:53.025898 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-03653d4f-3bd0-47ac-a56a-c831d146e1d1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:53.026381 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-03653d4f-3bd0-47ac-a56a-c831d146e1d1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:53.026816 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-03653d4f-3bd0-47ac-a56a-c831d146e1d1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:53.027501 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-03653d4f-3bd0-47ac-a56a-c831d146e1d1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:53.027953 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-03653d4f-3bd0-47ac-a56a-c831d146e1d1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:53.028373 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-03653d4f-3bd0-47ac-a56a-c831d146e1d1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:53.159928 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-03653d4f-3bd0-47ac-a56a-c831d146e1d1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:19:53.168322 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-03653d4f-3bd0-47ac-a56a-c831d146e1d1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab" status: 200 len: 1365 microversion: 2.1 time: 0.155158 Oct 30 02:19:53.168895 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3464/7262] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:19:53 2022] GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:19:54.190948 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fac7bff5-244b-4385-83ef-fe11b518c38a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:19:54.191572 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fac7bff5-244b-4385-83ef-fe11b518c38a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: aefa3d4a-410a-48ec-8ae1-c66ee39b3aab] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:19:54.199216 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fac7bff5-244b-4385-83ef-fe11b518c38a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:54.199714 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fac7bff5-244b-4385-83ef-fe11b518c38a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:54.200158 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fac7bff5-244b-4385-83ef-fe11b518c38a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:54.200889 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fac7bff5-244b-4385-83ef-fe11b518c38a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:54.201399 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fac7bff5-244b-4385-83ef-fe11b518c38a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:54.201838 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fac7bff5-244b-4385-83ef-fe11b518c38a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:54.334924 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-fac7bff5-244b-4385-83ef-fe11b518c38a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:19:54.342794 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fac7bff5-244b-4385-83ef-fe11b518c38a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab" status: 200 len: 1365 microversion: 2.1 time: 0.155751 Oct 30 02:19:54.343362 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3799/7263] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:19:54 2022] GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:19:55.365217 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-87adaa49-68e0-4d70-b9d5-47cd13c6f55c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:19:55.365883 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-87adaa49-68e0-4d70-b9d5-47cd13c6f55c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: aefa3d4a-410a-48ec-8ae1-c66ee39b3aab] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:19:55.372876 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-87adaa49-68e0-4d70-b9d5-47cd13c6f55c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:55.373411 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-87adaa49-68e0-4d70-b9d5-47cd13c6f55c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:55.373826 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-87adaa49-68e0-4d70-b9d5-47cd13c6f55c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:55.374515 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-87adaa49-68e0-4d70-b9d5-47cd13c6f55c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:55.374969 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-87adaa49-68e0-4d70-b9d5-47cd13c6f55c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:55.375393 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-87adaa49-68e0-4d70-b9d5-47cd13c6f55c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:55.505680 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-87adaa49-68e0-4d70-b9d5-47cd13c6f55c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:19:55.514340 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-87adaa49-68e0-4d70-b9d5-47cd13c6f55c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab" status: 200 len: 1365 microversion: 2.1 time: 0.153000 Oct 30 02:19:55.515124 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3465/7264] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:19:55 2022] GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:19:56.537546 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6d04bcf8-4a89-41a3-9df4-0652bfd73ea3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:19:56.538096 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6d04bcf8-4a89-41a3-9df4-0652bfd73ea3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: aefa3d4a-410a-48ec-8ae1-c66ee39b3aab] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:19:56.545545 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d04bcf8-4a89-41a3-9df4-0652bfd73ea3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:56.546034 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d04bcf8-4a89-41a3-9df4-0652bfd73ea3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:56.546469 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d04bcf8-4a89-41a3-9df4-0652bfd73ea3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:56.547167 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d04bcf8-4a89-41a3-9df4-0652bfd73ea3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:56.547625 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d04bcf8-4a89-41a3-9df4-0652bfd73ea3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:56.548058 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d04bcf8-4a89-41a3-9df4-0652bfd73ea3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:56.674702 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6d04bcf8-4a89-41a3-9df4-0652bfd73ea3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:19:56.682607 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6d04bcf8-4a89-41a3-9df4-0652bfd73ea3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab" status: 200 len: 1365 microversion: 2.1 time: 0.149077 Oct 30 02:19:56.683172 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3800/7265] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:19:56 2022] GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:19:57.672515 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-eab08695-f1b9-48d6-9d87-a80a85b2d8e6 req-9fbd80af-9e31-4c1d-b830-33defdc6bb31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aefa3d4a-410a-48ec-8ae1-c66ee39b3aab", "name": "network-vif-plugged", "status": "completed", "tag": "9e2bfd35-cb11-411d-823d-e12efe2a0c9e"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:19:57.678485 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=6 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:19:57.683743 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-eab08695-f1b9-48d6-9d87-a80a85b2d8e6 req-9fbd80af-9e31-4c1d-b830-33defdc6bb31 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:57.684484 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-eab08695-f1b9-48d6-9d87-a80a85b2d8e6 req-9fbd80af-9e31-4c1d-b830-33defdc6bb31 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:57.684916 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-eab08695-f1b9-48d6-9d87-a80a85b2d8e6 req-9fbd80af-9e31-4c1d-b830-33defdc6bb31 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:57.696002 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-eab08695-f1b9-48d6-9d87-a80a85b2d8e6 req-9fbd80af-9e31-4c1d-b830-33defdc6bb31 service nova] Creating event network-vif-plugged:9e2bfd35-cb11-411d-823d-e12efe2a0c9e for instance aefa3d4a-410a-48ec-8ae1-c66ee39b3aab on n-h1-master-1 Oct 30 02:19:57.701612 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-eab08695-f1b9-48d6-9d87-a80a85b2d8e6 req-9fbd80af-9e31-4c1d-b830-33defdc6bb31 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032809 Oct 30 02:19:57.702417 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3466/7266] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:19:57.706363 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8090be87-b493-4984-bbf5-02f4f0df4430 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:19:57.707019 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8090be87-b493-4984-bbf5-02f4f0df4430 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: aefa3d4a-410a-48ec-8ae1-c66ee39b3aab] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:19:57.708926 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:19:57.709699 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=6 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:19:57.716178 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8090be87-b493-4984-bbf5-02f4f0df4430 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:57.716660 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8090be87-b493-4984-bbf5-02f4f0df4430 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:57.717177 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8090be87-b493-4984-bbf5-02f4f0df4430 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:57.717938 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8090be87-b493-4984-bbf5-02f4f0df4430 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:57.718410 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8090be87-b493-4984-bbf5-02f4f0df4430 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:57.721071 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8090be87-b493-4984-bbf5-02f4f0df4430 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:57.901551 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8090be87-b493-4984-bbf5-02f4f0df4430 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:19:57.909173 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8090be87-b493-4984-bbf5-02f4f0df4430 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab" status: 200 len: 1365 microversion: 2.1 time: 0.206913 Oct 30 02:19:57.909796 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3801/7267] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:19:57 2022] GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab => generated 1365 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:19:58.933072 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2fb2b04b-774e-44af-b293-de8fd756ff67 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:19:58.933834 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2fb2b04b-774e-44af-b293-de8fd756ff67 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: aefa3d4a-410a-48ec-8ae1-c66ee39b3aab] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:19:58.940670 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2fb2b04b-774e-44af-b293-de8fd756ff67 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:58.941158 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2fb2b04b-774e-44af-b293-de8fd756ff67 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:58.941627 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2fb2b04b-774e-44af-b293-de8fd756ff67 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:58.942390 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2fb2b04b-774e-44af-b293-de8fd756ff67 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:19:58.942852 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2fb2b04b-774e-44af-b293-de8fd756ff67 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:19:58.943284 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2fb2b04b-774e-44af-b293-de8fd756ff67 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:19:59.085756 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2fb2b04b-774e-44af-b293-de8fd756ff67 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:19:59.094970 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2fb2b04b-774e-44af-b293-de8fd756ff67 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab" status: 200 len: 1365 microversion: 2.1 time: 0.166326 Oct 30 02:19:59.094970 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3467/7268] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:19:58 2022] GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:20:00.116107 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1fb0d57d-7ca2-4613-b2a9-c12bab4db500 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:20:00.116739 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1fb0d57d-7ca2-4613-b2a9-c12bab4db500 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: aefa3d4a-410a-48ec-8ae1-c66ee39b3aab] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:20:00.124197 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1fb0d57d-7ca2-4613-b2a9-c12bab4db500 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:00.124694 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1fb0d57d-7ca2-4613-b2a9-c12bab4db500 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:00.125141 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1fb0d57d-7ca2-4613-b2a9-c12bab4db500 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:00.125878 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1fb0d57d-7ca2-4613-b2a9-c12bab4db500 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:00.126346 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1fb0d57d-7ca2-4613-b2a9-c12bab4db500 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:00.126786 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1fb0d57d-7ca2-4613-b2a9-c12bab4db500 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:00.256753 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1fb0d57d-7ca2-4613-b2a9-c12bab4db500 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:20:00.265145 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1fb0d57d-7ca2-4613-b2a9-c12bab4db500 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab" status: 200 len: 1553 microversion: 2.1 time: 0.152926 Oct 30 02:20:00.265764 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3802/7269] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:20:00 2022] GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:20:00.287479 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e49957a8-b976-4b7a-8666-478b715bf230 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:20:00.287985 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e49957a8-b976-4b7a-8666-478b715bf230 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: aefa3d4a-410a-48ec-8ae1-c66ee39b3aab] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:20:00.294741 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e49957a8-b976-4b7a-8666-478b715bf230 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:00.295261 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e49957a8-b976-4b7a-8666-478b715bf230 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:00.295697 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e49957a8-b976-4b7a-8666-478b715bf230 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:00.296388 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e49957a8-b976-4b7a-8666-478b715bf230 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:00.296852 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e49957a8-b976-4b7a-8666-478b715bf230 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:00.297283 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e49957a8-b976-4b7a-8666-478b715bf230 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:00.373238 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e49957a8-b976-4b7a-8666-478b715bf230 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089715 Oct 30 02:20:00.373867 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3468/7270] 10.222.0.13 () {58 vars in 1275 bytes} [Sun Oct 30 02:20:00 2022] GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:20:01.340898 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-4f770c7e-8d8a-48cb-88be-d40eee451200 req-d3753837-4981-4dd1-b07f-f669f6097a67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aefa3d4a-410a-48ec-8ae1-c66ee39b3aab", "tag": "9e2bfd35-cb11-411d-823d-e12efe2a0c9e"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:20:01.351893 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-4f770c7e-8d8a-48cb-88be-d40eee451200 req-d3753837-4981-4dd1-b07f-f669f6097a67 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:01.352491 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-4f770c7e-8d8a-48cb-88be-d40eee451200 req-d3753837-4981-4dd1-b07f-f669f6097a67 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:01.353006 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-4f770c7e-8d8a-48cb-88be-d40eee451200 req-d3753837-4981-4dd1-b07f-f669f6097a67 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:01.364191 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-4f770c7e-8d8a-48cb-88be-d40eee451200 req-d3753837-4981-4dd1-b07f-f669f6097a67 service nova] Creating event network-changed:9e2bfd35-cb11-411d-823d-e12efe2a0c9e for instance aefa3d4a-410a-48ec-8ae1-c66ee39b3aab on n-h1-master-1 Oct 30 02:20:01.370234 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-4f770c7e-8d8a-48cb-88be-d40eee451200 req-d3753837-4981-4dd1-b07f-f669f6097a67 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033698 Oct 30 02:20:01.371017 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3803/7271] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:20:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:20:35.093663 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:20:35.094930 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=32 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:20:35.098823 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8448d192-2f1b-44f1-b8d9-55af3b4b6c61 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:20:35.099446 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8448d192-2f1b-44f1-b8d9-55af3b4b6c61 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: aefa3d4a-410a-48ec-8ae1-c66ee39b3aab] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:20:35.105282 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8448d192-2f1b-44f1-b8d9-55af3b4b6c61 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:35.105804 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8448d192-2f1b-44f1-b8d9-55af3b4b6c61 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:35.106247 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8448d192-2f1b-44f1-b8d9-55af3b4b6c61 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:35.106946 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8448d192-2f1b-44f1-b8d9-55af3b4b6c61 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:35.107406 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8448d192-2f1b-44f1-b8d9-55af3b4b6c61 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:35.107837 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8448d192-2f1b-44f1-b8d9-55af3b4b6c61 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:35.237166 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8448d192-2f1b-44f1-b8d9-55af3b4b6c61 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:20:35.244833 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8448d192-2f1b-44f1-b8d9-55af3b4b6c61 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab" status: 200 len: 1672 microversion: 2.1 time: 0.153675 Oct 30 02:20:35.245622 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3469/7272] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:20:35 2022] GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:20:35.268218 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3facbc75-487f-41ab-bf54-426b7ac90bad tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:20:35.268941 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3facbc75-487f-41ab-bf54-426b7ac90bad tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: aefa3d4a-410a-48ec-8ae1-c66ee39b3aab] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:20:35.271151 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:20:35.271970 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=46 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:20:35.277422 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3facbc75-487f-41ab-bf54-426b7ac90bad tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:35.277927 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3facbc75-487f-41ab-bf54-426b7ac90bad tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:35.285424 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3facbc75-487f-41ab-bf54-426b7ac90bad tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:35.285424 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3facbc75-487f-41ab-bf54-426b7ac90bad tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:35.285424 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3facbc75-487f-41ab-bf54-426b7ac90bad tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:35.285424 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3facbc75-487f-41ab-bf54-426b7ac90bad tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:35.410435 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3facbc75-487f-41ab-bf54-426b7ac90bad tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:20:35.418249 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3facbc75-487f-41ab-bf54-426b7ac90bad tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab" status: 200 len: 1672 microversion: 2.1 time: 0.154546 Oct 30 02:20:35.418830 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3804/7273] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:20:35 2022] GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:20:35.440419 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3241127c-02e3-48ec-b39d-f31f66a1de77 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:20:35.440963 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3241127c-02e3-48ec-b39d-f31f66a1de77 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: aefa3d4a-410a-48ec-8ae1-c66ee39b3aab] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:20:35.446998 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3241127c-02e3-48ec-b39d-f31f66a1de77 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:35.447491 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3241127c-02e3-48ec-b39d-f31f66a1de77 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:35.447935 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3241127c-02e3-48ec-b39d-f31f66a1de77 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:35.448638 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3241127c-02e3-48ec-b39d-f31f66a1de77 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:35.449651 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3241127c-02e3-48ec-b39d-f31f66a1de77 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:35.450094 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3241127c-02e3-48ec-b39d-f31f66a1de77 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:35.576644 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3241127c-02e3-48ec-b39d-f31f66a1de77 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:20:35.584373 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3241127c-02e3-48ec-b39d-f31f66a1de77 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab" status: 200 len: 1672 microversion: 2.1 time: 0.148011 Oct 30 02:20:35.584956 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3470/7274] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:20:35 2022] GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab => generated 1672 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:20:35.607012 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-653eca6f-a6eb-44a2-9796-766d0deeeeea tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:20:35.609235 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-653eca6f-a6eb-44a2-9796-766d0deeeeea tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: aefa3d4a-410a-48ec-8ae1-c66ee39b3aab] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:20:35.615111 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-653eca6f-a6eb-44a2-9796-766d0deeeeea tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:35.615602 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-653eca6f-a6eb-44a2-9796-766d0deeeeea tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:35.616058 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-653eca6f-a6eb-44a2-9796-766d0deeeeea tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:35.616750 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-653eca6f-a6eb-44a2-9796-766d0deeeeea tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:35.617210 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-653eca6f-a6eb-44a2-9796-766d0deeeeea tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:35.617666 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-653eca6f-a6eb-44a2-9796-766d0deeeeea tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:35.646384 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-653eca6f-a6eb-44a2-9796-766d0deeeeea tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:20:35.651901 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-653eca6f-a6eb-44a2-9796-766d0deeeeea tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: aefa3d4a-410a-48ec-8ae1-c66ee39b3aab] Old instance type m1.heat2, new instance type m1.heat {{(pid=121102) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 30 02:20:35.659090 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-653eca6f-a6eb-44a2-9796-766d0deeeeea tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 02:20:35.659556 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-653eca6f-a6eb-44a2-9796-766d0deeeeea tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 02:20:35.660044 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-653eca6f-a6eb-44a2-9796-766d0deeeeea tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 02:20:35.660466 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-653eca6f-a6eb-44a2-9796-766d0deeeeea tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 02:20:35.660893 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-653eca6f-a6eb-44a2-9796-766d0deeeeea tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 02:20:35.845552 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-653eca6f-a6eb-44a2-9796-766d0deeeeea tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "POST /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab/action" status: 202 len: 0 microversion: 2.1 time: 0.242392 Oct 30 02:20:35.846174 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3805/7275] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 02:20:35 2022] POST /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 02:20:35.854271 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4cf14d9c-29cd-4a76-8453-1687bf8df88d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:20:35.854893 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4cf14d9c-29cd-4a76-8453-1687bf8df88d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: aefa3d4a-410a-48ec-8ae1-c66ee39b3aab] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:20:35.861752 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4cf14d9c-29cd-4a76-8453-1687bf8df88d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:35.862379 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4cf14d9c-29cd-4a76-8453-1687bf8df88d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:35.862828 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4cf14d9c-29cd-4a76-8453-1687bf8df88d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:35.863538 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4cf14d9c-29cd-4a76-8453-1687bf8df88d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:35.864003 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4cf14d9c-29cd-4a76-8453-1687bf8df88d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:35.864447 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4cf14d9c-29cd-4a76-8453-1687bf8df88d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:35.997234 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4cf14d9c-29cd-4a76-8453-1687bf8df88d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:20:36.005151 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4cf14d9c-29cd-4a76-8453-1687bf8df88d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab" status: 200 len: 1681 microversion: 2.1 time: 0.154763 Oct 30 02:20:36.005847 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3471/7276] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:20:35 2022] GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:20:37.030302 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4d5677a4-8ced-4bff-86a6-f09231f24bb2 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:20:37.030924 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4d5677a4-8ced-4bff-86a6-f09231f24bb2 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: aefa3d4a-410a-48ec-8ae1-c66ee39b3aab] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:20:37.037763 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d5677a4-8ced-4bff-86a6-f09231f24bb2 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:37.038258 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d5677a4-8ced-4bff-86a6-f09231f24bb2 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:37.038761 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d5677a4-8ced-4bff-86a6-f09231f24bb2 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:37.039457 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d5677a4-8ced-4bff-86a6-f09231f24bb2 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:37.039917 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d5677a4-8ced-4bff-86a6-f09231f24bb2 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:37.040349 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d5677a4-8ced-4bff-86a6-f09231f24bb2 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:37.176918 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4d5677a4-8ced-4bff-86a6-f09231f24bb2 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:20:37.185072 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4d5677a4-8ced-4bff-86a6-f09231f24bb2 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab" status: 200 len: 1681 microversion: 2.1 time: 0.159789 Oct 30 02:20:37.185687 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3806/7277] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:20:37 2022] GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:20:38.208147 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7079d92b-0638-436f-a4bf-32bb3280eeb1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:20:38.208779 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7079d92b-0638-436f-a4bf-32bb3280eeb1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: aefa3d4a-410a-48ec-8ae1-c66ee39b3aab] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:20:38.216123 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7079d92b-0638-436f-a4bf-32bb3280eeb1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:38.216609 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7079d92b-0638-436f-a4bf-32bb3280eeb1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:38.217052 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7079d92b-0638-436f-a4bf-32bb3280eeb1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:38.217772 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7079d92b-0638-436f-a4bf-32bb3280eeb1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:38.218227 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7079d92b-0638-436f-a4bf-32bb3280eeb1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:38.218650 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7079d92b-0638-436f-a4bf-32bb3280eeb1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:38.355117 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7079d92b-0638-436f-a4bf-32bb3280eeb1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:20:38.363447 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7079d92b-0638-436f-a4bf-32bb3280eeb1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab" status: 200 len: 1681 microversion: 2.1 time: 0.159229 Oct 30 02:20:38.364032 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3472/7278] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:20:38 2022] GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:20:39.388698 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ab5adb46-0463-4d02-a421-2e83eb463ebe tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:20:39.389313 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ab5adb46-0463-4d02-a421-2e83eb463ebe tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: aefa3d4a-410a-48ec-8ae1-c66ee39b3aab] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:20:39.396153 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ab5adb46-0463-4d02-a421-2e83eb463ebe tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:39.396639 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ab5adb46-0463-4d02-a421-2e83eb463ebe tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:39.397081 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ab5adb46-0463-4d02-a421-2e83eb463ebe tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:39.397801 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ab5adb46-0463-4d02-a421-2e83eb463ebe tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:39.398261 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ab5adb46-0463-4d02-a421-2e83eb463ebe tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:39.398695 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ab5adb46-0463-4d02-a421-2e83eb463ebe tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:39.528425 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ab5adb46-0463-4d02-a421-2e83eb463ebe tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:20:39.536381 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ab5adb46-0463-4d02-a421-2e83eb463ebe tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab" status: 200 len: 1686 microversion: 2.1 time: 0.152154 Oct 30 02:20:39.536962 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3807/7279] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:20:39 2022] GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab => generated 1686 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:20:40.559967 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2722c911-4e49-43ac-884b-8342a62dc75c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:20:40.560621 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2722c911-4e49-43ac-884b-8342a62dc75c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: aefa3d4a-410a-48ec-8ae1-c66ee39b3aab] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:20:40.567489 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2722c911-4e49-43ac-884b-8342a62dc75c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:40.567974 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2722c911-4e49-43ac-884b-8342a62dc75c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:40.568413 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2722c911-4e49-43ac-884b-8342a62dc75c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:40.569105 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2722c911-4e49-43ac-884b-8342a62dc75c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:40.569595 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2722c911-4e49-43ac-884b-8342a62dc75c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:40.570024 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2722c911-4e49-43ac-884b-8342a62dc75c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:40.713269 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2722c911-4e49-43ac-884b-8342a62dc75c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:20:40.721617 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2722c911-4e49-43ac-884b-8342a62dc75c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab" status: 200 len: 1686 microversion: 2.1 time: 0.165805 Oct 30 02:20:40.722192 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3473/7280] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:20:40 2022] GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab => generated 1686 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:20:41.744629 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e7b912d5-eaf0-4243-be17-5ca138e4fc7f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:20:41.745259 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e7b912d5-eaf0-4243-be17-5ca138e4fc7f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: aefa3d4a-410a-48ec-8ae1-c66ee39b3aab] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:20:41.751654 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e7b912d5-eaf0-4243-be17-5ca138e4fc7f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:41.752157 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e7b912d5-eaf0-4243-be17-5ca138e4fc7f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:41.752610 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e7b912d5-eaf0-4243-be17-5ca138e4fc7f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:41.753314 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e7b912d5-eaf0-4243-be17-5ca138e4fc7f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:41.753815 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e7b912d5-eaf0-4243-be17-5ca138e4fc7f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:41.754258 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e7b912d5-eaf0-4243-be17-5ca138e4fc7f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:41.887874 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e7b912d5-eaf0-4243-be17-5ca138e4fc7f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:20:41.895761 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e7b912d5-eaf0-4243-be17-5ca138e4fc7f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab" status: 200 len: 1686 microversion: 2.1 time: 0.155099 Oct 30 02:20:41.896653 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3808/7281] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:20:41 2022] GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab => generated 1686 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:20:42.920157 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8ac5b634-e3c0-4a23-84cb-9d2a502e3ded tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:20:42.920773 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8ac5b634-e3c0-4a23-84cb-9d2a502e3ded tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: aefa3d4a-410a-48ec-8ae1-c66ee39b3aab] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:20:42.927633 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ac5b634-e3c0-4a23-84cb-9d2a502e3ded tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:42.928115 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ac5b634-e3c0-4a23-84cb-9d2a502e3ded tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:42.928547 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ac5b634-e3c0-4a23-84cb-9d2a502e3ded tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:42.929235 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ac5b634-e3c0-4a23-84cb-9d2a502e3ded tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:42.929709 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ac5b634-e3c0-4a23-84cb-9d2a502e3ded tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:42.930132 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ac5b634-e3c0-4a23-84cb-9d2a502e3ded tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:43.062291 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8ac5b634-e3c0-4a23-84cb-9d2a502e3ded tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:20:43.069987 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8ac5b634-e3c0-4a23-84cb-9d2a502e3ded tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab" status: 200 len: 1686 microversion: 2.1 time: 0.154363 Oct 30 02:20:43.070561 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3474/7282] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:20:42 2022] GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab => generated 1686 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:20:44.092930 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-42dd4ad2-3c3d-470e-9496-875ac4a47e43 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:20:44.093532 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-42dd4ad2-3c3d-470e-9496-875ac4a47e43 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: aefa3d4a-410a-48ec-8ae1-c66ee39b3aab] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:20:44.100290 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-42dd4ad2-3c3d-470e-9496-875ac4a47e43 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:44.100782 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-42dd4ad2-3c3d-470e-9496-875ac4a47e43 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:44.101231 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-42dd4ad2-3c3d-470e-9496-875ac4a47e43 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:44.101961 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-42dd4ad2-3c3d-470e-9496-875ac4a47e43 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:44.102428 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-42dd4ad2-3c3d-470e-9496-875ac4a47e43 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:44.102864 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-42dd4ad2-3c3d-470e-9496-875ac4a47e43 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:44.235299 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-42dd4ad2-3c3d-470e-9496-875ac4a47e43 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:20:44.237775 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-42dd4ad2-3c3d-470e-9496-875ac4a47e43 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab" status: 200 len: 1686 microversion: 2.1 time: 0.148823 Oct 30 02:20:44.238350 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3809/7283] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:20:44 2022] GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab => generated 1686 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:20:45.262433 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bb8fcbf5-6494-4795-a287-ab4708e7ac27 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:20:45.263052 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-bb8fcbf5-6494-4795-a287-ab4708e7ac27 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: aefa3d4a-410a-48ec-8ae1-c66ee39b3aab] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:20:45.270116 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb8fcbf5-6494-4795-a287-ab4708e7ac27 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:45.270603 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb8fcbf5-6494-4795-a287-ab4708e7ac27 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:45.271048 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb8fcbf5-6494-4795-a287-ab4708e7ac27 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:45.271750 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb8fcbf5-6494-4795-a287-ab4708e7ac27 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:45.272209 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb8fcbf5-6494-4795-a287-ab4708e7ac27 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:45.272634 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb8fcbf5-6494-4795-a287-ab4708e7ac27 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:45.403329 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-bb8fcbf5-6494-4795-a287-ab4708e7ac27 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:20:45.411154 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bb8fcbf5-6494-4795-a287-ab4708e7ac27 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab" status: 200 len: 1686 microversion: 2.1 time: 0.153200 Oct 30 02:20:45.411742 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3475/7284] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:20:45 2022] GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab => generated 1686 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:20:46.435124 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-99980685-6150-4c02-8c7b-8f1a2403157c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:20:46.435749 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-99980685-6150-4c02-8c7b-8f1a2403157c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: aefa3d4a-410a-48ec-8ae1-c66ee39b3aab] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:20:46.442694 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-99980685-6150-4c02-8c7b-8f1a2403157c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:46.443189 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-99980685-6150-4c02-8c7b-8f1a2403157c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:46.443634 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-99980685-6150-4c02-8c7b-8f1a2403157c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:46.444331 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-99980685-6150-4c02-8c7b-8f1a2403157c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:46.444992 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-99980685-6150-4c02-8c7b-8f1a2403157c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:46.445224 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-99980685-6150-4c02-8c7b-8f1a2403157c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:46.574000 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-99980685-6150-4c02-8c7b-8f1a2403157c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:20:46.581949 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-99980685-6150-4c02-8c7b-8f1a2403157c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab" status: 200 len: 1686 microversion: 2.1 time: 0.151496 Oct 30 02:20:46.582512 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3810/7285] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:20:46 2022] GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab => generated 1686 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:20:47.605633 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f78978eb-0b9f-44af-81f2-4ce7bb2d93fa tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:20:47.606253 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f78978eb-0b9f-44af-81f2-4ce7bb2d93fa tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: aefa3d4a-410a-48ec-8ae1-c66ee39b3aab] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:20:47.613002 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f78978eb-0b9f-44af-81f2-4ce7bb2d93fa tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:47.613519 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f78978eb-0b9f-44af-81f2-4ce7bb2d93fa tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:47.613954 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f78978eb-0b9f-44af-81f2-4ce7bb2d93fa tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:47.614647 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f78978eb-0b9f-44af-81f2-4ce7bb2d93fa tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:47.615099 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f78978eb-0b9f-44af-81f2-4ce7bb2d93fa tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:47.615523 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f78978eb-0b9f-44af-81f2-4ce7bb2d93fa tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:47.745583 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f78978eb-0b9f-44af-81f2-4ce7bb2d93fa tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:20:47.753990 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f78978eb-0b9f-44af-81f2-4ce7bb2d93fa tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab" status: 200 len: 1686 microversion: 2.1 time: 0.152416 Oct 30 02:20:47.754561 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3476/7286] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:20:47 2022] GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab => generated 1686 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:20:48.778704 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-176dffe3-ba1b-4bce-a282-d99fea295948 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:20:48.779335 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-176dffe3-ba1b-4bce-a282-d99fea295948 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: aefa3d4a-410a-48ec-8ae1-c66ee39b3aab] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:20:48.786235 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-176dffe3-ba1b-4bce-a282-d99fea295948 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:48.786732 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-176dffe3-ba1b-4bce-a282-d99fea295948 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:48.787185 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-176dffe3-ba1b-4bce-a282-d99fea295948 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:48.787890 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-176dffe3-ba1b-4bce-a282-d99fea295948 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:48.788359 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-176dffe3-ba1b-4bce-a282-d99fea295948 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:48.788802 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-176dffe3-ba1b-4bce-a282-d99fea295948 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:48.920757 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-176dffe3-ba1b-4bce-a282-d99fea295948 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:20:48.928709 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-176dffe3-ba1b-4bce-a282-d99fea295948 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab" status: 200 len: 1686 microversion: 2.1 time: 0.153960 Oct 30 02:20:48.929291 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3811/7287] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:20:48 2022] GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab => generated 1686 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:20:49.953499 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cd2214dc-3293-4882-b658-44c286deb37d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:20:49.954118 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-cd2214dc-3293-4882-b658-44c286deb37d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: aefa3d4a-410a-48ec-8ae1-c66ee39b3aab] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:20:49.961316 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd2214dc-3293-4882-b658-44c286deb37d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:49.961845 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd2214dc-3293-4882-b658-44c286deb37d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:49.962289 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd2214dc-3293-4882-b658-44c286deb37d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:49.962995 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd2214dc-3293-4882-b658-44c286deb37d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:49.963454 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd2214dc-3293-4882-b658-44c286deb37d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:49.963885 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd2214dc-3293-4882-b658-44c286deb37d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:50.099461 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-cd2214dc-3293-4882-b658-44c286deb37d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:20:50.107313 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cd2214dc-3293-4882-b658-44c286deb37d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab" status: 200 len: 1686 microversion: 2.1 time: 0.158397 Oct 30 02:20:50.107885 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3477/7288] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:20:49 2022] GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab => generated 1686 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:20:51.131274 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-714ba90b-d855-45c6-b433-b5616f20a5ed tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:20:51.131997 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-714ba90b-d855-45c6-b433-b5616f20a5ed tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: aefa3d4a-410a-48ec-8ae1-c66ee39b3aab] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:20:51.140005 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-714ba90b-d855-45c6-b433-b5616f20a5ed tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:51.140509 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-714ba90b-d855-45c6-b433-b5616f20a5ed tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:51.140955 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-714ba90b-d855-45c6-b433-b5616f20a5ed tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:51.141695 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-714ba90b-d855-45c6-b433-b5616f20a5ed tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:51.142164 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-714ba90b-d855-45c6-b433-b5616f20a5ed tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:51.142596 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-714ba90b-d855-45c6-b433-b5616f20a5ed tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:51.278911 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-714ba90b-d855-45c6-b433-b5616f20a5ed tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:20:51.286793 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-714ba90b-d855-45c6-b433-b5616f20a5ed tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab" status: 200 len: 1685 microversion: 2.1 time: 0.159571 Oct 30 02:20:51.287378 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3812/7289] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:20:51 2022] GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab => generated 1685 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:20:51.562919 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-d4446984-2b11-4952-b690-fd115abdcf1b req-82fd5446-b7c1-46ec-bd21-a598b5ccd70e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aefa3d4a-410a-48ec-8ae1-c66ee39b3aab", "name": "network-vif-unplugged", "status": "completed", "tag": "9e2bfd35-cb11-411d-823d-e12efe2a0c9e"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:20:51.572472 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d4446984-2b11-4952-b690-fd115abdcf1b req-82fd5446-b7c1-46ec-bd21-a598b5ccd70e service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:51.579768 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d4446984-2b11-4952-b690-fd115abdcf1b req-82fd5446-b7c1-46ec-bd21-a598b5ccd70e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:51.579768 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d4446984-2b11-4952-b690-fd115abdcf1b req-82fd5446-b7c1-46ec-bd21-a598b5ccd70e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:51.584929 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-d4446984-2b11-4952-b690-fd115abdcf1b req-82fd5446-b7c1-46ec-bd21-a598b5ccd70e service nova] Creating event network-vif-unplugged:9e2bfd35-cb11-411d-823d-e12efe2a0c9e for instance aefa3d4a-410a-48ec-8ae1-c66ee39b3aab on n-h2-master-1 Oct 30 02:20:51.590675 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [req-d4446984-2b11-4952-b690-fd115abdcf1b req-82fd5446-b7c1-46ec-bd21-a598b5ccd70e service nova] Instance aefa3d4a-410a-48ec-8ae1-c66ee39b3aab is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=121103) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 30 02:20:51.602269 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-d4446984-2b11-4952-b690-fd115abdcf1b req-82fd5446-b7c1-46ec-bd21-a598b5ccd70e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097868 Oct 30 02:20:51.602911 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3478/7290] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:20:52.311898 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6e6353f0-041d-48ac-98f3-b73ac5cd5074 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:20:52.312533 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6e6353f0-041d-48ac-98f3-b73ac5cd5074 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: aefa3d4a-410a-48ec-8ae1-c66ee39b3aab] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:20:52.319725 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e6353f0-041d-48ac-98f3-b73ac5cd5074 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:52.320232 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e6353f0-041d-48ac-98f3-b73ac5cd5074 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:52.320743 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e6353f0-041d-48ac-98f3-b73ac5cd5074 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:52.321500 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e6353f0-041d-48ac-98f3-b73ac5cd5074 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:52.321975 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e6353f0-041d-48ac-98f3-b73ac5cd5074 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:52.322424 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e6353f0-041d-48ac-98f3-b73ac5cd5074 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:52.454145 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6e6353f0-041d-48ac-98f3-b73ac5cd5074 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:20:52.462057 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6e6353f0-041d-48ac-98f3-b73ac5cd5074 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab" status: 200 len: 1685 microversion: 2.1 time: 0.154945 Oct 30 02:20:52.462633 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3813/7291] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:20:52 2022] GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab => generated 1685 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:20:53.487719 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e7c1d42e-cd63-41f1-b1e8-92527e8d7d67 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:20:53.488425 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e7c1d42e-cd63-41f1-b1e8-92527e8d7d67 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: aefa3d4a-410a-48ec-8ae1-c66ee39b3aab] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:20:53.494608 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7c1d42e-cd63-41f1-b1e8-92527e8d7d67 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:53.495096 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7c1d42e-cd63-41f1-b1e8-92527e8d7d67 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:53.495536 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7c1d42e-cd63-41f1-b1e8-92527e8d7d67 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:53.496253 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7c1d42e-cd63-41f1-b1e8-92527e8d7d67 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:53.496712 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7c1d42e-cd63-41f1-b1e8-92527e8d7d67 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:53.497142 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7c1d42e-cd63-41f1-b1e8-92527e8d7d67 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:53.620556 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-8dc8b713-4281-4018-b308-ab4e44842103 req-7434f23f-970e-4c89-8713-8ef70c9f4867 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aefa3d4a-410a-48ec-8ae1-c66ee39b3aab", "tag": "9e2bfd35-cb11-411d-823d-e12efe2a0c9e"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:20:53.631860 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-8dc8b713-4281-4018-b308-ab4e44842103 req-7434f23f-970e-4c89-8713-8ef70c9f4867 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:53.632350 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-8dc8b713-4281-4018-b308-ab4e44842103 req-7434f23f-970e-4c89-8713-8ef70c9f4867 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:53.632790 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-8dc8b713-4281-4018-b308-ab4e44842103 req-7434f23f-970e-4c89-8713-8ef70c9f4867 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:53.634819 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e7c1d42e-cd63-41f1-b1e8-92527e8d7d67 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:20:53.643366 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e7c1d42e-cd63-41f1-b1e8-92527e8d7d67 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab" status: 200 len: 1683 microversion: 2.1 time: 0.160842 Oct 30 02:20:53.645577 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3479/7292] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:20:53 2022] GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:20:53.645704 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-8dc8b713-4281-4018-b308-ab4e44842103 req-7434f23f-970e-4c89-8713-8ef70c9f4867 service nova] Creating event network-changed:9e2bfd35-cb11-411d-823d-e12efe2a0c9e for instance aefa3d4a-410a-48ec-8ae1-c66ee39b3aab on n-h2-master-1 Oct 30 02:20:53.651152 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [req-8dc8b713-4281-4018-b308-ab4e44842103 req-7434f23f-970e-4c89-8713-8ef70c9f4867 service nova] Instance aefa3d4a-410a-48ec-8ae1-c66ee39b3aab is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=121102) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 30 02:20:53.662290 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-8dc8b713-4281-4018-b308-ab4e44842103 req-7434f23f-970e-4c89-8713-8ef70c9f4867 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045374 Oct 30 02:20:53.662891 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3814/7293] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:20:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:20:54.667365 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1ee46bf5-7c66-425a-95f4-4529ab035686 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:20:54.667996 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1ee46bf5-7c66-425a-95f4-4529ab035686 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: aefa3d4a-410a-48ec-8ae1-c66ee39b3aab] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:20:54.675652 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1ee46bf5-7c66-425a-95f4-4529ab035686 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:54.676200 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1ee46bf5-7c66-425a-95f4-4529ab035686 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:54.676636 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1ee46bf5-7c66-425a-95f4-4529ab035686 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:54.677822 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1ee46bf5-7c66-425a-95f4-4529ab035686 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:54.678300 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1ee46bf5-7c66-425a-95f4-4529ab035686 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:54.678729 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1ee46bf5-7c66-425a-95f4-4529ab035686 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:55.026714 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1ee46bf5-7c66-425a-95f4-4529ab035686 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:20:55.034447 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1ee46bf5-7c66-425a-95f4-4529ab035686 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab" status: 200 len: 1680 microversion: 2.1 time: 0.371045 Oct 30 02:20:55.035314 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3480/7294] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:20:54 2022] GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab => generated 1680 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:20:55.059411 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7de69256-a2b4-496e-a3d1-d687aacb7777 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:20:55.060074 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7de69256-a2b4-496e-a3d1-d687aacb7777 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: aefa3d4a-410a-48ec-8ae1-c66ee39b3aab] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:20:55.067274 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7de69256-a2b4-496e-a3d1-d687aacb7777 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:55.067782 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7de69256-a2b4-496e-a3d1-d687aacb7777 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:55.068243 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7de69256-a2b4-496e-a3d1-d687aacb7777 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:55.068953 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7de69256-a2b4-496e-a3d1-d687aacb7777 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:55.069442 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7de69256-a2b4-496e-a3d1-d687aacb7777 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:55.069884 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7de69256-a2b4-496e-a3d1-d687aacb7777 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:55.228859 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7de69256-a2b4-496e-a3d1-d687aacb7777 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "POST /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab/action" status: 204 len: 0 microversion: 2.1 time: 0.174757 Oct 30 02:20:55.229660 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3815/7295] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 02:20:55 2022] POST /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab/action => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 30 02:20:55.238423 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e62a2f77-3307-4fec-9ca1-660c4f0f84a3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:20:55.239236 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e62a2f77-3307-4fec-9ca1-660c4f0f84a3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: aefa3d4a-410a-48ec-8ae1-c66ee39b3aab] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:20:55.245262 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e62a2f77-3307-4fec-9ca1-660c4f0f84a3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:55.245782 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e62a2f77-3307-4fec-9ca1-660c4f0f84a3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:55.246254 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e62a2f77-3307-4fec-9ca1-660c4f0f84a3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:55.246970 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e62a2f77-3307-4fec-9ca1-660c4f0f84a3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:55.247427 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e62a2f77-3307-4fec-9ca1-660c4f0f84a3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:55.247858 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e62a2f77-3307-4fec-9ca1-660c4f0f84a3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:55.388992 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e62a2f77-3307-4fec-9ca1-660c4f0f84a3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:20:55.397779 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e62a2f77-3307-4fec-9ca1-660c4f0f84a3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab" status: 200 len: 1680 microversion: 2.1 time: 0.163231 Oct 30 02:20:55.407927 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3481/7296] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:20:55 2022] GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:20:56.423634 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-638fef7b-12ed-445a-b063-43660616c39c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:20:56.424351 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-638fef7b-12ed-445a-b063-43660616c39c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: aefa3d4a-410a-48ec-8ae1-c66ee39b3aab] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:20:56.430610 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-638fef7b-12ed-445a-b063-43660616c39c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:56.431106 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-638fef7b-12ed-445a-b063-43660616c39c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:56.431557 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-638fef7b-12ed-445a-b063-43660616c39c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:56.432506 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-638fef7b-12ed-445a-b063-43660616c39c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:56.433025 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-638fef7b-12ed-445a-b063-43660616c39c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:56.433494 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-638fef7b-12ed-445a-b063-43660616c39c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:56.564509 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-638fef7b-12ed-445a-b063-43660616c39c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:20:56.572312 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-638fef7b-12ed-445a-b063-43660616c39c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab" status: 200 len: 1680 microversion: 2.1 time: 0.153864 Oct 30 02:20:56.572887 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3816/7297] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:20:56 2022] GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:20:57.578498 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-9ded55b3-e56d-4d17-96e0-a17c9b93a374 req-abf08e5e-1108-4b03-8d1c-5d04e8015915 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aefa3d4a-410a-48ec-8ae1-c66ee39b3aab", "name": "network-vif-plugged", "status": "completed", "tag": "9e2bfd35-cb11-411d-823d-e12efe2a0c9e"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:20:57.588748 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-9ded55b3-e56d-4d17-96e0-a17c9b93a374 req-abf08e5e-1108-4b03-8d1c-5d04e8015915 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:57.589233 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-9ded55b3-e56d-4d17-96e0-a17c9b93a374 req-abf08e5e-1108-4b03-8d1c-5d04e8015915 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:57.589684 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-9ded55b3-e56d-4d17-96e0-a17c9b93a374 req-abf08e5e-1108-4b03-8d1c-5d04e8015915 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:57.595636 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2e9df762-a70d-4943-b51d-028eebf5a801 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:20:57.596274 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2e9df762-a70d-4943-b51d-028eebf5a801 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: aefa3d4a-410a-48ec-8ae1-c66ee39b3aab] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:20:57.600789 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-9ded55b3-e56d-4d17-96e0-a17c9b93a374 req-abf08e5e-1108-4b03-8d1c-5d04e8015915 service nova] Creating event network-vif-plugged:9e2bfd35-cb11-411d-823d-e12efe2a0c9e for instance aefa3d4a-410a-48ec-8ae1-c66ee39b3aab on n-h2-master-1 Oct 30 02:20:57.603058 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2e9df762-a70d-4943-b51d-028eebf5a801 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:57.607920 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2e9df762-a70d-4943-b51d-028eebf5a801 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:57.607920 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2e9df762-a70d-4943-b51d-028eebf5a801 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:57.607920 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2e9df762-a70d-4943-b51d-028eebf5a801 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:57.607920 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2e9df762-a70d-4943-b51d-028eebf5a801 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:57.607920 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2e9df762-a70d-4943-b51d-028eebf5a801 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:57.608338 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-9ded55b3-e56d-4d17-96e0-a17c9b93a374 req-abf08e5e-1108-4b03-8d1c-5d04e8015915 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031795 Oct 30 02:20:57.608338 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3482/7298] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:20:57.740614 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2e9df762-a70d-4943-b51d-028eebf5a801 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:20:57.749066 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2e9df762-a70d-4943-b51d-028eebf5a801 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab" status: 200 len: 1672 microversion: 2.1 time: 0.157353 Oct 30 02:20:57.749687 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3817/7299] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:20:57 2022] GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:20:57.772264 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c8522569-2c46-4e9d-9829-84d95f84cef5 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:20:57.772966 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c8522569-2c46-4e9d-9829-84d95f84cef5 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: aefa3d4a-410a-48ec-8ae1-c66ee39b3aab] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:20:57.779076 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c8522569-2c46-4e9d-9829-84d95f84cef5 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:57.779556 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c8522569-2c46-4e9d-9829-84d95f84cef5 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:57.779988 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c8522569-2c46-4e9d-9829-84d95f84cef5 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:57.780675 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c8522569-2c46-4e9d-9829-84d95f84cef5 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:57.781124 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c8522569-2c46-4e9d-9829-84d95f84cef5 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:57.781573 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c8522569-2c46-4e9d-9829-84d95f84cef5 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:57.912599 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c8522569-2c46-4e9d-9829-84d95f84cef5 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:20:57.917354 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c8522569-2c46-4e9d-9829-84d95f84cef5 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab" status: 200 len: 1672 microversion: 2.1 time: 0.149410 Oct 30 02:20:57.918465 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3483/7300] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:20:57 2022] GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab => generated 1672 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:20:57.940711 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bb17ec24-435f-4635-8fec-42c64a7fe730 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:20:57.941361 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bb17ec24-435f-4635-8fec-42c64a7fe730 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: aefa3d4a-410a-48ec-8ae1-c66ee39b3aab] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:20:57.947269 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb17ec24-435f-4635-8fec-42c64a7fe730 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:57.947766 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb17ec24-435f-4635-8fec-42c64a7fe730 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:57.948216 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb17ec24-435f-4635-8fec-42c64a7fe730 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:57.948918 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb17ec24-435f-4635-8fec-42c64a7fe730 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:57.949445 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb17ec24-435f-4635-8fec-42c64a7fe730 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:57.949885 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb17ec24-435f-4635-8fec-42c64a7fe730 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:57.964400 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:20:58.075741 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bb17ec24-435f-4635-8fec-42c64a7fe730 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:20:58.083473 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bb17ec24-435f-4635-8fec-42c64a7fe730 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab" status: 200 len: 1672 microversion: 2.1 time: 0.146592 Oct 30 02:20:58.084050 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3818/7301] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:20:57 2022] GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab => generated 1672 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:20:58.106637 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7e31215e-4697-4776-8c4a-bfd86306e623 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:20:58.107140 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7e31215e-4697-4776-8c4a-bfd86306e623 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: aefa3d4a-410a-48ec-8ae1-c66ee39b3aab] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:20:58.113096 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7e31215e-4697-4776-8c4a-bfd86306e623 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:58.113645 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7e31215e-4697-4776-8c4a-bfd86306e623 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:58.114082 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7e31215e-4697-4776-8c4a-bfd86306e623 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:58.114774 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7e31215e-4697-4776-8c4a-bfd86306e623 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:58.115227 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7e31215e-4697-4776-8c4a-bfd86306e623 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:58.115650 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7e31215e-4697-4776-8c4a-bfd86306e623 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:58.139916 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7e31215e-4697-4776-8c4a-bfd86306e623 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: aefa3d4a-410a-48ec-8ae1-c66ee39b3aab] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 02:20:58.245041 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:20:58.417852 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7e31215e-4697-4776-8c4a-bfd86306e623 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "DELETE /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab" status: 204 len: 0 microversion: 2.1 time: 0.315328 Oct 30 02:20:58.419134 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3484/7302] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 02:20:58 2022] DELETE /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 02:20:58.427509 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f1eb1731-3364-4c0f-b75d-64f14fc03c0c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:20:58.428065 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f1eb1731-3364-4c0f-b75d-64f14fc03c0c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: aefa3d4a-410a-48ec-8ae1-c66ee39b3aab] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:20:58.434330 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f1eb1731-3364-4c0f-b75d-64f14fc03c0c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:58.434823 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f1eb1731-3364-4c0f-b75d-64f14fc03c0c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:58.435267 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f1eb1731-3364-4c0f-b75d-64f14fc03c0c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:58.435964 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f1eb1731-3364-4c0f-b75d-64f14fc03c0c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:58.436424 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f1eb1731-3364-4c0f-b75d-64f14fc03c0c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:58.436889 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f1eb1731-3364-4c0f-b75d-64f14fc03c0c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:58.567197 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f1eb1731-3364-4c0f-b75d-64f14fc03c0c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:20:58.575475 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f1eb1731-3364-4c0f-b75d-64f14fc03c0c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab" status: 200 len: 1678 microversion: 2.1 time: 0.151928 Oct 30 02:20:58.576039 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3819/7303] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:20:58 2022] GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:20:59.599682 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1a92d042-7635-4f29-a021-709a0f37d0ce tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:20:59.600384 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1a92d042-7635-4f29-a021-709a0f37d0ce tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: aefa3d4a-410a-48ec-8ae1-c66ee39b3aab] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:20:59.608484 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a92d042-7635-4f29-a021-709a0f37d0ce tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:59.608974 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a92d042-7635-4f29-a021-709a0f37d0ce tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:59.609447 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a92d042-7635-4f29-a021-709a0f37d0ce tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:59.610175 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a92d042-7635-4f29-a021-709a0f37d0ce tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:20:59.610665 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a92d042-7635-4f29-a021-709a0f37d0ce tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:20:59.611089 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a92d042-7635-4f29-a021-709a0f37d0ce tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:20:59.745287 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1a92d042-7635-4f29-a021-709a0f37d0ce tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:20:59.753012 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1a92d042-7635-4f29-a021-709a0f37d0ce tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab" status: 200 len: 1678 microversion: 2.1 time: 0.157629 Oct 30 02:20:59.753619 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3485/7304] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:20:59 2022] GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:21:00.775836 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e55b08f5-3db6-4930-a950-c3614278e8a7 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:21:00.776558 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e55b08f5-3db6-4930-a950-c3614278e8a7 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: aefa3d4a-410a-48ec-8ae1-c66ee39b3aab] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:21:00.784748 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-b00f22a5-6781-4fce-90f4-24e73d9a52e4 req-f74816e0-449c-4e11-95a3-36fd831d5401 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aefa3d4a-410a-48ec-8ae1-c66ee39b3aab", "name": "network-vif-deleted", "tag": "9e2bfd35-cb11-411d-823d-e12efe2a0c9e"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:21:00.792165 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e55b08f5-3db6-4930-a950-c3614278e8a7 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:21:00.792662 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e55b08f5-3db6-4930-a950-c3614278e8a7 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:21:00.793701 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e55b08f5-3db6-4930-a950-c3614278e8a7 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:21:00.794415 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e55b08f5-3db6-4930-a950-c3614278e8a7 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:21:00.794866 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e55b08f5-3db6-4930-a950-c3614278e8a7 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:21:00.795291 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e55b08f5-3db6-4930-a950-c3614278e8a7 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:21:00.801439 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-b00f22a5-6781-4fce-90f4-24e73d9a52e4 req-f74816e0-449c-4e11-95a3-36fd831d5401 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:21:00.802042 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-b00f22a5-6781-4fce-90f4-24e73d9a52e4 req-f74816e0-449c-4e11-95a3-36fd831d5401 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:21:00.802309 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-b00f22a5-6781-4fce-90f4-24e73d9a52e4 req-f74816e0-449c-4e11-95a3-36fd831d5401 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:21:00.815060 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-b00f22a5-6781-4fce-90f4-24e73d9a52e4 req-f74816e0-449c-4e11-95a3-36fd831d5401 service nova] Creating event network-vif-deleted:9e2bfd35-cb11-411d-823d-e12efe2a0c9e for instance aefa3d4a-410a-48ec-8ae1-c66ee39b3aab on n-h2-master-1 Oct 30 02:21:00.820984 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-b00f22a5-6781-4fce-90f4-24e73d9a52e4 req-f74816e0-449c-4e11-95a3-36fd831d5401 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050615 Oct 30 02:21:00.821639 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3820/7305] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:21:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:21:00.871755 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e55b08f5-3db6-4930-a950-c3614278e8a7 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:21:00.876186 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e55b08f5-3db6-4930-a950-c3614278e8a7 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab" status: 200 len: 1610 microversion: 2.1 time: 0.104150 Oct 30 02:21:00.876860 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3486/7306] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:21:00 2022] GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab => generated 1610 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:21:01.900834 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-76716c2c-c2d3-4e8f-aebb-18d0982eb232 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:21:01.901580 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-76716c2c-c2d3-4e8f-aebb-18d0982eb232 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: aefa3d4a-410a-48ec-8ae1-c66ee39b3aab] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:21:01.907757 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-76716c2c-c2d3-4e8f-aebb-18d0982eb232 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:21:01.908246 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-76716c2c-c2d3-4e8f-aebb-18d0982eb232 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:21:01.908690 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-76716c2c-c2d3-4e8f-aebb-18d0982eb232 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:21:01.909409 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-76716c2c-c2d3-4e8f-aebb-18d0982eb232 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:21:01.909874 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-76716c2c-c2d3-4e8f-aebb-18d0982eb232 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:21:01.910304 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-76716c2c-c2d3-4e8f-aebb-18d0982eb232 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:21:01.923234 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-76716c2c-c2d3-4e8f-aebb-18d0982eb232 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] HTTP exception thrown: Instance aefa3d4a-410a-48ec-8ae1-c66ee39b3aab could not be found. Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-76716c2c-c2d3-4e8f-aebb-18d0982eb232 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Request method failure captured: Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab HTTP/1.1 Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXd8_AaHeYv7mI8KcOiEpHHSLt3xix4i3AijgcSjiVH8gCZDNZTQs2eKPUSYf3-FI8TMZsjcfFPTEgO2BYtL_E0r7tuLX6t2K_PeaBE5t7gXNmnm97kpENPfU_RCfhh6EcQIjwoSMcBV6P-7_37AV6319KodCPKJo_De4zA522gc3ZJc Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: ec54882ff5fa47fe9303222e3f936de9 Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServerActionsTestJSON-1524178034 Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServerActionsTestJSON-1524178034 Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: ec54882ff5fa47fe9303222e3f936de9 Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServerActionsTestJSON-1524178034 Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServerActionsTestJSON-1524178034-project Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: bd6a4d32970a4d72be7109ceaf173241 Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServerActionsTestJSON-1524178034-project Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: exception: Instance aefa3d4a-410a-48ec-8ae1-c66ee39b3aab could not be found. Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'aefa3d4a-410a-48ec-8ae1-c66ee39b3aab'} Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aefa3d4a-410a-48ec-8ae1-c66ee39b3aab could not be found. Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aefa3d4a-410a-48ec-8ae1-c66ee39b3aab could not be found. Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:21:01.924833 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:21:01.930002 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:21:01.930002 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:21:01.930002 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:21:01.930002 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:21:01.930002 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:21:01.930002 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aefa3d4a-410a-48ec-8ae1-c66ee39b3aab could not be found. Oct 30 02:21:01.930002 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:21:01.930002 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-76716c2c-c2d3-4e8f-aebb-18d0982eb232 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Returning 404 to user: Instance aefa3d4a-410a-48ec-8ae1-c66ee39b3aab could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:21:01.930002 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-76716c2c-c2d3-4e8f-aebb-18d0982eb232 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab" status: 404 len: 111 microversion: 2.1 time: 0.030747 Oct 30 02:21:01.930002 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3821/7307] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:21:01 2022] GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 02:21:01.939810 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c1c41528-18ed-4bf6-a279-37cdd4cf1fd7 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:21:01.940438 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c1c41528-18ed-4bf6-a279-37cdd4cf1fd7 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: aefa3d4a-410a-48ec-8ae1-c66ee39b3aab] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:21:01.947432 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c1c41528-18ed-4bf6-a279-37cdd4cf1fd7 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:21:01.947924 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c1c41528-18ed-4bf6-a279-37cdd4cf1fd7 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:21:01.948368 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c1c41528-18ed-4bf6-a279-37cdd4cf1fd7 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:21:01.949764 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c1c41528-18ed-4bf6-a279-37cdd4cf1fd7 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:21:01.950239 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c1c41528-18ed-4bf6-a279-37cdd4cf1fd7 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:21:01.950672 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c1c41528-18ed-4bf6-a279-37cdd4cf1fd7 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:21:01.964184 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-c1c41528-18ed-4bf6-a279-37cdd4cf1fd7 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] HTTP exception thrown: Instance aefa3d4a-410a-48ec-8ae1-c66ee39b3aab could not be found. Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c1c41528-18ed-4bf6-a279-37cdd4cf1fd7 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Request method failure captured: Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab HTTP/1.1 Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXd8_AaHeYv7mI8KcOiEpHHSLt3xix4i3AijgcSjiVH8gCZDNZTQs2eKPUSYf3-FI8TMZsjcfFPTEgO2BYtL_E0r7tuLX6t2K_PeaBE5t7gXNmnm97kpENPfU_RCfhh6EcQIjwoSMcBV6P-7_37AV6319KodCPKJo_De4zA522gc3ZJc Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: ec54882ff5fa47fe9303222e3f936de9 Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServerActionsTestJSON-1524178034 Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServerActionsTestJSON-1524178034 Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: ec54882ff5fa47fe9303222e3f936de9 Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServerActionsTestJSON-1524178034 Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServerActionsTestJSON-1524178034-project Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: bd6a4d32970a4d72be7109ceaf173241 Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServerActionsTestJSON-1524178034-project Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: exception: Instance aefa3d4a-410a-48ec-8ae1-c66ee39b3aab could not be found. Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'aefa3d4a-410a-48ec-8ae1-c66ee39b3aab'} Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aefa3d4a-410a-48ec-8ae1-c66ee39b3aab could not be found. Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aefa3d4a-410a-48ec-8ae1-c66ee39b3aab could not be found. Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:21:01.965910 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:21:01.970575 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:21:01.970575 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:21:01.970575 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:21:01.970575 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:21:01.970575 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:21:01.970575 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aefa3d4a-410a-48ec-8ae1-c66ee39b3aab could not be found. Oct 30 02:21:01.970575 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:21:01.970575 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c1c41528-18ed-4bf6-a279-37cdd4cf1fd7 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Returning 404 to user: Instance aefa3d4a-410a-48ec-8ae1-c66ee39b3aab could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:21:01.970575 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c1c41528-18ed-4bf6-a279-37cdd4cf1fd7 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab" status: 404 len: 111 microversion: 2.1 time: 0.031411 Oct 30 02:21:01.970575 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3487/7308] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:21:01 2022] GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 02:21:02.016994 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c6cb038a-1b6e-4687-b8fe-34cec7f4e9be tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1937294201", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "69a7f320-9fb0-467c-85eb-ca0c978501c8"}], "security_groups": [{"name": "tempest-securitygroup--1896496015"}], "key_name": "tempest-keypair-1057397827", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:21:02.122157 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-c6cb038a-1b6e-4687-b8fe-34cec7f4e9be tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] validate_networks() for [('69a7f320-9fb0-467c-85eb-ca0c978501c8', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 02:21:02.482768 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-c6cb038a-1b6e-4687-b8fe-34cec7f4e9be tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 02:21:02.483333 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-c6cb038a-1b6e-4687-b8fe-34cec7f4e9be tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 02:21:02.483836 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-c6cb038a-1b6e-4687-b8fe-34cec7f4e9be tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 02:21:02.484267 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-c6cb038a-1b6e-4687-b8fe-34cec7f4e9be tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 02:21:02.484750 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-c6cb038a-1b6e-4687-b8fe-34cec7f4e9be tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 02:21:02.493725 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c6cb038a-1b6e-4687-b8fe-34cec7f4e9be tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:21:02.495930 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c6cb038a-1b6e-4687-b8fe-34cec7f4e9be tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:21:02.495930 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c6cb038a-1b6e-4687-b8fe-34cec7f4e9be tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:21:02.495930 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c6cb038a-1b6e-4687-b8fe-34cec7f4e9be tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:21:02.495930 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c6cb038a-1b6e-4687-b8fe-34cec7f4e9be tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:21:02.496990 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c6cb038a-1b6e-4687-b8fe-34cec7f4e9be tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:21:02.513692 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-c6cb038a-1b6e-4687-b8fe-34cec7f4e9be tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Getting quotas for project ec54882ff5fa47fe9303222e3f936de9. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 02:21:02.519152 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-c6cb038a-1b6e-4687-b8fe-34cec7f4e9be tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Getting quotas for user bd6a4d32970a4d72be7109ceaf173241 and project ec54882ff5fa47fe9303222e3f936de9. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 02:21:02.531888 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c6cb038a-1b6e-4687-b8fe-34cec7f4e9be tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 02:21:02.534276 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c6cb038a-1b6e-4687-b8fe-34cec7f4e9be tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 85f98d02-ecf3-44d8-85b1-d0ca91c4064c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 02:21:02.643326 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c6cb038a-1b6e-4687-b8fe-34cec7f4e9be tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.630098 Oct 30 02:21:02.643904 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3822/7309] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 02:21:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 02:21:02.655937 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b44a9791-8b32-4e77-b1ce-73aa6f345274 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:21:02.656665 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b44a9791-8b32-4e77-b1ce-73aa6f345274 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 85f98d02-ecf3-44d8-85b1-d0ca91c4064c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:21:02.717935 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b44a9791-8b32-4e77-b1ce-73aa6f345274 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:21:02.728163 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b44a9791-8b32-4e77-b1ce-73aa6f345274 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c" status: 200 len: 1239 microversion: 2.1 time: 0.073931 Oct 30 02:21:02.728163 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3488/7310] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:21:02 2022] GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c => generated 1239 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:21:03.750496 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0282d299-c294-4b5a-a092-d56e5748f37f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:21:03.751119 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0282d299-c294-4b5a-a092-d56e5748f37f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 85f98d02-ecf3-44d8-85b1-d0ca91c4064c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:21:03.760397 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0282d299-c294-4b5a-a092-d56e5748f37f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:21:03.760898 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0282d299-c294-4b5a-a092-d56e5748f37f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:21:03.761357 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0282d299-c294-4b5a-a092-d56e5748f37f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:21:03.762094 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0282d299-c294-4b5a-a092-d56e5748f37f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:21:03.762559 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0282d299-c294-4b5a-a092-d56e5748f37f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:21:03.762992 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0282d299-c294-4b5a-a092-d56e5748f37f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:21:03.824620 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0282d299-c294-4b5a-a092-d56e5748f37f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:21:03.832343 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0282d299-c294-4b5a-a092-d56e5748f37f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c" status: 200 len: 1235 microversion: 2.1 time: 0.087332 Oct 30 02:21:03.832955 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3823/7311] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:21:03 2022] GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c => generated 1235 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:21:04.856094 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5d0e4bbe-729b-43a8-9769-971581939b70 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:21:04.856774 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5d0e4bbe-729b-43a8-9769-971581939b70 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 85f98d02-ecf3-44d8-85b1-d0ca91c4064c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:21:04.864615 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5d0e4bbe-729b-43a8-9769-971581939b70 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:21:04.865118 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5d0e4bbe-729b-43a8-9769-971581939b70 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:21:04.865588 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5d0e4bbe-729b-43a8-9769-971581939b70 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:21:04.866309 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5d0e4bbe-729b-43a8-9769-971581939b70 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:21:04.866769 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5d0e4bbe-729b-43a8-9769-971581939b70 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:21:04.867201 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5d0e4bbe-729b-43a8-9769-971581939b70 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:21:04.936204 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5d0e4bbe-729b-43a8-9769-971581939b70 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:21:04.944465 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5d0e4bbe-729b-43a8-9769-971581939b70 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c" status: 200 len: 1297 microversion: 2.1 time: 0.092453 Oct 30 02:21:04.945296 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3489/7312] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:21:04 2022] GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c => generated 1297 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:21:05.968925 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-78ef8052-3c4c-49b9-ba10-5efcc38a6807 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:21:05.969699 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-78ef8052-3c4c-49b9-ba10-5efcc38a6807 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 85f98d02-ecf3-44d8-85b1-d0ca91c4064c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:21:05.972556 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:21:05.977450 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-78ef8052-3c4c-49b9-ba10-5efcc38a6807 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:21:05.977984 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-78ef8052-3c4c-49b9-ba10-5efcc38a6807 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:21:05.978491 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-78ef8052-3c4c-49b9-ba10-5efcc38a6807 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:21:05.979206 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-78ef8052-3c4c-49b9-ba10-5efcc38a6807 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:21:05.979707 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-78ef8052-3c4c-49b9-ba10-5efcc38a6807 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:21:05.980150 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-78ef8052-3c4c-49b9-ba10-5efcc38a6807 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:21:06.181770 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-78ef8052-3c4c-49b9-ba10-5efcc38a6807 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:21:06.189711 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-78ef8052-3c4c-49b9-ba10-5efcc38a6807 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c" status: 200 len: 1365 microversion: 2.1 time: 0.225478 Oct 30 02:21:06.190284 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3824/7313] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:21:05 2022] GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c => generated 1365 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:21:06.350459 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-1bd77044-dd0a-40a0-abb0-b4034b288a81 req-e9e99658-be41-4206-a39f-f0c648f9849c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85f98d02-ecf3-44d8-85b1-d0ca91c4064c", "tag": "e9b2958f-185b-4d87-a328-4f14cdfd3bbd"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:21:06.356405 n-d-master-1 devstack@n-api.service[121103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 30 02:21:06.357857 n-d-master-1 devstack@n-api.service[121103]: Sun Oct 30 02:21:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.13) !!! Oct 30 02:21:06.358521 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:21:06.368636 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-1bd77044-dd0a-40a0-abb0-b4034b288a81 req-e9e99658-be41-4206-a39f-f0c648f9849c service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:21:06.369141 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-1bd77044-dd0a-40a0-abb0-b4034b288a81 req-e9e99658-be41-4206-a39f-f0c648f9849c service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:21:06.369617 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-1bd77044-dd0a-40a0-abb0-b4034b288a81 req-e9e99658-be41-4206-a39f-f0c648f9849c service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:21:06.382693 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-1bd77044-dd0a-40a0-abb0-b4034b288a81 req-e9e99658-be41-4206-a39f-f0c648f9849c service nova] Creating event network-changed:e9b2958f-185b-4d87-a328-4f14cdfd3bbd for instance 85f98d02-ecf3-44d8-85b1-d0ca91c4064c on n-h1-master-1 Oct 30 02:21:06.388371 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-1bd77044-dd0a-40a0-abb0-b4034b288a81 req-e9e99658-be41-4206-a39f-f0c648f9849c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041794 Oct 30 02:21:06.389174 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3490/7314] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:21:07.214710 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a14ab43b-7760-4991-abef-48ba822e4c3c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:21:07.215950 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a14ab43b-7760-4991-abef-48ba822e4c3c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 85f98d02-ecf3-44d8-85b1-d0ca91c4064c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:21:07.223272 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a14ab43b-7760-4991-abef-48ba822e4c3c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:21:07.223769 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a14ab43b-7760-4991-abef-48ba822e4c3c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:21:07.224218 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a14ab43b-7760-4991-abef-48ba822e4c3c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:21:07.224925 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a14ab43b-7760-4991-abef-48ba822e4c3c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:21:07.226063 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a14ab43b-7760-4991-abef-48ba822e4c3c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:21:07.226675 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a14ab43b-7760-4991-abef-48ba822e4c3c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:21:07.364411 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a14ab43b-7760-4991-abef-48ba822e4c3c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:21:07.372357 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a14ab43b-7760-4991-abef-48ba822e4c3c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c" status: 200 len: 1365 microversion: 2.1 time: 0.162405 Oct 30 02:21:07.372930 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3825/7315] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:21:07 2022] GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:21:08.397209 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-469193af-91cb-4393-9ebe-25e1a60d7c06 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:21:08.397972 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-469193af-91cb-4393-9ebe-25e1a60d7c06 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 85f98d02-ecf3-44d8-85b1-d0ca91c4064c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:21:08.404759 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-469193af-91cb-4393-9ebe-25e1a60d7c06 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:21:08.405249 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-469193af-91cb-4393-9ebe-25e1a60d7c06 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:21:08.405716 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-469193af-91cb-4393-9ebe-25e1a60d7c06 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:21:08.406407 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-469193af-91cb-4393-9ebe-25e1a60d7c06 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:21:08.406866 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-469193af-91cb-4393-9ebe-25e1a60d7c06 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:21:08.407295 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-469193af-91cb-4393-9ebe-25e1a60d7c06 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:21:08.538039 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-469193af-91cb-4393-9ebe-25e1a60d7c06 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:21:08.546194 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-469193af-91cb-4393-9ebe-25e1a60d7c06 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c" status: 200 len: 1365 microversion: 2.1 time: 0.154377 Oct 30 02:21:08.546766 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3491/7316] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:21:08 2022] GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:21:09.570046 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b31b0164-0260-48f9-9b1d-5cbdf3cd9868 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:21:09.570675 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b31b0164-0260-48f9-9b1d-5cbdf3cd9868 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 85f98d02-ecf3-44d8-85b1-d0ca91c4064c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:21:09.578210 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b31b0164-0260-48f9-9b1d-5cbdf3cd9868 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:21:09.578712 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b31b0164-0260-48f9-9b1d-5cbdf3cd9868 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:21:09.579168 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b31b0164-0260-48f9-9b1d-5cbdf3cd9868 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:21:09.579879 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b31b0164-0260-48f9-9b1d-5cbdf3cd9868 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:21:09.580348 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b31b0164-0260-48f9-9b1d-5cbdf3cd9868 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:21:09.580790 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b31b0164-0260-48f9-9b1d-5cbdf3cd9868 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:21:09.707500 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b31b0164-0260-48f9-9b1d-5cbdf3cd9868 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:21:09.715150 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b31b0164-0260-48f9-9b1d-5cbdf3cd9868 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c" status: 200 len: 1365 microversion: 2.1 time: 0.148999 Oct 30 02:21:09.715717 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3826/7317] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:21:09 2022] GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:21:10.738933 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-051ce420-a873-443a-b367-fa5f331dea84 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:21:10.739460 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-051ce420-a873-443a-b367-fa5f331dea84 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 85f98d02-ecf3-44d8-85b1-d0ca91c4064c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:21:10.746301 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-051ce420-a873-443a-b367-fa5f331dea84 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:21:10.746784 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-051ce420-a873-443a-b367-fa5f331dea84 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:21:10.747218 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-051ce420-a873-443a-b367-fa5f331dea84 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:21:10.747901 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-051ce420-a873-443a-b367-fa5f331dea84 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:21:10.748354 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-051ce420-a873-443a-b367-fa5f331dea84 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:21:10.748804 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-051ce420-a873-443a-b367-fa5f331dea84 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:21:10.877085 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-051ce420-a873-443a-b367-fa5f331dea84 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:21:10.884967 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-051ce420-a873-443a-b367-fa5f331dea84 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c" status: 200 len: 1365 microversion: 2.1 time: 0.150026 Oct 30 02:21:10.885578 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3492/7318] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:21:10 2022] GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:21:11.909177 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-eb10ec38-0d06-4c0c-9dcd-d51d6d2f9278 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:21:11.909849 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-eb10ec38-0d06-4c0c-9dcd-d51d6d2f9278 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 85f98d02-ecf3-44d8-85b1-d0ca91c4064c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:21:11.916000 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eb10ec38-0d06-4c0c-9dcd-d51d6d2f9278 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:21:11.916502 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eb10ec38-0d06-4c0c-9dcd-d51d6d2f9278 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:21:11.916951 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eb10ec38-0d06-4c0c-9dcd-d51d6d2f9278 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:21:11.917685 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eb10ec38-0d06-4c0c-9dcd-d51d6d2f9278 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:21:11.918709 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eb10ec38-0d06-4c0c-9dcd-d51d6d2f9278 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:21:11.919153 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eb10ec38-0d06-4c0c-9dcd-d51d6d2f9278 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:21:12.017861 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-0e82fe9f-b203-4ed8-b0bd-94958c287bc2 req-6531229e-7185-4673-8395-846eca79fa05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85f98d02-ecf3-44d8-85b1-d0ca91c4064c", "name": "network-vif-plugged", "status": "completed", "tag": "e9b2958f-185b-4d87-a328-4f14cdfd3bbd"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:21:12.028901 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-0e82fe9f-b203-4ed8-b0bd-94958c287bc2 req-6531229e-7185-4673-8395-846eca79fa05 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:21:12.029424 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-0e82fe9f-b203-4ed8-b0bd-94958c287bc2 req-6531229e-7185-4673-8395-846eca79fa05 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:21:12.029856 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-0e82fe9f-b203-4ed8-b0bd-94958c287bc2 req-6531229e-7185-4673-8395-846eca79fa05 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:21:12.041378 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-0e82fe9f-b203-4ed8-b0bd-94958c287bc2 req-6531229e-7185-4673-8395-846eca79fa05 service nova] Creating event network-vif-plugged:e9b2958f-185b-4d87-a328-4f14cdfd3bbd for instance 85f98d02-ecf3-44d8-85b1-d0ca91c4064c on n-h1-master-1 Oct 30 02:21:12.046615 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-0e82fe9f-b203-4ed8-b0bd-94958c287bc2 req-6531229e-7185-4673-8395-846eca79fa05 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033029 Oct 30 02:21:12.047222 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3493/7319] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:21:12.056684 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-eb10ec38-0d06-4c0c-9dcd-d51d6d2f9278 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:21:12.064778 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-eb10ec38-0d06-4c0c-9dcd-d51d6d2f9278 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c" status: 200 len: 1365 microversion: 2.1 time: 0.159728 Oct 30 02:21:12.065281 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3827/7320] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:21:11 2022] GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:21:13.085560 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:21:13.091647 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e3261140-4ff7-4790-86d4-37d1c23b03b4 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:21:13.092429 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e3261140-4ff7-4790-86d4-37d1c23b03b4 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 85f98d02-ecf3-44d8-85b1-d0ca91c4064c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:21:13.098477 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e3261140-4ff7-4790-86d4-37d1c23b03b4 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:21:13.098964 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e3261140-4ff7-4790-86d4-37d1c23b03b4 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:21:13.099399 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e3261140-4ff7-4790-86d4-37d1c23b03b4 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:21:13.100082 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e3261140-4ff7-4790-86d4-37d1c23b03b4 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:21:13.100534 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e3261140-4ff7-4790-86d4-37d1c23b03b4 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:21:13.100956 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e3261140-4ff7-4790-86d4-37d1c23b03b4 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:21:13.237884 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e3261140-4ff7-4790-86d4-37d1c23b03b4 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:21:13.245791 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e3261140-4ff7-4790-86d4-37d1c23b03b4 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c" status: 200 len: 1365 microversion: 2.1 time: 0.161195 Oct 30 02:21:13.247759 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3494/7321] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:21:13 2022] GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:21:14.269246 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8e84502f-dbec-42d4-93d5-7f9f7a347b30 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:21:14.269855 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8e84502f-dbec-42d4-93d5-7f9f7a347b30 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 85f98d02-ecf3-44d8-85b1-d0ca91c4064c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:21:14.271751 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:21:14.272503 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=6 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:21:14.278134 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8e84502f-dbec-42d4-93d5-7f9f7a347b30 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:21:14.278665 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8e84502f-dbec-42d4-93d5-7f9f7a347b30 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:21:14.279125 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8e84502f-dbec-42d4-93d5-7f9f7a347b30 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:21:14.279863 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8e84502f-dbec-42d4-93d5-7f9f7a347b30 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:21:14.280335 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8e84502f-dbec-42d4-93d5-7f9f7a347b30 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:21:14.280779 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8e84502f-dbec-42d4-93d5-7f9f7a347b30 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:21:14.409597 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8e84502f-dbec-42d4-93d5-7f9f7a347b30 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:21:14.417257 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8e84502f-dbec-42d4-93d5-7f9f7a347b30 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c" status: 200 len: 1552 microversion: 2.1 time: 0.151989 Oct 30 02:21:14.417852 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3828/7322] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:21:14 2022] GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c => generated 1552 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:21:14.441296 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-faa6ed5f-c145-4dc3-bc11-8e2cded2602b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:21:14.441822 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-faa6ed5f-c145-4dc3-bc11-8e2cded2602b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 85f98d02-ecf3-44d8-85b1-d0ca91c4064c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:21:14.448646 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-faa6ed5f-c145-4dc3-bc11-8e2cded2602b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:21:14.449128 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-faa6ed5f-c145-4dc3-bc11-8e2cded2602b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:21:14.449597 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-faa6ed5f-c145-4dc3-bc11-8e2cded2602b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:21:14.450290 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-faa6ed5f-c145-4dc3-bc11-8e2cded2602b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:21:14.450745 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-faa6ed5f-c145-4dc3-bc11-8e2cded2602b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:21:14.451172 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-faa6ed5f-c145-4dc3-bc11-8e2cded2602b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:21:14.526782 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-faa6ed5f-c145-4dc3-bc11-8e2cded2602b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089359 Oct 30 02:21:14.527387 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3495/7323] 10.222.0.13 () {58 vars in 1275 bytes} [Sun Oct 30 02:21:14 2022] GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:21:15.495868 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-61b216fd-472d-4a03-806e-c3119347bdf3 req-e914593f-73fd-4750-ad83-781908f1fa72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85f98d02-ecf3-44d8-85b1-d0ca91c4064c", "tag": "e9b2958f-185b-4d87-a328-4f14cdfd3bbd"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:21:15.506814 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-61b216fd-472d-4a03-806e-c3119347bdf3 req-e914593f-73fd-4750-ad83-781908f1fa72 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:21:15.507389 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-61b216fd-472d-4a03-806e-c3119347bdf3 req-e914593f-73fd-4750-ad83-781908f1fa72 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:21:15.507901 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-61b216fd-472d-4a03-806e-c3119347bdf3 req-e914593f-73fd-4750-ad83-781908f1fa72 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:21:15.519434 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-61b216fd-472d-4a03-806e-c3119347bdf3 req-e914593f-73fd-4750-ad83-781908f1fa72 service nova] Creating event network-changed:e9b2958f-185b-4d87-a328-4f14cdfd3bbd for instance 85f98d02-ecf3-44d8-85b1-d0ca91c4064c on n-h1-master-1 Oct 30 02:21:15.524535 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-61b216fd-472d-4a03-806e-c3119347bdf3 req-e914593f-73fd-4750-ad83-781908f1fa72 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032330 Oct 30 02:21:15.525208 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3829/7324] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:21:48.418295 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=11 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:21:48.419051 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=46 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:21:48.423655 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c0f227bd-a862-4a0a-bc10-94c97b2152f0 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:21:48.429519 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0f227bd-a862-4a0a-bc10-94c97b2152f0 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:21:48.430002 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0f227bd-a862-4a0a-bc10-94c97b2152f0 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:21:48.430443 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0f227bd-a862-4a0a-bc10-94c97b2152f0 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:21:48.452481 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c0f227bd-a862-4a0a-bc10-94c97b2152f0 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 85f98d02-ecf3-44d8-85b1-d0ca91c4064c] Going to try to stop instance {{(pid=121103) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 30 02:21:48.602924 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c0f227bd-a862-4a0a-bc10-94c97b2152f0 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "POST /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c/action" status: 202 len: 0 microversion: 2.1 time: 0.186333 Oct 30 02:21:48.603635 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3496/7325] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 02:21:48 2022] POST /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 02:21:48.610591 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=11 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:21:48.611840 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=53 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:21:48.616062 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5b1b5982-c13a-4b36-b3c5-8f8981741e2f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:21:48.616958 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5b1b5982-c13a-4b36-b3c5-8f8981741e2f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 85f98d02-ecf3-44d8-85b1-d0ca91c4064c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:21:48.623012 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5b1b5982-c13a-4b36-b3c5-8f8981741e2f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:21:48.623504 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5b1b5982-c13a-4b36-b3c5-8f8981741e2f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:21:48.623952 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5b1b5982-c13a-4b36-b3c5-8f8981741e2f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:21:48.624657 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5b1b5982-c13a-4b36-b3c5-8f8981741e2f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:21:48.625124 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5b1b5982-c13a-4b36-b3c5-8f8981741e2f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:21:48.625588 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5b1b5982-c13a-4b36-b3c5-8f8981741e2f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:21:48.764125 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5b1b5982-c13a-4b36-b3c5-8f8981741e2f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:21:48.772510 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5b1b5982-c13a-4b36-b3c5-8f8981741e2f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c" status: 200 len: 1681 microversion: 2.1 time: 0.164365 Oct 30 02:21:48.773096 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3830/7326] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:21:48 2022] GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:21:49.797563 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9e801987-7adf-4611-bfe8-63535a394f1b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:21:49.798843 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9e801987-7adf-4611-bfe8-63535a394f1b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 85f98d02-ecf3-44d8-85b1-d0ca91c4064c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:21:49.805077 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e801987-7adf-4611-bfe8-63535a394f1b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:21:49.805591 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e801987-7adf-4611-bfe8-63535a394f1b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:21:49.806301 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e801987-7adf-4611-bfe8-63535a394f1b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:21:49.806990 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e801987-7adf-4611-bfe8-63535a394f1b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:21:49.807446 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e801987-7adf-4611-bfe8-63535a394f1b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:21:49.807873 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e801987-7adf-4611-bfe8-63535a394f1b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:21:49.990129 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9e801987-7adf-4611-bfe8-63535a394f1b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:21:49.997854 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9e801987-7adf-4611-bfe8-63535a394f1b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c" status: 200 len: 1681 microversion: 2.1 time: 0.205454 Oct 30 02:21:49.998437 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3497/7327] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:21:49 2022] GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c => generated 1681 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:21:51.021911 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-945b3172-f992-4015-9f66-4c79f0c27080 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:21:51.022540 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-945b3172-f992-4015-9f66-4c79f0c27080 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 85f98d02-ecf3-44d8-85b1-d0ca91c4064c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:21:51.029538 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-945b3172-f992-4015-9f66-4c79f0c27080 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:21:51.030042 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-945b3172-f992-4015-9f66-4c79f0c27080 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:21:51.030494 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-945b3172-f992-4015-9f66-4c79f0c27080 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:21:51.031277 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-945b3172-f992-4015-9f66-4c79f0c27080 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:21:51.031743 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-945b3172-f992-4015-9f66-4c79f0c27080 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:21:51.032180 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-945b3172-f992-4015-9f66-4c79f0c27080 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:21:51.162407 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-945b3172-f992-4015-9f66-4c79f0c27080 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:21:51.170225 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-945b3172-f992-4015-9f66-4c79f0c27080 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c" status: 200 len: 1681 microversion: 2.1 time: 0.152282 Oct 30 02:21:51.170802 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3831/7328] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:21:51 2022] GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:21:52.194174 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-07dadfd8-0217-4627-8310-9fd9d87fcbf5 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:21:52.194794 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-07dadfd8-0217-4627-8310-9fd9d87fcbf5 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 85f98d02-ecf3-44d8-85b1-d0ca91c4064c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:21:52.201708 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-07dadfd8-0217-4627-8310-9fd9d87fcbf5 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:21:52.202185 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-07dadfd8-0217-4627-8310-9fd9d87fcbf5 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:21:52.202622 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-07dadfd8-0217-4627-8310-9fd9d87fcbf5 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:21:52.203303 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-07dadfd8-0217-4627-8310-9fd9d87fcbf5 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:21:52.203750 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-07dadfd8-0217-4627-8310-9fd9d87fcbf5 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:21:52.204780 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-07dadfd8-0217-4627-8310-9fd9d87fcbf5 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:21:52.334087 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-07dadfd8-0217-4627-8310-9fd9d87fcbf5 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:21:52.341769 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-07dadfd8-0217-4627-8310-9fd9d87fcbf5 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c" status: 200 len: 1681 microversion: 2.1 time: 0.151542 Oct 30 02:21:52.342340 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3498/7329] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:21:52 2022] GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:21:53.364601 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4a8474ed-3450-4737-9e82-cbd26ed53cfb tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:21:53.365233 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4a8474ed-3450-4737-9e82-cbd26ed53cfb tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 85f98d02-ecf3-44d8-85b1-d0ca91c4064c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:21:53.372202 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a8474ed-3450-4737-9e82-cbd26ed53cfb tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:21:53.372696 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a8474ed-3450-4737-9e82-cbd26ed53cfb tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:21:53.373148 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a8474ed-3450-4737-9e82-cbd26ed53cfb tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:21:53.373893 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a8474ed-3450-4737-9e82-cbd26ed53cfb tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:21:53.374358 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a8474ed-3450-4737-9e82-cbd26ed53cfb tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:21:53.374796 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a8474ed-3450-4737-9e82-cbd26ed53cfb tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:21:53.501848 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4a8474ed-3450-4737-9e82-cbd26ed53cfb tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:21:53.509614 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4a8474ed-3450-4737-9e82-cbd26ed53cfb tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c" status: 200 len: 1681 microversion: 2.1 time: 0.148948 Oct 30 02:21:53.510192 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3832/7330] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:21:53 2022] GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:21:54.533570 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-dfee8f5e-40f0-4ca3-9fef-fea55650f2c4 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:21:54.534161 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-dfee8f5e-40f0-4ca3-9fef-fea55650f2c4 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 85f98d02-ecf3-44d8-85b1-d0ca91c4064c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:21:54.541600 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dfee8f5e-40f0-4ca3-9fef-fea55650f2c4 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:21:54.542092 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dfee8f5e-40f0-4ca3-9fef-fea55650f2c4 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:21:54.542535 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dfee8f5e-40f0-4ca3-9fef-fea55650f2c4 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:21:54.543245 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dfee8f5e-40f0-4ca3-9fef-fea55650f2c4 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:21:54.543706 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dfee8f5e-40f0-4ca3-9fef-fea55650f2c4 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:21:54.544137 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dfee8f5e-40f0-4ca3-9fef-fea55650f2c4 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:21:54.674518 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-dfee8f5e-40f0-4ca3-9fef-fea55650f2c4 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:21:54.682655 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-dfee8f5e-40f0-4ca3-9fef-fea55650f2c4 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c" status: 200 len: 1681 microversion: 2.1 time: 0.153621 Oct 30 02:21:54.683285 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3499/7331] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:21:54 2022] GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:21:55.704895 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-72b4f55e-b6b0-4bda-9a0b-2fb8fe6fe153 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:21:55.705542 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-72b4f55e-b6b0-4bda-9a0b-2fb8fe6fe153 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 85f98d02-ecf3-44d8-85b1-d0ca91c4064c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:21:55.712364 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-72b4f55e-b6b0-4bda-9a0b-2fb8fe6fe153 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:21:55.712916 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-72b4f55e-b6b0-4bda-9a0b-2fb8fe6fe153 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:21:55.713383 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-72b4f55e-b6b0-4bda-9a0b-2fb8fe6fe153 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:21:55.714078 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-72b4f55e-b6b0-4bda-9a0b-2fb8fe6fe153 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:21:55.714542 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-72b4f55e-b6b0-4bda-9a0b-2fb8fe6fe153 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:21:55.714971 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-72b4f55e-b6b0-4bda-9a0b-2fb8fe6fe153 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:21:55.846215 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-72b4f55e-b6b0-4bda-9a0b-2fb8fe6fe153 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:21:55.854175 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-72b4f55e-b6b0-4bda-9a0b-2fb8fe6fe153 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c" status: 200 len: 1681 microversion: 2.1 time: 0.153144 Oct 30 02:21:55.854748 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3833/7332] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:21:55 2022] GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:21:56.878897 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-272d0b77-2346-4ae2-97c1-aacdce8a139c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:21:56.879522 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-272d0b77-2346-4ae2-97c1-aacdce8a139c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 85f98d02-ecf3-44d8-85b1-d0ca91c4064c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:21:56.886450 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-272d0b77-2346-4ae2-97c1-aacdce8a139c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:21:56.886946 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-272d0b77-2346-4ae2-97c1-aacdce8a139c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:21:56.887391 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-272d0b77-2346-4ae2-97c1-aacdce8a139c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:21:56.888100 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-272d0b77-2346-4ae2-97c1-aacdce8a139c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:21:56.888561 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-272d0b77-2346-4ae2-97c1-aacdce8a139c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:21:56.888992 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-272d0b77-2346-4ae2-97c1-aacdce8a139c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:21:57.015923 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-272d0b77-2346-4ae2-97c1-aacdce8a139c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:21:57.023668 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-272d0b77-2346-4ae2-97c1-aacdce8a139c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c" status: 200 len: 1681 microversion: 2.1 time: 0.149406 Oct 30 02:21:57.024248 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3500/7333] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:21:56 2022] GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:21:58.046596 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3aee624f-ce02-430f-b2e6-5fa5a93d2283 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:21:58.047225 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3aee624f-ce02-430f-b2e6-5fa5a93d2283 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 85f98d02-ecf3-44d8-85b1-d0ca91c4064c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:21:58.054577 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3aee624f-ce02-430f-b2e6-5fa5a93d2283 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:21:58.055069 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3aee624f-ce02-430f-b2e6-5fa5a93d2283 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:21:58.055768 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3aee624f-ce02-430f-b2e6-5fa5a93d2283 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:21:58.056472 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3aee624f-ce02-430f-b2e6-5fa5a93d2283 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:21:58.056931 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3aee624f-ce02-430f-b2e6-5fa5a93d2283 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:21:58.057390 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3aee624f-ce02-430f-b2e6-5fa5a93d2283 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:21:58.182303 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3aee624f-ce02-430f-b2e6-5fa5a93d2283 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:21:58.192250 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3aee624f-ce02-430f-b2e6-5fa5a93d2283 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c" status: 200 len: 1681 microversion: 2.1 time: 0.147750 Oct 30 02:21:58.192250 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3834/7334] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:21:58 2022] GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:21:59.213254 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-91572bed-9232-4ef1-9bf6-79224b38c589 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:21:59.213909 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-91572bed-9232-4ef1-9bf6-79224b38c589 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 85f98d02-ecf3-44d8-85b1-d0ca91c4064c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:21:59.220758 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91572bed-9232-4ef1-9bf6-79224b38c589 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:21:59.221238 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91572bed-9232-4ef1-9bf6-79224b38c589 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:21:59.221703 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91572bed-9232-4ef1-9bf6-79224b38c589 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:21:59.222391 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91572bed-9232-4ef1-9bf6-79224b38c589 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:21:59.222851 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91572bed-9232-4ef1-9bf6-79224b38c589 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:21:59.223271 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91572bed-9232-4ef1-9bf6-79224b38c589 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:21:59.355782 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-91572bed-9232-4ef1-9bf6-79224b38c589 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:21:59.364362 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-91572bed-9232-4ef1-9bf6-79224b38c589 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c" status: 200 len: 1681 microversion: 2.1 time: 0.154993 Oct 30 02:21:59.365069 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3501/7335] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:21:59 2022] GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:22:00.388349 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-437e1a4b-21b3-420b-85ab-010758f0701e tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:22:00.388973 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-437e1a4b-21b3-420b-85ab-010758f0701e tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 85f98d02-ecf3-44d8-85b1-d0ca91c4064c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:22:00.396460 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-437e1a4b-21b3-420b-85ab-010758f0701e tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:00.396952 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-437e1a4b-21b3-420b-85ab-010758f0701e tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:00.397413 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-437e1a4b-21b3-420b-85ab-010758f0701e tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:00.398110 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-437e1a4b-21b3-420b-85ab-010758f0701e tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:00.398572 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-437e1a4b-21b3-420b-85ab-010758f0701e tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:00.399010 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-437e1a4b-21b3-420b-85ab-010758f0701e tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:00.527753 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-437e1a4b-21b3-420b-85ab-010758f0701e tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:22:00.535359 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-437e1a4b-21b3-420b-85ab-010758f0701e tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c" status: 200 len: 1681 microversion: 2.1 time: 0.151216 Oct 30 02:22:00.535929 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3835/7336] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:22:00 2022] GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:22:01.559193 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-552e7d6d-307a-4a7a-b610-84d7d4b6bb5f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:22:01.559812 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-552e7d6d-307a-4a7a-b610-84d7d4b6bb5f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 85f98d02-ecf3-44d8-85b1-d0ca91c4064c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:22:01.566699 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-552e7d6d-307a-4a7a-b610-84d7d4b6bb5f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:01.567184 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-552e7d6d-307a-4a7a-b610-84d7d4b6bb5f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:01.567617 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-552e7d6d-307a-4a7a-b610-84d7d4b6bb5f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:01.568309 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-552e7d6d-307a-4a7a-b610-84d7d4b6bb5f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:01.568787 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-552e7d6d-307a-4a7a-b610-84d7d4b6bb5f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:01.569212 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-552e7d6d-307a-4a7a-b610-84d7d4b6bb5f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:01.696835 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-552e7d6d-307a-4a7a-b610-84d7d4b6bb5f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:22:01.704668 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-552e7d6d-307a-4a7a-b610-84d7d4b6bb5f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c" status: 200 len: 1681 microversion: 2.1 time: 0.149696 Oct 30 02:22:01.705250 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3502/7337] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:22:01 2022] GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:22:02.728328 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-daf74e1c-5b21-4844-a382-69618a684efd tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:22:02.729014 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-daf74e1c-5b21-4844-a382-69618a684efd tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 85f98d02-ecf3-44d8-85b1-d0ca91c4064c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:22:02.735860 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-daf74e1c-5b21-4844-a382-69618a684efd tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:02.736355 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-daf74e1c-5b21-4844-a382-69618a684efd tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:02.736804 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-daf74e1c-5b21-4844-a382-69618a684efd tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:02.737537 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-daf74e1c-5b21-4844-a382-69618a684efd tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:02.738008 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-daf74e1c-5b21-4844-a382-69618a684efd tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:02.738468 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-daf74e1c-5b21-4844-a382-69618a684efd tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:03.121597 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-daf74e1c-5b21-4844-a382-69618a684efd tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:22:03.129874 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-daf74e1c-5b21-4844-a382-69618a684efd tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c" status: 200 len: 1681 microversion: 2.1 time: 0.405442 Oct 30 02:22:03.130441 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3836/7338] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:22:02 2022] GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c => generated 1681 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:22:04.153098 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ba70d8f1-b050-4cd1-ae7f-a51eef14a542 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:22:04.153707 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ba70d8f1-b050-4cd1-ae7f-a51eef14a542 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 85f98d02-ecf3-44d8-85b1-d0ca91c4064c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:22:04.160264 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ba70d8f1-b050-4cd1-ae7f-a51eef14a542 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:04.160754 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ba70d8f1-b050-4cd1-ae7f-a51eef14a542 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:04.161233 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ba70d8f1-b050-4cd1-ae7f-a51eef14a542 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:04.161921 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ba70d8f1-b050-4cd1-ae7f-a51eef14a542 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:04.162379 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ba70d8f1-b050-4cd1-ae7f-a51eef14a542 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:04.162806 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ba70d8f1-b050-4cd1-ae7f-a51eef14a542 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:04.299123 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ba70d8f1-b050-4cd1-ae7f-a51eef14a542 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:22:04.307288 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ba70d8f1-b050-4cd1-ae7f-a51eef14a542 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c" status: 200 len: 1681 microversion: 2.1 time: 0.158206 Oct 30 02:22:04.307869 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3503/7339] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:22:04 2022] GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:22:05.331537 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b6bd59e5-fff9-4263-903b-b16d3fc762c6 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:22:05.332160 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b6bd59e5-fff9-4263-903b-b16d3fc762c6 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 85f98d02-ecf3-44d8-85b1-d0ca91c4064c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:22:05.341163 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b6bd59e5-fff9-4263-903b-b16d3fc762c6 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:05.341697 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b6bd59e5-fff9-4263-903b-b16d3fc762c6 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:05.342143 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b6bd59e5-fff9-4263-903b-b16d3fc762c6 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:05.342849 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b6bd59e5-fff9-4263-903b-b16d3fc762c6 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:05.343312 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b6bd59e5-fff9-4263-903b-b16d3fc762c6 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:05.343745 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b6bd59e5-fff9-4263-903b-b16d3fc762c6 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:05.469625 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b6bd59e5-fff9-4263-903b-b16d3fc762c6 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:22:05.477662 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b6bd59e5-fff9-4263-903b-b16d3fc762c6 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c" status: 200 len: 1658 microversion: 2.1 time: 0.150604 Oct 30 02:22:05.478219 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3837/7340] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:22:05 2022] GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c => generated 1658 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:22:05.500037 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-10fcb9da-92be-45dc-9812-264bd20d18b6 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:22:05.502827 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-10fcb9da-92be-45dc-9812-264bd20d18b6 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 85f98d02-ecf3-44d8-85b1-d0ca91c4064c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:22:05.509579 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-10fcb9da-92be-45dc-9812-264bd20d18b6 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:05.510070 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-10fcb9da-92be-45dc-9812-264bd20d18b6 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:05.510510 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-10fcb9da-92be-45dc-9812-264bd20d18b6 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:05.511208 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-10fcb9da-92be-45dc-9812-264bd20d18b6 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:05.511664 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-10fcb9da-92be-45dc-9812-264bd20d18b6 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:05.512090 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-10fcb9da-92be-45dc-9812-264bd20d18b6 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:05.596155 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-10fcb9da-92be-45dc-9812-264bd20d18b6 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:22:05.600230 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-10fcb9da-92be-45dc-9812-264bd20d18b6 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 85f98d02-ecf3-44d8-85b1-d0ca91c4064c] Old instance type m1.heat2, new instance type m1.heat {{(pid=121103) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 30 02:22:05.607002 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-10fcb9da-92be-45dc-9812-264bd20d18b6 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 02:22:05.607527 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-10fcb9da-92be-45dc-9812-264bd20d18b6 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 02:22:05.608017 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-10fcb9da-92be-45dc-9812-264bd20d18b6 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 02:22:05.608428 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-10fcb9da-92be-45dc-9812-264bd20d18b6 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 02:22:05.608846 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-10fcb9da-92be-45dc-9812-264bd20d18b6 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 02:22:05.820361 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-10fcb9da-92be-45dc-9812-264bd20d18b6 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "POST /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c/action" status: 202 len: 0 microversion: 2.1 time: 0.324136 Oct 30 02:22:05.820974 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3504/7341] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 02:22:05 2022] POST /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 02:22:05.829168 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-06de68cd-93ab-49bf-b532-5dd936a3b0f3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:22:05.829865 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-06de68cd-93ab-49bf-b532-5dd936a3b0f3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 85f98d02-ecf3-44d8-85b1-d0ca91c4064c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:22:05.839650 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-06de68cd-93ab-49bf-b532-5dd936a3b0f3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:05.839650 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-06de68cd-93ab-49bf-b532-5dd936a3b0f3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:05.839650 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-06de68cd-93ab-49bf-b532-5dd936a3b0f3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:05.839650 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-06de68cd-93ab-49bf-b532-5dd936a3b0f3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:05.839650 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-06de68cd-93ab-49bf-b532-5dd936a3b0f3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:05.839650 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-06de68cd-93ab-49bf-b532-5dd936a3b0f3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:05.972422 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-06de68cd-93ab-49bf-b532-5dd936a3b0f3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:22:05.980158 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-06de68cd-93ab-49bf-b532-5dd936a3b0f3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c" status: 200 len: 1681 microversion: 2.1 time: 0.154867 Oct 30 02:22:05.980727 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3838/7342] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:22:05 2022] GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:22:07.005153 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a76276c1-8c1e-4a6f-9a53-866b8b74eecb tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:22:07.005810 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a76276c1-8c1e-4a6f-9a53-866b8b74eecb tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 85f98d02-ecf3-44d8-85b1-d0ca91c4064c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:22:07.012811 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a76276c1-8c1e-4a6f-9a53-866b8b74eecb tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:07.013310 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a76276c1-8c1e-4a6f-9a53-866b8b74eecb tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:07.013770 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a76276c1-8c1e-4a6f-9a53-866b8b74eecb tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:07.014467 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a76276c1-8c1e-4a6f-9a53-866b8b74eecb tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:07.014921 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a76276c1-8c1e-4a6f-9a53-866b8b74eecb tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:07.015346 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a76276c1-8c1e-4a6f-9a53-866b8b74eecb tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:07.149257 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a76276c1-8c1e-4a6f-9a53-866b8b74eecb tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:22:07.157270 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a76276c1-8c1e-4a6f-9a53-866b8b74eecb tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c" status: 200 len: 1681 microversion: 2.1 time: 0.157431 Oct 30 02:22:07.159664 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3505/7343] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:22:06 2022] GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:22:08.180870 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cb084838-ac76-4088-a366-c02817c771cc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:22:08.181540 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cb084838-ac76-4088-a366-c02817c771cc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 85f98d02-ecf3-44d8-85b1-d0ca91c4064c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:22:08.188591 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cb084838-ac76-4088-a366-c02817c771cc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:08.189112 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cb084838-ac76-4088-a366-c02817c771cc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:08.189644 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cb084838-ac76-4088-a366-c02817c771cc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:08.195370 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cb084838-ac76-4088-a366-c02817c771cc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:08.195370 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cb084838-ac76-4088-a366-c02817c771cc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:08.195370 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cb084838-ac76-4088-a366-c02817c771cc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:08.355682 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-cb084838-ac76-4088-a366-c02817c771cc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:22:08.363589 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cb084838-ac76-4088-a366-c02817c771cc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c" status: 200 len: 1681 microversion: 2.1 time: 0.187356 Oct 30 02:22:08.364161 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3839/7344] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:22:08 2022] GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c => generated 1681 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:22:09.387283 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c31b50de-9529-433f-bcec-35a4d89c4daf tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:22:09.387894 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c31b50de-9529-433f-bcec-35a4d89c4daf tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 85f98d02-ecf3-44d8-85b1-d0ca91c4064c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:22:09.394903 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c31b50de-9529-433f-bcec-35a4d89c4daf tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:09.395328 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c31b50de-9529-433f-bcec-35a4d89c4daf tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:09.395761 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c31b50de-9529-433f-bcec-35a4d89c4daf tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:09.396444 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c31b50de-9529-433f-bcec-35a4d89c4daf tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:09.396895 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c31b50de-9529-433f-bcec-35a4d89c4daf tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:09.397318 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c31b50de-9529-433f-bcec-35a4d89c4daf tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:09.529760 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c31b50de-9529-433f-bcec-35a4d89c4daf tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:22:09.538156 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c31b50de-9529-433f-bcec-35a4d89c4daf tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c" status: 200 len: 1686 microversion: 2.1 time: 0.155146 Oct 30 02:22:09.538727 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3506/7345] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:22:09 2022] GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c => generated 1686 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:22:10.562105 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bd15228e-7850-4c2c-9132-2feeec36bcb7 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:22:10.562768 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bd15228e-7850-4c2c-9132-2feeec36bcb7 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 85f98d02-ecf3-44d8-85b1-d0ca91c4064c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:22:10.570459 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bd15228e-7850-4c2c-9132-2feeec36bcb7 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:10.570958 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bd15228e-7850-4c2c-9132-2feeec36bcb7 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:10.571405 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bd15228e-7850-4c2c-9132-2feeec36bcb7 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:10.572110 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bd15228e-7850-4c2c-9132-2feeec36bcb7 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:10.572580 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bd15228e-7850-4c2c-9132-2feeec36bcb7 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:10.573016 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bd15228e-7850-4c2c-9132-2feeec36bcb7 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:10.703534 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bd15228e-7850-4c2c-9132-2feeec36bcb7 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:22:10.711289 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bd15228e-7850-4c2c-9132-2feeec36bcb7 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c" status: 200 len: 1686 microversion: 2.1 time: 0.153310 Oct 30 02:22:10.711858 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3840/7346] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:22:10 2022] GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c => generated 1686 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:22:11.614871 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-e4e12704-04f3-4f52-a1af-a1256fb62a75 req-e17b5afe-15ab-4faf-a173-2aa56f706a8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85f98d02-ecf3-44d8-85b1-d0ca91c4064c", "name": "network-vif-unplugged", "status": "completed", "tag": "e9b2958f-185b-4d87-a328-4f14cdfd3bbd"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:22:11.625428 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e4e12704-04f3-4f52-a1af-a1256fb62a75 req-e17b5afe-15ab-4faf-a173-2aa56f706a8d service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:11.625907 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e4e12704-04f3-4f52-a1af-a1256fb62a75 req-e17b5afe-15ab-4faf-a173-2aa56f706a8d service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:11.626335 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e4e12704-04f3-4f52-a1af-a1256fb62a75 req-e17b5afe-15ab-4faf-a173-2aa56f706a8d service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:11.638809 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-e4e12704-04f3-4f52-a1af-a1256fb62a75 req-e17b5afe-15ab-4faf-a173-2aa56f706a8d service nova] Creating event network-vif-unplugged:e9b2958f-185b-4d87-a328-4f14cdfd3bbd for instance 85f98d02-ecf3-44d8-85b1-d0ca91c4064c on n-h2-master-1 Oct 30 02:22:11.644649 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [req-e4e12704-04f3-4f52-a1af-a1256fb62a75 req-e17b5afe-15ab-4faf-a173-2aa56f706a8d service nova] Instance 85f98d02-ecf3-44d8-85b1-d0ca91c4064c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=121103) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 30 02:22:11.655519 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-e4e12704-04f3-4f52-a1af-a1256fb62a75 req-e17b5afe-15ab-4faf-a173-2aa56f706a8d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044610 Oct 30 02:22:11.656097 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3507/7347] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:22:11.735192 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-78e9dd90-48e2-4eb7-9404-fb7e2493ca05 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:22:11.735837 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-78e9dd90-48e2-4eb7-9404-fb7e2493ca05 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 85f98d02-ecf3-44d8-85b1-d0ca91c4064c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:22:11.742825 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-78e9dd90-48e2-4eb7-9404-fb7e2493ca05 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:11.743331 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-78e9dd90-48e2-4eb7-9404-fb7e2493ca05 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:11.743784 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-78e9dd90-48e2-4eb7-9404-fb7e2493ca05 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:11.744510 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-78e9dd90-48e2-4eb7-9404-fb7e2493ca05 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:11.744975 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-78e9dd90-48e2-4eb7-9404-fb7e2493ca05 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:11.745436 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-78e9dd90-48e2-4eb7-9404-fb7e2493ca05 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:11.884841 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-78e9dd90-48e2-4eb7-9404-fb7e2493ca05 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:22:11.893363 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-78e9dd90-48e2-4eb7-9404-fb7e2493ca05 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c" status: 200 len: 1685 microversion: 2.1 time: 0.162181 Oct 30 02:22:11.897401 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3841/7348] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:22:11 2022] GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c => generated 1685 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:22:12.917686 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ad3c766e-d522-4f88-a185-b4122b85437f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:22:12.918385 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ad3c766e-d522-4f88-a185-b4122b85437f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 85f98d02-ecf3-44d8-85b1-d0ca91c4064c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:22:12.925273 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ad3c766e-d522-4f88-a185-b4122b85437f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:12.925800 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ad3c766e-d522-4f88-a185-b4122b85437f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:12.926237 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ad3c766e-d522-4f88-a185-b4122b85437f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:12.926931 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ad3c766e-d522-4f88-a185-b4122b85437f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:12.927383 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ad3c766e-d522-4f88-a185-b4122b85437f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:12.927807 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ad3c766e-d522-4f88-a185-b4122b85437f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:13.059415 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ad3c766e-d522-4f88-a185-b4122b85437f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:22:13.068910 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ad3c766e-d522-4f88-a185-b4122b85437f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c" status: 200 len: 1685 microversion: 2.1 time: 0.155492 Oct 30 02:22:13.069534 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3508/7349] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:22:12 2022] GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c => generated 1685 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:22:13.669910 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-ee8384f9-a206-4da4-9b58-9de88072d86e req-b22befca-720d-49a5-b12f-59f7e1610278 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85f98d02-ecf3-44d8-85b1-d0ca91c4064c", "tag": "e9b2958f-185b-4d87-a328-4f14cdfd3bbd"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:22:13.680995 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ee8384f9-a206-4da4-9b58-9de88072d86e req-b22befca-720d-49a5-b12f-59f7e1610278 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:13.681513 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ee8384f9-a206-4da4-9b58-9de88072d86e req-b22befca-720d-49a5-b12f-59f7e1610278 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:13.681958 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ee8384f9-a206-4da4-9b58-9de88072d86e req-b22befca-720d-49a5-b12f-59f7e1610278 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:13.693372 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-ee8384f9-a206-4da4-9b58-9de88072d86e req-b22befca-720d-49a5-b12f-59f7e1610278 service nova] Creating event network-changed:e9b2958f-185b-4d87-a328-4f14cdfd3bbd for instance 85f98d02-ecf3-44d8-85b1-d0ca91c4064c on n-h2-master-1 Oct 30 02:22:13.698917 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [req-ee8384f9-a206-4da4-9b58-9de88072d86e req-b22befca-720d-49a5-b12f-59f7e1610278 service nova] Instance 85f98d02-ecf3-44d8-85b1-d0ca91c4064c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=121102) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 30 02:22:13.709787 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-ee8384f9-a206-4da4-9b58-9de88072d86e req-b22befca-720d-49a5-b12f-59f7e1610278 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043600 Oct 30 02:22:13.710366 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3842/7350] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:22:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:22:14.093168 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-70d8db53-8cf8-4b6d-986d-d91b7dcd165c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:22:14.093828 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-70d8db53-8cf8-4b6d-986d-d91b7dcd165c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 85f98d02-ecf3-44d8-85b1-d0ca91c4064c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:22:14.101481 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-70d8db53-8cf8-4b6d-986d-d91b7dcd165c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:14.101982 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-70d8db53-8cf8-4b6d-986d-d91b7dcd165c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:14.102425 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-70d8db53-8cf8-4b6d-986d-d91b7dcd165c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:14.103137 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-70d8db53-8cf8-4b6d-986d-d91b7dcd165c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:14.103595 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-70d8db53-8cf8-4b6d-986d-d91b7dcd165c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:14.104035 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-70d8db53-8cf8-4b6d-986d-d91b7dcd165c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:14.242238 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-70d8db53-8cf8-4b6d-986d-d91b7dcd165c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:22:14.249978 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-70d8db53-8cf8-4b6d-986d-d91b7dcd165c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c" status: 200 len: 1683 microversion: 2.1 time: 0.160786 Oct 30 02:22:14.250561 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3509/7351] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:22:14 2022] GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:22:15.275086 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-22bbaa83-5f6f-464a-a243-7bd45e48232a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:22:15.275860 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-22bbaa83-5f6f-464a-a243-7bd45e48232a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 85f98d02-ecf3-44d8-85b1-d0ca91c4064c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:22:15.286408 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-22bbaa83-5f6f-464a-a243-7bd45e48232a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:15.286913 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-22bbaa83-5f6f-464a-a243-7bd45e48232a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:15.287368 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-22bbaa83-5f6f-464a-a243-7bd45e48232a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:15.288423 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-22bbaa83-5f6f-464a-a243-7bd45e48232a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:15.288907 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-22bbaa83-5f6f-464a-a243-7bd45e48232a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:15.289371 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-22bbaa83-5f6f-464a-a243-7bd45e48232a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:15.422836 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-22bbaa83-5f6f-464a-a243-7bd45e48232a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:22:15.431484 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-22bbaa83-5f6f-464a-a243-7bd45e48232a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c" status: 200 len: 1679 microversion: 2.1 time: 0.161800 Oct 30 02:22:15.432056 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3843/7352] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:22:15 2022] GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:22:15.453816 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-700dbfef-0379-46de-b460-9911d3cfbf50 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:22:15.454337 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-700dbfef-0379-46de-b460-9911d3cfbf50 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 85f98d02-ecf3-44d8-85b1-d0ca91c4064c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:22:15.461094 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-700dbfef-0379-46de-b460-9911d3cfbf50 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:15.461612 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-700dbfef-0379-46de-b460-9911d3cfbf50 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:15.462047 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-700dbfef-0379-46de-b460-9911d3cfbf50 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:15.462735 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-700dbfef-0379-46de-b460-9911d3cfbf50 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:15.463186 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-700dbfef-0379-46de-b460-9911d3cfbf50 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:15.463609 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-700dbfef-0379-46de-b460-9911d3cfbf50 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:15.483370 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:22:15.655521 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-700dbfef-0379-46de-b460-9911d3cfbf50 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "POST /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c/action" status: 204 len: 0 microversion: 2.1 time: 0.205490 Oct 30 02:22:15.656171 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3510/7353] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 02:22:15 2022] POST /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c/action => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 02:22:15.665456 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2358b542-bff9-4e54-aa0f-2199143c148c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:22:15.666233 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2358b542-bff9-4e54-aa0f-2199143c148c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 85f98d02-ecf3-44d8-85b1-d0ca91c4064c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:22:15.672374 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2358b542-bff9-4e54-aa0f-2199143c148c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:15.672814 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2358b542-bff9-4e54-aa0f-2199143c148c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:15.673262 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2358b542-bff9-4e54-aa0f-2199143c148c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:15.674000 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2358b542-bff9-4e54-aa0f-2199143c148c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:15.674466 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2358b542-bff9-4e54-aa0f-2199143c148c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:15.677620 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2358b542-bff9-4e54-aa0f-2199143c148c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:15.841277 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2358b542-bff9-4e54-aa0f-2199143c148c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:22:15.852574 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2358b542-bff9-4e54-aa0f-2199143c148c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c" status: 200 len: 1679 microversion: 2.1 time: 0.191197 Oct 30 02:22:15.853165 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3844/7354] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:22:15 2022] GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c => generated 1679 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:22:16.878672 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e163c316-2001-4c1a-aca4-549333d767b7 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:22:16.879379 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e163c316-2001-4c1a-aca4-549333d767b7 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 85f98d02-ecf3-44d8-85b1-d0ca91c4064c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:22:16.886578 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e163c316-2001-4c1a-aca4-549333d767b7 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:16.887063 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e163c316-2001-4c1a-aca4-549333d767b7 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:16.887494 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e163c316-2001-4c1a-aca4-549333d767b7 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:16.888246 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e163c316-2001-4c1a-aca4-549333d767b7 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:16.888699 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e163c316-2001-4c1a-aca4-549333d767b7 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:16.889120 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e163c316-2001-4c1a-aca4-549333d767b7 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:17.022412 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e163c316-2001-4c1a-aca4-549333d767b7 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:22:17.030433 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e163c316-2001-4c1a-aca4-549333d767b7 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c" status: 200 len: 1679 microversion: 2.1 time: 0.158388 Oct 30 02:22:17.031000 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3511/7355] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:22:16 2022] GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:22:18.052824 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-dc16e382-4fe6-4e78-81d5-3d8abafdd6f6 req-d2d1ae8b-8006-459c-a87f-de60802cc69e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85f98d02-ecf3-44d8-85b1-d0ca91c4064c", "name": "network-vif-plugged", "status": "completed", "tag": "e9b2958f-185b-4d87-a328-4f14cdfd3bbd"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:22:18.055245 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-08254322-b2d9-4b27-8325-efcd1186520a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:22:18.056120 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-08254322-b2d9-4b27-8325-efcd1186520a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 85f98d02-ecf3-44d8-85b1-d0ca91c4064c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:22:18.063111 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08254322-b2d9-4b27-8325-efcd1186520a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:18.063604 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08254322-b2d9-4b27-8325-efcd1186520a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:18.068361 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-dc16e382-4fe6-4e78-81d5-3d8abafdd6f6 req-d2d1ae8b-8006-459c-a87f-de60802cc69e service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:18.068488 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08254322-b2d9-4b27-8325-efcd1186520a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:18.068600 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-dc16e382-4fe6-4e78-81d5-3d8abafdd6f6 req-d2d1ae8b-8006-459c-a87f-de60802cc69e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:18.068600 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-dc16e382-4fe6-4e78-81d5-3d8abafdd6f6 req-d2d1ae8b-8006-459c-a87f-de60802cc69e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:18.068763 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08254322-b2d9-4b27-8325-efcd1186520a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:18.068763 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08254322-b2d9-4b27-8325-efcd1186520a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:18.068763 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-08254322-b2d9-4b27-8325-efcd1186520a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:18.078082 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-dc16e382-4fe6-4e78-81d5-3d8abafdd6f6 req-d2d1ae8b-8006-459c-a87f-de60802cc69e service nova] Creating event network-vif-plugged:e9b2958f-185b-4d87-a328-4f14cdfd3bbd for instance 85f98d02-ecf3-44d8-85b1-d0ca91c4064c on n-h2-master-1 Oct 30 02:22:18.083372 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-dc16e382-4fe6-4e78-81d5-3d8abafdd6f6 req-d2d1ae8b-8006-459c-a87f-de60802cc69e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035049 Oct 30 02:22:18.083972 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3845/7356] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:22:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:22:18.201967 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-08254322-b2d9-4b27-8325-efcd1186520a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:22:18.209874 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-08254322-b2d9-4b27-8325-efcd1186520a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c" status: 200 len: 1658 microversion: 2.1 time: 0.158773 Oct 30 02:22:18.212680 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3512/7357] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:22:18 2022] GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c => generated 1658 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:22:18.232922 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-19642dc5-7807-4f36-a898-60b38388d442 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:22:18.233650 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-19642dc5-7807-4f36-a898-60b38388d442 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 85f98d02-ecf3-44d8-85b1-d0ca91c4064c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:22:18.240277 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-19642dc5-7807-4f36-a898-60b38388d442 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:18.245410 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-19642dc5-7807-4f36-a898-60b38388d442 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:18.245410 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-19642dc5-7807-4f36-a898-60b38388d442 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:18.245410 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-19642dc5-7807-4f36-a898-60b38388d442 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:18.245410 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-19642dc5-7807-4f36-a898-60b38388d442 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:18.245410 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-19642dc5-7807-4f36-a898-60b38388d442 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:18.371885 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-19642dc5-7807-4f36-a898-60b38388d442 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:22:18.379683 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-19642dc5-7807-4f36-a898-60b38388d442 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c" status: 200 len: 1658 microversion: 2.1 time: 0.151049 Oct 30 02:22:18.380250 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3846/7358] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:22:18 2022] GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c => generated 1658 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:22:18.401688 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-345d6891-1940-4278-adb6-22a6ccd35fbd tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:22:18.408241 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-345d6891-1940-4278-adb6-22a6ccd35fbd tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:18.408722 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-345d6891-1940-4278-adb6-22a6ccd35fbd tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:18.409154 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-345d6891-1940-4278-adb6-22a6ccd35fbd tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:18.431736 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-345d6891-1940-4278-adb6-22a6ccd35fbd tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 85f98d02-ecf3-44d8-85b1-d0ca91c4064c] Going to try to start instance {{(pid=121103) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 30 02:22:18.589270 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-345d6891-1940-4278-adb6-22a6ccd35fbd tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "POST /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c/action" status: 202 len: 0 microversion: 2.1 time: 0.191293 Oct 30 02:22:18.589819 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3513/7359] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 02:22:18 2022] POST /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 02:22:18.598746 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2fff7de1-01cb-4675-a79c-b041a6409409 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:22:18.599408 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2fff7de1-01cb-4675-a79c-b041a6409409 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 85f98d02-ecf3-44d8-85b1-d0ca91c4064c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:22:18.605612 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2fff7de1-01cb-4675-a79c-b041a6409409 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:18.606162 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2fff7de1-01cb-4675-a79c-b041a6409409 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:18.606629 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2fff7de1-01cb-4675-a79c-b041a6409409 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:18.607383 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2fff7de1-01cb-4675-a79c-b041a6409409 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:18.607857 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2fff7de1-01cb-4675-a79c-b041a6409409 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:18.608303 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2fff7de1-01cb-4675-a79c-b041a6409409 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:18.626428 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:22:18.738095 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2fff7de1-01cb-4675-a79c-b041a6409409 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:22:18.746285 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2fff7de1-01cb-4675-a79c-b041a6409409 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c" status: 200 len: 1667 microversion: 2.1 time: 0.152116 Oct 30 02:22:18.746879 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3847/7360] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:22:18 2022] GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c => generated 1667 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:22:19.771472 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-15f96d21-ed3e-4d87-87b8-61ad51757970 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:22:19.772223 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-15f96d21-ed3e-4d87-87b8-61ad51757970 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 85f98d02-ecf3-44d8-85b1-d0ca91c4064c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:22:19.774211 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=41 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:22:19.779141 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-15f96d21-ed3e-4d87-87b8-61ad51757970 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:19.779661 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-15f96d21-ed3e-4d87-87b8-61ad51757970 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:19.780298 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-15f96d21-ed3e-4d87-87b8-61ad51757970 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:19.781034 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-15f96d21-ed3e-4d87-87b8-61ad51757970 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:19.781528 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-15f96d21-ed3e-4d87-87b8-61ad51757970 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:19.783517 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-15f96d21-ed3e-4d87-87b8-61ad51757970 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:19.922460 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-15f96d21-ed3e-4d87-87b8-61ad51757970 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:22:19.931496 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-15f96d21-ed3e-4d87-87b8-61ad51757970 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c" status: 200 len: 1667 microversion: 2.1 time: 0.165467 Oct 30 02:22:19.932270 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3514/7361] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:22:19 2022] GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c => generated 1667 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:22:20.954927 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-30962d40-0dd0-4601-8496-64b4b5ec79e8 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:22:20.955557 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-30962d40-0dd0-4601-8496-64b4b5ec79e8 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 85f98d02-ecf3-44d8-85b1-d0ca91c4064c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:22:20.958442 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=37 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:22:20.963349 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-30962d40-0dd0-4601-8496-64b4b5ec79e8 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:20.963846 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-30962d40-0dd0-4601-8496-64b4b5ec79e8 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:20.964293 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-30962d40-0dd0-4601-8496-64b4b5ec79e8 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:20.965005 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-30962d40-0dd0-4601-8496-64b4b5ec79e8 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:20.965496 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-30962d40-0dd0-4601-8496-64b4b5ec79e8 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:20.967024 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-30962d40-0dd0-4601-8496-64b4b5ec79e8 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:21.099948 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-30962d40-0dd0-4601-8496-64b4b5ec79e8 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:22:21.108011 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-30962d40-0dd0-4601-8496-64b4b5ec79e8 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c" status: 200 len: 1671 microversion: 2.1 time: 0.157015 Oct 30 02:22:21.108583 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3848/7362] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:22:20 2022] GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c => generated 1671 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:22:21.130584 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-59f07b52-adb1-4670-b8d1-406cb80e0f92 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:22:21.131098 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-59f07b52-adb1-4670-b8d1-406cb80e0f92 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 85f98d02-ecf3-44d8-85b1-d0ca91c4064c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:22:21.137827 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-59f07b52-adb1-4670-b8d1-406cb80e0f92 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:21.138318 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-59f07b52-adb1-4670-b8d1-406cb80e0f92 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:21.138761 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-59f07b52-adb1-4670-b8d1-406cb80e0f92 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:21.139476 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-59f07b52-adb1-4670-b8d1-406cb80e0f92 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:21.139930 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-59f07b52-adb1-4670-b8d1-406cb80e0f92 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:21.140357 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-59f07b52-adb1-4670-b8d1-406cb80e0f92 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:21.168879 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-59f07b52-adb1-4670-b8d1-406cb80e0f92 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 85f98d02-ecf3-44d8-85b1-d0ca91c4064c] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 02:22:21.479163 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-59f07b52-adb1-4670-b8d1-406cb80e0f92 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "DELETE /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c" status: 204 len: 0 microversion: 2.1 time: 0.352138 Oct 30 02:22:21.479769 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3515/7363] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 02:22:21 2022] DELETE /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 02:22:21.488511 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f0a01cd8-a311-4024-b2d4-30e60bc91b5f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:22:21.489144 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f0a01cd8-a311-4024-b2d4-30e60bc91b5f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 85f98d02-ecf3-44d8-85b1-d0ca91c4064c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:22:21.495894 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f0a01cd8-a311-4024-b2d4-30e60bc91b5f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:21.496872 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f0a01cd8-a311-4024-b2d4-30e60bc91b5f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:21.497326 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f0a01cd8-a311-4024-b2d4-30e60bc91b5f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:21.498067 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f0a01cd8-a311-4024-b2d4-30e60bc91b5f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:21.498539 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f0a01cd8-a311-4024-b2d4-30e60bc91b5f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:21.499002 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f0a01cd8-a311-4024-b2d4-30e60bc91b5f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:21.627726 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f0a01cd8-a311-4024-b2d4-30e60bc91b5f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:22:21.635554 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f0a01cd8-a311-4024-b2d4-30e60bc91b5f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c" status: 200 len: 1677 microversion: 2.1 time: 0.151591 Oct 30 02:22:21.636122 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3849/7364] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:22:21 2022] GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:22:22.660020 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2d940438-6119-4de2-834c-8ef5d8906803 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:22:22.660730 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2d940438-6119-4de2-834c-8ef5d8906803 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 85f98d02-ecf3-44d8-85b1-d0ca91c4064c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:22:22.667612 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2d940438-6119-4de2-834c-8ef5d8906803 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:22.668102 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2d940438-6119-4de2-834c-8ef5d8906803 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:22.668543 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2d940438-6119-4de2-834c-8ef5d8906803 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:22.669273 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2d940438-6119-4de2-834c-8ef5d8906803 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:22.669827 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2d940438-6119-4de2-834c-8ef5d8906803 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:22.670254 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2d940438-6119-4de2-834c-8ef5d8906803 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:22.800137 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2d940438-6119-4de2-834c-8ef5d8906803 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:22:22.808183 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2d940438-6119-4de2-834c-8ef5d8906803 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c" status: 200 len: 1677 microversion: 2.1 time: 0.152460 Oct 30 02:22:22.808764 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3516/7365] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:22:22 2022] GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:22:23.757928 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-76cd41d3-7b50-4db8-adf5-3463e297d18a req-0a3c3ef0-1db2-4156-bfff-312c443673c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85f98d02-ecf3-44d8-85b1-d0ca91c4064c", "name": "network-vif-deleted", "tag": "e9b2958f-185b-4d87-a328-4f14cdfd3bbd"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:22:23.769706 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-76cd41d3-7b50-4db8-adf5-3463e297d18a req-0a3c3ef0-1db2-4156-bfff-312c443673c1 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:23.770218 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-76cd41d3-7b50-4db8-adf5-3463e297d18a req-0a3c3ef0-1db2-4156-bfff-312c443673c1 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:23.770642 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-76cd41d3-7b50-4db8-adf5-3463e297d18a req-0a3c3ef0-1db2-4156-bfff-312c443673c1 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:23.783698 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-76cd41d3-7b50-4db8-adf5-3463e297d18a req-0a3c3ef0-1db2-4156-bfff-312c443673c1 service nova] Creating event network-vif-deleted:e9b2958f-185b-4d87-a328-4f14cdfd3bbd for instance 85f98d02-ecf3-44d8-85b1-d0ca91c4064c on n-h2-master-1 Oct 30 02:22:23.788905 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-76cd41d3-7b50-4db8-adf5-3463e297d18a req-0a3c3ef0-1db2-4156-bfff-312c443673c1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034852 Oct 30 02:22:23.792572 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3850/7366] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:22:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:22:23.833828 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-69b3462e-1f5a-4145-b3f3-6a35a8fbb744 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:22:23.834452 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-69b3462e-1f5a-4145-b3f3-6a35a8fbb744 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 85f98d02-ecf3-44d8-85b1-d0ca91c4064c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:22:23.841599 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-69b3462e-1f5a-4145-b3f3-6a35a8fbb744 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:23.842090 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-69b3462e-1f5a-4145-b3f3-6a35a8fbb744 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:23.842594 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-69b3462e-1f5a-4145-b3f3-6a35a8fbb744 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:23.843457 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-69b3462e-1f5a-4145-b3f3-6a35a8fbb744 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:23.844191 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-69b3462e-1f5a-4145-b3f3-6a35a8fbb744 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:23.845375 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-69b3462e-1f5a-4145-b3f3-6a35a8fbb744 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:23.912734 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-69b3462e-1f5a-4145-b3f3-6a35a8fbb744 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:22:23.920586 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-69b3462e-1f5a-4145-b3f3-6a35a8fbb744 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c" status: 200 len: 1609 microversion: 2.1 time: 0.092329 Oct 30 02:22:23.921161 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3517/7367] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:22:23 2022] GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c => generated 1609 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:22:24.946333 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2c01a6b1-304b-4479-9701-e943b5c41a34 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:22:24.947047 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2c01a6b1-304b-4479-9701-e943b5c41a34 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 85f98d02-ecf3-44d8-85b1-d0ca91c4064c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:22:24.953213 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2c01a6b1-304b-4479-9701-e943b5c41a34 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:24.953745 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2c01a6b1-304b-4479-9701-e943b5c41a34 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:24.954199 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2c01a6b1-304b-4479-9701-e943b5c41a34 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:24.954899 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2c01a6b1-304b-4479-9701-e943b5c41a34 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:24.955369 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2c01a6b1-304b-4479-9701-e943b5c41a34 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:24.955807 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2c01a6b1-304b-4479-9701-e943b5c41a34 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:24.971520 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-2c01a6b1-304b-4479-9701-e943b5c41a34 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] HTTP exception thrown: Instance 85f98d02-ecf3-44d8-85b1-d0ca91c4064c could not be found. Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2c01a6b1-304b-4479-9701-e943b5c41a34 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Request method failure captured: Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c HTTP/1.1 Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXd8_AaHeYv7mI8KcOiEpHHSLt3xix4i3AijgcSjiVH8gCZDNZTQs2eKPUSYf3-FI8TMZsjcfFPTEgO2BYtL_E0r7tuLX6t2K_PeaBE5t7gXNmnm97kpENPfU_RCfhh6EcQIjwoSMcBV6P-7_37AV6319KodCPKJo_De4zA522gc3ZJc Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: ec54882ff5fa47fe9303222e3f936de9 Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServerActionsTestJSON-1524178034 Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServerActionsTestJSON-1524178034 Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: ec54882ff5fa47fe9303222e3f936de9 Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServerActionsTestJSON-1524178034 Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServerActionsTestJSON-1524178034-project Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: bd6a4d32970a4d72be7109ceaf173241 Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServerActionsTestJSON-1524178034-project Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 85f98d02-ecf3-44d8-85b1-d0ca91c4064c could not be found. Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '85f98d02-ecf3-44d8-85b1-d0ca91c4064c'} Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85f98d02-ecf3-44d8-85b1-d0ca91c4064c could not be found. Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85f98d02-ecf3-44d8-85b1-d0ca91c4064c could not be found. Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:22:24.973186 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:22:24.977816 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:22:24.977816 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:22:24.977816 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:22:24.977816 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:22:24.977816 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:22:24.977816 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85f98d02-ecf3-44d8-85b1-d0ca91c4064c could not be found. Oct 30 02:22:24.977816 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:22:24.977816 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2c01a6b1-304b-4479-9701-e943b5c41a34 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Returning 404 to user: Instance 85f98d02-ecf3-44d8-85b1-d0ca91c4064c could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:22:24.977816 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2c01a6b1-304b-4479-9701-e943b5c41a34 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c" status: 404 len: 111 microversion: 2.1 time: 0.033456 Oct 30 02:22:24.977816 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3851/7368] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:22:24 2022] GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 02:22:24.993187 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1824f18b-ac03-4880-8af5-1e6d1f58d3f3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:22:24.993853 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1824f18b-ac03-4880-8af5-1e6d1f58d3f3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 85f98d02-ecf3-44d8-85b1-d0ca91c4064c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:22:25.000645 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1824f18b-ac03-4880-8af5-1e6d1f58d3f3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:25.001123 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1824f18b-ac03-4880-8af5-1e6d1f58d3f3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:25.001588 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1824f18b-ac03-4880-8af5-1e6d1f58d3f3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:25.002274 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1824f18b-ac03-4880-8af5-1e6d1f58d3f3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:25.002729 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1824f18b-ac03-4880-8af5-1e6d1f58d3f3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:25.003147 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1824f18b-ac03-4880-8af5-1e6d1f58d3f3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:25.016300 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-1824f18b-ac03-4880-8af5-1e6d1f58d3f3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] HTTP exception thrown: Instance 85f98d02-ecf3-44d8-85b1-d0ca91c4064c could not be found. Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1824f18b-ac03-4880-8af5-1e6d1f58d3f3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Request method failure captured: Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c HTTP/1.1 Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXd8_AaHeYv7mI8KcOiEpHHSLt3xix4i3AijgcSjiVH8gCZDNZTQs2eKPUSYf3-FI8TMZsjcfFPTEgO2BYtL_E0r7tuLX6t2K_PeaBE5t7gXNmnm97kpENPfU_RCfhh6EcQIjwoSMcBV6P-7_37AV6319KodCPKJo_De4zA522gc3ZJc Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: ec54882ff5fa47fe9303222e3f936de9 Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServerActionsTestJSON-1524178034 Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServerActionsTestJSON-1524178034 Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: ec54882ff5fa47fe9303222e3f936de9 Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServerActionsTestJSON-1524178034 Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServerActionsTestJSON-1524178034-project Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: bd6a4d32970a4d72be7109ceaf173241 Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServerActionsTestJSON-1524178034-project Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 85f98d02-ecf3-44d8-85b1-d0ca91c4064c could not be found. Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '85f98d02-ecf3-44d8-85b1-d0ca91c4064c'} Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85f98d02-ecf3-44d8-85b1-d0ca91c4064c could not be found. Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85f98d02-ecf3-44d8-85b1-d0ca91c4064c could not be found. Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:22:25.017945 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:22:25.022936 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:22:25.022936 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:22:25.022936 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:22:25.022936 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:22:25.022936 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:22:25.022936 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85f98d02-ecf3-44d8-85b1-d0ca91c4064c could not be found. Oct 30 02:22:25.022936 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:22:25.022936 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1824f18b-ac03-4880-8af5-1e6d1f58d3f3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Returning 404 to user: Instance 85f98d02-ecf3-44d8-85b1-d0ca91c4064c could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:22:25.022936 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1824f18b-ac03-4880-8af5-1e6d1f58d3f3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c" status: 404 len: 111 microversion: 2.1 time: 0.030063 Oct 30 02:22:25.022936 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3518/7369] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:22:24 2022] GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 02:22:25.082542 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e9311b1c-37b4-4de9-8778-116f46d908f1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1142964814", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "69a7f320-9fb0-467c-85eb-ca0c978501c8"}], "security_groups": [{"name": "tempest-securitygroup--1896496015"}], "key_name": "tempest-keypair-1057397827", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:22:25.187128 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-e9311b1c-37b4-4de9-8778-116f46d908f1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] validate_networks() for [('69a7f320-9fb0-467c-85eb-ca0c978501c8', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 02:22:25.548299 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-e9311b1c-37b4-4de9-8778-116f46d908f1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 02:22:25.548734 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-e9311b1c-37b4-4de9-8778-116f46d908f1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 02:22:25.549242 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-e9311b1c-37b4-4de9-8778-116f46d908f1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 02:22:25.549749 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-e9311b1c-37b4-4de9-8778-116f46d908f1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 02:22:25.550235 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-e9311b1c-37b4-4de9-8778-116f46d908f1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 02:22:25.559404 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9311b1c-37b4-4de9-8778-116f46d908f1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:25.559896 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9311b1c-37b4-4de9-8778-116f46d908f1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:25.560342 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9311b1c-37b4-4de9-8778-116f46d908f1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:25.561072 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9311b1c-37b4-4de9-8778-116f46d908f1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:25.561568 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9311b1c-37b4-4de9-8778-116f46d908f1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:25.562031 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9311b1c-37b4-4de9-8778-116f46d908f1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:25.578397 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-e9311b1c-37b4-4de9-8778-116f46d908f1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Getting quotas for project ec54882ff5fa47fe9303222e3f936de9. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 02:22:25.584313 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-e9311b1c-37b4-4de9-8778-116f46d908f1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Getting quotas for user bd6a4d32970a4d72be7109ceaf173241 and project ec54882ff5fa47fe9303222e3f936de9. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 02:22:25.597912 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e9311b1c-37b4-4de9-8778-116f46d908f1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 02:22:25.600220 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e9311b1c-37b4-4de9-8778-116f46d908f1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 02:22:25.725039 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e9311b1c-37b4-4de9-8778-116f46d908f1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.646259 Oct 30 02:22:25.726070 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3852/7370] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 02:22:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 02:22:25.737499 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-81a40287-7cdf-46b7-b542-7c858af52d33 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:22:25.738123 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-81a40287-7cdf-46b7-b542-7c858af52d33 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:22:25.791994 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-81a40287-7cdf-46b7-b542-7c858af52d33 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:22:25.799178 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-81a40287-7cdf-46b7-b542-7c858af52d33 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db" status: 200 len: 1239 microversion: 2.1 time: 0.065844 Oct 30 02:22:25.799930 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3519/7371] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:22:25 2022] GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db => generated 1239 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:22:26.822093 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a2981d70-9d95-4f65-9fe0-0a775f5c078c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:22:26.822802 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a2981d70-9d95-4f65-9fe0-0a775f5c078c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:22:26.831009 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a2981d70-9d95-4f65-9fe0-0a775f5c078c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:26.831509 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a2981d70-9d95-4f65-9fe0-0a775f5c078c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:26.831965 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a2981d70-9d95-4f65-9fe0-0a775f5c078c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:26.832679 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a2981d70-9d95-4f65-9fe0-0a775f5c078c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:26.833154 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a2981d70-9d95-4f65-9fe0-0a775f5c078c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:26.833712 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a2981d70-9d95-4f65-9fe0-0a775f5c078c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:26.896400 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a2981d70-9d95-4f65-9fe0-0a775f5c078c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:22:26.904906 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a2981d70-9d95-4f65-9fe0-0a775f5c078c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db" status: 200 len: 1235 microversion: 2.1 time: 0.086723 Oct 30 02:22:26.905530 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3853/7372] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:22:26 2022] GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db => generated 1235 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:22:27.932375 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-de2d1bc0-87e2-4a4a-9821-8f9fcba3955d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:22:27.932994 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-de2d1bc0-87e2-4a4a-9821-8f9fcba3955d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:22:27.941038 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de2d1bc0-87e2-4a4a-9821-8f9fcba3955d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:27.941551 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de2d1bc0-87e2-4a4a-9821-8f9fcba3955d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:27.941986 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de2d1bc0-87e2-4a4a-9821-8f9fcba3955d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:27.942874 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de2d1bc0-87e2-4a4a-9821-8f9fcba3955d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:27.943329 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de2d1bc0-87e2-4a4a-9821-8f9fcba3955d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:27.943752 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de2d1bc0-87e2-4a4a-9821-8f9fcba3955d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:28.036259 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-de2d1bc0-87e2-4a4a-9821-8f9fcba3955d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:22:28.044169 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-de2d1bc0-87e2-4a4a-9821-8f9fcba3955d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db" status: 200 len: 1297 microversion: 2.1 time: 0.115874 Oct 30 02:22:28.044758 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3520/7373] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:22:27 2022] GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db => generated 1297 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:22:29.072023 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f42fb077-5dc3-43b0-9559-2c49e9fffd53 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:22:29.072773 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f42fb077-5dc3-43b0-9559-2c49e9fffd53 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:22:29.079805 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f42fb077-5dc3-43b0-9559-2c49e9fffd53 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:29.080410 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f42fb077-5dc3-43b0-9559-2c49e9fffd53 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:29.080870 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f42fb077-5dc3-43b0-9559-2c49e9fffd53 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:29.081608 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f42fb077-5dc3-43b0-9559-2c49e9fffd53 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:29.082082 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f42fb077-5dc3-43b0-9559-2c49e9fffd53 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:29.082526 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f42fb077-5dc3-43b0-9559-2c49e9fffd53 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:29.209674 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-80bd3e9f-41a5-4f22-86d8-41393a49e656 req-bfb73b4c-209d-4292-a08a-652eebb61e2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db", "tag": "9422e03e-876e-4509-9528-4572246a61b7"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:22:29.220654 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-80bd3e9f-41a5-4f22-86d8-41393a49e656 req-bfb73b4c-209d-4292-a08a-652eebb61e2e service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:29.221168 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-80bd3e9f-41a5-4f22-86d8-41393a49e656 req-bfb73b4c-209d-4292-a08a-652eebb61e2e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:29.221638 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-80bd3e9f-41a5-4f22-86d8-41393a49e656 req-bfb73b4c-209d-4292-a08a-652eebb61e2e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:29.225158 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f42fb077-5dc3-43b0-9559-2c49e9fffd53 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:22:29.233317 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f42fb077-5dc3-43b0-9559-2c49e9fffd53 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db" status: 200 len: 1365 microversion: 2.1 time: 0.165186 Oct 30 02:22:29.234245 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3854/7374] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:22:29 2022] GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:22:29.235369 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-80bd3e9f-41a5-4f22-86d8-41393a49e656 req-bfb73b4c-209d-4292-a08a-652eebb61e2e service nova] Creating event network-changed:9422e03e-876e-4509-9528-4572246a61b7 for instance 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db on n-h2-master-1 Oct 30 02:22:29.240876 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-80bd3e9f-41a5-4f22-86d8-41393a49e656 req-bfb73b4c-209d-4292-a08a-652eebb61e2e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035199 Oct 30 02:22:29.241680 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3521/7375] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:22:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:22:30.258083 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b2b52416-1245-4098-822a-ef1ee12a8f2d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:22:30.269492 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b2b52416-1245-4098-822a-ef1ee12a8f2d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:22:30.269492 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2b52416-1245-4098-822a-ef1ee12a8f2d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:30.269492 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2b52416-1245-4098-822a-ef1ee12a8f2d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:30.269492 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2b52416-1245-4098-822a-ef1ee12a8f2d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:30.269492 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2b52416-1245-4098-822a-ef1ee12a8f2d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:30.269492 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2b52416-1245-4098-822a-ef1ee12a8f2d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:30.269492 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2b52416-1245-4098-822a-ef1ee12a8f2d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:30.400263 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b2b52416-1245-4098-822a-ef1ee12a8f2d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:22:30.408438 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b2b52416-1245-4098-822a-ef1ee12a8f2d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db" status: 200 len: 1365 microversion: 2.1 time: 0.154379 Oct 30 02:22:30.409000 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3855/7376] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:22:30 2022] GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:22:31.433171 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4d7d2245-df84-4338-9854-d775e30f0a30 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:22:31.433901 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4d7d2245-df84-4338-9854-d775e30f0a30 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:22:31.440142 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4d7d2245-df84-4338-9854-d775e30f0a30 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:31.440631 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4d7d2245-df84-4338-9854-d775e30f0a30 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:31.441071 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4d7d2245-df84-4338-9854-d775e30f0a30 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:31.441803 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4d7d2245-df84-4338-9854-d775e30f0a30 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:31.442265 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4d7d2245-df84-4338-9854-d775e30f0a30 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:31.442692 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4d7d2245-df84-4338-9854-d775e30f0a30 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:31.570618 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4d7d2245-df84-4338-9854-d775e30f0a30 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:22:31.578708 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4d7d2245-df84-4338-9854-d775e30f0a30 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db" status: 200 len: 1365 microversion: 2.1 time: 0.151003 Oct 30 02:22:31.579279 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3522/7377] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:22:31 2022] GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:22:32.602310 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e618247a-6cbd-4a8b-8214-c02a2667cfec tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:22:32.602994 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e618247a-6cbd-4a8b-8214-c02a2667cfec tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:22:32.609937 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e618247a-6cbd-4a8b-8214-c02a2667cfec tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:32.610444 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e618247a-6cbd-4a8b-8214-c02a2667cfec tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:32.610898 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e618247a-6cbd-4a8b-8214-c02a2667cfec tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:32.612235 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e618247a-6cbd-4a8b-8214-c02a2667cfec tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:32.612703 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e618247a-6cbd-4a8b-8214-c02a2667cfec tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:32.613143 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e618247a-6cbd-4a8b-8214-c02a2667cfec tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:32.745037 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e618247a-6cbd-4a8b-8214-c02a2667cfec tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:22:32.752829 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e618247a-6cbd-4a8b-8214-c02a2667cfec tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db" status: 200 len: 1365 microversion: 2.1 time: 0.154562 Oct 30 02:22:32.753425 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3856/7378] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:22:32 2022] GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:22:33.777070 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ed00d1e9-7904-47ee-867e-61c4ce7e1ef9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:22:33.777723 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ed00d1e9-7904-47ee-867e-61c4ce7e1ef9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:22:33.784223 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ed00d1e9-7904-47ee-867e-61c4ce7e1ef9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:33.784709 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ed00d1e9-7904-47ee-867e-61c4ce7e1ef9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:33.785147 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ed00d1e9-7904-47ee-867e-61c4ce7e1ef9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:33.785869 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ed00d1e9-7904-47ee-867e-61c4ce7e1ef9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:33.786329 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ed00d1e9-7904-47ee-867e-61c4ce7e1ef9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:33.786756 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ed00d1e9-7904-47ee-867e-61c4ce7e1ef9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:33.925244 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ed00d1e9-7904-47ee-867e-61c4ce7e1ef9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:22:33.933354 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ed00d1e9-7904-47ee-867e-61c4ce7e1ef9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db" status: 200 len: 1365 microversion: 2.1 time: 0.160321 Oct 30 02:22:33.934244 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3523/7379] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:22:33 2022] GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:22:34.957535 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-51386cf5-200f-430f-9b83-b46c74ec9742 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:22:34.958166 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-51386cf5-200f-430f-9b83-b46c74ec9742 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:22:34.965038 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51386cf5-200f-430f-9b83-b46c74ec9742 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:34.965573 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51386cf5-200f-430f-9b83-b46c74ec9742 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:34.966025 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51386cf5-200f-430f-9b83-b46c74ec9742 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:34.966731 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51386cf5-200f-430f-9b83-b46c74ec9742 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:34.967202 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51386cf5-200f-430f-9b83-b46c74ec9742 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:34.967641 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51386cf5-200f-430f-9b83-b46c74ec9742 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:35.093962 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-51386cf5-200f-430f-9b83-b46c74ec9742 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:22:35.101925 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-51386cf5-200f-430f-9b83-b46c74ec9742 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db" status: 200 len: 1365 microversion: 2.1 time: 0.148935 Oct 30 02:22:35.113433 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3857/7380] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:22:34 2022] GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:22:36.126819 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-28b4f650-05d0-4bac-8032-75d04f322de2 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:22:36.128037 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-28b4f650-05d0-4bac-8032-75d04f322de2 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:22:36.131175 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:22:36.136649 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-28b4f650-05d0-4bac-8032-75d04f322de2 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:36.137382 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-28b4f650-05d0-4bac-8032-75d04f322de2 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:36.148683 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-28b4f650-05d0-4bac-8032-75d04f322de2 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:36.148683 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-28b4f650-05d0-4bac-8032-75d04f322de2 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:36.148683 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-28b4f650-05d0-4bac-8032-75d04f322de2 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:36.148683 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-28b4f650-05d0-4bac-8032-75d04f322de2 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:36.149212 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-b878b408-6401-4f33-96b1-baa3178093d8 req-66d3d35b-456b-4c67-9a01-70f64a2b31c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db", "name": "network-vif-plugged", "status": "completed", "tag": "9422e03e-876e-4509-9528-4572246a61b7"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:22:36.149212 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:22:36.149826 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=6 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:22:36.156151 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-b878b408-6401-4f33-96b1-baa3178093d8 req-66d3d35b-456b-4c67-9a01-70f64a2b31c7 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:36.156659 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-b878b408-6401-4f33-96b1-baa3178093d8 req-66d3d35b-456b-4c67-9a01-70f64a2b31c7 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:36.157103 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-b878b408-6401-4f33-96b1-baa3178093d8 req-66d3d35b-456b-4c67-9a01-70f64a2b31c7 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:36.171167 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-b878b408-6401-4f33-96b1-baa3178093d8 req-66d3d35b-456b-4c67-9a01-70f64a2b31c7 service nova] Creating event network-vif-plugged:9422e03e-876e-4509-9528-4572246a61b7 for instance 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db on n-h2-master-1 Oct 30 02:22:36.177245 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-b878b408-6401-4f33-96b1-baa3178093d8 req-66d3d35b-456b-4c67-9a01-70f64a2b31c7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037139 Oct 30 02:22:36.177245 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3858/7381] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:22:36.287887 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-28b4f650-05d0-4bac-8032-75d04f322de2 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:22:36.303025 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-28b4f650-05d0-4bac-8032-75d04f322de2 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db" status: 200 len: 1365 microversion: 2.1 time: 0.180030 Oct 30 02:22:36.304086 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3524/7382] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:22:36 2022] GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db => generated 1365 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:22:37.330663 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f2f7e6d9-fc34-4213-927f-0f744426f111 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:22:37.331395 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f2f7e6d9-fc34-4213-927f-0f744426f111 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:22:37.338164 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f2f7e6d9-fc34-4213-927f-0f744426f111 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:37.338661 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f2f7e6d9-fc34-4213-927f-0f744426f111 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:37.339111 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f2f7e6d9-fc34-4213-927f-0f744426f111 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:37.339819 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f2f7e6d9-fc34-4213-927f-0f744426f111 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:37.340287 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f2f7e6d9-fc34-4213-927f-0f744426f111 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:37.340726 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f2f7e6d9-fc34-4213-927f-0f744426f111 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:37.482909 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f2f7e6d9-fc34-4213-927f-0f744426f111 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:22:37.490870 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f2f7e6d9-fc34-4213-927f-0f744426f111 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db" status: 200 len: 1365 microversion: 2.1 time: 0.166524 Oct 30 02:22:37.491462 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3859/7383] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:22:37 2022] GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:22:38.514491 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-00fb0d8d-a80c-4661-9da8-2139eea243dc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:22:38.515022 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-00fb0d8d-a80c-4661-9da8-2139eea243dc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:22:38.521927 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-00fb0d8d-a80c-4661-9da8-2139eea243dc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:38.522411 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-00fb0d8d-a80c-4661-9da8-2139eea243dc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:38.522850 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-00fb0d8d-a80c-4661-9da8-2139eea243dc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:38.523542 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-00fb0d8d-a80c-4661-9da8-2139eea243dc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:38.523997 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-00fb0d8d-a80c-4661-9da8-2139eea243dc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:38.524422 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-00fb0d8d-a80c-4661-9da8-2139eea243dc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:38.651047 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-00fb0d8d-a80c-4661-9da8-2139eea243dc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:22:38.653279 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:22:38.659885 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-00fb0d8d-a80c-4661-9da8-2139eea243dc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db" status: 200 len: 1553 microversion: 2.1 time: 0.149394 Oct 30 02:22:38.660458 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3525/7384] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:22:38 2022] GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:22:38.683572 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-16116e38-4f37-46d3-b7fd-2a09a1442dae tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:22:38.684109 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-16116e38-4f37-46d3-b7fd-2a09a1442dae tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:22:38.691552 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-16116e38-4f37-46d3-b7fd-2a09a1442dae tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:38.692050 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-16116e38-4f37-46d3-b7fd-2a09a1442dae tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:38.692494 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-16116e38-4f37-46d3-b7fd-2a09a1442dae tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:38.693196 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-16116e38-4f37-46d3-b7fd-2a09a1442dae tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:38.693694 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-16116e38-4f37-46d3-b7fd-2a09a1442dae tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:38.694133 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-16116e38-4f37-46d3-b7fd-2a09a1442dae tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:38.770119 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-16116e38-4f37-46d3-b7fd-2a09a1442dae tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090681 Oct 30 02:22:38.770716 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3860/7385] 10.222.0.13 () {58 vars in 1275 bytes} [Sun Oct 30 02:22:38 2022] GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:22:39.755306 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-5ab0cede-877d-4d13-9e6e-2d693f0a8ed9 req-49791e56-9f09-4115-a914-11239506f9bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db", "tag": "9422e03e-876e-4509-9528-4572246a61b7"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:22:39.766376 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-5ab0cede-877d-4d13-9e6e-2d693f0a8ed9 req-49791e56-9f09-4115-a914-11239506f9bc service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:22:39.767129 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-5ab0cede-877d-4d13-9e6e-2d693f0a8ed9 req-49791e56-9f09-4115-a914-11239506f9bc service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:22:39.767556 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-5ab0cede-877d-4d13-9e6e-2d693f0a8ed9 req-49791e56-9f09-4115-a914-11239506f9bc service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:22:39.778667 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-5ab0cede-877d-4d13-9e6e-2d693f0a8ed9 req-49791e56-9f09-4115-a914-11239506f9bc service nova] Creating event network-changed:9422e03e-876e-4509-9528-4572246a61b7 for instance 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db on n-h2-master-1 Oct 30 02:22:39.783773 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-5ab0cede-877d-4d13-9e6e-2d693f0a8ed9 req-49791e56-9f09-4115-a914-11239506f9bc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033211 Oct 30 02:22:39.784362 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3526/7386] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:23:12.725640 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:23:12.726414 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=62 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:23:12.730400 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6ee827b8-2302-4b00-a59c-613251c44171 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:23:12.735220 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6ee827b8-2302-4b00-a59c-613251c44171 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:23:12.739112 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6ee827b8-2302-4b00-a59c-613251c44171 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:12.739610 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6ee827b8-2302-4b00-a59c-613251c44171 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:12.740064 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6ee827b8-2302-4b00-a59c-613251c44171 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:12.740768 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6ee827b8-2302-4b00-a59c-613251c44171 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:12.741241 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6ee827b8-2302-4b00-a59c-613251c44171 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:12.741707 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6ee827b8-2302-4b00-a59c-613251c44171 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:12.771399 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6ee827b8-2302-4b00-a59c-613251c44171 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:23:12.776995 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6ee827b8-2302-4b00-a59c-613251c44171 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db] Old instance type m1.heat2, new instance type m1.heat {{(pid=121102) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 30 02:23:12.783902 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-6ee827b8-2302-4b00-a59c-613251c44171 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 02:23:12.784335 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-6ee827b8-2302-4b00-a59c-613251c44171 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 02:23:12.785312 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-6ee827b8-2302-4b00-a59c-613251c44171 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 02:23:12.785761 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-6ee827b8-2302-4b00-a59c-613251c44171 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 02:23:12.786180 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-6ee827b8-2302-4b00-a59c-613251c44171 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 02:23:12.994048 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6ee827b8-2302-4b00-a59c-613251c44171 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "POST /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db/action" status: 202 len: 0 microversion: 2.1 time: 0.270505 Oct 30 02:23:12.994593 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3861/7387] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 02:23:12 2022] POST /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 02:23:13.001213 n-d-master-1 devstack@n-api.service[121103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 30 02:23:13.001799 n-d-master-1 devstack@n-api.service[121103]: Sun Oct 30 02:23:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db (ip 10.222.0.13) !!! Oct 30 02:23:13.002931 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:23:13.009147 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-24ed0fda-9b94-466e-ade4-a27ae48cd62d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:23:13.009927 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-24ed0fda-9b94-466e-ade4-a27ae48cd62d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:23:13.017723 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-24ed0fda-9b94-466e-ade4-a27ae48cd62d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:13.018212 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-24ed0fda-9b94-466e-ade4-a27ae48cd62d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:13.018653 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-24ed0fda-9b94-466e-ade4-a27ae48cd62d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:13.019360 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-24ed0fda-9b94-466e-ade4-a27ae48cd62d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:13.019818 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-24ed0fda-9b94-466e-ade4-a27ae48cd62d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:13.020249 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-24ed0fda-9b94-466e-ade4-a27ae48cd62d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:13.152511 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-24ed0fda-9b94-466e-ade4-a27ae48cd62d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:23:13.160940 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-24ed0fda-9b94-466e-ade4-a27ae48cd62d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db" status: 200 len: 1681 microversion: 2.1 time: 0.162003 Oct 30 02:23:13.161544 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3527/7388] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:23:12 2022] GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:23:14.185356 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2dd24b43-b0a5-4486-83a8-dbfc4b70a550 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:23:14.185985 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2dd24b43-b0a5-4486-83a8-dbfc4b70a550 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:23:14.193292 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2dd24b43-b0a5-4486-83a8-dbfc4b70a550 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:14.193836 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2dd24b43-b0a5-4486-83a8-dbfc4b70a550 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:14.194277 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2dd24b43-b0a5-4486-83a8-dbfc4b70a550 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:14.195016 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2dd24b43-b0a5-4486-83a8-dbfc4b70a550 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:14.196185 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2dd24b43-b0a5-4486-83a8-dbfc4b70a550 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:14.196626 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2dd24b43-b0a5-4486-83a8-dbfc4b70a550 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:14.396338 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2dd24b43-b0a5-4486-83a8-dbfc4b70a550 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:23:14.404866 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2dd24b43-b0a5-4486-83a8-dbfc4b70a550 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db" status: 200 len: 1681 microversion: 2.1 time: 0.223794 Oct 30 02:23:14.406002 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3862/7389] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:23:14 2022] GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db => generated 1681 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:23:15.430649 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f55f80bf-7952-4277-8084-3f0951d5d917 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:23:15.431200 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f55f80bf-7952-4277-8084-3f0951d5d917 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:23:15.438193 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f55f80bf-7952-4277-8084-3f0951d5d917 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:15.438680 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f55f80bf-7952-4277-8084-3f0951d5d917 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:15.439119 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f55f80bf-7952-4277-8084-3f0951d5d917 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:15.439821 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f55f80bf-7952-4277-8084-3f0951d5d917 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:15.440274 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f55f80bf-7952-4277-8084-3f0951d5d917 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:15.440695 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f55f80bf-7952-4277-8084-3f0951d5d917 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:15.658415 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f55f80bf-7952-4277-8084-3f0951d5d917 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:23:15.666864 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f55f80bf-7952-4277-8084-3f0951d5d917 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db" status: 200 len: 1681 microversion: 2.1 time: 0.240875 Oct 30 02:23:15.667442 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3528/7390] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:23:15 2022] GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db => generated 1681 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:23:16.690208 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-44ab61fc-b9d0-49e9-b47d-0c89067b970f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:23:16.690830 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-44ab61fc-b9d0-49e9-b47d-0c89067b970f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:23:16.697706 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44ab61fc-b9d0-49e9-b47d-0c89067b970f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:16.698200 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44ab61fc-b9d0-49e9-b47d-0c89067b970f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:16.698647 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44ab61fc-b9d0-49e9-b47d-0c89067b970f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:16.699345 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44ab61fc-b9d0-49e9-b47d-0c89067b970f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:16.699817 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44ab61fc-b9d0-49e9-b47d-0c89067b970f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:16.700254 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44ab61fc-b9d0-49e9-b47d-0c89067b970f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:16.827684 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-44ab61fc-b9d0-49e9-b47d-0c89067b970f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:23:16.835454 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-44ab61fc-b9d0-49e9-b47d-0c89067b970f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db" status: 200 len: 1686 microversion: 2.1 time: 0.149186 Oct 30 02:23:16.836017 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3863/7391] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:23:16 2022] GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db => generated 1686 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:23:17.859893 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-01de91c5-209c-46fb-a929-fe8421aca48d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:23:17.860427 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-01de91c5-209c-46fb-a929-fe8421aca48d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:23:17.867391 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-01de91c5-209c-46fb-a929-fe8421aca48d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:17.867871 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-01de91c5-209c-46fb-a929-fe8421aca48d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:17.868314 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-01de91c5-209c-46fb-a929-fe8421aca48d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:17.869008 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-01de91c5-209c-46fb-a929-fe8421aca48d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:17.869498 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-01de91c5-209c-46fb-a929-fe8421aca48d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:17.869927 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-01de91c5-209c-46fb-a929-fe8421aca48d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:17.998048 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-01de91c5-209c-46fb-a929-fe8421aca48d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:23:18.006405 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-01de91c5-209c-46fb-a929-fe8421aca48d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db" status: 200 len: 1686 microversion: 2.1 time: 0.150748 Oct 30 02:23:18.006981 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3529/7392] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:23:17 2022] GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db => generated 1686 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:23:19.028817 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-39f79583-dc33-44f4-b87e-d026fa81839f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:23:19.029584 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-39f79583-dc33-44f4-b87e-d026fa81839f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:23:19.037862 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-39f79583-dc33-44f4-b87e-d026fa81839f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:19.038365 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-39f79583-dc33-44f4-b87e-d026fa81839f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:19.038815 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-39f79583-dc33-44f4-b87e-d026fa81839f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:19.039528 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-39f79583-dc33-44f4-b87e-d026fa81839f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:19.039994 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-39f79583-dc33-44f4-b87e-d026fa81839f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:19.040430 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-39f79583-dc33-44f4-b87e-d026fa81839f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:19.177813 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-39f79583-dc33-44f4-b87e-d026fa81839f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:23:19.186561 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-39f79583-dc33-44f4-b87e-d026fa81839f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db" status: 200 len: 1686 microversion: 2.1 time: 0.161647 Oct 30 02:23:19.187156 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3864/7393] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:23:19 2022] GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db => generated 1686 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:23:20.211968 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e1264053-d283-409b-a7b6-1e557556a291 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:23:20.212373 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e1264053-d283-409b-a7b6-1e557556a291 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:23:20.220400 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e1264053-d283-409b-a7b6-1e557556a291 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:20.220890 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e1264053-d283-409b-a7b6-1e557556a291 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:20.221378 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e1264053-d283-409b-a7b6-1e557556a291 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:20.222752 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e1264053-d283-409b-a7b6-1e557556a291 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:20.223207 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e1264053-d283-409b-a7b6-1e557556a291 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:20.223632 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e1264053-d283-409b-a7b6-1e557556a291 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:20.358692 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e1264053-d283-409b-a7b6-1e557556a291 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:23:20.366391 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e1264053-d283-409b-a7b6-1e557556a291 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db" status: 200 len: 1686 microversion: 2.1 time: 0.158950 Oct 30 02:23:20.366978 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3530/7394] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:23:20 2022] GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db => generated 1686 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:23:21.389844 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-25f8fcfe-20d8-4d73-b6ab-9ebf84bf113a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:23:21.390470 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-25f8fcfe-20d8-4d73-b6ab-9ebf84bf113a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:23:21.397425 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25f8fcfe-20d8-4d73-b6ab-9ebf84bf113a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:21.397922 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25f8fcfe-20d8-4d73-b6ab-9ebf84bf113a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:21.398371 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25f8fcfe-20d8-4d73-b6ab-9ebf84bf113a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:21.399093 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25f8fcfe-20d8-4d73-b6ab-9ebf84bf113a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:21.399543 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25f8fcfe-20d8-4d73-b6ab-9ebf84bf113a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:21.399983 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25f8fcfe-20d8-4d73-b6ab-9ebf84bf113a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:21.526239 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-25f8fcfe-20d8-4d73-b6ab-9ebf84bf113a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:23:21.534008 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-25f8fcfe-20d8-4d73-b6ab-9ebf84bf113a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db" status: 200 len: 1686 microversion: 2.1 time: 0.148102 Oct 30 02:23:21.534587 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3865/7395] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:23:21 2022] GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db => generated 1686 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:23:22.556884 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f4fcc1e6-6690-4571-99db-8d0b86cf99ed tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:23:22.557527 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f4fcc1e6-6690-4571-99db-8d0b86cf99ed tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:23:22.564300 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f4fcc1e6-6690-4571-99db-8d0b86cf99ed tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:22.564778 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f4fcc1e6-6690-4571-99db-8d0b86cf99ed tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:22.565212 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f4fcc1e6-6690-4571-99db-8d0b86cf99ed tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:22.565932 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f4fcc1e6-6690-4571-99db-8d0b86cf99ed tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:22.566377 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f4fcc1e6-6690-4571-99db-8d0b86cf99ed tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:22.566798 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f4fcc1e6-6690-4571-99db-8d0b86cf99ed tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:22.693952 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f4fcc1e6-6690-4571-99db-8d0b86cf99ed tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:23:22.701708 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f4fcc1e6-6690-4571-99db-8d0b86cf99ed tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db" status: 200 len: 1686 microversion: 2.1 time: 0.149007 Oct 30 02:23:22.702343 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3531/7396] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:23:22 2022] GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db => generated 1686 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:23:23.724134 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-67f24028-8908-4618-bbaa-492e4f94b833 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:23:23.724675 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-67f24028-8908-4618-bbaa-492e4f94b833 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:23:23.731502 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67f24028-8908-4618-bbaa-492e4f94b833 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:23.731995 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67f24028-8908-4618-bbaa-492e4f94b833 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:23.732442 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67f24028-8908-4618-bbaa-492e4f94b833 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:23.733149 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67f24028-8908-4618-bbaa-492e4f94b833 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:23.733641 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67f24028-8908-4618-bbaa-492e4f94b833 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:23.734078 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67f24028-8908-4618-bbaa-492e4f94b833 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:23.865678 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-67f24028-8908-4618-bbaa-492e4f94b833 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:23:23.873400 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-67f24028-8908-4618-bbaa-492e4f94b833 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db" status: 200 len: 1686 microversion: 2.1 time: 0.153327 Oct 30 02:23:23.873971 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3866/7397] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:23:23 2022] GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db => generated 1686 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:23:24.897948 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a44e8216-22b9-48d2-87a9-5c9a4fefbfa6 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:23:24.898595 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a44e8216-22b9-48d2-87a9-5c9a4fefbfa6 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:23:24.905618 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a44e8216-22b9-48d2-87a9-5c9a4fefbfa6 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:24.906090 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a44e8216-22b9-48d2-87a9-5c9a4fefbfa6 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:24.906524 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a44e8216-22b9-48d2-87a9-5c9a4fefbfa6 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:24.907211 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a44e8216-22b9-48d2-87a9-5c9a4fefbfa6 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:24.907660 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a44e8216-22b9-48d2-87a9-5c9a4fefbfa6 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:24.908085 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a44e8216-22b9-48d2-87a9-5c9a4fefbfa6 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:25.040184 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a44e8216-22b9-48d2-87a9-5c9a4fefbfa6 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:23:25.047877 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a44e8216-22b9-48d2-87a9-5c9a4fefbfa6 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db" status: 200 len: 1686 microversion: 2.1 time: 0.154495 Oct 30 02:23:25.048448 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3532/7398] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:23:24 2022] GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db => generated 1686 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:23:26.071191 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-31c77f5a-b2ce-49e9-886c-44be63e1b7c1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:23:26.071821 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-31c77f5a-b2ce-49e9-886c-44be63e1b7c1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:23:26.078683 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-31c77f5a-b2ce-49e9-886c-44be63e1b7c1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:26.079178 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-31c77f5a-b2ce-49e9-886c-44be63e1b7c1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:26.079629 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-31c77f5a-b2ce-49e9-886c-44be63e1b7c1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:26.080328 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-31c77f5a-b2ce-49e9-886c-44be63e1b7c1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:26.080794 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-31c77f5a-b2ce-49e9-886c-44be63e1b7c1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:26.081765 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-31c77f5a-b2ce-49e9-886c-44be63e1b7c1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:26.209904 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-31c77f5a-b2ce-49e9-886c-44be63e1b7c1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:23:26.217598 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-31c77f5a-b2ce-49e9-886c-44be63e1b7c1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db" status: 200 len: 1686 microversion: 2.1 time: 0.150322 Oct 30 02:23:26.218175 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3867/7399] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:23:26 2022] GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db => generated 1686 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:23:27.241993 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f5b3c356-51d5-4a33-bef6-650a2e20900b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:23:27.242645 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f5b3c356-51d5-4a33-bef6-650a2e20900b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:23:27.249579 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f5b3c356-51d5-4a33-bef6-650a2e20900b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:27.250070 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f5b3c356-51d5-4a33-bef6-650a2e20900b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:27.250510 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f5b3c356-51d5-4a33-bef6-650a2e20900b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:27.251211 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f5b3c356-51d5-4a33-bef6-650a2e20900b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:27.251667 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f5b3c356-51d5-4a33-bef6-650a2e20900b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:27.252091 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f5b3c356-51d5-4a33-bef6-650a2e20900b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:27.379839 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f5b3c356-51d5-4a33-bef6-650a2e20900b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:23:27.387541 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f5b3c356-51d5-4a33-bef6-650a2e20900b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db" status: 200 len: 1686 microversion: 2.1 time: 0.150168 Oct 30 02:23:27.388117 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3533/7400] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:23:27 2022] GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db => generated 1686 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:23:28.410993 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5f4948ec-9e4b-4f75-a414-62f2f73cc917 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:23:28.411626 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5f4948ec-9e4b-4f75-a414-62f2f73cc917 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:23:28.418527 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f4948ec-9e4b-4f75-a414-62f2f73cc917 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:28.419026 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f4948ec-9e4b-4f75-a414-62f2f73cc917 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:28.419480 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f4948ec-9e4b-4f75-a414-62f2f73cc917 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:28.420190 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f4948ec-9e4b-4f75-a414-62f2f73cc917 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:28.420666 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f4948ec-9e4b-4f75-a414-62f2f73cc917 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:28.421109 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f4948ec-9e4b-4f75-a414-62f2f73cc917 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:28.554778 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5f4948ec-9e4b-4f75-a414-62f2f73cc917 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:23:28.563145 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5f4948ec-9e4b-4f75-a414-62f2f73cc917 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db" status: 200 len: 1686 microversion: 2.1 time: 0.156072 Oct 30 02:23:28.563734 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3868/7401] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:23:28 2022] GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db => generated 1686 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:23:29.586946 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c8292df2-4c14-4344-bfe2-ccac83e4643f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:23:29.587513 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c8292df2-4c14-4344-bfe2-ccac83e4643f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:23:29.594532 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c8292df2-4c14-4344-bfe2-ccac83e4643f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:29.595197 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c8292df2-4c14-4344-bfe2-ccac83e4643f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:29.595647 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c8292df2-4c14-4344-bfe2-ccac83e4643f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:29.596351 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c8292df2-4c14-4344-bfe2-ccac83e4643f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:29.596815 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c8292df2-4c14-4344-bfe2-ccac83e4643f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:29.597245 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c8292df2-4c14-4344-bfe2-ccac83e4643f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:29.724457 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c8292df2-4c14-4344-bfe2-ccac83e4643f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:23:29.732244 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c8292df2-4c14-4344-bfe2-ccac83e4643f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db" status: 200 len: 1686 microversion: 2.1 time: 0.150323 Oct 30 02:23:29.732825 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3534/7402] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:23:29 2022] GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db => generated 1686 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:23:30.755963 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-36a4ae10-b49d-4c0f-917e-f88361b3598d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:23:30.756591 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-36a4ae10-b49d-4c0f-917e-f88361b3598d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:23:30.763528 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-36a4ae10-b49d-4c0f-917e-f88361b3598d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:30.764022 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-36a4ae10-b49d-4c0f-917e-f88361b3598d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:30.764473 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-36a4ae10-b49d-4c0f-917e-f88361b3598d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:30.765180 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-36a4ae10-b49d-4c0f-917e-f88361b3598d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:30.765676 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-36a4ae10-b49d-4c0f-917e-f88361b3598d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:30.766117 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-36a4ae10-b49d-4c0f-917e-f88361b3598d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:30.894298 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-36a4ae10-b49d-4c0f-917e-f88361b3598d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:23:30.902158 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-36a4ae10-b49d-4c0f-917e-f88361b3598d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db" status: 200 len: 1686 microversion: 2.1 time: 0.150205 Oct 30 02:23:30.902731 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3869/7403] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:23:30 2022] GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db => generated 1686 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:23:31.924704 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-28a3a2c7-32b1-4c26-8841-ddc92d2f1f86 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:23:31.925313 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-28a3a2c7-32b1-4c26-8841-ddc92d2f1f86 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:23:31.932795 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-28a3a2c7-32b1-4c26-8841-ddc92d2f1f86 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:31.933275 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-28a3a2c7-32b1-4c26-8841-ddc92d2f1f86 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:31.933750 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-28a3a2c7-32b1-4c26-8841-ddc92d2f1f86 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:31.934434 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-28a3a2c7-32b1-4c26-8841-ddc92d2f1f86 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:31.934885 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-28a3a2c7-32b1-4c26-8841-ddc92d2f1f86 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:31.935308 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-28a3a2c7-32b1-4c26-8841-ddc92d2f1f86 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:32.067787 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-28a3a2c7-32b1-4c26-8841-ddc92d2f1f86 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:23:32.075552 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-28a3a2c7-32b1-4c26-8841-ddc92d2f1f86 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db" status: 200 len: 1686 microversion: 2.1 time: 0.154702 Oct 30 02:23:32.076129 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3535/7404] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:23:31 2022] GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db => generated 1686 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:23:33.098710 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-313276a3-0c32-4d77-b447-f682d575bff5 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:23:33.099344 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-313276a3-0c32-4d77-b447-f682d575bff5 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:23:33.106204 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-313276a3-0c32-4d77-b447-f682d575bff5 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:33.106736 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-313276a3-0c32-4d77-b447-f682d575bff5 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:33.107187 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-313276a3-0c32-4d77-b447-f682d575bff5 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:33.107901 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-313276a3-0c32-4d77-b447-f682d575bff5 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:33.108373 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-313276a3-0c32-4d77-b447-f682d575bff5 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:33.108814 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-313276a3-0c32-4d77-b447-f682d575bff5 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:33.242321 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-313276a3-0c32-4d77-b447-f682d575bff5 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:23:33.250168 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-313276a3-0c32-4d77-b447-f682d575bff5 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db" status: 200 len: 1686 microversion: 2.1 time: 0.155479 Oct 30 02:23:33.250757 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3870/7405] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:23:33 2022] GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db => generated 1686 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:23:34.044636 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-dbb3154b-a18a-463b-951d-06fd668df594 req-5a0853ca-4e9c-4235-9950-983ccd6710f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db", "name": "network-vif-unplugged", "status": "completed", "tag": "9422e03e-876e-4509-9528-4572246a61b7"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:23:34.055092 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-dbb3154b-a18a-463b-951d-06fd668df594 req-5a0853ca-4e9c-4235-9950-983ccd6710f5 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:34.055567 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-dbb3154b-a18a-463b-951d-06fd668df594 req-5a0853ca-4e9c-4235-9950-983ccd6710f5 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:34.055997 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-dbb3154b-a18a-463b-951d-06fd668df594 req-5a0853ca-4e9c-4235-9950-983ccd6710f5 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:34.070681 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-dbb3154b-a18a-463b-951d-06fd668df594 req-5a0853ca-4e9c-4235-9950-983ccd6710f5 service nova] Creating event network-vif-unplugged:9422e03e-876e-4509-9528-4572246a61b7 for instance 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db on n-h1-master-1 Oct 30 02:23:34.076313 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [req-dbb3154b-a18a-463b-951d-06fd668df594 req-5a0853ca-4e9c-4235-9950-983ccd6710f5 service nova] Instance 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=121103) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 30 02:23:34.088116 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-dbb3154b-a18a-463b-951d-06fd668df594 req-5a0853ca-4e9c-4235-9950-983ccd6710f5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100300 Oct 30 02:23:34.088737 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3536/7406] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:23:34.274690 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9b069f57-8ae6-4eca-b35c-7fb53c4f9d42 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:23:34.275359 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9b069f57-8ae6-4eca-b35c-7fb53c4f9d42 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:23:34.282468 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b069f57-8ae6-4eca-b35c-7fb53c4f9d42 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:34.283007 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b069f57-8ae6-4eca-b35c-7fb53c4f9d42 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:34.283470 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b069f57-8ae6-4eca-b35c-7fb53c4f9d42 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:34.284200 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b069f57-8ae6-4eca-b35c-7fb53c4f9d42 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:34.284672 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b069f57-8ae6-4eca-b35c-7fb53c4f9d42 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:34.285119 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b069f57-8ae6-4eca-b35c-7fb53c4f9d42 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:34.484209 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9b069f57-8ae6-4eca-b35c-7fb53c4f9d42 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:23:34.492937 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9b069f57-8ae6-4eca-b35c-7fb53c4f9d42 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db" status: 200 len: 1685 microversion: 2.1 time: 0.222067 Oct 30 02:23:34.493558 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3871/7407] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:23:34 2022] GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db => generated 1685 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:23:35.520102 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-897cabbe-831b-4e00-8e4d-0b3e22bb4024 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:23:35.520820 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-897cabbe-831b-4e00-8e4d-0b3e22bb4024 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:23:35.526965 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-897cabbe-831b-4e00-8e4d-0b3e22bb4024 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:35.527450 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-897cabbe-831b-4e00-8e4d-0b3e22bb4024 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:35.527882 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-897cabbe-831b-4e00-8e4d-0b3e22bb4024 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:35.528576 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-897cabbe-831b-4e00-8e4d-0b3e22bb4024 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:35.529024 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-897cabbe-831b-4e00-8e4d-0b3e22bb4024 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:35.529477 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-897cabbe-831b-4e00-8e4d-0b3e22bb4024 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:35.666283 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-897cabbe-831b-4e00-8e4d-0b3e22bb4024 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:23:35.674432 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-897cabbe-831b-4e00-8e4d-0b3e22bb4024 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db" status: 200 len: 1685 microversion: 2.1 time: 0.159476 Oct 30 02:23:35.676228 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3537/7408] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:23:35 2022] GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db => generated 1685 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:23:36.105842 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-5b08f1f4-d3c1-400e-a6f3-09f8f144360a req-676e2cd9-d733-4bf0-918d-c18d04c3f54a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db", "tag": "9422e03e-876e-4509-9528-4572246a61b7"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:23:36.116268 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-5b08f1f4-d3c1-400e-a6f3-09f8f144360a req-676e2cd9-d733-4bf0-918d-c18d04c3f54a service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:36.116765 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-5b08f1f4-d3c1-400e-a6f3-09f8f144360a req-676e2cd9-d733-4bf0-918d-c18d04c3f54a service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:36.117218 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-5b08f1f4-d3c1-400e-a6f3-09f8f144360a req-676e2cd9-d733-4bf0-918d-c18d04c3f54a service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:36.130021 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-5b08f1f4-d3c1-400e-a6f3-09f8f144360a req-676e2cd9-d733-4bf0-918d-c18d04c3f54a service nova] Creating event network-changed:9422e03e-876e-4509-9528-4572246a61b7 for instance 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db on n-h1-master-1 Oct 30 02:23:36.135358 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [req-5b08f1f4-d3c1-400e-a6f3-09f8f144360a req-676e2cd9-d733-4bf0-918d-c18d04c3f54a service nova] Instance 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=121102) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 30 02:23:36.146732 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-5b08f1f4-d3c1-400e-a6f3-09f8f144360a req-676e2cd9-d733-4bf0-918d-c18d04c3f54a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044611 Oct 30 02:23:36.147335 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3872/7409] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:23:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:23:36.697788 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c12e29b6-da39-4d51-b9ee-95fcc8bf71f1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:23:36.698520 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c12e29b6-da39-4d51-b9ee-95fcc8bf71f1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:23:36.705502 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c12e29b6-da39-4d51-b9ee-95fcc8bf71f1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:36.705995 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c12e29b6-da39-4d51-b9ee-95fcc8bf71f1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:36.706439 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c12e29b6-da39-4d51-b9ee-95fcc8bf71f1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:36.707139 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c12e29b6-da39-4d51-b9ee-95fcc8bf71f1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:36.707598 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c12e29b6-da39-4d51-b9ee-95fcc8bf71f1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:36.708029 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c12e29b6-da39-4d51-b9ee-95fcc8bf71f1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:36.840009 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c12e29b6-da39-4d51-b9ee-95fcc8bf71f1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:23:36.848016 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c12e29b6-da39-4d51-b9ee-95fcc8bf71f1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db" status: 200 len: 1683 microversion: 2.1 time: 0.154147 Oct 30 02:23:36.848599 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3538/7410] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:23:36 2022] GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:23:37.873527 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d250fbac-9345-4961-945f-ee43691b295a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:23:37.874163 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d250fbac-9345-4961-945f-ee43691b295a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:23:37.881097 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d250fbac-9345-4961-945f-ee43691b295a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:37.881611 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d250fbac-9345-4961-945f-ee43691b295a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:37.882064 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d250fbac-9345-4961-945f-ee43691b295a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:37.882778 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d250fbac-9345-4961-945f-ee43691b295a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:37.883244 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d250fbac-9345-4961-945f-ee43691b295a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:37.883683 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d250fbac-9345-4961-945f-ee43691b295a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:38.013463 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d250fbac-9345-4961-945f-ee43691b295a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:23:38.021281 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d250fbac-9345-4961-945f-ee43691b295a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db" status: 200 len: 1680 microversion: 2.1 time: 0.152960 Oct 30 02:23:38.021955 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3873/7411] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:23:37 2022] GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:23:38.043458 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-05d363c6-a8e7-484b-9dec-270addb88c70 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:23:38.044002 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-05d363c6-a8e7-484b-9dec-270addb88c70 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:23:38.050841 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-05d363c6-a8e7-484b-9dec-270addb88c70 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:38.051332 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-05d363c6-a8e7-484b-9dec-270addb88c70 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:38.051772 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-05d363c6-a8e7-484b-9dec-270addb88c70 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:38.053233 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-05d363c6-a8e7-484b-9dec-270addb88c70 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:38.053718 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-05d363c6-a8e7-484b-9dec-270addb88c70 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:38.054148 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-05d363c6-a8e7-484b-9dec-270addb88c70 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:38.092093 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-05d363c6-a8e7-484b-9dec-270addb88c70 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:38.092578 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-05d363c6-a8e7-484b-9dec-270addb88c70 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:38.093018 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-05d363c6-a8e7-484b-9dec-270addb88c70 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:38.093784 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-05d363c6-a8e7-484b-9dec-270addb88c70 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:38.094248 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-05d363c6-a8e7-484b-9dec-270addb88c70 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:38.094676 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-05d363c6-a8e7-484b-9dec-270addb88c70 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:38.121460 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-05d363c6-a8e7-484b-9dec-270addb88c70 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Getting quotas for project ec54882ff5fa47fe9303222e3f936de9. Resources: {'ram', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 02:23:38.126672 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-05d363c6-a8e7-484b-9dec-270addb88c70 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Getting quotas for user bd6a4d32970a4d72be7109ceaf173241 and project ec54882ff5fa47fe9303222e3f936de9. Resources: {'ram', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 02:23:38.493720 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-05d363c6-a8e7-484b-9dec-270addb88c70 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "POST /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db/action" status: 202 len: 0 microversion: 2.1 time: 0.453883 Oct 30 02:23:38.494764 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3539/7412] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 02:23:38 2022] POST /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db/action => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 02:23:38.502779 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1950ecd6-dea7-498c-9024-f8889a8c2f5e tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:23:38.503538 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1950ecd6-dea7-498c-9024-f8889a8c2f5e tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:23:38.509609 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1950ecd6-dea7-498c-9024-f8889a8c2f5e tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:38.510412 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1950ecd6-dea7-498c-9024-f8889a8c2f5e tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:38.511107 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1950ecd6-dea7-498c-9024-f8889a8c2f5e tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:38.511889 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1950ecd6-dea7-498c-9024-f8889a8c2f5e tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:38.512430 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1950ecd6-dea7-498c-9024-f8889a8c2f5e tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:38.512935 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1950ecd6-dea7-498c-9024-f8889a8c2f5e tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:38.717054 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1950ecd6-dea7-498c-9024-f8889a8c2f5e tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:23:38.725509 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1950ecd6-dea7-498c-9024-f8889a8c2f5e tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db" status: 200 len: 1679 microversion: 2.1 time: 0.226654 Oct 30 02:23:38.726085 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3874/7413] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:23:38 2022] GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db => generated 1679 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:23:39.750259 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7bbfe5fa-2375-48fb-a16f-77f1ab80ce2a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:23:39.750961 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7bbfe5fa-2375-48fb-a16f-77f1ab80ce2a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:23:39.757216 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7bbfe5fa-2375-48fb-a16f-77f1ab80ce2a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:39.757730 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7bbfe5fa-2375-48fb-a16f-77f1ab80ce2a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:39.758167 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7bbfe5fa-2375-48fb-a16f-77f1ab80ce2a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:39.758852 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7bbfe5fa-2375-48fb-a16f-77f1ab80ce2a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:39.759316 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7bbfe5fa-2375-48fb-a16f-77f1ab80ce2a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:39.759736 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7bbfe5fa-2375-48fb-a16f-77f1ab80ce2a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:39.774453 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:23:39.889055 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7bbfe5fa-2375-48fb-a16f-77f1ab80ce2a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:23:39.896941 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7bbfe5fa-2375-48fb-a16f-77f1ab80ce2a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db" status: 200 len: 1679 microversion: 2.1 time: 0.151778 Oct 30 02:23:39.897560 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3540/7414] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:23:39 2022] GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:23:40.790581 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-6391cd02-47c1-4724-b60f-5f6c82d237e6 req-dc248451-e5ce-48e2-9e5c-4136a37fef4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db", "name": "network-vif-plugged", "status": "completed", "tag": "9422e03e-876e-4509-9528-4572246a61b7"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:23:40.800273 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-6391cd02-47c1-4724-b60f-5f6c82d237e6 req-dc248451-e5ce-48e2-9e5c-4136a37fef4d service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:40.800769 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-6391cd02-47c1-4724-b60f-5f6c82d237e6 req-dc248451-e5ce-48e2-9e5c-4136a37fef4d service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:40.801218 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-6391cd02-47c1-4724-b60f-5f6c82d237e6 req-dc248451-e5ce-48e2-9e5c-4136a37fef4d service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:40.814463 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-6391cd02-47c1-4724-b60f-5f6c82d237e6 req-dc248451-e5ce-48e2-9e5c-4136a37fef4d service nova] Creating event network-vif-plugged:9422e03e-876e-4509-9528-4572246a61b7 for instance 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db on n-h1-master-1 Oct 30 02:23:40.820603 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [req-6391cd02-47c1-4724-b60f-5f6c82d237e6 req-dc248451-e5ce-48e2-9e5c-4136a37fef4d service nova] Instance 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=121102) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 30 02:23:40.832482 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-6391cd02-47c1-4724-b60f-5f6c82d237e6 req-dc248451-e5ce-48e2-9e5c-4136a37fef4d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109014 Oct 30 02:23:40.833263 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3875/7415] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:23:40.919472 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-99f3d3c7-4ebe-4f87-bfbf-ef66da780bb6 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:23:40.920109 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-99f3d3c7-4ebe-4f87-bfbf-ef66da780bb6 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:23:40.926806 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-99f3d3c7-4ebe-4f87-bfbf-ef66da780bb6 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:40.927281 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-99f3d3c7-4ebe-4f87-bfbf-ef66da780bb6 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:40.927974 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-99f3d3c7-4ebe-4f87-bfbf-ef66da780bb6 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:40.928657 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-99f3d3c7-4ebe-4f87-bfbf-ef66da780bb6 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:40.929101 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-99f3d3c7-4ebe-4f87-bfbf-ef66da780bb6 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:40.929562 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-99f3d3c7-4ebe-4f87-bfbf-ef66da780bb6 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:41.059394 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-99f3d3c7-4ebe-4f87-bfbf-ef66da780bb6 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:23:41.067232 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-99f3d3c7-4ebe-4f87-bfbf-ef66da780bb6 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db" status: 200 len: 1679 microversion: 2.1 time: 0.151613 Oct 30 02:23:41.067819 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3541/7416] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:23:40 2022] GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:23:42.092079 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5f4caa72-306c-4e85-b31e-93e009dd3b29 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:23:42.092794 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5f4caa72-306c-4e85-b31e-93e009dd3b29 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:23:42.098937 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f4caa72-306c-4e85-b31e-93e009dd3b29 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:42.100033 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f4caa72-306c-4e85-b31e-93e009dd3b29 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:42.100033 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f4caa72-306c-4e85-b31e-93e009dd3b29 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:42.101206 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f4caa72-306c-4e85-b31e-93e009dd3b29 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:42.101695 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f4caa72-306c-4e85-b31e-93e009dd3b29 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:42.102137 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f4caa72-306c-4e85-b31e-93e009dd3b29 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:42.219117 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-8895e3f2-d573-4893-af1a-80c04ac0d7a8 req-7fb318fe-d03d-48b9-91c3-0e1d048e08cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db", "name": "network-vif-unplugged", "status": "completed", "tag": "9422e03e-876e-4509-9528-4572246a61b7"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:23:42.230696 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-8895e3f2-d573-4893-af1a-80c04ac0d7a8 req-7fb318fe-d03d-48b9-91c3-0e1d048e08cc service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:42.231434 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-8895e3f2-d573-4893-af1a-80c04ac0d7a8 req-7fb318fe-d03d-48b9-91c3-0e1d048e08cc service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:42.231864 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-8895e3f2-d573-4893-af1a-80c04ac0d7a8 req-7fb318fe-d03d-48b9-91c3-0e1d048e08cc service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:42.240857 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5f4caa72-306c-4e85-b31e-93e009dd3b29 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:23:42.243665 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-8895e3f2-d573-4893-af1a-80c04ac0d7a8 req-7fb318fe-d03d-48b9-91c3-0e1d048e08cc service nova] Creating event network-vif-unplugged:9422e03e-876e-4509-9528-4572246a61b7 for instance 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db on n-h2-master-1 Oct 30 02:23:42.244663 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:23:42.249057 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [req-8895e3f2-d573-4893-af1a-80c04ac0d7a8 req-7fb318fe-d03d-48b9-91c3-0e1d048e08cc service nova] Instance 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=121103) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 30 02:23:42.254761 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5f4caa72-306c-4e85-b31e-93e009dd3b29 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db" status: 200 len: 1679 microversion: 2.1 time: 0.162941 Oct 30 02:23:42.254761 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3876/7417] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:23:42 2022] GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:23:42.259643 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-8895e3f2-d573-4893-af1a-80c04ac0d7a8 req-7fb318fe-d03d-48b9-91c3-0e1d048e08cc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044172 Oct 30 02:23:42.260234 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3542/7418] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:23:43.274244 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-27927fab-a00c-4d2f-9432-9f455db71fcd tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:23:43.274905 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-27927fab-a00c-4d2f-9432-9f455db71fcd tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:23:43.278068 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=37 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:23:43.293715 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27927fab-a00c-4d2f-9432-9f455db71fcd tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:43.293715 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27927fab-a00c-4d2f-9432-9f455db71fcd tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:43.293715 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27927fab-a00c-4d2f-9432-9f455db71fcd tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:43.293715 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27927fab-a00c-4d2f-9432-9f455db71fcd tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:43.293715 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27927fab-a00c-4d2f-9432-9f455db71fcd tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:43.293715 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27927fab-a00c-4d2f-9432-9f455db71fcd tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:43.417520 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-27927fab-a00c-4d2f-9432-9f455db71fcd tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:23:43.426009 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-27927fab-a00c-4d2f-9432-9f455db71fcd tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db" status: 200 len: 1679 microversion: 2.1 time: 0.156381 Oct 30 02:23:43.426585 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3877/7419] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:23:43 2022] GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:23:44.276198 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-4195c7c2-bb76-4e34-bd82-ad7b5d644ff8 req-4993bc80-28c2-4cb5-b002-6d5f95746e6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db", "tag": "9422e03e-876e-4509-9528-4572246a61b7"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:23:44.285653 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-4195c7c2-bb76-4e34-bd82-ad7b5d644ff8 req-4993bc80-28c2-4cb5-b002-6d5f95746e6a service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:44.286127 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-4195c7c2-bb76-4e34-bd82-ad7b5d644ff8 req-4993bc80-28c2-4cb5-b002-6d5f95746e6a service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:44.286547 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-4195c7c2-bb76-4e34-bd82-ad7b5d644ff8 req-4993bc80-28c2-4cb5-b002-6d5f95746e6a service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:44.298520 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-4195c7c2-bb76-4e34-bd82-ad7b5d644ff8 req-4993bc80-28c2-4cb5-b002-6d5f95746e6a service nova] Creating event network-changed:9422e03e-876e-4509-9528-4572246a61b7 for instance 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db on n-h2-master-1 Oct 30 02:23:44.303925 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [req-4195c7c2-bb76-4e34-bd82-ad7b5d644ff8 req-4993bc80-28c2-4cb5-b002-6d5f95746e6a service nova] Instance 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=121103) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 30 02:23:44.315698 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-4195c7c2-bb76-4e34-bd82-ad7b5d644ff8 req-4993bc80-28c2-4cb5-b002-6d5f95746e6a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044410 Oct 30 02:23:44.316782 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3543/7420] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:23:44.450567 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-358999d5-95ef-41da-bc30-ace93129abfe tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:23:44.451192 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-358999d5-95ef-41da-bc30-ace93129abfe tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:23:44.458927 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-358999d5-95ef-41da-bc30-ace93129abfe tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:44.460199 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-358999d5-95ef-41da-bc30-ace93129abfe tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:44.460855 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-358999d5-95ef-41da-bc30-ace93129abfe tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:44.461677 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-358999d5-95ef-41da-bc30-ace93129abfe tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:44.462148 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-358999d5-95ef-41da-bc30-ace93129abfe tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:44.462585 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-358999d5-95ef-41da-bc30-ace93129abfe tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:44.689515 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-358999d5-95ef-41da-bc30-ace93129abfe tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:23:44.698314 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-358999d5-95ef-41da-bc30-ace93129abfe tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db" status: 200 len: 1679 microversion: 2.1 time: 0.252088 Oct 30 02:23:44.698919 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3878/7421] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:23:44 2022] GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db => generated 1679 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:23:45.722663 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c103c319-5f0f-497c-ba92-44b5672e31a9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:23:45.723306 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c103c319-5f0f-497c-ba92-44b5672e31a9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:23:45.726190 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:23:45.731554 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c103c319-5f0f-497c-ba92-44b5672e31a9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:45.732037 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c103c319-5f0f-497c-ba92-44b5672e31a9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:45.732468 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c103c319-5f0f-497c-ba92-44b5672e31a9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:45.733147 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c103c319-5f0f-497c-ba92-44b5672e31a9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:45.733623 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c103c319-5f0f-497c-ba92-44b5672e31a9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:45.734045 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c103c319-5f0f-497c-ba92-44b5672e31a9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:45.866395 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c103c319-5f0f-497c-ba92-44b5672e31a9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:23:45.874097 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c103c319-5f0f-497c-ba92-44b5672e31a9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db" status: 200 len: 1672 microversion: 2.1 time: 0.155779 Oct 30 02:23:45.874668 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3544/7422] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:23:45 2022] GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:23:45.896114 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7f392883-0900-4311-ac51-7a7b80fb6eef tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:23:45.896749 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7f392883-0900-4311-ac51-7a7b80fb6eef tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:23:45.904141 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7f392883-0900-4311-ac51-7a7b80fb6eef tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:45.904623 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7f392883-0900-4311-ac51-7a7b80fb6eef tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:45.905073 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7f392883-0900-4311-ac51-7a7b80fb6eef tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:45.905809 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7f392883-0900-4311-ac51-7a7b80fb6eef tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:45.906281 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7f392883-0900-4311-ac51-7a7b80fb6eef tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:45.906725 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7f392883-0900-4311-ac51-7a7b80fb6eef tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:46.037845 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7f392883-0900-4311-ac51-7a7b80fb6eef tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:23:46.045577 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7f392883-0900-4311-ac51-7a7b80fb6eef tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db" status: 200 len: 1672 microversion: 2.1 time: 0.153349 Oct 30 02:23:46.046158 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3879/7423] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:23:45 2022] GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:23:46.067454 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bbca60fa-8a2f-4582-ba36-6fa02405b251 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:23:46.068070 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-bbca60fa-8a2f-4582-ba36-6fa02405b251 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:23:46.074489 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bbca60fa-8a2f-4582-ba36-6fa02405b251 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:46.074979 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bbca60fa-8a2f-4582-ba36-6fa02405b251 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:46.075420 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bbca60fa-8a2f-4582-ba36-6fa02405b251 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:46.076113 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bbca60fa-8a2f-4582-ba36-6fa02405b251 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:46.076570 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bbca60fa-8a2f-4582-ba36-6fa02405b251 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:46.076999 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bbca60fa-8a2f-4582-ba36-6fa02405b251 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:46.204909 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-bbca60fa-8a2f-4582-ba36-6fa02405b251 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:23:46.213226 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bbca60fa-8a2f-4582-ba36-6fa02405b251 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db" status: 200 len: 1672 microversion: 2.1 time: 0.149642 Oct 30 02:23:46.213830 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3545/7424] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:23:46 2022] GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db => generated 1672 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:23:46.236158 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-de95ceb9-13a5-4a14-9b08-b8014ca8e0dc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:23:46.236471 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-de95ceb9-13a5-4a14-9b08-b8014ca8e0dc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:23:46.242522 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-de95ceb9-13a5-4a14-9b08-b8014ca8e0dc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:46.243020 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-de95ceb9-13a5-4a14-9b08-b8014ca8e0dc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:46.243482 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-de95ceb9-13a5-4a14-9b08-b8014ca8e0dc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:46.244177 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-de95ceb9-13a5-4a14-9b08-b8014ca8e0dc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:46.244639 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-de95ceb9-13a5-4a14-9b08-b8014ca8e0dc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:46.245076 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-de95ceb9-13a5-4a14-9b08-b8014ca8e0dc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:46.270823 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-de95ceb9-13a5-4a14-9b08-b8014ca8e0dc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 02:23:46.555903 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-de95ceb9-13a5-4a14-9b08-b8014ca8e0dc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db" status: 204 len: 0 microversion: 2.1 time: 0.323189 Oct 30 02:23:46.556434 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3880/7425] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 02:23:46 2022] DELETE /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 02:23:46.564891 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ab685981-9a48-4c5c-80df-40509ad0fe44 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:23:46.565535 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ab685981-9a48-4c5c-80df-40509ad0fe44 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:23:46.572395 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ab685981-9a48-4c5c-80df-40509ad0fe44 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:46.572880 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ab685981-9a48-4c5c-80df-40509ad0fe44 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:46.573319 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ab685981-9a48-4c5c-80df-40509ad0fe44 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:46.574036 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ab685981-9a48-4c5c-80df-40509ad0fe44 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:46.574490 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ab685981-9a48-4c5c-80df-40509ad0fe44 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:46.574917 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ab685981-9a48-4c5c-80df-40509ad0fe44 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:46.708482 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ab685981-9a48-4c5c-80df-40509ad0fe44 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:23:46.716521 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ab685981-9a48-4c5c-80df-40509ad0fe44 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db" status: 200 len: 1678 microversion: 2.1 time: 0.155536 Oct 30 02:23:46.717113 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3546/7426] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:23:46 2022] GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:23:47.740561 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7ffbdd50-2b20-42e7-9608-8bc99cabb932 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:23:47.741186 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7ffbdd50-2b20-42e7-9608-8bc99cabb932 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:23:47.749624 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7ffbdd50-2b20-42e7-9608-8bc99cabb932 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:47.750136 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7ffbdd50-2b20-42e7-9608-8bc99cabb932 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:47.750592 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7ffbdd50-2b20-42e7-9608-8bc99cabb932 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:47.751311 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7ffbdd50-2b20-42e7-9608-8bc99cabb932 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:47.751783 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7ffbdd50-2b20-42e7-9608-8bc99cabb932 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:47.752228 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7ffbdd50-2b20-42e7-9608-8bc99cabb932 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:47.884556 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7ffbdd50-2b20-42e7-9608-8bc99cabb932 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:23:47.892689 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7ffbdd50-2b20-42e7-9608-8bc99cabb932 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db" status: 200 len: 1678 microversion: 2.1 time: 0.156480 Oct 30 02:23:47.893271 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3881/7427] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:23:47 2022] GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:23:48.414513 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-d91c9789-2ddc-47ee-a2e2-585204e13dde req-57d7b4a7-5720-4c4e-8551-3d1f1f0c9951 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db", "name": "network-vif-plugged", "status": "completed", "tag": "9422e03e-876e-4509-9528-4572246a61b7"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:23:48.424992 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:23:48.427141 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d91c9789-2ddc-47ee-a2e2-585204e13dde req-57d7b4a7-5720-4c4e-8551-3d1f1f0c9951 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:48.427884 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d91c9789-2ddc-47ee-a2e2-585204e13dde req-57d7b4a7-5720-4c4e-8551-3d1f1f0c9951 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:48.428321 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d91c9789-2ddc-47ee-a2e2-585204e13dde req-57d7b4a7-5720-4c4e-8551-3d1f1f0c9951 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:48.440678 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-d91c9789-2ddc-47ee-a2e2-585204e13dde req-57d7b4a7-5720-4c4e-8551-3d1f1f0c9951 service nova] Creating event network-vif-plugged:9422e03e-876e-4509-9528-4572246a61b7 for instance 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db on n-h2-master-1 Oct 30 02:23:48.446222 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-d91c9789-2ddc-47ee-a2e2-585204e13dde req-57d7b4a7-5720-4c4e-8551-3d1f1f0c9951 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034953 Oct 30 02:23:48.446841 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3547/7428] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:23:48.917223 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f168027a-3a31-4932-9ae6-5a2a2ec73b05 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:23:48.917889 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f168027a-3a31-4932-9ae6-5a2a2ec73b05 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:23:48.925013 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f168027a-3a31-4932-9ae6-5a2a2ec73b05 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:48.925554 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f168027a-3a31-4932-9ae6-5a2a2ec73b05 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:48.926010 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f168027a-3a31-4932-9ae6-5a2a2ec73b05 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:48.926718 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f168027a-3a31-4932-9ae6-5a2a2ec73b05 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:48.927188 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f168027a-3a31-4932-9ae6-5a2a2ec73b05 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:48.927881 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f168027a-3a31-4932-9ae6-5a2a2ec73b05 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:48.994900 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f168027a-3a31-4932-9ae6-5a2a2ec73b05 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:23:49.003173 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f168027a-3a31-4932-9ae6-5a2a2ec73b05 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db" status: 200 len: 1610 microversion: 2.1 time: 0.090300 Oct 30 02:23:49.003699 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3882/7429] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:23:48 2022] GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db => generated 1610 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:23:49.215690 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-9db9f17f-0ed2-494d-8d77-e1f9bad4456f req-639b9a16-939a-417c-9a36-4ee7b6c01feb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db", "name": "network-vif-deleted", "tag": "9422e03e-876e-4509-9528-4572246a61b7"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:23:49.234829 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-9db9f17f-0ed2-494d-8d77-e1f9bad4456f req-639b9a16-939a-417c-9a36-4ee7b6c01feb service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:49.234829 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-9db9f17f-0ed2-494d-8d77-e1f9bad4456f req-639b9a16-939a-417c-9a36-4ee7b6c01feb service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:49.234829 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-9db9f17f-0ed2-494d-8d77-e1f9bad4456f req-639b9a16-939a-417c-9a36-4ee7b6c01feb service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:49.240409 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-9db9f17f-0ed2-494d-8d77-e1f9bad4456f req-639b9a16-939a-417c-9a36-4ee7b6c01feb service nova] Creating event network-vif-deleted:9422e03e-876e-4509-9528-4572246a61b7 for instance 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db on n-h2-master-1 Oct 30 02:23:49.245369 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-9db9f17f-0ed2-494d-8d77-e1f9bad4456f req-639b9a16-939a-417c-9a36-4ee7b6c01feb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034765 Oct 30 02:23:49.245915 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3548/7430] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:23:50.026474 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bb160c77-d51a-4a2d-a3d2-ff08b6639c56 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:23:50.030612 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bb160c77-d51a-4a2d-a3d2-ff08b6639c56 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:23:50.034316 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb160c77-d51a-4a2d-a3d2-ff08b6639c56 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:50.034758 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb160c77-d51a-4a2d-a3d2-ff08b6639c56 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:50.035207 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb160c77-d51a-4a2d-a3d2-ff08b6639c56 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:50.035916 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb160c77-d51a-4a2d-a3d2-ff08b6639c56 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:50.036393 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb160c77-d51a-4a2d-a3d2-ff08b6639c56 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:50.036813 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb160c77-d51a-4a2d-a3d2-ff08b6639c56 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:50.071947 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb160c77-d51a-4a2d-a3d2-ff08b6639c56 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:50.072489 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb160c77-d51a-4a2d-a3d2-ff08b6639c56 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:50.072947 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb160c77-d51a-4a2d-a3d2-ff08b6639c56 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:50.073439 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-bb160c77-d51a-4a2d-a3d2-ff08b6639c56 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lazy-loading 'fault' on Instance uuid 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 02:23:50.119556 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bb160c77-d51a-4a2d-a3d2-ff08b6639c56 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:23:50.128280 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bb160c77-d51a-4a2d-a3d2-ff08b6639c56 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db" status: 200 len: 1329 microversion: 2.1 time: 0.105857 Oct 30 02:23:50.137049 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3883/7431] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:23:50 2022] GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db => generated 1329 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:23:51.153268 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-46c42d84-e362-4850-98f0-444c575ad387 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:23:51.153908 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-46c42d84-e362-4850-98f0-444c575ad387 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:23:51.160024 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-46c42d84-e362-4850-98f0-444c575ad387 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:51.160510 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-46c42d84-e362-4850-98f0-444c575ad387 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:51.160945 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-46c42d84-e362-4850-98f0-444c575ad387 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:51.161669 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-46c42d84-e362-4850-98f0-444c575ad387 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:51.162124 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-46c42d84-e362-4850-98f0-444c575ad387 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:51.162548 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-46c42d84-e362-4850-98f0-444c575ad387 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:51.175704 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-46c42d84-e362-4850-98f0-444c575ad387 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] HTTP exception thrown: Instance 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db could not be found. Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-46c42d84-e362-4850-98f0-444c575ad387 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Request method failure captured: Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db HTTP/1.1 Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXd8_AaHeYv7mI8KcOiEpHHSLt3xix4i3AijgcSjiVH8gCZDNZTQs2eKPUSYf3-FI8TMZsjcfFPTEgO2BYtL_E0r7tuLX6t2K_PeaBE5t7gXNmnm97kpENPfU_RCfhh6EcQIjwoSMcBV6P-7_37AV6319KodCPKJo_De4zA522gc3ZJc Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: ec54882ff5fa47fe9303222e3f936de9 Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServerActionsTestJSON-1524178034 Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServerActionsTestJSON-1524178034 Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: ec54882ff5fa47fe9303222e3f936de9 Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServerActionsTestJSON-1524178034 Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServerActionsTestJSON-1524178034-project Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: bd6a4d32970a4d72be7109ceaf173241 Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServerActionsTestJSON-1524178034-project Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db could not be found. Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db'} Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db could not be found. Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db could not be found. Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:23:51.177655 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:23:51.182589 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:23:51.182589 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:23:51.182589 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:23:51.182589 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:23:51.182589 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:23:51.182589 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db could not be found. Oct 30 02:23:51.182589 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:23:51.182589 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-46c42d84-e362-4850-98f0-444c575ad387 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Returning 404 to user: Instance 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:23:51.182589 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-46c42d84-e362-4850-98f0-444c575ad387 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db" status: 404 len: 111 microversion: 2.1 time: 0.031027 Oct 30 02:23:51.182589 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3549/7432] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:23:51 2022] GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 02:23:51.198579 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-558f6ab3-725b-48dd-ab3c-ab7246afc000 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:23:51.199250 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-558f6ab3-725b-48dd-ab3c-ab7246afc000 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:23:51.206191 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-558f6ab3-725b-48dd-ab3c-ab7246afc000 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:51.206695 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-558f6ab3-725b-48dd-ab3c-ab7246afc000 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:51.207149 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-558f6ab3-725b-48dd-ab3c-ab7246afc000 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:51.207891 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-558f6ab3-725b-48dd-ab3c-ab7246afc000 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:51.208361 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-558f6ab3-725b-48dd-ab3c-ab7246afc000 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:51.208800 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-558f6ab3-725b-48dd-ab3c-ab7246afc000 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:51.225105 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-558f6ab3-725b-48dd-ab3c-ab7246afc000 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] HTTP exception thrown: Instance 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db could not be found. Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-558f6ab3-725b-48dd-ab3c-ab7246afc000 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Request method failure captured: Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db HTTP/1.1 Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXd8_AaHeYv7mI8KcOiEpHHSLt3xix4i3AijgcSjiVH8gCZDNZTQs2eKPUSYf3-FI8TMZsjcfFPTEgO2BYtL_E0r7tuLX6t2K_PeaBE5t7gXNmnm97kpENPfU_RCfhh6EcQIjwoSMcBV6P-7_37AV6319KodCPKJo_De4zA522gc3ZJc Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: ec54882ff5fa47fe9303222e3f936de9 Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServerActionsTestJSON-1524178034 Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServerActionsTestJSON-1524178034 Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: ec54882ff5fa47fe9303222e3f936de9 Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServerActionsTestJSON-1524178034 Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServerActionsTestJSON-1524178034-project Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: bd6a4d32970a4d72be7109ceaf173241 Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServerActionsTestJSON-1524178034-project Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db could not be found. Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db'} Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db could not be found. Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db could not be found. Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:23:51.226819 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:23:51.232144 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:23:51.232144 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:23:51.232144 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:23:51.232144 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:23:51.232144 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:23:51.232144 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db could not be found. Oct 30 02:23:51.232144 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:23:51.232144 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-558f6ab3-725b-48dd-ab3c-ab7246afc000 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Returning 404 to user: Instance 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:23:51.232144 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-558f6ab3-725b-48dd-ab3c-ab7246afc000 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db" status: 404 len: 111 microversion: 2.1 time: 0.034777 Oct 30 02:23:51.232144 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3884/7433] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:23:51 2022] GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 02:23:51.277766 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3c96c453-56c6-4ffc-9ee8-c40e1341d32b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-563621655", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "69a7f320-9fb0-467c-85eb-ca0c978501c8"}], "security_groups": [{"name": "tempest-securitygroup--1896496015"}], "key_name": "tempest-keypair-1057397827", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:23:51.393891 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-3c96c453-56c6-4ffc-9ee8-c40e1341d32b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] validate_networks() for [('69a7f320-9fb0-467c-85eb-ca0c978501c8', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 02:23:51.807150 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-3c96c453-56c6-4ffc-9ee8-c40e1341d32b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 02:23:51.807580 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-3c96c453-56c6-4ffc-9ee8-c40e1341d32b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 02:23:51.808057 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-3c96c453-56c6-4ffc-9ee8-c40e1341d32b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 02:23:51.808590 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-3c96c453-56c6-4ffc-9ee8-c40e1341d32b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 02:23:51.809009 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-3c96c453-56c6-4ffc-9ee8-c40e1341d32b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 02:23:51.817848 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3c96c453-56c6-4ffc-9ee8-c40e1341d32b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:51.818334 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3c96c453-56c6-4ffc-9ee8-c40e1341d32b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:51.818769 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3c96c453-56c6-4ffc-9ee8-c40e1341d32b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:51.819503 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3c96c453-56c6-4ffc-9ee8-c40e1341d32b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:51.819957 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3c96c453-56c6-4ffc-9ee8-c40e1341d32b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:51.820384 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3c96c453-56c6-4ffc-9ee8-c40e1341d32b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:51.837572 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-3c96c453-56c6-4ffc-9ee8-c40e1341d32b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Getting quotas for project ec54882ff5fa47fe9303222e3f936de9. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 02:23:51.842767 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-3c96c453-56c6-4ffc-9ee8-c40e1341d32b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Getting quotas for user bd6a4d32970a4d72be7109ceaf173241 and project ec54882ff5fa47fe9303222e3f936de9. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 02:23:51.855674 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3c96c453-56c6-4ffc-9ee8-c40e1341d32b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 02:23:51.857986 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3c96c453-56c6-4ffc-9ee8-c40e1341d32b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 02:23:51.964831 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3c96c453-56c6-4ffc-9ee8-c40e1341d32b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.690893 Oct 30 02:23:51.965509 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3550/7434] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 02:23:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 02:23:51.976684 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ce5708f8-0b57-485e-b64b-1cd5e1b5f437 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:23:51.977909 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ce5708f8-0b57-485e-b64b-1cd5e1b5f437 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:23:52.032564 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ce5708f8-0b57-485e-b64b-1cd5e1b5f437 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:23:52.040044 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ce5708f8-0b57-485e-b64b-1cd5e1b5f437 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1238 microversion: 2.1 time: 0.067181 Oct 30 02:23:52.044877 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3885/7435] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:23:51 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1238 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:23:53.064704 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-91514f9f-190a-4cf9-aeac-c443f730e857 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:23:53.065317 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-91514f9f-190a-4cf9-aeac-c443f730e857 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:23:53.072184 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91514f9f-190a-4cf9-aeac-c443f730e857 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:53.072669 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91514f9f-190a-4cf9-aeac-c443f730e857 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:53.073100 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91514f9f-190a-4cf9-aeac-c443f730e857 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:53.073819 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91514f9f-190a-4cf9-aeac-c443f730e857 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:53.074273 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91514f9f-190a-4cf9-aeac-c443f730e857 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:53.074740 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91514f9f-190a-4cf9-aeac-c443f730e857 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:53.139062 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-91514f9f-190a-4cf9-aeac-c443f730e857 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:23:53.146898 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-91514f9f-190a-4cf9-aeac-c443f730e857 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1242 microversion: 2.1 time: 0.086970 Oct 30 02:23:53.147412 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3551/7436] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:23:53 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1242 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:23:54.171214 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1761d32a-106b-41da-a493-2fca967a9572 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:23:54.172243 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1761d32a-106b-41da-a493-2fca967a9572 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:23:54.180622 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1761d32a-106b-41da-a493-2fca967a9572 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:54.181127 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1761d32a-106b-41da-a493-2fca967a9572 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:54.181608 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1761d32a-106b-41da-a493-2fca967a9572 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:54.183301 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1761d32a-106b-41da-a493-2fca967a9572 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:54.183809 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1761d32a-106b-41da-a493-2fca967a9572 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:54.184420 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1761d32a-106b-41da-a493-2fca967a9572 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:54.259360 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1761d32a-106b-41da-a493-2fca967a9572 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:23:54.268603 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1761d32a-106b-41da-a493-2fca967a9572 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1308 microversion: 2.1 time: 0.101284 Oct 30 02:23:54.269284 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3886/7437] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:23:54 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1308 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:23:55.296217 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a8e0fc6e-15f6-4a6e-aa2d-088577a417a8 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:23:55.296830 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a8e0fc6e-15f6-4a6e-aa2d-088577a417a8 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:23:55.304009 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a8e0fc6e-15f6-4a6e-aa2d-088577a417a8 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:55.304495 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a8e0fc6e-15f6-4a6e-aa2d-088577a417a8 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:55.304935 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a8e0fc6e-15f6-4a6e-aa2d-088577a417a8 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:55.305659 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a8e0fc6e-15f6-4a6e-aa2d-088577a417a8 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:55.306110 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a8e0fc6e-15f6-4a6e-aa2d-088577a417a8 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:55.306531 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a8e0fc6e-15f6-4a6e-aa2d-088577a417a8 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:55.441647 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a8e0fc6e-15f6-4a6e-aa2d-088577a417a8 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:23:55.450391 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a8e0fc6e-15f6-4a6e-aa2d-088577a417a8 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1364 microversion: 2.1 time: 0.158144 Oct 30 02:23:55.451085 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3552/7438] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:23:55 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:23:55.722309 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-2ccac75c-1d85-4889-8c90-08d5b4817f19 req-7a5aed61-1999-48fe-b4b5-ad2008893b9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46108ce5-da96-4eed-969e-74f68c100472", "tag": "96f1c448-2187-4949-be70-6fd5aa27af4a"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:23:55.734176 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-2ccac75c-1d85-4889-8c90-08d5b4817f19 req-7a5aed61-1999-48fe-b4b5-ad2008893b9e service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:55.734670 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-2ccac75c-1d85-4889-8c90-08d5b4817f19 req-7a5aed61-1999-48fe-b4b5-ad2008893b9e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:55.735113 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-2ccac75c-1d85-4889-8c90-08d5b4817f19 req-7a5aed61-1999-48fe-b4b5-ad2008893b9e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:55.747041 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-2ccac75c-1d85-4889-8c90-08d5b4817f19 req-7a5aed61-1999-48fe-b4b5-ad2008893b9e service nova] Creating event network-changed:96f1c448-2187-4949-be70-6fd5aa27af4a for instance 46108ce5-da96-4eed-969e-74f68c100472 on n-h1-master-1 Oct 30 02:23:55.751951 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-2ccac75c-1d85-4889-8c90-08d5b4817f19 req-7a5aed61-1999-48fe-b4b5-ad2008893b9e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033432 Oct 30 02:23:55.752552 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3887/7439] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:23:56.473753 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9610843e-6e95-4e33-92e8-cb8290dbef35 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:23:56.474371 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9610843e-6e95-4e33-92e8-cb8290dbef35 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:23:56.481832 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9610843e-6e95-4e33-92e8-cb8290dbef35 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:56.483279 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9610843e-6e95-4e33-92e8-cb8290dbef35 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:56.483279 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9610843e-6e95-4e33-92e8-cb8290dbef35 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:56.483496 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9610843e-6e95-4e33-92e8-cb8290dbef35 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:56.483882 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9610843e-6e95-4e33-92e8-cb8290dbef35 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:56.484305 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9610843e-6e95-4e33-92e8-cb8290dbef35 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:56.613109 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9610843e-6e95-4e33-92e8-cb8290dbef35 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:23:56.621611 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9610843e-6e95-4e33-92e8-cb8290dbef35 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1364 microversion: 2.1 time: 0.151724 Oct 30 02:23:56.622128 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3553/7440] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:23:56 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:23:57.646152 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d0dd7a64-eff5-4831-b39f-37e25df57439 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:23:57.646887 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d0dd7a64-eff5-4831-b39f-37e25df57439 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:23:57.653137 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d0dd7a64-eff5-4831-b39f-37e25df57439 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:57.653726 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d0dd7a64-eff5-4831-b39f-37e25df57439 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:57.654173 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d0dd7a64-eff5-4831-b39f-37e25df57439 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:57.654870 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d0dd7a64-eff5-4831-b39f-37e25df57439 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:57.655333 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d0dd7a64-eff5-4831-b39f-37e25df57439 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:57.655770 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d0dd7a64-eff5-4831-b39f-37e25df57439 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:57.788342 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d0dd7a64-eff5-4831-b39f-37e25df57439 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:23:57.796003 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d0dd7a64-eff5-4831-b39f-37e25df57439 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1364 microversion: 2.1 time: 0.155288 Oct 30 02:23:57.796571 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3888/7441] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:23:57 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:23:58.819765 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-548ddf12-4665-4803-b444-cf1ae357de89 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:23:58.820385 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-548ddf12-4665-4803-b444-cf1ae357de89 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:23:58.828079 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-548ddf12-4665-4803-b444-cf1ae357de89 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:58.828572 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-548ddf12-4665-4803-b444-cf1ae357de89 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:58.829012 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-548ddf12-4665-4803-b444-cf1ae357de89 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:58.829736 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-548ddf12-4665-4803-b444-cf1ae357de89 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:58.830188 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-548ddf12-4665-4803-b444-cf1ae357de89 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:23:58.830611 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-548ddf12-4665-4803-b444-cf1ae357de89 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:23:58.960126 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-548ddf12-4665-4803-b444-cf1ae357de89 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:23:58.968591 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-548ddf12-4665-4803-b444-cf1ae357de89 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1364 microversion: 2.1 time: 0.152792 Oct 30 02:23:58.969168 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3554/7442] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:23:58 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:23:59.991182 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9ed4fbef-4145-4a5e-a7ba-264ad408b9ce tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:23:59.991847 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9ed4fbef-4145-4a5e-a7ba-264ad408b9ce tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:23:59.999292 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9ed4fbef-4145-4a5e-a7ba-264ad408b9ce tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:23:59.999789 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9ed4fbef-4145-4a5e-a7ba-264ad408b9ce tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:24:00.000238 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9ed4fbef-4145-4a5e-a7ba-264ad408b9ce tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:24:00.000946 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9ed4fbef-4145-4a5e-a7ba-264ad408b9ce tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:24:00.001442 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9ed4fbef-4145-4a5e-a7ba-264ad408b9ce tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:24:00.001883 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9ed4fbef-4145-4a5e-a7ba-264ad408b9ce tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:24:00.129071 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9ed4fbef-4145-4a5e-a7ba-264ad408b9ce tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:24:00.137268 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9ed4fbef-4145-4a5e-a7ba-264ad408b9ce tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1364 microversion: 2.1 time: 0.150031 Oct 30 02:24:00.137874 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3889/7443] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:23:59 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:24:00.840156 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-7c25831f-a7e9-430a-9eee-6a6b959a0330 req-569003eb-15a2-49c2-b208-87b9251375e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46108ce5-da96-4eed-969e-74f68c100472", "name": "network-vif-plugged", "status": "completed", "tag": "96f1c448-2187-4949-be70-6fd5aa27af4a"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:24:00.850915 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-7c25831f-a7e9-430a-9eee-6a6b959a0330 req-569003eb-15a2-49c2-b208-87b9251375e1 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:24:00.851401 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-7c25831f-a7e9-430a-9eee-6a6b959a0330 req-569003eb-15a2-49c2-b208-87b9251375e1 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:24:00.852469 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-7c25831f-a7e9-430a-9eee-6a6b959a0330 req-569003eb-15a2-49c2-b208-87b9251375e1 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:24:00.863396 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-7c25831f-a7e9-430a-9eee-6a6b959a0330 req-569003eb-15a2-49c2-b208-87b9251375e1 service nova] Creating event network-vif-plugged:96f1c448-2187-4949-be70-6fd5aa27af4a for instance 46108ce5-da96-4eed-969e-74f68c100472 on n-h1-master-1 Oct 30 02:24:00.868378 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-7c25831f-a7e9-430a-9eee-6a6b959a0330 req-569003eb-15a2-49c2-b208-87b9251375e1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032700 Oct 30 02:24:00.871694 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3555/7444] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:24:01.160228 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6d94e839-b5ee-402d-828b-7111c4753c4c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:24:01.160868 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6d94e839-b5ee-402d-828b-7111c4753c4c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:24:01.168221 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d94e839-b5ee-402d-828b-7111c4753c4c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:24:01.168723 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d94e839-b5ee-402d-828b-7111c4753c4c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:24:01.169181 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d94e839-b5ee-402d-828b-7111c4753c4c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:24:01.169922 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d94e839-b5ee-402d-828b-7111c4753c4c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:24:01.170394 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d94e839-b5ee-402d-828b-7111c4753c4c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:24:01.170842 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d94e839-b5ee-402d-828b-7111c4753c4c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:24:01.299142 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6d94e839-b5ee-402d-828b-7111c4753c4c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:24:01.308032 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6d94e839-b5ee-402d-828b-7111c4753c4c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1364 microversion: 2.1 time: 0.151715 Oct 30 02:24:01.308608 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3890/7445] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:24:01 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:24:02.328857 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:24:02.330543 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=6 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:24:02.334681 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3b10d09c-9fba-4e2f-93d4-474acb2560be tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:24:02.335386 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3b10d09c-9fba-4e2f-93d4-474acb2560be tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:24:02.341534 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b10d09c-9fba-4e2f-93d4-474acb2560be tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:24:02.347915 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b10d09c-9fba-4e2f-93d4-474acb2560be tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:24:02.347915 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b10d09c-9fba-4e2f-93d4-474acb2560be tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:24:02.347915 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b10d09c-9fba-4e2f-93d4-474acb2560be tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:24:02.347915 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b10d09c-9fba-4e2f-93d4-474acb2560be tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:24:02.347915 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b10d09c-9fba-4e2f-93d4-474acb2560be tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:24:02.478468 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3b10d09c-9fba-4e2f-93d4-474acb2560be tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:24:02.486516 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3b10d09c-9fba-4e2f-93d4-474acb2560be tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1552 microversion: 2.1 time: 0.158637 Oct 30 02:24:02.490676 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3556/7446] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:24:02 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1552 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:24:02.510053 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ce2fa50f-4844-4db5-b8c5-8cba2306c5ed tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:24:02.510634 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ce2fa50f-4844-4db5-b8c5-8cba2306c5ed tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:24:02.512563 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:24:02.518473 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce2fa50f-4844-4db5-b8c5-8cba2306c5ed tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:24:02.518972 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce2fa50f-4844-4db5-b8c5-8cba2306c5ed tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:24:02.519420 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce2fa50f-4844-4db5-b8c5-8cba2306c5ed tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:24:02.520164 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce2fa50f-4844-4db5-b8c5-8cba2306c5ed tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:24:02.520628 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce2fa50f-4844-4db5-b8c5-8cba2306c5ed tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:24:02.521067 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce2fa50f-4844-4db5-b8c5-8cba2306c5ed tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:24:02.598803 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ce2fa50f-4844-4db5-b8c5-8cba2306c5ed tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092704 Oct 30 02:24:02.599407 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3891/7447] 10.222.0.13 () {58 vars in 1275 bytes} [Sun Oct 30 02:24:02 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:24:03.868974 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-c0e32b49-065b-46bf-85bc-c552e9219c7d req-9f39f13a-60c3-4c2d-b0e6-99375e6dc0e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46108ce5-da96-4eed-969e-74f68c100472", "tag": "96f1c448-2187-4949-be70-6fd5aa27af4a"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:24:03.879640 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-c0e32b49-065b-46bf-85bc-c552e9219c7d req-9f39f13a-60c3-4c2d-b0e6-99375e6dc0e1 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:24:03.880427 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-c0e32b49-065b-46bf-85bc-c552e9219c7d req-9f39f13a-60c3-4c2d-b0e6-99375e6dc0e1 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:24:03.881046 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-c0e32b49-065b-46bf-85bc-c552e9219c7d req-9f39f13a-60c3-4c2d-b0e6-99375e6dc0e1 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:24:03.895145 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-c0e32b49-065b-46bf-85bc-c552e9219c7d req-9f39f13a-60c3-4c2d-b0e6-99375e6dc0e1 service nova] Creating event network-changed:96f1c448-2187-4949-be70-6fd5aa27af4a for instance 46108ce5-da96-4eed-969e-74f68c100472 on n-h1-master-1 Oct 30 02:24:03.900157 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-c0e32b49-065b-46bf-85bc-c552e9219c7d req-9f39f13a-60c3-4c2d-b0e6-99375e6dc0e1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035979 Oct 30 02:24:03.900820 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3557/7448] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:24:39.552908 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:24:39.553720 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:24:39.557677 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f4f245c3-27a3-4cbf-b33b-eeb87dbddd84 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:24:39.558295 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f4f245c3-27a3-4cbf-b33b-eeb87dbddd84 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:24:39.564684 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f4f245c3-27a3-4cbf-b33b-eeb87dbddd84 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:24:39.565176 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f4f245c3-27a3-4cbf-b33b-eeb87dbddd84 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:24:39.565780 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f4f245c3-27a3-4cbf-b33b-eeb87dbddd84 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:24:39.566481 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f4f245c3-27a3-4cbf-b33b-eeb87dbddd84 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:24:39.566966 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f4f245c3-27a3-4cbf-b33b-eeb87dbddd84 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:24:39.567421 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f4f245c3-27a3-4cbf-b33b-eeb87dbddd84 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:24:39.699465 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f4f245c3-27a3-4cbf-b33b-eeb87dbddd84 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:24:39.707988 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f4f245c3-27a3-4cbf-b33b-eeb87dbddd84 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1671 microversion: 2.1 time: 0.157387 Oct 30 02:24:39.708621 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3892/7449] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:24:39 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1671 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:24:39.731596 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e8fb65e4-751b-467b-ab95-5c7bb93953b8 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "861c193e-d96e-48dd-9e20-417820b8dd41"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:24:39.736826 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e8fb65e4-751b-467b-ab95-5c7bb93953b8 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:24:39.736826 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:24:39.737055 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=77 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:24:39.741946 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e8fb65e4-751b-467b-ab95-5c7bb93953b8 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:24:39.742426 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e8fb65e4-751b-467b-ab95-5c7bb93953b8 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:24:39.742857 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e8fb65e4-751b-467b-ab95-5c7bb93953b8 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:24:39.743540 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e8fb65e4-751b-467b-ab95-5c7bb93953b8 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:24:39.743991 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e8fb65e4-751b-467b-ab95-5c7bb93953b8 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:24:39.744408 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e8fb65e4-751b-467b-ab95-5c7bb93953b8 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:24:40.468977 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e8fb65e4-751b-467b-ab95-5c7bb93953b8 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "POST /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.741652 Oct 30 02:24:40.469669 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3558/7450] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 30 02:24:39 2022] POST /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472/os-volume_attachments => generated 194 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:24:52.403974 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-84cc8967-9d93-46c2-b0cf-1d3dbeb5a734 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:24:52.406271 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-84cc8967-9d93-46c2-b0cf-1d3dbeb5a734 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:24:52.408257 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:24:52.413349 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-84cc8967-9d93-46c2-b0cf-1d3dbeb5a734 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:24:52.413839 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-84cc8967-9d93-46c2-b0cf-1d3dbeb5a734 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:24:52.414291 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-84cc8967-9d93-46c2-b0cf-1d3dbeb5a734 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:24:52.414998 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-84cc8967-9d93-46c2-b0cf-1d3dbeb5a734 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:24:52.415470 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-84cc8967-9d93-46c2-b0cf-1d3dbeb5a734 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:24:52.415916 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-84cc8967-9d93-46c2-b0cf-1d3dbeb5a734 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:24:52.445148 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-84cc8967-9d93-46c2-b0cf-1d3dbeb5a734 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:24:52.451187 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-84cc8967-9d93-46c2-b0cf-1d3dbeb5a734 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Old instance type m1.heat2, new instance type m1.heat {{(pid=121102) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 30 02:24:52.458099 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-84cc8967-9d93-46c2-b0cf-1d3dbeb5a734 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 02:24:52.458536 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-84cc8967-9d93-46c2-b0cf-1d3dbeb5a734 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 02:24:52.459022 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-84cc8967-9d93-46c2-b0cf-1d3dbeb5a734 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 02:24:52.459443 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-84cc8967-9d93-46c2-b0cf-1d3dbeb5a734 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 02:24:52.459865 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-84cc8967-9d93-46c2-b0cf-1d3dbeb5a734 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 02:24:52.691233 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-84cc8967-9d93-46c2-b0cf-1d3dbeb5a734 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "POST /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472/action" status: 202 len: 0 microversion: 2.1 time: 0.291847 Oct 30 02:24:52.691864 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3893/7451] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 02:24:52 2022] POST /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 02:24:52.698367 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:24:52.699140 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:24:52.703225 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3d2a1a63-0b68-48bb-a4f8-821155f85ea9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:24:52.704366 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3d2a1a63-0b68-48bb-a4f8-821155f85ea9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:24:52.710174 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3d2a1a63-0b68-48bb-a4f8-821155f85ea9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:24:52.710663 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3d2a1a63-0b68-48bb-a4f8-821155f85ea9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:24:52.711102 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3d2a1a63-0b68-48bb-a4f8-821155f85ea9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:24:52.711801 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3d2a1a63-0b68-48bb-a4f8-821155f85ea9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:24:52.712256 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3d2a1a63-0b68-48bb-a4f8-821155f85ea9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:24:52.712682 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3d2a1a63-0b68-48bb-a4f8-821155f85ea9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:24:52.843258 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3d2a1a63-0b68-48bb-a4f8-821155f85ea9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:24:52.859910 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3d2a1a63-0b68-48bb-a4f8-821155f85ea9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1726 microversion: 2.1 time: 0.155064 Oct 30 02:24:52.859910 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3559/7452] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:24:52 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:24:53.877469 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ab5aae0f-297d-40d3-b35e-003ffbc188af tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:24:53.877469 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ab5aae0f-297d-40d3-b35e-003ffbc188af tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:24:53.883914 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ab5aae0f-297d-40d3-b35e-003ffbc188af tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:24:53.884411 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ab5aae0f-297d-40d3-b35e-003ffbc188af tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:24:53.884858 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ab5aae0f-297d-40d3-b35e-003ffbc188af tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:24:53.885595 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ab5aae0f-297d-40d3-b35e-003ffbc188af tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:24:53.886059 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ab5aae0f-297d-40d3-b35e-003ffbc188af tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:24:53.886492 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ab5aae0f-297d-40d3-b35e-003ffbc188af tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:24:54.022637 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ab5aae0f-297d-40d3-b35e-003ffbc188af tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:24:54.031558 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ab5aae0f-297d-40d3-b35e-003ffbc188af tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1726 microversion: 2.1 time: 0.160551 Oct 30 02:24:54.032169 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3894/7453] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:24:53 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:24:55.055391 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e4c0c875-1e8a-442f-9c03-a91f07179902 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:24:55.056030 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e4c0c875-1e8a-442f-9c03-a91f07179902 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:24:55.064944 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e4c0c875-1e8a-442f-9c03-a91f07179902 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:24:55.065455 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e4c0c875-1e8a-442f-9c03-a91f07179902 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:24:55.065888 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e4c0c875-1e8a-442f-9c03-a91f07179902 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:24:55.066594 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e4c0c875-1e8a-442f-9c03-a91f07179902 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:24:55.067044 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e4c0c875-1e8a-442f-9c03-a91f07179902 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:24:55.067515 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e4c0c875-1e8a-442f-9c03-a91f07179902 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:24:55.200985 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e4c0c875-1e8a-442f-9c03-a91f07179902 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:24:55.209570 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e4c0c875-1e8a-442f-9c03-a91f07179902 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1726 microversion: 2.1 time: 0.158870 Oct 30 02:24:55.210258 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3560/7454] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:24:55 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:24:56.233595 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-35a1fe27-767f-43a0-80d3-ff05d6eb9cc1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:24:56.234224 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-35a1fe27-767f-43a0-80d3-ff05d6eb9cc1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:24:56.241111 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-35a1fe27-767f-43a0-80d3-ff05d6eb9cc1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:24:56.241646 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-35a1fe27-767f-43a0-80d3-ff05d6eb9cc1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:24:56.242100 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-35a1fe27-767f-43a0-80d3-ff05d6eb9cc1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:24:56.242799 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-35a1fe27-767f-43a0-80d3-ff05d6eb9cc1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:24:56.243262 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-35a1fe27-767f-43a0-80d3-ff05d6eb9cc1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:24:56.243695 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-35a1fe27-767f-43a0-80d3-ff05d6eb9cc1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:24:56.374961 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-35a1fe27-767f-43a0-80d3-ff05d6eb9cc1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:24:56.383327 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-35a1fe27-767f-43a0-80d3-ff05d6eb9cc1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1731 microversion: 2.1 time: 0.153739 Oct 30 02:24:56.383913 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3895/7455] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:24:56 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:24:57.406303 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c0383c4e-6e51-475d-804d-b161bb443477 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:24:57.406923 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c0383c4e-6e51-475d-804d-b161bb443477 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:24:57.413882 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0383c4e-6e51-475d-804d-b161bb443477 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:24:57.414365 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0383c4e-6e51-475d-804d-b161bb443477 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:24:57.414800 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0383c4e-6e51-475d-804d-b161bb443477 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:24:57.415492 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0383c4e-6e51-475d-804d-b161bb443477 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:24:57.415949 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0383c4e-6e51-475d-804d-b161bb443477 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:24:57.416370 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0383c4e-6e51-475d-804d-b161bb443477 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:24:57.549596 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c0383c4e-6e51-475d-804d-b161bb443477 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:24:57.558361 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c0383c4e-6e51-475d-804d-b161bb443477 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1731 microversion: 2.1 time: 0.155921 Oct 30 02:24:57.558940 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3561/7456] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:24:57 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:24:58.582182 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-08bbbfdd-80c8-4a55-843a-633a76624f22 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:24:58.582707 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-08bbbfdd-80c8-4a55-843a-633a76624f22 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:24:58.589722 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08bbbfdd-80c8-4a55-843a-633a76624f22 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:24:58.590217 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08bbbfdd-80c8-4a55-843a-633a76624f22 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:24:58.591340 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08bbbfdd-80c8-4a55-843a-633a76624f22 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:24:58.592042 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08bbbfdd-80c8-4a55-843a-633a76624f22 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:24:58.592509 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08bbbfdd-80c8-4a55-843a-633a76624f22 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:24:58.592975 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08bbbfdd-80c8-4a55-843a-633a76624f22 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:24:58.718824 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-08bbbfdd-80c8-4a55-843a-633a76624f22 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:24:58.727084 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-08bbbfdd-80c8-4a55-843a-633a76624f22 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1731 microversion: 2.1 time: 0.148967 Oct 30 02:24:58.727658 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3896/7457] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:24:58 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:24:59.750523 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-592c2c31-ee50-4c70-bc67-b0bc3e95a813 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:24:59.751151 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-592c2c31-ee50-4c70-bc67-b0bc3e95a813 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:24:59.759181 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-592c2c31-ee50-4c70-bc67-b0bc3e95a813 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:24:59.759670 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-592c2c31-ee50-4c70-bc67-b0bc3e95a813 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:24:59.760125 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-592c2c31-ee50-4c70-bc67-b0bc3e95a813 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:24:59.760813 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-592c2c31-ee50-4c70-bc67-b0bc3e95a813 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:24:59.761267 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-592c2c31-ee50-4c70-bc67-b0bc3e95a813 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:24:59.761726 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-592c2c31-ee50-4c70-bc67-b0bc3e95a813 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:24:59.890966 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-592c2c31-ee50-4c70-bc67-b0bc3e95a813 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:24:59.899326 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-592c2c31-ee50-4c70-bc67-b0bc3e95a813 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1731 microversion: 2.1 time: 0.152930 Oct 30 02:24:59.899896 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3562/7458] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:24:59 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:25:00.922020 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-aa740ce5-d3d8-4198-994b-5dcc323cea27 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:25:00.922703 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-aa740ce5-d3d8-4198-994b-5dcc323cea27 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:25:00.929828 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aa740ce5-d3d8-4198-994b-5dcc323cea27 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:00.930328 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aa740ce5-d3d8-4198-994b-5dcc323cea27 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:00.930779 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aa740ce5-d3d8-4198-994b-5dcc323cea27 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:00.931489 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aa740ce5-d3d8-4198-994b-5dcc323cea27 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:00.931958 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aa740ce5-d3d8-4198-994b-5dcc323cea27 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:00.932432 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aa740ce5-d3d8-4198-994b-5dcc323cea27 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:01.065754 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-aa740ce5-d3d8-4198-994b-5dcc323cea27 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:25:01.073560 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-aa740ce5-d3d8-4198-994b-5dcc323cea27 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1731 microversion: 2.1 time: 0.155480 Oct 30 02:25:01.074174 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3897/7459] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:25:00 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:25:02.151964 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e710bd44-390d-41c3-9390-b04ee732b6db tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:25:02.152537 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e710bd44-390d-41c3-9390-b04ee732b6db tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:25:02.160355 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e710bd44-390d-41c3-9390-b04ee732b6db tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:02.160834 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e710bd44-390d-41c3-9390-b04ee732b6db tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:02.161264 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e710bd44-390d-41c3-9390-b04ee732b6db tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:02.161987 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e710bd44-390d-41c3-9390-b04ee732b6db tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:02.162437 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e710bd44-390d-41c3-9390-b04ee732b6db tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:02.162863 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e710bd44-390d-41c3-9390-b04ee732b6db tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:02.290435 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e710bd44-390d-41c3-9390-b04ee732b6db tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:25:02.299388 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e710bd44-390d-41c3-9390-b04ee732b6db tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1731 microversion: 2.1 time: 0.151501 Oct 30 02:25:02.299972 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3563/7460] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:25:02 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:25:03.322402 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-982a5015-dbd2-4f30-ab8a-ac8dc405b36a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:25:03.323030 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-982a5015-dbd2-4f30-ab8a-ac8dc405b36a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:25:03.330046 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-982a5015-dbd2-4f30-ab8a-ac8dc405b36a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:03.330545 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-982a5015-dbd2-4f30-ab8a-ac8dc405b36a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:03.330997 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-982a5015-dbd2-4f30-ab8a-ac8dc405b36a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:03.331700 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-982a5015-dbd2-4f30-ab8a-ac8dc405b36a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:03.332165 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-982a5015-dbd2-4f30-ab8a-ac8dc405b36a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:03.332662 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-982a5015-dbd2-4f30-ab8a-ac8dc405b36a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:03.460979 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-982a5015-dbd2-4f30-ab8a-ac8dc405b36a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:25:03.469848 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-982a5015-dbd2-4f30-ab8a-ac8dc405b36a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1731 microversion: 2.1 time: 0.151287 Oct 30 02:25:03.470440 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3898/7461] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:25:03 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:25:04.493617 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b20a1cf7-8684-4d3d-8ad2-3e84bed194c9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:25:04.494241 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b20a1cf7-8684-4d3d-8ad2-3e84bed194c9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:25:04.501142 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b20a1cf7-8684-4d3d-8ad2-3e84bed194c9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:04.501671 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b20a1cf7-8684-4d3d-8ad2-3e84bed194c9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:04.502112 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b20a1cf7-8684-4d3d-8ad2-3e84bed194c9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:04.502806 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b20a1cf7-8684-4d3d-8ad2-3e84bed194c9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:04.503263 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b20a1cf7-8684-4d3d-8ad2-3e84bed194c9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:04.503693 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b20a1cf7-8684-4d3d-8ad2-3e84bed194c9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:04.639756 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b20a1cf7-8684-4d3d-8ad2-3e84bed194c9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:25:04.648094 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b20a1cf7-8684-4d3d-8ad2-3e84bed194c9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1731 microversion: 2.1 time: 0.158440 Oct 30 02:25:04.648674 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3564/7462] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:25:04 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:25:05.672671 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3b6df978-7c84-4227-972d-8fe41c299133 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:25:05.673304 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3b6df978-7c84-4227-972d-8fe41c299133 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:25:05.681301 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3b6df978-7c84-4227-972d-8fe41c299133 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:05.681829 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3b6df978-7c84-4227-972d-8fe41c299133 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:05.682309 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3b6df978-7c84-4227-972d-8fe41c299133 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:05.683026 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3b6df978-7c84-4227-972d-8fe41c299133 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:05.683492 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3b6df978-7c84-4227-972d-8fe41c299133 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:05.683931 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3b6df978-7c84-4227-972d-8fe41c299133 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:05.825726 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3b6df978-7c84-4227-972d-8fe41c299133 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:25:05.834477 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3b6df978-7c84-4227-972d-8fe41c299133 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1731 microversion: 2.1 time: 0.166336 Oct 30 02:25:05.835054 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3899/7463] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:25:05 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:25:06.858637 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-15bb4cb7-5822-4015-8551-190aed0e9cca tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:25:06.859233 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-15bb4cb7-5822-4015-8551-190aed0e9cca tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:25:06.866103 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-15bb4cb7-5822-4015-8551-190aed0e9cca tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:06.866581 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-15bb4cb7-5822-4015-8551-190aed0e9cca tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:06.867011 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-15bb4cb7-5822-4015-8551-190aed0e9cca tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:06.867695 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-15bb4cb7-5822-4015-8551-190aed0e9cca tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:06.868145 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-15bb4cb7-5822-4015-8551-190aed0e9cca tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:06.868565 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-15bb4cb7-5822-4015-8551-190aed0e9cca tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:06.995409 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-15bb4cb7-5822-4015-8551-190aed0e9cca tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:25:07.004438 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-15bb4cb7-5822-4015-8551-190aed0e9cca tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1731 microversion: 2.1 time: 0.150167 Oct 30 02:25:07.005015 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3565/7464] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:25:06 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:25:08.027753 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6bbc2adb-68d1-473d-bf75-9429f8782f88 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:25:08.028389 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6bbc2adb-68d1-473d-bf75-9429f8782f88 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:25:08.035663 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6bbc2adb-68d1-473d-bf75-9429f8782f88 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:08.039517 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6bbc2adb-68d1-473d-bf75-9429f8782f88 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:08.039517 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6bbc2adb-68d1-473d-bf75-9429f8782f88 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:08.039517 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6bbc2adb-68d1-473d-bf75-9429f8782f88 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:08.039517 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6bbc2adb-68d1-473d-bf75-9429f8782f88 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:08.039517 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6bbc2adb-68d1-473d-bf75-9429f8782f88 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:08.170866 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6bbc2adb-68d1-473d-bf75-9429f8782f88 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:25:08.179564 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6bbc2adb-68d1-473d-bf75-9429f8782f88 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1731 microversion: 2.1 time: 0.155987 Oct 30 02:25:08.180148 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3900/7465] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:25:08 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:25:09.204238 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-df603105-1941-456a-80b4-d67e7e865ab9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:25:09.204857 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-df603105-1941-456a-80b4-d67e7e865ab9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:25:09.214437 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df603105-1941-456a-80b4-d67e7e865ab9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:09.214934 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df603105-1941-456a-80b4-d67e7e865ab9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:09.215374 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df603105-1941-456a-80b4-d67e7e865ab9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:09.217403 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df603105-1941-456a-80b4-d67e7e865ab9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:09.217875 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df603105-1941-456a-80b4-d67e7e865ab9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:09.218314 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df603105-1941-456a-80b4-d67e7e865ab9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:09.367293 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-df603105-1941-456a-80b4-d67e7e865ab9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:25:09.376723 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-df603105-1941-456a-80b4-d67e7e865ab9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1731 microversion: 2.1 time: 0.177011 Oct 30 02:25:09.377321 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3566/7466] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:25:09 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:25:10.400957 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d5eb6bf2-ccb9-4caa-821f-876545693cfb tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:25:10.401649 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d5eb6bf2-ccb9-4caa-821f-876545693cfb tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:25:10.408971 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5eb6bf2-ccb9-4caa-821f-876545693cfb tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:10.409510 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5eb6bf2-ccb9-4caa-821f-876545693cfb tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:10.409959 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5eb6bf2-ccb9-4caa-821f-876545693cfb tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:10.410699 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5eb6bf2-ccb9-4caa-821f-876545693cfb tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:10.411162 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5eb6bf2-ccb9-4caa-821f-876545693cfb tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:10.411598 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5eb6bf2-ccb9-4caa-821f-876545693cfb tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:10.547779 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d5eb6bf2-ccb9-4caa-821f-876545693cfb tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:25:10.556465 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d5eb6bf2-ccb9-4caa-821f-876545693cfb tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1730 microversion: 2.1 time: 0.159546 Oct 30 02:25:10.557051 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3901/7467] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:25:10 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:25:10.675428 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-b18d6cb4-af64-4129-b02e-4bd166c22d81 req-498d23e2-92d8-4473-8e23-07874bc12222 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46108ce5-da96-4eed-969e-74f68c100472", "name": "network-vif-unplugged", "status": "completed", "tag": "96f1c448-2187-4949-be70-6fd5aa27af4a"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:25:10.686106 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-b18d6cb4-af64-4129-b02e-4bd166c22d81 req-498d23e2-92d8-4473-8e23-07874bc12222 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:10.686533 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-b18d6cb4-af64-4129-b02e-4bd166c22d81 req-498d23e2-92d8-4473-8e23-07874bc12222 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:10.686972 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-b18d6cb4-af64-4129-b02e-4bd166c22d81 req-498d23e2-92d8-4473-8e23-07874bc12222 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:10.698616 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-b18d6cb4-af64-4129-b02e-4bd166c22d81 req-498d23e2-92d8-4473-8e23-07874bc12222 service nova] Creating event network-vif-unplugged:96f1c448-2187-4949-be70-6fd5aa27af4a for instance 46108ce5-da96-4eed-969e-74f68c100472 on n-h2-master-1 Oct 30 02:25:10.704603 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [req-b18d6cb4-af64-4129-b02e-4bd166c22d81 req-498d23e2-92d8-4473-8e23-07874bc12222 service nova] Instance 46108ce5-da96-4eed-969e-74f68c100472 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=121103) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 30 02:25:10.715547 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-b18d6cb4-af64-4129-b02e-4bd166c22d81 req-498d23e2-92d8-4473-8e23-07874bc12222 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044259 Oct 30 02:25:10.716796 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3567/7468] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:25:11.579534 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b54084ea-a92f-4433-ab3c-c35a8ab8e4b3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:25:11.580194 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b54084ea-a92f-4433-ab3c-c35a8ab8e4b3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:25:11.586388 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b54084ea-a92f-4433-ab3c-c35a8ab8e4b3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:11.586885 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b54084ea-a92f-4433-ab3c-c35a8ab8e4b3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:11.587333 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b54084ea-a92f-4433-ab3c-c35a8ab8e4b3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:11.588038 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b54084ea-a92f-4433-ab3c-c35a8ab8e4b3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:11.588504 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b54084ea-a92f-4433-ab3c-c35a8ab8e4b3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:11.588939 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b54084ea-a92f-4433-ab3c-c35a8ab8e4b3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:11.719967 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b54084ea-a92f-4433-ab3c-c35a8ab8e4b3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:25:11.728597 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b54084ea-a92f-4433-ab3c-c35a8ab8e4b3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1730 microversion: 2.1 time: 0.153083 Oct 30 02:25:11.729281 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3902/7469] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:25:11 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:25:12.732118 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-ffa2be4f-c63f-4463-90c9-63d532bc345f req-f46d44de-577f-4c6b-9214-021a259f2ff1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46108ce5-da96-4eed-969e-74f68c100472", "tag": "96f1c448-2187-4949-be70-6fd5aa27af4a"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:25:12.742310 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ffa2be4f-c63f-4463-90c9-63d532bc345f req-f46d44de-577f-4c6b-9214-021a259f2ff1 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:12.742892 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ffa2be4f-c63f-4463-90c9-63d532bc345f req-f46d44de-577f-4c6b-9214-021a259f2ff1 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:12.743343 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ffa2be4f-c63f-4463-90c9-63d532bc345f req-f46d44de-577f-4c6b-9214-021a259f2ff1 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:12.753945 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7d65337d-33d6-42f1-8f74-6640b4d57cb6 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:25:12.754585 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7d65337d-33d6-42f1-8f74-6640b4d57cb6 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:25:12.756165 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-ffa2be4f-c63f-4463-90c9-63d532bc345f req-f46d44de-577f-4c6b-9214-021a259f2ff1 service nova] Creating event network-changed:96f1c448-2187-4949-be70-6fd5aa27af4a for instance 46108ce5-da96-4eed-969e-74f68c100472 on n-h2-master-1 Oct 30 02:25:12.761534 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7d65337d-33d6-42f1-8f74-6640b4d57cb6 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:12.761895 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [req-ffa2be4f-c63f-4463-90c9-63d532bc345f req-f46d44de-577f-4c6b-9214-021a259f2ff1 service nova] Instance 46108ce5-da96-4eed-969e-74f68c100472 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=121103) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 30 02:25:12.762065 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7d65337d-33d6-42f1-8f74-6640b4d57cb6 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:12.762473 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7d65337d-33d6-42f1-8f74-6640b4d57cb6 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:12.763902 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7d65337d-33d6-42f1-8f74-6640b4d57cb6 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:12.764375 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7d65337d-33d6-42f1-8f74-6640b4d57cb6 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:12.764830 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7d65337d-33d6-42f1-8f74-6640b4d57cb6 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:12.773797 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-ffa2be4f-c63f-4463-90c9-63d532bc345f req-f46d44de-577f-4c6b-9214-021a259f2ff1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046643 Oct 30 02:25:12.774618 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3568/7470] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:25:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:25:13.017703 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7d65337d-33d6-42f1-8f74-6640b4d57cb6 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:25:13.027232 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7d65337d-33d6-42f1-8f74-6640b4d57cb6 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1728 microversion: 2.1 time: 0.277519 Oct 30 02:25:13.028214 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3903/7471] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:25:12 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1728 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:25:14.051899 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a0441e60-b39e-4dd7-9113-76c094977747 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:25:14.052667 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a0441e60-b39e-4dd7-9113-76c094977747 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:25:14.058940 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a0441e60-b39e-4dd7-9113-76c094977747 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:14.059426 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a0441e60-b39e-4dd7-9113-76c094977747 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:14.060347 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a0441e60-b39e-4dd7-9113-76c094977747 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:14.061042 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a0441e60-b39e-4dd7-9113-76c094977747 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:14.061520 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a0441e60-b39e-4dd7-9113-76c094977747 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:14.061942 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a0441e60-b39e-4dd7-9113-76c094977747 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:14.195768 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a0441e60-b39e-4dd7-9113-76c094977747 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:25:14.204748 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a0441e60-b39e-4dd7-9113-76c094977747 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1728 microversion: 2.1 time: 0.158144 Oct 30 02:25:14.205328 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3569/7472] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:25:14 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:25:15.228239 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-385a290e-e723-490a-8b09-0596871c1439 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:25:15.228877 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-385a290e-e723-490a-8b09-0596871c1439 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:25:15.235999 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-385a290e-e723-490a-8b09-0596871c1439 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:15.236500 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-385a290e-e723-490a-8b09-0596871c1439 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:15.236947 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-385a290e-e723-490a-8b09-0596871c1439 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:15.237860 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-385a290e-e723-490a-8b09-0596871c1439 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:15.238337 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-385a290e-e723-490a-8b09-0596871c1439 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:15.238780 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-385a290e-e723-490a-8b09-0596871c1439 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:15.374678 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-385a290e-e723-490a-8b09-0596871c1439 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:25:15.383454 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-385a290e-e723-490a-8b09-0596871c1439 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1728 microversion: 2.1 time: 0.159149 Oct 30 02:25:15.384112 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3904/7473] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:25:15 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:25:16.408473 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8ecc509e-960c-4206-9d5d-9206c0b3234c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:25:16.409090 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8ecc509e-960c-4206-9d5d-9206c0b3234c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:25:16.416143 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ecc509e-960c-4206-9d5d-9206c0b3234c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:16.416646 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ecc509e-960c-4206-9d5d-9206c0b3234c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:16.417066 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ecc509e-960c-4206-9d5d-9206c0b3234c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:16.417798 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ecc509e-960c-4206-9d5d-9206c0b3234c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:16.418254 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ecc509e-960c-4206-9d5d-9206c0b3234c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:16.418677 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ecc509e-960c-4206-9d5d-9206c0b3234c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:16.549293 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8ecc509e-960c-4206-9d5d-9206c0b3234c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:25:16.558032 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8ecc509e-960c-4206-9d5d-9206c0b3234c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1728 microversion: 2.1 time: 0.153453 Oct 30 02:25:16.558605 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3570/7474] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:25:16 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:25:17.581752 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b5ed07a1-382c-42cb-90f0-ca181c989ac0 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:25:17.582436 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b5ed07a1-382c-42cb-90f0-ca181c989ac0 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:25:17.589388 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b5ed07a1-382c-42cb-90f0-ca181c989ac0 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:17.589886 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b5ed07a1-382c-42cb-90f0-ca181c989ac0 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:17.590330 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b5ed07a1-382c-42cb-90f0-ca181c989ac0 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:17.591583 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b5ed07a1-382c-42cb-90f0-ca181c989ac0 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:17.592045 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b5ed07a1-382c-42cb-90f0-ca181c989ac0 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:17.592481 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b5ed07a1-382c-42cb-90f0-ca181c989ac0 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:17.720381 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b5ed07a1-382c-42cb-90f0-ca181c989ac0 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:25:17.728678 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b5ed07a1-382c-42cb-90f0-ca181c989ac0 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1728 microversion: 2.1 time: 0.150937 Oct 30 02:25:17.729242 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3905/7475] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:25:17 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:25:18.752118 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-03565a71-3055-4170-a4ec-f3c57e1f664f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:25:18.752795 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-03565a71-3055-4170-a4ec-f3c57e1f664f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:25:18.759195 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-03565a71-3055-4170-a4ec-f3c57e1f664f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:18.759682 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-03565a71-3055-4170-a4ec-f3c57e1f664f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:18.760117 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-03565a71-3055-4170-a4ec-f3c57e1f664f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:18.760801 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-03565a71-3055-4170-a4ec-f3c57e1f664f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:18.761250 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-03565a71-3055-4170-a4ec-f3c57e1f664f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:18.761696 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-03565a71-3055-4170-a4ec-f3c57e1f664f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:18.896798 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-03565a71-3055-4170-a4ec-f3c57e1f664f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:25:18.905545 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-03565a71-3055-4170-a4ec-f3c57e1f664f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1728 microversion: 2.1 time: 0.157690 Oct 30 02:25:18.906139 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3571/7476] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:25:18 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:25:19.928878 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-edde3a2c-3700-4365-aa98-abd7bd6048ce tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:25:19.929535 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-edde3a2c-3700-4365-aa98-abd7bd6048ce tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:25:19.936396 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-edde3a2c-3700-4365-aa98-abd7bd6048ce tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:19.936891 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-edde3a2c-3700-4365-aa98-abd7bd6048ce tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:19.937355 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-edde3a2c-3700-4365-aa98-abd7bd6048ce tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:19.938060 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-edde3a2c-3700-4365-aa98-abd7bd6048ce tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:19.938522 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-edde3a2c-3700-4365-aa98-abd7bd6048ce tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:19.938956 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-edde3a2c-3700-4365-aa98-abd7bd6048ce tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:20.072350 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-edde3a2c-3700-4365-aa98-abd7bd6048ce tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:25:20.080746 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-edde3a2c-3700-4365-aa98-abd7bd6048ce tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1728 microversion: 2.1 time: 0.156091 Oct 30 02:25:20.081352 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3906/7477] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:25:19 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:25:21.104853 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-55c1a7a7-d4bc-40dd-96b7-2dca524191ab tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:25:21.105520 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-55c1a7a7-d4bc-40dd-96b7-2dca524191ab tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:25:21.113093 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-55c1a7a7-d4bc-40dd-96b7-2dca524191ab tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:21.113614 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-55c1a7a7-d4bc-40dd-96b7-2dca524191ab tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:21.114053 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-55c1a7a7-d4bc-40dd-96b7-2dca524191ab tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:21.114744 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-55c1a7a7-d4bc-40dd-96b7-2dca524191ab tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:21.115197 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-55c1a7a7-d4bc-40dd-96b7-2dca524191ab tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:21.115666 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-55c1a7a7-d4bc-40dd-96b7-2dca524191ab tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:21.245223 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-55c1a7a7-d4bc-40dd-96b7-2dca524191ab tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:25:21.254178 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-55c1a7a7-d4bc-40dd-96b7-2dca524191ab tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1728 microversion: 2.1 time: 0.153446 Oct 30 02:25:21.254758 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3572/7478] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:25:21 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:25:22.277121 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-12da388b-d465-4138-a2c3-869899efa793 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:25:22.277797 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-12da388b-d465-4138-a2c3-869899efa793 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:25:22.284725 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-12da388b-d465-4138-a2c3-869899efa793 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:22.285229 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-12da388b-d465-4138-a2c3-869899efa793 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:22.285720 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-12da388b-d465-4138-a2c3-869899efa793 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:22.286428 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-12da388b-d465-4138-a2c3-869899efa793 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:22.286899 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-12da388b-d465-4138-a2c3-869899efa793 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:22.287340 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-12da388b-d465-4138-a2c3-869899efa793 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:22.291383 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:25:22.415979 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-12da388b-d465-4138-a2c3-869899efa793 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:25:22.424206 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-12da388b-d465-4138-a2c3-869899efa793 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1728 microversion: 2.1 time: 0.151025 Oct 30 02:25:22.425036 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3907/7479] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:25:22 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:25:23.448015 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-078f98a8-e0d2-40ab-8c60-4f75110ddc87 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:25:23.448622 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-078f98a8-e0d2-40ab-8c60-4f75110ddc87 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:25:23.451462 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=29 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:25:23.456214 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-078f98a8-e0d2-40ab-8c60-4f75110ddc87 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:23.456698 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-078f98a8-e0d2-40ab-8c60-4f75110ddc87 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:23.457137 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-078f98a8-e0d2-40ab-8c60-4f75110ddc87 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:23.457861 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-078f98a8-e0d2-40ab-8c60-4f75110ddc87 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:23.458315 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-078f98a8-e0d2-40ab-8c60-4f75110ddc87 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:23.464829 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-078f98a8-e0d2-40ab-8c60-4f75110ddc87 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:23.591205 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-078f98a8-e0d2-40ab-8c60-4f75110ddc87 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:25:23.599582 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-078f98a8-e0d2-40ab-8c60-4f75110ddc87 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1728 microversion: 2.1 time: 0.155486 Oct 30 02:25:23.600152 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3573/7480] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:25:23 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:25:24.624024 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d8c03fff-389a-40e1-98eb-bc3be57b5245 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:25:24.624554 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d8c03fff-389a-40e1-98eb-bc3be57b5245 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:25:24.627288 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=35 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:25:24.636471 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8c03fff-389a-40e1-98eb-bc3be57b5245 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:24.640011 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8c03fff-389a-40e1-98eb-bc3be57b5245 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:24.640011 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8c03fff-389a-40e1-98eb-bc3be57b5245 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:24.640011 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8c03fff-389a-40e1-98eb-bc3be57b5245 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:24.640011 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8c03fff-389a-40e1-98eb-bc3be57b5245 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:24.640620 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8c03fff-389a-40e1-98eb-bc3be57b5245 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:24.778523 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d8c03fff-389a-40e1-98eb-bc3be57b5245 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:25:24.787151 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d8c03fff-389a-40e1-98eb-bc3be57b5245 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1728 microversion: 2.1 time: 0.167624 Oct 30 02:25:24.787764 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3908/7481] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:25:24 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:25:25.811269 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fceb6014-0029-4c00-b4f2-edc181db9b92 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:25:25.811915 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-fceb6014-0029-4c00-b4f2-edc181db9b92 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:25:25.818672 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fceb6014-0029-4c00-b4f2-edc181db9b92 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:25.819155 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fceb6014-0029-4c00-b4f2-edc181db9b92 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:25.819588 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fceb6014-0029-4c00-b4f2-edc181db9b92 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:25.820282 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fceb6014-0029-4c00-b4f2-edc181db9b92 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:25.820733 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fceb6014-0029-4c00-b4f2-edc181db9b92 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:25.821155 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fceb6014-0029-4c00-b4f2-edc181db9b92 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:25.823689 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=87 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:25:25.951062 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-fceb6014-0029-4c00-b4f2-edc181db9b92 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:25:25.959429 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fceb6014-0029-4c00-b4f2-edc181db9b92 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1725 microversion: 2.1 time: 0.152735 Oct 30 02:25:25.960008 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3574/7482] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:25:25 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:25:25.983878 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1c897614-c65d-4831-a5fb-54c928f7b393 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:25:25.984432 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1c897614-c65d-4831-a5fb-54c928f7b393 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:25:25.991361 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1c897614-c65d-4831-a5fb-54c928f7b393 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:25.991859 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1c897614-c65d-4831-a5fb-54c928f7b393 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:25.992310 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1c897614-c65d-4831-a5fb-54c928f7b393 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:25.993014 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1c897614-c65d-4831-a5fb-54c928f7b393 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:25.993515 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1c897614-c65d-4831-a5fb-54c928f7b393 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:25.993957 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1c897614-c65d-4831-a5fb-54c928f7b393 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:26.030740 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1c897614-c65d-4831-a5fb-54c928f7b393 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:26.031229 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1c897614-c65d-4831-a5fb-54c928f7b393 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:26.031677 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1c897614-c65d-4831-a5fb-54c928f7b393 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:26.032406 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1c897614-c65d-4831-a5fb-54c928f7b393 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:26.032869 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1c897614-c65d-4831-a5fb-54c928f7b393 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:26.033309 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1c897614-c65d-4831-a5fb-54c928f7b393 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:26.054134 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-1c897614-c65d-4831-a5fb-54c928f7b393 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Getting quotas for project ec54882ff5fa47fe9303222e3f936de9. Resources: {'ram', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 02:25:26.059316 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-1c897614-c65d-4831-a5fb-54c928f7b393 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Getting quotas for user bd6a4d32970a4d72be7109ceaf173241 and project ec54882ff5fa47fe9303222e3f936de9. Resources: {'ram', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 02:25:26.470780 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1c897614-c65d-4831-a5fb-54c928f7b393 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "POST /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472/action" status: 202 len: 0 microversion: 2.1 time: 0.491195 Oct 30 02:25:26.471403 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3909/7483] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 02:25:25 2022] POST /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472/action => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 02:25:26.480659 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-102bf02d-d4d0-4b81-9316-fa7337d316c4 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:25:26.481277 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-102bf02d-d4d0-4b81-9316-fa7337d316c4 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:25:26.487229 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-102bf02d-d4d0-4b81-9316-fa7337d316c4 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:26.487718 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-102bf02d-d4d0-4b81-9316-fa7337d316c4 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:26.488162 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-102bf02d-d4d0-4b81-9316-fa7337d316c4 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:26.488853 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-102bf02d-d4d0-4b81-9316-fa7337d316c4 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:26.489308 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-102bf02d-d4d0-4b81-9316-fa7337d316c4 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:26.489757 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-102bf02d-d4d0-4b81-9316-fa7337d316c4 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:26.680293 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-102bf02d-d4d0-4b81-9316-fa7337d316c4 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:25:26.689230 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-102bf02d-d4d0-4b81-9316-fa7337d316c4 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1724 microversion: 2.1 time: 0.213566 Oct 30 02:25:26.689990 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3575/7484] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:25:26 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1724 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:25:27.714869 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-400fce0f-0400-41af-aa5c-0f71c90f138b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:25:27.716073 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-400fce0f-0400-41af-aa5c-0f71c90f138b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:25:27.722258 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-400fce0f-0400-41af-aa5c-0f71c90f138b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:27.722753 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-400fce0f-0400-41af-aa5c-0f71c90f138b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:27.723203 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-400fce0f-0400-41af-aa5c-0f71c90f138b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:27.723912 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-400fce0f-0400-41af-aa5c-0f71c90f138b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:27.724380 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-400fce0f-0400-41af-aa5c-0f71c90f138b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:27.724821 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-400fce0f-0400-41af-aa5c-0f71c90f138b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:27.853438 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-400fce0f-0400-41af-aa5c-0f71c90f138b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:25:27.861735 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-400fce0f-0400-41af-aa5c-0f71c90f138b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1724 microversion: 2.1 time: 0.152155 Oct 30 02:25:27.862316 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3910/7485] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:25:27 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:25:28.875218 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-f0ddcd1f-b514-4b9a-8293-c0998e7d26d2 req-25c52ced-37f7-4bf3-8451-77a861366e65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46108ce5-da96-4eed-969e-74f68c100472", "name": "network-vif-plugged", "status": "completed", "tag": "96f1c448-2187-4949-be70-6fd5aa27af4a"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:25:28.884653 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-606e4b60-009f-4a0c-bd06-c646b7e30277 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:25:28.885513 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-606e4b60-009f-4a0c-bd06-c646b7e30277 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:25:28.886385 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-f0ddcd1f-b514-4b9a-8293-c0998e7d26d2 req-25c52ced-37f7-4bf3-8451-77a861366e65 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:28.886870 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-f0ddcd1f-b514-4b9a-8293-c0998e7d26d2 req-25c52ced-37f7-4bf3-8451-77a861366e65 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:28.887300 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-f0ddcd1f-b514-4b9a-8293-c0998e7d26d2 req-25c52ced-37f7-4bf3-8451-77a861366e65 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:28.892744 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-606e4b60-009f-4a0c-bd06-c646b7e30277 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:28.893240 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-606e4b60-009f-4a0c-bd06-c646b7e30277 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:28.893723 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-606e4b60-009f-4a0c-bd06-c646b7e30277 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:28.894437 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-606e4b60-009f-4a0c-bd06-c646b7e30277 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:28.894911 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-606e4b60-009f-4a0c-bd06-c646b7e30277 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:28.898832 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-606e4b60-009f-4a0c-bd06-c646b7e30277 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:28.899755 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-f0ddcd1f-b514-4b9a-8293-c0998e7d26d2 req-25c52ced-37f7-4bf3-8451-77a861366e65 service nova] Creating event network-vif-plugged:96f1c448-2187-4949-be70-6fd5aa27af4a for instance 46108ce5-da96-4eed-969e-74f68c100472 on n-h2-master-1 Oct 30 02:25:28.905974 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [req-f0ddcd1f-b514-4b9a-8293-c0998e7d26d2 req-25c52ced-37f7-4bf3-8451-77a861366e65 service nova] Instance 46108ce5-da96-4eed-969e-74f68c100472 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=121103) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 30 02:25:28.917277 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-f0ddcd1f-b514-4b9a-8293-c0998e7d26d2 req-25c52ced-37f7-4bf3-8451-77a861366e65 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046290 Oct 30 02:25:28.918078 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3576/7486] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:25:29.045776 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-606e4b60-009f-4a0c-bd06-c646b7e30277 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:25:29.047539 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-606e4b60-009f-4a0c-bd06-c646b7e30277 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1724 microversion: 2.1 time: 0.167402 Oct 30 02:25:29.048132 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3911/7487] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:25:28 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:25:30.072940 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c675798c-f7ea-4837-97ca-3dd98f38b3c1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:25:30.073714 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c675798c-f7ea-4837-97ca-3dd98f38b3c1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:25:30.080467 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c675798c-f7ea-4837-97ca-3dd98f38b3c1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:30.080962 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c675798c-f7ea-4837-97ca-3dd98f38b3c1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:30.081419 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c675798c-f7ea-4837-97ca-3dd98f38b3c1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:30.082133 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c675798c-f7ea-4837-97ca-3dd98f38b3c1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:30.082590 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c675798c-f7ea-4837-97ca-3dd98f38b3c1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:30.083014 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c675798c-f7ea-4837-97ca-3dd98f38b3c1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:30.217376 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c675798c-f7ea-4837-97ca-3dd98f38b3c1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:25:30.225703 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c675798c-f7ea-4837-97ca-3dd98f38b3c1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1724 microversion: 2.1 time: 0.158004 Oct 30 02:25:30.226283 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3577/7488] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:25:30 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:25:31.249912 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-41b2de24-5ea3-4b62-b6b0-b657e426888e tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:25:31.251037 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-41b2de24-5ea3-4b62-b6b0-b657e426888e tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:25:31.257624 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-41b2de24-5ea3-4b62-b6b0-b657e426888e tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:31.258130 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-41b2de24-5ea3-4b62-b6b0-b657e426888e tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:31.258589 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-41b2de24-5ea3-4b62-b6b0-b657e426888e tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:31.259307 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-41b2de24-5ea3-4b62-b6b0-b657e426888e tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:31.259781 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-41b2de24-5ea3-4b62-b6b0-b657e426888e tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:31.260221 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-41b2de24-5ea3-4b62-b6b0-b657e426888e tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:31.394083 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-41b2de24-5ea3-4b62-b6b0-b657e426888e tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:25:31.402275 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-41b2de24-5ea3-4b62-b6b0-b657e426888e tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1724 microversion: 2.1 time: 0.157018 Oct 30 02:25:31.402843 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3912/7489] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:25:31 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:25:32.424720 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0d58a5d7-cce3-4b9a-9e69-e037287d74b0 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:25:32.425348 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0d58a5d7-cce3-4b9a-9e69-e037287d74b0 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:25:32.432245 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d58a5d7-cce3-4b9a-9e69-e037287d74b0 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:32.432727 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d58a5d7-cce3-4b9a-9e69-e037287d74b0 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:32.433157 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d58a5d7-cce3-4b9a-9e69-e037287d74b0 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:32.433985 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d58a5d7-cce3-4b9a-9e69-e037287d74b0 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:32.434469 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d58a5d7-cce3-4b9a-9e69-e037287d74b0 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:32.437938 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d58a5d7-cce3-4b9a-9e69-e037287d74b0 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:32.575812 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0d58a5d7-cce3-4b9a-9e69-e037287d74b0 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:25:32.584603 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0d58a5d7-cce3-4b9a-9e69-e037287d74b0 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1724 microversion: 2.1 time: 0.164177 Oct 30 02:25:32.585209 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3578/7490] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:25:32 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:25:32.779205 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-74fbab4b-160f-480b-b73e-cfba00dc8278 req-c1b89958-7204-42e5-99f9-0c7c08116c3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46108ce5-da96-4eed-969e-74f68c100472", "name": "network-vif-unplugged", "status": "completed", "tag": "96f1c448-2187-4949-be70-6fd5aa27af4a"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:25:32.789597 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-74fbab4b-160f-480b-b73e-cfba00dc8278 req-c1b89958-7204-42e5-99f9-0c7c08116c3a service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:32.790089 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-74fbab4b-160f-480b-b73e-cfba00dc8278 req-c1b89958-7204-42e5-99f9-0c7c08116c3a service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:32.790525 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-74fbab4b-160f-480b-b73e-cfba00dc8278 req-c1b89958-7204-42e5-99f9-0c7c08116c3a service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:32.802344 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-74fbab4b-160f-480b-b73e-cfba00dc8278 req-c1b89958-7204-42e5-99f9-0c7c08116c3a service nova] Creating event network-vif-unplugged:96f1c448-2187-4949-be70-6fd5aa27af4a for instance 46108ce5-da96-4eed-969e-74f68c100472 on n-h1-master-1 Oct 30 02:25:32.807789 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [req-74fbab4b-160f-480b-b73e-cfba00dc8278 req-c1b89958-7204-42e5-99f9-0c7c08116c3a service nova] Instance 46108ce5-da96-4eed-969e-74f68c100472 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=121102) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 30 02:25:32.819712 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-74fbab4b-160f-480b-b73e-cfba00dc8278 req-c1b89958-7204-42e5-99f9-0c7c08116c3a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044473 Oct 30 02:25:32.820438 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3913/7491] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:25:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:25:33.608771 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-39b9b670-1b0e-4f26-973b-95112c18cec9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:25:33.609458 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-39b9b670-1b0e-4f26-973b-95112c18cec9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:25:33.615992 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-39b9b670-1b0e-4f26-973b-95112c18cec9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:33.616478 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-39b9b670-1b0e-4f26-973b-95112c18cec9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:33.616918 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-39b9b670-1b0e-4f26-973b-95112c18cec9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:33.617714 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-39b9b670-1b0e-4f26-973b-95112c18cec9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:33.618171 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-39b9b670-1b0e-4f26-973b-95112c18cec9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:33.618595 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-39b9b670-1b0e-4f26-973b-95112c18cec9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:33.748974 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-39b9b670-1b0e-4f26-973b-95112c18cec9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:25:33.757364 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-39b9b670-1b0e-4f26-973b-95112c18cec9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1724 microversion: 2.1 time: 0.153241 Oct 30 02:25:33.757961 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3579/7492] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:25:33 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:25:34.781672 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-45c86e95-9771-4a2f-b69a-6e820d73e06d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:25:34.782265 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-45c86e95-9771-4a2f-b69a-6e820d73e06d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:25:34.788479 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-45c86e95-9771-4a2f-b69a-6e820d73e06d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:34.788971 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-45c86e95-9771-4a2f-b69a-6e820d73e06d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:34.789459 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-45c86e95-9771-4a2f-b69a-6e820d73e06d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:34.790152 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-45c86e95-9771-4a2f-b69a-6e820d73e06d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:34.790646 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-45c86e95-9771-4a2f-b69a-6e820d73e06d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:34.791081 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-45c86e95-9771-4a2f-b69a-6e820d73e06d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:34.835005 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-90a4e312-40a3-419f-8bca-c1a5a8508578 req-bccfed88-c6c6-4a4b-a375-3ab11b4d0c6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46108ce5-da96-4eed-969e-74f68c100472", "tag": "96f1c448-2187-4949-be70-6fd5aa27af4a"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:25:34.845640 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-90a4e312-40a3-419f-8bca-c1a5a8508578 req-bccfed88-c6c6-4a4b-a375-3ab11b4d0c6f service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:34.846230 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-90a4e312-40a3-419f-8bca-c1a5a8508578 req-bccfed88-c6c6-4a4b-a375-3ab11b4d0c6f service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:34.846732 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-90a4e312-40a3-419f-8bca-c1a5a8508578 req-bccfed88-c6c6-4a4b-a375-3ab11b4d0c6f service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:34.859770 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-90a4e312-40a3-419f-8bca-c1a5a8508578 req-bccfed88-c6c6-4a4b-a375-3ab11b4d0c6f service nova] Creating event network-changed:96f1c448-2187-4949-be70-6fd5aa27af4a for instance 46108ce5-da96-4eed-969e-74f68c100472 on n-h1-master-1 Oct 30 02:25:34.865406 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [req-90a4e312-40a3-419f-8bca-c1a5a8508578 req-bccfed88-c6c6-4a4b-a375-3ab11b4d0c6f service nova] Instance 46108ce5-da96-4eed-969e-74f68c100472 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=121103) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 30 02:25:34.883594 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-90a4e312-40a3-419f-8bca-c1a5a8508578 req-bccfed88-c6c6-4a4b-a375-3ab11b4d0c6f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051682 Oct 30 02:25:34.884293 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3580/7493] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:25:34.942301 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-45c86e95-9771-4a2f-b69a-6e820d73e06d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:25:34.954079 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-45c86e95-9771-4a2f-b69a-6e820d73e06d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1724 microversion: 2.1 time: 0.177582 Oct 30 02:25:34.970505 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3914/7494] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:25:34 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1724 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:25:35.981124 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d70a2e1e-8610-4183-be21-2e031037e16c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:25:35.981853 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d70a2e1e-8610-4183-be21-2e031037e16c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:25:35.987945 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d70a2e1e-8610-4183-be21-2e031037e16c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:35.988427 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d70a2e1e-8610-4183-be21-2e031037e16c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:35.988862 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d70a2e1e-8610-4183-be21-2e031037e16c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:35.989573 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d70a2e1e-8610-4183-be21-2e031037e16c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:35.990026 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d70a2e1e-8610-4183-be21-2e031037e16c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:35.990446 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d70a2e1e-8610-4183-be21-2e031037e16c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:36.124642 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d70a2e1e-8610-4183-be21-2e031037e16c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:25:36.133137 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d70a2e1e-8610-4183-be21-2e031037e16c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1724 microversion: 2.1 time: 0.157121 Oct 30 02:25:36.133745 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3581/7495] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:25:35 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:25:37.156813 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c69e0b83-7284-4c32-bba8-dc451537819a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:25:37.157486 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c69e0b83-7284-4c32-bba8-dc451537819a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:25:37.159981 n-d-master-1 devstack@n-api.service[121102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 30 02:25:37.160137 n-d-master-1 devstack@n-api.service[121102]: Sun Oct 30 02:25:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 (ip 10.222.0.13) !!! Oct 30 02:25:37.162345 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:25:37.169995 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c69e0b83-7284-4c32-bba8-dc451537819a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:37.170503 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c69e0b83-7284-4c32-bba8-dc451537819a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:37.170961 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c69e0b83-7284-4c32-bba8-dc451537819a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:37.171684 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c69e0b83-7284-4c32-bba8-dc451537819a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:37.172158 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c69e0b83-7284-4c32-bba8-dc451537819a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:37.172603 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c69e0b83-7284-4c32-bba8-dc451537819a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:37.317107 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c69e0b83-7284-4c32-bba8-dc451537819a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:25:37.326035 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c69e0b83-7284-4c32-bba8-dc451537819a tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1724 microversion: 2.1 time: 0.173744 Oct 30 02:25:37.326614 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3915/7496] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:25:37 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:25:38.351034 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c490fd7e-b0ed-42a6-85d7-f377138929bc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:25:38.351680 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c490fd7e-b0ed-42a6-85d7-f377138929bc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:25:38.359554 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c490fd7e-b0ed-42a6-85d7-f377138929bc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:38.360107 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c490fd7e-b0ed-42a6-85d7-f377138929bc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:38.360549 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c490fd7e-b0ed-42a6-85d7-f377138929bc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:38.361249 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c490fd7e-b0ed-42a6-85d7-f377138929bc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:38.361746 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c490fd7e-b0ed-42a6-85d7-f377138929bc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:38.362174 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c490fd7e-b0ed-42a6-85d7-f377138929bc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:38.498410 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c490fd7e-b0ed-42a6-85d7-f377138929bc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:25:38.506926 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c490fd7e-b0ed-42a6-85d7-f377138929bc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1724 microversion: 2.1 time: 0.160117 Oct 30 02:25:38.507652 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3582/7497] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:25:38 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:25:39.530280 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c5cd117d-0382-4c12-9539-8adae6c127b9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:25:39.530923 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c5cd117d-0382-4c12-9539-8adae6c127b9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:25:39.537880 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c5cd117d-0382-4c12-9539-8adae6c127b9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:39.538386 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c5cd117d-0382-4c12-9539-8adae6c127b9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:39.538844 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c5cd117d-0382-4c12-9539-8adae6c127b9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:39.539568 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c5cd117d-0382-4c12-9539-8adae6c127b9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:39.540046 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c5cd117d-0382-4c12-9539-8adae6c127b9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:39.540483 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c5cd117d-0382-4c12-9539-8adae6c127b9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:39.673200 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c5cd117d-0382-4c12-9539-8adae6c127b9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:25:39.681796 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c5cd117d-0382-4c12-9539-8adae6c127b9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1724 microversion: 2.1 time: 0.155492 Oct 30 02:25:39.682402 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3916/7498] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:25:39 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:25:40.706125 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f6a797ca-c184-4354-a8c2-96cd00b574f1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:25:40.707018 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f6a797ca-c184-4354-a8c2-96cd00b574f1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:25:40.714274 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f6a797ca-c184-4354-a8c2-96cd00b574f1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:40.714754 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f6a797ca-c184-4354-a8c2-96cd00b574f1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:40.715776 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f6a797ca-c184-4354-a8c2-96cd00b574f1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:40.716459 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f6a797ca-c184-4354-a8c2-96cd00b574f1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:40.716912 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f6a797ca-c184-4354-a8c2-96cd00b574f1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:40.717351 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f6a797ca-c184-4354-a8c2-96cd00b574f1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:40.846241 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f6a797ca-c184-4354-a8c2-96cd00b574f1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:25:40.854428 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f6a797ca-c184-4354-a8c2-96cd00b574f1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1724 microversion: 2.1 time: 0.152211 Oct 30 02:25:40.855002 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3583/7499] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:25:40 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:25:41.877661 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e9cac7bf-d1ac-40b2-8d57-bb12161d757d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:25:41.878293 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e9cac7bf-d1ac-40b2-8d57-bb12161d757d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:25:41.884668 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9cac7bf-d1ac-40b2-8d57-bb12161d757d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:41.885167 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9cac7bf-d1ac-40b2-8d57-bb12161d757d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:41.885647 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9cac7bf-d1ac-40b2-8d57-bb12161d757d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:41.886357 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9cac7bf-d1ac-40b2-8d57-bb12161d757d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:41.886824 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9cac7bf-d1ac-40b2-8d57-bb12161d757d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:41.887297 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9cac7bf-d1ac-40b2-8d57-bb12161d757d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:42.018765 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e9cac7bf-d1ac-40b2-8d57-bb12161d757d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:25:42.027075 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e9cac7bf-d1ac-40b2-8d57-bb12161d757d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1724 microversion: 2.1 time: 0.153684 Oct 30 02:25:42.028172 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3917/7500] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:25:41 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:25:43.050905 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-904302f8-a1a0-491d-b49e-3b997ddb4185 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:25:43.051530 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-904302f8-a1a0-491d-b49e-3b997ddb4185 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:25:43.058319 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-904302f8-a1a0-491d-b49e-3b997ddb4185 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:43.059401 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-904302f8-a1a0-491d-b49e-3b997ddb4185 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:43.059842 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-904302f8-a1a0-491d-b49e-3b997ddb4185 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:43.060588 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-904302f8-a1a0-491d-b49e-3b997ddb4185 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:43.061043 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-904302f8-a1a0-491d-b49e-3b997ddb4185 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:43.061502 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-904302f8-a1a0-491d-b49e-3b997ddb4185 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:43.194585 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-904302f8-a1a0-491d-b49e-3b997ddb4185 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:25:43.202899 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-904302f8-a1a0-491d-b49e-3b997ddb4185 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1724 microversion: 2.1 time: 0.156195 Oct 30 02:25:43.203479 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3584/7501] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:25:43 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:25:44.227071 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5b7425e8-e777-4447-b0d1-832593ac0880 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:25:44.227692 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5b7425e8-e777-4447-b0d1-832593ac0880 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:25:44.234504 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5b7425e8-e777-4447-b0d1-832593ac0880 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:44.234992 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5b7425e8-e777-4447-b0d1-832593ac0880 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:44.235433 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5b7425e8-e777-4447-b0d1-832593ac0880 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:44.236125 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5b7425e8-e777-4447-b0d1-832593ac0880 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:44.236578 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5b7425e8-e777-4447-b0d1-832593ac0880 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:44.237013 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5b7425e8-e777-4447-b0d1-832593ac0880 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:44.369762 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5b7425e8-e777-4447-b0d1-832593ac0880 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:25:44.378766 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5b7425e8-e777-4447-b0d1-832593ac0880 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1724 microversion: 2.1 time: 0.155635 Oct 30 02:25:44.379352 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3918/7502] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:25:44 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:25:45.402251 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-22d39343-27d4-4d5c-a5c4-d6f959fe4988 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:25:45.403365 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-22d39343-27d4-4d5c-a5c4-d6f959fe4988 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:25:45.410472 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22d39343-27d4-4d5c-a5c4-d6f959fe4988 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:45.410953 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22d39343-27d4-4d5c-a5c4-d6f959fe4988 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:45.411384 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22d39343-27d4-4d5c-a5c4-d6f959fe4988 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:45.412064 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22d39343-27d4-4d5c-a5c4-d6f959fe4988 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:45.412512 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22d39343-27d4-4d5c-a5c4-d6f959fe4988 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:45.412931 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22d39343-27d4-4d5c-a5c4-d6f959fe4988 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:45.545500 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-22d39343-27d4-4d5c-a5c4-d6f959fe4988 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:25:45.554034 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-22d39343-27d4-4d5c-a5c4-d6f959fe4988 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1724 microversion: 2.1 time: 0.155722 Oct 30 02:25:45.554629 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3585/7503] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:25:45 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:25:46.577951 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2a48dfbd-2a92-4a8b-ae05-bea2e9caaeb1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:25:46.582054 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2a48dfbd-2a92-4a8b-ae05-bea2e9caaeb1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:25:46.585550 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a48dfbd-2a92-4a8b-ae05-bea2e9caaeb1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:46.586108 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a48dfbd-2a92-4a8b-ae05-bea2e9caaeb1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:46.586510 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a48dfbd-2a92-4a8b-ae05-bea2e9caaeb1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:46.587223 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a48dfbd-2a92-4a8b-ae05-bea2e9caaeb1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:46.587698 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a48dfbd-2a92-4a8b-ae05-bea2e9caaeb1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:46.588141 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a48dfbd-2a92-4a8b-ae05-bea2e9caaeb1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:46.721440 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2a48dfbd-2a92-4a8b-ae05-bea2e9caaeb1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:25:46.729888 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2a48dfbd-2a92-4a8b-ae05-bea2e9caaeb1 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1724 microversion: 2.1 time: 0.156462 Oct 30 02:25:46.731767 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3919/7504] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:25:46 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:25:47.754808 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d945f9f8-ce51-4bd8-a874-284296c69df9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:25:47.755355 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d945f9f8-ce51-4bd8-a874-284296c69df9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:25:47.761737 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d945f9f8-ce51-4bd8-a874-284296c69df9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:47.764906 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d945f9f8-ce51-4bd8-a874-284296c69df9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:47.764906 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d945f9f8-ce51-4bd8-a874-284296c69df9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:47.764906 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d945f9f8-ce51-4bd8-a874-284296c69df9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:47.764906 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d945f9f8-ce51-4bd8-a874-284296c69df9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:47.764906 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d945f9f8-ce51-4bd8-a874-284296c69df9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:47.892443 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d945f9f8-ce51-4bd8-a874-284296c69df9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:25:47.900914 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d945f9f8-ce51-4bd8-a874-284296c69df9 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1717 microversion: 2.1 time: 0.150305 Oct 30 02:25:47.901519 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3586/7505] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:25:47 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1717 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:25:47.924766 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4d2235d3-866d-4ad6-be14-2dc73a05b08f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:25:47.925461 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4d2235d3-866d-4ad6-be14-2dc73a05b08f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:25:47.932412 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d2235d3-866d-4ad6-be14-2dc73a05b08f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:47.932922 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d2235d3-866d-4ad6-be14-2dc73a05b08f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:47.933401 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d2235d3-866d-4ad6-be14-2dc73a05b08f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:47.934192 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d2235d3-866d-4ad6-be14-2dc73a05b08f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:47.934667 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d2235d3-866d-4ad6-be14-2dc73a05b08f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:47.935114 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d2235d3-866d-4ad6-be14-2dc73a05b08f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:48.062212 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4d2235d3-866d-4ad6-be14-2dc73a05b08f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:25:48.070811 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4d2235d3-866d-4ad6-be14-2dc73a05b08f tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1717 microversion: 2.1 time: 0.150271 Oct 30 02:25:48.071398 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3920/7506] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:25:47 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1717 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:25:48.094144 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0f4ac7b3-75f1-4aac-afa2-7f35274911fb tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:25:48.094764 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0f4ac7b3-75f1-4aac-afa2-7f35274911fb tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:25:48.100725 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0f4ac7b3-75f1-4aac-afa2-7f35274911fb tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:48.101210 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0f4ac7b3-75f1-4aac-afa2-7f35274911fb tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:48.101678 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0f4ac7b3-75f1-4aac-afa2-7f35274911fb tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:48.102371 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0f4ac7b3-75f1-4aac-afa2-7f35274911fb tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:48.102829 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0f4ac7b3-75f1-4aac-afa2-7f35274911fb tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:48.103256 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0f4ac7b3-75f1-4aac-afa2-7f35274911fb tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:48.235061 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0f4ac7b3-75f1-4aac-afa2-7f35274911fb tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:25:48.243180 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0f4ac7b3-75f1-4aac-afa2-7f35274911fb tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1717 microversion: 2.1 time: 0.153554 Oct 30 02:25:48.243748 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3587/7507] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:25:48 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1717 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:25:48.265690 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ded49aa1-fdf5-4ccc-82cc-3e7aa6f58525 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:25:48.266144 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ded49aa1-fdf5-4ccc-82cc-3e7aa6f58525 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:25:48.272339 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ded49aa1-fdf5-4ccc-82cc-3e7aa6f58525 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:48.272845 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ded49aa1-fdf5-4ccc-82cc-3e7aa6f58525 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:48.273302 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ded49aa1-fdf5-4ccc-82cc-3e7aa6f58525 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:48.274046 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ded49aa1-fdf5-4ccc-82cc-3e7aa6f58525 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:48.274628 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ded49aa1-fdf5-4ccc-82cc-3e7aa6f58525 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:48.275109 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ded49aa1-fdf5-4ccc-82cc-3e7aa6f58525 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:48.279754 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:25:48.301316 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ded49aa1-fdf5-4ccc-82cc-3e7aa6f58525 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 02:25:48.534413 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ded49aa1-fdf5-4ccc-82cc-3e7aa6f58525 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "DELETE /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 204 len: 0 microversion: 2.1 time: 0.273023 Oct 30 02:25:48.534944 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3921/7508] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 02:25:48 2022] DELETE /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 02:25:48.543153 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-94d9a59e-e69b-4931-963c-bb12be93b32d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:25:48.543995 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-94d9a59e-e69b-4931-963c-bb12be93b32d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:25:48.550517 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94d9a59e-e69b-4931-963c-bb12be93b32d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:48.551038 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94d9a59e-e69b-4931-963c-bb12be93b32d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:48.551478 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94d9a59e-e69b-4931-963c-bb12be93b32d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:48.552231 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94d9a59e-e69b-4931-963c-bb12be93b32d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:48.552705 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94d9a59e-e69b-4931-963c-bb12be93b32d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:48.553163 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94d9a59e-e69b-4931-963c-bb12be93b32d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:48.682754 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-94d9a59e-e69b-4931-963c-bb12be93b32d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:25:48.691082 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-94d9a59e-e69b-4931-963c-bb12be93b32d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1723 microversion: 2.1 time: 0.151901 Oct 30 02:25:48.692513 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3588/7509] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:25:48 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:25:49.376459 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-96570078-5b18-42a4-96d2-642c91b1beff req-4ecf6305-d3f9-484a-955b-6b89ca218095 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46108ce5-da96-4eed-969e-74f68c100472", "name": "network-vif-plugged", "status": "completed", "tag": "96f1c448-2187-4949-be70-6fd5aa27af4a"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:25:49.391209 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-96570078-5b18-42a4-96d2-642c91b1beff req-4ecf6305-d3f9-484a-955b-6b89ca218095 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:49.391707 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-96570078-5b18-42a4-96d2-642c91b1beff req-4ecf6305-d3f9-484a-955b-6b89ca218095 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:49.392152 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-96570078-5b18-42a4-96d2-642c91b1beff req-4ecf6305-d3f9-484a-955b-6b89ca218095 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:49.403004 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-96570078-5b18-42a4-96d2-642c91b1beff req-4ecf6305-d3f9-484a-955b-6b89ca218095 service nova] Creating event network-vif-plugged:96f1c448-2187-4949-be70-6fd5aa27af4a for instance 46108ce5-da96-4eed-969e-74f68c100472 on n-h1-master-1 Oct 30 02:25:49.408037 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-96570078-5b18-42a4-96d2-642c91b1beff req-4ecf6305-d3f9-484a-955b-6b89ca218095 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035653 Oct 30 02:25:49.408620 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3922/7510] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:25:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:25:49.714464 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-41643803-d205-4bfd-9fbd-dec80c5bd475 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:25:49.715000 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-41643803-d205-4bfd-9fbd-dec80c5bd475 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:25:49.722313 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-41643803-d205-4bfd-9fbd-dec80c5bd475 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:49.722796 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-41643803-d205-4bfd-9fbd-dec80c5bd475 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:49.723236 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-41643803-d205-4bfd-9fbd-dec80c5bd475 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:49.723925 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-41643803-d205-4bfd-9fbd-dec80c5bd475 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:49.724385 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-41643803-d205-4bfd-9fbd-dec80c5bd475 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:49.724839 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-41643803-d205-4bfd-9fbd-dec80c5bd475 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:49.857113 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-41643803-d205-4bfd-9fbd-dec80c5bd475 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:25:49.865468 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-41643803-d205-4bfd-9fbd-dec80c5bd475 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1723 microversion: 2.1 time: 0.154976 Oct 30 02:25:49.866047 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3589/7511] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:25:49 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:25:50.891318 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ee3c293e-148d-4d09-8ac7-26270a6ab528 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:25:50.892950 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ee3c293e-148d-4d09-8ac7-26270a6ab528 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:25:50.902418 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee3c293e-148d-4d09-8ac7-26270a6ab528 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:50.903023 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee3c293e-148d-4d09-8ac7-26270a6ab528 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:50.903542 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee3c293e-148d-4d09-8ac7-26270a6ab528 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:50.904332 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee3c293e-148d-4d09-8ac7-26270a6ab528 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:50.904869 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee3c293e-148d-4d09-8ac7-26270a6ab528 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:50.905463 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee3c293e-148d-4d09-8ac7-26270a6ab528 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:51.002109 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ee3c293e-148d-4d09-8ac7-26270a6ab528 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:25:51.014917 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ee3c293e-148d-4d09-8ac7-26270a6ab528 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1655 microversion: 2.1 time: 0.129422 Oct 30 02:25:51.015520 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3923/7512] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:25:50 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1655 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:25:51.234998 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-0e2af4d9-c99f-4f91-95bf-298d1ce27523 req-ed1a062a-3a18-4ecc-8d89-ead0a4fef194 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46108ce5-da96-4eed-969e-74f68c100472", "name": "network-vif-deleted", "tag": "96f1c448-2187-4949-be70-6fd5aa27af4a"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:25:51.245900 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-0e2af4d9-c99f-4f91-95bf-298d1ce27523 req-ed1a062a-3a18-4ecc-8d89-ead0a4fef194 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:51.249922 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-0e2af4d9-c99f-4f91-95bf-298d1ce27523 req-ed1a062a-3a18-4ecc-8d89-ead0a4fef194 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:51.249922 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-0e2af4d9-c99f-4f91-95bf-298d1ce27523 req-ed1a062a-3a18-4ecc-8d89-ead0a4fef194 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:51.272632 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-0e2af4d9-c99f-4f91-95bf-298d1ce27523 req-ed1a062a-3a18-4ecc-8d89-ead0a4fef194 service nova] Creating event network-vif-deleted:96f1c448-2187-4949-be70-6fd5aa27af4a for instance 46108ce5-da96-4eed-969e-74f68c100472 on n-h1-master-1 Oct 30 02:25:51.278813 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-0e2af4d9-c99f-4f91-95bf-298d1ce27523 req-ed1a062a-3a18-4ecc-8d89-ead0a4fef194 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048015 Oct 30 02:25:51.279515 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3590/7513] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:25:52.038051 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f72266f4-f7ec-435a-9c24-cc3f0222fbcf tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:25:52.038716 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f72266f4-f7ec-435a-9c24-cc3f0222fbcf tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:25:52.046367 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f72266f4-f7ec-435a-9c24-cc3f0222fbcf tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:52.046880 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f72266f4-f7ec-435a-9c24-cc3f0222fbcf tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:52.047336 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f72266f4-f7ec-435a-9c24-cc3f0222fbcf tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:52.048067 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f72266f4-f7ec-435a-9c24-cc3f0222fbcf tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:52.048544 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f72266f4-f7ec-435a-9c24-cc3f0222fbcf tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:52.049251 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f72266f4-f7ec-435a-9c24-cc3f0222fbcf tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:52.115322 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f72266f4-f7ec-435a-9c24-cc3f0222fbcf tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:25:52.124695 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f72266f4-f7ec-435a-9c24-cc3f0222fbcf tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1369 microversion: 2.1 time: 0.090525 Oct 30 02:25:52.125653 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3924/7514] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:25:52 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:25:53.149846 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6196806c-9b4b-45b7-ba1c-7fad2a636236 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:25:53.150480 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6196806c-9b4b-45b7-ba1c-7fad2a636236 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:25:53.156692 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6196806c-9b4b-45b7-ba1c-7fad2a636236 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:53.157184 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6196806c-9b4b-45b7-ba1c-7fad2a636236 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:53.157658 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6196806c-9b4b-45b7-ba1c-7fad2a636236 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:53.158360 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6196806c-9b4b-45b7-ba1c-7fad2a636236 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:53.158822 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6196806c-9b4b-45b7-ba1c-7fad2a636236 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:53.159253 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6196806c-9b4b-45b7-ba1c-7fad2a636236 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:53.237930 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6196806c-9b4b-45b7-ba1c-7fad2a636236 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:25:53.246929 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6196806c-9b4b-45b7-ba1c-7fad2a636236 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1369 microversion: 2.1 time: 0.101852 Oct 30 02:25:53.247537 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3591/7515] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:25:53 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1369 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:25:54.270412 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-58c8761b-cfa2-415b-b4fd-7d307676e0ef tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:25:54.271059 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-58c8761b-cfa2-415b-b4fd-7d307676e0ef tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:25:54.278343 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-58c8761b-cfa2-415b-b4fd-7d307676e0ef tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:54.279755 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-58c8761b-cfa2-415b-b4fd-7d307676e0ef tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:54.280224 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-58c8761b-cfa2-415b-b4fd-7d307676e0ef tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:54.280948 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-58c8761b-cfa2-415b-b4fd-7d307676e0ef tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:54.281464 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-58c8761b-cfa2-415b-b4fd-7d307676e0ef tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:54.281900 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-58c8761b-cfa2-415b-b4fd-7d307676e0ef tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:54.346758 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-58c8761b-cfa2-415b-b4fd-7d307676e0ef tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:25:54.355321 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-58c8761b-cfa2-415b-b4fd-7d307676e0ef tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1369 microversion: 2.1 time: 0.088963 Oct 30 02:25:54.356744 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3925/7516] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:25:54 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:25:55.379698 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-baed216b-a83a-48f4-82c8-18ed17a15522 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:25:55.380312 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-baed216b-a83a-48f4-82c8-18ed17a15522 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:25:55.383317 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=38 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:25:55.388988 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-baed216b-a83a-48f4-82c8-18ed17a15522 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:55.389527 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-baed216b-a83a-48f4-82c8-18ed17a15522 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:55.391980 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-baed216b-a83a-48f4-82c8-18ed17a15522 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:55.391980 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-baed216b-a83a-48f4-82c8-18ed17a15522 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:55.391980 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-baed216b-a83a-48f4-82c8-18ed17a15522 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:55.391980 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-baed216b-a83a-48f4-82c8-18ed17a15522 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:55.394376 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=100 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:25:55.459643 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-baed216b-a83a-48f4-82c8-18ed17a15522 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6a4d32970a4d72be7109ceaf173241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec54882ff5fa47fe9303222e3f936de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:25:55.467865 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-baed216b-a83a-48f4-82c8-18ed17a15522 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 200 len: 1369 microversion: 2.1 time: 0.092100 Oct 30 02:25:55.468450 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3592/7517] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:25:55 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:25:56.491719 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d88392e4-e1ee-44d6-89ee-bceb2af9fc75 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:25:56.492367 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d88392e4-e1ee-44d6-89ee-bceb2af9fc75 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:25:56.495150 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:25:56.500279 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d88392e4-e1ee-44d6-89ee-bceb2af9fc75 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:56.500783 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d88392e4-e1ee-44d6-89ee-bceb2af9fc75 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:56.501239 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d88392e4-e1ee-44d6-89ee-bceb2af9fc75 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:56.502035 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d88392e4-e1ee-44d6-89ee-bceb2af9fc75 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:56.502492 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d88392e4-e1ee-44d6-89ee-bceb2af9fc75 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:56.502939 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d88392e4-e1ee-44d6-89ee-bceb2af9fc75 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:56.516851 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-d88392e4-e1ee-44d6-89ee-bceb2af9fc75 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] HTTP exception thrown: Instance 46108ce5-da96-4eed-969e-74f68c100472 could not be found. Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d88392e4-e1ee-44d6-89ee-bceb2af9fc75 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Request method failure captured: Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 HTTP/1.1 Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXd8_AaHeYv7mI8KcOiEpHHSLt3xix4i3AijgcSjiVH8gCZDNZTQs2eKPUSYf3-FI8TMZsjcfFPTEgO2BYtL_E0r7tuLX6t2K_PeaBE5t7gXNmnm97kpENPfU_RCfhh6EcQIjwoSMcBV6P-7_37AV6319KodCPKJo_De4zA522gc3ZJc Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: ec54882ff5fa47fe9303222e3f936de9 Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServerActionsTestJSON-1524178034 Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServerActionsTestJSON-1524178034 Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: ec54882ff5fa47fe9303222e3f936de9 Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServerActionsTestJSON-1524178034 Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServerActionsTestJSON-1524178034-project Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: bd6a4d32970a4d72be7109ceaf173241 Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServerActionsTestJSON-1524178034-project Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 46108ce5-da96-4eed-969e-74f68c100472 could not be found. Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '46108ce5-da96-4eed-969e-74f68c100472'} Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46108ce5-da96-4eed-969e-74f68c100472 could not be found. Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46108ce5-da96-4eed-969e-74f68c100472 could not be found. Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:25:56.518576 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:25:56.523859 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:25:56.523859 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:25:56.523859 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:25:56.523859 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:25:56.523859 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:25:56.523859 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46108ce5-da96-4eed-969e-74f68c100472 could not be found. Oct 30 02:25:56.523859 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:25:56.523859 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d88392e4-e1ee-44d6-89ee-bceb2af9fc75 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Returning 404 to user: Instance 46108ce5-da96-4eed-969e-74f68c100472 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:25:56.523859 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d88392e4-e1ee-44d6-89ee-bceb2af9fc75 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 404 len: 111 microversion: 2.1 time: 0.032357 Oct 30 02:25:56.523859 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3926/7518] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:25:56 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 02:25:56.581710 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d606673f-ce7c-42aa-935b-928b37fd343d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:25:56.583909 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d606673f-ce7c-42aa-935b-928b37fd343d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:25:56.591558 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d606673f-ce7c-42aa-935b-928b37fd343d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:56.592052 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d606673f-ce7c-42aa-935b-928b37fd343d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:56.592526 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d606673f-ce7c-42aa-935b-928b37fd343d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:56.593232 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d606673f-ce7c-42aa-935b-928b37fd343d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:25:56.593751 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d606673f-ce7c-42aa-935b-928b37fd343d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:25:56.594181 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d606673f-ce7c-42aa-935b-928b37fd343d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:25:56.606884 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-d606673f-ce7c-42aa-935b-928b37fd343d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] HTTP exception thrown: Instance 46108ce5-da96-4eed-969e-74f68c100472 could not be found. Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d606673f-ce7c-42aa-935b-928b37fd343d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Request method failure captured: Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472/os-volume_attachments HTTP/1.1 Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXd8_AaHeYv7mI8KcOiEpHHSLt3xix4i3AijgcSjiVH8gCZDNZTQs2eKPUSYf3-FI8TMZsjcfFPTEgO2BYtL_E0r7tuLX6t2K_PeaBE5t7gXNmnm97kpENPfU_RCfhh6EcQIjwoSMcBV6P-7_37AV6319KodCPKJo_De4zA522gc3ZJc Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: ec54882ff5fa47fe9303222e3f936de9 Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServerActionsTestJSON-1524178034 Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServerActionsTestJSON-1524178034 Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: ec54882ff5fa47fe9303222e3f936de9 Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServerActionsTestJSON-1524178034 Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServerActionsTestJSON-1524178034-project Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: bd6a4d32970a4d72be7109ceaf173241 Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServerActionsTestJSON-1524178034-project Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 46108ce5-da96-4eed-969e-74f68c100472 could not be found. Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: action_args: {'server_id': '46108ce5-da96-4eed-969e-74f68c100472'} Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46108ce5-da96-4eed-969e-74f68c100472 could not be found. Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 02:25:56.608561 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 02:25:56.613500 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46108ce5-da96-4eed-969e-74f68c100472 could not be found. Oct 30 02:25:56.613500 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:25:56.613500 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:25:56.613500 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:25:56.613500 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:25:56.613500 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:25:56.613500 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:25:56.613500 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:25:56.613500 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:25:56.613500 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46108ce5-da96-4eed-969e-74f68c100472 could not be found. Oct 30 02:25:56.613500 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:25:56.613500 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d606673f-ce7c-42aa-935b-928b37fd343d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Returning 404 to user: Instance 46108ce5-da96-4eed-969e-74f68c100472 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:25:56.613500 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d606673f-ce7c-42aa-935b-928b37fd343d tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032307 Oct 30 02:25:56.613500 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3593/7519] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 02:25:56 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 02:26:00.112165 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-26896d68-f531-4ab8-aa95-eab3f30e5ca3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:26:00.112684 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-26896d68-f531-4ab8-aa95-eab3f30e5ca3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:26:00.120365 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-26896d68-f531-4ab8-aa95-eab3f30e5ca3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:00.120875 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-26896d68-f531-4ab8-aa95-eab3f30e5ca3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:00.126107 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-26896d68-f531-4ab8-aa95-eab3f30e5ca3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:00.126107 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-26896d68-f531-4ab8-aa95-eab3f30e5ca3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:00.126107 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-26896d68-f531-4ab8-aa95-eab3f30e5ca3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:00.126107 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-26896d68-f531-4ab8-aa95-eab3f30e5ca3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:00.137549 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-26896d68-f531-4ab8-aa95-eab3f30e5ca3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] HTTP exception thrown: Instance 46108ce5-da96-4eed-969e-74f68c100472 could not be found. Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-26896d68-f531-4ab8-aa95-eab3f30e5ca3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Request method failure captured: Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 HTTP/1.1 Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXd8_AaHeYv7mI8KcOiEpHHSLt3xix4i3AijgcSjiVH8gCZDNZTQs2eKPUSYf3-FI8TMZsjcfFPTEgO2BYtL_E0r7tuLX6t2K_PeaBE5t7gXNmnm97kpENPfU_RCfhh6EcQIjwoSMcBV6P-7_37AV6319KodCPKJo_De4zA522gc3ZJc Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: ec54882ff5fa47fe9303222e3f936de9 Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServerActionsTestJSON-1524178034 Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServerActionsTestJSON-1524178034 Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: ec54882ff5fa47fe9303222e3f936de9 Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServerActionsTestJSON-1524178034 Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServerActionsTestJSON-1524178034-project Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: bd6a4d32970a4d72be7109ceaf173241 Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServerActionsTestJSON-1524178034-project Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 46108ce5-da96-4eed-969e-74f68c100472 could not be found. Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '46108ce5-da96-4eed-969e-74f68c100472'} Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46108ce5-da96-4eed-969e-74f68c100472 could not be found. Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 02:26:00.139192 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 02:26:00.143196 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46108ce5-da96-4eed-969e-74f68c100472 could not be found. Oct 30 02:26:00.143196 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:26:00.143196 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:26:00.143196 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:26:00.143196 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:26:00.143196 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:26:00.143196 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:26:00.143196 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:26:00.143196 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:26:00.143196 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46108ce5-da96-4eed-969e-74f68c100472 could not be found. Oct 30 02:26:00.143196 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:26:00.143196 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-26896d68-f531-4ab8-aa95-eab3f30e5ca3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Returning 404 to user: Instance 46108ce5-da96-4eed-969e-74f68c100472 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:26:00.143196 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-26896d68-f531-4ab8-aa95-eab3f30e5ca3 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "DELETE /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 404 len: 111 microversion: 2.1 time: 0.032450 Oct 30 02:26:00.143196 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3927/7520] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 02:26:00 2022] DELETE /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 02:26:00.149585 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-efcebad8-6a27-4396-a206-6bc120987d17 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:26:00.150135 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-efcebad8-6a27-4396-a206-6bc120987d17 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 46108ce5-da96-4eed-969e-74f68c100472] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:26:00.157215 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-efcebad8-6a27-4396-a206-6bc120987d17 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:00.157752 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-efcebad8-6a27-4396-a206-6bc120987d17 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:00.158185 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-efcebad8-6a27-4396-a206-6bc120987d17 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:00.158873 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-efcebad8-6a27-4396-a206-6bc120987d17 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:00.159323 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-efcebad8-6a27-4396-a206-6bc120987d17 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:00.159742 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-efcebad8-6a27-4396-a206-6bc120987d17 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:00.174044 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-efcebad8-6a27-4396-a206-6bc120987d17 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] HTTP exception thrown: Instance 46108ce5-da96-4eed-969e-74f68c100472 could not be found. Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-efcebad8-6a27-4396-a206-6bc120987d17 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Request method failure captured: Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 HTTP/1.1 Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXd8_AaHeYv7mI8KcOiEpHHSLt3xix4i3AijgcSjiVH8gCZDNZTQs2eKPUSYf3-FI8TMZsjcfFPTEgO2BYtL_E0r7tuLX6t2K_PeaBE5t7gXNmnm97kpENPfU_RCfhh6EcQIjwoSMcBV6P-7_37AV6319KodCPKJo_De4zA522gc3ZJc Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: ec54882ff5fa47fe9303222e3f936de9 Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServerActionsTestJSON-1524178034 Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServerActionsTestJSON-1524178034 Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: ec54882ff5fa47fe9303222e3f936de9 Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServerActionsTestJSON-1524178034 Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServerActionsTestJSON-1524178034-project Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: bd6a4d32970a4d72be7109ceaf173241 Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServerActionsTestJSON-1524178034-project Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 46108ce5-da96-4eed-969e-74f68c100472 could not be found. Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '46108ce5-da96-4eed-969e-74f68c100472'} Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46108ce5-da96-4eed-969e-74f68c100472 could not be found. Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46108ce5-da96-4eed-969e-74f68c100472 could not be found. Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:26:00.175565 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:26:00.182881 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:26:00.182881 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:26:00.182881 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:26:00.182881 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:26:00.182881 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:26:00.182881 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46108ce5-da96-4eed-969e-74f68c100472 could not be found. Oct 30 02:26:00.182881 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:26:00.182881 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-efcebad8-6a27-4396-a206-6bc120987d17 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Returning 404 to user: Instance 46108ce5-da96-4eed-969e-74f68c100472 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:26:00.182881 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-efcebad8-6a27-4396-a206-6bc120987d17 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472" status: 404 len: 111 microversion: 2.1 time: 0.031434 Oct 30 02:26:00.182881 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3594/7521] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:26:00 2022] GET /compute/v2.1/servers/46108ce5-da96-4eed-969e-74f68c100472 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 02:26:00.186385 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8947f8d5-8edd-4c78-b126-3d1b834eb073 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:26:00.186897 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8947f8d5-8edd-4c78-b126-3d1b834eb073 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:26:00.193132 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8947f8d5-8edd-4c78-b126-3d1b834eb073 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:00.193656 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8947f8d5-8edd-4c78-b126-3d1b834eb073 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:00.194105 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8947f8d5-8edd-4c78-b126-3d1b834eb073 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:00.194804 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8947f8d5-8edd-4c78-b126-3d1b834eb073 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:00.195270 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8947f8d5-8edd-4c78-b126-3d1b834eb073 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:00.195712 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8947f8d5-8edd-4c78-b126-3d1b834eb073 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:00.209205 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-8947f8d5-8edd-4c78-b126-3d1b834eb073 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] HTTP exception thrown: Instance 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db could not be found. Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8947f8d5-8edd-4c78-b126-3d1b834eb073 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Request method failure captured: Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db HTTP/1.1 Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXd8_AaHeYv7mI8KcOiEpHHSLt3xix4i3AijgcSjiVH8gCZDNZTQs2eKPUSYf3-FI8TMZsjcfFPTEgO2BYtL_E0r7tuLX6t2K_PeaBE5t7gXNmnm97kpENPfU_RCfhh6EcQIjwoSMcBV6P-7_37AV6319KodCPKJo_De4zA522gc3ZJc Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: ec54882ff5fa47fe9303222e3f936de9 Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServerActionsTestJSON-1524178034 Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServerActionsTestJSON-1524178034 Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: ec54882ff5fa47fe9303222e3f936de9 Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServerActionsTestJSON-1524178034 Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServerActionsTestJSON-1524178034-project Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: bd6a4d32970a4d72be7109ceaf173241 Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServerActionsTestJSON-1524178034-project Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db could not be found. Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db'} Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db could not be found. Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 02:26:00.210792 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 02:26:00.215140 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db could not be found. Oct 30 02:26:00.215140 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:26:00.215140 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:26:00.215140 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:26:00.215140 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:26:00.215140 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:26:00.215140 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:26:00.215140 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:26:00.215140 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:26:00.215140 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db could not be found. Oct 30 02:26:00.215140 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:26:00.215140 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8947f8d5-8edd-4c78-b126-3d1b834eb073 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Returning 404 to user: Instance 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:26:00.215140 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8947f8d5-8edd-4c78-b126-3d1b834eb073 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db" status: 404 len: 111 microversion: 2.1 time: 0.030730 Oct 30 02:26:00.215140 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3928/7522] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 02:26:00 2022] DELETE /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 02:26:00.220740 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-97f47e3c-4223-41ea-bf90-716bd444d2fc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:26:00.221365 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-97f47e3c-4223-41ea-bf90-716bd444d2fc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:26:00.227328 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-97f47e3c-4223-41ea-bf90-716bd444d2fc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:00.227811 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-97f47e3c-4223-41ea-bf90-716bd444d2fc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:00.228247 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-97f47e3c-4223-41ea-bf90-716bd444d2fc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:00.228935 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-97f47e3c-4223-41ea-bf90-716bd444d2fc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:00.229410 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-97f47e3c-4223-41ea-bf90-716bd444d2fc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:00.229832 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-97f47e3c-4223-41ea-bf90-716bd444d2fc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:00.243976 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-97f47e3c-4223-41ea-bf90-716bd444d2fc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] HTTP exception thrown: Instance 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db could not be found. Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-97f47e3c-4223-41ea-bf90-716bd444d2fc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Request method failure captured: Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db HTTP/1.1 Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXd8_AaHeYv7mI8KcOiEpHHSLt3xix4i3AijgcSjiVH8gCZDNZTQs2eKPUSYf3-FI8TMZsjcfFPTEgO2BYtL_E0r7tuLX6t2K_PeaBE5t7gXNmnm97kpENPfU_RCfhh6EcQIjwoSMcBV6P-7_37AV6319KodCPKJo_De4zA522gc3ZJc Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: ec54882ff5fa47fe9303222e3f936de9 Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServerActionsTestJSON-1524178034 Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServerActionsTestJSON-1524178034 Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: ec54882ff5fa47fe9303222e3f936de9 Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServerActionsTestJSON-1524178034 Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServerActionsTestJSON-1524178034-project Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: bd6a4d32970a4d72be7109ceaf173241 Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServerActionsTestJSON-1524178034-project Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db could not be found. Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db'} Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db could not be found. Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db could not be found. Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:26:00.245556 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:26:00.250597 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:26:00.250597 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:26:00.250597 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:26:00.250597 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:26:00.250597 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:26:00.250597 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db could not be found. Oct 30 02:26:00.250597 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:26:00.250597 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-97f47e3c-4223-41ea-bf90-716bd444d2fc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Returning 404 to user: Instance 2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:26:00.250597 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-97f47e3c-4223-41ea-bf90-716bd444d2fc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db" status: 404 len: 111 microversion: 2.1 time: 0.030535 Oct 30 02:26:00.250597 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3595/7523] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:26:00 2022] GET /compute/v2.1/servers/2a28b1c6-1b9d-4ab4-9316-cbadb22ab6db => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 02:26:00.256436 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ea17e96d-bc40-43e6-9752-7e9079fe452c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:26:00.256960 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ea17e96d-bc40-43e6-9752-7e9079fe452c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 85f98d02-ecf3-44d8-85b1-d0ca91c4064c] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:26:00.263136 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea17e96d-bc40-43e6-9752-7e9079fe452c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:00.263643 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea17e96d-bc40-43e6-9752-7e9079fe452c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:00.264102 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea17e96d-bc40-43e6-9752-7e9079fe452c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:00.264824 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea17e96d-bc40-43e6-9752-7e9079fe452c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:00.265300 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea17e96d-bc40-43e6-9752-7e9079fe452c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:00.265770 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea17e96d-bc40-43e6-9752-7e9079fe452c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:00.279573 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-ea17e96d-bc40-43e6-9752-7e9079fe452c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] HTTP exception thrown: Instance 85f98d02-ecf3-44d8-85b1-d0ca91c4064c could not be found. Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ea17e96d-bc40-43e6-9752-7e9079fe452c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Request method failure captured: Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c HTTP/1.1 Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXd8_AaHeYv7mI8KcOiEpHHSLt3xix4i3AijgcSjiVH8gCZDNZTQs2eKPUSYf3-FI8TMZsjcfFPTEgO2BYtL_E0r7tuLX6t2K_PeaBE5t7gXNmnm97kpENPfU_RCfhh6EcQIjwoSMcBV6P-7_37AV6319KodCPKJo_De4zA522gc3ZJc Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: ec54882ff5fa47fe9303222e3f936de9 Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServerActionsTestJSON-1524178034 Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServerActionsTestJSON-1524178034 Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: ec54882ff5fa47fe9303222e3f936de9 Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServerActionsTestJSON-1524178034 Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServerActionsTestJSON-1524178034-project Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: bd6a4d32970a4d72be7109ceaf173241 Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServerActionsTestJSON-1524178034-project Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 85f98d02-ecf3-44d8-85b1-d0ca91c4064c could not be found. Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '85f98d02-ecf3-44d8-85b1-d0ca91c4064c'} Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85f98d02-ecf3-44d8-85b1-d0ca91c4064c could not be found. Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 02:26:00.281229 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 02:26:00.285742 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85f98d02-ecf3-44d8-85b1-d0ca91c4064c could not be found. Oct 30 02:26:00.285742 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:26:00.285742 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:26:00.285742 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:26:00.285742 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:26:00.285742 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:26:00.285742 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:26:00.285742 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:26:00.285742 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:26:00.285742 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85f98d02-ecf3-44d8-85b1-d0ca91c4064c could not be found. Oct 30 02:26:00.285742 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:26:00.285742 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ea17e96d-bc40-43e6-9752-7e9079fe452c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Returning 404 to user: Instance 85f98d02-ecf3-44d8-85b1-d0ca91c4064c could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:26:00.285742 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ea17e96d-bc40-43e6-9752-7e9079fe452c tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "DELETE /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c" status: 404 len: 111 microversion: 2.1 time: 0.030275 Oct 30 02:26:00.285742 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3929/7524] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 02:26:00 2022] DELETE /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 02:26:00.291018 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e3434de7-2197-42e4-b1fe-f9bc3839e5d7 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:26:00.291645 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e3434de7-2197-42e4-b1fe-f9bc3839e5d7 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: 85f98d02-ecf3-44d8-85b1-d0ca91c4064c] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:26:00.298502 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e3434de7-2197-42e4-b1fe-f9bc3839e5d7 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:00.299228 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e3434de7-2197-42e4-b1fe-f9bc3839e5d7 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:00.299660 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e3434de7-2197-42e4-b1fe-f9bc3839e5d7 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:00.300961 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e3434de7-2197-42e4-b1fe-f9bc3839e5d7 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:00.301459 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e3434de7-2197-42e4-b1fe-f9bc3839e5d7 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:00.301889 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e3434de7-2197-42e4-b1fe-f9bc3839e5d7 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:00.316660 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-e3434de7-2197-42e4-b1fe-f9bc3839e5d7 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] HTTP exception thrown: Instance 85f98d02-ecf3-44d8-85b1-d0ca91c4064c could not be found. Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e3434de7-2197-42e4-b1fe-f9bc3839e5d7 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Request method failure captured: Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c HTTP/1.1 Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXd8_AaHeYv7mI8KcOiEpHHSLt3xix4i3AijgcSjiVH8gCZDNZTQs2eKPUSYf3-FI8TMZsjcfFPTEgO2BYtL_E0r7tuLX6t2K_PeaBE5t7gXNmnm97kpENPfU_RCfhh6EcQIjwoSMcBV6P-7_37AV6319KodCPKJo_De4zA522gc3ZJc Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: ec54882ff5fa47fe9303222e3f936de9 Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServerActionsTestJSON-1524178034 Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServerActionsTestJSON-1524178034 Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: ec54882ff5fa47fe9303222e3f936de9 Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServerActionsTestJSON-1524178034 Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServerActionsTestJSON-1524178034-project Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: bd6a4d32970a4d72be7109ceaf173241 Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServerActionsTestJSON-1524178034-project Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 85f98d02-ecf3-44d8-85b1-d0ca91c4064c could not be found. Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '85f98d02-ecf3-44d8-85b1-d0ca91c4064c'} Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85f98d02-ecf3-44d8-85b1-d0ca91c4064c could not be found. Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85f98d02-ecf3-44d8-85b1-d0ca91c4064c could not be found. Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:26:00.318266 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:26:00.323019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:26:00.323019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:26:00.323019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:26:00.323019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:26:00.323019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:26:00.323019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85f98d02-ecf3-44d8-85b1-d0ca91c4064c could not be found. Oct 30 02:26:00.323019 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:26:00.323019 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e3434de7-2197-42e4-b1fe-f9bc3839e5d7 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Returning 404 to user: Instance 85f98d02-ecf3-44d8-85b1-d0ca91c4064c could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:26:00.323019 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e3434de7-2197-42e4-b1fe-f9bc3839e5d7 tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c" status: 404 len: 111 microversion: 2.1 time: 0.032454 Oct 30 02:26:00.323019 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3596/7525] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:26:00 2022] GET /compute/v2.1/servers/85f98d02-ecf3-44d8-85b1-d0ca91c4064c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 02:26:00.328690 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d3348eea-b3d5-4271-88a3-2036fe6b392b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:26:00.329213 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d3348eea-b3d5-4271-88a3-2036fe6b392b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: aefa3d4a-410a-48ec-8ae1-c66ee39b3aab] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:26:00.335468 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3348eea-b3d5-4271-88a3-2036fe6b392b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:00.335969 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3348eea-b3d5-4271-88a3-2036fe6b392b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:00.336422 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3348eea-b3d5-4271-88a3-2036fe6b392b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:00.337135 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3348eea-b3d5-4271-88a3-2036fe6b392b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:00.337630 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3348eea-b3d5-4271-88a3-2036fe6b392b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:00.338105 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3348eea-b3d5-4271-88a3-2036fe6b392b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:00.351608 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-d3348eea-b3d5-4271-88a3-2036fe6b392b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] HTTP exception thrown: Instance aefa3d4a-410a-48ec-8ae1-c66ee39b3aab could not be found. Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d3348eea-b3d5-4271-88a3-2036fe6b392b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Request method failure captured: Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab HTTP/1.1 Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXd8_AaHeYv7mI8KcOiEpHHSLt3xix4i3AijgcSjiVH8gCZDNZTQs2eKPUSYf3-FI8TMZsjcfFPTEgO2BYtL_E0r7tuLX6t2K_PeaBE5t7gXNmnm97kpENPfU_RCfhh6EcQIjwoSMcBV6P-7_37AV6319KodCPKJo_De4zA522gc3ZJc Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: ec54882ff5fa47fe9303222e3f936de9 Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServerActionsTestJSON-1524178034 Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServerActionsTestJSON-1524178034 Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: ec54882ff5fa47fe9303222e3f936de9 Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServerActionsTestJSON-1524178034 Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServerActionsTestJSON-1524178034-project Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: bd6a4d32970a4d72be7109ceaf173241 Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServerActionsTestJSON-1524178034-project Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: exception: Instance aefa3d4a-410a-48ec-8ae1-c66ee39b3aab could not be found. Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'aefa3d4a-410a-48ec-8ae1-c66ee39b3aab'} Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aefa3d4a-410a-48ec-8ae1-c66ee39b3aab could not be found. Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 02:26:00.353184 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 02:26:00.358176 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aefa3d4a-410a-48ec-8ae1-c66ee39b3aab could not be found. Oct 30 02:26:00.358176 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:26:00.358176 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:26:00.358176 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:26:00.358176 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:26:00.358176 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:26:00.358176 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:26:00.358176 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:26:00.358176 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:26:00.358176 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aefa3d4a-410a-48ec-8ae1-c66ee39b3aab could not be found. Oct 30 02:26:00.358176 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:26:00.358176 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d3348eea-b3d5-4271-88a3-2036fe6b392b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Returning 404 to user: Instance aefa3d4a-410a-48ec-8ae1-c66ee39b3aab could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:26:00.358176 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d3348eea-b3d5-4271-88a3-2036fe6b392b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "DELETE /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab" status: 404 len: 111 microversion: 2.1 time: 0.029858 Oct 30 02:26:00.358176 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3930/7526] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 02:26:00 2022] DELETE /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 02:26:00.363681 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0a8fb3f5-fa22-4f8e-8f4c-f709c38bb5fc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:26:00.364296 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0a8fb3f5-fa22-4f8e-8f4c-f709c38bb5fc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] [instance: aefa3d4a-410a-48ec-8ae1-c66ee39b3aab] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:26:00.370322 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0a8fb3f5-fa22-4f8e-8f4c-f709c38bb5fc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:00.371418 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0a8fb3f5-fa22-4f8e-8f4c-f709c38bb5fc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:00.371912 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0a8fb3f5-fa22-4f8e-8f4c-f709c38bb5fc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:00.372613 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0a8fb3f5-fa22-4f8e-8f4c-f709c38bb5fc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:00.373071 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0a8fb3f5-fa22-4f8e-8f4c-f709c38bb5fc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:00.373527 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0a8fb3f5-fa22-4f8e-8f4c-f709c38bb5fc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:00.387015 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-0a8fb3f5-fa22-4f8e-8f4c-f709c38bb5fc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] HTTP exception thrown: Instance aefa3d4a-410a-48ec-8ae1-c66ee39b3aab could not be found. Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0a8fb3f5-fa22-4f8e-8f4c-f709c38bb5fc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Request method failure captured: Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab HTTP/1.1 Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXd8_AaHeYv7mI8KcOiEpHHSLt3xix4i3AijgcSjiVH8gCZDNZTQs2eKPUSYf3-FI8TMZsjcfFPTEgO2BYtL_E0r7tuLX6t2K_PeaBE5t7gXNmnm97kpENPfU_RCfhh6EcQIjwoSMcBV6P-7_37AV6319KodCPKJo_De4zA522gc3ZJc Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: ec54882ff5fa47fe9303222e3f936de9 Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServerActionsTestJSON-1524178034 Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ec54882ff5fa47fe9303222e3f936de9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServerActionsTestJSON-1524178034 Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: ec54882ff5fa47fe9303222e3f936de9 Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServerActionsTestJSON-1524178034 Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServerActionsTestJSON-1524178034-project Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: bd6a4d32970a4d72be7109ceaf173241 Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServerActionsTestJSON-1524178034-project Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: exception: Instance aefa3d4a-410a-48ec-8ae1-c66ee39b3aab could not be found. Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'aefa3d4a-410a-48ec-8ae1-c66ee39b3aab'} Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aefa3d4a-410a-48ec-8ae1-c66ee39b3aab could not be found. Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aefa3d4a-410a-48ec-8ae1-c66ee39b3aab could not be found. Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:26:00.388545 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:26:00.392688 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:26:00.392688 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:26:00.392688 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:26:00.392688 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:26:00.392688 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:26:00.392688 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aefa3d4a-410a-48ec-8ae1-c66ee39b3aab could not be found. Oct 30 02:26:00.392688 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:26:00.392688 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0a8fb3f5-fa22-4f8e-8f4c-f709c38bb5fc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Returning 404 to user: Instance aefa3d4a-410a-48ec-8ae1-c66ee39b3aab could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:26:00.392688 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0a8fb3f5-fa22-4f8e-8f4c-f709c38bb5fc tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab" status: 404 len: 111 microversion: 2.1 time: 0.030125 Oct 30 02:26:00.392688 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3597/7527] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:26:00 2022] GET /compute/v2.1/servers/aefa3d4a-410a-48ec-8ae1-c66ee39b3aab => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 02:26:00.398979 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6aad9e45-47f0-4ebe-a0ab-7f582294896b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] Calling method '.version_select at 0x7f44c44eb790>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:26:00.500343 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6aad9e45-47f0-4ebe-a0ab-7f582294896b tempest-ServerActionsTestJSON-1524178034 tempest-ServerActionsTestJSON-1524178034-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1057397827" status: 202 len: 0 microversion: 2.1 time: 0.105241 Oct 30 02:26:00.500934 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3931/7528] 10.222.0.13 () {58 vars in 1221 bytes} [Sun Oct 30 02:26:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1057397827 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 02:26:12.172076 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=11 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:26:12.172837 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=15 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:26:12.310536 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2be7f30c-bcbc-4295-9413-3603a66b0831 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1735547695", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "46b552ac-efc3-49ee-b9bf-ce16e89e90a6"}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:26:12.367689 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-2be7f30c-bcbc-4295-9413-3603a66b0831 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] validate_networks() for [('46b552ac-efc3-49ee-b9bf-ce16e89e90a6', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 02:26:12.735187 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-2be7f30c-bcbc-4295-9413-3603a66b0831 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 02:26:12.735617 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-2be7f30c-bcbc-4295-9413-3603a66b0831 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 02:26:12.736128 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-2be7f30c-bcbc-4295-9413-3603a66b0831 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 02:26:12.736546 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-2be7f30c-bcbc-4295-9413-3603a66b0831 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 02:26:12.737021 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-2be7f30c-bcbc-4295-9413-3603a66b0831 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 02:26:12.746200 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2be7f30c-bcbc-4295-9413-3603a66b0831 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:12.746688 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2be7f30c-bcbc-4295-9413-3603a66b0831 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:12.747132 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2be7f30c-bcbc-4295-9413-3603a66b0831 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:12.747869 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2be7f30c-bcbc-4295-9413-3603a66b0831 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:12.748333 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2be7f30c-bcbc-4295-9413-3603a66b0831 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:12.748765 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2be7f30c-bcbc-4295-9413-3603a66b0831 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:12.766359 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-2be7f30c-bcbc-4295-9413-3603a66b0831 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Getting quotas for project 4882834930374e3093f7a2de25c55d09. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 02:26:12.771613 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-2be7f30c-bcbc-4295-9413-3603a66b0831 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Getting quotas for user e0c3d5a6713246f0a856575bc7581a79 and project 4882834930374e3093f7a2de25c55d09. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 02:26:12.785123 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2be7f30c-bcbc-4295-9413-3603a66b0831 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 02:26:12.787519 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2be7f30c-bcbc-4295-9413-3603a66b0831 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] [instance: 5760feea-bfc9-4a1e-ac85-c5d54582289a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 02:26:12.911900 n-d-master-1 devstack@n-api.service[121103]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2be7f30c-bcbc-4295-9413-3603a66b0831 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] [ea8419db-1e48-4acc-a09d-9b821b35612c] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 30 02:26:13.921088 n-d-master-1 devstack@n-api.service[121103]: INFO oslo.messaging._drivers.impl_rabbit [None req-2be7f30c-bcbc-4295-9413-3603a66b0831 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] [ea8419db-1e48-4acc-a09d-9b821b35612c] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 57992. Oct 30 02:26:13.926332 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2be7f30c-bcbc-4295-9413-3603a66b0831 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.760298 Oct 30 02:26:13.927196 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3598/7529] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 02:26:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 02:26:13.936426 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:26:13.937305 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:26:13.941239 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-acabc67b-19ce-4b17-83b2-095749bf3012 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:26:13.941900 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-acabc67b-19ce-4b17-83b2-095749bf3012 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] [instance: 5760feea-bfc9-4a1e-ac85-c5d54582289a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:26:14.010082 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-acabc67b-19ce-4b17-83b2-095749bf3012 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3d5a6713246f0a856575bc7581a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882834930374e3093f7a2de25c55d09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:26:14.018240 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-acabc67b-19ce-4b17-83b2-095749bf3012 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] 10.222.0.13 "GET /compute/v2.1/servers/5760feea-bfc9-4a1e-ac85-c5d54582289a" status: 200 len: 1217 microversion: 2.1 time: 0.083668 Oct 30 02:26:14.018840 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3932/7530] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:26:13 2022] GET /compute/v2.1/servers/5760feea-bfc9-4a1e-ac85-c5d54582289a => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:26:15.041485 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-00589f81-8efe-469c-85a6-48d8c54ccd76 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:26:15.042659 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-00589f81-8efe-469c-85a6-48d8c54ccd76 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] [instance: 5760feea-bfc9-4a1e-ac85-c5d54582289a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:26:15.050148 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-00589f81-8efe-469c-85a6-48d8c54ccd76 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:15.050648 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-00589f81-8efe-469c-85a6-48d8c54ccd76 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:15.051120 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-00589f81-8efe-469c-85a6-48d8c54ccd76 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:15.051787 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-00589f81-8efe-469c-85a6-48d8c54ccd76 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:15.052248 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-00589f81-8efe-469c-85a6-48d8c54ccd76 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:15.052672 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-00589f81-8efe-469c-85a6-48d8c54ccd76 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:15.120076 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-00589f81-8efe-469c-85a6-48d8c54ccd76 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3d5a6713246f0a856575bc7581a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882834930374e3093f7a2de25c55d09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:26:15.129069 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-00589f81-8efe-469c-85a6-48d8c54ccd76 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] 10.222.0.13 "GET /compute/v2.1/servers/5760feea-bfc9-4a1e-ac85-c5d54582289a" status: 200 len: 1221 microversion: 2.1 time: 0.092326 Oct 30 02:26:15.129786 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3599/7531] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:26:15 2022] GET /compute/v2.1/servers/5760feea-bfc9-4a1e-ac85-c5d54582289a => generated 1221 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:26:16.153935 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-99d60914-6874-4a61-946a-7f81de9e8a54 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:26:16.154694 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-99d60914-6874-4a61-946a-7f81de9e8a54 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] [instance: 5760feea-bfc9-4a1e-ac85-c5d54582289a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:26:16.162788 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-99d60914-6874-4a61-946a-7f81de9e8a54 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:16.163406 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-99d60914-6874-4a61-946a-7f81de9e8a54 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:16.163958 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-99d60914-6874-4a61-946a-7f81de9e8a54 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:16.164686 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-99d60914-6874-4a61-946a-7f81de9e8a54 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:16.165160 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-99d60914-6874-4a61-946a-7f81de9e8a54 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:16.165632 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-99d60914-6874-4a61-946a-7f81de9e8a54 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:16.228978 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-99d60914-6874-4a61-946a-7f81de9e8a54 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3d5a6713246f0a856575bc7581a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882834930374e3093f7a2de25c55d09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:26:16.236734 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-99d60914-6874-4a61-946a-7f81de9e8a54 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] 10.222.0.13 "GET /compute/v2.1/servers/5760feea-bfc9-4a1e-ac85-c5d54582289a" status: 200 len: 1269 microversion: 2.1 time: 0.088619 Oct 30 02:26:16.237309 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3933/7532] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:26:16 2022] GET /compute/v2.1/servers/5760feea-bfc9-4a1e-ac85-c5d54582289a => generated 1269 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:26:17.263007 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-144f5deb-fa2b-414a-83df-fbd92ced81f3 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:26:17.264245 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-144f5deb-fa2b-414a-83df-fbd92ced81f3 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] [instance: 5760feea-bfc9-4a1e-ac85-c5d54582289a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:26:17.270674 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-144f5deb-fa2b-414a-83df-fbd92ced81f3 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:17.271214 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-144f5deb-fa2b-414a-83df-fbd92ced81f3 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:17.271759 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-144f5deb-fa2b-414a-83df-fbd92ced81f3 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:17.272546 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-144f5deb-fa2b-414a-83df-fbd92ced81f3 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:17.273075 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-144f5deb-fa2b-414a-83df-fbd92ced81f3 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:17.273599 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-144f5deb-fa2b-414a-83df-fbd92ced81f3 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:17.487592 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-144f5deb-fa2b-414a-83df-fbd92ced81f3 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3d5a6713246f0a856575bc7581a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882834930374e3093f7a2de25c55d09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:26:17.495267 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-144f5deb-fa2b-414a-83df-fbd92ced81f3 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] 10.222.0.13 "GET /compute/v2.1/servers/5760feea-bfc9-4a1e-ac85-c5d54582289a" status: 200 len: 1317 microversion: 2.1 time: 0.238856 Oct 30 02:26:17.495853 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3600/7533] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:26:17 2022] GET /compute/v2.1/servers/5760feea-bfc9-4a1e-ac85-c5d54582289a => generated 1317 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:26:18.124442 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-57c0dbfb-23f4-4ffa-af89-d4d78c29e3c8 req-9c770461-4a49-4d50-8e05-293ce69a857e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5760feea-bfc9-4a1e-ac85-c5d54582289a", "tag": "e2b26326-7e64-41ce-99f5-ca120ca2e4c2"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:26:18.135186 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-57c0dbfb-23f4-4ffa-af89-d4d78c29e3c8 req-9c770461-4a49-4d50-8e05-293ce69a857e service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:18.135714 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-57c0dbfb-23f4-4ffa-af89-d4d78c29e3c8 req-9c770461-4a49-4d50-8e05-293ce69a857e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:18.136158 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-57c0dbfb-23f4-4ffa-af89-d4d78c29e3c8 req-9c770461-4a49-4d50-8e05-293ce69a857e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:18.147590 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-57c0dbfb-23f4-4ffa-af89-d4d78c29e3c8 req-9c770461-4a49-4d50-8e05-293ce69a857e service nova] Creating event network-changed:e2b26326-7e64-41ce-99f5-ca120ca2e4c2 for instance 5760feea-bfc9-4a1e-ac85-c5d54582289a on n-h2-master-1 Oct 30 02:26:18.152468 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-57c0dbfb-23f4-4ffa-af89-d4d78c29e3c8 req-9c770461-4a49-4d50-8e05-293ce69a857e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102669 Oct 30 02:26:18.153242 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3934/7534] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:26:18.517978 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3dd9edd7-e6b1-4232-8638-bcf15240fa5e tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:26:18.518622 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3dd9edd7-e6b1-4232-8638-bcf15240fa5e tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] [instance: 5760feea-bfc9-4a1e-ac85-c5d54582289a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:26:18.525758 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3dd9edd7-e6b1-4232-8638-bcf15240fa5e tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:18.526746 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3dd9edd7-e6b1-4232-8638-bcf15240fa5e tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:18.527183 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3dd9edd7-e6b1-4232-8638-bcf15240fa5e tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:18.527888 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3dd9edd7-e6b1-4232-8638-bcf15240fa5e tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:18.528340 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3dd9edd7-e6b1-4232-8638-bcf15240fa5e tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:18.528763 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3dd9edd7-e6b1-4232-8638-bcf15240fa5e tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:18.665296 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3dd9edd7-e6b1-4232-8638-bcf15240fa5e tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3d5a6713246f0a856575bc7581a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882834930374e3093f7a2de25c55d09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:26:18.674204 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3dd9edd7-e6b1-4232-8638-bcf15240fa5e tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] 10.222.0.13 "GET /compute/v2.1/servers/5760feea-bfc9-4a1e-ac85-c5d54582289a" status: 200 len: 1317 microversion: 2.1 time: 0.160216 Oct 30 02:26:18.674815 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3601/7535] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:26:18 2022] GET /compute/v2.1/servers/5760feea-bfc9-4a1e-ac85-c5d54582289a => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:26:19.697436 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-acd6f405-d42d-4ed9-87fa-310a7c91dd13 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:26:19.698159 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-acd6f405-d42d-4ed9-87fa-310a7c91dd13 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] [instance: 5760feea-bfc9-4a1e-ac85-c5d54582289a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:26:19.704634 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-acd6f405-d42d-4ed9-87fa-310a7c91dd13 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:19.705137 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-acd6f405-d42d-4ed9-87fa-310a7c91dd13 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:19.705617 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-acd6f405-d42d-4ed9-87fa-310a7c91dd13 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:19.706366 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-acd6f405-d42d-4ed9-87fa-310a7c91dd13 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:19.706836 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-acd6f405-d42d-4ed9-87fa-310a7c91dd13 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:19.707286 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-acd6f405-d42d-4ed9-87fa-310a7c91dd13 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:19.857672 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-acd6f405-d42d-4ed9-87fa-310a7c91dd13 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3d5a6713246f0a856575bc7581a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882834930374e3093f7a2de25c55d09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:26:19.867866 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-acd6f405-d42d-4ed9-87fa-310a7c91dd13 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] 10.222.0.13 "GET /compute/v2.1/servers/5760feea-bfc9-4a1e-ac85-c5d54582289a" status: 200 len: 1317 microversion: 2.1 time: 0.174850 Oct 30 02:26:19.868476 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3935/7536] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:26:19 2022] GET /compute/v2.1/servers/5760feea-bfc9-4a1e-ac85-c5d54582289a => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:26:20.891592 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1a7e559c-5ed0-44c1-b202-2636f2396937 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:26:20.892211 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1a7e559c-5ed0-44c1-b202-2636f2396937 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] [instance: 5760feea-bfc9-4a1e-ac85-c5d54582289a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:26:20.899284 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a7e559c-5ed0-44c1-b202-2636f2396937 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:20.899770 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a7e559c-5ed0-44c1-b202-2636f2396937 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:20.900208 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a7e559c-5ed0-44c1-b202-2636f2396937 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:20.901017 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a7e559c-5ed0-44c1-b202-2636f2396937 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:20.901992 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a7e559c-5ed0-44c1-b202-2636f2396937 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:20.902411 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a7e559c-5ed0-44c1-b202-2636f2396937 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:21.036472 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1a7e559c-5ed0-44c1-b202-2636f2396937 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3d5a6713246f0a856575bc7581a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882834930374e3093f7a2de25c55d09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:26:21.044431 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1a7e559c-5ed0-44c1-b202-2636f2396937 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] 10.222.0.13 "GET /compute/v2.1/servers/5760feea-bfc9-4a1e-ac85-c5d54582289a" status: 200 len: 1317 microversion: 2.1 time: 0.156880 Oct 30 02:26:21.045013 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3602/7537] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:26:20 2022] GET /compute/v2.1/servers/5760feea-bfc9-4a1e-ac85-c5d54582289a => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:26:22.067209 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e18597d9-e49e-4cd1-97d2-d0c1fc5cf762 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:26:22.067841 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e18597d9-e49e-4cd1-97d2-d0c1fc5cf762 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] [instance: 5760feea-bfc9-4a1e-ac85-c5d54582289a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:26:22.074873 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e18597d9-e49e-4cd1-97d2-d0c1fc5cf762 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:22.075375 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e18597d9-e49e-4cd1-97d2-d0c1fc5cf762 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:22.075831 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e18597d9-e49e-4cd1-97d2-d0c1fc5cf762 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:22.076541 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e18597d9-e49e-4cd1-97d2-d0c1fc5cf762 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:22.077008 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e18597d9-e49e-4cd1-97d2-d0c1fc5cf762 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:22.077479 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e18597d9-e49e-4cd1-97d2-d0c1fc5cf762 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:22.203625 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e18597d9-e49e-4cd1-97d2-d0c1fc5cf762 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3d5a6713246f0a856575bc7581a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882834930374e3093f7a2de25c55d09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:26:22.211392 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e18597d9-e49e-4cd1-97d2-d0c1fc5cf762 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] 10.222.0.13 "GET /compute/v2.1/servers/5760feea-bfc9-4a1e-ac85-c5d54582289a" status: 200 len: 1317 microversion: 2.1 time: 0.148285 Oct 30 02:26:22.211963 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3936/7538] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:26:22 2022] GET /compute/v2.1/servers/5760feea-bfc9-4a1e-ac85-c5d54582289a => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:26:23.162779 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-df80862b-5d76-4f8c-9709-bc199373a1b1 req-aa090ebf-ae03-4c6a-a8f6-b00cadacaf36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5760feea-bfc9-4a1e-ac85-c5d54582289a", "name": "network-vif-plugged", "status": "completed", "tag": "e2b26326-7e64-41ce-99f5-ca120ca2e4c2"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:26:23.169726 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:26:23.170672 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=6 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:26:23.174486 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-df80862b-5d76-4f8c-9709-bc199373a1b1 req-aa090ebf-ae03-4c6a-a8f6-b00cadacaf36 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:23.174964 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-df80862b-5d76-4f8c-9709-bc199373a1b1 req-aa090ebf-ae03-4c6a-a8f6-b00cadacaf36 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:23.175388 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-df80862b-5d76-4f8c-9709-bc199373a1b1 req-aa090ebf-ae03-4c6a-a8f6-b00cadacaf36 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:23.186843 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-df80862b-5d76-4f8c-9709-bc199373a1b1 req-aa090ebf-ae03-4c6a-a8f6-b00cadacaf36 service nova] Creating event network-vif-plugged:e2b26326-7e64-41ce-99f5-ca120ca2e4c2 for instance 5760feea-bfc9-4a1e-ac85-c5d54582289a on n-h2-master-1 Oct 30 02:26:23.191850 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-df80862b-5d76-4f8c-9709-bc199373a1b1 req-aa090ebf-ae03-4c6a-a8f6-b00cadacaf36 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032887 Oct 30 02:26:23.192482 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3603/7539] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:26:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:26:23.234884 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-84d2f7ca-8369-4930-81aa-32ec4442b6f6 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:26:23.235519 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-84d2f7ca-8369-4930-81aa-32ec4442b6f6 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] [instance: 5760feea-bfc9-4a1e-ac85-c5d54582289a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:26:23.243033 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-84d2f7ca-8369-4930-81aa-32ec4442b6f6 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:23.243889 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-84d2f7ca-8369-4930-81aa-32ec4442b6f6 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:23.244013 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-84d2f7ca-8369-4930-81aa-32ec4442b6f6 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:23.245494 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-84d2f7ca-8369-4930-81aa-32ec4442b6f6 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:23.245695 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-84d2f7ca-8369-4930-81aa-32ec4442b6f6 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:23.246136 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-84d2f7ca-8369-4930-81aa-32ec4442b6f6 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:23.390294 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-84d2f7ca-8369-4930-81aa-32ec4442b6f6 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3d5a6713246f0a856575bc7581a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882834930374e3093f7a2de25c55d09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:26:23.398136 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-84d2f7ca-8369-4930-81aa-32ec4442b6f6 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] 10.222.0.13 "GET /compute/v2.1/servers/5760feea-bfc9-4a1e-ac85-c5d54582289a" status: 200 len: 1317 microversion: 2.1 time: 0.167230 Oct 30 02:26:23.398709 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3937/7540] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:26:23 2022] GET /compute/v2.1/servers/5760feea-bfc9-4a1e-ac85-c5d54582289a => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:26:24.423636 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f447b05c-639f-4891-b61b-cfaa2e07e44b tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:26:24.424343 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f447b05c-639f-4891-b61b-cfaa2e07e44b tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] [instance: 5760feea-bfc9-4a1e-ac85-c5d54582289a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:26:24.434427 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f447b05c-639f-4891-b61b-cfaa2e07e44b tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:24.434949 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f447b05c-639f-4891-b61b-cfaa2e07e44b tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:24.435655 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f447b05c-639f-4891-b61b-cfaa2e07e44b tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:24.436377 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f447b05c-639f-4891-b61b-cfaa2e07e44b tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:24.436835 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f447b05c-639f-4891-b61b-cfaa2e07e44b tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:24.437741 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f447b05c-639f-4891-b61b-cfaa2e07e44b tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:24.575670 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f447b05c-639f-4891-b61b-cfaa2e07e44b tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3d5a6713246f0a856575bc7581a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882834930374e3093f7a2de25c55d09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:26:24.583497 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f447b05c-639f-4891-b61b-cfaa2e07e44b tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] 10.222.0.13 "GET /compute/v2.1/servers/5760feea-bfc9-4a1e-ac85-c5d54582289a" status: 200 len: 1317 microversion: 2.1 time: 0.165742 Oct 30 02:26:24.584072 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3604/7541] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:26:24 2022] GET /compute/v2.1/servers/5760feea-bfc9-4a1e-ac85-c5d54582289a => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:26:25.605295 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-08c9c612-cc8c-42a7-84bb-af66add2c986 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:26:25.605943 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-08c9c612-cc8c-42a7-84bb-af66add2c986 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] [instance: 5760feea-bfc9-4a1e-ac85-c5d54582289a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:26:25.607982 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:26:25.613785 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08c9c612-cc8c-42a7-84bb-af66add2c986 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:25.614280 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08c9c612-cc8c-42a7-84bb-af66add2c986 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:25.614728 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08c9c612-cc8c-42a7-84bb-af66add2c986 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:25.615433 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08c9c612-cc8c-42a7-84bb-af66add2c986 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:25.615897 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08c9c612-cc8c-42a7-84bb-af66add2c986 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:25.616332 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08c9c612-cc8c-42a7-84bb-af66add2c986 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:25.742973 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-08c9c612-cc8c-42a7-84bb-af66add2c986 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3d5a6713246f0a856575bc7581a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882834930374e3093f7a2de25c55d09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:26:25.750727 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-08c9c612-cc8c-42a7-84bb-af66add2c986 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] 10.222.0.13 "GET /compute/v2.1/servers/5760feea-bfc9-4a1e-ac85-c5d54582289a" status: 200 len: 1506 microversion: 2.1 time: 0.149457 Oct 30 02:26:25.751306 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3938/7542] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:26:25 2022] GET /compute/v2.1/servers/5760feea-bfc9-4a1e-ac85-c5d54582289a => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:26:25.811797 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d12dd0c8-5bb8-47c7-9bed-343cba9772bd tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-17677194", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "46b552ac-efc3-49ee-b9bf-ce16e89e90a6"}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:26:25.864178 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-d12dd0c8-5bb8-47c7-9bed-343cba9772bd tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] validate_networks() for [('46b552ac-efc3-49ee-b9bf-ce16e89e90a6', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 02:26:26.504313 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-d12dd0c8-5bb8-47c7-9bed-343cba9772bd tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 02:26:26.504733 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-d12dd0c8-5bb8-47c7-9bed-343cba9772bd tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 02:26:26.505204 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-d12dd0c8-5bb8-47c7-9bed-343cba9772bd tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 02:26:26.505668 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-d12dd0c8-5bb8-47c7-9bed-343cba9772bd tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 02:26:26.506077 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-d12dd0c8-5bb8-47c7-9bed-343cba9772bd tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 02:26:26.515024 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d12dd0c8-5bb8-47c7-9bed-343cba9772bd tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:26.515505 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d12dd0c8-5bb8-47c7-9bed-343cba9772bd tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:26.515934 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d12dd0c8-5bb8-47c7-9bed-343cba9772bd tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:26.516664 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d12dd0c8-5bb8-47c7-9bed-343cba9772bd tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:26.517109 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d12dd0c8-5bb8-47c7-9bed-343cba9772bd tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:26.517557 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d12dd0c8-5bb8-47c7-9bed-343cba9772bd tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:26.533836 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-d12dd0c8-5bb8-47c7-9bed-343cba9772bd tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Getting quotas for project 4882834930374e3093f7a2de25c55d09. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 02:26:26.539448 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-d12dd0c8-5bb8-47c7-9bed-343cba9772bd tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Getting quotas for user e0c3d5a6713246f0a856575bc7581a79 and project 4882834930374e3093f7a2de25c55d09. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 02:26:26.552614 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d12dd0c8-5bb8-47c7-9bed-343cba9772bd tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 02:26:26.554904 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d12dd0c8-5bb8-47c7-9bed-343cba9772bd tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] [instance: bb9fd8ed-4283-4c7c-994b-7b5dc83855ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 02:26:26.646365 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d12dd0c8-5bb8-47c7-9bed-343cba9772bd tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.838375 Oct 30 02:26:26.649379 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3605/7543] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 02:26:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 840 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 02:26:26.658634 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-61fdda3d-67a0-45e6-8870-014da47de8c2 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:26:26.659301 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-61fdda3d-67a0-45e6-8870-014da47de8c2 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] [instance: bb9fd8ed-4283-4c7c-994b-7b5dc83855ed] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:26:26.712797 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-61fdda3d-67a0-45e6-8870-014da47de8c2 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3d5a6713246f0a856575bc7581a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882834930374e3093f7a2de25c55d09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:26:26.720352 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-61fdda3d-67a0-45e6-8870-014da47de8c2 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] 10.222.0.13 "GET /compute/v2.1/servers/bb9fd8ed-4283-4c7c-994b-7b5dc83855ed" status: 200 len: 1215 microversion: 2.1 time: 0.065642 Oct 30 02:26:26.720947 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3939/7544] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:26:26 2022] GET /compute/v2.1/servers/bb9fd8ed-4283-4c7c-994b-7b5dc83855ed => generated 1215 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:26:27.744261 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-aa5398d9-185b-4e95-ab14-ace05669a1b7 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:26:27.744793 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-aa5398d9-185b-4e95-ab14-ace05669a1b7 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] [instance: bb9fd8ed-4283-4c7c-994b-7b5dc83855ed] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:26:27.752170 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa5398d9-185b-4e95-ab14-ace05669a1b7 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:27.752654 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa5398d9-185b-4e95-ab14-ace05669a1b7 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:27.753086 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa5398d9-185b-4e95-ab14-ace05669a1b7 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:27.753798 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa5398d9-185b-4e95-ab14-ace05669a1b7 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:27.754246 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa5398d9-185b-4e95-ab14-ace05669a1b7 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:27.754666 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa5398d9-185b-4e95-ab14-ace05669a1b7 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:27.816593 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-aa5398d9-185b-4e95-ab14-ace05669a1b7 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3d5a6713246f0a856575bc7581a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882834930374e3093f7a2de25c55d09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:26:27.824217 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-aa5398d9-185b-4e95-ab14-ace05669a1b7 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] 10.222.0.13 "GET /compute/v2.1/servers/bb9fd8ed-4283-4c7c-994b-7b5dc83855ed" status: 200 len: 1219 microversion: 2.1 time: 0.084136 Oct 30 02:26:27.824786 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3606/7545] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:26:27 2022] GET /compute/v2.1/servers/bb9fd8ed-4283-4c7c-994b-7b5dc83855ed => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:26:28.846707 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b641740b-1162-43b4-b04f-2ef1ce216093 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:26:28.847344 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b641740b-1162-43b4-b04f-2ef1ce216093 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] [instance: bb9fd8ed-4283-4c7c-994b-7b5dc83855ed] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:26:28.858871 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b641740b-1162-43b4-b04f-2ef1ce216093 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:28.859372 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b641740b-1162-43b4-b04f-2ef1ce216093 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:28.859819 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b641740b-1162-43b4-b04f-2ef1ce216093 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:28.860530 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b641740b-1162-43b4-b04f-2ef1ce216093 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:28.860993 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b641740b-1162-43b4-b04f-2ef1ce216093 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:28.861454 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b641740b-1162-43b4-b04f-2ef1ce216093 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:28.938856 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b641740b-1162-43b4-b04f-2ef1ce216093 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3d5a6713246f0a856575bc7581a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882834930374e3093f7a2de25c55d09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:26:28.946907 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b641740b-1162-43b4-b04f-2ef1ce216093 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] 10.222.0.13 "GET /compute/v2.1/servers/bb9fd8ed-4283-4c7c-994b-7b5dc83855ed" status: 200 len: 1285 microversion: 2.1 time: 0.104119 Oct 30 02:26:28.947504 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3940/7546] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:26:28 2022] GET /compute/v2.1/servers/bb9fd8ed-4283-4c7c-994b-7b5dc83855ed => generated 1285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:26:29.970663 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2d202eb3-4792-4c2c-bd65-537a3ad9d47f tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:26:29.971658 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2d202eb3-4792-4c2c-bd65-537a3ad9d47f tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] [instance: bb9fd8ed-4283-4c7c-994b-7b5dc83855ed] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:26:29.979460 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2d202eb3-4792-4c2c-bd65-537a3ad9d47f tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:29.980807 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2d202eb3-4792-4c2c-bd65-537a3ad9d47f tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:29.981481 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2d202eb3-4792-4c2c-bd65-537a3ad9d47f tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:29.982282 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2d202eb3-4792-4c2c-bd65-537a3ad9d47f tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:29.982797 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2d202eb3-4792-4c2c-bd65-537a3ad9d47f tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:29.983506 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2d202eb3-4792-4c2c-bd65-537a3ad9d47f tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:30.114894 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2d202eb3-4792-4c2c-bd65-537a3ad9d47f tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3d5a6713246f0a856575bc7581a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882834930374e3093f7a2de25c55d09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:26:30.122848 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2d202eb3-4792-4c2c-bd65-537a3ad9d47f tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] 10.222.0.13 "GET /compute/v2.1/servers/bb9fd8ed-4283-4c7c-994b-7b5dc83855ed" status: 200 len: 1315 microversion: 2.1 time: 0.156449 Oct 30 02:26:30.129084 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3607/7547] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:26:29 2022] GET /compute/v2.1/servers/bb9fd8ed-4283-4c7c-994b-7b5dc83855ed => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:26:30.272511 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-998f0505-76c5-43a9-b73b-37df92c1131b req-d97586e3-06fd-49a5-a4c5-da9356d69be5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb9fd8ed-4283-4c7c-994b-7b5dc83855ed", "tag": "42320afe-f361-483a-88e3-a3304955797c"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:26:30.285321 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-998f0505-76c5-43a9-b73b-37df92c1131b req-d97586e3-06fd-49a5-a4c5-da9356d69be5 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:30.285877 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-998f0505-76c5-43a9-b73b-37df92c1131b req-d97586e3-06fd-49a5-a4c5-da9356d69be5 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:30.286323 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-998f0505-76c5-43a9-b73b-37df92c1131b req-d97586e3-06fd-49a5-a4c5-da9356d69be5 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:30.299718 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-998f0505-76c5-43a9-b73b-37df92c1131b req-d97586e3-06fd-49a5-a4c5-da9356d69be5 service nova] Creating event network-changed:42320afe-f361-483a-88e3-a3304955797c for instance bb9fd8ed-4283-4c7c-994b-7b5dc83855ed on n-h1-master-1 Oct 30 02:26:30.305351 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-998f0505-76c5-43a9-b73b-37df92c1131b req-d97586e3-06fd-49a5-a4c5-da9356d69be5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036774 Oct 30 02:26:30.305956 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3941/7548] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:26:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:26:31.146198 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9ead03d8-a1de-4034-b91e-ad229ca29ac8 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:26:31.146773 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9ead03d8-a1de-4034-b91e-ad229ca29ac8 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] [instance: bb9fd8ed-4283-4c7c-994b-7b5dc83855ed] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:26:31.154090 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9ead03d8-a1de-4034-b91e-ad229ca29ac8 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:31.154568 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9ead03d8-a1de-4034-b91e-ad229ca29ac8 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:31.154999 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9ead03d8-a1de-4034-b91e-ad229ca29ac8 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:31.155679 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9ead03d8-a1de-4034-b91e-ad229ca29ac8 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:31.156129 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9ead03d8-a1de-4034-b91e-ad229ca29ac8 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:31.156547 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9ead03d8-a1de-4034-b91e-ad229ca29ac8 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:31.288827 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9ead03d8-a1de-4034-b91e-ad229ca29ac8 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3d5a6713246f0a856575bc7581a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882834930374e3093f7a2de25c55d09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:26:31.297428 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9ead03d8-a1de-4034-b91e-ad229ca29ac8 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] 10.222.0.13 "GET /compute/v2.1/servers/bb9fd8ed-4283-4c7c-994b-7b5dc83855ed" status: 200 len: 1315 microversion: 2.1 time: 0.155205 Oct 30 02:26:31.298281 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3608/7549] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:26:31 2022] GET /compute/v2.1/servers/bb9fd8ed-4283-4c7c-994b-7b5dc83855ed => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:26:32.321554 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-34345ee5-a9dc-410e-87df-1cc65781042b tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:26:32.322267 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-34345ee5-a9dc-410e-87df-1cc65781042b tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] [instance: bb9fd8ed-4283-4c7c-994b-7b5dc83855ed] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:26:32.328422 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-34345ee5-a9dc-410e-87df-1cc65781042b tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:32.328919 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-34345ee5-a9dc-410e-87df-1cc65781042b tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:32.329399 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-34345ee5-a9dc-410e-87df-1cc65781042b tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:32.330101 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-34345ee5-a9dc-410e-87df-1cc65781042b tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:32.330565 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-34345ee5-a9dc-410e-87df-1cc65781042b tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:32.331001 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-34345ee5-a9dc-410e-87df-1cc65781042b tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:32.457255 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-34345ee5-a9dc-410e-87df-1cc65781042b tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3d5a6713246f0a856575bc7581a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882834930374e3093f7a2de25c55d09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:26:32.465176 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-34345ee5-a9dc-410e-87df-1cc65781042b tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] 10.222.0.13 "GET /compute/v2.1/servers/bb9fd8ed-4283-4c7c-994b-7b5dc83855ed" status: 200 len: 1315 microversion: 2.1 time: 0.148818 Oct 30 02:26:32.465783 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3942/7550] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:26:32 2022] GET /compute/v2.1/servers/bb9fd8ed-4283-4c7c-994b-7b5dc83855ed => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:26:33.488156 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4799fbca-0487-40e6-af62-7e29b5d813ee tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:26:33.488767 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4799fbca-0487-40e6-af62-7e29b5d813ee tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] [instance: bb9fd8ed-4283-4c7c-994b-7b5dc83855ed] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:26:33.495691 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4799fbca-0487-40e6-af62-7e29b5d813ee tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:33.496185 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4799fbca-0487-40e6-af62-7e29b5d813ee tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:33.496630 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4799fbca-0487-40e6-af62-7e29b5d813ee tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:33.497367 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4799fbca-0487-40e6-af62-7e29b5d813ee tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:33.497828 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4799fbca-0487-40e6-af62-7e29b5d813ee tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:33.498378 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4799fbca-0487-40e6-af62-7e29b5d813ee tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:33.627614 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4799fbca-0487-40e6-af62-7e29b5d813ee tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3d5a6713246f0a856575bc7581a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882834930374e3093f7a2de25c55d09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:26:33.635729 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4799fbca-0487-40e6-af62-7e29b5d813ee tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] 10.222.0.13 "GET /compute/v2.1/servers/bb9fd8ed-4283-4c7c-994b-7b5dc83855ed" status: 200 len: 1315 microversion: 2.1 time: 0.151442 Oct 30 02:26:33.636324 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3609/7551] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:26:33 2022] GET /compute/v2.1/servers/bb9fd8ed-4283-4c7c-994b-7b5dc83855ed => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:26:34.658772 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2745029d-3195-44e7-82d7-8c474bb14a9e tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:26:34.659436 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2745029d-3195-44e7-82d7-8c474bb14a9e tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] [instance: bb9fd8ed-4283-4c7c-994b-7b5dc83855ed] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:26:34.666594 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2745029d-3195-44e7-82d7-8c474bb14a9e tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:34.667077 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2745029d-3195-44e7-82d7-8c474bb14a9e tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:34.667532 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2745029d-3195-44e7-82d7-8c474bb14a9e tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:34.668759 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2745029d-3195-44e7-82d7-8c474bb14a9e tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:34.669230 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2745029d-3195-44e7-82d7-8c474bb14a9e tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:34.669732 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2745029d-3195-44e7-82d7-8c474bb14a9e tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:34.800536 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2745029d-3195-44e7-82d7-8c474bb14a9e tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3d5a6713246f0a856575bc7581a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882834930374e3093f7a2de25c55d09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:26:34.808201 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2745029d-3195-44e7-82d7-8c474bb14a9e tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] 10.222.0.13 "GET /compute/v2.1/servers/bb9fd8ed-4283-4c7c-994b-7b5dc83855ed" status: 200 len: 1315 microversion: 2.1 time: 0.153425 Oct 30 02:26:34.809410 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3943/7552] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:26:34 2022] GET /compute/v2.1/servers/bb9fd8ed-4283-4c7c-994b-7b5dc83855ed => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:26:35.612058 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-c63e5d50-db38-4ba8-92bc-133912f9bcf4 req-c1a18d82-c539-48a5-a165-3407e9669036 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb9fd8ed-4283-4c7c-994b-7b5dc83855ed", "name": "network-vif-plugged", "status": "completed", "tag": "42320afe-f361-483a-88e3-a3304955797c"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:26:35.618575 n-d-master-1 devstack@n-api.service[121103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 30 02:26:35.618723 n-d-master-1 devstack@n-api.service[121103]: Sun Oct 30 02:26:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.13) !!! Oct 30 02:26:35.630544 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-c63e5d50-db38-4ba8-92bc-133912f9bcf4 req-c1a18d82-c539-48a5-a165-3407e9669036 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:35.631079 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-c63e5d50-db38-4ba8-92bc-133912f9bcf4 req-c1a18d82-c539-48a5-a165-3407e9669036 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:35.631540 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-c63e5d50-db38-4ba8-92bc-133912f9bcf4 req-c1a18d82-c539-48a5-a165-3407e9669036 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:35.643342 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-c63e5d50-db38-4ba8-92bc-133912f9bcf4 req-c1a18d82-c539-48a5-a165-3407e9669036 service nova] Creating event network-vif-plugged:42320afe-f361-483a-88e3-a3304955797c for instance bb9fd8ed-4283-4c7c-994b-7b5dc83855ed on n-h1-master-1 Oct 30 02:26:35.648146 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-c63e5d50-db38-4ba8-92bc-133912f9bcf4 req-c1a18d82-c539-48a5-a165-3407e9669036 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039997 Oct 30 02:26:35.648727 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3610/7553] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:26:35.831714 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-08e2102d-e4db-4b4e-a372-6a0777596f76 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:26:35.832241 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-08e2102d-e4db-4b4e-a372-6a0777596f76 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] [instance: bb9fd8ed-4283-4c7c-994b-7b5dc83855ed] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:26:35.839704 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08e2102d-e4db-4b4e-a372-6a0777596f76 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:35.840220 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08e2102d-e4db-4b4e-a372-6a0777596f76 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:35.840669 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08e2102d-e4db-4b4e-a372-6a0777596f76 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:35.841435 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08e2102d-e4db-4b4e-a372-6a0777596f76 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:35.849991 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08e2102d-e4db-4b4e-a372-6a0777596f76 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:35.849991 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08e2102d-e4db-4b4e-a372-6a0777596f76 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:35.973671 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-08e2102d-e4db-4b4e-a372-6a0777596f76 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3d5a6713246f0a856575bc7581a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882834930374e3093f7a2de25c55d09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:26:35.981972 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-08e2102d-e4db-4b4e-a372-6a0777596f76 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] 10.222.0.13 "GET /compute/v2.1/servers/bb9fd8ed-4283-4c7c-994b-7b5dc83855ed" status: 200 len: 1315 microversion: 2.1 time: 0.154327 Oct 30 02:26:35.982544 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3944/7554] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:26:35 2022] GET /compute/v2.1/servers/bb9fd8ed-4283-4c7c-994b-7b5dc83855ed => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:26:37.006704 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ae1db7e0-5e51-45c9-bff3-0ca6fd92b3b9 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:26:37.007427 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ae1db7e0-5e51-45c9-bff3-0ca6fd92b3b9 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] [instance: bb9fd8ed-4283-4c7c-994b-7b5dc83855ed] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:26:37.009465 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:26:37.010125 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=6 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:26:37.016381 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ae1db7e0-5e51-45c9-bff3-0ca6fd92b3b9 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:37.016847 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ae1db7e0-5e51-45c9-bff3-0ca6fd92b3b9 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:37.017276 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ae1db7e0-5e51-45c9-bff3-0ca6fd92b3b9 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:37.017981 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ae1db7e0-5e51-45c9-bff3-0ca6fd92b3b9 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:37.018431 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ae1db7e0-5e51-45c9-bff3-0ca6fd92b3b9 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:37.018847 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ae1db7e0-5e51-45c9-bff3-0ca6fd92b3b9 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:37.152953 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ae1db7e0-5e51-45c9-bff3-0ca6fd92b3b9 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3d5a6713246f0a856575bc7581a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882834930374e3093f7a2de25c55d09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:26:37.160669 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ae1db7e0-5e51-45c9-bff3-0ca6fd92b3b9 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] 10.222.0.13 "GET /compute/v2.1/servers/bb9fd8ed-4283-4c7c-994b-7b5dc83855ed" status: 200 len: 1504 microversion: 2.1 time: 0.158664 Oct 30 02:26:37.161256 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3611/7555] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:26:37 2022] GET /compute/v2.1/servers/bb9fd8ed-4283-4c7c-994b-7b5dc83855ed => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:26:37.182717 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-93f84e4b-8fd8-498e-b830-0e645f5e6ec7 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:26:37.183302 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-93f84e4b-8fd8-498e-b830-0e645f5e6ec7 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] [instance: bb9fd8ed-4283-4c7c-994b-7b5dc83855ed] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:26:37.185722 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:26:37.191282 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-93f84e4b-8fd8-498e-b830-0e645f5e6ec7 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:37.191784 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-93f84e4b-8fd8-498e-b830-0e645f5e6ec7 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:37.192226 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-93f84e4b-8fd8-498e-b830-0e645f5e6ec7 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:37.192928 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-93f84e4b-8fd8-498e-b830-0e645f5e6ec7 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:37.193413 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-93f84e4b-8fd8-498e-b830-0e645f5e6ec7 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:37.193852 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-93f84e4b-8fd8-498e-b830-0e645f5e6ec7 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:37.219644 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-93f84e4b-8fd8-498e-b830-0e645f5e6ec7 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] [instance: bb9fd8ed-4283-4c7c-994b-7b5dc83855ed] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 02:26:37.484498 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-93f84e4b-8fd8-498e-b830-0e645f5e6ec7 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] 10.222.0.13 "DELETE /compute/v2.1/servers/bb9fd8ed-4283-4c7c-994b-7b5dc83855ed" status: 204 len: 0 microversion: 2.1 time: 0.305371 Oct 30 02:26:37.485138 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3945/7556] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 02:26:37 2022] DELETE /compute/v2.1/servers/bb9fd8ed-4283-4c7c-994b-7b5dc83855ed => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 02:26:37.493505 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-42005a07-05d1-409f-b336-c25bd7c91015 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:26:37.494127 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-42005a07-05d1-409f-b336-c25bd7c91015 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] [instance: bb9fd8ed-4283-4c7c-994b-7b5dc83855ed] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:26:37.500782 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42005a07-05d1-409f-b336-c25bd7c91015 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:37.501268 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42005a07-05d1-409f-b336-c25bd7c91015 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:37.501750 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42005a07-05d1-409f-b336-c25bd7c91015 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:37.502444 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42005a07-05d1-409f-b336-c25bd7c91015 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:37.502899 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42005a07-05d1-409f-b336-c25bd7c91015 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:37.503324 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42005a07-05d1-409f-b336-c25bd7c91015 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:37.632852 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-42005a07-05d1-409f-b336-c25bd7c91015 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3d5a6713246f0a856575bc7581a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882834930374e3093f7a2de25c55d09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:26:37.640643 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-42005a07-05d1-409f-b336-c25bd7c91015 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] 10.222.0.13 "GET /compute/v2.1/servers/bb9fd8ed-4283-4c7c-994b-7b5dc83855ed" status: 200 len: 1510 microversion: 2.1 time: 0.151062 Oct 30 02:26:37.641226 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3612/7557] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:26:37 2022] GET /compute/v2.1/servers/bb9fd8ed-4283-4c7c-994b-7b5dc83855ed => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:26:38.665141 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-173be4bb-2e3e-4604-b067-9ca899960fd4 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:26:38.665904 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-173be4bb-2e3e-4604-b067-9ca899960fd4 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] [instance: bb9fd8ed-4283-4c7c-994b-7b5dc83855ed] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:26:38.672864 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-173be4bb-2e3e-4604-b067-9ca899960fd4 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:38.673379 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-173be4bb-2e3e-4604-b067-9ca899960fd4 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:38.673830 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-173be4bb-2e3e-4604-b067-9ca899960fd4 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:38.674534 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-173be4bb-2e3e-4604-b067-9ca899960fd4 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:38.675001 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-173be4bb-2e3e-4604-b067-9ca899960fd4 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:38.675433 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-173be4bb-2e3e-4604-b067-9ca899960fd4 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:38.806103 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-173be4bb-2e3e-4604-b067-9ca899960fd4 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3d5a6713246f0a856575bc7581a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882834930374e3093f7a2de25c55d09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:26:38.814402 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-173be4bb-2e3e-4604-b067-9ca899960fd4 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] 10.222.0.13 "GET /compute/v2.1/servers/bb9fd8ed-4283-4c7c-994b-7b5dc83855ed" status: 200 len: 1510 microversion: 2.1 time: 0.154278 Oct 30 02:26:38.814992 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3946/7558] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:26:38 2022] GET /compute/v2.1/servers/bb9fd8ed-4283-4c7c-994b-7b5dc83855ed => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:26:39.464253 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-3da753d7-b23c-4a33-a440-ca325243e10e req-3a0fe92f-ec20-4af9-8f1e-0680a70b2fdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb9fd8ed-4283-4c7c-994b-7b5dc83855ed", "name": "network-vif-deleted", "tag": "42320afe-f361-483a-88e3-a3304955797c"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:26:39.479475 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-3da753d7-b23c-4a33-a440-ca325243e10e req-3a0fe92f-ec20-4af9-8f1e-0680a70b2fdb service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:39.481328 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-3da753d7-b23c-4a33-a440-ca325243e10e req-3a0fe92f-ec20-4af9-8f1e-0680a70b2fdb service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:39.481788 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-3da753d7-b23c-4a33-a440-ca325243e10e req-3a0fe92f-ec20-4af9-8f1e-0680a70b2fdb service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:39.494948 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-3da753d7-b23c-4a33-a440-ca325243e10e req-3a0fe92f-ec20-4af9-8f1e-0680a70b2fdb service nova] Creating event network-vif-deleted:42320afe-f361-483a-88e3-a3304955797c for instance bb9fd8ed-4283-4c7c-994b-7b5dc83855ed on n-h1-master-1 Oct 30 02:26:39.501917 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-3da753d7-b23c-4a33-a440-ca325243e10e req-3a0fe92f-ec20-4af9-8f1e-0680a70b2fdb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041236 Oct 30 02:26:39.502645 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3613/7559] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:26:39.838243 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-529b20b5-d7f3-407c-8a46-39195291bddd tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:26:39.838815 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-529b20b5-d7f3-407c-8a46-39195291bddd tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] [instance: bb9fd8ed-4283-4c7c-994b-7b5dc83855ed] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:26:39.846524 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-529b20b5-d7f3-407c-8a46-39195291bddd tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:39.851849 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-529b20b5-d7f3-407c-8a46-39195291bddd tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:39.851849 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-529b20b5-d7f3-407c-8a46-39195291bddd tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:39.851849 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-529b20b5-d7f3-407c-8a46-39195291bddd tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:39.851849 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-529b20b5-d7f3-407c-8a46-39195291bddd tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:39.851849 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-529b20b5-d7f3-407c-8a46-39195291bddd tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:39.880845 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-529b20b5-d7f3-407c-8a46-39195291bddd tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:39.881388 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-529b20b5-d7f3-407c-8a46-39195291bddd tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:39.881820 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-529b20b5-d7f3-407c-8a46-39195291bddd tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:39.882284 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-529b20b5-d7f3-407c-8a46-39195291bddd tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lazy-loading 'fault' on Instance uuid bb9fd8ed-4283-4c7c-994b-7b5dc83855ed {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 02:26:39.924849 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-529b20b5-d7f3-407c-8a46-39195291bddd tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3d5a6713246f0a856575bc7581a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882834930374e3093f7a2de25c55d09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:26:39.932814 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-529b20b5-d7f3-407c-8a46-39195291bddd tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] 10.222.0.13 "GET /compute/v2.1/servers/bb9fd8ed-4283-4c7c-994b-7b5dc83855ed" status: 200 len: 1305 microversion: 2.1 time: 0.098784 Oct 30 02:26:39.933499 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3947/7560] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:26:39 2022] GET /compute/v2.1/servers/bb9fd8ed-4283-4c7c-994b-7b5dc83855ed => generated 1305 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:26:40.955774 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-795ef0c3-20ea-4ce2-b216-67652d244a76 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:26:40.956478 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-795ef0c3-20ea-4ce2-b216-67652d244a76 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] [instance: bb9fd8ed-4283-4c7c-994b-7b5dc83855ed] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:26:40.963577 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-795ef0c3-20ea-4ce2-b216-67652d244a76 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:40.964057 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-795ef0c3-20ea-4ce2-b216-67652d244a76 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:40.964487 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-795ef0c3-20ea-4ce2-b216-67652d244a76 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:40.965726 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-795ef0c3-20ea-4ce2-b216-67652d244a76 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:40.966178 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-795ef0c3-20ea-4ce2-b216-67652d244a76 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:40.966598 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-795ef0c3-20ea-4ce2-b216-67652d244a76 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:40.979598 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-795ef0c3-20ea-4ce2-b216-67652d244a76 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] HTTP exception thrown: Instance bb9fd8ed-4283-4c7c-994b-7b5dc83855ed could not be found. Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-795ef0c3-20ea-4ce2-b216-67652d244a76 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Request method failure captured: Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/bb9fd8ed-4283-4c7c-994b-7b5dc83855ed HTTP/1.1 Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXeDEm-fCi3wQ7uAFYG_2IMcAwt9F7G_6idScrMwNW2UHUVnUO9ETg3uMfze98mT3_GKCKZcNYi_8b0I_VNLTX4qLuBQByleOBTmBLyzsiOETEZGExkwR_C9YxHmHGezWXMWAFEgnd9qE5RKy3gUWlKtI8sj1p79tCyaSGCYA7oOmpb4 Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 4882834930374e3093f7a2de25c55d09 Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersNegativeTestJSON-1276370252 Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4882834930374e3093f7a2de25c55d09"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4882834930374e3093f7a2de25c55d09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4882834930374e3093f7a2de25c55d09"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4882834930374e3093f7a2de25c55d09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersNegativeTestJSON-1276370252 Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 4882834930374e3093f7a2de25c55d09 Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1276370252 Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersNegativeTestJSON-1276370252-project Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: e0c3d5a6713246f0a856575bc7581a79 Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersNegativeTestJSON-1276370252-project Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: exception: Instance bb9fd8ed-4283-4c7c-994b-7b5dc83855ed could not be found. Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'bb9fd8ed-4283-4c7c-994b-7b5dc83855ed'} Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb9fd8ed-4283-4c7c-994b-7b5dc83855ed could not be found. Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb9fd8ed-4283-4c7c-994b-7b5dc83855ed could not be found. Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:26:40.982228 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:26:40.987357 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:26:40.987357 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:26:40.987357 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:26:40.987357 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:26:40.987357 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:26:40.987357 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb9fd8ed-4283-4c7c-994b-7b5dc83855ed could not be found. Oct 30 02:26:40.987357 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:26:40.987357 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-795ef0c3-20ea-4ce2-b216-67652d244a76 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Returning 404 to user: Instance bb9fd8ed-4283-4c7c-994b-7b5dc83855ed could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:26:40.987357 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-795ef0c3-20ea-4ce2-b216-67652d244a76 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] 10.222.0.13 "GET /compute/v2.1/servers/bb9fd8ed-4283-4c7c-994b-7b5dc83855ed" status: 404 len: 111 microversion: 2.1 time: 0.032123 Oct 30 02:26:40.987357 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3614/7561] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:26:40 2022] GET /compute/v2.1/servers/bb9fd8ed-4283-4c7c-994b-7b5dc83855ed => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 02:26:40.992700 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3ff8a225-362a-4ea8-8925-b44f7ad542de tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:26:40.993355 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3ff8a225-362a-4ea8-8925-b44f7ad542de tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] [instance: 5760feea-bfc9-4a1e-ac85-c5d54582289a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:26:40.999684 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3ff8a225-362a-4ea8-8925-b44f7ad542de tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:41.000185 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3ff8a225-362a-4ea8-8925-b44f7ad542de tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:41.000638 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3ff8a225-362a-4ea8-8925-b44f7ad542de tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:41.001368 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3ff8a225-362a-4ea8-8925-b44f7ad542de tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:41.001839 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3ff8a225-362a-4ea8-8925-b44f7ad542de tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:41.002284 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3ff8a225-362a-4ea8-8925-b44f7ad542de tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:41.130000 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3ff8a225-362a-4ea8-8925-b44f7ad542de tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3d5a6713246f0a856575bc7581a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882834930374e3093f7a2de25c55d09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:26:41.137948 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3ff8a225-362a-4ea8-8925-b44f7ad542de tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] 10.222.0.13 "GET /compute/v2.1/servers/5760feea-bfc9-4a1e-ac85-c5d54582289a" status: 200 len: 1506 microversion: 2.1 time: 0.149199 Oct 30 02:26:41.138526 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3948/7562] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:26:40 2022] GET /compute/v2.1/servers/5760feea-bfc9-4a1e-ac85-c5d54582289a => generated 1506 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:26:41.160520 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-063e4ac0-c69a-49cb-8f5b-c725c8f5f1c6 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:26:41.162869 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-063e4ac0-c69a-49cb-8f5b-c725c8f5f1c6 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] [instance: 67728ba9-e2bb-4a6f-a82b-156ccbc82391] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:26:41.168920 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-063e4ac0-c69a-49cb-8f5b-c725c8f5f1c6 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] HTTP exception thrown: Instance 67728ba9-e2bb-4a6f-a82b-156ccbc82391 could not be found. Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-063e4ac0-c69a-49cb-8f5b-c725c8f5f1c6 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Request method failure captured: Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: request: POST /compute/v2.1/servers/67728ba9-e2bb-4a6f-a82b-156ccbc82391/action HTTP/1.1 Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 32 Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXeDEm-fCi3wQ7uAFYG_2IMcAwt9F7G_6idScrMwNW2UHUVnUO9ETg3uMfze98mT3_GKCKZcNYi_8b0I_VNLTX4qLuBQByleOBTmBLyzsiOETEZGExkwR_C9YxHmHGezWXMWAFEgnd9qE5RKy3gUWlKtI8sj1p79tCyaSGCYA7oOmpb4 Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 4882834930374e3093f7a2de25c55d09 Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersNegativeTestJSON-1276370252 Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4882834930374e3093f7a2de25c55d09"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4882834930374e3093f7a2de25c55d09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4882834930374e3093f7a2de25c55d09"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4882834930374e3093f7a2de25c55d09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersNegativeTestJSON-1276370252 Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 4882834930374e3093f7a2de25c55d09 Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1276370252 Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersNegativeTestJSON-1276370252-project Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: e0c3d5a6713246f0a856575bc7581a79 Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersNegativeTestJSON-1276370252-project Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: {"resize": {"flavorRef": "452"}} Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 67728ba9-e2bb-4a6f-a82b-156ccbc82391 could not be found. Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '67728ba9-e2bb-4a6f-a82b-156ccbc82391', 'body': {'resize': {'flavorRef': '452'}}} Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67728ba9-e2bb-4a6f-a82b-156ccbc82391 could not be found. Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 02:26:41.170540 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 02:26:41.176043 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67728ba9-e2bb-4a6f-a82b-156ccbc82391 could not be found. Oct 30 02:26:41.176043 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:26:41.176043 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:26:41.176043 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:26:41.176043 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:26:41.176043 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:26:41.176043 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:26:41.176043 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:26:41.176043 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:26:41.176043 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67728ba9-e2bb-4a6f-a82b-156ccbc82391 could not be found. Oct 30 02:26:41.176043 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:26:41.176043 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-063e4ac0-c69a-49cb-8f5b-c725c8f5f1c6 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Returning 404 to user: Instance 67728ba9-e2bb-4a6f-a82b-156ccbc82391 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:26:41.176043 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-063e4ac0-c69a-49cb-8f5b-c725c8f5f1c6 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] 10.222.0.13 "POST /compute/v2.1/servers/67728ba9-e2bb-4a6f-a82b-156ccbc82391/action" status: 404 len: 111 microversion: 2.1 time: 0.015470 Oct 30 02:26:41.176043 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3615/7563] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 02:26:41 2022] POST /compute/v2.1/servers/67728ba9-e2bb-4a6f-a82b-156ccbc82391/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 02:26:41.180859 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a54a9a94-ed47-4ba9-a65d-ec62eda47cdb tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:26:41.181528 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a54a9a94-ed47-4ba9-a65d-ec62eda47cdb tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] [instance: 5760feea-bfc9-4a1e-ac85-c5d54582289a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:26:41.187687 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a54a9a94-ed47-4ba9-a65d-ec62eda47cdb tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:41.195088 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a54a9a94-ed47-4ba9-a65d-ec62eda47cdb tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:41.195088 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a54a9a94-ed47-4ba9-a65d-ec62eda47cdb tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:41.195088 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a54a9a94-ed47-4ba9-a65d-ec62eda47cdb tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:41.195088 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a54a9a94-ed47-4ba9-a65d-ec62eda47cdb tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:41.195088 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a54a9a94-ed47-4ba9-a65d-ec62eda47cdb tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:41.321220 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a54a9a94-ed47-4ba9-a65d-ec62eda47cdb tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3d5a6713246f0a856575bc7581a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882834930374e3093f7a2de25c55d09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:26:41.324815 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:26:41.329500 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a54a9a94-ed47-4ba9-a65d-ec62eda47cdb tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] 10.222.0.13 "GET /compute/v2.1/servers/5760feea-bfc9-4a1e-ac85-c5d54582289a" status: 200 len: 1506 microversion: 2.1 time: 0.152539 Oct 30 02:26:41.330077 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3949/7564] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:26:41 2022] GET /compute/v2.1/servers/5760feea-bfc9-4a1e-ac85-c5d54582289a => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:26:41.352511 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d04feb84-6e09-41a2-a245-4e9b0d2f0232 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:26:41.353124 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d04feb84-6e09-41a2-a245-4e9b0d2f0232 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] [instance: 5760feea-bfc9-4a1e-ac85-c5d54582289a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:26:41.360489 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d04feb84-6e09-41a2-a245-4e9b0d2f0232 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:41.360974 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d04feb84-6e09-41a2-a245-4e9b0d2f0232 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:41.361448 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d04feb84-6e09-41a2-a245-4e9b0d2f0232 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:41.362147 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d04feb84-6e09-41a2-a245-4e9b0d2f0232 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:41.362603 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d04feb84-6e09-41a2-a245-4e9b0d2f0232 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:41.363030 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d04feb84-6e09-41a2-a245-4e9b0d2f0232 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:41.488256 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d04feb84-6e09-41a2-a245-4e9b0d2f0232 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3d5a6713246f0a856575bc7581a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882834930374e3093f7a2de25c55d09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:26:41.496062 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d04feb84-6e09-41a2-a245-4e9b0d2f0232 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] 10.222.0.13 "GET /compute/v2.1/servers/5760feea-bfc9-4a1e-ac85-c5d54582289a" status: 200 len: 1506 microversion: 2.1 time: 0.147391 Oct 30 02:26:41.496632 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3616/7565] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:26:41 2022] GET /compute/v2.1/servers/5760feea-bfc9-4a1e-ac85-c5d54582289a => generated 1506 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:26:41.518129 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e3571388-1c3b-461d-861d-21747579d50a tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "ad01f919-f3b9-469c-86e1-76a8f5446687"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:26:41.520454 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e3571388-1c3b-461d-861d-21747579d50a tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] [instance: 5760feea-bfc9-4a1e-ac85-c5d54582289a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:26:41.527348 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e3571388-1c3b-461d-861d-21747579d50a tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:41.527843 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e3571388-1c3b-461d-861d-21747579d50a tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:41.528291 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e3571388-1c3b-461d-861d-21747579d50a tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:41.529550 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e3571388-1c3b-461d-861d-21747579d50a tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:41.530068 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e3571388-1c3b-461d-861d-21747579d50a tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:41.530501 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e3571388-1c3b-461d-861d-21747579d50a tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:41.617048 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e3571388-1c3b-461d-861d-21747579d50a tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e0c3d5a6713246f0a856575bc7581a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882834930374e3093f7a2de25c55d09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:26:41.622385 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-e3571388-1c3b-461d-861d-21747579d50a tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] HTTP exception thrown: Flavor ad01f919-f3b9-469c-86e1-76a8f5446687 could not be found. Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e3571388-1c3b-461d-861d-21747579d50a tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Request method failure captured: Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: request: POST /compute/v2.1/servers/5760feea-bfc9-4a1e-ac85-c5d54582289a/action HTTP/1.1 Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 65 Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXeDEm-fCi3wQ7uAFYG_2IMcAwt9F7G_6idScrMwNW2UHUVnUO9ETg3uMfze98mT3_GKCKZcNYi_8b0I_VNLTX4qLuBQByleOBTmBLyzsiOETEZGExkwR_C9YxHmHGezWXMWAFEgnd9qE5RKy3gUWlKtI8sj1p79tCyaSGCYA7oOmpb4 Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 4882834930374e3093f7a2de25c55d09 Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServersNegativeTestJSON-1276370252 Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4882834930374e3093f7a2de25c55d09"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4882834930374e3093f7a2de25c55d09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4882834930374e3093f7a2de25c55d09"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4882834930374e3093f7a2de25c55d09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServersNegativeTestJSON-1276370252 Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 4882834930374e3093f7a2de25c55d09 Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1276370252 Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServersNegativeTestJSON-1276370252-project Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: e0c3d5a6713246f0a856575bc7581a79 Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServersNegativeTestJSON-1276370252-project Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: {"resize": {"flavorRef": "ad01f919-f3b9-469c-86e1-76a8f5446687"}} Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: exception: Flavor ad01f919-f3b9-469c-86e1-76a8f5446687 could not be found. Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '5760feea-bfc9-4a1e-ac85-c5d54582289a', 'body': {'resize': {'flavorRef': 'ad01f919-f3b9-469c-86e1-76a8f5446687'}}} Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:26:41.624383 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 30 02:26:41.629258 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 30 02:26:41.629258 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor ad01f919-f3b9-469c-86e1-76a8f5446687 could not be found. Oct 30 02:26:41.629258 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:26:41.629258 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:26:41.629258 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:26:41.629258 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:26:41.629258 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:26:41.629258 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:26:41.629258 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:26:41.629258 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:26:41.629258 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:26:41.629258 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:26:41.629258 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 02:26:41.629258 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 02:26:41.629258 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 30 02:26:41.629258 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 30 02:26:41.629258 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 30 02:26:41.629258 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 30 02:26:41.629258 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor ad01f919-f3b9-469c-86e1-76a8f5446687 could not be found. Oct 30 02:26:41.629258 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:26:41.629258 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:26:41.629258 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:26:41.629258 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:26:41.629258 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:26:41.629258 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:26:41.629258 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:26:41.629258 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:26:41.629258 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor ad01f919-f3b9-469c-86e1-76a8f5446687 could not be found. Oct 30 02:26:41.629258 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:26:41.629258 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e3571388-1c3b-461d-861d-21747579d50a tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Returning 400 to user: Flavor ad01f919-f3b9-469c-86e1-76a8f5446687 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:26:41.629258 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e3571388-1c3b-461d-861d-21747579d50a tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] 10.222.0.13 "POST /compute/v2.1/servers/5760feea-bfc9-4a1e-ac85-c5d54582289a/action" status: 400 len: 107 microversion: 2.1 time: 0.111711 Oct 30 02:26:41.629258 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3950/7566] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 02:26:41 2022] POST /compute/v2.1/servers/5760feea-bfc9-4a1e-ac85-c5d54582289a/action => generated 107 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 30 02:26:41.634420 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-30079c0f-bfa7-4121-bbbf-b1831fb64ca8 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:26:41.635040 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-30079c0f-bfa7-4121-bbbf-b1831fb64ca8 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] [instance: 5760feea-bfc9-4a1e-ac85-c5d54582289a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:26:41.641642 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-30079c0f-bfa7-4121-bbbf-b1831fb64ca8 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:41.642119 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-30079c0f-bfa7-4121-bbbf-b1831fb64ca8 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:41.642551 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-30079c0f-bfa7-4121-bbbf-b1831fb64ca8 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:41.643231 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-30079c0f-bfa7-4121-bbbf-b1831fb64ca8 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:41.643681 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-30079c0f-bfa7-4121-bbbf-b1831fb64ca8 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:41.644100 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-30079c0f-bfa7-4121-bbbf-b1831fb64ca8 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:41.775022 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-30079c0f-bfa7-4121-bbbf-b1831fb64ca8 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3d5a6713246f0a856575bc7581a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882834930374e3093f7a2de25c55d09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:26:41.783274 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-30079c0f-bfa7-4121-bbbf-b1831fb64ca8 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] 10.222.0.13 "GET /compute/v2.1/servers/5760feea-bfc9-4a1e-ac85-c5d54582289a" status: 200 len: 1506 microversion: 2.1 time: 0.152557 Oct 30 02:26:41.783860 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3617/7567] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:26:41 2022] GET /compute/v2.1/servers/5760feea-bfc9-4a1e-ac85-c5d54582289a => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:26:41.806747 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-84078fee-600f-4534-bcfc-47ef2a92fe6e tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:26:41.807378 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-84078fee-600f-4534-bcfc-47ef2a92fe6e tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] [instance: 5760feea-bfc9-4a1e-ac85-c5d54582289a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:26:41.813389 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-84078fee-600f-4534-bcfc-47ef2a92fe6e tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:41.813882 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-84078fee-600f-4534-bcfc-47ef2a92fe6e tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:41.814325 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-84078fee-600f-4534-bcfc-47ef2a92fe6e tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:41.815021 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-84078fee-600f-4534-bcfc-47ef2a92fe6e tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:41.815479 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-84078fee-600f-4534-bcfc-47ef2a92fe6e tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:41.815908 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-84078fee-600f-4534-bcfc-47ef2a92fe6e tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:41.945636 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-84078fee-600f-4534-bcfc-47ef2a92fe6e tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3d5a6713246f0a856575bc7581a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882834930374e3093f7a2de25c55d09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:26:41.953994 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-84078fee-600f-4534-bcfc-47ef2a92fe6e tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] 10.222.0.13 "GET /compute/v2.1/servers/5760feea-bfc9-4a1e-ac85-c5d54582289a" status: 200 len: 1506 microversion: 2.1 time: 0.151181 Oct 30 02:26:41.954569 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3951/7568] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:26:41 2022] GET /compute/v2.1/servers/5760feea-bfc9-4a1e-ac85-c5d54582289a => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:26:41.977165 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e51e8d15-071b-4127-b9a6-f0fe6088404a tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e51e8d15-071b-4127-b9a6-f0fe6088404a tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Request method failure captured: Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: request: POST /compute/v2.1/servers/5760feea-bfc9-4a1e-ac85-c5d54582289a/action HTTP/1.1 Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 29 Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXeDEm-fCi3wQ7uAFYG_2IMcAwt9F7G_6idScrMwNW2UHUVnUO9ETg3uMfze98mT3_GKCKZcNYi_8b0I_VNLTX4qLuBQByleOBTmBLyzsiOETEZGExkwR_C9YxHmHGezWXMWAFEgnd9qE5RKy3gUWlKtI8sj1p79tCyaSGCYA7oOmpb4 Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 4882834930374e3093f7a2de25c55d09 Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersNegativeTestJSON-1276370252 Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4882834930374e3093f7a2de25c55d09"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4882834930374e3093f7a2de25c55d09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4882834930374e3093f7a2de25c55d09"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4882834930374e3093f7a2de25c55d09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersNegativeTestJSON-1276370252 Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 4882834930374e3093f7a2de25c55d09 Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1276370252 Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersNegativeTestJSON-1276370252-project Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: e0c3d5a6713246f0a856575bc7581a79 Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersNegativeTestJSON-1276370252-project Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: {"resize": {"flavorRef": ""}} Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '5760feea-bfc9-4a1e-ac85-c5d54582289a', 'body': {'resize': {'flavorRef': ''}}} Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise error Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi '' Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:26:41.980650 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:26:41.986015 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:26:41.986015 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:26:41.986015 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:26:41.986015 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:26:41.986015 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 30 02:26:41.986015 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 30 02:26:41.986015 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 30 02:26:41.986015 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:26:41.986015 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e51e8d15-071b-4127-b9a6-f0fe6088404a tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:26:41.986015 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e51e8d15-071b-4127-b9a6-f0fe6088404a tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] 10.222.0.13 "POST /compute/v2.1/servers/5760feea-bfc9-4a1e-ac85-c5d54582289a/action" status: 400 len: 113 microversion: 2.1 time: 0.009000 Oct 30 02:26:41.986015 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3618/7569] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 02:26:41 2022] POST /compute/v2.1/servers/5760feea-bfc9-4a1e-ac85-c5d54582289a/action => generated 113 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 30 02:26:41.990594 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9e3ab497-b489-4578-b72c-6ce19b1eba28 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:26:41.991221 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9e3ab497-b489-4578-b72c-6ce19b1eba28 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] [instance: 5760feea-bfc9-4a1e-ac85-c5d54582289a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:26:41.998487 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9e3ab497-b489-4578-b72c-6ce19b1eba28 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:41.999098 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9e3ab497-b489-4578-b72c-6ce19b1eba28 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:41.999406 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9e3ab497-b489-4578-b72c-6ce19b1eba28 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:42.000106 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9e3ab497-b489-4578-b72c-6ce19b1eba28 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:42.000569 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9e3ab497-b489-4578-b72c-6ce19b1eba28 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:42.001005 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9e3ab497-b489-4578-b72c-6ce19b1eba28 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:42.128743 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9e3ab497-b489-4578-b72c-6ce19b1eba28 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3d5a6713246f0a856575bc7581a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882834930374e3093f7a2de25c55d09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:26:42.136791 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9e3ab497-b489-4578-b72c-6ce19b1eba28 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] 10.222.0.13 "GET /compute/v2.1/servers/5760feea-bfc9-4a1e-ac85-c5d54582289a" status: 200 len: 1506 microversion: 2.1 time: 0.149976 Oct 30 02:26:42.137376 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3952/7570] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:26:41 2022] GET /compute/v2.1/servers/5760feea-bfc9-4a1e-ac85-c5d54582289a => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:26:42.163454 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bd925d07-552a-42c1-8083-7ce5ff852237 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:26:42.163946 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-bd925d07-552a-42c1-8083-7ce5ff852237 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] [instance: bb9fd8ed-4283-4c7c-994b-7b5dc83855ed] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:26:42.171046 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd925d07-552a-42c1-8083-7ce5ff852237 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:42.171524 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd925d07-552a-42c1-8083-7ce5ff852237 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:42.171958 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd925d07-552a-42c1-8083-7ce5ff852237 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:42.172902 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd925d07-552a-42c1-8083-7ce5ff852237 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:42.173367 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd925d07-552a-42c1-8083-7ce5ff852237 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:42.173795 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd925d07-552a-42c1-8083-7ce5ff852237 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:42.187216 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-bd925d07-552a-42c1-8083-7ce5ff852237 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] HTTP exception thrown: Instance bb9fd8ed-4283-4c7c-994b-7b5dc83855ed could not be found. Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bd925d07-552a-42c1-8083-7ce5ff852237 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Request method failure captured: Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: request: DELETE /compute/v2.1/servers/bb9fd8ed-4283-4c7c-994b-7b5dc83855ed HTTP/1.1 Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXeDEm-fCi3wQ7uAFYG_2IMcAwt9F7G_6idScrMwNW2UHUVnUO9ETg3uMfze98mT3_GKCKZcNYi_8b0I_VNLTX4qLuBQByleOBTmBLyzsiOETEZGExkwR_C9YxHmHGezWXMWAFEgnd9qE5RKy3gUWlKtI8sj1p79tCyaSGCYA7oOmpb4 Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 4882834930374e3093f7a2de25c55d09 Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-ServersNegativeTestJSON-1276370252 Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4882834930374e3093f7a2de25c55d09"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4882834930374e3093f7a2de25c55d09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4882834930374e3093f7a2de25c55d09"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4882834930374e3093f7a2de25c55d09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-ServersNegativeTestJSON-1276370252 Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 4882834930374e3093f7a2de25c55d09 Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1276370252 Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-ServersNegativeTestJSON-1276370252-project Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: e0c3d5a6713246f0a856575bc7581a79 Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-ServersNegativeTestJSON-1276370252-project Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: exception: Instance bb9fd8ed-4283-4c7c-994b-7b5dc83855ed could not be found. Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'bb9fd8ed-4283-4c7c-994b-7b5dc83855ed'} Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb9fd8ed-4283-4c7c-994b-7b5dc83855ed could not be found. Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 02:26:42.189720 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 02:26:42.193896 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb9fd8ed-4283-4c7c-994b-7b5dc83855ed could not be found. Oct 30 02:26:42.193896 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:26:42.193896 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:26:42.193896 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:26:42.193896 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:26:42.193896 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:26:42.193896 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:26:42.193896 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:26:42.193896 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:26:42.193896 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb9fd8ed-4283-4c7c-994b-7b5dc83855ed could not be found. Oct 30 02:26:42.193896 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:26:42.193896 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bd925d07-552a-42c1-8083-7ce5ff852237 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Returning 404 to user: Instance bb9fd8ed-4283-4c7c-994b-7b5dc83855ed could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:26:42.193896 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bd925d07-552a-42c1-8083-7ce5ff852237 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] 10.222.0.13 "DELETE /compute/v2.1/servers/bb9fd8ed-4283-4c7c-994b-7b5dc83855ed" status: 404 len: 111 microversion: 2.1 time: 0.031507 Oct 30 02:26:42.193896 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3619/7571] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 02:26:42 2022] DELETE /compute/v2.1/servers/bb9fd8ed-4283-4c7c-994b-7b5dc83855ed => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 02:26:42.198744 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8b8dd28b-a1f8-45e0-a37e-7292793cd776 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:26:42.199378 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8b8dd28b-a1f8-45e0-a37e-7292793cd776 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] [instance: bb9fd8ed-4283-4c7c-994b-7b5dc83855ed] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:26:42.206067 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b8dd28b-a1f8-45e0-a37e-7292793cd776 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:42.206566 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b8dd28b-a1f8-45e0-a37e-7292793cd776 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:42.207017 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b8dd28b-a1f8-45e0-a37e-7292793cd776 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:42.207787 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b8dd28b-a1f8-45e0-a37e-7292793cd776 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:42.208252 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b8dd28b-a1f8-45e0-a37e-7292793cd776 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:42.208696 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b8dd28b-a1f8-45e0-a37e-7292793cd776 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:42.224382 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-8b8dd28b-a1f8-45e0-a37e-7292793cd776 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] HTTP exception thrown: Instance bb9fd8ed-4283-4c7c-994b-7b5dc83855ed could not be found. Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8b8dd28b-a1f8-45e0-a37e-7292793cd776 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Request method failure captured: Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/bb9fd8ed-4283-4c7c-994b-7b5dc83855ed HTTP/1.1 Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXeDEm-fCi3wQ7uAFYG_2IMcAwt9F7G_6idScrMwNW2UHUVnUO9ETg3uMfze98mT3_GKCKZcNYi_8b0I_VNLTX4qLuBQByleOBTmBLyzsiOETEZGExkwR_C9YxHmHGezWXMWAFEgnd9qE5RKy3gUWlKtI8sj1p79tCyaSGCYA7oOmpb4 Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 4882834930374e3093f7a2de25c55d09 Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServersNegativeTestJSON-1276370252 Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4882834930374e3093f7a2de25c55d09"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4882834930374e3093f7a2de25c55d09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4882834930374e3093f7a2de25c55d09"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4882834930374e3093f7a2de25c55d09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServersNegativeTestJSON-1276370252 Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 4882834930374e3093f7a2de25c55d09 Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1276370252 Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServersNegativeTestJSON-1276370252-project Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: e0c3d5a6713246f0a856575bc7581a79 Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServersNegativeTestJSON-1276370252-project Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: exception: Instance bb9fd8ed-4283-4c7c-994b-7b5dc83855ed could not be found. Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'bb9fd8ed-4283-4c7c-994b-7b5dc83855ed'} Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb9fd8ed-4283-4c7c-994b-7b5dc83855ed could not be found. Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb9fd8ed-4283-4c7c-994b-7b5dc83855ed could not be found. Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:26:42.226036 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:26:42.230468 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:26:42.230468 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:26:42.230468 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:26:42.230468 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:26:42.230468 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:26:42.230468 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb9fd8ed-4283-4c7c-994b-7b5dc83855ed could not be found. Oct 30 02:26:42.230468 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:26:42.230468 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8b8dd28b-a1f8-45e0-a37e-7292793cd776 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Returning 404 to user: Instance bb9fd8ed-4283-4c7c-994b-7b5dc83855ed could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:26:42.230468 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8b8dd28b-a1f8-45e0-a37e-7292793cd776 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] 10.222.0.13 "GET /compute/v2.1/servers/bb9fd8ed-4283-4c7c-994b-7b5dc83855ed" status: 404 len: 111 microversion: 2.1 time: 0.032673 Oct 30 02:26:42.230468 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3953/7572] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:26:42 2022] GET /compute/v2.1/servers/bb9fd8ed-4283-4c7c-994b-7b5dc83855ed => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 02:26:42.236127 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5757a075-ad42-4101-9770-aaf025b36bd7 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:26:42.236632 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5757a075-ad42-4101-9770-aaf025b36bd7 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] [instance: 5760feea-bfc9-4a1e-ac85-c5d54582289a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:26:42.238662 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=6 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:26:42.243678 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5757a075-ad42-4101-9770-aaf025b36bd7 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:42.244163 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5757a075-ad42-4101-9770-aaf025b36bd7 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:42.244601 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5757a075-ad42-4101-9770-aaf025b36bd7 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:42.245295 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5757a075-ad42-4101-9770-aaf025b36bd7 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:42.245778 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5757a075-ad42-4101-9770-aaf025b36bd7 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:42.253314 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5757a075-ad42-4101-9770-aaf025b36bd7 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:42.253314 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=93 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:26:42.273171 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5757a075-ad42-4101-9770-aaf025b36bd7 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] [instance: 5760feea-bfc9-4a1e-ac85-c5d54582289a] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 02:26:42.558965 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5757a075-ad42-4101-9770-aaf025b36bd7 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5760feea-bfc9-4a1e-ac85-c5d54582289a" status: 204 len: 0 microversion: 2.1 time: 0.326365 Oct 30 02:26:42.559514 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3620/7573] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 02:26:42 2022] DELETE /compute/v2.1/servers/5760feea-bfc9-4a1e-ac85-c5d54582289a => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 02:26:42.568366 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-41fb4160-bfce-4b87-9ec2-efa95c8f7517 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:26:42.568998 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-41fb4160-bfce-4b87-9ec2-efa95c8f7517 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] [instance: 5760feea-bfc9-4a1e-ac85-c5d54582289a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:26:42.575139 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-41fb4160-bfce-4b87-9ec2-efa95c8f7517 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:42.575645 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-41fb4160-bfce-4b87-9ec2-efa95c8f7517 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:42.576096 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-41fb4160-bfce-4b87-9ec2-efa95c8f7517 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:42.576808 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-41fb4160-bfce-4b87-9ec2-efa95c8f7517 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:42.577279 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-41fb4160-bfce-4b87-9ec2-efa95c8f7517 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:42.577749 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-41fb4160-bfce-4b87-9ec2-efa95c8f7517 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:42.710395 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-41fb4160-bfce-4b87-9ec2-efa95c8f7517 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3d5a6713246f0a856575bc7581a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882834930374e3093f7a2de25c55d09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:26:42.718881 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-41fb4160-bfce-4b87-9ec2-efa95c8f7517 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] 10.222.0.13 "GET /compute/v2.1/servers/5760feea-bfc9-4a1e-ac85-c5d54582289a" status: 200 len: 1512 microversion: 2.1 time: 0.154600 Oct 30 02:26:42.719446 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3954/7574] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:26:42 2022] GET /compute/v2.1/servers/5760feea-bfc9-4a1e-ac85-c5d54582289a => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:26:43.743115 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b628d2ae-a530-47a1-b981-535220b5de6d tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:26:43.743823 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b628d2ae-a530-47a1-b981-535220b5de6d tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] [instance: 5760feea-bfc9-4a1e-ac85-c5d54582289a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:26:43.751238 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b628d2ae-a530-47a1-b981-535220b5de6d tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:43.751718 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b628d2ae-a530-47a1-b981-535220b5de6d tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:43.752152 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b628d2ae-a530-47a1-b981-535220b5de6d tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:43.752844 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b628d2ae-a530-47a1-b981-535220b5de6d tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:43.753304 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b628d2ae-a530-47a1-b981-535220b5de6d tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:43.753754 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b628d2ae-a530-47a1-b981-535220b5de6d tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:43.882557 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b628d2ae-a530-47a1-b981-535220b5de6d tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3d5a6713246f0a856575bc7581a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882834930374e3093f7a2de25c55d09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:26:43.890471 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b628d2ae-a530-47a1-b981-535220b5de6d tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] 10.222.0.13 "GET /compute/v2.1/servers/5760feea-bfc9-4a1e-ac85-c5d54582289a" status: 200 len: 1512 microversion: 2.1 time: 0.151689 Oct 30 02:26:43.891041 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3621/7575] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:26:43 2022] GET /compute/v2.1/servers/5760feea-bfc9-4a1e-ac85-c5d54582289a => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:26:44.596804 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-f419fbee-3470-46a4-b0be-546195936f33 req-4144f511-e2a0-401c-9be2-c31b106978df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5760feea-bfc9-4a1e-ac85-c5d54582289a", "name": "network-vif-deleted", "tag": "e2b26326-7e64-41ce-99f5-ca120ca2e4c2"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:26:44.608844 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-f419fbee-3470-46a4-b0be-546195936f33 req-4144f511-e2a0-401c-9be2-c31b106978df service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:44.609354 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-f419fbee-3470-46a4-b0be-546195936f33 req-4144f511-e2a0-401c-9be2-c31b106978df service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:44.609820 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-f419fbee-3470-46a4-b0be-546195936f33 req-4144f511-e2a0-401c-9be2-c31b106978df service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:44.623185 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-f419fbee-3470-46a4-b0be-546195936f33 req-4144f511-e2a0-401c-9be2-c31b106978df service nova] Creating event network-vif-deleted:e2b26326-7e64-41ce-99f5-ca120ca2e4c2 for instance 5760feea-bfc9-4a1e-ac85-c5d54582289a on n-h2-master-1 Oct 30 02:26:44.628911 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-f419fbee-3470-46a4-b0be-546195936f33 req-4144f511-e2a0-401c-9be2-c31b106978df service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038849 Oct 30 02:26:44.629767 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3955/7576] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:26:44.913486 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-798dd141-9a19-4f66-ac96-bb8c49266972 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:26:44.916672 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-798dd141-9a19-4f66-ac96-bb8c49266972 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] [instance: 5760feea-bfc9-4a1e-ac85-c5d54582289a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:26:44.920759 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-798dd141-9a19-4f66-ac96-bb8c49266972 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:44.921237 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-798dd141-9a19-4f66-ac96-bb8c49266972 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:44.921716 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-798dd141-9a19-4f66-ac96-bb8c49266972 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:44.922655 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-798dd141-9a19-4f66-ac96-bb8c49266972 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:44.923106 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-798dd141-9a19-4f66-ac96-bb8c49266972 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:44.923528 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-798dd141-9a19-4f66-ac96-bb8c49266972 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:44.954700 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-798dd141-9a19-4f66-ac96-bb8c49266972 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:44.955178 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-798dd141-9a19-4f66-ac96-bb8c49266972 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:44.955613 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-798dd141-9a19-4f66-ac96-bb8c49266972 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:44.956062 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-798dd141-9a19-4f66-ac96-bb8c49266972 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lazy-loading 'fault' on Instance uuid 5760feea-bfc9-4a1e-ac85-c5d54582289a {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 02:26:44.997602 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-798dd141-9a19-4f66-ac96-bb8c49266972 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3d5a6713246f0a856575bc7581a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4882834930374e3093f7a2de25c55d09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:26:45.005197 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-798dd141-9a19-4f66-ac96-bb8c49266972 tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] 10.222.0.13 "GET /compute/v2.1/servers/5760feea-bfc9-4a1e-ac85-c5d54582289a" status: 200 len: 1307 microversion: 2.1 time: 0.095703 Oct 30 02:26:45.010456 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3622/7577] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:26:44 2022] GET /compute/v2.1/servers/5760feea-bfc9-4a1e-ac85-c5d54582289a => generated 1307 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:26:46.030192 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-45b65db4-e8f1-4f7a-a612-60df7954baad tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:26:46.030936 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-45b65db4-e8f1-4f7a-a612-60df7954baad tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] [instance: 5760feea-bfc9-4a1e-ac85-c5d54582289a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:26:46.038437 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-45b65db4-e8f1-4f7a-a612-60df7954baad tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:46.038928 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-45b65db4-e8f1-4f7a-a612-60df7954baad tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:46.039372 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-45b65db4-e8f1-4f7a-a612-60df7954baad tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:46.040075 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-45b65db4-e8f1-4f7a-a612-60df7954baad tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:26:46.040535 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-45b65db4-e8f1-4f7a-a612-60df7954baad tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:26:46.040967 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-45b65db4-e8f1-4f7a-a612-60df7954baad tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:26:46.055389 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-45b65db4-e8f1-4f7a-a612-60df7954baad tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] HTTP exception thrown: Instance 5760feea-bfc9-4a1e-ac85-c5d54582289a could not be found. Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-45b65db4-e8f1-4f7a-a612-60df7954baad tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Request method failure captured: Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/5760feea-bfc9-4a1e-ac85-c5d54582289a HTTP/1.1 Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXeDEm-fCi3wQ7uAFYG_2IMcAwt9F7G_6idScrMwNW2UHUVnUO9ETg3uMfze98mT3_GKCKZcNYi_8b0I_VNLTX4qLuBQByleOBTmBLyzsiOETEZGExkwR_C9YxHmHGezWXMWAFEgnd9qE5RKy3gUWlKtI8sj1p79tCyaSGCYA7oOmpb4 Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 4882834930374e3093f7a2de25c55d09 Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-ServersNegativeTestJSON-1276370252 Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4882834930374e3093f7a2de25c55d09"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4882834930374e3093f7a2de25c55d09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4882834930374e3093f7a2de25c55d09"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4882834930374e3093f7a2de25c55d09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-ServersNegativeTestJSON-1276370252 Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 4882834930374e3093f7a2de25c55d09 Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1276370252 Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-ServersNegativeTestJSON-1276370252-project Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: e0c3d5a6713246f0a856575bc7581a79 Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-ServersNegativeTestJSON-1276370252-project Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 5760feea-bfc9-4a1e-ac85-c5d54582289a could not be found. Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '5760feea-bfc9-4a1e-ac85-c5d54582289a'} Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5760feea-bfc9-4a1e-ac85-c5d54582289a could not be found. Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5760feea-bfc9-4a1e-ac85-c5d54582289a could not be found. Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:26:46.057025 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:26:46.061448 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:26:46.061448 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:26:46.061448 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:26:46.061448 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:26:46.061448 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:26:46.061448 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5760feea-bfc9-4a1e-ac85-c5d54582289a could not be found. Oct 30 02:26:46.061448 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:26:46.061448 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-45b65db4-e8f1-4f7a-a612-60df7954baad tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] Returning 404 to user: Instance 5760feea-bfc9-4a1e-ac85-c5d54582289a could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:26:46.061448 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-45b65db4-e8f1-4f7a-a612-60df7954baad tempest-ServersNegativeTestJSON-1276370252 tempest-ServersNegativeTestJSON-1276370252-project] 10.222.0.13 "GET /compute/v2.1/servers/5760feea-bfc9-4a1e-ac85-c5d54582289a" status: 404 len: 111 microversion: 2.1 time: 0.033265 Oct 30 02:26:46.061448 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3956/7578] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:26:46 2022] GET /compute/v2.1/servers/5760feea-bfc9-4a1e-ac85-c5d54582289a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 02:27:28.702175 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:27:28.703056 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:27:28.877130 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-09cfd745-b660-4c59-89f2-0eb1b39e368b tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Action: 'create', calling method: .version_select at 0x7f44c6cd5940>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1004462871", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBbiGzNMCtbYqjHWPohp7GnyNwJluDTwDsADMhNfilb3WsgUpi/Was7jq/mlk+s6lqiJwQ95D3L+QvRynFgW66/1wp6KNtOiDd0aa/AcsBgq9pzovCT9xUYEu/wrfM349Q=="}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:27:28.893664 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-09cfd745-b660-4c59-89f2-0eb1b39e368b tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Getting quotas for project bfd17e8c4aa24960a8b46e4721e2acc7. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 02:27:28.900377 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-09cfd745-b660-4c59-89f2-0eb1b39e368b tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Getting quotas for user 620bbcf5f19d4cfbb8b39de0272870e4 and project bfd17e8c4aa24960a8b46e4721e2acc7. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 02:27:28.996613 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-09cfd745-b660-4c59-89f2-0eb1b39e368b tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.300610 Oct 30 02:27:28.997229 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3623/7579] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 30 02:27:28 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:27:29.047620 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ab858911-fcf1-4dd8-b80b-ee4e34ac3d0c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-147506567", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1004462871", "networks": [{"uuid": "2289005a-70ca-444d-9825-ca9817f8719a"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:27:29.056616 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:27:29.057294 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=28 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:27:29.058341 n-d-master-1 devstack@n-api.service[121102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 30 02:27:29.058491 n-d-master-1 devstack@n-api.service[121102]: Sun Oct 30 02:27:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.13) !!! Oct 30 02:27:29.107724 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-ab858911-fcf1-4dd8-b80b-ee4e34ac3d0c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] validate_networks() for [('2289005a-70ca-444d-9825-ca9817f8719a', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 02:27:29.497495 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-ab858911-fcf1-4dd8-b80b-ee4e34ac3d0c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 02:27:29.497937 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-ab858911-fcf1-4dd8-b80b-ee4e34ac3d0c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 02:27:29.498429 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-ab858911-fcf1-4dd8-b80b-ee4e34ac3d0c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 02:27:29.499433 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-ab858911-fcf1-4dd8-b80b-ee4e34ac3d0c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 02:27:29.499862 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-ab858911-fcf1-4dd8-b80b-ee4e34ac3d0c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 02:27:29.509390 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ab858911-fcf1-4dd8-b80b-ee4e34ac3d0c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:27:29.509883 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ab858911-fcf1-4dd8-b80b-ee4e34ac3d0c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:27:29.510335 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ab858911-fcf1-4dd8-b80b-ee4e34ac3d0c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:27:29.511145 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ab858911-fcf1-4dd8-b80b-ee4e34ac3d0c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:27:29.511869 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ab858911-fcf1-4dd8-b80b-ee4e34ac3d0c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:27:29.512497 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ab858911-fcf1-4dd8-b80b-ee4e34ac3d0c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:27:29.530777 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-ab858911-fcf1-4dd8-b80b-ee4e34ac3d0c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Getting quotas for project bfd17e8c4aa24960a8b46e4721e2acc7. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 02:27:29.536533 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-ab858911-fcf1-4dd8-b80b-ee4e34ac3d0c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Getting quotas for user 620bbcf5f19d4cfbb8b39de0272870e4 and project bfd17e8c4aa24960a8b46e4721e2acc7. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 02:27:29.549816 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ab858911-fcf1-4dd8-b80b-ee4e34ac3d0c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 02:27:29.552181 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ab858911-fcf1-4dd8-b80b-ee4e34ac3d0c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: d5814b82-906e-4470-9e62-2000905631cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 02:27:29.662432 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ab858911-fcf1-4dd8-b80b-ee4e34ac3d0c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.619880 Oct 30 02:27:29.663088 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3957/7580] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 02:27:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 02:27:29.675430 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3fb836f1-fa59-45af-8e8b-1ac5d0e5aa1a tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:27:29.676180 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3fb836f1-fa59-45af-8e8b-1ac5d0e5aa1a tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: d5814b82-906e-4470-9e62-2000905631cf] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:27:29.853856 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3fb836f1-fa59-45af-8e8b-1ac5d0e5aa1a tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620bbcf5f19d4cfbb8b39de0272870e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd17e8c4aa24960a8b46e4721e2acc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:27:29.863482 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3fb836f1-fa59-45af-8e8b-1ac5d0e5aa1a tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/d5814b82-906e-4470-9e62-2000905631cf" status: 200 len: 1262 microversion: 2.1 time: 0.193336 Oct 30 02:27:29.865370 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3624/7581] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:27:29 2022] GET /compute/v2.1/servers/d5814b82-906e-4470-9e62-2000905631cf => generated 1262 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:27:30.888011 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-09996279-dd01-40aa-8275-bfb3826602b5 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:27:30.888564 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-09996279-dd01-40aa-8275-bfb3826602b5 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: d5814b82-906e-4470-9e62-2000905631cf] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:27:30.897212 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-09996279-dd01-40aa-8275-bfb3826602b5 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:27:30.897810 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-09996279-dd01-40aa-8275-bfb3826602b5 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:27:30.898258 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-09996279-dd01-40aa-8275-bfb3826602b5 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:27:30.898969 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-09996279-dd01-40aa-8275-bfb3826602b5 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:27:30.899434 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-09996279-dd01-40aa-8275-bfb3826602b5 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:27:30.899872 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-09996279-dd01-40aa-8275-bfb3826602b5 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:27:30.966919 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-09996279-dd01-40aa-8275-bfb3826602b5 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620bbcf5f19d4cfbb8b39de0272870e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd17e8c4aa24960a8b46e4721e2acc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:27:30.975767 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-09996279-dd01-40aa-8275-bfb3826602b5 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/d5814b82-906e-4470-9e62-2000905631cf" status: 200 len: 1266 microversion: 2.1 time: 0.091683 Oct 30 02:27:30.976466 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3958/7582] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:27:30 2022] GET /compute/v2.1/servers/d5814b82-906e-4470-9e62-2000905631cf => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:27:32.000277 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c4f4c0f0-5d14-49fa-a175-27f6fb8a6205 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:27:32.000913 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c4f4c0f0-5d14-49fa-a175-27f6fb8a6205 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: d5814b82-906e-4470-9e62-2000905631cf] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:27:32.008652 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c4f4c0f0-5d14-49fa-a175-27f6fb8a6205 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:27:32.008652 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c4f4c0f0-5d14-49fa-a175-27f6fb8a6205 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:27:32.008983 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c4f4c0f0-5d14-49fa-a175-27f6fb8a6205 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:27:32.009758 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c4f4c0f0-5d14-49fa-a175-27f6fb8a6205 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:27:32.010815 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c4f4c0f0-5d14-49fa-a175-27f6fb8a6205 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:27:32.011427 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c4f4c0f0-5d14-49fa-a175-27f6fb8a6205 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:27:32.102345 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c4f4c0f0-5d14-49fa-a175-27f6fb8a6205 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620bbcf5f19d4cfbb8b39de0272870e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd17e8c4aa24960a8b46e4721e2acc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:27:32.110937 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c4f4c0f0-5d14-49fa-a175-27f6fb8a6205 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/d5814b82-906e-4470-9e62-2000905631cf" status: 200 len: 1322 microversion: 2.1 time: 0.115225 Oct 30 02:27:32.111528 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3625/7583] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:27:31 2022] GET /compute/v2.1/servers/d5814b82-906e-4470-9e62-2000905631cf => generated 1322 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:27:33.140903 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-87f72477-0796-4eff-bbbf-5a00fea65db5 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:27:33.141937 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-87f72477-0796-4eff-bbbf-5a00fea65db5 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: d5814b82-906e-4470-9e62-2000905631cf] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:27:33.149444 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-87f72477-0796-4eff-bbbf-5a00fea65db5 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:27:33.150020 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-87f72477-0796-4eff-bbbf-5a00fea65db5 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:27:33.150547 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-87f72477-0796-4eff-bbbf-5a00fea65db5 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:27:33.151383 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-87f72477-0796-4eff-bbbf-5a00fea65db5 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:27:33.151919 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-87f72477-0796-4eff-bbbf-5a00fea65db5 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:27:33.152556 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-87f72477-0796-4eff-bbbf-5a00fea65db5 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:27:33.303159 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-87f72477-0796-4eff-bbbf-5a00fea65db5 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620bbcf5f19d4cfbb8b39de0272870e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd17e8c4aa24960a8b46e4721e2acc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:27:33.311915 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-87f72477-0796-4eff-bbbf-5a00fea65db5 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/d5814b82-906e-4470-9e62-2000905631cf" status: 200 len: 1362 microversion: 2.1 time: 0.179790 Oct 30 02:27:33.312590 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3959/7584] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:27:33 2022] GET /compute/v2.1/servers/d5814b82-906e-4470-9e62-2000905631cf => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:27:34.102954 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-d4f71bd1-b99c-4b3c-9b03-e71e4d3af556 req-c6e54d1c-acbe-4faa-afa9-14d35890eeb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5814b82-906e-4470-9e62-2000905631cf", "tag": "cffba877-33f6-4778-836f-726e5db31ccd"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:27:34.114966 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d4f71bd1-b99c-4b3c-9b03-e71e4d3af556 req-c6e54d1c-acbe-4faa-afa9-14d35890eeb4 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:27:34.115441 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d4f71bd1-b99c-4b3c-9b03-e71e4d3af556 req-c6e54d1c-acbe-4faa-afa9-14d35890eeb4 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:27:34.115874 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d4f71bd1-b99c-4b3c-9b03-e71e4d3af556 req-c6e54d1c-acbe-4faa-afa9-14d35890eeb4 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:27:34.127399 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-d4f71bd1-b99c-4b3c-9b03-e71e4d3af556 req-c6e54d1c-acbe-4faa-afa9-14d35890eeb4 service nova] Creating event network-changed:cffba877-33f6-4778-836f-726e5db31ccd for instance d5814b82-906e-4470-9e62-2000905631cf on n-h2-master-1 Oct 30 02:27:34.132368 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-d4f71bd1-b99c-4b3c-9b03-e71e4d3af556 req-c6e54d1c-acbe-4faa-afa9-14d35890eeb4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033285 Oct 30 02:27:34.132965 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3626/7585] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:27:34.339684 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-04e5ab22-87a4-475c-906c-61a305461c3e tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:27:34.339684 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-04e5ab22-87a4-475c-906c-61a305461c3e tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: d5814b82-906e-4470-9e62-2000905631cf] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:27:34.344404 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04e5ab22-87a4-475c-906c-61a305461c3e tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:27:34.344936 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04e5ab22-87a4-475c-906c-61a305461c3e tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:27:34.345454 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04e5ab22-87a4-475c-906c-61a305461c3e tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:27:34.346174 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04e5ab22-87a4-475c-906c-61a305461c3e tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:27:34.346668 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04e5ab22-87a4-475c-906c-61a305461c3e tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:27:34.347112 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04e5ab22-87a4-475c-906c-61a305461c3e tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:27:34.489824 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-04e5ab22-87a4-475c-906c-61a305461c3e tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620bbcf5f19d4cfbb8b39de0272870e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd17e8c4aa24960a8b46e4721e2acc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:27:34.498151 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-04e5ab22-87a4-475c-906c-61a305461c3e tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/d5814b82-906e-4470-9e62-2000905631cf" status: 200 len: 1362 microversion: 2.1 time: 0.166086 Oct 30 02:27:34.498749 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3960/7586] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:27:34 2022] GET /compute/v2.1/servers/d5814b82-906e-4470-9e62-2000905631cf => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:27:35.521299 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9e8e4b88-d118-460d-bd4d-86f162f1648b tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:27:35.522019 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9e8e4b88-d118-460d-bd4d-86f162f1648b tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: d5814b82-906e-4470-9e62-2000905631cf] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:27:35.528195 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e8e4b88-d118-460d-bd4d-86f162f1648b tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:27:35.528678 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e8e4b88-d118-460d-bd4d-86f162f1648b tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:27:35.529110 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e8e4b88-d118-460d-bd4d-86f162f1648b tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:27:35.529831 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e8e4b88-d118-460d-bd4d-86f162f1648b tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:27:35.530324 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e8e4b88-d118-460d-bd4d-86f162f1648b tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:27:35.530746 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e8e4b88-d118-460d-bd4d-86f162f1648b tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:27:35.659015 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9e8e4b88-d118-460d-bd4d-86f162f1648b tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620bbcf5f19d4cfbb8b39de0272870e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd17e8c4aa24960a8b46e4721e2acc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:27:35.666986 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9e8e4b88-d118-460d-bd4d-86f162f1648b tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/d5814b82-906e-4470-9e62-2000905631cf" status: 200 len: 1362 microversion: 2.1 time: 0.150692 Oct 30 02:27:35.667566 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3627/7587] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:27:35 2022] GET /compute/v2.1/servers/d5814b82-906e-4470-9e62-2000905631cf => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:27:36.691339 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ce6330d7-7836-4627-8cd0-f96e5a949e6f tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:27:36.691964 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ce6330d7-7836-4627-8cd0-f96e5a949e6f tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: d5814b82-906e-4470-9e62-2000905631cf] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:27:36.698798 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce6330d7-7836-4627-8cd0-f96e5a949e6f tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:27:36.699292 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce6330d7-7836-4627-8cd0-f96e5a949e6f tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:27:36.699737 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce6330d7-7836-4627-8cd0-f96e5a949e6f tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:27:36.700437 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce6330d7-7836-4627-8cd0-f96e5a949e6f tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:27:36.700899 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce6330d7-7836-4627-8cd0-f96e5a949e6f tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:27:36.701360 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce6330d7-7836-4627-8cd0-f96e5a949e6f tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:27:36.836689 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ce6330d7-7836-4627-8cd0-f96e5a949e6f tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620bbcf5f19d4cfbb8b39de0272870e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd17e8c4aa24960a8b46e4721e2acc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:27:36.844459 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ce6330d7-7836-4627-8cd0-f96e5a949e6f tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/d5814b82-906e-4470-9e62-2000905631cf" status: 200 len: 1362 microversion: 2.1 time: 0.157131 Oct 30 02:27:36.845040 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3961/7588] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:27:36 2022] GET /compute/v2.1/servers/d5814b82-906e-4470-9e62-2000905631cf => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:27:37.867682 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f9f38d01-2191-46e0-a48b-c513175b0f08 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:27:37.868316 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f9f38d01-2191-46e0-a48b-c513175b0f08 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: d5814b82-906e-4470-9e62-2000905631cf] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:27:37.875729 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f9f38d01-2191-46e0-a48b-c513175b0f08 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:27:37.876213 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f9f38d01-2191-46e0-a48b-c513175b0f08 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:27:37.876776 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f9f38d01-2191-46e0-a48b-c513175b0f08 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:27:37.877387 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f9f38d01-2191-46e0-a48b-c513175b0f08 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:27:37.877842 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f9f38d01-2191-46e0-a48b-c513175b0f08 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:27:37.878266 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f9f38d01-2191-46e0-a48b-c513175b0f08 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:27:38.019189 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f9f38d01-2191-46e0-a48b-c513175b0f08 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620bbcf5f19d4cfbb8b39de0272870e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd17e8c4aa24960a8b46e4721e2acc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:27:38.019474 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f9f38d01-2191-46e0-a48b-c513175b0f08 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/d5814b82-906e-4470-9e62-2000905631cf" status: 200 len: 1362 microversion: 2.1 time: 0.155748 Oct 30 02:27:38.020050 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3628/7589] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:27:37 2022] GET /compute/v2.1/servers/d5814b82-906e-4470-9e62-2000905631cf => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:27:39.041765 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f5206d87-49e1-4cc7-89b7-3c6a8be9531d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:27:39.042397 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f5206d87-49e1-4cc7-89b7-3c6a8be9531d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: d5814b82-906e-4470-9e62-2000905631cf] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:27:39.049547 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5206d87-49e1-4cc7-89b7-3c6a8be9531d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:27:39.050043 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5206d87-49e1-4cc7-89b7-3c6a8be9531d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:27:39.050493 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5206d87-49e1-4cc7-89b7-3c6a8be9531d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:27:39.051189 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5206d87-49e1-4cc7-89b7-3c6a8be9531d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:27:39.051650 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5206d87-49e1-4cc7-89b7-3c6a8be9531d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:27:39.052086 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5206d87-49e1-4cc7-89b7-3c6a8be9531d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:27:39.180343 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f5206d87-49e1-4cc7-89b7-3c6a8be9531d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620bbcf5f19d4cfbb8b39de0272870e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd17e8c4aa24960a8b46e4721e2acc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:27:39.188303 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f5206d87-49e1-4cc7-89b7-3c6a8be9531d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/d5814b82-906e-4470-9e62-2000905631cf" status: 200 len: 1362 microversion: 2.1 time: 0.150476 Oct 30 02:27:39.188891 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3962/7590] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:27:39 2022] GET /compute/v2.1/servers/d5814b82-906e-4470-9e62-2000905631cf => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:27:39.384527 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-ed3c0070-e193-4da6-b9b1-96f1272fcaae req-9775f437-408f-4091-8f51-eee95d8e5f35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5814b82-906e-4470-9e62-2000905631cf", "name": "network-vif-plugged", "status": "completed", "tag": "cffba877-33f6-4778-836f-726e5db31ccd"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:27:39.395627 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ed3c0070-e193-4da6-b9b1-96f1272fcaae req-9775f437-408f-4091-8f51-eee95d8e5f35 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:27:39.396113 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ed3c0070-e193-4da6-b9b1-96f1272fcaae req-9775f437-408f-4091-8f51-eee95d8e5f35 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:27:39.396543 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ed3c0070-e193-4da6-b9b1-96f1272fcaae req-9775f437-408f-4091-8f51-eee95d8e5f35 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:27:39.407339 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-ed3c0070-e193-4da6-b9b1-96f1272fcaae req-9775f437-408f-4091-8f51-eee95d8e5f35 service nova] Creating event network-vif-plugged:cffba877-33f6-4778-836f-726e5db31ccd for instance d5814b82-906e-4470-9e62-2000905631cf on n-h2-master-1 Oct 30 02:27:39.412295 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-ed3c0070-e193-4da6-b9b1-96f1272fcaae req-9775f437-408f-4091-8f51-eee95d8e5f35 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031513 Oct 30 02:27:39.412885 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3629/7591] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:27:40.212537 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-09b0f6d4-2467-422a-9a72-f1c946b6c9f9 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:27:40.213139 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-09b0f6d4-2467-422a-9a72-f1c946b6c9f9 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: d5814b82-906e-4470-9e62-2000905631cf] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:27:40.216340 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:27:40.217767 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=6 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:27:40.222073 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-09b0f6d4-2467-422a-9a72-f1c946b6c9f9 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:27:40.222575 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-09b0f6d4-2467-422a-9a72-f1c946b6c9f9 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:27:40.223021 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-09b0f6d4-2467-422a-9a72-f1c946b6c9f9 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:27:40.223742 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-09b0f6d4-2467-422a-9a72-f1c946b6c9f9 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:27:40.224243 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-09b0f6d4-2467-422a-9a72-f1c946b6c9f9 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:27:40.224642 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-09b0f6d4-2467-422a-9a72-f1c946b6c9f9 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:27:40.353272 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-09b0f6d4-2467-422a-9a72-f1c946b6c9f9 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620bbcf5f19d4cfbb8b39de0272870e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd17e8c4aa24960a8b46e4721e2acc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:27:40.361621 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-09b0f6d4-2467-422a-9a72-f1c946b6c9f9 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/d5814b82-906e-4470-9e62-2000905631cf" status: 200 len: 1362 microversion: 2.1 time: 0.153216 Oct 30 02:27:40.362194 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3963/7592] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:27:40 2022] GET /compute/v2.1/servers/d5814b82-906e-4470-9e62-2000905631cf => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:27:41.381509 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=6 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:27:41.386574 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-51e73f74-b414-44ba-b4a8-51b3afb07815 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:27:41.387276 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-51e73f74-b414-44ba-b4a8-51b3afb07815 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: d5814b82-906e-4470-9e62-2000905631cf] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:27:41.393418 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-51e73f74-b414-44ba-b4a8-51b3afb07815 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:27:41.395642 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-51e73f74-b414-44ba-b4a8-51b3afb07815 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:27:41.395642 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-51e73f74-b414-44ba-b4a8-51b3afb07815 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:27:41.395642 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-51e73f74-b414-44ba-b4a8-51b3afb07815 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:27:41.395642 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-51e73f74-b414-44ba-b4a8-51b3afb07815 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:27:41.396029 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-51e73f74-b414-44ba-b4a8-51b3afb07815 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:27:41.530688 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-51e73f74-b414-44ba-b4a8-51b3afb07815 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620bbcf5f19d4cfbb8b39de0272870e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd17e8c4aa24960a8b46e4721e2acc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:27:41.538972 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-51e73f74-b414-44ba-b4a8-51b3afb07815 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/d5814b82-906e-4470-9e62-2000905631cf" status: 200 len: 1554 microversion: 2.1 time: 0.158423 Oct 30 02:27:41.539542 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3630/7593] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:27:41 2022] GET /compute/v2.1/servers/d5814b82-906e-4470-9e62-2000905631cf => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:27:41.561716 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-67c60742-f8a9-47e7-9385-c80843cfee88 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:27:41.562346 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-67c60742-f8a9-47e7-9385-c80843cfee88 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: d5814b82-906e-4470-9e62-2000905631cf] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:27:41.568572 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67c60742-f8a9-47e7-9385-c80843cfee88 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:27:41.569072 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67c60742-f8a9-47e7-9385-c80843cfee88 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:27:41.569568 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67c60742-f8a9-47e7-9385-c80843cfee88 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:27:41.570278 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67c60742-f8a9-47e7-9385-c80843cfee88 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:27:41.570750 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67c60742-f8a9-47e7-9385-c80843cfee88 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:27:41.571197 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-67c60742-f8a9-47e7-9385-c80843cfee88 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:27:41.701221 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-67c60742-f8a9-47e7-9385-c80843cfee88 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620bbcf5f19d4cfbb8b39de0272870e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd17e8c4aa24960a8b46e4721e2acc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:27:41.709563 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-67c60742-f8a9-47e7-9385-c80843cfee88 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/d5814b82-906e-4470-9e62-2000905631cf" status: 200 len: 1554 microversion: 2.1 time: 0.151912 Oct 30 02:27:41.710130 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3964/7594] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:27:41 2022] GET /compute/v2.1/servers/d5814b82-906e-4470-9e62-2000905631cf => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:27:44.758637 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-60e881a0-8924-47b5-9438-71efdf9bf8d8 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "254be36c-dccd-4571-bac6-d0e39bcde489"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:27:44.760969 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-60e881a0-8924-47b5-9438-71efdf9bf8d8 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: d5814b82-906e-4470-9e62-2000905631cf] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:27:44.768575 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-60e881a0-8924-47b5-9438-71efdf9bf8d8 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:27:44.769056 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-60e881a0-8924-47b5-9438-71efdf9bf8d8 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:27:44.769532 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-60e881a0-8924-47b5-9438-71efdf9bf8d8 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:27:44.770226 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-60e881a0-8924-47b5-9438-71efdf9bf8d8 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:27:44.770714 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-60e881a0-8924-47b5-9438-71efdf9bf8d8 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:27:44.771141 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-60e881a0-8924-47b5-9438-71efdf9bf8d8 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:27:45.478817 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-60e881a0-8924-47b5-9438-71efdf9bf8d8 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "POST /compute/v2.1/servers/d5814b82-906e-4470-9e62-2000905631cf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.723843 Oct 30 02:27:45.479434 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3631/7595] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 30 02:27:44 2022] POST /compute/v2.1/servers/d5814b82-906e-4470-9e62-2000905631cf/os-volume_attachments => generated 194 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:27:57.237437 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ed420a50-69ec-473c-ac78-c4402cf3dd17 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:27:57.237954 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ed420a50-69ec-473c-ac78-c4402cf3dd17 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: d5814b82-906e-4470-9e62-2000905631cf] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:27:57.240799 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:27:57.241516 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=44 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:27:57.246205 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed420a50-69ec-473c-ac78-c4402cf3dd17 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:27:57.246694 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed420a50-69ec-473c-ac78-c4402cf3dd17 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:27:57.247138 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed420a50-69ec-473c-ac78-c4402cf3dd17 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:27:57.247836 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed420a50-69ec-473c-ac78-c4402cf3dd17 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:27:57.248346 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed420a50-69ec-473c-ac78-c4402cf3dd17 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:27:57.248779 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed420a50-69ec-473c-ac78-c4402cf3dd17 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:27:57.331734 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-ed420a50-69ec-473c-ac78-c4402cf3dd17 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lazy-loading 'services' on Instance uuid d5814b82-906e-4470-9e62-2000905631cf {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 02:27:57.506317 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ed420a50-69ec-473c-ac78-c4402cf3dd17 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d5814b82-906e-4470-9e62-2000905631cf/os-volume_attachments/254be36c-dccd-4571-bac6-d0e39bcde489" status: 202 len: 0 microversion: 2.1 time: 0.273230 Oct 30 02:27:57.506914 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3965/7596] 10.222.0.13 () {58 vars in 1416 bytes} [Sun Oct 30 02:27:57 2022] DELETE /compute/v2.1/servers/d5814b82-906e-4470-9e62-2000905631cf/os-volume_attachments/254be36c-dccd-4571-bac6-d0e39bcde489 => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 02:27:57.513425 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:27:57.514229 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:27:57.518572 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-eb8a5713-9e37-4ddf-b880-59319ed6a55f tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:27:57.520947 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-eb8a5713-9e37-4ddf-b880-59319ed6a55f tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: d5814b82-906e-4470-9e62-2000905631cf] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:27:57.530496 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eb8a5713-9e37-4ddf-b880-59319ed6a55f tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:27:57.534980 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eb8a5713-9e37-4ddf-b880-59319ed6a55f tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:27:57.534980 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eb8a5713-9e37-4ddf-b880-59319ed6a55f tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:27:57.534980 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eb8a5713-9e37-4ddf-b880-59319ed6a55f tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:27:57.534980 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eb8a5713-9e37-4ddf-b880-59319ed6a55f tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:27:57.534980 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eb8a5713-9e37-4ddf-b880-59319ed6a55f tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:27:57.563369 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-eb8a5713-9e37-4ddf-b880-59319ed6a55f tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/d5814b82-906e-4470-9e62-2000905631cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051962 Oct 30 02:27:57.563983 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3632/7597] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 02:27:57 2022] GET /compute/v2.1/servers/d5814b82-906e-4470-9e62-2000905631cf/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:27:58.577585 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-709e8410-6463-4b3e-81d8-c033729ebc33 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:27:58.579885 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-709e8410-6463-4b3e-81d8-c033729ebc33 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: d5814b82-906e-4470-9e62-2000905631cf] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:27:58.586294 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-709e8410-6463-4b3e-81d8-c033729ebc33 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:27:58.586789 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-709e8410-6463-4b3e-81d8-c033729ebc33 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:27:58.587242 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-709e8410-6463-4b3e-81d8-c033729ebc33 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:27:58.587947 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-709e8410-6463-4b3e-81d8-c033729ebc33 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:27:58.588413 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-709e8410-6463-4b3e-81d8-c033729ebc33 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:27:58.588851 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-709e8410-6463-4b3e-81d8-c033729ebc33 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:27:58.620369 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-709e8410-6463-4b3e-81d8-c033729ebc33 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/d5814b82-906e-4470-9e62-2000905631cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048022 Oct 30 02:27:58.620943 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3966/7598] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 02:27:58 2022] GET /compute/v2.1/servers/d5814b82-906e-4470-9e62-2000905631cf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:27:59.633630 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b14f8447-c34e-4029-9cd6-7b716b1c8fca tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:27:59.635794 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b14f8447-c34e-4029-9cd6-7b716b1c8fca tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: d5814b82-906e-4470-9e62-2000905631cf] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:27:59.644722 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b14f8447-c34e-4029-9cd6-7b716b1c8fca tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:27:59.645291 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b14f8447-c34e-4029-9cd6-7b716b1c8fca tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:27:59.645770 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b14f8447-c34e-4029-9cd6-7b716b1c8fca tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:27:59.646495 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b14f8447-c34e-4029-9cd6-7b716b1c8fca tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:27:59.646995 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b14f8447-c34e-4029-9cd6-7b716b1c8fca tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:27:59.647408 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b14f8447-c34e-4029-9cd6-7b716b1c8fca tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:27:59.681353 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b14f8447-c34e-4029-9cd6-7b716b1c8fca tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/d5814b82-906e-4470-9e62-2000905631cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052432 Oct 30 02:27:59.681954 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3633/7599] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 02:27:59 2022] GET /compute/v2.1/servers/d5814b82-906e-4470-9e62-2000905631cf/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:28:00.694466 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-64a58cae-4bf5-49c3-9abf-a31241fcec2c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:28:00.696673 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-64a58cae-4bf5-49c3-9abf-a31241fcec2c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: d5814b82-906e-4470-9e62-2000905631cf] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:28:00.704082 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-64a58cae-4bf5-49c3-9abf-a31241fcec2c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:00.704576 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-64a58cae-4bf5-49c3-9abf-a31241fcec2c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:00.705023 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-64a58cae-4bf5-49c3-9abf-a31241fcec2c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:00.705759 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-64a58cae-4bf5-49c3-9abf-a31241fcec2c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:00.706229 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-64a58cae-4bf5-49c3-9abf-a31241fcec2c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:00.706661 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-64a58cae-4bf5-49c3-9abf-a31241fcec2c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:00.739473 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-64a58cae-4bf5-49c3-9abf-a31241fcec2c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/d5814b82-906e-4470-9e62-2000905631cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048988 Oct 30 02:28:00.739948 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3967/7600] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 02:28:00 2022] GET /compute/v2.1/servers/d5814b82-906e-4470-9e62-2000905631cf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:28:01.752167 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-028c54ae-f73b-44b1-8dfc-2eedd2f50e16 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:28:01.754429 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-028c54ae-f73b-44b1-8dfc-2eedd2f50e16 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: d5814b82-906e-4470-9e62-2000905631cf] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:28:01.762026 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-028c54ae-f73b-44b1-8dfc-2eedd2f50e16 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:01.762521 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-028c54ae-f73b-44b1-8dfc-2eedd2f50e16 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:01.762965 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-028c54ae-f73b-44b1-8dfc-2eedd2f50e16 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:01.763670 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-028c54ae-f73b-44b1-8dfc-2eedd2f50e16 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:01.764130 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-028c54ae-f73b-44b1-8dfc-2eedd2f50e16 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:01.764561 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-028c54ae-f73b-44b1-8dfc-2eedd2f50e16 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:01.794990 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-028c54ae-f73b-44b1-8dfc-2eedd2f50e16 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/d5814b82-906e-4470-9e62-2000905631cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047547 Oct 30 02:28:01.795566 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3634/7601] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 02:28:01 2022] GET /compute/v2.1/servers/d5814b82-906e-4470-9e62-2000905631cf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:28:02.808313 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d76e9962-3322-4262-b491-9669e8f1c9b0 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:28:02.810525 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d76e9962-3322-4262-b491-9669e8f1c9b0 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: d5814b82-906e-4470-9e62-2000905631cf] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:28:02.817789 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d76e9962-3322-4262-b491-9669e8f1c9b0 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:02.818286 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d76e9962-3322-4262-b491-9669e8f1c9b0 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:02.818771 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d76e9962-3322-4262-b491-9669e8f1c9b0 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:02.819467 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d76e9962-3322-4262-b491-9669e8f1c9b0 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:02.819929 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d76e9962-3322-4262-b491-9669e8f1c9b0 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:02.820364 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d76e9962-3322-4262-b491-9669e8f1c9b0 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:02.849575 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d76e9962-3322-4262-b491-9669e8f1c9b0 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/d5814b82-906e-4470-9e62-2000905631cf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045281 Oct 30 02:28:02.850104 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3968/7602] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 02:28:02 2022] GET /compute/v2.1/servers/d5814b82-906e-4470-9e62-2000905631cf/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 02:28:02.860587 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d54e94bc-31a7-43da-84ca-73bd2dae9b5e tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:28:02.861077 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d54e94bc-31a7-43da-84ca-73bd2dae9b5e tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: d5814b82-906e-4470-9e62-2000905631cf] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:28:02.868184 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d54e94bc-31a7-43da-84ca-73bd2dae9b5e tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:02.868665 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d54e94bc-31a7-43da-84ca-73bd2dae9b5e tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:02.869099 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d54e94bc-31a7-43da-84ca-73bd2dae9b5e tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:02.869808 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d54e94bc-31a7-43da-84ca-73bd2dae9b5e tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:02.870259 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d54e94bc-31a7-43da-84ca-73bd2dae9b5e tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:02.870678 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d54e94bc-31a7-43da-84ca-73bd2dae9b5e tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:02.946597 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-d54e94bc-31a7-43da-84ca-73bd2dae9b5e tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] HTTP exception thrown: Instance d5814b82-906e-4470-9e62-2000905631cf is not attached to volume 254be36c-dccd-4571-bac6-d0e39bcde489 Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d54e94bc-31a7-43da-84ca-73bd2dae9b5e tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Request method failure captured: Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: request: DELETE /compute/v2.1/servers/d5814b82-906e-4470-9e62-2000905631cf/os-volume_attachments/254be36c-dccd-4571-bac6-d0e39bcde489 HTTP/1.1 Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXeEK9QRMKpue-1_CAUN0nxT9SAWD0kaFatv9C7OVjZYraPcctja2AazGHqhBOq6LnX1PegLz8iyumG9Uq76GXVbEwti5u80AbvIbKIL2tu1SGTyf0cb0qF_VDsMq0t-VgWm1QBc6YgWxXJGukVVzGwRb9JGj6Yqt98XF2fW3lisFqgE Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: bfd17e8c4aa24960a8b46e4721e2acc7 Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1412150866 Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/bfd17e8c4aa24960a8b46e4721e2acc7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_bfd17e8c4aa24960a8b46e4721e2acc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/bfd17e8c4aa24960a8b46e4721e2acc7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/bfd17e8c4aa24960a8b46e4721e2acc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-TestEncryptedCinderVolumes-1412150866 Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: bfd17e8c4aa24960a8b46e4721e2acc7 Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1412150866 Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-TestEncryptedCinderVolumes-1412150866-project Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 620bbcf5f19d4cfbb8b39de0272870e4 Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-TestEncryptedCinderVolumes-1412150866-project Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: exception: Instance d5814b82-906e-4470-9e62-2000905631cf is not attached to volume 254be36c-dccd-4571-bac6-d0e39bcde489 Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: action_args: {'server_id': 'd5814b82-906e-4470-9e62-2000905631cf', 'id': '254be36c-dccd-4571-bac6-d0e39bcde489'} Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 254be36c-dccd-4571-bac6-d0e39bcde489. Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5814b82-906e-4470-9e62-2000905631cf is not attached to volume 254be36c-dccd-4571-bac6-d0e39bcde489 Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:28:02.950960 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:28:02.955980 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:28:02.955980 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:28:02.955980 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5814b82-906e-4470-9e62-2000905631cf is not attached to volume 254be36c-dccd-4571-bac6-d0e39bcde489 Oct 30 02:28:02.955980 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:28:02.955980 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d54e94bc-31a7-43da-84ca-73bd2dae9b5e tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Returning 404 to user: Instance d5814b82-906e-4470-9e62-2000905631cf is not attached to volume 254be36c-dccd-4571-bac6-d0e39bcde489 {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:28:02.955980 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d54e94bc-31a7-43da-84ca-73bd2dae9b5e tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d5814b82-906e-4470-9e62-2000905631cf/os-volume_attachments/254be36c-dccd-4571-bac6-d0e39bcde489" status: 404 len: 154 microversion: 2.1 time: 0.095776 Oct 30 02:28:02.955980 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3635/7603] 10.222.0.13 () {58 vars in 1416 bytes} [Sun Oct 30 02:28:02 2022] DELETE /compute/v2.1/servers/d5814b82-906e-4470-9e62-2000905631cf/os-volume_attachments/254be36c-dccd-4571-bac6-d0e39bcde489 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 02:28:06.471733 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-46f28ba8-1dcc-4676-826d-9ea191d6dce7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:28:06.472284 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-46f28ba8-1dcc-4676-826d-9ea191d6dce7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: d5814b82-906e-4470-9e62-2000905631cf] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:28:06.480939 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-46f28ba8-1dcc-4676-826d-9ea191d6dce7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:06.480939 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-46f28ba8-1dcc-4676-826d-9ea191d6dce7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:06.480939 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-46f28ba8-1dcc-4676-826d-9ea191d6dce7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:06.480939 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-46f28ba8-1dcc-4676-826d-9ea191d6dce7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:06.481527 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-46f28ba8-1dcc-4676-826d-9ea191d6dce7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:06.481972 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-46f28ba8-1dcc-4676-826d-9ea191d6dce7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:06.508958 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-46f28ba8-1dcc-4676-826d-9ea191d6dce7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: d5814b82-906e-4470-9e62-2000905631cf] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 02:28:06.776815 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-46f28ba8-1dcc-4676-826d-9ea191d6dce7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d5814b82-906e-4470-9e62-2000905631cf" status: 204 len: 0 microversion: 2.1 time: 0.308785 Oct 30 02:28:06.777438 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3969/7604] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 02:28:06 2022] DELETE /compute/v2.1/servers/d5814b82-906e-4470-9e62-2000905631cf => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 02:28:06.786459 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-55f04d64-9d2c-4dcd-9bc4-c4015b9217e8 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:28:06.787176 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-55f04d64-9d2c-4dcd-9bc4-c4015b9217e8 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: d5814b82-906e-4470-9e62-2000905631cf] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:28:06.794603 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-55f04d64-9d2c-4dcd-9bc4-c4015b9217e8 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:06.794603 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-55f04d64-9d2c-4dcd-9bc4-c4015b9217e8 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:06.794847 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-55f04d64-9d2c-4dcd-9bc4-c4015b9217e8 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:06.795544 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-55f04d64-9d2c-4dcd-9bc4-c4015b9217e8 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:06.796001 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-55f04d64-9d2c-4dcd-9bc4-c4015b9217e8 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:06.796430 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-55f04d64-9d2c-4dcd-9bc4-c4015b9217e8 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:06.931605 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-55f04d64-9d2c-4dcd-9bc4-c4015b9217e8 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620bbcf5f19d4cfbb8b39de0272870e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd17e8c4aa24960a8b46e4721e2acc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:28:06.939608 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-55f04d64-9d2c-4dcd-9bc4-c4015b9217e8 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/d5814b82-906e-4470-9e62-2000905631cf" status: 200 len: 1560 microversion: 2.1 time: 0.157630 Oct 30 02:28:06.940191 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3636/7605] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:28:06 2022] GET /compute/v2.1/servers/d5814b82-906e-4470-9e62-2000905631cf => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:28:07.963451 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4e687783-0432-422c-b80d-1f30bc86cf01 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:28:07.964212 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4e687783-0432-422c-b80d-1f30bc86cf01 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: d5814b82-906e-4470-9e62-2000905631cf] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:28:07.971208 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4e687783-0432-422c-b80d-1f30bc86cf01 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:07.971714 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4e687783-0432-422c-b80d-1f30bc86cf01 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:07.972176 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4e687783-0432-422c-b80d-1f30bc86cf01 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:07.972889 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4e687783-0432-422c-b80d-1f30bc86cf01 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:07.973386 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4e687783-0432-422c-b80d-1f30bc86cf01 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:07.973837 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4e687783-0432-422c-b80d-1f30bc86cf01 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:08.102618 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4e687783-0432-422c-b80d-1f30bc86cf01 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620bbcf5f19d4cfbb8b39de0272870e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd17e8c4aa24960a8b46e4721e2acc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:28:08.111207 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4e687783-0432-422c-b80d-1f30bc86cf01 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/d5814b82-906e-4470-9e62-2000905631cf" status: 200 len: 1560 microversion: 2.1 time: 0.151615 Oct 30 02:28:08.111846 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3970/7606] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:28:07 2022] GET /compute/v2.1/servers/d5814b82-906e-4470-9e62-2000905631cf => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:28:09.044188 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-5d413227-6942-426c-a4f9-835389e37667 req-06c38444-8ba7-49b3-a78c-fc861eca3fb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5814b82-906e-4470-9e62-2000905631cf", "name": "network-vif-deleted", "tag": "cffba877-33f6-4778-836f-726e5db31ccd"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:28:09.055447 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-5d413227-6942-426c-a4f9-835389e37667 req-06c38444-8ba7-49b3-a78c-fc861eca3fb2 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:09.056556 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-5d413227-6942-426c-a4f9-835389e37667 req-06c38444-8ba7-49b3-a78c-fc861eca3fb2 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:09.056556 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-5d413227-6942-426c-a4f9-835389e37667 req-06c38444-8ba7-49b3-a78c-fc861eca3fb2 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:09.067474 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-5d413227-6942-426c-a4f9-835389e37667 req-06c38444-8ba7-49b3-a78c-fc861eca3fb2 service nova] Creating event network-vif-deleted:cffba877-33f6-4778-836f-726e5db31ccd for instance d5814b82-906e-4470-9e62-2000905631cf on n-h2-master-1 Oct 30 02:28:09.072512 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-5d413227-6942-426c-a4f9-835389e37667 req-06c38444-8ba7-49b3-a78c-fc861eca3fb2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031987 Oct 30 02:28:09.073113 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3637/7607] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:28:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:28:09.134994 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-055f48a3-07ed-4d4e-9b14-0f8e163fd1f8 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:28:09.135757 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-055f48a3-07ed-4d4e-9b14-0f8e163fd1f8 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: d5814b82-906e-4470-9e62-2000905631cf] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:28:09.142737 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-055f48a3-07ed-4d4e-9b14-0f8e163fd1f8 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:09.143225 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-055f48a3-07ed-4d4e-9b14-0f8e163fd1f8 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:09.143669 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-055f48a3-07ed-4d4e-9b14-0f8e163fd1f8 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:09.144370 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-055f48a3-07ed-4d4e-9b14-0f8e163fd1f8 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:09.144834 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-055f48a3-07ed-4d4e-9b14-0f8e163fd1f8 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:09.145267 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-055f48a3-07ed-4d4e-9b14-0f8e163fd1f8 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:09.211227 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-055f48a3-07ed-4d4e-9b14-0f8e163fd1f8 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620bbcf5f19d4cfbb8b39de0272870e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd17e8c4aa24960a8b46e4721e2acc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:28:09.219069 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-055f48a3-07ed-4d4e-9b14-0f8e163fd1f8 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/d5814b82-906e-4470-9e62-2000905631cf" status: 200 len: 1518 microversion: 2.1 time: 0.088067 Oct 30 02:28:09.219640 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3971/7608] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:28:09 2022] GET /compute/v2.1/servers/d5814b82-906e-4470-9e62-2000905631cf => generated 1518 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:28:10.244227 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a5d0e398-2b49-4b36-9f8d-efffc08c5f32 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:28:10.244983 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a5d0e398-2b49-4b36-9f8d-efffc08c5f32 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: d5814b82-906e-4470-9e62-2000905631cf] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:28:10.251152 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a5d0e398-2b49-4b36-9f8d-efffc08c5f32 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:10.252214 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a5d0e398-2b49-4b36-9f8d-efffc08c5f32 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:10.252656 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a5d0e398-2b49-4b36-9f8d-efffc08c5f32 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:10.253367 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a5d0e398-2b49-4b36-9f8d-efffc08c5f32 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:10.253843 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a5d0e398-2b49-4b36-9f8d-efffc08c5f32 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:10.254273 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a5d0e398-2b49-4b36-9f8d-efffc08c5f32 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:10.268471 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-a5d0e398-2b49-4b36-9f8d-efffc08c5f32 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] HTTP exception thrown: Instance d5814b82-906e-4470-9e62-2000905631cf could not be found. Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a5d0e398-2b49-4b36-9f8d-efffc08c5f32 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Request method failure captured: Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/d5814b82-906e-4470-9e62-2000905631cf HTTP/1.1 Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXeEK9QRMKpue-1_CAUN0nxT9SAWD0kaFatv9C7OVjZYraPcctja2AazGHqhBOq6LnX1PegLz8iyumG9Uq76GXVbEwti5u80AbvIbKIL2tu1SGTyf0cb0qF_VDsMq0t-VgWm1QBc6YgWxXJGukVVzGwRb9JGj6Yqt98XF2fW3lisFqgE Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: bfd17e8c4aa24960a8b46e4721e2acc7 Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1412150866 Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/bfd17e8c4aa24960a8b46e4721e2acc7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_bfd17e8c4aa24960a8b46e4721e2acc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/bfd17e8c4aa24960a8b46e4721e2acc7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/bfd17e8c4aa24960a8b46e4721e2acc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-TestEncryptedCinderVolumes-1412150866 Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: bfd17e8c4aa24960a8b46e4721e2acc7 Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1412150866 Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-TestEncryptedCinderVolumes-1412150866-project Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 620bbcf5f19d4cfbb8b39de0272870e4 Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-TestEncryptedCinderVolumes-1412150866-project Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: exception: Instance d5814b82-906e-4470-9e62-2000905631cf could not be found. Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'd5814b82-906e-4470-9e62-2000905631cf'} Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5814b82-906e-4470-9e62-2000905631cf could not be found. Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5814b82-906e-4470-9e62-2000905631cf could not be found. Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:28:10.270211 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:28:10.275468 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:28:10.275468 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:28:10.275468 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:28:10.275468 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:28:10.275468 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:28:10.275468 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:28:10.275468 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5814b82-906e-4470-9e62-2000905631cf could not be found. Oct 30 02:28:10.275468 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:28:10.275468 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a5d0e398-2b49-4b36-9f8d-efffc08c5f32 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Returning 404 to user: Instance d5814b82-906e-4470-9e62-2000905631cf could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:28:10.275468 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a5d0e398-2b49-4b36-9f8d-efffc08c5f32 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/d5814b82-906e-4470-9e62-2000905631cf" status: 404 len: 111 microversion: 2.1 time: 0.032519 Oct 30 02:28:10.275468 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3638/7609] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:28:10 2022] GET /compute/v2.1/servers/d5814b82-906e-4470-9e62-2000905631cf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 02:28:10.282152 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6934c673-021c-4da0-aebf-a415f4a0ab40 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '.version_select at 0x7f44cc609430>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:28:10.431130 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6934c673-021c-4da0-aebf-a415f4a0ab40 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1004462871" status: 202 len: 0 microversion: 2.1 time: 0.153547 Oct 30 02:28:10.431731 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3972/7610] 10.222.0.13 () {58 vars in 1278 bytes} [Sun Oct 30 02:28:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1004462871 => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 02:28:10.449022 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-eee6265f-82b3-4eb4-a504-4fd8d7128206 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Action: 'create', calling method: .version_select at 0x7f44c6dea5e0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1846230351", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFW1tcK+V2AlA+GgcrlsAOHUPYbcc9amacGfFh/G0eJCfMWo5BNd5tCFhJ6rUiMGIeaSIb3gl51mxNf8Jff9p5G3EMnoq/6n8ak88a91wwcqDsqMFhAf0XZG/UUoomLEDA=="}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:28:10.464325 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-eee6265f-82b3-4eb4-a504-4fd8d7128206 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Getting quotas for project bfd17e8c4aa24960a8b46e4721e2acc7. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 02:28:10.473538 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-eee6265f-82b3-4eb4-a504-4fd8d7128206 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Getting quotas for user 620bbcf5f19d4cfbb8b39de0272870e4 and project bfd17e8c4aa24960a8b46e4721e2acc7. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 02:28:10.572017 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-eee6265f-82b3-4eb4-a504-4fd8d7128206 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.126799 Oct 30 02:28:10.572563 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3639/7611] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 30 02:28:10 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:28:10.623554 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-980066ad-d601-4693-8bd7-83a4d85bfa3c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-901330069", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1846230351", "networks": [{"uuid": "2289005a-70ca-444d-9825-ca9817f8719a"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:28:10.675815 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-980066ad-d601-4693-8bd7-83a4d85bfa3c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] validate_networks() for [('2289005a-70ca-444d-9825-ca9817f8719a', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 02:28:11.340863 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-980066ad-d601-4693-8bd7-83a4d85bfa3c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 02:28:11.340863 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-980066ad-d601-4693-8bd7-83a4d85bfa3c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 02:28:11.340863 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-980066ad-d601-4693-8bd7-83a4d85bfa3c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 02:28:11.341629 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-980066ad-d601-4693-8bd7-83a4d85bfa3c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 02:28:11.341629 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-980066ad-d601-4693-8bd7-83a4d85bfa3c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 02:28:11.350310 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-980066ad-d601-4693-8bd7-83a4d85bfa3c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:11.351065 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-980066ad-d601-4693-8bd7-83a4d85bfa3c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:11.351511 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-980066ad-d601-4693-8bd7-83a4d85bfa3c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:11.352251 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-980066ad-d601-4693-8bd7-83a4d85bfa3c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:11.352712 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-980066ad-d601-4693-8bd7-83a4d85bfa3c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:11.353147 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-980066ad-d601-4693-8bd7-83a4d85bfa3c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:11.370129 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-980066ad-d601-4693-8bd7-83a4d85bfa3c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Getting quotas for project bfd17e8c4aa24960a8b46e4721e2acc7. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 02:28:11.375295 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-980066ad-d601-4693-8bd7-83a4d85bfa3c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Getting quotas for user 620bbcf5f19d4cfbb8b39de0272870e4 and project bfd17e8c4aa24960a8b46e4721e2acc7. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 02:28:11.388361 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-980066ad-d601-4693-8bd7-83a4d85bfa3c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 02:28:11.390772 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-980066ad-d601-4693-8bd7-83a4d85bfa3c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: 02b78db0-d679-4f8d-99e3-26a3d5de40b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 02:28:11.494082 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-980066ad-d601-4693-8bd7-83a4d85bfa3c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.874644 Oct 30 02:28:11.494708 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3973/7612] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 02:28:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 876 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 02:28:11.507013 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c693146e-47ca-4ef2-abca-246085c13b5a tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:28:11.507782 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c693146e-47ca-4ef2-abca-246085c13b5a tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: 02b78db0-d679-4f8d-99e3-26a3d5de40b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:28:11.564953 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c693146e-47ca-4ef2-abca-246085c13b5a tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620bbcf5f19d4cfbb8b39de0272870e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd17e8c4aa24960a8b46e4721e2acc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:28:11.571940 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c693146e-47ca-4ef2-abca-246085c13b5a tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/02b78db0-d679-4f8d-99e3-26a3d5de40b8" status: 200 len: 1262 microversion: 2.1 time: 0.069353 Oct 30 02:28:11.572518 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3640/7613] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:28:11 2022] GET /compute/v2.1/servers/02b78db0-d679-4f8d-99e3-26a3d5de40b8 => generated 1262 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:28:12.595063 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4d94b878-3a85-43dd-bc14-eb4856b10e22 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:28:12.596254 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4d94b878-3a85-43dd-bc14-eb4856b10e22 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: 02b78db0-d679-4f8d-99e3-26a3d5de40b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:28:12.603207 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d94b878-3a85-43dd-bc14-eb4856b10e22 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:12.603706 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d94b878-3a85-43dd-bc14-eb4856b10e22 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:12.608973 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d94b878-3a85-43dd-bc14-eb4856b10e22 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:12.608973 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d94b878-3a85-43dd-bc14-eb4856b10e22 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:12.608973 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d94b878-3a85-43dd-bc14-eb4856b10e22 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:12.608973 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d94b878-3a85-43dd-bc14-eb4856b10e22 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:12.670862 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4d94b878-3a85-43dd-bc14-eb4856b10e22 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620bbcf5f19d4cfbb8b39de0272870e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd17e8c4aa24960a8b46e4721e2acc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:28:12.678852 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4d94b878-3a85-43dd-bc14-eb4856b10e22 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/02b78db0-d679-4f8d-99e3-26a3d5de40b8" status: 200 len: 1266 microversion: 2.1 time: 0.088732 Oct 30 02:28:12.679443 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3974/7614] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:28:12 2022] GET /compute/v2.1/servers/02b78db0-d679-4f8d-99e3-26a3d5de40b8 => generated 1266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:28:13.708246 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-573dde8c-7531-47d4-bfef-9ca9a34ec2ee tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:28:13.708939 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-573dde8c-7531-47d4-bfef-9ca9a34ec2ee tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: 02b78db0-d679-4f8d-99e3-26a3d5de40b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:28:13.716591 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-573dde8c-7531-47d4-bfef-9ca9a34ec2ee tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:13.717251 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-573dde8c-7531-47d4-bfef-9ca9a34ec2ee tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:13.717917 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-573dde8c-7531-47d4-bfef-9ca9a34ec2ee tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:13.718797 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-573dde8c-7531-47d4-bfef-9ca9a34ec2ee tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:13.719247 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-573dde8c-7531-47d4-bfef-9ca9a34ec2ee tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:13.719672 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-573dde8c-7531-47d4-bfef-9ca9a34ec2ee tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:13.810981 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-573dde8c-7531-47d4-bfef-9ca9a34ec2ee tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620bbcf5f19d4cfbb8b39de0272870e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd17e8c4aa24960a8b46e4721e2acc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:28:13.818798 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-573dde8c-7531-47d4-bfef-9ca9a34ec2ee tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/02b78db0-d679-4f8d-99e3-26a3d5de40b8" status: 200 len: 1332 microversion: 2.1 time: 0.114642 Oct 30 02:28:13.820749 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3641/7615] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:28:13 2022] GET /compute/v2.1/servers/02b78db0-d679-4f8d-99e3-26a3d5de40b8 => generated 1332 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:28:14.842327 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e1671fe1-0545-4cfa-a235-c0ac67f6c7e7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:28:14.842956 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e1671fe1-0545-4cfa-a235-c0ac67f6c7e7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: 02b78db0-d679-4f8d-99e3-26a3d5de40b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:28:14.849932 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e1671fe1-0545-4cfa-a235-c0ac67f6c7e7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:14.850472 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e1671fe1-0545-4cfa-a235-c0ac67f6c7e7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:14.850923 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e1671fe1-0545-4cfa-a235-c0ac67f6c7e7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:14.851650 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e1671fe1-0545-4cfa-a235-c0ac67f6c7e7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:14.852105 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e1671fe1-0545-4cfa-a235-c0ac67f6c7e7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:14.852545 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e1671fe1-0545-4cfa-a235-c0ac67f6c7e7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:15.046546 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e1671fe1-0545-4cfa-a235-c0ac67f6c7e7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620bbcf5f19d4cfbb8b39de0272870e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd17e8c4aa24960a8b46e4721e2acc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:28:15.054838 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e1671fe1-0545-4cfa-a235-c0ac67f6c7e7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/02b78db0-d679-4f8d-99e3-26a3d5de40b8" status: 200 len: 1362 microversion: 2.1 time: 0.216413 Oct 30 02:28:15.055426 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3975/7616] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:28:14 2022] GET /compute/v2.1/servers/02b78db0-d679-4f8d-99e3-26a3d5de40b8 => generated 1362 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:28:15.140668 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-4856b286-6b6e-44cf-8031-c4733f7e5a83 req-96b4eeea-36d8-459a-82bb-dbdf090673c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02b78db0-d679-4f8d-99e3-26a3d5de40b8", "tag": "c220ba99-370f-4b06-9e09-e51bbee95599"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:28:15.152250 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-4856b286-6b6e-44cf-8031-c4733f7e5a83 req-96b4eeea-36d8-459a-82bb-dbdf090673c9 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:15.158154 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-4856b286-6b6e-44cf-8031-c4733f7e5a83 req-96b4eeea-36d8-459a-82bb-dbdf090673c9 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:15.158154 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-4856b286-6b6e-44cf-8031-c4733f7e5a83 req-96b4eeea-36d8-459a-82bb-dbdf090673c9 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:15.164650 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-4856b286-6b6e-44cf-8031-c4733f7e5a83 req-96b4eeea-36d8-459a-82bb-dbdf090673c9 service nova] Creating event network-changed:c220ba99-370f-4b06-9e09-e51bbee95599 for instance 02b78db0-d679-4f8d-99e3-26a3d5de40b8 on n-h2-master-1 Oct 30 02:28:15.169457 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-4856b286-6b6e-44cf-8031-c4733f7e5a83 req-96b4eeea-36d8-459a-82bb-dbdf090673c9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032889 Oct 30 02:28:15.170227 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3642/7617] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:28:16.078690 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b88641e6-77a9-44f4-bc9d-1066481448e7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:28:16.079891 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b88641e6-77a9-44f4-bc9d-1066481448e7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: 02b78db0-d679-4f8d-99e3-26a3d5de40b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:28:16.086697 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b88641e6-77a9-44f4-bc9d-1066481448e7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:16.087188 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b88641e6-77a9-44f4-bc9d-1066481448e7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:16.087632 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b88641e6-77a9-44f4-bc9d-1066481448e7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:16.088340 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b88641e6-77a9-44f4-bc9d-1066481448e7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:16.088797 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b88641e6-77a9-44f4-bc9d-1066481448e7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:16.089230 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b88641e6-77a9-44f4-bc9d-1066481448e7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:16.220759 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b88641e6-77a9-44f4-bc9d-1066481448e7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620bbcf5f19d4cfbb8b39de0272870e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd17e8c4aa24960a8b46e4721e2acc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:28:16.228412 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b88641e6-77a9-44f4-bc9d-1066481448e7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/02b78db0-d679-4f8d-99e3-26a3d5de40b8" status: 200 len: 1362 microversion: 2.1 time: 0.153706 Oct 30 02:28:16.228982 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3976/7618] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:28:16 2022] GET /compute/v2.1/servers/02b78db0-d679-4f8d-99e3-26a3d5de40b8 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:28:17.252830 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-37a245e5-b7e6-4d84-a9c2-5a29985d03ff tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:28:17.253561 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-37a245e5-b7e6-4d84-a9c2-5a29985d03ff tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: 02b78db0-d679-4f8d-99e3-26a3d5de40b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:28:17.260040 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-37a245e5-b7e6-4d84-a9c2-5a29985d03ff tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:17.260520 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-37a245e5-b7e6-4d84-a9c2-5a29985d03ff tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:17.260954 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-37a245e5-b7e6-4d84-a9c2-5a29985d03ff tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:17.261740 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-37a245e5-b7e6-4d84-a9c2-5a29985d03ff tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:17.262193 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-37a245e5-b7e6-4d84-a9c2-5a29985d03ff tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:17.262615 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-37a245e5-b7e6-4d84-a9c2-5a29985d03ff tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:17.391274 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-37a245e5-b7e6-4d84-a9c2-5a29985d03ff tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620bbcf5f19d4cfbb8b39de0272870e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd17e8c4aa24960a8b46e4721e2acc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:28:17.399710 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-37a245e5-b7e6-4d84-a9c2-5a29985d03ff tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/02b78db0-d679-4f8d-99e3-26a3d5de40b8" status: 200 len: 1362 microversion: 2.1 time: 0.153229 Oct 30 02:28:17.400287 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3643/7619] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:28:17 2022] GET /compute/v2.1/servers/02b78db0-d679-4f8d-99e3-26a3d5de40b8 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:28:18.422046 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-dd4e9de5-84bf-480f-8002-789429636cfc tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:28:18.422938 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-dd4e9de5-84bf-480f-8002-789429636cfc tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: 02b78db0-d679-4f8d-99e3-26a3d5de40b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:28:18.429931 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dd4e9de5-84bf-480f-8002-789429636cfc tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:18.431392 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dd4e9de5-84bf-480f-8002-789429636cfc tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:18.431392 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dd4e9de5-84bf-480f-8002-789429636cfc tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:18.431620 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dd4e9de5-84bf-480f-8002-789429636cfc tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:18.432001 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dd4e9de5-84bf-480f-8002-789429636cfc tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:18.432440 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dd4e9de5-84bf-480f-8002-789429636cfc tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:18.559239 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-dd4e9de5-84bf-480f-8002-789429636cfc tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620bbcf5f19d4cfbb8b39de0272870e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd17e8c4aa24960a8b46e4721e2acc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:28:18.567047 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-dd4e9de5-84bf-480f-8002-789429636cfc tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/02b78db0-d679-4f8d-99e3-26a3d5de40b8" status: 200 len: 1362 microversion: 2.1 time: 0.149024 Oct 30 02:28:18.567630 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3977/7620] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:28:18 2022] GET /compute/v2.1/servers/02b78db0-d679-4f8d-99e3-26a3d5de40b8 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:28:19.589839 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-376bf5ca-f34a-4f14-8b1d-edb714902006 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:28:19.590499 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-376bf5ca-f34a-4f14-8b1d-edb714902006 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: 02b78db0-d679-4f8d-99e3-26a3d5de40b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:28:19.598279 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-376bf5ca-f34a-4f14-8b1d-edb714902006 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:19.598780 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-376bf5ca-f34a-4f14-8b1d-edb714902006 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:19.599222 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-376bf5ca-f34a-4f14-8b1d-edb714902006 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:19.599937 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-376bf5ca-f34a-4f14-8b1d-edb714902006 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:19.600394 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-376bf5ca-f34a-4f14-8b1d-edb714902006 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:19.600821 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-376bf5ca-f34a-4f14-8b1d-edb714902006 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:19.735857 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-376bf5ca-f34a-4f14-8b1d-edb714902006 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620bbcf5f19d4cfbb8b39de0272870e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd17e8c4aa24960a8b46e4721e2acc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:28:19.743772 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-376bf5ca-f34a-4f14-8b1d-edb714902006 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/02b78db0-d679-4f8d-99e3-26a3d5de40b8" status: 200 len: 1362 microversion: 2.1 time: 0.157892 Oct 30 02:28:19.744348 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3644/7621] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:28:19 2022] GET /compute/v2.1/servers/02b78db0-d679-4f8d-99e3-26a3d5de40b8 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:28:20.766387 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4c158da5-56eb-4483-8de3-8d4aaa75d362 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:28:20.767568 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4c158da5-56eb-4483-8de3-8d4aaa75d362 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: 02b78db0-d679-4f8d-99e3-26a3d5de40b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:28:20.774438 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4c158da5-56eb-4483-8de3-8d4aaa75d362 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:20.774933 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4c158da5-56eb-4483-8de3-8d4aaa75d362 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:20.775384 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4c158da5-56eb-4483-8de3-8d4aaa75d362 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:20.776088 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4c158da5-56eb-4483-8de3-8d4aaa75d362 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:20.776558 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4c158da5-56eb-4483-8de3-8d4aaa75d362 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:20.776995 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4c158da5-56eb-4483-8de3-8d4aaa75d362 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:20.904922 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4c158da5-56eb-4483-8de3-8d4aaa75d362 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620bbcf5f19d4cfbb8b39de0272870e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd17e8c4aa24960a8b46e4721e2acc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:28:20.913665 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4c158da5-56eb-4483-8de3-8d4aaa75d362 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/02b78db0-d679-4f8d-99e3-26a3d5de40b8" status: 200 len: 1362 microversion: 2.1 time: 0.151410 Oct 30 02:28:20.914178 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3978/7622] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:28:20 2022] GET /compute/v2.1/servers/02b78db0-d679-4f8d-99e3-26a3d5de40b8 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:28:21.651962 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-b9110c26-e387-4222-850c-e53d2019fe81 req-38fb2dec-5cda-4173-a7d8-144ac44b4e35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02b78db0-d679-4f8d-99e3-26a3d5de40b8", "name": "network-vif-plugged", "status": "completed", "tag": "c220ba99-370f-4b06-9e09-e51bbee95599"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:28:21.659392 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=6 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:28:21.663335 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-b9110c26-e387-4222-850c-e53d2019fe81 req-38fb2dec-5cda-4173-a7d8-144ac44b4e35 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:21.664394 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-b9110c26-e387-4222-850c-e53d2019fe81 req-38fb2dec-5cda-4173-a7d8-144ac44b4e35 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:21.664394 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-b9110c26-e387-4222-850c-e53d2019fe81 req-38fb2dec-5cda-4173-a7d8-144ac44b4e35 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:21.676243 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-b9110c26-e387-4222-850c-e53d2019fe81 req-38fb2dec-5cda-4173-a7d8-144ac44b4e35 service nova] Creating event network-vif-plugged:c220ba99-370f-4b06-9e09-e51bbee95599 for instance 02b78db0-d679-4f8d-99e3-26a3d5de40b8 on n-h2-master-1 Oct 30 02:28:21.681151 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-b9110c26-e387-4222-850c-e53d2019fe81 req-38fb2dec-5cda-4173-a7d8-144ac44b4e35 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033228 Oct 30 02:28:21.681764 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3645/7623] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:28:21.936524 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-aeb18d3d-a2bc-4fd4-84b4-8e4beecc8f3c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:28:21.937172 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-aeb18d3d-a2bc-4fd4-84b4-8e4beecc8f3c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: 02b78db0-d679-4f8d-99e3-26a3d5de40b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:28:21.940580 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:28:21.941350 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=6 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:28:21.945879 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aeb18d3d-a2bc-4fd4-84b4-8e4beecc8f3c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:21.949938 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aeb18d3d-a2bc-4fd4-84b4-8e4beecc8f3c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:21.949938 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aeb18d3d-a2bc-4fd4-84b4-8e4beecc8f3c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:21.949938 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aeb18d3d-a2bc-4fd4-84b4-8e4beecc8f3c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:21.949938 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aeb18d3d-a2bc-4fd4-84b4-8e4beecc8f3c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:21.949938 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aeb18d3d-a2bc-4fd4-84b4-8e4beecc8f3c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:22.080636 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-aeb18d3d-a2bc-4fd4-84b4-8e4beecc8f3c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620bbcf5f19d4cfbb8b39de0272870e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd17e8c4aa24960a8b46e4721e2acc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:28:22.088477 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-aeb18d3d-a2bc-4fd4-84b4-8e4beecc8f3c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/02b78db0-d679-4f8d-99e3-26a3d5de40b8" status: 200 len: 1362 microversion: 2.1 time: 0.156232 Oct 30 02:28:22.089057 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3979/7624] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:28:21 2022] GET /compute/v2.1/servers/02b78db0-d679-4f8d-99e3-26a3d5de40b8 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:28:23.116639 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2e153d15-2a4d-47c4-bb0c-4896583cfb8d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:28:23.117367 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2e153d15-2a4d-47c4-bb0c-4896583cfb8d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: 02b78db0-d679-4f8d-99e3-26a3d5de40b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:28:23.124006 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2e153d15-2a4d-47c4-bb0c-4896583cfb8d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:23.124488 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2e153d15-2a4d-47c4-bb0c-4896583cfb8d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:23.124919 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2e153d15-2a4d-47c4-bb0c-4896583cfb8d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:23.125634 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2e153d15-2a4d-47c4-bb0c-4896583cfb8d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:23.126083 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2e153d15-2a4d-47c4-bb0c-4896583cfb8d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:23.127167 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2e153d15-2a4d-47c4-bb0c-4896583cfb8d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:23.262058 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2e153d15-2a4d-47c4-bb0c-4896583cfb8d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620bbcf5f19d4cfbb8b39de0272870e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd17e8c4aa24960a8b46e4721e2acc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:28:23.269925 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2e153d15-2a4d-47c4-bb0c-4896583cfb8d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/02b78db0-d679-4f8d-99e3-26a3d5de40b8" status: 200 len: 1362 microversion: 2.1 time: 0.158963 Oct 30 02:28:23.270473 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3646/7625] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:28:23 2022] GET /compute/v2.1/servers/02b78db0-d679-4f8d-99e3-26a3d5de40b8 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:28:24.293592 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7bd49e8a-0f74-431a-9adb-f839858830f1 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:28:24.294220 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7bd49e8a-0f74-431a-9adb-f839858830f1 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: 02b78db0-d679-4f8d-99e3-26a3d5de40b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:28:24.301960 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7bd49e8a-0f74-431a-9adb-f839858830f1 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:24.302450 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7bd49e8a-0f74-431a-9adb-f839858830f1 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:24.302893 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7bd49e8a-0f74-431a-9adb-f839858830f1 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:24.303596 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7bd49e8a-0f74-431a-9adb-f839858830f1 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:24.304065 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7bd49e8a-0f74-431a-9adb-f839858830f1 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:24.304498 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7bd49e8a-0f74-431a-9adb-f839858830f1 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:24.436114 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7bd49e8a-0f74-431a-9adb-f839858830f1 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620bbcf5f19d4cfbb8b39de0272870e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd17e8c4aa24960a8b46e4721e2acc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:28:24.440317 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:28:24.444960 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7bd49e8a-0f74-431a-9adb-f839858830f1 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/02b78db0-d679-4f8d-99e3-26a3d5de40b8" status: 200 len: 1554 microversion: 2.1 time: 0.155315 Oct 30 02:28:24.445577 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3980/7626] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:28:24 2022] GET /compute/v2.1/servers/02b78db0-d679-4f8d-99e3-26a3d5de40b8 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:28:24.466997 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-50e2de40-924e-4f1e-836b-bbd9c124b36c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:28:24.467976 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-50e2de40-924e-4f1e-836b-bbd9c124b36c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: 02b78db0-d679-4f8d-99e3-26a3d5de40b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:28:24.474478 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-50e2de40-924e-4f1e-836b-bbd9c124b36c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:24.474966 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-50e2de40-924e-4f1e-836b-bbd9c124b36c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:24.475411 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-50e2de40-924e-4f1e-836b-bbd9c124b36c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:24.476113 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-50e2de40-924e-4f1e-836b-bbd9c124b36c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:24.476572 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-50e2de40-924e-4f1e-836b-bbd9c124b36c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:24.476997 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-50e2de40-924e-4f1e-836b-bbd9c124b36c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:24.614433 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-50e2de40-924e-4f1e-836b-bbd9c124b36c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620bbcf5f19d4cfbb8b39de0272870e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd17e8c4aa24960a8b46e4721e2acc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:28:24.622229 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-50e2de40-924e-4f1e-836b-bbd9c124b36c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/02b78db0-d679-4f8d-99e3-26a3d5de40b8" status: 200 len: 1554 microversion: 2.1 time: 0.159111 Oct 30 02:28:24.622818 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3647/7627] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:28:24 2022] GET /compute/v2.1/servers/02b78db0-d679-4f8d-99e3-26a3d5de40b8 => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:28:27.634621 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2d75cb8d-200d-4a3d-a6ac-cf8dc1a441ba tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "97cb8bc7-9b86-4f0c-98b1-516abffedffc"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:28:27.637144 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2d75cb8d-200d-4a3d-a6ac-cf8dc1a441ba tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: 02b78db0-d679-4f8d-99e3-26a3d5de40b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:28:27.639855 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:28:27.645315 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2d75cb8d-200d-4a3d-a6ac-cf8dc1a441ba tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:27.645841 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2d75cb8d-200d-4a3d-a6ac-cf8dc1a441ba tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:27.646299 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2d75cb8d-200d-4a3d-a6ac-cf8dc1a441ba tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:27.647007 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2d75cb8d-200d-4a3d-a6ac-cf8dc1a441ba tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:27.647478 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2d75cb8d-200d-4a3d-a6ac-cf8dc1a441ba tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:27.647920 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2d75cb8d-200d-4a3d-a6ac-cf8dc1a441ba tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:28.375294 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2d75cb8d-200d-4a3d-a6ac-cf8dc1a441ba tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "POST /compute/v2.1/servers/02b78db0-d679-4f8d-99e3-26a3d5de40b8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.744687 Oct 30 02:28:28.375997 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3981/7628] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 30 02:28:27 2022] POST /compute/v2.1/servers/02b78db0-d679-4f8d-99e3-26a3d5de40b8/os-volume_attachments => generated 194 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:28:40.334474 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bd8bf23b-5b6a-4d33-86fd-f63abda77668 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:28:40.334973 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-bd8bf23b-5b6a-4d33-86fd-f63abda77668 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: 02b78db0-d679-4f8d-99e3-26a3d5de40b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:28:40.337822 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:28:40.338509 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=68 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:28:40.343193 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd8bf23b-5b6a-4d33-86fd-f63abda77668 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:40.343679 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd8bf23b-5b6a-4d33-86fd-f63abda77668 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:40.344121 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd8bf23b-5b6a-4d33-86fd-f63abda77668 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:40.344820 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd8bf23b-5b6a-4d33-86fd-f63abda77668 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:40.345275 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd8bf23b-5b6a-4d33-86fd-f63abda77668 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:40.345727 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd8bf23b-5b6a-4d33-86fd-f63abda77668 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:40.425074 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-bd8bf23b-5b6a-4d33-86fd-f63abda77668 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lazy-loading 'services' on Instance uuid 02b78db0-d679-4f8d-99e3-26a3d5de40b8 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 02:28:40.628533 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bd8bf23b-5b6a-4d33-86fd-f63abda77668 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "DELETE /compute/v2.1/servers/02b78db0-d679-4f8d-99e3-26a3d5de40b8/os-volume_attachments/97cb8bc7-9b86-4f0c-98b1-516abffedffc" status: 202 len: 0 microversion: 2.1 time: 0.298477 Oct 30 02:28:40.629163 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3648/7629] 10.222.0.13 () {58 vars in 1416 bytes} [Sun Oct 30 02:28:40 2022] DELETE /compute/v2.1/servers/02b78db0-d679-4f8d-99e3-26a3d5de40b8/os-volume_attachments/97cb8bc7-9b86-4f0c-98b1-516abffedffc => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 02:28:40.638188 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3c7a7620-9d05-4ac6-b5d9-dacfc2967125 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:28:40.640637 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3c7a7620-9d05-4ac6-b5d9-dacfc2967125 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: 02b78db0-d679-4f8d-99e3-26a3d5de40b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:28:40.643849 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:28:40.644613 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:28:40.649504 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3c7a7620-9d05-4ac6-b5d9-dacfc2967125 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:40.650009 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3c7a7620-9d05-4ac6-b5d9-dacfc2967125 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:40.650497 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3c7a7620-9d05-4ac6-b5d9-dacfc2967125 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:40.651229 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3c7a7620-9d05-4ac6-b5d9-dacfc2967125 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:40.651698 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3c7a7620-9d05-4ac6-b5d9-dacfc2967125 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:40.652140 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3c7a7620-9d05-4ac6-b5d9-dacfc2967125 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:40.683329 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3c7a7620-9d05-4ac6-b5d9-dacfc2967125 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/02b78db0-d679-4f8d-99e3-26a3d5de40b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049517 Oct 30 02:28:40.683887 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3982/7630] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 02:28:40 2022] GET /compute/v2.1/servers/02b78db0-d679-4f8d-99e3-26a3d5de40b8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:28:41.697975 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e8e340f9-d003-4577-824a-9dd3cf06b3a0 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:28:41.700288 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e8e340f9-d003-4577-824a-9dd3cf06b3a0 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: 02b78db0-d679-4f8d-99e3-26a3d5de40b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:28:41.706674 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e8e340f9-d003-4577-824a-9dd3cf06b3a0 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:41.707163 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e8e340f9-d003-4577-824a-9dd3cf06b3a0 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:41.707597 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e8e340f9-d003-4577-824a-9dd3cf06b3a0 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:41.708291 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e8e340f9-d003-4577-824a-9dd3cf06b3a0 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:41.708738 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e8e340f9-d003-4577-824a-9dd3cf06b3a0 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:41.709155 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e8e340f9-d003-4577-824a-9dd3cf06b3a0 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:41.739679 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e8e340f9-d003-4577-824a-9dd3cf06b3a0 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/02b78db0-d679-4f8d-99e3-26a3d5de40b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046980 Oct 30 02:28:41.740235 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3649/7631] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 02:28:41 2022] GET /compute/v2.1/servers/02b78db0-d679-4f8d-99e3-26a3d5de40b8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:28:42.752377 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-aae6c6a8-49ea-4780-b68e-4cafefeff524 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:28:42.754812 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-aae6c6a8-49ea-4780-b68e-4cafefeff524 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: 02b78db0-d679-4f8d-99e3-26a3d5de40b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:28:42.763362 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aae6c6a8-49ea-4780-b68e-4cafefeff524 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:42.763874 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aae6c6a8-49ea-4780-b68e-4cafefeff524 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:42.764554 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aae6c6a8-49ea-4780-b68e-4cafefeff524 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:42.765282 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aae6c6a8-49ea-4780-b68e-4cafefeff524 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:42.765860 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aae6c6a8-49ea-4780-b68e-4cafefeff524 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:42.766304 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aae6c6a8-49ea-4780-b68e-4cafefeff524 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:42.799750 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-aae6c6a8-49ea-4780-b68e-4cafefeff524 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/02b78db0-d679-4f8d-99e3-26a3d5de40b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051431 Oct 30 02:28:42.800385 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3983/7632] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 02:28:42 2022] GET /compute/v2.1/servers/02b78db0-d679-4f8d-99e3-26a3d5de40b8/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:28:43.813350 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-12e7775d-1e40-4a05-92dd-09b0a7d640d7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:28:43.815707 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-12e7775d-1e40-4a05-92dd-09b0a7d640d7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: 02b78db0-d679-4f8d-99e3-26a3d5de40b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:28:43.823251 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-12e7775d-1e40-4a05-92dd-09b0a7d640d7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:43.823681 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-12e7775d-1e40-4a05-92dd-09b0a7d640d7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:43.824142 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-12e7775d-1e40-4a05-92dd-09b0a7d640d7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:43.824845 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-12e7775d-1e40-4a05-92dd-09b0a7d640d7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:43.825298 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-12e7775d-1e40-4a05-92dd-09b0a7d640d7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:43.825750 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-12e7775d-1e40-4a05-92dd-09b0a7d640d7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:43.854966 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-12e7775d-1e40-4a05-92dd-09b0a7d640d7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/02b78db0-d679-4f8d-99e3-26a3d5de40b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045647 Oct 30 02:28:43.855540 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3650/7633] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 02:28:43 2022] GET /compute/v2.1/servers/02b78db0-d679-4f8d-99e3-26a3d5de40b8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:28:44.867742 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-65b46877-3cf9-42be-854c-2dd172a71bf1 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:28:44.869964 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-65b46877-3cf9-42be-854c-2dd172a71bf1 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: 02b78db0-d679-4f8d-99e3-26a3d5de40b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:28:44.877467 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-65b46877-3cf9-42be-854c-2dd172a71bf1 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:44.877996 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-65b46877-3cf9-42be-854c-2dd172a71bf1 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:44.878444 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-65b46877-3cf9-42be-854c-2dd172a71bf1 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:44.879153 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-65b46877-3cf9-42be-854c-2dd172a71bf1 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:44.879615 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-65b46877-3cf9-42be-854c-2dd172a71bf1 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:44.880049 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-65b46877-3cf9-42be-854c-2dd172a71bf1 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:44.912167 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-65b46877-3cf9-42be-854c-2dd172a71bf1 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/02b78db0-d679-4f8d-99e3-26a3d5de40b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048994 Oct 30 02:28:44.912736 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3984/7634] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 02:28:44 2022] GET /compute/v2.1/servers/02b78db0-d679-4f8d-99e3-26a3d5de40b8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:28:45.924822 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0aaac017-149f-4ed4-85db-a02223061782 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:28:45.927607 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0aaac017-149f-4ed4-85db-a02223061782 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: 02b78db0-d679-4f8d-99e3-26a3d5de40b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:28:45.935016 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0aaac017-149f-4ed4-85db-a02223061782 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:45.935505 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0aaac017-149f-4ed4-85db-a02223061782 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:45.935949 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0aaac017-149f-4ed4-85db-a02223061782 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:45.936648 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0aaac017-149f-4ed4-85db-a02223061782 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:45.937107 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0aaac017-149f-4ed4-85db-a02223061782 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:45.937563 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0aaac017-149f-4ed4-85db-a02223061782 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:45.966999 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0aaac017-149f-4ed4-85db-a02223061782 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/02b78db0-d679-4f8d-99e3-26a3d5de40b8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046400 Oct 30 02:28:45.967558 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3651/7635] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 02:28:45 2022] GET /compute/v2.1/servers/02b78db0-d679-4f8d-99e3-26a3d5de40b8/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 02:28:45.978892 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3edbef4a-1135-476a-8f8c-8072c713017b tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:28:45.979431 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3edbef4a-1135-476a-8f8c-8072c713017b tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: 02b78db0-d679-4f8d-99e3-26a3d5de40b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:28:45.986314 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3edbef4a-1135-476a-8f8c-8072c713017b tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:45.986810 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3edbef4a-1135-476a-8f8c-8072c713017b tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:45.987259 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3edbef4a-1135-476a-8f8c-8072c713017b tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:45.987976 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3edbef4a-1135-476a-8f8c-8072c713017b tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:45.988417 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3edbef4a-1135-476a-8f8c-8072c713017b tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:45.988851 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3edbef4a-1135-476a-8f8c-8072c713017b tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:46.063212 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-3edbef4a-1135-476a-8f8c-8072c713017b tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] HTTP exception thrown: Instance 02b78db0-d679-4f8d-99e3-26a3d5de40b8 is not attached to volume 97cb8bc7-9b86-4f0c-98b1-516abffedffc Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3edbef4a-1135-476a-8f8c-8072c713017b tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Request method failure captured: Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: request: DELETE /compute/v2.1/servers/02b78db0-d679-4f8d-99e3-26a3d5de40b8/os-volume_attachments/97cb8bc7-9b86-4f0c-98b1-516abffedffc HTTP/1.1 Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXeEK9QRMKpue-1_CAUN0nxT9SAWD0kaFatv9C7OVjZYraPcctja2AazGHqhBOq6LnX1PegLz8iyumG9Uq76GXVbEwti5u80AbvIbKIL2tu1SGTyf0cb0qF_VDsMq0t-VgWm1QBc6YgWxXJGukVVzGwRb9JGj6Yqt98XF2fW3lisFqgE Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: bfd17e8c4aa24960a8b46e4721e2acc7 Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1412150866 Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/bfd17e8c4aa24960a8b46e4721e2acc7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_bfd17e8c4aa24960a8b46e4721e2acc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/bfd17e8c4aa24960a8b46e4721e2acc7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/bfd17e8c4aa24960a8b46e4721e2acc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-TestEncryptedCinderVolumes-1412150866 Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: bfd17e8c4aa24960a8b46e4721e2acc7 Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1412150866 Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-TestEncryptedCinderVolumes-1412150866-project Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 620bbcf5f19d4cfbb8b39de0272870e4 Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-TestEncryptedCinderVolumes-1412150866-project Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 02b78db0-d679-4f8d-99e3-26a3d5de40b8 is not attached to volume 97cb8bc7-9b86-4f0c-98b1-516abffedffc Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: action_args: {'server_id': '02b78db0-d679-4f8d-99e3-26a3d5de40b8', 'id': '97cb8bc7-9b86-4f0c-98b1-516abffedffc'} Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 97cb8bc7-9b86-4f0c-98b1-516abffedffc. Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02b78db0-d679-4f8d-99e3-26a3d5de40b8 is not attached to volume 97cb8bc7-9b86-4f0c-98b1-516abffedffc Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:28:46.065143 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:28:46.070383 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:28:46.070383 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:28:46.070383 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02b78db0-d679-4f8d-99e3-26a3d5de40b8 is not attached to volume 97cb8bc7-9b86-4f0c-98b1-516abffedffc Oct 30 02:28:46.070383 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:28:46.070383 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3edbef4a-1135-476a-8f8c-8072c713017b tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Returning 404 to user: Instance 02b78db0-d679-4f8d-99e3-26a3d5de40b8 is not attached to volume 97cb8bc7-9b86-4f0c-98b1-516abffedffc {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:28:46.070383 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3edbef4a-1135-476a-8f8c-8072c713017b tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "DELETE /compute/v2.1/servers/02b78db0-d679-4f8d-99e3-26a3d5de40b8/os-volume_attachments/97cb8bc7-9b86-4f0c-98b1-516abffedffc" status: 404 len: 154 microversion: 2.1 time: 0.091810 Oct 30 02:28:46.070383 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3985/7636] 10.222.0.13 () {58 vars in 1416 bytes} [Sun Oct 30 02:28:45 2022] DELETE /compute/v2.1/servers/02b78db0-d679-4f8d-99e3-26a3d5de40b8/os-volume_attachments/97cb8bc7-9b86-4f0c-98b1-516abffedffc => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 02:28:49.665982 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c330dd0d-ff80-4057-b5af-281a25555e94 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:28:49.666576 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c330dd0d-ff80-4057-b5af-281a25555e94 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: 02b78db0-d679-4f8d-99e3-26a3d5de40b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:28:49.673418 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c330dd0d-ff80-4057-b5af-281a25555e94 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:49.673924 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c330dd0d-ff80-4057-b5af-281a25555e94 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:49.674363 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c330dd0d-ff80-4057-b5af-281a25555e94 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:49.675050 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c330dd0d-ff80-4057-b5af-281a25555e94 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:49.675500 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c330dd0d-ff80-4057-b5af-281a25555e94 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:49.675967 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c330dd0d-ff80-4057-b5af-281a25555e94 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:49.702226 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c330dd0d-ff80-4057-b5af-281a25555e94 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: 02b78db0-d679-4f8d-99e3-26a3d5de40b8] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 02:28:49.967240 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c330dd0d-ff80-4057-b5af-281a25555e94 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "DELETE /compute/v2.1/servers/02b78db0-d679-4f8d-99e3-26a3d5de40b8" status: 204 len: 0 microversion: 2.1 time: 0.304874 Oct 30 02:28:49.967910 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3652/7637] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 02:28:49 2022] DELETE /compute/v2.1/servers/02b78db0-d679-4f8d-99e3-26a3d5de40b8 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 02:28:49.977037 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cc1e4b54-0769-428e-98cc-ba7238c055bf tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:28:49.977720 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cc1e4b54-0769-428e-98cc-ba7238c055bf tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: 02b78db0-d679-4f8d-99e3-26a3d5de40b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:28:49.985564 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cc1e4b54-0769-428e-98cc-ba7238c055bf tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:49.986060 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cc1e4b54-0769-428e-98cc-ba7238c055bf tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:49.986505 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cc1e4b54-0769-428e-98cc-ba7238c055bf tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:49.987206 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cc1e4b54-0769-428e-98cc-ba7238c055bf tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:49.987710 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cc1e4b54-0769-428e-98cc-ba7238c055bf tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:49.988139 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cc1e4b54-0769-428e-98cc-ba7238c055bf tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:50.122723 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-cc1e4b54-0769-428e-98cc-ba7238c055bf tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620bbcf5f19d4cfbb8b39de0272870e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd17e8c4aa24960a8b46e4721e2acc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:28:50.131242 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cc1e4b54-0769-428e-98cc-ba7238c055bf tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/02b78db0-d679-4f8d-99e3-26a3d5de40b8" status: 200 len: 1560 microversion: 2.1 time: 0.158989 Oct 30 02:28:50.131810 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3986/7638] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:28:49 2022] GET /compute/v2.1/servers/02b78db0-d679-4f8d-99e3-26a3d5de40b8 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:28:51.155454 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-909321ea-17ac-4284-ab67-a7c0ba9465a4 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:28:51.156186 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-909321ea-17ac-4284-ab67-a7c0ba9465a4 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: 02b78db0-d679-4f8d-99e3-26a3d5de40b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:28:51.163672 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-909321ea-17ac-4284-ab67-a7c0ba9465a4 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:51.164154 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-909321ea-17ac-4284-ab67-a7c0ba9465a4 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:51.164588 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-909321ea-17ac-4284-ab67-a7c0ba9465a4 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:51.165273 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-909321ea-17ac-4284-ab67-a7c0ba9465a4 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:51.165748 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-909321ea-17ac-4284-ab67-a7c0ba9465a4 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:51.166170 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-909321ea-17ac-4284-ab67-a7c0ba9465a4 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:51.303490 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-909321ea-17ac-4284-ab67-a7c0ba9465a4 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620bbcf5f19d4cfbb8b39de0272870e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd17e8c4aa24960a8b46e4721e2acc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:28:51.311315 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-909321ea-17ac-4284-ab67-a7c0ba9465a4 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/02b78db0-d679-4f8d-99e3-26a3d5de40b8" status: 200 len: 1560 microversion: 2.1 time: 0.160174 Oct 30 02:28:51.311891 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3653/7639] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:28:51 2022] GET /compute/v2.1/servers/02b78db0-d679-4f8d-99e3-26a3d5de40b8 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:28:52.336112 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6cacbac4-338c-422a-b943-03be94b6beb7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:28:52.336859 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6cacbac4-338c-422a-b943-03be94b6beb7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: 02b78db0-d679-4f8d-99e3-26a3d5de40b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:28:52.344029 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6cacbac4-338c-422a-b943-03be94b6beb7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:52.344630 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6cacbac4-338c-422a-b943-03be94b6beb7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:52.345093 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6cacbac4-338c-422a-b943-03be94b6beb7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:52.345940 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6cacbac4-338c-422a-b943-03be94b6beb7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:52.346397 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6cacbac4-338c-422a-b943-03be94b6beb7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:52.346839 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6cacbac4-338c-422a-b943-03be94b6beb7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:52.418248 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6cacbac4-338c-422a-b943-03be94b6beb7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620bbcf5f19d4cfbb8b39de0272870e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd17e8c4aa24960a8b46e4721e2acc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:28:52.427703 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6cacbac4-338c-422a-b943-03be94b6beb7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/02b78db0-d679-4f8d-99e3-26a3d5de40b8" status: 200 len: 1518 microversion: 2.1 time: 0.096278 Oct 30 02:28:52.428546 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3987/7640] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:28:52 2022] GET /compute/v2.1/servers/02b78db0-d679-4f8d-99e3-26a3d5de40b8 => generated 1518 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:28:52.433743 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-722f60ee-8f1d-4f29-9933-c963a2b19e9a req-ca31d855-c504-4d9a-a4c3-9562ee6628a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02b78db0-d679-4f8d-99e3-26a3d5de40b8", "name": "network-vif-deleted", "tag": "c220ba99-370f-4b06-9e09-e51bbee95599"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:28:52.444265 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-722f60ee-8f1d-4f29-9933-c963a2b19e9a req-ca31d855-c504-4d9a-a4c3-9562ee6628a9 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:52.444742 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-722f60ee-8f1d-4f29-9933-c963a2b19e9a req-ca31d855-c504-4d9a-a4c3-9562ee6628a9 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:52.445168 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-722f60ee-8f1d-4f29-9933-c963a2b19e9a req-ca31d855-c504-4d9a-a4c3-9562ee6628a9 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:52.457214 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-722f60ee-8f1d-4f29-9933-c963a2b19e9a req-ca31d855-c504-4d9a-a4c3-9562ee6628a9 service nova] Creating event network-vif-deleted:c220ba99-370f-4b06-9e09-e51bbee95599 for instance 02b78db0-d679-4f8d-99e3-26a3d5de40b8 on n-h2-master-1 Oct 30 02:28:52.462177 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-722f60ee-8f1d-4f29-9933-c963a2b19e9a req-ca31d855-c504-4d9a-a4c3-9562ee6628a9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034804 Oct 30 02:28:52.465099 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3654/7641] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:28:53.451439 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b05593d5-55a2-4527-a6fd-a68eae1a2c0d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:28:53.451999 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b05593d5-55a2-4527-a6fd-a68eae1a2c0d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: 02b78db0-d679-4f8d-99e3-26a3d5de40b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:28:53.459354 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b05593d5-55a2-4527-a6fd-a68eae1a2c0d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:53.459844 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b05593d5-55a2-4527-a6fd-a68eae1a2c0d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:53.460288 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b05593d5-55a2-4527-a6fd-a68eae1a2c0d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:53.460980 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b05593d5-55a2-4527-a6fd-a68eae1a2c0d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:53.461476 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b05593d5-55a2-4527-a6fd-a68eae1a2c0d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:53.461912 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b05593d5-55a2-4527-a6fd-a68eae1a2c0d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:53.493993 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b05593d5-55a2-4527-a6fd-a68eae1a2c0d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:53.494494 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b05593d5-55a2-4527-a6fd-a68eae1a2c0d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:53.494936 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b05593d5-55a2-4527-a6fd-a68eae1a2c0d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:53.495398 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-b05593d5-55a2-4527-a6fd-a68eae1a2c0d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lazy-loading 'fault' on Instance uuid 02b78db0-d679-4f8d-99e3-26a3d5de40b8 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 02:28:53.536352 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b05593d5-55a2-4527-a6fd-a68eae1a2c0d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620bbcf5f19d4cfbb8b39de0272870e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd17e8c4aa24960a8b46e4721e2acc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:28:53.543431 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b05593d5-55a2-4527-a6fd-a68eae1a2c0d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/02b78db0-d679-4f8d-99e3-26a3d5de40b8" status: 200 len: 1352 microversion: 2.1 time: 0.096017 Oct 30 02:28:53.544005 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3988/7642] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:28:53 2022] GET /compute/v2.1/servers/02b78db0-d679-4f8d-99e3-26a3d5de40b8 => generated 1352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:28:54.567529 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8ebe112d-927b-4215-ba17-9f6951ea14d2 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:28:54.568236 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8ebe112d-927b-4215-ba17-9f6951ea14d2 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: 02b78db0-d679-4f8d-99e3-26a3d5de40b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:28:54.574696 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ebe112d-927b-4215-ba17-9f6951ea14d2 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:54.575200 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ebe112d-927b-4215-ba17-9f6951ea14d2 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:54.575632 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ebe112d-927b-4215-ba17-9f6951ea14d2 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:54.576317 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ebe112d-927b-4215-ba17-9f6951ea14d2 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:54.576767 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ebe112d-927b-4215-ba17-9f6951ea14d2 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:54.577186 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ebe112d-927b-4215-ba17-9f6951ea14d2 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:54.590133 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-8ebe112d-927b-4215-ba17-9f6951ea14d2 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] HTTP exception thrown: Instance 02b78db0-d679-4f8d-99e3-26a3d5de40b8 could not be found. Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8ebe112d-927b-4215-ba17-9f6951ea14d2 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Request method failure captured: Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/02b78db0-d679-4f8d-99e3-26a3d5de40b8 HTTP/1.1 Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXeEK9QRMKpue-1_CAUN0nxT9SAWD0kaFatv9C7OVjZYraPcctja2AazGHqhBOq6LnX1PegLz8iyumG9Uq76GXVbEwti5u80AbvIbKIL2tu1SGTyf0cb0qF_VDsMq0t-VgWm1QBc6YgWxXJGukVVzGwRb9JGj6Yqt98XF2fW3lisFqgE Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: bfd17e8c4aa24960a8b46e4721e2acc7 Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1412150866 Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/bfd17e8c4aa24960a8b46e4721e2acc7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_bfd17e8c4aa24960a8b46e4721e2acc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/bfd17e8c4aa24960a8b46e4721e2acc7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/bfd17e8c4aa24960a8b46e4721e2acc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-TestEncryptedCinderVolumes-1412150866 Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: bfd17e8c4aa24960a8b46e4721e2acc7 Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1412150866 Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-TestEncryptedCinderVolumes-1412150866-project Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 620bbcf5f19d4cfbb8b39de0272870e4 Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-TestEncryptedCinderVolumes-1412150866-project Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 02b78db0-d679-4f8d-99e3-26a3d5de40b8 could not be found. Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '02b78db0-d679-4f8d-99e3-26a3d5de40b8'} Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02b78db0-d679-4f8d-99e3-26a3d5de40b8 could not be found. Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02b78db0-d679-4f8d-99e3-26a3d5de40b8 could not be found. Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:28:54.591719 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:28:54.596796 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:28:54.596796 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:28:54.596796 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:28:54.596796 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:28:54.596796 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:28:54.596796 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:28:54.596796 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02b78db0-d679-4f8d-99e3-26a3d5de40b8 could not be found. Oct 30 02:28:54.596796 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:28:54.596796 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8ebe112d-927b-4215-ba17-9f6951ea14d2 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Returning 404 to user: Instance 02b78db0-d679-4f8d-99e3-26a3d5de40b8 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:28:54.596796 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8ebe112d-927b-4215-ba17-9f6951ea14d2 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/02b78db0-d679-4f8d-99e3-26a3d5de40b8" status: 404 len: 111 microversion: 2.1 time: 0.031204 Oct 30 02:28:54.596796 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3655/7643] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:28:54 2022] GET /compute/v2.1/servers/02b78db0-d679-4f8d-99e3-26a3d5de40b8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 02:28:54.602619 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-984c26db-a01c-417e-b4af-711b678c8b95 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '.version_select at 0x7f44d03f5a60>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:28:54.716989 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-984c26db-a01c-417e-b4af-711b678c8b95 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1846230351" status: 202 len: 0 microversion: 2.1 time: 0.118108 Oct 30 02:28:54.717550 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3989/7644] 10.222.0.13 () {58 vars in 1278 bytes} [Sun Oct 30 02:28:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1846230351 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 02:28:54.735999 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-64357f00-1f0b-4e8c-9e79-e7faac63c403 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Action: 'create', calling method: .version_select at 0x7f44c73b2dc0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-920439603", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHZuwX7So0QHFl88zZ6WZ77wG3o8ZOIioBSvuoeqYTzv5LMtAfXMTX7e8P7u57WX2+NrM3KnyAGhmluHCDWc3dtqImcRpSHtZNs8Em80nrzzfEximSF8qgmfUEnWEwDgA=="}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:28:54.752627 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-64357f00-1f0b-4e8c-9e79-e7faac63c403 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Getting quotas for project bfd17e8c4aa24960a8b46e4721e2acc7. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 02:28:54.757875 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-64357f00-1f0b-4e8c-9e79-e7faac63c403 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Getting quotas for user 620bbcf5f19d4cfbb8b39de0272870e4 and project bfd17e8c4aa24960a8b46e4721e2acc7. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 02:28:54.831118 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-64357f00-1f0b-4e8c-9e79-e7faac63c403 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.098984 Oct 30 02:28:54.831866 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3656/7645] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 30 02:28:54 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:28:55.019938 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a7a66f2a-0240-40f4-bef5-e2528e3cef42 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1519422486", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-920439603", "networks": [{"uuid": "2289005a-70ca-444d-9825-ca9817f8719a"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:28:55.072287 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-a7a66f2a-0240-40f4-bef5-e2528e3cef42 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] validate_networks() for [('2289005a-70ca-444d-9825-ca9817f8719a', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 02:28:55.439444 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-a7a66f2a-0240-40f4-bef5-e2528e3cef42 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 02:28:55.439923 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-a7a66f2a-0240-40f4-bef5-e2528e3cef42 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 02:28:55.440415 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-a7a66f2a-0240-40f4-bef5-e2528e3cef42 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 02:28:55.441436 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-a7a66f2a-0240-40f4-bef5-e2528e3cef42 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 02:28:55.441878 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-a7a66f2a-0240-40f4-bef5-e2528e3cef42 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 02:28:55.450786 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7a66f2a-0240-40f4-bef5-e2528e3cef42 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:55.451282 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7a66f2a-0240-40f4-bef5-e2528e3cef42 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:55.451732 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7a66f2a-0240-40f4-bef5-e2528e3cef42 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:55.452477 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7a66f2a-0240-40f4-bef5-e2528e3cef42 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:55.452947 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7a66f2a-0240-40f4-bef5-e2528e3cef42 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:55.453417 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7a66f2a-0240-40f4-bef5-e2528e3cef42 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:55.471179 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-a7a66f2a-0240-40f4-bef5-e2528e3cef42 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Getting quotas for project bfd17e8c4aa24960a8b46e4721e2acc7. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 02:28:55.476915 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-a7a66f2a-0240-40f4-bef5-e2528e3cef42 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Getting quotas for user 620bbcf5f19d4cfbb8b39de0272870e4 and project bfd17e8c4aa24960a8b46e4721e2acc7. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 02:28:55.489844 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a7a66f2a-0240-40f4-bef5-e2528e3cef42 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 02:28:55.492170 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a7a66f2a-0240-40f4-bef5-e2528e3cef42 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: 15b46004-3316-4c23-8ff1-99cff47dbde8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 02:28:55.603934 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a7a66f2a-0240-40f4-bef5-e2528e3cef42 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.588425 Oct 30 02:28:55.604567 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3990/7646] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 02:28:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 02:28:55.617127 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5e732f0c-be26-4b9e-baee-6dee64c08e5a tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:28:55.617817 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5e732f0c-be26-4b9e-baee-6dee64c08e5a tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: 15b46004-3316-4c23-8ff1-99cff47dbde8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:28:55.674203 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5e732f0c-be26-4b9e-baee-6dee64c08e5a tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620bbcf5f19d4cfbb8b39de0272870e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd17e8c4aa24960a8b46e4721e2acc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:28:55.681757 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5e732f0c-be26-4b9e-baee-6dee64c08e5a tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/15b46004-3316-4c23-8ff1-99cff47dbde8" status: 200 len: 1262 microversion: 2.1 time: 0.069956 Oct 30 02:28:55.682485 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3657/7647] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:28:55 2022] GET /compute/v2.1/servers/15b46004-3316-4c23-8ff1-99cff47dbde8 => generated 1262 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:28:56.704679 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-920baabb-a08f-4b7f-a5f7-39d3ec703436 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:28:56.705310 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-920baabb-a08f-4b7f-a5f7-39d3ec703436 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: 15b46004-3316-4c23-8ff1-99cff47dbde8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:28:56.712153 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-920baabb-a08f-4b7f-a5f7-39d3ec703436 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:56.712660 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-920baabb-a08f-4b7f-a5f7-39d3ec703436 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:56.713113 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-920baabb-a08f-4b7f-a5f7-39d3ec703436 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:56.715467 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-920baabb-a08f-4b7f-a5f7-39d3ec703436 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:56.715467 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-920baabb-a08f-4b7f-a5f7-39d3ec703436 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:56.715467 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-920baabb-a08f-4b7f-a5f7-39d3ec703436 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:56.786933 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-920baabb-a08f-4b7f-a5f7-39d3ec703436 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620bbcf5f19d4cfbb8b39de0272870e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd17e8c4aa24960a8b46e4721e2acc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:28:56.795497 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-920baabb-a08f-4b7f-a5f7-39d3ec703436 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/15b46004-3316-4c23-8ff1-99cff47dbde8" status: 200 len: 1266 microversion: 2.1 time: 0.095550 Oct 30 02:28:56.796088 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3991/7648] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:28:56 2022] GET /compute/v2.1/servers/15b46004-3316-4c23-8ff1-99cff47dbde8 => generated 1266 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:28:57.819916 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-76b43893-afca-4f47-b53c-14ce574e2f67 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:28:57.822198 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-76b43893-afca-4f47-b53c-14ce574e2f67 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: 15b46004-3316-4c23-8ff1-99cff47dbde8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:28:57.828010 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-76b43893-afca-4f47-b53c-14ce574e2f67 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:57.828503 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-76b43893-afca-4f47-b53c-14ce574e2f67 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:57.828939 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-76b43893-afca-4f47-b53c-14ce574e2f67 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:57.829672 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-76b43893-afca-4f47-b53c-14ce574e2f67 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:57.830129 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-76b43893-afca-4f47-b53c-14ce574e2f67 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:57.830701 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-76b43893-afca-4f47-b53c-14ce574e2f67 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:57.910848 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-76b43893-afca-4f47-b53c-14ce574e2f67 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620bbcf5f19d4cfbb8b39de0272870e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd17e8c4aa24960a8b46e4721e2acc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:28:57.918964 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-76b43893-afca-4f47-b53c-14ce574e2f67 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/15b46004-3316-4c23-8ff1-99cff47dbde8" status: 200 len: 1322 microversion: 2.1 time: 0.103549 Oct 30 02:28:57.921693 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3658/7649] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:28:57 2022] GET /compute/v2.1/servers/15b46004-3316-4c23-8ff1-99cff47dbde8 => generated 1322 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:28:58.942335 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fb20efe7-d52d-417c-a231-4eba72298f2c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:28:58.945855 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fb20efe7-d52d-417c-a231-4eba72298f2c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: 15b46004-3316-4c23-8ff1-99cff47dbde8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:28:58.950513 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb20efe7-d52d-417c-a231-4eba72298f2c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:58.951005 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb20efe7-d52d-417c-a231-4eba72298f2c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:58.951579 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb20efe7-d52d-417c-a231-4eba72298f2c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:58.952287 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb20efe7-d52d-417c-a231-4eba72298f2c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:58.952750 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb20efe7-d52d-417c-a231-4eba72298f2c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:58.953185 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fb20efe7-d52d-417c-a231-4eba72298f2c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:59.089546 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-fb20efe7-d52d-417c-a231-4eba72298f2c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620bbcf5f19d4cfbb8b39de0272870e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd17e8c4aa24960a8b46e4721e2acc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:28:59.097257 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fb20efe7-d52d-417c-a231-4eba72298f2c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/15b46004-3316-4c23-8ff1-99cff47dbde8" status: 200 len: 1362 microversion: 2.1 time: 0.158809 Oct 30 02:28:59.097779 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3992/7650] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:28:58 2022] GET /compute/v2.1/servers/15b46004-3316-4c23-8ff1-99cff47dbde8 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:28:59.429304 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-e157f747-354b-470c-a498-fa8ca29cb6d0 req-c6bac7bf-f240-43d1-b13a-f8d2648b2a54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15b46004-3316-4c23-8ff1-99cff47dbde8", "tag": "dee0571b-acbf-46c3-91a3-c497d5fac91c"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:28:59.439757 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e157f747-354b-470c-a498-fa8ca29cb6d0 req-c6bac7bf-f240-43d1-b13a-f8d2648b2a54 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:28:59.440246 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e157f747-354b-470c-a498-fa8ca29cb6d0 req-c6bac7bf-f240-43d1-b13a-f8d2648b2a54 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:28:59.440680 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e157f747-354b-470c-a498-fa8ca29cb6d0 req-c6bac7bf-f240-43d1-b13a-f8d2648b2a54 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:28:59.452185 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-e157f747-354b-470c-a498-fa8ca29cb6d0 req-c6bac7bf-f240-43d1-b13a-f8d2648b2a54 service nova] Creating event network-changed:dee0571b-acbf-46c3-91a3-c497d5fac91c for instance 15b46004-3316-4c23-8ff1-99cff47dbde8 on n-h2-master-1 Oct 30 02:28:59.457204 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-e157f747-354b-470c-a498-fa8ca29cb6d0 req-c6bac7bf-f240-43d1-b13a-f8d2648b2a54 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032223 Oct 30 02:28:59.457855 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3659/7651] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:29:00.120194 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-88f73622-8e32-4c55-97e6-a2925963113b tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:29:00.120830 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-88f73622-8e32-4c55-97e6-a2925963113b tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: 15b46004-3316-4c23-8ff1-99cff47dbde8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:29:00.127941 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-88f73622-8e32-4c55-97e6-a2925963113b tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:29:00.128447 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-88f73622-8e32-4c55-97e6-a2925963113b tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:29:00.128972 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-88f73622-8e32-4c55-97e6-a2925963113b tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:29:00.129723 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-88f73622-8e32-4c55-97e6-a2925963113b tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:29:00.130197 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-88f73622-8e32-4c55-97e6-a2925963113b tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:29:00.130644 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-88f73622-8e32-4c55-97e6-a2925963113b tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:29:00.260603 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-88f73622-8e32-4c55-97e6-a2925963113b tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620bbcf5f19d4cfbb8b39de0272870e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd17e8c4aa24960a8b46e4721e2acc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:29:00.268357 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-88f73622-8e32-4c55-97e6-a2925963113b tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/15b46004-3316-4c23-8ff1-99cff47dbde8" status: 200 len: 1362 microversion: 2.1 time: 0.152195 Oct 30 02:29:00.268934 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3993/7652] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:29:00 2022] GET /compute/v2.1/servers/15b46004-3316-4c23-8ff1-99cff47dbde8 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:29:01.293686 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-06d00deb-8ec2-4057-9edf-4617f0f8c2c0 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:29:01.294392 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-06d00deb-8ec2-4057-9edf-4617f0f8c2c0 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: 15b46004-3316-4c23-8ff1-99cff47dbde8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:29:01.300850 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-06d00deb-8ec2-4057-9edf-4617f0f8c2c0 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:29:01.301364 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-06d00deb-8ec2-4057-9edf-4617f0f8c2c0 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:29:01.301799 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-06d00deb-8ec2-4057-9edf-4617f0f8c2c0 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:29:01.302492 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-06d00deb-8ec2-4057-9edf-4617f0f8c2c0 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:29:01.303601 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-06d00deb-8ec2-4057-9edf-4617f0f8c2c0 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:29:01.304034 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-06d00deb-8ec2-4057-9edf-4617f0f8c2c0 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:29:01.431661 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-06d00deb-8ec2-4057-9edf-4617f0f8c2c0 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620bbcf5f19d4cfbb8b39de0272870e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd17e8c4aa24960a8b46e4721e2acc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:29:01.439381 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-06d00deb-8ec2-4057-9edf-4617f0f8c2c0 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/15b46004-3316-4c23-8ff1-99cff47dbde8" status: 200 len: 1362 microversion: 2.1 time: 0.150965 Oct 30 02:29:01.439954 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3660/7653] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:29:01 2022] GET /compute/v2.1/servers/15b46004-3316-4c23-8ff1-99cff47dbde8 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:29:02.461945 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-99d2f051-e037-47d8-9294-f768f465e400 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:29:02.462586 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-99d2f051-e037-47d8-9294-f768f465e400 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: 15b46004-3316-4c23-8ff1-99cff47dbde8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:29:02.469560 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-99d2f051-e037-47d8-9294-f768f465e400 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:29:02.470066 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-99d2f051-e037-47d8-9294-f768f465e400 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:29:02.470521 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-99d2f051-e037-47d8-9294-f768f465e400 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:29:02.471234 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-99d2f051-e037-47d8-9294-f768f465e400 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:29:02.471708 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-99d2f051-e037-47d8-9294-f768f465e400 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:29:02.472153 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-99d2f051-e037-47d8-9294-f768f465e400 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:29:02.607566 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-99d2f051-e037-47d8-9294-f768f465e400 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620bbcf5f19d4cfbb8b39de0272870e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd17e8c4aa24960a8b46e4721e2acc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:29:02.615840 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-99d2f051-e037-47d8-9294-f768f465e400 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/15b46004-3316-4c23-8ff1-99cff47dbde8" status: 200 len: 1362 microversion: 2.1 time: 0.157387 Oct 30 02:29:02.616452 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3994/7654] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:29:02 2022] GET /compute/v2.1/servers/15b46004-3316-4c23-8ff1-99cff47dbde8 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:29:03.639284 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-871a1a14-e456-4a3b-9a37-291357ddc6c2 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:29:03.639826 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-871a1a14-e456-4a3b-9a37-291357ddc6c2 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: 15b46004-3316-4c23-8ff1-99cff47dbde8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:29:03.646167 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-871a1a14-e456-4a3b-9a37-291357ddc6c2 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:29:03.647244 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-871a1a14-e456-4a3b-9a37-291357ddc6c2 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:29:03.647709 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-871a1a14-e456-4a3b-9a37-291357ddc6c2 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:29:03.648384 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-871a1a14-e456-4a3b-9a37-291357ddc6c2 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:29:03.648866 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-871a1a14-e456-4a3b-9a37-291357ddc6c2 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:29:03.649292 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-871a1a14-e456-4a3b-9a37-291357ddc6c2 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:29:03.782038 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-871a1a14-e456-4a3b-9a37-291357ddc6c2 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620bbcf5f19d4cfbb8b39de0272870e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd17e8c4aa24960a8b46e4721e2acc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:29:03.789692 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-871a1a14-e456-4a3b-9a37-291357ddc6c2 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/15b46004-3316-4c23-8ff1-99cff47dbde8" status: 200 len: 1362 microversion: 2.1 time: 0.154400 Oct 30 02:29:03.790271 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3661/7655] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:29:03 2022] GET /compute/v2.1/servers/15b46004-3316-4c23-8ff1-99cff47dbde8 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:29:04.812463 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0042a077-43fe-49ea-87f5-a97d330c9473 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:29:04.813001 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0042a077-43fe-49ea-87f5-a97d330c9473 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: 15b46004-3316-4c23-8ff1-99cff47dbde8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:29:04.820008 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0042a077-43fe-49ea-87f5-a97d330c9473 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:29:04.820507 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0042a077-43fe-49ea-87f5-a97d330c9473 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:29:04.820961 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0042a077-43fe-49ea-87f5-a97d330c9473 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:29:04.821718 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0042a077-43fe-49ea-87f5-a97d330c9473 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:29:04.822189 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0042a077-43fe-49ea-87f5-a97d330c9473 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:29:04.822644 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0042a077-43fe-49ea-87f5-a97d330c9473 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:29:04.952042 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0042a077-43fe-49ea-87f5-a97d330c9473 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620bbcf5f19d4cfbb8b39de0272870e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd17e8c4aa24960a8b46e4721e2acc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:29:04.959765 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0042a077-43fe-49ea-87f5-a97d330c9473 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/15b46004-3316-4c23-8ff1-99cff47dbde8" status: 200 len: 1362 microversion: 2.1 time: 0.151334 Oct 30 02:29:04.960341 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3995/7656] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:29:04 2022] GET /compute/v2.1/servers/15b46004-3316-4c23-8ff1-99cff47dbde8 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:29:05.795638 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=6 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:29:05.846250 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-c3889833-5b3f-402c-ace0-c298bf05c549 req-bcb6b889-7844-4fa8-a190-11c758951905 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15b46004-3316-4c23-8ff1-99cff47dbde8", "name": "network-vif-plugged", "status": "completed", "tag": "dee0571b-acbf-46c3-91a3-c497d5fac91c"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:29:05.856060 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-c3889833-5b3f-402c-ace0-c298bf05c549 req-bcb6b889-7844-4fa8-a190-11c758951905 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:29:05.856545 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-c3889833-5b3f-402c-ace0-c298bf05c549 req-bcb6b889-7844-4fa8-a190-11c758951905 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:29:05.856971 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-c3889833-5b3f-402c-ace0-c298bf05c549 req-bcb6b889-7844-4fa8-a190-11c758951905 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:29:05.868605 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-c3889833-5b3f-402c-ace0-c298bf05c549 req-bcb6b889-7844-4fa8-a190-11c758951905 service nova] Creating event network-vif-plugged:dee0571b-acbf-46c3-91a3-c497d5fac91c for instance 15b46004-3316-4c23-8ff1-99cff47dbde8 on n-h2-master-1 Oct 30 02:29:05.873404 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-c3889833-5b3f-402c-ace0-c298bf05c549 req-bcb6b889-7844-4fa8-a190-11c758951905 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084037 Oct 30 02:29:05.873998 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3662/7657] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:29:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:29:05.983787 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cec2f409-1676-49b0-8290-2f577a42e58d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:29:05.984453 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cec2f409-1676-49b0-8290-2f577a42e58d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: 15b46004-3316-4c23-8ff1-99cff47dbde8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:29:05.986428 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:29:05.987118 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=6 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:29:05.993615 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cec2f409-1676-49b0-8290-2f577a42e58d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:29:05.995673 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cec2f409-1676-49b0-8290-2f577a42e58d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:29:05.995673 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cec2f409-1676-49b0-8290-2f577a42e58d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:29:05.995673 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cec2f409-1676-49b0-8290-2f577a42e58d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:29:05.995991 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cec2f409-1676-49b0-8290-2f577a42e58d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:29:05.996248 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cec2f409-1676-49b0-8290-2f577a42e58d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:29:06.131007 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-cec2f409-1676-49b0-8290-2f577a42e58d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620bbcf5f19d4cfbb8b39de0272870e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd17e8c4aa24960a8b46e4721e2acc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:29:06.138806 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cec2f409-1676-49b0-8290-2f577a42e58d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/15b46004-3316-4c23-8ff1-99cff47dbde8" status: 200 len: 1362 microversion: 2.1 time: 0.159485 Oct 30 02:29:06.139376 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3996/7658] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:29:05 2022] GET /compute/v2.1/servers/15b46004-3316-4c23-8ff1-99cff47dbde8 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:29:07.162605 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b70d7522-1b2b-464c-8b43-ab39178f8527 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:29:07.163385 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b70d7522-1b2b-464c-8b43-ab39178f8527 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: 15b46004-3316-4c23-8ff1-99cff47dbde8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:29:07.171760 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b70d7522-1b2b-464c-8b43-ab39178f8527 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:29:07.172245 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b70d7522-1b2b-464c-8b43-ab39178f8527 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:29:07.172751 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b70d7522-1b2b-464c-8b43-ab39178f8527 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:29:07.173743 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b70d7522-1b2b-464c-8b43-ab39178f8527 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:29:07.174214 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b70d7522-1b2b-464c-8b43-ab39178f8527 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:29:07.174638 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b70d7522-1b2b-464c-8b43-ab39178f8527 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:29:07.317965 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b70d7522-1b2b-464c-8b43-ab39178f8527 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620bbcf5f19d4cfbb8b39de0272870e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd17e8c4aa24960a8b46e4721e2acc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:29:07.326319 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b70d7522-1b2b-464c-8b43-ab39178f8527 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/15b46004-3316-4c23-8ff1-99cff47dbde8" status: 200 len: 1555 microversion: 2.1 time: 0.168674 Oct 30 02:29:07.326897 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3663/7659] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:29:07 2022] GET /compute/v2.1/servers/15b46004-3316-4c23-8ff1-99cff47dbde8 => generated 1555 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:29:07.348490 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-57b8d1ae-f573-4792-842a-5d8d42d8fb78 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:29:07.349492 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-57b8d1ae-f573-4792-842a-5d8d42d8fb78 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: 15b46004-3316-4c23-8ff1-99cff47dbde8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:29:07.356684 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-57b8d1ae-f573-4792-842a-5d8d42d8fb78 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:29:07.357182 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-57b8d1ae-f573-4792-842a-5d8d42d8fb78 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:29:07.357719 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-57b8d1ae-f573-4792-842a-5d8d42d8fb78 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:29:07.358412 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-57b8d1ae-f573-4792-842a-5d8d42d8fb78 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:29:07.358885 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-57b8d1ae-f573-4792-842a-5d8d42d8fb78 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:29:07.359324 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-57b8d1ae-f573-4792-842a-5d8d42d8fb78 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:29:07.488897 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-57b8d1ae-f573-4792-842a-5d8d42d8fb78 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620bbcf5f19d4cfbb8b39de0272870e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd17e8c4aa24960a8b46e4721e2acc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:29:07.496733 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-57b8d1ae-f573-4792-842a-5d8d42d8fb78 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/15b46004-3316-4c23-8ff1-99cff47dbde8" status: 200 len: 1555 microversion: 2.1 time: 0.152083 Oct 30 02:29:07.497309 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3997/7660] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:29:07 2022] GET /compute/v2.1/servers/15b46004-3316-4c23-8ff1-99cff47dbde8 => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:29:10.507091 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8aed8470-c0b6-439a-be9d-f25b9b38695b tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b45cd965-d370-4d7a-a1e1-8a0128c7034c"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:29:10.509558 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8aed8470-c0b6-439a-be9d-f25b9b38695b tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: 15b46004-3316-4c23-8ff1-99cff47dbde8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:29:10.512322 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:29:10.517008 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8aed8470-c0b6-439a-be9d-f25b9b38695b tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:29:10.517539 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8aed8470-c0b6-439a-be9d-f25b9b38695b tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:29:10.517980 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8aed8470-c0b6-439a-be9d-f25b9b38695b tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:29:10.518671 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8aed8470-c0b6-439a-be9d-f25b9b38695b tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:29:10.519126 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8aed8470-c0b6-439a-be9d-f25b9b38695b tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:29:10.519555 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8aed8470-c0b6-439a-be9d-f25b9b38695b tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:29:10.521978 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=80,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:29:11.147109 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8aed8470-c0b6-439a-be9d-f25b9b38695b tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "POST /compute/v2.1/servers/15b46004-3316-4c23-8ff1-99cff47dbde8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.643712 Oct 30 02:29:11.147649 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3664/7661] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 30 02:29:10 2022] POST /compute/v2.1/servers/15b46004-3316-4c23-8ff1-99cff47dbde8/os-volume_attachments => generated 194 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:29:22.909317 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-147fa5fd-6bd4-48f6-b586-bc526ef3a457 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:29:22.909894 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-147fa5fd-6bd4-48f6-b586-bc526ef3a457 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: 15b46004-3316-4c23-8ff1-99cff47dbde8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:29:22.912669 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:29:22.913376 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=88 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:29:22.918710 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-147fa5fd-6bd4-48f6-b586-bc526ef3a457 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:29:22.919212 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-147fa5fd-6bd4-48f6-b586-bc526ef3a457 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:29:22.919666 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-147fa5fd-6bd4-48f6-b586-bc526ef3a457 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:29:22.920379 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-147fa5fd-6bd4-48f6-b586-bc526ef3a457 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:29:22.920844 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-147fa5fd-6bd4-48f6-b586-bc526ef3a457 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:29:22.921285 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-147fa5fd-6bd4-48f6-b586-bc526ef3a457 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:29:23.000075 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-147fa5fd-6bd4-48f6-b586-bc526ef3a457 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lazy-loading 'services' on Instance uuid 15b46004-3316-4c23-8ff1-99cff47dbde8 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 02:29:23.257056 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-147fa5fd-6bd4-48f6-b586-bc526ef3a457 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "DELETE /compute/v2.1/servers/15b46004-3316-4c23-8ff1-99cff47dbde8/os-volume_attachments/b45cd965-d370-4d7a-a1e1-8a0128c7034c" status: 202 len: 0 microversion: 2.1 time: 0.351947 Oct 30 02:29:23.257709 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3998/7662] 10.222.0.13 () {58 vars in 1416 bytes} [Sun Oct 30 02:29:22 2022] DELETE /compute/v2.1/servers/15b46004-3316-4c23-8ff1-99cff47dbde8/os-volume_attachments/b45cd965-d370-4d7a-a1e1-8a0128c7034c => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 02:29:23.264842 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:29:23.275363 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=10,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:29:23.275363 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a4e62bab-3f14-4472-b262-66369e9ebb03 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:29:23.275363 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a4e62bab-3f14-4472-b262-66369e9ebb03 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: 15b46004-3316-4c23-8ff1-99cff47dbde8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:29:23.279562 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a4e62bab-3f14-4472-b262-66369e9ebb03 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:29:23.280022 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a4e62bab-3f14-4472-b262-66369e9ebb03 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:29:23.280463 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a4e62bab-3f14-4472-b262-66369e9ebb03 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:29:23.281166 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a4e62bab-3f14-4472-b262-66369e9ebb03 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:29:23.281646 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a4e62bab-3f14-4472-b262-66369e9ebb03 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:29:23.282075 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a4e62bab-3f14-4472-b262-66369e9ebb03 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:29:23.313016 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a4e62bab-3f14-4472-b262-66369e9ebb03 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/15b46004-3316-4c23-8ff1-99cff47dbde8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050076 Oct 30 02:29:23.313605 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3665/7663] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 02:29:23 2022] GET /compute/v2.1/servers/15b46004-3316-4c23-8ff1-99cff47dbde8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:29:24.327321 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b3d80551-8fd0-47bc-8100-beda10e17e3d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:29:24.329706 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b3d80551-8fd0-47bc-8100-beda10e17e3d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: 15b46004-3316-4c23-8ff1-99cff47dbde8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:29:24.336164 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b3d80551-8fd0-47bc-8100-beda10e17e3d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:29:24.336668 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b3d80551-8fd0-47bc-8100-beda10e17e3d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:29:24.337122 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b3d80551-8fd0-47bc-8100-beda10e17e3d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:29:24.337884 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b3d80551-8fd0-47bc-8100-beda10e17e3d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:29:24.338844 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b3d80551-8fd0-47bc-8100-beda10e17e3d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:29:24.339285 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b3d80551-8fd0-47bc-8100-beda10e17e3d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:29:24.370762 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b3d80551-8fd0-47bc-8100-beda10e17e3d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/15b46004-3316-4c23-8ff1-99cff47dbde8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048719 Oct 30 02:29:24.371340 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3999/7664] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 02:29:24 2022] GET /compute/v2.1/servers/15b46004-3316-4c23-8ff1-99cff47dbde8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:29:25.382731 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-481defc9-3a72-49e4-a5f8-e0cff737985d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:29:25.384962 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-481defc9-3a72-49e4-a5f8-e0cff737985d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: 15b46004-3316-4c23-8ff1-99cff47dbde8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:29:25.392696 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-481defc9-3a72-49e4-a5f8-e0cff737985d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:29:25.393190 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-481defc9-3a72-49e4-a5f8-e0cff737985d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:29:25.393655 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-481defc9-3a72-49e4-a5f8-e0cff737985d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:29:25.394367 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-481defc9-3a72-49e4-a5f8-e0cff737985d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:29:25.394822 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-481defc9-3a72-49e4-a5f8-e0cff737985d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:29:25.395247 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-481defc9-3a72-49e4-a5f8-e0cff737985d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:29:25.428778 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-481defc9-3a72-49e4-a5f8-e0cff737985d tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/15b46004-3316-4c23-8ff1-99cff47dbde8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050156 Oct 30 02:29:25.429422 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3666/7665] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 02:29:25 2022] GET /compute/v2.1/servers/15b46004-3316-4c23-8ff1-99cff47dbde8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:29:26.448262 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-69df40e9-0bf6-44ba-a7ec-b7290a84ef36 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:29:26.450671 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-69df40e9-0bf6-44ba-a7ec-b7290a84ef36 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: 15b46004-3316-4c23-8ff1-99cff47dbde8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:29:26.457574 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-69df40e9-0bf6-44ba-a7ec-b7290a84ef36 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:29:26.458077 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-69df40e9-0bf6-44ba-a7ec-b7290a84ef36 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:29:26.458533 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-69df40e9-0bf6-44ba-a7ec-b7290a84ef36 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:29:26.459241 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-69df40e9-0bf6-44ba-a7ec-b7290a84ef36 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:29:26.459711 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-69df40e9-0bf6-44ba-a7ec-b7290a84ef36 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:29:26.460146 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-69df40e9-0bf6-44ba-a7ec-b7290a84ef36 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:29:26.492653 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-69df40e9-0bf6-44ba-a7ec-b7290a84ef36 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/15b46004-3316-4c23-8ff1-99cff47dbde8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049182 Oct 30 02:29:26.493131 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4000/7666] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 02:29:26 2022] GET /compute/v2.1/servers/15b46004-3316-4c23-8ff1-99cff47dbde8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:29:27.506093 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b3bffdf6-a61b-45bd-b86d-6b1bb883a619 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:29:27.508420 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b3bffdf6-a61b-45bd-b86d-6b1bb883a619 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: 15b46004-3316-4c23-8ff1-99cff47dbde8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:29:27.516677 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3bffdf6-a61b-45bd-b86d-6b1bb883a619 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:29:27.517170 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3bffdf6-a61b-45bd-b86d-6b1bb883a619 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:29:27.517710 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3bffdf6-a61b-45bd-b86d-6b1bb883a619 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:29:27.518432 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3bffdf6-a61b-45bd-b86d-6b1bb883a619 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:29:27.518879 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3bffdf6-a61b-45bd-b86d-6b1bb883a619 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:29:27.519298 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3bffdf6-a61b-45bd-b86d-6b1bb883a619 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:29:27.549944 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b3bffdf6-a61b-45bd-b86d-6b1bb883a619 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/15b46004-3316-4c23-8ff1-99cff47dbde8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047773 Oct 30 02:29:27.551507 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3667/7667] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 02:29:27 2022] GET /compute/v2.1/servers/15b46004-3316-4c23-8ff1-99cff47dbde8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:29:28.562431 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1526fdab-cba6-471b-99e5-33ecffa05297 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:29:28.564663 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1526fdab-cba6-471b-99e5-33ecffa05297 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: 15b46004-3316-4c23-8ff1-99cff47dbde8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:29:28.571644 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1526fdab-cba6-471b-99e5-33ecffa05297 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:29:28.572140 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1526fdab-cba6-471b-99e5-33ecffa05297 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:29:28.572588 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1526fdab-cba6-471b-99e5-33ecffa05297 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:29:28.573290 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1526fdab-cba6-471b-99e5-33ecffa05297 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:29:28.573780 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1526fdab-cba6-471b-99e5-33ecffa05297 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:29:28.574220 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1526fdab-cba6-471b-99e5-33ecffa05297 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:29:28.603985 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1526fdab-cba6-471b-99e5-33ecffa05297 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/15b46004-3316-4c23-8ff1-99cff47dbde8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045597 Oct 30 02:29:28.604542 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4001/7668] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 02:29:28 2022] GET /compute/v2.1/servers/15b46004-3316-4c23-8ff1-99cff47dbde8/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 02:29:28.616000 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-45930c9a-3144-470c-8256-676c731c0cb7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:29:28.616513 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-45930c9a-3144-470c-8256-676c731c0cb7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: 15b46004-3316-4c23-8ff1-99cff47dbde8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:29:28.623178 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45930c9a-3144-470c-8256-676c731c0cb7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:29:28.623657 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45930c9a-3144-470c-8256-676c731c0cb7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:29:28.624089 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45930c9a-3144-470c-8256-676c731c0cb7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:29:28.624773 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45930c9a-3144-470c-8256-676c731c0cb7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:29:28.625221 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45930c9a-3144-470c-8256-676c731c0cb7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:29:28.625666 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45930c9a-3144-470c-8256-676c731c0cb7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:29:28.699750 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-45930c9a-3144-470c-8256-676c731c0cb7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] HTTP exception thrown: Instance 15b46004-3316-4c23-8ff1-99cff47dbde8 is not attached to volume b45cd965-d370-4d7a-a1e1-8a0128c7034c Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-45930c9a-3144-470c-8256-676c731c0cb7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Request method failure captured: Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: request: DELETE /compute/v2.1/servers/15b46004-3316-4c23-8ff1-99cff47dbde8/os-volume_attachments/b45cd965-d370-4d7a-a1e1-8a0128c7034c HTTP/1.1 Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXeEK9QRMKpue-1_CAUN0nxT9SAWD0kaFatv9C7OVjZYraPcctja2AazGHqhBOq6LnX1PegLz8iyumG9Uq76GXVbEwti5u80AbvIbKIL2tu1SGTyf0cb0qF_VDsMq0t-VgWm1QBc6YgWxXJGukVVzGwRb9JGj6Yqt98XF2fW3lisFqgE Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: bfd17e8c4aa24960a8b46e4721e2acc7 Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1412150866 Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/bfd17e8c4aa24960a8b46e4721e2acc7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_bfd17e8c4aa24960a8b46e4721e2acc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/bfd17e8c4aa24960a8b46e4721e2acc7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/bfd17e8c4aa24960a8b46e4721e2acc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-TestEncryptedCinderVolumes-1412150866 Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: bfd17e8c4aa24960a8b46e4721e2acc7 Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1412150866 Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-TestEncryptedCinderVolumes-1412150866-project Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 620bbcf5f19d4cfbb8b39de0272870e4 Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-TestEncryptedCinderVolumes-1412150866-project Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 15b46004-3316-4c23-8ff1-99cff47dbde8 is not attached to volume b45cd965-d370-4d7a-a1e1-8a0128c7034c Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: action_args: {'server_id': '15b46004-3316-4c23-8ff1-99cff47dbde8', 'id': 'b45cd965-d370-4d7a-a1e1-8a0128c7034c'} Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b45cd965-d370-4d7a-a1e1-8a0128c7034c. Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15b46004-3316-4c23-8ff1-99cff47dbde8 is not attached to volume b45cd965-d370-4d7a-a1e1-8a0128c7034c Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:29:28.701410 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:29:28.706353 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:29:28.706353 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:29:28.706353 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15b46004-3316-4c23-8ff1-99cff47dbde8 is not attached to volume b45cd965-d370-4d7a-a1e1-8a0128c7034c Oct 30 02:29:28.706353 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:29:28.706353 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-45930c9a-3144-470c-8256-676c731c0cb7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Returning 404 to user: Instance 15b46004-3316-4c23-8ff1-99cff47dbde8 is not attached to volume b45cd965-d370-4d7a-a1e1-8a0128c7034c {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:29:28.706353 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-45930c9a-3144-470c-8256-676c731c0cb7 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "DELETE /compute/v2.1/servers/15b46004-3316-4c23-8ff1-99cff47dbde8/os-volume_attachments/b45cd965-d370-4d7a-a1e1-8a0128c7034c" status: 404 len: 154 microversion: 2.1 time: 0.091037 Oct 30 02:29:28.706353 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3668/7669] 10.222.0.13 () {58 vars in 1416 bytes} [Sun Oct 30 02:29:28 2022] DELETE /compute/v2.1/servers/15b46004-3316-4c23-8ff1-99cff47dbde8/os-volume_attachments/b45cd965-d370-4d7a-a1e1-8a0128c7034c => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 02:29:32.192381 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9764365e-2c64-4cdb-a9e2-59e1a8e44b87 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:29:32.192958 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9764365e-2c64-4cdb-a9e2-59e1a8e44b87 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: 15b46004-3316-4c23-8ff1-99cff47dbde8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:29:32.200878 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9764365e-2c64-4cdb-a9e2-59e1a8e44b87 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:29:32.201565 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9764365e-2c64-4cdb-a9e2-59e1a8e44b87 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:29:32.202085 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9764365e-2c64-4cdb-a9e2-59e1a8e44b87 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:29:32.202795 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9764365e-2c64-4cdb-a9e2-59e1a8e44b87 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:29:32.203262 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9764365e-2c64-4cdb-a9e2-59e1a8e44b87 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:29:32.203700 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9764365e-2c64-4cdb-a9e2-59e1a8e44b87 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:29:32.229797 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9764365e-2c64-4cdb-a9e2-59e1a8e44b87 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: 15b46004-3316-4c23-8ff1-99cff47dbde8] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 02:29:32.561441 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9764365e-2c64-4cdb-a9e2-59e1a8e44b87 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "DELETE /compute/v2.1/servers/15b46004-3316-4c23-8ff1-99cff47dbde8" status: 204 len: 0 microversion: 2.1 time: 0.373011 Oct 30 02:29:32.562091 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4002/7670] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 02:29:32 2022] DELETE /compute/v2.1/servers/15b46004-3316-4c23-8ff1-99cff47dbde8 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 02:29:32.571058 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-87f2be69-3f25-4278-b4cc-725c9696f340 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:29:32.571682 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-87f2be69-3f25-4278-b4cc-725c9696f340 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: 15b46004-3316-4c23-8ff1-99cff47dbde8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:29:32.583008 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-87f2be69-3f25-4278-b4cc-725c9696f340 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:29:32.583509 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-87f2be69-3f25-4278-b4cc-725c9696f340 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:29:32.583950 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-87f2be69-3f25-4278-b4cc-725c9696f340 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:29:32.584659 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-87f2be69-3f25-4278-b4cc-725c9696f340 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:29:32.585295 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-87f2be69-3f25-4278-b4cc-725c9696f340 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:29:32.585792 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-87f2be69-3f25-4278-b4cc-725c9696f340 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:29:32.724559 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-87f2be69-3f25-4278-b4cc-725c9696f340 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620bbcf5f19d4cfbb8b39de0272870e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd17e8c4aa24960a8b46e4721e2acc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:29:32.733095 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-87f2be69-3f25-4278-b4cc-725c9696f340 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/15b46004-3316-4c23-8ff1-99cff47dbde8" status: 200 len: 1561 microversion: 2.1 time: 0.166506 Oct 30 02:29:32.733718 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3669/7671] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:29:32 2022] GET /compute/v2.1/servers/15b46004-3316-4c23-8ff1-99cff47dbde8 => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:29:33.757165 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c207fb66-718f-4b14-86d0-a4ac0d9bb5f0 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:29:33.757914 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c207fb66-718f-4b14-86d0-a4ac0d9bb5f0 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: 15b46004-3316-4c23-8ff1-99cff47dbde8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:29:33.765524 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c207fb66-718f-4b14-86d0-a4ac0d9bb5f0 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:29:33.766334 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c207fb66-718f-4b14-86d0-a4ac0d9bb5f0 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:29:33.766805 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c207fb66-718f-4b14-86d0-a4ac0d9bb5f0 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:29:33.767520 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c207fb66-718f-4b14-86d0-a4ac0d9bb5f0 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:29:33.767991 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c207fb66-718f-4b14-86d0-a4ac0d9bb5f0 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:29:33.768438 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c207fb66-718f-4b14-86d0-a4ac0d9bb5f0 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:29:33.898974 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c207fb66-718f-4b14-86d0-a4ac0d9bb5f0 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620bbcf5f19d4cfbb8b39de0272870e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd17e8c4aa24960a8b46e4721e2acc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:29:33.906809 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c207fb66-718f-4b14-86d0-a4ac0d9bb5f0 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/15b46004-3316-4c23-8ff1-99cff47dbde8" status: 200 len: 1561 microversion: 2.1 time: 0.154002 Oct 30 02:29:33.907386 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4003/7672] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:29:33 2022] GET /compute/v2.1/servers/15b46004-3316-4c23-8ff1-99cff47dbde8 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:29:34.886051 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-3f4c2401-2dec-45d1-b9fa-79ee76b0e12d req-b8a7b44e-9124-4637-a300-5ea7626ed862 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15b46004-3316-4c23-8ff1-99cff47dbde8", "name": "network-vif-deleted", "tag": "dee0571b-acbf-46c3-91a3-c497d5fac91c"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:29:34.897069 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-3f4c2401-2dec-45d1-b9fa-79ee76b0e12d req-b8a7b44e-9124-4637-a300-5ea7626ed862 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:29:34.897247 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-3f4c2401-2dec-45d1-b9fa-79ee76b0e12d req-b8a7b44e-9124-4637-a300-5ea7626ed862 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:29:34.897717 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-3f4c2401-2dec-45d1-b9fa-79ee76b0e12d req-b8a7b44e-9124-4637-a300-5ea7626ed862 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:29:34.909921 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-3f4c2401-2dec-45d1-b9fa-79ee76b0e12d req-b8a7b44e-9124-4637-a300-5ea7626ed862 service nova] Creating event network-vif-deleted:dee0571b-acbf-46c3-91a3-c497d5fac91c for instance 15b46004-3316-4c23-8ff1-99cff47dbde8 on n-h2-master-1 Oct 30 02:29:34.915281 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-3f4c2401-2dec-45d1-b9fa-79ee76b0e12d req-b8a7b44e-9124-4637-a300-5ea7626ed862 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032913 Oct 30 02:29:34.915889 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3670/7673] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:29:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:29:34.929741 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6a5c517a-04bc-4330-9bbe-7a674eab1f44 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:29:34.930491 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6a5c517a-04bc-4330-9bbe-7a674eab1f44 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: 15b46004-3316-4c23-8ff1-99cff47dbde8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:29:34.937501 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a5c517a-04bc-4330-9bbe-7a674eab1f44 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:29:34.938000 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a5c517a-04bc-4330-9bbe-7a674eab1f44 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:29:34.938454 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a5c517a-04bc-4330-9bbe-7a674eab1f44 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:29:34.939170 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a5c517a-04bc-4330-9bbe-7a674eab1f44 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:29:34.939642 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a5c517a-04bc-4330-9bbe-7a674eab1f44 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:29:34.940083 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a5c517a-04bc-4330-9bbe-7a674eab1f44 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:29:35.008008 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6a5c517a-04bc-4330-9bbe-7a674eab1f44 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620bbcf5f19d4cfbb8b39de0272870e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd17e8c4aa24960a8b46e4721e2acc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:29:35.016377 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6a5c517a-04bc-4330-9bbe-7a674eab1f44 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/15b46004-3316-4c23-8ff1-99cff47dbde8" status: 200 len: 1519 microversion: 2.1 time: 0.090503 Oct 30 02:29:35.016950 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4004/7674] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:29:34 2022] GET /compute/v2.1/servers/15b46004-3316-4c23-8ff1-99cff47dbde8 => generated 1519 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:29:36.040470 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3fd012e7-6c19-4f4a-8652-e4c8af4cc022 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:29:36.041172 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3fd012e7-6c19-4f4a-8652-e4c8af4cc022 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] [instance: 15b46004-3316-4c23-8ff1-99cff47dbde8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:29:36.047842 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3fd012e7-6c19-4f4a-8652-e4c8af4cc022 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:29:36.048589 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3fd012e7-6c19-4f4a-8652-e4c8af4cc022 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:29:36.049021 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3fd012e7-6c19-4f4a-8652-e4c8af4cc022 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:29:36.049731 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3fd012e7-6c19-4f4a-8652-e4c8af4cc022 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:29:36.050180 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3fd012e7-6c19-4f4a-8652-e4c8af4cc022 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:29:36.050602 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3fd012e7-6c19-4f4a-8652-e4c8af4cc022 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:29:36.063696 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-3fd012e7-6c19-4f4a-8652-e4c8af4cc022 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] HTTP exception thrown: Instance 15b46004-3316-4c23-8ff1-99cff47dbde8 could not be found. Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3fd012e7-6c19-4f4a-8652-e4c8af4cc022 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Request method failure captured: Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/15b46004-3316-4c23-8ff1-99cff47dbde8 HTTP/1.1 Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXeEK9QRMKpue-1_CAUN0nxT9SAWD0kaFatv9C7OVjZYraPcctja2AazGHqhBOq6LnX1PegLz8iyumG9Uq76GXVbEwti5u80AbvIbKIL2tu1SGTyf0cb0qF_VDsMq0t-VgWm1QBc6YgWxXJGukVVzGwRb9JGj6Yqt98XF2fW3lisFqgE Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: bfd17e8c4aa24960a8b46e4721e2acc7 Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1412150866 Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/bfd17e8c4aa24960a8b46e4721e2acc7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_bfd17e8c4aa24960a8b46e4721e2acc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/bfd17e8c4aa24960a8b46e4721e2acc7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/bfd17e8c4aa24960a8b46e4721e2acc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-TestEncryptedCinderVolumes-1412150866 Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: bfd17e8c4aa24960a8b46e4721e2acc7 Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1412150866 Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-TestEncryptedCinderVolumes-1412150866-project Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 620bbcf5f19d4cfbb8b39de0272870e4 Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-TestEncryptedCinderVolumes-1412150866-project Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 15b46004-3316-4c23-8ff1-99cff47dbde8 could not be found. Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '15b46004-3316-4c23-8ff1-99cff47dbde8'} Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15b46004-3316-4c23-8ff1-99cff47dbde8 could not be found. Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15b46004-3316-4c23-8ff1-99cff47dbde8 could not be found. Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:29:36.065284 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:29:36.070329 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:29:36.070329 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:29:36.070329 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:29:36.070329 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:29:36.070329 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:29:36.070329 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:29:36.070329 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15b46004-3316-4c23-8ff1-99cff47dbde8 could not be found. Oct 30 02:29:36.070329 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:29:36.070329 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3fd012e7-6c19-4f4a-8652-e4c8af4cc022 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Returning 404 to user: Instance 15b46004-3316-4c23-8ff1-99cff47dbde8 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:29:36.070329 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3fd012e7-6c19-4f4a-8652-e4c8af4cc022 tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "GET /compute/v2.1/servers/15b46004-3316-4c23-8ff1-99cff47dbde8" status: 404 len: 111 microversion: 2.1 time: 0.031319 Oct 30 02:29:36.070329 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3671/7675] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:29:36 2022] GET /compute/v2.1/servers/15b46004-3316-4c23-8ff1-99cff47dbde8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 02:29:36.075596 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-befebf6f-aeb2-4b07-a5f3-18dc2ac8a52c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] Calling method '.version_select at 0x7f44c6d50af0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:29:36.185396 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-befebf6f-aeb2-4b07-a5f3-18dc2ac8a52c tempest-TestEncryptedCinderVolumes-1412150866 tempest-TestEncryptedCinderVolumes-1412150866-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-920439603" status: 202 len: 0 microversion: 2.1 time: 0.113590 Oct 30 02:29:36.185990 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4005/7676] 10.222.0.13 () {58 vars in 1275 bytes} [Sun Oct 30 02:29:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-920439603 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 02:30:08.656142 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-02da0966-8c53-4c5f-8f90-10592ef7d7a7 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Action: 'create', calling method: .version_select at 0x7f44c6cee5e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1982573980", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBByft26SORLHnLERa1GWWK4M/5xBXFrYczN0DeHzhc9yGDcrYGFFXx16BU7APYLNqJk/3OHoiu+78VOUbFCGudrpfYwPlRvYWXJcbQmQZ/A3ht8J0rcovKBBN1pWsH8ViA=="}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:30:08.661657 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=14 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:30:08.662338 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=34 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:30:08.673882 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-02da0966-8c53-4c5f-8f90-10592ef7d7a7 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Getting quotas for project 6305db1090aa4559b92d87c1dbca1443. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 02:30:08.679896 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-02da0966-8c53-4c5f-8f90-10592ef7d7a7 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Getting quotas for user a75d2920b15d4f8fa293477d6cebba8c and project 6305db1090aa4559b92d87c1dbca1443. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 02:30:08.746116 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-02da0966-8c53-4c5f-8f90-10592ef7d7a7 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.094662 Oct 30 02:30:08.746650 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3672/7677] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 30 02:30:08 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:30:08.801623 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:30:08.802485 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:30:08.806750 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-56d78907-168b-4028-97f0-ce66cc79baec tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1192552731", "imageRef": "3dd1ffc9-8444-43d4-8de6-82eddc6f97a2", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1982573980", "networks": [{"uuid": "ffe9be98-371e-4c17-96fd-e2b8fa66d4fb"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:30:08.859684 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-56d78907-168b-4028-97f0-ce66cc79baec tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] validate_networks() for [('ffe9be98-371e-4c17-96fd-e2b8fa66d4fb', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 02:30:09.240911 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-56d78907-168b-4028-97f0-ce66cc79baec tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 02:30:09.241372 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-56d78907-168b-4028-97f0-ce66cc79baec tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 02:30:09.241868 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-56d78907-168b-4028-97f0-ce66cc79baec tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 02:30:09.242287 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-56d78907-168b-4028-97f0-ce66cc79baec tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 02:30:09.242720 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-56d78907-168b-4028-97f0-ce66cc79baec tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 02:30:09.251859 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-56d78907-168b-4028-97f0-ce66cc79baec tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:30:09.252353 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-56d78907-168b-4028-97f0-ce66cc79baec tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:30:09.252827 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-56d78907-168b-4028-97f0-ce66cc79baec tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:30:09.253634 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-56d78907-168b-4028-97f0-ce66cc79baec tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:30:09.254099 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-56d78907-168b-4028-97f0-ce66cc79baec tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:30:09.254533 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-56d78907-168b-4028-97f0-ce66cc79baec tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:30:09.272109 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-56d78907-168b-4028-97f0-ce66cc79baec tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Getting quotas for project 6305db1090aa4559b92d87c1dbca1443. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 02:30:09.277497 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-56d78907-168b-4028-97f0-ce66cc79baec tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Getting quotas for user a75d2920b15d4f8fa293477d6cebba8c and project 6305db1090aa4559b92d87c1dbca1443. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 02:30:09.290237 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-56d78907-168b-4028-97f0-ce66cc79baec tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 02:30:09.292415 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-56d78907-168b-4028-97f0-ce66cc79baec tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: d8b11d47-d46e-4876-b721-c09c5a9e2e8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3dd1ffc9-8444-43d4-8de6-82eddc6f97a2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 02:30:09.409599 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-56d78907-168b-4028-97f0-ce66cc79baec tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.610357 Oct 30 02:30:09.410255 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4006/7678] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 02:30:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 02:30:09.421177 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-78cc0a17-a733-48d5-b664-06ce7db097f9 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:30:09.422052 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-78cc0a17-a733-48d5-b664-06ce7db097f9 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: d8b11d47-d46e-4876-b721-c09c5a9e2e8a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:30:09.483517 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-78cc0a17-a733-48d5-b664-06ce7db097f9 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:30:09.490730 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-78cc0a17-a733-48d5-b664-06ce7db097f9 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a" status: 200 len: 1259 microversion: 2.1 time: 0.073414 Oct 30 02:30:09.491301 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3673/7679] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:30:09 2022] GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a => generated 1259 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:30:10.514308 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bf32f8c0-074d-4aff-9f91-2e15cd1ef0f2 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:30:10.514938 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bf32f8c0-074d-4aff-9f91-2e15cd1ef0f2 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: d8b11d47-d46e-4876-b721-c09c5a9e2e8a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:30:10.524888 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bf32f8c0-074d-4aff-9f91-2e15cd1ef0f2 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:30:10.525421 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bf32f8c0-074d-4aff-9f91-2e15cd1ef0f2 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:30:10.525872 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bf32f8c0-074d-4aff-9f91-2e15cd1ef0f2 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:30:10.526583 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bf32f8c0-074d-4aff-9f91-2e15cd1ef0f2 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:30:10.527054 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bf32f8c0-074d-4aff-9f91-2e15cd1ef0f2 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:30:10.527558 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bf32f8c0-074d-4aff-9f91-2e15cd1ef0f2 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:30:10.589464 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bf32f8c0-074d-4aff-9f91-2e15cd1ef0f2 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:30:10.597757 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bf32f8c0-074d-4aff-9f91-2e15cd1ef0f2 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a" status: 200 len: 1263 microversion: 2.1 time: 0.088317 Oct 30 02:30:10.598344 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4007/7680] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:30:10 2022] GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a => generated 1263 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:30:11.620136 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-047e364e-7539-4999-b29d-6c8670b5ebe9 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:30:11.621278 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-047e364e-7539-4999-b29d-6c8670b5ebe9 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: d8b11d47-d46e-4876-b721-c09c5a9e2e8a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:30:11.628656 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-047e364e-7539-4999-b29d-6c8670b5ebe9 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:30:11.629148 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-047e364e-7539-4999-b29d-6c8670b5ebe9 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:30:11.630445 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-047e364e-7539-4999-b29d-6c8670b5ebe9 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:30:11.630445 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-047e364e-7539-4999-b29d-6c8670b5ebe9 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:30:11.630772 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-047e364e-7539-4999-b29d-6c8670b5ebe9 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:30:11.631197 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-047e364e-7539-4999-b29d-6c8670b5ebe9 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:30:11.694610 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-047e364e-7539-4999-b29d-6c8670b5ebe9 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:30:11.703000 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-047e364e-7539-4999-b29d-6c8670b5ebe9 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a" status: 200 len: 1319 microversion: 2.1 time: 0.086769 Oct 30 02:30:11.703581 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3674/7681] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:30:11 2022] GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a => generated 1319 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:30:12.726328 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6718f72c-1268-49db-b4bd-f39127d2976e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:30:12.727860 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6718f72c-1268-49db-b4bd-f39127d2976e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: d8b11d47-d46e-4876-b721-c09c5a9e2e8a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:30:12.735493 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6718f72c-1268-49db-b4bd-f39127d2976e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:30:12.736272 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6718f72c-1268-49db-b4bd-f39127d2976e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:30:12.736885 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6718f72c-1268-49db-b4bd-f39127d2976e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:30:12.738098 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6718f72c-1268-49db-b4bd-f39127d2976e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:30:12.738911 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6718f72c-1268-49db-b4bd-f39127d2976e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:30:12.739693 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6718f72c-1268-49db-b4bd-f39127d2976e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:30:12.890409 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6718f72c-1268-49db-b4bd-f39127d2976e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:30:12.901718 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6718f72c-1268-49db-b4bd-f39127d2976e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a" status: 200 len: 1359 microversion: 2.1 time: 0.179441 Oct 30 02:30:12.902323 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4008/7682] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:30:12 2022] GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:30:13.925036 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-37768316-8cf3-44cf-8bbf-56bb27f5ba0a tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:30:13.926151 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-37768316-8cf3-44cf-8bbf-56bb27f5ba0a tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: d8b11d47-d46e-4876-b721-c09c5a9e2e8a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:30:13.933275 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-37768316-8cf3-44cf-8bbf-56bb27f5ba0a tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:30:13.934134 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-37768316-8cf3-44cf-8bbf-56bb27f5ba0a tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:30:13.934825 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-37768316-8cf3-44cf-8bbf-56bb27f5ba0a tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:30:13.935809 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-37768316-8cf3-44cf-8bbf-56bb27f5ba0a tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:30:13.937185 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-37768316-8cf3-44cf-8bbf-56bb27f5ba0a tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:30:13.937869 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-37768316-8cf3-44cf-8bbf-56bb27f5ba0a tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:30:14.081549 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-37768316-8cf3-44cf-8bbf-56bb27f5ba0a tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:30:14.089571 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-37768316-8cf3-44cf-8bbf-56bb27f5ba0a tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a" status: 200 len: 1359 microversion: 2.1 time: 0.169171 Oct 30 02:30:14.090735 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3675/7683] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:30:13 2022] GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:30:15.112810 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3240c009-b999-4569-a676-1d2fb500d695 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:30:15.115367 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3240c009-b999-4569-a676-1d2fb500d695 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: d8b11d47-d46e-4876-b721-c09c5a9e2e8a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:30:15.120611 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3240c009-b999-4569-a676-1d2fb500d695 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:30:15.121114 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3240c009-b999-4569-a676-1d2fb500d695 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:30:15.121595 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3240c009-b999-4569-a676-1d2fb500d695 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:30:15.122323 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3240c009-b999-4569-a676-1d2fb500d695 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:30:15.122803 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3240c009-b999-4569-a676-1d2fb500d695 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:30:15.123294 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3240c009-b999-4569-a676-1d2fb500d695 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:30:15.267568 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3240c009-b999-4569-a676-1d2fb500d695 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:30:15.276195 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3240c009-b999-4569-a676-1d2fb500d695 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a" status: 200 len: 1359 microversion: 2.1 time: 0.167299 Oct 30 02:30:15.276792 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4009/7684] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:30:15 2022] GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:30:16.301060 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-aec3ee72-44d2-49ec-8d5f-27902fcfe30b tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:30:16.302175 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-aec3ee72-44d2-49ec-8d5f-27902fcfe30b tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: d8b11d47-d46e-4876-b721-c09c5a9e2e8a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:30:16.309595 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aec3ee72-44d2-49ec-8d5f-27902fcfe30b tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:30:16.310091 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aec3ee72-44d2-49ec-8d5f-27902fcfe30b tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:30:16.310534 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aec3ee72-44d2-49ec-8d5f-27902fcfe30b tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:30:16.311261 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aec3ee72-44d2-49ec-8d5f-27902fcfe30b tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:30:16.311705 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aec3ee72-44d2-49ec-8d5f-27902fcfe30b tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:30:16.312700 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aec3ee72-44d2-49ec-8d5f-27902fcfe30b tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:30:16.456262 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-aec3ee72-44d2-49ec-8d5f-27902fcfe30b tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:30:16.464586 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-aec3ee72-44d2-49ec-8d5f-27902fcfe30b tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a" status: 200 len: 1359 microversion: 2.1 time: 0.168463 Oct 30 02:30:16.465297 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3676/7685] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:30:16 2022] GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:30:17.488653 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4cd73ad2-d5bf-44c0-a4fb-51a574e03949 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:30:17.490155 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4cd73ad2-d5bf-44c0-a4fb-51a574e03949 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: d8b11d47-d46e-4876-b721-c09c5a9e2e8a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:30:17.498498 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4cd73ad2-d5bf-44c0-a4fb-51a574e03949 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:30:17.499150 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4cd73ad2-d5bf-44c0-a4fb-51a574e03949 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:30:17.500287 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4cd73ad2-d5bf-44c0-a4fb-51a574e03949 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:30:17.501238 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4cd73ad2-d5bf-44c0-a4fb-51a574e03949 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:30:17.501998 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4cd73ad2-d5bf-44c0-a4fb-51a574e03949 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:30:17.502565 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4cd73ad2-d5bf-44c0-a4fb-51a574e03949 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:30:17.648142 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4cd73ad2-d5bf-44c0-a4fb-51a574e03949 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:30:17.657044 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4cd73ad2-d5bf-44c0-a4fb-51a574e03949 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a" status: 200 len: 1359 microversion: 2.1 time: 0.172608 Oct 30 02:30:17.657594 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4010/7686] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:30:17 2022] GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:30:18.679890 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c2fa5776-4b1e-49d9-9cfd-41432e718064 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:30:18.680540 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c2fa5776-4b1e-49d9-9cfd-41432e718064 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: d8b11d47-d46e-4876-b721-c09c5a9e2e8a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:30:18.693394 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c2fa5776-4b1e-49d9-9cfd-41432e718064 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:30:18.694046 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c2fa5776-4b1e-49d9-9cfd-41432e718064 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:30:18.694490 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c2fa5776-4b1e-49d9-9cfd-41432e718064 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:30:18.695370 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c2fa5776-4b1e-49d9-9cfd-41432e718064 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:30:18.695861 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c2fa5776-4b1e-49d9-9cfd-41432e718064 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:30:18.696289 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c2fa5776-4b1e-49d9-9cfd-41432e718064 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:30:18.841213 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c2fa5776-4b1e-49d9-9cfd-41432e718064 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:30:18.849809 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c2fa5776-4b1e-49d9-9cfd-41432e718064 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a" status: 200 len: 1359 microversion: 2.1 time: 0.173861 Oct 30 02:30:18.850404 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3677/7687] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:30:18 2022] GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:30:19.872786 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-584cd60a-144e-45af-8ec0-983e746d7ebb tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:30:19.873499 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-584cd60a-144e-45af-8ec0-983e746d7ebb tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: d8b11d47-d46e-4876-b721-c09c5a9e2e8a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:30:19.876894 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:30:19.877786 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=6 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:30:19.882610 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-584cd60a-144e-45af-8ec0-983e746d7ebb tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:30:19.887229 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-584cd60a-144e-45af-8ec0-983e746d7ebb tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:30:19.887229 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-584cd60a-144e-45af-8ec0-983e746d7ebb tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:30:19.887229 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-584cd60a-144e-45af-8ec0-983e746d7ebb tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:30:19.887229 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-584cd60a-144e-45af-8ec0-983e746d7ebb tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:30:19.887229 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-584cd60a-144e-45af-8ec0-983e746d7ebb tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:30:20.019998 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-584cd60a-144e-45af-8ec0-983e746d7ebb tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:30:20.030406 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-584cd60a-144e-45af-8ec0-983e746d7ebb tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a" status: 200 len: 1359 microversion: 2.1 time: 0.161545 Oct 30 02:30:20.031171 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4011/7688] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:30:19 2022] GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:30:20.817673 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=6 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:30:21.054915 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d4f0999b-61df-407a-8a1d-0d41a9b7e5b2 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:30:21.056128 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d4f0999b-61df-407a-8a1d-0d41a9b7e5b2 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: d8b11d47-d46e-4876-b721-c09c5a9e2e8a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:30:21.064361 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4f0999b-61df-407a-8a1d-0d41a9b7e5b2 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:30:21.064870 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4f0999b-61df-407a-8a1d-0d41a9b7e5b2 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:30:21.065315 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4f0999b-61df-407a-8a1d-0d41a9b7e5b2 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:30:21.066234 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4f0999b-61df-407a-8a1d-0d41a9b7e5b2 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:30:21.066865 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4f0999b-61df-407a-8a1d-0d41a9b7e5b2 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:30:21.067477 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4f0999b-61df-407a-8a1d-0d41a9b7e5b2 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:30:21.080923 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-72f14caf-a249-4129-b363-61977e7bf28d req-f84c1a03-9f71-48d6-bc2b-863edd9e917c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8b11d47-d46e-4876-b721-c09c5a9e2e8a", "tag": "2b5c37bf-b93f-4139-952c-3d69e022fa0a"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:30:21.091959 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-72f14caf-a249-4129-b363-61977e7bf28d req-f84c1a03-9f71-48d6-bc2b-863edd9e917c service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:30:21.094481 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-72f14caf-a249-4129-b363-61977e7bf28d req-f84c1a03-9f71-48d6-bc2b-863edd9e917c service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:30:21.094481 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-72f14caf-a249-4129-b363-61977e7bf28d req-f84c1a03-9f71-48d6-bc2b-863edd9e917c service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:30:21.104995 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-72f14caf-a249-4129-b363-61977e7bf28d req-f84c1a03-9f71-48d6-bc2b-863edd9e917c service nova] Creating event network-changed:2b5c37bf-b93f-4139-952c-3d69e022fa0a for instance d8b11d47-d46e-4876-b721-c09c5a9e2e8a on n-h1-master-1 Oct 30 02:30:21.111386 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-72f14caf-a249-4129-b363-61977e7bf28d req-f84c1a03-9f71-48d6-bc2b-863edd9e917c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.297962 Oct 30 02:30:21.112222 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3678/7689] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:30:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:30:21.292062 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d4f0999b-61df-407a-8a1d-0d41a9b7e5b2 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:30:21.300643 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d4f0999b-61df-407a-8a1d-0d41a9b7e5b2 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a" status: 200 len: 1359 microversion: 2.1 time: 0.249605 Oct 30 02:30:21.301221 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4012/7690] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:30:21 2022] GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a => generated 1359 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:30:22.326732 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-34c0d6af-667a-4dce-88c4-1173ec94ce9c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:30:22.330816 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-34c0d6af-667a-4dce-88c4-1173ec94ce9c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: d8b11d47-d46e-4876-b721-c09c5a9e2e8a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:30:22.335050 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-34c0d6af-667a-4dce-88c4-1173ec94ce9c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:30:22.335555 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-34c0d6af-667a-4dce-88c4-1173ec94ce9c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:30:22.335989 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-34c0d6af-667a-4dce-88c4-1173ec94ce9c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:30:22.336730 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-34c0d6af-667a-4dce-88c4-1173ec94ce9c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:30:22.337188 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-34c0d6af-667a-4dce-88c4-1173ec94ce9c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:30:22.337648 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-34c0d6af-667a-4dce-88c4-1173ec94ce9c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:30:22.472672 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-34c0d6af-667a-4dce-88c4-1173ec94ce9c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:30:22.480562 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-34c0d6af-667a-4dce-88c4-1173ec94ce9c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a" status: 200 len: 1359 microversion: 2.1 time: 0.158919 Oct 30 02:30:22.481147 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3679/7691] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:30:22 2022] GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:30:23.504256 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1e7a4028-a24b-4555-9c1e-d98b4ec9f94c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:30:23.504867 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1e7a4028-a24b-4555-9c1e-d98b4ec9f94c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: d8b11d47-d46e-4876-b721-c09c5a9e2e8a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:30:23.512858 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1e7a4028-a24b-4555-9c1e-d98b4ec9f94c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:30:23.513441 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1e7a4028-a24b-4555-9c1e-d98b4ec9f94c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:30:23.513951 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1e7a4028-a24b-4555-9c1e-d98b4ec9f94c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:30:23.515328 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1e7a4028-a24b-4555-9c1e-d98b4ec9f94c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:30:23.515867 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1e7a4028-a24b-4555-9c1e-d98b4ec9f94c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:30:23.516350 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1e7a4028-a24b-4555-9c1e-d98b4ec9f94c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:30:23.659256 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1e7a4028-a24b-4555-9c1e-d98b4ec9f94c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:30:23.668817 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1e7a4028-a24b-4555-9c1e-d98b4ec9f94c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a" status: 200 len: 1359 microversion: 2.1 time: 0.169100 Oct 30 02:30:23.669582 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4013/7692] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:30:23 2022] GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:30:24.694249 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-db7c0c52-d072-42ad-9386-1d49008cf21e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:30:24.694861 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-db7c0c52-d072-42ad-9386-1d49008cf21e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: d8b11d47-d46e-4876-b721-c09c5a9e2e8a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:30:24.701708 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-db7c0c52-d072-42ad-9386-1d49008cf21e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:30:24.702189 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-db7c0c52-d072-42ad-9386-1d49008cf21e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:30:24.702631 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-db7c0c52-d072-42ad-9386-1d49008cf21e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:30:24.703344 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-db7c0c52-d072-42ad-9386-1d49008cf21e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:30:24.703796 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-db7c0c52-d072-42ad-9386-1d49008cf21e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:30:24.704215 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-db7c0c52-d072-42ad-9386-1d49008cf21e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:30:24.839587 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-db7c0c52-d072-42ad-9386-1d49008cf21e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:30:24.847697 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-db7c0c52-d072-42ad-9386-1d49008cf21e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a" status: 200 len: 1359 microversion: 2.1 time: 0.157389 Oct 30 02:30:24.848262 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3680/7693] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:30:24 2022] GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:30:25.870896 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f2621d52-0e75-4016-a16a-101da919a7c6 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:30:25.871455 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f2621d52-0e75-4016-a16a-101da919a7c6 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: d8b11d47-d46e-4876-b721-c09c5a9e2e8a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:30:25.879135 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f2621d52-0e75-4016-a16a-101da919a7c6 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:30:25.879633 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f2621d52-0e75-4016-a16a-101da919a7c6 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:30:25.880079 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f2621d52-0e75-4016-a16a-101da919a7c6 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:30:25.880787 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f2621d52-0e75-4016-a16a-101da919a7c6 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:30:25.881255 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f2621d52-0e75-4016-a16a-101da919a7c6 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:30:25.881725 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f2621d52-0e75-4016-a16a-101da919a7c6 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:30:26.009844 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f2621d52-0e75-4016-a16a-101da919a7c6 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:30:26.017607 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f2621d52-0e75-4016-a16a-101da919a7c6 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a" status: 200 len: 1359 microversion: 2.1 time: 0.150717 Oct 30 02:30:26.018178 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4014/7694] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:30:25 2022] GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:30:26.577819 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-a3170b02-9dbd-426c-adad-18ba4058fd2b req-c6670269-2246-4327-bc60-24d1bdb1f8f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8b11d47-d46e-4876-b721-c09c5a9e2e8a", "name": "network-vif-plugged", "status": "completed", "tag": "2b5c37bf-b93f-4139-952c-3d69e022fa0a"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:30:26.588692 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-a3170b02-9dbd-426c-adad-18ba4058fd2b req-c6670269-2246-4327-bc60-24d1bdb1f8f1 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:30:26.589177 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-a3170b02-9dbd-426c-adad-18ba4058fd2b req-c6670269-2246-4327-bc60-24d1bdb1f8f1 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:30:26.589646 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-a3170b02-9dbd-426c-adad-18ba4058fd2b req-c6670269-2246-4327-bc60-24d1bdb1f8f1 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:30:26.601021 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-a3170b02-9dbd-426c-adad-18ba4058fd2b req-c6670269-2246-4327-bc60-24d1bdb1f8f1 service nova] Creating event network-vif-plugged:2b5c37bf-b93f-4139-952c-3d69e022fa0a for instance d8b11d47-d46e-4876-b721-c09c5a9e2e8a on n-h1-master-1 Oct 30 02:30:26.606195 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-a3170b02-9dbd-426c-adad-18ba4058fd2b req-c6670269-2246-4327-bc60-24d1bdb1f8f1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032312 Oct 30 02:30:26.606781 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3681/7695] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:30:27.040193 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-24d1d1d1-5c82-4977-bb2d-c19000ab7acd tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:30:27.040822 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-24d1d1d1-5c82-4977-bb2d-c19000ab7acd tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: d8b11d47-d46e-4876-b721-c09c5a9e2e8a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:30:27.047858 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24d1d1d1-5c82-4977-bb2d-c19000ab7acd tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:30:27.048617 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24d1d1d1-5c82-4977-bb2d-c19000ab7acd tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:30:27.049068 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24d1d1d1-5c82-4977-bb2d-c19000ab7acd tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:30:27.049808 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24d1d1d1-5c82-4977-bb2d-c19000ab7acd tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:30:27.050275 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24d1d1d1-5c82-4977-bb2d-c19000ab7acd tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:30:27.050716 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24d1d1d1-5c82-4977-bb2d-c19000ab7acd tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:30:27.178667 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-24d1d1d1-5c82-4977-bb2d-c19000ab7acd tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:30:27.186432 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-24d1d1d1-5c82-4977-bb2d-c19000ab7acd tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a" status: 200 len: 1359 microversion: 2.1 time: 0.150182 Oct 30 02:30:27.187010 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4015/7696] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:30:27 2022] GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:30:28.211358 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-599dec99-6bba-46fc-97c7-2b5af161aa8c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:30:28.212065 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-599dec99-6bba-46fc-97c7-2b5af161aa8c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: d8b11d47-d46e-4876-b721-c09c5a9e2e8a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:30:28.218301 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-599dec99-6bba-46fc-97c7-2b5af161aa8c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:30:28.219372 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-599dec99-6bba-46fc-97c7-2b5af161aa8c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:30:28.219808 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-599dec99-6bba-46fc-97c7-2b5af161aa8c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:30:28.220498 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-599dec99-6bba-46fc-97c7-2b5af161aa8c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:30:28.220949 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-599dec99-6bba-46fc-97c7-2b5af161aa8c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:30:28.221393 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-599dec99-6bba-46fc-97c7-2b5af161aa8c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:30:28.351611 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-599dec99-6bba-46fc-97c7-2b5af161aa8c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:30:28.359398 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-599dec99-6bba-46fc-97c7-2b5af161aa8c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a" status: 200 len: 1550 microversion: 2.1 time: 0.153200 Oct 30 02:30:28.359962 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3682/7697] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:30:28 2022] GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a => generated 1550 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:30:28.382330 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b6dff5bb-00fc-4c34-ace3-54c7466abd7f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:30:28.383115 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b6dff5bb-00fc-4c34-ace3-54c7466abd7f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: d8b11d47-d46e-4876-b721-c09c5a9e2e8a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:30:28.390063 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b6dff5bb-00fc-4c34-ace3-54c7466abd7f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:30:28.391086 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b6dff5bb-00fc-4c34-ace3-54c7466abd7f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:30:28.391552 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b6dff5bb-00fc-4c34-ace3-54c7466abd7f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:30:28.392257 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b6dff5bb-00fc-4c34-ace3-54c7466abd7f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:30:28.392728 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b6dff5bb-00fc-4c34-ace3-54c7466abd7f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:30:28.393169 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b6dff5bb-00fc-4c34-ace3-54c7466abd7f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:30:28.519164 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b6dff5bb-00fc-4c34-ace3-54c7466abd7f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:30:28.526886 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b6dff5bb-00fc-4c34-ace3-54c7466abd7f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a" status: 200 len: 1550 microversion: 2.1 time: 0.148600 Oct 30 02:30:28.527470 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4016/7698] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:30:28 2022] GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a => generated 1550 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:30:28.548651 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-44b401a8-ee4c-4f7a-8833-d61203244ad6 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:30:28.553303 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-44b401a8-ee4c-4f7a-8833-d61203244ad6 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:30:28.554090 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-44b401a8-ee4c-4f7a-8833-d61203244ad6 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Searching by: {'deleted': False, 'project_id': '6305db1090aa4559b92d87c1dbca1443'} {{(pid=121103) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 30 02:30:28.559344 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-44b401a8-ee4c-4f7a-8833-d61203244ad6 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:30:28.559807 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-44b401a8-ee4c-4f7a-8833-d61203244ad6 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:30:28.560240 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-44b401a8-ee4c-4f7a-8833-d61203244ad6 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:30:28.560961 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-44b401a8-ee4c-4f7a-8833-d61203244ad6 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:30:28.561448 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-44b401a8-ee4c-4f7a-8833-d61203244ad6 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:30:28.561877 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-44b401a8-ee4c-4f7a-8833-d61203244ad6 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:30:28.586220 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.multi_cell_list [None req-44b401a8-ee4c-4f7a-8833-d61203244ad6 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121103) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 30 02:30:28.611887 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-44b401a8-ee4c-4f7a-8833-d61203244ad6 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.067286 Oct 30 02:30:28.612460 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3683/7699] 10.222.0.13 () {58 vars in 1125 bytes} [Sun Oct 30 02:30:28 2022] GET /compute/v2.1/servers => generated 343 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:30:28.624068 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c8aa4085-15be-41d5-b8af-bc1d86d2b8b3 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:30:28.624727 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c8aa4085-15be-41d5-b8af-bc1d86d2b8b3 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: d8b11d47-d46e-4876-b721-c09c5a9e2e8a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:30:28.631184 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c8aa4085-15be-41d5-b8af-bc1d86d2b8b3 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:30:28.631684 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c8aa4085-15be-41d5-b8af-bc1d86d2b8b3 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:30:28.632137 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c8aa4085-15be-41d5-b8af-bc1d86d2b8b3 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:30:28.632840 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c8aa4085-15be-41d5-b8af-bc1d86d2b8b3 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:30:28.633308 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c8aa4085-15be-41d5-b8af-bc1d86d2b8b3 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:30:28.633773 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c8aa4085-15be-41d5-b8af-bc1d86d2b8b3 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:30:28.761641 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c8aa4085-15be-41d5-b8af-bc1d86d2b8b3 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:30:28.770071 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c8aa4085-15be-41d5-b8af-bc1d86d2b8b3 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a" status: 200 len: 1550 microversion: 2.1 time: 0.149962 Oct 30 02:30:28.770645 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4017/7700] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:30:28 2022] GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a => generated 1550 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:30:31.574980 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9a8f1fda-8d61-471b-9940-71a33012876b tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a9a0e903-f3f4-45e5-9c5f-e06977374338"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:30:31.577281 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9a8f1fda-8d61-471b-9940-71a33012876b tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: d8b11d47-d46e-4876-b721-c09c5a9e2e8a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:30:31.584651 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9a8f1fda-8d61-471b-9940-71a33012876b tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:30:31.585127 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9a8f1fda-8d61-471b-9940-71a33012876b tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:30:31.585584 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9a8f1fda-8d61-471b-9940-71a33012876b tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:30:31.586266 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9a8f1fda-8d61-471b-9940-71a33012876b tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:30:31.586715 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9a8f1fda-8d61-471b-9940-71a33012876b tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:30:31.587137 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9a8f1fda-8d61-471b-9940-71a33012876b tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:30:32.250741 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9a8f1fda-8d61-471b-9940-71a33012876b tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "POST /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.679442 Oct 30 02:30:32.251581 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3684/7701] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 30 02:30:31 2022] POST /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a/os-volume_attachments => generated 194 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:30:46.621177 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f4e40b1d-1360-4cee-b4f9-0ea67038368f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:30:46.621840 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f4e40b1d-1360-4cee-b4f9-0ea67038368f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: d8b11d47-d46e-4876-b721-c09c5a9e2e8a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:30:46.623971 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:30:46.624665 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=68 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:30:46.629500 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f4e40b1d-1360-4cee-b4f9-0ea67038368f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:30:46.630006 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f4e40b1d-1360-4cee-b4f9-0ea67038368f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:30:46.630490 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f4e40b1d-1360-4cee-b4f9-0ea67038368f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:30:46.631262 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f4e40b1d-1360-4cee-b4f9-0ea67038368f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:30:46.631740 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f4e40b1d-1360-4cee-b4f9-0ea67038368f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:30:46.632186 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f4e40b1d-1360-4cee-b4f9-0ea67038368f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:30:46.760339 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f4e40b1d-1360-4cee-b4f9-0ea67038368f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:30:46.769051 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f4e40b1d-1360-4cee-b4f9-0ea67038368f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a" status: 200 len: 1596 microversion: 2.1 time: 0.152114 Oct 30 02:30:46.769681 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4018/7702] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:30:46 2022] GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a => generated 1596 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:30:48.943847 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:30:48.945086 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:30:48.945794 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:30:48.949875 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-6c41f40d-3aa2-46c3-a47c-0007d4f4f740 req-4546c53c-e271-4251-b309-87fcc26660de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8b11d47-d46e-4876-b721-c09c5a9e2e8a", "tag": "2b5c37bf-b93f-4139-952c-3d69e022fa0a"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:30:48.960240 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-6c41f40d-3aa2-46c3-a47c-0007d4f4f740 req-4546c53c-e271-4251-b309-87fcc26660de service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:30:48.960730 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-6c41f40d-3aa2-46c3-a47c-0007d4f4f740 req-4546c53c-e271-4251-b309-87fcc26660de service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:30:48.961167 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-6c41f40d-3aa2-46c3-a47c-0007d4f4f740 req-4546c53c-e271-4251-b309-87fcc26660de service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:30:48.974661 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-6c41f40d-3aa2-46c3-a47c-0007d4f4f740 req-4546c53c-e271-4251-b309-87fcc26660de service nova] Creating event network-changed:2b5c37bf-b93f-4139-952c-3d69e022fa0a for instance d8b11d47-d46e-4876-b721-c09c5a9e2e8a on n-h1-master-1 Oct 30 02:30:48.980667 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-6c41f40d-3aa2-46c3-a47c-0007d4f4f740 req-4546c53c-e271-4251-b309-87fcc26660de service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038512 Oct 30 02:30:48.981714 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3685/7703] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:30:51.034890 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-08c8a86f-1ea6-4a09-8597-6256c3b79fef tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-115532268"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:30:51.035417 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-08c8a86f-1ea6-4a09-8597-6256c3b79fef tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: d8b11d47-d46e-4876-b721-c09c5a9e2e8a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:30:51.042478 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08c8a86f-1ea6-4a09-8597-6256c3b79fef tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:30:51.042979 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08c8a86f-1ea6-4a09-8597-6256c3b79fef tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:30:51.043430 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08c8a86f-1ea6-4a09-8597-6256c3b79fef tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:30:51.044136 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08c8a86f-1ea6-4a09-8597-6256c3b79fef tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:30:51.044604 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08c8a86f-1ea6-4a09-8597-6256c3b79fef tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:30:51.045103 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08c8a86f-1ea6-4a09-8597-6256c3b79fef tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:30:51.176149 n-d-master-1 devstack@n-api.service[121102]: INFO nova.network.security_group_api [None req-08c8a86f-1ea6-4a09-8597-6256c3b79fef tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Adding security group 5d904be5-fe53-4fe4-9842-5411e6fcd1af to port 2b5c37bf-b93f-4139-952c-3d69e022fa0a Oct 30 02:30:51.535258 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-08c8a86f-1ea6-4a09-8597-6256c3b79fef tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "POST /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a/action" status: 202 len: 0 microversion: 2.1 time: 0.504408 Oct 30 02:30:51.535877 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4019/7704] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 02:30:51 2022] POST /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a/action => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 02:30:51.544713 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-ec36a0a7-d1f2-46d1-8e3a-590d9fa900be req-cff5cc79-9ed2-43f4-be64-8ca34e0821d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8b11d47-d46e-4876-b721-c09c5a9e2e8a", "tag": "2b5c37bf-b93f-4139-952c-3d69e022fa0a"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:30:51.559191 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6c22d805-0bd9-4993-8a46-2ca5e107434a tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:30:51.559860 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6c22d805-0bd9-4993-8a46-2ca5e107434a tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: d8b11d47-d46e-4876-b721-c09c5a9e2e8a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:30:51.567429 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ec36a0a7-d1f2-46d1-8e3a-590d9fa900be req-cff5cc79-9ed2-43f4-be64-8ca34e0821d9 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:30:51.568175 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ec36a0a7-d1f2-46d1-8e3a-590d9fa900be req-cff5cc79-9ed2-43f4-be64-8ca34e0821d9 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:30:51.568803 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ec36a0a7-d1f2-46d1-8e3a-590d9fa900be req-cff5cc79-9ed2-43f4-be64-8ca34e0821d9 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:30:51.570583 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c22d805-0bd9-4993-8a46-2ca5e107434a tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:30:51.571377 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c22d805-0bd9-4993-8a46-2ca5e107434a tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:30:51.571926 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c22d805-0bd9-4993-8a46-2ca5e107434a tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:30:51.573157 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c22d805-0bd9-4993-8a46-2ca5e107434a tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:30:51.574132 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c22d805-0bd9-4993-8a46-2ca5e107434a tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:30:51.575123 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c22d805-0bd9-4993-8a46-2ca5e107434a tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:30:51.582566 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-ec36a0a7-d1f2-46d1-8e3a-590d9fa900be req-cff5cc79-9ed2-43f4-be64-8ca34e0821d9 service nova] Creating event network-changed:2b5c37bf-b93f-4139-952c-3d69e022fa0a for instance d8b11d47-d46e-4876-b721-c09c5a9e2e8a on n-h1-master-1 Oct 30 02:30:51.589292 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-ec36a0a7-d1f2-46d1-8e3a-590d9fa900be req-cff5cc79-9ed2-43f4-be64-8ca34e0821d9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049046 Oct 30 02:30:51.593395 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3686/7705] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:30:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:30:51.827669 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6c22d805-0bd9-4993-8a46-2ca5e107434a tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:30:51.838213 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6c22d805-0bd9-4993-8a46-2ca5e107434a tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a" status: 200 len: 1761 microversion: 2.1 time: 0.286992 Oct 30 02:30:51.838975 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4020/7706] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:30:51 2022] GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a => generated 1761 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:32:24.235349 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=4 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:32:24.236280 n-d-master-1 devstack@n-api.service[121103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 30 02:32:24.236423 n-d-master-1 devstack@n-api.service[121103]: Sun Oct 30 02:32:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a/action (ip 10.222.0.13) !!! Oct 30 02:32:24.244987 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-31562784-a7b4-4ff1-b4e6-c443d5fb4a35 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:32:24.247617 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-31562784-a7b4-4ff1-b4e6-c443d5fb4a35 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: d8b11d47-d46e-4876-b721-c09c5a9e2e8a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:32:24.254776 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-31562784-a7b4-4ff1-b4e6-c443d5fb4a35 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:32:24.255257 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-31562784-a7b4-4ff1-b4e6-c443d5fb4a35 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:32:24.255687 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-31562784-a7b4-4ff1-b4e6-c443d5fb4a35 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:32:24.256370 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-31562784-a7b4-4ff1-b4e6-c443d5fb4a35 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:32:24.256817 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-31562784-a7b4-4ff1-b4e6-c443d5fb4a35 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:32:24.257245 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-31562784-a7b4-4ff1-b4e6-c443d5fb4a35 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:32:24.417522 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-31562784-a7b4-4ff1-b4e6-c443d5fb4a35 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "POST /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a/action" status: 202 len: 0 microversion: 2.1 time: 0.184603 Oct 30 02:32:24.418306 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3687/7707] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 02:32:24 2022] POST /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 02:32:24.425546 n-d-master-1 devstack@n-api.service[121102]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8caffca0-53fa-4143-8e03-000c8bb53286] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 30 02:32:24.426088 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=6 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:32:24.426861 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=16 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:32:24.427890 n-d-master-1 devstack@n-api.service[121102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 30 02:32:24.428057 n-d-master-1 devstack@n-api.service[121102]: Sun Oct 30 02:32:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a (ip 10.222.0.13) !!! Oct 30 02:32:24.429483 n-d-master-1 devstack@n-api.service[121102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 30 02:32:24.429483 n-d-master-1 devstack@n-api.service[121102]: Sun Oct 30 02:32:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a (ip 10.222.0.13) !!! Oct 30 02:32:24.434566 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ea9ae0c0-28ea-40d6-a611-f82aae443e0e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:32:24.435199 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ea9ae0c0-28ea-40d6-a611-f82aae443e0e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: d8b11d47-d46e-4876-b721-c09c5a9e2e8a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:32:24.444301 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea9ae0c0-28ea-40d6-a611-f82aae443e0e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:32:24.446429 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea9ae0c0-28ea-40d6-a611-f82aae443e0e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:32:24.446429 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea9ae0c0-28ea-40d6-a611-f82aae443e0e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:32:24.446429 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea9ae0c0-28ea-40d6-a611-f82aae443e0e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:32:24.447033 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea9ae0c0-28ea-40d6-a611-f82aae443e0e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:32:24.447485 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ea9ae0c0-28ea-40d6-a611-f82aae443e0e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:32:24.609618 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ea9ae0c0-28ea-40d6-a611-f82aae443e0e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:32:24.618337 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ea9ae0c0-28ea-40d6-a611-f82aae443e0e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a" status: 200 len: 1763 microversion: 2.1 time: 0.195672 Oct 30 02:32:24.618916 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4021/7708] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:32:24 2022] GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a => generated 1763 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:32:25.643485 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bf019da1-77c4-4778-951d-e390fc82cc1e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:32:25.644216 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-bf019da1-77c4-4778-951d-e390fc82cc1e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: d8b11d47-d46e-4876-b721-c09c5a9e2e8a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:32:25.651145 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bf019da1-77c4-4778-951d-e390fc82cc1e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:32:25.651624 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bf019da1-77c4-4778-951d-e390fc82cc1e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:32:25.652052 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bf019da1-77c4-4778-951d-e390fc82cc1e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:32:25.652736 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bf019da1-77c4-4778-951d-e390fc82cc1e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:32:25.653207 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bf019da1-77c4-4778-951d-e390fc82cc1e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:32:25.653650 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bf019da1-77c4-4778-951d-e390fc82cc1e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:32:25.800950 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-bf019da1-77c4-4778-951d-e390fc82cc1e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:32:25.810047 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bf019da1-77c4-4778-951d-e390fc82cc1e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a" status: 200 len: 1768 microversion: 2.1 time: 0.171660 Oct 30 02:32:25.810686 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3688/7709] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:32:25 2022] GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a => generated 1768 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:32:26.835172 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-51dfe02a-a7af-4008-a427-ce64cc85996a tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:32:26.835807 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-51dfe02a-a7af-4008-a427-ce64cc85996a tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: d8b11d47-d46e-4876-b721-c09c5a9e2e8a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:32:26.843838 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51dfe02a-a7af-4008-a427-ce64cc85996a tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:32:26.844333 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51dfe02a-a7af-4008-a427-ce64cc85996a tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:32:26.844783 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51dfe02a-a7af-4008-a427-ce64cc85996a tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:32:26.845533 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51dfe02a-a7af-4008-a427-ce64cc85996a tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:32:26.846002 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51dfe02a-a7af-4008-a427-ce64cc85996a tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:32:26.846442 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51dfe02a-a7af-4008-a427-ce64cc85996a tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:32:26.864868 n-d-master-1 devstack@n-api.service[121102]: INFO oslo.messaging._drivers.impl_rabbit [-] [8caffca0-53fa-4143-8e03-000c8bb53286] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 59252. Oct 30 02:32:26.994674 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-51dfe02a-a7af-4008-a427-ce64cc85996a tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:32:27.002980 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-51dfe02a-a7af-4008-a427-ce64cc85996a tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a" status: 200 len: 1761 microversion: 2.1 time: 0.171809 Oct 30 02:32:27.003575 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4022/7710] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:32:26 2022] GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a => generated 1761 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:33:39.628505 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=4 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:33:39.629361 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:33:39.633202 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2f5c4dac-198b-4094-a6b5-99f206fba5b6 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-115532268"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:33:39.633775 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2f5c4dac-198b-4094-a6b5-99f206fba5b6 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: d8b11d47-d46e-4876-b721-c09c5a9e2e8a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:33:39.639650 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f5c4dac-198b-4094-a6b5-99f206fba5b6 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:33:39.641926 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f5c4dac-198b-4094-a6b5-99f206fba5b6 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:33:39.641926 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f5c4dac-198b-4094-a6b5-99f206fba5b6 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:33:39.641926 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f5c4dac-198b-4094-a6b5-99f206fba5b6 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:33:39.641926 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f5c4dac-198b-4094-a6b5-99f206fba5b6 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:33:39.642297 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f5c4dac-198b-4094-a6b5-99f206fba5b6 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:33:39.884838 n-d-master-1 devstack@n-api.service[121103]: INFO nova.network.security_group_api [None req-2f5c4dac-198b-4094-a6b5-99f206fba5b6 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Removing security group 5d904be5-fe53-4fe4-9842-5411e6fcd1af from port 2b5c37bf-b93f-4139-952c-3d69e022fa0a Oct 30 02:33:40.231327 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2f5c4dac-198b-4094-a6b5-99f206fba5b6 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "POST /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a/action" status: 202 len: 0 microversion: 2.1 time: 0.604740 Oct 30 02:33:40.232085 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3689/7711] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 02:33:39 2022] POST /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a/action => generated 0 bytes in 606 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 02:33:40.238765 n-d-master-1 devstack@n-api.service[121102]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ea6ec045-ee0c-4212-8fa5-a40465026485] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 30 02:33:40.239331 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=4 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:33:40.240120 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=12 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:33:40.397615 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-76c6f69a-9a93-487b-bccf-be9b933ed143 req-4821a978-41f5-43b5-b9b2-84acfef294ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8b11d47-d46e-4876-b721-c09c5a9e2e8a", "tag": "2b5c37bf-b93f-4139-952c-3d69e022fa0a"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:33:40.408077 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-76c6f69a-9a93-487b-bccf-be9b933ed143 req-4821a978-41f5-43b5-b9b2-84acfef294ca service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:33:40.408582 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-76c6f69a-9a93-487b-bccf-be9b933ed143 req-4821a978-41f5-43b5-b9b2-84acfef294ca service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:33:40.409006 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-76c6f69a-9a93-487b-bccf-be9b933ed143 req-4821a978-41f5-43b5-b9b2-84acfef294ca service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:33:40.420518 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-76c6f69a-9a93-487b-bccf-be9b933ed143 req-4821a978-41f5-43b5-b9b2-84acfef294ca service nova] Creating event network-changed:2b5c37bf-b93f-4139-952c-3d69e022fa0a for instance d8b11d47-d46e-4876-b721-c09c5a9e2e8a on n-h1-master-1 Oct 30 02:33:40.427002 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-76c6f69a-9a93-487b-bccf-be9b933ed143 req-4821a978-41f5-43b5-b9b2-84acfef294ca service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.191233 Oct 30 02:33:40.427652 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4023/7712] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:33:41.455868 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-785c12d3-ac87-4c49-bb50-ef06e070990c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:33:41.456417 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-785c12d3-ac87-4c49-bb50-ef06e070990c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: d8b11d47-d46e-4876-b721-c09c5a9e2e8a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:33:41.462725 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-785c12d3-ac87-4c49-bb50-ef06e070990c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:33:41.463217 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-785c12d3-ac87-4c49-bb50-ef06e070990c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:33:41.463662 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-785c12d3-ac87-4c49-bb50-ef06e070990c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:33:41.464367 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-785c12d3-ac87-4c49-bb50-ef06e070990c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:33:41.465357 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-785c12d3-ac87-4c49-bb50-ef06e070990c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:33:41.465821 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-785c12d3-ac87-4c49-bb50-ef06e070990c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:33:41.550425 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-785c12d3-ac87-4c49-bb50-ef06e070990c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lazy-loading 'services' on Instance uuid d8b11d47-d46e-4876-b721-c09c5a9e2e8a {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 02:33:41.748822 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-785c12d3-ac87-4c49-bb50-ef06e070990c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a/os-volume_attachments/a9a0e903-f3f4-45e5-9c5f-e06977374338" status: 202 len: 0 microversion: 2.1 time: 0.297778 Oct 30 02:33:41.749502 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3690/7713] 10.222.0.13 () {58 vars in 1416 bytes} [Sun Oct 30 02:33:41 2022] DELETE /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a/os-volume_attachments/a9a0e903-f3f4-45e5-9c5f-e06977374338 => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 02:33:41.762558 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3f5cc026-c027-4c70-b829-bec26f817c3d tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:33:41.764916 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3f5cc026-c027-4c70-b829-bec26f817c3d tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: d8b11d47-d46e-4876-b721-c09c5a9e2e8a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:33:41.775501 n-d-master-1 devstack@n-api.service[121102]: INFO oslo.messaging._drivers.impl_rabbit [-] [ea6ec045-ee0c-4212-8fa5-a40465026485] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 59298. Oct 30 02:33:41.778454 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f5cc026-c027-4c70-b829-bec26f817c3d tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:33:41.778956 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f5cc026-c027-4c70-b829-bec26f817c3d tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:33:41.779414 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f5cc026-c027-4c70-b829-bec26f817c3d tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:33:41.780135 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f5cc026-c027-4c70-b829-bec26f817c3d tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:33:41.780596 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f5cc026-c027-4c70-b829-bec26f817c3d tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:33:41.781069 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f5cc026-c027-4c70-b829-bec26f817c3d tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:33:41.812006 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3f5cc026-c027-4c70-b829-bec26f817c3d tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057797 Oct 30 02:33:41.812580 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4024/7714] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 02:33:41 2022] GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:33:42.443095 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-7647f04f-bc20-429f-9282-7d292295b7b7 req-8299a0c0-a6e1-447d-b990-54bf7477c39c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8b11d47-d46e-4876-b721-c09c5a9e2e8a", "tag": "2b5c37bf-b93f-4139-952c-3d69e022fa0a"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:33:42.452866 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-7647f04f-bc20-429f-9282-7d292295b7b7 req-8299a0c0-a6e1-447d-b990-54bf7477c39c service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:33:42.453469 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-7647f04f-bc20-429f-9282-7d292295b7b7 req-8299a0c0-a6e1-447d-b990-54bf7477c39c service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:33:42.453971 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-7647f04f-bc20-429f-9282-7d292295b7b7 req-8299a0c0-a6e1-447d-b990-54bf7477c39c service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:33:42.465111 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-7647f04f-bc20-429f-9282-7d292295b7b7 req-8299a0c0-a6e1-447d-b990-54bf7477c39c service nova] Creating event network-changed:2b5c37bf-b93f-4139-952c-3d69e022fa0a for instance d8b11d47-d46e-4876-b721-c09c5a9e2e8a on n-h1-master-1 Oct 30 02:33:42.470149 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-7647f04f-bc20-429f-9282-7d292295b7b7 req-8299a0c0-a6e1-447d-b990-54bf7477c39c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031233 Oct 30 02:33:42.470848 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3691/7715] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:33:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:33:42.825620 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b3ffbf86-8451-4118-a213-81aea415132e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:33:42.828056 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b3ffbf86-8451-4118-a213-81aea415132e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: d8b11d47-d46e-4876-b721-c09c5a9e2e8a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:33:42.834813 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b3ffbf86-8451-4118-a213-81aea415132e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:33:42.835437 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b3ffbf86-8451-4118-a213-81aea415132e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:33:42.836015 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b3ffbf86-8451-4118-a213-81aea415132e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:33:42.836834 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b3ffbf86-8451-4118-a213-81aea415132e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:33:42.837444 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b3ffbf86-8451-4118-a213-81aea415132e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:33:42.838003 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b3ffbf86-8451-4118-a213-81aea415132e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:33:42.868419 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b3ffbf86-8451-4118-a213-81aea415132e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047608 Oct 30 02:33:42.869185 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4025/7716] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 02:33:42 2022] GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:33:43.883605 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3971c679-6bfd-43ef-9b1e-131020a9f491 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:33:43.885900 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3971c679-6bfd-43ef-9b1e-131020a9f491 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: d8b11d47-d46e-4876-b721-c09c5a9e2e8a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:33:43.892175 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3971c679-6bfd-43ef-9b1e-131020a9f491 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:33:43.892675 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3971c679-6bfd-43ef-9b1e-131020a9f491 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:33:43.893116 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3971c679-6bfd-43ef-9b1e-131020a9f491 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:33:43.893870 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3971c679-6bfd-43ef-9b1e-131020a9f491 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:33:43.894327 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3971c679-6bfd-43ef-9b1e-131020a9f491 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:33:43.894762 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3971c679-6bfd-43ef-9b1e-131020a9f491 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:33:43.928184 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3971c679-6bfd-43ef-9b1e-131020a9f491 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049956 Oct 30 02:33:43.928793 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3692/7717] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 02:33:43 2022] GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:33:44.941389 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-422d693d-642d-4630-8bb5-7661a1e2570f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:33:44.943745 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-422d693d-642d-4630-8bb5-7661a1e2570f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: d8b11d47-d46e-4876-b721-c09c5a9e2e8a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:33:44.950764 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-422d693d-642d-4630-8bb5-7661a1e2570f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:33:44.951415 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-422d693d-642d-4630-8bb5-7661a1e2570f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:33:44.951927 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-422d693d-642d-4630-8bb5-7661a1e2570f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:33:44.952732 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-422d693d-642d-4630-8bb5-7661a1e2570f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:33:44.953265 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-422d693d-642d-4630-8bb5-7661a1e2570f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:33:44.953765 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-422d693d-642d-4630-8bb5-7661a1e2570f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:33:44.984643 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-422d693d-642d-4630-8bb5-7661a1e2570f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047407 Oct 30 02:33:44.985111 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4026/7718] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 02:33:44 2022] GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:33:45.997728 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e6f95c4b-194e-488e-8625-856bed7945ec tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:33:45.999904 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e6f95c4b-194e-488e-8625-856bed7945ec tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: d8b11d47-d46e-4876-b721-c09c5a9e2e8a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:33:46.006754 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e6f95c4b-194e-488e-8625-856bed7945ec tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:33:46.007248 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e6f95c4b-194e-488e-8625-856bed7945ec tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:33:46.007685 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e6f95c4b-194e-488e-8625-856bed7945ec tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:33:46.008381 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e6f95c4b-194e-488e-8625-856bed7945ec tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:33:46.008835 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e6f95c4b-194e-488e-8625-856bed7945ec tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:33:46.009258 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e6f95c4b-194e-488e-8625-856bed7945ec tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:33:46.038683 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e6f95c4b-194e-488e-8625-856bed7945ec tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045470 Oct 30 02:33:46.039262 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3693/7719] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 02:33:45 2022] GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:33:47.051406 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7d823353-f54a-4372-b755-cdc6b1f511ba tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:33:47.053632 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7d823353-f54a-4372-b755-cdc6b1f511ba tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: d8b11d47-d46e-4876-b721-c09c5a9e2e8a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:33:47.060469 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7d823353-f54a-4372-b755-cdc6b1f511ba tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:33:47.060960 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7d823353-f54a-4372-b755-cdc6b1f511ba tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:33:47.061432 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7d823353-f54a-4372-b755-cdc6b1f511ba tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:33:47.062134 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7d823353-f54a-4372-b755-cdc6b1f511ba tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:33:47.062597 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7d823353-f54a-4372-b755-cdc6b1f511ba tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:33:47.063035 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7d823353-f54a-4372-b755-cdc6b1f511ba tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:33:47.092137 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7d823353-f54a-4372-b755-cdc6b1f511ba tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044976 Oct 30 02:33:47.092683 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4027/7720] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 02:33:47 2022] GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 02:33:47.103174 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3ed44c76-192c-4988-9e1a-9382e3a94da6 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:33:47.103657 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3ed44c76-192c-4988-9e1a-9382e3a94da6 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: d8b11d47-d46e-4876-b721-c09c5a9e2e8a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:33:47.110229 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3ed44c76-192c-4988-9e1a-9382e3a94da6 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:33:47.110716 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3ed44c76-192c-4988-9e1a-9382e3a94da6 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:33:47.111154 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3ed44c76-192c-4988-9e1a-9382e3a94da6 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:33:47.111845 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3ed44c76-192c-4988-9e1a-9382e3a94da6 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:33:47.112327 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3ed44c76-192c-4988-9e1a-9382e3a94da6 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:33:47.112734 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3ed44c76-192c-4988-9e1a-9382e3a94da6 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:33:47.187203 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-3ed44c76-192c-4988-9e1a-9382e3a94da6 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] HTTP exception thrown: Instance d8b11d47-d46e-4876-b721-c09c5a9e2e8a is not attached to volume a9a0e903-f3f4-45e5-9c5f-e06977374338 Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3ed44c76-192c-4988-9e1a-9382e3a94da6 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Request method failure captured: Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: request: DELETE /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a/os-volume_attachments/a9a0e903-f3f4-45e5-9c5f-e06977374338 HTTP/1.1 Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXeGf755rIBeiTHzX7Cpxk5fM-F7b90QYMQIVJpd36bfEzIdTJ97JsiOO5gvSPckgyDyAAU60jNf_qBsvHoIM00VwkZ7JNmDAHKso4bj0J_BUVbOOjniKwSMzcpI3AMF93OfgBEWmdfX3n1ynuWjSgXoUX6G0uVtlvcJY1kZRtb6zoOs Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 6305db1090aa4559b92d87c1dbca1443 Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-TestMinimumBasicScenario-518047285 Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6305db1090aa4559b92d87c1dbca1443"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6305db1090aa4559b92d87c1dbca1443"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6305db1090aa4559b92d87c1dbca1443"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6305db1090aa4559b92d87c1dbca1443"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-TestMinimumBasicScenario-518047285 Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 6305db1090aa4559b92d87c1dbca1443 Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-TestMinimumBasicScenario-518047285 Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-TestMinimumBasicScenario-518047285-project Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: a75d2920b15d4f8fa293477d6cebba8c Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-TestMinimumBasicScenario-518047285-project Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: exception: Instance d8b11d47-d46e-4876-b721-c09c5a9e2e8a is not attached to volume a9a0e903-f3f4-45e5-9c5f-e06977374338 Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: action_args: {'server_id': 'd8b11d47-d46e-4876-b721-c09c5a9e2e8a', 'id': 'a9a0e903-f3f4-45e5-9c5f-e06977374338'} Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a9a0e903-f3f4-45e5-9c5f-e06977374338. Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8b11d47-d46e-4876-b721-c09c5a9e2e8a is not attached to volume a9a0e903-f3f4-45e5-9c5f-e06977374338 Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:33:47.188828 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:33:47.194048 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:33:47.194048 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:33:47.194048 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8b11d47-d46e-4876-b721-c09c5a9e2e8a is not attached to volume a9a0e903-f3f4-45e5-9c5f-e06977374338 Oct 30 02:33:47.194048 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:33:47.194048 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3ed44c76-192c-4988-9e1a-9382e3a94da6 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Returning 404 to user: Instance d8b11d47-d46e-4876-b721-c09c5a9e2e8a is not attached to volume a9a0e903-f3f4-45e5-9c5f-e06977374338 {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:33:47.194048 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3ed44c76-192c-4988-9e1a-9382e3a94da6 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a/os-volume_attachments/a9a0e903-f3f4-45e5-9c5f-e06977374338" status: 404 len: 154 microversion: 2.1 time: 0.091164 Oct 30 02:33:47.194048 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3694/7721] 10.222.0.13 () {58 vars in 1416 bytes} [Sun Oct 30 02:33:47 2022] DELETE /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a/os-volume_attachments/a9a0e903-f3f4-45e5-9c5f-e06977374338 => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 02:33:50.529879 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-dc4e5bf8-929d-45a7-a8cd-69909e898d2b tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:33:50.530405 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-dc4e5bf8-929d-45a7-a8cd-69909e898d2b tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: d8b11d47-d46e-4876-b721-c09c5a9e2e8a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:33:50.537688 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dc4e5bf8-929d-45a7-a8cd-69909e898d2b tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:33:50.538185 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dc4e5bf8-929d-45a7-a8cd-69909e898d2b tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:33:50.538630 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dc4e5bf8-929d-45a7-a8cd-69909e898d2b tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:33:50.539337 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dc4e5bf8-929d-45a7-a8cd-69909e898d2b tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:33:50.539804 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dc4e5bf8-929d-45a7-a8cd-69909e898d2b tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:33:50.540239 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dc4e5bf8-929d-45a7-a8cd-69909e898d2b tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:33:50.566535 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-dc4e5bf8-929d-45a7-a8cd-69909e898d2b tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: d8b11d47-d46e-4876-b721-c09c5a9e2e8a] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 02:33:50.835342 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-dc4e5bf8-929d-45a7-a8cd-69909e898d2b tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a" status: 204 len: 0 microversion: 2.1 time: 0.310548 Oct 30 02:33:50.836012 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4028/7722] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 02:33:50 2022] DELETE /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 02:33:50.845986 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3b39f5db-1cad-46f7-a91c-5c891d1851e0 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:33:50.846609 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3b39f5db-1cad-46f7-a91c-5c891d1851e0 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: d8b11d47-d46e-4876-b721-c09c5a9e2e8a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:33:50.853454 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b39f5db-1cad-46f7-a91c-5c891d1851e0 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:33:50.853946 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b39f5db-1cad-46f7-a91c-5c891d1851e0 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:33:50.854386 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b39f5db-1cad-46f7-a91c-5c891d1851e0 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:33:50.855086 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b39f5db-1cad-46f7-a91c-5c891d1851e0 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:33:50.855541 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b39f5db-1cad-46f7-a91c-5c891d1851e0 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:33:50.855970 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b39f5db-1cad-46f7-a91c-5c891d1851e0 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:33:50.990830 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3b39f5db-1cad-46f7-a91c-5c891d1851e0 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:33:50.999419 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3b39f5db-1cad-46f7-a91c-5c891d1851e0 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a" status: 200 len: 1556 microversion: 2.1 time: 0.159041 Oct 30 02:33:51.000077 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3695/7723] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:33:50 2022] GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a => generated 1556 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:33:52.023775 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-77b307ca-a421-42b9-a005-ad7330a31a43 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:33:52.024493 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-77b307ca-a421-42b9-a005-ad7330a31a43 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: d8b11d47-d46e-4876-b721-c09c5a9e2e8a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:33:52.035199 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-77b307ca-a421-42b9-a005-ad7330a31a43 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:33:52.035692 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-77b307ca-a421-42b9-a005-ad7330a31a43 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:33:52.036139 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-77b307ca-a421-42b9-a005-ad7330a31a43 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:33:52.036907 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-77b307ca-a421-42b9-a005-ad7330a31a43 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:33:52.037369 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-77b307ca-a421-42b9-a005-ad7330a31a43 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:33:52.037804 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-77b307ca-a421-42b9-a005-ad7330a31a43 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:33:52.213972 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-77b307ca-a421-42b9-a005-ad7330a31a43 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:33:52.221982 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-77b307ca-a421-42b9-a005-ad7330a31a43 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a" status: 200 len: 1556 microversion: 2.1 time: 0.202492 Oct 30 02:33:52.222568 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4029/7724] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:33:52 2022] GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a => generated 1556 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:33:53.066968 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-a029152d-7dfa-4972-8a26-dda41ad344de req-b9a3fe24-77fe-481b-bb0a-8fad850b30fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8b11d47-d46e-4876-b721-c09c5a9e2e8a", "name": "network-vif-deleted", "tag": "2b5c37bf-b93f-4139-952c-3d69e022fa0a"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:33:53.078856 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-a029152d-7dfa-4972-8a26-dda41ad344de req-b9a3fe24-77fe-481b-bb0a-8fad850b30fb service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:33:53.080534 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-a029152d-7dfa-4972-8a26-dda41ad344de req-b9a3fe24-77fe-481b-bb0a-8fad850b30fb service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:33:53.080534 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-a029152d-7dfa-4972-8a26-dda41ad344de req-b9a3fe24-77fe-481b-bb0a-8fad850b30fb service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:33:53.091580 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-a029152d-7dfa-4972-8a26-dda41ad344de req-b9a3fe24-77fe-481b-bb0a-8fad850b30fb service nova] Creating event network-vif-deleted:2b5c37bf-b93f-4139-952c-3d69e022fa0a for instance d8b11d47-d46e-4876-b721-c09c5a9e2e8a on n-h1-master-1 Oct 30 02:33:53.097064 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-a029152d-7dfa-4972-8a26-dda41ad344de req-b9a3fe24-77fe-481b-bb0a-8fad850b30fb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033882 Oct 30 02:33:53.098032 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3696/7725] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:33:53.244870 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bb0d8882-4482-49ec-a262-b57d8621b808 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:33:53.246304 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bb0d8882-4482-49ec-a262-b57d8621b808 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: d8b11d47-d46e-4876-b721-c09c5a9e2e8a] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:33:53.253661 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb0d8882-4482-49ec-a262-b57d8621b808 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:33:53.254415 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb0d8882-4482-49ec-a262-b57d8621b808 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:33:53.255077 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb0d8882-4482-49ec-a262-b57d8621b808 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:33:53.256240 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb0d8882-4482-49ec-a262-b57d8621b808 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:33:53.257062 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb0d8882-4482-49ec-a262-b57d8621b808 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:33:53.259015 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bb0d8882-4482-49ec-a262-b57d8621b808 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:33:53.332661 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bb0d8882-4482-49ec-a262-b57d8621b808 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:33:53.341295 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bb0d8882-4482-49ec-a262-b57d8621b808 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a" status: 200 len: 1344 microversion: 2.1 time: 0.099817 Oct 30 02:33:53.342102 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4030/7726] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:33:53 2022] GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a => generated 1344 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:33:54.366609 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e600ec04-33bb-40c8-bedc-fd54ad204ee5 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:33:54.367316 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e600ec04-33bb-40c8-bedc-fd54ad204ee5 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: d8b11d47-d46e-4876-b721-c09c5a9e2e8a] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:33:54.374224 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e600ec04-33bb-40c8-bedc-fd54ad204ee5 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:33:54.374710 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e600ec04-33bb-40c8-bedc-fd54ad204ee5 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:33:54.375145 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e600ec04-33bb-40c8-bedc-fd54ad204ee5 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:33:54.375838 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e600ec04-33bb-40c8-bedc-fd54ad204ee5 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:33:54.376291 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e600ec04-33bb-40c8-bedc-fd54ad204ee5 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:33:54.376714 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e600ec04-33bb-40c8-bedc-fd54ad204ee5 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:33:54.389855 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-e600ec04-33bb-40c8-bedc-fd54ad204ee5 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] HTTP exception thrown: Instance d8b11d47-d46e-4876-b721-c09c5a9e2e8a could not be found. Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e600ec04-33bb-40c8-bedc-fd54ad204ee5 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Request method failure captured: Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a HTTP/1.1 Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXeGf755rIBeiTHzX7Cpxk5fM-F7b90QYMQIVJpd36bfEzIdTJ97JsiOO5gvSPckgyDyAAU60jNf_qBsvHoIM00VwkZ7JNmDAHKso4bj0J_BUVbOOjniKwSMzcpI3AMF93OfgBEWmdfX3n1ynuWjSgXoUX6G0uVtlvcJY1kZRtb6zoOs Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 6305db1090aa4559b92d87c1dbca1443 Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-TestMinimumBasicScenario-518047285 Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6305db1090aa4559b92d87c1dbca1443"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6305db1090aa4559b92d87c1dbca1443"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6305db1090aa4559b92d87c1dbca1443"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6305db1090aa4559b92d87c1dbca1443"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-TestMinimumBasicScenario-518047285 Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 6305db1090aa4559b92d87c1dbca1443 Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-TestMinimumBasicScenario-518047285 Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-TestMinimumBasicScenario-518047285-project Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: a75d2920b15d4f8fa293477d6cebba8c Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-TestMinimumBasicScenario-518047285-project Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: exception: Instance d8b11d47-d46e-4876-b721-c09c5a9e2e8a could not be found. Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'd8b11d47-d46e-4876-b721-c09c5a9e2e8a'} Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8b11d47-d46e-4876-b721-c09c5a9e2e8a could not be found. Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8b11d47-d46e-4876-b721-c09c5a9e2e8a could not be found. Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:33:54.391454 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:33:54.396896 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:33:54.396896 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:33:54.396896 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:33:54.396896 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:33:54.396896 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:33:54.396896 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8b11d47-d46e-4876-b721-c09c5a9e2e8a could not be found. Oct 30 02:33:54.396896 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:33:54.396896 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e600ec04-33bb-40c8-bedc-fd54ad204ee5 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Returning 404 to user: Instance d8b11d47-d46e-4876-b721-c09c5a9e2e8a could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:33:54.396896 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e600ec04-33bb-40c8-bedc-fd54ad204ee5 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a" status: 404 len: 111 microversion: 2.1 time: 0.031407 Oct 30 02:33:54.396896 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3697/7727] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:33:54 2022] GET /compute/v2.1/servers/d8b11d47-d46e-4876-b721-c09c5a9e2e8a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 02:33:54.401626 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-666c32c9-c421-4b09-a91d-b3aa64255d2d tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '.version_select at 0x7f44c7edd3a0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:33:54.522480 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-666c32c9-c421-4b09-a91d-b3aa64255d2d tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1982573980" status: 202 len: 0 microversion: 2.1 time: 0.124771 Oct 30 02:33:54.523073 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4031/7728] 10.222.0.13 () {58 vars in 1272 bytes} [Sun Oct 30 02:33:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1982573980 => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 02:34:05.576136 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f4324fab-f849-41ee-83b4-5736f5940989 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Action: 'create', calling method: .version_select at 0x7f44c6ccc310>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1740950001", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEBJCv0t5RDDxbu4tgVTkA78vPZHYJ/9W3AcUNKvKuCe2t6zrX/qEkV7TzOXp4aBrUi160uNzD7EZcrbA6lWPl+6Wm6FpWAAoxCBEeIVqmGR2GBOLDp70AKsaI10QUUg3A=="}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:34:05.582432 n-d-master-1 devstack@n-api.service[121103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 30 02:34:05.584472 n-d-master-1 devstack@n-api.service[121103]: Sun Oct 30 02:34:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.13) !!! Oct 30 02:34:05.584603 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=18 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:34:05.586049 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:34:05.599432 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-f4324fab-f849-41ee-83b4-5736f5940989 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Getting quotas for project 6305db1090aa4559b92d87c1dbca1443. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 02:34:05.604534 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-f4324fab-f849-41ee-83b4-5736f5940989 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Getting quotas for user a75d2920b15d4f8fa293477d6cebba8c and project 6305db1090aa4559b92d87c1dbca1443. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 02:34:05.699785 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f4324fab-f849-41ee-83b4-5736f5940989 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.128351 Oct 30 02:34:05.700889 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3698/7729] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 30 02:34:05 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:34:05.749150 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:34:05.750026 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:34:05.750854 n-d-master-1 devstack@n-api.service[121102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 30 02:34:05.750997 n-d-master-1 devstack@n-api.service[121102]: Sun Oct 30 02:34:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.13) !!! Oct 30 02:34:05.757418 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-da119889-9a15-4abe-ba3e-9a087b596534 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-463787950", "imageRef": "a6996079-1c22-495a-8d3a-911416b7e64e", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1740950001", "networks": [{"uuid": "ffe9be98-371e-4c17-96fd-e2b8fa66d4fb"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:34:05.811338 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-da119889-9a15-4abe-ba3e-9a087b596534 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] validate_networks() for [('ffe9be98-371e-4c17-96fd-e2b8fa66d4fb', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 02:34:06.235466 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-da119889-9a15-4abe-ba3e-9a087b596534 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 02:34:06.235913 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-da119889-9a15-4abe-ba3e-9a087b596534 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 02:34:06.236408 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-da119889-9a15-4abe-ba3e-9a087b596534 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 02:34:06.236833 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-da119889-9a15-4abe-ba3e-9a087b596534 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 02:34:06.237264 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-da119889-9a15-4abe-ba3e-9a087b596534 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 02:34:06.246175 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-da119889-9a15-4abe-ba3e-9a087b596534 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:34:06.246615 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-da119889-9a15-4abe-ba3e-9a087b596534 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:34:06.247569 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-da119889-9a15-4abe-ba3e-9a087b596534 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:34:06.248312 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-da119889-9a15-4abe-ba3e-9a087b596534 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:34:06.248784 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-da119889-9a15-4abe-ba3e-9a087b596534 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:34:06.249232 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-da119889-9a15-4abe-ba3e-9a087b596534 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:34:06.267576 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-da119889-9a15-4abe-ba3e-9a087b596534 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Getting quotas for project 6305db1090aa4559b92d87c1dbca1443. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 02:34:06.272946 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-da119889-9a15-4abe-ba3e-9a087b596534 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Getting quotas for user a75d2920b15d4f8fa293477d6cebba8c and project 6305db1090aa4559b92d87c1dbca1443. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 02:34:06.285221 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-da119889-9a15-4abe-ba3e-9a087b596534 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 02:34:06.287501 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-da119889-9a15-4abe-ba3e-9a087b596534 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: cb10e972-c94d-44a3-8d6e-3be8a9cd0260] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6996079-1c22-495a-8d3a-911416b7e64e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 02:34:06.392352 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-da119889-9a15-4abe-ba3e-9a087b596534 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.645060 Oct 30 02:34:06.393039 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4032/7730] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 02:34:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 02:34:06.404415 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2b359ce9-508a-499e-9e68-d59b3381ebc0 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:34:06.405121 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2b359ce9-508a-499e-9e68-d59b3381ebc0 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: cb10e972-c94d-44a3-8d6e-3be8a9cd0260] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:34:06.465730 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2b359ce9-508a-499e-9e68-d59b3381ebc0 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:34:06.472652 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2b359ce9-508a-499e-9e68-d59b3381ebc0 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260" status: 200 len: 1258 microversion: 2.1 time: 0.072468 Oct 30 02:34:06.473220 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3699/7731] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:34:06 2022] GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260 => generated 1258 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:34:07.497486 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7f427028-fd60-4a10-b39e-3eb29a9f3665 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:34:07.498195 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7f427028-fd60-4a10-b39e-3eb29a9f3665 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: cb10e972-c94d-44a3-8d6e-3be8a9cd0260] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:34:07.504914 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7f427028-fd60-4a10-b39e-3eb29a9f3665 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:34:07.505440 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7f427028-fd60-4a10-b39e-3eb29a9f3665 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:34:07.505897 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7f427028-fd60-4a10-b39e-3eb29a9f3665 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:34:07.506598 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7f427028-fd60-4a10-b39e-3eb29a9f3665 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:34:07.507067 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7f427028-fd60-4a10-b39e-3eb29a9f3665 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:34:07.507510 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7f427028-fd60-4a10-b39e-3eb29a9f3665 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:34:07.570540 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7f427028-fd60-4a10-b39e-3eb29a9f3665 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:34:07.579429 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7f427028-fd60-4a10-b39e-3eb29a9f3665 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260" status: 200 len: 1262 microversion: 2.1 time: 0.087276 Oct 30 02:34:07.579998 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4033/7732] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:34:07 2022] GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260 => generated 1262 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:34:08.602366 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7ac58d3a-f28e-4b4a-bdc4-0977c505049a tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:34:08.603755 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7ac58d3a-f28e-4b4a-bdc4-0977c505049a tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: cb10e972-c94d-44a3-8d6e-3be8a9cd0260] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:34:08.610776 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7ac58d3a-f28e-4b4a-bdc4-0977c505049a tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:34:08.611269 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7ac58d3a-f28e-4b4a-bdc4-0977c505049a tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:34:08.616009 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7ac58d3a-f28e-4b4a-bdc4-0977c505049a tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:34:08.616009 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7ac58d3a-f28e-4b4a-bdc4-0977c505049a tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:34:08.616009 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7ac58d3a-f28e-4b4a-bdc4-0977c505049a tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:34:08.616009 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7ac58d3a-f28e-4b4a-bdc4-0977c505049a tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:34:08.689596 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7ac58d3a-f28e-4b4a-bdc4-0977c505049a tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:34:08.697969 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7ac58d3a-f28e-4b4a-bdc4-0977c505049a tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260" status: 200 len: 1318 microversion: 2.1 time: 0.099583 Oct 30 02:34:08.698772 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3700/7733] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:34:08 2022] GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260 => generated 1318 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:34:09.730512 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-da442c77-78a9-4894-b7f8-867dac4c525c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:34:09.731826 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-da442c77-78a9-4894-b7f8-867dac4c525c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: cb10e972-c94d-44a3-8d6e-3be8a9cd0260] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:34:09.740162 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-da442c77-78a9-4894-b7f8-867dac4c525c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:34:09.740991 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-da442c77-78a9-4894-b7f8-867dac4c525c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:34:09.742463 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-da442c77-78a9-4894-b7f8-867dac4c525c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:34:09.743472 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-da442c77-78a9-4894-b7f8-867dac4c525c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:34:09.744187 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-da442c77-78a9-4894-b7f8-867dac4c525c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:34:09.744868 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-da442c77-78a9-4894-b7f8-867dac4c525c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:34:09.908370 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-da442c77-78a9-4894-b7f8-867dac4c525c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:34:09.917933 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-da442c77-78a9-4894-b7f8-867dac4c525c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260" status: 200 len: 1358 microversion: 2.1 time: 0.191424 Oct 30 02:34:09.933918 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4034/7734] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:34:09 2022] GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260 => generated 1358 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:34:10.946314 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bfd1b4db-fe1b-4e23-9f6a-1c9f1baca2e3 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:34:10.947886 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-bfd1b4db-fe1b-4e23-9f6a-1c9f1baca2e3 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: cb10e972-c94d-44a3-8d6e-3be8a9cd0260] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:34:10.955894 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bfd1b4db-fe1b-4e23-9f6a-1c9f1baca2e3 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:34:10.956384 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bfd1b4db-fe1b-4e23-9f6a-1c9f1baca2e3 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:34:10.956819 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bfd1b4db-fe1b-4e23-9f6a-1c9f1baca2e3 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:34:10.957632 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bfd1b4db-fe1b-4e23-9f6a-1c9f1baca2e3 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:34:10.958090 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bfd1b4db-fe1b-4e23-9f6a-1c9f1baca2e3 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:34:10.958516 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bfd1b4db-fe1b-4e23-9f6a-1c9f1baca2e3 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:34:11.097028 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-bfd1b4db-fe1b-4e23-9f6a-1c9f1baca2e3 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:34:11.105123 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bfd1b4db-fe1b-4e23-9f6a-1c9f1baca2e3 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260" status: 200 len: 1358 microversion: 2.1 time: 0.164762 Oct 30 02:34:11.105742 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3701/7735] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:34:10 2022] GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:34:12.130333 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fd226096-43f0-4233-b5bf-4f714230a11b tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:34:12.130975 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fd226096-43f0-4233-b5bf-4f714230a11b tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: cb10e972-c94d-44a3-8d6e-3be8a9cd0260] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:34:12.139030 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fd226096-43f0-4233-b5bf-4f714230a11b tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:34:12.139618 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fd226096-43f0-4233-b5bf-4f714230a11b tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:34:12.140076 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fd226096-43f0-4233-b5bf-4f714230a11b tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:34:12.140802 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fd226096-43f0-4233-b5bf-4f714230a11b tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:34:12.141283 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fd226096-43f0-4233-b5bf-4f714230a11b tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:34:12.141749 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fd226096-43f0-4233-b5bf-4f714230a11b tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:34:12.273671 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-fd226096-43f0-4233-b5bf-4f714230a11b tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:34:12.281361 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fd226096-43f0-4233-b5bf-4f714230a11b tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260" status: 200 len: 1358 microversion: 2.1 time: 0.155131 Oct 30 02:34:12.281937 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4035/7736] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:34:12 2022] GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:34:13.304295 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2caf526e-24f4-49f2-af11-aa91fa4d17d5 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:34:13.304907 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2caf526e-24f4-49f2-af11-aa91fa4d17d5 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: cb10e972-c94d-44a3-8d6e-3be8a9cd0260] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:34:13.312299 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2caf526e-24f4-49f2-af11-aa91fa4d17d5 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:34:13.321093 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2caf526e-24f4-49f2-af11-aa91fa4d17d5 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:34:13.321093 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2caf526e-24f4-49f2-af11-aa91fa4d17d5 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:34:13.321093 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2caf526e-24f4-49f2-af11-aa91fa4d17d5 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:34:13.321093 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2caf526e-24f4-49f2-af11-aa91fa4d17d5 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:34:13.321093 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2caf526e-24f4-49f2-af11-aa91fa4d17d5 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:34:13.466450 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2caf526e-24f4-49f2-af11-aa91fa4d17d5 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:34:13.474808 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2caf526e-24f4-49f2-af11-aa91fa4d17d5 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260" status: 200 len: 1358 microversion: 2.1 time: 0.174375 Oct 30 02:34:13.475401 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3702/7737] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:34:13 2022] GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:34:14.499774 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2001b996-d79c-4d85-a3bd-b90da9c3f2ae tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:34:14.501979 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2001b996-d79c-4d85-a3bd-b90da9c3f2ae tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: cb10e972-c94d-44a3-8d6e-3be8a9cd0260] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:34:14.511173 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2001b996-d79c-4d85-a3bd-b90da9c3f2ae tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:34:14.511928 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2001b996-d79c-4d85-a3bd-b90da9c3f2ae tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:34:14.512606 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2001b996-d79c-4d85-a3bd-b90da9c3f2ae tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:34:14.513563 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2001b996-d79c-4d85-a3bd-b90da9c3f2ae tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:34:14.514691 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2001b996-d79c-4d85-a3bd-b90da9c3f2ae tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:34:14.515295 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2001b996-d79c-4d85-a3bd-b90da9c3f2ae tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:34:14.670759 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2001b996-d79c-4d85-a3bd-b90da9c3f2ae tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:34:14.679284 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2001b996-d79c-4d85-a3bd-b90da9c3f2ae tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260" status: 200 len: 1358 microversion: 2.1 time: 0.184273 Oct 30 02:34:14.680119 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4036/7738] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:34:14 2022] GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:34:15.705767 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-832019da-57c1-40a0-bf73-23c8c78b7ca3 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:34:15.706363 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-832019da-57c1-40a0-bf73-23c8c78b7ca3 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: cb10e972-c94d-44a3-8d6e-3be8a9cd0260] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:34:15.713382 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-832019da-57c1-40a0-bf73-23c8c78b7ca3 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:34:15.713866 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-832019da-57c1-40a0-bf73-23c8c78b7ca3 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:34:15.714301 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-832019da-57c1-40a0-bf73-23c8c78b7ca3 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:34:15.714990 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-832019da-57c1-40a0-bf73-23c8c78b7ca3 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:34:15.715443 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-832019da-57c1-40a0-bf73-23c8c78b7ca3 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:34:15.715864 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-832019da-57c1-40a0-bf73-23c8c78b7ca3 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:34:15.843437 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-832019da-57c1-40a0-bf73-23c8c78b7ca3 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:34:15.851768 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-832019da-57c1-40a0-bf73-23c8c78b7ca3 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260" status: 200 len: 1358 microversion: 2.1 time: 0.150309 Oct 30 02:34:15.852352 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3703/7739] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:34:15 2022] GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:34:16.876629 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-56b80fb0-eb92-4125-b08c-c63bc712fae1 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:34:16.877896 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-56b80fb0-eb92-4125-b08c-c63bc712fae1 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: cb10e972-c94d-44a3-8d6e-3be8a9cd0260] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:34:16.880799 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:34:16.881645 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=6 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:34:16.886594 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-56b80fb0-eb92-4125-b08c-c63bc712fae1 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:34:16.887122 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-56b80fb0-eb92-4125-b08c-c63bc712fae1 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:34:16.887589 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-56b80fb0-eb92-4125-b08c-c63bc712fae1 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:34:16.888289 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-56b80fb0-eb92-4125-b08c-c63bc712fae1 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:34:16.888756 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-56b80fb0-eb92-4125-b08c-c63bc712fae1 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:34:16.889194 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-56b80fb0-eb92-4125-b08c-c63bc712fae1 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:34:17.036501 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-56b80fb0-eb92-4125-b08c-c63bc712fae1 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:34:17.044720 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-56b80fb0-eb92-4125-b08c-c63bc712fae1 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260" status: 200 len: 1358 microversion: 2.1 time: 0.172954 Oct 30 02:34:17.045870 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4037/7740] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:34:16 2022] GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:34:18.070267 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-acaed4c3-4134-41c1-8c8f-c30fecbc9f28 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:34:18.070865 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-acaed4c3-4134-41c1-8c8f-c30fecbc9f28 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: cb10e972-c94d-44a3-8d6e-3be8a9cd0260] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:34:18.072694 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=6 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:34:18.078745 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-acaed4c3-4134-41c1-8c8f-c30fecbc9f28 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:34:18.079421 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-acaed4c3-4134-41c1-8c8f-c30fecbc9f28 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:34:18.079656 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-acaed4c3-4134-41c1-8c8f-c30fecbc9f28 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:34:18.080360 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-acaed4c3-4134-41c1-8c8f-c30fecbc9f28 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:34:18.080819 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-acaed4c3-4134-41c1-8c8f-c30fecbc9f28 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:34:18.081246 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-acaed4c3-4134-41c1-8c8f-c30fecbc9f28 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:34:18.214884 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-acaed4c3-4134-41c1-8c8f-c30fecbc9f28 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:34:18.222653 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-acaed4c3-4134-41c1-8c8f-c30fecbc9f28 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260" status: 200 len: 1358 microversion: 2.1 time: 0.157213 Oct 30 02:34:18.223217 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3704/7741] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:34:18 2022] GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:34:19.245955 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4265f75e-17ff-4a03-b882-fa28e797d7bd tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:34:19.246619 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4265f75e-17ff-4a03-b882-fa28e797d7bd tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: cb10e972-c94d-44a3-8d6e-3be8a9cd0260] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:34:19.253626 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4265f75e-17ff-4a03-b882-fa28e797d7bd tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:34:19.254126 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4265f75e-17ff-4a03-b882-fa28e797d7bd tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:34:19.254574 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4265f75e-17ff-4a03-b882-fa28e797d7bd tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:34:19.255287 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4265f75e-17ff-4a03-b882-fa28e797d7bd tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:34:19.255766 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4265f75e-17ff-4a03-b882-fa28e797d7bd tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:34:19.256189 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4265f75e-17ff-4a03-b882-fa28e797d7bd tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:34:19.409987 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4265f75e-17ff-4a03-b882-fa28e797d7bd tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:34:19.418919 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4265f75e-17ff-4a03-b882-fa28e797d7bd tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260" status: 200 len: 1358 microversion: 2.1 time: 0.176867 Oct 30 02:34:19.419638 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4038/7742] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:34:19 2022] GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:34:19.694382 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-8be818de-d4f0-45a6-85b2-8f7795f50113 req-06e5cc52-1b08-4a95-be9e-ffef10673036 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb10e972-c94d-44a3-8d6e-3be8a9cd0260", "tag": "d62d7cc5-6fa4-44ee-99a2-0105677e6b8b"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:34:19.707047 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-8be818de-d4f0-45a6-85b2-8f7795f50113 req-06e5cc52-1b08-4a95-be9e-ffef10673036 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:34:19.707559 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-8be818de-d4f0-45a6-85b2-8f7795f50113 req-06e5cc52-1b08-4a95-be9e-ffef10673036 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:34:19.707997 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-8be818de-d4f0-45a6-85b2-8f7795f50113 req-06e5cc52-1b08-4a95-be9e-ffef10673036 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:34:19.719798 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-8be818de-d4f0-45a6-85b2-8f7795f50113 req-06e5cc52-1b08-4a95-be9e-ffef10673036 service nova] Creating event network-changed:d62d7cc5-6fa4-44ee-99a2-0105677e6b8b for instance cb10e972-c94d-44a3-8d6e-3be8a9cd0260 on n-h2-master-1 Oct 30 02:34:19.725297 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-8be818de-d4f0-45a6-85b2-8f7795f50113 req-06e5cc52-1b08-4a95-be9e-ffef10673036 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035140 Oct 30 02:34:19.726105 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3705/7743] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:34:20.443269 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5e0cf564-056f-420f-9274-995ef2cf7ccb tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:34:20.444047 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5e0cf564-056f-420f-9274-995ef2cf7ccb tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: cb10e972-c94d-44a3-8d6e-3be8a9cd0260] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:34:20.458025 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5e0cf564-056f-420f-9274-995ef2cf7ccb tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:34:20.458634 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5e0cf564-056f-420f-9274-995ef2cf7ccb tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:34:20.459094 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5e0cf564-056f-420f-9274-995ef2cf7ccb tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:34:20.459843 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5e0cf564-056f-420f-9274-995ef2cf7ccb tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:34:20.460314 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5e0cf564-056f-420f-9274-995ef2cf7ccb tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:34:20.460769 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5e0cf564-056f-420f-9274-995ef2cf7ccb tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:34:20.595246 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5e0cf564-056f-420f-9274-995ef2cf7ccb tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:34:20.602719 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5e0cf564-056f-420f-9274-995ef2cf7ccb tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260" status: 200 len: 1358 microversion: 2.1 time: 0.163671 Oct 30 02:34:20.603306 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4039/7744] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:34:20 2022] GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:34:21.627964 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-302d602f-64b9-4abd-8a65-3bba07ce1e9e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:34:21.628663 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-302d602f-64b9-4abd-8a65-3bba07ce1e9e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: cb10e972-c94d-44a3-8d6e-3be8a9cd0260] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:34:21.634773 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-302d602f-64b9-4abd-8a65-3bba07ce1e9e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:34:21.635249 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-302d602f-64b9-4abd-8a65-3bba07ce1e9e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:34:21.635675 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-302d602f-64b9-4abd-8a65-3bba07ce1e9e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:34:21.636357 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-302d602f-64b9-4abd-8a65-3bba07ce1e9e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:34:21.636802 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-302d602f-64b9-4abd-8a65-3bba07ce1e9e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:34:21.637225 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-302d602f-64b9-4abd-8a65-3bba07ce1e9e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:34:21.763840 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-302d602f-64b9-4abd-8a65-3bba07ce1e9e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:34:21.772033 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-302d602f-64b9-4abd-8a65-3bba07ce1e9e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260" status: 200 len: 1358 microversion: 2.1 time: 0.149720 Oct 30 02:34:21.772606 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3706/7745] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:34:21 2022] GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:34:22.794672 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-072ebbd2-26be-4c06-9196-9f39c16fe4e6 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:34:22.795295 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-072ebbd2-26be-4c06-9196-9f39c16fe4e6 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: cb10e972-c94d-44a3-8d6e-3be8a9cd0260] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:34:22.802526 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-072ebbd2-26be-4c06-9196-9f39c16fe4e6 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:34:22.803018 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-072ebbd2-26be-4c06-9196-9f39c16fe4e6 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:34:22.803460 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-072ebbd2-26be-4c06-9196-9f39c16fe4e6 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:34:22.804158 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-072ebbd2-26be-4c06-9196-9f39c16fe4e6 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:34:22.804620 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-072ebbd2-26be-4c06-9196-9f39c16fe4e6 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:34:22.805053 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-072ebbd2-26be-4c06-9196-9f39c16fe4e6 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:34:22.932389 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-072ebbd2-26be-4c06-9196-9f39c16fe4e6 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:34:22.940010 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-072ebbd2-26be-4c06-9196-9f39c16fe4e6 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260" status: 200 len: 1358 microversion: 2.1 time: 0.149297 Oct 30 02:34:22.940577 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4040/7746] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:34:22 2022] GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:34:23.963135 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3f1a50f2-86f4-4b7f-987c-90ba0ac10a14 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:34:23.963786 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3f1a50f2-86f4-4b7f-987c-90ba0ac10a14 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: cb10e972-c94d-44a3-8d6e-3be8a9cd0260] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:34:23.970868 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f1a50f2-86f4-4b7f-987c-90ba0ac10a14 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:34:23.971351 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f1a50f2-86f4-4b7f-987c-90ba0ac10a14 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:34:23.971786 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f1a50f2-86f4-4b7f-987c-90ba0ac10a14 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:34:23.972504 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f1a50f2-86f4-4b7f-987c-90ba0ac10a14 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:34:23.973014 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f1a50f2-86f4-4b7f-987c-90ba0ac10a14 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:34:23.973481 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f1a50f2-86f4-4b7f-987c-90ba0ac10a14 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:34:24.105713 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3f1a50f2-86f4-4b7f-987c-90ba0ac10a14 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:34:24.113585 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3f1a50f2-86f4-4b7f-987c-90ba0ac10a14 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260" status: 200 len: 1358 microversion: 2.1 time: 0.154347 Oct 30 02:34:24.114173 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3707/7747] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:34:23 2022] GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:34:25.136275 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7f0a2000-25b6-4b2e-8191-42937cbd5f40 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:34:25.137635 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7f0a2000-25b6-4b2e-8191-42937cbd5f40 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: cb10e972-c94d-44a3-8d6e-3be8a9cd0260] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:34:25.144904 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7f0a2000-25b6-4b2e-8191-42937cbd5f40 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:34:25.145434 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7f0a2000-25b6-4b2e-8191-42937cbd5f40 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:34:25.145884 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7f0a2000-25b6-4b2e-8191-42937cbd5f40 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:34:25.146639 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7f0a2000-25b6-4b2e-8191-42937cbd5f40 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:34:25.147050 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7f0a2000-25b6-4b2e-8191-42937cbd5f40 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:34:25.147482 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7f0a2000-25b6-4b2e-8191-42937cbd5f40 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:34:25.254473 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-330d9f28-b8b6-48e2-9418-6c50f4dd1df9 req-e4f24d92-ba2a-429c-a42d-cc1700b7d8c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb10e972-c94d-44a3-8d6e-3be8a9cd0260", "name": "network-vif-plugged", "status": "completed", "tag": "d62d7cc5-6fa4-44ee-99a2-0105677e6b8b"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:34:25.265223 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-330d9f28-b8b6-48e2-9418-6c50f4dd1df9 req-e4f24d92-ba2a-429c-a42d-cc1700b7d8c2 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:34:25.265739 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-330d9f28-b8b6-48e2-9418-6c50f4dd1df9 req-e4f24d92-ba2a-429c-a42d-cc1700b7d8c2 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:34:25.272645 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-330d9f28-b8b6-48e2-9418-6c50f4dd1df9 req-e4f24d92-ba2a-429c-a42d-cc1700b7d8c2 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:34:25.277640 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-330d9f28-b8b6-48e2-9418-6c50f4dd1df9 req-e4f24d92-ba2a-429c-a42d-cc1700b7d8c2 service nova] Creating event network-vif-plugged:d62d7cc5-6fa4-44ee-99a2-0105677e6b8b for instance cb10e972-c94d-44a3-8d6e-3be8a9cd0260 on n-h2-master-1 Oct 30 02:34:25.283370 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-330d9f28-b8b6-48e2-9418-6c50f4dd1df9 req-e4f24d92-ba2a-429c-a42d-cc1700b7d8c2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089067 Oct 30 02:34:25.284335 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3708/7748] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:34:25.290129 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7f0a2000-25b6-4b2e-8191-42937cbd5f40 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:34:25.298117 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7f0a2000-25b6-4b2e-8191-42937cbd5f40 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260" status: 200 len: 1358 microversion: 2.1 time: 0.165456 Oct 30 02:34:25.298912 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4041/7749] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:34:25 2022] GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:34:26.322587 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a1a454a5-8f01-425c-945f-64e318f92976 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:34:26.323283 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a1a454a5-8f01-425c-945f-64e318f92976 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: cb10e972-c94d-44a3-8d6e-3be8a9cd0260] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:34:26.329491 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a1a454a5-8f01-425c-945f-64e318f92976 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:34:26.329972 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a1a454a5-8f01-425c-945f-64e318f92976 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:34:26.330430 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a1a454a5-8f01-425c-945f-64e318f92976 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:34:26.331113 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a1a454a5-8f01-425c-945f-64e318f92976 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:34:26.331561 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a1a454a5-8f01-425c-945f-64e318f92976 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:34:26.331985 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a1a454a5-8f01-425c-945f-64e318f92976 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:34:26.463358 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a1a454a5-8f01-425c-945f-64e318f92976 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:34:26.471531 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a1a454a5-8f01-425c-945f-64e318f92976 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260" status: 200 len: 1358 microversion: 2.1 time: 0.154190 Oct 30 02:34:26.472107 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3709/7750] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:34:26 2022] GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:34:27.495681 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4c6a0207-61d2-4cbe-83a8-e6e56a12d3a4 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:34:27.496311 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4c6a0207-61d2-4cbe-83a8-e6e56a12d3a4 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: cb10e972-c94d-44a3-8d6e-3be8a9cd0260] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:34:27.503268 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4c6a0207-61d2-4cbe-83a8-e6e56a12d3a4 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:34:27.503761 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4c6a0207-61d2-4cbe-83a8-e6e56a12d3a4 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:34:27.504207 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4c6a0207-61d2-4cbe-83a8-e6e56a12d3a4 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:34:27.504904 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4c6a0207-61d2-4cbe-83a8-e6e56a12d3a4 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:34:27.505479 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4c6a0207-61d2-4cbe-83a8-e6e56a12d3a4 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:34:27.505838 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4c6a0207-61d2-4cbe-83a8-e6e56a12d3a4 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:34:27.643200 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4c6a0207-61d2-4cbe-83a8-e6e56a12d3a4 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:34:27.651156 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4c6a0207-61d2-4cbe-83a8-e6e56a12d3a4 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260" status: 200 len: 1548 microversion: 2.1 time: 0.159583 Oct 30 02:34:27.651773 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4042/7751] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:34:27 2022] GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260 => generated 1548 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:34:27.673861 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8b1d47b3-24cf-4d32-b2bd-8da436a05f2c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:34:27.674417 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8b1d47b3-24cf-4d32-b2bd-8da436a05f2c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: cb10e972-c94d-44a3-8d6e-3be8a9cd0260] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:34:27.681321 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8b1d47b3-24cf-4d32-b2bd-8da436a05f2c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:34:27.681866 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8b1d47b3-24cf-4d32-b2bd-8da436a05f2c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:34:27.682309 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8b1d47b3-24cf-4d32-b2bd-8da436a05f2c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:34:27.683006 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8b1d47b3-24cf-4d32-b2bd-8da436a05f2c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:34:27.683465 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8b1d47b3-24cf-4d32-b2bd-8da436a05f2c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:34:27.683894 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8b1d47b3-24cf-4d32-b2bd-8da436a05f2c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:34:27.812257 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8b1d47b3-24cf-4d32-b2bd-8da436a05f2c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:34:27.820165 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8b1d47b3-24cf-4d32-b2bd-8da436a05f2c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260" status: 200 len: 1548 microversion: 2.1 time: 0.150619 Oct 30 02:34:27.820739 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3710/7752] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:34:27 2022] GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260 => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:34:27.842245 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-467e898b-f2e3-4ad0-84d7-bdfbf4555f92 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:34:27.847226 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-467e898b-f2e3-4ad0-84d7-bdfbf4555f92 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:34:27.851924 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-467e898b-f2e3-4ad0-84d7-bdfbf4555f92 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Searching by: {'deleted': False, 'project_id': '6305db1090aa4559b92d87c1dbca1443'} {{(pid=121102) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 30 02:34:27.853243 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-467e898b-f2e3-4ad0-84d7-bdfbf4555f92 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:34:27.853768 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-467e898b-f2e3-4ad0-84d7-bdfbf4555f92 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:34:27.854214 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-467e898b-f2e3-4ad0-84d7-bdfbf4555f92 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:34:27.854940 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-467e898b-f2e3-4ad0-84d7-bdfbf4555f92 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:34:27.855400 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-467e898b-f2e3-4ad0-84d7-bdfbf4555f92 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:34:27.855833 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-467e898b-f2e3-4ad0-84d7-bdfbf4555f92 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:34:27.879890 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.multi_cell_list [None req-467e898b-f2e3-4ad0-84d7-bdfbf4555f92 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121102) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 30 02:34:27.908167 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-467e898b-f2e3-4ad0-84d7-bdfbf4555f92 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.069648 Oct 30 02:34:27.908923 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4043/7753] 10.222.0.13 () {58 vars in 1125 bytes} [Sun Oct 30 02:34:27 2022] GET /compute/v2.1/servers => generated 342 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:34:27.920503 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8fd7c89a-e1ed-4795-befa-40a8deb1da0f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:34:27.921150 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8fd7c89a-e1ed-4795-befa-40a8deb1da0f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: cb10e972-c94d-44a3-8d6e-3be8a9cd0260] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:34:27.927354 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8fd7c89a-e1ed-4795-befa-40a8deb1da0f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:34:27.927756 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8fd7c89a-e1ed-4795-befa-40a8deb1da0f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:34:27.928188 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8fd7c89a-e1ed-4795-befa-40a8deb1da0f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:34:27.928872 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8fd7c89a-e1ed-4795-befa-40a8deb1da0f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:34:27.929321 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8fd7c89a-e1ed-4795-befa-40a8deb1da0f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:34:27.929767 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8fd7c89a-e1ed-4795-befa-40a8deb1da0f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:34:28.057063 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8fd7c89a-e1ed-4795-befa-40a8deb1da0f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:34:28.065667 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8fd7c89a-e1ed-4795-befa-40a8deb1da0f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260" status: 200 len: 1548 microversion: 2.1 time: 0.148967 Oct 30 02:34:28.066245 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3711/7754] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:34:27 2022] GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260 => generated 1548 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:34:30.871131 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0b9758a4-e633-4395-a6f9-308e5540c859 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "407f6a4f-eb17-40c6-9210-27c50342bb43"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:34:30.873654 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0b9758a4-e633-4395-a6f9-308e5540c859 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: cb10e972-c94d-44a3-8d6e-3be8a9cd0260] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:34:30.881788 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b9758a4-e633-4395-a6f9-308e5540c859 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:34:30.882298 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b9758a4-e633-4395-a6f9-308e5540c859 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:34:30.882929 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b9758a4-e633-4395-a6f9-308e5540c859 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:34:30.883651 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b9758a4-e633-4395-a6f9-308e5540c859 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:34:30.884133 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b9758a4-e633-4395-a6f9-308e5540c859 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:34:30.884567 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b9758a4-e633-4395-a6f9-308e5540c859 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:34:31.543975 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0b9758a4-e633-4395-a6f9-308e5540c859 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "POST /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.676618 Oct 30 02:34:31.544608 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4044/7755] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 30 02:34:30 2022] POST /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260/os-volume_attachments => generated 194 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:34:43.375984 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e04e9b2f-a135-4376-957f-62a4101654e0 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:34:43.376692 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e04e9b2f-a135-4376-957f-62a4101654e0 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: cb10e972-c94d-44a3-8d6e-3be8a9cd0260] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:34:43.379336 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:34:43.382093 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=64 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:34:43.384728 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e04e9b2f-a135-4376-957f-62a4101654e0 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:34:43.385111 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e04e9b2f-a135-4376-957f-62a4101654e0 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:34:43.385594 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e04e9b2f-a135-4376-957f-62a4101654e0 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:34:43.386288 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e04e9b2f-a135-4376-957f-62a4101654e0 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:34:43.386740 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e04e9b2f-a135-4376-957f-62a4101654e0 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:34:43.387183 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e04e9b2f-a135-4376-957f-62a4101654e0 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:34:43.517461 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e04e9b2f-a135-4376-957f-62a4101654e0 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:34:43.525813 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e04e9b2f-a135-4376-957f-62a4101654e0 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260" status: 200 len: 1594 microversion: 2.1 time: 0.153832 Oct 30 02:34:43.526388 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3712/7756] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:34:43 2022] GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260 => generated 1594 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:34:45.389520 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:34:45.390676 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:34:45.391364 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:34:45.395490 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-402311c6-d251-4be0-ad2d-1f3c2e417757 req-4e344414-e358-4aa2-b228-9b79378bb96f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb10e972-c94d-44a3-8d6e-3be8a9cd0260", "tag": "d62d7cc5-6fa4-44ee-99a2-0105677e6b8b"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:34:45.405120 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-402311c6-d251-4be0-ad2d-1f3c2e417757 req-4e344414-e358-4aa2-b228-9b79378bb96f service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:34:45.405747 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-402311c6-d251-4be0-ad2d-1f3c2e417757 req-4e344414-e358-4aa2-b228-9b79378bb96f service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:34:45.406110 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-402311c6-d251-4be0-ad2d-1f3c2e417757 req-4e344414-e358-4aa2-b228-9b79378bb96f service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:34:45.417772 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-402311c6-d251-4be0-ad2d-1f3c2e417757 req-4e344414-e358-4aa2-b228-9b79378bb96f service nova] Creating event network-changed:d62d7cc5-6fa4-44ee-99a2-0105677e6b8b for instance cb10e972-c94d-44a3-8d6e-3be8a9cd0260 on n-h2-master-1 Oct 30 02:34:45.424203 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-402311c6-d251-4be0-ad2d-1f3c2e417757 req-4e344414-e358-4aa2-b228-9b79378bb96f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036490 Oct 30 02:34:45.425519 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4045/7757] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:34:47.754652 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4e5de525-48d6-4444-a023-b14022c1cbb0 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1133929583"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:34:47.755226 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4e5de525-48d6-4444-a023-b14022c1cbb0 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: cb10e972-c94d-44a3-8d6e-3be8a9cd0260] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:34:47.762314 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4e5de525-48d6-4444-a023-b14022c1cbb0 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:34:47.762796 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4e5de525-48d6-4444-a023-b14022c1cbb0 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:34:47.763229 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4e5de525-48d6-4444-a023-b14022c1cbb0 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:34:47.763918 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4e5de525-48d6-4444-a023-b14022c1cbb0 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:34:47.764364 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4e5de525-48d6-4444-a023-b14022c1cbb0 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:34:47.764797 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4e5de525-48d6-4444-a023-b14022c1cbb0 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:34:47.895647 n-d-master-1 devstack@n-api.service[121103]: INFO nova.network.security_group_api [None req-4e5de525-48d6-4444-a023-b14022c1cbb0 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Adding security group eb9e86d7-3574-4b7f-969b-10a6c2c5de19 to port d62d7cc5-6fa4-44ee-99a2-0105677e6b8b Oct 30 02:34:48.271582 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4e5de525-48d6-4444-a023-b14022c1cbb0 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "POST /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260/action" status: 202 len: 0 microversion: 2.1 time: 0.520754 Oct 30 02:34:48.272141 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3713/7758] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 02:34:47 2022] POST /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260/action => generated 0 bytes in 523 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 30 02:34:48.281801 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8255c4ef-8c77-4b30-8763-b85e2b87636e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:34:48.283233 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-9b5e6230-8606-47a0-bcfb-121345e5098d req-e0cca6cd-cfcc-4d05-8823-6b122a93940f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb10e972-c94d-44a3-8d6e-3be8a9cd0260", "tag": "d62d7cc5-6fa4-44ee-99a2-0105677e6b8b"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:34:48.283738 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8255c4ef-8c77-4b30-8763-b85e2b87636e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: cb10e972-c94d-44a3-8d6e-3be8a9cd0260] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:34:48.288849 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8255c4ef-8c77-4b30-8763-b85e2b87636e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:34:48.289603 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8255c4ef-8c77-4b30-8763-b85e2b87636e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:34:48.290039 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8255c4ef-8c77-4b30-8763-b85e2b87636e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:34:48.291033 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8255c4ef-8c77-4b30-8763-b85e2b87636e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:34:48.291480 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8255c4ef-8c77-4b30-8763-b85e2b87636e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:34:48.291902 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8255c4ef-8c77-4b30-8763-b85e2b87636e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:34:48.312074 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-9b5e6230-8606-47a0-bcfb-121345e5098d req-e0cca6cd-cfcc-4d05-8823-6b122a93940f service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:34:48.313620 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-9b5e6230-8606-47a0-bcfb-121345e5098d req-e0cca6cd-cfcc-4d05-8823-6b122a93940f service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:34:48.313620 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-9b5e6230-8606-47a0-bcfb-121345e5098d req-e0cca6cd-cfcc-4d05-8823-6b122a93940f service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:34:48.332933 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-9b5e6230-8606-47a0-bcfb-121345e5098d req-e0cca6cd-cfcc-4d05-8823-6b122a93940f service nova] Creating event network-changed:d62d7cc5-6fa4-44ee-99a2-0105677e6b8b for instance cb10e972-c94d-44a3-8d6e-3be8a9cd0260 on n-h2-master-1 Oct 30 02:34:48.339637 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-9b5e6230-8606-47a0-bcfb-121345e5098d req-e0cca6cd-cfcc-4d05-8823-6b122a93940f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062551 Oct 30 02:34:48.342702 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4046/7759] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:34:48.555153 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8255c4ef-8c77-4b30-8763-b85e2b87636e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:34:48.565209 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8255c4ef-8c77-4b30-8763-b85e2b87636e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260" status: 200 len: 1760 microversion: 2.1 time: 0.287622 Oct 30 02:34:48.566053 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3714/7760] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:34:48 2022] GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260 => generated 1760 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:35:01.747175 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5dad16bd-859e-49a9-a41f-e852804864e0 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:35:01.749678 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5dad16bd-859e-49a9-a41f-e852804864e0 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: cb10e972-c94d-44a3-8d6e-3be8a9cd0260] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:35:01.756476 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5dad16bd-859e-49a9-a41f-e852804864e0 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:35:01.756972 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5dad16bd-859e-49a9-a41f-e852804864e0 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:35:01.757456 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5dad16bd-859e-49a9-a41f-e852804864e0 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:35:01.758295 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5dad16bd-859e-49a9-a41f-e852804864e0 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:35:01.758809 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5dad16bd-859e-49a9-a41f-e852804864e0 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:35:01.759246 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5dad16bd-859e-49a9-a41f-e852804864e0 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:35:01.982028 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5dad16bd-859e-49a9-a41f-e852804864e0 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "POST /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260/action" status: 202 len: 0 microversion: 2.1 time: 0.286825 Oct 30 02:35:01.982661 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4047/7761] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 02:35:01 2022] POST /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 02:35:01.991160 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-101d56e2-0119-416c-af8d-f244bde3d883 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:35:01.992094 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-101d56e2-0119-416c-af8d-f244bde3d883 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: cb10e972-c94d-44a3-8d6e-3be8a9cd0260] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:35:01.994944 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=6 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:35:01.995657 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=16 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:35:02.000331 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-101d56e2-0119-416c-af8d-f244bde3d883 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:35:02.001523 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-101d56e2-0119-416c-af8d-f244bde3d883 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:35:02.006532 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-101d56e2-0119-416c-af8d-f244bde3d883 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:35:02.006532 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-101d56e2-0119-416c-af8d-f244bde3d883 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:35:02.006532 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-101d56e2-0119-416c-af8d-f244bde3d883 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:35:02.006532 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-101d56e2-0119-416c-af8d-f244bde3d883 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:35:02.162959 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-101d56e2-0119-416c-af8d-f244bde3d883 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:35:02.171433 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-101d56e2-0119-416c-af8d-f244bde3d883 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260" status: 200 len: 1752 microversion: 2.1 time: 0.184092 Oct 30 02:35:02.172028 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3715/7762] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:35:01 2022] GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260 => generated 1752 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:35:03.197471 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6e80b34b-2a0b-42b4-9787-1ebe7c1e5c0f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:35:03.198190 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6e80b34b-2a0b-42b4-9787-1ebe7c1e5c0f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: cb10e972-c94d-44a3-8d6e-3be8a9cd0260] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:35:03.204878 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e80b34b-2a0b-42b4-9787-1ebe7c1e5c0f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:35:03.205392 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e80b34b-2a0b-42b4-9787-1ebe7c1e5c0f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:35:03.205843 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e80b34b-2a0b-42b4-9787-1ebe7c1e5c0f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:35:03.206547 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e80b34b-2a0b-42b4-9787-1ebe7c1e5c0f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:35:03.207015 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e80b34b-2a0b-42b4-9787-1ebe7c1e5c0f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:35:03.207450 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e80b34b-2a0b-42b4-9787-1ebe7c1e5c0f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:35:03.352608 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6e80b34b-2a0b-42b4-9787-1ebe7c1e5c0f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:35:03.361303 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6e80b34b-2a0b-42b4-9787-1ebe7c1e5c0f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260" status: 200 len: 1757 microversion: 2.1 time: 0.168979 Oct 30 02:35:03.361901 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4048/7763] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:35:03 2022] GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:35:04.390779 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f38a91eb-1189-4d18-9811-1e20023252d3 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:35:04.391391 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f38a91eb-1189-4d18-9811-1e20023252d3 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: cb10e972-c94d-44a3-8d6e-3be8a9cd0260] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:35:04.397905 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f38a91eb-1189-4d18-9811-1e20023252d3 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:35:04.398390 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f38a91eb-1189-4d18-9811-1e20023252d3 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:35:04.398825 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f38a91eb-1189-4d18-9811-1e20023252d3 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:35:04.399543 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f38a91eb-1189-4d18-9811-1e20023252d3 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:35:04.400002 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f38a91eb-1189-4d18-9811-1e20023252d3 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:35:04.400431 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f38a91eb-1189-4d18-9811-1e20023252d3 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:35:04.543916 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f38a91eb-1189-4d18-9811-1e20023252d3 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:35:04.553103 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f38a91eb-1189-4d18-9811-1e20023252d3 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260" status: 200 len: 1757 microversion: 2.1 time: 0.166407 Oct 30 02:35:04.553717 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3716/7764] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:35:04 2022] GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:35:05.575701 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7971d339-0d78-4ee7-9b74-109be7b7b54f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:35:05.576332 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7971d339-0d78-4ee7-9b74-109be7b7b54f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: cb10e972-c94d-44a3-8d6e-3be8a9cd0260] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:35:05.583233 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7971d339-0d78-4ee7-9b74-109be7b7b54f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:35:05.583730 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7971d339-0d78-4ee7-9b74-109be7b7b54f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:35:05.584180 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7971d339-0d78-4ee7-9b74-109be7b7b54f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:35:05.584882 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7971d339-0d78-4ee7-9b74-109be7b7b54f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:35:05.585357 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7971d339-0d78-4ee7-9b74-109be7b7b54f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:35:05.585811 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7971d339-0d78-4ee7-9b74-109be7b7b54f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:35:05.728739 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7971d339-0d78-4ee7-9b74-109be7b7b54f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:35:05.737592 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7971d339-0d78-4ee7-9b74-109be7b7b54f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260" status: 200 len: 1757 microversion: 2.1 time: 0.165784 Oct 30 02:35:05.748559 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4049/7765] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:35:05 2022] GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:35:06.761566 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e9ee34f9-9ee1-4242-be24-cad0bedafe77 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:35:06.762132 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e9ee34f9-9ee1-4242-be24-cad0bedafe77 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: cb10e972-c94d-44a3-8d6e-3be8a9cd0260] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:35:06.769559 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e9ee34f9-9ee1-4242-be24-cad0bedafe77 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:35:06.770045 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e9ee34f9-9ee1-4242-be24-cad0bedafe77 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:35:06.770482 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e9ee34f9-9ee1-4242-be24-cad0bedafe77 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:35:06.771178 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e9ee34f9-9ee1-4242-be24-cad0bedafe77 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:35:06.771632 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e9ee34f9-9ee1-4242-be24-cad0bedafe77 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:35:06.772061 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e9ee34f9-9ee1-4242-be24-cad0bedafe77 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:35:06.916335 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e9ee34f9-9ee1-4242-be24-cad0bedafe77 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:35:06.925507 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e9ee34f9-9ee1-4242-be24-cad0bedafe77 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260" status: 200 len: 1757 microversion: 2.1 time: 0.167947 Oct 30 02:35:06.926078 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3717/7766] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:35:06 2022] GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:35:07.947962 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7af9c145-b232-47fb-a338-c893eaf62927 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:35:07.948595 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7af9c145-b232-47fb-a338-c893eaf62927 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: cb10e972-c94d-44a3-8d6e-3be8a9cd0260] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:35:07.956123 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7af9c145-b232-47fb-a338-c893eaf62927 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:35:07.956616 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7af9c145-b232-47fb-a338-c893eaf62927 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:35:07.957061 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7af9c145-b232-47fb-a338-c893eaf62927 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:35:07.957784 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7af9c145-b232-47fb-a338-c893eaf62927 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:35:07.958248 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7af9c145-b232-47fb-a338-c893eaf62927 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:35:07.958692 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7af9c145-b232-47fb-a338-c893eaf62927 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:35:08.098749 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7af9c145-b232-47fb-a338-c893eaf62927 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:35:08.106945 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7af9c145-b232-47fb-a338-c893eaf62927 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260" status: 200 len: 1757 microversion: 2.1 time: 0.162877 Oct 30 02:35:08.107514 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4050/7767] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:35:07 2022] GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:35:09.130609 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-37e6d0d5-5a3c-46bf-832b-763e6a78d171 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:35:09.131252 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-37e6d0d5-5a3c-46bf-832b-763e6a78d171 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: cb10e972-c94d-44a3-8d6e-3be8a9cd0260] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:35:09.138050 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-37e6d0d5-5a3c-46bf-832b-763e6a78d171 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:35:09.138536 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-37e6d0d5-5a3c-46bf-832b-763e6a78d171 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:35:09.138969 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-37e6d0d5-5a3c-46bf-832b-763e6a78d171 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:35:09.139672 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-37e6d0d5-5a3c-46bf-832b-763e6a78d171 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:35:09.140117 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-37e6d0d5-5a3c-46bf-832b-763e6a78d171 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:35:09.140545 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-37e6d0d5-5a3c-46bf-832b-763e6a78d171 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:35:09.281177 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-37e6d0d5-5a3c-46bf-832b-763e6a78d171 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:35:09.289440 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-37e6d0d5-5a3c-46bf-832b-763e6a78d171 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260" status: 200 len: 1757 microversion: 2.1 time: 0.162756 Oct 30 02:35:09.290018 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3718/7768] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:35:09 2022] GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:35:10.312149 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7d24d85d-eae4-40df-965e-c65ce9e684f1 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:35:10.312812 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7d24d85d-eae4-40df-965e-c65ce9e684f1 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: cb10e972-c94d-44a3-8d6e-3be8a9cd0260] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:35:10.320306 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7d24d85d-eae4-40df-965e-c65ce9e684f1 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:35:10.320812 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7d24d85d-eae4-40df-965e-c65ce9e684f1 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:35:10.321271 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7d24d85d-eae4-40df-965e-c65ce9e684f1 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:35:10.322009 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7d24d85d-eae4-40df-965e-c65ce9e684f1 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:35:10.322482 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7d24d85d-eae4-40df-965e-c65ce9e684f1 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:35:10.322929 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7d24d85d-eae4-40df-965e-c65ce9e684f1 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:35:10.465451 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7d24d85d-eae4-40df-965e-c65ce9e684f1 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:35:10.473780 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7d24d85d-eae4-40df-965e-c65ce9e684f1 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260" status: 200 len: 1757 microversion: 2.1 time: 0.165653 Oct 30 02:35:10.474354 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4051/7769] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:35:10 2022] GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:35:11.497148 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2eebb261-affd-4a37-a0e4-41dc81bd65ee tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:35:11.497764 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2eebb261-affd-4a37-a0e4-41dc81bd65ee tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: cb10e972-c94d-44a3-8d6e-3be8a9cd0260] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:35:11.504558 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2eebb261-affd-4a37-a0e4-41dc81bd65ee tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:35:11.505040 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2eebb261-affd-4a37-a0e4-41dc81bd65ee tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:35:11.505503 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2eebb261-affd-4a37-a0e4-41dc81bd65ee tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:35:11.506186 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2eebb261-affd-4a37-a0e4-41dc81bd65ee tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:35:11.506633 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2eebb261-affd-4a37-a0e4-41dc81bd65ee tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:35:11.507049 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2eebb261-affd-4a37-a0e4-41dc81bd65ee tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:35:11.647872 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2eebb261-affd-4a37-a0e4-41dc81bd65ee tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:35:11.656102 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2eebb261-affd-4a37-a0e4-41dc81bd65ee tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260" status: 200 len: 1757 microversion: 2.1 time: 0.162825 Oct 30 02:35:11.656675 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3719/7770] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:35:11 2022] GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:35:12.680608 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f8855891-49ed-48df-bf77-11aee8108269 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:35:12.681238 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f8855891-49ed-48df-bf77-11aee8108269 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: cb10e972-c94d-44a3-8d6e-3be8a9cd0260] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:35:12.687966 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f8855891-49ed-48df-bf77-11aee8108269 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:35:12.688463 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f8855891-49ed-48df-bf77-11aee8108269 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:35:12.688916 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f8855891-49ed-48df-bf77-11aee8108269 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:35:12.689704 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f8855891-49ed-48df-bf77-11aee8108269 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:35:12.690177 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f8855891-49ed-48df-bf77-11aee8108269 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:35:12.690614 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f8855891-49ed-48df-bf77-11aee8108269 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:35:12.832813 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f8855891-49ed-48df-bf77-11aee8108269 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:35:12.841137 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f8855891-49ed-48df-bf77-11aee8108269 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260" status: 200 len: 1757 microversion: 2.1 time: 0.164654 Oct 30 02:35:12.841749 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4052/7771] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:35:12 2022] GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:35:13.865228 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1b32056c-c92e-45a9-a86a-2796e03bea73 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:35:13.865806 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1b32056c-c92e-45a9-a86a-2796e03bea73 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: cb10e972-c94d-44a3-8d6e-3be8a9cd0260] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:35:13.872716 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1b32056c-c92e-45a9-a86a-2796e03bea73 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:35:13.873201 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1b32056c-c92e-45a9-a86a-2796e03bea73 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:35:13.873675 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1b32056c-c92e-45a9-a86a-2796e03bea73 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:35:13.874367 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1b32056c-c92e-45a9-a86a-2796e03bea73 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:35:13.874822 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1b32056c-c92e-45a9-a86a-2796e03bea73 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:35:13.875251 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1b32056c-c92e-45a9-a86a-2796e03bea73 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:35:14.020386 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1b32056c-c92e-45a9-a86a-2796e03bea73 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:35:14.028774 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1b32056c-c92e-45a9-a86a-2796e03bea73 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260" status: 200 len: 1757 microversion: 2.1 time: 0.167844 Oct 30 02:35:14.029375 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3720/7772] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:35:13 2022] GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:35:15.053479 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-44b83967-031d-49c2-b42d-d990d37da04c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:35:15.054108 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-44b83967-031d-49c2-b42d-d990d37da04c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: cb10e972-c94d-44a3-8d6e-3be8a9cd0260] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:35:15.060946 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44b83967-031d-49c2-b42d-d990d37da04c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:35:15.061477 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44b83967-031d-49c2-b42d-d990d37da04c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:35:15.061926 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44b83967-031d-49c2-b42d-d990d37da04c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:35:15.062623 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44b83967-031d-49c2-b42d-d990d37da04c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:35:15.063085 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44b83967-031d-49c2-b42d-d990d37da04c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:35:15.063521 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44b83967-031d-49c2-b42d-d990d37da04c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:35:15.206788 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-44b83967-031d-49c2-b42d-d990d37da04c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:35:15.215202 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-44b83967-031d-49c2-b42d-d990d37da04c tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260" status: 200 len: 1757 microversion: 2.1 time: 0.166405 Oct 30 02:35:15.215774 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4053/7773] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:35:15 2022] GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:35:16.239379 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ab1738e4-a1f6-4f85-a8df-4f0dc5f0cc4e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:35:16.239996 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ab1738e4-a1f6-4f85-a8df-4f0dc5f0cc4e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: cb10e972-c94d-44a3-8d6e-3be8a9cd0260] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:35:16.246814 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ab1738e4-a1f6-4f85-a8df-4f0dc5f0cc4e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:35:16.247298 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ab1738e4-a1f6-4f85-a8df-4f0dc5f0cc4e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:35:16.247732 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ab1738e4-a1f6-4f85-a8df-4f0dc5f0cc4e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:35:16.248421 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ab1738e4-a1f6-4f85-a8df-4f0dc5f0cc4e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:35:16.248873 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ab1738e4-a1f6-4f85-a8df-4f0dc5f0cc4e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:35:16.249302 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ab1738e4-a1f6-4f85-a8df-4f0dc5f0cc4e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:35:16.391252 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ab1738e4-a1f6-4f85-a8df-4f0dc5f0cc4e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:35:16.399563 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ab1738e4-a1f6-4f85-a8df-4f0dc5f0cc4e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260" status: 200 len: 1757 microversion: 2.1 time: 0.164548 Oct 30 02:35:16.400137 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3721/7774] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:35:16 2022] GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:35:17.423168 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-221d7425-3ca5-42f1-b2bf-78d11aa5fd3e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:35:17.423793 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-221d7425-3ca5-42f1-b2bf-78d11aa5fd3e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: cb10e972-c94d-44a3-8d6e-3be8a9cd0260] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:35:17.431413 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-221d7425-3ca5-42f1-b2bf-78d11aa5fd3e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:35:17.431971 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-221d7425-3ca5-42f1-b2bf-78d11aa5fd3e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:35:17.432415 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-221d7425-3ca5-42f1-b2bf-78d11aa5fd3e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:35:17.433116 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-221d7425-3ca5-42f1-b2bf-78d11aa5fd3e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:35:17.433609 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-221d7425-3ca5-42f1-b2bf-78d11aa5fd3e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:35:17.434048 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-221d7425-3ca5-42f1-b2bf-78d11aa5fd3e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:35:17.573886 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-221d7425-3ca5-42f1-b2bf-78d11aa5fd3e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:35:17.582254 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-221d7425-3ca5-42f1-b2bf-78d11aa5fd3e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260" status: 200 len: 1757 microversion: 2.1 time: 0.163421 Oct 30 02:35:17.582833 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4054/7775] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:35:17 2022] GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:35:18.605276 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7c622d50-00ab-422c-8222-e8dedb6f507e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:35:18.605931 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7c622d50-00ab-422c-8222-e8dedb6f507e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: cb10e972-c94d-44a3-8d6e-3be8a9cd0260] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:35:18.612677 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7c622d50-00ab-422c-8222-e8dedb6f507e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:35:18.613159 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7c622d50-00ab-422c-8222-e8dedb6f507e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:35:18.613619 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7c622d50-00ab-422c-8222-e8dedb6f507e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:35:18.614316 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7c622d50-00ab-422c-8222-e8dedb6f507e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:35:18.614768 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7c622d50-00ab-422c-8222-e8dedb6f507e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:35:18.615189 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7c622d50-00ab-422c-8222-e8dedb6f507e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:35:18.763953 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7c622d50-00ab-422c-8222-e8dedb6f507e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:35:18.773049 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7c622d50-00ab-422c-8222-e8dedb6f507e tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260" status: 200 len: 1757 microversion: 2.1 time: 0.171756 Oct 30 02:35:18.776539 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3722/7776] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:35:18 2022] GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:35:19.796097 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-de8b8be7-f9e3-44ee-b57d-5a11fe3fe25d tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:35:19.796751 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-de8b8be7-f9e3-44ee-b57d-5a11fe3fe25d tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: cb10e972-c94d-44a3-8d6e-3be8a9cd0260] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:35:19.804503 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-de8b8be7-f9e3-44ee-b57d-5a11fe3fe25d tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:35:19.805005 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-de8b8be7-f9e3-44ee-b57d-5a11fe3fe25d tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:35:19.805481 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-de8b8be7-f9e3-44ee-b57d-5a11fe3fe25d tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:35:19.806224 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-de8b8be7-f9e3-44ee-b57d-5a11fe3fe25d tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:35:19.806693 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-de8b8be7-f9e3-44ee-b57d-5a11fe3fe25d tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:35:19.807128 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-de8b8be7-f9e3-44ee-b57d-5a11fe3fe25d tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:35:19.955215 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-de8b8be7-f9e3-44ee-b57d-5a11fe3fe25d tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:35:19.963583 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-de8b8be7-f9e3-44ee-b57d-5a11fe3fe25d tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260" status: 200 len: 1760 microversion: 2.1 time: 0.171466 Oct 30 02:35:19.964164 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4055/7777] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:35:19 2022] GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260 => generated 1760 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:35:52.128014 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f689c04a-1c7c-46a2-8de8-d5a3117d9876 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1133929583"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:35:52.128622 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f689c04a-1c7c-46a2-8de8-d5a3117d9876 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: cb10e972-c94d-44a3-8d6e-3be8a9cd0260] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:35:52.130889 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=16 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:35:52.131685 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=48 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:35:52.132529 n-d-master-1 devstack@n-api.service[121103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 30 02:35:52.132674 n-d-master-1 devstack@n-api.service[121103]: Sun Oct 30 02:35:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260/action (ip 10.222.0.13) !!! Oct 30 02:35:52.143707 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f689c04a-1c7c-46a2-8de8-d5a3117d9876 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:35:52.144186 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f689c04a-1c7c-46a2-8de8-d5a3117d9876 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:35:52.144623 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f689c04a-1c7c-46a2-8de8-d5a3117d9876 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:35:52.145308 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f689c04a-1c7c-46a2-8de8-d5a3117d9876 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:35:52.145782 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f689c04a-1c7c-46a2-8de8-d5a3117d9876 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:35:52.146250 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f689c04a-1c7c-46a2-8de8-d5a3117d9876 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:35:52.273527 n-d-master-1 devstack@n-api.service[121103]: INFO nova.network.security_group_api [None req-f689c04a-1c7c-46a2-8de8-d5a3117d9876 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Removing security group eb9e86d7-3574-4b7f-969b-10a6c2c5de19 from port d62d7cc5-6fa4-44ee-99a2-0105677e6b8b Oct 30 02:35:52.627191 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f689c04a-1c7c-46a2-8de8-d5a3117d9876 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "POST /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260/action" status: 202 len: 0 microversion: 2.1 time: 0.503056 Oct 30 02:35:52.628014 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3723/7778] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 02:35:52 2022] POST /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260/action => generated 0 bytes in 504 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 02:35:52.655035 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-6141ae18-922c-4143-a4bd-1ba3e8f41511 req-dcc3bf7d-c25c-46ba-9869-69a565f4d879 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb10e972-c94d-44a3-8d6e-3be8a9cd0260", "tag": "d62d7cc5-6fa4-44ee-99a2-0105677e6b8b"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:35:52.667732 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=22 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:35:52.668477 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:35:52.671139 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-6141ae18-922c-4143-a4bd-1ba3e8f41511 req-dcc3bf7d-c25c-46ba-9869-69a565f4d879 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:35:52.671636 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-6141ae18-922c-4143-a4bd-1ba3e8f41511 req-dcc3bf7d-c25c-46ba-9869-69a565f4d879 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:35:52.672927 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-6141ae18-922c-4143-a4bd-1ba3e8f41511 req-dcc3bf7d-c25c-46ba-9869-69a565f4d879 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:35:52.692647 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-6141ae18-922c-4143-a4bd-1ba3e8f41511 req-dcc3bf7d-c25c-46ba-9869-69a565f4d879 service nova] Creating event network-changed:d62d7cc5-6fa4-44ee-99a2-0105677e6b8b for instance cb10e972-c94d-44a3-8d6e-3be8a9cd0260 on n-h2-master-1 Oct 30 02:35:52.699861 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-6141ae18-922c-4143-a4bd-1ba3e8f41511 req-dcc3bf7d-c25c-46ba-9869-69a565f4d879 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050295 Oct 30 02:35:52.700856 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4056/7779] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:35:54.044775 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-accdb872-6e55-429b-8792-6516a9e73817 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:35:54.045297 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-accdb872-6e55-429b-8792-6516a9e73817 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: cb10e972-c94d-44a3-8d6e-3be8a9cd0260] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:35:54.051781 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-accdb872-6e55-429b-8792-6516a9e73817 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:35:54.052263 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-accdb872-6e55-429b-8792-6516a9e73817 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:35:54.052698 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-accdb872-6e55-429b-8792-6516a9e73817 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:35:54.053411 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-accdb872-6e55-429b-8792-6516a9e73817 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:35:54.053862 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-accdb872-6e55-429b-8792-6516a9e73817 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:35:54.054283 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-accdb872-6e55-429b-8792-6516a9e73817 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:35:54.136069 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-accdb872-6e55-429b-8792-6516a9e73817 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lazy-loading 'services' on Instance uuid cb10e972-c94d-44a3-8d6e-3be8a9cd0260 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 02:35:54.312737 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-accdb872-6e55-429b-8792-6516a9e73817 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "DELETE /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260/os-volume_attachments/407f6a4f-eb17-40c6-9210-27c50342bb43" status: 202 len: 0 microversion: 2.1 time: 0.272522 Oct 30 02:35:54.313363 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3724/7780] 10.222.0.13 () {58 vars in 1416 bytes} [Sun Oct 30 02:35:54 2022] DELETE /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260/os-volume_attachments/407f6a4f-eb17-40c6-9210-27c50342bb43 => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 02:35:54.323384 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b72023ab-81ce-4575-9d7f-d14579d8cc7d tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:35:54.325739 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b72023ab-81ce-4575-9d7f-d14579d8cc7d tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: cb10e972-c94d-44a3-8d6e-3be8a9cd0260] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:35:54.334395 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b72023ab-81ce-4575-9d7f-d14579d8cc7d tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:35:54.334900 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b72023ab-81ce-4575-9d7f-d14579d8cc7d tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:35:54.335348 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b72023ab-81ce-4575-9d7f-d14579d8cc7d tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:35:54.336070 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b72023ab-81ce-4575-9d7f-d14579d8cc7d tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:35:54.336541 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b72023ab-81ce-4575-9d7f-d14579d8cc7d tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:35:54.336972 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b72023ab-81ce-4575-9d7f-d14579d8cc7d tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:35:54.368946 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b72023ab-81ce-4575-9d7f-d14579d8cc7d tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050370 Oct 30 02:35:54.369573 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4057/7781] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 02:35:54 2022] GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:35:54.715066 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-c3b3628b-af41-4159-9796-87fe45b985f6 req-a465e49f-6527-47eb-9ad8-d168ff4828da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb10e972-c94d-44a3-8d6e-3be8a9cd0260", "tag": "d62d7cc5-6fa4-44ee-99a2-0105677e6b8b"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:35:54.724700 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-c3b3628b-af41-4159-9796-87fe45b985f6 req-a465e49f-6527-47eb-9ad8-d168ff4828da service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:35:54.728185 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-c3b3628b-af41-4159-9796-87fe45b985f6 req-a465e49f-6527-47eb-9ad8-d168ff4828da service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:35:54.728185 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-c3b3628b-af41-4159-9796-87fe45b985f6 req-a465e49f-6527-47eb-9ad8-d168ff4828da service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:35:54.736540 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-c3b3628b-af41-4159-9796-87fe45b985f6 req-a465e49f-6527-47eb-9ad8-d168ff4828da service nova] Creating event network-changed:d62d7cc5-6fa4-44ee-99a2-0105677e6b8b for instance cb10e972-c94d-44a3-8d6e-3be8a9cd0260 on n-h2-master-1 Oct 30 02:35:54.741885 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-c3b3628b-af41-4159-9796-87fe45b985f6 req-a465e49f-6527-47eb-9ad8-d168ff4828da service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031015 Oct 30 02:35:54.742484 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3725/7782] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:35:55.381535 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-93c0693f-da51-4bdb-a19e-85480d07f422 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:35:55.383864 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-93c0693f-da51-4bdb-a19e-85480d07f422 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: cb10e972-c94d-44a3-8d6e-3be8a9cd0260] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:35:55.391278 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-93c0693f-da51-4bdb-a19e-85480d07f422 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:35:55.391780 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-93c0693f-da51-4bdb-a19e-85480d07f422 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:35:55.392238 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-93c0693f-da51-4bdb-a19e-85480d07f422 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:35:55.393071 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-93c0693f-da51-4bdb-a19e-85480d07f422 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:35:55.393568 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-93c0693f-da51-4bdb-a19e-85480d07f422 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:35:55.394011 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-93c0693f-da51-4bdb-a19e-85480d07f422 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:35:55.425833 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-93c0693f-da51-4bdb-a19e-85480d07f422 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048653 Oct 30 02:35:55.426529 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4058/7783] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 02:35:55 2022] GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:35:56.439848 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-091d0ab8-5444-45bc-931c-49787bdbf0ea tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:35:56.442159 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-091d0ab8-5444-45bc-931c-49787bdbf0ea tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: cb10e972-c94d-44a3-8d6e-3be8a9cd0260] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:35:56.449472 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-091d0ab8-5444-45bc-931c-49787bdbf0ea tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:35:56.449472 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-091d0ab8-5444-45bc-931c-49787bdbf0ea tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:35:56.449741 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-091d0ab8-5444-45bc-931c-49787bdbf0ea tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:35:56.450225 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-091d0ab8-5444-45bc-931c-49787bdbf0ea tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:35:56.450675 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-091d0ab8-5444-45bc-931c-49787bdbf0ea tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:35:56.451094 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-091d0ab8-5444-45bc-931c-49787bdbf0ea tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:35:56.483501 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-091d0ab8-5444-45bc-931c-49787bdbf0ea tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048703 Oct 30 02:35:56.484095 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3726/7784] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 02:35:56 2022] GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:35:57.497072 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-669681e9-fd87-42cf-a10e-c0a1f1a62cc0 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:35:57.499365 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-669681e9-fd87-42cf-a10e-c0a1f1a62cc0 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: cb10e972-c94d-44a3-8d6e-3be8a9cd0260] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:35:57.507146 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-669681e9-fd87-42cf-a10e-c0a1f1a62cc0 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:35:57.507647 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-669681e9-fd87-42cf-a10e-c0a1f1a62cc0 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:35:57.508099 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-669681e9-fd87-42cf-a10e-c0a1f1a62cc0 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:35:57.508812 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-669681e9-fd87-42cf-a10e-c0a1f1a62cc0 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:35:57.509281 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-669681e9-fd87-42cf-a10e-c0a1f1a62cc0 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:35:57.509748 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-669681e9-fd87-42cf-a10e-c0a1f1a62cc0 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:35:57.539001 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-669681e9-fd87-42cf-a10e-c0a1f1a62cc0 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045936 Oct 30 02:35:57.539477 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4059/7785] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 02:35:57 2022] GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:35:58.551513 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-af2b8398-1df2-4e18-a0ca-fc1c5905db9b tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:35:58.553699 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-af2b8398-1df2-4e18-a0ca-fc1c5905db9b tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: cb10e972-c94d-44a3-8d6e-3be8a9cd0260] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:35:58.560598 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af2b8398-1df2-4e18-a0ca-fc1c5905db9b tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:35:58.561087 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af2b8398-1df2-4e18-a0ca-fc1c5905db9b tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:35:58.561553 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af2b8398-1df2-4e18-a0ca-fc1c5905db9b tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:35:58.562251 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af2b8398-1df2-4e18-a0ca-fc1c5905db9b tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:35:58.562708 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af2b8398-1df2-4e18-a0ca-fc1c5905db9b tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:35:58.563132 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af2b8398-1df2-4e18-a0ca-fc1c5905db9b tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:35:58.592876 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-af2b8398-1df2-4e18-a0ca-fc1c5905db9b tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045325 Oct 30 02:35:58.593464 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3727/7786] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 02:35:58 2022] GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:35:59.605236 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5220c0c0-91e1-4241-a930-def6484130e8 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:35:59.607461 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5220c0c0-91e1-4241-a930-def6484130e8 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: cb10e972-c94d-44a3-8d6e-3be8a9cd0260] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:35:59.614948 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5220c0c0-91e1-4241-a930-def6484130e8 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:35:59.615438 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5220c0c0-91e1-4241-a930-def6484130e8 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:35:59.615884 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5220c0c0-91e1-4241-a930-def6484130e8 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:35:59.616580 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5220c0c0-91e1-4241-a930-def6484130e8 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:35:59.617041 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5220c0c0-91e1-4241-a930-def6484130e8 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:35:59.617472 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5220c0c0-91e1-4241-a930-def6484130e8 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:35:59.645804 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5220c0c0-91e1-4241-a930-def6484130e8 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044544 Oct 30 02:35:59.646358 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4060/7787] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 02:35:59 2022] GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 02:35:59.656716 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6a9bcf0d-3413-456d-aa2e-5280595d2224 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:35:59.657222 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6a9bcf0d-3413-456d-aa2e-5280595d2224 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: cb10e972-c94d-44a3-8d6e-3be8a9cd0260] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:35:59.664405 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a9bcf0d-3413-456d-aa2e-5280595d2224 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:35:59.664885 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a9bcf0d-3413-456d-aa2e-5280595d2224 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:35:59.665314 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a9bcf0d-3413-456d-aa2e-5280595d2224 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:35:59.666024 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a9bcf0d-3413-456d-aa2e-5280595d2224 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:35:59.666471 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a9bcf0d-3413-456d-aa2e-5280595d2224 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:35:59.666888 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a9bcf0d-3413-456d-aa2e-5280595d2224 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:35:59.741896 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-6a9bcf0d-3413-456d-aa2e-5280595d2224 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] HTTP exception thrown: Instance cb10e972-c94d-44a3-8d6e-3be8a9cd0260 is not attached to volume 407f6a4f-eb17-40c6-9210-27c50342bb43 Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6a9bcf0d-3413-456d-aa2e-5280595d2224 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Request method failure captured: Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: request: DELETE /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260/os-volume_attachments/407f6a4f-eb17-40c6-9210-27c50342bb43 HTTP/1.1 Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXeGf755rIBeiTHzX7Cpxk5fM-F7b90QYMQIVJpd36bfEzIdTJ97JsiOO5gvSPckgyDyAAU60jNf_qBsvHoIM00VwkZ7JNmDAHKso4bj0J_BUVbOOjniKwSMzcpI3AMF93OfgBEWmdfX3n1ynuWjSgXoUX6G0uVtlvcJY1kZRtb6zoOs Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 6305db1090aa4559b92d87c1dbca1443 Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-TestMinimumBasicScenario-518047285 Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6305db1090aa4559b92d87c1dbca1443"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6305db1090aa4559b92d87c1dbca1443"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6305db1090aa4559b92d87c1dbca1443"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6305db1090aa4559b92d87c1dbca1443"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-TestMinimumBasicScenario-518047285 Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 6305db1090aa4559b92d87c1dbca1443 Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-TestMinimumBasicScenario-518047285 Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-TestMinimumBasicScenario-518047285-project Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: a75d2920b15d4f8fa293477d6cebba8c Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-TestMinimumBasicScenario-518047285-project Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: exception: Instance cb10e972-c94d-44a3-8d6e-3be8a9cd0260 is not attached to volume 407f6a4f-eb17-40c6-9210-27c50342bb43 Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: action_args: {'server_id': 'cb10e972-c94d-44a3-8d6e-3be8a9cd0260', 'id': '407f6a4f-eb17-40c6-9210-27c50342bb43'} Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 407f6a4f-eb17-40c6-9210-27c50342bb43. Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb10e972-c94d-44a3-8d6e-3be8a9cd0260 is not attached to volume 407f6a4f-eb17-40c6-9210-27c50342bb43 Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:35:59.743576 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:35:59.750901 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:35:59.750901 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:35:59.750901 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb10e972-c94d-44a3-8d6e-3be8a9cd0260 is not attached to volume 407f6a4f-eb17-40c6-9210-27c50342bb43 Oct 30 02:35:59.750901 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:35:59.750901 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6a9bcf0d-3413-456d-aa2e-5280595d2224 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Returning 404 to user: Instance cb10e972-c94d-44a3-8d6e-3be8a9cd0260 is not attached to volume 407f6a4f-eb17-40c6-9210-27c50342bb43 {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:35:59.750901 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6a9bcf0d-3413-456d-aa2e-5280595d2224 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "DELETE /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260/os-volume_attachments/407f6a4f-eb17-40c6-9210-27c50342bb43" status: 404 len: 154 microversion: 2.1 time: 0.092249 Oct 30 02:35:59.750901 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3728/7788] 10.222.0.13 () {58 vars in 1416 bytes} [Sun Oct 30 02:35:59 2022] DELETE /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260/os-volume_attachments/407f6a4f-eb17-40c6-9210-27c50342bb43 => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 02:36:03.126348 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-434ce0b3-dadc-45f6-bb24-f19281d70b9b tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:36:03.126870 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-434ce0b3-dadc-45f6-bb24-f19281d70b9b tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: cb10e972-c94d-44a3-8d6e-3be8a9cd0260] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:36:03.134727 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-434ce0b3-dadc-45f6-bb24-f19281d70b9b tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:36:03.135224 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-434ce0b3-dadc-45f6-bb24-f19281d70b9b tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:36:03.135670 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-434ce0b3-dadc-45f6-bb24-f19281d70b9b tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:36:03.136377 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-434ce0b3-dadc-45f6-bb24-f19281d70b9b tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:36:03.136840 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-434ce0b3-dadc-45f6-bb24-f19281d70b9b tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:36:03.137279 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-434ce0b3-dadc-45f6-bb24-f19281d70b9b tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:36:03.163869 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-434ce0b3-dadc-45f6-bb24-f19281d70b9b tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: cb10e972-c94d-44a3-8d6e-3be8a9cd0260] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 02:36:03.424612 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-434ce0b3-dadc-45f6-bb24-f19281d70b9b tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "DELETE /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260" status: 204 len: 0 microversion: 2.1 time: 0.301756 Oct 30 02:36:03.425135 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4061/7789] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 02:36:03 2022] DELETE /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 02:36:03.434686 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d71ffef0-5f3e-4d90-bcc6-063df76801c2 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:36:03.435318 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d71ffef0-5f3e-4d90-bcc6-063df76801c2 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: cb10e972-c94d-44a3-8d6e-3be8a9cd0260] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:36:03.444247 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d71ffef0-5f3e-4d90-bcc6-063df76801c2 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:36:03.444851 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d71ffef0-5f3e-4d90-bcc6-063df76801c2 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:36:03.445301 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d71ffef0-5f3e-4d90-bcc6-063df76801c2 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:36:03.446058 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d71ffef0-5f3e-4d90-bcc6-063df76801c2 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:36:03.446521 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d71ffef0-5f3e-4d90-bcc6-063df76801c2 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:36:03.446979 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d71ffef0-5f3e-4d90-bcc6-063df76801c2 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:36:03.581918 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d71ffef0-5f3e-4d90-bcc6-063df76801c2 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:36:03.590096 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d71ffef0-5f3e-4d90-bcc6-063df76801c2 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260" status: 200 len: 1554 microversion: 2.1 time: 0.159686 Oct 30 02:36:03.590698 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3729/7790] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:36:03 2022] GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260 => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:36:04.613376 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a8bfc74f-536f-46b2-90d8-47408d17b49f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:36:04.614096 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a8bfc74f-536f-46b2-90d8-47408d17b49f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: cb10e972-c94d-44a3-8d6e-3be8a9cd0260] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:36:04.621713 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a8bfc74f-536f-46b2-90d8-47408d17b49f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:36:04.622213 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a8bfc74f-536f-46b2-90d8-47408d17b49f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:36:04.622661 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a8bfc74f-536f-46b2-90d8-47408d17b49f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:36:04.623364 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a8bfc74f-536f-46b2-90d8-47408d17b49f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:36:04.623828 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a8bfc74f-536f-46b2-90d8-47408d17b49f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:36:04.624264 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a8bfc74f-536f-46b2-90d8-47408d17b49f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:36:04.753382 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a8bfc74f-536f-46b2-90d8-47408d17b49f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:36:04.761774 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a8bfc74f-536f-46b2-90d8-47408d17b49f tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260" status: 200 len: 1554 microversion: 2.1 time: 0.152732 Oct 30 02:36:04.762359 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4062/7791] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:36:04 2022] GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:36:05.766456 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-b06d0006-6698-43a3-8ef4-4f3aea5b15a3 req-976e95d1-9bb3-4e27-ae22-4f832c55adb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb10e972-c94d-44a3-8d6e-3be8a9cd0260", "name": "network-vif-deleted", "tag": "d62d7cc5-6fa4-44ee-99a2-0105677e6b8b"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:36:05.777126 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-b06d0006-6698-43a3-8ef4-4f3aea5b15a3 req-976e95d1-9bb3-4e27-ae22-4f832c55adb0 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:36:05.777646 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-b06d0006-6698-43a3-8ef4-4f3aea5b15a3 req-976e95d1-9bb3-4e27-ae22-4f832c55adb0 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:36:05.778074 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-b06d0006-6698-43a3-8ef4-4f3aea5b15a3 req-976e95d1-9bb3-4e27-ae22-4f832c55adb0 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:36:05.790012 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-b06d0006-6698-43a3-8ef4-4f3aea5b15a3 req-976e95d1-9bb3-4e27-ae22-4f832c55adb0 service nova] Creating event network-vif-deleted:d62d7cc5-6fa4-44ee-99a2-0105677e6b8b for instance cb10e972-c94d-44a3-8d6e-3be8a9cd0260 on n-h2-master-1 Oct 30 02:36:05.795262 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-b06d0006-6698-43a3-8ef4-4f3aea5b15a3 req-976e95d1-9bb3-4e27-ae22-4f832c55adb0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032776 Oct 30 02:36:05.795865 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3730/7792] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:36:05.796233 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-994490d3-48a6-4918-9f89-63601f962120 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:36:05.797130 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-994490d3-48a6-4918-9f89-63601f962120 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: cb10e972-c94d-44a3-8d6e-3be8a9cd0260] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:36:05.804730 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-994490d3-48a6-4918-9f89-63601f962120 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:36:05.805237 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-994490d3-48a6-4918-9f89-63601f962120 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:36:05.805745 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-994490d3-48a6-4918-9f89-63601f962120 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:36:05.809465 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-994490d3-48a6-4918-9f89-63601f962120 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:36:05.809465 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-994490d3-48a6-4918-9f89-63601f962120 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:36:05.809465 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-994490d3-48a6-4918-9f89-63601f962120 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:36:05.874280 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-994490d3-48a6-4918-9f89-63601f962120 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75d2920b15d4f8fa293477d6cebba8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6305db1090aa4559b92d87c1dbca1443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:36:05.882398 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-994490d3-48a6-4918-9f89-63601f962120 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260" status: 200 len: 1512 microversion: 2.1 time: 0.090118 Oct 30 02:36:05.882973 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4063/7793] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:36:05 2022] GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260 => generated 1512 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:36:06.907196 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a72b233c-b729-4cc0-bc88-9b6b8b433843 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:36:06.907926 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a72b233c-b729-4cc0-bc88-9b6b8b433843 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] [instance: cb10e972-c94d-44a3-8d6e-3be8a9cd0260] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:36:06.914595 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a72b233c-b729-4cc0-bc88-9b6b8b433843 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:36:06.915075 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a72b233c-b729-4cc0-bc88-9b6b8b433843 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:36:06.915506 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a72b233c-b729-4cc0-bc88-9b6b8b433843 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:36:06.916186 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a72b233c-b729-4cc0-bc88-9b6b8b433843 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:36:06.916638 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a72b233c-b729-4cc0-bc88-9b6b8b433843 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:36:06.917054 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a72b233c-b729-4cc0-bc88-9b6b8b433843 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:36:06.930901 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-a72b233c-b729-4cc0-bc88-9b6b8b433843 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] HTTP exception thrown: Instance cb10e972-c94d-44a3-8d6e-3be8a9cd0260 could not be found. Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a72b233c-b729-4cc0-bc88-9b6b8b433843 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Request method failure captured: Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260 HTTP/1.1 Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXeGf755rIBeiTHzX7Cpxk5fM-F7b90QYMQIVJpd36bfEzIdTJ97JsiOO5gvSPckgyDyAAU60jNf_qBsvHoIM00VwkZ7JNmDAHKso4bj0J_BUVbOOjniKwSMzcpI3AMF93OfgBEWmdfX3n1ynuWjSgXoUX6G0uVtlvcJY1kZRtb6zoOs Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 6305db1090aa4559b92d87c1dbca1443 Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-TestMinimumBasicScenario-518047285 Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6305db1090aa4559b92d87c1dbca1443"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6305db1090aa4559b92d87c1dbca1443"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6305db1090aa4559b92d87c1dbca1443"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6305db1090aa4559b92d87c1dbca1443"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-TestMinimumBasicScenario-518047285 Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 6305db1090aa4559b92d87c1dbca1443 Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-TestMinimumBasicScenario-518047285 Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-TestMinimumBasicScenario-518047285-project Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: a75d2920b15d4f8fa293477d6cebba8c Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-TestMinimumBasicScenario-518047285-project Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: exception: Instance cb10e972-c94d-44a3-8d6e-3be8a9cd0260 could not be found. Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'cb10e972-c94d-44a3-8d6e-3be8a9cd0260'} Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb10e972-c94d-44a3-8d6e-3be8a9cd0260 could not be found. Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb10e972-c94d-44a3-8d6e-3be8a9cd0260 could not be found. Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:36:06.932509 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:36:06.937838 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:36:06.937838 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:36:06.937838 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:36:06.937838 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:36:06.937838 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:36:06.937838 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb10e972-c94d-44a3-8d6e-3be8a9cd0260 could not be found. Oct 30 02:36:06.937838 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:36:06.937838 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a72b233c-b729-4cc0-bc88-9b6b8b433843 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Returning 404 to user: Instance cb10e972-c94d-44a3-8d6e-3be8a9cd0260 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:36:06.937838 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a72b233c-b729-4cc0-bc88-9b6b8b433843 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260" status: 404 len: 111 microversion: 2.1 time: 0.031814 Oct 30 02:36:06.937838 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3731/7794] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:36:06 2022] GET /compute/v2.1/servers/cb10e972-c94d-44a3-8d6e-3be8a9cd0260 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 02:36:06.942775 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6aa8f317-ff6d-49d2-96e1-dfb9bc1cdf69 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] Calling method '.version_select at 0x7f44d039a280>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:36:06.996249 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6aa8f317-ff6d-49d2-96e1-dfb9bc1cdf69 tempest-TestMinimumBasicScenario-518047285 tempest-TestMinimumBasicScenario-518047285-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1740950001" status: 202 len: 0 microversion: 2.1 time: 0.057355 Oct 30 02:36:06.996835 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4064/7795] 10.222.0.13 () {58 vars in 1272 bytes} [Sun Oct 30 02:36:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1740950001 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 02:36:18.722556 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=18 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:36:18.731313 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:36:18.899951 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-eddb10a5-30bb-429d-b2c2-27bb2d093e76 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Action: 'create', calling method: .version_select at 0x7f44c6cf71f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1276472962", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGcurxgOKT90yN7sOdZDAwbxJSHdVAemsaJiLeqnuwFd5JQk8y0L0Yk7tLxzVGzOpyzFHEiTuxvaAFORhNNXfuQF2465hbT+HoP8ewq35aCt06d+Gu5Gf7ufHjIfMDMCsA=="}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:36:18.915712 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-eddb10a5-30bb-429d-b2c2-27bb2d093e76 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Getting quotas for project 4a813c90e3ec437fbf1f37dbb2b340d4. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 02:36:18.920869 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-eddb10a5-30bb-429d-b2c2-27bb2d093e76 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Getting quotas for user ef194f895a0c404abc08cad62a3b566d and project 4a813c90e3ec437fbf1f37dbb2b340d4. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 02:36:19.019209 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-eddb10a5-30bb-429d-b2c2-27bb2d093e76 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.301867 Oct 30 02:36:19.019818 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3732/7796] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 30 02:36:18 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:36:27.702440 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:36:27.703740 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:36:27.707887 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b71f1a6a-f051-456b-bbe0-9b77e2179dcf tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-694835002", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "189d6849-41ae-4764-bcdf-a5c46bdf9f4c"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1276472962", "security_groups": [{"name": "tempest-secgroup-smoke-1496227725"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:36:27.825173 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-b71f1a6a-f051-456b-bbe0-9b77e2179dcf tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] validate_networks() for [('189d6849-41ae-4764-bcdf-a5c46bdf9f4c', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 02:36:28.221491 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-b71f1a6a-f051-456b-bbe0-9b77e2179dcf tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 02:36:28.221936 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-b71f1a6a-f051-456b-bbe0-9b77e2179dcf tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 02:36:28.222448 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-b71f1a6a-f051-456b-bbe0-9b77e2179dcf tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 02:36:28.222873 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-b71f1a6a-f051-456b-bbe0-9b77e2179dcf tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 02:36:28.223293 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-b71f1a6a-f051-456b-bbe0-9b77e2179dcf tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 02:36:28.233374 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b71f1a6a-f051-456b-bbe0-9b77e2179dcf tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:36:28.233881 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b71f1a6a-f051-456b-bbe0-9b77e2179dcf tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:36:28.234330 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b71f1a6a-f051-456b-bbe0-9b77e2179dcf tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:36:28.235067 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b71f1a6a-f051-456b-bbe0-9b77e2179dcf tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:36:28.235530 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b71f1a6a-f051-456b-bbe0-9b77e2179dcf tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:36:28.235967 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b71f1a6a-f051-456b-bbe0-9b77e2179dcf tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:36:28.255072 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-b71f1a6a-f051-456b-bbe0-9b77e2179dcf tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Getting quotas for project 4a813c90e3ec437fbf1f37dbb2b340d4. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 02:36:28.260911 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-b71f1a6a-f051-456b-bbe0-9b77e2179dcf tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Getting quotas for user ef194f895a0c404abc08cad62a3b566d and project 4a813c90e3ec437fbf1f37dbb2b340d4. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 02:36:28.274470 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b71f1a6a-f051-456b-bbe0-9b77e2179dcf tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 02:36:28.276856 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b71f1a6a-f051-456b-bbe0-9b77e2179dcf tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bb976652-3408-410e-8a0b-b8fe37e7c41f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 02:36:28.398951 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b71f1a6a-f051-456b-bbe0-9b77e2179dcf tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.698262 Oct 30 02:36:28.399854 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4065/7797] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 02:36:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 02:36:28.412109 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9f780e18-f07a-4708-994e-6bc7e8fb7593 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:36:28.412721 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9f780e18-f07a-4708-994e-6bc7e8fb7593 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bb976652-3408-410e-8a0b-b8fe37e7c41f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:36:28.502245 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9f780e18-f07a-4708-994e-6bc7e8fb7593 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:36:28.511729 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9f780e18-f07a-4708-994e-6bc7e8fb7593 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/bb976652-3408-410e-8a0b-b8fe37e7c41f" status: 200 len: 1266 microversion: 2.1 time: 0.104325 Oct 30 02:36:28.522987 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3733/7798] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:36:28 2022] GET /compute/v2.1/servers/bb976652-3408-410e-8a0b-b8fe37e7c41f => generated 1266 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:36:29.536383 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-27e2be69-2669-4680-ba41-d52be8462888 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:36:29.537029 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-27e2be69-2669-4680-ba41-d52be8462888 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bb976652-3408-410e-8a0b-b8fe37e7c41f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:36:29.593860 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-27e2be69-2669-4680-ba41-d52be8462888 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:36:29.603941 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-27e2be69-2669-4680-ba41-d52be8462888 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/bb976652-3408-410e-8a0b-b8fe37e7c41f" status: 200 len: 1266 microversion: 2.1 time: 0.072364 Oct 30 02:36:29.604896 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4066/7799] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:36:29 2022] GET /compute/v2.1/servers/bb976652-3408-410e-8a0b-b8fe37e7c41f => generated 1266 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:36:30.628100 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4e63a61e-6cdb-4fd8-bb3a-4e09486d033d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:36:30.628696 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4e63a61e-6cdb-4fd8-bb3a-4e09486d033d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bb976652-3408-410e-8a0b-b8fe37e7c41f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:36:30.636532 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4e63a61e-6cdb-4fd8-bb3a-4e09486d033d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:36:30.636996 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4e63a61e-6cdb-4fd8-bb3a-4e09486d033d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:36:30.637456 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4e63a61e-6cdb-4fd8-bb3a-4e09486d033d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:36:30.638158 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4e63a61e-6cdb-4fd8-bb3a-4e09486d033d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:36:30.638610 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4e63a61e-6cdb-4fd8-bb3a-4e09486d033d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:36:30.639031 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4e63a61e-6cdb-4fd8-bb3a-4e09486d033d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:36:30.703087 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4e63a61e-6cdb-4fd8-bb3a-4e09486d033d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:36:30.711277 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4e63a61e-6cdb-4fd8-bb3a-4e09486d033d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/bb976652-3408-410e-8a0b-b8fe37e7c41f" status: 200 len: 1318 microversion: 2.1 time: 0.087008 Oct 30 02:36:30.711862 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3734/7800] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:36:30 2022] GET /compute/v2.1/servers/bb976652-3408-410e-8a0b-b8fe37e7c41f => generated 1318 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:36:31.742443 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b86983d4-9638-4694-bee1-75eab14e10b4 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:36:31.743089 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b86983d4-9638-4694-bee1-75eab14e10b4 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bb976652-3408-410e-8a0b-b8fe37e7c41f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:36:31.768912 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b86983d4-9638-4694-bee1-75eab14e10b4 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:36:31.769457 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b86983d4-9638-4694-bee1-75eab14e10b4 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:36:31.769942 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b86983d4-9638-4694-bee1-75eab14e10b4 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:36:31.770669 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b86983d4-9638-4694-bee1-75eab14e10b4 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:36:31.771140 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b86983d4-9638-4694-bee1-75eab14e10b4 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:36:31.771593 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b86983d4-9638-4694-bee1-75eab14e10b4 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:36:31.981565 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b86983d4-9638-4694-bee1-75eab14e10b4 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:36:31.992727 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b86983d4-9638-4694-bee1-75eab14e10b4 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/bb976652-3408-410e-8a0b-b8fe37e7c41f" status: 200 len: 1392 microversion: 2.1 time: 0.253877 Oct 30 02:36:31.993349 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4067/7801] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:36:31 2022] GET /compute/v2.1/servers/bb976652-3408-410e-8a0b-b8fe37e7c41f => generated 1392 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:36:32.938336 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-0e53f567-8c84-4c1a-9486-b8c70207a71c req-242e939e-4a6c-4905-8be5-a4464d6d5829 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb976652-3408-410e-8a0b-b8fe37e7c41f", "tag": "380ef5a8-0814-48a5-8b26-d815ad0506c2"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:36:32.947657 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-0e53f567-8c84-4c1a-9486-b8c70207a71c req-242e939e-4a6c-4905-8be5-a4464d6d5829 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:36:32.948140 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-0e53f567-8c84-4c1a-9486-b8c70207a71c req-242e939e-4a6c-4905-8be5-a4464d6d5829 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:36:32.948575 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-0e53f567-8c84-4c1a-9486-b8c70207a71c req-242e939e-4a6c-4905-8be5-a4464d6d5829 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:36:32.960505 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-0e53f567-8c84-4c1a-9486-b8c70207a71c req-242e939e-4a6c-4905-8be5-a4464d6d5829 service nova] Creating event network-changed:380ef5a8-0814-48a5-8b26-d815ad0506c2 for instance bb976652-3408-410e-8a0b-b8fe37e7c41f on n-h1-master-1 Oct 30 02:36:32.965467 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-0e53f567-8c84-4c1a-9486-b8c70207a71c req-242e939e-4a6c-4905-8be5-a4464d6d5829 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094736 Oct 30 02:36:32.966070 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3735/7802] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:36:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:36:33.016527 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6526a201-84ab-4aa4-90e7-706217f6d8d9 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:36:33.017280 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6526a201-84ab-4aa4-90e7-706217f6d8d9 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bb976652-3408-410e-8a0b-b8fe37e7c41f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:36:33.025099 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6526a201-84ab-4aa4-90e7-706217f6d8d9 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:36:33.025645 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6526a201-84ab-4aa4-90e7-706217f6d8d9 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:36:33.026311 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6526a201-84ab-4aa4-90e7-706217f6d8d9 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:36:33.026983 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6526a201-84ab-4aa4-90e7-706217f6d8d9 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:36:33.027519 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6526a201-84ab-4aa4-90e7-706217f6d8d9 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:36:33.028103 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6526a201-84ab-4aa4-90e7-706217f6d8d9 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:36:33.251885 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6526a201-84ab-4aa4-90e7-706217f6d8d9 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:36:33.260178 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6526a201-84ab-4aa4-90e7-706217f6d8d9 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/bb976652-3408-410e-8a0b-b8fe37e7c41f" status: 200 len: 1392 microversion: 2.1 time: 0.247642 Oct 30 02:36:33.260760 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4068/7803] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:36:33 2022] GET /compute/v2.1/servers/bb976652-3408-410e-8a0b-b8fe37e7c41f => generated 1392 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:36:34.285047 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2568d6be-89bd-45f3-babe-52cbb5118e71 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:36:34.285772 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2568d6be-89bd-45f3-babe-52cbb5118e71 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bb976652-3408-410e-8a0b-b8fe37e7c41f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:36:34.292649 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2568d6be-89bd-45f3-babe-52cbb5118e71 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:36:34.293127 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2568d6be-89bd-45f3-babe-52cbb5118e71 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:36:34.293593 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2568d6be-89bd-45f3-babe-52cbb5118e71 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:36:34.294276 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2568d6be-89bd-45f3-babe-52cbb5118e71 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:36:34.294728 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2568d6be-89bd-45f3-babe-52cbb5118e71 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:36:34.295149 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2568d6be-89bd-45f3-babe-52cbb5118e71 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:36:34.441213 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2568d6be-89bd-45f3-babe-52cbb5118e71 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:36:34.445572 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2568d6be-89bd-45f3-babe-52cbb5118e71 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/bb976652-3408-410e-8a0b-b8fe37e7c41f" status: 200 len: 1392 microversion: 2.1 time: 0.165573 Oct 30 02:36:34.446195 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3736/7804] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:36:34 2022] GET /compute/v2.1/servers/bb976652-3408-410e-8a0b-b8fe37e7c41f => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:36:35.468946 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c6d4c644-ac9b-4c29-8ccc-b484b705051a tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:36:35.469618 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c6d4c644-ac9b-4c29-8ccc-b484b705051a tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bb976652-3408-410e-8a0b-b8fe37e7c41f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:36:35.477364 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c6d4c644-ac9b-4c29-8ccc-b484b705051a tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:36:35.477983 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c6d4c644-ac9b-4c29-8ccc-b484b705051a tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:36:35.478437 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c6d4c644-ac9b-4c29-8ccc-b484b705051a tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:36:35.479151 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c6d4c644-ac9b-4c29-8ccc-b484b705051a tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:36:35.479613 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c6d4c644-ac9b-4c29-8ccc-b484b705051a tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:36:35.480056 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c6d4c644-ac9b-4c29-8ccc-b484b705051a tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:36:35.611151 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c6d4c644-ac9b-4c29-8ccc-b484b705051a tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:36:35.619498 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c6d4c644-ac9b-4c29-8ccc-b484b705051a tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/bb976652-3408-410e-8a0b-b8fe37e7c41f" status: 200 len: 1392 microversion: 2.1 time: 0.154745 Oct 30 02:36:35.620070 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4069/7805] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:36:35 2022] GET /compute/v2.1/servers/bb976652-3408-410e-8a0b-b8fe37e7c41f => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:36:36.641778 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c857a839-73ff-4a96-8403-c14dca604c5b tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:36:36.642435 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c857a839-73ff-4a96-8403-c14dca604c5b tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bb976652-3408-410e-8a0b-b8fe37e7c41f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:36:36.649353 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c857a839-73ff-4a96-8403-c14dca604c5b tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:36:36.649862 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c857a839-73ff-4a96-8403-c14dca604c5b tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:36:36.650302 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c857a839-73ff-4a96-8403-c14dca604c5b tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:36:36.650999 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c857a839-73ff-4a96-8403-c14dca604c5b tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:36:36.651457 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c857a839-73ff-4a96-8403-c14dca604c5b tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:36:36.651886 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c857a839-73ff-4a96-8403-c14dca604c5b tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:36:36.783657 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c857a839-73ff-4a96-8403-c14dca604c5b tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:36:36.792524 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c857a839-73ff-4a96-8403-c14dca604c5b tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/bb976652-3408-410e-8a0b-b8fe37e7c41f" status: 200 len: 1392 microversion: 2.1 time: 0.154658 Oct 30 02:36:36.793113 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3737/7806] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:36:36 2022] GET /compute/v2.1/servers/bb976652-3408-410e-8a0b-b8fe37e7c41f => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:36:37.817454 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ee787bae-4ea2-4008-9ccd-d1822fa333a1 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:36:37.818080 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ee787bae-4ea2-4008-9ccd-d1822fa333a1 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bb976652-3408-410e-8a0b-b8fe37e7c41f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:36:37.825443 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee787bae-4ea2-4008-9ccd-d1822fa333a1 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:36:37.825960 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee787bae-4ea2-4008-9ccd-d1822fa333a1 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:36:37.826393 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee787bae-4ea2-4008-9ccd-d1822fa333a1 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:36:37.827145 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee787bae-4ea2-4008-9ccd-d1822fa333a1 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:36:37.827608 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee787bae-4ea2-4008-9ccd-d1822fa333a1 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:36:37.828044 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee787bae-4ea2-4008-9ccd-d1822fa333a1 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:36:37.964929 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ee787bae-4ea2-4008-9ccd-d1822fa333a1 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:36:37.972706 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ee787bae-4ea2-4008-9ccd-d1822fa333a1 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/bb976652-3408-410e-8a0b-b8fe37e7c41f" status: 200 len: 1392 microversion: 2.1 time: 0.159245 Oct 30 02:36:37.973299 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4070/7807] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:36:37 2022] GET /compute/v2.1/servers/bb976652-3408-410e-8a0b-b8fe37e7c41f => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:36:38.176826 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-a6a37448-369b-45d2-bd2b-e6cb26a7ac1f req-07a21fe6-dc8e-4135-a556-b4bc164023bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb976652-3408-410e-8a0b-b8fe37e7c41f", "name": "network-vif-plugged", "status": "completed", "tag": "380ef5a8-0814-48a5-8b26-d815ad0506c2"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:36:38.187532 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-a6a37448-369b-45d2-bd2b-e6cb26a7ac1f req-07a21fe6-dc8e-4135-a556-b4bc164023bb service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:36:38.188004 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-a6a37448-369b-45d2-bd2b-e6cb26a7ac1f req-07a21fe6-dc8e-4135-a556-b4bc164023bb service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:36:38.188430 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-a6a37448-369b-45d2-bd2b-e6cb26a7ac1f req-07a21fe6-dc8e-4135-a556-b4bc164023bb service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:36:38.199954 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-a6a37448-369b-45d2-bd2b-e6cb26a7ac1f req-07a21fe6-dc8e-4135-a556-b4bc164023bb service nova] Creating event network-vif-plugged:380ef5a8-0814-48a5-8b26-d815ad0506c2 for instance bb976652-3408-410e-8a0b-b8fe37e7c41f on n-h1-master-1 Oct 30 02:36:38.204898 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-a6a37448-369b-45d2-bd2b-e6cb26a7ac1f req-07a21fe6-dc8e-4135-a556-b4bc164023bb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031784 Oct 30 02:36:38.205500 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3738/7808] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:36:38.994539 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-295d5ace-59d1-4a90-ab4a-0b04de537667 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:36:38.995094 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-295d5ace-59d1-4a90-ab4a-0b04de537667 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bb976652-3408-410e-8a0b-b8fe37e7c41f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:36:38.996903 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:36:39.002700 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-295d5ace-59d1-4a90-ab4a-0b04de537667 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:36:39.003131 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-295d5ace-59d1-4a90-ab4a-0b04de537667 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:36:39.003579 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-295d5ace-59d1-4a90-ab4a-0b04de537667 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:36:39.004271 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-295d5ace-59d1-4a90-ab4a-0b04de537667 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:36:39.004743 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-295d5ace-59d1-4a90-ab4a-0b04de537667 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:36:39.005178 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-295d5ace-59d1-4a90-ab4a-0b04de537667 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:36:39.140228 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-295d5ace-59d1-4a90-ab4a-0b04de537667 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:36:39.148567 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-295d5ace-59d1-4a90-ab4a-0b04de537667 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/bb976652-3408-410e-8a0b-b8fe37e7c41f" status: 200 len: 1392 microversion: 2.1 time: 0.157529 Oct 30 02:36:39.149139 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4071/7809] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:36:38 2022] GET /compute/v2.1/servers/bb976652-3408-410e-8a0b-b8fe37e7c41f => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:36:40.172406 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cf957ac3-c894-4998-bcd8-44d646a8ba11 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:36:40.173105 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-cf957ac3-c894-4998-bcd8-44d646a8ba11 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bb976652-3408-410e-8a0b-b8fe37e7c41f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:36:40.175097 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=6 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:36:40.180860 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cf957ac3-c894-4998-bcd8-44d646a8ba11 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:36:40.181417 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cf957ac3-c894-4998-bcd8-44d646a8ba11 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:36:40.188285 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cf957ac3-c894-4998-bcd8-44d646a8ba11 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:36:40.188285 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cf957ac3-c894-4998-bcd8-44d646a8ba11 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:36:40.188285 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cf957ac3-c894-4998-bcd8-44d646a8ba11 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:36:40.188285 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cf957ac3-c894-4998-bcd8-44d646a8ba11 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:36:40.576589 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-cf957ac3-c894-4998-bcd8-44d646a8ba11 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:36:40.584343 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cf957ac3-c894-4998-bcd8-44d646a8ba11 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/bb976652-3408-410e-8a0b-b8fe37e7c41f" status: 200 len: 1564 microversion: 2.1 time: 0.416647 Oct 30 02:36:40.584900 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3739/7810] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:36:40 2022] GET /compute/v2.1/servers/bb976652-3408-410e-8a0b-b8fe37e7c41f => generated 1564 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:36:40.607122 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1e4aab77-31d2-49b8-b811-7d55d85144ee tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:36:40.607753 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1e4aab77-31d2-49b8-b811-7d55d85144ee tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bb976652-3408-410e-8a0b-b8fe37e7c41f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:36:40.609679 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=8 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:36:40.615291 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1e4aab77-31d2-49b8-b811-7d55d85144ee tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:36:40.615877 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1e4aab77-31d2-49b8-b811-7d55d85144ee tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:36:40.628662 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1e4aab77-31d2-49b8-b811-7d55d85144ee tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:36:40.628662 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1e4aab77-31d2-49b8-b811-7d55d85144ee tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:36:40.628662 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1e4aab77-31d2-49b8-b811-7d55d85144ee tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:36:40.628662 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1e4aab77-31d2-49b8-b811-7d55d85144ee tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:36:40.747568 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1e4aab77-31d2-49b8-b811-7d55d85144ee tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:36:40.755165 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1e4aab77-31d2-49b8-b811-7d55d85144ee tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/bb976652-3408-410e-8a0b-b8fe37e7c41f" status: 200 len: 1564 microversion: 2.1 time: 0.152131 Oct 30 02:36:40.755740 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4072/7811] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:36:40 2022] GET /compute/v2.1/servers/bb976652-3408-410e-8a0b-b8fe37e7c41f => generated 1564 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:36:43.387594 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ebd2c46b-25ae-4931-ab0c-68e978695425 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:36:43.388431 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ebd2c46b-25ae-4931-ab0c-68e978695425 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bb976652-3408-410e-8a0b-b8fe37e7c41f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:36:43.390192 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-c84a8785-0e14-4e12-92b4-c182f28ea04f req-383c7f1a-64b6-4748-88b0-1182f69e8f3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb976652-3408-410e-8a0b-b8fe37e7c41f", "tag": "380ef5a8-0814-48a5-8b26-d815ad0506c2"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:36:43.396898 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ebd2c46b-25ae-4931-ab0c-68e978695425 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:36:43.397516 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ebd2c46b-25ae-4931-ab0c-68e978695425 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:36:43.398029 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ebd2c46b-25ae-4931-ab0c-68e978695425 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:36:43.399041 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ebd2c46b-25ae-4931-ab0c-68e978695425 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:36:43.400110 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ebd2c46b-25ae-4931-ab0c-68e978695425 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:36:43.400767 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ebd2c46b-25ae-4931-ab0c-68e978695425 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:36:43.401654 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-c84a8785-0e14-4e12-92b4-c182f28ea04f req-383c7f1a-64b6-4748-88b0-1182f69e8f3e service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:36:43.402167 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-c84a8785-0e14-4e12-92b4-c182f28ea04f req-383c7f1a-64b6-4748-88b0-1182f69e8f3e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:36:43.402624 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-c84a8785-0e14-4e12-92b4-c182f28ea04f req-383c7f1a-64b6-4748-88b0-1182f69e8f3e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:36:43.416422 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-c84a8785-0e14-4e12-92b4-c182f28ea04f req-383c7f1a-64b6-4748-88b0-1182f69e8f3e service nova] Creating event network-changed:380ef5a8-0814-48a5-8b26-d815ad0506c2 for instance bb976652-3408-410e-8a0b-b8fe37e7c41f on n-h1-master-1 Oct 30 02:36:43.422066 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-c84a8785-0e14-4e12-92b4-c182f28ea04f req-383c7f1a-64b6-4748-88b0-1182f69e8f3e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036665 Oct 30 02:36:43.422684 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4073/7812] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:36:43.545594 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ebd2c46b-25ae-4931-ab0c-68e978695425 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:36:43.554243 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ebd2c46b-25ae-4931-ab0c-68e978695425 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/bb976652-3408-410e-8a0b-b8fe37e7c41f" status: 200 len: 1564 microversion: 2.1 time: 0.171133 Oct 30 02:36:43.554810 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3740/7813] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:36:43 2022] GET /compute/v2.1/servers/bb976652-3408-410e-8a0b-b8fe37e7c41f => generated 1564 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:37:04.792149 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:37:04.792853 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=40 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:37:04.797615 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9cfa09f5-09ed-4326-ab06-1396dc55b9d1 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:37:04.799974 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9cfa09f5-09ed-4326-ab06-1396dc55b9d1 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bb976652-3408-410e-8a0b-b8fe37e7c41f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:37:04.806040 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9cfa09f5-09ed-4326-ab06-1396dc55b9d1 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:37:04.816103 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9cfa09f5-09ed-4326-ab06-1396dc55b9d1 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:37:04.816103 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9cfa09f5-09ed-4326-ab06-1396dc55b9d1 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:37:04.816103 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9cfa09f5-09ed-4326-ab06-1396dc55b9d1 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:37:04.816103 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9cfa09f5-09ed-4326-ab06-1396dc55b9d1 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:37:04.816103 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9cfa09f5-09ed-4326-ab06-1396dc55b9d1 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:37:04.878794 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9cfa09f5-09ed-4326-ab06-1396dc55b9d1 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "POST /compute/v2.1/servers/bb976652-3408-410e-8a0b-b8fe37e7c41f/action" status: 200 len: 24560 microversion: 2.1 time: 0.088640 Oct 30 02:37:04.881896 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4074/7814] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 02:37:04 2022] POST /compute/v2.1/servers/bb976652-3408-410e-8a0b-b8fe37e7c41f/action => generated 24560 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 02:37:11.238592 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0e36d401-0699-4ed3-b839-ed41b26f70cd tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:37:11.239309 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0e36d401-0699-4ed3-b839-ed41b26f70cd tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bb976652-3408-410e-8a0b-b8fe37e7c41f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:37:11.241585 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:37:11.242441 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=34 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:37:11.246976 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0e36d401-0699-4ed3-b839-ed41b26f70cd tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:37:11.257188 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0e36d401-0699-4ed3-b839-ed41b26f70cd tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:37:11.257188 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0e36d401-0699-4ed3-b839-ed41b26f70cd tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:37:11.257188 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0e36d401-0699-4ed3-b839-ed41b26f70cd tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:37:11.257188 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0e36d401-0699-4ed3-b839-ed41b26f70cd tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:37:11.257188 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0e36d401-0699-4ed3-b839-ed41b26f70cd tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:37:11.461418 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0e36d401-0699-4ed3-b839-ed41b26f70cd tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "POST /compute/v2.1/servers/bb976652-3408-410e-8a0b-b8fe37e7c41f/action" status: 202 len: 0 microversion: 2.1 time: 0.226518 Oct 30 02:37:11.462074 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3741/7815] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 02:37:11 2022] POST /compute/v2.1/servers/bb976652-3408-410e-8a0b-b8fe37e7c41f/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 02:37:11.471575 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0de9d3ca-2eb1-4875-aea1-c3360a90f707 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:37:11.475441 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0de9d3ca-2eb1-4875-aea1-c3360a90f707 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bb976652-3408-410e-8a0b-b8fe37e7c41f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:37:11.480078 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0de9d3ca-2eb1-4875-aea1-c3360a90f707 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:37:11.481143 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0de9d3ca-2eb1-4875-aea1-c3360a90f707 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:37:11.481616 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0de9d3ca-2eb1-4875-aea1-c3360a90f707 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:37:11.482450 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0de9d3ca-2eb1-4875-aea1-c3360a90f707 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:37:11.482919 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0de9d3ca-2eb1-4875-aea1-c3360a90f707 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:37:11.483360 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0de9d3ca-2eb1-4875-aea1-c3360a90f707 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:37:11.622644 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0de9d3ca-2eb1-4875-aea1-c3360a90f707 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:37:11.630523 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0de9d3ca-2eb1-4875-aea1-c3360a90f707 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/bb976652-3408-410e-8a0b-b8fe37e7c41f" status: 200 len: 1688 microversion: 2.1 time: 0.163273 Oct 30 02:37:11.631091 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4075/7816] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:37:11 2022] GET /compute/v2.1/servers/bb976652-3408-410e-8a0b-b8fe37e7c41f => generated 1688 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:37:12.656366 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c2c0697d-63b9-476e-a2c4-758842ee4b9c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:37:12.657063 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c2c0697d-63b9-476e-a2c4-758842ee4b9c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bb976652-3408-410e-8a0b-b8fe37e7c41f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:37:12.664784 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c2c0697d-63b9-476e-a2c4-758842ee4b9c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:37:12.665280 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c2c0697d-63b9-476e-a2c4-758842ee4b9c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:37:12.665742 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c2c0697d-63b9-476e-a2c4-758842ee4b9c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:37:12.666433 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c2c0697d-63b9-476e-a2c4-758842ee4b9c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:37:12.666931 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c2c0697d-63b9-476e-a2c4-758842ee4b9c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:37:12.667351 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c2c0697d-63b9-476e-a2c4-758842ee4b9c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:37:12.800899 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c2c0697d-63b9-476e-a2c4-758842ee4b9c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:37:12.809211 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c2c0697d-63b9-476e-a2c4-758842ee4b9c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/bb976652-3408-410e-8a0b-b8fe37e7c41f" status: 200 len: 1668 microversion: 2.1 time: 0.157826 Oct 30 02:37:12.809855 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3742/7817] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:37:12 2022] GET /compute/v2.1/servers/bb976652-3408-410e-8a0b-b8fe37e7c41f => generated 1668 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:37:13.903391 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a0fcb660-a691-4420-a1b0-b3514d36437d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:37:13.905639 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a0fcb660-a691-4420-a1b0-b3514d36437d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bb976652-3408-410e-8a0b-b8fe37e7c41f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:37:13.914118 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a0fcb660-a691-4420-a1b0-b3514d36437d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:37:13.914615 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a0fcb660-a691-4420-a1b0-b3514d36437d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:37:13.915062 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a0fcb660-a691-4420-a1b0-b3514d36437d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:37:13.915763 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a0fcb660-a691-4420-a1b0-b3514d36437d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:37:13.916224 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a0fcb660-a691-4420-a1b0-b3514d36437d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:37:13.916662 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a0fcb660-a691-4420-a1b0-b3514d36437d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:37:13.986090 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a0fcb660-a691-4420-a1b0-b3514d36437d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "POST /compute/v2.1/servers/bb976652-3408-410e-8a0b-b8fe37e7c41f/action" status: 200 len: 32629 microversion: 2.1 time: 0.086934 Oct 30 02:37:13.986754 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4076/7818] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 02:37:13 2022] POST /compute/v2.1/servers/bb976652-3408-410e-8a0b-b8fe37e7c41f/action => generated 32629 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 02:37:13.998353 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-87f7ac72-5634-4987-a1d7-8bfa1f0146b9 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:37:13.998900 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-87f7ac72-5634-4987-a1d7-8bfa1f0146b9 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bb976652-3408-410e-8a0b-b8fe37e7c41f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:37:14.005804 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-87f7ac72-5634-4987-a1d7-8bfa1f0146b9 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:37:14.006309 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-87f7ac72-5634-4987-a1d7-8bfa1f0146b9 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:37:14.006756 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-87f7ac72-5634-4987-a1d7-8bfa1f0146b9 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:37:14.007460 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-87f7ac72-5634-4987-a1d7-8bfa1f0146b9 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:37:14.007919 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-87f7ac72-5634-4987-a1d7-8bfa1f0146b9 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:37:14.008352 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-87f7ac72-5634-4987-a1d7-8bfa1f0146b9 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:37:14.248283 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-87f7ac72-5634-4987-a1d7-8bfa1f0146b9 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "POST /compute/v2.1/servers/bb976652-3408-410e-8a0b-b8fe37e7c41f/action" status: 202 len: 0 microversion: 2.1 time: 0.253719 Oct 30 02:37:14.248915 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3743/7819] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 02:37:13 2022] POST /compute/v2.1/servers/bb976652-3408-410e-8a0b-b8fe37e7c41f/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 02:37:14.262729 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-be37a198-d632-4372-b77d-22d48cf7e296 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:37:14.264074 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-be37a198-d632-4372-b77d-22d48cf7e296 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bb976652-3408-410e-8a0b-b8fe37e7c41f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:37:14.273623 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-be37a198-d632-4372-b77d-22d48cf7e296 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:37:14.274170 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-be37a198-d632-4372-b77d-22d48cf7e296 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:37:14.274682 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-be37a198-d632-4372-b77d-22d48cf7e296 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:37:14.275494 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-be37a198-d632-4372-b77d-22d48cf7e296 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:37:14.276007 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-be37a198-d632-4372-b77d-22d48cf7e296 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:37:14.276588 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-be37a198-d632-4372-b77d-22d48cf7e296 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:37:14.418861 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-be37a198-d632-4372-b77d-22d48cf7e296 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:37:14.426880 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-be37a198-d632-4372-b77d-22d48cf7e296 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/bb976652-3408-410e-8a0b-b8fe37e7c41f" status: 200 len: 1675 microversion: 2.1 time: 0.172735 Oct 30 02:37:14.427450 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4077/7820] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:37:14 2022] GET /compute/v2.1/servers/bb976652-3408-410e-8a0b-b8fe37e7c41f => generated 1675 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:37:15.452420 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6caee095-215b-4a07-b5a1-5d9db6cc307c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:37:15.453116 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6caee095-215b-4a07-b5a1-5d9db6cc307c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bb976652-3408-410e-8a0b-b8fe37e7c41f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:37:15.459272 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6caee095-215b-4a07-b5a1-5d9db6cc307c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:37:15.459756 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6caee095-215b-4a07-b5a1-5d9db6cc307c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:37:15.460187 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6caee095-215b-4a07-b5a1-5d9db6cc307c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:37:15.460873 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6caee095-215b-4a07-b5a1-5d9db6cc307c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:37:15.461324 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6caee095-215b-4a07-b5a1-5d9db6cc307c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:37:15.461767 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6caee095-215b-4a07-b5a1-5d9db6cc307c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:37:15.592506 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6caee095-215b-4a07-b5a1-5d9db6cc307c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:37:15.600232 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6caee095-215b-4a07-b5a1-5d9db6cc307c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/bb976652-3408-410e-8a0b-b8fe37e7c41f" status: 200 len: 1683 microversion: 2.1 time: 0.153037 Oct 30 02:37:15.600793 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3744/7821] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:37:15 2022] GET /compute/v2.1/servers/bb976652-3408-410e-8a0b-b8fe37e7c41f => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:37:15.698653 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5fc72e87-557e-4731-8918-110786c11b11 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:37:15.701429 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5fc72e87-557e-4731-8918-110786c11b11 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bb976652-3408-410e-8a0b-b8fe37e7c41f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:37:15.709386 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5fc72e87-557e-4731-8918-110786c11b11 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:37:15.709873 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5fc72e87-557e-4731-8918-110786c11b11 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:37:15.710335 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5fc72e87-557e-4731-8918-110786c11b11 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:37:15.711048 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5fc72e87-557e-4731-8918-110786c11b11 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:37:15.711521 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5fc72e87-557e-4731-8918-110786c11b11 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:37:15.711968 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5fc72e87-557e-4731-8918-110786c11b11 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:37:15.773349 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5fc72e87-557e-4731-8918-110786c11b11 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "POST /compute/v2.1/servers/bb976652-3408-410e-8a0b-b8fe37e7c41f/action" status: 200 len: 35819 microversion: 2.1 time: 0.078594 Oct 30 02:37:15.774010 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4078/7822] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 02:37:15 2022] POST /compute/v2.1/servers/bb976652-3408-410e-8a0b-b8fe37e7c41f/action => generated 35819 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 02:37:16.896944 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-69863872-fe0e-45e5-85af-aefbcaa204c4 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:37:16.897367 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-69863872-fe0e-45e5-85af-aefbcaa204c4 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bb976652-3408-410e-8a0b-b8fe37e7c41f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:37:16.899500 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-63b7a739-c881-4636-81cb-c45deb9862da req-57786005-559a-4580-9904-699d1d4c4421 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb976652-3408-410e-8a0b-b8fe37e7c41f", "tag": "380ef5a8-0814-48a5-8b26-d815ad0506c2"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:37:16.905845 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-69863872-fe0e-45e5-85af-aefbcaa204c4 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:37:16.906419 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-69863872-fe0e-45e5-85af-aefbcaa204c4 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:37:16.906932 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-69863872-fe0e-45e5-85af-aefbcaa204c4 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:37:16.907730 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-69863872-fe0e-45e5-85af-aefbcaa204c4 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:37:16.908267 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-69863872-fe0e-45e5-85af-aefbcaa204c4 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:37:16.908767 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-69863872-fe0e-45e5-85af-aefbcaa204c4 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:37:16.910750 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-63b7a739-c881-4636-81cb-c45deb9862da req-57786005-559a-4580-9904-699d1d4c4421 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:37:16.911248 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-63b7a739-c881-4636-81cb-c45deb9862da req-57786005-559a-4580-9904-699d1d4c4421 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:37:16.911698 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-63b7a739-c881-4636-81cb-c45deb9862da req-57786005-559a-4580-9904-699d1d4c4421 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:37:16.924969 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-63b7a739-c881-4636-81cb-c45deb9862da req-57786005-559a-4580-9904-699d1d4c4421 service nova] Creating event network-changed:380ef5a8-0814-48a5-8b26-d815ad0506c2 for instance bb976652-3408-410e-8a0b-b8fe37e7c41f on n-h1-master-1 Oct 30 02:37:16.931833 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-63b7a739-c881-4636-81cb-c45deb9862da req-57786005-559a-4580-9904-699d1d4c4421 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034818 Oct 30 02:37:16.932859 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4079/7823] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:37:16.940183 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-69863872-fe0e-45e5-85af-aefbcaa204c4 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bb976652-3408-410e-8a0b-b8fe37e7c41f] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 02:37:17.195482 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-69863872-fe0e-45e5-85af-aefbcaa204c4 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "DELETE /compute/v2.1/servers/bb976652-3408-410e-8a0b-b8fe37e7c41f" status: 204 len: 0 microversion: 2.1 time: 0.304622 Oct 30 02:37:17.196374 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3745/7824] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 02:37:16 2022] DELETE /compute/v2.1/servers/bb976652-3408-410e-8a0b-b8fe37e7c41f => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 02:37:17.207003 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5c5ada45-cc46-43e8-9a91-8a3c8435a22d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:37:17.215191 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5c5ada45-cc46-43e8-9a91-8a3c8435a22d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bb976652-3408-410e-8a0b-b8fe37e7c41f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:37:17.215191 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c5ada45-cc46-43e8-9a91-8a3c8435a22d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:37:17.215191 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c5ada45-cc46-43e8-9a91-8a3c8435a22d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:37:17.215542 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c5ada45-cc46-43e8-9a91-8a3c8435a22d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:37:17.216270 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c5ada45-cc46-43e8-9a91-8a3c8435a22d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:37:17.216732 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c5ada45-cc46-43e8-9a91-8a3c8435a22d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:37:17.217169 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5c5ada45-cc46-43e8-9a91-8a3c8435a22d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:37:17.356510 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5c5ada45-cc46-43e8-9a91-8a3c8435a22d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:37:17.364466 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5c5ada45-cc46-43e8-9a91-8a3c8435a22d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/bb976652-3408-410e-8a0b-b8fe37e7c41f" status: 200 len: 1689 microversion: 2.1 time: 0.162524 Oct 30 02:37:17.365111 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4080/7825] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:37:17 2022] GET /compute/v2.1/servers/bb976652-3408-410e-8a0b-b8fe37e7c41f => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:37:18.388670 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0bc903aa-851a-4af9-ba46-fd6a226afd4c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:37:18.389407 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0bc903aa-851a-4af9-ba46-fd6a226afd4c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bb976652-3408-410e-8a0b-b8fe37e7c41f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:37:18.396185 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0bc903aa-851a-4af9-ba46-fd6a226afd4c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:37:18.396696 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0bc903aa-851a-4af9-ba46-fd6a226afd4c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:37:18.397145 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0bc903aa-851a-4af9-ba46-fd6a226afd4c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:37:18.397884 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0bc903aa-851a-4af9-ba46-fd6a226afd4c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:37:18.398348 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0bc903aa-851a-4af9-ba46-fd6a226afd4c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:37:18.398782 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0bc903aa-851a-4af9-ba46-fd6a226afd4c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:37:18.532847 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0bc903aa-851a-4af9-ba46-fd6a226afd4c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:37:18.540740 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0bc903aa-851a-4af9-ba46-fd6a226afd4c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/bb976652-3408-410e-8a0b-b8fe37e7c41f" status: 200 len: 1689 microversion: 2.1 time: 0.156372 Oct 30 02:37:18.541328 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3746/7826] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:37:18 2022] GET /compute/v2.1/servers/bb976652-3408-410e-8a0b-b8fe37e7c41f => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:37:19.468326 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-4d45d967-a982-44a9-8c67-a614f30069d8 req-1f4860d3-9b91-4f5d-b1ea-bde8cdab5b59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb976652-3408-410e-8a0b-b8fe37e7c41f", "name": "network-vif-deleted", "tag": "380ef5a8-0814-48a5-8b26-d815ad0506c2"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:37:19.479187 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-4d45d967-a982-44a9-8c67-a614f30069d8 req-1f4860d3-9b91-4f5d-b1ea-bde8cdab5b59 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:37:19.479685 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-4d45d967-a982-44a9-8c67-a614f30069d8 req-1f4860d3-9b91-4f5d-b1ea-bde8cdab5b59 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:37:19.480662 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-4d45d967-a982-44a9-8c67-a614f30069d8 req-1f4860d3-9b91-4f5d-b1ea-bde8cdab5b59 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:37:19.492602 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-4d45d967-a982-44a9-8c67-a614f30069d8 req-1f4860d3-9b91-4f5d-b1ea-bde8cdab5b59 service nova] Creating event network-vif-deleted:380ef5a8-0814-48a5-8b26-d815ad0506c2 for instance bb976652-3408-410e-8a0b-b8fe37e7c41f on n-h1-master-1 Oct 30 02:37:19.498601 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-4d45d967-a982-44a9-8c67-a614f30069d8 req-1f4860d3-9b91-4f5d-b1ea-bde8cdab5b59 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034287 Oct 30 02:37:19.502187 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4081/7827] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:37:19.565746 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d741df82-5408-4aca-b845-7be0b178d005 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:37:19.566365 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d741df82-5408-4aca-b845-7be0b178d005 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bb976652-3408-410e-8a0b-b8fe37e7c41f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:37:19.573994 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d741df82-5408-4aca-b845-7be0b178d005 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:37:19.574490 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d741df82-5408-4aca-b845-7be0b178d005 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:37:19.574966 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d741df82-5408-4aca-b845-7be0b178d005 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:37:19.575691 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d741df82-5408-4aca-b845-7be0b178d005 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:37:19.576143 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d741df82-5408-4aca-b845-7be0b178d005 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:37:19.576564 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d741df82-5408-4aca-b845-7be0b178d005 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:37:19.646449 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d741df82-5408-4aca-b845-7be0b178d005 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:37:19.655058 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d741df82-5408-4aca-b845-7be0b178d005 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/bb976652-3408-410e-8a0b-b8fe37e7c41f" status: 200 len: 1502 microversion: 2.1 time: 0.093024 Oct 30 02:37:19.655833 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3747/7828] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:37:19 2022] GET /compute/v2.1/servers/bb976652-3408-410e-8a0b-b8fe37e7c41f => generated 1502 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:37:20.680678 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-55bc8f2b-2421-43aa-bb68-56c86ca5b026 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:37:20.681421 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-55bc8f2b-2421-43aa-bb68-56c86ca5b026 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bb976652-3408-410e-8a0b-b8fe37e7c41f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:37:20.688083 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-55bc8f2b-2421-43aa-bb68-56c86ca5b026 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:37:20.688584 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-55bc8f2b-2421-43aa-bb68-56c86ca5b026 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:37:20.689036 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-55bc8f2b-2421-43aa-bb68-56c86ca5b026 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:37:20.689781 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-55bc8f2b-2421-43aa-bb68-56c86ca5b026 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:37:20.690251 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-55bc8f2b-2421-43aa-bb68-56c86ca5b026 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:37:20.690691 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-55bc8f2b-2421-43aa-bb68-56c86ca5b026 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:37:20.704369 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-55bc8f2b-2421-43aa-bb68-56c86ca5b026 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] HTTP exception thrown: Instance bb976652-3408-410e-8a0b-b8fe37e7c41f could not be found. Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-55bc8f2b-2421-43aa-bb68-56c86ca5b026 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Request method failure captured: Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/bb976652-3408-410e-8a0b-b8fe37e7c41f HTTP/1.1 Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXeMhmBt07CnqlsQCCZQN6u-PC4AsgU8WequZ4Kud9tCoyqv8mAHQMcaho4Jbx4RzGkeSupfwjjjBU9nby25ZfrQmG3SvdDYuPUoYCpt4XAVTrkn_pjoiCb5AJLHMr5UnOHpTN2d7v4LRRKuXP0k9zso8ZvHlSuYjg8x6U3J73q4pZ0Q Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 4a813c90e3ec437fbf1f37dbb2b340d4 Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-521135141 Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a813c90e3ec437fbf1f37dbb2b340d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4a813c90e3ec437fbf1f37dbb2b340d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4a813c90e3ec437fbf1f37dbb2b340d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a813c90e3ec437fbf1f37dbb2b340d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-TestNetworkAdvancedServerOps-521135141 Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 4a813c90e3ec437fbf1f37dbb2b340d4 Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-521135141 Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-TestNetworkAdvancedServerOps-521135141-project Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: ef194f895a0c404abc08cad62a3b566d Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-TestNetworkAdvancedServerOps-521135141-project Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: exception: Instance bb976652-3408-410e-8a0b-b8fe37e7c41f could not be found. Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'bb976652-3408-410e-8a0b-b8fe37e7c41f'} Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb976652-3408-410e-8a0b-b8fe37e7c41f could not be found. Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb976652-3408-410e-8a0b-b8fe37e7c41f could not be found. Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:37:20.706039 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:37:20.712068 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:37:20.712068 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:37:20.712068 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:37:20.712068 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:37:20.712068 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:37:20.712068 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:37:20.712068 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb976652-3408-410e-8a0b-b8fe37e7c41f could not be found. Oct 30 02:37:20.712068 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:37:20.712068 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-55bc8f2b-2421-43aa-bb68-56c86ca5b026 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Returning 404 to user: Instance bb976652-3408-410e-8a0b-b8fe37e7c41f could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:37:20.712068 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-55bc8f2b-2421-43aa-bb68-56c86ca5b026 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/bb976652-3408-410e-8a0b-b8fe37e7c41f" status: 404 len: 111 microversion: 2.1 time: 0.031988 Oct 30 02:37:20.712068 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4082/7829] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:37:20 2022] GET /compute/v2.1/servers/bb976652-3408-410e-8a0b-b8fe37e7c41f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 02:37:24.183163 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8979de80-e2a5-4cc3-be20-ad78e1c8cba4 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '.version_select at 0x7f44c6d7daf0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:37:24.265368 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8979de80-e2a5-4cc3-be20-ad78e1c8cba4 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1276472962" status: 202 len: 0 microversion: 2.1 time: 0.086061 Oct 30 02:37:24.265974 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3748/7830] 10.222.0.13 () {58 vars in 1284 bytes} [Sun Oct 30 02:37:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1276472962 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 02:37:24.293061 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-273b48f0-4c2f-4941-a26c-b47c823882cd tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Action: 'create', calling method: .version_select at 0x7f44c7ee3310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-745954542", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIAFrXXHWiY0PUfjkk9hgrOVuwja8opBPt9+muC1B6aR7yJ579pF1zybEYm8P0obg3iF98a5KrqJDHgPCDH2jXJXqnGbYmp5i27XDeDXsNd+E99X6K+dUTHct/NXrvkVA=="}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:37:24.310920 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-273b48f0-4c2f-4941-a26c-b47c823882cd tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Getting quotas for project 4a813c90e3ec437fbf1f37dbb2b340d4. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 02:37:24.316097 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-273b48f0-4c2f-4941-a26c-b47c823882cd tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Getting quotas for user ef194f895a0c404abc08cad62a3b566d and project 4a813c90e3ec437fbf1f37dbb2b340d4. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 02:37:24.399910 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-273b48f0-4c2f-4941-a26c-b47c823882cd tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.110640 Oct 30 02:37:24.400446 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4083/7831] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 30 02:37:24 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:37:32.457354 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:37:32.463326 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4c17df92-db43-4d38-8ee6-09fa18eaceda tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1242122253", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "e37b2292-1586-44a3-a093-51fdccc0e011"}], "key_name": "tempest-TestNetworkAdvancedServerOps-745954542", "security_groups": [{"name": "tempest-secgroup-smoke-537521068"}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:37:32.598818 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-4c17df92-db43-4d38-8ee6-09fa18eaceda tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] validate_networks() for [('e37b2292-1586-44a3-a093-51fdccc0e011', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 02:37:33.089199 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-4c17df92-db43-4d38-8ee6-09fa18eaceda tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 02:37:33.089851 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-4c17df92-db43-4d38-8ee6-09fa18eaceda tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 02:37:33.090644 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-4c17df92-db43-4d38-8ee6-09fa18eaceda tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 02:37:33.091064 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-4c17df92-db43-4d38-8ee6-09fa18eaceda tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 02:37:33.091472 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-4c17df92-db43-4d38-8ee6-09fa18eaceda tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 02:37:33.102250 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4c17df92-db43-4d38-8ee6-09fa18eaceda tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:37:33.103022 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4c17df92-db43-4d38-8ee6-09fa18eaceda tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:37:33.103672 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4c17df92-db43-4d38-8ee6-09fa18eaceda tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:37:33.104593 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4c17df92-db43-4d38-8ee6-09fa18eaceda tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:37:33.105238 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4c17df92-db43-4d38-8ee6-09fa18eaceda tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:37:33.106964 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4c17df92-db43-4d38-8ee6-09fa18eaceda tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:37:33.128418 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-4c17df92-db43-4d38-8ee6-09fa18eaceda tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Getting quotas for project 4a813c90e3ec437fbf1f37dbb2b340d4. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 02:37:33.134212 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-4c17df92-db43-4d38-8ee6-09fa18eaceda tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Getting quotas for user ef194f895a0c404abc08cad62a3b566d and project 4a813c90e3ec437fbf1f37dbb2b340d4. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 02:37:33.147815 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4c17df92-db43-4d38-8ee6-09fa18eaceda tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 02:37:33.150507 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4c17df92-db43-4d38-8ee6-09fa18eaceda tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bf3641be-e964-42c3-be66-cfc94b1aec35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 02:37:33.260902 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4c17df92-db43-4d38-8ee6-09fa18eaceda tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.805245 Oct 30 02:37:33.261786 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3749/7832] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 02:37:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 02:37:33.270845 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=36 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:37:33.275746 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9941289b-2f34-49e8-85e4-bb93d28e3fc2 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:37:33.276379 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9941289b-2f34-49e8-85e4-bb93d28e3fc2 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bf3641be-e964-42c3-be66-cfc94b1aec35] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:37:33.373532 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9941289b-2f34-49e8-85e4-bb93d28e3fc2 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:37:33.381954 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9941289b-2f34-49e8-85e4-bb93d28e3fc2 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35" status: 200 len: 1266 microversion: 2.1 time: 0.112934 Oct 30 02:37:33.382541 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4084/7833] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:37:33 2022] GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35 => generated 1266 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:37:34.419388 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d1e38fe4-30e4-41b3-9455-076dd65afe9f tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:37:34.419388 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d1e38fe4-30e4-41b3-9455-076dd65afe9f tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bf3641be-e964-42c3-be66-cfc94b1aec35] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:37:34.423646 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d1e38fe4-30e4-41b3-9455-076dd65afe9f tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:37:34.424328 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d1e38fe4-30e4-41b3-9455-076dd65afe9f tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:37:34.424767 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d1e38fe4-30e4-41b3-9455-076dd65afe9f tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:37:34.425515 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d1e38fe4-30e4-41b3-9455-076dd65afe9f tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:37:34.426149 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d1e38fe4-30e4-41b3-9455-076dd65afe9f tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:37:34.426630 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d1e38fe4-30e4-41b3-9455-076dd65afe9f tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:37:34.507335 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d1e38fe4-30e4-41b3-9455-076dd65afe9f tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:37:34.515977 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d1e38fe4-30e4-41b3-9455-076dd65afe9f tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35" status: 200 len: 1270 microversion: 2.1 time: 0.111772 Oct 30 02:37:34.516554 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3750/7834] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:37:34 2022] GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35 => generated 1270 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:37:35.539775 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c01cf965-027e-4240-bec9-88953d4e83df tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:37:35.540523 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c01cf965-027e-4240-bec9-88953d4e83df tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bf3641be-e964-42c3-be66-cfc94b1aec35] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:37:35.544826 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:37:35.551402 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c01cf965-027e-4240-bec9-88953d4e83df tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:37:35.551882 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c01cf965-027e-4240-bec9-88953d4e83df tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:37:35.552323 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c01cf965-027e-4240-bec9-88953d4e83df tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:37:35.553048 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c01cf965-027e-4240-bec9-88953d4e83df tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:37:35.553543 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c01cf965-027e-4240-bec9-88953d4e83df tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:37:35.553984 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c01cf965-027e-4240-bec9-88953d4e83df tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:37:35.619500 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c01cf965-027e-4240-bec9-88953d4e83df tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:37:35.627296 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c01cf965-027e-4240-bec9-88953d4e83df tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35" status: 200 len: 1326 microversion: 2.1 time: 0.091564 Oct 30 02:37:35.627886 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4085/7835] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:37:35 2022] GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35 => generated 1326 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:37:36.650490 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8bdb15e3-7035-4878-9d90-33095493f8eb tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:37:36.651821 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8bdb15e3-7035-4878-9d90-33095493f8eb tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bf3641be-e964-42c3-be66-cfc94b1aec35] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:37:36.660314 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8bdb15e3-7035-4878-9d90-33095493f8eb tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:37:36.660817 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8bdb15e3-7035-4878-9d90-33095493f8eb tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:37:36.661527 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8bdb15e3-7035-4878-9d90-33095493f8eb tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:37:36.662436 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8bdb15e3-7035-4878-9d90-33095493f8eb tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:37:36.662898 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8bdb15e3-7035-4878-9d90-33095493f8eb tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:37:36.663338 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8bdb15e3-7035-4878-9d90-33095493f8eb tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:37:36.845675 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8bdb15e3-7035-4878-9d90-33095493f8eb tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:37:36.853550 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8bdb15e3-7035-4878-9d90-33095493f8eb tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35" status: 200 len: 1391 microversion: 2.1 time: 0.207154 Oct 30 02:37:36.854382 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3751/7836] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:37:36 2022] GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35 => generated 1391 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:37:37.586672 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-f83f9430-adf9-4e1f-9001-a2a280b50e55 req-7005e4c3-2e8d-4108-9c88-0db6b7dbd5a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf3641be-e964-42c3-be66-cfc94b1aec35", "tag": "dd75406d-26dd-4a3c-9412-9988b93f2905"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:37:37.597810 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-f83f9430-adf9-4e1f-9001-a2a280b50e55 req-7005e4c3-2e8d-4108-9c88-0db6b7dbd5a2 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:37:37.598297 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-f83f9430-adf9-4e1f-9001-a2a280b50e55 req-7005e4c3-2e8d-4108-9c88-0db6b7dbd5a2 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:37:37.598740 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-f83f9430-adf9-4e1f-9001-a2a280b50e55 req-7005e4c3-2e8d-4108-9c88-0db6b7dbd5a2 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:37:37.610282 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-f83f9430-adf9-4e1f-9001-a2a280b50e55 req-7005e4c3-2e8d-4108-9c88-0db6b7dbd5a2 service nova] Creating event network-changed:dd75406d-26dd-4a3c-9412-9988b93f2905 for instance bf3641be-e964-42c3-be66-cfc94b1aec35 on n-h2-master-1 Oct 30 02:37:37.615491 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-f83f9430-adf9-4e1f-9001-a2a280b50e55 req-7005e4c3-2e8d-4108-9c88-0db6b7dbd5a2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032746 Oct 30 02:37:37.616087 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4086/7837] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:37:37.876115 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-04745605-ee63-46d2-bee2-3dfe5dac5466 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:37:37.877633 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-04745605-ee63-46d2-bee2-3dfe5dac5466 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bf3641be-e964-42c3-be66-cfc94b1aec35] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:37:37.884396 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-04745605-ee63-46d2-bee2-3dfe5dac5466 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:37:37.884973 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-04745605-ee63-46d2-bee2-3dfe5dac5466 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:37:37.885519 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-04745605-ee63-46d2-bee2-3dfe5dac5466 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:37:37.886233 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-04745605-ee63-46d2-bee2-3dfe5dac5466 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:37:37.886714 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-04745605-ee63-46d2-bee2-3dfe5dac5466 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:37:37.887174 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-04745605-ee63-46d2-bee2-3dfe5dac5466 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:37:38.065635 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-04745605-ee63-46d2-bee2-3dfe5dac5466 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:37:38.073680 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-04745605-ee63-46d2-bee2-3dfe5dac5466 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35" status: 200 len: 1391 microversion: 2.1 time: 0.201371 Oct 30 02:37:38.074772 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3752/7838] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:37:37 2022] GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35 => generated 1391 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:37:39.097405 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a95e91dc-f76e-4ce9-b9b2-03c754d62c33 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:37:39.098150 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a95e91dc-f76e-4ce9-b9b2-03c754d62c33 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bf3641be-e964-42c3-be66-cfc94b1aec35] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:37:39.105769 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a95e91dc-f76e-4ce9-b9b2-03c754d62c33 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:37:39.106278 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a95e91dc-f76e-4ce9-b9b2-03c754d62c33 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:37:39.106726 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a95e91dc-f76e-4ce9-b9b2-03c754d62c33 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:37:39.107421 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a95e91dc-f76e-4ce9-b9b2-03c754d62c33 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:37:39.107886 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a95e91dc-f76e-4ce9-b9b2-03c754d62c33 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:37:39.108321 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a95e91dc-f76e-4ce9-b9b2-03c754d62c33 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:37:39.544962 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a95e91dc-f76e-4ce9-b9b2-03c754d62c33 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:37:39.553274 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a95e91dc-f76e-4ce9-b9b2-03c754d62c33 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35" status: 200 len: 1391 microversion: 2.1 time: 0.460103 Oct 30 02:37:39.553888 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4087/7839] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:37:39 2022] GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35 => generated 1391 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:37:40.576032 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-77ac812f-807e-4844-9c6d-7b0396ead576 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:37:40.576582 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-77ac812f-807e-4844-9c6d-7b0396ead576 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bf3641be-e964-42c3-be66-cfc94b1aec35] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:37:40.583293 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-77ac812f-807e-4844-9c6d-7b0396ead576 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:37:40.583766 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-77ac812f-807e-4844-9c6d-7b0396ead576 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:37:40.584203 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-77ac812f-807e-4844-9c6d-7b0396ead576 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:37:40.584890 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-77ac812f-807e-4844-9c6d-7b0396ead576 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:37:40.585354 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-77ac812f-807e-4844-9c6d-7b0396ead576 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:37:40.585794 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-77ac812f-807e-4844-9c6d-7b0396ead576 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:37:40.719529 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-77ac812f-807e-4844-9c6d-7b0396ead576 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:37:40.727101 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-77ac812f-807e-4844-9c6d-7b0396ead576 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35" status: 200 len: 1391 microversion: 2.1 time: 0.155088 Oct 30 02:37:40.727953 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3753/7840] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:37:40 2022] GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:37:41.750756 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-94bab7cb-64ff-426b-8fbb-b94de4e3d1cd tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:37:41.751385 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-94bab7cb-64ff-426b-8fbb-b94de4e3d1cd tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bf3641be-e964-42c3-be66-cfc94b1aec35] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:37:41.758281 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-94bab7cb-64ff-426b-8fbb-b94de4e3d1cd tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:37:41.758780 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-94bab7cb-64ff-426b-8fbb-b94de4e3d1cd tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:37:41.759235 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-94bab7cb-64ff-426b-8fbb-b94de4e3d1cd tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:37:41.759939 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-94bab7cb-64ff-426b-8fbb-b94de4e3d1cd tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:37:41.760411 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-94bab7cb-64ff-426b-8fbb-b94de4e3d1cd tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:37:41.760850 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-94bab7cb-64ff-426b-8fbb-b94de4e3d1cd tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:37:41.892001 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-94bab7cb-64ff-426b-8fbb-b94de4e3d1cd tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:37:41.899955 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-94bab7cb-64ff-426b-8fbb-b94de4e3d1cd tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35" status: 200 len: 1391 microversion: 2.1 time: 0.153697 Oct 30 02:37:41.900533 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4088/7841] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:37:41 2022] GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35 => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:37:42.018914 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-417b7805-f4db-4966-a9dd-0314753e8de8 req-19a06ca8-eef5-46e9-af22-0ec14d40b41e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf3641be-e964-42c3-be66-cfc94b1aec35", "name": "network-vif-plugged", "status": "completed", "tag": "dd75406d-26dd-4a3c-9412-9988b93f2905"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:37:42.024755 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:37:42.030660 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-417b7805-f4db-4966-a9dd-0314753e8de8 req-19a06ca8-eef5-46e9-af22-0ec14d40b41e service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:37:42.031143 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-417b7805-f4db-4966-a9dd-0314753e8de8 req-19a06ca8-eef5-46e9-af22-0ec14d40b41e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:37:42.031576 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-417b7805-f4db-4966-a9dd-0314753e8de8 req-19a06ca8-eef5-46e9-af22-0ec14d40b41e service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:37:42.042504 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-417b7805-f4db-4966-a9dd-0314753e8de8 req-19a06ca8-eef5-46e9-af22-0ec14d40b41e service nova] Creating event network-vif-plugged:dd75406d-26dd-4a3c-9412-9988b93f2905 for instance bf3641be-e964-42c3-be66-cfc94b1aec35 on n-h2-master-1 Oct 30 02:37:42.047716 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-417b7805-f4db-4966-a9dd-0314753e8de8 req-19a06ca8-eef5-46e9-af22-0ec14d40b41e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032598 Oct 30 02:37:42.048291 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3754/7842] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:37:42.923964 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-df7690fa-a6fd-4999-8b62-e3ff6f6d0509 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:37:42.924597 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-df7690fa-a6fd-4999-8b62-e3ff6f6d0509 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bf3641be-e964-42c3-be66-cfc94b1aec35] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:37:42.931674 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df7690fa-a6fd-4999-8b62-e3ff6f6d0509 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:37:42.932177 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df7690fa-a6fd-4999-8b62-e3ff6f6d0509 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:37:42.932644 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df7690fa-a6fd-4999-8b62-e3ff6f6d0509 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:37:42.934032 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df7690fa-a6fd-4999-8b62-e3ff6f6d0509 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:37:42.934505 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df7690fa-a6fd-4999-8b62-e3ff6f6d0509 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:37:42.934946 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df7690fa-a6fd-4999-8b62-e3ff6f6d0509 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:37:43.067273 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-df7690fa-a6fd-4999-8b62-e3ff6f6d0509 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:37:43.075137 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-df7690fa-a6fd-4999-8b62-e3ff6f6d0509 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35" status: 200 len: 1391 microversion: 2.1 time: 0.155429 Oct 30 02:37:43.075714 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4089/7843] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:37:42 2022] GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:37:44.096869 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:37:44.100446 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=6 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:37:44.102173 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e216392c-41a7-4a7d-b1c3-0a4776958078 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:37:44.102874 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e216392c-41a7-4a7d-b1c3-0a4776958078 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bf3641be-e964-42c3-be66-cfc94b1aec35] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:37:44.109676 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e216392c-41a7-4a7d-b1c3-0a4776958078 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:37:44.110163 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e216392c-41a7-4a7d-b1c3-0a4776958078 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:37:44.110598 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e216392c-41a7-4a7d-b1c3-0a4776958078 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:37:44.111290 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e216392c-41a7-4a7d-b1c3-0a4776958078 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:37:44.111744 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e216392c-41a7-4a7d-b1c3-0a4776958078 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:37:44.112167 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e216392c-41a7-4a7d-b1c3-0a4776958078 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:37:44.248125 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e216392c-41a7-4a7d-b1c3-0a4776958078 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:37:44.256293 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e216392c-41a7-4a7d-b1c3-0a4776958078 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35" status: 200 len: 1564 microversion: 2.1 time: 0.161178 Oct 30 02:37:44.257086 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3755/7844] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:37:44 2022] GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35 => generated 1564 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:37:44.279309 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-62b0bfb1-6d00-4449-804d-bb3c92ba9615 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:37:44.280315 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-62b0bfb1-6d00-4449-804d-bb3c92ba9615 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bf3641be-e964-42c3-be66-cfc94b1aec35] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:37:44.282226 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=6 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:37:44.288238 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-62b0bfb1-6d00-4449-804d-bb3c92ba9615 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:37:44.288741 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-62b0bfb1-6d00-4449-804d-bb3c92ba9615 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:37:44.289190 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-62b0bfb1-6d00-4449-804d-bb3c92ba9615 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:37:44.289932 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-62b0bfb1-6d00-4449-804d-bb3c92ba9615 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:37:44.290402 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-62b0bfb1-6d00-4449-804d-bb3c92ba9615 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:37:44.290841 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-62b0bfb1-6d00-4449-804d-bb3c92ba9615 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:37:44.424951 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-62b0bfb1-6d00-4449-804d-bb3c92ba9615 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:37:44.433189 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-62b0bfb1-6d00-4449-804d-bb3c92ba9615 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35" status: 200 len: 1564 microversion: 2.1 time: 0.157682 Oct 30 02:37:44.434591 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4090/7845] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:37:44 2022] GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35 => generated 1564 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:37:46.277905 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1a476956-bd19-43d3-a91e-01f8fa8c37cf tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:37:46.278522 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1a476956-bd19-43d3-a91e-01f8fa8c37cf tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bf3641be-e964-42c3-be66-cfc94b1aec35] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:37:46.286250 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-68f7be7f-98b9-4e30-8f60-cfaab11e3757 req-f322f369-1407-4c5d-a5de-68b033cf27af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf3641be-e964-42c3-be66-cfc94b1aec35", "tag": "dd75406d-26dd-4a3c-9412-9988b93f2905"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:37:46.297912 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a476956-bd19-43d3-a91e-01f8fa8c37cf tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:37:46.298407 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a476956-bd19-43d3-a91e-01f8fa8c37cf tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:37:46.298845 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a476956-bd19-43d3-a91e-01f8fa8c37cf tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:37:46.299556 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a476956-bd19-43d3-a91e-01f8fa8c37cf tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:37:46.300010 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a476956-bd19-43d3-a91e-01f8fa8c37cf tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:37:46.300434 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a476956-bd19-43d3-a91e-01f8fa8c37cf tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:37:46.308355 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-68f7be7f-98b9-4e30-8f60-cfaab11e3757 req-f322f369-1407-4c5d-a5de-68b033cf27af service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:37:46.308846 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-68f7be7f-98b9-4e30-8f60-cfaab11e3757 req-f322f369-1407-4c5d-a5de-68b033cf27af service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:37:46.309285 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-68f7be7f-98b9-4e30-8f60-cfaab11e3757 req-f322f369-1407-4c5d-a5de-68b033cf27af service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:37:46.323129 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-68f7be7f-98b9-4e30-8f60-cfaab11e3757 req-f322f369-1407-4c5d-a5de-68b033cf27af service nova] Creating event network-changed:dd75406d-26dd-4a3c-9412-9988b93f2905 for instance bf3641be-e964-42c3-be66-cfc94b1aec35 on n-h2-master-1 Oct 30 02:37:46.329681 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-68f7be7f-98b9-4e30-8f60-cfaab11e3757 req-f322f369-1407-4c5d-a5de-68b033cf27af service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046981 Oct 30 02:37:46.330680 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4091/7846] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:37:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:37:46.511019 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1a476956-bd19-43d3-a91e-01f8fa8c37cf tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:37:46.520358 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1a476956-bd19-43d3-a91e-01f8fa8c37cf tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35" status: 200 len: 1564 microversion: 2.1 time: 0.247440 Oct 30 02:37:46.533692 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3756/7847] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:37:46 2022] GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35 => generated 1564 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:38:07.806362 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=13 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:38:07.807170 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=34 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:38:07.811379 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c295976a-2661-4083-af98-f4953a245574 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:38:07.813715 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c295976a-2661-4083-af98-f4953a245574 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bf3641be-e964-42c3-be66-cfc94b1aec35] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:38:07.819708 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c295976a-2661-4083-af98-f4953a245574 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:38:07.820201 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c295976a-2661-4083-af98-f4953a245574 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:38:07.820674 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c295976a-2661-4083-af98-f4953a245574 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:38:07.821404 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c295976a-2661-4083-af98-f4953a245574 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:38:07.821869 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c295976a-2661-4083-af98-f4953a245574 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:38:07.822304 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c295976a-2661-4083-af98-f4953a245574 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:38:07.892935 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c295976a-2661-4083-af98-f4953a245574 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "POST /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35/action" status: 200 len: 24566 microversion: 2.1 time: 0.088319 Oct 30 02:38:07.895025 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4092/7848] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 02:38:07 2022] POST /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35/action => generated 24566 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 02:38:18.910249 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-02f87d27-96db-4309-b526-715cbdf77792 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:38:18.912553 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-02f87d27-96db-4309-b526-715cbdf77792 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bf3641be-e964-42c3-be66-cfc94b1aec35] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:38:18.914941 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=5 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:38:18.915600 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=40 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:38:18.920542 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-02f87d27-96db-4309-b526-715cbdf77792 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:38:18.922910 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-02f87d27-96db-4309-b526-715cbdf77792 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:38:18.922910 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-02f87d27-96db-4309-b526-715cbdf77792 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:38:18.922910 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-02f87d27-96db-4309-b526-715cbdf77792 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:38:18.922910 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-02f87d27-96db-4309-b526-715cbdf77792 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:38:18.923341 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-02f87d27-96db-4309-b526-715cbdf77792 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:38:19.113012 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-02f87d27-96db-4309-b526-715cbdf77792 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "POST /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35/action" status: 202 len: 0 microversion: 2.1 time: 0.206553 Oct 30 02:38:19.113952 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3757/7849] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 02:38:18 2022] POST /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 02:38:19.129216 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5a8a4813-d01f-4afb-b704-28ec7112a209 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:38:19.130034 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5a8a4813-d01f-4afb-b704-28ec7112a209 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bf3641be-e964-42c3-be66-cfc94b1aec35] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:38:19.134492 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:38:19.138912 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a8a4813-d01f-4afb-b704-28ec7112a209 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:38:19.139417 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a8a4813-d01f-4afb-b704-28ec7112a209 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:38:19.139868 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a8a4813-d01f-4afb-b704-28ec7112a209 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:38:19.140592 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a8a4813-d01f-4afb-b704-28ec7112a209 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:38:19.141061 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a8a4813-d01f-4afb-b704-28ec7112a209 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:38:19.142208 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a8a4813-d01f-4afb-b704-28ec7112a209 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:38:19.284838 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5a8a4813-d01f-4afb-b704-28ec7112a209 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:38:19.293594 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5a8a4813-d01f-4afb-b704-28ec7112a209 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35" status: 200 len: 1675 microversion: 2.1 time: 0.175224 Oct 30 02:38:19.294404 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4093/7850] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:38:19 2022] GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35 => generated 1675 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:38:20.321292 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e3cdb61d-43da-4c66-b6d5-154dc53fa963 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:38:20.322104 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e3cdb61d-43da-4c66-b6d5-154dc53fa963 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bf3641be-e964-42c3-be66-cfc94b1aec35] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:38:20.328446 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e3cdb61d-43da-4c66-b6d5-154dc53fa963 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:38:20.329577 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e3cdb61d-43da-4c66-b6d5-154dc53fa963 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:38:20.330015 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e3cdb61d-43da-4c66-b6d5-154dc53fa963 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:38:20.330705 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e3cdb61d-43da-4c66-b6d5-154dc53fa963 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:38:20.331158 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e3cdb61d-43da-4c66-b6d5-154dc53fa963 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:38:20.331580 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e3cdb61d-43da-4c66-b6d5-154dc53fa963 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:38:20.464122 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e3cdb61d-43da-4c66-b6d5-154dc53fa963 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:38:20.472039 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e3cdb61d-43da-4c66-b6d5-154dc53fa963 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35" status: 200 len: 1680 microversion: 2.1 time: 0.156415 Oct 30 02:38:20.472606 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3758/7851] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:38:20 2022] GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:38:21.495015 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d2389a51-8135-4923-b003-897a864e80b9 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:38:21.495712 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d2389a51-8135-4923-b003-897a864e80b9 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bf3641be-e964-42c3-be66-cfc94b1aec35] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:38:21.502800 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2389a51-8135-4923-b003-897a864e80b9 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:38:21.503299 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2389a51-8135-4923-b003-897a864e80b9 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:38:21.503754 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2389a51-8135-4923-b003-897a864e80b9 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:38:21.504470 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2389a51-8135-4923-b003-897a864e80b9 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:38:21.504943 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2389a51-8135-4923-b003-897a864e80b9 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:38:21.505409 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2389a51-8135-4923-b003-897a864e80b9 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:38:21.637880 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d2389a51-8135-4923-b003-897a864e80b9 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:38:21.646157 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d2389a51-8135-4923-b003-897a864e80b9 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35" status: 200 len: 1680 microversion: 2.1 time: 0.155120 Oct 30 02:38:21.646729 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4094/7852] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:38:21 2022] GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:38:22.669445 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7d3dd004-f7b9-46ef-b418-244e908ba150 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:38:22.670381 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7d3dd004-f7b9-46ef-b418-244e908ba150 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bf3641be-e964-42c3-be66-cfc94b1aec35] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:38:22.677973 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7d3dd004-f7b9-46ef-b418-244e908ba150 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:38:22.681590 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7d3dd004-f7b9-46ef-b418-244e908ba150 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:38:22.681590 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7d3dd004-f7b9-46ef-b418-244e908ba150 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:38:22.681590 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7d3dd004-f7b9-46ef-b418-244e908ba150 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:38:22.681590 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7d3dd004-f7b9-46ef-b418-244e908ba150 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:38:22.681590 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7d3dd004-f7b9-46ef-b418-244e908ba150 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:38:22.810340 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7d3dd004-f7b9-46ef-b418-244e908ba150 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:38:22.818078 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7d3dd004-f7b9-46ef-b418-244e908ba150 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35" status: 200 len: 1680 microversion: 2.1 time: 0.152719 Oct 30 02:38:22.818646 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3759/7853] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:38:22 2022] GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:38:23.840835 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ecf21b20-907a-4cab-b33c-a9e66b5c0b03 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:38:23.841485 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ecf21b20-907a-4cab-b33c-a9e66b5c0b03 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bf3641be-e964-42c3-be66-cfc94b1aec35] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:38:23.848334 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ecf21b20-907a-4cab-b33c-a9e66b5c0b03 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:38:23.848827 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ecf21b20-907a-4cab-b33c-a9e66b5c0b03 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:38:23.849271 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ecf21b20-907a-4cab-b33c-a9e66b5c0b03 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:38:23.849995 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ecf21b20-907a-4cab-b33c-a9e66b5c0b03 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:38:23.850464 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ecf21b20-907a-4cab-b33c-a9e66b5c0b03 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:38:23.851272 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ecf21b20-907a-4cab-b33c-a9e66b5c0b03 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:38:23.980266 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ecf21b20-907a-4cab-b33c-a9e66b5c0b03 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:38:23.988686 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ecf21b20-907a-4cab-b33c-a9e66b5c0b03 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35" status: 200 len: 1680 microversion: 2.1 time: 0.151719 Oct 30 02:38:23.989264 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4095/7854] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:38:23 2022] GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:38:25.012028 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d9d003fd-3252-47f1-8fc2-51345b33e32a tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:38:25.012650 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d9d003fd-3252-47f1-8fc2-51345b33e32a tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bf3641be-e964-42c3-be66-cfc94b1aec35] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:38:25.020222 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d9d003fd-3252-47f1-8fc2-51345b33e32a tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:38:25.020713 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d9d003fd-3252-47f1-8fc2-51345b33e32a tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:38:25.021153 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d9d003fd-3252-47f1-8fc2-51345b33e32a tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:38:25.021885 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d9d003fd-3252-47f1-8fc2-51345b33e32a tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:38:25.022352 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d9d003fd-3252-47f1-8fc2-51345b33e32a tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:38:25.022789 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d9d003fd-3252-47f1-8fc2-51345b33e32a tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:38:25.154993 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d9d003fd-3252-47f1-8fc2-51345b33e32a tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:38:25.162659 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d9d003fd-3252-47f1-8fc2-51345b33e32a tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35" status: 200 len: 1680 microversion: 2.1 time: 0.154560 Oct 30 02:38:25.163232 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3760/7855] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:38:25 2022] GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:38:26.186417 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-71606f65-7826-4b7d-8457-26380a7a7a06 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:38:26.187182 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-71606f65-7826-4b7d-8457-26380a7a7a06 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bf3641be-e964-42c3-be66-cfc94b1aec35] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:38:26.194146 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-71606f65-7826-4b7d-8457-26380a7a7a06 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:38:26.194642 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-71606f65-7826-4b7d-8457-26380a7a7a06 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:38:26.195085 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-71606f65-7826-4b7d-8457-26380a7a7a06 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:38:26.195780 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-71606f65-7826-4b7d-8457-26380a7a7a06 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:38:26.196243 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-71606f65-7826-4b7d-8457-26380a7a7a06 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:38:26.196678 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-71606f65-7826-4b7d-8457-26380a7a7a06 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:38:26.326511 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-71606f65-7826-4b7d-8457-26380a7a7a06 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:38:26.334990 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-71606f65-7826-4b7d-8457-26380a7a7a06 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35" status: 200 len: 1680 microversion: 2.1 time: 0.152548 Oct 30 02:38:26.335561 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4096/7856] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:38:26 2022] GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:38:27.358202 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5b24e213-e426-4116-b97c-aaf52cba4dbc tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:38:27.358850 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5b24e213-e426-4116-b97c-aaf52cba4dbc tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bf3641be-e964-42c3-be66-cfc94b1aec35] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:38:27.366251 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5b24e213-e426-4116-b97c-aaf52cba4dbc tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:38:27.366763 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5b24e213-e426-4116-b97c-aaf52cba4dbc tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:38:27.367216 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5b24e213-e426-4116-b97c-aaf52cba4dbc tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:38:27.367907 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5b24e213-e426-4116-b97c-aaf52cba4dbc tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:38:27.368356 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5b24e213-e426-4116-b97c-aaf52cba4dbc tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:38:27.368781 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5b24e213-e426-4116-b97c-aaf52cba4dbc tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:38:27.496970 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5b24e213-e426-4116-b97c-aaf52cba4dbc tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:38:27.504911 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5b24e213-e426-4116-b97c-aaf52cba4dbc tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35" status: 200 len: 1680 microversion: 2.1 time: 0.150609 Oct 30 02:38:27.505509 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3761/7857] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:38:27 2022] GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:38:28.528831 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-96ad7b00-16a5-4448-9f6e-dacfb12ca036 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:38:28.529496 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-96ad7b00-16a5-4448-9f6e-dacfb12ca036 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bf3641be-e964-42c3-be66-cfc94b1aec35] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:38:28.536723 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96ad7b00-16a5-4448-9f6e-dacfb12ca036 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:38:28.537258 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96ad7b00-16a5-4448-9f6e-dacfb12ca036 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:38:28.537745 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96ad7b00-16a5-4448-9f6e-dacfb12ca036 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:38:28.538458 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96ad7b00-16a5-4448-9f6e-dacfb12ca036 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:38:28.538931 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96ad7b00-16a5-4448-9f6e-dacfb12ca036 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:38:28.539375 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96ad7b00-16a5-4448-9f6e-dacfb12ca036 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:38:28.672899 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-96ad7b00-16a5-4448-9f6e-dacfb12ca036 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:38:28.680626 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-96ad7b00-16a5-4448-9f6e-dacfb12ca036 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35" status: 200 len: 1680 microversion: 2.1 time: 0.155916 Oct 30 02:38:28.681204 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4097/7858] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:38:28 2022] GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:38:29.704610 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6f6f0ecb-8779-47d9-868b-ea96f66056be tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:38:29.705314 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6f6f0ecb-8779-47d9-868b-ea96f66056be tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bf3641be-e964-42c3-be66-cfc94b1aec35] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:38:29.712270 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f6f0ecb-8779-47d9-868b-ea96f66056be tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:38:29.712758 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f6f0ecb-8779-47d9-868b-ea96f66056be tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:38:29.713203 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f6f0ecb-8779-47d9-868b-ea96f66056be tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:38:29.713942 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f6f0ecb-8779-47d9-868b-ea96f66056be tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:38:29.714410 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f6f0ecb-8779-47d9-868b-ea96f66056be tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:38:29.714843 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6f6f0ecb-8779-47d9-868b-ea96f66056be tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:38:29.848316 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6f6f0ecb-8779-47d9-868b-ea96f66056be tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:38:29.856045 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6f6f0ecb-8779-47d9-868b-ea96f66056be tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35" status: 200 len: 1680 microversion: 2.1 time: 0.155974 Oct 30 02:38:29.856634 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3762/7859] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:38:29 2022] GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:38:30.879282 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-aaf00bb8-6251-4787-b3e4-3747ba3001e1 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:38:30.879876 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-aaf00bb8-6251-4787-b3e4-3747ba3001e1 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bf3641be-e964-42c3-be66-cfc94b1aec35] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:38:30.886836 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aaf00bb8-6251-4787-b3e4-3747ba3001e1 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:38:30.887325 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aaf00bb8-6251-4787-b3e4-3747ba3001e1 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:38:30.887770 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aaf00bb8-6251-4787-b3e4-3747ba3001e1 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:38:30.888468 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aaf00bb8-6251-4787-b3e4-3747ba3001e1 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:38:30.888931 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aaf00bb8-6251-4787-b3e4-3747ba3001e1 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:38:30.889385 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aaf00bb8-6251-4787-b3e4-3747ba3001e1 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:38:31.020148 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-aaf00bb8-6251-4787-b3e4-3747ba3001e1 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:38:31.027774 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-aaf00bb8-6251-4787-b3e4-3747ba3001e1 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35" status: 200 len: 1680 microversion: 2.1 time: 0.152580 Oct 30 02:38:31.028344 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4098/7860] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:38:30 2022] GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:38:32.051972 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e2cd2512-ff31-4079-b788-f7a4dab1eb8f tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:38:32.052589 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e2cd2512-ff31-4079-b788-f7a4dab1eb8f tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bf3641be-e964-42c3-be66-cfc94b1aec35] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:38:32.059473 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2cd2512-ff31-4079-b788-f7a4dab1eb8f tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:38:32.060030 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2cd2512-ff31-4079-b788-f7a4dab1eb8f tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:38:32.060497 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2cd2512-ff31-4079-b788-f7a4dab1eb8f tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:38:32.061194 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2cd2512-ff31-4079-b788-f7a4dab1eb8f tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:38:32.061689 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2cd2512-ff31-4079-b788-f7a4dab1eb8f tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:38:32.062125 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2cd2512-ff31-4079-b788-f7a4dab1eb8f tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:38:32.199533 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e2cd2512-ff31-4079-b788-f7a4dab1eb8f tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:38:32.207605 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e2cd2512-ff31-4079-b788-f7a4dab1eb8f tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35" status: 200 len: 1680 microversion: 2.1 time: 0.160060 Oct 30 02:38:32.208183 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3763/7861] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:38:32 2022] GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:38:33.230186 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7e152d2d-fda6-4fa3-9cb2-bc533aab1f51 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:38:33.230816 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7e152d2d-fda6-4fa3-9cb2-bc533aab1f51 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bf3641be-e964-42c3-be66-cfc94b1aec35] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:38:33.237818 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e152d2d-fda6-4fa3-9cb2-bc533aab1f51 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:38:33.238324 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e152d2d-fda6-4fa3-9cb2-bc533aab1f51 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:38:33.238775 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e152d2d-fda6-4fa3-9cb2-bc533aab1f51 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:38:33.239478 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e152d2d-fda6-4fa3-9cb2-bc533aab1f51 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:38:33.239946 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e152d2d-fda6-4fa3-9cb2-bc533aab1f51 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:38:33.240386 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e152d2d-fda6-4fa3-9cb2-bc533aab1f51 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:38:33.377208 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7e152d2d-fda6-4fa3-9cb2-bc533aab1f51 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:38:33.385390 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7e152d2d-fda6-4fa3-9cb2-bc533aab1f51 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35" status: 200 len: 1680 microversion: 2.1 time: 0.159112 Oct 30 02:38:33.385977 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4099/7862] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:38:33 2022] GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:38:34.410544 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2489af8f-f96c-45c4-95f6-a46ffa7006cf tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:38:34.411202 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2489af8f-f96c-45c4-95f6-a46ffa7006cf tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bf3641be-e964-42c3-be66-cfc94b1aec35] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:38:34.418194 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2489af8f-f96c-45c4-95f6-a46ffa7006cf tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:38:34.418697 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2489af8f-f96c-45c4-95f6-a46ffa7006cf tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:38:34.419137 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2489af8f-f96c-45c4-95f6-a46ffa7006cf tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:38:34.420108 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2489af8f-f96c-45c4-95f6-a46ffa7006cf tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:38:34.420569 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2489af8f-f96c-45c4-95f6-a46ffa7006cf tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:38:34.421009 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2489af8f-f96c-45c4-95f6-a46ffa7006cf tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:38:34.555085 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2489af8f-f96c-45c4-95f6-a46ffa7006cf tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:38:34.563456 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2489af8f-f96c-45c4-95f6-a46ffa7006cf tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35" status: 200 len: 1680 microversion: 2.1 time: 0.157856 Oct 30 02:38:34.564025 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3764/7863] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:38:34 2022] GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:38:35.587025 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fdac212e-458e-4ee2-97ba-c0bd445b7be6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:38:35.587647 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fdac212e-458e-4ee2-97ba-c0bd445b7be6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bf3641be-e964-42c3-be66-cfc94b1aec35] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:38:35.595107 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fdac212e-458e-4ee2-97ba-c0bd445b7be6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:38:35.595596 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fdac212e-458e-4ee2-97ba-c0bd445b7be6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:38:35.596036 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fdac212e-458e-4ee2-97ba-c0bd445b7be6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:38:35.596731 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fdac212e-458e-4ee2-97ba-c0bd445b7be6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:38:35.597192 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fdac212e-458e-4ee2-97ba-c0bd445b7be6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:38:35.597658 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fdac212e-458e-4ee2-97ba-c0bd445b7be6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:38:35.729973 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-fdac212e-458e-4ee2-97ba-c0bd445b7be6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:38:35.737734 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fdac212e-458e-4ee2-97ba-c0bd445b7be6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35" status: 200 len: 1680 microversion: 2.1 time: 0.154615 Oct 30 02:38:35.738305 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4100/7864] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:38:35 2022] GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:38:36.760049 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-079a44dc-1246-4411-8ebc-d64868ca79b3 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:38:36.760676 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-079a44dc-1246-4411-8ebc-d64868ca79b3 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bf3641be-e964-42c3-be66-cfc94b1aec35] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:38:36.767547 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-079a44dc-1246-4411-8ebc-d64868ca79b3 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:38:36.768028 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-079a44dc-1246-4411-8ebc-d64868ca79b3 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:38:36.768462 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-079a44dc-1246-4411-8ebc-d64868ca79b3 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:38:36.769147 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-079a44dc-1246-4411-8ebc-d64868ca79b3 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:38:36.769625 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-079a44dc-1246-4411-8ebc-d64868ca79b3 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:38:36.770044 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-079a44dc-1246-4411-8ebc-d64868ca79b3 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:38:36.901314 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-079a44dc-1246-4411-8ebc-d64868ca79b3 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:38:36.909768 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-079a44dc-1246-4411-8ebc-d64868ca79b3 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35" status: 200 len: 1683 microversion: 2.1 time: 0.153547 Oct 30 02:38:36.910349 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3765/7865] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:38:36 2022] GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:39:01.094238 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-24431ad5-6a76-4e43-991c-9f3ce9556444 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:39:01.096949 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-24431ad5-6a76-4e43-991c-9f3ce9556444 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bf3641be-e964-42c3-be66-cfc94b1aec35] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:39:01.099180 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=16 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:39:01.099862 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=52 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:39:01.104552 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24431ad5-6a76-4e43-991c-9f3ce9556444 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:39:01.105046 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24431ad5-6a76-4e43-991c-9f3ce9556444 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:39:01.105534 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24431ad5-6a76-4e43-991c-9f3ce9556444 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:39:01.106235 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24431ad5-6a76-4e43-991c-9f3ce9556444 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:39:01.106703 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24431ad5-6a76-4e43-991c-9f3ce9556444 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:39:01.107135 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24431ad5-6a76-4e43-991c-9f3ce9556444 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:39:01.176652 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-24431ad5-6a76-4e43-991c-9f3ce9556444 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "POST /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35/action" status: 200 len: 69272 microversion: 2.1 time: 0.086631 Oct 30 02:39:01.177316 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4101/7866] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 02:39:01 2022] POST /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35/action => generated 69272 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 02:39:08.541523 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d161724b-0017-4391-93e6-1ed7d1536a50 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:39:08.541523 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d161724b-0017-4391-93e6-1ed7d1536a50 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bf3641be-e964-42c3-be66-cfc94b1aec35] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:39:08.543003 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=18 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:39:08.544621 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:39:08.549773 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d161724b-0017-4391-93e6-1ed7d1536a50 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:39:08.550276 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d161724b-0017-4391-93e6-1ed7d1536a50 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:39:08.550989 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d161724b-0017-4391-93e6-1ed7d1536a50 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:39:08.551704 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d161724b-0017-4391-93e6-1ed7d1536a50 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:39:08.552481 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d161724b-0017-4391-93e6-1ed7d1536a50 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:39:08.552922 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d161724b-0017-4391-93e6-1ed7d1536a50 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:39:08.587585 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d161724b-0017-4391-93e6-1ed7d1536a50 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bf3641be-e964-42c3-be66-cfc94b1aec35] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 02:39:08.611707 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-c5314186-da2d-4453-8e15-2883216cd4a5 req-df972db9-aac1-4929-a986-04c836e38194 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf3641be-e964-42c3-be66-cfc94b1aec35", "tag": "dd75406d-26dd-4a3c-9412-9988b93f2905"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:39:08.624016 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-c5314186-da2d-4453-8e15-2883216cd4a5 req-df972db9-aac1-4929-a986-04c836e38194 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:39:08.624266 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-c5314186-da2d-4453-8e15-2883216cd4a5 req-df972db9-aac1-4929-a986-04c836e38194 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:39:08.624716 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-c5314186-da2d-4453-8e15-2883216cd4a5 req-df972db9-aac1-4929-a986-04c836e38194 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:39:08.635904 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-c5314186-da2d-4453-8e15-2883216cd4a5 req-df972db9-aac1-4929-a986-04c836e38194 service nova] Creating event network-changed:dd75406d-26dd-4a3c-9412-9988b93f2905 for instance bf3641be-e964-42c3-be66-cfc94b1aec35 on n-h2-master-1 Oct 30 02:39:08.641887 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-c5314186-da2d-4453-8e15-2883216cd4a5 req-df972db9-aac1-4929-a986-04c836e38194 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102391 Oct 30 02:39:08.642590 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4102/7867] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:39:08.869195 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d161724b-0017-4391-93e6-1ed7d1536a50 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "DELETE /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35" status: 204 len: 0 microversion: 2.1 time: 0.333569 Oct 30 02:39:08.869984 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3766/7868] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 02:39:08 2022] DELETE /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 02:39:08.879807 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-af799c62-e42f-4a6a-adde-2882fbf16c55 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:39:08.880521 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-af799c62-e42f-4a6a-adde-2882fbf16c55 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bf3641be-e964-42c3-be66-cfc94b1aec35] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:39:08.887478 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af799c62-e42f-4a6a-adde-2882fbf16c55 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:39:08.888608 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af799c62-e42f-4a6a-adde-2882fbf16c55 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:39:08.888608 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af799c62-e42f-4a6a-adde-2882fbf16c55 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:39:08.889269 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af799c62-e42f-4a6a-adde-2882fbf16c55 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:39:08.890201 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af799c62-e42f-4a6a-adde-2882fbf16c55 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:39:08.890646 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af799c62-e42f-4a6a-adde-2882fbf16c55 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:39:09.075186 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-af799c62-e42f-4a6a-adde-2882fbf16c55 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:39:09.083114 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-af799c62-e42f-4a6a-adde-2882fbf16c55 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35" status: 200 len: 1689 microversion: 2.1 time: 0.208493 Oct 30 02:39:09.084005 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4103/7869] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:39:08 2022] GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35 => generated 1689 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:39:10.107417 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b143f395-3d96-4208-a90e-60fd562d75d4 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:39:10.108123 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b143f395-3d96-4208-a90e-60fd562d75d4 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bf3641be-e964-42c3-be66-cfc94b1aec35] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:39:10.115082 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b143f395-3d96-4208-a90e-60fd562d75d4 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:39:10.115576 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b143f395-3d96-4208-a90e-60fd562d75d4 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:39:10.116017 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b143f395-3d96-4208-a90e-60fd562d75d4 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:39:10.116722 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b143f395-3d96-4208-a90e-60fd562d75d4 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:39:10.117180 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b143f395-3d96-4208-a90e-60fd562d75d4 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:39:10.117648 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b143f395-3d96-4208-a90e-60fd562d75d4 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:39:10.311722 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b143f395-3d96-4208-a90e-60fd562d75d4 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:39:10.321220 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b143f395-3d96-4208-a90e-60fd562d75d4 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35" status: 200 len: 1689 microversion: 2.1 time: 0.218076 Oct 30 02:39:10.321841 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3767/7870] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:39:10 2022] GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35 => generated 1689 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:39:11.016763 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-92845384-7f8c-4cae-a840-55a54d2969d4 req-1838de8f-2c3e-4457-9e68-f443848c2f89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf3641be-e964-42c3-be66-cfc94b1aec35", "name": "network-vif-deleted", "tag": "dd75406d-26dd-4a3c-9412-9988b93f2905"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:39:11.027067 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-92845384-7f8c-4cae-a840-55a54d2969d4 req-1838de8f-2c3e-4457-9e68-f443848c2f89 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:39:11.027557 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-92845384-7f8c-4cae-a840-55a54d2969d4 req-1838de8f-2c3e-4457-9e68-f443848c2f89 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:39:11.027996 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-92845384-7f8c-4cae-a840-55a54d2969d4 req-1838de8f-2c3e-4457-9e68-f443848c2f89 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:39:11.039710 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-92845384-7f8c-4cae-a840-55a54d2969d4 req-1838de8f-2c3e-4457-9e68-f443848c2f89 service nova] Creating event network-vif-deleted:dd75406d-26dd-4a3c-9412-9988b93f2905 for instance bf3641be-e964-42c3-be66-cfc94b1aec35 on n-h2-master-1 Oct 30 02:39:11.044877 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-92845384-7f8c-4cae-a840-55a54d2969d4 req-1838de8f-2c3e-4457-9e68-f443848c2f89 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032068 Oct 30 02:39:11.046177 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4104/7871] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:39:11.344792 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e7bad27e-b935-4891-a260-69652c3f0c56 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:39:11.345444 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e7bad27e-b935-4891-a260-69652c3f0c56 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bf3641be-e964-42c3-be66-cfc94b1aec35] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:39:11.353020 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7bad27e-b935-4891-a260-69652c3f0c56 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:39:11.353565 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7bad27e-b935-4891-a260-69652c3f0c56 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:39:11.354008 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7bad27e-b935-4891-a260-69652c3f0c56 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:39:11.354778 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7bad27e-b935-4891-a260-69652c3f0c56 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:39:11.355222 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7bad27e-b935-4891-a260-69652c3f0c56 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:39:11.355655 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7bad27e-b935-4891-a260-69652c3f0c56 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:39:11.390307 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7bad27e-b935-4891-a260-69652c3f0c56 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:39:11.391715 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7bad27e-b935-4891-a260-69652c3f0c56 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:39:11.392153 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7bad27e-b935-4891-a260-69652c3f0c56 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:39:11.392604 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-e7bad27e-b935-4891-a260-69652c3f0c56 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lazy-loading 'fault' on Instance uuid bf3641be-e964-42c3-be66-cfc94b1aec35 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 02:39:11.436760 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e7bad27e-b935-4891-a260-69652c3f0c56 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:39:11.445510 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e7bad27e-b935-4891-a260-69652c3f0c56 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35" status: 200 len: 1356 microversion: 2.1 time: 0.104786 Oct 30 02:39:11.446613 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3768/7872] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:39:11 2022] GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35 => generated 1356 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:39:12.470476 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6d8e98ca-12fd-406e-bb2d-6658a60d1b48 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:39:12.471184 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6d8e98ca-12fd-406e-bb2d-6658a60d1b48 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: bf3641be-e964-42c3-be66-cfc94b1aec35] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:39:12.478332 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d8e98ca-12fd-406e-bb2d-6658a60d1b48 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:39:12.478824 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d8e98ca-12fd-406e-bb2d-6658a60d1b48 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:39:12.479269 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d8e98ca-12fd-406e-bb2d-6658a60d1b48 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:39:12.479963 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d8e98ca-12fd-406e-bb2d-6658a60d1b48 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:39:12.480426 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d8e98ca-12fd-406e-bb2d-6658a60d1b48 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:39:12.480858 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d8e98ca-12fd-406e-bb2d-6658a60d1b48 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:39:12.494794 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-6d8e98ca-12fd-406e-bb2d-6658a60d1b48 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] HTTP exception thrown: Instance bf3641be-e964-42c3-be66-cfc94b1aec35 could not be found. Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6d8e98ca-12fd-406e-bb2d-6658a60d1b48 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Request method failure captured: Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35 HTTP/1.1 Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXeMhmBt07CnqlsQCCZQN6u-PC4AsgU8WequZ4Kud9tCoyqv8mAHQMcaho4Jbx4RzGkeSupfwjjjBU9nby25ZfrQmG3SvdDYuPUoYCpt4XAVTrkn_pjoiCb5AJLHMr5UnOHpTN2d7v4LRRKuXP0k9zso8ZvHlSuYjg8x6U3J73q4pZ0Q Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 4a813c90e3ec437fbf1f37dbb2b340d4 Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-521135141 Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a813c90e3ec437fbf1f37dbb2b340d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4a813c90e3ec437fbf1f37dbb2b340d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4a813c90e3ec437fbf1f37dbb2b340d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a813c90e3ec437fbf1f37dbb2b340d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-TestNetworkAdvancedServerOps-521135141 Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 4a813c90e3ec437fbf1f37dbb2b340d4 Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-521135141 Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-TestNetworkAdvancedServerOps-521135141-project Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: ef194f895a0c404abc08cad62a3b566d Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-TestNetworkAdvancedServerOps-521135141-project Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: exception: Instance bf3641be-e964-42c3-be66-cfc94b1aec35 could not be found. Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': 'bf3641be-e964-42c3-be66-cfc94b1aec35'} Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf3641be-e964-42c3-be66-cfc94b1aec35 could not be found. Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf3641be-e964-42c3-be66-cfc94b1aec35 could not be found. Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:39:12.496426 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:39:12.502640 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:39:12.502640 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:39:12.502640 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:39:12.502640 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:39:12.502640 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:39:12.502640 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:39:12.502640 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf3641be-e964-42c3-be66-cfc94b1aec35 could not be found. Oct 30 02:39:12.502640 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:39:12.502640 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6d8e98ca-12fd-406e-bb2d-6658a60d1b48 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Returning 404 to user: Instance bf3641be-e964-42c3-be66-cfc94b1aec35 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:39:12.502640 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6d8e98ca-12fd-406e-bb2d-6658a60d1b48 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35" status: 404 len: 111 microversion: 2.1 time: 0.031657 Oct 30 02:39:12.502640 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4105/7873] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:39:12 2022] GET /compute/v2.1/servers/bf3641be-e964-42c3-be66-cfc94b1aec35 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 02:39:16.165313 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bc696ac5-474d-49d3-80a0-1de9c4b06f54 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '.version_select at 0x7f44c6e1ef70>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:39:16.247007 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bc696ac5-474d-49d3-80a0-1de9c4b06f54 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-745954542" status: 202 len: 0 microversion: 2.1 time: 0.085604 Oct 30 02:39:16.247631 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3769/7874] 10.222.0.13 () {58 vars in 1281 bytes} [Sun Oct 30 02:39:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-745954542 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 02:39:16.276818 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6b860f29-01f1-4ac8-a96c-3590e4dc1faa tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Action: 'create', calling method: .version_select at 0x7f44cc258a60>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1420748158", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTJLtxuz0yVIIwke+OXPdSL0RtOmSTC+nPv4ot1qcBMGns6vvmXcwVgRMNao8sku2YtwSjCt1cEkolR5Fw+PZeIkboGQGAUNOan8gmD2Tc+9aM63HaRv+KjhS3CkMBmDw=="}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:39:16.283428 n-d-master-1 devstack@n-api.service[121102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 30 02:39:16.283570 n-d-master-1 devstack@n-api.service[121102]: Sun Oct 30 02:39:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.13) !!! Oct 30 02:39:16.299173 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-6b860f29-01f1-4ac8-a96c-3590e4dc1faa tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Getting quotas for project 4a813c90e3ec437fbf1f37dbb2b340d4. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 02:39:16.304949 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-6b860f29-01f1-4ac8-a96c-3590e4dc1faa tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Getting quotas for user ef194f895a0c404abc08cad62a3b566d and project 4a813c90e3ec437fbf1f37dbb2b340d4. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 02:39:16.389535 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6b860f29-01f1-4ac8-a96c-3590e4dc1faa tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.116599 Oct 30 02:39:16.390141 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4106/7875] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 30 02:39:16 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:39:24.597293 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:39:24.603415 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9faa3795-abc0-4de4-8dfa-eefdb0ae9d28 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-965546121", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "1c04dbed-94de-4b00-b834-583598b8c386"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1420748158", "security_groups": [{"name": "tempest-secgroup-smoke-1781706873"}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:39:24.718105 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-9faa3795-abc0-4de4-8dfa-eefdb0ae9d28 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] validate_networks() for [('1c04dbed-94de-4b00-b834-583598b8c386', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 02:39:25.120892 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-9faa3795-abc0-4de4-8dfa-eefdb0ae9d28 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 02:39:25.121889 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-9faa3795-abc0-4de4-8dfa-eefdb0ae9d28 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 02:39:25.122607 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-9faa3795-abc0-4de4-8dfa-eefdb0ae9d28 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 02:39:25.123270 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-9faa3795-abc0-4de4-8dfa-eefdb0ae9d28 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 02:39:25.123930 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-9faa3795-abc0-4de4-8dfa-eefdb0ae9d28 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 02:39:25.135579 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9faa3795-abc0-4de4-8dfa-eefdb0ae9d28 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:39:25.136336 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9faa3795-abc0-4de4-8dfa-eefdb0ae9d28 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:39:25.136784 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9faa3795-abc0-4de4-8dfa-eefdb0ae9d28 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:39:25.137739 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9faa3795-abc0-4de4-8dfa-eefdb0ae9d28 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:39:25.138404 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9faa3795-abc0-4de4-8dfa-eefdb0ae9d28 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:39:25.138841 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9faa3795-abc0-4de4-8dfa-eefdb0ae9d28 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:39:25.159960 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-9faa3795-abc0-4de4-8dfa-eefdb0ae9d28 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Getting quotas for project 4a813c90e3ec437fbf1f37dbb2b340d4. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 02:39:25.165755 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-9faa3795-abc0-4de4-8dfa-eefdb0ae9d28 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Getting quotas for user ef194f895a0c404abc08cad62a3b566d and project 4a813c90e3ec437fbf1f37dbb2b340d4. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 02:39:25.180916 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9faa3795-abc0-4de4-8dfa-eefdb0ae9d28 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 02:39:25.183808 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9faa3795-abc0-4de4-8dfa-eefdb0ae9d28 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: c00652b0-2f49-4142-80d1-a0f3de233ab1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 02:39:25.320939 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9faa3795-abc0-4de4-8dfa-eefdb0ae9d28 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.726466 Oct 30 02:39:25.321944 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3770/7876] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 02:39:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 02:39:25.332146 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=16 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:39:25.338154 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6efea9f2-111e-4ea9-8729-abd634b61dab tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:39:25.341352 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6efea9f2-111e-4ea9-8729-abd634b61dab tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: c00652b0-2f49-4142-80d1-a0f3de233ab1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:39:25.427019 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6efea9f2-111e-4ea9-8729-abd634b61dab tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:39:25.435820 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6efea9f2-111e-4ea9-8729-abd634b61dab tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1" status: 200 len: 1266 microversion: 2.1 time: 0.105911 Oct 30 02:39:25.437356 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4107/7877] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:39:25 2022] GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1 => generated 1266 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:39:26.461129 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c0d67957-3165-42c1-a9cd-b9d67199b9e6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:39:26.461757 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c0d67957-3165-42c1-a9cd-b9d67199b9e6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: c00652b0-2f49-4142-80d1-a0f3de233ab1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:39:26.468397 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0d67957-3165-42c1-a9cd-b9d67199b9e6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:39:26.468879 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0d67957-3165-42c1-a9cd-b9d67199b9e6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:39:26.469349 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0d67957-3165-42c1-a9cd-b9d67199b9e6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:39:26.470518 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0d67957-3165-42c1-a9cd-b9d67199b9e6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:39:26.471015 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0d67957-3165-42c1-a9cd-b9d67199b9e6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:39:26.471440 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0d67957-3165-42c1-a9cd-b9d67199b9e6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:39:26.551215 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c0d67957-3165-42c1-a9cd-b9d67199b9e6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:39:26.559217 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c0d67957-3165-42c1-a9cd-b9d67199b9e6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1" status: 200 len: 1270 microversion: 2.1 time: 0.102983 Oct 30 02:39:26.559948 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3771/7878] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:39:26 2022] GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1 => generated 1270 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:39:27.582738 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e16b0146-6b6c-4235-bc12-98dd8bd7f1bc tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:39:27.583685 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e16b0146-6b6c-4235-bc12-98dd8bd7f1bc tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: c00652b0-2f49-4142-80d1-a0f3de233ab1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:39:27.594548 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e16b0146-6b6c-4235-bc12-98dd8bd7f1bc tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:39:27.595316 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e16b0146-6b6c-4235-bc12-98dd8bd7f1bc tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:39:27.595838 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e16b0146-6b6c-4235-bc12-98dd8bd7f1bc tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:39:27.596639 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e16b0146-6b6c-4235-bc12-98dd8bd7f1bc tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:39:27.597181 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e16b0146-6b6c-4235-bc12-98dd8bd7f1bc tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:39:27.597835 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e16b0146-6b6c-4235-bc12-98dd8bd7f1bc tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:39:27.674883 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e16b0146-6b6c-4235-bc12-98dd8bd7f1bc tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:39:27.683066 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e16b0146-6b6c-4235-bc12-98dd8bd7f1bc tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1" status: 200 len: 1326 microversion: 2.1 time: 0.104400 Oct 30 02:39:27.683763 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4108/7879] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:39:27 2022] GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1 => generated 1326 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:39:28.708461 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2f10e4b8-f6ff-48b5-9262-4af28654547d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:39:28.709227 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2f10e4b8-f6ff-48b5-9262-4af28654547d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: c00652b0-2f49-4142-80d1-a0f3de233ab1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:39:28.716202 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f10e4b8-f6ff-48b5-9262-4af28654547d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:39:28.716699 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f10e4b8-f6ff-48b5-9262-4af28654547d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:39:28.717172 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f10e4b8-f6ff-48b5-9262-4af28654547d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:39:28.717915 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f10e4b8-f6ff-48b5-9262-4af28654547d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:39:28.718377 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f10e4b8-f6ff-48b5-9262-4af28654547d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:39:28.718810 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f10e4b8-f6ff-48b5-9262-4af28654547d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:39:28.848751 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2f10e4b8-f6ff-48b5-9262-4af28654547d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:39:28.856773 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2f10e4b8-f6ff-48b5-9262-4af28654547d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1" status: 200 len: 1392 microversion: 2.1 time: 0.152897 Oct 30 02:39:28.857370 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3772/7880] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:39:28 2022] GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1 => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:39:29.208740 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-5b923406-bf26-42b4-8e4d-54e4f6e4266b req-877487c0-94f1-45f6-bb2f-9cf60545a1ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c00652b0-2f49-4142-80d1-a0f3de233ab1", "tag": "f4a5cb78-c769-4929-8db0-03162c320ed3"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:39:29.219347 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-5b923406-bf26-42b4-8e4d-54e4f6e4266b req-877487c0-94f1-45f6-bb2f-9cf60545a1ee service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:39:29.220270 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-5b923406-bf26-42b4-8e4d-54e4f6e4266b req-877487c0-94f1-45f6-bb2f-9cf60545a1ee service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:39:29.220716 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-5b923406-bf26-42b4-8e4d-54e4f6e4266b req-877487c0-94f1-45f6-bb2f-9cf60545a1ee service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:39:29.232480 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-5b923406-bf26-42b4-8e4d-54e4f6e4266b req-877487c0-94f1-45f6-bb2f-9cf60545a1ee service nova] Creating event network-changed:f4a5cb78-c769-4929-8db0-03162c320ed3 for instance c00652b0-2f49-4142-80d1-a0f3de233ab1 on n-h2-master-1 Oct 30 02:39:29.238388 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-5b923406-bf26-42b4-8e4d-54e4f6e4266b req-877487c0-94f1-45f6-bb2f-9cf60545a1ee service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034445 Oct 30 02:39:29.238997 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4109/7881] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:39:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:39:29.880084 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-654824df-79ca-4700-8b5b-478adb41e063 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:39:29.881283 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-654824df-79ca-4700-8b5b-478adb41e063 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: c00652b0-2f49-4142-80d1-a0f3de233ab1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:39:29.888550 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-654824df-79ca-4700-8b5b-478adb41e063 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:39:29.889042 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-654824df-79ca-4700-8b5b-478adb41e063 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:39:29.889534 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-654824df-79ca-4700-8b5b-478adb41e063 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:39:29.890251 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-654824df-79ca-4700-8b5b-478adb41e063 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:39:29.890714 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-654824df-79ca-4700-8b5b-478adb41e063 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:39:29.891148 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-654824df-79ca-4700-8b5b-478adb41e063 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:39:30.032311 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-654824df-79ca-4700-8b5b-478adb41e063 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:39:30.040205 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-654824df-79ca-4700-8b5b-478adb41e063 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1" status: 200 len: 1392 microversion: 2.1 time: 0.164002 Oct 30 02:39:30.040777 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3773/7882] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:39:29 2022] GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1 => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:39:31.064926 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-690fd18e-4563-437b-8d2b-ca0de4986e87 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:39:31.065704 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-690fd18e-4563-437b-8d2b-ca0de4986e87 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: c00652b0-2f49-4142-80d1-a0f3de233ab1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:39:31.071986 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-690fd18e-4563-437b-8d2b-ca0de4986e87 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:39:31.072481 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-690fd18e-4563-437b-8d2b-ca0de4986e87 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:39:31.072928 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-690fd18e-4563-437b-8d2b-ca0de4986e87 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:39:31.073665 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-690fd18e-4563-437b-8d2b-ca0de4986e87 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:39:31.074132 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-690fd18e-4563-437b-8d2b-ca0de4986e87 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:39:31.074585 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-690fd18e-4563-437b-8d2b-ca0de4986e87 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:39:31.205050 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-690fd18e-4563-437b-8d2b-ca0de4986e87 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:39:31.212777 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-690fd18e-4563-437b-8d2b-ca0de4986e87 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1" status: 200 len: 1392 microversion: 2.1 time: 0.153003 Oct 30 02:39:31.213357 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4110/7883] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:39:31 2022] GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1 => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:39:32.236349 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d970ce54-096a-4e05-93ad-b197803db9cd tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:39:32.236906 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d970ce54-096a-4e05-93ad-b197803db9cd tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: c00652b0-2f49-4142-80d1-a0f3de233ab1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:39:32.243748 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d970ce54-096a-4e05-93ad-b197803db9cd tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:39:32.244235 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d970ce54-096a-4e05-93ad-b197803db9cd tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:39:32.244674 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d970ce54-096a-4e05-93ad-b197803db9cd tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:39:32.245389 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d970ce54-096a-4e05-93ad-b197803db9cd tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:39:32.245846 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d970ce54-096a-4e05-93ad-b197803db9cd tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:39:32.246274 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d970ce54-096a-4e05-93ad-b197803db9cd tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:39:32.379630 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d970ce54-096a-4e05-93ad-b197803db9cd tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:39:32.387278 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d970ce54-096a-4e05-93ad-b197803db9cd tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1" status: 200 len: 1392 microversion: 2.1 time: 0.155023 Oct 30 02:39:32.388073 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3774/7884] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:39:32 2022] GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:39:33.412884 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0bc1fbf4-ccd9-42c4-a1e9-36bafb4b4597 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:39:33.413649 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0bc1fbf4-ccd9-42c4-a1e9-36bafb4b4597 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: c00652b0-2f49-4142-80d1-a0f3de233ab1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:39:33.416482 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:39:33.421710 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0bc1fbf4-ccd9-42c4-a1e9-36bafb4b4597 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:39:33.422219 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0bc1fbf4-ccd9-42c4-a1e9-36bafb4b4597 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:39:33.422673 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0bc1fbf4-ccd9-42c4-a1e9-36bafb4b4597 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:39:33.423468 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0bc1fbf4-ccd9-42c4-a1e9-36bafb4b4597 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:39:33.423944 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0bc1fbf4-ccd9-42c4-a1e9-36bafb4b4597 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:39:33.424390 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0bc1fbf4-ccd9-42c4-a1e9-36bafb4b4597 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:39:33.553816 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0bc1fbf4-ccd9-42c4-a1e9-36bafb4b4597 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:39:33.561562 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0bc1fbf4-ccd9-42c4-a1e9-36bafb4b4597 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1" status: 200 len: 1392 microversion: 2.1 time: 0.154649 Oct 30 02:39:33.562145 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4111/7885] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:39:33 2022] GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:39:34.584900 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6d89cff0-6fe8-463e-8852-f82f91d81368 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:39:34.586484 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6d89cff0-6fe8-463e-8852-f82f91d81368 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: c00652b0-2f49-4142-80d1-a0f3de233ab1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:39:34.592683 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d89cff0-6fe8-463e-8852-f82f91d81368 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:39:34.593197 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d89cff0-6fe8-463e-8852-f82f91d81368 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:39:34.593680 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d89cff0-6fe8-463e-8852-f82f91d81368 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:39:34.594396 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d89cff0-6fe8-463e-8852-f82f91d81368 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:39:34.595356 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d89cff0-6fe8-463e-8852-f82f91d81368 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:39:34.595842 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d89cff0-6fe8-463e-8852-f82f91d81368 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:39:34.613908 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-05e28353-2fb1-41dc-b449-aca7883a8fb3 req-d27e6b0e-87ec-417e-b618-461caaa17d27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c00652b0-2f49-4142-80d1-a0f3de233ab1", "name": "network-vif-plugged", "status": "completed", "tag": "f4a5cb78-c769-4929-8db0-03162c320ed3"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:39:34.623399 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-05e28353-2fb1-41dc-b449-aca7883a8fb3 req-d27e6b0e-87ec-417e-b618-461caaa17d27 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:39:34.623881 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-05e28353-2fb1-41dc-b449-aca7883a8fb3 req-d27e6b0e-87ec-417e-b618-461caaa17d27 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:39:34.624316 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-05e28353-2fb1-41dc-b449-aca7883a8fb3 req-d27e6b0e-87ec-417e-b618-461caaa17d27 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:39:34.636373 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-05e28353-2fb1-41dc-b449-aca7883a8fb3 req-d27e6b0e-87ec-417e-b618-461caaa17d27 service nova] Creating event network-vif-plugged:f4a5cb78-c769-4929-8db0-03162c320ed3 for instance c00652b0-2f49-4142-80d1-a0f3de233ab1 on n-h2-master-1 Oct 30 02:39:34.641894 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-05e28353-2fb1-41dc-b449-aca7883a8fb3 req-d27e6b0e-87ec-417e-b618-461caaa17d27 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086711 Oct 30 02:39:34.642781 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3775/7886] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:39:34.748903 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6d89cff0-6fe8-463e-8852-f82f91d81368 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:39:34.756927 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6d89cff0-6fe8-463e-8852-f82f91d81368 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1" status: 200 len: 1392 microversion: 2.1 time: 0.176562 Oct 30 02:39:34.760803 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4112/7887] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:39:34 2022] GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1 => generated 1392 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:39:35.776684 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:39:35.777555 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=6 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:39:35.782495 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4aee2f96-a756-494e-8a06-16210bd317ac tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:39:35.783227 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4aee2f96-a756-494e-8a06-16210bd317ac tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: c00652b0-2f49-4142-80d1-a0f3de233ab1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:39:35.789380 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4aee2f96-a756-494e-8a06-16210bd317ac tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:39:35.789874 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4aee2f96-a756-494e-8a06-16210bd317ac tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:39:35.790320 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4aee2f96-a756-494e-8a06-16210bd317ac tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:39:35.791019 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4aee2f96-a756-494e-8a06-16210bd317ac tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:39:35.791524 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4aee2f96-a756-494e-8a06-16210bd317ac tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:39:35.791967 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4aee2f96-a756-494e-8a06-16210bd317ac tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:39:35.931283 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4aee2f96-a756-494e-8a06-16210bd317ac tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:39:35.939528 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4aee2f96-a756-494e-8a06-16210bd317ac tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1" status: 200 len: 1392 microversion: 2.1 time: 0.163883 Oct 30 02:39:35.942681 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3776/7888] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:39:35 2022] GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1 => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:39:36.962364 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-974d64af-2f14-41ce-a6c4-af36a64f223b tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:39:36.963025 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-974d64af-2f14-41ce-a6c4-af36a64f223b tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: c00652b0-2f49-4142-80d1-a0f3de233ab1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:39:36.965009 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=6 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:39:36.970770 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-974d64af-2f14-41ce-a6c4-af36a64f223b tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:39:36.971269 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-974d64af-2f14-41ce-a6c4-af36a64f223b tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:39:36.971722 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-974d64af-2f14-41ce-a6c4-af36a64f223b tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:39:36.972429 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-974d64af-2f14-41ce-a6c4-af36a64f223b tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:39:36.972900 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-974d64af-2f14-41ce-a6c4-af36a64f223b tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:39:36.973361 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-974d64af-2f14-41ce-a6c4-af36a64f223b tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:39:37.106260 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-974d64af-2f14-41ce-a6c4-af36a64f223b tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:39:37.114503 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-974d64af-2f14-41ce-a6c4-af36a64f223b tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1" status: 200 len: 1564 microversion: 2.1 time: 0.156054 Oct 30 02:39:37.115071 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4113/7889] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:39:36 2022] GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1 => generated 1564 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:39:37.136918 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-783d4dc3-ac58-43b4-8857-a00a0a62bacd tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:39:37.137566 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-783d4dc3-ac58-43b4-8857-a00a0a62bacd tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: c00652b0-2f49-4142-80d1-a0f3de233ab1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:39:37.144808 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-783d4dc3-ac58-43b4-8857-a00a0a62bacd tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:39:37.145296 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-783d4dc3-ac58-43b4-8857-a00a0a62bacd tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:39:37.145762 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-783d4dc3-ac58-43b4-8857-a00a0a62bacd tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:39:37.146506 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-783d4dc3-ac58-43b4-8857-a00a0a62bacd tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:39:37.146912 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-783d4dc3-ac58-43b4-8857-a00a0a62bacd tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:39:37.147336 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-783d4dc3-ac58-43b4-8857-a00a0a62bacd tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:39:37.276825 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-783d4dc3-ac58-43b4-8857-a00a0a62bacd tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:39:37.284663 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-783d4dc3-ac58-43b4-8857-a00a0a62bacd tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1" status: 200 len: 1564 microversion: 2.1 time: 0.151748 Oct 30 02:39:37.288983 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3777/7890] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:39:37 2022] GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1 => generated 1564 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:39:39.189961 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-db9881a6-6da3-49af-9d26-437732ed6630 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:39:39.190604 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-db9881a6-6da3-49af-9d26-437732ed6630 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: c00652b0-2f49-4142-80d1-a0f3de233ab1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:39:39.198105 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-db9881a6-6da3-49af-9d26-437732ed6630 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:39:39.199105 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-db9881a6-6da3-49af-9d26-437732ed6630 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:39:39.199657 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-db9881a6-6da3-49af-9d26-437732ed6630 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:39:39.199852 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-f9aa6070-f0b8-4689-a371-d84d62c1e80f req-204556cc-b51d-4e3e-84ac-57b1428b4dda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c00652b0-2f49-4142-80d1-a0f3de233ab1", "tag": "f4a5cb78-c769-4929-8db0-03162c320ed3"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:39:39.200559 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-db9881a6-6da3-49af-9d26-437732ed6630 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:39:39.201117 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-db9881a6-6da3-49af-9d26-437732ed6630 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:39:39.201707 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-db9881a6-6da3-49af-9d26-437732ed6630 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:39:39.206397 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:39:39.212174 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-f9aa6070-f0b8-4689-a371-d84d62c1e80f req-204556cc-b51d-4e3e-84ac-57b1428b4dda service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:39:39.213014 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-f9aa6070-f0b8-4689-a371-d84d62c1e80f req-204556cc-b51d-4e3e-84ac-57b1428b4dda service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:39:39.218474 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-f9aa6070-f0b8-4689-a371-d84d62c1e80f req-204556cc-b51d-4e3e-84ac-57b1428b4dda service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:39:39.229873 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-f9aa6070-f0b8-4689-a371-d84d62c1e80f req-204556cc-b51d-4e3e-84ac-57b1428b4dda service nova] Creating event network-changed:f4a5cb78-c769-4929-8db0-03162c320ed3 for instance c00652b0-2f49-4142-80d1-a0f3de233ab1 on n-h2-master-1 Oct 30 02:39:39.236734 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-f9aa6070-f0b8-4689-a371-d84d62c1e80f req-204556cc-b51d-4e3e-84ac-57b1428b4dda service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041100 Oct 30 02:39:39.237401 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3778/7891] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:39:39.400949 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-db9881a6-6da3-49af-9d26-437732ed6630 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:39:39.409460 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-db9881a6-6da3-49af-9d26-437732ed6630 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1" status: 200 len: 1564 microversion: 2.1 time: 0.223516 Oct 30 02:39:39.412514 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4114/7892] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:39:39 2022] GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1 => generated 1564 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:40:00.655614 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=42 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:40:00.660549 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-60012046-c783-4601-99c4-0f4ab55351fb tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:40:00.662852 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-60012046-c783-4601-99c4-0f4ab55351fb tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: c00652b0-2f49-4142-80d1-a0f3de233ab1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:40:00.669050 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-60012046-c783-4601-99c4-0f4ab55351fb tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:00.669569 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-60012046-c783-4601-99c4-0f4ab55351fb tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:00.670010 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-60012046-c783-4601-99c4-0f4ab55351fb tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:00.670703 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-60012046-c783-4601-99c4-0f4ab55351fb tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:00.671158 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-60012046-c783-4601-99c4-0f4ab55351fb tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:00.671589 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-60012046-c783-4601-99c4-0f4ab55351fb tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:00.739018 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-60012046-c783-4601-99c4-0f4ab55351fb tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "POST /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1/action" status: 200 len: 24571 microversion: 2.1 time: 0.085496 Oct 30 02:40:00.739868 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3779/7893] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 02:40:00 2022] POST /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1/action => generated 24571 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 02:40:07.130093 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-24fa7a47-a6c3-4f83-8c50-c2dcea689351 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:40:07.132337 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-24fa7a47-a6c3-4f83-8c50-c2dcea689351 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: c00652b0-2f49-4142-80d1-a0f3de233ab1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:40:07.134683 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=7 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:40:07.135358 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=38 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:40:07.140036 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24fa7a47-a6c3-4f83-8c50-c2dcea689351 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:07.140525 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24fa7a47-a6c3-4f83-8c50-c2dcea689351 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:07.140969 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24fa7a47-a6c3-4f83-8c50-c2dcea689351 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:07.142334 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24fa7a47-a6c3-4f83-8c50-c2dcea689351 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:07.142800 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24fa7a47-a6c3-4f83-8c50-c2dcea689351 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:07.143235 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24fa7a47-a6c3-4f83-8c50-c2dcea689351 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:07.224629 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-24fa7a47-a6c3-4f83-8c50-c2dcea689351 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:40:07.230764 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-24fa7a47-a6c3-4f83-8c50-c2dcea689351 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: c00652b0-2f49-4142-80d1-a0f3de233ab1] Old instance type m1.heat2, new instance type m1.heat {{(pid=121102) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 30 02:40:07.237324 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-24fa7a47-a6c3-4f83-8c50-c2dcea689351 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 02:40:07.237779 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-24fa7a47-a6c3-4f83-8c50-c2dcea689351 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 02:40:07.238263 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-24fa7a47-a6c3-4f83-8c50-c2dcea689351 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 02:40:07.238680 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-24fa7a47-a6c3-4f83-8c50-c2dcea689351 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 02:40:07.239099 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-24fa7a47-a6c3-4f83-8c50-c2dcea689351 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 02:40:07.450269 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-24fa7a47-a6c3-4f83-8c50-c2dcea689351 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "POST /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1/action" status: 202 len: 0 microversion: 2.1 time: 0.324671 Oct 30 02:40:07.450929 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4115/7894] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 02:40:07 2022] POST /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1/action => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 02:40:07.460881 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0cf949cf-f3ee-4447-9514-716464bc1f92 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:40:07.462356 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0cf949cf-f3ee-4447-9514-716464bc1f92 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: c00652b0-2f49-4142-80d1-a0f3de233ab1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:40:07.470915 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0cf949cf-f3ee-4447-9514-716464bc1f92 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:07.474278 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0cf949cf-f3ee-4447-9514-716464bc1f92 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:07.474278 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0cf949cf-f3ee-4447-9514-716464bc1f92 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:07.474278 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0cf949cf-f3ee-4447-9514-716464bc1f92 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:07.474278 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0cf949cf-f3ee-4447-9514-716464bc1f92 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:07.474278 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0cf949cf-f3ee-4447-9514-716464bc1f92 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:07.607808 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0cf949cf-f3ee-4447-9514-716464bc1f92 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:40:07.616123 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0cf949cf-f3ee-4447-9514-716464bc1f92 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1" status: 200 len: 1692 microversion: 2.1 time: 0.160148 Oct 30 02:40:07.616683 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3780/7895] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:40:07 2022] GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1 => generated 1692 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:40:08.640920 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7e62f4c1-2205-416c-b37f-8f300f4e793c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:40:08.641521 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7e62f4c1-2205-416c-b37f-8f300f4e793c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: c00652b0-2f49-4142-80d1-a0f3de233ab1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:40:08.649058 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e62f4c1-2205-416c-b37f-8f300f4e793c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:08.649580 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e62f4c1-2205-416c-b37f-8f300f4e793c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:08.650039 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e62f4c1-2205-416c-b37f-8f300f4e793c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:08.650716 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e62f4c1-2205-416c-b37f-8f300f4e793c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:08.651178 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e62f4c1-2205-416c-b37f-8f300f4e793c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:08.651611 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e62f4c1-2205-416c-b37f-8f300f4e793c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:08.782835 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7e62f4c1-2205-416c-b37f-8f300f4e793c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:40:08.790567 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7e62f4c1-2205-416c-b37f-8f300f4e793c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1" status: 200 len: 1692 microversion: 2.1 time: 0.154906 Oct 30 02:40:08.791132 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4116/7896] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:40:08 2022] GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1 => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:40:09.813489 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f4646239-582a-4ddf-90d5-668651a1be67 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:40:09.814023 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f4646239-582a-4ddf-90d5-668651a1be67 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: c00652b0-2f49-4142-80d1-a0f3de233ab1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:40:09.820775 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f4646239-582a-4ddf-90d5-668651a1be67 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:09.821263 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f4646239-582a-4ddf-90d5-668651a1be67 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:09.821734 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f4646239-582a-4ddf-90d5-668651a1be67 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:09.822435 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f4646239-582a-4ddf-90d5-668651a1be67 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:09.822927 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f4646239-582a-4ddf-90d5-668651a1be67 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:09.823359 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f4646239-582a-4ddf-90d5-668651a1be67 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:09.956754 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f4646239-582a-4ddf-90d5-668651a1be67 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:40:09.964556 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f4646239-582a-4ddf-90d5-668651a1be67 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1" status: 200 len: 1692 microversion: 2.1 time: 0.155526 Oct 30 02:40:09.965129 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3781/7897] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:40:09 2022] GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1 => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:40:10.988721 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cada9c4e-8497-4a3d-8382-c84b7227cf31 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:40:10.989396 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cada9c4e-8497-4a3d-8382-c84b7227cf31 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: c00652b0-2f49-4142-80d1-a0f3de233ab1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:40:10.997383 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cada9c4e-8497-4a3d-8382-c84b7227cf31 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:10.997890 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cada9c4e-8497-4a3d-8382-c84b7227cf31 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:10.998344 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cada9c4e-8497-4a3d-8382-c84b7227cf31 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:10.999057 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cada9c4e-8497-4a3d-8382-c84b7227cf31 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:10.999529 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cada9c4e-8497-4a3d-8382-c84b7227cf31 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:10.999966 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cada9c4e-8497-4a3d-8382-c84b7227cf31 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:11.132031 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-cada9c4e-8497-4a3d-8382-c84b7227cf31 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:40:11.139771 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cada9c4e-8497-4a3d-8382-c84b7227cf31 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1" status: 200 len: 1692 microversion: 2.1 time: 0.155604 Oct 30 02:40:11.140340 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4117/7898] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:40:10 2022] GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1 => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:40:12.162311 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2879aa31-3e28-4b3d-aa77-a465d6bd300c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:40:12.162929 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2879aa31-3e28-4b3d-aa77-a465d6bd300c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: c00652b0-2f49-4142-80d1-a0f3de233ab1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:40:12.170315 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2879aa31-3e28-4b3d-aa77-a465d6bd300c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:12.170801 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2879aa31-3e28-4b3d-aa77-a465d6bd300c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:12.171233 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2879aa31-3e28-4b3d-aa77-a465d6bd300c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:12.171954 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2879aa31-3e28-4b3d-aa77-a465d6bd300c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:12.172437 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2879aa31-3e28-4b3d-aa77-a465d6bd300c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:12.173391 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2879aa31-3e28-4b3d-aa77-a465d6bd300c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:12.301667 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2879aa31-3e28-4b3d-aa77-a465d6bd300c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:40:12.309380 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2879aa31-3e28-4b3d-aa77-a465d6bd300c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1" status: 200 len: 1692 microversion: 2.1 time: 0.151046 Oct 30 02:40:12.309984 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3782/7899] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:40:12 2022] GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1 => generated 1692 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:40:13.333353 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b7a10ac5-b949-47ce-982e-0498c929e2a6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:40:13.334137 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b7a10ac5-b949-47ce-982e-0498c929e2a6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: c00652b0-2f49-4142-80d1-a0f3de233ab1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:40:13.340869 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b7a10ac5-b949-47ce-982e-0498c929e2a6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:13.341392 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b7a10ac5-b949-47ce-982e-0498c929e2a6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:13.341844 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b7a10ac5-b949-47ce-982e-0498c929e2a6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:13.342547 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b7a10ac5-b949-47ce-982e-0498c929e2a6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:13.343450 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b7a10ac5-b949-47ce-982e-0498c929e2a6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:13.343960 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b7a10ac5-b949-47ce-982e-0498c929e2a6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:13.481630 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b7a10ac5-b949-47ce-982e-0498c929e2a6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:40:13.490048 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b7a10ac5-b949-47ce-982e-0498c929e2a6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1" status: 200 len: 1692 microversion: 2.1 time: 0.160739 Oct 30 02:40:13.490632 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4118/7900] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:40:13 2022] GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1 => generated 1692 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:40:14.513415 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-537a7880-cd82-4f3d-8baa-8222900a2075 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:40:14.514037 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-537a7880-cd82-4f3d-8baa-8222900a2075 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: c00652b0-2f49-4142-80d1-a0f3de233ab1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:40:14.521528 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-537a7880-cd82-4f3d-8baa-8222900a2075 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:14.522012 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-537a7880-cd82-4f3d-8baa-8222900a2075 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:14.522447 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-537a7880-cd82-4f3d-8baa-8222900a2075 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:14.523413 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-537a7880-cd82-4f3d-8baa-8222900a2075 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:14.523875 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-537a7880-cd82-4f3d-8baa-8222900a2075 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:14.524299 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-537a7880-cd82-4f3d-8baa-8222900a2075 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:14.661158 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-537a7880-cd82-4f3d-8baa-8222900a2075 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:40:14.669551 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-537a7880-cd82-4f3d-8baa-8222900a2075 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1" status: 200 len: 1692 microversion: 2.1 time: 0.160069 Oct 30 02:40:14.670055 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3783/7901] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:40:14 2022] GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1 => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:40:15.693823 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8530df8e-be44-4c43-aad8-7d630e5ac899 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:40:15.694477 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8530df8e-be44-4c43-aad8-7d630e5ac899 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: c00652b0-2f49-4142-80d1-a0f3de233ab1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:40:15.701502 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8530df8e-be44-4c43-aad8-7d630e5ac899 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:15.702008 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8530df8e-be44-4c43-aad8-7d630e5ac899 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:15.702469 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8530df8e-be44-4c43-aad8-7d630e5ac899 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:15.703183 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8530df8e-be44-4c43-aad8-7d630e5ac899 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:15.703658 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8530df8e-be44-4c43-aad8-7d630e5ac899 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:15.704747 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8530df8e-be44-4c43-aad8-7d630e5ac899 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:15.834462 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8530df8e-be44-4c43-aad8-7d630e5ac899 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:40:15.842177 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8530df8e-be44-4c43-aad8-7d630e5ac899 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1" status: 200 len: 1697 microversion: 2.1 time: 0.152413 Oct 30 02:40:15.842754 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4119/7902] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:40:15 2022] GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1 => generated 1697 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:40:16.866037 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b01125e0-ad69-4263-aee5-fb59b634b251 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:40:16.866639 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b01125e0-ad69-4263-aee5-fb59b634b251 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: c00652b0-2f49-4142-80d1-a0f3de233ab1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:40:16.873524 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b01125e0-ad69-4263-aee5-fb59b634b251 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:16.874017 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b01125e0-ad69-4263-aee5-fb59b634b251 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:16.874458 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b01125e0-ad69-4263-aee5-fb59b634b251 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:16.875192 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b01125e0-ad69-4263-aee5-fb59b634b251 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:16.875650 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b01125e0-ad69-4263-aee5-fb59b634b251 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:16.876083 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b01125e0-ad69-4263-aee5-fb59b634b251 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:17.008676 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b01125e0-ad69-4263-aee5-fb59b634b251 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:40:17.016681 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b01125e0-ad69-4263-aee5-fb59b634b251 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1" status: 200 len: 1697 microversion: 2.1 time: 0.154591 Oct 30 02:40:17.017252 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3784/7903] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:40:16 2022] GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1 => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:40:18.039564 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-69f27463-69a9-4754-8740-545bde3219df tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:40:18.040195 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-69f27463-69a9-4754-8740-545bde3219df tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: c00652b0-2f49-4142-80d1-a0f3de233ab1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:40:18.047440 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-69f27463-69a9-4754-8740-545bde3219df tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:18.047934 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-69f27463-69a9-4754-8740-545bde3219df tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:18.048389 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-69f27463-69a9-4754-8740-545bde3219df tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:18.049089 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-69f27463-69a9-4754-8740-545bde3219df tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:18.049584 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-69f27463-69a9-4754-8740-545bde3219df tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:18.050023 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-69f27463-69a9-4754-8740-545bde3219df tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:18.186818 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-69f27463-69a9-4754-8740-545bde3219df tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:40:18.194652 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-69f27463-69a9-4754-8740-545bde3219df tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1" status: 200 len: 1697 microversion: 2.1 time: 0.159029 Oct 30 02:40:18.195227 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4120/7904] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:40:18 2022] GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1 => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:40:19.217880 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2dab4d61-1f19-409d-9368-ace9bd400974 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:40:19.218490 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2dab4d61-1f19-409d-9368-ace9bd400974 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: c00652b0-2f49-4142-80d1-a0f3de233ab1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:40:19.225849 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2dab4d61-1f19-409d-9368-ace9bd400974 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:19.226379 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2dab4d61-1f19-409d-9368-ace9bd400974 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:19.226801 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2dab4d61-1f19-409d-9368-ace9bd400974 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:19.227495 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2dab4d61-1f19-409d-9368-ace9bd400974 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:19.227951 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2dab4d61-1f19-409d-9368-ace9bd400974 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:19.228371 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2dab4d61-1f19-409d-9368-ace9bd400974 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:19.363807 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2dab4d61-1f19-409d-9368-ace9bd400974 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:40:19.372256 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2dab4d61-1f19-409d-9368-ace9bd400974 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1" status: 200 len: 1697 microversion: 2.1 time: 0.158345 Oct 30 02:40:19.372840 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3785/7905] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:40:19 2022] GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1 => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:40:20.395654 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-503ce52e-b138-4d43-92ff-40befafc88b7 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:40:20.396205 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-503ce52e-b138-4d43-92ff-40befafc88b7 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: c00652b0-2f49-4142-80d1-a0f3de233ab1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:40:20.403075 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-503ce52e-b138-4d43-92ff-40befafc88b7 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:20.403568 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-503ce52e-b138-4d43-92ff-40befafc88b7 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:20.404015 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-503ce52e-b138-4d43-92ff-40befafc88b7 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:20.404710 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-503ce52e-b138-4d43-92ff-40befafc88b7 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:20.405174 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-503ce52e-b138-4d43-92ff-40befafc88b7 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:20.405636 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-503ce52e-b138-4d43-92ff-40befafc88b7 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:20.533891 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-503ce52e-b138-4d43-92ff-40befafc88b7 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:40:20.541728 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-503ce52e-b138-4d43-92ff-40befafc88b7 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1" status: 200 len: 1697 microversion: 2.1 time: 0.149992 Oct 30 02:40:20.542283 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4121/7906] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:40:20 2022] GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1 => generated 1697 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:40:21.566349 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a7c2c281-c5c4-4e2b-810a-a1cc0cff4da2 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:40:21.566966 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a7c2c281-c5c4-4e2b-810a-a1cc0cff4da2 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: c00652b0-2f49-4142-80d1-a0f3de233ab1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:40:21.573854 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a7c2c281-c5c4-4e2b-810a-a1cc0cff4da2 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:21.574324 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a7c2c281-c5c4-4e2b-810a-a1cc0cff4da2 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:21.574766 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a7c2c281-c5c4-4e2b-810a-a1cc0cff4da2 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:21.575460 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a7c2c281-c5c4-4e2b-810a-a1cc0cff4da2 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:21.575916 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a7c2c281-c5c4-4e2b-810a-a1cc0cff4da2 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:21.576343 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a7c2c281-c5c4-4e2b-810a-a1cc0cff4da2 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:21.710670 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a7c2c281-c5c4-4e2b-810a-a1cc0cff4da2 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:40:21.718475 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a7c2c281-c5c4-4e2b-810a-a1cc0cff4da2 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1" status: 200 len: 1697 microversion: 2.1 time: 0.156538 Oct 30 02:40:21.719041 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3786/7907] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:40:21 2022] GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1 => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:40:22.740776 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-da62b278-aaac-442c-8532-685e748c3449 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:40:22.741446 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-da62b278-aaac-442c-8532-685e748c3449 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: c00652b0-2f49-4142-80d1-a0f3de233ab1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:40:22.748283 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-da62b278-aaac-442c-8532-685e748c3449 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:22.748789 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-da62b278-aaac-442c-8532-685e748c3449 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:22.749246 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-da62b278-aaac-442c-8532-685e748c3449 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:22.749987 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-da62b278-aaac-442c-8532-685e748c3449 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:22.750458 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-da62b278-aaac-442c-8532-685e748c3449 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:22.750903 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-da62b278-aaac-442c-8532-685e748c3449 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:22.886038 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-da62b278-aaac-442c-8532-685e748c3449 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:40:22.894612 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-da62b278-aaac-442c-8532-685e748c3449 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1" status: 200 len: 1697 microversion: 2.1 time: 0.157809 Oct 30 02:40:22.895192 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4122/7908] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:40:22 2022] GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1 => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:40:23.917876 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-57069bc0-c3dc-4ebc-99ea-1c6fc0cf9bd0 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:40:23.918753 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-57069bc0-c3dc-4ebc-99ea-1c6fc0cf9bd0 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: c00652b0-2f49-4142-80d1-a0f3de233ab1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:40:23.926346 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-57069bc0-c3dc-4ebc-99ea-1c6fc0cf9bd0 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:23.926839 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-57069bc0-c3dc-4ebc-99ea-1c6fc0cf9bd0 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:23.927278 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-57069bc0-c3dc-4ebc-99ea-1c6fc0cf9bd0 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:23.927971 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-57069bc0-c3dc-4ebc-99ea-1c6fc0cf9bd0 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:23.928427 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-57069bc0-c3dc-4ebc-99ea-1c6fc0cf9bd0 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:23.928854 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-57069bc0-c3dc-4ebc-99ea-1c6fc0cf9bd0 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:24.066831 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-57069bc0-c3dc-4ebc-99ea-1c6fc0cf9bd0 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:40:24.074630 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-57069bc0-c3dc-4ebc-99ea-1c6fc0cf9bd0 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1" status: 200 len: 1697 microversion: 2.1 time: 0.160714 Oct 30 02:40:24.075199 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3787/7909] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:40:23 2022] GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1 => generated 1697 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:40:25.099573 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-95ee09e2-3f30-47f3-8297-a45b1c2f2f72 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:40:25.100199 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-95ee09e2-3f30-47f3-8297-a45b1c2f2f72 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: c00652b0-2f49-4142-80d1-a0f3de233ab1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:40:25.107129 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-95ee09e2-3f30-47f3-8297-a45b1c2f2f72 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:25.107623 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-95ee09e2-3f30-47f3-8297-a45b1c2f2f72 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:25.108068 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-95ee09e2-3f30-47f3-8297-a45b1c2f2f72 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:25.108769 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-95ee09e2-3f30-47f3-8297-a45b1c2f2f72 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:25.109242 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-95ee09e2-3f30-47f3-8297-a45b1c2f2f72 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:25.109708 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-95ee09e2-3f30-47f3-8297-a45b1c2f2f72 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:25.237638 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-95ee09e2-3f30-47f3-8297-a45b1c2f2f72 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:40:25.245838 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-95ee09e2-3f30-47f3-8297-a45b1c2f2f72 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1" status: 200 len: 1697 microversion: 2.1 time: 0.150712 Oct 30 02:40:25.246417 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4123/7910] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:40:25 2022] GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1 => generated 1697 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:40:26.270028 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-50888f7e-14dc-4918-8d6a-b21a39195175 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:40:26.270636 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-50888f7e-14dc-4918-8d6a-b21a39195175 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: c00652b0-2f49-4142-80d1-a0f3de233ab1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:40:26.277582 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-50888f7e-14dc-4918-8d6a-b21a39195175 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:26.278074 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-50888f7e-14dc-4918-8d6a-b21a39195175 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:26.278512 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-50888f7e-14dc-4918-8d6a-b21a39195175 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:26.279209 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-50888f7e-14dc-4918-8d6a-b21a39195175 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:26.279661 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-50888f7e-14dc-4918-8d6a-b21a39195175 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:26.280082 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-50888f7e-14dc-4918-8d6a-b21a39195175 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:26.413923 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-50888f7e-14dc-4918-8d6a-b21a39195175 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:40:26.421967 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-50888f7e-14dc-4918-8d6a-b21a39195175 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1" status: 200 len: 1697 microversion: 2.1 time: 0.156368 Oct 30 02:40:26.422536 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3788/7911] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:40:26 2022] GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1 => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:40:27.444335 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5e6eee34-6097-4e3e-b396-b1199b67d447 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:40:27.444971 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5e6eee34-6097-4e3e-b396-b1199b67d447 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: c00652b0-2f49-4142-80d1-a0f3de233ab1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:40:27.451510 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5e6eee34-6097-4e3e-b396-b1199b67d447 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:27.452011 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5e6eee34-6097-4e3e-b396-b1199b67d447 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:27.452473 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5e6eee34-6097-4e3e-b396-b1199b67d447 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:27.453184 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5e6eee34-6097-4e3e-b396-b1199b67d447 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:27.453694 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5e6eee34-6097-4e3e-b396-b1199b67d447 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:27.454137 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5e6eee34-6097-4e3e-b396-b1199b67d447 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:27.585813 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5e6eee34-6097-4e3e-b396-b1199b67d447 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:40:27.597202 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5e6eee34-6097-4e3e-b396-b1199b67d447 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1" status: 200 len: 1697 microversion: 2.1 time: 0.153363 Oct 30 02:40:27.597202 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4124/7912] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:40:27 2022] GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1 => generated 1697 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:40:28.617509 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ce1f224f-72b0-4c8a-8598-90be3eb5876c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:40:28.618106 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ce1f224f-72b0-4c8a-8598-90be3eb5876c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: c00652b0-2f49-4142-80d1-a0f3de233ab1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:40:28.625256 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ce1f224f-72b0-4c8a-8598-90be3eb5876c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:28.625802 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ce1f224f-72b0-4c8a-8598-90be3eb5876c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:28.626237 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ce1f224f-72b0-4c8a-8598-90be3eb5876c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:28.626930 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ce1f224f-72b0-4c8a-8598-90be3eb5876c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:28.628020 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ce1f224f-72b0-4c8a-8598-90be3eb5876c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:28.628505 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ce1f224f-72b0-4c8a-8598-90be3eb5876c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:28.757915 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ce1f224f-72b0-4c8a-8598-90be3eb5876c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:40:28.765618 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ce1f224f-72b0-4c8a-8598-90be3eb5876c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1" status: 200 len: 1697 microversion: 2.1 time: 0.151982 Oct 30 02:40:28.766187 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3789/7913] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:40:28 2022] GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1 => generated 1697 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:40:29.789247 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2a3318e9-2a4a-43f8-afe6-7bdb6c43f620 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:40:29.789896 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2a3318e9-2a4a-43f8-afe6-7bdb6c43f620 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: c00652b0-2f49-4142-80d1-a0f3de233ab1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:40:29.797197 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a3318e9-2a4a-43f8-afe6-7bdb6c43f620 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:29.797718 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a3318e9-2a4a-43f8-afe6-7bdb6c43f620 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:29.798163 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a3318e9-2a4a-43f8-afe6-7bdb6c43f620 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:29.798891 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a3318e9-2a4a-43f8-afe6-7bdb6c43f620 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:29.799977 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a3318e9-2a4a-43f8-afe6-7bdb6c43f620 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:29.800411 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a3318e9-2a4a-43f8-afe6-7bdb6c43f620 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:29.929445 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2a3318e9-2a4a-43f8-afe6-7bdb6c43f620 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:40:29.937171 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2a3318e9-2a4a-43f8-afe6-7bdb6c43f620 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1" status: 200 len: 1697 microversion: 2.1 time: 0.151804 Oct 30 02:40:29.937767 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4125/7914] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:40:29 2022] GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1 => generated 1697 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:40:30.960421 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ba60d831-248a-4994-963d-6bb4acdcf6c9 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:40:30.961042 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ba60d831-248a-4994-963d-6bb4acdcf6c9 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: c00652b0-2f49-4142-80d1-a0f3de233ab1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:40:30.968107 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ba60d831-248a-4994-963d-6bb4acdcf6c9 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:30.968602 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ba60d831-248a-4994-963d-6bb4acdcf6c9 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:30.969044 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ba60d831-248a-4994-963d-6bb4acdcf6c9 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:30.969783 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ba60d831-248a-4994-963d-6bb4acdcf6c9 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:30.970241 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ba60d831-248a-4994-963d-6bb4acdcf6c9 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:30.970673 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ba60d831-248a-4994-963d-6bb4acdcf6c9 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:30.974804 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=65 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:40:31.105487 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ba60d831-248a-4994-963d-6bb4acdcf6c9 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:40:31.113862 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ba60d831-248a-4994-963d-6bb4acdcf6c9 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1" status: 200 len: 1697 microversion: 2.1 time: 0.157358 Oct 30 02:40:31.114442 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3790/7915] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:40:30 2022] GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1 => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:40:32.137596 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6019bc9a-9220-4f38-8355-0c4a25fa63c6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:40:32.138242 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6019bc9a-9220-4f38-8355-0c4a25fa63c6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: c00652b0-2f49-4142-80d1-a0f3de233ab1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:40:32.145897 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6019bc9a-9220-4f38-8355-0c4a25fa63c6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:32.146404 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6019bc9a-9220-4f38-8355-0c4a25fa63c6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:32.146859 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6019bc9a-9220-4f38-8355-0c4a25fa63c6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:32.147577 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6019bc9a-9220-4f38-8355-0c4a25fa63c6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:32.148074 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6019bc9a-9220-4f38-8355-0c4a25fa63c6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:32.148523 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6019bc9a-9220-4f38-8355-0c4a25fa63c6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:32.647207 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6019bc9a-9220-4f38-8355-0c4a25fa63c6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:40:32.655129 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6019bc9a-9220-4f38-8355-0c4a25fa63c6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1" status: 200 len: 1696 microversion: 2.1 time: 0.521562 Oct 30 02:40:32.655711 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4126/7916] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:40:32 2022] GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1 => generated 1696 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:40:32.875763 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-02532b0f-43b0-4677-8da0-ba8919ee1b7b req-a43d3e3d-d472-488e-82d8-d77e7af70595 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c00652b0-2f49-4142-80d1-a0f3de233ab1", "name": "network-vif-unplugged", "status": "completed", "tag": "f4a5cb78-c769-4929-8db0-03162c320ed3"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:40:32.886311 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-02532b0f-43b0-4677-8da0-ba8919ee1b7b req-a43d3e3d-d472-488e-82d8-d77e7af70595 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:32.886803 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-02532b0f-43b0-4677-8da0-ba8919ee1b7b req-a43d3e3d-d472-488e-82d8-d77e7af70595 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:32.887236 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-02532b0f-43b0-4677-8da0-ba8919ee1b7b req-a43d3e3d-d472-488e-82d8-d77e7af70595 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:32.902173 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-02532b0f-43b0-4677-8da0-ba8919ee1b7b req-a43d3e3d-d472-488e-82d8-d77e7af70595 service nova] Creating event network-vif-unplugged:f4a5cb78-c769-4929-8db0-03162c320ed3 for instance c00652b0-2f49-4142-80d1-a0f3de233ab1 on n-h1-master-1 Oct 30 02:40:32.907619 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [req-02532b0f-43b0-4677-8da0-ba8919ee1b7b req-a43d3e3d-d472-488e-82d8-d77e7af70595 service nova] Instance c00652b0-2f49-4142-80d1-a0f3de233ab1 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=121103) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 30 02:40:32.919451 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-02532b0f-43b0-4677-8da0-ba8919ee1b7b req-a43d3e3d-d472-488e-82d8-d77e7af70595 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047705 Oct 30 02:40:32.920067 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3791/7917] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:40:33.680719 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-75c366b8-ecfa-4669-a7b2-8dc24c859866 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:40:33.681368 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-75c366b8-ecfa-4669-a7b2-8dc24c859866 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: c00652b0-2f49-4142-80d1-a0f3de233ab1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:40:33.688208 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-75c366b8-ecfa-4669-a7b2-8dc24c859866 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:33.688727 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-75c366b8-ecfa-4669-a7b2-8dc24c859866 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:33.689175 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-75c366b8-ecfa-4669-a7b2-8dc24c859866 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:33.690571 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-75c366b8-ecfa-4669-a7b2-8dc24c859866 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:33.691035 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-75c366b8-ecfa-4669-a7b2-8dc24c859866 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:33.691472 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-75c366b8-ecfa-4669-a7b2-8dc24c859866 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:33.892781 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-75c366b8-ecfa-4669-a7b2-8dc24c859866 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:40:33.901519 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-75c366b8-ecfa-4669-a7b2-8dc24c859866 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1" status: 200 len: 1696 microversion: 2.1 time: 0.224701 Oct 30 02:40:33.902101 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4127/7918] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:40:33 2022] GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1 => generated 1696 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:40:34.927442 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-aa1519dc-5d0f-4a5e-8d28-6f00ff875e87 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:40:34.928219 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-aa1519dc-5d0f-4a5e-8d28-6f00ff875e87 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: c00652b0-2f49-4142-80d1-a0f3de233ab1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:40:34.933170 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-c82ea1ec-1306-45b0-8226-53d060ba6225 req-054fec03-42ff-418b-99cb-71d96db6e4c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c00652b0-2f49-4142-80d1-a0f3de233ab1", "tag": "f4a5cb78-c769-4929-8db0-03162c320ed3"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:40:34.934510 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa1519dc-5d0f-4a5e-8d28-6f00ff875e87 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:34.934997 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa1519dc-5d0f-4a5e-8d28-6f00ff875e87 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:34.935433 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa1519dc-5d0f-4a5e-8d28-6f00ff875e87 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:34.936126 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa1519dc-5d0f-4a5e-8d28-6f00ff875e87 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:34.936638 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa1519dc-5d0f-4a5e-8d28-6f00ff875e87 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:34.937064 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa1519dc-5d0f-4a5e-8d28-6f00ff875e87 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:34.943798 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-c82ea1ec-1306-45b0-8226-53d060ba6225 req-054fec03-42ff-418b-99cb-71d96db6e4c1 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:34.944279 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-c82ea1ec-1306-45b0-8226-53d060ba6225 req-054fec03-42ff-418b-99cb-71d96db6e4c1 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:34.944720 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-c82ea1ec-1306-45b0-8226-53d060ba6225 req-054fec03-42ff-418b-99cb-71d96db6e4c1 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:34.956805 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-c82ea1ec-1306-45b0-8226-53d060ba6225 req-054fec03-42ff-418b-99cb-71d96db6e4c1 service nova] Creating event network-changed:f4a5cb78-c769-4929-8db0-03162c320ed3 for instance c00652b0-2f49-4142-80d1-a0f3de233ab1 on n-h1-master-1 Oct 30 02:40:34.962190 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [req-c82ea1ec-1306-45b0-8226-53d060ba6225 req-054fec03-42ff-418b-99cb-71d96db6e4c1 service nova] Instance c00652b0-2f49-4142-80d1-a0f3de233ab1 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=121102) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 30 02:40:34.973312 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-c82ea1ec-1306-45b0-8226-53d060ba6225 req-054fec03-42ff-418b-99cb-71d96db6e4c1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043819 Oct 30 02:40:34.973943 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4128/7919] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:40:35.079604 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-aa1519dc-5d0f-4a5e-8d28-6f00ff875e87 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:40:35.087952 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-aa1519dc-5d0f-4a5e-8d28-6f00ff875e87 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1" status: 200 len: 1694 microversion: 2.1 time: 0.166026 Oct 30 02:40:35.088536 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3792/7920] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:40:34 2022] GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1 => generated 1694 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:40:36.113201 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-54603277-99f3-4bd2-8132-371bc17fc086 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:40:36.114031 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-54603277-99f3-4bd2-8132-371bc17fc086 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: c00652b0-2f49-4142-80d1-a0f3de233ab1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:40:36.120290 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-54603277-99f3-4bd2-8132-371bc17fc086 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:36.123630 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-54603277-99f3-4bd2-8132-371bc17fc086 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:36.123630 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-54603277-99f3-4bd2-8132-371bc17fc086 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:36.123630 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-54603277-99f3-4bd2-8132-371bc17fc086 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:36.123630 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-54603277-99f3-4bd2-8132-371bc17fc086 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:36.123630 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-54603277-99f3-4bd2-8132-371bc17fc086 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:36.342414 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-54603277-99f3-4bd2-8132-371bc17fc086 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:40:36.350343 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-54603277-99f3-4bd2-8132-371bc17fc086 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1" status: 200 len: 1694 microversion: 2.1 time: 0.242507 Oct 30 02:40:36.356570 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4129/7921] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:40:36 2022] GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1 => generated 1694 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:40:37.373517 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ad32d788-471e-47c1-a6c0-a1cdca9712bd tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:40:37.374140 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ad32d788-471e-47c1-a6c0-a1cdca9712bd tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: c00652b0-2f49-4142-80d1-a0f3de233ab1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:40:37.380907 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ad32d788-471e-47c1-a6c0-a1cdca9712bd tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:37.385817 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ad32d788-471e-47c1-a6c0-a1cdca9712bd tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:37.385817 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ad32d788-471e-47c1-a6c0-a1cdca9712bd tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:37.385817 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ad32d788-471e-47c1-a6c0-a1cdca9712bd tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:37.385817 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ad32d788-471e-47c1-a6c0-a1cdca9712bd tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:37.385817 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ad32d788-471e-47c1-a6c0-a1cdca9712bd tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:37.514736 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ad32d788-471e-47c1-a6c0-a1cdca9712bd tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:40:37.523092 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ad32d788-471e-47c1-a6c0-a1cdca9712bd tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1" status: 200 len: 1691 microversion: 2.1 time: 0.153564 Oct 30 02:40:37.523668 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3793/7922] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:40:37 2022] GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1 => generated 1691 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:40:37.546586 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7302393c-d5a0-406a-9d78-c4840d796313 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:40:37.547185 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7302393c-d5a0-406a-9d78-c4840d796313 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: c00652b0-2f49-4142-80d1-a0f3de233ab1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:40:37.550100 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=35 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:40:37.555068 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7302393c-d5a0-406a-9d78-c4840d796313 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:37.555577 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7302393c-d5a0-406a-9d78-c4840d796313 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:37.556032 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7302393c-d5a0-406a-9d78-c4840d796313 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:37.556766 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7302393c-d5a0-406a-9d78-c4840d796313 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:37.557236 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7302393c-d5a0-406a-9d78-c4840d796313 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:37.557708 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7302393c-d5a0-406a-9d78-c4840d796313 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:37.562024 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:40:37.778464 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7302393c-d5a0-406a-9d78-c4840d796313 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "POST /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1/action" status: 204 len: 0 microversion: 2.1 time: 0.235965 Oct 30 02:40:37.779142 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4130/7923] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 02:40:37 2022] POST /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1/action => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 02:40:37.788769 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5bbd0023-5529-4699-aac4-157ce324a727 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:40:37.789516 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5bbd0023-5529-4699-aac4-157ce324a727 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: c00652b0-2f49-4142-80d1-a0f3de233ab1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:40:37.796130 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5bbd0023-5529-4699-aac4-157ce324a727 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:37.796642 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5bbd0023-5529-4699-aac4-157ce324a727 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:37.797079 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5bbd0023-5529-4699-aac4-157ce324a727 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:37.797800 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5bbd0023-5529-4699-aac4-157ce324a727 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:37.798254 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5bbd0023-5529-4699-aac4-157ce324a727 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:37.798681 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5bbd0023-5529-4699-aac4-157ce324a727 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:37.937442 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5bbd0023-5529-4699-aac4-157ce324a727 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:40:37.945685 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5bbd0023-5529-4699-aac4-157ce324a727 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1" status: 200 len: 1691 microversion: 2.1 time: 0.162292 Oct 30 02:40:37.946265 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3794/7924] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:40:37 2022] GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1 => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:40:37.969542 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b2a46177-d86a-4f7d-ba85-2ec2604f5304 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:40:37.970263 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b2a46177-d86a-4f7d-ba85-2ec2604f5304 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: c00652b0-2f49-4142-80d1-a0f3de233ab1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:40:37.976905 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2a46177-d86a-4f7d-ba85-2ec2604f5304 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:37.977427 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2a46177-d86a-4f7d-ba85-2ec2604f5304 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:37.977884 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2a46177-d86a-4f7d-ba85-2ec2604f5304 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:37.978585 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2a46177-d86a-4f7d-ba85-2ec2604f5304 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:37.979051 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2a46177-d86a-4f7d-ba85-2ec2604f5304 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:37.979486 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2a46177-d86a-4f7d-ba85-2ec2604f5304 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:38.129112 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b2a46177-d86a-4f7d-ba85-2ec2604f5304 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:40:38.136905 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b2a46177-d86a-4f7d-ba85-2ec2604f5304 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1" status: 200 len: 1691 microversion: 2.1 time: 0.171803 Oct 30 02:40:38.137508 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4131/7925] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:40:37 2022] GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1 => generated 1691 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:40:39.160850 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a3a3c622-2495-4178-baf9-666562538499 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:40:39.161495 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a3a3c622-2495-4178-baf9-666562538499 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: c00652b0-2f49-4142-80d1-a0f3de233ab1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:40:39.168640 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a3a3c622-2495-4178-baf9-666562538499 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:39.169125 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a3a3c622-2495-4178-baf9-666562538499 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:39.169593 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a3a3c622-2495-4178-baf9-666562538499 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:39.170363 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a3a3c622-2495-4178-baf9-666562538499 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:39.170826 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a3a3c622-2495-4178-baf9-666562538499 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:39.171255 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a3a3c622-2495-4178-baf9-666562538499 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:39.286363 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-a9b8680b-cd14-44eb-8477-fd5b74701b6d req-498ae5db-9d0d-4c24-94ce-af5e4508f360 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c00652b0-2f49-4142-80d1-a0f3de233ab1", "name": "network-vif-plugged", "status": "completed", "tag": "f4a5cb78-c769-4929-8db0-03162c320ed3"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:40:39.300791 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-a9b8680b-cd14-44eb-8477-fd5b74701b6d req-498ae5db-9d0d-4c24-94ce-af5e4508f360 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:39.301282 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-a9b8680b-cd14-44eb-8477-fd5b74701b6d req-498ae5db-9d0d-4c24-94ce-af5e4508f360 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:39.301745 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-a9b8680b-cd14-44eb-8477-fd5b74701b6d req-498ae5db-9d0d-4c24-94ce-af5e4508f360 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:39.315617 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-a9b8680b-cd14-44eb-8477-fd5b74701b6d req-498ae5db-9d0d-4c24-94ce-af5e4508f360 service nova] Creating event network-vif-plugged:f4a5cb78-c769-4929-8db0-03162c320ed3 for instance c00652b0-2f49-4142-80d1-a0f3de233ab1 on n-h1-master-1 Oct 30 02:40:39.320643 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-a9b8680b-cd14-44eb-8477-fd5b74701b6d req-498ae5db-9d0d-4c24-94ce-af5e4508f360 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039054 Oct 30 02:40:39.321543 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4132/7926] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:40:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:40:39.325411 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a3a3c622-2495-4178-baf9-666562538499 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:40:39.334135 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a3a3c622-2495-4178-baf9-666562538499 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1" status: 200 len: 1691 microversion: 2.1 time: 0.178036 Oct 30 02:40:39.334713 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3795/7927] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:40:39 2022] GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1 => generated 1691 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:40:40.358280 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8266b033-6ee7-4332-80c4-14ebd09254d4 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:40:40.359030 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8266b033-6ee7-4332-80c4-14ebd09254d4 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: c00652b0-2f49-4142-80d1-a0f3de233ab1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:40:40.366876 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8266b033-6ee7-4332-80c4-14ebd09254d4 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:40.367377 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8266b033-6ee7-4332-80c4-14ebd09254d4 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:40.367832 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8266b033-6ee7-4332-80c4-14ebd09254d4 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:40.368544 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8266b033-6ee7-4332-80c4-14ebd09254d4 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:40:40.369014 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8266b033-6ee7-4332-80c4-14ebd09254d4 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:40:40.369488 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8266b033-6ee7-4332-80c4-14ebd09254d4 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:40:40.502726 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8266b033-6ee7-4332-80c4-14ebd09254d4 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:40:40.510523 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8266b033-6ee7-4332-80c4-14ebd09254d4 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1" status: 200 len: 1683 microversion: 2.1 time: 0.156525 Oct 30 02:40:40.511103 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4133/7928] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:40:40 2022] GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:41:00.684859 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0fd48228-2045-4e2b-adfd-3249dd8a750d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:41:00.687176 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0fd48228-2045-4e2b-adfd-3249dd8a750d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: c00652b0-2f49-4142-80d1-a0f3de233ab1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:41:00.689936 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=35 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:41:00.690607 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=33 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:41:00.696581 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0fd48228-2045-4e2b-adfd-3249dd8a750d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:41:00.697071 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0fd48228-2045-4e2b-adfd-3249dd8a750d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:41:00.697558 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0fd48228-2045-4e2b-adfd-3249dd8a750d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:41:00.703760 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0fd48228-2045-4e2b-adfd-3249dd8a750d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:41:00.703760 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0fd48228-2045-4e2b-adfd-3249dd8a750d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:41:00.703760 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0fd48228-2045-4e2b-adfd-3249dd8a750d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:41:00.765719 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0fd48228-2045-4e2b-adfd-3249dd8a750d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "POST /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1/action" status: 200 len: 24553 microversion: 2.1 time: 0.084643 Oct 30 02:41:00.766627 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3796/7929] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 02:41:00 2022] POST /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1/action => generated 24553 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 02:41:08.258983 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b79e6750-8d58-434b-914c-346d28475cfa tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:41:08.258983 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b79e6750-8d58-434b-914c-346d28475cfa tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: c00652b0-2f49-4142-80d1-a0f3de233ab1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:41:08.259559 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-57319a47-b016-4d05-8024-4231b8ecf155 req-711f4cfc-7fc3-4d60-a917-cd7b90a6da71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c00652b0-2f49-4142-80d1-a0f3de233ab1", "tag": "f4a5cb78-c769-4929-8db0-03162c320ed3"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:41:08.259944 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=7 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:41:08.259944 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:41:08.264950 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b79e6750-8d58-434b-914c-346d28475cfa tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:41:08.265101 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b79e6750-8d58-434b-914c-346d28475cfa tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:41:08.265652 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b79e6750-8d58-434b-914c-346d28475cfa tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:41:08.266433 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b79e6750-8d58-434b-914c-346d28475cfa tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:41:08.267062 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b79e6750-8d58-434b-914c-346d28475cfa tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:41:08.267568 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b79e6750-8d58-434b-914c-346d28475cfa tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:41:08.268983 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-57319a47-b016-4d05-8024-4231b8ecf155 req-711f4cfc-7fc3-4d60-a917-cd7b90a6da71 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:41:08.270314 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-57319a47-b016-4d05-8024-4231b8ecf155 req-711f4cfc-7fc3-4d60-a917-cd7b90a6da71 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:41:08.270747 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-57319a47-b016-4d05-8024-4231b8ecf155 req-711f4cfc-7fc3-4d60-a917-cd7b90a6da71 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:41:08.282501 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-57319a47-b016-4d05-8024-4231b8ecf155 req-711f4cfc-7fc3-4d60-a917-cd7b90a6da71 service nova] Creating event network-changed:f4a5cb78-c769-4929-8db0-03162c320ed3 for instance c00652b0-2f49-4142-80d1-a0f3de233ab1 on n-h1-master-1 Oct 30 02:41:08.288234 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-57319a47-b016-4d05-8024-4231b8ecf155 req-711f4cfc-7fc3-4d60-a917-cd7b90a6da71 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035195 Oct 30 02:41:08.288929 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3797/7930] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:41:08.297059 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b79e6750-8d58-434b-914c-346d28475cfa tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: c00652b0-2f49-4142-80d1-a0f3de233ab1] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 02:41:08.647231 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b79e6750-8d58-434b-914c-346d28475cfa tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1" status: 204 len: 0 microversion: 2.1 time: 0.396705 Oct 30 02:41:08.649313 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4134/7931] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 02:41:08 2022] DELETE /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 02:41:08.658027 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-68263854-1046-421b-8457-babd59684062 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:41:08.659008 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-68263854-1046-421b-8457-babd59684062 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: c00652b0-2f49-4142-80d1-a0f3de233ab1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:41:08.665720 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-68263854-1046-421b-8457-babd59684062 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:41:08.666207 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-68263854-1046-421b-8457-babd59684062 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:41:08.666641 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-68263854-1046-421b-8457-babd59684062 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:41:08.667631 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-68263854-1046-421b-8457-babd59684062 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:41:08.668058 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-68263854-1046-421b-8457-babd59684062 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:41:08.668481 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-68263854-1046-421b-8457-babd59684062 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:41:08.808986 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-68263854-1046-421b-8457-babd59684062 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:41:08.816978 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-68263854-1046-421b-8457-babd59684062 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1" status: 200 len: 1689 microversion: 2.1 time: 0.163919 Oct 30 02:41:08.817731 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3798/7932] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:41:08 2022] GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1 => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:41:09.840807 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6a0a9f46-cd3b-4922-bce7-e60013fd1bd6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:41:09.841588 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6a0a9f46-cd3b-4922-bce7-e60013fd1bd6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: c00652b0-2f49-4142-80d1-a0f3de233ab1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:41:09.849095 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a0a9f46-cd3b-4922-bce7-e60013fd1bd6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:41:09.849615 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a0a9f46-cd3b-4922-bce7-e60013fd1bd6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:41:09.850069 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a0a9f46-cd3b-4922-bce7-e60013fd1bd6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:41:09.850776 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a0a9f46-cd3b-4922-bce7-e60013fd1bd6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:41:09.851241 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a0a9f46-cd3b-4922-bce7-e60013fd1bd6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:41:09.851682 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6a0a9f46-cd3b-4922-bce7-e60013fd1bd6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:41:09.982910 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6a0a9f46-cd3b-4922-bce7-e60013fd1bd6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:41:09.990688 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6a0a9f46-cd3b-4922-bce7-e60013fd1bd6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1" status: 200 len: 1689 microversion: 2.1 time: 0.154241 Oct 30 02:41:09.991202 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4135/7933] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:41:09 2022] GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1 => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:41:10.584974 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-58e21db2-7c29-4d75-9d4d-cadeac5bc58e req-c005c6cc-cd99-45c9-8daf-7bd49831e3c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c00652b0-2f49-4142-80d1-a0f3de233ab1", "name": "network-vif-deleted", "tag": "f4a5cb78-c769-4929-8db0-03162c320ed3"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:41:10.595843 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-58e21db2-7c29-4d75-9d4d-cadeac5bc58e req-c005c6cc-cd99-45c9-8daf-7bd49831e3c8 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:41:10.596328 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-58e21db2-7c29-4d75-9d4d-cadeac5bc58e req-c005c6cc-cd99-45c9-8daf-7bd49831e3c8 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:41:10.596760 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-58e21db2-7c29-4d75-9d4d-cadeac5bc58e req-c005c6cc-cd99-45c9-8daf-7bd49831e3c8 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:41:10.610759 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-58e21db2-7c29-4d75-9d4d-cadeac5bc58e req-c005c6cc-cd99-45c9-8daf-7bd49831e3c8 service nova] Creating event network-vif-deleted:f4a5cb78-c769-4929-8db0-03162c320ed3 for instance c00652b0-2f49-4142-80d1-a0f3de233ab1 on n-h1-master-1 Oct 30 02:41:10.615845 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-58e21db2-7c29-4d75-9d4d-cadeac5bc58e req-c005c6cc-cd99-45c9-8daf-7bd49831e3c8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034700 Oct 30 02:41:10.616551 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3799/7934] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:41:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:41:11.015484 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-905f4fcf-7ac1-4155-b83b-fb8aeb44757f tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:41:11.016113 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-905f4fcf-7ac1-4155-b83b-fb8aeb44757f tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: c00652b0-2f49-4142-80d1-a0f3de233ab1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:41:11.023692 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-905f4fcf-7ac1-4155-b83b-fb8aeb44757f tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:41:11.024184 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-905f4fcf-7ac1-4155-b83b-fb8aeb44757f tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:41:11.024633 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-905f4fcf-7ac1-4155-b83b-fb8aeb44757f tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:41:11.025714 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-905f4fcf-7ac1-4155-b83b-fb8aeb44757f tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:41:11.026275 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-905f4fcf-7ac1-4155-b83b-fb8aeb44757f tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:41:11.026713 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-905f4fcf-7ac1-4155-b83b-fb8aeb44757f tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:41:11.059138 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-905f4fcf-7ac1-4155-b83b-fb8aeb44757f tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:41:11.059466 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-905f4fcf-7ac1-4155-b83b-fb8aeb44757f tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:41:11.059918 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-905f4fcf-7ac1-4155-b83b-fb8aeb44757f tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:41:11.060825 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-905f4fcf-7ac1-4155-b83b-fb8aeb44757f tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lazy-loading 'fault' on Instance uuid c00652b0-2f49-4142-80d1-a0f3de233ab1 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 02:41:11.103282 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-905f4fcf-7ac1-4155-b83b-fb8aeb44757f tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:41:11.111188 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-905f4fcf-7ac1-4155-b83b-fb8aeb44757f tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1" status: 200 len: 1356 microversion: 2.1 time: 0.099655 Oct 30 02:41:11.111767 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4136/7935] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:41:11 2022] GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1 => generated 1356 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:41:12.136788 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7092c9de-213b-4dbf-83e2-8f9a42f7f6f6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:41:12.137449 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7092c9de-213b-4dbf-83e2-8f9a42f7f6f6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: c00652b0-2f49-4142-80d1-a0f3de233ab1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:41:12.143646 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7092c9de-213b-4dbf-83e2-8f9a42f7f6f6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:41:12.144124 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7092c9de-213b-4dbf-83e2-8f9a42f7f6f6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:41:12.144561 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7092c9de-213b-4dbf-83e2-8f9a42f7f6f6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:41:12.145242 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7092c9de-213b-4dbf-83e2-8f9a42f7f6f6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:41:12.145715 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7092c9de-213b-4dbf-83e2-8f9a42f7f6f6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:41:12.146135 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7092c9de-213b-4dbf-83e2-8f9a42f7f6f6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:41:12.159908 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-7092c9de-213b-4dbf-83e2-8f9a42f7f6f6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] HTTP exception thrown: Instance c00652b0-2f49-4142-80d1-a0f3de233ab1 could not be found. Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7092c9de-213b-4dbf-83e2-8f9a42f7f6f6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Request method failure captured: Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1 HTTP/1.1 Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXeMhmBt07CnqlsQCCZQN6u-PC4AsgU8WequZ4Kud9tCoyqv8mAHQMcaho4Jbx4RzGkeSupfwjjjBU9nby25ZfrQmG3SvdDYuPUoYCpt4XAVTrkn_pjoiCb5AJLHMr5UnOHpTN2d7v4LRRKuXP0k9zso8ZvHlSuYjg8x6U3J73q4pZ0Q Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 4a813c90e3ec437fbf1f37dbb2b340d4 Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-521135141 Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a813c90e3ec437fbf1f37dbb2b340d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4a813c90e3ec437fbf1f37dbb2b340d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4a813c90e3ec437fbf1f37dbb2b340d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a813c90e3ec437fbf1f37dbb2b340d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-TestNetworkAdvancedServerOps-521135141 Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 4a813c90e3ec437fbf1f37dbb2b340d4 Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-521135141 Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-TestNetworkAdvancedServerOps-521135141-project Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: ef194f895a0c404abc08cad62a3b566d Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-TestNetworkAdvancedServerOps-521135141-project Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: exception: Instance c00652b0-2f49-4142-80d1-a0f3de233ab1 could not be found. Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': 'c00652b0-2f49-4142-80d1-a0f3de233ab1'} Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c00652b0-2f49-4142-80d1-a0f3de233ab1 could not be found. Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c00652b0-2f49-4142-80d1-a0f3de233ab1 could not be found. Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:41:12.161554 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:41:12.167699 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:41:12.167699 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:41:12.167699 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:41:12.167699 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:41:12.167699 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:41:12.167699 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:41:12.167699 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c00652b0-2f49-4142-80d1-a0f3de233ab1 could not be found. Oct 30 02:41:12.167699 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:41:12.167699 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7092c9de-213b-4dbf-83e2-8f9a42f7f6f6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Returning 404 to user: Instance c00652b0-2f49-4142-80d1-a0f3de233ab1 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:41:12.167699 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7092c9de-213b-4dbf-83e2-8f9a42f7f6f6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1" status: 404 len: 111 microversion: 2.1 time: 0.031961 Oct 30 02:41:12.167699 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3800/7936] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:41:12 2022] GET /compute/v2.1/servers/c00652b0-2f49-4142-80d1-a0f3de233ab1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 02:41:15.975761 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-69332302-41a7-4c43-8387-1b0d2a9d92fd tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '.version_select at 0x7f44c76a2820>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:41:16.051502 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-69332302-41a7-4c43-8387-1b0d2a9d92fd tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1420748158" status: 202 len: 0 microversion: 2.1 time: 0.079641 Oct 30 02:41:16.052045 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4137/7937] 10.222.0.13 () {58 vars in 1284 bytes} [Sun Oct 30 02:41:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1420748158 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 30 02:41:16.081435 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-511d8a77-d1b1-4ab9-ac1b-e7a251a386c7 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Action: 'create', calling method: .version_select at 0x7f44c6dc83a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-762435059", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPypxU34vrX2l0pLPIeSesu0OFYagE8WmdN9V5wU04N2JQt8U3NQyHBstxzZaW+0jYwElQpTz2Zu4+qeah+m4rkASo+0Cpf2gff8z0BXo6FdPWEeT0VySw+GdCYYKNp/vw=="}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:41:16.098162 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-511d8a77-d1b1-4ab9-ac1b-e7a251a386c7 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Getting quotas for project 4a813c90e3ec437fbf1f37dbb2b340d4. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 02:41:16.104091 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-511d8a77-d1b1-4ab9-ac1b-e7a251a386c7 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Getting quotas for user ef194f895a0c404abc08cad62a3b566d and project 4a813c90e3ec437fbf1f37dbb2b340d4. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 02:41:16.213800 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-511d8a77-d1b1-4ab9-ac1b-e7a251a386c7 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.136160 Oct 30 02:41:16.214539 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3801/7938] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 30 02:41:16 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:41:24.427072 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:41:24.431512 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-15c5e067-996f-4d77-a462-da880104c865 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1907719778", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "60e52efc-f44b-4ff9-9ad3-21ead653d0a0"}], "key_name": "tempest-TestNetworkAdvancedServerOps-762435059", "security_groups": [{"name": "tempest-secgroup-smoke-53311188"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:41:24.548606 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-15c5e067-996f-4d77-a462-da880104c865 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] validate_networks() for [('60e52efc-f44b-4ff9-9ad3-21ead653d0a0', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 02:41:24.981362 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-15c5e067-996f-4d77-a462-da880104c865 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 02:41:24.982030 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-15c5e067-996f-4d77-a462-da880104c865 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 02:41:24.983379 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-15c5e067-996f-4d77-a462-da880104c865 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 02:41:24.983821 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-15c5e067-996f-4d77-a462-da880104c865 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 02:41:24.984405 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-15c5e067-996f-4d77-a462-da880104c865 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 02:41:24.995379 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-15c5e067-996f-4d77-a462-da880104c865 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:41:24.995890 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-15c5e067-996f-4d77-a462-da880104c865 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:41:24.996380 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-15c5e067-996f-4d77-a462-da880104c865 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:41:24.997368 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-15c5e067-996f-4d77-a462-da880104c865 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:41:24.998065 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-15c5e067-996f-4d77-a462-da880104c865 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:41:24.999374 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-15c5e067-996f-4d77-a462-da880104c865 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:41:25.019405 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-15c5e067-996f-4d77-a462-da880104c865 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Getting quotas for project 4a813c90e3ec437fbf1f37dbb2b340d4. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 02:41:25.025926 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-15c5e067-996f-4d77-a462-da880104c865 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Getting quotas for user ef194f895a0c404abc08cad62a3b566d and project 4a813c90e3ec437fbf1f37dbb2b340d4. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 02:41:25.039918 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-15c5e067-996f-4d77-a462-da880104c865 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 02:41:25.042609 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-15c5e067-996f-4d77-a462-da880104c865 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 25d39e4d-23a0-4fab-bba8-fd72d48b7886] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 02:41:25.178938 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-15c5e067-996f-4d77-a462-da880104c865 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.753588 Oct 30 02:41:25.179927 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4138/7939] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 02:41:24 2022] POST /compute/v2.1/servers => generated 404 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 02:41:25.196847 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-114999f2-2cfc-471b-85a2-8fd5876346cc tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:41:25.199447 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-114999f2-2cfc-471b-85a2-8fd5876346cc tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 25d39e4d-23a0-4fab-bba8-fd72d48b7886] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:41:25.216352 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=16 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:41:25.281888 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-114999f2-2cfc-471b-85a2-8fd5876346cc tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:41:25.292673 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-114999f2-2cfc-471b-85a2-8fd5876346cc tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886" status: 200 len: 1266 microversion: 2.1 time: 0.104321 Oct 30 02:41:25.302599 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3802/7940] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:41:25 2022] GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886 => generated 1266 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:41:26.316643 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-92532043-dd4c-45a3-9073-cd48abf899e0 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:41:26.322561 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-92532043-dd4c-45a3-9073-cd48abf899e0 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 25d39e4d-23a0-4fab-bba8-fd72d48b7886] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:41:26.325567 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92532043-dd4c-45a3-9073-cd48abf899e0 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:41:26.326076 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92532043-dd4c-45a3-9073-cd48abf899e0 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:41:26.326529 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92532043-dd4c-45a3-9073-cd48abf899e0 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:41:26.327337 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92532043-dd4c-45a3-9073-cd48abf899e0 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:41:26.327807 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92532043-dd4c-45a3-9073-cd48abf899e0 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:41:26.328249 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92532043-dd4c-45a3-9073-cd48abf899e0 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:41:26.392812 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-92532043-dd4c-45a3-9073-cd48abf899e0 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:41:26.401214 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-92532043-dd4c-45a3-9073-cd48abf899e0 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886" status: 200 len: 1270 microversion: 2.1 time: 0.088589 Oct 30 02:41:26.411799 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4139/7941] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:41:26 2022] GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886 => generated 1270 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:41:27.424323 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-642f713a-98b3-482e-8085-a128925620ea tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:41:27.424970 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-642f713a-98b3-482e-8085-a128925620ea tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 25d39e4d-23a0-4fab-bba8-fd72d48b7886] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:41:27.433367 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-642f713a-98b3-482e-8085-a128925620ea tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:41:27.434181 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-642f713a-98b3-482e-8085-a128925620ea tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:41:27.434619 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-642f713a-98b3-482e-8085-a128925620ea tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:41:27.435339 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-642f713a-98b3-482e-8085-a128925620ea tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:41:27.435788 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-642f713a-98b3-482e-8085-a128925620ea tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:41:27.436210 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-642f713a-98b3-482e-8085-a128925620ea tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:41:27.500224 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-642f713a-98b3-482e-8085-a128925620ea tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:41:27.508114 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-642f713a-98b3-482e-8085-a128925620ea tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886" status: 200 len: 1326 microversion: 2.1 time: 0.087794 Oct 30 02:41:27.512277 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3803/7942] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:41:27 2022] GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886 => generated 1326 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:41:28.531876 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-53cabbc7-0461-4dba-af54-493a56869b75 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:41:28.532511 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-53cabbc7-0461-4dba-af54-493a56869b75 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 25d39e4d-23a0-4fab-bba8-fd72d48b7886] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:41:28.539050 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53cabbc7-0461-4dba-af54-493a56869b75 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:41:28.539490 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53cabbc7-0461-4dba-af54-493a56869b75 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:41:28.539943 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53cabbc7-0461-4dba-af54-493a56869b75 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:41:28.540657 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53cabbc7-0461-4dba-af54-493a56869b75 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:41:28.541159 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53cabbc7-0461-4dba-af54-493a56869b75 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:41:28.541634 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53cabbc7-0461-4dba-af54-493a56869b75 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:41:28.780813 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-53cabbc7-0461-4dba-af54-493a56869b75 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:41:28.788710 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-53cabbc7-0461-4dba-af54-493a56869b75 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886" status: 200 len: 1390 microversion: 2.1 time: 0.260885 Oct 30 02:41:28.792417 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4140/7943] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:41:28 2022] GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886 => generated 1390 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:41:29.293091 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-88626e79-eac6-4889-ab39-a6a8609d9356 req-4815955f-bc65-4024-8281-00d0e1f12776 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25d39e4d-23a0-4fab-bba8-fd72d48b7886", "tag": "ec0c199d-4d5b-4723-baab-48e488f88964"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:41:29.304374 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-88626e79-eac6-4889-ab39-a6a8609d9356 req-4815955f-bc65-4024-8281-00d0e1f12776 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:41:29.304815 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-88626e79-eac6-4889-ab39-a6a8609d9356 req-4815955f-bc65-4024-8281-00d0e1f12776 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:41:29.305243 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-88626e79-eac6-4889-ab39-a6a8609d9356 req-4815955f-bc65-4024-8281-00d0e1f12776 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:41:29.316601 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-88626e79-eac6-4889-ab39-a6a8609d9356 req-4815955f-bc65-4024-8281-00d0e1f12776 service nova] Creating event network-changed:ec0c199d-4d5b-4723-baab-48e488f88964 for instance 25d39e4d-23a0-4fab-bba8-fd72d48b7886 on n-h2-master-1 Oct 30 02:41:29.321992 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-88626e79-eac6-4889-ab39-a6a8609d9356 req-4815955f-bc65-4024-8281-00d0e1f12776 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034062 Oct 30 02:41:29.323192 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3804/7944] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:41:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:41:29.812616 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2618cb4c-691a-4d94-9c93-c2b656c88c2d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:41:29.813317 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2618cb4c-691a-4d94-9c93-c2b656c88c2d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 25d39e4d-23a0-4fab-bba8-fd72d48b7886] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:41:29.820364 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2618cb4c-691a-4d94-9c93-c2b656c88c2d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:41:29.821064 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2618cb4c-691a-4d94-9c93-c2b656c88c2d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:41:29.821755 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2618cb4c-691a-4d94-9c93-c2b656c88c2d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:41:29.823307 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2618cb4c-691a-4d94-9c93-c2b656c88c2d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:41:29.823776 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2618cb4c-691a-4d94-9c93-c2b656c88c2d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:41:29.824219 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2618cb4c-691a-4d94-9c93-c2b656c88c2d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:41:30.042758 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-2618cb4c-691a-4d94-9c93-c2b656c88c2d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:41:30.051409 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2618cb4c-691a-4d94-9c93-c2b656c88c2d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886" status: 200 len: 1390 microversion: 2.1 time: 0.242736 Oct 30 02:41:30.051999 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4141/7945] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:41:29 2022] GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886 => generated 1390 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:41:31.076339 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-45a49c5b-ddd9-4615-b2e3-76098fbe05a3 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:41:31.077046 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-45a49c5b-ddd9-4615-b2e3-76098fbe05a3 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 25d39e4d-23a0-4fab-bba8-fd72d48b7886] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:41:31.079053 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:41:31.083999 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45a49c5b-ddd9-4615-b2e3-76098fbe05a3 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:41:31.084486 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45a49c5b-ddd9-4615-b2e3-76098fbe05a3 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:41:31.084923 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45a49c5b-ddd9-4615-b2e3-76098fbe05a3 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:41:31.085662 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45a49c5b-ddd9-4615-b2e3-76098fbe05a3 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:41:31.086120 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45a49c5b-ddd9-4615-b2e3-76098fbe05a3 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:41:31.086552 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45a49c5b-ddd9-4615-b2e3-76098fbe05a3 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:41:31.220854 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-45a49c5b-ddd9-4615-b2e3-76098fbe05a3 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:41:31.228488 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-45a49c5b-ddd9-4615-b2e3-76098fbe05a3 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886" status: 200 len: 1390 microversion: 2.1 time: 0.157350 Oct 30 02:41:31.229716 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3805/7946] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:41:31 2022] GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886 => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:41:32.251854 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6cb2c059-f26e-4dca-b2b5-45c11b2dd067 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:41:32.252480 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6cb2c059-f26e-4dca-b2b5-45c11b2dd067 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 25d39e4d-23a0-4fab-bba8-fd72d48b7886] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:41:32.260511 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6cb2c059-f26e-4dca-b2b5-45c11b2dd067 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:41:32.261008 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6cb2c059-f26e-4dca-b2b5-45c11b2dd067 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:41:32.261496 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6cb2c059-f26e-4dca-b2b5-45c11b2dd067 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:41:32.262203 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6cb2c059-f26e-4dca-b2b5-45c11b2dd067 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:41:32.262663 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6cb2c059-f26e-4dca-b2b5-45c11b2dd067 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:41:32.263100 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6cb2c059-f26e-4dca-b2b5-45c11b2dd067 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:41:32.395647 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6cb2c059-f26e-4dca-b2b5-45c11b2dd067 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:41:32.403670 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6cb2c059-f26e-4dca-b2b5-45c11b2dd067 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886" status: 200 len: 1390 microversion: 2.1 time: 0.155811 Oct 30 02:41:32.404241 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4142/7947] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:41:32 2022] GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886 => generated 1390 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:41:33.427782 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-75859df1-ea74-411e-b978-09e5c8b5bf69 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:41:33.428597 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-75859df1-ea74-411e-b978-09e5c8b5bf69 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 25d39e4d-23a0-4fab-bba8-fd72d48b7886] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:41:33.436093 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-75859df1-ea74-411e-b978-09e5c8b5bf69 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:41:33.436619 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-75859df1-ea74-411e-b978-09e5c8b5bf69 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:41:33.437062 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-75859df1-ea74-411e-b978-09e5c8b5bf69 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:41:33.437788 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-75859df1-ea74-411e-b978-09e5c8b5bf69 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:41:33.438247 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-75859df1-ea74-411e-b978-09e5c8b5bf69 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:41:33.438706 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-75859df1-ea74-411e-b978-09e5c8b5bf69 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:41:33.570271 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-75859df1-ea74-411e-b978-09e5c8b5bf69 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:41:33.578763 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-75859df1-ea74-411e-b978-09e5c8b5bf69 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886" status: 200 len: 1390 microversion: 2.1 time: 0.155083 Oct 30 02:41:33.579341 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3806/7948] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:41:33 2022] GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886 => generated 1390 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:41:34.600856 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-34c3da70-12c3-4a47-be1a-13dae35e3dde tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:41:34.601507 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-34c3da70-12c3-4a47-be1a-13dae35e3dde tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 25d39e4d-23a0-4fab-bba8-fd72d48b7886] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:41:34.608876 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-34c3da70-12c3-4a47-be1a-13dae35e3dde tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:41:34.609425 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-34c3da70-12c3-4a47-be1a-13dae35e3dde tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:41:34.609868 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-34c3da70-12c3-4a47-be1a-13dae35e3dde tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:41:34.610566 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-34c3da70-12c3-4a47-be1a-13dae35e3dde tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:41:34.611031 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-34c3da70-12c3-4a47-be1a-13dae35e3dde tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:41:34.611467 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-34c3da70-12c3-4a47-be1a-13dae35e3dde tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:41:34.742409 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-34c3da70-12c3-4a47-be1a-13dae35e3dde tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:41:34.751337 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-34c3da70-12c3-4a47-be1a-13dae35e3dde tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886" status: 200 len: 1390 microversion: 2.1 time: 0.154422 Oct 30 02:41:34.751926 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4143/7949] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:41:34 2022] GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886 => generated 1390 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:41:34.959610 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-865a3826-6e6e-4363-82ca-58e2b4f5b75a req-c4163351-ac3c-47a4-acab-476f29467c03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25d39e4d-23a0-4fab-bba8-fd72d48b7886", "name": "network-vif-plugged", "status": "completed", "tag": "ec0c199d-4d5b-4723-baab-48e488f88964"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:41:34.970907 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-865a3826-6e6e-4363-82ca-58e2b4f5b75a req-c4163351-ac3c-47a4-acab-476f29467c03 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:41:34.971387 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-865a3826-6e6e-4363-82ca-58e2b4f5b75a req-c4163351-ac3c-47a4-acab-476f29467c03 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:41:34.971818 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-865a3826-6e6e-4363-82ca-58e2b4f5b75a req-c4163351-ac3c-47a4-acab-476f29467c03 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:41:34.983303 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-865a3826-6e6e-4363-82ca-58e2b4f5b75a req-c4163351-ac3c-47a4-acab-476f29467c03 service nova] Creating event network-vif-plugged:ec0c199d-4d5b-4723-baab-48e488f88964 for instance 25d39e4d-23a0-4fab-bba8-fd72d48b7886 on n-h2-master-1 Oct 30 02:41:34.988282 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-865a3826-6e6e-4363-82ca-58e2b4f5b75a req-c4163351-ac3c-47a4-acab-476f29467c03 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032358 Oct 30 02:41:34.988863 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3807/7950] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:41:35.774329 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c44e029c-6171-4060-bd76-0e900f57cc5e tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:41:35.774962 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c44e029c-6171-4060-bd76-0e900f57cc5e tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 25d39e4d-23a0-4fab-bba8-fd72d48b7886] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:41:35.777355 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:41:35.778050 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=6 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:41:35.783722 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c44e029c-6171-4060-bd76-0e900f57cc5e tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:41:35.789859 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c44e029c-6171-4060-bd76-0e900f57cc5e tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:41:35.789859 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c44e029c-6171-4060-bd76-0e900f57cc5e tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:41:35.789859 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c44e029c-6171-4060-bd76-0e900f57cc5e tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:41:35.789859 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c44e029c-6171-4060-bd76-0e900f57cc5e tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:41:35.789859 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c44e029c-6171-4060-bd76-0e900f57cc5e tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:41:35.920014 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c44e029c-6171-4060-bd76-0e900f57cc5e tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:41:35.927940 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c44e029c-6171-4060-bd76-0e900f57cc5e tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886" status: 200 len: 1390 microversion: 2.1 time: 0.157556 Oct 30 02:41:35.928523 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4144/7951] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:41:35 2022] GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886 => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:41:36.951589 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fd05f9e2-6d38-4215-87ad-87c35593ed23 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:41:36.952552 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-fd05f9e2-6d38-4215-87ad-87c35593ed23 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 25d39e4d-23a0-4fab-bba8-fd72d48b7886] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:41:36.954608 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=6 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:41:36.960379 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fd05f9e2-6d38-4215-87ad-87c35593ed23 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:41:36.960862 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fd05f9e2-6d38-4215-87ad-87c35593ed23 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:41:36.961301 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fd05f9e2-6d38-4215-87ad-87c35593ed23 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:41:36.962041 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fd05f9e2-6d38-4215-87ad-87c35593ed23 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:41:36.962495 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fd05f9e2-6d38-4215-87ad-87c35593ed23 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:41:36.962921 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fd05f9e2-6d38-4215-87ad-87c35593ed23 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:41:37.099778 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-fd05f9e2-6d38-4215-87ad-87c35593ed23 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:41:37.108087 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fd05f9e2-6d38-4215-87ad-87c35593ed23 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886" status: 200 len: 1563 microversion: 2.1 time: 0.160740 Oct 30 02:41:37.108673 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3808/7952] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:41:36 2022] GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886 => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:41:37.131381 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e2840b6d-4587-48d7-a82e-a5093abda2d1 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:41:37.132017 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e2840b6d-4587-48d7-a82e-a5093abda2d1 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 25d39e4d-23a0-4fab-bba8-fd72d48b7886] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:41:37.139599 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e2840b6d-4587-48d7-a82e-a5093abda2d1 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:41:37.140104 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e2840b6d-4587-48d7-a82e-a5093abda2d1 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:41:37.140555 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e2840b6d-4587-48d7-a82e-a5093abda2d1 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:41:37.141272 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e2840b6d-4587-48d7-a82e-a5093abda2d1 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:41:37.141769 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e2840b6d-4587-48d7-a82e-a5093abda2d1 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:41:37.142210 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e2840b6d-4587-48d7-a82e-a5093abda2d1 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:41:37.289744 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e2840b6d-4587-48d7-a82e-a5093abda2d1 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:41:37.299107 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e2840b6d-4587-48d7-a82e-a5093abda2d1 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886" status: 200 len: 1563 microversion: 2.1 time: 0.171661 Oct 30 02:41:37.299769 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4145/7953] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:41:37 2022] GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886 => generated 1563 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:41:39.584811 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-14e96be3-c278-4c5e-9476-fb5f78558c65 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:41:39.591159 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-3acb7b0b-693a-4976-92f4-ceaddf9eaaf7 req-ade76a32-cdc1-4f91-b09a-086a930aec22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25d39e4d-23a0-4fab-bba8-fd72d48b7886", "tag": "ec0c199d-4d5b-4723-baab-48e488f88964"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:41:39.597059 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-14e96be3-c278-4c5e-9476-fb5f78558c65 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 25d39e4d-23a0-4fab-bba8-fd72d48b7886] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:41:39.601357 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:41:39.605279 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14e96be3-c278-4c5e-9476-fb5f78558c65 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:41:39.605863 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14e96be3-c278-4c5e-9476-fb5f78558c65 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:41:39.606307 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14e96be3-c278-4c5e-9476-fb5f78558c65 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:41:39.607027 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14e96be3-c278-4c5e-9476-fb5f78558c65 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:41:39.607469 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14e96be3-c278-4c5e-9476-fb5f78558c65 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:41:39.607732 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-3acb7b0b-693a-4976-92f4-ceaddf9eaaf7 req-ade76a32-cdc1-4f91-b09a-086a930aec22 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:41:39.607872 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14e96be3-c278-4c5e-9476-fb5f78558c65 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:41:39.608232 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-3acb7b0b-693a-4976-92f4-ceaddf9eaaf7 req-ade76a32-cdc1-4f91-b09a-086a930aec22 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:41:39.608679 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-3acb7b0b-693a-4976-92f4-ceaddf9eaaf7 req-ade76a32-cdc1-4f91-b09a-086a930aec22 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:41:39.620864 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-3acb7b0b-693a-4976-92f4-ceaddf9eaaf7 req-ade76a32-cdc1-4f91-b09a-086a930aec22 service nova] Creating event network-changed:ec0c199d-4d5b-4723-baab-48e488f88964 for instance 25d39e4d-23a0-4fab-bba8-fd72d48b7886 on n-h2-master-1 Oct 30 02:41:39.626114 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-3acb7b0b-693a-4976-92f4-ceaddf9eaaf7 req-ade76a32-cdc1-4f91-b09a-086a930aec22 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039280 Oct 30 02:41:39.629252 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4146/7954] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:41:39.747279 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-14e96be3-c278-4c5e-9476-fb5f78558c65 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:41:39.755189 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-14e96be3-c278-4c5e-9476-fb5f78558c65 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886" status: 200 len: 1563 microversion: 2.1 time: 0.174623 Oct 30 02:41:39.755973 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3809/7955] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:41:39 2022] GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886 => generated 1563 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:42:00.994010 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=46 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:42:00.999340 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8c7904a2-f5c6-4ed7-a575-beea5459a34a tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:42:01.001669 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8c7904a2-f5c6-4ed7-a575-beea5459a34a tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 25d39e4d-23a0-4fab-bba8-fd72d48b7886] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:42:01.008184 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8c7904a2-f5c6-4ed7-a575-beea5459a34a tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:42:01.008689 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8c7904a2-f5c6-4ed7-a575-beea5459a34a tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:42:01.009143 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8c7904a2-f5c6-4ed7-a575-beea5459a34a tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:42:01.009884 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8c7904a2-f5c6-4ed7-a575-beea5459a34a tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:42:01.010351 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8c7904a2-f5c6-4ed7-a575-beea5459a34a tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:42:01.010791 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8c7904a2-f5c6-4ed7-a575-beea5459a34a tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:42:01.080373 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8c7904a2-f5c6-4ed7-a575-beea5459a34a tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "POST /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886/action" status: 200 len: 24559 microversion: 2.1 time: 0.088215 Oct 30 02:42:01.081057 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4147/7956] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 02:42:00 2022] POST /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886/action => generated 24559 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 02:42:12.142202 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d512c2b9-4063-49bf-ae34-3f33ff0cdd2b tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:42:12.144638 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=9 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:42:12.145448 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=34 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:42:12.150141 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d512c2b9-4063-49bf-ae34-3f33ff0cdd2b tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:42:12.150575 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d512c2b9-4063-49bf-ae34-3f33ff0cdd2b tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:42:12.151012 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d512c2b9-4063-49bf-ae34-3f33ff0cdd2b tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:42:12.173381 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d512c2b9-4063-49bf-ae34-3f33ff0cdd2b tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 25d39e4d-23a0-4fab-bba8-fd72d48b7886] Going to try to stop instance {{(pid=121103) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 30 02:42:12.351044 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d512c2b9-4063-49bf-ae34-3f33ff0cdd2b tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "POST /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886/action" status: 202 len: 0 microversion: 2.1 time: 0.212639 Oct 30 02:42:12.351650 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3810/7957] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 02:42:12 2022] POST /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 02:42:12.360744 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e781df9b-fccc-4c0e-9a2a-efd3df10ab9b tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:42:12.361499 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e781df9b-fccc-4c0e-9a2a-efd3df10ab9b tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 25d39e4d-23a0-4fab-bba8-fd72d48b7886] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:42:12.364711 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=4 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:42:12.370423 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e781df9b-fccc-4c0e-9a2a-efd3df10ab9b tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:42:12.370922 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e781df9b-fccc-4c0e-9a2a-efd3df10ab9b tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:42:12.371852 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e781df9b-fccc-4c0e-9a2a-efd3df10ab9b tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:42:12.372575 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e781df9b-fccc-4c0e-9a2a-efd3df10ab9b tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:42:12.373044 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e781df9b-fccc-4c0e-9a2a-efd3df10ab9b tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:42:12.373514 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e781df9b-fccc-4c0e-9a2a-efd3df10ab9b tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:42:12.505733 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e781df9b-fccc-4c0e-9a2a-efd3df10ab9b tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:42:12.514696 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e781df9b-fccc-4c0e-9a2a-efd3df10ab9b tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886" status: 200 len: 1692 microversion: 2.1 time: 0.158531 Oct 30 02:42:12.515269 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4148/7958] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:42:12 2022] GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886 => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:42:13.540510 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0c6ff97a-ee68-44cb-93f1-dd94a5a9f551 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:42:13.541478 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0c6ff97a-ee68-44cb-93f1-dd94a5a9f551 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 25d39e4d-23a0-4fab-bba8-fd72d48b7886] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:42:13.547733 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c6ff97a-ee68-44cb-93f1-dd94a5a9f551 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:42:13.548222 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c6ff97a-ee68-44cb-93f1-dd94a5a9f551 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:42:13.548662 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c6ff97a-ee68-44cb-93f1-dd94a5a9f551 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:42:13.549375 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c6ff97a-ee68-44cb-93f1-dd94a5a9f551 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:42:13.549835 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c6ff97a-ee68-44cb-93f1-dd94a5a9f551 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:42:13.550265 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0c6ff97a-ee68-44cb-93f1-dd94a5a9f551 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:42:13.683932 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0c6ff97a-ee68-44cb-93f1-dd94a5a9f551 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:42:13.691662 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0c6ff97a-ee68-44cb-93f1-dd94a5a9f551 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886" status: 200 len: 1692 microversion: 2.1 time: 0.156396 Oct 30 02:42:13.692243 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3811/7959] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:42:13 2022] GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886 => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:42:14.715402 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b5e23225-7652-4c94-9f09-7cf5cb79d390 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:42:14.716032 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b5e23225-7652-4c94-9f09-7cf5cb79d390 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 25d39e4d-23a0-4fab-bba8-fd72d48b7886] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:42:14.723145 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b5e23225-7652-4c94-9f09-7cf5cb79d390 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:42:14.723643 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b5e23225-7652-4c94-9f09-7cf5cb79d390 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:42:14.724093 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b5e23225-7652-4c94-9f09-7cf5cb79d390 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:42:14.724799 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b5e23225-7652-4c94-9f09-7cf5cb79d390 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:42:14.725266 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b5e23225-7652-4c94-9f09-7cf5cb79d390 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:42:14.725734 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b5e23225-7652-4c94-9f09-7cf5cb79d390 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:42:14.854812 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b5e23225-7652-4c94-9f09-7cf5cb79d390 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:42:14.862717 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b5e23225-7652-4c94-9f09-7cf5cb79d390 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886" status: 200 len: 1692 microversion: 2.1 time: 0.151259 Oct 30 02:42:14.863287 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4149/7960] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:42:14 2022] GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886 => generated 1692 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:42:15.886005 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0dad7eb6-3718-4259-aaa4-b2ca01e3ae87 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:42:15.886620 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0dad7eb6-3718-4259-aaa4-b2ca01e3ae87 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 25d39e4d-23a0-4fab-bba8-fd72d48b7886] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:42:15.893618 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0dad7eb6-3718-4259-aaa4-b2ca01e3ae87 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:42:15.894106 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0dad7eb6-3718-4259-aaa4-b2ca01e3ae87 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:42:15.894549 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0dad7eb6-3718-4259-aaa4-b2ca01e3ae87 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:42:15.895248 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0dad7eb6-3718-4259-aaa4-b2ca01e3ae87 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:42:15.895706 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0dad7eb6-3718-4259-aaa4-b2ca01e3ae87 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:42:15.896505 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0dad7eb6-3718-4259-aaa4-b2ca01e3ae87 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:42:16.026289 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0dad7eb6-3718-4259-aaa4-b2ca01e3ae87 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:42:16.033984 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0dad7eb6-3718-4259-aaa4-b2ca01e3ae87 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886" status: 200 len: 1692 microversion: 2.1 time: 0.151924 Oct 30 02:42:16.034553 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3812/7961] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:42:15 2022] GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886 => generated 1692 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:42:17.057239 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f3d56e19-2494-47b5-8fd4-96f74fb21a63 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:42:17.057902 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f3d56e19-2494-47b5-8fd4-96f74fb21a63 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 25d39e4d-23a0-4fab-bba8-fd72d48b7886] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:42:17.065483 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3d56e19-2494-47b5-8fd4-96f74fb21a63 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:42:17.065984 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3d56e19-2494-47b5-8fd4-96f74fb21a63 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:42:17.066438 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3d56e19-2494-47b5-8fd4-96f74fb21a63 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:42:17.067144 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3d56e19-2494-47b5-8fd4-96f74fb21a63 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:42:17.067614 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3d56e19-2494-47b5-8fd4-96f74fb21a63 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:42:17.068056 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3d56e19-2494-47b5-8fd4-96f74fb21a63 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:42:17.200305 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f3d56e19-2494-47b5-8fd4-96f74fb21a63 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:42:17.208054 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f3d56e19-2494-47b5-8fd4-96f74fb21a63 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886" status: 200 len: 1692 microversion: 2.1 time: 0.154747 Oct 30 02:42:17.208637 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4150/7962] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:42:17 2022] GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886 => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:42:18.231453 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7478a417-f0be-4a84-b0cb-777e5e4dc81b tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:42:18.232099 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7478a417-f0be-4a84-b0cb-777e5e4dc81b tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 25d39e4d-23a0-4fab-bba8-fd72d48b7886] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:42:18.238727 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7478a417-f0be-4a84-b0cb-777e5e4dc81b tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:42:18.239214 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7478a417-f0be-4a84-b0cb-777e5e4dc81b tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:42:18.239651 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7478a417-f0be-4a84-b0cb-777e5e4dc81b tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:42:18.240341 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7478a417-f0be-4a84-b0cb-777e5e4dc81b tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:42:18.240793 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7478a417-f0be-4a84-b0cb-777e5e4dc81b tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:42:18.241216 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7478a417-f0be-4a84-b0cb-777e5e4dc81b tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:42:18.370817 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7478a417-f0be-4a84-b0cb-777e5e4dc81b tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:42:18.379208 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7478a417-f0be-4a84-b0cb-777e5e4dc81b tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886" status: 200 len: 1692 microversion: 2.1 time: 0.151925 Oct 30 02:42:18.380216 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3813/7963] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:42:18 2022] GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886 => generated 1692 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:42:19.403856 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5e60ce86-b5ea-40d1-8d47-0bc01c9d4bad tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:42:19.404504 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5e60ce86-b5ea-40d1-8d47-0bc01c9d4bad tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 25d39e4d-23a0-4fab-bba8-fd72d48b7886] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:42:19.411436 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5e60ce86-b5ea-40d1-8d47-0bc01c9d4bad tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:42:19.411947 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5e60ce86-b5ea-40d1-8d47-0bc01c9d4bad tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:42:19.412401 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5e60ce86-b5ea-40d1-8d47-0bc01c9d4bad tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:42:19.413152 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5e60ce86-b5ea-40d1-8d47-0bc01c9d4bad tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:42:19.413681 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5e60ce86-b5ea-40d1-8d47-0bc01c9d4bad tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:42:19.414096 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5e60ce86-b5ea-40d1-8d47-0bc01c9d4bad tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:42:19.547142 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5e60ce86-b5ea-40d1-8d47-0bc01c9d4bad tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:42:19.554957 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5e60ce86-b5ea-40d1-8d47-0bc01c9d4bad tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886" status: 200 len: 1692 microversion: 2.1 time: 0.155760 Oct 30 02:42:19.555532 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4151/7964] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:42:19 2022] GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886 => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:42:20.577804 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ad9f8547-a4ab-437e-b639-533c5c3f4b2a tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:42:20.578333 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ad9f8547-a4ab-437e-b639-533c5c3f4b2a tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 25d39e4d-23a0-4fab-bba8-fd72d48b7886] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:42:20.585180 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ad9f8547-a4ab-437e-b639-533c5c3f4b2a tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:42:20.585702 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ad9f8547-a4ab-437e-b639-533c5c3f4b2a tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:42:20.586143 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ad9f8547-a4ab-437e-b639-533c5c3f4b2a tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:42:20.586835 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ad9f8547-a4ab-437e-b639-533c5c3f4b2a tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:42:20.587290 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ad9f8547-a4ab-437e-b639-533c5c3f4b2a tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:42:20.587717 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ad9f8547-a4ab-437e-b639-533c5c3f4b2a tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:42:20.723897 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ad9f8547-a4ab-437e-b639-533c5c3f4b2a tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:42:20.732257 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ad9f8547-a4ab-437e-b639-533c5c3f4b2a tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886" status: 200 len: 1692 microversion: 2.1 time: 0.158442 Oct 30 02:42:20.739953 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3814/7965] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:42:20 2022] GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886 => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:42:21.756049 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-962ece1a-1c11-42b2-a3ac-b16ac4435a9f tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:42:21.756685 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-962ece1a-1c11-42b2-a3ac-b16ac4435a9f tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 25d39e4d-23a0-4fab-bba8-fd72d48b7886] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:42:21.763716 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-962ece1a-1c11-42b2-a3ac-b16ac4435a9f tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:42:21.764186 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-962ece1a-1c11-42b2-a3ac-b16ac4435a9f tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:42:21.769286 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-962ece1a-1c11-42b2-a3ac-b16ac4435a9f tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:42:21.769286 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-962ece1a-1c11-42b2-a3ac-b16ac4435a9f tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:42:21.769286 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-962ece1a-1c11-42b2-a3ac-b16ac4435a9f tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:42:21.769286 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-962ece1a-1c11-42b2-a3ac-b16ac4435a9f tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:42:21.899230 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-962ece1a-1c11-42b2-a3ac-b16ac4435a9f tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:42:21.906985 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-962ece1a-1c11-42b2-a3ac-b16ac4435a9f tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886" status: 200 len: 1692 microversion: 2.1 time: 0.155370 Oct 30 02:42:21.907559 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4152/7966] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:42:21 2022] GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886 => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:42:22.930716 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-dbbce2ee-bf0f-4950-90ef-50ef95e3f398 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:42:22.931335 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-dbbce2ee-bf0f-4950-90ef-50ef95e3f398 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 25d39e4d-23a0-4fab-bba8-fd72d48b7886] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:42:22.938376 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dbbce2ee-bf0f-4950-90ef-50ef95e3f398 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:42:22.938862 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dbbce2ee-bf0f-4950-90ef-50ef95e3f398 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:42:22.939302 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dbbce2ee-bf0f-4950-90ef-50ef95e3f398 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:42:22.939996 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dbbce2ee-bf0f-4950-90ef-50ef95e3f398 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:42:22.940454 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dbbce2ee-bf0f-4950-90ef-50ef95e3f398 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:42:22.940881 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dbbce2ee-bf0f-4950-90ef-50ef95e3f398 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:42:23.069565 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-dbbce2ee-bf0f-4950-90ef-50ef95e3f398 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:42:23.077502 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-dbbce2ee-bf0f-4950-90ef-50ef95e3f398 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886" status: 200 len: 1692 microversion: 2.1 time: 0.150672 Oct 30 02:42:23.078079 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3815/7967] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:42:22 2022] GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886 => generated 1692 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:42:24.101664 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d1eae650-71ae-48b2-a7e1-f7f44b1206c1 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:42:24.102210 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d1eae650-71ae-48b2-a7e1-f7f44b1206c1 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 25d39e4d-23a0-4fab-bba8-fd72d48b7886] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:42:24.109165 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1eae650-71ae-48b2-a7e1-f7f44b1206c1 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:42:24.109705 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1eae650-71ae-48b2-a7e1-f7f44b1206c1 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:42:24.110161 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1eae650-71ae-48b2-a7e1-f7f44b1206c1 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:42:24.110871 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1eae650-71ae-48b2-a7e1-f7f44b1206c1 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:42:24.111346 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1eae650-71ae-48b2-a7e1-f7f44b1206c1 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:42:24.111785 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1eae650-71ae-48b2-a7e1-f7f44b1206c1 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:42:24.242837 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d1eae650-71ae-48b2-a7e1-f7f44b1206c1 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:42:24.250557 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d1eae650-71ae-48b2-a7e1-f7f44b1206c1 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886" status: 200 len: 1692 microversion: 2.1 time: 0.153005 Oct 30 02:42:24.251146 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4153/7968] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:42:24 2022] GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886 => generated 1692 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:42:25.273630 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-538b367f-8284-45eb-bb2c-5da052d629f0 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:42:25.274247 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-538b367f-8284-45eb-bb2c-5da052d629f0 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 25d39e4d-23a0-4fab-bba8-fd72d48b7886] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:42:25.281619 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-538b367f-8284-45eb-bb2c-5da052d629f0 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:42:25.282104 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-538b367f-8284-45eb-bb2c-5da052d629f0 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:42:25.282533 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-538b367f-8284-45eb-bb2c-5da052d629f0 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:42:25.283221 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-538b367f-8284-45eb-bb2c-5da052d629f0 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:42:25.283667 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-538b367f-8284-45eb-bb2c-5da052d629f0 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:42:25.284099 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-538b367f-8284-45eb-bb2c-5da052d629f0 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:42:25.420647 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-538b367f-8284-45eb-bb2c-5da052d629f0 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:42:25.428464 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-538b367f-8284-45eb-bb2c-5da052d629f0 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886" status: 200 len: 1692 microversion: 2.1 time: 0.158793 Oct 30 02:42:25.429046 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3816/7969] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:42:25 2022] GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886 => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:42:26.451766 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bee94ef2-a464-451f-8a68-1d92a5f760da tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:42:26.452394 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bee94ef2-a464-451f-8a68-1d92a5f760da tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 25d39e4d-23a0-4fab-bba8-fd72d48b7886] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:42:26.459319 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bee94ef2-a464-451f-8a68-1d92a5f760da tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:42:26.459818 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bee94ef2-a464-451f-8a68-1d92a5f760da tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:42:26.460271 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bee94ef2-a464-451f-8a68-1d92a5f760da tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:42:26.460982 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bee94ef2-a464-451f-8a68-1d92a5f760da tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:42:26.461820 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bee94ef2-a464-451f-8a68-1d92a5f760da tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:42:26.461949 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bee94ef2-a464-451f-8a68-1d92a5f760da tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:42:26.595188 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-bee94ef2-a464-451f-8a68-1d92a5f760da tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:42:26.602965 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bee94ef2-a464-451f-8a68-1d92a5f760da tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886" status: 200 len: 1692 microversion: 2.1 time: 0.155186 Oct 30 02:42:26.603547 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4154/7970] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:42:26 2022] GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886 => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:42:27.626291 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6ac69508-a455-4af4-9f35-c116e81434b5 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:42:27.626291 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6ac69508-a455-4af4-9f35-c116e81434b5 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 25d39e4d-23a0-4fab-bba8-fd72d48b7886] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:42:27.633993 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ac69508-a455-4af4-9f35-c116e81434b5 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:42:27.634488 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ac69508-a455-4af4-9f35-c116e81434b5 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:42:27.634935 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ac69508-a455-4af4-9f35-c116e81434b5 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:42:27.635635 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ac69508-a455-4af4-9f35-c116e81434b5 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:42:27.636102 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ac69508-a455-4af4-9f35-c116e81434b5 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:42:27.636533 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ac69508-a455-4af4-9f35-c116e81434b5 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:42:27.769787 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6ac69508-a455-4af4-9f35-c116e81434b5 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:42:27.778437 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6ac69508-a455-4af4-9f35-c116e81434b5 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886" status: 200 len: 1692 microversion: 2.1 time: 0.156119 Oct 30 02:42:27.779046 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3817/7971] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:42:27 2022] GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886 => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:42:28.803176 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-24c7aa0b-27cc-4002-9370-e10c967792b9 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:42:28.803776 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-24c7aa0b-27cc-4002-9370-e10c967792b9 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 25d39e4d-23a0-4fab-bba8-fd72d48b7886] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:42:28.810903 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24c7aa0b-27cc-4002-9370-e10c967792b9 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:42:28.811396 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24c7aa0b-27cc-4002-9370-e10c967792b9 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:42:28.811843 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24c7aa0b-27cc-4002-9370-e10c967792b9 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:42:28.812576 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24c7aa0b-27cc-4002-9370-e10c967792b9 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:42:28.813006 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24c7aa0b-27cc-4002-9370-e10c967792b9 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:42:28.813541 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24c7aa0b-27cc-4002-9370-e10c967792b9 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:42:28.942437 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-24c7aa0b-27cc-4002-9370-e10c967792b9 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:42:28.950138 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-24c7aa0b-27cc-4002-9370-e10c967792b9 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886" status: 200 len: 1669 microversion: 2.1 time: 0.151126 Oct 30 02:42:28.950705 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4155/7972] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:42:28 2022] GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886 => generated 1669 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:42:30.042250 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5058b9d6-bd39-4ca2-aba7-6d8c440bef64 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:42:30.044931 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5058b9d6-bd39-4ca2-aba7-6d8c440bef64 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 25d39e4d-23a0-4fab-bba8-fd72d48b7886] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:42:30.051756 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5058b9d6-bd39-4ca2-aba7-6d8c440bef64 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:42:30.052236 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5058b9d6-bd39-4ca2-aba7-6d8c440bef64 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:42:30.052666 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5058b9d6-bd39-4ca2-aba7-6d8c440bef64 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:42:30.053382 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5058b9d6-bd39-4ca2-aba7-6d8c440bef64 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:42:30.053837 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5058b9d6-bd39-4ca2-aba7-6d8c440bef64 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:42:30.054261 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5058b9d6-bd39-4ca2-aba7-6d8c440bef64 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:42:30.116607 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5058b9d6-bd39-4ca2-aba7-6d8c440bef64 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "POST /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886/action" status: 200 len: 38397 microversion: 2.1 time: 0.078434 Oct 30 02:42:30.117265 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3818/7973] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 02:42:30 2022] POST /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886/action => generated 38397 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 02:42:30.129832 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9c0d47f6-4544-45d7-9889-e24e1eadeafa tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:42:30.136808 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9c0d47f6-4544-45d7-9889-e24e1eadeafa tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:42:30.137309 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9c0d47f6-4544-45d7-9889-e24e1eadeafa tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:42:30.137791 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9c0d47f6-4544-45d7-9889-e24e1eadeafa tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:42:30.159801 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9c0d47f6-4544-45d7-9889-e24e1eadeafa tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 25d39e4d-23a0-4fab-bba8-fd72d48b7886] Going to try to start instance {{(pid=121102) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 30 02:42:30.339973 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9c0d47f6-4544-45d7-9889-e24e1eadeafa tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "POST /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886/action" status: 202 len: 0 microversion: 2.1 time: 0.213886 Oct 30 02:42:30.341063 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4156/7974] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 02:42:30 2022] POST /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 02:42:30.350008 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4aba655c-46f8-4c72-b762-9638b0278664 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:42:30.350867 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4aba655c-46f8-4c72-b762-9638b0278664 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 25d39e4d-23a0-4fab-bba8-fd72d48b7886] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:42:30.358381 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4aba655c-46f8-4c72-b762-9638b0278664 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:42:30.358870 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4aba655c-46f8-4c72-b762-9638b0278664 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:42:30.359309 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4aba655c-46f8-4c72-b762-9638b0278664 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:42:30.360006 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4aba655c-46f8-4c72-b762-9638b0278664 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:42:30.360464 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4aba655c-46f8-4c72-b762-9638b0278664 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:42:30.360893 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4aba655c-46f8-4c72-b762-9638b0278664 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:42:30.492844 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4aba655c-46f8-4c72-b762-9638b0278664 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:42:30.502512 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4aba655c-46f8-4c72-b762-9638b0278664 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886" status: 200 len: 1678 microversion: 2.1 time: 0.156834 Oct 30 02:42:30.503090 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3819/7975] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:42:30 2022] GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:42:31.527365 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-221fc038-6656-421a-9932-ed4b55f3adf5 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:42:31.528076 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-221fc038-6656-421a-9932-ed4b55f3adf5 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 25d39e4d-23a0-4fab-bba8-fd72d48b7886] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:42:31.534331 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-221fc038-6656-421a-9932-ed4b55f3adf5 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:42:31.534824 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-221fc038-6656-421a-9932-ed4b55f3adf5 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:42:31.535275 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-221fc038-6656-421a-9932-ed4b55f3adf5 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:42:31.535971 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-221fc038-6656-421a-9932-ed4b55f3adf5 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:42:31.536432 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-221fc038-6656-421a-9932-ed4b55f3adf5 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:42:31.536899 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-221fc038-6656-421a-9932-ed4b55f3adf5 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:42:31.670857 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-221fc038-6656-421a-9932-ed4b55f3adf5 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:42:31.678607 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-221fc038-6656-421a-9932-ed4b55f3adf5 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886" status: 200 len: 1678 microversion: 2.1 time: 0.156353 Oct 30 02:42:31.679182 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4157/7976] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:42:31 2022] GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:42:32.703623 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e739e66c-b7ab-48c1-9539-94973935f523 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:42:32.704295 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e739e66c-b7ab-48c1-9539-94973935f523 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 25d39e4d-23a0-4fab-bba8-fd72d48b7886] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:42:32.711835 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e739e66c-b7ab-48c1-9539-94973935f523 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:42:32.712325 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e739e66c-b7ab-48c1-9539-94973935f523 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:42:32.712773 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e739e66c-b7ab-48c1-9539-94973935f523 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:42:32.713501 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e739e66c-b7ab-48c1-9539-94973935f523 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:42:32.713965 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e739e66c-b7ab-48c1-9539-94973935f523 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:42:32.714396 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e739e66c-b7ab-48c1-9539-94973935f523 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:42:32.852280 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e739e66c-b7ab-48c1-9539-94973935f523 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:42:32.860748 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e739e66c-b7ab-48c1-9539-94973935f523 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886" status: 200 len: 1682 microversion: 2.1 time: 0.161141 Oct 30 02:42:32.861355 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3820/7977] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:42:32 2022] GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:42:57.048160 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-95f7be4e-1a6d-403b-b85e-da0ef8ede266 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:42:57.050467 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-95f7be4e-1a6d-403b-b85e-da0ef8ede266 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 25d39e4d-23a0-4fab-bba8-fd72d48b7886] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:42:57.052681 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=23 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:42:57.053420 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:42:57.058778 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-95f7be4e-1a6d-403b-b85e-da0ef8ede266 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:42:57.059286 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-95f7be4e-1a6d-403b-b85e-da0ef8ede266 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:42:57.059739 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-95f7be4e-1a6d-403b-b85e-da0ef8ede266 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:42:57.060446 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-95f7be4e-1a6d-403b-b85e-da0ef8ede266 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:42:57.060915 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-95f7be4e-1a6d-403b-b85e-da0ef8ede266 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:42:57.061382 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-95f7be4e-1a6d-403b-b85e-da0ef8ede266 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:42:57.130945 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-95f7be4e-1a6d-403b-b85e-da0ef8ede266 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "POST /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886/action" status: 200 len: 62948 microversion: 2.1 time: 0.087411 Oct 30 02:42:57.131617 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4158/7978] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 02:42:57 2022] POST /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886/action => generated 62948 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 02:43:04.491526 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-39ff5461-989c-4489-9d10-cb4a2d482829 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:43:04.492150 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-39ff5461-989c-4489-9d10-cb4a2d482829 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 25d39e4d-23a0-4fab-bba8-fd72d48b7886] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:43:04.497323 n-d-master-1 devstack@n-api.service[121103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 30 02:43:04.497541 n-d-master-1 devstack@n-api.service[121103]: Sun Oct 30 02:43:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886 (ip 10.222.0.13) !!! Oct 30 02:43:04.500475 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=22 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:43:04.501203 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:43:04.506824 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-39ff5461-989c-4489-9d10-cb4a2d482829 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:43:04.507808 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-39ff5461-989c-4489-9d10-cb4a2d482829 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:43:04.507808 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-39ff5461-989c-4489-9d10-cb4a2d482829 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:43:04.508660 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-39ff5461-989c-4489-9d10-cb4a2d482829 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:43:04.509125 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-39ff5461-989c-4489-9d10-cb4a2d482829 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:43:04.509586 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-39ff5461-989c-4489-9d10-cb4a2d482829 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:43:04.542586 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-39ff5461-989c-4489-9d10-cb4a2d482829 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 25d39e4d-23a0-4fab-bba8-fd72d48b7886] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 02:43:04.554680 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-1908997a-a36d-444c-ba2f-198671faed43 req-f6260842-01cf-4b03-9452-86869ba731db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25d39e4d-23a0-4fab-bba8-fd72d48b7886", "tag": "ec0c199d-4d5b-4723-baab-48e488f88964"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:43:04.568353 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-1908997a-a36d-444c-ba2f-198671faed43 req-f6260842-01cf-4b03-9452-86869ba731db service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:43:04.568850 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-1908997a-a36d-444c-ba2f-198671faed43 req-f6260842-01cf-4b03-9452-86869ba731db service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:43:04.569297 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-1908997a-a36d-444c-ba2f-198671faed43 req-f6260842-01cf-4b03-9452-86869ba731db service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:43:04.580763 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-1908997a-a36d-444c-ba2f-198671faed43 req-f6260842-01cf-4b03-9452-86869ba731db service nova] Creating event network-changed:ec0c199d-4d5b-4723-baab-48e488f88964 for instance 25d39e4d-23a0-4fab-bba8-fd72d48b7886 on n-h2-master-1 Oct 30 02:43:04.586206 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-1908997a-a36d-444c-ba2f-198671faed43 req-f6260842-01cf-4b03-9452-86869ba731db service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096696 Oct 30 02:43:04.587132 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4159/7979] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:43:04.889261 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-39ff5461-989c-4489-9d10-cb4a2d482829 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "DELETE /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886" status: 204 len: 0 microversion: 2.1 time: 0.401350 Oct 30 02:43:04.892978 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3821/7980] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 02:43:04 2022] DELETE /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 02:43:04.899299 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6d1a1dee-be69-4a45-9d5b-6ca13bae167c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:43:04.900014 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6d1a1dee-be69-4a45-9d5b-6ca13bae167c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 25d39e4d-23a0-4fab-bba8-fd72d48b7886] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:43:04.907032 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d1a1dee-be69-4a45-9d5b-6ca13bae167c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:43:04.907826 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d1a1dee-be69-4a45-9d5b-6ca13bae167c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:43:04.908272 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d1a1dee-be69-4a45-9d5b-6ca13bae167c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:43:04.909221 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d1a1dee-be69-4a45-9d5b-6ca13bae167c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:43:04.909929 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d1a1dee-be69-4a45-9d5b-6ca13bae167c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:43:04.910376 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d1a1dee-be69-4a45-9d5b-6ca13bae167c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:43:05.049848 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6d1a1dee-be69-4a45-9d5b-6ca13bae167c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:43:05.057732 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6d1a1dee-be69-4a45-9d5b-6ca13bae167c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886" status: 200 len: 1688 microversion: 2.1 time: 0.163119 Oct 30 02:43:05.058318 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4160/7981] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:43:04 2022] GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886 => generated 1688 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:43:06.081524 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bfe8db01-6032-4577-ae45-63ad71f91199 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:43:06.082258 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-bfe8db01-6032-4577-ae45-63ad71f91199 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 25d39e4d-23a0-4fab-bba8-fd72d48b7886] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:43:06.089197 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bfe8db01-6032-4577-ae45-63ad71f91199 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:43:06.089718 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bfe8db01-6032-4577-ae45-63ad71f91199 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:43:06.090157 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bfe8db01-6032-4577-ae45-63ad71f91199 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:43:06.090844 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bfe8db01-6032-4577-ae45-63ad71f91199 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:43:06.091296 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bfe8db01-6032-4577-ae45-63ad71f91199 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:43:06.091719 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bfe8db01-6032-4577-ae45-63ad71f91199 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:43:06.224341 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-bfe8db01-6032-4577-ae45-63ad71f91199 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:43:06.232379 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bfe8db01-6032-4577-ae45-63ad71f91199 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886" status: 200 len: 1688 microversion: 2.1 time: 0.155121 Oct 30 02:43:06.232957 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3822/7982] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:43:06 2022] GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886 => generated 1688 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:43:07.018877 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-70f068f0-9f45-4def-a585-f31b8b5a0194 req-d6156844-be49-4b40-a514-e9b1966136df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25d39e4d-23a0-4fab-bba8-fd72d48b7886", "name": "network-vif-deleted", "tag": "ec0c199d-4d5b-4723-baab-48e488f88964"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:43:07.029262 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-70f068f0-9f45-4def-a585-f31b8b5a0194 req-d6156844-be49-4b40-a514-e9b1966136df service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:43:07.029840 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-70f068f0-9f45-4def-a585-f31b8b5a0194 req-d6156844-be49-4b40-a514-e9b1966136df service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:43:07.030287 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-70f068f0-9f45-4def-a585-f31b8b5a0194 req-d6156844-be49-4b40-a514-e9b1966136df service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:43:07.041559 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-70f068f0-9f45-4def-a585-f31b8b5a0194 req-d6156844-be49-4b40-a514-e9b1966136df service nova] Creating event network-vif-deleted:ec0c199d-4d5b-4723-baab-48e488f88964 for instance 25d39e4d-23a0-4fab-bba8-fd72d48b7886 on n-h2-master-1 Oct 30 02:43:07.046952 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-70f068f0-9f45-4def-a585-f31b8b5a0194 req-d6156844-be49-4b40-a514-e9b1966136df service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031491 Oct 30 02:43:07.047580 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4161/7983] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:43:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:43:07.256530 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-21854355-c607-4a52-8aac-eb59afb569f0 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:43:07.257183 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-21854355-c607-4a52-8aac-eb59afb569f0 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 25d39e4d-23a0-4fab-bba8-fd72d48b7886] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:43:07.264081 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21854355-c607-4a52-8aac-eb59afb569f0 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:43:07.264572 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21854355-c607-4a52-8aac-eb59afb569f0 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:43:07.265013 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21854355-c607-4a52-8aac-eb59afb569f0 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:43:07.265738 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21854355-c607-4a52-8aac-eb59afb569f0 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:43:07.266197 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21854355-c607-4a52-8aac-eb59afb569f0 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:43:07.266625 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21854355-c607-4a52-8aac-eb59afb569f0 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:43:07.336268 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-21854355-c607-4a52-8aac-eb59afb569f0 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:43:07.345467 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-21854355-c607-4a52-8aac-eb59afb569f0 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886" status: 200 len: 1351 microversion: 2.1 time: 0.092886 Oct 30 02:43:07.350089 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3823/7984] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:43:07 2022] GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886 => generated 1351 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:43:08.369748 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d2a0c9f2-adab-4459-8167-5b468c776cd2 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:43:08.370490 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d2a0c9f2-adab-4459-8167-5b468c776cd2 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 25d39e4d-23a0-4fab-bba8-fd72d48b7886] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:43:08.377169 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2a0c9f2-adab-4459-8167-5b468c776cd2 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:43:08.377697 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2a0c9f2-adab-4459-8167-5b468c776cd2 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:43:08.378150 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2a0c9f2-adab-4459-8167-5b468c776cd2 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:43:08.378878 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2a0c9f2-adab-4459-8167-5b468c776cd2 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:43:08.379354 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2a0c9f2-adab-4459-8167-5b468c776cd2 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:43:08.379801 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2a0c9f2-adab-4459-8167-5b468c776cd2 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:43:08.393847 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-d2a0c9f2-adab-4459-8167-5b468c776cd2 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] HTTP exception thrown: Instance 25d39e4d-23a0-4fab-bba8-fd72d48b7886 could not be found. Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d2a0c9f2-adab-4459-8167-5b468c776cd2 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Request method failure captured: Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886 HTTP/1.1 Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXeMhmBt07CnqlsQCCZQN6u-PC4AsgU8WequZ4Kud9tCoyqv8mAHQMcaho4Jbx4RzGkeSupfwjjjBU9nby25ZfrQmG3SvdDYuPUoYCpt4XAVTrkn_pjoiCb5AJLHMr5UnOHpTN2d7v4LRRKuXP0k9zso8ZvHlSuYjg8x6U3J73q4pZ0Q Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: 4a813c90e3ec437fbf1f37dbb2b340d4 Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-521135141 Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a813c90e3ec437fbf1f37dbb2b340d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4a813c90e3ec437fbf1f37dbb2b340d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4a813c90e3ec437fbf1f37dbb2b340d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a813c90e3ec437fbf1f37dbb2b340d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-TestNetworkAdvancedServerOps-521135141 Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: 4a813c90e3ec437fbf1f37dbb2b340d4 Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-521135141 Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-TestNetworkAdvancedServerOps-521135141-project Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: ef194f895a0c404abc08cad62a3b566d Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-TestNetworkAdvancedServerOps-521135141-project Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 25d39e4d-23a0-4fab-bba8-fd72d48b7886 could not be found. Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '25d39e4d-23a0-4fab-bba8-fd72d48b7886'} Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25d39e4d-23a0-4fab-bba8-fd72d48b7886 could not be found. Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25d39e4d-23a0-4fab-bba8-fd72d48b7886 could not be found. Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:43:08.395535 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:43:08.405778 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:43:08.405778 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:43:08.405778 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:43:08.405778 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:43:08.405778 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:43:08.405778 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:43:08.405778 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25d39e4d-23a0-4fab-bba8-fd72d48b7886 could not be found. Oct 30 02:43:08.405778 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:43:08.405778 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d2a0c9f2-adab-4459-8167-5b468c776cd2 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Returning 404 to user: Instance 25d39e4d-23a0-4fab-bba8-fd72d48b7886 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:43:08.405778 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d2a0c9f2-adab-4459-8167-5b468c776cd2 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886" status: 404 len: 111 microversion: 2.1 time: 0.032612 Oct 30 02:43:08.405778 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4162/7985] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:43:08 2022] GET /compute/v2.1/servers/25d39e4d-23a0-4fab-bba8-fd72d48b7886 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 02:43:11.872941 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c74b111d-d0a2-4a9d-9bfa-a400ae75cd66 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '.version_select at 0x7f44d0328310>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:43:11.954516 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c74b111d-d0a2-4a9d-9bfa-a400ae75cd66 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-762435059" status: 202 len: 0 microversion: 2.1 time: 0.085704 Oct 30 02:43:11.955238 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3824/7986] 10.222.0.13 () {58 vars in 1281 bytes} [Sun Oct 30 02:43:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-762435059 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 30 02:43:11.990099 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8751136f-4fa0-40ef-9e56-cd0a210afaa4 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Action: 'create', calling method: .version_select at 0x7f44c70bc3a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-731109607", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbKbNO2PIL+i91oIEC1XnhRLdzuidVvEYs9P/8YDdPqPzUSJ5lTcSTveumfv9LTjdybJFRBnNcWAXc7EiadsKWeohstwqADyjQhRz7E6bsw1ECyB8QBil/Ie3ZSWjOR3A=="}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:43:12.006749 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-8751136f-4fa0-40ef-9e56-cd0a210afaa4 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Getting quotas for project 4a813c90e3ec437fbf1f37dbb2b340d4. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 02:43:12.013095 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-8751136f-4fa0-40ef-9e56-cd0a210afaa4 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Getting quotas for user ef194f895a0c404abc08cad62a3b566d and project 4a813c90e3ec437fbf1f37dbb2b340d4. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 02:43:12.095975 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8751136f-4fa0-40ef-9e56-cd0a210afaa4 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.109911 Oct 30 02:43:12.096568 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4163/7987] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 30 02:43:11 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:43:20.505677 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:43:20.509805 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6612eb21-8d6f-4336-868f-b14a0cfc99b7 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-987854000", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "networks": [{"uuid": "c19e52f4-a55e-46f9-b67f-693625a04901"}], "key_name": "tempest-TestNetworkAdvancedServerOps-731109607", "security_groups": [{"name": "tempest-secgroup-smoke-1192004722"}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:43:20.618164 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-6612eb21-8d6f-4336-868f-b14a0cfc99b7 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] validate_networks() for [('c19e52f4-a55e-46f9-b67f-693625a04901', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 02:43:21.079323 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-6612eb21-8d6f-4336-868f-b14a0cfc99b7 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 02:43:21.079755 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-6612eb21-8d6f-4336-868f-b14a0cfc99b7 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 02:43:21.081532 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-6612eb21-8d6f-4336-868f-b14a0cfc99b7 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 02:43:21.081958 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-6612eb21-8d6f-4336-868f-b14a0cfc99b7 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 02:43:21.082383 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-6612eb21-8d6f-4336-868f-b14a0cfc99b7 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 02:43:21.092178 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6612eb21-8d6f-4336-868f-b14a0cfc99b7 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:43:21.092674 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6612eb21-8d6f-4336-868f-b14a0cfc99b7 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:43:21.093327 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6612eb21-8d6f-4336-868f-b14a0cfc99b7 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:43:21.094649 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6612eb21-8d6f-4336-868f-b14a0cfc99b7 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:43:21.095108 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6612eb21-8d6f-4336-868f-b14a0cfc99b7 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:43:21.095539 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6612eb21-8d6f-4336-868f-b14a0cfc99b7 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:43:21.115035 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-6612eb21-8d6f-4336-868f-b14a0cfc99b7 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Getting quotas for project 4a813c90e3ec437fbf1f37dbb2b340d4. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 02:43:21.121288 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-6612eb21-8d6f-4336-868f-b14a0cfc99b7 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Getting quotas for user ef194f895a0c404abc08cad62a3b566d and project 4a813c90e3ec437fbf1f37dbb2b340d4. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 02:43:21.135124 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6612eb21-8d6f-4336-868f-b14a0cfc99b7 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 02:43:21.137602 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6612eb21-8d6f-4336-868f-b14a0cfc99b7 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 53553d9c-7471-4d73-8a83-6c3084cef5b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 02:43:21.258951 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6612eb21-8d6f-4336-868f-b14a0cfc99b7 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.755053 Oct 30 02:43:21.266636 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3825/7988] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 02:43:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 02:43:21.271844 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-03a72c26-0f3d-4487-b559-4a80dbe5cb42 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:43:21.272554 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-03a72c26-0f3d-4487-b559-4a80dbe5cb42 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 53553d9c-7471-4d73-8a83-6c3084cef5b1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:43:21.275629 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=16 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:43:21.349701 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-03a72c26-0f3d-4487-b559-4a80dbe5cb42 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:43:21.356938 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-03a72c26-0f3d-4487-b559-4a80dbe5cb42 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/53553d9c-7471-4d73-8a83-6c3084cef5b1" status: 200 len: 1265 microversion: 2.1 time: 0.088998 Oct 30 02:43:21.357617 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4164/7989] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:43:21 2022] GET /compute/v2.1/servers/53553d9c-7471-4d73-8a83-6c3084cef5b1 => generated 1265 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:43:22.380054 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-760b1ea8-4ec1-4cd1-a786-65913b797974 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:43:22.380662 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-760b1ea8-4ec1-4cd1-a786-65913b797974 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 53553d9c-7471-4d73-8a83-6c3084cef5b1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:43:22.388322 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-760b1ea8-4ec1-4cd1-a786-65913b797974 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:43:22.388813 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-760b1ea8-4ec1-4cd1-a786-65913b797974 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:43:22.389251 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-760b1ea8-4ec1-4cd1-a786-65913b797974 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:43:22.389973 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-760b1ea8-4ec1-4cd1-a786-65913b797974 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:43:22.390432 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-760b1ea8-4ec1-4cd1-a786-65913b797974 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:43:22.390853 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-760b1ea8-4ec1-4cd1-a786-65913b797974 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:43:22.456336 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-760b1ea8-4ec1-4cd1-a786-65913b797974 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:43:22.464779 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-760b1ea8-4ec1-4cd1-a786-65913b797974 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/53553d9c-7471-4d73-8a83-6c3084cef5b1" status: 200 len: 1269 microversion: 2.1 time: 0.088629 Oct 30 02:43:22.465240 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3826/7990] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:43:22 2022] GET /compute/v2.1/servers/53553d9c-7471-4d73-8a83-6c3084cef5b1 => generated 1269 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:43:23.487975 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-523f53f2-6a45-40d0-9e68-dded8526e24e tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:43:23.491161 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-523f53f2-6a45-40d0-9e68-dded8526e24e tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 53553d9c-7471-4d73-8a83-6c3084cef5b1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:43:23.497319 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-523f53f2-6a45-40d0-9e68-dded8526e24e tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:43:23.497878 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-523f53f2-6a45-40d0-9e68-dded8526e24e tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:43:23.498337 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-523f53f2-6a45-40d0-9e68-dded8526e24e tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:43:23.500905 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-523f53f2-6a45-40d0-9e68-dded8526e24e tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:43:23.501462 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-523f53f2-6a45-40d0-9e68-dded8526e24e tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:43:23.501865 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-523f53f2-6a45-40d0-9e68-dded8526e24e tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:43:23.593321 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-523f53f2-6a45-40d0-9e68-dded8526e24e tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:43:23.606160 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-523f53f2-6a45-40d0-9e68-dded8526e24e tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/53553d9c-7471-4d73-8a83-6c3084cef5b1" status: 200 len: 1335 microversion: 2.1 time: 0.122055 Oct 30 02:43:23.607258 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4165/7991] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:43:23 2022] GET /compute/v2.1/servers/53553d9c-7471-4d73-8a83-6c3084cef5b1 => generated 1335 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:43:24.631396 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-37a7f1c5-9dbb-4fff-ab90-a6ef7e1810c7 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:43:24.632092 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-37a7f1c5-9dbb-4fff-ab90-a6ef7e1810c7 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 53553d9c-7471-4d73-8a83-6c3084cef5b1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:43:24.642550 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-37a7f1c5-9dbb-4fff-ab90-a6ef7e1810c7 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:43:24.643114 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-37a7f1c5-9dbb-4fff-ab90-a6ef7e1810c7 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:43:24.648149 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-37a7f1c5-9dbb-4fff-ab90-a6ef7e1810c7 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:43:24.648149 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-37a7f1c5-9dbb-4fff-ab90-a6ef7e1810c7 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:43:24.648149 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-37a7f1c5-9dbb-4fff-ab90-a6ef7e1810c7 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:43:24.648149 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-37a7f1c5-9dbb-4fff-ab90-a6ef7e1810c7 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:43:24.785424 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-37a7f1c5-9dbb-4fff-ab90-a6ef7e1810c7 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:43:24.793546 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-37a7f1c5-9dbb-4fff-ab90-a6ef7e1810c7 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/53553d9c-7471-4d73-8a83-6c3084cef5b1" status: 200 len: 1391 microversion: 2.1 time: 0.166253 Oct 30 02:43:24.800334 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3827/7992] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:43:24 2022] GET /compute/v2.1/servers/53553d9c-7471-4d73-8a83-6c3084cef5b1 => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:43:25.141833 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-77e0f18d-de33-47a9-968a-1fae50ad0350 req-83770331-8024-40ed-afd1-8ef2a7ccd910 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53553d9c-7471-4d73-8a83-6c3084cef5b1", "tag": "7068c82f-6446-44a8-bb99-7d5d04842b9c"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:43:25.151989 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-77e0f18d-de33-47a9-968a-1fae50ad0350 req-83770331-8024-40ed-afd1-8ef2a7ccd910 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:43:25.152569 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-77e0f18d-de33-47a9-968a-1fae50ad0350 req-83770331-8024-40ed-afd1-8ef2a7ccd910 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:43:25.153087 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-77e0f18d-de33-47a9-968a-1fae50ad0350 req-83770331-8024-40ed-afd1-8ef2a7ccd910 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:43:25.165193 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-77e0f18d-de33-47a9-968a-1fae50ad0350 req-83770331-8024-40ed-afd1-8ef2a7ccd910 service nova] Creating event network-changed:7068c82f-6446-44a8-bb99-7d5d04842b9c for instance 53553d9c-7471-4d73-8a83-6c3084cef5b1 on n-h1-master-1 Oct 30 02:43:25.171468 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-77e0f18d-de33-47a9-968a-1fae50ad0350 req-83770331-8024-40ed-afd1-8ef2a7ccd910 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034110 Oct 30 02:43:25.172082 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4166/7993] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:43:25.818185 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e6b52b35-55d8-4df4-8646-a4174bcf82fb tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:43:25.819048 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e6b52b35-55d8-4df4-8646-a4174bcf82fb tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 53553d9c-7471-4d73-8a83-6c3084cef5b1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:43:25.827757 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e6b52b35-55d8-4df4-8646-a4174bcf82fb tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:43:25.828345 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e6b52b35-55d8-4df4-8646-a4174bcf82fb tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:43:25.828743 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e6b52b35-55d8-4df4-8646-a4174bcf82fb tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:43:25.829514 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e6b52b35-55d8-4df4-8646-a4174bcf82fb tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:43:25.829980 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e6b52b35-55d8-4df4-8646-a4174bcf82fb tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:43:25.830627 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e6b52b35-55d8-4df4-8646-a4174bcf82fb tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:43:25.969690 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e6b52b35-55d8-4df4-8646-a4174bcf82fb tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:43:25.977795 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e6b52b35-55d8-4df4-8646-a4174bcf82fb tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/53553d9c-7471-4d73-8a83-6c3084cef5b1" status: 200 len: 1391 microversion: 2.1 time: 0.165215 Oct 30 02:43:25.978438 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3828/7994] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:43:25 2022] GET /compute/v2.1/servers/53553d9c-7471-4d73-8a83-6c3084cef5b1 => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:43:27.002377 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-130bb5ea-38d1-401d-a9ce-bb83a2b6dfff tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:43:27.003103 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-130bb5ea-38d1-401d-a9ce-bb83a2b6dfff tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 53553d9c-7471-4d73-8a83-6c3084cef5b1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:43:27.009356 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-130bb5ea-38d1-401d-a9ce-bb83a2b6dfff tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:43:27.009859 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-130bb5ea-38d1-401d-a9ce-bb83a2b6dfff tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:43:27.010316 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-130bb5ea-38d1-401d-a9ce-bb83a2b6dfff tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:43:27.011028 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-130bb5ea-38d1-401d-a9ce-bb83a2b6dfff tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:43:27.011503 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-130bb5ea-38d1-401d-a9ce-bb83a2b6dfff tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:43:27.011946 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-130bb5ea-38d1-401d-a9ce-bb83a2b6dfff tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:43:27.143705 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-130bb5ea-38d1-401d-a9ce-bb83a2b6dfff tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:43:27.151472 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-130bb5ea-38d1-401d-a9ce-bb83a2b6dfff tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/53553d9c-7471-4d73-8a83-6c3084cef5b1" status: 200 len: 1391 microversion: 2.1 time: 0.154900 Oct 30 02:43:27.151989 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4167/7995] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:43:26 2022] GET /compute/v2.1/servers/53553d9c-7471-4d73-8a83-6c3084cef5b1 => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:43:28.174947 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6ee07859-e11a-49de-8565-51929b7ee431 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:43:28.175570 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6ee07859-e11a-49de-8565-51929b7ee431 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 53553d9c-7471-4d73-8a83-6c3084cef5b1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:43:28.182471 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ee07859-e11a-49de-8565-51929b7ee431 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:43:28.182992 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ee07859-e11a-49de-8565-51929b7ee431 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:43:28.183438 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ee07859-e11a-49de-8565-51929b7ee431 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:43:28.184139 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ee07859-e11a-49de-8565-51929b7ee431 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:43:28.184603 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ee07859-e11a-49de-8565-51929b7ee431 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:43:28.185043 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ee07859-e11a-49de-8565-51929b7ee431 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:43:28.320748 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6ee07859-e11a-49de-8565-51929b7ee431 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:43:28.328820 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6ee07859-e11a-49de-8565-51929b7ee431 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/53553d9c-7471-4d73-8a83-6c3084cef5b1" status: 200 len: 1391 microversion: 2.1 time: 0.158287 Oct 30 02:43:28.329408 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3829/7996] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:43:28 2022] GET /compute/v2.1/servers/53553d9c-7471-4d73-8a83-6c3084cef5b1 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:43:29.352114 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-95d6835a-5d1e-4ccb-a25a-6f911b09c264 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:43:29.352737 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-95d6835a-5d1e-4ccb-a25a-6f911b09c264 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 53553d9c-7471-4d73-8a83-6c3084cef5b1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:43:29.355525 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:43:29.360637 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-95d6835a-5d1e-4ccb-a25a-6f911b09c264 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:43:29.361133 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-95d6835a-5d1e-4ccb-a25a-6f911b09c264 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:43:29.361629 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-95d6835a-5d1e-4ccb-a25a-6f911b09c264 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:43:29.362330 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-95d6835a-5d1e-4ccb-a25a-6f911b09c264 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:43:29.362794 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-95d6835a-5d1e-4ccb-a25a-6f911b09c264 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:43:29.363232 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-95d6835a-5d1e-4ccb-a25a-6f911b09c264 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:43:29.497810 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-95d6835a-5d1e-4ccb-a25a-6f911b09c264 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:43:29.506165 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-95d6835a-5d1e-4ccb-a25a-6f911b09c264 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/53553d9c-7471-4d73-8a83-6c3084cef5b1" status: 200 len: 1391 microversion: 2.1 time: 0.158038 Oct 30 02:43:29.506745 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4168/7997] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:43:29 2022] GET /compute/v2.1/servers/53553d9c-7471-4d73-8a83-6c3084cef5b1 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:43:30.529493 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-358da266-ea94-4137-8f5d-faec85287127 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:43:30.530116 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-358da266-ea94-4137-8f5d-faec85287127 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 53553d9c-7471-4d73-8a83-6c3084cef5b1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:43:30.537315 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-358da266-ea94-4137-8f5d-faec85287127 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:43:30.537833 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-358da266-ea94-4137-8f5d-faec85287127 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:43:30.538277 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-358da266-ea94-4137-8f5d-faec85287127 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:43:30.538983 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-358da266-ea94-4137-8f5d-faec85287127 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:43:30.539442 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-358da266-ea94-4137-8f5d-faec85287127 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:43:30.540128 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-358da266-ea94-4137-8f5d-faec85287127 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:43:30.673712 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-358da266-ea94-4137-8f5d-faec85287127 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:43:30.681428 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-358da266-ea94-4137-8f5d-faec85287127 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/53553d9c-7471-4d73-8a83-6c3084cef5b1" status: 200 len: 1391 microversion: 2.1 time: 0.155922 Oct 30 02:43:30.682005 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3830/7998] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:43:30 2022] GET /compute/v2.1/servers/53553d9c-7471-4d73-8a83-6c3084cef5b1 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:43:31.704959 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-40ff1623-d63e-41ff-a6d0-ae3f734cf8b5 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:43:31.705587 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-40ff1623-d63e-41ff-a6d0-ae3f734cf8b5 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 53553d9c-7471-4d73-8a83-6c3084cef5b1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:43:31.708319 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=6 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:43:31.713347 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-40ff1623-d63e-41ff-a6d0-ae3f734cf8b5 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:43:31.713853 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-40ff1623-d63e-41ff-a6d0-ae3f734cf8b5 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:43:31.714310 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-40ff1623-d63e-41ff-a6d0-ae3f734cf8b5 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:43:31.715025 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-40ff1623-d63e-41ff-a6d0-ae3f734cf8b5 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:43:31.715505 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-40ff1623-d63e-41ff-a6d0-ae3f734cf8b5 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:43:31.715961 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-40ff1623-d63e-41ff-a6d0-ae3f734cf8b5 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:43:31.849031 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-40ff1623-d63e-41ff-a6d0-ae3f734cf8b5 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:43:31.856920 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-40ff1623-d63e-41ff-a6d0-ae3f734cf8b5 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/53553d9c-7471-4d73-8a83-6c3084cef5b1" status: 200 len: 1391 microversion: 2.1 time: 0.156549 Oct 30 02:43:31.857546 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4169/7999] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:43:31 2022] GET /compute/v2.1/servers/53553d9c-7471-4d73-8a83-6c3084cef5b1 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:43:32.123991 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-22cb56a2-3819-4ef8-871d-2b5579e17bcc req-19b69bb3-3dd2-4205-86ff-49ca6b52a425 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53553d9c-7471-4d73-8a83-6c3084cef5b1", "name": "network-vif-plugged", "status": "completed", "tag": "7068c82f-6446-44a8-bb99-7d5d04842b9c"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:43:32.129017 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:43:32.129756 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=6 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:43:32.135888 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-22cb56a2-3819-4ef8-871d-2b5579e17bcc req-19b69bb3-3dd2-4205-86ff-49ca6b52a425 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:43:32.136358 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-22cb56a2-3819-4ef8-871d-2b5579e17bcc req-19b69bb3-3dd2-4205-86ff-49ca6b52a425 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:43:32.137564 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-22cb56a2-3819-4ef8-871d-2b5579e17bcc req-19b69bb3-3dd2-4205-86ff-49ca6b52a425 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:43:32.147792 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-22cb56a2-3819-4ef8-871d-2b5579e17bcc req-19b69bb3-3dd2-4205-86ff-49ca6b52a425 service nova] Creating event network-vif-plugged:7068c82f-6446-44a8-bb99-7d5d04842b9c for instance 53553d9c-7471-4d73-8a83-6c3084cef5b1 on n-h1-master-1 Oct 30 02:43:32.152996 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-22cb56a2-3819-4ef8-871d-2b5579e17bcc req-19b69bb3-3dd2-4205-86ff-49ca6b52a425 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032815 Oct 30 02:43:32.153631 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3831/8000] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:43:32.880656 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-942733ac-c336-4f8d-9ce5-a41e7823e71c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:43:32.881443 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-942733ac-c336-4f8d-9ce5-a41e7823e71c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 53553d9c-7471-4d73-8a83-6c3084cef5b1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:43:32.888335 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-942733ac-c336-4f8d-9ce5-a41e7823e71c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:43:32.888828 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-942733ac-c336-4f8d-9ce5-a41e7823e71c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:43:32.889272 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-942733ac-c336-4f8d-9ce5-a41e7823e71c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:43:32.890675 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-942733ac-c336-4f8d-9ce5-a41e7823e71c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:43:32.891148 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-942733ac-c336-4f8d-9ce5-a41e7823e71c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:43:32.891613 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-942733ac-c336-4f8d-9ce5-a41e7823e71c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:43:33.025138 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-942733ac-c336-4f8d-9ce5-a41e7823e71c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:43:33.032985 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-942733ac-c336-4f8d-9ce5-a41e7823e71c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/53553d9c-7471-4d73-8a83-6c3084cef5b1" status: 200 len: 1391 microversion: 2.1 time: 0.156363 Oct 30 02:43:33.033592 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4170/8001] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:43:32 2022] GET /compute/v2.1/servers/53553d9c-7471-4d73-8a83-6c3084cef5b1 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:43:34.058296 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f0cf08d6-bc1f-4a80-8818-15bb6e51fba6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:43:34.058929 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f0cf08d6-bc1f-4a80-8818-15bb6e51fba6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 53553d9c-7471-4d73-8a83-6c3084cef5b1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:43:34.065600 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f0cf08d6-bc1f-4a80-8818-15bb6e51fba6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:43:34.066083 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f0cf08d6-bc1f-4a80-8818-15bb6e51fba6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:43:34.066519 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f0cf08d6-bc1f-4a80-8818-15bb6e51fba6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:43:34.067206 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f0cf08d6-bc1f-4a80-8818-15bb6e51fba6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:43:34.067662 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f0cf08d6-bc1f-4a80-8818-15bb6e51fba6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:43:34.068087 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f0cf08d6-bc1f-4a80-8818-15bb6e51fba6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:43:34.197059 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f0cf08d6-bc1f-4a80-8818-15bb6e51fba6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:43:34.205190 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f0cf08d6-bc1f-4a80-8818-15bb6e51fba6 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/53553d9c-7471-4d73-8a83-6c3084cef5b1" status: 200 len: 1562 microversion: 2.1 time: 0.152854 Oct 30 02:43:34.205792 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3832/8002] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:43:34 2022] GET /compute/v2.1/servers/53553d9c-7471-4d73-8a83-6c3084cef5b1 => generated 1562 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:43:34.227623 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9ffa2afb-ccb2-4732-972e-72dc432a98a3 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:43:34.228257 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9ffa2afb-ccb2-4732-972e-72dc432a98a3 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 53553d9c-7471-4d73-8a83-6c3084cef5b1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:43:34.235061 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9ffa2afb-ccb2-4732-972e-72dc432a98a3 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:43:34.235563 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9ffa2afb-ccb2-4732-972e-72dc432a98a3 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:43:34.236015 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9ffa2afb-ccb2-4732-972e-72dc432a98a3 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:43:34.236721 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9ffa2afb-ccb2-4732-972e-72dc432a98a3 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:43:34.237198 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9ffa2afb-ccb2-4732-972e-72dc432a98a3 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:43:34.237666 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9ffa2afb-ccb2-4732-972e-72dc432a98a3 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:43:34.367390 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9ffa2afb-ccb2-4732-972e-72dc432a98a3 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:43:34.375668 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9ffa2afb-ccb2-4732-972e-72dc432a98a3 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/53553d9c-7471-4d73-8a83-6c3084cef5b1" status: 200 len: 1562 microversion: 2.1 time: 0.151894 Oct 30 02:43:34.376245 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4171/8003] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:43:34 2022] GET /compute/v2.1/servers/53553d9c-7471-4d73-8a83-6c3084cef5b1 => generated 1562 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:43:36.612755 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-64fe1c2a-424b-448b-8001-7df522949f9b req-a5465fcd-8ad2-4c6b-a92b-6a80fbb51ae9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53553d9c-7471-4d73-8a83-6c3084cef5b1", "tag": "7068c82f-6446-44a8-bb99-7d5d04842b9c"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:43:36.616014 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a4a14f8e-014d-4e85-b571-60fa9eca1e0c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:43:36.616644 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a4a14f8e-014d-4e85-b571-60fa9eca1e0c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 53553d9c-7471-4d73-8a83-6c3084cef5b1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:43:36.619629 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:43:36.632961 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a4a14f8e-014d-4e85-b571-60fa9eca1e0c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:43:36.634110 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a4a14f8e-014d-4e85-b571-60fa9eca1e0c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:43:36.634251 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-64fe1c2a-424b-448b-8001-7df522949f9b req-a5465fcd-8ad2-4c6b-a92b-6a80fbb51ae9 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:43:36.634376 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a4a14f8e-014d-4e85-b571-60fa9eca1e0c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:43:36.634527 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-64fe1c2a-424b-448b-8001-7df522949f9b req-a5465fcd-8ad2-4c6b-a92b-6a80fbb51ae9 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:43:36.634714 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a4a14f8e-014d-4e85-b571-60fa9eca1e0c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:43:36.635073 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-64fe1c2a-424b-448b-8001-7df522949f9b req-a5465fcd-8ad2-4c6b-a92b-6a80fbb51ae9 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:43:36.635230 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a4a14f8e-014d-4e85-b571-60fa9eca1e0c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:43:36.635572 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a4a14f8e-014d-4e85-b571-60fa9eca1e0c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:43:36.649809 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-64fe1c2a-424b-448b-8001-7df522949f9b req-a5465fcd-8ad2-4c6b-a92b-6a80fbb51ae9 service nova] Creating event network-changed:7068c82f-6446-44a8-bb99-7d5d04842b9c for instance 53553d9c-7471-4d73-8a83-6c3084cef5b1 on n-h1-master-1 Oct 30 02:43:36.655690 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-64fe1c2a-424b-448b-8001-7df522949f9b req-a5465fcd-8ad2-4c6b-a92b-6a80fbb51ae9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047265 Oct 30 02:43:36.657030 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4172/8004] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:43:36.783520 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a4a14f8e-014d-4e85-b571-60fa9eca1e0c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:43:36.792088 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a4a14f8e-014d-4e85-b571-60fa9eca1e0c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/53553d9c-7471-4d73-8a83-6c3084cef5b1" status: 200 len: 1562 microversion: 2.1 time: 0.186509 Oct 30 02:43:36.792886 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3833/8005] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:43:36 2022] GET /compute/v2.1/servers/53553d9c-7471-4d73-8a83-6c3084cef5b1 => generated 1562 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:43:58.030939 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=9 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:43:58.031626 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=40 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:43:58.036482 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-77085a38-10a7-412c-b4f8-ebd073b26def tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:43:58.039719 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-77085a38-10a7-412c-b4f8-ebd073b26def tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 53553d9c-7471-4d73-8a83-6c3084cef5b1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:43:58.045142 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-77085a38-10a7-412c-b4f8-ebd073b26def tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:43:58.045721 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-77085a38-10a7-412c-b4f8-ebd073b26def tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:43:58.046178 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-77085a38-10a7-412c-b4f8-ebd073b26def tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:43:58.046862 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-77085a38-10a7-412c-b4f8-ebd073b26def tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:43:58.047326 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-77085a38-10a7-412c-b4f8-ebd073b26def tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:43:58.047790 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-77085a38-10a7-412c-b4f8-ebd073b26def tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:43:58.116026 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-77085a38-10a7-412c-b4f8-ebd073b26def tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "POST /compute/v2.1/servers/53553d9c-7471-4d73-8a83-6c3084cef5b1/action" status: 200 len: 24574 microversion: 2.1 time: 0.087403 Oct 30 02:43:58.116681 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4173/8006] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 02:43:58 2022] POST /compute/v2.1/servers/53553d9c-7471-4d73-8a83-6c3084cef5b1/action => generated 24574 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 02:44:09.194017 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f818d8d6-0ef6-41ce-bbd5-1adec48dd7e5 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:44:09.194637 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f818d8d6-0ef6-41ce-bbd5-1adec48dd7e5 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 53553d9c-7471-4d73-8a83-6c3084cef5b1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:44:09.196538 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:44:09.197376 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=46 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:44:09.202128 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f818d8d6-0ef6-41ce-bbd5-1adec48dd7e5 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:44:09.202609 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f818d8d6-0ef6-41ce-bbd5-1adec48dd7e5 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:44:09.203046 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f818d8d6-0ef6-41ce-bbd5-1adec48dd7e5 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:44:09.203730 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f818d8d6-0ef6-41ce-bbd5-1adec48dd7e5 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:44:09.204183 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f818d8d6-0ef6-41ce-bbd5-1adec48dd7e5 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:44:09.205122 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f818d8d6-0ef6-41ce-bbd5-1adec48dd7e5 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:44:09.227980 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-f818d8d6-0ef6-41ce-bbd5-1adec48dd7e5 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lazy-loading 'flavor' on Instance uuid 53553d9c-7471-4d73-8a83-6c3084cef5b1 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 02:44:09.522129 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f818d8d6-0ef6-41ce-bbd5-1adec48dd7e5 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "POST /compute/v2.1/servers/53553d9c-7471-4d73-8a83-6c3084cef5b1/action" status: 202 len: 0 microversion: 2.1 time: 0.332096 Oct 30 02:44:09.522749 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3834/8007] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 02:44:09 2022] POST /compute/v2.1/servers/53553d9c-7471-4d73-8a83-6c3084cef5b1/action => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 02:44:09.532477 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-145fc3ca-d53f-4a91-963b-92f0b7c32383 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:44:09.533817 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-145fc3ca-d53f-4a91-963b-92f0b7c32383 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 53553d9c-7471-4d73-8a83-6c3084cef5b1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:44:09.537190 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:44:09.538144 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=4 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:44:09.543435 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-145fc3ca-d53f-4a91-963b-92f0b7c32383 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:44:09.543939 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-145fc3ca-d53f-4a91-963b-92f0b7c32383 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:44:09.544484 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-145fc3ca-d53f-4a91-963b-92f0b7c32383 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:44:09.545199 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-145fc3ca-d53f-4a91-963b-92f0b7c32383 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:44:09.545676 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-145fc3ca-d53f-4a91-963b-92f0b7c32383 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:44:09.552273 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-145fc3ca-d53f-4a91-963b-92f0b7c32383 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:44:09.779306 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-145fc3ca-d53f-4a91-963b-92f0b7c32383 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:44:09.787036 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-145fc3ca-d53f-4a91-963b-92f0b7c32383 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/53553d9c-7471-4d73-8a83-6c3084cef5b1" status: 200 len: 1688 microversion: 2.1 time: 0.259810 Oct 30 02:44:09.787605 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4174/8008] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:44:09 2022] GET /compute/v2.1/servers/53553d9c-7471-4d73-8a83-6c3084cef5b1 => generated 1688 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:44:10.812367 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1032359f-6592-42d0-91cb-524e7755afc2 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:44:10.813063 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1032359f-6592-42d0-91cb-524e7755afc2 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 53553d9c-7471-4d73-8a83-6c3084cef5b1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:44:10.819291 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1032359f-6592-42d0-91cb-524e7755afc2 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:44:10.819774 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1032359f-6592-42d0-91cb-524e7755afc2 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:44:10.820207 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1032359f-6592-42d0-91cb-524e7755afc2 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:44:10.820892 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1032359f-6592-42d0-91cb-524e7755afc2 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:44:10.821362 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1032359f-6592-42d0-91cb-524e7755afc2 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:44:10.821785 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1032359f-6592-42d0-91cb-524e7755afc2 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:44:11.017790 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1032359f-6592-42d0-91cb-524e7755afc2 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:44:11.025564 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1032359f-6592-42d0-91cb-524e7755afc2 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/53553d9c-7471-4d73-8a83-6c3084cef5b1" status: 200 len: 1671 microversion: 2.1 time: 0.218747 Oct 30 02:44:11.026129 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3835/8009] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:44:10 2022] GET /compute/v2.1/servers/53553d9c-7471-4d73-8a83-6c3084cef5b1 => generated 1671 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:44:12.122281 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d4ac91a2-17cc-4f0c-9752-fe7a9fe518c7 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:44:12.124403 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d4ac91a2-17cc-4f0c-9752-fe7a9fe518c7 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 53553d9c-7471-4d73-8a83-6c3084cef5b1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:44:12.132144 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4ac91a2-17cc-4f0c-9752-fe7a9fe518c7 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:44:12.132645 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4ac91a2-17cc-4f0c-9752-fe7a9fe518c7 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:44:12.133098 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4ac91a2-17cc-4f0c-9752-fe7a9fe518c7 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:44:12.133837 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4ac91a2-17cc-4f0c-9752-fe7a9fe518c7 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:44:12.134307 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4ac91a2-17cc-4f0c-9752-fe7a9fe518c7 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:44:12.134744 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4ac91a2-17cc-4f0c-9752-fe7a9fe518c7 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:44:12.195736 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d4ac91a2-17cc-4f0c-9752-fe7a9fe518c7 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "POST /compute/v2.1/servers/53553d9c-7471-4d73-8a83-6c3084cef5b1/action" status: 200 len: 38384 microversion: 2.1 time: 0.077416 Oct 30 02:44:12.196388 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4175/8010] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 02:44:12 2022] POST /compute/v2.1/servers/53553d9c-7471-4d73-8a83-6c3084cef5b1/action => generated 38384 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 02:44:12.208848 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-da605639-fde7-4fe9-a7dc-fcfb7e12c69d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:44:12.209393 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-da605639-fde7-4fe9-a7dc-fcfb7e12c69d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 53553d9c-7471-4d73-8a83-6c3084cef5b1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:44:12.216281 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da605639-fde7-4fe9-a7dc-fcfb7e12c69d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:44:12.216794 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da605639-fde7-4fe9-a7dc-fcfb7e12c69d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:44:12.217228 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da605639-fde7-4fe9-a7dc-fcfb7e12c69d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:44:12.217976 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da605639-fde7-4fe9-a7dc-fcfb7e12c69d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:44:12.218426 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da605639-fde7-4fe9-a7dc-fcfb7e12c69d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:44:12.218880 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-da605639-fde7-4fe9-a7dc-fcfb7e12c69d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:44:12.406984 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-da605639-fde7-4fe9-a7dc-fcfb7e12c69d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "POST /compute/v2.1/servers/53553d9c-7471-4d73-8a83-6c3084cef5b1/action" status: 202 len: 0 microversion: 2.1 time: 0.202342 Oct 30 02:44:12.408180 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3836/8011] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 02:44:12 2022] POST /compute/v2.1/servers/53553d9c-7471-4d73-8a83-6c3084cef5b1/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 02:44:12.417390 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0ca3d69e-d553-4e2c-9e63-973dfc890b7e tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:44:12.418120 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0ca3d69e-d553-4e2c-9e63-973dfc890b7e tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 53553d9c-7471-4d73-8a83-6c3084cef5b1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:44:12.425565 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0ca3d69e-d553-4e2c-9e63-973dfc890b7e tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:44:12.426062 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0ca3d69e-d553-4e2c-9e63-973dfc890b7e tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:44:12.426505 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0ca3d69e-d553-4e2c-9e63-973dfc890b7e tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:44:12.427214 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0ca3d69e-d553-4e2c-9e63-973dfc890b7e tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:44:12.427681 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0ca3d69e-d553-4e2c-9e63-973dfc890b7e tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:44:12.428114 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0ca3d69e-d553-4e2c-9e63-973dfc890b7e tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:44:12.583288 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0ca3d69e-d553-4e2c-9e63-973dfc890b7e tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:44:12.591400 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0ca3d69e-d553-4e2c-9e63-973dfc890b7e tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/53553d9c-7471-4d73-8a83-6c3084cef5b1" status: 200 len: 1677 microversion: 2.1 time: 0.178567 Oct 30 02:44:12.591980 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4176/8012] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:44:12 2022] GET /compute/v2.1/servers/53553d9c-7471-4d73-8a83-6c3084cef5b1 => generated 1677 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:44:13.616492 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-16bc5fe1-4d20-4b7a-acfa-67660cc2e36d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:44:13.617218 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-16bc5fe1-4d20-4b7a-acfa-67660cc2e36d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 53553d9c-7471-4d73-8a83-6c3084cef5b1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:44:13.624194 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-16bc5fe1-4d20-4b7a-acfa-67660cc2e36d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:44:13.624677 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-16bc5fe1-4d20-4b7a-acfa-67660cc2e36d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:44:13.625112 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-16bc5fe1-4d20-4b7a-acfa-67660cc2e36d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:44:13.625844 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-16bc5fe1-4d20-4b7a-acfa-67660cc2e36d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:44:13.626298 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-16bc5fe1-4d20-4b7a-acfa-67660cc2e36d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:44:13.626721 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-16bc5fe1-4d20-4b7a-acfa-67660cc2e36d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:44:13.756886 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-16bc5fe1-4d20-4b7a-acfa-67660cc2e36d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:44:13.764570 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-16bc5fe1-4d20-4b7a-acfa-67660cc2e36d tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/53553d9c-7471-4d73-8a83-6c3084cef5b1" status: 200 len: 1677 microversion: 2.1 time: 0.152949 Oct 30 02:44:13.765137 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3837/8013] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:44:13 2022] GET /compute/v2.1/servers/53553d9c-7471-4d73-8a83-6c3084cef5b1 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:44:14.787722 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cfc13f6f-9d7a-49b7-ba9b-a89567d6dbca tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:44:14.788352 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cfc13f6f-9d7a-49b7-ba9b-a89567d6dbca tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 53553d9c-7471-4d73-8a83-6c3084cef5b1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:44:14.795515 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cfc13f6f-9d7a-49b7-ba9b-a89567d6dbca tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:44:14.796011 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cfc13f6f-9d7a-49b7-ba9b-a89567d6dbca tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:44:14.796463 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cfc13f6f-9d7a-49b7-ba9b-a89567d6dbca tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:44:14.797170 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cfc13f6f-9d7a-49b7-ba9b-a89567d6dbca tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:44:14.797672 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cfc13f6f-9d7a-49b7-ba9b-a89567d6dbca tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:44:14.798116 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cfc13f6f-9d7a-49b7-ba9b-a89567d6dbca tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:44:14.934809 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-cfc13f6f-9d7a-49b7-ba9b-a89567d6dbca tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:44:14.943055 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cfc13f6f-9d7a-49b7-ba9b-a89567d6dbca tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/53553d9c-7471-4d73-8a83-6c3084cef5b1" status: 200 len: 1680 microversion: 2.1 time: 0.159263 Oct 30 02:44:14.943626 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4177/8014] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:44:14 2022] GET /compute/v2.1/servers/53553d9c-7471-4d73-8a83-6c3084cef5b1 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:44:15.041248 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a30693d8-001b-4e1e-bf09-823f1b71ad8f tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:44:15.043616 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a30693d8-001b-4e1e-bf09-823f1b71ad8f tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 53553d9c-7471-4d73-8a83-6c3084cef5b1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:44:15.050991 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a30693d8-001b-4e1e-bf09-823f1b71ad8f tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:44:15.051479 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a30693d8-001b-4e1e-bf09-823f1b71ad8f tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:44:15.051920 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a30693d8-001b-4e1e-bf09-823f1b71ad8f tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:44:15.052644 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a30693d8-001b-4e1e-bf09-823f1b71ad8f tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:44:15.053100 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a30693d8-001b-4e1e-bf09-823f1b71ad8f tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:44:15.053557 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a30693d8-001b-4e1e-bf09-823f1b71ad8f tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:44:15.114819 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a30693d8-001b-4e1e-bf09-823f1b71ad8f tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "POST /compute/v2.1/servers/53553d9c-7471-4d73-8a83-6c3084cef5b1/action" status: 200 len: 38384 microversion: 2.1 time: 0.077688 Oct 30 02:44:15.115470 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3838/8015] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 02:44:15 2022] POST /compute/v2.1/servers/53553d9c-7471-4d73-8a83-6c3084cef5b1/action => generated 38384 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 02:44:16.109437 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-80ade8f2-6cbd-4c42-9d97-dc95242f850e tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:44:16.109960 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-80ade8f2-6cbd-4c42-9d97-dc95242f850e tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 53553d9c-7471-4d73-8a83-6c3084cef5b1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:44:16.114638 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-b22470f5-7dc5-47d1-86db-1f03d1d115c8 req-6fc95704-a754-491a-9ce7-fda039712bef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53553d9c-7471-4d73-8a83-6c3084cef5b1", "tag": "7068c82f-6446-44a8-bb99-7d5d04842b9c"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:44:16.117979 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-80ade8f2-6cbd-4c42-9d97-dc95242f850e tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:44:16.118489 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-80ade8f2-6cbd-4c42-9d97-dc95242f850e tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:44:16.118941 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-80ade8f2-6cbd-4c42-9d97-dc95242f850e tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:44:16.119665 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-80ade8f2-6cbd-4c42-9d97-dc95242f850e tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:44:16.120138 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-80ade8f2-6cbd-4c42-9d97-dc95242f850e tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:44:16.120584 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-80ade8f2-6cbd-4c42-9d97-dc95242f850e tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:44:16.128599 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-b22470f5-7dc5-47d1-86db-1f03d1d115c8 req-6fc95704-a754-491a-9ce7-fda039712bef service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:44:16.129430 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-b22470f5-7dc5-47d1-86db-1f03d1d115c8 req-6fc95704-a754-491a-9ce7-fda039712bef service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:44:16.130081 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-b22470f5-7dc5-47d1-86db-1f03d1d115c8 req-6fc95704-a754-491a-9ce7-fda039712bef service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:44:16.142669 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-b22470f5-7dc5-47d1-86db-1f03d1d115c8 req-6fc95704-a754-491a-9ce7-fda039712bef service nova] Creating event network-changed:7068c82f-6446-44a8-bb99-7d5d04842b9c for instance 53553d9c-7471-4d73-8a83-6c3084cef5b1 on n-h1-master-1 Oct 30 02:44:16.147442 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-80ade8f2-6cbd-4c42-9d97-dc95242f850e tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 53553d9c-7471-4d73-8a83-6c3084cef5b1] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 02:44:16.148499 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-b22470f5-7dc5-47d1-86db-1f03d1d115c8 req-6fc95704-a754-491a-9ce7-fda039712bef service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038733 Oct 30 02:44:16.149723 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3839/8016] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:44:16.403229 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-80ade8f2-6cbd-4c42-9d97-dc95242f850e tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "DELETE /compute/v2.1/servers/53553d9c-7471-4d73-8a83-6c3084cef5b1" status: 204 len: 0 microversion: 2.1 time: 0.297363 Oct 30 02:44:16.403839 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4178/8017] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 02:44:16 2022] DELETE /compute/v2.1/servers/53553d9c-7471-4d73-8a83-6c3084cef5b1 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 02:44:16.413783 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a6e0b7f9-a7fb-4c3c-9ac0-a8031a54f0aa tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:44:16.414757 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a6e0b7f9-a7fb-4c3c-9ac0-a8031a54f0aa tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 53553d9c-7471-4d73-8a83-6c3084cef5b1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:44:16.420896 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a6e0b7f9-a7fb-4c3c-9ac0-a8031a54f0aa tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:44:16.421429 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a6e0b7f9-a7fb-4c3c-9ac0-a8031a54f0aa tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:44:16.421866 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a6e0b7f9-a7fb-4c3c-9ac0-a8031a54f0aa tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:44:16.422563 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a6e0b7f9-a7fb-4c3c-9ac0-a8031a54f0aa tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:44:16.423012 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a6e0b7f9-a7fb-4c3c-9ac0-a8031a54f0aa tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:44:16.423438 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a6e0b7f9-a7fb-4c3c-9ac0-a8031a54f0aa tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:44:16.562749 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-a6e0b7f9-a7fb-4c3c-9ac0-a8031a54f0aa tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:44:16.570736 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a6e0b7f9-a7fb-4c3c-9ac0-a8031a54f0aa tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/53553d9c-7471-4d73-8a83-6c3084cef5b1" status: 200 len: 1686 microversion: 2.1 time: 0.162213 Oct 30 02:44:16.571320 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3840/8018] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:44:16 2022] GET /compute/v2.1/servers/53553d9c-7471-4d73-8a83-6c3084cef5b1 => generated 1686 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:44:17.595512 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d550b2c9-1ca3-4131-95b1-8daf7732b2f2 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:44:17.596232 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d550b2c9-1ca3-4131-95b1-8daf7732b2f2 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 53553d9c-7471-4d73-8a83-6c3084cef5b1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:44:17.603074 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d550b2c9-1ca3-4131-95b1-8daf7732b2f2 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:44:17.603575 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d550b2c9-1ca3-4131-95b1-8daf7732b2f2 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:44:17.604024 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d550b2c9-1ca3-4131-95b1-8daf7732b2f2 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:44:17.604732 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d550b2c9-1ca3-4131-95b1-8daf7732b2f2 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:44:17.605202 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d550b2c9-1ca3-4131-95b1-8daf7732b2f2 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:44:17.605678 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d550b2c9-1ca3-4131-95b1-8daf7732b2f2 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:44:17.794379 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d550b2c9-1ca3-4131-95b1-8daf7732b2f2 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:44:17.802807 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d550b2c9-1ca3-4131-95b1-8daf7732b2f2 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/53553d9c-7471-4d73-8a83-6c3084cef5b1" status: 200 len: 1686 microversion: 2.1 time: 0.211625 Oct 30 02:44:17.805265 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4179/8019] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:44:17 2022] GET /compute/v2.1/servers/53553d9c-7471-4d73-8a83-6c3084cef5b1 => generated 1686 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:44:18.603478 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-7e5b7236-271b-4c15-9dc6-f71e52b809ca req-9f028992-5132-4140-8cf2-02bcf8958b24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53553d9c-7471-4d73-8a83-6c3084cef5b1", "name": "network-vif-deleted", "tag": "7068c82f-6446-44a8-bb99-7d5d04842b9c"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:44:18.613226 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-7e5b7236-271b-4c15-9dc6-f71e52b809ca req-9f028992-5132-4140-8cf2-02bcf8958b24 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:44:18.613740 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-7e5b7236-271b-4c15-9dc6-f71e52b809ca req-9f028992-5132-4140-8cf2-02bcf8958b24 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:44:18.614174 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-7e5b7236-271b-4c15-9dc6-f71e52b809ca req-9f028992-5132-4140-8cf2-02bcf8958b24 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:44:18.653624 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-7e5b7236-271b-4c15-9dc6-f71e52b809ca req-9f028992-5132-4140-8cf2-02bcf8958b24 service nova] Creating event network-vif-deleted:7068c82f-6446-44a8-bb99-7d5d04842b9c for instance 53553d9c-7471-4d73-8a83-6c3084cef5b1 on n-h1-master-1 Oct 30 02:44:18.653624 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-7e5b7236-271b-4c15-9dc6-f71e52b809ca req-9f028992-5132-4140-8cf2-02bcf8958b24 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079257 Oct 30 02:44:18.653624 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3841/8020] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:44:18.828086 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-80c17d90-bd5d-434d-a6e3-8631f41fd368 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:44:18.828717 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-80c17d90-bd5d-434d-a6e3-8631f41fd368 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 53553d9c-7471-4d73-8a83-6c3084cef5b1] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:44:18.836490 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-80c17d90-bd5d-434d-a6e3-8631f41fd368 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:44:18.837002 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-80c17d90-bd5d-434d-a6e3-8631f41fd368 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:44:18.837500 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-80c17d90-bd5d-434d-a6e3-8631f41fd368 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:44:18.838234 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-80c17d90-bd5d-434d-a6e3-8631f41fd368 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:44:18.839370 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-80c17d90-bd5d-434d-a6e3-8631f41fd368 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:44:18.839869 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-80c17d90-bd5d-434d-a6e3-8631f41fd368 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:44:18.914240 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-80c17d90-bd5d-434d-a6e3-8631f41fd368 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef194f895a0c404abc08cad62a3b566d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a813c90e3ec437fbf1f37dbb2b340d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:44:18.922720 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-80c17d90-bd5d-434d-a6e3-8631f41fd368 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/53553d9c-7471-4d73-8a83-6c3084cef5b1" status: 200 len: 1350 microversion: 2.1 time: 0.098840 Oct 30 02:44:18.923307 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4180/8021] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:44:18 2022] GET /compute/v2.1/servers/53553d9c-7471-4d73-8a83-6c3084cef5b1 => generated 1350 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:44:19.947073 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b1068b94-e8ab-45b7-8192-05b054a9188c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:44:19.947691 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b1068b94-e8ab-45b7-8192-05b054a9188c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] [instance: 53553d9c-7471-4d73-8a83-6c3084cef5b1] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:44:19.954881 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1068b94-e8ab-45b7-8192-05b054a9188c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:44:19.955864 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1068b94-e8ab-45b7-8192-05b054a9188c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:44:19.956304 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1068b94-e8ab-45b7-8192-05b054a9188c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:44:19.957000 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1068b94-e8ab-45b7-8192-05b054a9188c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:44:19.957487 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1068b94-e8ab-45b7-8192-05b054a9188c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:44:19.957916 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1068b94-e8ab-45b7-8192-05b054a9188c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:44:19.972109 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-b1068b94-e8ab-45b7-8192-05b054a9188c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] HTTP exception thrown: Instance 53553d9c-7471-4d73-8a83-6c3084cef5b1 could not be found. Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b1068b94-e8ab-45b7-8192-05b054a9188c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Request method failure captured: Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/53553d9c-7471-4d73-8a83-6c3084cef5b1 HTTP/1.1 Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXeMhmBt07CnqlsQCCZQN6u-PC4AsgU8WequZ4Kud9tCoyqv8mAHQMcaho4Jbx4RzGkeSupfwjjjBU9nby25ZfrQmG3SvdDYuPUoYCpt4XAVTrkn_pjoiCb5AJLHMr5UnOHpTN2d7v4LRRKuXP0k9zso8ZvHlSuYjg8x6U3J73q4pZ0Q Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 4a813c90e3ec437fbf1f37dbb2b340d4 Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-521135141 Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a813c90e3ec437fbf1f37dbb2b340d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4a813c90e3ec437fbf1f37dbb2b340d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4a813c90e3ec437fbf1f37dbb2b340d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a813c90e3ec437fbf1f37dbb2b340d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-TestNetworkAdvancedServerOps-521135141 Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 4a813c90e3ec437fbf1f37dbb2b340d4 Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-521135141 Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-TestNetworkAdvancedServerOps-521135141-project Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: ef194f895a0c404abc08cad62a3b566d Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-TestNetworkAdvancedServerOps-521135141-project Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 53553d9c-7471-4d73-8a83-6c3084cef5b1 could not be found. Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '53553d9c-7471-4d73-8a83-6c3084cef5b1'} Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53553d9c-7471-4d73-8a83-6c3084cef5b1 could not be found. Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53553d9c-7471-4d73-8a83-6c3084cef5b1 could not be found. Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:44:19.973807 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:44:19.979511 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:44:19.979511 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:44:19.979511 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:44:19.979511 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:44:19.979511 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:44:19.979511 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:44:19.979511 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53553d9c-7471-4d73-8a83-6c3084cef5b1 could not be found. Oct 30 02:44:19.979511 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:44:19.979511 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b1068b94-e8ab-45b7-8192-05b054a9188c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Returning 404 to user: Instance 53553d9c-7471-4d73-8a83-6c3084cef5b1 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:44:19.979511 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b1068b94-e8ab-45b7-8192-05b054a9188c tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "GET /compute/v2.1/servers/53553d9c-7471-4d73-8a83-6c3084cef5b1" status: 404 len: 111 microversion: 2.1 time: 0.032508 Oct 30 02:44:19.979511 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3842/8022] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:44:19 2022] GET /compute/v2.1/servers/53553d9c-7471-4d73-8a83-6c3084cef5b1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 02:44:23.647838 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1ed018aa-4c4a-483c-9a71-881d6f79ecf0 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] Calling method '.version_select at 0x7f44c6eacaf0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:44:23.713066 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1ed018aa-4c4a-483c-9a71-881d6f79ecf0 tempest-TestNetworkAdvancedServerOps-521135141 tempest-TestNetworkAdvancedServerOps-521135141-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-731109607" status: 202 len: 0 microversion: 2.1 time: 0.069173 Oct 30 02:44:23.713707 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4181/8023] 10.222.0.13 () {58 vars in 1281 bytes} [Sun Oct 30 02:44:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-731109607 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 02:44:37.798842 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=18 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:44:37.799473 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:44:38.018694 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7a13fd71-07a0-4fad-a57c-df9d0922b221 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Action: 'create', calling method: .version_select at 0x7f44c6d1a430>, body: {"keypair": {"name": "tempest-TestShelveInstance-310702319", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSplGMLrf1Yp0AzB5ZwOXwjqNHvPlDKchNBvxq1UF+WoIgX+kS10XTqHeJzqJ58OZ9EldUPmn8uUfRXKmbwcVwLZasTZ9dddorApRA9HYeKgzPah3E7kCXLz0Jo9rnzdw=="}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:44:38.035496 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-7a13fd71-07a0-4fad-a57c-df9d0922b221 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Getting quotas for project d49c70393b0144a1a1e946fea78b47a9. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 02:44:38.041521 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-7a13fd71-07a0-4fad-a57c-df9d0922b221 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Getting quotas for user 4deb849d2b814e648cd1d84a82d1783d and project d49c70393b0144a1a1e946fea78b47a9. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 02:44:38.130205 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7a13fd71-07a0-4fad-a57c-df9d0922b221 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.336828 Oct 30 02:44:38.135267 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3843/8024] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 30 02:44:37 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:44:40.571231 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:44:40.572255 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:44:40.573523 n-d-master-1 devstack@n-api.service[121102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 30 02:44:40.573701 n-d-master-1 devstack@n-api.service[121102]: Sun Oct 30 02:44:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.13) !!! Oct 30 02:44:40.580765 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fc6f1269-037e-48f7-a14e-558f38853690 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2014144961", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-310702319", "security_groups": [{"name": "tempest-secgroup-smoke-4103418"}], "networks": [{"uuid": "590c29ae-3cbb-4bd5-83a3-697c2ec0c271"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:44:40.690362 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-fc6f1269-037e-48f7-a14e-558f38853690 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] validate_networks() for [('590c29ae-3cbb-4bd5-83a3-697c2ec0c271', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 02:44:41.084429 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-fc6f1269-037e-48f7-a14e-558f38853690 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 02:44:41.084429 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-fc6f1269-037e-48f7-a14e-558f38853690 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 02:44:41.084429 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-fc6f1269-037e-48f7-a14e-558f38853690 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 02:44:41.084429 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-fc6f1269-037e-48f7-a14e-558f38853690 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 02:44:41.084872 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-fc6f1269-037e-48f7-a14e-558f38853690 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 02:44:41.094344 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fc6f1269-037e-48f7-a14e-558f38853690 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:44:41.094846 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fc6f1269-037e-48f7-a14e-558f38853690 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:44:41.095295 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fc6f1269-037e-48f7-a14e-558f38853690 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:44:41.096106 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fc6f1269-037e-48f7-a14e-558f38853690 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:44:41.096626 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fc6f1269-037e-48f7-a14e-558f38853690 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:44:41.097066 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fc6f1269-037e-48f7-a14e-558f38853690 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:44:41.115583 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-fc6f1269-037e-48f7-a14e-558f38853690 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Getting quotas for project d49c70393b0144a1a1e946fea78b47a9. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 02:44:41.121251 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-fc6f1269-037e-48f7-a14e-558f38853690 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Getting quotas for user 4deb849d2b814e648cd1d84a82d1783d and project d49c70393b0144a1a1e946fea78b47a9. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 02:44:41.135116 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fc6f1269-037e-48f7-a14e-558f38853690 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 02:44:41.137512 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fc6f1269-037e-48f7-a14e-558f38853690 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 02:44:41.252153 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fc6f1269-037e-48f7-a14e-558f38853690 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.682731 Oct 30 02:44:41.252822 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4182/8025] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 02:44:40 2022] POST /compute/v2.1/servers => generated 403 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 02:44:41.265461 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f00d8570-25ee-438f-91b8-d1f1b0bd2197 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:44:41.267953 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f00d8570-25ee-438f-91b8-d1f1b0bd2197 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:44:41.339873 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f00d8570-25ee-438f-91b8-d1f1b0bd2197 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:44:41.348013 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f00d8570-25ee-438f-91b8-d1f1b0bd2197 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130" status: 200 len: 1246 microversion: 2.1 time: 0.086842 Oct 30 02:44:41.358068 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3844/8026] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:44:41 2022] GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130 => generated 1246 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:44:42.372120 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-395bd00e-113f-4b50-9207-80e929406d84 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:44:42.372745 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-395bd00e-113f-4b50-9207-80e929406d84 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:44:42.379565 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-395bd00e-113f-4b50-9207-80e929406d84 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:44:42.380072 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-395bd00e-113f-4b50-9207-80e929406d84 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:44:42.380526 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-395bd00e-113f-4b50-9207-80e929406d84 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:44:42.381245 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-395bd00e-113f-4b50-9207-80e929406d84 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:44:42.381883 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-395bd00e-113f-4b50-9207-80e929406d84 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:44:42.382202 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-395bd00e-113f-4b50-9207-80e929406d84 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:44:42.446668 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-395bd00e-113f-4b50-9207-80e929406d84 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:44:42.454618 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-395bd00e-113f-4b50-9207-80e929406d84 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130" status: 200 len: 1250 microversion: 2.1 time: 0.087377 Oct 30 02:44:42.455196 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4183/8027] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:44:42 2022] GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130 => generated 1250 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:44:43.477579 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-45dc19a2-268e-4278-88ca-f06b96939e5a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:44:43.478200 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-45dc19a2-268e-4278-88ca-f06b96939e5a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:44:43.484778 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45dc19a2-268e-4278-88ca-f06b96939e5a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:44:43.485360 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45dc19a2-268e-4278-88ca-f06b96939e5a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:44:43.485802 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45dc19a2-268e-4278-88ca-f06b96939e5a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:44:43.486533 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45dc19a2-268e-4278-88ca-f06b96939e5a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:44:43.486986 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45dc19a2-268e-4278-88ca-f06b96939e5a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:44:43.487415 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45dc19a2-268e-4278-88ca-f06b96939e5a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:44:43.554207 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-45dc19a2-268e-4278-88ca-f06b96939e5a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:44:43.561820 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-45dc19a2-268e-4278-88ca-f06b96939e5a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130" status: 200 len: 1306 microversion: 2.1 time: 0.088254 Oct 30 02:44:43.562434 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3845/8028] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:44:43 2022] GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130 => generated 1306 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:44:44.584209 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-49e725c7-2ae2-4c07-8774-0c783d1b772b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:44:44.584847 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-49e725c7-2ae2-4c07-8774-0c783d1b772b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:44:44.591758 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-49e725c7-2ae2-4c07-8774-0c783d1b772b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:44:44.592266 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-49e725c7-2ae2-4c07-8774-0c783d1b772b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:44:44.592722 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-49e725c7-2ae2-4c07-8774-0c783d1b772b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:44:44.593478 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-49e725c7-2ae2-4c07-8774-0c783d1b772b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:44:44.593961 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-49e725c7-2ae2-4c07-8774-0c783d1b772b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:44:44.594405 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-49e725c7-2ae2-4c07-8774-0c783d1b772b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:44:45.079748 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-49e725c7-2ae2-4c07-8774-0c783d1b772b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:44:45.088197 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-49e725c7-2ae2-4c07-8774-0c783d1b772b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130" status: 200 len: 1369 microversion: 2.1 time: 0.507974 Oct 30 02:44:45.088805 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4184/8029] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:44:44 2022] GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130 => generated 1369 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:44:45.469517 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-9e506485-318d-4e05-8ce4-a3a6d779092e req-c7901915-1b23-4b37-be75-93d3ba60c109 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e313c6d-86a4-47e0-b461-71558843c130", "tag": "da354005-a94f-4126-a68e-4e0ce8177a9d"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:44:45.481943 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-9e506485-318d-4e05-8ce4-a3a6d779092e req-c7901915-1b23-4b37-be75-93d3ba60c109 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:44:45.482430 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-9e506485-318d-4e05-8ce4-a3a6d779092e req-c7901915-1b23-4b37-be75-93d3ba60c109 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:44:45.482887 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-9e506485-318d-4e05-8ce4-a3a6d779092e req-c7901915-1b23-4b37-be75-93d3ba60c109 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:44:45.493221 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-9e506485-318d-4e05-8ce4-a3a6d779092e req-c7901915-1b23-4b37-be75-93d3ba60c109 service nova] Creating event network-changed:da354005-a94f-4126-a68e-4e0ce8177a9d for instance 6e313c6d-86a4-47e0-b461-71558843c130 on n-h2-master-1 Oct 30 02:44:45.498055 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-9e506485-318d-4e05-8ce4-a3a6d779092e req-c7901915-1b23-4b37-be75-93d3ba60c109 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032393 Oct 30 02:44:45.498670 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3846/8030] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:44:46.111512 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1d0c2488-7e95-4761-9296-0c62ae0f7758 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:44:46.112151 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1d0c2488-7e95-4761-9296-0c62ae0f7758 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:44:46.120292 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1d0c2488-7e95-4761-9296-0c62ae0f7758 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:44:46.120796 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1d0c2488-7e95-4761-9296-0c62ae0f7758 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:44:46.121260 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1d0c2488-7e95-4761-9296-0c62ae0f7758 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:44:46.122041 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1d0c2488-7e95-4761-9296-0c62ae0f7758 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:44:46.122512 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1d0c2488-7e95-4761-9296-0c62ae0f7758 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:44:46.122983 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1d0c2488-7e95-4761-9296-0c62ae0f7758 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:44:46.304684 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1d0c2488-7e95-4761-9296-0c62ae0f7758 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:44:46.312398 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1d0c2488-7e95-4761-9296-0c62ae0f7758 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130" status: 200 len: 1369 microversion: 2.1 time: 0.204889 Oct 30 02:44:46.312975 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4185/8031] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:44:46 2022] GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130 => generated 1369 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:44:47.337259 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5b1d87e6-029c-49e2-bc2f-5557caca491e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:44:47.337942 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5b1d87e6-029c-49e2-bc2f-5557caca491e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:44:47.344198 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5b1d87e6-029c-49e2-bc2f-5557caca491e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:44:47.344685 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5b1d87e6-029c-49e2-bc2f-5557caca491e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:44:47.345125 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5b1d87e6-029c-49e2-bc2f-5557caca491e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:44:47.345845 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5b1d87e6-029c-49e2-bc2f-5557caca491e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:44:47.346303 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5b1d87e6-029c-49e2-bc2f-5557caca491e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:44:47.346731 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5b1d87e6-029c-49e2-bc2f-5557caca491e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:44:47.477873 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5b1d87e6-029c-49e2-bc2f-5557caca491e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:44:47.485639 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5b1d87e6-029c-49e2-bc2f-5557caca491e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130" status: 200 len: 1369 microversion: 2.1 time: 0.154218 Oct 30 02:44:47.486200 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3847/8032] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:44:47 2022] GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130 => generated 1369 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:44:48.509113 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-484ae083-545d-45aa-b6ec-42ac38328459 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:44:48.509794 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-484ae083-545d-45aa-b6ec-42ac38328459 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:44:48.516570 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-484ae083-545d-45aa-b6ec-42ac38328459 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:44:48.517065 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-484ae083-545d-45aa-b6ec-42ac38328459 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:44:48.517532 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-484ae083-545d-45aa-b6ec-42ac38328459 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:44:48.518233 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-484ae083-545d-45aa-b6ec-42ac38328459 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:44:48.518699 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-484ae083-545d-45aa-b6ec-42ac38328459 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:44:48.519179 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-484ae083-545d-45aa-b6ec-42ac38328459 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:44:48.647773 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-484ae083-545d-45aa-b6ec-42ac38328459 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:44:48.655488 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-484ae083-545d-45aa-b6ec-42ac38328459 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130" status: 200 len: 1369 microversion: 2.1 time: 0.150363 Oct 30 02:44:48.656093 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4186/8033] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:44:48 2022] GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130 => generated 1369 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:44:49.679275 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e23ff45a-9a3d-4c0f-9e97-4eb459076c54 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:44:49.679891 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e23ff45a-9a3d-4c0f-9e97-4eb459076c54 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:44:49.686878 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e23ff45a-9a3d-4c0f-9e97-4eb459076c54 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:44:49.687309 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e23ff45a-9a3d-4c0f-9e97-4eb459076c54 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:44:49.687741 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e23ff45a-9a3d-4c0f-9e97-4eb459076c54 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:44:49.688464 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e23ff45a-9a3d-4c0f-9e97-4eb459076c54 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:44:49.688919 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e23ff45a-9a3d-4c0f-9e97-4eb459076c54 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:44:49.689356 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e23ff45a-9a3d-4c0f-9e97-4eb459076c54 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:44:49.825111 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e23ff45a-9a3d-4c0f-9e97-4eb459076c54 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:44:49.833535 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e23ff45a-9a3d-4c0f-9e97-4eb459076c54 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130" status: 200 len: 1369 microversion: 2.1 time: 0.158196 Oct 30 02:44:49.834097 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3848/8034] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:44:49 2022] GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130 => generated 1369 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:44:50.041383 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-ecae02e2-c6ae-497d-8117-1cf2e8f4d244 req-2eaf4115-bf0a-423e-bc61-d6e956648361 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e313c6d-86a4-47e0-b461-71558843c130", "name": "network-vif-plugged", "status": "completed", "tag": "da354005-a94f-4126-a68e-4e0ce8177a9d"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:44:50.051302 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ecae02e2-c6ae-497d-8117-1cf2e8f4d244 req-2eaf4115-bf0a-423e-bc61-d6e956648361 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:44:50.051870 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ecae02e2-c6ae-497d-8117-1cf2e8f4d244 req-2eaf4115-bf0a-423e-bc61-d6e956648361 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:44:50.052310 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ecae02e2-c6ae-497d-8117-1cf2e8f4d244 req-2eaf4115-bf0a-423e-bc61-d6e956648361 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:44:50.063457 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-ecae02e2-c6ae-497d-8117-1cf2e8f4d244 req-2eaf4115-bf0a-423e-bc61-d6e956648361 service nova] Creating event network-vif-plugged:da354005-a94f-4126-a68e-4e0ce8177a9d for instance 6e313c6d-86a4-47e0-b461-71558843c130 on n-h2-master-1 Oct 30 02:44:50.069261 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-ecae02e2-c6ae-497d-8117-1cf2e8f4d244 req-2eaf4115-bf0a-423e-bc61-d6e956648361 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089614 Oct 30 02:44:50.069938 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4187/8035] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:44:50.856973 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-43ae5d22-03c7-4982-b15e-e57b1e22ca20 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:44:50.857615 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-43ae5d22-03c7-4982-b15e-e57b1e22ca20 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:44:50.864429 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-43ae5d22-03c7-4982-b15e-e57b1e22ca20 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:44:50.864924 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-43ae5d22-03c7-4982-b15e-e57b1e22ca20 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:44:50.865384 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-43ae5d22-03c7-4982-b15e-e57b1e22ca20 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:44:50.866077 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-43ae5d22-03c7-4982-b15e-e57b1e22ca20 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:44:50.866536 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-43ae5d22-03c7-4982-b15e-e57b1e22ca20 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:44:50.866962 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-43ae5d22-03c7-4982-b15e-e57b1e22ca20 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:44:50.998822 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-43ae5d22-03c7-4982-b15e-e57b1e22ca20 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:44:51.006663 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-43ae5d22-03c7-4982-b15e-e57b1e22ca20 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130" status: 200 len: 1369 microversion: 2.1 time: 0.153748 Oct 30 02:44:51.007254 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3849/8036] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:44:50 2022] GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130 => generated 1369 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:44:52.028398 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:44:52.029221 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=6 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:44:52.033259 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a08fc380-ec43-4bf3-a009-5ef1df670c3d tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:44:52.034043 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a08fc380-ec43-4bf3-a009-5ef1df670c3d tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:44:52.040825 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a08fc380-ec43-4bf3-a009-5ef1df670c3d tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:44:52.041314 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a08fc380-ec43-4bf3-a009-5ef1df670c3d tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:44:52.046876 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a08fc380-ec43-4bf3-a009-5ef1df670c3d tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:44:52.046876 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a08fc380-ec43-4bf3-a009-5ef1df670c3d tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:44:52.046876 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a08fc380-ec43-4bf3-a009-5ef1df670c3d tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:44:52.046876 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a08fc380-ec43-4bf3-a009-5ef1df670c3d tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:44:52.174650 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a08fc380-ec43-4bf3-a009-5ef1df670c3d tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:44:52.183241 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a08fc380-ec43-4bf3-a009-5ef1df670c3d tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130" status: 200 len: 1553 microversion: 2.1 time: 0.156611 Oct 30 02:44:52.183823 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4188/8037] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:44:52 2022] GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130 => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:44:52.215343 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fff7d4a5-0735-43ea-b52c-c816d08b87b9 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:44:52.215958 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-fff7d4a5-0735-43ea-b52c-c816d08b87b9 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:44:52.217975 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=6 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:44:52.224216 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fff7d4a5-0735-43ea-b52c-c816d08b87b9 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:44:52.224739 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fff7d4a5-0735-43ea-b52c-c816d08b87b9 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:44:52.225191 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fff7d4a5-0735-43ea-b52c-c816d08b87b9 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:44:52.225905 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fff7d4a5-0735-43ea-b52c-c816d08b87b9 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:44:52.229699 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fff7d4a5-0735-43ea-b52c-c816d08b87b9 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:44:52.229699 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fff7d4a5-0735-43ea-b52c-c816d08b87b9 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:44:52.359822 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-fff7d4a5-0735-43ea-b52c-c816d08b87b9 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:44:52.367615 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fff7d4a5-0735-43ea-b52c-c816d08b87b9 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130" status: 200 len: 1553 microversion: 2.1 time: 0.156254 Oct 30 02:44:52.368235 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3850/8038] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:44:52 2022] GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130 => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:44:54.247419 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-fc91d2c3-a3d6-4988-a60b-cd04193f0a3a req-3cb238ef-2c58-4a39-a64c-b5099ae88782 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e313c6d-86a4-47e0-b461-71558843c130", "tag": "da354005-a94f-4126-a68e-4e0ce8177a9d"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:44:54.259756 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-fc91d2c3-a3d6-4988-a60b-cd04193f0a3a req-3cb238ef-2c58-4a39-a64c-b5099ae88782 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:44:54.260258 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-fc91d2c3-a3d6-4988-a60b-cd04193f0a3a req-3cb238ef-2c58-4a39-a64c-b5099ae88782 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:44:54.260712 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-fc91d2c3-a3d6-4988-a60b-cd04193f0a3a req-3cb238ef-2c58-4a39-a64c-b5099ae88782 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:44:54.276661 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-fc91d2c3-a3d6-4988-a60b-cd04193f0a3a req-3cb238ef-2c58-4a39-a64c-b5099ae88782 service nova] Creating event network-changed:da354005-a94f-4126-a68e-4e0ce8177a9d for instance 6e313c6d-86a4-47e0-b461-71558843c130 on n-h2-master-1 Oct 30 02:44:54.282032 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-fc91d2c3-a3d6-4988-a60b-cd04193f0a3a req-3cb238ef-2c58-4a39-a64c-b5099ae88782 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038513 Oct 30 02:44:54.282638 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4189/8039] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:46:49.677653 n-d-master-1 devstack@n-api.service[121103]: ERROR oslo.messaging._drivers.impl_rabbit [-] [975c5eab-3cac-4f3e-8d59-9cc73a7448cc] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 30 02:46:49.678874 n-d-master-1 devstack@n-api.service[121103]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b7c2a62f-729f-40a5-8849-28eec979ab4a] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 30 02:46:49.679386 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:46:49.680240 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=32 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:46:49.681650 n-d-master-1 devstack@n-api.service[121103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 30 02:46:49.683999 n-d-master-1 devstack@n-api.service[121103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 30 02:46:49.684168 n-d-master-1 devstack@n-api.service[121103]: Sun Oct 30 02:46:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130/action (ip 10.222.0.13) !!! Oct 30 02:46:49.688820 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c8c3c7bb-e319-4f30-8e64-336db428b1f3 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:46:49.691127 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c8c3c7bb-e319-4f30-8e64-336db428b1f3 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:46:49.696815 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c8c3c7bb-e319-4f30-8e64-336db428b1f3 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:46:49.697249 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c8c3c7bb-e319-4f30-8e64-336db428b1f3 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:46:49.698282 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c8c3c7bb-e319-4f30-8e64-336db428b1f3 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:46:49.698974 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c8c3c7bb-e319-4f30-8e64-336db428b1f3 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:46:49.699434 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c8c3c7bb-e319-4f30-8e64-336db428b1f3 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:46:49.699863 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c8c3c7bb-e319-4f30-8e64-336db428b1f3 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:46:49.723564 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-c8c3c7bb-e319-4f30-8e64-336db428b1f3 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lazy-loading 'flavor' on Instance uuid 6e313c6d-86a4-47e0-b461-71558843c130 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 02:46:50.118098 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c8c3c7bb-e319-4f30-8e64-336db428b1f3 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "POST /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130/action" status: 202 len: 0 microversion: 2.1 time: 0.442030 Oct 30 02:46:50.119538 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3851/8040] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 02:46:49 2022] POST /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130/action => generated 0 bytes in 444 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 02:46:50.125841 n-d-master-1 devstack@n-api.service[121102]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ea6ec045-ee0c-4212-8fa5-a40465026485] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 30 02:46:50.126668 n-d-master-1 devstack@n-api.service[121102]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8caffca0-53fa-4143-8e03-000c8bb53286] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 30 02:46:50.127290 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:46:50.128162 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=36 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:46:50.129155 n-d-master-1 devstack@n-api.service[121102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 30 02:46:50.129287 n-d-master-1 devstack@n-api.service[121102]: Sun Oct 30 02:46:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130 (ip 10.222.0.13) !!! Oct 30 02:46:50.134697 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-131f6c23-1b7d-4744-8dd2-10bbd6a5540a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:46:50.135460 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-131f6c23-1b7d-4744-8dd2-10bbd6a5540a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:46:50.142306 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-131f6c23-1b7d-4744-8dd2-10bbd6a5540a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:46:50.148132 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-131f6c23-1b7d-4744-8dd2-10bbd6a5540a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:46:50.148132 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-131f6c23-1b7d-4744-8dd2-10bbd6a5540a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:46:50.148132 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-131f6c23-1b7d-4744-8dd2-10bbd6a5540a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:46:50.148132 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-131f6c23-1b7d-4744-8dd2-10bbd6a5540a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:46:50.148132 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-131f6c23-1b7d-4744-8dd2-10bbd6a5540a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:46:50.288067 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-131f6c23-1b7d-4744-8dd2-10bbd6a5540a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:46:50.297003 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-131f6c23-1b7d-4744-8dd2-10bbd6a5540a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130" status: 200 len: 1677 microversion: 2.1 time: 0.173008 Oct 30 02:46:50.297616 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4190/8041] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:46:50 2022] GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130 => generated 1677 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:46:51.321950 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1354c628-bf21-4aba-9760-ee43a802f947 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:46:51.322660 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1354c628-bf21-4aba-9760-ee43a802f947 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:46:51.332770 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1354c628-bf21-4aba-9760-ee43a802f947 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:46:51.338843 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1354c628-bf21-4aba-9760-ee43a802f947 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:46:51.338843 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1354c628-bf21-4aba-9760-ee43a802f947 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:46:51.338843 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1354c628-bf21-4aba-9760-ee43a802f947 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:46:51.338843 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1354c628-bf21-4aba-9760-ee43a802f947 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:46:51.338843 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1354c628-bf21-4aba-9760-ee43a802f947 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:46:51.339399 n-d-master-1 devstack@n-api.service[121103]: INFO oslo.messaging._drivers.impl_rabbit [-] [b7c2a62f-729f-40a5-8849-28eec979ab4a] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 32862. Oct 30 02:46:51.339933 n-d-master-1 devstack@n-api.service[121103]: INFO oslo.messaging._drivers.impl_rabbit [-] [975c5eab-3cac-4f3e-8d59-9cc73a7448cc] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 32860. Oct 30 02:46:51.468828 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1354c628-bf21-4aba-9760-ee43a802f947 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:46:51.476586 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1354c628-bf21-4aba-9760-ee43a802f947 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130" status: 200 len: 1677 microversion: 2.1 time: 0.160210 Oct 30 02:46:51.477157 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3852/8042] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:46:51 2022] GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:46:52.500806 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e728d2ce-e4f9-4c45-a8cf-c3005143548a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:46:52.501455 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e728d2ce-e4f9-4c45-a8cf-c3005143548a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:46:52.512757 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e728d2ce-e4f9-4c45-a8cf-c3005143548a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:46:52.513262 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e728d2ce-e4f9-4c45-a8cf-c3005143548a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:46:52.513742 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e728d2ce-e4f9-4c45-a8cf-c3005143548a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:46:52.514463 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e728d2ce-e4f9-4c45-a8cf-c3005143548a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:46:52.514958 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e728d2ce-e4f9-4c45-a8cf-c3005143548a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:46:52.515428 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e728d2ce-e4f9-4c45-a8cf-c3005143548a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:46:52.521612 n-d-master-1 devstack@n-api.service[121102]: INFO oslo.messaging._drivers.impl_rabbit [-] [ea6ec045-ee0c-4212-8fa5-a40465026485] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 32868. Oct 30 02:46:52.522457 n-d-master-1 devstack@n-api.service[121102]: INFO oslo.messaging._drivers.impl_rabbit [-] [8caffca0-53fa-4143-8e03-000c8bb53286] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 32870. Oct 30 02:46:52.649467 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e728d2ce-e4f9-4c45-a8cf-c3005143548a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:46:52.657486 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e728d2ce-e4f9-4c45-a8cf-c3005143548a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130" status: 200 len: 1677 microversion: 2.1 time: 0.160607 Oct 30 02:46:52.658066 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4191/8043] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:46:52 2022] GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:46:53.680886 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ea7e458f-5c29-4716-9940-27f514a63738 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:46:53.681511 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ea7e458f-5c29-4716-9940-27f514a63738 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:46:53.688296 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ea7e458f-5c29-4716-9940-27f514a63738 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:46:53.688780 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ea7e458f-5c29-4716-9940-27f514a63738 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:46:53.689212 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ea7e458f-5c29-4716-9940-27f514a63738 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:46:53.689924 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ea7e458f-5c29-4716-9940-27f514a63738 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:46:53.690376 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ea7e458f-5c29-4716-9940-27f514a63738 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:46:53.690826 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ea7e458f-5c29-4716-9940-27f514a63738 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:46:53.822902 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ea7e458f-5c29-4716-9940-27f514a63738 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:46:53.830663 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ea7e458f-5c29-4716-9940-27f514a63738 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130" status: 200 len: 1677 microversion: 2.1 time: 0.153739 Oct 30 02:46:53.831231 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3853/8044] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:46:53 2022] GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:46:54.855263 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-95ac13d6-ed3d-48c3-bc6e-bc579fb89e6e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:46:54.855886 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-95ac13d6-ed3d-48c3-bc6e-bc579fb89e6e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:46:54.862834 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-95ac13d6-ed3d-48c3-bc6e-bc579fb89e6e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:46:54.863327 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-95ac13d6-ed3d-48c3-bc6e-bc579fb89e6e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:46:54.863772 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-95ac13d6-ed3d-48c3-bc6e-bc579fb89e6e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:46:54.864469 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-95ac13d6-ed3d-48c3-bc6e-bc579fb89e6e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:46:54.864933 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-95ac13d6-ed3d-48c3-bc6e-bc579fb89e6e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:46:54.865390 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-95ac13d6-ed3d-48c3-bc6e-bc579fb89e6e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:46:54.992968 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-95ac13d6-ed3d-48c3-bc6e-bc579fb89e6e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:46:55.000987 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-95ac13d6-ed3d-48c3-bc6e-bc579fb89e6e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130" status: 200 len: 1677 microversion: 2.1 time: 0.150091 Oct 30 02:46:55.001627 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4192/8045] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:46:54 2022] GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:46:56.024835 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e08b3cdb-4a39-4ca1-a800-539af2a152fa tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:46:56.025836 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e08b3cdb-4a39-4ca1-a800-539af2a152fa tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:46:56.032725 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e08b3cdb-4a39-4ca1-a800-539af2a152fa tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:46:56.033213 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e08b3cdb-4a39-4ca1-a800-539af2a152fa tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:46:56.033690 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e08b3cdb-4a39-4ca1-a800-539af2a152fa tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:46:56.034388 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e08b3cdb-4a39-4ca1-a800-539af2a152fa tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:46:56.034850 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e08b3cdb-4a39-4ca1-a800-539af2a152fa tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:46:56.035281 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e08b3cdb-4a39-4ca1-a800-539af2a152fa tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:46:56.170500 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e08b3cdb-4a39-4ca1-a800-539af2a152fa tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:46:56.178381 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e08b3cdb-4a39-4ca1-a800-539af2a152fa tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130" status: 200 len: 1677 microversion: 2.1 time: 0.157535 Oct 30 02:46:56.179170 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3854/8046] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:46:56 2022] GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:46:57.201370 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f63d40a6-536f-4c18-b58c-4d3a97626cfe tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:46:57.202010 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f63d40a6-536f-4c18-b58c-4d3a97626cfe tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:46:57.208835 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f63d40a6-536f-4c18-b58c-4d3a97626cfe tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:46:57.209350 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f63d40a6-536f-4c18-b58c-4d3a97626cfe tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:46:57.209845 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f63d40a6-536f-4c18-b58c-4d3a97626cfe tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:46:57.210552 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f63d40a6-536f-4c18-b58c-4d3a97626cfe tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:46:57.211027 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f63d40a6-536f-4c18-b58c-4d3a97626cfe tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:46:57.211469 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f63d40a6-536f-4c18-b58c-4d3a97626cfe tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:46:57.343793 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f63d40a6-536f-4c18-b58c-4d3a97626cfe tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:46:57.351695 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f63d40a6-536f-4c18-b58c-4d3a97626cfe tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130" status: 200 len: 1677 microversion: 2.1 time: 0.154745 Oct 30 02:46:57.352280 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4193/8047] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:46:57 2022] GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:46:58.375663 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7778d34b-18b2-4749-956e-dc79a0013f12 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:46:58.376281 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7778d34b-18b2-4749-956e-dc79a0013f12 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:46:58.383136 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7778d34b-18b2-4749-956e-dc79a0013f12 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:46:58.385293 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7778d34b-18b2-4749-956e-dc79a0013f12 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:46:58.385293 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7778d34b-18b2-4749-956e-dc79a0013f12 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:46:58.385293 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7778d34b-18b2-4749-956e-dc79a0013f12 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:46:58.385293 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7778d34b-18b2-4749-956e-dc79a0013f12 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:46:58.385779 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7778d34b-18b2-4749-956e-dc79a0013f12 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:46:58.516734 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7778d34b-18b2-4749-956e-dc79a0013f12 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:46:58.524451 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7778d34b-18b2-4749-956e-dc79a0013f12 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130" status: 200 len: 1677 microversion: 2.1 time: 0.152768 Oct 30 02:46:58.525020 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3855/8048] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:46:58 2022] GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:46:59.548211 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e24f2325-b0b2-4264-9ee2-80d55fed8198 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:46:59.548848 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e24f2325-b0b2-4264-9ee2-80d55fed8198 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:46:59.555772 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e24f2325-b0b2-4264-9ee2-80d55fed8198 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:46:59.560314 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e24f2325-b0b2-4264-9ee2-80d55fed8198 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:46:59.560314 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e24f2325-b0b2-4264-9ee2-80d55fed8198 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:46:59.560314 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e24f2325-b0b2-4264-9ee2-80d55fed8198 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:46:59.560314 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e24f2325-b0b2-4264-9ee2-80d55fed8198 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:46:59.560314 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e24f2325-b0b2-4264-9ee2-80d55fed8198 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:46:59.687735 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e24f2325-b0b2-4264-9ee2-80d55fed8198 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:46:59.695434 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e24f2325-b0b2-4264-9ee2-80d55fed8198 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130" status: 200 len: 1677 microversion: 2.1 time: 0.151204 Oct 30 02:46:59.696008 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4194/8049] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:46:59 2022] GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:47:00.718750 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3b620304-c32d-4adf-a2d7-fd5be8e18464 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:47:00.719351 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3b620304-c32d-4adf-a2d7-fd5be8e18464 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:47:00.726241 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b620304-c32d-4adf-a2d7-fd5be8e18464 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:00.726720 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b620304-c32d-4adf-a2d7-fd5be8e18464 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:00.727157 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b620304-c32d-4adf-a2d7-fd5be8e18464 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:00.727841 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b620304-c32d-4adf-a2d7-fd5be8e18464 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:00.728291 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b620304-c32d-4adf-a2d7-fd5be8e18464 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:00.728766 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b620304-c32d-4adf-a2d7-fd5be8e18464 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:00.857498 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3b620304-c32d-4adf-a2d7-fd5be8e18464 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:47:00.865170 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3b620304-c32d-4adf-a2d7-fd5be8e18464 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130" status: 200 len: 1698 microversion: 2.1 time: 0.150403 Oct 30 02:47:00.865769 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3856/8050] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:47:00 2022] GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130 => generated 1698 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:47:01.889321 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9fe0ae32-bc07-49e2-84d9-3dd033e1b4c2 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:47:02.021840 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9fe0ae32-bc07-49e2-84d9-3dd033e1b4c2 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:47:02.021840 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9fe0ae32-bc07-49e2-84d9-3dd033e1b4c2 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:02.021840 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9fe0ae32-bc07-49e2-84d9-3dd033e1b4c2 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:02.021840 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9fe0ae32-bc07-49e2-84d9-3dd033e1b4c2 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:02.021840 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9fe0ae32-bc07-49e2-84d9-3dd033e1b4c2 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:02.021840 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9fe0ae32-bc07-49e2-84d9-3dd033e1b4c2 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:02.021840 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9fe0ae32-bc07-49e2-84d9-3dd033e1b4c2 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:02.050920 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-9fe0ae32-bc07-49e2-84d9-3dd033e1b4c2 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:47:02.056835 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9fe0ae32-bc07-49e2-84d9-3dd033e1b4c2 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130" status: 200 len: 1698 microversion: 2.1 time: 0.172031 Oct 30 02:47:02.057442 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4195/8051] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:47:01 2022] GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130 => generated 1698 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:47:03.080671 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ece45b91-e58b-4817-aa8d-221de8b1d41b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:47:03.081278 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ece45b91-e58b-4817-aa8d-221de8b1d41b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:47:03.088200 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ece45b91-e58b-4817-aa8d-221de8b1d41b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:03.089197 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ece45b91-e58b-4817-aa8d-221de8b1d41b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:03.089652 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ece45b91-e58b-4817-aa8d-221de8b1d41b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:03.090347 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ece45b91-e58b-4817-aa8d-221de8b1d41b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:03.090802 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ece45b91-e58b-4817-aa8d-221de8b1d41b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:03.091229 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ece45b91-e58b-4817-aa8d-221de8b1d41b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:03.228235 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ece45b91-e58b-4817-aa8d-221de8b1d41b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:47:03.236304 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ece45b91-e58b-4817-aa8d-221de8b1d41b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130" status: 200 len: 1693 microversion: 2.1 time: 0.159596 Oct 30 02:47:03.237124 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3857/8052] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:47:03 2022] GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130 => generated 1693 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:47:04.261485 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e1f29428-120a-4f11-88f7-8d2b3b0c5de7 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:47:04.262103 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e1f29428-120a-4f11-88f7-8d2b3b0c5de7 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:47:04.269138 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e1f29428-120a-4f11-88f7-8d2b3b0c5de7 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:04.278109 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e1f29428-120a-4f11-88f7-8d2b3b0c5de7 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:04.278109 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e1f29428-120a-4f11-88f7-8d2b3b0c5de7 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:04.278109 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e1f29428-120a-4f11-88f7-8d2b3b0c5de7 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:04.278109 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e1f29428-120a-4f11-88f7-8d2b3b0c5de7 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:04.278109 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e1f29428-120a-4f11-88f7-8d2b3b0c5de7 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:04.434178 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e1f29428-120a-4f11-88f7-8d2b3b0c5de7 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:47:04.444313 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e1f29428-120a-4f11-88f7-8d2b3b0c5de7 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130" status: 200 len: 1693 microversion: 2.1 time: 0.187156 Oct 30 02:47:04.462004 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4196/8053] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:47:04 2022] GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130 => generated 1693 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:47:05.468613 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5131a7ff-15cb-4dfe-8b8e-bf7688aade25 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:47:05.469279 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5131a7ff-15cb-4dfe-8b8e-bf7688aade25 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:47:05.476609 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5131a7ff-15cb-4dfe-8b8e-bf7688aade25 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:05.477421 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5131a7ff-15cb-4dfe-8b8e-bf7688aade25 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:05.477892 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5131a7ff-15cb-4dfe-8b8e-bf7688aade25 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:05.478610 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5131a7ff-15cb-4dfe-8b8e-bf7688aade25 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:05.479117 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5131a7ff-15cb-4dfe-8b8e-bf7688aade25 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:05.479593 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5131a7ff-15cb-4dfe-8b8e-bf7688aade25 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:05.623330 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5131a7ff-15cb-4dfe-8b8e-bf7688aade25 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:47:05.632267 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5131a7ff-15cb-4dfe-8b8e-bf7688aade25 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130" status: 200 len: 1693 microversion: 2.1 time: 0.167524 Oct 30 02:47:05.633374 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3858/8054] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:47:05 2022] GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130 => generated 1693 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:47:06.546971 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-a9c31175-26bb-432e-af90-88717df86ec6 req-fed79d12-b90f-4c6c-b287-d0b4977cedaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e313c6d-86a4-47e0-b461-71558843c130", "name": "network-vif-plugged", "status": "completed", "tag": "da354005-a94f-4126-a68e-4e0ce8177a9d"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:47:06.559120 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-a9c31175-26bb-432e-af90-88717df86ec6 req-fed79d12-b90f-4c6c-b287-d0b4977cedaf service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:06.560065 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-a9c31175-26bb-432e-af90-88717df86ec6 req-fed79d12-b90f-4c6c-b287-d0b4977cedaf service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:06.560065 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-a9c31175-26bb-432e-af90-88717df86ec6 req-fed79d12-b90f-4c6c-b287-d0b4977cedaf service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:06.571707 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-a9c31175-26bb-432e-af90-88717df86ec6 req-fed79d12-b90f-4c6c-b287-d0b4977cedaf service nova] Creating event network-vif-plugged:da354005-a94f-4126-a68e-4e0ce8177a9d for instance 6e313c6d-86a4-47e0-b461-71558843c130 on n-h2-master-1 Oct 30 02:47:06.576976 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-a9c31175-26bb-432e-af90-88717df86ec6 req-fed79d12-b90f-4c6c-b287-d0b4977cedaf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035365 Oct 30 02:47:06.577795 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4197/8055] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:47:06.662876 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-532ef521-3b95-4b40-9d46-f50aaa1b9695 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:47:06.669207 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-532ef521-3b95-4b40-9d46-f50aaa1b9695 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:47:06.681154 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-532ef521-3b95-4b40-9d46-f50aaa1b9695 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:06.681689 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-532ef521-3b95-4b40-9d46-f50aaa1b9695 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:06.682129 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-532ef521-3b95-4b40-9d46-f50aaa1b9695 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:06.682873 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-532ef521-3b95-4b40-9d46-f50aaa1b9695 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:06.683326 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-532ef521-3b95-4b40-9d46-f50aaa1b9695 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:06.683748 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-532ef521-3b95-4b40-9d46-f50aaa1b9695 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:06.835442 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-532ef521-3b95-4b40-9d46-f50aaa1b9695 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:47:06.846597 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-532ef521-3b95-4b40-9d46-f50aaa1b9695 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130" status: 200 len: 1693 microversion: 2.1 time: 0.188550 Oct 30 02:47:06.847776 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3859/8056] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:47:06 2022] GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130 => generated 1693 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:47:07.872267 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b8d58cfb-7e9e-4163-889a-2fddd753c8dc tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:47:07.874191 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b8d58cfb-7e9e-4163-889a-2fddd753c8dc tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:47:07.882295 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b8d58cfb-7e9e-4163-889a-2fddd753c8dc tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:07.883202 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b8d58cfb-7e9e-4163-889a-2fddd753c8dc tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:07.883922 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b8d58cfb-7e9e-4163-889a-2fddd753c8dc tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:07.884891 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b8d58cfb-7e9e-4163-889a-2fddd753c8dc tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:07.885617 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b8d58cfb-7e9e-4163-889a-2fddd753c8dc tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:07.886291 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b8d58cfb-7e9e-4163-889a-2fddd753c8dc tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:08.043459 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b8d58cfb-7e9e-4163-889a-2fddd753c8dc tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:47:08.051960 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b8d58cfb-7e9e-4163-889a-2fddd753c8dc tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130" status: 200 len: 1693 microversion: 2.1 time: 0.184550 Oct 30 02:47:08.052894 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4198/8057] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:47:07 2022] GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130 => generated 1693 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:47:09.076411 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-aa7a0698-5de5-422a-9247-88bb86953c72 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:47:09.077048 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-aa7a0698-5de5-422a-9247-88bb86953c72 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:47:09.084795 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa7a0698-5de5-422a-9247-88bb86953c72 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:09.085301 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa7a0698-5de5-422a-9247-88bb86953c72 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:09.085770 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa7a0698-5de5-422a-9247-88bb86953c72 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:09.086507 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa7a0698-5de5-422a-9247-88bb86953c72 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:09.086971 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa7a0698-5de5-422a-9247-88bb86953c72 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:09.087441 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa7a0698-5de5-422a-9247-88bb86953c72 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:09.236325 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-aa7a0698-5de5-422a-9247-88bb86953c72 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:47:09.244597 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-aa7a0698-5de5-422a-9247-88bb86953c72 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130" status: 200 len: 1693 microversion: 2.1 time: 0.172234 Oct 30 02:47:09.245194 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3860/8058] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:47:09 2022] GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130 => generated 1693 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:47:10.428389 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0095afec-c0b6-4eb7-8fde-d8885b41073a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:47:10.429048 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0095afec-c0b6-4eb7-8fde-d8885b41073a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:47:10.437579 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0095afec-c0b6-4eb7-8fde-d8885b41073a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:10.438100 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0095afec-c0b6-4eb7-8fde-d8885b41073a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:10.438551 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0095afec-c0b6-4eb7-8fde-d8885b41073a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:10.439491 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0095afec-c0b6-4eb7-8fde-d8885b41073a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:10.440143 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0095afec-c0b6-4eb7-8fde-d8885b41073a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:10.440594 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0095afec-c0b6-4eb7-8fde-d8885b41073a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:10.583795 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-0095afec-c0b6-4eb7-8fde-d8885b41073a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:47:10.593151 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0095afec-c0b6-4eb7-8fde-d8885b41073a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130" status: 200 len: 1693 microversion: 2.1 time: 0.168816 Oct 30 02:47:10.601511 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4199/8059] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:47:10 2022] GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130 => generated 1693 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:47:11.616462 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-19da3a4e-5cdc-4e64-8b54-43ac401d1bbf tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:47:11.617910 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-19da3a4e-5cdc-4e64-8b54-43ac401d1bbf tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:47:11.625696 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-19da3a4e-5cdc-4e64-8b54-43ac401d1bbf tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:11.626274 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-19da3a4e-5cdc-4e64-8b54-43ac401d1bbf tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:11.626789 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-19da3a4e-5cdc-4e64-8b54-43ac401d1bbf tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:11.627506 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-19da3a4e-5cdc-4e64-8b54-43ac401d1bbf tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:11.627969 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-19da3a4e-5cdc-4e64-8b54-43ac401d1bbf tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:11.628400 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-19da3a4e-5cdc-4e64-8b54-43ac401d1bbf tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:11.779687 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-19da3a4e-5cdc-4e64-8b54-43ac401d1bbf tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:47:11.788253 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-19da3a4e-5cdc-4e64-8b54-43ac401d1bbf tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130" status: 200 len: 1693 microversion: 2.1 time: 0.176024 Oct 30 02:47:11.788843 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3861/8060] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:47:11 2022] GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130 => generated 1693 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:47:12.811746 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c9e2f9f5-e46e-4995-974b-8d056f92794a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:47:12.812470 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c9e2f9f5-e46e-4995-974b-8d056f92794a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:47:12.820399 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c9e2f9f5-e46e-4995-974b-8d056f92794a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:12.820893 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c9e2f9f5-e46e-4995-974b-8d056f92794a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:12.821361 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c9e2f9f5-e46e-4995-974b-8d056f92794a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:12.822068 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c9e2f9f5-e46e-4995-974b-8d056f92794a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:12.822544 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c9e2f9f5-e46e-4995-974b-8d056f92794a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:12.822962 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c9e2f9f5-e46e-4995-974b-8d056f92794a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:12.972549 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c9e2f9f5-e46e-4995-974b-8d056f92794a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:47:12.983796 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c9e2f9f5-e46e-4995-974b-8d056f92794a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130" status: 200 len: 1693 microversion: 2.1 time: 0.175873 Oct 30 02:47:12.984399 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4200/8061] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:47:12 2022] GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130 => generated 1693 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:47:14.007372 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b089087c-86bd-4c56-b505-8a769c5cc86e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:47:14.007936 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b089087c-86bd-4c56-b505-8a769c5cc86e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:47:14.015465 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b089087c-86bd-4c56-b505-8a769c5cc86e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:14.015966 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b089087c-86bd-4c56-b505-8a769c5cc86e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:14.016409 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b089087c-86bd-4c56-b505-8a769c5cc86e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:14.017108 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b089087c-86bd-4c56-b505-8a769c5cc86e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:14.017608 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b089087c-86bd-4c56-b505-8a769c5cc86e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:14.018041 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b089087c-86bd-4c56-b505-8a769c5cc86e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:14.151342 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b089087c-86bd-4c56-b505-8a769c5cc86e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:47:14.159289 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b089087c-86bd-4c56-b505-8a769c5cc86e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130" status: 200 len: 1693 microversion: 2.1 time: 0.155967 Oct 30 02:47:14.159872 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3862/8062] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:47:14 2022] GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130 => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:47:15.182798 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-946f5a01-459f-4827-8d17-c6f4dcadba01 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:47:15.183436 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-946f5a01-459f-4827-8d17-c6f4dcadba01 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:47:15.190326 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-946f5a01-459f-4827-8d17-c6f4dcadba01 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:15.190827 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-946f5a01-459f-4827-8d17-c6f4dcadba01 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:15.191280 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-946f5a01-459f-4827-8d17-c6f4dcadba01 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:15.191989 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-946f5a01-459f-4827-8d17-c6f4dcadba01 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:15.192464 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-946f5a01-459f-4827-8d17-c6f4dcadba01 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:15.192910 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-946f5a01-459f-4827-8d17-c6f4dcadba01 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:15.328215 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-946f5a01-459f-4827-8d17-c6f4dcadba01 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:47:15.336504 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-946f5a01-459f-4827-8d17-c6f4dcadba01 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130" status: 200 len: 1675 microversion: 2.1 time: 0.157640 Oct 30 02:47:15.337088 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4201/8063] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:47:15 2022] GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130 => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:47:16.362877 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d0882498-f394-4b00-9632-c32a744c4723 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:47:16.363477 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d0882498-f394-4b00-9632-c32a744c4723 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:47:16.371236 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d0882498-f394-4b00-9632-c32a744c4723 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:16.371236 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d0882498-f394-4b00-9632-c32a744c4723 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:16.371508 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d0882498-f394-4b00-9632-c32a744c4723 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:16.372026 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d0882498-f394-4b00-9632-c32a744c4723 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:16.372484 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d0882498-f394-4b00-9632-c32a744c4723 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:16.372937 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d0882498-f394-4b00-9632-c32a744c4723 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:16.502553 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d0882498-f394-4b00-9632-c32a744c4723 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:47:16.509997 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d0882498-f394-4b00-9632-c32a744c4723 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130" status: 200 len: 1675 microversion: 2.1 time: 0.151046 Oct 30 02:47:16.510588 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3863/8064] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:47:16 2022] GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130 => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:47:17.532538 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cb83306c-6bcb-4c6b-9f7b-572b2b83c5f7 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:47:17.533159 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cb83306c-6bcb-4c6b-9f7b-572b2b83c5f7 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:47:17.540327 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cb83306c-6bcb-4c6b-9f7b-572b2b83c5f7 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:17.540955 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cb83306c-6bcb-4c6b-9f7b-572b2b83c5f7 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:17.541426 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cb83306c-6bcb-4c6b-9f7b-572b2b83c5f7 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:17.542127 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cb83306c-6bcb-4c6b-9f7b-572b2b83c5f7 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:17.542618 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cb83306c-6bcb-4c6b-9f7b-572b2b83c5f7 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:17.543051 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cb83306c-6bcb-4c6b-9f7b-572b2b83c5f7 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:17.676271 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-cb83306c-6bcb-4c6b-9f7b-572b2b83c5f7 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:47:17.684021 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cb83306c-6bcb-4c6b-9f7b-572b2b83c5f7 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130" status: 200 len: 1618 microversion: 2.1 time: 0.155440 Oct 30 02:47:17.684599 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4202/8065] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:47:17 2022] GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130 => generated 1618 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:47:17.706862 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f212ad91-e4e3-4d38-8551-d97835907798 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:47:17.707482 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f212ad91-e4e3-4d38-8551-d97835907798 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:47:17.714455 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f212ad91-e4e3-4d38-8551-d97835907798 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:17.714973 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f212ad91-e4e3-4d38-8551-d97835907798 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:17.715415 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f212ad91-e4e3-4d38-8551-d97835907798 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:17.716104 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f212ad91-e4e3-4d38-8551-d97835907798 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:17.717039 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f212ad91-e4e3-4d38-8551-d97835907798 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:17.717512 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f212ad91-e4e3-4d38-8551-d97835907798 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:17.759277 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f212ad91-e4e3-4d38-8551-d97835907798 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121103) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 30 02:47:17.913254 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:47:18.117180 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f212ad91-e4e3-4d38-8551-d97835907798 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "POST /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130/action" status: 202 len: 0 microversion: 2.1 time: 0.414303 Oct 30 02:47:18.117974 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3864/8066] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 02:47:17 2022] POST /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130/action => generated 0 bytes in 416 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 02:47:18.126170 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-855de3f7-5505-4285-986e-b3a5d59dd7db tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:47:18.126839 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-855de3f7-5505-4285-986e-b3a5d59dd7db tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:47:18.132793 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-855de3f7-5505-4285-986e-b3a5d59dd7db tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:18.133295 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-855de3f7-5505-4285-986e-b3a5d59dd7db tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:18.133780 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-855de3f7-5505-4285-986e-b3a5d59dd7db tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:18.134558 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-855de3f7-5505-4285-986e-b3a5d59dd7db tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:18.135228 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-855de3f7-5505-4285-986e-b3a5d59dd7db tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:18.135716 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-855de3f7-5505-4285-986e-b3a5d59dd7db tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:18.273886 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-855de3f7-5505-4285-986e-b3a5d59dd7db tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:47:18.279136 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-855de3f7-5505-4285-986e-b3a5d59dd7db tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130" status: 200 len: 1626 microversion: 2.1 time: 0.156963 Oct 30 02:47:18.280258 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4203/8067] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:47:18 2022] GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130 => generated 1626 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:47:18.639120 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-1e674216-9466-44a1-80cd-2572a5d0a535 req-927962e1-3b19-4d7b-94bf-72e0a08b0410 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e313c6d-86a4-47e0-b461-71558843c130", "name": "network-vif-unplugged", "status": "completed", "tag": "da354005-a94f-4126-a68e-4e0ce8177a9d"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:47:18.647707 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-1e674216-9466-44a1-80cd-2572a5d0a535 req-927962e1-3b19-4d7b-94bf-72e0a08b0410 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:18.648191 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-1e674216-9466-44a1-80cd-2572a5d0a535 req-927962e1-3b19-4d7b-94bf-72e0a08b0410 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:18.648687 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-1e674216-9466-44a1-80cd-2572a5d0a535 req-927962e1-3b19-4d7b-94bf-72e0a08b0410 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:18.660175 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.compute.server_external_events [req-1e674216-9466-44a1-80cd-2572a5d0a535 req-927962e1-3b19-4d7b-94bf-72e0a08b0410 service nova] Unable to find a host for instance 6e313c6d-86a4-47e0-b461-71558843c130. Dropping event network-vif-unplugged {{(pid=121103) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 30 02:47:18.661313 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-1e674216-9466-44a1-80cd-2572a5d0a535 req-927962e1-3b19-4d7b-94bf-72e0a08b0410 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030021 Oct 30 02:47:18.661908 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3865/8068] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 30 02:47:19.302742 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7aa354ab-4d8a-4996-84f5-0477244fdc17 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:47:19.303344 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7aa354ab-4d8a-4996-84f5-0477244fdc17 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:47:19.310529 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7aa354ab-4d8a-4996-84f5-0477244fdc17 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:19.316569 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7aa354ab-4d8a-4996-84f5-0477244fdc17 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:19.316569 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7aa354ab-4d8a-4996-84f5-0477244fdc17 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:19.316569 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7aa354ab-4d8a-4996-84f5-0477244fdc17 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:19.316569 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7aa354ab-4d8a-4996-84f5-0477244fdc17 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:19.316569 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7aa354ab-4d8a-4996-84f5-0477244fdc17 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:19.462337 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7aa354ab-4d8a-4996-84f5-0477244fdc17 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:47:19.470779 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7aa354ab-4d8a-4996-84f5-0477244fdc17 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130" status: 200 len: 1626 microversion: 2.1 time: 0.172151 Oct 30 02:47:19.471417 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4204/8069] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:47:19 2022] GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130 => generated 1626 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:47:20.494753 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1c61391f-d249-42c0-8f3d-12b99002e5b2 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:47:20.495352 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1c61391f-d249-42c0-8f3d-12b99002e5b2 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:47:20.498107 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:47:20.503716 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1c61391f-d249-42c0-8f3d-12b99002e5b2 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:20.504211 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1c61391f-d249-42c0-8f3d-12b99002e5b2 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:20.504672 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1c61391f-d249-42c0-8f3d-12b99002e5b2 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:20.505388 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1c61391f-d249-42c0-8f3d-12b99002e5b2 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:20.505850 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1c61391f-d249-42c0-8f3d-12b99002e5b2 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:20.506277 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1c61391f-d249-42c0-8f3d-12b99002e5b2 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:20.747009 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1c61391f-d249-42c0-8f3d-12b99002e5b2 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:47:20.754857 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1c61391f-d249-42c0-8f3d-12b99002e5b2 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130" status: 200 len: 1684 microversion: 2.1 time: 0.264135 Oct 30 02:47:20.755446 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3866/8070] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:47:20 2022] GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130 => generated 1684 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:47:21.456102 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-ec6d993e-3a06-46d6-9a8f-72854e5fb271 req-71f9ba76-df63-4513-b29d-a56e7ec8cfab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e313c6d-86a4-47e0-b461-71558843c130", "tag": "da354005-a94f-4126-a68e-4e0ce8177a9d"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:47:21.461903 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=31 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:47:21.467091 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ec6d993e-3a06-46d6-9a8f-72854e5fb271 req-71f9ba76-df63-4513-b29d-a56e7ec8cfab service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:21.467549 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ec6d993e-3a06-46d6-9a8f-72854e5fb271 req-71f9ba76-df63-4513-b29d-a56e7ec8cfab service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:21.468009 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ec6d993e-3a06-46d6-9a8f-72854e5fb271 req-71f9ba76-df63-4513-b29d-a56e7ec8cfab service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:21.471918 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=87 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:47:21.479524 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-ec6d993e-3a06-46d6-9a8f-72854e5fb271 req-71f9ba76-df63-4513-b29d-a56e7ec8cfab service nova] Creating event network-changed:da354005-a94f-4126-a68e-4e0ce8177a9d for instance 6e313c6d-86a4-47e0-b461-71558843c130 on n-h1-master-1 Oct 30 02:47:21.484583 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-ec6d993e-3a06-46d6-9a8f-72854e5fb271 req-71f9ba76-df63-4513-b29d-a56e7ec8cfab service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032893 Oct 30 02:47:21.489609 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4205/8071] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:47:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:47:21.778427 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-236944b2-b023-4178-b826-972d84122b09 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:47:21.779043 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-236944b2-b023-4178-b826-972d84122b09 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:47:21.784987 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-236944b2-b023-4178-b826-972d84122b09 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:21.785764 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-236944b2-b023-4178-b826-972d84122b09 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:21.786206 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-236944b2-b023-4178-b826-972d84122b09 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:21.786892 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-236944b2-b023-4178-b826-972d84122b09 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:21.787347 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-236944b2-b023-4178-b826-972d84122b09 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:21.787771 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-236944b2-b023-4178-b826-972d84122b09 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:22.033416 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-236944b2-b023-4178-b826-972d84122b09 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:47:22.041455 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-236944b2-b023-4178-b826-972d84122b09 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130" status: 200 len: 1684 microversion: 2.1 time: 0.267210 Oct 30 02:47:22.042226 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3867/8072] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:47:21 2022] GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130 => generated 1684 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:47:23.067686 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-00e97cb9-3003-4fe5-8f19-fadb54ab7faf tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:47:23.068402 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-00e97cb9-3003-4fe5-8f19-fadb54ab7faf tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:47:23.075232 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00e97cb9-3003-4fe5-8f19-fadb54ab7faf tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:23.075723 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00e97cb9-3003-4fe5-8f19-fadb54ab7faf tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:23.076165 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00e97cb9-3003-4fe5-8f19-fadb54ab7faf tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:23.076865 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00e97cb9-3003-4fe5-8f19-fadb54ab7faf tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:23.077342 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00e97cb9-3003-4fe5-8f19-fadb54ab7faf tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:23.077788 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00e97cb9-3003-4fe5-8f19-fadb54ab7faf tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:23.222629 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-00e97cb9-3003-4fe5-8f19-fadb54ab7faf tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:47:23.230426 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-00e97cb9-3003-4fe5-8f19-fadb54ab7faf tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130" status: 200 len: 1684 microversion: 2.1 time: 0.168712 Oct 30 02:47:23.230999 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4206/8073] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:47:23 2022] GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130 => generated 1684 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:47:24.258393 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d839da28-6d63-4e24-90d6-6cfa70ef116a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:47:24.259861 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d839da28-6d63-4e24-90d6-6cfa70ef116a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:47:24.269196 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d839da28-6d63-4e24-90d6-6cfa70ef116a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:24.269721 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d839da28-6d63-4e24-90d6-6cfa70ef116a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:24.276191 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d839da28-6d63-4e24-90d6-6cfa70ef116a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:24.276191 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d839da28-6d63-4e24-90d6-6cfa70ef116a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:24.276191 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d839da28-6d63-4e24-90d6-6cfa70ef116a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:24.276191 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d839da28-6d63-4e24-90d6-6cfa70ef116a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:24.419773 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d839da28-6d63-4e24-90d6-6cfa70ef116a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:47:24.427759 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d839da28-6d63-4e24-90d6-6cfa70ef116a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130" status: 200 len: 1684 microversion: 2.1 time: 0.174921 Oct 30 02:47:24.441668 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3868/8074] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:47:24 2022] GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130 => generated 1684 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:47:25.453626 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f17f2010-802d-48ca-9c33-e09fa3e869c7 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:47:25.454493 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f17f2010-802d-48ca-9c33-e09fa3e869c7 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:47:25.463069 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f17f2010-802d-48ca-9c33-e09fa3e869c7 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:25.463773 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f17f2010-802d-48ca-9c33-e09fa3e869c7 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:25.464233 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f17f2010-802d-48ca-9c33-e09fa3e869c7 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:25.465232 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f17f2010-802d-48ca-9c33-e09fa3e869c7 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:25.465935 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f17f2010-802d-48ca-9c33-e09fa3e869c7 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:25.466388 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f17f2010-802d-48ca-9c33-e09fa3e869c7 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:25.616476 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f17f2010-802d-48ca-9c33-e09fa3e869c7 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:47:25.625271 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f17f2010-802d-48ca-9c33-e09fa3e869c7 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130" status: 200 len: 1684 microversion: 2.1 time: 0.175784 Oct 30 02:47:25.625904 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4207/8075] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:47:25 2022] GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130 => generated 1684 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:47:26.649434 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-94e8f5a2-2183-4bb2-b329-f6e825ef98ba tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:47:26.650058 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-94e8f5a2-2183-4bb2-b329-f6e825ef98ba tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:47:26.657076 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94e8f5a2-2183-4bb2-b329-f6e825ef98ba tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:26.657847 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94e8f5a2-2183-4bb2-b329-f6e825ef98ba tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:26.658285 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94e8f5a2-2183-4bb2-b329-f6e825ef98ba tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:26.658985 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94e8f5a2-2183-4bb2-b329-f6e825ef98ba tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:26.659497 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94e8f5a2-2183-4bb2-b329-f6e825ef98ba tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:26.659924 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-94e8f5a2-2183-4bb2-b329-f6e825ef98ba tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:26.795501 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-94e8f5a2-2183-4bb2-b329-f6e825ef98ba tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:47:26.806273 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-94e8f5a2-2183-4bb2-b329-f6e825ef98ba tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130" status: 200 len: 1684 microversion: 2.1 time: 0.160738 Oct 30 02:47:26.811877 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3869/8076] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:47:26 2022] GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130 => generated 1684 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:47:27.831097 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-678a90e4-006c-4b97-9021-a7037a92fedd tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:47:27.832532 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-678a90e4-006c-4b97-9021-a7037a92fedd tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:47:27.840175 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-678a90e4-006c-4b97-9021-a7037a92fedd tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:27.841071 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-678a90e4-006c-4b97-9021-a7037a92fedd tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:27.841621 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-678a90e4-006c-4b97-9021-a7037a92fedd tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:27.842417 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-678a90e4-006c-4b97-9021-a7037a92fedd tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:27.843182 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-678a90e4-006c-4b97-9021-a7037a92fedd tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:27.843626 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-678a90e4-006c-4b97-9021-a7037a92fedd tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:27.991571 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-678a90e4-006c-4b97-9021-a7037a92fedd tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:47:28.001115 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-678a90e4-006c-4b97-9021-a7037a92fedd tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130" status: 200 len: 1684 microversion: 2.1 time: 0.174423 Oct 30 02:47:28.001730 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4208/8077] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:47:27 2022] GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130 => generated 1684 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:47:29.024240 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d041cdff-5dda-4c15-bab0-44c06af508bf tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:47:29.025149 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d041cdff-5dda-4c15-bab0-44c06af508bf tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:47:29.032338 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d041cdff-5dda-4c15-bab0-44c06af508bf tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:29.032825 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d041cdff-5dda-4c15-bab0-44c06af508bf tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:29.033266 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d041cdff-5dda-4c15-bab0-44c06af508bf tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:29.034007 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d041cdff-5dda-4c15-bab0-44c06af508bf tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:29.034464 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d041cdff-5dda-4c15-bab0-44c06af508bf tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:29.034892 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d041cdff-5dda-4c15-bab0-44c06af508bf tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:29.186865 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-d041cdff-5dda-4c15-bab0-44c06af508bf tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:47:29.196829 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d041cdff-5dda-4c15-bab0-44c06af508bf tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130" status: 200 len: 1684 microversion: 2.1 time: 0.176544 Oct 30 02:47:29.198089 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3870/8078] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:47:29 2022] GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130 => generated 1684 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:47:30.221485 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d4107ba3-a2b1-4d13-9eb4-180c019336fc tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:47:30.222116 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d4107ba3-a2b1-4d13-9eb4-180c019336fc tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:47:30.228982 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4107ba3-a2b1-4d13-9eb4-180c019336fc tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:30.229513 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4107ba3-a2b1-4d13-9eb4-180c019336fc tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:30.229966 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4107ba3-a2b1-4d13-9eb4-180c019336fc tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:30.230671 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4107ba3-a2b1-4d13-9eb4-180c019336fc tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:30.231146 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4107ba3-a2b1-4d13-9eb4-180c019336fc tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:30.231588 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4107ba3-a2b1-4d13-9eb4-180c019336fc tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:30.368357 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d4107ba3-a2b1-4d13-9eb4-180c019336fc tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:47:30.376128 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d4107ba3-a2b1-4d13-9eb4-180c019336fc tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130" status: 200 len: 1684 microversion: 2.1 time: 0.159134 Oct 30 02:47:30.376713 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4209/8079] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:47:30 2022] GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130 => generated 1684 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:47:31.399531 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c9212b89-2a62-437c-b2a5-7f579214d284 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:47:31.400146 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c9212b89-2a62-437c-b2a5-7f579214d284 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:47:31.407454 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c9212b89-2a62-437c-b2a5-7f579214d284 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:31.407935 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c9212b89-2a62-437c-b2a5-7f579214d284 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:31.408367 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c9212b89-2a62-437c-b2a5-7f579214d284 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:31.409076 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c9212b89-2a62-437c-b2a5-7f579214d284 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:31.409544 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c9212b89-2a62-437c-b2a5-7f579214d284 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:31.409969 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c9212b89-2a62-437c-b2a5-7f579214d284 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:31.542288 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c9212b89-2a62-437c-b2a5-7f579214d284 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:47:31.550691 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c9212b89-2a62-437c-b2a5-7f579214d284 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130" status: 200 len: 1684 microversion: 2.1 time: 0.155087 Oct 30 02:47:31.551263 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3871/8080] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:47:31 2022] GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130 => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:47:32.573780 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6b9d3f6d-c5da-40ff-8182-7e3ebc054b10 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:47:32.574407 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6b9d3f6d-c5da-40ff-8182-7e3ebc054b10 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:47:32.581292 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b9d3f6d-c5da-40ff-8182-7e3ebc054b10 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:32.581815 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b9d3f6d-c5da-40ff-8182-7e3ebc054b10 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:32.582260 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b9d3f6d-c5da-40ff-8182-7e3ebc054b10 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:32.582960 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b9d3f6d-c5da-40ff-8182-7e3ebc054b10 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:32.583428 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b9d3f6d-c5da-40ff-8182-7e3ebc054b10 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:32.583860 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6b9d3f6d-c5da-40ff-8182-7e3ebc054b10 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:32.715439 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6b9d3f6d-c5da-40ff-8182-7e3ebc054b10 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:47:32.723904 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6b9d3f6d-c5da-40ff-8182-7e3ebc054b10 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130" status: 200 len: 1684 microversion: 2.1 time: 0.153999 Oct 30 02:47:32.724469 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4210/8081] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:47:32 2022] GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130 => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:47:33.747201 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-24f4229e-9f28-4185-9037-ed0d4acd9c8e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:47:33.747809 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-24f4229e-9f28-4185-9037-ed0d4acd9c8e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:47:33.755736 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-24f4229e-9f28-4185-9037-ed0d4acd9c8e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:33.756228 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-24f4229e-9f28-4185-9037-ed0d4acd9c8e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:33.757011 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-24f4229e-9f28-4185-9037-ed0d4acd9c8e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:33.757744 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-24f4229e-9f28-4185-9037-ed0d4acd9c8e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:33.758199 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-24f4229e-9f28-4185-9037-ed0d4acd9c8e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:33.758623 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-24f4229e-9f28-4185-9037-ed0d4acd9c8e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:33.897678 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-24f4229e-9f28-4185-9037-ed0d4acd9c8e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:47:33.905562 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-24f4229e-9f28-4185-9037-ed0d4acd9c8e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130" status: 200 len: 1684 microversion: 2.1 time: 0.162313 Oct 30 02:47:33.906142 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3872/8082] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:47:33 2022] GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130 => generated 1684 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:47:34.929803 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-821edbbe-c4b2-4ae3-845a-b15c52f7d719 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:47:34.930435 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-821edbbe-c4b2-4ae3-845a-b15c52f7d719 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:47:34.937480 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-821edbbe-c4b2-4ae3-845a-b15c52f7d719 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:34.937980 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-821edbbe-c4b2-4ae3-845a-b15c52f7d719 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:34.938433 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-821edbbe-c4b2-4ae3-845a-b15c52f7d719 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:34.939628 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-821edbbe-c4b2-4ae3-845a-b15c52f7d719 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:34.940098 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-821edbbe-c4b2-4ae3-845a-b15c52f7d719 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:34.940538 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-821edbbe-c4b2-4ae3-845a-b15c52f7d719 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:35.075317 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-821edbbe-c4b2-4ae3-845a-b15c52f7d719 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:47:35.084027 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-821edbbe-c4b2-4ae3-845a-b15c52f7d719 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130" status: 200 len: 1684 microversion: 2.1 time: 0.158097 Oct 30 02:47:35.084637 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4211/8083] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:47:34 2022] GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130 => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:47:35.242370 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-75dd7d4b-a5ee-44e5-a039-c644a8fdb621 req-db4a9c85-7ace-440f-bca6-68f7a4025d88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e313c6d-86a4-47e0-b461-71558843c130", "name": "network-vif-plugged", "status": "completed", "tag": "da354005-a94f-4126-a68e-4e0ce8177a9d"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:47:35.253529 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-75dd7d4b-a5ee-44e5-a039-c644a8fdb621 req-db4a9c85-7ace-440f-bca6-68f7a4025d88 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:35.254018 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-75dd7d4b-a5ee-44e5-a039-c644a8fdb621 req-db4a9c85-7ace-440f-bca6-68f7a4025d88 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:35.254455 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-75dd7d4b-a5ee-44e5-a039-c644a8fdb621 req-db4a9c85-7ace-440f-bca6-68f7a4025d88 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:35.265929 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-75dd7d4b-a5ee-44e5-a039-c644a8fdb621 req-db4a9c85-7ace-440f-bca6-68f7a4025d88 service nova] Creating event network-vif-plugged:da354005-a94f-4126-a68e-4e0ce8177a9d for instance 6e313c6d-86a4-47e0-b461-71558843c130 on n-h1-master-1 Oct 30 02:47:35.272236 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-75dd7d4b-a5ee-44e5-a039-c644a8fdb621 req-db4a9c85-7ace-440f-bca6-68f7a4025d88 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033723 Oct 30 02:47:35.272825 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3873/8084] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:47:36.107006 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-01496343-03f4-49ad-a25b-f8a37228659a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:47:36.107633 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-01496343-03f4-49ad-a25b-f8a37228659a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:47:36.114511 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-01496343-03f4-49ad-a25b-f8a37228659a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:36.115001 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-01496343-03f4-49ad-a25b-f8a37228659a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:36.115448 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-01496343-03f4-49ad-a25b-f8a37228659a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:36.116147 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-01496343-03f4-49ad-a25b-f8a37228659a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:36.116613 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-01496343-03f4-49ad-a25b-f8a37228659a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:36.117048 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-01496343-03f4-49ad-a25b-f8a37228659a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:36.245763 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-01496343-03f4-49ad-a25b-f8a37228659a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:47:36.253671 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-01496343-03f4-49ad-a25b-f8a37228659a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130" status: 200 len: 1684 microversion: 2.1 time: 0.150563 Oct 30 02:47:36.254252 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4212/8085] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:47:36 2022] GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130 => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:47:37.278127 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f8bf2942-451a-484c-bac3-5488de797219 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:47:37.278845 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f8bf2942-451a-484c-bac3-5488de797219 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:47:37.287768 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f8bf2942-451a-484c-bac3-5488de797219 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:37.288275 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f8bf2942-451a-484c-bac3-5488de797219 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:37.288721 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f8bf2942-451a-484c-bac3-5488de797219 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:37.289467 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f8bf2942-451a-484c-bac3-5488de797219 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:37.289935 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f8bf2942-451a-484c-bac3-5488de797219 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:37.296364 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f8bf2942-451a-484c-bac3-5488de797219 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:37.433094 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-f8bf2942-451a-484c-bac3-5488de797219 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:47:37.441040 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f8bf2942-451a-484c-bac3-5488de797219 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130" status: 200 len: 1684 microversion: 2.1 time: 0.167552 Oct 30 02:47:37.441606 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3874/8086] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:47:37 2022] GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130 => generated 1684 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:47:38.464036 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e507da11-1dca-4179-a5d3-7a38cd8a61a6 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:47:38.464663 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e507da11-1dca-4179-a5d3-7a38cd8a61a6 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:47:38.472079 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e507da11-1dca-4179-a5d3-7a38cd8a61a6 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:38.472567 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e507da11-1dca-4179-a5d3-7a38cd8a61a6 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:38.473008 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e507da11-1dca-4179-a5d3-7a38cd8a61a6 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:38.473788 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e507da11-1dca-4179-a5d3-7a38cd8a61a6 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:47:38.474256 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e507da11-1dca-4179-a5d3-7a38cd8a61a6 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:47:38.474691 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e507da11-1dca-4179-a5d3-7a38cd8a61a6 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:47:38.603539 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e507da11-1dca-4179-a5d3-7a38cd8a61a6 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:47:38.611290 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e507da11-1dca-4179-a5d3-7a38cd8a61a6 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130" status: 200 len: 1671 microversion: 2.1 time: 0.151192 Oct 30 02:47:38.611868 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4213/8087] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:47:38 2022] GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130 => generated 1671 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:48:47.709696 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=17 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:48:47.710591 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d7566bf4-720f-416d-a818-51d9f3fb23ac tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:48:47.711106 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d7566bf4-720f-416d-a818-51d9f3fb23ac tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:48:47.711630 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=49 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:48:47.712812 n-d-master-1 devstack@n-api.service[121102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 30 02:48:47.713308 n-d-master-1 devstack@n-api.service[121102]: Sun Oct 30 02:48:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.13) !!! Oct 30 02:48:47.713775 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=17 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:48:47.716123 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:48:47.728855 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d7566bf4-720f-416d-a818-51d9f3fb23ac tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:48:47.730148 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d7566bf4-720f-416d-a818-51d9f3fb23ac tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:48:47.730614 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d7566bf4-720f-416d-a818-51d9f3fb23ac tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:48:47.731338 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d7566bf4-720f-416d-a818-51d9f3fb23ac tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:48:47.731801 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d7566bf4-720f-416d-a818-51d9f3fb23ac tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:48:47.732230 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d7566bf4-720f-416d-a818-51d9f3fb23ac tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:48:47.768872 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d7566bf4-720f-416d-a818-51d9f3fb23ac tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 02:48:47.784319 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-c1f43436-68b1-4daf-8fc9-383d9efda5cf req-7e2cfd92-54a9-4efa-bc84-24cc66a53763 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e313c6d-86a4-47e0-b461-71558843c130", "tag": "da354005-a94f-4126-a68e-4e0ce8177a9d"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:48:47.798698 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-c1f43436-68b1-4daf-8fc9-383d9efda5cf req-7e2cfd92-54a9-4efa-bc84-24cc66a53763 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:48:47.799347 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-c1f43436-68b1-4daf-8fc9-383d9efda5cf req-7e2cfd92-54a9-4efa-bc84-24cc66a53763 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:48:47.800442 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-c1f43436-68b1-4daf-8fc9-383d9efda5cf req-7e2cfd92-54a9-4efa-bc84-24cc66a53763 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:48:47.813446 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-c1f43436-68b1-4daf-8fc9-383d9efda5cf req-7e2cfd92-54a9-4efa-bc84-24cc66a53763 service nova] Creating event network-changed:da354005-a94f-4126-a68e-4e0ce8177a9d for instance 6e313c6d-86a4-47e0-b461-71558843c130 on n-h1-master-1 Oct 30 02:48:47.819349 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-c1f43436-68b1-4daf-8fc9-383d9efda5cf req-7e2cfd92-54a9-4efa-bc84-24cc66a53763 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111436 Oct 30 02:48:47.820260 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4214/8088] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:48:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:48:48.078143 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d7566bf4-720f-416d-a818-51d9f3fb23ac tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130" status: 204 len: 0 microversion: 2.1 time: 0.372673 Oct 30 02:48:48.078735 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3875/8089] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 02:48:47 2022] DELETE /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 02:48:48.087974 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1df96926-858d-446d-8a3e-2cbc2e65e80b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:48:48.088716 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1df96926-858d-446d-8a3e-2cbc2e65e80b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:48:48.095023 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1df96926-858d-446d-8a3e-2cbc2e65e80b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:48:48.095749 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1df96926-858d-446d-8a3e-2cbc2e65e80b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:48:48.096194 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1df96926-858d-446d-8a3e-2cbc2e65e80b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:48:48.096901 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1df96926-858d-446d-8a3e-2cbc2e65e80b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:48:48.097382 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1df96926-858d-446d-8a3e-2cbc2e65e80b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:48:48.098393 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1df96926-858d-446d-8a3e-2cbc2e65e80b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:48:48.237824 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1df96926-858d-446d-8a3e-2cbc2e65e80b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:48:48.245770 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1df96926-858d-446d-8a3e-2cbc2e65e80b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130" status: 200 len: 1677 microversion: 2.1 time: 0.161999 Oct 30 02:48:48.247721 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4215/8090] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:48:48 2022] GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:48:49.269704 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-16d8fcbd-4ffb-4414-80ad-ace5a21b68f5 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:48:49.270429 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-16d8fcbd-4ffb-4414-80ad-ace5a21b68f5 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:48:49.277661 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-16d8fcbd-4ffb-4414-80ad-ace5a21b68f5 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:48:49.278143 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-16d8fcbd-4ffb-4414-80ad-ace5a21b68f5 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:48:49.278573 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-16d8fcbd-4ffb-4414-80ad-ace5a21b68f5 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:48:49.279257 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-16d8fcbd-4ffb-4414-80ad-ace5a21b68f5 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:48:49.279706 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-16d8fcbd-4ffb-4414-80ad-ace5a21b68f5 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:48:49.280131 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-16d8fcbd-4ffb-4414-80ad-ace5a21b68f5 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:48:49.495193 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-16d8fcbd-4ffb-4414-80ad-ace5a21b68f5 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:48:49.504056 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-16d8fcbd-4ffb-4414-80ad-ace5a21b68f5 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130" status: 200 len: 1677 microversion: 2.1 time: 0.238737 Oct 30 02:48:49.504606 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3876/8091] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:48:49 2022] GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130 => generated 1677 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:48:49.981961 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-ce01f8d2-170d-45b8-a1f7-94701c4a7a7c req-3e55a0cf-50e9-42da-af7a-157b48e9547a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e313c6d-86a4-47e0-b461-71558843c130", "name": "network-vif-deleted", "tag": "da354005-a94f-4126-a68e-4e0ce8177a9d"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:48:49.993161 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ce01f8d2-170d-45b8-a1f7-94701c4a7a7c req-3e55a0cf-50e9-42da-af7a-157b48e9547a service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:48:49.993693 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ce01f8d2-170d-45b8-a1f7-94701c4a7a7c req-3e55a0cf-50e9-42da-af7a-157b48e9547a service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:48:49.994440 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ce01f8d2-170d-45b8-a1f7-94701c4a7a7c req-3e55a0cf-50e9-42da-af7a-157b48e9547a service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:48:50.005717 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-ce01f8d2-170d-45b8-a1f7-94701c4a7a7c req-3e55a0cf-50e9-42da-af7a-157b48e9547a service nova] Creating event network-vif-deleted:da354005-a94f-4126-a68e-4e0ce8177a9d for instance 6e313c6d-86a4-47e0-b461-71558843c130 on n-h1-master-1 Oct 30 02:48:50.010853 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-ce01f8d2-170d-45b8-a1f7-94701c4a7a7c req-3e55a0cf-50e9-42da-af7a-157b48e9547a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032565 Oct 30 02:48:50.011454 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4216/8092] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:48:50.527896 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bc2710e4-6d8c-48b5-84d0-669d1d487857 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:48:50.528521 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-bc2710e4-6d8c-48b5-84d0-669d1d487857 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:48:50.536302 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bc2710e4-6d8c-48b5-84d0-669d1d487857 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:48:50.536791 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bc2710e4-6d8c-48b5-84d0-669d1d487857 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:48:50.537236 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bc2710e4-6d8c-48b5-84d0-669d1d487857 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:48:50.537976 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bc2710e4-6d8c-48b5-84d0-669d1d487857 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:48:50.538418 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bc2710e4-6d8c-48b5-84d0-669d1d487857 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:48:50.538848 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bc2710e4-6d8c-48b5-84d0-669d1d487857 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:48:50.570749 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bc2710e4-6d8c-48b5-84d0-669d1d487857 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:48:50.571219 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bc2710e4-6d8c-48b5-84d0-669d1d487857 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:48:50.571661 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bc2710e4-6d8c-48b5-84d0-669d1d487857 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:48:50.572111 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-bc2710e4-6d8c-48b5-84d0-669d1d487857 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lazy-loading 'fault' on Instance uuid 6e313c6d-86a4-47e0-b461-71558843c130 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 02:48:50.617958 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-bc2710e4-6d8c-48b5-84d0-669d1d487857 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:48:50.625813 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bc2710e4-6d8c-48b5-84d0-669d1d487857 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130" status: 200 len: 1336 microversion: 2.1 time: 0.101797 Oct 30 02:48:50.626391 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3877/8093] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:48:50 2022] GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130 => generated 1336 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:48:51.650476 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-23185210-3355-4508-918a-328b834c501b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:48:51.651187 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-23185210-3355-4508-918a-328b834c501b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6e313c6d-86a4-47e0-b461-71558843c130] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:48:51.657373 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-23185210-3355-4508-918a-328b834c501b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:48:51.657880 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-23185210-3355-4508-918a-328b834c501b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:48:51.658332 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-23185210-3355-4508-918a-328b834c501b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:48:51.659286 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-23185210-3355-4508-918a-328b834c501b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:48:51.659752 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-23185210-3355-4508-918a-328b834c501b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:48:51.660191 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-23185210-3355-4508-918a-328b834c501b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:48:51.673356 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-23185210-3355-4508-918a-328b834c501b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] HTTP exception thrown: Instance 6e313c6d-86a4-47e0-b461-71558843c130 could not be found. Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-23185210-3355-4508-918a-328b834c501b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Request method failure captured: Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130 HTTP/1.1 Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: Accept: application/json Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: Accept-Encoding: identity Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: Connection: close Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: Content-Length: 0 Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: Content-Type: application/json Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: Host: 10.222.0.13 Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: Openstack-System-Scope: None Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjXeUPdBo5IBOL6hMNVaotx7rEiLvWLlpjTPYAuINGFChh-soSWDakJ_4SgU92eWZTVCp8Q97zTfb3IKrPNrvZdC9HJWtoWcVuSHkPhdXVI_dv9m38Ap38aFAdc6co5idqsPBDZx60yftsnaFdt-DC12fpgTeUSQk_zOYWXKTs86iIKbI Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Id: None Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: X-Domain-Name: None Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: X-Identity-Status: Confirmed Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: X-Is-Admin-Project: True Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Id: default Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: X-Project-Domain-Name: Default Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: X-Project-Id: d49c70393b0144a1a1e946fea78b47a9 Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: X-Project-Name: tempest-TestShelveInstance-453476353 Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: X-Role: member,reader Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: X-Roles: member,reader Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d49c70393b0144a1a1e946fea78b47a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d49c70393b0144a1a1e946fea78b47a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d49c70393b0144a1a1e946fea78b47a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d49c70393b0144a1a1e946fea78b47a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: X-Tenant: tempest-TestShelveInstance-453476353 Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Id: d49c70393b0144a1a1e946fea78b47a9 Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: X-Tenant-Name: tempest-TestShelveInstance-453476353 Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: X-User: tempest-TestShelveInstance-453476353-project Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Id: default Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: X-User-Domain-Name: Default Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: X-User-Id: 4deb849d2b814e648cd1d84a82d1783d Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: X-User-Name: tempest-TestShelveInstance-453476353-project Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: method: > Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: exception: Instance 6e313c6d-86a4-47e0-b461-71558843c130 could not be found. Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: action_args: {'id': '6e313c6d-86a4-47e0-b461-71558843c130'} Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e313c6d-86a4-47e0-b461-71558843c130 could not be found. Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e313c6d-86a4-47e0-b461-71558843c130 could not be found. Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:48:51.675016 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:48:51.681503 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:48:51.681503 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:48:51.681503 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:48:51.681503 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:48:51.681503 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:48:51.681503 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e313c6d-86a4-47e0-b461-71558843c130 could not be found. Oct 30 02:48:51.681503 n-d-master-1 devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Oct 30 02:48:51.681503 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-23185210-3355-4508-918a-328b834c501b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Returning 404 to user: Instance 6e313c6d-86a4-47e0-b461-71558843c130 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:48:51.681503 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-23185210-3355-4508-918a-328b834c501b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130" status: 404 len: 111 microversion: 2.1 time: 0.031152 Oct 30 02:48:51.681503 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4217/8094] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:48:51 2022] GET /compute/v2.1/servers/6e313c6d-86a4-47e0-b461-71558843c130 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 02:48:51.894665 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-292dcc1f-dc6b-4efb-9217-3e50b5675573 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '.version_select at 0x7f44d03a4a60>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:48:51.982287 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-292dcc1f-dc6b-4efb-9217-3e50b5675573 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-310702319" status: 202 len: 0 microversion: 2.1 time: 0.091784 Oct 30 02:48:51.982922 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3878/8095] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 30 02:48:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-310702319 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 02:48:52.007240 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-30d2991c-022b-456e-bdb9-a9bcd0a04b74 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Action: 'create', calling method: .version_select at 0x7f44c4476c10>, body: {"keypair": {"name": "tempest-TestShelveInstance-1687352678", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA1NNr/1PUrP3g1nayFWARJCYM4IpG+YcjMzuzL4bOLaC9gYFxyOjjYmi9Q6GEoMeWut0gYfRj6wIo4MHEsgSoWr23GjFf1CctAGvOMzmnTXAL+JN87wU7VrUgZXewnZ0w=="}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:48:52.022657 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-30d2991c-022b-456e-bdb9-a9bcd0a04b74 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Getting quotas for project d49c70393b0144a1a1e946fea78b47a9. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 02:48:52.027756 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-30d2991c-022b-456e-bdb9-a9bcd0a04b74 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Getting quotas for user 4deb849d2b814e648cd1d84a82d1783d and project d49c70393b0144a1a1e946fea78b47a9. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 02:48:52.107900 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-30d2991c-022b-456e-bdb9-a9bcd0a04b74 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.104525 Oct 30 02:48:52.108505 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4218/8096] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 30 02:48:52 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:49:15.054382 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:49:15.055164 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:49:15.059096 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cb7137a5-acab-4172-a99f-247664d73d87 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2134051201", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1687352678", "security_groups": [{"name": "tempest-secgroup-smoke-532763709"}], "networks": [{"uuid": "590c29ae-3cbb-4bd5-83a3-697c2ec0c271"}], "block_device_mapping_v2": [{"uuid": "2a87d7fd-fb87-48b4-9ccd-5db62351830a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:49:15.291447 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-cb7137a5-acab-4172-a99f-247664d73d87 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] validate_networks() for [('590c29ae-3cbb-4bd5-83a3-697c2ec0c271', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 02:49:15.702643 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-cb7137a5-acab-4172-a99f-247664d73d87 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 02:49:15.703084 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-cb7137a5-acab-4172-a99f-247664d73d87 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 02:49:15.703624 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-cb7137a5-acab-4172-a99f-247664d73d87 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 02:49:15.704034 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-cb7137a5-acab-4172-a99f-247664d73d87 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 02:49:15.704444 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-cb7137a5-acab-4172-a99f-247664d73d87 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 02:49:15.714033 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cb7137a5-acab-4172-a99f-247664d73d87 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:49:15.714441 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cb7137a5-acab-4172-a99f-247664d73d87 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:49:15.714877 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cb7137a5-acab-4172-a99f-247664d73d87 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:49:15.715601 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cb7137a5-acab-4172-a99f-247664d73d87 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:49:15.716056 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cb7137a5-acab-4172-a99f-247664d73d87 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:49:15.716478 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cb7137a5-acab-4172-a99f-247664d73d87 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:49:15.732861 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-cb7137a5-acab-4172-a99f-247664d73d87 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Getting quotas for project d49c70393b0144a1a1e946fea78b47a9. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 02:49:15.738210 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-cb7137a5-acab-4172-a99f-247664d73d87 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Getting quotas for user 4deb849d2b814e648cd1d84a82d1783d and project d49c70393b0144a1a1e946fea78b47a9. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 02:49:15.796287 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-cb7137a5-acab-4172-a99f-247664d73d87 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 02:49:15.798498 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-cb7137a5-acab-4172-a99f-247664d73d87 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2a87d7fd-fb87-48b4-9ccd-5db62351830a',volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 02:49:16.160553 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cb7137a5-acab-4172-a99f-247664d73d87 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.107920 Oct 30 02:49:16.161404 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3879/8097] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 02:49:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 1109 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 02:49:16.171115 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=12 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:49:16.175609 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=4 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:49:16.175609 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:49:16.177086 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a2333060-a9b3-4870-a7a2-aca16f0229ef tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:49:16.178043 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a2333060-a9b3-4870-a7a2-aca16f0229ef tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:49:16.287436 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a2333060-a9b3-4870-a7a2-aca16f0229ef tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:49:16.294550 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a2333060-a9b3-4870-a7a2-aca16f0229ef tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 200 len: 1089 microversion: 2.1 time: 0.125275 Oct 30 02:49:16.294993 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4219/8098] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:49:16 2022] GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 1089 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:49:17.318604 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-079a3780-8b0f-43f7-b247-28d48de7bf4e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:49:17.319224 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-079a3780-8b0f-43f7-b247-28d48de7bf4e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:49:17.325416 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-079a3780-8b0f-43f7-b247-28d48de7bf4e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:49:17.327773 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-079a3780-8b0f-43f7-b247-28d48de7bf4e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:49:17.328213 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-079a3780-8b0f-43f7-b247-28d48de7bf4e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:49:17.328917 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-079a3780-8b0f-43f7-b247-28d48de7bf4e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:49:17.329399 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-079a3780-8b0f-43f7-b247-28d48de7bf4e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:49:17.329831 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-079a3780-8b0f-43f7-b247-28d48de7bf4e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:49:17.392529 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-079a3780-8b0f-43f7-b247-28d48de7bf4e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:49:17.401411 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-079a3780-8b0f-43f7-b247-28d48de7bf4e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 200 len: 1131 microversion: 2.1 time: 0.087249 Oct 30 02:49:17.401696 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3880/8099] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:49:17 2022] GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 1131 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:49:18.424189 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7bdfa168-4ce4-4aca-bca5-490af0980028 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:49:18.424812 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7bdfa168-4ce4-4aca-bca5-490af0980028 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:49:18.432674 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7bdfa168-4ce4-4aca-bca5-490af0980028 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:49:18.433175 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7bdfa168-4ce4-4aca-bca5-490af0980028 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:49:18.433666 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7bdfa168-4ce4-4aca-bca5-490af0980028 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:49:18.434380 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7bdfa168-4ce4-4aca-bca5-490af0980028 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:49:18.434846 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7bdfa168-4ce4-4aca-bca5-490af0980028 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:49:18.435284 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7bdfa168-4ce4-4aca-bca5-490af0980028 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:49:18.505065 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7bdfa168-4ce4-4aca-bca5-490af0980028 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:49:18.514103 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7bdfa168-4ce4-4aca-bca5-490af0980028 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 200 len: 1205 microversion: 2.1 time: 0.093784 Oct 30 02:49:18.514798 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4220/8100] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:49:18 2022] GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 1205 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:49:19.538869 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-059e6ee4-2485-430d-9701-d7ea62240059 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:49:19.540944 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-059e6ee4-2485-430d-9701-d7ea62240059 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:49:19.547662 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-059e6ee4-2485-430d-9701-d7ea62240059 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:49:19.548411 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-059e6ee4-2485-430d-9701-d7ea62240059 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:49:19.549160 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-059e6ee4-2485-430d-9701-d7ea62240059 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:49:19.550075 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-059e6ee4-2485-430d-9701-d7ea62240059 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:49:19.550572 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-059e6ee4-2485-430d-9701-d7ea62240059 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:49:19.551028 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-059e6ee4-2485-430d-9701-d7ea62240059 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:49:19.719321 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-059e6ee4-2485-430d-9701-d7ea62240059 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:49:19.732311 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-059e6ee4-2485-430d-9701-d7ea62240059 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 200 len: 1272 microversion: 2.1 time: 0.193568 Oct 30 02:49:19.735212 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3881/8101] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:49:19 2022] GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 1272 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:49:19.949225 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-54598239-e41a-4b06-b48a-0a750821e938 req-c7f3e878-ecc0-45ee-86d3-9220aefea241 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a2ade30-3cf5-43af-8d19-b45cfa549702", "tag": "e88cc00f-15a6-4fd6-a8cc-99c7749bae74"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:49:19.964503 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-54598239-e41a-4b06-b48a-0a750821e938 req-c7f3e878-ecc0-45ee-86d3-9220aefea241 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:49:19.965501 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-54598239-e41a-4b06-b48a-0a750821e938 req-c7f3e878-ecc0-45ee-86d3-9220aefea241 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:49:19.966132 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-54598239-e41a-4b06-b48a-0a750821e938 req-c7f3e878-ecc0-45ee-86d3-9220aefea241 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:49:19.981999 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-54598239-e41a-4b06-b48a-0a750821e938 req-c7f3e878-ecc0-45ee-86d3-9220aefea241 service nova] Creating event network-changed:e88cc00f-15a6-4fd6-a8cc-99c7749bae74 for instance 6a2ade30-3cf5-43af-8d19-b45cfa549702 on n-h2-master-1 Oct 30 02:49:19.987434 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-54598239-e41a-4b06-b48a-0a750821e938 req-c7f3e878-ecc0-45ee-86d3-9220aefea241 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042705 Oct 30 02:49:19.990607 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4221/8102] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:49:20.750942 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-10d082f2-89d6-4a70-907f-8039f5221867 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:49:20.751711 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-10d082f2-89d6-4a70-907f-8039f5221867 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:49:20.759749 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-10d082f2-89d6-4a70-907f-8039f5221867 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:49:20.760243 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-10d082f2-89d6-4a70-907f-8039f5221867 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:49:20.760666 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-10d082f2-89d6-4a70-907f-8039f5221867 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:49:20.761388 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-10d082f2-89d6-4a70-907f-8039f5221867 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:49:20.761842 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-10d082f2-89d6-4a70-907f-8039f5221867 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:49:20.762266 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-10d082f2-89d6-4a70-907f-8039f5221867 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:49:20.912297 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-10d082f2-89d6-4a70-907f-8039f5221867 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:49:20.920209 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-10d082f2-89d6-4a70-907f-8039f5221867 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 200 len: 1272 microversion: 2.1 time: 0.173665 Oct 30 02:49:20.920729 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3882/8103] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:49:20 2022] GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 1272 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:49:21.944632 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cae2e80c-596d-402f-8390-339c4dde6c3b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:49:21.945396 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cae2e80c-596d-402f-8390-339c4dde6c3b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:49:21.951677 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cae2e80c-596d-402f-8390-339c4dde6c3b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:49:21.952168 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cae2e80c-596d-402f-8390-339c4dde6c3b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:49:21.952614 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cae2e80c-596d-402f-8390-339c4dde6c3b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:49:21.953311 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cae2e80c-596d-402f-8390-339c4dde6c3b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:49:21.953801 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cae2e80c-596d-402f-8390-339c4dde6c3b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:49:21.954239 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cae2e80c-596d-402f-8390-339c4dde6c3b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:49:22.092250 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-cae2e80c-596d-402f-8390-339c4dde6c3b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:49:22.100017 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cae2e80c-596d-402f-8390-339c4dde6c3b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 200 len: 1272 microversion: 2.1 time: 0.161120 Oct 30 02:49:22.100607 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4222/8104] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:49:21 2022] GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 1272 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:49:23.123707 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e84ddfe5-d77e-4ccb-adbd-3988230553cf tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:49:23.124432 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e84ddfe5-d77e-4ccb-adbd-3988230553cf tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:49:23.131178 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e84ddfe5-d77e-4ccb-adbd-3988230553cf tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:49:23.131708 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e84ddfe5-d77e-4ccb-adbd-3988230553cf tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:49:23.132144 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e84ddfe5-d77e-4ccb-adbd-3988230553cf tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:49:23.132862 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e84ddfe5-d77e-4ccb-adbd-3988230553cf tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:49:23.133835 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e84ddfe5-d77e-4ccb-adbd-3988230553cf tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:49:23.134260 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e84ddfe5-d77e-4ccb-adbd-3988230553cf tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:49:23.268628 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e84ddfe5-d77e-4ccb-adbd-3988230553cf tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:49:23.277154 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e84ddfe5-d77e-4ccb-adbd-3988230553cf tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 200 len: 1272 microversion: 2.1 time: 0.157432 Oct 30 02:49:23.277786 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3883/8105] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:49:23 2022] GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 1272 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:49:24.300666 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-229319c4-e291-4c50-bb5f-a97b7133f75b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:49:24.301290 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-229319c4-e291-4c50-bb5f-a97b7133f75b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:49:24.307624 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-229319c4-e291-4c50-bb5f-a97b7133f75b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:49:24.308114 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-229319c4-e291-4c50-bb5f-a97b7133f75b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:49:24.308559 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-229319c4-e291-4c50-bb5f-a97b7133f75b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:49:24.309255 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-229319c4-e291-4c50-bb5f-a97b7133f75b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:49:24.309747 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-229319c4-e291-4c50-bb5f-a97b7133f75b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:49:24.310179 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-229319c4-e291-4c50-bb5f-a97b7133f75b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:49:24.438230 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-229319c4-e291-4c50-bb5f-a97b7133f75b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:49:24.446264 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-229319c4-e291-4c50-bb5f-a97b7133f75b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 200 len: 1260 microversion: 2.1 time: 0.149650 Oct 30 02:49:24.446860 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4223/8106] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:49:24 2022] GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:49:25.469696 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6a2f9dc5-491f-4fac-b929-6cd348b73df3 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:49:25.470319 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6a2f9dc5-491f-4fac-b929-6cd348b73df3 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:49:25.477190 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a2f9dc5-491f-4fac-b929-6cd348b73df3 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:49:25.477702 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a2f9dc5-491f-4fac-b929-6cd348b73df3 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:49:25.478136 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a2f9dc5-491f-4fac-b929-6cd348b73df3 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:49:25.478824 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a2f9dc5-491f-4fac-b929-6cd348b73df3 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:49:25.479271 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a2f9dc5-491f-4fac-b929-6cd348b73df3 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:49:25.479693 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6a2f9dc5-491f-4fac-b929-6cd348b73df3 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:49:25.611237 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6a2f9dc5-491f-4fac-b929-6cd348b73df3 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:49:25.618981 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6a2f9dc5-491f-4fac-b929-6cd348b73df3 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 200 len: 1260 microversion: 2.1 time: 0.153322 Oct 30 02:49:25.619560 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3884/8107] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:49:25 2022] GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:49:26.641993 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1e2eda6f-5fa4-4fff-9a49-65a73958aff9 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:49:26.642660 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1e2eda6f-5fa4-4fff-9a49-65a73958aff9 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:49:26.645780 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:49:26.651055 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1e2eda6f-5fa4-4fff-9a49-65a73958aff9 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:49:26.651544 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1e2eda6f-5fa4-4fff-9a49-65a73958aff9 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:49:26.651989 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1e2eda6f-5fa4-4fff-9a49-65a73958aff9 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:49:26.652690 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1e2eda6f-5fa4-4fff-9a49-65a73958aff9 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:49:26.653151 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1e2eda6f-5fa4-4fff-9a49-65a73958aff9 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:49:26.653606 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1e2eda6f-5fa4-4fff-9a49-65a73958aff9 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:49:27.086486 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1e2eda6f-5fa4-4fff-9a49-65a73958aff9 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:49:27.094178 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1e2eda6f-5fa4-4fff-9a49-65a73958aff9 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 200 len: 1260 microversion: 2.1 time: 0.456126 Oct 30 02:49:27.094747 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4224/8108] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:49:26 2022] GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 1260 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:49:28.117053 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e21fee3c-64eb-405f-9df4-348001f6f593 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:49:28.117715 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e21fee3c-64eb-405f-9df4-348001f6f593 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:49:28.119949 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:49:28.120628 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=6 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:49:28.126375 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e21fee3c-64eb-405f-9df4-348001f6f593 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:49:28.126887 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e21fee3c-64eb-405f-9df4-348001f6f593 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:49:28.127355 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e21fee3c-64eb-405f-9df4-348001f6f593 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:49:28.128059 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e21fee3c-64eb-405f-9df4-348001f6f593 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:49:28.128514 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e21fee3c-64eb-405f-9df4-348001f6f593 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:49:28.128942 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e21fee3c-64eb-405f-9df4-348001f6f593 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:49:28.259256 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-e21fee3c-64eb-405f-9df4-348001f6f593 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:49:28.266922 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e21fee3c-64eb-405f-9df4-348001f6f593 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 200 len: 1260 microversion: 2.1 time: 0.153897 Oct 30 02:49:28.267495 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3885/8109] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:49:28 2022] GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:49:29.290721 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ce484c0e-1bc9-4fa1-95b1-98ea9a73ef77 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:49:29.291348 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ce484c0e-1bc9-4fa1-95b1-98ea9a73ef77 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:49:29.298192 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce484c0e-1bc9-4fa1-95b1-98ea9a73ef77 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:49:29.298684 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce484c0e-1bc9-4fa1-95b1-98ea9a73ef77 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:49:29.299126 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce484c0e-1bc9-4fa1-95b1-98ea9a73ef77 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:49:29.299822 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce484c0e-1bc9-4fa1-95b1-98ea9a73ef77 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:49:29.300291 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce484c0e-1bc9-4fa1-95b1-98ea9a73ef77 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:49:29.300723 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce484c0e-1bc9-4fa1-95b1-98ea9a73ef77 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:49:29.431064 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ce484c0e-1bc9-4fa1-95b1-98ea9a73ef77 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:49:29.438789 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ce484c0e-1bc9-4fa1-95b1-98ea9a73ef77 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 200 len: 1260 microversion: 2.1 time: 0.152515 Oct 30 02:49:29.439534 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4225/8110] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:49:29 2022] GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:49:30.461796 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2aae3ebe-f939-4f73-8312-e906a1f826e8 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:49:30.462451 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2aae3ebe-f939-4f73-8312-e906a1f826e8 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:49:30.469351 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2aae3ebe-f939-4f73-8312-e906a1f826e8 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:49:30.469857 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2aae3ebe-f939-4f73-8312-e906a1f826e8 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:49:30.470300 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2aae3ebe-f939-4f73-8312-e906a1f826e8 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:49:30.471025 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2aae3ebe-f939-4f73-8312-e906a1f826e8 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:49:30.471480 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2aae3ebe-f939-4f73-8312-e906a1f826e8 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:49:30.471910 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2aae3ebe-f939-4f73-8312-e906a1f826e8 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:49:30.600006 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2aae3ebe-f939-4f73-8312-e906a1f826e8 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:49:30.608926 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2aae3ebe-f939-4f73-8312-e906a1f826e8 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 200 len: 1260 microversion: 2.1 time: 0.151185 Oct 30 02:49:30.609888 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3886/8111] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:49:30 2022] GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:49:31.632135 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e2943b2b-ca6f-4507-9a03-8886876b27ad tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:49:31.633269 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e2943b2b-ca6f-4507-9a03-8886876b27ad tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:49:31.640172 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e2943b2b-ca6f-4507-9a03-8886876b27ad tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:49:31.640672 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e2943b2b-ca6f-4507-9a03-8886876b27ad tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:49:31.641123 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e2943b2b-ca6f-4507-9a03-8886876b27ad tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:49:31.641864 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e2943b2b-ca6f-4507-9a03-8886876b27ad tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:49:31.642331 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e2943b2b-ca6f-4507-9a03-8886876b27ad tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:49:31.642771 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e2943b2b-ca6f-4507-9a03-8886876b27ad tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:49:31.770539 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e2943b2b-ca6f-4507-9a03-8886876b27ad tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:49:31.778410 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e2943b2b-ca6f-4507-9a03-8886876b27ad tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 200 len: 1260 microversion: 2.1 time: 0.150237 Oct 30 02:49:31.778982 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4226/8112] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:49:31 2022] GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:49:32.801561 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-25fa1b22-6d37-4f20-aabc-7ec5975567ec tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:49:32.802166 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-25fa1b22-6d37-4f20-aabc-7ec5975567ec tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:49:32.809605 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-25fa1b22-6d37-4f20-aabc-7ec5975567ec tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:49:32.810094 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-25fa1b22-6d37-4f20-aabc-7ec5975567ec tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:49:32.810529 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-25fa1b22-6d37-4f20-aabc-7ec5975567ec tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:49:32.811223 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-25fa1b22-6d37-4f20-aabc-7ec5975567ec tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:49:32.811674 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-25fa1b22-6d37-4f20-aabc-7ec5975567ec tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:49:32.812097 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-25fa1b22-6d37-4f20-aabc-7ec5975567ec tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:49:32.946747 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-25fa1b22-6d37-4f20-aabc-7ec5975567ec tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:49:32.954480 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-25fa1b22-6d37-4f20-aabc-7ec5975567ec tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 200 len: 1260 microversion: 2.1 time: 0.156939 Oct 30 02:49:32.955058 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3887/8113] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:49:32 2022] GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:49:33.977302 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-434a6726-fe6a-402e-8834-0084244945b7 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:49:33.977962 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-434a6726-fe6a-402e-8834-0084244945b7 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:49:33.984890 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-434a6726-fe6a-402e-8834-0084244945b7 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:49:33.985419 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-434a6726-fe6a-402e-8834-0084244945b7 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:49:33.985880 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-434a6726-fe6a-402e-8834-0084244945b7 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:49:33.986613 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-434a6726-fe6a-402e-8834-0084244945b7 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:49:33.987068 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-434a6726-fe6a-402e-8834-0084244945b7 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:49:33.987540 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-434a6726-fe6a-402e-8834-0084244945b7 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:49:34.119844 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-434a6726-fe6a-402e-8834-0084244945b7 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:49:34.127675 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-434a6726-fe6a-402e-8834-0084244945b7 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 200 len: 1260 microversion: 2.1 time: 0.154493 Oct 30 02:49:34.128257 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4227/8114] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:49:33 2022] GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:49:35.151491 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4fa95622-12eb-482f-873a-4515c9bea579 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:49:35.152106 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4fa95622-12eb-482f-873a-4515c9bea579 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:49:35.159190 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4fa95622-12eb-482f-873a-4515c9bea579 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:49:35.159677 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4fa95622-12eb-482f-873a-4515c9bea579 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:49:35.160109 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4fa95622-12eb-482f-873a-4515c9bea579 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:49:35.160805 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4fa95622-12eb-482f-873a-4515c9bea579 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:49:35.161256 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4fa95622-12eb-482f-873a-4515c9bea579 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:49:35.161706 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4fa95622-12eb-482f-873a-4515c9bea579 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:49:35.292684 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4fa95622-12eb-482f-873a-4515c9bea579 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:49:35.300568 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4fa95622-12eb-482f-873a-4515c9bea579 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 200 len: 1260 microversion: 2.1 time: 0.153593 Oct 30 02:49:35.301149 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3888/8115] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:49:35 2022] GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:49:35.375702 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-cdb87864-5afb-4c11-9f51-f76de07e1e81 req-b35d8014-7df1-4eb7-96e2-9f6e9356ff8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a2ade30-3cf5-43af-8d19-b45cfa549702", "name": "network-vif-plugged", "status": "completed", "tag": "e88cc00f-15a6-4fd6-a8cc-99c7749bae74"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:49:35.386505 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-cdb87864-5afb-4c11-9f51-f76de07e1e81 req-b35d8014-7df1-4eb7-96e2-9f6e9356ff8b service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:49:35.387000 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-cdb87864-5afb-4c11-9f51-f76de07e1e81 req-b35d8014-7df1-4eb7-96e2-9f6e9356ff8b service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:49:35.387438 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-cdb87864-5afb-4c11-9f51-f76de07e1e81 req-b35d8014-7df1-4eb7-96e2-9f6e9356ff8b service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:49:35.398800 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-cdb87864-5afb-4c11-9f51-f76de07e1e81 req-b35d8014-7df1-4eb7-96e2-9f6e9356ff8b service nova] Creating event network-vif-plugged:e88cc00f-15a6-4fd6-a8cc-99c7749bae74 for instance 6a2ade30-3cf5-43af-8d19-b45cfa549702 on n-h2-master-1 Oct 30 02:49:35.403931 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-cdb87864-5afb-4c11-9f51-f76de07e1e81 req-b35d8014-7df1-4eb7-96e2-9f6e9356ff8b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032107 Oct 30 02:49:35.404611 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4228/8116] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:49:36.324099 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ae0f1175-8799-423c-a472-097122aa6a35 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:49:36.324749 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ae0f1175-8799-423c-a472-097122aa6a35 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:49:36.331729 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ae0f1175-8799-423c-a472-097122aa6a35 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:49:36.332206 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ae0f1175-8799-423c-a472-097122aa6a35 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:49:36.332648 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ae0f1175-8799-423c-a472-097122aa6a35 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:49:36.333417 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ae0f1175-8799-423c-a472-097122aa6a35 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:49:36.333824 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ae0f1175-8799-423c-a472-097122aa6a35 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:49:36.334254 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ae0f1175-8799-423c-a472-097122aa6a35 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:49:36.466903 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ae0f1175-8799-423c-a472-097122aa6a35 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:49:36.474753 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ae0f1175-8799-423c-a472-097122aa6a35 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 200 len: 1260 microversion: 2.1 time: 0.154574 Oct 30 02:49:36.475330 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3889/8117] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:49:36 2022] GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:49:37.499157 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a7723387-5db2-4003-86a3-be200df59e69 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:49:37.499872 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a7723387-5db2-4003-86a3-be200df59e69 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:49:37.506931 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7723387-5db2-4003-86a3-be200df59e69 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:49:37.507450 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7723387-5db2-4003-86a3-be200df59e69 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:49:37.507898 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7723387-5db2-4003-86a3-be200df59e69 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:49:37.508591 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7723387-5db2-4003-86a3-be200df59e69 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:49:37.509052 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7723387-5db2-4003-86a3-be200df59e69 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:49:37.509514 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7723387-5db2-4003-86a3-be200df59e69 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:49:37.640682 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a7723387-5db2-4003-86a3-be200df59e69 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:49:37.648949 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a7723387-5db2-4003-86a3-be200df59e69 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 200 len: 1444 microversion: 2.1 time: 0.154050 Oct 30 02:49:37.649542 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4229/8118] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:49:37 2022] GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 1444 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:49:37.717983 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c0ba691c-bc99-4e0e-acd4-a38d5fc2af09 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:49:37.718604 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c0ba691c-bc99-4e0e-acd4-a38d5fc2af09 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:49:37.724495 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0ba691c-bc99-4e0e-acd4-a38d5fc2af09 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:49:37.728573 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0ba691c-bc99-4e0e-acd4-a38d5fc2af09 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:49:37.728573 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0ba691c-bc99-4e0e-acd4-a38d5fc2af09 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:49:37.728573 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0ba691c-bc99-4e0e-acd4-a38d5fc2af09 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:49:37.728573 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0ba691c-bc99-4e0e-acd4-a38d5fc2af09 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:49:37.728573 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0ba691c-bc99-4e0e-acd4-a38d5fc2af09 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:49:37.858268 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c0ba691c-bc99-4e0e-acd4-a38d5fc2af09 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:49:37.866367 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c0ba691c-bc99-4e0e-acd4-a38d5fc2af09 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 200 len: 1444 microversion: 2.1 time: 0.198815 Oct 30 02:49:37.866946 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3890/8119] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:49:37 2022] GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 1444 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:49:40.031446 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-f92035b5-2070-4fda-8765-e2cd77ceb3e7 req-49674038-8260-4e22-bd18-c42eea48a389 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a2ade30-3cf5-43af-8d19-b45cfa549702", "tag": "e88cc00f-15a6-4fd6-a8cc-99c7749bae74"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:49:40.041547 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-f92035b5-2070-4fda-8765-e2cd77ceb3e7 req-49674038-8260-4e22-bd18-c42eea48a389 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:49:40.042165 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-f92035b5-2070-4fda-8765-e2cd77ceb3e7 req-49674038-8260-4e22-bd18-c42eea48a389 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:49:40.042608 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-f92035b5-2070-4fda-8765-e2cd77ceb3e7 req-49674038-8260-4e22-bd18-c42eea48a389 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:49:40.053668 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-f92035b5-2070-4fda-8765-e2cd77ceb3e7 req-49674038-8260-4e22-bd18-c42eea48a389 service nova] Creating event network-changed:e88cc00f-15a6-4fd6-a8cc-99c7749bae74 for instance 6a2ade30-3cf5-43af-8d19-b45cfa549702 on n-h2-master-1 Oct 30 02:49:40.059138 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-f92035b5-2070-4fda-8765-e2cd77ceb3e7 req-49674038-8260-4e22-bd18-c42eea48a389 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087076 Oct 30 02:49:40.059907 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4230/8120] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:49:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:52:06.458161 n-d-master-1 devstack@n-api.service[121103]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b7c2a62f-729f-40a5-8849-28eec979ab4a] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 30 02:52:06.459046 n-d-master-1 devstack@n-api.service[121103]: ERROR oslo.messaging._drivers.impl_rabbit [-] [975c5eab-3cac-4f3e-8d59-9cc73a7448cc] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 30 02:52:06.459625 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:52:06.460402 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=68 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:52:06.461718 n-d-master-1 devstack@n-api.service[121103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 30 02:52:06.461864 n-d-master-1 devstack@n-api.service[121103]: Sun Oct 30 02:52:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702/action (ip 10.222.0.13) !!! Oct 30 02:52:06.462981 n-d-master-1 devstack@n-api.service[121103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 30 02:52:06.463143 n-d-master-1 devstack@n-api.service[121103]: Sun Oct 30 02:52:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702/action (ip 10.222.0.13) !!! Oct 30 02:52:06.464136 n-d-master-1 devstack@n-api.service[121103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 30 02:52:06.464258 n-d-master-1 devstack@n-api.service[121103]: Sun Oct 30 02:52:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702/action (ip 10.222.0.13) !!! Oct 30 02:52:06.468374 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b4448098-1078-461c-82dc-e89876f5334f tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:52:06.472817 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b4448098-1078-461c-82dc-e89876f5334f tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:52:06.479545 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4448098-1078-461c-82dc-e89876f5334f tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:06.480035 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4448098-1078-461c-82dc-e89876f5334f tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:06.480473 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4448098-1078-461c-82dc-e89876f5334f tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:06.481171 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4448098-1078-461c-82dc-e89876f5334f tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:06.481656 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4448098-1078-461c-82dc-e89876f5334f tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:06.482088 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4448098-1078-461c-82dc-e89876f5334f tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:06.507696 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-b4448098-1078-461c-82dc-e89876f5334f tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lazy-loading 'flavor' on Instance uuid 6a2ade30-3cf5-43af-8d19-b45cfa549702 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 02:52:06.828188 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b4448098-1078-461c-82dc-e89876f5334f tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "POST /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702/action" status: 202 len: 0 microversion: 2.1 time: 0.371820 Oct 30 02:52:06.828696 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3891/8121] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 02:52:06 2022] POST /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702/action => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 02:52:06.835179 n-d-master-1 devstack@n-api.service[121102]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ea6ec045-ee0c-4212-8fa5-a40465026485] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 30 02:52:06.836081 n-d-master-1 devstack@n-api.service[121102]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8caffca0-53fa-4143-8e03-000c8bb53286] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 30 02:52:06.837225 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=26 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:52:06.838025 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=54 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:52:06.840352 n-d-master-1 devstack@n-api.service[121102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 30 02:52:06.840352 n-d-master-1 devstack@n-api.service[121102]: Sun Oct 30 02:52:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 (ip 10.222.0.13) !!! Oct 30 02:52:06.841040 n-d-master-1 devstack@n-api.service[121102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 30 02:52:06.841040 n-d-master-1 devstack@n-api.service[121102]: Sun Oct 30 02:52:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 (ip 10.222.0.13) !!! Oct 30 02:52:06.846409 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-99e9a2f9-cd36-478c-b955-32409cb0370b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:52:06.847128 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-99e9a2f9-cd36-478c-b955-32409cb0370b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:52:06.856393 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-99e9a2f9-cd36-478c-b955-32409cb0370b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:06.856887 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-99e9a2f9-cd36-478c-b955-32409cb0370b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:06.857361 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-99e9a2f9-cd36-478c-b955-32409cb0370b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:06.858067 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-99e9a2f9-cd36-478c-b955-32409cb0370b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:06.858538 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-99e9a2f9-cd36-478c-b955-32409cb0370b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:06.859029 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-99e9a2f9-cd36-478c-b955-32409cb0370b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:06.993037 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-99e9a2f9-cd36-478c-b955-32409cb0370b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:52:07.000898 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-99e9a2f9-cd36-478c-b955-32409cb0370b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 200 len: 1569 microversion: 2.1 time: 0.167635 Oct 30 02:52:07.001483 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4231/8122] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:52:06 2022] GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:52:08.026749 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cd2a0d12-e8b4-43a2-93d6-c7e6ede09122 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:52:08.027455 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-cd2a0d12-e8b4-43a2-93d6-c7e6ede09122 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:52:08.036500 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd2a0d12-e8b4-43a2-93d6-c7e6ede09122 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:08.036991 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd2a0d12-e8b4-43a2-93d6-c7e6ede09122 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:08.037467 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd2a0d12-e8b4-43a2-93d6-c7e6ede09122 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:08.038166 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd2a0d12-e8b4-43a2-93d6-c7e6ede09122 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:08.038620 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd2a0d12-e8b4-43a2-93d6-c7e6ede09122 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:08.039047 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd2a0d12-e8b4-43a2-93d6-c7e6ede09122 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:08.044164 n-d-master-1 devstack@n-api.service[121103]: INFO oslo.messaging._drivers.impl_rabbit [-] [b7c2a62f-729f-40a5-8849-28eec979ab4a] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 33450. Oct 30 02:52:08.046896 n-d-master-1 devstack@n-api.service[121103]: INFO oslo.messaging._drivers.impl_rabbit [-] [975c5eab-3cac-4f3e-8d59-9cc73a7448cc] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 33452. Oct 30 02:52:08.172999 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-cd2a0d12-e8b4-43a2-93d6-c7e6ede09122 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:52:08.181498 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cd2a0d12-e8b4-43a2-93d6-c7e6ede09122 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 200 len: 1569 microversion: 2.1 time: 0.160407 Oct 30 02:52:08.182068 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3892/8123] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:52:08 2022] GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:52:09.204769 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4d8fe4ae-d35d-4d41-8a13-70626da13e8c tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:52:09.205414 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4d8fe4ae-d35d-4d41-8a13-70626da13e8c tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:52:09.220133 n-d-master-1 devstack@n-api.service[121102]: INFO oslo.messaging._drivers.impl_rabbit [-] [ea6ec045-ee0c-4212-8fa5-a40465026485] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 33458. Oct 30 02:52:09.222720 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d8fe4ae-d35d-4d41-8a13-70626da13e8c tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:09.223226 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d8fe4ae-d35d-4d41-8a13-70626da13e8c tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:09.223683 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d8fe4ae-d35d-4d41-8a13-70626da13e8c tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:09.224402 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d8fe4ae-d35d-4d41-8a13-70626da13e8c tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:09.224873 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d8fe4ae-d35d-4d41-8a13-70626da13e8c tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:09.225408 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d8fe4ae-d35d-4d41-8a13-70626da13e8c tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:09.229394 n-d-master-1 devstack@n-api.service[121102]: INFO oslo.messaging._drivers.impl_rabbit [-] [8caffca0-53fa-4143-8e03-000c8bb53286] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 33460. Oct 30 02:52:09.364408 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4d8fe4ae-d35d-4d41-8a13-70626da13e8c tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:52:09.372968 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4d8fe4ae-d35d-4d41-8a13-70626da13e8c tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 200 len: 1569 microversion: 2.1 time: 0.172200 Oct 30 02:52:09.373589 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4232/8124] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:52:09 2022] GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:52:10.396740 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b3f2f6c6-1fe2-4a55-a0ff-62481ed43a0a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:52:10.397406 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b3f2f6c6-1fe2-4a55-a0ff-62481ed43a0a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:52:10.405226 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3f2f6c6-1fe2-4a55-a0ff-62481ed43a0a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:10.405745 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3f2f6c6-1fe2-4a55-a0ff-62481ed43a0a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:10.406186 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3f2f6c6-1fe2-4a55-a0ff-62481ed43a0a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:10.406885 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3f2f6c6-1fe2-4a55-a0ff-62481ed43a0a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:10.407343 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3f2f6c6-1fe2-4a55-a0ff-62481ed43a0a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:10.407772 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3f2f6c6-1fe2-4a55-a0ff-62481ed43a0a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:10.542311 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b3f2f6c6-1fe2-4a55-a0ff-62481ed43a0a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:52:10.550161 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b3f2f6c6-1fe2-4a55-a0ff-62481ed43a0a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 200 len: 1569 microversion: 2.1 time: 0.157354 Oct 30 02:52:10.550733 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3893/8125] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:52:10 2022] GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:52:11.574630 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-73bda137-e3f3-47da-bfe6-ff92680cba35 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:52:11.575256 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-73bda137-e3f3-47da-bfe6-ff92680cba35 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:52:11.582209 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-73bda137-e3f3-47da-bfe6-ff92680cba35 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:11.582700 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-73bda137-e3f3-47da-bfe6-ff92680cba35 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:11.583145 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-73bda137-e3f3-47da-bfe6-ff92680cba35 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:11.583840 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-73bda137-e3f3-47da-bfe6-ff92680cba35 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:11.584300 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-73bda137-e3f3-47da-bfe6-ff92680cba35 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:11.584732 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-73bda137-e3f3-47da-bfe6-ff92680cba35 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:11.714846 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-73bda137-e3f3-47da-bfe6-ff92680cba35 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:52:11.722821 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-73bda137-e3f3-47da-bfe6-ff92680cba35 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 200 len: 1569 microversion: 2.1 time: 0.152722 Oct 30 02:52:11.725625 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4233/8126] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:52:11 2022] GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:52:12.748358 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0fa01012-dac3-4df2-997a-d7ca7203479e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:52:12.748982 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0fa01012-dac3-4df2-997a-d7ca7203479e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:52:12.755884 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0fa01012-dac3-4df2-997a-d7ca7203479e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:12.756372 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0fa01012-dac3-4df2-997a-d7ca7203479e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:12.756814 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0fa01012-dac3-4df2-997a-d7ca7203479e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:12.757538 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0fa01012-dac3-4df2-997a-d7ca7203479e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:12.758029 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0fa01012-dac3-4df2-997a-d7ca7203479e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:12.758981 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0fa01012-dac3-4df2-997a-d7ca7203479e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:12.889716 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-0fa01012-dac3-4df2-997a-d7ca7203479e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:52:12.898510 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0fa01012-dac3-4df2-997a-d7ca7203479e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 200 len: 1569 microversion: 2.1 time: 0.154216 Oct 30 02:52:12.899154 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3894/8127] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:52:12 2022] GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:52:13.922008 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7f820302-8615-4a99-be04-f2aca34e418c tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:52:13.922639 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7f820302-8615-4a99-be04-f2aca34e418c tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:52:13.929558 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7f820302-8615-4a99-be04-f2aca34e418c tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:13.930058 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7f820302-8615-4a99-be04-f2aca34e418c tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:13.930516 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7f820302-8615-4a99-be04-f2aca34e418c tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:13.931223 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7f820302-8615-4a99-be04-f2aca34e418c tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:13.931692 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7f820302-8615-4a99-be04-f2aca34e418c tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:13.932134 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7f820302-8615-4a99-be04-f2aca34e418c tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:14.065004 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7f820302-8615-4a99-be04-f2aca34e418c tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:52:14.073377 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7f820302-8615-4a99-be04-f2aca34e418c tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 200 len: 1569 microversion: 2.1 time: 0.155286 Oct 30 02:52:14.073939 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4234/8128] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:52:13 2022] GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:52:15.096063 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-79a35e75-6960-46b2-9abf-0d47727fe8f6 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:52:15.096677 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-79a35e75-6960-46b2-9abf-0d47727fe8f6 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:52:15.104166 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-79a35e75-6960-46b2-9abf-0d47727fe8f6 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:15.104648 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-79a35e75-6960-46b2-9abf-0d47727fe8f6 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:15.105086 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-79a35e75-6960-46b2-9abf-0d47727fe8f6 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:15.105804 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-79a35e75-6960-46b2-9abf-0d47727fe8f6 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:15.106257 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-79a35e75-6960-46b2-9abf-0d47727fe8f6 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:15.106685 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-79a35e75-6960-46b2-9abf-0d47727fe8f6 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:15.239147 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-79a35e75-6960-46b2-9abf-0d47727fe8f6 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:52:15.247215 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-79a35e75-6960-46b2-9abf-0d47727fe8f6 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 200 len: 1569 microversion: 2.1 time: 0.155029 Oct 30 02:52:15.247876 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3895/8129] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:52:15 2022] GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:52:16.270993 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ba4a04a6-4b14-4db2-8327-6a2107597693 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:52:16.271620 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ba4a04a6-4b14-4db2-8327-6a2107597693 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:52:16.278421 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ba4a04a6-4b14-4db2-8327-6a2107597693 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:16.278916 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ba4a04a6-4b14-4db2-8327-6a2107597693 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:16.279613 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ba4a04a6-4b14-4db2-8327-6a2107597693 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:16.280312 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ba4a04a6-4b14-4db2-8327-6a2107597693 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:16.280774 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ba4a04a6-4b14-4db2-8327-6a2107597693 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:16.281208 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ba4a04a6-4b14-4db2-8327-6a2107597693 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:16.409148 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ba4a04a6-4b14-4db2-8327-6a2107597693 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:52:16.417516 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ba4a04a6-4b14-4db2-8327-6a2107597693 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 200 len: 1569 microversion: 2.1 time: 0.150447 Oct 30 02:52:16.418090 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4235/8130] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:52:16 2022] GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:52:17.440467 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-90c7d3c5-035f-4ebe-bc61-a1c402d92cc0 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:52:17.441092 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-90c7d3c5-035f-4ebe-bc61-a1c402d92cc0 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:52:17.448575 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-90c7d3c5-035f-4ebe-bc61-a1c402d92cc0 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:17.449064 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-90c7d3c5-035f-4ebe-bc61-a1c402d92cc0 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:17.449533 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-90c7d3c5-035f-4ebe-bc61-a1c402d92cc0 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:17.450236 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-90c7d3c5-035f-4ebe-bc61-a1c402d92cc0 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:17.450696 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-90c7d3c5-035f-4ebe-bc61-a1c402d92cc0 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:17.451123 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-90c7d3c5-035f-4ebe-bc61-a1c402d92cc0 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:17.584724 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-90c7d3c5-035f-4ebe-bc61-a1c402d92cc0 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:52:17.593299 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-90c7d3c5-035f-4ebe-bc61-a1c402d92cc0 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 200 len: 1569 microversion: 2.1 time: 0.156758 Oct 30 02:52:17.593912 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3896/8131] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:52:17 2022] GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:52:18.616775 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c4039c1b-3be9-42e7-9276-cb3116e6a441 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:52:18.617417 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c4039c1b-3be9-42e7-9276-cb3116e6a441 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:52:18.624847 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4039c1b-3be9-42e7-9276-cb3116e6a441 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:18.625355 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4039c1b-3be9-42e7-9276-cb3116e6a441 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:18.625808 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4039c1b-3be9-42e7-9276-cb3116e6a441 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:18.626502 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4039c1b-3be9-42e7-9276-cb3116e6a441 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:18.626964 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4039c1b-3be9-42e7-9276-cb3116e6a441 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:18.627397 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4039c1b-3be9-42e7-9276-cb3116e6a441 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:18.756018 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c4039c1b-3be9-42e7-9276-cb3116e6a441 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:52:18.764316 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c4039c1b-3be9-42e7-9276-cb3116e6a441 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 200 len: 1569 microversion: 2.1 time: 0.151540 Oct 30 02:52:18.764888 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4236/8132] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:52:18 2022] GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:52:19.788845 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-abd3c6aa-aefb-4d82-99bd-969b785d6ad2 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:52:19.790281 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-abd3c6aa-aefb-4d82-99bd-969b785d6ad2 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:52:19.797573 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-abd3c6aa-aefb-4d82-99bd-969b785d6ad2 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:19.798066 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-abd3c6aa-aefb-4d82-99bd-969b785d6ad2 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:19.798504 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-abd3c6aa-aefb-4d82-99bd-969b785d6ad2 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:19.799209 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-abd3c6aa-aefb-4d82-99bd-969b785d6ad2 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:19.799696 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-abd3c6aa-aefb-4d82-99bd-969b785d6ad2 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:19.800139 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-abd3c6aa-aefb-4d82-99bd-969b785d6ad2 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:19.948343 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-abd3c6aa-aefb-4d82-99bd-969b785d6ad2 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:52:19.956587 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-abd3c6aa-aefb-4d82-99bd-969b785d6ad2 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 200 len: 1569 microversion: 2.1 time: 0.171790 Oct 30 02:52:19.957284 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3897/8133] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:52:19 2022] GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:52:20.980484 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-588c68d0-263c-43ba-bb30-8001b337a1ae tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:52:20.981102 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-588c68d0-263c-43ba-bb30-8001b337a1ae tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:52:20.988018 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-588c68d0-263c-43ba-bb30-8001b337a1ae tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:20.988513 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-588c68d0-263c-43ba-bb30-8001b337a1ae tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:20.988957 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-588c68d0-263c-43ba-bb30-8001b337a1ae tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:20.989689 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-588c68d0-263c-43ba-bb30-8001b337a1ae tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:20.990223 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-588c68d0-263c-43ba-bb30-8001b337a1ae tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:20.990660 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-588c68d0-263c-43ba-bb30-8001b337a1ae tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:21.135051 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-588c68d0-263c-43ba-bb30-8001b337a1ae tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:52:21.141442 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-588c68d0-263c-43ba-bb30-8001b337a1ae tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 200 len: 1569 microversion: 2.1 time: 0.165256 Oct 30 02:52:21.142013 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4237/8134] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:52:20 2022] GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:52:22.045555 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-f4316077-f04e-43b0-8800-81f47b460849 req-57f4f1b4-20fa-4357-898b-7d8ed1a78c44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a2ade30-3cf5-43af-8d19-b45cfa549702", "name": "network-vif-unplugged", "status": "completed", "tag": "e88cc00f-15a6-4fd6-a8cc-99c7749bae74"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:52:22.055027 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-f4316077-f04e-43b0-8800-81f47b460849 req-57f4f1b4-20fa-4357-898b-7d8ed1a78c44 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:22.055517 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-f4316077-f04e-43b0-8800-81f47b460849 req-57f4f1b4-20fa-4357-898b-7d8ed1a78c44 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:22.055950 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-f4316077-f04e-43b0-8800-81f47b460849 req-57f4f1b4-20fa-4357-898b-7d8ed1a78c44 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:22.067087 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-f4316077-f04e-43b0-8800-81f47b460849 req-57f4f1b4-20fa-4357-898b-7d8ed1a78c44 service nova] Creating event network-vif-unplugged:e88cc00f-15a6-4fd6-a8cc-99c7749bae74 for instance 6a2ade30-3cf5-43af-8d19-b45cfa549702 on n-h2-master-1 Oct 30 02:52:22.072262 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-f4316077-f04e-43b0-8800-81f47b460849 req-57f4f1b4-20fa-4357-898b-7d8ed1a78c44 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084265 Oct 30 02:52:22.073009 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3898/8135] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:52:22.165841 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-febd7892-d45d-4b39-a606-b0aaa1c648cd tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:52:22.166464 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-febd7892-d45d-4b39-a606-b0aaa1c648cd tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:52:22.173368 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-febd7892-d45d-4b39-a606-b0aaa1c648cd tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:22.173867 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-febd7892-d45d-4b39-a606-b0aaa1c648cd tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:22.174317 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-febd7892-d45d-4b39-a606-b0aaa1c648cd tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:22.175022 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-febd7892-d45d-4b39-a606-b0aaa1c648cd tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:22.175489 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-febd7892-d45d-4b39-a606-b0aaa1c648cd tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:22.175927 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-febd7892-d45d-4b39-a606-b0aaa1c648cd tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:22.310612 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-febd7892-d45d-4b39-a606-b0aaa1c648cd tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:52:22.318541 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-febd7892-d45d-4b39-a606-b0aaa1c648cd tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 200 len: 1570 microversion: 2.1 time: 0.156813 Oct 30 02:52:22.319122 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4238/8136] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:52:22 2022] GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:52:22.344944 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4d30221e-ef8b-4176-9f63-10d82bbbceb4 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:52:22.345712 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4d30221e-ef8b-4176-9f63-10d82bbbceb4 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:52:22.352184 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4d30221e-ef8b-4176-9f63-10d82bbbceb4 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:22.353729 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4d30221e-ef8b-4176-9f63-10d82bbbceb4 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:22.353729 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4d30221e-ef8b-4176-9f63-10d82bbbceb4 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:22.353984 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4d30221e-ef8b-4176-9f63-10d82bbbceb4 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:22.354337 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4d30221e-ef8b-4176-9f63-10d82bbbceb4 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:22.354769 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4d30221e-ef8b-4176-9f63-10d82bbbceb4 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:22.385728 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4d30221e-ef8b-4176-9f63-10d82bbbceb4 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121103) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 30 02:52:22.717791 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4d30221e-ef8b-4176-9f63-10d82bbbceb4 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "POST /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702/action" status: 202 len: 0 microversion: 2.1 time: 0.377232 Oct 30 02:52:22.718532 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3899/8137] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 02:52:22 2022] POST /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702/action => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 30 02:52:22.726857 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-db72db6c-8ef0-4570-b297-a4d50fa3c6b7 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:52:22.727658 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-db72db6c-8ef0-4570-b297-a4d50fa3c6b7 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:52:22.734995 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-db72db6c-8ef0-4570-b297-a4d50fa3c6b7 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:22.735832 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-db72db6c-8ef0-4570-b297-a4d50fa3c6b7 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:22.736478 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-db72db6c-8ef0-4570-b297-a4d50fa3c6b7 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:22.737199 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-db72db6c-8ef0-4570-b297-a4d50fa3c6b7 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:22.737725 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-db72db6c-8ef0-4570-b297-a4d50fa3c6b7 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:22.738164 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-db72db6c-8ef0-4570-b297-a4d50fa3c6b7 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:22.871588 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-db72db6c-8ef0-4570-b297-a4d50fa3c6b7 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:52:22.879697 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-db72db6c-8ef0-4570-b297-a4d50fa3c6b7 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 200 len: 1518 microversion: 2.1 time: 0.156804 Oct 30 02:52:22.880270 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4239/8138] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:52:22 2022] GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:52:23.905309 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b7ed528a-7f34-4b2b-aab7-e7bd2239900f tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:52:23.905955 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b7ed528a-7f34-4b2b-aab7-e7bd2239900f tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:52:23.912489 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b7ed528a-7f34-4b2b-aab7-e7bd2239900f tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:23.912978 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b7ed528a-7f34-4b2b-aab7-e7bd2239900f tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:23.913448 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b7ed528a-7f34-4b2b-aab7-e7bd2239900f tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:23.914154 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b7ed528a-7f34-4b2b-aab7-e7bd2239900f tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:23.914612 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b7ed528a-7f34-4b2b-aab7-e7bd2239900f tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:23.915039 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b7ed528a-7f34-4b2b-aab7-e7bd2239900f tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:24.051640 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b7ed528a-7f34-4b2b-aab7-e7bd2239900f tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:52:24.060191 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b7ed528a-7f34-4b2b-aab7-e7bd2239900f tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 200 len: 1520 microversion: 2.1 time: 0.161155 Oct 30 02:52:24.060859 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3900/8139] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:52:23 2022] GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:52:25.084474 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e8abdfc4-02e2-45b4-94d9-1c2ee5e0d7f9 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:52:25.085047 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e8abdfc4-02e2-45b4-94d9-1c2ee5e0d7f9 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:52:25.092407 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e8abdfc4-02e2-45b4-94d9-1c2ee5e0d7f9 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:25.092903 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e8abdfc4-02e2-45b4-94d9-1c2ee5e0d7f9 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:25.093379 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e8abdfc4-02e2-45b4-94d9-1c2ee5e0d7f9 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:25.094095 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e8abdfc4-02e2-45b4-94d9-1c2ee5e0d7f9 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:25.094559 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e8abdfc4-02e2-45b4-94d9-1c2ee5e0d7f9 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:25.094997 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e8abdfc4-02e2-45b4-94d9-1c2ee5e0d7f9 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:25.229731 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-e8abdfc4-02e2-45b4-94d9-1c2ee5e0d7f9 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:52:25.238463 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e8abdfc4-02e2-45b4-94d9-1c2ee5e0d7f9 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 200 len: 1520 microversion: 2.1 time: 0.157626 Oct 30 02:52:25.239091 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4240/8140] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:52:25 2022] GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:52:26.262638 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b26481a6-6695-45fb-9a6b-838da625f9e1 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:52:26.263255 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b26481a6-6695-45fb-9a6b-838da625f9e1 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:52:26.270310 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b26481a6-6695-45fb-9a6b-838da625f9e1 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:26.270801 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b26481a6-6695-45fb-9a6b-838da625f9e1 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:26.271314 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b26481a6-6695-45fb-9a6b-838da625f9e1 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:26.272253 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b26481a6-6695-45fb-9a6b-838da625f9e1 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:26.272821 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b26481a6-6695-45fb-9a6b-838da625f9e1 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:26.273379 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b26481a6-6695-45fb-9a6b-838da625f9e1 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:26.411490 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b26481a6-6695-45fb-9a6b-838da625f9e1 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:52:26.420188 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b26481a6-6695-45fb-9a6b-838da625f9e1 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 200 len: 1520 microversion: 2.1 time: 0.161703 Oct 30 02:52:26.420772 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3901/8141] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:52:26 2022] GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:52:27.443653 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-844d9dc8-6d67-4ab1-9221-f59ade36c341 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:52:27.444368 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-844d9dc8-6d67-4ab1-9221-f59ade36c341 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:52:27.451326 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-844d9dc8-6d67-4ab1-9221-f59ade36c341 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:27.451823 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-844d9dc8-6d67-4ab1-9221-f59ade36c341 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:27.452269 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-844d9dc8-6d67-4ab1-9221-f59ade36c341 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:27.452979 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-844d9dc8-6d67-4ab1-9221-f59ade36c341 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:27.453500 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-844d9dc8-6d67-4ab1-9221-f59ade36c341 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:27.453939 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-844d9dc8-6d67-4ab1-9221-f59ade36c341 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:27.592443 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-844d9dc8-6d67-4ab1-9221-f59ade36c341 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:52:27.600836 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-844d9dc8-6d67-4ab1-9221-f59ade36c341 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 200 len: 1520 microversion: 2.1 time: 0.161045 Oct 30 02:52:27.601451 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4241/8142] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:52:27 2022] GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:52:28.624624 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-580fe170-812d-407b-a897-ada0f4aad0dc tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:52:28.625248 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-580fe170-812d-407b-a897-ada0f4aad0dc tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:52:28.632329 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-580fe170-812d-407b-a897-ada0f4aad0dc tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:28.632843 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-580fe170-812d-407b-a897-ada0f4aad0dc tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:28.633280 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-580fe170-812d-407b-a897-ada0f4aad0dc tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:28.633999 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-580fe170-812d-407b-a897-ada0f4aad0dc tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:28.635124 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-580fe170-812d-407b-a897-ada0f4aad0dc tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:28.635552 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-580fe170-812d-407b-a897-ada0f4aad0dc tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:28.768907 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-580fe170-812d-407b-a897-ada0f4aad0dc tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:52:28.776947 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-580fe170-812d-407b-a897-ada0f4aad0dc tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 200 len: 1520 microversion: 2.1 time: 0.156325 Oct 30 02:52:28.777559 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3902/8143] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:52:28 2022] GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:52:29.800132 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d7212bee-2a42-492a-997b-394dfe7c01c1 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:52:29.800892 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d7212bee-2a42-492a-997b-394dfe7c01c1 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:52:29.807808 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7212bee-2a42-492a-997b-394dfe7c01c1 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:29.808244 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7212bee-2a42-492a-997b-394dfe7c01c1 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:29.808695 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7212bee-2a42-492a-997b-394dfe7c01c1 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:29.809432 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7212bee-2a42-492a-997b-394dfe7c01c1 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:29.809927 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7212bee-2a42-492a-997b-394dfe7c01c1 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:29.810371 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7212bee-2a42-492a-997b-394dfe7c01c1 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:29.999374 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-d7212bee-2a42-492a-997b-394dfe7c01c1 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:52:30.007216 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d7212bee-2a42-492a-997b-394dfe7c01c1 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 200 len: 1576 microversion: 2.1 time: 0.210977 Oct 30 02:52:30.007876 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4242/8144] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:52:29 2022] GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 1576 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:52:30.543475 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-5bed21eb-b02d-45c3-bf8b-c41a0a05e841 req-8ccb1f44-baba-4083-be64-5dac6564dc4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a2ade30-3cf5-43af-8d19-b45cfa549702", "tag": "e88cc00f-15a6-4fd6-a8cc-99c7749bae74"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:52:30.554728 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-5bed21eb-b02d-45c3-bf8b-c41a0a05e841 req-8ccb1f44-baba-4083-be64-5dac6564dc4f service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:30.555214 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-5bed21eb-b02d-45c3-bf8b-c41a0a05e841 req-8ccb1f44-baba-4083-be64-5dac6564dc4f service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:30.555643 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-5bed21eb-b02d-45c3-bf8b-c41a0a05e841 req-8ccb1f44-baba-4083-be64-5dac6564dc4f service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:30.569118 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-5bed21eb-b02d-45c3-bf8b-c41a0a05e841 req-8ccb1f44-baba-4083-be64-5dac6564dc4f service nova] Creating event network-changed:e88cc00f-15a6-4fd6-a8cc-99c7749bae74 for instance 6a2ade30-3cf5-43af-8d19-b45cfa549702 on n-h1-master-1 Oct 30 02:52:30.574282 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-5bed21eb-b02d-45c3-bf8b-c41a0a05e841 req-8ccb1f44-baba-4083-be64-5dac6564dc4f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035189 Oct 30 02:52:30.575123 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3903/8145] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:52:31.032577 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8386ca22-d4fe-4d49-862e-ea7cff108170 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:52:31.033215 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8386ca22-d4fe-4d49-862e-ea7cff108170 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:52:31.040012 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8386ca22-d4fe-4d49-862e-ea7cff108170 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:31.040506 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8386ca22-d4fe-4d49-862e-ea7cff108170 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:31.041640 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8386ca22-d4fe-4d49-862e-ea7cff108170 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:31.042376 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8386ca22-d4fe-4d49-862e-ea7cff108170 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:31.042839 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8386ca22-d4fe-4d49-862e-ea7cff108170 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:31.043287 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8386ca22-d4fe-4d49-862e-ea7cff108170 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:31.176312 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-8386ca22-d4fe-4d49-862e-ea7cff108170 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:52:31.184498 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8386ca22-d4fe-4d49-862e-ea7cff108170 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 200 len: 1576 microversion: 2.1 time: 0.156238 Oct 30 02:52:31.185724 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4243/8146] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:52:31 2022] GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:52:32.208447 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bbce8faf-b7f2-4bea-bd84-d4fd171a0ce8 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:52:32.209187 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-bbce8faf-b7f2-4bea-bd84-d4fd171a0ce8 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:52:32.216536 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bbce8faf-b7f2-4bea-bd84-d4fd171a0ce8 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:32.217030 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bbce8faf-b7f2-4bea-bd84-d4fd171a0ce8 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:32.217514 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bbce8faf-b7f2-4bea-bd84-d4fd171a0ce8 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:32.218222 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bbce8faf-b7f2-4bea-bd84-d4fd171a0ce8 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:32.218683 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bbce8faf-b7f2-4bea-bd84-d4fd171a0ce8 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:32.219117 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bbce8faf-b7f2-4bea-bd84-d4fd171a0ce8 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:32.354249 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-bbce8faf-b7f2-4bea-bd84-d4fd171a0ce8 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:52:32.362039 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bbce8faf-b7f2-4bea-bd84-d4fd171a0ce8 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 200 len: 1576 microversion: 2.1 time: 0.157936 Oct 30 02:52:32.362618 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3904/8147] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:52:32 2022] GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:52:33.386533 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a53e1b0e-f30a-4baf-9728-42419d0a63e2 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:52:33.387165 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a53e1b0e-f30a-4baf-9728-42419d0a63e2 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:52:33.394187 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a53e1b0e-f30a-4baf-9728-42419d0a63e2 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:33.394685 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a53e1b0e-f30a-4baf-9728-42419d0a63e2 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:33.395137 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a53e1b0e-f30a-4baf-9728-42419d0a63e2 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:33.395840 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a53e1b0e-f30a-4baf-9728-42419d0a63e2 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:33.396308 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a53e1b0e-f30a-4baf-9728-42419d0a63e2 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:33.396746 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a53e1b0e-f30a-4baf-9728-42419d0a63e2 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:33.534796 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a53e1b0e-f30a-4baf-9728-42419d0a63e2 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:52:33.542561 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a53e1b0e-f30a-4baf-9728-42419d0a63e2 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 200 len: 1576 microversion: 2.1 time: 0.160611 Oct 30 02:52:33.543140 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4244/8148] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:52:33 2022] GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:52:34.565697 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-05b3e82b-d7f3-48b2-a57b-1fb6c66a8ae8 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:52:34.566320 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-05b3e82b-d7f3-48b2-a57b-1fb6c66a8ae8 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:52:34.573217 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-05b3e82b-d7f3-48b2-a57b-1fb6c66a8ae8 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:34.579829 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-05b3e82b-d7f3-48b2-a57b-1fb6c66a8ae8 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:34.579829 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-05b3e82b-d7f3-48b2-a57b-1fb6c66a8ae8 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:34.579829 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-05b3e82b-d7f3-48b2-a57b-1fb6c66a8ae8 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:34.579829 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-05b3e82b-d7f3-48b2-a57b-1fb6c66a8ae8 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:34.579829 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-05b3e82b-d7f3-48b2-a57b-1fb6c66a8ae8 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:34.708811 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-05b3e82b-d7f3-48b2-a57b-1fb6c66a8ae8 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:52:34.712858 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:52:34.717529 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-05b3e82b-d7f3-48b2-a57b-1fb6c66a8ae8 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 200 len: 1576 microversion: 2.1 time: 0.155815 Oct 30 02:52:34.718113 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3905/8149] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:52:34 2022] GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:52:35.741136 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-44f42834-79dd-4334-a118-c4997af267d5 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:52:35.741846 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-44f42834-79dd-4334-a118-c4997af267d5 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:52:35.748622 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44f42834-79dd-4334-a118-c4997af267d5 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:35.749113 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44f42834-79dd-4334-a118-c4997af267d5 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:35.749598 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44f42834-79dd-4334-a118-c4997af267d5 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:35.750297 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44f42834-79dd-4334-a118-c4997af267d5 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:35.750757 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44f42834-79dd-4334-a118-c4997af267d5 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:35.751189 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44f42834-79dd-4334-a118-c4997af267d5 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:35.878565 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-44f42834-79dd-4334-a118-c4997af267d5 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:52:35.886968 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-44f42834-79dd-4334-a118-c4997af267d5 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 200 len: 1576 microversion: 2.1 time: 0.149727 Oct 30 02:52:35.887548 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4245/8150] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:52:35 2022] GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:52:36.912868 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8884219a-d0f6-4c11-b847-57a9f67fd4ce tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:52:36.913548 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8884219a-d0f6-4c11-b847-57a9f67fd4ce tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:52:36.917116 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:52:36.922188 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8884219a-d0f6-4c11-b847-57a9f67fd4ce tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:36.922679 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8884219a-d0f6-4c11-b847-57a9f67fd4ce tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:36.923118 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8884219a-d0f6-4c11-b847-57a9f67fd4ce tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:36.923816 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8884219a-d0f6-4c11-b847-57a9f67fd4ce tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:36.924275 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8884219a-d0f6-4c11-b847-57a9f67fd4ce tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:36.924705 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8884219a-d0f6-4c11-b847-57a9f67fd4ce tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:37.059102 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-8884219a-d0f6-4c11-b847-57a9f67fd4ce tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:52:37.066793 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8884219a-d0f6-4c11-b847-57a9f67fd4ce tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 200 len: 1576 microversion: 2.1 time: 0.158915 Oct 30 02:52:37.067372 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3906/8151] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:52:36 2022] GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:52:38.089161 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-84b87fd3-23b7-411b-a4db-9ea83c11d175 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:52:38.089770 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-84b87fd3-23b7-411b-a4db-9ea83c11d175 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:52:38.092469 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=31 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:52:38.097227 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-84b87fd3-23b7-411b-a4db-9ea83c11d175 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:38.097762 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-84b87fd3-23b7-411b-a4db-9ea83c11d175 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:38.098217 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-84b87fd3-23b7-411b-a4db-9ea83c11d175 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:38.098929 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-84b87fd3-23b7-411b-a4db-9ea83c11d175 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:38.099397 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-84b87fd3-23b7-411b-a4db-9ea83c11d175 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:38.099839 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-84b87fd3-23b7-411b-a4db-9ea83c11d175 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:38.105526 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=91 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:52:38.233190 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-84b87fd3-23b7-411b-a4db-9ea83c11d175 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:52:38.241043 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-84b87fd3-23b7-411b-a4db-9ea83c11d175 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 200 len: 1576 microversion: 2.1 time: 0.155890 Oct 30 02:52:38.241637 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4246/8152] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:52:38 2022] GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:52:39.264991 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-650b0157-555e-4929-a6db-ffbe21da87fe tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:52:39.265641 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-650b0157-555e-4929-a6db-ffbe21da87fe tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:52:39.271906 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-650b0157-555e-4929-a6db-ffbe21da87fe tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:39.272400 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-650b0157-555e-4929-a6db-ffbe21da87fe tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:39.272840 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-650b0157-555e-4929-a6db-ffbe21da87fe tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:39.273573 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-650b0157-555e-4929-a6db-ffbe21da87fe tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:39.274035 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-650b0157-555e-4929-a6db-ffbe21da87fe tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:39.274460 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-650b0157-555e-4929-a6db-ffbe21da87fe tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:39.411139 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-650b0157-555e-4929-a6db-ffbe21da87fe tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:52:39.419648 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-650b0157-555e-4929-a6db-ffbe21da87fe tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 200 len: 1576 microversion: 2.1 time: 0.158907 Oct 30 02:52:39.420411 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3907/8153] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:52:39 2022] GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:52:40.443770 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4472e867-6468-4a6b-9631-1ccf19018a2c tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:52:40.444404 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4472e867-6468-4a6b-9631-1ccf19018a2c tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:52:40.451462 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4472e867-6468-4a6b-9631-1ccf19018a2c tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:40.452293 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4472e867-6468-4a6b-9631-1ccf19018a2c tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:40.452748 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4472e867-6468-4a6b-9631-1ccf19018a2c tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:40.453490 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4472e867-6468-4a6b-9631-1ccf19018a2c tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:40.453963 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4472e867-6468-4a6b-9631-1ccf19018a2c tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:40.454405 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4472e867-6468-4a6b-9631-1ccf19018a2c tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:40.582574 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-4472e867-6468-4a6b-9631-1ccf19018a2c tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:52:40.590325 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4472e867-6468-4a6b-9631-1ccf19018a2c tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 200 len: 1576 microversion: 2.1 time: 0.150615 Oct 30 02:52:40.590912 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4247/8154] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:52:40 2022] GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:52:40.881497 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-2152d295-57fd-4ef6-a6e2-9a2beda5a775 req-2f72e4f7-d9d9-439d-8664-e6600721dc47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a2ade30-3cf5-43af-8d19-b45cfa549702", "name": "network-vif-plugged", "status": "completed", "tag": "e88cc00f-15a6-4fd6-a8cc-99c7749bae74"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:52:40.892531 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-2152d295-57fd-4ef6-a6e2-9a2beda5a775 req-2f72e4f7-d9d9-439d-8664-e6600721dc47 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:40.892950 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-2152d295-57fd-4ef6-a6e2-9a2beda5a775 req-2f72e4f7-d9d9-439d-8664-e6600721dc47 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:40.893404 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-2152d295-57fd-4ef6-a6e2-9a2beda5a775 req-2f72e4f7-d9d9-439d-8664-e6600721dc47 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:40.905295 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-2152d295-57fd-4ef6-a6e2-9a2beda5a775 req-2f72e4f7-d9d9-439d-8664-e6600721dc47 service nova] Creating event network-vif-plugged:e88cc00f-15a6-4fd6-a8cc-99c7749bae74 for instance 6a2ade30-3cf5-43af-8d19-b45cfa549702 on n-h1-master-1 Oct 30 02:52:40.910625 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-2152d295-57fd-4ef6-a6e2-9a2beda5a775 req-2f72e4f7-d9d9-439d-8664-e6600721dc47 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032969 Oct 30 02:52:40.911244 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3908/8155] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:52:41.613230 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b0fcc86b-5ea9-4e5d-b795-b1e1c4aed06c tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:52:41.613870 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b0fcc86b-5ea9-4e5d-b795-b1e1c4aed06c tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:52:41.620750 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0fcc86b-5ea9-4e5d-b795-b1e1c4aed06c tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:41.621241 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0fcc86b-5ea9-4e5d-b795-b1e1c4aed06c tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:41.621730 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0fcc86b-5ea9-4e5d-b795-b1e1c4aed06c tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:41.622426 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0fcc86b-5ea9-4e5d-b795-b1e1c4aed06c tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:41.622886 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0fcc86b-5ea9-4e5d-b795-b1e1c4aed06c tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:41.623324 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0fcc86b-5ea9-4e5d-b795-b1e1c4aed06c tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:42.056398 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b0fcc86b-5ea9-4e5d-b795-b1e1c4aed06c tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:52:42.064171 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b0fcc86b-5ea9-4e5d-b795-b1e1c4aed06c tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 200 len: 1576 microversion: 2.1 time: 0.454867 Oct 30 02:52:42.064736 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4248/8156] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:52:41 2022] GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 1576 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:52:43.088843 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-22790c4f-0327-4795-b5d9-31624f5e08eb tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:52:43.089600 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-22790c4f-0327-4795-b5d9-31624f5e08eb tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:52:43.095838 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22790c4f-0327-4795-b5d9-31624f5e08eb tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:43.096326 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22790c4f-0327-4795-b5d9-31624f5e08eb tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:43.096762 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22790c4f-0327-4795-b5d9-31624f5e08eb tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:43.097492 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22790c4f-0327-4795-b5d9-31624f5e08eb tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:52:43.097951 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22790c4f-0327-4795-b5d9-31624f5e08eb tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:52:43.098376 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22790c4f-0327-4795-b5d9-31624f5e08eb tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:52:43.230776 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-22790c4f-0327-4795-b5d9-31624f5e08eb tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:52:43.238909 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-22790c4f-0327-4795-b5d9-31624f5e08eb tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 200 len: 1563 microversion: 2.1 time: 0.155785 Oct 30 02:52:43.239488 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3909/8157] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:52:43 2022] GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:54:20.467326 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c3d9d152-3975-4112-bae9-e9c4f754e1a3 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:54:20.467326 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c3d9d152-3975-4112-bae9-e9c4f754e1a3 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:54:20.469080 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=5 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:54:20.469673 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=7 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:54:20.470464 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=20 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:54:20.476667 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=17 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:54:20.478124 n-d-master-1 devstack@n-api.service[121102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 30 02:54:20.478341 n-d-master-1 devstack@n-api.service[121102]: Sun Oct 30 02:54:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 (ip 10.222.0.13) !!! Oct 30 02:54:20.487030 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c3d9d152-3975-4112-bae9-e9c4f754e1a3 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:54:20.487536 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c3d9d152-3975-4112-bae9-e9c4f754e1a3 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:54:20.487980 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c3d9d152-3975-4112-bae9-e9c4f754e1a3 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:54:20.488955 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c3d9d152-3975-4112-bae9-e9c4f754e1a3 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:54:20.489449 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c3d9d152-3975-4112-bae9-e9c4f754e1a3 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:54:20.489889 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c3d9d152-3975-4112-bae9-e9c4f754e1a3 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:54:20.521582 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c3d9d152-3975-4112-bae9-e9c4f754e1a3 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 02:54:20.594669 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-33005082-34f7-4be8-bb33-86d3af330786 req-399c68fa-8a0c-402a-8c01-05cc84684623 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a2ade30-3cf5-43af-8d19-b45cfa549702", "tag": "e88cc00f-15a6-4fd6-a8cc-99c7749bae74"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:54:20.604509 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-33005082-34f7-4be8-bb33-86d3af330786 req-399c68fa-8a0c-402a-8c01-05cc84684623 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:54:20.610336 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-33005082-34f7-4be8-bb33-86d3af330786 req-399c68fa-8a0c-402a-8c01-05cc84684623 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:54:20.610336 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-33005082-34f7-4be8-bb33-86d3af330786 req-399c68fa-8a0c-402a-8c01-05cc84684623 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:54:20.617643 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-33005082-34f7-4be8-bb33-86d3af330786 req-399c68fa-8a0c-402a-8c01-05cc84684623 service nova] Creating event network-changed:e88cc00f-15a6-4fd6-a8cc-99c7749bae74 for instance 6a2ade30-3cf5-43af-8d19-b45cfa549702 on n-h1-master-1 Oct 30 02:54:20.623066 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-33005082-34f7-4be8-bb33-86d3af330786 req-399c68fa-8a0c-402a-8c01-05cc84684623 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162092 Oct 30 02:54:20.623694 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3910/8158] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:54:20.794134 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c3d9d152-3975-4112-bae9-e9c4f754e1a3 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 204 len: 0 microversion: 2.1 time: 0.335168 Oct 30 02:54:20.795412 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4249/8159] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 02:54:20 2022] DELETE /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 02:54:20.804774 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c9729724-7b1d-4619-a92c-2b4811af48ed tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:54:20.805984 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c9729724-7b1d-4619-a92c-2b4811af48ed tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:54:20.812493 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c9729724-7b1d-4619-a92c-2b4811af48ed tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:54:20.813116 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c9729724-7b1d-4619-a92c-2b4811af48ed tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:54:20.813773 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c9729724-7b1d-4619-a92c-2b4811af48ed tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:54:20.814583 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c9729724-7b1d-4619-a92c-2b4811af48ed tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:54:20.815147 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c9729724-7b1d-4619-a92c-2b4811af48ed tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:54:20.815710 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c9729724-7b1d-4619-a92c-2b4811af48ed tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:54:21.032591 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-c9729724-7b1d-4619-a92c-2b4811af48ed tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:54:21.041283 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c9729724-7b1d-4619-a92c-2b4811af48ed tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 200 len: 1569 microversion: 2.1 time: 0.241291 Oct 30 02:54:21.047188 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3911/8160] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:54:20 2022] GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 1569 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:54:22.064876 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1fc1794e-3be7-4ac2-ad12-722ee68e19d9 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:54:22.065613 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1fc1794e-3be7-4ac2-ad12-722ee68e19d9 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:54:22.074003 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1fc1794e-3be7-4ac2-ad12-722ee68e19d9 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:54:22.074531 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1fc1794e-3be7-4ac2-ad12-722ee68e19d9 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:54:22.074980 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1fc1794e-3be7-4ac2-ad12-722ee68e19d9 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:54:22.075688 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1fc1794e-3be7-4ac2-ad12-722ee68e19d9 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:54:22.076179 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1fc1794e-3be7-4ac2-ad12-722ee68e19d9 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:54:22.076615 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1fc1794e-3be7-4ac2-ad12-722ee68e19d9 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:54:22.299675 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-1fc1794e-3be7-4ac2-ad12-722ee68e19d9 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:54:22.308327 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1fc1794e-3be7-4ac2-ad12-722ee68e19d9 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 200 len: 1569 microversion: 2.1 time: 0.247906 Oct 30 02:54:22.308892 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4250/8161] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:54:22 2022] GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 1569 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:54:22.987359 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-32944549-8040-428a-9cdb-e36a0a19559b req-dda8c4d9-346e-4656-a3b2-3d2d53632ab2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a2ade30-3cf5-43af-8d19-b45cfa549702", "name": "network-vif-deleted", "tag": "e88cc00f-15a6-4fd6-a8cc-99c7749bae74"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:54:22.998069 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-32944549-8040-428a-9cdb-e36a0a19559b req-dda8c4d9-346e-4656-a3b2-3d2d53632ab2 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:54:23.000462 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-32944549-8040-428a-9cdb-e36a0a19559b req-dda8c4d9-346e-4656-a3b2-3d2d53632ab2 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:54:23.000462 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-32944549-8040-428a-9cdb-e36a0a19559b req-dda8c4d9-346e-4656-a3b2-3d2d53632ab2 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:54:23.011002 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-32944549-8040-428a-9cdb-e36a0a19559b req-dda8c4d9-346e-4656-a3b2-3d2d53632ab2 service nova] Creating event network-vif-deleted:e88cc00f-15a6-4fd6-a8cc-99c7749bae74 for instance 6a2ade30-3cf5-43af-8d19-b45cfa549702 on n-h1-master-1 Oct 30 02:54:23.016217 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-32944549-8040-428a-9cdb-e36a0a19559b req-dda8c4d9-346e-4656-a3b2-3d2d53632ab2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032818 Oct 30 02:54:23.016807 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3912/8162] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:54:23.331721 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3147545a-5cc7-4b42-8d12-cc2ddc6d20e0 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:54:23.332347 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3147545a-5cc7-4b42-8d12-cc2ddc6d20e0 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:54:23.339752 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3147545a-5cc7-4b42-8d12-cc2ddc6d20e0 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:54:23.340590 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3147545a-5cc7-4b42-8d12-cc2ddc6d20e0 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:54:23.341041 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3147545a-5cc7-4b42-8d12-cc2ddc6d20e0 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:54:23.341789 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3147545a-5cc7-4b42-8d12-cc2ddc6d20e0 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:54:23.342256 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3147545a-5cc7-4b42-8d12-cc2ddc6d20e0 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:54:23.342845 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3147545a-5cc7-4b42-8d12-cc2ddc6d20e0 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:54:23.409779 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3147545a-5cc7-4b42-8d12-cc2ddc6d20e0 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:54:23.418265 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3147545a-5cc7-4b42-8d12-cc2ddc6d20e0 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 200 len: 1220 microversion: 2.1 time: 0.090374 Oct 30 02:54:23.422332 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4251/8163] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:54:23 2022] GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:54:24.442192 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-de291cd1-c905-4345-9d7e-72b5d1f6dd43 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:54:24.443008 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-de291cd1-c905-4345-9d7e-72b5d1f6dd43 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:54:24.450635 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de291cd1-c905-4345-9d7e-72b5d1f6dd43 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:54:24.451115 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de291cd1-c905-4345-9d7e-72b5d1f6dd43 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:54:24.451546 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de291cd1-c905-4345-9d7e-72b5d1f6dd43 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:54:24.452235 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de291cd1-c905-4345-9d7e-72b5d1f6dd43 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:54:24.452687 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de291cd1-c905-4345-9d7e-72b5d1f6dd43 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:54:24.453134 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de291cd1-c905-4345-9d7e-72b5d1f6dd43 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:54:24.516285 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-de291cd1-c905-4345-9d7e-72b5d1f6dd43 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:54:24.525577 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-de291cd1-c905-4345-9d7e-72b5d1f6dd43 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 200 len: 1220 microversion: 2.1 time: 0.087586 Oct 30 02:54:24.526411 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3913/8164] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:54:24 2022] GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:54:25.548291 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6490e15b-c4f2-4112-8126-46158cb7f5c4 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:54:25.548914 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6490e15b-c4f2-4112-8126-46158cb7f5c4 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:54:25.556191 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6490e15b-c4f2-4112-8126-46158cb7f5c4 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:54:25.556706 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6490e15b-c4f2-4112-8126-46158cb7f5c4 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:54:25.557158 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6490e15b-c4f2-4112-8126-46158cb7f5c4 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:54:25.557933 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6490e15b-c4f2-4112-8126-46158cb7f5c4 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:54:25.558406 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6490e15b-c4f2-4112-8126-46158cb7f5c4 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:54:25.558846 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6490e15b-c4f2-4112-8126-46158cb7f5c4 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:54:25.621486 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-6490e15b-c4f2-4112-8126-46158cb7f5c4 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:54:25.629446 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6490e15b-c4f2-4112-8126-46158cb7f5c4 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 200 len: 1220 microversion: 2.1 time: 0.085174 Oct 30 02:54:25.630019 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4252/8165] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:54:25 2022] GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:54:26.652424 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6172846d-0756-4de6-afc8-cdc46872469e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:54:26.652963 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6172846d-0756-4de6-afc8-cdc46872469e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:54:26.659917 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6172846d-0756-4de6-afc8-cdc46872469e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:54:26.660410 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6172846d-0756-4de6-afc8-cdc46872469e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:54:26.660850 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6172846d-0756-4de6-afc8-cdc46872469e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:54:26.661577 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6172846d-0756-4de6-afc8-cdc46872469e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:54:26.662037 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6172846d-0756-4de6-afc8-cdc46872469e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:54:26.662465 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6172846d-0756-4de6-afc8-cdc46872469e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:54:26.728212 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-6172846d-0756-4de6-afc8-cdc46872469e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:54:26.736088 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6172846d-0756-4de6-afc8-cdc46872469e tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 200 len: 1220 microversion: 2.1 time: 0.087961 Oct 30 02:54:26.736679 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3914/8166] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:54:26 2022] GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:54:27.761009 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-317347b0-8c59-45a9-9ec9-798e5e5ce17a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:54:27.761832 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-317347b0-8c59-45a9-9ec9-798e5e5ce17a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:54:27.769539 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-317347b0-8c59-45a9-9ec9-798e5e5ce17a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:54:27.770186 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-317347b0-8c59-45a9-9ec9-798e5e5ce17a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:54:27.770841 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-317347b0-8c59-45a9-9ec9-798e5e5ce17a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:54:27.771564 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-317347b0-8c59-45a9-9ec9-798e5e5ce17a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:54:27.772035 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-317347b0-8c59-45a9-9ec9-798e5e5ce17a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:54:27.772611 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-317347b0-8c59-45a9-9ec9-798e5e5ce17a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:54:27.807750 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-317347b0-8c59-45a9-9ec9-798e5e5ce17a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:54:27.808250 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-317347b0-8c59-45a9-9ec9-798e5e5ce17a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:54:27.808874 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-317347b0-8c59-45a9-9ec9-798e5e5ce17a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:54:27.809522 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-317347b0-8c59-45a9-9ec9-798e5e5ce17a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lazy-loading 'fault' on Instance uuid 6a2ade30-3cf5-43af-8d19-b45cfa549702 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 02:54:27.853760 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-317347b0-8c59-45a9-9ec9-798e5e5ce17a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4deb849d2b814e648cd1d84a82d1783d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49c70393b0144a1a1e946fea78b47a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:54:27.861736 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-317347b0-8c59-45a9-9ec9-798e5e5ce17a tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 200 len: 1225 microversion: 2.1 time: 0.105342 Oct 30 02:54:27.862455 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4253/8167] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:54:27 2022] GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:54:28.890193 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f66590d0-2d29-49a4-b139-2ef46aa3eb99 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:54:28.890193 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f66590d0-2d29-49a4-b139-2ef46aa3eb99 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] [instance: 6a2ade30-3cf5-43af-8d19-b45cfa549702] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:54:28.894074 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f66590d0-2d29-49a4-b139-2ef46aa3eb99 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:54:28.894566 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f66590d0-2d29-49a4-b139-2ef46aa3eb99 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:54:28.895001 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f66590d0-2d29-49a4-b139-2ef46aa3eb99 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:54:28.895702 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f66590d0-2d29-49a4-b139-2ef46aa3eb99 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:54:28.896159 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f66590d0-2d29-49a4-b139-2ef46aa3eb99 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:54:28.896864 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f66590d0-2d29-49a4-b139-2ef46aa3eb99 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:54:28.911116 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-f66590d0-2d29-49a4-b139-2ef46aa3eb99 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] HTTP exception thrown: Instance 6a2ade30-3cf5-43af-8d19-b45cfa549702 could not be found. Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f66590d0-2d29-49a4-b139-2ef46aa3eb99 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Request method failure captured: Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 HTTP/1.1 Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXeUPdBo5IBOL6hMNVaotx7rEiLvWLlpjTPYAuINGFChh-soSWDakJ_4SgU92eWZTVCp8Q97zTfb3IKrPNrvZdC9HJWtoWcVuSHkPhdXVI_dv9m38Ap38aFAdc6co5idqsPBDZx60yftsnaFdt-DC12fpgTeUSQk_zOYWXKTs86iIKbI Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: d49c70393b0144a1a1e946fea78b47a9 Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-TestShelveInstance-453476353 Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d49c70393b0144a1a1e946fea78b47a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d49c70393b0144a1a1e946fea78b47a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d49c70393b0144a1a1e946fea78b47a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d49c70393b0144a1a1e946fea78b47a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-TestShelveInstance-453476353 Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: d49c70393b0144a1a1e946fea78b47a9 Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-TestShelveInstance-453476353 Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-TestShelveInstance-453476353-project Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 4deb849d2b814e648cd1d84a82d1783d Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-TestShelveInstance-453476353-project Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 6a2ade30-3cf5-43af-8d19-b45cfa549702 could not be found. Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '6a2ade30-3cf5-43af-8d19-b45cfa549702'} Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a2ade30-3cf5-43af-8d19-b45cfa549702 could not be found. Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a2ade30-3cf5-43af-8d19-b45cfa549702 could not be found. Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:54:28.912810 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:54:28.923130 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:54:28.923130 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:54:28.923130 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:54:28.923130 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:54:28.923130 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:54:28.923130 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a2ade30-3cf5-43af-8d19-b45cfa549702 could not be found. Oct 30 02:54:28.923130 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:54:28.923130 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f66590d0-2d29-49a4-b139-2ef46aa3eb99 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Returning 404 to user: Instance 6a2ade30-3cf5-43af-8d19-b45cfa549702 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:54:28.923130 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f66590d0-2d29-49a4-b139-2ef46aa3eb99 tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702" status: 404 len: 111 microversion: 2.1 time: 0.031692 Oct 30 02:54:28.923130 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3915/8168] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:54:28 2022] GET /compute/v2.1/servers/6a2ade30-3cf5-43af-8d19-b45cfa549702 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 02:54:29.132902 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4cce6293-2b04-4b69-b54b-f9998b0fcf1b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] Calling method '.version_select at 0x7f44c6db20d0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:54:29.224969 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4cce6293-2b04-4b69-b54b-f9998b0fcf1b tempest-TestShelveInstance-453476353 tempest-TestShelveInstance-453476353-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1687352678" status: 202 len: 0 microversion: 2.1 time: 0.096830 Oct 30 02:54:29.225628 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4254/8169] 10.222.0.13 () {58 vars in 1254 bytes} [Sun Oct 30 02:54:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1687352678 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 02:54:51.607259 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=12 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:54:51.608396 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=24 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:54:51.776934 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7ed38bb0-a8f3-4bb7-9887-1a4d0a20cd18 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Action: 'create', calling method: .version_select at 0x7f44cc8dba60>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-261469712", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGQA1AHYn/ou3ksubhZzNb96aJmhXrpJKDwW/ZudBgj8VFpSCLsHZAB6ZraVZ8vr7sK/LCkaAiCzed1cQNyxLxWtnEOniSZOAl7tmlSvw8nsipNvV5RmM3dhePzXVLE63w=="}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:54:51.793261 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-7ed38bb0-a8f3-4bb7-9887-1a4d0a20cd18 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Getting quotas for project 59500d959c9f445eb7b4bb07c464cbb4. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 02:54:51.798713 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-7ed38bb0-a8f3-4bb7-9887-1a4d0a20cd18 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Getting quotas for user 6751185089fc469eb6d5db2e13058d15 and project 59500d959c9f445eb7b4bb07c464cbb4. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 02:54:51.910953 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7ed38bb0-a8f3-4bb7-9887-1a4d0a20cd18 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.308931 Oct 30 02:54:51.911587 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3916/8170] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 30 02:54:51 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:54:54.555302 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-51a8f32d-0794-4cfa-afd1-885e8b836088 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1145748611", "imageRef": "deb14158-45d8-4539-889d-ff9726d046d7", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-261469712", "security_groups": [{"name": "tempest-secgroup-smoke-1946260264"}], "networks": [{"uuid": "1e1908df-31b5-4da9-abfd-5dce52465d93"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:54:54.566426 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:54:54.567222 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:54:54.683127 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-51a8f32d-0794-4cfa-afd1-885e8b836088 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] validate_networks() for [('1e1908df-31b5-4da9-abfd-5dce52465d93', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 02:54:55.204959 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-51a8f32d-0794-4cfa-afd1-885e8b836088 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 02:54:55.205536 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-51a8f32d-0794-4cfa-afd1-885e8b836088 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 02:54:55.206105 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-51a8f32d-0794-4cfa-afd1-885e8b836088 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 02:54:55.206601 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-51a8f32d-0794-4cfa-afd1-885e8b836088 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 02:54:55.207140 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-51a8f32d-0794-4cfa-afd1-885e8b836088 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 02:54:55.216661 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51a8f32d-0794-4cfa-afd1-885e8b836088 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:54:55.217166 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51a8f32d-0794-4cfa-afd1-885e8b836088 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:54:55.217664 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51a8f32d-0794-4cfa-afd1-885e8b836088 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:54:55.218410 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51a8f32d-0794-4cfa-afd1-885e8b836088 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:54:55.218880 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51a8f32d-0794-4cfa-afd1-885e8b836088 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:54:55.219319 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51a8f32d-0794-4cfa-afd1-885e8b836088 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:54:55.237926 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-51a8f32d-0794-4cfa-afd1-885e8b836088 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Getting quotas for project 59500d959c9f445eb7b4bb07c464cbb4. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 02:54:55.244345 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.quota [None req-51a8f32d-0794-4cfa-afd1-885e8b836088 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Getting quotas for user 6751185089fc469eb6d5db2e13058d15 and project 59500d959c9f445eb7b4bb07c464cbb4. Resources: {'ram', 'instances', 'cores'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 02:54:55.257377 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-51a8f32d-0794-4cfa-afd1-885e8b836088 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 02:54:55.259753 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-51a8f32d-0794-4cfa-afd1-885e8b836088 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] [instance: 262f928c-b8f2-4c0d-9f20-6e90690e0108] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='deb14158-45d8-4539-889d-ff9726d046d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 02:54:55.382396 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-51a8f32d-0794-4cfa-afd1-885e8b836088 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.831962 Oct 30 02:54:55.382986 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4255/8171] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 02:54:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 02:54:55.395114 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3ed5c630-542b-4fa7-8a87-c3649895357d tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:54:55.395803 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3ed5c630-542b-4fa7-8a87-c3649895357d tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] [instance: 262f928c-b8f2-4c0d-9f20-6e90690e0108] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:54:55.453010 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3ed5c630-542b-4fa7-8a87-c3649895357d tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6751185089fc469eb6d5db2e13058d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59500d959c9f445eb7b4bb07c464cbb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:54:55.460742 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3ed5c630-542b-4fa7-8a87-c3649895357d tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] 10.222.0.13 "GET /compute/v2.1/servers/262f928c-b8f2-4c0d-9f20-6e90690e0108" status: 200 len: 1248 microversion: 2.1 time: 0.069894 Oct 30 02:54:55.461322 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3917/8172] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:54:55 2022] GET /compute/v2.1/servers/262f928c-b8f2-4c0d-9f20-6e90690e0108 => generated 1248 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:54:56.484552 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-99cd2fc4-82c4-4e7d-8c05-94d2d7f79a03 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:54:56.485209 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-99cd2fc4-82c4-4e7d-8c05-94d2d7f79a03 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] [instance: 262f928c-b8f2-4c0d-9f20-6e90690e0108] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:54:56.539772 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-99cd2fc4-82c4-4e7d-8c05-94d2d7f79a03 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6751185089fc469eb6d5db2e13058d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59500d959c9f445eb7b4bb07c464cbb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:54:56.546818 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-99cd2fc4-82c4-4e7d-8c05-94d2d7f79a03 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] 10.222.0.13 "GET /compute/v2.1/servers/262f928c-b8f2-4c0d-9f20-6e90690e0108" status: 200 len: 1248 microversion: 2.1 time: 0.067131 Oct 30 02:54:56.547392 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4256/8173] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:54:56 2022] GET /compute/v2.1/servers/262f928c-b8f2-4c0d-9f20-6e90690e0108 => generated 1248 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:54:57.570493 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3e19561d-dcfa-4896-840a-52355ac3b106 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:54:57.571167 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3e19561d-dcfa-4896-840a-52355ac3b106 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] [instance: 262f928c-b8f2-4c0d-9f20-6e90690e0108] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:54:57.578099 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3e19561d-dcfa-4896-840a-52355ac3b106 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:54:57.578592 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3e19561d-dcfa-4896-840a-52355ac3b106 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:54:57.579111 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3e19561d-dcfa-4896-840a-52355ac3b106 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:54:57.579811 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3e19561d-dcfa-4896-840a-52355ac3b106 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:54:57.580268 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3e19561d-dcfa-4896-840a-52355ac3b106 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:54:57.580696 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3e19561d-dcfa-4896-840a-52355ac3b106 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:54:57.644581 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-3e19561d-dcfa-4896-840a-52355ac3b106 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6751185089fc469eb6d5db2e13058d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59500d959c9f445eb7b4bb07c464cbb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:54:57.653214 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3e19561d-dcfa-4896-840a-52355ac3b106 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] 10.222.0.13 "GET /compute/v2.1/servers/262f928c-b8f2-4c0d-9f20-6e90690e0108" status: 200 len: 1300 microversion: 2.1 time: 0.087217 Oct 30 02:54:57.653830 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3918/8174] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:54:57 2022] GET /compute/v2.1/servers/262f928c-b8f2-4c0d-9f20-6e90690e0108 => generated 1300 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:54:58.676283 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-57fa517b-7f1d-4ba0-a836-528b7e1adecc tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:54:58.677219 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-57fa517b-7f1d-4ba0-a836-528b7e1adecc tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] [instance: 262f928c-b8f2-4c0d-9f20-6e90690e0108] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:54:58.684409 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-57fa517b-7f1d-4ba0-a836-528b7e1adecc tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:54:58.684925 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-57fa517b-7f1d-4ba0-a836-528b7e1adecc tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:54:58.685408 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-57fa517b-7f1d-4ba0-a836-528b7e1adecc tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:54:58.686139 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-57fa517b-7f1d-4ba0-a836-528b7e1adecc tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:54:58.686614 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-57fa517b-7f1d-4ba0-a836-528b7e1adecc tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:54:58.687060 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-57fa517b-7f1d-4ba0-a836-528b7e1adecc tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:54:58.875100 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-57fa517b-7f1d-4ba0-a836-528b7e1adecc tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6751185089fc469eb6d5db2e13058d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59500d959c9f445eb7b4bb07c464cbb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:54:58.883676 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-57fa517b-7f1d-4ba0-a836-528b7e1adecc tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] 10.222.0.13 "GET /compute/v2.1/servers/262f928c-b8f2-4c0d-9f20-6e90690e0108" status: 200 len: 1374 microversion: 2.1 time: 0.211253 Oct 30 02:54:58.884262 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4257/8175] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:54:58 2022] GET /compute/v2.1/servers/262f928c-b8f2-4c0d-9f20-6e90690e0108 => generated 1374 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:54:59.619044 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-50f48a35-ec58-419f-8b0a-b2f9cb40e9cd req-b7807394-8a3b-455e-bfea-7fde995279c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "262f928c-b8f2-4c0d-9f20-6e90690e0108", "tag": "4a880a91-048a-4faf-b8e3-3d938e672eaa"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:54:59.630917 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-50f48a35-ec58-419f-8b0a-b2f9cb40e9cd req-b7807394-8a3b-455e-bfea-7fde995279c1 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:54:59.631402 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-50f48a35-ec58-419f-8b0a-b2f9cb40e9cd req-b7807394-8a3b-455e-bfea-7fde995279c1 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:54:59.631937 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-50f48a35-ec58-419f-8b0a-b2f9cb40e9cd req-b7807394-8a3b-455e-bfea-7fde995279c1 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:54:59.644986 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-50f48a35-ec58-419f-8b0a-b2f9cb40e9cd req-b7807394-8a3b-455e-bfea-7fde995279c1 service nova] Creating event network-changed:4a880a91-048a-4faf-b8e3-3d938e672eaa for instance 262f928c-b8f2-4c0d-9f20-6e90690e0108 on n-h2-master-1 Oct 30 02:54:59.652173 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-50f48a35-ec58-419f-8b0a-b2f9cb40e9cd req-b7807394-8a3b-455e-bfea-7fde995279c1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037096 Oct 30 02:54:59.652561 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3919/8176] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:54:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:54:59.908047 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c0651b30-ff63-4184-8c4f-b6ccebe9bc1d tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:54:59.908715 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c0651b30-ff63-4184-8c4f-b6ccebe9bc1d tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] [instance: 262f928c-b8f2-4c0d-9f20-6e90690e0108] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:54:59.915813 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c0651b30-ff63-4184-8c4f-b6ccebe9bc1d tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:54:59.916316 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c0651b30-ff63-4184-8c4f-b6ccebe9bc1d tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:54:59.916772 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c0651b30-ff63-4184-8c4f-b6ccebe9bc1d tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:54:59.917989 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c0651b30-ff63-4184-8c4f-b6ccebe9bc1d tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:54:59.917989 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c0651b30-ff63-4184-8c4f-b6ccebe9bc1d tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:54:59.918414 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c0651b30-ff63-4184-8c4f-b6ccebe9bc1d tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:55:00.089598 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-c0651b30-ff63-4184-8c4f-b6ccebe9bc1d tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6751185089fc469eb6d5db2e13058d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59500d959c9f445eb7b4bb07c464cbb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:55:00.097562 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c0651b30-ff63-4184-8c4f-b6ccebe9bc1d tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] 10.222.0.13 "GET /compute/v2.1/servers/262f928c-b8f2-4c0d-9f20-6e90690e0108" status: 200 len: 1374 microversion: 2.1 time: 0.193315 Oct 30 02:55:00.109699 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4258/8177] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:54:59 2022] GET /compute/v2.1/servers/262f928c-b8f2-4c0d-9f20-6e90690e0108 => generated 1374 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:55:01.121761 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7ecea45f-5bb5-4939-9047-76fd2a116a86 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:55:01.122416 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7ecea45f-5bb5-4939-9047-76fd2a116a86 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] [instance: 262f928c-b8f2-4c0d-9f20-6e90690e0108] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:55:01.128715 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7ecea45f-5bb5-4939-9047-76fd2a116a86 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:55:01.129201 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7ecea45f-5bb5-4939-9047-76fd2a116a86 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:55:01.129677 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7ecea45f-5bb5-4939-9047-76fd2a116a86 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:55:01.130371 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7ecea45f-5bb5-4939-9047-76fd2a116a86 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:55:01.130829 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7ecea45f-5bb5-4939-9047-76fd2a116a86 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:55:01.131258 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7ecea45f-5bb5-4939-9047-76fd2a116a86 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:55:01.262311 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7ecea45f-5bb5-4939-9047-76fd2a116a86 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6751185089fc469eb6d5db2e13058d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59500d959c9f445eb7b4bb07c464cbb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:55:01.269981 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7ecea45f-5bb5-4939-9047-76fd2a116a86 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] 10.222.0.13 "GET /compute/v2.1/servers/262f928c-b8f2-4c0d-9f20-6e90690e0108" status: 200 len: 1374 microversion: 2.1 time: 0.153643 Oct 30 02:55:01.270543 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3920/8178] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:55:01 2022] GET /compute/v2.1/servers/262f928c-b8f2-4c0d-9f20-6e90690e0108 => generated 1374 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:55:02.293834 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b0d0c28c-3479-4a9c-8327-39d6d6d2a0af tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:55:02.294452 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b0d0c28c-3479-4a9c-8327-39d6d6d2a0af tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] [instance: 262f928c-b8f2-4c0d-9f20-6e90690e0108] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:55:02.301617 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0d0c28c-3479-4a9c-8327-39d6d6d2a0af tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:55:02.302112 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0d0c28c-3479-4a9c-8327-39d6d6d2a0af tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:55:02.302559 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0d0c28c-3479-4a9c-8327-39d6d6d2a0af tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:55:02.303260 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0d0c28c-3479-4a9c-8327-39d6d6d2a0af tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:55:02.303724 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0d0c28c-3479-4a9c-8327-39d6d6d2a0af tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:55:02.304159 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0d0c28c-3479-4a9c-8327-39d6d6d2a0af tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:55:02.436949 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b0d0c28c-3479-4a9c-8327-39d6d6d2a0af tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6751185089fc469eb6d5db2e13058d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59500d959c9f445eb7b4bb07c464cbb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:55:02.444671 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b0d0c28c-3479-4a9c-8327-39d6d6d2a0af tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] 10.222.0.13 "GET /compute/v2.1/servers/262f928c-b8f2-4c0d-9f20-6e90690e0108" status: 200 len: 1374 microversion: 2.1 time: 0.155374 Oct 30 02:55:02.445242 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4259/8179] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:55:02 2022] GET /compute/v2.1/servers/262f928c-b8f2-4c0d-9f20-6e90690e0108 => generated 1374 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:55:03.467243 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1efc1337-8a13-4afb-b681-05d8d2746d49 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:55:03.468591 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1efc1337-8a13-4afb-b681-05d8d2746d49 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] [instance: 262f928c-b8f2-4c0d-9f20-6e90690e0108] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:55:03.475744 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1efc1337-8a13-4afb-b681-05d8d2746d49 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:55:03.476271 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1efc1337-8a13-4afb-b681-05d8d2746d49 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:55:03.477257 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1efc1337-8a13-4afb-b681-05d8d2746d49 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:55:03.484483 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1efc1337-8a13-4afb-b681-05d8d2746d49 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:55:03.484483 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1efc1337-8a13-4afb-b681-05d8d2746d49 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:55:03.484483 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1efc1337-8a13-4afb-b681-05d8d2746d49 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:55:03.611302 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-1efc1337-8a13-4afb-b681-05d8d2746d49 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6751185089fc469eb6d5db2e13058d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59500d959c9f445eb7b4bb07c464cbb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:55:03.619889 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1efc1337-8a13-4afb-b681-05d8d2746d49 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] 10.222.0.13 "GET /compute/v2.1/servers/262f928c-b8f2-4c0d-9f20-6e90690e0108" status: 200 len: 1374 microversion: 2.1 time: 0.156596 Oct 30 02:55:03.620473 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3921/8180] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:55:03 2022] GET /compute/v2.1/servers/262f928c-b8f2-4c0d-9f20-6e90690e0108 => generated 1374 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:55:04.644509 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5462cfdf-c40c-4d93-b9db-9a2cca422be0 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:55:04.645139 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5462cfdf-c40c-4d93-b9db-9a2cca422be0 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] [instance: 262f928c-b8f2-4c0d-9f20-6e90690e0108] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:55:04.652990 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5462cfdf-c40c-4d93-b9db-9a2cca422be0 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:55:04.653536 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5462cfdf-c40c-4d93-b9db-9a2cca422be0 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:55:04.653993 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5462cfdf-c40c-4d93-b9db-9a2cca422be0 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:55:04.654710 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5462cfdf-c40c-4d93-b9db-9a2cca422be0 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:55:04.655178 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5462cfdf-c40c-4d93-b9db-9a2cca422be0 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:55:04.655618 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5462cfdf-c40c-4d93-b9db-9a2cca422be0 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:55:04.787853 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-5462cfdf-c40c-4d93-b9db-9a2cca422be0 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6751185089fc469eb6d5db2e13058d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59500d959c9f445eb7b4bb07c464cbb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:55:04.796404 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5462cfdf-c40c-4d93-b9db-9a2cca422be0 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] 10.222.0.13 "GET /compute/v2.1/servers/262f928c-b8f2-4c0d-9f20-6e90690e0108" status: 200 len: 1374 microversion: 2.1 time: 0.156658 Oct 30 02:55:04.797092 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4260/8181] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:55:04 2022] GET /compute/v2.1/servers/262f928c-b8f2-4c0d-9f20-6e90690e0108 => generated 1374 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:55:05.819239 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b3385d53-b281-4f62-9abc-a950fcfcad20 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:55:05.819790 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b3385d53-b281-4f62-9abc-a950fcfcad20 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] [instance: 262f928c-b8f2-4c0d-9f20-6e90690e0108] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:55:05.822713 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=6 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:55:05.827724 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3385d53-b281-4f62-9abc-a950fcfcad20 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:55:05.828216 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3385d53-b281-4f62-9abc-a950fcfcad20 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:55:05.832571 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3385d53-b281-4f62-9abc-a950fcfcad20 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:55:05.832571 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3385d53-b281-4f62-9abc-a950fcfcad20 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:55:05.832571 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3385d53-b281-4f62-9abc-a950fcfcad20 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:55:05.832571 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b3385d53-b281-4f62-9abc-a950fcfcad20 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:55:05.967129 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b3385d53-b281-4f62-9abc-a950fcfcad20 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6751185089fc469eb6d5db2e13058d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59500d959c9f445eb7b4bb07c464cbb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:55:05.975159 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b3385d53-b281-4f62-9abc-a950fcfcad20 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] 10.222.0.13 "GET /compute/v2.1/servers/262f928c-b8f2-4c0d-9f20-6e90690e0108" status: 200 len: 1374 microversion: 2.1 time: 0.159835 Oct 30 02:55:05.975743 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3922/8182] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:55:05 2022] GET /compute/v2.1/servers/262f928c-b8f2-4c0d-9f20-6e90690e0108 => generated 1374 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:55:06.851112 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-93f11683-798e-4116-ab55-27ffaac90e2d req-2c3c9910-74ff-4020-a1e8-f01ab8aac8f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "262f928c-b8f2-4c0d-9f20-6e90690e0108", "name": "network-vif-plugged", "status": "completed", "tag": "4a880a91-048a-4faf-b8e3-3d938e672eaa"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:55:06.856216 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:55:06.857760 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=8 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:55:06.862960 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-93f11683-798e-4116-ab55-27ffaac90e2d req-2c3c9910-74ff-4020-a1e8-f01ab8aac8f9 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:55:06.863450 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-93f11683-798e-4116-ab55-27ffaac90e2d req-2c3c9910-74ff-4020-a1e8-f01ab8aac8f9 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:55:06.863893 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-93f11683-798e-4116-ab55-27ffaac90e2d req-2c3c9910-74ff-4020-a1e8-f01ab8aac8f9 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:55:06.875178 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-93f11683-798e-4116-ab55-27ffaac90e2d req-2c3c9910-74ff-4020-a1e8-f01ab8aac8f9 service nova] Creating event network-vif-plugged:4a880a91-048a-4faf-b8e3-3d938e672eaa for instance 262f928c-b8f2-4c0d-9f20-6e90690e0108 on n-h2-master-1 Oct 30 02:55:06.880253 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-93f11683-798e-4116-ab55-27ffaac90e2d req-2c3c9910-74ff-4020-a1e8-f01ab8aac8f9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032927 Oct 30 02:55:06.880846 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4261/8183] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:55:06.999120 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4a6e3532-bc62-4874-9066-e43693b77c77 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:55:06.999738 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4a6e3532-bc62-4874-9066-e43693b77c77 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] [instance: 262f928c-b8f2-4c0d-9f20-6e90690e0108] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:55:07.006870 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4a6e3532-bc62-4874-9066-e43693b77c77 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:55:07.007360 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4a6e3532-bc62-4874-9066-e43693b77c77 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:55:07.007844 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4a6e3532-bc62-4874-9066-e43693b77c77 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:55:07.009258 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4a6e3532-bc62-4874-9066-e43693b77c77 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:55:07.009742 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4a6e3532-bc62-4874-9066-e43693b77c77 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:55:07.010163 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4a6e3532-bc62-4874-9066-e43693b77c77 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:55:07.143829 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-4a6e3532-bc62-4874-9066-e43693b77c77 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6751185089fc469eb6d5db2e13058d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59500d959c9f445eb7b4bb07c464cbb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:55:07.152063 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4a6e3532-bc62-4874-9066-e43693b77c77 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] 10.222.0.13 "GET /compute/v2.1/servers/262f928c-b8f2-4c0d-9f20-6e90690e0108" status: 200 len: 1374 microversion: 2.1 time: 0.156913 Oct 30 02:55:07.152659 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3923/8184] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:55:06 2022] GET /compute/v2.1/servers/262f928c-b8f2-4c0d-9f20-6e90690e0108 => generated 1374 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:55:08.177612 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-de077a97-a97b-4107-a59a-f2e266cf1821 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:55:08.178365 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-de077a97-a97b-4107-a59a-f2e266cf1821 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] [instance: 262f928c-b8f2-4c0d-9f20-6e90690e0108] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:55:08.185530 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-de077a97-a97b-4107-a59a-f2e266cf1821 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:55:08.186039 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-de077a97-a97b-4107-a59a-f2e266cf1821 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:55:08.186486 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-de077a97-a97b-4107-a59a-f2e266cf1821 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:55:08.187200 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-de077a97-a97b-4107-a59a-f2e266cf1821 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:55:08.187675 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-de077a97-a97b-4107-a59a-f2e266cf1821 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:55:08.188119 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-de077a97-a97b-4107-a59a-f2e266cf1821 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:55:08.320199 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-de077a97-a97b-4107-a59a-f2e266cf1821 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6751185089fc469eb6d5db2e13058d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59500d959c9f445eb7b4bb07c464cbb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:55:08.328622 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-de077a97-a97b-4107-a59a-f2e266cf1821 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] 10.222.0.13 "GET /compute/v2.1/servers/262f928c-b8f2-4c0d-9f20-6e90690e0108" status: 200 len: 1559 microversion: 2.1 time: 0.157083 Oct 30 02:55:08.329183 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4262/8185] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:55:08 2022] GET /compute/v2.1/servers/262f928c-b8f2-4c0d-9f20-6e90690e0108 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:55:08.350690 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-96283feb-d5c0-459e-bdeb-1de62d4325cb tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:55:08.351379 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-96283feb-d5c0-459e-bdeb-1de62d4325cb tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] [instance: 262f928c-b8f2-4c0d-9f20-6e90690e0108] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:55:08.358101 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-96283feb-d5c0-459e-bdeb-1de62d4325cb tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:55:08.358592 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-96283feb-d5c0-459e-bdeb-1de62d4325cb tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:55:08.359026 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-96283feb-d5c0-459e-bdeb-1de62d4325cb tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:55:08.359719 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-96283feb-d5c0-459e-bdeb-1de62d4325cb tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:55:08.360171 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-96283feb-d5c0-459e-bdeb-1de62d4325cb tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:55:08.360593 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-96283feb-d5c0-459e-bdeb-1de62d4325cb tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:55:08.497506 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-96283feb-d5c0-459e-bdeb-1de62d4325cb tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6751185089fc469eb6d5db2e13058d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59500d959c9f445eb7b4bb07c464cbb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:55:08.505379 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-96283feb-d5c0-459e-bdeb-1de62d4325cb tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] 10.222.0.13 "GET /compute/v2.1/servers/262f928c-b8f2-4c0d-9f20-6e90690e0108" status: 200 len: 1559 microversion: 2.1 time: 0.158669 Oct 30 02:55:08.505956 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3924/8186] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:55:08 2022] GET /compute/v2.1/servers/262f928c-b8f2-4c0d-9f20-6e90690e0108 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:55:10.443335 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-89680a98-d36c-4b05-be04-f3d973f09ce7 req-a83f2ccd-2621-4089-a537-1a6d90445433 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "262f928c-b8f2-4c0d-9f20-6e90690e0108", "tag": "4a880a91-048a-4faf-b8e3-3d938e672eaa"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:55:10.453466 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-89680a98-d36c-4b05-be04-f3d973f09ce7 req-a83f2ccd-2621-4089-a537-1a6d90445433 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:55:10.454093 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-89680a98-d36c-4b05-be04-f3d973f09ce7 req-a83f2ccd-2621-4089-a537-1a6d90445433 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:55:10.454544 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-89680a98-d36c-4b05-be04-f3d973f09ce7 req-a83f2ccd-2621-4089-a537-1a6d90445433 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:55:10.466589 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-89680a98-d36c-4b05-be04-f3d973f09ce7 req-a83f2ccd-2621-4089-a537-1a6d90445433 service nova] Creating event network-changed:4a880a91-048a-4faf-b8e3-3d938e672eaa for instance 262f928c-b8f2-4c0d-9f20-6e90690e0108 on n-h2-master-1 Oct 30 02:55:10.473161 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-89680a98-d36c-4b05-be04-f3d973f09ce7 req-a83f2ccd-2621-4089-a537-1a6d90445433 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097372 Oct 30 02:55:10.478886 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4263/8187] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:55:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:57:02.890317 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:57:02.891205 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=38 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:57:02.892297 n-d-master-1 devstack@n-api.service[121103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 30 02:57:02.892486 n-d-master-1 devstack@n-api.service[121103]: Sun Oct 30 02:57:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/262f928c-b8f2-4c0d-9f20-6e90690e0108/action (ip 10.222.0.13) !!! Oct 30 02:57:02.902353 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-dc44dadb-1e16-487c-985d-5bd251962993 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1132198903"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:57:02.902353 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-dc44dadb-1e16-487c-985d-5bd251962993 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] [instance: 262f928c-b8f2-4c0d-9f20-6e90690e0108] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:57:02.911379 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc44dadb-1e16-487c-985d-5bd251962993 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:57:02.911874 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc44dadb-1e16-487c-985d-5bd251962993 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:57:02.912343 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc44dadb-1e16-487c-985d-5bd251962993 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:57:02.913075 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc44dadb-1e16-487c-985d-5bd251962993 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:57:02.913563 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc44dadb-1e16-487c-985d-5bd251962993 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:57:02.914061 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc44dadb-1e16-487c-985d-5bd251962993 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:57:03.301876 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-dc44dadb-1e16-487c-985d-5bd251962993 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] 10.222.0.13 "POST /compute/v2.1/servers/262f928c-b8f2-4c0d-9f20-6e90690e0108/action" status: 202 len: 0 microversion: 2.1 time: 0.413302 Oct 30 02:57:03.302609 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3925/8188] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 02:57:02 2022] POST /compute/v2.1/servers/262f928c-b8f2-4c0d-9f20-6e90690e0108/action => generated 0 bytes in 415 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 30 02:57:09.344224 n-d-master-1 devstack@n-api.service[121102]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8caffca0-53fa-4143-8e03-000c8bb53286] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 30 02:57:09.345057 n-d-master-1 devstack@n-api.service[121102]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ea6ec045-ee0c-4212-8fa5-a40465026485] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 30 02:57:09.345750 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:57:09.347005 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=36 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:57:09.348040 n-d-master-1 devstack@n-api.service[121102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 30 02:57:09.348190 n-d-master-1 devstack@n-api.service[121102]: Sun Oct 30 02:57:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.13) !!! Oct 30 02:57:09.349946 n-d-master-1 devstack@n-api.service[121102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 30 02:57:09.350326 n-d-master-1 devstack@n-api.service[121102]: Sun Oct 30 02:57:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.13) !!! Oct 30 02:57:09.360767 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-ed7022c9-8bba-4973-9750-29c068479a04 req-410ea324-9a83-4280-851b-917485961f2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "262f928c-b8f2-4c0d-9f20-6e90690e0108", "name": "network-vif-plugged", "status": "completed", "tag": "4a880a91-048a-4faf-b8e3-3d938e672eaa"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:57:09.376143 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ed7022c9-8bba-4973-9750-29c068479a04 req-410ea324-9a83-4280-851b-917485961f2d service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:57:09.377684 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ed7022c9-8bba-4973-9750-29c068479a04 req-410ea324-9a83-4280-851b-917485961f2d service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:57:09.378355 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ed7022c9-8bba-4973-9750-29c068479a04 req-410ea324-9a83-4280-851b-917485961f2d service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:57:09.390182 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-ed7022c9-8bba-4973-9750-29c068479a04 req-410ea324-9a83-4280-851b-917485961f2d service nova] Creating event network-vif-plugged:4a880a91-048a-4faf-b8e3-3d938e672eaa for instance 262f928c-b8f2-4c0d-9f20-6e90690e0108 on n-h2-master-1 Oct 30 02:57:09.398013 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-ed7022c9-8bba-4973-9750-29c068479a04 req-410ea324-9a83-4280-851b-917485961f2d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055340 Oct 30 02:57:09.399331 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4264/8189] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:57:19.004650 n-d-master-1 devstack@n-api.service[121103]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b7c2a62f-729f-40a5-8849-28eec979ab4a] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 30 02:57:19.005766 n-d-master-1 devstack@n-api.service[121103]: ERROR oslo.messaging._drivers.impl_rabbit [-] [975c5eab-3cac-4f3e-8d59-9cc73a7448cc] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 30 02:57:19.006306 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:57:19.007063 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:57:19.011299 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d91535a6-ce85-4efb-a853-3d46c33a4a2c tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1983372284", "imageRef": "7cc3e428-2e23-4a6d-b9c7-8cf85c6f3271", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-261469712", "security_groups": [{"name": "tempest-secgroup-smoke-1946260264"}], "networks": [{"uuid": "1e1908df-31b5-4da9-abfd-5dce52465d93"}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:57:19.124245 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-d91535a6-ce85-4efb-a853-3d46c33a4a2c tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] validate_networks() for [('1e1908df-31b5-4da9-abfd-5dce52465d93', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 02:57:19.541318 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-d91535a6-ce85-4efb-a853-3d46c33a4a2c tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 02:57:19.541764 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-d91535a6-ce85-4efb-a853-3d46c33a4a2c tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 02:57:19.542239 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-d91535a6-ce85-4efb-a853-3d46c33a4a2c tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 02:57:19.542650 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-d91535a6-ce85-4efb-a853-3d46c33a4a2c tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 02:57:19.543061 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-d91535a6-ce85-4efb-a853-3d46c33a4a2c tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 02:57:19.552190 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d91535a6-ce85-4efb-a853-3d46c33a4a2c tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:57:19.552673 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d91535a6-ce85-4efb-a853-3d46c33a4a2c tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:57:19.553108 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d91535a6-ce85-4efb-a853-3d46c33a4a2c tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:57:19.561442 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d91535a6-ce85-4efb-a853-3d46c33a4a2c tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:57:19.561442 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d91535a6-ce85-4efb-a853-3d46c33a4a2c tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:57:19.561442 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d91535a6-ce85-4efb-a853-3d46c33a4a2c tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:57:19.571259 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-d91535a6-ce85-4efb-a853-3d46c33a4a2c tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Getting quotas for project 59500d959c9f445eb7b4bb07c464cbb4. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 02:57:19.576480 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.quota [None req-d91535a6-ce85-4efb-a853-3d46c33a4a2c tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Getting quotas for user 6751185089fc469eb6d5db2e13058d15 and project 59500d959c9f445eb7b4bb07c464cbb4. Resources: {'ram', 'instances', 'cores'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 02:57:19.589303 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d91535a6-ce85-4efb-a853-3d46c33a4a2c tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 02:57:19.591811 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d91535a6-ce85-4efb-a853-3d46c33a4a2c tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] [instance: 5b3f7d56-1a77-4b7e-a829-168707450110] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7cc3e428-2e23-4a6d-b9c7-8cf85c6f3271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 02:57:19.686507 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d91535a6-ce85-4efb-a853-3d46c33a4a2c tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.683227 Oct 30 02:57:19.691341 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3926/8190] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 02:57:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 02:57:19.701363 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3c3af341-847b-4f42-a6a0-f86767f165eb tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:57:19.702496 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3c3af341-847b-4f42-a6a0-f86767f165eb tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] [instance: 5b3f7d56-1a77-4b7e-a829-168707450110] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:57:19.715133 n-d-master-1 devstack@n-api.service[121102]: INFO oslo.messaging._drivers.impl_rabbit [-] [8caffca0-53fa-4143-8e03-000c8bb53286] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 34010. Oct 30 02:57:19.722379 n-d-master-1 devstack@n-api.service[121102]: INFO oslo.messaging._drivers.impl_rabbit [-] [ea6ec045-ee0c-4212-8fa5-a40465026485] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 34012. Oct 30 02:57:19.769188 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-3c3af341-847b-4f42-a6a0-f86767f165eb tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6751185089fc469eb6d5db2e13058d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59500d959c9f445eb7b4bb07c464cbb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:57:19.778353 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3c3af341-847b-4f42-a6a0-f86767f165eb tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] 10.222.0.13 "GET /compute/v2.1/servers/5b3f7d56-1a77-4b7e-a829-168707450110" status: 200 len: 1248 microversion: 2.1 time: 0.083622 Oct 30 02:57:19.779123 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4265/8191] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:57:19 2022] GET /compute/v2.1/servers/5b3f7d56-1a77-4b7e-a829-168707450110 => generated 1248 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:57:20.803868 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2d69685b-b47d-4af9-9067-d7c0e2eb3148 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:57:20.804492 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2d69685b-b47d-4af9-9067-d7c0e2eb3148 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] [instance: 5b3f7d56-1a77-4b7e-a829-168707450110] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:57:20.815002 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2d69685b-b47d-4af9-9067-d7c0e2eb3148 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:57:20.815491 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2d69685b-b47d-4af9-9067-d7c0e2eb3148 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:57:20.815934 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2d69685b-b47d-4af9-9067-d7c0e2eb3148 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:57:20.816642 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2d69685b-b47d-4af9-9067-d7c0e2eb3148 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:57:20.817098 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2d69685b-b47d-4af9-9067-d7c0e2eb3148 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:57:20.818071 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2d69685b-b47d-4af9-9067-d7c0e2eb3148 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:57:20.818850 n-d-master-1 devstack@n-api.service[121103]: INFO oslo.messaging._drivers.impl_rabbit [-] [975c5eab-3cac-4f3e-8d59-9cc73a7448cc] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 34026. Oct 30 02:57:20.821928 n-d-master-1 devstack@n-api.service[121103]: INFO oslo.messaging._drivers.impl_rabbit [-] [b7c2a62f-729f-40a5-8849-28eec979ab4a] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 34024. Oct 30 02:57:20.885427 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-2d69685b-b47d-4af9-9067-d7c0e2eb3148 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6751185089fc469eb6d5db2e13058d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59500d959c9f445eb7b4bb07c464cbb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:57:20.894751 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2d69685b-b47d-4af9-9067-d7c0e2eb3148 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] 10.222.0.13 "GET /compute/v2.1/servers/5b3f7d56-1a77-4b7e-a829-168707450110" status: 200 len: 1244 microversion: 2.1 time: 0.097094 Oct 30 02:57:20.895788 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3927/8192] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:57:20 2022] GET /compute/v2.1/servers/5b3f7d56-1a77-4b7e-a829-168707450110 => generated 1244 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:57:21.401680 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-dbc0e8e2-53a3-4958-af22-cbbba693384c req-db1374ee-75e3-4bd8-ad96-4727f88cf4f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "262f928c-b8f2-4c0d-9f20-6e90690e0108", "name": "network-vif-unplugged", "status": "completed", "tag": "4a880a91-048a-4faf-b8e3-3d938e672eaa"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:57:21.411820 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-dbc0e8e2-53a3-4958-af22-cbbba693384c req-db1374ee-75e3-4bd8-ad96-4727f88cf4f3 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:57:21.412185 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-dbc0e8e2-53a3-4958-af22-cbbba693384c req-db1374ee-75e3-4bd8-ad96-4727f88cf4f3 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:57:21.412627 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-dbc0e8e2-53a3-4958-af22-cbbba693384c req-db1374ee-75e3-4bd8-ad96-4727f88cf4f3 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:57:21.429085 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-dbc0e8e2-53a3-4958-af22-cbbba693384c req-db1374ee-75e3-4bd8-ad96-4727f88cf4f3 service nova] Creating event network-vif-unplugged:4a880a91-048a-4faf-b8e3-3d938e672eaa for instance 262f928c-b8f2-4c0d-9f20-6e90690e0108 on n-h2-master-1 Oct 30 02:57:21.434239 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-dbc0e8e2-53a3-4958-af22-cbbba693384c req-db1374ee-75e3-4bd8-ad96-4727f88cf4f3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106165 Oct 30 02:57:21.435100 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4266/8193] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:57:21.919193 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-32e84423-1cad-4c62-819f-d914e3366ed2 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:57:21.919825 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-32e84423-1cad-4c62-819f-d914e3366ed2 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] [instance: 5b3f7d56-1a77-4b7e-a829-168707450110] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:57:21.927153 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-32e84423-1cad-4c62-819f-d914e3366ed2 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:57:21.927652 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-32e84423-1cad-4c62-819f-d914e3366ed2 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:57:21.928102 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-32e84423-1cad-4c62-819f-d914e3366ed2 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:57:21.928819 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-32e84423-1cad-4c62-819f-d914e3366ed2 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:57:21.929282 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-32e84423-1cad-4c62-819f-d914e3366ed2 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:57:21.929743 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-32e84423-1cad-4c62-819f-d914e3366ed2 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:57:21.996901 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-32e84423-1cad-4c62-819f-d914e3366ed2 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6751185089fc469eb6d5db2e13058d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59500d959c9f445eb7b4bb07c464cbb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:57:22.005435 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-32e84423-1cad-4c62-819f-d914e3366ed2 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] 10.222.0.13 "GET /compute/v2.1/servers/5b3f7d56-1a77-4b7e-a829-168707450110" status: 200 len: 1318 microversion: 2.1 time: 0.090316 Oct 30 02:57:22.006023 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3928/8194] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:57:21 2022] GET /compute/v2.1/servers/5b3f7d56-1a77-4b7e-a829-168707450110 => generated 1318 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:57:23.029617 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-181502e9-6013-4eef-b782-d85a03171439 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:57:23.030414 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-181502e9-6013-4eef-b782-d85a03171439 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] [instance: 5b3f7d56-1a77-4b7e-a829-168707450110] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:57:23.037787 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-181502e9-6013-4eef-b782-d85a03171439 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:57:23.038466 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-181502e9-6013-4eef-b782-d85a03171439 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:57:23.039064 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-181502e9-6013-4eef-b782-d85a03171439 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:57:23.039833 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-181502e9-6013-4eef-b782-d85a03171439 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:57:23.040330 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-181502e9-6013-4eef-b782-d85a03171439 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:57:23.040767 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-181502e9-6013-4eef-b782-d85a03171439 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:57:23.201493 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-181502e9-6013-4eef-b782-d85a03171439 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6751185089fc469eb6d5db2e13058d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59500d959c9f445eb7b4bb07c464cbb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:57:23.210759 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-181502e9-6013-4eef-b782-d85a03171439 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] 10.222.0.13 "GET /compute/v2.1/servers/5b3f7d56-1a77-4b7e-a829-168707450110" status: 200 len: 1374 microversion: 2.1 time: 0.185706 Oct 30 02:57:23.211869 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4267/8195] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:57:23 2022] GET /compute/v2.1/servers/5b3f7d56-1a77-4b7e-a829-168707450110 => generated 1374 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:57:24.234967 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-09b32a1b-579f-4602-bf41-2008bce8ea98 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:57:24.235590 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-09b32a1b-579f-4602-bf41-2008bce8ea98 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] [instance: 5b3f7d56-1a77-4b7e-a829-168707450110] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:57:24.243012 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-09b32a1b-579f-4602-bf41-2008bce8ea98 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:57:24.243508 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-09b32a1b-579f-4602-bf41-2008bce8ea98 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:57:24.243949 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-09b32a1b-579f-4602-bf41-2008bce8ea98 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:57:24.244656 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-09b32a1b-579f-4602-bf41-2008bce8ea98 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:57:24.245119 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-09b32a1b-579f-4602-bf41-2008bce8ea98 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:57:24.245574 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-09b32a1b-579f-4602-bf41-2008bce8ea98 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:57:24.389513 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-09b32a1b-579f-4602-bf41-2008bce8ea98 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6751185089fc469eb6d5db2e13058d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59500d959c9f445eb7b4bb07c464cbb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:57:24.398513 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-09b32a1b-579f-4602-bf41-2008bce8ea98 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] 10.222.0.13 "GET /compute/v2.1/servers/5b3f7d56-1a77-4b7e-a829-168707450110" status: 200 len: 1374 microversion: 2.1 time: 0.167484 Oct 30 02:57:24.399100 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3929/8196] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:57:24 2022] GET /compute/v2.1/servers/5b3f7d56-1a77-4b7e-a829-168707450110 => generated 1374 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:57:25.421823 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ce1b51dd-540b-47dc-bf75-8f8fe463922f tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:57:25.422506 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ce1b51dd-540b-47dc-bf75-8f8fe463922f tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] [instance: 5b3f7d56-1a77-4b7e-a829-168707450110] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:57:25.431499 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce1b51dd-540b-47dc-bf75-8f8fe463922f tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:57:25.432019 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce1b51dd-540b-47dc-bf75-8f8fe463922f tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:57:25.432478 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce1b51dd-540b-47dc-bf75-8f8fe463922f tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:57:25.433213 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce1b51dd-540b-47dc-bf75-8f8fe463922f tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:57:25.433716 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce1b51dd-540b-47dc-bf75-8f8fe463922f tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:57:25.434162 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce1b51dd-540b-47dc-bf75-8f8fe463922f tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:57:25.583900 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ce1b51dd-540b-47dc-bf75-8f8fe463922f tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6751185089fc469eb6d5db2e13058d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59500d959c9f445eb7b4bb07c464cbb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:57:25.592212 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ce1b51dd-540b-47dc-bf75-8f8fe463922f tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] 10.222.0.13 "GET /compute/v2.1/servers/5b3f7d56-1a77-4b7e-a829-168707450110" status: 200 len: 1374 microversion: 2.1 time: 0.174460 Oct 30 02:57:25.592989 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4268/8197] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:57:25 2022] GET /compute/v2.1/servers/5b3f7d56-1a77-4b7e-a829-168707450110 => generated 1374 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:57:26.616683 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b7f52ca9-dd48-407a-91c9-4b174c8a4ece tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:57:26.618048 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b7f52ca9-dd48-407a-91c9-4b174c8a4ece tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] [instance: 5b3f7d56-1a77-4b7e-a829-168707450110] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:57:26.626088 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b7f52ca9-dd48-407a-91c9-4b174c8a4ece tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:57:26.626917 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b7f52ca9-dd48-407a-91c9-4b174c8a4ece tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:57:26.628250 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b7f52ca9-dd48-407a-91c9-4b174c8a4ece tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:57:26.629215 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b7f52ca9-dd48-407a-91c9-4b174c8a4ece tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:57:26.629904 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b7f52ca9-dd48-407a-91c9-4b174c8a4ece tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:57:26.630530 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b7f52ca9-dd48-407a-91c9-4b174c8a4ece tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:57:26.775256 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b7f52ca9-dd48-407a-91c9-4b174c8a4ece tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6751185089fc469eb6d5db2e13058d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59500d959c9f445eb7b4bb07c464cbb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:57:26.784789 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b7f52ca9-dd48-407a-91c9-4b174c8a4ece tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] 10.222.0.13 "GET /compute/v2.1/servers/5b3f7d56-1a77-4b7e-a829-168707450110" status: 200 len: 1374 microversion: 2.1 time: 0.172117 Oct 30 02:57:26.785423 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3930/8198] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:57:26 2022] GET /compute/v2.1/servers/5b3f7d56-1a77-4b7e-a829-168707450110 => generated 1374 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:57:27.808412 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b8ae767f-465a-4a26-aea5-bf33d9aed2c8 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:57:27.809531 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b8ae767f-465a-4a26-aea5-bf33d9aed2c8 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] [instance: 5b3f7d56-1a77-4b7e-a829-168707450110] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:57:27.817662 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b8ae767f-465a-4a26-aea5-bf33d9aed2c8 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:57:27.818205 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b8ae767f-465a-4a26-aea5-bf33d9aed2c8 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:57:27.818721 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b8ae767f-465a-4a26-aea5-bf33d9aed2c8 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:57:27.819909 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b8ae767f-465a-4a26-aea5-bf33d9aed2c8 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:57:27.820454 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b8ae767f-465a-4a26-aea5-bf33d9aed2c8 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:57:27.820992 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b8ae767f-465a-4a26-aea5-bf33d9aed2c8 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:57:27.970026 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-b8ae767f-465a-4a26-aea5-bf33d9aed2c8 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6751185089fc469eb6d5db2e13058d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59500d959c9f445eb7b4bb07c464cbb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:57:27.983335 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b8ae767f-465a-4a26-aea5-bf33d9aed2c8 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] 10.222.0.13 "GET /compute/v2.1/servers/5b3f7d56-1a77-4b7e-a829-168707450110" status: 200 len: 1374 microversion: 2.1 time: 0.178710 Oct 30 02:57:27.983954 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4269/8199] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:57:27 2022] GET /compute/v2.1/servers/5b3f7d56-1a77-4b7e-a829-168707450110 => generated 1374 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:57:29.007205 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-642fb051-8784-4ff5-9e45-0b64be0b3567 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:57:29.007934 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-642fb051-8784-4ff5-9e45-0b64be0b3567 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] [instance: 5b3f7d56-1a77-4b7e-a829-168707450110] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:57:29.014895 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-642fb051-8784-4ff5-9e45-0b64be0b3567 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:57:29.015386 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-642fb051-8784-4ff5-9e45-0b64be0b3567 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:57:29.015944 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-642fb051-8784-4ff5-9e45-0b64be0b3567 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:57:29.016659 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-642fb051-8784-4ff5-9e45-0b64be0b3567 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:57:29.017118 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-642fb051-8784-4ff5-9e45-0b64be0b3567 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:57:29.017574 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-642fb051-8784-4ff5-9e45-0b64be0b3567 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:57:29.156890 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-642fb051-8784-4ff5-9e45-0b64be0b3567 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6751185089fc469eb6d5db2e13058d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59500d959c9f445eb7b4bb07c464cbb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:57:29.166653 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-642fb051-8784-4ff5-9e45-0b64be0b3567 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] 10.222.0.13 "GET /compute/v2.1/servers/5b3f7d56-1a77-4b7e-a829-168707450110" status: 200 len: 1374 microversion: 2.1 time: 0.163385 Oct 30 02:57:29.179864 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3931/8200] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:57:29 2022] GET /compute/v2.1/servers/5b3f7d56-1a77-4b7e-a829-168707450110 => generated 1374 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:57:30.191008 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-025bde36-abc9-4b32-8e83-5a4b61ff61dc tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:57:30.191631 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-025bde36-abc9-4b32-8e83-5a4b61ff61dc tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] [instance: 5b3f7d56-1a77-4b7e-a829-168707450110] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:57:30.194513 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:57:30.199340 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-025bde36-abc9-4b32-8e83-5a4b61ff61dc tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:57:30.199841 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-025bde36-abc9-4b32-8e83-5a4b61ff61dc tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:57:30.200288 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-025bde36-abc9-4b32-8e83-5a4b61ff61dc tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:57:30.200997 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-025bde36-abc9-4b32-8e83-5a4b61ff61dc tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:57:30.201492 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-025bde36-abc9-4b32-8e83-5a4b61ff61dc tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:57:30.201931 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-025bde36-abc9-4b32-8e83-5a4b61ff61dc tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:57:30.450431 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-025bde36-abc9-4b32-8e83-5a4b61ff61dc tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6751185089fc469eb6d5db2e13058d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59500d959c9f445eb7b4bb07c464cbb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:57:30.458222 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-025bde36-abc9-4b32-8e83-5a4b61ff61dc tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] 10.222.0.13 "GET /compute/v2.1/servers/5b3f7d56-1a77-4b7e-a829-168707450110" status: 200 len: 1374 microversion: 2.1 time: 0.271653 Oct 30 02:57:30.458805 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4270/8201] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:57:30 2022] GET /compute/v2.1/servers/5b3f7d56-1a77-4b7e-a829-168707450110 => generated 1374 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:57:31.052051 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-c4b429ee-d6d0-4860-b965-16e45ae901e0 req-41f3061d-d76c-499f-95cb-578043ad725f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b3f7d56-1a77-4b7e-a829-168707450110", "tag": "d22a2bd2-96f2-4b23-bad7-aa4da5ee1934"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:57:31.057512 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:57:31.058195 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=6 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:57:31.064371 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-c4b429ee-d6d0-4860-b965-16e45ae901e0 req-41f3061d-d76c-499f-95cb-578043ad725f service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:57:31.067300 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-c4b429ee-d6d0-4860-b965-16e45ae901e0 req-41f3061d-d76c-499f-95cb-578043ad725f service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:57:31.067300 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-c4b429ee-d6d0-4860-b965-16e45ae901e0 req-41f3061d-d76c-499f-95cb-578043ad725f service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:57:31.077075 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-c4b429ee-d6d0-4860-b965-16e45ae901e0 req-41f3061d-d76c-499f-95cb-578043ad725f service nova] Creating event network-changed:d22a2bd2-96f2-4b23-bad7-aa4da5ee1934 for instance 5b3f7d56-1a77-4b7e-a829-168707450110 on n-h1-master-1 Oct 30 02:57:31.082029 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-c4b429ee-d6d0-4860-b965-16e45ae901e0 req-41f3061d-d76c-499f-95cb-578043ad725f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034293 Oct 30 02:57:31.082638 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3932/8202] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:57:31.481606 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fd14543a-2b65-4e8b-b74a-7bfd28d75246 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:57:31.482334 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fd14543a-2b65-4e8b-b74a-7bfd28d75246 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] [instance: 5b3f7d56-1a77-4b7e-a829-168707450110] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:57:31.490149 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fd14543a-2b65-4e8b-b74a-7bfd28d75246 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:57:31.490640 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fd14543a-2b65-4e8b-b74a-7bfd28d75246 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:57:31.491094 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fd14543a-2b65-4e8b-b74a-7bfd28d75246 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:57:31.491831 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fd14543a-2b65-4e8b-b74a-7bfd28d75246 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:57:31.492308 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fd14543a-2b65-4e8b-b74a-7bfd28d75246 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:57:31.492754 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fd14543a-2b65-4e8b-b74a-7bfd28d75246 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:57:31.699349 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-fd14543a-2b65-4e8b-b74a-7bfd28d75246 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6751185089fc469eb6d5db2e13058d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59500d959c9f445eb7b4bb07c464cbb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:57:31.707922 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fd14543a-2b65-4e8b-b74a-7bfd28d75246 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] 10.222.0.13 "GET /compute/v2.1/servers/5b3f7d56-1a77-4b7e-a829-168707450110" status: 200 len: 1374 microversion: 2.1 time: 0.230272 Oct 30 02:57:31.708499 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4271/8203] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:57:31 2022] GET /compute/v2.1/servers/5b3f7d56-1a77-4b7e-a829-168707450110 => generated 1374 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:57:32.732956 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5d200a00-cabf-43bd-9c88-909405a1b7ee tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:57:32.733697 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5d200a00-cabf-43bd-9c88-909405a1b7ee tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] [instance: 5b3f7d56-1a77-4b7e-a829-168707450110] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:57:32.741174 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5d200a00-cabf-43bd-9c88-909405a1b7ee tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:57:32.741700 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5d200a00-cabf-43bd-9c88-909405a1b7ee tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:57:32.742165 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5d200a00-cabf-43bd-9c88-909405a1b7ee tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:57:32.742845 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5d200a00-cabf-43bd-9c88-909405a1b7ee tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:57:32.743304 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5d200a00-cabf-43bd-9c88-909405a1b7ee tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:57:32.743733 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5d200a00-cabf-43bd-9c88-909405a1b7ee tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:57:32.882141 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-5d200a00-cabf-43bd-9c88-909405a1b7ee tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6751185089fc469eb6d5db2e13058d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59500d959c9f445eb7b4bb07c464cbb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:57:32.889951 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5d200a00-cabf-43bd-9c88-909405a1b7ee tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] 10.222.0.13 "GET /compute/v2.1/servers/5b3f7d56-1a77-4b7e-a829-168707450110" status: 200 len: 1374 microversion: 2.1 time: 0.162250 Oct 30 02:57:32.890533 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3933/8204] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:57:32 2022] GET /compute/v2.1/servers/5b3f7d56-1a77-4b7e-a829-168707450110 => generated 1374 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:57:33.914259 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-04ce7811-f9da-4f04-a946-33d2300f562c tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:57:33.914259 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-04ce7811-f9da-4f04-a946-33d2300f562c tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] [instance: 5b3f7d56-1a77-4b7e-a829-168707450110] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:57:33.921593 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04ce7811-f9da-4f04-a946-33d2300f562c tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:57:33.922137 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04ce7811-f9da-4f04-a946-33d2300f562c tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:57:33.922634 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04ce7811-f9da-4f04-a946-33d2300f562c tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:57:33.923430 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04ce7811-f9da-4f04-a946-33d2300f562c tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:57:33.923897 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04ce7811-f9da-4f04-a946-33d2300f562c tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:57:33.924336 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04ce7811-f9da-4f04-a946-33d2300f562c tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:57:34.065486 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-04ce7811-f9da-4f04-a946-33d2300f562c tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6751185089fc469eb6d5db2e13058d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59500d959c9f445eb7b4bb07c464cbb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:57:34.073803 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-04ce7811-f9da-4f04-a946-33d2300f562c tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] 10.222.0.13 "GET /compute/v2.1/servers/5b3f7d56-1a77-4b7e-a829-168707450110" status: 200 len: 1374 microversion: 2.1 time: 0.164137 Oct 30 02:57:34.074401 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4272/8205] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:57:33 2022] GET /compute/v2.1/servers/5b3f7d56-1a77-4b7e-a829-168707450110 => generated 1374 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:57:35.096929 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ed8e7876-78e4-42f1-bfed-99d0ff9c441b tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:57:35.097572 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ed8e7876-78e4-42f1-bfed-99d0ff9c441b tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] [instance: 5b3f7d56-1a77-4b7e-a829-168707450110] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:57:35.104401 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ed8e7876-78e4-42f1-bfed-99d0ff9c441b tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:57:35.104891 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ed8e7876-78e4-42f1-bfed-99d0ff9c441b tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:57:35.105323 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ed8e7876-78e4-42f1-bfed-99d0ff9c441b tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:57:35.106029 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ed8e7876-78e4-42f1-bfed-99d0ff9c441b tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:57:35.106484 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ed8e7876-78e4-42f1-bfed-99d0ff9c441b tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:57:35.106907 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ed8e7876-78e4-42f1-bfed-99d0ff9c441b tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:57:35.236179 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-ed8e7876-78e4-42f1-bfed-99d0ff9c441b tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6751185089fc469eb6d5db2e13058d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59500d959c9f445eb7b4bb07c464cbb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:57:35.244375 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ed8e7876-78e4-42f1-bfed-99d0ff9c441b tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] 10.222.0.13 "GET /compute/v2.1/servers/5b3f7d56-1a77-4b7e-a829-168707450110" status: 200 len: 1374 microversion: 2.1 time: 0.151404 Oct 30 02:57:35.244954 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3934/8206] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:57:35 2022] GET /compute/v2.1/servers/5b3f7d56-1a77-4b7e-a829-168707450110 => generated 1374 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:57:36.155395 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-73bde2be-4995-4c6c-a603-4947305ab777 req-52a1e6a1-a842-4e10-be58-bcda66e46958 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b3f7d56-1a77-4b7e-a829-168707450110", "name": "network-vif-plugged", "status": "completed", "tag": "d22a2bd2-96f2-4b23-bad7-aa4da5ee1934"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:57:36.166390 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-73bde2be-4995-4c6c-a603-4947305ab777 req-52a1e6a1-a842-4e10-be58-bcda66e46958 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:57:36.166875 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-73bde2be-4995-4c6c-a603-4947305ab777 req-52a1e6a1-a842-4e10-be58-bcda66e46958 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:57:36.167320 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-73bde2be-4995-4c6c-a603-4947305ab777 req-52a1e6a1-a842-4e10-be58-bcda66e46958 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:57:36.178181 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-73bde2be-4995-4c6c-a603-4947305ab777 req-52a1e6a1-a842-4e10-be58-bcda66e46958 service nova] Creating event network-vif-plugged:d22a2bd2-96f2-4b23-bad7-aa4da5ee1934 for instance 5b3f7d56-1a77-4b7e-a829-168707450110 on n-h1-master-1 Oct 30 02:57:36.183452 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-73bde2be-4995-4c6c-a603-4947305ab777 req-52a1e6a1-a842-4e10-be58-bcda66e46958 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031761 Oct 30 02:57:36.184069 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4273/8207] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:57:36.268080 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7043bd14-c4a6-4a45-bb53-f24055e1521a tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:57:36.268701 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7043bd14-c4a6-4a45-bb53-f24055e1521a tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] [instance: 5b3f7d56-1a77-4b7e-a829-168707450110] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:57:36.276666 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7043bd14-c4a6-4a45-bb53-f24055e1521a tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:57:36.277166 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7043bd14-c4a6-4a45-bb53-f24055e1521a tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:57:36.288121 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7043bd14-c4a6-4a45-bb53-f24055e1521a tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:57:36.289564 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7043bd14-c4a6-4a45-bb53-f24055e1521a tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:57:36.290060 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7043bd14-c4a6-4a45-bb53-f24055e1521a tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:57:36.290781 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7043bd14-c4a6-4a45-bb53-f24055e1521a tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:57:36.436262 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-7043bd14-c4a6-4a45-bb53-f24055e1521a tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6751185089fc469eb6d5db2e13058d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59500d959c9f445eb7b4bb07c464cbb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:57:36.444568 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7043bd14-c4a6-4a45-bb53-f24055e1521a tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] 10.222.0.13 "GET /compute/v2.1/servers/5b3f7d56-1a77-4b7e-a829-168707450110" status: 200 len: 1374 microversion: 2.1 time: 0.180839 Oct 30 02:57:36.445147 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3935/8208] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:57:36 2022] GET /compute/v2.1/servers/5b3f7d56-1a77-4b7e-a829-168707450110 => generated 1374 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:57:37.469607 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-97f6cf63-eaef-4c86-b949-4efb8c6952bf tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:57:37.470422 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-97f6cf63-eaef-4c86-b949-4efb8c6952bf tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] [instance: 5b3f7d56-1a77-4b7e-a829-168707450110] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:57:37.477756 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-97f6cf63-eaef-4c86-b949-4efb8c6952bf tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:57:37.478255 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-97f6cf63-eaef-4c86-b949-4efb8c6952bf tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:57:37.478710 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-97f6cf63-eaef-4c86-b949-4efb8c6952bf tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:57:37.479452 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-97f6cf63-eaef-4c86-b949-4efb8c6952bf tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:57:37.480018 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-97f6cf63-eaef-4c86-b949-4efb8c6952bf tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:57:37.480462 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-97f6cf63-eaef-4c86-b949-4efb8c6952bf tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:57:37.616530 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-97f6cf63-eaef-4c86-b949-4efb8c6952bf tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6751185089fc469eb6d5db2e13058d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59500d959c9f445eb7b4bb07c464cbb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:57:37.625039 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-97f6cf63-eaef-4c86-b949-4efb8c6952bf tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] 10.222.0.13 "GET /compute/v2.1/servers/5b3f7d56-1a77-4b7e-a829-168707450110" status: 200 len: 1374 microversion: 2.1 time: 0.160683 Oct 30 02:57:37.625649 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4274/8209] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:57:37 2022] GET /compute/v2.1/servers/5b3f7d56-1a77-4b7e-a829-168707450110 => generated 1374 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:57:38.649428 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b4da4bb0-e0e1-4fa5-b095-5c0223b1c1be tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:57:38.649983 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b4da4bb0-e0e1-4fa5-b095-5c0223b1c1be tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] [instance: 5b3f7d56-1a77-4b7e-a829-168707450110] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:57:38.656806 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4da4bb0-e0e1-4fa5-b095-5c0223b1c1be tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:57:38.657288 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4da4bb0-e0e1-4fa5-b095-5c0223b1c1be tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:57:38.657758 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4da4bb0-e0e1-4fa5-b095-5c0223b1c1be tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:57:38.658453 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4da4bb0-e0e1-4fa5-b095-5c0223b1c1be tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:57:38.658908 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4da4bb0-e0e1-4fa5-b095-5c0223b1c1be tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:57:38.659335 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4da4bb0-e0e1-4fa5-b095-5c0223b1c1be tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:57:38.793184 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-b4da4bb0-e0e1-4fa5-b095-5c0223b1c1be tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6751185089fc469eb6d5db2e13058d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59500d959c9f445eb7b4bb07c464cbb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:57:38.800969 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b4da4bb0-e0e1-4fa5-b095-5c0223b1c1be tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] 10.222.0.13 "GET /compute/v2.1/servers/5b3f7d56-1a77-4b7e-a829-168707450110" status: 200 len: 1559 microversion: 2.1 time: 0.156468 Oct 30 02:57:38.801612 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3936/8210] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:57:38 2022] GET /compute/v2.1/servers/5b3f7d56-1a77-4b7e-a829-168707450110 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:57:38.823224 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f9f82ac7-6f44-4373-ad7a-c916ac21ef95 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:57:38.823849 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f9f82ac7-6f44-4373-ad7a-c916ac21ef95 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] [instance: 5b3f7d56-1a77-4b7e-a829-168707450110] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:57:38.830733 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f9f82ac7-6f44-4373-ad7a-c916ac21ef95 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:57:38.831221 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f9f82ac7-6f44-4373-ad7a-c916ac21ef95 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:57:38.831663 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f9f82ac7-6f44-4373-ad7a-c916ac21ef95 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:57:38.832364 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f9f82ac7-6f44-4373-ad7a-c916ac21ef95 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:57:38.832824 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f9f82ac7-6f44-4373-ad7a-c916ac21ef95 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:57:38.833258 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f9f82ac7-6f44-4373-ad7a-c916ac21ef95 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:57:38.962237 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-f9f82ac7-6f44-4373-ad7a-c916ac21ef95 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6751185089fc469eb6d5db2e13058d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59500d959c9f445eb7b4bb07c464cbb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:57:38.969829 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f9f82ac7-6f44-4373-ad7a-c916ac21ef95 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] 10.222.0.13 "GET /compute/v2.1/servers/5b3f7d56-1a77-4b7e-a829-168707450110" status: 200 len: 1559 microversion: 2.1 time: 0.150948 Oct 30 02:57:38.970398 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4275/8211] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:57:38 2022] GET /compute/v2.1/servers/5b3f7d56-1a77-4b7e-a829-168707450110 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:57:41.128569 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-787e369d-def5-4018-997b-8edf82773a27 req-fdef0227-634c-41dd-9569-e80b45d3aaa2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b3f7d56-1a77-4b7e-a829-168707450110", "tag": "d22a2bd2-96f2-4b23-bad7-aa4da5ee1934"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:57:41.140398 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-787e369d-def5-4018-997b-8edf82773a27 req-fdef0227-634c-41dd-9569-e80b45d3aaa2 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:57:41.140945 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-787e369d-def5-4018-997b-8edf82773a27 req-fdef0227-634c-41dd-9569-e80b45d3aaa2 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:57:41.141420 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-787e369d-def5-4018-997b-8edf82773a27 req-fdef0227-634c-41dd-9569-e80b45d3aaa2 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:57:41.154153 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-787e369d-def5-4018-997b-8edf82773a27 req-fdef0227-634c-41dd-9569-e80b45d3aaa2 service nova] Creating event network-changed:d22a2bd2-96f2-4b23-bad7-aa4da5ee1934 for instance 5b3f7d56-1a77-4b7e-a829-168707450110 on n-h1-master-1 Oct 30 02:57:41.159307 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-787e369d-def5-4018-997b-8edf82773a27 req-fdef0227-634c-41dd-9569-e80b45d3aaa2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034727 Oct 30 02:57:41.159939 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3937/8212] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:59:09.320851 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=26 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:59:09.322089 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=54 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:59:09.326893 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6956e878-5387-423f-b1fa-5f8c532701d9 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1907326607"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:59:09.329231 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6956e878-5387-423f-b1fa-5f8c532701d9 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] [instance: 5b3f7d56-1a77-4b7e-a829-168707450110] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:59:09.335453 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6956e878-5387-423f-b1fa-5f8c532701d9 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:59:09.335962 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6956e878-5387-423f-b1fa-5f8c532701d9 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:59:09.336411 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6956e878-5387-423f-b1fa-5f8c532701d9 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:59:09.337117 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6956e878-5387-423f-b1fa-5f8c532701d9 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:59:09.337614 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6956e878-5387-423f-b1fa-5f8c532701d9 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:59:09.338088 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6956e878-5387-423f-b1fa-5f8c532701d9 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:59:09.698130 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6956e878-5387-423f-b1fa-5f8c532701d9 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] 10.222.0.13 "POST /compute/v2.1/servers/5b3f7d56-1a77-4b7e-a829-168707450110/action" status: 202 len: 0 microversion: 2.1 time: 0.379281 Oct 30 02:59:09.698804 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4276/8213] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 30 02:59:09 2022] POST /compute/v2.1/servers/5b3f7d56-1a77-4b7e-a829-168707450110/action => generated 0 bytes in 381 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 30 02:59:14.600310 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:59:14.601528 n-d-master-1 devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=60 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:59:14.602657 n-d-master-1 devstack@n-api.service[121103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 30 02:59:14.603061 n-d-master-1 devstack@n-api.service[121103]: Sun Oct 30 02:59:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.13) !!! Oct 30 02:59:14.615318 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-6bc180bf-a41a-4df8-9b86-5e1d89edbfa5 req-771d8578-8397-48c8-97b9-8e6f8299efaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b3f7d56-1a77-4b7e-a829-168707450110", "name": "network-vif-plugged", "status": "completed", "tag": "d22a2bd2-96f2-4b23-bad7-aa4da5ee1934"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:59:14.626520 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-6bc180bf-a41a-4df8-9b86-5e1d89edbfa5 req-771d8578-8397-48c8-97b9-8e6f8299efaa service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:59:14.627657 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-6bc180bf-a41a-4df8-9b86-5e1d89edbfa5 req-771d8578-8397-48c8-97b9-8e6f8299efaa service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:59:14.628185 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-6bc180bf-a41a-4df8-9b86-5e1d89edbfa5 req-771d8578-8397-48c8-97b9-8e6f8299efaa service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:59:14.640721 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-6bc180bf-a41a-4df8-9b86-5e1d89edbfa5 req-771d8578-8397-48c8-97b9-8e6f8299efaa service nova] Creating event network-vif-plugged:d22a2bd2-96f2-4b23-bad7-aa4da5ee1934 for instance 5b3f7d56-1a77-4b7e-a829-168707450110 on n-h1-master-1 Oct 30 02:59:14.653701 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-6bc180bf-a41a-4df8-9b86-5e1d89edbfa5 req-771d8578-8397-48c8-97b9-8e6f8299efaa service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051437 Oct 30 02:59:14.653701 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3938/8214] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:59:25.957793 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:59:25.959183 n-d-master-1 devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:59:25.963433 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-799267ea-e49d-4dfd-9bc8-2453ab954a2f tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:59:25.963549 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-229e6522-0c86-43e4-b9d7-414d9750ec06 req-215640aa-cec3-41b9-a71d-4cbf2df066ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b3f7d56-1a77-4b7e-a829-168707450110", "tag": "d22a2bd2-96f2-4b23-bad7-aa4da5ee1934"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:59:25.964041 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-799267ea-e49d-4dfd-9bc8-2453ab954a2f tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] [instance: 5b3f7d56-1a77-4b7e-a829-168707450110] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:59:25.971701 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-799267ea-e49d-4dfd-9bc8-2453ab954a2f tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:59:25.972205 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-799267ea-e49d-4dfd-9bc8-2453ab954a2f tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:59:25.972869 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-799267ea-e49d-4dfd-9bc8-2453ab954a2f tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:59:25.973615 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-799267ea-e49d-4dfd-9bc8-2453ab954a2f tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:59:25.974249 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-799267ea-e49d-4dfd-9bc8-2453ab954a2f tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:59:25.974868 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-799267ea-e49d-4dfd-9bc8-2453ab954a2f tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:59:25.979217 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-229e6522-0c86-43e4-b9d7-414d9750ec06 req-215640aa-cec3-41b9-a71d-4cbf2df066ba service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:59:25.979217 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-229e6522-0c86-43e4-b9d7-414d9750ec06 req-215640aa-cec3-41b9-a71d-4cbf2df066ba service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:59:25.979217 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-229e6522-0c86-43e4-b9d7-414d9750ec06 req-215640aa-cec3-41b9-a71d-4cbf2df066ba service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:59:25.988551 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-229e6522-0c86-43e4-b9d7-414d9750ec06 req-215640aa-cec3-41b9-a71d-4cbf2df066ba service nova] Creating event network-changed:d22a2bd2-96f2-4b23-bad7-aa4da5ee1934 for instance 5b3f7d56-1a77-4b7e-a829-168707450110 on n-h1-master-1 Oct 30 02:59:25.993902 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-229e6522-0c86-43e4-b9d7-414d9750ec06 req-215640aa-cec3-41b9-a71d-4cbf2df066ba service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036205 Oct 30 02:59:25.994712 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3939/8215] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:59:26.005702 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-799267ea-e49d-4dfd-9bc8-2453ab954a2f tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] [instance: 5b3f7d56-1a77-4b7e-a829-168707450110] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 02:59:26.310295 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-799267ea-e49d-4dfd-9bc8-2453ab954a2f tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5b3f7d56-1a77-4b7e-a829-168707450110" status: 204 len: 0 microversion: 2.1 time: 0.354884 Oct 30 02:59:26.311282 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4277/8216] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 02:59:25 2022] DELETE /compute/v2.1/servers/5b3f7d56-1a77-4b7e-a829-168707450110 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 02:59:26.321478 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-57037a4b-9053-4bfb-85ff-b77fe530b3eb tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:59:26.322299 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-57037a4b-9053-4bfb-85ff-b77fe530b3eb tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] [instance: 5b3f7d56-1a77-4b7e-a829-168707450110] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:59:26.329058 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-57037a4b-9053-4bfb-85ff-b77fe530b3eb tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:59:26.329811 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-57037a4b-9053-4bfb-85ff-b77fe530b3eb tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:59:26.330317 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-57037a4b-9053-4bfb-85ff-b77fe530b3eb tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:59:26.331150 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-57037a4b-9053-4bfb-85ff-b77fe530b3eb tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:59:26.331779 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-57037a4b-9053-4bfb-85ff-b77fe530b3eb tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:59:26.332358 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-57037a4b-9053-4bfb-85ff-b77fe530b3eb tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:59:26.524543 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-57037a4b-9053-4bfb-85ff-b77fe530b3eb tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6751185089fc469eb6d5db2e13058d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59500d959c9f445eb7b4bb07c464cbb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:59:26.533059 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-57037a4b-9053-4bfb-85ff-b77fe530b3eb tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] 10.222.0.13 "GET /compute/v2.1/servers/5b3f7d56-1a77-4b7e-a829-168707450110" status: 200 len: 1683 microversion: 2.1 time: 0.216538 Oct 30 02:59:26.534409 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3940/8217] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:59:26 2022] GET /compute/v2.1/servers/5b3f7d56-1a77-4b7e-a829-168707450110 => generated 1683 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:59:27.557564 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a8aec446-0185-43db-832c-0af3b9f33066 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:59:27.558273 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a8aec446-0185-43db-832c-0af3b9f33066 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] [instance: 5b3f7d56-1a77-4b7e-a829-168707450110] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:59:27.564968 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a8aec446-0185-43db-832c-0af3b9f33066 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:59:27.565987 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a8aec446-0185-43db-832c-0af3b9f33066 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:59:27.566427 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a8aec446-0185-43db-832c-0af3b9f33066 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:59:27.567119 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a8aec446-0185-43db-832c-0af3b9f33066 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:59:27.567577 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a8aec446-0185-43db-832c-0af3b9f33066 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:59:27.568006 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a8aec446-0185-43db-832c-0af3b9f33066 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:59:27.860429 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-a8aec446-0185-43db-832c-0af3b9f33066 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6751185089fc469eb6d5db2e13058d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59500d959c9f445eb7b4bb07c464cbb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:59:27.868812 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a8aec446-0185-43db-832c-0af3b9f33066 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] 10.222.0.13 "GET /compute/v2.1/servers/5b3f7d56-1a77-4b7e-a829-168707450110" status: 200 len: 1683 microversion: 2.1 time: 0.315540 Oct 30 02:59:27.869406 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4278/8218] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:59:27 2022] GET /compute/v2.1/servers/5b3f7d56-1a77-4b7e-a829-168707450110 => generated 1683 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:59:28.446967 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-165662c4-3fb8-4928-962a-67bb3ea04c7a req-a3e6c847-b9c3-496e-ab42-52e28a00d5d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b3f7d56-1a77-4b7e-a829-168707450110", "name": "network-vif-deleted", "tag": "d22a2bd2-96f2-4b23-bad7-aa4da5ee1934"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:59:28.457936 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-165662c4-3fb8-4928-962a-67bb3ea04c7a req-a3e6c847-b9c3-496e-ab42-52e28a00d5d3 service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:59:28.458449 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-165662c4-3fb8-4928-962a-67bb3ea04c7a req-a3e6c847-b9c3-496e-ab42-52e28a00d5d3 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:59:28.458904 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-165662c4-3fb8-4928-962a-67bb3ea04c7a req-a3e6c847-b9c3-496e-ab42-52e28a00d5d3 service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:59:28.470459 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-165662c4-3fb8-4928-962a-67bb3ea04c7a req-a3e6c847-b9c3-496e-ab42-52e28a00d5d3 service nova] Creating event network-vif-deleted:d22a2bd2-96f2-4b23-bad7-aa4da5ee1934 for instance 5b3f7d56-1a77-4b7e-a829-168707450110 on n-h1-master-1 Oct 30 02:59:28.476321 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-165662c4-3fb8-4928-962a-67bb3ea04c7a req-a3e6c847-b9c3-496e-ab42-52e28a00d5d3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033145 Oct 30 02:59:28.476978 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3941/8219] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:59:28.892607 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-98c895cf-e057-41e4-8f0f-e4ba12de7101 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:59:28.893885 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-98c895cf-e057-41e4-8f0f-e4ba12de7101 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] [instance: 5b3f7d56-1a77-4b7e-a829-168707450110] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:59:28.901028 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-98c895cf-e057-41e4-8f0f-e4ba12de7101 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:59:28.901568 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-98c895cf-e057-41e4-8f0f-e4ba12de7101 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:59:28.902029 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-98c895cf-e057-41e4-8f0f-e4ba12de7101 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:59:28.902749 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-98c895cf-e057-41e4-8f0f-e4ba12de7101 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:59:28.903228 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-98c895cf-e057-41e4-8f0f-e4ba12de7101 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:59:28.903668 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-98c895cf-e057-41e4-8f0f-e4ba12de7101 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:59:28.935493 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-98c895cf-e057-41e4-8f0f-e4ba12de7101 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:59:28.935991 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-98c895cf-e057-41e4-8f0f-e4ba12de7101 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:59:28.936451 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-98c895cf-e057-41e4-8f0f-e4ba12de7101 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:59:28.936918 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-98c895cf-e057-41e4-8f0f-e4ba12de7101 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lazy-loading 'fault' on Instance uuid 5b3f7d56-1a77-4b7e-a829-168707450110 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 02:59:28.978615 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-98c895cf-e057-41e4-8f0f-e4ba12de7101 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6751185089fc469eb6d5db2e13058d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59500d959c9f445eb7b4bb07c464cbb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:59:28.986432 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-98c895cf-e057-41e4-8f0f-e4ba12de7101 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] 10.222.0.13 "GET /compute/v2.1/servers/5b3f7d56-1a77-4b7e-a829-168707450110" status: 200 len: 1338 microversion: 2.1 time: 0.097906 Oct 30 02:59:28.987035 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4279/8220] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:59:28 2022] GET /compute/v2.1/servers/5b3f7d56-1a77-4b7e-a829-168707450110 => generated 1338 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 02:59:30.011197 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4fe605d2-a558-41c0-a7a1-1184a19d3d93 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:59:30.011935 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4fe605d2-a558-41c0-a7a1-1184a19d3d93 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] [instance: 5b3f7d56-1a77-4b7e-a829-168707450110] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:59:30.018164 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4fe605d2-a558-41c0-a7a1-1184a19d3d93 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:59:30.018650 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4fe605d2-a558-41c0-a7a1-1184a19d3d93 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:59:30.019338 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4fe605d2-a558-41c0-a7a1-1184a19d3d93 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:59:30.020036 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4fe605d2-a558-41c0-a7a1-1184a19d3d93 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:59:30.020498 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4fe605d2-a558-41c0-a7a1-1184a19d3d93 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:59:30.020926 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4fe605d2-a558-41c0-a7a1-1184a19d3d93 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:59:30.034165 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-4fe605d2-a558-41c0-a7a1-1184a19d3d93 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] HTTP exception thrown: Instance 5b3f7d56-1a77-4b7e-a829-168707450110 could not be found. Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4fe605d2-a558-41c0-a7a1-1184a19d3d93 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Request method failure captured: Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/5b3f7d56-1a77-4b7e-a829-168707450110 HTTP/1.1 Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXed1c6UCiOejN2rh6iWYB3E1k4_XbdUK5hPgyrhRiuMs9Q_9up2sSGriOdYBE8p9uU975H4YscmYV5gBu12kgRnVfxRADD75qPYRT_4KKT1FAftdjB__znn496mEU1V2ms3IfQwYAWvPqpoha5SvzF5ipT49QxDqLNvU2jRQYdWl9rM Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 59500d959c9f445eb7b4bb07c464cbb4 Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-TestSnapshotPattern-1938181891 Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/59500d959c9f445eb7b4bb07c464cbb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_59500d959c9f445eb7b4bb07c464cbb4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/59500d959c9f445eb7b4bb07c464cbb4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/59500d959c9f445eb7b4bb07c464cbb4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-TestSnapshotPattern-1938181891 Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 59500d959c9f445eb7b4bb07c464cbb4 Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-TestSnapshotPattern-1938181891 Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-TestSnapshotPattern-1938181891-project Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 6751185089fc469eb6d5db2e13058d15 Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-TestSnapshotPattern-1938181891-project Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 5b3f7d56-1a77-4b7e-a829-168707450110 could not be found. Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '5b3f7d56-1a77-4b7e-a829-168707450110'} Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b3f7d56-1a77-4b7e-a829-168707450110 could not be found. Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b3f7d56-1a77-4b7e-a829-168707450110 could not be found. Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:59:30.035785 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:59:30.039595 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:59:30.039595 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:59:30.039595 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:59:30.039595 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:59:30.039595 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:59:30.039595 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b3f7d56-1a77-4b7e-a829-168707450110 could not be found. Oct 30 02:59:30.039595 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:59:30.039595 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4fe605d2-a558-41c0-a7a1-1184a19d3d93 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Returning 404 to user: Instance 5b3f7d56-1a77-4b7e-a829-168707450110 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:59:30.039595 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4fe605d2-a558-41c0-a7a1-1184a19d3d93 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] 10.222.0.13 "GET /compute/v2.1/servers/5b3f7d56-1a77-4b7e-a829-168707450110" status: 404 len: 111 microversion: 2.1 time: 0.031114 Oct 30 02:59:30.039595 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3942/8221] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:59:30 2022] GET /compute/v2.1/servers/5b3f7d56-1a77-4b7e-a829-168707450110 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 02:59:32.345954 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d68467cc-6823-4094-a813-835003c30f76 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:59:32.346465 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d68467cc-6823-4094-a813-835003c30f76 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] [instance: 262f928c-b8f2-4c0d-9f20-6e90690e0108] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:59:32.348888 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-75405683-c2c2-4d47-8692-bf4b193c288c req-9400e374-9f38-4184-aae2-b0594800572d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "262f928c-b8f2-4c0d-9f20-6e90690e0108", "tag": "4a880a91-048a-4faf-b8e3-3d938e672eaa"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:59:32.354171 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d68467cc-6823-4094-a813-835003c30f76 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:59:32.354674 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d68467cc-6823-4094-a813-835003c30f76 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:59:32.355126 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d68467cc-6823-4094-a813-835003c30f76 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:59:32.355945 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d68467cc-6823-4094-a813-835003c30f76 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:59:32.356956 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d68467cc-6823-4094-a813-835003c30f76 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:59:32.357638 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d68467cc-6823-4094-a813-835003c30f76 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:59:32.373223 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-75405683-c2c2-4d47-8692-bf4b193c288c req-9400e374-9f38-4184-aae2-b0594800572d service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:59:32.373809 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-75405683-c2c2-4d47-8692-bf4b193c288c req-9400e374-9f38-4184-aae2-b0594800572d service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:59:32.374249 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-75405683-c2c2-4d47-8692-bf4b193c288c req-9400e374-9f38-4184-aae2-b0594800572d service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:59:32.386217 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-75405683-c2c2-4d47-8692-bf4b193c288c req-9400e374-9f38-4184-aae2-b0594800572d service nova] Creating event network-changed:4a880a91-048a-4faf-b8e3-3d938e672eaa for instance 262f928c-b8f2-4c0d-9f20-6e90690e0108 on n-h2-master-1 Oct 30 02:59:32.386513 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d68467cc-6823-4094-a813-835003c30f76 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] [instance: 262f928c-b8f2-4c0d-9f20-6e90690e0108] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 02:59:32.391530 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-75405683-c2c2-4d47-8692-bf4b193c288c req-9400e374-9f38-4184-aae2-b0594800572d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046528 Oct 30 02:59:32.392473 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3943/8222] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 02:59:32.691908 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d68467cc-6823-4094-a813-835003c30f76 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] 10.222.0.13 "DELETE /compute/v2.1/servers/262f928c-b8f2-4c0d-9f20-6e90690e0108" status: 204 len: 0 microversion: 2.1 time: 0.349610 Oct 30 02:59:32.692589 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4280/8223] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 02:59:32 2022] DELETE /compute/v2.1/servers/262f928c-b8f2-4c0d-9f20-6e90690e0108 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 02:59:32.701312 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9068574e-9f18-4108-81ea-7c26e8a1b4a2 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:59:32.702040 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9068574e-9f18-4108-81ea-7c26e8a1b4a2 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] [instance: 262f928c-b8f2-4c0d-9f20-6e90690e0108] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:59:32.708830 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9068574e-9f18-4108-81ea-7c26e8a1b4a2 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:59:32.709249 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9068574e-9f18-4108-81ea-7c26e8a1b4a2 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:59:32.709722 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9068574e-9f18-4108-81ea-7c26e8a1b4a2 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:59:32.710421 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9068574e-9f18-4108-81ea-7c26e8a1b4a2 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:59:32.710877 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9068574e-9f18-4108-81ea-7c26e8a1b4a2 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:59:32.711431 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9068574e-9f18-4108-81ea-7c26e8a1b4a2 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:59:32.847435 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.policy [None req-9068574e-9f18-4108-81ea-7c26e8a1b4a2 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6751185089fc469eb6d5db2e13058d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59500d959c9f445eb7b4bb07c464cbb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:59:32.856439 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9068574e-9f18-4108-81ea-7c26e8a1b4a2 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] 10.222.0.13 "GET /compute/v2.1/servers/262f928c-b8f2-4c0d-9f20-6e90690e0108" status: 200 len: 1683 microversion: 2.1 time: 0.159343 Oct 30 02:59:32.857140 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3944/8224] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:59:32 2022] GET /compute/v2.1/servers/262f928c-b8f2-4c0d-9f20-6e90690e0108 => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:59:33.880595 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7dbd258c-63cf-4b84-ab7d-372ce646c944 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:59:33.881319 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7dbd258c-63cf-4b84-ab7d-372ce646c944 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] [instance: 262f928c-b8f2-4c0d-9f20-6e90690e0108] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:59:33.888157 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7dbd258c-63cf-4b84-ab7d-372ce646c944 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:59:33.888667 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7dbd258c-63cf-4b84-ab7d-372ce646c944 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:59:33.889125 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7dbd258c-63cf-4b84-ab7d-372ce646c944 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:59:33.889903 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7dbd258c-63cf-4b84-ab7d-372ce646c944 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:59:33.890366 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7dbd258c-63cf-4b84-ab7d-372ce646c944 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:59:33.890807 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7dbd258c-63cf-4b84-ab7d-372ce646c944 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:59:34.057268 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-7dbd258c-63cf-4b84-ab7d-372ce646c944 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6751185089fc469eb6d5db2e13058d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59500d959c9f445eb7b4bb07c464cbb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:59:34.065785 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7dbd258c-63cf-4b84-ab7d-372ce646c944 tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] 10.222.0.13 "GET /compute/v2.1/servers/262f928c-b8f2-4c0d-9f20-6e90690e0108" status: 200 len: 1683 microversion: 2.1 time: 0.188943 Oct 30 02:59:34.066364 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4281/8225] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:59:33 2022] GET /compute/v2.1/servers/262f928c-b8f2-4c0d-9f20-6e90690e0108 => generated 1683 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:59:34.972471 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-183bd07b-011b-4ebe-b1f9-039dcf1c1e20 req-4ac38d36-ec41-4566-983c-a3db8f5bb0cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "262f928c-b8f2-4c0d-9f20-6e90690e0108", "name": "network-vif-deleted", "tag": "4a880a91-048a-4faf-b8e3-3d938e672eaa"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 02:59:34.981960 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-183bd07b-011b-4ebe-b1f9-039dcf1c1e20 req-4ac38d36-ec41-4566-983c-a3db8f5bb0cd service nova] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:59:34.982437 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-183bd07b-011b-4ebe-b1f9-039dcf1c1e20 req-4ac38d36-ec41-4566-983c-a3db8f5bb0cd service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:59:34.984149 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-183bd07b-011b-4ebe-b1f9-039dcf1c1e20 req-4ac38d36-ec41-4566-983c-a3db8f5bb0cd service nova] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:59:34.994928 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-183bd07b-011b-4ebe-b1f9-039dcf1c1e20 req-4ac38d36-ec41-4566-983c-a3db8f5bb0cd service nova] Creating event network-vif-deleted:4a880a91-048a-4faf-b8e3-3d938e672eaa for instance 262f928c-b8f2-4c0d-9f20-6e90690e0108 on n-h2-master-1 Oct 30 02:59:34.999852 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-183bd07b-011b-4ebe-b1f9-039dcf1c1e20 req-4ac38d36-ec41-4566-983c-a3db8f5bb0cd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087891 Oct 30 02:59:35.000436 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3945/8226] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 30 02:59:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 02:59:35.089127 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ae5ddf13-932b-4d82-bcc0-068b77d70e2a tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:59:35.089788 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ae5ddf13-932b-4d82-bcc0-068b77d70e2a tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] [instance: 262f928c-b8f2-4c0d-9f20-6e90690e0108] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:59:35.097136 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae5ddf13-932b-4d82-bcc0-068b77d70e2a tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:59:35.097663 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae5ddf13-932b-4d82-bcc0-068b77d70e2a tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:59:35.098112 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae5ddf13-932b-4d82-bcc0-068b77d70e2a tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:59:35.098847 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae5ddf13-932b-4d82-bcc0-068b77d70e2a tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:59:35.099319 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae5ddf13-932b-4d82-bcc0-068b77d70e2a tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:59:35.099756 n-d-master-1 devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ae5ddf13-932b-4d82-bcc0-068b77d70e2a tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:59:35.164257 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.policy [None req-ae5ddf13-932b-4d82-bcc0-068b77d70e2a tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6751185089fc469eb6d5db2e13058d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59500d959c9f445eb7b4bb07c464cbb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 02:59:35.174316 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ae5ddf13-932b-4d82-bcc0-068b77d70e2a tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] 10.222.0.13 "GET /compute/v2.1/servers/262f928c-b8f2-4c0d-9f20-6e90690e0108" status: 200 len: 1497 microversion: 2.1 time: 0.088991 Oct 30 02:59:35.184180 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4282/8227] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:59:35 2022] GET /compute/v2.1/servers/262f928c-b8f2-4c0d-9f20-6e90690e0108 => generated 1497 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 02:59:36.199186 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e7ef3e27-b779-487c-94eb-e34eb1693bdc tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:59:36.199892 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e7ef3e27-b779-487c-94eb-e34eb1693bdc tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] [instance: 262f928c-b8f2-4c0d-9f20-6e90690e0108] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 02:59:36.206144 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7ef3e27-b779-487c-94eb-e34eb1693bdc tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:59:36.206639 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7ef3e27-b779-487c-94eb-e34eb1693bdc tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:59:36.207078 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7ef3e27-b779-487c-94eb-e34eb1693bdc tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:59:36.207774 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7ef3e27-b779-487c-94eb-e34eb1693bdc tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Acquiring lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 02:59:36.208251 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7ef3e27-b779-487c-94eb-e34eb1693bdc tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 02:59:36.208702 n-d-master-1 devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7ef3e27-b779-487c-94eb-e34eb1693bdc tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Lock "7a264aef-b8bb-4843-8958-43bc38c25cb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 02:59:36.224661 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-e7ef3e27-b779-487c-94eb-e34eb1693bdc tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] HTTP exception thrown: Instance 262f928c-b8f2-4c0d-9f20-6e90690e0108 could not be found. Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e7ef3e27-b779-487c-94eb-e34eb1693bdc tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Request method failure captured: Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/262f928c-b8f2-4c0d-9f20-6e90690e0108 HTTP/1.1 Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: Accept: application/json Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: Accept-Encoding: identity Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: Connection: close Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: Content-Length: 0 Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: Content-Type: application/json Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: Host: 10.222.0.13 Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: Openstack-System-Scope: None Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjXed1c6UCiOejN2rh6iWYB3E1k4_XbdUK5hPgyrhRiuMs9Q_9up2sSGriOdYBE8p9uU975H4YscmYV5gBu12kgRnVfxRADD75qPYRT_4KKT1FAftdjB__znn496mEU1V2ms3IfQwYAWvPqpoha5SvzF5ipT49QxDqLNvU2jRQYdWl9rM Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Id: None Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: X-Domain-Name: None Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: X-Identity-Status: Confirmed Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: X-Is-Admin-Project: True Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Id: default Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: X-Project-Domain-Name: Default Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: X-Project-Id: 59500d959c9f445eb7b4bb07c464cbb4 Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: X-Project-Name: tempest-TestSnapshotPattern-1938181891 Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: X-Role: member,reader Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: X-Roles: member,reader Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/59500d959c9f445eb7b4bb07c464cbb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_59500d959c9f445eb7b4bb07c464cbb4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/59500d959c9f445eb7b4bb07c464cbb4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/59500d959c9f445eb7b4bb07c464cbb4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}] Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: X-Tenant: tempest-TestSnapshotPattern-1938181891 Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Id: 59500d959c9f445eb7b4bb07c464cbb4 Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: X-Tenant-Name: tempest-TestSnapshotPattern-1938181891 Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: X-User: tempest-TestSnapshotPattern-1938181891-project Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Id: default Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: X-User-Domain-Name: Default Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: X-User-Id: 6751185089fc469eb6d5db2e13058d15 Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: X-User-Name: tempest-TestSnapshotPattern-1938181891-project Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: method: > Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: exception: Instance 262f928c-b8f2-4c0d-9f20-6e90690e0108 could not be found. Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: action_args: {'id': '262f928c-b8f2-4c0d-9f20-6e90690e0108'} Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 262f928c-b8f2-4c0d-9f20-6e90690e0108 could not be found. Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 262f928c-b8f2-4c0d-9f20-6e90690e0108 could not be found. Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 02:59:36.226379 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:59:36.229739 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 02:59:36.229739 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 02:59:36.229739 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 02:59:36.229739 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 02:59:36.229739 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 02:59:36.229739 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 262f928c-b8f2-4c0d-9f20-6e90690e0108 could not be found. Oct 30 02:59:36.229739 n-d-master-1 devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Oct 30 02:59:36.229739 n-d-master-1 devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e7ef3e27-b779-487c-94eb-e34eb1693bdc tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Returning 404 to user: Instance 262f928c-b8f2-4c0d-9f20-6e90690e0108 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 02:59:36.229739 n-d-master-1 devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e7ef3e27-b779-487c-94eb-e34eb1693bdc tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] 10.222.0.13 "GET /compute/v2.1/servers/262f928c-b8f2-4c0d-9f20-6e90690e0108" status: 404 len: 111 microversion: 2.1 time: 0.033934 Oct 30 02:59:36.229739 n-d-master-1 devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3946/8228] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 02:59:36 2022] GET /compute/v2.1/servers/262f928c-b8f2-4c0d-9f20-6e90690e0108 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 02:59:36.438627 n-d-master-1 devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e9e2c9e6-bb32-42aa-854c-d930ab0dc8ae tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] Calling method '.version_select at 0x7f44c44ca9d0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 02:59:36.531313 n-d-master-1 devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e9e2c9e6-bb32-42aa-854c-d930ab0dc8ae tempest-TestSnapshotPattern-1938181891 tempest-TestSnapshotPattern-1938181891-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-261469712" status: 202 len: 0 microversion: 2.1 time: 0.096535 Oct 30 02:59:36.532121 n-d-master-1 devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4283/8229] 10.222.0.13 () {58 vars in 1254 bytes} [Sun Oct 30 02:59:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-261469712 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)